-- Logs begin at Sat 2022-10-22 20:01:24 UTC, end at Sat 2022-10-22 22:43:52 UTC. -- Oct 22 20:37:16.982965 ncdv-master-1 systemd[1]: Starting Devstack devstack@n-api.service... Oct 22 20:37:16.992028 ncdv-master-1 devstack@n-api.service[122301]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 22 20:37:16.994043 ncdv-master-1 devstack@n-api.service[122301]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat Oct 22 20:37:16 2022] *** Oct 22 20:37:16.994043 ncdv-master-1 devstack@n-api.service[122301]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 22 20:37:16.994043 ncdv-master-1 devstack@n-api.service[122301]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 22 20:37:16.994043 ncdv-master-1 devstack@n-api.service[122301]: nodename: ncdv-master-1 Oct 22 20:37:16.994043 ncdv-master-1 devstack@n-api.service[122301]: machine: x86_64 Oct 22 20:37:16.994043 ncdv-master-1 devstack@n-api.service[122301]: clock source: unix Oct 22 20:37:16.994043 ncdv-master-1 devstack@n-api.service[122301]: pcre jit disabled Oct 22 20:37:16.994043 ncdv-master-1 devstack@n-api.service[122301]: detected number of CPU cores: 4 Oct 22 20:37:16.994043 ncdv-master-1 devstack@n-api.service[122301]: current working directory: / Oct 22 20:37:16.994043 ncdv-master-1 devstack@n-api.service[122301]: detected binary path: /usr/bin/uwsgi-core Oct 22 20:37:16.994043 ncdv-master-1 devstack@n-api.service[122301]: your processes number limit is 47680 Oct 22 20:37:16.994043 ncdv-master-1 devstack@n-api.service[122301]: your memory page size is 4096 bytes Oct 22 20:37:16.994043 ncdv-master-1 devstack@n-api.service[122301]: detected max file descriptor number: 2048 Oct 22 20:37:16.994043 ncdv-master-1 devstack@n-api.service[122301]: lock engine: pthread robust mutexes Oct 22 20:37:16.995021 ncdv-master-1 devstack@n-api.service[122301]: thunder lock: enabled Oct 22 20:37:16.995021 ncdv-master-1 devstack@n-api.service[122301]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 22 20:37:16.995021 ncdv-master-1 devstack@n-api.service[122301]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 22 20:37:17.037621 ncdv-master-1 devstack@n-api.service[122301]: Python main interpreter initialized at 0x55a89191d9c0 Oct 22 20:37:17.037621 ncdv-master-1 devstack@n-api.service[122301]: python threads support enabled Oct 22 20:37:17.037621 ncdv-master-1 devstack@n-api.service[122301]: your server socket listen backlog is limited to 100 connections Oct 22 20:37:17.037621 ncdv-master-1 devstack@n-api.service[122301]: your mercy for graceful operations on workers is 90 seconds Oct 22 20:37:17.037985 ncdv-master-1 devstack@n-api.service[122301]: mapped 403077 bytes (393 KB) for 2 cores Oct 22 20:37:17.037985 ncdv-master-1 devstack@n-api.service[122301]: *** Operational MODE: preforking *** Oct 22 20:37:17.038270 ncdv-master-1 devstack@n-api.service[122301]: *** uWSGI is running in multiple interpreter mode *** Oct 22 20:37:17.038270 ncdv-master-1 devstack@n-api.service[122301]: spawned uWSGI master process (pid: 122301) Oct 22 20:37:17.038470 ncdv-master-1 systemd[1]: Started Devstack devstack@n-api.service. Oct 22 20:37:17.039473 ncdv-master-1 devstack@n-api.service[122301]: spawned uWSGI worker 1 (pid: 122302, cores: 1) Oct 22 20:37:17.039473 ncdv-master-1 devstack@n-api.service[122301]: spawned uWSGI worker 2 (pid: 122303, cores: 1) Oct 22 20:37:17.039473 ncdv-master-1 devstack@n-api.service[122301]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 22 20:37:18.314046 ncdv-master-1 devstack@n-api.service[122303]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 22 20:37:18.315124 ncdv-master-1 devstack@n-api.service[122302]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 22 20:37:18.981019 ncdv-master-1 devstack@n-api.service[122303]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 22 20:37:18.981019 ncdv-master-1 devstack@n-api.service[122303]: from cryptography.utils import int_from_bytes Oct 22 20:37:18.981314 ncdv-master-1 devstack@n-api.service[122303]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 22 20:37:18.981314 ncdv-master-1 devstack@n-api.service[122303]: from cryptography.utils import int_from_bytes Oct 22 20:37:18.981429 ncdv-master-1 devstack@n-api.service[122302]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 22 20:37:18.981429 ncdv-master-1 devstack@n-api.service[122302]: from cryptography.utils import int_from_bytes Oct 22 20:37:18.981684 ncdv-master-1 devstack@n-api.service[122302]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 22 20:37:18.981684 ncdv-master-1 devstack@n-api.service[122302]: from cryptography.utils import int_from_bytes Oct 22 20:37:21.518095 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 22 20:37:21.518785 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 22 20:37:21.519132 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 22 20:37:21.519228 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 22 20:37:21.519298 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 22 20:37:21.519390 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 22 20:37:21.519460 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 22 20:37:21.519541 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 22 20:37:21.519609 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 22 20:37:21.519682 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 22 20:37:21.519882 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.519969 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.520158 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.520302 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.520466 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.520628 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.520773 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.520878 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.521092 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.521240 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.521373 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.521493 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.521701 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.521834 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.521966 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.522071 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.522317 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.522451 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.522557 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.522635 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.522854 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.523005 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.523151 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] console_host = ncdv-master-1 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.523243 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] console_host = ncdv-master-1 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.523483 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.523575 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.523779 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.523890 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.524076 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.524171 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.524378 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.524467 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.524672 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.524768 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.524983 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.525077 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.525274 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.525369 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.525768 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.526175 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.526175 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.526415 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.526539 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.526662 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.526768 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.526879 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.527073 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.527195 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.527451 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.527555 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.527758 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.527853 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.528068 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.528161 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.528371 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.528557 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.528693 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.528791 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.528988 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.529088 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.529377 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] host = ncdv-master-1 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.529466 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] host = ncdv-master-1 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.529677 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.529772 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.529978 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.530115 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.530284 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.530372 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.530675 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.530784 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.530956 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.531041 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.531256 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.531364 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.531595 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.531725 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.531909 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.531997 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.532205 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.532297 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.532524 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.532618 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.532835 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.532995 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.533150 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.533242 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.533442 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.533535 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.533733 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.533836 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.534029 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.534126 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.534323 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.534411 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.534629 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.534742 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.534920 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.535011 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.535211 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.535299 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.535486 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.535582 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.535771 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.535861 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.536077 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.536174 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.536386 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.536488 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.536696 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.536788 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.536942 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.537042 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.537187 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.537277 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.537495 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.537621 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.537806 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.537907 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.538104 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.538192 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.538400 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.538500 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.538695 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.538796 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.538989 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.539079 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.539283 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.539405 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.539604 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.539700 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.539899 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.539989 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.540195 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.540284 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.540500 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.540589 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.540804 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.540893 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.541119 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.541220 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.541415 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.541504 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.541724 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.541827 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.542108 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.18 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.542205 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.18 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.542385 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.18 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.542530 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.18 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.542651 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.542745 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.543151 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.543471 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.543574 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.543658 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.543758 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.543841 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.544042 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.544190 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.544328 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.544426 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.544652 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.544784 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.544948 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.545094 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.545218 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.545313 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.545556 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.545688 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.545864 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.546014 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.546130 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.546231 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.546399 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.546541 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.546651 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.546733 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.546976 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.547108 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.547328 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.547530 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.547635 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.547727 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.547891 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.548066 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.548161 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.548241 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.548466 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.548601 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.548765 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.548909 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.549032 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.549131 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.549347 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.549480 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.549639 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.549731 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.549922 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.550011 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.550212 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.550366 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.550516 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.550613 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.550801 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.550902 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.551098 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.551198 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.551391 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.551482 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.551720 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.551824 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.552026 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.552114 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.552324 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.552415 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.552619 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.552720 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.552885 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.553025 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.553198 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.553329 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.553508 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.553596 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.553804 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.553893 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.554100 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.554188 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.554408 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.554509 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.554697 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.554786 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.554993 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.555081 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.555300 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.555429 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.555626 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.555716 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.555918 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.556006 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.556226 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.556324 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.556515 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.556603 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.556813 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.556901 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.557118 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.557214 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.557420 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.557509 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.557695 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.557781 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.557986 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.558073 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.558277 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.558367 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.558652 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.558744 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.558959 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.559086 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.559249 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.559379 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.559569 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.559666 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.559858 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.559943 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.560165 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.560264 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.560475 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.560559 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.560772 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.560857 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.561076 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.561170 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.561371 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.561464 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.561684 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.561793 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:37:21.562004 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.562098 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.562326 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.562427 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.562656 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.562740 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.562961 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.563089 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.563286 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.563461 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.563633 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.563725 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.563944 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.564030 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.564246 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.564332 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.564551 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.564634 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.564868 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.564953 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.565171 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.565266 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.565473 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.565558 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.565777 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.565862 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.566086 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.566191 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.566398 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.566484 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.566718 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.566802 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.567022 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.567108 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.567330 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.567462 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.567662 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.567747 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.567964 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.568051 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.568271 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.568363 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.568588 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.568674 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.568898 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.568992 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.569199 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.569293 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.569526 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.569611 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.569862 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.569947 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.570164 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.570249 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.570478 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.570615 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.570789 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.570889 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.571089 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.571181 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.571410 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.571513 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.571714 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.571800 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.572036 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.572122 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.572339 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.572468 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.572640 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.572724 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.572946 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.573030 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.573251 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.573351 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.573562 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.573647 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.573863 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.573947 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.574190 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.574332 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.574485 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.574570 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.574783 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.574912 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.575084 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.575219 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.575434 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.575569 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.575746 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.575878 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.576060 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.576193 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.576366 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.576504 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.576670 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.576810 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.576980 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.577124 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.577293 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.577428 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.577596 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.577734 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.577901 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.578038 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.578198 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.578340 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.578494 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.578640 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.578791 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.578939 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.579092 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.579239 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.579410 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.579570 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.579727 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.579883 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.580047 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.580203 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.580344 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.580502 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.580671 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.580827 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.580968 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.581130 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.581269 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.581435 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.581569 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.581737 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.581871 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.582041 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.582167 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.582336 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.582468 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.582641 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.582768 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.582928 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.583062 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.583228 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.583400 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.583564 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.583693 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.583864 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.583985 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.584161 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.584296 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.584473 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.584592 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.584768 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.584890 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.585066 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.585193 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.585369 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.585493 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.585670 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.585794 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.585972 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.586099 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.586276 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.586398 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.586575 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.586710 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.586886 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.587012 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.587190 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.587323 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.587515 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.587670 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.587839 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.587990 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.588161 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.588289 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.588455 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.588604 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.588767 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.588918 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.589081 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.589226 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.589389 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.589525 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.589685 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.589920 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.590167 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.590354 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.590465 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.590552 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.590761 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.590847 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.591056 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.591150 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.591377 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.591489 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.591676 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.591773 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.591969 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.592076 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.592261 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.592356 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.592566 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.592670 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.592849 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.592947 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.593151 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.593255 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.593448 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.593538 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.593742 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.593831 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.594036 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.594124 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.594330 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.594419 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.594651 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.594740 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.594945 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.595042 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.595274 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.595398 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.595624 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.595714 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.595937 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.596053 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.596242 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.596360 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.596549 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.596665 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.596851 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.596973 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.597162 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.597258 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.597464 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.597551 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.597769 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.597856 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.598079 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.598173 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.598381 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.598466 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.598691 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.598784 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.598993 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.599087 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.599301 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.599441 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.599627 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.599721 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.599926 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.600012 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.600219 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.600317 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.600516 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.600600 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.600822 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.600956 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.601151 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.601235 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.601460 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.601546 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.601766 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.601859 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.602381 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.602472 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.602686 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.602779 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.602990 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.603076 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.603288 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.603424 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.603617 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.603710 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.603921 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.604020 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.604222 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.604308 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.604521 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.604615 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.604822 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.604907 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.605120 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.605209 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.605452 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.605556 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.605769 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.605960 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.606054 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.606203 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.606368 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.606469 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.606666 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.606762 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.606974 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.607060 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.607291 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.607435 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.607619 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.607705 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.607924 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.608009 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.608226 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.608316 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.608526 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.608610 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.608825 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.608909 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.609127 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.609220 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.609426 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.609510 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.609722 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.609814 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.610021 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.610108 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.610323 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.610410 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.610623 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.610707 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.610921 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.611050 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.611216 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.611300 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.611537 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.611633 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.611842 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.611928 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.612137 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.612281 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.612431 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.612526 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.612725 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.612810 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.613027 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.613113 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.613325 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.613417 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.613628 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.613712 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.613993 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.614088 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.614227 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.614327 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.614522 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.614612 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.614814 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.614912 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.615119 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.615214 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.615438 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.615527 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.615734 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.615821 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.616026 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.616112 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.616324 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.616409 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.616643 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.616729 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.616938 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.617024 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.617232 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.617316 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.617539 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.617625 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.617835 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.617921 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.618139 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.618268 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.618437 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.618531 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.618737 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.618822 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.619039 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.619124 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.619357 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.619457 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.619667 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.619759 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.619965 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.620049 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.620265 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.620358 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.620564 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.620651 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.620863 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.620947 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.621237 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.621337 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.621553 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.621646 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.621852 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.621944 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.622157 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.622244 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.622460 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.622545 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.622757 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.622852 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.623060 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.623180 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.623387 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.623647 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.623948 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.624049 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.624270 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.624366 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.624578 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.624662 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.624895 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.624980 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.625213 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.625311 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.625534 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.625629 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.625854 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.625938 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.626156 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.626240 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.626454 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.626542 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.626759 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.626844 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.627062 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.627217 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.627376 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.627465 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.627679 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.627766 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.627974 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.628059 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.628272 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.628357 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.628564 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.628648 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.628856 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.628940 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.629151 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.629245 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.629443 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.629528 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.629734 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.629827 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.630028 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.630112 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.630324 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.630421 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.630615 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.630708 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.630908 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.630992 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.631201 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.631321 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.631519 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.631624 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.631829 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.631921 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.632125 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.632209 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.632418 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.632512 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.632714 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.632824 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.633014 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.633119 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.633375 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.633465 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.633630 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.633750 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.633961 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.634195 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.634303 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.634523 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.634614 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.634857 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.634948 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.635159 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.635257 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.635486 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.635585 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.635781 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.635869 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.636079 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.636181 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.636374 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.636462 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.636695 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.636797 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.637000 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.637091 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.637299 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.637390 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.637593 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.637683 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.637895 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.637985 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.638195 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.638293 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.638496 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.638582 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.638794 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.638885 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.639084 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.639172 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.639402 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.639505 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.639698 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.639788 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.639990 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.640079 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.640284 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.640388 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.640575 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.640664 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.640868 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.640958 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.641161 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.641292 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.641455 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.641548 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.641746 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.641833 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.642042 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.642138 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.642335 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.642429 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.642628 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.642776 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.642920 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.645561 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.645561 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.645799 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.645799 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.646015 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.646015 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.646220 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.646220 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.646432 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.646538 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.646648 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.646648 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.646851 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.646954 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.647057 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.647159 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.647262 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.647440 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.648026 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.648150 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.648263 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.648347 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.648435 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.648531 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.648597 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.648597 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.648779 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.648779 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.648938 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.649016 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.649102 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.649190 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.649277 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.649369 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.649448 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.649525 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.649602 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.649678 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.649755 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.649841 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.649932 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.650011 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.650089 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.650177 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.650269 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.650356 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.650443 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.650532 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.650610 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.650694 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.650780 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.650858 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.650943 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.651020 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.651104 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.651183 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.651268 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.651437 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.651530 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.651530 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.651674 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.651794 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.651895 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.652126 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.652213 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.652483 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.652585 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.652786 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.652885 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.653098 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.653185 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.653402 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.653486 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.653689 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.653786 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.653991 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.654077 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.654287 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.654373 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.654587 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.654674 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.654881 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.654967 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.655182 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.655267 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.655505 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.655595 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.655801 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.655886 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.656103 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.656189 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.656397 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.656484 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.656695 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.656780 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.656999 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.657091 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.657300 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.657386 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.657611 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.657696 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.657903 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.657997 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.658204 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.658289 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.658503 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.658587 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.658800 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.658901 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.659098 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.659189 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.659417 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.659520 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.659724 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.659818 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.660025 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.660110 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.660325 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.660409 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.660628 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.660726 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.660928 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.661019 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.661228 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.661314 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.661526 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.661665 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.661816 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.661915 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.662113 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.662197 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.662411 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.662498 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.662707 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.662793 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.663005 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.663089 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.663306 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.663421 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.663624 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.663753 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.663922 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.664021 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.664217 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.664302 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.664516 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.664645 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.664811 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.664952 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.665236 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.665322 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.665536 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.665621 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.665834 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.665928 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.666133 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.666227 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.666434 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.666518 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.666736 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.666830 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.667036 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.667120 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.667352 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.667542 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.667641 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.667861 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.668092 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.668188 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.668452 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.668542 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.668773 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.668859 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.669072 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.669161 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.669369 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.669452 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.669667 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.669754 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.669963 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.670047 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.670261 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.670346 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.670554 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.670640 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.670850 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.670936 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.671145 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.671240 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.671484 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.671589 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.671834 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.671930 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.672146 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.672243 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.672465 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.672552 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.672870 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.672956 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.673173 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.673267 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.673476 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.673638 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.673792 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.673937 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.674106 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.674240 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.674422 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.674553 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.674722 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.674867 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.675026 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.675182 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.675328 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.675505 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.675667 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.675813 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.675986 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.676122 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.676293 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.676440 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.676599 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.676755 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.676898 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.677059 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.677220 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.677368 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.677532 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.677665 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.677837 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.677979 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.678151 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.678294 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.678556 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.678644 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.678874 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.678960 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.679178 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.679301 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.679522 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.679612 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.679840 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.679934 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.680139 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.680232 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.680439 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.680524 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.680742 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.680840 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.681043 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.681128 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.681343 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.681428 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.681654 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.681750 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.681954 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.682041 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.682239 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.682325 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.682537 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.682635 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.682837 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.682930 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.683135 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.683230 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.683458 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.683593 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.683827 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.683914 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.684125 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.684217 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.684444 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.684541 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.684750 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.684846 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.685066 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.685153 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.685374 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.685460 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.685667 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.685753 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.685981 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.686066 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.686282 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.686368 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.686579 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.686664 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.686879 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.686973 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.687177 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.687261 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.687500 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.687588 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.687804 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.687902 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.688120 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.688205 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.688425 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.688510 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.688739 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.688838 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.689040 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.689124 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.689364 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.689451 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.689664 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.689763 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.689980 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.690066 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.690282 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.690366 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.690591 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.690678 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.690906 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.691025 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.691192 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.691276 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.691513 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.691603 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.691814 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.691899 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.692112 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.692209 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.692405 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.692492 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.692700 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.692785 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.692999 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.693093 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.693293 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.693379 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.693588 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.693673 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.693880 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.693973 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.694176 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.694270 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.694472 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.694558 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.694782 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.694876 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.695077 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.695176 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.695400 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.695491 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.695690 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.695789 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.695986 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.696071 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.696280 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.696364 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.696576 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.696674 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.696903 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.696988 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.697211 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.697296 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.697526 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.697614 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.697836 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.697921 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.698146 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.698231 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.698454 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.698541 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.698760 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.698845 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.699067 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.699265 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.699488 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.699579 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.699803 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.699890 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.700108 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.700200 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.700419 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.700506 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.700723 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.700808 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.701028 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.701127 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.701333 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.701561 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.701647 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.701885 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.702160 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.702296 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.702476 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.702578 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.702779 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.702876 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.703077 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.703188 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.703399 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.703497 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.703704 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.703801 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.704004 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.704128 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.704304 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.704406 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.704604 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.704699 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.704927 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.705024 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.705240 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.705326 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.705556 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.705649 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.705867 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.705953 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.706179 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.706265 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.706487 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.706646 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.706794 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.706880 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.707095 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.707180 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.707429 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.707535 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.707739 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.707834 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.708050 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.708135 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.708356 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.708444 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.708664 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.708770 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.708967 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.709063 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.709268 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.709364 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.709569 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.709665 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.709870 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.709966 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.710171 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.710268 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.710471 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.710565 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.710772 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.710881 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.711073 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.711170 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.711394 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.711492 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.711703 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.711812 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.712009 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.712124 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.712319 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.712414 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.712623 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.712727 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.712927 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.713024 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.713227 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.713322 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.713531 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.713725 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.713828 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.714029 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.714389 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.714493 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.714625 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.714724 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.714966 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.715078 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.715280 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.715458 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.715619 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.715776 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.715934 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.716097 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.716242 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.716396 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.716561 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.716697 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.716856 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.717003 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.717153 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.717310 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.717455 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.717608 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.717758 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.717921 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.718054 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.718222 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.718365 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.718518 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.718665 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.718831 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.718943 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.719187 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.719287 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.719567 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.719665 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.720005 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.720100 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.720315 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.720411 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.720631 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.720726 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.720948 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.721053 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.721256 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.721394 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.721553 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.721688 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.721869 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.722012 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.722170 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.722327 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.722476 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.722620 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.722763 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.722927 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.723072 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.723224 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.723393 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.723556 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.723702 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.723854 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.723997 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.724140 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.724291 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.724452 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.724676 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.724829 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.724997 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.725141 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.725294 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.725446 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.725598 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.725742 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.725886 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.726028 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.726170 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.726312 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.726462 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.726606 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.726749 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.726912 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.727392 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.727667 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.727842 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.727990 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.728133 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.728276 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.728419 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.728571 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.728725 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.728869 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.729014 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.729172 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.729326 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.729502 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.729656 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.729801 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.729945 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.730088 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.730230 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.730426 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.730578 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.730722 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.730865 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.731009 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.731009 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.731311 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.731479 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.731624 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.731768 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.731910 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.732066 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.732210 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.732353 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.732495 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.732638 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.732780 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.732986 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.733146 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.733290 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.733433 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.733576 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.733718 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.733870 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.734013 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.734013 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.734294 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.734294 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.734565 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.734804 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.734956 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.735112 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.735257 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.735421 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.735652 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.735800 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.735945 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.736096 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.736240 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.736383 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.736534 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.736680 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.736872 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.737039 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.737184 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.737329 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.737481 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.737639 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.737789 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.737933 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.738075 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.738231 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.738377 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.738520 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.738671 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.738815 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.738968 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.739126 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.739271 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.739477 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.739624 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.739770 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.739911 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.740064 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.740217 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.740362 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.740513 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.740657 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.740820 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.740964 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.741108 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.741254 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.741407 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.741407 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.741688 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.741688 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.741981 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.742125 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.742267 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.742410 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.742562 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.742724 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.742868 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.743011 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.743156 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.743325 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.743505 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.743608 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.743686 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.743769 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.743847 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.743847 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.743978 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.744058 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.744144 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.744225 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.744292 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.744484 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.744660 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.744763 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.745137 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.745417 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.745551 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.745724 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.745858 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.746040 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.746185 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.746383 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.746531 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.746685 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.746819 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.747000 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.747134 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.747306 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.747484 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.747652 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.747785 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.747927 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.748018 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.748287 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.748415 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.748555 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.748645 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.748869 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.748959 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.749188 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.749287 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.749485 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.749592 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.749769 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.749955 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.750112 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.750247 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.750380 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.750521 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.750655 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.750787 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.750932 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.751066 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.751198 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.751330 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.751513 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.751661 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.751807 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.751940 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.752078 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.752210 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.752376 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.752520 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.752653 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.752785 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.752950 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.753086 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.753225 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.753365 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.753523 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.753673 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.753806 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.753945 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.754080 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.754221 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.754357 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.754496 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.754648 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.754777 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.754920 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.755146 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.755282 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.755476 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.755611 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.755742 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.755885 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.756019 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.756159 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.756300 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.756432 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.756564 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.756704 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.756836 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.756974 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.757108 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.757253 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.757392 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.757538 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.757670 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.757802 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.757935 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.758144 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.758352 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.758499 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.758638 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.758772 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.758914 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.759048 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.759201 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.759388 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.759543 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.759689 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.759840 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.759983 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.760142 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.760289 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.760432 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.760575 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.760727 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.760870 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.761034 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.761180 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.761324 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.761468 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.761654 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.761815 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.761961 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.762114 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.762259 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.762404 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.762547 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.762771 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.762919 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.763075 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.763219 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.763414 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.763567 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.763725 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.763870 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.764014 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.764158 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.764300 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.764461 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.764618 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.764769 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.764931 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.765075 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.765325 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.765489 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.765636 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.765786 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.765930 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.766073 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.766216 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.766368 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.766514 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.766659 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.766813 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.766958 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.766958 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.767241 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.767404 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.767552 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.767709 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.767861 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.768206 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.768367 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.768367 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.768642 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.768786 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.768941 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.768941 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.769224 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.769224 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.769504 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.769648 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.769798 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.769951 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.770102 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.770246 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.770398 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.770542 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.770694 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.770851 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.770995 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.771140 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.771283 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.771468 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.771630 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.771630 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.771905 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.772064 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=122303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 22 20:37:21.772210 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:37:21.772210 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=122302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 22 20:37:21.835982 ncdv-master-1 devstack@n-api.service[122303]: INFO dbcounter [None req-4bb788af-3d8e-42d2-9a01-f8ab4a6f3e48 None None] Registered counter for database nova_api Oct 22 20:37:21.836259 ncdv-master-1 devstack@n-api.service[122302]: INFO dbcounter [None req-e1e37b9c-0522-415b-b451-57859adc4424 None None] Registered counter for database nova_api Oct 22 20:37:21.859218 ncdv-master-1 devstack@n-api.service[122303]: DEBUG oslo_db.sqlalchemy.engines [None req-4bb788af-3d8e-42d2-9a01-f8ab4a6f3e48 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122303) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 22 20:37:21.861157 ncdv-master-1 devstack@n-api.service[122302]: DEBUG oslo_db.sqlalchemy.engines [None req-e1e37b9c-0522-415b-b451-57859adc4424 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122302) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 22 20:37:21.866097 ncdv-master-1 devstack@n-api.service[122303]: DEBUG dbcounter [-] [122303] Writer thread running {{(pid=122303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 22 20:37:21.867656 ncdv-master-1 devstack@n-api.service[122302]: DEBUG dbcounter [-] [122302] Writer thread running {{(pid=122302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 22 20:37:21.921273 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.context [None req-4bb788af-3d8e-42d2-9a01-f8ab4a6f3e48 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),5972cb63-1ab7-4825-b0ae-86c7acab764c(cell1) {{(pid=122303) load_cells /opt/stack/nova/nova/context.py:464}} Oct 22 20:37:21.924120 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.context [None req-e1e37b9c-0522-415b-b451-57859adc4424 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),5972cb63-1ab7-4825-b0ae-86c7acab764c(cell1) {{(pid=122302) load_cells /opt/stack/nova/nova/context.py:464}} Oct 22 20:37:21.925129 ncdv-master-1 devstack@n-api.service[122303]: DEBUG oslo_concurrency.lockutils [None req-4bb788af-3d8e-42d2-9a01-f8ab4a6f3e48 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:37:21.925600 ncdv-master-1 devstack@n-api.service[122303]: DEBUG oslo_concurrency.lockutils [None req-4bb788af-3d8e-42d2-9a01-f8ab4a6f3e48 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:37:21.927168 ncdv-master-1 devstack@n-api.service[122303]: DEBUG oslo_concurrency.lockutils [None req-4bb788af-3d8e-42d2-9a01-f8ab4a6f3e48 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:37:21.927909 ncdv-master-1 devstack@n-api.service[122303]: DEBUG oslo_concurrency.lockutils [None req-4bb788af-3d8e-42d2-9a01-f8ab4a6f3e48 None None] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:37:21.928042 ncdv-master-1 devstack@n-api.service[122302]: DEBUG oslo_concurrency.lockutils [None req-e1e37b9c-0522-415b-b451-57859adc4424 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:37:21.928338 ncdv-master-1 devstack@n-api.service[122303]: DEBUG oslo_concurrency.lockutils [None req-4bb788af-3d8e-42d2-9a01-f8ab4a6f3e48 None None] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:37:21.928491 ncdv-master-1 devstack@n-api.service[122302]: DEBUG oslo_concurrency.lockutils [None req-e1e37b9c-0522-415b-b451-57859adc4424 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:37:21.929985 ncdv-master-1 devstack@n-api.service[122302]: DEBUG oslo_concurrency.lockutils [None req-e1e37b9c-0522-415b-b451-57859adc4424 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:37:21.930324 ncdv-master-1 devstack@n-api.service[122303]: DEBUG oslo_concurrency.lockutils [None req-4bb788af-3d8e-42d2-9a01-f8ab4a6f3e48 None None] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:37:21.930690 ncdv-master-1 devstack@n-api.service[122302]: DEBUG oslo_concurrency.lockutils [None req-e1e37b9c-0522-415b-b451-57859adc4424 None None] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:37:21.931121 ncdv-master-1 devstack@n-api.service[122302]: DEBUG oslo_concurrency.lockutils [None req-e1e37b9c-0522-415b-b451-57859adc4424 None None] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:37:21.932379 ncdv-master-1 devstack@n-api.service[122303]: INFO dbcounter [None req-4bb788af-3d8e-42d2-9a01-f8ab4a6f3e48 None None] Registered counter for database nova_cell0 Oct 22 20:37:21.933146 ncdv-master-1 devstack@n-api.service[122302]: DEBUG oslo_concurrency.lockutils [None req-e1e37b9c-0522-415b-b451-57859adc4424 None None] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:37:21.935251 ncdv-master-1 devstack@n-api.service[122302]: INFO dbcounter [None req-e1e37b9c-0522-415b-b451-57859adc4424 None None] Registered counter for database nova_cell0 Oct 22 20:37:21.936475 ncdv-master-1 devstack@n-api.service[122303]: INFO dbcounter [None req-4bb788af-3d8e-42d2-9a01-f8ab4a6f3e48 None None] Registered counter for database nova_cell1 Oct 22 20:37:21.939298 ncdv-master-1 devstack@n-api.service[122302]: INFO dbcounter [None req-e1e37b9c-0522-415b-b451-57859adc4424 None None] Registered counter for database nova_cell1 Oct 22 20:37:21.944125 ncdv-master-1 devstack@n-api.service[122303]: DEBUG oslo_db.sqlalchemy.engines [None req-4bb788af-3d8e-42d2-9a01-f8ab4a6f3e48 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122303) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 22 20:37:21.945321 ncdv-master-1 devstack@n-api.service[122303]: DEBUG oslo_db.sqlalchemy.engines [None req-4bb788af-3d8e-42d2-9a01-f8ab4a6f3e48 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122303) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 22 20:37:21.947101 ncdv-master-1 devstack@n-api.service[122302]: DEBUG oslo_db.sqlalchemy.engines [None req-e1e37b9c-0522-415b-b451-57859adc4424 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122302) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 22 20:37:21.949642 ncdv-master-1 devstack@n-api.service[122302]: DEBUG oslo_db.sqlalchemy.engines [None req-e1e37b9c-0522-415b-b451-57859adc4424 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122302) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 22 20:37:21.951921 ncdv-master-1 devstack@n-api.service[122303]: DEBUG dbcounter [-] [122303] Writer thread running {{(pid=122303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 22 20:37:21.953654 ncdv-master-1 devstack@n-api.service[122303]: DEBUG dbcounter [-] [122303] Writer thread running {{(pid=122303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 22 20:37:21.955207 ncdv-master-1 devstack@n-api.service[122302]: DEBUG dbcounter [-] [122302] Writer thread running {{(pid=122302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 22 20:37:21.957898 ncdv-master-1 devstack@n-api.service[122302]: DEBUG dbcounter [-] [122302] Writer thread running {{(pid=122302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 22 20:37:22.094482 ncdv-master-1 devstack@n-api.service[122303]: INFO dbcounter [None req-4bb788af-3d8e-42d2-9a01-f8ab4a6f3e48 None None] Registered counter for database nova_cell0 Oct 22 20:37:22.099279 ncdv-master-1 devstack@n-api.service[122302]: INFO dbcounter [None req-e1e37b9c-0522-415b-b451-57859adc4424 None None] Registered counter for database nova_cell0 Oct 22 20:37:22.104185 ncdv-master-1 devstack@n-api.service[122303]: DEBUG oslo_db.sqlalchemy.engines [None req-4bb788af-3d8e-42d2-9a01-f8ab4a6f3e48 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122303) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 22 20:37:22.109217 ncdv-master-1 devstack@n-api.service[122302]: DEBUG oslo_db.sqlalchemy.engines [None req-e1e37b9c-0522-415b-b451-57859adc4424 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122302) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 22 20:37:22.109563 ncdv-master-1 devstack@n-api.service[122303]: DEBUG dbcounter [-] [122303] Writer thread running {{(pid=122303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 22 20:37:22.114841 ncdv-master-1 devstack@n-api.service[122302]: DEBUG dbcounter [-] [122302] Writer thread running {{(pid=122302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 22 20:37:22.559457 ncdv-master-1 devstack@n-api.service[122303]: WARNING keystonemiddleware.auth_token [None req-4bb788af-3d8e-42d2-9a01-f8ab4a6f3e48 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 22 20:37:22.560172 ncdv-master-1 devstack@n-api.service[122302]: WARNING keystonemiddleware.auth_token [None req-e1e37b9c-0522-415b-b451-57859adc4424 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 22 20:37:22.566745 ncdv-master-1 devstack@n-api.service[122303]: WARNING keystonemiddleware.auth_token [None req-4bb788af-3d8e-42d2-9a01-f8ab4a6f3e48 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 22 20:37:22.567365 ncdv-master-1 devstack@n-api.service[122302]: WARNING keystonemiddleware.auth_token [None req-e1e37b9c-0522-415b-b451-57859adc4424 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 22 20:37:22.784964 ncdv-master-1 devstack@n-api.service[122302]: WARNING keystonemiddleware.auth_token [None req-e1e37b9c-0522-415b-b451-57859adc4424 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 22 20:37:22.785417 ncdv-master-1 devstack@n-api.service[122303]: WARNING keystonemiddleware.auth_token [None req-4bb788af-3d8e-42d2-9a01-f8ab4a6f3e48 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 22 20:37:22.790973 ncdv-master-1 devstack@n-api.service[122302]: WARNING keystonemiddleware.auth_token [None req-e1e37b9c-0522-415b-b451-57859adc4424 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 22 20:37:22.791362 ncdv-master-1 devstack@n-api.service[122303]: WARNING keystonemiddleware.auth_token [None req-4bb788af-3d8e-42d2-9a01-f8ab4a6f3e48 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 22 20:37:22.796294 ncdv-master-1 devstack@n-api.service[122302]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55a89191d9c0 pid: 122302 (default app) Oct 22 20:37:22.796636 ncdv-master-1 devstack@n-api.service[122303]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55a89191d9c0 pid: 122303 (default app) Oct 22 20:37:22.798346 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi [None req-e1e37b9c-0522-415b-b451-57859adc4424 None None] Calling method '>' {{(pid=122302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:37:22.799567 ncdv-master-1 devstack@n-api.service[122302]: INFO nova.api.openstack.requestlog [None req-e1e37b9c-0522-415b-b451-57859adc4424 None None] 10.222.0.18 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001708 Oct 22 20:37:22.800016 ncdv-master-1 devstack@n-api.service[122302]: [pid: 122302|app: 0|req: 1/1] 10.222.0.18 () {50 vars in 788 bytes} [Sat Oct 22 20:37:22 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:38:50.321519 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi [None req-4bb788af-3d8e-42d2-9a01-f8ab4a6f3e48 None None] Calling method '>' {{(pid=122303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:38:50.323694 ncdv-master-1 devstack@n-api.service[122303]: INFO nova.api.openstack.requestlog [None req-4bb788af-3d8e-42d2-9a01-f8ab4a6f3e48 None None] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002884 Oct 22 20:38:50.324586 ncdv-master-1 devstack@n-api.service[122303]: [pid: 122303|app: 0|req: 1/2] 10.222.0.18 () {54 vars in 931 bytes} [Sat Oct 22 20:38:50 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:38:50.339798 ncdv-master-1 devstack@n-api.service[122302]: DEBUG dbcounter [-] [122302] Writing DB stats nova_api:SELECT=3 {{(pid=122302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:38:50.341172 ncdv-master-1 devstack@n-api.service[122302]: DEBUG dbcounter [-] [122302] Writing DB stats nova_cell0:SELECT=3 {{(pid=122302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:38:50.342339 ncdv-master-1 devstack@n-api.service[122302]: DEBUG dbcounter [-] [122302] Writing DB stats nova_cell1:SELECT=3 {{(pid=122302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:38:50.343172 ncdv-master-1 devstack@n-api.service[122302]: DEBUG dbcounter [-] [122302] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=122302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:38:51.202845 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi [None req-70d2bbd9-9dd1-4b60-960c-9b88ea8ee94f admin admin] Calling method '>' {{(pid=122302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:38:51.236727 ncdv-master-1 devstack@n-api.service[122302]: INFO nova.api.openstack.requestlog [None req-70d2bbd9-9dd1-4b60-960c-9b88ea8ee94f admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.906133 Oct 22 20:38:51.237638 ncdv-master-1 devstack@n-api.service[122302]: [pid: 122302|app: 0|req: 2/3] 10.222.0.18 () {60 vars in 1292 bytes} [Sat Oct 22 20:38:50 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:38:54.142991 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi [None req-4bb788af-3d8e-42d2-9a01-f8ab4a6f3e48 None None] Calling method '>' {{(pid=122303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:38:54.144076 ncdv-master-1 devstack@n-api.service[122303]: INFO nova.api.openstack.requestlog [None req-4bb788af-3d8e-42d2-9a01-f8ab4a6f3e48 None None] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001474 Oct 22 20:38:54.144612 ncdv-master-1 devstack@n-api.service[122303]: [pid: 122303|app: 0|req: 2/4] 10.222.0.18 () {54 vars in 931 bytes} [Sat Oct 22 20:38:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:38:54.564672 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi [None req-825716e3-a52c-4b18-b178-bca0bfa1968c admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 256, "os-flavor-access:is_public": true, "name": "cirros256", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "disk": 1, "id": "c1", "rxtx_factor": 1.0, "vcpus": 1}} {{(pid=122302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:38:54.614006 ncdv-master-1 devstack@n-api.service[122302]: INFO nova.api.openstack.requestlog [None req-825716e3-a52c-4b18-b178-bca0bfa1968c admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.463111 Oct 22 20:38:54.615137 ncdv-master-1 devstack@n-api.service[122302]: [pid: 122302|app: 0|req: 3/5] 10.222.0.18 () {64 vars in 1283 bytes} [Sat Oct 22 20:38:54 2022] POST /compute/v2.1/flavors => generated 407 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 22 20:38:54.629995 ncdv-master-1 devstack@n-api.service[122303]: DEBUG dbcounter [-] [122303] Writing DB stats nova_api:SELECT=3 {{(pid=122303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:38:54.630934 ncdv-master-1 devstack@n-api.service[122303]: DEBUG dbcounter [-] [122303] Writing DB stats nova_cell1:SELECT=3 {{(pid=122303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:38:54.631934 ncdv-master-1 devstack@n-api.service[122303]: DEBUG dbcounter [-] [122303] Writing DB stats nova_cell0:SELECT=3 {{(pid=122303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:38:54.632778 ncdv-master-1 devstack@n-api.service[122303]: DEBUG dbcounter [-] [122303] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=122303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:38:54.836302 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi [None req-d8d017ce-14d3-471c-b4a1-9cbd9614ee62 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=122303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:38:54.907796 ncdv-master-1 devstack@n-api.service[122303]: INFO nova.api.openstack.requestlog [None req-d8d017ce-14d3-471c-b4a1-9cbd9614ee62 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.284156 Oct 22 20:38:54.908382 ncdv-master-1 devstack@n-api.service[122303]: [pid: 122303|app: 0|req: 3/6] 10.222.0.18 () {64 vars in 1336 bytes} [Sat Oct 22 20:38:54 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:38:57.838149 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi [None req-825716e3-a52c-4b18-b178-bca0bfa1968c admin admin] Calling method '>' {{(pid=122302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:38:57.839890 ncdv-master-1 devstack@n-api.service[122302]: INFO nova.api.openstack.requestlog [None req-825716e3-a52c-4b18-b178-bca0bfa1968c admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002367 Oct 22 20:38:57.845666 ncdv-master-1 devstack@n-api.service[122302]: [pid: 122302|app: 0|req: 4/7] 10.222.0.18 () {54 vars in 931 bytes} [Sat Oct 22 20:38:57 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:38:58.683046 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi [None req-b8263fbc-89e8-44f7-8e6f-075e0e2b2217 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "disk": 5, "swap": 0, "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d1", "os-flavor-access:is_public": true, "vcpus": 1, "name": "ds512M"}} {{(pid=122303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:38:58.773332 ncdv-master-1 devstack@n-api.service[122303]: INFO nova.api.openstack.requestlog [None req-b8263fbc-89e8-44f7-8e6f-075e0e2b2217 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.925987 Oct 22 20:38:58.781374 ncdv-master-1 devstack@n-api.service[122303]: [pid: 122303|app: 0|req: 4/8] 10.222.0.18 () {64 vars in 1283 bytes} [Sat Oct 22 20:38:57 2022] POST /compute/v2.1/flavors => generated 404 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 22 20:38:58.799136 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi [None req-9996a05b-5758-4c1f-930f-d02d1e2b28bf admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=122302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:38:58.878386 ncdv-master-1 devstack@n-api.service[122302]: INFO nova.api.openstack.requestlog [None req-9996a05b-5758-4c1f-930f-d02d1e2b28bf admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.085704 Oct 22 20:38:58.879355 ncdv-master-1 devstack@n-api.service[122302]: [pid: 122302|app: 0|req: 5/9] 10.222.0.18 () {64 vars in 1336 bytes} [Sat Oct 22 20:38:58 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:39:02.086136 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi [None req-b8263fbc-89e8-44f7-8e6f-075e0e2b2217 admin admin] Calling method '>' {{(pid=122303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:39:02.087168 ncdv-master-1 devstack@n-api.service[122303]: INFO nova.api.openstack.requestlog [None req-b8263fbc-89e8-44f7-8e6f-075e0e2b2217 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001535 Oct 22 20:39:02.089604 ncdv-master-1 devstack@n-api.service[122303]: [pid: 122303|app: 0|req: 5/10] 10.222.0.18 () {54 vars in 931 bytes} [Sat Oct 22 20:39:02 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:39:02.605146 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi [None req-9617b5ae-233f-4651-9769-480272295b65 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "id": "d2", "name": "ds1G", "swap": 0, "rxtx_factor": 1.0, "disk": 10, "os-flavor-access:is_public": true, "ram": 1024, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=122302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:39:02.629043 ncdv-master-1 devstack@n-api.service[122302]: INFO nova.api.openstack.requestlog [None req-9617b5ae-233f-4651-9769-480272295b65 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.534826 Oct 22 20:39:02.630287 ncdv-master-1 devstack@n-api.service[122302]: [pid: 122302|app: 0|req: 6/11] 10.222.0.18 () {64 vars in 1283 bytes} [Sat Oct 22 20:39:02 2022] POST /compute/v2.1/flavors => generated 404 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 22 20:39:02.643440 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi [None req-3e7cba3f-cedc-4f93-ac42-2bb576cbcbd9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=122303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:39:02.675328 ncdv-master-1 devstack@n-api.service[122303]: INFO nova.api.openstack.requestlog [None req-3e7cba3f-cedc-4f93-ac42-2bb576cbcbd9 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035873 Oct 22 20:39:02.676022 ncdv-master-1 devstack@n-api.service[122303]: [pid: 122303|app: 0|req: 6/12] 10.222.0.18 () {64 vars in 1336 bytes} [Sat Oct 22 20:39:02 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:39:05.813352 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi [None req-9617b5ae-233f-4651-9769-480272295b65 admin admin] Calling method '>' {{(pid=122302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:39:05.814367 ncdv-master-1 devstack@n-api.service[122302]: INFO nova.api.openstack.requestlog [None req-9617b5ae-233f-4651-9769-480272295b65 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001465 Oct 22 20:39:05.814771 ncdv-master-1 devstack@n-api.service[122302]: [pid: 122302|app: 0|req: 7/13] 10.222.0.18 () {54 vars in 931 bytes} [Sat Oct 22 20:39:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:39:06.247523 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi [None req-4a94cd11-98f6-4fd0-b636-a423f2309180 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "id": "d3", "name": "ds2G", "ram": 2048, "os-flavor-access:is_public": true, "rxtx_factor": 1.0}} {{(pid=122303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:39:06.267989 ncdv-master-1 devstack@n-api.service[122303]: INFO nova.api.openstack.requestlog [None req-4a94cd11-98f6-4fd0-b636-a423f2309180 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.446920 Oct 22 20:39:06.268573 ncdv-master-1 devstack@n-api.service[122303]: [pid: 122303|app: 0|req: 7/14] 10.222.0.18 () {64 vars in 1283 bytes} [Sat Oct 22 20:39:05 2022] POST /compute/v2.1/flavors => generated 404 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 22 20:39:06.282243 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi [None req-61ae32d9-c7c3-413a-b363-548a0a766fc7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=122302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:39:06.310656 ncdv-master-1 devstack@n-api.service[122302]: INFO nova.api.openstack.requestlog [None req-61ae32d9-c7c3-413a-b363-548a0a766fc7 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032184 Oct 22 20:39:06.311235 ncdv-master-1 devstack@n-api.service[122302]: [pid: 122302|app: 0|req: 8/15] 10.222.0.18 () {64 vars in 1336 bytes} [Sat Oct 22 20:39:06 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:39:09.220131 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi [None req-4a94cd11-98f6-4fd0-b636-a423f2309180 admin admin] Calling method '>' {{(pid=122303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:39:09.221579 ncdv-master-1 devstack@n-api.service[122303]: INFO nova.api.openstack.requestlog [None req-4a94cd11-98f6-4fd0-b636-a423f2309180 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001599 Oct 22 20:39:09.227848 ncdv-master-1 devstack@n-api.service[122303]: [pid: 122303|app: 0|req: 8/16] 10.222.0.18 () {54 vars in 931 bytes} [Sat Oct 22 20:39:09 2022] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:39:09.662524 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi [None req-4d869e3a-ad24-4c97-aaa0-caee55e57a81 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "id": "d4", "vcpus": 4, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds4G", "disk": 20, "rxtx_factor": 1.0, "ram": 4096}} {{(pid=122302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:39:09.682436 ncdv-master-1 devstack@n-api.service[122302]: INFO nova.api.openstack.requestlog [None req-4d869e3a-ad24-4c97-aaa0-caee55e57a81 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.454247 Oct 22 20:39:09.683405 ncdv-master-1 devstack@n-api.service[122302]: [pid: 122302|app: 0|req: 9/17] 10.222.0.18 () {64 vars in 1283 bytes} [Sat Oct 22 20:39:09 2022] POST /compute/v2.1/flavors => generated 404 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 22 20:39:09.695165 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi [None req-adb7b505-06c2-45c0-84ab-147eba1aeaf2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=122303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:39:09.719150 ncdv-master-1 devstack@n-api.service[122303]: INFO nova.api.openstack.requestlog [None req-adb7b505-06c2-45c0-84ab-147eba1aeaf2 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027694 Oct 22 20:39:09.731437 ncdv-master-1 devstack@n-api.service[122303]: [pid: 122303|app: 0|req: 9/18] 10.222.0.18 () {64 vars in 1336 bytes} [Sat Oct 22 20:39:09 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:39:12.607404 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi [None req-4d869e3a-ad24-4c97-aaa0-caee55e57a81 admin admin] Calling method '>' {{(pid=122302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:39:12.608424 ncdv-master-1 devstack@n-api.service[122302]: INFO nova.api.openstack.requestlog [None req-4d869e3a-ad24-4c97-aaa0-caee55e57a81 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001475 Oct 22 20:39:12.608879 ncdv-master-1 devstack@n-api.service[122302]: [pid: 122302|app: 0|req: 10/19] 10.222.0.18 () {54 vars in 931 bytes} [Sat Oct 22 20:39:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:39:13.062135 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi [None req-03021331-ef15-4ca2-b9e1-3aea87e8da1e admin admin] Calling method '>' {{(pid=122303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:39:13.087879 ncdv-master-1 devstack@n-api.service[122303]: INFO nova.api.openstack.requestlog [None req-03021331-ef15-4ca2-b9e1-3aea87e8da1e admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.472861 Oct 22 20:39:13.088519 ncdv-master-1 devstack@n-api.service[122303]: [pid: 122303|app: 0|req: 10/20] 10.222.0.18 () {60 vars in 1292 bytes} [Sat Oct 22 20:39:12 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 20:39:16.164566 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi [None req-4d869e3a-ad24-4c97-aaa0-caee55e57a81 admin admin] Calling method '>' {{(pid=122302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:39:16.165510 ncdv-master-1 devstack@n-api.service[122302]: INFO nova.api.openstack.requestlog [None req-4d869e3a-ad24-4c97-aaa0-caee55e57a81 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001470 Oct 22 20:39:16.165927 ncdv-master-1 devstack@n-api.service[122302]: [pid: 122302|app: 0|req: 11/21] 10.222.0.18 () {54 vars in 931 bytes} [Sat Oct 22 20:39:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:39:16.611635 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi [None req-529d8ab7-6021-4db2-861d-9f5b438eb260 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "vcpus": 1, "swap": 0, "rxtx_factor": 1.0, "name": "m1.tiny", "id": "1"}} {{(pid=122303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:39:16.632454 ncdv-master-1 devstack@n-api.service[122303]: INFO nova.api.openstack.requestlog [None req-529d8ab7-6021-4db2-861d-9f5b438eb260 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.460001 Oct 22 20:39:16.633026 ncdv-master-1 devstack@n-api.service[122303]: [pid: 122303|app: 0|req: 11/22] 10.222.0.18 () {64 vars in 1283 bytes} [Sat Oct 22 20:39:16 2022] POST /compute/v2.1/flavors => generated 402 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 22 20:39:16.645534 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi [None req-b5e866ed-9643-4120-9e9e-7de0befbc5aa admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=122302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:39:16.673855 ncdv-master-1 devstack@n-api.service[122302]: INFO nova.api.openstack.requestlog [None req-b5e866ed-9643-4120-9e9e-7de0befbc5aa admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032054 Oct 22 20:39:16.674434 ncdv-master-1 devstack@n-api.service[122302]: [pid: 122302|app: 0|req: 12/23] 10.222.0.18 () {64 vars in 1333 bytes} [Sat Oct 22 20:39:16 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:39:19.887300 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi [None req-529d8ab7-6021-4db2-861d-9f5b438eb260 admin admin] Calling method '>' {{(pid=122303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:39:19.888282 ncdv-master-1 devstack@n-api.service[122303]: INFO nova.api.openstack.requestlog [None req-529d8ab7-6021-4db2-861d-9f5b438eb260 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001515 Oct 22 20:39:19.888709 ncdv-master-1 devstack@n-api.service[122303]: [pid: 122303|app: 0|req: 12/24] 10.222.0.18 () {54 vars in 931 bytes} [Sat Oct 22 20:39:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:39:20.306030 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi [None req-ac93e65d-34a3-46de-bec0-6db37dcbef1b admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "2", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "os-flavor-access:is_public": true, "swap": 0, "vcpus": 1, "disk": 20, "rxtx_factor": 1.0, "name": "m1.small"}} {{(pid=122302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:39:20.326074 ncdv-master-1 devstack@n-api.service[122302]: INFO nova.api.openstack.requestlog [None req-ac93e65d-34a3-46de-bec0-6db37dcbef1b admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.431304 Oct 22 20:39:20.326715 ncdv-master-1 devstack@n-api.service[122302]: [pid: 122302|app: 0|req: 13/25] 10.222.0.18 () {64 vars in 1283 bytes} [Sat Oct 22 20:39:19 2022] POST /compute/v2.1/flavors => generated 405 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 22 20:39:20.338871 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi [None req-547bc225-2f33-4ac9-8289-cd24b41b36a6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=122303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:39:20.365924 ncdv-master-1 devstack@n-api.service[122303]: INFO nova.api.openstack.requestlog [None req-547bc225-2f33-4ac9-8289-cd24b41b36a6 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030638 Oct 22 20:39:20.374389 ncdv-master-1 devstack@n-api.service[122303]: [pid: 122303|app: 0|req: 13/26] 10.222.0.18 () {64 vars in 1333 bytes} [Sat Oct 22 20:39:20 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:39:23.249669 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi [None req-ac93e65d-34a3-46de-bec0-6db37dcbef1b admin admin] Calling method '>' {{(pid=122302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:39:23.250861 ncdv-master-1 devstack@n-api.service[122302]: INFO nova.api.openstack.requestlog [None req-ac93e65d-34a3-46de-bec0-6db37dcbef1b admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 Oct 22 20:39:23.255651 ncdv-master-1 devstack@n-api.service[122302]: [pid: 122302|app: 0|req: 14/27] 10.222.0.18 () {54 vars in 931 bytes} [Sat Oct 22 20:39:23 2022] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:39:23.665698 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi [None req-9660bada-657c-404a-ad99-c86405faec9a admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "3", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "disk": 40, "name": "m1.medium", "vcpus": 2, "rxtx_factor": 1.0, "swap": 0, "ram": 4096}} {{(pid=122303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:39:23.688618 ncdv-master-1 devstack@n-api.service[122303]: INFO nova.api.openstack.requestlog [None req-9660bada-657c-404a-ad99-c86405faec9a admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.431066 Oct 22 20:39:23.689368 ncdv-master-1 devstack@n-api.service[122303]: [pid: 122303|app: 0|req: 14/28] 10.222.0.18 () {64 vars in 1283 bytes} [Sat Oct 22 20:39:23 2022] POST /compute/v2.1/flavors => generated 406 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 22 20:39:23.701392 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi [None req-43bf392f-6b7d-40f0-8e18-18b78e3d16c2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=122302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:39:23.706396 ncdv-master-1 devstack@n-api.service[122302]: DEBUG dbcounter [-] [122302] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=7,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=122302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:39:23.734458 ncdv-master-1 devstack@n-api.service[122302]: INFO nova.api.openstack.requestlog [None req-43bf392f-6b7d-40f0-8e18-18b78e3d16c2 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036697 Oct 22 20:39:23.735134 ncdv-master-1 devstack@n-api.service[122302]: [pid: 122302|app: 0|req: 15/29] 10.222.0.18 () {64 vars in 1333 bytes} [Sat Oct 22 20:39:23 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 20:39:26.730272 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi [None req-9660bada-657c-404a-ad99-c86405faec9a admin admin] Calling method '>' {{(pid=122303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:39:26.731275 ncdv-master-1 devstack@n-api.service[122303]: INFO nova.api.openstack.requestlog [None req-9660bada-657c-404a-ad99-c86405faec9a admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Oct 22 20:39:26.731938 ncdv-master-1 devstack@n-api.service[122303]: [pid: 122303|app: 0|req: 15/30] 10.222.0.18 () {54 vars in 931 bytes} [Sat Oct 22 20:39:26 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:39:27.210133 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi [None req-0c15f8e4-cb5e-49eb-9005-a16c29aedbfc admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "disk": 80, "ram": 8192, "rxtx_factor": 1.0, "id": "4", "name": "m1.large", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true}} {{(pid=122302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:39:27.232843 ncdv-master-1 devstack@n-api.service[122302]: INFO nova.api.openstack.requestlog [None req-0c15f8e4-cb5e-49eb-9005-a16c29aedbfc admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.494816 Oct 22 20:39:27.233711 ncdv-master-1 devstack@n-api.service[122302]: [pid: 122302|app: 0|req: 16/31] 10.222.0.18 () {64 vars in 1283 bytes} [Sat Oct 22 20:39:26 2022] POST /compute/v2.1/flavors => generated 405 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 22 20:39:27.252007 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi [None req-71146f02-ce58-4935-a96f-a203f9722a3c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=122303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:39:27.257533 ncdv-master-1 devstack@n-api.service[122303]: DEBUG dbcounter [-] [122303] Writing DB stats nova_api:SELECT=39,nova_api:SAVEPOINT=4,nova_api:INSERT=8,nova_api:RELEASE=4 {{(pid=122303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:39:27.279868 ncdv-master-1 devstack@n-api.service[122303]: INFO nova.api.openstack.requestlog [None req-71146f02-ce58-4935-a96f-a203f9722a3c admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031530 Oct 22 20:39:27.295366 ncdv-master-1 devstack@n-api.service[122303]: [pid: 122303|app: 0|req: 16/32] 10.222.0.18 () {64 vars in 1333 bytes} [Sat Oct 22 20:39:27 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 20:39:30.217165 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi [None req-0c15f8e4-cb5e-49eb-9005-a16c29aedbfc admin admin] Calling method '>' {{(pid=122302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:39:30.218190 ncdv-master-1 devstack@n-api.service[122302]: INFO nova.api.openstack.requestlog [None req-0c15f8e4-cb5e-49eb-9005-a16c29aedbfc admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001509 Oct 22 20:39:30.218821 ncdv-master-1 devstack@n-api.service[122302]: [pid: 122302|app: 0|req: 17/33] 10.222.0.18 () {54 vars in 931 bytes} [Sat Oct 22 20:39:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:39:30.680966 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi [None req-39a25893-0bd8-4186-bbdb-536aecf126ce admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.xlarge", "vcpus": 8, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 16384, "id": "5", "os-flavor-access:is_public": true, "disk": 160, "rxtx_factor": 1.0, "swap": 0}} {{(pid=122303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:39:30.703111 ncdv-master-1 devstack@n-api.service[122303]: INFO nova.api.openstack.requestlog [None req-39a25893-0bd8-4186-bbdb-536aecf126ce admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.477508 Oct 22 20:39:30.707434 ncdv-master-1 devstack@n-api.service[122303]: [pid: 122303|app: 0|req: 17/34] 10.222.0.18 () {64 vars in 1283 bytes} [Sat Oct 22 20:39:30 2022] POST /compute/v2.1/flavors => generated 408 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 22 20:39:30.717090 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi [None req-cba19683-e158-4abc-a71d-50fb8cbce4b7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=122302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:39:30.748142 ncdv-master-1 devstack@n-api.service[122302]: INFO nova.api.openstack.requestlog [None req-cba19683-e158-4abc-a71d-50fb8cbce4b7 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034917 Oct 22 20:39:30.749469 ncdv-master-1 devstack@n-api.service[122302]: [pid: 122302|app: 0|req: 18/35] 10.222.0.18 () {64 vars in 1333 bytes} [Sat Oct 22 20:39:30 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:39:50.399770 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi [None req-39a25893-0bd8-4186-bbdb-536aecf126ce admin admin] Calling method '>' {{(pid=122303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:39:50.400836 ncdv-master-1 devstack@n-api.service[122303]: INFO nova.api.openstack.requestlog [None req-39a25893-0bd8-4186-bbdb-536aecf126ce admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002158 Oct 22 20:39:50.401250 ncdv-master-1 devstack@n-api.service[122303]: [pid: 122303|app: 0|req: 18/36] 10.222.0.18 () {54 vars in 931 bytes} [Sat Oct 22 20:39:50 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:39:50.417217 ncdv-master-1 devstack@n-api.service[122302]: DEBUG dbcounter [-] [122302] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=3,nova_api:RELEASE=2 {{(pid=122302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:39:50.826090 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi [None req-ffc8bb80-94c7-43a3-8a05-40ca56af7f5d admin admin] Calling method '>' {{(pid=122302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:39:50.845190 ncdv-master-1 devstack@n-api.service[122302]: INFO nova.api.openstack.requestlog [None req-ffc8bb80-94c7-43a3-8a05-40ca56af7f5d admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.434780 Oct 22 20:39:50.845691 ncdv-master-1 devstack@n-api.service[122302]: [pid: 122302|app: 0|req: 19/37] 10.222.0.18 () {60 vars in 1292 bytes} [Sat Oct 22 20:39:50 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 20:39:52.729293 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi [None req-39a25893-0bd8-4186-bbdb-536aecf126ce admin admin] Calling method '>' {{(pid=122303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:39:52.730298 ncdv-master-1 devstack@n-api.service[122303]: INFO nova.api.openstack.requestlog [None req-39a25893-0bd8-4186-bbdb-536aecf126ce admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001567 Oct 22 20:39:52.730718 ncdv-master-1 devstack@n-api.service[122303]: [pid: 122303|app: 0|req: 19/38] 10.222.0.18 () {56 vars in 1074 bytes} [Sat Oct 22 20:39:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:39:53.391317 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi [None req-3ac75072-37d9-449e-9cbd-7d483d4d160c admin admin] Calling method '>' {{(pid=122302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:39:53.396689 ncdv-master-1 devstack@n-api.service[122302]: INFO nova.api.openstack.wsgi [None req-3ac75072-37d9-449e-9cbd-7d483d4d160c admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 22 20:39:53.403953 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi [None req-3ac75072-37d9-449e-9cbd-7d483d4d160c admin admin] Request method failure captured: Oct 22 20:39:53.403953 ncdv-master-1 devstack@n-api.service[122302]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 22 20:39:53.403953 ncdv-master-1 devstack@n-api.service[122302]: Accept: application/json Oct 22 20:39:53.403953 ncdv-master-1 devstack@n-api.service[122302]: Accept-Encoding: gzip, deflate Oct 22 20:39:53.403953 ncdv-master-1 devstack@n-api.service[122302]: Connection: keep-alive Oct 22 20:39:53.403953 ncdv-master-1 devstack@n-api.service[122302]: Content-Length: 0 Oct 22 20:39:53.403953 ncdv-master-1 devstack@n-api.service[122302]: Host: 10.222.0.18 Oct 22 20:39:53.403953 ncdv-master-1 devstack@n-api.service[122302]: Openstack-Api-Version: compute 2.92 Oct 22 20:39:53.403953 ncdv-master-1 devstack@n-api.service[122302]: Openstack-System-Scope: None Oct 22 20:39:53.403953 ncdv-master-1 devstack@n-api.service[122302]: User-Agent: python-novaclient Oct 22 20:39:53.403953 ncdv-master-1 devstack@n-api.service[122302]: X-Auth-Token: gAAAAABjVFUYzjo9hIh82RkVRuMVVJUh1ec6xq1RSQElh_kMLwnBJofvhIhQ8dJVnf9NJRdNkhYhG5l1ujbvhVMO4wIffZ2Fl71UQPB9CqOMal34IqvXq7AxbET0MdlBpc78DXibFF5TTZZo-i3oeGPU-gj40loJuOZwVKiYK2FpzpxPBfOX_j0 Oct 22 20:39:53.403953 ncdv-master-1 devstack@n-api.service[122302]: X-Domain-Id: None Oct 22 20:39:53.403953 ncdv-master-1 devstack@n-api.service[122302]: X-Domain-Name: None Oct 22 20:39:53.403953 ncdv-master-1 devstack@n-api.service[122302]: X-Identity-Status: Confirmed Oct 22 20:39:53.403953 ncdv-master-1 devstack@n-api.service[122302]: X-Is-Admin-Project: True Oct 22 20:39:53.403953 ncdv-master-1 devstack@n-api.service[122302]: X-Openstack-Nova-Api-Version: 2.92 Oct 22 20:39:53.403953 ncdv-master-1 devstack@n-api.service[122302]: X-Project-Domain-Id: default Oct 22 20:39:53.403953 ncdv-master-1 devstack@n-api.service[122302]: X-Project-Domain-Name: Default Oct 22 20:39:53.403953 ncdv-master-1 devstack@n-api.service[122302]: X-Project-Id: 1ffd1cedd62c48f599340661b26417f0 Oct 22 20:39:53.403953 ncdv-master-1 devstack@n-api.service[122302]: X-Project-Name: admin Oct 22 20:39:53.403953 ncdv-master-1 devstack@n-api.service[122302]: X-Role: admin,member,reader Oct 22 20:39:53.403953 ncdv-master-1 devstack@n-api.service[122302]: X-Roles: admin,member,reader Oct 22 20:39:53.405417 ncdv-master-1 devstack@n-api.service[122302]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_1ffd1cedd62c48f599340661b26417f0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1ffd1cedd62c48f599340661b26417f0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/1ffd1cedd62c48f599340661b26417f0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1ffd1cedd62c48f599340661b26417f0"}]}] Oct 22 20:39:53.405417 ncdv-master-1 devstack@n-api.service[122302]: X-Tenant: admin Oct 22 20:39:53.405417 ncdv-master-1 devstack@n-api.service[122302]: X-Tenant-Id: 1ffd1cedd62c48f599340661b26417f0 Oct 22 20:39:53.405417 ncdv-master-1 devstack@n-api.service[122302]: X-Tenant-Name: admin Oct 22 20:39:53.405417 ncdv-master-1 devstack@n-api.service[122302]: X-User: admin Oct 22 20:39:53.405417 ncdv-master-1 devstack@n-api.service[122302]: X-User-Domain-Id: default Oct 22 20:39:53.405417 ncdv-master-1 devstack@n-api.service[122302]: X-User-Domain-Name: Default Oct 22 20:39:53.405417 ncdv-master-1 devstack@n-api.service[122302]: X-User-Id: 043e83d310424fb2aa8aa9414b1ed3f2 Oct 22 20:39:53.405417 ncdv-master-1 devstack@n-api.service[122302]: X-User-Name: admin Oct 22 20:39:53.405417 ncdv-master-1 devstack@n-api.service[122302]: method: > Oct 22 20:39:53.405417 ncdv-master-1 devstack@n-api.service[122302]: exception: Flavor 42 could not be found. Oct 22 20:39:53.405417 ncdv-master-1 devstack@n-api.service[122302]: action_args: {'id': '42'} Oct 22 20:39:53.405417 ncdv-master-1 devstack@n-api.service[122302]: {{(pid=122302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:39:53.405417 ncdv-master-1 devstack@n-api.service[122302]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:39:53.406276 ncdv-master-1 devstack@n-api.service[122302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 22 20:39:53.406276 ncdv-master-1 devstack@n-api.service[122302]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 22 20:39:53.406276 ncdv-master-1 devstack@n-api.service[122302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 22 20:39:53.406276 ncdv-master-1 devstack@n-api.service[122302]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 22 20:39:53.406276 ncdv-master-1 devstack@n-api.service[122302]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 22 20:39:53.406276 ncdv-master-1 devstack@n-api.service[122302]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 22 20:39:53.406276 ncdv-master-1 devstack@n-api.service[122302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 22 20:39:53.406276 ncdv-master-1 devstack@n-api.service[122302]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 22 20:39:53.406276 ncdv-master-1 devstack@n-api.service[122302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 22 20:39:53.406276 ncdv-master-1 devstack@n-api.service[122302]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:39:53.406276 ncdv-master-1 devstack@n-api.service[122302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 22 20:39:53.406276 ncdv-master-1 devstack@n-api.service[122302]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 22 20:39:53.406276 ncdv-master-1 devstack@n-api.service[122302]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 22 20:39:53.406276 ncdv-master-1 devstack@n-api.service[122302]: ERROR nova.api.openstack.wsgi Oct 22 20:39:53.406276 ncdv-master-1 devstack@n-api.service[122302]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:39:53.406276 ncdv-master-1 devstack@n-api.service[122302]: ERROR nova.api.openstack.wsgi Oct 22 20:39:53.406276 ncdv-master-1 devstack@n-api.service[122302]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:39:53.406276 ncdv-master-1 devstack@n-api.service[122302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:39:53.406276 ncdv-master-1 devstack@n-api.service[122302]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:39:53.407527 ncdv-master-1 devstack@n-api.service[122302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:39:53.407527 ncdv-master-1 devstack@n-api.service[122302]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:39:53.407527 ncdv-master-1 devstack@n-api.service[122302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:39:53.407527 ncdv-master-1 devstack@n-api.service[122302]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:39:53.407527 ncdv-master-1 devstack@n-api.service[122302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 22 20:39:53.407527 ncdv-master-1 devstack@n-api.service[122302]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 22 20:39:53.407527 ncdv-master-1 devstack@n-api.service[122302]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 22 20:39:53.407527 ncdv-master-1 devstack@n-api.service[122302]: ERROR nova.api.openstack.wsgi Oct 22 20:39:53.407527 ncdv-master-1 devstack@n-api.service[122302]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:39:53.407527 ncdv-master-1 devstack@n-api.service[122302]: ERROR nova.api.openstack.wsgi Oct 22 20:39:53.407527 ncdv-master-1 devstack@n-api.service[122302]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:39:53.407527 ncdv-master-1 devstack@n-api.service[122302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:39:53.407527 ncdv-master-1 devstack@n-api.service[122302]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:39:53.407527 ncdv-master-1 devstack@n-api.service[122302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 20:39:53.407527 ncdv-master-1 devstack@n-api.service[122302]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 20:39:53.407527 ncdv-master-1 devstack@n-api.service[122302]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 22 20:39:53.407527 ncdv-master-1 devstack@n-api.service[122302]: ERROR nova.api.openstack.wsgi Oct 22 20:39:53.407527 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi [None req-3ac75072-37d9-449e-9cbd-7d483d4d160c admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=122302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:39:53.408934 ncdv-master-1 devstack@n-api.service[122302]: INFO nova.api.openstack.requestlog [None req-3ac75072-37d9-449e-9cbd-7d483d4d160c admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.440017 Oct 22 20:39:53.408934 ncdv-master-1 devstack@n-api.service[122302]: [pid: 122302|app: 0|req: 20/39] 10.222.0.18 () {60 vars in 1190 bytes} [Sat Oct 22 20:39:52 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 441 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 22 20:39:53.415393 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi [None req-369a2796-9ef9-4e97-9c5d-f88cde310494 admin admin] Calling method '>' {{(pid=122303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:39:53.420189 ncdv-master-1 devstack@n-api.service[122303]: DEBUG dbcounter [-] [122303] Writing DB stats nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:INSERT=2,nova_api:RELEASE=1 {{(pid=122303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:39:53.441971 ncdv-master-1 devstack@n-api.service[122303]: INFO nova.api.openstack.requestlog [None req-369a2796-9ef9-4e97-9c5d-f88cde310494 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.030125 Oct 22 20:39:53.442531 ncdv-master-1 devstack@n-api.service[122303]: [pid: 122303|app: 0|req: 20/40] 10.222.0.18 () {60 vars in 1210 bytes} [Sat Oct 22 20:39:53 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 22 20:39:53.458122 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi [None req-454a873a-d6db-4228-aa0b-169ccd58d1f1 admin admin] Calling method '>' {{(pid=122302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:39:53.483742 ncdv-master-1 devstack@n-api.service[122302]: INFO nova.api.openstack.requestlog [None req-454a873a-d6db-4228-aa0b-169ccd58d1f1 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.030277 Oct 22 20:39:53.484277 ncdv-master-1 devstack@n-api.service[122302]: [pid: 122302|app: 0|req: 21/41] 10.222.0.18 () {60 vars in 1210 bytes} [Sat Oct 22 20:39:53 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 20:39:53.494799 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi [None req-e1f5d469-7b9e-4a06-ad83-4a18171c4b02 admin admin] Calling method '>' {{(pid=122303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:39:53.500829 ncdv-master-1 devstack@n-api.service[122303]: INFO nova.api.openstack.wsgi [None req-e1f5d469-7b9e-4a06-ad83-4a18171c4b02 admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 22 20:39:53.504121 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi [None req-e1f5d469-7b9e-4a06-ad83-4a18171c4b02 admin admin] Request method failure captured: Oct 22 20:39:53.504121 ncdv-master-1 devstack@n-api.service[122303]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 22 20:39:53.504121 ncdv-master-1 devstack@n-api.service[122303]: Accept: application/json Oct 22 20:39:53.504121 ncdv-master-1 devstack@n-api.service[122303]: Accept-Encoding: gzip, deflate Oct 22 20:39:53.504121 ncdv-master-1 devstack@n-api.service[122303]: Connection: keep-alive Oct 22 20:39:53.504121 ncdv-master-1 devstack@n-api.service[122303]: Content-Length: 0 Oct 22 20:39:53.504121 ncdv-master-1 devstack@n-api.service[122303]: Host: 10.222.0.18 Oct 22 20:39:53.504121 ncdv-master-1 devstack@n-api.service[122303]: Openstack-Api-Version: compute 2.92 Oct 22 20:39:53.504121 ncdv-master-1 devstack@n-api.service[122303]: Openstack-System-Scope: None Oct 22 20:39:53.504121 ncdv-master-1 devstack@n-api.service[122303]: User-Agent: python-novaclient Oct 22 20:39:53.504121 ncdv-master-1 devstack@n-api.service[122303]: X-Auth-Token: gAAAAABjVFUYzjo9hIh82RkVRuMVVJUh1ec6xq1RSQElh_kMLwnBJofvhIhQ8dJVnf9NJRdNkhYhG5l1ujbvhVMO4wIffZ2Fl71UQPB9CqOMal34IqvXq7AxbET0MdlBpc78DXibFF5TTZZo-i3oeGPU-gj40loJuOZwVKiYK2FpzpxPBfOX_j0 Oct 22 20:39:53.504121 ncdv-master-1 devstack@n-api.service[122303]: X-Domain-Id: None Oct 22 20:39:53.504121 ncdv-master-1 devstack@n-api.service[122303]: X-Domain-Name: None Oct 22 20:39:53.504121 ncdv-master-1 devstack@n-api.service[122303]: X-Identity-Status: Confirmed Oct 22 20:39:53.504121 ncdv-master-1 devstack@n-api.service[122303]: X-Is-Admin-Project: True Oct 22 20:39:53.504121 ncdv-master-1 devstack@n-api.service[122303]: X-Openstack-Nova-Api-Version: 2.92 Oct 22 20:39:53.504121 ncdv-master-1 devstack@n-api.service[122303]: X-Project-Domain-Id: default Oct 22 20:39:53.504121 ncdv-master-1 devstack@n-api.service[122303]: X-Project-Domain-Name: Default Oct 22 20:39:53.504121 ncdv-master-1 devstack@n-api.service[122303]: X-Project-Id: 1ffd1cedd62c48f599340661b26417f0 Oct 22 20:39:53.504121 ncdv-master-1 devstack@n-api.service[122303]: X-Project-Name: admin Oct 22 20:39:53.504121 ncdv-master-1 devstack@n-api.service[122303]: X-Role: admin,member,reader Oct 22 20:39:53.504121 ncdv-master-1 devstack@n-api.service[122303]: X-Roles: admin,member,reader Oct 22 20:39:53.505559 ncdv-master-1 devstack@n-api.service[122303]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_1ffd1cedd62c48f599340661b26417f0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1ffd1cedd62c48f599340661b26417f0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/1ffd1cedd62c48f599340661b26417f0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1ffd1cedd62c48f599340661b26417f0"}]}] Oct 22 20:39:53.505559 ncdv-master-1 devstack@n-api.service[122303]: X-Tenant: admin Oct 22 20:39:53.505559 ncdv-master-1 devstack@n-api.service[122303]: X-Tenant-Id: 1ffd1cedd62c48f599340661b26417f0 Oct 22 20:39:53.505559 ncdv-master-1 devstack@n-api.service[122303]: X-Tenant-Name: admin Oct 22 20:39:53.505559 ncdv-master-1 devstack@n-api.service[122303]: X-User: admin Oct 22 20:39:53.505559 ncdv-master-1 devstack@n-api.service[122303]: X-User-Domain-Id: default Oct 22 20:39:53.505559 ncdv-master-1 devstack@n-api.service[122303]: X-User-Domain-Name: Default Oct 22 20:39:53.505559 ncdv-master-1 devstack@n-api.service[122303]: X-User-Id: 043e83d310424fb2aa8aa9414b1ed3f2 Oct 22 20:39:53.505559 ncdv-master-1 devstack@n-api.service[122303]: X-User-Name: admin Oct 22 20:39:53.505559 ncdv-master-1 devstack@n-api.service[122303]: method: > Oct 22 20:39:53.505559 ncdv-master-1 devstack@n-api.service[122303]: exception: Flavor 42 could not be found. Oct 22 20:39:53.505559 ncdv-master-1 devstack@n-api.service[122303]: action_args: {'id': '42'} Oct 22 20:39:53.505559 ncdv-master-1 devstack@n-api.service[122303]: {{(pid=122303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:39:53.505559 ncdv-master-1 devstack@n-api.service[122303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:39:53.506418 ncdv-master-1 devstack@n-api.service[122303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 22 20:39:53.506418 ncdv-master-1 devstack@n-api.service[122303]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 22 20:39:53.506418 ncdv-master-1 devstack@n-api.service[122303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 22 20:39:53.506418 ncdv-master-1 devstack@n-api.service[122303]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 22 20:39:53.506418 ncdv-master-1 devstack@n-api.service[122303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 22 20:39:53.506418 ncdv-master-1 devstack@n-api.service[122303]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 22 20:39:53.506418 ncdv-master-1 devstack@n-api.service[122303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 22 20:39:53.506418 ncdv-master-1 devstack@n-api.service[122303]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 22 20:39:53.506418 ncdv-master-1 devstack@n-api.service[122303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 22 20:39:53.506418 ncdv-master-1 devstack@n-api.service[122303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:39:53.506418 ncdv-master-1 devstack@n-api.service[122303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 22 20:39:53.506418 ncdv-master-1 devstack@n-api.service[122303]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 22 20:39:53.506418 ncdv-master-1 devstack@n-api.service[122303]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 22 20:39:53.506418 ncdv-master-1 devstack@n-api.service[122303]: ERROR nova.api.openstack.wsgi Oct 22 20:39:53.506418 ncdv-master-1 devstack@n-api.service[122303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:39:53.506418 ncdv-master-1 devstack@n-api.service[122303]: ERROR nova.api.openstack.wsgi Oct 22 20:39:53.506418 ncdv-master-1 devstack@n-api.service[122303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:39:53.506418 ncdv-master-1 devstack@n-api.service[122303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:39:53.506418 ncdv-master-1 devstack@n-api.service[122303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:39:53.507627 ncdv-master-1 devstack@n-api.service[122303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:39:53.507627 ncdv-master-1 devstack@n-api.service[122303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:39:53.507627 ncdv-master-1 devstack@n-api.service[122303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:39:53.507627 ncdv-master-1 devstack@n-api.service[122303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:39:53.507627 ncdv-master-1 devstack@n-api.service[122303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 22 20:39:53.507627 ncdv-master-1 devstack@n-api.service[122303]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 22 20:39:53.507627 ncdv-master-1 devstack@n-api.service[122303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 22 20:39:53.507627 ncdv-master-1 devstack@n-api.service[122303]: ERROR nova.api.openstack.wsgi Oct 22 20:39:53.507627 ncdv-master-1 devstack@n-api.service[122303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:39:53.507627 ncdv-master-1 devstack@n-api.service[122303]: ERROR nova.api.openstack.wsgi Oct 22 20:39:53.507627 ncdv-master-1 devstack@n-api.service[122303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:39:53.507627 ncdv-master-1 devstack@n-api.service[122303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:39:53.507627 ncdv-master-1 devstack@n-api.service[122303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:39:53.507627 ncdv-master-1 devstack@n-api.service[122303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 20:39:53.507627 ncdv-master-1 devstack@n-api.service[122303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 20:39:53.507627 ncdv-master-1 devstack@n-api.service[122303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 22 20:39:53.507627 ncdv-master-1 devstack@n-api.service[122303]: ERROR nova.api.openstack.wsgi Oct 22 20:39:53.507627 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi [None req-e1f5d469-7b9e-4a06-ad83-4a18171c4b02 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=122303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:39:53.508882 ncdv-master-1 devstack@n-api.service[122303]: INFO nova.api.openstack.requestlog [None req-e1f5d469-7b9e-4a06-ad83-4a18171c4b02 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.015181 Oct 22 20:39:53.508882 ncdv-master-1 devstack@n-api.service[122303]: [pid: 122303|app: 0|req: 21/42] 10.222.0.18 () {60 vars in 1190 bytes} [Sat Oct 22 20:39:53 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 22 20:39:55.272078 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi [None req-454a873a-d6db-4228-aa0b-169ccd58d1f1 admin admin] Calling method '>' {{(pid=122302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:39:55.273077 ncdv-master-1 devstack@n-api.service[122302]: INFO nova.api.openstack.requestlog [None req-454a873a-d6db-4228-aa0b-169ccd58d1f1 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001488 Oct 22 20:39:55.273469 ncdv-master-1 devstack@n-api.service[122302]: [pid: 122302|app: 0|req: 22/43] 10.222.0.18 () {56 vars in 1074 bytes} [Sat Oct 22 20:39:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:39:55.848446 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi [None req-52d93ce6-ae0b-4b88-af23-043d46eb0133 admin admin] Calling method '>' {{(pid=122303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:39:55.854005 ncdv-master-1 devstack@n-api.service[122303]: INFO nova.api.openstack.wsgi [None req-52d93ce6-ae0b-4b88-af23-043d46eb0133 admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 22 20:39:55.855570 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi [None req-52d93ce6-ae0b-4b88-af23-043d46eb0133 admin admin] Request method failure captured: Oct 22 20:39:55.855570 ncdv-master-1 devstack@n-api.service[122303]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 22 20:39:55.855570 ncdv-master-1 devstack@n-api.service[122303]: Accept: application/json Oct 22 20:39:55.855570 ncdv-master-1 devstack@n-api.service[122303]: Accept-Encoding: gzip, deflate Oct 22 20:39:55.855570 ncdv-master-1 devstack@n-api.service[122303]: Connection: keep-alive Oct 22 20:39:55.855570 ncdv-master-1 devstack@n-api.service[122303]: Content-Length: 0 Oct 22 20:39:55.855570 ncdv-master-1 devstack@n-api.service[122303]: Host: 10.222.0.18 Oct 22 20:39:55.855570 ncdv-master-1 devstack@n-api.service[122303]: Openstack-Api-Version: compute 2.92 Oct 22 20:39:55.855570 ncdv-master-1 devstack@n-api.service[122303]: Openstack-System-Scope: None Oct 22 20:39:55.855570 ncdv-master-1 devstack@n-api.service[122303]: User-Agent: python-novaclient Oct 22 20:39:55.855570 ncdv-master-1 devstack@n-api.service[122303]: X-Auth-Token: gAAAAABjVFUbcrq-tShDgYw-5WKRIIluaJ1u0AxcTzq3Y8VH1Qgv_y14fYsEks1_weVxv6vL7diPQxurSHn8RNPYf_orBsrIXLV1d2phkzWLdCVhBvwzXuyQfFe0Ivh1Wb1wrJqASKhDsUpqR4peAD1UvKS3EVWhPGy3qDL9uCXjOmNnIPT_3bM Oct 22 20:39:55.855570 ncdv-master-1 devstack@n-api.service[122303]: X-Domain-Id: None Oct 22 20:39:55.855570 ncdv-master-1 devstack@n-api.service[122303]: X-Domain-Name: None Oct 22 20:39:55.855570 ncdv-master-1 devstack@n-api.service[122303]: X-Identity-Status: Confirmed Oct 22 20:39:55.855570 ncdv-master-1 devstack@n-api.service[122303]: X-Is-Admin-Project: True Oct 22 20:39:55.855570 ncdv-master-1 devstack@n-api.service[122303]: X-Openstack-Nova-Api-Version: 2.92 Oct 22 20:39:55.855570 ncdv-master-1 devstack@n-api.service[122303]: X-Project-Domain-Id: default Oct 22 20:39:55.855570 ncdv-master-1 devstack@n-api.service[122303]: X-Project-Domain-Name: Default Oct 22 20:39:55.855570 ncdv-master-1 devstack@n-api.service[122303]: X-Project-Id: 1ffd1cedd62c48f599340661b26417f0 Oct 22 20:39:55.855570 ncdv-master-1 devstack@n-api.service[122303]: X-Project-Name: admin Oct 22 20:39:55.855570 ncdv-master-1 devstack@n-api.service[122303]: X-Role: admin,member,reader Oct 22 20:39:55.855570 ncdv-master-1 devstack@n-api.service[122303]: X-Roles: admin,member,reader Oct 22 20:39:55.857240 ncdv-master-1 devstack@n-api.service[122303]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_1ffd1cedd62c48f599340661b26417f0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1ffd1cedd62c48f599340661b26417f0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/1ffd1cedd62c48f599340661b26417f0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1ffd1cedd62c48f599340661b26417f0"}]}] Oct 22 20:39:55.857240 ncdv-master-1 devstack@n-api.service[122303]: X-Tenant: admin Oct 22 20:39:55.857240 ncdv-master-1 devstack@n-api.service[122303]: X-Tenant-Id: 1ffd1cedd62c48f599340661b26417f0 Oct 22 20:39:55.857240 ncdv-master-1 devstack@n-api.service[122303]: X-Tenant-Name: admin Oct 22 20:39:55.857240 ncdv-master-1 devstack@n-api.service[122303]: X-User: admin Oct 22 20:39:55.857240 ncdv-master-1 devstack@n-api.service[122303]: X-User-Domain-Id: default Oct 22 20:39:55.857240 ncdv-master-1 devstack@n-api.service[122303]: X-User-Domain-Name: Default Oct 22 20:39:55.857240 ncdv-master-1 devstack@n-api.service[122303]: X-User-Id: 043e83d310424fb2aa8aa9414b1ed3f2 Oct 22 20:39:55.857240 ncdv-master-1 devstack@n-api.service[122303]: X-User-Name: admin Oct 22 20:39:55.857240 ncdv-master-1 devstack@n-api.service[122303]: method: > Oct 22 20:39:55.857240 ncdv-master-1 devstack@n-api.service[122303]: exception: Flavor 84 could not be found. Oct 22 20:39:55.857240 ncdv-master-1 devstack@n-api.service[122303]: action_args: {'id': '84'} Oct 22 20:39:55.857240 ncdv-master-1 devstack@n-api.service[122303]: {{(pid=122303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:39:55.857240 ncdv-master-1 devstack@n-api.service[122303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:39:55.858031 ncdv-master-1 devstack@n-api.service[122303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 22 20:39:55.858031 ncdv-master-1 devstack@n-api.service[122303]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 22 20:39:55.858031 ncdv-master-1 devstack@n-api.service[122303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 22 20:39:55.858031 ncdv-master-1 devstack@n-api.service[122303]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 22 20:39:55.858031 ncdv-master-1 devstack@n-api.service[122303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 22 20:39:55.858031 ncdv-master-1 devstack@n-api.service[122303]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 22 20:39:55.858031 ncdv-master-1 devstack@n-api.service[122303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 22 20:39:55.858031 ncdv-master-1 devstack@n-api.service[122303]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 22 20:39:55.858031 ncdv-master-1 devstack@n-api.service[122303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 22 20:39:55.858031 ncdv-master-1 devstack@n-api.service[122303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:39:55.858031 ncdv-master-1 devstack@n-api.service[122303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 22 20:39:55.858031 ncdv-master-1 devstack@n-api.service[122303]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 22 20:39:55.858031 ncdv-master-1 devstack@n-api.service[122303]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 22 20:39:55.858031 ncdv-master-1 devstack@n-api.service[122303]: ERROR nova.api.openstack.wsgi Oct 22 20:39:55.858031 ncdv-master-1 devstack@n-api.service[122303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:39:55.858031 ncdv-master-1 devstack@n-api.service[122303]: ERROR nova.api.openstack.wsgi Oct 22 20:39:55.858031 ncdv-master-1 devstack@n-api.service[122303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:39:55.858031 ncdv-master-1 devstack@n-api.service[122303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:39:55.858031 ncdv-master-1 devstack@n-api.service[122303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:39:55.859406 ncdv-master-1 devstack@n-api.service[122303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:39:55.859406 ncdv-master-1 devstack@n-api.service[122303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:39:55.859406 ncdv-master-1 devstack@n-api.service[122303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:39:55.859406 ncdv-master-1 devstack@n-api.service[122303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:39:55.859406 ncdv-master-1 devstack@n-api.service[122303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 22 20:39:55.859406 ncdv-master-1 devstack@n-api.service[122303]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 22 20:39:55.859406 ncdv-master-1 devstack@n-api.service[122303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 22 20:39:55.859406 ncdv-master-1 devstack@n-api.service[122303]: ERROR nova.api.openstack.wsgi Oct 22 20:39:55.859406 ncdv-master-1 devstack@n-api.service[122303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:39:55.859406 ncdv-master-1 devstack@n-api.service[122303]: ERROR nova.api.openstack.wsgi Oct 22 20:39:55.859406 ncdv-master-1 devstack@n-api.service[122303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:39:55.859406 ncdv-master-1 devstack@n-api.service[122303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:39:55.859406 ncdv-master-1 devstack@n-api.service[122303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:39:55.859406 ncdv-master-1 devstack@n-api.service[122303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 20:39:55.859406 ncdv-master-1 devstack@n-api.service[122303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 20:39:55.859406 ncdv-master-1 devstack@n-api.service[122303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 22 20:39:55.859406 ncdv-master-1 devstack@n-api.service[122303]: ERROR nova.api.openstack.wsgi Oct 22 20:39:55.859406 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi [None req-52d93ce6-ae0b-4b88-af23-043d46eb0133 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=122303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:39:55.860658 ncdv-master-1 devstack@n-api.service[122303]: INFO nova.api.openstack.requestlog [None req-52d93ce6-ae0b-4b88-af23-043d46eb0133 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.439107 Oct 22 20:39:55.860658 ncdv-master-1 devstack@n-api.service[122303]: [pid: 122303|app: 0|req: 22/44] 10.222.0.18 () {60 vars in 1190 bytes} [Sat Oct 22 20:39:55 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 441 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 22 20:39:55.866973 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi [None req-7b2485b7-5260-41fd-b4ba-8ff61f5b5f98 admin admin] Calling method '>' {{(pid=122302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:39:55.882621 ncdv-master-1 devstack@n-api.service[122302]: INFO nova.api.openstack.requestlog [None req-7b2485b7-5260-41fd-b4ba-8ff61f5b5f98 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019264 Oct 22 20:39:55.883146 ncdv-master-1 devstack@n-api.service[122302]: [pid: 122302|app: 0|req: 23/45] 10.222.0.18 () {60 vars in 1210 bytes} [Sat Oct 22 20:39:55 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 20:39:55.893119 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi [None req-6c55024e-18bd-42f8-913d-5e2c8b27548b admin admin] Calling method '>' {{(pid=122303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:39:55.908799 ncdv-master-1 devstack@n-api.service[122303]: INFO nova.api.openstack.requestlog [None req-6c55024e-18bd-42f8-913d-5e2c8b27548b admin admin] 10.222.0.18 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019260 Oct 22 20:39:55.909367 ncdv-master-1 devstack@n-api.service[122303]: [pid: 122303|app: 0|req: 23/46] 10.222.0.18 () {60 vars in 1210 bytes} [Sat Oct 22 20:39:55 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 20:39:55.918831 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi [None req-7814f7b1-cd12-4b8d-800d-09f6b36b23b6 admin admin] Calling method '>' {{(pid=122302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:39:55.924207 ncdv-master-1 devstack@n-api.service[122302]: INFO nova.api.openstack.wsgi [None req-7814f7b1-cd12-4b8d-800d-09f6b36b23b6 admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 22 20:39:55.925704 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi [None req-7814f7b1-cd12-4b8d-800d-09f6b36b23b6 admin admin] Request method failure captured: Oct 22 20:39:55.925704 ncdv-master-1 devstack@n-api.service[122302]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 22 20:39:55.925704 ncdv-master-1 devstack@n-api.service[122302]: Accept: application/json Oct 22 20:39:55.925704 ncdv-master-1 devstack@n-api.service[122302]: Accept-Encoding: gzip, deflate Oct 22 20:39:55.925704 ncdv-master-1 devstack@n-api.service[122302]: Connection: keep-alive Oct 22 20:39:55.925704 ncdv-master-1 devstack@n-api.service[122302]: Content-Length: 0 Oct 22 20:39:55.925704 ncdv-master-1 devstack@n-api.service[122302]: Host: 10.222.0.18 Oct 22 20:39:55.925704 ncdv-master-1 devstack@n-api.service[122302]: Openstack-Api-Version: compute 2.92 Oct 22 20:39:55.925704 ncdv-master-1 devstack@n-api.service[122302]: Openstack-System-Scope: None Oct 22 20:39:55.925704 ncdv-master-1 devstack@n-api.service[122302]: User-Agent: python-novaclient Oct 22 20:39:55.925704 ncdv-master-1 devstack@n-api.service[122302]: X-Auth-Token: gAAAAABjVFUbcrq-tShDgYw-5WKRIIluaJ1u0AxcTzq3Y8VH1Qgv_y14fYsEks1_weVxv6vL7diPQxurSHn8RNPYf_orBsrIXLV1d2phkzWLdCVhBvwzXuyQfFe0Ivh1Wb1wrJqASKhDsUpqR4peAD1UvKS3EVWhPGy3qDL9uCXjOmNnIPT_3bM Oct 22 20:39:55.925704 ncdv-master-1 devstack@n-api.service[122302]: X-Domain-Id: None Oct 22 20:39:55.925704 ncdv-master-1 devstack@n-api.service[122302]: X-Domain-Name: None Oct 22 20:39:55.925704 ncdv-master-1 devstack@n-api.service[122302]: X-Identity-Status: Confirmed Oct 22 20:39:55.925704 ncdv-master-1 devstack@n-api.service[122302]: X-Is-Admin-Project: True Oct 22 20:39:55.925704 ncdv-master-1 devstack@n-api.service[122302]: X-Openstack-Nova-Api-Version: 2.92 Oct 22 20:39:55.925704 ncdv-master-1 devstack@n-api.service[122302]: X-Project-Domain-Id: default Oct 22 20:39:55.925704 ncdv-master-1 devstack@n-api.service[122302]: X-Project-Domain-Name: Default Oct 22 20:39:55.925704 ncdv-master-1 devstack@n-api.service[122302]: X-Project-Id: 1ffd1cedd62c48f599340661b26417f0 Oct 22 20:39:55.925704 ncdv-master-1 devstack@n-api.service[122302]: X-Project-Name: admin Oct 22 20:39:55.925704 ncdv-master-1 devstack@n-api.service[122302]: X-Role: admin,member,reader Oct 22 20:39:55.925704 ncdv-master-1 devstack@n-api.service[122302]: X-Roles: admin,member,reader Oct 22 20:39:55.927162 ncdv-master-1 devstack@n-api.service[122302]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_1ffd1cedd62c48f599340661b26417f0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1ffd1cedd62c48f599340661b26417f0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/1ffd1cedd62c48f599340661b26417f0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1ffd1cedd62c48f599340661b26417f0"}]}] Oct 22 20:39:55.927162 ncdv-master-1 devstack@n-api.service[122302]: X-Tenant: admin Oct 22 20:39:55.927162 ncdv-master-1 devstack@n-api.service[122302]: X-Tenant-Id: 1ffd1cedd62c48f599340661b26417f0 Oct 22 20:39:55.927162 ncdv-master-1 devstack@n-api.service[122302]: X-Tenant-Name: admin Oct 22 20:39:55.927162 ncdv-master-1 devstack@n-api.service[122302]: X-User: admin Oct 22 20:39:55.927162 ncdv-master-1 devstack@n-api.service[122302]: X-User-Domain-Id: default Oct 22 20:39:55.927162 ncdv-master-1 devstack@n-api.service[122302]: X-User-Domain-Name: Default Oct 22 20:39:55.927162 ncdv-master-1 devstack@n-api.service[122302]: X-User-Id: 043e83d310424fb2aa8aa9414b1ed3f2 Oct 22 20:39:55.927162 ncdv-master-1 devstack@n-api.service[122302]: X-User-Name: admin Oct 22 20:39:55.927162 ncdv-master-1 devstack@n-api.service[122302]: method: > Oct 22 20:39:55.927162 ncdv-master-1 devstack@n-api.service[122302]: exception: Flavor 84 could not be found. Oct 22 20:39:55.927162 ncdv-master-1 devstack@n-api.service[122302]: action_args: {'id': '84'} Oct 22 20:39:55.927162 ncdv-master-1 devstack@n-api.service[122302]: {{(pid=122302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:39:55.927162 ncdv-master-1 devstack@n-api.service[122302]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:39:55.928209 ncdv-master-1 devstack@n-api.service[122302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 22 20:39:55.928209 ncdv-master-1 devstack@n-api.service[122302]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 22 20:39:55.928209 ncdv-master-1 devstack@n-api.service[122302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 22 20:39:55.928209 ncdv-master-1 devstack@n-api.service[122302]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 22 20:39:55.928209 ncdv-master-1 devstack@n-api.service[122302]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 22 20:39:55.928209 ncdv-master-1 devstack@n-api.service[122302]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 22 20:39:55.928209 ncdv-master-1 devstack@n-api.service[122302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 22 20:39:55.928209 ncdv-master-1 devstack@n-api.service[122302]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 22 20:39:55.928209 ncdv-master-1 devstack@n-api.service[122302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 22 20:39:55.928209 ncdv-master-1 devstack@n-api.service[122302]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:39:55.928209 ncdv-master-1 devstack@n-api.service[122302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 22 20:39:55.928209 ncdv-master-1 devstack@n-api.service[122302]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 22 20:39:55.928209 ncdv-master-1 devstack@n-api.service[122302]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 22 20:39:55.928209 ncdv-master-1 devstack@n-api.service[122302]: ERROR nova.api.openstack.wsgi Oct 22 20:39:55.928209 ncdv-master-1 devstack@n-api.service[122302]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:39:55.928209 ncdv-master-1 devstack@n-api.service[122302]: ERROR nova.api.openstack.wsgi Oct 22 20:39:55.928209 ncdv-master-1 devstack@n-api.service[122302]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:39:55.928209 ncdv-master-1 devstack@n-api.service[122302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:39:55.928209 ncdv-master-1 devstack@n-api.service[122302]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:39:55.929291 ncdv-master-1 devstack@n-api.service[122302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:39:55.929291 ncdv-master-1 devstack@n-api.service[122302]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:39:55.929291 ncdv-master-1 devstack@n-api.service[122302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:39:55.929291 ncdv-master-1 devstack@n-api.service[122302]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:39:55.929291 ncdv-master-1 devstack@n-api.service[122302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 22 20:39:55.929291 ncdv-master-1 devstack@n-api.service[122302]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 22 20:39:55.929291 ncdv-master-1 devstack@n-api.service[122302]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 22 20:39:55.929291 ncdv-master-1 devstack@n-api.service[122302]: ERROR nova.api.openstack.wsgi Oct 22 20:39:55.929291 ncdv-master-1 devstack@n-api.service[122302]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:39:55.929291 ncdv-master-1 devstack@n-api.service[122302]: ERROR nova.api.openstack.wsgi Oct 22 20:39:55.929291 ncdv-master-1 devstack@n-api.service[122302]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:39:55.929291 ncdv-master-1 devstack@n-api.service[122302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:39:55.929291 ncdv-master-1 devstack@n-api.service[122302]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:39:55.929291 ncdv-master-1 devstack@n-api.service[122302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 20:39:55.929291 ncdv-master-1 devstack@n-api.service[122302]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 20:39:55.929291 ncdv-master-1 devstack@n-api.service[122302]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 22 20:39:55.929291 ncdv-master-1 devstack@n-api.service[122302]: ERROR nova.api.openstack.wsgi Oct 22 20:39:55.929291 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi [None req-7814f7b1-cd12-4b8d-800d-09f6b36b23b6 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=122302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:39:55.930377 ncdv-master-1 devstack@n-api.service[122302]: INFO nova.api.openstack.requestlog [None req-7814f7b1-cd12-4b8d-800d-09f6b36b23b6 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.011762 Oct 22 20:39:55.930377 ncdv-master-1 devstack@n-api.service[122302]: [pid: 122302|app: 0|req: 24/47] 10.222.0.18 () {60 vars in 1190 bytes} [Sat Oct 22 20:39:55 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 22 20:39:57.714772 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi [None req-6c55024e-18bd-42f8-913d-5e2c8b27548b admin admin] Calling method '>' {{(pid=122303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:39:57.715811 ncdv-master-1 devstack@n-api.service[122303]: INFO nova.api.openstack.requestlog [None req-6c55024e-18bd-42f8-913d-5e2c8b27548b admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001558 Oct 22 20:39:57.716234 ncdv-master-1 devstack@n-api.service[122303]: [pid: 122303|app: 0|req: 24/48] 10.222.0.18 () {56 vars in 1074 bytes} [Sat Oct 22 20:39:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:39:58.273204 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi [None req-e7b32477-802b-4a3e-a282-648226d770ef admin admin] Calling method '>' {{(pid=122302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:39:58.279323 ncdv-master-1 devstack@n-api.service[122302]: INFO nova.api.openstack.wsgi [None req-e7b32477-802b-4a3e-a282-648226d770ef admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 22 20:39:58.280903 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi [None req-e7b32477-802b-4a3e-a282-648226d770ef admin admin] Request method failure captured: Oct 22 20:39:58.280903 ncdv-master-1 devstack@n-api.service[122302]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 22 20:39:58.280903 ncdv-master-1 devstack@n-api.service[122302]: Accept: application/json Oct 22 20:39:58.280903 ncdv-master-1 devstack@n-api.service[122302]: Accept-Encoding: gzip, deflate Oct 22 20:39:58.280903 ncdv-master-1 devstack@n-api.service[122302]: Connection: keep-alive Oct 22 20:39:58.280903 ncdv-master-1 devstack@n-api.service[122302]: Content-Length: 0 Oct 22 20:39:58.280903 ncdv-master-1 devstack@n-api.service[122302]: Host: 10.222.0.18 Oct 22 20:39:58.280903 ncdv-master-1 devstack@n-api.service[122302]: Openstack-Api-Version: compute 2.92 Oct 22 20:39:58.280903 ncdv-master-1 devstack@n-api.service[122302]: Openstack-System-Scope: None Oct 22 20:39:58.280903 ncdv-master-1 devstack@n-api.service[122302]: User-Agent: python-novaclient Oct 22 20:39:58.280903 ncdv-master-1 devstack@n-api.service[122302]: X-Auth-Token: gAAAAABjVFUdqnZNP14xNs2zdjm7Nr9lqzQwwKmDqZCjc0E1Quj5NvOZZjARAios5HuuMimK1VDj_CjZfazuuWWUc4OIjtammPMbbtzpQQNzXofaI1WaDkyEenjAznZeuuiMNyepRMUr9RNMDR7xJVBZX0hfOHLjKgdpp72Va7Idx8x_XDv09Xc Oct 22 20:39:58.280903 ncdv-master-1 devstack@n-api.service[122302]: X-Domain-Id: None Oct 22 20:39:58.280903 ncdv-master-1 devstack@n-api.service[122302]: X-Domain-Name: None Oct 22 20:39:58.280903 ncdv-master-1 devstack@n-api.service[122302]: X-Identity-Status: Confirmed Oct 22 20:39:58.280903 ncdv-master-1 devstack@n-api.service[122302]: X-Is-Admin-Project: True Oct 22 20:39:58.280903 ncdv-master-1 devstack@n-api.service[122302]: X-Openstack-Nova-Api-Version: 2.92 Oct 22 20:39:58.280903 ncdv-master-1 devstack@n-api.service[122302]: X-Project-Domain-Id: default Oct 22 20:39:58.280903 ncdv-master-1 devstack@n-api.service[122302]: X-Project-Domain-Name: Default Oct 22 20:39:58.280903 ncdv-master-1 devstack@n-api.service[122302]: X-Project-Id: 1ffd1cedd62c48f599340661b26417f0 Oct 22 20:39:58.280903 ncdv-master-1 devstack@n-api.service[122302]: X-Project-Name: admin Oct 22 20:39:58.280903 ncdv-master-1 devstack@n-api.service[122302]: X-Role: admin,member,reader Oct 22 20:39:58.280903 ncdv-master-1 devstack@n-api.service[122302]: X-Roles: admin,member,reader Oct 22 20:39:58.282345 ncdv-master-1 devstack@n-api.service[122302]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_1ffd1cedd62c48f599340661b26417f0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1ffd1cedd62c48f599340661b26417f0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/1ffd1cedd62c48f599340661b26417f0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1ffd1cedd62c48f599340661b26417f0"}]}] Oct 22 20:39:58.282345 ncdv-master-1 devstack@n-api.service[122302]: X-Tenant: admin Oct 22 20:39:58.282345 ncdv-master-1 devstack@n-api.service[122302]: X-Tenant-Id: 1ffd1cedd62c48f599340661b26417f0 Oct 22 20:39:58.282345 ncdv-master-1 devstack@n-api.service[122302]: X-Tenant-Name: admin Oct 22 20:39:58.282345 ncdv-master-1 devstack@n-api.service[122302]: X-User: admin Oct 22 20:39:58.282345 ncdv-master-1 devstack@n-api.service[122302]: X-User-Domain-Id: default Oct 22 20:39:58.282345 ncdv-master-1 devstack@n-api.service[122302]: X-User-Domain-Name: Default Oct 22 20:39:58.282345 ncdv-master-1 devstack@n-api.service[122302]: X-User-Id: 043e83d310424fb2aa8aa9414b1ed3f2 Oct 22 20:39:58.282345 ncdv-master-1 devstack@n-api.service[122302]: X-User-Name: admin Oct 22 20:39:58.282345 ncdv-master-1 devstack@n-api.service[122302]: method: > Oct 22 20:39:58.282345 ncdv-master-1 devstack@n-api.service[122302]: exception: Flavor 451 could not be found. Oct 22 20:39:58.282345 ncdv-master-1 devstack@n-api.service[122302]: action_args: {'id': '451'} Oct 22 20:39:58.282345 ncdv-master-1 devstack@n-api.service[122302]: {{(pid=122302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:39:58.282345 ncdv-master-1 devstack@n-api.service[122302]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:39:58.283317 ncdv-master-1 devstack@n-api.service[122302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 22 20:39:58.283317 ncdv-master-1 devstack@n-api.service[122302]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 22 20:39:58.283317 ncdv-master-1 devstack@n-api.service[122302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 22 20:39:58.283317 ncdv-master-1 devstack@n-api.service[122302]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 22 20:39:58.283317 ncdv-master-1 devstack@n-api.service[122302]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 22 20:39:58.283317 ncdv-master-1 devstack@n-api.service[122302]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 22 20:39:58.283317 ncdv-master-1 devstack@n-api.service[122302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 22 20:39:58.283317 ncdv-master-1 devstack@n-api.service[122302]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 22 20:39:58.283317 ncdv-master-1 devstack@n-api.service[122302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 22 20:39:58.283317 ncdv-master-1 devstack@n-api.service[122302]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:39:58.283317 ncdv-master-1 devstack@n-api.service[122302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 22 20:39:58.283317 ncdv-master-1 devstack@n-api.service[122302]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 22 20:39:58.283317 ncdv-master-1 devstack@n-api.service[122302]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 22 20:39:58.283317 ncdv-master-1 devstack@n-api.service[122302]: ERROR nova.api.openstack.wsgi Oct 22 20:39:58.283317 ncdv-master-1 devstack@n-api.service[122302]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:39:58.283317 ncdv-master-1 devstack@n-api.service[122302]: ERROR nova.api.openstack.wsgi Oct 22 20:39:58.283317 ncdv-master-1 devstack@n-api.service[122302]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:39:58.283317 ncdv-master-1 devstack@n-api.service[122302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:39:58.283317 ncdv-master-1 devstack@n-api.service[122302]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:39:58.284459 ncdv-master-1 devstack@n-api.service[122302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:39:58.284459 ncdv-master-1 devstack@n-api.service[122302]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:39:58.284459 ncdv-master-1 devstack@n-api.service[122302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:39:58.284459 ncdv-master-1 devstack@n-api.service[122302]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:39:58.284459 ncdv-master-1 devstack@n-api.service[122302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 22 20:39:58.284459 ncdv-master-1 devstack@n-api.service[122302]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 22 20:39:58.284459 ncdv-master-1 devstack@n-api.service[122302]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 22 20:39:58.284459 ncdv-master-1 devstack@n-api.service[122302]: ERROR nova.api.openstack.wsgi Oct 22 20:39:58.284459 ncdv-master-1 devstack@n-api.service[122302]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:39:58.284459 ncdv-master-1 devstack@n-api.service[122302]: ERROR nova.api.openstack.wsgi Oct 22 20:39:58.284459 ncdv-master-1 devstack@n-api.service[122302]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:39:58.284459 ncdv-master-1 devstack@n-api.service[122302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:39:58.284459 ncdv-master-1 devstack@n-api.service[122302]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:39:58.284459 ncdv-master-1 devstack@n-api.service[122302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 20:39:58.284459 ncdv-master-1 devstack@n-api.service[122302]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 20:39:58.284459 ncdv-master-1 devstack@n-api.service[122302]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 22 20:39:58.284459 ncdv-master-1 devstack@n-api.service[122302]: ERROR nova.api.openstack.wsgi Oct 22 20:39:58.284459 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi [None req-e7b32477-802b-4a3e-a282-648226d770ef admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=122302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:39:58.285444 ncdv-master-1 devstack@n-api.service[122302]: INFO nova.api.openstack.requestlog [None req-e7b32477-802b-4a3e-a282-648226d770ef admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.418175 Oct 22 20:39:58.285444 ncdv-master-1 devstack@n-api.service[122302]: [pid: 122302|app: 0|req: 25/49] 10.222.0.18 () {60 vars in 1193 bytes} [Sat Oct 22 20:39:57 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 419 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 22 20:39:58.292252 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi [None req-4036a35b-bedf-4763-be70-a6fc0567c98f admin admin] Calling method '>' {{(pid=122303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:39:58.307832 ncdv-master-1 devstack@n-api.service[122303]: INFO nova.api.openstack.requestlog [None req-4036a35b-bedf-4763-be70-a6fc0567c98f admin admin] 10.222.0.18 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019139 Oct 22 20:39:58.308381 ncdv-master-1 devstack@n-api.service[122303]: [pid: 122303|app: 0|req: 25/50] 10.222.0.18 () {60 vars in 1210 bytes} [Sat Oct 22 20:39:58 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 20:39:58.317999 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi [None req-8c91066f-43ce-4e7a-b284-19f85cac853e admin admin] Calling method '>' {{(pid=122302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:39:58.333659 ncdv-master-1 devstack@n-api.service[122302]: INFO nova.api.openstack.requestlog [None req-8c91066f-43ce-4e7a-b284-19f85cac853e admin admin] 10.222.0.18 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019149 Oct 22 20:39:58.334168 ncdv-master-1 devstack@n-api.service[122302]: [pid: 122302|app: 0|req: 26/51] 10.222.0.18 () {60 vars in 1210 bytes} [Sat Oct 22 20:39:58 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 22 20:39:58.343917 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi [None req-d9c0c478-8916-43af-bef9-6966c7bede82 admin admin] Calling method '>' {{(pid=122303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:39:58.349092 ncdv-master-1 devstack@n-api.service[122303]: INFO nova.api.openstack.wsgi [None req-d9c0c478-8916-43af-bef9-6966c7bede82 admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 22 20:39:58.350600 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi [None req-d9c0c478-8916-43af-bef9-6966c7bede82 admin admin] Request method failure captured: Oct 22 20:39:58.350600 ncdv-master-1 devstack@n-api.service[122303]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 22 20:39:58.350600 ncdv-master-1 devstack@n-api.service[122303]: Accept: application/json Oct 22 20:39:58.350600 ncdv-master-1 devstack@n-api.service[122303]: Accept-Encoding: gzip, deflate Oct 22 20:39:58.350600 ncdv-master-1 devstack@n-api.service[122303]: Connection: keep-alive Oct 22 20:39:58.350600 ncdv-master-1 devstack@n-api.service[122303]: Content-Length: 0 Oct 22 20:39:58.350600 ncdv-master-1 devstack@n-api.service[122303]: Host: 10.222.0.18 Oct 22 20:39:58.350600 ncdv-master-1 devstack@n-api.service[122303]: Openstack-Api-Version: compute 2.92 Oct 22 20:39:58.350600 ncdv-master-1 devstack@n-api.service[122303]: Openstack-System-Scope: None Oct 22 20:39:58.350600 ncdv-master-1 devstack@n-api.service[122303]: User-Agent: python-novaclient Oct 22 20:39:58.350600 ncdv-master-1 devstack@n-api.service[122303]: X-Auth-Token: gAAAAABjVFUdqnZNP14xNs2zdjm7Nr9lqzQwwKmDqZCjc0E1Quj5NvOZZjARAios5HuuMimK1VDj_CjZfazuuWWUc4OIjtammPMbbtzpQQNzXofaI1WaDkyEenjAznZeuuiMNyepRMUr9RNMDR7xJVBZX0hfOHLjKgdpp72Va7Idx8x_XDv09Xc Oct 22 20:39:58.350600 ncdv-master-1 devstack@n-api.service[122303]: X-Domain-Id: None Oct 22 20:39:58.350600 ncdv-master-1 devstack@n-api.service[122303]: X-Domain-Name: None Oct 22 20:39:58.350600 ncdv-master-1 devstack@n-api.service[122303]: X-Identity-Status: Confirmed Oct 22 20:39:58.350600 ncdv-master-1 devstack@n-api.service[122303]: X-Is-Admin-Project: True Oct 22 20:39:58.350600 ncdv-master-1 devstack@n-api.service[122303]: X-Openstack-Nova-Api-Version: 2.92 Oct 22 20:39:58.350600 ncdv-master-1 devstack@n-api.service[122303]: X-Project-Domain-Id: default Oct 22 20:39:58.350600 ncdv-master-1 devstack@n-api.service[122303]: X-Project-Domain-Name: Default Oct 22 20:39:58.350600 ncdv-master-1 devstack@n-api.service[122303]: X-Project-Id: 1ffd1cedd62c48f599340661b26417f0 Oct 22 20:39:58.350600 ncdv-master-1 devstack@n-api.service[122303]: X-Project-Name: admin Oct 22 20:39:58.350600 ncdv-master-1 devstack@n-api.service[122303]: X-Role: admin,member,reader Oct 22 20:39:58.350600 ncdv-master-1 devstack@n-api.service[122303]: X-Roles: admin,member,reader Oct 22 20:39:58.352475 ncdv-master-1 devstack@n-api.service[122303]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_1ffd1cedd62c48f599340661b26417f0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1ffd1cedd62c48f599340661b26417f0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/1ffd1cedd62c48f599340661b26417f0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1ffd1cedd62c48f599340661b26417f0"}]}] Oct 22 20:39:58.352475 ncdv-master-1 devstack@n-api.service[122303]: X-Tenant: admin Oct 22 20:39:58.352475 ncdv-master-1 devstack@n-api.service[122303]: X-Tenant-Id: 1ffd1cedd62c48f599340661b26417f0 Oct 22 20:39:58.352475 ncdv-master-1 devstack@n-api.service[122303]: X-Tenant-Name: admin Oct 22 20:39:58.352475 ncdv-master-1 devstack@n-api.service[122303]: X-User: admin Oct 22 20:39:58.352475 ncdv-master-1 devstack@n-api.service[122303]: X-User-Domain-Id: default Oct 22 20:39:58.352475 ncdv-master-1 devstack@n-api.service[122303]: X-User-Domain-Name: Default Oct 22 20:39:58.352475 ncdv-master-1 devstack@n-api.service[122303]: X-User-Id: 043e83d310424fb2aa8aa9414b1ed3f2 Oct 22 20:39:58.352475 ncdv-master-1 devstack@n-api.service[122303]: X-User-Name: admin Oct 22 20:39:58.352475 ncdv-master-1 devstack@n-api.service[122303]: method: > Oct 22 20:39:58.352475 ncdv-master-1 devstack@n-api.service[122303]: exception: Flavor 451 could not be found. Oct 22 20:39:58.352475 ncdv-master-1 devstack@n-api.service[122303]: action_args: {'id': '451'} Oct 22 20:39:58.352475 ncdv-master-1 devstack@n-api.service[122303]: {{(pid=122303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:39:58.352475 ncdv-master-1 devstack@n-api.service[122303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:39:58.353348 ncdv-master-1 devstack@n-api.service[122303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 22 20:39:58.353348 ncdv-master-1 devstack@n-api.service[122303]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 22 20:39:58.353348 ncdv-master-1 devstack@n-api.service[122303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 22 20:39:58.353348 ncdv-master-1 devstack@n-api.service[122303]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 22 20:39:58.353348 ncdv-master-1 devstack@n-api.service[122303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 22 20:39:58.353348 ncdv-master-1 devstack@n-api.service[122303]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 22 20:39:58.353348 ncdv-master-1 devstack@n-api.service[122303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 22 20:39:58.353348 ncdv-master-1 devstack@n-api.service[122303]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 22 20:39:58.353348 ncdv-master-1 devstack@n-api.service[122303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 22 20:39:58.353348 ncdv-master-1 devstack@n-api.service[122303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:39:58.353348 ncdv-master-1 devstack@n-api.service[122303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 22 20:39:58.353348 ncdv-master-1 devstack@n-api.service[122303]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 22 20:39:58.353348 ncdv-master-1 devstack@n-api.service[122303]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 22 20:39:58.353348 ncdv-master-1 devstack@n-api.service[122303]: ERROR nova.api.openstack.wsgi Oct 22 20:39:58.353348 ncdv-master-1 devstack@n-api.service[122303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:39:58.353348 ncdv-master-1 devstack@n-api.service[122303]: ERROR nova.api.openstack.wsgi Oct 22 20:39:58.353348 ncdv-master-1 devstack@n-api.service[122303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:39:58.353348 ncdv-master-1 devstack@n-api.service[122303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:39:58.353348 ncdv-master-1 devstack@n-api.service[122303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:39:58.354517 ncdv-master-1 devstack@n-api.service[122303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:39:58.354517 ncdv-master-1 devstack@n-api.service[122303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:39:58.354517 ncdv-master-1 devstack@n-api.service[122303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:39:58.354517 ncdv-master-1 devstack@n-api.service[122303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:39:58.354517 ncdv-master-1 devstack@n-api.service[122303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 22 20:39:58.354517 ncdv-master-1 devstack@n-api.service[122303]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 22 20:39:58.354517 ncdv-master-1 devstack@n-api.service[122303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 22 20:39:58.354517 ncdv-master-1 devstack@n-api.service[122303]: ERROR nova.api.openstack.wsgi Oct 22 20:39:58.354517 ncdv-master-1 devstack@n-api.service[122303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:39:58.354517 ncdv-master-1 devstack@n-api.service[122303]: ERROR nova.api.openstack.wsgi Oct 22 20:39:58.354517 ncdv-master-1 devstack@n-api.service[122303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:39:58.354517 ncdv-master-1 devstack@n-api.service[122303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:39:58.354517 ncdv-master-1 devstack@n-api.service[122303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:39:58.354517 ncdv-master-1 devstack@n-api.service[122303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 20:39:58.354517 ncdv-master-1 devstack@n-api.service[122303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 20:39:58.354517 ncdv-master-1 devstack@n-api.service[122303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 22 20:39:58.354517 ncdv-master-1 devstack@n-api.service[122303]: ERROR nova.api.openstack.wsgi Oct 22 20:39:58.354517 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi [None req-d9c0c478-8916-43af-bef9-6966c7bede82 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=122303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:39:58.355593 ncdv-master-1 devstack@n-api.service[122303]: INFO nova.api.openstack.requestlog [None req-d9c0c478-8916-43af-bef9-6966c7bede82 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.011704 Oct 22 20:39:58.355593 ncdv-master-1 devstack@n-api.service[122303]: [pid: 122303|app: 0|req: 26/52] 10.222.0.18 () {60 vars in 1193 bytes} [Sat Oct 22 20:39:58 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 22 20:40:00.133709 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi [None req-8c91066f-43ce-4e7a-b284-19f85cac853e admin admin] Calling method '>' {{(pid=122302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:40:00.134808 ncdv-master-1 devstack@n-api.service[122302]: INFO nova.api.openstack.requestlog [None req-8c91066f-43ce-4e7a-b284-19f85cac853e admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001471 Oct 22 20:40:00.135171 ncdv-master-1 devstack@n-api.service[122302]: [pid: 122302|app: 0|req: 27/53] 10.222.0.18 () {56 vars in 1074 bytes} [Sat Oct 22 20:40:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:40:00.712238 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi [None req-a59e0c0b-51f4-4004-bff6-f2729c93efa3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=122303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:40:00.734543 ncdv-master-1 devstack@n-api.service[122303]: INFO nova.api.openstack.requestlog [None req-a59e0c0b-51f4-4004-bff6-f2729c93efa3 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.450733 Oct 22 20:40:00.735083 ncdv-master-1 devstack@n-api.service[122303]: [pid: 122303|app: 0|req: 27/54] 10.222.0.18 () {64 vars in 1235 bytes} [Sat Oct 22 20:40:00 2022] POST /compute/v2.1/flavors => generated 404 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 22 20:40:02.510159 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi [None req-8c91066f-43ce-4e7a-b284-19f85cac853e admin admin] Calling method '>' {{(pid=122302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:40:02.511804 ncdv-master-1 devstack@n-api.service[122302]: INFO nova.api.openstack.requestlog [None req-8c91066f-43ce-4e7a-b284-19f85cac853e admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002149 Oct 22 20:40:02.512206 ncdv-master-1 devstack@n-api.service[122302]: [pid: 122302|app: 0|req: 28/55] 10.222.0.18 () {56 vars in 1074 bytes} [Sat Oct 22 20:40:02 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:40:03.056678 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi [None req-5ee8c7df-feb6-4093-9fcf-512d36f2f881 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=122303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:40:03.078119 ncdv-master-1 devstack@n-api.service[122303]: INFO nova.api.openstack.requestlog [None req-5ee8c7df-feb6-4093-9fcf-512d36f2f881 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.421154 Oct 22 20:40:03.078656 ncdv-master-1 devstack@n-api.service[122303]: [pid: 122303|app: 0|req: 28/56] 10.222.0.18 () {64 vars in 1235 bytes} [Sat Oct 22 20:40:02 2022] POST /compute/v2.1/flavors => generated 405 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 22 20:40:04.870318 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi [None req-8c91066f-43ce-4e7a-b284-19f85cac853e admin admin] Calling method '>' {{(pid=122302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:40:04.871384 ncdv-master-1 devstack@n-api.service[122302]: INFO nova.api.openstack.requestlog [None req-8c91066f-43ce-4e7a-b284-19f85cac853e admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001676 Oct 22 20:40:04.871754 ncdv-master-1 devstack@n-api.service[122302]: [pid: 122302|app: 0|req: 29/57] 10.222.0.18 () {56 vars in 1074 bytes} [Sat Oct 22 20:40:04 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:40:05.528994 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi [None req-27d7b870-c415-4f9a-9bc3-8eadd052cfa0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=122303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:40:05.553499 ncdv-master-1 devstack@n-api.service[122303]: INFO nova.api.openstack.requestlog [None req-27d7b870-c415-4f9a-9bc3-8eadd052cfa0 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.500279 Oct 22 20:40:05.554068 ncdv-master-1 devstack@n-api.service[122303]: [pid: 122303|app: 0|req: 29/58] 10.222.0.18 () {64 vars in 1235 bytes} [Sat Oct 22 20:40:05 2022] POST /compute/v2.1/flavors => generated 407 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 22 20:40:07.419785 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi [None req-8c91066f-43ce-4e7a-b284-19f85cac853e admin admin] Calling method '>' {{(pid=122302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:40:07.420789 ncdv-master-1 devstack@n-api.service[122302]: INFO nova.api.openstack.requestlog [None req-8c91066f-43ce-4e7a-b284-19f85cac853e admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Oct 22 20:40:07.421186 ncdv-master-1 devstack@n-api.service[122302]: [pid: 122302|app: 0|req: 30/59] 10.222.0.18 () {56 vars in 1074 bytes} [Sat Oct 22 20:40:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:40:07.966586 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi [None req-9938a19f-fd93-428a-88fa-39c91b2b078d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=122303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:40:07.989086 ncdv-master-1 devstack@n-api.service[122303]: INFO nova.api.openstack.requestlog [None req-9938a19f-fd93-428a-88fa-39c91b2b078d admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.423713 Oct 22 20:40:07.989640 ncdv-master-1 devstack@n-api.service[122303]: [pid: 122303|app: 0|req: 30/60] 10.222.0.18 () {64 vars in 1235 bytes} [Sat Oct 22 20:40:07 2022] POST /compute/v2.1/flavors => generated 409 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 22 20:40:09.979447 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi [None req-8c91066f-43ce-4e7a-b284-19f85cac853e admin admin] Calling method '>' {{(pid=122302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:40:09.980460 ncdv-master-1 devstack@n-api.service[122302]: INFO nova.api.openstack.requestlog [None req-8c91066f-43ce-4e7a-b284-19f85cac853e admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001723 Oct 22 20:40:09.980839 ncdv-master-1 devstack@n-api.service[122302]: [pid: 122302|app: 0|req: 31/61] 10.222.0.18 () {56 vars in 1074 bytes} [Sat Oct 22 20:40:09 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:40:10.581967 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi [None req-7b8e9677-5369-49e2-9f61-ff11956bcd17 admin admin] Calling method '>' {{(pid=122303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:40:10.604011 ncdv-master-1 devstack@n-api.service[122303]: INFO nova.api.openstack.requestlog [None req-7b8e9677-5369-49e2-9f61-ff11956bcd17 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.476548 Oct 22 20:40:10.604556 ncdv-master-1 devstack@n-api.service[122303]: [pid: 122303|app: 0|req: 31/62] 10.222.0.18 () {60 vars in 1202 bytes} [Sat Oct 22 20:40:10 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 20:41:16.223178 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi [None req-8c91066f-43ce-4e7a-b284-19f85cac853e admin admin] Calling method '>' {{(pid=122302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:41:16.224919 ncdv-master-1 devstack@n-api.service[122302]: INFO nova.api.openstack.requestlog [None req-8c91066f-43ce-4e7a-b284-19f85cac853e admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002424 Oct 22 20:41:16.225578 ncdv-master-1 devstack@n-api.service[122302]: [pid: 122302|app: 0|req: 32/63] 10.222.0.18 () {54 vars in 931 bytes} [Sat Oct 22 20:41:16 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:41:16.236273 ncdv-master-1 devstack@n-api.service[122303]: DEBUG dbcounter [-] [122303] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=122303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:41:16.640280 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi [None req-d30ead1b-60f4-42a7-9995-8960f3599217 admin admin] Calling method '>' {{(pid=122303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:41:16.663570 ncdv-master-1 devstack@n-api.service[122303]: INFO nova.api.openstack.requestlog [None req-d30ead1b-60f4-42a7-9995-8960f3599217 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.428692 Oct 22 20:41:16.664110 ncdv-master-1 devstack@n-api.service[122303]: [pid: 122303|app: 0|req: 32/64] 10.222.0.18 () {60 vars in 1292 bytes} [Sat Oct 22 20:41:16 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 20:41:16.685216 ncdv-master-1 devstack@n-api.service[122302]: DEBUG dbcounter [-] [122302] Writing DB stats nova_api:SELECT=14 {{(pid=122302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:41:16.689055 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi [None req-88ee441d-61a6-4846-96b5-765d6e008544 admin admin] Calling method '>' {{(pid=122302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:41:16.696238 ncdv-master-1 devstack@n-api.service[122302]: INFO nova.api.openstack.requestlog [None req-88ee441d-61a6-4846-96b5-765d6e008544 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012526 Oct 22 20:41:16.696787 ncdv-master-1 devstack@n-api.service[122302]: [pid: 122302|app: 0|req: 33/65] 10.222.0.18 () {60 vars in 1283 bytes} [Sat Oct 22 20:41:16 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:41:16.711522 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi [None req-02c267c4-0261-419e-81b7-4142acff029b admin admin] Calling method '>' {{(pid=122303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:41:16.720846 ncdv-master-1 devstack@n-api.service[122303]: INFO nova.api.openstack.requestlog [None req-02c267c4-0261-419e-81b7-4142acff029b admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.015501 Oct 22 20:41:16.721326 ncdv-master-1 devstack@n-api.service[122303]: [pid: 122303|app: 0|req: 33/66] 10.222.0.18 () {60 vars in 1286 bytes} [Sat Oct 22 20:41:16 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:41:16.733367 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi [None req-628a9807-9e0b-4f42-adfa-fceb82449216 admin admin] Calling method '>' {{(pid=122302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:41:16.740568 ncdv-master-1 devstack@n-api.service[122302]: INFO nova.api.openstack.requestlog [None req-628a9807-9e0b-4f42-adfa-fceb82449216 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011075 Oct 22 20:41:16.741078 ncdv-master-1 devstack@n-api.service[122302]: [pid: 122302|app: 0|req: 34/67] 10.222.0.18 () {60 vars in 1286 bytes} [Sat Oct 22 20:41:16 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:41:16.752576 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi [None req-c2bda53b-9af8-4e9c-af8a-dcb5292241c1 admin admin] Calling method '>' {{(pid=122303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:41:16.759955 ncdv-master-1 devstack@n-api.service[122303]: INFO nova.api.openstack.requestlog [None req-c2bda53b-9af8-4e9c-af8a-dcb5292241c1 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010889 Oct 22 20:41:16.760504 ncdv-master-1 devstack@n-api.service[122303]: [pid: 122303|app: 0|req: 34/68] 10.222.0.18 () {60 vars in 1283 bytes} [Sat Oct 22 20:41:16 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:46:40.798901 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi [None req-628a9807-9e0b-4f42-adfa-fceb82449216 admin admin] Calling method '>' {{(pid=122302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:46:40.800279 ncdv-master-1 devstack@n-api.service[122302]: INFO nova.api.openstack.requestlog [None req-628a9807-9e0b-4f42-adfa-fceb82449216 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001942 Oct 22 20:46:40.800818 ncdv-master-1 devstack@n-api.service[122302]: [pid: 122302|app: 0|req: 35/69] 10.222.0.18 () {56 vars in 1074 bytes} [Sat Oct 22 20:46:40 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:46:40.949925 ncdv-master-1 devstack@n-api.service[122303]: DEBUG dbcounter [-] [122303] Writing DB stats nova_api:SELECT=6 {{(pid=122303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:46:41.105014 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi [None req-28781696-d45d-4d48-a4d0-c649387f5983 admin admin] Calling method '>' {{(pid=122303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:46:41.110032 ncdv-master-1 devstack@n-api.service[122303]: DEBUG oslo_concurrency.lockutils [None req-28781696-d45d-4d48-a4d0-c649387f5983 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:46:41.110497 ncdv-master-1 devstack@n-api.service[122303]: DEBUG oslo_concurrency.lockutils [None req-28781696-d45d-4d48-a4d0-c649387f5983 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:46:41.110914 ncdv-master-1 devstack@n-api.service[122303]: DEBUG oslo_concurrency.lockutils [None req-28781696-d45d-4d48-a4d0-c649387f5983 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:46:41.111644 ncdv-master-1 devstack@n-api.service[122303]: DEBUG oslo_concurrency.lockutils [None req-28781696-d45d-4d48-a4d0-c649387f5983 admin admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:46:41.112082 ncdv-master-1 devstack@n-api.service[122303]: DEBUG oslo_concurrency.lockutils [None req-28781696-d45d-4d48-a4d0-c649387f5983 admin admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:46:41.112493 ncdv-master-1 devstack@n-api.service[122303]: DEBUG oslo_concurrency.lockutils [None req-28781696-d45d-4d48-a4d0-c649387f5983 admin admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:46:41.149632 ncdv-master-1 devstack@n-api.service[122303]: INFO nova.api.openstack.requestlog [None req-28781696-d45d-4d48-a4d0-c649387f5983 admin admin] 10.222.0.18 "GET /compute/v2.1/os-services" status: 200 len: 1242 microversion: 2.92 time: 0.200843 Oct 22 20:46:41.150188 ncdv-master-1 devstack@n-api.service[122303]: [pid: 122303|app: 0|req: 35/70] 10.222.0.18 () {60 vars in 1193 bytes} [Sat Oct 22 20:46:40 2022] GET /compute/v2.1/os-services => generated 1242 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 20:46:42.763641 ncdv-master-1 devstack@n-api.service[122302]: DEBUG nova.api.openstack.wsgi [None req-628a9807-9e0b-4f42-adfa-fceb82449216 admin admin] Calling method '>' {{(pid=122302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:46:42.764655 ncdv-master-1 devstack@n-api.service[122302]: INFO nova.api.openstack.requestlog [None req-628a9807-9e0b-4f42-adfa-fceb82449216 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001496 Oct 22 20:46:42.765048 ncdv-master-1 devstack@n-api.service[122302]: [pid: 122302|app: 0|req: 36/71] 10.222.0.18 () {56 vars in 1074 bytes} [Sat Oct 22 20:46:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:46:42.971127 ncdv-master-1 devstack@n-api.service[122303]: DEBUG nova.api.openstack.wsgi [None req-8f186e01-35ca-4063-9157-81ddab388103 admin admin] Calling method '>' {{(pid=122303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:46:42.974710 ncdv-master-1 devstack@n-api.service[122303]: DEBUG oslo_concurrency.lockutils [None req-8f186e01-35ca-4063-9157-81ddab388103 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:46:42.975177 ncdv-master-1 devstack@n-api.service[122303]: DEBUG oslo_concurrency.lockutils [None req-8f186e01-35ca-4063-9157-81ddab388103 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:46:42.975622 ncdv-master-1 devstack@n-api.service[122303]: DEBUG oslo_concurrency.lockutils [None req-8f186e01-35ca-4063-9157-81ddab388103 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:46:42.976325 ncdv-master-1 devstack@n-api.service[122303]: DEBUG oslo_concurrency.lockutils [None req-8f186e01-35ca-4063-9157-81ddab388103 admin admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:46:42.977107 ncdv-master-1 devstack@n-api.service[122303]: DEBUG oslo_concurrency.lockutils [None req-8f186e01-35ca-4063-9157-81ddab388103 admin admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:46:42.977516 ncdv-master-1 devstack@n-api.service[122303]: DEBUG oslo_concurrency.lockutils [None req-8f186e01-35ca-4063-9157-81ddab388103 admin admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:46:43.000164 ncdv-master-1 devstack@n-api.service[122303]: INFO nova.api.openstack.requestlog [None req-8f186e01-35ca-4063-9157-81ddab388103 admin admin] 10.222.0.18 "GET /compute/v2.1/os-services" status: 200 len: 1242 microversion: 2.92 time: 0.089367 Oct 22 20:46:43.000706 ncdv-master-1 devstack@n-api.service[122303]: [pid: 122303|app: 0|req: 36/72] 10.222.0.18 () {60 vars in 1193 bytes} [Sat Oct 22 20:46:42 2022] GET /compute/v2.1/os-services => generated 1242 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 20:47:29.450485 ncdv-master-1 devstack@n-api.service[122301]: Sat Oct 22 20:47:29 2022 - graceful shutdown triggered... Oct 22 20:47:29.450592 ncdv-master-1 systemd[1]: Stopping Devstack devstack@n-api.service... Oct 22 20:47:29.451621 ncdv-master-1 devstack@n-api.service[122303]: Gracefully killing worker 2 (pid: 122303)... Oct 22 20:47:29.452069 ncdv-master-1 devstack@n-api.service[122302]: Gracefully killing worker 1 (pid: 122302)... Oct 22 20:47:29.592190 ncdv-master-1 devstack@n-api.service[122303]: DEBUG dbcounter [-] [122303] Writing DB stats nova_cell0:SELECT=4 {{(pid=122303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:47:29.592440 ncdv-master-1 devstack@n-api.service[122302]: DEBUG dbcounter [-] [122302] Writing DB stats nova_api:SELECT=4 {{(pid=122302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:47:29.592807 ncdv-master-1 devstack@n-api.service[122303]: DEBUG dbcounter [-] [122303] Writing DB stats nova_cell1:SELECT=4 {{(pid=122303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:47:29.593414 ncdv-master-1 devstack@n-api.service[122303]: DEBUG dbcounter [-] [122303] Writing DB stats nova_api:SELECT=8 {{(pid=122303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:47:30.452490 ncdv-master-1 devstack@n-api.service[122301]: worker 1 buried after 1 seconds Oct 22 20:47:30.452490 ncdv-master-1 devstack@n-api.service[122301]: worker 2 buried after 1 seconds Oct 22 20:47:30.452490 ncdv-master-1 devstack@n-api.service[122301]: goodbye to uWSGI. Oct 22 20:47:30.454814 ncdv-master-1 systemd[1]: devstack@n-api.service: Succeeded. Oct 22 20:47:30.455696 ncdv-master-1 systemd[1]: Stopped Devstack devstack@n-api.service. Oct 22 20:47:30.459194 ncdv-master-1 systemd[1]: Starting Devstack devstack@n-api.service... Oct 22 20:47:30.511092 ncdv-master-1 devstack@n-api.service[138715]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 22 20:47:30.514990 ncdv-master-1 devstack@n-api.service[138715]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat Oct 22 20:47:30 2022] *** Oct 22 20:47:30.514990 ncdv-master-1 devstack@n-api.service[138715]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 22 20:47:30.514990 ncdv-master-1 devstack@n-api.service[138715]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 22 20:47:30.514990 ncdv-master-1 devstack@n-api.service[138715]: nodename: ncdv-master-1 Oct 22 20:47:30.514990 ncdv-master-1 devstack@n-api.service[138715]: machine: x86_64 Oct 22 20:47:30.514990 ncdv-master-1 devstack@n-api.service[138715]: clock source: unix Oct 22 20:47:30.514990 ncdv-master-1 devstack@n-api.service[138715]: pcre jit disabled Oct 22 20:47:30.514990 ncdv-master-1 devstack@n-api.service[138715]: detected number of CPU cores: 4 Oct 22 20:47:30.514990 ncdv-master-1 devstack@n-api.service[138715]: current working directory: / Oct 22 20:47:30.514990 ncdv-master-1 devstack@n-api.service[138715]: detected binary path: /usr/bin/uwsgi-core Oct 22 20:47:30.515745 ncdv-master-1 devstack@n-api.service[138715]: your processes number limit is 47680 Oct 22 20:47:30.515745 ncdv-master-1 devstack@n-api.service[138715]: your memory page size is 4096 bytes Oct 22 20:47:30.515745 ncdv-master-1 devstack@n-api.service[138715]: detected max file descriptor number: 2048 Oct 22 20:47:30.515745 ncdv-master-1 devstack@n-api.service[138715]: lock engine: pthread robust mutexes Oct 22 20:47:30.515745 ncdv-master-1 devstack@n-api.service[138715]: thunder lock: enabled Oct 22 20:47:30.515745 ncdv-master-1 devstack@n-api.service[138715]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 22 20:47:30.515745 ncdv-master-1 devstack@n-api.service[138715]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 22 20:47:30.560011 ncdv-master-1 devstack@n-api.service[138715]: Python main interpreter initialized at 0x5640512899c0 Oct 22 20:47:30.560011 ncdv-master-1 devstack@n-api.service[138715]: python threads support enabled Oct 22 20:47:30.560011 ncdv-master-1 devstack@n-api.service[138715]: your server socket listen backlog is limited to 100 connections Oct 22 20:47:30.560011 ncdv-master-1 devstack@n-api.service[138715]: your mercy for graceful operations on workers is 90 seconds Oct 22 20:47:30.560425 ncdv-master-1 devstack@n-api.service[138715]: mapped 403077 bytes (393 KB) for 2 cores Oct 22 20:47:30.560425 ncdv-master-1 devstack@n-api.service[138715]: *** Operational MODE: preforking *** Oct 22 20:47:30.560677 ncdv-master-1 devstack@n-api.service[138715]: *** uWSGI is running in multiple interpreter mode *** Oct 22 20:47:30.560677 ncdv-master-1 devstack@n-api.service[138715]: spawned uWSGI master process (pid: 138715) Oct 22 20:47:30.560853 ncdv-master-1 systemd[1]: Started Devstack devstack@n-api.service. Oct 22 20:47:30.562167 ncdv-master-1 devstack@n-api.service[138715]: spawned uWSGI worker 1 (pid: 138744, cores: 1) Oct 22 20:47:30.562717 ncdv-master-1 devstack@n-api.service[138715]: spawned uWSGI worker 2 (pid: 138745, cores: 1) Oct 22 20:47:30.562920 ncdv-master-1 devstack@n-api.service[138715]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 22 20:47:31.881322 ncdv-master-1 devstack@n-api.service[138745]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 22 20:47:31.881938 ncdv-master-1 devstack@n-api.service[138744]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 22 20:47:32.658332 ncdv-master-1 devstack@n-api.service[138745]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 22 20:47:32.658332 ncdv-master-1 devstack@n-api.service[138745]: from cryptography.utils import int_from_bytes Oct 22 20:47:32.658719 ncdv-master-1 devstack@n-api.service[138745]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 22 20:47:32.658719 ncdv-master-1 devstack@n-api.service[138745]: from cryptography.utils import int_from_bytes Oct 22 20:47:32.665556 ncdv-master-1 devstack@n-api.service[138744]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 22 20:47:32.665556 ncdv-master-1 devstack@n-api.service[138744]: from cryptography.utils import int_from_bytes Oct 22 20:47:32.665556 ncdv-master-1 devstack@n-api.service[138744]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 22 20:47:32.665556 ncdv-master-1 devstack@n-api.service[138744]: from cryptography.utils import int_from_bytes Oct 22 20:47:35.119665 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 22 20:47:35.120289 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 22 20:47:35.120571 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 22 20:47:35.120839 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 22 20:47:35.121095 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 22 20:47:35.121514 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.121848 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.122214 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.122503 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.122839 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.123126 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.123483 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.123822 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.124175 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.124413 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.124757 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.125089 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] console_host = ncdv-master-1 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.125393 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.125709 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.126058 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.126386 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.126677 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.127046 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.127313 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.127838 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.129378 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.129709 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.130096 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.130441 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.130776 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.131086 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.131475 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.131778 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.132143 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.132439 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.132862 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] host = ncdv-master-1 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.133188 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.133518 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.133827 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.134285 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.134606 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.134923 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.135240 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.135603 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.135912 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.136253 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.136597 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.136925 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.137253 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.137562 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.137873 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.138199 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.138530 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.138857 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.139148 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.139397 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.139715 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.140043 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.140376 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.140707 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.140965 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.141139 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 22 20:47:35.141725 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.141886 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 22 20:47:35.142047 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.142047 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.142343 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 22 20:47:35.142485 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.142638 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 22 20:47:35.142790 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.142943 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 22 20:47:35.143087 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.143228 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.143418 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.143598 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.143755 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.143914 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.144064 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.144242 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.144399 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.144542 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.144694 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.144838 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.144986 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.145139 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.145292 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.145292 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.145715 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.145867 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.146012 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.146155 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.146342 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.146496 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.18 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.146650 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.146846 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.18 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.147001 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] console_host = ncdv-master-1 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.147153 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.147306 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.147508 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.147669 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.147813 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.147964 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.148136 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.148306 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.148467 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.148639 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.148899 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.149087 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.149232 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.149380 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.149532 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.149532 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.149837 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.150020 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.150164 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.150314 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.150466 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.151447 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.151604 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.151766 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.151912 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.152075 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.152245 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.152396 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.152539 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.152695 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.152838 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.152994 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.153147 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.153477 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.153636 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.153780 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.153928 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.154084 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.154084 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.154376 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] host = ncdv-master-1 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.154527 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.154670 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.154821 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.154971 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.155120 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.155273 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.155455 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.155598 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.155768 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.155911 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.156060 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.156201 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.156380 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.156542 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.156685 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.156835 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.157034 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.157346 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.157525 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.157682 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.157829 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.157829 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.158114 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.158268 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.158433 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.158599 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.158750 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.158902 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.159054 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.159279 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.159472 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.159625 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.159778 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.159943 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.160101 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.160252 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.160402 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.160557 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.160724 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.160724 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.161692 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.161839 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.161981 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.161981 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.162250 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.162406 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.162559 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.162702 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.162843 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.162843 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.163149 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.163291 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.163706 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.163706 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.163991 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.164142 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.164299 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.164452 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.164602 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.164753 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.164905 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.165067 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.165224 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.165374 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.165517 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.165659 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.165818 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.165967 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.166120 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.166263 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.166405 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.166563 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.166712 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.166866 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.167074 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.167222 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.167394 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.168093 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.168247 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.168488 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.168636 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.168788 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.168944 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.169087 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.169087 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.169372 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.18 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.169372 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.18 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.169674 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.169824 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.169976 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.170126 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.170279 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.170438 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.170588 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.170740 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.170882 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.171148 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.171857 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.171857 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.172156 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.172300 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.172444 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.172444 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.172738 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.172889 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.173050 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.173050 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.173319 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.173481 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.173649 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.173994 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.174148 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.174148 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.174443 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.174586 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.174728 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.174876 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.175022 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.175022 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.175305 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.175505 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.175660 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.175804 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.175953 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.175953 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.176253 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.176396 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.176537 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.176686 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.176837 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.176988 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.177182 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.177330 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.177480 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.177623 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.177769 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.177918 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.178088 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.178242 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.178386 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.178536 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.178686 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.178845 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.178989 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.179138 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.179288 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.179478 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.179631 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.179784 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.179943 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.180106 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.180257 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.180401 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.180544 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.180696 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.180841 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.180982 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.181157 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.181521 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.182011 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.182170 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.182322 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.182467 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.182638 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.182782 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.182924 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.183074 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.183227 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.183389 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.183552 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.183697 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.183857 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.184167 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.184315 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.184475 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.184628 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.184798 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.184953 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.185110 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.185254 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.185411 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.185578 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.185722 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.185864 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.185961 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.186043 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.186120 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.186208 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.186288 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.186373 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.186457 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.186556 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.186649 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.186747 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.186837 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.186922 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.187007 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.187090 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.187211 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.187304 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.187447 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.187534 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.187613 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.187683 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.187763 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.187843 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.187924 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.188010 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.188090 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.188090 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.188090 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.188090 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:47:35.188090 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.188414 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.188487 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.188558 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.188558 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.188708 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.188781 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.188855 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.188934 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.189005 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.189085 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.189164 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.189251 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.189331 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.189430 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.189525 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.189757 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.189838 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.190081 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.190174 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.190412 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.190511 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.190729 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.190817 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.191047 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.191135 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.191549 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.191665 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.191766 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.192173 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.192302 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.192399 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.192494 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.192704 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.192828 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.192941 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.193035 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.193128 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.193342 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.193447 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.193666 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.193764 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.194013 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.194130 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.194427 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.194525 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.194650 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.194743 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.194981 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.195072 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.195318 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.195446 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.195668 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.195760 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.195983 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.196073 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.196302 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.196384 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.196614 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.196703 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.196927 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.197017 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.197276 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.197365 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.197555 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.197636 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.197867 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.197963 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.198179 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.198269 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.198492 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.198580 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.198803 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.198899 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.199115 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.199204 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.199666 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.199824 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.199995 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.200150 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.200304 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.200457 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.200600 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.200742 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.200894 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.201037 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.201180 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.201322 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.201483 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.201817 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.202312 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.202482 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.202628 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.202770 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.202928 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.203082 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.203237 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.203399 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.203566 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.203710 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.203862 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.204006 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.204164 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.204325 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.204662 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.204808 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.204958 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.205100 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.205252 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.205395 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.205540 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.205681 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.205824 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.205980 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.206123 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.206265 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.206408 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.206565 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.206710 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.206866 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.207019 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.207174 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.207384 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.207540 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.207696 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.207892 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.208049 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.208200 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.208200 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.208501 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.208699 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.208858 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.209014 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.209164 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.209377 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.209533 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.209691 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.209835 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.209977 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.210126 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.210271 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.210412 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.210587 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.210730 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.210880 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.211022 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.211163 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.211304 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.211490 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.211636 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.211987 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.212475 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.212642 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.212787 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.212953 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.213121 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.213273 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.213417 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.213572 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.213726 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.213870 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.214014 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.214163 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.214306 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.214448 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.214788 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.214788 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.215087 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.215251 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.215466 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.215616 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.215769 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.215919 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.216071 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.216222 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.216365 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.216507 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.216659 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.216802 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.216956 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.217113 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.217256 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.217415 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.217604 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.217747 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.217897 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.218040 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.218183 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.218339 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.218490 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.218645 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.218789 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.218939 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.219092 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.219251 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.219424 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.219580 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.219723 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.219879 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.220022 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.220178 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.220329 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.220471 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.220613 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.220833 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.221008 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.221173 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.221316 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.221458 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.221607 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.221750 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.222107 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.222614 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.222777 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.222932 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.223121 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.223282 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.223580 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.223732 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.223889 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.224033 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.224178 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.224328 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.224488 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.224647 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.225010 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.225168 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.225319 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.225487 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.225652 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.225811 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.225961 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.226179 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.226341 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.226512 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.226999 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.227154 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.227309 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.227722 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.227890 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.228051 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.228219 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.228464 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.228464 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.228801 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.228801 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.229111 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.229111 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.229411 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.229562 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.229719 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.229881 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.230040 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.230203 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.230353 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.230502 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.230658 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.230830 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.230982 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.231131 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.231289 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.231476 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.231636 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.231796 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.231946 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.232305 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.232793 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.232961 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.233122 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.233286 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.233455 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.233756 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.233914 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.233914 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.234198 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.234358 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.234510 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.234659 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.234809 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.235148 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.235316 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.235512 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.235674 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.235852 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.236023 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.236175 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.236325 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.236481 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.236631 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.236788 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.236948 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.237100 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.237253 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.237402 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.238251 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.238424 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.238583 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.238741 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.238892 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.239083 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.239302 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.239542 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.239748 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.239913 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.240073 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.240244 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.240404 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.240568 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.240719 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.240878 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.241029 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.241192 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.241351 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.241511 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.241661 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.241811 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.241977 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.242135 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.242562 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.243109 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.243276 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.243454 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.243620 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.243782 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.243934 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.244082 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.244232 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.244382 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.244540 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.244698 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.244857 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.244857 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.245358 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.245528 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.245692 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.245861 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.246023 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.246174 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.246323 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.246323 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.246620 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.246778 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.246927 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.247076 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.247226 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.247405 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.247574 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.247734 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.247929 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.248083 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.248241 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.248402 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.248563 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.248721 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.248880 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.249031 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.249196 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.249196 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.249770 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.249930 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.250089 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.250247 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.250450 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.250601 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.250931 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.251088 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.251247 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.251429 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.251574 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.251666 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.251771 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.251866 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.251952 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.252072 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.252244 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.252345 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.252676 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.252953 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.253170 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.253276 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.253363 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.253457 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.253543 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.253626 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.253711 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.253804 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.253891 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.253974 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.254057 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.254140 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.254234 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.254334 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.254420 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.254504 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.254588 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.254695 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.254805 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.254901 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.254987 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.255071 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.255071 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.255223 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.255410 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.255514 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.255608 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.255694 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.255779 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.255863 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.256031 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.256120 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.256205 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.256205 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.256376 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.256469 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.256554 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.256637 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.256721 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.256823 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.256918 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.257003 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.257087 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.257170 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.257262 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.257382 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.257479 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.257565 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.257664 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.257757 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.257843 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.258081 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.258186 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.258283 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.258369 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.258464 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.258548 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.258642 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.258735 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.258828 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.258920 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.259006 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.259103 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.259189 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.259279 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.259509 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.259606 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.259691 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.259861 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.259957 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.260049 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.260134 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.260218 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.260308 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.260406 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.260499 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.260610 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.260696 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.260779 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.260877 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.260972 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.261057 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.261141 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.261223 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.261307 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.261399 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.261484 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.261575 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.261660 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.261759 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.261851 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.261946 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.262031 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.262122 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.262215 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.262308 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.262402 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.262501 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.262586 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.262877 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.263042 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.263189 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.263313 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.263438 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.263527 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.263619 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.263704 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.263788 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.263887 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.263973 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.264064 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.264159 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.264258 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.264352 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.264511 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.264604 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.264830 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.264923 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.265152 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.265245 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.265472 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.265601 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.265791 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.265882 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.266112 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.266203 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.266424 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.266518 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.266737 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.266836 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.267055 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.267154 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.267469 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.267604 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.267790 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.267897 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.268111 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.268213 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.268430 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.268531 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.268743 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.268844 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.269059 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.269162 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.269370 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.269473 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.269685 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.269785 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.269997 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.270097 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.270325 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.270419 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.270640 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.270730 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.270959 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.271059 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.271279 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.271424 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.271649 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.271743 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.271970 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.272161 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.272317 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.272411 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.272586 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.272716 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.272914 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.273033 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.273222 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.273431 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.273584 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.273691 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.273836 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.273951 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.274169 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.274302 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.274489 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.274619 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.274883 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.275206 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.275566 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.275906 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.276048 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.276275 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.276392 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.276590 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.276715 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.276907 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.277036 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.277218 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.277345 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.277527 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.277644 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.277844 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.277977 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.278175 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.278396 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.278511 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.278632 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.278784 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.278918 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.279092 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.279210 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.280728 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.280863 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.281059 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.281169 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.281260 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.281356 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.281443 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.281528 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.281713 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.281817 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.281913 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.282009 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.282097 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.282182 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.282278 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.282366 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.282459 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.282459 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.282619 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.282742 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.282882 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.283070 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.283419 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.283543 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.283748 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.284013 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.284121 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.284351 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.284443 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.284683 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.284775 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.285005 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.285127 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.285324 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.285430 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.285642 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.285738 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.286065 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.286182 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.286519 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.286670 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.286895 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.287006 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.287175 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.287273 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.287628 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.287737 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.287959 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.288137 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.288283 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.288407 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.288615 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.288802 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.288948 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.289148 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.289249 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.289494 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.289586 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.289818 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.289910 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.290146 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.290239 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.290456 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.290563 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.290786 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.290882 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.291096 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.291198 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.291436 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.291534 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.291755 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.291846 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.292068 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.292170 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.292377 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.292479 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.292687 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.292794 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.293017 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.293105 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.293329 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.293528 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.293661 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.293785 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.293979 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.294115 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.294311 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.294430 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.294637 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.294749 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.294950 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.295054 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.295280 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.295458 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.295626 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.295769 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.295939 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.296093 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.296251 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.296418 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.296561 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.296736 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.296907 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.297190 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.297283 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.297520 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.297620 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.297848 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.297948 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.298168 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.298320 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.298487 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.298587 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.298830 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.299165 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.299256 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.299517 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.299644 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.299835 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.299975 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.300160 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.300297 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.300492 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.300734 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.300826 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.301062 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.301153 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.301386 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.301496 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.301779 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.301879 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.302094 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.302299 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.302403 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.302627 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.302727 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.302951 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.303051 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.303299 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.303634 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.303767 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.303885 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.304091 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.304204 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.304448 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.304567 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.304756 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.304858 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.305057 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.305160 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.305369 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.305486 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.305692 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.305793 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.306004 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.306103 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.306355 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.306463 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.306671 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.306835 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.307004 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.307161 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.307324 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.307525 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.307676 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.308000 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.308099 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.308869 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.309071 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.309229 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.309391 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.309549 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.309699 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.309861 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.309861 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.310160 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.310308 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.310457 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.310621 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.310779 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.310929 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.311077 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.311225 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.311418 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.311575 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.311796 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.311796 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.312110 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.312259 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.312415 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.312566 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.312729 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.312888 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.313045 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.313194 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.313343 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.313498 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.313618 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.313702 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.313775 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.314583 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.314692 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.314793 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.314889 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.314976 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.315060 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.315151 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.315246 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.315362 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.315491 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.315596 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.315913 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.316270 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.316616 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.316739 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.316941 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.317049 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.317294 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.317455 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.317714 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.317809 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.318105 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.318206 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.318513 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.318618 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.318847 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.318947 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.319210 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.319309 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.319548 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.319660 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.319873 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.319976 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.320196 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.320294 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.320520 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.320629 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.320847 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.320946 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.321164 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.321271 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.321482 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.321590 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.321863 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.321972 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.322210 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.322307 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.322471 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.322597 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.322760 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.322862 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.323078 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.323179 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.323427 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.323557 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.323766 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.323874 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.324115 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.324230 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.324446 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.324545 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.324769 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.324868 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.325090 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.325185 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.325417 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.325528 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.325768 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.325953 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.326088 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.326280 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.326420 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.326624 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.326753 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.326962 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.327063 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.327298 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.327446 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.327654 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.327817 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.327979 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.328140 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.328314 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.328510 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.328620 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.328836 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.328939 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.329154 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.329259 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.329471 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.329575 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.329786 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.329886 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.330098 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.330210 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.330429 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.330537 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.330744 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.330850 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.331068 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.331176 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.331406 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.331519 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.331721 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.331941 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.332045 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.332303 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.332396 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.332627 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.332719 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.332995 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.333109 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.333334 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.333580 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.333693 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.333938 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.334047 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.334241 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.334346 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.334557 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.334650 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.334872 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.334983 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.335186 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.335286 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.335539 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.335644 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.335860 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.335961 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.336171 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.336270 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.336483 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.336575 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.336802 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.336912 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.337118 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.337219 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.337428 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.337519 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.338923 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.339040 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.339182 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.339279 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.339387 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.339487 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.340219 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.340323 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.340420 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.340516 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.340602 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.340602 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.340773 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.340859 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.340950 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.341038 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.341131 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.341226 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.341325 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.341420 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.341507 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.341590 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.341681 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.341775 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.341862 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.341946 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.342037 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.342131 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.342226 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.342395 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.342490 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.342625 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.342902 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.343003 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.343237 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.343378 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.343604 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.344099 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.344219 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.344320 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.344619 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.344850 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.345180 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.345497 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.345819 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.346172 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.346496 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.346682 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.347048 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.347164 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.347412 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.347526 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.347740 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.347854 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.348080 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.348179 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.348443 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.348581 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.348871 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.348980 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.349212 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.349312 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.349548 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.349664 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.349969 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.350073 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.350201 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.350352 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.350570 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.350688 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.350967 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.351131 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.351228 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.351314 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.351478 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.352146 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.352248 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.352441 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.352536 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.352779 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.352879 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.353096 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.353205 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.353416 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.353773 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.353869 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.354056 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.354196 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.354363 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.354565 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.354818 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.355064 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.355162 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.355449 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.355585 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.355783 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.355915 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.356114 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.356228 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.356553 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.356710 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.356802 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.357169 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.357393 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.357535 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.358124 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.358234 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.358312 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.358471 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.358576 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.358671 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.358766 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.358861 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.359145 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.359253 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.359486 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.359573 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.359899 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.360045 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.360245 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.360347 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.360574 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.360951 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.361073 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.361189 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.361329 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.361434 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.361694 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.361897 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.362044 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.362242 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.362350 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.362656 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.362747 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.363011 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.363110 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.363501 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.363884 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.364051 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.364355 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.364545 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.364864 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.364978 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.365105 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.365330 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.365431 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.365677 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.365777 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.366002 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.366105 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.366327 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.366428 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.366643 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.366735 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.366953 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.367047 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.367265 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.367474 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.367612 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.367702 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.367908 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.368034 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.368219 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.368415 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.368532 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.368742 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.368847 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.369109 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.369204 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.369418 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.369517 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.369775 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.369888 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.370053 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.370147 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.370344 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.370446 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.370654 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.370748 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.370978 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.371126 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.371274 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.371389 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.371612 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.371713 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.371922 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.372025 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.372245 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.372338 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.372583 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.372683 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.372888 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.372986 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.373205 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.373296 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.373522 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.373617 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.373844 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.373959 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.374177 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.374290 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.374492 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.374620 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.374811 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.374957 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.375126 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.375268 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.375470 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.375567 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.375788 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.375884 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.376112 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.376286 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.376431 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.376528 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.376759 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.376850 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.377073 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.377175 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.377388 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.377479 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.377700 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.377800 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.378015 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.378116 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.378327 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.378587 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.378681 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.378937 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.379042 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.379269 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.379392 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.379607 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.379717 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.379965 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.380072 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.380290 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.380384 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.380617 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.380709 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.380940 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.381055 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.381261 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.381400 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.381595 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.381699 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.381913 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.382005 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.382227 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.382327 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.382541 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.382633 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.382855 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.382949 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.383169 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.383261 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.383511 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.383625 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.383827 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.383927 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.384141 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.384286 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.384459 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.384565 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.384776 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.384884 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.385092 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.385201 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.385413 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.385544 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.385733 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.385845 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.386052 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.386152 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.386382 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.386483 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.386717 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.386815 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.387041 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.387139 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.387378 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.387507 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.387709 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.387801 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.388030 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.388136 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.388347 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.388446 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.388659 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.388750 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.388909 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=138745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 22 20:47:35.389000 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.389279 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.389617 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.389942 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.390255 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.390690 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.391012 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.391363 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.391738 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.392070 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.392447 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.392786 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.393924 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.394257 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.394579 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.394922 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.395290 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.395790 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.396329 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.396655 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.396966 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.397285 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.397607 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.397969 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.398294 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.398613 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.398927 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.399245 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.399589 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.399906 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.400218 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.400604 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.400844 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.401165 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.401509 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.401857 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.402172 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.402484 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.402795 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.403111 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.403521 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.403844 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.404158 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.404472 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.404784 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.405127 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.405471 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.405795 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.406125 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.406446 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.406774 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.407090 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.407459 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.407795 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.408120 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.408435 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.408782 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.409123 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.409444 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.409791 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.410110 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.410424 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.410740 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.411108 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.411470 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.411786 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.412121 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.414649 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.414649 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.414649 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.414649 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.414649 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.414649 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.414649 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.414649 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.415263 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.415263 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.415595 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.416153 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.416264 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.416501 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.416828 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.417163 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.417500 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.417872 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.418147 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.418482 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.418843 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.419165 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.419544 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.420257 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.420591 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.420914 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.421605 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:47:35.421605 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=138744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 22 20:47:35.462176 ncdv-master-1 devstack@n-api.service[138745]: INFO dbcounter [None req-7e541ef9-63c1-4bf0-86fd-8a5eb4b7cfba None None] Registered counter for database nova_api Oct 22 20:47:35.483599 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_db.sqlalchemy.engines [None req-7e541ef9-63c1-4bf0-86fd-8a5eb4b7cfba None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=138745) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 22 20:47:35.491372 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writer thread running {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 22 20:47:35.491797 ncdv-master-1 devstack@n-api.service[138744]: INFO dbcounter [None req-74a4ea4e-6b32-4b81-861c-b708acf10743 None None] Registered counter for database nova_api Oct 22 20:47:35.513816 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_db.sqlalchemy.engines [None req-74a4ea4e-6b32-4b81-861c-b708acf10743 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=138744) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 22 20:47:35.521958 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writer thread running {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 22 20:47:35.549425 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.context [None req-7e541ef9-63c1-4bf0-86fd-8a5eb4b7cfba None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),5972cb63-1ab7-4825-b0ae-86c7acab764c(cell1) {{(pid=138745) load_cells /opt/stack/nova/nova/context.py:464}} Oct 22 20:47:35.553640 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7e541ef9-63c1-4bf0-86fd-8a5eb4b7cfba None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:47:35.554113 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7e541ef9-63c1-4bf0-86fd-8a5eb4b7cfba None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:47:35.555781 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7e541ef9-63c1-4bf0-86fd-8a5eb4b7cfba None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:47:35.556525 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7e541ef9-63c1-4bf0-86fd-8a5eb4b7cfba None None] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:47:35.556975 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7e541ef9-63c1-4bf0-86fd-8a5eb4b7cfba None None] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:47:35.559064 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7e541ef9-63c1-4bf0-86fd-8a5eb4b7cfba None None] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:47:35.561152 ncdv-master-1 devstack@n-api.service[138745]: INFO dbcounter [None req-7e541ef9-63c1-4bf0-86fd-8a5eb4b7cfba None None] Registered counter for database nova_cell0 Oct 22 20:47:35.565388 ncdv-master-1 devstack@n-api.service[138745]: INFO dbcounter [None req-7e541ef9-63c1-4bf0-86fd-8a5eb4b7cfba None None] Registered counter for database nova_cell1 Oct 22 20:47:35.574207 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_db.sqlalchemy.engines [None req-7e541ef9-63c1-4bf0-86fd-8a5eb4b7cfba None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=138745) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 22 20:47:35.576050 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_db.sqlalchemy.engines [None req-7e541ef9-63c1-4bf0-86fd-8a5eb4b7cfba None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=138745) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 22 20:47:35.581847 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writer thread running {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 22 20:47:35.584647 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.context [None req-74a4ea4e-6b32-4b81-861c-b708acf10743 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),5972cb63-1ab7-4825-b0ae-86c7acab764c(cell1) {{(pid=138744) load_cells /opt/stack/nova/nova/context.py:464}} Oct 22 20:47:35.587453 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writer thread running {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 22 20:47:35.589019 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-74a4ea4e-6b32-4b81-861c-b708acf10743 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:47:35.589573 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-74a4ea4e-6b32-4b81-861c-b708acf10743 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:47:35.591301 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-74a4ea4e-6b32-4b81-861c-b708acf10743 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:47:35.592316 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-74a4ea4e-6b32-4b81-861c-b708acf10743 None None] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:47:35.592846 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-74a4ea4e-6b32-4b81-861c-b708acf10743 None None] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:47:35.595127 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-74a4ea4e-6b32-4b81-861c-b708acf10743 None None] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:47:35.597597 ncdv-master-1 devstack@n-api.service[138744]: INFO dbcounter [None req-74a4ea4e-6b32-4b81-861c-b708acf10743 None None] Registered counter for database nova_cell0 Oct 22 20:47:35.602613 ncdv-master-1 devstack@n-api.service[138744]: INFO dbcounter [None req-74a4ea4e-6b32-4b81-861c-b708acf10743 None None] Registered counter for database nova_cell1 Oct 22 20:47:35.610511 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_db.sqlalchemy.engines [None req-74a4ea4e-6b32-4b81-861c-b708acf10743 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=138744) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 22 20:47:35.614020 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_db.sqlalchemy.engines [None req-74a4ea4e-6b32-4b81-861c-b708acf10743 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=138744) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 22 20:47:35.617907 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writer thread running {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 22 20:47:35.732365 ncdv-master-1 devstack@n-api.service[138745]: INFO dbcounter [None req-7e541ef9-63c1-4bf0-86fd-8a5eb4b7cfba None None] Registered counter for database nova_cell0 Oct 22 20:47:35.739448 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_db.sqlalchemy.engines [None req-7e541ef9-63c1-4bf0-86fd-8a5eb4b7cfba None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=138745) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 22 20:47:35.744078 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writer thread running {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 22 20:47:35.766266 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writer thread running {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 22 20:47:35.775699 ncdv-master-1 devstack@n-api.service[138744]: INFO dbcounter [None req-74a4ea4e-6b32-4b81-861c-b708acf10743 None None] Registered counter for database nova_cell0 Oct 22 20:47:35.782547 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_db.sqlalchemy.engines [None req-74a4ea4e-6b32-4b81-861c-b708acf10743 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=138744) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 22 20:47:35.787505 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writer thread running {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 22 20:47:36.181612 ncdv-master-1 devstack@n-api.service[138745]: WARNING keystonemiddleware.auth_token [None req-7e541ef9-63c1-4bf0-86fd-8a5eb4b7cfba None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 22 20:47:36.189379 ncdv-master-1 devstack@n-api.service[138745]: WARNING keystonemiddleware.auth_token [None req-7e541ef9-63c1-4bf0-86fd-8a5eb4b7cfba None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 22 20:47:36.232177 ncdv-master-1 devstack@n-api.service[138744]: WARNING keystonemiddleware.auth_token [None req-74a4ea4e-6b32-4b81-861c-b708acf10743 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 22 20:47:36.240566 ncdv-master-1 devstack@n-api.service[138744]: WARNING keystonemiddleware.auth_token [None req-74a4ea4e-6b32-4b81-861c-b708acf10743 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 22 20:47:36.414508 ncdv-master-1 devstack@n-api.service[138745]: WARNING keystonemiddleware.auth_token [None req-7e541ef9-63c1-4bf0-86fd-8a5eb4b7cfba None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 22 20:47:36.420720 ncdv-master-1 devstack@n-api.service[138745]: WARNING keystonemiddleware.auth_token [None req-7e541ef9-63c1-4bf0-86fd-8a5eb4b7cfba None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 22 20:47:36.426042 ncdv-master-1 devstack@n-api.service[138745]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5640512899c0 pid: 138745 (default app) Oct 22 20:47:36.473668 ncdv-master-1 devstack@n-api.service[138744]: WARNING keystonemiddleware.auth_token [None req-74a4ea4e-6b32-4b81-861c-b708acf10743 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 22 20:47:36.481817 ncdv-master-1 devstack@n-api.service[138744]: WARNING keystonemiddleware.auth_token [None req-74a4ea4e-6b32-4b81-861c-b708acf10743 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 22 20:47:36.487305 ncdv-master-1 devstack@n-api.service[138744]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5640512899c0 pid: 138744 (default app) Oct 22 20:48:19.717496 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_api:SELECT=3 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:48:19.719644 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell1:SELECT=3 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:48:19.721292 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell0:SELECT=3 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:48:19.722283 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell0:SELECT=3 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:48:19.921154 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_api:SELECT=3 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:48:19.923298 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:SELECT=3 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:48:19.924324 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell0:SELECT=3 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:48:19.925223 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell0:SELECT=3 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:48:21.093201 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-aa9022ca-006c-4f4f-9e3b-4edc3740a7f5 tempest-AggregatesAdminTestJSON-1406494805 tempest-AggregatesAdminTestJSON-1406494805-project-admin] Calling method '.version_select at 0x7fd3a5acf040>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:48:21.097974 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-aa9022ca-006c-4f4f-9e3b-4edc3740a7f5 tempest-AggregatesAdminTestJSON-1406494805 tempest-AggregatesAdminTestJSON-1406494805-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),5972cb63-1ab7-4825-b0ae-86c7acab764c(cell1) {{(pid=138745) load_cells /opt/stack/nova/nova/compute/api.py:319}} Oct 22 20:48:21.099664 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-aa9022ca-006c-4f4f-9e3b-4edc3740a7f5 tempest-AggregatesAdminTestJSON-1406494805 tempest-AggregatesAdminTestJSON-1406494805-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:48:21.099664 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-aa9022ca-006c-4f4f-9e3b-4edc3740a7f5 tempest-AggregatesAdminTestJSON-1406494805 tempest-AggregatesAdminTestJSON-1406494805-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:48:21.099664 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-aa9022ca-006c-4f4f-9e3b-4edc3740a7f5 tempest-AggregatesAdminTestJSON-1406494805 tempest-AggregatesAdminTestJSON-1406494805-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:48:21.126913 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-aa9022ca-006c-4f4f-9e3b-4edc3740a7f5 tempest-AggregatesAdminTestJSON-1406494805 tempest-AggregatesAdminTestJSON-1406494805-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:48:21.127437 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-aa9022ca-006c-4f4f-9e3b-4edc3740a7f5 tempest-AggregatesAdminTestJSON-1406494805 tempest-AggregatesAdminTestJSON-1406494805-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:48:21.127886 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-aa9022ca-006c-4f4f-9e3b-4edc3740a7f5 tempest-AggregatesAdminTestJSON-1406494805 tempest-AggregatesAdminTestJSON-1406494805-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:48:21.144260 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-aa9022ca-006c-4f4f-9e3b-4edc3740a7f5 tempest-AggregatesAdminTestJSON-1406494805 tempest-AggregatesAdminTestJSON-1406494805-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:48:21.145252 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-aa9022ca-006c-4f4f-9e3b-4edc3740a7f5 tempest-AggregatesAdminTestJSON-1406494805 tempest-AggregatesAdminTestJSON-1406494805-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:48:21.145819 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-aa9022ca-006c-4f4f-9e3b-4edc3740a7f5 tempest-AggregatesAdminTestJSON-1406494805 tempest-AggregatesAdminTestJSON-1406494805-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:48:21.152647 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-aa9022ca-006c-4f4f-9e3b-4edc3740a7f5 tempest-AggregatesAdminTestJSON-1406494805 tempest-AggregatesAdminTestJSON-1406494805-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1503 microversion: 2.1 time: 1.456612 Oct 22 20:48:21.163497 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1/1] 10.222.0.18 () {58 vars in 1167 bytes} [Sat Oct 22 20:48:19 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1503 bytes in 1469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:48:21.179731 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-5b2f2f3b-e5c1-46f2-a261-0857c6921a98 tempest-AggregatesAdminNegativeTestJSON-1306123093 tempest-AggregatesAdminNegativeTestJSON-1306123093-project-admin] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:48:21.184554 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5b2f2f3b-e5c1-46f2-a261-0857c6921a98 tempest-AggregatesAdminNegativeTestJSON-1306123093 tempest-AggregatesAdminNegativeTestJSON-1306123093-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:48:21.185042 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5b2f2f3b-e5c1-46f2-a261-0857c6921a98 tempest-AggregatesAdminNegativeTestJSON-1306123093 tempest-AggregatesAdminNegativeTestJSON-1306123093-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:48:21.185734 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5b2f2f3b-e5c1-46f2-a261-0857c6921a98 tempest-AggregatesAdminNegativeTestJSON-1306123093 tempest-AggregatesAdminNegativeTestJSON-1306123093-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:48:21.186605 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5b2f2f3b-e5c1-46f2-a261-0857c6921a98 tempest-AggregatesAdminNegativeTestJSON-1306123093 tempest-AggregatesAdminNegativeTestJSON-1306123093-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:48:21.187268 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5b2f2f3b-e5c1-46f2-a261-0857c6921a98 tempest-AggregatesAdminNegativeTestJSON-1306123093 tempest-AggregatesAdminNegativeTestJSON-1306123093-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:48:21.188105 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5b2f2f3b-e5c1-46f2-a261-0857c6921a98 tempest-AggregatesAdminNegativeTestJSON-1306123093 tempest-AggregatesAdminNegativeTestJSON-1306123093-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:48:21.233612 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-5b2f2f3b-e5c1-46f2-a261-0857c6921a98 tempest-AggregatesAdminNegativeTestJSON-1306123093 tempest-AggregatesAdminNegativeTestJSON-1306123093-project-admin] 10.222.0.18 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 1.322600 Oct 22 20:48:21.234390 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1/2] 10.222.0.18 () {58 vars in 1176 bytes} [Sat Oct 22 20:48:19 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 1325 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:48:21.350286 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-462654b9-ea59-40cc-9a45-0731398735c9 tempest-AggregatesAdminTestV241-182638173 tempest-AggregatesAdminTestV241-182638173-project-admin] Calling method '.version_select at 0x7fd3a5b54b80>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:48:21.355828 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-462654b9-ea59-40cc-9a45-0731398735c9 tempest-AggregatesAdminTestV241-182638173 tempest-AggregatesAdminTestV241-182638173-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:48:21.356352 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-462654b9-ea59-40cc-9a45-0731398735c9 tempest-AggregatesAdminTestV241-182638173 tempest-AggregatesAdminTestV241-182638173-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:48:21.356946 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-462654b9-ea59-40cc-9a45-0731398735c9 tempest-AggregatesAdminTestV241-182638173 tempest-AggregatesAdminTestV241-182638173-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:48:21.374654 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-462654b9-ea59-40cc-9a45-0731398735c9 tempest-AggregatesAdminTestV241-182638173 tempest-AggregatesAdminTestV241-182638173-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:48:21.375140 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-462654b9-ea59-40cc-9a45-0731398735c9 tempest-AggregatesAdminTestV241-182638173 tempest-AggregatesAdminTestV241-182638173-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:48:21.375596 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-462654b9-ea59-40cc-9a45-0731398735c9 tempest-AggregatesAdminTestV241-182638173 tempest-AggregatesAdminTestV241-182638173-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:48:21.390298 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-462654b9-ea59-40cc-9a45-0731398735c9 tempest-AggregatesAdminTestV241-182638173 tempest-AggregatesAdminTestV241-182638173-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:48:21.390780 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-462654b9-ea59-40cc-9a45-0731398735c9 tempest-AggregatesAdminTestV241-182638173 tempest-AggregatesAdminTestV241-182638173-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:48:21.391211 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-462654b9-ea59-40cc-9a45-0731398735c9 tempest-AggregatesAdminTestV241-182638173 tempest-AggregatesAdminTestV241-182638173-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:48:21.398111 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-462654b9-ea59-40cc-9a45-0731398735c9 tempest-AggregatesAdminTestV241-182638173 tempest-AggregatesAdminTestV241-182638173-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1423 microversion: 2.41 time: 0.232881 Oct 22 20:48:21.398868 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2/3] 10.222.0.18 () {60 vars in 1208 bytes} [Sat Oct 22 20:48:21 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1423 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 20:48:21.433817 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-10c64124-e2f9-49a9-9fc4-4018cec639df tempest-FlavorsAdminTestJSON-516654737 tempest-FlavorsAdminTestJSON-516654737-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": "1024", "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1411501418", "id": 428911699, "os-flavor-access:is_public": "True"}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:48:21.484263 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-10c64124-e2f9-49a9-9fc4-4018cec639df tempest-FlavorsAdminTestJSON-516654737 tempest-FlavorsAdminTestJSON-516654737-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 427 microversion: 2.1 time: 0.248892 Oct 22 20:48:21.484852 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2/4] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Oct 22 20:48:21 2022] POST /compute/v2.1/flavors => generated 427 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:48:21.598995 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-cd3bd1de-583f-429b-ab0a-7ac24a74f92f tempest-FlavorsExtraSpecsTestJSON-1327478759 tempest-FlavorsExtraSpecsTestJSON-1327478759-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-1478583805", "ram": 512, "vcpus": 1, "disk": 10, "id": 1573113979, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:48:21.653344 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-cd3bd1de-583f-429b-ab0a-7ac24a74f92f tempest-FlavorsExtraSpecsTestJSON-1327478759 tempest-FlavorsExtraSpecsTestJSON-1327478759-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 416 microversion: 2.1 time: 0.253487 Oct 22 20:48:21.654098 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3/5] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Oct 22 20:48:21 2022] POST /compute/v2.1/flavors => generated 416 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:48:21.678911 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-ab77b754-7e12-45ad-be6b-654dc6aa9b81 tempest-AZAdminNegativeTestJSON-1575436888 tempest-AZAdminNegativeTestJSON-1575436888-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:48:21.680977 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-ab77b754-7e12-45ad-be6b-654dc6aa9b81 tempest-AZAdminNegativeTestJSON-1575436888 tempest-AZAdminNegativeTestJSON-1575436888-project] Policy check for os_compute_api:os-availability-zone:detail failed with credentials {'is_admin': False, 'user_id': 'ef9b363defad47ce8731b3437556ae72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3734c4ffa4aa4081baf0304fef295852', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:48:21.684510 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-ab77b754-7e12-45ad-be6b-654dc6aa9b81 tempest-AZAdminNegativeTestJSON-1575436888 tempest-AZAdminNegativeTestJSON-1575436888-project] Request method failure captured: Oct 22 20:48:21.684510 ncdv-master-1 devstack@n-api.service[138744]: request: GET /compute/v2.1/os-availability-zone/detail HTTP/1.1 Oct 22 20:48:21.684510 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 20:48:21.684510 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 20:48:21.684510 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 20:48:21.684510 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 0 Oct 22 20:48:21.684510 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 20:48:21.684510 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 20:48:21.684510 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 20:48:21.684510 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 20:48:21.684510 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVFcSbqs2V3FatYA2MWTuwswArqr0GKCul-tnhiwTiBSddmRy8r-aOnQiHyVGrTicdUhNeFIS4UFIpOyH2Fs0g133mITNLKalz27PVcgCBi8g1bKmNehEOhB3k25ufVNyRzxcUt6RblGZszXCd1neAxIWrGvt4TBT84Yi_w09YgX1lms Oct 22 20:48:21.684510 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 20:48:21.684510 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 20:48:21.684510 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 20:48:21.684510 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 20:48:21.684510 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 20:48:21.684510 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 20:48:21.684510 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: 3734c4ffa4aa4081baf0304fef295852 Oct 22 20:48:21.684510 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-AZAdminNegativeTestJSON-1575436888 Oct 22 20:48:21.684510 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 20:48:21.684510 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 20:48:21.685802 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_3734c4ffa4aa4081baf0304fef295852"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/3734c4ffa4aa4081baf0304fef295852"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/3734c4ffa4aa4081baf0304fef295852"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/3734c4ffa4aa4081baf0304fef295852"}]}] Oct 22 20:48:21.685802 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-AZAdminNegativeTestJSON-1575436888 Oct 22 20:48:21.685802 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: 3734c4ffa4aa4081baf0304fef295852 Oct 22 20:48:21.685802 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-AZAdminNegativeTestJSON-1575436888 Oct 22 20:48:21.685802 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-AZAdminNegativeTestJSON-1575436888-project Oct 22 20:48:21.685802 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 20:48:21.685802 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 20:48:21.685802 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: ef9b363defad47ce8731b3437556ae72 Oct 22 20:48:21.685802 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-AZAdminNegativeTestJSON-1575436888-project Oct 22 20:48:21.685802 ncdv-master-1 devstack@n-api.service[138744]: method: > Oct 22 20:48:21.685802 ncdv-master-1 devstack@n-api.service[138744]: exception: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Oct 22 20:48:21.685802 ncdv-master-1 devstack@n-api.service[138744]: action_args: {} Oct 22 20:48:21.686499 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:48:21.686499 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:48:21.686499 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:48:21.686499 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:48:21.686499 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:48:21.686499 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:48:21.686499 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:48:21.686499 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:48:21.686499 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/availability_zone.py", line 117, in detail Oct 22 20:48:21.686499 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi context.can(az_policies.POLICY_ROOT % 'detail', target={}) Oct 22 20:48:21.686499 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 22 20:48:21.686499 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 22 20:48:21.686499 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 22 20:48:21.686499 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 22 20:48:21.686499 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 22 20:48:21.686499 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 22 20:48:21.686499 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 22 20:48:21.686499 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise self.value Oct 22 20:48:21.686499 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 22 20:48:21.688018 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 22 20:48:21.688018 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 22 20:48:21.688018 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 22 20:48:21.688018 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 22 20:48:21.688018 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 22 20:48:21.688018 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Oct 22 20:48:21.688018 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:48:21.688018 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:48:21.688018 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:48:21.688018 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:48:21.688018 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:48:21.688018 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:48:21.688018 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 22 20:48:21.688018 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 22 20:48:21.688018 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Oct 22 20:48:21.688018 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:48:21.688018 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-ab77b754-7e12-45ad-be6b-654dc6aa9b81 tempest-AZAdminNegativeTestJSON-1575436888 tempest-AZAdminNegativeTestJSON-1575436888-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:48:21.689095 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-ab77b754-7e12-45ad-be6b-654dc6aa9b81 tempest-AZAdminNegativeTestJSON-1575436888 tempest-AZAdminNegativeTestJSON-1575436888-project] 10.222.0.18 "GET /compute/v2.1/os-availability-zone/detail" status: 403 len: 123 microversion: 2.1 time: 0.201416 Oct 22 20:48:21.693919 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3/6] 10.222.0.18 () {58 vars in 1185 bytes} [Sat Oct 22 20:48:21 2022] GET /compute/v2.1/os-availability-zone/detail => generated 123 bytes in 208 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 22 20:48:21.699584 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-62161c2d-6e5d-4e15-8975-ab5d64d3a9d4 tempest-AggregatesAdminTestJSON-1406494805 tempest-AggregatesAdminTestJSON-1406494805-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-731369501", "name": "tempest-test_aggregate-177528015"}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:48:21.719655 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.objects.aggregate [None req-62161c2d-6e5d-4e15-8975-ab5d64d3a9d4 tempest-AggregatesAdminTestJSON-1406494805 tempest-AggregatesAdminTestJSON-1406494805-project-admin] Generated uuid ddab838c-c3e2-4aae-b662-abc016cd6599 for aggregate {{(pid=138744) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 22 20:48:21.791939 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-62161c2d-6e5d-4e15-8975-ab5d64d3a9d4 tempest-AggregatesAdminTestJSON-1406494805 tempest-AggregatesAdminTestJSON-1406494805-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates" status: 200 len: 220 microversion: 2.1 time: 0.096531 Oct 22 20:48:21.795524 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 4/7] 10.222.0.18 () {60 vars in 1165 bytes} [Sat Oct 22 20:48:21 2022] POST /compute/v2.1/os-aggregates => generated 220 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:48:21.798119 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-c717947e-b98d-418a-b1a3-8f90d30503c1 tempest-FlavorsAdminTestJSON-516654737 tempest-FlavorsAdminTestJSON-516654737-project-admin] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:48:21.803497 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-e454757e-c3fa-4333-b127-17184c5a7686 tempest-FlavorsAccessTestJSON-625154109 tempest-FlavorsAccessTestJSON-625154109-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-964663842", "id": 1655103017, "os-flavor-access:is_public": "False"}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:48:21.832352 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-c717947e-b98d-418a-b1a3-8f90d30503c1 tempest-FlavorsAdminTestJSON-516654737 tempest-FlavorsAdminTestJSON-516654737-project-admin] 10.222.0.18 "DELETE /compute/v2.1/flavors/428911699" status: 202 len: 0 microversion: 2.1 time: 0.037901 Oct 22 20:48:21.833397 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 5/8] 10.222.0.18 () {58 vars in 1158 bytes} [Sat Oct 22 20:48:21 2022] DELETE /compute/v2.1/flavors/428911699 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 20:48:21.838931 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-b6cf8594-0673-428d-9b6e-101725e44800 tempest-FlavorsExtraSpecsTestJSON-1327478759 tempest-FlavorsExtraSpecsTestJSON-1327478759-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:48:21.839910 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-e454757e-c3fa-4333-b127-17184c5a7686 tempest-FlavorsAccessTestJSON-625154109 tempest-FlavorsAccessTestJSON-625154109-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 430 microversion: 2.1 time: 0.184384 Oct 22 20:48:21.841152 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 4/9] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Oct 22 20:48:21 2022] POST /compute/v2.1/flavors => generated 430 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:48:21.847001 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-19ea2484-6618-4063-b460-2869e709ad33 tempest-AggregatesAdminTestJSON-1406494805 tempest-AggregatesAdminTestJSON-1406494805-project-admin] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:48:21.870359 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-19ea2484-6618-4063-b460-2869e709ad33 tempest-AggregatesAdminTestJSON-1406494805 tempest-AggregatesAdminTestJSON-1406494805-project-admin] 10.222.0.18 "GET /compute/v2.1/os-aggregates" status: 200 len: 300 microversion: 2.1 time: 0.027654 Oct 22 20:48:21.870966 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 5/10] 10.222.0.18 () {58 vars in 1143 bytes} [Sat Oct 22 20:48:21 2022] GET /compute/v2.1/os-aggregates => generated 300 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:48:21.877719 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-95149b5b-38bb-4af8-8c45-fed75cb16a08 tempest-FlavorsAdminTestJSON-516654737 tempest-FlavorsAdminTestJSON-516654737-project-admin] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:48:21.891879 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-b6cf8594-0673-428d-9b6e-101725e44800 tempest-FlavorsExtraSpecsTestJSON-1327478759 tempest-FlavorsExtraSpecsTestJSON-1327478759-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors/1573113979/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.056798 Oct 22 20:48:21.900039 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 6/11] 10.222.0.18 () {60 vars in 1224 bytes} [Sat Oct 22 20:48:21 2022] POST /compute/v2.1/flavors/1573113979/os-extra_specs => generated 66 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 22 20:48:21.904819 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-42a897e6-a1a3-4042-a69a-5ca3ca19486e tempest-FlavorsAccessTestJSON-625154109 tempest-FlavorsAccessTestJSON-625154109-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "854071169f2f4316842c9eb8c1fc4704"}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:48:21.922157 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-95149b5b-38bb-4af8-8c45-fed75cb16a08 tempest-FlavorsAdminTestJSON-516654737 tempest-FlavorsAdminTestJSON-516654737-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 5397 microversion: 2.1 time: 0.049278 Oct 22 20:48:21.922756 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 6/12] 10.222.0.18 () {58 vars in 1146 bytes} [Sat Oct 22 20:48:21 2022] GET /compute/v2.1/flavors/detail => generated 5397 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:48:21.936152 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-a7a7b9f6-4a32-4e9a-9ced-e9b0752741bb tempest-AggregatesAdminTestJSON-1406494805 tempest-AggregatesAdminTestJSON-1406494805-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch2-master-1"}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:48:21.977110 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a7a7b9f6-4a32-4e9a-9ced-e9b0752741bb tempest-AggregatesAdminTestJSON-1406494805 tempest-AggregatesAdminTestJSON-1406494805-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:48:21.977796 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a7a7b9f6-4a32-4e9a-9ced-e9b0752741bb tempest-AggregatesAdminTestJSON-1406494805 tempest-AggregatesAdminTestJSON-1406494805-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:48:21.978325 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a7a7b9f6-4a32-4e9a-9ced-e9b0752741bb tempest-AggregatesAdminTestJSON-1406494805 tempest-AggregatesAdminTestJSON-1406494805-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:48:22.189628 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-42a897e6-a1a3-4042-a69a-5ca3ca19486e tempest-FlavorsAccessTestJSON-625154109 tempest-FlavorsAccessTestJSON-625154109-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors/1655103017/action" status: 200 len: 97 microversion: 2.1 time: 0.288415 Oct 22 20:48:22.190675 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 7/13] 10.222.0.18 () {60 vars in 1200 bytes} [Sat Oct 22 20:48:21 2022] POST /compute/v2.1/flavors/1655103017/action => generated 97 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 22 20:48:22.450459 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-bd457da4-bd23-4a3c-bf5e-15302cb93f83 tempest-FlavorsExtraSpecsTestJSON-2138901105 tempest-FlavorsExtraSpecsTestJSON-2138901105-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:48:22.489233 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-bd457da4-bd23-4a3c-bf5e-15302cb93f83 tempest-FlavorsExtraSpecsTestJSON-2138901105 tempest-FlavorsExtraSpecsTestJSON-2138901105-project] 10.222.0.18 "GET /compute/v2.1/flavors/1573113979/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.296536 Oct 22 20:48:22.490296 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 8/14] 10.222.0.18 () {58 vars in 1203 bytes} [Sat Oct 22 20:48:22 2022] GET /compute/v2.1/flavors/1573113979/os-extra_specs => generated 66 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 22 20:48:22.498958 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-78b433e5-26b6-4518-9b0d-99a8bd8b175c tempest-FlavorsAdminTestJSON-516654737 tempest-FlavorsAdminTestJSON-516654737-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-546455255", "id": 1973723868, "swap": 1024, "rxtx_factor": 2, "OS-FLV-EXT-DATA:ephemeral": 10, "os-flavor-access:is_public": "True"}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:48:22.521807 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-78b433e5-26b6-4518-9b0d-99a8bd8b175c tempest-FlavorsAdminTestJSON-516654737 tempest-FlavorsAdminTestJSON-516654737-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 416 microversion: 2.1 time: 0.030065 Oct 22 20:48:22.522463 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 9/15] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Oct 22 20:48:22 2022] POST /compute/v2.1/flavors => generated 416 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:48:22.650833 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-a4597539-b0d7-41b3-a2ce-0a2b70417228 tempest-FlavorsAccessTestJSON-463749272 tempest-FlavorsAccessTestJSON-463749272-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:48:22.685962 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-a4597539-b0d7-41b3-a2ce-0a2b70417228 tempest-FlavorsAccessTestJSON-463749272 tempest-FlavorsAccessTestJSON-463749272-project] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 6223 microversion: 2.1 time: 0.154907 Oct 22 20:48:22.688356 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 10/16] 10.222.0.18 () {58 vars in 1146 bytes} [Sat Oct 22 20:48:22 2022] GET /compute/v2.1/flavors/detail => generated 6223 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:48:22.691836 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-e972c1a3-9267-4809-a1a7-5f8c6b70af23 tempest-FlavorsExtraSpecsTestJSON-1327478759 tempest-FlavorsExtraSpecsTestJSON-1327478759-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:48:22.721790 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-e972c1a3-9267-4809-a1a7-5f8c6b70af23 tempest-FlavorsExtraSpecsTestJSON-1327478759 tempest-FlavorsExtraSpecsTestJSON-1327478759-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors/1573113979/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.033515 Oct 22 20:48:22.722781 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 11/17] 10.222.0.18 () {60 vars in 1224 bytes} [Sat Oct 22 20:48:22 2022] POST /compute/v2.1/flavors/1573113979/os-extra_specs => generated 66 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 22 20:48:22.724180 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-a7a7b9f6-4a32-4e9a-9ced-e9b0752741bb tempest-AggregatesAdminTestJSON-1406494805 tempest-AggregatesAdminTestJSON-1406494805-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 312 microversion: 2.1 time: 0.799299 Oct 22 20:48:22.724838 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 7/18] 10.222.0.18 () {60 vars in 1191 bytes} [Sat Oct 22 20:48:21 2022] POST /compute/v2.1/os-aggregates/1/action => generated 312 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:48:22.724838 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-e2eef89c-b9c8-4b43-af9c-e40d9a057a73 tempest-FlavorsAdminTestJSON-516654737 tempest-FlavorsAdminTestJSON-516654737-project-admin] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:48:22.759504 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-e2eef89c-b9c8-4b43-af9c-e40d9a057a73 tempest-FlavorsAdminTestJSON-516654737 tempest-FlavorsAdminTestJSON-516654737-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 5803 microversion: 2.1 time: 0.033311 Oct 22 20:48:22.760790 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 8/19] 10.222.0.18 () {58 vars in 1146 bytes} [Sat Oct 22 20:48:22 2022] GET /compute/v2.1/flavors/detail => generated 5803 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:48:22.765484 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-4ff7f3fb-4161-4374-a89a-b715536eeb27 tempest-FlavorsAccessTestJSON-625154109 tempest-FlavorsAccessTestJSON-625154109-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "854071169f2f4316842c9eb8c1fc4704"}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:48:23.006846 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-fcc2a065-6505-4f2a-9e21-9cb2c87e68ca tempest-FlavorsV261TestJSON-634136090 tempest-FlavorsV261TestJSON-634136090-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV261TestJSON-flavor-1137478731", "id": 446531282, "os-flavor-access:is_public": "True"}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:48:23.028413 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-fcc2a065-6505-4f2a-9e21-9cb2c87e68ca tempest-FlavorsV261TestJSON-634136090 tempest-FlavorsV261TestJSON-634136090-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 465 microversion: 2.61 time: 0.304332 Oct 22 20:48:23.040109 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 12/20] 10.222.0.18 () {62 vars in 1188 bytes} [Sat Oct 22 20:48:22 2022] POST /compute/v2.1/flavors => generated 465 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 22 20:48:23.048861 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-1667ec5d-b5b1-4d88-afbb-f07d106fe82b tempest-FlavorsExtraSpecsTestJSON-2138901105 tempest-FlavorsExtraSpecsTestJSON-2138901105-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:48:23.058909 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-1667ec5d-b5b1-4d88-afbb-f07d106fe82b tempest-FlavorsExtraSpecsTestJSON-2138901105 tempest-FlavorsExtraSpecsTestJSON-2138901105-project] 10.222.0.18 "GET /compute/v2.1/flavors/1573113979/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.017306 Oct 22 20:48:23.059764 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 13/21] 10.222.0.18 () {58 vars in 1245 bytes} [Sat Oct 22 20:48:23 2022] GET /compute/v2.1/flavors/1573113979/os-extra_specs/hw:numa_nodes => generated 22 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 22 20:48:23.064339 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-2a22e76c-f55a-4f9b-aa48-9431cfa9d3c1 tempest-FlavorsAdminTestJSON-516654737 tempest-FlavorsAdminTestJSON-516654737-project-admin] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:48:23.084754 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-2a22e76c-f55a-4f9b-aa48-9431cfa9d3c1 tempest-FlavorsAdminTestJSON-516654737 tempest-FlavorsAdminTestJSON-516654737-project-admin] 10.222.0.18 "DELETE /compute/v2.1/flavors/1973723868" status: 202 len: 0 microversion: 2.1 time: 0.023634 Oct 22 20:48:23.085478 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 14/22] 10.222.0.18 () {58 vars in 1161 bytes} [Sat Oct 22 20:48:23 2022] DELETE /compute/v2.1/flavors/1973723868 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 20:48:23.225145 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-4ff7f3fb-4161-4374-a89a-b715536eeb27 tempest-FlavorsAccessTestJSON-625154109 tempest-FlavorsAccessTestJSON-625154109-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors/1655103017/action" status: 200 len: 21 microversion: 2.1 time: 0.463021 Oct 22 20:48:23.225764 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 9/23] 10.222.0.18 () {60 vars in 1200 bytes} [Sat Oct 22 20:48:22 2022] POST /compute/v2.1/flavors/1655103017/action => generated 21 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 22 20:48:23.305282 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-39d3b99d-96e3-43eb-90bd-42b06a85b312 tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AggregatesAdminTestJSON-server-1034445307", "imageRef": "085e4478-6edc-4a69-8e08-f9831713eb65", "flavorRef": "452", "availability_zone": "tempest-test_az-731369501"}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:48:23.321752 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-39d3b99d-96e3-43eb-90bd-42b06a85b312 tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:48:23.322491 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-39d3b99d-96e3-43eb-90bd-42b06a85b312 tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:48:23.323099 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-39d3b99d-96e3-43eb-90bd-42b06a85b312 tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:48:23.324062 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-39d3b99d-96e3-43eb-90bd-42b06a85b312 tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:48:23.324718 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-39d3b99d-96e3-43eb-90bd-42b06a85b312 tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:48:23.326112 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-39d3b99d-96e3-43eb-90bd-42b06a85b312 tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:48:23.359803 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-0d963253-d359-43fa-887b-14e58ca1f121 tempest-FlavorsV261TestJSON-2118327779 tempest-FlavorsV261TestJSON-2118327779-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:48:23.386867 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-0d963253-d359-43fa-887b-14e58ca1f121 tempest-FlavorsV261TestJSON-2118327779 tempest-FlavorsV261TestJSON-2118327779-project] 10.222.0.18 "GET /compute/v2.1/flavors/446531282" status: 200 len: 465 microversion: 2.61 time: 0.160001 Oct 22 20:48:23.387783 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 10/24] 10.222.0.18 () {60 vars in 1196 bytes} [Sat Oct 22 20:48:23 2022] GET /compute/v2.1/flavors/446531282 => generated 465 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 22 20:48:23.392678 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-39295929-04ce-4231-ae61-5c67cba7670d tempest-FlavorsExtraSpecsTestJSON-1327478759 tempest-FlavorsExtraSpecsTestJSON-1327478759-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:48:23.425997 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-39295929-04ce-4231-ae61-5c67cba7670d tempest-FlavorsExtraSpecsTestJSON-1327478759 tempest-FlavorsExtraSpecsTestJSON-1327478759-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors/1573113979/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.037011 Oct 22 20:48:23.426704 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 11/25] 10.222.0.18 () {60 vars in 1224 bytes} [Sat Oct 22 20:48:23 2022] POST /compute/v2.1/flavors/1573113979/os-extra_specs => generated 66 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 22 20:48:23.437003 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-f1a73dc0-1e0b-4b72-9e30-f8a3b9a63089 tempest-FlavorsAdminTestJSON-516654737 tempest-FlavorsAdminTestJSON-516654737-project-admin] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:48:23.458571 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-f1a73dc0-1e0b-4b72-9e30-f8a3b9a63089 tempest-FlavorsAdminTestJSON-516654737 tempest-FlavorsAdminTestJSON-516654737-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 5812 microversion: 2.1 time: 0.025236 Oct 22 20:48:23.459847 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 12/26] 10.222.0.18 () {58 vars in 1146 bytes} [Sat Oct 22 20:48:23 2022] GET /compute/v2.1/flavors/detail => generated 5812 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:48:23.467582 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-3642e35d-0c2e-4b1f-8bd1-1261ebd44623 tempest-FlavorsAccessTestJSON-463749272 tempest-FlavorsAccessTestJSON-463749272-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:48:23.507041 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-3642e35d-0c2e-4b1f-8bd1-1261ebd44623 tempest-FlavorsAccessTestJSON-463749272 tempest-FlavorsAccessTestJSON-463749272-project] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 5812 microversion: 2.1 time: 0.045877 Oct 22 20:48:23.507794 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 13/27] 10.222.0.18 () {58 vars in 1146 bytes} [Sat Oct 22 20:48:23 2022] GET /compute/v2.1/flavors/detail => generated 5812 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:48:23.512945 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-30af94a1-b22b-45a2-bc72-98d4bc8463b0 tempest-FlavorsV261TestJSON-634136090 tempest-FlavorsV261TestJSON-634136090-project-admin] Action: 'update', calling method: .version_select at 0x7fd3a5f78f70>, body: {"flavor": {"description": "new"}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:48:23.560939 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-30af94a1-b22b-45a2-bc72-98d4bc8463b0 tempest-FlavorsV261TestJSON-634136090 tempest-FlavorsV261TestJSON-634136090-project-admin] 10.222.0.18 "PUT /compute/v2.1/flavors/446531282" status: 200 len: 466 microversion: 2.61 time: 0.049387 Oct 22 20:48:23.560939 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 14/28] 10.222.0.18 () {62 vars in 1216 bytes} [Sat Oct 22 20:48:23 2022] PUT /compute/v2.1/flavors/446531282 => generated 466 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 22 20:48:23.563480 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-0a315d9c-f0b2-47da-bc60-23375da4f98e tempest-FlavorsExtraSpecsTestJSON-1327478759 tempest-FlavorsExtraSpecsTestJSON-1327478759-project-admin] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:48:23.574689 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-0a315d9c-f0b2-47da-bc60-23375da4f98e tempest-FlavorsExtraSpecsTestJSON-1327478759 tempest-FlavorsExtraSpecsTestJSON-1327478759-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/1573113979/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.014364 Oct 22 20:48:23.579490 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 15/29] 10.222.0.18 () {58 vars in 1203 bytes} [Sat Oct 22 20:48:23 2022] GET /compute/v2.1/flavors/1573113979/os-extra_specs => generated 66 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 22 20:48:23.586620 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-ac6cbcf2-c195-4305-ba09-65fd349b1799 tempest-FlavorsAdminTestJSON-516654737 tempest-FlavorsAdminTestJSON-516654737-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-617848475", "id": 1631548568, "os-flavor-access:is_public": "True"}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:48:23.607632 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-ac6cbcf2-c195-4305-ba09-65fd349b1799 tempest-FlavorsAdminTestJSON-516654737 tempest-FlavorsAdminTestJSON-516654737-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 428 microversion: 2.1 time: 0.024982 Oct 22 20:48:23.608292 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 16/30] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Oct 22 20:48:23 2022] POST /compute/v2.1/flavors => generated 428 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:48:23.613268 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-fea0ce45-b85c-4208-ab78-9be0e2874322 tempest-FlavorsAccessTestJSON-625154109 tempest-FlavorsAccessTestJSON-625154109-project-admin] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:48:23.643156 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-fea0ce45-b85c-4208-ab78-9be0e2874322 tempest-FlavorsAccessTestJSON-625154109 tempest-FlavorsAccessTestJSON-625154109-project-admin] 10.222.0.18 "DELETE /compute/v2.1/flavors/1655103017" status: 202 len: 0 microversion: 2.1 time: 0.033318 Oct 22 20:48:23.643956 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 17/31] 10.222.0.18 () {58 vars in 1161 bytes} [Sat Oct 22 20:48:23 2022] DELETE /compute/v2.1/flavors/1655103017 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 20:48:23.652992 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-c0b13dc8-4b89-40d6-9a1e-f8863e0d9621 tempest-FlavorsV261TestJSON-2118327779 tempest-FlavorsV261TestJSON-2118327779-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:48:23.679265 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-c0b13dc8-4b89-40d6-9a1e-f8863e0d9621 tempest-FlavorsV261TestJSON-2118327779 tempest-FlavorsV261TestJSON-2118327779-project] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 7198 microversion: 2.61 time: 0.033676 Oct 22 20:48:23.680175 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 18/32] 10.222.0.18 () {60 vars in 1187 bytes} [Sat Oct 22 20:48:23 2022] GET /compute/v2.1/flavors/detail => generated 7198 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 20:48:23.685128 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-926d1b27-740d-4eae-b650-bb37ed6239cd tempest-FlavorsExtraSpecsTestJSON-1327478759 tempest-FlavorsExtraSpecsTestJSON-1327478759-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "2"} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:48:23.720636 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-926d1b27-740d-4eae-b650-bb37ed6239cd tempest-FlavorsExtraSpecsTestJSON-1327478759 tempest-FlavorsExtraSpecsTestJSON-1327478759-project-admin] 10.222.0.18 "PUT /compute/v2.1/flavors/1573113979/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.039023 Oct 22 20:48:23.721228 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 19/33] 10.222.0.18 () {60 vars in 1265 bytes} [Sat Oct 22 20:48:23 2022] PUT /compute/v2.1/flavors/1573113979/os-extra_specs/hw:numa_nodes => generated 22 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 22 20:48:23.725916 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-e6413bf7-9bb3-4d64-94c9-a83c606438ac tempest-FlavorsAdminTestJSON-516654737 tempest-FlavorsAdminTestJSON-516654737-project-admin] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:48:23.745217 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-e6413bf7-9bb3-4d64-94c9-a83c606438ac tempest-FlavorsAdminTestJSON-516654737 tempest-FlavorsAdminTestJSON-516654737-project-admin] 10.222.0.18 "DELETE /compute/v2.1/flavors/1631548568" status: 202 len: 0 microversion: 2.1 time: 0.022945 Oct 22 20:48:23.746147 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 20/34] 10.222.0.18 () {58 vars in 1161 bytes} [Sat Oct 22 20:48:23 2022] DELETE /compute/v2.1/flavors/1631548568 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 20:48:23.751013 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-2d0c946c-f447-4d59-9bfe-952403bdb29a tempest-FlavorsAccessTestJSON-625154109 tempest-FlavorsAccessTestJSON-625154109-project-admin] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:48:23.774640 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-2d0c946c-f447-4d59-9bfe-952403bdb29a tempest-FlavorsAccessTestJSON-625154109 tempest-FlavorsAccessTestJSON-625154109-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 5812 microversion: 2.1 time: 0.027423 Oct 22 20:48:23.779607 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 21/35] 10.222.0.18 () {58 vars in 1146 bytes} [Sat Oct 22 20:48:23 2022] GET /compute/v2.1/flavors/detail => generated 5812 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:48:23.783181 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-83871e55-729d-4b1c-847f-342fc3f83878 tempest-FlavorsV261TestJSON-2118327779 tempest-FlavorsV261TestJSON-2118327779-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:48:23.789708 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=4,nova_api:DELETE=7,nova_api:SAVEPOINT=4,nova_api:RELEASE=4,nova_api:UPDATE=2 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:48:23.810326 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-83871e55-729d-4b1c-847f-342fc3f83878 tempest-FlavorsV261TestJSON-2118327779 tempest-FlavorsV261TestJSON-2118327779-project] 10.222.0.18 "GET /compute/v2.1/flavors" status: 200 len: 3407 microversion: 2.61 time: 0.033572 Oct 22 20:48:23.811044 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 22/36] 10.222.0.18 () {60 vars in 1166 bytes} [Sat Oct 22 20:48:23 2022] GET /compute/v2.1/flavors => generated 3407 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 20:48:23.816471 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-ae43b9b5-28e3-4124-9f46-8e86c6284e42 tempest-FlavorsExtraSpecsTestJSON-1327478759 tempest-FlavorsExtraSpecsTestJSON-1327478759-project-admin] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:48:23.825403 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-ae43b9b5-28e3-4124-9f46-8e86c6284e42 tempest-FlavorsExtraSpecsTestJSON-1327478759 tempest-FlavorsExtraSpecsTestJSON-1327478759-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/1573113979/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.012960 Oct 22 20:48:23.830699 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 23/37] 10.222.0.18 () {58 vars in 1203 bytes} [Sat Oct 22 20:48:23 2022] GET /compute/v2.1/flavors/1573113979/os-extra_specs => generated 66 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 22 20:48:23.830886 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.network.neutron [None req-39d3b99d-96e3-43eb-90bd-42b06a85b312 tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] validate_networks() for None {{(pid=138744) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 20:48:23.831011 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-dce4e50b-1279-4674-b9f7-8b11c66318e1 tempest-FlavorsAdminTestJSON-516654737 tempest-FlavorsAdminTestJSON-516654737-project-admin] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:48:23.855577 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-dce4e50b-1279-4674-b9f7-8b11c66318e1 tempest-FlavorsAdminTestJSON-516654737 tempest-FlavorsAdminTestJSON-516654737-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 5812 microversion: 2.1 time: 0.028493 Oct 22 20:48:23.856186 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 24/38] 10.222.0.18 () {58 vars in 1146 bytes} [Sat Oct 22 20:48:23 2022] GET /compute/v2.1/flavors/detail => generated 5812 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:48:23.860986 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-caff8fc8-3b57-498d-b39f-3d115a787d71 tempest-FlavorsAccessTestJSON-625154109 tempest-FlavorsAccessTestJSON-625154109-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-2070619917", "id": 1973194704, "os-flavor-access:is_public": "False"}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:48:23.885741 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-caff8fc8-3b57-498d-b39f-3d115a787d71 tempest-FlavorsAccessTestJSON-625154109 tempest-FlavorsAccessTestJSON-625154109-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 431 microversion: 2.1 time: 0.028464 Oct 22 20:48:23.886926 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 25/39] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Oct 22 20:48:23 2022] POST /compute/v2.1/flavors => generated 431 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:48:23.893404 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-02dad031-15e3-49ec-a04d-2a3e2c25b0c6 tempest-FlavorsV261TestJSON-634136090 tempest-FlavorsV261TestJSON-634136090-project-admin] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:48:23.916093 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-02dad031-15e3-49ec-a04d-2a3e2c25b0c6 tempest-FlavorsV261TestJSON-634136090 tempest-FlavorsV261TestJSON-634136090-project-admin] 10.222.0.18 "DELETE /compute/v2.1/flavors/446531282" status: 202 len: 0 microversion: 2.61 time: 0.027801 Oct 22 20:48:23.920111 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 26/40] 10.222.0.18 () {60 vars in 1199 bytes} [Sat Oct 22 20:48:23 2022] DELETE /compute/v2.1/flavors/446531282 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 22 20:48:23.924235 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-5492f27e-80ba-4d25-a4ac-0f7d1986fb80 tempest-FlavorsExtraSpecsTestJSON-1327478759 tempest-FlavorsExtraSpecsTestJSON-1327478759-project-admin] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:48:23.959117 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-5492f27e-80ba-4d25-a4ac-0f7d1986fb80 tempest-FlavorsExtraSpecsTestJSON-1327478759 tempest-FlavorsExtraSpecsTestJSON-1327478759-project-admin] 10.222.0.18 "DELETE /compute/v2.1/flavors/1573113979/os-extra_specs/hw:numa_nodes" status: 200 len: 0 microversion: 2.1 time: 0.040745 Oct 22 20:48:23.963730 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 27/41] 10.222.0.18 () {58 vars in 1248 bytes} [Sat Oct 22 20:48:23 2022] DELETE /compute/v2.1/flavors/1573113979/os-extra_specs/hw:numa_nodes => generated 0 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 22 20:48:23.970324 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-218b849b-249e-4b5b-b95b-2aab513ab6ad tempest-FlavorsAdminTestJSON-516654737 tempest-FlavorsAdminTestJSON-516654737-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-589845875", "id": null, "os-flavor-access:is_public": "True"}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:48:23.992028 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-218b849b-249e-4b5b-b95b-2aab513ab6ad tempest-FlavorsAdminTestJSON-516654737 tempest-FlavorsAdminTestJSON-516654737-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 506 microversion: 2.1 time: 0.026602 Oct 22 20:48:23.995488 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 28/42] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Oct 22 20:48:23 2022] POST /compute/v2.1/flavors => generated 506 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:48:24.001771 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-e6249df6-02f4-46dc-a456-6742892b2212 tempest-FlavorsAccessTestJSON-625154109 tempest-FlavorsAccessTestJSON-625154109-project-admin] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:48:24.018390 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-e6249df6-02f4-46dc-a456-6742892b2212 tempest-FlavorsAccessTestJSON-625154109 tempest-FlavorsAccessTestJSON-625154109-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/1973194704/os-flavor-access" status: 200 len: 21 microversion: 2.1 time: 0.018749 Oct 22 20:48:24.018390 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 29/43] 10.222.0.18 () {58 vars in 1209 bytes} [Sat Oct 22 20:48:23 2022] GET /compute/v2.1/flavors/1973194704/os-flavor-access => generated 21 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 22 20:48:24.021517 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-296d0ca6-ead0-45fb-8948-6896b600b80f tempest-FlavorsV261TestJSON-634136090 tempest-FlavorsV261TestJSON-634136090-project-admin] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:48:24.046032 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-296d0ca6-ead0-45fb-8948-6896b600b80f tempest-FlavorsV261TestJSON-634136090 tempest-FlavorsV261TestJSON-634136090-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 6798 microversion: 2.61 time: 0.028424 Oct 22 20:48:24.046788 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 30/44] 10.222.0.18 () {60 vars in 1187 bytes} [Sat Oct 22 20:48:24 2022] GET /compute/v2.1/flavors/detail => generated 6798 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 20:48:24.061703 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-7df64b2a-cf55-4e3a-a101-4ed85751a391 tempest-FlavorsExtraSpecsTestJSON-1327478759 tempest-FlavorsExtraSpecsTestJSON-1327478759-project-admin] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:48:24.088778 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-7df64b2a-cf55-4e3a-a101-4ed85751a391 tempest-FlavorsExtraSpecsTestJSON-1327478759 tempest-FlavorsExtraSpecsTestJSON-1327478759-project-admin] 10.222.0.18 "DELETE /compute/v2.1/flavors/1573113979/os-extra_specs/hw:cpu_policy" status: 200 len: 0 microversion: 2.1 time: 0.036296 Oct 22 20:48:24.092406 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 31/45] 10.222.0.18 () {58 vars in 1248 bytes} [Sat Oct 22 20:48:24 2022] DELETE /compute/v2.1/flavors/1573113979/os-extra_specs/hw:cpu_policy => generated 0 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 22 20:48:24.093964 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-48eef0b8-5832-4ec1-8085-c5ebc7af92ee tempest-FlavorsAdminTestJSON-516654737 tempest-FlavorsAdminTestJSON-516654737-project-admin] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:48:24.115970 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-48eef0b8-5832-4ec1-8085-c5ebc7af92ee tempest-FlavorsAdminTestJSON-516654737 tempest-FlavorsAdminTestJSON-516654737-project-admin] 10.222.0.18 "DELETE /compute/v2.1/flavors/a2ff7cfa-66aa-4a6f-ab9b-2018ecb4129b" status: 202 len: 0 microversion: 2.1 time: 0.025521 Oct 22 20:48:24.118838 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 32/46] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 20:48:24 2022] DELETE /compute/v2.1/flavors/a2ff7cfa-66aa-4a6f-ab9b-2018ecb4129b => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 20:48:24.128928 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-db2f2caa-dc2f-4435-8a4d-54f3990b164b tempest-FlavorsAccessTestJSON-625154109 tempest-FlavorsAccessTestJSON-625154109-project-admin] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:48:24.163311 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-db2f2caa-dc2f-4435-8a4d-54f3990b164b tempest-FlavorsAccessTestJSON-625154109 tempest-FlavorsAccessTestJSON-625154109-project-admin] 10.222.0.18 "DELETE /compute/v2.1/flavors/1973194704" status: 202 len: 0 microversion: 2.1 time: 0.043277 Oct 22 20:48:24.163985 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 33/47] 10.222.0.18 () {58 vars in 1161 bytes} [Sat Oct 22 20:48:24 2022] DELETE /compute/v2.1/flavors/1973194704 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 20:48:24.170312 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-7af6cbd4-43e3-406f-8c5c-98d7c92fa3ae tempest-FlavorsExtraSpecsTestJSON-1327478759 tempest-FlavorsExtraSpecsTestJSON-1327478759-project-admin] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:48:24.179261 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-39d3b99d-96e3-43eb-90bd-42b06a85b312 tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Flavor limits 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 20:48:24.179882 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-39d3b99d-96e3-43eb-90bd-42b06a85b312 tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Image limits 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 20:48:24.180621 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-39d3b99d-96e3-43eb-90bd-42b06a85b312 tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Flavor pref 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 20:48:24.181035 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-39d3b99d-96e3-43eb-90bd-42b06a85b312 tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Image pref 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 20:48:24.181168 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-7af6cbd4-43e3-406f-8c5c-98d7c92fa3ae tempest-FlavorsExtraSpecsTestJSON-1327478759 tempest-FlavorsExtraSpecsTestJSON-1327478759-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/1573113979/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.015120 Oct 22 20:48:24.181473 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-39d3b99d-96e3-43eb-90bd-42b06a85b312 tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 20:48:24.181982 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 34/48] 10.222.0.18 () {58 vars in 1203 bytes} [Sat Oct 22 20:48:24 2022] GET /compute/v2.1/flavors/1573113979/os-extra_specs => generated 19 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 22 20:48:24.186783 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-63b6d488-61bc-4ce0-a304-2951d2e59c35 tempest-FlavorsAdminTestJSON-516654737 tempest-FlavorsAdminTestJSON-516654737-project-admin] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:48:24.209681 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-39d3b99d-96e3-43eb-90bd-42b06a85b312 tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:48:24.210331 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-39d3b99d-96e3-43eb-90bd-42b06a85b312 tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:48:24.210915 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-39d3b99d-96e3-43eb-90bd-42b06a85b312 tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:48:24.211769 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-39d3b99d-96e3-43eb-90bd-42b06a85b312 tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:48:24.212280 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-39d3b99d-96e3-43eb-90bd-42b06a85b312 tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:48:24.213057 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-39d3b99d-96e3-43eb-90bd-42b06a85b312 tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:48:24.217038 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-63b6d488-61bc-4ce0-a304-2951d2e59c35 tempest-FlavorsAdminTestJSON-516654737 tempest-FlavorsAdminTestJSON-516654737-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 5397 microversion: 2.1 time: 0.034170 Oct 22 20:48:24.217906 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 35/49] 10.222.0.18 () {58 vars in 1146 bytes} [Sat Oct 22 20:48:24 2022] GET /compute/v2.1/flavors/detail => generated 5397 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:48:24.224541 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-475d7f80-6c7f-4adc-81b9-9f5ff5fffab1 tempest-FlavorsAccessTestJSON-625154109 tempest-FlavorsAccessTestJSON-625154109-project-admin] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:48:24.248155 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-475d7f80-6c7f-4adc-81b9-9f5ff5fffab1 tempest-FlavorsAccessTestJSON-625154109 tempest-FlavorsAccessTestJSON-625154109-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 5397 microversion: 2.1 time: 0.028616 Oct 22 20:48:24.248989 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 36/50] 10.222.0.18 () {58 vars in 1146 bytes} [Sat Oct 22 20:48:24 2022] GET /compute/v2.1/flavors/detail => generated 5397 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:48:24.260086 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-60b69b06-05ca-4f92-81ae-8867e7909c6d tempest-FlavorsExtraSpecsTestJSON-1327478759 tempest-FlavorsExtraSpecsTestJSON-1327478759-project-admin] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:48:24.267635 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-39d3b99d-96e3-43eb-90bd-42b06a85b312 tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Getting quotas for project ae95f5dee52f4235b3478cc90f3b0347. Resources: {'cores', 'instances', 'ram'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 20:48:24.283898 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-39d3b99d-96e3-43eb-90bd-42b06a85b312 tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Getting quotas for user 6de80d628cf14694af6d2cd16f16afad and project ae95f5dee52f4235b3478cc90f3b0347. Resources: {'cores', 'instances', 'ram'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 20:48:24.289231 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-60b69b06-05ca-4f92-81ae-8867e7909c6d tempest-FlavorsExtraSpecsTestJSON-1327478759 tempest-FlavorsExtraSpecsTestJSON-1327478759-project-admin] 10.222.0.18 "DELETE /compute/v2.1/flavors/1573113979" status: 202 len: 0 microversion: 2.1 time: 0.037877 Oct 22 20:48:24.290014 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 37/51] 10.222.0.18 () {58 vars in 1161 bytes} [Sat Oct 22 20:48:24 2022] DELETE /compute/v2.1/flavors/1573113979 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 20:48:24.299524 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-c460d130-7440-4084-b540-5b4321ca1181 tempest-FlavorsAdminTestJSON-516654737 tempest-FlavorsAdminTestJSON-516654737-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1891198844", "id": "9d0ec781-27f6-4cc7-9a3f-ec7dd44069bf", "os-flavor-access:is_public": "True"}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:48:24.304582 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-39d3b99d-96e3-43eb-90bd-42b06a85b312 tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Going to run 1 instances... {{(pid=138744) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 20:48:24.312531 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-39d3b99d-96e3-43eb-90bd-42b06a85b312 tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] [instance: e169b57b-4899-4a9e-80a9-d6290eb63ceb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='085e4478-6edc-4a69-8e08-f9831713eb65',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138744) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 20:48:24.343170 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-c460d130-7440-4084-b540-5b4321ca1181 tempest-FlavorsAdminTestJSON-516654737 tempest-FlavorsAdminTestJSON-516654737-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 507 microversion: 2.1 time: 0.050925 Oct 22 20:48:24.344232 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 38/52] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Oct 22 20:48:24 2022] POST /compute/v2.1/flavors => generated 507 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:48:24.355508 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-2dc3ecdb-9519-43e8-a554-19796ddc1219 tempest-FlavorsExtraSpecsTestJSON-1327478759 tempest-FlavorsExtraSpecsTestJSON-1327478759-project-admin] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:48:24.385032 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-2dc3ecdb-9519-43e8-a554-19796ddc1219 tempest-FlavorsExtraSpecsTestJSON-1327478759 tempest-FlavorsExtraSpecsTestJSON-1327478759-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 5488 microversion: 2.1 time: 0.039090 Oct 22 20:48:24.386075 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 39/53] 10.222.0.18 () {58 vars in 1146 bytes} [Sat Oct 22 20:48:24 2022] GET /compute/v2.1/flavors/detail => generated 5488 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:48:24.391086 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-e2820636-c4e3-4da8-b2f9-902a82345927 tempest-FlavorsAdminTestJSON-516654737 tempest-FlavorsAdminTestJSON-516654737-project-admin] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:48:24.422638 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-e2820636-c4e3-4da8-b2f9-902a82345927 tempest-FlavorsAdminTestJSON-516654737 tempest-FlavorsAdminTestJSON-516654737-project-admin] 10.222.0.18 "DELETE /compute/v2.1/flavors/9d0ec781-27f6-4cc7-9a3f-ec7dd44069bf" status: 202 len: 0 microversion: 2.1 time: 0.034808 Oct 22 20:48:24.423238 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 40/54] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 20:48:24 2022] DELETE /compute/v2.1/flavors/9d0ec781-27f6-4cc7-9a3f-ec7dd44069bf => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 20:48:24.432743 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-02d1a32d-cd57-4e38-b622-1a26eae07fc0 tempest-FlavorsAdminTestJSON-516654737 tempest-FlavorsAdminTestJSON-516654737-project-admin] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:48:24.442741 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-39d3b99d-96e3-43eb-90bd-42b06a85b312 tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.356020 Oct 22 20:48:24.444020 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 15/55] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Oct 22 20:48:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 1358 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 20:48:24.456535 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-02d1a32d-cd57-4e38-b622-1a26eae07fc0 tempest-FlavorsAdminTestJSON-516654737 tempest-FlavorsAdminTestJSON-516654737-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.027866 Oct 22 20:48:24.468072 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-396b1d2f-e4d1-4ae7-b0e6-f279684e4b72 tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:48:24.468072 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-396b1d2f-e4d1-4ae7-b0e6-f279684e4b72 tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] [instance: e169b57b-4899-4a9e-80a9-d6290eb63ceb] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:48:24.470346 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 41/56] 10.222.0.18 () {58 vars in 1146 bytes} [Sat Oct 22 20:48:24 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:48:24.487365 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-1240ff30-57be-4335-bf43-617fb5c67884 tempest-FlavorsAdminTestJSON-516654737 tempest-FlavorsAdminTestJSON-516654737-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-2139149937", "id": 1481147831, "os-flavor-access:is_public": "True"}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:48:24.519660 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-1240ff30-57be-4335-bf43-617fb5c67884 tempest-FlavorsAdminTestJSON-516654737 tempest-FlavorsAdminTestJSON-516654737-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.040429 Oct 22 20:48:24.521354 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 42/57] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Oct 22 20:48:24 2022] POST /compute/v2.1/flavors => generated 414 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:48:24.543422 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-fa4b2314-7d31-405e-8f91-7843ba8c09cb tempest-FlavorsAdminTestJSON-516654737 tempest-FlavorsAdminTestJSON-516654737-project-admin] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:48:24.562644 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-fa4b2314-7d31-405e-8f91-7843ba8c09cb tempest-FlavorsAdminTestJSON-516654737 tempest-FlavorsAdminTestJSON-516654737-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/1481147831" status: 200 len: 414 microversion: 2.1 time: 0.022918 Oct 22 20:48:24.563870 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 43/58] 10.222.0.18 () {58 vars in 1158 bytes} [Sat Oct 22 20:48:24 2022] GET /compute/v2.1/flavors/1481147831 => generated 414 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:48:24.622153 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-396b1d2f-e4d1-4ae7-b0e6-f279684e4b72 tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6de80d628cf14694af6d2cd16f16afad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae95f5dee52f4235b3478cc90f3b0347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:48:24.638911 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-396b1d2f-e4d1-4ae7-b0e6-f279684e4b72 tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] 10.222.0.18 "GET /compute/v2.1/servers/e169b57b-4899-4a9e-80a9-d6290eb63ceb" status: 200 len: 1242 microversion: 2.1 time: 0.181141 Oct 22 20:48:24.654389 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 16/59] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:48:24 2022] GET /compute/v2.1/servers/e169b57b-4899-4a9e-80a9-d6290eb63ceb => generated 1242 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 20:48:25.109773 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-ae5f650b-b239-4443-90b0-70b5f0b9be3c tempest-FlavorsAdminTestJSON-861877712 tempest-FlavorsAdminTestJSON-861877712-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:48:25.145460 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-ae5f650b-b239-4443-90b0-70b5f0b9be3c tempest-FlavorsAdminTestJSON-861877712 tempest-FlavorsAdminTestJSON-861877712-project] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 5395 microversion: 2.1 time: 0.571920 Oct 22 20:48:25.146046 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 44/60] 10.222.0.18 () {58 vars in 1146 bytes} [Sat Oct 22 20:48:24 2022] GET /compute/v2.1/flavors/detail => generated 5395 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 20:48:25.166284 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-50e906ae-f604-42cb-9238-49bbfbbf7fc8 tempest-FlavorsAdminTestJSON-516654737 tempest-FlavorsAdminTestJSON-516654737-project-admin] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:48:25.174111 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=11,nova_api:DELETE=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:48:25.187096 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-50e906ae-f604-42cb-9238-49bbfbbf7fc8 tempest-FlavorsAdminTestJSON-516654737 tempest-FlavorsAdminTestJSON-516654737-project-admin] 10.222.0.18 "DELETE /compute/v2.1/flavors/1481147831" status: 202 len: 0 microversion: 2.1 time: 0.024668 Oct 22 20:48:25.187930 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 17/61] 10.222.0.18 () {58 vars in 1161 bytes} [Sat Oct 22 20:48:25 2022] DELETE /compute/v2.1/flavors/1481147831 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 20:48:25.196319 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-db4c7991-0445-400f-b8b2-73dc597c8d12 tempest-FlavorsAdminTestJSON-516654737 tempest-FlavorsAdminTestJSON-516654737-project-admin] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:48:25.216936 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-db4c7991-0445-400f-b8b2-73dc597c8d12 tempest-FlavorsAdminTestJSON-516654737 tempest-FlavorsAdminTestJSON-516654737-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.024271 Oct 22 20:48:25.218031 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 45/62] 10.222.0.18 () {58 vars in 1146 bytes} [Sat Oct 22 20:48:25 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 20:48:25.239453 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-338d0341-9a4b-421a-af21-fd1f7f937c73 tempest-FlavorsAdminTestJSON-516654737 tempest-FlavorsAdminTestJSON-516654737-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1389946168", "id": 526642287, "os-flavor-access:is_public": "False"}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:48:25.262360 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-338d0341-9a4b-421a-af21-fd1f7f937c73 tempest-FlavorsAdminTestJSON-516654737 tempest-FlavorsAdminTestJSON-516654737-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 427 microversion: 2.1 time: 0.027369 Oct 22 20:48:25.272861 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 18/63] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Oct 22 20:48:25 2022] POST /compute/v2.1/flavors => generated 427 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:48:25.277293 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-278d51f6-9c06-49dc-be63-7988c13ab206 tempest-FlavorsAdminTestJSON-861877712 tempest-FlavorsAdminTestJSON-861877712-project] Action: 'create', calling method: >, body: {"server": {"name": "test", "imageRef": "085e4478-6edc-4a69-8e08-f9831713eb65", "flavorRef": "526642287"}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:48:25.289660 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.wsgi [None req-278d51f6-9c06-49dc-be63-7988c13ab206 tempest-FlavorsAdminTestJSON-861877712 tempest-FlavorsAdminTestJSON-861877712-project] HTTP exception thrown: Flavor 526642287 could not be found. Oct 22 20:48:25.299545 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-278d51f6-9c06-49dc-be63-7988c13ab206 tempest-FlavorsAdminTestJSON-861877712 tempest-FlavorsAdminTestJSON-861877712-project] Request method failure captured: Oct 22 20:48:25.299545 ncdv-master-1 devstack@n-api.service[138745]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 22 20:48:25.299545 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 20:48:25.299545 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 20:48:25.299545 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 20:48:25.299545 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 106 Oct 22 20:48:25.299545 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 20:48:25.299545 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 20:48:25.299545 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 20:48:25.299545 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 20:48:25.299545 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVFcSIZKTJcoJFooKNwcoZpcrsaHtNCIPoEmSF8Vt0efwDJFU2UM4i6oFkQ-heInfc4E3YdgO6Lkw8bt2cyZXyXce0wPCROOzun_82WvmHh14iGSnqyuX2ZMp66bDUZwB9_iphB9-eJBZH8v5y4vr3iy8Q7otzb2kkd3s4uPFDbR_d-c Oct 22 20:48:25.299545 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 20:48:25.299545 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 20:48:25.299545 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 20:48:25.299545 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 20:48:25.299545 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 20:48:25.299545 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 20:48:25.299545 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: 90aa677193f147179b2d8e287f42567a Oct 22 20:48:25.299545 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-FlavorsAdminTestJSON-861877712 Oct 22 20:48:25.299545 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 20:48:25.299545 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 20:48:25.301187 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_90aa677193f147179b2d8e287f42567a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/90aa677193f147179b2d8e287f42567a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/90aa677193f147179b2d8e287f42567a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/90aa677193f147179b2d8e287f42567a"}]}] Oct 22 20:48:25.301187 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-FlavorsAdminTestJSON-861877712 Oct 22 20:48:25.301187 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: 90aa677193f147179b2d8e287f42567a Oct 22 20:48:25.301187 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-FlavorsAdminTestJSON-861877712 Oct 22 20:48:25.301187 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-FlavorsAdminTestJSON-861877712-project Oct 22 20:48:25.301187 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 20:48:25.301187 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 20:48:25.301187 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: be0a2cbb0dc9405d910c4c5a2559e42b Oct 22 20:48:25.301187 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-FlavorsAdminTestJSON-861877712-project Oct 22 20:48:25.301187 ncdv-master-1 devstack@n-api.service[138745]: Oct 22 20:48:25.301187 ncdv-master-1 devstack@n-api.service[138745]: {"server": {"name": "test", "imageRef": "085e4478-6edc-4a69-8e08-f9831713eb65", "flavorRef": "526642287"}} Oct 22 20:48:25.301187 ncdv-master-1 devstack@n-api.service[138745]: method: > Oct 22 20:48:25.301187 ncdv-master-1 devstack@n-api.service[138745]: exception: Flavor 526642287 could not be found. Oct 22 20:48:25.301857 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'body': {'server': {'name': 'test', 'imageRef': '085e4478-6edc-4a69-8e08-f9831713eb65', 'flavorRef': '526642287'}}} Oct 22 20:48:25.301857 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:48:25.301857 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:48:25.301857 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Oct 22 20:48:25.301857 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Oct 22 20:48:25.301857 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 22 20:48:25.301857 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 22 20:48:25.301857 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 22 20:48:25.301857 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 22 20:48:25.301857 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 22 20:48:25.301857 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 22 20:48:25.301857 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 22 20:48:25.301857 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:48:25.301857 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 22 20:48:25.301857 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 22 20:48:25.301857 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 526642287 could not be found. Oct 22 20:48:25.301857 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:48:25.301857 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:48:25.301857 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:48:25.301857 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:48:25.302903 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:48:25.302903 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:48:25.302903 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:48:25.302903 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:48:25.302903 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:48:25.302903 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:48:25.302903 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 20:48:25.302903 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 20:48:25.302903 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 20:48:25.302903 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 20:48:25.302903 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 20:48:25.302903 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 20:48:25.302903 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 22 20:48:25.302903 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 22 20:48:25.302903 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 22 20:48:25.302903 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 526642287 could not be found. Oct 22 20:48:25.302903 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:48:25.302903 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:48:25.302903 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:48:25.302903 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:48:25.302903 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:48:25.304292 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:48:25.304292 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 20:48:25.304292 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 20:48:25.304292 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 526642287 could not be found. Oct 22 20:48:25.304292 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:48:25.305993 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-278d51f6-9c06-49dc-be63-7988c13ab206 tempest-FlavorsAdminTestJSON-861877712 tempest-FlavorsAdminTestJSON-861877712-project] Returning 400 to user: Flavor 526642287 could not be found. {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:48:25.308515 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-278d51f6-9c06-49dc-be63-7988c13ab206 tempest-FlavorsAdminTestJSON-861877712 tempest-FlavorsAdminTestJSON-861877712-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 400 len: 80 microversion: 2.1 time: 0.036157 Oct 22 20:48:25.309600 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 46/64] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Oct 22 20:48:25 2022] POST /compute/v2.1/servers => generated 80 bytes in 38 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 22 20:48:25.319382 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-251bace5-cb27-48a1-bbd6-ee79014b56fe tempest-FlavorsAdminTestJSON-516654737 tempest-FlavorsAdminTestJSON-516654737-project-admin] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:48:25.340113 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-251bace5-cb27-48a1-bbd6-ee79014b56fe tempest-FlavorsAdminTestJSON-516654737 tempest-FlavorsAdminTestJSON-516654737-project-admin] 10.222.0.18 "DELETE /compute/v2.1/flavors/526642287" status: 202 len: 0 microversion: 2.1 time: 0.025793 Oct 22 20:48:25.341210 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 19/65] 10.222.0.18 () {58 vars in 1158 bytes} [Sat Oct 22 20:48:25 2022] DELETE /compute/v2.1/flavors/526642287 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 22 20:48:25.351429 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-6d1f7fd3-8192-4791-bba3-6a0a45317b41 tempest-FlavorsAdminTestJSON-516654737 tempest-FlavorsAdminTestJSON-516654737-project-admin] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:48:25.376248 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-6d1f7fd3-8192-4791-bba3-6a0a45317b41 tempest-FlavorsAdminTestJSON-516654737 tempest-FlavorsAdminTestJSON-516654737-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.030260 Oct 22 20:48:25.377368 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 47/66] 10.222.0.18 () {58 vars in 1146 bytes} [Sat Oct 22 20:48:25 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 20:48:25.398440 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-0018a23f-b453-41ff-8f77-be7d9775fa45 tempest-FlavorsAdminTestJSON-516654737 tempest-FlavorsAdminTestJSON-516654737-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1372022895", "id": 1893835623, "os-flavor-access:is_public": "False"}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:48:25.424671 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-0018a23f-b453-41ff-8f77-be7d9775fa45 tempest-FlavorsAdminTestJSON-516654737 tempest-FlavorsAdminTestJSON-516654737-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 415 microversion: 2.1 time: 0.030205 Oct 22 20:48:25.425852 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 20/67] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Oct 22 20:48:25 2022] POST /compute/v2.1/flavors => generated 415 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:48:25.447952 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-06a53242-cf99-4d34-ba91-283f9e659fbf tempest-FlavorsAdminTestJSON-516654737 tempest-FlavorsAdminTestJSON-516654737-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1004857241", "id": 1052464441, "os-flavor-access:is_public": "True"}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:48:25.458461 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=5,nova_api:DELETE=17,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:48:25.502341 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-06a53242-cf99-4d34-ba91-283f9e659fbf tempest-FlavorsAdminTestJSON-516654737 tempest-FlavorsAdminTestJSON-516654737-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.064384 Oct 22 20:48:25.505085 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 48/68] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Oct 22 20:48:25 2022] POST /compute/v2.1/flavors => generated 414 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:48:25.523734 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-ab047fd4-8b5c-4cf2-bc98-c00ebdd6dd97 tempest-FlavorsAdminTestJSON-516654737 tempest-FlavorsAdminTestJSON-516654737-project-admin] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:48:25.574320 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-ab047fd4-8b5c-4cf2-bc98-c00ebdd6dd97 tempest-FlavorsAdminTestJSON-516654737 tempest-FlavorsAdminTestJSON-516654737-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail?is_public=f" status: 200 len: 418 microversion: 2.1 time: 0.060855 Oct 22 20:48:25.574700 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 21/69] 10.222.0.18 () {58 vars in 1169 bytes} [Sat Oct 22 20:48:25 2022] GET /compute/v2.1/flavors/detail?is_public=f => generated 418 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:48:25.591630 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-b2e1730e-091b-43f4-8e23-81156977c860 tempest-FlavorsAdminTestJSON-516654737 tempest-FlavorsAdminTestJSON-516654737-project-admin] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:48:25.619233 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-b2e1730e-091b-43f4-8e23-81156977c860 tempest-FlavorsAdminTestJSON-516654737 tempest-FlavorsAdminTestJSON-516654737-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail?is_public=false" status: 200 len: 418 microversion: 2.1 time: 0.034447 Oct 22 20:48:25.620262 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 49/70] 10.222.0.18 () {58 vars in 1177 bytes} [Sat Oct 22 20:48:25 2022] GET /compute/v2.1/flavors/detail?is_public=false => generated 418 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:48:25.634962 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-ea357134-b2cd-4c6e-b0b0-e174ec4c27fe tempest-FlavorsAdminTestJSON-516654737 tempest-FlavorsAdminTestJSON-516654737-project-admin] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:48:25.651587 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-ea357134-b2cd-4c6e-b0b0-e174ec4c27fe tempest-FlavorsAdminTestJSON-516654737 tempest-FlavorsAdminTestJSON-516654737-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail?is_public=no" status: 200 len: 418 microversion: 2.1 time: 0.019861 Oct 22 20:48:25.651587 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 22/71] 10.222.0.18 () {58 vars in 1171 bytes} [Sat Oct 22 20:48:25 2022] GET /compute/v2.1/flavors/detail?is_public=no => generated 418 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 20:48:25.673275 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-7391c585-e62e-43e6-9232-f670aef63c4c tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:48:25.674424 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-7391c585-e62e-43e6-9232-f670aef63c4c tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] [instance: e169b57b-4899-4a9e-80a9-d6290eb63ceb] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:48:25.678124 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-2797dcf6-a1cc-493a-bf33-3a963320047d tempest-FlavorsAdminTestJSON-516654737 tempest-FlavorsAdminTestJSON-516654737-project-admin] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:48:25.714753 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-2797dcf6-a1cc-493a-bf33-3a963320047d tempest-FlavorsAdminTestJSON-516654737 tempest-FlavorsAdminTestJSON-516654737-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail?is_public=0" status: 200 len: 418 microversion: 2.1 time: 0.041391 Oct 22 20:48:25.726238 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 23/72] 10.222.0.18 () {58 vars in 1169 bytes} [Sat Oct 22 20:48:25 2022] GET /compute/v2.1/flavors/detail?is_public=0 => generated 418 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:48:25.743481 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-ea7515bb-42a3-4095-bec6-4139c0e1e39c tempest-FlavorsAdminTestJSON-516654737 tempest-FlavorsAdminTestJSON-516654737-project-admin] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:48:25.798414 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-ea7515bb-42a3-4095-bec6-4139c0e1e39c tempest-FlavorsAdminTestJSON-516654737 tempest-FlavorsAdminTestJSON-516654737-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail?is_public=t" status: 200 len: 5395 microversion: 2.1 time: 0.062480 Oct 22 20:48:25.800290 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 24/73] 10.222.0.18 () {58 vars in 1169 bytes} [Sat Oct 22 20:48:25 2022] GET /compute/v2.1/flavors/detail?is_public=t => generated 5395 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:48:25.823380 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-21427a4b-2289-43c6-8607-631f54b98eb4 tempest-FlavorsAdminTestJSON-516654737 tempest-FlavorsAdminTestJSON-516654737-project-admin] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:48:25.865447 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-21427a4b-2289-43c6-8607-631f54b98eb4 tempest-FlavorsAdminTestJSON-516654737 tempest-FlavorsAdminTestJSON-516654737-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail?is_public=true" status: 200 len: 5395 microversion: 2.1 time: 0.050280 Oct 22 20:48:25.866766 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 25/74] 10.222.0.18 () {58 vars in 1175 bytes} [Sat Oct 22 20:48:25 2022] GET /compute/v2.1/flavors/detail?is_public=true => generated 5395 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 20:48:25.887411 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-772c19fa-3cbb-40d0-a381-e243aed17fca tempest-FlavorsAdminTestJSON-516654737 tempest-FlavorsAdminTestJSON-516654737-project-admin] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:48:25.912580 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-772c19fa-3cbb-40d0-a381-e243aed17fca tempest-FlavorsAdminTestJSON-516654737 tempest-FlavorsAdminTestJSON-516654737-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail?is_public=yes" status: 200 len: 5395 microversion: 2.1 time: 0.030612 Oct 22 20:48:25.914265 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 26/75] 10.222.0.18 () {58 vars in 1173 bytes} [Sat Oct 22 20:48:25 2022] GET /compute/v2.1/flavors/detail?is_public=yes => generated 5395 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:48:25.945066 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-1b8134b1-c9f8-47e5-b3c3-e310a220b2fb tempest-FlavorsAdminTestJSON-516654737 tempest-FlavorsAdminTestJSON-516654737-project-admin] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:48:26.013733 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-1b8134b1-c9f8-47e5-b3c3-e310a220b2fb tempest-FlavorsAdminTestJSON-516654737 tempest-FlavorsAdminTestJSON-516654737-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail?is_public=1" status: 200 len: 5395 microversion: 2.1 time: 0.072970 Oct 22 20:48:26.015397 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 27/76] 10.222.0.18 () {58 vars in 1169 bytes} [Sat Oct 22 20:48:25 2022] GET /compute/v2.1/flavors/detail?is_public=1 => generated 5395 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 20:48:26.035320 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-cacd412b-f8ba-44ab-9071-73916ef84a77 tempest-FlavorsAdminTestJSON-516654737 tempest-FlavorsAdminTestJSON-516654737-project-admin] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:48:26.056658 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-cacd412b-f8ba-44ab-9071-73916ef84a77 tempest-FlavorsAdminTestJSON-516654737 tempest-FlavorsAdminTestJSON-516654737-project-admin] 10.222.0.18 "DELETE /compute/v2.1/flavors/1052464441" status: 202 len: 0 microversion: 2.1 time: 0.025101 Oct 22 20:48:26.057514 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 28/77] 10.222.0.18 () {58 vars in 1161 bytes} [Sat Oct 22 20:48:26 2022] DELETE /compute/v2.1/flavors/1052464441 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 20:48:26.066597 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-f63b5f1b-e5c7-4d52-9f33-c9c6bf1d3168 tempest-FlavorsAdminTestJSON-516654737 tempest-FlavorsAdminTestJSON-516654737-project-admin] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:48:26.111474 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-f63b5f1b-e5c7-4d52-9f33-c9c6bf1d3168 tempest-FlavorsAdminTestJSON-516654737 tempest-FlavorsAdminTestJSON-516654737-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.048708 Oct 22 20:48:26.114629 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 29/78] 10.222.0.18 () {58 vars in 1146 bytes} [Sat Oct 22 20:48:26 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:48:26.626179 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-c8e09157-87fa-4263-80de-01e0fac968b8 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-761665399", "imageRef": "085e4478-6edc-4a69-8e08-f9831713eb65", "flavorRef": "452"}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:48:26.711960 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.network.neutron [None req-c8e09157-87fa-4263-80de-01e0fac968b8 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] validate_networks() for None {{(pid=138744) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 20:48:26.909489 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-7391c585-e62e-43e6-9232-f670aef63c4c tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6de80d628cf14694af6d2cd16f16afad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae95f5dee52f4235b3478cc90f3b0347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:48:26.935103 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-7391c585-e62e-43e6-9232-f670aef63c4c tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] 10.222.0.18 "GET /compute/v2.1/servers/e169b57b-4899-4a9e-80a9-d6290eb63ceb" status: 200 len: 1242 microversion: 2.1 time: 1.266227 Oct 22 20:48:26.938369 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 50/79] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:48:25 2022] GET /compute/v2.1/servers/e169b57b-4899-4a9e-80a9-d6290eb63ceb => generated 1242 bytes in 1270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:48:26.959724 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-badb60b0-b0b6-4ea1-8ac8-7eb5de00b29c tempest-FlavorsAdminTestJSON-516654737 tempest-FlavorsAdminTestJSON-516654737-project-admin] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:48:26.994190 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-badb60b0-b0b6-4ea1-8ac8-7eb5de00b29c tempest-FlavorsAdminTestJSON-516654737 tempest-FlavorsAdminTestJSON-516654737-project-admin] 10.222.0.18 "DELETE /compute/v2.1/flavors/1893835623" status: 202 len: 0 microversion: 2.1 time: 0.045335 Oct 22 20:48:26.994939 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 51/80] 10.222.0.18 () {58 vars in 1161 bytes} [Sat Oct 22 20:48:26 2022] DELETE /compute/v2.1/flavors/1893835623 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 20:48:27.014302 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-f9bbad6b-a95e-4a74-9ad0-c5d2ad6a6c4b tempest-FlavorsAdminTestJSON-516654737 tempest-FlavorsAdminTestJSON-516654737-project-admin] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:48:27.047467 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-f9bbad6b-a95e-4a74-9ad0-c5d2ad6a6c4b tempest-FlavorsAdminTestJSON-516654737 tempest-FlavorsAdminTestJSON-516654737-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.042372 Oct 22 20:48:27.050134 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 52/81] 10.222.0.18 () {58 vars in 1146 bytes} [Sat Oct 22 20:48:27 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:48:27.076239 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-1f7efb2f-d3e7-4e4c-82ba-58fcdfaef0a3 tempest-FlavorsAdminTestJSON-516654737 tempest-FlavorsAdminTestJSON-516654737-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-493260525", "id": 1665827214, "os-flavor-access:is_public": "False"}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:48:27.106083 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-1f7efb2f-d3e7-4e4c-82ba-58fcdfaef0a3 tempest-FlavorsAdminTestJSON-516654737 tempest-FlavorsAdminTestJSON-516654737-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.035672 Oct 22 20:48:27.106936 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 53/82] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Oct 22 20:48:27 2022] POST /compute/v2.1/flavors => generated 414 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:48:27.125977 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-5374b53d-b3ea-44f4-87ce-c685708ab475 tempest-FlavorsAdminTestJSON-516654737 tempest-FlavorsAdminTestJSON-516654737-project-admin] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:48:27.177951 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-5374b53d-b3ea-44f4-87ce-c685708ab475 tempest-FlavorsAdminTestJSON-516654737 tempest-FlavorsAdminTestJSON-516654737-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.059918 Oct 22 20:48:27.179202 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 54/83] 10.222.0.18 () {58 vars in 1146 bytes} [Sat Oct 22 20:48:27 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 20:48:27.205666 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-963921cd-abbf-42cf-b615-af84b854e46d tempest-FlavorsAdminTestJSON-861877712 tempest-FlavorsAdminTestJSON-861877712-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:48:27.229972 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-c8e09157-87fa-4263-80de-01e0fac968b8 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Flavor limits 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 20:48:27.230399 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-c8e09157-87fa-4263-80de-01e0fac968b8 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Image limits 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 20:48:27.230915 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-c8e09157-87fa-4263-80de-01e0fac968b8 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Flavor pref 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 20:48:27.231527 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-c8e09157-87fa-4263-80de-01e0fac968b8 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Image pref 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 20:48:27.231957 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-c8e09157-87fa-4263-80de-01e0fac968b8 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 20:48:27.251712 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-963921cd-abbf-42cf-b615-af84b854e46d tempest-FlavorsAdminTestJSON-861877712 tempest-FlavorsAdminTestJSON-861877712-project] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.057226 Oct 22 20:48:27.252870 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 55/84] 10.222.0.18 () {58 vars in 1146 bytes} [Sat Oct 22 20:48:27 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:48:27.255751 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c8e09157-87fa-4263-80de-01e0fac968b8 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:48:27.256254 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c8e09157-87fa-4263-80de-01e0fac968b8 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:48:27.256785 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c8e09157-87fa-4263-80de-01e0fac968b8 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:48:27.257550 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c8e09157-87fa-4263-80de-01e0fac968b8 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:48:27.258009 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c8e09157-87fa-4263-80de-01e0fac968b8 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:48:27.258423 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c8e09157-87fa-4263-80de-01e0fac968b8 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:48:27.287290 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-852bf9c9-32e8-45e9-97dc-4bafdb15d4d2 tempest-FlavorsAdminTestJSON-516654737 tempest-FlavorsAdminTestJSON-516654737-project-admin] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:48:27.297407 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-c8e09157-87fa-4263-80de-01e0fac968b8 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Getting quotas for project 2675a324f0134844a1964f64322493ba. Resources: {'cores', 'instances', 'ram'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 20:48:27.302895 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-c8e09157-87fa-4263-80de-01e0fac968b8 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Getting quotas for user 16e13dcabaaa4b218945aeeabb4c902e and project 2675a324f0134844a1964f64322493ba. Resources: {'cores', 'instances', 'ram'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 20:48:27.312049 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-852bf9c9-32e8-45e9-97dc-4bafdb15d4d2 tempest-FlavorsAdminTestJSON-516654737 tempest-FlavorsAdminTestJSON-516654737-project-admin] 10.222.0.18 "DELETE /compute/v2.1/flavors/1665827214" status: 202 len: 0 microversion: 2.1 time: 0.042084 Oct 22 20:48:27.315620 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 56/85] 10.222.0.18 () {58 vars in 1161 bytes} [Sat Oct 22 20:48:27 2022] DELETE /compute/v2.1/flavors/1665827214 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 20:48:27.319829 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-c8e09157-87fa-4263-80de-01e0fac968b8 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Going to run 1 instances... {{(pid=138744) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 20:48:27.322653 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-c8e09157-87fa-4263-80de-01e0fac968b8 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] [instance: f592a6fe-8cc7-4bb1-bb04-f8ddd358eeca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='085e4478-6edc-4a69-8e08-f9831713eb65',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138744) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 20:48:27.324835 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-7902a172-6cdf-40fc-b79b-b7835274efc4 tempest-FlavorsAdminTestJSON-516654737 tempest-FlavorsAdminTestJSON-516654737-project-admin] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:48:27.384553 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-7902a172-6cdf-40fc-b79b-b7835274efc4 tempest-FlavorsAdminTestJSON-516654737 tempest-FlavorsAdminTestJSON-516654737-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.060714 Oct 22 20:48:27.384553 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 57/86] 10.222.0.18 () {58 vars in 1146 bytes} [Sat Oct 22 20:48:27 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:48:27.396470 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-c8e09157-87fa-4263-80de-01e0fac968b8 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.270957 Oct 22 20:48:27.397309 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 30/87] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Oct 22 20:48:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 1273 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 20:48:27.410353 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-5609bbf5-1713-4db2-ab86-f9522f97c0f3 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:48:27.411242 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-5609bbf5-1713-4db2-ab86-f9522f97c0f3 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] [instance: f592a6fe-8cc7-4bb1-bb04-f8ddd358eeca] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:48:27.413893 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-09277464-2b01-49f3-b535-4cfcf86c56d1 tempest-FlavorsAdminTestJSON-516654737 tempest-FlavorsAdminTestJSON-516654737-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1183204541", "id": 874171768, "os-flavor-access:is_public": "True"}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:48:27.453956 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-09277464-2b01-49f3-b535-4cfcf86c56d1 tempest-FlavorsAdminTestJSON-516654737 tempest-FlavorsAdminTestJSON-516654737-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.1 time: 0.044925 Oct 22 20:48:27.480894 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 31/88] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Oct 22 20:48:27 2022] POST /compute/v2.1/flavors => generated 411 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 20:48:27.502393 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-f63a335b-9ab6-47bf-8db3-3e31dba082dd tempest-FlavorsAdminTestJSON-861877712 tempest-FlavorsAdminTestJSON-861877712-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:48:27.527016 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-5609bbf5-1713-4db2-ab86-f9522f97c0f3 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e13dcabaaa4b218945aeeabb4c902e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675a324f0134844a1964f64322493ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:48:27.532543 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-f63a335b-9ab6-47bf-8db3-3e31dba082dd tempest-FlavorsAdminTestJSON-861877712 tempest-FlavorsAdminTestJSON-861877712-project] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 5392 microversion: 2.1 time: 0.047888 Oct 22 20:48:27.534123 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 32/89] 10.222.0.18 () {58 vars in 1146 bytes} [Sat Oct 22 20:48:27 2022] GET /compute/v2.1/flavors/detail => generated 5392 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:48:27.537360 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-5609bbf5-1713-4db2-ab86-f9522f97c0f3 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] 10.222.0.18 "GET /compute/v2.1/servers/f592a6fe-8cc7-4bb1-bb04-f8ddd358eeca" status: 200 len: 1219 microversion: 2.1 time: 0.131544 Oct 22 20:48:27.540979 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 58/90] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:48:27 2022] GET /compute/v2.1/servers/f592a6fe-8cc7-4bb1-bb04-f8ddd358eeca => generated 1219 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:48:27.582779 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-e4b0b2c1-4491-47f0-a2f8-dc35a34ee4e0 tempest-FlavorsAdminTestJSON-516654737 tempest-FlavorsAdminTestJSON-516654737-project-admin] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:48:27.628675 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-e4b0b2c1-4491-47f0-a2f8-dc35a34ee4e0 tempest-FlavorsAdminTestJSON-516654737 tempest-FlavorsAdminTestJSON-516654737-project-admin] 10.222.0.18 "DELETE /compute/v2.1/flavors/874171768" status: 202 len: 0 microversion: 2.1 time: 0.064771 Oct 22 20:48:27.633633 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 33/91] 10.222.0.18 () {58 vars in 1158 bytes} [Sat Oct 22 20:48:27 2022] DELETE /compute/v2.1/flavors/874171768 => generated 0 bytes in 71 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 20:48:27.643506 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-36db661b-5227-490c-8148-c306157779a8 tempest-FlavorsAdminTestJSON-516654737 tempest-FlavorsAdminTestJSON-516654737-project-admin] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:48:27.689094 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-36db661b-5227-490c-8148-c306157779a8 tempest-FlavorsAdminTestJSON-516654737 tempest-FlavorsAdminTestJSON-516654737-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.049037 Oct 22 20:48:27.690163 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 59/92] 10.222.0.18 () {58 vars in 1146 bytes} [Sat Oct 22 20:48:27 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:48:27.970699 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-7f911a80-fb0c-43e8-8cef-c4a1c34d05a5 tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:48:27.971959 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-7f911a80-fb0c-43e8-8cef-c4a1c34d05a5 tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] [instance: e169b57b-4899-4a9e-80a9-d6290eb63ceb] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:48:27.986041 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7f911a80-fb0c-43e8-8cef-c4a1c34d05a5 tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:48:27.986753 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7f911a80-fb0c-43e8-8cef-c4a1c34d05a5 tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:48:27.988045 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7f911a80-fb0c-43e8-8cef-c4a1c34d05a5 tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:48:27.990239 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7f911a80-fb0c-43e8-8cef-c4a1c34d05a5 tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:48:27.991157 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7f911a80-fb0c-43e8-8cef-c4a1c34d05a5 tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:48:27.991696 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7f911a80-fb0c-43e8-8cef-c4a1c34d05a5 tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:48:28.195975 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-7f911a80-fb0c-43e8-8cef-c4a1c34d05a5 tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6de80d628cf14694af6d2cd16f16afad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae95f5dee52f4235b3478cc90f3b0347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:48:28.225710 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-7f911a80-fb0c-43e8-8cef-c4a1c34d05a5 tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] 10.222.0.18 "GET /compute/v2.1/servers/e169b57b-4899-4a9e-80a9-d6290eb63ceb" status: 200 len: 1296 microversion: 2.1 time: 0.259841 Oct 22 20:48:28.228289 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 34/93] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:48:27 2022] GET /compute/v2.1/servers/e169b57b-4899-4a9e-80a9-d6290eb63ceb => generated 1296 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:48:28.581468 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-e1c58f21-492c-4742-8dd9-c612a698c5b6 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:48:28.583667 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-e1c58f21-492c-4742-8dd9-c612a698c5b6 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] [instance: f592a6fe-8cc7-4bb1-bb04-f8ddd358eeca] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:48:28.602023 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e1c58f21-492c-4742-8dd9-c612a698c5b6 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:48:28.602751 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e1c58f21-492c-4742-8dd9-c612a698c5b6 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:48:28.603528 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e1c58f21-492c-4742-8dd9-c612a698c5b6 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:48:28.604767 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e1c58f21-492c-4742-8dd9-c612a698c5b6 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:48:28.606111 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e1c58f21-492c-4742-8dd9-c612a698c5b6 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:48:28.606645 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e1c58f21-492c-4742-8dd9-c612a698c5b6 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:48:28.990891 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-e1c58f21-492c-4742-8dd9-c612a698c5b6 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e13dcabaaa4b218945aeeabb4c902e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675a324f0134844a1964f64322493ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:48:29.004921 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-e1c58f21-492c-4742-8dd9-c612a698c5b6 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] 10.222.0.18 "GET /compute/v2.1/servers/f592a6fe-8cc7-4bb1-bb04-f8ddd358eeca" status: 200 len: 1215 microversion: 2.1 time: 0.441109 Oct 22 20:48:29.006246 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 60/94] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:48:28 2022] GET /compute/v2.1/servers/f592a6fe-8cc7-4bb1-bb04-f8ddd358eeca => generated 1215 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:48:29.251425 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-6f75c3ca-1416-4539-baa6-13fb87435dfd tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:48:29.252387 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-6f75c3ca-1416-4539-baa6-13fb87435dfd tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] [instance: e169b57b-4899-4a9e-80a9-d6290eb63ceb] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:48:29.264469 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6f75c3ca-1416-4539-baa6-13fb87435dfd tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:48:29.267914 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6f75c3ca-1416-4539-baa6-13fb87435dfd tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:48:29.269987 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6f75c3ca-1416-4539-baa6-13fb87435dfd tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:48:29.271745 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6f75c3ca-1416-4539-baa6-13fb87435dfd tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:48:29.272555 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6f75c3ca-1416-4539-baa6-13fb87435dfd tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:48:29.274600 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6f75c3ca-1416-4539-baa6-13fb87435dfd tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:48:29.805014 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-6f75c3ca-1416-4539-baa6-13fb87435dfd tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6de80d628cf14694af6d2cd16f16afad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae95f5dee52f4235b3478cc90f3b0347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:48:29.820056 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-6f75c3ca-1416-4539-baa6-13fb87435dfd tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] 10.222.0.18 "GET /compute/v2.1/servers/e169b57b-4899-4a9e-80a9-d6290eb63ceb" status: 200 len: 1338 microversion: 2.1 time: 0.571455 Oct 22 20:48:29.838359 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 35/95] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:48:29 2022] GET /compute/v2.1/servers/e169b57b-4899-4a9e-80a9-d6290eb63ceb => generated 1338 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:48:30.032280 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-8232ba9a-eff0-4cf5-900c-d3bc4d9eab58 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:48:30.034480 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-8232ba9a-eff0-4cf5-900c-d3bc4d9eab58 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] [instance: f592a6fe-8cc7-4bb1-bb04-f8ddd358eeca] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:48:30.050227 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8232ba9a-eff0-4cf5-900c-d3bc4d9eab58 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:48:30.052743 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8232ba9a-eff0-4cf5-900c-d3bc4d9eab58 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:48:30.056384 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8232ba9a-eff0-4cf5-900c-d3bc4d9eab58 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:48:30.058469 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8232ba9a-eff0-4cf5-900c-d3bc4d9eab58 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:48:30.060928 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8232ba9a-eff0-4cf5-900c-d3bc4d9eab58 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:48:30.061584 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8232ba9a-eff0-4cf5-900c-d3bc4d9eab58 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:48:30.297847 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-8232ba9a-eff0-4cf5-900c-d3bc4d9eab58 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e13dcabaaa4b218945aeeabb4c902e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675a324f0134844a1964f64322493ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:48:30.317653 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-8232ba9a-eff0-4cf5-900c-d3bc4d9eab58 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] 10.222.0.18 "GET /compute/v2.1/servers/f592a6fe-8cc7-4bb1-bb04-f8ddd358eeca" status: 200 len: 1277 microversion: 2.1 time: 0.290303 Oct 22 20:48:30.319061 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 61/96] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:48:30 2022] GET /compute/v2.1/servers/f592a6fe-8cc7-4bb1-bb04-f8ddd358eeca => generated 1277 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:48:30.844887 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-bf68c294-ca8c-4d2c-a4ff-de4819d5aec0 tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:48:30.845515 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-bf68c294-ca8c-4d2c-a4ff-de4819d5aec0 tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] [instance: e169b57b-4899-4a9e-80a9-d6290eb63ceb] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:48:30.860290 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bf68c294-ca8c-4d2c-a4ff-de4819d5aec0 tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:48:30.860800 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bf68c294-ca8c-4d2c-a4ff-de4819d5aec0 tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:48:30.861250 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bf68c294-ca8c-4d2c-a4ff-de4819d5aec0 tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:48:30.869618 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bf68c294-ca8c-4d2c-a4ff-de4819d5aec0 tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:48:30.870158 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bf68c294-ca8c-4d2c-a4ff-de4819d5aec0 tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:48:30.874850 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bf68c294-ca8c-4d2c-a4ff-de4819d5aec0 tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:48:31.283377 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-bf68c294-ca8c-4d2c-a4ff-de4819d5aec0 tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6de80d628cf14694af6d2cd16f16afad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae95f5dee52f4235b3478cc90f3b0347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:48:31.292389 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-bf68c294-ca8c-4d2c-a4ff-de4819d5aec0 tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] 10.222.0.18 "GET /compute/v2.1/servers/e169b57b-4899-4a9e-80a9-d6290eb63ceb" status: 200 len: 1338 microversion: 2.1 time: 0.451326 Oct 22 20:48:31.312175 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 36/97] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:48:30 2022] GET /compute/v2.1/servers/e169b57b-4899-4a9e-80a9-d6290eb63ceb => generated 1338 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:48:31.342518 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-5ef839aa-65c1-43d0-92c9-f2bf54a6956a tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:48:31.344315 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-5ef839aa-65c1-43d0-92c9-f2bf54a6956a tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] [instance: f592a6fe-8cc7-4bb1-bb04-f8ddd358eeca] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:48:31.352766 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5ef839aa-65c1-43d0-92c9-f2bf54a6956a tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:48:31.357490 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5ef839aa-65c1-43d0-92c9-f2bf54a6956a tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:48:31.361007 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5ef839aa-65c1-43d0-92c9-f2bf54a6956a tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:48:31.362768 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5ef839aa-65c1-43d0-92c9-f2bf54a6956a tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:48:31.365276 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5ef839aa-65c1-43d0-92c9-f2bf54a6956a tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:48:31.366069 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5ef839aa-65c1-43d0-92c9-f2bf54a6956a tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:48:31.495919 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-5ef839aa-65c1-43d0-92c9-f2bf54a6956a tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e13dcabaaa4b218945aeeabb4c902e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675a324f0134844a1964f64322493ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:48:31.508732 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-5ef839aa-65c1-43d0-92c9-f2bf54a6956a tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] 10.222.0.18 "GET /compute/v2.1/servers/f592a6fe-8cc7-4bb1-bb04-f8ddd358eeca" status: 200 len: 1277 microversion: 2.1 time: 0.170556 Oct 22 20:48:31.512861 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 62/98] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:48:31 2022] GET /compute/v2.1/servers/f592a6fe-8cc7-4bb1-bb04-f8ddd358eeca => generated 1277 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:48:32.324469 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-0f98a86a-b099-4652-b367-5b4b04a5f7b4 tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:48:32.324469 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-0f98a86a-b099-4652-b367-5b4b04a5f7b4 tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] [instance: e169b57b-4899-4a9e-80a9-d6290eb63ceb] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:48:32.333212 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0f98a86a-b099-4652-b367-5b4b04a5f7b4 tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:48:32.333720 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0f98a86a-b099-4652-b367-5b4b04a5f7b4 tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:48:32.334164 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0f98a86a-b099-4652-b367-5b4b04a5f7b4 tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:48:32.334885 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0f98a86a-b099-4652-b367-5b4b04a5f7b4 tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:48:32.335377 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0f98a86a-b099-4652-b367-5b4b04a5f7b4 tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:48:32.335809 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0f98a86a-b099-4652-b367-5b4b04a5f7b4 tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:48:32.536975 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-1705503e-1071-4e8c-bbc5-7e8633bf0db2 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:48:32.537595 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-1705503e-1071-4e8c-bbc5-7e8633bf0db2 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] [instance: f592a6fe-8cc7-4bb1-bb04-f8ddd358eeca] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:48:32.552308 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1705503e-1071-4e8c-bbc5-7e8633bf0db2 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:48:32.558643 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1705503e-1071-4e8c-bbc5-7e8633bf0db2 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:48:32.560544 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1705503e-1071-4e8c-bbc5-7e8633bf0db2 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:48:32.564392 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1705503e-1071-4e8c-bbc5-7e8633bf0db2 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:48:32.566434 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1705503e-1071-4e8c-bbc5-7e8633bf0db2 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:48:32.569751 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1705503e-1071-4e8c-bbc5-7e8633bf0db2 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:48:32.622961 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-0f98a86a-b099-4652-b367-5b4b04a5f7b4 tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6de80d628cf14694af6d2cd16f16afad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae95f5dee52f4235b3478cc90f3b0347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:48:32.636930 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-0f98a86a-b099-4652-b367-5b4b04a5f7b4 tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] 10.222.0.18 "GET /compute/v2.1/servers/e169b57b-4899-4a9e-80a9-d6290eb63ceb" status: 200 len: 1338 microversion: 2.1 time: 0.317177 Oct 22 20:48:32.656162 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 37/99] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:48:32 2022] GET /compute/v2.1/servers/e169b57b-4899-4a9e-80a9-d6290eb63ceb => generated 1338 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:48:32.657391 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-0f98a86a-b099-4652-b367-5b4b04a5f7b4 tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:48:32.667617 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-0f98a86a-b099-4652-b367-5b4b04a5f7b4 tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] 10.222.0.18 "GET /compute//" status: 200 len: 377 microversion: - time: 0.007992 Oct 22 20:48:32.670419 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 38/100] 10.222.0.18 () {56 vars in 886 bytes} [Sat Oct 22 20:48:32 2022] GET /compute/ => generated 377 bytes in 13 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 22 20:48:32.915595 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-1705503e-1071-4e8c-bbc5-7e8633bf0db2 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e13dcabaaa4b218945aeeabb4c902e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675a324f0134844a1964f64322493ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:48:32.930563 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-1705503e-1071-4e8c-bbc5-7e8633bf0db2 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] 10.222.0.18 "GET /compute/v2.1/servers/f592a6fe-8cc7-4bb1-bb04-f8ddd358eeca" status: 200 len: 1319 microversion: 2.1 time: 0.397337 Oct 22 20:48:32.951075 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 63/101] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:48:32 2022] GET /compute/v2.1/servers/f592a6fe-8cc7-4bb1-bb04-f8ddd358eeca => generated 1319 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:48:33.669952 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-1a4086ed-15b5-4119-9eb7-471e95efec76 tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:48:33.670646 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-1a4086ed-15b5-4119-9eb7-471e95efec76 tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] [instance: e169b57b-4899-4a9e-80a9-d6290eb63ceb] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:48:33.690104 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1a4086ed-15b5-4119-9eb7-471e95efec76 tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:48:33.694231 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1a4086ed-15b5-4119-9eb7-471e95efec76 tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:48:33.694798 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1a4086ed-15b5-4119-9eb7-471e95efec76 tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:48:33.699312 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1a4086ed-15b5-4119-9eb7-471e95efec76 tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:48:33.703630 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1a4086ed-15b5-4119-9eb7-471e95efec76 tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:48:33.705725 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1a4086ed-15b5-4119-9eb7-471e95efec76 tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:48:33.934450 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-96d6123c-4f31-49b8-b45c-c3ed8c564b1a tempest-HypervisorAdminUnderV252Test-1890332784 tempest-HypervisorAdminUnderV252Test-1890332784-project-admin] Calling method '.version_select at 0x7fd3a4fb8700>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:48:33.964766 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-96d6123c-4f31-49b8-b45c-c3ed8c564b1a tempest-HypervisorAdminUnderV252Test-1890332784 tempest-HypervisorAdminUnderV252Test-1890332784-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),5972cb63-1ab7-4825-b0ae-86c7acab764c(cell1) {{(pid=138744) load_cells /opt/stack/nova/nova/compute/api.py:319}} Oct 22 20:48:33.965758 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-96d6123c-4f31-49b8-b45c-c3ed8c564b1a tempest-HypervisorAdminUnderV252Test-1890332784 tempest-HypervisorAdminUnderV252Test-1890332784-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:48:33.973272 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-96d6123c-4f31-49b8-b45c-c3ed8c564b1a tempest-HypervisorAdminUnderV252Test-1890332784 tempest-HypervisorAdminUnderV252Test-1890332784-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:48:33.974536 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-96d6123c-4f31-49b8-b45c-c3ed8c564b1a tempest-HypervisorAdminUnderV252Test-1890332784 tempest-HypervisorAdminUnderV252Test-1890332784-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:48:34.460986 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-96d6123c-4f31-49b8-b45c-c3ed8c564b1a tempest-HypervisorAdminUnderV252Test-1890332784 tempest-HypervisorAdminUnderV252Test-1890332784-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:48:34.461494 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-96d6123c-4f31-49b8-b45c-c3ed8c564b1a tempest-HypervisorAdminUnderV252Test-1890332784 tempest-HypervisorAdminUnderV252Test-1890332784-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:48:34.461941 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-96d6123c-4f31-49b8-b45c-c3ed8c564b1a tempest-HypervisorAdminUnderV252Test-1890332784 tempest-HypervisorAdminUnderV252Test-1890332784-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:48:34.493292 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-96d6123c-4f31-49b8-b45c-c3ed8c564b1a tempest-HypervisorAdminUnderV252Test-1890332784 tempest-HypervisorAdminUnderV252Test-1890332784-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:48:34.494002 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-96d6123c-4f31-49b8-b45c-c3ed8c564b1a tempest-HypervisorAdminUnderV252Test-1890332784 tempest-HypervisorAdminUnderV252Test-1890332784-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:48:34.494631 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-96d6123c-4f31-49b8-b45c-c3ed8c564b1a tempest-HypervisorAdminUnderV252Test-1890332784 tempest-HypervisorAdminUnderV252Test-1890332784-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:48:34.504157 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-96d6123c-4f31-49b8-b45c-c3ed8c564b1a tempest-HypervisorAdminUnderV252Test-1890332784 tempest-HypervisorAdminUnderV252Test-1890332784-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 1.422923 Oct 22 20:48:34.505207 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 39/102] 10.222.0.18 () {58 vars in 1146 bytes} [Sat Oct 22 20:48:33 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 1426 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:48:34.525391 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-4ab390a5-a2ef-4b2c-a877-d91b8bf6511b tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:48:34.526220 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-4ab390a5-a2ef-4b2c-a877-d91b8bf6511b tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] [instance: f592a6fe-8cc7-4bb1-bb04-f8ddd358eeca] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:48:34.535736 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4ab390a5-a2ef-4b2c-a877-d91b8bf6511b tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:48:34.537063 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4ab390a5-a2ef-4b2c-a877-d91b8bf6511b tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:48:34.537718 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4ab390a5-a2ef-4b2c-a877-d91b8bf6511b tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:48:34.538757 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4ab390a5-a2ef-4b2c-a877-d91b8bf6511b tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:48:34.539322 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4ab390a5-a2ef-4b2c-a877-d91b8bf6511b tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:48:34.539865 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4ab390a5-a2ef-4b2c-a877-d91b8bf6511b tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:48:35.115542 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-1a4086ed-15b5-4119-9eb7-471e95efec76 tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6de80d628cf14694af6d2cd16f16afad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae95f5dee52f4235b3478cc90f3b0347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:48:35.139767 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-1a4086ed-15b5-4119-9eb7-471e95efec76 tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] 10.222.0.18 "GET /compute/v2.1/servers/e169b57b-4899-4a9e-80a9-d6290eb63ceb" status: 200 len: 1338 microversion: 2.1 time: 1.475168 Oct 22 20:48:35.159121 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 64/103] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:48:33 2022] GET /compute/v2.1/servers/e169b57b-4899-4a9e-80a9-d6290eb63ceb => generated 1338 bytes in 1487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:48:35.164967 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-80f93d66-d936-423e-9b73-85d8e6704be5 tempest-HypervisorAdminUnderV252Test-1890332784 tempest-HypervisorAdminUnderV252Test-1890332784-project-admin] Calling method '.version_select at 0x7fd3a50ad0d0>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:48:35.168029 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-80f93d66-d936-423e-9b73-85d8e6704be5 tempest-HypervisorAdminUnderV252Test-1890332784 tempest-HypervisorAdminUnderV252Test-1890332784-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:48:35.169034 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-80f93d66-d936-423e-9b73-85d8e6704be5 tempest-HypervisorAdminUnderV252Test-1890332784 tempest-HypervisorAdminUnderV252Test-1890332784-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:48:35.169908 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-80f93d66-d936-423e-9b73-85d8e6704be5 tempest-HypervisorAdminUnderV252Test-1890332784 tempest-HypervisorAdminUnderV252Test-1890332784-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:48:35.201260 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-80f93d66-d936-423e-9b73-85d8e6704be5 tempest-HypervisorAdminUnderV252Test-1890332784 tempest-HypervisorAdminUnderV252Test-1890332784-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:48:35.202622 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-80f93d66-d936-423e-9b73-85d8e6704be5 tempest-HypervisorAdminUnderV252Test-1890332784 tempest-HypervisorAdminUnderV252Test-1890332784-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:48:35.203416 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-80f93d66-d936-423e-9b73-85d8e6704be5 tempest-HypervisorAdminUnderV252Test-1890332784 tempest-HypervisorAdminUnderV252Test-1890332784-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:48:35.271785 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-80f93d66-d936-423e-9b73-85d8e6704be5 tempest-HypervisorAdminUnderV252Test-1890332784 tempest-HypervisorAdminUnderV252Test-1890332784-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:48:35.275423 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-80f93d66-d936-423e-9b73-85d8e6704be5 tempest-HypervisorAdminUnderV252Test-1890332784 tempest-HypervisorAdminUnderV252Test-1890332784-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:48:35.276323 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-80f93d66-d936-423e-9b73-85d8e6704be5 tempest-HypervisorAdminUnderV252Test-1890332784 tempest-HypervisorAdminUnderV252Test-1890332784-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:48:35.299104 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-80f93d66-d936-423e-9b73-85d8e6704be5 tempest-HypervisorAdminUnderV252Test-1890332784 tempest-HypervisorAdminUnderV252Test-1890332784-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hypervisors/nch2-master-1/servers" status: 200 len: 196 microversion: 2.1 time: 0.146128 Oct 22 20:48:35.301596 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 65/104] 10.222.0.18 () {58 vars in 1212 bytes} [Sat Oct 22 20:48:35 2022] GET /compute/v2.1/os-hypervisors/nch2-master-1/servers => generated 196 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:48:35.370593 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-4ab390a5-a2ef-4b2c-a877-d91b8bf6511b tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e13dcabaaa4b218945aeeabb4c902e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675a324f0134844a1964f64322493ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:48:35.384475 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-4ab390a5-a2ef-4b2c-a877-d91b8bf6511b tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] 10.222.0.18 "GET /compute/v2.1/servers/f592a6fe-8cc7-4bb1-bb04-f8ddd358eeca" status: 200 len: 1319 microversion: 2.1 time: 0.877927 Oct 22 20:48:35.392810 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 40/105] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:48:34 2022] GET /compute/v2.1/servers/f592a6fe-8cc7-4bb1-bb04-f8ddd358eeca => generated 1319 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:48:35.400205 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-f8dc5c42-0994-4b64-9a7d-9c3da5046af8 tempest-HypervisorAdminUnderV252Test-1890332784 tempest-HypervisorAdminUnderV252Test-1890332784-project-admin] Calling method '.version_select at 0x7fd3a50095e0>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:48:35.402235 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f8dc5c42-0994-4b64-9a7d-9c3da5046af8 tempest-HypervisorAdminUnderV252Test-1890332784 tempest-HypervisorAdminUnderV252Test-1890332784-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:48:35.402871 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f8dc5c42-0994-4b64-9a7d-9c3da5046af8 tempest-HypervisorAdminUnderV252Test-1890332784 tempest-HypervisorAdminUnderV252Test-1890332784-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:48:35.403367 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f8dc5c42-0994-4b64-9a7d-9c3da5046af8 tempest-HypervisorAdminUnderV252Test-1890332784 tempest-HypervisorAdminUnderV252Test-1890332784-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:48:35.450425 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f8dc5c42-0994-4b64-9a7d-9c3da5046af8 tempest-HypervisorAdminUnderV252Test-1890332784 tempest-HypervisorAdminUnderV252Test-1890332784-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:48:35.451719 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f8dc5c42-0994-4b64-9a7d-9c3da5046af8 tempest-HypervisorAdminUnderV252Test-1890332784 tempest-HypervisorAdminUnderV252Test-1890332784-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:48:35.452366 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f8dc5c42-0994-4b64-9a7d-9c3da5046af8 tempest-HypervisorAdminUnderV252Test-1890332784 tempest-HypervisorAdminUnderV252Test-1890332784-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:48:35.487761 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f8dc5c42-0994-4b64-9a7d-9c3da5046af8 tempest-HypervisorAdminUnderV252Test-1890332784 tempest-HypervisorAdminUnderV252Test-1890332784-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:48:35.488477 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f8dc5c42-0994-4b64-9a7d-9c3da5046af8 tempest-HypervisorAdminUnderV252Test-1890332784 tempest-HypervisorAdminUnderV252Test-1890332784-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:48:35.488923 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f8dc5c42-0994-4b64-9a7d-9c3da5046af8 tempest-HypervisorAdminUnderV252Test-1890332784 tempest-HypervisorAdminUnderV252Test-1890332784-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:48:35.506778 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-f8dc5c42-0994-4b64-9a7d-9c3da5046af8 tempest-HypervisorAdminUnderV252Test-1890332784 tempest-HypervisorAdminUnderV252Test-1890332784-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.112342 Oct 22 20:48:35.507748 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 41/106] 10.222.0.18 () {58 vars in 1146 bytes} [Sat Oct 22 20:48:35 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:48:35.519387 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-6b5c5756-af35-477a-bcdb-50afe8a1fe36 tempest-HypervisorAdminUnderV252Test-1890332784 tempest-HypervisorAdminUnderV252Test-1890332784-project-admin] Calling method '.version_select at 0x7fd3a50098b0>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:48:35.521578 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6b5c5756-af35-477a-bcdb-50afe8a1fe36 tempest-HypervisorAdminUnderV252Test-1890332784 tempest-HypervisorAdminUnderV252Test-1890332784-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:48:35.523072 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6b5c5756-af35-477a-bcdb-50afe8a1fe36 tempest-HypervisorAdminUnderV252Test-1890332784 tempest-HypervisorAdminUnderV252Test-1890332784-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:48:35.523792 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6b5c5756-af35-477a-bcdb-50afe8a1fe36 tempest-HypervisorAdminUnderV252Test-1890332784 tempest-HypervisorAdminUnderV252Test-1890332784-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:48:35.562638 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6b5c5756-af35-477a-bcdb-50afe8a1fe36 tempest-HypervisorAdminUnderV252Test-1890332784 tempest-HypervisorAdminUnderV252Test-1890332784-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:48:35.568005 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6b5c5756-af35-477a-bcdb-50afe8a1fe36 tempest-HypervisorAdminUnderV252Test-1890332784 tempest-HypervisorAdminUnderV252Test-1890332784-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:48:35.568810 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6b5c5756-af35-477a-bcdb-50afe8a1fe36 tempest-HypervisorAdminUnderV252Test-1890332784 tempest-HypervisorAdminUnderV252Test-1890332784-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:48:35.583825 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-6b5c5756-af35-477a-bcdb-50afe8a1fe36 tempest-HypervisorAdminUnderV252Test-1890332784 tempest-HypervisorAdminUnderV252Test-1890332784-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hypervisors/nch2-master-1/search" status: 200 len: 104 microversion: 2.1 time: 0.068842 Oct 22 20:48:35.587877 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 42/107] 10.222.0.18 () {58 vars in 1209 bytes} [Sat Oct 22 20:48:35 2022] GET /compute/v2.1/os-hypervisors/nch2-master-1/search => generated 104 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:48:36.178162 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-9a0cb0a7-22d4-4a26-982c-e2e03a10d6e4 tempest-QuotasAdminTestV236-254240257 tempest-QuotasAdminTestV236-254240257-project-admin] Action: 'update', calling method: .version_select at 0x7fd3a50ad670>, body: {"quota_set": {"ram": "5120"}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:48:36.442875 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-67cf4743-34ad-4442-bdd5-21e5ce34239e req-feec8ada-fe35-4e87-b61a-8cf9acb73cf2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e169b57b-4899-4a9e-80a9-d6290eb63ceb", "tag": "02de842c-17fc-4e5f-baff-e53cc52aeb55"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:48:36.461150 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-67cf4743-34ad-4442-bdd5-21e5ce34239e req-feec8ada-fe35-4e87-b61a-8cf9acb73cf2 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:48:36.461866 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-67cf4743-34ad-4442-bdd5-21e5ce34239e req-feec8ada-fe35-4e87-b61a-8cf9acb73cf2 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:48:36.462900 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-67cf4743-34ad-4442-bdd5-21e5ce34239e req-feec8ada-fe35-4e87-b61a-8cf9acb73cf2 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:48:36.492481 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-67cf4743-34ad-4442-bdd5-21e5ce34239e req-feec8ada-fe35-4e87-b61a-8cf9acb73cf2 service nova] Creating event network-changed:02de842c-17fc-4e5f-baff-e53cc52aeb55 for instance e169b57b-4899-4a9e-80a9-d6290eb63ceb on nch2-master-1 Oct 22 20:48:36.494783 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-67cf4743-34ad-4442-bdd5-21e5ce34239e req-feec8ada-fe35-4e87-b61a-8cf9acb73cf2 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=138744) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 22 20:48:36.496437 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-67cf4743-34ad-4442-bdd5-21e5ce34239e req-feec8ada-fe35-4e87-b61a-8cf9acb73cf2 service nova] Acquired lock "compute-rpcapi-router" {{(pid=138744) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 22 20:48:36.498623 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-00fffe4e-c2c0-4e42-a131-b9a5c48f9bad None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:48:36.513922 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-00fffe4e-c2c0-4e42-a131-b9a5c48f9bad None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:48:36.517923 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-00fffe4e-c2c0-4e42-a131-b9a5c48f9bad None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:48:36.525538 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-00fffe4e-c2c0-4e42-a131-b9a5c48f9bad None None] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:48:36.528233 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-00fffe4e-c2c0-4e42-a131-b9a5c48f9bad None None] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:48:36.532919 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-00fffe4e-c2c0-4e42-a131-b9a5c48f9bad None None] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:48:36.564782 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.compute.rpcapi [None req-00fffe4e-c2c0-4e42-a131-b9a5c48f9bad None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 22 20:48:36.565818 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-00fffe4e-c2c0-4e42-a131-b9a5c48f9bad None None] Releasing lock "compute-rpcapi-router" {{(pid=138744) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 22 20:48:36.608385 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-00fffe4e-c2c0-4e42-a131-b9a5c48f9bad None None] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.652627 Oct 22 20:48:36.612065 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 43/108] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:48:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 20:48:36.649845 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-078d901c-dd61-4a04-b3db-5bc9db44ea0f tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:48:36.652676 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-078d901c-dd61-4a04-b3db-5bc9db44ea0f tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] [instance: e169b57b-4899-4a9e-80a9-d6290eb63ceb] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:48:36.668859 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-078d901c-dd61-4a04-b3db-5bc9db44ea0f tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:48:36.672883 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-078d901c-dd61-4a04-b3db-5bc9db44ea0f tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:48:36.673618 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-078d901c-dd61-4a04-b3db-5bc9db44ea0f tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:48:36.676604 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-078d901c-dd61-4a04-b3db-5bc9db44ea0f tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:48:36.677288 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-078d901c-dd61-4a04-b3db-5bc9db44ea0f tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:48:36.679778 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-078d901c-dd61-4a04-b3db-5bc9db44ea0f tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:48:37.048532 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-078d901c-dd61-4a04-b3db-5bc9db44ea0f tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6de80d628cf14694af6d2cd16f16afad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae95f5dee52f4235b3478cc90f3b0347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:48:37.081016 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-078d901c-dd61-4a04-b3db-5bc9db44ea0f tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] 10.222.0.18 "GET /compute/v2.1/servers/e169b57b-4899-4a9e-80a9-d6290eb63ceb" status: 200 len: 1338 microversion: 2.1 time: 0.466833 Oct 22 20:48:37.085029 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 44/109] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:48:36 2022] GET /compute/v2.1/servers/e169b57b-4899-4a9e-80a9-d6290eb63ceb => generated 1338 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:48:37.093826 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-b5c244c7-4638-497e-ad43-1fc4ecd96984 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:48:37.106764 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-b5c244c7-4638-497e-ad43-1fc4ecd96984 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] [instance: f592a6fe-8cc7-4bb1-bb04-f8ddd358eeca] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:48:37.109850 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9a0cb0a7-22d4-4a26-982c-e2e03a10d6e4 tempest-QuotasAdminTestV236-254240257 tempest-QuotasAdminTestV236-254240257-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:48:37.110436 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9a0cb0a7-22d4-4a26-982c-e2e03a10d6e4 tempest-QuotasAdminTestV236-254240257 tempest-QuotasAdminTestV236-254240257-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:48:37.110945 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9a0cb0a7-22d4-4a26-982c-e2e03a10d6e4 tempest-QuotasAdminTestV236-254240257 tempest-QuotasAdminTestV236-254240257-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:48:37.115841 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9a0cb0a7-22d4-4a26-982c-e2e03a10d6e4 tempest-QuotasAdminTestV236-254240257 tempest-QuotasAdminTestV236-254240257-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:48:37.116523 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9a0cb0a7-22d4-4a26-982c-e2e03a10d6e4 tempest-QuotasAdminTestV236-254240257 tempest-QuotasAdminTestV236-254240257-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:48:37.117143 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9a0cb0a7-22d4-4a26-982c-e2e03a10d6e4 tempest-QuotasAdminTestV236-254240257 tempest-QuotasAdminTestV236-254240257-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:48:37.126960 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b5c244c7-4638-497e-ad43-1fc4ecd96984 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:48:37.127501 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b5c244c7-4638-497e-ad43-1fc4ecd96984 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:48:37.127939 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b5c244c7-4638-497e-ad43-1fc4ecd96984 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:48:37.128707 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b5c244c7-4638-497e-ad43-1fc4ecd96984 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:48:37.129165 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b5c244c7-4638-497e-ad43-1fc4ecd96984 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:48:37.129590 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b5c244c7-4638-497e-ad43-1fc4ecd96984 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:48:37.312274 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell0:SELECT=14 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:48:37.321459 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-9a0cb0a7-22d4-4a26-982c-e2e03a10d6e4 tempest-QuotasAdminTestV236-254240257 tempest-QuotasAdminTestV236-254240257-project-admin] 10.222.0.18 "PUT /compute/v2.1/os-quota-sets/67376327e3c24b7d87abd13cece840bc" status: 200 len: 240 microversion: 2.36 time: 2.018516 Oct 22 20:48:37.338386 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 66/110] 10.222.0.18 () {62 vars in 1303 bytes} [Sat Oct 22 20:48:35 2022] PUT /compute/v2.1/os-quota-sets/67376327e3c24b7d87abd13cece840bc => generated 240 bytes in 2034 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 22 20:48:37.688348 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-b5c244c7-4638-497e-ad43-1fc4ecd96984 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e13dcabaaa4b218945aeeabb4c902e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675a324f0134844a1964f64322493ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:48:37.698865 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-b5c244c7-4638-497e-ad43-1fc4ecd96984 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] 10.222.0.18 "GET /compute/v2.1/servers/f592a6fe-8cc7-4bb1-bb04-f8ddd358eeca" status: 200 len: 1319 microversion: 2.1 time: 0.608781 Oct 22 20:48:37.720979 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 45/111] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:48:37 2022] GET /compute/v2.1/servers/f592a6fe-8cc7-4bb1-bb04-f8ddd358eeca => generated 1319 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:48:37.734036 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-fbe31a00-fc6d-4908-8850-0fe8f9671dc3 tempest-QuotasAdminTestV236-254240257 tempest-QuotasAdminTestV236-254240257-project-admin] Calling method '.version_select at 0x7fd3a5009dc0>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:48:37.763604 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-15f152b1-f56b-43c7-8f78-ad585144c489 req-1889db61-8a2e-4703-a761-52a3aa6fbe41 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f592a6fe-8cc7-4bb1-bb04-f8ddd358eeca", "tag": "a1417ffd-e3b2-4e5f-8fb0-0c90bf22df37"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:48:37.804167 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-15f152b1-f56b-43c7-8f78-ad585144c489 req-1889db61-8a2e-4703-a761-52a3aa6fbe41 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:48:37.805889 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-15f152b1-f56b-43c7-8f78-ad585144c489 req-1889db61-8a2e-4703-a761-52a3aa6fbe41 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:48:37.806481 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-15f152b1-f56b-43c7-8f78-ad585144c489 req-1889db61-8a2e-4703-a761-52a3aa6fbe41 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:48:37.870083 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-15f152b1-f56b-43c7-8f78-ad585144c489 req-1889db61-8a2e-4703-a761-52a3aa6fbe41 service nova] Creating event network-changed:a1417ffd-e3b2-4e5f-8fb0-0c90bf22df37 for instance f592a6fe-8cc7-4bb1-bb04-f8ddd358eeca on nch1-master-1 Oct 22 20:48:37.873503 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-15f152b1-f56b-43c7-8f78-ad585144c489 req-1889db61-8a2e-4703-a761-52a3aa6fbe41 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=138745) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 22 20:48:37.874159 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-15f152b1-f56b-43c7-8f78-ad585144c489 req-1889db61-8a2e-4703-a761-52a3aa6fbe41 service nova] Acquired lock "compute-rpcapi-router" {{(pid=138745) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 22 20:48:37.877436 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-08866b95-06a9-4ebc-ae32-15f976b7014e None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:48:37.878474 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-08866b95-06a9-4ebc-ae32-15f976b7014e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:48:37.879601 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-08866b95-06a9-4ebc-ae32-15f976b7014e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:48:37.881978 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-08866b95-06a9-4ebc-ae32-15f976b7014e None None] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:48:37.883894 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-08866b95-06a9-4ebc-ae32-15f976b7014e None None] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:48:37.884477 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-08866b95-06a9-4ebc-ae32-15f976b7014e None None] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:48:37.910156 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.compute.rpcapi [None req-08866b95-06a9-4ebc-ae32-15f976b7014e None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 22 20:48:37.913016 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-08866b95-06a9-4ebc-ae32-15f976b7014e None None] Releasing lock "compute-rpcapi-router" {{(pid=138745) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 22 20:48:37.951501 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-08866b95-06a9-4ebc-ae32-15f976b7014e None None] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.610002 Oct 22 20:48:37.954454 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 67/112] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:48:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:48:38.024413 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_api:SELECT=84,nova_api:DELETE=10,nova_api:INSERT=6 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:48:38.034754 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fbe31a00-fc6d-4908-8850-0fe8f9671dc3 tempest-QuotasAdminTestV236-254240257 tempest-QuotasAdminTestV236-254240257-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:48:38.035989 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fbe31a00-fc6d-4908-8850-0fe8f9671dc3 tempest-QuotasAdminTestV236-254240257 tempest-QuotasAdminTestV236-254240257-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:48:38.036704 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fbe31a00-fc6d-4908-8850-0fe8f9671dc3 tempest-QuotasAdminTestV236-254240257 tempest-QuotasAdminTestV236-254240257-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:48:38.037651 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fbe31a00-fc6d-4908-8850-0fe8f9671dc3 tempest-QuotasAdminTestV236-254240257 tempest-QuotasAdminTestV236-254240257-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:48:38.038444 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fbe31a00-fc6d-4908-8850-0fe8f9671dc3 tempest-QuotasAdminTestV236-254240257 tempest-QuotasAdminTestV236-254240257-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:48:38.039404 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fbe31a00-fc6d-4908-8850-0fe8f9671dc3 tempest-QuotasAdminTestV236-254240257 tempest-QuotasAdminTestV236-254240257-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:48:38.071694 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-fbe31a00-fc6d-4908-8850-0fe8f9671dc3 tempest-QuotasAdminTestV236-254240257 tempest-QuotasAdminTestV236-254240257-project-admin] 10.222.0.18 "GET /compute/v2.1/os-quota-sets/67376327e3c24b7d87abd13cece840bc/detail" status: 200 len: 672 microversion: 2.36 time: 0.349046 Oct 22 20:48:38.072745 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 46/113] 10.222.0.18 () {60 vars in 1304 bytes} [Sat Oct 22 20:48:37 2022] GET /compute/v2.1/os-quota-sets/67376327e3c24b7d87abd13cece840bc/detail => generated 672 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 22 20:48:38.088118 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-0b6721b3-e484-4be1-a5a4-0e4f8f673e7b tempest-FlavorsExtraSpecsNegativeTestJSON-1299769607 tempest-FlavorsExtraSpecsNegativeTestJSON-1299769607-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-109005316", "ram": 512, "vcpus": 1, "disk": 10, "id": 1140105472, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:48:38.111634 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-62bbb4e5-4502-4bee-b9f7-01422b4a7275 tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:48:38.112668 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-62bbb4e5-4502-4bee-b9f7-01422b4a7275 tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] [instance: e169b57b-4899-4a9e-80a9-d6290eb63ceb] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:48:38.121063 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-62bbb4e5-4502-4bee-b9f7-01422b4a7275 tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:48:38.121791 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-0b6721b3-e484-4be1-a5a4-0e4f8f673e7b tempest-FlavorsExtraSpecsNegativeTestJSON-1299769607 tempest-FlavorsExtraSpecsNegativeTestJSON-1299769607-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 415 microversion: 2.1 time: 0.165401 Oct 22 20:48:38.122287 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-62bbb4e5-4502-4bee-b9f7-01422b4a7275 tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:48:38.123359 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-62bbb4e5-4502-4bee-b9f7-01422b4a7275 tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:48:38.124296 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-62bbb4e5-4502-4bee-b9f7-01422b4a7275 tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:48:38.125183 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-62bbb4e5-4502-4bee-b9f7-01422b4a7275 tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:48:38.125860 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-62bbb4e5-4502-4bee-b9f7-01422b4a7275 tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:48:38.127039 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 68/114] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Oct 22 20:48:37 2022] POST /compute/v2.1/flavors => generated 415 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:48:38.360054 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-66cc6cf9-1bfd-4407-b65c-96349f043a13 tempest-FlavorsExtraSpecsNegativeTestJSON-1425648891 tempest-FlavorsExtraSpecsNegativeTestJSON-1425648891-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:48:38.374068 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.wsgi [None req-66cc6cf9-1bfd-4407-b65c-96349f043a13 tempest-FlavorsExtraSpecsNegativeTestJSON-1425648891 tempest-FlavorsExtraSpecsNegativeTestJSON-1425648891-project] HTTP exception thrown: Flavor 1140105472 has no extra specs with key hw:cpu_thread_policy. Oct 22 20:48:38.376229 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-66cc6cf9-1bfd-4407-b65c-96349f043a13 tempest-FlavorsExtraSpecsNegativeTestJSON-1425648891 tempest-FlavorsExtraSpecsNegativeTestJSON-1425648891-project] Request method failure captured: Oct 22 20:48:38.376229 ncdv-master-1 devstack@n-api.service[138745]: request: GET /compute/v2.1/flavors/1140105472/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Oct 22 20:48:38.376229 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 20:48:38.376229 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 20:48:38.376229 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 20:48:38.376229 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 0 Oct 22 20:48:38.376229 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 20:48:38.376229 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 20:48:38.376229 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 20:48:38.376229 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 20:48:38.376229 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVFciVSkQKAF5Yz12tqLuYe09tbpK0VTnIMWiAA3fHIBG3e7UFLz0Fe0Hsia9wrguoeVhql-hu4FFRha9AmnIzHzbO7FHLCQU23I46bMcJkBC99a4EZtzaQLilMb5PQTSv3X_k0zbk9YGe9YHlQKO7t54cmRj5uW163tv16YAIA7RAM0 Oct 22 20:48:38.376229 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 20:48:38.376229 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 20:48:38.376229 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 20:48:38.376229 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 20:48:38.376229 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 20:48:38.376229 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 20:48:38.376229 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: ed507c2ddb8a4a74bef788b2fcc47b4f Oct 22 20:48:38.376229 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1425648891 Oct 22 20:48:38.376229 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 20:48:38.376229 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 20:48:38.377494 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ed507c2ddb8a4a74bef788b2fcc47b4f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ed507c2ddb8a4a74bef788b2fcc47b4f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ed507c2ddb8a4a74bef788b2fcc47b4f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ed507c2ddb8a4a74bef788b2fcc47b4f"}]}] Oct 22 20:48:38.377494 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1425648891 Oct 22 20:48:38.377494 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: ed507c2ddb8a4a74bef788b2fcc47b4f Oct 22 20:48:38.377494 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1425648891 Oct 22 20:48:38.377494 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1425648891-project Oct 22 20:48:38.377494 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 20:48:38.377494 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 20:48:38.377494 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: 9fbe586cd59d40389e6bd3e57ed6f1ac Oct 22 20:48:38.377494 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1425648891-project Oct 22 20:48:38.377494 ncdv-master-1 devstack@n-api.service[138745]: method: > Oct 22 20:48:38.377494 ncdv-master-1 devstack@n-api.service[138745]: exception: Flavor 1140105472 has no extra specs with key hw:cpu_thread_policy. Oct 22 20:48:38.378335 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'flavor_id': '1140105472', 'id': 'hw:cpu_thread_policy'} Oct 22 20:48:38.378335 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:48:38.378335 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:48:38.378335 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 115, in show Oct 22 20:48:38.378335 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return {id: flavor.extra_specs[id]} Oct 22 20:48:38.378335 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Oct 22 20:48:38.378335 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:48:38.378335 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:48:38.378335 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:48:38.378335 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:48:38.378335 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:48:38.378335 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:48:38.378335 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:48:38.378335 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:48:38.378335 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:48:38.378335 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:48:38.378335 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 120, in show Oct 22 20:48:38.378335 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 22 20:48:38.378335 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 1140105472 has no extra specs with key hw:cpu_thread_policy. Oct 22 20:48:38.378335 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:48:38.378335 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:48:38.378335 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:48:38.380272 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:48:38.380272 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:48:38.380272 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:48:38.380272 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 20:48:38.380272 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 20:48:38.380272 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1140105472 has no extra specs with key hw:cpu_thread_policy. Oct 22 20:48:38.380272 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:48:38.386903 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-66cc6cf9-1bfd-4407-b65c-96349f043a13 tempest-FlavorsExtraSpecsNegativeTestJSON-1425648891 tempest-FlavorsExtraSpecsNegativeTestJSON-1425648891-project] Returning 404 to user: Flavor 1140105472 has no extra specs with key hw:cpu_thread_policy. {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:48:38.388029 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-66cc6cf9-1bfd-4407-b65c-96349f043a13 tempest-FlavorsExtraSpecsNegativeTestJSON-1425648891 tempest-FlavorsExtraSpecsNegativeTestJSON-1425648891-project] 10.222.0.18 "GET /compute/v2.1/flavors/1140105472/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.252240 Oct 22 20:48:38.389100 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 69/115] 10.222.0.18 () {58 vars in 1266 bytes} [Sat Oct 22 20:48:38 2022] GET /compute/v2.1/flavors/1140105472/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 254 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 20:48:38.397860 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-539fc22b-b061-4845-ad74-47db27e34cdc tempest-QuotasAdminTestV236-254240257 tempest-QuotasAdminTestV236-254240257-project-admin] Action: 'update', calling method: .version_select at 0x7fd3a6390670>, body: {"quota_set": {"ram": "2048"}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:48:38.439392 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-62bbb4e5-4502-4bee-b9f7-01422b4a7275 tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6de80d628cf14694af6d2cd16f16afad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae95f5dee52f4235b3478cc90f3b0347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:48:38.458837 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-62bbb4e5-4502-4bee-b9f7-01422b4a7275 tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] 10.222.0.18 "GET /compute/v2.1/servers/e169b57b-4899-4a9e-80a9-d6290eb63ceb" status: 200 len: 1338 microversion: 2.1 time: 0.353217 Oct 22 20:48:38.472389 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 47/116] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:48:38 2022] GET /compute/v2.1/servers/e169b57b-4899-4a9e-80a9-d6290eb63ceb => generated 1338 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:48:38.484405 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-d000e23f-40ca-4049-9f13-9cb5f24bf563 tempest-FlavorsExtraSpecsNegativeTestJSON-1425648891 tempest-FlavorsExtraSpecsNegativeTestJSON-1425648891-project] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:48:38.490076 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-d000e23f-40ca-4049-9f13-9cb5f24bf563 tempest-FlavorsExtraSpecsNegativeTestJSON-1425648891 tempest-FlavorsExtraSpecsNegativeTestJSON-1425648891-project] Policy check for os_compute_api:os-flavor-extra-specs:create failed with credentials {'is_admin': False, 'user_id': '9fbe586cd59d40389e6bd3e57ed6f1ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed507c2ddb8a4a74bef788b2fcc47b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:48:38.497145 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-d000e23f-40ca-4049-9f13-9cb5f24bf563 tempest-FlavorsExtraSpecsNegativeTestJSON-1425648891 tempest-FlavorsExtraSpecsNegativeTestJSON-1425648891-project] Request method failure captured: Oct 22 20:48:38.497145 ncdv-master-1 devstack@n-api.service[138744]: request: POST /compute/v2.1/flavors/1140105472/os-extra_specs HTTP/1.1 Oct 22 20:48:38.497145 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 20:48:38.497145 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 20:48:38.497145 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 20:48:38.497145 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 66 Oct 22 20:48:38.497145 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 20:48:38.497145 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 20:48:38.497145 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 20:48:38.497145 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 20:48:38.497145 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVFciVSkQKAF5Yz12tqLuYe09tbpK0VTnIMWiAA3fHIBG3e7UFLz0Fe0Hsia9wrguoeVhql-hu4FFRha9AmnIzHzbO7FHLCQU23I46bMcJkBC99a4EZtzaQLilMb5PQTSv3X_k0zbk9YGe9YHlQKO7t54cmRj5uW163tv16YAIA7RAM0 Oct 22 20:48:38.497145 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 20:48:38.497145 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 20:48:38.497145 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 20:48:38.497145 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 20:48:38.497145 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 20:48:38.497145 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 20:48:38.497145 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: ed507c2ddb8a4a74bef788b2fcc47b4f Oct 22 20:48:38.497145 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1425648891 Oct 22 20:48:38.497145 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 20:48:38.497145 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 20:48:38.498542 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ed507c2ddb8a4a74bef788b2fcc47b4f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ed507c2ddb8a4a74bef788b2fcc47b4f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ed507c2ddb8a4a74bef788b2fcc47b4f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ed507c2ddb8a4a74bef788b2fcc47b4f"}]}] Oct 22 20:48:38.498542 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1425648891 Oct 22 20:48:38.498542 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: ed507c2ddb8a4a74bef788b2fcc47b4f Oct 22 20:48:38.498542 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1425648891 Oct 22 20:48:38.498542 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1425648891-project Oct 22 20:48:38.498542 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 20:48:38.498542 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 20:48:38.498542 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: 9fbe586cd59d40389e6bd3e57ed6f1ac Oct 22 20:48:38.498542 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1425648891-project Oct 22 20:48:38.498542 ncdv-master-1 devstack@n-api.service[138744]: Oct 22 20:48:38.498542 ncdv-master-1 devstack@n-api.service[138744]: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} Oct 22 20:48:38.498542 ncdv-master-1 devstack@n-api.service[138744]: method: > Oct 22 20:48:38.499259 ncdv-master-1 devstack@n-api.service[138744]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Oct 22 20:48:38.499259 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'flavor_id': '1140105472', 'body': {'extra_specs': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}}} Oct 22 20:48:38.499259 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:48:38.499259 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:48:38.499259 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:48:38.499259 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:48:38.499259 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:48:38.499259 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:48:38.499259 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:48:38.499259 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:48:38.499259 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 20:48:38.499259 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 20:48:38.499259 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 73, in create Oct 22 20:48:38.499259 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'create', target={}) Oct 22 20:48:38.499259 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 22 20:48:38.499259 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 22 20:48:38.499259 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 22 20:48:38.499259 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 22 20:48:38.499259 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 22 20:48:38.500505 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 22 20:48:38.500505 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 22 20:48:38.500505 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise self.value Oct 22 20:48:38.500505 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 22 20:48:38.500505 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 22 20:48:38.500505 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 22 20:48:38.500505 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 22 20:48:38.500505 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 22 20:48:38.500505 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 22 20:48:38.500505 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Oct 22 20:48:38.500505 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:48:38.500505 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:48:38.500505 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:48:38.500505 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:48:38.500505 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:48:38.500505 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:48:38.500505 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 22 20:48:38.500505 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 22 20:48:38.500505 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Oct 22 20:48:38.500505 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:48:38.504170 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-d000e23f-40ca-4049-9f13-9cb5f24bf563 tempest-FlavorsExtraSpecsNegativeTestJSON-1425648891 tempest-FlavorsExtraSpecsNegativeTestJSON-1425648891-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:48:38.505233 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-d000e23f-40ca-4049-9f13-9cb5f24bf563 tempest-FlavorsExtraSpecsNegativeTestJSON-1425648891 tempest-FlavorsExtraSpecsNegativeTestJSON-1425648891-project] 10.222.0.18 "POST /compute/v2.1/flavors/1140105472/os-extra_specs" status: 403 len: 124 microversion: 2.1 time: 0.031524 Oct 22 20:48:38.506300 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 48/117] 10.222.0.18 () {60 vars in 1224 bytes} [Sat Oct 22 20:48:38 2022] POST /compute/v2.1/flavors/1140105472/os-extra_specs => generated 124 bytes in 33 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 22 20:48:38.519920 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-107cfc7d-da15-4fa2-8603-3e2970f96a0d tempest-FlavorsExtraSpecsNegativeTestJSON-1299769607 tempest-FlavorsExtraSpecsNegativeTestJSON-1299769607-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:48:38.583563 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-107cfc7d-da15-4fa2-8603-3e2970f96a0d tempest-FlavorsExtraSpecsNegativeTestJSON-1299769607 tempest-FlavorsExtraSpecsNegativeTestJSON-1299769607-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors/1140105472/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.070348 Oct 22 20:48:38.589898 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 49/118] 10.222.0.18 () {60 vars in 1224 bytes} [Sat Oct 22 20:48:38 2022] POST /compute/v2.1/flavors/1140105472/os-extra_specs => generated 66 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 22 20:48:38.596111 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-55d5bed2-f038-4d26-b56c-ca673d115634 tempest-FlavorsExtraSpecsNegativeTestJSON-1425648891 tempest-FlavorsExtraSpecsNegativeTestJSON-1425648891-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:48:38.598272 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-55d5bed2-f038-4d26-b56c-ca673d115634 tempest-FlavorsExtraSpecsNegativeTestJSON-1425648891 tempest-FlavorsExtraSpecsNegativeTestJSON-1425648891-project] Policy check for os_compute_api:os-flavor-extra-specs:delete failed with credentials {'is_admin': False, 'user_id': '9fbe586cd59d40389e6bd3e57ed6f1ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed507c2ddb8a4a74bef788b2fcc47b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:48:38.605485 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-539fc22b-b061-4845-ad74-47db27e34cdc tempest-QuotasAdminTestV236-254240257 tempest-QuotasAdminTestV236-254240257-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:48:38.605990 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-539fc22b-b061-4845-ad74-47db27e34cdc tempest-QuotasAdminTestV236-254240257 tempest-QuotasAdminTestV236-254240257-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:48:38.609465 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-539fc22b-b061-4845-ad74-47db27e34cdc tempest-QuotasAdminTestV236-254240257 tempest-QuotasAdminTestV236-254240257-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:48:38.613860 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-55d5bed2-f038-4d26-b56c-ca673d115634 tempest-FlavorsExtraSpecsNegativeTestJSON-1425648891 tempest-FlavorsExtraSpecsNegativeTestJSON-1425648891-project] Request method failure captured: Oct 22 20:48:38.613860 ncdv-master-1 devstack@n-api.service[138744]: request: DELETE /compute/v2.1/flavors/1140105472/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 22 20:48:38.613860 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 20:48:38.613860 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 20:48:38.613860 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 20:48:38.613860 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 0 Oct 22 20:48:38.613860 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 20:48:38.613860 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 20:48:38.613860 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 20:48:38.613860 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 20:48:38.613860 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVFciVSkQKAF5Yz12tqLuYe09tbpK0VTnIMWiAA3fHIBG3e7UFLz0Fe0Hsia9wrguoeVhql-hu4FFRha9AmnIzHzbO7FHLCQU23I46bMcJkBC99a4EZtzaQLilMb5PQTSv3X_k0zbk9YGe9YHlQKO7t54cmRj5uW163tv16YAIA7RAM0 Oct 22 20:48:38.613860 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 20:48:38.613860 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 20:48:38.613860 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 20:48:38.613860 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 20:48:38.613860 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 20:48:38.613860 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 20:48:38.613860 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: ed507c2ddb8a4a74bef788b2fcc47b4f Oct 22 20:48:38.613860 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1425648891 Oct 22 20:48:38.613860 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 20:48:38.613860 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 20:48:38.615193 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ed507c2ddb8a4a74bef788b2fcc47b4f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ed507c2ddb8a4a74bef788b2fcc47b4f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ed507c2ddb8a4a74bef788b2fcc47b4f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ed507c2ddb8a4a74bef788b2fcc47b4f"}]}] Oct 22 20:48:38.615193 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1425648891 Oct 22 20:48:38.615193 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: ed507c2ddb8a4a74bef788b2fcc47b4f Oct 22 20:48:38.615193 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1425648891 Oct 22 20:48:38.615193 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1425648891-project Oct 22 20:48:38.615193 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 20:48:38.615193 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 20:48:38.615193 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: 9fbe586cd59d40389e6bd3e57ed6f1ac Oct 22 20:48:38.615193 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1425648891-project Oct 22 20:48:38.615193 ncdv-master-1 devstack@n-api.service[138744]: method: > Oct 22 20:48:38.615193 ncdv-master-1 devstack@n-api.service[138744]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Oct 22 20:48:38.615934 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'flavor_id': '1140105472', 'id': 'hw:numa_nodes'} Oct 22 20:48:38.615934 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:48:38.615934 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:48:38.615934 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:48:38.615934 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:48:38.615934 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:48:38.615934 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:48:38.615934 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:48:38.615934 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:48:38.615934 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 129, in delete Oct 22 20:48:38.615934 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'delete', target={}) Oct 22 20:48:38.615934 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 22 20:48:38.615934 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 22 20:48:38.615934 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 22 20:48:38.615934 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 22 20:48:38.615934 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 22 20:48:38.615934 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 22 20:48:38.615934 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 22 20:48:38.615934 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise self.value Oct 22 20:48:38.615934 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 22 20:48:38.617094 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 22 20:48:38.617094 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 22 20:48:38.617094 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 22 20:48:38.617094 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 22 20:48:38.617094 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 22 20:48:38.617094 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Oct 22 20:48:38.617094 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:48:38.617094 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:48:38.617094 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:48:38.617094 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:48:38.617094 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:48:38.617094 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:48:38.617094 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 22 20:48:38.617094 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 22 20:48:38.617094 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Oct 22 20:48:38.617094 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:48:38.617952 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-539fc22b-b061-4845-ad74-47db27e34cdc tempest-QuotasAdminTestV236-254240257 tempest-QuotasAdminTestV236-254240257-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:48:38.617952 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-539fc22b-b061-4845-ad74-47db27e34cdc tempest-QuotasAdminTestV236-254240257 tempest-QuotasAdminTestV236-254240257-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:48:38.617952 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-539fc22b-b061-4845-ad74-47db27e34cdc tempest-QuotasAdminTestV236-254240257 tempest-QuotasAdminTestV236-254240257-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:48:38.621117 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-55d5bed2-f038-4d26-b56c-ca673d115634 tempest-FlavorsExtraSpecsNegativeTestJSON-1425648891 tempest-FlavorsExtraSpecsNegativeTestJSON-1425648891-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:48:38.641513 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-55d5bed2-f038-4d26-b56c-ca673d115634 tempest-FlavorsExtraSpecsNegativeTestJSON-1425648891 tempest-FlavorsExtraSpecsNegativeTestJSON-1425648891-project] 10.222.0.18 "DELETE /compute/v2.1/flavors/1140105472/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.030483 Oct 22 20:48:38.648098 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 50/119] 10.222.0.18 () {58 vars in 1248 bytes} [Sat Oct 22 20:48:38 2022] DELETE /compute/v2.1/flavors/1140105472/os-extra_specs/hw:numa_nodes => generated 124 bytes in 52 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 22 20:48:38.663094 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-58c50c5c-ae3d-4a4b-9b38-db0e6e2cfce7 tempest-FlavorsExtraSpecsNegativeTestJSON-1299769607 tempest-FlavorsExtraSpecsNegativeTestJSON-1299769607-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:48:38.696783 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-539fc22b-b061-4845-ad74-47db27e34cdc tempest-QuotasAdminTestV236-254240257 tempest-QuotasAdminTestV236-254240257-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:48:38.698883 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-539fc22b-b061-4845-ad74-47db27e34cdc tempest-QuotasAdminTestV236-254240257 tempest-QuotasAdminTestV236-254240257-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:48:38.699542 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-539fc22b-b061-4845-ad74-47db27e34cdc tempest-QuotasAdminTestV236-254240257 tempest-QuotasAdminTestV236-254240257-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:48:38.700319 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-58c50c5c-ae3d-4a4b-9b38-db0e6e2cfce7 tempest-FlavorsExtraSpecsNegativeTestJSON-1299769607 tempest-FlavorsExtraSpecsNegativeTestJSON-1299769607-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors/1140105472/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.048503 Oct 22 20:48:38.705644 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 51/120] 10.222.0.18 () {60 vars in 1224 bytes} [Sat Oct 22 20:48:38 2022] POST /compute/v2.1/flavors/1140105472/os-extra_specs => generated 66 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 22 20:48:38.705812 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-539fc22b-b061-4845-ad74-47db27e34cdc tempest-QuotasAdminTestV236-254240257 tempest-QuotasAdminTestV236-254240257-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:48:38.705812 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-539fc22b-b061-4845-ad74-47db27e34cdc tempest-QuotasAdminTestV236-254240257 tempest-QuotasAdminTestV236-254240257-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:48:38.705812 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-539fc22b-b061-4845-ad74-47db27e34cdc tempest-QuotasAdminTestV236-254240257 tempest-QuotasAdminTestV236-254240257-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:48:38.713091 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-b963c58e-94c9-496e-ac11-89c860a0bb03 tempest-FlavorsExtraSpecsNegativeTestJSON-1425648891 tempest-FlavorsExtraSpecsNegativeTestJSON-1425648891-project] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1"} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:48:38.729949 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-b963c58e-94c9-496e-ac11-89c860a0bb03 tempest-FlavorsExtraSpecsNegativeTestJSON-1425648891 tempest-FlavorsExtraSpecsNegativeTestJSON-1425648891-project] Policy check for os_compute_api:os-flavor-extra-specs:update failed with credentials {'is_admin': False, 'user_id': '9fbe586cd59d40389e6bd3e57ed6f1ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed507c2ddb8a4a74bef788b2fcc47b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:48:38.735097 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-b963c58e-94c9-496e-ac11-89c860a0bb03 tempest-FlavorsExtraSpecsNegativeTestJSON-1425648891 tempest-FlavorsExtraSpecsNegativeTestJSON-1425648891-project] Request method failure captured: Oct 22 20:48:38.735097 ncdv-master-1 devstack@n-api.service[138744]: request: PUT /compute/v2.1/flavors/1140105472/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 22 20:48:38.735097 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 20:48:38.735097 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 20:48:38.735097 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 20:48:38.735097 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 22 Oct 22 20:48:38.735097 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 20:48:38.735097 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 20:48:38.735097 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 20:48:38.735097 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 20:48:38.735097 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVFciVSkQKAF5Yz12tqLuYe09tbpK0VTnIMWiAA3fHIBG3e7UFLz0Fe0Hsia9wrguoeVhql-hu4FFRha9AmnIzHzbO7FHLCQU23I46bMcJkBC99a4EZtzaQLilMb5PQTSv3X_k0zbk9YGe9YHlQKO7t54cmRj5uW163tv16YAIA7RAM0 Oct 22 20:48:38.735097 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 20:48:38.735097 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 20:48:38.735097 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 20:48:38.735097 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 20:48:38.735097 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 20:48:38.735097 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 20:48:38.735097 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: ed507c2ddb8a4a74bef788b2fcc47b4f Oct 22 20:48:38.735097 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1425648891 Oct 22 20:48:38.735097 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 20:48:38.735097 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 20:48:38.736443 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ed507c2ddb8a4a74bef788b2fcc47b4f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ed507c2ddb8a4a74bef788b2fcc47b4f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ed507c2ddb8a4a74bef788b2fcc47b4f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ed507c2ddb8a4a74bef788b2fcc47b4f"}]}] Oct 22 20:48:38.736443 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1425648891 Oct 22 20:48:38.736443 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: ed507c2ddb8a4a74bef788b2fcc47b4f Oct 22 20:48:38.736443 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1425648891 Oct 22 20:48:38.736443 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1425648891-project Oct 22 20:48:38.736443 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 20:48:38.736443 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 20:48:38.736443 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: 9fbe586cd59d40389e6bd3e57ed6f1ac Oct 22 20:48:38.736443 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1425648891-project Oct 22 20:48:38.736443 ncdv-master-1 devstack@n-api.service[138744]: Oct 22 20:48:38.736443 ncdv-master-1 devstack@n-api.service[138744]: {"hw:numa_nodes": "1"} Oct 22 20:48:38.736443 ncdv-master-1 devstack@n-api.service[138744]: method: > Oct 22 20:48:38.736443 ncdv-master-1 devstack@n-api.service[138744]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Oct 22 20:48:38.737132 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'flavor_id': '1140105472', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1'}} Oct 22 20:48:38.737132 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:48:38.737132 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:48:38.737132 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:48:38.737132 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:48:38.737132 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:48:38.737132 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:48:38.737132 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:48:38.737132 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:48:38.737132 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 20:48:38.737132 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 20:48:38.737132 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 91, in update Oct 22 20:48:38.737132 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'update', target={}) Oct 22 20:48:38.737132 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 22 20:48:38.737132 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 22 20:48:38.737132 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 22 20:48:38.737132 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 22 20:48:38.737132 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 22 20:48:38.737132 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 22 20:48:38.744096 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 22 20:48:38.744096 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise self.value Oct 22 20:48:38.744096 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 22 20:48:38.744096 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 22 20:48:38.744096 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 22 20:48:38.744096 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 22 20:48:38.744096 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 22 20:48:38.744096 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 22 20:48:38.744096 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Oct 22 20:48:38.744096 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:48:38.744096 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:48:38.744096 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:48:38.744096 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:48:38.744096 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:48:38.744096 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:48:38.744096 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 22 20:48:38.744096 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 22 20:48:38.744096 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Oct 22 20:48:38.744096 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:48:38.745146 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-b963c58e-94c9-496e-ac11-89c860a0bb03 tempest-FlavorsExtraSpecsNegativeTestJSON-1425648891 tempest-FlavorsExtraSpecsNegativeTestJSON-1425648891-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:48:38.745146 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-b963c58e-94c9-496e-ac11-89c860a0bb03 tempest-FlavorsExtraSpecsNegativeTestJSON-1425648891 tempest-FlavorsExtraSpecsNegativeTestJSON-1425648891-project] 10.222.0.18 "PUT /compute/v2.1/flavors/1140105472/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.029169 Oct 22 20:48:38.745146 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 52/121] 10.222.0.18 () {60 vars in 1265 bytes} [Sat Oct 22 20:48:38 2022] PUT /compute/v2.1/flavors/1140105472/os-extra_specs/hw:numa_nodes => generated 124 bytes in 31 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 22 20:48:38.745146 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-2fb2c49e-0a09-4612-ba9e-7d17a4b62c0f tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:48:38.745490 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-2fb2c49e-0a09-4612-ba9e-7d17a4b62c0f tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] [instance: f592a6fe-8cc7-4bb1-bb04-f8ddd358eeca] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:48:38.752295 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2fb2c49e-0a09-4612-ba9e-7d17a4b62c0f tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:48:38.752813 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2fb2c49e-0a09-4612-ba9e-7d17a4b62c0f tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:48:38.753339 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2fb2c49e-0a09-4612-ba9e-7d17a4b62c0f tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:48:38.754064 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2fb2c49e-0a09-4612-ba9e-7d17a4b62c0f tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:48:38.754514 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2fb2c49e-0a09-4612-ba9e-7d17a4b62c0f tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:48:38.755222 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2fb2c49e-0a09-4612-ba9e-7d17a4b62c0f tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:48:38.834002 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-539fc22b-b061-4845-ad74-47db27e34cdc tempest-QuotasAdminTestV236-254240257 tempest-QuotasAdminTestV236-254240257-project-admin] 10.222.0.18 "PUT /compute/v2.1/os-quota-sets/67376327e3c24b7d87abd13cece840bc?user_id=052a2a06ae614b738b4ff7afe8af2972" status: 200 len: 240 microversion: 2.36 time: 0.443580 Oct 22 20:48:38.834998 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 70/122] 10.222.0.18 () {62 vars in 1384 bytes} [Sat Oct 22 20:48:38 2022] PUT /compute/v2.1/os-quota-sets/67376327e3c24b7d87abd13cece840bc?user_id=052a2a06ae614b738b4ff7afe8af2972 => generated 240 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 22 20:48:38.845307 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-2dae67d4-3e5a-471d-9c01-8fd0492ac2fd tempest-FlavorsExtraSpecsNegativeTestJSON-1299769607 tempest-FlavorsExtraSpecsNegativeTestJSON-1299769607-project-admin] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:48:38.848613 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_api:SELECT=90,nova_api:DELETE=6,nova_api:INSERT=4 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:48:38.858084 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.wsgi [None req-2dae67d4-3e5a-471d-9c01-8fd0492ac2fd tempest-FlavorsExtraSpecsNegativeTestJSON-1299769607 tempest-FlavorsExtraSpecsNegativeTestJSON-1299769607-project-admin] HTTP exception thrown: Flavor 1140105472 has no extra specs with key hw:cpu_thread_policy. Oct 22 20:48:38.867255 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-2dae67d4-3e5a-471d-9c01-8fd0492ac2fd tempest-FlavorsExtraSpecsNegativeTestJSON-1299769607 tempest-FlavorsExtraSpecsNegativeTestJSON-1299769607-project-admin] Request method failure captured: Oct 22 20:48:38.867255 ncdv-master-1 devstack@n-api.service[138745]: request: DELETE /compute/v2.1/flavors/1140105472/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Oct 22 20:48:38.867255 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 20:48:38.867255 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 20:48:38.867255 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 20:48:38.867255 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 0 Oct 22 20:48:38.867255 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 20:48:38.867255 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 20:48:38.867255 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 20:48:38.867255 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 20:48:38.867255 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVFclIglQlCtIXUUw8VU8HkNcir6X8fkZclAStf_oirLPpBJPnt2jE-w2utBcV5AH0Q3d3xCuFsJPpq1WHiLsm_ARTAd-8-wgHHsAyCDL_Oql9kcLtFiPVb2S2flJaHcb3Jd2l3A5jIFwJlpuALYvAEn6-J3QdR7nPXLqIsQxnWty_QM Oct 22 20:48:38.867255 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 20:48:38.867255 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 20:48:38.867255 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 20:48:38.867255 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 20:48:38.867255 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 20:48:38.867255 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 20:48:38.867255 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: 10dd3d2a3a084b929c6abc5dbef72544 Oct 22 20:48:38.867255 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1299769607 Oct 22 20:48:38.867255 ncdv-master-1 devstack@n-api.service[138745]: X-Role: admin,member,reader Oct 22 20:48:38.867255 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: admin,member,reader Oct 22 20:48:38.868719 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_10dd3d2a3a084b929c6abc5dbef72544"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/10dd3d2a3a084b929c6abc5dbef72544"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/10dd3d2a3a084b929c6abc5dbef72544"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/10dd3d2a3a084b929c6abc5dbef72544"}]}] Oct 22 20:48:38.868719 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1299769607 Oct 22 20:48:38.868719 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: 10dd3d2a3a084b929c6abc5dbef72544 Oct 22 20:48:38.868719 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1299769607 Oct 22 20:48:38.868719 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1299769607-project-admin Oct 22 20:48:38.868719 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 20:48:38.868719 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 20:48:38.868719 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: ce012d20d33c4ffb94f8e888e2cfb259 Oct 22 20:48:38.868719 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1299769607-project-admin Oct 22 20:48:38.868719 ncdv-master-1 devstack@n-api.service[138745]: method: > Oct 22 20:48:38.868719 ncdv-master-1 devstack@n-api.service[138745]: exception: Flavor 1140105472 has no extra specs with key hw:cpu_thread_policy. Oct 22 20:48:38.869411 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'flavor_id': '1140105472', 'id': 'hw:cpu_thread_policy'} Oct 22 20:48:38.869411 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:48:38.869411 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:48:38.869411 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 132, in delete Oct 22 20:48:38.869411 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi del flavor.extra_specs[id] Oct 22 20:48:38.869411 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Oct 22 20:48:38.869411 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:48:38.869411 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:48:38.869411 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:48:38.869411 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:48:38.869411 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:48:38.869411 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:48:38.869411 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:48:38.869411 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:48:38.869411 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:48:38.869411 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:48:38.869411 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 141, in delete Oct 22 20:48:38.869411 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 22 20:48:38.869411 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 1140105472 has no extra specs with key hw:cpu_thread_policy. Oct 22 20:48:38.869411 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:48:38.869411 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:48:38.869411 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:48:38.870772 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:48:38.870772 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:48:38.870772 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:48:38.870772 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 20:48:38.870772 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 20:48:38.870772 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1140105472 has no extra specs with key hw:cpu_thread_policy. Oct 22 20:48:38.870772 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:48:38.872868 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-2dae67d4-3e5a-471d-9c01-8fd0492ac2fd tempest-FlavorsExtraSpecsNegativeTestJSON-1299769607 tempest-FlavorsExtraSpecsNegativeTestJSON-1299769607-project-admin] Returning 404 to user: Flavor 1140105472 has no extra specs with key hw:cpu_thread_policy. {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:48:38.878147 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-2dae67d4-3e5a-471d-9c01-8fd0492ac2fd tempest-FlavorsExtraSpecsNegativeTestJSON-1299769607 tempest-FlavorsExtraSpecsNegativeTestJSON-1299769607-project-admin] 10.222.0.18 "DELETE /compute/v2.1/flavors/1140105472/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.039969 Oct 22 20:48:38.884942 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 71/123] 10.222.0.18 () {58 vars in 1269 bytes} [Sat Oct 22 20:48:38 2022] DELETE /compute/v2.1/flavors/1140105472/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 20:48:38.891591 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-f059006e-c355-4499-ade9-e99cf7d75814 tempest-QuotasAdminTestV236-254240257 tempest-QuotasAdminTestV236-254240257-project-admin] Calling method '.version_select at 0x7fd3a4e30a60>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:48:38.985547 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-2fb2c49e-0a09-4612-ba9e-7d17a4b62c0f tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e13dcabaaa4b218945aeeabb4c902e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675a324f0134844a1964f64322493ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:48:39.005002 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-2fb2c49e-0a09-4612-ba9e-7d17a4b62c0f tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] 10.222.0.18 "GET /compute/v2.1/servers/f592a6fe-8cc7-4bb1-bb04-f8ddd358eeca" status: 200 len: 1319 microversion: 2.1 time: 0.262689 Oct 22 20:48:39.006809 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 53/124] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:48:38 2022] GET /compute/v2.1/servers/f592a6fe-8cc7-4bb1-bb04-f8ddd358eeca => generated 1319 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:48:39.025057 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-b7b2b0f5-a2e9-40f8-b31c-dd17705ae842 tempest-FlavorsExtraSpecsNegativeTestJSON-1299769607 tempest-FlavorsExtraSpecsNegativeTestJSON-1299769607-project-admin] Action: 'update', calling method: >, body: {"hw:cpu_policy": "shared"} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:48:39.031658 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-b7b2b0f5-a2e9-40f8-b31c-dd17705ae842 tempest-FlavorsExtraSpecsNegativeTestJSON-1299769607 tempest-FlavorsExtraSpecsNegativeTestJSON-1299769607-project-admin] HTTP exception thrown: Request body and URI mismatch Oct 22 20:48:39.035049 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-b7b2b0f5-a2e9-40f8-b31c-dd17705ae842 tempest-FlavorsExtraSpecsNegativeTestJSON-1299769607 tempest-FlavorsExtraSpecsNegativeTestJSON-1299769607-project-admin] Request method failure captured: Oct 22 20:48:39.035049 ncdv-master-1 devstack@n-api.service[138744]: request: PUT /compute/v2.1/flavors/1140105472/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 22 20:48:39.035049 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 20:48:39.035049 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 20:48:39.035049 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 20:48:39.035049 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 27 Oct 22 20:48:39.035049 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 20:48:39.035049 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 20:48:39.035049 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 20:48:39.035049 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 20:48:39.035049 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVFclIglQlCtIXUUw8VU8HkNcir6X8fkZclAStf_oirLPpBJPnt2jE-w2utBcV5AH0Q3d3xCuFsJPpq1WHiLsm_ARTAd-8-wgHHsAyCDL_Oql9kcLtFiPVb2S2flJaHcb3Jd2l3A5jIFwJlpuALYvAEn6-J3QdR7nPXLqIsQxnWty_QM Oct 22 20:48:39.035049 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 20:48:39.035049 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 20:48:39.035049 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 20:48:39.035049 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 20:48:39.035049 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 20:48:39.035049 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 20:48:39.035049 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: 10dd3d2a3a084b929c6abc5dbef72544 Oct 22 20:48:39.035049 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1299769607 Oct 22 20:48:39.035049 ncdv-master-1 devstack@n-api.service[138744]: X-Role: admin,member,reader Oct 22 20:48:39.035049 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: admin,member,reader Oct 22 20:48:39.036573 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_10dd3d2a3a084b929c6abc5dbef72544"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/10dd3d2a3a084b929c6abc5dbef72544"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/10dd3d2a3a084b929c6abc5dbef72544"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/10dd3d2a3a084b929c6abc5dbef72544"}]}] Oct 22 20:48:39.036573 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1299769607 Oct 22 20:48:39.036573 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: 10dd3d2a3a084b929c6abc5dbef72544 Oct 22 20:48:39.036573 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1299769607 Oct 22 20:48:39.036573 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1299769607-project-admin Oct 22 20:48:39.036573 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 20:48:39.036573 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 20:48:39.036573 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: ce012d20d33c4ffb94f8e888e2cfb259 Oct 22 20:48:39.036573 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1299769607-project-admin Oct 22 20:48:39.036573 ncdv-master-1 devstack@n-api.service[138744]: Oct 22 20:48:39.036573 ncdv-master-1 devstack@n-api.service[138744]: {"hw:cpu_policy": "shared"} Oct 22 20:48:39.036573 ncdv-master-1 devstack@n-api.service[138744]: method: > Oct 22 20:48:39.036573 ncdv-master-1 devstack@n-api.service[138744]: exception: Request body and URI mismatch Oct 22 20:48:39.037341 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'flavor_id': '1140105472', 'id': 'hw:numa_nodes', 'body': {'hw:cpu_policy': 'shared'}} Oct 22 20:48:39.037341 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:48:39.037341 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:48:39.037341 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:48:39.037341 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:48:39.037341 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:48:39.037341 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:48:39.037341 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:48:39.037341 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:48:39.037341 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 20:48:39.037341 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 20:48:39.037341 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 96, in update Oct 22 20:48:39.037341 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=expl) Oct 22 20:48:39.037341 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Request body and URI mismatch Oct 22 20:48:39.037341 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:48:39.037341 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:48:39.037341 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:48:39.037341 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:48:39.037341 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:48:39.037341 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:48:39.038516 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 20:48:39.038516 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 20:48:39.038516 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Request body and URI mismatch Oct 22 20:48:39.038516 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:48:39.040370 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-b7b2b0f5-a2e9-40f8-b31c-dd17705ae842 tempest-FlavorsExtraSpecsNegativeTestJSON-1299769607 tempest-FlavorsExtraSpecsNegativeTestJSON-1299769607-project-admin] Returning 400 to user: Request body and URI mismatch {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:48:39.041507 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-b7b2b0f5-a2e9-40f8-b31c-dd17705ae842 tempest-FlavorsExtraSpecsNegativeTestJSON-1299769607 tempest-FlavorsExtraSpecsNegativeTestJSON-1299769607-project-admin] 10.222.0.18 "PUT /compute/v2.1/flavors/1140105472/os-extra_specs/hw:numa_nodes" status: 400 len: 73 microversion: 2.1 time: 0.033684 Oct 22 20:48:39.042914 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 54/125] 10.222.0.18 () {60 vars in 1265 bytes} [Sat Oct 22 20:48:39 2022] PUT /compute/v2.1/flavors/1140105472/os-extra_specs/hw:numa_nodes => generated 73 bytes in 35 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 22 20:48:39.056529 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-3b74860c-5eef-428f-b7c2-4c9fb0a5b1ae tempest-FlavorsExtraSpecsNegativeTestJSON-1299769607 tempest-FlavorsExtraSpecsNegativeTestJSON-1299769607-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:48:39.064864 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-3b74860c-5eef-428f-b7c2-4c9fb0a5b1ae tempest-FlavorsExtraSpecsNegativeTestJSON-1299769607 tempest-FlavorsExtraSpecsNegativeTestJSON-1299769607-project-admin] Request method failure captured: Oct 22 20:48:39.064864 ncdv-master-1 devstack@n-api.service[138744]: request: PUT /compute/v2.1/flavors/1140105472/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 22 20:48:39.064864 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 20:48:39.064864 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 20:48:39.064864 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 20:48:39.064864 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 49 Oct 22 20:48:39.064864 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 20:48:39.064864 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 20:48:39.064864 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 20:48:39.064864 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 20:48:39.064864 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVFclIglQlCtIXUUw8VU8HkNcir6X8fkZclAStf_oirLPpBJPnt2jE-w2utBcV5AH0Q3d3xCuFsJPpq1WHiLsm_ARTAd-8-wgHHsAyCDL_Oql9kcLtFiPVb2S2flJaHcb3Jd2l3A5jIFwJlpuALYvAEn6-J3QdR7nPXLqIsQxnWty_QM Oct 22 20:48:39.064864 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 20:48:39.064864 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 20:48:39.064864 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 20:48:39.064864 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 20:48:39.064864 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 20:48:39.064864 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 20:48:39.064864 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: 10dd3d2a3a084b929c6abc5dbef72544 Oct 22 20:48:39.064864 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1299769607 Oct 22 20:48:39.064864 ncdv-master-1 devstack@n-api.service[138744]: X-Role: admin,member,reader Oct 22 20:48:39.064864 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: admin,member,reader Oct 22 20:48:39.066354 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_10dd3d2a3a084b929c6abc5dbef72544"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/10dd3d2a3a084b929c6abc5dbef72544"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/10dd3d2a3a084b929c6abc5dbef72544"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/10dd3d2a3a084b929c6abc5dbef72544"}]}] Oct 22 20:48:39.066354 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1299769607 Oct 22 20:48:39.066354 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: 10dd3d2a3a084b929c6abc5dbef72544 Oct 22 20:48:39.066354 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1299769607 Oct 22 20:48:39.066354 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1299769607-project-admin Oct 22 20:48:39.066354 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 20:48:39.066354 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 20:48:39.066354 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: ce012d20d33c4ffb94f8e888e2cfb259 Oct 22 20:48:39.066354 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1299769607-project-admin Oct 22 20:48:39.066354 ncdv-master-1 devstack@n-api.service[138744]: Oct 22 20:48:39.066354 ncdv-master-1 devstack@n-api.service[138744]: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} Oct 22 20:48:39.066354 ncdv-master-1 devstack@n-api.service[138744]: method: > Oct 22 20:48:39.067024 ncdv-master-1 devstack@n-api.service[138744]: exception: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 22 20:48:39.067024 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'flavor_id': '1140105472', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}} Oct 22 20:48:39.067024 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:48:39.067024 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:48:39.067024 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 22 20:48:39.067024 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 22 20:48:39.067024 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 22 20:48:39.067024 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise error Oct 22 20:48:39.067024 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 22 20:48:39.067024 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:48:39.067024 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Failed validating 'maxProperties' in schema: Oct 22 20:48:39.067024 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 22 20:48:39.067024 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi 'maxProperties': 1, Oct 22 20:48:39.067024 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi 'minProperties': 1, Oct 22 20:48:39.067024 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 22 20:48:39.067024 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi 'type': ['string', Oct 22 20:48:39.067024 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi 'number']}}, Oct 22 20:48:39.067024 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 22 20:48:39.067024 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:48:39.067024 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi On instance: Oct 22 20:48:39.067024 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi {'hw:cpu_policy': 'shared', 'hw:numa_nodes': '1'} Oct 22 20:48:39.067024 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:48:39.068647 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:48:39.068647 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:48:39.068647 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:48:39.068647 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:48:39.068647 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:48:39.068647 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:48:39.068647 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:48:39.068647 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:48:39.068647 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:48:39.068647 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 22 20:48:39.068647 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 22 20:48:39.068647 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 22 20:48:39.068647 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 22 20:48:39.068647 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 22 20:48:39.068647 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 22 20:48:39.068647 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 22 20:48:39.068647 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:48:39.068647 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:48:39.068647 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:48:39.068647 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:48:39.070126 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:48:39.070126 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:48:39.070126 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 22 20:48:39.070126 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 22 20:48:39.070126 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 22 20:48:39.070126 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:48:39.070126 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-3b74860c-5eef-428f-b7c2-4c9fb0a5b1ae tempest-FlavorsExtraSpecsNegativeTestJSON-1299769607 tempest-FlavorsExtraSpecsNegativeTestJSON-1299769607-project-admin] Returning 400 to user: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:48:39.070126 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-3b74860c-5eef-428f-b7c2-4c9fb0a5b1ae tempest-FlavorsExtraSpecsNegativeTestJSON-1299769607 tempest-FlavorsExtraSpecsNegativeTestJSON-1299769607-project-admin] 10.222.0.18 "PUT /compute/v2.1/flavors/1140105472/os-extra_specs/hw:numa_nodes" status: 400 len: 117 microversion: 2.1 time: 0.020724 Oct 22 20:48:39.085145 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 55/126] 10.222.0.18 () {60 vars in 1265 bytes} [Sat Oct 22 20:48:39 2022] PUT /compute/v2.1/flavors/1140105472/os-extra_specs/hw:numa_nodes => generated 117 bytes in 37 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 22 20:48:39.097863 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-75f88980-daf0-462d-b100-64f4675218bf tempest-FlavorsExtraSpecsNegativeTestJSON-1299769607 tempest-FlavorsExtraSpecsNegativeTestJSON-1299769607-project-admin] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:48:39.147136 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-75f88980-daf0-462d-b100-64f4675218bf tempest-FlavorsExtraSpecsNegativeTestJSON-1299769607 tempest-FlavorsExtraSpecsNegativeTestJSON-1299769607-project-admin] 10.222.0.18 "DELETE /compute/v2.1/flavors/1140105472" status: 202 len: 0 microversion: 2.1 time: 0.060789 Oct 22 20:48:39.153311 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 56/127] 10.222.0.18 () {58 vars in 1161 bytes} [Sat Oct 22 20:48:39 2022] DELETE /compute/v2.1/flavors/1140105472 => generated 0 bytes in 67 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 20:48:39.162589 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-b5cbd90a-5af6-4c40-9b17-5cc061601a7d tempest-FlavorsExtraSpecsNegativeTestJSON-1299769607 tempest-FlavorsExtraSpecsNegativeTestJSON-1299769607-project-admin] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:48:39.186739 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-b5cbd90a-5af6-4c40-9b17-5cc061601a7d tempest-FlavorsExtraSpecsNegativeTestJSON-1299769607 tempest-FlavorsExtraSpecsNegativeTestJSON-1299769607-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.029057 Oct 22 20:48:39.187921 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 57/128] 10.222.0.18 () {58 vars in 1146 bytes} [Sat Oct 22 20:48:39 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 20:48:39.490140 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-7ad1fe80-6539-4403-842c-5d8f7a0f7d85 tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:48:39.490952 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-7ad1fe80-6539-4403-842c-5d8f7a0f7d85 tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] [instance: e169b57b-4899-4a9e-80a9-d6290eb63ceb] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:48:39.504007 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7ad1fe80-6539-4403-842c-5d8f7a0f7d85 tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:48:39.504951 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7ad1fe80-6539-4403-842c-5d8f7a0f7d85 tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:48:39.506312 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7ad1fe80-6539-4403-842c-5d8f7a0f7d85 tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:48:39.509444 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7ad1fe80-6539-4403-842c-5d8f7a0f7d85 tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:48:39.510104 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7ad1fe80-6539-4403-842c-5d8f7a0f7d85 tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:48:39.510672 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7ad1fe80-6539-4403-842c-5d8f7a0f7d85 tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:48:39.663290 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-f059006e-c355-4499-ade9-e99cf7d75814 tempest-QuotasAdminTestV236-254240257 tempest-QuotasAdminTestV236-254240257-project-admin] 10.222.0.18 "GET /compute/v2.1/os-quota-sets/67376327e3c24b7d87abd13cece840bc?user_id=052a2a06ae614b738b4ff7afe8af2972" status: 200 len: 282 microversion: 2.36 time: 0.776895 Oct 22 20:48:39.675386 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 72/129] 10.222.0.18 () {60 vars in 1364 bytes} [Sat Oct 22 20:48:38 2022] GET /compute/v2.1/os-quota-sets/67376327e3c24b7d87abd13cece840bc?user_id=052a2a06ae614b738b4ff7afe8af2972 => generated 282 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 22 20:48:40.033196 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-0c1fc9a9-998f-4020-b56f-221049650ff5 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:48:40.034389 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-0c1fc9a9-998f-4020-b56f-221049650ff5 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] [instance: f592a6fe-8cc7-4bb1-bb04-f8ddd358eeca] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:48:40.053353 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0c1fc9a9-998f-4020-b56f-221049650ff5 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:48:40.057612 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0c1fc9a9-998f-4020-b56f-221049650ff5 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:48:40.058449 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0c1fc9a9-998f-4020-b56f-221049650ff5 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:48:40.060175 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0c1fc9a9-998f-4020-b56f-221049650ff5 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:48:40.062042 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0c1fc9a9-998f-4020-b56f-221049650ff5 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:48:40.062701 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0c1fc9a9-998f-4020-b56f-221049650ff5 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:48:40.712428 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-7ad1fe80-6539-4403-842c-5d8f7a0f7d85 tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6de80d628cf14694af6d2cd16f16afad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae95f5dee52f4235b3478cc90f3b0347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:48:40.727283 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-7ad1fe80-6539-4403-842c-5d8f7a0f7d85 tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] 10.222.0.18 "GET /compute/v2.1/servers/e169b57b-4899-4a9e-80a9-d6290eb63ceb" status: 200 len: 1338 microversion: 2.1 time: 1.238762 Oct 22 20:48:40.729822 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 58/130] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:48:39 2022] GET /compute/v2.1/servers/e169b57b-4899-4a9e-80a9-d6290eb63ceb => generated 1338 bytes in 1246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 20:48:40.804443 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-0c1fc9a9-998f-4020-b56f-221049650ff5 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e13dcabaaa4b218945aeeabb4c902e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675a324f0134844a1964f64322493ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:48:40.825739 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-0c1fc9a9-998f-4020-b56f-221049650ff5 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] 10.222.0.18 "GET /compute/v2.1/servers/f592a6fe-8cc7-4bb1-bb04-f8ddd358eeca" status: 200 len: 1319 microversion: 2.1 time: 0.798129 Oct 22 20:48:40.857935 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 73/131] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:48:40 2022] GET /compute/v2.1/servers/f592a6fe-8cc7-4bb1-bb04-f8ddd358eeca => generated 1319 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:48:41.761346 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-2642fe39-0f7d-4fbe-a76b-0c957f72b757 tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:48:41.762104 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-2642fe39-0f7d-4fbe-a76b-0c957f72b757 tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] [instance: e169b57b-4899-4a9e-80a9-d6290eb63ceb] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:48:41.769726 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2642fe39-0f7d-4fbe-a76b-0c957f72b757 tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:48:41.771835 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2642fe39-0f7d-4fbe-a76b-0c957f72b757 tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:48:41.773345 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2642fe39-0f7d-4fbe-a76b-0c957f72b757 tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:48:41.774424 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2642fe39-0f7d-4fbe-a76b-0c957f72b757 tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:48:41.776949 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2642fe39-0f7d-4fbe-a76b-0c957f72b757 tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:48:41.778402 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2642fe39-0f7d-4fbe-a76b-0c957f72b757 tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:48:41.860883 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-42fdcf11-52f8-4a70-94a0-31d772d100a6 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:48:41.862598 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-42fdcf11-52f8-4a70-94a0-31d772d100a6 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] [instance: f592a6fe-8cc7-4bb1-bb04-f8ddd358eeca] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:48:41.869694 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-42fdcf11-52f8-4a70-94a0-31d772d100a6 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:48:41.870414 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-42fdcf11-52f8-4a70-94a0-31d772d100a6 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:48:41.871004 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-42fdcf11-52f8-4a70-94a0-31d772d100a6 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:48:41.872402 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-42fdcf11-52f8-4a70-94a0-31d772d100a6 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:48:41.873050 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-42fdcf11-52f8-4a70-94a0-31d772d100a6 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:48:41.873629 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-42fdcf11-52f8-4a70-94a0-31d772d100a6 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:48:42.054406 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-2642fe39-0f7d-4fbe-a76b-0c957f72b757 tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6de80d628cf14694af6d2cd16f16afad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae95f5dee52f4235b3478cc90f3b0347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:48:42.065232 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-2642fe39-0f7d-4fbe-a76b-0c957f72b757 tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] 10.222.0.18 "GET /compute/v2.1/servers/e169b57b-4899-4a9e-80a9-d6290eb63ceb" status: 200 len: 1338 microversion: 2.1 time: 0.308559 Oct 22 20:48:42.069729 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 59/132] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:48:41 2022] GET /compute/v2.1/servers/e169b57b-4899-4a9e-80a9-d6290eb63ceb => generated 1338 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:48:42.247084 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-42fdcf11-52f8-4a70-94a0-31d772d100a6 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e13dcabaaa4b218945aeeabb4c902e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675a324f0134844a1964f64322493ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:48:42.261652 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-42fdcf11-52f8-4a70-94a0-31d772d100a6 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] 10.222.0.18 "GET /compute/v2.1/servers/f592a6fe-8cc7-4bb1-bb04-f8ddd358eeca" status: 200 len: 1319 microversion: 2.1 time: 0.404494 Oct 22 20:48:42.279030 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 74/133] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:48:41 2022] GET /compute/v2.1/servers/f592a6fe-8cc7-4bb1-bb04-f8ddd358eeca => generated 1319 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:48:43.105216 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-7c107a35-447c-4658-bb54-02bb07bf15ff tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:48:43.107051 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-7c107a35-447c-4658-bb54-02bb07bf15ff tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] [instance: e169b57b-4899-4a9e-80a9-d6290eb63ceb] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:48:43.139306 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7c107a35-447c-4658-bb54-02bb07bf15ff tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:48:43.144776 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7c107a35-447c-4658-bb54-02bb07bf15ff tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:48:43.158167 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7c107a35-447c-4658-bb54-02bb07bf15ff tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:48:43.164659 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7c107a35-447c-4658-bb54-02bb07bf15ff tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:48:43.167209 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7c107a35-447c-4658-bb54-02bb07bf15ff tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:48:43.167764 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7c107a35-447c-4658-bb54-02bb07bf15ff tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:48:43.209807 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:SELECT=100 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:48:43.290447 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-ae769997-37e0-4c8c-a549-5b880ed5cc21 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:48:43.291101 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-ae769997-37e0-4c8c-a549-5b880ed5cc21 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] [instance: f592a6fe-8cc7-4bb1-bb04-f8ddd358eeca] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:48:43.311894 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ae769997-37e0-4c8c-a549-5b880ed5cc21 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:48:43.314162 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ae769997-37e0-4c8c-a549-5b880ed5cc21 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:48:43.315430 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ae769997-37e0-4c8c-a549-5b880ed5cc21 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:48:43.325119 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ae769997-37e0-4c8c-a549-5b880ed5cc21 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:48:43.326292 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ae769997-37e0-4c8c-a549-5b880ed5cc21 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:48:43.328361 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ae769997-37e0-4c8c-a549-5b880ed5cc21 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:48:43.379122 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-7c107a35-447c-4658-bb54-02bb07bf15ff tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6de80d628cf14694af6d2cd16f16afad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae95f5dee52f4235b3478cc90f3b0347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:48:43.391177 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-7c107a35-447c-4658-bb54-02bb07bf15ff tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] 10.222.0.18 "GET /compute/v2.1/servers/e169b57b-4899-4a9e-80a9-d6290eb63ceb" status: 200 len: 1338 microversion: 2.1 time: 0.295407 Oct 22 20:48:43.392132 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 60/134] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:48:43 2022] GET /compute/v2.1/servers/e169b57b-4899-4a9e-80a9-d6290eb63ceb => generated 1338 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:48:43.553388 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-ae769997-37e0-4c8c-a549-5b880ed5cc21 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e13dcabaaa4b218945aeeabb4c902e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675a324f0134844a1964f64322493ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:48:43.575839 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-ae769997-37e0-4c8c-a549-5b880ed5cc21 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] 10.222.0.18 "GET /compute/v2.1/servers/f592a6fe-8cc7-4bb1-bb04-f8ddd358eeca" status: 200 len: 1319 microversion: 2.1 time: 0.289824 Oct 22 20:48:43.576674 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 75/135] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:48:43 2022] GET /compute/v2.1/servers/f592a6fe-8cc7-4bb1-bb04-f8ddd358eeca => generated 1319 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:48:44.416232 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-ef1df482-266c-4004-a7e0-1d2eb27b635c tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:48:44.417506 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-ef1df482-266c-4004-a7e0-1d2eb27b635c tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] [instance: e169b57b-4899-4a9e-80a9-d6290eb63ceb] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:48:44.423665 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ef1df482-266c-4004-a7e0-1d2eb27b635c tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:48:44.424465 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ef1df482-266c-4004-a7e0-1d2eb27b635c tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:48:44.425164 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ef1df482-266c-4004-a7e0-1d2eb27b635c tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:48:44.426036 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ef1df482-266c-4004-a7e0-1d2eb27b635c tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:48:44.426639 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ef1df482-266c-4004-a7e0-1d2eb27b635c tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:48:44.427309 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ef1df482-266c-4004-a7e0-1d2eb27b635c tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:48:44.600983 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-f0a8c444-bac7-4f36-a193-eabd86b3aac1 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:48:44.602009 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-f0a8c444-bac7-4f36-a193-eabd86b3aac1 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] [instance: f592a6fe-8cc7-4bb1-bb04-f8ddd358eeca] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:48:44.608858 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f0a8c444-bac7-4f36-a193-eabd86b3aac1 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:48:44.609354 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f0a8c444-bac7-4f36-a193-eabd86b3aac1 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:48:44.609844 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f0a8c444-bac7-4f36-a193-eabd86b3aac1 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:48:44.610601 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f0a8c444-bac7-4f36-a193-eabd86b3aac1 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:48:44.611137 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f0a8c444-bac7-4f36-a193-eabd86b3aac1 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:48:44.611653 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f0a8c444-bac7-4f36-a193-eabd86b3aac1 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:48:44.624870 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-ef1df482-266c-4004-a7e0-1d2eb27b635c tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6de80d628cf14694af6d2cd16f16afad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae95f5dee52f4235b3478cc90f3b0347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:48:44.638511 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-ef1df482-266c-4004-a7e0-1d2eb27b635c tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] 10.222.0.18 "GET /compute/v2.1/servers/e169b57b-4899-4a9e-80a9-d6290eb63ceb" status: 200 len: 1338 microversion: 2.1 time: 0.227106 Oct 22 20:48:44.660818 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 61/136] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:48:44 2022] GET /compute/v2.1/servers/e169b57b-4899-4a9e-80a9-d6290eb63ceb => generated 1338 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:48:44.799195 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-f0a8c444-bac7-4f36-a193-eabd86b3aac1 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e13dcabaaa4b218945aeeabb4c902e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675a324f0134844a1964f64322493ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:48:44.808065 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-f0a8c444-bac7-4f36-a193-eabd86b3aac1 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] 10.222.0.18 "GET /compute/v2.1/servers/f592a6fe-8cc7-4bb1-bb04-f8ddd358eeca" status: 200 len: 1319 microversion: 2.1 time: 0.211839 Oct 22 20:48:44.808835 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 76/137] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:48:44 2022] GET /compute/v2.1/servers/f592a6fe-8cc7-4bb1-bb04-f8ddd358eeca => generated 1319 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:48:45.054798 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-607fc1b0-c85e-4700-bbfc-14fc258cd675 tempest-InstanceUsageAuditLogNegativeTestJSON-437066011 tempest-InstanceUsageAuditLogNegativeTestJSON-437066011-project-admin] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:48:45.057600 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-607fc1b0-c85e-4700-bbfc-14fc258cd675 tempest-InstanceUsageAuditLogNegativeTestJSON-437066011 tempest-InstanceUsageAuditLogNegativeTestJSON-437066011-project-admin] HTTP exception thrown: Invalid timestamp for date invalid_time Oct 22 20:48:45.071703 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-607fc1b0-c85e-4700-bbfc-14fc258cd675 tempest-InstanceUsageAuditLogNegativeTestJSON-437066011 tempest-InstanceUsageAuditLogNegativeTestJSON-437066011-project-admin] Request method failure captured: Oct 22 20:48:45.071703 ncdv-master-1 devstack@n-api.service[138744]: request: GET /compute/v2.1/os-instance_usage_audit_log/invalid_time HTTP/1.1 Oct 22 20:48:45.071703 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 20:48:45.071703 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 20:48:45.071703 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 20:48:45.071703 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 0 Oct 22 20:48:45.071703 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 20:48:45.071703 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 20:48:45.071703 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 20:48:45.071703 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 20:48:45.071703 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVFcsPT5NTAiQRzoZSoU7_LICGYxPFQD1ZZJulXCOVH6zTrwR6wjaOFWiNvPeAwtMQNd9mK05ABAFzQlFKMlDj59_wXup-4Y5t84Gb6J3WnYp91Keg8-2rLcn1v645w_VRhESV5F3oy_SsTx9Pq8aHArg9WuJh1gfN-pncf8eQHVLK-U Oct 22 20:48:45.071703 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 20:48:45.071703 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 20:48:45.071703 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 20:48:45.071703 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 20:48:45.071703 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 20:48:45.071703 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 20:48:45.071703 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: 7801d00b1d4547e09a9568e4c0302cd5 Oct 22 20:48:45.071703 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-437066011 Oct 22 20:48:45.071703 ncdv-master-1 devstack@n-api.service[138744]: X-Role: admin,member,reader Oct 22 20:48:45.071703 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: admin,member,reader Oct 22 20:48:45.073065 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_7801d00b1d4547e09a9568e4c0302cd5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7801d00b1d4547e09a9568e4c0302cd5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/7801d00b1d4547e09a9568e4c0302cd5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7801d00b1d4547e09a9568e4c0302cd5"}]}] Oct 22 20:48:45.073065 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-437066011 Oct 22 20:48:45.073065 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: 7801d00b1d4547e09a9568e4c0302cd5 Oct 22 20:48:45.073065 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-437066011 Oct 22 20:48:45.073065 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-437066011-project-admin Oct 22 20:48:45.073065 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 20:48:45.073065 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 20:48:45.073065 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: 43c0f788891f4f4385dea27b9558f9b7 Oct 22 20:48:45.073065 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-437066011-project-admin Oct 22 20:48:45.073065 ncdv-master-1 devstack@n-api.service[138744]: method: > Oct 22 20:48:45.073065 ncdv-master-1 devstack@n-api.service[138744]: exception: Invalid timestamp for date invalid_time Oct 22 20:48:45.073689 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': 'invalid_time'} Oct 22 20:48:45.073689 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:48:45.073689 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:48:45.073689 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 51, in show Oct 22 20:48:45.073689 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi before_date = datetime.datetime.strptime(str(id), Oct 22 20:48:45.073689 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 568, in _strptime_datetime Oct 22 20:48:45.073689 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi tt, fraction, gmtoff_fraction = _strptime(data_string, format) Oct 22 20:48:45.073689 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 349, in _strptime Oct 22 20:48:45.073689 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise ValueError("time data %r does not match format %r" % Oct 22 20:48:45.073689 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi ValueError: time data 'invalid_time' does not match format '%Y-%m-%d %H:%M:%S' Oct 22 20:48:45.073689 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:48:45.073689 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:48:45.073689 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:48:45.073689 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:48:45.073689 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:48:45.073689 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:48:45.073689 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:48:45.073689 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:48:45.073689 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:48:45.073689 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:48:45.074912 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 55, in show Oct 22 20:48:45.074912 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=msg) Oct 22 20:48:45.074912 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid timestamp for date invalid_time Oct 22 20:48:45.074912 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:48:45.074912 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:48:45.074912 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:48:45.074912 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:48:45.074912 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:48:45.074912 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:48:45.074912 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 20:48:45.074912 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 20:48:45.074912 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid timestamp for date invalid_time Oct 22 20:48:45.074912 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:48:45.076270 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-607fc1b0-c85e-4700-bbfc-14fc258cd675 tempest-InstanceUsageAuditLogNegativeTestJSON-437066011 tempest-InstanceUsageAuditLogNegativeTestJSON-437066011-project-admin] Returning 400 to user: Invalid timestamp for date invalid_time {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:48:45.077216 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-607fc1b0-c85e-4700-bbfc-14fc258cd675 tempest-InstanceUsageAuditLogNegativeTestJSON-437066011 tempest-InstanceUsageAuditLogNegativeTestJSON-437066011-project-admin] 10.222.0.18 "GET /compute/v2.1/os-instance_usage_audit_log/invalid_time" status: 400 len: 83 microversion: 2.1 time: 0.415572 Oct 22 20:48:45.078103 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 62/138] 10.222.0.18 () {58 vars in 1224 bytes} [Sat Oct 22 20:48:44 2022] GET /compute/v2.1/os-instance_usage_audit_log/invalid_time => generated 83 bytes in 417 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 22 20:48:45.275019 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-5cf791c2-2fd4-49bd-85aa-0de0db22ca3f tempest-InstanceUsageAuditLogNegativeTestJSON-750084291 tempest-InstanceUsageAuditLogNegativeTestJSON-750084291-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:48:45.276825 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-5cf791c2-2fd4-49bd-85aa-0de0db22ca3f tempest-InstanceUsageAuditLogNegativeTestJSON-750084291 tempest-InstanceUsageAuditLogNegativeTestJSON-750084291-project] Policy check for os_compute_api:os-instance-usage-audit-log:list failed with credentials {'is_admin': False, 'user_id': 'aff8a073aa72462aa68a41a569beb4b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fda9acc13ed24b8ca7d94eec9a3dd865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:48:45.280435 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-5cf791c2-2fd4-49bd-85aa-0de0db22ca3f tempest-InstanceUsageAuditLogNegativeTestJSON-750084291 tempest-InstanceUsageAuditLogNegativeTestJSON-750084291-project] Request method failure captured: Oct 22 20:48:45.280435 ncdv-master-1 devstack@n-api.service[138745]: request: GET /compute/v2.1/os-instance_usage_audit_log HTTP/1.1 Oct 22 20:48:45.280435 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 20:48:45.280435 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 20:48:45.280435 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 20:48:45.280435 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 0 Oct 22 20:48:45.280435 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 20:48:45.280435 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 20:48:45.280435 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 20:48:45.280435 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 20:48:45.280435 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVFcqagwQtkZbWZfMbJerLNG3mZd_7ABXDJPxdQVMBfzyXFbsBC107YuFDqLd9V6-ziuEBfn6B9wyuY2jY-p9JKo2yZ7T8vs3FQrh8t9Mw-0EQBbx3arwY1PpcoaT9dTDF34xhEARR5UUkjd9klR1RuDz-PgGP-PY1_hPuHma1D5CYNk Oct 22 20:48:45.280435 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 20:48:45.280435 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 20:48:45.280435 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 20:48:45.280435 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 20:48:45.280435 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 20:48:45.280435 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 20:48:45.280435 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: fda9acc13ed24b8ca7d94eec9a3dd865 Oct 22 20:48:45.280435 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-750084291 Oct 22 20:48:45.280435 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 20:48:45.280435 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 20:48:45.281573 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_fda9acc13ed24b8ca7d94eec9a3dd865"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fda9acc13ed24b8ca7d94eec9a3dd865"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/fda9acc13ed24b8ca7d94eec9a3dd865"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fda9acc13ed24b8ca7d94eec9a3dd865"}]}] Oct 22 20:48:45.281573 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-750084291 Oct 22 20:48:45.281573 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: fda9acc13ed24b8ca7d94eec9a3dd865 Oct 22 20:48:45.281573 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-750084291 Oct 22 20:48:45.281573 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-750084291-project Oct 22 20:48:45.281573 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 20:48:45.281573 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 20:48:45.281573 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: aff8a073aa72462aa68a41a569beb4b2 Oct 22 20:48:45.281573 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-750084291-project Oct 22 20:48:45.281573 ncdv-master-1 devstack@n-api.service[138745]: method: > Oct 22 20:48:45.282116 ncdv-master-1 devstack@n-api.service[138745]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Oct 22 20:48:45.282116 ncdv-master-1 devstack@n-api.service[138745]: action_args: {} Oct 22 20:48:45.282116 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:48:45.282116 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:48:45.282116 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:48:45.282116 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:48:45.282116 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:48:45.282116 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:48:45.282116 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:48:45.282116 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:48:45.282116 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 38, in index Oct 22 20:48:45.282116 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'list', target={}) Oct 22 20:48:45.282116 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 22 20:48:45.282116 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 22 20:48:45.282116 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 22 20:48:45.282116 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 22 20:48:45.282116 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 22 20:48:45.282116 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 22 20:48:45.282116 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 22 20:48:45.282116 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise self.value Oct 22 20:48:45.283098 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 22 20:48:45.283098 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 22 20:48:45.283098 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 22 20:48:45.283098 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 22 20:48:45.283098 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 22 20:48:45.283098 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 22 20:48:45.283098 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Oct 22 20:48:45.283098 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:48:45.283098 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:48:45.283098 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:48:45.283098 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:48:45.283098 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:48:45.283098 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:48:45.283098 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 22 20:48:45.283098 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 22 20:48:45.283098 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Oct 22 20:48:45.283098 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:48:45.284604 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-5cf791c2-2fd4-49bd-85aa-0de0db22ca3f tempest-InstanceUsageAuditLogNegativeTestJSON-750084291 tempest-InstanceUsageAuditLogNegativeTestJSON-750084291-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:48:45.284604 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-5cf791c2-2fd4-49bd-85aa-0de0db22ca3f tempest-InstanceUsageAuditLogNegativeTestJSON-750084291 tempest-InstanceUsageAuditLogNegativeTestJSON-750084291-project] 10.222.0.18 "GET /compute/v2.1/os-instance_usage_audit_log" status: 403 len: 128 microversion: 2.1 time: 0.198242 Oct 22 20:48:45.284604 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 77/139] 10.222.0.18 () {58 vars in 1185 bytes} [Sat Oct 22 20:48:45 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 128 bytes in 199 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 22 20:48:45.291873 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-984c4a3e-6f61-4f5c-80d1-2098b34b8674 tempest-InstanceUsageAuditLogNegativeTestJSON-750084291 tempest-InstanceUsageAuditLogNegativeTestJSON-750084291-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:48:45.293726 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-984c4a3e-6f61-4f5c-80d1-2098b34b8674 tempest-InstanceUsageAuditLogNegativeTestJSON-750084291 tempest-InstanceUsageAuditLogNegativeTestJSON-750084291-project] Policy check for os_compute_api:os-instance-usage-audit-log:show failed with credentials {'is_admin': False, 'user_id': 'aff8a073aa72462aa68a41a569beb4b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fda9acc13ed24b8ca7d94eec9a3dd865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:48:45.295926 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-984c4a3e-6f61-4f5c-80d1-2098b34b8674 tempest-InstanceUsageAuditLogNegativeTestJSON-750084291 tempest-InstanceUsageAuditLogNegativeTestJSON-750084291-project] Request method failure captured: Oct 22 20:48:45.295926 ncdv-master-1 devstack@n-api.service[138744]: request: GET /compute/v2.1/os-instance_usage_audit_log/2022-10-22%2020:48:45 HTTP/1.1 Oct 22 20:48:45.295926 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 20:48:45.295926 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 20:48:45.295926 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 20:48:45.295926 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 0 Oct 22 20:48:45.295926 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 20:48:45.295926 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 20:48:45.295926 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 20:48:45.295926 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 20:48:45.295926 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVFcqagwQtkZbWZfMbJerLNG3mZd_7ABXDJPxdQVMBfzyXFbsBC107YuFDqLd9V6-ziuEBfn6B9wyuY2jY-p9JKo2yZ7T8vs3FQrh8t9Mw-0EQBbx3arwY1PpcoaT9dTDF34xhEARR5UUkjd9klR1RuDz-PgGP-PY1_hPuHma1D5CYNk Oct 22 20:48:45.295926 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 20:48:45.295926 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 20:48:45.295926 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 20:48:45.295926 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 20:48:45.295926 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 20:48:45.295926 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 20:48:45.295926 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: fda9acc13ed24b8ca7d94eec9a3dd865 Oct 22 20:48:45.295926 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-750084291 Oct 22 20:48:45.295926 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 20:48:45.295926 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 20:48:45.297210 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_fda9acc13ed24b8ca7d94eec9a3dd865"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fda9acc13ed24b8ca7d94eec9a3dd865"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/fda9acc13ed24b8ca7d94eec9a3dd865"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fda9acc13ed24b8ca7d94eec9a3dd865"}]}] Oct 22 20:48:45.297210 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-750084291 Oct 22 20:48:45.297210 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: fda9acc13ed24b8ca7d94eec9a3dd865 Oct 22 20:48:45.297210 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-750084291 Oct 22 20:48:45.297210 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-750084291-project Oct 22 20:48:45.297210 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 20:48:45.297210 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 20:48:45.297210 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: aff8a073aa72462aa68a41a569beb4b2 Oct 22 20:48:45.297210 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-750084291-project Oct 22 20:48:45.297210 ncdv-master-1 devstack@n-api.service[138744]: method: > Oct 22 20:48:45.297865 ncdv-master-1 devstack@n-api.service[138744]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Oct 22 20:48:45.297865 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': '2022-10-22 20:48:45'} Oct 22 20:48:45.297865 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:48:45.297865 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:48:45.297865 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:48:45.297865 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:48:45.297865 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:48:45.297865 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:48:45.297865 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:48:45.297865 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:48:45.297865 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 45, in show Oct 22 20:48:45.297865 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'show', target={}) Oct 22 20:48:45.297865 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 22 20:48:45.297865 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 22 20:48:45.297865 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 22 20:48:45.297865 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 22 20:48:45.297865 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 22 20:48:45.297865 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 22 20:48:45.297865 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 22 20:48:45.297865 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise self.value Oct 22 20:48:45.299104 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 22 20:48:45.299104 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 22 20:48:45.299104 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 22 20:48:45.299104 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 22 20:48:45.299104 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 22 20:48:45.299104 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 22 20:48:45.299104 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Oct 22 20:48:45.299104 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:48:45.299104 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:48:45.299104 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:48:45.299104 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:48:45.299104 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:48:45.299104 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:48:45.299104 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 22 20:48:45.299104 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 22 20:48:45.299104 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Oct 22 20:48:45.299104 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:48:45.300301 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-984c4a3e-6f61-4f5c-80d1-2098b34b8674 tempest-InstanceUsageAuditLogNegativeTestJSON-750084291 tempest-InstanceUsageAuditLogNegativeTestJSON-750084291-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:48:45.300301 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-984c4a3e-6f61-4f5c-80d1-2098b34b8674 tempest-InstanceUsageAuditLogNegativeTestJSON-750084291 tempest-InstanceUsageAuditLogNegativeTestJSON-750084291-project] 10.222.0.18 "GET /compute/v2.1/os-instance_usage_audit_log/2022-10-22 20:48:45" status: 403 len: 128 microversion: 2.1 time: 0.009307 Oct 22 20:48:45.302575 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 63/140] 10.222.0.18 () {58 vars in 1251 bytes} [Sat Oct 22 20:48:45 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-10-22%2020%3A48%3A45 => generated 128 bytes in 16 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 22 20:48:45.683437 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-71ec97c0-9603-4d0f-a516-b2d3f933ae2f tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:48:45.684122 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-71ec97c0-9603-4d0f-a516-b2d3f933ae2f tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] [instance: e169b57b-4899-4a9e-80a9-d6290eb63ceb] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:48:45.690613 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-71ec97c0-9603-4d0f-a516-b2d3f933ae2f tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:48:45.691333 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-71ec97c0-9603-4d0f-a516-b2d3f933ae2f tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:48:45.691885 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-71ec97c0-9603-4d0f-a516-b2d3f933ae2f tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:48:45.692788 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-71ec97c0-9603-4d0f-a516-b2d3f933ae2f tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:48:45.693265 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-71ec97c0-9603-4d0f-a516-b2d3f933ae2f tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:48:45.693785 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-71ec97c0-9603-4d0f-a516-b2d3f933ae2f tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:48:45.744572 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-dc50192d-be7d-4445-8802-e1e528aaf809 tempest-HypervisorAdminV228Test-1105290374 tempest-HypervisorAdminV228Test-1105290374-project-admin] Calling method '.version_select at 0x7fd3a4e30b80>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:48:45.746376 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-dc50192d-be7d-4445-8802-e1e528aaf809 tempest-HypervisorAdminV228Test-1105290374 tempest-HypervisorAdminV228Test-1105290374-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:48:45.747043 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-dc50192d-be7d-4445-8802-e1e528aaf809 tempest-HypervisorAdminV228Test-1105290374 tempest-HypervisorAdminV228Test-1105290374-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:48:45.747517 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-dc50192d-be7d-4445-8802-e1e528aaf809 tempest-HypervisorAdminV228Test-1105290374 tempest-HypervisorAdminV228Test-1105290374-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:48:45.778451 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-dc50192d-be7d-4445-8802-e1e528aaf809 tempest-HypervisorAdminV228Test-1105290374 tempest-HypervisorAdminV228Test-1105290374-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:48:45.778946 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-dc50192d-be7d-4445-8802-e1e528aaf809 tempest-HypervisorAdminV228Test-1105290374 tempest-HypervisorAdminV228Test-1105290374-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:48:45.779537 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-dc50192d-be7d-4445-8802-e1e528aaf809 tempest-HypervisorAdminV228Test-1105290374 tempest-HypervisorAdminV228Test-1105290374-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:48:45.794584 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-dc50192d-be7d-4445-8802-e1e528aaf809 tempest-HypervisorAdminV228Test-1105290374 tempest-HypervisorAdminV228Test-1105290374-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:48:45.795306 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-dc50192d-be7d-4445-8802-e1e528aaf809 tempest-HypervisorAdminV228Test-1105290374 tempest-HypervisorAdminV228Test-1105290374-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:48:45.795769 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-dc50192d-be7d-4445-8802-e1e528aaf809 tempest-HypervisorAdminV228Test-1105290374 tempest-HypervisorAdminV228Test-1105290374-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:48:45.802270 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-dc50192d-be7d-4445-8802-e1e528aaf809 tempest-HypervisorAdminV228Test-1105290374 tempest-HypervisorAdminV228Test-1105290374-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.28 time: 0.336375 Oct 22 20:48:45.808873 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 78/141] 10.222.0.18 () {60 vars in 1187 bytes} [Sat Oct 22 20:48:45 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 22 20:48:45.813768 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-192f3b70-2a2e-433f-82b4-217a20d03a9b tempest-HypervisorAdminV228Test-1105290374 tempest-HypervisorAdminV228Test-1105290374-project-admin] Calling method '.version_select at 0x7fd3a4e4fca0>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:48:45.815877 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-192f3b70-2a2e-433f-82b4-217a20d03a9b tempest-HypervisorAdminV228Test-1105290374 tempest-HypervisorAdminV228Test-1105290374-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:48:45.816509 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-192f3b70-2a2e-433f-82b4-217a20d03a9b tempest-HypervisorAdminV228Test-1105290374 tempest-HypervisorAdminV228Test-1105290374-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:48:45.817112 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-192f3b70-2a2e-433f-82b4-217a20d03a9b tempest-HypervisorAdminV228Test-1105290374 tempest-HypervisorAdminV228Test-1105290374-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:48:45.836112 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-192f3b70-2a2e-433f-82b4-217a20d03a9b tempest-HypervisorAdminV228Test-1105290374 tempest-HypervisorAdminV228Test-1105290374-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:48:45.836808 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-192f3b70-2a2e-433f-82b4-217a20d03a9b tempest-HypervisorAdminV228Test-1105290374 tempest-HypervisorAdminV228Test-1105290374-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:48:45.837380 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-192f3b70-2a2e-433f-82b4-217a20d03a9b tempest-HypervisorAdminV228Test-1105290374 tempest-HypervisorAdminV228Test-1105290374-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:48:45.844553 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-192f3b70-2a2e-433f-82b4-217a20d03a9b tempest-HypervisorAdminV228Test-1105290374 tempest-HypervisorAdminV228Test-1105290374-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 718 microversion: 2.28 time: 0.034346 Oct 22 20:48:45.855918 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 79/142] 10.222.0.18 () {60 vars in 1193 bytes} [Sat Oct 22 20:48:45 2022] GET /compute/v2.1/os-hypervisors/1 => generated 718 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 22 20:48:45.860922 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-7ea83845-d099-4d06-9c7a-8a9600279740 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:48:45.861523 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-7ea83845-d099-4d06-9c7a-8a9600279740 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] [instance: f592a6fe-8cc7-4bb1-bb04-f8ddd358eeca] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:48:45.867824 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7ea83845-d099-4d06-9c7a-8a9600279740 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:48:45.868546 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7ea83845-d099-4d06-9c7a-8a9600279740 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:48:45.869128 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7ea83845-d099-4d06-9c7a-8a9600279740 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:48:45.869960 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7ea83845-d099-4d06-9c7a-8a9600279740 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:48:45.870611 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7ea83845-d099-4d06-9c7a-8a9600279740 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:48:45.871400 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7ea83845-d099-4d06-9c7a-8a9600279740 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:48:45.873837 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-71ec97c0-9603-4d0f-a516-b2d3f933ae2f tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6de80d628cf14694af6d2cd16f16afad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae95f5dee52f4235b3478cc90f3b0347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:48:45.883619 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-71ec97c0-9603-4d0f-a516-b2d3f933ae2f tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] 10.222.0.18 "GET /compute/v2.1/servers/e169b57b-4899-4a9e-80a9-d6290eb63ceb" status: 200 len: 1338 microversion: 2.1 time: 0.204162 Oct 22 20:48:45.896247 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 64/143] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:48:45 2022] GET /compute/v2.1/servers/e169b57b-4899-4a9e-80a9-d6290eb63ceb => generated 1338 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:48:45.906254 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell1:SELECT=100 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:48:46.104755 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-7ea83845-d099-4d06-9c7a-8a9600279740 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e13dcabaaa4b218945aeeabb4c902e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675a324f0134844a1964f64322493ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:48:46.118065 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-7ea83845-d099-4d06-9c7a-8a9600279740 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] 10.222.0.18 "GET /compute/v2.1/servers/f592a6fe-8cc7-4bb1-bb04-f8ddd358eeca" status: 200 len: 1319 microversion: 2.1 time: 0.260885 Oct 22 20:48:46.121457 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 80/144] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:48:45 2022] GET /compute/v2.1/servers/f592a6fe-8cc7-4bb1-bb04-f8ddd358eeca => generated 1319 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:48:46.907398 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-970f3f4d-117e-4728-90a6-1728b9ffa73d tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:48:46.908020 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-970f3f4d-117e-4728-90a6-1728b9ffa73d tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] [instance: e169b57b-4899-4a9e-80a9-d6290eb63ceb] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:48:46.917512 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-970f3f4d-117e-4728-90a6-1728b9ffa73d tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:48:46.918020 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-970f3f4d-117e-4728-90a6-1728b9ffa73d tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:48:46.921120 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-970f3f4d-117e-4728-90a6-1728b9ffa73d tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:48:46.921918 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-970f3f4d-117e-4728-90a6-1728b9ffa73d tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:48:46.922388 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-970f3f4d-117e-4728-90a6-1728b9ffa73d tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:48:46.925708 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-970f3f4d-117e-4728-90a6-1728b9ffa73d tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:48:46.968904 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-5cfa4ee6-aeaa-4775-bc45-422f81f3652d tempest-HypervisorAdminTestJSON-903726693 tempest-HypervisorAdminTestJSON-903726693-project-admin] Calling method '.version_select at 0x7fd3a4eb4310>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:48:46.970690 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5cfa4ee6-aeaa-4775-bc45-422f81f3652d tempest-HypervisorAdminTestJSON-903726693 tempest-HypervisorAdminTestJSON-903726693-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:48:46.971175 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5cfa4ee6-aeaa-4775-bc45-422f81f3652d tempest-HypervisorAdminTestJSON-903726693 tempest-HypervisorAdminTestJSON-903726693-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:48:46.971637 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5cfa4ee6-aeaa-4775-bc45-422f81f3652d tempest-HypervisorAdminTestJSON-903726693 tempest-HypervisorAdminTestJSON-903726693-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:48:46.996707 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5cfa4ee6-aeaa-4775-bc45-422f81f3652d tempest-HypervisorAdminTestJSON-903726693 tempest-HypervisorAdminTestJSON-903726693-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:48:46.997491 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5cfa4ee6-aeaa-4775-bc45-422f81f3652d tempest-HypervisorAdminTestJSON-903726693 tempest-HypervisorAdminTestJSON-903726693-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:48:46.998461 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5cfa4ee6-aeaa-4775-bc45-422f81f3652d tempest-HypervisorAdminTestJSON-903726693 tempest-HypervisorAdminTestJSON-903726693-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:48:47.018259 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5cfa4ee6-aeaa-4775-bc45-422f81f3652d tempest-HypervisorAdminTestJSON-903726693 tempest-HypervisorAdminTestJSON-903726693-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:48:47.019299 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5cfa4ee6-aeaa-4775-bc45-422f81f3652d tempest-HypervisorAdminTestJSON-903726693 tempest-HypervisorAdminTestJSON-903726693-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:48:47.020099 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5cfa4ee6-aeaa-4775-bc45-422f81f3652d tempest-HypervisorAdminTestJSON-903726693 tempest-HypervisorAdminTestJSON-903726693-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:48:47.030510 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-5cfa4ee6-aeaa-4775-bc45-422f81f3652d tempest-HypervisorAdminTestJSON-903726693 tempest-HypervisorAdminTestJSON-903726693-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.510724 Oct 22 20:48:47.032010 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 65/145] 10.222.0.18 () {58 vars in 1146 bytes} [Sat Oct 22 20:48:46 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:48:47.054827 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-4572775c-5b02-4780-97c2-26c6194ac6d5 tempest-HypervisorAdminTestJSON-903726693 tempest-HypervisorAdminTestJSON-903726693-project-admin] Calling method '.version_select at 0x7fd3a4eb48b0>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:48:47.068832 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4572775c-5b02-4780-97c2-26c6194ac6d5 tempest-HypervisorAdminTestJSON-903726693 tempest-HypervisorAdminTestJSON-903726693-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:48:47.068832 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4572775c-5b02-4780-97c2-26c6194ac6d5 tempest-HypervisorAdminTestJSON-903726693 tempest-HypervisorAdminTestJSON-903726693-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:48:47.068832 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4572775c-5b02-4780-97c2-26c6194ac6d5 tempest-HypervisorAdminTestJSON-903726693 tempest-HypervisorAdminTestJSON-903726693-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:48:47.094761 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4572775c-5b02-4780-97c2-26c6194ac6d5 tempest-HypervisorAdminTestJSON-903726693 tempest-HypervisorAdminTestJSON-903726693-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:48:47.094761 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4572775c-5b02-4780-97c2-26c6194ac6d5 tempest-HypervisorAdminTestJSON-903726693 tempest-HypervisorAdminTestJSON-903726693-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:48:47.095093 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4572775c-5b02-4780-97c2-26c6194ac6d5 tempest-HypervisorAdminTestJSON-903726693 tempest-HypervisorAdminTestJSON-903726693-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:48:47.108547 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4572775c-5b02-4780-97c2-26c6194ac6d5 tempest-HypervisorAdminTestJSON-903726693 tempest-HypervisorAdminTestJSON-903726693-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:48:47.109589 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4572775c-5b02-4780-97c2-26c6194ac6d5 tempest-HypervisorAdminTestJSON-903726693 tempest-HypervisorAdminTestJSON-903726693-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:48:47.110253 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4572775c-5b02-4780-97c2-26c6194ac6d5 tempest-HypervisorAdminTestJSON-903726693 tempest-HypervisorAdminTestJSON-903726693-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:48:47.118972 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-4572775c-5b02-4780-97c2-26c6194ac6d5 tempest-HypervisorAdminTestJSON-903726693 tempest-HypervisorAdminTestJSON-903726693-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1505 microversion: 2.1 time: 0.070588 Oct 22 20:48:47.120136 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 66/146] 10.222.0.18 () {58 vars in 1167 bytes} [Sat Oct 22 20:48:47 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1505 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:48:47.136817 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-970f3f4d-117e-4728-90a6-1728b9ffa73d tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6de80d628cf14694af6d2cd16f16afad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae95f5dee52f4235b3478cc90f3b0347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:48:47.138133 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-887a55d8-1749-481e-8e0b-121ba49f1168 tempest-HypervisorAdminTestJSON-903726693 tempest-HypervisorAdminTestJSON-903726693-project-admin] Calling method '.version_select at 0x7fd3a5009dc0>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:48:47.140798 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-887a55d8-1749-481e-8e0b-121ba49f1168 tempest-HypervisorAdminTestJSON-903726693 tempest-HypervisorAdminTestJSON-903726693-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:48:47.145683 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-970f3f4d-117e-4728-90a6-1728b9ffa73d tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] 10.222.0.18 "GET /compute/v2.1/servers/e169b57b-4899-4a9e-80a9-d6290eb63ceb" status: 200 len: 1338 microversion: 2.1 time: 0.242766 Oct 22 20:48:47.145848 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-887a55d8-1749-481e-8e0b-121ba49f1168 tempest-HypervisorAdminTestJSON-903726693 tempest-HypervisorAdminTestJSON-903726693-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:48:47.147152 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-887a55d8-1749-481e-8e0b-121ba49f1168 tempest-HypervisorAdminTestJSON-903726693 tempest-HypervisorAdminTestJSON-903726693-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:48:47.151955 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 81/147] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:48:46 2022] GET /compute/v2.1/servers/e169b57b-4899-4a9e-80a9-d6290eb63ceb => generated 1338 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 20:48:47.158031 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-48946982-ef8f-4544-bb39-5895f4b8ce67 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:48:47.158715 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-48946982-ef8f-4544-bb39-5895f4b8ce67 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] [instance: f592a6fe-8cc7-4bb1-bb04-f8ddd358eeca] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:48:47.166925 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-48946982-ef8f-4544-bb39-5895f4b8ce67 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:48:47.167504 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-48946982-ef8f-4544-bb39-5895f4b8ce67 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:48:47.167945 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-48946982-ef8f-4544-bb39-5895f4b8ce67 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:48:47.169002 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-48946982-ef8f-4544-bb39-5895f4b8ce67 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:48:47.169463 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-48946982-ef8f-4544-bb39-5895f4b8ce67 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:48:47.169889 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-48946982-ef8f-4544-bb39-5895f4b8ce67 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:48:47.177724 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-887a55d8-1749-481e-8e0b-121ba49f1168 tempest-HypervisorAdminTestJSON-903726693 tempest-HypervisorAdminTestJSON-903726693-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:48:47.179168 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-887a55d8-1749-481e-8e0b-121ba49f1168 tempest-HypervisorAdminTestJSON-903726693 tempest-HypervisorAdminTestJSON-903726693-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:48:47.179977 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-887a55d8-1749-481e-8e0b-121ba49f1168 tempest-HypervisorAdminTestJSON-903726693 tempest-HypervisorAdminTestJSON-903726693-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:48:47.195825 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-887a55d8-1749-481e-8e0b-121ba49f1168 tempest-HypervisorAdminTestJSON-903726693 tempest-HypervisorAdminTestJSON-903726693-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:48:47.196733 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-887a55d8-1749-481e-8e0b-121ba49f1168 tempest-HypervisorAdminTestJSON-903726693 tempest-HypervisorAdminTestJSON-903726693-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:48:47.197565 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-887a55d8-1749-481e-8e0b-121ba49f1168 tempest-HypervisorAdminTestJSON-903726693 tempest-HypervisorAdminTestJSON-903726693-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:48:47.205050 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-887a55d8-1749-481e-8e0b-121ba49f1168 tempest-HypervisorAdminTestJSON-903726693 tempest-HypervisorAdminTestJSON-903726693-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.072589 Oct 22 20:48:47.205865 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 67/148] 10.222.0.18 () {58 vars in 1146 bytes} [Sat Oct 22 20:48:47 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 20:48:47.217595 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-9372c3b3-2cfb-4646-ae9b-5d41560bccb0 tempest-HypervisorAdminTestJSON-903726693 tempest-HypervisorAdminTestJSON-903726693-project-admin] Calling method '.version_select at 0x7fd3a4eb4670>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:48:47.219848 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9372c3b3-2cfb-4646-ae9b-5d41560bccb0 tempest-HypervisorAdminTestJSON-903726693 tempest-HypervisorAdminTestJSON-903726693-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:48:47.220523 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9372c3b3-2cfb-4646-ae9b-5d41560bccb0 tempest-HypervisorAdminTestJSON-903726693 tempest-HypervisorAdminTestJSON-903726693-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:48:47.221129 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9372c3b3-2cfb-4646-ae9b-5d41560bccb0 tempest-HypervisorAdminTestJSON-903726693 tempest-HypervisorAdminTestJSON-903726693-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:48:47.241899 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9372c3b3-2cfb-4646-ae9b-5d41560bccb0 tempest-HypervisorAdminTestJSON-903726693 tempest-HypervisorAdminTestJSON-903726693-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:48:47.243014 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9372c3b3-2cfb-4646-ae9b-5d41560bccb0 tempest-HypervisorAdminTestJSON-903726693 tempest-HypervisorAdminTestJSON-903726693-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:48:47.243641 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9372c3b3-2cfb-4646-ae9b-5d41560bccb0 tempest-HypervisorAdminTestJSON-903726693 tempest-HypervisorAdminTestJSON-903726693-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:48:47.250300 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-9372c3b3-2cfb-4646-ae9b-5d41560bccb0 tempest-HypervisorAdminTestJSON-903726693 tempest-HypervisorAdminTestJSON-903726693-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.036648 Oct 22 20:48:47.251026 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 68/149] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Oct 22 20:48:47 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:48:47.273274 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-f08d4ee9-7764-4063-968b-d3573eece66e tempest-HypervisorAdminTestJSON-903726693 tempest-HypervisorAdminTestJSON-903726693-project-admin] Calling method '.version_select at 0x7fd3a5043670>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:48:47.275149 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f08d4ee9-7764-4063-968b-d3573eece66e tempest-HypervisorAdminTestJSON-903726693 tempest-HypervisorAdminTestJSON-903726693-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:48:47.275668 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f08d4ee9-7764-4063-968b-d3573eece66e tempest-HypervisorAdminTestJSON-903726693 tempest-HypervisorAdminTestJSON-903726693-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:48:47.276236 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f08d4ee9-7764-4063-968b-d3573eece66e tempest-HypervisorAdminTestJSON-903726693 tempest-HypervisorAdminTestJSON-903726693-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:48:47.297547 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-f08d4ee9-7764-4063-968b-d3573eece66e tempest-HypervisorAdminTestJSON-903726693 tempest-HypervisorAdminTestJSON-903726693-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hypervisors/statistics" status: 200 len: 263 microversion: 2.1 time: 0.028560 Oct 22 20:48:47.298153 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 69/150] 10.222.0.18 () {58 vars in 1179 bytes} [Sat Oct 22 20:48:47 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 263 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:48:47.311908 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-114680ed-32eb-44c0-83ab-14da7260ee71 tempest-HypervisorAdminTestJSON-903726693 tempest-HypervisorAdminTestJSON-903726693-project-admin] Calling method '.version_select at 0x7fd3a4eb4ee0>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:48:47.314552 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-114680ed-32eb-44c0-83ab-14da7260ee71 tempest-HypervisorAdminTestJSON-903726693 tempest-HypervisorAdminTestJSON-903726693-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:48:47.315323 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-114680ed-32eb-44c0-83ab-14da7260ee71 tempest-HypervisorAdminTestJSON-903726693 tempest-HypervisorAdminTestJSON-903726693-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:48:47.318064 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-114680ed-32eb-44c0-83ab-14da7260ee71 tempest-HypervisorAdminTestJSON-903726693 tempest-HypervisorAdminTestJSON-903726693-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:48:47.328542 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-48946982-ef8f-4544-bb39-5895f4b8ce67 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e13dcabaaa4b218945aeeabb4c902e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675a324f0134844a1964f64322493ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:48:47.337454 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-114680ed-32eb-44c0-83ab-14da7260ee71 tempest-HypervisorAdminTestJSON-903726693 tempest-HypervisorAdminTestJSON-903726693-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:48:47.338159 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-114680ed-32eb-44c0-83ab-14da7260ee71 tempest-HypervisorAdminTestJSON-903726693 tempest-HypervisorAdminTestJSON-903726693-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:48:47.338324 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-48946982-ef8f-4544-bb39-5895f4b8ce67 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] 10.222.0.18 "GET /compute/v2.1/servers/f592a6fe-8cc7-4bb1-bb04-f8ddd358eeca" status: 200 len: 1319 microversion: 2.1 time: 0.185245 Oct 22 20:48:47.338752 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-114680ed-32eb-44c0-83ab-14da7260ee71 tempest-HypervisorAdminTestJSON-903726693 tempest-HypervisorAdminTestJSON-903726693-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:48:47.339252 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 82/151] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:48:47 2022] GET /compute/v2.1/servers/f592a6fe-8cc7-4bb1-bb04-f8ddd358eeca => generated 1319 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:48:47.351589 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-114680ed-32eb-44c0-83ab-14da7260ee71 tempest-HypervisorAdminTestJSON-903726693 tempest-HypervisorAdminTestJSON-903726693-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:48:47.351589 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-114680ed-32eb-44c0-83ab-14da7260ee71 tempest-HypervisorAdminTestJSON-903726693 tempest-HypervisorAdminTestJSON-903726693-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:48:47.351589 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-114680ed-32eb-44c0-83ab-14da7260ee71 tempest-HypervisorAdminTestJSON-903726693 tempest-HypervisorAdminTestJSON-903726693-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:48:47.356893 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-114680ed-32eb-44c0-83ab-14da7260ee71 tempest-HypervisorAdminTestJSON-903726693 tempest-HypervisorAdminTestJSON-903726693-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.050238 Oct 22 20:48:47.357608 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 70/152] 10.222.0.18 () {58 vars in 1146 bytes} [Sat Oct 22 20:48:47 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:48:47.368740 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-ba1e00e3-b8d1-4b27-b0d7-7c7bb464a04c tempest-HypervisorAdminTestJSON-903726693 tempest-HypervisorAdminTestJSON-903726693-project-admin] Calling method '.version_select at 0x7fd3a50a3af0>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:48:47.370551 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ba1e00e3-b8d1-4b27-b0d7-7c7bb464a04c tempest-HypervisorAdminTestJSON-903726693 tempest-HypervisorAdminTestJSON-903726693-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:48:47.371032 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ba1e00e3-b8d1-4b27-b0d7-7c7bb464a04c tempest-HypervisorAdminTestJSON-903726693 tempest-HypervisorAdminTestJSON-903726693-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:48:47.371500 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ba1e00e3-b8d1-4b27-b0d7-7c7bb464a04c tempest-HypervisorAdminTestJSON-903726693 tempest-HypervisorAdminTestJSON-903726693-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:48:47.385260 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ba1e00e3-b8d1-4b27-b0d7-7c7bb464a04c tempest-HypervisorAdminTestJSON-903726693 tempest-HypervisorAdminTestJSON-903726693-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:48:47.386211 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ba1e00e3-b8d1-4b27-b0d7-7c7bb464a04c tempest-HypervisorAdminTestJSON-903726693 tempest-HypervisorAdminTestJSON-903726693-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:48:47.386650 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ba1e00e3-b8d1-4b27-b0d7-7c7bb464a04c tempest-HypervisorAdminTestJSON-903726693 tempest-HypervisorAdminTestJSON-903726693-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:48:47.394171 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-ba1e00e3-b8d1-4b27-b0d7-7c7bb464a04c tempest-HypervisorAdminTestJSON-903726693 tempest-HypervisorAdminTestJSON-903726693-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.029297 Oct 22 20:48:47.394759 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 83/153] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Oct 22 20:48:47 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:48:47.411645 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-919b6437-1525-45ef-897e-a557f30b4688 tempest-HypervisorAdminTestJSON-903726693 tempest-HypervisorAdminTestJSON-903726693-project-admin] Calling method '.version_select at 0x7fd3a4e97b80>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:48:47.413645 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-919b6437-1525-45ef-897e-a557f30b4688 tempest-HypervisorAdminTestJSON-903726693 tempest-HypervisorAdminTestJSON-903726693-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:48:47.414133 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-919b6437-1525-45ef-897e-a557f30b4688 tempest-HypervisorAdminTestJSON-903726693 tempest-HypervisorAdminTestJSON-903726693-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:48:47.414700 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-919b6437-1525-45ef-897e-a557f30b4688 tempest-HypervisorAdminTestJSON-903726693 tempest-HypervisorAdminTestJSON-903726693-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:48:47.428716 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-919b6437-1525-45ef-897e-a557f30b4688 tempest-HypervisorAdminTestJSON-903726693 tempest-HypervisorAdminTestJSON-903726693-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:48:47.429390 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-919b6437-1525-45ef-897e-a557f30b4688 tempest-HypervisorAdminTestJSON-903726693 tempest-HypervisorAdminTestJSON-903726693-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:48:47.430015 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-919b6437-1525-45ef-897e-a557f30b4688 tempest-HypervisorAdminTestJSON-903726693 tempest-HypervisorAdminTestJSON-903726693-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:48:47.437690 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-919b6437-1525-45ef-897e-a557f30b4688 tempest-HypervisorAdminTestJSON-903726693 tempest-HypervisorAdminTestJSON-903726693-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hypervisors/2" status: 200 len: 758 microversion: 2.1 time: 0.030824 Oct 22 20:48:47.438432 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 71/154] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Oct 22 20:48:47 2022] GET /compute/v2.1/os-hypervisors/2 => generated 758 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:48:47.453457 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-7afd57f1-a6e5-42c4-a83c-951d346a6b6e tempest-HypervisorAdminTestJSON-903726693 tempest-HypervisorAdminTestJSON-903726693-project-admin] Calling method '.version_select at 0x7fd3a4e3a280>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:48:47.455212 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7afd57f1-a6e5-42c4-a83c-951d346a6b6e tempest-HypervisorAdminTestJSON-903726693 tempest-HypervisorAdminTestJSON-903726693-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:48:47.455918 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7afd57f1-a6e5-42c4-a83c-951d346a6b6e tempest-HypervisorAdminTestJSON-903726693 tempest-HypervisorAdminTestJSON-903726693-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:48:47.456509 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7afd57f1-a6e5-42c4-a83c-951d346a6b6e tempest-HypervisorAdminTestJSON-903726693 tempest-HypervisorAdminTestJSON-903726693-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:48:47.470719 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7afd57f1-a6e5-42c4-a83c-951d346a6b6e tempest-HypervisorAdminTestJSON-903726693 tempest-HypervisorAdminTestJSON-903726693-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:48:47.471390 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7afd57f1-a6e5-42c4-a83c-951d346a6b6e tempest-HypervisorAdminTestJSON-903726693 tempest-HypervisorAdminTestJSON-903726693-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:48:47.472138 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7afd57f1-a6e5-42c4-a83c-951d346a6b6e tempest-HypervisorAdminTestJSON-903726693 tempest-HypervisorAdminTestJSON-903726693-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:48:47.482893 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7afd57f1-a6e5-42c4-a83c-951d346a6b6e tempest-HypervisorAdminTestJSON-903726693 tempest-HypervisorAdminTestJSON-903726693-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:48:47.483609 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7afd57f1-a6e5-42c4-a83c-951d346a6b6e tempest-HypervisorAdminTestJSON-903726693 tempest-HypervisorAdminTestJSON-903726693-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:48:47.484046 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7afd57f1-a6e5-42c4-a83c-951d346a6b6e tempest-HypervisorAdminTestJSON-903726693 tempest-HypervisorAdminTestJSON-903726693-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:48:47.511667 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-7afd57f1-a6e5-42c4-a83c-951d346a6b6e tempest-HypervisorAdminTestJSON-903726693 tempest-HypervisorAdminTestJSON-903726693-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 200 len: 175 microversion: 2.1 time: 0.061834 Oct 22 20:48:47.512492 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 84/155] 10.222.0.18 () {58 vars in 1173 bytes} [Sat Oct 22 20:48:47 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 175 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:48:48.031550 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-99f6f064-d02c-4b44-bcb4-8230acd0f836 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdmin275Test-server-853091664", "imageRef": "085e4478-6edc-4a69-8e08-f9831713eb65", "flavorRef": "452", "networks": "none"}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:48:48.046140 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell0:SELECT=2 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:48:48.055469 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell0:SELECT=12 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:48:48.113666 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-99f6f064-d02c-4b44-bcb4-8230acd0f836 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Flavor limits 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 20:48:48.114166 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-99f6f064-d02c-4b44-bcb4-8230acd0f836 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Image limits 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 20:48:48.114857 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-99f6f064-d02c-4b44-bcb4-8230acd0f836 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Flavor pref 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 20:48:48.115479 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-99f6f064-d02c-4b44-bcb4-8230acd0f836 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Image pref 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 20:48:48.116338 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-99f6f064-d02c-4b44-bcb4-8230acd0f836 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 20:48:48.127637 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-99f6f064-d02c-4b44-bcb4-8230acd0f836 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:48:48.128214 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-99f6f064-d02c-4b44-bcb4-8230acd0f836 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:48:48.128663 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-99f6f064-d02c-4b44-bcb4-8230acd0f836 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:48:48.129646 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-99f6f064-d02c-4b44-bcb4-8230acd0f836 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:48:48.130120 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-99f6f064-d02c-4b44-bcb4-8230acd0f836 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:48:48.130887 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-99f6f064-d02c-4b44-bcb4-8230acd0f836 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:48:48.152066 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-99f6f064-d02c-4b44-bcb4-8230acd0f836 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Getting quotas for project 1a20f8f858424c89bf67a56feb720ac9. Resources: {'cores', 'instances', 'ram'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 20:48:48.156983 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-99f6f064-d02c-4b44-bcb4-8230acd0f836 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Getting quotas for user ed1ce98c66024d49b31e8e4f38b82838 and project 1a20f8f858424c89bf67a56feb720ac9. Resources: {'cores', 'instances', 'ram'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 20:48:48.170261 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-364c9436-eab1-43e3-9599-b3e51aec41b9 tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:48:48.171784 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-364c9436-eab1-43e3-9599-b3e51aec41b9 tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] [instance: e169b57b-4899-4a9e-80a9-d6290eb63ceb] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:48:48.179757 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-99f6f064-d02c-4b44-bcb4-8230acd0f836 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Going to run 1 instances... {{(pid=138744) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 20:48:48.182822 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-364c9436-eab1-43e3-9599-b3e51aec41b9 tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:48:48.183015 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-99f6f064-d02c-4b44-bcb4-8230acd0f836 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] [instance: 5c3de24c-090d-4769-8975-207eb939b979] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='085e4478-6edc-4a69-8e08-f9831713eb65',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138744) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 20:48:48.183757 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-364c9436-eab1-43e3-9599-b3e51aec41b9 tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:48:48.184398 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-364c9436-eab1-43e3-9599-b3e51aec41b9 tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:48:48.185403 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-364c9436-eab1-43e3-9599-b3e51aec41b9 tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:48:48.186002 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-364c9436-eab1-43e3-9599-b3e51aec41b9 tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:48:48.186606 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-364c9436-eab1-43e3-9599-b3e51aec41b9 tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:48:48.258348 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-99f6f064-d02c-4b44-bcb4-8230acd0f836 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.75 time: 0.444456 Oct 22 20:48:48.259691 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 72/156] 10.222.0.18 () {62 vars in 1188 bytes} [Sat Oct 22 20:48:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 446 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 22 20:48:48.272392 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-bc8f46ad-a2bb-4839-af43-5952a3b34b55 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:48:48.276203 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-bc8f46ad-a2bb-4839-af43-5952a3b34b55 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] [instance: 5c3de24c-090d-4769-8975-207eb939b979] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:48:48.426323 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-bc8f46ad-a2bb-4839-af43-5952a3b34b55 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1ce98c66024d49b31e8e4f38b82838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a20f8f858424c89bf67a56feb720ac9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:48:48.440357 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-bc8f46ad-a2bb-4839-af43-5952a3b34b55 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed1ce98c66024d49b31e8e4f38b82838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a20f8f858424c89bf67a56feb720ac9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:48:48.443752 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-bc8f46ad-a2bb-4839-af43-5952a3b34b55 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed1ce98c66024d49b31e8e4f38b82838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a20f8f858424c89bf67a56feb720ac9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:48:48.465995 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-bc8f46ad-a2bb-4839-af43-5952a3b34b55 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] 10.222.0.18 "PUT /compute/v2.1/servers/5c3de24c-090d-4769-8975-207eb939b979" status: 200 len: 1358 microversion: 2.75 time: 0.197425 Oct 22 20:48:48.471656 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 73/157] 10.222.0.18 () {62 vars in 1297 bytes} [Sat Oct 22 20:48:48 2022] PUT /compute/v2.1/servers/5c3de24c-090d-4769-8975-207eb939b979 => generated 1358 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 20:48:48.483614 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-08e8790e-9f4a-4787-9833-7a84f958a617 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:48:48.487615 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-08e8790e-9f4a-4787-9833-7a84f958a617 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] [instance: f592a6fe-8cc7-4bb1-bb04-f8ddd358eeca] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:48:48.490888 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-364c9436-eab1-43e3-9599-b3e51aec41b9 tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6de80d628cf14694af6d2cd16f16afad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae95f5dee52f4235b3478cc90f3b0347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:48:48.497986 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-08e8790e-9f4a-4787-9833-7a84f958a617 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:48:48.499746 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-08e8790e-9f4a-4787-9833-7a84f958a617 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:48:48.500920 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-08e8790e-9f4a-4787-9833-7a84f958a617 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:48:48.501888 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-08e8790e-9f4a-4787-9833-7a84f958a617 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:48:48.502475 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-08e8790e-9f4a-4787-9833-7a84f958a617 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:48:48.503171 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-08e8790e-9f4a-4787-9833-7a84f958a617 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:48:48.522578 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-364c9436-eab1-43e3-9599-b3e51aec41b9 tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] 10.222.0.18 "GET /compute/v2.1/servers/e169b57b-4899-4a9e-80a9-d6290eb63ceb" status: 200 len: 1338 microversion: 2.1 time: 0.356953 Oct 22 20:48:48.524965 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 85/158] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:48:48 2022] GET /compute/v2.1/servers/e169b57b-4899-4a9e-80a9-d6290eb63ceb => generated 1338 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 20:48:48.541318 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-7fe8d8d3-1cdf-4ae3-be43-7f7bdb4c4f85 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:48:48.542741 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-7fe8d8d3-1cdf-4ae3-be43-7f7bdb4c4f85 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] [instance: 5c3de24c-090d-4769-8975-207eb939b979] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:48:48.706716 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-7fe8d8d3-1cdf-4ae3-be43-7f7bdb4c4f85 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1ce98c66024d49b31e8e4f38b82838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a20f8f858424c89bf67a56feb720ac9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:48:48.725611 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-7fe8d8d3-1cdf-4ae3-be43-7f7bdb4c4f85 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed1ce98c66024d49b31e8e4f38b82838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a20f8f858424c89bf67a56feb720ac9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:48:48.727445 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-7fe8d8d3-1cdf-4ae3-be43-7f7bdb4c4f85 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed1ce98c66024d49b31e8e4f38b82838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a20f8f858424c89bf67a56feb720ac9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:48:48.736977 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell0:SELECT=9 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:48:48.738883 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-7fe8d8d3-1cdf-4ae3-be43-7f7bdb4c4f85 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] 10.222.0.18 "GET /compute/v2.1/servers/5c3de24c-090d-4769-8975-207eb939b979" status: 200 len: 1358 microversion: 2.75 time: 0.210986 Oct 22 20:48:48.743747 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 86/159] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 20:48:48 2022] GET /compute/v2.1/servers/5c3de24c-090d-4769-8975-207eb939b979 => generated 1358 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 20:48:48.858429 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-08e8790e-9f4a-4787-9833-7a84f958a617 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e13dcabaaa4b218945aeeabb4c902e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675a324f0134844a1964f64322493ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:48:48.877511 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-08e8790e-9f4a-4787-9833-7a84f958a617 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] 10.222.0.18 "GET /compute/v2.1/servers/f592a6fe-8cc7-4bb1-bb04-f8ddd358eeca" status: 200 len: 1319 microversion: 2.1 time: 0.408417 Oct 22 20:48:48.878305 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 74/160] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:48:48 2022] GET /compute/v2.1/servers/f592a6fe-8cc7-4bb1-bb04-f8ddd358eeca => generated 1319 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:48:49.555609 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-9553e48a-1b2c-4a86-8fc3-25bf2d170acc tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:48:49.556442 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-9553e48a-1b2c-4a86-8fc3-25bf2d170acc tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] [instance: e169b57b-4899-4a9e-80a9-d6290eb63ceb] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:48:49.568154 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9553e48a-1b2c-4a86-8fc3-25bf2d170acc tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:48:49.569642 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9553e48a-1b2c-4a86-8fc3-25bf2d170acc tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:48:49.570107 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9553e48a-1b2c-4a86-8fc3-25bf2d170acc tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:48:49.571183 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9553e48a-1b2c-4a86-8fc3-25bf2d170acc tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:48:49.571622 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9553e48a-1b2c-4a86-8fc3-25bf2d170acc tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:48:49.574234 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9553e48a-1b2c-4a86-8fc3-25bf2d170acc tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:48:49.775242 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-5bc8c5b4-f172-4f7d-9366-9ad275c6badb tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:48:49.776023 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-5bc8c5b4-f172-4f7d-9366-9ad275c6badb tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] [instance: 5c3de24c-090d-4769-8975-207eb939b979] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:48:49.780572 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-9553e48a-1b2c-4a86-8fc3-25bf2d170acc tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6de80d628cf14694af6d2cd16f16afad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae95f5dee52f4235b3478cc90f3b0347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:48:49.796057 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-9553e48a-1b2c-4a86-8fc3-25bf2d170acc tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] 10.222.0.18 "GET /compute/v2.1/servers/e169b57b-4899-4a9e-80a9-d6290eb63ceb" status: 200 len: 1338 microversion: 2.1 time: 0.244555 Oct 22 20:48:49.821292 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 87/161] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:48:49 2022] GET /compute/v2.1/servers/e169b57b-4899-4a9e-80a9-d6290eb63ceb => generated 1338 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:48:49.822066 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5bc8c5b4-f172-4f7d-9366-9ad275c6badb tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:48:49.823994 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5bc8c5b4-f172-4f7d-9366-9ad275c6badb tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:48:49.825148 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5bc8c5b4-f172-4f7d-9366-9ad275c6badb tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:48:49.826277 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5bc8c5b4-f172-4f7d-9366-9ad275c6badb tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:48:49.826888 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5bc8c5b4-f172-4f7d-9366-9ad275c6badb tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:48:49.828349 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5bc8c5b4-f172-4f7d-9366-9ad275c6badb tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:48:49.900602 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-610b375c-50c1-4daa-9408-5672768f684c tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:48:49.901520 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-610b375c-50c1-4daa-9408-5672768f684c tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] [instance: f592a6fe-8cc7-4bb1-bb04-f8ddd358eeca] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:48:49.914651 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-610b375c-50c1-4daa-9408-5672768f684c tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:48:49.915676 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-610b375c-50c1-4daa-9408-5672768f684c tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:48:49.916267 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-610b375c-50c1-4daa-9408-5672768f684c tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:48:49.917149 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-610b375c-50c1-4daa-9408-5672768f684c tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:48:49.917797 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-610b375c-50c1-4daa-9408-5672768f684c tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:48:49.918366 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-610b375c-50c1-4daa-9408-5672768f684c tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:48:50.065362 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-5bc8c5b4-f172-4f7d-9366-9ad275c6badb tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1ce98c66024d49b31e8e4f38b82838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a20f8f858424c89bf67a56feb720ac9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:48:50.077022 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-5bc8c5b4-f172-4f7d-9366-9ad275c6badb tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed1ce98c66024d49b31e8e4f38b82838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a20f8f858424c89bf67a56feb720ac9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:48:50.079502 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-5bc8c5b4-f172-4f7d-9366-9ad275c6badb tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed1ce98c66024d49b31e8e4f38b82838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a20f8f858424c89bf67a56feb720ac9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:48:50.090193 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_api:SELECT=84,nova_api:SAVEPOINT=4,nova_api:INSERT=5,nova_api:RELEASE=4,nova_api:DELETE=3 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:48:50.099200 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-5bc8c5b4-f172-4f7d-9366-9ad275c6badb tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] 10.222.0.18 "GET /compute/v2.1/servers/5c3de24c-090d-4769-8975-207eb939b979" status: 200 len: 1410 microversion: 2.75 time: 0.328979 Oct 22 20:48:50.107754 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 75/162] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 20:48:49 2022] GET /compute/v2.1/servers/5c3de24c-090d-4769-8975-207eb939b979 => generated 1410 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 20:48:50.216572 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-610b375c-50c1-4daa-9408-5672768f684c tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e13dcabaaa4b218945aeeabb4c902e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675a324f0134844a1964f64322493ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:48:50.230375 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-610b375c-50c1-4daa-9408-5672768f684c tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] 10.222.0.18 "GET /compute/v2.1/servers/f592a6fe-8cc7-4bb1-bb04-f8ddd358eeca" status: 200 len: 1319 microversion: 2.1 time: 0.333508 Oct 22 20:48:50.236362 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 88/163] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:48:49 2022] GET /compute/v2.1/servers/f592a6fe-8cc7-4bb1-bb04-f8ddd358eeca => generated 1319 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 20:48:50.505893 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-592d218c-e04f-4597-971f-ba058f5cd483 tempest-QuotaClassesAdminTestJSON-335801474 tempest-QuotaClassesAdminTestJSON-335801474-project-admin] Calling method '.version_select at 0x7fd3a4fb8c10>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:48:50.524094 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-592d218c-e04f-4597-971f-ba058f5cd483 tempest-QuotaClassesAdminTestJSON-335801474 tempest-QuotaClassesAdminTestJSON-335801474-project-admin] 10.222.0.18 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 303 microversion: 2.1 time: 0.414829 Oct 22 20:48:50.533186 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 76/164] 10.222.0.18 () {58 vars in 1185 bytes} [Sat Oct 22 20:48:50 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 303 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:48:50.537699 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-ee09a631-2861-4a6b-9b3b-3b89ffbbc9af tempest-QuotaClassesAdminTestJSON-335801474 tempest-QuotaClassesAdminTestJSON-335801474-project-admin] Action: 'update', calling method: .version_select at 0x7fd3a4d7e550>, body: {"quota_class_set": {"cores": 120, "fixed_ips": 99, "floating_ips": 99, "injected_file_content_bytes": 10340, "injected_file_path_bytes": 355, "injected_files": 105, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "security_group_rules": 99, "security_groups": 99}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:48:50.556129 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell0:SELECT=31 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:48:50.828752 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-889a3156-7722-40b2-bfb6-0ea0966cb1fa tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:48:50.829892 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-889a3156-7722-40b2-bfb6-0ea0966cb1fa tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] [instance: e169b57b-4899-4a9e-80a9-d6290eb63ceb] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:48:50.846703 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-889a3156-7722-40b2-bfb6-0ea0966cb1fa tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:48:50.848064 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-889a3156-7722-40b2-bfb6-0ea0966cb1fa tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:48:50.849901 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-889a3156-7722-40b2-bfb6-0ea0966cb1fa tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:48:50.853579 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-889a3156-7722-40b2-bfb6-0ea0966cb1fa tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:48:50.854536 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-889a3156-7722-40b2-bfb6-0ea0966cb1fa tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:48:50.856066 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-889a3156-7722-40b2-bfb6-0ea0966cb1fa tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:48:50.999102 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_api:SELECT=78,nova_api:UPDATE=11,nova_api:INSERT=11 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:48:51.049998 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-ee09a631-2861-4a6b-9b3b-3b89ffbbc9af tempest-QuotaClassesAdminTestJSON-335801474 tempest-QuotaClassesAdminTestJSON-335801474-project-admin] 10.222.0.18 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 290 microversion: 2.1 time: 0.516200 Oct 22 20:48:51.051374 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 89/165] 10.222.0.18 () {60 vars in 1206 bytes} [Sat Oct 22 20:48:50 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 290 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:48:51.062623 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-ff569050-89b8-4e2b-a388-f5654a98f994 tempest-QuotaClassesAdminTestJSON-335801474 tempest-QuotaClassesAdminTestJSON-335801474-project-admin] Calling method '.version_select at 0x7fd3a4d7eee0>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:48:51.076290 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-ff569050-89b8-4e2b-a388-f5654a98f994 tempest-QuotaClassesAdminTestJSON-335801474 tempest-QuotaClassesAdminTestJSON-335801474-project-admin] 10.222.0.18 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 307 microversion: 2.1 time: 0.017517 Oct 22 20:48:51.077466 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 90/166] 10.222.0.18 () {58 vars in 1185 bytes} [Sat Oct 22 20:48:51 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 307 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 20:48:51.090056 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-cf2f6541-2917-4bc9-967e-53391a709fdc tempest-QuotaClassesAdminTestJSON-335801474 tempest-QuotaClassesAdminTestJSON-335801474-project-admin] Action: 'update', calling method: .version_select at 0x7fd3a4d07af0>, body: {"quota_class_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:48:51.190907 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-889a3156-7722-40b2-bfb6-0ea0966cb1fa tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6de80d628cf14694af6d2cd16f16afad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae95f5dee52f4235b3478cc90f3b0347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:48:51.200971 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-889a3156-7722-40b2-bfb6-0ea0966cb1fa tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] 10.222.0.18 "GET /compute/v2.1/servers/e169b57b-4899-4a9e-80a9-d6290eb63ceb" status: 200 len: 1338 microversion: 2.1 time: 0.377983 Oct 22 20:48:51.201824 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 77/167] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:48:50 2022] GET /compute/v2.1/servers/e169b57b-4899-4a9e-80a9-d6290eb63ceb => generated 1338 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:48:51.227382 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-cf2f6541-2917-4bc9-967e-53391a709fdc tempest-QuotaClassesAdminTestJSON-335801474 tempest-QuotaClassesAdminTestJSON-335801474-project-admin] 10.222.0.18 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 286 microversion: 2.1 time: 0.141233 Oct 22 20:48:51.229390 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 91/168] 10.222.0.18 () {60 vars in 1206 bytes} [Sat Oct 22 20:48:51 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 286 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:48:51.236439 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-a711a79d-84b7-4daa-8732-1c56b5e5d646 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:48:51.237942 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-a711a79d-84b7-4daa-8732-1c56b5e5d646 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] [instance: 5c3de24c-090d-4769-8975-207eb939b979] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:48:51.246736 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a711a79d-84b7-4daa-8732-1c56b5e5d646 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:48:51.247614 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a711a79d-84b7-4daa-8732-1c56b5e5d646 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:48:51.248318 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a711a79d-84b7-4daa-8732-1c56b5e5d646 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:48:51.249250 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a711a79d-84b7-4daa-8732-1c56b5e5d646 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:48:51.249965 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a711a79d-84b7-4daa-8732-1c56b5e5d646 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:48:51.251413 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a711a79d-84b7-4daa-8732-1c56b5e5d646 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:48:51.461823 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-a711a79d-84b7-4daa-8732-1c56b5e5d646 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1ce98c66024d49b31e8e4f38b82838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a20f8f858424c89bf67a56feb720ac9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:48:51.471542 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-a711a79d-84b7-4daa-8732-1c56b5e5d646 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed1ce98c66024d49b31e8e4f38b82838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a20f8f858424c89bf67a56feb720ac9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:48:51.480155 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-a711a79d-84b7-4daa-8732-1c56b5e5d646 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed1ce98c66024d49b31e8e4f38b82838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a20f8f858424c89bf67a56feb720ac9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:48:51.488416 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-a711a79d-84b7-4daa-8732-1c56b5e5d646 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] 10.222.0.18 "GET /compute/v2.1/servers/5c3de24c-090d-4769-8975-207eb939b979" status: 200 len: 1416 microversion: 2.75 time: 0.257738 Oct 22 20:48:51.489023 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 92/169] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 20:48:51 2022] GET /compute/v2.1/servers/5c3de24c-090d-4769-8975-207eb939b979 => generated 1416 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 20:48:51.497845 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-ecc86a33-4f30-4ab6-ad3b-0d69fa5fd5bc tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:48:51.498475 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-ecc86a33-4f30-4ab6-ad3b-0d69fa5fd5bc tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] [instance: f592a6fe-8cc7-4bb1-bb04-f8ddd358eeca] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:48:51.505577 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ecc86a33-4f30-4ab6-ad3b-0d69fa5fd5bc tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:48:51.506300 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ecc86a33-4f30-4ab6-ad3b-0d69fa5fd5bc tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:48:51.506639 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ecc86a33-4f30-4ab6-ad3b-0d69fa5fd5bc tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:48:51.507363 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ecc86a33-4f30-4ab6-ad3b-0d69fa5fd5bc tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:48:51.507831 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ecc86a33-4f30-4ab6-ad3b-0d69fa5fd5bc tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:48:51.508258 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ecc86a33-4f30-4ab6-ad3b-0d69fa5fd5bc tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:48:51.521240 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-c64efe7f-12c8-446f-9adb-de8d72e08e00 req-0aa59a55-ee27-4da3-8e68-ffa96ba542dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f592a6fe-8cc7-4bb1-bb04-f8ddd358eeca", "name": "network-vif-plugged", "status": "completed", "tag": "a1417ffd-e3b2-4e5f-8fb0-0c90bf22df37"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:48:51.542652 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-c64efe7f-12c8-446f-9adb-de8d72e08e00 req-0aa59a55-ee27-4da3-8e68-ffa96ba542dc service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:48:51.545125 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-c64efe7f-12c8-446f-9adb-de8d72e08e00 req-0aa59a55-ee27-4da3-8e68-ffa96ba542dc service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:48:51.547613 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-c64efe7f-12c8-446f-9adb-de8d72e08e00 req-0aa59a55-ee27-4da3-8e68-ffa96ba542dc service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:48:51.588423 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-c64efe7f-12c8-446f-9adb-de8d72e08e00 req-0aa59a55-ee27-4da3-8e68-ffa96ba542dc service nova] Creating event network-vif-plugged:a1417ffd-e3b2-4e5f-8fb0-0c90bf22df37 for instance f592a6fe-8cc7-4bb1-bb04-f8ddd358eeca on nch1-master-1 Oct 22 20:48:51.606773 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-c64efe7f-12c8-446f-9adb-de8d72e08e00 req-0aa59a55-ee27-4da3-8e68-ffa96ba542dc service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.388827 Oct 22 20:48:51.608149 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 78/170] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:48:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:48:51.834872 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-ecc86a33-4f30-4ab6-ad3b-0d69fa5fd5bc tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e13dcabaaa4b218945aeeabb4c902e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675a324f0134844a1964f64322493ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:48:51.845067 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-ecc86a33-4f30-4ab6-ad3b-0d69fa5fd5bc tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] 10.222.0.18 "GET /compute/v2.1/servers/f592a6fe-8cc7-4bb1-bb04-f8ddd358eeca" status: 200 len: 1319 microversion: 2.1 time: 0.349597 Oct 22 20:48:51.845656 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 93/171] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:48:51 2022] GET /compute/v2.1/servers/f592a6fe-8cc7-4bb1-bb04-f8ddd358eeca => generated 1319 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:48:52.232743 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-771afe48-922a-434f-9eaf-c9d8fddef94c tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:48:52.233393 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-771afe48-922a-434f-9eaf-c9d8fddef94c tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] [instance: e169b57b-4899-4a9e-80a9-d6290eb63ceb] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:48:52.249056 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-771afe48-922a-434f-9eaf-c9d8fddef94c tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:48:52.249560 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-771afe48-922a-434f-9eaf-c9d8fddef94c tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:48:52.250999 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-771afe48-922a-434f-9eaf-c9d8fddef94c tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:48:52.251775 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-771afe48-922a-434f-9eaf-c9d8fddef94c tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:48:52.252331 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-771afe48-922a-434f-9eaf-c9d8fddef94c tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:48:52.253435 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-771afe48-922a-434f-9eaf-c9d8fddef94c tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:48:52.359037 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-c26f2fdb-2a61-4218-b6d8-e55f84b48731 tempest-HypervisorAdminV253TestBase-1092431218 tempest-HypervisorAdminV253TestBase-1092431218-project-admin] Calling method '.version_select at 0x7fd3a4f0e940>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:48:52.371512 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c26f2fdb-2a61-4218-b6d8-e55f84b48731 tempest-HypervisorAdminV253TestBase-1092431218 tempest-HypervisorAdminV253TestBase-1092431218-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:48:52.373823 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c26f2fdb-2a61-4218-b6d8-e55f84b48731 tempest-HypervisorAdminV253TestBase-1092431218 tempest-HypervisorAdminV253TestBase-1092431218-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:48:52.374978 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c26f2fdb-2a61-4218-b6d8-e55f84b48731 tempest-HypervisorAdminV253TestBase-1092431218 tempest-HypervisorAdminV253TestBase-1092431218-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:48:52.412794 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c26f2fdb-2a61-4218-b6d8-e55f84b48731 tempest-HypervisorAdminV253TestBase-1092431218 tempest-HypervisorAdminV253TestBase-1092431218-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:48:52.413693 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c26f2fdb-2a61-4218-b6d8-e55f84b48731 tempest-HypervisorAdminV253TestBase-1092431218 tempest-HypervisorAdminV253TestBase-1092431218-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:48:52.414496 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c26f2fdb-2a61-4218-b6d8-e55f84b48731 tempest-HypervisorAdminV253TestBase-1092431218 tempest-HypervisorAdminV253TestBase-1092431218-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:48:52.478942 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c26f2fdb-2a61-4218-b6d8-e55f84b48731 tempest-HypervisorAdminV253TestBase-1092431218 tempest-HypervisorAdminV253TestBase-1092431218-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:48:52.479484 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c26f2fdb-2a61-4218-b6d8-e55f84b48731 tempest-HypervisorAdminV253TestBase-1092431218 tempest-HypervisorAdminV253TestBase-1092431218-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:48:52.479933 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c26f2fdb-2a61-4218-b6d8-e55f84b48731 tempest-HypervisorAdminV253TestBase-1092431218 tempest-HypervisorAdminV253TestBase-1092431218-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:48:52.498848 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c26f2fdb-2a61-4218-b6d8-e55f84b48731 tempest-HypervisorAdminV253TestBase-1092431218 tempest-HypervisorAdminV253TestBase-1092431218-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:48:52.499981 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c26f2fdb-2a61-4218-b6d8-e55f84b48731 tempest-HypervisorAdminV253TestBase-1092431218 tempest-HypervisorAdminV253TestBase-1092431218-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:48:52.500471 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c26f2fdb-2a61-4218-b6d8-e55f84b48731 tempest-HypervisorAdminV253TestBase-1092431218 tempest-HypervisorAdminV253TestBase-1092431218-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:48:52.550400 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c26f2fdb-2a61-4218-b6d8-e55f84b48731 tempest-HypervisorAdminV253TestBase-1092431218 tempest-HypervisorAdminV253TestBase-1092431218-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:48:52.550920 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c26f2fdb-2a61-4218-b6d8-e55f84b48731 tempest-HypervisorAdminV253TestBase-1092431218 tempest-HypervisorAdminV253TestBase-1092431218-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:48:52.551393 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c26f2fdb-2a61-4218-b6d8-e55f84b48731 tempest-HypervisorAdminV253TestBase-1092431218 tempest-HypervisorAdminV253TestBase-1092431218-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:48:52.576810 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-c26f2fdb-2a61-4218-b6d8-e55f84b48731 tempest-HypervisorAdminV253TestBase-1092431218 tempest-HypervisorAdminV253TestBase-1092431218-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hypervisors/detail?with_servers=True" status: 200 len: 1836 microversion: 2.53 time: 0.418791 Oct 22 20:48:52.577529 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 79/172] 10.222.0.18 () {60 vars in 1243 bytes} [Sat Oct 22 20:48:52 2022] GET /compute/v2.1/os-hypervisors/detail?with_servers=True => generated 1836 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 20:48:52.587921 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-d99296ef-db00-4efb-acb7-9407f1cdfb9e tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:48:52.596850 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-d99296ef-db00-4efb-acb7-9407f1cdfb9e tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] [instance: 5c3de24c-090d-4769-8975-207eb939b979] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:48:52.612782 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d99296ef-db00-4efb-acb7-9407f1cdfb9e tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:48:52.613286 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d99296ef-db00-4efb-acb7-9407f1cdfb9e tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:48:52.614110 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d99296ef-db00-4efb-acb7-9407f1cdfb9e tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:48:52.615920 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d99296ef-db00-4efb-acb7-9407f1cdfb9e tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:48:52.616759 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d99296ef-db00-4efb-acb7-9407f1cdfb9e tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:48:52.617424 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d99296ef-db00-4efb-acb7-9407f1cdfb9e tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:48:52.798824 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-771afe48-922a-434f-9eaf-c9d8fddef94c tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6de80d628cf14694af6d2cd16f16afad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae95f5dee52f4235b3478cc90f3b0347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:48:52.809364 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-771afe48-922a-434f-9eaf-c9d8fddef94c tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] 10.222.0.18 "GET /compute/v2.1/servers/e169b57b-4899-4a9e-80a9-d6290eb63ceb" status: 200 len: 1338 microversion: 2.1 time: 0.583474 Oct 22 20:48:52.819612 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 94/173] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:48:52 2022] GET /compute/v2.1/servers/e169b57b-4899-4a9e-80a9-d6290eb63ceb => generated 1338 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:48:52.819612 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-15ba4540-2dc7-4e13-8ef7-24eb057be04a tempest-HypervisorAdminV253TestBase-1092431218 tempest-HypervisorAdminV253TestBase-1092431218-project-admin] Calling method '.version_select at 0x7fd3a4d75430>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:48:52.833576 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-15ba4540-2dc7-4e13-8ef7-24eb057be04a tempest-HypervisorAdminV253TestBase-1092431218 tempest-HypervisorAdminV253TestBase-1092431218-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:48:52.834134 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-15ba4540-2dc7-4e13-8ef7-24eb057be04a tempest-HypervisorAdminV253TestBase-1092431218 tempest-HypervisorAdminV253TestBase-1092431218-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:48:52.834677 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-15ba4540-2dc7-4e13-8ef7-24eb057be04a tempest-HypervisorAdminV253TestBase-1092431218 tempest-HypervisorAdminV253TestBase-1092431218-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:48:52.868310 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-15ba4540-2dc7-4e13-8ef7-24eb057be04a tempest-HypervisorAdminV253TestBase-1092431218 tempest-HypervisorAdminV253TestBase-1092431218-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:48:52.873942 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-15ba4540-2dc7-4e13-8ef7-24eb057be04a tempest-HypervisorAdminV253TestBase-1092431218 tempest-HypervisorAdminV253TestBase-1092431218-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:48:52.874786 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-15ba4540-2dc7-4e13-8ef7-24eb057be04a tempest-HypervisorAdminV253TestBase-1092431218 tempest-HypervisorAdminV253TestBase-1092431218-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:48:52.905448 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-15ba4540-2dc7-4e13-8ef7-24eb057be04a tempest-HypervisorAdminV253TestBase-1092431218 tempest-HypervisorAdminV253TestBase-1092431218-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:48:52.906144 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-15ba4540-2dc7-4e13-8ef7-24eb057be04a tempest-HypervisorAdminV253TestBase-1092431218 tempest-HypervisorAdminV253TestBase-1092431218-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:48:52.908439 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-15ba4540-2dc7-4e13-8ef7-24eb057be04a tempest-HypervisorAdminV253TestBase-1092431218 tempest-HypervisorAdminV253TestBase-1092431218-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:48:52.926462 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-15ba4540-2dc7-4e13-8ef7-24eb057be04a tempest-HypervisorAdminV253TestBase-1092431218 tempest-HypervisorAdminV253TestBase-1092431218-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:48:52.927326 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-15ba4540-2dc7-4e13-8ef7-24eb057be04a tempest-HypervisorAdminV253TestBase-1092431218 tempest-HypervisorAdminV253TestBase-1092431218-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:48:52.928235 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-15ba4540-2dc7-4e13-8ef7-24eb057be04a tempest-HypervisorAdminV253TestBase-1092431218 tempest-HypervisorAdminV253TestBase-1092431218-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:48:52.965302 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-15ba4540-2dc7-4e13-8ef7-24eb057be04a tempest-HypervisorAdminV253TestBase-1092431218 tempest-HypervisorAdminV253TestBase-1092431218-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:48:52.965977 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-15ba4540-2dc7-4e13-8ef7-24eb057be04a tempest-HypervisorAdminV253TestBase-1092431218 tempest-HypervisorAdminV253TestBase-1092431218-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:48:52.966574 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-15ba4540-2dc7-4e13-8ef7-24eb057be04a tempest-HypervisorAdminV253TestBase-1092431218 tempest-HypervisorAdminV253TestBase-1092431218-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:48:52.966784 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-d99296ef-db00-4efb-acb7-9407f1cdfb9e tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1ce98c66024d49b31e8e4f38b82838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a20f8f858424c89bf67a56feb720ac9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:48:52.977186 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-15ba4540-2dc7-4e13-8ef7-24eb057be04a tempest-HypervisorAdminV253TestBase-1092431218 tempest-HypervisorAdminV253TestBase-1092431218-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hypervisors?with_servers=True" status: 200 len: 528 microversion: 2.53 time: 0.160850 Oct 22 20:48:52.977779 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 95/174] 10.222.0.18 () {60 vars in 1222 bytes} [Sat Oct 22 20:48:52 2022] GET /compute/v2.1/os-hypervisors?with_servers=True => generated 528 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 22 20:48:52.983034 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-d8bccbb1-4782-4b36-a673-ae4b4de71cd9 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:48:52.983680 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-d8bccbb1-4782-4b36-a673-ae4b4de71cd9 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] [instance: f592a6fe-8cc7-4bb1-bb04-f8ddd358eeca] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:48:52.988487 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-d99296ef-db00-4efb-acb7-9407f1cdfb9e tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed1ce98c66024d49b31e8e4f38b82838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a20f8f858424c89bf67a56feb720ac9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:48:52.990109 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-d99296ef-db00-4efb-acb7-9407f1cdfb9e tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed1ce98c66024d49b31e8e4f38b82838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a20f8f858424c89bf67a56feb720ac9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:48:52.992225 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d8bccbb1-4782-4b36-a673-ae4b4de71cd9 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:48:52.992727 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d8bccbb1-4782-4b36-a673-ae4b4de71cd9 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:48:52.993181 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d8bccbb1-4782-4b36-a673-ae4b4de71cd9 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:48:52.994457 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d8bccbb1-4782-4b36-a673-ae4b4de71cd9 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:48:52.994931 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d8bccbb1-4782-4b36-a673-ae4b4de71cd9 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:48:52.995410 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d8bccbb1-4782-4b36-a673-ae4b4de71cd9 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:48:52.997567 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-d99296ef-db00-4efb-acb7-9407f1cdfb9e tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] 10.222.0.18 "GET /compute/v2.1/servers/5c3de24c-090d-4769-8975-207eb939b979" status: 200 len: 1416 microversion: 2.75 time: 0.414907 Oct 22 20:48:52.998259 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 80/175] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 20:48:52 2022] GET /compute/v2.1/servers/5c3de24c-090d-4769-8975-207eb939b979 => generated 1416 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 20:48:53.004137 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-0275fc2a-acfe-484d-8fc2-89becf67a55b tempest-HypervisorAdminV253TestBase-1092431218 tempest-HypervisorAdminV253TestBase-1092431218-project-admin] Calling method '.version_select at 0x7fd3a4d86790>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:48:53.008355 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0275fc2a-acfe-484d-8fc2-89becf67a55b tempest-HypervisorAdminV253TestBase-1092431218 tempest-HypervisorAdminV253TestBase-1092431218-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:48:53.009064 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0275fc2a-acfe-484d-8fc2-89becf67a55b tempest-HypervisorAdminV253TestBase-1092431218 tempest-HypervisorAdminV253TestBase-1092431218-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:48:53.009715 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0275fc2a-acfe-484d-8fc2-89becf67a55b tempest-HypervisorAdminV253TestBase-1092431218 tempest-HypervisorAdminV253TestBase-1092431218-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:48:53.030637 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0275fc2a-acfe-484d-8fc2-89becf67a55b tempest-HypervisorAdminV253TestBase-1092431218 tempest-HypervisorAdminV253TestBase-1092431218-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:48:53.031262 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0275fc2a-acfe-484d-8fc2-89becf67a55b tempest-HypervisorAdminV253TestBase-1092431218 tempest-HypervisorAdminV253TestBase-1092431218-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:48:53.031751 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0275fc2a-acfe-484d-8fc2-89becf67a55b tempest-HypervisorAdminV253TestBase-1092431218 tempest-HypervisorAdminV253TestBase-1092431218-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:48:53.038428 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-0275fc2a-acfe-484d-8fc2-89becf67a55b tempest-HypervisorAdminV253TestBase-1092431218 tempest-HypervisorAdminV253TestBase-1092431218-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hypervisors/82b2e70d-e53b-42b2-b365-9fc3a40c7b32" status: 200 len: 792 microversion: 2.53 time: 0.038895 Oct 22 20:48:53.039022 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 81/176] 10.222.0.18 () {60 vars in 1298 bytes} [Sat Oct 22 20:48:52 2022] GET /compute/v2.1/os-hypervisors/82b2e70d-e53b-42b2-b365-9fc3a40c7b32 => generated 792 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 22 20:48:53.312697 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-d8bccbb1-4782-4b36-a673-ae4b4de71cd9 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e13dcabaaa4b218945aeeabb4c902e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675a324f0134844a1964f64322493ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:48:53.322704 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-d8bccbb1-4782-4b36-a673-ae4b4de71cd9 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] 10.222.0.18 "GET /compute/v2.1/servers/f592a6fe-8cc7-4bb1-bb04-f8ddd358eeca" status: 200 len: 1319 microversion: 2.1 time: 0.343825 Oct 22 20:48:53.338954 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 96/177] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:48:52 2022] GET /compute/v2.1/servers/f592a6fe-8cc7-4bb1-bb04-f8ddd358eeca => generated 1319 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:48:53.624133 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-67131932-76d0-480d-8f08-b87ed8f7438b req-6ec54116-5f12-4ce1-81df-2cfa733ba4aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e169b57b-4899-4a9e-80a9-d6290eb63ceb", "name": "network-vif-plugged", "status": "completed", "tag": "02de842c-17fc-4e5f-baff-e53cc52aeb55"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:48:53.645970 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-67131932-76d0-480d-8f08-b87ed8f7438b req-6ec54116-5f12-4ce1-81df-2cfa733ba4aa service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:48:53.646743 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-67131932-76d0-480d-8f08-b87ed8f7438b req-6ec54116-5f12-4ce1-81df-2cfa733ba4aa service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:48:53.647321 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-67131932-76d0-480d-8f08-b87ed8f7438b req-6ec54116-5f12-4ce1-81df-2cfa733ba4aa service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:48:53.663389 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-67131932-76d0-480d-8f08-b87ed8f7438b req-6ec54116-5f12-4ce1-81df-2cfa733ba4aa service nova] Creating event network-vif-plugged:02de842c-17fc-4e5f-baff-e53cc52aeb55 for instance e169b57b-4899-4a9e-80a9-d6290eb63ceb on nch2-master-1 Oct 22 20:48:53.676221 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-67131932-76d0-480d-8f08-b87ed8f7438b req-6ec54116-5f12-4ce1-81df-2cfa733ba4aa service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055619 Oct 22 20:48:53.677504 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 82/178] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:48:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:48:53.833635 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-d743c5c8-2ac3-4fd8-85c9-05afe413cd02 tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:48:53.834674 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-d743c5c8-2ac3-4fd8-85c9-05afe413cd02 tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] [instance: e169b57b-4899-4a9e-80a9-d6290eb63ceb] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:48:53.848547 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d743c5c8-2ac3-4fd8-85c9-05afe413cd02 tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:48:53.849284 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d743c5c8-2ac3-4fd8-85c9-05afe413cd02 tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:48:53.850000 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d743c5c8-2ac3-4fd8-85c9-05afe413cd02 tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:48:53.850965 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d743c5c8-2ac3-4fd8-85c9-05afe413cd02 tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:48:53.853256 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d743c5c8-2ac3-4fd8-85c9-05afe413cd02 tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:48:53.854003 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d743c5c8-2ac3-4fd8-85c9-05afe413cd02 tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:48:54.035012 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-da788cf3-64f8-4adf-8894-6073fe011123 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:48:54.035749 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-da788cf3-64f8-4adf-8894-6073fe011123 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] [instance: 5c3de24c-090d-4769-8975-207eb939b979] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:48:54.064980 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-da788cf3-64f8-4adf-8894-6073fe011123 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:48:54.068649 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-da788cf3-64f8-4adf-8894-6073fe011123 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:48:54.071022 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-da788cf3-64f8-4adf-8894-6073fe011123 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:48:54.072482 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-da788cf3-64f8-4adf-8894-6073fe011123 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:48:54.074523 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-da788cf3-64f8-4adf-8894-6073fe011123 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:48:54.076505 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-da788cf3-64f8-4adf-8894-6073fe011123 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:48:54.136544 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:SELECT=100 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:48:54.153641 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-d743c5c8-2ac3-4fd8-85c9-05afe413cd02 tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6de80d628cf14694af6d2cd16f16afad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae95f5dee52f4235b3478cc90f3b0347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:48:54.169099 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-d743c5c8-2ac3-4fd8-85c9-05afe413cd02 tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] 10.222.0.18 "GET /compute/v2.1/servers/e169b57b-4899-4a9e-80a9-d6290eb63ceb" status: 200 len: 1338 microversion: 2.1 time: 0.339753 Oct 22 20:48:54.169759 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 97/179] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:48:53 2022] GET /compute/v2.1/servers/e169b57b-4899-4a9e-80a9-d6290eb63ceb => generated 1338 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 20:48:54.246442 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-da788cf3-64f8-4adf-8894-6073fe011123 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1ce98c66024d49b31e8e4f38b82838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a20f8f858424c89bf67a56feb720ac9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:48:54.255778 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-da788cf3-64f8-4adf-8894-6073fe011123 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed1ce98c66024d49b31e8e4f38b82838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a20f8f858424c89bf67a56feb720ac9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:48:54.263154 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-da788cf3-64f8-4adf-8894-6073fe011123 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed1ce98c66024d49b31e8e4f38b82838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a20f8f858424c89bf67a56feb720ac9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:48:54.272508 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-da788cf3-64f8-4adf-8894-6073fe011123 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] 10.222.0.18 "GET /compute/v2.1/servers/5c3de24c-090d-4769-8975-207eb939b979" status: 200 len: 1416 microversion: 2.75 time: 0.244363 Oct 22 20:48:54.273108 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 83/180] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 20:48:54 2022] GET /compute/v2.1/servers/5c3de24c-090d-4769-8975-207eb939b979 => generated 1416 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 20:48:54.349642 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-ea89e2e2-0882-4716-a32d-bfe971f5adcd tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:48:54.350631 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-ea89e2e2-0882-4716-a32d-bfe971f5adcd tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] [instance: f592a6fe-8cc7-4bb1-bb04-f8ddd358eeca] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:48:54.357310 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ea89e2e2-0882-4716-a32d-bfe971f5adcd tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:48:54.358055 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ea89e2e2-0882-4716-a32d-bfe971f5adcd tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:48:54.358802 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ea89e2e2-0882-4716-a32d-bfe971f5adcd tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:48:54.359846 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ea89e2e2-0882-4716-a32d-bfe971f5adcd tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:48:54.360595 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ea89e2e2-0882-4716-a32d-bfe971f5adcd tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:48:54.361205 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ea89e2e2-0882-4716-a32d-bfe971f5adcd tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:48:54.654660 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-ea89e2e2-0882-4716-a32d-bfe971f5adcd tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e13dcabaaa4b218945aeeabb4c902e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675a324f0134844a1964f64322493ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:48:54.667074 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-ea89e2e2-0882-4716-a32d-bfe971f5adcd tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] 10.222.0.18 "GET /compute/v2.1/servers/f592a6fe-8cc7-4bb1-bb04-f8ddd358eeca" status: 200 len: 1319 microversion: 2.1 time: 0.318384 Oct 22 20:48:54.687196 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 98/181] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:48:54 2022] GET /compute/v2.1/servers/f592a6fe-8cc7-4bb1-bb04-f8ddd358eeca => generated 1319 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:48:55.205101 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-f38ddba5-4cac-49fd-bb3d-3bc400657778 tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:48:55.206095 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-f38ddba5-4cac-49fd-bb3d-3bc400657778 tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] [instance: e169b57b-4899-4a9e-80a9-d6290eb63ceb] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:48:55.213944 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f38ddba5-4cac-49fd-bb3d-3bc400657778 tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:48:55.214986 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f38ddba5-4cac-49fd-bb3d-3bc400657778 tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:48:55.215759 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f38ddba5-4cac-49fd-bb3d-3bc400657778 tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:48:55.216802 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f38ddba5-4cac-49fd-bb3d-3bc400657778 tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:48:55.217500 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f38ddba5-4cac-49fd-bb3d-3bc400657778 tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:48:55.218347 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f38ddba5-4cac-49fd-bb3d-3bc400657778 tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:48:55.300814 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-0380a4e3-8d9b-4550-aa97-675709d97b81 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:48:55.302253 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-0380a4e3-8d9b-4550-aa97-675709d97b81 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] [instance: 5c3de24c-090d-4769-8975-207eb939b979] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:48:55.315505 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0380a4e3-8d9b-4550-aa97-675709d97b81 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:48:55.322588 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0380a4e3-8d9b-4550-aa97-675709d97b81 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:48:55.323475 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0380a4e3-8d9b-4550-aa97-675709d97b81 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:48:55.324451 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0380a4e3-8d9b-4550-aa97-675709d97b81 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:48:55.325166 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0380a4e3-8d9b-4550-aa97-675709d97b81 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:48:55.325779 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0380a4e3-8d9b-4550-aa97-675709d97b81 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:48:55.685057 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-0380a4e3-8d9b-4550-aa97-675709d97b81 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1ce98c66024d49b31e8e4f38b82838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a20f8f858424c89bf67a56feb720ac9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:48:55.689518 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell1:SELECT=100 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:48:55.705606 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-0380a4e3-8d9b-4550-aa97-675709d97b81 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed1ce98c66024d49b31e8e4f38b82838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a20f8f858424c89bf67a56feb720ac9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:48:55.707939 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-0380a4e3-8d9b-4550-aa97-675709d97b81 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed1ce98c66024d49b31e8e4f38b82838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a20f8f858424c89bf67a56feb720ac9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:48:55.721754 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-0380a4e3-8d9b-4550-aa97-675709d97b81 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] 10.222.0.18 "GET /compute/v2.1/servers/5c3de24c-090d-4769-8975-207eb939b979" status: 200 len: 1437 microversion: 2.75 time: 0.425191 Oct 22 20:48:55.730368 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 99/182] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 20:48:55 2022] GET /compute/v2.1/servers/5c3de24c-090d-4769-8975-207eb939b979 => generated 1437 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 20:48:55.743410 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-58624b19-969b-4897-a7c7-8d4a5504ba19 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:48:55.744361 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-58624b19-969b-4897-a7c7-8d4a5504ba19 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] [instance: f592a6fe-8cc7-4bb1-bb04-f8ddd358eeca] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:48:55.763835 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-58624b19-969b-4897-a7c7-8d4a5504ba19 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:48:55.764579 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-58624b19-969b-4897-a7c7-8d4a5504ba19 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:48:55.765285 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-58624b19-969b-4897-a7c7-8d4a5504ba19 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:48:55.766076 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-58624b19-969b-4897-a7c7-8d4a5504ba19 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:48:55.766690 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-58624b19-969b-4897-a7c7-8d4a5504ba19 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:48:55.767218 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-58624b19-969b-4897-a7c7-8d4a5504ba19 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:48:55.942140 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-f38ddba5-4cac-49fd-bb3d-3bc400657778 tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6de80d628cf14694af6d2cd16f16afad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae95f5dee52f4235b3478cc90f3b0347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:48:55.951698 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-f38ddba5-4cac-49fd-bb3d-3bc400657778 tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] 10.222.0.18 "GET /compute/v2.1/servers/e169b57b-4899-4a9e-80a9-d6290eb63ceb" status: 200 len: 1338 microversion: 2.1 time: 0.751562 Oct 22 20:48:55.956495 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 84/183] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:48:55 2022] GET /compute/v2.1/servers/e169b57b-4899-4a9e-80a9-d6290eb63ceb => generated 1338 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:48:55.969561 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-baf52e07-617d-4a6a-8e49-8ed79078167b tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "085e4478-6edc-4a69-8e08-f9831713eb65"}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:48:55.979929 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-baf52e07-617d-4a6a-8e49-8ed79078167b tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] [instance: 5c3de24c-090d-4769-8975-207eb939b979] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:48:55.991875 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-baf52e07-617d-4a6a-8e49-8ed79078167b tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:48:56.004628 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-baf52e07-617d-4a6a-8e49-8ed79078167b tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:48:56.005685 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-baf52e07-617d-4a6a-8e49-8ed79078167b tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:48:56.006584 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-baf52e07-617d-4a6a-8e49-8ed79078167b tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:48:56.007270 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-baf52e07-617d-4a6a-8e49-8ed79078167b tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:48:56.008069 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-baf52e07-617d-4a6a-8e49-8ed79078167b tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:48:56.169606 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-baf52e07-617d-4a6a-8e49-8ed79078167b tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Flavor limits 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 20:48:56.170037 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-baf52e07-617d-4a6a-8e49-8ed79078167b tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Image limits 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 20:48:56.170522 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-baf52e07-617d-4a6a-8e49-8ed79078167b tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Flavor pref 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 20:48:56.170931 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-baf52e07-617d-4a6a-8e49-8ed79078167b tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Image pref 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 20:48:56.174210 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-baf52e07-617d-4a6a-8e49-8ed79078167b tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 20:48:56.244931 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-58624b19-969b-4897-a7c7-8d4a5504ba19 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e13dcabaaa4b218945aeeabb4c902e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675a324f0134844a1964f64322493ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:48:56.258812 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-58624b19-969b-4897-a7c7-8d4a5504ba19 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] 10.222.0.18 "GET /compute/v2.1/servers/f592a6fe-8cc7-4bb1-bb04-f8ddd358eeca" status: 200 len: 1467 microversion: 2.1 time: 0.525664 Oct 22 20:48:56.259797 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 100/184] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:48:55 2022] GET /compute/v2.1/servers/f592a6fe-8cc7-4bb1-bb04-f8ddd358eeca => generated 1467 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:48:56.413703 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-baf52e07-617d-4a6a-8e49-8ed79078167b tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] [instance: 5c3de24c-090d-4769-8975-207eb939b979] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:48:56.423982 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-baf52e07-617d-4a6a-8e49-8ed79078167b tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:48:56.424865 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-baf52e07-617d-4a6a-8e49-8ed79078167b tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:48:56.425825 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-baf52e07-617d-4a6a-8e49-8ed79078167b tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:48:56.428025 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-baf52e07-617d-4a6a-8e49-8ed79078167b tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:48:56.428893 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-baf52e07-617d-4a6a-8e49-8ed79078167b tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:48:56.429695 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-baf52e07-617d-4a6a-8e49-8ed79078167b tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:48:56.621979 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-baf52e07-617d-4a6a-8e49-8ed79078167b tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1ce98c66024d49b31e8e4f38b82838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a20f8f858424c89bf67a56feb720ac9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:48:56.661130 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-baf52e07-617d-4a6a-8e49-8ed79078167b tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed1ce98c66024d49b31e8e4f38b82838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a20f8f858424c89bf67a56feb720ac9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:48:56.664430 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-baf52e07-617d-4a6a-8e49-8ed79078167b tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed1ce98c66024d49b31e8e4f38b82838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a20f8f858424c89bf67a56feb720ac9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:48:56.685897 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-baf52e07-617d-4a6a-8e49-8ed79078167b tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] 10.222.0.18 "POST /compute/v2.1/servers/5c3de24c-090d-4769-8975-207eb939b979/action" status: 202 len: 1494 microversion: 2.75 time: 0.727278 Oct 22 20:48:56.691288 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 85/185] 10.222.0.18 () {62 vars in 1319 bytes} [Sat Oct 22 20:48:55 2022] POST /compute/v2.1/servers/5c3de24c-090d-4769-8975-207eb939b979/action => generated 1494 bytes in 734 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 22 20:48:56.723145 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-71fe4514-a58d-429d-8204-e5ee5bdf8416 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:48:56.723818 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-71fe4514-a58d-429d-8204-e5ee5bdf8416 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] [instance: 5c3de24c-090d-4769-8975-207eb939b979] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:48:56.743445 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-71fe4514-a58d-429d-8204-e5ee5bdf8416 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:48:56.743663 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-71fe4514-a58d-429d-8204-e5ee5bdf8416 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:48:56.745268 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-71fe4514-a58d-429d-8204-e5ee5bdf8416 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:48:56.748627 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-71fe4514-a58d-429d-8204-e5ee5bdf8416 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:48:56.750807 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-71fe4514-a58d-429d-8204-e5ee5bdf8416 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:48:56.751427 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-71fe4514-a58d-429d-8204-e5ee5bdf8416 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:48:56.887255 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-71fe4514-a58d-429d-8204-e5ee5bdf8416 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1ce98c66024d49b31e8e4f38b82838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a20f8f858424c89bf67a56feb720ac9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:48:56.907643 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-71fe4514-a58d-429d-8204-e5ee5bdf8416 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed1ce98c66024d49b31e8e4f38b82838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a20f8f858424c89bf67a56feb720ac9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:48:56.920092 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-71fe4514-a58d-429d-8204-e5ee5bdf8416 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed1ce98c66024d49b31e8e4f38b82838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a20f8f858424c89bf67a56feb720ac9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:48:56.931685 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-71fe4514-a58d-429d-8204-e5ee5bdf8416 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] 10.222.0.18 "GET /compute/v2.1/servers/5c3de24c-090d-4769-8975-207eb939b979" status: 200 len: 1446 microversion: 2.75 time: 0.213104 Oct 22 20:48:56.944318 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 86/186] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 20:48:56 2022] GET /compute/v2.1/servers/5c3de24c-090d-4769-8975-207eb939b979 => generated 1446 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 20:48:56.992142 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-535a357d-8285-4dad-af2e-75f71aeda5ee tempest-DeleteServersAdminTestJSON-1839136719 tempest-DeleteServersAdminTestJSON-1839136719-project-admin] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:48:56.993042 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-535a357d-8285-4dad-af2e-75f71aeda5ee tempest-DeleteServersAdminTestJSON-1839136719 tempest-DeleteServersAdminTestJSON-1839136719-project-admin] [instance: f592a6fe-8cc7-4bb1-bb04-f8ddd358eeca] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:48:57.003860 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-535a357d-8285-4dad-af2e-75f71aeda5ee tempest-DeleteServersAdminTestJSON-1839136719 tempest-DeleteServersAdminTestJSON-1839136719-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:48:57.004389 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-535a357d-8285-4dad-af2e-75f71aeda5ee tempest-DeleteServersAdminTestJSON-1839136719 tempest-DeleteServersAdminTestJSON-1839136719-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:48:57.006066 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-535a357d-8285-4dad-af2e-75f71aeda5ee tempest-DeleteServersAdminTestJSON-1839136719 tempest-DeleteServersAdminTestJSON-1839136719-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:48:57.009612 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-535a357d-8285-4dad-af2e-75f71aeda5ee tempest-DeleteServersAdminTestJSON-1839136719 tempest-DeleteServersAdminTestJSON-1839136719-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:48:57.010593 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-535a357d-8285-4dad-af2e-75f71aeda5ee tempest-DeleteServersAdminTestJSON-1839136719 tempest-DeleteServersAdminTestJSON-1839136719-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:48:57.011411 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-535a357d-8285-4dad-af2e-75f71aeda5ee tempest-DeleteServersAdminTestJSON-1839136719 tempest-DeleteServersAdminTestJSON-1839136719-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:48:57.167107 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-535a357d-8285-4dad-af2e-75f71aeda5ee tempest-DeleteServersAdminTestJSON-1839136719 tempest-DeleteServersAdminTestJSON-1839136719-project-admin] [instance: f592a6fe-8cc7-4bb1-bb04-f8ddd358eeca] Going to try to terminate instance {{(pid=138745) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 20:48:57.182104 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-4d8302e9-9936-44fa-b57d-c2f219b00d9a tempest-QuotasAdminTestV257-1660297992 tempest-QuotasAdminTestV257-1660297992-project-admin] Action: 'update', calling method: .version_select at 0x7fd3a4dadee0>, body: {"quota_set": {"ram": "5120"}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:48:57.296974 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4d8302e9-9936-44fa-b57d-c2f219b00d9a tempest-QuotasAdminTestV257-1660297992 tempest-QuotasAdminTestV257-1660297992-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:48:57.297753 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4d8302e9-9936-44fa-b57d-c2f219b00d9a tempest-QuotasAdminTestV257-1660297992 tempest-QuotasAdminTestV257-1660297992-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:48:57.298388 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4d8302e9-9936-44fa-b57d-c2f219b00d9a tempest-QuotasAdminTestV257-1660297992 tempest-QuotasAdminTestV257-1660297992-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:48:57.300534 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4d8302e9-9936-44fa-b57d-c2f219b00d9a tempest-QuotasAdminTestV257-1660297992 tempest-QuotasAdminTestV257-1660297992-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:48:57.301264 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4d8302e9-9936-44fa-b57d-c2f219b00d9a tempest-QuotasAdminTestV257-1660297992 tempest-QuotasAdminTestV257-1660297992-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:48:57.302109 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4d8302e9-9936-44fa-b57d-c2f219b00d9a tempest-QuotasAdminTestV257-1660297992 tempest-QuotasAdminTestV257-1660297992-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:48:57.358391 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-535a357d-8285-4dad-af2e-75f71aeda5ee tempest-DeleteServersAdminTestJSON-1839136719 tempest-DeleteServersAdminTestJSON-1839136719-project-admin] 10.222.0.18 "DELETE /compute/v2.1/servers/f592a6fe-8cc7-4bb1-bb04-f8ddd358eeca" status: 204 len: 0 microversion: 2.1 time: 1.074257 Oct 22 20:48:57.363568 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 101/187] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 20:48:56 2022] DELETE /compute/v2.1/servers/f592a6fe-8cc7-4bb1-bb04-f8ddd358eeca => generated 0 bytes in 1076 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 22 20:48:57.371781 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-e93917bb-f5b1-4442-a3e1-c63f4056555d tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:48:57.372759 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-e93917bb-f5b1-4442-a3e1-c63f4056555d tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] [instance: e169b57b-4899-4a9e-80a9-d6290eb63ceb] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:48:57.380155 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e93917bb-f5b1-4442-a3e1-c63f4056555d tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:48:57.381201 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e93917bb-f5b1-4442-a3e1-c63f4056555d tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:48:57.381642 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e93917bb-f5b1-4442-a3e1-c63f4056555d tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:48:57.382373 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e93917bb-f5b1-4442-a3e1-c63f4056555d tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:48:57.382829 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e93917bb-f5b1-4442-a3e1-c63f4056555d tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:48:57.383259 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e93917bb-f5b1-4442-a3e1-c63f4056555d tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:48:57.399707 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-4d8302e9-9936-44fa-b57d-c2f219b00d9a tempest-QuotasAdminTestV257-1660297992 tempest-QuotasAdminTestV257-1660297992-project-admin] 10.222.0.18 "PUT /compute/v2.1/os-quota-sets/28cb8a61f6e54f7986328242f19b3113" status: 200 len: 148 microversion: 2.57 time: 0.451866 Oct 22 20:48:57.401132 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 87/188] 10.222.0.18 () {62 vars in 1303 bytes} [Sat Oct 22 20:48:56 2022] PUT /compute/v2.1/os-quota-sets/28cb8a61f6e54f7986328242f19b3113 => generated 148 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 22 20:48:57.410557 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-8c8af90e-15a7-42d5-b39f-fcf738692ef6 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:48:57.411249 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-8c8af90e-15a7-42d5-b39f-fcf738692ef6 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] [instance: f592a6fe-8cc7-4bb1-bb04-f8ddd358eeca] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:48:57.419630 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8c8af90e-15a7-42d5-b39f-fcf738692ef6 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:48:57.420323 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8c8af90e-15a7-42d5-b39f-fcf738692ef6 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:48:57.420582 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8c8af90e-15a7-42d5-b39f-fcf738692ef6 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:48:57.421343 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8c8af90e-15a7-42d5-b39f-fcf738692ef6 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:48:57.421783 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8c8af90e-15a7-42d5-b39f-fcf738692ef6 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:48:57.422211 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8c8af90e-15a7-42d5-b39f-fcf738692ef6 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:48:57.709305 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-e93917bb-f5b1-4442-a3e1-c63f4056555d tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6de80d628cf14694af6d2cd16f16afad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae95f5dee52f4235b3478cc90f3b0347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:48:57.720060 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-e93917bb-f5b1-4442-a3e1-c63f4056555d tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] 10.222.0.18 "GET /compute/v2.1/servers/e169b57b-4899-4a9e-80a9-d6290eb63ceb" status: 200 len: 1487 microversion: 2.1 time: 0.354234 Oct 22 20:48:57.724807 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 102/189] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:48:57 2022] GET /compute/v2.1/servers/e169b57b-4899-4a9e-80a9-d6290eb63ceb => generated 1487 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:48:57.730990 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-12fe7c82-9ca5-4755-a201-954a37020446 tempest-QuotasAdminTestV257-1660297992 tempest-QuotasAdminTestV257-1660297992-project-admin] Calling method '.version_select at 0x7fd3a4cd9280>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:48:57.741607 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-8c8af90e-15a7-42d5-b39f-fcf738692ef6 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e13dcabaaa4b218945aeeabb4c902e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675a324f0134844a1964f64322493ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:48:57.753743 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-8c8af90e-15a7-42d5-b39f-fcf738692ef6 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] 10.222.0.18 "GET /compute/v2.1/servers/f592a6fe-8cc7-4bb1-bb04-f8ddd358eeca" status: 200 len: 1473 microversion: 2.1 time: 0.351357 Oct 22 20:48:57.754320 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 88/190] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:48:57 2022] GET /compute/v2.1/servers/f592a6fe-8cc7-4bb1-bb04-f8ddd358eeca => generated 1473 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:48:57.943649 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-965d7a74-741f-4865-96f8-f7a7a99f2109 tempest-ServicesAdminNegativeV253TestJSON-200826749 tempest-ServicesAdminNegativeV253TestJSON-200826749-project-admin] Action: 'update', calling method: .version_select at 0x7fd3a4e6c8b0>, body: {"status": "disabled", "disabled_reason": "maintenance"} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:48:57.947931 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-965d7a74-741f-4865-96f8-f7a7a99f2109 tempest-ServicesAdminNegativeV253TestJSON-200826749 tempest-ServicesAdminNegativeV253TestJSON-200826749-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:48:57.948870 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-965d7a74-741f-4865-96f8-f7a7a99f2109 tempest-ServicesAdminNegativeV253TestJSON-200826749 tempest-ServicesAdminNegativeV253TestJSON-200826749-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:48:57.949475 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-965d7a74-741f-4865-96f8-f7a7a99f2109 tempest-ServicesAdminNegativeV253TestJSON-200826749 tempest-ServicesAdminNegativeV253TestJSON-200826749-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:48:57.961434 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-965d7a74-741f-4865-96f8-f7a7a99f2109 tempest-ServicesAdminNegativeV253TestJSON-200826749 tempest-ServicesAdminNegativeV253TestJSON-200826749-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:48:57.961976 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-965d7a74-741f-4865-96f8-f7a7a99f2109 tempest-ServicesAdminNegativeV253TestJSON-200826749 tempest-ServicesAdminNegativeV253TestJSON-200826749-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:48:57.962584 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-965d7a74-741f-4865-96f8-f7a7a99f2109 tempest-ServicesAdminNegativeV253TestJSON-200826749 tempest-ServicesAdminNegativeV253TestJSON-200826749-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:48:57.970676 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-965d7a74-741f-4865-96f8-f7a7a99f2109 tempest-ServicesAdminNegativeV253TestJSON-200826749 tempest-ServicesAdminNegativeV253TestJSON-200826749-project-admin] HTTP exception thrown: Service 172b87b1-9cde-4cc7-82e4-ca69e49afcc5 could not be found. Oct 22 20:48:57.975764 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-965d7a74-741f-4865-96f8-f7a7a99f2109 tempest-ServicesAdminNegativeV253TestJSON-200826749 tempest-ServicesAdminNegativeV253TestJSON-200826749-project-admin] Request method failure captured: Oct 22 20:48:57.975764 ncdv-master-1 devstack@n-api.service[138744]: request: PUT /compute/v2.1/os-services/172b87b1-9cde-4cc7-82e4-ca69e49afcc5 HTTP/1.1 Oct 22 20:48:57.975764 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 20:48:57.975764 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 20:48:57.975764 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 20:48:57.975764 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 56 Oct 22 20:48:57.975764 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 20:48:57.975764 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 20:48:57.975764 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 20:48:57.975764 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 20:48:57.975764 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVFc5z4kvde7iEiFcwG9LeBXIUd6Pd2ayD6ZUQPVEIWZyIowSwRDcf5ScOGb_dCXrtBOM8VhvnPi1X3StGfgeMeZgOiNIQ7cIuci-aTKyN0UUqysgwqOTYfZCSXu3jSKtz9tRXltigmbnd-KazIbtY_eWrqS3nGqP6AzmGHrZUbgg7nM Oct 22 20:48:57.975764 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 20:48:57.975764 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 20:48:57.975764 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 20:48:57.975764 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 20:48:57.975764 ncdv-master-1 devstack@n-api.service[138744]: X-Openstack-Nova-Api-Version: 2.53 Oct 22 20:48:57.975764 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 20:48:57.975764 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 20:48:57.975764 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: 6d572694eee94c749a580362dcab3c12 Oct 22 20:48:57.975764 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-200826749 Oct 22 20:48:57.975764 ncdv-master-1 devstack@n-api.service[138744]: X-Role: admin,member,reader Oct 22 20:48:57.975764 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: admin,member,reader Oct 22 20:48:57.977554 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_6d572694eee94c749a580362dcab3c12"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6d572694eee94c749a580362dcab3c12"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/6d572694eee94c749a580362dcab3c12"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6d572694eee94c749a580362dcab3c12"}]}] Oct 22 20:48:57.977554 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-200826749 Oct 22 20:48:57.977554 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: 6d572694eee94c749a580362dcab3c12 Oct 22 20:48:57.977554 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-200826749 Oct 22 20:48:57.977554 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-ServicesAdminNegativeV253TestJSON-200826749-project-admin Oct 22 20:48:57.977554 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 20:48:57.977554 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 20:48:57.977554 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: 809683cb78474e85865166a3626b6b45 Oct 22 20:48:57.977554 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-200826749-project-admin Oct 22 20:48:57.977554 ncdv-master-1 devstack@n-api.service[138744]: Oct 22 20:48:57.977554 ncdv-master-1 devstack@n-api.service[138744]: {"status": "disabled", "disabled_reason": "maintenance"} Oct 22 20:48:57.977554 ncdv-master-1 devstack@n-api.service[138744]: method: Oct 22 20:48:57.977554 ncdv-master-1 devstack@n-api.service[138744]: exception: Service 172b87b1-9cde-4cc7-82e4-ca69e49afcc5 could not be found. Oct 22 20:48:57.978467 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': '172b87b1-9cde-4cc7-82e4-ca69e49afcc5', 'body': {'status': 'disabled', 'disabled_reason': 'maintenance'}} Oct 22 20:48:57.978467 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:48:57.978467 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:48:57.978467 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Oct 22 20:48:57.978467 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Oct 22 20:48:57.978467 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 22 20:48:57.978467 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 22 20:48:57.978467 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 22 20:48:57.978467 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:48:57.978467 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:48:57.978467 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:48:57.978467 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:48:57.978467 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Oct 22 20:48:57.978467 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Oct 22 20:48:57.978467 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Oct 22 20:48:57.978467 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Oct 22 20:48:57.978467 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 172b87b1-9cde-4cc7-82e4-ca69e49afcc5 could not be found. Oct 22 20:48:57.978467 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:48:57.978467 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:48:57.978467 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:48:57.978467 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:48:57.980119 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:48:57.980119 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:48:57.980119 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:48:57.980119 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:48:57.980119 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 22 20:48:57.980119 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 22 20:48:57.980119 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:48:57.980119 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:48:57.980119 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 20:48:57.980119 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 20:48:57.980119 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Oct 22 20:48:57.980119 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 22 20:48:57.980119 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 172b87b1-9cde-4cc7-82e4-ca69e49afcc5 could not be found. Oct 22 20:48:57.980119 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:48:57.980119 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:48:57.980119 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:48:57.980119 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:48:57.980119 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:48:57.980119 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:48:57.980119 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 20:48:57.983040 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 20:48:57.983040 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 172b87b1-9cde-4cc7-82e4-ca69e49afcc5 could not be found. Oct 22 20:48:57.983040 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:48:57.983040 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-965d7a74-741f-4865-96f8-f7a7a99f2109 tempest-ServicesAdminNegativeV253TestJSON-200826749 tempest-ServicesAdminNegativeV253TestJSON-200826749-project-admin] Returning 404 to user: Service 172b87b1-9cde-4cc7-82e4-ca69e49afcc5 could not be found. {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:48:57.983040 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-965d7a74-741f-4865-96f8-f7a7a99f2109 tempest-ServicesAdminNegativeV253TestJSON-200826749 tempest-ServicesAdminNegativeV253TestJSON-200826749-project-admin] 10.222.0.18 "PUT /compute/v2.1/os-services/172b87b1-9cde-4cc7-82e4-ca69e49afcc5" status: 404 len: 110 microversion: 2.53 time: 0.214871 Oct 22 20:48:57.983040 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 89/191] 10.222.0.18 () {62 vars in 1309 bytes} [Sat Oct 22 20:48:57 2022] PUT /compute/v2.1/os-services/172b87b1-9cde-4cc7-82e4-ca69e49afcc5 => generated 110 bytes in 223 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 22 20:48:57.983490 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-8a53b99a-e11f-4446-947b-95b9f61b6f14 tempest-AggregatesAdminTestJSON-1406494805 tempest-AggregatesAdminTestJSON-1406494805-project-admin] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:48:57.984091 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-8a53b99a-e11f-4446-947b-95b9f61b6f14 tempest-AggregatesAdminTestJSON-1406494805 tempest-AggregatesAdminTestJSON-1406494805-project-admin] [instance: e169b57b-4899-4a9e-80a9-d6290eb63ceb] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:48:57.990693 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8a53b99a-e11f-4446-947b-95b9f61b6f14 tempest-AggregatesAdminTestJSON-1406494805 tempest-AggregatesAdminTestJSON-1406494805-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:48:57.991193 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8a53b99a-e11f-4446-947b-95b9f61b6f14 tempest-AggregatesAdminTestJSON-1406494805 tempest-AggregatesAdminTestJSON-1406494805-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:48:57.991847 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8a53b99a-e11f-4446-947b-95b9f61b6f14 tempest-AggregatesAdminTestJSON-1406494805 tempest-AggregatesAdminTestJSON-1406494805-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:48:57.992552 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8a53b99a-e11f-4446-947b-95b9f61b6f14 tempest-AggregatesAdminTestJSON-1406494805 tempest-AggregatesAdminTestJSON-1406494805-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:48:57.993000 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8a53b99a-e11f-4446-947b-95b9f61b6f14 tempest-AggregatesAdminTestJSON-1406494805 tempest-AggregatesAdminTestJSON-1406494805-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:48:57.993424 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8a53b99a-e11f-4446-947b-95b9f61b6f14 tempest-AggregatesAdminTestJSON-1406494805 tempest-AggregatesAdminTestJSON-1406494805-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:48:58.025344 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-12fe7c82-9ca5-4755-a201-954a37020446 tempest-QuotasAdminTestV257-1660297992 tempest-QuotasAdminTestV257-1660297992-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:48:58.026808 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-12fe7c82-9ca5-4755-a201-954a37020446 tempest-QuotasAdminTestV257-1660297992 tempest-QuotasAdminTestV257-1660297992-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:48:58.027508 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-12fe7c82-9ca5-4755-a201-954a37020446 tempest-QuotasAdminTestV257-1660297992 tempest-QuotasAdminTestV257-1660297992-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:48:58.029357 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-12fe7c82-9ca5-4755-a201-954a37020446 tempest-QuotasAdminTestV257-1660297992 tempest-QuotasAdminTestV257-1660297992-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:48:58.029922 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-12fe7c82-9ca5-4755-a201-954a37020446 tempest-QuotasAdminTestV257-1660297992 tempest-QuotasAdminTestV257-1660297992-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:48:58.030455 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-12fe7c82-9ca5-4755-a201-954a37020446 tempest-QuotasAdminTestV257-1660297992 tempest-QuotasAdminTestV257-1660297992-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:48:58.063109 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-12fe7c82-9ca5-4755-a201-954a37020446 tempest-QuotasAdminTestV257-1660297992 tempest-QuotasAdminTestV257-1660297992-project-admin] 10.222.0.18 "GET /compute/v2.1/os-quota-sets/28cb8a61f6e54f7986328242f19b3113/detail" status: 200 len: 463 microversion: 2.57 time: 0.336800 Oct 22 20:48:58.063982 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 103/192] 10.222.0.18 () {60 vars in 1304 bytes} [Sat Oct 22 20:48:57 2022] GET /compute/v2.1/os-quota-sets/28cb8a61f6e54f7986328242f19b3113/detail => generated 463 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 22 20:48:58.085471 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-538bdb29-b2f3-47f9-89f8-c97bbbec66b4 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:48:58.086251 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-538bdb29-b2f3-47f9-89f8-c97bbbec66b4 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] [instance: 5c3de24c-090d-4769-8975-207eb939b979] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:48:58.108456 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-538bdb29-b2f3-47f9-89f8-c97bbbec66b4 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:48:58.113218 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-538bdb29-b2f3-47f9-89f8-c97bbbec66b4 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:48:58.114031 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-538bdb29-b2f3-47f9-89f8-c97bbbec66b4 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:48:58.115023 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-538bdb29-b2f3-47f9-89f8-c97bbbec66b4 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:48:58.116052 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-538bdb29-b2f3-47f9-89f8-c97bbbec66b4 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:48:58.116691 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-538bdb29-b2f3-47f9-89f8-c97bbbec66b4 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:48:58.229269 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-538bdb29-b2f3-47f9-89f8-c97bbbec66b4 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1ce98c66024d49b31e8e4f38b82838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a20f8f858424c89bf67a56feb720ac9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:48:58.238920 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-538bdb29-b2f3-47f9-89f8-c97bbbec66b4 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed1ce98c66024d49b31e8e4f38b82838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a20f8f858424c89bf67a56feb720ac9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:48:58.240605 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-538bdb29-b2f3-47f9-89f8-c97bbbec66b4 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed1ce98c66024d49b31e8e4f38b82838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a20f8f858424c89bf67a56feb720ac9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:48:58.246562 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-538bdb29-b2f3-47f9-89f8-c97bbbec66b4 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] 10.222.0.18 "GET /compute/v2.1/servers/5c3de24c-090d-4769-8975-207eb939b979" status: 200 len: 1446 microversion: 2.75 time: 0.181283 Oct 22 20:48:58.247660 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 104/193] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 20:48:58 2022] GET /compute/v2.1/servers/5c3de24c-090d-4769-8975-207eb939b979 => generated 1446 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 20:48:58.252473 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-575a22d9-1504-413b-bb71-f329783aa64e tempest-ServicesAdminNegativeV253TestJSON-200826749 tempest-ServicesAdminNegativeV253TestJSON-200826749-project-admin] Action: 'update', calling method: .version_select at 0x7fd3a4cb4ca0>, body: {"status": "disabled"} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:48:58.256208 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-575a22d9-1504-413b-bb71-f329783aa64e tempest-ServicesAdminNegativeV253TestJSON-200826749 tempest-ServicesAdminNegativeV253TestJSON-200826749-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:48:58.256895 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-575a22d9-1504-413b-bb71-f329783aa64e tempest-ServicesAdminNegativeV253TestJSON-200826749 tempest-ServicesAdminNegativeV253TestJSON-200826749-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:48:58.257490 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-575a22d9-1504-413b-bb71-f329783aa64e tempest-ServicesAdminNegativeV253TestJSON-200826749 tempest-ServicesAdminNegativeV253TestJSON-200826749-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:48:58.267150 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-575a22d9-1504-413b-bb71-f329783aa64e tempest-ServicesAdminNegativeV253TestJSON-200826749 tempest-ServicesAdminNegativeV253TestJSON-200826749-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:48:58.267815 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-575a22d9-1504-413b-bb71-f329783aa64e tempest-ServicesAdminNegativeV253TestJSON-200826749 tempest-ServicesAdminNegativeV253TestJSON-200826749-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:48:58.268442 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-575a22d9-1504-413b-bb71-f329783aa64e tempest-ServicesAdminNegativeV253TestJSON-200826749 tempest-ServicesAdminNegativeV253TestJSON-200826749-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:48:58.278567 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.wsgi [None req-575a22d9-1504-413b-bb71-f329783aa64e tempest-ServicesAdminNegativeV253TestJSON-200826749 tempest-ServicesAdminNegativeV253TestJSON-200826749-project-admin] HTTP exception thrown: Service 172b87b1-9cde-4cc7-82e4-ca69e49afcc5 could not be found. Oct 22 20:48:58.283585 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-575a22d9-1504-413b-bb71-f329783aa64e tempest-ServicesAdminNegativeV253TestJSON-200826749 tempest-ServicesAdminNegativeV253TestJSON-200826749-project-admin] Request method failure captured: Oct 22 20:48:58.283585 ncdv-master-1 devstack@n-api.service[138745]: request: PUT /compute/v2.1/os-services/172b87b1-9cde-4cc7-82e4-ca69e49afcc5 HTTP/1.1 Oct 22 20:48:58.283585 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 20:48:58.283585 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 20:48:58.283585 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 20:48:58.283585 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 22 Oct 22 20:48:58.283585 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 20:48:58.283585 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 20:48:58.283585 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 20:48:58.283585 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 20:48:58.283585 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVFc5z4kvde7iEiFcwG9LeBXIUd6Pd2ayD6ZUQPVEIWZyIowSwRDcf5ScOGb_dCXrtBOM8VhvnPi1X3StGfgeMeZgOiNIQ7cIuci-aTKyN0UUqysgwqOTYfZCSXu3jSKtz9tRXltigmbnd-KazIbtY_eWrqS3nGqP6AzmGHrZUbgg7nM Oct 22 20:48:58.283585 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 20:48:58.283585 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 20:48:58.283585 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 20:48:58.283585 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 20:48:58.283585 ncdv-master-1 devstack@n-api.service[138745]: X-Openstack-Nova-Api-Version: 2.53 Oct 22 20:48:58.283585 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 20:48:58.283585 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 20:48:58.283585 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: 6d572694eee94c749a580362dcab3c12 Oct 22 20:48:58.283585 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-200826749 Oct 22 20:48:58.283585 ncdv-master-1 devstack@n-api.service[138745]: X-Role: admin,member,reader Oct 22 20:48:58.283585 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: admin,member,reader Oct 22 20:48:58.285126 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_6d572694eee94c749a580362dcab3c12"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6d572694eee94c749a580362dcab3c12"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/6d572694eee94c749a580362dcab3c12"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6d572694eee94c749a580362dcab3c12"}]}] Oct 22 20:48:58.285126 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-200826749 Oct 22 20:48:58.285126 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: 6d572694eee94c749a580362dcab3c12 Oct 22 20:48:58.285126 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-200826749 Oct 22 20:48:58.285126 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-ServicesAdminNegativeV253TestJSON-200826749-project-admin Oct 22 20:48:58.285126 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 20:48:58.285126 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 20:48:58.285126 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: 809683cb78474e85865166a3626b6b45 Oct 22 20:48:58.285126 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-200826749-project-admin Oct 22 20:48:58.285126 ncdv-master-1 devstack@n-api.service[138745]: Oct 22 20:48:58.285126 ncdv-master-1 devstack@n-api.service[138745]: {"status": "disabled"} Oct 22 20:48:58.285126 ncdv-master-1 devstack@n-api.service[138745]: method: Oct 22 20:48:58.285126 ncdv-master-1 devstack@n-api.service[138745]: exception: Service 172b87b1-9cde-4cc7-82e4-ca69e49afcc5 could not be found. Oct 22 20:48:58.285126 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'id': '172b87b1-9cde-4cc7-82e4-ca69e49afcc5', 'body': {'status': 'disabled'}} Oct 22 20:48:58.286006 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:48:58.286006 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:48:58.286006 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Oct 22 20:48:58.286006 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Oct 22 20:48:58.286006 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 22 20:48:58.286006 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 22 20:48:58.286006 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 22 20:48:58.286006 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:48:58.286006 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:48:58.286006 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:48:58.286006 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:48:58.286006 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Oct 22 20:48:58.286006 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Oct 22 20:48:58.286006 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Oct 22 20:48:58.286006 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Oct 22 20:48:58.286006 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 172b87b1-9cde-4cc7-82e4-ca69e49afcc5 could not be found. Oct 22 20:48:58.286006 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:48:58.286006 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:48:58.286006 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:48:58.286006 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:48:58.286006 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:48:58.287248 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:48:58.287248 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:48:58.287248 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:48:58.287248 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 22 20:48:58.287248 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 22 20:48:58.287248 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:48:58.287248 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:48:58.287248 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 20:48:58.287248 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 20:48:58.287248 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Oct 22 20:48:58.287248 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 22 20:48:58.287248 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 172b87b1-9cde-4cc7-82e4-ca69e49afcc5 could not be found. Oct 22 20:48:58.287248 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:48:58.287248 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:48:58.287248 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:48:58.287248 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:48:58.287248 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:48:58.287248 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:48:58.287248 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 20:48:58.287248 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 20:48:58.288491 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 172b87b1-9cde-4cc7-82e4-ca69e49afcc5 could not be found. Oct 22 20:48:58.288491 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:48:58.289478 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-575a22d9-1504-413b-bb71-f329783aa64e tempest-ServicesAdminNegativeV253TestJSON-200826749 tempest-ServicesAdminNegativeV253TestJSON-200826749-project-admin] Returning 404 to user: Service 172b87b1-9cde-4cc7-82e4-ca69e49afcc5 could not be found. {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:48:58.290440 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-575a22d9-1504-413b-bb71-f329783aa64e tempest-ServicesAdminNegativeV253TestJSON-200826749 tempest-ServicesAdminNegativeV253TestJSON-200826749-project-admin] 10.222.0.18 "PUT /compute/v2.1/os-services/172b87b1-9cde-4cc7-82e4-ca69e49afcc5" status: 404 len: 110 microversion: 2.53 time: 0.041568 Oct 22 20:48:58.291069 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 105/194] 10.222.0.18 () {62 vars in 1309 bytes} [Sat Oct 22 20:48:58 2022] PUT /compute/v2.1/os-services/172b87b1-9cde-4cc7-82e4-ca69e49afcc5 => generated 110 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 22 20:48:58.300648 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-9b232528-8670-4ab6-bf47-67c564f5914c tempest-QuotasAdminTestV257-1660297992 tempest-QuotasAdminTestV257-1660297992-project-admin] Action: 'update', calling method: .version_select at 0x7fd3a4ac8040>, body: {"quota_set": {"ram": "2048"}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:48:58.409736 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9b232528-8670-4ab6-bf47-67c564f5914c tempest-QuotasAdminTestV257-1660297992 tempest-QuotasAdminTestV257-1660297992-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:48:58.410226 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9b232528-8670-4ab6-bf47-67c564f5914c tempest-QuotasAdminTestV257-1660297992 tempest-QuotasAdminTestV257-1660297992-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:48:58.413738 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9b232528-8670-4ab6-bf47-67c564f5914c tempest-QuotasAdminTestV257-1660297992 tempest-QuotasAdminTestV257-1660297992-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:48:58.414525 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9b232528-8670-4ab6-bf47-67c564f5914c tempest-QuotasAdminTestV257-1660297992 tempest-QuotasAdminTestV257-1660297992-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:48:58.415078 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9b232528-8670-4ab6-bf47-67c564f5914c tempest-QuotasAdminTestV257-1660297992 tempest-QuotasAdminTestV257-1660297992-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:48:58.415582 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9b232528-8670-4ab6-bf47-67c564f5914c tempest-QuotasAdminTestV257-1660297992 tempest-QuotasAdminTestV257-1660297992-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:48:58.479094 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9b232528-8670-4ab6-bf47-67c564f5914c tempest-QuotasAdminTestV257-1660297992 tempest-QuotasAdminTestV257-1660297992-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:48:58.480421 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9b232528-8670-4ab6-bf47-67c564f5914c tempest-QuotasAdminTestV257-1660297992 tempest-QuotasAdminTestV257-1660297992-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:48:58.486991 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-8a53b99a-e11f-4446-947b-95b9f61b6f14 tempest-AggregatesAdminTestJSON-1406494805 tempest-AggregatesAdminTestJSON-1406494805-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/e169b57b-4899-4a9e-80a9-d6290eb63ceb" status: 200 len: 1638 microversion: 2.1 time: 0.507486 Oct 22 20:48:58.487911 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 90/195] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:48:57 2022] GET /compute/v2.1/servers/e169b57b-4899-4a9e-80a9-d6290eb63ceb => generated 1638 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:48:58.488221 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9b232528-8670-4ab6-bf47-67c564f5914c tempest-QuotasAdminTestV257-1660297992 tempest-QuotasAdminTestV257-1660297992-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:48:58.489130 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9b232528-8670-4ab6-bf47-67c564f5914c tempest-QuotasAdminTestV257-1660297992 tempest-QuotasAdminTestV257-1660297992-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:48:58.490450 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9b232528-8670-4ab6-bf47-67c564f5914c tempest-QuotasAdminTestV257-1660297992 tempest-QuotasAdminTestV257-1660297992-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:48:58.490933 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9b232528-8670-4ab6-bf47-67c564f5914c tempest-QuotasAdminTestV257-1660297992 tempest-QuotasAdminTestV257-1660297992-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:48:58.509089 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-f5cf42d5-c165-4624-8c29-5e9d230c47c5 tempest-ServicesAdminNegativeV253TestJSON-200826749 tempest-ServicesAdminNegativeV253TestJSON-200826749-project-admin] Action: 'update', calling method: .version_select at 0x7fd3a4be6b80>, body: {"status": "enabled"} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:48:58.515427 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f5cf42d5-c165-4624-8c29-5e9d230c47c5 tempest-ServicesAdminNegativeV253TestJSON-200826749 tempest-ServicesAdminNegativeV253TestJSON-200826749-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:48:58.517687 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f5cf42d5-c165-4624-8c29-5e9d230c47c5 tempest-ServicesAdminNegativeV253TestJSON-200826749 tempest-ServicesAdminNegativeV253TestJSON-200826749-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:48:58.519662 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f5cf42d5-c165-4624-8c29-5e9d230c47c5 tempest-ServicesAdminNegativeV253TestJSON-200826749 tempest-ServicesAdminNegativeV253TestJSON-200826749-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:48:58.534361 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f5cf42d5-c165-4624-8c29-5e9d230c47c5 tempest-ServicesAdminNegativeV253TestJSON-200826749 tempest-ServicesAdminNegativeV253TestJSON-200826749-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:48:58.536012 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f5cf42d5-c165-4624-8c29-5e9d230c47c5 tempest-ServicesAdminNegativeV253TestJSON-200826749 tempest-ServicesAdminNegativeV253TestJSON-200826749-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:48:58.536478 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f5cf42d5-c165-4624-8c29-5e9d230c47c5 tempest-ServicesAdminNegativeV253TestJSON-200826749 tempest-ServicesAdminNegativeV253TestJSON-200826749-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:48:58.542364 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-f5cf42d5-c165-4624-8c29-5e9d230c47c5 tempest-ServicesAdminNegativeV253TestJSON-200826749 tempest-ServicesAdminNegativeV253TestJSON-200826749-project-admin] HTTP exception thrown: Service 172b87b1-9cde-4cc7-82e4-ca69e49afcc5 could not be found. Oct 22 20:48:58.543819 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_api:SELECT=84,nova_api:UPDATE=14,nova_api:INSERT=2 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:48:58.544979 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-f5cf42d5-c165-4624-8c29-5e9d230c47c5 tempest-ServicesAdminNegativeV253TestJSON-200826749 tempest-ServicesAdminNegativeV253TestJSON-200826749-project-admin] Request method failure captured: Oct 22 20:48:58.544979 ncdv-master-1 devstack@n-api.service[138744]: request: PUT /compute/v2.1/os-services/172b87b1-9cde-4cc7-82e4-ca69e49afcc5 HTTP/1.1 Oct 22 20:48:58.544979 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 20:48:58.544979 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 20:48:58.544979 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 20:48:58.544979 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 21 Oct 22 20:48:58.544979 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 20:48:58.544979 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 20:48:58.544979 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 20:48:58.544979 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 20:48:58.544979 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVFc5z4kvde7iEiFcwG9LeBXIUd6Pd2ayD6ZUQPVEIWZyIowSwRDcf5ScOGb_dCXrtBOM8VhvnPi1X3StGfgeMeZgOiNIQ7cIuci-aTKyN0UUqysgwqOTYfZCSXu3jSKtz9tRXltigmbnd-KazIbtY_eWrqS3nGqP6AzmGHrZUbgg7nM Oct 22 20:48:58.544979 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 20:48:58.544979 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 20:48:58.544979 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 20:48:58.544979 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 20:48:58.544979 ncdv-master-1 devstack@n-api.service[138744]: X-Openstack-Nova-Api-Version: 2.53 Oct 22 20:48:58.544979 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 20:48:58.544979 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 20:48:58.544979 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: 6d572694eee94c749a580362dcab3c12 Oct 22 20:48:58.544979 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-200826749 Oct 22 20:48:58.544979 ncdv-master-1 devstack@n-api.service[138744]: X-Role: admin,member,reader Oct 22 20:48:58.544979 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: admin,member,reader Oct 22 20:48:58.546374 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_6d572694eee94c749a580362dcab3c12"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6d572694eee94c749a580362dcab3c12"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/6d572694eee94c749a580362dcab3c12"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6d572694eee94c749a580362dcab3c12"}]}] Oct 22 20:48:58.546374 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-200826749 Oct 22 20:48:58.546374 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: 6d572694eee94c749a580362dcab3c12 Oct 22 20:48:58.546374 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-200826749 Oct 22 20:48:58.546374 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-ServicesAdminNegativeV253TestJSON-200826749-project-admin Oct 22 20:48:58.546374 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 20:48:58.546374 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 20:48:58.546374 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: 809683cb78474e85865166a3626b6b45 Oct 22 20:48:58.546374 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-200826749-project-admin Oct 22 20:48:58.546374 ncdv-master-1 devstack@n-api.service[138744]: Oct 22 20:48:58.546374 ncdv-master-1 devstack@n-api.service[138744]: {"status": "enabled"} Oct 22 20:48:58.546374 ncdv-master-1 devstack@n-api.service[138744]: method: Oct 22 20:48:58.546374 ncdv-master-1 devstack@n-api.service[138744]: exception: Service 172b87b1-9cde-4cc7-82e4-ca69e49afcc5 could not be found. Oct 22 20:48:58.546374 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': '172b87b1-9cde-4cc7-82e4-ca69e49afcc5', 'body': {'status': 'enabled'}} Oct 22 20:48:58.547172 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:48:58.547172 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:48:58.547172 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Oct 22 20:48:58.547172 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Oct 22 20:48:58.547172 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 22 20:48:58.547172 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 22 20:48:58.547172 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 22 20:48:58.547172 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:48:58.547172 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:48:58.547172 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:48:58.547172 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:48:58.547172 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Oct 22 20:48:58.547172 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Oct 22 20:48:58.547172 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Oct 22 20:48:58.547172 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Oct 22 20:48:58.547172 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 172b87b1-9cde-4cc7-82e4-ca69e49afcc5 could not be found. Oct 22 20:48:58.547172 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:48:58.547172 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:48:58.547172 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:48:58.547172 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:48:58.547172 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:48:58.548866 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:48:58.548866 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:48:58.548866 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:48:58.548866 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 22 20:48:58.548866 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 22 20:48:58.548866 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:48:58.548866 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:48:58.548866 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 20:48:58.548866 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 20:48:58.548866 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Oct 22 20:48:58.548866 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 22 20:48:58.548866 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 172b87b1-9cde-4cc7-82e4-ca69e49afcc5 could not be found. Oct 22 20:48:58.548866 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:48:58.548866 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:48:58.548866 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:48:58.548866 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:48:58.548866 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:48:58.548866 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:48:58.548866 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 20:48:58.548866 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 20:48:58.550394 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 172b87b1-9cde-4cc7-82e4-ca69e49afcc5 could not be found. Oct 22 20:48:58.550394 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:48:58.550394 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-f5cf42d5-c165-4624-8c29-5e9d230c47c5 tempest-ServicesAdminNegativeV253TestJSON-200826749 tempest-ServicesAdminNegativeV253TestJSON-200826749-project-admin] Returning 404 to user: Service 172b87b1-9cde-4cc7-82e4-ca69e49afcc5 could not be found. {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:48:58.553497 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-f5cf42d5-c165-4624-8c29-5e9d230c47c5 tempest-ServicesAdminNegativeV253TestJSON-200826749 tempest-ServicesAdminNegativeV253TestJSON-200826749-project-admin] 10.222.0.18 "PUT /compute/v2.1/os-services/172b87b1-9cde-4cc7-82e4-ca69e49afcc5" status: 404 len: 110 microversion: 2.53 time: 0.058741 Oct 22 20:48:58.559637 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 91/196] 10.222.0.18 () {62 vars in 1309 bytes} [Sat Oct 22 20:48:58 2022] PUT /compute/v2.1/os-services/172b87b1-9cde-4cc7-82e4-ca69e49afcc5 => generated 110 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 22 20:48:58.567726 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-d53f2ee0-6482-4214-b4dc-2c1dfe46d997 tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:48:58.571561 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-d53f2ee0-6482-4214-b4dc-2c1dfe46d997 tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] [instance: e169b57b-4899-4a9e-80a9-d6290eb63ceb] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:48:58.581582 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d53f2ee0-6482-4214-b4dc-2c1dfe46d997 tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:48:58.582327 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d53f2ee0-6482-4214-b4dc-2c1dfe46d997 tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:48:58.582454 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-9b232528-8670-4ab6-bf47-67c564f5914c tempest-QuotasAdminTestV257-1660297992 tempest-QuotasAdminTestV257-1660297992-project-admin] 10.222.0.18 "PUT /compute/v2.1/os-quota-sets/28cb8a61f6e54f7986328242f19b3113?user_id=6b810ac3cb634077b0b6ce9dd3de9610" status: 200 len: 148 microversion: 2.57 time: 0.285496 Oct 22 20:48:58.582768 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d53f2ee0-6482-4214-b4dc-2c1dfe46d997 tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:48:58.583148 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 106/197] 10.222.0.18 () {62 vars in 1384 bytes} [Sat Oct 22 20:48:58 2022] PUT /compute/v2.1/os-quota-sets/28cb8a61f6e54f7986328242f19b3113?user_id=6b810ac3cb634077b0b6ce9dd3de9610 => generated 148 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 22 20:48:58.583559 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d53f2ee0-6482-4214-b4dc-2c1dfe46d997 tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:48:58.584027 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d53f2ee0-6482-4214-b4dc-2c1dfe46d997 tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:48:58.584444 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d53f2ee0-6482-4214-b4dc-2c1dfe46d997 tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:48:58.591173 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-8790cf0d-1114-488e-9429-49e2f7ebc507 tempest-ServicesAdminNegativeV253TestJSON-200826749 tempest-ServicesAdminNegativeV253TestJSON-200826749-project-admin] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:48:58.594690 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8790cf0d-1114-488e-9429-49e2f7ebc507 tempest-ServicesAdminNegativeV253TestJSON-200826749 tempest-ServicesAdminNegativeV253TestJSON-200826749-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:48:58.595223 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8790cf0d-1114-488e-9429-49e2f7ebc507 tempest-ServicesAdminNegativeV253TestJSON-200826749 tempest-ServicesAdminNegativeV253TestJSON-200826749-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:48:58.595786 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8790cf0d-1114-488e-9429-49e2f7ebc507 tempest-ServicesAdminNegativeV253TestJSON-200826749 tempest-ServicesAdminNegativeV253TestJSON-200826749-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:48:58.597186 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8790cf0d-1114-488e-9429-49e2f7ebc507 tempest-ServicesAdminNegativeV253TestJSON-200826749 tempest-ServicesAdminNegativeV253TestJSON-200826749-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:48:58.597765 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8790cf0d-1114-488e-9429-49e2f7ebc507 tempest-ServicesAdminNegativeV253TestJSON-200826749 tempest-ServicesAdminNegativeV253TestJSON-200826749-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:48:58.598204 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8790cf0d-1114-488e-9429-49e2f7ebc507 tempest-ServicesAdminNegativeV253TestJSON-200826749 tempest-ServicesAdminNegativeV253TestJSON-200826749-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:48:58.614897 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-d53f2ee0-6482-4214-b4dc-2c1dfe46d997 tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] [instance: e169b57b-4899-4a9e-80a9-d6290eb63ceb] Going to try to terminate instance {{(pid=138744) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 20:48:58.665714 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-8790cf0d-1114-488e-9429-49e2f7ebc507 tempest-ServicesAdminNegativeV253TestJSON-200826749 tempest-ServicesAdminNegativeV253TestJSON-200826749-project-admin] 10.222.0.18 "GET /compute/v2.1/os-services" status: 200 len: 1263 microversion: 2.53 time: 0.080828 Oct 22 20:48:58.666574 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 107/198] 10.222.0.18 () {60 vars in 1178 bytes} [Sat Oct 22 20:48:58 2022] GET /compute/v2.1/os-services => generated 1263 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 20:48:58.671589 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-942e149d-2bd1-4151-bd60-f1295608ffdc tempest-QuotasAdminTestV257-1660297992 tempest-QuotasAdminTestV257-1660297992-project-admin] Calling method '.version_select at 0x7fd3a4ac8700>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:48:58.725677 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-d53f2ee0-6482-4214-b4dc-2c1dfe46d997 tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] 10.222.0.18 "DELETE /compute/v2.1/servers/e169b57b-4899-4a9e-80a9-d6290eb63ceb" status: 204 len: 0 microversion: 2.1 time: 0.164324 Oct 22 20:48:58.727024 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 92/199] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 20:48:58 2022] DELETE /compute/v2.1/servers/e169b57b-4899-4a9e-80a9-d6290eb63ceb => generated 0 bytes in 166 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 20:48:58.735005 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-038918e6-eb4c-4556-a993-249ab2c8fa96 tempest-ServicesAdminNegativeV253TestJSON-200826749 tempest-ServicesAdminNegativeV253TestJSON-200826749-project-admin] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:48:58.740292 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-038918e6-eb4c-4556-a993-249ab2c8fa96 tempest-ServicesAdminNegativeV253TestJSON-200826749 tempest-ServicesAdminNegativeV253TestJSON-200826749-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:48:58.741844 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-038918e6-eb4c-4556-a993-249ab2c8fa96 tempest-ServicesAdminNegativeV253TestJSON-200826749 tempest-ServicesAdminNegativeV253TestJSON-200826749-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:48:58.742382 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-038918e6-eb4c-4556-a993-249ab2c8fa96 tempest-ServicesAdminNegativeV253TestJSON-200826749 tempest-ServicesAdminNegativeV253TestJSON-200826749-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:48:58.743461 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-038918e6-eb4c-4556-a993-249ab2c8fa96 tempest-ServicesAdminNegativeV253TestJSON-200826749 tempest-ServicesAdminNegativeV253TestJSON-200826749-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:48:58.744087 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-038918e6-eb4c-4556-a993-249ab2c8fa96 tempest-ServicesAdminNegativeV253TestJSON-200826749 tempest-ServicesAdminNegativeV253TestJSON-200826749-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:48:58.744762 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-038918e6-eb4c-4556-a993-249ab2c8fa96 tempest-ServicesAdminNegativeV253TestJSON-200826749 tempest-ServicesAdminNegativeV253TestJSON-200826749-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:48:58.772506 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-038918e6-eb4c-4556-a993-249ab2c8fa96 tempest-ServicesAdminNegativeV253TestJSON-200826749 tempest-ServicesAdminNegativeV253TestJSON-200826749-project-admin] 10.222.0.18 "GET /compute/v2.1/os-services" status: 200 len: 1263 microversion: 2.53 time: 0.043833 Oct 22 20:48:58.782426 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 93/200] 10.222.0.18 () {60 vars in 1211 bytes} [Sat Oct 22 20:48:58 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 1263 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 20:48:58.788864 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-c897ff3c-babc-46f9-bee9-027d529dc947 tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:48:58.789635 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-c897ff3c-babc-46f9-bee9-027d529dc947 tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] [instance: e169b57b-4899-4a9e-80a9-d6290eb63ceb] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:48:58.796503 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c897ff3c-babc-46f9-bee9-027d529dc947 tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:48:58.797098 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c897ff3c-babc-46f9-bee9-027d529dc947 tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:48:58.797484 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c897ff3c-babc-46f9-bee9-027d529dc947 tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:48:58.798327 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c897ff3c-babc-46f9-bee9-027d529dc947 tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:48:58.798776 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c897ff3c-babc-46f9-bee9-027d529dc947 tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:48:58.799246 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c897ff3c-babc-46f9-bee9-027d529dc947 tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:48:59.010135 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-c897ff3c-babc-46f9-bee9-027d529dc947 tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6de80d628cf14694af6d2cd16f16afad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae95f5dee52f4235b3478cc90f3b0347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:48:59.024146 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-c897ff3c-babc-46f9-bee9-027d529dc947 tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] 10.222.0.18 "GET /compute/v2.1/servers/e169b57b-4899-4a9e-80a9-d6290eb63ceb" status: 200 len: 1493 microversion: 2.1 time: 0.239634 Oct 22 20:48:59.025155 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 94/201] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:48:58 2022] GET /compute/v2.1/servers/e169b57b-4899-4a9e-80a9-d6290eb63ceb => generated 1493 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:48:59.055547 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-838aa716-fbd8-4452-8ea2-b04c6f04a982 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:48:59.056421 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-838aa716-fbd8-4452-8ea2-b04c6f04a982 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] [instance: f592a6fe-8cc7-4bb1-bb04-f8ddd358eeca] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:48:59.061694 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-942e149d-2bd1-4151-bd60-f1295608ffdc tempest-QuotasAdminTestV257-1660297992 tempest-QuotasAdminTestV257-1660297992-project-admin] 10.222.0.18 "GET /compute/v2.1/os-quota-sets/28cb8a61f6e54f7986328242f19b3113?user_id=6b810ac3cb634077b0b6ce9dd3de9610" status: 200 len: 190 microversion: 2.57 time: 0.393941 Oct 22 20:48:59.063470 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 108/202] 10.222.0.18 () {60 vars in 1364 bytes} [Sat Oct 22 20:48:58 2022] GET /compute/v2.1/os-quota-sets/28cb8a61f6e54f7986328242f19b3113?user_id=6b810ac3cb634077b0b6ce9dd3de9610 => generated 190 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 22 20:48:59.074501 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-838aa716-fbd8-4452-8ea2-b04c6f04a982 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:48:59.075884 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-838aa716-fbd8-4452-8ea2-b04c6f04a982 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:48:59.076594 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-838aa716-fbd8-4452-8ea2-b04c6f04a982 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:48:59.077619 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-838aa716-fbd8-4452-8ea2-b04c6f04a982 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:48:59.078291 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-838aa716-fbd8-4452-8ea2-b04c6f04a982 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:48:59.079908 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-838aa716-fbd8-4452-8ea2-b04c6f04a982 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:48:59.094200 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-0baa13b8-b84b-46bd-9a17-39b1f1e90e53 tempest-ServicesAdminNegativeV253TestJSON-200826749 tempest-ServicesAdminNegativeV253TestJSON-200826749-project-admin] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:48:59.106118 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0baa13b8-b84b-46bd-9a17-39b1f1e90e53 tempest-ServicesAdminNegativeV253TestJSON-200826749 tempest-ServicesAdminNegativeV253TestJSON-200826749-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:48:59.107614 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0baa13b8-b84b-46bd-9a17-39b1f1e90e53 tempest-ServicesAdminNegativeV253TestJSON-200826749 tempest-ServicesAdminNegativeV253TestJSON-200826749-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:48:59.109855 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0baa13b8-b84b-46bd-9a17-39b1f1e90e53 tempest-ServicesAdminNegativeV253TestJSON-200826749 tempest-ServicesAdminNegativeV253TestJSON-200826749-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:48:59.112878 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0baa13b8-b84b-46bd-9a17-39b1f1e90e53 tempest-ServicesAdminNegativeV253TestJSON-200826749 tempest-ServicesAdminNegativeV253TestJSON-200826749-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:48:59.115468 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0baa13b8-b84b-46bd-9a17-39b1f1e90e53 tempest-ServicesAdminNegativeV253TestJSON-200826749 tempest-ServicesAdminNegativeV253TestJSON-200826749-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:48:59.116210 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0baa13b8-b84b-46bd-9a17-39b1f1e90e53 tempest-ServicesAdminNegativeV253TestJSON-200826749 tempest-ServicesAdminNegativeV253TestJSON-200826749-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:48:59.164577 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-0baa13b8-b84b-46bd-9a17-39b1f1e90e53 tempest-ServicesAdminNegativeV253TestJSON-200826749 tempest-ServicesAdminNegativeV253TestJSON-200826749-project-admin] 10.222.0.18 "GET /compute/v2.1/os-services" status: 200 len: 1263 microversion: 2.53 time: 0.099429 Oct 22 20:48:59.165647 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 109/203] 10.222.0.18 () {60 vars in 1178 bytes} [Sat Oct 22 20:48:59 2022] GET /compute/v2.1/os-services => generated 1263 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 20:48:59.184026 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-aa84e238-9bfe-4fb8-a1e0-9ef401af269d tempest-ServicesAdminNegativeV253TestJSON-200826749 tempest-ServicesAdminNegativeV253TestJSON-200826749-project-admin] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:48:59.194822 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-aa84e238-9bfe-4fb8-a1e0-9ef401af269d tempest-ServicesAdminNegativeV253TestJSON-200826749 tempest-ServicesAdminNegativeV253TestJSON-200826749-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:48:59.197148 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-aa84e238-9bfe-4fb8-a1e0-9ef401af269d tempest-ServicesAdminNegativeV253TestJSON-200826749 tempest-ServicesAdminNegativeV253TestJSON-200826749-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:48:59.198370 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-aa84e238-9bfe-4fb8-a1e0-9ef401af269d tempest-ServicesAdminNegativeV253TestJSON-200826749 tempest-ServicesAdminNegativeV253TestJSON-200826749-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:48:59.201643 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-aa84e238-9bfe-4fb8-a1e0-9ef401af269d tempest-ServicesAdminNegativeV253TestJSON-200826749 tempest-ServicesAdminNegativeV253TestJSON-200826749-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:48:59.203196 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-aa84e238-9bfe-4fb8-a1e0-9ef401af269d tempest-ServicesAdminNegativeV253TestJSON-200826749 tempest-ServicesAdminNegativeV253TestJSON-200826749-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:48:59.204048 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-aa84e238-9bfe-4fb8-a1e0-9ef401af269d tempest-ServicesAdminNegativeV253TestJSON-200826749 tempest-ServicesAdminNegativeV253TestJSON-200826749-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:48:59.280483 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-aa84e238-9bfe-4fb8-a1e0-9ef401af269d tempest-ServicesAdminNegativeV253TestJSON-200826749 tempest-ServicesAdminNegativeV253TestJSON-200826749-project-admin] 10.222.0.18 "GET /compute/v2.1/os-services?host=ncdv-master-1&binary=xxx" status: 200 len: 16 microversion: 2.53 time: 0.105972 Oct 22 20:48:59.284342 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 110/204] 10.222.0.18 () {60 vars in 1237 bytes} [Sat Oct 22 20:48:59 2022] GET /compute/v2.1/os-services?host=ncdv-master-1&binary=xxx => generated 16 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:48:59.293196 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-9ba15a71-3ecc-4259-9bc5-707ab01ded2d tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:48:59.294128 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-9ba15a71-3ecc-4259-9bc5-707ab01ded2d tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] [instance: 5c3de24c-090d-4769-8975-207eb939b979] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:48:59.303610 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9ba15a71-3ecc-4259-9bc5-707ab01ded2d tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:48:59.304613 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9ba15a71-3ecc-4259-9bc5-707ab01ded2d tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:48:59.305827 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9ba15a71-3ecc-4259-9bc5-707ab01ded2d tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:48:59.308476 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9ba15a71-3ecc-4259-9bc5-707ab01ded2d tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:48:59.309203 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9ba15a71-3ecc-4259-9bc5-707ab01ded2d tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:48:59.309831 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9ba15a71-3ecc-4259-9bc5-707ab01ded2d tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:48:59.337256 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-838aa716-fbd8-4452-8ea2-b04c6f04a982 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e13dcabaaa4b218945aeeabb4c902e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675a324f0134844a1964f64322493ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:48:59.350408 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-838aa716-fbd8-4452-8ea2-b04c6f04a982 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] 10.222.0.18 "GET /compute/v2.1/servers/f592a6fe-8cc7-4bb1-bb04-f8ddd358eeca" status: 200 len: 1473 microversion: 2.1 time: 0.302823 Oct 22 20:48:59.352953 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 95/205] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:48:59 2022] GET /compute/v2.1/servers/f592a6fe-8cc7-4bb1-bb04-f8ddd358eeca => generated 1473 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:48:59.373395 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-ff591bbe-c5f1-4a4b-8b0b-b476d03e2faf tempest-ServicesAdminNegativeV253TestJSON-200826749 tempest-ServicesAdminNegativeV253TestJSON-200826749-project-admin] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:48:59.382158 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ff591bbe-c5f1-4a4b-8b0b-b476d03e2faf tempest-ServicesAdminNegativeV253TestJSON-200826749 tempest-ServicesAdminNegativeV253TestJSON-200826749-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:48:59.383079 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ff591bbe-c5f1-4a4b-8b0b-b476d03e2faf tempest-ServicesAdminNegativeV253TestJSON-200826749 tempest-ServicesAdminNegativeV253TestJSON-200826749-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:48:59.384318 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ff591bbe-c5f1-4a4b-8b0b-b476d03e2faf tempest-ServicesAdminNegativeV253TestJSON-200826749 tempest-ServicesAdminNegativeV253TestJSON-200826749-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:48:59.386108 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ff591bbe-c5f1-4a4b-8b0b-b476d03e2faf tempest-ServicesAdminNegativeV253TestJSON-200826749 tempest-ServicesAdminNegativeV253TestJSON-200826749-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:48:59.388305 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ff591bbe-c5f1-4a4b-8b0b-b476d03e2faf tempest-ServicesAdminNegativeV253TestJSON-200826749 tempest-ServicesAdminNegativeV253TestJSON-200826749-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:48:59.390232 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ff591bbe-c5f1-4a4b-8b0b-b476d03e2faf tempest-ServicesAdminNegativeV253TestJSON-200826749 tempest-ServicesAdminNegativeV253TestJSON-200826749-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:48:59.456899 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-ff591bbe-c5f1-4a4b-8b0b-b476d03e2faf tempest-ServicesAdminNegativeV253TestJSON-200826749 tempest-ServicesAdminNegativeV253TestJSON-200826749-project-admin] 10.222.0.18 "GET /compute/v2.1/os-services" status: 200 len: 1263 microversion: 2.53 time: 0.101914 Oct 22 20:48:59.457533 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 96/206] 10.222.0.18 () {60 vars in 1178 bytes} [Sat Oct 22 20:48:59 2022] GET /compute/v2.1/os-services => generated 1263 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 20:48:59.470488 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-91b09007-d7e5-4edc-83ac-a32a5d87e13a tempest-ServicesAdminNegativeV253TestJSON-200826749 tempest-ServicesAdminNegativeV253TestJSON-200826749-project-admin] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:48:59.474704 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-91b09007-d7e5-4edc-83ac-a32a5d87e13a tempest-ServicesAdminNegativeV253TestJSON-200826749 tempest-ServicesAdminNegativeV253TestJSON-200826749-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:48:59.475584 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-91b09007-d7e5-4edc-83ac-a32a5d87e13a tempest-ServicesAdminNegativeV253TestJSON-200826749 tempest-ServicesAdminNegativeV253TestJSON-200826749-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:48:59.479045 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-91b09007-d7e5-4edc-83ac-a32a5d87e13a tempest-ServicesAdminNegativeV253TestJSON-200826749 tempest-ServicesAdminNegativeV253TestJSON-200826749-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:48:59.480073 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-91b09007-d7e5-4edc-83ac-a32a5d87e13a tempest-ServicesAdminNegativeV253TestJSON-200826749 tempest-ServicesAdminNegativeV253TestJSON-200826749-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:48:59.480703 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-91b09007-d7e5-4edc-83ac-a32a5d87e13a tempest-ServicesAdminNegativeV253TestJSON-200826749 tempest-ServicesAdminNegativeV253TestJSON-200826749-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:48:59.481286 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-91b09007-d7e5-4edc-83ac-a32a5d87e13a tempest-ServicesAdminNegativeV253TestJSON-200826749 tempest-ServicesAdminNegativeV253TestJSON-200826749-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:48:59.534254 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-9ba15a71-3ecc-4259-9bc5-707ab01ded2d tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1ce98c66024d49b31e8e4f38b82838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a20f8f858424c89bf67a56feb720ac9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:48:59.548083 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-9ba15a71-3ecc-4259-9bc5-707ab01ded2d tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed1ce98c66024d49b31e8e4f38b82838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a20f8f858424c89bf67a56feb720ac9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:48:59.557845 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-9ba15a71-3ecc-4259-9bc5-707ab01ded2d tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed1ce98c66024d49b31e8e4f38b82838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a20f8f858424c89bf67a56feb720ac9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:48:59.578031 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-9ba15a71-3ecc-4259-9bc5-707ab01ded2d tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] 10.222.0.18 "GET /compute/v2.1/servers/5c3de24c-090d-4769-8975-207eb939b979" status: 200 len: 1446 microversion: 2.75 time: 0.291650 Oct 22 20:48:59.578642 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-91b09007-d7e5-4edc-83ac-a32a5d87e13a tempest-ServicesAdminNegativeV253TestJSON-200826749 tempest-ServicesAdminNegativeV253TestJSON-200826749-project-admin] 10.222.0.18 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.53 time: 0.111861 Oct 22 20:48:59.579625 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 97/207] 10.222.0.18 () {60 vars in 1239 bytes} [Sat Oct 22 20:48:59 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:48:59.592095 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 111/208] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 20:48:59 2022] GET /compute/v2.1/servers/5c3de24c-090d-4769-8975-207eb939b979 => generated 1446 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 20:48:59.725162 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-948b2ceb-8b1f-4c8a-9859-f7f86d4166b5 req-1b60efd8-16b2-41e6-8da5-179b6ed03c08 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f592a6fe-8cc7-4bb1-bb04-f8ddd358eeca", "name": "network-vif-deleted", "tag": "a1417ffd-e3b2-4e5f-8fb0-0c90bf22df37"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:48:59.754576 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-948b2ceb-8b1f-4c8a-9859-f7f86d4166b5 req-1b60efd8-16b2-41e6-8da5-179b6ed03c08 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:48:59.756728 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-948b2ceb-8b1f-4c8a-9859-f7f86d4166b5 req-1b60efd8-16b2-41e6-8da5-179b6ed03c08 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:48:59.758369 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-948b2ceb-8b1f-4c8a-9859-f7f86d4166b5 req-1b60efd8-16b2-41e6-8da5-179b6ed03c08 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:48:59.792529 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-948b2ceb-8b1f-4c8a-9859-f7f86d4166b5 req-1b60efd8-16b2-41e6-8da5-179b6ed03c08 service nova] Creating event network-vif-deleted:a1417ffd-e3b2-4e5f-8fb0-0c90bf22df37 for instance f592a6fe-8cc7-4bb1-bb04-f8ddd358eeca on nch1-master-1 Oct 22 20:48:59.804688 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-948b2ceb-8b1f-4c8a-9859-f7f86d4166b5 req-1b60efd8-16b2-41e6-8da5-179b6ed03c08 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085966 Oct 22 20:48:59.817505 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 112/209] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:48:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:49:00.052958 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-893dc412-1868-4368-9e19-9a67383b6c97 tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:49:00.053616 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-893dc412-1868-4368-9e19-9a67383b6c97 tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] [instance: e169b57b-4899-4a9e-80a9-d6290eb63ceb] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:49:00.066842 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-893dc412-1868-4368-9e19-9a67383b6c97 tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:00.067454 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-893dc412-1868-4368-9e19-9a67383b6c97 tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:00.070884 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-893dc412-1868-4368-9e19-9a67383b6c97 tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:00.070884 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-893dc412-1868-4368-9e19-9a67383b6c97 tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:00.070884 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-893dc412-1868-4368-9e19-9a67383b6c97 tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:00.070884 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-893dc412-1868-4368-9e19-9a67383b6c97 tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:00.200881 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-6570db91-ec52-47a0-8171-38542754be15 tempest-ServicesAdminNegativeV253TestJSON-645643668 tempest-ServicesAdminNegativeV253TestJSON-645643668-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:49:00.207841 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-6570db91-ec52-47a0-8171-38542754be15 tempest-ServicesAdminNegativeV253TestJSON-645643668 tempest-ServicesAdminNegativeV253TestJSON-645643668-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': 'feb6893afe694fc8b3689da679807f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375a3b50d22346ba94e0ca58ea55b255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:49:00.210072 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-6570db91-ec52-47a0-8171-38542754be15 tempest-ServicesAdminNegativeV253TestJSON-645643668 tempest-ServicesAdminNegativeV253TestJSON-645643668-project] Request method failure captured: Oct 22 20:49:00.210072 ncdv-master-1 devstack@n-api.service[138744]: request: GET /compute/v2.1/os-services HTTP/1.1 Oct 22 20:49:00.210072 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 20:49:00.210072 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 20:49:00.210072 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 20:49:00.210072 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 0 Oct 22 20:49:00.210072 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 20:49:00.210072 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 20:49:00.210072 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 20:49:00.210072 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 20:49:00.210072 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVFc46NhNCU5XCIAjIPhOt-vp1rxJYRgkI5qOgo1LY2-rSRsx2g408Y1kAuRgGQ8rHW8X67sZTMfaucdWAmcsOhEqG6BFNCbOarY5g6xFG2w5LcdK2cfAafLHWUEXQnIl77_rGr50m44hDINl-mf_H_Fq2qlMBDL39cK8OjUgNhI8bDU Oct 22 20:49:00.210072 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 20:49:00.210072 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 20:49:00.210072 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 20:49:00.210072 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 20:49:00.210072 ncdv-master-1 devstack@n-api.service[138744]: X-Openstack-Nova-Api-Version: 2.53 Oct 22 20:49:00.210072 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 20:49:00.210072 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 20:49:00.210072 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: 375a3b50d22346ba94e0ca58ea55b255 Oct 22 20:49:00.210072 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-645643668 Oct 22 20:49:00.210072 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 20:49:00.210072 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 20:49:00.211242 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_375a3b50d22346ba94e0ca58ea55b255"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/375a3b50d22346ba94e0ca58ea55b255"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/375a3b50d22346ba94e0ca58ea55b255"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/375a3b50d22346ba94e0ca58ea55b255"}]}] Oct 22 20:49:00.211242 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-645643668 Oct 22 20:49:00.211242 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: 375a3b50d22346ba94e0ca58ea55b255 Oct 22 20:49:00.211242 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-645643668 Oct 22 20:49:00.211242 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-ServicesAdminNegativeV253TestJSON-645643668-project Oct 22 20:49:00.211242 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 20:49:00.211242 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 20:49:00.211242 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: feb6893afe694fc8b3689da679807f56 Oct 22 20:49:00.211242 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-645643668-project Oct 22 20:49:00.211242 ncdv-master-1 devstack@n-api.service[138744]: method: > Oct 22 20:49:00.211242 ncdv-master-1 devstack@n-api.service[138744]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 22 20:49:00.211242 ncdv-master-1 devstack@n-api.service[138744]: action_args: {} Oct 22 20:49:00.211944 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:49:00.211944 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:49:00.211944 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:49:00.211944 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:49:00.211944 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:49:00.211944 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:49:00.211944 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 22 20:49:00.211944 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 20:49:00.211944 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 22 20:49:00.211944 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 20:49:00.211944 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:49:00.211944 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:49:00.211944 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Oct 22 20:49:00.211944 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Oct 22 20:49:00.211944 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 22 20:49:00.211944 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 22 20:49:00.211944 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 22 20:49:00.211944 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 22 20:49:00.211944 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 22 20:49:00.212915 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 22 20:49:00.212915 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 22 20:49:00.212915 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise self.value Oct 22 20:49:00.212915 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 22 20:49:00.212915 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 22 20:49:00.212915 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 22 20:49:00.212915 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 22 20:49:00.212915 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 22 20:49:00.212915 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 22 20:49:00.212915 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 22 20:49:00.212915 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:49:00.212915 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:49:00.212915 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:49:00.212915 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:49:00.212915 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:49:00.212915 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:49:00.212915 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 22 20:49:00.212915 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 22 20:49:00.212915 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 22 20:49:00.212915 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:49:00.216338 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-6570db91-ec52-47a0-8171-38542754be15 tempest-ServicesAdminNegativeV253TestJSON-645643668 tempest-ServicesAdminNegativeV253TestJSON-645643668-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:49:00.217592 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-6570db91-ec52-47a0-8171-38542754be15 tempest-ServicesAdminNegativeV253TestJSON-645643668 tempest-ServicesAdminNegativeV253TestJSON-645643668-project] 10.222.0.18 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.53 time: 0.624156 Oct 22 20:49:00.218685 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 98/210] 10.222.0.18 () {60 vars in 1178 bytes} [Sat Oct 22 20:48:59 2022] GET /compute/v2.1/os-services => generated 112 bytes in 626 msecs (HTTP/1.1 403) 9 headers in 381 bytes (2 switches on core 0) Oct 22 20:49:00.382102 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-b47c59f6-d396-4abf-a111-15d8cf94ce08 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:49:00.383319 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-b47c59f6-d396-4abf-a111-15d8cf94ce08 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] [instance: f592a6fe-8cc7-4bb1-bb04-f8ddd358eeca] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:49:00.395624 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b47c59f6-d396-4abf-a111-15d8cf94ce08 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:00.396129 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b47c59f6-d396-4abf-a111-15d8cf94ce08 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:00.396577 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b47c59f6-d396-4abf-a111-15d8cf94ce08 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:00.397303 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b47c59f6-d396-4abf-a111-15d8cf94ce08 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:00.397766 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b47c59f6-d396-4abf-a111-15d8cf94ce08 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:00.398201 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b47c59f6-d396-4abf-a111-15d8cf94ce08 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:00.510409 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b47c59f6-d396-4abf-a111-15d8cf94ce08 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:00.513337 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b47c59f6-d396-4abf-a111-15d8cf94ce08 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:00.514331 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b47c59f6-d396-4abf-a111-15d8cf94ce08 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:00.514958 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.objects.instance [None req-b47c59f6-d396-4abf-a111-15d8cf94ce08 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Lazy-loading 'fault' on Instance uuid f592a6fe-8cc7-4bb1-bb04-f8ddd358eeca {{(pid=138744) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 20:49:00.538930 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-893dc412-1868-4368-9e19-9a67383b6c97 tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6de80d628cf14694af6d2cd16f16afad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae95f5dee52f4235b3478cc90f3b0347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:49:00.550416 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-893dc412-1868-4368-9e19-9a67383b6c97 tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] 10.222.0.18 "GET /compute/v2.1/servers/e169b57b-4899-4a9e-80a9-d6290eb63ceb" status: 200 len: 1493 microversion: 2.1 time: 0.502506 Oct 22 20:49:00.551879 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 113/211] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:49:00 2022] GET /compute/v2.1/servers/e169b57b-4899-4a9e-80a9-d6290eb63ceb => generated 1493 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 20:49:00.609322 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-5b828ecc-e144-458d-9a35-315660d932fb tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:49:00.610112 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-5b828ecc-e144-458d-9a35-315660d932fb tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] [instance: 5c3de24c-090d-4769-8975-207eb939b979] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:49:00.619992 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-b47c59f6-d396-4abf-a111-15d8cf94ce08 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e13dcabaaa4b218945aeeabb4c902e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675a324f0134844a1964f64322493ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:49:00.627832 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5b828ecc-e144-458d-9a35-315660d932fb tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:00.628475 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5b828ecc-e144-458d-9a35-315660d932fb tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:00.629148 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5b828ecc-e144-458d-9a35-315660d932fb tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:00.630108 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5b828ecc-e144-458d-9a35-315660d932fb tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:00.630762 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5b828ecc-e144-458d-9a35-315660d932fb tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:00.636714 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5b828ecc-e144-458d-9a35-315660d932fb tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:00.643071 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-b47c59f6-d396-4abf-a111-15d8cf94ce08 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] 10.222.0.18 "GET /compute/v2.1/servers/f592a6fe-8cc7-4bb1-bb04-f8ddd358eeca" status: 200 len: 1309 microversion: 2.1 time: 0.267969 Oct 22 20:49:00.649455 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 99/212] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:49:00 2022] GET /compute/v2.1/servers/f592a6fe-8cc7-4bb1-bb04-f8ddd358eeca => generated 1309 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:49:00.748142 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-5b828ecc-e144-458d-9a35-315660d932fb tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1ce98c66024d49b31e8e4f38b82838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a20f8f858424c89bf67a56feb720ac9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:49:00.765083 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-5b828ecc-e144-458d-9a35-315660d932fb tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed1ce98c66024d49b31e8e4f38b82838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a20f8f858424c89bf67a56feb720ac9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:49:00.767687 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-5b828ecc-e144-458d-9a35-315660d932fb tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed1ce98c66024d49b31e8e4f38b82838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a20f8f858424c89bf67a56feb720ac9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:49:00.777064 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-5b828ecc-e144-458d-9a35-315660d932fb tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] 10.222.0.18 "GET /compute/v2.1/servers/5c3de24c-090d-4769-8975-207eb939b979" status: 200 len: 1446 microversion: 2.75 time: 0.174184 Oct 22 20:49:00.779493 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 114/213] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 20:49:00 2022] GET /compute/v2.1/servers/5c3de24c-090d-4769-8975-207eb939b979 => generated 1446 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 20:49:01.574544 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-25af6e8f-a9c9-4ffe-83dd-8328d8a156dd tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:49:01.575167 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-25af6e8f-a9c9-4ffe-83dd-8328d8a156dd tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] [instance: e169b57b-4899-4a9e-80a9-d6290eb63ceb] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:49:01.583034 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-25af6e8f-a9c9-4ffe-83dd-8328d8a156dd tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:01.583907 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-25af6e8f-a9c9-4ffe-83dd-8328d8a156dd tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:01.584555 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-25af6e8f-a9c9-4ffe-83dd-8328d8a156dd tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:01.585692 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-25af6e8f-a9c9-4ffe-83dd-8328d8a156dd tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:01.586364 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-25af6e8f-a9c9-4ffe-83dd-8328d8a156dd tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:01.587119 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-25af6e8f-a9c9-4ffe-83dd-8328d8a156dd tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:01.626876 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-25af6e8f-a9c9-4ffe-83dd-8328d8a156dd tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:01.627478 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-25af6e8f-a9c9-4ffe-83dd-8328d8a156dd tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:01.628296 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-25af6e8f-a9c9-4ffe-83dd-8328d8a156dd tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:01.629061 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.objects.instance [None req-25af6e8f-a9c9-4ffe-83dd-8328d8a156dd tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Lazy-loading 'fault' on Instance uuid e169b57b-4899-4a9e-80a9-d6290eb63ceb {{(pid=138744) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 20:49:01.651589 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:49:01.673168 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-8d85c65b-6814-4515-9941-7cddedf2461b tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:49:01.674500 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-8d85c65b-6814-4515-9941-7cddedf2461b tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] [instance: f592a6fe-8cc7-4bb1-bb04-f8ddd358eeca] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:49:01.685229 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8d85c65b-6814-4515-9941-7cddedf2461b tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:01.686109 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8d85c65b-6814-4515-9941-7cddedf2461b tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:01.686910 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8d85c65b-6814-4515-9941-7cddedf2461b tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:01.689397 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8d85c65b-6814-4515-9941-7cddedf2461b tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:01.690595 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8d85c65b-6814-4515-9941-7cddedf2461b tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:01.692212 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8d85c65b-6814-4515-9941-7cddedf2461b tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:01.717736 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.wsgi [None req-8d85c65b-6814-4515-9941-7cddedf2461b tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] HTTP exception thrown: Instance f592a6fe-8cc7-4bb1-bb04-f8ddd358eeca could not be found. Oct 22 20:49:01.720118 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-8d85c65b-6814-4515-9941-7cddedf2461b tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Request method failure captured: Oct 22 20:49:01.720118 ncdv-master-1 devstack@n-api.service[138745]: request: GET /compute/v2.1/servers/f592a6fe-8cc7-4bb1-bb04-f8ddd358eeca HTTP/1.1 Oct 22 20:49:01.720118 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 20:49:01.720118 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 20:49:01.720118 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 20:49:01.720118 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 0 Oct 22 20:49:01.720118 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 20:49:01.720118 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 20:49:01.720118 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 20:49:01.720118 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 20:49:01.720118 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVFcYYORhwFB1ry8Evy8Voe9D4YGgNQU5_4r5xU__9WXZwFhi1ysgPAlzqoWtpXWb5AmV6DcS0MfiQoPElUcKT8-mpbeXfIqn597wkNknXaYh6U3AKbg58fbAPYPOorYCbxVAYf4DMC0ny28dLv3iMq4Wg-HScb3aYg1qBD2hJHVN7WI Oct 22 20:49:01.720118 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 20:49:01.720118 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 20:49:01.720118 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 20:49:01.720118 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 20:49:01.720118 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 20:49:01.720118 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 20:49:01.720118 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: 2675a324f0134844a1964f64322493ba Oct 22 20:49:01.720118 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-DeleteServersAdminTestJSON-331859835 Oct 22 20:49:01.720118 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 20:49:01.720118 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 20:49:01.721348 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_2675a324f0134844a1964f64322493ba"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2675a324f0134844a1964f64322493ba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/2675a324f0134844a1964f64322493ba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2675a324f0134844a1964f64322493ba"}]}] Oct 22 20:49:01.721348 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-DeleteServersAdminTestJSON-331859835 Oct 22 20:49:01.721348 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: 2675a324f0134844a1964f64322493ba Oct 22 20:49:01.721348 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-331859835 Oct 22 20:49:01.721348 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-DeleteServersAdminTestJSON-331859835-project Oct 22 20:49:01.721348 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 20:49:01.721348 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 20:49:01.721348 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: 16e13dcabaaa4b218945aeeabb4c902e Oct 22 20:49:01.721348 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-DeleteServersAdminTestJSON-331859835-project Oct 22 20:49:01.721348 ncdv-master-1 devstack@n-api.service[138745]: method: > Oct 22 20:49:01.721348 ncdv-master-1 devstack@n-api.service[138745]: exception: Instance f592a6fe-8cc7-4bb1-bb04-f8ddd358eeca could not be found. Oct 22 20:49:01.721348 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'id': 'f592a6fe-8cc7-4bb1-bb04-f8ddd358eeca'} Oct 22 20:49:01.722018 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:49:01.722018 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:49:01.722018 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 20:49:01.722018 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 20:49:01.722018 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 20:49:01.722018 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 20:49:01.722018 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 20:49:01.722018 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 20:49:01.722018 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 20:49:01.722018 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 20:49:01.722018 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f592a6fe-8cc7-4bb1-bb04-f8ddd358eeca could not be found. Oct 22 20:49:01.722018 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:49:01.722018 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:49:01.722018 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:49:01.722018 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:49:01.722018 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:49:01.722018 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:49:01.722018 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:49:01.722018 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:49:01.722018 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:49:01.723231 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:49:01.723231 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 20:49:01.723231 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 20:49:01.723231 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 20:49:01.723231 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 20:49:01.723231 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 20:49:01.723231 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 20:49:01.723231 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f592a6fe-8cc7-4bb1-bb04-f8ddd358eeca could not be found. Oct 22 20:49:01.723231 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:49:01.723231 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:49:01.723231 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:49:01.723231 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:49:01.723231 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:49:01.723231 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:49:01.723231 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 20:49:01.723231 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 20:49:01.723231 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f592a6fe-8cc7-4bb1-bb04-f8ddd358eeca could not be found. Oct 22 20:49:01.723231 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:49:01.728428 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-8d85c65b-6814-4515-9941-7cddedf2461b tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Returning 404 to user: Instance f592a6fe-8cc7-4bb1-bb04-f8ddd358eeca could not be found. {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:49:01.733476 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-8d85c65b-6814-4515-9941-7cddedf2461b tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] 10.222.0.18 "GET /compute/v2.1/servers/f592a6fe-8cc7-4bb1-bb04-f8ddd358eeca" status: 404 len: 111 microversion: 2.1 time: 0.061037 Oct 22 20:49:01.736932 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 115/214] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:49:01 2022] GET /compute/v2.1/servers/f592a6fe-8cc7-4bb1-bb04-f8ddd358eeca => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 20:49:01.809512 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-734ce664-d649-4da1-893c-0b8a75200b2d tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:49:01.810118 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-734ce664-d649-4da1-893c-0b8a75200b2d tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] [instance: 5c3de24c-090d-4769-8975-207eb939b979] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:49:01.821900 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-734ce664-d649-4da1-893c-0b8a75200b2d tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:01.822637 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-734ce664-d649-4da1-893c-0b8a75200b2d tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:01.823256 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-734ce664-d649-4da1-893c-0b8a75200b2d tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:01.824195 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-734ce664-d649-4da1-893c-0b8a75200b2d tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:01.828043 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-734ce664-d649-4da1-893c-0b8a75200b2d tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:01.829602 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-734ce664-d649-4da1-893c-0b8a75200b2d tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:01.859303 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-25af6e8f-a9c9-4ffe-83dd-8328d8a156dd tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6de80d628cf14694af6d2cd16f16afad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae95f5dee52f4235b3478cc90f3b0347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:49:01.874518 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-25af6e8f-a9c9-4ffe-83dd-8328d8a156dd tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] 10.222.0.18 "GET /compute/v2.1/servers/e169b57b-4899-4a9e-80a9-d6290eb63ceb" status: 200 len: 1328 microversion: 2.1 time: 0.301386 Oct 22 20:49:01.877344 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 100/215] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:49:01 2022] GET /compute/v2.1/servers/e169b57b-4899-4a9e-80a9-d6290eb63ceb => generated 1328 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:49:01.885980 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-05bc0f09-9c0b-4da2-8082-f682270c984c req-1614ca27-fe6d-4750-89be-fb3900175702 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e169b57b-4899-4a9e-80a9-d6290eb63ceb", "name": "network-vif-deleted", "tag": "02de842c-17fc-4e5f-baff-e53cc52aeb55"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:49:01.908332 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-05bc0f09-9c0b-4da2-8082-f682270c984c req-1614ca27-fe6d-4750-89be-fb3900175702 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:01.912162 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-05bc0f09-9c0b-4da2-8082-f682270c984c req-1614ca27-fe6d-4750-89be-fb3900175702 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:01.912877 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-05bc0f09-9c0b-4da2-8082-f682270c984c req-1614ca27-fe6d-4750-89be-fb3900175702 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:01.941190 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-05bc0f09-9c0b-4da2-8082-f682270c984c req-1614ca27-fe6d-4750-89be-fb3900175702 service nova] Creating event network-vif-deleted:02de842c-17fc-4e5f-baff-e53cc52aeb55 for instance e169b57b-4899-4a9e-80a9-d6290eb63ceb on nch2-master-1 Oct 22 20:49:01.950258 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-05bc0f09-9c0b-4da2-8082-f682270c984c req-1614ca27-fe6d-4750-89be-fb3900175702 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071417 Oct 22 20:49:01.957729 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 101/216] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:49:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:49:01.967240 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-734ce664-d649-4da1-893c-0b8a75200b2d tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1ce98c66024d49b31e8e4f38b82838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a20f8f858424c89bf67a56feb720ac9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:49:01.979220 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-734ce664-d649-4da1-893c-0b8a75200b2d tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed1ce98c66024d49b31e8e4f38b82838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a20f8f858424c89bf67a56feb720ac9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:49:01.982733 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-734ce664-d649-4da1-893c-0b8a75200b2d tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed1ce98c66024d49b31e8e4f38b82838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a20f8f858424c89bf67a56feb720ac9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:49:01.992550 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-734ce664-d649-4da1-893c-0b8a75200b2d tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] 10.222.0.18 "GET /compute/v2.1/servers/5c3de24c-090d-4769-8975-207eb939b979" status: 200 len: 1446 microversion: 2.75 time: 0.188163 Oct 22 20:49:02.003819 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 116/217] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 20:49:01 2022] GET /compute/v2.1/servers/5c3de24c-090d-4769-8975-207eb939b979 => generated 1446 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 22 20:49:02.014928 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-568f5d83-5c66-4740-847d-f4fd6fc18076 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-1075935312", "imageRef": "085e4478-6edc-4a69-8e08-f9831713eb65", "flavorRef": "452"}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:49:02.081112 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.network.neutron [None req-568f5d83-5c66-4740-847d-f4fd6fc18076 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] validate_networks() for None {{(pid=138744) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 20:49:02.574208 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-568f5d83-5c66-4740-847d-f4fd6fc18076 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Flavor limits 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 20:49:02.575240 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-568f5d83-5c66-4740-847d-f4fd6fc18076 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Image limits 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 20:49:02.575994 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-568f5d83-5c66-4740-847d-f4fd6fc18076 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Flavor pref 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 20:49:02.576505 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-568f5d83-5c66-4740-847d-f4fd6fc18076 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Image pref 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 20:49:02.577722 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-568f5d83-5c66-4740-847d-f4fd6fc18076 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 20:49:02.589010 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-568f5d83-5c66-4740-847d-f4fd6fc18076 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:02.589814 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-568f5d83-5c66-4740-847d-f4fd6fc18076 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:02.590451 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-568f5d83-5c66-4740-847d-f4fd6fc18076 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:02.591525 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-568f5d83-5c66-4740-847d-f4fd6fc18076 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:02.592413 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-568f5d83-5c66-4740-847d-f4fd6fc18076 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:02.593046 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-568f5d83-5c66-4740-847d-f4fd6fc18076 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:02.619039 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-568f5d83-5c66-4740-847d-f4fd6fc18076 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Getting quotas for project 2675a324f0134844a1964f64322493ba. Resources: {'cores', 'instances', 'ram'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 20:49:02.621874 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:49:02.633152 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-568f5d83-5c66-4740-847d-f4fd6fc18076 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Getting quotas for user 16e13dcabaaa4b218945aeeabb4c902e and project 2675a324f0134844a1964f64322493ba. Resources: {'cores', 'instances', 'ram'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 20:49:02.654824 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-568f5d83-5c66-4740-847d-f4fd6fc18076 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Going to run 1 instances... {{(pid=138744) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 20:49:02.664349 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-568f5d83-5c66-4740-847d-f4fd6fc18076 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] [instance: 96add0b3-b82f-4a0a-bec3-9a6341ae5dec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='085e4478-6edc-4a69-8e08-f9831713eb65',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138744) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 20:49:02.729793 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-568f5d83-5c66-4740-847d-f4fd6fc18076 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.719152 Oct 22 20:49:02.737904 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 102/218] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Oct 22 20:49:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 728 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 20:49:02.742455 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-a8c4c03c-df82-491a-a872-9380ce37a33c tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:49:02.743074 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-a8c4c03c-df82-491a-a872-9380ce37a33c tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] [instance: 96add0b3-b82f-4a0a-bec3-9a6341ae5dec] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:49:02.872179 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-a8c4c03c-df82-491a-a872-9380ce37a33c tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e13dcabaaa4b218945aeeabb4c902e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675a324f0134844a1964f64322493ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:49:02.885186 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-a8c4c03c-df82-491a-a872-9380ce37a33c tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] 10.222.0.18 "GET /compute/v2.1/servers/96add0b3-b82f-4a0a-bec3-9a6341ae5dec" status: 200 len: 1220 microversion: 2.1 time: 0.146787 Oct 22 20:49:02.886015 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 117/219] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:49:02 2022] GET /compute/v2.1/servers/96add0b3-b82f-4a0a-bec3-9a6341ae5dec => generated 1220 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 20:49:02.902652 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-21231ebe-4b76-4057-8bfe-3bd63bd2add4 tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:49:02.903276 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-21231ebe-4b76-4057-8bfe-3bd63bd2add4 tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] [instance: e169b57b-4899-4a9e-80a9-d6290eb63ceb] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:49:02.910776 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-21231ebe-4b76-4057-8bfe-3bd63bd2add4 tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:02.911452 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-21231ebe-4b76-4057-8bfe-3bd63bd2add4 tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:02.912090 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-21231ebe-4b76-4057-8bfe-3bd63bd2add4 tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:02.916811 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-21231ebe-4b76-4057-8bfe-3bd63bd2add4 tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:02.917526 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-21231ebe-4b76-4057-8bfe-3bd63bd2add4 tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:02.918142 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-21231ebe-4b76-4057-8bfe-3bd63bd2add4 tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:02.950350 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-21231ebe-4b76-4057-8bfe-3bd63bd2add4 tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] HTTP exception thrown: Instance e169b57b-4899-4a9e-80a9-d6290eb63ceb could not be found. Oct 22 20:49:02.960304 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-21231ebe-4b76-4057-8bfe-3bd63bd2add4 tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Request method failure captured: Oct 22 20:49:02.960304 ncdv-master-1 devstack@n-api.service[138744]: request: GET /compute/v2.1/servers/e169b57b-4899-4a9e-80a9-d6290eb63ceb HTTP/1.1 Oct 22 20:49:02.960304 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 20:49:02.960304 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 20:49:02.960304 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 20:49:02.960304 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 0 Oct 22 20:49:02.960304 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 20:49:02.960304 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 20:49:02.960304 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 20:49:02.960304 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 20:49:02.960304 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVFcR3Gi1yX1pP_GmeDbM5thuRvx-N5c64yQJ8A7DkfEbppSLPquXJ-e4bh1vd_15bl0K9SilbWS4_BrSso52A59gsGmA-DYleAGCI409pkI_KF_KpTPtTodEqbftxW9AErrml4mCwQFhzzMrkj2Se3xSckyD9Fmvlv3FtmH_2IxnJA0 Oct 22 20:49:02.960304 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 20:49:02.960304 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 20:49:02.960304 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 20:49:02.960304 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 20:49:02.960304 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 20:49:02.960304 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 20:49:02.960304 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: ae95f5dee52f4235b3478cc90f3b0347 Oct 22 20:49:02.960304 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-AggregatesAdminTestJSON-166487075 Oct 22 20:49:02.960304 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 20:49:02.960304 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 20:49:02.961529 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ae95f5dee52f4235b3478cc90f3b0347"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ae95f5dee52f4235b3478cc90f3b0347"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ae95f5dee52f4235b3478cc90f3b0347"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ae95f5dee52f4235b3478cc90f3b0347"}]}] Oct 22 20:49:02.961529 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-AggregatesAdminTestJSON-166487075 Oct 22 20:49:02.961529 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: ae95f5dee52f4235b3478cc90f3b0347 Oct 22 20:49:02.961529 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-166487075 Oct 22 20:49:02.961529 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-AggregatesAdminTestJSON-166487075-project Oct 22 20:49:02.961529 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 20:49:02.961529 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 20:49:02.961529 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: 6de80d628cf14694af6d2cd16f16afad Oct 22 20:49:02.961529 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-AggregatesAdminTestJSON-166487075-project Oct 22 20:49:02.961529 ncdv-master-1 devstack@n-api.service[138744]: method: > Oct 22 20:49:02.961529 ncdv-master-1 devstack@n-api.service[138744]: exception: Instance e169b57b-4899-4a9e-80a9-d6290eb63ceb could not be found. Oct 22 20:49:02.961529 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': 'e169b57b-4899-4a9e-80a9-d6290eb63ceb'} Oct 22 20:49:02.962178 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:49:02.962178 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:49:02.962178 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 20:49:02.962178 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 20:49:02.962178 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 20:49:02.962178 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 20:49:02.962178 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 20:49:02.962178 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 20:49:02.962178 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 20:49:02.962178 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 20:49:02.962178 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e169b57b-4899-4a9e-80a9-d6290eb63ceb could not be found. Oct 22 20:49:02.962178 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:49:02.962178 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:49:02.962178 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:49:02.962178 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:49:02.962178 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:49:02.962178 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:49:02.962178 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:49:02.962178 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:49:02.962178 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:49:02.963221 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:49:02.963221 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 20:49:02.963221 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 20:49:02.963221 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 20:49:02.963221 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 20:49:02.963221 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 20:49:02.963221 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 20:49:02.963221 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e169b57b-4899-4a9e-80a9-d6290eb63ceb could not be found. Oct 22 20:49:02.963221 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:49:02.963221 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:49:02.963221 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:49:02.963221 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:49:02.963221 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:49:02.963221 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:49:02.963221 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 20:49:02.963221 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 20:49:02.963221 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e169b57b-4899-4a9e-80a9-d6290eb63ceb could not be found. Oct 22 20:49:02.963221 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:49:02.968279 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-21231ebe-4b76-4057-8bfe-3bd63bd2add4 tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Returning 404 to user: Instance e169b57b-4899-4a9e-80a9-d6290eb63ceb could not be found. {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:49:02.969420 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-21231ebe-4b76-4057-8bfe-3bd63bd2add4 tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] 10.222.0.18 "GET /compute/v2.1/servers/e169b57b-4899-4a9e-80a9-d6290eb63ceb" status: 404 len: 111 microversion: 2.1 time: 0.071162 Oct 22 20:49:02.972561 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 103/220] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:49:02 2022] GET /compute/v2.1/servers/e169b57b-4899-4a9e-80a9-d6290eb63ceb => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 20:49:02.979929 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-6b6d606f-5cb3-4c0d-9218-20ae58f6a174 tempest-AggregatesAdminTestJSON-1406494805 tempest-AggregatesAdminTestJSON-1406494805-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch2-master-1"}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:49:02.999927 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6b6d606f-5cb3-4c0d-9218-20ae58f6a174 tempest-AggregatesAdminTestJSON-1406494805 tempest-AggregatesAdminTestJSON-1406494805-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:03.000409 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6b6d606f-5cb3-4c0d-9218-20ae58f6a174 tempest-AggregatesAdminTestJSON-1406494805 tempest-AggregatesAdminTestJSON-1406494805-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:03.004748 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6b6d606f-5cb3-4c0d-9218-20ae58f6a174 tempest-AggregatesAdminTestJSON-1406494805 tempest-AggregatesAdminTestJSON-1406494805-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:03.034628 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-8a1dcf62-8233-4a37-8b7c-81d8d7f9ed04 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:49:03.035695 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-8a1dcf62-8233-4a37-8b7c-81d8d7f9ed04 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] [instance: 5c3de24c-090d-4769-8975-207eb939b979] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:49:03.045210 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8a1dcf62-8233-4a37-8b7c-81d8d7f9ed04 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:03.048794 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8a1dcf62-8233-4a37-8b7c-81d8d7f9ed04 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:03.049465 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8a1dcf62-8233-4a37-8b7c-81d8d7f9ed04 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:03.051409 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8a1dcf62-8233-4a37-8b7c-81d8d7f9ed04 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:03.053622 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8a1dcf62-8233-4a37-8b7c-81d8d7f9ed04 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:03.056226 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8a1dcf62-8233-4a37-8b7c-81d8d7f9ed04 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:03.277446 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-6b6d606f-5cb3-4c0d-9218-20ae58f6a174 tempest-AggregatesAdminTestJSON-1406494805 tempest-AggregatesAdminTestJSON-1406494805-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 297 microversion: 2.1 time: 0.301884 Oct 22 20:49:03.278050 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 118/221] 10.222.0.18 () {60 vars in 1191 bytes} [Sat Oct 22 20:49:02 2022] POST /compute/v2.1/os-aggregates/1/action => generated 297 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:49:03.292795 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-e8c6e4b9-ce6d-4793-af90-18107afbab28 tempest-AggregatesAdminTestJSON-1406494805 tempest-AggregatesAdminTestJSON-1406494805-project-admin] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:49:03.299040 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-8a1dcf62-8233-4a37-8b7c-81d8d7f9ed04 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1ce98c66024d49b31e8e4f38b82838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a20f8f858424c89bf67a56feb720ac9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:49:03.310060 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-8a1dcf62-8233-4a37-8b7c-81d8d7f9ed04 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed1ce98c66024d49b31e8e4f38b82838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a20f8f858424c89bf67a56feb720ac9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:49:03.313474 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-8a1dcf62-8233-4a37-8b7c-81d8d7f9ed04 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed1ce98c66024d49b31e8e4f38b82838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a20f8f858424c89bf67a56feb720ac9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:49:03.330970 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-8a1dcf62-8233-4a37-8b7c-81d8d7f9ed04 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] 10.222.0.18 "GET /compute/v2.1/servers/5c3de24c-090d-4769-8975-207eb939b979" status: 200 len: 1446 microversion: 2.75 time: 0.298706 Oct 22 20:49:03.344269 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 104/222] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 20:49:03 2022] GET /compute/v2.1/servers/5c3de24c-090d-4769-8975-207eb939b979 => generated 1446 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 20:49:03.377001 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-e8c6e4b9-ce6d-4793-af90-18107afbab28 tempest-AggregatesAdminTestJSON-1406494805 tempest-AggregatesAdminTestJSON-1406494805-project-admin] 10.222.0.18 "DELETE /compute/v2.1/os-aggregates/1" status: 200 len: 0 microversion: 2.1 time: 0.087922 Oct 22 20:49:03.385703 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 119/223] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Oct 22 20:49:03 2022] DELETE /compute/v2.1/os-aggregates/1 => generated 0 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 22 20:49:03.399140 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-9c629f2d-4476-48e9-8e24-5f8dd7bee5ba tempest-AggregatesAdminNegativeTestJSON-1306123093 tempest-AggregatesAdminNegativeTestJSON-1306123093-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-119968317"}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:49:03.406010 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.objects.aggregate [None req-9c629f2d-4476-48e9-8e24-5f8dd7bee5ba tempest-AggregatesAdminNegativeTestJSON-1306123093 tempest-AggregatesAdminNegativeTestJSON-1306123093-project-admin] Generated uuid 0a6c64b3-b5b7-47da-9215-83e24ae4ec79 for aggregate {{(pid=138744) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 22 20:49:03.452829 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-9c629f2d-4476-48e9-8e24-5f8dd7bee5ba tempest-AggregatesAdminNegativeTestJSON-1306123093 tempest-AggregatesAdminNegativeTestJSON-1306123093-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.059820 Oct 22 20:49:03.455822 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 105/224] 10.222.0.18 () {60 vars in 1164 bytes} [Sat Oct 22 20:49:03 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:49:03.471852 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-314504f9-1ff5-4c8d-bee4-07dc30fc6b83 tempest-AggregatesAdminNegativeTestJSON-1306123093 tempest-AggregatesAdminNegativeTestJSON-1306123093-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch2-master-1"}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:49:03.503255 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-314504f9-1ff5-4c8d-bee4-07dc30fc6b83 tempest-AggregatesAdminNegativeTestJSON-1306123093 tempest-AggregatesAdminNegativeTestJSON-1306123093-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:03.505193 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-314504f9-1ff5-4c8d-bee4-07dc30fc6b83 tempest-AggregatesAdminNegativeTestJSON-1306123093 tempest-AggregatesAdminNegativeTestJSON-1306123093-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:03.505803 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-314504f9-1ff5-4c8d-bee4-07dc30fc6b83 tempest-AggregatesAdminNegativeTestJSON-1306123093 tempest-AggregatesAdminNegativeTestJSON-1306123093-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:03.748864 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-314504f9-1ff5-4c8d-bee4-07dc30fc6b83 tempest-AggregatesAdminNegativeTestJSON-1306123093 tempest-AggregatesAdminNegativeTestJSON-1306123093-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 241 microversion: 2.1 time: 0.283877 Oct 22 20:49:03.750231 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 120/225] 10.222.0.18 () {60 vars in 1191 bytes} [Sat Oct 22 20:49:03 2022] POST /compute/v2.1/os-aggregates/2/action => generated 241 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:49:03.763246 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-d92b7d21-e958-4da3-9f6b-667ff1096da0 tempest-AggregatesAdminNegativeTestJSON-1306123093 tempest-AggregatesAdminNegativeTestJSON-1306123093-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch2-master-1"}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:49:03.815737 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d92b7d21-e958-4da3-9f6b-667ff1096da0 tempest-AggregatesAdminNegativeTestJSON-1306123093 tempest-AggregatesAdminNegativeTestJSON-1306123093-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:03.816262 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d92b7d21-e958-4da3-9f6b-667ff1096da0 tempest-AggregatesAdminNegativeTestJSON-1306123093 tempest-AggregatesAdminNegativeTestJSON-1306123093-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:03.819741 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d92b7d21-e958-4da3-9f6b-667ff1096da0 tempest-AggregatesAdminNegativeTestJSON-1306123093 tempest-AggregatesAdminNegativeTestJSON-1306123093-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:03.892068 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-d92b7d21-e958-4da3-9f6b-667ff1096da0 tempest-AggregatesAdminNegativeTestJSON-1306123093 tempest-AggregatesAdminNegativeTestJSON-1306123093-project-admin] HTTP exception thrown: Aggregate 2 already has host nch2-master-1. Oct 22 20:49:03.920055 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-40bca096-2314-4848-a5bf-4748f1a43cb2 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:49:03.920854 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-40bca096-2314-4848-a5bf-4748f1a43cb2 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] [instance: 96add0b3-b82f-4a0a-bec3-9a6341ae5dec] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:49:03.934130 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-40bca096-2314-4848-a5bf-4748f1a43cb2 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:03.934906 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-40bca096-2314-4848-a5bf-4748f1a43cb2 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:03.938442 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-40bca096-2314-4848-a5bf-4748f1a43cb2 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:03.939551 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-40bca096-2314-4848-a5bf-4748f1a43cb2 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:03.940454 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-40bca096-2314-4848-a5bf-4748f1a43cb2 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:03.941404 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-40bca096-2314-4848-a5bf-4748f1a43cb2 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:03.960847 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-d92b7d21-e958-4da3-9f6b-667ff1096da0 tempest-AggregatesAdminNegativeTestJSON-1306123093 tempest-AggregatesAdminNegativeTestJSON-1306123093-project-admin] Request method failure captured: Oct 22 20:49:03.960847 ncdv-master-1 devstack@n-api.service[138744]: request: POST /compute/v2.1/os-aggregates/2/action HTTP/1.1 Oct 22 20:49:03.960847 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 20:49:03.960847 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 20:49:03.960847 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 20:49:03.960847 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 39 Oct 22 20:49:03.960847 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 20:49:03.960847 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 20:49:03.960847 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 20:49:03.960847 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 20:49:03.960847 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVFcTjzeCF7gwSKDmU2CPWCR_esBhUtkbcoM98K65tKtwTX7k8J3P2XxFlWelX1TDo_-yYShDH5UFO7PvTkSeEz8zhJDyz1PblWBsa9c1g1Qy6YZmn8lB_e_ZFbxFrZc-0aXSGx-CMuDgW5UvCQv7euL6tHWkksIhSTjd3SVjJ9Vfw2k Oct 22 20:49:03.960847 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 20:49:03.960847 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 20:49:03.960847 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 20:49:03.960847 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 20:49:03.960847 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 20:49:03.960847 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 20:49:03.960847 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: c0539194941d4647ae4209c24cdce003 Oct 22 20:49:03.960847 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1306123093 Oct 22 20:49:03.960847 ncdv-master-1 devstack@n-api.service[138744]: X-Role: admin,member,reader Oct 22 20:49:03.960847 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: admin,member,reader Oct 22 20:49:03.962828 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_c0539194941d4647ae4209c24cdce003"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c0539194941d4647ae4209c24cdce003"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/c0539194941d4647ae4209c24cdce003"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c0539194941d4647ae4209c24cdce003"}]}] Oct 22 20:49:03.962828 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1306123093 Oct 22 20:49:03.962828 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: c0539194941d4647ae4209c24cdce003 Oct 22 20:49:03.962828 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1306123093 Oct 22 20:49:03.962828 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-AggregatesAdminNegativeTestJSON-1306123093-project-admin Oct 22 20:49:03.962828 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 20:49:03.962828 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 20:49:03.962828 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: 352f8254dcc044f18778bbbe73fc8d01 Oct 22 20:49:03.962828 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1306123093-project-admin Oct 22 20:49:03.962828 ncdv-master-1 devstack@n-api.service[138744]: Oct 22 20:49:03.962828 ncdv-master-1 devstack@n-api.service[138744]: {"add_host": {"host": "nch2-master-1"}} Oct 22 20:49:03.962828 ncdv-master-1 devstack@n-api.service[138744]: method: > Oct 22 20:49:03.962828 ncdv-master-1 devstack@n-api.service[138744]: exception: Aggregate 2 already has host nch2-master-1. Oct 22 20:49:03.963675 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': '2', 'body': {'add_host': {'host': 'nch2-master-1'}}} Oct 22 20:49:03.963675 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:49:03.963675 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:49:03.963675 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 22 20:49:03.963675 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 22 20:49:03.963675 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 22 20:49:03.963675 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 22 20:49:03.963675 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 22 20:49:03.963675 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 22 20:49:03.963675 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 22 20:49:03.963675 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 22 20:49:03.963675 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 22 20:49:03.963675 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 22 20:49:03.963675 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 22 20:49:03.963675 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi result.read() Oct 22 20:49:03.963675 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 22 20:49:03.963675 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 22 20:49:03.963675 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 22 20:49:03.963675 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 22 20:49:03.964989 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 22 20:49:03.964989 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 22 20:49:03.964989 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 22 20:49:03.964989 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 22 20:49:03.964989 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'nch2-master-1-2' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Oct 22 20:49:03.964989 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:49:03.964989 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 22 20:49:03.964989 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:49:03.964989 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:49:03.964989 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 73, in _host_add_to_db Oct 22 20:49:03.964989 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi host_ref.save(context.session) Oct 22 20:49:03.964989 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Oct 22 20:49:03.964989 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi session.flush() Oct 22 20:49:03.964989 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 22 20:49:03.964989 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi self._flush(objects) Oct 22 20:49:03.964989 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 22 20:49:03.964989 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Oct 22 20:49:03.964989 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 22 20:49:03.964989 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi compat.raise_( Oct 22 20:49:03.966343 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 22 20:49:03.966343 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception Oct 22 20:49:03.966343 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 22 20:49:03.966343 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi flush_context.execute() Oct 22 20:49:03.966343 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 22 20:49:03.966343 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi rec.execute(self) Oct 22 20:49:03.966343 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 22 20:49:03.966343 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Oct 22 20:49:03.966343 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 22 20:49:03.966343 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Oct 22 20:49:03.966343 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 22 20:49:03.966343 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Oct 22 20:49:03.966343 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 22 20:49:03.966343 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Oct 22 20:49:03.966343 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 22 20:49:03.966343 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Oct 22 20:49:03.966343 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 22 20:49:03.966343 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Oct 22 20:49:03.967592 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 22 20:49:03.967592 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Oct 22 20:49:03.967592 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 22 20:49:03.967592 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 22 20:49:03.967592 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 22 20:49:03.967592 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception Oct 22 20:49:03.967592 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 22 20:49:03.967592 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 22 20:49:03.967592 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 22 20:49:03.967592 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 22 20:49:03.967592 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 22 20:49:03.967592 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 22 20:49:03.967592 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 22 20:49:03.967592 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 22 20:49:03.967592 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 22 20:49:03.967592 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 22 20:49:03.967592 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 22 20:49:03.967592 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi result.read() Oct 22 20:49:03.968853 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 22 20:49:03.968853 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 22 20:49:03.968853 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 22 20:49:03.968853 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 22 20:49:03.968853 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 22 20:49:03.968853 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 22 20:49:03.968853 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 22 20:49:03.968853 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 22 20:49:03.968853 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'nch2-master-1-2' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Oct 22 20:49:03.968853 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO aggregate_hosts (created_at, updated_at, host, aggregate_id) VALUES (%(created_at)s, %(updated_at)s, %(host)s, %(aggregate_id)s)] Oct 22 20:49:03.968853 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 10, 22, 20, 49, 3, 875292), 'updated_at': None, 'host': 'nch2-master-1', 'aggregate_id': 2}] Oct 22 20:49:03.968853 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 22 20:49:03.968853 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:49:03.968853 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:49:03.968853 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:49:03.968853 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:49:03.968853 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Oct 22 20:49:03.971679 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Oct 22 20:49:03.971679 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 22 20:49:03.971679 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 22 20:49:03.971679 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 22 20:49:03.971679 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 22 20:49:03.971679 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 22 20:49:03.971679 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise self.value Oct 22 20:49:03.971679 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 22 20:49:03.971679 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 22 20:49:03.971679 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6641, in add_host_to_aggregate Oct 22 20:49:03.971679 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi aggregate.add_host(host_name) Oct 22 20:49:03.971679 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 22 20:49:03.971679 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 22 20:49:03.971679 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 395, in add_host Oct 22 20:49:03.971679 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi _host_add_to_db(self._context, self.id, host) Oct 22 20:49:03.971679 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 76, in _host_add_to_db Oct 22 20:49:03.971679 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.AggregateHostExists(host=host, Oct 22 20:49:03.971679 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.AggregateHostExists: Aggregate 2 already has host nch2-master-1. Oct 22 20:49:03.971679 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:49:03.971679 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:49:03.972918 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:49:03.972918 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:49:03.972918 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:49:03.972918 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:49:03.972918 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:49:03.972918 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:49:03.972918 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:49:03.972918 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:49:03.972918 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 20:49:03.972918 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 20:49:03.972918 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 187, in _add_host Oct 22 20:49:03.972918 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Oct 22 20:49:03.972918 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate 2 already has host nch2-master-1. Oct 22 20:49:03.972918 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:49:03.972918 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:49:03.972918 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:49:03.972918 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:49:03.972918 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:49:03.972918 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:49:03.972918 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 20:49:03.972918 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 20:49:03.974334 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 2 already has host nch2-master-1. Oct 22 20:49:03.974334 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:49:03.975635 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-d92b7d21-e958-4da3-9f6b-667ff1096da0 tempest-AggregatesAdminNegativeTestJSON-1306123093 tempest-AggregatesAdminNegativeTestJSON-1306123093-project-admin] Returning 409 to user: Aggregate 2 already has host nch2-master-1. {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:49:03.978523 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-d92b7d21-e958-4da3-9f6b-667ff1096da0 tempest-AggregatesAdminNegativeTestJSON-1306123093 tempest-AggregatesAdminNegativeTestJSON-1306123093-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates/2/action" status: 409 len: 95 microversion: 2.1 time: 0.219157 Oct 22 20:49:03.979310 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 106/226] 10.222.0.18 () {60 vars in 1191 bytes} [Sat Oct 22 20:49:03 2022] POST /compute/v2.1/os-aggregates/2/action => generated 95 bytes in 221 msecs (HTTP/1.1 409) 9 headers in 377 bytes (1 switches on core 0) Oct 22 20:49:04.008307 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-96f90991-84e1-4c7a-becc-980140da53e4 tempest-AggregatesAdminNegativeTestJSON-1306123093 tempest-AggregatesAdminNegativeTestJSON-1306123093-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch2-master-1"}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:49:04.057188 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-40bca096-2314-4848-a5bf-4748f1a43cb2 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e13dcabaaa4b218945aeeabb4c902e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675a324f0134844a1964f64322493ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:49:04.059319 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-96f90991-84e1-4c7a-becc-980140da53e4 tempest-AggregatesAdminNegativeTestJSON-1306123093 tempest-AggregatesAdminNegativeTestJSON-1306123093-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:04.060099 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-96f90991-84e1-4c7a-becc-980140da53e4 tempest-AggregatesAdminNegativeTestJSON-1306123093 tempest-AggregatesAdminNegativeTestJSON-1306123093-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:04.063407 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-96f90991-84e1-4c7a-becc-980140da53e4 tempest-AggregatesAdminNegativeTestJSON-1306123093 tempest-AggregatesAdminNegativeTestJSON-1306123093-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:04.073665 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-40bca096-2314-4848-a5bf-4748f1a43cb2 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] 10.222.0.18 "GET /compute/v2.1/servers/96add0b3-b82f-4a0a-bec3-9a6341ae5dec" status: 200 len: 1216 microversion: 2.1 time: 0.167568 Oct 22 20:49:04.076061 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 121/227] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:49:03 2022] GET /compute/v2.1/servers/96add0b3-b82f-4a0a-bec3-9a6341ae5dec => generated 1216 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:49:04.373126 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-bde88a44-086c-49d6-8bad-cb103a35d2d6 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:49:04.374194 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-bde88a44-086c-49d6-8bad-cb103a35d2d6 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] [instance: 5c3de24c-090d-4769-8975-207eb939b979] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:49:04.404262 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bde88a44-086c-49d6-8bad-cb103a35d2d6 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:04.405779 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bde88a44-086c-49d6-8bad-cb103a35d2d6 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:04.408201 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bde88a44-086c-49d6-8bad-cb103a35d2d6 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:04.410606 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bde88a44-086c-49d6-8bad-cb103a35d2d6 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:04.411423 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bde88a44-086c-49d6-8bad-cb103a35d2d6 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:04.413003 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bde88a44-086c-49d6-8bad-cb103a35d2d6 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:04.630619 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-bde88a44-086c-49d6-8bad-cb103a35d2d6 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1ce98c66024d49b31e8e4f38b82838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a20f8f858424c89bf67a56feb720ac9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:49:04.668080 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-bde88a44-086c-49d6-8bad-cb103a35d2d6 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed1ce98c66024d49b31e8e4f38b82838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a20f8f858424c89bf67a56feb720ac9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:49:04.672017 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-bde88a44-086c-49d6-8bad-cb103a35d2d6 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed1ce98c66024d49b31e8e4f38b82838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a20f8f858424c89bf67a56feb720ac9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:49:04.685456 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-bde88a44-086c-49d6-8bad-cb103a35d2d6 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] 10.222.0.18 "GET /compute/v2.1/servers/5c3de24c-090d-4769-8975-207eb939b979" status: 200 len: 1446 microversion: 2.75 time: 0.321894 Oct 22 20:49:04.691066 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 122/228] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 20:49:04 2022] GET /compute/v2.1/servers/5c3de24c-090d-4769-8975-207eb939b979 => generated 1446 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 20:49:05.003957 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-96f90991-84e1-4c7a-becc-980140da53e4 tempest-AggregatesAdminNegativeTestJSON-1306123093 tempest-AggregatesAdminNegativeTestJSON-1306123093-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 226 microversion: 2.1 time: 1.016438 Oct 22 20:49:05.013943 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 107/229] 10.222.0.18 () {60 vars in 1191 bytes} [Sat Oct 22 20:49:03 2022] POST /compute/v2.1/os-aggregates/2/action => generated 226 bytes in 1030 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:49:05.017883 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-a85e2ad5-3675-43ad-83b3-d33c11e9a0ce tempest-AggregatesAdminNegativeTestJSON-1306123093 tempest-AggregatesAdminNegativeTestJSON-1306123093-project-admin] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:49:05.087256 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-a85e2ad5-3675-43ad-83b3-d33c11e9a0ce tempest-AggregatesAdminNegativeTestJSON-1306123093 tempest-AggregatesAdminNegativeTestJSON-1306123093-project-admin] 10.222.0.18 "DELETE /compute/v2.1/os-aggregates/2" status: 200 len: 0 microversion: 2.1 time: 0.074433 Oct 22 20:49:05.091995 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 123/230] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Oct 22 20:49:05 2022] DELETE /compute/v2.1/os-aggregates/2 => generated 0 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Oct 22 20:49:05.110345 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-28627b52-0474-4a06-8362-ebb880865a16 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:49:05.111061 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-28627b52-0474-4a06-8362-ebb880865a16 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] [instance: 96add0b3-b82f-4a0a-bec3-9a6341ae5dec] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:49:05.118142 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-3d1c87cb-ff75-4663-a03c-ad827a82d2b5 tempest-AggregatesAdminNegativeTestJSON-1306123093 tempest-AggregatesAdminNegativeTestJSON-1306123093-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-498234259"}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:49:05.123084 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.objects.aggregate [None req-3d1c87cb-ff75-4663-a03c-ad827a82d2b5 tempest-AggregatesAdminNegativeTestJSON-1306123093 tempest-AggregatesAdminNegativeTestJSON-1306123093-project-admin] Generated uuid 50ae2924-59cd-4bae-9b5f-a2603aa8b793 for aggregate {{(pid=138745) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 22 20:49:05.129486 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-28627b52-0474-4a06-8362-ebb880865a16 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:05.130459 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-28627b52-0474-4a06-8362-ebb880865a16 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:05.131864 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-28627b52-0474-4a06-8362-ebb880865a16 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:05.134593 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-28627b52-0474-4a06-8362-ebb880865a16 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:05.140163 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-28627b52-0474-4a06-8362-ebb880865a16 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:05.141732 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-28627b52-0474-4a06-8362-ebb880865a16 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:05.192103 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-3d1c87cb-ff75-4663-a03c-ad827a82d2b5 tempest-AggregatesAdminNegativeTestJSON-1306123093 tempest-AggregatesAdminNegativeTestJSON-1306123093-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.083020 Oct 22 20:49:05.192984 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 124/231] 10.222.0.18 () {60 vars in 1164 bytes} [Sat Oct 22 20:49:05 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:49:05.202731 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-a950fdf2-69ef-489c-802f-8f9b6885a6bf tempest-AggregatesAdminTestJSON-1406494805 tempest-AggregatesAdminTestJSON-1406494805-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-854612404"}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:49:05.214211 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.objects.aggregate [None req-a950fdf2-69ef-489c-802f-8f9b6885a6bf tempest-AggregatesAdminTestJSON-1406494805 tempest-AggregatesAdminTestJSON-1406494805-project-admin] Generated uuid f1b95bd5-9845-46b4-8be6-8be03f91b38f for aggregate {{(pid=138745) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 22 20:49:05.275245 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-a950fdf2-69ef-489c-802f-8f9b6885a6bf tempest-AggregatesAdminTestJSON-1406494805 tempest-AggregatesAdminTestJSON-1406494805-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.080430 Oct 22 20:49:05.277127 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 125/232] 10.222.0.18 () {60 vars in 1164 bytes} [Sat Oct 22 20:49:05 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:49:05.332566 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-28627b52-0474-4a06-8362-ebb880865a16 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e13dcabaaa4b218945aeeabb4c902e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675a324f0134844a1964f64322493ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:49:05.353434 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-28627b52-0474-4a06-8362-ebb880865a16 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] 10.222.0.18 "GET /compute/v2.1/servers/96add0b3-b82f-4a0a-bec3-9a6341ae5dec" status: 200 len: 1280 microversion: 2.1 time: 0.254745 Oct 22 20:49:05.373172 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 108/233] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:49:05 2022] GET /compute/v2.1/servers/96add0b3-b82f-4a0a-bec3-9a6341ae5dec => generated 1280 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:49:05.383801 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-02747112-fa4c-4db4-aead-aaa1f7438a6f tempest-AggregatesAdminTestJSON-1406494805 tempest-AggregatesAdminTestJSON-1406494805-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch2-master-1"}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:49:05.399392 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-02747112-fa4c-4db4-aead-aaa1f7438a6f tempest-AggregatesAdminTestJSON-1406494805 tempest-AggregatesAdminTestJSON-1406494805-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:05.400194 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-02747112-fa4c-4db4-aead-aaa1f7438a6f tempest-AggregatesAdminTestJSON-1406494805 tempest-AggregatesAdminTestJSON-1406494805-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:05.400783 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-02747112-fa4c-4db4-aead-aaa1f7438a6f tempest-AggregatesAdminTestJSON-1406494805 tempest-AggregatesAdminTestJSON-1406494805-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:05.703299 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-02747112-fa4c-4db4-aead-aaa1f7438a6f tempest-AggregatesAdminTestJSON-1406494805 tempest-AggregatesAdminTestJSON-1406494805-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 241 microversion: 2.1 time: 0.327133 Oct 22 20:49:05.704528 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 109/234] 10.222.0.18 () {60 vars in 1191 bytes} [Sat Oct 22 20:49:05 2022] POST /compute/v2.1/os-aggregates/4/action => generated 241 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:49:05.718327 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-097552dd-d409-4875-a553-0eef3f652960 tempest-AggregatesAdminTestJSON-1406494805 tempest-AggregatesAdminTestJSON-1406494805-project-admin] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:49:05.742399 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-097552dd-d409-4875-a553-0eef3f652960 tempest-AggregatesAdminTestJSON-1406494805 tempest-AggregatesAdminTestJSON-1406494805-project-admin] 10.222.0.18 "GET /compute/v2.1/os-aggregates/4" status: 200 len: 241 microversion: 2.1 time: 0.029899 Oct 22 20:49:05.746526 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 110/235] 10.222.0.18 () {58 vars in 1149 bytes} [Sat Oct 22 20:49:05 2022] GET /compute/v2.1/os-aggregates/4 => generated 241 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:49:05.765804 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-63807eba-e699-4667-8a83-abba945a87d7 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:49:05.768197 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-63807eba-e699-4667-8a83-abba945a87d7 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] [instance: 5c3de24c-090d-4769-8975-207eb939b979] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:49:05.785697 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-63807eba-e699-4667-8a83-abba945a87d7 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:05.787922 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-63807eba-e699-4667-8a83-abba945a87d7 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:05.788389 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-63807eba-e699-4667-8a83-abba945a87d7 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:05.790766 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-63807eba-e699-4667-8a83-abba945a87d7 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:05.793246 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-63807eba-e699-4667-8a83-abba945a87d7 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:05.793734 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-63807eba-e699-4667-8a83-abba945a87d7 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:05.937990 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-63807eba-e699-4667-8a83-abba945a87d7 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1ce98c66024d49b31e8e4f38b82838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a20f8f858424c89bf67a56feb720ac9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:49:05.943006 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-9b11bced-ce40-4fc2-b86a-b20b5866c6a8 tempest-AggregatesAdminNegativeTestJSON-128164911 tempest-AggregatesAdminNegativeTestJSON-128164911-project] Action: 'action', calling method: >, body: {"add_host": {"host": "nch2-master-1"}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:49:05.946520 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-9b11bced-ce40-4fc2-b86a-b20b5866c6a8 tempest-AggregatesAdminNegativeTestJSON-128164911 tempest-AggregatesAdminNegativeTestJSON-128164911-project] Policy check for os_compute_api:os-aggregates:add_host failed with credentials {'is_admin': False, 'user_id': 'd268c9e02ce649be9e9b2944ce652160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8775b596d1be4555a770625018c0499d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:49:05.949249 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-9b11bced-ce40-4fc2-b86a-b20b5866c6a8 tempest-AggregatesAdminNegativeTestJSON-128164911 tempest-AggregatesAdminNegativeTestJSON-128164911-project] Request method failure captured: Oct 22 20:49:05.949249 ncdv-master-1 devstack@n-api.service[138745]: request: POST /compute/v2.1/os-aggregates/3/action HTTP/1.1 Oct 22 20:49:05.949249 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 20:49:05.949249 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 20:49:05.949249 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 20:49:05.949249 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 39 Oct 22 20:49:05.949249 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 20:49:05.949249 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 20:49:05.949249 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 20:49:05.949249 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 20:49:05.949249 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVFcRNCPvpyUh9tHTp84IOcCCKBZNW74xRyRc1HMyEY1AnMcIwFdyL4E6RhA9OOpDiPUeN_gcx_nuT_6fY_gFdGSihdKqmRwLPQ8Oe91nL_sbgLbf1YwTco9wIZIplHXz7tJYgFaO8QTnHGpSZR6jcZWLP2WrqHwbI-Dty0oLrpE3PKI Oct 22 20:49:05.949249 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 20:49:05.949249 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 20:49:05.949249 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 20:49:05.949249 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 20:49:05.949249 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 20:49:05.949249 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 20:49:05.949249 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: 8775b596d1be4555a770625018c0499d Oct 22 20:49:05.949249 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-128164911 Oct 22 20:49:05.949249 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 20:49:05.949249 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 20:49:05.950660 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_8775b596d1be4555a770625018c0499d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8775b596d1be4555a770625018c0499d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/8775b596d1be4555a770625018c0499d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8775b596d1be4555a770625018c0499d"}]}] Oct 22 20:49:05.950660 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-128164911 Oct 22 20:49:05.950660 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: 8775b596d1be4555a770625018c0499d Oct 22 20:49:05.950660 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-128164911 Oct 22 20:49:05.950660 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-AggregatesAdminNegativeTestJSON-128164911-project Oct 22 20:49:05.950660 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 20:49:05.950660 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 20:49:05.950660 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: d268c9e02ce649be9e9b2944ce652160 Oct 22 20:49:05.950660 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-128164911-project Oct 22 20:49:05.950660 ncdv-master-1 devstack@n-api.service[138745]: Oct 22 20:49:05.950660 ncdv-master-1 devstack@n-api.service[138745]: {"add_host": {"host": "nch2-master-1"}} Oct 22 20:49:05.950660 ncdv-master-1 devstack@n-api.service[138745]: method: > Oct 22 20:49:05.950660 ncdv-master-1 devstack@n-api.service[138745]: exception: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Oct 22 20:49:05.951540 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'id': '3', 'body': {'add_host': {'host': 'nch2-master-1'}}} Oct 22 20:49:05.951540 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:49:05.951540 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:49:05.951540 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:49:05.951540 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:49:05.951540 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:49:05.951540 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:49:05.951540 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:49:05.951540 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:49:05.951540 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 20:49:05.951540 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 20:49:05.951540 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 172, in _add_host Oct 22 20:49:05.951540 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'add_host', target={}) Oct 22 20:49:05.951540 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 22 20:49:05.951540 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 22 20:49:05.951540 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 22 20:49:05.951540 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 22 20:49:05.951540 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 22 20:49:05.951540 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 22 20:49:05.952746 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 22 20:49:05.952746 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise self.value Oct 22 20:49:05.952746 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 22 20:49:05.952746 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 22 20:49:05.952746 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 22 20:49:05.952746 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 22 20:49:05.952746 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 22 20:49:05.952746 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 22 20:49:05.952746 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Oct 22 20:49:05.952746 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:49:05.952746 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:49:05.952746 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:49:05.952746 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:49:05.952746 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:49:05.952746 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:49:05.952746 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 22 20:49:05.952746 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 22 20:49:05.952746 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Oct 22 20:49:05.952746 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:49:05.955474 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-63807eba-e699-4667-8a83-abba945a87d7 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed1ce98c66024d49b31e8e4f38b82838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a20f8f858424c89bf67a56feb720ac9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:49:05.957611 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-63807eba-e699-4667-8a83-abba945a87d7 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed1ce98c66024d49b31e8e4f38b82838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a20f8f858424c89bf67a56feb720ac9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:49:05.960138 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-9b11bced-ce40-4fc2-b86a-b20b5866c6a8 tempest-AggregatesAdminNegativeTestJSON-128164911 tempest-AggregatesAdminNegativeTestJSON-128164911-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:49:05.961254 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-9b11bced-ce40-4fc2-b86a-b20b5866c6a8 tempest-AggregatesAdminNegativeTestJSON-128164911 tempest-AggregatesAdminNegativeTestJSON-128164911-project] 10.222.0.18 "POST /compute/v2.1/os-aggregates/3/action" status: 403 len: 118 microversion: 2.1 time: 0.682779 Oct 22 20:49:05.962003 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 126/236] 10.222.0.18 () {60 vars in 1191 bytes} [Sat Oct 22 20:49:05 2022] POST /compute/v2.1/os-aggregates/3/action => generated 118 bytes in 684 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 22 20:49:05.968070 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-eeea112f-87d4-43b4-860b-0ac1e7d257cc tempest-AggregatesAdminTestJSON-1406494805 tempest-AggregatesAdminTestJSON-1406494805-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch2-master-1"}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:49:05.971817 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-63807eba-e699-4667-8a83-abba945a87d7 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] 10.222.0.18 "GET /compute/v2.1/servers/5c3de24c-090d-4769-8975-207eb939b979" status: 200 len: 1446 microversion: 2.75 time: 0.219627 Oct 22 20:49:05.976582 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 111/237] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 20:49:05 2022] GET /compute/v2.1/servers/5c3de24c-090d-4769-8975-207eb939b979 => generated 1446 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 20:49:05.986392 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-3da05bf2-e311-4828-a8a6-6b4fe040e845 tempest-AggregatesAdminNegativeTestJSON-1306123093 tempest-AggregatesAdminNegativeTestJSON-1306123093-project-admin] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:49:06.004513 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-eeea112f-87d4-43b4-860b-0ac1e7d257cc tempest-AggregatesAdminTestJSON-1406494805 tempest-AggregatesAdminTestJSON-1406494805-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:06.005232 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-eeea112f-87d4-43b4-860b-0ac1e7d257cc tempest-AggregatesAdminTestJSON-1406494805 tempest-AggregatesAdminTestJSON-1406494805-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:06.005955 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-eeea112f-87d4-43b4-860b-0ac1e7d257cc tempest-AggregatesAdminTestJSON-1406494805 tempest-AggregatesAdminTestJSON-1406494805-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:06.013434 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:49:06.061932 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-3da05bf2-e311-4828-a8a6-6b4fe040e845 tempest-AggregatesAdminNegativeTestJSON-1306123093 tempest-AggregatesAdminNegativeTestJSON-1306123093-project-admin] 10.222.0.18 "DELETE /compute/v2.1/os-aggregates/3" status: 200 len: 0 microversion: 2.1 time: 0.083512 Oct 22 20:49:06.063881 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 112/238] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Oct 22 20:49:05 2022] DELETE /compute/v2.1/os-aggregates/3 => generated 0 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 22 20:49:06.078666 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-06c5c3ab-ab63-424b-81a8-17dcab7472bf tempest-AggregatesAdminNegativeTestJSON-1306123093 tempest-AggregatesAdminNegativeTestJSON-1306123093-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1286552392"}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:49:06.088070 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.objects.aggregate [None req-06c5c3ab-ab63-424b-81a8-17dcab7472bf tempest-AggregatesAdminNegativeTestJSON-1306123093 tempest-AggregatesAdminNegativeTestJSON-1306123093-project-admin] Generated uuid d96a5992-c1ab-42d9-a9fb-3b6648a3001e for aggregate {{(pid=138744) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 22 20:49:06.156624 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-06c5c3ab-ab63-424b-81a8-17dcab7472bf tempest-AggregatesAdminNegativeTestJSON-1306123093 tempest-AggregatesAdminNegativeTestJSON-1306123093-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.088253 Oct 22 20:49:06.160582 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 113/239] 10.222.0.18 () {60 vars in 1164 bytes} [Sat Oct 22 20:49:06 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:49:06.175745 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-6a28b4a2-fae3-438b-b8e2-496181a76847 tempest-AggregatesAdminNegativeTestJSON-1306123093 tempest-AggregatesAdminNegativeTestJSON-1306123093-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "tempest-nonexist_host-470181882"}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:49:06.203671 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6a28b4a2-fae3-438b-b8e2-496181a76847 tempest-AggregatesAdminNegativeTestJSON-1306123093 tempest-AggregatesAdminNegativeTestJSON-1306123093-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:06.204440 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6a28b4a2-fae3-438b-b8e2-496181a76847 tempest-AggregatesAdminNegativeTestJSON-1306123093 tempest-AggregatesAdminNegativeTestJSON-1306123093-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:06.206195 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6a28b4a2-fae3-438b-b8e2-496181a76847 tempest-AggregatesAdminNegativeTestJSON-1306123093 tempest-AggregatesAdminNegativeTestJSON-1306123093-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:06.228822 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6a28b4a2-fae3-438b-b8e2-496181a76847 tempest-AggregatesAdminNegativeTestJSON-1306123093 tempest-AggregatesAdminNegativeTestJSON-1306123093-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:06.232698 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6a28b4a2-fae3-438b-b8e2-496181a76847 tempest-AggregatesAdminNegativeTestJSON-1306123093 tempest-AggregatesAdminNegativeTestJSON-1306123093-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:06.233714 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6a28b4a2-fae3-438b-b8e2-496181a76847 tempest-AggregatesAdminNegativeTestJSON-1306123093 tempest-AggregatesAdminNegativeTestJSON-1306123093-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:06.251560 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-eeea112f-87d4-43b4-860b-0ac1e7d257cc tempest-AggregatesAdminTestJSON-1406494805 tempest-AggregatesAdminTestJSON-1406494805-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 226 microversion: 2.1 time: 0.287982 Oct 22 20:49:06.252517 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 127/240] 10.222.0.18 () {60 vars in 1191 bytes} [Sat Oct 22 20:49:05 2022] POST /compute/v2.1/os-aggregates/4/action => generated 226 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:49:06.268695 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-ca6158c8-4a39-4cbf-9980-5e7c03c1e10a tempest-AggregatesAdminTestJSON-1406494805 tempest-AggregatesAdminTestJSON-1406494805-project-admin] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:49:06.283168 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-6a28b4a2-fae3-438b-b8e2-496181a76847 tempest-AggregatesAdminNegativeTestJSON-1306123093 tempest-AggregatesAdminNegativeTestJSON-1306123093-project-admin] HTTP exception thrown: Compute host tempest-nonexist_host-470181882 could not be found. Oct 22 20:49:06.294612 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-6a28b4a2-fae3-438b-b8e2-496181a76847 tempest-AggregatesAdminNegativeTestJSON-1306123093 tempest-AggregatesAdminNegativeTestJSON-1306123093-project-admin] Request method failure captured: Oct 22 20:49:06.294612 ncdv-master-1 devstack@n-api.service[138744]: request: POST /compute/v2.1/os-aggregates/5/action HTTP/1.1 Oct 22 20:49:06.294612 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 20:49:06.294612 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 20:49:06.294612 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 20:49:06.294612 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 57 Oct 22 20:49:06.294612 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 20:49:06.294612 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 20:49:06.294612 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 20:49:06.294612 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 20:49:06.294612 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVFcTjzeCF7gwSKDmU2CPWCR_esBhUtkbcoM98K65tKtwTX7k8J3P2XxFlWelX1TDo_-yYShDH5UFO7PvTkSeEz8zhJDyz1PblWBsa9c1g1Qy6YZmn8lB_e_ZFbxFrZc-0aXSGx-CMuDgW5UvCQv7euL6tHWkksIhSTjd3SVjJ9Vfw2k Oct 22 20:49:06.294612 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 20:49:06.294612 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 20:49:06.294612 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 20:49:06.294612 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 20:49:06.294612 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 20:49:06.294612 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 20:49:06.294612 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: c0539194941d4647ae4209c24cdce003 Oct 22 20:49:06.294612 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1306123093 Oct 22 20:49:06.294612 ncdv-master-1 devstack@n-api.service[138744]: X-Role: admin,member,reader Oct 22 20:49:06.294612 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: admin,member,reader Oct 22 20:49:06.296060 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_c0539194941d4647ae4209c24cdce003"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c0539194941d4647ae4209c24cdce003"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/c0539194941d4647ae4209c24cdce003"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c0539194941d4647ae4209c24cdce003"}]}] Oct 22 20:49:06.296060 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1306123093 Oct 22 20:49:06.296060 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: c0539194941d4647ae4209c24cdce003 Oct 22 20:49:06.296060 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1306123093 Oct 22 20:49:06.296060 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-AggregatesAdminNegativeTestJSON-1306123093-project-admin Oct 22 20:49:06.296060 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 20:49:06.296060 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 20:49:06.296060 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: 352f8254dcc044f18778bbbe73fc8d01 Oct 22 20:49:06.296060 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1306123093-project-admin Oct 22 20:49:06.296060 ncdv-master-1 devstack@n-api.service[138744]: Oct 22 20:49:06.296060 ncdv-master-1 devstack@n-api.service[138744]: {"add_host": {"host": "tempest-nonexist_host-470181882"}} Oct 22 20:49:06.296060 ncdv-master-1 devstack@n-api.service[138744]: method: > Oct 22 20:49:06.296740 ncdv-master-1 devstack@n-api.service[138744]: exception: Compute host tempest-nonexist_host-470181882 could not be found. Oct 22 20:49:06.296740 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': '5', 'body': {'add_host': {'host': 'tempest-nonexist_host-470181882'}}} Oct 22 20:49:06.296740 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:49:06.296740 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:49:06.296740 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5999, in _get_service_in_cell_by_host Oct 22 20:49:06.296740 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Oct 22 20:49:06.296740 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 22 20:49:06.296740 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 22 20:49:06.296740 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 22 20:49:06.296740 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 22 20:49:06.296740 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 22 20:49:06.296740 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 22 20:49:06.296740 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 22 20:49:06.296740 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 22 20:49:06.296740 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'tempest-nonexist_host-470181882' is not mapped to any cell Oct 22 20:49:06.296740 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:49:06.296740 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:49:06.296740 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:49:06.296740 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:49:06.296740 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6005, in _get_service_in_cell_by_host Oct 22 20:49:06.297809 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Oct 22 20:49:06.297809 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 22 20:49:06.297809 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 22 20:49:06.297809 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 22 20:49:06.297809 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:49:06.297809 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:49:06.297809 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:49:06.297809 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:49:06.297809 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Oct 22 20:49:06.297809 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Oct 22 20:49:06.297809 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 22 20:49:06.297809 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 22 20:49:06.297809 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 22 20:49:06.297809 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 22 20:49:06.297809 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 22 20:49:06.297809 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise self.value Oct 22 20:49:06.297809 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 22 20:49:06.297809 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 22 20:49:06.297809 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6621, in add_host_to_aggregate Oct 22 20:49:06.297809 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi service = _get_service_in_cell_by_host(context, host_name) Oct 22 20:49:06.300203 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6007, in _get_service_in_cell_by_host Oct 22 20:49:06.300203 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Oct 22 20:49:06.300203 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-nonexist_host-470181882 could not be found. Oct 22 20:49:06.300203 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:49:06.300203 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:49:06.300203 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:49:06.300203 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:49:06.300203 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:49:06.300203 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:49:06.300203 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:49:06.300203 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:49:06.300203 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:49:06.300203 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:49:06.300203 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 20:49:06.300203 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 20:49:06.300203 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 184, in _add_host Oct 22 20:49:06.300203 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 20:49:06.300203 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Compute host tempest-nonexist_host-470181882 could not be found. Oct 22 20:49:06.300203 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:49:06.300203 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:49:06.300203 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:49:06.303690 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:49:06.303690 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:49:06.303690 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:49:06.303690 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 20:49:06.303690 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 20:49:06.303690 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-nonexist_host-470181882 could not be found. Oct 22 20:49:06.303690 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:49:06.303690 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-6a28b4a2-fae3-438b-b8e2-496181a76847 tempest-AggregatesAdminNegativeTestJSON-1306123093 tempest-AggregatesAdminNegativeTestJSON-1306123093-project-admin] Returning 404 to user: Compute host tempest-nonexist_host-470181882 could not be found. {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:49:06.303690 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-6a28b4a2-fae3-438b-b8e2-496181a76847 tempest-AggregatesAdminNegativeTestJSON-1306123093 tempest-AggregatesAdminNegativeTestJSON-1306123093-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates/5/action" status: 404 len: 110 microversion: 2.1 time: 0.133073 Oct 22 20:49:06.310793 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 114/241] 10.222.0.18 () {60 vars in 1191 bytes} [Sat Oct 22 20:49:06 2022] POST /compute/v2.1/os-aggregates/5/action => generated 110 bytes in 144 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 20:49:06.323124 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_api:SELECT=89,nova_api:DELETE=8,nova_api:INSERT=3 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:49:06.328767 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-22f3c876-0bd4-466f-a0c7-0af4ca779f2b tempest-AggregatesAdminNegativeTestJSON-1306123093 tempest-AggregatesAdminNegativeTestJSON-1306123093-project-admin] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:49:06.345860 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-ca6158c8-4a39-4cbf-9980-5e7c03c1e10a tempest-AggregatesAdminTestJSON-1406494805 tempest-AggregatesAdminTestJSON-1406494805-project-admin] 10.222.0.18 "DELETE /compute/v2.1/os-aggregates/4" status: 200 len: 0 microversion: 2.1 time: 0.085838 Oct 22 20:49:06.350024 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 128/242] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Oct 22 20:49:06 2022] DELETE /compute/v2.1/os-aggregates/4 => generated 0 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Oct 22 20:49:06.390358 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-302b0a2e-62cc-41a2-b885-fbe46323af64 tempest-AggregatesAdminTestJSON-1406494805 tempest-AggregatesAdminTestJSON-1406494805-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1925848797"}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:49:06.395134 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.objects.aggregate [None req-302b0a2e-62cc-41a2-b885-fbe46323af64 tempest-AggregatesAdminTestJSON-1406494805 tempest-AggregatesAdminTestJSON-1406494805-project-admin] Generated uuid a4920691-c1dd-4448-8907-eea05c8c4166 for aggregate {{(pid=138745) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 22 20:49:06.425250 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-302b0a2e-62cc-41a2-b885-fbe46323af64 tempest-AggregatesAdminTestJSON-1406494805 tempest-AggregatesAdminTestJSON-1406494805-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.069016 Oct 22 20:49:06.427611 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 129/243] 10.222.0.18 () {60 vars in 1164 bytes} [Sat Oct 22 20:49:06 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:49:06.430375 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-22f3c876-0bd4-466f-a0c7-0af4ca779f2b tempest-AggregatesAdminNegativeTestJSON-1306123093 tempest-AggregatesAdminNegativeTestJSON-1306123093-project-admin] 10.222.0.18 "DELETE /compute/v2.1/os-aggregates/5" status: 200 len: 0 microversion: 2.1 time: 0.114799 Oct 22 20:49:06.435360 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-ac6247ee-0c5f-4857-95ea-bc376805d323 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:49:06.436254 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-ac6247ee-0c5f-4857-95ea-bc376805d323 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] [instance: 96add0b3-b82f-4a0a-bec3-9a6341ae5dec] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:49:06.437896 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 115/244] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Oct 22 20:49:06 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 0 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 22 20:49:06.449850 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ac6247ee-0c5f-4857-95ea-bc376805d323 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:06.450534 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ac6247ee-0c5f-4857-95ea-bc376805d323 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:06.451073 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ac6247ee-0c5f-4857-95ea-bc376805d323 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:06.451938 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ac6247ee-0c5f-4857-95ea-bc376805d323 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:06.452505 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ac6247ee-0c5f-4857-95ea-bc376805d323 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:06.453027 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ac6247ee-0c5f-4857-95ea-bc376805d323 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:06.459239 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-e4d43056-627f-4ddb-980d-bf08613ca0f7 tempest-AggregatesAdminTestJSON-1406494805 tempest-AggregatesAdminTestJSON-1406494805-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch2-master-1"}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:49:06.498086 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e4d43056-627f-4ddb-980d-bf08613ca0f7 tempest-AggregatesAdminTestJSON-1406494805 tempest-AggregatesAdminTestJSON-1406494805-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:06.501112 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e4d43056-627f-4ddb-980d-bf08613ca0f7 tempest-AggregatesAdminTestJSON-1406494805 tempest-AggregatesAdminTestJSON-1406494805-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:06.503234 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e4d43056-627f-4ddb-980d-bf08613ca0f7 tempest-AggregatesAdminTestJSON-1406494805 tempest-AggregatesAdminTestJSON-1406494805-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:06.659883 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-ac6247ee-0c5f-4857-95ea-bc376805d323 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e13dcabaaa4b218945aeeabb4c902e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675a324f0134844a1964f64322493ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:49:06.672588 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-ac6247ee-0c5f-4857-95ea-bc376805d323 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] 10.222.0.18 "GET /compute/v2.1/servers/96add0b3-b82f-4a0a-bec3-9a6341ae5dec" status: 200 len: 1278 microversion: 2.1 time: 0.243409 Oct 22 20:49:06.682070 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 130/245] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:49:06 2022] GET /compute/v2.1/servers/96add0b3-b82f-4a0a-bec3-9a6341ae5dec => generated 1278 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:49:06.706523 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-51ec150d-f160-4c68-8d65-0e4ac3020234 tempest-AggregatesAdminNegativeTestJSON-1306123093 tempest-AggregatesAdminNegativeTestJSON-1306123093-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:49:06.720041 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-51ec150d-f160-4c68-8d65-0e4ac3020234 tempest-AggregatesAdminNegativeTestJSON-1306123093 tempest-AggregatesAdminNegativeTestJSON-1306123093-project-admin] Request method failure captured: Oct 22 20:49:06.720041 ncdv-master-1 devstack@n-api.service[138745]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 22 20:49:06.720041 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 20:49:06.720041 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 20:49:06.720041 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 20:49:06.720041 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 283 Oct 22 20:49:06.720041 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 20:49:06.720041 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 20:49:06.720041 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 20:49:06.720041 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 20:49:06.720041 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVFcTjzeCF7gwSKDmU2CPWCR_esBhUtkbcoM98K65tKtwTX7k8J3P2XxFlWelX1TDo_-yYShDH5UFO7PvTkSeEz8zhJDyz1PblWBsa9c1g1Qy6YZmn8lB_e_ZFbxFrZc-0aXSGx-CMuDgW5UvCQv7euL6tHWkksIhSTjd3SVjJ9Vfw2k Oct 22 20:49:06.720041 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 20:49:06.720041 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 20:49:06.720041 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 20:49:06.720041 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 20:49:06.720041 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 20:49:06.720041 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 20:49:06.720041 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: c0539194941d4647ae4209c24cdce003 Oct 22 20:49:06.720041 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1306123093 Oct 22 20:49:06.720041 ncdv-master-1 devstack@n-api.service[138745]: X-Role: admin,member,reader Oct 22 20:49:06.720041 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: admin,member,reader Oct 22 20:49:06.721630 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_c0539194941d4647ae4209c24cdce003"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c0539194941d4647ae4209c24cdce003"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/c0539194941d4647ae4209c24cdce003"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c0539194941d4647ae4209c24cdce003"}]}] Oct 22 20:49:06.721630 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1306123093 Oct 22 20:49:06.721630 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: c0539194941d4647ae4209c24cdce003 Oct 22 20:49:06.721630 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1306123093 Oct 22 20:49:06.721630 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-AggregatesAdminNegativeTestJSON-1306123093-project-admin Oct 22 20:49:06.721630 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 20:49:06.721630 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 20:49:06.721630 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: 352f8254dcc044f18778bbbe73fc8d01 Oct 22 20:49:06.721630 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1306123093-project-admin Oct 22 20:49:06.721630 ncdv-master-1 devstack@n-api.service[138745]: Oct 22 20:49:06.722357 ncdv-master-1 devstack@n-api.service[138745]: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Oct 22 20:49:06.722357 ncdv-master-1 devstack@n-api.service[138745]: method: > Oct 22 20:49:06.722357 ncdv-master-1 devstack@n-api.service[138745]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 22 20:49:06.722357 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'body': {'aggregate': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Oct 22 20:49:06.722357 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:49:06.722357 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:49:06.722357 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 22 20:49:06.722357 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 22 20:49:06.722357 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 22 20:49:06.722357 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise error Oct 22 20:49:06.723158 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 22 20:49:06.723158 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:49:06.723158 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['aggregate']['properties']['name']: Oct 22 20:49:06.723158 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 22 20:49:06.723158 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:49:06.723158 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Oct 22 20:49:06.723158 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 22 20:49:06.723158 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:49:06.723158 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:49:06.723158 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:49:06.723158 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:49:06.723158 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:49:06.723158 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:49:06.723158 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:49:06.723158 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:49:06.723158 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:49:06.723158 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:49:06.724345 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 20:49:06.724345 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 20:49:06.724345 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 22 20:49:06.724345 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 22 20:49:06.724345 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 22 20:49:06.724345 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 22 20:49:06.724345 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 22 20:49:06.724345 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 22 20:49:06.724345 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 22 20:49:06.724345 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:49:06.724345 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:49:06.724345 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:49:06.724345 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:49:06.724345 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:49:06.724345 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:49:06.725341 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 22 20:49:06.725341 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 22 20:49:06.725341 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 22 20:49:06.725341 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:49:06.727007 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-51ec150d-f160-4c68-8d65-0e4ac3020234 tempest-AggregatesAdminNegativeTestJSON-1306123093 tempest-AggregatesAdminNegativeTestJSON-1306123093-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:49:06.729595 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-51ec150d-f160-4c68-8d65-0e4ac3020234 tempest-AggregatesAdminNegativeTestJSON-1306123093 tempest-AggregatesAdminNegativeTestJSON-1306123093-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates" status: 400 len: 619 microversion: 2.1 time: 0.044714 Oct 22 20:49:06.733164 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 131/246] 10.222.0.18 () {60 vars in 1165 bytes} [Sat Oct 22 20:49:06 2022] POST /compute/v2.1/os-aggregates => generated 619 bytes in 50 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 22 20:49:06.755531 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-ae013973-dd31-4157-a85d-186664c3ad36 tempest-AggregatesAdminNegativeTestJSON-1306123093 tempest-AggregatesAdminNegativeTestJSON-1306123093-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": ""}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:49:06.761836 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-ae013973-dd31-4157-a85d-186664c3ad36 tempest-AggregatesAdminNegativeTestJSON-1306123093 tempest-AggregatesAdminNegativeTestJSON-1306123093-project-admin] Request method failure captured: Oct 22 20:49:06.761836 ncdv-master-1 devstack@n-api.service[138745]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 22 20:49:06.761836 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 20:49:06.761836 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 20:49:06.761836 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 20:49:06.761836 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 27 Oct 22 20:49:06.761836 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 20:49:06.761836 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 20:49:06.761836 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 20:49:06.761836 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 20:49:06.761836 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVFcTjzeCF7gwSKDmU2CPWCR_esBhUtkbcoM98K65tKtwTX7k8J3P2XxFlWelX1TDo_-yYShDH5UFO7PvTkSeEz8zhJDyz1PblWBsa9c1g1Qy6YZmn8lB_e_ZFbxFrZc-0aXSGx-CMuDgW5UvCQv7euL6tHWkksIhSTjd3SVjJ9Vfw2k Oct 22 20:49:06.761836 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 20:49:06.761836 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 20:49:06.761836 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 20:49:06.761836 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 20:49:06.761836 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 20:49:06.761836 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 20:49:06.761836 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: c0539194941d4647ae4209c24cdce003 Oct 22 20:49:06.761836 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1306123093 Oct 22 20:49:06.761836 ncdv-master-1 devstack@n-api.service[138745]: X-Role: admin,member,reader Oct 22 20:49:06.761836 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: admin,member,reader Oct 22 20:49:06.763680 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_c0539194941d4647ae4209c24cdce003"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c0539194941d4647ae4209c24cdce003"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/c0539194941d4647ae4209c24cdce003"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c0539194941d4647ae4209c24cdce003"}]}] Oct 22 20:49:06.763680 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1306123093 Oct 22 20:49:06.763680 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: c0539194941d4647ae4209c24cdce003 Oct 22 20:49:06.763680 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1306123093 Oct 22 20:49:06.763680 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-AggregatesAdminNegativeTestJSON-1306123093-project-admin Oct 22 20:49:06.763680 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 20:49:06.763680 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 20:49:06.763680 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: 352f8254dcc044f18778bbbe73fc8d01 Oct 22 20:49:06.763680 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1306123093-project-admin Oct 22 20:49:06.763680 ncdv-master-1 devstack@n-api.service[138745]: Oct 22 20:49:06.763680 ncdv-master-1 devstack@n-api.service[138745]: {"aggregate": {"name": ""}} Oct 22 20:49:06.763680 ncdv-master-1 devstack@n-api.service[138745]: method: > Oct 22 20:49:06.763680 ncdv-master-1 devstack@n-api.service[138745]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 22 20:49:06.764783 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'body': {'aggregate': {'name': ''}}} Oct 22 20:49:06.764783 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:49:06.764783 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:49:06.764783 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 22 20:49:06.764783 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 22 20:49:06.764783 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 22 20:49:06.764783 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise error Oct 22 20:49:06.764783 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 22 20:49:06.764783 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:49:06.764783 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['aggregate']['properties']['name']: Oct 22 20:49:06.764783 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 22 20:49:06.764783 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:49:06.764783 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Oct 22 20:49:06.764783 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi '' Oct 22 20:49:06.764783 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:49:06.764783 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:49:06.764783 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:49:06.764783 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:49:06.764783 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:49:06.764783 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:49:06.764783 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:49:06.764783 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:49:06.764783 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:49:06.766290 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:49:06.766290 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 20:49:06.766290 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 20:49:06.766290 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 22 20:49:06.766290 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 22 20:49:06.766290 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 22 20:49:06.766290 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 22 20:49:06.766290 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 22 20:49:06.766290 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 22 20:49:06.766290 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 22 20:49:06.766290 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:49:06.766290 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:49:06.766290 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:49:06.766290 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:49:06.766290 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:49:06.766290 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:49:06.766290 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 22 20:49:06.766290 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 22 20:49:06.766290 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 22 20:49:06.766290 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:49:06.769583 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-ae013973-dd31-4157-a85d-186664c3ad36 tempest-AggregatesAdminNegativeTestJSON-1306123093 tempest-AggregatesAdminNegativeTestJSON-1306123093-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:49:06.769697 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-e4d43056-627f-4ddb-980d-bf08613ca0f7 tempest-AggregatesAdminTestJSON-1406494805 tempest-AggregatesAdminTestJSON-1406494805-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates/6/action" status: 200 len: 242 microversion: 2.1 time: 0.330848 Oct 22 20:49:06.770787 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-ae013973-dd31-4157-a85d-186664c3ad36 tempest-AggregatesAdminNegativeTestJSON-1306123093 tempest-AggregatesAdminNegativeTestJSON-1306123093-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates" status: 400 len: 108 microversion: 2.1 time: 0.026837 Oct 22 20:49:06.777145 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 116/248] 10.222.0.18 () {60 vars in 1191 bytes} [Sat Oct 22 20:49:06 2022] POST /compute/v2.1/os-aggregates/6/action => generated 242 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:49:06.777343 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 132/248] 10.222.0.18 () {60 vars in 1164 bytes} [Sat Oct 22 20:49:06 2022] POST /compute/v2.1/os-aggregates => generated 108 bytes in 34 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 22 20:49:06.783421 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-c061a4f5-e05e-42c5-b5cc-d45311fb7ce8 tempest-AggregatesAdminNegativeTestJSON-128164911 tempest-AggregatesAdminNegativeTestJSON-128164911-project] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1346664651"}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:49:06.790111 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-5ab3eae3-8b03-4d6f-b36d-2a7e7d53c985 tempest-AggregatesAdminTestJSON-1406494805 tempest-AggregatesAdminTestJSON-1406494805-project-admin] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:49:06.803538 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-5ab3eae3-8b03-4d6f-b36d-2a7e7d53c985 tempest-AggregatesAdminTestJSON-1406494805 tempest-AggregatesAdminTestJSON-1406494805-project-admin] 10.222.0.18 "GET /compute/v2.1/os-aggregates" status: 200 len: 245 microversion: 2.1 time: 0.019606 Oct 22 20:49:06.804075 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-c061a4f5-e05e-42c5-b5cc-d45311fb7ce8 tempest-AggregatesAdminNegativeTestJSON-128164911 tempest-AggregatesAdminNegativeTestJSON-128164911-project] Policy check for os_compute_api:os-aggregates:create failed with credentials {'is_admin': False, 'user_id': 'd268c9e02ce649be9e9b2944ce652160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8775b596d1be4555a770625018c0499d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:49:06.804647 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 133/249] 10.222.0.18 () {58 vars in 1143 bytes} [Sat Oct 22 20:49:06 2022] GET /compute/v2.1/os-aggregates => generated 245 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:49:06.816391 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-c061a4f5-e05e-42c5-b5cc-d45311fb7ce8 tempest-AggregatesAdminNegativeTestJSON-128164911 tempest-AggregatesAdminNegativeTestJSON-128164911-project] Request method failure captured: Oct 22 20:49:06.816391 ncdv-master-1 devstack@n-api.service[138744]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 22 20:49:06.816391 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 20:49:06.816391 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 20:49:06.816391 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 20:49:06.816391 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 60 Oct 22 20:49:06.816391 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 20:49:06.816391 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 20:49:06.816391 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 20:49:06.816391 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 20:49:06.816391 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVFcRNCPvpyUh9tHTp84IOcCCKBZNW74xRyRc1HMyEY1AnMcIwFdyL4E6RhA9OOpDiPUeN_gcx_nuT_6fY_gFdGSihdKqmRwLPQ8Oe91nL_sbgLbf1YwTco9wIZIplHXz7tJYgFaO8QTnHGpSZR6jcZWLP2WrqHwbI-Dty0oLrpE3PKI Oct 22 20:49:06.816391 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 20:49:06.816391 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 20:49:06.816391 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 20:49:06.816391 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 20:49:06.816391 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 20:49:06.816391 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 20:49:06.816391 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: 8775b596d1be4555a770625018c0499d Oct 22 20:49:06.816391 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-128164911 Oct 22 20:49:06.816391 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 20:49:06.816391 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 20:49:06.818148 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_8775b596d1be4555a770625018c0499d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8775b596d1be4555a770625018c0499d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/8775b596d1be4555a770625018c0499d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8775b596d1be4555a770625018c0499d"}]}] Oct 22 20:49:06.818148 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-128164911 Oct 22 20:49:06.818148 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: 8775b596d1be4555a770625018c0499d Oct 22 20:49:06.818148 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-128164911 Oct 22 20:49:06.818148 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-AggregatesAdminNegativeTestJSON-128164911-project Oct 22 20:49:06.818148 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 20:49:06.818148 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 20:49:06.818148 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: d268c9e02ce649be9e9b2944ce652160 Oct 22 20:49:06.818148 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-128164911-project Oct 22 20:49:06.818148 ncdv-master-1 devstack@n-api.service[138744]: Oct 22 20:49:06.818148 ncdv-master-1 devstack@n-api.service[138744]: {"aggregate": {"name": "tempest-test_aggregate-1346664651"}} Oct 22 20:49:06.818148 ncdv-master-1 devstack@n-api.service[138744]: method: > Oct 22 20:49:06.818148 ncdv-master-1 devstack@n-api.service[138744]: exception: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Oct 22 20:49:06.819174 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-1346664651'}}} Oct 22 20:49:06.819174 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:49:06.819174 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:49:06.819174 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:49:06.819174 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:49:06.819174 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:49:06.819174 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:49:06.819174 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:49:06.819174 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:49:06.819174 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 20:49:06.819174 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 20:49:06.819174 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 20:49:06.819174 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 20:49:06.819174 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 70, in create Oct 22 20:49:06.819174 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'create', target={}) Oct 22 20:49:06.819174 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 22 20:49:06.819174 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 22 20:49:06.819174 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 22 20:49:06.819174 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 22 20:49:06.820428 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 22 20:49:06.820428 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 22 20:49:06.820428 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 22 20:49:06.820428 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise self.value Oct 22 20:49:06.820428 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 22 20:49:06.820428 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 22 20:49:06.820428 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 22 20:49:06.820428 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 22 20:49:06.820428 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 22 20:49:06.820428 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 22 20:49:06.820428 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Oct 22 20:49:06.820428 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:49:06.820428 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:49:06.820428 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:49:06.820428 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:49:06.820428 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:49:06.820428 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:49:06.820428 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 22 20:49:06.820428 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 22 20:49:06.820428 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Oct 22 20:49:06.821706 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:49:06.826818 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-c061a4f5-e05e-42c5-b5cc-d45311fb7ce8 tempest-AggregatesAdminNegativeTestJSON-128164911 tempest-AggregatesAdminNegativeTestJSON-128164911-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:49:06.831674 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-c061a4f5-e05e-42c5-b5cc-d45311fb7ce8 tempest-AggregatesAdminNegativeTestJSON-128164911 tempest-AggregatesAdminNegativeTestJSON-128164911-project] 10.222.0.18 "POST /compute/v2.1/os-aggregates" status: 403 len: 116 microversion: 2.1 time: 0.052318 Oct 22 20:49:06.841598 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 117/250] 10.222.0.18 () {60 vars in 1164 bytes} [Sat Oct 22 20:49:06 2022] POST /compute/v2.1/os-aggregates => generated 116 bytes in 64 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 22 20:49:06.850223 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-8aa5a2bd-31c1-488c-a9b8-b9bf09866d71 tempest-AggregatesAdminTestJSON-1406494805 tempest-AggregatesAdminTestJSON-1406494805-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch2-master-1"}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:49:06.867806 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-8133fc1e-1de9-4b68-9977-c8897d21a4e3 tempest-AggregatesAdminNegativeTestJSON-1306123093 tempest-AggregatesAdminNegativeTestJSON-1306123093-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-345787218"}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:49:06.888942 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.objects.aggregate [None req-8133fc1e-1de9-4b68-9977-c8897d21a4e3 tempest-AggregatesAdminNegativeTestJSON-1306123093 tempest-AggregatesAdminNegativeTestJSON-1306123093-project-admin] Generated uuid 2c5ce5ec-d9eb-44e7-bf49-6b13f09545bf for aggregate {{(pid=138744) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 22 20:49:06.891467 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8aa5a2bd-31c1-488c-a9b8-b9bf09866d71 tempest-AggregatesAdminTestJSON-1406494805 tempest-AggregatesAdminTestJSON-1406494805-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:06.892278 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8aa5a2bd-31c1-488c-a9b8-b9bf09866d71 tempest-AggregatesAdminTestJSON-1406494805 tempest-AggregatesAdminTestJSON-1406494805-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:06.893962 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8aa5a2bd-31c1-488c-a9b8-b9bf09866d71 tempest-AggregatesAdminTestJSON-1406494805 tempest-AggregatesAdminTestJSON-1406494805-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:06.930790 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-8133fc1e-1de9-4b68-9977-c8897d21a4e3 tempest-AggregatesAdminNegativeTestJSON-1306123093 tempest-AggregatesAdminNegativeTestJSON-1306123093-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.084662 Oct 22 20:49:06.932322 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 118/251] 10.222.0.18 () {60 vars in 1164 bytes} [Sat Oct 22 20:49:06 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:49:06.968145 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-7490e12d-ebdd-4e4f-a01b-b3e3f279d2e5 tempest-AggregatesAdminNegativeTestJSON-1306123093 tempest-AggregatesAdminNegativeTestJSON-1306123093-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-345787218"}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:49:06.981010 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.objects.aggregate [None req-7490e12d-ebdd-4e4f-a01b-b3e3f279d2e5 tempest-AggregatesAdminNegativeTestJSON-1306123093 tempest-AggregatesAdminNegativeTestJSON-1306123093-project-admin] Generated uuid 7a2e5c4e-76b5-463b-92a4-9a1824d8b186 for aggregate {{(pid=138744) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 22 20:49:07.007703 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-7490e12d-ebdd-4e4f-a01b-b3e3f279d2e5 tempest-AggregatesAdminNegativeTestJSON-1306123093 tempest-AggregatesAdminNegativeTestJSON-1306123093-project-admin] HTTP exception thrown: Aggregate tempest-test_aggregate-345787218 already exists. Oct 22 20:49:07.014130 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-7490e12d-ebdd-4e4f-a01b-b3e3f279d2e5 tempest-AggregatesAdminNegativeTestJSON-1306123093 tempest-AggregatesAdminNegativeTestJSON-1306123093-project-admin] Request method failure captured: Oct 22 20:49:07.014130 ncdv-master-1 devstack@n-api.service[138744]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 22 20:49:07.014130 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 20:49:07.014130 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 20:49:07.014130 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 20:49:07.014130 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 59 Oct 22 20:49:07.014130 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 20:49:07.014130 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 20:49:07.014130 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 20:49:07.014130 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 20:49:07.014130 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVFcTjzeCF7gwSKDmU2CPWCR_esBhUtkbcoM98K65tKtwTX7k8J3P2XxFlWelX1TDo_-yYShDH5UFO7PvTkSeEz8zhJDyz1PblWBsa9c1g1Qy6YZmn8lB_e_ZFbxFrZc-0aXSGx-CMuDgW5UvCQv7euL6tHWkksIhSTjd3SVjJ9Vfw2k Oct 22 20:49:07.014130 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 20:49:07.014130 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 20:49:07.014130 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 20:49:07.014130 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 20:49:07.014130 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 20:49:07.014130 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 20:49:07.014130 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: c0539194941d4647ae4209c24cdce003 Oct 22 20:49:07.014130 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1306123093 Oct 22 20:49:07.014130 ncdv-master-1 devstack@n-api.service[138744]: X-Role: admin,member,reader Oct 22 20:49:07.014130 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: admin,member,reader Oct 22 20:49:07.015599 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_c0539194941d4647ae4209c24cdce003"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c0539194941d4647ae4209c24cdce003"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/c0539194941d4647ae4209c24cdce003"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c0539194941d4647ae4209c24cdce003"}]}] Oct 22 20:49:07.015599 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1306123093 Oct 22 20:49:07.015599 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: c0539194941d4647ae4209c24cdce003 Oct 22 20:49:07.015599 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1306123093 Oct 22 20:49:07.015599 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-AggregatesAdminNegativeTestJSON-1306123093-project-admin Oct 22 20:49:07.015599 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 20:49:07.015599 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 20:49:07.015599 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: 352f8254dcc044f18778bbbe73fc8d01 Oct 22 20:49:07.015599 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1306123093-project-admin Oct 22 20:49:07.015599 ncdv-master-1 devstack@n-api.service[138744]: Oct 22 20:49:07.015599 ncdv-master-1 devstack@n-api.service[138744]: {"aggregate": {"name": "tempest-test_aggregate-345787218"}} Oct 22 20:49:07.015599 ncdv-master-1 devstack@n-api.service[138744]: method: > Oct 22 20:49:07.015599 ncdv-master-1 devstack@n-api.service[138744]: exception: Aggregate tempest-test_aggregate-345787218 already exists. Oct 22 20:49:07.016429 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-345787218'}}} Oct 22 20:49:07.016429 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:49:07.016429 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:49:07.016429 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 78, in create Oct 22 20:49:07.016429 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi aggregate = self.api.create_aggregate(context, name, avail_zone) Oct 22 20:49:07.016429 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 22 20:49:07.016429 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 22 20:49:07.016429 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 22 20:49:07.016429 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 22 20:49:07.016429 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 22 20:49:07.016429 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise self.value Oct 22 20:49:07.016429 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 22 20:49:07.016429 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 22 20:49:07.016429 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6458, in create_aggregate Oct 22 20:49:07.016429 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi aggregate.create() Oct 22 20:49:07.016429 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 22 20:49:07.016429 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 22 20:49:07.016429 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 310, in create Oct 22 20:49:07.016429 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_create_in_db(self._context, updates, Oct 22 20:49:07.017654 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 22 20:49:07.017654 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 22 20:49:07.017654 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 175, in _aggregate_create_in_db Oct 22 20:49:07.017654 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.AggregateNameExists(aggregate_name=values['name']) Oct 22 20:49:07.017654 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNameExists: Aggregate tempest-test_aggregate-345787218 already exists. Oct 22 20:49:07.017654 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:49:07.017654 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:49:07.017654 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:49:07.017654 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:49:07.017654 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:49:07.017654 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:49:07.017654 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:49:07.017654 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:49:07.017654 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:49:07.017654 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:49:07.017654 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 20:49:07.017654 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 20:49:07.017654 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 20:49:07.017654 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 20:49:07.017654 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 80, in create Oct 22 20:49:07.018834 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Oct 22 20:49:07.018834 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate tempest-test_aggregate-345787218 already exists. Oct 22 20:49:07.018834 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:49:07.018834 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:49:07.018834 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:49:07.018834 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:49:07.018834 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:49:07.018834 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:49:07.018834 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 20:49:07.018834 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 20:49:07.018834 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate tempest-test_aggregate-345787218 already exists. Oct 22 20:49:07.018834 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:49:07.018834 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-7490e12d-ebdd-4e4f-a01b-b3e3f279d2e5 tempest-AggregatesAdminNegativeTestJSON-1306123093 tempest-AggregatesAdminNegativeTestJSON-1306123093-project-admin] Returning 409 to user: Aggregate tempest-test_aggregate-345787218 already exists. {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:49:07.021366 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-7490e12d-ebdd-4e4f-a01b-b3e3f279d2e5 tempest-AggregatesAdminNegativeTestJSON-1306123093 tempest-AggregatesAdminNegativeTestJSON-1306123093-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates" status: 409 len: 110 microversion: 2.1 time: 0.065219 Oct 22 20:49:07.023000 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 119/252] 10.222.0.18 () {60 vars in 1164 bytes} [Sat Oct 22 20:49:06 2022] POST /compute/v2.1/os-aggregates => generated 110 bytes in 70 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Oct 22 20:49:07.042563 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-16157773-8391-40a1-9276-5d46a3fbe52e tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:49:07.044407 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-16157773-8391-40a1-9276-5d46a3fbe52e tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] [instance: 5c3de24c-090d-4769-8975-207eb939b979] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:49:07.057941 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-16157773-8391-40a1-9276-5d46a3fbe52e tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:07.058469 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-16157773-8391-40a1-9276-5d46a3fbe52e tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:07.058922 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-16157773-8391-40a1-9276-5d46a3fbe52e tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:07.060663 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-16157773-8391-40a1-9276-5d46a3fbe52e tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:07.061422 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-16157773-8391-40a1-9276-5d46a3fbe52e tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:07.062011 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-16157773-8391-40a1-9276-5d46a3fbe52e tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:07.073155 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-8aa5a2bd-31c1-488c-a9b8-b9bf09866d71 tempest-AggregatesAdminTestJSON-1406494805 tempest-AggregatesAdminTestJSON-1406494805-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates/6/action" status: 200 len: 227 microversion: 2.1 time: 0.259275 Oct 22 20:49:07.079799 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 134/253] 10.222.0.18 () {60 vars in 1191 bytes} [Sat Oct 22 20:49:06 2022] POST /compute/v2.1/os-aggregates/6/action => generated 227 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:49:07.094022 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-5433f651-ca9c-4172-8711-45dc64bd49c7 tempest-AggregatesAdminNegativeTestJSON-1306123093 tempest-AggregatesAdminNegativeTestJSON-1306123093-project-admin] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:49:07.145237 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-5433f651-ca9c-4172-8711-45dc64bd49c7 tempest-AggregatesAdminNegativeTestJSON-1306123093 tempest-AggregatesAdminNegativeTestJSON-1306123093-project-admin] 10.222.0.18 "DELETE /compute/v2.1/os-aggregates/7" status: 200 len: 0 microversion: 2.1 time: 0.060804 Oct 22 20:49:07.145766 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 135/254] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Oct 22 20:49:07 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 0 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 22 20:49:07.156325 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-8b19395c-c96c-478e-8294-a9681de62236 tempest-AggregatesAdminTestJSON-1406494805 tempest-AggregatesAdminTestJSON-1406494805-project-admin] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:49:07.195117 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-8b19395c-c96c-478e-8294-a9681de62236 tempest-AggregatesAdminTestJSON-1406494805 tempest-AggregatesAdminTestJSON-1406494805-project-admin] 10.222.0.18 "DELETE /compute/v2.1/os-aggregates/6" status: 200 len: 0 microversion: 2.1 time: 0.046426 Oct 22 20:49:07.196726 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 136/255] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Oct 22 20:49:07 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 0 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 22 20:49:07.202814 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-16157773-8391-40a1-9276-5d46a3fbe52e tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1ce98c66024d49b31e8e4f38b82838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a20f8f858424c89bf67a56feb720ac9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:49:07.207516 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-1b29833f-538c-4a1b-a8d8-ea7b91361904 tempest-AggregatesAdminNegativeTestJSON-1306123093 tempest-AggregatesAdminNegativeTestJSON-1306123093-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-525029225"}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:49:07.216067 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.objects.aggregate [None req-1b29833f-538c-4a1b-a8d8-ea7b91361904 tempest-AggregatesAdminNegativeTestJSON-1306123093 tempest-AggregatesAdminNegativeTestJSON-1306123093-project-admin] Generated uuid e036057d-c47a-449e-94b4-d20878284a50 for aggregate {{(pid=138745) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 22 20:49:07.224029 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-16157773-8391-40a1-9276-5d46a3fbe52e tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed1ce98c66024d49b31e8e4f38b82838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a20f8f858424c89bf67a56feb720ac9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:49:07.228424 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-16157773-8391-40a1-9276-5d46a3fbe52e tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed1ce98c66024d49b31e8e4f38b82838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a20f8f858424c89bf67a56feb720ac9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:49:07.242014 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-16157773-8391-40a1-9276-5d46a3fbe52e tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] 10.222.0.18 "GET /compute/v2.1/servers/5c3de24c-090d-4769-8975-207eb939b979" status: 200 len: 1446 microversion: 2.75 time: 0.217229 Oct 22 20:49:07.244160 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 120/256] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 20:49:07 2022] GET /compute/v2.1/servers/5c3de24c-090d-4769-8975-207eb939b979 => generated 1446 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 20:49:07.260034 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-1b29833f-538c-4a1b-a8d8-ea7b91361904 tempest-AggregatesAdminNegativeTestJSON-1306123093 tempest-AggregatesAdminNegativeTestJSON-1306123093-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.059950 Oct 22 20:49:07.265032 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-7fb173e8-5a19-4caf-93d6-3e1addc05440 tempest-AggregatesAdminTestJSON-1406494805 tempest-AggregatesAdminTestJSON-1406494805-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1688013698"}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:49:07.267332 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 137/257] 10.222.0.18 () {60 vars in 1164 bytes} [Sat Oct 22 20:49:07 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:49:07.273776 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.objects.aggregate [None req-7fb173e8-5a19-4caf-93d6-3e1addc05440 tempest-AggregatesAdminTestJSON-1406494805 tempest-AggregatesAdminTestJSON-1406494805-project-admin] Generated uuid 536c4a56-e4ad-4659-a02d-7341f6c7a49e for aggregate {{(pid=138744) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 22 20:49:07.288395 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-c8a6c97e-751a-4d8e-883d-c8fc047b0c99 tempest-AggregatesAdminNegativeTestJSON-128164911 tempest-AggregatesAdminNegativeTestJSON-128164911-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:49:07.293814 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-c8a6c97e-751a-4d8e-883d-c8fc047b0c99 tempest-AggregatesAdminNegativeTestJSON-128164911 tempest-AggregatesAdminNegativeTestJSON-128164911-project] Policy check for os_compute_api:os-aggregates:delete failed with credentials {'is_admin': False, 'user_id': 'd268c9e02ce649be9e9b2944ce652160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8775b596d1be4555a770625018c0499d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:49:07.296699 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-c8a6c97e-751a-4d8e-883d-c8fc047b0c99 tempest-AggregatesAdminNegativeTestJSON-128164911 tempest-AggregatesAdminNegativeTestJSON-128164911-project] Request method failure captured: Oct 22 20:49:07.296699 ncdv-master-1 devstack@n-api.service[138745]: request: DELETE /compute/v2.1/os-aggregates/8 HTTP/1.1 Oct 22 20:49:07.296699 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 20:49:07.296699 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 20:49:07.296699 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 20:49:07.296699 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 0 Oct 22 20:49:07.296699 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 20:49:07.296699 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 20:49:07.296699 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 20:49:07.296699 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 20:49:07.296699 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVFcRNCPvpyUh9tHTp84IOcCCKBZNW74xRyRc1HMyEY1AnMcIwFdyL4E6RhA9OOpDiPUeN_gcx_nuT_6fY_gFdGSihdKqmRwLPQ8Oe91nL_sbgLbf1YwTco9wIZIplHXz7tJYgFaO8QTnHGpSZR6jcZWLP2WrqHwbI-Dty0oLrpE3PKI Oct 22 20:49:07.296699 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 20:49:07.296699 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 20:49:07.296699 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 20:49:07.296699 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 20:49:07.296699 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 20:49:07.296699 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 20:49:07.296699 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: 8775b596d1be4555a770625018c0499d Oct 22 20:49:07.296699 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-128164911 Oct 22 20:49:07.296699 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 20:49:07.296699 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 20:49:07.297941 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_8775b596d1be4555a770625018c0499d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8775b596d1be4555a770625018c0499d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/8775b596d1be4555a770625018c0499d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8775b596d1be4555a770625018c0499d"}]}] Oct 22 20:49:07.297941 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-128164911 Oct 22 20:49:07.297941 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: 8775b596d1be4555a770625018c0499d Oct 22 20:49:07.297941 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-128164911 Oct 22 20:49:07.297941 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-AggregatesAdminNegativeTestJSON-128164911-project Oct 22 20:49:07.297941 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 20:49:07.297941 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 20:49:07.297941 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: d268c9e02ce649be9e9b2944ce652160 Oct 22 20:49:07.297941 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-128164911-project Oct 22 20:49:07.297941 ncdv-master-1 devstack@n-api.service[138745]: method: > Oct 22 20:49:07.297941 ncdv-master-1 devstack@n-api.service[138745]: exception: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Oct 22 20:49:07.297941 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'id': '8'} Oct 22 20:49:07.298582 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:49:07.298582 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:49:07.298582 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:49:07.298582 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:49:07.298582 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:49:07.298582 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:49:07.298582 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:49:07.298582 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:49:07.298582 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 147, in delete Oct 22 20:49:07.298582 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'delete', target={}) Oct 22 20:49:07.298582 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 22 20:49:07.298582 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 22 20:49:07.298582 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 22 20:49:07.298582 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 22 20:49:07.298582 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 22 20:49:07.298582 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 22 20:49:07.298582 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 22 20:49:07.298582 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise self.value Oct 22 20:49:07.298582 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 22 20:49:07.299987 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 22 20:49:07.299987 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 22 20:49:07.299987 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 22 20:49:07.299987 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 22 20:49:07.299987 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 22 20:49:07.299987 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Oct 22 20:49:07.299987 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:49:07.299987 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:49:07.299987 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:49:07.299987 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:49:07.299987 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:49:07.299987 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:49:07.299987 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 22 20:49:07.299987 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 22 20:49:07.299987 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Oct 22 20:49:07.299987 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:49:07.302176 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-c8a6c97e-751a-4d8e-883d-c8fc047b0c99 tempest-AggregatesAdminNegativeTestJSON-128164911 tempest-AggregatesAdminNegativeTestJSON-128164911-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:49:07.304505 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-c8a6c97e-751a-4d8e-883d-c8fc047b0c99 tempest-AggregatesAdminNegativeTestJSON-128164911 tempest-AggregatesAdminNegativeTestJSON-128164911-project] 10.222.0.18 "DELETE /compute/v2.1/os-aggregates/8" status: 403 len: 116 microversion: 2.1 time: 0.025316 Oct 22 20:49:07.305821 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 138/258] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Oct 22 20:49:07 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 116 bytes in 29 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 22 20:49:07.336780 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-7fb173e8-5a19-4caf-93d6-3e1addc05440 tempest-AggregatesAdminTestJSON-1406494805 tempest-AggregatesAdminTestJSON-1406494805-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.090624 Oct 22 20:49:07.338451 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 121/259] 10.222.0.18 () {60 vars in 1164 bytes} [Sat Oct 22 20:49:07 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:49:07.354122 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-6cb1ecbe-8067-4ef4-8731-d73ce32097d7 tempest-AggregatesAdminNegativeTestJSON-1306123093 tempest-AggregatesAdminNegativeTestJSON-1306123093-project-admin] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:49:07.410883 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-6cb1ecbe-8067-4ef4-8731-d73ce32097d7 tempest-AggregatesAdminNegativeTestJSON-1306123093 tempest-AggregatesAdminNegativeTestJSON-1306123093-project-admin] 10.222.0.18 "DELETE /compute/v2.1/os-aggregates/8" status: 200 len: 0 microversion: 2.1 time: 0.070467 Oct 22 20:49:07.417205 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 122/260] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Oct 22 20:49:07 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 0 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 22 20:49:07.422490 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-7efe617b-a154-45fa-93e6-38aa253454a6 tempest-AggregatesAdminTestJSON-1406494805 tempest-AggregatesAdminTestJSON-1406494805-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch2-master-1"}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:49:07.438103 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7efe617b-a154-45fa-93e6-38aa253454a6 tempest-AggregatesAdminTestJSON-1406494805 tempest-AggregatesAdminTestJSON-1406494805-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:07.438990 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7efe617b-a154-45fa-93e6-38aa253454a6 tempest-AggregatesAdminTestJSON-1406494805 tempest-AggregatesAdminTestJSON-1406494805-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:07.439895 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7efe617b-a154-45fa-93e6-38aa253454a6 tempest-AggregatesAdminTestJSON-1406494805 tempest-AggregatesAdminTestJSON-1406494805-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:07.478671 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=10,nova_api:DELETE=7 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:49:07.570176 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-a0a4d79d-59ac-45b6-ab9c-db3f169f1408 tempest-QuotasAdminNegativeTest-1726628264 tempest-QuotasAdminNegativeTest-1726628264-project-admin] Calling method '.version_select at 0x7fd3a4a88ca0>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:49:07.707775 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-a0a4d79d-59ac-45b6-ab9c-db3f169f1408 tempest-QuotasAdminNegativeTest-1726628264 tempest-QuotasAdminNegativeTest-1726628264-project-admin] 10.222.0.18 "GET /compute/v2.1/os-quota-sets/164a0764f87b4526a9a4cc7f19117f1f" status: 200 len: 371 microversion: 2.1 time: 0.400486 Oct 22 20:49:07.708440 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 139/261] 10.222.0.18 () {58 vars in 1242 bytes} [Sat Oct 22 20:49:07 2022] GET /compute/v2.1/os-quota-sets/164a0764f87b4526a9a4cc7f19117f1f => generated 371 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:49:07.712886 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-98012dd1-2474-4a01-a114-24bb28aa994c tempest-AggregatesAdminNegativeTestJSON-1306123093 tempest-AggregatesAdminNegativeTestJSON-1306123093-project-admin] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:49:07.751026 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-7efe617b-a154-45fa-93e6-38aa253454a6 tempest-AggregatesAdminTestJSON-1406494805 tempest-AggregatesAdminTestJSON-1406494805-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates/9/action" status: 200 len: 242 microversion: 2.1 time: 0.332080 Oct 22 20:49:07.765058 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 123/262] 10.222.0.18 () {60 vars in 1191 bytes} [Sat Oct 22 20:49:07 2022] POST /compute/v2.1/os-aggregates/9/action => generated 242 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:49:07.766693 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.wsgi [None req-98012dd1-2474-4a01-a114-24bb28aa994c tempest-AggregatesAdminNegativeTestJSON-1306123093 tempest-AggregatesAdminNegativeTestJSON-1306123093-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Oct 22 20:49:07.769784 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-98012dd1-2474-4a01-a114-24bb28aa994c tempest-AggregatesAdminNegativeTestJSON-1306123093 tempest-AggregatesAdminNegativeTestJSON-1306123093-project-admin] Request method failure captured: Oct 22 20:49:07.769784 ncdv-master-1 devstack@n-api.service[138745]: request: DELETE /compute/v2.1/os-aggregates/-1 HTTP/1.1 Oct 22 20:49:07.769784 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 20:49:07.769784 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 20:49:07.769784 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 20:49:07.769784 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 0 Oct 22 20:49:07.769784 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 20:49:07.769784 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 20:49:07.769784 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 20:49:07.769784 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 20:49:07.769784 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVFcTjzeCF7gwSKDmU2CPWCR_esBhUtkbcoM98K65tKtwTX7k8J3P2XxFlWelX1TDo_-yYShDH5UFO7PvTkSeEz8zhJDyz1PblWBsa9c1g1Qy6YZmn8lB_e_ZFbxFrZc-0aXSGx-CMuDgW5UvCQv7euL6tHWkksIhSTjd3SVjJ9Vfw2k Oct 22 20:49:07.769784 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 20:49:07.769784 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 20:49:07.769784 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 20:49:07.769784 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 20:49:07.769784 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 20:49:07.769784 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 20:49:07.769784 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: c0539194941d4647ae4209c24cdce003 Oct 22 20:49:07.769784 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1306123093 Oct 22 20:49:07.769784 ncdv-master-1 devstack@n-api.service[138745]: X-Role: admin,member,reader Oct 22 20:49:07.769784 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: admin,member,reader Oct 22 20:49:07.770952 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_c0539194941d4647ae4209c24cdce003"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c0539194941d4647ae4209c24cdce003"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/c0539194941d4647ae4209c24cdce003"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c0539194941d4647ae4209c24cdce003"}]}] Oct 22 20:49:07.770952 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1306123093 Oct 22 20:49:07.770952 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: c0539194941d4647ae4209c24cdce003 Oct 22 20:49:07.770952 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1306123093 Oct 22 20:49:07.770952 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-AggregatesAdminNegativeTestJSON-1306123093-project-admin Oct 22 20:49:07.770952 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 20:49:07.770952 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 20:49:07.770952 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: 352f8254dcc044f18778bbbe73fc8d01 Oct 22 20:49:07.770952 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1306123093-project-admin Oct 22 20:49:07.770952 ncdv-master-1 devstack@n-api.service[138745]: method: > Oct 22 20:49:07.770952 ncdv-master-1 devstack@n-api.service[138745]: exception: Aggregate -1 could not be found. Oct 22 20:49:07.770952 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'id': '-1'} Oct 22 20:49:07.771645 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:49:07.771645 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:49:07.771645 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Oct 22 20:49:07.771645 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Oct 22 20:49:07.771645 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 22 20:49:07.771645 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 22 20:49:07.771645 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 22 20:49:07.771645 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 22 20:49:07.771645 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 22 20:49:07.771645 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise self.value Oct 22 20:49:07.771645 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 22 20:49:07.771645 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 22 20:49:07.771645 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Oct 22 20:49:07.771645 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Oct 22 20:49:07.771645 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 22 20:49:07.771645 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 22 20:49:07.771645 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 22 20:49:07.771645 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 22 20:49:07.771645 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 22 20:49:07.772740 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 22 20:49:07.772740 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 22 20:49:07.772740 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 22 20:49:07.772740 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Oct 22 20:49:07.772740 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:49:07.772740 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:49:07.772740 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:49:07.772740 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:49:07.772740 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:49:07.772740 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:49:07.772740 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:49:07.772740 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:49:07.772740 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:49:07.772740 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:49:07.772740 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Oct 22 20:49:07.772740 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 20:49:07.772740 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Oct 22 20:49:07.772740 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:49:07.772740 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:49:07.772740 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:49:07.772740 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:49:07.773870 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:49:07.773870 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:49:07.773870 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 20:49:07.773870 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 20:49:07.773870 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Oct 22 20:49:07.773870 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:49:07.773870 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-98012dd1-2474-4a01-a114-24bb28aa994c tempest-AggregatesAdminNegativeTestJSON-1306123093 tempest-AggregatesAdminNegativeTestJSON-1306123093-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:49:07.773870 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-98012dd1-2474-4a01-a114-24bb28aa994c tempest-AggregatesAdminNegativeTestJSON-1306123093 tempest-AggregatesAdminNegativeTestJSON-1306123093-project-admin] 10.222.0.18 "DELETE /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.061828 Oct 22 20:49:07.776053 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 140/263] 10.222.0.18 () {58 vars in 1155 bytes} [Sat Oct 22 20:49:07 2022] DELETE /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 22 20:49:07.776794 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-87a8fd2e-5ee8-436e-a094-df51b8e533e2 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:49:07.778872 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-87a8fd2e-5ee8-436e-a094-df51b8e533e2 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] [instance: 96add0b3-b82f-4a0a-bec3-9a6341ae5dec] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:49:07.780836 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-3efba667-c8bd-430a-ac92-da8ed03ced53 tempest-QuotasAdminNegativeTest-1726628264 tempest-QuotasAdminNegativeTest-1726628264-project-admin] Action: 'update', calling method: .version_select at 0x7fd3a4ad68b0>, body: {"quota_set": {"force": true, "cores": 0}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:49:07.805107 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-87a8fd2e-5ee8-436e-a094-df51b8e533e2 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:07.805669 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-87a8fd2e-5ee8-436e-a094-df51b8e533e2 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:07.806116 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-87a8fd2e-5ee8-436e-a094-df51b8e533e2 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:07.807431 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-87a8fd2e-5ee8-436e-a094-df51b8e533e2 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:07.812698 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-87a8fd2e-5ee8-436e-a094-df51b8e533e2 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:07.813307 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-87a8fd2e-5ee8-436e-a094-df51b8e533e2 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:07.966785 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3efba667-c8bd-430a-ac92-da8ed03ced53 tempest-QuotasAdminNegativeTest-1726628264 tempest-QuotasAdminNegativeTest-1726628264-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:07.967567 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3efba667-c8bd-430a-ac92-da8ed03ced53 tempest-QuotasAdminNegativeTest-1726628264 tempest-QuotasAdminNegativeTest-1726628264-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:07.968084 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3efba667-c8bd-430a-ac92-da8ed03ced53 tempest-QuotasAdminNegativeTest-1726628264 tempest-QuotasAdminNegativeTest-1726628264-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:07.968954 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3efba667-c8bd-430a-ac92-da8ed03ced53 tempest-QuotasAdminNegativeTest-1726628264 tempest-QuotasAdminNegativeTest-1726628264-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:07.970012 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3efba667-c8bd-430a-ac92-da8ed03ced53 tempest-QuotasAdminNegativeTest-1726628264 tempest-QuotasAdminNegativeTest-1726628264-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:07.971740 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3efba667-c8bd-430a-ac92-da8ed03ced53 tempest-QuotasAdminNegativeTest-1726628264 tempest-QuotasAdminNegativeTest-1726628264-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:08.141557 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-3efba667-c8bd-430a-ac92-da8ed03ced53 tempest-QuotasAdminNegativeTest-1726628264 tempest-QuotasAdminNegativeTest-1726628264-project-admin] 10.222.0.18 "PUT /compute/v2.1/os-quota-sets/164a0764f87b4526a9a4cc7f19117f1f" status: 200 len: 328 microversion: 2.1 time: 0.364273 Oct 22 20:49:08.160877 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 141/264] 10.222.0.18 () {60 vars in 1262 bytes} [Sat Oct 22 20:49:07 2022] PUT /compute/v2.1/os-quota-sets/164a0764f87b4526a9a4cc7f19117f1f => generated 328 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:49:08.174759 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-49ff8c85-eb01-4324-96a3-6b696455c84a tempest-AggregatesAdminTestJSON-1406494805 tempest-AggregatesAdminTestJSON-1406494805-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch2-master-1"}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:49:08.203320 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-49ff8c85-eb01-4324-96a3-6b696455c84a tempest-AggregatesAdminTestJSON-1406494805 tempest-AggregatesAdminTestJSON-1406494805-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:08.204525 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-49ff8c85-eb01-4324-96a3-6b696455c84a tempest-AggregatesAdminTestJSON-1406494805 tempest-AggregatesAdminTestJSON-1406494805-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:08.206736 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-49ff8c85-eb01-4324-96a3-6b696455c84a tempest-AggregatesAdminTestJSON-1406494805 tempest-AggregatesAdminTestJSON-1406494805-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:08.442027 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-49ff8c85-eb01-4324-96a3-6b696455c84a tempest-AggregatesAdminTestJSON-1406494805 tempest-AggregatesAdminTestJSON-1406494805-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates/9/action" status: 200 len: 227 microversion: 2.1 time: 0.279791 Oct 22 20:49:08.443995 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 142/265] 10.222.0.18 () {60 vars in 1191 bytes} [Sat Oct 22 20:49:08 2022] POST /compute/v2.1/os-aggregates/9/action => generated 227 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:49:08.454060 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-47a648da-8cbe-4ddd-a877-7108dae47a30 tempest-AggregatesAdminNegativeTestJSON-1306123093 tempest-AggregatesAdminNegativeTestJSON-1306123093-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2063818205"}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:49:08.461744 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.objects.aggregate [None req-47a648da-8cbe-4ddd-a877-7108dae47a30 tempest-AggregatesAdminNegativeTestJSON-1306123093 tempest-AggregatesAdminNegativeTestJSON-1306123093-project-admin] Generated uuid 8141c151-397b-46cf-8570-856e558b21fc for aggregate {{(pid=138745) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 22 20:49:08.517048 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-47a648da-8cbe-4ddd-a877-7108dae47a30 tempest-AggregatesAdminNegativeTestJSON-1306123093 tempest-AggregatesAdminNegativeTestJSON-1306123093-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.071075 Oct 22 20:49:08.520830 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 143/266] 10.222.0.18 () {60 vars in 1164 bytes} [Sat Oct 22 20:49:08 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:49:08.532462 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-37b8b5bb-f4ec-4a98-a355-0ef7d7716f46 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:49:08.537064 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-37b8b5bb-f4ec-4a98-a355-0ef7d7716f46 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] [instance: 5c3de24c-090d-4769-8975-207eb939b979] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:49:08.552246 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-37b8b5bb-f4ec-4a98-a355-0ef7d7716f46 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:08.552771 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-37b8b5bb-f4ec-4a98-a355-0ef7d7716f46 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:08.554380 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-37b8b5bb-f4ec-4a98-a355-0ef7d7716f46 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:08.555208 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-37b8b5bb-f4ec-4a98-a355-0ef7d7716f46 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:08.557811 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-37b8b5bb-f4ec-4a98-a355-0ef7d7716f46 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:08.558335 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-37b8b5bb-f4ec-4a98-a355-0ef7d7716f46 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:08.670150 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-87a8fd2e-5ee8-436e-a094-df51b8e533e2 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e13dcabaaa4b218945aeeabb4c902e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675a324f0134844a1964f64322493ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:49:08.682216 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-87a8fd2e-5ee8-436e-a094-df51b8e533e2 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] 10.222.0.18 "GET /compute/v2.1/servers/96add0b3-b82f-4a0a-bec3-9a6341ae5dec" status: 200 len: 1320 microversion: 2.1 time: 0.916872 Oct 22 20:49:08.682807 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 124/267] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:49:07 2022] GET /compute/v2.1/servers/96add0b3-b82f-4a0a-bec3-9a6341ae5dec => generated 1320 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:49:08.740971 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-37b8b5bb-f4ec-4a98-a355-0ef7d7716f46 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1ce98c66024d49b31e8e4f38b82838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a20f8f858424c89bf67a56feb720ac9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:49:08.757417 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-37b8b5bb-f4ec-4a98-a355-0ef7d7716f46 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed1ce98c66024d49b31e8e4f38b82838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a20f8f858424c89bf67a56feb720ac9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:49:08.759083 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-37b8b5bb-f4ec-4a98-a355-0ef7d7716f46 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed1ce98c66024d49b31e8e4f38b82838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a20f8f858424c89bf67a56feb720ac9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:49:08.769049 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-37b8b5bb-f4ec-4a98-a355-0ef7d7716f46 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] 10.222.0.18 "GET /compute/v2.1/servers/5c3de24c-090d-4769-8975-207eb939b979" status: 200 len: 1446 microversion: 2.75 time: 0.247023 Oct 22 20:49:08.769674 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 144/268] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 20:49:08 2022] GET /compute/v2.1/servers/5c3de24c-090d-4769-8975-207eb939b979 => generated 1446 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 20:49:08.794290 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-9c6e937d-2167-41cf-bf33-e49188fe172b tempest-AggregatesAdminTestJSON-1406494805 tempest-AggregatesAdminTestJSON-1406494805-project-admin] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:49:08.804937 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-39dd7fc6-9c25-4a6a-aac5-7c85b8aeb14e tempest-QuotasAdminNegativeTest-220159200 tempest-QuotasAdminNegativeTest-220159200-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-2085464877", "imageRef": "085e4478-6edc-4a69-8e08-f9831713eb65", "flavorRef": "452"}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:49:08.870538 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-9c6e937d-2167-41cf-bf33-e49188fe172b tempest-AggregatesAdminTestJSON-1406494805 tempest-AggregatesAdminTestJSON-1406494805-project-admin] 10.222.0.18 "DELETE /compute/v2.1/os-aggregates/9" status: 200 len: 0 microversion: 2.1 time: 0.084187 Oct 22 20:49:08.877696 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 145/269] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Oct 22 20:49:08 2022] DELETE /compute/v2.1/os-aggregates/9 => generated 0 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 22 20:49:08.900563 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-f0fe929f-6e17-41b8-a1ff-6acfc6cfc8f1 tempest-AggregatesAdminNegativeTestJSON-128164911 tempest-AggregatesAdminNegativeTestJSON-128164911-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:49:08.902325 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-f0fe929f-6e17-41b8-a1ff-6acfc6cfc8f1 tempest-AggregatesAdminNegativeTestJSON-128164911 tempest-AggregatesAdminNegativeTestJSON-128164911-project] Policy check for os_compute_api:os-aggregates:show failed with credentials {'is_admin': False, 'user_id': 'd268c9e02ce649be9e9b2944ce652160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8775b596d1be4555a770625018c0499d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:49:08.905423 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-f0fe929f-6e17-41b8-a1ff-6acfc6cfc8f1 tempest-AggregatesAdminNegativeTestJSON-128164911 tempest-AggregatesAdminNegativeTestJSON-128164911-project] Request method failure captured: Oct 22 20:49:08.905423 ncdv-master-1 devstack@n-api.service[138745]: request: GET /compute/v2.1/os-aggregates/10 HTTP/1.1 Oct 22 20:49:08.905423 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 20:49:08.905423 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 20:49:08.905423 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 20:49:08.905423 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 0 Oct 22 20:49:08.905423 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 20:49:08.905423 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 20:49:08.905423 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 20:49:08.905423 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 20:49:08.905423 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVFcRNCPvpyUh9tHTp84IOcCCKBZNW74xRyRc1HMyEY1AnMcIwFdyL4E6RhA9OOpDiPUeN_gcx_nuT_6fY_gFdGSihdKqmRwLPQ8Oe91nL_sbgLbf1YwTco9wIZIplHXz7tJYgFaO8QTnHGpSZR6jcZWLP2WrqHwbI-Dty0oLrpE3PKI Oct 22 20:49:08.905423 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 20:49:08.905423 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 20:49:08.905423 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 20:49:08.905423 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 20:49:08.905423 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 20:49:08.905423 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 20:49:08.905423 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: 8775b596d1be4555a770625018c0499d Oct 22 20:49:08.905423 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-128164911 Oct 22 20:49:08.905423 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 20:49:08.905423 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 20:49:08.906599 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_8775b596d1be4555a770625018c0499d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8775b596d1be4555a770625018c0499d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/8775b596d1be4555a770625018c0499d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8775b596d1be4555a770625018c0499d"}]}] Oct 22 20:49:08.906599 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-128164911 Oct 22 20:49:08.906599 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: 8775b596d1be4555a770625018c0499d Oct 22 20:49:08.906599 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-128164911 Oct 22 20:49:08.906599 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-AggregatesAdminNegativeTestJSON-128164911-project Oct 22 20:49:08.906599 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 20:49:08.906599 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 20:49:08.906599 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: d268c9e02ce649be9e9b2944ce652160 Oct 22 20:49:08.906599 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-128164911-project Oct 22 20:49:08.906599 ncdv-master-1 devstack@n-api.service[138745]: method: > Oct 22 20:49:08.906599 ncdv-master-1 devstack@n-api.service[138745]: exception: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Oct 22 20:49:08.906599 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'id': '10'} Oct 22 20:49:08.907240 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:49:08.907240 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:49:08.907240 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:49:08.907240 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:49:08.907240 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:49:08.907240 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:49:08.907240 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:49:08.907240 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:49:08.907240 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 100, in show Oct 22 20:49:08.907240 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'show', target={}) Oct 22 20:49:08.907240 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 22 20:49:08.907240 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 22 20:49:08.907240 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 22 20:49:08.907240 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 22 20:49:08.907240 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 22 20:49:08.907240 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 22 20:49:08.907240 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 22 20:49:08.907240 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise self.value Oct 22 20:49:08.907240 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 22 20:49:08.908359 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 22 20:49:08.908359 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 22 20:49:08.908359 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 22 20:49:08.908359 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 22 20:49:08.908359 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 22 20:49:08.908359 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Oct 22 20:49:08.908359 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:49:08.908359 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:49:08.908359 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:49:08.908359 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:49:08.908359 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:49:08.908359 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:49:08.908359 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 22 20:49:08.908359 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 22 20:49:08.908359 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Oct 22 20:49:08.908359 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:49:08.909303 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.network.neutron [None req-39dd7fc6-9c25-4a6a-aac5-7c85b8aeb14e tempest-QuotasAdminNegativeTest-220159200 tempest-QuotasAdminNegativeTest-220159200-project] validate_networks() for None {{(pid=138744) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 20:49:08.910984 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-f0fe929f-6e17-41b8-a1ff-6acfc6cfc8f1 tempest-AggregatesAdminNegativeTestJSON-128164911 tempest-AggregatesAdminNegativeTestJSON-128164911-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:49:08.911964 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-f0fe929f-6e17-41b8-a1ff-6acfc6cfc8f1 tempest-AggregatesAdminNegativeTestJSON-128164911 tempest-AggregatesAdminNegativeTestJSON-128164911-project] 10.222.0.18 "GET /compute/v2.1/os-aggregates/10" status: 403 len: 114 microversion: 2.1 time: 0.033283 Oct 22 20:49:08.912529 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 146/270] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Oct 22 20:49:08 2022] GET /compute/v2.1/os-aggregates/10 => generated 114 bytes in 34 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 22 20:49:08.917045 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-7f73868e-ae02-42f6-bf2b-e33861a32411 tempest-AggregatesAdminTestJSON-1406494805 tempest-AggregatesAdminTestJSON-1406494805-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2081214647"}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:49:08.921454 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.objects.aggregate [None req-7f73868e-ae02-42f6-bf2b-e33861a32411 tempest-AggregatesAdminTestJSON-1406494805 tempest-AggregatesAdminTestJSON-1406494805-project-admin] Generated uuid e29aaff4-723b-4210-a80a-a238c69cd0fd for aggregate {{(pid=138745) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 22 20:49:08.955191 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-7f73868e-ae02-42f6-bf2b-e33861a32411 tempest-AggregatesAdminTestJSON-1406494805 tempest-AggregatesAdminTestJSON-1406494805-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.041512 Oct 22 20:49:08.964353 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 147/271] 10.222.0.18 () {60 vars in 1164 bytes} [Sat Oct 22 20:49:08 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:49:08.970481 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-60ff8169-bbc4-474e-84c0-4c14c255ed8e tempest-AggregatesAdminNegativeTestJSON-1306123093 tempest-AggregatesAdminNegativeTestJSON-1306123093-project-admin] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:49:09.004688 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-60ff8169-bbc4-474e-84c0-4c14c255ed8e tempest-AggregatesAdminNegativeTestJSON-1306123093 tempest-AggregatesAdminNegativeTestJSON-1306123093-project-admin] 10.222.0.18 "DELETE /compute/v2.1/os-aggregates/10" status: 200 len: 0 microversion: 2.1 time: 0.038407 Oct 22 20:49:09.006073 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 148/272] 10.222.0.18 () {58 vars in 1155 bytes} [Sat Oct 22 20:49:08 2022] DELETE /compute/v2.1/os-aggregates/10 => generated 0 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 22 20:49:09.011882 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-be72920b-5b5a-4516-b403-357b1d8bd2cb tempest-AggregatesAdminTestJSON-1406494805 tempest-AggregatesAdminTestJSON-1406494805-project-admin] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:49:09.058715 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-be72920b-5b5a-4516-b403-357b1d8bd2cb tempest-AggregatesAdminTestJSON-1406494805 tempest-AggregatesAdminTestJSON-1406494805-project-admin] 10.222.0.18 "DELETE /compute/v2.1/os-aggregates/11" status: 200 len: 0 microversion: 2.1 time: 0.050724 Oct 22 20:49:09.061451 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 149/273] 10.222.0.18 () {58 vars in 1155 bytes} [Sat Oct 22 20:49:09 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 0 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 22 20:49:09.070641 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-06ea3376-1573-45c0-b29c-8b31b3163152 tempest-AggregatesAdminTestV241-182638173 tempest-AggregatesAdminTestV241-182638173-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-663059111"}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:49:09.074690 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.objects.aggregate [None req-06ea3376-1573-45c0-b29c-8b31b3163152 tempest-AggregatesAdminTestV241-182638173 tempest-AggregatesAdminTestV241-182638173-project-admin] Generated uuid d2154e99-07e1-4275-a280-91af22c99506 for aggregate {{(pid=138745) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 22 20:49:09.122658 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-06ea3376-1573-45c0-b29c-8b31b3163152 tempest-AggregatesAdminTestV241-182638173 tempest-AggregatesAdminTestV241-182638173-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates" status: 200 len: 246 microversion: 2.41 time: 0.059763 Oct 22 20:49:09.123278 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 150/274] 10.222.0.18 () {62 vars in 1205 bytes} [Sat Oct 22 20:49:09 2022] POST /compute/v2.1/os-aggregates => generated 246 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 22 20:49:09.130593 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-5051b00a-fc0e-439a-b5a7-fd07ba8c2b5b tempest-AggregatesAdminNegativeTestJSON-1306123093 tempest-AggregatesAdminNegativeTestJSON-1306123093-project-admin] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:49:09.147493 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.wsgi [None req-5051b00a-fc0e-439a-b5a7-fd07ba8c2b5b tempest-AggregatesAdminNegativeTestJSON-1306123093 tempest-AggregatesAdminNegativeTestJSON-1306123093-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Oct 22 20:49:09.149491 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-5051b00a-fc0e-439a-b5a7-fd07ba8c2b5b tempest-AggregatesAdminNegativeTestJSON-1306123093 tempest-AggregatesAdminNegativeTestJSON-1306123093-project-admin] Request method failure captured: Oct 22 20:49:09.149491 ncdv-master-1 devstack@n-api.service[138745]: request: GET /compute/v2.1/os-aggregates/-1 HTTP/1.1 Oct 22 20:49:09.149491 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 20:49:09.149491 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 20:49:09.149491 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 20:49:09.149491 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 0 Oct 22 20:49:09.149491 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 20:49:09.149491 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 20:49:09.149491 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 20:49:09.149491 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 20:49:09.149491 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVFcTjzeCF7gwSKDmU2CPWCR_esBhUtkbcoM98K65tKtwTX7k8J3P2XxFlWelX1TDo_-yYShDH5UFO7PvTkSeEz8zhJDyz1PblWBsa9c1g1Qy6YZmn8lB_e_ZFbxFrZc-0aXSGx-CMuDgW5UvCQv7euL6tHWkksIhSTjd3SVjJ9Vfw2k Oct 22 20:49:09.149491 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 20:49:09.149491 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 20:49:09.149491 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 20:49:09.149491 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 20:49:09.149491 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 20:49:09.149491 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 20:49:09.149491 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: c0539194941d4647ae4209c24cdce003 Oct 22 20:49:09.149491 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1306123093 Oct 22 20:49:09.149491 ncdv-master-1 devstack@n-api.service[138745]: X-Role: admin,member,reader Oct 22 20:49:09.149491 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: admin,member,reader Oct 22 20:49:09.150807 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_c0539194941d4647ae4209c24cdce003"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c0539194941d4647ae4209c24cdce003"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/c0539194941d4647ae4209c24cdce003"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c0539194941d4647ae4209c24cdce003"}]}] Oct 22 20:49:09.150807 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1306123093 Oct 22 20:49:09.150807 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: c0539194941d4647ae4209c24cdce003 Oct 22 20:49:09.150807 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1306123093 Oct 22 20:49:09.150807 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-AggregatesAdminNegativeTestJSON-1306123093-project-admin Oct 22 20:49:09.150807 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 20:49:09.150807 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 20:49:09.150807 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: 352f8254dcc044f18778bbbe73fc8d01 Oct 22 20:49:09.150807 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1306123093-project-admin Oct 22 20:49:09.150807 ncdv-master-1 devstack@n-api.service[138745]: method: > Oct 22 20:49:09.150807 ncdv-master-1 devstack@n-api.service[138745]: exception: Aggregate -1 could not be found. Oct 22 20:49:09.150807 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'id': '-1'} Oct 22 20:49:09.151528 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:49:09.151528 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:49:09.151528 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Oct 22 20:49:09.151528 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Oct 22 20:49:09.151528 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Oct 22 20:49:09.151528 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Oct 22 20:49:09.151528 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 22 20:49:09.151528 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 22 20:49:09.151528 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 22 20:49:09.151528 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 22 20:49:09.151528 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 22 20:49:09.151528 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 22 20:49:09.151528 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 22 20:49:09.151528 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 22 20:49:09.151528 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Oct 22 20:49:09.151528 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:49:09.151528 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:49:09.151528 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:49:09.151528 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:49:09.151528 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:49:09.152734 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:49:09.152734 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:49:09.152734 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:49:09.152734 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:49:09.152734 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:49:09.152734 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Oct 22 20:49:09.152734 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 20:49:09.152734 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Oct 22 20:49:09.152734 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:49:09.152734 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:49:09.152734 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:49:09.152734 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:49:09.152734 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:49:09.152734 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:49:09.152734 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 20:49:09.152734 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 20:49:09.152734 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Oct 22 20:49:09.152734 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:49:09.161044 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-5051b00a-fc0e-439a-b5a7-fd07ba8c2b5b tempest-AggregatesAdminNegativeTestJSON-1306123093 tempest-AggregatesAdminNegativeTestJSON-1306123093-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:49:09.161947 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-5051b00a-fc0e-439a-b5a7-fd07ba8c2b5b tempest-AggregatesAdminNegativeTestJSON-1306123093 tempest-AggregatesAdminNegativeTestJSON-1306123093-project-admin] 10.222.0.18 "GET /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.037405 Oct 22 20:49:09.169873 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 151/275] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Oct 22 20:49:09 2022] GET /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 22 20:49:09.175205 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-d3eb36f7-601d-4949-a8fb-ded53299a6c0 tempest-AggregatesAdminTestJSON-1406494805 tempest-AggregatesAdminTestJSON-1406494805-project-admin] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:49:09.183625 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.wsgi [None req-d3eb36f7-601d-4949-a8fb-ded53299a6c0 tempest-AggregatesAdminTestJSON-1406494805 tempest-AggregatesAdminTestJSON-1406494805-project-admin] HTTP exception thrown: Aggregate 11 could not be found. Oct 22 20:49:09.185673 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-d3eb36f7-601d-4949-a8fb-ded53299a6c0 tempest-AggregatesAdminTestJSON-1406494805 tempest-AggregatesAdminTestJSON-1406494805-project-admin] Request method failure captured: Oct 22 20:49:09.185673 ncdv-master-1 devstack@n-api.service[138745]: request: GET /compute/v2.1/os-aggregates/11 HTTP/1.1 Oct 22 20:49:09.185673 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 20:49:09.185673 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 20:49:09.185673 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 20:49:09.185673 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 0 Oct 22 20:49:09.185673 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 20:49:09.185673 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 20:49:09.185673 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 20:49:09.185673 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 20:49:09.185673 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVFcT-TF7Ckhvp7jTqOeJ_u5R15cKXcgAABawQ9qTv2GJmaBGBk2_QL0q7Yfssczb8pFALR0xGGk1D1NyWOnMWa2LxulLs9fxMiA7XlkFa82om618ZTRD97RRUxFTIJGnENeG4Xz1kjNB_JKXuGaWKG4h1x_LppACxHgtODj8pIsDTzA Oct 22 20:49:09.185673 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 20:49:09.185673 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 20:49:09.185673 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 20:49:09.185673 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 20:49:09.185673 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 20:49:09.185673 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 20:49:09.185673 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: d985fa03c3084ccd9e9d8302495c3f0e Oct 22 20:49:09.185673 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-AggregatesAdminTestJSON-1406494805 Oct 22 20:49:09.185673 ncdv-master-1 devstack@n-api.service[138745]: X-Role: admin,member,reader Oct 22 20:49:09.185673 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: admin,member,reader Oct 22 20:49:09.186877 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_d985fa03c3084ccd9e9d8302495c3f0e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d985fa03c3084ccd9e9d8302495c3f0e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/d985fa03c3084ccd9e9d8302495c3f0e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d985fa03c3084ccd9e9d8302495c3f0e"}]}] Oct 22 20:49:09.186877 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-AggregatesAdminTestJSON-1406494805 Oct 22 20:49:09.186877 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: d985fa03c3084ccd9e9d8302495c3f0e Oct 22 20:49:09.186877 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1406494805 Oct 22 20:49:09.186877 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-AggregatesAdminTestJSON-1406494805-project-admin Oct 22 20:49:09.186877 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 20:49:09.186877 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 20:49:09.186877 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: c0687fb0bd424d8fa0d9a6e524ff221e Oct 22 20:49:09.186877 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-AggregatesAdminTestJSON-1406494805-project-admin Oct 22 20:49:09.186877 ncdv-master-1 devstack@n-api.service[138745]: method: > Oct 22 20:49:09.186877 ncdv-master-1 devstack@n-api.service[138745]: exception: Aggregate 11 could not be found. Oct 22 20:49:09.186877 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'id': '11'} Oct 22 20:49:09.186877 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:49:09.187660 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:49:09.187660 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Oct 22 20:49:09.187660 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Oct 22 20:49:09.187660 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Oct 22 20:49:09.187660 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Oct 22 20:49:09.187660 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 22 20:49:09.187660 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 22 20:49:09.187660 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 22 20:49:09.187660 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 22 20:49:09.187660 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 22 20:49:09.187660 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 22 20:49:09.187660 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 22 20:49:09.187660 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 22 20:49:09.187660 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 11 could not be found. Oct 22 20:49:09.187660 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:49:09.187660 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:49:09.187660 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:49:09.187660 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:49:09.187660 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:49:09.188801 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:49:09.188801 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:49:09.188801 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:49:09.188801 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:49:09.188801 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:49:09.188801 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Oct 22 20:49:09.188801 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 20:49:09.188801 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 11 could not be found. Oct 22 20:49:09.188801 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:49:09.188801 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:49:09.188801 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:49:09.188801 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:49:09.188801 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:49:09.188801 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:49:09.188801 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 20:49:09.188801 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 20:49:09.188801 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 11 could not be found. Oct 22 20:49:09.188801 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:49:09.191851 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-d3eb36f7-601d-4949-a8fb-ded53299a6c0 tempest-AggregatesAdminTestJSON-1406494805 tempest-AggregatesAdminTestJSON-1406494805-project-admin] Returning 404 to user: Aggregate 11 could not be found. {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:49:09.193085 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-d3eb36f7-601d-4949-a8fb-ded53299a6c0 tempest-AggregatesAdminTestJSON-1406494805 tempest-AggregatesAdminTestJSON-1406494805-project-admin] 10.222.0.18 "GET /compute/v2.1/os-aggregates/11" status: 404 len: 78 microversion: 2.1 time: 0.022078 Oct 22 20:49:09.197749 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 152/276] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Oct 22 20:49:09 2022] GET /compute/v2.1/os-aggregates/11 => generated 78 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 22 20:49:09.203401 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-6daabe91-59a7-46a3-86a8-1e13a0fd05d0 tempest-AggregatesAdminTestV241-182638173 tempest-AggregatesAdminTestV241-182638173-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1707585224"}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:49:09.307299 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=6,nova_api:DELETE=12 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:49:09.336432 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-6daabe91-59a7-46a3-86a8-1e13a0fd05d0 tempest-AggregatesAdminTestV241-182638173 tempest-AggregatesAdminTestV241-182638173-project-admin] 10.222.0.18 "PUT /compute/v2.1/os-aggregates/12" status: 200 len: 300 microversion: 2.41 time: 0.136335 Oct 22 20:49:09.337515 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 153/277] 10.222.0.18 () {62 vars in 1213 bytes} [Sat Oct 22 20:49:09 2022] PUT /compute/v2.1/os-aggregates/12 => generated 300 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 22 20:49:09.342645 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-c8515c35-3ed3-4154-980c-72492f3b15aa tempest-AggregatesAdminNegativeTestJSON-128164911 tempest-AggregatesAdminNegativeTestJSON-128164911-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:49:09.344801 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-c8515c35-3ed3-4154-980c-72492f3b15aa tempest-AggregatesAdminNegativeTestJSON-128164911 tempest-AggregatesAdminNegativeTestJSON-128164911-project] Policy check for os_compute_api:os-aggregates:index failed with credentials {'is_admin': False, 'user_id': 'd268c9e02ce649be9e9b2944ce652160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8775b596d1be4555a770625018c0499d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:49:09.347101 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-c8515c35-3ed3-4154-980c-72492f3b15aa tempest-AggregatesAdminNegativeTestJSON-128164911 tempest-AggregatesAdminNegativeTestJSON-128164911-project] Request method failure captured: Oct 22 20:49:09.347101 ncdv-master-1 devstack@n-api.service[138745]: request: GET /compute/v2.1/os-aggregates HTTP/1.1 Oct 22 20:49:09.347101 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 20:49:09.347101 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 20:49:09.347101 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 20:49:09.347101 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 0 Oct 22 20:49:09.347101 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 20:49:09.347101 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 20:49:09.347101 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 20:49:09.347101 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 20:49:09.347101 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVFcRNCPvpyUh9tHTp84IOcCCKBZNW74xRyRc1HMyEY1AnMcIwFdyL4E6RhA9OOpDiPUeN_gcx_nuT_6fY_gFdGSihdKqmRwLPQ8Oe91nL_sbgLbf1YwTco9wIZIplHXz7tJYgFaO8QTnHGpSZR6jcZWLP2WrqHwbI-Dty0oLrpE3PKI Oct 22 20:49:09.347101 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 20:49:09.347101 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 20:49:09.347101 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 20:49:09.347101 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 20:49:09.347101 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 20:49:09.347101 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 20:49:09.347101 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: 8775b596d1be4555a770625018c0499d Oct 22 20:49:09.347101 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-128164911 Oct 22 20:49:09.347101 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 20:49:09.347101 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 20:49:09.348781 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_8775b596d1be4555a770625018c0499d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8775b596d1be4555a770625018c0499d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/8775b596d1be4555a770625018c0499d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8775b596d1be4555a770625018c0499d"}]}] Oct 22 20:49:09.348781 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-128164911 Oct 22 20:49:09.348781 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: 8775b596d1be4555a770625018c0499d Oct 22 20:49:09.348781 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-128164911 Oct 22 20:49:09.348781 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-AggregatesAdminNegativeTestJSON-128164911-project Oct 22 20:49:09.348781 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 20:49:09.348781 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 20:49:09.348781 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: d268c9e02ce649be9e9b2944ce652160 Oct 22 20:49:09.348781 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-128164911-project Oct 22 20:49:09.348781 ncdv-master-1 devstack@n-api.service[138745]: method: > Oct 22 20:49:09.348781 ncdv-master-1 devstack@n-api.service[138745]: exception: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Oct 22 20:49:09.348781 ncdv-master-1 devstack@n-api.service[138745]: action_args: {} Oct 22 20:49:09.349615 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:49:09.349615 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:49:09.349615 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:49:09.349615 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:49:09.349615 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:49:09.349615 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:49:09.349615 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:49:09.349615 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:49:09.349615 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 55, in index Oct 22 20:49:09.349615 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'index', target={}) Oct 22 20:49:09.349615 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 22 20:49:09.349615 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 22 20:49:09.349615 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 22 20:49:09.349615 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 22 20:49:09.349615 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 22 20:49:09.349615 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 22 20:49:09.349615 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 22 20:49:09.349615 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise self.value Oct 22 20:49:09.349615 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 22 20:49:09.350948 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 22 20:49:09.350948 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 22 20:49:09.350948 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 22 20:49:09.350948 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 22 20:49:09.350948 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 22 20:49:09.350948 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Oct 22 20:49:09.350948 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:49:09.350948 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:49:09.350948 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:49:09.350948 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:49:09.350948 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:49:09.350948 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:49:09.350948 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 22 20:49:09.350948 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 22 20:49:09.350948 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Oct 22 20:49:09.350948 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:49:09.354877 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-c8515c35-3ed3-4154-980c-72492f3b15aa tempest-AggregatesAdminNegativeTestJSON-128164911 tempest-AggregatesAdminNegativeTestJSON-128164911-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:49:09.356337 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-c8515c35-3ed3-4154-980c-72492f3b15aa tempest-AggregatesAdminNegativeTestJSON-128164911 tempest-AggregatesAdminNegativeTestJSON-128164911-project] 10.222.0.18 "GET /compute/v2.1/os-aggregates" status: 403 len: 115 microversion: 2.1 time: 0.017584 Oct 22 20:49:09.364264 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 154/278] 10.222.0.18 () {58 vars in 1143 bytes} [Sat Oct 22 20:49:09 2022] GET /compute/v2.1/os-aggregates => generated 115 bytes in 26 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 22 20:49:09.379811 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-544618c9-764e-41c3-a6e9-731810f84bc6 tempest-AggregatesAdminTestJSON-1406494805 tempest-AggregatesAdminTestJSON-1406494805-project-admin] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:49:09.398290 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.wsgi [None req-544618c9-764e-41c3-a6e9-731810f84bc6 tempest-AggregatesAdminTestJSON-1406494805 tempest-AggregatesAdminTestJSON-1406494805-project-admin] HTTP exception thrown: Aggregate 11 could not be found. Oct 22 20:49:09.400390 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-544618c9-764e-41c3-a6e9-731810f84bc6 tempest-AggregatesAdminTestJSON-1406494805 tempest-AggregatesAdminTestJSON-1406494805-project-admin] Request method failure captured: Oct 22 20:49:09.400390 ncdv-master-1 devstack@n-api.service[138745]: request: DELETE /compute/v2.1/os-aggregates/11 HTTP/1.1 Oct 22 20:49:09.400390 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 20:49:09.400390 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 20:49:09.400390 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 20:49:09.400390 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 0 Oct 22 20:49:09.400390 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 20:49:09.400390 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 20:49:09.400390 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 20:49:09.400390 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 20:49:09.400390 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVFcT-TF7Ckhvp7jTqOeJ_u5R15cKXcgAABawQ9qTv2GJmaBGBk2_QL0q7Yfssczb8pFALR0xGGk1D1NyWOnMWa2LxulLs9fxMiA7XlkFa82om618ZTRD97RRUxFTIJGnENeG4Xz1kjNB_JKXuGaWKG4h1x_LppACxHgtODj8pIsDTzA Oct 22 20:49:09.400390 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 20:49:09.400390 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 20:49:09.400390 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 20:49:09.400390 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 20:49:09.400390 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 20:49:09.400390 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 20:49:09.400390 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: d985fa03c3084ccd9e9d8302495c3f0e Oct 22 20:49:09.400390 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-AggregatesAdminTestJSON-1406494805 Oct 22 20:49:09.400390 ncdv-master-1 devstack@n-api.service[138745]: X-Role: admin,member,reader Oct 22 20:49:09.400390 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: admin,member,reader Oct 22 20:49:09.401590 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_d985fa03c3084ccd9e9d8302495c3f0e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d985fa03c3084ccd9e9d8302495c3f0e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/d985fa03c3084ccd9e9d8302495c3f0e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d985fa03c3084ccd9e9d8302495c3f0e"}]}] Oct 22 20:49:09.401590 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-AggregatesAdminTestJSON-1406494805 Oct 22 20:49:09.401590 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: d985fa03c3084ccd9e9d8302495c3f0e Oct 22 20:49:09.401590 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1406494805 Oct 22 20:49:09.401590 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-AggregatesAdminTestJSON-1406494805-project-admin Oct 22 20:49:09.401590 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 20:49:09.401590 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 20:49:09.401590 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: c0687fb0bd424d8fa0d9a6e524ff221e Oct 22 20:49:09.401590 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-AggregatesAdminTestJSON-1406494805-project-admin Oct 22 20:49:09.401590 ncdv-master-1 devstack@n-api.service[138745]: method: > Oct 22 20:49:09.401590 ncdv-master-1 devstack@n-api.service[138745]: exception: Aggregate 11 could not be found. Oct 22 20:49:09.401590 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'id': '11'} Oct 22 20:49:09.401590 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:49:09.402279 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:49:09.402279 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Oct 22 20:49:09.402279 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Oct 22 20:49:09.402279 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 22 20:49:09.402279 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 22 20:49:09.402279 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 22 20:49:09.402279 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 22 20:49:09.402279 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 22 20:49:09.402279 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise self.value Oct 22 20:49:09.402279 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 22 20:49:09.402279 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 22 20:49:09.402279 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Oct 22 20:49:09.402279 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Oct 22 20:49:09.402279 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 22 20:49:09.402279 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 22 20:49:09.402279 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 22 20:49:09.402279 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 22 20:49:09.402279 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 22 20:49:09.402279 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 22 20:49:09.403365 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 22 20:49:09.403365 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 22 20:49:09.403365 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 11 could not be found. Oct 22 20:49:09.403365 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:49:09.403365 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:49:09.403365 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:49:09.403365 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:49:09.403365 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:49:09.403365 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:49:09.403365 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:49:09.403365 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:49:09.403365 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:49:09.403365 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:49:09.403365 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Oct 22 20:49:09.403365 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 20:49:09.403365 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 11 could not be found. Oct 22 20:49:09.403365 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:49:09.403365 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:49:09.403365 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:49:09.403365 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:49:09.403365 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:49:09.404558 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:49:09.404558 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 20:49:09.404558 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 20:49:09.404558 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 11 could not be found. Oct 22 20:49:09.404558 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:49:09.406522 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-544618c9-764e-41c3-a6e9-731810f84bc6 tempest-AggregatesAdminTestJSON-1406494805 tempest-AggregatesAdminTestJSON-1406494805-project-admin] Returning 404 to user: Aggregate 11 could not be found. {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:49:09.407651 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-544618c9-764e-41c3-a6e9-731810f84bc6 tempest-AggregatesAdminTestJSON-1406494805 tempest-AggregatesAdminTestJSON-1406494805-project-admin] 10.222.0.18 "DELETE /compute/v2.1/os-aggregates/11" status: 404 len: 78 microversion: 2.1 time: 0.041915 Oct 22 20:49:09.414320 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 155/279] 10.222.0.18 () {58 vars in 1155 bytes} [Sat Oct 22 20:49:09 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 78 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 22 20:49:09.420130 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-2f2ee3f7-3195-40fd-a1f1-8848b1b60d30 tempest-AggregatesAdminTestV241-182638173 tempest-AggregatesAdminTestV241-182638173-project-admin] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:49:09.432665 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-2f2ee3f7-3195-40fd-a1f1-8848b1b60d30 tempest-AggregatesAdminTestV241-182638173 tempest-AggregatesAdminTestV241-182638173-project-admin] 10.222.0.18 "GET /compute/v2.1/os-aggregates/12" status: 200 len: 300 microversion: 2.41 time: 0.016795 Oct 22 20:49:09.433864 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 156/280] 10.222.0.18 () {60 vars in 1193 bytes} [Sat Oct 22 20:49:09 2022] GET /compute/v2.1/os-aggregates/12 => generated 300 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 22 20:49:09.439454 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-d37b88f5-09a0-4cdd-9af9-5e60e338b51a tempest-AggregatesAdminTestJSON-1406494805 tempest-AggregatesAdminTestJSON-1406494805-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-1862501680", "name": "tempest-test_aggregate-897353450"}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:49:09.473633 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-39dd7fc6-9c25-4a6a-aac5-7c85b8aeb14e tempest-QuotasAdminNegativeTest-220159200 tempest-QuotasAdminNegativeTest-220159200-project] Flavor limits 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 20:49:09.474030 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.objects.aggregate [None req-d37b88f5-09a0-4cdd-9af9-5e60e338b51a tempest-AggregatesAdminTestJSON-1406494805 tempest-AggregatesAdminTestJSON-1406494805-project-admin] Generated uuid 86f10179-b3ca-4fc1-aa5f-51ba3fbe938e for aggregate {{(pid=138745) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 22 20:49:09.474504 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-39dd7fc6-9c25-4a6a-aac5-7c85b8aeb14e tempest-QuotasAdminNegativeTest-220159200 tempest-QuotasAdminNegativeTest-220159200-project] Image limits 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 20:49:09.474504 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-39dd7fc6-9c25-4a6a-aac5-7c85b8aeb14e tempest-QuotasAdminNegativeTest-220159200 tempest-QuotasAdminNegativeTest-220159200-project] Flavor pref 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 20:49:09.474931 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-39dd7fc6-9c25-4a6a-aac5-7c85b8aeb14e tempest-QuotasAdminNegativeTest-220159200 tempest-QuotasAdminNegativeTest-220159200-project] Image pref 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 20:49:09.475363 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-39dd7fc6-9c25-4a6a-aac5-7c85b8aeb14e tempest-QuotasAdminNegativeTest-220159200 tempest-QuotasAdminNegativeTest-220159200-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 20:49:09.494136 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-39dd7fc6-9c25-4a6a-aac5-7c85b8aeb14e tempest-QuotasAdminNegativeTest-220159200 tempest-QuotasAdminNegativeTest-220159200-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:09.495303 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-39dd7fc6-9c25-4a6a-aac5-7c85b8aeb14e tempest-QuotasAdminNegativeTest-220159200 tempest-QuotasAdminNegativeTest-220159200-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:09.500324 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-39dd7fc6-9c25-4a6a-aac5-7c85b8aeb14e tempest-QuotasAdminNegativeTest-220159200 tempest-QuotasAdminNegativeTest-220159200-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:09.501335 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-39dd7fc6-9c25-4a6a-aac5-7c85b8aeb14e tempest-QuotasAdminNegativeTest-220159200 tempest-QuotasAdminNegativeTest-220159200-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:09.501918 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-39dd7fc6-9c25-4a6a-aac5-7c85b8aeb14e tempest-QuotasAdminNegativeTest-220159200 tempest-QuotasAdminNegativeTest-220159200-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:09.502464 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-39dd7fc6-9c25-4a6a-aac5-7c85b8aeb14e tempest-QuotasAdminNegativeTest-220159200 tempest-QuotasAdminNegativeTest-220159200-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:09.529350 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-d37b88f5-09a0-4cdd-9af9-5e60e338b51a tempest-AggregatesAdminTestJSON-1406494805 tempest-AggregatesAdminTestJSON-1406494805-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates" status: 200 len: 222 microversion: 2.1 time: 0.094105 Oct 22 20:49:09.530487 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 157/281] 10.222.0.18 () {60 vars in 1165 bytes} [Sat Oct 22 20:49:09 2022] POST /compute/v2.1/os-aggregates => generated 222 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:49:09.536028 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-604fd9cf-45c4-494a-870e-3094da199efd tempest-AggregatesAdminTestV241-182638173 tempest-AggregatesAdminTestV241-182638173-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch2-master-1"}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:49:09.549368 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-604fd9cf-45c4-494a-870e-3094da199efd tempest-AggregatesAdminTestV241-182638173 tempest-AggregatesAdminTestV241-182638173-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:09.549977 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-604fd9cf-45c4-494a-870e-3094da199efd tempest-AggregatesAdminTestV241-182638173 tempest-AggregatesAdminTestV241-182638173-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:09.550472 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-604fd9cf-45c4-494a-870e-3094da199efd tempest-AggregatesAdminTestV241-182638173 tempest-AggregatesAdminTestV241-182638173-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:09.551679 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-39dd7fc6-9c25-4a6a-aac5-7c85b8aeb14e tempest-QuotasAdminNegativeTest-220159200 tempest-QuotasAdminNegativeTest-220159200-project] Getting quotas for project 164a0764f87b4526a9a4cc7f19117f1f. Resources: {'cores', 'instances', 'ram'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 20:49:09.569920 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-39dd7fc6-9c25-4a6a-aac5-7c85b8aeb14e tempest-QuotasAdminNegativeTest-220159200 tempest-QuotasAdminNegativeTest-220159200-project] Getting quotas for user 86ff0818a46743dc8f1a0320eb613cf2 and project 164a0764f87b4526a9a4cc7f19117f1f. Resources: {'cores', 'instances', 'ram'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 20:49:09.588258 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.utils [None req-39dd7fc6-9c25-4a6a-aac5-7c85b8aeb14e tempest-QuotasAdminNegativeTest-220159200 tempest-QuotasAdminNegativeTest-220159200-project] cores quota exceeded for 164a0764f87b4526a9a4cc7f19117f1f, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=138744) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Oct 22 20:49:09.589513 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-39dd7fc6-9c25-4a6a-aac5-7c85b8aeb14e tempest-QuotasAdminNegativeTest-220159200 tempest-QuotasAdminNegativeTest-220159200-project] HTTP exception thrown: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 22 20:49:09.597672 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-39dd7fc6-9c25-4a6a-aac5-7c85b8aeb14e tempest-QuotasAdminNegativeTest-220159200 tempest-QuotasAdminNegativeTest-220159200-project] Request method failure captured: Oct 22 20:49:09.597672 ncdv-master-1 devstack@n-api.service[138744]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 22 20:49:09.597672 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 20:49:09.597672 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 20:49:09.597672 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 20:49:09.597672 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 145 Oct 22 20:49:09.597672 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 20:49:09.597672 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 20:49:09.597672 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 20:49:09.597672 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 20:49:09.597672 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVFdBdt_jpp6OlkiUgC6CAOUuG44kuvwlEO6SardfVzcSX3ugb-rcT5pF4VlZcV_TlQ4dG9RYIRE-91qMCgCtQfRrdbrFZ3EPoBQbwtNIOQkJIVaU54gsXpJazF5OpTzC3KBUkjSYd-7sLY0_x53he8hnNEq4UOciMdqN3cpoUSaiS4w Oct 22 20:49:09.597672 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 20:49:09.597672 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 20:49:09.597672 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 20:49:09.597672 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 20:49:09.597672 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 20:49:09.597672 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 20:49:09.597672 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: 164a0764f87b4526a9a4cc7f19117f1f Oct 22 20:49:09.597672 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-QuotasAdminNegativeTest-220159200 Oct 22 20:49:09.597672 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 20:49:09.597672 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 20:49:09.599247 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_164a0764f87b4526a9a4cc7f19117f1f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/164a0764f87b4526a9a4cc7f19117f1f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/164a0764f87b4526a9a4cc7f19117f1f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/164a0764f87b4526a9a4cc7f19117f1f"}]}] Oct 22 20:49:09.599247 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-QuotasAdminNegativeTest-220159200 Oct 22 20:49:09.599247 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: 164a0764f87b4526a9a4cc7f19117f1f Oct 22 20:49:09.599247 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-220159200 Oct 22 20:49:09.599247 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-QuotasAdminNegativeTest-220159200-project Oct 22 20:49:09.599247 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 20:49:09.599247 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 20:49:09.599247 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: 86ff0818a46743dc8f1a0320eb613cf2 Oct 22 20:49:09.599247 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-QuotasAdminNegativeTest-220159200-project Oct 22 20:49:09.599247 ncdv-master-1 devstack@n-api.service[138744]: Oct 22 20:49:09.599247 ncdv-master-1 devstack@n-api.service[138744]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-2085464877", "imageRef": "085e4478-6edc-4a69-8e08-f9831713eb65", "flavorRef": "452"}} Oct 22 20:49:09.599247 ncdv-master-1 devstack@n-api.service[138744]: method: > Oct 22 20:49:09.600191 ncdv-master-1 devstack@n-api.service[138744]: exception: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 22 20:49:09.600191 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-2085464877', 'imageRef': '085e4478-6edc-4a69-8e08-f9831713eb65', 'flavorRef': '452'}}} Oct 22 20:49:09.600191 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:49:09.600191 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:49:09.600191 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Oct 22 20:49:09.600191 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Oct 22 20:49:09.600191 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 22 20:49:09.600191 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 22 20:49:09.600191 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 22 20:49:09.600191 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc Oct 22 20:49:09.600191 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 22 20:49:09.600191 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 22 20:49:09.600191 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 22 20:49:09.600191 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 22 20:49:09.600191 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 22 20:49:09.600191 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 22 20:49:09.600191 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 22 20:49:09.600191 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 22 20:49:09.601383 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Oct 22 20:49:09.601383 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 22 20:49:09.601383 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Oct 22 20:49:09.601383 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:49:09.601383 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:49:09.601383 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:49:09.601383 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:49:09.601383 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 22 20:49:09.601383 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 22 20:49:09.601383 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 22 20:49:09.601383 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 22 20:49:09.601383 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Oct 22 20:49:09.601383 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Oct 22 20:49:09.601383 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Oct 22 20:49:09.601383 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Oct 22 20:49:09.601383 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Oct 22 20:49:09.601383 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 22 20:49:09.601383 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 22 20:49:09.601383 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:49:09.601383 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:49:09.601383 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:49:09.603159 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:49:09.603159 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:49:09.603159 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:49:09.603159 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:49:09.603159 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:49:09.603159 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:49:09.603159 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:49:09.603159 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 20:49:09.603159 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 20:49:09.603159 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 20:49:09.603159 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 20:49:09.603159 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 20:49:09.603159 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 20:49:09.603159 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 22 20:49:09.603159 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 22 20:49:09.603159 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 22 20:49:09.603159 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 22 20:49:09.603159 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:49:09.603159 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:49:09.603159 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:49:09.603159 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:49:09.604639 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:49:09.604639 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:49:09.604639 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 20:49:09.604639 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 20:49:09.604639 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 22 20:49:09.604639 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:49:09.608389 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-39dd7fc6-9c25-4a6a-aac5-7c85b8aeb14e tempest-QuotasAdminNegativeTest-220159200 tempest-QuotasAdminNegativeTest-220159200-project] Returning 403 to user: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:49:09.609386 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-39dd7fc6-9c25-4a6a-aac5-7c85b8aeb14e tempest-QuotasAdminNegativeTest-220159200 tempest-QuotasAdminNegativeTest-220159200-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 403 len: 111 microversion: 2.1 time: 0.924962 Oct 22 20:49:09.610176 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 125/282] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Oct 22 20:49:08 2022] POST /compute/v2.1/servers => generated 111 bytes in 927 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 22 20:49:09.621872 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-c2e7dee7-faa3-4519-866f-f7f2251203da tempest-AggregatesAdminTestJSON-1406494805 tempest-AggregatesAdminTestJSON-1406494805-project-admin] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:49:09.665174 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-c2e7dee7-faa3-4519-866f-f7f2251203da tempest-AggregatesAdminTestJSON-1406494805 tempest-AggregatesAdminTestJSON-1406494805-project-admin] 10.222.0.18 "DELETE /compute/v2.1/os-aggregates/13" status: 200 len: 0 microversion: 2.1 time: 0.046957 Oct 22 20:49:09.666301 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 126/283] 10.222.0.18 () {58 vars in 1155 bytes} [Sat Oct 22 20:49:09 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 0 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 22 20:49:09.680359 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-a98b691b-4ce5-4bf9-a0bc-0c2b58741fd5 tempest-QuotasAdminNegativeTest-1726628264 tempest-QuotasAdminNegativeTest-1726628264-project-admin] Action: 'update', calling method: .version_select at 0x7fd3a4811940>, body: {"quota_set": {"cores": 20}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:49:09.781031 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-604fd9cf-45c4-494a-870e-3094da199efd tempest-AggregatesAdminTestV241-182638173 tempest-AggregatesAdminTestV241-182638173-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates/12/action" status: 200 len: 315 microversion: 2.41 time: 0.249274 Oct 22 20:49:09.781623 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 158/284] 10.222.0.18 () {62 vars in 1235 bytes} [Sat Oct 22 20:49:09 2022] POST /compute/v2.1/os-aggregates/12/action => generated 315 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 22 20:49:09.800137 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-b8701fe0-4241-4589-8c5d-4c17a12e01bf tempest-AggregatesAdminTestJSON-1406494805 tempest-AggregatesAdminTestJSON-1406494805-project-admin] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:49:09.814052 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.wsgi [None req-b8701fe0-4241-4589-8c5d-4c17a12e01bf tempest-AggregatesAdminTestJSON-1406494805 tempest-AggregatesAdminTestJSON-1406494805-project-admin] HTTP exception thrown: Aggregate 13 could not be found. Oct 22 20:49:09.815744 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-b8701fe0-4241-4589-8c5d-4c17a12e01bf tempest-AggregatesAdminTestJSON-1406494805 tempest-AggregatesAdminTestJSON-1406494805-project-admin] Request method failure captured: Oct 22 20:49:09.815744 ncdv-master-1 devstack@n-api.service[138745]: request: GET /compute/v2.1/os-aggregates/13 HTTP/1.1 Oct 22 20:49:09.815744 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 20:49:09.815744 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 20:49:09.815744 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 20:49:09.815744 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 0 Oct 22 20:49:09.815744 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 20:49:09.815744 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 20:49:09.815744 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 20:49:09.815744 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 20:49:09.815744 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVFcT-TF7Ckhvp7jTqOeJ_u5R15cKXcgAABawQ9qTv2GJmaBGBk2_QL0q7Yfssczb8pFALR0xGGk1D1NyWOnMWa2LxulLs9fxMiA7XlkFa82om618ZTRD97RRUxFTIJGnENeG4Xz1kjNB_JKXuGaWKG4h1x_LppACxHgtODj8pIsDTzA Oct 22 20:49:09.815744 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 20:49:09.815744 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 20:49:09.815744 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 20:49:09.815744 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 20:49:09.815744 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 20:49:09.815744 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 20:49:09.815744 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: d985fa03c3084ccd9e9d8302495c3f0e Oct 22 20:49:09.815744 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-AggregatesAdminTestJSON-1406494805 Oct 22 20:49:09.815744 ncdv-master-1 devstack@n-api.service[138745]: X-Role: admin,member,reader Oct 22 20:49:09.815744 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: admin,member,reader Oct 22 20:49:09.817560 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_d985fa03c3084ccd9e9d8302495c3f0e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d985fa03c3084ccd9e9d8302495c3f0e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/d985fa03c3084ccd9e9d8302495c3f0e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d985fa03c3084ccd9e9d8302495c3f0e"}]}] Oct 22 20:49:09.817560 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-AggregatesAdminTestJSON-1406494805 Oct 22 20:49:09.817560 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: d985fa03c3084ccd9e9d8302495c3f0e Oct 22 20:49:09.817560 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1406494805 Oct 22 20:49:09.817560 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-AggregatesAdminTestJSON-1406494805-project-admin Oct 22 20:49:09.817560 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 20:49:09.817560 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 20:49:09.817560 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: c0687fb0bd424d8fa0d9a6e524ff221e Oct 22 20:49:09.817560 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-AggregatesAdminTestJSON-1406494805-project-admin Oct 22 20:49:09.817560 ncdv-master-1 devstack@n-api.service[138745]: method: > Oct 22 20:49:09.817560 ncdv-master-1 devstack@n-api.service[138745]: exception: Aggregate 13 could not be found. Oct 22 20:49:09.817560 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'id': '13'} Oct 22 20:49:09.817560 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:49:09.818830 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:49:09.818830 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Oct 22 20:49:09.818830 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Oct 22 20:49:09.818830 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Oct 22 20:49:09.818830 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Oct 22 20:49:09.818830 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 22 20:49:09.818830 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 22 20:49:09.818830 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 22 20:49:09.818830 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 22 20:49:09.818830 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 22 20:49:09.818830 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 22 20:49:09.818830 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 22 20:49:09.818830 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 22 20:49:09.818830 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 13 could not be found. Oct 22 20:49:09.818830 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:49:09.818830 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:49:09.818830 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:49:09.818830 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:49:09.818830 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:49:09.819901 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:49:09.819901 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:49:09.819901 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:49:09.819901 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:49:09.819901 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:49:09.819901 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Oct 22 20:49:09.819901 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 20:49:09.819901 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 13 could not be found. Oct 22 20:49:09.819901 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:49:09.819901 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:49:09.819901 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:49:09.819901 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:49:09.819901 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:49:09.819901 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:49:09.819901 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 20:49:09.819901 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 20:49:09.819901 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 13 could not be found. Oct 22 20:49:09.819901 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:49:09.821629 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-b8701fe0-4241-4589-8c5d-4c17a12e01bf tempest-AggregatesAdminTestJSON-1406494805 tempest-AggregatesAdminTestJSON-1406494805-project-admin] Returning 404 to user: Aggregate 13 could not be found. {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:49:09.821629 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-b8701fe0-4241-4589-8c5d-4c17a12e01bf tempest-AggregatesAdminTestJSON-1406494805 tempest-AggregatesAdminTestJSON-1406494805-project-admin] 10.222.0.18 "GET /compute/v2.1/os-aggregates/13" status: 404 len: 78 microversion: 2.1 time: 0.027223 Oct 22 20:49:09.821629 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 159/285] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Oct 22 20:49:09 2022] GET /compute/v2.1/os-aggregates/13 => generated 78 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 22 20:49:09.828461 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-64cafb20-8fe7-45dc-bed8-ef9f6e828e43 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:49:09.829308 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-64cafb20-8fe7-45dc-bed8-ef9f6e828e43 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] [instance: 96add0b3-b82f-4a0a-bec3-9a6341ae5dec] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:49:09.836924 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-64cafb20-8fe7-45dc-bed8-ef9f6e828e43 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:09.837312 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-64cafb20-8fe7-45dc-bed8-ef9f6e828e43 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:09.838212 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-64cafb20-8fe7-45dc-bed8-ef9f6e828e43 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:09.838461 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-64cafb20-8fe7-45dc-bed8-ef9f6e828e43 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:09.838912 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-64cafb20-8fe7-45dc-bed8-ef9f6e828e43 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:09.839396 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-64cafb20-8fe7-45dc-bed8-ef9f6e828e43 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:09.893025 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a98b691b-4ce5-4bf9-a0bc-0c2b58741fd5 tempest-QuotasAdminNegativeTest-1726628264 tempest-QuotasAdminNegativeTest-1726628264-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:09.893811 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a98b691b-4ce5-4bf9-a0bc-0c2b58741fd5 tempest-QuotasAdminNegativeTest-1726628264 tempest-QuotasAdminNegativeTest-1726628264-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:09.894577 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a98b691b-4ce5-4bf9-a0bc-0c2b58741fd5 tempest-QuotasAdminNegativeTest-1726628264 tempest-QuotasAdminNegativeTest-1726628264-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:09.895785 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a98b691b-4ce5-4bf9-a0bc-0c2b58741fd5 tempest-QuotasAdminNegativeTest-1726628264 tempest-QuotasAdminNegativeTest-1726628264-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:09.896419 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a98b691b-4ce5-4bf9-a0bc-0c2b58741fd5 tempest-QuotasAdminNegativeTest-1726628264 tempest-QuotasAdminNegativeTest-1726628264-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:09.897009 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a98b691b-4ce5-4bf9-a0bc-0c2b58741fd5 tempest-QuotasAdminNegativeTest-1726628264 tempest-QuotasAdminNegativeTest-1726628264-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:10.000224 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-a98b691b-4ce5-4bf9-a0bc-0c2b58741fd5 tempest-QuotasAdminNegativeTest-1726628264 tempest-QuotasAdminNegativeTest-1726628264-project-admin] 10.222.0.18 "PUT /compute/v2.1/os-quota-sets/164a0764f87b4526a9a4cc7f19117f1f" status: 200 len: 329 microversion: 2.1 time: 0.330813 Oct 22 20:49:10.008980 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 127/286] 10.222.0.18 () {60 vars in 1262 bytes} [Sat Oct 22 20:49:09 2022] PUT /compute/v2.1/os-quota-sets/164a0764f87b4526a9a4cc7f19117f1f => generated 329 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:49:10.008980 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-2b78f0b3-1a55-438e-b7c6-dfab94224f8c tempest-AggregatesAdminTestV241-182638173 tempest-AggregatesAdminTestV241-182638173-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch2-master-1"}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:49:10.034624 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2b78f0b3-1a55-438e-b7c6-dfab94224f8c tempest-AggregatesAdminTestV241-182638173 tempest-AggregatesAdminTestV241-182638173-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:10.035808 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2b78f0b3-1a55-438e-b7c6-dfab94224f8c tempest-AggregatesAdminTestV241-182638173 tempest-AggregatesAdminTestV241-182638173-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:10.036833 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2b78f0b3-1a55-438e-b7c6-dfab94224f8c tempest-AggregatesAdminTestV241-182638173 tempest-AggregatesAdminTestV241-182638173-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:10.238318 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-2b78f0b3-1a55-438e-b7c6-dfab94224f8c tempest-AggregatesAdminTestV241-182638173 tempest-AggregatesAdminTestV241-182638173-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates/12/action" status: 200 len: 300 microversion: 2.41 time: 0.234332 Oct 22 20:49:10.240541 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 128/287] 10.222.0.18 () {62 vars in 1235 bytes} [Sat Oct 22 20:49:10 2022] POST /compute/v2.1/os-aggregates/12/action => generated 300 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 22 20:49:10.254568 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-6e0ad090-cbf6-43b1-9b97-a673a39fda30 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:49:10.255273 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-6e0ad090-cbf6-43b1-9b97-a673a39fda30 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] [instance: 5c3de24c-090d-4769-8975-207eb939b979] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:49:10.270650 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6e0ad090-cbf6-43b1-9b97-a673a39fda30 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:10.271065 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6e0ad090-cbf6-43b1-9b97-a673a39fda30 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:10.271843 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6e0ad090-cbf6-43b1-9b97-a673a39fda30 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:10.272764 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6e0ad090-cbf6-43b1-9b97-a673a39fda30 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:10.275170 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6e0ad090-cbf6-43b1-9b97-a673a39fda30 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:10.275812 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6e0ad090-cbf6-43b1-9b97-a673a39fda30 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:10.334996 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-64cafb20-8fe7-45dc-bed8-ef9f6e828e43 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e13dcabaaa4b218945aeeabb4c902e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675a324f0134844a1964f64322493ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:49:10.343571 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-64cafb20-8fe7-45dc-bed8-ef9f6e828e43 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] 10.222.0.18 "GET /compute/v2.1/servers/96add0b3-b82f-4a0a-bec3-9a6341ae5dec" status: 200 len: 1320 microversion: 2.1 time: 0.524297 Oct 22 20:49:10.345830 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 160/288] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:49:09 2022] GET /compute/v2.1/servers/96add0b3-b82f-4a0a-bec3-9a6341ae5dec => generated 1320 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:49:10.383285 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-eb250499-1a5c-4309-b184-09bbb408911d tempest-AggregatesAdminTestJSON-1406494805 tempest-AggregatesAdminTestJSON-1406494805-project-admin] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:49:10.396174 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.wsgi [None req-eb250499-1a5c-4309-b184-09bbb408911d tempest-AggregatesAdminTestJSON-1406494805 tempest-AggregatesAdminTestJSON-1406494805-project-admin] HTTP exception thrown: Aggregate 13 could not be found. Oct 22 20:49:10.398969 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-eb250499-1a5c-4309-b184-09bbb408911d tempest-AggregatesAdminTestJSON-1406494805 tempest-AggregatesAdminTestJSON-1406494805-project-admin] Request method failure captured: Oct 22 20:49:10.398969 ncdv-master-1 devstack@n-api.service[138745]: request: DELETE /compute/v2.1/os-aggregates/13 HTTP/1.1 Oct 22 20:49:10.398969 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 20:49:10.398969 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 20:49:10.398969 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 20:49:10.398969 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 0 Oct 22 20:49:10.398969 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 20:49:10.398969 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 20:49:10.398969 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 20:49:10.398969 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 20:49:10.398969 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVFcT-TF7Ckhvp7jTqOeJ_u5R15cKXcgAABawQ9qTv2GJmaBGBk2_QL0q7Yfssczb8pFALR0xGGk1D1NyWOnMWa2LxulLs9fxMiA7XlkFa82om618ZTRD97RRUxFTIJGnENeG4Xz1kjNB_JKXuGaWKG4h1x_LppACxHgtODj8pIsDTzA Oct 22 20:49:10.398969 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 20:49:10.398969 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 20:49:10.398969 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 20:49:10.398969 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 20:49:10.398969 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 20:49:10.398969 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 20:49:10.398969 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: d985fa03c3084ccd9e9d8302495c3f0e Oct 22 20:49:10.398969 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-AggregatesAdminTestJSON-1406494805 Oct 22 20:49:10.398969 ncdv-master-1 devstack@n-api.service[138745]: X-Role: admin,member,reader Oct 22 20:49:10.398969 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: admin,member,reader Oct 22 20:49:10.400409 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_d985fa03c3084ccd9e9d8302495c3f0e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d985fa03c3084ccd9e9d8302495c3f0e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/d985fa03c3084ccd9e9d8302495c3f0e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d985fa03c3084ccd9e9d8302495c3f0e"}]}] Oct 22 20:49:10.400409 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-AggregatesAdminTestJSON-1406494805 Oct 22 20:49:10.400409 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: d985fa03c3084ccd9e9d8302495c3f0e Oct 22 20:49:10.400409 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1406494805 Oct 22 20:49:10.400409 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-AggregatesAdminTestJSON-1406494805-project-admin Oct 22 20:49:10.400409 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 20:49:10.400409 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 20:49:10.400409 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: c0687fb0bd424d8fa0d9a6e524ff221e Oct 22 20:49:10.400409 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-AggregatesAdminTestJSON-1406494805-project-admin Oct 22 20:49:10.400409 ncdv-master-1 devstack@n-api.service[138745]: method: > Oct 22 20:49:10.400409 ncdv-master-1 devstack@n-api.service[138745]: exception: Aggregate 13 could not be found. Oct 22 20:49:10.400409 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'id': '13'} Oct 22 20:49:10.400409 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:49:10.401283 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:49:10.401283 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Oct 22 20:49:10.401283 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Oct 22 20:49:10.401283 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 22 20:49:10.401283 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 22 20:49:10.401283 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 22 20:49:10.401283 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 22 20:49:10.401283 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 22 20:49:10.401283 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise self.value Oct 22 20:49:10.401283 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 22 20:49:10.401283 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 22 20:49:10.401283 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Oct 22 20:49:10.401283 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Oct 22 20:49:10.401283 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 22 20:49:10.401283 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 22 20:49:10.401283 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 22 20:49:10.401283 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 22 20:49:10.401283 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 22 20:49:10.401283 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 22 20:49:10.402353 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 22 20:49:10.402353 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 22 20:49:10.402353 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 13 could not be found. Oct 22 20:49:10.402353 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:49:10.402353 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:49:10.402353 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:49:10.402353 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:49:10.402353 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:49:10.402353 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:49:10.402353 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:49:10.402353 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:49:10.402353 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:49:10.402353 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:49:10.402353 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Oct 22 20:49:10.402353 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 20:49:10.402353 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 13 could not be found. Oct 22 20:49:10.402353 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:49:10.402353 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:49:10.402353 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:49:10.402353 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:49:10.402353 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:49:10.403885 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:49:10.403885 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 20:49:10.403885 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 20:49:10.403885 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 13 could not be found. Oct 22 20:49:10.403885 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:49:10.405322 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-eb250499-1a5c-4309-b184-09bbb408911d tempest-AggregatesAdminTestJSON-1406494805 tempest-AggregatesAdminTestJSON-1406494805-project-admin] Returning 404 to user: Aggregate 13 could not be found. {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:49:10.414291 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-eb250499-1a5c-4309-b184-09bbb408911d tempest-AggregatesAdminTestJSON-1406494805 tempest-AggregatesAdminTestJSON-1406494805-project-admin] 10.222.0.18 "DELETE /compute/v2.1/os-aggregates/13" status: 404 len: 78 microversion: 2.1 time: 0.035630 Oct 22 20:49:10.415408 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 161/289] 10.222.0.18 () {58 vars in 1155 bytes} [Sat Oct 22 20:49:10 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 78 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 22 20:49:10.423025 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-6622a9ea-2b72-460b-8202-84df86579904 tempest-QuotasAdminNegativeTest-1726628264 tempest-QuotasAdminNegativeTest-1726628264-project-admin] Calling method '.version_select at 0x7fd3a4a18940>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:49:10.522505 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-6e0ad090-cbf6-43b1-9b97-a673a39fda30 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1ce98c66024d49b31e8e4f38b82838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a20f8f858424c89bf67a56feb720ac9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:49:10.546775 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-6e0ad090-cbf6-43b1-9b97-a673a39fda30 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed1ce98c66024d49b31e8e4f38b82838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a20f8f858424c89bf67a56feb720ac9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:49:10.549513 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-6e0ad090-cbf6-43b1-9b97-a673a39fda30 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed1ce98c66024d49b31e8e4f38b82838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a20f8f858424c89bf67a56feb720ac9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:49:10.556048 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-6e0ad090-cbf6-43b1-9b97-a673a39fda30 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] 10.222.0.18 "GET /compute/v2.1/servers/5c3de24c-090d-4769-8975-207eb939b979" status: 200 len: 1446 microversion: 2.75 time: 0.314098 Oct 22 20:49:10.557339 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 129/290] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 20:49:10 2022] GET /compute/v2.1/servers/5c3de24c-090d-4769-8975-207eb939b979 => generated 1446 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 20:49:10.562577 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-77daeeb8-8c28-4de2-aecc-8440fed41dfc tempest-AggregatesAdminTestV241-182638173 tempest-AggregatesAdminTestV241-182638173-project-admin] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:49:10.588127 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-6622a9ea-2b72-460b-8202-84df86579904 tempest-QuotasAdminNegativeTest-1726628264 tempest-QuotasAdminNegativeTest-1726628264-project-admin] 10.222.0.18 "GET /compute/v2.1/os-quota-sets/164a0764f87b4526a9a4cc7f19117f1f" status: 200 len: 371 microversion: 2.1 time: 0.171316 Oct 22 20:49:10.596125 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 162/291] 10.222.0.18 () {58 vars in 1242 bytes} [Sat Oct 22 20:49:10 2022] GET /compute/v2.1/os-quota-sets/164a0764f87b4526a9a4cc7f19117f1f => generated 371 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:49:10.603201 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-7610c0f3-03c1-46ff-a655-90f4b546ef81 tempest-AggregatesAdminTestJSON-1406494805 tempest-AggregatesAdminTestJSON-1406494805-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1851877217"}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:49:10.613452 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.objects.aggregate [None req-7610c0f3-03c1-46ff-a655-90f4b546ef81 tempest-AggregatesAdminTestJSON-1406494805 tempest-AggregatesAdminTestJSON-1406494805-project-admin] Generated uuid 4b2c8881-bfd5-42f7-8a89-aff11ece4190 for aggregate {{(pid=138745) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 22 20:49:10.616204 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-77daeeb8-8c28-4de2-aecc-8440fed41dfc tempest-AggregatesAdminTestV241-182638173 tempest-AggregatesAdminTestV241-182638173-project-admin] 10.222.0.18 "DELETE /compute/v2.1/os-aggregates/12" status: 200 len: 0 microversion: 2.41 time: 0.057313 Oct 22 20:49:10.619577 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 130/292] 10.222.0.18 () {60 vars in 1196 bytes} [Sat Oct 22 20:49:10 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 0 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:49:10.635058 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-7e3fc9e8-0531-4017-95c4-c45edc3225bf tempest-QuotasAdminNegativeTest-1726628264 tempest-QuotasAdminNegativeTest-1726628264-project-admin] Action: 'update', calling method: .version_select at 0x7fd3a48510d0>, body: {"quota_set": {"force": true, "instances": 0}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:49:10.670311 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-7610c0f3-03c1-46ff-a655-90f4b546ef81 tempest-AggregatesAdminTestJSON-1406494805 tempest-AggregatesAdminTestJSON-1406494805-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.077965 Oct 22 20:49:10.671000 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 163/293] 10.222.0.18 () {60 vars in 1164 bytes} [Sat Oct 22 20:49:10 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:49:10.684076 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-7fc8115a-1c35-4951-a0a7-02671c3fbe8d tempest-AggregatesAdminTestJSON-1406494805 tempest-AggregatesAdminTestJSON-1406494805-project-admin] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:49:10.717152 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-7fc8115a-1c35-4951-a0a7-02671c3fbe8d tempest-AggregatesAdminTestJSON-1406494805 tempest-AggregatesAdminTestJSON-1406494805-project-admin] 10.222.0.18 "GET /compute/v2.1/os-aggregates/14" status: 200 len: 228 microversion: 2.1 time: 0.034944 Oct 22 20:49:10.719100 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 164/294] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Oct 22 20:49:10 2022] GET /compute/v2.1/os-aggregates/14 => generated 228 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:49:10.730858 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-65ff4505-a878-4ffa-8085-edb43584c47b tempest-AggregatesAdminNegativeTestJSON-1306123093 tempest-AggregatesAdminNegativeTestJSON-1306123093-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-831152226"}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:49:10.744783 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.objects.aggregate [None req-65ff4505-a878-4ffa-8085-edb43584c47b tempest-AggregatesAdminNegativeTestJSON-1306123093 tempest-AggregatesAdminNegativeTestJSON-1306123093-project-admin] Generated uuid 9e77bc01-e414-40cf-98a3-976207611b92 for aggregate {{(pid=138745) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 22 20:49:10.776677 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7e3fc9e8-0531-4017-95c4-c45edc3225bf tempest-QuotasAdminNegativeTest-1726628264 tempest-QuotasAdminNegativeTest-1726628264-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:10.778423 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7e3fc9e8-0531-4017-95c4-c45edc3225bf tempest-QuotasAdminNegativeTest-1726628264 tempest-QuotasAdminNegativeTest-1726628264-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:10.780106 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7e3fc9e8-0531-4017-95c4-c45edc3225bf tempest-QuotasAdminNegativeTest-1726628264 tempest-QuotasAdminNegativeTest-1726628264-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:10.783367 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7e3fc9e8-0531-4017-95c4-c45edc3225bf tempest-QuotasAdminNegativeTest-1726628264 tempest-QuotasAdminNegativeTest-1726628264-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:10.785285 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7e3fc9e8-0531-4017-95c4-c45edc3225bf tempest-QuotasAdminNegativeTest-1726628264 tempest-QuotasAdminNegativeTest-1726628264-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:10.787718 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7e3fc9e8-0531-4017-95c4-c45edc3225bf tempest-QuotasAdminNegativeTest-1726628264 tempest-QuotasAdminNegativeTest-1726628264-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:10.820382 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-65ff4505-a878-4ffa-8085-edb43584c47b tempest-AggregatesAdminNegativeTestJSON-1306123093 tempest-AggregatesAdminNegativeTestJSON-1306123093-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.097604 Oct 22 20:49:10.824474 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 165/295] 10.222.0.18 () {60 vars in 1164 bytes} [Sat Oct 22 20:49:10 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:49:10.838750 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-a0ebfbdd-6220-447a-8966-c28ce0960ef5 tempest-AggregatesAdminTestJSON-1406494805 tempest-AggregatesAdminTestJSON-1406494805-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"key": "value"}}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:49:10.903654 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-a0ebfbdd-6220-447a-8966-c28ce0960ef5 tempest-AggregatesAdminTestJSON-1406494805 tempest-AggregatesAdminTestJSON-1406494805-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates/14/action" status: 200 len: 266 microversion: 2.1 time: 0.072268 Oct 22 20:49:10.915290 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 166/296] 10.222.0.18 () {60 vars in 1194 bytes} [Sat Oct 22 20:49:10 2022] POST /compute/v2.1/os-aggregates/14/action => generated 266 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:49:10.917898 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-62ff3a59-12d5-42b0-b1f5-f5a47de20000 tempest-AggregatesAdminNegativeTestJSON-1306123093 tempest-AggregatesAdminNegativeTestJSON-1306123093-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch2-master-1"}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:49:10.951503 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-62ff3a59-12d5-42b0-b1f5-f5a47de20000 tempest-AggregatesAdminNegativeTestJSON-1306123093 tempest-AggregatesAdminNegativeTestJSON-1306123093-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:10.952007 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-62ff3a59-12d5-42b0-b1f5-f5a47de20000 tempest-AggregatesAdminNegativeTestJSON-1306123093 tempest-AggregatesAdminNegativeTestJSON-1306123093-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:10.952456 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-62ff3a59-12d5-42b0-b1f5-f5a47de20000 tempest-AggregatesAdminNegativeTestJSON-1306123093 tempest-AggregatesAdminNegativeTestJSON-1306123093-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:10.958248 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-7e3fc9e8-0531-4017-95c4-c45edc3225bf tempest-QuotasAdminNegativeTest-1726628264 tempest-QuotasAdminNegativeTest-1726628264-project-admin] 10.222.0.18 "PUT /compute/v2.1/os-quota-sets/164a0764f87b4526a9a4cc7f19117f1f" status: 200 len: 328 microversion: 2.1 time: 0.336270 Oct 22 20:49:10.994047 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 131/297] 10.222.0.18 () {60 vars in 1262 bytes} [Sat Oct 22 20:49:10 2022] PUT /compute/v2.1/os-quota-sets/164a0764f87b4526a9a4cc7f19117f1f => generated 328 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:49:11.016283 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-1a19151c-4bfb-4360-8044-ee8f4adb4594 tempest-AggregatesAdminTestJSON-1406494805 tempest-AggregatesAdminTestJSON-1406494805-project-admin] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:49:11.058714 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-1a19151c-4bfb-4360-8044-ee8f4adb4594 tempest-AggregatesAdminTestJSON-1406494805 tempest-AggregatesAdminTestJSON-1406494805-project-admin] 10.222.0.18 "GET /compute/v2.1/os-aggregates/14" status: 200 len: 242 microversion: 2.1 time: 0.061570 Oct 22 20:49:11.069969 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 132/298] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Oct 22 20:49:10 2022] GET /compute/v2.1/os-aggregates/14 => generated 242 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:49:11.089333 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-a8e4365e-eee0-4462-ad63-039efe736098 tempest-AggregatesAdminTestJSON-1406494805 tempest-AggregatesAdminTestJSON-1406494805-project-admin] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:49:11.146414 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-a8e4365e-eee0-4462-ad63-039efe736098 tempest-AggregatesAdminTestJSON-1406494805 tempest-AggregatesAdminTestJSON-1406494805-project-admin] 10.222.0.18 "DELETE /compute/v2.1/os-aggregates/14" status: 200 len: 0 microversion: 2.1 time: 0.075135 Oct 22 20:49:11.150985 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 133/299] 10.222.0.18 () {58 vars in 1155 bytes} [Sat Oct 22 20:49:11 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 0 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 22 20:49:11.154609 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-87804604-99f7-480c-8d06-a18f19a3f3a0 tempest-QuotasAdminNegativeTest-220159200 tempest-QuotasAdminNegativeTest-220159200-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-485130220", "imageRef": "085e4478-6edc-4a69-8e08-f9831713eb65", "flavorRef": "452"}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:49:11.266209 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-62ff3a59-12d5-42b0-b1f5-f5a47de20000 tempest-AggregatesAdminNegativeTestJSON-1306123093 tempest-AggregatesAdminNegativeTestJSON-1306123093-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates/15/action" status: 200 len: 242 microversion: 2.1 time: 0.355310 Oct 22 20:49:11.267035 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 167/300] 10.222.0.18 () {60 vars in 1194 bytes} [Sat Oct 22 20:49:10 2022] POST /compute/v2.1/os-aggregates/15/action => generated 242 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:49:11.279096 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-7ff46bfd-290f-4123-b162-23f9ab5ffd88 tempest-AggregatesAdminTestJSON-1406494805 tempest-AggregatesAdminTestJSON-1406494805-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-390720202", "availability_zone": "tempest-test_az-351277030"}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:49:11.291961 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.objects.aggregate [None req-7ff46bfd-290f-4123-b162-23f9ab5ffd88 tempest-AggregatesAdminTestJSON-1406494805 tempest-AggregatesAdminTestJSON-1406494805-project-admin] Generated uuid 7684e748-fdd7-4a9f-bc15-f69f82325753 for aggregate {{(pid=138745) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 22 20:49:11.325696 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.network.neutron [None req-87804604-99f7-480c-8d06-a18f19a3f3a0 tempest-QuotasAdminNegativeTest-220159200 tempest-QuotasAdminNegativeTest-220159200-project] validate_networks() for None {{(pid=138744) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 20:49:11.359515 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-7ff46bfd-290f-4123-b162-23f9ab5ffd88 tempest-AggregatesAdminTestJSON-1406494805 tempest-AggregatesAdminTestJSON-1406494805-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates" status: 200 len: 221 microversion: 2.1 time: 0.090881 Oct 22 20:49:11.366771 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 168/301] 10.222.0.18 () {60 vars in 1165 bytes} [Sat Oct 22 20:49:11 2022] POST /compute/v2.1/os-aggregates => generated 221 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:49:11.368486 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-4449ca40-c529-449d-8979-e03a08d636ff tempest-AggregatesAdminNegativeTestJSON-128164911 tempest-AggregatesAdminNegativeTestJSON-128164911-project] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch2-master-1"}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:49:11.376900 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-4449ca40-c529-449d-8979-e03a08d636ff tempest-AggregatesAdminNegativeTestJSON-128164911 tempest-AggregatesAdminNegativeTestJSON-128164911-project] Policy check for os_compute_api:os-aggregates:remove_host failed with credentials {'is_admin': False, 'user_id': 'd268c9e02ce649be9e9b2944ce652160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8775b596d1be4555a770625018c0499d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:49:11.380943 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-4449ca40-c529-449d-8979-e03a08d636ff tempest-AggregatesAdminNegativeTestJSON-128164911 tempest-AggregatesAdminNegativeTestJSON-128164911-project] Request method failure captured: Oct 22 20:49:11.380943 ncdv-master-1 devstack@n-api.service[138745]: request: POST /compute/v2.1/os-aggregates/15/action HTTP/1.1 Oct 22 20:49:11.380943 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 20:49:11.380943 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 20:49:11.380943 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 20:49:11.380943 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 42 Oct 22 20:49:11.380943 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 20:49:11.380943 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 20:49:11.380943 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 20:49:11.380943 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 20:49:11.380943 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVFcRNCPvpyUh9tHTp84IOcCCKBZNW74xRyRc1HMyEY1AnMcIwFdyL4E6RhA9OOpDiPUeN_gcx_nuT_6fY_gFdGSihdKqmRwLPQ8Oe91nL_sbgLbf1YwTco9wIZIplHXz7tJYgFaO8QTnHGpSZR6jcZWLP2WrqHwbI-Dty0oLrpE3PKI Oct 22 20:49:11.380943 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 20:49:11.380943 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 20:49:11.380943 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 20:49:11.380943 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 20:49:11.380943 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 20:49:11.380943 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 20:49:11.380943 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: 8775b596d1be4555a770625018c0499d Oct 22 20:49:11.380943 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-128164911 Oct 22 20:49:11.380943 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 20:49:11.380943 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 20:49:11.382403 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_8775b596d1be4555a770625018c0499d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8775b596d1be4555a770625018c0499d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/8775b596d1be4555a770625018c0499d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8775b596d1be4555a770625018c0499d"}]}] Oct 22 20:49:11.382403 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-128164911 Oct 22 20:49:11.382403 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: 8775b596d1be4555a770625018c0499d Oct 22 20:49:11.382403 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-128164911 Oct 22 20:49:11.382403 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-AggregatesAdminNegativeTestJSON-128164911-project Oct 22 20:49:11.382403 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 20:49:11.382403 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 20:49:11.382403 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: d268c9e02ce649be9e9b2944ce652160 Oct 22 20:49:11.382403 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-128164911-project Oct 22 20:49:11.382403 ncdv-master-1 devstack@n-api.service[138745]: Oct 22 20:49:11.382403 ncdv-master-1 devstack@n-api.service[138745]: {"remove_host": {"host": "nch2-master-1"}} Oct 22 20:49:11.382403 ncdv-master-1 devstack@n-api.service[138745]: method: > Oct 22 20:49:11.382403 ncdv-master-1 devstack@n-api.service[138745]: exception: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Oct 22 20:49:11.384440 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'id': '15', 'body': {'remove_host': {'host': 'nch2-master-1'}}} Oct 22 20:49:11.384440 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:49:11.384440 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:49:11.384440 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:49:11.384440 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:49:11.384440 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:49:11.384440 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:49:11.384440 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:49:11.384440 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:49:11.384440 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 20:49:11.384440 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 20:49:11.384440 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 201, in _remove_host Oct 22 20:49:11.384440 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'remove_host', target={}) Oct 22 20:49:11.384440 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 22 20:49:11.384440 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 22 20:49:11.384440 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 22 20:49:11.384440 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 22 20:49:11.384440 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 22 20:49:11.384440 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 22 20:49:11.385442 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 22 20:49:11.385442 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise self.value Oct 22 20:49:11.385442 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 22 20:49:11.385442 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 22 20:49:11.385442 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 22 20:49:11.385442 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 22 20:49:11.385442 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 22 20:49:11.385442 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 22 20:49:11.385442 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Oct 22 20:49:11.385442 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:49:11.385442 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:49:11.385442 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:49:11.385442 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:49:11.385442 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:49:11.385442 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:49:11.385442 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 22 20:49:11.385442 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 22 20:49:11.385442 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Oct 22 20:49:11.385442 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:49:11.386428 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-4449ca40-c529-449d-8979-e03a08d636ff tempest-AggregatesAdminNegativeTestJSON-128164911 tempest-AggregatesAdminNegativeTestJSON-128164911-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:49:11.386428 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-4449ca40-c529-449d-8979-e03a08d636ff tempest-AggregatesAdminNegativeTestJSON-128164911 tempest-AggregatesAdminNegativeTestJSON-128164911-project] 10.222.0.18 "POST /compute/v2.1/os-aggregates/15/action" status: 403 len: 121 microversion: 2.1 time: 0.021414 Oct 22 20:49:11.386428 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 169/302] 10.222.0.18 () {60 vars in 1194 bytes} [Sat Oct 22 20:49:11 2022] POST /compute/v2.1/os-aggregates/15/action => generated 121 bytes in 24 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 22 20:49:11.417589 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-0aa41580-fa0d-4c03-a187-6a9b05528fc7 req-8d6177c8-ebbb-4d64-97c5-2fbcd41c0bdf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96add0b3-b82f-4a0a-bec3-9a6341ae5dec", "tag": "0fd2316a-3787-46da-84c3-1064f9a62d40"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:49:11.431369 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-0aa41580-fa0d-4c03-a187-6a9b05528fc7 req-8d6177c8-ebbb-4d64-97c5-2fbcd41c0bdf service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:11.431875 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-0aa41580-fa0d-4c03-a187-6a9b05528fc7 req-8d6177c8-ebbb-4d64-97c5-2fbcd41c0bdf service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:11.432511 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-0aa41580-fa0d-4c03-a187-6a9b05528fc7 req-8d6177c8-ebbb-4d64-97c5-2fbcd41c0bdf service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:11.444778 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-0aa41580-fa0d-4c03-a187-6a9b05528fc7 req-8d6177c8-ebbb-4d64-97c5-2fbcd41c0bdf service nova] Creating event network-changed:0fd2316a-3787-46da-84c3-1064f9a62d40 for instance 96add0b3-b82f-4a0a-bec3-9a6341ae5dec on nch2-master-1 Oct 22 20:49:11.451825 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-0aa41580-fa0d-4c03-a187-6a9b05528fc7 req-8d6177c8-ebbb-4d64-97c5-2fbcd41c0bdf service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055003 Oct 22 20:49:11.453278 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 170/303] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:49:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:49:11.460396 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-40c85b7f-2493-42b0-b791-11c32d37d3ec tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:49:11.461464 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-40c85b7f-2493-42b0-b791-11c32d37d3ec tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] [instance: 96add0b3-b82f-4a0a-bec3-9a6341ae5dec] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:49:11.468603 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-40c85b7f-2493-42b0-b791-11c32d37d3ec tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:11.469083 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-40c85b7f-2493-42b0-b791-11c32d37d3ec tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:11.469650 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-40c85b7f-2493-42b0-b791-11c32d37d3ec tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:11.470276 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-40c85b7f-2493-42b0-b791-11c32d37d3ec tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:11.470641 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-40c85b7f-2493-42b0-b791-11c32d37d3ec tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:11.471072 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-40c85b7f-2493-42b0-b791-11c32d37d3ec tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:12.183048 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-40c85b7f-2493-42b0-b791-11c32d37d3ec tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e13dcabaaa4b218945aeeabb4c902e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675a324f0134844a1964f64322493ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:49:12.201745 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-40c85b7f-2493-42b0-b791-11c32d37d3ec tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] 10.222.0.18 "GET /compute/v2.1/servers/96add0b3-b82f-4a0a-bec3-9a6341ae5dec" status: 200 len: 1320 microversion: 2.1 time: 0.747053 Oct 22 20:49:12.209091 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-87804604-99f7-480c-8d06-a18f19a3f3a0 tempest-QuotasAdminNegativeTest-220159200 tempest-QuotasAdminNegativeTest-220159200-project] Flavor limits 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 20:49:12.210258 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-87804604-99f7-480c-8d06-a18f19a3f3a0 tempest-QuotasAdminNegativeTest-220159200 tempest-QuotasAdminNegativeTest-220159200-project] Image limits 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 20:49:12.210925 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-87804604-99f7-480c-8d06-a18f19a3f3a0 tempest-QuotasAdminNegativeTest-220159200 tempest-QuotasAdminNegativeTest-220159200-project] Flavor pref 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 20:49:12.211521 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-87804604-99f7-480c-8d06-a18f19a3f3a0 tempest-QuotasAdminNegativeTest-220159200 tempest-QuotasAdminNegativeTest-220159200-project] Image pref 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 20:49:12.212088 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-87804604-99f7-480c-8d06-a18f19a3f3a0 tempest-QuotasAdminNegativeTest-220159200 tempest-QuotasAdminNegativeTest-220159200-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 20:49:12.214541 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 171/304] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:49:11 2022] GET /compute/v2.1/servers/96add0b3-b82f-4a0a-bec3-9a6341ae5dec => generated 1320 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:49:12.233313 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-5296e39d-441c-47eb-a050-54f97de86b06 tempest-AggregatesAdminTestJSON-1406494805 tempest-AggregatesAdminTestJSON-1406494805-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-390720202_new", "availability_zone": "tempest-test_az-351277030_new"}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:49:12.240255 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-87804604-99f7-480c-8d06-a18f19a3f3a0 tempest-QuotasAdminNegativeTest-220159200 tempest-QuotasAdminNegativeTest-220159200-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:12.240793 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-87804604-99f7-480c-8d06-a18f19a3f3a0 tempest-QuotasAdminNegativeTest-220159200 tempest-QuotasAdminNegativeTest-220159200-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:12.241242 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-87804604-99f7-480c-8d06-a18f19a3f3a0 tempest-QuotasAdminNegativeTest-220159200 tempest-QuotasAdminNegativeTest-220159200-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:12.242017 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-87804604-99f7-480c-8d06-a18f19a3f3a0 tempest-QuotasAdminNegativeTest-220159200 tempest-QuotasAdminNegativeTest-220159200-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:12.242478 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-87804604-99f7-480c-8d06-a18f19a3f3a0 tempest-QuotasAdminNegativeTest-220159200 tempest-QuotasAdminNegativeTest-220159200-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:12.242908 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-87804604-99f7-480c-8d06-a18f19a3f3a0 tempest-QuotasAdminNegativeTest-220159200 tempest-QuotasAdminNegativeTest-220159200-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:12.283100 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-87804604-99f7-480c-8d06-a18f19a3f3a0 tempest-QuotasAdminNegativeTest-220159200 tempest-QuotasAdminNegativeTest-220159200-project] Getting quotas for project 164a0764f87b4526a9a4cc7f19117f1f. Resources: {'cores', 'instances', 'ram'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 20:49:12.302048 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-87804604-99f7-480c-8d06-a18f19a3f3a0 tempest-QuotasAdminNegativeTest-220159200 tempest-QuotasAdminNegativeTest-220159200-project] Getting quotas for user 86ff0818a46743dc8f1a0320eb613cf2 and project 164a0764f87b4526a9a4cc7f19117f1f. Resources: {'cores', 'instances', 'ram'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 20:49:12.309529 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5296e39d-441c-47eb-a050-54f97de86b06 tempest-AggregatesAdminTestJSON-1406494805 tempest-AggregatesAdminTestJSON-1406494805-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:12.310031 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5296e39d-441c-47eb-a050-54f97de86b06 tempest-AggregatesAdminTestJSON-1406494805 tempest-AggregatesAdminTestJSON-1406494805-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:12.310477 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5296e39d-441c-47eb-a050-54f97de86b06 tempest-AggregatesAdminTestJSON-1406494805 tempest-AggregatesAdminTestJSON-1406494805-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:12.320946 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.utils [None req-87804604-99f7-480c-8d06-a18f19a3f3a0 tempest-QuotasAdminNegativeTest-220159200 tempest-QuotasAdminNegativeTest-220159200-project] instances quota exceeded for 164a0764f87b4526a9a4cc7f19117f1f, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=138744) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Oct 22 20:49:12.321997 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-87804604-99f7-480c-8d06-a18f19a3f3a0 tempest-QuotasAdminNegativeTest-220159200 tempest-QuotasAdminNegativeTest-220159200-project] HTTP exception thrown: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 22 20:49:12.328632 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-87804604-99f7-480c-8d06-a18f19a3f3a0 tempest-QuotasAdminNegativeTest-220159200 tempest-QuotasAdminNegativeTest-220159200-project] Request method failure captured: Oct 22 20:49:12.328632 ncdv-master-1 devstack@n-api.service[138744]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 22 20:49:12.328632 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 20:49:12.328632 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 20:49:12.328632 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 20:49:12.328632 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 144 Oct 22 20:49:12.328632 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 20:49:12.328632 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 20:49:12.328632 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 20:49:12.328632 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 20:49:12.328632 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVFdBdt_jpp6OlkiUgC6CAOUuG44kuvwlEO6SardfVzcSX3ugb-rcT5pF4VlZcV_TlQ4dG9RYIRE-91qMCgCtQfRrdbrFZ3EPoBQbwtNIOQkJIVaU54gsXpJazF5OpTzC3KBUkjSYd-7sLY0_x53he8hnNEq4UOciMdqN3cpoUSaiS4w Oct 22 20:49:12.328632 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 20:49:12.328632 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 20:49:12.328632 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 20:49:12.328632 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 20:49:12.328632 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 20:49:12.328632 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 20:49:12.328632 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: 164a0764f87b4526a9a4cc7f19117f1f Oct 22 20:49:12.328632 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-QuotasAdminNegativeTest-220159200 Oct 22 20:49:12.328632 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 20:49:12.328632 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 20:49:12.329812 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_164a0764f87b4526a9a4cc7f19117f1f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/164a0764f87b4526a9a4cc7f19117f1f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/164a0764f87b4526a9a4cc7f19117f1f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/164a0764f87b4526a9a4cc7f19117f1f"}]}] Oct 22 20:49:12.329812 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-QuotasAdminNegativeTest-220159200 Oct 22 20:49:12.329812 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: 164a0764f87b4526a9a4cc7f19117f1f Oct 22 20:49:12.329812 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-220159200 Oct 22 20:49:12.329812 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-QuotasAdminNegativeTest-220159200-project Oct 22 20:49:12.329812 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 20:49:12.329812 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 20:49:12.329812 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: 86ff0818a46743dc8f1a0320eb613cf2 Oct 22 20:49:12.329812 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-QuotasAdminNegativeTest-220159200-project Oct 22 20:49:12.329812 ncdv-master-1 devstack@n-api.service[138744]: Oct 22 20:49:12.329812 ncdv-master-1 devstack@n-api.service[138744]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-485130220", "imageRef": "085e4478-6edc-4a69-8e08-f9831713eb65", "flavorRef": "452"}} Oct 22 20:49:12.329812 ncdv-master-1 devstack@n-api.service[138744]: method: > Oct 22 20:49:12.330449 ncdv-master-1 devstack@n-api.service[138744]: exception: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 22 20:49:12.330449 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-485130220', 'imageRef': '085e4478-6edc-4a69-8e08-f9831713eb65', 'flavorRef': '452'}}} Oct 22 20:49:12.330449 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:49:12.330449 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:49:12.330449 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Oct 22 20:49:12.330449 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Oct 22 20:49:12.330449 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 22 20:49:12.330449 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 22 20:49:12.330449 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 22 20:49:12.330449 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc Oct 22 20:49:12.330449 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 22 20:49:12.330449 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 22 20:49:12.330449 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 22 20:49:12.330449 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 22 20:49:12.330449 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 22 20:49:12.330449 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 22 20:49:12.330449 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 22 20:49:12.330449 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 22 20:49:12.332158 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Oct 22 20:49:12.332158 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 22 20:49:12.332158 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['instances'] Oct 22 20:49:12.332158 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:49:12.332158 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:49:12.332158 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:49:12.332158 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:49:12.332158 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 22 20:49:12.332158 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 22 20:49:12.332158 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 22 20:49:12.332158 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 22 20:49:12.332158 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Oct 22 20:49:12.332158 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Oct 22 20:49:12.332158 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Oct 22 20:49:12.332158 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Oct 22 20:49:12.332158 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Oct 22 20:49:12.332158 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 22 20:49:12.332158 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 22 20:49:12.332158 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:49:12.332158 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:49:12.332158 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:49:12.333230 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:49:12.333230 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:49:12.333230 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:49:12.333230 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:49:12.333230 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:49:12.333230 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:49:12.333230 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:49:12.333230 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 20:49:12.333230 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 20:49:12.333230 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 20:49:12.333230 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 20:49:12.333230 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 20:49:12.333230 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 20:49:12.333230 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 22 20:49:12.333230 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 22 20:49:12.333230 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 22 20:49:12.333230 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 22 20:49:12.333230 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:49:12.333230 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:49:12.333230 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:49:12.333230 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:49:12.334312 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:49:12.334312 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:49:12.334312 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 20:49:12.334312 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 20:49:12.334312 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 22 20:49:12.334312 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:49:12.334312 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-87804604-99f7-480c-8d06-a18f19a3f3a0 tempest-QuotasAdminNegativeTest-220159200 tempest-QuotasAdminNegativeTest-220159200-project] Returning 403 to user: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:49:12.334312 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-87804604-99f7-480c-8d06-a18f19a3f3a0 tempest-QuotasAdminNegativeTest-220159200 tempest-QuotasAdminNegativeTest-220159200-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 403 len: 119 microversion: 2.1 time: 1.183790 Oct 22 20:49:12.336546 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 134/305] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Oct 22 20:49:11 2022] POST /compute/v2.1/servers => generated 119 bytes in 1188 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 22 20:49:12.342736 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-9f1dd861-4144-40ef-9c31-77efac6659e8 tempest-AggregatesAdminNegativeTestJSON-1306123093 tempest-AggregatesAdminNegativeTestJSON-1306123093-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch2-master-1"}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:49:12.357950 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9f1dd861-4144-40ef-9c31-77efac6659e8 tempest-AggregatesAdminNegativeTestJSON-1306123093 tempest-AggregatesAdminNegativeTestJSON-1306123093-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:12.358602 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9f1dd861-4144-40ef-9c31-77efac6659e8 tempest-AggregatesAdminNegativeTestJSON-1306123093 tempest-AggregatesAdminNegativeTestJSON-1306123093-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:12.359281 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9f1dd861-4144-40ef-9c31-77efac6659e8 tempest-AggregatesAdminNegativeTestJSON-1306123093 tempest-AggregatesAdminNegativeTestJSON-1306123093-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:12.382015 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-5296e39d-441c-47eb-a050-54f97de86b06 tempest-AggregatesAdminTestJSON-1406494805 tempest-AggregatesAdminTestJSON-1406494805-project-admin] 10.222.0.18 "PUT /compute/v2.1/os-aggregates/16" status: 200 len: 334 microversion: 2.1 time: 0.166100 Oct 22 20:49:12.388807 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 172/306] 10.222.0.18 () {60 vars in 1173 bytes} [Sat Oct 22 20:49:12 2022] PUT /compute/v2.1/os-aggregates/16 => generated 334 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:49:12.392849 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-8809d2ce-4b01-4024-b523-423c8397b002 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:49:12.393666 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-8809d2ce-4b01-4024-b523-423c8397b002 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] [instance: 5c3de24c-090d-4769-8975-207eb939b979] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:49:12.419696 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8809d2ce-4b01-4024-b523-423c8397b002 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:12.421722 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8809d2ce-4b01-4024-b523-423c8397b002 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:12.422703 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8809d2ce-4b01-4024-b523-423c8397b002 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:12.426016 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8809d2ce-4b01-4024-b523-423c8397b002 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:12.427815 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8809d2ce-4b01-4024-b523-423c8397b002 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:12.428912 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8809d2ce-4b01-4024-b523-423c8397b002 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:12.541525 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-9f1dd861-4144-40ef-9c31-77efac6659e8 tempest-AggregatesAdminNegativeTestJSON-1306123093 tempest-AggregatesAdminNegativeTestJSON-1306123093-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates/15/action" status: 200 len: 227 microversion: 2.1 time: 0.203583 Oct 22 20:49:12.548805 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 135/307] 10.222.0.18 () {60 vars in 1194 bytes} [Sat Oct 22 20:49:12 2022] POST /compute/v2.1/os-aggregates/15/action => generated 227 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:49:12.596074 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-8809d2ce-4b01-4024-b523-423c8397b002 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1ce98c66024d49b31e8e4f38b82838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a20f8f858424c89bf67a56feb720ac9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:49:12.609944 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-8809d2ce-4b01-4024-b523-423c8397b002 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed1ce98c66024d49b31e8e4f38b82838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a20f8f858424c89bf67a56feb720ac9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:49:12.613128 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-8809d2ce-4b01-4024-b523-423c8397b002 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed1ce98c66024d49b31e8e4f38b82838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a20f8f858424c89bf67a56feb720ac9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:49:12.627164 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-8809d2ce-4b01-4024-b523-423c8397b002 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] 10.222.0.18 "GET /compute/v2.1/servers/5c3de24c-090d-4769-8975-207eb939b979" status: 200 len: 1446 microversion: 2.75 time: 0.240598 Oct 22 20:49:12.627876 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 173/308] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 20:49:12 2022] GET /compute/v2.1/servers/5c3de24c-090d-4769-8975-207eb939b979 => generated 1446 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 20:49:12.651758 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-fc3d46ce-a30d-4bfd-bcfb-ed15b0d63e89 tempest-QuotasAdminNegativeTest-1726628264 tempest-QuotasAdminNegativeTest-1726628264-project-admin] Action: 'update', calling method: .version_select at 0x7fd3a4a883a0>, body: {"quota_set": {"instances": 10}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:49:12.810329 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-cdd2541e-1ad2-4b01-b3c9-5ed614a4daab tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1718864319", "imageRef": "085e4478-6edc-4a69-8e08-f9831713eb65", "flavorRef": "452", "networks": [{"uuid": "03a467bd-c608-425f-8923-ff356110df6b"}]}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:49:12.911841 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.network.neutron [None req-cdd2541e-1ad2-4b01-b3c9-5ed614a4daab tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] validate_networks() for [('03a467bd-c608-425f-8923-ff356110df6b', None, None, None, None, None)] {{(pid=138744) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 20:49:13.187307 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fc3d46ce-a30d-4bfd-bcfb-ed15b0d63e89 tempest-QuotasAdminNegativeTest-1726628264 tempest-QuotasAdminNegativeTest-1726628264-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:13.187989 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fc3d46ce-a30d-4bfd-bcfb-ed15b0d63e89 tempest-QuotasAdminNegativeTest-1726628264 tempest-QuotasAdminNegativeTest-1726628264-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:13.188436 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fc3d46ce-a30d-4bfd-bcfb-ed15b0d63e89 tempest-QuotasAdminNegativeTest-1726628264 tempest-QuotasAdminNegativeTest-1726628264-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:13.189171 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fc3d46ce-a30d-4bfd-bcfb-ed15b0d63e89 tempest-QuotasAdminNegativeTest-1726628264 tempest-QuotasAdminNegativeTest-1726628264-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:13.189942 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fc3d46ce-a30d-4bfd-bcfb-ed15b0d63e89 tempest-QuotasAdminNegativeTest-1726628264 tempest-QuotasAdminNegativeTest-1726628264-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:13.192375 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fc3d46ce-a30d-4bfd-bcfb-ed15b0d63e89 tempest-QuotasAdminNegativeTest-1726628264 tempest-QuotasAdminNegativeTest-1726628264-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:13.299165 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-fc3d46ce-a30d-4bfd-bcfb-ed15b0d63e89 tempest-QuotasAdminNegativeTest-1726628264 tempest-QuotasAdminNegativeTest-1726628264-project-admin] 10.222.0.18 "PUT /compute/v2.1/os-quota-sets/164a0764f87b4526a9a4cc7f19117f1f" status: 200 len: 329 microversion: 2.1 time: 0.670184 Oct 22 20:49:13.303670 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 174/309] 10.222.0.18 () {60 vars in 1262 bytes} [Sat Oct 22 20:49:12 2022] PUT /compute/v2.1/os-quota-sets/164a0764f87b4526a9a4cc7f19117f1f => generated 329 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:49:13.313920 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-c7b52b63-9c96-4a7b-a4a7-033043c1d52a tempest-AggregatesAdminTestJSON-1406494805 tempest-AggregatesAdminTestJSON-1406494805-project-admin] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:49:13.326173 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_api:UPDATE=4,nova_api:SELECT=86,nova_api:INSERT=10 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:49:13.339327 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-c7b52b63-9c96-4a7b-a4a7-033043c1d52a tempest-AggregatesAdminTestJSON-1406494805 tempest-AggregatesAdminTestJSON-1406494805-project-admin] 10.222.0.18 "GET /compute/v2.1/os-aggregates" status: 200 len: 551 microversion: 2.1 time: 0.034328 Oct 22 20:49:13.341989 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 175/310] 10.222.0.18 () {58 vars in 1143 bytes} [Sat Oct 22 20:49:13 2022] GET /compute/v2.1/os-aggregates => generated 551 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:49:13.359783 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-6b9130f0-227b-4b84-981f-c8457e24aa3d tempest-AggregatesAdminNegativeTestJSON-1306123093 tempest-AggregatesAdminNegativeTestJSON-1306123093-project-admin] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:49:13.413538 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-6b9130f0-227b-4b84-981f-c8457e24aa3d tempest-AggregatesAdminNegativeTestJSON-1306123093 tempest-AggregatesAdminNegativeTestJSON-1306123093-project-admin] 10.222.0.18 "DELETE /compute/v2.1/os-aggregates/15" status: 200 len: 0 microversion: 2.1 time: 0.067921 Oct 22 20:49:13.414443 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 176/311] 10.222.0.18 () {58 vars in 1155 bytes} [Sat Oct 22 20:49:13 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 0 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 22 20:49:13.430995 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-5283d524-70be-4d12-b6b7-6d096198057c tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:49:13.431814 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-5283d524-70be-4d12-b6b7-6d096198057c tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] [instance: 96add0b3-b82f-4a0a-bec3-9a6341ae5dec] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:49:13.446277 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5283d524-70be-4d12-b6b7-6d096198057c tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:13.449253 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5283d524-70be-4d12-b6b7-6d096198057c tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:13.449900 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5283d524-70be-4d12-b6b7-6d096198057c tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:13.451928 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5283d524-70be-4d12-b6b7-6d096198057c tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:13.453751 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5283d524-70be-4d12-b6b7-6d096198057c tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:13.455960 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5283d524-70be-4d12-b6b7-6d096198057c tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:13.885231 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-5283d524-70be-4d12-b6b7-6d096198057c tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e13dcabaaa4b218945aeeabb4c902e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675a324f0134844a1964f64322493ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:49:13.903539 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-5283d524-70be-4d12-b6b7-6d096198057c tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] 10.222.0.18 "GET /compute/v2.1/servers/96add0b3-b82f-4a0a-bec3-9a6341ae5dec" status: 200 len: 1320 microversion: 2.1 time: 0.479775 Oct 22 20:49:13.904520 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 177/312] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:49:13 2022] GET /compute/v2.1/servers/96add0b3-b82f-4a0a-bec3-9a6341ae5dec => generated 1320 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:49:13.914631 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-904ebf17-f027-42df-8064-cd264873724d tempest-QuotasAdminNegativeTest-1726628264 tempest-QuotasAdminNegativeTest-1726628264-project-admin] Calling method '.version_select at 0x7fd3a4a88040>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:49:14.389915 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-904ebf17-f027-42df-8064-cd264873724d tempest-QuotasAdminNegativeTest-1726628264 tempest-QuotasAdminNegativeTest-1726628264-project-admin] 10.222.0.18 "GET /compute/v2.1/os-quota-sets/164a0764f87b4526a9a4cc7f19117f1f" status: 200 len: 371 microversion: 2.1 time: 0.484168 Oct 22 20:49:14.394217 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 178/313] 10.222.0.18 () {58 vars in 1242 bytes} [Sat Oct 22 20:49:13 2022] GET /compute/v2.1/os-quota-sets/164a0764f87b4526a9a4cc7f19117f1f => generated 371 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:49:14.402901 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-abe09bba-4248-4e88-b81f-329c734b5dc5 tempest-AggregatesAdminTestJSON-1406494805 tempest-AggregatesAdminTestJSON-1406494805-project-admin] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:49:14.473625 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-abe09bba-4248-4e88-b81f-329c734b5dc5 tempest-AggregatesAdminTestJSON-1406494805 tempest-AggregatesAdminTestJSON-1406494805-project-admin] 10.222.0.18 "DELETE /compute/v2.1/os-aggregates/16" status: 200 len: 0 microversion: 2.1 time: 0.077501 Oct 22 20:49:14.476349 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 179/314] 10.222.0.18 () {58 vars in 1155 bytes} [Sat Oct 22 20:49:14 2022] DELETE /compute/v2.1/os-aggregates/16 => generated 0 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 22 20:49:14.493737 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-952700e0-ec10-4331-8365-d5db11effe3f tempest-AggregatesAdminNegativeTestJSON-1306123093 tempest-AggregatesAdminNegativeTestJSON-1306123093-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-528247014"}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:49:14.499471 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.objects.aggregate [None req-952700e0-ec10-4331-8365-d5db11effe3f tempest-AggregatesAdminNegativeTestJSON-1306123093 tempest-AggregatesAdminNegativeTestJSON-1306123093-project-admin] Generated uuid a55e9191-6c6f-42f3-b767-ac088b2427b4 for aggregate {{(pid=138745) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 22 20:49:14.548671 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-952700e0-ec10-4331-8365-d5db11effe3f tempest-AggregatesAdminNegativeTestJSON-1306123093 tempest-AggregatesAdminNegativeTestJSON-1306123093-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.067771 Oct 22 20:49:14.549310 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 180/315] 10.222.0.18 () {60 vars in 1164 bytes} [Sat Oct 22 20:49:14 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:49:14.562716 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-257de3ae-68f3-4a2c-b00d-f186567ce84f tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:49:14.563695 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-257de3ae-68f3-4a2c-b00d-f186567ce84f tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] [instance: 5c3de24c-090d-4769-8975-207eb939b979] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:49:14.574371 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-257de3ae-68f3-4a2c-b00d-f186567ce84f tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:14.575228 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-257de3ae-68f3-4a2c-b00d-f186567ce84f tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:14.576506 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-257de3ae-68f3-4a2c-b00d-f186567ce84f tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:14.577611 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-257de3ae-68f3-4a2c-b00d-f186567ce84f tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:14.578358 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-257de3ae-68f3-4a2c-b00d-f186567ce84f tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:14.579071 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-257de3ae-68f3-4a2c-b00d-f186567ce84f tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:14.757354 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-257de3ae-68f3-4a2c-b00d-f186567ce84f tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1ce98c66024d49b31e8e4f38b82838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a20f8f858424c89bf67a56feb720ac9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:49:14.768316 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-257de3ae-68f3-4a2c-b00d-f186567ce84f tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed1ce98c66024d49b31e8e4f38b82838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a20f8f858424c89bf67a56feb720ac9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:49:14.771951 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-257de3ae-68f3-4a2c-b00d-f186567ce84f tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed1ce98c66024d49b31e8e4f38b82838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a20f8f858424c89bf67a56feb720ac9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:49:14.783204 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-257de3ae-68f3-4a2c-b00d-f186567ce84f tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] 10.222.0.18 "GET /compute/v2.1/servers/5c3de24c-090d-4769-8975-207eb939b979" status: 200 len: 1446 microversion: 2.75 time: 0.232156 Oct 22 20:49:14.795380 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 181/316] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 20:49:14 2022] GET /compute/v2.1/servers/5c3de24c-090d-4769-8975-207eb939b979 => generated 1446 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 20:49:14.795380 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-c3ae9ac2-93a0-438a-8b90-82cf5b71c0c1 tempest-QuotasAdminNegativeTest-1726628264 tempest-QuotasAdminNegativeTest-1726628264-project-admin] Action: 'update', calling method: .version_select at 0x7fd3a4a880d0>, body: {"quota_set": {"force": true, "ram": 0}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:49:15.093863 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-cdd2541e-1ad2-4b01-b3c9-5ed614a4daab tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Flavor limits 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 20:49:15.095004 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-cdd2541e-1ad2-4b01-b3c9-5ed614a4daab tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Image limits 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 20:49:15.095693 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-cdd2541e-1ad2-4b01-b3c9-5ed614a4daab tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Flavor pref 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 20:49:15.096375 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-cdd2541e-1ad2-4b01-b3c9-5ed614a4daab tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Image pref 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 20:49:15.097038 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-cdd2541e-1ad2-4b01-b3c9-5ed614a4daab tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 20:49:15.113135 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cdd2541e-1ad2-4b01-b3c9-5ed614a4daab tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:15.113807 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cdd2541e-1ad2-4b01-b3c9-5ed614a4daab tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:15.114399 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cdd2541e-1ad2-4b01-b3c9-5ed614a4daab tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:15.115799 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cdd2541e-1ad2-4b01-b3c9-5ed614a4daab tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:15.116410 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cdd2541e-1ad2-4b01-b3c9-5ed614a4daab tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:15.117033 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cdd2541e-1ad2-4b01-b3c9-5ed614a4daab tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:15.139967 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c3ae9ac2-93a0-438a-8b90-82cf5b71c0c1 tempest-QuotasAdminNegativeTest-1726628264 tempest-QuotasAdminNegativeTest-1726628264-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:15.143777 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c3ae9ac2-93a0-438a-8b90-82cf5b71c0c1 tempest-QuotasAdminNegativeTest-1726628264 tempest-QuotasAdminNegativeTest-1726628264-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:15.144240 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c3ae9ac2-93a0-438a-8b90-82cf5b71c0c1 tempest-QuotasAdminNegativeTest-1726628264 tempest-QuotasAdminNegativeTest-1726628264-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:15.144567 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-cdd2541e-1ad2-4b01-b3c9-5ed614a4daab tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Getting quotas for project 11060bbcab6b45cabb1457319d72b982. Resources: {'cores', 'instances', 'ram'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 20:49:15.145040 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c3ae9ac2-93a0-438a-8b90-82cf5b71c0c1 tempest-QuotasAdminNegativeTest-1726628264 tempest-QuotasAdminNegativeTest-1726628264-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:15.145506 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c3ae9ac2-93a0-438a-8b90-82cf5b71c0c1 tempest-QuotasAdminNegativeTest-1726628264 tempest-QuotasAdminNegativeTest-1726628264-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:15.145928 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c3ae9ac2-93a0-438a-8b90-82cf5b71c0c1 tempest-QuotasAdminNegativeTest-1726628264 tempest-QuotasAdminNegativeTest-1726628264-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:15.151520 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_api:INSERT=3,nova_api:SELECT=88,nova_api:DELETE=8,nova_api:UPDATE=1 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:49:15.153125 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-cdd2541e-1ad2-4b01-b3c9-5ed614a4daab tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Getting quotas for user 93c41b7be1724632b0d6bd2bd3b57f8f and project 11060bbcab6b45cabb1457319d72b982. Resources: {'cores', 'instances', 'ram'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 20:49:15.175763 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-cdd2541e-1ad2-4b01-b3c9-5ed614a4daab tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Going to run 1 instances... {{(pid=138744) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 20:49:15.178910 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-cdd2541e-1ad2-4b01-b3c9-5ed614a4daab tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] [instance: 1d613848-05f4-478f-a569-b4c50576edb7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='085e4478-6edc-4a69-8e08-f9831713eb65',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138744) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 20:49:15.210652 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell0:UPDATE=12,nova_cell0:SELECT=88 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:49:15.249672 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-cdd2541e-1ad2-4b01-b3c9-5ed614a4daab tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 2.704908 Oct 22 20:49:15.250819 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 136/317] 10.222.0.18 () {62 vars in 1188 bytes} [Sat Oct 22 20:49:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 2706 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 22 20:49:15.256124 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-55518bb8-98c7-4620-ae4d-4cc139529af0 tempest-AggregatesAdminTestJSON-1406494805 tempest-AggregatesAdminTestJSON-1406494805-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1155832077"}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:49:15.260060 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.objects.aggregate [None req-55518bb8-98c7-4620-ae4d-4cc139529af0 tempest-AggregatesAdminTestJSON-1406494805 tempest-AggregatesAdminTestJSON-1406494805-project-admin] Generated uuid ad148815-57b3-42ee-81d4-e2cf52d1bb6d for aggregate {{(pid=138744) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 22 20:49:15.280997 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-c3ae9ac2-93a0-438a-8b90-82cf5b71c0c1 tempest-QuotasAdminNegativeTest-1726628264 tempest-QuotasAdminNegativeTest-1726628264-project-admin] 10.222.0.18 "PUT /compute/v2.1/os-quota-sets/164a0764f87b4526a9a4cc7f19117f1f" status: 200 len: 325 microversion: 2.1 time: 0.495521 Oct 22 20:49:15.281708 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 182/318] 10.222.0.18 () {60 vars in 1262 bytes} [Sat Oct 22 20:49:14 2022] PUT /compute/v2.1/os-quota-sets/164a0764f87b4526a9a4cc7f19117f1f => generated 325 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:49:15.303736 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-55518bb8-98c7-4620-ae4d-4cc139529af0 tempest-AggregatesAdminTestJSON-1406494805 tempest-AggregatesAdminTestJSON-1406494805-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.051352 Oct 22 20:49:15.304645 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-e15915e3-51a2-4363-ab8b-0e892a4f669c tempest-AggregatesAdminNegativeTestJSON-1306123093 tempest-AggregatesAdminNegativeTestJSON-1306123093-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nonexist_host"}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:49:15.307308 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 137/319] 10.222.0.18 () {60 vars in 1164 bytes} [Sat Oct 22 20:49:15 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:49:15.317408 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e15915e3-51a2-4363-ab8b-0e892a4f669c tempest-AggregatesAdminNegativeTestJSON-1306123093 tempest-AggregatesAdminNegativeTestJSON-1306123093-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:15.329765 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-3948f3a8-9af2-475b-ba1f-e7d5394803a6 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:49:15.333774 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e15915e3-51a2-4363-ab8b-0e892a4f669c tempest-AggregatesAdminNegativeTestJSON-1306123093 tempest-AggregatesAdminNegativeTestJSON-1306123093-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:15.334108 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e15915e3-51a2-4363-ab8b-0e892a4f669c tempest-AggregatesAdminNegativeTestJSON-1306123093 tempest-AggregatesAdminNegativeTestJSON-1306123093-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:15.334580 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-3948f3a8-9af2-475b-ba1f-e7d5394803a6 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] [instance: 96add0b3-b82f-4a0a-bec3-9a6341ae5dec] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:49:15.347585 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3948f3a8-9af2-475b-ba1f-e7d5394803a6 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:15.348361 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3948f3a8-9af2-475b-ba1f-e7d5394803a6 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:15.349037 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3948f3a8-9af2-475b-ba1f-e7d5394803a6 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:15.356673 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3948f3a8-9af2-475b-ba1f-e7d5394803a6 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:15.357624 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3948f3a8-9af2-475b-ba1f-e7d5394803a6 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:15.358212 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3948f3a8-9af2-475b-ba1f-e7d5394803a6 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:15.367069 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e15915e3-51a2-4363-ab8b-0e892a4f669c tempest-AggregatesAdminNegativeTestJSON-1306123093 tempest-AggregatesAdminNegativeTestJSON-1306123093-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:15.367620 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e15915e3-51a2-4363-ab8b-0e892a4f669c tempest-AggregatesAdminNegativeTestJSON-1306123093 tempest-AggregatesAdminNegativeTestJSON-1306123093-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:15.368152 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e15915e3-51a2-4363-ab8b-0e892a4f669c tempest-AggregatesAdminNegativeTestJSON-1306123093 tempest-AggregatesAdminNegativeTestJSON-1306123093-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:15.404330 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.compute.aggregates [None req-e15915e3-51a2-4363-ab8b-0e892a4f669c tempest-AggregatesAdminNegativeTestJSON-1306123093 tempest-AggregatesAdminNegativeTestJSON-1306123093-project-admin] Failed to remove host nonexist_host from aggregate 17. Error: Compute host nonexist_host could not be found.: nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Oct 22 20:49:15.404955 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.wsgi [None req-e15915e3-51a2-4363-ab8b-0e892a4f669c tempest-AggregatesAdminNegativeTestJSON-1306123093 tempest-AggregatesAdminNegativeTestJSON-1306123093-project-admin] HTTP exception thrown: Cannot remove host nonexist_host in aggregate 17 Oct 22 20:49:15.407011 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-e15915e3-51a2-4363-ab8b-0e892a4f669c tempest-AggregatesAdminNegativeTestJSON-1306123093 tempest-AggregatesAdminNegativeTestJSON-1306123093-project-admin] Request method failure captured: Oct 22 20:49:15.407011 ncdv-master-1 devstack@n-api.service[138745]: request: POST /compute/v2.1/os-aggregates/17/action HTTP/1.1 Oct 22 20:49:15.407011 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 20:49:15.407011 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 20:49:15.407011 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 20:49:15.407011 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 42 Oct 22 20:49:15.407011 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 20:49:15.407011 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 20:49:15.407011 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 20:49:15.407011 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 20:49:15.407011 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVFcTjzeCF7gwSKDmU2CPWCR_esBhUtkbcoM98K65tKtwTX7k8J3P2XxFlWelX1TDo_-yYShDH5UFO7PvTkSeEz8zhJDyz1PblWBsa9c1g1Qy6YZmn8lB_e_ZFbxFrZc-0aXSGx-CMuDgW5UvCQv7euL6tHWkksIhSTjd3SVjJ9Vfw2k Oct 22 20:49:15.407011 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 20:49:15.407011 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 20:49:15.407011 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 20:49:15.407011 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 20:49:15.407011 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 20:49:15.407011 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 20:49:15.407011 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: c0539194941d4647ae4209c24cdce003 Oct 22 20:49:15.407011 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1306123093 Oct 22 20:49:15.407011 ncdv-master-1 devstack@n-api.service[138745]: X-Role: admin,member,reader Oct 22 20:49:15.407011 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: admin,member,reader Oct 22 20:49:15.408554 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_c0539194941d4647ae4209c24cdce003"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c0539194941d4647ae4209c24cdce003"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/c0539194941d4647ae4209c24cdce003"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c0539194941d4647ae4209c24cdce003"}]}] Oct 22 20:49:15.408554 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1306123093 Oct 22 20:49:15.408554 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: c0539194941d4647ae4209c24cdce003 Oct 22 20:49:15.408554 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1306123093 Oct 22 20:49:15.408554 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-AggregatesAdminNegativeTestJSON-1306123093-project-admin Oct 22 20:49:15.408554 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 20:49:15.408554 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 20:49:15.408554 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: 352f8254dcc044f18778bbbe73fc8d01 Oct 22 20:49:15.408554 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1306123093-project-admin Oct 22 20:49:15.408554 ncdv-master-1 devstack@n-api.service[138745]: Oct 22 20:49:15.408554 ncdv-master-1 devstack@n-api.service[138745]: {"remove_host": {"host": "nonexist_host"}} Oct 22 20:49:15.408554 ncdv-master-1 devstack@n-api.service[138745]: method: > Oct 22 20:49:15.408554 ncdv-master-1 devstack@n-api.service[138745]: exception: Cannot remove host nonexist_host in aggregate 17 Oct 22 20:49:15.409440 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'id': '17', 'body': {'remove_host': {'host': 'nonexist_host'}}} Oct 22 20:49:15.409440 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:49:15.409440 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:49:15.409440 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5999, in _get_service_in_cell_by_host Oct 22 20:49:15.409440 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Oct 22 20:49:15.409440 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 22 20:49:15.409440 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 22 20:49:15.409440 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 22 20:49:15.409440 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 22 20:49:15.409440 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 22 20:49:15.409440 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 22 20:49:15.409440 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 22 20:49:15.409440 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 22 20:49:15.409440 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexist_host' is not mapped to any cell Oct 22 20:49:15.409440 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:49:15.409440 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:49:15.409440 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:49:15.409440 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:49:15.409440 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6005, in _get_service_in_cell_by_host Oct 22 20:49:15.409440 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Oct 22 20:49:15.410588 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 22 20:49:15.410588 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 22 20:49:15.410588 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 22 20:49:15.410588 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:49:15.410588 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:49:15.410588 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:49:15.410588 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:49:15.410588 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 209, in _remove_host Oct 22 20:49:15.410588 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi aggregate = self.api.remove_host_from_aggregate(context, id, host) Oct 22 20:49:15.410588 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 22 20:49:15.410588 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 22 20:49:15.410588 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 22 20:49:15.410588 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 22 20:49:15.410588 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 22 20:49:15.410588 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise self.value Oct 22 20:49:15.410588 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 22 20:49:15.410588 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 22 20:49:15.410588 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6683, in remove_host_from_aggregate Oct 22 20:49:15.410588 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi _get_service_in_cell_by_host(context, host_name) Oct 22 20:49:15.410588 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6007, in _get_service_in_cell_by_host Oct 22 20:49:15.411868 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Oct 22 20:49:15.411868 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Oct 22 20:49:15.411868 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:49:15.411868 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:49:15.411868 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:49:15.411868 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:49:15.411868 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:49:15.411868 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:49:15.411868 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:49:15.411868 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:49:15.411868 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:49:15.411868 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:49:15.411868 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 20:49:15.411868 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 20:49:15.411868 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 217, in _remove_host Oct 22 20:49:15.411868 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 22 20:49:15.411868 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Cannot remove host nonexist_host in aggregate 17 Oct 22 20:49:15.411868 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:49:15.411868 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:49:15.411868 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:49:15.411868 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:49:15.414598 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:49:15.414598 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:49:15.414598 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 20:49:15.414598 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 20:49:15.414598 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot remove host nonexist_host in aggregate 17 Oct 22 20:49:15.414598 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:49:15.418296 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-e15915e3-51a2-4363-ab8b-0e892a4f669c tempest-AggregatesAdminNegativeTestJSON-1306123093 tempest-AggregatesAdminNegativeTestJSON-1306123093-project-admin] Returning 404 to user: Cannot remove host nonexist_host in aggregate 17 {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:49:15.419295 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-e15915e3-51a2-4363-ab8b-0e892a4f669c tempest-AggregatesAdminNegativeTestJSON-1306123093 tempest-AggregatesAdminNegativeTestJSON-1306123093-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates/17/action" status: 404 len: 94 microversion: 2.1 time: 0.127251 Oct 22 20:49:15.428755 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 183/320] 10.222.0.18 () {60 vars in 1194 bytes} [Sat Oct 22 20:49:15 2022] POST /compute/v2.1/os-aggregates/17/action => generated 94 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 22 20:49:15.441245 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-e3e01f8f-d5ea-4886-9979-b83751e67a7b tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:49:15.441958 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-e3e01f8f-d5ea-4886-9979-b83751e67a7b tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] [instance: 1d613848-05f4-478f-a569-b4c50576edb7] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:49:15.592535 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-e3e01f8f-d5ea-4886-9979-b83751e67a7b tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:49:15.606599 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-e3e01f8f-d5ea-4886-9979-b83751e67a7b tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:49:15.608095 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-e3e01f8f-d5ea-4886-9979-b83751e67a7b tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:49:15.609210 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-e3e01f8f-d5ea-4886-9979-b83751e67a7b tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] 10.222.0.18 "GET /compute/v2.1/servers/1d613848-05f4-478f-a569-b4c50576edb7" status: 200 len: 1262 microversion: 2.25 time: 0.182158 Oct 22 20:49:15.609764 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 184/321] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 20:49:15 2022] GET /compute/v2.1/servers/1d613848-05f4-478f-a569-b4c50576edb7 => generated 1262 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 20:49:15.614235 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-9e699f37-9d60-4291-9a64-899171563ef6 tempest-AggregatesAdminTestJSON-1406494805 tempest-AggregatesAdminTestJSON-1406494805-project-admin] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:49:15.638638 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-9e699f37-9d60-4291-9a64-899171563ef6 tempest-AggregatesAdminTestJSON-1406494805 tempest-AggregatesAdminTestJSON-1406494805-project-admin] 10.222.0.18 "GET /compute/v2.1/os-aggregates" status: 200 len: 445 microversion: 2.1 time: 0.027751 Oct 22 20:49:15.639208 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 185/322] 10.222.0.18 () {58 vars in 1143 bytes} [Sat Oct 22 20:49:15 2022] GET /compute/v2.1/os-aggregates => generated 445 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:49:15.647153 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-251c9466-8783-4216-a982-0ec619dc7f6a tempest-AggregatesAdminNegativeTestJSON-1306123093 tempest-AggregatesAdminNegativeTestJSON-1306123093-project-admin] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:49:15.680650 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-251c9466-8783-4216-a982-0ec619dc7f6a tempest-AggregatesAdminNegativeTestJSON-1306123093 tempest-AggregatesAdminNegativeTestJSON-1306123093-project-admin] 10.222.0.18 "DELETE /compute/v2.1/os-aggregates/17" status: 200 len: 0 microversion: 2.1 time: 0.040216 Oct 22 20:49:15.681683 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 186/323] 10.222.0.18 () {58 vars in 1155 bytes} [Sat Oct 22 20:49:15 2022] DELETE /compute/v2.1/os-aggregates/17 => generated 0 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 22 20:49:15.686684 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-f3da4ad9-45f0-447a-a526-1278593638be tempest-QuotasAdminNegativeTest-220159200 tempest-QuotasAdminNegativeTest-220159200-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-285388771", "imageRef": "085e4478-6edc-4a69-8e08-f9831713eb65", "flavorRef": "452"}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:49:15.767909 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.network.neutron [None req-f3da4ad9-45f0-447a-a526-1278593638be tempest-QuotasAdminNegativeTest-220159200 tempest-QuotasAdminNegativeTest-220159200-project] validate_networks() for None {{(pid=138745) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 20:49:15.933379 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-3948f3a8-9af2-475b-ba1f-e7d5394803a6 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e13dcabaaa4b218945aeeabb4c902e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675a324f0134844a1964f64322493ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:49:15.953762 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-3948f3a8-9af2-475b-ba1f-e7d5394803a6 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] 10.222.0.18 "GET /compute/v2.1/servers/96add0b3-b82f-4a0a-bec3-9a6341ae5dec" status: 200 len: 1320 microversion: 2.1 time: 0.637700 Oct 22 20:49:15.954832 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 138/324] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:49:15 2022] GET /compute/v2.1/servers/96add0b3-b82f-4a0a-bec3-9a6341ae5dec => generated 1320 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:49:15.974648 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-7d544cbc-29d9-488d-ab03-8e1e3b62a435 tempest-AggregatesAdminTestJSON-1406494805 tempest-AggregatesAdminTestJSON-1406494805-project-admin] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:49:16.033390 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-7d544cbc-29d9-488d-ab03-8e1e3b62a435 tempest-AggregatesAdminTestJSON-1406494805 tempest-AggregatesAdminTestJSON-1406494805-project-admin] 10.222.0.18 "DELETE /compute/v2.1/os-aggregates/18" status: 200 len: 0 microversion: 2.1 time: 0.062643 Oct 22 20:49:16.037575 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 139/325] 10.222.0.18 () {58 vars in 1155 bytes} [Sat Oct 22 20:49:15 2022] DELETE /compute/v2.1/os-aggregates/18 => generated 0 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 22 20:49:16.061214 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-7c23445d-722f-4070-a386-55c32c40e480 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:49:16.062952 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-7c23445d-722f-4070-a386-55c32c40e480 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] [instance: 5c3de24c-090d-4769-8975-207eb939b979] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:49:16.096829 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7c23445d-722f-4070-a386-55c32c40e480 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:16.101362 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7c23445d-722f-4070-a386-55c32c40e480 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:16.102960 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7c23445d-722f-4070-a386-55c32c40e480 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:16.107062 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7c23445d-722f-4070-a386-55c32c40e480 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:16.108655 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7c23445d-722f-4070-a386-55c32c40e480 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:16.110330 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7c23445d-722f-4070-a386-55c32c40e480 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:16.382405 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-7c23445d-722f-4070-a386-55c32c40e480 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1ce98c66024d49b31e8e4f38b82838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a20f8f858424c89bf67a56feb720ac9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:49:16.412977 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-7c23445d-722f-4070-a386-55c32c40e480 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed1ce98c66024d49b31e8e4f38b82838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a20f8f858424c89bf67a56feb720ac9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:49:16.416104 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-7c23445d-722f-4070-a386-55c32c40e480 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed1ce98c66024d49b31e8e4f38b82838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a20f8f858424c89bf67a56feb720ac9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:49:16.435895 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-7c23445d-722f-4070-a386-55c32c40e480 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] 10.222.0.18 "GET /compute/v2.1/servers/5c3de24c-090d-4769-8975-207eb939b979" status: 200 len: 1446 microversion: 2.75 time: 0.391433 Oct 22 20:49:16.438046 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 140/326] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 20:49:16 2022] GET /compute/v2.1/servers/5c3de24c-090d-4769-8975-207eb939b979 => generated 1446 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 20:49:16.480002 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-f3da4ad9-45f0-447a-a526-1278593638be tempest-QuotasAdminNegativeTest-220159200 tempest-QuotasAdminNegativeTest-220159200-project] Flavor limits 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 20:49:16.481212 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-f3da4ad9-45f0-447a-a526-1278593638be tempest-QuotasAdminNegativeTest-220159200 tempest-QuotasAdminNegativeTest-220159200-project] Image limits 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 20:49:16.481840 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-f3da4ad9-45f0-447a-a526-1278593638be tempest-QuotasAdminNegativeTest-220159200 tempest-QuotasAdminNegativeTest-220159200-project] Flavor pref 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 20:49:16.482451 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-f3da4ad9-45f0-447a-a526-1278593638be tempest-QuotasAdminNegativeTest-220159200 tempest-QuotasAdminNegativeTest-220159200-project] Image pref 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 20:49:16.482868 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-f3da4ad9-45f0-447a-a526-1278593638be tempest-QuotasAdminNegativeTest-220159200 tempest-QuotasAdminNegativeTest-220159200-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 20:49:16.494987 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-bce91683-56cf-4de2-812c-8880c4fdc667 tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:49:16.495567 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-bce91683-56cf-4de2-812c-8880c4fdc667 tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] [instance: e169b57b-4899-4a9e-80a9-d6290eb63ceb] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:49:16.508771 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f3da4ad9-45f0-447a-a526-1278593638be tempest-QuotasAdminNegativeTest-220159200 tempest-QuotasAdminNegativeTest-220159200-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:16.509257 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f3da4ad9-45f0-447a-a526-1278593638be tempest-QuotasAdminNegativeTest-220159200 tempest-QuotasAdminNegativeTest-220159200-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:16.509692 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f3da4ad9-45f0-447a-a526-1278593638be tempest-QuotasAdminNegativeTest-220159200 tempest-QuotasAdminNegativeTest-220159200-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:16.510413 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f3da4ad9-45f0-447a-a526-1278593638be tempest-QuotasAdminNegativeTest-220159200 tempest-QuotasAdminNegativeTest-220159200-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:16.510862 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f3da4ad9-45f0-447a-a526-1278593638be tempest-QuotasAdminNegativeTest-220159200 tempest-QuotasAdminNegativeTest-220159200-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:16.511289 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f3da4ad9-45f0-447a-a526-1278593638be tempest-QuotasAdminNegativeTest-220159200 tempest-QuotasAdminNegativeTest-220159200-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:16.514447 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bce91683-56cf-4de2-812c-8880c4fdc667 tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:16.514962 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bce91683-56cf-4de2-812c-8880c4fdc667 tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:16.515454 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bce91683-56cf-4de2-812c-8880c4fdc667 tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:16.516386 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bce91683-56cf-4de2-812c-8880c4fdc667 tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:16.516982 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bce91683-56cf-4de2-812c-8880c4fdc667 tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:16.517676 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bce91683-56cf-4de2-812c-8880c4fdc667 tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:16.563854 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-bce91683-56cf-4de2-812c-8880c4fdc667 tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] HTTP exception thrown: Instance e169b57b-4899-4a9e-80a9-d6290eb63ceb could not be found. Oct 22 20:49:16.568992 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-bce91683-56cf-4de2-812c-8880c4fdc667 tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Request method failure captured: Oct 22 20:49:16.568992 ncdv-master-1 devstack@n-api.service[138744]: request: DELETE /compute/v2.1/servers/e169b57b-4899-4a9e-80a9-d6290eb63ceb HTTP/1.1 Oct 22 20:49:16.568992 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 20:49:16.568992 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 20:49:16.568992 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 20:49:16.568992 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 0 Oct 22 20:49:16.568992 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 20:49:16.568992 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 20:49:16.568992 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 20:49:16.568992 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 20:49:16.568992 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVFcR3Gi1yX1pP_GmeDbM5thuRvx-N5c64yQJ8A7DkfEbppSLPquXJ-e4bh1vd_15bl0K9SilbWS4_BrSso52A59gsGmA-DYleAGCI409pkI_KF_KpTPtTodEqbftxW9AErrml4mCwQFhzzMrkj2Se3xSckyD9Fmvlv3FtmH_2IxnJA0 Oct 22 20:49:16.568992 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 20:49:16.568992 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 20:49:16.568992 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 20:49:16.568992 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 20:49:16.568992 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 20:49:16.568992 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 20:49:16.568992 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: ae95f5dee52f4235b3478cc90f3b0347 Oct 22 20:49:16.568992 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-AggregatesAdminTestJSON-166487075 Oct 22 20:49:16.568992 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 20:49:16.568992 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 20:49:16.570519 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ae95f5dee52f4235b3478cc90f3b0347"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ae95f5dee52f4235b3478cc90f3b0347"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ae95f5dee52f4235b3478cc90f3b0347"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ae95f5dee52f4235b3478cc90f3b0347"}]}] Oct 22 20:49:16.570519 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-AggregatesAdminTestJSON-166487075 Oct 22 20:49:16.570519 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: ae95f5dee52f4235b3478cc90f3b0347 Oct 22 20:49:16.570519 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-166487075 Oct 22 20:49:16.570519 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-AggregatesAdminTestJSON-166487075-project Oct 22 20:49:16.570519 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 20:49:16.570519 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 20:49:16.570519 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: 6de80d628cf14694af6d2cd16f16afad Oct 22 20:49:16.570519 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-AggregatesAdminTestJSON-166487075-project Oct 22 20:49:16.570519 ncdv-master-1 devstack@n-api.service[138744]: method: > Oct 22 20:49:16.570519 ncdv-master-1 devstack@n-api.service[138744]: exception: Instance e169b57b-4899-4a9e-80a9-d6290eb63ceb could not be found. Oct 22 20:49:16.570519 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': 'e169b57b-4899-4a9e-80a9-d6290eb63ceb'} Oct 22 20:49:16.571322 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:49:16.571322 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:49:16.571322 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 20:49:16.571322 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 20:49:16.571322 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 20:49:16.571322 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 20:49:16.571322 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 20:49:16.571322 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 20:49:16.571322 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 20:49:16.571322 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 20:49:16.571322 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e169b57b-4899-4a9e-80a9-d6290eb63ceb could not be found. Oct 22 20:49:16.571322 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:49:16.571322 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:49:16.571322 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:49:16.571322 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:49:16.571322 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:49:16.571322 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:49:16.571322 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:49:16.571322 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:49:16.571322 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:49:16.572707 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:49:16.572707 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 22 20:49:16.572707 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 22 20:49:16.572707 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 22 20:49:16.572707 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 22 20:49:16.572707 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 20:49:16.572707 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 20:49:16.572707 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 20:49:16.572707 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 20:49:16.572707 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e169b57b-4899-4a9e-80a9-d6290eb63ceb could not be found. Oct 22 20:49:16.572707 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:49:16.572707 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:49:16.572707 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:49:16.572707 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:49:16.572707 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:49:16.572707 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:49:16.572707 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 20:49:16.572707 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 20:49:16.572707 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e169b57b-4899-4a9e-80a9-d6290eb63ceb could not be found. Oct 22 20:49:16.572707 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:49:16.576972 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-f3da4ad9-45f0-447a-a526-1278593638be tempest-QuotasAdminNegativeTest-220159200 tempest-QuotasAdminNegativeTest-220159200-project] Getting quotas for project 164a0764f87b4526a9a4cc7f19117f1f. Resources: {'cores', 'instances', 'ram'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 20:49:16.577114 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-bce91683-56cf-4de2-812c-8880c4fdc667 tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Returning 404 to user: Instance e169b57b-4899-4a9e-80a9-d6290eb63ceb could not be found. {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:49:16.577832 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-bce91683-56cf-4de2-812c-8880c4fdc667 tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] 10.222.0.18 "DELETE /compute/v2.1/servers/e169b57b-4899-4a9e-80a9-d6290eb63ceb" status: 404 len: 111 microversion: 2.1 time: 0.111949 Oct 22 20:49:16.578419 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 141/327] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 20:49:16 2022] DELETE /compute/v2.1/servers/e169b57b-4899-4a9e-80a9-d6290eb63ceb => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 20:49:16.588605 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-f3da4ad9-45f0-447a-a526-1278593638be tempest-QuotasAdminNegativeTest-220159200 tempest-QuotasAdminNegativeTest-220159200-project] Getting quotas for user 86ff0818a46743dc8f1a0320eb613cf2 and project 164a0764f87b4526a9a4cc7f19117f1f. Resources: {'cores', 'instances', 'ram'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 20:49:16.603798 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-38eb4893-fdf4-446b-97f5-b18ee0d52ef6 tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:49:16.606861 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-38eb4893-fdf4-446b-97f5-b18ee0d52ef6 tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] [instance: e169b57b-4899-4a9e-80a9-d6290eb63ceb] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:49:16.620189 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-38eb4893-fdf4-446b-97f5-b18ee0d52ef6 tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:16.620687 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-38eb4893-fdf4-446b-97f5-b18ee0d52ef6 tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:16.621138 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-38eb4893-fdf4-446b-97f5-b18ee0d52ef6 tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:16.621846 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-38eb4893-fdf4-446b-97f5-b18ee0d52ef6 tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:16.622307 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-38eb4893-fdf4-446b-97f5-b18ee0d52ef6 tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:16.629164 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-38eb4893-fdf4-446b-97f5-b18ee0d52ef6 tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:16.644582 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.utils [None req-f3da4ad9-45f0-447a-a526-1278593638be tempest-QuotasAdminNegativeTest-220159200 tempest-QuotasAdminNegativeTest-220159200-project] ram quota exceeded for 164a0764f87b4526a9a4cc7f19117f1f, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=138745) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Oct 22 20:49:16.649749 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.wsgi [None req-f3da4ad9-45f0-447a-a526-1278593638be tempest-QuotasAdminNegativeTest-220159200 tempest-QuotasAdminNegativeTest-220159200-project] HTTP exception thrown: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 22 20:49:16.659188 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-f3da4ad9-45f0-447a-a526-1278593638be tempest-QuotasAdminNegativeTest-220159200 tempest-QuotasAdminNegativeTest-220159200-project] Request method failure captured: Oct 22 20:49:16.659188 ncdv-master-1 devstack@n-api.service[138745]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 22 20:49:16.659188 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 20:49:16.659188 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 20:49:16.659188 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 20:49:16.659188 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 144 Oct 22 20:49:16.659188 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 20:49:16.659188 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 20:49:16.659188 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 20:49:16.659188 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 20:49:16.659188 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVFdBdt_jpp6OlkiUgC6CAOUuG44kuvwlEO6SardfVzcSX3ugb-rcT5pF4VlZcV_TlQ4dG9RYIRE-91qMCgCtQfRrdbrFZ3EPoBQbwtNIOQkJIVaU54gsXpJazF5OpTzC3KBUkjSYd-7sLY0_x53he8hnNEq4UOciMdqN3cpoUSaiS4w Oct 22 20:49:16.659188 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 20:49:16.659188 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 20:49:16.659188 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 20:49:16.659188 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 20:49:16.659188 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 20:49:16.659188 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 20:49:16.659188 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: 164a0764f87b4526a9a4cc7f19117f1f Oct 22 20:49:16.659188 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-QuotasAdminNegativeTest-220159200 Oct 22 20:49:16.659188 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 20:49:16.659188 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 20:49:16.660741 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_164a0764f87b4526a9a4cc7f19117f1f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/164a0764f87b4526a9a4cc7f19117f1f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/164a0764f87b4526a9a4cc7f19117f1f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/164a0764f87b4526a9a4cc7f19117f1f"}]}] Oct 22 20:49:16.660741 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-QuotasAdminNegativeTest-220159200 Oct 22 20:49:16.660741 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: 164a0764f87b4526a9a4cc7f19117f1f Oct 22 20:49:16.660741 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-220159200 Oct 22 20:49:16.660741 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-QuotasAdminNegativeTest-220159200-project Oct 22 20:49:16.660741 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 20:49:16.660741 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 20:49:16.660741 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: 86ff0818a46743dc8f1a0320eb613cf2 Oct 22 20:49:16.660741 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-QuotasAdminNegativeTest-220159200-project Oct 22 20:49:16.660741 ncdv-master-1 devstack@n-api.service[138745]: Oct 22 20:49:16.660741 ncdv-master-1 devstack@n-api.service[138745]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-285388771", "imageRef": "085e4478-6edc-4a69-8e08-f9831713eb65", "flavorRef": "452"}} Oct 22 20:49:16.660741 ncdv-master-1 devstack@n-api.service[138745]: method: > Oct 22 20:49:16.661606 ncdv-master-1 devstack@n-api.service[138745]: exception: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 22 20:49:16.661606 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-285388771', 'imageRef': '085e4478-6edc-4a69-8e08-f9831713eb65', 'flavorRef': '452'}}} Oct 22 20:49:16.661606 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:49:16.661606 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:49:16.661606 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Oct 22 20:49:16.661606 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Oct 22 20:49:16.661606 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 22 20:49:16.661606 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 22 20:49:16.661606 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 22 20:49:16.661606 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exc Oct 22 20:49:16.661606 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 22 20:49:16.661606 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 22 20:49:16.661606 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 22 20:49:16.661606 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 22 20:49:16.661606 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 22 20:49:16.661606 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 22 20:49:16.661606 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 22 20:49:16.661606 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 22 20:49:16.663048 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Oct 22 20:49:16.663048 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 22 20:49:16.663048 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Oct 22 20:49:16.663048 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:49:16.663048 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:49:16.663048 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:49:16.663048 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:49:16.663048 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 22 20:49:16.663048 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 22 20:49:16.663048 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 22 20:49:16.663048 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 22 20:49:16.663048 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Oct 22 20:49:16.663048 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Oct 22 20:49:16.663048 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Oct 22 20:49:16.663048 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Oct 22 20:49:16.663048 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Oct 22 20:49:16.663048 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 22 20:49:16.663048 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 22 20:49:16.663048 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:49:16.663048 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:49:16.663048 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:49:16.664405 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:49:16.664405 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:49:16.664405 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:49:16.664405 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:49:16.664405 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:49:16.664405 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:49:16.664405 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:49:16.664405 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 20:49:16.664405 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 20:49:16.664405 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 20:49:16.664405 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 20:49:16.664405 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 20:49:16.664405 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 20:49:16.664405 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 22 20:49:16.664405 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 22 20:49:16.664405 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 22 20:49:16.664405 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 22 20:49:16.664405 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:49:16.664405 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:49:16.664405 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:49:16.664405 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:49:16.665698 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:49:16.665698 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:49:16.665698 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 20:49:16.665698 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 20:49:16.665698 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 22 20:49:16.665698 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:49:16.668853 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-f3da4ad9-45f0-447a-a526-1278593638be tempest-QuotasAdminNegativeTest-220159200 tempest-QuotasAdminNegativeTest-220159200-project] Returning 403 to user: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:49:16.670032 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-f3da4ad9-45f0-447a-a526-1278593638be tempest-QuotasAdminNegativeTest-220159200 tempest-QuotasAdminNegativeTest-220159200-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 403 len: 110 microversion: 2.1 time: 0.987296 Oct 22 20:49:16.671109 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 187/328] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Oct 22 20:49:15 2022] POST /compute/v2.1/servers => generated 110 bytes in 989 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 22 20:49:16.683996 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-b2453ff6-d7b1-458f-ac1c-9bfb152ebcce tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:49:16.685441 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-38eb4893-fdf4-446b-97f5-b18ee0d52ef6 tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] HTTP exception thrown: Instance e169b57b-4899-4a9e-80a9-d6290eb63ceb could not be found. Oct 22 20:49:16.686517 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-b2453ff6-d7b1-458f-ac1c-9bfb152ebcce tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] [instance: 1d613848-05f4-478f-a569-b4c50576edb7] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:49:16.687045 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-38eb4893-fdf4-446b-97f5-b18ee0d52ef6 tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Request method failure captured: Oct 22 20:49:16.687045 ncdv-master-1 devstack@n-api.service[138744]: request: GET /compute/v2.1/servers/e169b57b-4899-4a9e-80a9-d6290eb63ceb HTTP/1.1 Oct 22 20:49:16.687045 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 20:49:16.687045 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 20:49:16.687045 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 20:49:16.687045 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 0 Oct 22 20:49:16.687045 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 20:49:16.687045 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 20:49:16.687045 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 20:49:16.687045 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 20:49:16.687045 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVFcR3Gi1yX1pP_GmeDbM5thuRvx-N5c64yQJ8A7DkfEbppSLPquXJ-e4bh1vd_15bl0K9SilbWS4_BrSso52A59gsGmA-DYleAGCI409pkI_KF_KpTPtTodEqbftxW9AErrml4mCwQFhzzMrkj2Se3xSckyD9Fmvlv3FtmH_2IxnJA0 Oct 22 20:49:16.687045 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 20:49:16.687045 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 20:49:16.687045 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 20:49:16.687045 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 20:49:16.687045 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 20:49:16.687045 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 20:49:16.687045 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: ae95f5dee52f4235b3478cc90f3b0347 Oct 22 20:49:16.687045 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-AggregatesAdminTestJSON-166487075 Oct 22 20:49:16.687045 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 20:49:16.687045 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 20:49:16.688466 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ae95f5dee52f4235b3478cc90f3b0347"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ae95f5dee52f4235b3478cc90f3b0347"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ae95f5dee52f4235b3478cc90f3b0347"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ae95f5dee52f4235b3478cc90f3b0347"}]}] Oct 22 20:49:16.688466 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-AggregatesAdminTestJSON-166487075 Oct 22 20:49:16.688466 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: ae95f5dee52f4235b3478cc90f3b0347 Oct 22 20:49:16.688466 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-166487075 Oct 22 20:49:16.688466 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-AggregatesAdminTestJSON-166487075-project Oct 22 20:49:16.688466 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 20:49:16.688466 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 20:49:16.688466 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: 6de80d628cf14694af6d2cd16f16afad Oct 22 20:49:16.688466 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-AggregatesAdminTestJSON-166487075-project Oct 22 20:49:16.688466 ncdv-master-1 devstack@n-api.service[138744]: method: > Oct 22 20:49:16.688466 ncdv-master-1 devstack@n-api.service[138744]: exception: Instance e169b57b-4899-4a9e-80a9-d6290eb63ceb could not be found. Oct 22 20:49:16.688466 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': 'e169b57b-4899-4a9e-80a9-d6290eb63ceb'} Oct 22 20:49:16.689110 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:49:16.689110 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:49:16.689110 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 20:49:16.689110 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 20:49:16.689110 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 20:49:16.689110 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 20:49:16.689110 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 20:49:16.689110 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 20:49:16.689110 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 20:49:16.689110 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 20:49:16.689110 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e169b57b-4899-4a9e-80a9-d6290eb63ceb could not be found. Oct 22 20:49:16.689110 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:49:16.689110 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:49:16.689110 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:49:16.689110 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:49:16.689110 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:49:16.689110 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:49:16.689110 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:49:16.689110 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:49:16.689110 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:49:16.690198 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:49:16.690198 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 20:49:16.690198 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 20:49:16.690198 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 20:49:16.690198 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 20:49:16.690198 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 20:49:16.690198 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 20:49:16.690198 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e169b57b-4899-4a9e-80a9-d6290eb63ceb could not be found. Oct 22 20:49:16.690198 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:49:16.690198 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:49:16.690198 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:49:16.690198 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:49:16.690198 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:49:16.690198 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:49:16.690198 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 20:49:16.690198 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 20:49:16.690198 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e169b57b-4899-4a9e-80a9-d6290eb63ceb could not be found. Oct 22 20:49:16.690198 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:49:16.691311 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-38eb4893-fdf4-446b-97f5-b18ee0d52ef6 tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] Returning 404 to user: Instance e169b57b-4899-4a9e-80a9-d6290eb63ceb could not be found. {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:49:16.691311 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-38eb4893-fdf4-446b-97f5-b18ee0d52ef6 tempest-AggregatesAdminTestJSON-166487075 tempest-AggregatesAdminTestJSON-166487075-project] 10.222.0.18 "GET /compute/v2.1/servers/e169b57b-4899-4a9e-80a9-d6290eb63ceb" status: 404 len: 111 microversion: 2.1 time: 0.102648 Oct 22 20:49:16.691642 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 142/329] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:49:16 2022] GET /compute/v2.1/servers/e169b57b-4899-4a9e-80a9-d6290eb63ceb => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 20:49:16.701795 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-3de77838-c2db-494d-b972-317bc0d8bcda tempest-QuotasAdminNegativeTest-1726628264 tempest-QuotasAdminNegativeTest-1726628264-project-admin] Action: 'update', calling method: .version_select at 0x7fd3a4b0bd30>, body: {"quota_set": {"ram": 51200}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:49:16.718434 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b2453ff6-d7b1-458f-ac1c-9bfb152ebcce tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:16.719083 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b2453ff6-d7b1-458f-ac1c-9bfb152ebcce tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:16.719725 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b2453ff6-d7b1-458f-ac1c-9bfb152ebcce tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:16.720658 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b2453ff6-d7b1-458f-ac1c-9bfb152ebcce tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:16.722076 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b2453ff6-d7b1-458f-ac1c-9bfb152ebcce tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:16.724281 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b2453ff6-d7b1-458f-ac1c-9bfb152ebcce tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:16.891199 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-b2453ff6-d7b1-458f-ac1c-9bfb152ebcce tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:49:16.903101 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-b2453ff6-d7b1-458f-ac1c-9bfb152ebcce tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:49:16.904876 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-b2453ff6-d7b1-458f-ac1c-9bfb152ebcce tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:49:16.906325 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-b2453ff6-d7b1-458f-ac1c-9bfb152ebcce tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] 10.222.0.18 "GET /compute/v2.1/servers/1d613848-05f4-478f-a569-b4c50576edb7" status: 200 len: 1314 microversion: 2.25 time: 0.233164 Oct 22 20:49:16.907177 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 188/330] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 20:49:16 2022] GET /compute/v2.1/servers/1d613848-05f4-478f-a569-b4c50576edb7 => generated 1314 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 20:49:16.979808 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-4fbfded3-a4ce-4793-8910-e9cee7ecc8fb tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:49:16.980655 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-4fbfded3-a4ce-4793-8910-e9cee7ecc8fb tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] [instance: 96add0b3-b82f-4a0a-bec3-9a6341ae5dec] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:49:16.989087 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4fbfded3-a4ce-4793-8910-e9cee7ecc8fb tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:16.997408 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4fbfded3-a4ce-4793-8910-e9cee7ecc8fb tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:16.998530 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4fbfded3-a4ce-4793-8910-e9cee7ecc8fb tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:16.999982 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4fbfded3-a4ce-4793-8910-e9cee7ecc8fb tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:17.003596 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4fbfded3-a4ce-4793-8910-e9cee7ecc8fb tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:17.004326 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4fbfded3-a4ce-4793-8910-e9cee7ecc8fb tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:17.288628 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-4fbfded3-a4ce-4793-8910-e9cee7ecc8fb tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e13dcabaaa4b218945aeeabb4c902e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675a324f0134844a1964f64322493ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:49:17.308481 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-4fbfded3-a4ce-4793-8910-e9cee7ecc8fb tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] 10.222.0.18 "GET /compute/v2.1/servers/96add0b3-b82f-4a0a-bec3-9a6341ae5dec" status: 200 len: 1320 microversion: 2.1 time: 0.333974 Oct 22 20:49:17.314490 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 189/331] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:49:16 2022] GET /compute/v2.1/servers/96add0b3-b82f-4a0a-bec3-9a6341ae5dec => generated 1320 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 20:49:17.451305 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3de77838-c2db-494d-b972-317bc0d8bcda tempest-QuotasAdminNegativeTest-1726628264 tempest-QuotasAdminNegativeTest-1726628264-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:17.451886 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3de77838-c2db-494d-b972-317bc0d8bcda tempest-QuotasAdminNegativeTest-1726628264 tempest-QuotasAdminNegativeTest-1726628264-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:17.452172 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3de77838-c2db-494d-b972-317bc0d8bcda tempest-QuotasAdminNegativeTest-1726628264 tempest-QuotasAdminNegativeTest-1726628264-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:17.454640 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3de77838-c2db-494d-b972-317bc0d8bcda tempest-QuotasAdminNegativeTest-1726628264 tempest-QuotasAdminNegativeTest-1726628264-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:17.457569 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3de77838-c2db-494d-b972-317bc0d8bcda tempest-QuotasAdminNegativeTest-1726628264 tempest-QuotasAdminNegativeTest-1726628264-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:17.458241 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3de77838-c2db-494d-b972-317bc0d8bcda tempest-QuotasAdminNegativeTest-1726628264 tempest-QuotasAdminNegativeTest-1726628264-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:17.473368 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-0bd8ced6-07b9-45ce-ab84-3354cd66d1af tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:49:17.474423 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-0bd8ced6-07b9-45ce-ab84-3354cd66d1af tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] [instance: 5c3de24c-090d-4769-8975-207eb939b979] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:49:17.492779 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0bd8ced6-07b9-45ce-ab84-3354cd66d1af tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:17.493415 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0bd8ced6-07b9-45ce-ab84-3354cd66d1af tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:17.495534 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0bd8ced6-07b9-45ce-ab84-3354cd66d1af tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:17.499700 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0bd8ced6-07b9-45ce-ab84-3354cd66d1af tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:17.500185 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0bd8ced6-07b9-45ce-ab84-3354cd66d1af tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:17.506347 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0bd8ced6-07b9-45ce-ab84-3354cd66d1af tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:17.511266 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:SELECT=100 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:49:17.691297 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-3de77838-c2db-494d-b972-317bc0d8bcda tempest-QuotasAdminNegativeTest-1726628264 tempest-QuotasAdminNegativeTest-1726628264-project-admin] 10.222.0.18 "PUT /compute/v2.1/os-quota-sets/164a0764f87b4526a9a4cc7f19117f1f" status: 200 len: 329 microversion: 2.1 time: 0.998337 Oct 22 20:49:17.694044 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 143/332] 10.222.0.18 () {60 vars in 1262 bytes} [Sat Oct 22 20:49:16 2022] PUT /compute/v2.1/os-quota-sets/164a0764f87b4526a9a4cc7f19117f1f => generated 329 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:49:17.698964 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-0bd8ced6-07b9-45ce-ab84-3354cd66d1af tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1ce98c66024d49b31e8e4f38b82838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a20f8f858424c89bf67a56feb720ac9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:49:17.713173 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-0bd8ced6-07b9-45ce-ab84-3354cd66d1af tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed1ce98c66024d49b31e8e4f38b82838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a20f8f858424c89bf67a56feb720ac9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:49:17.728448 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-0bd8ced6-07b9-45ce-ab84-3354cd66d1af tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed1ce98c66024d49b31e8e4f38b82838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a20f8f858424c89bf67a56feb720ac9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:49:17.735085 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-0bd8ced6-07b9-45ce-ab84-3354cd66d1af tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] 10.222.0.18 "GET /compute/v2.1/servers/5c3de24c-090d-4769-8975-207eb939b979" status: 200 len: 1446 microversion: 2.75 time: 0.269276 Oct 22 20:49:17.754884 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 190/333] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 20:49:17 2022] GET /compute/v2.1/servers/5c3de24c-090d-4769-8975-207eb939b979 => generated 1446 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 22 20:49:17.760851 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-934918ce-9620-4d66-a19e-15a41fc69fd7 tempest-QuotasAdminNegativeTest-220159200 tempest-QuotasAdminNegativeTest-220159200-project] Action: 'update', calling method: .version_select at 0x7fd3a4a3b040>, body: {"quota_set": {"ram": 0}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:49:17.777585 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-934918ce-9620-4d66-a19e-15a41fc69fd7 tempest-QuotasAdminNegativeTest-220159200 tempest-QuotasAdminNegativeTest-220159200-project] Policy check for os_compute_api:os-quota-sets:update failed with credentials {'is_admin': False, 'user_id': '86ff0818a46743dc8f1a0320eb613cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164a0764f87b4526a9a4cc7f19117f1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:49:17.781303 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-934918ce-9620-4d66-a19e-15a41fc69fd7 tempest-QuotasAdminNegativeTest-220159200 tempest-QuotasAdminNegativeTest-220159200-project] Request method failure captured: Oct 22 20:49:17.781303 ncdv-master-1 devstack@n-api.service[138745]: request: PUT /compute/v2.1/os-quota-sets/164a0764f87b4526a9a4cc7f19117f1f HTTP/1.1 Oct 22 20:49:17.781303 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 20:49:17.781303 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 20:49:17.781303 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 20:49:17.781303 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 25 Oct 22 20:49:17.781303 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 20:49:17.781303 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 20:49:17.781303 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 20:49:17.781303 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 20:49:17.781303 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVFdBdt_jpp6OlkiUgC6CAOUuG44kuvwlEO6SardfVzcSX3ugb-rcT5pF4VlZcV_TlQ4dG9RYIRE-91qMCgCtQfRrdbrFZ3EPoBQbwtNIOQkJIVaU54gsXpJazF5OpTzC3KBUkjSYd-7sLY0_x53he8hnNEq4UOciMdqN3cpoUSaiS4w Oct 22 20:49:17.781303 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 20:49:17.781303 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 20:49:17.781303 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 20:49:17.781303 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 20:49:17.781303 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 20:49:17.781303 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 20:49:17.781303 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: 164a0764f87b4526a9a4cc7f19117f1f Oct 22 20:49:17.781303 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-QuotasAdminNegativeTest-220159200 Oct 22 20:49:17.781303 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 20:49:17.781303 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 20:49:17.782794 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_164a0764f87b4526a9a4cc7f19117f1f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/164a0764f87b4526a9a4cc7f19117f1f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/164a0764f87b4526a9a4cc7f19117f1f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/164a0764f87b4526a9a4cc7f19117f1f"}]}] Oct 22 20:49:17.782794 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-QuotasAdminNegativeTest-220159200 Oct 22 20:49:17.782794 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: 164a0764f87b4526a9a4cc7f19117f1f Oct 22 20:49:17.782794 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-220159200 Oct 22 20:49:17.782794 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-QuotasAdminNegativeTest-220159200-project Oct 22 20:49:17.782794 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 20:49:17.782794 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 20:49:17.782794 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: 86ff0818a46743dc8f1a0320eb613cf2 Oct 22 20:49:17.782794 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-QuotasAdminNegativeTest-220159200-project Oct 22 20:49:17.782794 ncdv-master-1 devstack@n-api.service[138745]: Oct 22 20:49:17.782794 ncdv-master-1 devstack@n-api.service[138745]: {"quota_set": {"ram": 0}} Oct 22 20:49:17.782794 ncdv-master-1 devstack@n-api.service[138745]: method: Oct 22 20:49:17.782794 ncdv-master-1 devstack@n-api.service[138745]: exception: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Oct 22 20:49:17.782794 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'id': '164a0764f87b4526a9a4cc7f19117f1f', 'body': {'quota_set': {'ram': 0}}} Oct 22 20:49:17.784478 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:49:17.784478 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:49:17.784478 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:49:17.784478 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:49:17.784478 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:49:17.784478 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:49:17.784478 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 22 20:49:17.784478 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 22 20:49:17.784478 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:49:17.784478 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:49:17.784478 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 20:49:17.784478 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 20:49:17.784478 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 170, in update Oct 22 20:49:17.784478 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return self._update(req, id, body, []) Oct 22 20:49:17.784478 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 22 20:49:17.784478 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 20:49:17.784478 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 22 20:49:17.784478 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 20:49:17.784478 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 189, in _update Oct 22 20:49:17.785866 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi context.can(qs_policies.POLICY_ROOT % 'update', {'project_id': id}) Oct 22 20:49:17.785866 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 22 20:49:17.785866 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 22 20:49:17.785866 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 22 20:49:17.785866 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 22 20:49:17.785866 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 22 20:49:17.785866 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 22 20:49:17.785866 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 22 20:49:17.785866 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise self.value Oct 22 20:49:17.785866 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 22 20:49:17.785866 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 22 20:49:17.785866 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 22 20:49:17.785866 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 22 20:49:17.785866 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 22 20:49:17.785866 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 22 20:49:17.785866 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Oct 22 20:49:17.785866 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:49:17.785866 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:49:17.785866 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:49:17.785866 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:49:17.787215 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:49:17.787215 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:49:17.787215 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 22 20:49:17.787215 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 22 20:49:17.787215 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Oct 22 20:49:17.787215 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:49:17.787215 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-934918ce-9620-4d66-a19e-15a41fc69fd7 tempest-QuotasAdminNegativeTest-220159200 tempest-QuotasAdminNegativeTest-220159200-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:49:17.787215 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-934918ce-9620-4d66-a19e-15a41fc69fd7 tempest-QuotasAdminNegativeTest-220159200 tempest-QuotasAdminNegativeTest-220159200-project] 10.222.0.18 "PUT /compute/v2.1/os-quota-sets/164a0764f87b4526a9a4cc7f19117f1f" status: 403 len: 116 microversion: 2.1 time: 0.034414 Oct 22 20:49:17.788785 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 191/334] 10.222.0.18 () {60 vars in 1262 bytes} [Sat Oct 22 20:49:17 2022] PUT /compute/v2.1/os-quota-sets/164a0764f87b4526a9a4cc7f19117f1f => generated 116 bytes in 38 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 22 20:49:17.934698 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-64de614e-6a1a-466b-918f-0baf8cf3d3cd tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:49:17.935904 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-64de614e-6a1a-466b-918f-0baf8cf3d3cd tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] [instance: 1d613848-05f4-478f-a569-b4c50576edb7] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:49:17.956279 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-64de614e-6a1a-466b-918f-0baf8cf3d3cd tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:17.956698 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-64de614e-6a1a-466b-918f-0baf8cf3d3cd tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:17.958107 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-64de614e-6a1a-466b-918f-0baf8cf3d3cd tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:17.964925 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-64de614e-6a1a-466b-918f-0baf8cf3d3cd tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:17.965643 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-64de614e-6a1a-466b-918f-0baf8cf3d3cd tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:17.967712 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-64de614e-6a1a-466b-918f-0baf8cf3d3cd tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:18.047175 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-01448291-ed6b-44a2-958b-7f4d5bb26d06 tempest-HostsAdminTestJSON-698514808 tempest-HostsAdminTestJSON-698514808-project-admin] Calling method '.version_select at 0x7fd3a4851820>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:49:18.051865 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-01448291-ed6b-44a2-958b-7f4d5bb26d06 tempest-HostsAdminTestJSON-698514808 tempest-HostsAdminTestJSON-698514808-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:18.052368 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-01448291-ed6b-44a2-958b-7f4d5bb26d06 tempest-HostsAdminTestJSON-698514808 tempest-HostsAdminTestJSON-698514808-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:18.052817 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-01448291-ed6b-44a2-958b-7f4d5bb26d06 tempest-HostsAdminTestJSON-698514808 tempest-HostsAdminTestJSON-698514808-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:18.053561 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-01448291-ed6b-44a2-958b-7f4d5bb26d06 tempest-HostsAdminTestJSON-698514808 tempest-HostsAdminTestJSON-698514808-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:18.054026 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-01448291-ed6b-44a2-958b-7f4d5bb26d06 tempest-HostsAdminTestJSON-698514808 tempest-HostsAdminTestJSON-698514808-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:18.054462 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-01448291-ed6b-44a2-958b-7f4d5bb26d06 tempest-HostsAdminTestJSON-698514808 tempest-HostsAdminTestJSON-698514808-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:18.093307 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell0:SELECT=31 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:49:18.126209 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-64de614e-6a1a-466b-918f-0baf8cf3d3cd tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:49:18.145026 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-64de614e-6a1a-466b-918f-0baf8cf3d3cd tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:49:18.147320 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-64de614e-6a1a-466b-918f-0baf8cf3d3cd tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:49:18.149859 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-64de614e-6a1a-466b-918f-0baf8cf3d3cd tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] 10.222.0.18 "GET /compute/v2.1/servers/1d613848-05f4-478f-a569-b4c50576edb7" status: 200 len: 1320 microversion: 2.25 time: 0.221150 Oct 22 20:49:18.151152 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 192/335] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 20:49:17 2022] GET /compute/v2.1/servers/1d613848-05f4-478f-a569-b4c50576edb7 => generated 1320 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 22 20:49:18.164085 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-01448291-ed6b-44a2-958b-7f4d5bb26d06 tempest-HostsAdminTestJSON-698514808 tempest-HostsAdminTestJSON-698514808-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hosts" status: 200 len: 379 microversion: 2.1 time: 0.462485 Oct 22 20:49:18.168856 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 144/336] 10.222.0.18 () {58 vars in 1128 bytes} [Sat Oct 22 20:49:17 2022] GET /compute/v2.1/os-hosts => generated 379 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:49:18.189078 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-8d1727fc-3453-446a-a66e-557e9d1fc8fe tempest-HostsAdminTestJSON-698514808 tempest-HostsAdminTestJSON-698514808-project-admin] Calling method '.version_select at 0x7fd3a48114c0>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:49:18.221477 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8d1727fc-3453-446a-a66e-557e9d1fc8fe tempest-HostsAdminTestJSON-698514808 tempest-HostsAdminTestJSON-698514808-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:18.223699 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8d1727fc-3453-446a-a66e-557e9d1fc8fe tempest-HostsAdminTestJSON-698514808 tempest-HostsAdminTestJSON-698514808-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:18.225041 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8d1727fc-3453-446a-a66e-557e9d1fc8fe tempest-HostsAdminTestJSON-698514808 tempest-HostsAdminTestJSON-698514808-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:18.225940 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8d1727fc-3453-446a-a66e-557e9d1fc8fe tempest-HostsAdminTestJSON-698514808 tempest-HostsAdminTestJSON-698514808-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:18.226533 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8d1727fc-3453-446a-a66e-557e9d1fc8fe tempest-HostsAdminTestJSON-698514808 tempest-HostsAdminTestJSON-698514808-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:18.227440 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8d1727fc-3453-446a-a66e-557e9d1fc8fe tempest-HostsAdminTestJSON-698514808 tempest-HostsAdminTestJSON-698514808-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:18.291244 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-8d1727fc-3453-446a-a66e-557e9d1fc8fe tempest-HostsAdminTestJSON-698514808 tempest-HostsAdminTestJSON-698514808-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hosts?zone=" status: 200 len: 379 microversion: 2.1 time: 0.119833 Oct 22 20:49:18.307272 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 145/337] 10.222.0.18 () {58 vars in 1139 bytes} [Sat Oct 22 20:49:18 2022] GET /compute/v2.1/os-hosts?zone= => generated 379 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:49:18.313320 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-3a0f3cc6-0470-46c0-a3a0-6cbbe244cf86 tempest-HostsAdminTestJSON-698514808 tempest-HostsAdminTestJSON-698514808-project-admin] Calling method '.version_select at 0x7fd3a4968280>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:49:18.319741 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3a0f3cc6-0470-46c0-a3a0-6cbbe244cf86 tempest-HostsAdminTestJSON-698514808 tempest-HostsAdminTestJSON-698514808-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:18.320416 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3a0f3cc6-0470-46c0-a3a0-6cbbe244cf86 tempest-HostsAdminTestJSON-698514808 tempest-HostsAdminTestJSON-698514808-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:18.320919 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3a0f3cc6-0470-46c0-a3a0-6cbbe244cf86 tempest-HostsAdminTestJSON-698514808 tempest-HostsAdminTestJSON-698514808-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:18.321878 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3a0f3cc6-0470-46c0-a3a0-6cbbe244cf86 tempest-HostsAdminTestJSON-698514808 tempest-HostsAdminTestJSON-698514808-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:18.322513 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3a0f3cc6-0470-46c0-a3a0-6cbbe244cf86 tempest-HostsAdminTestJSON-698514808 tempest-HostsAdminTestJSON-698514808-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:18.323261 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3a0f3cc6-0470-46c0-a3a0-6cbbe244cf86 tempest-HostsAdminTestJSON-698514808 tempest-HostsAdminTestJSON-698514808-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:18.335753 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell1:SELECT=100 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:49:18.339914 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-767d1154-df83-495a-9fee-467b2e7801f5 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:49:18.340608 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-767d1154-df83-495a-9fee-467b2e7801f5 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] [instance: 96add0b3-b82f-4a0a-bec3-9a6341ae5dec] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:49:18.353211 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-767d1154-df83-495a-9fee-467b2e7801f5 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:18.353718 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-767d1154-df83-495a-9fee-467b2e7801f5 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:18.354182 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-767d1154-df83-495a-9fee-467b2e7801f5 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:18.356401 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-767d1154-df83-495a-9fee-467b2e7801f5 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:18.357555 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-767d1154-df83-495a-9fee-467b2e7801f5 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:18.359750 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-767d1154-df83-495a-9fee-467b2e7801f5 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:18.369437 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-3a0f3cc6-0470-46c0-a3a0-6cbbe244cf86 tempest-HostsAdminTestJSON-698514808 tempest-HostsAdminTestJSON-698514808-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hosts?zone=xxx" status: 200 len: 13 microversion: 2.1 time: 0.059992 Oct 22 20:49:18.371162 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 193/338] 10.222.0.18 () {58 vars in 1145 bytes} [Sat Oct 22 20:49:18 2022] GET /compute/v2.1/os-hosts?zone=xxx => generated 13 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 22 20:49:18.391984 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-fa831349-843c-4182-a430-dece2c09efc5 tempest-HostsAdminTestJSON-698514808 tempest-HostsAdminTestJSON-698514808-project-admin] Calling method '.version_select at 0x7fd3a4d6d3a0>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:49:18.402263 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fa831349-843c-4182-a430-dece2c09efc5 tempest-HostsAdminTestJSON-698514808 tempest-HostsAdminTestJSON-698514808-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:18.404121 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fa831349-843c-4182-a430-dece2c09efc5 tempest-HostsAdminTestJSON-698514808 tempest-HostsAdminTestJSON-698514808-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:18.405855 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fa831349-843c-4182-a430-dece2c09efc5 tempest-HostsAdminTestJSON-698514808 tempest-HostsAdminTestJSON-698514808-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:18.409185 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fa831349-843c-4182-a430-dece2c09efc5 tempest-HostsAdminTestJSON-698514808 tempest-HostsAdminTestJSON-698514808-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:18.410598 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fa831349-843c-4182-a430-dece2c09efc5 tempest-HostsAdminTestJSON-698514808 tempest-HostsAdminTestJSON-698514808-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:18.411731 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fa831349-843c-4182-a430-dece2c09efc5 tempest-HostsAdminTestJSON-698514808 tempest-HostsAdminTestJSON-698514808-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:18.473398 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-fa831349-843c-4182-a430-dece2c09efc5 tempest-HostsAdminTestJSON-698514808 tempest-HostsAdminTestJSON-698514808-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hosts" status: 200 len: 379 microversion: 2.1 time: 0.091727 Oct 22 20:49:18.474812 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 194/339] 10.222.0.18 () {58 vars in 1128 bytes} [Sat Oct 22 20:49:18 2022] GET /compute/v2.1/os-hosts => generated 379 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:49:18.486605 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-c0ae13d9-1c1b-4cb1-ab4e-db5b7ee6c0ae tempest-HostsAdminTestJSON-698514808 tempest-HostsAdminTestJSON-698514808-project-admin] Calling method '.version_select at 0x7fd3ab106b80>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:49:18.492784 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c0ae13d9-1c1b-4cb1-ab4e-db5b7ee6c0ae tempest-HostsAdminTestJSON-698514808 tempest-HostsAdminTestJSON-698514808-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:18.494253 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c0ae13d9-1c1b-4cb1-ab4e-db5b7ee6c0ae tempest-HostsAdminTestJSON-698514808 tempest-HostsAdminTestJSON-698514808-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:18.495373 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c0ae13d9-1c1b-4cb1-ab4e-db5b7ee6c0ae tempest-HostsAdminTestJSON-698514808 tempest-HostsAdminTestJSON-698514808-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:18.496439 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c0ae13d9-1c1b-4cb1-ab4e-db5b7ee6c0ae tempest-HostsAdminTestJSON-698514808 tempest-HostsAdminTestJSON-698514808-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:18.497196 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c0ae13d9-1c1b-4cb1-ab4e-db5b7ee6c0ae tempest-HostsAdminTestJSON-698514808 tempest-HostsAdminTestJSON-698514808-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:18.498281 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c0ae13d9-1c1b-4cb1-ab4e-db5b7ee6c0ae tempest-HostsAdminTestJSON-698514808 tempest-HostsAdminTestJSON-698514808-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:18.533391 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-c0ae13d9-1c1b-4cb1-ab4e-db5b7ee6c0ae tempest-HostsAdminTestJSON-698514808 tempest-HostsAdminTestJSON-698514808-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hosts?zone=internal" status: 200 len: 239 microversion: 2.1 time: 0.051487 Oct 22 20:49:18.535497 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 195/340] 10.222.0.18 () {58 vars in 1155 bytes} [Sat Oct 22 20:49:18 2022] GET /compute/v2.1/os-hosts?zone=internal => generated 239 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:49:18.547556 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-7969bf00-a7e6-4cfb-8339-92f318561c60 tempest-HostsAdminTestJSON-698514808 tempest-HostsAdminTestJSON-698514808-project-admin] Calling method '.version_select at 0x7fd3a4a10550>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:49:18.552797 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7969bf00-a7e6-4cfb-8339-92f318561c60 tempest-HostsAdminTestJSON-698514808 tempest-HostsAdminTestJSON-698514808-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:18.554236 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7969bf00-a7e6-4cfb-8339-92f318561c60 tempest-HostsAdminTestJSON-698514808 tempest-HostsAdminTestJSON-698514808-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:18.562285 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7969bf00-a7e6-4cfb-8339-92f318561c60 tempest-HostsAdminTestJSON-698514808 tempest-HostsAdminTestJSON-698514808-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:18.563235 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7969bf00-a7e6-4cfb-8339-92f318561c60 tempest-HostsAdminTestJSON-698514808 tempest-HostsAdminTestJSON-698514808-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:18.563842 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7969bf00-a7e6-4cfb-8339-92f318561c60 tempest-HostsAdminTestJSON-698514808 tempest-HostsAdminTestJSON-698514808-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:18.564462 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7969bf00-a7e6-4cfb-8339-92f318561c60 tempest-HostsAdminTestJSON-698514808 tempest-HostsAdminTestJSON-698514808-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:18.602985 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-7969bf00-a7e6-4cfb-8339-92f318561c60 tempest-HostsAdminTestJSON-698514808 tempest-HostsAdminTestJSON-698514808-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hosts" status: 200 len: 379 microversion: 2.1 time: 0.058887 Oct 22 20:49:18.609799 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 196/341] 10.222.0.18 () {58 vars in 1128 bytes} [Sat Oct 22 20:49:18 2022] GET /compute/v2.1/os-hosts => generated 379 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:49:18.618391 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-64b7c5d6-e02b-4935-acc5-ee526e3d738e tempest-HostsAdminTestJSON-698514808 tempest-HostsAdminTestJSON-698514808-project-admin] Calling method '.version_select at 0x7fd3a4a18040>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:49:18.634973 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-64b7c5d6-e02b-4935-acc5-ee526e3d738e tempest-HostsAdminTestJSON-698514808 tempest-HostsAdminTestJSON-698514808-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:18.635516 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-64b7c5d6-e02b-4935-acc5-ee526e3d738e tempest-HostsAdminTestJSON-698514808 tempest-HostsAdminTestJSON-698514808-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:18.638135 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-64b7c5d6-e02b-4935-acc5-ee526e3d738e tempest-HostsAdminTestJSON-698514808 tempest-HostsAdminTestJSON-698514808-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:18.651908 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-767d1154-df83-495a-9fee-467b2e7801f5 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e13dcabaaa4b218945aeeabb4c902e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675a324f0134844a1964f64322493ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:49:18.661505 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-767d1154-df83-495a-9fee-467b2e7801f5 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] 10.222.0.18 "GET /compute/v2.1/servers/96add0b3-b82f-4a0a-bec3-9a6341ae5dec" status: 200 len: 1320 microversion: 2.1 time: 0.325626 Oct 22 20:49:18.663418 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 146/342] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:49:18 2022] GET /compute/v2.1/servers/96add0b3-b82f-4a0a-bec3-9a6341ae5dec => generated 1320 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 20:49:18.670425 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-64b7c5d6-e02b-4935-acc5-ee526e3d738e tempest-HostsAdminTestJSON-698514808 tempest-HostsAdminTestJSON-698514808-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:18.671460 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-64b7c5d6-e02b-4935-acc5-ee526e3d738e tempest-HostsAdminTestJSON-698514808 tempest-HostsAdminTestJSON-698514808-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:18.674107 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-64b7c5d6-e02b-4935-acc5-ee526e3d738e tempest-HostsAdminTestJSON-698514808 tempest-HostsAdminTestJSON-698514808-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:18.694197 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-64b7c5d6-e02b-4935-acc5-ee526e3d738e tempest-HostsAdminTestJSON-698514808 tempest-HostsAdminTestJSON-698514808-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hosts/nch2-master-1" status: 200 len: 598 microversion: 2.1 time: 0.082869 Oct 22 20:49:18.695246 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 197/343] 10.222.0.18 () {58 vars in 1170 bytes} [Sat Oct 22 20:49:18 2022] GET /compute/v2.1/os-hosts/nch2-master-1 => generated 598 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:49:18.708636 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-abca0ba9-ab17-4596-a67c-abb791bde0f6 tempest-HostsAdminTestJSON-698514808 tempest-HostsAdminTestJSON-698514808-project-admin] Calling method '.version_select at 0x7fd3a4811160>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:49:18.724644 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-abca0ba9-ab17-4596-a67c-abb791bde0f6 tempest-HostsAdminTestJSON-698514808 tempest-HostsAdminTestJSON-698514808-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:18.725065 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-abca0ba9-ab17-4596-a67c-abb791bde0f6 tempest-HostsAdminTestJSON-698514808 tempest-HostsAdminTestJSON-698514808-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:18.726553 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-abca0ba9-ab17-4596-a67c-abb791bde0f6 tempest-HostsAdminTestJSON-698514808 tempest-HostsAdminTestJSON-698514808-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:18.767297 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-aa407d99-4c45-4108-bb4a-07d545300807 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:49:18.768243 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-aa407d99-4c45-4108-bb4a-07d545300807 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] [instance: 5c3de24c-090d-4769-8975-207eb939b979] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:49:18.768361 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-abca0ba9-ab17-4596-a67c-abb791bde0f6 tempest-HostsAdminTestJSON-698514808 tempest-HostsAdminTestJSON-698514808-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:18.769815 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-abca0ba9-ab17-4596-a67c-abb791bde0f6 tempest-HostsAdminTestJSON-698514808 tempest-HostsAdminTestJSON-698514808-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:18.770927 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-abca0ba9-ab17-4596-a67c-abb791bde0f6 tempest-HostsAdminTestJSON-698514808 tempest-HostsAdminTestJSON-698514808-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:18.782043 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-aa407d99-4c45-4108-bb4a-07d545300807 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:18.787172 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-aa407d99-4c45-4108-bb4a-07d545300807 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:18.792193 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-aa407d99-4c45-4108-bb4a-07d545300807 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:18.792193 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-aa407d99-4c45-4108-bb4a-07d545300807 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:18.792193 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-aa407d99-4c45-4108-bb4a-07d545300807 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:18.792193 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-aa407d99-4c45-4108-bb4a-07d545300807 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:18.814073 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-abca0ba9-ab17-4596-a67c-abb791bde0f6 tempest-HostsAdminTestJSON-698514808 tempest-HostsAdminTestJSON-698514808-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hosts/nch1-master-1" status: 200 len: 467 microversion: 2.1 time: 0.112136 Oct 22 20:49:18.823650 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 147/344] 10.222.0.18 () {58 vars in 1170 bytes} [Sat Oct 22 20:49:18 2022] GET /compute/v2.1/os-hosts/nch1-master-1 => generated 467 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:49:18.943215 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-aa407d99-4c45-4108-bb4a-07d545300807 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1ce98c66024d49b31e8e4f38b82838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a20f8f858424c89bf67a56feb720ac9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:49:18.957009 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-aa407d99-4c45-4108-bb4a-07d545300807 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed1ce98c66024d49b31e8e4f38b82838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a20f8f858424c89bf67a56feb720ac9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:49:18.963694 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-aa407d99-4c45-4108-bb4a-07d545300807 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed1ce98c66024d49b31e8e4f38b82838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a20f8f858424c89bf67a56feb720ac9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:49:18.978773 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-aa407d99-4c45-4108-bb4a-07d545300807 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] 10.222.0.18 "GET /compute/v2.1/servers/5c3de24c-090d-4769-8975-207eb939b979" status: 200 len: 1446 microversion: 2.75 time: 0.213520 Oct 22 20:49:18.979800 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 198/345] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 20:49:18 2022] GET /compute/v2.1/servers/5c3de24c-090d-4769-8975-207eb939b979 => generated 1446 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 20:49:19.180634 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-d3781f12-dcc0-43d9-ac8d-6e5fd0f81237 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:49:19.182094 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-d3781f12-dcc0-43d9-ac8d-6e5fd0f81237 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] [instance: 1d613848-05f4-478f-a569-b4c50576edb7] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:49:19.194660 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d3781f12-dcc0-43d9-ac8d-6e5fd0f81237 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:19.195333 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d3781f12-dcc0-43d9-ac8d-6e5fd0f81237 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:19.196139 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d3781f12-dcc0-43d9-ac8d-6e5fd0f81237 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:19.197020 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d3781f12-dcc0-43d9-ac8d-6e5fd0f81237 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:19.198932 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d3781f12-dcc0-43d9-ac8d-6e5fd0f81237 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:19.200826 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d3781f12-dcc0-43d9-ac8d-6e5fd0f81237 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:19.474439 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-d3781f12-dcc0-43d9-ac8d-6e5fd0f81237 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:49:19.488589 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-d3781f12-dcc0-43d9-ac8d-6e5fd0f81237 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:49:19.495283 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-d3781f12-dcc0-43d9-ac8d-6e5fd0f81237 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:49:19.498268 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-d3781f12-dcc0-43d9-ac8d-6e5fd0f81237 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] 10.222.0.18 "GET /compute/v2.1/servers/1d613848-05f4-478f-a569-b4c50576edb7" status: 200 len: 1362 microversion: 2.25 time: 0.321602 Oct 22 20:49:19.501195 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 148/346] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 20:49:19 2022] GET /compute/v2.1/servers/1d613848-05f4-478f-a569-b4c50576edb7 => generated 1362 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 20:49:19.690243 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-27e974b2-3867-480e-8624-94737b0be67f tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:49:19.691027 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-27e974b2-3867-480e-8624-94737b0be67f tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] [instance: 96add0b3-b82f-4a0a-bec3-9a6341ae5dec] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:49:19.701129 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_api:SELECT=92,nova_api:DELETE=6,nova_api:INSERT=2 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:49:19.714471 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-27e974b2-3867-480e-8624-94737b0be67f tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:19.714985 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-27e974b2-3867-480e-8624-94737b0be67f tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:19.715468 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-27e974b2-3867-480e-8624-94737b0be67f tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:19.716212 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-27e974b2-3867-480e-8624-94737b0be67f tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:19.721134 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-27e974b2-3867-480e-8624-94737b0be67f tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:19.722395 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-27e974b2-3867-480e-8624-94737b0be67f tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:20.014453 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-b78fd716-a5e4-4483-ab0c-73ac9f6bdeab tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:49:20.015083 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-b78fd716-a5e4-4483-ab0c-73ac9f6bdeab tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] [instance: 5c3de24c-090d-4769-8975-207eb939b979] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:49:20.048045 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b78fd716-a5e4-4483-ab0c-73ac9f6bdeab tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:20.048571 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b78fd716-a5e4-4483-ab0c-73ac9f6bdeab tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:20.049084 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b78fd716-a5e4-4483-ab0c-73ac9f6bdeab tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:20.054705 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b78fd716-a5e4-4483-ab0c-73ac9f6bdeab tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:20.055180 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b78fd716-a5e4-4483-ab0c-73ac9f6bdeab tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:20.063470 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b78fd716-a5e4-4483-ab0c-73ac9f6bdeab tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:20.200891 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-27e974b2-3867-480e-8624-94737b0be67f tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e13dcabaaa4b218945aeeabb4c902e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675a324f0134844a1964f64322493ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:49:20.213405 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-27e974b2-3867-480e-8624-94737b0be67f tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] 10.222.0.18 "GET /compute/v2.1/servers/96add0b3-b82f-4a0a-bec3-9a6341ae5dec" status: 200 len: 1320 microversion: 2.1 time: 0.525164 Oct 22 20:49:20.216234 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 199/347] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:49:19 2022] GET /compute/v2.1/servers/96add0b3-b82f-4a0a-bec3-9a6341ae5dec => generated 1320 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:49:20.305771 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-b78fd716-a5e4-4483-ab0c-73ac9f6bdeab tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1ce98c66024d49b31e8e4f38b82838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a20f8f858424c89bf67a56feb720ac9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:49:20.316395 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-b78fd716-a5e4-4483-ab0c-73ac9f6bdeab tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed1ce98c66024d49b31e8e4f38b82838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a20f8f858424c89bf67a56feb720ac9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:49:20.317913 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-b78fd716-a5e4-4483-ab0c-73ac9f6bdeab tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed1ce98c66024d49b31e8e4f38b82838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a20f8f858424c89bf67a56feb720ac9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:49:20.334358 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-b78fd716-a5e4-4483-ab0c-73ac9f6bdeab tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] 10.222.0.18 "GET /compute/v2.1/servers/5c3de24c-090d-4769-8975-207eb939b979" status: 200 len: 1446 microversion: 2.75 time: 0.331786 Oct 22 20:49:20.336663 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 149/348] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 20:49:20 2022] GET /compute/v2.1/servers/5c3de24c-090d-4769-8975-207eb939b979 => generated 1446 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 20:49:20.527869 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-afe0d3ce-13db-427f-8e2a-1c7b726bc8fd tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:49:20.528810 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-afe0d3ce-13db-427f-8e2a-1c7b726bc8fd tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] [instance: 1d613848-05f4-478f-a569-b4c50576edb7] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:49:20.556073 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-afe0d3ce-13db-427f-8e2a-1c7b726bc8fd tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:20.557309 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-afe0d3ce-13db-427f-8e2a-1c7b726bc8fd tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:20.559992 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-afe0d3ce-13db-427f-8e2a-1c7b726bc8fd tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:20.560763 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-afe0d3ce-13db-427f-8e2a-1c7b726bc8fd tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:20.561235 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-afe0d3ce-13db-427f-8e2a-1c7b726bc8fd tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:20.561670 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-afe0d3ce-13db-427f-8e2a-1c7b726bc8fd tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:20.899444 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-afe0d3ce-13db-427f-8e2a-1c7b726bc8fd tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:49:20.918849 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-afe0d3ce-13db-427f-8e2a-1c7b726bc8fd tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:49:20.925733 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-afe0d3ce-13db-427f-8e2a-1c7b726bc8fd tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:49:20.927333 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-afe0d3ce-13db-427f-8e2a-1c7b726bc8fd tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] 10.222.0.18 "GET /compute/v2.1/servers/1d613848-05f4-478f-a569-b4c50576edb7" status: 200 len: 1362 microversion: 2.25 time: 0.404696 Oct 22 20:49:20.928150 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 200/349] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 20:49:20 2022] GET /compute/v2.1/servers/1d613848-05f4-478f-a569-b4c50576edb7 => generated 1362 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 20:49:21.157122 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-88f11f22-d8b0-4971-a836-60381abf6191 req-30d4a7cb-b569-4a35-a9be-954cdda91fbd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96add0b3-b82f-4a0a-bec3-9a6341ae5dec", "name": "network-vif-plugged", "status": "completed", "tag": "0fd2316a-3787-46da-84c3-1064f9a62d40"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:49:21.176938 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-88f11f22-d8b0-4971-a836-60381abf6191 req-30d4a7cb-b569-4a35-a9be-954cdda91fbd service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:21.177435 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-88f11f22-d8b0-4971-a836-60381abf6191 req-30d4a7cb-b569-4a35-a9be-954cdda91fbd service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:21.178627 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-88f11f22-d8b0-4971-a836-60381abf6191 req-30d4a7cb-b569-4a35-a9be-954cdda91fbd service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:21.206777 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-88f11f22-d8b0-4971-a836-60381abf6191 req-30d4a7cb-b569-4a35-a9be-954cdda91fbd service nova] Creating event network-vif-plugged:0fd2316a-3787-46da-84c3-1064f9a62d40 for instance 96add0b3-b82f-4a0a-bec3-9a6341ae5dec on nch2-master-1 Oct 22 20:49:21.240248 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-484631d9-04ec-4fe2-a341-ef6ce180c4ba tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:49:21.240855 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-484631d9-04ec-4fe2-a341-ef6ce180c4ba tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] [instance: 96add0b3-b82f-4a0a-bec3-9a6341ae5dec] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:49:21.241967 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-88f11f22-d8b0-4971-a836-60381abf6191 req-30d4a7cb-b569-4a35-a9be-954cdda91fbd service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078527 Oct 22 20:49:21.244234 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 150/350] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:49:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:49:21.255804 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-484631d9-04ec-4fe2-a341-ef6ce180c4ba tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:21.257336 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-484631d9-04ec-4fe2-a341-ef6ce180c4ba tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:21.257964 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-484631d9-04ec-4fe2-a341-ef6ce180c4ba tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:21.258928 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-484631d9-04ec-4fe2-a341-ef6ce180c4ba tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:21.259633 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-484631d9-04ec-4fe2-a341-ef6ce180c4ba tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:21.261694 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-484631d9-04ec-4fe2-a341-ef6ce180c4ba tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:21.368581 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-07b74786-b3f1-483f-8906-f714fec5f2a6 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:49:21.369971 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-07b74786-b3f1-483f-8906-f714fec5f2a6 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] [instance: 5c3de24c-090d-4769-8975-207eb939b979] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:49:21.395119 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-07b74786-b3f1-483f-8906-f714fec5f2a6 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:21.398729 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-07b74786-b3f1-483f-8906-f714fec5f2a6 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:21.403964 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-07b74786-b3f1-483f-8906-f714fec5f2a6 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:21.404958 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-07b74786-b3f1-483f-8906-f714fec5f2a6 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:21.407461 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-07b74786-b3f1-483f-8906-f714fec5f2a6 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:21.409051 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-07b74786-b3f1-483f-8906-f714fec5f2a6 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:21.676220 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-484631d9-04ec-4fe2-a341-ef6ce180c4ba tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e13dcabaaa4b218945aeeabb4c902e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675a324f0134844a1964f64322493ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:49:21.688956 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-484631d9-04ec-4fe2-a341-ef6ce180c4ba tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] 10.222.0.18 "GET /compute/v2.1/servers/96add0b3-b82f-4a0a-bec3-9a6341ae5dec" status: 200 len: 1320 microversion: 2.1 time: 0.453077 Oct 22 20:49:21.691730 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 201/351] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:49:21 2022] GET /compute/v2.1/servers/96add0b3-b82f-4a0a-bec3-9a6341ae5dec => generated 1320 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 20:49:21.711141 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-07b74786-b3f1-483f-8906-f714fec5f2a6 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1ce98c66024d49b31e8e4f38b82838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a20f8f858424c89bf67a56feb720ac9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:49:21.730648 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-07b74786-b3f1-483f-8906-f714fec5f2a6 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed1ce98c66024d49b31e8e4f38b82838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a20f8f858424c89bf67a56feb720ac9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:49:21.732195 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-07b74786-b3f1-483f-8906-f714fec5f2a6 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed1ce98c66024d49b31e8e4f38b82838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a20f8f858424c89bf67a56feb720ac9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:49:21.747938 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-07b74786-b3f1-483f-8906-f714fec5f2a6 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] 10.222.0.18 "GET /compute/v2.1/servers/5c3de24c-090d-4769-8975-207eb939b979" status: 200 len: 1446 microversion: 2.75 time: 0.385485 Oct 22 20:49:21.751410 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 151/352] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 20:49:21 2022] GET /compute/v2.1/servers/5c3de24c-090d-4769-8975-207eb939b979 => generated 1446 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 20:49:21.955473 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-a1208276-a944-4589-b02a-c63447127ab8 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:49:21.957022 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-a1208276-a944-4589-b02a-c63447127ab8 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] [instance: 1d613848-05f4-478f-a569-b4c50576edb7] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:49:21.991052 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a1208276-a944-4589-b02a-c63447127ab8 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:21.992120 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a1208276-a944-4589-b02a-c63447127ab8 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:21.992797 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a1208276-a944-4589-b02a-c63447127ab8 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:21.993787 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a1208276-a944-4589-b02a-c63447127ab8 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:21.994674 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a1208276-a944-4589-b02a-c63447127ab8 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:21.995326 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a1208276-a944-4589-b02a-c63447127ab8 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:22.571239 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-a1208276-a944-4589-b02a-c63447127ab8 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:49:22.587656 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-a1208276-a944-4589-b02a-c63447127ab8 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:49:22.591976 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-a1208276-a944-4589-b02a-c63447127ab8 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:49:22.594950 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-a1208276-a944-4589-b02a-c63447127ab8 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] 10.222.0.18 "GET /compute/v2.1/servers/1d613848-05f4-478f-a569-b4c50576edb7" status: 200 len: 1362 microversion: 2.25 time: 0.644157 Oct 22 20:49:22.609289 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 202/353] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 20:49:21 2022] GET /compute/v2.1/servers/1d613848-05f4-478f-a569-b4c50576edb7 => generated 1362 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 20:49:22.716944 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-7483d2cb-f44a-433e-865f-c74f2216ef50 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:49:22.718441 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-7483d2cb-f44a-433e-865f-c74f2216ef50 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] [instance: 96add0b3-b82f-4a0a-bec3-9a6341ae5dec] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:49:22.731874 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7483d2cb-f44a-433e-865f-c74f2216ef50 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:22.733711 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7483d2cb-f44a-433e-865f-c74f2216ef50 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:22.734624 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7483d2cb-f44a-433e-865f-c74f2216ef50 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:22.735815 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7483d2cb-f44a-433e-865f-c74f2216ef50 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:22.736520 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7483d2cb-f44a-433e-865f-c74f2216ef50 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:22.738082 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7483d2cb-f44a-433e-865f-c74f2216ef50 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:22.781398 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-c9069cd8-aeef-4a89-a10c-4e1914bafc2e tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:49:22.782077 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-c9069cd8-aeef-4a89-a10c-4e1914bafc2e tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] [instance: 5c3de24c-090d-4769-8975-207eb939b979] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:49:22.801672 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c9069cd8-aeef-4a89-a10c-4e1914bafc2e tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:22.802195 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c9069cd8-aeef-4a89-a10c-4e1914bafc2e tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:22.802653 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c9069cd8-aeef-4a89-a10c-4e1914bafc2e tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:22.804600 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c9069cd8-aeef-4a89-a10c-4e1914bafc2e tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:22.805071 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c9069cd8-aeef-4a89-a10c-4e1914bafc2e tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:22.805529 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c9069cd8-aeef-4a89-a10c-4e1914bafc2e tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:22.997768 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-c9069cd8-aeef-4a89-a10c-4e1914bafc2e tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1ce98c66024d49b31e8e4f38b82838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a20f8f858424c89bf67a56feb720ac9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:49:23.026392 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-c9069cd8-aeef-4a89-a10c-4e1914bafc2e tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed1ce98c66024d49b31e8e4f38b82838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a20f8f858424c89bf67a56feb720ac9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:49:23.032733 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-c9069cd8-aeef-4a89-a10c-4e1914bafc2e tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed1ce98c66024d49b31e8e4f38b82838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a20f8f858424c89bf67a56feb720ac9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:49:23.059680 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-c9069cd8-aeef-4a89-a10c-4e1914bafc2e tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] 10.222.0.18 "GET /compute/v2.1/servers/5c3de24c-090d-4769-8975-207eb939b979" status: 200 len: 1446 microversion: 2.75 time: 0.281895 Oct 22 20:49:23.060278 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 203/354] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 20:49:22 2022] GET /compute/v2.1/servers/5c3de24c-090d-4769-8975-207eb939b979 => generated 1446 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 22 20:49:23.088160 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-59f5ca86-f9ec-41a1-a64b-2158174a45da req-41f97e1a-c94a-4197-96d6-acfbbe05d56a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d613848-05f4-478f-a569-b4c50576edb7", "tag": "6bf75146-c298-478b-aee3-b0be607e5d87"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:49:23.088319 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-7483d2cb-f44a-433e-865f-c74f2216ef50 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e13dcabaaa4b218945aeeabb4c902e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675a324f0134844a1964f64322493ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:49:23.105749 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-7483d2cb-f44a-433e-865f-c74f2216ef50 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] 10.222.0.18 "GET /compute/v2.1/servers/96add0b3-b82f-4a0a-bec3-9a6341ae5dec" status: 200 len: 1320 microversion: 2.1 time: 0.393374 Oct 22 20:49:23.108960 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 152/355] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:49:22 2022] GET /compute/v2.1/servers/96add0b3-b82f-4a0a-bec3-9a6341ae5dec => generated 1320 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:49:23.125735 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-59f5ca86-f9ec-41a1-a64b-2158174a45da req-41f97e1a-c94a-4197-96d6-acfbbe05d56a service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:23.130293 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-59f5ca86-f9ec-41a1-a64b-2158174a45da req-41f97e1a-c94a-4197-96d6-acfbbe05d56a service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:23.130834 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-59f5ca86-f9ec-41a1-a64b-2158174a45da req-41f97e1a-c94a-4197-96d6-acfbbe05d56a service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:23.153958 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-59f5ca86-f9ec-41a1-a64b-2158174a45da req-41f97e1a-c94a-4197-96d6-acfbbe05d56a service nova] Creating event network-changed:6bf75146-c298-478b-aee3-b0be607e5d87 for instance 1d613848-05f4-478f-a569-b4c50576edb7 on nch2-master-1 Oct 22 20:49:23.171683 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-59f5ca86-f9ec-41a1-a64b-2158174a45da req-41f97e1a-c94a-4197-96d6-acfbbe05d56a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103004 Oct 22 20:49:23.172583 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 204/356] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:49:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:49:23.625632 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-3cb7e9d4-e2ba-405f-a43f-047074e04e16 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:49:23.626355 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-3cb7e9d4-e2ba-405f-a43f-047074e04e16 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] [instance: 1d613848-05f4-478f-a569-b4c50576edb7] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:49:23.639662 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3cb7e9d4-e2ba-405f-a43f-047074e04e16 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:23.646038 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3cb7e9d4-e2ba-405f-a43f-047074e04e16 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:23.647356 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3cb7e9d4-e2ba-405f-a43f-047074e04e16 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:23.653880 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3cb7e9d4-e2ba-405f-a43f-047074e04e16 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:23.654439 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3cb7e9d4-e2ba-405f-a43f-047074e04e16 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:23.658046 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3cb7e9d4-e2ba-405f-a43f-047074e04e16 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:23.882131 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-3cb7e9d4-e2ba-405f-a43f-047074e04e16 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:49:23.894529 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-3cb7e9d4-e2ba-405f-a43f-047074e04e16 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:49:23.896994 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-3cb7e9d4-e2ba-405f-a43f-047074e04e16 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:49:23.898520 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-3cb7e9d4-e2ba-405f-a43f-047074e04e16 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] 10.222.0.18 "GET /compute/v2.1/servers/1d613848-05f4-478f-a569-b4c50576edb7" status: 200 len: 1362 microversion: 2.25 time: 0.277620 Oct 22 20:49:23.899553 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 205/357] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 20:49:23 2022] GET /compute/v2.1/servers/1d613848-05f4-478f-a569-b4c50576edb7 => generated 1362 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 22 20:49:23.986378 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-65220987-9cd3-476f-85d1-4bd3c68a63c1 tempest-AZAdminV2TestJSON-1896893101 tempest-AZAdminV2TestJSON-1896893101-project-admin] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:49:23.992950 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-65220987-9cd3-476f-85d1-4bd3c68a63c1 tempest-AZAdminV2TestJSON-1896893101 tempest-AZAdminV2TestJSON-1896893101-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:23.993470 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-65220987-9cd3-476f-85d1-4bd3c68a63c1 tempest-AZAdminV2TestJSON-1896893101 tempest-AZAdminV2TestJSON-1896893101-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:23.993913 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-65220987-9cd3-476f-85d1-4bd3c68a63c1 tempest-AZAdminV2TestJSON-1896893101 tempest-AZAdminV2TestJSON-1896893101-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:23.996411 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-65220987-9cd3-476f-85d1-4bd3c68a63c1 tempest-AZAdminV2TestJSON-1896893101 tempest-AZAdminV2TestJSON-1896893101-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:23.997222 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-65220987-9cd3-476f-85d1-4bd3c68a63c1 tempest-AZAdminV2TestJSON-1896893101 tempest-AZAdminV2TestJSON-1896893101-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:23.999395 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-65220987-9cd3-476f-85d1-4bd3c68a63c1 tempest-AZAdminV2TestJSON-1896893101 tempest-AZAdminV2TestJSON-1896893101-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:24.052965 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-65220987-9cd3-476f-85d1-4bd3c68a63c1 tempest-AZAdminV2TestJSON-1896893101 tempest-AZAdminV2TestJSON-1896893101-project-admin] 10.222.0.18 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.710890 Oct 22 20:49:24.054162 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 153/358] 10.222.0.18 () {58 vars in 1164 bytes} [Sat Oct 22 20:49:23 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 22 20:49:24.069959 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-f1437cc4-d593-467e-b352-65722a7a6c7a tempest-AZAdminV2TestJSON-1896893101 tempest-AZAdminV2TestJSON-1896893101-project-admin] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:49:24.071961 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f1437cc4-d593-467e-b352-65722a7a6c7a tempest-AZAdminV2TestJSON-1896893101 tempest-AZAdminV2TestJSON-1896893101-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:24.072454 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f1437cc4-d593-467e-b352-65722a7a6c7a tempest-AZAdminV2TestJSON-1896893101 tempest-AZAdminV2TestJSON-1896893101-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:24.073064 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f1437cc4-d593-467e-b352-65722a7a6c7a tempest-AZAdminV2TestJSON-1896893101 tempest-AZAdminV2TestJSON-1896893101-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:24.074061 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f1437cc4-d593-467e-b352-65722a7a6c7a tempest-AZAdminV2TestJSON-1896893101 tempest-AZAdminV2TestJSON-1896893101-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:24.074689 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f1437cc4-d593-467e-b352-65722a7a6c7a tempest-AZAdminV2TestJSON-1896893101 tempest-AZAdminV2TestJSON-1896893101-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:24.075274 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f1437cc4-d593-467e-b352-65722a7a6c7a tempest-AZAdminV2TestJSON-1896893101 tempest-AZAdminV2TestJSON-1896893101-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:24.080935 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell0:SELECT=34 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:49:24.100018 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-661d9f4b-2e66-4fc4-bef5-8fff0980cbc0 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:49:24.103242 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-661d9f4b-2e66-4fc4-bef5-8fff0980cbc0 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] [instance: 5c3de24c-090d-4769-8975-207eb939b979] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:49:24.106106 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-f1437cc4-d593-467e-b352-65722a7a6c7a tempest-AZAdminV2TestJSON-1896893101 tempest-AZAdminV2TestJSON-1896893101-project-admin] 10.222.0.18 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 613 microversion: 2.1 time: 0.043107 Oct 22 20:49:24.116483 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 206/359] 10.222.0.18 () {58 vars in 1185 bytes} [Sat Oct 22 20:49:24 2022] GET /compute/v2.1/os-availability-zone/detail => generated 613 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:49:24.120403 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-661d9f4b-2e66-4fc4-bef5-8fff0980cbc0 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:24.121080 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-661d9f4b-2e66-4fc4-bef5-8fff0980cbc0 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:24.122001 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-661d9f4b-2e66-4fc4-bef5-8fff0980cbc0 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:24.125312 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-661d9f4b-2e66-4fc4-bef5-8fff0980cbc0 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:24.125971 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-661d9f4b-2e66-4fc4-bef5-8fff0980cbc0 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:24.126430 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-661d9f4b-2e66-4fc4-bef5-8fff0980cbc0 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:24.135651 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-c9d69966-2711-4b4a-9496-e05d458ded62 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:49:24.136587 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-c9d69966-2711-4b4a-9496-e05d458ded62 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] [instance: 96add0b3-b82f-4a0a-bec3-9a6341ae5dec] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:49:24.149542 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c9d69966-2711-4b4a-9496-e05d458ded62 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:24.152553 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c9d69966-2711-4b4a-9496-e05d458ded62 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:24.153116 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c9d69966-2711-4b4a-9496-e05d458ded62 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:24.155708 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c9d69966-2711-4b4a-9496-e05d458ded62 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:24.157413 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c9d69966-2711-4b4a-9496-e05d458ded62 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:24.158103 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c9d69966-2711-4b4a-9496-e05d458ded62 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:24.225392 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-661d9f4b-2e66-4fc4-bef5-8fff0980cbc0 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1ce98c66024d49b31e8e4f38b82838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a20f8f858424c89bf67a56feb720ac9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:49:24.240704 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-661d9f4b-2e66-4fc4-bef5-8fff0980cbc0 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed1ce98c66024d49b31e8e4f38b82838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a20f8f858424c89bf67a56feb720ac9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:49:24.243220 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-661d9f4b-2e66-4fc4-bef5-8fff0980cbc0 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed1ce98c66024d49b31e8e4f38b82838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a20f8f858424c89bf67a56feb720ac9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:49:24.280017 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-661d9f4b-2e66-4fc4-bef5-8fff0980cbc0 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] 10.222.0.18 "GET /compute/v2.1/servers/5c3de24c-090d-4769-8975-207eb939b979" status: 200 len: 1452 microversion: 2.75 time: 0.188276 Oct 22 20:49:24.283620 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 154/360] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 20:49:24 2022] GET /compute/v2.1/servers/5c3de24c-090d-4769-8975-207eb939b979 => generated 1452 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 20:49:24.456925 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-c9d69966-2711-4b4a-9496-e05d458ded62 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e13dcabaaa4b218945aeeabb4c902e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675a324f0134844a1964f64322493ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:49:24.465975 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-c9d69966-2711-4b4a-9496-e05d458ded62 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] 10.222.0.18 "GET /compute/v2.1/servers/96add0b3-b82f-4a0a-bec3-9a6341ae5dec" status: 200 len: 1470 microversion: 2.1 time: 0.334292 Oct 22 20:49:24.466563 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 207/361] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:49:24 2022] GET /compute/v2.1/servers/96add0b3-b82f-4a0a-bec3-9a6341ae5dec => generated 1470 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:49:24.490006 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-c437fa73-4c5b-44b3-8a37-78545a5ada5c tempest-DeleteServersAdminTestJSON-1839136719 tempest-DeleteServersAdminTestJSON-1839136719-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:49:24.492700 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-c437fa73-4c5b-44b3-8a37-78545a5ada5c tempest-DeleteServersAdminTestJSON-1839136719 tempest-DeleteServersAdminTestJSON-1839136719-project-admin] [instance: 96add0b3-b82f-4a0a-bec3-9a6341ae5dec] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:49:24.506865 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c437fa73-4c5b-44b3-8a37-78545a5ada5c tempest-DeleteServersAdminTestJSON-1839136719 tempest-DeleteServersAdminTestJSON-1839136719-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:24.507391 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c437fa73-4c5b-44b3-8a37-78545a5ada5c tempest-DeleteServersAdminTestJSON-1839136719 tempest-DeleteServersAdminTestJSON-1839136719-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:24.507844 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c437fa73-4c5b-44b3-8a37-78545a5ada5c tempest-DeleteServersAdminTestJSON-1839136719 tempest-DeleteServersAdminTestJSON-1839136719-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:24.508564 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c437fa73-4c5b-44b3-8a37-78545a5ada5c tempest-DeleteServersAdminTestJSON-1839136719 tempest-DeleteServersAdminTestJSON-1839136719-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:24.509020 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c437fa73-4c5b-44b3-8a37-78545a5ada5c tempest-DeleteServersAdminTestJSON-1839136719 tempest-DeleteServersAdminTestJSON-1839136719-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:24.513192 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c437fa73-4c5b-44b3-8a37-78545a5ada5c tempest-DeleteServersAdminTestJSON-1839136719 tempest-DeleteServersAdminTestJSON-1839136719-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:24.717298 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-c437fa73-4c5b-44b3-8a37-78545a5ada5c tempest-DeleteServersAdminTestJSON-1839136719 tempest-DeleteServersAdminTestJSON-1839136719-project-admin] 10.222.0.18 "POST /compute/v2.1/servers/96add0b3-b82f-4a0a-bec3-9a6341ae5dec/action" status: 202 len: 0 microversion: 2.1 time: 0.228912 Oct 22 20:49:24.721141 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 155/362] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 20:49:24 2022] POST /compute/v2.1/servers/96add0b3-b82f-4a0a-bec3-9a6341ae5dec/action => generated 0 bytes in 233 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 20:49:24.729637 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-2d4ac3b5-5ec9-4609-aa15-a529c511c613 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:49:24.730427 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-2d4ac3b5-5ec9-4609-aa15-a529c511c613 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] [instance: 96add0b3-b82f-4a0a-bec3-9a6341ae5dec] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:49:24.745057 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2d4ac3b5-5ec9-4609-aa15-a529c511c613 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:24.745696 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2d4ac3b5-5ec9-4609-aa15-a529c511c613 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:24.746374 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2d4ac3b5-5ec9-4609-aa15-a529c511c613 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:24.748470 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2d4ac3b5-5ec9-4609-aa15-a529c511c613 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:24.749008 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2d4ac3b5-5ec9-4609-aa15-a529c511c613 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:24.749560 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2d4ac3b5-5ec9-4609-aa15-a529c511c613 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:24.796200 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2d4ac3b5-5ec9-4609-aa15-a529c511c613 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:24.796922 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2d4ac3b5-5ec9-4609-aa15-a529c511c613 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:24.797571 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2d4ac3b5-5ec9-4609-aa15-a529c511c613 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:24.798484 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.objects.instance [None req-2d4ac3b5-5ec9-4609-aa15-a529c511c613 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Lazy-loading 'fault' on Instance uuid 96add0b3-b82f-4a0a-bec3-9a6341ae5dec {{(pid=138745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 20:49:24.926269 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-72ddee40-9c02-4c05-bedf-4f81580921f4 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:49:24.926886 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-72ddee40-9c02-4c05-bedf-4f81580921f4 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] [instance: 1d613848-05f4-478f-a569-b4c50576edb7] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:49:24.935391 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-72ddee40-9c02-4c05-bedf-4f81580921f4 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:24.936129 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-72ddee40-9c02-4c05-bedf-4f81580921f4 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:24.936725 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-72ddee40-9c02-4c05-bedf-4f81580921f4 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:24.937596 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-72ddee40-9c02-4c05-bedf-4f81580921f4 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:24.938520 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-72ddee40-9c02-4c05-bedf-4f81580921f4 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:24.939523 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-72ddee40-9c02-4c05-bedf-4f81580921f4 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:24.980261 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-2d4ac3b5-5ec9-4609-aa15-a529c511c613 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e13dcabaaa4b218945aeeabb4c902e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675a324f0134844a1964f64322493ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:49:24.992793 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-2d4ac3b5-5ec9-4609-aa15-a529c511c613 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] 10.222.0.18 "GET /compute/v2.1/servers/96add0b3-b82f-4a0a-bec3-9a6341ae5dec" status: 200 len: 1453 microversion: 2.1 time: 0.270147 Oct 22 20:49:25.003403 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 208/363] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:49:24 2022] GET /compute/v2.1/servers/96add0b3-b82f-4a0a-bec3-9a6341ae5dec => generated 1453 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:49:25.016386 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-acd00604-7357-4220-9ab3-7258c7f96523 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:49:25.016754 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-acd00604-7357-4220-9ab3-7258c7f96523 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] [instance: 96add0b3-b82f-4a0a-bec3-9a6341ae5dec] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:49:25.038196 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-acd00604-7357-4220-9ab3-7258c7f96523 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:25.038761 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-acd00604-7357-4220-9ab3-7258c7f96523 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:25.039218 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-acd00604-7357-4220-9ab3-7258c7f96523 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:25.048147 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-acd00604-7357-4220-9ab3-7258c7f96523 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:25.048638 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-acd00604-7357-4220-9ab3-7258c7f96523 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:25.049158 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-acd00604-7357-4220-9ab3-7258c7f96523 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:25.119999 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-acd00604-7357-4220-9ab3-7258c7f96523 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] [instance: 96add0b3-b82f-4a0a-bec3-9a6341ae5dec] Going to try to terminate instance {{(pid=138745) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 20:49:25.364523 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-72ddee40-9c02-4c05-bedf-4f81580921f4 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:49:25.382176 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-72ddee40-9c02-4c05-bedf-4f81580921f4 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:49:25.388710 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-72ddee40-9c02-4c05-bedf-4f81580921f4 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:49:25.393992 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-72ddee40-9c02-4c05-bedf-4f81580921f4 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] 10.222.0.18 "GET /compute/v2.1/servers/1d613848-05f4-478f-a569-b4c50576edb7" status: 200 len: 1362 microversion: 2.25 time: 0.473173 Oct 22 20:49:25.398714 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 156/364] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 20:49:24 2022] GET /compute/v2.1/servers/1d613848-05f4-478f-a569-b4c50576edb7 => generated 1362 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 20:49:25.417343 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-19558c72-964e-479a-a755-a22b660c7ba2 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:49:25.418383 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-19558c72-964e-479a-a755-a22b660c7ba2 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] [instance: 5c3de24c-090d-4769-8975-207eb939b979] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:49:25.422037 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-acd00604-7357-4220-9ab3-7258c7f96523 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] 10.222.0.18 "DELETE /compute/v2.1/servers/96add0b3-b82f-4a0a-bec3-9a6341ae5dec" status: 204 len: 0 microversion: 2.1 time: 0.409864 Oct 22 20:49:25.422853 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 209/365] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 20:49:25 2022] DELETE /compute/v2.1/servers/96add0b3-b82f-4a0a-bec3-9a6341ae5dec => generated 0 bytes in 412 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 22 20:49:25.447031 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-b9d32c25-3da5-4cf9-881a-5025408f6246 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:49:25.453281 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-b9d32c25-3da5-4cf9-881a-5025408f6246 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] [instance: 96add0b3-b82f-4a0a-bec3-9a6341ae5dec] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:49:25.457846 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-19558c72-964e-479a-a755-a22b660c7ba2 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:25.458350 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-19558c72-964e-479a-a755-a22b660c7ba2 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:25.460552 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-19558c72-964e-479a-a755-a22b660c7ba2 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:25.464724 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-19558c72-964e-479a-a755-a22b660c7ba2 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:25.466753 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-19558c72-964e-479a-a755-a22b660c7ba2 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:25.467326 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b9d32c25-3da5-4cf9-881a-5025408f6246 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:25.468295 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-19558c72-964e-479a-a755-a22b660c7ba2 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:25.469588 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b9d32c25-3da5-4cf9-881a-5025408f6246 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:25.470236 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b9d32c25-3da5-4cf9-881a-5025408f6246 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:25.471958 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b9d32c25-3da5-4cf9-881a-5025408f6246 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:25.475236 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b9d32c25-3da5-4cf9-881a-5025408f6246 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:25.475971 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b9d32c25-3da5-4cf9-881a-5025408f6246 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:25.557216 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b9d32c25-3da5-4cf9-881a-5025408f6246 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:25.557698 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b9d32c25-3da5-4cf9-881a-5025408f6246 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:25.558132 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b9d32c25-3da5-4cf9-881a-5025408f6246 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:25.558588 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.objects.instance [None req-b9d32c25-3da5-4cf9-881a-5025408f6246 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Lazy-loading 'fault' on Instance uuid 96add0b3-b82f-4a0a-bec3-9a6341ae5dec {{(pid=138745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 20:49:25.767427 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-b9d32c25-3da5-4cf9-881a-5025408f6246 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e13dcabaaa4b218945aeeabb4c902e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675a324f0134844a1964f64322493ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:49:25.778860 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-b9d32c25-3da5-4cf9-881a-5025408f6246 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] 10.222.0.18 "GET /compute/v2.1/servers/96add0b3-b82f-4a0a-bec3-9a6341ae5dec" status: 200 len: 1459 microversion: 2.1 time: 0.350116 Oct 22 20:49:25.779472 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 210/366] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:49:25 2022] GET /compute/v2.1/servers/96add0b3-b82f-4a0a-bec3-9a6341ae5dec => generated 1459 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:49:25.793996 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-19558c72-964e-479a-a755-a22b660c7ba2 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1ce98c66024d49b31e8e4f38b82838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a20f8f858424c89bf67a56feb720ac9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:49:25.810130 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-19558c72-964e-479a-a755-a22b660c7ba2 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed1ce98c66024d49b31e8e4f38b82838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a20f8f858424c89bf67a56feb720ac9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:49:25.813987 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-19558c72-964e-479a-a755-a22b660c7ba2 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed1ce98c66024d49b31e8e4f38b82838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a20f8f858424c89bf67a56feb720ac9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:49:25.825379 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-19558c72-964e-479a-a755-a22b660c7ba2 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] 10.222.0.18 "GET /compute/v2.1/servers/5c3de24c-090d-4769-8975-207eb939b979" status: 200 len: 1452 microversion: 2.75 time: 0.422138 Oct 22 20:49:25.836664 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 157/367] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 20:49:25 2022] GET /compute/v2.1/servers/5c3de24c-090d-4769-8975-207eb939b979 => generated 1452 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 20:49:26.431486 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-0a7768ca-927a-404c-b89e-c4f37cdd4d81 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:49:26.432899 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-0a7768ca-927a-404c-b89e-c4f37cdd4d81 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] [instance: 1d613848-05f4-478f-a569-b4c50576edb7] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:49:26.440568 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0a7768ca-927a-404c-b89e-c4f37cdd4d81 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:26.441315 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0a7768ca-927a-404c-b89e-c4f37cdd4d81 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:26.442037 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0a7768ca-927a-404c-b89e-c4f37cdd4d81 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:26.442923 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0a7768ca-927a-404c-b89e-c4f37cdd4d81 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:26.443554 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0a7768ca-927a-404c-b89e-c4f37cdd4d81 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:26.444121 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0a7768ca-927a-404c-b89e-c4f37cdd4d81 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:26.493508 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:49:26.618550 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell0:SELECT=11 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:49:26.643808 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-0a7768ca-927a-404c-b89e-c4f37cdd4d81 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:49:26.661918 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-0a7768ca-927a-404c-b89e-c4f37cdd4d81 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:49:26.669690 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-0a7768ca-927a-404c-b89e-c4f37cdd4d81 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:49:26.671385 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-0a7768ca-927a-404c-b89e-c4f37cdd4d81 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] 10.222.0.18 "GET /compute/v2.1/servers/1d613848-05f4-478f-a569-b4c50576edb7" status: 200 len: 1362 microversion: 2.25 time: 0.243910 Oct 22 20:49:26.673043 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 211/368] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 20:49:26 2022] GET /compute/v2.1/servers/1d613848-05f4-478f-a569-b4c50576edb7 => generated 1362 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 20:49:26.806107 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-f02de028-1dbb-4d0b-a325-0f6f4119f558 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:49:26.806717 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-f02de028-1dbb-4d0b-a325-0f6f4119f558 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] [instance: 96add0b3-b82f-4a0a-bec3-9a6341ae5dec] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:49:26.816958 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f02de028-1dbb-4d0b-a325-0f6f4119f558 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:26.823597 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f02de028-1dbb-4d0b-a325-0f6f4119f558 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:26.824221 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f02de028-1dbb-4d0b-a325-0f6f4119f558 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:26.826694 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f02de028-1dbb-4d0b-a325-0f6f4119f558 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:26.828233 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f02de028-1dbb-4d0b-a325-0f6f4119f558 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:26.830587 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f02de028-1dbb-4d0b-a325-0f6f4119f558 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:26.860420 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-fb231032-a209-4e98-bc73-8582acaf7595 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:49:26.861923 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-fb231032-a209-4e98-bc73-8582acaf7595 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] [instance: 5c3de24c-090d-4769-8975-207eb939b979] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:49:26.881801 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fb231032-a209-4e98-bc73-8582acaf7595 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:26.884268 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fb231032-a209-4e98-bc73-8582acaf7595 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:26.884939 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fb231032-a209-4e98-bc73-8582acaf7595 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:26.893072 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fb231032-a209-4e98-bc73-8582acaf7595 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:26.895976 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fb231032-a209-4e98-bc73-8582acaf7595 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:26.897481 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fb231032-a209-4e98-bc73-8582acaf7595 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:26.933338 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f02de028-1dbb-4d0b-a325-0f6f4119f558 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:26.933836 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f02de028-1dbb-4d0b-a325-0f6f4119f558 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:26.934281 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f02de028-1dbb-4d0b-a325-0f6f4119f558 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:26.934831 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.objects.instance [None req-f02de028-1dbb-4d0b-a325-0f6f4119f558 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Lazy-loading 'fault' on Instance uuid 96add0b3-b82f-4a0a-bec3-9a6341ae5dec {{(pid=138744) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 20:49:27.111708 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-fb231032-a209-4e98-bc73-8582acaf7595 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1ce98c66024d49b31e8e4f38b82838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a20f8f858424c89bf67a56feb720ac9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:49:27.123641 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-fb231032-a209-4e98-bc73-8582acaf7595 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed1ce98c66024d49b31e8e4f38b82838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a20f8f858424c89bf67a56feb720ac9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:49:27.132685 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-fb231032-a209-4e98-bc73-8582acaf7595 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed1ce98c66024d49b31e8e4f38b82838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a20f8f858424c89bf67a56feb720ac9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:49:27.148121 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-fb231032-a209-4e98-bc73-8582acaf7595 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] 10.222.0.18 "GET /compute/v2.1/servers/5c3de24c-090d-4769-8975-207eb939b979" status: 200 len: 1452 microversion: 2.75 time: 0.296307 Oct 22 20:49:27.166326 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 212/369] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 20:49:26 2022] GET /compute/v2.1/servers/5c3de24c-090d-4769-8975-207eb939b979 => generated 1452 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 20:49:27.660069 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell0:SELECT=66 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:49:27.700499 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-f606d73f-236b-426a-825f-9c4d115f4458 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:49:27.701896 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-f606d73f-236b-426a-825f-9c4d115f4458 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] [instance: 1d613848-05f4-478f-a569-b4c50576edb7] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:49:27.716998 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f606d73f-236b-426a-825f-9c4d115f4458 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:27.720033 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f606d73f-236b-426a-825f-9c4d115f4458 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:27.720677 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f606d73f-236b-426a-825f-9c4d115f4458 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:27.722477 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f606d73f-236b-426a-825f-9c4d115f4458 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:27.724162 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f606d73f-236b-426a-825f-9c4d115f4458 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:27.728615 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f606d73f-236b-426a-825f-9c4d115f4458 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:28.052060 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-f02de028-1dbb-4d0b-a325-0f6f4119f558 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e13dcabaaa4b218945aeeabb4c902e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675a324f0134844a1964f64322493ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:49:28.066016 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-f02de028-1dbb-4d0b-a325-0f6f4119f558 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] 10.222.0.18 "GET /compute/v2.1/servers/96add0b3-b82f-4a0a-bec3-9a6341ae5dec" status: 200 len: 1459 microversion: 2.1 time: 1.263748 Oct 22 20:49:28.067052 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 158/370] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:49:26 2022] GET /compute/v2.1/servers/96add0b3-b82f-4a0a-bec3-9a6341ae5dec => generated 1459 bytes in 1265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:49:28.181958 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-3726033f-47e1-45ec-90ef-f897b3462ebd tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:49:28.182959 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-3726033f-47e1-45ec-90ef-f897b3462ebd tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] [instance: 5c3de24c-090d-4769-8975-207eb939b979] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:49:28.196061 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3726033f-47e1-45ec-90ef-f897b3462ebd tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:28.196829 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3726033f-47e1-45ec-90ef-f897b3462ebd tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:28.199138 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3726033f-47e1-45ec-90ef-f897b3462ebd tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:28.201546 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3726033f-47e1-45ec-90ef-f897b3462ebd tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:28.203148 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3726033f-47e1-45ec-90ef-f897b3462ebd tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:28.205411 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3726033f-47e1-45ec-90ef-f897b3462ebd tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:28.229745 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-f606d73f-236b-426a-825f-9c4d115f4458 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:49:28.244506 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-f606d73f-236b-426a-825f-9c4d115f4458 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:49:28.249196 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-f606d73f-236b-426a-825f-9c4d115f4458 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:49:28.251102 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-f606d73f-236b-426a-825f-9c4d115f4458 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] 10.222.0.18 "GET /compute/v2.1/servers/1d613848-05f4-478f-a569-b4c50576edb7" status: 200 len: 1362 microversion: 2.25 time: 0.554673 Oct 22 20:49:28.255042 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 213/371] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 20:49:27 2022] GET /compute/v2.1/servers/1d613848-05f4-478f-a569-b4c50576edb7 => generated 1362 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 20:49:28.392517 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-3726033f-47e1-45ec-90ef-f897b3462ebd tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1ce98c66024d49b31e8e4f38b82838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a20f8f858424c89bf67a56feb720ac9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:49:28.415016 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-3726033f-47e1-45ec-90ef-f897b3462ebd tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed1ce98c66024d49b31e8e4f38b82838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a20f8f858424c89bf67a56feb720ac9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:49:28.417406 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-3726033f-47e1-45ec-90ef-f897b3462ebd tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed1ce98c66024d49b31e8e4f38b82838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a20f8f858424c89bf67a56feb720ac9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:49:28.433870 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-3726033f-47e1-45ec-90ef-f897b3462ebd tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] 10.222.0.18 "GET /compute/v2.1/servers/5c3de24c-090d-4769-8975-207eb939b979" status: 200 len: 1437 microversion: 2.75 time: 0.255977 Oct 22 20:49:28.434848 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 159/372] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 20:49:28 2022] GET /compute/v2.1/servers/5c3de24c-090d-4769-8975-207eb939b979 => generated 1437 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 22 20:49:29.048334 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-0bf05226-2606-498b-909f-6dee1e96c7c6 tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "085e4478-6edc-4a69-8e08-f9831713eb65"}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:49:29.054488 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-0bf05226-2606-498b-909f-6dee1e96c7c6 tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] [instance: 5c3de24c-090d-4769-8975-207eb939b979] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:49:29.076752 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0bf05226-2606-498b-909f-6dee1e96c7c6 tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:29.079312 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0bf05226-2606-498b-909f-6dee1e96c7c6 tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:29.087956 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0bf05226-2606-498b-909f-6dee1e96c7c6 tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:29.089624 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-e28eaee1-02f1-4118-9557-f2b2ff30e822 tempest-FlavorsAccessNegativeTestJSON-1155582995 tempest-FlavorsAccessNegativeTestJSON-1155582995-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-673449390", "id": 1166462420, "os-flavor-access:is_public": "False"}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:49:29.090663 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0bf05226-2606-498b-909f-6dee1e96c7c6 tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:29.092520 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0bf05226-2606-498b-909f-6dee1e96c7c6 tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:29.098549 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0bf05226-2606-498b-909f-6dee1e96c7c6 tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:29.143331 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-e28eaee1-02f1-4118-9557-f2b2ff30e822 tempest-FlavorsAccessNegativeTestJSON-1155582995 tempest-FlavorsAccessNegativeTestJSON-1155582995-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.778871 Oct 22 20:49:29.154368 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 214/373] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Oct 22 20:49:28 2022] POST /compute/v2.1/flavors => generated 438 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 20:49:29.174657 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-1cefaccd-504a-436b-9fa4-3dc643e56132 req-9637da6c-217c-4d2e-bb99-85ac9801c608 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d613848-05f4-478f-a569-b4c50576edb7", "name": "network-vif-plugged", "status": "completed", "tag": "6bf75146-c298-478b-aee3-b0be607e5d87"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:49:29.199329 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-1cefaccd-504a-436b-9fa4-3dc643e56132 req-9637da6c-217c-4d2e-bb99-85ac9801c608 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:29.201597 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-1cefaccd-504a-436b-9fa4-3dc643e56132 req-9637da6c-217c-4d2e-bb99-85ac9801c608 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:29.202417 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-1cefaccd-504a-436b-9fa4-3dc643e56132 req-9637da6c-217c-4d2e-bb99-85ac9801c608 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:29.234473 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-1cefaccd-504a-436b-9fa4-3dc643e56132 req-9637da6c-217c-4d2e-bb99-85ac9801c608 service nova] Creating event network-vif-plugged:6bf75146-c298-478b-aee3-b0be607e5d87 for instance 1d613848-05f4-478f-a569-b4c50576edb7 on nch2-master-1 Oct 22 20:49:29.250392 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-1cefaccd-504a-436b-9fa4-3dc643e56132 req-9637da6c-217c-4d2e-bb99-85ac9801c608 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094458 Oct 22 20:49:29.254082 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 215/374] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:49:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:49:29.270030 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-205cb812-242f-4bbe-b51c-6d839b6ad476 req-91a0a2c4-877d-41c0-8258-bf2a727146b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96add0b3-b82f-4a0a-bec3-9a6341ae5dec", "name": "network-vif-deleted", "tag": "0fd2316a-3787-46da-84c3-1064f9a62d40"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:49:29.335011 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-205cb812-242f-4bbe-b51c-6d839b6ad476 req-91a0a2c4-877d-41c0-8258-bf2a727146b1 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:29.335906 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-205cb812-242f-4bbe-b51c-6d839b6ad476 req-91a0a2c4-877d-41c0-8258-bf2a727146b1 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:29.336725 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-205cb812-242f-4bbe-b51c-6d839b6ad476 req-91a0a2c4-877d-41c0-8258-bf2a727146b1 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:29.349472 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=5,nova_api:DELETE=2,nova_api:UPDATE=1 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:49:29.359165 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-0bf05226-2606-498b-909f-6dee1e96c7c6 tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] Flavor limits 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 20:49:29.359885 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-0bf05226-2606-498b-909f-6dee1e96c7c6 tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] Image limits 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 20:49:29.360762 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-0bf05226-2606-498b-909f-6dee1e96c7c6 tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] Flavor pref 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 20:49:29.361590 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-0bf05226-2606-498b-909f-6dee1e96c7c6 tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] Image pref 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 20:49:29.362261 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-0bf05226-2606-498b-909f-6dee1e96c7c6 tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 20:49:29.379746 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-205cb812-242f-4bbe-b51c-6d839b6ad476 req-91a0a2c4-877d-41c0-8258-bf2a727146b1 service nova] Creating event network-vif-deleted:0fd2316a-3787-46da-84c3-1064f9a62d40 for instance 96add0b3-b82f-4a0a-bec3-9a6341ae5dec on nch2-master-1 Oct 22 20:49:29.403053 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-205cb812-242f-4bbe-b51c-6d839b6ad476 req-91a0a2c4-877d-41c0-8258-bf2a727146b1 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.146866 Oct 22 20:49:29.403709 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 216/375] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:49:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:49:29.417116 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:49:29.428490 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-3a920fda-39d3-40f6-a34b-78257d2c70da tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:49:29.430660 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-3a920fda-39d3-40f6-a34b-78257d2c70da tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] [instance: 96add0b3-b82f-4a0a-bec3-9a6341ae5dec] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:49:29.450399 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3a920fda-39d3-40f6-a34b-78257d2c70da tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:29.452886 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3a920fda-39d3-40f6-a34b-78257d2c70da tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:29.453793 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3a920fda-39d3-40f6-a34b-78257d2c70da tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:29.457481 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3a920fda-39d3-40f6-a34b-78257d2c70da tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:29.458196 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3a920fda-39d3-40f6-a34b-78257d2c70da tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:29.458803 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3a920fda-39d3-40f6-a34b-78257d2c70da tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:29.536751 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-0bf05226-2606-498b-909f-6dee1e96c7c6 tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] [instance: 5c3de24c-090d-4769-8975-207eb939b979] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:49:29.544225 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3a920fda-39d3-40f6-a34b-78257d2c70da tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:29.552693 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0bf05226-2606-498b-909f-6dee1e96c7c6 tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:29.556520 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3a920fda-39d3-40f6-a34b-78257d2c70da tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:29.556967 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3a920fda-39d3-40f6-a34b-78257d2c70da tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:29.557767 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0bf05226-2606-498b-909f-6dee1e96c7c6 tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:29.560361 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0bf05226-2606-498b-909f-6dee1e96c7c6 tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:29.561400 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.objects.instance [None req-3a920fda-39d3-40f6-a34b-78257d2c70da tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Lazy-loading 'fault' on Instance uuid 96add0b3-b82f-4a0a-bec3-9a6341ae5dec {{(pid=138745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 20:49:29.564949 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0bf05226-2606-498b-909f-6dee1e96c7c6 tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:29.566215 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0bf05226-2606-498b-909f-6dee1e96c7c6 tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:29.569901 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0bf05226-2606-498b-909f-6dee1e96c7c6 tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:29.802889 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-3a920fda-39d3-40f6-a34b-78257d2c70da tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e13dcabaaa4b218945aeeabb4c902e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675a324f0134844a1964f64322493ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:49:29.814908 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-3a920fda-39d3-40f6-a34b-78257d2c70da tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] 10.222.0.18 "GET /compute/v2.1/servers/96add0b3-b82f-4a0a-bec3-9a6341ae5dec" status: 200 len: 1310 microversion: 2.1 time: 0.409802 Oct 22 20:49:29.822013 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 217/376] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:49:29 2022] GET /compute/v2.1/servers/96add0b3-b82f-4a0a-bec3-9a6341ae5dec => generated 1310 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:49:29.833007 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-2cf9e064-fdb7-46e8-82ee-52dc1f6a8f0c tempest-FlavorsAccessNegativeTestJSON-1155582995 tempest-FlavorsAccessNegativeTestJSON-1155582995-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "ecb4d08b21184b53b41cce2833f65990"}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:49:29.919599 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.objects.instance [None req-0bf05226-2606-498b-909f-6dee1e96c7c6 tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] Lazy-loading 'services' on Instance uuid 5c3de24c-090d-4769-8975-207eb939b979 {{(pid=138744) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 20:49:30.019513 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-0bf05226-2606-498b-909f-6dee1e96c7c6 tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] 10.222.0.18 "POST /compute/v2.1/servers/5c3de24c-090d-4769-8975-207eb939b979/action" status: 202 len: 1940 microversion: 2.75 time: 1.554184 Oct 22 20:49:30.023399 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 160/377] 10.222.0.18 () {62 vars in 1319 bytes} [Sat Oct 22 20:49:28 2022] POST /compute/v2.1/servers/5c3de24c-090d-4769-8975-207eb939b979/action => generated 1940 bytes in 1557 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 22 20:49:30.026553 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-5d60da18-ba38-4aa4-b083-4e0b44cc2717 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:49:30.027201 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-5d60da18-ba38-4aa4-b083-4e0b44cc2717 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] [instance: 1d613848-05f4-478f-a569-b4c50576edb7] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:49:30.050839 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5d60da18-ba38-4aa4-b083-4e0b44cc2717 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:30.052292 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5d60da18-ba38-4aa4-b083-4e0b44cc2717 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:30.052762 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5d60da18-ba38-4aa4-b083-4e0b44cc2717 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:30.053713 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5d60da18-ba38-4aa4-b083-4e0b44cc2717 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:30.054180 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5d60da18-ba38-4aa4-b083-4e0b44cc2717 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:30.054771 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5d60da18-ba38-4aa4-b083-4e0b44cc2717 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:30.214634 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-5d60da18-ba38-4aa4-b083-4e0b44cc2717 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:49:30.223740 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-5d60da18-ba38-4aa4-b083-4e0b44cc2717 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:49:30.224534 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-2cf9e064-fdb7-46e8-82ee-52dc1f6a8f0c tempest-FlavorsAccessNegativeTestJSON-1155582995 tempest-FlavorsAccessNegativeTestJSON-1155582995-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors/1166462420/action" status: 200 len: 97 microversion: 2.1 time: 0.399066 Oct 22 20:49:30.225733 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-5d60da18-ba38-4aa4-b083-4e0b44cc2717 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:49:30.226267 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 218/378] 10.222.0.18 () {60 vars in 1200 bytes} [Sat Oct 22 20:49:29 2022] POST /compute/v2.1/flavors/1166462420/action => generated 97 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 22 20:49:30.227955 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-5d60da18-ba38-4aa4-b083-4e0b44cc2717 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] 10.222.0.18 "GET /compute/v2.1/servers/1d613848-05f4-478f-a569-b4c50576edb7" status: 200 len: 1362 microversion: 2.25 time: 0.205760 Oct 22 20:49:30.228744 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 161/379] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 20:49:30 2022] GET /compute/v2.1/servers/1d613848-05f4-478f-a569-b4c50576edb7 => generated 1362 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 20:49:30.398925 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-ce1b8b8c-b223-4f3e-b6c6-52b99e112577 tempest-HypervisorAdminNegativeUnderV252Test-252456033 tempest-HypervisorAdminNegativeUnderV252Test-252456033-project-admin] Calling method '.version_select at 0x7fd3a490f3a0>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:49:30.402471 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ce1b8b8c-b223-4f3e-b6c6-52b99e112577 tempest-HypervisorAdminNegativeUnderV252Test-252456033 tempest-HypervisorAdminNegativeUnderV252Test-252456033-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:30.403214 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ce1b8b8c-b223-4f3e-b6c6-52b99e112577 tempest-HypervisorAdminNegativeUnderV252Test-252456033 tempest-HypervisorAdminNegativeUnderV252Test-252456033-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:30.403948 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ce1b8b8c-b223-4f3e-b6c6-52b99e112577 tempest-HypervisorAdminNegativeUnderV252Test-252456033 tempest-HypervisorAdminNegativeUnderV252Test-252456033-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:30.413273 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-b81c614e-57ce-4a7e-9802-bf5c7eabcc5f tempest-ServicesAdminTestJSON-320224419 tempest-ServicesAdminTestJSON-320224419-project-admin] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:49:30.417076 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b81c614e-57ce-4a7e-9802-bf5c7eabcc5f tempest-ServicesAdminTestJSON-320224419 tempest-ServicesAdminTestJSON-320224419-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:30.417568 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b81c614e-57ce-4a7e-9802-bf5c7eabcc5f tempest-ServicesAdminTestJSON-320224419 tempest-ServicesAdminTestJSON-320224419-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:30.418038 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b81c614e-57ce-4a7e-9802-bf5c7eabcc5f tempest-ServicesAdminTestJSON-320224419 tempest-ServicesAdminTestJSON-320224419-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:30.418804 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b81c614e-57ce-4a7e-9802-bf5c7eabcc5f tempest-ServicesAdminTestJSON-320224419 tempest-ServicesAdminTestJSON-320224419-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:30.419259 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b81c614e-57ce-4a7e-9802-bf5c7eabcc5f tempest-ServicesAdminTestJSON-320224419 tempest-ServicesAdminTestJSON-320224419-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:30.419706 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b81c614e-57ce-4a7e-9802-bf5c7eabcc5f tempest-ServicesAdminTestJSON-320224419 tempest-ServicesAdminTestJSON-320224419-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:30.425005 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ce1b8b8c-b223-4f3e-b6c6-52b99e112577 tempest-HypervisorAdminNegativeUnderV252Test-252456033 tempest-HypervisorAdminNegativeUnderV252Test-252456033-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:30.425493 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ce1b8b8c-b223-4f3e-b6c6-52b99e112577 tempest-HypervisorAdminNegativeUnderV252Test-252456033 tempest-HypervisorAdminNegativeUnderV252Test-252456033-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:30.425930 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ce1b8b8c-b223-4f3e-b6c6-52b99e112577 tempest-HypervisorAdminNegativeUnderV252Test-252456033 tempest-HypervisorAdminNegativeUnderV252Test-252456033-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:30.437713 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ce1b8b8c-b223-4f3e-b6c6-52b99e112577 tempest-HypervisorAdminNegativeUnderV252Test-252456033 tempest-HypervisorAdminNegativeUnderV252Test-252456033-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:30.438195 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ce1b8b8c-b223-4f3e-b6c6-52b99e112577 tempest-HypervisorAdminNegativeUnderV252Test-252456033 tempest-HypervisorAdminNegativeUnderV252Test-252456033-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:30.439109 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ce1b8b8c-b223-4f3e-b6c6-52b99e112577 tempest-HypervisorAdminNegativeUnderV252Test-252456033 tempest-HypervisorAdminNegativeUnderV252Test-252456033-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:30.445088 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-ce1b8b8c-b223-4f3e-b6c6-52b99e112577 tempest-HypervisorAdminNegativeUnderV252Test-252456033 tempest-HypervisorAdminNegativeUnderV252Test-252456033-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.217181 Oct 22 20:49:30.445855 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 219/380] 10.222.0.18 () {58 vars in 1146 bytes} [Sat Oct 22 20:49:30 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:49:30.451045 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-35920ab7-4e74-4c8c-a6de-6213004a4e4b tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:49:30.452260 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-35920ab7-4e74-4c8c-a6de-6213004a4e4b tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] [instance: 5c3de24c-090d-4769-8975-207eb939b979] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:49:30.452515 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-b81c614e-57ce-4a7e-9802-bf5c7eabcc5f tempest-ServicesAdminTestJSON-320224419 tempest-ServicesAdminTestJSON-320224419-project-admin] 10.222.0.18 "GET /compute/v2.1/os-services" status: 200 len: 947 microversion: 2.1 time: 0.222433 Oct 22 20:49:30.453191 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 162/381] 10.222.0.18 () {58 vars in 1137 bytes} [Sat Oct 22 20:49:30 2022] GET /compute/v2.1/os-services => generated 947 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:49:30.458885 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-873f63c9-86b9-400c-870e-279b0cdac7ec tempest-FlavorsAccessNegativeTestJSON-1155582995 tempest-FlavorsAccessNegativeTestJSON-1155582995-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "ecb4d08b21184b53b41cce2833f65990"}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:49:30.465396 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-35920ab7-4e74-4c8c-a6de-6213004a4e4b tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:30.466134 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-35920ab7-4e74-4c8c-a6de-6213004a4e4b tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:30.466795 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-35920ab7-4e74-4c8c-a6de-6213004a4e4b tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:30.470247 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-35920ab7-4e74-4c8c-a6de-6213004a4e4b tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:30.471042 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-35920ab7-4e74-4c8c-a6de-6213004a4e4b tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:30.473039 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-35920ab7-4e74-4c8c-a6de-6213004a4e4b tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:30.668619 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-873f63c9-86b9-400c-870e-279b0cdac7ec tempest-FlavorsAccessNegativeTestJSON-1155582995 tempest-FlavorsAccessNegativeTestJSON-1155582995-project-admin] HTTP exception thrown: Flavor access already exists for flavor 31 and project ecb4d08b21184b53b41cce2833f65990 combination. Oct 22 20:49:30.676832 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-873f63c9-86b9-400c-870e-279b0cdac7ec tempest-FlavorsAccessNegativeTestJSON-1155582995 tempest-FlavorsAccessNegativeTestJSON-1155582995-project-admin] Request method failure captured: Oct 22 20:49:30.676832 ncdv-master-1 devstack@n-api.service[138744]: request: POST /compute/v2.1/flavors/1166462420/action HTTP/1.1 Oct 22 20:49:30.676832 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 20:49:30.676832 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 20:49:30.676832 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 20:49:30.676832 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 67 Oct 22 20:49:30.676832 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 20:49:30.676832 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 20:49:30.676832 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 20:49:30.676832 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 20:49:30.676832 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVFdVH0j3Onka0cJiJKz5mwWrdT3UkYTUrkBWWBgq6gIBGYoJrcu7Sw5ZMDuIE6sWOr5rOIb8l-Ogyrk9m2M1fd5Jp-ksiPJy-d_HlSyTriMuumIOdbVIWPr1UtH5i3ky5xLJOQvzZY8IucywSOTdp8Bne43Xw81w_YBnuHDuBNkREno Oct 22 20:49:30.676832 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 20:49:30.676832 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 20:49:30.676832 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 20:49:30.676832 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 20:49:30.676832 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 20:49:30.676832 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 20:49:30.676832 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: 9c8b0f59c10a4e55af2f72c7d77c13cc Oct 22 20:49:30.676832 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1155582995 Oct 22 20:49:30.676832 ncdv-master-1 devstack@n-api.service[138744]: X-Role: admin,member,reader Oct 22 20:49:30.676832 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: admin,member,reader Oct 22 20:49:30.678179 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_9c8b0f59c10a4e55af2f72c7d77c13cc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9c8b0f59c10a4e55af2f72c7d77c13cc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/9c8b0f59c10a4e55af2f72c7d77c13cc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9c8b0f59c10a4e55af2f72c7d77c13cc"}]}] Oct 22 20:49:30.678179 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1155582995 Oct 22 20:49:30.678179 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: 9c8b0f59c10a4e55af2f72c7d77c13cc Oct 22 20:49:30.678179 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1155582995 Oct 22 20:49:30.678179 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-FlavorsAccessNegativeTestJSON-1155582995-project-admin Oct 22 20:49:30.678179 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 20:49:30.678179 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 20:49:30.678179 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: 78c31e62d8d440bc9f2047d3107fe9f6 Oct 22 20:49:30.678179 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1155582995-project-admin Oct 22 20:49:30.678179 ncdv-master-1 devstack@n-api.service[138744]: Oct 22 20:49:30.678179 ncdv-master-1 devstack@n-api.service[138744]: {"addTenantAccess": {"tenant": "ecb4d08b21184b53b41cce2833f65990"}} Oct 22 20:49:30.678179 ncdv-master-1 devstack@n-api.service[138744]: method: > Oct 22 20:49:30.678929 ncdv-master-1 devstack@n-api.service[138744]: exception: Flavor access already exists for flavor 31 and project ecb4d08b21184b53b41cce2833f65990 combination. Oct 22 20:49:30.678929 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': '1166462420', 'body': {'addTenantAccess': {'tenant': 'ecb4d08b21184b53b41cce2833f65990'}}} Oct 22 20:49:30.678929 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:49:30.678929 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:49:30.678929 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 22 20:49:30.678929 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 22 20:49:30.678929 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 22 20:49:30.678929 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 22 20:49:30.678929 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 22 20:49:30.678929 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 22 20:49:30.678929 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 22 20:49:30.678929 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 22 20:49:30.678929 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 22 20:49:30.678929 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 22 20:49:30.678929 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 22 20:49:30.678929 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi result.read() Oct 22 20:49:30.678929 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 22 20:49:30.678929 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 22 20:49:30.680079 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 22 20:49:30.680079 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 22 20:49:30.680079 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 22 20:49:30.680079 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 22 20:49:30.680079 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 22 20:49:30.680079 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 22 20:49:30.680079 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '31-ecb4d08b21184b53b41cce2833f65990' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Oct 22 20:49:30.680079 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:49:30.680079 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 22 20:49:30.680079 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:49:30.680079 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:49:30.680079 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 73, in _flavor_add_project Oct 22 20:49:30.680079 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi project.save(context.session) Oct 22 20:49:30.680079 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Oct 22 20:49:30.680079 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi session.flush() Oct 22 20:49:30.680079 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 22 20:49:30.680079 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi self._flush(objects) Oct 22 20:49:30.680079 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 22 20:49:30.680079 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Oct 22 20:49:30.681205 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 22 20:49:30.681205 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi compat.raise_( Oct 22 20:49:30.681205 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 22 20:49:30.681205 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception Oct 22 20:49:30.681205 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 22 20:49:30.681205 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi flush_context.execute() Oct 22 20:49:30.681205 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 22 20:49:30.681205 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi rec.execute(self) Oct 22 20:49:30.681205 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 22 20:49:30.681205 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Oct 22 20:49:30.681205 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 22 20:49:30.681205 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Oct 22 20:49:30.681205 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 22 20:49:30.681205 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Oct 22 20:49:30.681205 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 22 20:49:30.681205 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Oct 22 20:49:30.681205 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 22 20:49:30.681205 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Oct 22 20:49:30.682617 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 22 20:49:30.682617 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Oct 22 20:49:30.682617 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 22 20:49:30.682617 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Oct 22 20:49:30.682617 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 22 20:49:30.682617 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 22 20:49:30.682617 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 22 20:49:30.682617 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception Oct 22 20:49:30.682617 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 22 20:49:30.682617 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 22 20:49:30.682617 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 22 20:49:30.682617 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 22 20:49:30.682617 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 22 20:49:30.682617 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 22 20:49:30.682617 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 22 20:49:30.682617 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 22 20:49:30.682617 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 22 20:49:30.682617 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 22 20:49:30.685006 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 22 20:49:30.685006 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi result.read() Oct 22 20:49:30.685006 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 22 20:49:30.685006 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 22 20:49:30.685006 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 22 20:49:30.685006 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 22 20:49:30.685006 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 22 20:49:30.685006 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 22 20:49:30.685006 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 22 20:49:30.685006 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 22 20:49:30.685006 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '31-ecb4d08b21184b53b41cce2833f65990' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Oct 22 20:49:30.685006 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO flavor_projects (created_at, updated_at, flavor_id, project_id) VALUES (%(created_at)s, %(updated_at)s, %(flavor_id)s, %(project_id)s)] Oct 22 20:49:30.685006 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 10, 22, 20, 49, 30, 641139), 'updated_at': None, 'flavor_id': 31, 'project_id': 'ecb4d08b21184b53b41cce2833f65990'}] Oct 22 20:49:30.685006 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 22 20:49:30.685006 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:49:30.685006 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:49:30.685006 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:49:30.687171 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:49:30.687171 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 79, in _add_tenant_access Oct 22 20:49:30.687171 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi flavor.add_access(tenant) Oct 22 20:49:30.687171 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 22 20:49:30.687171 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 22 20:49:30.687171 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 411, in add_access Oct 22 20:49:30.687171 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi self._add_access(project_id) Oct 22 20:49:30.687171 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 404, in _add_access Oct 22 20:49:30.687171 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi self._flavor_add_project(self._context, self.id, project_id) Oct 22 20:49:30.687171 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 397, in _flavor_add_project Oct 22 20:49:30.687171 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return _flavor_add_project(context, flavor_id, project_id) Oct 22 20:49:30.687171 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 22 20:49:30.687171 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 22 20:49:30.687171 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 75, in _flavor_add_project Oct 22 20:49:30.687171 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessExists(flavor_id=flavor_id, Oct 22 20:49:30.687171 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessExists: Flavor access already exists for flavor 31 and project ecb4d08b21184b53b41cce2833f65990 combination. Oct 22 20:49:30.687171 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:49:30.687171 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:49:30.687171 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:49:30.693038 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:49:30.693038 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:49:30.693038 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:49:30.693038 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:49:30.693038 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:49:30.693038 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:49:30.693038 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:49:30.693038 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 20:49:30.693038 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 20:49:30.693038 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 83, in _add_tenant_access Oct 22 20:49:30.693038 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=err.format_message()) Oct 22 20:49:30.693038 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Flavor access already exists for flavor 31 and project ecb4d08b21184b53b41cce2833f65990 combination. Oct 22 20:49:30.693038 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:49:30.693038 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:49:30.693038 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:49:30.693038 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:49:30.693038 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:49:30.693038 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:49:30.693038 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 20:49:30.693038 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 20:49:30.695586 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access already exists for flavor 31 and project ecb4d08b21184b53b41cce2833f65990 combination. Oct 22 20:49:30.695586 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:49:30.695586 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-873f63c9-86b9-400c-870e-279b0cdac7ec tempest-FlavorsAccessNegativeTestJSON-1155582995 tempest-FlavorsAccessNegativeTestJSON-1155582995-project-admin] Returning 409 to user: Flavor access already exists for flavor 31 and project ecb4d08b21184b53b41cce2833f65990 combination. {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:49:30.695975 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.objects.instance [None req-35920ab7-4e74-4c8c-a6de-6213004a4e4b tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] Lazy-loading 'services' on Instance uuid 5c3de24c-090d-4769-8975-207eb939b979 {{(pid=138745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 20:49:30.696120 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-873f63c9-86b9-400c-870e-279b0cdac7ec tempest-FlavorsAccessNegativeTestJSON-1155582995 tempest-FlavorsAccessNegativeTestJSON-1155582995-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors/1166462420/action" status: 409 len: 152 microversion: 2.1 time: 0.224261 Oct 22 20:49:30.696120 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 163/382] 10.222.0.18 () {60 vars in 1200 bytes} [Sat Oct 22 20:49:30 2022] POST /compute/v2.1/flavors/1166462420/action => generated 152 bytes in 229 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 22 20:49:30.789586 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-35920ab7-4e74-4c8c-a6de-6213004a4e4b tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/5c3de24c-090d-4769-8975-207eb939b979" status: 200 len: 1927 microversion: 2.75 time: 0.342432 Oct 22 20:49:30.790816 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 220/383] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 20:49:30 2022] GET /compute/v2.1/servers/5c3de24c-090d-4769-8975-207eb939b979 => generated 1927 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 20:49:30.795961 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-e4eeedac-05f1-4ad7-a476-aba3aca8bd69 tempest-ServicesAdminTestJSON-320224419 tempest-ServicesAdminTestJSON-320224419-project-admin] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:49:30.800049 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e4eeedac-05f1-4ad7-a476-aba3aca8bd69 tempest-ServicesAdminTestJSON-320224419 tempest-ServicesAdminTestJSON-320224419-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:30.800770 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e4eeedac-05f1-4ad7-a476-aba3aca8bd69 tempest-ServicesAdminTestJSON-320224419 tempest-ServicesAdminTestJSON-320224419-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:30.801415 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e4eeedac-05f1-4ad7-a476-aba3aca8bd69 tempest-ServicesAdminTestJSON-320224419 tempest-ServicesAdminTestJSON-320224419-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:30.802394 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e4eeedac-05f1-4ad7-a476-aba3aca8bd69 tempest-ServicesAdminTestJSON-320224419 tempest-ServicesAdminTestJSON-320224419-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:30.803141 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e4eeedac-05f1-4ad7-a476-aba3aca8bd69 tempest-ServicesAdminTestJSON-320224419 tempest-ServicesAdminTestJSON-320224419-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:30.803792 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e4eeedac-05f1-4ad7-a476-aba3aca8bd69 tempest-ServicesAdminTestJSON-320224419 tempest-ServicesAdminTestJSON-320224419-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:30.833179 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-e4eeedac-05f1-4ad7-a476-aba3aca8bd69 tempest-ServicesAdminTestJSON-320224419 tempest-ServicesAdminTestJSON-320224419-project-admin] 10.222.0.18 "GET /compute/v2.1/os-services?host=ncdv-master-1" status: 200 len: 581 microversion: 2.1 time: 0.041056 Oct 22 20:49:30.834267 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 221/384] 10.222.0.18 () {58 vars in 1174 bytes} [Sat Oct 22 20:49:30 2022] GET /compute/v2.1/os-services?host=ncdv-master-1 => generated 581 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:49:30.853464 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-f474a91d-dc5f-4b19-9f55-3699517f4244 tempest-FlavorsAccessNegativeTestJSON-1155582995 tempest-FlavorsAccessNegativeTestJSON-1155582995-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "ecb4d08b21184b53b41cce2833f65990"}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:49:31.217638 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-f92fbdf6-52f9-4f95-9756-13a0109afec9 tempest-HypervisorAdminNegativeUnderV252Test-1510085462 tempest-HypervisorAdminNegativeUnderV252Test-1510085462-project] Calling method '.version_select at 0x7fd3a47b7c10>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:49:31.220169 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-f92fbdf6-52f9-4f95-9756-13a0109afec9 tempest-HypervisorAdminNegativeUnderV252Test-1510085462 tempest-HypervisorAdminNegativeUnderV252Test-1510085462-project] Policy check for os_compute_api:os-hypervisors:search failed with credentials {'is_admin': False, 'user_id': '91702e4ea3be48da8c6ae42a3a7004f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1022407f76c54e7cb820879c0e91982b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:49:31.230649 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-f92fbdf6-52f9-4f95-9756-13a0109afec9 tempest-HypervisorAdminNegativeUnderV252Test-1510085462 tempest-HypervisorAdminNegativeUnderV252Test-1510085462-project] Request method failure captured: Oct 22 20:49:31.230649 ncdv-master-1 devstack@n-api.service[138744]: request: GET /compute/v2.1/os-hypervisors/nch2-master-1/search HTTP/1.1 Oct 22 20:49:31.230649 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 20:49:31.230649 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 20:49:31.230649 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 20:49:31.230649 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 0 Oct 22 20:49:31.230649 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 20:49:31.230649 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 20:49:31.230649 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 20:49:31.230649 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 20:49:31.230649 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVFdWEWeUQgnZitv_rTh9Jieclh4qJHVuBqWVvZTgWqLvuPBlTecw6aX7nRwa-V04pt3HnIu-OohBlaQlrFlnOJ0jUpsmpbjh4u2QE_4OHzBOT5cbFm8WL4KB_RA3dl9IfrCESkcge90ZpNWe2gwi_bjbICNQ3kisNwLkHOu1DFy1BqE Oct 22 20:49:31.230649 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 20:49:31.230649 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 20:49:31.230649 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 20:49:31.230649 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 20:49:31.230649 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 20:49:31.230649 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 20:49:31.230649 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: 1022407f76c54e7cb820879c0e91982b Oct 22 20:49:31.230649 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1510085462 Oct 22 20:49:31.230649 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 20:49:31.230649 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 20:49:31.231918 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_1022407f76c54e7cb820879c0e91982b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1022407f76c54e7cb820879c0e91982b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/1022407f76c54e7cb820879c0e91982b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1022407f76c54e7cb820879c0e91982b"}]}] Oct 22 20:49:31.231918 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1510085462 Oct 22 20:49:31.231918 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: 1022407f76c54e7cb820879c0e91982b Oct 22 20:49:31.231918 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1510085462 Oct 22 20:49:31.231918 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1510085462-project Oct 22 20:49:31.231918 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 20:49:31.231918 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 20:49:31.231918 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: 91702e4ea3be48da8c6ae42a3a7004f9 Oct 22 20:49:31.231918 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1510085462-project Oct 22 20:49:31.231918 ncdv-master-1 devstack@n-api.service[138744]: method: Oct 22 20:49:31.231918 ncdv-master-1 devstack@n-api.service[138744]: exception: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Oct 22 20:49:31.231918 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': 'nch2-master-1'} Oct 22 20:49:31.232711 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:49:31.232711 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:49:31.232711 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:49:31.232711 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:49:31.232711 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:49:31.232711 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:49:31.232711 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 22 20:49:31.232711 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 22 20:49:31.232711 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:49:31.232711 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:49:31.232711 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 439, in search Oct 22 20:49:31.232711 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'search', target={}) Oct 22 20:49:31.232711 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 22 20:49:31.232711 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 22 20:49:31.232711 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 22 20:49:31.232711 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 22 20:49:31.232711 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 22 20:49:31.232711 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 22 20:49:31.232711 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 22 20:49:31.233846 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise self.value Oct 22 20:49:31.233846 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 22 20:49:31.233846 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 22 20:49:31.233846 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 22 20:49:31.233846 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 22 20:49:31.233846 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 22 20:49:31.233846 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 22 20:49:31.233846 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Oct 22 20:49:31.233846 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:49:31.233846 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:49:31.233846 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:49:31.233846 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:49:31.233846 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:49:31.233846 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:49:31.233846 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 22 20:49:31.233846 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 22 20:49:31.233846 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Oct 22 20:49:31.233846 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:49:31.237031 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-f92fbdf6-52f9-4f95-9756-13a0109afec9 tempest-HypervisorAdminNegativeUnderV252Test-1510085462 tempest-HypervisorAdminNegativeUnderV252Test-1510085462-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:49:31.240741 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-f92fbdf6-52f9-4f95-9756-13a0109afec9 tempest-HypervisorAdminNegativeUnderV252Test-1510085462 tempest-HypervisorAdminNegativeUnderV252Test-1510085462-project] 10.222.0.18 "GET /compute/v2.1/os-hypervisors/nch2-master-1/search" status: 403 len: 117 microversion: 2.1 time: 0.554144 Oct 22 20:49:31.241863 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 164/385] 10.222.0.18 () {58 vars in 1209 bytes} [Sat Oct 22 20:49:30 2022] GET /compute/v2.1/os-hypervisors/nch2-master-1/search => generated 117 bytes in 558 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 22 20:49:31.260431 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-901749d6-196c-41ae-a872-b8938beb08b4 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:49:31.262335 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-901749d6-196c-41ae-a872-b8938beb08b4 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] [instance: 96add0b3-b82f-4a0a-bec3-9a6341ae5dec] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:49:31.280741 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-901749d6-196c-41ae-a872-b8938beb08b4 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:31.281591 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-901749d6-196c-41ae-a872-b8938beb08b4 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:31.283011 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-901749d6-196c-41ae-a872-b8938beb08b4 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:31.286198 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-901749d6-196c-41ae-a872-b8938beb08b4 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:31.291676 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-901749d6-196c-41ae-a872-b8938beb08b4 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:31.292356 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-901749d6-196c-41ae-a872-b8938beb08b4 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:31.309209 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-f474a91d-dc5f-4b19-9f55-3699517f4244 tempest-FlavorsAccessNegativeTestJSON-1155582995 tempest-FlavorsAccessNegativeTestJSON-1155582995-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors/1166462420/action" status: 200 len: 21 microversion: 2.1 time: 0.473379 Oct 22 20:49:31.316539 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 222/386] 10.222.0.18 () {60 vars in 1200 bytes} [Sat Oct 22 20:49:30 2022] POST /compute/v2.1/flavors/1166462420/action => generated 21 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 22 20:49:31.322335 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-7a6b6d15-0875-4774-ad72-76b2ba1a6e71 tempest-ServicesAdminTestJSON-320224419 tempest-ServicesAdminTestJSON-320224419-project-admin] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:49:31.325214 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-901749d6-196c-41ae-a872-b8938beb08b4 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] HTTP exception thrown: Instance 96add0b3-b82f-4a0a-bec3-9a6341ae5dec could not be found. Oct 22 20:49:31.326829 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-901749d6-196c-41ae-a872-b8938beb08b4 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Request method failure captured: Oct 22 20:49:31.326829 ncdv-master-1 devstack@n-api.service[138744]: request: GET /compute/v2.1/servers/96add0b3-b82f-4a0a-bec3-9a6341ae5dec HTTP/1.1 Oct 22 20:49:31.326829 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 20:49:31.326829 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 20:49:31.326829 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 20:49:31.326829 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 0 Oct 22 20:49:31.326829 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 20:49:31.326829 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 20:49:31.326829 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 20:49:31.326829 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 20:49:31.326829 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVFcYYORhwFB1ry8Evy8Voe9D4YGgNQU5_4r5xU__9WXZwFhi1ysgPAlzqoWtpXWb5AmV6DcS0MfiQoPElUcKT8-mpbeXfIqn597wkNknXaYh6U3AKbg58fbAPYPOorYCbxVAYf4DMC0ny28dLv3iMq4Wg-HScb3aYg1qBD2hJHVN7WI Oct 22 20:49:31.326829 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 20:49:31.326829 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 20:49:31.326829 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 20:49:31.326829 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 20:49:31.326829 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 20:49:31.326829 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 20:49:31.326829 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: 2675a324f0134844a1964f64322493ba Oct 22 20:49:31.326829 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-DeleteServersAdminTestJSON-331859835 Oct 22 20:49:31.326829 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 20:49:31.326829 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 20:49:31.328256 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_2675a324f0134844a1964f64322493ba"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2675a324f0134844a1964f64322493ba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/2675a324f0134844a1964f64322493ba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2675a324f0134844a1964f64322493ba"}]}] Oct 22 20:49:31.328256 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-DeleteServersAdminTestJSON-331859835 Oct 22 20:49:31.328256 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: 2675a324f0134844a1964f64322493ba Oct 22 20:49:31.328256 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-331859835 Oct 22 20:49:31.328256 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-DeleteServersAdminTestJSON-331859835-project Oct 22 20:49:31.328256 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 20:49:31.328256 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 20:49:31.328256 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: 16e13dcabaaa4b218945aeeabb4c902e Oct 22 20:49:31.328256 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-DeleteServersAdminTestJSON-331859835-project Oct 22 20:49:31.328256 ncdv-master-1 devstack@n-api.service[138744]: method: > Oct 22 20:49:31.328256 ncdv-master-1 devstack@n-api.service[138744]: exception: Instance 96add0b3-b82f-4a0a-bec3-9a6341ae5dec could not be found. Oct 22 20:49:31.328256 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': '96add0b3-b82f-4a0a-bec3-9a6341ae5dec'} Oct 22 20:49:31.328947 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:49:31.328947 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:49:31.328947 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 20:49:31.328947 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 20:49:31.328947 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 20:49:31.328947 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 20:49:31.328947 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 20:49:31.328947 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 20:49:31.328947 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 20:49:31.328947 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 20:49:31.328947 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 96add0b3-b82f-4a0a-bec3-9a6341ae5dec could not be found. Oct 22 20:49:31.328947 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:49:31.328947 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:49:31.328947 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:49:31.328947 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:49:31.328947 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:49:31.328947 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:49:31.328947 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:49:31.328947 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:49:31.328947 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:49:31.330053 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:49:31.330053 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 20:49:31.330053 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 20:49:31.330053 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 20:49:31.330053 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 20:49:31.330053 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 20:49:31.330053 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 20:49:31.330053 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 96add0b3-b82f-4a0a-bec3-9a6341ae5dec could not be found. Oct 22 20:49:31.330053 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:49:31.330053 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:49:31.330053 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:49:31.330053 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:49:31.330053 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:49:31.330053 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:49:31.330053 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 20:49:31.330053 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 20:49:31.330053 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 96add0b3-b82f-4a0a-bec3-9a6341ae5dec could not be found. Oct 22 20:49:31.330053 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:49:31.338152 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7a6b6d15-0875-4774-ad72-76b2ba1a6e71 tempest-ServicesAdminTestJSON-320224419 tempest-ServicesAdminTestJSON-320224419-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:31.341417 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7a6b6d15-0875-4774-ad72-76b2ba1a6e71 tempest-ServicesAdminTestJSON-320224419 tempest-ServicesAdminTestJSON-320224419-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:31.342157 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7a6b6d15-0875-4774-ad72-76b2ba1a6e71 tempest-ServicesAdminTestJSON-320224419 tempest-ServicesAdminTestJSON-320224419-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:31.344372 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7a6b6d15-0875-4774-ad72-76b2ba1a6e71 tempest-ServicesAdminTestJSON-320224419 tempest-ServicesAdminTestJSON-320224419-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:31.345055 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7a6b6d15-0875-4774-ad72-76b2ba1a6e71 tempest-ServicesAdminTestJSON-320224419 tempest-ServicesAdminTestJSON-320224419-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:31.347028 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7a6b6d15-0875-4774-ad72-76b2ba1a6e71 tempest-ServicesAdminTestJSON-320224419 tempest-ServicesAdminTestJSON-320224419-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:31.347830 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-901749d6-196c-41ae-a872-b8938beb08b4 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Returning 404 to user: Instance 96add0b3-b82f-4a0a-bec3-9a6341ae5dec could not be found. {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:49:31.352797 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-901749d6-196c-41ae-a872-b8938beb08b4 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] 10.222.0.18 "GET /compute/v2.1/servers/96add0b3-b82f-4a0a-bec3-9a6341ae5dec" status: 404 len: 111 microversion: 2.1 time: 0.105619 Oct 22 20:49:31.353380 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 165/387] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:49:31 2022] GET /compute/v2.1/servers/96add0b3-b82f-4a0a-bec3-9a6341ae5dec => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 20:49:31.366256 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-1fb460cf-1c61-42e0-97a4-22ab090fe714 tempest-HypervisorAdminNegativeUnderV252Test-252456033 tempest-HypervisorAdminNegativeUnderV252Test-252456033-project-admin] Calling method '.version_select at 0x7fd3a473ac10>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:49:31.368650 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1fb460cf-1c61-42e0-97a4-22ab090fe714 tempest-HypervisorAdminNegativeUnderV252Test-252456033 tempest-HypervisorAdminNegativeUnderV252Test-252456033-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:31.369377 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1fb460cf-1c61-42e0-97a4-22ab090fe714 tempest-HypervisorAdminNegativeUnderV252Test-252456033 tempest-HypervisorAdminNegativeUnderV252Test-252456033-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:31.370033 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1fb460cf-1c61-42e0-97a4-22ab090fe714 tempest-HypervisorAdminNegativeUnderV252Test-252456033 tempest-HypervisorAdminNegativeUnderV252Test-252456033-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:31.378607 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-1fb460cf-1c61-42e0-97a4-22ab090fe714 tempest-HypervisorAdminNegativeUnderV252Test-252456033 tempest-HypervisorAdminNegativeUnderV252Test-252456033-project-admin] HTTP exception thrown: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 22 20:49:31.381094 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-1fb460cf-1c61-42e0-97a4-22ab090fe714 tempest-HypervisorAdminNegativeUnderV252Test-252456033 tempest-HypervisorAdminNegativeUnderV252Test-252456033-project-admin] Request method failure captured: Oct 22 20:49:31.381094 ncdv-master-1 devstack@n-api.service[138744]: request: GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search HTTP/1.1 Oct 22 20:49:31.381094 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 20:49:31.381094 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 20:49:31.381094 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 20:49:31.381094 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 0 Oct 22 20:49:31.381094 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 20:49:31.381094 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 20:49:31.381094 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 20:49:31.381094 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 20:49:31.381094 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVFdZ73An2H6iXDiiWeV6MpH8rbxB2NTRYaPADRE3O5ZeQPaQO1q_l8-Mvt7hDGKxikZMMk3b0LD6PfYdyNXIrzV_7Q3ezGXubIiROLhpDqfDXVHE3rUQ4xvdOBHb8ch5AsuhqK9MaRkluybjkAxCnLs4V4eVOMdHmpcfKxpRt1DzZz4 Oct 22 20:49:31.381094 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 20:49:31.381094 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 20:49:31.381094 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 20:49:31.381094 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 20:49:31.381094 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 20:49:31.381094 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 20:49:31.381094 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: 66575d42a0ff4e51a95a9b09a6b817fe Oct 22 20:49:31.381094 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-252456033 Oct 22 20:49:31.381094 ncdv-master-1 devstack@n-api.service[138744]: X-Role: admin,member,reader Oct 22 20:49:31.381094 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: admin,member,reader Oct 22 20:49:31.382336 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_66575d42a0ff4e51a95a9b09a6b817fe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/66575d42a0ff4e51a95a9b09a6b817fe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/66575d42a0ff4e51a95a9b09a6b817fe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/66575d42a0ff4e51a95a9b09a6b817fe"}]}] Oct 22 20:49:31.382336 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-252456033 Oct 22 20:49:31.382336 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: 66575d42a0ff4e51a95a9b09a6b817fe Oct 22 20:49:31.382336 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-252456033 Oct 22 20:49:31.382336 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-252456033-project-admin Oct 22 20:49:31.382336 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 20:49:31.382336 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 20:49:31.382336 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: ab5505579fa944c882e7ddee602b1181 Oct 22 20:49:31.382336 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-252456033-project-admin Oct 22 20:49:31.382336 ncdv-master-1 devstack@n-api.service[138744]: method: Oct 22 20:49:31.382336 ncdv-master-1 devstack@n-api.service[138744]: exception: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 22 20:49:31.382336 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': 'nonexistent_hypervisor_name'} Oct 22 20:49:31.383009 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:49:31.383009 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:49:31.383009 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:49:31.383009 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:49:31.383009 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:49:31.383009 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:49:31.383009 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 22 20:49:31.383009 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 22 20:49:31.383009 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:49:31.383009 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:49:31.383009 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 443, in search Oct 22 20:49:31.383009 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Oct 22 20:49:31.383009 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Oct 22 20:49:31.383009 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 22 20:49:31.383009 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 22 20:49:31.383009 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:49:31.383009 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:49:31.383009 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:49:31.383009 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:49:31.383009 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:49:31.384127 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:49:31.384127 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 20:49:31.384127 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 20:49:31.384127 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 22 20:49:31.384127 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:49:31.385791 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-1fb460cf-1c61-42e0-97a4-22ab090fe714 tempest-HypervisorAdminNegativeUnderV252Test-252456033 tempest-HypervisorAdminNegativeUnderV252Test-252456033-project-admin] Returning 404 to user: No hypervisor matching 'nonexistent_hypervisor_name' could be found. {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:49:31.386856 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-1fb460cf-1c61-42e0-97a4-22ab090fe714 tempest-HypervisorAdminNegativeUnderV252Test-252456033 tempest-HypervisorAdminNegativeUnderV252Test-252456033-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search" status: 404 len: 114 microversion: 2.1 time: 0.032314 Oct 22 20:49:31.387954 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 166/388] 10.222.0.18 () {58 vars in 1251 bytes} [Sat Oct 22 20:49:31 2022] GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search => generated 114 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 20:49:31.395722 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-1522b6b5-3799-4294-9eef-f6b9d80433a0 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:49:31.396672 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-1522b6b5-3799-4294-9eef-f6b9d80433a0 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] [instance: 1d613848-05f4-478f-a569-b4c50576edb7] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:49:31.405099 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1522b6b5-3799-4294-9eef-f6b9d80433a0 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:31.405902 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1522b6b5-3799-4294-9eef-f6b9d80433a0 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:31.406543 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1522b6b5-3799-4294-9eef-f6b9d80433a0 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:31.407523 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1522b6b5-3799-4294-9eef-f6b9d80433a0 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:31.408179 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1522b6b5-3799-4294-9eef-f6b9d80433a0 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:31.408912 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1522b6b5-3799-4294-9eef-f6b9d80433a0 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:31.436153 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-7a6b6d15-0875-4774-ad72-76b2ba1a6e71 tempest-ServicesAdminTestJSON-320224419 tempest-ServicesAdminTestJSON-320224419-project-admin] 10.222.0.18 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.115211 Oct 22 20:49:31.439810 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 223/389] 10.222.0.18 () {58 vars in 1176 bytes} [Sat Oct 22 20:49:31 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:49:31.453030 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-29468537-f465-4df4-b96b-ad154361c8da tempest-FlavorsAccessNegativeTestJSON-1155582995 tempest-FlavorsAccessNegativeTestJSON-1155582995-project-admin] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:49:31.526327 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-29468537-f465-4df4-b96b-ad154361c8da tempest-FlavorsAccessNegativeTestJSON-1155582995 tempest-FlavorsAccessNegativeTestJSON-1155582995-project-admin] 10.222.0.18 "DELETE /compute/v2.1/flavors/1166462420" status: 202 len: 0 microversion: 2.1 time: 0.080731 Oct 22 20:49:31.526946 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 224/390] 10.222.0.18 () {58 vars in 1161 bytes} [Sat Oct 22 20:49:31 2022] DELETE /compute/v2.1/flavors/1166462420 => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 20:49:31.539376 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-2f71ea56-aeff-4c03-8680-9ae85f5658cf tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:49:31.542934 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-2f71ea56-aeff-4c03-8680-9ae85f5658cf tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] [instance: 96add0b3-b82f-4a0a-bec3-9a6341ae5dec] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:49:31.564172 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2f71ea56-aeff-4c03-8680-9ae85f5658cf tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:31.568925 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2f71ea56-aeff-4c03-8680-9ae85f5658cf tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:31.573122 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2f71ea56-aeff-4c03-8680-9ae85f5658cf tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:31.573956 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2f71ea56-aeff-4c03-8680-9ae85f5658cf tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:31.574454 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2f71ea56-aeff-4c03-8680-9ae85f5658cf tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:31.574880 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2f71ea56-aeff-4c03-8680-9ae85f5658cf tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:31.624229 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.wsgi [None req-2f71ea56-aeff-4c03-8680-9ae85f5658cf tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] HTTP exception thrown: Instance 96add0b3-b82f-4a0a-bec3-9a6341ae5dec could not be found. Oct 22 20:49:31.628952 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-2f71ea56-aeff-4c03-8680-9ae85f5658cf tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Request method failure captured: Oct 22 20:49:31.628952 ncdv-master-1 devstack@n-api.service[138745]: request: DELETE /compute/v2.1/servers/96add0b3-b82f-4a0a-bec3-9a6341ae5dec HTTP/1.1 Oct 22 20:49:31.628952 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 20:49:31.628952 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 20:49:31.628952 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 20:49:31.628952 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 0 Oct 22 20:49:31.628952 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 20:49:31.628952 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 20:49:31.628952 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 20:49:31.628952 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 20:49:31.628952 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVFcYYORhwFB1ry8Evy8Voe9D4YGgNQU5_4r5xU__9WXZwFhi1ysgPAlzqoWtpXWb5AmV6DcS0MfiQoPElUcKT8-mpbeXfIqn597wkNknXaYh6U3AKbg58fbAPYPOorYCbxVAYf4DMC0ny28dLv3iMq4Wg-HScb3aYg1qBD2hJHVN7WI Oct 22 20:49:31.628952 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 20:49:31.628952 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 20:49:31.628952 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 20:49:31.628952 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 20:49:31.628952 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 20:49:31.628952 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 20:49:31.628952 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: 2675a324f0134844a1964f64322493ba Oct 22 20:49:31.628952 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-DeleteServersAdminTestJSON-331859835 Oct 22 20:49:31.628952 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 20:49:31.628952 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 20:49:31.630201 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_2675a324f0134844a1964f64322493ba"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2675a324f0134844a1964f64322493ba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/2675a324f0134844a1964f64322493ba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2675a324f0134844a1964f64322493ba"}]}] Oct 22 20:49:31.630201 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-DeleteServersAdminTestJSON-331859835 Oct 22 20:49:31.630201 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: 2675a324f0134844a1964f64322493ba Oct 22 20:49:31.630201 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-331859835 Oct 22 20:49:31.630201 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-DeleteServersAdminTestJSON-331859835-project Oct 22 20:49:31.630201 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 20:49:31.630201 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 20:49:31.630201 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: 16e13dcabaaa4b218945aeeabb4c902e Oct 22 20:49:31.630201 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-DeleteServersAdminTestJSON-331859835-project Oct 22 20:49:31.630201 ncdv-master-1 devstack@n-api.service[138745]: method: > Oct 22 20:49:31.630201 ncdv-master-1 devstack@n-api.service[138745]: exception: Instance 96add0b3-b82f-4a0a-bec3-9a6341ae5dec could not be found. Oct 22 20:49:31.630201 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'id': '96add0b3-b82f-4a0a-bec3-9a6341ae5dec'} Oct 22 20:49:31.630889 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:49:31.630889 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:49:31.630889 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 20:49:31.630889 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 20:49:31.630889 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 20:49:31.630889 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 20:49:31.630889 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 20:49:31.630889 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 20:49:31.630889 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 20:49:31.630889 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 20:49:31.630889 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 96add0b3-b82f-4a0a-bec3-9a6341ae5dec could not be found. Oct 22 20:49:31.630889 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:49:31.630889 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:49:31.630889 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:49:31.630889 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:49:31.630889 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:49:31.630889 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:49:31.630889 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:49:31.630889 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:49:31.630889 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:49:31.632032 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:49:31.632032 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 22 20:49:31.632032 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 22 20:49:31.632032 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 22 20:49:31.632032 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 22 20:49:31.632032 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 20:49:31.632032 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 20:49:31.632032 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 20:49:31.632032 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 20:49:31.632032 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 96add0b3-b82f-4a0a-bec3-9a6341ae5dec could not be found. Oct 22 20:49:31.632032 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:49:31.632032 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:49:31.632032 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:49:31.632032 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:49:31.632032 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:49:31.632032 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:49:31.632032 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 20:49:31.632032 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 20:49:31.632032 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 96add0b3-b82f-4a0a-bec3-9a6341ae5dec could not be found. Oct 22 20:49:31.632032 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:49:31.634654 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-2f71ea56-aeff-4c03-8680-9ae85f5658cf tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Returning 404 to user: Instance 96add0b3-b82f-4a0a-bec3-9a6341ae5dec could not be found. {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:49:31.636812 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-2f71ea56-aeff-4c03-8680-9ae85f5658cf tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] 10.222.0.18 "DELETE /compute/v2.1/servers/96add0b3-b82f-4a0a-bec3-9a6341ae5dec" status: 404 len: 111 microversion: 2.1 time: 0.108162 Oct 22 20:49:31.643186 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 225/391] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 20:49:31 2022] DELETE /compute/v2.1/servers/96add0b3-b82f-4a0a-bec3-9a6341ae5dec => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 20:49:31.649075 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-9fce53b2-5a25-4e32-ae48-8f874910df14 tempest-HypervisorAdminNegativeUnderV252Test-252456033 tempest-HypervisorAdminNegativeUnderV252Test-252456033-project-admin] Calling method '.version_select at 0x7fd3a4a3ba60>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:49:31.655797 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9fce53b2-5a25-4e32-ae48-8f874910df14 tempest-HypervisorAdminNegativeUnderV252Test-252456033 tempest-HypervisorAdminNegativeUnderV252Test-252456033-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:31.659244 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9fce53b2-5a25-4e32-ae48-8f874910df14 tempest-HypervisorAdminNegativeUnderV252Test-252456033 tempest-HypervisorAdminNegativeUnderV252Test-252456033-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:31.659840 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9fce53b2-5a25-4e32-ae48-8f874910df14 tempest-HypervisorAdminNegativeUnderV252Test-252456033 tempest-HypervisorAdminNegativeUnderV252Test-252456033-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:31.694326 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9fce53b2-5a25-4e32-ae48-8f874910df14 tempest-HypervisorAdminNegativeUnderV252Test-252456033 tempest-HypervisorAdminNegativeUnderV252Test-252456033-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:31.695268 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9fce53b2-5a25-4e32-ae48-8f874910df14 tempest-HypervisorAdminNegativeUnderV252Test-252456033 tempest-HypervisorAdminNegativeUnderV252Test-252456033-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:31.696584 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9fce53b2-5a25-4e32-ae48-8f874910df14 tempest-HypervisorAdminNegativeUnderV252Test-252456033 tempest-HypervisorAdminNegativeUnderV252Test-252456033-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:31.713764 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9fce53b2-5a25-4e32-ae48-8f874910df14 tempest-HypervisorAdminNegativeUnderV252Test-252456033 tempest-HypervisorAdminNegativeUnderV252Test-252456033-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:31.714617 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9fce53b2-5a25-4e32-ae48-8f874910df14 tempest-HypervisorAdminNegativeUnderV252Test-252456033 tempest-HypervisorAdminNegativeUnderV252Test-252456033-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:31.715264 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9fce53b2-5a25-4e32-ae48-8f874910df14 tempest-HypervisorAdminNegativeUnderV252Test-252456033 tempest-HypervisorAdminNegativeUnderV252Test-252456033-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:31.720575 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-1522b6b5-3799-4294-9eef-f6b9d80433a0 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:49:31.740249 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-1522b6b5-3799-4294-9eef-f6b9d80433a0 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:49:31.743518 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-1522b6b5-3799-4294-9eef-f6b9d80433a0 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:49:31.750037 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-9fce53b2-5a25-4e32-ae48-8f874910df14 tempest-HypervisorAdminNegativeUnderV252Test-252456033 tempest-HypervisorAdminNegativeUnderV252Test-252456033-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.104598 Oct 22 20:49:31.750673 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-1522b6b5-3799-4294-9eef-f6b9d80433a0 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] 10.222.0.18 "GET /compute/v2.1/servers/1d613848-05f4-478f-a569-b4c50576edb7" status: 200 len: 1559 microversion: 2.25 time: 0.359463 Oct 22 20:49:31.751369 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 226/392] 10.222.0.18 () {58 vars in 1146 bytes} [Sat Oct 22 20:49:31 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:49:31.751883 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 167/393] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 20:49:31 2022] GET /compute/v2.1/servers/1d613848-05f4-478f-a569-b4c50576edb7 => generated 1559 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 20:49:31.761140 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-fa61a752-3554-4dd6-b512-7ee3af2c1fd3 tempest-FlavorsAccessNegativeTestJSON-1155582995 tempest-FlavorsAccessNegativeTestJSON-1155582995-project-admin] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:49:31.762927 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-bf20f8ae-d8ce-41f0-819a-400ce466fa7c tempest-ServicesAdminTestJSON-320224419 tempest-ServicesAdminTestJSON-320224419-project-admin] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:49:31.769555 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bf20f8ae-d8ce-41f0-819a-400ce466fa7c tempest-ServicesAdminTestJSON-320224419 tempest-ServicesAdminTestJSON-320224419-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:31.773504 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bf20f8ae-d8ce-41f0-819a-400ce466fa7c tempest-ServicesAdminTestJSON-320224419 tempest-ServicesAdminTestJSON-320224419-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:31.774169 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bf20f8ae-d8ce-41f0-819a-400ce466fa7c tempest-ServicesAdminTestJSON-320224419 tempest-ServicesAdminTestJSON-320224419-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:31.777665 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bf20f8ae-d8ce-41f0-819a-400ce466fa7c tempest-ServicesAdminTestJSON-320224419 tempest-ServicesAdminTestJSON-320224419-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:31.778897 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bf20f8ae-d8ce-41f0-819a-400ce466fa7c tempest-ServicesAdminTestJSON-320224419 tempest-ServicesAdminTestJSON-320224419-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:31.779959 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bf20f8ae-d8ce-41f0-819a-400ce466fa7c tempest-ServicesAdminTestJSON-320224419 tempest-ServicesAdminTestJSON-320224419-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:31.813753 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-fa61a752-3554-4dd6-b512-7ee3af2c1fd3 tempest-FlavorsAccessNegativeTestJSON-1155582995 tempest-FlavorsAccessNegativeTestJSON-1155582995-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.060622 Oct 22 20:49:31.818230 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 168/394] 10.222.0.18 () {58 vars in 1146 bytes} [Sat Oct 22 20:49:31 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:49:31.827217 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-a1879448-7657-4d8c-a2cf-6e23e8e28e14 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:49:31.829574 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=2,nova_api:DELETE=4 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:49:31.832203 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-a1879448-7657-4d8c-a2cf-6e23e8e28e14 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] [instance: 96add0b3-b82f-4a0a-bec3-9a6341ae5dec] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:49:31.844522 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a1879448-7657-4d8c-a2cf-6e23e8e28e14 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:31.845172 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a1879448-7657-4d8c-a2cf-6e23e8e28e14 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:31.845846 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a1879448-7657-4d8c-a2cf-6e23e8e28e14 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:31.846852 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a1879448-7657-4d8c-a2cf-6e23e8e28e14 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:31.847434 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a1879448-7657-4d8c-a2cf-6e23e8e28e14 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:31.847547 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-bf20f8ae-d8ce-41f0-819a-400ce466fa7c tempest-ServicesAdminTestJSON-320224419 tempest-ServicesAdminTestJSON-320224419-project-admin] 10.222.0.18 "GET /compute/v2.1/os-services" status: 200 len: 947 microversion: 2.1 time: 0.093060 Oct 22 20:49:31.847968 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a1879448-7657-4d8c-a2cf-6e23e8e28e14 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:31.848136 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 227/395] 10.222.0.18 () {58 vars in 1137 bytes} [Sat Oct 22 20:49:31 2022] GET /compute/v2.1/os-services => generated 947 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:49:31.864734 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-bbd87d5d-62fa-4027-9f0e-4a1ca88244f0 tempest-HypervisorAdminNegativeUnderV252Test-1510085462 tempest-HypervisorAdminNegativeUnderV252Test-1510085462-project] Calling method '.version_select at 0x7fd3a4a3bf70>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:49:31.866481 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-bbd87d5d-62fa-4027-9f0e-4a1ca88244f0 tempest-HypervisorAdminNegativeUnderV252Test-1510085462 tempest-HypervisorAdminNegativeUnderV252Test-1510085462-project] Policy check for os_compute_api:os-hypervisors:servers failed with credentials {'is_admin': False, 'user_id': '91702e4ea3be48da8c6ae42a3a7004f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1022407f76c54e7cb820879c0e91982b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:49:31.868353 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-bbd87d5d-62fa-4027-9f0e-4a1ca88244f0 tempest-HypervisorAdminNegativeUnderV252Test-1510085462 tempest-HypervisorAdminNegativeUnderV252Test-1510085462-project] Request method failure captured: Oct 22 20:49:31.868353 ncdv-master-1 devstack@n-api.service[138745]: request: GET /compute/v2.1/os-hypervisors/1/servers HTTP/1.1 Oct 22 20:49:31.868353 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 20:49:31.868353 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 20:49:31.868353 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 20:49:31.868353 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 0 Oct 22 20:49:31.868353 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 20:49:31.868353 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 20:49:31.868353 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 20:49:31.868353 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 20:49:31.868353 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVFdWEWeUQgnZitv_rTh9Jieclh4qJHVuBqWVvZTgWqLvuPBlTecw6aX7nRwa-V04pt3HnIu-OohBlaQlrFlnOJ0jUpsmpbjh4u2QE_4OHzBOT5cbFm8WL4KB_RA3dl9IfrCESkcge90ZpNWe2gwi_bjbICNQ3kisNwLkHOu1DFy1BqE Oct 22 20:49:31.868353 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 20:49:31.868353 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 20:49:31.868353 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 20:49:31.868353 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 20:49:31.868353 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 20:49:31.868353 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 20:49:31.868353 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: 1022407f76c54e7cb820879c0e91982b Oct 22 20:49:31.868353 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1510085462 Oct 22 20:49:31.868353 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 20:49:31.868353 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 20:49:31.869822 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_1022407f76c54e7cb820879c0e91982b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1022407f76c54e7cb820879c0e91982b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/1022407f76c54e7cb820879c0e91982b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1022407f76c54e7cb820879c0e91982b"}]}] Oct 22 20:49:31.869822 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1510085462 Oct 22 20:49:31.869822 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: 1022407f76c54e7cb820879c0e91982b Oct 22 20:49:31.869822 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1510085462 Oct 22 20:49:31.869822 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1510085462-project Oct 22 20:49:31.869822 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 20:49:31.869822 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 20:49:31.869822 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: 91702e4ea3be48da8c6ae42a3a7004f9 Oct 22 20:49:31.869822 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1510085462-project Oct 22 20:49:31.869822 ncdv-master-1 devstack@n-api.service[138745]: method: Oct 22 20:49:31.869822 ncdv-master-1 devstack@n-api.service[138745]: exception: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Oct 22 20:49:31.869822 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'id': '1'} Oct 22 20:49:31.870616 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:49:31.870616 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:49:31.870616 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:49:31.870616 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:49:31.870616 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:49:31.870616 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:49:31.870616 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 22 20:49:31.870616 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 22 20:49:31.870616 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:49:31.870616 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:49:31.870616 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 478, in servers Oct 22 20:49:31.870616 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'servers', target={}) Oct 22 20:49:31.870616 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 22 20:49:31.870616 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 22 20:49:31.870616 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 22 20:49:31.870616 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 22 20:49:31.870616 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 22 20:49:31.870616 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 22 20:49:31.870616 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 22 20:49:31.871901 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise self.value Oct 22 20:49:31.871901 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 22 20:49:31.871901 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 22 20:49:31.871901 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 22 20:49:31.871901 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 22 20:49:31.871901 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 22 20:49:31.871901 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 22 20:49:31.871901 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Oct 22 20:49:31.871901 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:49:31.871901 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:49:31.871901 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:49:31.871901 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:49:31.871901 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:49:31.871901 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:49:31.871901 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 22 20:49:31.871901 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 22 20:49:31.871901 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Oct 22 20:49:31.871901 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:49:31.873087 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-bbd87d5d-62fa-4027-9f0e-4a1ca88244f0 tempest-HypervisorAdminNegativeUnderV252Test-1510085462 tempest-HypervisorAdminNegativeUnderV252Test-1510085462-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:49:31.873087 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-bbd87d5d-62fa-4027-9f0e-4a1ca88244f0 tempest-HypervisorAdminNegativeUnderV252Test-1510085462 tempest-HypervisorAdminNegativeUnderV252Test-1510085462-project] 10.222.0.18 "GET /compute/v2.1/os-hypervisors/1/servers" status: 403 len: 118 microversion: 2.1 time: 0.009964 Oct 22 20:49:31.876777 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 228/396] 10.222.0.18 () {58 vars in 1176 bytes} [Sat Oct 22 20:49:31 2022] GET /compute/v2.1/os-hypervisors/1/servers => generated 118 bytes in 17 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 22 20:49:31.889046 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-a1879448-7657-4d8c-a2cf-6e23e8e28e14 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] HTTP exception thrown: Instance 96add0b3-b82f-4a0a-bec3-9a6341ae5dec could not be found. Oct 22 20:49:31.891664 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-a1879448-7657-4d8c-a2cf-6e23e8e28e14 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Request method failure captured: Oct 22 20:49:31.891664 ncdv-master-1 devstack@n-api.service[138744]: request: GET /compute/v2.1/servers/96add0b3-b82f-4a0a-bec3-9a6341ae5dec HTTP/1.1 Oct 22 20:49:31.891664 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 20:49:31.891664 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 20:49:31.891664 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 20:49:31.891664 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 0 Oct 22 20:49:31.891664 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 20:49:31.891664 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 20:49:31.891664 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 20:49:31.891664 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 20:49:31.891664 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVFcYYORhwFB1ry8Evy8Voe9D4YGgNQU5_4r5xU__9WXZwFhi1ysgPAlzqoWtpXWb5AmV6DcS0MfiQoPElUcKT8-mpbeXfIqn597wkNknXaYh6U3AKbg58fbAPYPOorYCbxVAYf4DMC0ny28dLv3iMq4Wg-HScb3aYg1qBD2hJHVN7WI Oct 22 20:49:31.891664 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 20:49:31.891664 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 20:49:31.891664 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 20:49:31.891664 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 20:49:31.891664 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 20:49:31.891664 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 20:49:31.891664 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: 2675a324f0134844a1964f64322493ba Oct 22 20:49:31.891664 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-DeleteServersAdminTestJSON-331859835 Oct 22 20:49:31.891664 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 20:49:31.891664 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 20:49:31.893168 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_2675a324f0134844a1964f64322493ba"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2675a324f0134844a1964f64322493ba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/2675a324f0134844a1964f64322493ba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2675a324f0134844a1964f64322493ba"}]}] Oct 22 20:49:31.893168 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-DeleteServersAdminTestJSON-331859835 Oct 22 20:49:31.893168 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: 2675a324f0134844a1964f64322493ba Oct 22 20:49:31.893168 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-331859835 Oct 22 20:49:31.893168 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-DeleteServersAdminTestJSON-331859835-project Oct 22 20:49:31.893168 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 20:49:31.893168 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 20:49:31.893168 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: 16e13dcabaaa4b218945aeeabb4c902e Oct 22 20:49:31.893168 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-DeleteServersAdminTestJSON-331859835-project Oct 22 20:49:31.893168 ncdv-master-1 devstack@n-api.service[138744]: method: > Oct 22 20:49:31.893168 ncdv-master-1 devstack@n-api.service[138744]: exception: Instance 96add0b3-b82f-4a0a-bec3-9a6341ae5dec could not be found. Oct 22 20:49:31.893168 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': '96add0b3-b82f-4a0a-bec3-9a6341ae5dec'} Oct 22 20:49:31.893981 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:49:31.893981 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:49:31.893981 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 20:49:31.893981 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 20:49:31.893981 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 20:49:31.893981 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 20:49:31.893981 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 20:49:31.893981 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 20:49:31.893981 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 20:49:31.893981 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 20:49:31.893981 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 96add0b3-b82f-4a0a-bec3-9a6341ae5dec could not be found. Oct 22 20:49:31.893981 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:49:31.893981 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:49:31.893981 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:49:31.893981 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:49:31.893981 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:49:31.893981 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:49:31.893981 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:49:31.893981 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:49:31.893981 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:49:31.895148 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:49:31.895148 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 20:49:31.895148 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 20:49:31.895148 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 20:49:31.895148 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 20:49:31.895148 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 20:49:31.895148 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 20:49:31.895148 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 96add0b3-b82f-4a0a-bec3-9a6341ae5dec could not be found. Oct 22 20:49:31.895148 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:49:31.895148 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:49:31.895148 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:49:31.895148 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:49:31.895148 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:49:31.895148 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:49:31.895148 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 20:49:31.895148 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 20:49:31.895148 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 96add0b3-b82f-4a0a-bec3-9a6341ae5dec could not be found. Oct 22 20:49:31.895148 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:49:31.897778 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-a1879448-7657-4d8c-a2cf-6e23e8e28e14 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Returning 404 to user: Instance 96add0b3-b82f-4a0a-bec3-9a6341ae5dec could not be found. {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:49:31.899243 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-a1879448-7657-4d8c-a2cf-6e23e8e28e14 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] 10.222.0.18 "GET /compute/v2.1/servers/96add0b3-b82f-4a0a-bec3-9a6341ae5dec" status: 404 len: 111 microversion: 2.1 time: 0.076060 Oct 22 20:49:31.900319 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 169/397] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:49:31 2022] GET /compute/v2.1/servers/96add0b3-b82f-4a0a-bec3-9a6341ae5dec => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 20:49:31.906853 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-da7e61f3-4fb1-4a65-8549-3b03dc3d1362 tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:49:31.912298 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-da7e61f3-4fb1-4a65-8549-3b03dc3d1362 tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] [instance: 5c3de24c-090d-4769-8975-207eb939b979] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:49:31.926763 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-da7e61f3-4fb1-4a65-8549-3b03dc3d1362 tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:31.927294 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-da7e61f3-4fb1-4a65-8549-3b03dc3d1362 tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:31.929484 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-da7e61f3-4fb1-4a65-8549-3b03dc3d1362 tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:31.931155 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-da7e61f3-4fb1-4a65-8549-3b03dc3d1362 tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:31.931784 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-da7e61f3-4fb1-4a65-8549-3b03dc3d1362 tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:31.947763 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-da7e61f3-4fb1-4a65-8549-3b03dc3d1362 tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:32.107401 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.objects.instance [None req-da7e61f3-4fb1-4a65-8549-3b03dc3d1362 tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] Lazy-loading 'services' on Instance uuid 5c3de24c-090d-4769-8975-207eb939b979 {{(pid=138744) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 20:49:32.152988 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-da7e61f3-4fb1-4a65-8549-3b03dc3d1362 tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/5c3de24c-090d-4769-8975-207eb939b979" status: 200 len: 1927 microversion: 2.75 time: 0.250164 Oct 22 20:49:32.158282 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 170/398] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 20:49:31 2022] GET /compute/v2.1/servers/5c3de24c-090d-4769-8975-207eb939b979 => generated 1927 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 20:49:32.169390 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-7ceaeaf2-f561-4d2c-96fa-d9dc57cae3b3 tempest-FlavorsAccessNegativeTestJSON-1155582995 tempest-FlavorsAccessNegativeTestJSON-1155582995-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1698403003", "id": 635078478, "os-flavor-access:is_public": "True"}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:49:32.231561 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-7ceaeaf2-f561-4d2c-96fa-d9dc57cae3b3 tempest-FlavorsAccessNegativeTestJSON-1155582995 tempest-FlavorsAccessNegativeTestJSON-1155582995-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.071591 Oct 22 20:49:32.235992 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 171/399] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Oct 22 20:49:32 2022] POST /compute/v2.1/flavors => generated 435 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:49:32.252418 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-64dbe57a-54c3-4f31-97e4-be696bd63bff tempest-HypervisorAdminNegativeUnderV252Test-252456033 tempest-HypervisorAdminNegativeUnderV252Test-252456033-project-admin] Calling method '.version_select at 0x7fd3a4727ca0>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:49:32.262758 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-64dbe57a-54c3-4f31-97e4-be696bd63bff tempest-HypervisorAdminNegativeUnderV252Test-252456033 tempest-HypervisorAdminNegativeUnderV252Test-252456033-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:32.265011 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-64dbe57a-54c3-4f31-97e4-be696bd63bff tempest-HypervisorAdminNegativeUnderV252Test-252456033 tempest-HypervisorAdminNegativeUnderV252Test-252456033-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:32.265687 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-64dbe57a-54c3-4f31-97e4-be696bd63bff tempest-HypervisorAdminNegativeUnderV252Test-252456033 tempest-HypervisorAdminNegativeUnderV252Test-252456033-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:32.286122 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-64dbe57a-54c3-4f31-97e4-be696bd63bff tempest-HypervisorAdminNegativeUnderV252Test-252456033 tempest-HypervisorAdminNegativeUnderV252Test-252456033-project-admin] HTTP exception thrown: No hypervisor matching '0b41401e-8265-449e-a686-d86a244d6a86' could be found. Oct 22 20:49:32.288081 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-64dbe57a-54c3-4f31-97e4-be696bd63bff tempest-HypervisorAdminNegativeUnderV252Test-252456033 tempest-HypervisorAdminNegativeUnderV252Test-252456033-project-admin] Request method failure captured: Oct 22 20:49:32.288081 ncdv-master-1 devstack@n-api.service[138744]: request: GET /compute/v2.1/os-hypervisors/0b41401e-8265-449e-a686-d86a244d6a86/servers HTTP/1.1 Oct 22 20:49:32.288081 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 20:49:32.288081 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 20:49:32.288081 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 20:49:32.288081 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 0 Oct 22 20:49:32.288081 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 20:49:32.288081 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 20:49:32.288081 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 20:49:32.288081 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 20:49:32.288081 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVFdZ73An2H6iXDiiWeV6MpH8rbxB2NTRYaPADRE3O5ZeQPaQO1q_l8-Mvt7hDGKxikZMMk3b0LD6PfYdyNXIrzV_7Q3ezGXubIiROLhpDqfDXVHE3rUQ4xvdOBHb8ch5AsuhqK9MaRkluybjkAxCnLs4V4eVOMdHmpcfKxpRt1DzZz4 Oct 22 20:49:32.288081 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 20:49:32.288081 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 20:49:32.288081 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 20:49:32.288081 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 20:49:32.288081 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 20:49:32.288081 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 20:49:32.288081 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: 66575d42a0ff4e51a95a9b09a6b817fe Oct 22 20:49:32.288081 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-252456033 Oct 22 20:49:32.288081 ncdv-master-1 devstack@n-api.service[138744]: X-Role: admin,member,reader Oct 22 20:49:32.288081 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: admin,member,reader Oct 22 20:49:32.289267 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_66575d42a0ff4e51a95a9b09a6b817fe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/66575d42a0ff4e51a95a9b09a6b817fe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/66575d42a0ff4e51a95a9b09a6b817fe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/66575d42a0ff4e51a95a9b09a6b817fe"}]}] Oct 22 20:49:32.289267 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-252456033 Oct 22 20:49:32.289267 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: 66575d42a0ff4e51a95a9b09a6b817fe Oct 22 20:49:32.289267 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-252456033 Oct 22 20:49:32.289267 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-252456033-project-admin Oct 22 20:49:32.289267 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 20:49:32.289267 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 20:49:32.289267 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: ab5505579fa944c882e7ddee602b1181 Oct 22 20:49:32.289267 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-252456033-project-admin Oct 22 20:49:32.289267 ncdv-master-1 devstack@n-api.service[138744]: method: Oct 22 20:49:32.289267 ncdv-master-1 devstack@n-api.service[138744]: exception: No hypervisor matching '0b41401e-8265-449e-a686-d86a244d6a86' could be found. Oct 22 20:49:32.289267 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': '0b41401e-8265-449e-a686-d86a244d6a86'} Oct 22 20:49:32.289905 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:49:32.289905 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:49:32.289905 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:49:32.289905 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:49:32.289905 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:49:32.289905 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:49:32.289905 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 22 20:49:32.289905 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 22 20:49:32.289905 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:49:32.289905 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:49:32.289905 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 482, in servers Oct 22 20:49:32.289905 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Oct 22 20:49:32.289905 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Oct 22 20:49:32.289905 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 22 20:49:32.289905 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching '0b41401e-8265-449e-a686-d86a244d6a86' could be found. Oct 22 20:49:32.289905 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:49:32.289905 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:49:32.289905 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:49:32.289905 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:49:32.290891 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:49:32.290891 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:49:32.290891 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 20:49:32.290891 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 20:49:32.290891 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching '0b41401e-8265-449e-a686-d86a244d6a86' could be found. Oct 22 20:49:32.290891 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:49:32.294267 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-64dbe57a-54c3-4f31-97e4-be696bd63bff tempest-HypervisorAdminNegativeUnderV252Test-252456033 tempest-HypervisorAdminNegativeUnderV252Test-252456033-project-admin] Returning 404 to user: No hypervisor matching '0b41401e-8265-449e-a686-d86a244d6a86' could be found. {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:49:32.297222 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-64dbe57a-54c3-4f31-97e4-be696bd63bff tempest-HypervisorAdminNegativeUnderV252Test-252456033 tempest-HypervisorAdminNegativeUnderV252Test-252456033-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hypervisors/0b41401e-8265-449e-a686-d86a244d6a86/servers" status: 404 len: 123 microversion: 2.1 time: 0.058393 Oct 22 20:49:32.303863 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 172/400] 10.222.0.18 () {58 vars in 1281 bytes} [Sat Oct 22 20:49:32 2022] GET /compute/v2.1/os-hypervisors/0b41401e-8265-449e-a686-d86a244d6a86/servers => generated 123 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 20:49:32.317405 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-5ae9bb75-da46-4d3f-bfa3-4622f5be4b16 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:49:32.319286 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-5ae9bb75-da46-4d3f-bfa3-4622f5be4b16 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] [instance: f592a6fe-8cc7-4bb1-bb04-f8ddd358eeca] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:49:32.326935 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-127be5d0-263f-4675-9d8a-57ff0dee3db0 tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:49:32.328393 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-127be5d0-263f-4675-9d8a-57ff0dee3db0 tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] [instance: 1d613848-05f4-478f-a569-b4c50576edb7] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:49:32.356592 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5ae9bb75-da46-4d3f-bfa3-4622f5be4b16 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:32.357670 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5ae9bb75-da46-4d3f-bfa3-4622f5be4b16 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:32.358197 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5ae9bb75-da46-4d3f-bfa3-4622f5be4b16 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:32.358853 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-127be5d0-263f-4675-9d8a-57ff0dee3db0 tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:32.359437 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5ae9bb75-da46-4d3f-bfa3-4622f5be4b16 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:32.359974 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5ae9bb75-da46-4d3f-bfa3-4622f5be4b16 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:32.360603 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5ae9bb75-da46-4d3f-bfa3-4622f5be4b16 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:32.360727 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-127be5d0-263f-4675-9d8a-57ff0dee3db0 tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:32.361147 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-127be5d0-263f-4675-9d8a-57ff0dee3db0 tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:32.362105 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-127be5d0-263f-4675-9d8a-57ff0dee3db0 tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:32.362646 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-127be5d0-263f-4675-9d8a-57ff0dee3db0 tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:32.363067 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-127be5d0-263f-4675-9d8a-57ff0dee3db0 tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:32.404978 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-5ae9bb75-da46-4d3f-bfa3-4622f5be4b16 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] HTTP exception thrown: Instance f592a6fe-8cc7-4bb1-bb04-f8ddd358eeca could not be found. Oct 22 20:49:32.410228 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-5ae9bb75-da46-4d3f-bfa3-4622f5be4b16 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Request method failure captured: Oct 22 20:49:32.410228 ncdv-master-1 devstack@n-api.service[138744]: request: DELETE /compute/v2.1/servers/f592a6fe-8cc7-4bb1-bb04-f8ddd358eeca HTTP/1.1 Oct 22 20:49:32.410228 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 20:49:32.410228 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 20:49:32.410228 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 20:49:32.410228 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 0 Oct 22 20:49:32.410228 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 20:49:32.410228 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 20:49:32.410228 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 20:49:32.410228 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 20:49:32.410228 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVFcYYORhwFB1ry8Evy8Voe9D4YGgNQU5_4r5xU__9WXZwFhi1ysgPAlzqoWtpXWb5AmV6DcS0MfiQoPElUcKT8-mpbeXfIqn597wkNknXaYh6U3AKbg58fbAPYPOorYCbxVAYf4DMC0ny28dLv3iMq4Wg-HScb3aYg1qBD2hJHVN7WI Oct 22 20:49:32.410228 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 20:49:32.410228 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 20:49:32.410228 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 20:49:32.410228 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 20:49:32.410228 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 20:49:32.410228 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 20:49:32.410228 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: 2675a324f0134844a1964f64322493ba Oct 22 20:49:32.410228 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-DeleteServersAdminTestJSON-331859835 Oct 22 20:49:32.410228 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 20:49:32.410228 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 20:49:32.411770 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_2675a324f0134844a1964f64322493ba"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2675a324f0134844a1964f64322493ba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/2675a324f0134844a1964f64322493ba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2675a324f0134844a1964f64322493ba"}]}] Oct 22 20:49:32.411770 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-DeleteServersAdminTestJSON-331859835 Oct 22 20:49:32.411770 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: 2675a324f0134844a1964f64322493ba Oct 22 20:49:32.411770 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-331859835 Oct 22 20:49:32.411770 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-DeleteServersAdminTestJSON-331859835-project Oct 22 20:49:32.411770 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 20:49:32.411770 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 20:49:32.411770 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: 16e13dcabaaa4b218945aeeabb4c902e Oct 22 20:49:32.411770 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-DeleteServersAdminTestJSON-331859835-project Oct 22 20:49:32.411770 ncdv-master-1 devstack@n-api.service[138744]: method: > Oct 22 20:49:32.411770 ncdv-master-1 devstack@n-api.service[138744]: exception: Instance f592a6fe-8cc7-4bb1-bb04-f8ddd358eeca could not be found. Oct 22 20:49:32.411770 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': 'f592a6fe-8cc7-4bb1-bb04-f8ddd358eeca'} Oct 22 20:49:32.412480 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:49:32.412480 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:49:32.412480 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 20:49:32.412480 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 20:49:32.412480 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 20:49:32.412480 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 20:49:32.412480 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 20:49:32.412480 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 20:49:32.412480 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 20:49:32.412480 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 20:49:32.412480 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f592a6fe-8cc7-4bb1-bb04-f8ddd358eeca could not be found. Oct 22 20:49:32.412480 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:49:32.412480 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:49:32.412480 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:49:32.412480 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:49:32.412480 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:49:32.412480 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:49:32.412480 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:49:32.412480 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:49:32.412480 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:49:32.413591 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:49:32.413591 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 22 20:49:32.413591 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 22 20:49:32.413591 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 22 20:49:32.413591 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 22 20:49:32.413591 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 20:49:32.413591 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 20:49:32.413591 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 20:49:32.413591 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 20:49:32.413591 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f592a6fe-8cc7-4bb1-bb04-f8ddd358eeca could not be found. Oct 22 20:49:32.413591 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:49:32.413591 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:49:32.413591 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:49:32.413591 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:49:32.413591 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:49:32.413591 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:49:32.413591 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 20:49:32.413591 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 20:49:32.413591 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f592a6fe-8cc7-4bb1-bb04-f8ddd358eeca could not be found. Oct 22 20:49:32.413591 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:49:32.420174 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-5ae9bb75-da46-4d3f-bfa3-4622f5be4b16 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Returning 404 to user: Instance f592a6fe-8cc7-4bb1-bb04-f8ddd358eeca could not be found. {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:49:32.422666 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-5ae9bb75-da46-4d3f-bfa3-4622f5be4b16 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] 10.222.0.18 "DELETE /compute/v2.1/servers/f592a6fe-8cc7-4bb1-bb04-f8ddd358eeca" status: 404 len: 111 microversion: 2.1 time: 0.113743 Oct 22 20:49:32.445745 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 173/401] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 20:49:32 2022] DELETE /compute/v2.1/servers/f592a6fe-8cc7-4bb1-bb04-f8ddd358eeca => generated 111 bytes in 138 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 20:49:32.466906 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-9dee2eac-732b-4c1a-95ee-997caaf91ba4 tempest-FlavorsAccessNegativeTestJSON-1155582995 tempest-FlavorsAccessNegativeTestJSON-1155582995-project-admin] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:49:32.485996 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-9dee2eac-732b-4c1a-95ee-997caaf91ba4 tempest-FlavorsAccessNegativeTestJSON-1155582995 tempest-FlavorsAccessNegativeTestJSON-1155582995-project-admin] HTTP exception thrown: Access list not available for public flavors. Oct 22 20:49:32.493279 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-9dee2eac-732b-4c1a-95ee-997caaf91ba4 tempest-FlavorsAccessNegativeTestJSON-1155582995 tempest-FlavorsAccessNegativeTestJSON-1155582995-project-admin] Request method failure captured: Oct 22 20:49:32.493279 ncdv-master-1 devstack@n-api.service[138744]: request: GET /compute/v2.1/flavors/635078478/os-flavor-access HTTP/1.1 Oct 22 20:49:32.493279 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 20:49:32.493279 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 20:49:32.493279 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 20:49:32.493279 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 0 Oct 22 20:49:32.493279 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 20:49:32.493279 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 20:49:32.493279 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 20:49:32.493279 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 20:49:32.493279 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVFdVH0j3Onka0cJiJKz5mwWrdT3UkYTUrkBWWBgq6gIBGYoJrcu7Sw5ZMDuIE6sWOr5rOIb8l-Ogyrk9m2M1fd5Jp-ksiPJy-d_HlSyTriMuumIOdbVIWPr1UtH5i3ky5xLJOQvzZY8IucywSOTdp8Bne43Xw81w_YBnuHDuBNkREno Oct 22 20:49:32.493279 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 20:49:32.493279 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 20:49:32.493279 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 20:49:32.493279 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 20:49:32.493279 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 20:49:32.493279 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 20:49:32.493279 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: 9c8b0f59c10a4e55af2f72c7d77c13cc Oct 22 20:49:32.493279 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1155582995 Oct 22 20:49:32.493279 ncdv-master-1 devstack@n-api.service[138744]: X-Role: admin,member,reader Oct 22 20:49:32.493279 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: admin,member,reader Oct 22 20:49:32.494606 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_9c8b0f59c10a4e55af2f72c7d77c13cc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9c8b0f59c10a4e55af2f72c7d77c13cc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/9c8b0f59c10a4e55af2f72c7d77c13cc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9c8b0f59c10a4e55af2f72c7d77c13cc"}]}] Oct 22 20:49:32.494606 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1155582995 Oct 22 20:49:32.494606 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: 9c8b0f59c10a4e55af2f72c7d77c13cc Oct 22 20:49:32.494606 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1155582995 Oct 22 20:49:32.494606 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-FlavorsAccessNegativeTestJSON-1155582995-project-admin Oct 22 20:49:32.494606 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 20:49:32.494606 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 20:49:32.494606 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: 78c31e62d8d440bc9f2047d3107fe9f6 Oct 22 20:49:32.494606 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1155582995-project-admin Oct 22 20:49:32.494606 ncdv-master-1 devstack@n-api.service[138744]: method: > Oct 22 20:49:32.494606 ncdv-master-1 devstack@n-api.service[138744]: exception: Access list not available for public flavors. Oct 22 20:49:32.494606 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'flavor_id': '635078478'} Oct 22 20:49:32.495438 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:49:32.495438 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:49:32.495438 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:49:32.495438 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:49:32.495438 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:49:32.495438 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:49:32.495438 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:49:32.495438 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:49:32.495438 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 52, in index Oct 22 20:49:32.495438 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 22 20:49:32.495438 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Access list not available for public flavors. Oct 22 20:49:32.495438 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:49:32.495438 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:49:32.495438 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:49:32.495438 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:49:32.495438 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:49:32.495438 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:49:32.495438 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 20:49:32.495438 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 20:49:32.495438 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Access list not available for public flavors. Oct 22 20:49:32.495438 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:49:32.499510 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-9dee2eac-732b-4c1a-95ee-997caaf91ba4 tempest-FlavorsAccessNegativeTestJSON-1155582995 tempest-FlavorsAccessNegativeTestJSON-1155582995-project-admin] Returning 404 to user: Access list not available for public flavors. {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:49:32.500953 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-9dee2eac-732b-4c1a-95ee-997caaf91ba4 tempest-FlavorsAccessNegativeTestJSON-1155582995 tempest-FlavorsAccessNegativeTestJSON-1155582995-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/635078478/os-flavor-access" status: 404 len: 91 microversion: 2.1 time: 0.054131 Oct 22 20:49:32.505556 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 174/402] 10.222.0.18 () {58 vars in 1206 bytes} [Sat Oct 22 20:49:32 2022] GET /compute/v2.1/flavors/635078478/os-flavor-access => generated 91 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 22 20:49:32.519260 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-38fb77d7-0010-4b5f-8061-43bd54b751a8 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:49:32.520878 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-38fb77d7-0010-4b5f-8061-43bd54b751a8 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] [instance: f592a6fe-8cc7-4bb1-bb04-f8ddd358eeca] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:49:32.541792 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-38fb77d7-0010-4b5f-8061-43bd54b751a8 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:32.542291 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-38fb77d7-0010-4b5f-8061-43bd54b751a8 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:32.542735 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-38fb77d7-0010-4b5f-8061-43bd54b751a8 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:32.545645 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-38fb77d7-0010-4b5f-8061-43bd54b751a8 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:32.547544 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-38fb77d7-0010-4b5f-8061-43bd54b751a8 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:32.547993 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-38fb77d7-0010-4b5f-8061-43bd54b751a8 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:32.605128 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-38fb77d7-0010-4b5f-8061-43bd54b751a8 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] HTTP exception thrown: Instance f592a6fe-8cc7-4bb1-bb04-f8ddd358eeca could not be found. Oct 22 20:49:32.606838 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-38fb77d7-0010-4b5f-8061-43bd54b751a8 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Request method failure captured: Oct 22 20:49:32.606838 ncdv-master-1 devstack@n-api.service[138744]: request: GET /compute/v2.1/servers/f592a6fe-8cc7-4bb1-bb04-f8ddd358eeca HTTP/1.1 Oct 22 20:49:32.606838 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 20:49:32.606838 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 20:49:32.606838 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 20:49:32.606838 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 0 Oct 22 20:49:32.606838 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 20:49:32.606838 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 20:49:32.606838 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 20:49:32.606838 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 20:49:32.606838 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVFcYYORhwFB1ry8Evy8Voe9D4YGgNQU5_4r5xU__9WXZwFhi1ysgPAlzqoWtpXWb5AmV6DcS0MfiQoPElUcKT8-mpbeXfIqn597wkNknXaYh6U3AKbg58fbAPYPOorYCbxVAYf4DMC0ny28dLv3iMq4Wg-HScb3aYg1qBD2hJHVN7WI Oct 22 20:49:32.606838 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 20:49:32.606838 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 20:49:32.606838 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 20:49:32.606838 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 20:49:32.606838 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 20:49:32.606838 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 20:49:32.606838 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: 2675a324f0134844a1964f64322493ba Oct 22 20:49:32.606838 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-DeleteServersAdminTestJSON-331859835 Oct 22 20:49:32.606838 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 20:49:32.606838 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 20:49:32.608679 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_2675a324f0134844a1964f64322493ba"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2675a324f0134844a1964f64322493ba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/2675a324f0134844a1964f64322493ba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2675a324f0134844a1964f64322493ba"}]}] Oct 22 20:49:32.608679 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-DeleteServersAdminTestJSON-331859835 Oct 22 20:49:32.608679 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: 2675a324f0134844a1964f64322493ba Oct 22 20:49:32.608679 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-331859835 Oct 22 20:49:32.608679 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-DeleteServersAdminTestJSON-331859835-project Oct 22 20:49:32.608679 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 20:49:32.608679 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 20:49:32.608679 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: 16e13dcabaaa4b218945aeeabb4c902e Oct 22 20:49:32.608679 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-DeleteServersAdminTestJSON-331859835-project Oct 22 20:49:32.608679 ncdv-master-1 devstack@n-api.service[138744]: method: > Oct 22 20:49:32.608679 ncdv-master-1 devstack@n-api.service[138744]: exception: Instance f592a6fe-8cc7-4bb1-bb04-f8ddd358eeca could not be found. Oct 22 20:49:32.608679 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': 'f592a6fe-8cc7-4bb1-bb04-f8ddd358eeca'} Oct 22 20:49:32.609505 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:49:32.609505 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:49:32.609505 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 20:49:32.609505 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 20:49:32.609505 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 20:49:32.609505 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 20:49:32.609505 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 20:49:32.609505 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 20:49:32.609505 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 20:49:32.609505 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 20:49:32.609505 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f592a6fe-8cc7-4bb1-bb04-f8ddd358eeca could not be found. Oct 22 20:49:32.609505 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:49:32.609505 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:49:32.609505 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:49:32.609505 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:49:32.609505 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:49:32.609505 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:49:32.609505 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:49:32.609505 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:49:32.609505 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:49:32.611016 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:49:32.611016 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 20:49:32.611016 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 20:49:32.611016 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 20:49:32.611016 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 20:49:32.611016 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 20:49:32.611016 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 20:49:32.611016 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f592a6fe-8cc7-4bb1-bb04-f8ddd358eeca could not be found. Oct 22 20:49:32.611016 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:49:32.611016 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:49:32.611016 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:49:32.611016 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:49:32.611016 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:49:32.611016 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:49:32.611016 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 20:49:32.611016 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 20:49:32.611016 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f592a6fe-8cc7-4bb1-bb04-f8ddd358eeca could not be found. Oct 22 20:49:32.611016 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:49:32.612373 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-38fb77d7-0010-4b5f-8061-43bd54b751a8 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] Returning 404 to user: Instance f592a6fe-8cc7-4bb1-bb04-f8ddd358eeca could not be found. {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:49:32.613013 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-38fb77d7-0010-4b5f-8061-43bd54b751a8 tempest-DeleteServersAdminTestJSON-331859835 tempest-DeleteServersAdminTestJSON-331859835-project] 10.222.0.18 "GET /compute/v2.1/servers/f592a6fe-8cc7-4bb1-bb04-f8ddd358eeca" status: 404 len: 111 microversion: 2.1 time: 0.103762 Oct 22 20:49:32.618759 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 175/403] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:49:32 2022] GET /compute/v2.1/servers/f592a6fe-8cc7-4bb1-bb04-f8ddd358eeca => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 20:49:32.629956 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-80b0a833-6bc8-4765-9e6a-b06f90778fb2 tempest-FlavorsAccessNegativeTestJSON-1155582995 tempest-FlavorsAccessNegativeTestJSON-1155582995-project-admin] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:49:32.698009 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-80b0a833-6bc8-4765-9e6a-b06f90778fb2 tempest-FlavorsAccessNegativeTestJSON-1155582995 tempest-FlavorsAccessNegativeTestJSON-1155582995-project-admin] 10.222.0.18 "DELETE /compute/v2.1/flavors/635078478" status: 202 len: 0 microversion: 2.1 time: 0.077311 Oct 22 20:49:32.703388 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 176/404] 10.222.0.18 () {58 vars in 1158 bytes} [Sat Oct 22 20:49:32 2022] DELETE /compute/v2.1/flavors/635078478 => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 20:49:32.708461 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-acf82534-9dc1-4311-ae10-4873fac1a4af tempest-FlavorsAccessNegativeTestJSON-1155582995 tempest-FlavorsAccessNegativeTestJSON-1155582995-project-admin] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:49:32.783467 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-acf82534-9dc1-4311-ae10-4873fac1a4af tempest-FlavorsAccessNegativeTestJSON-1155582995 tempest-FlavorsAccessNegativeTestJSON-1155582995-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.079040 Oct 22 20:49:32.795367 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 177/405] 10.222.0.18 () {58 vars in 1146 bytes} [Sat Oct 22 20:49:32 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 20:49:32.811543 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-0c27ce8d-68e9-434c-a9e3-e2ae97127cb1 tempest-FlavorsAccessNegativeTestJSON-1155582995 tempest-FlavorsAccessNegativeTestJSON-1155582995-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-306423305", "id": 1077377160, "os-flavor-access:is_public": "False"}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:49:32.870277 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-0c27ce8d-68e9-434c-a9e3-e2ae97127cb1 tempest-FlavorsAccessNegativeTestJSON-1155582995 tempest-FlavorsAccessNegativeTestJSON-1155582995-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.062947 Oct 22 20:49:32.879702 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 178/406] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Oct 22 20:49:32 2022] POST /compute/v2.1/flavors => generated 438 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:49:32.946758 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.objects.instance [None req-127be5d0-263f-4675-9d8a-57ff0dee3db0 tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] Lazy-loading 'services' on Instance uuid 1d613848-05f4-478f-a569-b4c50576edb7 {{(pid=138745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 20:49:32.980455 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-127be5d0-263f-4675-9d8a-57ff0dee3db0 tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/1d613848-05f4-478f-a569-b4c50576edb7" status: 200 len: 2052 microversion: 2.25 time: 1.102436 Oct 22 20:49:32.983239 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 229/407] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 20:49:31 2022] GET /compute/v2.1/servers/1d613848-05f4-478f-a569-b4c50576edb7 => generated 2052 bytes in 1106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 20:49:33.013020 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-7f986036-b3bb-458d-a9c3-30d18868e8c3 tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:49:33.013959 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-7f986036-b3bb-458d-a9c3-30d18868e8c3 tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] [instance: 1d613848-05f4-478f-a569-b4c50576edb7] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:49:33.024100 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7f986036-b3bb-458d-a9c3-30d18868e8c3 tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:33.026215 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7f986036-b3bb-458d-a9c3-30d18868e8c3 tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:33.026666 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7f986036-b3bb-458d-a9c3-30d18868e8c3 tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:33.028611 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7f986036-b3bb-458d-a9c3-30d18868e8c3 tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:33.029077 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7f986036-b3bb-458d-a9c3-30d18868e8c3 tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:33.029511 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7f986036-b3bb-458d-a9c3-30d18868e8c3 tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:33.380386 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.objects.instance [None req-7f986036-b3bb-458d-a9c3-30d18868e8c3 tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] Lazy-loading 'services' on Instance uuid 1d613848-05f4-478f-a569-b4c50576edb7 {{(pid=138745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 20:49:33.408894 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-7f986036-b3bb-458d-a9c3-30d18868e8c3 tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/1d613848-05f4-478f-a569-b4c50576edb7" status: 200 len: 2052 microversion: 2.25 time: 0.401150 Oct 22 20:49:33.412340 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 230/408] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 20:49:33 2022] GET /compute/v2.1/servers/1d613848-05f4-478f-a569-b4c50576edb7 => generated 2052 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 22 20:49:33.417544 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-e47cc3bf-fd48-41b4-af0c-bf25828acb46 tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:49:33.418402 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-e47cc3bf-fd48-41b4-af0c-bf25828acb46 tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] [instance: 5c3de24c-090d-4769-8975-207eb939b979] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:49:33.435534 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e47cc3bf-fd48-41b4-af0c-bf25828acb46 tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:33.439296 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e47cc3bf-fd48-41b4-af0c-bf25828acb46 tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:33.440737 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e47cc3bf-fd48-41b4-af0c-bf25828acb46 tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:33.444586 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e47cc3bf-fd48-41b4-af0c-bf25828acb46 tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:33.445086 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e47cc3bf-fd48-41b4-af0c-bf25828acb46 tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:33.445534 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e47cc3bf-fd48-41b4-af0c-bf25828acb46 tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:33.710103 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-8e396ac8-6ba5-4a71-92a9-c07eaf49e94b tempest-FlavorsAccessNegativeTestJSON-311579878 tempest-FlavorsAccessNegativeTestJSON-311579878-project] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "ecb4d08b21184b53b41cce2833f65990"}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:49:33.715060 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.objects.instance [None req-e47cc3bf-fd48-41b4-af0c-bf25828acb46 tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] Lazy-loading 'services' on Instance uuid 5c3de24c-090d-4769-8975-207eb939b979 {{(pid=138745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 20:49:33.716543 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-8e396ac8-6ba5-4a71-92a9-c07eaf49e94b tempest-FlavorsAccessNegativeTestJSON-311579878 tempest-FlavorsAccessNegativeTestJSON-311579878-project] Policy check for os_compute_api:os-flavor-access:add_tenant_access failed with credentials {'is_admin': False, 'user_id': 'e752e011dbf243c88455f637dfae19e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb4d08b21184b53b41cce2833f65990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:49:33.725891 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-8e396ac8-6ba5-4a71-92a9-c07eaf49e94b tempest-FlavorsAccessNegativeTestJSON-311579878 tempest-FlavorsAccessNegativeTestJSON-311579878-project] Request method failure captured: Oct 22 20:49:33.725891 ncdv-master-1 devstack@n-api.service[138744]: request: POST /compute/v2.1/flavors/1077377160/action HTTP/1.1 Oct 22 20:49:33.725891 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 20:49:33.725891 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 20:49:33.725891 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 20:49:33.725891 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 67 Oct 22 20:49:33.725891 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 20:49:33.725891 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 20:49:33.725891 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 20:49:33.725891 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 20:49:33.725891 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVFdUkATY-ePO77YLbAYtjx32il0RGwdLUkd-4qloS_F_O-m5gsEVWt3GcDSTcYQC4quLuA5MT7a96MNg4vgspBBEJDl8zdNZCUJqyQhvqBKsc-kUtcQVD4_7VHzCKdZbqpe4_rjF0OJvZpNv_GGfXHnBJLA8ZgzOHTDPY3Fi2hlDUQg Oct 22 20:49:33.725891 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 20:49:33.725891 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 20:49:33.725891 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 20:49:33.725891 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 20:49:33.725891 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 20:49:33.725891 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 20:49:33.725891 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: ecb4d08b21184b53b41cce2833f65990 Oct 22 20:49:33.725891 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-311579878 Oct 22 20:49:33.725891 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 20:49:33.725891 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 20:49:33.727684 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ecb4d08b21184b53b41cce2833f65990"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ecb4d08b21184b53b41cce2833f65990"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ecb4d08b21184b53b41cce2833f65990"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ecb4d08b21184b53b41cce2833f65990"}]}] Oct 22 20:49:33.727684 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-311579878 Oct 22 20:49:33.727684 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: ecb4d08b21184b53b41cce2833f65990 Oct 22 20:49:33.727684 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-311579878 Oct 22 20:49:33.727684 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-FlavorsAccessNegativeTestJSON-311579878-project Oct 22 20:49:33.727684 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 20:49:33.727684 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 20:49:33.727684 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: e752e011dbf243c88455f637dfae19e9 Oct 22 20:49:33.727684 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-311579878-project Oct 22 20:49:33.727684 ncdv-master-1 devstack@n-api.service[138744]: Oct 22 20:49:33.727684 ncdv-master-1 devstack@n-api.service[138744]: {"addTenantAccess": {"tenant": "ecb4d08b21184b53b41cce2833f65990"}} Oct 22 20:49:33.727684 ncdv-master-1 devstack@n-api.service[138744]: method: > Oct 22 20:49:33.728456 ncdv-master-1 devstack@n-api.service[138744]: exception: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Oct 22 20:49:33.728456 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': '1077377160', 'body': {'addTenantAccess': {'tenant': 'ecb4d08b21184b53b41cce2833f65990'}}} Oct 22 20:49:33.728456 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:49:33.728456 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:49:33.728456 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:49:33.728456 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:49:33.728456 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:49:33.728456 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:49:33.728456 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:49:33.728456 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:49:33.728456 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 20:49:33.728456 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 20:49:33.728456 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 66, in _add_tenant_access Oct 22 20:49:33.728456 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi context.can(fa_policies.POLICY_ROOT % "add_tenant_access", target={}) Oct 22 20:49:33.728456 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 22 20:49:33.728456 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 22 20:49:33.728456 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 22 20:49:33.728456 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 22 20:49:33.728456 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 22 20:49:33.729581 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 22 20:49:33.729581 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 22 20:49:33.729581 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise self.value Oct 22 20:49:33.729581 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 22 20:49:33.729581 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 22 20:49:33.729581 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 22 20:49:33.729581 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 22 20:49:33.729581 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 22 20:49:33.729581 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 22 20:49:33.729581 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Oct 22 20:49:33.729581 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:49:33.729581 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:49:33.729581 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:49:33.729581 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:49:33.729581 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:49:33.729581 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:49:33.729581 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 22 20:49:33.729581 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 22 20:49:33.729581 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Oct 22 20:49:33.729581 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:49:33.732590 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-8e396ac8-6ba5-4a71-92a9-c07eaf49e94b tempest-FlavorsAccessNegativeTestJSON-311579878 tempest-FlavorsAccessNegativeTestJSON-311579878-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:49:33.734511 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-8e396ac8-6ba5-4a71-92a9-c07eaf49e94b tempest-FlavorsAccessNegativeTestJSON-311579878 tempest-FlavorsAccessNegativeTestJSON-311579878-project] 10.222.0.18 "POST /compute/v2.1/flavors/1077377160/action" status: 403 len: 130 microversion: 2.1 time: 0.847515 Oct 22 20:49:33.747440 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 179/409] 10.222.0.18 () {60 vars in 1200 bytes} [Sat Oct 22 20:49:32 2022] POST /compute/v2.1/flavors/1077377160/action => generated 130 bytes in 861 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 22 20:49:33.760757 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-10442d23-f8b2-4dbe-a1c6-6431fb055c27 tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:49:33.784625 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-10442d23-f8b2-4dbe-a1c6-6431fb055c27 tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:33.788053 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-10442d23-f8b2-4dbe-a1c6-6431fb055c27 tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:33.792138 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-10442d23-f8b2-4dbe-a1c6-6431fb055c27 tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:33.792336 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-e47cc3bf-fd48-41b4-af0c-bf25828acb46 tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/5c3de24c-090d-4769-8975-207eb939b979" status: 200 len: 1927 microversion: 2.75 time: 0.376165 Oct 22 20:49:33.798024 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-10442d23-f8b2-4dbe-a1c6-6431fb055c27 tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:33.798719 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-10442d23-f8b2-4dbe-a1c6-6431fb055c27 tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:33.800537 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-10442d23-f8b2-4dbe-a1c6-6431fb055c27 tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:33.819630 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 231/410] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 20:49:33 2022] GET /compute/v2.1/servers/5c3de24c-090d-4769-8975-207eb939b979 => generated 1927 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 20:49:33.833703 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-cab29a68-4ab8-45d5-99dc-cb260148fd25 tempest-FlavorsAccessNegativeTestJSON-1155582995 tempest-FlavorsAccessNegativeTestJSON-1155582995-project-admin] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:49:33.908917 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-cab29a68-4ab8-45d5-99dc-cb260148fd25 tempest-FlavorsAccessNegativeTestJSON-1155582995 tempest-FlavorsAccessNegativeTestJSON-1155582995-project-admin] 10.222.0.18 "DELETE /compute/v2.1/flavors/1077377160" status: 202 len: 0 microversion: 2.1 time: 0.086991 Oct 22 20:49:33.911832 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 232/411] 10.222.0.18 () {58 vars in 1161 bytes} [Sat Oct 22 20:49:33 2022] DELETE /compute/v2.1/flavors/1077377160 => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 20:49:33.927762 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-10442d23-f8b2-4dbe-a1c6-6431fb055c27 tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] 10.222.0.18 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.172098 Oct 22 20:49:33.928689 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 180/412] 10.222.0.18 () {60 vars in 1217 bytes} [Sat Oct 22 20:49:33 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 22 20:49:33.935243 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-e894e8db-9fcf-4f11-b8fe-d8406c6fb24d tempest-FlavorsAccessNegativeTestJSON-1155582995 tempest-FlavorsAccessNegativeTestJSON-1155582995-project-admin] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:49:33.952654 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-bc493204-b98f-49cb-9aaf-5c9fb7b255a6 tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch1-master-1", "block_migration": "auto"}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:49:33.962785 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-bc493204-b98f-49cb-9aaf-5c9fb7b255a6 tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] [instance: 1d613848-05f4-478f-a569-b4c50576edb7] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:49:33.987777 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-e894e8db-9fcf-4f11-b8fe-d8406c6fb24d tempest-FlavorsAccessNegativeTestJSON-1155582995 tempest-FlavorsAccessNegativeTestJSON-1155582995-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.058187 Oct 22 20:49:33.989141 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 233/413] 10.222.0.18 () {58 vars in 1146 bytes} [Sat Oct 22 20:49:33 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:49:33.998528 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bc493204-b98f-49cb-9aaf-5c9fb7b255a6 tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:34.012347 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bc493204-b98f-49cb-9aaf-5c9fb7b255a6 tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:34.012864 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bc493204-b98f-49cb-9aaf-5c9fb7b255a6 tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:34.019010 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bc493204-b98f-49cb-9aaf-5c9fb7b255a6 tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:34.020105 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bc493204-b98f-49cb-9aaf-5c9fb7b255a6 tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:34.020552 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bc493204-b98f-49cb-9aaf-5c9fb7b255a6 tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:34.021374 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-8bdc6d69-3c1d-488a-bee6-dec3351e2f5e tempest-FlavorsAccessNegativeTestJSON-1155582995 tempest-FlavorsAccessNegativeTestJSON-1155582995-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1869052519", "id": 1083897590, "os-flavor-access:is_public": "False"}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:49:34.056430 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-8bdc6d69-3c1d-488a-bee6-dec3351e2f5e tempest-FlavorsAccessNegativeTestJSON-1155582995 tempest-FlavorsAccessNegativeTestJSON-1155582995-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.040390 Oct 22 20:49:34.063203 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 234/414] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Oct 22 20:49:34 2022] POST /compute/v2.1/flavors => generated 439 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:49:34.072834 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-d9a829b7-11fa-4606-8ed5-ce4571ecc633 tempest-FlavorsAccessNegativeTestJSON-1155582995 tempest-FlavorsAccessNegativeTestJSON-1155582995-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "ecb4d08b21184b53b41cce2833f65990"}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:49:34.467776 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.objects.instance [None req-bc493204-b98f-49cb-9aaf-5c9fb7b255a6 tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] Lazy-loading 'flavor' on Instance uuid 1d613848-05f4-478f-a569-b4c50576edb7 {{(pid=138744) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 20:49:34.605356 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-bc493204-b98f-49cb-9aaf-5c9fb7b255a6 tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] [instance: 1d613848-05f4-478f-a569-b4c50576edb7] Going to try to live migrate instance to nch1-master-1 {{(pid=138744) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 22 20:49:34.964003 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-d9a829b7-11fa-4606-8ed5-ce4571ecc633 tempest-FlavorsAccessNegativeTestJSON-1155582995 tempest-FlavorsAccessNegativeTestJSON-1155582995-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors/1083897590/action" status: 200 len: 97 microversion: 2.1 time: 0.897046 Oct 22 20:49:34.967719 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 235/415] 10.222.0.18 () {60 vars in 1200 bytes} [Sat Oct 22 20:49:34 2022] POST /compute/v2.1/flavors/1083897590/action => generated 97 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 22 20:49:34.980897 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-ed0f1d3d-1e35-49e1-9a81-bd5baafac1a7 tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:49:34.981426 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-ed0f1d3d-1e35-49e1-9a81-bd5baafac1a7 tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] [instance: 5c3de24c-090d-4769-8975-207eb939b979] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:49:34.996223 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ed0f1d3d-1e35-49e1-9a81-bd5baafac1a7 tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:34.996724 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ed0f1d3d-1e35-49e1-9a81-bd5baafac1a7 tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:34.997154 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ed0f1d3d-1e35-49e1-9a81-bd5baafac1a7 tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:34.997857 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ed0f1d3d-1e35-49e1-9a81-bd5baafac1a7 tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:34.998304 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ed0f1d3d-1e35-49e1-9a81-bd5baafac1a7 tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:34.998720 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ed0f1d3d-1e35-49e1-9a81-bd5baafac1a7 tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:35.688609 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.objects.instance [None req-ed0f1d3d-1e35-49e1-9a81-bd5baafac1a7 tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] Lazy-loading 'services' on Instance uuid 5c3de24c-090d-4769-8975-207eb939b979 {{(pid=138745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 20:49:35.797590 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-ed0f1d3d-1e35-49e1-9a81-bd5baafac1a7 tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/5c3de24c-090d-4769-8975-207eb939b979" status: 200 len: 1927 microversion: 2.75 time: 0.827012 Oct 22 20:49:35.810033 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 236/416] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 20:49:34 2022] GET /compute/v2.1/servers/5c3de24c-090d-4769-8975-207eb939b979 => generated 1927 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 20:49:35.841774 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-51d8b941-b76d-4304-8796-6302f3b3837c tempest-FlavorsAccessNegativeTestJSON-311579878 tempest-FlavorsAccessNegativeTestJSON-311579878-project] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "ecb4d08b21184b53b41cce2833f65990"}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:49:35.858028 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-51d8b941-b76d-4304-8796-6302f3b3837c tempest-FlavorsAccessNegativeTestJSON-311579878 tempest-FlavorsAccessNegativeTestJSON-311579878-project] Policy check for os_compute_api:os-flavor-access:remove_tenant_access failed with credentials {'is_admin': False, 'user_id': 'e752e011dbf243c88455f637dfae19e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb4d08b21184b53b41cce2833f65990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:49:35.874602 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-51d8b941-b76d-4304-8796-6302f3b3837c tempest-FlavorsAccessNegativeTestJSON-311579878 tempest-FlavorsAccessNegativeTestJSON-311579878-project] Request method failure captured: Oct 22 20:49:35.874602 ncdv-master-1 devstack@n-api.service[138745]: request: POST /compute/v2.1/flavors/1083897590/action HTTP/1.1 Oct 22 20:49:35.874602 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 20:49:35.874602 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 20:49:35.874602 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 20:49:35.874602 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 70 Oct 22 20:49:35.874602 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 20:49:35.874602 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 20:49:35.874602 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 20:49:35.874602 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 20:49:35.874602 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVFdUkATY-ePO77YLbAYtjx32il0RGwdLUkd-4qloS_F_O-m5gsEVWt3GcDSTcYQC4quLuA5MT7a96MNg4vgspBBEJDl8zdNZCUJqyQhvqBKsc-kUtcQVD4_7VHzCKdZbqpe4_rjF0OJvZpNv_GGfXHnBJLA8ZgzOHTDPY3Fi2hlDUQg Oct 22 20:49:35.874602 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 20:49:35.874602 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 20:49:35.874602 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 20:49:35.874602 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 20:49:35.874602 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 20:49:35.874602 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 20:49:35.874602 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: ecb4d08b21184b53b41cce2833f65990 Oct 22 20:49:35.874602 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-311579878 Oct 22 20:49:35.874602 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 20:49:35.874602 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 20:49:35.875834 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ecb4d08b21184b53b41cce2833f65990"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ecb4d08b21184b53b41cce2833f65990"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ecb4d08b21184b53b41cce2833f65990"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ecb4d08b21184b53b41cce2833f65990"}]}] Oct 22 20:49:35.875834 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-311579878 Oct 22 20:49:35.875834 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: ecb4d08b21184b53b41cce2833f65990 Oct 22 20:49:35.875834 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-311579878 Oct 22 20:49:35.875834 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-FlavorsAccessNegativeTestJSON-311579878-project Oct 22 20:49:35.875834 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 20:49:35.875834 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 20:49:35.875834 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: e752e011dbf243c88455f637dfae19e9 Oct 22 20:49:35.875834 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-311579878-project Oct 22 20:49:35.875834 ncdv-master-1 devstack@n-api.service[138745]: Oct 22 20:49:35.875834 ncdv-master-1 devstack@n-api.service[138745]: {"removeTenantAccess": {"tenant": "ecb4d08b21184b53b41cce2833f65990"}} Oct 22 20:49:35.875834 ncdv-master-1 devstack@n-api.service[138745]: method: > Oct 22 20:49:35.876505 ncdv-master-1 devstack@n-api.service[138745]: exception: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Oct 22 20:49:35.876505 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'id': '1083897590', 'body': {'removeTenantAccess': {'tenant': 'ecb4d08b21184b53b41cce2833f65990'}}} Oct 22 20:49:35.876505 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:49:35.876505 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:49:35.876505 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:49:35.876505 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:49:35.876505 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:49:35.876505 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:49:35.876505 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:49:35.876505 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:49:35.876505 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 20:49:35.876505 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 20:49:35.876505 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 91, in _remove_tenant_access Oct 22 20:49:35.876505 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi context.can( Oct 22 20:49:35.876505 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 22 20:49:35.876505 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 22 20:49:35.876505 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 22 20:49:35.876505 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 22 20:49:35.876505 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 22 20:49:35.876505 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 22 20:49:35.877616 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 22 20:49:35.877616 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise self.value Oct 22 20:49:35.877616 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 22 20:49:35.877616 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 22 20:49:35.877616 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 22 20:49:35.877616 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 22 20:49:35.877616 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 22 20:49:35.877616 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 22 20:49:35.877616 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Oct 22 20:49:35.877616 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:49:35.877616 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:49:35.877616 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:49:35.877616 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:49:35.877616 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:49:35.877616 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:49:35.877616 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 22 20:49:35.877616 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 22 20:49:35.877616 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Oct 22 20:49:35.877616 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:49:35.878651 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-51d8b941-b76d-4304-8796-6302f3b3837c tempest-FlavorsAccessNegativeTestJSON-311579878 tempest-FlavorsAccessNegativeTestJSON-311579878-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:49:35.881543 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-51d8b941-b76d-4304-8796-6302f3b3837c tempest-FlavorsAccessNegativeTestJSON-311579878 tempest-FlavorsAccessNegativeTestJSON-311579878-project] 10.222.0.18 "POST /compute/v2.1/flavors/1083897590/action" status: 403 len: 133 microversion: 2.1 time: 0.068879 Oct 22 20:49:35.885444 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 237/417] 10.222.0.18 () {60 vars in 1200 bytes} [Sat Oct 22 20:49:35 2022] POST /compute/v2.1/flavors/1083897590/action => generated 133 bytes in 75 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 22 20:49:35.901901 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-b2287280-369a-4937-9f9b-37cac1efcb71 tempest-FlavorsAccessNegativeTestJSON-1155582995 tempest-FlavorsAccessNegativeTestJSON-1155582995-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "ecb4d08b21184b53b41cce2833f65990"}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:49:37.654312 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-b2287280-369a-4937-9f9b-37cac1efcb71 tempest-FlavorsAccessNegativeTestJSON-1155582995 tempest-FlavorsAccessNegativeTestJSON-1155582995-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors/1083897590/action" status: 200 len: 21 microversion: 2.1 time: 1.764583 Oct 22 20:49:37.664456 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 238/418] 10.222.0.18 () {60 vars in 1200 bytes} [Sat Oct 22 20:49:35 2022] POST /compute/v2.1/flavors/1083897590/action => generated 21 bytes in 1776 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 22 20:49:37.675813 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-e84b7ec9-07e2-463c-935d-d810565e580a tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:49:37.678723 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-e84b7ec9-07e2-463c-935d-d810565e580a tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] [instance: 5c3de24c-090d-4769-8975-207eb939b979] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:49:37.697924 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e84b7ec9-07e2-463c-935d-d810565e580a tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:37.698804 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e84b7ec9-07e2-463c-935d-d810565e580a tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:37.700042 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e84b7ec9-07e2-463c-935d-d810565e580a tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:37.701019 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e84b7ec9-07e2-463c-935d-d810565e580a tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:37.702140 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e84b7ec9-07e2-463c-935d-d810565e580a tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:37.703818 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e84b7ec9-07e2-463c-935d-d810565e580a tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:37.855309 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.objects.instance [None req-e84b7ec9-07e2-463c-935d-d810565e580a tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] Lazy-loading 'services' on Instance uuid 5c3de24c-090d-4769-8975-207eb939b979 {{(pid=138745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 20:49:37.957693 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-e84b7ec9-07e2-463c-935d-d810565e580a tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/5c3de24c-090d-4769-8975-207eb939b979" status: 200 len: 1927 microversion: 2.75 time: 0.291810 Oct 22 20:49:37.963072 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 239/419] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 20:49:37 2022] GET /compute/v2.1/servers/5c3de24c-090d-4769-8975-207eb939b979 => generated 1927 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 20:49:37.975943 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-1ab76026-ffae-4e21-ac77-e96ade9f6bd0 tempest-FlavorsAccessNegativeTestJSON-1155582995 tempest-FlavorsAccessNegativeTestJSON-1155582995-project-admin] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:49:38.018654 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-1ab76026-ffae-4e21-ac77-e96ade9f6bd0 tempest-FlavorsAccessNegativeTestJSON-1155582995 tempest-FlavorsAccessNegativeTestJSON-1155582995-project-admin] 10.222.0.18 "DELETE /compute/v2.1/flavors/1083897590" status: 202 len: 0 microversion: 2.1 time: 0.050773 Oct 22 20:49:38.020383 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 240/420] 10.222.0.18 () {58 vars in 1161 bytes} [Sat Oct 22 20:49:37 2022] DELETE /compute/v2.1/flavors/1083897590 => generated 0 bytes in 56 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 20:49:38.032114 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-e6932d04-338d-43b1-8b43-f8a879258d1b tempest-FlavorsAccessNegativeTestJSON-1155582995 tempest-FlavorsAccessNegativeTestJSON-1155582995-project-admin] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:49:38.111210 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-e6932d04-338d-43b1-8b43-f8a879258d1b tempest-FlavorsAccessNegativeTestJSON-1155582995 tempest-FlavorsAccessNegativeTestJSON-1155582995-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.081967 Oct 22 20:49:38.113388 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 241/421] 10.222.0.18 () {58 vars in 1146 bytes} [Sat Oct 22 20:49:38 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:49:38.137416 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-8d2b909b-d6ca-4697-b7ef-7e491b450f99 tempest-FlavorsAccessNegativeTestJSON-1155582995 tempest-FlavorsAccessNegativeTestJSON-1155582995-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-524542698", "id": 1673351485, "os-flavor-access:is_public": "False"}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:49:38.186282 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-8d2b909b-d6ca-4697-b7ef-7e491b450f99 tempest-FlavorsAccessNegativeTestJSON-1155582995 tempest-FlavorsAccessNegativeTestJSON-1155582995-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.052886 Oct 22 20:49:38.187137 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 242/422] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Oct 22 20:49:38 2022] POST /compute/v2.1/flavors => generated 438 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 20:49:38.208280 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-19fbd930-d3da-42b6-ab2e-822d5c03ea04 tempest-FlavorsAccessNegativeTestJSON-1155582995 tempest-FlavorsAccessNegativeTestJSON-1155582995-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "cd069f6566a64b2bb6dba44e212b95d2"}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:49:38.998044 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.wsgi [None req-19fbd930-d3da-42b6-ab2e-822d5c03ea04 tempest-FlavorsAccessNegativeTestJSON-1155582995 tempest-FlavorsAccessNegativeTestJSON-1155582995-project-admin] HTTP exception thrown: Flavor access not found for 35 / cd069f6566a64b2bb6dba44e212b95d2 combination. Oct 22 20:49:39.001918 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-19fbd930-d3da-42b6-ab2e-822d5c03ea04 tempest-FlavorsAccessNegativeTestJSON-1155582995 tempest-FlavorsAccessNegativeTestJSON-1155582995-project-admin] Request method failure captured: Oct 22 20:49:39.001918 ncdv-master-1 devstack@n-api.service[138745]: request: POST /compute/v2.1/flavors/1673351485/action HTTP/1.1 Oct 22 20:49:39.001918 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 20:49:39.001918 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 20:49:39.001918 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 20:49:39.001918 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 70 Oct 22 20:49:39.001918 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 20:49:39.001918 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 20:49:39.001918 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 20:49:39.001918 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 20:49:39.001918 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVFdVH0j3Onka0cJiJKz5mwWrdT3UkYTUrkBWWBgq6gIBGYoJrcu7Sw5ZMDuIE6sWOr5rOIb8l-Ogyrk9m2M1fd5Jp-ksiPJy-d_HlSyTriMuumIOdbVIWPr1UtH5i3ky5xLJOQvzZY8IucywSOTdp8Bne43Xw81w_YBnuHDuBNkREno Oct 22 20:49:39.001918 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 20:49:39.001918 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 20:49:39.001918 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 20:49:39.001918 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 20:49:39.001918 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 20:49:39.001918 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 20:49:39.001918 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: 9c8b0f59c10a4e55af2f72c7d77c13cc Oct 22 20:49:39.001918 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1155582995 Oct 22 20:49:39.001918 ncdv-master-1 devstack@n-api.service[138745]: X-Role: admin,member,reader Oct 22 20:49:39.001918 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: admin,member,reader Oct 22 20:49:39.003153 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_9c8b0f59c10a4e55af2f72c7d77c13cc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9c8b0f59c10a4e55af2f72c7d77c13cc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/9c8b0f59c10a4e55af2f72c7d77c13cc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9c8b0f59c10a4e55af2f72c7d77c13cc"}]}] Oct 22 20:49:39.003153 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1155582995 Oct 22 20:49:39.003153 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: 9c8b0f59c10a4e55af2f72c7d77c13cc Oct 22 20:49:39.003153 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1155582995 Oct 22 20:49:39.003153 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-FlavorsAccessNegativeTestJSON-1155582995-project-admin Oct 22 20:49:39.003153 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 20:49:39.003153 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 20:49:39.003153 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: 78c31e62d8d440bc9f2047d3107fe9f6 Oct 22 20:49:39.003153 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1155582995-project-admin Oct 22 20:49:39.003153 ncdv-master-1 devstack@n-api.service[138745]: Oct 22 20:49:39.003153 ncdv-master-1 devstack@n-api.service[138745]: {"removeTenantAccess": {"tenant": "cd069f6566a64b2bb6dba44e212b95d2"}} Oct 22 20:49:39.003153 ncdv-master-1 devstack@n-api.service[138745]: method: > Oct 22 20:49:39.004147 ncdv-master-1 devstack@n-api.service[138745]: exception: Flavor access not found for 35 / cd069f6566a64b2bb6dba44e212b95d2 combination. Oct 22 20:49:39.004147 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'id': '1673351485', 'body': {'removeTenantAccess': {'tenant': 'cd069f6566a64b2bb6dba44e212b95d2'}}} Oct 22 20:49:39.004147 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:49:39.004147 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:49:39.004147 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 104, in _remove_tenant_access Oct 22 20:49:39.004147 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi flavor.remove_access(tenant) Oct 22 20:49:39.004147 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 22 20:49:39.004147 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 22 20:49:39.004147 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 423, in remove_access Oct 22 20:49:39.004147 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi self._remove_access(project_id) Oct 22 20:49:39.004147 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 416, in _remove_access Oct 22 20:49:39.004147 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi self._flavor_del_project(self._context, self.id, project_id) Oct 22 20:49:39.004147 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 401, in _flavor_del_project Oct 22 20:49:39.004147 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return _flavor_del_project(context, flavor_id, project_id) Oct 22 20:49:39.004147 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 22 20:49:39.004147 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 22 20:49:39.004147 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 86, in _flavor_del_project Oct 22 20:49:39.004147 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessNotFound(flavor_id=flavor_id, Oct 22 20:49:39.005209 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessNotFound: Flavor access not found for 35 / cd069f6566a64b2bb6dba44e212b95d2 combination. Oct 22 20:49:39.005209 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:49:39.005209 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:49:39.005209 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:49:39.005209 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:49:39.005209 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:49:39.005209 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:49:39.005209 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:49:39.005209 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:49:39.005209 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:49:39.005209 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:49:39.005209 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 20:49:39.005209 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 20:49:39.005209 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 107, in _remove_tenant_access Oct 22 20:49:39.005209 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 22 20:49:39.005209 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor access not found for 35 / cd069f6566a64b2bb6dba44e212b95d2 combination. Oct 22 20:49:39.005209 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:49:39.005209 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:49:39.005209 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:49:39.005209 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:49:39.006290 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:49:39.006290 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:49:39.006290 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 20:49:39.006290 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 20:49:39.006290 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access not found for 35 / cd069f6566a64b2bb6dba44e212b95d2 combination. Oct 22 20:49:39.006290 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:49:39.009608 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-19fbd930-d3da-42b6-ab2e-822d5c03ea04 tempest-FlavorsAccessNegativeTestJSON-1155582995 tempest-FlavorsAccessNegativeTestJSON-1155582995-project-admin] Returning 404 to user: Flavor access not found for 35 / cd069f6566a64b2bb6dba44e212b95d2 combination. {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:49:39.010721 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-19fbd930-d3da-42b6-ab2e-822d5c03ea04 tempest-FlavorsAccessNegativeTestJSON-1155582995 tempest-FlavorsAccessNegativeTestJSON-1155582995-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors/1673351485/action" status: 404 len: 124 microversion: 2.1 time: 0.809948 Oct 22 20:49:39.015219 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 243/423] 10.222.0.18 () {60 vars in 1200 bytes} [Sat Oct 22 20:49:38 2022] POST /compute/v2.1/flavors/1673351485/action => generated 124 bytes in 815 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 22 20:49:39.040645 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-09836a0c-c1fc-40d7-847e-ec662dc509c5 tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:49:39.042222 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-09836a0c-c1fc-40d7-847e-ec662dc509c5 tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] [instance: 5c3de24c-090d-4769-8975-207eb939b979] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:49:39.064830 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-09836a0c-c1fc-40d7-847e-ec662dc509c5 tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:39.065570 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-09836a0c-c1fc-40d7-847e-ec662dc509c5 tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:39.066157 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-09836a0c-c1fc-40d7-847e-ec662dc509c5 tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:39.067063 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-09836a0c-c1fc-40d7-847e-ec662dc509c5 tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:39.067684 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-09836a0c-c1fc-40d7-847e-ec662dc509c5 tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:39.068252 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-09836a0c-c1fc-40d7-847e-ec662dc509c5 tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:39.253711 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell1:SELECT=100 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:49:39.263809 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.objects.instance [None req-09836a0c-c1fc-40d7-847e-ec662dc509c5 tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] Lazy-loading 'services' on Instance uuid 5c3de24c-090d-4769-8975-207eb939b979 {{(pid=138745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 20:49:39.347077 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-09836a0c-c1fc-40d7-847e-ec662dc509c5 tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/5c3de24c-090d-4769-8975-207eb939b979" status: 200 len: 1927 microversion: 2.75 time: 0.330133 Oct 22 20:49:39.369238 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 244/424] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 20:49:39 2022] GET /compute/v2.1/servers/5c3de24c-090d-4769-8975-207eb939b979 => generated 1927 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 20:49:39.389693 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-d1164efa-a689-488d-a132-dd510d16c0c1 tempest-FlavorsAccessNegativeTestJSON-1155582995 tempest-FlavorsAccessNegativeTestJSON-1155582995-project-admin] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:49:39.466144 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-d1164efa-a689-488d-a132-dd510d16c0c1 tempest-FlavorsAccessNegativeTestJSON-1155582995 tempest-FlavorsAccessNegativeTestJSON-1155582995-project-admin] 10.222.0.18 "DELETE /compute/v2.1/flavors/1673351485" status: 202 len: 0 microversion: 2.1 time: 0.093989 Oct 22 20:49:39.468901 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 245/425] 10.222.0.18 () {58 vars in 1161 bytes} [Sat Oct 22 20:49:39 2022] DELETE /compute/v2.1/flavors/1673351485 => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 20:49:39.485547 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-4a74c9d1-4178-412c-8093-686847a3493d tempest-FlavorsAccessNegativeTestJSON-1155582995 tempest-FlavorsAccessNegativeTestJSON-1155582995-project-admin] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:49:39.563452 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-4a74c9d1-4178-412c-8093-686847a3493d tempest-FlavorsAccessNegativeTestJSON-1155582995 tempest-FlavorsAccessNegativeTestJSON-1155582995-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.090126 Oct 22 20:49:39.567213 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 246/426] 10.222.0.18 () {58 vars in 1146 bytes} [Sat Oct 22 20:49:39 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:49:40.350190 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-bc493204-b98f-49cb-9aaf-5c9fb7b255a6 tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] 10.222.0.18 "POST /compute/v2.1/servers/1d613848-05f4-478f-a569-b4c50576edb7/action" status: 202 len: 0 microversion: 2.25 time: 6.409819 Oct 22 20:49:40.352927 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 181/427] 10.222.0.18 () {62 vars in 1319 bytes} [Sat Oct 22 20:49:33 2022] POST /compute/v2.1/servers/1d613848-05f4-478f-a569-b4c50576edb7/action => generated 0 bytes in 6413 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 22 20:49:40.362135 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-f207f668-01a8-467d-b7c2-bb25cbe14bd8 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:49:40.363455 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-f207f668-01a8-467d-b7c2-bb25cbe14bd8 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] [instance: 1d613848-05f4-478f-a569-b4c50576edb7] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:49:40.380296 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f207f668-01a8-467d-b7c2-bb25cbe14bd8 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:40.383827 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f207f668-01a8-467d-b7c2-bb25cbe14bd8 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:40.384728 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f207f668-01a8-467d-b7c2-bb25cbe14bd8 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:40.386800 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f207f668-01a8-467d-b7c2-bb25cbe14bd8 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:40.390048 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f207f668-01a8-467d-b7c2-bb25cbe14bd8 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:40.390892 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f207f668-01a8-467d-b7c2-bb25cbe14bd8 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:40.446662 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-970d08f8-1fc7-4445-a4f2-3871fbbb49f0 tempest-AbsoluteLimitsNegativeTestJSON-498728385 tempest-AbsoluteLimitsNegativeTestJSON-498728385-project] Calling method '.version_select at 0x7fd3a4786550>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:49:40.510393 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-970d08f8-1fc7-4445-a4f2-3871fbbb49f0 tempest-AbsoluteLimitsNegativeTestJSON-498728385 tempest-AbsoluteLimitsNegativeTestJSON-498728385-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:40.516946 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-970d08f8-1fc7-4445-a4f2-3871fbbb49f0 tempest-AbsoluteLimitsNegativeTestJSON-498728385 tempest-AbsoluteLimitsNegativeTestJSON-498728385-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:40.518080 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-970d08f8-1fc7-4445-a4f2-3871fbbb49f0 tempest-AbsoluteLimitsNegativeTestJSON-498728385 tempest-AbsoluteLimitsNegativeTestJSON-498728385-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:40.519106 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-970d08f8-1fc7-4445-a4f2-3871fbbb49f0 tempest-AbsoluteLimitsNegativeTestJSON-498728385 tempest-AbsoluteLimitsNegativeTestJSON-498728385-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:40.520122 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-970d08f8-1fc7-4445-a4f2-3871fbbb49f0 tempest-AbsoluteLimitsNegativeTestJSON-498728385 tempest-AbsoluteLimitsNegativeTestJSON-498728385-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:40.520869 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-970d08f8-1fc7-4445-a4f2-3871fbbb49f0 tempest-AbsoluteLimitsNegativeTestJSON-498728385 tempest-AbsoluteLimitsNegativeTestJSON-498728385-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:40.619092 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-970d08f8-1fc7-4445-a4f2-3871fbbb49f0 tempest-AbsoluteLimitsNegativeTestJSON-498728385 tempest-AbsoluteLimitsNegativeTestJSON-498728385-project] 10.222.0.18 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.937148 Oct 22 20:49:40.621684 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 247/428] 10.222.0.18 () {58 vars in 1122 bytes} [Sat Oct 22 20:49:39 2022] GET /compute/v2.1/limits => generated 511 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:49:40.678602 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-cf0f47ce-7ca5-4779-97b0-8d22ce84d32d tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:49:40.683152 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-cf0f47ce-7ca5-4779-97b0-8d22ce84d32d tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] [instance: 5c3de24c-090d-4769-8975-207eb939b979] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:49:40.709896 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cf0f47ce-7ca5-4779-97b0-8d22ce84d32d tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:40.710639 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cf0f47ce-7ca5-4779-97b0-8d22ce84d32d tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:40.711237 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cf0f47ce-7ca5-4779-97b0-8d22ce84d32d tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:40.712804 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cf0f47ce-7ca5-4779-97b0-8d22ce84d32d tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:40.714226 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cf0f47ce-7ca5-4779-97b0-8d22ce84d32d tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:40.716293 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cf0f47ce-7ca5-4779-97b0-8d22ce84d32d tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:40.731981 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-f207f668-01a8-467d-b7c2-bb25cbe14bd8 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:49:40.748297 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-f207f668-01a8-467d-b7c2-bb25cbe14bd8 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:49:40.750144 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-f207f668-01a8-467d-b7c2-bb25cbe14bd8 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:49:40.757270 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-f207f668-01a8-467d-b7c2-bb25cbe14bd8 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] 10.222.0.18 "GET /compute/v2.1/servers/1d613848-05f4-478f-a569-b4c50576edb7" status: 200 len: 1569 microversion: 2.25 time: 0.400378 Oct 22 20:49:40.765975 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 182/429] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 20:49:40 2022] GET /compute/v2.1/servers/1d613848-05f4-478f-a569-b4c50576edb7 => generated 1569 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 22 20:49:40.882023 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.objects.instance [None req-cf0f47ce-7ca5-4779-97b0-8d22ce84d32d tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] Lazy-loading 'services' on Instance uuid 5c3de24c-090d-4769-8975-207eb939b979 {{(pid=138745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 20:49:40.936372 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-cf0f47ce-7ca5-4779-97b0-8d22ce84d32d tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/5c3de24c-090d-4769-8975-207eb939b979" status: 200 len: 1927 microversion: 2.75 time: 0.313034 Oct 22 20:49:40.938038 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 248/430] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 20:49:40 2022] GET /compute/v2.1/servers/5c3de24c-090d-4769-8975-207eb939b979 => generated 1927 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 20:49:41.196134 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-7d2a39d3-2c81-4906-b82d-27e5958013b0 tempest-AbsoluteLimitsNegativeTestJSON-498728385 tempest-AbsoluteLimitsNegativeTestJSON-498728385-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-338833151", "imageRef": "085e4478-6edc-4a69-8e08-f9831713eb65", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:49:41.322304 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.network.neutron [None req-7d2a39d3-2c81-4906-b82d-27e5958013b0 tempest-AbsoluteLimitsNegativeTestJSON-498728385 tempest-AbsoluteLimitsNegativeTestJSON-498728385-project] validate_networks() for None {{(pid=138744) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 20:49:41.794201 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-74e2ea66-c041-4fcc-9c7a-3a4ff7336349 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:49:41.794827 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-74e2ea66-c041-4fcc-9c7a-3a4ff7336349 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] [instance: 1d613848-05f4-478f-a569-b4c50576edb7] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:49:41.820849 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-74e2ea66-c041-4fcc-9c7a-3a4ff7336349 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:41.824827 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-74e2ea66-c041-4fcc-9c7a-3a4ff7336349 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:41.825443 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-74e2ea66-c041-4fcc-9c7a-3a4ff7336349 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:41.826773 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-74e2ea66-c041-4fcc-9c7a-3a4ff7336349 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:41.827391 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-74e2ea66-c041-4fcc-9c7a-3a4ff7336349 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:41.828316 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-74e2ea66-c041-4fcc-9c7a-3a4ff7336349 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:42.221507 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-74e2ea66-c041-4fcc-9c7a-3a4ff7336349 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:49:42.248317 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-74e2ea66-c041-4fcc-9c7a-3a4ff7336349 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:49:42.262044 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-74e2ea66-c041-4fcc-9c7a-3a4ff7336349 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:49:42.266376 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-74e2ea66-c041-4fcc-9c7a-3a4ff7336349 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] 10.222.0.18 "GET /compute/v2.1/servers/1d613848-05f4-478f-a569-b4c50576edb7" status: 200 len: 1569 microversion: 2.25 time: 0.476639 Oct 22 20:49:42.269636 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 249/431] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 20:49:41 2022] GET /compute/v2.1/servers/1d613848-05f4-478f-a569-b4c50576edb7 => generated 1569 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 20:49:42.282563 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-2c41af0f-6010-4eb9-a8c3-588c17bad1d6 tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:49:42.292002 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-2c41af0f-6010-4eb9-a8c3-588c17bad1d6 tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] [instance: 5c3de24c-090d-4769-8975-207eb939b979] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:49:42.315071 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2c41af0f-6010-4eb9-a8c3-588c17bad1d6 tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:42.316030 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2c41af0f-6010-4eb9-a8c3-588c17bad1d6 tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:42.320612 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2c41af0f-6010-4eb9-a8c3-588c17bad1d6 tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:42.322069 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2c41af0f-6010-4eb9-a8c3-588c17bad1d6 tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:42.326677 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2c41af0f-6010-4eb9-a8c3-588c17bad1d6 tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:42.328980 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2c41af0f-6010-4eb9-a8c3-588c17bad1d6 tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:42.489034 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-7d2a39d3-2c81-4906-b82d-27e5958013b0 tempest-AbsoluteLimitsNegativeTestJSON-498728385 tempest-AbsoluteLimitsNegativeTestJSON-498728385-project] Getting quotas for project e1d65a50708b4faab9cf473f1ef20ccf. Resources: dict_keys(['metadata_items']) {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 20:49:42.511364 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-7d2a39d3-2c81-4906-b82d-27e5958013b0 tempest-AbsoluteLimitsNegativeTestJSON-498728385 tempest-AbsoluteLimitsNegativeTestJSON-498728385-project] Getting quotas for user 958037f6fd7547efbe28fceaa8b8d52f and project e1d65a50708b4faab9cf473f1ef20ccf. Resources: dict_keys(['metadata_items']) {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 20:49:42.532696 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-7d2a39d3-2c81-4906-b82d-27e5958013b0 tempest-AbsoluteLimitsNegativeTestJSON-498728385 tempest-AbsoluteLimitsNegativeTestJSON-498728385-project] HTTP exception thrown: Maximum number of metadata items exceeds 128 Oct 22 20:49:42.556356 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-7d2a39d3-2c81-4906-b82d-27e5958013b0 tempest-AbsoluteLimitsNegativeTestJSON-498728385 tempest-AbsoluteLimitsNegativeTestJSON-498728385-project] Request method failure captured: Oct 22 20:49:42.556356 ncdv-master-1 devstack@n-api.service[138744]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 22 20:49:42.556356 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 20:49:42.556356 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 20:49:42.556356 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 20:49:42.556356 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 1751 Oct 22 20:49:42.556356 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 20:49:42.556356 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 20:49:42.556356 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 20:49:42.556356 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 20:49:42.556356 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVFdjceBrQyj7MUrNFFUDyYizFC-PYj_0QWyY2bhtzgGwVt_A6S9lfM37nxWlJkIk9Y3pz6PHqyrTua_etCtW4AyG6lh-5ApOj-56p_mBXKq-zPIbP6Et4WLEo_mwKiHXJTgr4A06BJR9ocEr8lBcbFS_fJZnRNWve-QZVHhO7bwZGGo Oct 22 20:49:42.556356 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 20:49:42.556356 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 20:49:42.556356 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 20:49:42.556356 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 20:49:42.556356 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 20:49:42.556356 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 20:49:42.556356 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: e1d65a50708b4faab9cf473f1ef20ccf Oct 22 20:49:42.556356 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-AbsoluteLimitsNegativeTestJSON-498728385 Oct 22 20:49:42.556356 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 20:49:42.556356 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 20:49:42.556356 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_e1d65a50708b4faab9cf473f1ef20ccf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e1d65a50708b4faab9cf473f1ef20ccf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/e1d65a50708b4faab9cf473f1ef20ccf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e1d65a50708b4faab9cf473f1ef20ccf"}]}] Oct 22 20:49:42.556356 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-AbsoluteLimitsNegativeTestJSON-498728385 Oct 22 20:49:42.556356 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: e1d65a50708b4faab9cf473f1ef20ccf Oct 22 20:49:42.556356 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-AbsoluteLimitsNegativeTestJSON-498728385 Oct 22 20:49:42.556356 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-AbsoluteLimitsNegativeTestJSON-498728385-project Oct 22 20:49:42.556356 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 20:49:42.556356 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 20:49:42.556356 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: 958037f6fd7547efbe28fceaa8b8d52f Oct 22 20:49:42.556356 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-AbsoluteLimitsNegativeTestJSON-498728385-project Oct 22 20:49:42.556356 ncdv-master-1 devstack@n-api.service[138744]: Oct 22 20:49:42.556356 ncdv-master-1 devstack@n-api.service[138744]: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-338833151", "imageRef": "085e4478-6edc-4a69-8e08-f9831713eb65", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} Oct 22 20:49:42.556356 ncdv-master-1 devstack@n-api.service[138744]: method: > Oct 22 20:49:42.556356 ncdv-master-1 devstack@n-api.service[138744]: exception: Maximum number of metadata items exceeds 128 Oct 22 20:49:42.558972 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'body': {'server': {'name': 'tempest-AbsoluteLimitsNegativeTestJSON-server-338833151', 'imageRef': '085e4478-6edc-4a69-8e08-f9831713eb65', 'flavorRef': '452', 'metadata': {'0': '0', '1': '1', '2': '2', '3': '3', '4': '4', '5': '5', '6': '6', '7': '7', '8': '8', '9': '9', '10': '10', '11': '11', '12': '12', '13': '13', '14': '14', '15': '15', '16': '16', '17': '17', '18': '18', '19': '19', '20': '20', '21': '21', '22': '22', '23': '23', '24': '24', '25': '25', '26': '26', '27': '27', '28': '28', '29': '29', '30': '30', '31': '31', '32': '32', '33': '33', '34': '34', '35': '35', '36': '36', '37': '37', '38': '38', '39': '39', '40': '40', '41': '41', '42': '42', '43': '43', '44': '44', '45': '45', '46': '46', '47': '47', '48': '48', '49': '49', '50': '50', '51': '51', '52': '52', '53': '53', '54': '54', '55': '55', '56': '56', '57': '57', '58': '58', '59': '59', '60': '60', '61': '61', '62': '62', '63': '63', '64': '64', '65': '65', '66': '66', '67': '67', '68': '68', '69': '69', '70': '70', '71': '71', '72': '72', '73': '73', '74': '74', '75': '75', '76': '76', '77': '77', '78': '78', '79': '79', '80': '80', '81': '81', '82': '82', '83': '83', '84': '84', '85': '85', '86': '86', '87': '87', '88': '88', '89': '89', '90': '90', '91': '91', '92': '92', '93': '93', '94': '94', '95': '95', '96': '96', '97': '97', '98': '98', '99': '99', '100': '100', '101': '101', '102': '102', '103': '103', '104': '104', '105': '105', '106': '106', '107': '107', '108': '108', '109': '109', '110': '110', '111': '111', '112': '112', '113': '113', '114': '114', '115': '115', '116': '116', '117': '117', '118': '118', '119': '119', '120': '120', '121': '121', '122': '122', '123': '123', '124': '124', '125': '125', '126': '126', '127': '127', '128': '128'}}}} Oct 22 20:49:42.558972 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:49:42.558972 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:49:42.558972 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 476, in _check_metadata_properties_quota Oct 22 20:49:42.558972 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi objects.Quotas.limit_check(context, metadata_items=num_metadata) Oct 22 20:49:42.558972 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 22 20:49:42.558972 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 22 20:49:42.558972 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 290, in limit_check Oct 22 20:49:42.558972 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check( Oct 22 20:49:42.558972 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1118, in limit_check Oct 22 20:49:42.558972 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return self._driver.limit_check(context, self._resources, values, Oct 22 20:49:42.558972 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 468, in limit_check Oct 22 20:49:42.558972 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), quotas=quotas, Oct 22 20:49:42.558972 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['metadata_items'] Oct 22 20:49:42.558972 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:49:42.558972 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:49:42.558972 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:49:42.558972 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:49:42.558972 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 22 20:49:42.558972 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 22 20:49:42.558972 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 22 20:49:42.558972 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 22 20:49:42.558972 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Oct 22 20:49:42.558972 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Oct 22 20:49:42.558972 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1016, in _checks_for_create_and_rebuild Oct 22 20:49:42.558972 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi self._check_metadata_properties_quota(context, metadata) Oct 22 20:49:42.558972 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 483, in _check_metadata_properties_quota Oct 22 20:49:42.558972 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.MetadataLimitExceeded(allowed=quota_metadata) Oct 22 20:49:42.558972 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.MetadataLimitExceeded: Maximum number of metadata items exceeds 128 Oct 22 20:49:42.558972 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:49:42.558972 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:49:42.558972 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:49:42.558972 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:49:42.558972 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:49:42.558972 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:49:42.558972 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:49:42.558972 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:49:42.558972 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:49:42.558972 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:49:42.558972 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 20:49:42.558972 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 20:49:42.558972 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 20:49:42.558972 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 20:49:42.558972 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 20:49:42.563951 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 20:49:42.563951 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 22 20:49:42.563951 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 22 20:49:42.563951 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 22 20:49:42.563951 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Maximum number of metadata items exceeds 128 Oct 22 20:49:42.563951 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:49:42.563951 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:49:42.563951 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:49:42.563951 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:49:42.563951 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:49:42.563951 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:49:42.563951 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 20:49:42.563951 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 20:49:42.563951 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Maximum number of metadata items exceeds 128 Oct 22 20:49:42.563951 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:49:42.569116 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-7d2a39d3-2c81-4906-b82d-27e5958013b0 tempest-AbsoluteLimitsNegativeTestJSON-498728385 tempest-AbsoluteLimitsNegativeTestJSON-498728385-project] Returning 403 to user: Maximum number of metadata items exceeds 128 {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:49:42.571648 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-7d2a39d3-2c81-4906-b82d-27e5958013b0 tempest-AbsoluteLimitsNegativeTestJSON-498728385 tempest-AbsoluteLimitsNegativeTestJSON-498728385-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 403 len: 87 microversion: 2.1 time: 1.380135 Oct 22 20:49:42.581830 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 183/432] 10.222.0.18 () {60 vars in 1148 bytes} [Sat Oct 22 20:49:41 2022] POST /compute/v2.1/servers => generated 87 bytes in 1392 msecs (HTTP/1.1 403) 9 headers in 378 bytes (1 switches on core 0) Oct 22 20:49:42.626827 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.objects.instance [None req-2c41af0f-6010-4eb9-a8c3-588c17bad1d6 tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] Lazy-loading 'services' on Instance uuid 5c3de24c-090d-4769-8975-207eb939b979 {{(pid=138745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 20:49:42.713340 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-2c41af0f-6010-4eb9-a8c3-588c17bad1d6 tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/5c3de24c-090d-4769-8975-207eb939b979" status: 200 len: 1927 microversion: 2.75 time: 0.439543 Oct 22 20:49:42.715837 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 250/433] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 20:49:42 2022] GET /compute/v2.1/servers/5c3de24c-090d-4769-8975-207eb939b979 => generated 1927 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 20:49:43.334239 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-2a9cd0f6-57dd-4ec0-a519-ebe45030d583 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:49:43.334924 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-2a9cd0f6-57dd-4ec0-a519-ebe45030d583 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] [instance: 1d613848-05f4-478f-a569-b4c50576edb7] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:49:43.372349 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2a9cd0f6-57dd-4ec0-a519-ebe45030d583 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:43.379512 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2a9cd0f6-57dd-4ec0-a519-ebe45030d583 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:43.381070 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2a9cd0f6-57dd-4ec0-a519-ebe45030d583 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:43.385946 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2a9cd0f6-57dd-4ec0-a519-ebe45030d583 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:43.386768 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2a9cd0f6-57dd-4ec0-a519-ebe45030d583 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:43.388290 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2a9cd0f6-57dd-4ec0-a519-ebe45030d583 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:43.670553 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-2a9cd0f6-57dd-4ec0-a519-ebe45030d583 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:49:43.717426 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-2a9cd0f6-57dd-4ec0-a519-ebe45030d583 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:49:43.730543 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-2a9cd0f6-57dd-4ec0-a519-ebe45030d583 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:49:43.735494 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-2a9cd0f6-57dd-4ec0-a519-ebe45030d583 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] 10.222.0.18 "GET /compute/v2.1/servers/1d613848-05f4-478f-a569-b4c50576edb7" status: 200 len: 1569 microversion: 2.25 time: 0.406179 Oct 22 20:49:43.743680 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 184/434] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 20:49:43 2022] GET /compute/v2.1/servers/1d613848-05f4-478f-a569-b4c50576edb7 => generated 1569 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 20:49:43.765618 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-e53fc219-6764-478e-ad45-074cce334066 tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:49:43.768225 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-e53fc219-6764-478e-ad45-074cce334066 tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] [instance: 5c3de24c-090d-4769-8975-207eb939b979] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:49:43.783440 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e53fc219-6764-478e-ad45-074cce334066 tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:43.786266 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e53fc219-6764-478e-ad45-074cce334066 tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:43.786897 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e53fc219-6764-478e-ad45-074cce334066 tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:43.787736 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e53fc219-6764-478e-ad45-074cce334066 tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:43.788376 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e53fc219-6764-478e-ad45-074cce334066 tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:43.788811 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e53fc219-6764-478e-ad45-074cce334066 tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:43.850427 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell0:SELECT=9 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:49:43.989856 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.objects.instance [None req-e53fc219-6764-478e-ad45-074cce334066 tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] Lazy-loading 'services' on Instance uuid 5c3de24c-090d-4769-8975-207eb939b979 {{(pid=138744) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 20:49:44.028489 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-e53fc219-6764-478e-ad45-074cce334066 tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/5c3de24c-090d-4769-8975-207eb939b979" status: 200 len: 1927 microversion: 2.75 time: 0.267266 Oct 22 20:49:44.045152 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 185/435] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 20:49:43 2022] GET /compute/v2.1/servers/5c3de24c-090d-4769-8975-207eb939b979 => generated 1927 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 20:49:44.234593 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-9ea0d8b9-0454-49df-8026-c4dbabaea9a2 tempest-HostsAdminNegativeTestJSON-97806701 tempest-HostsAdminNegativeTestJSON-97806701-project-admin] Calling method '.version_select at 0x7fd3a482a8b0>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:49:44.245342 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9ea0d8b9-0454-49df-8026-c4dbabaea9a2 tempest-HostsAdminNegativeTestJSON-97806701 tempest-HostsAdminNegativeTestJSON-97806701-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:44.247442 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9ea0d8b9-0454-49df-8026-c4dbabaea9a2 tempest-HostsAdminNegativeTestJSON-97806701 tempest-HostsAdminNegativeTestJSON-97806701-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:44.248683 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9ea0d8b9-0454-49df-8026-c4dbabaea9a2 tempest-HostsAdminNegativeTestJSON-97806701 tempest-HostsAdminNegativeTestJSON-97806701-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:44.255518 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9ea0d8b9-0454-49df-8026-c4dbabaea9a2 tempest-HostsAdminNegativeTestJSON-97806701 tempest-HostsAdminNegativeTestJSON-97806701-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:44.257113 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9ea0d8b9-0454-49df-8026-c4dbabaea9a2 tempest-HostsAdminNegativeTestJSON-97806701 tempest-HostsAdminNegativeTestJSON-97806701-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:44.258330 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9ea0d8b9-0454-49df-8026-c4dbabaea9a2 tempest-HostsAdminNegativeTestJSON-97806701 tempest-HostsAdminNegativeTestJSON-97806701-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:44.338921 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-9ea0d8b9-0454-49df-8026-c4dbabaea9a2 tempest-HostsAdminNegativeTestJSON-97806701 tempest-HostsAdminNegativeTestJSON-97806701-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hosts" status: 200 len: 379 microversion: 2.1 time: 0.839115 Oct 22 20:49:44.354604 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 251/436] 10.222.0.18 () {58 vars in 1128 bytes} [Sat Oct 22 20:49:43 2022] GET /compute/v2.1/os-hosts => generated 379 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:49:44.777141 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-f5224749-82f3-4a9a-a66f-e9b2ec64771f tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:49:44.778267 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-f5224749-82f3-4a9a-a66f-e9b2ec64771f tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] [instance: 1d613848-05f4-478f-a569-b4c50576edb7] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:49:44.816994 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f5224749-82f3-4a9a-a66f-e9b2ec64771f tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:44.817684 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f5224749-82f3-4a9a-a66f-e9b2ec64771f tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:44.818142 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f5224749-82f3-4a9a-a66f-e9b2ec64771f tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:44.818900 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f5224749-82f3-4a9a-a66f-e9b2ec64771f tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:44.819426 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f5224749-82f3-4a9a-a66f-e9b2ec64771f tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:44.819869 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f5224749-82f3-4a9a-a66f-e9b2ec64771f tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:44.849364 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-abd66fcd-069d-4c74-8e6e-ea03b4773929 tempest-HostsAdminNegativeTestJSON-1234248089 tempest-HostsAdminNegativeTestJSON-1234248089-project] Calling method '.version_select at 0x7fd3a47b7160>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:49:44.853812 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-abd66fcd-069d-4c74-8e6e-ea03b4773929 tempest-HostsAdminNegativeTestJSON-1234248089 tempest-HostsAdminNegativeTestJSON-1234248089-project] Policy check for os_compute_api:os-hosts:list failed with credentials {'is_admin': False, 'user_id': 'e11e87ee2762492c9584751daf4ceecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9e30f3a4524c5791d2800ab3d57f01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:49:44.862981 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-abd66fcd-069d-4c74-8e6e-ea03b4773929 tempest-HostsAdminNegativeTestJSON-1234248089 tempest-HostsAdminNegativeTestJSON-1234248089-project] Request method failure captured: Oct 22 20:49:44.862981 ncdv-master-1 devstack@n-api.service[138744]: request: GET /compute/v2.1/os-hosts HTTP/1.1 Oct 22 20:49:44.862981 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 20:49:44.862981 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 20:49:44.862981 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 20:49:44.862981 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 0 Oct 22 20:49:44.862981 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 20:49:44.862981 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 20:49:44.862981 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 20:49:44.862981 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 20:49:44.862981 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVFdlTdUfijYB6DmiNQ72nh7-KqB5dZ9V2lDRUVM9o7dmgwk1D1M0vcMDRbuoCOkw9QFKjwPzCdnedfXOCcTasTVTIMzsodskTYko6CPwkIgxfKq5l9ZGhPdulqvjr1o7gp_VkjPFeD1CfrxwAqNLppv9-wnOFZCDs5Puth1gv1ZQI98 Oct 22 20:49:44.862981 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 20:49:44.862981 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 20:49:44.862981 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 20:49:44.862981 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 20:49:44.862981 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 20:49:44.862981 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 20:49:44.862981 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: fb9e30f3a4524c5791d2800ab3d57f01 Oct 22 20:49:44.862981 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1234248089 Oct 22 20:49:44.862981 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 20:49:44.862981 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 20:49:44.862981 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_fb9e30f3a4524c5791d2800ab3d57f01"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fb9e30f3a4524c5791d2800ab3d57f01"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/fb9e30f3a4524c5791d2800ab3d57f01"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fb9e30f3a4524c5791d2800ab3d57f01"}]}] Oct 22 20:49:44.862981 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1234248089 Oct 22 20:49:44.862981 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: fb9e30f3a4524c5791d2800ab3d57f01 Oct 22 20:49:44.862981 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1234248089 Oct 22 20:49:44.862981 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-HostsAdminNegativeTestJSON-1234248089-project Oct 22 20:49:44.862981 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 20:49:44.862981 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 20:49:44.862981 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: e11e87ee2762492c9584751daf4ceecf Oct 22 20:49:44.862981 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1234248089-project Oct 22 20:49:44.862981 ncdv-master-1 devstack@n-api.service[138744]: method: Oct 22 20:49:44.862981 ncdv-master-1 devstack@n-api.service[138744]: exception: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Oct 22 20:49:44.862981 ncdv-master-1 devstack@n-api.service[138744]: action_args: {} Oct 22 20:49:44.862981 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:49:44.862981 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:49:44.862981 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:49:44.862981 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:49:44.862981 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:49:44.862981 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:49:44.862981 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 22 20:49:44.862981 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 22 20:49:44.862981 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 22 20:49:44.862981 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 20:49:44.862981 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:49:44.862981 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:49:44.862981 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 74, in index Oct 22 20:49:44.862981 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'list', Oct 22 20:49:44.862981 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 22 20:49:44.862981 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 22 20:49:44.862981 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 22 20:49:44.862981 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 22 20:49:44.862981 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 22 20:49:44.862981 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 22 20:49:44.862981 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 22 20:49:44.862981 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise self.value Oct 22 20:49:44.862981 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 22 20:49:44.862981 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 22 20:49:44.862981 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 22 20:49:44.862981 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 22 20:49:44.862981 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 22 20:49:44.862981 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 22 20:49:44.862981 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Oct 22 20:49:44.862981 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:49:44.862981 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:49:44.862981 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:49:44.867218 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:49:44.867218 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:49:44.867218 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:49:44.867218 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 22 20:49:44.867218 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 22 20:49:44.867218 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Oct 22 20:49:44.867218 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:49:44.867218 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-abd66fcd-069d-4c74-8e6e-ea03b4773929 tempest-HostsAdminNegativeTestJSON-1234248089 tempest-HostsAdminNegativeTestJSON-1234248089-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:list to be performed. {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:49:44.878778 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-abd66fcd-069d-4c74-8e6e-ea03b4773929 tempest-HostsAdminNegativeTestJSON-1234248089 tempest-HostsAdminNegativeTestJSON-1234248089-project] 10.222.0.18 "GET /compute/v2.1/os-hosts" status: 403 len: 109 microversion: 2.1 time: 0.528854 Oct 22 20:49:44.886769 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 186/437] 10.222.0.18 () {58 vars in 1128 bytes} [Sat Oct 22 20:49:44 2022] GET /compute/v2.1/os-hosts => generated 109 bytes in 540 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 22 20:49:44.906115 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-2851937e-452e-46a6-84c5-63af10c37ea8 req-974ac4f3-5559-469e-bdd6-de01882a017a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d613848-05f4-478f-a569-b4c50576edb7", "name": "network-vif-unplugged", "status": "completed", "tag": "6bf75146-c298-478b-aee3-b0be607e5d87"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:49:44.959959 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-2851937e-452e-46a6-84c5-63af10c37ea8 req-974ac4f3-5559-469e-bdd6-de01882a017a service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:44.972512 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-2851937e-452e-46a6-84c5-63af10c37ea8 req-974ac4f3-5559-469e-bdd6-de01882a017a service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:44.974762 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-2851937e-452e-46a6-84c5-63af10c37ea8 req-974ac4f3-5559-469e-bdd6-de01882a017a service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:45.031140 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-2851937e-452e-46a6-84c5-63af10c37ea8 req-974ac4f3-5559-469e-bdd6-de01882a017a service nova] Creating event network-vif-unplugged:6bf75146-c298-478b-aee3-b0be607e5d87 for instance 1d613848-05f4-478f-a569-b4c50576edb7 on nch2-master-1 Oct 22 20:49:45.060263 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-2851937e-452e-46a6-84c5-63af10c37ea8 req-974ac4f3-5559-469e-bdd6-de01882a017a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.172042 Oct 22 20:49:45.068818 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 187/438] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:49:44 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:49:45.089966 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-bdd82568-9f9b-4c8f-9969-30fffcabe8ff tempest-HostsAdminNegativeTestJSON-1234248089 tempest-HostsAdminNegativeTestJSON-1234248089-project] Calling method '.version_select at 0x7fd3a454de50>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:49:45.109308 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-bdd82568-9f9b-4c8f-9969-30fffcabe8ff tempest-HostsAdminNegativeTestJSON-1234248089 tempest-HostsAdminNegativeTestJSON-1234248089-project] Policy check for os_compute_api:os-hosts:reboot failed with credentials {'is_admin': False, 'user_id': 'e11e87ee2762492c9584751daf4ceecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9e30f3a4524c5791d2800ab3d57f01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:49:45.117128 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-bdd82568-9f9b-4c8f-9969-30fffcabe8ff tempest-HostsAdminNegativeTestJSON-1234248089 tempest-HostsAdminNegativeTestJSON-1234248089-project] Request method failure captured: Oct 22 20:49:45.117128 ncdv-master-1 devstack@n-api.service[138744]: request: GET /compute/v2.1/os-hosts/ncdv-master-1/reboot HTTP/1.1 Oct 22 20:49:45.117128 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 20:49:45.117128 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 20:49:45.117128 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 20:49:45.117128 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 0 Oct 22 20:49:45.117128 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 20:49:45.117128 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 20:49:45.117128 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 20:49:45.117128 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 20:49:45.117128 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVFdlTdUfijYB6DmiNQ72nh7-KqB5dZ9V2lDRUVM9o7dmgwk1D1M0vcMDRbuoCOkw9QFKjwPzCdnedfXOCcTasTVTIMzsodskTYko6CPwkIgxfKq5l9ZGhPdulqvjr1o7gp_VkjPFeD1CfrxwAqNLppv9-wnOFZCDs5Puth1gv1ZQI98 Oct 22 20:49:45.117128 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 20:49:45.117128 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 20:49:45.117128 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 20:49:45.117128 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 20:49:45.117128 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 20:49:45.117128 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 20:49:45.117128 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: fb9e30f3a4524c5791d2800ab3d57f01 Oct 22 20:49:45.117128 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1234248089 Oct 22 20:49:45.117128 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 20:49:45.117128 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 20:49:45.117128 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_fb9e30f3a4524c5791d2800ab3d57f01"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fb9e30f3a4524c5791d2800ab3d57f01"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/fb9e30f3a4524c5791d2800ab3d57f01"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fb9e30f3a4524c5791d2800ab3d57f01"}]}] Oct 22 20:49:45.117128 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1234248089 Oct 22 20:49:45.117128 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: fb9e30f3a4524c5791d2800ab3d57f01 Oct 22 20:49:45.117128 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1234248089 Oct 22 20:49:45.117128 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-HostsAdminNegativeTestJSON-1234248089-project Oct 22 20:49:45.117128 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 20:49:45.117128 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 20:49:45.117128 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: e11e87ee2762492c9584751daf4ceecf Oct 22 20:49:45.117128 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1234248089-project Oct 22 20:49:45.117128 ncdv-master-1 devstack@n-api.service[138744]: method: Oct 22 20:49:45.117128 ncdv-master-1 devstack@n-api.service[138744]: exception: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Oct 22 20:49:45.117128 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': 'ncdv-master-1'} Oct 22 20:49:45.117128 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:49:45.117128 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:49:45.117128 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:49:45.117128 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:49:45.117128 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:49:45.117128 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:49:45.117128 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 22 20:49:45.117128 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 22 20:49:45.117128 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:49:45.117128 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:49:45.117128 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 203, in reboot Oct 22 20:49:45.117128 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'reboot', Oct 22 20:49:45.117128 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 22 20:49:45.117128 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 22 20:49:45.117128 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 22 20:49:45.117128 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 22 20:49:45.117128 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 22 20:49:45.117128 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 22 20:49:45.117128 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 22 20:49:45.117128 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise self.value Oct 22 20:49:45.117128 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 22 20:49:45.117128 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 22 20:49:45.117128 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 22 20:49:45.117128 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 22 20:49:45.117128 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 22 20:49:45.117128 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 22 20:49:45.117128 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Oct 22 20:49:45.117128 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:49:45.117128 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:49:45.117128 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:49:45.117128 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:49:45.121364 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:49:45.121364 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:49:45.121364 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 22 20:49:45.121364 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 22 20:49:45.121364 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Oct 22 20:49:45.121364 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:49:45.125420 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-bdd82568-9f9b-4c8f-9969-30fffcabe8ff tempest-HostsAdminNegativeTestJSON-1234248089 tempest-HostsAdminNegativeTestJSON-1234248089-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:49:45.126907 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-bdd82568-9f9b-4c8f-9969-30fffcabe8ff tempest-HostsAdminNegativeTestJSON-1234248089 tempest-HostsAdminNegativeTestJSON-1234248089-project] 10.222.0.18 "GET /compute/v2.1/os-hosts/ncdv-master-1/reboot" status: 403 len: 111 microversion: 2.1 time: 0.056237 Oct 22 20:49:45.139727 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 188/439] 10.222.0.18 () {58 vars in 1191 bytes} [Sat Oct 22 20:49:45 2022] GET /compute/v2.1/os-hosts/ncdv-master-1/reboot => generated 111 bytes in 70 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 22 20:49:45.152896 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-79818ffe-b04a-4ad4-a862-d0e46be0c9c5 tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:49:45.155501 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-79818ffe-b04a-4ad4-a862-d0e46be0c9c5 tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] [instance: 5c3de24c-090d-4769-8975-207eb939b979] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:49:45.177067 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-79818ffe-b04a-4ad4-a862-d0e46be0c9c5 tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:45.177624 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-79818ffe-b04a-4ad4-a862-d0e46be0c9c5 tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:45.178076 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-79818ffe-b04a-4ad4-a862-d0e46be0c9c5 tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:45.180729 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-79818ffe-b04a-4ad4-a862-d0e46be0c9c5 tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:45.181230 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-79818ffe-b04a-4ad4-a862-d0e46be0c9c5 tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:45.181675 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-79818ffe-b04a-4ad4-a862-d0e46be0c9c5 tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:45.597785 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.objects.instance [None req-79818ffe-b04a-4ad4-a862-d0e46be0c9c5 tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] Lazy-loading 'services' on Instance uuid 5c3de24c-090d-4769-8975-207eb939b979 {{(pid=138744) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 20:49:45.669021 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-f5224749-82f3-4a9a-a66f-e9b2ec64771f tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:49:45.686145 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-f5224749-82f3-4a9a-a66f-e9b2ec64771f tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:49:45.692910 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-f5224749-82f3-4a9a-a66f-e9b2ec64771f tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:49:45.694396 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-f5224749-82f3-4a9a-a66f-e9b2ec64771f tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] 10.222.0.18 "GET /compute/v2.1/servers/1d613848-05f4-478f-a569-b4c50576edb7" status: 200 len: 1569 microversion: 2.25 time: 0.922534 Oct 22 20:49:45.703828 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 252/440] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 20:49:44 2022] GET /compute/v2.1/servers/1d613848-05f4-478f-a569-b4c50576edb7 => generated 1569 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 20:49:45.716230 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-ccf09bbf-be85-41b0-9d4c-3880793e6d8c tempest-HostsAdminNegativeTestJSON-97806701 tempest-HostsAdminNegativeTestJSON-97806701-project-admin] Calling method '.version_select at 0x7fd3a4786f70>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:49:45.716407 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-79818ffe-b04a-4ad4-a862-d0e46be0c9c5 tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/5c3de24c-090d-4769-8975-207eb939b979" status: 200 len: 1927 microversion: 2.75 time: 0.575192 Oct 22 20:49:45.723221 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 189/441] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 20:49:45 2022] GET /compute/v2.1/servers/5c3de24c-090d-4769-8975-207eb939b979 => generated 1927 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 20:49:45.730618 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.wsgi [None req-ccf09bbf-be85-41b0-9d4c-3880793e6d8c tempest-HostsAdminNegativeTestJSON-97806701 tempest-HostsAdminNegativeTestJSON-97806701-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 22 20:49:45.732984 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-ccf09bbf-be85-41b0-9d4c-3880793e6d8c tempest-HostsAdminNegativeTestJSON-97806701 tempest-HostsAdminNegativeTestJSON-97806701-project-admin] Request method failure captured: Oct 22 20:49:45.732984 ncdv-master-1 devstack@n-api.service[138745]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot HTTP/1.1 Oct 22 20:49:45.732984 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 20:49:45.732984 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 20:49:45.732984 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 20:49:45.732984 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 0 Oct 22 20:49:45.732984 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 20:49:45.732984 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 20:49:45.732984 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 20:49:45.732984 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 20:49:45.732984 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVFdnG0mvA-xneruW_U3tDX2ZeJqEN162TjCXFuW9ejtnEfNSL1sQYtSpF-nvUP4a2mD3RD8Em5YOYIdT37MKf12mO_gwTTMGp26I33EdDpuefl2G3Ij234bx80BliCn0RvchRslD8mLm19UDF1gCHhsXhUtoVQuTTH3jILvnw85W4Sk Oct 22 20:49:45.732984 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 20:49:45.732984 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 20:49:45.732984 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 20:49:45.732984 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 20:49:45.732984 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 20:49:45.732984 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 20:49:45.732984 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: 40f85a41d53644978201cd0c2412ff4d Oct 22 20:49:45.732984 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-97806701 Oct 22 20:49:45.732984 ncdv-master-1 devstack@n-api.service[138745]: X-Role: admin,member,reader Oct 22 20:49:45.732984 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: admin,member,reader Oct 22 20:49:45.732984 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_40f85a41d53644978201cd0c2412ff4d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/40f85a41d53644978201cd0c2412ff4d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/40f85a41d53644978201cd0c2412ff4d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/40f85a41d53644978201cd0c2412ff4d"}]}] Oct 22 20:49:45.732984 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-HostsAdminNegativeTestJSON-97806701 Oct 22 20:49:45.732984 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: 40f85a41d53644978201cd0c2412ff4d Oct 22 20:49:45.732984 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-97806701 Oct 22 20:49:45.732984 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-HostsAdminNegativeTestJSON-97806701-project-admin Oct 22 20:49:45.732984 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 20:49:45.732984 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 20:49:45.732984 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: e779477b41254c86bac9458a7b0694a7 Oct 22 20:49:45.732984 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-HostsAdminNegativeTestJSON-97806701-project-admin Oct 22 20:49:45.732984 ncdv-master-1 devstack@n-api.service[138745]: method: Oct 22 20:49:45.732984 ncdv-master-1 devstack@n-api.service[138745]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 22 20:49:45.732984 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'id': 'nonexistent_hostname'} Oct 22 20:49:45.732984 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:49:45.732984 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:49:45.732984 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Oct 22 20:49:45.732984 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Oct 22 20:49:45.732984 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 22 20:49:45.732984 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 22 20:49:45.732984 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 22 20:49:45.732984 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 22 20:49:45.732984 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 22 20:49:45.732984 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise self.value Oct 22 20:49:45.732984 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 22 20:49:45.732984 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 22 20:49:45.732984 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 22 20:49:45.732984 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 22 20:49:45.732984 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 22 20:49:45.732984 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 22 20:49:45.732984 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 22 20:49:45.732984 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 22 20:49:45.732984 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 22 20:49:45.732984 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 22 20:49:45.732984 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 22 20:49:45.732984 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 22 20:49:45.732984 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 22 20:49:45.732984 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:49:45.732984 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:49:45.732984 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:49:45.732984 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:49:45.732984 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:49:45.732984 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:49:45.732984 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:49:45.737159 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:49:45.737159 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 22 20:49:45.737159 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 22 20:49:45.737159 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:49:45.737159 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:49:45.737159 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 205, in reboot Oct 22 20:49:45.737159 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="reboot") Oct 22 20:49:45.737159 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Oct 22 20:49:45.737159 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 22 20:49:45.737159 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 22 20:49:45.737159 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:49:45.737159 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:49:45.737159 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:49:45.737159 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:49:45.737159 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:49:45.737159 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:49:45.737159 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 20:49:45.737159 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 20:49:45.737159 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 22 20:49:45.737159 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:49:45.739393 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-ccf09bbf-be85-41b0-9d4c-3880793e6d8c tempest-HostsAdminNegativeTestJSON-97806701 tempest-HostsAdminNegativeTestJSON-97806701-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:49:45.740592 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-ccf09bbf-be85-41b0-9d4c-3880793e6d8c tempest-HostsAdminNegativeTestJSON-97806701 tempest-HostsAdminNegativeTestJSON-97806701-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot" status: 404 len: 99 microversion: 2.1 time: 0.035734 Oct 22 20:49:45.755549 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 253/442] 10.222.0.18 () {58 vars in 1212 bytes} [Sat Oct 22 20:49:45 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot => generated 99 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 22 20:49:45.766057 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-0336a152-05c5-4835-9aca-e7e217a5723a tempest-HostsAdminNegativeTestJSON-1234248089 tempest-HostsAdminNegativeTestJSON-1234248089-project] Calling method '.version_select at 0x7fd3a45599d0>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:49:45.769022 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-0336a152-05c5-4835-9aca-e7e217a5723a tempest-HostsAdminNegativeTestJSON-1234248089 tempest-HostsAdminNegativeTestJSON-1234248089-project] Policy check for os_compute_api:os-hosts:show failed with credentials {'is_admin': False, 'user_id': 'e11e87ee2762492c9584751daf4ceecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9e30f3a4524c5791d2800ab3d57f01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:49:45.773120 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-0336a152-05c5-4835-9aca-e7e217a5723a tempest-HostsAdminNegativeTestJSON-1234248089 tempest-HostsAdminNegativeTestJSON-1234248089-project] Request method failure captured: Oct 22 20:49:45.773120 ncdv-master-1 devstack@n-api.service[138744]: request: GET /compute/v2.1/os-hosts/ncdv-master-1 HTTP/1.1 Oct 22 20:49:45.773120 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 20:49:45.773120 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 20:49:45.773120 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 20:49:45.773120 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 0 Oct 22 20:49:45.773120 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 20:49:45.773120 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 20:49:45.773120 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 20:49:45.773120 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 20:49:45.773120 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVFdlTdUfijYB6DmiNQ72nh7-KqB5dZ9V2lDRUVM9o7dmgwk1D1M0vcMDRbuoCOkw9QFKjwPzCdnedfXOCcTasTVTIMzsodskTYko6CPwkIgxfKq5l9ZGhPdulqvjr1o7gp_VkjPFeD1CfrxwAqNLppv9-wnOFZCDs5Puth1gv1ZQI98 Oct 22 20:49:45.773120 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 20:49:45.773120 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 20:49:45.773120 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 20:49:45.773120 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 20:49:45.773120 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 20:49:45.773120 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 20:49:45.773120 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: fb9e30f3a4524c5791d2800ab3d57f01 Oct 22 20:49:45.773120 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1234248089 Oct 22 20:49:45.773120 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 20:49:45.773120 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 20:49:45.773120 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_fb9e30f3a4524c5791d2800ab3d57f01"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fb9e30f3a4524c5791d2800ab3d57f01"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/fb9e30f3a4524c5791d2800ab3d57f01"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fb9e30f3a4524c5791d2800ab3d57f01"}]}] Oct 22 20:49:45.773120 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1234248089 Oct 22 20:49:45.773120 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: fb9e30f3a4524c5791d2800ab3d57f01 Oct 22 20:49:45.773120 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1234248089 Oct 22 20:49:45.773120 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-HostsAdminNegativeTestJSON-1234248089-project Oct 22 20:49:45.773120 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 20:49:45.773120 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 20:49:45.773120 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: e11e87ee2762492c9584751daf4ceecf Oct 22 20:49:45.773120 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1234248089-project Oct 22 20:49:45.773120 ncdv-master-1 devstack@n-api.service[138744]: method: Oct 22 20:49:45.773120 ncdv-master-1 devstack@n-api.service[138744]: exception: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Oct 22 20:49:45.773120 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': 'ncdv-master-1'} Oct 22 20:49:45.773120 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:49:45.773120 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:49:45.773120 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:49:45.773120 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:49:45.773120 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:49:45.773120 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:49:45.773120 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 22 20:49:45.773120 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 22 20:49:45.773120 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:49:45.773120 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:49:45.773120 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 270, in show Oct 22 20:49:45.773120 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'show', Oct 22 20:49:45.773120 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 22 20:49:45.773120 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 22 20:49:45.773120 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 22 20:49:45.773120 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 22 20:49:45.773120 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 22 20:49:45.773120 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 22 20:49:45.773120 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 22 20:49:45.773120 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise self.value Oct 22 20:49:45.773120 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 22 20:49:45.773120 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 22 20:49:45.773120 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 22 20:49:45.773120 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 22 20:49:45.773120 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 22 20:49:45.773120 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 22 20:49:45.773120 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Oct 22 20:49:45.773120 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:49:45.773120 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:49:45.773120 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:49:45.773120 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:49:45.777022 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:49:45.777022 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:49:45.777022 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 22 20:49:45.777022 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 22 20:49:45.777022 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Oct 22 20:49:45.777022 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:49:45.781996 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-0336a152-05c5-4835-9aca-e7e217a5723a tempest-HostsAdminNegativeTestJSON-1234248089 tempest-HostsAdminNegativeTestJSON-1234248089-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:show to be performed. {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:49:45.783732 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-0336a152-05c5-4835-9aca-e7e217a5723a tempest-HostsAdminNegativeTestJSON-1234248089 tempest-HostsAdminNegativeTestJSON-1234248089-project] 10.222.0.18 "GET /compute/v2.1/os-hosts/ncdv-master-1" status: 403 len: 109 microversion: 2.1 time: 0.022448 Oct 22 20:49:45.785025 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 190/443] 10.222.0.18 () {58 vars in 1170 bytes} [Sat Oct 22 20:49:45 2022] GET /compute/v2.1/os-hosts/ncdv-master-1 => generated 109 bytes in 25 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 22 20:49:45.794511 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-c819089a-40c0-405e-81f3-0a4eb9415586 tempest-HostsAdminNegativeTestJSON-97806701 tempest-HostsAdminNegativeTestJSON-97806701-project-admin] Calling method '.version_select at 0x7fd3a4935c10>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:49:45.818391 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.wsgi [None req-c819089a-40c0-405e-81f3-0a4eb9415586 tempest-HostsAdminNegativeTestJSON-97806701 tempest-HostsAdminNegativeTestJSON-97806701-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 22 20:49:45.829408 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-c819089a-40c0-405e-81f3-0a4eb9415586 tempest-HostsAdminNegativeTestJSON-97806701 tempest-HostsAdminNegativeTestJSON-97806701-project-admin] Request method failure captured: Oct 22 20:49:45.829408 ncdv-master-1 devstack@n-api.service[138745]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Oct 22 20:49:45.829408 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 20:49:45.829408 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 20:49:45.829408 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 20:49:45.829408 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 0 Oct 22 20:49:45.829408 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 20:49:45.829408 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 20:49:45.829408 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 20:49:45.829408 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 20:49:45.829408 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVFdnG0mvA-xneruW_U3tDX2ZeJqEN162TjCXFuW9ejtnEfNSL1sQYtSpF-nvUP4a2mD3RD8Em5YOYIdT37MKf12mO_gwTTMGp26I33EdDpuefl2G3Ij234bx80BliCn0RvchRslD8mLm19UDF1gCHhsXhUtoVQuTTH3jILvnw85W4Sk Oct 22 20:49:45.829408 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 20:49:45.829408 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 20:49:45.829408 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 20:49:45.829408 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 20:49:45.829408 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 20:49:45.829408 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 20:49:45.829408 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: 40f85a41d53644978201cd0c2412ff4d Oct 22 20:49:45.829408 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-97806701 Oct 22 20:49:45.829408 ncdv-master-1 devstack@n-api.service[138745]: X-Role: admin,member,reader Oct 22 20:49:45.829408 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: admin,member,reader Oct 22 20:49:45.829408 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_40f85a41d53644978201cd0c2412ff4d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/40f85a41d53644978201cd0c2412ff4d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/40f85a41d53644978201cd0c2412ff4d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/40f85a41d53644978201cd0c2412ff4d"}]}] Oct 22 20:49:45.829408 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-HostsAdminNegativeTestJSON-97806701 Oct 22 20:49:45.829408 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: 40f85a41d53644978201cd0c2412ff4d Oct 22 20:49:45.829408 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-97806701 Oct 22 20:49:45.829408 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-HostsAdminNegativeTestJSON-97806701-project-admin Oct 22 20:49:45.829408 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 20:49:45.829408 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 20:49:45.829408 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: e779477b41254c86bac9458a7b0694a7 Oct 22 20:49:45.829408 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-HostsAdminNegativeTestJSON-97806701-project-admin Oct 22 20:49:45.829408 ncdv-master-1 devstack@n-api.service[138745]: method: Oct 22 20:49:45.829408 ncdv-master-1 devstack@n-api.service[138745]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 22 20:49:45.829408 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'id': 'nonexistent_hostname'} Oct 22 20:49:45.829408 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:49:45.829408 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:49:45.829408 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 274, in show Oct 22 20:49:45.829408 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Oct 22 20:49:45.829408 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 22 20:49:45.829408 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 22 20:49:45.829408 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 22 20:49:45.829408 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 22 20:49:45.829408 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 22 20:49:45.829408 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 22 20:49:45.829408 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 22 20:49:45.829408 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 22 20:49:45.829408 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 22 20:49:45.829408 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:49:45.829408 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:49:45.829408 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:49:45.829408 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:49:45.829408 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:49:45.829408 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:49:45.829408 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:49:45.829408 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:49:45.829408 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 22 20:49:45.829408 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 22 20:49:45.829408 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:49:45.829408 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:49:45.829408 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 282, in show Oct 22 20:49:45.829408 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 22 20:49:45.829408 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 22 20:49:45.829408 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:49:45.829408 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:49:45.829408 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:49:45.834834 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:49:45.834834 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:49:45.834834 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:49:45.834834 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 20:49:45.834834 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 20:49:45.834834 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 22 20:49:45.834834 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:49:45.836181 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-c819089a-40c0-405e-81f3-0a4eb9415586 tempest-HostsAdminNegativeTestJSON-97806701 tempest-HostsAdminNegativeTestJSON-97806701-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:49:45.837209 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-c819089a-40c0-405e-81f3-0a4eb9415586 tempest-HostsAdminNegativeTestJSON-97806701 tempest-HostsAdminNegativeTestJSON-97806701-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.046419 Oct 22 20:49:45.838226 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 254/444] 10.222.0.18 () {58 vars in 1191 bytes} [Sat Oct 22 20:49:45 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 22 20:49:45.851303 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-80772864-ccc1-4c0d-893d-9697b55b9d9e tempest-HostsAdminNegativeTestJSON-1234248089 tempest-HostsAdminNegativeTestJSON-1234248089-project] Calling method '.version_select at 0x7fd3a4753670>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:49:45.866584 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-80772864-ccc1-4c0d-893d-9697b55b9d9e tempest-HostsAdminNegativeTestJSON-1234248089 tempest-HostsAdminNegativeTestJSON-1234248089-project] Policy check for os_compute_api:os-hosts:shutdown failed with credentials {'is_admin': False, 'user_id': 'e11e87ee2762492c9584751daf4ceecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9e30f3a4524c5791d2800ab3d57f01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:49:45.869117 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-80772864-ccc1-4c0d-893d-9697b55b9d9e tempest-HostsAdminNegativeTestJSON-1234248089 tempest-HostsAdminNegativeTestJSON-1234248089-project] Request method failure captured: Oct 22 20:49:45.869117 ncdv-master-1 devstack@n-api.service[138744]: request: GET /compute/v2.1/os-hosts/ncdv-master-1/shutdown HTTP/1.1 Oct 22 20:49:45.869117 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 20:49:45.869117 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 20:49:45.869117 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 20:49:45.869117 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 0 Oct 22 20:49:45.869117 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 20:49:45.869117 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 20:49:45.869117 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 20:49:45.869117 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 20:49:45.869117 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVFdlTdUfijYB6DmiNQ72nh7-KqB5dZ9V2lDRUVM9o7dmgwk1D1M0vcMDRbuoCOkw9QFKjwPzCdnedfXOCcTasTVTIMzsodskTYko6CPwkIgxfKq5l9ZGhPdulqvjr1o7gp_VkjPFeD1CfrxwAqNLppv9-wnOFZCDs5Puth1gv1ZQI98 Oct 22 20:49:45.869117 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 20:49:45.869117 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 20:49:45.869117 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 20:49:45.869117 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 20:49:45.869117 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 20:49:45.869117 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 20:49:45.869117 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: fb9e30f3a4524c5791d2800ab3d57f01 Oct 22 20:49:45.869117 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1234248089 Oct 22 20:49:45.869117 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 20:49:45.869117 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 20:49:45.869117 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_fb9e30f3a4524c5791d2800ab3d57f01"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fb9e30f3a4524c5791d2800ab3d57f01"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/fb9e30f3a4524c5791d2800ab3d57f01"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fb9e30f3a4524c5791d2800ab3d57f01"}]}] Oct 22 20:49:45.869117 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1234248089 Oct 22 20:49:45.869117 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: fb9e30f3a4524c5791d2800ab3d57f01 Oct 22 20:49:45.869117 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1234248089 Oct 22 20:49:45.869117 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-HostsAdminNegativeTestJSON-1234248089-project Oct 22 20:49:45.869117 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 20:49:45.869117 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 20:49:45.869117 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: e11e87ee2762492c9584751daf4ceecf Oct 22 20:49:45.869117 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1234248089-project Oct 22 20:49:45.869117 ncdv-master-1 devstack@n-api.service[138744]: method: Oct 22 20:49:45.869117 ncdv-master-1 devstack@n-api.service[138744]: exception: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Oct 22 20:49:45.869117 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': 'ncdv-master-1'} Oct 22 20:49:45.869117 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:49:45.869117 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:49:45.869117 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:49:45.869117 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:49:45.869117 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:49:45.869117 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:49:45.869117 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 22 20:49:45.869117 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 22 20:49:45.869117 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:49:45.869117 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:49:45.869117 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 195, in shutdown Oct 22 20:49:45.869117 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'shutdown', Oct 22 20:49:45.869117 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 22 20:49:45.869117 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 22 20:49:45.869117 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 22 20:49:45.869117 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 22 20:49:45.869117 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 22 20:49:45.869117 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 22 20:49:45.869117 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 22 20:49:45.869117 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise self.value Oct 22 20:49:45.869117 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 22 20:49:45.869117 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 22 20:49:45.869117 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 22 20:49:45.869117 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 22 20:49:45.869117 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 22 20:49:45.869117 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 22 20:49:45.869117 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Oct 22 20:49:45.869117 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:49:45.869117 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:49:45.869117 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:49:45.869117 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:49:45.873481 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:49:45.873481 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:49:45.873481 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 22 20:49:45.873481 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 22 20:49:45.873481 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Oct 22 20:49:45.873481 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:49:45.873481 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-80772864-ccc1-4c0d-893d-9697b55b9d9e tempest-HostsAdminNegativeTestJSON-1234248089 tempest-HostsAdminNegativeTestJSON-1234248089-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:49:45.873481 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-80772864-ccc1-4c0d-893d-9697b55b9d9e tempest-HostsAdminNegativeTestJSON-1234248089 tempest-HostsAdminNegativeTestJSON-1234248089-project] 10.222.0.18 "GET /compute/v2.1/os-hosts/ncdv-master-1/shutdown" status: 403 len: 113 microversion: 2.1 time: 0.029319 Oct 22 20:49:45.874039 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 191/445] 10.222.0.18 () {58 vars in 1197 bytes} [Sat Oct 22 20:49:45 2022] GET /compute/v2.1/os-hosts/ncdv-master-1/shutdown => generated 113 bytes in 31 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 22 20:49:45.883849 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-72c5a2a9-dbda-4e36-a4e0-28d852a1cfe2 tempest-HostsAdminNegativeTestJSON-97806701 tempest-HostsAdminNegativeTestJSON-97806701-project-admin] Calling method '.version_select at 0x7fd3a47864c0>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:49:45.888638 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_api:SELECT=86,nova_api:DELETE=11,nova_api:INSERT=3 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:49:45.913758 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.wsgi [None req-72c5a2a9-dbda-4e36-a4e0-28d852a1cfe2 tempest-HostsAdminNegativeTestJSON-97806701 tempest-HostsAdminNegativeTestJSON-97806701-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 22 20:49:45.915890 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-72c5a2a9-dbda-4e36-a4e0-28d852a1cfe2 tempest-HostsAdminNegativeTestJSON-97806701 tempest-HostsAdminNegativeTestJSON-97806701-project-admin] Request method failure captured: Oct 22 20:49:45.915890 ncdv-master-1 devstack@n-api.service[138745]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown HTTP/1.1 Oct 22 20:49:45.915890 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 20:49:45.915890 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 20:49:45.915890 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 20:49:45.915890 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 0 Oct 22 20:49:45.915890 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 20:49:45.915890 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 20:49:45.915890 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 20:49:45.915890 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 20:49:45.915890 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVFdnG0mvA-xneruW_U3tDX2ZeJqEN162TjCXFuW9ejtnEfNSL1sQYtSpF-nvUP4a2mD3RD8Em5YOYIdT37MKf12mO_gwTTMGp26I33EdDpuefl2G3Ij234bx80BliCn0RvchRslD8mLm19UDF1gCHhsXhUtoVQuTTH3jILvnw85W4Sk Oct 22 20:49:45.915890 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 20:49:45.915890 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 20:49:45.915890 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 20:49:45.915890 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 20:49:45.915890 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 20:49:45.915890 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 20:49:45.915890 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: 40f85a41d53644978201cd0c2412ff4d Oct 22 20:49:45.915890 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-97806701 Oct 22 20:49:45.915890 ncdv-master-1 devstack@n-api.service[138745]: X-Role: admin,member,reader Oct 22 20:49:45.915890 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: admin,member,reader Oct 22 20:49:45.915890 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_40f85a41d53644978201cd0c2412ff4d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/40f85a41d53644978201cd0c2412ff4d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/40f85a41d53644978201cd0c2412ff4d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/40f85a41d53644978201cd0c2412ff4d"}]}] Oct 22 20:49:45.915890 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-HostsAdminNegativeTestJSON-97806701 Oct 22 20:49:45.915890 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: 40f85a41d53644978201cd0c2412ff4d Oct 22 20:49:45.915890 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-97806701 Oct 22 20:49:45.915890 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-HostsAdminNegativeTestJSON-97806701-project-admin Oct 22 20:49:45.915890 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 20:49:45.915890 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 20:49:45.915890 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: e779477b41254c86bac9458a7b0694a7 Oct 22 20:49:45.915890 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-HostsAdminNegativeTestJSON-97806701-project-admin Oct 22 20:49:45.915890 ncdv-master-1 devstack@n-api.service[138745]: method: Oct 22 20:49:45.915890 ncdv-master-1 devstack@n-api.service[138745]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 22 20:49:45.915890 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'id': 'nonexistent_hostname'} Oct 22 20:49:45.915890 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:49:45.915890 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:49:45.915890 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Oct 22 20:49:45.915890 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Oct 22 20:49:45.915890 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 22 20:49:45.915890 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 22 20:49:45.915890 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 22 20:49:45.915890 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 22 20:49:45.915890 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 22 20:49:45.915890 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise self.value Oct 22 20:49:45.915890 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 22 20:49:45.915890 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 22 20:49:45.915890 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 22 20:49:45.915890 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 22 20:49:45.915890 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 22 20:49:45.915890 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 22 20:49:45.915890 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 22 20:49:45.915890 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 22 20:49:45.915890 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 22 20:49:45.915890 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 22 20:49:45.915890 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 22 20:49:45.915890 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 22 20:49:45.915890 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 22 20:49:45.915890 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:49:45.915890 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:49:45.915890 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:49:45.915890 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:49:45.915890 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:49:45.915890 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:49:45.915890 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:49:45.919928 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:49:45.919928 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 22 20:49:45.919928 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 22 20:49:45.919928 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:49:45.919928 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:49:45.919928 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 197, in shutdown Oct 22 20:49:45.919928 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="shutdown") Oct 22 20:49:45.919928 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Oct 22 20:49:45.919928 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 22 20:49:45.919928 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 22 20:49:45.919928 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:49:45.919928 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:49:45.919928 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:49:45.919928 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:49:45.919928 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:49:45.919928 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:49:45.919928 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 20:49:45.919928 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 20:49:45.919928 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 22 20:49:45.919928 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:49:45.921120 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-72c5a2a9-dbda-4e36-a4e0-28d852a1cfe2 tempest-HostsAdminNegativeTestJSON-97806701 tempest-HostsAdminNegativeTestJSON-97806701-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:49:45.925913 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-72c5a2a9-dbda-4e36-a4e0-28d852a1cfe2 tempest-HostsAdminNegativeTestJSON-97806701 tempest-HostsAdminNegativeTestJSON-97806701-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown" status: 404 len: 99 microversion: 2.1 time: 0.041652 Oct 22 20:49:45.931646 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 255/446] 10.222.0.18 () {58 vars in 1218 bytes} [Sat Oct 22 20:49:45 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown => generated 99 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 22 20:49:45.938349 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-2368a35c-df82-4d51-9209-44a8a2a5ab40 tempest-HostsAdminNegativeTestJSON-1234248089 tempest-HostsAdminNegativeTestJSON-1234248089-project] Calling method '.version_select at 0x7fd3a4753670>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:49:45.942301 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-2368a35c-df82-4d51-9209-44a8a2a5ab40 tempest-HostsAdminNegativeTestJSON-1234248089 tempest-HostsAdminNegativeTestJSON-1234248089-project] Policy check for os_compute_api:os-hosts:start failed with credentials {'is_admin': False, 'user_id': 'e11e87ee2762492c9584751daf4ceecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9e30f3a4524c5791d2800ab3d57f01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:49:45.945639 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-2368a35c-df82-4d51-9209-44a8a2a5ab40 tempest-HostsAdminNegativeTestJSON-1234248089 tempest-HostsAdminNegativeTestJSON-1234248089-project] Request method failure captured: Oct 22 20:49:45.945639 ncdv-master-1 devstack@n-api.service[138744]: request: GET /compute/v2.1/os-hosts/ncdv-master-1/startup HTTP/1.1 Oct 22 20:49:45.945639 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 20:49:45.945639 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 20:49:45.945639 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 20:49:45.945639 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 0 Oct 22 20:49:45.945639 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 20:49:45.945639 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 20:49:45.945639 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 20:49:45.945639 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 20:49:45.945639 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVFdlTdUfijYB6DmiNQ72nh7-KqB5dZ9V2lDRUVM9o7dmgwk1D1M0vcMDRbuoCOkw9QFKjwPzCdnedfXOCcTasTVTIMzsodskTYko6CPwkIgxfKq5l9ZGhPdulqvjr1o7gp_VkjPFeD1CfrxwAqNLppv9-wnOFZCDs5Puth1gv1ZQI98 Oct 22 20:49:45.945639 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 20:49:45.945639 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 20:49:45.945639 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 20:49:45.945639 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 20:49:45.945639 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 20:49:45.945639 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 20:49:45.945639 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: fb9e30f3a4524c5791d2800ab3d57f01 Oct 22 20:49:45.945639 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1234248089 Oct 22 20:49:45.945639 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 20:49:45.945639 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 20:49:45.945639 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_fb9e30f3a4524c5791d2800ab3d57f01"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fb9e30f3a4524c5791d2800ab3d57f01"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/fb9e30f3a4524c5791d2800ab3d57f01"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fb9e30f3a4524c5791d2800ab3d57f01"}]}] Oct 22 20:49:45.945639 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1234248089 Oct 22 20:49:45.945639 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: fb9e30f3a4524c5791d2800ab3d57f01 Oct 22 20:49:45.945639 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1234248089 Oct 22 20:49:45.945639 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-HostsAdminNegativeTestJSON-1234248089-project Oct 22 20:49:45.945639 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 20:49:45.945639 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 20:49:45.945639 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: e11e87ee2762492c9584751daf4ceecf Oct 22 20:49:45.945639 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1234248089-project Oct 22 20:49:45.945639 ncdv-master-1 devstack@n-api.service[138744]: method: Oct 22 20:49:45.945639 ncdv-master-1 devstack@n-api.service[138744]: exception: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Oct 22 20:49:45.945639 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': 'ncdv-master-1'} Oct 22 20:49:45.945639 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:49:45.945639 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:49:45.945639 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:49:45.945639 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:49:45.945639 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:49:45.945639 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:49:45.945639 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 22 20:49:45.945639 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 22 20:49:45.945639 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:49:45.945639 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:49:45.945639 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 187, in startup Oct 22 20:49:45.945639 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'start', Oct 22 20:49:45.945639 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 22 20:49:45.945639 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 22 20:49:45.945639 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 22 20:49:45.945639 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 22 20:49:45.945639 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 22 20:49:45.945639 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 22 20:49:45.945639 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 22 20:49:45.945639 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise self.value Oct 22 20:49:45.945639 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 22 20:49:45.945639 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 22 20:49:45.945639 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 22 20:49:45.945639 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 22 20:49:45.945639 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 22 20:49:45.945639 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 22 20:49:45.945639 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Oct 22 20:49:45.945639 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:49:45.945639 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:49:45.945639 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:49:45.945639 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:49:45.950703 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:49:45.950703 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:49:45.950703 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 22 20:49:45.950703 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 22 20:49:45.950703 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Oct 22 20:49:45.950703 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:49:45.956403 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-2368a35c-df82-4d51-9209-44a8a2a5ab40 tempest-HostsAdminNegativeTestJSON-1234248089 tempest-HostsAdminNegativeTestJSON-1234248089-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:start to be performed. {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:49:45.957503 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-2368a35c-df82-4d51-9209-44a8a2a5ab40 tempest-HostsAdminNegativeTestJSON-1234248089 tempest-HostsAdminNegativeTestJSON-1234248089-project] 10.222.0.18 "GET /compute/v2.1/os-hosts/ncdv-master-1/startup" status: 403 len: 110 microversion: 2.1 time: 0.024564 Oct 22 20:49:45.958220 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 192/447] 10.222.0.18 () {58 vars in 1194 bytes} [Sat Oct 22 20:49:45 2022] GET /compute/v2.1/os-hosts/ncdv-master-1/startup => generated 110 bytes in 26 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 22 20:49:45.967690 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-b17fb8ed-1653-4b04-a8cc-a6641130f2a4 tempest-HostsAdminNegativeTestJSON-97806701 tempest-HostsAdminNegativeTestJSON-97806701-project-admin] Calling method '.version_select at 0x7fd3a4a3b280>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:49:46.006819 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.wsgi [None req-b17fb8ed-1653-4b04-a8cc-a6641130f2a4 tempest-HostsAdminNegativeTestJSON-97806701 tempest-HostsAdminNegativeTestJSON-97806701-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 22 20:49:46.019486 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-b17fb8ed-1653-4b04-a8cc-a6641130f2a4 tempest-HostsAdminNegativeTestJSON-97806701 tempest-HostsAdminNegativeTestJSON-97806701-project-admin] Request method failure captured: Oct 22 20:49:46.019486 ncdv-master-1 devstack@n-api.service[138745]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/startup HTTP/1.1 Oct 22 20:49:46.019486 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 20:49:46.019486 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 20:49:46.019486 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 20:49:46.019486 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 0 Oct 22 20:49:46.019486 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 20:49:46.019486 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 20:49:46.019486 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 20:49:46.019486 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 20:49:46.019486 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVFdnG0mvA-xneruW_U3tDX2ZeJqEN162TjCXFuW9ejtnEfNSL1sQYtSpF-nvUP4a2mD3RD8Em5YOYIdT37MKf12mO_gwTTMGp26I33EdDpuefl2G3Ij234bx80BliCn0RvchRslD8mLm19UDF1gCHhsXhUtoVQuTTH3jILvnw85W4Sk Oct 22 20:49:46.019486 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 20:49:46.019486 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 20:49:46.019486 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 20:49:46.019486 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 20:49:46.019486 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 20:49:46.019486 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 20:49:46.019486 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: 40f85a41d53644978201cd0c2412ff4d Oct 22 20:49:46.019486 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-97806701 Oct 22 20:49:46.019486 ncdv-master-1 devstack@n-api.service[138745]: X-Role: admin,member,reader Oct 22 20:49:46.019486 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: admin,member,reader Oct 22 20:49:46.019486 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_40f85a41d53644978201cd0c2412ff4d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/40f85a41d53644978201cd0c2412ff4d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/40f85a41d53644978201cd0c2412ff4d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/40f85a41d53644978201cd0c2412ff4d"}]}] Oct 22 20:49:46.019486 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-HostsAdminNegativeTestJSON-97806701 Oct 22 20:49:46.019486 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: 40f85a41d53644978201cd0c2412ff4d Oct 22 20:49:46.019486 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-97806701 Oct 22 20:49:46.019486 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-HostsAdminNegativeTestJSON-97806701-project-admin Oct 22 20:49:46.019486 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 20:49:46.019486 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 20:49:46.019486 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: e779477b41254c86bac9458a7b0694a7 Oct 22 20:49:46.019486 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-HostsAdminNegativeTestJSON-97806701-project-admin Oct 22 20:49:46.019486 ncdv-master-1 devstack@n-api.service[138745]: method: Oct 22 20:49:46.019486 ncdv-master-1 devstack@n-api.service[138745]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 22 20:49:46.019486 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'id': 'nonexistent_hostname'} Oct 22 20:49:46.019486 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:49:46.019486 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:49:46.019486 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Oct 22 20:49:46.019486 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Oct 22 20:49:46.019486 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 22 20:49:46.019486 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 22 20:49:46.019486 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 22 20:49:46.019486 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 22 20:49:46.019486 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 22 20:49:46.019486 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise self.value Oct 22 20:49:46.019486 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 22 20:49:46.019486 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 22 20:49:46.019486 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 22 20:49:46.019486 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 22 20:49:46.019486 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 22 20:49:46.019486 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 22 20:49:46.019486 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 22 20:49:46.019486 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 22 20:49:46.019486 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 22 20:49:46.019486 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 22 20:49:46.019486 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 22 20:49:46.019486 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 22 20:49:46.019486 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 22 20:49:46.019486 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:49:46.019486 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:49:46.019486 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:49:46.019486 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:49:46.019486 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:49:46.019486 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:49:46.019486 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:49:46.026569 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:49:46.026569 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 22 20:49:46.026569 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 22 20:49:46.026569 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:49:46.026569 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:49:46.026569 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 189, in startup Oct 22 20:49:46.026569 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="startup") Oct 22 20:49:46.026569 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Oct 22 20:49:46.026569 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 22 20:49:46.026569 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 22 20:49:46.026569 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:49:46.026569 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:49:46.026569 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:49:46.026569 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:49:46.026569 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:49:46.026569 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:49:46.026569 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 20:49:46.026569 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 20:49:46.026569 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 22 20:49:46.026569 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:49:46.026569 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-b17fb8ed-1653-4b04-a8cc-a6641130f2a4 tempest-HostsAdminNegativeTestJSON-97806701 tempest-HostsAdminNegativeTestJSON-97806701-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:49:46.026569 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-b17fb8ed-1653-4b04-a8cc-a6641130f2a4 tempest-HostsAdminNegativeTestJSON-97806701 tempest-HostsAdminNegativeTestJSON-97806701-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hosts/nonexistent_hostname/startup" status: 404 len: 99 microversion: 2.1 time: 0.057620 Oct 22 20:49:46.030225 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 256/448] 10.222.0.18 () {58 vars in 1215 bytes} [Sat Oct 22 20:49:45 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/startup => generated 99 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 22 20:49:46.037524 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-2156e483-bc20-43bc-accc-b4965f4ed786 tempest-HostsAdminNegativeTestJSON-97806701 tempest-HostsAdminNegativeTestJSON-97806701-project-admin] Action: 'update', calling method: .version_select at 0x7fd3a4559ca0>, body: {"status": "enable", "maintenance_mode": "invalid"} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:49:46.041749 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-2156e483-bc20-43bc-accc-b4965f4ed786 tempest-HostsAdminNegativeTestJSON-97806701 tempest-HostsAdminNegativeTestJSON-97806701-project-admin] Request method failure captured: Oct 22 20:49:46.041749 ncdv-master-1 devstack@n-api.service[138744]: request: PUT /compute/v2.1/os-hosts/ncdv-master-1 HTTP/1.1 Oct 22 20:49:46.041749 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 20:49:46.041749 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 20:49:46.041749 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 20:49:46.041749 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 51 Oct 22 20:49:46.041749 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 20:49:46.041749 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 20:49:46.041749 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 20:49:46.041749 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 20:49:46.041749 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVFdnG0mvA-xneruW_U3tDX2ZeJqEN162TjCXFuW9ejtnEfNSL1sQYtSpF-nvUP4a2mD3RD8Em5YOYIdT37MKf12mO_gwTTMGp26I33EdDpuefl2G3Ij234bx80BliCn0RvchRslD8mLm19UDF1gCHhsXhUtoVQuTTH3jILvnw85W4Sk Oct 22 20:49:46.041749 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 20:49:46.041749 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 20:49:46.041749 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 20:49:46.041749 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 20:49:46.041749 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 20:49:46.041749 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 20:49:46.041749 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: 40f85a41d53644978201cd0c2412ff4d Oct 22 20:49:46.041749 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-97806701 Oct 22 20:49:46.041749 ncdv-master-1 devstack@n-api.service[138744]: X-Role: admin,member,reader Oct 22 20:49:46.041749 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: admin,member,reader Oct 22 20:49:46.041749 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_40f85a41d53644978201cd0c2412ff4d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/40f85a41d53644978201cd0c2412ff4d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/40f85a41d53644978201cd0c2412ff4d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/40f85a41d53644978201cd0c2412ff4d"}]}] Oct 22 20:49:46.041749 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-HostsAdminNegativeTestJSON-97806701 Oct 22 20:49:46.041749 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: 40f85a41d53644978201cd0c2412ff4d Oct 22 20:49:46.041749 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-97806701 Oct 22 20:49:46.041749 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-HostsAdminNegativeTestJSON-97806701-project-admin Oct 22 20:49:46.041749 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 20:49:46.041749 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 20:49:46.041749 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: e779477b41254c86bac9458a7b0694a7 Oct 22 20:49:46.041749 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-HostsAdminNegativeTestJSON-97806701-project-admin Oct 22 20:49:46.041749 ncdv-master-1 devstack@n-api.service[138744]: Oct 22 20:49:46.041749 ncdv-master-1 devstack@n-api.service[138744]: {"status": "enable", "maintenance_mode": "invalid"} Oct 22 20:49:46.041749 ncdv-master-1 devstack@n-api.service[138744]: method: Oct 22 20:49:46.041749 ncdv-master-1 devstack@n-api.service[138744]: exception: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 22 20:49:46.041749 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': 'ncdv-master-1', 'body': {'status': 'enable', 'maintenance_mode': 'invalid'}} Oct 22 20:49:46.041749 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:49:46.041749 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:49:46.041749 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 22 20:49:46.041749 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 22 20:49:46.041749 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 22 20:49:46.041749 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise error Oct 22 20:49:46.041749 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 22 20:49:46.041749 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:49:46.041749 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['maintenance_mode']: Oct 22 20:49:46.041749 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Oct 22 20:49:46.041749 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi 'disable', Oct 22 20:49:46.041749 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi 'Enable', Oct 22 20:49:46.041749 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi 'Disable', Oct 22 20:49:46.041749 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi 'ENABLE', Oct 22 20:49:46.041749 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi 'DISABLE'], Oct 22 20:49:46.041749 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 22 20:49:46.041749 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:49:46.041749 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi On instance: Oct 22 20:49:46.041749 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi 'invalid' Oct 22 20:49:46.041749 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:49:46.041749 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:49:46.041749 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:49:46.041749 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:49:46.041749 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:49:46.041749 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:49:46.041749 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:49:46.041749 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:49:46.041749 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 22 20:49:46.041749 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 22 20:49:46.041749 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:49:46.041749 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:49:46.041749 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 22 20:49:46.041749 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 22 20:49:46.046750 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 22 20:49:46.046750 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 22 20:49:46.046750 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 22 20:49:46.046750 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 22 20:49:46.046750 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 22 20:49:46.046750 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:49:46.046750 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:49:46.046750 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:49:46.046750 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:49:46.046750 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:49:46.046750 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:49:46.046750 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 22 20:49:46.046750 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 22 20:49:46.046750 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 22 20:49:46.046750 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:49:46.046750 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-2156e483-bc20-43bc-accc-b4965f4ed786 tempest-HostsAdminNegativeTestJSON-97806701 tempest-HostsAdminNegativeTestJSON-97806701-project-admin] Returning 400 to user: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:49:46.046750 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-2156e483-bc20-43bc-accc-b4965f4ed786 tempest-HostsAdminNegativeTestJSON-97806701 tempest-HostsAdminNegativeTestJSON-97806701-project-admin] 10.222.0.18 "PUT /compute/v2.1/os-hosts/ncdv-master-1" status: 400 len: 199 microversion: 2.1 time: 0.011930 Oct 22 20:49:46.052057 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 193/449] 10.222.0.18 () {60 vars in 1190 bytes} [Sat Oct 22 20:49:46 2022] PUT /compute/v2.1/os-hosts/ncdv-master-1 => generated 199 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 22 20:49:46.076970 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-69944453-4166-4b73-ae13-ed07ad816a4d tempest-HostsAdminNegativeTestJSON-97806701 tempest-HostsAdminNegativeTestJSON-97806701-project-admin] Action: 'update', calling method: .version_select at 0x7fd3a47864c0>, body: {"status": "invalid", "maintenance_mode": "enable"} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:49:46.097020 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-69944453-4166-4b73-ae13-ed07ad816a4d tempest-HostsAdminNegativeTestJSON-97806701 tempest-HostsAdminNegativeTestJSON-97806701-project-admin] Request method failure captured: Oct 22 20:49:46.097020 ncdv-master-1 devstack@n-api.service[138745]: request: PUT /compute/v2.1/os-hosts/ncdv-master-1 HTTP/1.1 Oct 22 20:49:46.097020 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 20:49:46.097020 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 20:49:46.097020 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 20:49:46.097020 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 51 Oct 22 20:49:46.097020 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 20:49:46.097020 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 20:49:46.097020 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 20:49:46.097020 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 20:49:46.097020 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVFdnG0mvA-xneruW_U3tDX2ZeJqEN162TjCXFuW9ejtnEfNSL1sQYtSpF-nvUP4a2mD3RD8Em5YOYIdT37MKf12mO_gwTTMGp26I33EdDpuefl2G3Ij234bx80BliCn0RvchRslD8mLm19UDF1gCHhsXhUtoVQuTTH3jILvnw85W4Sk Oct 22 20:49:46.097020 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 20:49:46.097020 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 20:49:46.097020 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 20:49:46.097020 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 20:49:46.097020 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 20:49:46.097020 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 20:49:46.097020 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: 40f85a41d53644978201cd0c2412ff4d Oct 22 20:49:46.097020 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-97806701 Oct 22 20:49:46.097020 ncdv-master-1 devstack@n-api.service[138745]: X-Role: admin,member,reader Oct 22 20:49:46.097020 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: admin,member,reader Oct 22 20:49:46.097020 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_40f85a41d53644978201cd0c2412ff4d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/40f85a41d53644978201cd0c2412ff4d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/40f85a41d53644978201cd0c2412ff4d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/40f85a41d53644978201cd0c2412ff4d"}]}] Oct 22 20:49:46.097020 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-HostsAdminNegativeTestJSON-97806701 Oct 22 20:49:46.097020 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: 40f85a41d53644978201cd0c2412ff4d Oct 22 20:49:46.097020 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-97806701 Oct 22 20:49:46.097020 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-HostsAdminNegativeTestJSON-97806701-project-admin Oct 22 20:49:46.097020 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 20:49:46.097020 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 20:49:46.097020 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: e779477b41254c86bac9458a7b0694a7 Oct 22 20:49:46.097020 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-HostsAdminNegativeTestJSON-97806701-project-admin Oct 22 20:49:46.097020 ncdv-master-1 devstack@n-api.service[138745]: Oct 22 20:49:46.097020 ncdv-master-1 devstack@n-api.service[138745]: {"status": "invalid", "maintenance_mode": "enable"} Oct 22 20:49:46.097020 ncdv-master-1 devstack@n-api.service[138745]: method: Oct 22 20:49:46.097020 ncdv-master-1 devstack@n-api.service[138745]: exception: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 22 20:49:46.097020 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'id': 'ncdv-master-1', 'body': {'status': 'invalid', 'maintenance_mode': 'enable'}} Oct 22 20:49:46.097020 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:49:46.097020 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:49:46.097020 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 22 20:49:46.097020 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 22 20:49:46.097020 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 22 20:49:46.097020 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise error Oct 22 20:49:46.097020 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 22 20:49:46.097020 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:49:46.097020 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['status']: Oct 22 20:49:46.097020 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Oct 22 20:49:46.097020 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi 'disable', Oct 22 20:49:46.097020 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi 'Enable', Oct 22 20:49:46.097020 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi 'Disable', Oct 22 20:49:46.097020 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi 'ENABLE', Oct 22 20:49:46.097020 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi 'DISABLE'], Oct 22 20:49:46.097020 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 22 20:49:46.097020 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:49:46.097020 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi On instance: Oct 22 20:49:46.097020 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi 'invalid' Oct 22 20:49:46.097020 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:49:46.097020 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:49:46.097020 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:49:46.097020 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:49:46.097020 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:49:46.097020 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:49:46.097020 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:49:46.097020 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:49:46.097020 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 22 20:49:46.097020 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 22 20:49:46.097020 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:49:46.097020 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:49:46.097020 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 22 20:49:46.097020 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 22 20:49:46.106724 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 22 20:49:46.106724 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 22 20:49:46.106724 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 22 20:49:46.106724 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 22 20:49:46.106724 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 22 20:49:46.106724 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:49:46.106724 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:49:46.106724 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:49:46.106724 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:49:46.106724 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:49:46.106724 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:49:46.106724 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 22 20:49:46.106724 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 22 20:49:46.106724 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 22 20:49:46.106724 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:49:46.113018 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-69944453-4166-4b73-ae13-ed07ad816a4d tempest-HostsAdminNegativeTestJSON-97806701 tempest-HostsAdminNegativeTestJSON-97806701-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:49:46.115988 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-69944453-4166-4b73-ae13-ed07ad816a4d tempest-HostsAdminNegativeTestJSON-97806701 tempest-HostsAdminNegativeTestJSON-97806701-project-admin] 10.222.0.18 "PUT /compute/v2.1/os-hosts/ncdv-master-1" status: 400 len: 189 microversion: 2.1 time: 0.061308 Oct 22 20:49:46.117572 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 257/450] 10.222.0.18 () {60 vars in 1190 bytes} [Sat Oct 22 20:49:46 2022] PUT /compute/v2.1/os-hosts/ncdv-master-1 => generated 189 bytes in 65 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 22 20:49:46.131041 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-96d336f6-6318-4485-a13c-542e155b7159 tempest-HostsAdminNegativeTestJSON-1234248089 tempest-HostsAdminNegativeTestJSON-1234248089-project] Action: 'update', calling method: .version_select at 0x7fd3a477f3a0>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:49:46.135168 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-96d336f6-6318-4485-a13c-542e155b7159 tempest-HostsAdminNegativeTestJSON-1234248089 tempest-HostsAdminNegativeTestJSON-1234248089-project] Policy check for os_compute_api:os-hosts:update failed with credentials {'is_admin': False, 'user_id': 'e11e87ee2762492c9584751daf4ceecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9e30f3a4524c5791d2800ab3d57f01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:49:46.148012 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-96d336f6-6318-4485-a13c-542e155b7159 tempest-HostsAdminNegativeTestJSON-1234248089 tempest-HostsAdminNegativeTestJSON-1234248089-project] Request method failure captured: Oct 22 20:49:46.148012 ncdv-master-1 devstack@n-api.service[138744]: request: PUT /compute/v2.1/os-hosts/ncdv-master-1 HTTP/1.1 Oct 22 20:49:46.148012 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 20:49:46.148012 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 20:49:46.148012 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 20:49:46.148012 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 50 Oct 22 20:49:46.148012 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 20:49:46.148012 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 20:49:46.148012 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 20:49:46.148012 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 20:49:46.148012 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVFdlTdUfijYB6DmiNQ72nh7-KqB5dZ9V2lDRUVM9o7dmgwk1D1M0vcMDRbuoCOkw9QFKjwPzCdnedfXOCcTasTVTIMzsodskTYko6CPwkIgxfKq5l9ZGhPdulqvjr1o7gp_VkjPFeD1CfrxwAqNLppv9-wnOFZCDs5Puth1gv1ZQI98 Oct 22 20:49:46.148012 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 20:49:46.148012 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 20:49:46.148012 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 20:49:46.148012 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 20:49:46.148012 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 20:49:46.148012 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 20:49:46.148012 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: fb9e30f3a4524c5791d2800ab3d57f01 Oct 22 20:49:46.148012 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1234248089 Oct 22 20:49:46.148012 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 20:49:46.148012 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 20:49:46.148012 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_fb9e30f3a4524c5791d2800ab3d57f01"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fb9e30f3a4524c5791d2800ab3d57f01"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/fb9e30f3a4524c5791d2800ab3d57f01"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fb9e30f3a4524c5791d2800ab3d57f01"}]}] Oct 22 20:49:46.148012 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1234248089 Oct 22 20:49:46.148012 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: fb9e30f3a4524c5791d2800ab3d57f01 Oct 22 20:49:46.148012 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1234248089 Oct 22 20:49:46.148012 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-HostsAdminNegativeTestJSON-1234248089-project Oct 22 20:49:46.148012 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 20:49:46.148012 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 20:49:46.148012 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: e11e87ee2762492c9584751daf4ceecf Oct 22 20:49:46.148012 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1234248089-project Oct 22 20:49:46.148012 ncdv-master-1 devstack@n-api.service[138744]: Oct 22 20:49:46.148012 ncdv-master-1 devstack@n-api.service[138744]: {"status": "enable", "maintenance_mode": "enable"} Oct 22 20:49:46.148012 ncdv-master-1 devstack@n-api.service[138744]: method: Oct 22 20:49:46.148012 ncdv-master-1 devstack@n-api.service[138744]: exception: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Oct 22 20:49:46.148012 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': 'ncdv-master-1', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Oct 22 20:49:46.148012 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:49:46.148012 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:49:46.148012 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:49:46.148012 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:49:46.148012 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:49:46.148012 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:49:46.148012 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 22 20:49:46.148012 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 22 20:49:46.148012 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:49:46.148012 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:49:46.148012 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 20:49:46.148012 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 20:49:46.148012 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 112, in update Oct 22 20:49:46.148012 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'update', Oct 22 20:49:46.148012 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 22 20:49:46.148012 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 22 20:49:46.148012 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 22 20:49:46.148012 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 22 20:49:46.148012 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 22 20:49:46.148012 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 22 20:49:46.148012 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 22 20:49:46.148012 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise self.value Oct 22 20:49:46.148012 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 22 20:49:46.148012 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 22 20:49:46.148012 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 22 20:49:46.148012 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 22 20:49:46.148012 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 22 20:49:46.148012 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 22 20:49:46.148012 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Oct 22 20:49:46.148012 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:49:46.161475 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:49:46.161475 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:49:46.161475 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:49:46.161475 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:49:46.161475 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:49:46.161475 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 22 20:49:46.161475 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 22 20:49:46.161475 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Oct 22 20:49:46.161475 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:49:46.161475 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-96d336f6-6318-4485-a13c-542e155b7159 tempest-HostsAdminNegativeTestJSON-1234248089 tempest-HostsAdminNegativeTestJSON-1234248089-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:update to be performed. {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:49:46.161475 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-96d336f6-6318-4485-a13c-542e155b7159 tempest-HostsAdminNegativeTestJSON-1234248089 tempest-HostsAdminNegativeTestJSON-1234248089-project] 10.222.0.18 "PUT /compute/v2.1/os-hosts/ncdv-master-1" status: 403 len: 111 microversion: 2.1 time: 0.026173 Oct 22 20:49:46.161475 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 194/451] 10.222.0.18 () {60 vars in 1190 bytes} [Sat Oct 22 20:49:46 2022] PUT /compute/v2.1/os-hosts/ncdv-master-1 => generated 111 bytes in 27 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 22 20:49:46.163760 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-30959b70-2408-4e52-9f3f-9d899c1ea8a4 tempest-HostsAdminNegativeTestJSON-97806701 tempest-HostsAdminNegativeTestJSON-97806701-project-admin] Action: 'update', calling method: .version_select at 0x7fd3a47e60d0>, body: {"status": null, "maintenance_mode": null} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:49:46.168060 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-30959b70-2408-4e52-9f3f-9d899c1ea8a4 tempest-HostsAdminNegativeTestJSON-97806701 tempest-HostsAdminNegativeTestJSON-97806701-project-admin] Request method failure captured: Oct 22 20:49:46.168060 ncdv-master-1 devstack@n-api.service[138745]: request: PUT /compute/v2.1/os-hosts/ncdv-master-1 HTTP/1.1 Oct 22 20:49:46.168060 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 20:49:46.168060 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 20:49:46.168060 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 20:49:46.168060 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 42 Oct 22 20:49:46.168060 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 20:49:46.168060 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 20:49:46.168060 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 20:49:46.168060 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 20:49:46.168060 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVFdnG0mvA-xneruW_U3tDX2ZeJqEN162TjCXFuW9ejtnEfNSL1sQYtSpF-nvUP4a2mD3RD8Em5YOYIdT37MKf12mO_gwTTMGp26I33EdDpuefl2G3Ij234bx80BliCn0RvchRslD8mLm19UDF1gCHhsXhUtoVQuTTH3jILvnw85W4Sk Oct 22 20:49:46.168060 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 20:49:46.168060 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 20:49:46.168060 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 20:49:46.168060 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 20:49:46.168060 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 20:49:46.168060 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 20:49:46.168060 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: 40f85a41d53644978201cd0c2412ff4d Oct 22 20:49:46.168060 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-97806701 Oct 22 20:49:46.168060 ncdv-master-1 devstack@n-api.service[138745]: X-Role: admin,member,reader Oct 22 20:49:46.168060 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: admin,member,reader Oct 22 20:49:46.168060 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_40f85a41d53644978201cd0c2412ff4d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/40f85a41d53644978201cd0c2412ff4d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/40f85a41d53644978201cd0c2412ff4d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/40f85a41d53644978201cd0c2412ff4d"}]}] Oct 22 20:49:46.168060 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-HostsAdminNegativeTestJSON-97806701 Oct 22 20:49:46.168060 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: 40f85a41d53644978201cd0c2412ff4d Oct 22 20:49:46.168060 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-97806701 Oct 22 20:49:46.168060 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-HostsAdminNegativeTestJSON-97806701-project-admin Oct 22 20:49:46.168060 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 20:49:46.168060 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 20:49:46.168060 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: e779477b41254c86bac9458a7b0694a7 Oct 22 20:49:46.168060 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-HostsAdminNegativeTestJSON-97806701-project-admin Oct 22 20:49:46.168060 ncdv-master-1 devstack@n-api.service[138745]: Oct 22 20:49:46.168060 ncdv-master-1 devstack@n-api.service[138745]: {"status": null, "maintenance_mode": null} Oct 22 20:49:46.168060 ncdv-master-1 devstack@n-api.service[138745]: method: Oct 22 20:49:46.168060 ncdv-master-1 devstack@n-api.service[138745]: exception: Invalid input for field/attribute status. Value: None. None is not of type 'string' Oct 22 20:49:46.168060 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'id': 'ncdv-master-1', 'body': {'status': None, 'maintenance_mode': None}} Oct 22 20:49:46.168060 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:49:46.168060 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:49:46.168060 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 22 20:49:46.168060 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 22 20:49:46.168060 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 22 20:49:46.168060 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise error Oct 22 20:49:46.168060 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: None is not of type 'string' Oct 22 20:49:46.168060 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:49:46.168060 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['status']: Oct 22 20:49:46.168060 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Oct 22 20:49:46.168060 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi 'disable', Oct 22 20:49:46.168060 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi 'Enable', Oct 22 20:49:46.168060 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi 'Disable', Oct 22 20:49:46.168060 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi 'ENABLE', Oct 22 20:49:46.168060 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi 'DISABLE'], Oct 22 20:49:46.168060 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 22 20:49:46.168060 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:49:46.168060 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi On instance: Oct 22 20:49:46.168060 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi None Oct 22 20:49:46.168060 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:49:46.168060 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:49:46.168060 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:49:46.168060 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:49:46.168060 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:49:46.168060 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:49:46.168060 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:49:46.168060 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:49:46.168060 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 22 20:49:46.168060 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 22 20:49:46.168060 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:49:46.168060 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:49:46.168060 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 22 20:49:46.168060 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 22 20:49:46.168060 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 22 20:49:46.168060 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 22 20:49:46.172250 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 22 20:49:46.172250 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 22 20:49:46.172250 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: None. None is not of type 'string' Oct 22 20:49:46.172250 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:49:46.172250 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:49:46.172250 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:49:46.172250 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:49:46.172250 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:49:46.172250 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:49:46.172250 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 22 20:49:46.172250 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 22 20:49:46.172250 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: None. None is not of type 'string' Oct 22 20:49:46.172250 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:49:46.178698 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-30959b70-2408-4e52-9f3f-9d899c1ea8a4 tempest-HostsAdminNegativeTestJSON-97806701 tempest-HostsAdminNegativeTestJSON-97806701-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: None. None is not of type 'string' {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:49:46.180489 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-30959b70-2408-4e52-9f3f-9d899c1ea8a4 tempest-HostsAdminNegativeTestJSON-97806701 tempest-HostsAdminNegativeTestJSON-97806701-project-admin] 10.222.0.18 "PUT /compute/v2.1/os-hosts/ncdv-master-1" status: 400 len: 127 microversion: 2.1 time: 0.021267 Oct 22 20:49:46.182949 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 258/452] 10.222.0.18 () {60 vars in 1190 bytes} [Sat Oct 22 20:49:46 2022] PUT /compute/v2.1/os-hosts/ncdv-master-1 => generated 127 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 22 20:49:46.192854 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-c8f03973-aace-4653-9c16-3a95003d2bd8 tempest-HostsAdminNegativeTestJSON-97806701 tempest-HostsAdminNegativeTestJSON-97806701-project-admin] Action: 'update', calling method: .version_select at 0x7fd3a47b7820>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:49:46.196337 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.hosts [None req-c8f03973-aace-4653-9c16-3a95003d2bd8 tempest-HostsAdminNegativeTestJSON-97806701 tempest-HostsAdminNegativeTestJSON-97806701-project-admin] Enabling host nonexistent_hostname. Oct 22 20:49:46.225340 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-c8f03973-aace-4653-9c16-3a95003d2bd8 tempest-HostsAdminNegativeTestJSON-97806701 tempest-HostsAdminNegativeTestJSON-97806701-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 22 20:49:46.235199 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-c8f03973-aace-4653-9c16-3a95003d2bd8 tempest-HostsAdminNegativeTestJSON-97806701 tempest-HostsAdminNegativeTestJSON-97806701-project-admin] Request method failure captured: Oct 22 20:49:46.235199 ncdv-master-1 devstack@n-api.service[138744]: request: PUT /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Oct 22 20:49:46.235199 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 20:49:46.235199 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 20:49:46.235199 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 20:49:46.235199 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 50 Oct 22 20:49:46.235199 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 20:49:46.235199 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 20:49:46.235199 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 20:49:46.235199 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 20:49:46.235199 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVFdnG0mvA-xneruW_U3tDX2ZeJqEN162TjCXFuW9ejtnEfNSL1sQYtSpF-nvUP4a2mD3RD8Em5YOYIdT37MKf12mO_gwTTMGp26I33EdDpuefl2G3Ij234bx80BliCn0RvchRslD8mLm19UDF1gCHhsXhUtoVQuTTH3jILvnw85W4Sk Oct 22 20:49:46.235199 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 20:49:46.235199 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 20:49:46.235199 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 20:49:46.235199 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 20:49:46.235199 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 20:49:46.235199 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 20:49:46.235199 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: 40f85a41d53644978201cd0c2412ff4d Oct 22 20:49:46.235199 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-97806701 Oct 22 20:49:46.235199 ncdv-master-1 devstack@n-api.service[138744]: X-Role: admin,member,reader Oct 22 20:49:46.235199 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: admin,member,reader Oct 22 20:49:46.235199 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_40f85a41d53644978201cd0c2412ff4d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/40f85a41d53644978201cd0c2412ff4d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/40f85a41d53644978201cd0c2412ff4d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/40f85a41d53644978201cd0c2412ff4d"}]}] Oct 22 20:49:46.235199 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-HostsAdminNegativeTestJSON-97806701 Oct 22 20:49:46.235199 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: 40f85a41d53644978201cd0c2412ff4d Oct 22 20:49:46.235199 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-97806701 Oct 22 20:49:46.235199 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-HostsAdminNegativeTestJSON-97806701-project-admin Oct 22 20:49:46.235199 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 20:49:46.235199 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 20:49:46.235199 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: e779477b41254c86bac9458a7b0694a7 Oct 22 20:49:46.235199 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-HostsAdminNegativeTestJSON-97806701-project-admin Oct 22 20:49:46.235199 ncdv-master-1 devstack@n-api.service[138744]: Oct 22 20:49:46.235199 ncdv-master-1 devstack@n-api.service[138744]: {"status": "enable", "maintenance_mode": "enable"} Oct 22 20:49:46.235199 ncdv-master-1 devstack@n-api.service[138744]: method: Oct 22 20:49:46.235199 ncdv-master-1 devstack@n-api.service[138744]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 22 20:49:46.235199 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': 'nonexistent_hostname', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Oct 22 20:49:46.235199 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:49:46.235199 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:49:46.235199 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 159, in _set_enabled_status Oct 22 20:49:46.235199 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi result = self.api.set_host_enabled(context, host_name, enabled) Oct 22 20:49:46.235199 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 22 20:49:46.235199 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 22 20:49:46.235199 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 22 20:49:46.235199 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 22 20:49:46.235199 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 22 20:49:46.235199 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise self.value Oct 22 20:49:46.235199 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 22 20:49:46.235199 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 22 20:49:46.235199 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 22 20:49:46.235199 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 22 20:49:46.235199 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 22 20:49:46.235199 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 22 20:49:46.235199 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 22 20:49:46.235199 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 22 20:49:46.235199 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 22 20:49:46.235199 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 22 20:49:46.235199 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 22 20:49:46.235199 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 22 20:49:46.235199 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 22 20:49:46.235199 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:49:46.235199 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:49:46.235199 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:49:46.235199 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:49:46.235199 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:49:46.235199 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:49:46.241172 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:49:46.241172 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:49:46.241172 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 22 20:49:46.241172 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 22 20:49:46.241172 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:49:46.241172 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:49:46.241172 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 20:49:46.241172 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 20:49:46.241172 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 124, in update Oct 22 20:49:46.241172 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi result['status'] = self._set_enabled_status(context, id, status) Oct 22 20:49:46.241172 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 163, in _set_enabled_status Oct 22 20:49:46.241172 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 22 20:49:46.241172 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 22 20:49:46.241172 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:49:46.241172 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:49:46.241172 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:49:46.241172 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:49:46.241172 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:49:46.241172 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:49:46.241172 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 20:49:46.241172 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 20:49:46.241172 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 22 20:49:46.241172 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:49:46.241172 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-c8f03973-aace-4653-9c16-3a95003d2bd8 tempest-HostsAdminNegativeTestJSON-97806701 tempest-HostsAdminNegativeTestJSON-97806701-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:49:46.241172 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-c8f03973-aace-4653-9c16-3a95003d2bd8 tempest-HostsAdminNegativeTestJSON-97806701 tempest-HostsAdminNegativeTestJSON-97806701-project-admin] 10.222.0.18 "PUT /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.048029 Oct 22 20:49:46.241172 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 195/453] 10.222.0.18 () {60 vars in 1211 bytes} [Sat Oct 22 20:49:46 2022] PUT /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 22 20:49:46.730966 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-2d9c1ea5-4188-4612-9821-e04546abd052 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:49:46.732326 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-2d9c1ea5-4188-4612-9821-e04546abd052 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] [instance: 1d613848-05f4-478f-a569-b4c50576edb7] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:49:46.755051 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-e2014e7b-d7db-40c1-ae44-672e8fecfa5d tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:49:46.755831 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-e2014e7b-d7db-40c1-ae44-672e8fecfa5d tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] [instance: 5c3de24c-090d-4769-8975-207eb939b979] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:49:46.760791 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2d9c1ea5-4188-4612-9821-e04546abd052 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:46.761627 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2d9c1ea5-4188-4612-9821-e04546abd052 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:46.764252 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2d9c1ea5-4188-4612-9821-e04546abd052 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:46.774510 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2d9c1ea5-4188-4612-9821-e04546abd052 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:46.777941 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2d9c1ea5-4188-4612-9821-e04546abd052 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:46.779572 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2d9c1ea5-4188-4612-9821-e04546abd052 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:46.791779 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e2014e7b-d7db-40c1-ae44-672e8fecfa5d tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:46.792438 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e2014e7b-d7db-40c1-ae44-672e8fecfa5d tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:46.797231 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e2014e7b-d7db-40c1-ae44-672e8fecfa5d tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:46.799172 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e2014e7b-d7db-40c1-ae44-672e8fecfa5d tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:46.804799 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e2014e7b-d7db-40c1-ae44-672e8fecfa5d tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:46.808204 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e2014e7b-d7db-40c1-ae44-672e8fecfa5d tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:46.881486 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:49:47.146857 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.objects.instance [None req-e2014e7b-d7db-40c1-ae44-672e8fecfa5d tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] Lazy-loading 'services' on Instance uuid 5c3de24c-090d-4769-8975-207eb939b979 {{(pid=138744) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 20:49:47.252775 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-e2014e7b-d7db-40c1-ae44-672e8fecfa5d tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/5c3de24c-090d-4769-8975-207eb939b979" status: 200 len: 1927 microversion: 2.75 time: 0.502239 Oct 22 20:49:47.253398 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 196/454] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 20:49:46 2022] GET /compute/v2.1/servers/5c3de24c-090d-4769-8975-207eb939b979 => generated 1927 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 22 20:49:47.283769 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-43b0c654-59f4-4ca4-aaf0-bec9eaf33b0a req-cf007e35-4616-4558-ade6-f27a43a8256a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d613848-05f4-478f-a569-b4c50576edb7", "tag": "6bf75146-c298-478b-aee3-b0be607e5d87"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:49:47.324431 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-43b0c654-59f4-4ca4-aaf0-bec9eaf33b0a req-cf007e35-4616-4558-ade6-f27a43a8256a service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:47.327436 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-43b0c654-59f4-4ca4-aaf0-bec9eaf33b0a req-cf007e35-4616-4558-ade6-f27a43a8256a service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:47.329532 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-43b0c654-59f4-4ca4-aaf0-bec9eaf33b0a req-cf007e35-4616-4558-ade6-f27a43a8256a service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:47.360491 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-43b0c654-59f4-4ca4-aaf0-bec9eaf33b0a req-cf007e35-4616-4558-ade6-f27a43a8256a service nova] Creating event network-changed:6bf75146-c298-478b-aee3-b0be607e5d87 for instance 1d613848-05f4-478f-a569-b4c50576edb7 on nch2-master-1 Oct 22 20:49:47.364545 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-2d9c1ea5-4188-4612-9821-e04546abd052 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:49:47.375575 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-43b0c654-59f4-4ca4-aaf0-bec9eaf33b0a req-cf007e35-4616-4558-ade6-f27a43a8256a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118674 Oct 22 20:49:47.378143 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 197/455] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:49:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:49:47.383046 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-2d9c1ea5-4188-4612-9821-e04546abd052 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:49:47.392638 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-2d9c1ea5-4188-4612-9821-e04546abd052 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:49:47.406030 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-2d9c1ea5-4188-4612-9821-e04546abd052 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] 10.222.0.18 "GET /compute/v2.1/servers/1d613848-05f4-478f-a569-b4c50576edb7" status: 200 len: 1569 microversion: 2.25 time: 0.671957 Oct 22 20:49:47.406712 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 259/456] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 20:49:46 2022] GET /compute/v2.1/servers/1d613848-05f4-478f-a569-b4c50576edb7 => generated 1569 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 20:49:48.290835 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-b978fbd8-75af-4426-b790-4cb55b7eef45 tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:49:48.292808 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-b978fbd8-75af-4426-b790-4cb55b7eef45 tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] [instance: 5c3de24c-090d-4769-8975-207eb939b979] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:49:48.345697 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b978fbd8-75af-4426-b790-4cb55b7eef45 tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:48.346558 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b978fbd8-75af-4426-b790-4cb55b7eef45 tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:48.347026 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b978fbd8-75af-4426-b790-4cb55b7eef45 tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:48.351190 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b978fbd8-75af-4426-b790-4cb55b7eef45 tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:48.352338 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b978fbd8-75af-4426-b790-4cb55b7eef45 tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:48.360886 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b978fbd8-75af-4426-b790-4cb55b7eef45 tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:48.438713 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-71122045-9a7c-4fd2-ae8a-5e38b86c9ab9 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:49:48.439473 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-71122045-9a7c-4fd2-ae8a-5e38b86c9ab9 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] [instance: 1d613848-05f4-478f-a569-b4c50576edb7] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:49:48.454440 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-71122045-9a7c-4fd2-ae8a-5e38b86c9ab9 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:48.461786 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-71122045-9a7c-4fd2-ae8a-5e38b86c9ab9 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:48.465726 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-71122045-9a7c-4fd2-ae8a-5e38b86c9ab9 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:48.469431 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-71122045-9a7c-4fd2-ae8a-5e38b86c9ab9 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:48.470136 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-71122045-9a7c-4fd2-ae8a-5e38b86c9ab9 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:48.473929 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-71122045-9a7c-4fd2-ae8a-5e38b86c9ab9 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:48.547760 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.objects.instance [None req-b978fbd8-75af-4426-b790-4cb55b7eef45 tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] Lazy-loading 'services' on Instance uuid 5c3de24c-090d-4769-8975-207eb939b979 {{(pid=138744) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 20:49:48.586465 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-b978fbd8-75af-4426-b790-4cb55b7eef45 tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/5c3de24c-090d-4769-8975-207eb939b979" status: 200 len: 1927 microversion: 2.75 time: 0.301227 Oct 22 20:49:48.590916 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 198/457] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 20:49:48 2022] GET /compute/v2.1/servers/5c3de24c-090d-4769-8975-207eb939b979 => generated 1927 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 22 20:49:49.018190 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-71122045-9a7c-4fd2-ae8a-5e38b86c9ab9 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:49:49.027383 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-71122045-9a7c-4fd2-ae8a-5e38b86c9ab9 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:49:49.035137 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-71122045-9a7c-4fd2-ae8a-5e38b86c9ab9 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:49:49.040395 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-71122045-9a7c-4fd2-ae8a-5e38b86c9ab9 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] 10.222.0.18 "GET /compute/v2.1/servers/1d613848-05f4-478f-a569-b4c50576edb7" status: 200 len: 1569 microversion: 2.25 time: 0.605816 Oct 22 20:49:49.041071 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 260/458] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 20:49:48 2022] GET /compute/v2.1/servers/1d613848-05f4-478f-a569-b4c50576edb7 => generated 1569 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 20:49:49.625222 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-a458897d-69e3-4bff-8ab6-44f558998474 tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:49:49.628174 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-a458897d-69e3-4bff-8ab6-44f558998474 tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] [instance: 5c3de24c-090d-4769-8975-207eb939b979] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:49:49.644815 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a458897d-69e3-4bff-8ab6-44f558998474 tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:49.645371 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a458897d-69e3-4bff-8ab6-44f558998474 tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:49.645818 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a458897d-69e3-4bff-8ab6-44f558998474 tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:49.646549 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a458897d-69e3-4bff-8ab6-44f558998474 tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:49.647013 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a458897d-69e3-4bff-8ab6-44f558998474 tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:49.647751 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a458897d-69e3-4bff-8ab6-44f558998474 tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:50.068615 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-f1904034-3d03-45bd-81df-a1327de60276 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:49:50.069950 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-f1904034-3d03-45bd-81df-a1327de60276 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] [instance: 1d613848-05f4-478f-a569-b4c50576edb7] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:49:50.084754 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f1904034-3d03-45bd-81df-a1327de60276 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:50.092506 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f1904034-3d03-45bd-81df-a1327de60276 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:50.093611 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f1904034-3d03-45bd-81df-a1327de60276 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:50.097359 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f1904034-3d03-45bd-81df-a1327de60276 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:50.098018 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.objects.instance [None req-a458897d-69e3-4bff-8ab6-44f558998474 tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] Lazy-loading 'services' on Instance uuid 5c3de24c-090d-4769-8975-207eb939b979 {{(pid=138744) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 20:49:50.100374 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f1904034-3d03-45bd-81df-a1327de60276 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:50.102428 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f1904034-3d03-45bd-81df-a1327de60276 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:50.214195 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-a458897d-69e3-4bff-8ab6-44f558998474 tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/5c3de24c-090d-4769-8975-207eb939b979" status: 200 len: 1927 microversion: 2.75 time: 0.597912 Oct 22 20:49:50.227779 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 199/459] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 20:49:49 2022] GET /compute/v2.1/servers/5c3de24c-090d-4769-8975-207eb939b979 => generated 1927 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 20:49:50.505694 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell0:SELECT=2 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:49:50.742202 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-f1904034-3d03-45bd-81df-a1327de60276 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:49:50.765569 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-f1904034-3d03-45bd-81df-a1327de60276 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:49:50.779222 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-f1904034-3d03-45bd-81df-a1327de60276 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:49:50.785683 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-f1904034-3d03-45bd-81df-a1327de60276 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] 10.222.0.18 "GET /compute/v2.1/servers/1d613848-05f4-478f-a569-b4c50576edb7" status: 200 len: 1569 microversion: 2.25 time: 0.719362 Oct 22 20:49:50.786935 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 261/460] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 20:49:50 2022] GET /compute/v2.1/servers/1d613848-05f4-478f-a569-b4c50576edb7 => generated 1569 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 20:49:51.248467 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-fea6b87c-67a8-4ce9-8ee6-8d21ea12b894 tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:49:51.249487 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-fea6b87c-67a8-4ce9-8ee6-8d21ea12b894 tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] [instance: 5c3de24c-090d-4769-8975-207eb939b979] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:49:51.262656 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fea6b87c-67a8-4ce9-8ee6-8d21ea12b894 tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:51.267811 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fea6b87c-67a8-4ce9-8ee6-8d21ea12b894 tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:51.269170 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fea6b87c-67a8-4ce9-8ee6-8d21ea12b894 tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:51.271234 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fea6b87c-67a8-4ce9-8ee6-8d21ea12b894 tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:51.272095 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fea6b87c-67a8-4ce9-8ee6-8d21ea12b894 tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:51.273627 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fea6b87c-67a8-4ce9-8ee6-8d21ea12b894 tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:51.456733 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.objects.instance [None req-fea6b87c-67a8-4ce9-8ee6-8d21ea12b894 tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] Lazy-loading 'services' on Instance uuid 5c3de24c-090d-4769-8975-207eb939b979 {{(pid=138744) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 20:49:51.498590 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:DELETE=3 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:49:51.503644 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-fea6b87c-67a8-4ce9-8ee6-8d21ea12b894 tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/5c3de24c-090d-4769-8975-207eb939b979" status: 200 len: 1927 microversion: 2.75 time: 0.258397 Oct 22 20:49:51.507016 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 200/461] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 20:49:51 2022] GET /compute/v2.1/servers/5c3de24c-090d-4769-8975-207eb939b979 => generated 1927 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 20:49:51.613936 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-dd99803f-4162-49a4-ab31-c13531b5ce1d tempest-FlavorMetadataValidation-2082911263 tempest-FlavorMetadataValidation-2082911263-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_validate_metadata_-45416292", "id": 2004096050, "os-flavor-access:is_public": "True"}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:49:51.671812 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-dd99803f-4162-49a4-ab31-c13531b5ce1d tempest-FlavorMetadataValidation-2082911263 tempest-FlavorMetadataValidation-2082911263-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 469 microversion: 2.86 time: 0.291118 Oct 22 20:49:51.682362 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 262/462] 10.222.0.18 () {62 vars in 1188 bytes} [Sat Oct 22 20:49:51 2022] POST /compute/v2.1/flavors => generated 469 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 22 20:49:51.696778 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-29ec7786-f670-40ca-93ef-99c0382c7bbb tempest-FlavorMetadataValidation-2082911263 tempest-FlavorMetadataValidation-2082911263-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:cpu_policy": "shared", "foo:bar": "baz"}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:49:51.814242 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-57170d90-54d4-428c-882b-16dd38d62544 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:49:51.815199 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-57170d90-54d4-428c-882b-16dd38d62544 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] [instance: 1d613848-05f4-478f-a569-b4c50576edb7] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:49:51.827443 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-57170d90-54d4-428c-882b-16dd38d62544 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:51.835176 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-57170d90-54d4-428c-882b-16dd38d62544 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:51.836018 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-57170d90-54d4-428c-882b-16dd38d62544 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:51.836992 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-57170d90-54d4-428c-882b-16dd38d62544 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:51.840238 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-57170d90-54d4-428c-882b-16dd38d62544 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:51.840931 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-57170d90-54d4-428c-882b-16dd38d62544 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:52.114519 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-29ec7786-f670-40ca-93ef-99c0382c7bbb tempest-FlavorMetadataValidation-2082911263 tempest-FlavorMetadataValidation-2082911263-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors/2004096050/os-extra_specs" status: 200 len: 62 microversion: 2.86 time: 0.417253 Oct 22 20:49:52.115118 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 201/463] 10.222.0.18 () {62 vars in 1265 bytes} [Sat Oct 22 20:49:51 2022] POST /compute/v2.1/flavors/2004096050/os-extra_specs => generated 62 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 20:49:52.126740 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-a62f25b0-5871-4796-b6ce-93389f4e4ca8 tempest-FlavorMetadataValidation-2082911263 tempest-FlavorMetadataValidation-2082911263-project-admin] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:49:52.162797 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-a62f25b0-5871-4796-b6ce-93389f4e4ca8 tempest-FlavorMetadataValidation-2082911263 tempest-FlavorMetadataValidation-2082911263-project-admin] 10.222.0.18 "DELETE /compute/v2.1/flavors/2004096050" status: 202 len: 0 microversion: 2.86 time: 0.041113 Oct 22 20:49:52.164348 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 202/464] 10.222.0.18 () {60 vars in 1202 bytes} [Sat Oct 22 20:49:52 2022] DELETE /compute/v2.1/flavors/2004096050 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 22 20:49:52.175525 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-cda33146-36ba-4381-866e-7f610cda2ce8 tempest-FlavorMetadataValidation-2082911263 tempest-FlavorMetadataValidation-2082911263-project-admin] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:49:52.228451 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-cda33146-36ba-4381-866e-7f610cda2ce8 tempest-FlavorMetadataValidation-2082911263 tempest-FlavorMetadataValidation-2082911263-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.86 time: 0.058503 Oct 22 20:49:52.233119 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 203/465] 10.222.0.18 () {60 vars in 1187 bytes} [Sat Oct 22 20:49:52 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 20:49:52.320179 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-57170d90-54d4-428c-882b-16dd38d62544 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:49:52.343186 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-57170d90-54d4-428c-882b-16dd38d62544 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:49:52.353250 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-57170d90-54d4-428c-882b-16dd38d62544 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:49:52.355010 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-57170d90-54d4-428c-882b-16dd38d62544 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] 10.222.0.18 "GET /compute/v2.1/servers/1d613848-05f4-478f-a569-b4c50576edb7" status: 200 len: 1569 microversion: 2.25 time: 0.544878 Oct 22 20:49:52.358446 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 263/466] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 20:49:51 2022] GET /compute/v2.1/servers/1d613848-05f4-478f-a569-b4c50576edb7 => generated 1569 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 22 20:49:52.537106 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-89dd1756-1ff2-488f-ad01-ec244418556e tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:49:52.537701 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-89dd1756-1ff2-488f-ad01-ec244418556e tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] [instance: 5c3de24c-090d-4769-8975-207eb939b979] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:49:52.547616 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell0:SELECT=4 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:49:52.551936 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-89dd1756-1ff2-488f-ad01-ec244418556e tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:52.553572 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-89dd1756-1ff2-488f-ad01-ec244418556e tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:52.554738 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-89dd1756-1ff2-488f-ad01-ec244418556e tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:52.557307 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-89dd1756-1ff2-488f-ad01-ec244418556e tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:52.559091 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-89dd1756-1ff2-488f-ad01-ec244418556e tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:52.559834 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-89dd1756-1ff2-488f-ad01-ec244418556e tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:52.777450 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.objects.instance [None req-89dd1756-1ff2-488f-ad01-ec244418556e tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] Lazy-loading 'services' on Instance uuid 5c3de24c-090d-4769-8975-207eb939b979 {{(pid=138744) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 20:49:52.818356 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-89dd1756-1ff2-488f-ad01-ec244418556e tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/5c3de24c-090d-4769-8975-207eb939b979" status: 200 len: 1927 microversion: 2.75 time: 0.285625 Oct 22 20:49:52.821752 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 204/467] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 20:49:52 2022] GET /compute/v2.1/servers/5c3de24c-090d-4769-8975-207eb939b979 => generated 1927 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 22 20:49:53.390733 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-0963b1a5-40f6-420a-b60d-5bb3ba6e02e1 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:49:53.392472 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-0963b1a5-40f6-420a-b60d-5bb3ba6e02e1 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] [instance: 1d613848-05f4-478f-a569-b4c50576edb7] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:49:53.421360 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0963b1a5-40f6-420a-b60d-5bb3ba6e02e1 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:53.424430 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0963b1a5-40f6-420a-b60d-5bb3ba6e02e1 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:53.425565 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0963b1a5-40f6-420a-b60d-5bb3ba6e02e1 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:53.426505 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0963b1a5-40f6-420a-b60d-5bb3ba6e02e1 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:53.427174 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0963b1a5-40f6-420a-b60d-5bb3ba6e02e1 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:53.428077 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0963b1a5-40f6-420a-b60d-5bb3ba6e02e1 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:53.853128 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-ffdca0d1-60a1-492e-a0d4-5dec1e2700fc tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:49:53.854543 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-ffdca0d1-60a1-492e-a0d4-5dec1e2700fc tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] [instance: 5c3de24c-090d-4769-8975-207eb939b979] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:49:53.873829 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ffdca0d1-60a1-492e-a0d4-5dec1e2700fc tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:53.877808 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ffdca0d1-60a1-492e-a0d4-5dec1e2700fc tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:53.879876 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ffdca0d1-60a1-492e-a0d4-5dec1e2700fc tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:53.885730 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ffdca0d1-60a1-492e-a0d4-5dec1e2700fc tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:53.886517 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ffdca0d1-60a1-492e-a0d4-5dec1e2700fc tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:53.887940 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ffdca0d1-60a1-492e-a0d4-5dec1e2700fc tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:54.301871 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell0:SELECT=11 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:49:54.316770 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.objects.instance [None req-ffdca0d1-60a1-492e-a0d4-5dec1e2700fc tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] Lazy-loading 'services' on Instance uuid 5c3de24c-090d-4769-8975-207eb939b979 {{(pid=138744) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 20:49:54.378926 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-0963b1a5-40f6-420a-b60d-5bb3ba6e02e1 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:49:54.494204 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-ffdca0d1-60a1-492e-a0d4-5dec1e2700fc tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/5c3de24c-090d-4769-8975-207eb939b979" status: 200 len: 1927 microversion: 2.75 time: 0.640602 Oct 22 20:49:54.499967 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 205/468] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 20:49:53 2022] GET /compute/v2.1/servers/5c3de24c-090d-4769-8975-207eb939b979 => generated 1927 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 20:49:54.502604 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-0963b1a5-40f6-420a-b60d-5bb3ba6e02e1 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:49:54.532510 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-0963b1a5-40f6-420a-b60d-5bb3ba6e02e1 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:49:54.543326 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-0963b1a5-40f6-420a-b60d-5bb3ba6e02e1 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] 10.222.0.18 "GET /compute/v2.1/servers/1d613848-05f4-478f-a569-b4c50576edb7" status: 200 len: 1569 microversion: 2.25 time: 1.159138 Oct 22 20:49:54.543961 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 264/469] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 20:49:53 2022] GET /compute/v2.1/servers/1d613848-05f4-478f-a569-b4c50576edb7 => generated 1569 bytes in 1161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 20:49:55.541012 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-e8216aa4-44ae-4a08-bbb6-85988ee3c395 tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:49:55.543182 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-e8216aa4-44ae-4a08-bbb6-85988ee3c395 tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] [instance: 5c3de24c-090d-4769-8975-207eb939b979] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:49:55.553231 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e8216aa4-44ae-4a08-bbb6-85988ee3c395 tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:55.554149 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e8216aa4-44ae-4a08-bbb6-85988ee3c395 tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:55.554943 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e8216aa4-44ae-4a08-bbb6-85988ee3c395 tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:55.556088 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e8216aa4-44ae-4a08-bbb6-85988ee3c395 tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:55.556781 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e8216aa4-44ae-4a08-bbb6-85988ee3c395 tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:55.557429 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e8216aa4-44ae-4a08-bbb6-85988ee3c395 tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:55.577145 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-442d91ec-e9a1-45dd-b0a3-6d8bbb86a14e tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:49:55.577890 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-442d91ec-e9a1-45dd-b0a3-6d8bbb86a14e tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] [instance: 1d613848-05f4-478f-a569-b4c50576edb7] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:49:55.592636 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-442d91ec-e9a1-45dd-b0a3-6d8bbb86a14e tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:55.593993 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-442d91ec-e9a1-45dd-b0a3-6d8bbb86a14e tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:55.594522 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-442d91ec-e9a1-45dd-b0a3-6d8bbb86a14e tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:55.596864 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-442d91ec-e9a1-45dd-b0a3-6d8bbb86a14e tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:55.600144 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-442d91ec-e9a1-45dd-b0a3-6d8bbb86a14e tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:55.600739 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-442d91ec-e9a1-45dd-b0a3-6d8bbb86a14e tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:55.853372 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.objects.instance [None req-e8216aa4-44ae-4a08-bbb6-85988ee3c395 tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] Lazy-loading 'services' on Instance uuid 5c3de24c-090d-4769-8975-207eb939b979 {{(pid=138744) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 20:49:55.929097 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-e8216aa4-44ae-4a08-bbb6-85988ee3c395 tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/5c3de24c-090d-4769-8975-207eb939b979" status: 200 len: 1927 microversion: 2.75 time: 0.403779 Oct 22 20:49:55.934040 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 206/470] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 20:49:55 2022] GET /compute/v2.1/servers/5c3de24c-090d-4769-8975-207eb939b979 => generated 1927 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 20:49:56.912054 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-442d91ec-e9a1-45dd-b0a3-6d8bbb86a14e tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:49:56.945774 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-442d91ec-e9a1-45dd-b0a3-6d8bbb86a14e tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:49:56.956883 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-442d91ec-e9a1-45dd-b0a3-6d8bbb86a14e tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:49:56.958548 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-442d91ec-e9a1-45dd-b0a3-6d8bbb86a14e tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] 10.222.0.18 "GET /compute/v2.1/servers/1d613848-05f4-478f-a569-b4c50576edb7" status: 200 len: 1569 microversion: 2.25 time: 1.388724 Oct 22 20:49:56.962324 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-c08ace7b-8946-4037-92be-da47af67a8a9 tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:49:56.963168 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-c08ace7b-8946-4037-92be-da47af67a8a9 tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] [instance: 5c3de24c-090d-4769-8975-207eb939b979] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:49:56.968174 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 265/471] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 20:49:55 2022] GET /compute/v2.1/servers/1d613848-05f4-478f-a569-b4c50576edb7 => generated 1569 bytes in 1399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 20:49:56.987226 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c08ace7b-8946-4037-92be-da47af67a8a9 tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:56.991705 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c08ace7b-8946-4037-92be-da47af67a8a9 tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:56.992324 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c08ace7b-8946-4037-92be-da47af67a8a9 tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:56.994060 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c08ace7b-8946-4037-92be-da47af67a8a9 tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:56.994958 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c08ace7b-8946-4037-92be-da47af67a8a9 tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:56.995668 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c08ace7b-8946-4037-92be-da47af67a8a9 tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:57.350242 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.objects.instance [None req-c08ace7b-8946-4037-92be-da47af67a8a9 tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] Lazy-loading 'services' on Instance uuid 5c3de24c-090d-4769-8975-207eb939b979 {{(pid=138744) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 20:49:57.389211 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-c08ace7b-8946-4037-92be-da47af67a8a9 tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/5c3de24c-090d-4769-8975-207eb939b979" status: 200 len: 1927 microversion: 2.75 time: 0.430567 Oct 22 20:49:57.391800 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 207/472] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 20:49:56 2022] GET /compute/v2.1/servers/5c3de24c-090d-4769-8975-207eb939b979 => generated 1927 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 22 20:49:57.993563 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-dbd15fd7-0767-473d-a87b-8bbadd537620 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:49:57.994235 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-dbd15fd7-0767-473d-a87b-8bbadd537620 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] [instance: 1d613848-05f4-478f-a569-b4c50576edb7] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:49:58.022816 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-dbd15fd7-0767-473d-a87b-8bbadd537620 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:58.023232 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-dbd15fd7-0767-473d-a87b-8bbadd537620 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:58.023704 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-dbd15fd7-0767-473d-a87b-8bbadd537620 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:58.031539 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-dbd15fd7-0767-473d-a87b-8bbadd537620 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:58.032260 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-dbd15fd7-0767-473d-a87b-8bbadd537620 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:58.035749 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-dbd15fd7-0767-473d-a87b-8bbadd537620 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:58.427717 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-f6057668-2fbd-46ef-9f0e-dfac54f71e63 tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:49:58.432469 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-f6057668-2fbd-46ef-9f0e-dfac54f71e63 tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] [instance: 5c3de24c-090d-4769-8975-207eb939b979] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:49:58.448350 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f6057668-2fbd-46ef-9f0e-dfac54f71e63 tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:58.450182 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f6057668-2fbd-46ef-9f0e-dfac54f71e63 tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:58.451411 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f6057668-2fbd-46ef-9f0e-dfac54f71e63 tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:58.452404 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f6057668-2fbd-46ef-9f0e-dfac54f71e63 tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:58.453092 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f6057668-2fbd-46ef-9f0e-dfac54f71e63 tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:58.453874 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f6057668-2fbd-46ef-9f0e-dfac54f71e63 tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:58.769027 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.objects.instance [None req-f6057668-2fbd-46ef-9f0e-dfac54f71e63 tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] Lazy-loading 'services' on Instance uuid 5c3de24c-090d-4769-8975-207eb939b979 {{(pid=138744) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 20:49:58.800271 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-f6057668-2fbd-46ef-9f0e-dfac54f71e63 tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/5c3de24c-090d-4769-8975-207eb939b979" status: 200 len: 1927 microversion: 2.75 time: 0.379956 Oct 22 20:49:58.823765 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 208/473] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 20:49:58 2022] GET /compute/v2.1/servers/5c3de24c-090d-4769-8975-207eb939b979 => generated 1927 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 20:49:59.274100 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-dbd15fd7-0767-473d-a87b-8bbadd537620 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:49:59.285949 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-dbd15fd7-0767-473d-a87b-8bbadd537620 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:49:59.288962 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-dbd15fd7-0767-473d-a87b-8bbadd537620 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:49:59.292704 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-dbd15fd7-0767-473d-a87b-8bbadd537620 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] 10.222.0.18 "GET /compute/v2.1/servers/1d613848-05f4-478f-a569-b4c50576edb7" status: 200 len: 1569 microversion: 2.25 time: 1.303704 Oct 22 20:49:59.293370 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 266/474] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 20:49:57 2022] GET /compute/v2.1/servers/1d613848-05f4-478f-a569-b4c50576edb7 => generated 1569 bytes in 1305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 20:49:59.837466 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-98755f0d-deaa-4b52-9669-5b9a1d0af5ce tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:49:59.846285 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-98755f0d-deaa-4b52-9669-5b9a1d0af5ce tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] [instance: 5c3de24c-090d-4769-8975-207eb939b979] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:49:59.861457 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-98755f0d-deaa-4b52-9669-5b9a1d0af5ce tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:59.867737 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-98755f0d-deaa-4b52-9669-5b9a1d0af5ce tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:59.868580 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-98755f0d-deaa-4b52-9669-5b9a1d0af5ce tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:49:59.869557 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-98755f0d-deaa-4b52-9669-5b9a1d0af5ce tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:49:59.870696 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-98755f0d-deaa-4b52-9669-5b9a1d0af5ce tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:49:59.871521 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-98755f0d-deaa-4b52-9669-5b9a1d0af5ce tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:50:00.322483 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-c0004875-0416-4b61-a47c-a2929d7dffac tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:50:00.323235 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-c0004875-0416-4b61-a47c-a2929d7dffac tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] [instance: 1d613848-05f4-478f-a569-b4c50576edb7] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:50:00.333325 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c0004875-0416-4b61-a47c-a2929d7dffac tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:50:00.333829 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c0004875-0416-4b61-a47c-a2929d7dffac tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:50:00.334286 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c0004875-0416-4b61-a47c-a2929d7dffac tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:50:00.344429 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c0004875-0416-4b61-a47c-a2929d7dffac tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:50:00.344939 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c0004875-0416-4b61-a47c-a2929d7dffac tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:50:00.345462 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c0004875-0416-4b61-a47c-a2929d7dffac tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:50:00.915781 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.objects.instance [None req-98755f0d-deaa-4b52-9669-5b9a1d0af5ce tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] Lazy-loading 'services' on Instance uuid 5c3de24c-090d-4769-8975-207eb939b979 {{(pid=138744) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 20:50:00.986114 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-98755f0d-deaa-4b52-9669-5b9a1d0af5ce tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/5c3de24c-090d-4769-8975-207eb939b979" status: 200 len: 1927 microversion: 2.75 time: 1.149131 Oct 22 20:50:00.990301 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 209/475] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 20:49:59 2022] GET /compute/v2.1/servers/5c3de24c-090d-4769-8975-207eb939b979 => generated 1927 bytes in 1159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 22 20:50:01.193845 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-c0004875-0416-4b61-a47c-a2929d7dffac tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:50:01.205144 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-c0004875-0416-4b61-a47c-a2929d7dffac tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:50:01.206837 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-c0004875-0416-4b61-a47c-a2929d7dffac tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:50:01.214567 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-c0004875-0416-4b61-a47c-a2929d7dffac tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] 10.222.0.18 "GET /compute/v2.1/servers/1d613848-05f4-478f-a569-b4c50576edb7" status: 200 len: 1569 microversion: 2.25 time: 0.893220 Oct 22 20:50:01.217487 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 267/476] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 20:50:00 2022] GET /compute/v2.1/servers/1d613848-05f4-478f-a569-b4c50576edb7 => generated 1569 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 20:50:02.019475 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-7168ae5a-e707-49ee-aa48-e321c5bde67f tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:50:02.020818 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-7168ae5a-e707-49ee-aa48-e321c5bde67f tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] [instance: 5c3de24c-090d-4769-8975-207eb939b979] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:50:02.041545 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7168ae5a-e707-49ee-aa48-e321c5bde67f tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:50:02.044031 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7168ae5a-e707-49ee-aa48-e321c5bde67f tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:50:02.044724 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7168ae5a-e707-49ee-aa48-e321c5bde67f tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:50:02.046467 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7168ae5a-e707-49ee-aa48-e321c5bde67f tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:50:02.049990 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7168ae5a-e707-49ee-aa48-e321c5bde67f tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:50:02.053614 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7168ae5a-e707-49ee-aa48-e321c5bde67f tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:50:02.229784 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.objects.instance [None req-7168ae5a-e707-49ee-aa48-e321c5bde67f tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] Lazy-loading 'services' on Instance uuid 5c3de24c-090d-4769-8975-207eb939b979 {{(pid=138744) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 20:50:02.249339 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-4c5b8a4a-16f9-4e9e-89fa-0f837adca9fd tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:50:02.250102 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-4c5b8a4a-16f9-4e9e-89fa-0f837adca9fd tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] [instance: 1d613848-05f4-478f-a569-b4c50576edb7] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:50:02.262046 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4c5b8a4a-16f9-4e9e-89fa-0f837adca9fd tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:50:02.266904 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4c5b8a4a-16f9-4e9e-89fa-0f837adca9fd tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:50:02.270077 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4c5b8a4a-16f9-4e9e-89fa-0f837adca9fd tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:50:02.272069 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4c5b8a4a-16f9-4e9e-89fa-0f837adca9fd tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:50:02.275917 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-7168ae5a-e707-49ee-aa48-e321c5bde67f tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/5c3de24c-090d-4769-8975-207eb939b979" status: 200 len: 1933 microversion: 2.75 time: 0.261488 Oct 22 20:50:02.276088 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4c5b8a4a-16f9-4e9e-89fa-0f837adca9fd tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:50:02.286387 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4c5b8a4a-16f9-4e9e-89fa-0f837adca9fd tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:50:02.303254 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 210/477] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 20:50:02 2022] GET /compute/v2.1/servers/5c3de24c-090d-4769-8975-207eb939b979 => generated 1933 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 20:50:02.667033 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-4c5b8a4a-16f9-4e9e-89fa-0f837adca9fd tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:50:02.688436 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-4c5b8a4a-16f9-4e9e-89fa-0f837adca9fd tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:50:02.696259 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-4c5b8a4a-16f9-4e9e-89fa-0f837adca9fd tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:50:02.697689 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-4c5b8a4a-16f9-4e9e-89fa-0f837adca9fd tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] 10.222.0.18 "GET /compute/v2.1/servers/1d613848-05f4-478f-a569-b4c50576edb7" status: 200 len: 1569 microversion: 2.25 time: 0.457156 Oct 22 20:50:02.701182 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 268/478] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 20:50:02 2022] GET /compute/v2.1/servers/1d613848-05f4-478f-a569-b4c50576edb7 => generated 1569 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 20:50:03.214171 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-ecc0aa40-d134-43e1-81b6-8fc7545715b9 tempest-FlavorsV255TestJSON-986274832 tempest-FlavorsV255TestJSON-986274832-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV255TestJSON-flavor-34779769", "id": 672037137, "os-flavor-access:is_public": "True"}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:50:03.308304 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-ceacf35b-3e94-4591-b8ac-2cc21481702e tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:50:03.311974 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-ceacf35b-3e94-4591-b8ac-2cc21481702e tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] [instance: 5c3de24c-090d-4769-8975-207eb939b979] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:50:03.327616 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ceacf35b-3e94-4591-b8ac-2cc21481702e tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:50:03.328671 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-ecc0aa40-d134-43e1-81b6-8fc7545715b9 tempest-FlavorsV255TestJSON-986274832 tempest-FlavorsV255TestJSON-986274832-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 444 microversion: 2.55 time: 0.385119 Oct 22 20:50:03.329373 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ceacf35b-3e94-4591-b8ac-2cc21481702e tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:50:03.330097 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ceacf35b-3e94-4591-b8ac-2cc21481702e tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:50:03.331399 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 211/479] 10.222.0.18 () {62 vars in 1188 bytes} [Sat Oct 22 20:50:02 2022] POST /compute/v2.1/flavors => generated 444 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 22 20:50:03.332106 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ceacf35b-3e94-4591-b8ac-2cc21481702e tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:50:03.335276 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ceacf35b-3e94-4591-b8ac-2cc21481702e tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:50:03.335833 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ceacf35b-3e94-4591-b8ac-2cc21481702e tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:50:03.559146 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.objects.instance [None req-ceacf35b-3e94-4591-b8ac-2cc21481702e tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] Lazy-loading 'services' on Instance uuid 5c3de24c-090d-4769-8975-207eb939b979 {{(pid=138745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 20:50:03.610158 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-ceacf35b-3e94-4591-b8ac-2cc21481702e tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/5c3de24c-090d-4769-8975-207eb939b979" status: 200 len: 1933 microversion: 2.75 time: 0.306256 Oct 22 20:50:03.614615 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 269/480] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 20:50:03 2022] GET /compute/v2.1/servers/5c3de24c-090d-4769-8975-207eb939b979 => generated 1933 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 20:50:03.620483 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-da27018f-efc8-4ac9-ae74-946c7f83a1c9 tempest-FlavorsV255TestJSON-960872339 tempest-FlavorsV255TestJSON-960872339-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:50:03.635580 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-da27018f-efc8-4ac9-ae74-946c7f83a1c9 tempest-FlavorsV255TestJSON-960872339 tempest-FlavorsV255TestJSON-960872339-project] 10.222.0.18 "GET /compute/v2.1/flavors/672037137" status: 200 len: 444 microversion: 2.55 time: 0.294570 Oct 22 20:50:03.636882 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 212/481] 10.222.0.18 () {60 vars in 1196 bytes} [Sat Oct 22 20:50:03 2022] GET /compute/v2.1/flavors/672037137 => generated 444 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 22 20:50:03.650872 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-4d60d3f3-bae4-4dce-ac09-7aadafc723b5 tempest-FlavorsV255TestJSON-986274832 tempest-FlavorsV255TestJSON-986274832-project-admin] Action: 'update', calling method: , body: {"flavor": {"description": "new"}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:50:03.712532 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-4d60d3f3-bae4-4dce-ac09-7aadafc723b5 tempest-FlavorsV255TestJSON-986274832 tempest-FlavorsV255TestJSON-986274832-project-admin] 10.222.0.18 "PUT /compute/v2.1/flavors/672037137" status: 200 len: 445 microversion: 2.55 time: 0.066154 Oct 22 20:50:03.713762 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 270/482] 10.222.0.18 () {62 vars in 1216 bytes} [Sat Oct 22 20:50:03 2022] PUT /compute/v2.1/flavors/672037137 => generated 445 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 22 20:50:03.730976 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-8378387b-c678-4bab-abbb-6fa034bbef66 tempest-FlavorsV255TestJSON-960872339 tempest-FlavorsV255TestJSON-960872339-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:50:03.758129 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-edafe77a-f98f-4be0-a366-579522df4403 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:50:03.761246 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-edafe77a-f98f-4be0-a366-579522df4403 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] [instance: 1d613848-05f4-478f-a569-b4c50576edb7] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:50:03.793338 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-edafe77a-f98f-4be0-a366-579522df4403 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:50:03.795584 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-edafe77a-f98f-4be0-a366-579522df4403 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:50:03.796149 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-edafe77a-f98f-4be0-a366-579522df4403 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:50:03.800464 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-edafe77a-f98f-4be0-a366-579522df4403 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:50:03.801149 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-edafe77a-f98f-4be0-a366-579522df4403 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:50:03.807869 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-edafe77a-f98f-4be0-a366-579522df4403 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:50:03.812121 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-8378387b-c678-4bab-abbb-6fa034bbef66 tempest-FlavorsV255TestJSON-960872339 tempest-FlavorsV255TestJSON-960872339-project] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 5720 microversion: 2.55 time: 0.087255 Oct 22 20:50:03.824821 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 213/483] 10.222.0.18 () {60 vars in 1187 bytes} [Sat Oct 22 20:50:03 2022] GET /compute/v2.1/flavors/detail => generated 5720 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 20:50:03.844719 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-f640b197-7926-4ec7-9637-86670fda5d90 tempest-FlavorsV255TestJSON-960872339 tempest-FlavorsV255TestJSON-960872339-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:50:03.861867 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell1:SELECT=100 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:50:03.897734 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-f640b197-7926-4ec7-9637-86670fda5d90 tempest-FlavorsV255TestJSON-960872339 tempest-FlavorsV255TestJSON-960872339-project] 10.222.0.18 "GET /compute/v2.1/flavors" status: 200 len: 3152 microversion: 2.55 time: 0.059284 Oct 22 20:50:03.898411 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 214/484] 10.222.0.18 () {60 vars in 1166 bytes} [Sat Oct 22 20:50:03 2022] GET /compute/v2.1/flavors => generated 3152 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 20:50:03.920347 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-e76180fc-c03e-40b7-8066-aa4d96140ff8 tempest-FlavorsV255TestJSON-986274832 tempest-FlavorsV255TestJSON-986274832-project-admin] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:50:03.965003 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-e76180fc-c03e-40b7-8066-aa4d96140ff8 tempest-FlavorsV255TestJSON-986274832 tempest-FlavorsV255TestJSON-986274832-project-admin] 10.222.0.18 "DELETE /compute/v2.1/flavors/672037137" status: 202 len: 0 microversion: 2.55 time: 0.053039 Oct 22 20:50:03.965873 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 215/485] 10.222.0.18 () {60 vars in 1199 bytes} [Sat Oct 22 20:50:03 2022] DELETE /compute/v2.1/flavors/672037137 => generated 0 bytes in 55 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 22 20:50:03.974592 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-bdc5e42c-e181-4b65-aad1-ee2524ae1455 tempest-FlavorsV255TestJSON-986274832 tempest-FlavorsV255TestJSON-986274832-project-admin] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:50:04.001387 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-bdc5e42c-e181-4b65-aad1-ee2524ae1455 tempest-FlavorsV255TestJSON-986274832 tempest-FlavorsV255TestJSON-986274832-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 5285 microversion: 2.55 time: 0.031003 Oct 22 20:50:04.002248 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 216/486] 10.222.0.18 () {60 vars in 1187 bytes} [Sat Oct 22 20:50:03 2022] GET /compute/v2.1/flavors/detail => generated 5285 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 20:50:04.552504 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-edafe77a-f98f-4be0-a366-579522df4403 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:50:04.574102 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-edafe77a-f98f-4be0-a366-579522df4403 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:50:04.580228 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-edafe77a-f98f-4be0-a366-579522df4403 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:50:04.581775 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-edafe77a-f98f-4be0-a366-579522df4403 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] 10.222.0.18 "GET /compute/v2.1/servers/1d613848-05f4-478f-a569-b4c50576edb7" status: 200 len: 1569 microversion: 2.25 time: 0.842130 Oct 22 20:50:04.584283 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 271/487] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 20:50:03 2022] GET /compute/v2.1/servers/1d613848-05f4-478f-a569-b4c50576edb7 => generated 1569 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 20:50:04.645996 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-cbe3b202-96db-4b7a-85cf-49a60ffbd4d3 tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:50:04.651831 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-cbe3b202-96db-4b7a-85cf-49a60ffbd4d3 tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] [instance: 5c3de24c-090d-4769-8975-207eb939b979] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:50:04.688568 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cbe3b202-96db-4b7a-85cf-49a60ffbd4d3 tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:50:04.698486 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cbe3b202-96db-4b7a-85cf-49a60ffbd4d3 tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:50:04.698954 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cbe3b202-96db-4b7a-85cf-49a60ffbd4d3 tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:50:04.699751 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cbe3b202-96db-4b7a-85cf-49a60ffbd4d3 tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:50:04.700225 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cbe3b202-96db-4b7a-85cf-49a60ffbd4d3 tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:50:04.700659 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cbe3b202-96db-4b7a-85cf-49a60ffbd4d3 tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:50:05.048073 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.objects.instance [None req-cbe3b202-96db-4b7a-85cf-49a60ffbd4d3 tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] Lazy-loading 'services' on Instance uuid 5c3de24c-090d-4769-8975-207eb939b979 {{(pid=138744) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 20:50:05.123611 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-cbe3b202-96db-4b7a-85cf-49a60ffbd4d3 tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/5c3de24c-090d-4769-8975-207eb939b979" status: 200 len: 1933 microversion: 2.75 time: 0.481561 Oct 22 20:50:05.124198 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 217/488] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 20:50:04 2022] GET /compute/v2.1/servers/5c3de24c-090d-4769-8975-207eb939b979 => generated 1933 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 20:50:05.614798 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-1f45c1ec-e9ea-461b-87d0-f1c74c01ddb2 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:50:05.616069 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-1f45c1ec-e9ea-461b-87d0-f1c74c01ddb2 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] [instance: 1d613848-05f4-478f-a569-b4c50576edb7] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:50:05.629495 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1f45c1ec-e9ea-461b-87d0-f1c74c01ddb2 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:50:05.630267 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1f45c1ec-e9ea-461b-87d0-f1c74c01ddb2 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:50:05.630859 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1f45c1ec-e9ea-461b-87d0-f1c74c01ddb2 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:50:05.632446 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1f45c1ec-e9ea-461b-87d0-f1c74c01ddb2 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:50:05.638038 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1f45c1ec-e9ea-461b-87d0-f1c74c01ddb2 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:50:05.638737 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1f45c1ec-e9ea-461b-87d0-f1c74c01ddb2 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:50:06.002835 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-ca632186-e496-4f7f-902b-5b0c7d1b3f43 tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Action: 'create', calling method: .version_select at 0x7fd3a44ecf70>, body: {"keypair": {"name": "tempest-keypair-578928425", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIHWMk7eM9MANzaI/maCC40Y1A+3sSDlH6NJmJGB8YyBvT3PnJqwVf/ce9AGvIjcoTw3GItO2Ku2SchgIrQmw+aP46DYc/2PGBz9vcPcMsoo+fTHy1OjT04cg510xF980A=="}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:50:06.093762 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-ca632186-e496-4f7f-902b-5b0c7d1b3f43 tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Getting quotas for project 598f129979a34e7a856b83bd0e69f1b5. Resources: {'key_pairs'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 20:50:06.119777 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-ca632186-e496-4f7f-902b-5b0c7d1b3f43 tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Getting quotas for user 6da7143c3bfb46a7b193a8d96f1b75b2 and project 598f129979a34e7a856b83bd0e69f1b5. Resources: {'key_pairs'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 20:50:06.159399 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-1f45c1ec-e9ea-461b-87d0-f1c74c01ddb2 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:50:06.177583 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-1f45c1ec-e9ea-461b-87d0-f1c74c01ddb2 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:50:06.186590 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-1f45c1ec-e9ea-461b-87d0-f1c74c01ddb2 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:50:06.189612 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-1f45c1ec-e9ea-461b-87d0-f1c74c01ddb2 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] 10.222.0.18 "GET /compute/v2.1/servers/1d613848-05f4-478f-a569-b4c50576edb7" status: 200 len: 1559 microversion: 2.25 time: 0.577924 Oct 22 20:50:06.190228 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 272/489] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 20:50:05 2022] GET /compute/v2.1/servers/1d613848-05f4-478f-a569-b4c50576edb7 => generated 1559 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 20:50:06.208431 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-303eb7c5-093f-4733-b4c9-4c00ad13b193 tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:50:06.209126 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-303eb7c5-093f-4733-b4c9-4c00ad13b193 tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] [instance: 5c3de24c-090d-4769-8975-207eb939b979] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:50:06.230719 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-303eb7c5-093f-4733-b4c9-4c00ad13b193 tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:50:06.236545 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-303eb7c5-093f-4733-b4c9-4c00ad13b193 tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:50:06.237445 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-303eb7c5-093f-4733-b4c9-4c00ad13b193 tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:50:06.243680 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-303eb7c5-093f-4733-b4c9-4c00ad13b193 tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:50:06.244646 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-303eb7c5-093f-4733-b4c9-4c00ad13b193 tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:50:06.246128 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-303eb7c5-093f-4733-b4c9-4c00ad13b193 tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:50:06.247477 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-ca632186-e496-4f7f-902b-5b0c7d1b3f43 tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.553799 Oct 22 20:50:06.255310 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 218/490] 10.222.0.18 () {60 vars in 1159 bytes} [Sat Oct 22 20:50:05 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:50:06.267762 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-3a02b3f5-ebef-4732-b866-a365f2f522f6 tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] Calling method '.version_select at 0x7fd3a4560f70>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:50:06.289906 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3a02b3f5-ebef-4732-b866-a365f2f522f6 tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:50:06.290728 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3a02b3f5-ebef-4732-b866-a365f2f522f6 tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:50:06.293682 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3a02b3f5-ebef-4732-b866-a365f2f522f6 tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:50:06.361021 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-3a02b3f5-ebef-4732-b866-a365f2f522f6 tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] 10.222.0.18 "GET /compute/v2.1/os-migrations" status: 200 len: 680 microversion: 2.25 time: 0.095017 Oct 22 20:50:06.374028 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 219/491] 10.222.0.18 () {60 vars in 1184 bytes} [Sat Oct 22 20:50:06 2022] GET /compute/v2.1/os-migrations => generated 680 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 22 20:50:06.392394 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-ec5b9604-b5cb-47cd-baed-620ad992dd33 tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:50:06.395494 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-ec5b9604-b5cb-47cd-baed-620ad992dd33 tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] [instance: 1d613848-05f4-478f-a569-b4c50576edb7] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:50:06.421169 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ec5b9604-b5cb-47cd-baed-620ad992dd33 tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:50:06.427433 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ec5b9604-b5cb-47cd-baed-620ad992dd33 tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:50:06.427433 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ec5b9604-b5cb-47cd-baed-620ad992dd33 tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:50:06.442070 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ec5b9604-b5cb-47cd-baed-620ad992dd33 tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:50:06.445811 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ec5b9604-b5cb-47cd-baed-620ad992dd33 tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:50:06.458848 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ec5b9604-b5cb-47cd-baed-620ad992dd33 tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:50:06.560154 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:SELECT=100 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:50:06.784477 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.objects.instance [None req-303eb7c5-093f-4733-b4c9-4c00ad13b193 tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] Lazy-loading 'services' on Instance uuid 5c3de24c-090d-4769-8975-207eb939b979 {{(pid=138745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 20:50:06.848488 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-303eb7c5-093f-4733-b4c9-4c00ad13b193 tempest-ServersAdmin275Test-1257769615 tempest-ServersAdmin275Test-1257769615-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/5c3de24c-090d-4769-8975-207eb939b979" status: 200 len: 1918 microversion: 2.75 time: 0.653795 Oct 22 20:50:06.849767 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 273/492] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 20:50:06 2022] GET /compute/v2.1/servers/5c3de24c-090d-4769-8975-207eb939b979 => generated 1918 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 20:50:06.890748 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-5bca87a3-b244-4124-939d-d9b48ea8a29e tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:50:06.891564 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-5bca87a3-b244-4124-939d-d9b48ea8a29e tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] [instance: 5c3de24c-090d-4769-8975-207eb939b979] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:50:06.900646 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5bca87a3-b244-4124-939d-d9b48ea8a29e tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:50:06.908161 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5bca87a3-b244-4124-939d-d9b48ea8a29e tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:50:06.908791 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5bca87a3-b244-4124-939d-d9b48ea8a29e tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:50:06.909724 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5bca87a3-b244-4124-939d-d9b48ea8a29e tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:50:06.910342 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5bca87a3-b244-4124-939d-d9b48ea8a29e tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:50:06.910922 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5bca87a3-b244-4124-939d-d9b48ea8a29e tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:50:06.964146 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-5bca87a3-b244-4124-939d-d9b48ea8a29e tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] [instance: 5c3de24c-090d-4769-8975-207eb939b979] Going to try to terminate instance {{(pid=138745) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 20:50:07.139093 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-5bca87a3-b244-4124-939d-d9b48ea8a29e tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] 10.222.0.18 "DELETE /compute/v2.1/servers/5c3de24c-090d-4769-8975-207eb939b979" status: 204 len: 0 microversion: 2.75 time: 0.253210 Oct 22 20:50:07.142518 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 274/493] 10.222.0.18 () {60 vars in 1280 bytes} [Sat Oct 22 20:50:06 2022] DELETE /compute/v2.1/servers/5c3de24c-090d-4769-8975-207eb939b979 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 22 20:50:07.156092 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-1a799e5e-53f5-411d-929d-5a942d1eba4a tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:50:07.159861 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-1a799e5e-53f5-411d-929d-5a942d1eba4a tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] [instance: 5c3de24c-090d-4769-8975-207eb939b979] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:50:07.174812 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1a799e5e-53f5-411d-929d-5a942d1eba4a tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:50:07.177895 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1a799e5e-53f5-411d-929d-5a942d1eba4a tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:50:07.180219 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1a799e5e-53f5-411d-929d-5a942d1eba4a tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:50:07.181176 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1a799e5e-53f5-411d-929d-5a942d1eba4a tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:50:07.181795 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1a799e5e-53f5-411d-929d-5a942d1eba4a tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:50:07.186061 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1a799e5e-53f5-411d-929d-5a942d1eba4a tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:50:07.301445 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.objects.instance [None req-ec5b9604-b5cb-47cd-baed-620ad992dd33 tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] Lazy-loading 'services' on Instance uuid 1d613848-05f4-478f-a569-b4c50576edb7 {{(pid=138744) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 20:50:07.364021 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-ec5b9604-b5cb-47cd-baed-620ad992dd33 tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/1d613848-05f4-478f-a569-b4c50576edb7" status: 200 len: 2052 microversion: 2.25 time: 0.988613 Oct 22 20:50:07.373702 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 220/494] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 20:50:06 2022] GET /compute/v2.1/servers/1d613848-05f4-478f-a569-b4c50576edb7 => generated 2052 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 20:50:07.386075 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-1a799e5e-53f5-411d-929d-5a942d1eba4a tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1ce98c66024d49b31e8e4f38b82838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a20f8f858424c89bf67a56feb720ac9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:50:07.412474 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-1a799e5e-53f5-411d-929d-5a942d1eba4a tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed1ce98c66024d49b31e8e4f38b82838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a20f8f858424c89bf67a56feb720ac9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:50:07.426264 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-1a799e5e-53f5-411d-929d-5a942d1eba4a tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed1ce98c66024d49b31e8e4f38b82838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a20f8f858424c89bf67a56feb720ac9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:50:07.448932 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-1a799e5e-53f5-411d-929d-5a942d1eba4a tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] 10.222.0.18 "GET /compute/v2.1/servers/5c3de24c-090d-4769-8975-207eb939b979" status: 200 len: 1443 microversion: 2.75 time: 0.301920 Oct 22 20:50:07.451838 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 275/495] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 20:50:07 2022] GET /compute/v2.1/servers/5c3de24c-090d-4769-8975-207eb939b979 => generated 1443 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 20:50:07.908976 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-5c909226-851b-474f-8af0-9f58358507c0 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-2117052611", "imageRef": "085e4478-6edc-4a69-8e08-f9831713eb65", "flavorRef": "452", "networks": [{"uuid": "03a467bd-c608-425f-8923-ff356110df6b"}]}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:50:08.086698 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.network.neutron [None req-5c909226-851b-474f-8af0-9f58358507c0 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] validate_networks() for [('03a467bd-c608-425f-8923-ff356110df6b', None, None, None, None, None)] {{(pid=138744) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 20:50:08.487328 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-25a28cb3-4f97-4111-8ea6-9691b3146421 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:50:08.488001 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-25a28cb3-4f97-4111-8ea6-9691b3146421 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] [instance: 5c3de24c-090d-4769-8975-207eb939b979] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:50:08.500972 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-25a28cb3-4f97-4111-8ea6-9691b3146421 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:50:08.507687 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-25a28cb3-4f97-4111-8ea6-9691b3146421 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:50:08.511276 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-25a28cb3-4f97-4111-8ea6-9691b3146421 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:50:08.517003 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-25a28cb3-4f97-4111-8ea6-9691b3146421 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:50:08.520248 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-25a28cb3-4f97-4111-8ea6-9691b3146421 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:50:08.521535 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-25a28cb3-4f97-4111-8ea6-9691b3146421 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:50:08.938980 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-25a28cb3-4f97-4111-8ea6-9691b3146421 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1ce98c66024d49b31e8e4f38b82838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a20f8f858424c89bf67a56feb720ac9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:50:08.959216 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-25a28cb3-4f97-4111-8ea6-9691b3146421 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed1ce98c66024d49b31e8e4f38b82838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a20f8f858424c89bf67a56feb720ac9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:50:08.961516 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-25a28cb3-4f97-4111-8ea6-9691b3146421 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed1ce98c66024d49b31e8e4f38b82838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a20f8f858424c89bf67a56feb720ac9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:50:08.970751 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-25a28cb3-4f97-4111-8ea6-9691b3146421 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] 10.222.0.18 "GET /compute/v2.1/servers/5c3de24c-090d-4769-8975-207eb939b979" status: 200 len: 1443 microversion: 2.75 time: 0.487879 Oct 22 20:50:09.008509 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 276/496] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 20:50:08 2022] GET /compute/v2.1/servers/5c3de24c-090d-4769-8975-207eb939b979 => generated 1443 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 22 20:50:09.577890 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-8a2b967a-fe96-43ec-9d65-a6dc9a9275f5 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:50:09.595259 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-8a2b967a-fe96-43ec-9d65-a6dc9a9275f5 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] 10.222.0.18 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.585370 Oct 22 20:50:09.596039 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 277/497] 10.222.0.18 () {58 vars in 1137 bytes} [Sat Oct 22 20:50:09 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:50:09.883332 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-b8678c7e-0430-4860-9211-177428147834 tempest-ServersWithSpecificFlavorTestJSON-1796401636 tempest-ServersWithSpecificFlavorTestJSON-1796401636-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_1-1991118857", "id": 2037618959, "OS-FLV-EXT-DATA:ephemeral": 1, "os-flavor-access:is_public": "True"}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:50:09.928761 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-b8678c7e-0430-4860-9211-177428147834 tempest-ServersWithSpecificFlavorTestJSON-1796401636 tempest-ServersWithSpecificFlavorTestJSON-1796401636-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 425 microversion: 2.1 time: 0.322999 Oct 22 20:50:09.934257 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 278/498] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Oct 22 20:50:09 2022] POST /compute/v2.1/flavors => generated 425 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:50:09.948688 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-93451df6-013c-4868-b1a4-4503c1d20f0a tempest-ServersWithSpecificFlavorTestJSON-1796401636 tempest-ServersWithSpecificFlavorTestJSON-1796401636-project-admin] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:50:09.967736 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-93451df6-013c-4868-b1a4-4503c1d20f0a tempest-ServersWithSpecificFlavorTestJSON-1796401636 tempest-ServersWithSpecificFlavorTestJSON-1796401636-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.024929 Oct 22 20:50:09.968321 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 279/499] 10.222.0.18 () {58 vars in 1182 bytes} [Sat Oct 22 20:50:09 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 22 20:50:09.986567 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-56afd685-e72d-402b-b432-8983a10edaa4 tempest-ServersWithSpecificFlavorTestJSON-1796401636 tempest-ServersWithSpecificFlavorTestJSON-1796401636-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_0-631690767", "id": 2046857660, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": "True"}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:50:10.059761 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-56afd685-e72d-402b-b432-8983a10edaa4 tempest-ServersWithSpecificFlavorTestJSON-1796401636 tempest-ServersWithSpecificFlavorTestJSON-1796401636-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 424 microversion: 2.1 time: 0.072738 Oct 22 20:50:10.061467 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 280/500] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Oct 22 20:50:09 2022] POST /compute/v2.1/flavors => generated 424 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:50:10.072797 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-0018bc62-d479-4054-8e78-d49a9e777948 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:50:10.073690 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-0018bc62-d479-4054-8e78-d49a9e777948 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] [instance: 5c3de24c-090d-4769-8975-207eb939b979] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:50:10.082996 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0018bc62-d479-4054-8e78-d49a9e777948 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:50:10.083936 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0018bc62-d479-4054-8e78-d49a9e777948 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:50:10.084555 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0018bc62-d479-4054-8e78-d49a9e777948 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:50:10.085408 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0018bc62-d479-4054-8e78-d49a9e777948 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:50:10.086072 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0018bc62-d479-4054-8e78-d49a9e777948 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:50:10.086738 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0018bc62-d479-4054-8e78-d49a9e777948 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:50:10.162886 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0018bc62-d479-4054-8e78-d49a9e777948 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:50:10.163972 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0018bc62-d479-4054-8e78-d49a9e777948 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:50:10.164638 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0018bc62-d479-4054-8e78-d49a9e777948 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:50:10.165411 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.objects.instance [None req-0018bc62-d479-4054-8e78-d49a9e777948 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Lazy-loading 'fault' on Instance uuid 5c3de24c-090d-4769-8975-207eb939b979 {{(pid=138745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 20:50:10.964915 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-0018bc62-d479-4054-8e78-d49a9e777948 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1ce98c66024d49b31e8e4f38b82838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a20f8f858424c89bf67a56feb720ac9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:50:10.981541 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-0018bc62-d479-4054-8e78-d49a9e777948 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed1ce98c66024d49b31e8e4f38b82838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a20f8f858424c89bf67a56feb720ac9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:50:10.995455 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-0018bc62-d479-4054-8e78-d49a9e777948 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed1ce98c66024d49b31e8e4f38b82838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a20f8f858424c89bf67a56feb720ac9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:50:11.019059 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-0018bc62-d479-4054-8e78-d49a9e777948 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] 10.222.0.18 "GET /compute/v2.1/servers/5c3de24c-090d-4769-8975-207eb939b979" status: 200 len: 1448 microversion: 2.75 time: 0.952296 Oct 22 20:50:11.024488 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 281/501] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 20:50:10 2022] GET /compute/v2.1/servers/5c3de24c-090d-4769-8975-207eb939b979 => generated 1448 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 20:50:11.047658 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-7b699b77-4c08-437d-8840-daff907b6a7a tempest-ServersWithSpecificFlavorTestJSON-1796401636 tempest-ServersWithSpecificFlavorTestJSON-1796401636-project-admin] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:50:11.102705 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-7b699b77-4c08-437d-8840-daff907b6a7a tempest-ServersWithSpecificFlavorTestJSON-1796401636 tempest-ServersWithSpecificFlavorTestJSON-1796401636-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.073812 Oct 22 20:50:11.110100 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 282/502] 10.222.0.18 () {58 vars in 1182 bytes} [Sat Oct 22 20:50:11 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 22 20:50:11.129970 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-523aa931-634c-4b2b-983e-e561d7fc89b3 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Action: 'create', calling method: .version_select at 0x7fd3a47ad940>, body: {"keypair": {"name": "tempest-keypair-621297242", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBALWMOasbIJDKaQH400lergZOlMxqVts5aB4dEINxnN/6CV5B7RABu5TGr04dA7kBwSzXoGtUpOqLp7cQzSpx6P55blcJ4kwuWBRN3yP4ofncGMn1hIW54NArSFYbj7fsA=="}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:50:11.132151 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-5c909226-851b-474f-8af0-9f58358507c0 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Flavor limits 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 20:50:11.133495 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-5c909226-851b-474f-8af0-9f58358507c0 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Image limits 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 20:50:11.134148 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-5c909226-851b-474f-8af0-9f58358507c0 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Flavor pref 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 20:50:11.134735 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-5c909226-851b-474f-8af0-9f58358507c0 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Image pref 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 20:50:11.135329 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-5c909226-851b-474f-8af0-9f58358507c0 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 20:50:11.157106 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5c909226-851b-474f-8af0-9f58358507c0 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:50:11.163040 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5c909226-851b-474f-8af0-9f58358507c0 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:50:11.165980 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5c909226-851b-474f-8af0-9f58358507c0 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:50:11.170677 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5c909226-851b-474f-8af0-9f58358507c0 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:50:11.171457 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5c909226-851b-474f-8af0-9f58358507c0 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:50:11.174871 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5c909226-851b-474f-8af0-9f58358507c0 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:50:11.226481 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-523aa931-634c-4b2b-983e-e561d7fc89b3 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Getting quotas for project 30dbbdc150694e0ebc07c63e90280d40. Resources: {'key_pairs'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 20:50:11.256457 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-523aa931-634c-4b2b-983e-e561d7fc89b3 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Getting quotas for user f9bba9ed37d7430e82e7d310982b8e47 and project 30dbbdc150694e0ebc07c63e90280d40. Resources: {'key_pairs'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 20:50:11.268801 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-5c909226-851b-474f-8af0-9f58358507c0 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Getting quotas for project 11060bbcab6b45cabb1457319d72b982. Resources: {'cores', 'instances', 'ram'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 20:50:11.296202 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-5c909226-851b-474f-8af0-9f58358507c0 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Getting quotas for user 93c41b7be1724632b0d6bd2bd3b57f8f and project 11060bbcab6b45cabb1457319d72b982. Resources: {'cores', 'instances', 'ram'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 20:50:11.353477 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-523aa931-634c-4b2b-983e-e561d7fc89b3 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.237731 Oct 22 20:50:11.356530 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 283/503] 10.222.0.18 () {60 vars in 1159 bytes} [Sat Oct 22 20:50:11 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:50:11.362791 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-5c909226-851b-474f-8af0-9f58358507c0 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Going to run 1 instances... {{(pid=138744) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 20:50:11.362791 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-5c909226-851b-474f-8af0-9f58358507c0 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] [instance: 254dfdd3-3716-43cf-aadc-f678aff08d27] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='085e4478-6edc-4a69-8e08-f9831713eb65',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138744) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 20:50:11.459932 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_api:SELECT=86,nova_api:SAVEPOINT=2,nova_api:INSERT=4,nova_api:RELEASE=2,nova_api:DELETE=6 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:50:11.594647 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-5c909226-851b-474f-8af0-9f58358507c0 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 3.691813 Oct 22 20:50:11.607449 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-9138e632-233a-47ae-8139-f45d27bb6ec4 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:50:11.608404 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-9138e632-233a-47ae-8139-f45d27bb6ec4 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] [instance: 254dfdd3-3716-43cf-aadc-f678aff08d27] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:50:11.608639 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 221/504] 10.222.0.18 () {62 vars in 1188 bytes} [Sat Oct 22 20:50:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 3707 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 22 20:50:12.058869 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-0d87ee1f-234c-4c02-98cb-ca28638d4a52 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:50:12.059530 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-0d87ee1f-234c-4c02-98cb-ca28638d4a52 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] [instance: 5c3de24c-090d-4769-8975-207eb939b979] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:50:12.083329 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0d87ee1f-234c-4c02-98cb-ca28638d4a52 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:50:12.083878 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0d87ee1f-234c-4c02-98cb-ca28638d4a52 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:50:12.084326 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0d87ee1f-234c-4c02-98cb-ca28638d4a52 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:50:12.095993 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0d87ee1f-234c-4c02-98cb-ca28638d4a52 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:50:12.101134 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0d87ee1f-234c-4c02-98cb-ca28638d4a52 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:50:12.105951 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0d87ee1f-234c-4c02-98cb-ca28638d4a52 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:50:12.166880 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-0d87ee1f-234c-4c02-98cb-ca28638d4a52 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] HTTP exception thrown: Instance 5c3de24c-090d-4769-8975-207eb939b979 could not be found. Oct 22 20:50:12.172424 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-0d87ee1f-234c-4c02-98cb-ca28638d4a52 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Request method failure captured: Oct 22 20:50:12.172424 ncdv-master-1 devstack@n-api.service[138744]: request: GET /compute/v2.1/servers/5c3de24c-090d-4769-8975-207eb939b979 HTTP/1.1 Oct 22 20:50:12.172424 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 20:50:12.172424 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 20:50:12.172424 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 20:50:12.172424 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 0 Oct 22 20:50:12.172424 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 20:50:12.172424 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 20:50:12.172424 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 20:50:12.172424 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 20:50:12.172424 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVFcu2410oc2BEZd1tsl_pqlOoMPQC-SZbyWmWdCe5N52XNJa1kF87-VDaBQa0r9YYt9-lsZ5GJ8sVRPDVuLeOCVW1BUFrjP5YVD3cDorUY9flgtb27tNor6Gx_IdZe6KCAtFA2B0n1RloRSWdgjaf2oLynYewaXR7pdtLeaWrARPQvE Oct 22 20:50:12.172424 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 20:50:12.172424 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 20:50:12.172424 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 20:50:12.172424 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 20:50:12.172424 ncdv-master-1 devstack@n-api.service[138744]: X-Openstack-Nova-Api-Version: 2.75 Oct 22 20:50:12.172424 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 20:50:12.172424 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 20:50:12.172424 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: 1a20f8f858424c89bf67a56feb720ac9 Oct 22 20:50:12.172424 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-ServersAdmin275Test-1051490846 Oct 22 20:50:12.172424 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 20:50:12.172424 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 20:50:12.172424 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_1a20f8f858424c89bf67a56feb720ac9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1a20f8f858424c89bf67a56feb720ac9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/1a20f8f858424c89bf67a56feb720ac9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1a20f8f858424c89bf67a56feb720ac9"}]}] Oct 22 20:50:12.172424 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-ServersAdmin275Test-1051490846 Oct 22 20:50:12.172424 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: 1a20f8f858424c89bf67a56feb720ac9 Oct 22 20:50:12.172424 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-ServersAdmin275Test-1051490846 Oct 22 20:50:12.172424 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-ServersAdmin275Test-1051490846-project Oct 22 20:50:12.172424 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 20:50:12.172424 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 20:50:12.172424 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: ed1ce98c66024d49b31e8e4f38b82838 Oct 22 20:50:12.172424 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-ServersAdmin275Test-1051490846-project Oct 22 20:50:12.172424 ncdv-master-1 devstack@n-api.service[138744]: method: > Oct 22 20:50:12.172424 ncdv-master-1 devstack@n-api.service[138744]: exception: Instance 5c3de24c-090d-4769-8975-207eb939b979 could not be found. Oct 22 20:50:12.172424 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': '5c3de24c-090d-4769-8975-207eb939b979'} Oct 22 20:50:12.172424 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:50:12.172424 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:50:12.172424 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 20:50:12.172424 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 20:50:12.172424 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 20:50:12.172424 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 20:50:12.172424 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 20:50:12.172424 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 20:50:12.172424 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 20:50:12.172424 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 20:50:12.172424 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c3de24c-090d-4769-8975-207eb939b979 could not be found. Oct 22 20:50:12.172424 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:50:12.172424 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:50:12.172424 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:50:12.172424 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:50:12.172424 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:50:12.172424 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:50:12.172424 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:50:12.172424 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:50:12.172424 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:50:12.172424 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:50:12.172424 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 20:50:12.172424 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 20:50:12.172424 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 20:50:12.172424 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 20:50:12.172424 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 20:50:12.172424 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 20:50:12.172424 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c3de24c-090d-4769-8975-207eb939b979 could not be found. Oct 22 20:50:12.172424 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:50:12.172424 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:50:12.172424 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:50:12.179741 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:50:12.179741 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:50:12.179741 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:50:12.179741 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 20:50:12.179741 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 20:50:12.179741 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c3de24c-090d-4769-8975-207eb939b979 could not be found. Oct 22 20:50:12.179741 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:50:12.179741 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-0d87ee1f-234c-4c02-98cb-ca28638d4a52 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] Returning 404 to user: Instance 5c3de24c-090d-4769-8975-207eb939b979 could not be found. {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:50:12.180351 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-0d87ee1f-234c-4c02-98cb-ca28638d4a52 tempest-ServersAdmin275Test-1051490846 tempest-ServersAdmin275Test-1051490846-project] 10.222.0.18 "GET /compute/v2.1/servers/5c3de24c-090d-4769-8975-207eb939b979" status: 404 len: 111 microversion: 2.75 time: 0.126616 Oct 22 20:50:12.185237 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 222/505] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 20:50:12 2022] GET /compute/v2.1/servers/5c3de24c-090d-4769-8975-207eb939b979 => generated 111 bytes in 132 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 22 20:50:12.710450 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-9138e632-233a-47ae-8139-f45d27bb6ec4 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:50:12.729939 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-9138e632-233a-47ae-8139-f45d27bb6ec4 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:50:12.738237 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-9138e632-233a-47ae-8139-f45d27bb6ec4 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:50:12.748935 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-9138e632-233a-47ae-8139-f45d27bb6ec4 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] 10.222.0.18 "GET /compute/v2.1/servers/254dfdd3-3716-43cf-aadc-f678aff08d27" status: 200 len: 1262 microversion: 2.25 time: 1.145644 Oct 22 20:50:12.749540 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 284/506] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 20:50:11 2022] GET /compute/v2.1/servers/254dfdd3-3716-43cf-aadc-f678aff08d27 => generated 1262 bytes in 1147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 20:50:13.779077 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-0350cb58-8f65-40fa-bace-3854db44678b tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:50:13.779732 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-0350cb58-8f65-40fa-bace-3854db44678b tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] [instance: 254dfdd3-3716-43cf-aadc-f678aff08d27] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:50:13.795118 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0350cb58-8f65-40fa-bace-3854db44678b tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:50:13.802917 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0350cb58-8f65-40fa-bace-3854db44678b tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:50:13.803509 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0350cb58-8f65-40fa-bace-3854db44678b tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:50:13.804313 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0350cb58-8f65-40fa-bace-3854db44678b tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:50:13.813184 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0350cb58-8f65-40fa-bace-3854db44678b tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:50:13.813781 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0350cb58-8f65-40fa-bace-3854db44678b tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:50:15.048414 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-c959dfa4-c88f-4223-ae8a-2944b7ab1bb8 tempest-InstanceUsageAuditLogTestJSON-220523810 tempest-InstanceUsageAuditLogTestJSON-220523810-project-admin] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:50:15.113501 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-0350cb58-8f65-40fa-bace-3854db44678b tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:50:15.127097 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-0350cb58-8f65-40fa-bace-3854db44678b tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:50:15.127479 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-c959dfa4-c88f-4223-ae8a-2944b7ab1bb8 tempest-InstanceUsageAuditLogTestJSON-220523810 tempest-InstanceUsageAuditLogTestJSON-220523810-project-admin] 10.222.0.18 "GET /compute/v2.1/os-instance_usage_audit_log/2022-10-22 20:50:14" status: 200 len: 318 microversion: 2.1 time: 0.750737 Oct 22 20:50:15.137936 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 285/507] 10.222.0.18 () {58 vars in 1251 bytes} [Sat Oct 22 20:50:14 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-10-22%2020%3A50%3A14 => generated 318 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:50:15.143925 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-0350cb58-8f65-40fa-bace-3854db44678b tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:50:15.145225 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-0350cb58-8f65-40fa-bace-3854db44678b tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] 10.222.0.18 "GET /compute/v2.1/servers/254dfdd3-3716-43cf-aadc-f678aff08d27" status: 200 len: 1314 microversion: 2.25 time: 1.370983 Oct 22 20:50:15.148409 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 223/508] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 20:50:13 2022] GET /compute/v2.1/servers/254dfdd3-3716-43cf-aadc-f678aff08d27 => generated 1314 bytes in 1375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 20:50:15.165891 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-7d87bfc1-7daa-4b68-9817-88fc2e2138fd tempest-InstanceUsageAuditLogTestJSON-220523810 tempest-InstanceUsageAuditLogTestJSON-220523810-project-admin] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:50:15.205094 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-7d87bfc1-7daa-4b68-9817-88fc2e2138fd tempest-InstanceUsageAuditLogTestJSON-220523810 tempest-InstanceUsageAuditLogTestJSON-220523810-project-admin] 10.222.0.18 "GET /compute/v2.1/os-instance_usage_audit_log" status: 200 len: 319 microversion: 2.1 time: 0.059599 Oct 22 20:50:15.207076 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 286/509] 10.222.0.18 () {58 vars in 1185 bytes} [Sat Oct 22 20:50:15 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 319 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:50:16.181371 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-a682793a-9123-422a-9e5f-30dc8a5d1b9a tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:50:16.182097 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-a682793a-9123-422a-9e5f-30dc8a5d1b9a tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] [instance: 254dfdd3-3716-43cf-aadc-f678aff08d27] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:50:16.209902 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a682793a-9123-422a-9e5f-30dc8a5d1b9a tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:50:16.212474 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a682793a-9123-422a-9e5f-30dc8a5d1b9a tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:50:16.212957 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a682793a-9123-422a-9e5f-30dc8a5d1b9a tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:50:16.223452 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a682793a-9123-422a-9e5f-30dc8a5d1b9a tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:50:16.224384 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a682793a-9123-422a-9e5f-30dc8a5d1b9a tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:50:16.224849 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a682793a-9123-422a-9e5f-30dc8a5d1b9a tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:50:16.624327 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-a682793a-9123-422a-9e5f-30dc8a5d1b9a tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:50:16.641634 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-a682793a-9123-422a-9e5f-30dc8a5d1b9a tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:50:16.650569 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-a682793a-9123-422a-9e5f-30dc8a5d1b9a tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:50:16.658260 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-a682793a-9123-422a-9e5f-30dc8a5d1b9a tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] 10.222.0.18 "GET /compute/v2.1/servers/254dfdd3-3716-43cf-aadc-f678aff08d27" status: 200 len: 1320 microversion: 2.25 time: 0.481985 Oct 22 20:50:16.684679 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 224/510] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 20:50:16 2022] GET /compute/v2.1/servers/254dfdd3-3716-43cf-aadc-f678aff08d27 => generated 1320 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 22 20:50:17.691109 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-7d1549a9-4e2e-4824-a598-4771bcc017a4 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:50:17.691944 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-7d1549a9-4e2e-4824-a598-4771bcc017a4 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] [instance: 254dfdd3-3716-43cf-aadc-f678aff08d27] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:50:17.713008 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=4,nova_api:UPDATE=2 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:50:17.716686 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7d1549a9-4e2e-4824-a598-4771bcc017a4 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:50:17.719961 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7d1549a9-4e2e-4824-a598-4771bcc017a4 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:50:17.722297 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7d1549a9-4e2e-4824-a598-4771bcc017a4 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:50:17.728193 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7d1549a9-4e2e-4824-a598-4771bcc017a4 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:50:17.729510 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7d1549a9-4e2e-4824-a598-4771bcc017a4 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:50:17.731124 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7d1549a9-4e2e-4824-a598-4771bcc017a4 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:50:18.246280 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-7d1549a9-4e2e-4824-a598-4771bcc017a4 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:50:18.273473 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-7d1549a9-4e2e-4824-a598-4771bcc017a4 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:50:18.280529 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-7d1549a9-4e2e-4824-a598-4771bcc017a4 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:50:18.290121 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-7d1549a9-4e2e-4824-a598-4771bcc017a4 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] 10.222.0.18 "GET /compute/v2.1/servers/254dfdd3-3716-43cf-aadc-f678aff08d27" status: 200 len: 1320 microversion: 2.25 time: 0.606323 Oct 22 20:50:18.293662 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 287/511] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 20:50:17 2022] GET /compute/v2.1/servers/254dfdd3-3716-43cf-aadc-f678aff08d27 => generated 1320 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 20:50:19.036794 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-3fb67e83-7b9f-40f1-8801-eb814f88057c tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] Action: 'create', calling method: .version_select at 0x7fd3a44a73a0>, body: {"keypair": {"name": "tempest-keypair-1140613902", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI7AYhL9e9A7DijAGJzHCOgX1s9ner3PKRF2yO8IBEayJKr0WZKwYs2qn2iDpAWjvkecVZ8kS9P7zaz78+yXPWQwikmi7i7Z9xSgXRkzqci0Imjf+2RVu1TgNJRdA9Bx5g=="}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:50:19.102073 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-3fb67e83-7b9f-40f1-8801-eb814f88057c tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] Getting quotas for project a7b403b83cad4babab211dafade27bde. Resources: {'key_pairs'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 20:50:19.123935 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-3fb67e83-7b9f-40f1-8801-eb814f88057c tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] Getting quotas for user b892876156f34b0d99a6c853d0cd4905 and project a7b403b83cad4babab211dafade27bde. Resources: {'key_pairs'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 20:50:19.222021 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-3fb67e83-7b9f-40f1-8801-eb814f88057c tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.589464 Oct 22 20:50:19.224335 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 225/512] 10.222.0.18 () {60 vars in 1159 bytes} [Sat Oct 22 20:50:18 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:50:19.321343 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-dfe5b7dc-bc89-4a35-8942-9b50fac55821 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:50:19.321951 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-dfe5b7dc-bc89-4a35-8942-9b50fac55821 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] [instance: 254dfdd3-3716-43cf-aadc-f678aff08d27] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:50:19.335477 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-dfe5b7dc-bc89-4a35-8942-9b50fac55821 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:50:19.336231 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-dfe5b7dc-bc89-4a35-8942-9b50fac55821 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:50:19.337524 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-dfe5b7dc-bc89-4a35-8942-9b50fac55821 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:50:19.340111 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-dfe5b7dc-bc89-4a35-8942-9b50fac55821 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:50:19.340752 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-dfe5b7dc-bc89-4a35-8942-9b50fac55821 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:50:19.345715 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-dfe5b7dc-bc89-4a35-8942-9b50fac55821 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:50:19.671536 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-dfe5b7dc-bc89-4a35-8942-9b50fac55821 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:50:19.686604 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-dfe5b7dc-bc89-4a35-8942-9b50fac55821 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:50:19.688006 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-dfe5b7dc-bc89-4a35-8942-9b50fac55821 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:50:19.689272 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-dfe5b7dc-bc89-4a35-8942-9b50fac55821 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] 10.222.0.18 "GET /compute/v2.1/servers/254dfdd3-3716-43cf-aadc-f678aff08d27" status: 200 len: 1320 microversion: 2.25 time: 0.372660 Oct 22 20:50:19.707374 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 288/513] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 20:50:19 2022] GET /compute/v2.1/servers/254dfdd3-3716-43cf-aadc-f678aff08d27 => generated 1320 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 20:50:19.963057 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-0682c95f-4ef4-4427-9c7f-14069e50eda5 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-729623215", "imageRef": "085e4478-6edc-4a69-8e08-f9831713eb65", "flavorRef": "2046857660", "adminPass": "***", "networks": [{"uuid": "23d78391-5f1f-42d8-9cb4-080779546339"}], "security_groups": [{"name": "tempest-securitygroup--501915065"}], "key_name": "tempest-keypair-621297242", "user_data": "}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:50:20.277046 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.network.neutron [None req-0682c95f-4ef4-4427-9c7f-14069e50eda5 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] validate_networks() for [('23d78391-5f1f-42d8-9cb4-080779546339', None, None, None, None, None)] {{(pid=138744) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 20:50:20.723302 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-3f383e8b-8f83-46d2-ac64-94a82485316d tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:50:20.724539 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-3f383e8b-8f83-46d2-ac64-94a82485316d tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] [instance: 254dfdd3-3716-43cf-aadc-f678aff08d27] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:50:20.745091 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3f383e8b-8f83-46d2-ac64-94a82485316d tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:50:20.745852 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3f383e8b-8f83-46d2-ac64-94a82485316d tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:50:20.746490 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3f383e8b-8f83-46d2-ac64-94a82485316d tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:50:20.747481 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3f383e8b-8f83-46d2-ac64-94a82485316d tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:50:20.751576 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3f383e8b-8f83-46d2-ac64-94a82485316d tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:50:20.752297 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3f383e8b-8f83-46d2-ac64-94a82485316d tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:50:21.232929 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell0:SELECT=2 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:50:22.247498 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-3f383e8b-8f83-46d2-ac64-94a82485316d tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:50:22.265090 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-3f383e8b-8f83-46d2-ac64-94a82485316d tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:50:22.271042 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-3f383e8b-8f83-46d2-ac64-94a82485316d tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:50:22.275603 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-3f383e8b-8f83-46d2-ac64-94a82485316d tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] 10.222.0.18 "GET /compute/v2.1/servers/254dfdd3-3716-43cf-aadc-f678aff08d27" status: 200 len: 1362 microversion: 2.25 time: 1.555940 Oct 22 20:50:22.276471 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 289/514] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 20:50:20 2022] GET /compute/v2.1/servers/254dfdd3-3716-43cf-aadc-f678aff08d27 => generated 1362 bytes in 1560 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 22 20:50:22.920487 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-86a30b2a-4144-44fc-9a99-47b6d0615a7e tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1056770897", "imageRef": "085e4478-6edc-4a69-8e08-f9831713eb65", "flavorRef": "452"}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:50:23.093727 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.network.neutron [None req-86a30b2a-4144-44fc-9a99-47b6d0615a7e tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] validate_networks() for None {{(pid=138745) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 20:50:23.989145 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-0682c95f-4ef4-4427-9c7f-14069e50eda5 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Flavor limits 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 20:50:23.989737 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-0682c95f-4ef4-4427-9c7f-14069e50eda5 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Image limits 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 20:50:23.990204 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-0682c95f-4ef4-4427-9c7f-14069e50eda5 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Flavor pref 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 20:50:23.990623 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-0682c95f-4ef4-4427-9c7f-14069e50eda5 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Image pref 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 20:50:23.991034 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-0682c95f-4ef4-4427-9c7f-14069e50eda5 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 20:50:24.017929 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0682c95f-4ef4-4427-9c7f-14069e50eda5 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:50:24.018415 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0682c95f-4ef4-4427-9c7f-14069e50eda5 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:50:24.018847 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0682c95f-4ef4-4427-9c7f-14069e50eda5 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:50:24.032780 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0682c95f-4ef4-4427-9c7f-14069e50eda5 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:50:24.033290 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0682c95f-4ef4-4427-9c7f-14069e50eda5 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:50:24.033730 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0682c95f-4ef4-4427-9c7f-14069e50eda5 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:50:24.133167 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-0682c95f-4ef4-4427-9c7f-14069e50eda5 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Getting quotas for project 30dbbdc150694e0ebc07c63e90280d40. Resources: {'cores', 'instances', 'ram'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 20:50:24.152098 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-0682c95f-4ef4-4427-9c7f-14069e50eda5 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Getting quotas for user f9bba9ed37d7430e82e7d310982b8e47 and project 30dbbdc150694e0ebc07c63e90280d40. Resources: {'cores', 'instances', 'ram'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 20:50:24.212999 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-0682c95f-4ef4-4427-9c7f-14069e50eda5 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Going to run 1 instances... {{(pid=138744) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 20:50:24.215297 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-0682c95f-4ef4-4427-9c7f-14069e50eda5 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] [instance: 4c53f81e-f4d8-4b41-b03a-ba9acb867226] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='085e4478-6edc-4a69-8e08-f9831713eb65',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138744) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 20:50:24.399098 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-0682c95f-4ef4-4427-9c7f-14069e50eda5 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 4.441876 Oct 22 20:50:24.399782 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 226/515] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Oct 22 20:50:19 2022] POST /compute/v2.1/servers => generated 401 bytes in 4443 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 20:50:24.430885 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-c842af72-4651-49c0-b3b4-a9a50020c9fb tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:50:24.433724 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-c842af72-4651-49c0-b3b4-a9a50020c9fb tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] [instance: 254dfdd3-3716-43cf-aadc-f678aff08d27] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:50:24.460336 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c842af72-4651-49c0-b3b4-a9a50020c9fb tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:50:24.464462 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c842af72-4651-49c0-b3b4-a9a50020c9fb tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:50:24.465880 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c842af72-4651-49c0-b3b4-a9a50020c9fb tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:50:24.473990 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c842af72-4651-49c0-b3b4-a9a50020c9fb tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:50:24.478073 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c842af72-4651-49c0-b3b4-a9a50020c9fb tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:50:24.479609 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c842af72-4651-49c0-b3b4-a9a50020c9fb tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:50:24.649262 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-86a30b2a-4144-44fc-9a99-47b6d0615a7e tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Flavor limits 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 20:50:24.650452 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-86a30b2a-4144-44fc-9a99-47b6d0615a7e tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Image limits 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 20:50:24.651387 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-86a30b2a-4144-44fc-9a99-47b6d0615a7e tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Flavor pref 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 20:50:24.652489 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-86a30b2a-4144-44fc-9a99-47b6d0615a7e tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Image pref 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 20:50:24.653559 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-86a30b2a-4144-44fc-9a99-47b6d0615a7e tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 20:50:24.667563 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-86a30b2a-4144-44fc-9a99-47b6d0615a7e tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:50:24.669561 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-86a30b2a-4144-44fc-9a99-47b6d0615a7e tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:50:24.670272 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-86a30b2a-4144-44fc-9a99-47b6d0615a7e tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:50:24.673404 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-86a30b2a-4144-44fc-9a99-47b6d0615a7e tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:50:24.674016 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-86a30b2a-4144-44fc-9a99-47b6d0615a7e tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:50:24.679808 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-86a30b2a-4144-44fc-9a99-47b6d0615a7e tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:50:24.733194 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-86a30b2a-4144-44fc-9a99-47b6d0615a7e tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Getting quotas for project 902e239d67664098895ab24340b0b780. Resources: {'cores', 'instances', 'ram'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 20:50:24.750190 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-86a30b2a-4144-44fc-9a99-47b6d0615a7e tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Getting quotas for user 91cf84a287b74618ae1b3368785b0b4c and project 902e239d67664098895ab24340b0b780. Resources: {'cores', 'instances', 'ram'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 20:50:24.797047 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-86a30b2a-4144-44fc-9a99-47b6d0615a7e tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Going to run 1 instances... {{(pid=138745) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 20:50:24.818220 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-86a30b2a-4144-44fc-9a99-47b6d0615a7e tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] [instance: 69ed98a2-c208-4765-88b1-3e76a09cc481] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='085e4478-6edc-4a69-8e08-f9831713eb65',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138745) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 20:50:24.976400 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-86a30b2a-4144-44fc-9a99-47b6d0615a7e tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.693476 Oct 22 20:50:24.981555 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 290/516] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Oct 22 20:50:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 2703 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 20:50:24.998557 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-186d1544-1619-4eea-a51b-9b9923610392 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:50:25.003985 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-186d1544-1619-4eea-a51b-9b9923610392 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] [instance: 4c53f81e-f4d8-4b41-b03a-ba9acb867226] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:50:25.102694 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-c842af72-4651-49c0-b3b4-a9a50020c9fb tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:50:25.123366 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-c842af72-4651-49c0-b3b4-a9a50020c9fb tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:50:25.127545 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-c842af72-4651-49c0-b3b4-a9a50020c9fb tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:50:25.134401 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-c842af72-4651-49c0-b3b4-a9a50020c9fb tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] 10.222.0.18 "GET /compute/v2.1/servers/254dfdd3-3716-43cf-aadc-f678aff08d27" status: 200 len: 1362 microversion: 2.25 time: 0.718024 Oct 22 20:50:25.159464 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 227/517] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 20:50:24 2022] GET /compute/v2.1/servers/254dfdd3-3716-43cf-aadc-f678aff08d27 => generated 1362 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 20:50:25.181034 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-186d1544-1619-4eea-a51b-9b9923610392 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9bba9ed37d7430e82e7d310982b8e47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30dbbdc150694e0ebc07c63e90280d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:50:25.201589 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-186d1544-1619-4eea-a51b-9b9923610392 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] 10.222.0.18 "GET /compute/v2.1/servers/4c53f81e-f4d8-4b41-b03a-ba9acb867226" status: 200 len: 1263 microversion: 2.1 time: 0.216732 Oct 22 20:50:25.203066 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 291/518] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:50:24 2022] GET /compute/v2.1/servers/4c53f81e-f4d8-4b41-b03a-ba9acb867226 => generated 1263 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:50:25.677626 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-ca22ac83-f67e-4312-a4ce-c075571e710f tempest-KeyPairsV210TestJSON-1298024825 tempest-KeyPairsV210TestJSON-1298024825-project-admin] Action: 'create', calling method: .version_select at 0x7fd3a4935f70>, body: {"keypair": {"name": "tempest-keypair-81951606", "type": "ssh", "user_id": "be509469719e49ca8d82f68cdb2f52db", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGNkEsNhkv9W0bkBP6va1MX/wPAE9oIHl82YdLb13eJLSTYcgzDSYH3l5eaMCk4/pB0R1QlyxWmqvSVcU+ZcYd7eqlN2C04LFQv/ykCkYhTcY0VkCDLcD+/17XbEC3Osxw=="}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:50:25.734434 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-ca22ac83-f67e-4312-a4ce-c075571e710f tempest-KeyPairsV210TestJSON-1298024825 tempest-KeyPairsV210TestJSON-1298024825-project-admin] Getting quotas for project b2b8930951c74fc8810e5e80eb081fd9. Resources: {'key_pairs'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 20:50:25.751301 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-ca22ac83-f67e-4312-a4ce-c075571e710f tempest-KeyPairsV210TestJSON-1298024825 tempest-KeyPairsV210TestJSON-1298024825-project-admin] Getting quotas for user 621bdad559ca4a44b6c6f3d59adb2e37 and project b2b8930951c74fc8810e5e80eb081fd9. Resources: {'key_pairs'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 20:50:25.830933 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-0a242eba-974b-47e0-bd29-7ad8f76fc7c6 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-225565320", "imageRef": "085e4478-6edc-4a69-8e08-f9831713eb65", "flavorRef": "452", "networks": [{"uuid": "4282d9d7-1326-486a-8448-108826634658"}]}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:50:25.847168 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-ca22ac83-f67e-4312-a4ce-c075571e710f tempest-KeyPairsV210TestJSON-1298024825 tempest-KeyPairsV210TestJSON-1298024825-project-admin] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 201 len: 399 microversion: 2.10 time: 0.637690 Oct 22 20:50:25.850935 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 292/519] 10.222.0.18 () {62 vars in 1200 bytes} [Sat Oct 22 20:50:25 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 647 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 22 20:50:25.870381 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-b7eb943f-75e7-4984-b4c8-773ca6b7e230 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:50:25.873987 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-b7eb943f-75e7-4984-b4c8-773ca6b7e230 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] [instance: 69ed98a2-c208-4765-88b1-3e76a09cc481] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:50:25.969641 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.network.neutron [None req-0a242eba-974b-47e0-bd29-7ad8f76fc7c6 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] validate_networks() for [('4282d9d7-1326-486a-8448-108826634658', None, None, None, None, None)] {{(pid=138744) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 20:50:26.066622 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-b7eb943f-75e7-4984-b4c8-773ca6b7e230 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91cf84a287b74618ae1b3368785b0b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902e239d67664098895ab24340b0b780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:50:26.081919 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-b7eb943f-75e7-4984-b4c8-773ca6b7e230 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] 10.222.0.18 "GET /compute/v2.1/servers/69ed98a2-c208-4765-88b1-3e76a09cc481" status: 200 len: 1217 microversion: 2.1 time: 0.227797 Oct 22 20:50:26.084151 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 293/520] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:50:25 2022] GET /compute/v2.1/servers/69ed98a2-c208-4765-88b1-3e76a09cc481 => generated 1217 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:50:26.109771 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-66bc12d9-f6d0-4cdb-a42f-515f6b56ca67 req-e40b7af3-e137-400c-ab00-ad8d9af1fc56 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "254dfdd3-3716-43cf-aadc-f678aff08d27", "tag": "aa3c904e-442d-4f48-8da8-c9451b740c64"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:50:26.122823 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-66bc12d9-f6d0-4cdb-a42f-515f6b56ca67 req-e40b7af3-e137-400c-ab00-ad8d9af1fc56 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:50:26.123660 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-66bc12d9-f6d0-4cdb-a42f-515f6b56ca67 req-e40b7af3-e137-400c-ab00-ad8d9af1fc56 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:50:26.124240 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-66bc12d9-f6d0-4cdb-a42f-515f6b56ca67 req-e40b7af3-e137-400c-ab00-ad8d9af1fc56 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:50:26.153894 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-66bc12d9-f6d0-4cdb-a42f-515f6b56ca67 req-e40b7af3-e137-400c-ab00-ad8d9af1fc56 service nova] Creating event network-changed:aa3c904e-442d-4f48-8da8-c9451b740c64 for instance 254dfdd3-3716-43cf-aadc-f678aff08d27 on nch2-master-1 Oct 22 20:50:26.169515 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-66bc12d9-f6d0-4cdb-a42f-515f6b56ca67 req-e40b7af3-e137-400c-ab00-ad8d9af1fc56 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065602 Oct 22 20:50:26.174477 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 294/521] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:50:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:50:26.189356 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-da7152c8-ce24-4990-8e1a-9d67da1c681f tempest-KeyPairsV210TestJSON-1298024825 tempest-KeyPairsV210TestJSON-1298024825-project-admin] Action: 'create', calling method: .version_select at 0x7fd3a4799160>, body: {"keypair": {"name": "tempest-keypair-952504972", "type": "ssh", "user_id": "be509469719e49ca8d82f68cdb2f52db", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEAxy+yvh8cIZXaFCY6C6gt2vS6kHH3rwRmJk+7VlqYgRSqiqynIQDjBQOMmSdZ7Gq9RQShavTqmZsGOxxJYx6d4Y84wEMrZVVfVLJ1hno8TqfA2H7GenF/GNVrTfmzmEA=="}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:50:26.237968 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-da7152c8-ce24-4990-8e1a-9d67da1c681f tempest-KeyPairsV210TestJSON-1298024825 tempest-KeyPairsV210TestJSON-1298024825-project-admin] Getting quotas for project b2b8930951c74fc8810e5e80eb081fd9. Resources: {'key_pairs'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 20:50:26.251272 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-da7152c8-ce24-4990-8e1a-9d67da1c681f tempest-KeyPairsV210TestJSON-1298024825 tempest-KeyPairsV210TestJSON-1298024825-project-admin] Getting quotas for user 621bdad559ca4a44b6c6f3d59adb2e37 and project b2b8930951c74fc8810e5e80eb081fd9. Resources: {'key_pairs'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 20:50:26.313028 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-da7152c8-ce24-4990-8e1a-9d67da1c681f tempest-KeyPairsV210TestJSON-1298024825 tempest-KeyPairsV210TestJSON-1298024825-project-admin] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.10 time: 0.136687 Oct 22 20:50:26.315623 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 295/522] 10.222.0.18 () {62 vars in 1200 bytes} [Sat Oct 22 20:50:26 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 140 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 22 20:50:26.323683 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-ca4d3da3-9ad3-4b31-aebf-ba72ceef58d2 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:50:26.327133 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-ca4d3da3-9ad3-4b31-aebf-ba72ceef58d2 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] [instance: 254dfdd3-3716-43cf-aadc-f678aff08d27] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:50:26.350584 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ca4d3da3-9ad3-4b31-aebf-ba72ceef58d2 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:50:26.352410 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ca4d3da3-9ad3-4b31-aebf-ba72ceef58d2 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:50:26.354395 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ca4d3da3-9ad3-4b31-aebf-ba72ceef58d2 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:50:26.356365 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ca4d3da3-9ad3-4b31-aebf-ba72ceef58d2 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:50:26.357720 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ca4d3da3-9ad3-4b31-aebf-ba72ceef58d2 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:50:26.359396 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ca4d3da3-9ad3-4b31-aebf-ba72ceef58d2 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:50:27.085798 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-ca4d3da3-9ad3-4b31-aebf-ba72ceef58d2 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:50:27.114576 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-ca4d3da3-9ad3-4b31-aebf-ba72ceef58d2 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:50:27.118281 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-ca4d3da3-9ad3-4b31-aebf-ba72ceef58d2 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:50:27.123027 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-ca4d3da3-9ad3-4b31-aebf-ba72ceef58d2 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] 10.222.0.18 "GET /compute/v2.1/servers/254dfdd3-3716-43cf-aadc-f678aff08d27" status: 200 len: 1362 microversion: 2.25 time: 0.802046 Oct 22 20:50:27.135401 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 296/523] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 20:50:26 2022] GET /compute/v2.1/servers/254dfdd3-3716-43cf-aadc-f678aff08d27 => generated 1362 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 20:50:27.135401 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-3f3660d6-0d0a-4a9c-81a1-8bcfed5ad45f tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:50:27.135401 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-3f3660d6-0d0a-4a9c-81a1-8bcfed5ad45f tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] [instance: 4c53f81e-f4d8-4b41-b03a-ba9acb867226] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:50:27.152205 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3f3660d6-0d0a-4a9c-81a1-8bcfed5ad45f tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:50:27.154914 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3f3660d6-0d0a-4a9c-81a1-8bcfed5ad45f tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:50:27.156541 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3f3660d6-0d0a-4a9c-81a1-8bcfed5ad45f tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:50:27.159243 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3f3660d6-0d0a-4a9c-81a1-8bcfed5ad45f tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:50:27.160222 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3f3660d6-0d0a-4a9c-81a1-8bcfed5ad45f tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:50:27.160845 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3f3660d6-0d0a-4a9c-81a1-8bcfed5ad45f tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:50:27.488459 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-3f3660d6-0d0a-4a9c-81a1-8bcfed5ad45f tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9bba9ed37d7430e82e7d310982b8e47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30dbbdc150694e0ebc07c63e90280d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:50:27.499707 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-3f3660d6-0d0a-4a9c-81a1-8bcfed5ad45f tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] 10.222.0.18 "GET /compute/v2.1/servers/4c53f81e-f4d8-4b41-b03a-ba9acb867226" status: 200 len: 1323 microversion: 2.1 time: 0.374246 Oct 22 20:50:27.512959 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 297/524] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:50:27 2022] GET /compute/v2.1/servers/4c53f81e-f4d8-4b41-b03a-ba9acb867226 => generated 1323 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:50:27.513128 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-6f9253d3-ba97-4eda-a31f-e55c03316743 tempest-KeyPairsV210TestJSON-1298024825 tempest-KeyPairsV210TestJSON-1298024825-project-admin] Calling method '.version_select at 0x7fd3a4799310>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:50:27.540797 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-6f9253d3-ba97-4eda-a31f-e55c03316743 tempest-KeyPairsV210TestJSON-1298024825 tempest-KeyPairsV210TestJSON-1298024825-project-admin] 10.222.0.18 "GET /compute/v2.1/os-keypairs/tempest-keypair-81951606?user_id=be509469719e49ca8d82f68cdb2f52db" status: 200 len: 510 microversion: 2.10 time: 0.036059 Oct 22 20:50:27.541536 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 298/525] 10.222.0.18 () {60 vars in 1334 bytes} [Sat Oct 22 20:50:27 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-81951606?user_id=be509469719e49ca8d82f68cdb2f52db => generated 510 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 22 20:50:27.557417 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-76103710-dfb2-41f6-9a9a-64dda3d13005 tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-1169402091", "imageRef": "2417c8cd-813c-4850-927b-c5c7a19f86da", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "82271c74-769e-440f-89fe-4fb334e3b298"}], "security_groups": [{"name": "tempest-securitygroup--817348902"}], "key_name": "tempest-keypair-1140613902", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:50:27.911930 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.network.neutron [None req-76103710-dfb2-41f6-9a9a-64dda3d13005 tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] validate_networks() for [('82271c74-769e-440f-89fe-4fb334e3b298', None, None, None, None, None)] {{(pid=138745) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 20:50:27.928422 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-0a242eba-974b-47e0-bd29-7ad8f76fc7c6 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Flavor limits 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 20:50:27.929051 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-0a242eba-974b-47e0-bd29-7ad8f76fc7c6 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Image limits 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 20:50:27.929705 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-0a242eba-974b-47e0-bd29-7ad8f76fc7c6 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Flavor pref 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 20:50:27.931120 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-0a242eba-974b-47e0-bd29-7ad8f76fc7c6 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Image pref 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 20:50:27.931852 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-0a242eba-974b-47e0-bd29-7ad8f76fc7c6 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 20:50:27.952693 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0a242eba-974b-47e0-bd29-7ad8f76fc7c6 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:50:27.953206 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0a242eba-974b-47e0-bd29-7ad8f76fc7c6 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:50:27.955117 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0a242eba-974b-47e0-bd29-7ad8f76fc7c6 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:50:27.958635 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0a242eba-974b-47e0-bd29-7ad8f76fc7c6 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:50:27.960136 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0a242eba-974b-47e0-bd29-7ad8f76fc7c6 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:50:27.963056 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0a242eba-974b-47e0-bd29-7ad8f76fc7c6 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:50:28.033013 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-0a242eba-974b-47e0-bd29-7ad8f76fc7c6 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Getting quotas for project 9f0ee8c8f7fc4e12bc1f9fcce3e7b581. Resources: {'cores', 'instances', 'ram'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 20:50:28.046576 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-0a242eba-974b-47e0-bd29-7ad8f76fc7c6 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Getting quotas for user 2c87f0356ca346f39c6216393d85da2f and project 9f0ee8c8f7fc4e12bc1f9fcce3e7b581. Resources: {'cores', 'instances', 'ram'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 20:50:28.086819 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-0a242eba-974b-47e0-bd29-7ad8f76fc7c6 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Going to run 1 instances... {{(pid=138744) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 20:50:28.096069 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-0a242eba-974b-47e0-bd29-7ad8f76fc7c6 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] [instance: fe83cd49-4ceb-49aa-a775-cc2a4229fd76] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='085e4478-6edc-4a69-8e08-f9831713eb65',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138744) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 20:50:28.195296 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-0a242eba-974b-47e0-bd29-7ad8f76fc7c6 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.047480 Oct 22 20:50:28.199420 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 228/526] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Oct 22 20:50:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 3051 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 20:50:28.220226 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-ac77f2eb-3133-421a-b7d8-61d02ca91be1 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:50:28.221341 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-ac77f2eb-3133-421a-b7d8-61d02ca91be1 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] [instance: 69ed98a2-c208-4765-88b1-3e76a09cc481] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:50:28.234994 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ac77f2eb-3133-421a-b7d8-61d02ca91be1 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:50:28.235742 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ac77f2eb-3133-421a-b7d8-61d02ca91be1 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:50:28.238697 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ac77f2eb-3133-421a-b7d8-61d02ca91be1 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:50:28.240347 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ac77f2eb-3133-421a-b7d8-61d02ca91be1 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:50:28.241192 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ac77f2eb-3133-421a-b7d8-61d02ca91be1 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:50:28.242893 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ac77f2eb-3133-421a-b7d8-61d02ca91be1 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:50:28.515486 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-ac77f2eb-3133-421a-b7d8-61d02ca91be1 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91cf84a287b74618ae1b3368785b0b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902e239d67664098895ab24340b0b780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:50:28.533532 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-ac77f2eb-3133-421a-b7d8-61d02ca91be1 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] 10.222.0.18 "GET /compute/v2.1/servers/69ed98a2-c208-4765-88b1-3e76a09cc481" status: 200 len: 1275 microversion: 2.1 time: 0.332088 Oct 22 20:50:28.535839 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 229/527] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:50:28 2022] GET /compute/v2.1/servers/69ed98a2-c208-4765-88b1-3e76a09cc481 => generated 1275 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:50:28.554350 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-6893e30c-029f-4917-b415-a5e7c371ea4a tempest-KeyPairsV210TestJSON-1298024825 tempest-KeyPairsV210TestJSON-1298024825-project-admin] Action: 'create', calling method: .version_select at 0x7fd3a445d5e0>, body: {"keypair": {"name": "tempest-KeyPairsV210TestJSON-keypair-1709917807", "type": "ssh", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGvG9qIe+KdS0Mt76s7SuWeKiSWSbwtFQCRSspYYP0CaWTE9eUn47Gf5qNmr1OsVcFWnek0t3JQTwUczdeqrNmPuRF7sQDIl9qUU/ip3hKL5VCvwhk0PDCPYoqGICmLv+w=="}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:50:28.603519 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-6893e30c-029f-4917-b415-a5e7c371ea4a tempest-KeyPairsV210TestJSON-1298024825 tempest-KeyPairsV210TestJSON-1298024825-project-admin] Getting quotas for project b2b8930951c74fc8810e5e80eb081fd9. Resources: {'key_pairs'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 20:50:28.618773 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-6893e30c-029f-4917-b415-a5e7c371ea4a tempest-KeyPairsV210TestJSON-1298024825 tempest-KeyPairsV210TestJSON-1298024825-project-admin] Getting quotas for user 621bdad559ca4a44b6c6f3d59adb2e37 and project b2b8930951c74fc8810e5e80eb081fd9. Resources: {'key_pairs'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 20:50:28.676394 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-6893e30c-029f-4917-b415-a5e7c371ea4a tempest-KeyPairsV210TestJSON-1298024825 tempest-KeyPairsV210TestJSON-1298024825-project-admin] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 201 len: 422 microversion: 2.10 time: 0.138239 Oct 22 20:50:28.677532 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 230/528] 10.222.0.18 () {62 vars in 1200 bytes} [Sat Oct 22 20:50:28 2022] POST /compute/v2.1/os-keypairs => generated 422 bytes in 141 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 22 20:50:28.690993 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-d45a8477-0d32-4d6d-9421-a218f4806d45 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:50:28.691656 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-d45a8477-0d32-4d6d-9421-a218f4806d45 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] [instance: 254dfdd3-3716-43cf-aadc-f678aff08d27] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:50:28.713493 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d45a8477-0d32-4d6d-9421-a218f4806d45 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:50:28.714239 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d45a8477-0d32-4d6d-9421-a218f4806d45 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:50:28.714864 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d45a8477-0d32-4d6d-9421-a218f4806d45 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:50:28.715822 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d45a8477-0d32-4d6d-9421-a218f4806d45 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:50:28.716429 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d45a8477-0d32-4d6d-9421-a218f4806d45 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:50:28.723180 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d45a8477-0d32-4d6d-9421-a218f4806d45 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:50:30.304568 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-d45a8477-0d32-4d6d-9421-a218f4806d45 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:50:30.322484 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-d45a8477-0d32-4d6d-9421-a218f4806d45 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:50:30.324238 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-d45a8477-0d32-4d6d-9421-a218f4806d45 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:50:30.325700 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-d45a8477-0d32-4d6d-9421-a218f4806d45 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] 10.222.0.18 "GET /compute/v2.1/servers/254dfdd3-3716-43cf-aadc-f678aff08d27" status: 200 len: 1362 microversion: 2.25 time: 1.646994 Oct 22 20:50:30.326433 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 231/529] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 20:50:28 2022] GET /compute/v2.1/servers/254dfdd3-3716-43cf-aadc-f678aff08d27 => generated 1362 bytes in 1648 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 20:50:30.336125 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-2c7c2a5c-422c-4723-bb29-b37e1c38b8be tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:50:30.338820 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-2c7c2a5c-422c-4723-bb29-b37e1c38b8be tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] [instance: fe83cd49-4ceb-49aa-a775-cc2a4229fd76] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:50:30.353996 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2c7c2a5c-422c-4723-bb29-b37e1c38b8be tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:50:30.354770 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2c7c2a5c-422c-4723-bb29-b37e1c38b8be tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:50:30.363271 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2c7c2a5c-422c-4723-bb29-b37e1c38b8be tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:50:30.364365 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2c7c2a5c-422c-4723-bb29-b37e1c38b8be tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:50:30.364991 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2c7c2a5c-422c-4723-bb29-b37e1c38b8be tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:50:30.365574 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2c7c2a5c-422c-4723-bb29-b37e1c38b8be tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:50:30.573115 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-2c7c2a5c-422c-4723-bb29-b37e1c38b8be tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c87f0356ca346f39c6216393d85da2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee8c8f7fc4e12bc1f9fcce3e7b581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:50:30.598718 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-2c7c2a5c-422c-4723-bb29-b37e1c38b8be tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] 10.222.0.18 "GET /compute/v2.1/servers/fe83cd49-4ceb-49aa-a775-cc2a4229fd76" status: 200 len: 1270 microversion: 2.1 time: 0.270845 Oct 22 20:50:30.617637 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 232/530] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:50:30 2022] GET /compute/v2.1/servers/fe83cd49-4ceb-49aa-a775-cc2a4229fd76 => generated 1270 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:50:30.656784 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-9848923f-2255-49c1-bbc2-5072a307da20 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:50:30.657510 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-9848923f-2255-49c1-bbc2-5072a307da20 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] [instance: 4c53f81e-f4d8-4b41-b03a-ba9acb867226] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:50:30.676890 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9848923f-2255-49c1-bbc2-5072a307da20 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:50:30.679869 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9848923f-2255-49c1-bbc2-5072a307da20 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:50:30.684148 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9848923f-2255-49c1-bbc2-5072a307da20 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:50:30.686560 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9848923f-2255-49c1-bbc2-5072a307da20 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:50:30.687967 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9848923f-2255-49c1-bbc2-5072a307da20 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:50:30.690883 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9848923f-2255-49c1-bbc2-5072a307da20 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:50:31.475689 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-76103710-dfb2-41f6-9a9a-64dda3d13005 tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] Flavor limits 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 20:50:31.476197 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-76103710-dfb2-41f6-9a9a-64dda3d13005 tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] Image limits 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 20:50:31.477277 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-76103710-dfb2-41f6-9a9a-64dda3d13005 tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] Flavor pref 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 20:50:31.477694 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-76103710-dfb2-41f6-9a9a-64dda3d13005 tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] Image pref 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 20:50:31.478112 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-76103710-dfb2-41f6-9a9a-64dda3d13005 tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 20:50:31.516179 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-76103710-dfb2-41f6-9a9a-64dda3d13005 tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:50:31.516795 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-76103710-dfb2-41f6-9a9a-64dda3d13005 tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:50:31.517253 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-76103710-dfb2-41f6-9a9a-64dda3d13005 tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:50:31.520211 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-76103710-dfb2-41f6-9a9a-64dda3d13005 tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:50:31.520700 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-76103710-dfb2-41f6-9a9a-64dda3d13005 tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:50:31.521150 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-76103710-dfb2-41f6-9a9a-64dda3d13005 tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:50:31.581047 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-76103710-dfb2-41f6-9a9a-64dda3d13005 tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] Getting quotas for project a7b403b83cad4babab211dafade27bde. Resources: {'cores', 'instances', 'ram'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 20:50:31.593335 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-76103710-dfb2-41f6-9a9a-64dda3d13005 tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] Getting quotas for user b892876156f34b0d99a6c853d0cd4905 and project a7b403b83cad4babab211dafade27bde. Resources: {'cores', 'instances', 'ram'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 20:50:31.627646 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-76103710-dfb2-41f6-9a9a-64dda3d13005 tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] Going to run 1 instances... {{(pid=138745) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 20:50:31.634095 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-76103710-dfb2-41f6-9a9a-64dda3d13005 tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] [instance: 65381d5e-1265-418b-ac70-4ef749d9af14] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2417c8cd-813c-4850-927b-c5c7a19f86da',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138745) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 20:50:31.759302 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-76103710-dfb2-41f6-9a9a-64dda3d13005 tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 4.212105 Oct 22 20:50:31.761924 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 299/531] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Oct 22 20:50:27 2022] POST /compute/v2.1/servers => generated 405 bytes in 4220 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 20:50:31.773434 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-8606e227-397a-496f-bb48-dc89402cd14d tempest-KeyPairsV210TestJSON-1298024825 tempest-KeyPairsV210TestJSON-1298024825-project-admin] Calling method '.version_select at 0x7fd3a482a820>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:50:31.789897 ncdv-master-1 devstack@n-api.service[138745]: WARNING oslo_db.sqlalchemy.utils [None req-8606e227-397a-496f-bb48-dc89402cd14d tempest-KeyPairsV210TestJSON-1298024825 tempest-KeyPairsV210TestJSON-1298024825-project-admin] Unique keys not in sort_keys. The sorting order may be unstable. Oct 22 20:50:31.804415 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-8606e227-397a-496f-bb48-dc89402cd14d tempest-KeyPairsV210TestJSON-1298024825 tempest-KeyPairsV210TestJSON-1298024825-project-admin] 10.222.0.18 "GET /compute/v2.1/os-keypairs?user_id=be509469719e49ca8d82f68cdb2f52db" status: 200 len: 723 microversion: 2.10 time: 0.039298 Oct 22 20:50:31.807912 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 300/532] 10.222.0.18 () {60 vars in 1259 bytes} [Sat Oct 22 20:50:31 2022] GET /compute/v2.1/os-keypairs?user_id=be509469719e49ca8d82f68cdb2f52db => generated 723 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 22 20:50:31.814074 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-df8b399a-d39d-4c85-896b-c598ef0b33e2 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:50:31.825129 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-df8b399a-d39d-4c85-896b-c598ef0b33e2 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] [instance: 69ed98a2-c208-4765-88b1-3e76a09cc481] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:50:31.840784 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-df8b399a-d39d-4c85-896b-c598ef0b33e2 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:50:31.848474 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-df8b399a-d39d-4c85-896b-c598ef0b33e2 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:50:31.849235 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-df8b399a-d39d-4c85-896b-c598ef0b33e2 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:50:31.850215 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-df8b399a-d39d-4c85-896b-c598ef0b33e2 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:50:31.850826 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-df8b399a-d39d-4c85-896b-c598ef0b33e2 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:50:31.851449 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-df8b399a-d39d-4c85-896b-c598ef0b33e2 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:50:32.065965 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-9848923f-2255-49c1-bbc2-5072a307da20 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9bba9ed37d7430e82e7d310982b8e47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30dbbdc150694e0ebc07c63e90280d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:50:32.084104 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-9848923f-2255-49c1-bbc2-5072a307da20 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] 10.222.0.18 "GET /compute/v2.1/servers/4c53f81e-f4d8-4b41-b03a-ba9acb867226" status: 200 len: 1388 microversion: 2.1 time: 1.464131 Oct 22 20:50:32.086399 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 233/533] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:50:30 2022] GET /compute/v2.1/servers/4c53f81e-f4d8-4b41-b03a-ba9acb867226 => generated 1388 bytes in 1468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:50:32.108327 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-6a90fc9f-d73b-4c51-a4b3-5bd27a1c4c3d req-f84a9788-d7fd-4830-afe3-30b3b7cb97ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c53f81e-f4d8-4b41-b03a-ba9acb867226", "tag": "94e91c18-1bda-4ad5-9d8b-805c0859ebdd"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:50:32.150166 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-6a90fc9f-d73b-4c51-a4b3-5bd27a1c4c3d req-f84a9788-d7fd-4830-afe3-30b3b7cb97ec service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:50:32.150752 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-6a90fc9f-d73b-4c51-a4b3-5bd27a1c4c3d req-f84a9788-d7fd-4830-afe3-30b3b7cb97ec service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:50:32.151212 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-6a90fc9f-d73b-4c51-a4b3-5bd27a1c4c3d req-f84a9788-d7fd-4830-afe3-30b3b7cb97ec service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:50:32.212119 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-6a90fc9f-d73b-4c51-a4b3-5bd27a1c4c3d req-f84a9788-d7fd-4830-afe3-30b3b7cb97ec service nova] Creating event network-changed:94e91c18-1bda-4ad5-9d8b-805c0859ebdd for instance 4c53f81e-f4d8-4b41-b03a-ba9acb867226 on nch1-master-1 Oct 22 20:50:32.241626 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-6a90fc9f-d73b-4c51-a4b3-5bd27a1c4c3d req-f84a9788-d7fd-4830-afe3-30b3b7cb97ec service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.152805 Oct 22 20:50:32.243422 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 234/534] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:50:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:50:32.249285 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-2d371d80-59bb-4ebd-b11d-f637d050e313 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:50:32.249899 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-2d371d80-59bb-4ebd-b11d-f637d050e313 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] [instance: 254dfdd3-3716-43cf-aadc-f678aff08d27] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:50:32.257514 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-df8b399a-d39d-4c85-896b-c598ef0b33e2 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91cf84a287b74618ae1b3368785b0b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902e239d67664098895ab24340b0b780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:50:32.270942 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-df8b399a-d39d-4c85-896b-c598ef0b33e2 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] 10.222.0.18 "GET /compute/v2.1/servers/69ed98a2-c208-4765-88b1-3e76a09cc481" status: 200 len: 1275 microversion: 2.1 time: 0.460686 Oct 22 20:50:32.281115 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 301/535] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:50:31 2022] GET /compute/v2.1/servers/69ed98a2-c208-4765-88b1-3e76a09cc481 => generated 1275 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:50:32.304356 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-c82a8aca-e2e5-4d38-914c-1d92ec1f2c71 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:50:32.305019 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-c82a8aca-e2e5-4d38-914c-1d92ec1f2c71 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] [instance: fe83cd49-4ceb-49aa-a775-cc2a4229fd76] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:50:32.316500 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2d371d80-59bb-4ebd-b11d-f637d050e313 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:50:32.319405 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2d371d80-59bb-4ebd-b11d-f637d050e313 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:50:32.319946 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2d371d80-59bb-4ebd-b11d-f637d050e313 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:50:32.320716 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2d371d80-59bb-4ebd-b11d-f637d050e313 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:50:32.321191 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2d371d80-59bb-4ebd-b11d-f637d050e313 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:50:32.326399 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2d371d80-59bb-4ebd-b11d-f637d050e313 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:50:32.346297 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c82a8aca-e2e5-4d38-914c-1d92ec1f2c71 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:50:32.346817 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c82a8aca-e2e5-4d38-914c-1d92ec1f2c71 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:50:32.347267 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c82a8aca-e2e5-4d38-914c-1d92ec1f2c71 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:50:32.348031 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c82a8aca-e2e5-4d38-914c-1d92ec1f2c71 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:50:32.348504 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c82a8aca-e2e5-4d38-914c-1d92ec1f2c71 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:50:32.348933 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c82a8aca-e2e5-4d38-914c-1d92ec1f2c71 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:50:32.995306 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-2d371d80-59bb-4ebd-b11d-f637d050e313 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:50:33.010728 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-2d371d80-59bb-4ebd-b11d-f637d050e313 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:50:33.021177 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-2d371d80-59bb-4ebd-b11d-f637d050e313 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:50:33.028136 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-2d371d80-59bb-4ebd-b11d-f637d050e313 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] 10.222.0.18 "GET /compute/v2.1/servers/254dfdd3-3716-43cf-aadc-f678aff08d27" status: 200 len: 1362 microversion: 2.25 time: 0.783368 Oct 22 20:50:33.029227 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 235/536] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 20:50:32 2022] GET /compute/v2.1/servers/254dfdd3-3716-43cf-aadc-f678aff08d27 => generated 1362 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 20:50:33.044199 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-6c9b1f3e-466f-41ba-bbe9-aa141ae4e5df tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:50:33.049299 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-6c9b1f3e-466f-41ba-bbe9-aa141ae4e5df tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] [instance: 65381d5e-1265-418b-ac70-4ef749d9af14] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:50:33.288918 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-6c9b1f3e-466f-41ba-bbe9-aa141ae4e5df tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b892876156f34b0d99a6c853d0cd4905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b403b83cad4babab211dafade27bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:50:33.293022 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell0:SELECT=31 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:50:33.310959 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-6c9b1f3e-466f-41ba-bbe9-aa141ae4e5df tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] 10.222.0.18 "GET /compute/v2.1/servers/65381d5e-1265-418b-ac70-4ef749d9af14" status: 200 len: 1246 microversion: 2.1 time: 0.276596 Oct 22 20:50:33.311918 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 236/537] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:50:33 2022] GET /compute/v2.1/servers/65381d5e-1265-418b-ac70-4ef749d9af14 => generated 1246 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:50:33.339178 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-4d56e899-2f86-4ebd-a063-0c74c5a135e9 tempest-KeyPairsV210TestJSON-1298024825 tempest-KeyPairsV210TestJSON-1298024825-project-admin] Calling method '.version_select at 0x7fd3a461cca0>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:50:33.401343 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-4d56e899-2f86-4ebd-a063-0c74c5a135e9 tempest-KeyPairsV210TestJSON-1298024825 tempest-KeyPairsV210TestJSON-1298024825-project-admin] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-1709917807" status: 204 len: 0 microversion: 2.10 time: 0.087799 Oct 22 20:50:33.412247 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 237/538] 10.222.0.18 () {60 vars in 1325 bytes} [Sat Oct 22 20:50:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-1709917807 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 22 20:50:33.417763 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-4b4fa8f4-7152-48c3-b186-4bf1a460e9ef tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:50:33.418600 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-4b4fa8f4-7152-48c3-b186-4bf1a460e9ef tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] [instance: 4c53f81e-f4d8-4b41-b03a-ba9acb867226] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:50:33.425584 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4b4fa8f4-7152-48c3-b186-4bf1a460e9ef tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:50:33.426319 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4b4fa8f4-7152-48c3-b186-4bf1a460e9ef tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:50:33.426921 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4b4fa8f4-7152-48c3-b186-4bf1a460e9ef tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:50:33.429150 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4b4fa8f4-7152-48c3-b186-4bf1a460e9ef tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:50:33.429794 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4b4fa8f4-7152-48c3-b186-4bf1a460e9ef tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:50:33.430377 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4b4fa8f4-7152-48c3-b186-4bf1a460e9ef tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:50:34.020779 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-c82a8aca-e2e5-4d38-914c-1d92ec1f2c71 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c87f0356ca346f39c6216393d85da2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee8c8f7fc4e12bc1f9fcce3e7b581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:50:34.032879 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:50:34.042787 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-c82a8aca-e2e5-4d38-914c-1d92ec1f2c71 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] 10.222.0.18 "GET /compute/v2.1/servers/fe83cd49-4ceb-49aa-a775-cc2a4229fd76" status: 200 len: 1310 microversion: 2.1 time: 1.759593 Oct 22 20:50:34.061772 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 302/539] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:50:32 2022] GET /compute/v2.1/servers/fe83cd49-4ceb-49aa-a775-cc2a4229fd76 => generated 1310 bytes in 1774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:50:34.101196 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-7954108d-5d4c-40d1-afca-88be836264b6 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:50:34.104309 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-7954108d-5d4c-40d1-afca-88be836264b6 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] [instance: 69ed98a2-c208-4765-88b1-3e76a09cc481] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:50:34.131890 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7954108d-5d4c-40d1-afca-88be836264b6 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:50:34.132571 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7954108d-5d4c-40d1-afca-88be836264b6 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:50:34.134740 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7954108d-5d4c-40d1-afca-88be836264b6 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:50:34.136051 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7954108d-5d4c-40d1-afca-88be836264b6 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:50:34.137330 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7954108d-5d4c-40d1-afca-88be836264b6 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:50:34.138972 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7954108d-5d4c-40d1-afca-88be836264b6 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:50:34.808565 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-4b4fa8f4-7152-48c3-b186-4bf1a460e9ef tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9bba9ed37d7430e82e7d310982b8e47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30dbbdc150694e0ebc07c63e90280d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:50:34.823553 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-4b4fa8f4-7152-48c3-b186-4bf1a460e9ef tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] 10.222.0.18 "GET /compute/v2.1/servers/4c53f81e-f4d8-4b41-b03a-ba9acb867226" status: 200 len: 1388 microversion: 2.1 time: 1.408240 Oct 22 20:50:34.838121 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-7954108d-5d4c-40d1-afca-88be836264b6 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91cf84a287b74618ae1b3368785b0b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902e239d67664098895ab24340b0b780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:50:34.843633 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 238/540] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:50:33 2022] GET /compute/v2.1/servers/4c53f81e-f4d8-4b41-b03a-ba9acb867226 => generated 1388 bytes in 1430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:50:34.850320 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-e0d99979-39d3-404e-ab3b-d86996e6c3e2 tempest-KeyPairsV210TestJSON-1298024825 tempest-KeyPairsV210TestJSON-1298024825-project-admin] Calling method '.version_select at 0x7fd3a44b2d30>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:50:34.851932 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-7954108d-5d4c-40d1-afca-88be836264b6 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] 10.222.0.18 "GET /compute/v2.1/servers/69ed98a2-c208-4765-88b1-3e76a09cc481" status: 200 len: 1317 microversion: 2.1 time: 0.786996 Oct 22 20:50:34.869054 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 303/541] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:50:34 2022] GET /compute/v2.1/servers/69ed98a2-c208-4765-88b1-3e76a09cc481 => generated 1317 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:50:34.878504 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-d708fd3e-4424-4aa5-ac24-bb4a3aa27471 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:50:34.879495 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-d708fd3e-4424-4aa5-ac24-bb4a3aa27471 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] [instance: 254dfdd3-3716-43cf-aadc-f678aff08d27] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:50:34.886249 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d708fd3e-4424-4aa5-ac24-bb4a3aa27471 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:50:34.887075 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d708fd3e-4424-4aa5-ac24-bb4a3aa27471 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:50:34.887727 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d708fd3e-4424-4aa5-ac24-bb4a3aa27471 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:50:34.888583 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d708fd3e-4424-4aa5-ac24-bb4a3aa27471 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:50:34.889313 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d708fd3e-4424-4aa5-ac24-bb4a3aa27471 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:50:34.889874 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d708fd3e-4424-4aa5-ac24-bb4a3aa27471 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:50:34.913183 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-e0d99979-39d3-404e-ab3b-d86996e6c3e2 tempest-KeyPairsV210TestJSON-1298024825 tempest-KeyPairsV210TestJSON-1298024825-project-admin] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-952504972?user_id=be509469719e49ca8d82f68cdb2f52db" status: 204 len: 0 microversion: 2.10 time: 0.068319 Oct 22 20:50:34.917456 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 239/542] 10.222.0.18 () {60 vars in 1340 bytes} [Sat Oct 22 20:50:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-952504972?user_id=be509469719e49ca8d82f68cdb2f52db => generated 0 bytes in 73 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 22 20:50:34.933802 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-b24a5898-c01c-4e59-8197-48fb08e304cf req-c5d2d42f-2c51-4a5b-af78-e718febf611f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe83cd49-4ceb-49aa-a775-cc2a4229fd76", "tag": "5f1c98e3-36fa-4e76-8bc6-b184fe0c58b3"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:50:34.944926 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-b24a5898-c01c-4e59-8197-48fb08e304cf req-c5d2d42f-2c51-4a5b-af78-e718febf611f service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:50:34.946116 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-b24a5898-c01c-4e59-8197-48fb08e304cf req-c5d2d42f-2c51-4a5b-af78-e718febf611f service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:50:34.946709 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-b24a5898-c01c-4e59-8197-48fb08e304cf req-c5d2d42f-2c51-4a5b-af78-e718febf611f service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:50:34.963674 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-b24a5898-c01c-4e59-8197-48fb08e304cf req-c5d2d42f-2c51-4a5b-af78-e718febf611f service nova] Creating event network-changed:5f1c98e3-36fa-4e76-8bc6-b184fe0c58b3 for instance fe83cd49-4ceb-49aa-a775-cc2a4229fd76 on nch2-master-1 Oct 22 20:50:34.984201 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-b24a5898-c01c-4e59-8197-48fb08e304cf req-c5d2d42f-2c51-4a5b-af78-e718febf611f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062728 Oct 22 20:50:34.986436 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 240/543] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:50:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:50:34.996147 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-2419492b-a623-4282-aa21-8ccb8e3d09e8 tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:50:35.002734 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-2419492b-a623-4282-aa21-8ccb8e3d09e8 tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] [instance: 65381d5e-1265-418b-ac70-4ef749d9af14] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:50:35.021173 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2419492b-a623-4282-aa21-8ccb8e3d09e8 tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:50:35.022460 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2419492b-a623-4282-aa21-8ccb8e3d09e8 tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:50:35.023305 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2419492b-a623-4282-aa21-8ccb8e3d09e8 tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:50:35.024903 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2419492b-a623-4282-aa21-8ccb8e3d09e8 tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:50:35.025550 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2419492b-a623-4282-aa21-8ccb8e3d09e8 tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:50:35.026186 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2419492b-a623-4282-aa21-8ccb8e3d09e8 tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:50:35.249980 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-2419492b-a623-4282-aa21-8ccb8e3d09e8 tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b892876156f34b0d99a6c853d0cd4905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b403b83cad4babab211dafade27bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:50:35.271243 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-2419492b-a623-4282-aa21-8ccb8e3d09e8 tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] 10.222.0.18 "GET /compute/v2.1/servers/65381d5e-1265-418b-ac70-4ef749d9af14" status: 200 len: 1304 microversion: 2.1 time: 0.280118 Oct 22 20:50:35.273909 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 241/544] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:50:34 2022] GET /compute/v2.1/servers/65381d5e-1265-418b-ac70-4ef749d9af14 => generated 1304 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:50:35.279989 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-00e1d199-bd88-4c21-8f06-b2abbf20d2c9 req-77fb3ed4-b365-41b8-bd21-d35b3da789e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "254dfdd3-3716-43cf-aadc-f678aff08d27", "name": "network-vif-plugged", "status": "completed", "tag": "aa3c904e-442d-4f48-8da8-c9451b740c64"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:50:35.288514 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_api:INSERT=11,nova_api:SELECT=87,nova_api:DELETE=2 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:50:35.302983 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-00e1d199-bd88-4c21-8f06-b2abbf20d2c9 req-77fb3ed4-b365-41b8-bd21-d35b3da789e1 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:50:35.311191 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-00e1d199-bd88-4c21-8f06-b2abbf20d2c9 req-77fb3ed4-b365-41b8-bd21-d35b3da789e1 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:50:35.312266 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-00e1d199-bd88-4c21-8f06-b2abbf20d2c9 req-77fb3ed4-b365-41b8-bd21-d35b3da789e1 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:50:35.342117 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-00e1d199-bd88-4c21-8f06-b2abbf20d2c9 req-77fb3ed4-b365-41b8-bd21-d35b3da789e1 service nova] Creating event network-vif-plugged:aa3c904e-442d-4f48-8da8-c9451b740c64 for instance 254dfdd3-3716-43cf-aadc-f678aff08d27 on nch2-master-1 Oct 22 20:50:35.351263 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-00e1d199-bd88-4c21-8f06-b2abbf20d2c9 req-77fb3ed4-b365-41b8-bd21-d35b3da789e1 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075236 Oct 22 20:50:35.353446 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 242/545] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:50:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:50:35.377340 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-d0fc6f2a-66f5-424f-b4eb-9ddabf663f23 tempest-KeyPairsV210TestJSON-1298024825 tempest-KeyPairsV210TestJSON-1298024825-project-admin] Calling method '.version_select at 0x7fd3a44b43a0>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:50:35.427842 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-d0fc6f2a-66f5-424f-b4eb-9ddabf663f23 tempest-KeyPairsV210TestJSON-1298024825 tempest-KeyPairsV210TestJSON-1298024825-project-admin] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-81951606?user_id=be509469719e49ca8d82f68cdb2f52db" status: 204 len: 0 microversion: 2.10 time: 0.070871 Oct 22 20:50:35.438275 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 243/546] 10.222.0.18 () {60 vars in 1337 bytes} [Sat Oct 22 20:50:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-81951606?user_id=be509469719e49ca8d82f68cdb2f52db => generated 0 bytes in 77 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 22 20:50:35.448904 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-dd9aa9a1-278c-4a29-9214-61413dcf9a73 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:50:35.450538 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-dd9aa9a1-278c-4a29-9214-61413dcf9a73 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] [instance: fe83cd49-4ceb-49aa-a775-cc2a4229fd76] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:50:35.462833 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-dd9aa9a1-278c-4a29-9214-61413dcf9a73 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:50:35.463491 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-dd9aa9a1-278c-4a29-9214-61413dcf9a73 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:50:35.463988 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-dd9aa9a1-278c-4a29-9214-61413dcf9a73 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:50:35.465240 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-dd9aa9a1-278c-4a29-9214-61413dcf9a73 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:50:35.465851 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-dd9aa9a1-278c-4a29-9214-61413dcf9a73 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:50:35.466295 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-dd9aa9a1-278c-4a29-9214-61413dcf9a73 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:50:36.028480 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-d708fd3e-4424-4aa5-ac24-bb4a3aa27471 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:50:36.040569 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-d708fd3e-4424-4aa5-ac24-bb4a3aa27471 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:50:36.047624 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-d708fd3e-4424-4aa5-ac24-bb4a3aa27471 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:50:36.049281 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-d708fd3e-4424-4aa5-ac24-bb4a3aa27471 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] 10.222.0.18 "GET /compute/v2.1/servers/254dfdd3-3716-43cf-aadc-f678aff08d27" status: 200 len: 1362 microversion: 2.25 time: 1.178215 Oct 22 20:50:36.049859 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 304/547] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 20:50:34 2022] GET /compute/v2.1/servers/254dfdd3-3716-43cf-aadc-f678aff08d27 => generated 1362 bytes in 1180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 20:50:36.054715 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-cebbd140-d0bc-49ed-b119-a668b086df9a tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:50:36.055592 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-cebbd140-d0bc-49ed-b119-a668b086df9a tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] [instance: 4c53f81e-f4d8-4b41-b03a-ba9acb867226] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:50:36.063048 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cebbd140-d0bc-49ed-b119-a668b086df9a tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:50:36.063596 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cebbd140-d0bc-49ed-b119-a668b086df9a tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:50:36.064029 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cebbd140-d0bc-49ed-b119-a668b086df9a tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:50:36.064914 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cebbd140-d0bc-49ed-b119-a668b086df9a tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:50:36.065563 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cebbd140-d0bc-49ed-b119-a668b086df9a tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:50:36.065996 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cebbd140-d0bc-49ed-b119-a668b086df9a tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:50:36.245408 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-dd9aa9a1-278c-4a29-9214-61413dcf9a73 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c87f0356ca346f39c6216393d85da2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee8c8f7fc4e12bc1f9fcce3e7b581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:50:36.265949 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-dd9aa9a1-278c-4a29-9214-61413dcf9a73 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] 10.222.0.18 "GET /compute/v2.1/servers/fe83cd49-4ceb-49aa-a775-cc2a4229fd76" status: 200 len: 1310 microversion: 2.1 time: 0.825871 Oct 22 20:50:36.266901 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 244/548] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:50:35 2022] GET /compute/v2.1/servers/fe83cd49-4ceb-49aa-a775-cc2a4229fd76 => generated 1310 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:50:36.286016 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-739e4276-c229-4b1f-9943-b74258118a84 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:50:36.286820 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-739e4276-c229-4b1f-9943-b74258118a84 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] [instance: 69ed98a2-c208-4765-88b1-3e76a09cc481] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:50:36.293382 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-739e4276-c229-4b1f-9943-b74258118a84 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:50:36.304151 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-739e4276-c229-4b1f-9943-b74258118a84 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:50:36.304950 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-739e4276-c229-4b1f-9943-b74258118a84 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:50:36.306041 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-739e4276-c229-4b1f-9943-b74258118a84 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:50:36.306692 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-739e4276-c229-4b1f-9943-b74258118a84 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:50:36.307312 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-739e4276-c229-4b1f-9943-b74258118a84 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:50:36.517513 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-cebbd140-d0bc-49ed-b119-a668b086df9a tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9bba9ed37d7430e82e7d310982b8e47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30dbbdc150694e0ebc07c63e90280d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:50:36.532164 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-cebbd140-d0bc-49ed-b119-a668b086df9a tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] 10.222.0.18 "GET /compute/v2.1/servers/4c53f81e-f4d8-4b41-b03a-ba9acb867226" status: 200 len: 1388 microversion: 2.1 time: 0.480995 Oct 22 20:50:36.532761 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 305/549] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:50:36 2022] GET /compute/v2.1/servers/4c53f81e-f4d8-4b41-b03a-ba9acb867226 => generated 1388 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:50:36.551546 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-55f266e3-9add-4063-9487-55ab15988487 tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:50:36.552356 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-55f266e3-9add-4063-9487-55ab15988487 tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] [instance: 65381d5e-1265-418b-ac70-4ef749d9af14] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:50:36.561091 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-55f266e3-9add-4063-9487-55ab15988487 tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:50:36.561844 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-55f266e3-9add-4063-9487-55ab15988487 tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:50:36.562447 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-55f266e3-9add-4063-9487-55ab15988487 tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:50:36.565102 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-55f266e3-9add-4063-9487-55ab15988487 tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:50:36.565746 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-55f266e3-9add-4063-9487-55ab15988487 tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:50:36.568198 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-55f266e3-9add-4063-9487-55ab15988487 tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:50:36.724178 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-739e4276-c229-4b1f-9943-b74258118a84 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91cf84a287b74618ae1b3368785b0b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902e239d67664098895ab24340b0b780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:50:36.726372 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:SELECT=90 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:50:36.733440 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-55f266e3-9add-4063-9487-55ab15988487 tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b892876156f34b0d99a6c853d0cd4905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b403b83cad4babab211dafade27bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:50:36.733667 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-739e4276-c229-4b1f-9943-b74258118a84 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] 10.222.0.18 "GET /compute/v2.1/servers/69ed98a2-c208-4765-88b1-3e76a09cc481" status: 200 len: 1317 microversion: 2.1 time: 0.465359 Oct 22 20:50:36.742879 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-55f266e3-9add-4063-9487-55ab15988487 tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] 10.222.0.18 "GET /compute/v2.1/servers/65381d5e-1265-418b-ac70-4ef749d9af14" status: 200 len: 1304 microversion: 2.1 time: 0.209083 Oct 22 20:50:36.743737 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 306/550] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:50:36 2022] GET /compute/v2.1/servers/65381d5e-1265-418b-ac70-4ef749d9af14 => generated 1304 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:50:36.747677 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 245/551] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:50:36 2022] GET /compute/v2.1/servers/69ed98a2-c208-4765-88b1-3e76a09cc481 => generated 1317 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:50:36.874118 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-379bb719-b5df-46e8-bc91-554e4659cecf req-f38e1736-9130-4770-89ee-993c6f1406b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69ed98a2-c208-4765-88b1-3e76a09cc481", "tag": "e967f24f-34ec-4633-8022-8dac0a05409f"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:50:36.886723 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-379bb719-b5df-46e8-bc91-554e4659cecf req-f38e1736-9130-4770-89ee-993c6f1406b4 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:50:36.887204 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-379bb719-b5df-46e8-bc91-554e4659cecf req-f38e1736-9130-4770-89ee-993c6f1406b4 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:50:36.887651 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-379bb719-b5df-46e8-bc91-554e4659cecf req-f38e1736-9130-4770-89ee-993c6f1406b4 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:50:37.076479 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-29e6e73c-86ab-4d3c-839b-df82b1bf360b tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:50:37.077304 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-29e6e73c-86ab-4d3c-839b-df82b1bf360b tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] [instance: 254dfdd3-3716-43cf-aadc-f678aff08d27] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:50:37.098519 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-29e6e73c-86ab-4d3c-839b-df82b1bf360b tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:50:37.104512 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-29e6e73c-86ab-4d3c-839b-df82b1bf360b tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:50:37.104983 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-29e6e73c-86ab-4d3c-839b-df82b1bf360b tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:50:37.115026 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-29e6e73c-86ab-4d3c-839b-df82b1bf360b tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:50:37.117032 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-29e6e73c-86ab-4d3c-839b-df82b1bf360b tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:50:37.117576 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-29e6e73c-86ab-4d3c-839b-df82b1bf360b tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:50:37.301998 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-379bb719-b5df-46e8-bc91-554e4659cecf req-f38e1736-9130-4770-89ee-993c6f1406b4 service nova] Creating event network-changed:e967f24f-34ec-4633-8022-8dac0a05409f for instance 69ed98a2-c208-4765-88b1-3e76a09cc481 on nch1-master-1 Oct 22 20:50:37.309401 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-379bb719-b5df-46e8-bc91-554e4659cecf req-f38e1736-9130-4770-89ee-993c6f1406b4 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.439659 Oct 22 20:50:37.310672 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 307/552] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:50:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:50:37.319842 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-be7d2748-ab83-45d1-af49-86bde425ef01 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:50:37.321164 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-be7d2748-ab83-45d1-af49-86bde425ef01 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] [instance: fe83cd49-4ceb-49aa-a775-cc2a4229fd76] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:50:37.330249 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-be7d2748-ab83-45d1-af49-86bde425ef01 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:50:37.331136 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-be7d2748-ab83-45d1-af49-86bde425ef01 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:50:37.332436 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-be7d2748-ab83-45d1-af49-86bde425ef01 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:50:37.333558 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-be7d2748-ab83-45d1-af49-86bde425ef01 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:50:37.334769 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-be7d2748-ab83-45d1-af49-86bde425ef01 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:50:37.335465 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-be7d2748-ab83-45d1-af49-86bde425ef01 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:50:37.999889 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell0:SELECT=4 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:50:38.297120 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-29e6e73c-86ab-4d3c-839b-df82b1bf360b tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:50:38.308115 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-29e6e73c-86ab-4d3c-839b-df82b1bf360b tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:50:38.309571 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-29e6e73c-86ab-4d3c-839b-df82b1bf360b tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:50:38.310708 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-29e6e73c-86ab-4d3c-839b-df82b1bf360b tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] 10.222.0.18 "GET /compute/v2.1/servers/254dfdd3-3716-43cf-aadc-f678aff08d27" status: 200 len: 1362 microversion: 2.25 time: 1.238423 Oct 22 20:50:38.311280 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 246/553] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 20:50:37 2022] GET /compute/v2.1/servers/254dfdd3-3716-43cf-aadc-f678aff08d27 => generated 1362 bytes in 1240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 22 20:50:38.326248 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-9b048d9d-25ee-4759-954e-d2aa8b74ce03 req-5758a281-bd66-4e3d-ba53-ca3ad950ec97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c53f81e-f4d8-4b41-b03a-ba9acb867226", "name": "network-vif-plugged", "status": "completed", "tag": "94e91c18-1bda-4ad5-9d8b-805c0859ebdd"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:50:38.341478 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-be7d2748-ab83-45d1-af49-86bde425ef01 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c87f0356ca346f39c6216393d85da2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee8c8f7fc4e12bc1f9fcce3e7b581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:50:38.353062 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-be7d2748-ab83-45d1-af49-86bde425ef01 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] 10.222.0.18 "GET /compute/v2.1/servers/fe83cd49-4ceb-49aa-a775-cc2a4229fd76" status: 200 len: 1310 microversion: 2.1 time: 1.040478 Oct 22 20:50:38.363640 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 308/554] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:50:37 2022] GET /compute/v2.1/servers/fe83cd49-4ceb-49aa-a775-cc2a4229fd76 => generated 1310 bytes in 1052 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:50:38.372529 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-6bc878cf-1f29-4bd5-b473-b84331e681c2 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:50:38.386922 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-6bc878cf-1f29-4bd5-b473-b84331e681c2 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] [instance: 4c53f81e-f4d8-4b41-b03a-ba9acb867226] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:50:38.400481 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-9b048d9d-25ee-4759-954e-d2aa8b74ce03 req-5758a281-bd66-4e3d-ba53-ca3ad950ec97 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:50:38.401606 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-9b048d9d-25ee-4759-954e-d2aa8b74ce03 req-5758a281-bd66-4e3d-ba53-ca3ad950ec97 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:50:38.403935 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-9b048d9d-25ee-4759-954e-d2aa8b74ce03 req-5758a281-bd66-4e3d-ba53-ca3ad950ec97 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:50:38.410299 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6bc878cf-1f29-4bd5-b473-b84331e681c2 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:50:38.415297 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6bc878cf-1f29-4bd5-b473-b84331e681c2 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:50:38.416021 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6bc878cf-1f29-4bd5-b473-b84331e681c2 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:50:38.417210 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6bc878cf-1f29-4bd5-b473-b84331e681c2 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:50:38.422134 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6bc878cf-1f29-4bd5-b473-b84331e681c2 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:50:38.422913 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6bc878cf-1f29-4bd5-b473-b84331e681c2 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:50:38.471517 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-9b048d9d-25ee-4759-954e-d2aa8b74ce03 req-5758a281-bd66-4e3d-ba53-ca3ad950ec97 service nova] Creating event network-vif-plugged:94e91c18-1bda-4ad5-9d8b-805c0859ebdd for instance 4c53f81e-f4d8-4b41-b03a-ba9acb867226 on nch1-master-1 Oct 22 20:50:38.504056 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-9b048d9d-25ee-4759-954e-d2aa8b74ce03 req-5758a281-bd66-4e3d-ba53-ca3ad950ec97 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.181308 Oct 22 20:50:38.513957 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 247/555] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:50:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:50:38.525337 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-309b7a44-9f2b-4592-80ba-65f5463a35fb tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:50:38.533220 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-309b7a44-9f2b-4592-80ba-65f5463a35fb tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] [instance: 69ed98a2-c208-4765-88b1-3e76a09cc481] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:50:38.557763 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-309b7a44-9f2b-4592-80ba-65f5463a35fb tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:50:38.565403 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-309b7a44-9f2b-4592-80ba-65f5463a35fb tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:50:38.568271 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-309b7a44-9f2b-4592-80ba-65f5463a35fb tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:50:38.572572 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-309b7a44-9f2b-4592-80ba-65f5463a35fb tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:50:38.575138 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-309b7a44-9f2b-4592-80ba-65f5463a35fb tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:50:38.576469 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-309b7a44-9f2b-4592-80ba-65f5463a35fb tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:50:39.424094 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-6bc878cf-1f29-4bd5-b473-b84331e681c2 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9bba9ed37d7430e82e7d310982b8e47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30dbbdc150694e0ebc07c63e90280d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:50:39.438082 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-6bc878cf-1f29-4bd5-b473-b84331e681c2 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] 10.222.0.18 "GET /compute/v2.1/servers/4c53f81e-f4d8-4b41-b03a-ba9acb867226" status: 200 len: 1388 microversion: 2.1 time: 1.072283 Oct 22 20:50:39.439463 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 309/556] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:50:38 2022] GET /compute/v2.1/servers/4c53f81e-f4d8-4b41-b03a-ba9acb867226 => generated 1388 bytes in 1074 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:50:39.449026 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-5c0afccf-e515-4afc-a0ca-2568ab70732f tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:50:39.450680 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-5c0afccf-e515-4afc-a0ca-2568ab70732f tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] [instance: 65381d5e-1265-418b-ac70-4ef749d9af14] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:50:39.485088 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:50:39.500650 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5c0afccf-e515-4afc-a0ca-2568ab70732f tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:50:39.503402 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5c0afccf-e515-4afc-a0ca-2568ab70732f tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:50:39.506300 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5c0afccf-e515-4afc-a0ca-2568ab70732f tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:50:39.508059 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5c0afccf-e515-4afc-a0ca-2568ab70732f tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:50:39.513985 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5c0afccf-e515-4afc-a0ca-2568ab70732f tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:50:39.514619 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5c0afccf-e515-4afc-a0ca-2568ab70732f tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:50:39.614643 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-309b7a44-9f2b-4592-80ba-65f5463a35fb tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91cf84a287b74618ae1b3368785b0b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902e239d67664098895ab24340b0b780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:50:39.630304 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-309b7a44-9f2b-4592-80ba-65f5463a35fb tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] 10.222.0.18 "GET /compute/v2.1/servers/69ed98a2-c208-4765-88b1-3e76a09cc481" status: 200 len: 1317 microversion: 2.1 time: 1.112090 Oct 22 20:50:39.631049 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 248/557] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:50:38 2022] GET /compute/v2.1/servers/69ed98a2-c208-4765-88b1-3e76a09cc481 => generated 1317 bytes in 1116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:50:39.666648 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-5ee85ae8-0326-4ac8-a8ff-ab0d8c32196c tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:50:39.678365 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-5ee85ae8-0326-4ac8-a8ff-ab0d8c32196c tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] [instance: 254dfdd3-3716-43cf-aadc-f678aff08d27] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:50:39.713725 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5ee85ae8-0326-4ac8-a8ff-ab0d8c32196c tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:50:39.714790 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5ee85ae8-0326-4ac8-a8ff-ab0d8c32196c tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:50:39.718533 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5ee85ae8-0326-4ac8-a8ff-ab0d8c32196c tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:50:39.720657 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5ee85ae8-0326-4ac8-a8ff-ab0d8c32196c tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:50:39.724908 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5ee85ae8-0326-4ac8-a8ff-ab0d8c32196c tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:50:39.725992 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5ee85ae8-0326-4ac8-a8ff-ab0d8c32196c tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:50:40.419555 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-5c0afccf-e515-4afc-a0ca-2568ab70732f tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b892876156f34b0d99a6c853d0cd4905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b403b83cad4babab211dafade27bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:50:40.434174 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-5c0afccf-e515-4afc-a0ca-2568ab70732f tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] 10.222.0.18 "GET /compute/v2.1/servers/65381d5e-1265-418b-ac70-4ef749d9af14" status: 200 len: 1304 microversion: 2.1 time: 0.992550 Oct 22 20:50:40.458355 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 310/558] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:50:39 2022] GET /compute/v2.1/servers/65381d5e-1265-418b-ac70-4ef749d9af14 => generated 1304 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:50:40.477112 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-215aa25a-44a3-4098-8857-f2f5e2c117e3 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:50:40.479681 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-215aa25a-44a3-4098-8857-f2f5e2c117e3 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] [instance: fe83cd49-4ceb-49aa-a775-cc2a4229fd76] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:50:40.497838 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-215aa25a-44a3-4098-8857-f2f5e2c117e3 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:50:40.499802 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-215aa25a-44a3-4098-8857-f2f5e2c117e3 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:50:40.501836 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-215aa25a-44a3-4098-8857-f2f5e2c117e3 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:50:40.519769 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-215aa25a-44a3-4098-8857-f2f5e2c117e3 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:50:40.524607 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-215aa25a-44a3-4098-8857-f2f5e2c117e3 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:50:40.526601 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-215aa25a-44a3-4098-8857-f2f5e2c117e3 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:50:40.705298 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-5ee85ae8-0326-4ac8-a8ff-ab0d8c32196c tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:50:40.722933 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-5ee85ae8-0326-4ac8-a8ff-ab0d8c32196c tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:50:40.724428 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-5ee85ae8-0326-4ac8-a8ff-ab0d8c32196c tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:50:40.725646 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-5ee85ae8-0326-4ac8-a8ff-ab0d8c32196c tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] 10.222.0.18 "GET /compute/v2.1/servers/254dfdd3-3716-43cf-aadc-f678aff08d27" status: 200 len: 1558 microversion: 2.25 time: 1.085118 Oct 22 20:50:40.738649 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 249/559] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 20:50:39 2022] GET /compute/v2.1/servers/254dfdd3-3716-43cf-aadc-f678aff08d27 => generated 1558 bytes in 1098 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 20:50:40.758833 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-23046bff-7695-4e98-8237-2a0c2856d49d tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:50:40.758833 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-23046bff-7695-4e98-8237-2a0c2856d49d tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] [instance: 4c53f81e-f4d8-4b41-b03a-ba9acb867226] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:50:40.773167 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-23046bff-7695-4e98-8237-2a0c2856d49d tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:50:40.773738 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-23046bff-7695-4e98-8237-2a0c2856d49d tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:50:40.774130 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-23046bff-7695-4e98-8237-2a0c2856d49d tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:50:40.774862 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-23046bff-7695-4e98-8237-2a0c2856d49d tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:50:40.775324 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-23046bff-7695-4e98-8237-2a0c2856d49d tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:50:40.790268 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-23046bff-7695-4e98-8237-2a0c2856d49d tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:50:41.257808 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-23046bff-7695-4e98-8237-2a0c2856d49d tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9bba9ed37d7430e82e7d310982b8e47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30dbbdc150694e0ebc07c63e90280d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:50:41.266278 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-23046bff-7695-4e98-8237-2a0c2856d49d tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] 10.222.0.18 "GET /compute/v2.1/servers/4c53f81e-f4d8-4b41-b03a-ba9acb867226" status: 200 len: 1388 microversion: 2.1 time: 0.526323 Oct 22 20:50:41.266848 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 250/560] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:50:40 2022] GET /compute/v2.1/servers/4c53f81e-f4d8-4b41-b03a-ba9acb867226 => generated 1388 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:50:41.284759 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-e3cf4b28-4ad0-42fd-85e4-215f14dd666a tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:50:41.294327 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-e3cf4b28-4ad0-42fd-85e4-215f14dd666a tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] [instance: 69ed98a2-c208-4765-88b1-3e76a09cc481] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:50:41.312870 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e3cf4b28-4ad0-42fd-85e4-215f14dd666a tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:50:41.316686 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e3cf4b28-4ad0-42fd-85e4-215f14dd666a tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:50:41.317777 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e3cf4b28-4ad0-42fd-85e4-215f14dd666a tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:50:41.318724 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e3cf4b28-4ad0-42fd-85e4-215f14dd666a tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:50:41.319198 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e3cf4b28-4ad0-42fd-85e4-215f14dd666a tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:50:41.321504 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e3cf4b28-4ad0-42fd-85e4-215f14dd666a tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:50:41.384334 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-215aa25a-44a3-4098-8857-f2f5e2c117e3 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c87f0356ca346f39c6216393d85da2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee8c8f7fc4e12bc1f9fcce3e7b581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:50:41.448169 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-215aa25a-44a3-4098-8857-f2f5e2c117e3 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] 10.222.0.18 "GET /compute/v2.1/servers/fe83cd49-4ceb-49aa-a775-cc2a4229fd76" status: 200 len: 1310 microversion: 2.1 time: 0.980855 Oct 22 20:50:41.451305 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 311/561] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:50:40 2022] GET /compute/v2.1/servers/fe83cd49-4ceb-49aa-a775-cc2a4229fd76 => generated 1310 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:50:41.469113 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-5f89f751-3a22-4e58-94db-66b48f5d9756 tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:50:41.470214 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-5f89f751-3a22-4e58-94db-66b48f5d9756 tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] [instance: 254dfdd3-3716-43cf-aadc-f678aff08d27] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:50:41.491162 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5f89f751-3a22-4e58-94db-66b48f5d9756 tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:50:41.491846 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5f89f751-3a22-4e58-94db-66b48f5d9756 tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:50:41.492337 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5f89f751-3a22-4e58-94db-66b48f5d9756 tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:50:41.498580 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5f89f751-3a22-4e58-94db-66b48f5d9756 tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:50:41.499560 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5f89f751-3a22-4e58-94db-66b48f5d9756 tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:50:41.500178 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5f89f751-3a22-4e58-94db-66b48f5d9756 tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:50:41.551114 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell0:SELECT=4 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:50:41.611285 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell0:SELECT=38 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:50:42.107990 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.objects.instance [None req-5f89f751-3a22-4e58-94db-66b48f5d9756 tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] Lazy-loading 'services' on Instance uuid 254dfdd3-3716-43cf-aadc-f678aff08d27 {{(pid=138745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 20:50:42.154204 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-5f89f751-3a22-4e58-94db-66b48f5d9756 tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/254dfdd3-3716-43cf-aadc-f678aff08d27" status: 200 len: 2051 microversion: 2.25 time: 0.696154 Oct 22 20:50:42.158354 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 312/562] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 20:50:41 2022] GET /compute/v2.1/servers/254dfdd3-3716-43cf-aadc-f678aff08d27 => generated 2051 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 20:50:42.169999 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-ba74d6e7-b8ef-4396-b717-5f472ba42c64 req-394c639f-c4d8-4e25-b033-c0e10940be41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe83cd49-4ceb-49aa-a775-cc2a4229fd76", "name": "network-vif-plugged", "status": "completed", "tag": "5f1c98e3-36fa-4e76-8bc6-b184fe0c58b3"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:50:42.217678 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-ba74d6e7-b8ef-4396-b717-5f472ba42c64 req-394c639f-c4d8-4e25-b033-c0e10940be41 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:50:42.218285 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-ba74d6e7-b8ef-4396-b717-5f472ba42c64 req-394c639f-c4d8-4e25-b033-c0e10940be41 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:50:42.218868 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-ba74d6e7-b8ef-4396-b717-5f472ba42c64 req-394c639f-c4d8-4e25-b033-c0e10940be41 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:50:42.245402 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-e3cf4b28-4ad0-42fd-85e4-215f14dd666a tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91cf84a287b74618ae1b3368785b0b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902e239d67664098895ab24340b0b780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:50:42.256552 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-e3cf4b28-4ad0-42fd-85e4-215f14dd666a tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] 10.222.0.18 "GET /compute/v2.1/servers/69ed98a2-c208-4765-88b1-3e76a09cc481" status: 200 len: 1317 microversion: 2.1 time: 0.975857 Oct 22 20:50:42.259680 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 251/563] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:50:41 2022] GET /compute/v2.1/servers/69ed98a2-c208-4765-88b1-3e76a09cc481 => generated 1317 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:50:42.266699 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-83353c43-d075-43c4-9b36-a45e1ded34fc tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:50:42.273491 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-83353c43-d075-43c4-9b36-a45e1ded34fc tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] [instance: 65381d5e-1265-418b-ac70-4ef749d9af14] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:50:42.299981 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-ba74d6e7-b8ef-4396-b717-5f472ba42c64 req-394c639f-c4d8-4e25-b033-c0e10940be41 service nova] Creating event network-vif-plugged:5f1c98e3-36fa-4e76-8bc6-b184fe0c58b3 for instance fe83cd49-4ceb-49aa-a775-cc2a4229fd76 on nch2-master-1 Oct 22 20:50:42.302978 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-83353c43-d075-43c4-9b36-a45e1ded34fc tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:50:42.303962 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-83353c43-d075-43c4-9b36-a45e1ded34fc tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:50:42.304630 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-83353c43-d075-43c4-9b36-a45e1ded34fc tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:50:42.305809 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-83353c43-d075-43c4-9b36-a45e1ded34fc tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:50:42.306475 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-83353c43-d075-43c4-9b36-a45e1ded34fc tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:50:42.307108 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-83353c43-d075-43c4-9b36-a45e1ded34fc tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:50:42.355260 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-ba74d6e7-b8ef-4396-b717-5f472ba42c64 req-394c639f-c4d8-4e25-b033-c0e10940be41 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.190807 Oct 22 20:50:42.359657 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 313/564] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:50:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:50:42.896736 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-74dae996-7060-404d-bacf-d357fda55af8 tempest-QuotaClassesAdmin257Test-264767046 tempest-QuotaClassesAdmin257Test-264767046-project-admin] Calling method '.version_select at 0x7fd3a490ca60>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:50:42.935478 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-74dae996-7060-404d-bacf-d357fda55af8 tempest-QuotaClassesAdmin257Test-264767046 tempest-QuotaClassesAdmin257Test-264767046-project-admin] 10.222.0.18 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 172 microversion: 2.57 time: 0.572555 Oct 22 20:50:42.942035 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 314/565] 10.222.0.18 () {60 vars in 1226 bytes} [Sat Oct 22 20:50:42 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 172 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 22 20:50:42.959464 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-e8612f32-9b40-4919-aea0-3bb3b049f3e9 tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:50:42.960240 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-e8612f32-9b40-4919-aea0-3bb3b049f3e9 tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] [instance: 254dfdd3-3716-43cf-aadc-f678aff08d27] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:50:42.986135 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e8612f32-9b40-4919-aea0-3bb3b049f3e9 tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:50:42.986639 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e8612f32-9b40-4919-aea0-3bb3b049f3e9 tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:50:42.995016 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e8612f32-9b40-4919-aea0-3bb3b049f3e9 tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:50:42.996539 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e8612f32-9b40-4919-aea0-3bb3b049f3e9 tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:50:43.000690 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e8612f32-9b40-4919-aea0-3bb3b049f3e9 tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:50:43.002920 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e8612f32-9b40-4919-aea0-3bb3b049f3e9 tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:50:43.324335 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell0:SELECT=1 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:50:43.526995 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-83353c43-d075-43c4-9b36-a45e1ded34fc tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b892876156f34b0d99a6c853d0cd4905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b403b83cad4babab211dafade27bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:50:43.547856 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-83353c43-d075-43c4-9b36-a45e1ded34fc tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] 10.222.0.18 "GET /compute/v2.1/servers/65381d5e-1265-418b-ac70-4ef749d9af14" status: 200 len: 1371 microversion: 2.1 time: 1.284951 Oct 22 20:50:43.567742 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 252/566] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:50:42 2022] GET /compute/v2.1/servers/65381d5e-1265-418b-ac70-4ef749d9af14 => generated 1371 bytes in 1307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:50:43.577949 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-b6706922-ad1f-41f0-b1a9-b1e2b7efb9c7 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:50:43.578842 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-b6706922-ad1f-41f0-b1a9-b1e2b7efb9c7 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] [instance: 4c53f81e-f4d8-4b41-b03a-ba9acb867226] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:50:43.603715 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b6706922-ad1f-41f0-b1a9-b1e2b7efb9c7 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:50:43.604799 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b6706922-ad1f-41f0-b1a9-b1e2b7efb9c7 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:50:43.606253 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b6706922-ad1f-41f0-b1a9-b1e2b7efb9c7 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:50:43.608574 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b6706922-ad1f-41f0-b1a9-b1e2b7efb9c7 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:50:43.609544 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b6706922-ad1f-41f0-b1a9-b1e2b7efb9c7 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:50:43.615402 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b6706922-ad1f-41f0-b1a9-b1e2b7efb9c7 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:50:43.691758 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.objects.instance [None req-e8612f32-9b40-4919-aea0-3bb3b049f3e9 tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] Lazy-loading 'services' on Instance uuid 254dfdd3-3716-43cf-aadc-f678aff08d27 {{(pid=138745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 20:50:43.718912 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-e8612f32-9b40-4919-aea0-3bb3b049f3e9 tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/254dfdd3-3716-43cf-aadc-f678aff08d27" status: 200 len: 2051 microversion: 2.25 time: 0.775696 Oct 22 20:50:43.721155 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 315/567] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 20:50:42 2022] GET /compute/v2.1/servers/254dfdd3-3716-43cf-aadc-f678aff08d27 => generated 2051 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 20:50:43.731576 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-560fe673-9f86-4353-9c4d-1097c9575fce tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:50:43.732570 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-560fe673-9f86-4353-9c4d-1097c9575fce tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] [instance: fe83cd49-4ceb-49aa-a775-cc2a4229fd76] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:50:43.757991 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-560fe673-9f86-4353-9c4d-1097c9575fce tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:50:43.759570 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-560fe673-9f86-4353-9c4d-1097c9575fce tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:50:43.760232 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-560fe673-9f86-4353-9c4d-1097c9575fce tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:50:43.761966 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-560fe673-9f86-4353-9c4d-1097c9575fce tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:50:43.764728 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-560fe673-9f86-4353-9c4d-1097c9575fce tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:50:43.766025 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-560fe673-9f86-4353-9c4d-1097c9575fce tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:50:44.358560 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-560fe673-9f86-4353-9c4d-1097c9575fce tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c87f0356ca346f39c6216393d85da2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee8c8f7fc4e12bc1f9fcce3e7b581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:50:44.370458 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-b6706922-ad1f-41f0-b1a9-b1e2b7efb9c7 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9bba9ed37d7430e82e7d310982b8e47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30dbbdc150694e0ebc07c63e90280d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:50:44.373759 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-560fe673-9f86-4353-9c4d-1097c9575fce tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] 10.222.0.18 "GET /compute/v2.1/servers/fe83cd49-4ceb-49aa-a775-cc2a4229fd76" status: 200 len: 1310 microversion: 2.1 time: 0.649160 Oct 22 20:50:44.379180 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 316/568] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:50:43 2022] GET /compute/v2.1/servers/fe83cd49-4ceb-49aa-a775-cc2a4229fd76 => generated 1310 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:50:44.384786 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-722091ec-d5cd-4f9b-8336-df9313fd1c59 tempest-QuotaClassesAdmin257Test-264767046 tempest-QuotaClassesAdmin257Test-264767046-project-admin] Action: 'update', calling method: .version_select at 0x7fd3a4aa3160>, body: {"quota_class_set": {"cores": 120, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "server_group_members": 110, "server_groups": 110}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:50:44.400859 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-b6706922-ad1f-41f0-b1a9-b1e2b7efb9c7 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] 10.222.0.18 "GET /compute/v2.1/servers/4c53f81e-f4d8-4b41-b03a-ba9acb867226" status: 200 len: 1587 microversion: 2.1 time: 0.831516 Oct 22 20:50:44.419410 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 253/569] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:50:43 2022] GET /compute/v2.1/servers/4c53f81e-f4d8-4b41-b03a-ba9acb867226 => generated 1587 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:50:44.440075 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-560d1812-5a1a-4b8c-8b43-7fdb0431d65f tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:50:44.441270 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-560d1812-5a1a-4b8c-8b43-7fdb0431d65f tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] [instance: 69ed98a2-c208-4765-88b1-3e76a09cc481] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:50:44.472655 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-560d1812-5a1a-4b8c-8b43-7fdb0431d65f tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:50:44.474173 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-560d1812-5a1a-4b8c-8b43-7fdb0431d65f tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:50:44.475464 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-560d1812-5a1a-4b8c-8b43-7fdb0431d65f tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:50:44.477316 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-560d1812-5a1a-4b8c-8b43-7fdb0431d65f tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:50:44.479372 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-560d1812-5a1a-4b8c-8b43-7fdb0431d65f tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:50:44.482886 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-560d1812-5a1a-4b8c-8b43-7fdb0431d65f tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:50:44.644611 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-722091ec-d5cd-4f9b-8336-df9313fd1c59 tempest-QuotaClassesAdmin257Test-264767046 tempest-QuotaClassesAdmin257Test-264767046-project-admin] 10.222.0.18 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 159 microversion: 2.57 time: 0.263384 Oct 22 20:50:44.649565 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 317/570] 10.222.0.18 () {62 vars in 1247 bytes} [Sat Oct 22 20:50:44 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 159 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 22 20:50:44.672127 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-2aa26639-6cad-4238-a727-45dbfe5e1f1d tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:50:44.676958 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2aa26639-6cad-4238-a727-45dbfe5e1f1d tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:50:44.677456 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2aa26639-6cad-4238-a727-45dbfe5e1f1d tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:50:44.693541 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2aa26639-6cad-4238-a727-45dbfe5e1f1d tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:50:44.694793 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2aa26639-6cad-4238-a727-45dbfe5e1f1d tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:50:44.697775 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2aa26639-6cad-4238-a727-45dbfe5e1f1d tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:50:44.700059 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2aa26639-6cad-4238-a727-45dbfe5e1f1d tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:50:44.778826 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-2aa26639-6cad-4238-a727-45dbfe5e1f1d tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] 10.222.0.18 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.127101 Oct 22 20:50:44.795199 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 318/571] 10.222.0.18 () {60 vars in 1217 bytes} [Sat Oct 22 20:50:44 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 22 20:50:44.811585 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-2eb07bc0-a7dd-4519-b8d9-93d09fc43f34 req-23c0eaf1-20d0-4855-a859-7471856a52bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "65381d5e-1265-418b-ac70-4ef749d9af14", "tag": "2082100f-222c-49e5-af14-7af046476c87"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:50:44.839365 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-2eb07bc0-a7dd-4519-b8d9-93d09fc43f34 req-23c0eaf1-20d0-4855-a859-7471856a52bd service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:50:44.840713 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-2eb07bc0-a7dd-4519-b8d9-93d09fc43f34 req-23c0eaf1-20d0-4855-a859-7471856a52bd service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:50:44.843788 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-2eb07bc0-a7dd-4519-b8d9-93d09fc43f34 req-23c0eaf1-20d0-4855-a859-7471856a52bd service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:50:44.857478 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-2eb07bc0-a7dd-4519-b8d9-93d09fc43f34 req-23c0eaf1-20d0-4855-a859-7471856a52bd service nova] Creating event network-changed:2082100f-222c-49e5-af14-7af046476c87 for instance 65381d5e-1265-418b-ac70-4ef749d9af14 on nch2-master-1 Oct 22 20:50:44.864760 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-2eb07bc0-a7dd-4519-b8d9-93d09fc43f34 req-23c0eaf1-20d0-4855-a859-7471856a52bd service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067108 Oct 22 20:50:44.866151 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 319/572] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:50:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:50:44.872623 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-849bf5f0-71d1-40c1-acd1-9a5b67ac1132 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:50:44.873563 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-849bf5f0-71d1-40c1-acd1-9a5b67ac1132 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] [instance: 4c53f81e-f4d8-4b41-b03a-ba9acb867226] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:50:44.882118 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-849bf5f0-71d1-40c1-acd1-9a5b67ac1132 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:50:44.882881 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-849bf5f0-71d1-40c1-acd1-9a5b67ac1132 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:50:44.883609 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-849bf5f0-71d1-40c1-acd1-9a5b67ac1132 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:50:44.884940 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-849bf5f0-71d1-40c1-acd1-9a5b67ac1132 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:50:44.896610 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-849bf5f0-71d1-40c1-acd1-9a5b67ac1132 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:50:44.897970 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-560d1812-5a1a-4b8c-8b43-7fdb0431d65f tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91cf84a287b74618ae1b3368785b0b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902e239d67664098895ab24340b0b780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:50:44.898694 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-849bf5f0-71d1-40c1-acd1-9a5b67ac1132 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:50:44.910427 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-560d1812-5a1a-4b8c-8b43-7fdb0431d65f tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] 10.222.0.18 "GET /compute/v2.1/servers/69ed98a2-c208-4765-88b1-3e76a09cc481" status: 200 len: 1317 microversion: 2.1 time: 0.487533 Oct 22 20:50:44.911314 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 254/573] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:50:44 2022] GET /compute/v2.1/servers/69ed98a2-c208-4765-88b1-3e76a09cc481 => generated 1317 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:50:44.943320 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-a7d03bb5-3862-4b13-9729-5ab6d339374c tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:50:44.944259 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-a7d03bb5-3862-4b13-9729-5ab6d339374c tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] [instance: 65381d5e-1265-418b-ac70-4ef749d9af14] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:50:44.951890 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a7d03bb5-3862-4b13-9729-5ab6d339374c tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:50:44.952778 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a7d03bb5-3862-4b13-9729-5ab6d339374c tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:50:44.953457 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a7d03bb5-3862-4b13-9729-5ab6d339374c tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:50:44.955327 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a7d03bb5-3862-4b13-9729-5ab6d339374c tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:50:44.956006 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a7d03bb5-3862-4b13-9729-5ab6d339374c tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:50:44.956659 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a7d03bb5-3862-4b13-9729-5ab6d339374c tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:50:45.024404 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-849bf5f0-71d1-40c1-acd1-9a5b67ac1132 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] 10.222.0.18 "GET /compute/v2.1/servers/4c53f81e-f4d8-4b41-b03a-ba9acb867226/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.156681 Oct 22 20:50:45.025180 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 320/574] 10.222.0.18 () {58 vars in 1275 bytes} [Sat Oct 22 20:50:44 2022] GET /compute/v2.1/servers/4c53f81e-f4d8-4b41-b03a-ba9acb867226/os-interface => generated 284 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:50:45.029942 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-07144b82-b9f7-4dde-868e-af405eaa23bb tempest-QuotaClassesAdmin257Test-264767046 tempest-QuotaClassesAdmin257Test-264767046-project-admin] Calling method '.version_select at 0x7fd3a47e6af0>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:50:45.058989 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-07144b82-b9f7-4dde-868e-af405eaa23bb tempest-QuotaClassesAdmin257Test-264767046 tempest-QuotaClassesAdmin257Test-264767046-project-admin] 10.222.0.18 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 176 microversion: 2.57 time: 0.032891 Oct 22 20:50:45.059614 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 321/575] 10.222.0.18 () {60 vars in 1226 bytes} [Sat Oct 22 20:50:45 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 176 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 22 20:50:45.070798 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-ef637a70-c58d-4f47-a747-e2cd5f5ff500 tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:50:45.071359 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-ef637a70-c58d-4f47-a747-e2cd5f5ff500 tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] [instance: 254dfdd3-3716-43cf-aadc-f678aff08d27] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:50:45.086860 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ef637a70-c58d-4f47-a747-e2cd5f5ff500 tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:50:45.087379 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ef637a70-c58d-4f47-a747-e2cd5f5ff500 tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:50:45.087813 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ef637a70-c58d-4f47-a747-e2cd5f5ff500 tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:50:45.092323 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ef637a70-c58d-4f47-a747-e2cd5f5ff500 tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:50:45.092803 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ef637a70-c58d-4f47-a747-e2cd5f5ff500 tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:50:45.093242 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ef637a70-c58d-4f47-a747-e2cd5f5ff500 tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:50:45.197123 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-ef637a70-c58d-4f47-a747-e2cd5f5ff500 tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] 10.222.0.18 "POST /compute/v2.1/servers/254dfdd3-3716-43cf-aadc-f678aff08d27/action" status: 202 len: 0 microversion: 2.25 time: 0.129293 Oct 22 20:50:45.198422 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 322/576] 10.222.0.18 () {62 vars in 1319 bytes} [Sat Oct 22 20:50:45 2022] POST /compute/v2.1/servers/254dfdd3-3716-43cf-aadc-f678aff08d27/action => generated 0 bytes in 138 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 22 20:50:45.205264 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-01b63b3d-cb05-450f-bac0-28724cf53b4d tempest-QuotaClassesAdmin257Test-264767046 tempest-QuotaClassesAdmin257Test-264767046-project-admin] Action: 'update', calling method: .version_select at 0x7fd3a4898430>, body: {"quota_class_set": {"cores": 20, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "server_group_members": 10, "server_groups": 10}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:50:45.404167 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-01b63b3d-cb05-450f-bac0-28724cf53b4d tempest-QuotaClassesAdmin257Test-264767046 tempest-QuotaClassesAdmin257Test-264767046-project-admin] 10.222.0.18 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 155 microversion: 2.57 time: 0.204143 Oct 22 20:50:45.409528 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 323/577] 10.222.0.18 () {62 vars in 1247 bytes} [Sat Oct 22 20:50:45 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 155 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 22 20:50:45.425075 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-793a0e73-1923-4021-a5a0-0e4e74cd043d tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:50:45.425823 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-793a0e73-1923-4021-a5a0-0e4e74cd043d tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] [instance: 254dfdd3-3716-43cf-aadc-f678aff08d27] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:50:45.463389 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-793a0e73-1923-4021-a5a0-0e4e74cd043d tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:50:45.464119 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-793a0e73-1923-4021-a5a0-0e4e74cd043d tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:50:45.464722 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-793a0e73-1923-4021-a5a0-0e4e74cd043d tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:50:45.468246 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-793a0e73-1923-4021-a5a0-0e4e74cd043d tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:50:45.468929 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-793a0e73-1923-4021-a5a0-0e4e74cd043d tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:50:45.469761 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-793a0e73-1923-4021-a5a0-0e4e74cd043d tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:50:46.745079 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-a7d03bb5-3862-4b13-9729-5ab6d339374c tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b892876156f34b0d99a6c853d0cd4905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b403b83cad4babab211dafade27bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:50:46.764774 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-a7d03bb5-3862-4b13-9729-5ab6d339374c tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] 10.222.0.18 "GET /compute/v2.1/servers/65381d5e-1265-418b-ac70-4ef749d9af14" status: 200 len: 1371 microversion: 2.1 time: 1.851904 Oct 22 20:50:46.766205 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 255/578] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:50:44 2022] GET /compute/v2.1/servers/65381d5e-1265-418b-ac70-4ef749d9af14 => generated 1371 bytes in 1854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:50:46.779868 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-9f7bda5a-c1ec-4e54-a569-cdfd18f8daa8 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:50:46.780566 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-9f7bda5a-c1ec-4e54-a569-cdfd18f8daa8 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] [instance: fe83cd49-4ceb-49aa-a775-cc2a4229fd76] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:50:46.791300 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9f7bda5a-c1ec-4e54-a569-cdfd18f8daa8 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:50:46.796095 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9f7bda5a-c1ec-4e54-a569-cdfd18f8daa8 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:50:46.796839 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9f7bda5a-c1ec-4e54-a569-cdfd18f8daa8 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:50:46.798138 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9f7bda5a-c1ec-4e54-a569-cdfd18f8daa8 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:50:46.802974 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9f7bda5a-c1ec-4e54-a569-cdfd18f8daa8 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:50:46.803740 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9f7bda5a-c1ec-4e54-a569-cdfd18f8daa8 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:50:47.166749 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:50:47.182093 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.objects.instance [None req-793a0e73-1923-4021-a5a0-0e4e74cd043d tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] Lazy-loading 'services' on Instance uuid 254dfdd3-3716-43cf-aadc-f678aff08d27 {{(pid=138745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 20:50:47.265526 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-793a0e73-1923-4021-a5a0-0e4e74cd043d tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/254dfdd3-3716-43cf-aadc-f678aff08d27" status: 200 len: 2056 microversion: 2.25 time: 1.853519 Oct 22 20:50:47.268260 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 324/579] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 20:50:45 2022] GET /compute/v2.1/servers/254dfdd3-3716-43cf-aadc-f678aff08d27 => generated 2056 bytes in 1858 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 20:50:47.293311 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-e8a1df30-bfdf-4236-8308-f35a7bdb2734 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:50:47.297005 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-e8a1df30-bfdf-4236-8308-f35a7bdb2734 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] [instance: 69ed98a2-c208-4765-88b1-3e76a09cc481] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:50:47.311509 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e8a1df30-bfdf-4236-8308-f35a7bdb2734 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:50:47.312418 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e8a1df30-bfdf-4236-8308-f35a7bdb2734 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:50:47.313489 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e8a1df30-bfdf-4236-8308-f35a7bdb2734 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:50:47.315600 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e8a1df30-bfdf-4236-8308-f35a7bdb2734 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:50:47.317316 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e8a1df30-bfdf-4236-8308-f35a7bdb2734 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:50:47.318876 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e8a1df30-bfdf-4236-8308-f35a7bdb2734 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:50:48.041373 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-9f7bda5a-c1ec-4e54-a569-cdfd18f8daa8 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c87f0356ca346f39c6216393d85da2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee8c8f7fc4e12bc1f9fcce3e7b581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:50:48.064415 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-9f7bda5a-c1ec-4e54-a569-cdfd18f8daa8 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] 10.222.0.18 "GET /compute/v2.1/servers/fe83cd49-4ceb-49aa-a775-cc2a4229fd76" status: 200 len: 1493 microversion: 2.1 time: 1.294925 Oct 22 20:50:48.065719 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 256/580] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:50:46 2022] GET /compute/v2.1/servers/fe83cd49-4ceb-49aa-a775-cc2a4229fd76 => generated 1493 bytes in 1298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:50:48.084910 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-c1972d1e-8b56-46c4-8c52-e3fac363b1ed req-4c3bfe5e-239b-4991-bd1c-715dbf581a97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69ed98a2-c208-4765-88b1-3e76a09cc481", "name": "network-vif-plugged", "status": "completed", "tag": "e967f24f-34ec-4633-8022-8dac0a05409f"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:50:48.110372 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-c1972d1e-8b56-46c4-8c52-e3fac363b1ed req-4c3bfe5e-239b-4991-bd1c-715dbf581a97 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:50:48.111199 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-c1972d1e-8b56-46c4-8c52-e3fac363b1ed req-4c3bfe5e-239b-4991-bd1c-715dbf581a97 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:50:48.113518 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-c1972d1e-8b56-46c4-8c52-e3fac363b1ed req-4c3bfe5e-239b-4991-bd1c-715dbf581a97 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:50:48.152384 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-c1972d1e-8b56-46c4-8c52-e3fac363b1ed req-4c3bfe5e-239b-4991-bd1c-715dbf581a97 service nova] Creating event network-vif-plugged:e967f24f-34ec-4633-8022-8dac0a05409f for instance 69ed98a2-c208-4765-88b1-3e76a09cc481 on nch1-master-1 Oct 22 20:50:48.167198 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-c1972d1e-8b56-46c4-8c52-e3fac363b1ed req-4c3bfe5e-239b-4991-bd1c-715dbf581a97 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099992 Oct 22 20:50:48.170582 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 257/581] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:50:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:50:48.216419 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-e8a1df30-bfdf-4236-8308-f35a7bdb2734 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91cf84a287b74618ae1b3368785b0b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902e239d67664098895ab24340b0b780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:50:48.258569 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-e8a1df30-bfdf-4236-8308-f35a7bdb2734 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] 10.222.0.18 "GET /compute/v2.1/servers/69ed98a2-c208-4765-88b1-3e76a09cc481" status: 200 len: 1317 microversion: 2.1 time: 0.988519 Oct 22 20:50:48.276669 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 325/582] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:50:47 2022] GET /compute/v2.1/servers/69ed98a2-c208-4765-88b1-3e76a09cc481 => generated 1317 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:50:48.294822 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-2ce5e493-52b8-4c8e-a6c7-93433970c461 tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:50:48.296179 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-2ce5e493-52b8-4c8e-a6c7-93433970c461 tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] [instance: 65381d5e-1265-418b-ac70-4ef749d9af14] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:50:48.326610 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2ce5e493-52b8-4c8e-a6c7-93433970c461 tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:50:48.329339 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2ce5e493-52b8-4c8e-a6c7-93433970c461 tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:50:48.330092 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2ce5e493-52b8-4c8e-a6c7-93433970c461 tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:50:48.336444 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2ce5e493-52b8-4c8e-a6c7-93433970c461 tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:50:48.337304 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2ce5e493-52b8-4c8e-a6c7-93433970c461 tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:50:48.341978 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2ce5e493-52b8-4c8e-a6c7-93433970c461 tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:50:49.050422 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-94ae75e2-f105-4f34-8f61-77e00e12ab9b tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Action: 'create', calling method: .version_select at 0x7fd3a445d4c0>, body: {"keypair": {"name": "tempest-keypair-609268957", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPm7zoKEALQb0o8zFM636x2FmiakdilR8Eijz5cm/OD2r2nq++Y3uz50Vh47RmrP6sf7GU+G/P2JMmPS4+FA41O8Q1HEAANy7eHhMPhrPUrgNSFjh6gO3HpscZ2pZ4LhEw=="}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:50:49.121332 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-94ae75e2-f105-4f34-8f61-77e00e12ab9b tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Getting quotas for project 3e48413ed1ac4e1ea65fb38f097881db. Resources: {'key_pairs'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 20:50:49.165181 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-94ae75e2-f105-4f34-8f61-77e00e12ab9b tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Getting quotas for user 34f8af8ee2b545bead90fffd6c6c4896 and project 3e48413ed1ac4e1ea65fb38f097881db. Resources: {'key_pairs'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 20:50:49.235832 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-94ae75e2-f105-4f34-8f61-77e00e12ab9b tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.059970 Oct 22 20:50:49.239260 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 258/583] 10.222.0.18 () {60 vars in 1159 bytes} [Sat Oct 22 20:50:48 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1068 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:50:49.525641 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-2ce5e493-52b8-4c8e-a6c7-93433970c461 tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b892876156f34b0d99a6c853d0cd4905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b403b83cad4babab211dafade27bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:50:49.536672 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-2ce5e493-52b8-4c8e-a6c7-93433970c461 tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] 10.222.0.18 "GET /compute/v2.1/servers/65381d5e-1265-418b-ac70-4ef749d9af14" status: 200 len: 1371 microversion: 2.1 time: 1.255953 Oct 22 20:50:49.539169 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 326/584] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:50:48 2022] GET /compute/v2.1/servers/65381d5e-1265-418b-ac70-4ef749d9af14 => generated 1371 bytes in 1262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:50:49.545172 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-d2e091f7-5dd9-4281-b9b7-9f013532fad3 tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:50:49.547707 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-d2e091f7-5dd9-4281-b9b7-9f013532fad3 tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] [instance: 254dfdd3-3716-43cf-aadc-f678aff08d27] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:50:49.557467 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d2e091f7-5dd9-4281-b9b7-9f013532fad3 tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:50:49.560589 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d2e091f7-5dd9-4281-b9b7-9f013532fad3 tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:50:49.562085 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d2e091f7-5dd9-4281-b9b7-9f013532fad3 tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:50:49.563328 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d2e091f7-5dd9-4281-b9b7-9f013532fad3 tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:50:49.564023 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d2e091f7-5dd9-4281-b9b7-9f013532fad3 tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:50:49.564636 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d2e091f7-5dd9-4281-b9b7-9f013532fad3 tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:50:50.144679 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.objects.instance [None req-d2e091f7-5dd9-4281-b9b7-9f013532fad3 tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] Lazy-loading 'services' on Instance uuid 254dfdd3-3716-43cf-aadc-f678aff08d27 {{(pid=138745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 20:50:50.218859 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-d2e091f7-5dd9-4281-b9b7-9f013532fad3 tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/254dfdd3-3716-43cf-aadc-f678aff08d27" status: 200 len: 2036 microversion: 2.25 time: 0.677995 Oct 22 20:50:50.221580 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 327/585] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 20:50:49 2022] GET /compute/v2.1/servers/254dfdd3-3716-43cf-aadc-f678aff08d27 => generated 2036 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 20:50:50.236064 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-8b3b0d3a-a976-48d7-935f-676085842081 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:50:50.245635 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-8b3b0d3a-a976-48d7-935f-676085842081 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] [instance: 69ed98a2-c208-4765-88b1-3e76a09cc481] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:50:50.266326 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8b3b0d3a-a976-48d7-935f-676085842081 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:50:50.268631 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8b3b0d3a-a976-48d7-935f-676085842081 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:50:50.270704 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8b3b0d3a-a976-48d7-935f-676085842081 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:50:50.271807 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8b3b0d3a-a976-48d7-935f-676085842081 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:50:50.274689 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8b3b0d3a-a976-48d7-935f-676085842081 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:50:50.275518 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8b3b0d3a-a976-48d7-935f-676085842081 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:50:50.483615 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-8dbc03f1-ac82-463e-92f3-c46ffebff520 tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:50:50.485444 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-8dbc03f1-ac82-463e-92f3-c46ffebff520 tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] [instance: fe83cd49-4ceb-49aa-a775-cc2a4229fd76] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:50:50.537299 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8dbc03f1-ac82-463e-92f3-c46ffebff520 tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:50:50.539980 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8dbc03f1-ac82-463e-92f3-c46ffebff520 tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:50:50.543406 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8dbc03f1-ac82-463e-92f3-c46ffebff520 tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:50:50.552241 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8dbc03f1-ac82-463e-92f3-c46ffebff520 tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:50:50.570345 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8dbc03f1-ac82-463e-92f3-c46ffebff520 tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:50:50.571806 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8dbc03f1-ac82-463e-92f3-c46ffebff520 tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:50:51.763504 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-8b3b0d3a-a976-48d7-935f-676085842081 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91cf84a287b74618ae1b3368785b0b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902e239d67664098895ab24340b0b780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:50:51.798748 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-8b3b0d3a-a976-48d7-935f-676085842081 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] 10.222.0.18 "GET /compute/v2.1/servers/69ed98a2-c208-4765-88b1-3e76a09cc481" status: 200 len: 1466 microversion: 2.1 time: 1.575788 Oct 22 20:50:51.802917 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 328/586] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:50:50 2022] GET /compute/v2.1/servers/69ed98a2-c208-4765-88b1-3e76a09cc481 => generated 1466 bytes in 1579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:50:51.845204 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-ece5bb64-f995-4ac3-9651-11e2a42aa697 tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch1-master-1", "block_migration": "auto"}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:50:51.853482 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-ece5bb64-f995-4ac3-9651-11e2a42aa697 tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] [instance: 254dfdd3-3716-43cf-aadc-f678aff08d27] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:50:51.872783 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ece5bb64-f995-4ac3-9651-11e2a42aa697 tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:50:51.883149 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ece5bb64-f995-4ac3-9651-11e2a42aa697 tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:50:51.885670 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ece5bb64-f995-4ac3-9651-11e2a42aa697 tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:50:51.888843 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ece5bb64-f995-4ac3-9651-11e2a42aa697 tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:50:51.889587 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ece5bb64-f995-4ac3-9651-11e2a42aa697 tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:50:51.892422 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ece5bb64-f995-4ac3-9651-11e2a42aa697 tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:50:51.988310 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-8dbc03f1-ac82-463e-92f3-c46ffebff520 tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/fe83cd49-4ceb-49aa-a775-cc2a4229fd76" status: 200 len: 1644 microversion: 2.1 time: 2.746539 Oct 22 20:50:51.998500 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 259/587] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:50:49 2022] GET /compute/v2.1/servers/fe83cd49-4ceb-49aa-a775-cc2a4229fd76 => generated 1644 bytes in 2758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:50:52.007699 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-c87f7aef-8baa-4eb3-9ee6-147745084e46 tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:50:52.009397 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-c87f7aef-8baa-4eb3-9ee6-147745084e46 tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] [instance: 65381d5e-1265-418b-ac70-4ef749d9af14] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:50:52.021718 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c87f7aef-8baa-4eb3-9ee6-147745084e46 tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:50:52.022561 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c87f7aef-8baa-4eb3-9ee6-147745084e46 tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:50:52.023197 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c87f7aef-8baa-4eb3-9ee6-147745084e46 tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:50:52.024159 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c87f7aef-8baa-4eb3-9ee6-147745084e46 tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:50:52.024799 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c87f7aef-8baa-4eb3-9ee6-147745084e46 tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:50:52.025453 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c87f7aef-8baa-4eb3-9ee6-147745084e46 tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:50:52.128159 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.objects.instance [None req-ece5bb64-f995-4ac3-9651-11e2a42aa697 tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] Lazy-loading 'flavor' on Instance uuid 254dfdd3-3716-43cf-aadc-f678aff08d27 {{(pid=138745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 20:50:52.311899 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-ece5bb64-f995-4ac3-9651-11e2a42aa697 tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] [instance: 254dfdd3-3716-43cf-aadc-f678aff08d27] Going to try to live migrate instance to nch1-master-1 {{(pid=138745) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 22 20:50:52.531712 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-c87f7aef-8baa-4eb3-9ee6-147745084e46 tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b892876156f34b0d99a6c853d0cd4905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b403b83cad4babab211dafade27bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:50:52.549451 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-c87f7aef-8baa-4eb3-9ee6-147745084e46 tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] 10.222.0.18 "GET /compute/v2.1/servers/65381d5e-1265-418b-ac70-4ef749d9af14" status: 200 len: 1371 microversion: 2.1 time: 0.549499 Oct 22 20:50:52.551253 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 260/588] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:50:51 2022] GET /compute/v2.1/servers/65381d5e-1265-418b-ac70-4ef749d9af14 => generated 1371 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:50:52.837777 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-6a072708-4bc0-476b-8d8c-c4993b79598b tempest-ServersOnMultiNodesTest-1015080240 tempest-ServersOnMultiNodesTest-1015080240-project-admin] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:50:52.838403 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-6a072708-4bc0-476b-8d8c-c4993b79598b tempest-ServersOnMultiNodesTest-1015080240 tempest-ServersOnMultiNodesTest-1015080240-project-admin] [instance: 69ed98a2-c208-4765-88b1-3e76a09cc481] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:50:52.849849 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6a072708-4bc0-476b-8d8c-c4993b79598b tempest-ServersOnMultiNodesTest-1015080240 tempest-ServersOnMultiNodesTest-1015080240-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:50:52.850361 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6a072708-4bc0-476b-8d8c-c4993b79598b tempest-ServersOnMultiNodesTest-1015080240 tempest-ServersOnMultiNodesTest-1015080240-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:50:52.850810 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6a072708-4bc0-476b-8d8c-c4993b79598b tempest-ServersOnMultiNodesTest-1015080240 tempest-ServersOnMultiNodesTest-1015080240-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:50:52.852033 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6a072708-4bc0-476b-8d8c-c4993b79598b tempest-ServersOnMultiNodesTest-1015080240 tempest-ServersOnMultiNodesTest-1015080240-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:50:52.852881 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6a072708-4bc0-476b-8d8c-c4993b79598b tempest-ServersOnMultiNodesTest-1015080240 tempest-ServersOnMultiNodesTest-1015080240-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:50:52.853401 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6a072708-4bc0-476b-8d8c-c4993b79598b tempest-ServersOnMultiNodesTest-1015080240 tempest-ServersOnMultiNodesTest-1015080240-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:50:53.146043 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-6a072708-4bc0-476b-8d8c-c4993b79598b tempest-ServersOnMultiNodesTest-1015080240 tempest-ServersOnMultiNodesTest-1015080240-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/69ed98a2-c208-4765-88b1-3e76a09cc481" status: 200 len: 1617 microversion: 2.1 time: 0.593407 Oct 22 20:50:53.166747 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 261/589] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:50:52 2022] GET /compute/v2.1/servers/69ed98a2-c208-4765-88b1-3e76a09cc481 => generated 1617 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:50:53.173750 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-0b5b687d-e52e-4000-b403-4d72caa101e9 tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:50:53.174994 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-0b5b687d-e52e-4000-b403-4d72caa101e9 tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] [instance: fe83cd49-4ceb-49aa-a775-cc2a4229fd76] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:50:53.184135 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0b5b687d-e52e-4000-b403-4d72caa101e9 tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:50:53.185590 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0b5b687d-e52e-4000-b403-4d72caa101e9 tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:50:53.186272 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0b5b687d-e52e-4000-b403-4d72caa101e9 tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:50:53.187227 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0b5b687d-e52e-4000-b403-4d72caa101e9 tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:50:53.188464 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0b5b687d-e52e-4000-b403-4d72caa101e9 tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:50:53.189149 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0b5b687d-e52e-4000-b403-4d72caa101e9 tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:50:53.437492 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-0b5b687d-e52e-4000-b403-4d72caa101e9 tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/fe83cd49-4ceb-49aa-a775-cc2a4229fd76" status: 200 len: 1644 microversion: 2.1 time: 0.269155 Oct 22 20:50:53.439057 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 262/590] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:50:53 2022] GET /compute/v2.1/servers/fe83cd49-4ceb-49aa-a775-cc2a4229fd76 => generated 1644 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:50:53.445936 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-a42ff07d-3d5e-4850-872b-fad755468613 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:50:53.446774 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-a42ff07d-3d5e-4850-872b-fad755468613 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] [instance: 4c53f81e-f4d8-4b41-b03a-ba9acb867226] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:50:53.455558 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a42ff07d-3d5e-4850-872b-fad755468613 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:50:53.456316 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a42ff07d-3d5e-4850-872b-fad755468613 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:50:53.457000 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a42ff07d-3d5e-4850-872b-fad755468613 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:50:53.457887 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a42ff07d-3d5e-4850-872b-fad755468613 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:50:53.458576 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a42ff07d-3d5e-4850-872b-fad755468613 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:50:53.459185 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a42ff07d-3d5e-4850-872b-fad755468613 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:50:53.948403 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-a42ff07d-3d5e-4850-872b-fad755468613 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9bba9ed37d7430e82e7d310982b8e47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30dbbdc150694e0ebc07c63e90280d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:50:53.962665 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-a42ff07d-3d5e-4850-872b-fad755468613 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] 10.222.0.18 "GET /compute/v2.1/servers/4c53f81e-f4d8-4b41-b03a-ba9acb867226" status: 200 len: 1587 microversion: 2.1 time: 0.521425 Oct 22 20:50:53.963622 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 263/591] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:50:53 2022] GET /compute/v2.1/servers/4c53f81e-f4d8-4b41-b03a-ba9acb867226 => generated 1587 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:50:53.968418 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-44b54a1a-81c2-4ea3-90b7-dc14e6ef65b0 req-ccc72881-5185-4e4d-ae5c-499e85ebc81d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c53f81e-f4d8-4b41-b03a-ba9acb867226", "tag": "94e91c18-1bda-4ad5-9d8b-805c0859ebdd"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:50:53.987980 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-44b54a1a-81c2-4ea3-90b7-dc14e6ef65b0 req-ccc72881-5185-4e4d-ae5c-499e85ebc81d service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:50:53.993281 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-44b54a1a-81c2-4ea3-90b7-dc14e6ef65b0 req-ccc72881-5185-4e4d-ae5c-499e85ebc81d service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:50:53.993834 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-44b54a1a-81c2-4ea3-90b7-dc14e6ef65b0 req-ccc72881-5185-4e4d-ae5c-499e85ebc81d service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:50:54.019185 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-44b54a1a-81c2-4ea3-90b7-dc14e6ef65b0 req-ccc72881-5185-4e4d-ae5c-499e85ebc81d service nova] Creating event network-changed:94e91c18-1bda-4ad5-9d8b-805c0859ebdd for instance 4c53f81e-f4d8-4b41-b03a-ba9acb867226 on nch1-master-1 Oct 22 20:50:54.026163 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-44b54a1a-81c2-4ea3-90b7-dc14e6ef65b0 req-ccc72881-5185-4e4d-ae5c-499e85ebc81d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060859 Oct 22 20:50:54.026796 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 264/592] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:50:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:50:54.157216 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-3d884960-982a-4683-9efe-b07c60973c97 tempest-QuotasAdminTestJSON-890688892 tempest-QuotasAdminTestJSON-890688892-project-admin] Calling method '.version_select at 0x7fd3a44484c0>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:50:54.200268 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-ece5bb64-f995-4ac3-9651-11e2a42aa697 tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] 10.222.0.18 "POST /compute/v2.1/servers/254dfdd3-3716-43cf-aadc-f678aff08d27/action" status: 202 len: 0 microversion: 2.25 time: 2.397642 Oct 22 20:50:54.201383 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 329/593] 10.222.0.18 () {62 vars in 1319 bytes} [Sat Oct 22 20:50:51 2022] POST /compute/v2.1/servers/254dfdd3-3716-43cf-aadc-f678aff08d27/action => generated 0 bytes in 2399 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 22 20:50:54.208243 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-8e4c31ed-202b-47f8-ad64-20e1cd34b9af tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-345290603", "imageRef": "085e4478-6edc-4a69-8e08-f9831713eb65", "flavorRef": "452", "networks": [{"uuid": "310fed8a-623c-4efa-985c-2ea8005828e2"}], "security_groups": [{"name": "tempest-securitygroup--1016165463"}], "key_name": "tempest-keypair-609268957", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:50:54.245757 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-3d884960-982a-4683-9efe-b07c60973c97 tempest-QuotasAdminTestJSON-890688892 tempest-QuotasAdminTestJSON-890688892-project-admin] 10.222.0.18 "GET /compute/v2.1/os-quota-sets/006baf72e2df494a89fe7d9966756672" status: 200 len: 371 microversion: 2.1 time: 0.216546 Oct 22 20:50:54.246652 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 265/594] 10.222.0.18 () {58 vars in 1242 bytes} [Sat Oct 22 20:50:54 2022] GET /compute/v2.1/os-quota-sets/006baf72e2df494a89fe7d9966756672 => generated 371 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:50:54.251763 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-1080007d-d9fb-4904-8bc3-71286ce43cd7 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Action: 'create', calling method: .version_select at 0x7fd3a4eca4c0>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-1418649182", "policies": ["affinity"]}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:50:54.276279 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-1080007d-d9fb-4904-8bc3-71286ce43cd7 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Getting quotas for project 902e239d67664098895ab24340b0b780. Resources: {'server_groups'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 20:50:54.282750 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-1080007d-d9fb-4904-8bc3-71286ce43cd7 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Getting quotas for user 91cf84a287b74618ae1b3368785b0b4c and project 902e239d67664098895ab24340b0b780. Resources: {'server_groups'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 20:50:54.406371 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-1080007d-d9fb-4904-8bc3-71286ce43cd7 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Getting quotas for project 902e239d67664098895ab24340b0b780. Resources: {'server_groups'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 20:50:54.421042 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-1080007d-d9fb-4904-8bc3-71286ce43cd7 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Getting quotas for user 91cf84a287b74618ae1b3368785b0b4c and project 902e239d67664098895ab24340b0b780. Resources: {'server_groups'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 20:50:54.439210 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.network.neutron [None req-8e4c31ed-202b-47f8-ad64-20e1cd34b9af tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] validate_networks() for [('310fed8a-623c-4efa-985c-2ea8005828e2', None, None, None, None, None)] {{(pid=138745) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 20:50:54.462243 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-1080007d-d9fb-4904-8bc3-71286ce43cd7 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] 10.222.0.18 "POST /compute/v2.1/os-server-groups" status: 200 len: 188 microversion: 2.1 time: 0.214431 Oct 22 20:50:54.463279 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 266/595] 10.222.0.18 () {60 vars in 1174 bytes} [Sat Oct 22 20:50:54 2022] POST /compute/v2.1/os-server-groups => generated 188 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:50:54.473517 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-f672a105-8a11-467d-940a-9ed31c5a0b74 tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:50:54.485741 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f672a105-8a11-467d-940a-9ed31c5a0b74 tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:50:54.487175 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f672a105-8a11-467d-940a-9ed31c5a0b74 tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:50:54.488277 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f672a105-8a11-467d-940a-9ed31c5a0b74 tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:50:54.490784 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f672a105-8a11-467d-940a-9ed31c5a0b74 tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:50:54.492019 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f672a105-8a11-467d-940a-9ed31c5a0b74 tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:50:54.492586 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f672a105-8a11-467d-940a-9ed31c5a0b74 tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:50:54.557491 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-f672a105-8a11-467d-940a-9ed31c5a0b74 tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] 10.222.0.18 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.092776 Oct 22 20:50:54.558449 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 267/596] 10.222.0.18 () {58 vars in 1176 bytes} [Sat Oct 22 20:50:54 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:50:54.563763 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-4762d11a-b9b4-4f14-b745-2d72593c64f9 tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:50:54.564743 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-4762d11a-b9b4-4f14-b745-2d72593c64f9 tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] [instance: 65381d5e-1265-418b-ac70-4ef749d9af14] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:50:54.571703 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4762d11a-b9b4-4f14-b745-2d72593c64f9 tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:50:54.572447 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4762d11a-b9b4-4f14-b745-2d72593c64f9 tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:50:54.573046 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4762d11a-b9b4-4f14-b745-2d72593c64f9 tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:50:54.573955 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4762d11a-b9b4-4f14-b745-2d72593c64f9 tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:50:54.574560 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4762d11a-b9b4-4f14-b745-2d72593c64f9 tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:50:54.575125 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4762d11a-b9b4-4f14-b745-2d72593c64f9 tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:50:54.578687 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:SELECT=100 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:50:54.717664 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell0:SELECT=2 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:50:54.871614 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-4762d11a-b9b4-4f14-b745-2d72593c64f9 tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b892876156f34b0d99a6c853d0cd4905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b403b83cad4babab211dafade27bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:50:54.884755 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-4762d11a-b9b4-4f14-b745-2d72593c64f9 tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] 10.222.0.18 "GET /compute/v2.1/servers/65381d5e-1265-418b-ac70-4ef749d9af14" status: 200 len: 1371 microversion: 2.1 time: 0.325027 Oct 22 20:50:54.885609 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 268/597] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:50:54 2022] GET /compute/v2.1/servers/65381d5e-1265-418b-ac70-4ef749d9af14 => generated 1371 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:50:54.891247 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-a78ce47c-6d2c-4932-b0ec-d297c7d5842a tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:50:54.892097 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-a78ce47c-6d2c-4932-b0ec-d297c7d5842a tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] [instance: 254dfdd3-3716-43cf-aadc-f678aff08d27] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:50:54.899426 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a78ce47c-6d2c-4932-b0ec-d297c7d5842a tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:50:54.900196 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a78ce47c-6d2c-4932-b0ec-d297c7d5842a tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:50:54.900921 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a78ce47c-6d2c-4932-b0ec-d297c7d5842a tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:50:54.901861 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a78ce47c-6d2c-4932-b0ec-d297c7d5842a tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:50:54.902477 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a78ce47c-6d2c-4932-b0ec-d297c7d5842a tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:50:54.903330 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a78ce47c-6d2c-4932-b0ec-d297c7d5842a tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:50:55.238673 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-a78ce47c-6d2c-4932-b0ec-d297c7d5842a tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:50:55.247966 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-a78ce47c-6d2c-4932-b0ec-d297c7d5842a tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:50:55.249507 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-a78ce47c-6d2c-4932-b0ec-d297c7d5842a tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:50:55.250963 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-a78ce47c-6d2c-4932-b0ec-d297c7d5842a tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] 10.222.0.18 "GET /compute/v2.1/servers/254dfdd3-3716-43cf-aadc-f678aff08d27" status: 200 len: 1568 microversion: 2.25 time: 0.364183 Oct 22 20:50:55.253093 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 269/598] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 20:50:54 2022] GET /compute/v2.1/servers/254dfdd3-3716-43cf-aadc-f678aff08d27 => generated 1568 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 20:50:55.257393 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-99f3974f-cbeb-4dc0-8470-f2c69656f8be tempest-QuotasAdminTestJSON-890688892 tempest-QuotasAdminTestJSON-890688892-project-admin] Action: 'update', calling method: .version_select at 0x7fd3a4559c10>, body: {"quota_set": {"ram": "5120"}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:50:55.330429 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-99f3974f-cbeb-4dc0-8470-f2c69656f8be tempest-QuotasAdminTestJSON-890688892 tempest-QuotasAdminTestJSON-890688892-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:50:55.331237 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-99f3974f-cbeb-4dc0-8470-f2c69656f8be tempest-QuotasAdminTestJSON-890688892 tempest-QuotasAdminTestJSON-890688892-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:50:55.331957 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-99f3974f-cbeb-4dc0-8470-f2c69656f8be tempest-QuotasAdminTestJSON-890688892 tempest-QuotasAdminTestJSON-890688892-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:50:55.332724 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-99f3974f-cbeb-4dc0-8470-f2c69656f8be tempest-QuotasAdminTestJSON-890688892 tempest-QuotasAdminTestJSON-890688892-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:50:55.333634 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-99f3974f-cbeb-4dc0-8470-f2c69656f8be tempest-QuotasAdminTestJSON-890688892 tempest-QuotasAdminTestJSON-890688892-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:50:55.333634 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-99f3974f-cbeb-4dc0-8470-f2c69656f8be tempest-QuotasAdminTestJSON-890688892 tempest-QuotasAdminTestJSON-890688892-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:50:55.350802 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:50:55.394744 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell0:SELECT=14,nova_cell0:UPDATE=2 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:50:55.405990 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-99f3974f-cbeb-4dc0-8470-f2c69656f8be tempest-QuotasAdminTestJSON-890688892 tempest-QuotasAdminTestJSON-890688892-project-admin] 10.222.0.18 "PUT /compute/v2.1/os-quota-sets/006baf72e2df494a89fe7d9966756672" status: 200 len: 328 microversion: 2.1 time: 0.152984 Oct 22 20:50:55.414399 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 270/599] 10.222.0.18 () {60 vars in 1262 bytes} [Sat Oct 22 20:50:55 2022] PUT /compute/v2.1/os-quota-sets/006baf72e2df494a89fe7d9966756672 => generated 328 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:50:55.420524 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-62349010-0444-4bc8-b932-fa271484e6ab tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch1-master-1", "block_migration": true, "disk_over_commit": false}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:50:55.423904 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-62349010-0444-4bc8-b932-fa271484e6ab tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] [instance: fe83cd49-4ceb-49aa-a775-cc2a4229fd76] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:50:55.430470 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-62349010-0444-4bc8-b932-fa271484e6ab tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:50:55.430962 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-62349010-0444-4bc8-b932-fa271484e6ab tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:50:55.431435 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-62349010-0444-4bc8-b932-fa271484e6ab tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:50:55.432159 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-62349010-0444-4bc8-b932-fa271484e6ab tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:50:55.432614 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-62349010-0444-4bc8-b932-fa271484e6ab tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:50:55.433035 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-62349010-0444-4bc8-b932-fa271484e6ab tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:50:55.468532 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.objects.instance [None req-62349010-0444-4bc8-b932-fa271484e6ab tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] Lazy-loading 'flavor' on Instance uuid fe83cd49-4ceb-49aa-a775-cc2a4229fd76 {{(pid=138744) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 20:50:55.482338 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-62349010-0444-4bc8-b932-fa271484e6ab tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] [instance: fe83cd49-4ceb-49aa-a775-cc2a4229fd76] Going to try to live migrate instance to nch1-master-1 {{(pid=138744) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 22 20:50:55.482465 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-8e4c31ed-202b-47f8-ad64-20e1cd34b9af tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Flavor limits 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 20:50:55.482840 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-8e4c31ed-202b-47f8-ad64-20e1cd34b9af tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Image limits 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 20:50:55.483326 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-8e4c31ed-202b-47f8-ad64-20e1cd34b9af tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Flavor pref 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 20:50:55.483754 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-8e4c31ed-202b-47f8-ad64-20e1cd34b9af tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Image pref 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 20:50:55.484160 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-8e4c31ed-202b-47f8-ad64-20e1cd34b9af tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 20:50:55.499662 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8e4c31ed-202b-47f8-ad64-20e1cd34b9af tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:50:55.500063 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8e4c31ed-202b-47f8-ad64-20e1cd34b9af tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:50:55.500601 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8e4c31ed-202b-47f8-ad64-20e1cd34b9af tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:50:55.501330 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8e4c31ed-202b-47f8-ad64-20e1cd34b9af tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:50:55.501782 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8e4c31ed-202b-47f8-ad64-20e1cd34b9af tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:50:55.502203 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8e4c31ed-202b-47f8-ad64-20e1cd34b9af tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:50:55.521695 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-8e4c31ed-202b-47f8-ad64-20e1cd34b9af tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Getting quotas for project 3e48413ed1ac4e1ea65fb38f097881db. Resources: {'cores', 'instances', 'ram'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 20:50:55.527117 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-8e4c31ed-202b-47f8-ad64-20e1cd34b9af tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Getting quotas for user 34f8af8ee2b545bead90fffd6c6c4896 and project 3e48413ed1ac4e1ea65fb38f097881db. Resources: {'cores', 'instances', 'ram'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 20:50:55.540366 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-8e4c31ed-202b-47f8-ad64-20e1cd34b9af tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Going to run 1 instances... {{(pid=138745) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 20:50:55.543043 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-8e4c31ed-202b-47f8-ad64-20e1cd34b9af tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] [instance: c475672d-99ba-4c6a-abaa-3332a392534d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='085e4478-6edc-4a69-8e08-f9831713eb65',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138745) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 20:50:55.599217 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-8e4c31ed-202b-47f8-ad64-20e1cd34b9af tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.396736 Oct 22 20:50:55.600883 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 330/600] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Oct 22 20:50:54 2022] POST /compute/v2.1/servers => generated 406 bytes in 1399 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 20:50:55.606979 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-af0e7905-7b8d-4267-b19f-91b94a9980db tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-388382712", "imageRef": "085e4478-6edc-4a69-8e08-f9831713eb65", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "83091a39-89dc-40c4-ae59-edcc55a4b24d"}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:50:55.689464 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.network.neutron [None req-af0e7905-7b8d-4267-b19f-91b94a9980db tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] validate_networks() for None {{(pid=138745) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 20:50:56.362342 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-af0e7905-7b8d-4267-b19f-91b94a9980db tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Flavor limits 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 20:50:56.362897 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-af0e7905-7b8d-4267-b19f-91b94a9980db tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Image limits 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 20:50:56.363768 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-af0e7905-7b8d-4267-b19f-91b94a9980db tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Flavor pref 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 20:50:56.364183 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-af0e7905-7b8d-4267-b19f-91b94a9980db tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Image pref 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 20:50:56.364597 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-af0e7905-7b8d-4267-b19f-91b94a9980db tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 20:50:56.412066 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=14,nova_api:INSERT=5 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:50:56.438338 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-af0e7905-7b8d-4267-b19f-91b94a9980db tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:50:56.438920 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-af0e7905-7b8d-4267-b19f-91b94a9980db tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:50:56.439392 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-af0e7905-7b8d-4267-b19f-91b94a9980db tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:50:56.440142 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-af0e7905-7b8d-4267-b19f-91b94a9980db tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:50:56.440794 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-af0e7905-7b8d-4267-b19f-91b94a9980db tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:50:56.442532 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-af0e7905-7b8d-4267-b19f-91b94a9980db tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:50:56.464733 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-af0e7905-7b8d-4267-b19f-91b94a9980db tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Getting quotas for project 902e239d67664098895ab24340b0b780. Resources: {'cores', 'instances', 'ram'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 20:50:56.472975 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-af0e7905-7b8d-4267-b19f-91b94a9980db tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Getting quotas for user 91cf84a287b74618ae1b3368785b0b4c and project 902e239d67664098895ab24340b0b780. Resources: {'cores', 'instances', 'ram'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 20:50:56.523038 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-af0e7905-7b8d-4267-b19f-91b94a9980db tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Going to run 2 instances... {{(pid=138745) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 20:50:56.530845 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-af0e7905-7b8d-4267-b19f-91b94a9980db tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] [instance: d992dc02-b690-452b-aaf2-1473b69a75cb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='085e4478-6edc-4a69-8e08-f9831713eb65',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138745) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 20:50:56.585603 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-af0e7905-7b8d-4267-b19f-91b94a9980db tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=138745) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Oct 22 20:50:56.635240 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-af0e7905-7b8d-4267-b19f-91b94a9980db tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Getting quotas for project 902e239d67664098895ab24340b0b780. Resources: {'server_group_members'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 20:50:56.645314 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-af0e7905-7b8d-4267-b19f-91b94a9980db tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Getting quotas for user 91cf84a287b74618ae1b3368785b0b4c and project 902e239d67664098895ab24340b0b780. Resources: {'server_group_members'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 20:50:56.730708 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-af0e7905-7b8d-4267-b19f-91b94a9980db tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Getting quotas for project 902e239d67664098895ab24340b0b780. Resources: {'server_group_members'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 20:50:56.738375 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-af0e7905-7b8d-4267-b19f-91b94a9980db tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Getting quotas for user 91cf84a287b74618ae1b3368785b0b4c and project 902e239d67664098895ab24340b0b780. Resources: {'server_group_members'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 20:50:56.774455 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-af0e7905-7b8d-4267-b19f-91b94a9980db tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] [instance: 0923f68f-d334-4133-824a-7830b65acc28] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='085e4478-6edc-4a69-8e08-f9831713eb65',instance=,instance_uuid=d992dc02-b690-452b-aaf2-1473b69a75cb,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138745) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 20:50:56.859914 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-af0e7905-7b8d-4267-b19f-91b94a9980db tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Getting quotas for project 902e239d67664098895ab24340b0b780. Resources: {'server_group_members'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 20:50:56.865991 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-af0e7905-7b8d-4267-b19f-91b94a9980db tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Getting quotas for user 91cf84a287b74618ae1b3368785b0b4c and project 902e239d67664098895ab24340b0b780. Resources: {'server_group_members'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 20:50:56.917202 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-af0e7905-7b8d-4267-b19f-91b94a9980db tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Getting quotas for project 902e239d67664098895ab24340b0b780. Resources: {'server_group_members'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 20:50:56.923596 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-af0e7905-7b8d-4267-b19f-91b94a9980db tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Getting quotas for user 91cf84a287b74618ae1b3368785b0b4c and project 902e239d67664098895ab24340b0b780. Resources: {'server_group_members'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 20:50:56.984685 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-af0e7905-7b8d-4267-b19f-91b94a9980db tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.381629 Oct 22 20:50:56.985328 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 331/601] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Oct 22 20:50:55 2022] POST /compute/v2.1/servers => generated 32 bytes in 1384 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Oct 22 20:50:56.992140 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-db7e267e-4174-4db0-8057-3fda0500749b tempest-QuotasAdminTestJSON-890688892 tempest-QuotasAdminTestJSON-890688892-project-admin] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:50:57.037328 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-db7e267e-4174-4db0-8057-3fda0500749b tempest-QuotasAdminTestJSON-890688892 tempest-QuotasAdminTestJSON-890688892-project-admin] 10.222.0.18 "DELETE /compute/v2.1/os-quota-sets/006baf72e2df494a89fe7d9966756672" status: 202 len: 0 microversion: 2.1 time: 0.050829 Oct 22 20:50:57.038231 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 332/602] 10.222.0.18 () {58 vars in 1245 bytes} [Sat Oct 22 20:50:56 2022] DELETE /compute/v2.1/os-quota-sets/006baf72e2df494a89fe7d9966756672 => generated 0 bytes in 52 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 20:50:57.049001 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-2e636b18-d866-4b0b-b2be-06a190c88828 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:50:57.051042 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-2e636b18-d866-4b0b-b2be-06a190c88828 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] [instance: c475672d-99ba-4c6a-abaa-3332a392534d] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:50:57.068580 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2e636b18-d866-4b0b-b2be-06a190c88828 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:50:57.073005 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2e636b18-d866-4b0b-b2be-06a190c88828 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:50:57.073476 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2e636b18-d866-4b0b-b2be-06a190c88828 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:50:57.074872 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2e636b18-d866-4b0b-b2be-06a190c88828 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:50:57.074872 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2e636b18-d866-4b0b-b2be-06a190c88828 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:50:57.075179 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2e636b18-d866-4b0b-b2be-06a190c88828 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:50:57.208680 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-2e636b18-d866-4b0b-b2be-06a190c88828 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34f8af8ee2b545bead90fffd6c6c4896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48413ed1ac4e1ea65fb38f097881db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:50:57.218987 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-2e636b18-d866-4b0b-b2be-06a190c88828 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] 10.222.0.18 "GET /compute/v2.1/servers/c475672d-99ba-4c6a-abaa-3332a392534d" status: 200 len: 1292 microversion: 2.1 time: 0.178561 Oct 22 20:50:57.235291 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 333/603] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:50:57 2022] GET /compute/v2.1/servers/c475672d-99ba-4c6a-abaa-3332a392534d => generated 1292 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:50:57.235291 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-56523634-0db2-4bfa-9192-5e9fd3067c9f tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:50:57.235291 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-56523634-0db2-4bfa-9192-5e9fd3067c9f tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] [instance: 65381d5e-1265-418b-ac70-4ef749d9af14] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:50:57.246491 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-56523634-0db2-4bfa-9192-5e9fd3067c9f tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:50:57.246984 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-56523634-0db2-4bfa-9192-5e9fd3067c9f tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:50:57.247583 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-56523634-0db2-4bfa-9192-5e9fd3067c9f tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:50:57.248431 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-56523634-0db2-4bfa-9192-5e9fd3067c9f tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:50:57.249609 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-56523634-0db2-4bfa-9192-5e9fd3067c9f tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:50:57.250165 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-56523634-0db2-4bfa-9192-5e9fd3067c9f tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:50:57.787609 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-56523634-0db2-4bfa-9192-5e9fd3067c9f tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b892876156f34b0d99a6c853d0cd4905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b403b83cad4babab211dafade27bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:50:57.799556 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-56523634-0db2-4bfa-9192-5e9fd3067c9f tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] 10.222.0.18 "GET /compute/v2.1/servers/65381d5e-1265-418b-ac70-4ef749d9af14" status: 200 len: 1371 microversion: 2.1 time: 0.577880 Oct 22 20:50:57.802139 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 334/604] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:50:57 2022] GET /compute/v2.1/servers/65381d5e-1265-418b-ac70-4ef749d9af14 => generated 1371 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:50:57.807054 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-3e15819f-c0f8-47f1-ac2a-4e9ce1728d74 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:50:57.807694 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-3e15819f-c0f8-47f1-ac2a-4e9ce1728d74 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] [instance: 254dfdd3-3716-43cf-aadc-f678aff08d27] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:50:57.828589 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3e15819f-c0f8-47f1-ac2a-4e9ce1728d74 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:50:57.829082 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3e15819f-c0f8-47f1-ac2a-4e9ce1728d74 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:50:57.829521 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3e15819f-c0f8-47f1-ac2a-4e9ce1728d74 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:50:57.830240 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3e15819f-c0f8-47f1-ac2a-4e9ce1728d74 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:50:57.830694 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3e15819f-c0f8-47f1-ac2a-4e9ce1728d74 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:50:57.831115 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3e15819f-c0f8-47f1-ac2a-4e9ce1728d74 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:50:57.841076 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-62349010-0444-4bc8-b932-fa271484e6ab tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] 10.222.0.18 "POST /compute/v2.1/servers/fe83cd49-4ceb-49aa-a775-cc2a4229fd76/action" status: 202 len: 0 microversion: 2.1 time: 2.432913 Oct 22 20:50:57.842024 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 271/605] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 20:50:55 2022] POST /compute/v2.1/servers/fe83cd49-4ceb-49aa-a775-cc2a4229fd76/action => generated 0 bytes in 2434 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 20:50:57.849454 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-9f63b712-dedb-4b9c-8456-0ea0aa6b2710 req-62ab4ea0-8f81-4e4c-9634-d1e4506daf07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "254dfdd3-3716-43cf-aadc-f678aff08d27", "name": "network-vif-unplugged", "status": "completed", "tag": "aa3c904e-442d-4f48-8da8-c9451b740c64"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:50:57.878018 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-9f63b712-dedb-4b9c-8456-0ea0aa6b2710 req-62ab4ea0-8f81-4e4c-9634-d1e4506daf07 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:50:57.884916 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-9f63b712-dedb-4b9c-8456-0ea0aa6b2710 req-62ab4ea0-8f81-4e4c-9634-d1e4506daf07 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:50:57.885902 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-9f63b712-dedb-4b9c-8456-0ea0aa6b2710 req-62ab4ea0-8f81-4e4c-9634-d1e4506daf07 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:50:57.918045 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-9f63b712-dedb-4b9c-8456-0ea0aa6b2710 req-62ab4ea0-8f81-4e4c-9634-d1e4506daf07 service nova] Creating event network-vif-unplugged:aa3c904e-442d-4f48-8da8-c9451b740c64 for instance 254dfdd3-3716-43cf-aadc-f678aff08d27 on nch2-master-1 Oct 22 20:50:57.939396 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-9f63b712-dedb-4b9c-8456-0ea0aa6b2710 req-62ab4ea0-8f81-4e4c-9634-d1e4506daf07 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.093412 Oct 22 20:50:57.941056 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 272/606] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:50:57 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:50:57.977339 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-0eeaeaf1-100f-4584-a07c-6adbf659bec5 req-f9784ca4-2751-43a9-b06a-b058acad6365 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65381d5e-1265-418b-ac70-4ef749d9af14", "name": "network-vif-plugged", "status": "completed", "tag": "2082100f-222c-49e5-af14-7af046476c87"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:50:57.999091 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-0eeaeaf1-100f-4584-a07c-6adbf659bec5 req-f9784ca4-2751-43a9-b06a-b058acad6365 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:50:57.999649 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-0eeaeaf1-100f-4584-a07c-6adbf659bec5 req-f9784ca4-2751-43a9-b06a-b058acad6365 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:50:58.000301 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-0eeaeaf1-100f-4584-a07c-6adbf659bec5 req-f9784ca4-2751-43a9-b06a-b058acad6365 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:50:58.025380 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-0eeaeaf1-100f-4584-a07c-6adbf659bec5 req-f9784ca4-2751-43a9-b06a-b058acad6365 service nova] Creating event network-vif-plugged:2082100f-222c-49e5-af14-7af046476c87 for instance 65381d5e-1265-418b-ac70-4ef749d9af14 on nch2-master-1 Oct 22 20:50:58.033960 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-0eeaeaf1-100f-4584-a07c-6adbf659bec5 req-f9784ca4-2751-43a9-b06a-b058acad6365 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076382 Oct 22 20:50:58.035060 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 273/607] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:50:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:50:58.041444 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-7d245f7c-3f4c-4341-b0fb-328294e9e2d2 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:50:58.047761 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-7d245f7c-3f4c-4341-b0fb-328294e9e2d2 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '91cf84a287b74618ae1b3368785b0b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902e239d67664098895ab24340b0b780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:50:58.048869 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-7d245f7c-3f4c-4341-b0fb-328294e9e2d2 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Searching by: {'deleted': False, 'project_id': '902e239d67664098895ab24340b0b780'} {{(pid=138744) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 22 20:50:58.095256 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7d245f7c-3f4c-4341-b0fb-328294e9e2d2 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:50:58.096892 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7d245f7c-3f4c-4341-b0fb-328294e9e2d2 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:50:58.097574 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7d245f7c-3f4c-4341-b0fb-328294e9e2d2 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:50:58.098644 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7d245f7c-3f4c-4341-b0fb-328294e9e2d2 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:50:58.099353 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7d245f7c-3f4c-4341-b0fb-328294e9e2d2 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:50:58.100789 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7d245f7c-3f4c-4341-b0fb-328294e9e2d2 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:50:58.228907 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.multi_cell_list [None req-7d245f7c-3f4c-4341-b0fb-328294e9e2d2 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Listed batch of 1 results from cell out of 998 limit. Returned 1 total so far. {{(pid=138744) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 22 20:50:58.303696 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-3e15819f-c0f8-47f1-ac2a-4e9ce1728d74 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:50:58.319969 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-3e15819f-c0f8-47f1-ac2a-4e9ce1728d74 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:50:58.321770 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-3e15819f-c0f8-47f1-ac2a-4e9ce1728d74 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:50:58.323280 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-3e15819f-c0f8-47f1-ac2a-4e9ce1728d74 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] 10.222.0.18 "GET /compute/v2.1/servers/254dfdd3-3716-43cf-aadc-f678aff08d27" status: 200 len: 1568 microversion: 2.25 time: 0.520069 Oct 22 20:50:58.324077 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 335/608] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 20:50:57 2022] GET /compute/v2.1/servers/254dfdd3-3716-43cf-aadc-f678aff08d27 => generated 1568 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 20:50:58.335422 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-e7c6b660-31f1-4b80-ae05-edabae9f7a40 tempest-QuotasAdminTestJSON-890688892 tempest-QuotasAdminTestJSON-890688892-project-admin] Calling method '.version_select at 0x7fd3a4ad6310>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:50:58.363880 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-7d245f7c-3f4c-4341-b0fb-328294e9e2d2 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] 10.222.0.18 "GET /compute/v2.1/servers" status: 200 len: 1002 microversion: 2.1 time: 0.326770 Oct 22 20:50:58.364635 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 274/609] 10.222.0.18 () {58 vars in 1125 bytes} [Sat Oct 22 20:50:58 2022] GET /compute/v2.1/servers => generated 1002 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:50:58.370026 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-8ff72b73-1248-4b1e-8819-5aa74527459f tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:50:58.370946 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-8ff72b73-1248-4b1e-8819-5aa74527459f tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] [instance: fe83cd49-4ceb-49aa-a775-cc2a4229fd76] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:50:58.379307 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8ff72b73-1248-4b1e-8819-5aa74527459f tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:50:58.380091 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8ff72b73-1248-4b1e-8819-5aa74527459f tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:50:58.380517 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8ff72b73-1248-4b1e-8819-5aa74527459f tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:50:58.381332 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8ff72b73-1248-4b1e-8819-5aa74527459f tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:50:58.382458 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8ff72b73-1248-4b1e-8819-5aa74527459f tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:50:58.382998 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8ff72b73-1248-4b1e-8819-5aa74527459f tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:50:58.484762 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-e7c6b660-31f1-4b80-ae05-edabae9f7a40 tempest-QuotasAdminTestJSON-890688892 tempest-QuotasAdminTestJSON-890688892-project-admin] 10.222.0.18 "GET /compute/v2.1/os-quota-sets/006baf72e2df494a89fe7d9966756672" status: 200 len: 371 microversion: 2.1 time: 0.159263 Oct 22 20:50:58.493282 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 336/610] 10.222.0.18 () {58 vars in 1242 bytes} [Sat Oct 22 20:50:58 2022] GET /compute/v2.1/os-quota-sets/006baf72e2df494a89fe7d9966756672 => generated 371 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:50:58.505260 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-686eba53-04de-4544-b911-84d067fa7745 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:50:58.508216 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-686eba53-04de-4544-b911-84d067fa7745 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] [instance: c475672d-99ba-4c6a-abaa-3332a392534d] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:50:58.522197 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-686eba53-04de-4544-b911-84d067fa7745 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:50:58.522713 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-686eba53-04de-4544-b911-84d067fa7745 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:50:58.523416 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-686eba53-04de-4544-b911-84d067fa7745 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:50:58.524212 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-686eba53-04de-4544-b911-84d067fa7745 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:50:58.524687 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-686eba53-04de-4544-b911-84d067fa7745 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:50:58.525163 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-686eba53-04de-4544-b911-84d067fa7745 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:50:58.670028 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-686eba53-04de-4544-b911-84d067fa7745 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34f8af8ee2b545bead90fffd6c6c4896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48413ed1ac4e1ea65fb38f097881db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:50:58.678835 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-686eba53-04de-4544-b911-84d067fa7745 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] 10.222.0.18 "GET /compute/v2.1/servers/c475672d-99ba-4c6a-abaa-3332a392534d" status: 200 len: 1298 microversion: 2.1 time: 0.184031 Oct 22 20:50:58.679640 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 337/611] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:50:58 2022] GET /compute/v2.1/servers/c475672d-99ba-4c6a-abaa-3332a392534d => generated 1298 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:50:58.684606 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-260d456a-d264-4e79-ab13-6c4895a21c04 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:50:58.685214 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-260d456a-d264-4e79-ab13-6c4895a21c04 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] [instance: 0923f68f-d334-4133-824a-7830b65acc28] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:50:58.691867 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-260d456a-d264-4e79-ab13-6c4895a21c04 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:50:58.692621 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-260d456a-d264-4e79-ab13-6c4895a21c04 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:50:58.693206 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-260d456a-d264-4e79-ab13-6c4895a21c04 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:50:58.694075 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-8ff72b73-1248-4b1e-8819-5aa74527459f tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c87f0356ca346f39c6216393d85da2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee8c8f7fc4e12bc1f9fcce3e7b581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:50:58.694274 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-260d456a-d264-4e79-ab13-6c4895a21c04 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:50:58.694888 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-260d456a-d264-4e79-ab13-6c4895a21c04 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:50:58.695521 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-260d456a-d264-4e79-ab13-6c4895a21c04 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:50:58.708469 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-8ff72b73-1248-4b1e-8819-5aa74527459f tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] 10.222.0.18 "GET /compute/v2.1/servers/fe83cd49-4ceb-49aa-a775-cc2a4229fd76" status: 200 len: 1503 microversion: 2.1 time: 0.342646 Oct 22 20:50:58.711894 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 275/612] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:50:58 2022] GET /compute/v2.1/servers/fe83cd49-4ceb-49aa-a775-cc2a4229fd76 => generated 1503 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:50:58.716929 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-86377a21-aa07-45f8-aec8-1df2bc0a0b39 tempest-QuotasAdminTestJSON-890688892 tempest-QuotasAdminTestJSON-890688892-project-admin] Calling method '.version_select at 0x7fd3a454ddc0>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:50:58.817588 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-260d456a-d264-4e79-ab13-6c4895a21c04 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91cf84a287b74618ae1b3368785b0b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902e239d67664098895ab24340b0b780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:50:58.830609 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-260d456a-d264-4e79-ab13-6c4895a21c04 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] 10.222.0.18 "GET /compute/v2.1/servers/0923f68f-d334-4133-824a-7830b65acc28" status: 200 len: 1222 microversion: 2.1 time: 0.149829 Oct 22 20:50:58.838757 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 338/613] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:50:58 2022] GET /compute/v2.1/servers/0923f68f-d334-4133-824a-7830b65acc28 => generated 1222 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:50:58.842652 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-f473a3d7-081e-4bb6-9477-bf12e7f7f26e tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:50:58.844438 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-f473a3d7-081e-4bb6-9477-bf12e7f7f26e tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] [instance: 65381d5e-1265-418b-ac70-4ef749d9af14] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:50:58.854696 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f473a3d7-081e-4bb6-9477-bf12e7f7f26e tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:50:58.855318 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f473a3d7-081e-4bb6-9477-bf12e7f7f26e tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:50:58.856058 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f473a3d7-081e-4bb6-9477-bf12e7f7f26e tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:50:58.857046 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f473a3d7-081e-4bb6-9477-bf12e7f7f26e tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:50:58.857405 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f473a3d7-081e-4bb6-9477-bf12e7f7f26e tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:50:58.858095 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f473a3d7-081e-4bb6-9477-bf12e7f7f26e tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:50:58.976517 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-86377a21-aa07-45f8-aec8-1df2bc0a0b39 tempest-QuotasAdminTestJSON-890688892 tempest-QuotasAdminTestJSON-890688892-project-admin] 10.222.0.18 "GET /compute/v2.1/os-quota-sets/b8e4f0ef6caf430c96d4d3f82954882b/defaults" status: 200 len: 371 microversion: 2.1 time: 0.263403 Oct 22 20:50:58.977865 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 276/614] 10.222.0.18 () {58 vars in 1269 bytes} [Sat Oct 22 20:50:58 2022] GET /compute/v2.1/os-quota-sets/b8e4f0ef6caf430c96d4d3f82954882b/defaults => generated 371 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:50:59.117754 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-f473a3d7-081e-4bb6-9477-bf12e7f7f26e tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b892876156f34b0d99a6c853d0cd4905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b403b83cad4babab211dafade27bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:50:59.137455 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-f473a3d7-081e-4bb6-9477-bf12e7f7f26e tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] 10.222.0.18 "GET /compute/v2.1/servers/65381d5e-1265-418b-ac70-4ef749d9af14" status: 200 len: 1371 microversion: 2.1 time: 0.302716 Oct 22 20:50:59.139204 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 339/615] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:50:58 2022] GET /compute/v2.1/servers/65381d5e-1265-418b-ac70-4ef749d9af14 => generated 1371 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:50:59.194476 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-489d9d31-e1b8-48df-ab7e-cc832fab211c tempest-QuotasAdminTestJSON-890688892 tempest-QuotasAdminTestJSON-890688892-project-admin] Action: 'update', calling method: .version_select at 0x7fd3a4559670>, body: {"quota_set": {"ram": "5120"}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:50:59.352912 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-4ae76b92-4e5c-49f3-a15c-20cf567f25d9 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:50:59.353790 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-4ae76b92-4e5c-49f3-a15c-20cf567f25d9 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] [instance: 254dfdd3-3716-43cf-aadc-f678aff08d27] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:50:59.361664 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4ae76b92-4e5c-49f3-a15c-20cf567f25d9 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:50:59.362472 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4ae76b92-4e5c-49f3-a15c-20cf567f25d9 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:50:59.363165 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4ae76b92-4e5c-49f3-a15c-20cf567f25d9 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:50:59.364253 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4ae76b92-4e5c-49f3-a15c-20cf567f25d9 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:50:59.364889 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4ae76b92-4e5c-49f3-a15c-20cf567f25d9 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:50:59.365487 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4ae76b92-4e5c-49f3-a15c-20cf567f25d9 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:50:59.380036 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-489d9d31-e1b8-48df-ab7e-cc832fab211c tempest-QuotasAdminTestJSON-890688892 tempest-QuotasAdminTestJSON-890688892-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:50:59.380526 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-489d9d31-e1b8-48df-ab7e-cc832fab211c tempest-QuotasAdminTestJSON-890688892 tempest-QuotasAdminTestJSON-890688892-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:50:59.396788 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-489d9d31-e1b8-48df-ab7e-cc832fab211c tempest-QuotasAdminTestJSON-890688892 tempest-QuotasAdminTestJSON-890688892-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:50:59.397774 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-489d9d31-e1b8-48df-ab7e-cc832fab211c tempest-QuotasAdminTestJSON-890688892 tempest-QuotasAdminTestJSON-890688892-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:50:59.398306 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-489d9d31-e1b8-48df-ab7e-cc832fab211c tempest-QuotasAdminTestJSON-890688892 tempest-QuotasAdminTestJSON-890688892-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:50:59.403691 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-489d9d31-e1b8-48df-ab7e-cc832fab211c tempest-QuotasAdminTestJSON-890688892 tempest-QuotasAdminTestJSON-890688892-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:50:59.503545 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-489d9d31-e1b8-48df-ab7e-cc832fab211c tempest-QuotasAdminTestJSON-890688892 tempest-QuotasAdminTestJSON-890688892-project-admin] 10.222.0.18 "PUT /compute/v2.1/os-quota-sets/a7f0ec336d964930b0da0c47d6b02dd1" status: 200 len: 328 microversion: 2.1 time: 0.313809 Oct 22 20:50:59.513212 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 277/616] 10.222.0.18 () {60 vars in 1262 bytes} [Sat Oct 22 20:50:59 2022] PUT /compute/v2.1/os-quota-sets/a7f0ec336d964930b0da0c47d6b02dd1 => generated 328 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:50:59.520177 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-33868b41-9493-4118-9de7-2715dd4069e1 tempest-QuotasAdminTestJSON-890688892 tempest-QuotasAdminTestJSON-890688892-project-admin] Calling method '.version_select at 0x7fd3a4ef3b80>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:50:59.598250 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-33868b41-9493-4118-9de7-2715dd4069e1 tempest-QuotasAdminTestJSON-890688892 tempest-QuotasAdminTestJSON-890688892-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:50:59.599394 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-33868b41-9493-4118-9de7-2715dd4069e1 tempest-QuotasAdminTestJSON-890688892 tempest-QuotasAdminTestJSON-890688892-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:50:59.600080 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-33868b41-9493-4118-9de7-2715dd4069e1 tempest-QuotasAdminTestJSON-890688892 tempest-QuotasAdminTestJSON-890688892-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:50:59.601081 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-33868b41-9493-4118-9de7-2715dd4069e1 tempest-QuotasAdminTestJSON-890688892 tempest-QuotasAdminTestJSON-890688892-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:50:59.602097 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-33868b41-9493-4118-9de7-2715dd4069e1 tempest-QuotasAdminTestJSON-890688892 tempest-QuotasAdminTestJSON-890688892-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:50:59.603009 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-33868b41-9493-4118-9de7-2715dd4069e1 tempest-QuotasAdminTestJSON-890688892 tempest-QuotasAdminTestJSON-890688892-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:50:59.626601 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-33868b41-9493-4118-9de7-2715dd4069e1 tempest-QuotasAdminTestJSON-890688892 tempest-QuotasAdminTestJSON-890688892-project-admin] 10.222.0.18 "GET /compute/v2.1/os-quota-sets/a7f0ec336d964930b0da0c47d6b02dd1/detail" status: 200 len: 916 microversion: 2.1 time: 0.111991 Oct 22 20:50:59.627821 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 278/617] 10.222.0.18 () {58 vars in 1263 bytes} [Sat Oct 22 20:50:59 2022] GET /compute/v2.1/os-quota-sets/a7f0ec336d964930b0da0c47d6b02dd1/detail => generated 916 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:50:59.710594 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-4e239231-97ee-4116-a238-2c438d17e39c tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:50:59.711885 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-4e239231-97ee-4116-a238-2c438d17e39c tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] [instance: c475672d-99ba-4c6a-abaa-3332a392534d] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:50:59.724559 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4e239231-97ee-4116-a238-2c438d17e39c tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:50:59.725564 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4e239231-97ee-4116-a238-2c438d17e39c tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:50:59.726185 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4e239231-97ee-4116-a238-2c438d17e39c tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:50:59.728910 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4e239231-97ee-4116-a238-2c438d17e39c tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:50:59.729659 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4e239231-97ee-4116-a238-2c438d17e39c tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:50:59.731677 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4e239231-97ee-4116-a238-2c438d17e39c tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:50:59.745480 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-4ae76b92-4e5c-49f3-a15c-20cf567f25d9 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:50:59.782323 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-4ae76b92-4e5c-49f3-a15c-20cf567f25d9 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:50:59.790812 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-4ae76b92-4e5c-49f3-a15c-20cf567f25d9 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:50:59.797266 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-4ae76b92-4e5c-49f3-a15c-20cf567f25d9 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] 10.222.0.18 "GET /compute/v2.1/servers/254dfdd3-3716-43cf-aadc-f678aff08d27" status: 200 len: 1568 microversion: 2.25 time: 0.444980 Oct 22 20:50:59.799375 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 340/618] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 20:50:59 2022] GET /compute/v2.1/servers/254dfdd3-3716-43cf-aadc-f678aff08d27 => generated 1568 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 22 20:50:59.827702 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-b649a812-054d-4583-8eaf-22b21005e48f tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:50:59.828785 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-b649a812-054d-4583-8eaf-22b21005e48f tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] [instance: fe83cd49-4ceb-49aa-a775-cc2a4229fd76] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:50:59.849192 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b649a812-054d-4583-8eaf-22b21005e48f tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:50:59.850005 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b649a812-054d-4583-8eaf-22b21005e48f tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:50:59.850600 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b649a812-054d-4583-8eaf-22b21005e48f tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:50:59.853317 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b649a812-054d-4583-8eaf-22b21005e48f tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:50:59.854843 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b649a812-054d-4583-8eaf-22b21005e48f tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:50:59.856178 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b649a812-054d-4583-8eaf-22b21005e48f tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:00.164794 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-4e239231-97ee-4116-a238-2c438d17e39c tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34f8af8ee2b545bead90fffd6c6c4896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48413ed1ac4e1ea65fb38f097881db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:51:00.172733 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-4e239231-97ee-4116-a238-2c438d17e39c tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] 10.222.0.18 "GET /compute/v2.1/servers/c475672d-99ba-4c6a-abaa-3332a392534d" status: 200 len: 1366 microversion: 2.1 time: 0.466965 Oct 22 20:51:00.173329 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 279/619] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:50:59 2022] GET /compute/v2.1/servers/c475672d-99ba-4c6a-abaa-3332a392534d => generated 1366 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 20:51:00.177845 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-b6dfa56b-b711-4788-b75a-2e56573d2cda tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:51:00.178478 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-b6dfa56b-b711-4788-b75a-2e56573d2cda tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] [instance: 0923f68f-d334-4133-824a-7830b65acc28] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:51:00.185488 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b6dfa56b-b711-4788-b75a-2e56573d2cda tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:00.186286 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b6dfa56b-b711-4788-b75a-2e56573d2cda tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:00.186925 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b6dfa56b-b711-4788-b75a-2e56573d2cda tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:00.187849 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b6dfa56b-b711-4788-b75a-2e56573d2cda tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:00.188490 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b6dfa56b-b711-4788-b75a-2e56573d2cda tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:00.189136 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b6dfa56b-b711-4788-b75a-2e56573d2cda tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:00.190818 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-b649a812-054d-4583-8eaf-22b21005e48f tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c87f0356ca346f39c6216393d85da2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee8c8f7fc4e12bc1f9fcce3e7b581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:51:00.204851 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-b649a812-054d-4583-8eaf-22b21005e48f tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] 10.222.0.18 "GET /compute/v2.1/servers/fe83cd49-4ceb-49aa-a775-cc2a4229fd76" status: 200 len: 1503 microversion: 2.1 time: 0.401364 Oct 22 20:51:00.219030 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 341/620] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:50:59 2022] GET /compute/v2.1/servers/fe83cd49-4ceb-49aa-a775-cc2a4229fd76 => generated 1503 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:51:00.239701 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-0c15560d-7b34-4b26-92de-a21e30c1f6fb tempest-QuotasAdminTestJSON-890688892 tempest-QuotasAdminTestJSON-890688892-project-admin] Action: 'update', calling method: .version_select at 0x7fd3a4b24ee0>, body: {"quota_set": {"ram": "2048"}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:51:00.272506 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-b6dfa56b-b711-4788-b75a-2e56573d2cda tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91cf84a287b74618ae1b3368785b0b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902e239d67664098895ab24340b0b780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:51:00.284064 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-b6dfa56b-b711-4788-b75a-2e56573d2cda tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] 10.222.0.18 "GET /compute/v2.1/servers/0923f68f-d334-4133-824a-7830b65acc28" status: 200 len: 1270 microversion: 2.1 time: 0.109496 Oct 22 20:51:00.284976 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 280/621] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:51:00 2022] GET /compute/v2.1/servers/0923f68f-d334-4133-824a-7830b65acc28 => generated 1270 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:51:00.290644 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-718df16e-9559-49ed-a865-b4313d6299e3 req-e0458d2c-7997-4ee2-9189-9cbc3d5e3934 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "254dfdd3-3716-43cf-aadc-f678aff08d27", "tag": "aa3c904e-442d-4f48-8da8-c9451b740c64"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:51:00.301250 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-718df16e-9559-49ed-a865-b4313d6299e3 req-e0458d2c-7997-4ee2-9189-9cbc3d5e3934 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:00.301997 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-718df16e-9559-49ed-a865-b4313d6299e3 req-e0458d2c-7997-4ee2-9189-9cbc3d5e3934 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:00.302601 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-718df16e-9559-49ed-a865-b4313d6299e3 req-e0458d2c-7997-4ee2-9189-9cbc3d5e3934 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:00.319691 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-718df16e-9559-49ed-a865-b4313d6299e3 req-e0458d2c-7997-4ee2-9189-9cbc3d5e3934 service nova] Creating event network-changed:aa3c904e-442d-4f48-8da8-c9451b740c64 for instance 254dfdd3-3716-43cf-aadc-f678aff08d27 on nch2-master-1 Oct 22 20:51:00.328658 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-718df16e-9559-49ed-a865-b4313d6299e3 req-e0458d2c-7997-4ee2-9189-9cbc3d5e3934 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041442 Oct 22 20:51:00.329863 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 281/622] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:51:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:51:00.336347 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-936dcac2-819a-4102-bee9-0cf47b714af9 tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:51:00.337369 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-936dcac2-819a-4102-bee9-0cf47b714af9 tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] [instance: 65381d5e-1265-418b-ac70-4ef749d9af14] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:51:00.346351 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-936dcac2-819a-4102-bee9-0cf47b714af9 tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:00.347379 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-936dcac2-819a-4102-bee9-0cf47b714af9 tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:00.348400 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-936dcac2-819a-4102-bee9-0cf47b714af9 tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:00.349799 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-936dcac2-819a-4102-bee9-0cf47b714af9 tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:00.350575 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-936dcac2-819a-4102-bee9-0cf47b714af9 tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:00.351216 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-936dcac2-819a-4102-bee9-0cf47b714af9 tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:00.371916 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0c15560d-7b34-4b26-92de-a21e30c1f6fb tempest-QuotasAdminTestJSON-890688892 tempest-QuotasAdminTestJSON-890688892-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:00.372504 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0c15560d-7b34-4b26-92de-a21e30c1f6fb tempest-QuotasAdminTestJSON-890688892 tempest-QuotasAdminTestJSON-890688892-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:00.373126 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0c15560d-7b34-4b26-92de-a21e30c1f6fb tempest-QuotasAdminTestJSON-890688892 tempest-QuotasAdminTestJSON-890688892-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:00.374467 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0c15560d-7b34-4b26-92de-a21e30c1f6fb tempest-QuotasAdminTestJSON-890688892 tempest-QuotasAdminTestJSON-890688892-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:00.375138 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0c15560d-7b34-4b26-92de-a21e30c1f6fb tempest-QuotasAdminTestJSON-890688892 tempest-QuotasAdminTestJSON-890688892-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:00.375865 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0c15560d-7b34-4b26-92de-a21e30c1f6fb tempest-QuotasAdminTestJSON-890688892 tempest-QuotasAdminTestJSON-890688892-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:00.390862 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:51:00.425551 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=8,nova_api:DELETE=2 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:51:00.437872 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0c15560d-7b34-4b26-92de-a21e30c1f6fb tempest-QuotasAdminTestJSON-890688892 tempest-QuotasAdminTestJSON-890688892-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:00.439494 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0c15560d-7b34-4b26-92de-a21e30c1f6fb tempest-QuotasAdminTestJSON-890688892 tempest-QuotasAdminTestJSON-890688892-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:00.440353 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0c15560d-7b34-4b26-92de-a21e30c1f6fb tempest-QuotasAdminTestJSON-890688892 tempest-QuotasAdminTestJSON-890688892-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:00.441456 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0c15560d-7b34-4b26-92de-a21e30c1f6fb tempest-QuotasAdminTestJSON-890688892 tempest-QuotasAdminTestJSON-890688892-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:00.444023 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0c15560d-7b34-4b26-92de-a21e30c1f6fb tempest-QuotasAdminTestJSON-890688892 tempest-QuotasAdminTestJSON-890688892-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:00.444758 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0c15560d-7b34-4b26-92de-a21e30c1f6fb tempest-QuotasAdminTestJSON-890688892 tempest-QuotasAdminTestJSON-890688892-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:00.514193 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-0c15560d-7b34-4b26-92de-a21e30c1f6fb tempest-QuotasAdminTestJSON-890688892 tempest-QuotasAdminTestJSON-890688892-project-admin] 10.222.0.18 "PUT /compute/v2.1/os-quota-sets/a7f0ec336d964930b0da0c47d6b02dd1?user_id=5c8488c62bd34489a7a5d5e47a69c2b7" status: 200 len: 328 microversion: 2.1 time: 0.292919 Oct 22 20:51:00.515067 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 342/623] 10.222.0.18 () {60 vars in 1343 bytes} [Sat Oct 22 20:51:00 2022] PUT /compute/v2.1/os-quota-sets/a7f0ec336d964930b0da0c47d6b02dd1?user_id=5c8488c62bd34489a7a5d5e47a69c2b7 => generated 328 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:51:00.527764 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-67af386a-2dc4-40ce-b0a4-9ab1a8c304d3 tempest-QuotasAdminTestJSON-890688892 tempest-QuotasAdminTestJSON-890688892-project-admin] Calling method '.version_select at 0x7fd3a490fd30>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:51:00.644991 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-67af386a-2dc4-40ce-b0a4-9ab1a8c304d3 tempest-QuotasAdminTestJSON-890688892 tempest-QuotasAdminTestJSON-890688892-project-admin] 10.222.0.18 "GET /compute/v2.1/os-quota-sets/a7f0ec336d964930b0da0c47d6b02dd1?user_id=5c8488c62bd34489a7a5d5e47a69c2b7" status: 200 len: 370 microversion: 2.1 time: 0.120832 Oct 22 20:51:00.645827 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 343/624] 10.222.0.18 () {58 vars in 1323 bytes} [Sat Oct 22 20:51:00 2022] GET /compute/v2.1/os-quota-sets/a7f0ec336d964930b0da0c47d6b02dd1?user_id=5c8488c62bd34489a7a5d5e47a69c2b7 => generated 370 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:51:00.773653 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-936dcac2-819a-4102-bee9-0cf47b714af9 tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b892876156f34b0d99a6c853d0cd4905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b403b83cad4babab211dafade27bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:51:00.787941 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-936dcac2-819a-4102-bee9-0cf47b714af9 tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] 10.222.0.18 "GET /compute/v2.1/servers/65381d5e-1265-418b-ac70-4ef749d9af14" status: 200 len: 1557 microversion: 2.1 time: 0.452314 Oct 22 20:51:00.788596 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 282/625] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:51:00 2022] GET /compute/v2.1/servers/65381d5e-1265-418b-ac70-4ef749d9af14 => generated 1557 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:51:00.813891 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-cbae4ba9-0511-4dc4-bc57-e087b38f03c0 tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:51:00.814387 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-cbae4ba9-0511-4dc4-bc57-e087b38f03c0 tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] [instance: 65381d5e-1265-418b-ac70-4ef749d9af14] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:51:00.830392 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cbae4ba9-0511-4dc4-bc57-e087b38f03c0 tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:00.831133 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cbae4ba9-0511-4dc4-bc57-e087b38f03c0 tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:00.831315 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cbae4ba9-0511-4dc4-bc57-e087b38f03c0 tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:00.831881 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-260442fc-e05a-46de-863c-dfa76620ed89 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:51:00.832040 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cbae4ba9-0511-4dc4-bc57-e087b38f03c0 tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:00.832494 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cbae4ba9-0511-4dc4-bc57-e087b38f03c0 tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:00.832695 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-260442fc-e05a-46de-863c-dfa76620ed89 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] [instance: 254dfdd3-3716-43cf-aadc-f678aff08d27] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:51:00.832919 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cbae4ba9-0511-4dc4-bc57-e087b38f03c0 tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:00.848054 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-260442fc-e05a-46de-863c-dfa76620ed89 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:00.848561 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-260442fc-e05a-46de-863c-dfa76620ed89 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:00.849109 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-260442fc-e05a-46de-863c-dfa76620ed89 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:00.849935 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-260442fc-e05a-46de-863c-dfa76620ed89 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:00.851193 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-260442fc-e05a-46de-863c-dfa76620ed89 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:00.853942 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-260442fc-e05a-46de-863c-dfa76620ed89 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:01.001005 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-cbae4ba9-0511-4dc4-bc57-e087b38f03c0 tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] 10.222.0.18 "GET /compute/v2.1/servers/65381d5e-1265-418b-ac70-4ef749d9af14/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.191133 Oct 22 20:51:01.002354 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 344/626] 10.222.0.18 () {58 vars in 1275 bytes} [Sat Oct 22 20:51:00 2022] GET /compute/v2.1/servers/65381d5e-1265-418b-ac70-4ef749d9af14/os-interface => generated 285 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:51:01.202819 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-baf603f9-6689-410c-9f3f-feed2a657fc4 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:51:01.204657 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-baf603f9-6689-410c-9f3f-feed2a657fc4 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] [instance: c475672d-99ba-4c6a-abaa-3332a392534d] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:51:01.241152 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-baf603f9-6689-410c-9f3f-feed2a657fc4 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:01.241749 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-baf603f9-6689-410c-9f3f-feed2a657fc4 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:01.242179 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-baf603f9-6689-410c-9f3f-feed2a657fc4 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:01.244525 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-baf603f9-6689-410c-9f3f-feed2a657fc4 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:01.244900 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-baf603f9-6689-410c-9f3f-feed2a657fc4 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:01.245644 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-baf603f9-6689-410c-9f3f-feed2a657fc4 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:01.529931 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-260442fc-e05a-46de-863c-dfa76620ed89 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:51:01.545279 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-260442fc-e05a-46de-863c-dfa76620ed89 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:51:01.546827 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-260442fc-e05a-46de-863c-dfa76620ed89 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:51:01.552371 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-260442fc-e05a-46de-863c-dfa76620ed89 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] 10.222.0.18 "GET /compute/v2.1/servers/254dfdd3-3716-43cf-aadc-f678aff08d27" status: 200 len: 1568 microversion: 2.25 time: 0.726109 Oct 22 20:51:01.553517 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 283/627] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 20:51:00 2022] GET /compute/v2.1/servers/254dfdd3-3716-43cf-aadc-f678aff08d27 => generated 1568 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 22 20:51:01.561003 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-7e4c258c-3768-47ab-a099-3d0c462a2bb1 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:51:01.563834 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-7e4c258c-3768-47ab-a099-3d0c462a2bb1 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] [instance: fe83cd49-4ceb-49aa-a775-cc2a4229fd76] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:51:01.579791 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7e4c258c-3768-47ab-a099-3d0c462a2bb1 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:01.589883 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7e4c258c-3768-47ab-a099-3d0c462a2bb1 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:01.591547 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7e4c258c-3768-47ab-a099-3d0c462a2bb1 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:01.604531 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7e4c258c-3768-47ab-a099-3d0c462a2bb1 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:01.605539 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7e4c258c-3768-47ab-a099-3d0c462a2bb1 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:01.606283 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7e4c258c-3768-47ab-a099-3d0c462a2bb1 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:02.428833 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-baf603f9-6689-410c-9f3f-feed2a657fc4 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34f8af8ee2b545bead90fffd6c6c4896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48413ed1ac4e1ea65fb38f097881db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:51:02.450600 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-baf603f9-6689-410c-9f3f-feed2a657fc4 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] 10.222.0.18 "GET /compute/v2.1/servers/c475672d-99ba-4c6a-abaa-3332a392534d" status: 200 len: 1366 microversion: 2.1 time: 1.253268 Oct 22 20:51:02.464496 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 345/628] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:51:01 2022] GET /compute/v2.1/servers/c475672d-99ba-4c6a-abaa-3332a392534d => generated 1366 bytes in 1271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:51:02.475480 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-6cb025c6-c709-4e35-8c84-f81456d30fc8 tempest-QuotasAdminTestJSON-890688892 tempest-QuotasAdminTestJSON-890688892-project-admin] Calling method '.version_select at 0x7fd3a47e6670>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:51:02.574081 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-7e4c258c-3768-47ab-a099-3d0c462a2bb1 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c87f0356ca346f39c6216393d85da2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee8c8f7fc4e12bc1f9fcce3e7b581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:51:02.587012 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-7e4c258c-3768-47ab-a099-3d0c462a2bb1 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] 10.222.0.18 "GET /compute/v2.1/servers/fe83cd49-4ceb-49aa-a775-cc2a4229fd76" status: 200 len: 1503 microversion: 2.1 time: 1.032166 Oct 22 20:51:02.593488 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 284/629] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:51:01 2022] GET /compute/v2.1/servers/fe83cd49-4ceb-49aa-a775-cc2a4229fd76 => generated 1503 bytes in 1039 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:51:02.601013 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-b771ae29-b31b-4828-b9b5-b4d09f67c751 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:51:02.615556 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-b771ae29-b31b-4828-b9b5-b4d09f67c751 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] [instance: 0923f68f-d334-4133-824a-7830b65acc28] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:51:02.623311 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b771ae29-b31b-4828-b9b5-b4d09f67c751 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:02.624178 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b771ae29-b31b-4828-b9b5-b4d09f67c751 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:02.624879 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b771ae29-b31b-4828-b9b5-b4d09f67c751 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:02.626183 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b771ae29-b31b-4828-b9b5-b4d09f67c751 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:02.626836 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b771ae29-b31b-4828-b9b5-b4d09f67c751 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:02.627944 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b771ae29-b31b-4828-b9b5-b4d09f67c751 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:02.973762 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-b771ae29-b31b-4828-b9b5-b4d09f67c751 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91cf84a287b74618ae1b3368785b0b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902e239d67664098895ab24340b0b780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:51:03.020663 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-b771ae29-b31b-4828-b9b5-b4d09f67c751 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] 10.222.0.18 "GET /compute/v2.1/servers/0923f68f-d334-4133-824a-7830b65acc28" status: 200 len: 1318 microversion: 2.1 time: 0.423124 Oct 22 20:51:03.023747 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 285/630] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:51:02 2022] GET /compute/v2.1/servers/0923f68f-d334-4133-824a-7830b65acc28 => generated 1318 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:51:03.028792 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-6cb025c6-c709-4e35-8c84-f81456d30fc8 tempest-QuotasAdminTestJSON-890688892 tempest-QuotasAdminTestJSON-890688892-project-admin] 10.222.0.18 "GET /compute/v2.1/os-quota-sets/b8e4f0ef6caf430c96d4d3f82954882b/defaults" status: 200 len: 371 microversion: 2.1 time: 0.562776 Oct 22 20:51:03.029423 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 346/631] 10.222.0.18 () {58 vars in 1269 bytes} [Sat Oct 22 20:51:02 2022] GET /compute/v2.1/os-quota-sets/b8e4f0ef6caf430c96d4d3f82954882b/defaults => generated 371 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:51:03.042393 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-dba82de8-3d3d-47ed-a66a-a46b52c40c83 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:51:03.043034 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-dba82de8-3d3d-47ed-a66a-a46b52c40c83 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] [instance: 254dfdd3-3716-43cf-aadc-f678aff08d27] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:51:03.045594 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-8532f0df-a89f-44d3-a2f5-4fb48be621a4 req-ec586c71-15d3-4956-a9c3-52b9d8f800f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c475672d-99ba-4c6a-abaa-3332a392534d", "tag": "5a48f24d-ee6f-4bfc-9d60-4db767fe6dbd"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:51:03.060898 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-dba82de8-3d3d-47ed-a66a-a46b52c40c83 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:03.062583 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-dba82de8-3d3d-47ed-a66a-a46b52c40c83 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:03.063081 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-dba82de8-3d3d-47ed-a66a-a46b52c40c83 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:03.065069 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-dba82de8-3d3d-47ed-a66a-a46b52c40c83 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:03.065557 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-dba82de8-3d3d-47ed-a66a-a46b52c40c83 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:03.066794 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-8532f0df-a89f-44d3-a2f5-4fb48be621a4 req-ec586c71-15d3-4956-a9c3-52b9d8f800f2 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:03.067163 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-dba82de8-3d3d-47ed-a66a-a46b52c40c83 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:03.067841 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-8532f0df-a89f-44d3-a2f5-4fb48be621a4 req-ec586c71-15d3-4956-a9c3-52b9d8f800f2 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:03.068641 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-8532f0df-a89f-44d3-a2f5-4fb48be621a4 req-ec586c71-15d3-4956-a9c3-52b9d8f800f2 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:03.094131 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-8532f0df-a89f-44d3-a2f5-4fb48be621a4 req-ec586c71-15d3-4956-a9c3-52b9d8f800f2 service nova] Creating event network-changed:5a48f24d-ee6f-4bfc-9d60-4db767fe6dbd for instance c475672d-99ba-4c6a-abaa-3332a392534d on nch1-master-1 Oct 22 20:51:03.124411 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-8532f0df-a89f-44d3-a2f5-4fb48be621a4 req-ec586c71-15d3-4956-a9c3-52b9d8f800f2 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092980 Oct 22 20:51:03.125852 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 286/632] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:51:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:51:03.144804 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-fcabef0f-f383-4f6f-9799-c1d76e48a79d tempest-QuotasAdminTestJSON-890688892 tempest-QuotasAdminTestJSON-890688892-project-admin] Action: 'update', calling method: .version_select at 0x7fd3a4727820>, body: {"quota_set": {"force": true, "metadata_items": 256, "ram": 10240, "key_pairs": 200, "instances": 20, "server_groups": 20, "server_group_members": 20, "cores": 2, "fixed_ips": 10, "floating_ips": 20, "security_group_rules": 20, "security_groups": 20, "injected_file_content_bytes": 20480, "injected_file_path_bytes": 512, "injected_files": 10}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:51:03.315180 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fcabef0f-f383-4f6f-9799-c1d76e48a79d tempest-QuotasAdminTestJSON-890688892 tempest-QuotasAdminTestJSON-890688892-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:03.316054 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fcabef0f-f383-4f6f-9799-c1d76e48a79d tempest-QuotasAdminTestJSON-890688892 tempest-QuotasAdminTestJSON-890688892-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:03.316429 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fcabef0f-f383-4f6f-9799-c1d76e48a79d tempest-QuotasAdminTestJSON-890688892 tempest-QuotasAdminTestJSON-890688892-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:03.317582 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fcabef0f-f383-4f6f-9799-c1d76e48a79d tempest-QuotasAdminTestJSON-890688892 tempest-QuotasAdminTestJSON-890688892-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:03.318192 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fcabef0f-f383-4f6f-9799-c1d76e48a79d tempest-QuotasAdminTestJSON-890688892 tempest-QuotasAdminTestJSON-890688892-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:03.318752 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fcabef0f-f383-4f6f-9799-c1d76e48a79d tempest-QuotasAdminTestJSON-890688892 tempest-QuotasAdminTestJSON-890688892-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:03.412505 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-dba82de8-3d3d-47ed-a66a-a46b52c40c83 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:51:03.423697 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-dba82de8-3d3d-47ed-a66a-a46b52c40c83 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:51:03.425788 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-dba82de8-3d3d-47ed-a66a-a46b52c40c83 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:51:03.427486 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-dba82de8-3d3d-47ed-a66a-a46b52c40c83 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] 10.222.0.18 "GET /compute/v2.1/servers/254dfdd3-3716-43cf-aadc-f678aff08d27" status: 200 len: 1568 microversion: 2.25 time: 0.397072 Oct 22 20:51:03.428338 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 347/633] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 20:51:03 2022] GET /compute/v2.1/servers/254dfdd3-3716-43cf-aadc-f678aff08d27 => generated 1568 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 20:51:03.483524 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-2faed46e-1bc9-4f17-8f64-2fdadae71f3f tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:51:03.484938 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-2faed46e-1bc9-4f17-8f64-2fdadae71f3f tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] [instance: c475672d-99ba-4c6a-abaa-3332a392534d] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:51:03.492763 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2faed46e-1bc9-4f17-8f64-2fdadae71f3f tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:03.493251 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2faed46e-1bc9-4f17-8f64-2fdadae71f3f tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:03.493656 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2faed46e-1bc9-4f17-8f64-2fdadae71f3f tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:03.494369 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2faed46e-1bc9-4f17-8f64-2fdadae71f3f tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:03.495040 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2faed46e-1bc9-4f17-8f64-2fdadae71f3f tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:03.495691 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2faed46e-1bc9-4f17-8f64-2fdadae71f3f tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:03.837101 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=16 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:51:03.844720 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-2faed46e-1bc9-4f17-8f64-2fdadae71f3f tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34f8af8ee2b545bead90fffd6c6c4896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48413ed1ac4e1ea65fb38f097881db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:51:03.857896 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-fcabef0f-f383-4f6f-9799-c1d76e48a79d tempest-QuotasAdminTestJSON-890688892 tempest-QuotasAdminTestJSON-890688892-project-admin] 10.222.0.18 "PUT /compute/v2.1/os-quota-sets/b8e4f0ef6caf430c96d4d3f82954882b" status: 200 len: 329 microversion: 2.1 time: 0.727646 Oct 22 20:51:03.868799 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 287/634] 10.222.0.18 () {60 vars in 1263 bytes} [Sat Oct 22 20:51:03 2022] PUT /compute/v2.1/os-quota-sets/b8e4f0ef6caf430c96d4d3f82954882b => generated 329 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:51:03.870833 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-2faed46e-1bc9-4f17-8f64-2fdadae71f3f tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] 10.222.0.18 "GET /compute/v2.1/servers/c475672d-99ba-4c6a-abaa-3332a392534d" status: 200 len: 1366 microversion: 2.1 time: 0.391737 Oct 22 20:51:03.883991 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 348/635] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:51:03 2022] GET /compute/v2.1/servers/c475672d-99ba-4c6a-abaa-3332a392534d => generated 1366 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:51:03.897750 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-e42d85d3-b1ed-4365-bc34-1a05b9366e21 tempest-QuotasAdminTestJSON-890688892 tempest-QuotasAdminTestJSON-890688892-project-admin] Action: 'update', calling method: .version_select at 0x7fd3a4e30e50>, body: {"quota_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1, "server_group_members": 10, "server_groups": 10}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:51:03.907932 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-e4a86511-4e8d-4226-a9b4-06c7d9aeb0f7 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:51:03.912205 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-e4a86511-4e8d-4226-a9b4-06c7d9aeb0f7 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] [instance: fe83cd49-4ceb-49aa-a775-cc2a4229fd76] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:51:03.954875 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e4a86511-4e8d-4226-a9b4-06c7d9aeb0f7 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:03.961197 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e4a86511-4e8d-4226-a9b4-06c7d9aeb0f7 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:03.961197 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e4a86511-4e8d-4226-a9b4-06c7d9aeb0f7 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:03.961197 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e4a86511-4e8d-4226-a9b4-06c7d9aeb0f7 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:03.961197 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e4a86511-4e8d-4226-a9b4-06c7d9aeb0f7 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:03.961197 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e4a86511-4e8d-4226-a9b4-06c7d9aeb0f7 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:04.099571 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e42d85d3-b1ed-4365-bc34-1a05b9366e21 tempest-QuotasAdminTestJSON-890688892 tempest-QuotasAdminTestJSON-890688892-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:04.100074 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e42d85d3-b1ed-4365-bc34-1a05b9366e21 tempest-QuotasAdminTestJSON-890688892 tempest-QuotasAdminTestJSON-890688892-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:04.100512 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e42d85d3-b1ed-4365-bc34-1a05b9366e21 tempest-QuotasAdminTestJSON-890688892 tempest-QuotasAdminTestJSON-890688892-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:04.101257 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e42d85d3-b1ed-4365-bc34-1a05b9366e21 tempest-QuotasAdminTestJSON-890688892 tempest-QuotasAdminTestJSON-890688892-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:04.102091 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e42d85d3-b1ed-4365-bc34-1a05b9366e21 tempest-QuotasAdminTestJSON-890688892 tempest-QuotasAdminTestJSON-890688892-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:04.102529 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e42d85d3-b1ed-4365-bc34-1a05b9366e21 tempest-QuotasAdminTestJSON-890688892 tempest-QuotasAdminTestJSON-890688892-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:04.346879 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-e4a86511-4e8d-4226-a9b4-06c7d9aeb0f7 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c87f0356ca346f39c6216393d85da2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee8c8f7fc4e12bc1f9fcce3e7b581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:51:04.358988 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:51:04.366748 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-e4a86511-4e8d-4226-a9b4-06c7d9aeb0f7 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] 10.222.0.18 "GET /compute/v2.1/servers/fe83cd49-4ceb-49aa-a775-cc2a4229fd76" status: 200 len: 1503 microversion: 2.1 time: 0.488739 Oct 22 20:51:04.367779 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 288/636] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:51:03 2022] GET /compute/v2.1/servers/fe83cd49-4ceb-49aa-a775-cc2a4229fd76 => generated 1503 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:51:04.373168 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-7421d2dc-8eb1-4d43-9a39-0b4f4e296b1f tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:51:04.374339 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-7421d2dc-8eb1-4d43-9a39-0b4f4e296b1f tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] [instance: 0923f68f-d334-4133-824a-7830b65acc28] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:51:04.382589 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7421d2dc-8eb1-4d43-9a39-0b4f4e296b1f tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:04.383315 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7421d2dc-8eb1-4d43-9a39-0b4f4e296b1f tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:04.383911 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7421d2dc-8eb1-4d43-9a39-0b4f4e296b1f tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:04.384782 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7421d2dc-8eb1-4d43-9a39-0b4f4e296b1f tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:04.386152 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7421d2dc-8eb1-4d43-9a39-0b4f4e296b1f tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:04.387560 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7421d2dc-8eb1-4d43-9a39-0b4f4e296b1f tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:04.693706 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-7421d2dc-8eb1-4d43-9a39-0b4f4e296b1f tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91cf84a287b74618ae1b3368785b0b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902e239d67664098895ab24340b0b780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:51:04.708052 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-7421d2dc-8eb1-4d43-9a39-0b4f4e296b1f tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] 10.222.0.18 "GET /compute/v2.1/servers/0923f68f-d334-4133-824a-7830b65acc28" status: 200 len: 1318 microversion: 2.1 time: 0.338786 Oct 22 20:51:04.728547 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 289/637] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:51:04 2022] GET /compute/v2.1/servers/0923f68f-d334-4133-824a-7830b65acc28 => generated 1318 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:51:04.736207 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-4e059629-f1bd-4681-a2d2-40d4b6984967 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:51:04.737908 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-4e059629-f1bd-4681-a2d2-40d4b6984967 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] [instance: 254dfdd3-3716-43cf-aadc-f678aff08d27] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:51:04.748104 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4e059629-f1bd-4681-a2d2-40d4b6984967 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:04.749153 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4e059629-f1bd-4681-a2d2-40d4b6984967 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:04.749998 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4e059629-f1bd-4681-a2d2-40d4b6984967 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:04.751076 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4e059629-f1bd-4681-a2d2-40d4b6984967 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:04.751992 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4e059629-f1bd-4681-a2d2-40d4b6984967 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:04.752669 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4e059629-f1bd-4681-a2d2-40d4b6984967 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:04.937097 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-e42d85d3-b1ed-4365-bc34-1a05b9366e21 tempest-QuotasAdminTestJSON-890688892 tempest-QuotasAdminTestJSON-890688892-project-admin] 10.222.0.18 "PUT /compute/v2.1/os-quota-sets/b8e4f0ef6caf430c96d4d3f82954882b" status: 200 len: 329 microversion: 2.1 time: 1.061807 Oct 22 20:51:04.944147 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 349/638] 10.222.0.18 () {60 vars in 1263 bytes} [Sat Oct 22 20:51:03 2022] PUT /compute/v2.1/os-quota-sets/b8e4f0ef6caf430c96d4d3f82954882b => generated 329 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:51:04.967409 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-30187cf1-2206-4441-833f-6aa86dde15d6 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:51:04.968450 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-30187cf1-2206-4441-833f-6aa86dde15d6 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] [instance: c475672d-99ba-4c6a-abaa-3332a392534d] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:51:04.991438 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-30187cf1-2206-4441-833f-6aa86dde15d6 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:04.991438 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-30187cf1-2206-4441-833f-6aa86dde15d6 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:04.991786 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-30187cf1-2206-4441-833f-6aa86dde15d6 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:04.992397 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-30187cf1-2206-4441-833f-6aa86dde15d6 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:04.992886 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-30187cf1-2206-4441-833f-6aa86dde15d6 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:04.993314 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-30187cf1-2206-4441-833f-6aa86dde15d6 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:05.073246 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-4e059629-f1bd-4681-a2d2-40d4b6984967 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:51:05.100309 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-4e059629-f1bd-4681-a2d2-40d4b6984967 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:51:05.102585 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-4e059629-f1bd-4681-a2d2-40d4b6984967 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:51:05.103918 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-4e059629-f1bd-4681-a2d2-40d4b6984967 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] 10.222.0.18 "GET /compute/v2.1/servers/254dfdd3-3716-43cf-aadc-f678aff08d27" status: 200 len: 1568 microversion: 2.25 time: 0.373618 Oct 22 20:51:05.134185 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 290/639] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 20:51:04 2022] GET /compute/v2.1/servers/254dfdd3-3716-43cf-aadc-f678aff08d27 => generated 1568 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 20:51:05.212382 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-30187cf1-2206-4441-833f-6aa86dde15d6 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34f8af8ee2b545bead90fffd6c6c4896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48413ed1ac4e1ea65fb38f097881db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:51:05.222571 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-30187cf1-2206-4441-833f-6aa86dde15d6 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] 10.222.0.18 "GET /compute/v2.1/servers/c475672d-99ba-4c6a-abaa-3332a392534d" status: 200 len: 1366 microversion: 2.1 time: 0.276512 Oct 22 20:51:05.239509 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 350/640] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:51:04 2022] GET /compute/v2.1/servers/c475672d-99ba-4c6a-abaa-3332a392534d => generated 1366 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:51:05.419227 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-7b314e18-071b-4ead-a17a-0150e55cebe6 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:51:05.420629 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-7b314e18-071b-4ead-a17a-0150e55cebe6 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] [instance: fe83cd49-4ceb-49aa-a775-cc2a4229fd76] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:51:05.428406 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7b314e18-071b-4ead-a17a-0150e55cebe6 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:05.428880 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7b314e18-071b-4ead-a17a-0150e55cebe6 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:05.429402 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7b314e18-071b-4ead-a17a-0150e55cebe6 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:05.430233 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7b314e18-071b-4ead-a17a-0150e55cebe6 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:05.430842 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7b314e18-071b-4ead-a17a-0150e55cebe6 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:05.431396 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7b314e18-071b-4ead-a17a-0150e55cebe6 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:05.678561 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-7b314e18-071b-4ead-a17a-0150e55cebe6 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c87f0356ca346f39c6216393d85da2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee8c8f7fc4e12bc1f9fcce3e7b581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:51:05.694683 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-7b314e18-071b-4ead-a17a-0150e55cebe6 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] 10.222.0.18 "GET /compute/v2.1/servers/fe83cd49-4ceb-49aa-a775-cc2a4229fd76" status: 200 len: 1503 microversion: 2.1 time: 0.281010 Oct 22 20:51:05.697881 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 291/641] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:51:05 2022] GET /compute/v2.1/servers/fe83cd49-4ceb-49aa-a775-cc2a4229fd76 => generated 1503 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:51:05.737639 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-c1492e59-1a49-4157-9c4f-65bf54fdac31 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:51:05.740140 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-c1492e59-1a49-4157-9c4f-65bf54fdac31 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] [instance: 0923f68f-d334-4133-824a-7830b65acc28] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:51:05.746575 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=15,nova_api:UPDATE=14 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:51:05.768893 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c1492e59-1a49-4157-9c4f-65bf54fdac31 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:05.770781 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c1492e59-1a49-4157-9c4f-65bf54fdac31 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:05.772266 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c1492e59-1a49-4157-9c4f-65bf54fdac31 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:05.775468 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c1492e59-1a49-4157-9c4f-65bf54fdac31 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:05.778640 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c1492e59-1a49-4157-9c4f-65bf54fdac31 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:05.780088 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c1492e59-1a49-4157-9c4f-65bf54fdac31 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:05.939188 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-1d4894d4-6086-4484-8742-c052991f45a4 req-19309010-5e8e-4ae3-881b-0ba3de62c733 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "65381d5e-1265-418b-ac70-4ef749d9af14", "tag": "2082100f-222c-49e5-af14-7af046476c87"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:51:05.956503 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-1d4894d4-6086-4484-8742-c052991f45a4 req-19309010-5e8e-4ae3-881b-0ba3de62c733 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:05.957018 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-1d4894d4-6086-4484-8742-c052991f45a4 req-19309010-5e8e-4ae3-881b-0ba3de62c733 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:05.957447 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-1d4894d4-6086-4484-8742-c052991f45a4 req-19309010-5e8e-4ae3-881b-0ba3de62c733 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:05.989370 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-1d4894d4-6086-4484-8742-c052991f45a4 req-19309010-5e8e-4ae3-881b-0ba3de62c733 service nova] Creating event network-changed:2082100f-222c-49e5-af14-7af046476c87 for instance 65381d5e-1265-418b-ac70-4ef749d9af14 on nch2-master-1 Oct 22 20:51:06.009334 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-1d4894d4-6086-4484-8742-c052991f45a4 req-19309010-5e8e-4ae3-881b-0ba3de62c733 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075037 Oct 22 20:51:06.024101 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 292/642] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:51:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 20:51:06.140203 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-a4be7965-efe9-4442-b1f5-8f0744d23807 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:51:06.142253 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-a4be7965-efe9-4442-b1f5-8f0744d23807 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] [instance: 254dfdd3-3716-43cf-aadc-f678aff08d27] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:51:06.155903 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a4be7965-efe9-4442-b1f5-8f0744d23807 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:06.160871 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a4be7965-efe9-4442-b1f5-8f0744d23807 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:06.161753 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a4be7965-efe9-4442-b1f5-8f0744d23807 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:06.162674 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a4be7965-efe9-4442-b1f5-8f0744d23807 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:06.163291 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a4be7965-efe9-4442-b1f5-8f0744d23807 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:06.164348 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a4be7965-efe9-4442-b1f5-8f0744d23807 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:06.540684 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-c1492e59-1a49-4157-9c4f-65bf54fdac31 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91cf84a287b74618ae1b3368785b0b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902e239d67664098895ab24340b0b780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:51:06.563277 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-c1492e59-1a49-4157-9c4f-65bf54fdac31 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] 10.222.0.18 "GET /compute/v2.1/servers/0923f68f-d334-4133-824a-7830b65acc28" status: 200 len: 1318 microversion: 2.1 time: 0.830554 Oct 22 20:51:06.568899 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 351/643] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:51:05 2022] GET /compute/v2.1/servers/0923f68f-d334-4133-824a-7830b65acc28 => generated 1318 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:51:06.574916 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-97f4b0f8-4b61-4e5f-88ef-f737d3fbc743 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:51:06.576010 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-97f4b0f8-4b61-4e5f-88ef-f737d3fbc743 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] [instance: c475672d-99ba-4c6a-abaa-3332a392534d] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:51:06.590096 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-97f4b0f8-4b61-4e5f-88ef-f737d3fbc743 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:06.590965 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-97f4b0f8-4b61-4e5f-88ef-f737d3fbc743 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:06.593312 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-97f4b0f8-4b61-4e5f-88ef-f737d3fbc743 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:06.595369 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-97f4b0f8-4b61-4e5f-88ef-f737d3fbc743 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:06.596026 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-97f4b0f8-4b61-4e5f-88ef-f737d3fbc743 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:06.596608 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-97f4b0f8-4b61-4e5f-88ef-f737d3fbc743 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:06.651042 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-a4be7965-efe9-4442-b1f5-8f0744d23807 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:51:06.668238 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-a4be7965-efe9-4442-b1f5-8f0744d23807 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:51:06.671572 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-a4be7965-efe9-4442-b1f5-8f0744d23807 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:51:06.673828 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-a4be7965-efe9-4442-b1f5-8f0744d23807 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] 10.222.0.18 "GET /compute/v2.1/servers/254dfdd3-3716-43cf-aadc-f678aff08d27" status: 200 len: 1568 microversion: 2.25 time: 0.538611 Oct 22 20:51:06.676282 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 293/644] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 20:51:06 2022] GET /compute/v2.1/servers/254dfdd3-3716-43cf-aadc-f678aff08d27 => generated 1568 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 20:51:06.725613 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-b8f0b2d0-0703-446b-8739-ae2022848748 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:51:06.726524 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-b8f0b2d0-0703-446b-8739-ae2022848748 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] [instance: fe83cd49-4ceb-49aa-a775-cc2a4229fd76] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:51:06.734007 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b8f0b2d0-0703-446b-8739-ae2022848748 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:06.734792 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b8f0b2d0-0703-446b-8739-ae2022848748 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:06.735437 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b8f0b2d0-0703-446b-8739-ae2022848748 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:06.736321 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b8f0b2d0-0703-446b-8739-ae2022848748 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:06.736998 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b8f0b2d0-0703-446b-8739-ae2022848748 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:06.737658 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b8f0b2d0-0703-446b-8739-ae2022848748 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:07.131415 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-b8f0b2d0-0703-446b-8739-ae2022848748 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c87f0356ca346f39c6216393d85da2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee8c8f7fc4e12bc1f9fcce3e7b581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:51:07.144025 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-b8f0b2d0-0703-446b-8739-ae2022848748 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] 10.222.0.18 "GET /compute/v2.1/servers/fe83cd49-4ceb-49aa-a775-cc2a4229fd76" status: 200 len: 1503 microversion: 2.1 time: 0.423568 Oct 22 20:51:07.144729 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-97f4b0f8-4b61-4e5f-88ef-f737d3fbc743 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34f8af8ee2b545bead90fffd6c6c4896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48413ed1ac4e1ea65fb38f097881db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:51:07.145760 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 294/645] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:51:06 2022] GET /compute/v2.1/servers/fe83cd49-4ceb-49aa-a775-cc2a4229fd76 => generated 1503 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:51:07.157475 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-97f4b0f8-4b61-4e5f-88ef-f737d3fbc743 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] 10.222.0.18 "GET /compute/v2.1/servers/c475672d-99ba-4c6a-abaa-3332a392534d" status: 200 len: 1366 microversion: 2.1 time: 0.586926 Oct 22 20:51:07.161267 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 352/646] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:51:06 2022] GET /compute/v2.1/servers/c475672d-99ba-4c6a-abaa-3332a392534d => generated 1366 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:51:07.595158 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-605e7ae9-7e55-483b-ab3a-0fd3ca70152f tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:51:07.596084 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-605e7ae9-7e55-483b-ab3a-0fd3ca70152f tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] [instance: 0923f68f-d334-4133-824a-7830b65acc28] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:51:07.611299 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-605e7ae9-7e55-483b-ab3a-0fd3ca70152f tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:07.615119 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-605e7ae9-7e55-483b-ab3a-0fd3ca70152f tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:07.615710 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-605e7ae9-7e55-483b-ab3a-0fd3ca70152f tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:07.616543 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-605e7ae9-7e55-483b-ab3a-0fd3ca70152f tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:07.617080 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-605e7ae9-7e55-483b-ab3a-0fd3ca70152f tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:07.617689 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-605e7ae9-7e55-483b-ab3a-0fd3ca70152f tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:07.701340 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-79b15f64-f20d-4452-9ca2-efd3f6ef509a tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:51:07.701957 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-79b15f64-f20d-4452-9ca2-efd3f6ef509a tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] [instance: 254dfdd3-3716-43cf-aadc-f678aff08d27] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:51:07.714938 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-79b15f64-f20d-4452-9ca2-efd3f6ef509a tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:07.715930 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-79b15f64-f20d-4452-9ca2-efd3f6ef509a tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:07.718332 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-79b15f64-f20d-4452-9ca2-efd3f6ef509a tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:07.720193 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-79b15f64-f20d-4452-9ca2-efd3f6ef509a tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:07.723320 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-79b15f64-f20d-4452-9ca2-efd3f6ef509a tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:07.724532 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-79b15f64-f20d-4452-9ca2-efd3f6ef509a tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:08.057971 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-605e7ae9-7e55-483b-ab3a-0fd3ca70152f tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91cf84a287b74618ae1b3368785b0b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902e239d67664098895ab24340b0b780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:51:08.082355 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-605e7ae9-7e55-483b-ab3a-0fd3ca70152f tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] 10.222.0.18 "GET /compute/v2.1/servers/0923f68f-d334-4133-824a-7830b65acc28" status: 200 len: 1318 microversion: 2.1 time: 0.489318 Oct 22 20:51:08.084703 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 295/647] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:51:07 2022] GET /compute/v2.1/servers/0923f68f-d334-4133-824a-7830b65acc28 => generated 1318 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:51:08.102010 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-320a6e21-3534-4991-a06c-5e329115f433 req-a813efb1-b9c6-4d26-af79-1c947545e6c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0923f68f-d334-4133-824a-7830b65acc28", "tag": "e2f995f5-84a0-4b55-bc6a-8c2cd4d30e99"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:51:08.115896 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-320a6e21-3534-4991-a06c-5e329115f433 req-a813efb1-b9c6-4d26-af79-1c947545e6c2 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:08.117203 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-320a6e21-3534-4991-a06c-5e329115f433 req-a813efb1-b9c6-4d26-af79-1c947545e6c2 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:08.117862 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-320a6e21-3534-4991-a06c-5e329115f433 req-a813efb1-b9c6-4d26-af79-1c947545e6c2 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:08.134580 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-320a6e21-3534-4991-a06c-5e329115f433 req-a813efb1-b9c6-4d26-af79-1c947545e6c2 service nova] Creating event network-changed:e2f995f5-84a0-4b55-bc6a-8c2cd4d30e99 for instance 0923f68f-d334-4133-824a-7830b65acc28 on nch2-master-1 Oct 22 20:51:08.139273 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-79b15f64-f20d-4452-9ca2-efd3f6ef509a tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:51:08.145604 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-320a6e21-3534-4991-a06c-5e329115f433 req-a813efb1-b9c6-4d26-af79-1c947545e6c2 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052332 Oct 22 20:51:08.146783 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 296/648] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:51:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:51:08.149646 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-79b15f64-f20d-4452-9ca2-efd3f6ef509a tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:51:08.151106 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-79b15f64-f20d-4452-9ca2-efd3f6ef509a tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:51:08.152513 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-79b15f64-f20d-4452-9ca2-efd3f6ef509a tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] 10.222.0.18 "GET /compute/v2.1/servers/254dfdd3-3716-43cf-aadc-f678aff08d27" status: 200 len: 1568 microversion: 2.25 time: 0.455267 Oct 22 20:51:08.153504 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 353/649] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 20:51:07 2022] GET /compute/v2.1/servers/254dfdd3-3716-43cf-aadc-f678aff08d27 => generated 1568 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 22 20:51:08.183031 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-42d0ed66-c5c4-4320-bbba-07107422203e tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:51:08.183779 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-42d0ed66-c5c4-4320-bbba-07107422203e tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] [instance: fe83cd49-4ceb-49aa-a775-cc2a4229fd76] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:51:08.184859 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-9c359979-a3d3-43ef-969e-115edecb45f0 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:51:08.185553 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-9c359979-a3d3-43ef-969e-115edecb45f0 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] [instance: c475672d-99ba-4c6a-abaa-3332a392534d] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:51:08.191514 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-42d0ed66-c5c4-4320-bbba-07107422203e tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:08.191938 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-42d0ed66-c5c4-4320-bbba-07107422203e tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:08.192384 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-42d0ed66-c5c4-4320-bbba-07107422203e tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:08.192945 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9c359979-a3d3-43ef-969e-115edecb45f0 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:08.193083 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-42d0ed66-c5c4-4320-bbba-07107422203e tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:08.193549 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-42d0ed66-c5c4-4320-bbba-07107422203e tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:08.193982 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-42d0ed66-c5c4-4320-bbba-07107422203e tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:08.194907 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9c359979-a3d3-43ef-969e-115edecb45f0 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:08.195390 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9c359979-a3d3-43ef-969e-115edecb45f0 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:08.196190 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9c359979-a3d3-43ef-969e-115edecb45f0 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:08.196799 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9c359979-a3d3-43ef-969e-115edecb45f0 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:08.197368 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9c359979-a3d3-43ef-969e-115edecb45f0 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:08.517091 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-42d0ed66-c5c4-4320-bbba-07107422203e tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c87f0356ca346f39c6216393d85da2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee8c8f7fc4e12bc1f9fcce3e7b581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:51:08.528179 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-9c359979-a3d3-43ef-969e-115edecb45f0 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34f8af8ee2b545bead90fffd6c6c4896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48413ed1ac4e1ea65fb38f097881db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:51:08.530061 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-42d0ed66-c5c4-4320-bbba-07107422203e tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] 10.222.0.18 "GET /compute/v2.1/servers/fe83cd49-4ceb-49aa-a775-cc2a4229fd76" status: 200 len: 1503 microversion: 2.1 time: 0.350185 Oct 22 20:51:08.543599 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-9c359979-a3d3-43ef-969e-115edecb45f0 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] 10.222.0.18 "GET /compute/v2.1/servers/c475672d-99ba-4c6a-abaa-3332a392534d" status: 200 len: 1366 microversion: 2.1 time: 0.360058 Oct 22 20:51:08.544297 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 297/650] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:51:08 2022] GET /compute/v2.1/servers/fe83cd49-4ceb-49aa-a775-cc2a4229fd76 => generated 1503 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:51:08.550411 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-39764ac6-cf59-4d8d-901a-1d8492eeb3bc tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestBootFromVolume-server-1331254303", "imageRef": "", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "7d47d5f4-58bb-4e30-9e9f-060fb3e33e80"}], "security_groups": [{"name": "tempest-securitygroup--681042669"}], "key_name": "tempest-keypair-578928425", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "b19f74cf-0ef6-4650-adc9-cd75d82fe224", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "OS-DCF:diskConfig": "}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:51:08.552233 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 354/651] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:51:08 2022] GET /compute/v2.1/servers/c475672d-99ba-4c6a-abaa-3332a392534d => generated 1366 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:51:08.818368 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.network.neutron [None req-39764ac6-cf59-4d8d-901a-1d8492eeb3bc tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] validate_networks() for [('7d47d5f4-58bb-4e30-9e9f-060fb3e33e80', None, None, None, None, None)] {{(pid=138744) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 20:51:09.107222 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-6714158f-9b92-46af-b0b4-7535650e9abe tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:51:09.109234 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-6714158f-9b92-46af-b0b4-7535650e9abe tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] [instance: 0923f68f-d334-4133-824a-7830b65acc28] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:51:09.120466 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6714158f-9b92-46af-b0b4-7535650e9abe tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:09.121749 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6714158f-9b92-46af-b0b4-7535650e9abe tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:09.128813 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6714158f-9b92-46af-b0b4-7535650e9abe tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:09.130048 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6714158f-9b92-46af-b0b4-7535650e9abe tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:09.130811 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6714158f-9b92-46af-b0b4-7535650e9abe tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:09.131500 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6714158f-9b92-46af-b0b4-7535650e9abe tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:09.365396 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-39764ac6-cf59-4d8d-901a-1d8492eeb3bc tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Getting quotas for project 598f129979a34e7a856b83bd0e69f1b5. Resources: dict_keys(['metadata_items']) {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 20:51:09.371075 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-39764ac6-cf59-4d8d-901a-1d8492eeb3bc tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Getting quotas for user 6da7143c3bfb46a7b193a8d96f1b75b2 and project 598f129979a34e7a856b83bd0e69f1b5. Resources: dict_keys(['metadata_items']) {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 20:51:09.375688 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-6714158f-9b92-46af-b0b4-7535650e9abe tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91cf84a287b74618ae1b3368785b0b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902e239d67664098895ab24340b0b780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:51:09.384120 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-6714158f-9b92-46af-b0b4-7535650e9abe tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] 10.222.0.18 "GET /compute/v2.1/servers/0923f68f-d334-4133-824a-7830b65acc28" status: 200 len: 1318 microversion: 2.1 time: 0.280855 Oct 22 20:51:09.384952 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 355/652] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:51:09 2022] GET /compute/v2.1/servers/0923f68f-d334-4133-824a-7830b65acc28 => generated 1318 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 20:51:09.385197 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-39764ac6-cf59-4d8d-901a-1d8492eeb3bc tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Flavor limits 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 20:51:09.385686 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-39764ac6-cf59-4d8d-901a-1d8492eeb3bc tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Image limits 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 20:51:09.386237 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-39764ac6-cf59-4d8d-901a-1d8492eeb3bc tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Flavor pref 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 20:51:09.386712 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-39764ac6-cf59-4d8d-901a-1d8492eeb3bc tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Image pref 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 20:51:09.387187 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-39764ac6-cf59-4d8d-901a-1d8492eeb3bc tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 20:51:09.392555 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-548bc11e-00d1-446c-b3d5-583eea64faee tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:51:09.393962 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-548bc11e-00d1-446c-b3d5-583eea64faee tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] [instance: 254dfdd3-3716-43cf-aadc-f678aff08d27] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:51:09.403809 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-39764ac6-cf59-4d8d-901a-1d8492eeb3bc tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:09.404382 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-39764ac6-cf59-4d8d-901a-1d8492eeb3bc tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:09.405035 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-39764ac6-cf59-4d8d-901a-1d8492eeb3bc tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:09.405781 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-39764ac6-cf59-4d8d-901a-1d8492eeb3bc tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:09.405967 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-548bc11e-00d1-446c-b3d5-583eea64faee tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:09.406440 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-39764ac6-cf59-4d8d-901a-1d8492eeb3bc tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:09.406676 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-548bc11e-00d1-446c-b3d5-583eea64faee tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:09.406840 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-39764ac6-cf59-4d8d-901a-1d8492eeb3bc tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:09.407240 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-548bc11e-00d1-446c-b3d5-583eea64faee tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:09.408033 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-548bc11e-00d1-446c-b3d5-583eea64faee tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:09.408550 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-548bc11e-00d1-446c-b3d5-583eea64faee tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:09.409034 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-548bc11e-00d1-446c-b3d5-583eea64faee tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:09.424333 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-39764ac6-cf59-4d8d-901a-1d8492eeb3bc tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Getting quotas for project 598f129979a34e7a856b83bd0e69f1b5. Resources: {'cores', 'instances', 'ram'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 20:51:09.429755 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-39764ac6-cf59-4d8d-901a-1d8492eeb3bc tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Getting quotas for user 6da7143c3bfb46a7b193a8d96f1b75b2 and project 598f129979a34e7a856b83bd0e69f1b5. Resources: {'cores', 'instances', 'ram'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 20:51:09.496349 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-39764ac6-cf59-4d8d-901a-1d8492eeb3bc tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Going to run 1 instances... {{(pid=138744) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 20:51:09.498806 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-39764ac6-cf59-4d8d-901a-1d8492eeb3bc tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] [instance: 58846d5b-1bfa-42cd-92a3-546b110ff64b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b19f74cf-0ef6-4650-adc9-cd75d82fe224',volume_size=None,volume_type=None)] {{(pid=138744) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 20:51:09.592974 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-548bc11e-00d1-446c-b3d5-583eea64faee tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:51:09.604289 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-548bc11e-00d1-446c-b3d5-583eea64faee tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:51:09.606966 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-548bc11e-00d1-446c-b3d5-583eea64faee tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:51:09.608595 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-548bc11e-00d1-446c-b3d5-583eea64faee tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] 10.222.0.18 "GET /compute/v2.1/servers/254dfdd3-3716-43cf-aadc-f678aff08d27" status: 200 len: 1543 microversion: 2.25 time: 0.222342 Oct 22 20:51:09.609331 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 356/653] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 20:51:09 2022] GET /compute/v2.1/servers/254dfdd3-3716-43cf-aadc-f678aff08d27 => generated 1543 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 20:51:09.614056 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-81ce0a8c-af19-4a40-9ecb-474f5a15cdd5 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:51:09.614657 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-81ce0a8c-af19-4a40-9ecb-474f5a15cdd5 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] [instance: fe83cd49-4ceb-49aa-a775-cc2a4229fd76] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:51:09.629571 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-81ce0a8c-af19-4a40-9ecb-474f5a15cdd5 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:09.631659 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-81ce0a8c-af19-4a40-9ecb-474f5a15cdd5 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:09.632332 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-81ce0a8c-af19-4a40-9ecb-474f5a15cdd5 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:09.633675 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-81ce0a8c-af19-4a40-9ecb-474f5a15cdd5 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:09.634354 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-81ce0a8c-af19-4a40-9ecb-474f5a15cdd5 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:09.635318 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-81ce0a8c-af19-4a40-9ecb-474f5a15cdd5 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:09.749606 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-39764ac6-cf59-4d8d-901a-1d8492eeb3bc tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.204013 Oct 22 20:51:09.751065 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 298/654] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Oct 22 20:51:08 2022] POST /compute/v2.1/servers => generated 406 bytes in 1206 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 20:51:09.756439 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-abfa268d-f047-4f25-92d2-8d3c42177bb2 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:51:09.757054 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-abfa268d-f047-4f25-92d2-8d3c42177bb2 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] [instance: c475672d-99ba-4c6a-abaa-3332a392534d] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:51:09.763531 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-abfa268d-f047-4f25-92d2-8d3c42177bb2 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:09.764788 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-abfa268d-f047-4f25-92d2-8d3c42177bb2 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:09.765410 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-abfa268d-f047-4f25-92d2-8d3c42177bb2 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:09.766281 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-abfa268d-f047-4f25-92d2-8d3c42177bb2 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:09.766890 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-abfa268d-f047-4f25-92d2-8d3c42177bb2 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:09.767536 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-abfa268d-f047-4f25-92d2-8d3c42177bb2 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:09.882872 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-81ce0a8c-af19-4a40-9ecb-474f5a15cdd5 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c87f0356ca346f39c6216393d85da2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee8c8f7fc4e12bc1f9fcce3e7b581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:51:09.894186 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-81ce0a8c-af19-4a40-9ecb-474f5a15cdd5 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] 10.222.0.18 "GET /compute/v2.1/servers/fe83cd49-4ceb-49aa-a775-cc2a4229fd76" status: 200 len: 1503 microversion: 2.1 time: 0.283616 Oct 22 20:51:09.894780 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 357/655] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:51:09 2022] GET /compute/v2.1/servers/fe83cd49-4ceb-49aa-a775-cc2a4229fd76 => generated 1503 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:51:09.903489 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-6efa5c79-f140-4397-a914-d533c40fdca9 tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] Calling method '.version_select at 0x7fd3a4719ee0>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:51:09.906934 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6efa5c79-f140-4397-a914-d533c40fdca9 tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:09.910345 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6efa5c79-f140-4397-a914-d533c40fdca9 tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:09.911566 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6efa5c79-f140-4397-a914-d533c40fdca9 tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:09.930951 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-6efa5c79-f140-4397-a914-d533c40fdca9 tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] 10.222.0.18 "GET /compute/v2.1/os-migrations" status: 200 len: 1763 microversion: 2.25 time: 0.034677 Oct 22 20:51:09.931981 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 358/656] 10.222.0.18 () {60 vars in 1184 bytes} [Sat Oct 22 20:51:09 2022] GET /compute/v2.1/os-migrations => generated 1763 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 20:51:09.936645 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-5b2c2f0f-c1c5-4228-a664-4ce8897615d1 req-24a32398-8c8f-4572-9ff7-0bf8acc847a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c475672d-99ba-4c6a-abaa-3332a392534d", "name": "network-vif-plugged", "status": "completed", "tag": "5a48f24d-ee6f-4bfc-9d60-4db767fe6dbd"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:51:09.947404 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-5b2c2f0f-c1c5-4228-a664-4ce8897615d1 req-24a32398-8c8f-4572-9ff7-0bf8acc847a1 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:09.948103 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-5b2c2f0f-c1c5-4228-a664-4ce8897615d1 req-24a32398-8c8f-4572-9ff7-0bf8acc847a1 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:09.948754 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-5b2c2f0f-c1c5-4228-a664-4ce8897615d1 req-24a32398-8c8f-4572-9ff7-0bf8acc847a1 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:09.953686 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-abfa268d-f047-4f25-92d2-8d3c42177bb2 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34f8af8ee2b545bead90fffd6c6c4896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48413ed1ac4e1ea65fb38f097881db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:51:09.963785 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-abfa268d-f047-4f25-92d2-8d3c42177bb2 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] 10.222.0.18 "GET /compute/v2.1/servers/c475672d-99ba-4c6a-abaa-3332a392534d" status: 200 len: 1366 microversion: 2.1 time: 0.210821 Oct 22 20:51:09.966575 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 299/657] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:51:09 2022] GET /compute/v2.1/servers/c475672d-99ba-4c6a-abaa-3332a392534d => generated 1366 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:51:09.977789 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-07ae6daa-6772-45bd-86db-33da8a6a4887 tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:51:09.978376 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-07ae6daa-6772-45bd-86db-33da8a6a4887 tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] [instance: 58846d5b-1bfa-42cd-92a3-546b110ff64b] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:51:09.983652 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-5b2c2f0f-c1c5-4228-a664-4ce8897615d1 req-24a32398-8c8f-4572-9ff7-0bf8acc847a1 service nova] Creating event network-vif-plugged:5a48f24d-ee6f-4bfc-9d60-4db767fe6dbd for instance c475672d-99ba-4c6a-abaa-3332a392534d on nch1-master-1 Oct 22 20:51:09.995573 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-5b2c2f0f-c1c5-4228-a664-4ce8897615d1 req-24a32398-8c8f-4572-9ff7-0bf8acc847a1 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060810 Oct 22 20:51:09.996198 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 359/658] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:51:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:51:10.001417 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-f15f9741-43b6-4174-8264-095aab0e31d3 tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:51:10.009769 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-f15f9741-43b6-4174-8264-095aab0e31d3 tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] [instance: 254dfdd3-3716-43cf-aadc-f678aff08d27] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:51:10.019826 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f15f9741-43b6-4174-8264-095aab0e31d3 tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:10.020365 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f15f9741-43b6-4174-8264-095aab0e31d3 tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:10.021257 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f15f9741-43b6-4174-8264-095aab0e31d3 tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:10.022193 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f15f9741-43b6-4174-8264-095aab0e31d3 tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:10.023264 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f15f9741-43b6-4174-8264-095aab0e31d3 tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:10.023736 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f15f9741-43b6-4174-8264-095aab0e31d3 tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:10.061927 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-07ae6daa-6772-45bd-86db-33da8a6a4887 tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da7143c3bfb46a7b193a8d96f1b75b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598f129979a34e7a856b83bd0e69f1b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:51:10.070521 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-07ae6daa-6772-45bd-86db-33da8a6a4887 tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] 10.222.0.18 "GET /compute/v2.1/servers/58846d5b-1bfa-42cd-92a3-546b110ff64b" status: 200 len: 1121 microversion: 2.1 time: 0.102476 Oct 22 20:51:10.083763 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 300/659] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:51:09 2022] GET /compute/v2.1/servers/58846d5b-1bfa-42cd-92a3-546b110ff64b => generated 1121 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:51:10.196032 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-84ef5fa0-e0b2-49ad-bb74-082f8c6b0e5e req-d65eee43-6eb0-43c6-88bf-2795571a437a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d992dc02-b690-452b-aaf2-1473b69a75cb", "tag": "dd91ec1a-3d89-46f1-b7e7-fe796a7b20b7"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:51:10.218812 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.objects.instance [None req-f15f9741-43b6-4174-8264-095aab0e31d3 tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] Lazy-loading 'services' on Instance uuid 254dfdd3-3716-43cf-aadc-f678aff08d27 {{(pid=138745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 20:51:10.220286 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-84ef5fa0-e0b2-49ad-bb74-082f8c6b0e5e req-d65eee43-6eb0-43c6-88bf-2795571a437a service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:10.220790 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-84ef5fa0-e0b2-49ad-bb74-082f8c6b0e5e req-d65eee43-6eb0-43c6-88bf-2795571a437a service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:10.221238 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-84ef5fa0-e0b2-49ad-bb74-082f8c6b0e5e req-d65eee43-6eb0-43c6-88bf-2795571a437a service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:10.243530 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-84ef5fa0-e0b2-49ad-bb74-082f8c6b0e5e req-d65eee43-6eb0-43c6-88bf-2795571a437a service nova] Creating event network-changed:dd91ec1a-3d89-46f1-b7e7-fe796a7b20b7 for instance d992dc02-b690-452b-aaf2-1473b69a75cb on nch2-master-1 Oct 22 20:51:10.248580 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-84ef5fa0-e0b2-49ad-bb74-082f8c6b0e5e req-d65eee43-6eb0-43c6-88bf-2795571a437a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056583 Oct 22 20:51:10.249483 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 301/660] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:51:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 20:51:10.255461 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-f15f9741-43b6-4174-8264-095aab0e31d3 tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/254dfdd3-3716-43cf-aadc-f678aff08d27" status: 200 len: 2036 microversion: 2.25 time: 0.258036 Oct 22 20:51:10.256184 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 360/661] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 20:51:09 2022] GET /compute/v2.1/servers/254dfdd3-3716-43cf-aadc-f678aff08d27 => generated 2036 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 20:51:10.290239 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-63773b4a-a680-44d3-af45-ef885e1ceff1 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Action: 'create', calling method: .version_select at 0x7fd3a44835e0>, body: {"keypair": {"name": "tempest-keypair-250920229", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN/ZVexpmeUulZFQpxcW/eTO1EvZtw/0QIEPHhsmPCcPIukox+8hC6oV1rHPYp5kXI2lmL7gTtX7bmv/NhlyUIV8ChriZTORnhUf+4kAoLJOJM71h+pWolrkYaVPwqquhg=="}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:51:10.306556 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-63773b4a-a680-44d3-af45-ef885e1ceff1 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Getting quotas for project 11060bbcab6b45cabb1457319d72b982. Resources: {'key_pairs'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 20:51:10.312940 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-63773b4a-a680-44d3-af45-ef885e1ceff1 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Getting quotas for user 93c41b7be1724632b0d6bd2bd3b57f8f and project 11060bbcab6b45cabb1457319d72b982. Resources: {'key_pairs'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 20:51:10.342087 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-63773b4a-a680-44d3-af45-ef885e1ceff1 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.25 time: 0.057241 Oct 22 20:51:10.342689 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 302/662] 10.222.0.18 () {62 vars in 1200 bytes} [Sat Oct 22 20:51:10 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 59 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 22 20:51:10.408201 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-2ae75749-9a61-4628-969d-17da8708a708 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:51:10.408822 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-2ae75749-9a61-4628-969d-17da8708a708 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] [instance: 0923f68f-d334-4133-824a-7830b65acc28] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:51:10.421303 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2ae75749-9a61-4628-969d-17da8708a708 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:10.422435 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2ae75749-9a61-4628-969d-17da8708a708 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:10.423054 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2ae75749-9a61-4628-969d-17da8708a708 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:10.423983 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2ae75749-9a61-4628-969d-17da8708a708 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:10.428037 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2ae75749-9a61-4628-969d-17da8708a708 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:10.428508 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2ae75749-9a61-4628-969d-17da8708a708 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:10.675725 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-2ae75749-9a61-4628-969d-17da8708a708 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91cf84a287b74618ae1b3368785b0b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902e239d67664098895ab24340b0b780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:51:10.684887 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-2ae75749-9a61-4628-969d-17da8708a708 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] 10.222.0.18 "GET /compute/v2.1/servers/0923f68f-d334-4133-824a-7830b65acc28" status: 200 len: 1318 microversion: 2.1 time: 0.280812 Oct 22 20:51:10.685472 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 361/663] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:51:10 2022] GET /compute/v2.1/servers/0923f68f-d334-4133-824a-7830b65acc28 => generated 1318 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:51:10.921129 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-17b2b9b5-8358-46d9-bc0e-0fb703a9e7df tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:51:10.923657 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-17b2b9b5-8358-46d9-bc0e-0fb703a9e7df tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] [instance: fe83cd49-4ceb-49aa-a775-cc2a4229fd76] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:51:10.933171 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-17b2b9b5-8358-46d9-bc0e-0fb703a9e7df tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:10.933835 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-17b2b9b5-8358-46d9-bc0e-0fb703a9e7df tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:10.935471 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-17b2b9b5-8358-46d9-bc0e-0fb703a9e7df tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:10.937494 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-17b2b9b5-8358-46d9-bc0e-0fb703a9e7df tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:10.938591 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-17b2b9b5-8358-46d9-bc0e-0fb703a9e7df tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:10.940419 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-17b2b9b5-8358-46d9-bc0e-0fb703a9e7df tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:10.993672 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-800a7af2-7641-421a-9b2a-d1cfb3994647 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:51:10.994604 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-800a7af2-7641-421a-9b2a-d1cfb3994647 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] [instance: c475672d-99ba-4c6a-abaa-3332a392534d] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:51:11.007139 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-800a7af2-7641-421a-9b2a-d1cfb3994647 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:11.007948 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-800a7af2-7641-421a-9b2a-d1cfb3994647 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:11.008532 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-800a7af2-7641-421a-9b2a-d1cfb3994647 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:11.009597 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-800a7af2-7641-421a-9b2a-d1cfb3994647 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:11.010104 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-800a7af2-7641-421a-9b2a-d1cfb3994647 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:11.010604 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-800a7af2-7641-421a-9b2a-d1cfb3994647 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:11.261487 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-17b2b9b5-8358-46d9-bc0e-0fb703a9e7df tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c87f0356ca346f39c6216393d85da2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee8c8f7fc4e12bc1f9fcce3e7b581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:51:11.270024 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-17b2b9b5-8358-46d9-bc0e-0fb703a9e7df tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] 10.222.0.18 "GET /compute/v2.1/servers/fe83cd49-4ceb-49aa-a775-cc2a4229fd76" status: 200 len: 1503 microversion: 2.1 time: 0.354813 Oct 22 20:51:11.270839 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 303/664] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:51:10 2022] GET /compute/v2.1/servers/fe83cd49-4ceb-49aa-a775-cc2a4229fd76 => generated 1503 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:51:11.276169 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-8e535340-edcc-41ab-a663-5403846b6ce7 tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:51:11.276756 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-8e535340-edcc-41ab-a663-5403846b6ce7 tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] [instance: 58846d5b-1bfa-42cd-92a3-546b110ff64b] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:51:11.283220 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8e535340-edcc-41ab-a663-5403846b6ce7 tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:11.283717 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8e535340-edcc-41ab-a663-5403846b6ce7 tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:11.284334 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8e535340-edcc-41ab-a663-5403846b6ce7 tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:11.285190 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8e535340-edcc-41ab-a663-5403846b6ce7 tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:11.286065 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8e535340-edcc-41ab-a663-5403846b6ce7 tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:11.286492 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8e535340-edcc-41ab-a663-5403846b6ce7 tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:11.297429 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-800a7af2-7641-421a-9b2a-d1cfb3994647 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34f8af8ee2b545bead90fffd6c6c4896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48413ed1ac4e1ea65fb38f097881db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:51:11.307413 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell1:SELECT=100 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:51:11.320885 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-800a7af2-7641-421a-9b2a-d1cfb3994647 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] 10.222.0.18 "GET /compute/v2.1/servers/c475672d-99ba-4c6a-abaa-3332a392534d" status: 200 len: 1366 microversion: 2.1 time: 0.331322 Oct 22 20:51:11.321761 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 362/665] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:51:10 2022] GET /compute/v2.1/servers/c475672d-99ba-4c6a-abaa-3332a392534d => generated 1366 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 20:51:11.361451 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-8e535340-edcc-41ab-a663-5403846b6ce7 tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da7143c3bfb46a7b193a8d96f1b75b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598f129979a34e7a856b83bd0e69f1b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:51:11.370142 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-8e535340-edcc-41ab-a663-5403846b6ce7 tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] 10.222.0.18 "GET /compute/v2.1/servers/58846d5b-1bfa-42cd-92a3-546b110ff64b" status: 200 len: 1219 microversion: 2.1 time: 0.097701 Oct 22 20:51:11.370378 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 304/666] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:51:11 2022] GET /compute/v2.1/servers/58846d5b-1bfa-42cd-92a3-546b110ff64b => generated 1219 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:51:11.710334 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-6afdf724-d5c3-4d85-bb1c-ad5204d749fc tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:51:11.710955 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-6afdf724-d5c3-4d85-bb1c-ad5204d749fc tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] [instance: 0923f68f-d334-4133-824a-7830b65acc28] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:51:11.721107 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6afdf724-d5c3-4d85-bb1c-ad5204d749fc tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:11.723327 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6afdf724-d5c3-4d85-bb1c-ad5204d749fc tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:11.723817 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6afdf724-d5c3-4d85-bb1c-ad5204d749fc tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:11.726125 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6afdf724-d5c3-4d85-bb1c-ad5204d749fc tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:11.727163 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6afdf724-d5c3-4d85-bb1c-ad5204d749fc tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:11.729216 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6afdf724-d5c3-4d85-bb1c-ad5204d749fc tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:12.001761 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-6afdf724-d5c3-4d85-bb1c-ad5204d749fc tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91cf84a287b74618ae1b3368785b0b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902e239d67664098895ab24340b0b780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:51:12.013906 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-6afdf724-d5c3-4d85-bb1c-ad5204d749fc tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] 10.222.0.18 "GET /compute/v2.1/servers/0923f68f-d334-4133-824a-7830b65acc28" status: 200 len: 1318 microversion: 2.1 time: 0.307967 Oct 22 20:51:12.015023 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 363/667] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:51:11 2022] GET /compute/v2.1/servers/0923f68f-d334-4133-824a-7830b65acc28 => generated 1318 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:51:12.293638 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-a7a5c31b-231d-4d84-8065-a769c2577c7a tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:51:12.294278 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-a7a5c31b-231d-4d84-8065-a769c2577c7a tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] [instance: fe83cd49-4ceb-49aa-a775-cc2a4229fd76] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:51:12.301477 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a7a5c31b-231d-4d84-8065-a769c2577c7a tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:12.301966 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a7a5c31b-231d-4d84-8065-a769c2577c7a tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:12.302626 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a7a5c31b-231d-4d84-8065-a769c2577c7a tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:12.303328 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a7a5c31b-231d-4d84-8065-a769c2577c7a tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:12.303983 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a7a5c31b-231d-4d84-8065-a769c2577c7a tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:12.304406 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a7a5c31b-231d-4d84-8065-a769c2577c7a tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:12.344871 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-20eb5b12-46f0-48f1-88ba-10990c139f20 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:51:12.346117 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-20eb5b12-46f0-48f1-88ba-10990c139f20 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] [instance: c475672d-99ba-4c6a-abaa-3332a392534d] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:51:12.353991 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-20eb5b12-46f0-48f1-88ba-10990c139f20 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:12.354852 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-20eb5b12-46f0-48f1-88ba-10990c139f20 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:12.355649 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-20eb5b12-46f0-48f1-88ba-10990c139f20 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:12.356523 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-20eb5b12-46f0-48f1-88ba-10990c139f20 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:12.357125 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-20eb5b12-46f0-48f1-88ba-10990c139f20 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:12.357704 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-20eb5b12-46f0-48f1-88ba-10990c139f20 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:12.621856 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-a7a5c31b-231d-4d84-8065-a769c2577c7a tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c87f0356ca346f39c6216393d85da2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee8c8f7fc4e12bc1f9fcce3e7b581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:51:12.631182 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-a7a5c31b-231d-4d84-8065-a769c2577c7a tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] 10.222.0.18 "GET /compute/v2.1/servers/fe83cd49-4ceb-49aa-a775-cc2a4229fd76" status: 200 len: 1503 microversion: 2.1 time: 0.341579 Oct 22 20:51:12.632169 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 305/668] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:51:12 2022] GET /compute/v2.1/servers/fe83cd49-4ceb-49aa-a775-cc2a4229fd76 => generated 1503 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:51:12.637661 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-65b57bfd-65a7-4273-980a-43c354e10107 tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:51:12.638539 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-65b57bfd-65a7-4273-980a-43c354e10107 tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] [instance: 58846d5b-1bfa-42cd-92a3-546b110ff64b] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:51:12.646370 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-65b57bfd-65a7-4273-980a-43c354e10107 tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:12.647632 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-65b57bfd-65a7-4273-980a-43c354e10107 tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:12.648308 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-65b57bfd-65a7-4273-980a-43c354e10107 tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:12.649818 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-65b57bfd-65a7-4273-980a-43c354e10107 tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:12.650837 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-65b57bfd-65a7-4273-980a-43c354e10107 tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:12.651996 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-65b57bfd-65a7-4273-980a-43c354e10107 tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:12.697710 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-20eb5b12-46f0-48f1-88ba-10990c139f20 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34f8af8ee2b545bead90fffd6c6c4896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48413ed1ac4e1ea65fb38f097881db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:51:12.710767 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-20eb5b12-46f0-48f1-88ba-10990c139f20 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] 10.222.0.18 "GET /compute/v2.1/servers/c475672d-99ba-4c6a-abaa-3332a392534d" status: 200 len: 1556 microversion: 2.1 time: 0.368989 Oct 22 20:51:12.713609 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 364/669] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:51:12 2022] GET /compute/v2.1/servers/c475672d-99ba-4c6a-abaa-3332a392534d => generated 1556 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 20:51:12.736713 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-198bb839-c47f-45fc-aad5-1892464fb08d tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:51:12.737479 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-198bb839-c47f-45fc-aad5-1892464fb08d tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] [instance: c475672d-99ba-4c6a-abaa-3332a392534d] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:51:12.749630 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-198bb839-c47f-45fc-aad5-1892464fb08d tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:12.751721 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-65b57bfd-65a7-4273-980a-43c354e10107 tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da7143c3bfb46a7b193a8d96f1b75b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598f129979a34e7a856b83bd0e69f1b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:51:12.762241 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-198bb839-c47f-45fc-aad5-1892464fb08d tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:12.765129 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-198bb839-c47f-45fc-aad5-1892464fb08d tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:12.765861 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-65b57bfd-65a7-4273-980a-43c354e10107 tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] 10.222.0.18 "GET /compute/v2.1/servers/58846d5b-1bfa-42cd-92a3-546b110ff64b" status: 200 len: 1227 microversion: 2.1 time: 0.131089 Oct 22 20:51:12.766460 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-198bb839-c47f-45fc-aad5-1892464fb08d tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:12.767504 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 306/670] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:51:12 2022] GET /compute/v2.1/servers/58846d5b-1bfa-42cd-92a3-546b110ff64b => generated 1227 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:51:12.767880 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-198bb839-c47f-45fc-aad5-1892464fb08d tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:12.769353 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-198bb839-c47f-45fc-aad5-1892464fb08d tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:12.997677 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-198bb839-c47f-45fc-aad5-1892464fb08d tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] 10.222.0.18 "GET /compute/v2.1/servers/c475672d-99ba-4c6a-abaa-3332a392534d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.265036 Oct 22 20:51:12.998805 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 365/671] 10.222.0.18 () {58 vars in 1275 bytes} [Sat Oct 22 20:51:12 2022] GET /compute/v2.1/servers/c475672d-99ba-4c6a-abaa-3332a392534d/os-interface => generated 284 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 20:51:13.041310 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-54fae4a6-6492-488f-9e20-1886717075ef tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:51:13.044175 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-54fae4a6-6492-488f-9e20-1886717075ef tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] [instance: 0923f68f-d334-4133-824a-7830b65acc28] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:51:13.054262 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-54fae4a6-6492-488f-9e20-1886717075ef tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:13.064460 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-54fae4a6-6492-488f-9e20-1886717075ef tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:13.066147 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-54fae4a6-6492-488f-9e20-1886717075ef tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:13.069375 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-54fae4a6-6492-488f-9e20-1886717075ef tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:13.071985 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-54fae4a6-6492-488f-9e20-1886717075ef tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:13.073166 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-54fae4a6-6492-488f-9e20-1886717075ef tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:13.657695 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-0ac4a5d1-2a50-438e-be31-68abb047fff3 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:51:13.658320 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-0ac4a5d1-2a50-438e-be31-68abb047fff3 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] [instance: fe83cd49-4ceb-49aa-a775-cc2a4229fd76] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:51:13.668114 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0ac4a5d1-2a50-438e-be31-68abb047fff3 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:13.668630 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0ac4a5d1-2a50-438e-be31-68abb047fff3 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:13.670652 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0ac4a5d1-2a50-438e-be31-68abb047fff3 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:13.671991 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0ac4a5d1-2a50-438e-be31-68abb047fff3 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:13.673541 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0ac4a5d1-2a50-438e-be31-68abb047fff3 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:13.677986 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0ac4a5d1-2a50-438e-be31-68abb047fff3 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:13.806053 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-54fae4a6-6492-488f-9e20-1886717075ef tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91cf84a287b74618ae1b3368785b0b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902e239d67664098895ab24340b0b780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:51:13.815322 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-54fae4a6-6492-488f-9e20-1886717075ef tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] 10.222.0.18 "GET /compute/v2.1/servers/0923f68f-d334-4133-824a-7830b65acc28" status: 200 len: 1318 microversion: 2.1 time: 0.781540 Oct 22 20:51:13.818356 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 307/672] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:51:13 2022] GET /compute/v2.1/servers/0923f68f-d334-4133-824a-7830b65acc28 => generated 1318 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:51:13.826604 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-30f99bec-e1b6-40bc-becf-cd8d8a2a0080 tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:51:13.832666 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-30f99bec-e1b6-40bc-becf-cd8d8a2a0080 tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] [instance: 58846d5b-1bfa-42cd-92a3-546b110ff64b] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:51:13.846366 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-30f99bec-e1b6-40bc-becf-cd8d8a2a0080 tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:13.847164 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-30f99bec-e1b6-40bc-becf-cd8d8a2a0080 tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:13.847791 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-30f99bec-e1b6-40bc-becf-cd8d8a2a0080 tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:13.850629 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-30f99bec-e1b6-40bc-becf-cd8d8a2a0080 tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:13.851261 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-30f99bec-e1b6-40bc-becf-cd8d8a2a0080 tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:13.855674 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-30f99bec-e1b6-40bc-becf-cd8d8a2a0080 tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:14.031607 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-30f99bec-e1b6-40bc-becf-cd8d8a2a0080 tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da7143c3bfb46a7b193a8d96f1b75b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598f129979a34e7a856b83bd0e69f1b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:51:14.045807 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-30f99bec-e1b6-40bc-becf-cd8d8a2a0080 tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] 10.222.0.18 "GET /compute/v2.1/servers/58846d5b-1bfa-42cd-92a3-546b110ff64b" status: 200 len: 1237 microversion: 2.1 time: 0.222897 Oct 22 20:51:14.048371 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 308/673] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:51:13 2022] GET /compute/v2.1/servers/58846d5b-1bfa-42cd-92a3-546b110ff64b => generated 1237 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:51:14.147863 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell0:SELECT=11 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:51:14.250110 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-0ac4a5d1-2a50-438e-be31-68abb047fff3 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c87f0356ca346f39c6216393d85da2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee8c8f7fc4e12bc1f9fcce3e7b581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:51:14.256697 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-3f337152-43a9-4f74-84df-0f7f65e1e0ed tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-853812932", "imageRef": "085e4478-6edc-4a69-8e08-f9831713eb65", "flavorRef": "452", "networks": [{"uuid": "03a467bd-c608-425f-8923-ff356110df6b"}], "security_groups": [{"name": "tempest-securitygroup--2037466263"}], "key_name": "tempest-keypair-250920229", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:51:14.285738 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-0ac4a5d1-2a50-438e-be31-68abb047fff3 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] 10.222.0.18 "GET /compute/v2.1/servers/fe83cd49-4ceb-49aa-a775-cc2a4229fd76" status: 200 len: 1503 microversion: 2.1 time: 0.606726 Oct 22 20:51:14.288980 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 366/674] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:51:13 2022] GET /compute/v2.1/servers/fe83cd49-4ceb-49aa-a775-cc2a4229fd76 => generated 1503 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 20:51:14.695311 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.network.neutron [None req-3f337152-43a9-4f74-84df-0f7f65e1e0ed tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] validate_networks() for [('03a467bd-c608-425f-8923-ff356110df6b', None, None, None, None, None)] {{(pid=138744) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 20:51:14.925611 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell0:SELECT=80 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:51:15.207390 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-a7356912-f90e-4e57-9cd0-300b33289e5d tempest-SecurityGroupsTestAdminJSON-147590501 tempest-SecurityGroupsTestAdminJSON-147590501-project] Action: 'create', calling method: .version_select at 0x7fd3a47ad550>, body: {"security_group": {"name": "tempest-securitygroup-925589062", "description": "tempest-description-414102269"}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:51:16.404274 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-a7356912-f90e-4e57-9cd0-300b33289e5d tempest-SecurityGroupsTestAdminJSON-147590501 tempest-SecurityGroupsTestAdminJSON-147590501-project] 10.222.0.18 "POST /compute/v2.1/os-security-groups" status: 200 len: 219 microversion: 2.1 time: 1.580403 Oct 22 20:51:16.414324 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 367/675] 10.222.0.18 () {60 vars in 1180 bytes} [Sat Oct 22 20:51:14 2022] POST /compute/v2.1/os-security-groups => generated 219 bytes in 1592 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 20:51:16.420309 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-08854b18-779c-4691-a53d-0435ea8afb5b tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:51:16.421167 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-08854b18-779c-4691-a53d-0435ea8afb5b tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] [instance: 0923f68f-d334-4133-824a-7830b65acc28] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:51:16.429506 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-08854b18-779c-4691-a53d-0435ea8afb5b tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:16.430217 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-08854b18-779c-4691-a53d-0435ea8afb5b tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:16.430800 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-08854b18-779c-4691-a53d-0435ea8afb5b tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:16.432444 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-08854b18-779c-4691-a53d-0435ea8afb5b tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:16.433202 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-08854b18-779c-4691-a53d-0435ea8afb5b tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:16.434043 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-08854b18-779c-4691-a53d-0435ea8afb5b tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:16.473269 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-3f337152-43a9-4f74-84df-0f7f65e1e0ed tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Flavor limits 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 20:51:16.473824 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-3f337152-43a9-4f74-84df-0f7f65e1e0ed tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Image limits 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 20:51:16.474426 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-3f337152-43a9-4f74-84df-0f7f65e1e0ed tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Flavor pref 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 20:51:16.474940 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-3f337152-43a9-4f74-84df-0f7f65e1e0ed tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Image pref 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 20:51:16.476086 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-3f337152-43a9-4f74-84df-0f7f65e1e0ed tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 20:51:16.489033 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell0:SELECT=83 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:51:16.494444 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3f337152-43a9-4f74-84df-0f7f65e1e0ed tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:16.495282 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3f337152-43a9-4f74-84df-0f7f65e1e0ed tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:16.496012 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3f337152-43a9-4f74-84df-0f7f65e1e0ed tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:16.496984 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3f337152-43a9-4f74-84df-0f7f65e1e0ed tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:16.497647 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3f337152-43a9-4f74-84df-0f7f65e1e0ed tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:16.498757 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3f337152-43a9-4f74-84df-0f7f65e1e0ed tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:16.522764 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-3f337152-43a9-4f74-84df-0f7f65e1e0ed tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Getting quotas for project 11060bbcab6b45cabb1457319d72b982. Resources: {'cores', 'instances', 'ram'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 20:51:16.534637 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-3f337152-43a9-4f74-84df-0f7f65e1e0ed tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Getting quotas for user 93c41b7be1724632b0d6bd2bd3b57f8f and project 11060bbcab6b45cabb1457319d72b982. Resources: {'cores', 'instances', 'ram'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 20:51:16.553998 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-3f337152-43a9-4f74-84df-0f7f65e1e0ed tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Going to run 1 instances... {{(pid=138744) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 20:51:16.557012 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-3f337152-43a9-4f74-84df-0f7f65e1e0ed tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] [instance: 4c7b99a9-2ec4-4f4b-98e7-8e1ea2103735] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='085e4478-6edc-4a69-8e08-f9831713eb65',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138744) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 20:51:16.656175 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-3f337152-43a9-4f74-84df-0f7f65e1e0ed tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.25 time: 2.409888 Oct 22 20:51:16.657298 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 309/676] 10.222.0.18 () {62 vars in 1188 bytes} [Sat Oct 22 20:51:14 2022] POST /compute/v2.1/servers => generated 406 bytes in 2412 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 22 20:51:16.663292 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-54fcd99d-669f-409b-9259-e05819758804 tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:51:16.664588 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-54fcd99d-669f-409b-9259-e05819758804 tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] [instance: 58846d5b-1bfa-42cd-92a3-546b110ff64b] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:51:16.674774 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-54fcd99d-669f-409b-9259-e05819758804 tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:16.675749 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-54fcd99d-669f-409b-9259-e05819758804 tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:16.676459 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-54fcd99d-669f-409b-9259-e05819758804 tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:16.677479 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-54fcd99d-669f-409b-9259-e05819758804 tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:16.678437 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-54fcd99d-669f-409b-9259-e05819758804 tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:16.679246 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-54fcd99d-669f-409b-9259-e05819758804 tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:16.717108 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-08854b18-779c-4691-a53d-0435ea8afb5b tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91cf84a287b74618ae1b3368785b0b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902e239d67664098895ab24340b0b780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:51:16.730556 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-08854b18-779c-4691-a53d-0435ea8afb5b tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] 10.222.0.18 "GET /compute/v2.1/servers/0923f68f-d334-4133-824a-7830b65acc28" status: 200 len: 1318 microversion: 2.1 time: 0.314771 Oct 22 20:51:16.735725 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 368/677] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:51:16 2022] GET /compute/v2.1/servers/0923f68f-d334-4133-824a-7830b65acc28 => generated 1318 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:51:16.751695 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-1bfd173a-9a3f-48d3-bed6-f496f0fc5c39 req-094ec481-62d0-4d84-ace4-462e443f108e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0923f68f-d334-4133-824a-7830b65acc28", "name": "network-vif-plugged", "status": "completed", "tag": "e2f995f5-84a0-4b55-bc6a-8c2cd4d30e99"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:51:16.772681 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-1bfd173a-9a3f-48d3-bed6-f496f0fc5c39 req-094ec481-62d0-4d84-ace4-462e443f108e service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:16.773218 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-1bfd173a-9a3f-48d3-bed6-f496f0fc5c39 req-094ec481-62d0-4d84-ace4-462e443f108e service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:16.773582 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-1bfd173a-9a3f-48d3-bed6-f496f0fc5c39 req-094ec481-62d0-4d84-ace4-462e443f108e service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:16.803727 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-1bfd173a-9a3f-48d3-bed6-f496f0fc5c39 req-094ec481-62d0-4d84-ace4-462e443f108e service nova] Creating event network-vif-plugged:e2f995f5-84a0-4b55-bc6a-8c2cd4d30e99 for instance 0923f68f-d334-4133-824a-7830b65acc28 on nch2-master-1 Oct 22 20:51:16.817704 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-1bfd173a-9a3f-48d3-bed6-f496f0fc5c39 req-094ec481-62d0-4d84-ace4-462e443f108e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080309 Oct 22 20:51:16.820036 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 369/678] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:51:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:51:16.835838 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-96628abb-a9f2-43d7-a463-0ca766473ded tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:51:16.840092 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-96628abb-a9f2-43d7-a463-0ca766473ded tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] [instance: fe83cd49-4ceb-49aa-a775-cc2a4229fd76] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:51:16.862272 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-96628abb-a9f2-43d7-a463-0ca766473ded tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:16.862767 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-96628abb-a9f2-43d7-a463-0ca766473ded tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:16.863208 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-96628abb-a9f2-43d7-a463-0ca766473ded tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:16.864409 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-96628abb-a9f2-43d7-a463-0ca766473ded tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:16.865014 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-96628abb-a9f2-43d7-a463-0ca766473ded tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:16.865446 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-96628abb-a9f2-43d7-a463-0ca766473ded tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:16.995724 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-54fcd99d-669f-409b-9259-e05819758804 tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da7143c3bfb46a7b193a8d96f1b75b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598f129979a34e7a856b83bd0e69f1b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:51:16.998631 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:SELECT=100 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:51:17.007483 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-54fcd99d-669f-409b-9259-e05819758804 tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] 10.222.0.18 "GET /compute/v2.1/servers/58846d5b-1bfa-42cd-92a3-546b110ff64b" status: 200 len: 1292 microversion: 2.1 time: 0.348977 Oct 22 20:51:17.009359 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 310/679] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:51:16 2022] GET /compute/v2.1/servers/58846d5b-1bfa-42cd-92a3-546b110ff64b => generated 1292 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:51:17.015507 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-00b55208-4414-4de0-801b-fbe06f7f7564 req-a022b906-5cee-4f75-a6d3-f28edf1fd981 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58846d5b-1bfa-42cd-92a3-546b110ff64b", "tag": "6fea6402-4ea4-46cb-b608-a01b3e495aa0"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:51:17.022956 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:51:17.028804 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-00b55208-4414-4de0-801b-fbe06f7f7564 req-a022b906-5cee-4f75-a6d3-f28edf1fd981 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:17.029885 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-00b55208-4414-4de0-801b-fbe06f7f7564 req-a022b906-5cee-4f75-a6d3-f28edf1fd981 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:17.030708 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-00b55208-4414-4de0-801b-fbe06f7f7564 req-a022b906-5cee-4f75-a6d3-f28edf1fd981 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:17.062006 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-00b55208-4414-4de0-801b-fbe06f7f7564 req-a022b906-5cee-4f75-a6d3-f28edf1fd981 service nova] Creating event network-changed:6fea6402-4ea4-46cb-b608-a01b3e495aa0 for instance 58846d5b-1bfa-42cd-92a3-546b110ff64b on nch1-master-1 Oct 22 20:51:17.068050 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-00b55208-4414-4de0-801b-fbe06f7f7564 req-a022b906-5cee-4f75-a6d3-f28edf1fd981 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056272 Oct 22 20:51:17.068855 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 311/680] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:51:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:51:17.074506 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-15c69db9-c94b-471c-a585-526e5d4457c4 tempest-SecurityGroupsTestAdminJSON-147590501 tempest-SecurityGroupsTestAdminJSON-147590501-project] Action: 'create', calling method: .version_select at 0x7fd3a4753ca0>, body: {"security_group": {"name": "tempest-securitygroup-1474896507", "description": "tempest-description-698376370"}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:51:17.204518 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-96628abb-a9f2-43d7-a463-0ca766473ded tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c87f0356ca346f39c6216393d85da2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee8c8f7fc4e12bc1f9fcce3e7b581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:51:17.228100 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-96628abb-a9f2-43d7-a463-0ca766473ded tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] 10.222.0.18 "GET /compute/v2.1/servers/fe83cd49-4ceb-49aa-a775-cc2a4229fd76" status: 200 len: 1503 microversion: 2.1 time: 0.401932 Oct 22 20:51:17.244371 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 370/681] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:51:16 2022] GET /compute/v2.1/servers/fe83cd49-4ceb-49aa-a775-cc2a4229fd76 => generated 1503 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:51:17.250532 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-525ed003-ee98-448e-adef-fd24ce97145b req-0586b7b9-ab74-4735-9eff-b3629c620bc1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c475672d-99ba-4c6a-abaa-3332a392534d", "tag": "5a48f24d-ee6f-4bfc-9d60-4db767fe6dbd"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:51:17.261509 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-525ed003-ee98-448e-adef-fd24ce97145b req-0586b7b9-ab74-4735-9eff-b3629c620bc1 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:17.262393 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-525ed003-ee98-448e-adef-fd24ce97145b req-0586b7b9-ab74-4735-9eff-b3629c620bc1 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:17.263483 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-525ed003-ee98-448e-adef-fd24ce97145b req-0586b7b9-ab74-4735-9eff-b3629c620bc1 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:17.278046 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-525ed003-ee98-448e-adef-fd24ce97145b req-0586b7b9-ab74-4735-9eff-b3629c620bc1 service nova] Creating event network-changed:5a48f24d-ee6f-4bfc-9d60-4db767fe6dbd for instance c475672d-99ba-4c6a-abaa-3332a392534d on nch1-master-1 Oct 22 20:51:17.283655 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-525ed003-ee98-448e-adef-fd24ce97145b req-0586b7b9-ab74-4735-9eff-b3629c620bc1 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037497 Oct 22 20:51:17.285405 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 371/682] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:51:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:51:17.291787 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-cbe46094-be3d-47a0-9e33-55276b084009 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:51:17.293119 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-cbe46094-be3d-47a0-9e33-55276b084009 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] [instance: 4c7b99a9-2ec4-4f4b-98e7-8e1ea2103735] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:51:17.378819 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-cbe46094-be3d-47a0-9e33-55276b084009 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:51:17.388534 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-cbe46094-be3d-47a0-9e33-55276b084009 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:51:17.391919 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-cbe46094-be3d-47a0-9e33-55276b084009 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:51:17.394130 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-cbe46094-be3d-47a0-9e33-55276b084009 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] 10.222.0.18 "GET /compute/v2.1/servers/4c7b99a9-2ec4-4f4b-98e7-8e1ea2103735" status: 200 len: 1284 microversion: 2.25 time: 0.106610 Oct 22 20:51:17.399992 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 372/683] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 20:51:17 2022] GET /compute/v2.1/servers/4c7b99a9-2ec4-4f4b-98e7-8e1ea2103735 => generated 1284 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 20:51:17.476011 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-15c69db9-c94b-471c-a585-526e5d4457c4 tempest-SecurityGroupsTestAdminJSON-147590501 tempest-SecurityGroupsTestAdminJSON-147590501-project] 10.222.0.18 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 0.405671 Oct 22 20:51:17.486251 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 312/684] 10.222.0.18 () {60 vars in 1180 bytes} [Sat Oct 22 20:51:17 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:51:17.551617 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-07f5c8eb-3ecc-4028-8f4c-b7b8d12f744b tempest-SecurityGroupsTestAdminJSON-1406491783 tempest-SecurityGroupsTestAdminJSON-1406491783-project-admin] Action: 'create', calling method: .version_select at 0x7fd3a4a3b040>, body: {"security_group": {"name": "tempest-securitygroup-1727764662", "description": "tempest-description-109211833"}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:51:17.758356 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-140ff657-a7ff-4fe4-ad75-623e600f1fd6 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:51:17.759777 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-140ff657-a7ff-4fe4-ad75-623e600f1fd6 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] [instance: 0923f68f-d334-4133-824a-7830b65acc28] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:51:17.768540 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-140ff657-a7ff-4fe4-ad75-623e600f1fd6 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:17.769315 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-140ff657-a7ff-4fe4-ad75-623e600f1fd6 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:17.770414 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-140ff657-a7ff-4fe4-ad75-623e600f1fd6 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:17.771657 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-140ff657-a7ff-4fe4-ad75-623e600f1fd6 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:17.772480 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-140ff657-a7ff-4fe4-ad75-623e600f1fd6 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:17.773275 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-140ff657-a7ff-4fe4-ad75-623e600f1fd6 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:17.928304 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-07f5c8eb-3ecc-4028-8f4c-b7b8d12f744b tempest-SecurityGroupsTestAdminJSON-1406491783 tempest-SecurityGroupsTestAdminJSON-1406491783-project-admin] 10.222.0.18 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 0.441170 Oct 22 20:51:17.937766 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 373/685] 10.222.0.18 () {60 vars in 1180 bytes} [Sat Oct 22 20:51:17 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:51:17.944427 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-c0834693-7897-4297-9022-d1f795a272dd tempest-SecurityGroupsTestAdminJSON-1406491783 tempest-SecurityGroupsTestAdminJSON-1406491783-project-admin] Action: 'create', calling method: .version_select at 0x7fd3a4d6d9d0>, body: {"security_group": {"name": "tempest-securitygroup-1840324117", "description": "tempest-description-738004756"}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:51:18.012090 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-140ff657-a7ff-4fe4-ad75-623e600f1fd6 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91cf84a287b74618ae1b3368785b0b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902e239d67664098895ab24340b0b780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:51:18.029213 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-140ff657-a7ff-4fe4-ad75-623e600f1fd6 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] 10.222.0.18 "GET /compute/v2.1/servers/0923f68f-d334-4133-824a-7830b65acc28" status: 200 len: 1318 microversion: 2.1 time: 0.274845 Oct 22 20:51:18.032422 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 313/686] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:51:17 2022] GET /compute/v2.1/servers/0923f68f-d334-4133-824a-7830b65acc28 => generated 1318 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 20:51:18.047927 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-a3327c77-2e52-46af-a789-1d4357134dd6 tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:51:18.048454 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-a3327c77-2e52-46af-a789-1d4357134dd6 tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] [instance: 58846d5b-1bfa-42cd-92a3-546b110ff64b] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:51:18.063407 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a3327c77-2e52-46af-a789-1d4357134dd6 tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:18.063926 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a3327c77-2e52-46af-a789-1d4357134dd6 tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:18.064377 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a3327c77-2e52-46af-a789-1d4357134dd6 tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:18.065100 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a3327c77-2e52-46af-a789-1d4357134dd6 tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:18.065558 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a3327c77-2e52-46af-a789-1d4357134dd6 tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:18.065990 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a3327c77-2e52-46af-a789-1d4357134dd6 tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:18.605828 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-c0834693-7897-4297-9022-d1f795a272dd tempest-SecurityGroupsTestAdminJSON-1406491783 tempest-SecurityGroupsTestAdminJSON-1406491783-project-admin] 10.222.0.18 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 0.666418 Oct 22 20:51:18.607133 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 374/687] 10.222.0.18 () {60 vars in 1180 bytes} [Sat Oct 22 20:51:17 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:51:18.613194 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-d581d223-df50-4425-9567-e0f2dae5f568 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:51:18.613836 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-d581d223-df50-4425-9567-e0f2dae5f568 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] [instance: fe83cd49-4ceb-49aa-a775-cc2a4229fd76] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:51:18.621307 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d581d223-df50-4425-9567-e0f2dae5f568 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:18.621888 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d581d223-df50-4425-9567-e0f2dae5f568 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:18.622376 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d581d223-df50-4425-9567-e0f2dae5f568 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:18.623513 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d581d223-df50-4425-9567-e0f2dae5f568 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:18.623981 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d581d223-df50-4425-9567-e0f2dae5f568 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:18.624446 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d581d223-df50-4425-9567-e0f2dae5f568 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:18.772480 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-a3327c77-2e52-46af-a789-1d4357134dd6 tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da7143c3bfb46a7b193a8d96f1b75b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598f129979a34e7a856b83bd0e69f1b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:51:18.781743 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-a3327c77-2e52-46af-a789-1d4357134dd6 tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] 10.222.0.18 "GET /compute/v2.1/servers/58846d5b-1bfa-42cd-92a3-546b110ff64b" status: 200 len: 1292 microversion: 2.1 time: 0.748257 Oct 22 20:51:18.782840 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 314/688] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:51:18 2022] GET /compute/v2.1/servers/58846d5b-1bfa-42cd-92a3-546b110ff64b => generated 1292 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:51:18.787859 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-5b91a0fb-bdff-4448-807c-70afb43bd8cf tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:51:18.788681 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-5b91a0fb-bdff-4448-807c-70afb43bd8cf tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] [instance: 4c7b99a9-2ec4-4f4b-98e7-8e1ea2103735] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:51:18.794998 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5b91a0fb-bdff-4448-807c-70afb43bd8cf tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:18.795623 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5b91a0fb-bdff-4448-807c-70afb43bd8cf tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:18.796531 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5b91a0fb-bdff-4448-807c-70afb43bd8cf tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:18.797585 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5b91a0fb-bdff-4448-807c-70afb43bd8cf tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:18.798249 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5b91a0fb-bdff-4448-807c-70afb43bd8cf tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:18.798907 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5b91a0fb-bdff-4448-807c-70afb43bd8cf tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:18.858643 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-d581d223-df50-4425-9567-e0f2dae5f568 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c87f0356ca346f39c6216393d85da2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee8c8f7fc4e12bc1f9fcce3e7b581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:51:18.867035 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-d581d223-df50-4425-9567-e0f2dae5f568 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] 10.222.0.18 "GET /compute/v2.1/servers/fe83cd49-4ceb-49aa-a775-cc2a4229fd76" status: 200 len: 1503 microversion: 2.1 time: 0.258534 Oct 22 20:51:18.867632 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 375/689] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:51:18 2022] GET /compute/v2.1/servers/fe83cd49-4ceb-49aa-a775-cc2a4229fd76 => generated 1503 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:51:18.873470 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-5e9bcb2f-483d-43ef-97ad-8393fbfec398 tempest-SecurityGroupsTestAdminJSON-1406491783 tempest-SecurityGroupsTestAdminJSON-1406491783-project-admin] Calling method '.version_select at 0x7fd3a4786940>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:51:18.883167 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-5b91a0fb-bdff-4448-807c-70afb43bd8cf tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:51:18.892728 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-5b91a0fb-bdff-4448-807c-70afb43bd8cf tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:51:18.894272 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-5b91a0fb-bdff-4448-807c-70afb43bd8cf tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:51:18.895477 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-5b91a0fb-bdff-4448-807c-70afb43bd8cf tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] 10.222.0.18 "GET /compute/v2.1/servers/4c7b99a9-2ec4-4f4b-98e7-8e1ea2103735" status: 200 len: 1336 microversion: 2.25 time: 0.111297 Oct 22 20:51:18.896115 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 315/690] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 20:51:18 2022] GET /compute/v2.1/servers/4c7b99a9-2ec4-4f4b-98e7-8e1ea2103735 => generated 1336 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 20:51:18.900802 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-cd49a363-7073-429b-9fc3-fa78ab4fa12d req-75308a96-5b6a-480b-86b4-1e4948dc9df3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d992dc02-b690-452b-aaf2-1473b69a75cb", "name": "network-vif-plugged", "status": "completed", "tag": "dd91ec1a-3d89-46f1-b7e7-fe796a7b20b7"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:51:18.910648 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-cd49a363-7073-429b-9fc3-fa78ab4fa12d req-75308a96-5b6a-480b-86b4-1e4948dc9df3 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:18.911945 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-cd49a363-7073-429b-9fc3-fa78ab4fa12d req-75308a96-5b6a-480b-86b4-1e4948dc9df3 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:18.912462 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-cd49a363-7073-429b-9fc3-fa78ab4fa12d req-75308a96-5b6a-480b-86b4-1e4948dc9df3 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:18.924059 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-cd49a363-7073-429b-9fc3-fa78ab4fa12d req-75308a96-5b6a-480b-86b4-1e4948dc9df3 service nova] Creating event network-vif-plugged:dd91ec1a-3d89-46f1-b7e7-fe796a7b20b7 for instance d992dc02-b690-452b-aaf2-1473b69a75cb on nch2-master-1 Oct 22 20:51:18.929058 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-cd49a363-7073-429b-9fc3-fa78ab4fa12d req-75308a96-5b6a-480b-86b4-1e4948dc9df3 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031567 Oct 22 20:51:18.929682 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 316/691] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:51:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:51:19.061240 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-d1193d0c-3e3e-4599-9e6f-07cf453d0943 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:51:19.063762 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-d1193d0c-3e3e-4599-9e6f-07cf453d0943 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] [instance: 0923f68f-d334-4133-824a-7830b65acc28] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:51:19.073156 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d1193d0c-3e3e-4599-9e6f-07cf453d0943 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:19.073971 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d1193d0c-3e3e-4599-9e6f-07cf453d0943 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:19.074972 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d1193d0c-3e3e-4599-9e6f-07cf453d0943 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:19.076038 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d1193d0c-3e3e-4599-9e6f-07cf453d0943 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:19.076697 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d1193d0c-3e3e-4599-9e6f-07cf453d0943 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:19.077330 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d1193d0c-3e3e-4599-9e6f-07cf453d0943 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:19.337796 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-d1193d0c-3e3e-4599-9e6f-07cf453d0943 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91cf84a287b74618ae1b3368785b0b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902e239d67664098895ab24340b0b780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:51:19.346475 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-d1193d0c-3e3e-4599-9e6f-07cf453d0943 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] 10.222.0.18 "GET /compute/v2.1/servers/0923f68f-d334-4133-824a-7830b65acc28" status: 200 len: 1468 microversion: 2.1 time: 0.291164 Oct 22 20:51:19.347092 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 317/692] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:51:19 2022] GET /compute/v2.1/servers/0923f68f-d334-4133-824a-7830b65acc28 => generated 1468 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 20:51:19.352214 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-37afa615-df8c-4a99-927d-15b5ce532b84 req-c825a6dc-0404-4d4e-8857-c266ccdbdacc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe83cd49-4ceb-49aa-a775-cc2a4229fd76", "name": "network-vif-unplugged", "status": "completed", "tag": "5f1c98e3-36fa-4e76-8bc6-b184fe0c58b3"}, {"name": "network-changed", "server_uuid": "fe83cd49-4ceb-49aa-a775-cc2a4229fd76", "tag": "5f1c98e3-36fa-4e76-8bc6-b184fe0c58b3"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:51:19.362111 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-37afa615-df8c-4a99-927d-15b5ce532b84 req-c825a6dc-0404-4d4e-8857-c266ccdbdacc service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:19.362615 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-37afa615-df8c-4a99-927d-15b5ce532b84 req-c825a6dc-0404-4d4e-8857-c266ccdbdacc service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:19.363051 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-37afa615-df8c-4a99-927d-15b5ce532b84 req-c825a6dc-0404-4d4e-8857-c266ccdbdacc service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:19.377322 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-37afa615-df8c-4a99-927d-15b5ce532b84 req-c825a6dc-0404-4d4e-8857-c266ccdbdacc service nova] Creating event network-vif-unplugged:5f1c98e3-36fa-4e76-8bc6-b184fe0c58b3 for instance fe83cd49-4ceb-49aa-a775-cc2a4229fd76 on nch2-master-1 Oct 22 20:51:19.377881 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-37afa615-df8c-4a99-927d-15b5ce532b84 req-c825a6dc-0404-4d4e-8857-c266ccdbdacc service nova] Creating event network-changed:5f1c98e3-36fa-4e76-8bc6-b184fe0c58b3 for instance fe83cd49-4ceb-49aa-a775-cc2a4229fd76 on nch2-master-1 Oct 22 20:51:19.383749 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-37afa615-df8c-4a99-927d-15b5ce532b84 req-c825a6dc-0404-4d4e-8857-c266ccdbdacc service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.035453 Oct 22 20:51:19.384789 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 318/693] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:51:19 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:51:19.390065 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-91e521cc-4411-4975-9c9d-53dfd4e4f7fa tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:51:19.390883 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-91e521cc-4411-4975-9c9d-53dfd4e4f7fa tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] [instance: d992dc02-b690-452b-aaf2-1473b69a75cb] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:51:19.412484 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-91e521cc-4411-4975-9c9d-53dfd4e4f7fa tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:19.412722 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-91e521cc-4411-4975-9c9d-53dfd4e4f7fa tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:19.413061 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-91e521cc-4411-4975-9c9d-53dfd4e4f7fa tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:19.413792 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-91e521cc-4411-4975-9c9d-53dfd4e4f7fa tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:19.414255 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-91e521cc-4411-4975-9c9d-53dfd4e4f7fa tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:19.414707 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-91e521cc-4411-4975-9c9d-53dfd4e4f7fa tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:19.650057 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-91e521cc-4411-4975-9c9d-53dfd4e4f7fa tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91cf84a287b74618ae1b3368785b0b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902e239d67664098895ab24340b0b780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:51:19.672553 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-91e521cc-4411-4975-9c9d-53dfd4e4f7fa tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] 10.222.0.18 "GET /compute/v2.1/servers/d992dc02-b690-452b-aaf2-1473b69a75cb" status: 200 len: 1318 microversion: 2.1 time: 0.286245 Oct 22 20:51:19.673689 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 319/694] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:51:19 2022] GET /compute/v2.1/servers/d992dc02-b690-452b-aaf2-1473b69a75cb => generated 1318 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:51:19.806033 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-66ab38b3-31da-4413-8b1f-9083e71d65a5 tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:51:19.807547 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-66ab38b3-31da-4413-8b1f-9083e71d65a5 tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] [instance: 58846d5b-1bfa-42cd-92a3-546b110ff64b] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:51:19.815033 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-66ab38b3-31da-4413-8b1f-9083e71d65a5 tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:19.815887 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-66ab38b3-31da-4413-8b1f-9083e71d65a5 tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:19.816329 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-66ab38b3-31da-4413-8b1f-9083e71d65a5 tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:19.817352 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-66ab38b3-31da-4413-8b1f-9083e71d65a5 tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:19.818043 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-66ab38b3-31da-4413-8b1f-9083e71d65a5 tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:19.818683 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-66ab38b3-31da-4413-8b1f-9083e71d65a5 tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:20.011932 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-66ab38b3-31da-4413-8b1f-9083e71d65a5 tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da7143c3bfb46a7b193a8d96f1b75b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598f129979a34e7a856b83bd0e69f1b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:51:20.020846 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-66ab38b3-31da-4413-8b1f-9083e71d65a5 tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] 10.222.0.18 "GET /compute/v2.1/servers/58846d5b-1bfa-42cd-92a3-546b110ff64b" status: 200 len: 1292 microversion: 2.1 time: 0.218793 Oct 22 20:51:20.021405 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 320/695] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:51:19 2022] GET /compute/v2.1/servers/58846d5b-1bfa-42cd-92a3-546b110ff64b => generated 1292 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:51:20.041469 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-75722d15-0ca5-4ece-a132-3a718784935c tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:51:20.042300 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-75722d15-0ca5-4ece-a132-3a718784935c tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] [instance: fe83cd49-4ceb-49aa-a775-cc2a4229fd76] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:51:20.048800 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-75722d15-0ca5-4ece-a132-3a718784935c tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:20.049300 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-75722d15-0ca5-4ece-a132-3a718784935c tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:20.049722 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-75722d15-0ca5-4ece-a132-3a718784935c tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:20.051368 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-75722d15-0ca5-4ece-a132-3a718784935c tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:20.051368 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-75722d15-0ca5-4ece-a132-3a718784935c tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:20.051368 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-75722d15-0ca5-4ece-a132-3a718784935c tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:20.237275 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-75722d15-0ca5-4ece-a132-3a718784935c tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c87f0356ca346f39c6216393d85da2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee8c8f7fc4e12bc1f9fcce3e7b581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:51:20.252820 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-75722d15-0ca5-4ece-a132-3a718784935c tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] 10.222.0.18 "GET /compute/v2.1/servers/fe83cd49-4ceb-49aa-a775-cc2a4229fd76" status: 200 len: 1503 microversion: 2.1 time: 0.214729 Oct 22 20:51:20.260480 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 321/696] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:51:20 2022] GET /compute/v2.1/servers/fe83cd49-4ceb-49aa-a775-cc2a4229fd76 => generated 1503 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:51:20.267267 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-25221ca0-06fd-4a38-be51-df9315ac7c4b tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:51:20.268146 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-25221ca0-06fd-4a38-be51-df9315ac7c4b tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] [instance: 4c7b99a9-2ec4-4f4b-98e7-8e1ea2103735] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:51:20.274972 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-25221ca0-06fd-4a38-be51-df9315ac7c4b tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:20.275808 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-25221ca0-06fd-4a38-be51-df9315ac7c4b tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:20.276686 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-25221ca0-06fd-4a38-be51-df9315ac7c4b tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:20.277900 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-25221ca0-06fd-4a38-be51-df9315ac7c4b tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:20.278574 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-25221ca0-06fd-4a38-be51-df9315ac7c4b tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:20.279116 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-25221ca0-06fd-4a38-be51-df9315ac7c4b tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:20.532822 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-25221ca0-06fd-4a38-be51-df9315ac7c4b tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:51:20.542853 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-25221ca0-06fd-4a38-be51-df9315ac7c4b tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:51:20.544782 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-25221ca0-06fd-4a38-be51-df9315ac7c4b tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:51:20.547225 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-25221ca0-06fd-4a38-be51-df9315ac7c4b tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] 10.222.0.18 "GET /compute/v2.1/servers/4c7b99a9-2ec4-4f4b-98e7-8e1ea2103735" status: 200 len: 1410 microversion: 2.25 time: 0.285452 Oct 22 20:51:20.548101 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 322/697] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 20:51:20 2022] GET /compute/v2.1/servers/4c7b99a9-2ec4-4f4b-98e7-8e1ea2103735 => generated 1410 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 20:51:20.696094 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-70b3341f-a73b-43fc-b636-ba983512fdba tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:51:20.696703 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-70b3341f-a73b-43fc-b636-ba983512fdba tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] [instance: d992dc02-b690-452b-aaf2-1473b69a75cb] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:51:20.702639 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-70b3341f-a73b-43fc-b636-ba983512fdba tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:20.703411 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-70b3341f-a73b-43fc-b636-ba983512fdba tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:20.703853 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-70b3341f-a73b-43fc-b636-ba983512fdba tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:20.704551 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-70b3341f-a73b-43fc-b636-ba983512fdba tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:20.705004 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-70b3341f-a73b-43fc-b636-ba983512fdba tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:20.705433 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-70b3341f-a73b-43fc-b636-ba983512fdba tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:20.891739 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-70b3341f-a73b-43fc-b636-ba983512fdba tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91cf84a287b74618ae1b3368785b0b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902e239d67664098895ab24340b0b780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:51:20.900028 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-70b3341f-a73b-43fc-b636-ba983512fdba tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] 10.222.0.18 "GET /compute/v2.1/servers/d992dc02-b690-452b-aaf2-1473b69a75cb" status: 200 len: 1467 microversion: 2.1 time: 0.207882 Oct 22 20:51:20.900605 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 323/698] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:51:20 2022] GET /compute/v2.1/servers/d992dc02-b690-452b-aaf2-1473b69a75cb => generated 1467 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 20:51:20.923911 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-7cb29094-a6ec-4634-a285-48033ae3e973 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:51:20.929171 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-7cb29094-a6ec-4634-a285-48033ae3e973 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '91cf84a287b74618ae1b3368785b0b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902e239d67664098895ab24340b0b780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:51:20.930075 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-7cb29094-a6ec-4634-a285-48033ae3e973 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Searching by: {'reservation_id': 'r-q00te0bv', 'deleted': False, 'project_id': '902e239d67664098895ab24340b0b780'} {{(pid=138744) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 22 20:51:20.936361 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7cb29094-a6ec-4634-a285-48033ae3e973 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:20.936840 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7cb29094-a6ec-4634-a285-48033ae3e973 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:20.937379 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7cb29094-a6ec-4634-a285-48033ae3e973 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:20.938099 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7cb29094-a6ec-4634-a285-48033ae3e973 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:20.938558 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7cb29094-a6ec-4634-a285-48033ae3e973 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:20.938977 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7cb29094-a6ec-4634-a285-48033ae3e973 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:20.968938 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell0:SELECT=17 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:51:21.082576 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.multi_cell_list [None req-7cb29094-a6ec-4634-a285-48033ae3e973 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=138744) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 22 20:51:21.158787 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-7cb29094-a6ec-4634-a285-48033ae3e973 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91cf84a287b74618ae1b3368785b0b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902e239d67664098895ab24340b0b780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:51:21.165620 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7cb29094-a6ec-4634-a285-48033ae3e973 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:21.166095 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7cb29094-a6ec-4634-a285-48033ae3e973 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:21.166522 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7cb29094-a6ec-4634-a285-48033ae3e973 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:21.349173 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-7cb29094-a6ec-4634-a285-48033ae3e973 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] 10.222.0.18 "GET /compute/v2.1/servers/detail?reservation_id=r-q00te0bv" status: 200 len: 2928 microversion: 2.1 time: 0.430520 Oct 22 20:51:21.362032 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 324/699] 10.222.0.18 () {58 vars in 1197 bytes} [Sat Oct 22 20:51:20 2022] GET /compute/v2.1/servers/detail?reservation_id=r-q00te0bv => generated 2928 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:51:21.366245 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-1a5ef9c0-767a-4c04-b6f1-66f90adc92fd tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:51:21.366867 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-1a5ef9c0-767a-4c04-b6f1-66f90adc92fd tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] [instance: 58846d5b-1bfa-42cd-92a3-546b110ff64b] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:51:21.374323 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1a5ef9c0-767a-4c04-b6f1-66f90adc92fd tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:21.374811 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1a5ef9c0-767a-4c04-b6f1-66f90adc92fd tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:21.375469 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1a5ef9c0-767a-4c04-b6f1-66f90adc92fd tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:21.376190 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1a5ef9c0-767a-4c04-b6f1-66f90adc92fd tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:21.376640 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1a5ef9c0-767a-4c04-b6f1-66f90adc92fd tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:21.377243 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1a5ef9c0-767a-4c04-b6f1-66f90adc92fd tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:21.566137 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-1a5ef9c0-767a-4c04-b6f1-66f90adc92fd tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da7143c3bfb46a7b193a8d96f1b75b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598f129979a34e7a856b83bd0e69f1b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:51:21.575136 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-1a5ef9c0-767a-4c04-b6f1-66f90adc92fd tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] 10.222.0.18 "GET /compute/v2.1/servers/58846d5b-1bfa-42cd-92a3-546b110ff64b" status: 200 len: 1292 microversion: 2.1 time: 0.223845 Oct 22 20:51:21.587369 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 325/700] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:51:21 2022] GET /compute/v2.1/servers/58846d5b-1bfa-42cd-92a3-546b110ff64b => generated 1292 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:51:21.587369 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-989c7506-c795-41d9-bda1-a4d764dfe012 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:51:21.587369 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-989c7506-c795-41d9-bda1-a4d764dfe012 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] [instance: fe83cd49-4ceb-49aa-a775-cc2a4229fd76] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:51:21.587987 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-989c7506-c795-41d9-bda1-a4d764dfe012 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:21.588570 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-989c7506-c795-41d9-bda1-a4d764dfe012 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:21.591425 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-989c7506-c795-41d9-bda1-a4d764dfe012 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:21.591425 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-989c7506-c795-41d9-bda1-a4d764dfe012 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:21.591425 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-989c7506-c795-41d9-bda1-a4d764dfe012 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:21.591425 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-989c7506-c795-41d9-bda1-a4d764dfe012 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:21.779308 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-989c7506-c795-41d9-bda1-a4d764dfe012 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c87f0356ca346f39c6216393d85da2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee8c8f7fc4e12bc1f9fcce3e7b581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:51:21.787859 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-989c7506-c795-41d9-bda1-a4d764dfe012 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] 10.222.0.18 "GET /compute/v2.1/servers/fe83cd49-4ceb-49aa-a775-cc2a4229fd76" status: 200 len: 1503 microversion: 2.1 time: 0.210835 Oct 22 20:51:21.788475 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 326/701] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:51:21 2022] GET /compute/v2.1/servers/fe83cd49-4ceb-49aa-a775-cc2a4229fd76 => generated 1503 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:51:21.793697 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-b6cf65d9-aa60-45f4-9c17-f743fb8aa01f tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:51:21.799694 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-5e9bcb2f-483d-43ef-97ad-8393fbfec398 tempest-SecurityGroupsTestAdminJSON-1406491783 tempest-SecurityGroupsTestAdminJSON-1406491783-project-admin] 10.222.0.18 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 16279 microversion: 2.1 time: 2.930713 Oct 22 20:51:21.800648 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 376/702] 10.222.0.18 () {58 vars in 1191 bytes} [Sat Oct 22 20:51:18 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 16279 bytes in 2932 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 22 20:51:21.805003 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-b4f8d888-617a-4407-8035-67b9fd25a211 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:51:21.805723 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-b4f8d888-617a-4407-8035-67b9fd25a211 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] [instance: 4c7b99a9-2ec4-4f4b-98e7-8e1ea2103735] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:51:21.813981 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b4f8d888-617a-4407-8035-67b9fd25a211 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:21.814487 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b4f8d888-617a-4407-8035-67b9fd25a211 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:21.814929 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b4f8d888-617a-4407-8035-67b9fd25a211 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:21.815689 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b4f8d888-617a-4407-8035-67b9fd25a211 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:21.816147 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b4f8d888-617a-4407-8035-67b9fd25a211 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:21.816581 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b4f8d888-617a-4407-8035-67b9fd25a211 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:21.821848 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.compute.server_groups [None req-b6cf65d9-aa60-45f4-9c17-f743fb8aa01f tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Querying cell 5972cb63-1ab7-4825-b0ae-86c7acab764c(cell1) for 2 instances {{(pid=138744) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 22 20:51:21.822517 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b6cf65d9-aa60-45f4-9c17-f743fb8aa01f tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:21.822989 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b6cf65d9-aa60-45f4-9c17-f743fb8aa01f tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:21.823449 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b6cf65d9-aa60-45f4-9c17-f743fb8aa01f tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:21.853547 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-b6cf65d9-aa60-45f4-9c17-f743fb8aa01f tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] 10.222.0.18 "GET /compute/v2.1/os-server-groups/83091a39-89dc-40c4-ae59-edcc55a4b24d" status: 200 len: 266 microversion: 2.1 time: 0.063318 Oct 22 20:51:21.854130 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 327/703] 10.222.0.18 () {58 vars in 1263 bytes} [Sat Oct 22 20:51:21 2022] GET /compute/v2.1/os-server-groups/83091a39-89dc-40c4-ae59-edcc55a4b24d => generated 266 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:51:21.859381 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-b97d36f0-bc5f-41c4-b7f8-8b9ab06facf0 tempest-SecurityGroupsTestAdminJSON-147590501 tempest-SecurityGroupsTestAdminJSON-147590501-project] Calling method '.version_select at 0x7fd3a43abe50>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:51:22.009376 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-b4f8d888-617a-4407-8035-67b9fd25a211 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:51:22.025146 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-b4f8d888-617a-4407-8035-67b9fd25a211 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:51:22.026916 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-b4f8d888-617a-4407-8035-67b9fd25a211 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:51:22.028731 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-b4f8d888-617a-4407-8035-67b9fd25a211 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] 10.222.0.18 "GET /compute/v2.1/servers/4c7b99a9-2ec4-4f4b-98e7-8e1ea2103735" status: 200 len: 1410 microversion: 2.25 time: 0.227249 Oct 22 20:51:22.029491 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 377/704] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 20:51:21 2022] GET /compute/v2.1/servers/4c7b99a9-2ec4-4f4b-98e7-8e1ea2103735 => generated 1410 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 20:51:22.034364 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-fcf52033-6801-4386-a576-06869fe6e76c tempest-ServersOnMultiNodesTest-1015080240 tempest-ServersOnMultiNodesTest-1015080240-project-admin] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:51:22.035237 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-fcf52033-6801-4386-a576-06869fe6e76c tempest-ServersOnMultiNodesTest-1015080240 tempest-ServersOnMultiNodesTest-1015080240-project-admin] [instance: 0923f68f-d334-4133-824a-7830b65acc28] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:51:22.043659 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fcf52033-6801-4386-a576-06869fe6e76c tempest-ServersOnMultiNodesTest-1015080240 tempest-ServersOnMultiNodesTest-1015080240-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:22.044616 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fcf52033-6801-4386-a576-06869fe6e76c tempest-ServersOnMultiNodesTest-1015080240 tempest-ServersOnMultiNodesTest-1015080240-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:22.045078 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fcf52033-6801-4386-a576-06869fe6e76c tempest-ServersOnMultiNodesTest-1015080240 tempest-ServersOnMultiNodesTest-1015080240-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:22.046254 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fcf52033-6801-4386-a576-06869fe6e76c tempest-ServersOnMultiNodesTest-1015080240 tempest-ServersOnMultiNodesTest-1015080240-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:22.046786 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fcf52033-6801-4386-a576-06869fe6e76c tempest-ServersOnMultiNodesTest-1015080240 tempest-ServersOnMultiNodesTest-1015080240-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:22.047223 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fcf52033-6801-4386-a576-06869fe6e76c tempest-ServersOnMultiNodesTest-1015080240 tempest-ServersOnMultiNodesTest-1015080240-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:22.122981 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-b97d36f0-bc5f-41c4-b7f8-8b9ab06facf0 tempest-SecurityGroupsTestAdminJSON-147590501 tempest-SecurityGroupsTestAdminJSON-147590501-project] 10.222.0.18 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 1110 microversion: 2.1 time: 0.267751 Oct 22 20:51:22.123616 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 328/705] 10.222.0.18 () {58 vars in 1191 bytes} [Sat Oct 22 20:51:21 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 1110 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:51:22.141812 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-2cf61fd1-a34a-4e55-b582-aedb260a73b4 tempest-SecurityGroupsTestAdminJSON-1406491783 tempest-SecurityGroupsTestAdminJSON-1406491783-project-admin] Calling method '.version_select at 0x7fd3a436f940>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:51:22.245624 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-fcf52033-6801-4386-a576-06869fe6e76c tempest-ServersOnMultiNodesTest-1015080240 tempest-ServersOnMultiNodesTest-1015080240-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/0923f68f-d334-4133-824a-7830b65acc28" status: 200 len: 1619 microversion: 2.1 time: 0.214882 Oct 22 20:51:22.255857 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 378/706] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:51:22 2022] GET /compute/v2.1/servers/0923f68f-d334-4133-824a-7830b65acc28 => generated 1619 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:51:22.272304 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-7c44afab-6c64-41f6-9bfc-9654e40da3db tempest-ServersOnMultiNodesTest-1015080240 tempest-ServersOnMultiNodesTest-1015080240-project-admin] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:51:22.273170 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-7c44afab-6c64-41f6-9bfc-9654e40da3db tempest-ServersOnMultiNodesTest-1015080240 tempest-ServersOnMultiNodesTest-1015080240-project-admin] [instance: d992dc02-b690-452b-aaf2-1473b69a75cb] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:51:22.281559 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7c44afab-6c64-41f6-9bfc-9654e40da3db tempest-ServersOnMultiNodesTest-1015080240 tempest-ServersOnMultiNodesTest-1015080240-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:22.282068 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7c44afab-6c64-41f6-9bfc-9654e40da3db tempest-ServersOnMultiNodesTest-1015080240 tempest-ServersOnMultiNodesTest-1015080240-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:22.282646 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7c44afab-6c64-41f6-9bfc-9654e40da3db tempest-ServersOnMultiNodesTest-1015080240 tempest-ServersOnMultiNodesTest-1015080240-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:22.283421 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7c44afab-6c64-41f6-9bfc-9654e40da3db tempest-ServersOnMultiNodesTest-1015080240 tempest-ServersOnMultiNodesTest-1015080240-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:22.284095 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7c44afab-6c64-41f6-9bfc-9654e40da3db tempest-ServersOnMultiNodesTest-1015080240 tempest-ServersOnMultiNodesTest-1015080240-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:22.284679 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7c44afab-6c64-41f6-9bfc-9654e40da3db tempest-ServersOnMultiNodesTest-1015080240 tempest-ServersOnMultiNodesTest-1015080240-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:22.374490 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-2cf61fd1-a34a-4e55-b582-aedb260a73b4 tempest-SecurityGroupsTestAdminJSON-1406491783 tempest-SecurityGroupsTestAdminJSON-1406491783-project-admin] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/51c0d3df-3407-4685-b240-bd9f9f4e1493" status: 202 len: 0 microversion: 2.1 time: 0.236915 Oct 22 20:51:22.386803 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 329/707] 10.222.0.18 () {58 vars in 1272 bytes} [Sat Oct 22 20:51:22 2022] DELETE /compute/v2.1/os-security-groups/51c0d3df-3407-4685-b240-bd9f9f4e1493 => generated 0 bytes in 252 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 20:51:22.396530 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-1482aeb4-a3d9-48f3-9bc9-5c7d3e759887 tempest-SecurityGroupsTestAdminJSON-1406491783 tempest-SecurityGroupsTestAdminJSON-1406491783-project-admin] Calling method '.version_select at 0x7fd3a43444c0>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:51:22.486920 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-7c44afab-6c64-41f6-9bfc-9654e40da3db tempest-ServersOnMultiNodesTest-1015080240 tempest-ServersOnMultiNodesTest-1015080240-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/d992dc02-b690-452b-aaf2-1473b69a75cb" status: 200 len: 1618 microversion: 2.1 time: 0.221663 Oct 22 20:51:22.500588 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 379/708] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:51:22 2022] GET /compute/v2.1/servers/d992dc02-b690-452b-aaf2-1473b69a75cb => generated 1618 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:51:22.516001 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-800b35ba-e93c-461d-940f-364375c932e4 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Action: 'create', calling method: .version_select at 0x7fd3a47e6670>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-1279561392", "policies": ["anti-affinity"]}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:51:22.536074 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-800b35ba-e93c-461d-940f-364375c932e4 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Getting quotas for project 902e239d67664098895ab24340b0b780. Resources: {'server_groups'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 20:51:22.542072 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-800b35ba-e93c-461d-940f-364375c932e4 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Getting quotas for user 91cf84a287b74618ae1b3368785b0b4c and project 902e239d67664098895ab24340b0b780. Resources: {'server_groups'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 20:51:22.596924 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-800b35ba-e93c-461d-940f-364375c932e4 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Getting quotas for project 902e239d67664098895ab24340b0b780. Resources: {'server_groups'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 20:51:22.603136 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-800b35ba-e93c-461d-940f-364375c932e4 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Getting quotas for user 91cf84a287b74618ae1b3368785b0b4c and project 902e239d67664098895ab24340b0b780. Resources: {'server_groups'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 20:51:22.613381 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-1482aeb4-a3d9-48f3-9bc9-5c7d3e759887 tempest-SecurityGroupsTestAdminJSON-1406491783 tempest-SecurityGroupsTestAdminJSON-1406491783-project-admin] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/05c7c8b5-375c-4ef2-8002-39dc04a606bc" status: 202 len: 0 microversion: 2.1 time: 0.225373 Oct 22 20:51:22.614470 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 330/709] 10.222.0.18 () {58 vars in 1272 bytes} [Sat Oct 22 20:51:22 2022] DELETE /compute/v2.1/os-security-groups/05c7c8b5-375c-4ef2-8002-39dc04a606bc => generated 0 bytes in 227 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 20:51:22.617683 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-800b35ba-e93c-461d-940f-364375c932e4 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] 10.222.0.18 "POST /compute/v2.1/os-server-groups" status: 200 len: 193 microversion: 2.1 time: 0.105521 Oct 22 20:51:22.617847 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 380/710] 10.222.0.18 () {60 vars in 1174 bytes} [Sat Oct 22 20:51:22 2022] POST /compute/v2.1/os-server-groups => generated 193 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:51:22.622568 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-6827ca61-4872-4176-a663-681e5dd72cd1 tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:51:22.623766 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-6827ca61-4872-4176-a663-681e5dd72cd1 tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] [instance: 58846d5b-1bfa-42cd-92a3-546b110ff64b] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:51:22.624727 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-1b98902f-8bee-4963-8179-79dd0d4f60e0 tempest-SecurityGroupsTestAdminJSON-147590501 tempest-SecurityGroupsTestAdminJSON-147590501-project] Calling method '.version_select at 0x7fd3a4248790>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:51:22.635714 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6827ca61-4872-4176-a663-681e5dd72cd1 tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:22.636480 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6827ca61-4872-4176-a663-681e5dd72cd1 tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:22.636981 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6827ca61-4872-4176-a663-681e5dd72cd1 tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:22.637788 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6827ca61-4872-4176-a663-681e5dd72cd1 tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:22.638301 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6827ca61-4872-4176-a663-681e5dd72cd1 tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:22.638830 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6827ca61-4872-4176-a663-681e5dd72cd1 tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:22.846024 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-6827ca61-4872-4176-a663-681e5dd72cd1 tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da7143c3bfb46a7b193a8d96f1b75b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598f129979a34e7a856b83bd0e69f1b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:51:22.854521 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-6827ca61-4872-4176-a663-681e5dd72cd1 tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] 10.222.0.18 "GET /compute/v2.1/servers/58846d5b-1bfa-42cd-92a3-546b110ff64b" status: 200 len: 1292 microversion: 2.1 time: 0.235421 Oct 22 20:51:22.855105 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 381/711] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:51:22 2022] GET /compute/v2.1/servers/58846d5b-1bfa-42cd-92a3-546b110ff64b => generated 1292 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:51:22.860199 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-0b6606a2-56cc-400a-993b-5749b6474e76 req-09fee81b-391a-4e5f-a7cf-1999bb89dce2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c7b99a9-2ec4-4f4b-98e7-8e1ea2103735", "tag": "54a65686-35c5-4655-a6b6-8d82393a2555"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:51:22.870381 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-0b6606a2-56cc-400a-993b-5749b6474e76 req-09fee81b-391a-4e5f-a7cf-1999bb89dce2 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:22.870851 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-0b6606a2-56cc-400a-993b-5749b6474e76 req-09fee81b-391a-4e5f-a7cf-1999bb89dce2 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:22.871275 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-0b6606a2-56cc-400a-993b-5749b6474e76 req-09fee81b-391a-4e5f-a7cf-1999bb89dce2 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:22.886010 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-0b6606a2-56cc-400a-993b-5749b6474e76 req-09fee81b-391a-4e5f-a7cf-1999bb89dce2 service nova] Creating event network-changed:54a65686-35c5-4655-a6b6-8d82393a2555 for instance 4c7b99a9-2ec4-4f4b-98e7-8e1ea2103735 on nch1-master-1 Oct 22 20:51:22.891981 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-0b6606a2-56cc-400a-993b-5749b6474e76 req-09fee81b-391a-4e5f-a7cf-1999bb89dce2 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035382 Oct 22 20:51:22.892881 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 382/712] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:51:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:51:22.898077 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-0cb68237-1857-41ad-81cc-eccdcf493891 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-357266439", "imageRef": "085e4478-6edc-4a69-8e08-f9831713eb65", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "c805829d-9330-44c4-abe6-ffa468507877"}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:51:22.938370 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-1b98902f-8bee-4963-8179-79dd0d4f60e0 tempest-SecurityGroupsTestAdminJSON-147590501 tempest-SecurityGroupsTestAdminJSON-147590501-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/ae577a87-3bee-47f5-a4f8-e02e416cefb2" status: 202 len: 0 microversion: 2.1 time: 0.318002 Oct 22 20:51:22.939621 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 331/713] 10.222.0.18 () {58 vars in 1272 bytes} [Sat Oct 22 20:51:22 2022] DELETE /compute/v2.1/os-security-groups/ae577a87-3bee-47f5-a4f8-e02e416cefb2 => generated 0 bytes in 320 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 20:51:22.951794 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-da30b0fb-83ef-446c-ae81-5d2533bdce19 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:51:22.953292 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-da30b0fb-83ef-446c-ae81-5d2533bdce19 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] [instance: fe83cd49-4ceb-49aa-a775-cc2a4229fd76] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:51:22.960014 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.network.neutron [None req-0cb68237-1857-41ad-81cc-eccdcf493891 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] validate_networks() for None {{(pid=138745) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 20:51:22.975761 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-da30b0fb-83ef-446c-ae81-5d2533bdce19 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:22.977750 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-da30b0fb-83ef-446c-ae81-5d2533bdce19 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:22.978345 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-da30b0fb-83ef-446c-ae81-5d2533bdce19 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:22.979569 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-da30b0fb-83ef-446c-ae81-5d2533bdce19 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:22.980047 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-da30b0fb-83ef-446c-ae81-5d2533bdce19 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:22.981853 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-da30b0fb-83ef-446c-ae81-5d2533bdce19 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:23.199659 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-da30b0fb-83ef-446c-ae81-5d2533bdce19 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c87f0356ca346f39c6216393d85da2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee8c8f7fc4e12bc1f9fcce3e7b581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:51:23.207820 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-da30b0fb-83ef-446c-ae81-5d2533bdce19 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] 10.222.0.18 "GET /compute/v2.1/servers/fe83cd49-4ceb-49aa-a775-cc2a4229fd76" status: 200 len: 1503 microversion: 2.1 time: 0.265877 Oct 22 20:51:23.208405 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 332/714] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:51:22 2022] GET /compute/v2.1/servers/fe83cd49-4ceb-49aa-a775-cc2a4229fd76 => generated 1503 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:51:23.212938 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-3bbfd31f-cfd5-4f9d-b2b2-eb0d6d2a1bf4 tempest-SecurityGroupsTestAdminJSON-147590501 tempest-SecurityGroupsTestAdminJSON-147590501-project] Calling method '.version_select at 0x7fd3a43abc10>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:51:23.268349 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-0cb68237-1857-41ad-81cc-eccdcf493891 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Flavor limits 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 20:51:23.268822 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-0cb68237-1857-41ad-81cc-eccdcf493891 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Image limits 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 20:51:23.269302 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-0cb68237-1857-41ad-81cc-eccdcf493891 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Flavor pref 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 20:51:23.269768 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-0cb68237-1857-41ad-81cc-eccdcf493891 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Image pref 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 20:51:23.270270 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-0cb68237-1857-41ad-81cc-eccdcf493891 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 20:51:23.287830 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0cb68237-1857-41ad-81cc-eccdcf493891 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:23.288316 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0cb68237-1857-41ad-81cc-eccdcf493891 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:23.288753 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0cb68237-1857-41ad-81cc-eccdcf493891 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:23.289474 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0cb68237-1857-41ad-81cc-eccdcf493891 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:23.289940 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0cb68237-1857-41ad-81cc-eccdcf493891 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:23.290361 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0cb68237-1857-41ad-81cc-eccdcf493891 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:23.308121 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-0cb68237-1857-41ad-81cc-eccdcf493891 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Getting quotas for project 902e239d67664098895ab24340b0b780. Resources: {'cores', 'instances', 'ram'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 20:51:23.313516 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-0cb68237-1857-41ad-81cc-eccdcf493891 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Getting quotas for user 91cf84a287b74618ae1b3368785b0b4c and project 902e239d67664098895ab24340b0b780. Resources: {'cores', 'instances', 'ram'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 20:51:23.327113 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-0cb68237-1857-41ad-81cc-eccdcf493891 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Going to run 2 instances... {{(pid=138745) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 20:51:23.329739 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-0cb68237-1857-41ad-81cc-eccdcf493891 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] [instance: 4ef975af-c582-4e7e-9913-e4be1688f81d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='085e4478-6edc-4a69-8e08-f9831713eb65',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138745) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 20:51:23.368692 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:51:23.380508 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-0cb68237-1857-41ad-81cc-eccdcf493891 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Getting quotas for project 902e239d67664098895ab24340b0b780. Resources: {'server_group_members'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 20:51:23.386116 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-0cb68237-1857-41ad-81cc-eccdcf493891 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Getting quotas for user 91cf84a287b74618ae1b3368785b0b4c and project 902e239d67664098895ab24340b0b780. Resources: {'server_group_members'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 20:51:23.418063 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-3bbfd31f-cfd5-4f9d-b2b2-eb0d6d2a1bf4 tempest-SecurityGroupsTestAdminJSON-147590501 tempest-SecurityGroupsTestAdminJSON-147590501-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/50a77d04-07a8-4e8b-9ea9-97e482b2f23d" status: 202 len: 0 microversion: 2.1 time: 0.208560 Oct 22 20:51:23.418731 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 333/715] 10.222.0.18 () {58 vars in 1272 bytes} [Sat Oct 22 20:51:23 2022] DELETE /compute/v2.1/os-security-groups/50a77d04-07a8-4e8b-9ea9-97e482b2f23d => generated 0 bytes in 210 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 20:51:23.426782 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-548c3929-655a-4e59-97e5-94a8f4bc51bf tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:51:23.427586 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-548c3929-655a-4e59-97e5-94a8f4bc51bf tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] [instance: 4c7b99a9-2ec4-4f4b-98e7-8e1ea2103735] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:51:23.430532 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-0cb68237-1857-41ad-81cc-eccdcf493891 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Getting quotas for project 902e239d67664098895ab24340b0b780. Resources: {'server_group_members'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 20:51:23.436338 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-548c3929-655a-4e59-97e5-94a8f4bc51bf tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:23.436692 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-548c3929-655a-4e59-97e5-94a8f4bc51bf tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:23.437275 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-548c3929-655a-4e59-97e5-94a8f4bc51bf tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:23.438869 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-0cb68237-1857-41ad-81cc-eccdcf493891 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Getting quotas for user 91cf84a287b74618ae1b3368785b0b4c and project 902e239d67664098895ab24340b0b780. Resources: {'server_group_members'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 20:51:23.451075 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-548c3929-655a-4e59-97e5-94a8f4bc51bf tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:23.453252 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-548c3929-655a-4e59-97e5-94a8f4bc51bf tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:23.454281 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-548c3929-655a-4e59-97e5-94a8f4bc51bf tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:23.455871 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-0cb68237-1857-41ad-81cc-eccdcf493891 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] [instance: c190c6e5-8b3b-4946-bb18-01fa5aba6fd2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='085e4478-6edc-4a69-8e08-f9831713eb65',instance=,instance_uuid=4ef975af-c582-4e7e-9913-e4be1688f81d,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138745) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 20:51:23.511905 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-0cb68237-1857-41ad-81cc-eccdcf493891 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Getting quotas for project 902e239d67664098895ab24340b0b780. Resources: {'server_group_members'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 20:51:23.517812 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-0cb68237-1857-41ad-81cc-eccdcf493891 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Getting quotas for user 91cf84a287b74618ae1b3368785b0b4c and project 902e239d67664098895ab24340b0b780. Resources: {'server_group_members'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 20:51:23.560281 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-0cb68237-1857-41ad-81cc-eccdcf493891 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Getting quotas for project 902e239d67664098895ab24340b0b780. Resources: {'server_group_members'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 20:51:23.567517 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-0cb68237-1857-41ad-81cc-eccdcf493891 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Getting quotas for user 91cf84a287b74618ae1b3368785b0b4c and project 902e239d67664098895ab24340b0b780. Resources: {'server_group_members'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 20:51:23.605067 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-0cb68237-1857-41ad-81cc-eccdcf493891 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 0.711091 Oct 22 20:51:23.606741 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-548c3929-655a-4e59-97e5-94a8f4bc51bf tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:51:23.609085 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 383/716] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Oct 22 20:51:22 2022] POST /compute/v2.1/servers => generated 32 bytes in 715 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Oct 22 20:51:23.613907 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-4ea8ed94-8c8c-4d72-b83f-c63ae8b57daf tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:51:23.616355 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-548c3929-655a-4e59-97e5-94a8f4bc51bf tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:51:23.619214 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-548c3929-655a-4e59-97e5-94a8f4bc51bf tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:51:23.619369 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-4ea8ed94-8c8c-4d72-b83f-c63ae8b57daf tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '91cf84a287b74618ae1b3368785b0b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902e239d67664098895ab24340b0b780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:51:23.620694 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-548c3929-655a-4e59-97e5-94a8f4bc51bf tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] 10.222.0.18 "GET /compute/v2.1/servers/4c7b99a9-2ec4-4f4b-98e7-8e1ea2103735" status: 200 len: 1410 microversion: 2.25 time: 0.200967 Oct 22 20:51:23.620831 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-4ea8ed94-8c8c-4d72-b83f-c63ae8b57daf tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Searching by: {'deleted': False, 'project_id': '902e239d67664098895ab24340b0b780'} {{(pid=138745) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 22 20:51:23.621765 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 334/717] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 20:51:23 2022] GET /compute/v2.1/servers/4c7b99a9-2ec4-4f4b-98e7-8e1ea2103735 => generated 1410 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 20:51:23.649996 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4ea8ed94-8c8c-4d72-b83f-c63ae8b57daf tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:23.651120 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4ea8ed94-8c8c-4d72-b83f-c63ae8b57daf tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:23.651254 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4ea8ed94-8c8c-4d72-b83f-c63ae8b57daf tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:23.652342 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4ea8ed94-8c8c-4d72-b83f-c63ae8b57daf tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:23.652869 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4ea8ed94-8c8c-4d72-b83f-c63ae8b57daf tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:23.653364 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4ea8ed94-8c8c-4d72-b83f-c63ae8b57daf tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:23.779306 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.multi_cell_list [None req-4ea8ed94-8c8c-4d72-b83f-c63ae8b57daf tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Listed batch of 3 results from cell out of 998 limit. Returned 3 total so far. {{(pid=138745) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 22 20:51:23.878998 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-877e9c8d-f5b7-4a0f-a3b2-3cd4c6eeeb5f tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:51:23.880398 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-877e9c8d-f5b7-4a0f-a3b2-3cd4c6eeeb5f tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] [instance: 58846d5b-1bfa-42cd-92a3-546b110ff64b] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:51:23.888192 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-877e9c8d-f5b7-4a0f-a3b2-3cd4c6eeeb5f tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:23.888783 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-877e9c8d-f5b7-4a0f-a3b2-3cd4c6eeeb5f tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:23.889314 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-877e9c8d-f5b7-4a0f-a3b2-3cd4c6eeeb5f tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:23.890380 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-877e9c8d-f5b7-4a0f-a3b2-3cd4c6eeeb5f tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:23.891006 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-877e9c8d-f5b7-4a0f-a3b2-3cd4c6eeeb5f tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:23.891563 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-877e9c8d-f5b7-4a0f-a3b2-3cd4c6eeeb5f tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:23.899176 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:SELECT=100 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:51:23.914192 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-4ea8ed94-8c8c-4d72-b83f-c63ae8b57daf tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] 10.222.0.18 "GET /compute/v2.1/servers" status: 200 len: 1662 microversion: 2.1 time: 0.303839 Oct 22 20:51:23.919502 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 384/718] 10.222.0.18 () {58 vars in 1125 bytes} [Sat Oct 22 20:51:23 2022] GET /compute/v2.1/servers => generated 1662 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:51:23.931485 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-59f60d6d-e3cb-407a-bbae-4d881d80069a tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:51:23.932252 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-59f60d6d-e3cb-407a-bbae-4d881d80069a tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] [instance: c190c6e5-8b3b-4946-bb18-01fa5aba6fd2] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:51:24.027806 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-59f60d6d-e3cb-407a-bbae-4d881d80069a tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91cf84a287b74618ae1b3368785b0b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902e239d67664098895ab24340b0b780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:51:24.036261 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-59f60d6d-e3cb-407a-bbae-4d881d80069a tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] 10.222.0.18 "GET /compute/v2.1/servers/c190c6e5-8b3b-4946-bb18-01fa5aba6fd2" status: 200 len: 1218 microversion: 2.1 time: 0.109277 Oct 22 20:51:24.051035 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 385/719] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:51:23 2022] GET /compute/v2.1/servers/c190c6e5-8b3b-4946-bb18-01fa5aba6fd2 => generated 1218 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 20:51:24.152723 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-877e9c8d-f5b7-4a0f-a3b2-3cd4c6eeeb5f tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da7143c3bfb46a7b193a8d96f1b75b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598f129979a34e7a856b83bd0e69f1b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:51:24.161305 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-877e9c8d-f5b7-4a0f-a3b2-3cd4c6eeeb5f tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] 10.222.0.18 "GET /compute/v2.1/servers/58846d5b-1bfa-42cd-92a3-546b110ff64b" status: 200 len: 1292 microversion: 2.1 time: 0.287408 Oct 22 20:51:24.163655 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 335/720] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:51:23 2022] GET /compute/v2.1/servers/58846d5b-1bfa-42cd-92a3-546b110ff64b => generated 1292 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 20:51:24.232194 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-2ef81f6d-2979-49c7-8ce3-56ba979c5ad0 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:51:24.232846 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-2ef81f6d-2979-49c7-8ce3-56ba979c5ad0 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] [instance: fe83cd49-4ceb-49aa-a775-cc2a4229fd76] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:51:24.239603 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2ef81f6d-2979-49c7-8ce3-56ba979c5ad0 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:24.240097 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2ef81f6d-2979-49c7-8ce3-56ba979c5ad0 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:24.240540 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2ef81f6d-2979-49c7-8ce3-56ba979c5ad0 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:24.241319 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2ef81f6d-2979-49c7-8ce3-56ba979c5ad0 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:24.242139 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2ef81f6d-2979-49c7-8ce3-56ba979c5ad0 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:24.242473 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2ef81f6d-2979-49c7-8ce3-56ba979c5ad0 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:24.423684 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-2ef81f6d-2979-49c7-8ce3-56ba979c5ad0 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c87f0356ca346f39c6216393d85da2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee8c8f7fc4e12bc1f9fcce3e7b581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:51:24.433950 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-2ef81f6d-2979-49c7-8ce3-56ba979c5ad0 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] 10.222.0.18 "GET /compute/v2.1/servers/fe83cd49-4ceb-49aa-a775-cc2a4229fd76" status: 200 len: 1503 microversion: 2.1 time: 0.205640 Oct 22 20:51:24.435414 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 386/721] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:51:24 2022] GET /compute/v2.1/servers/fe83cd49-4ceb-49aa-a775-cc2a4229fd76 => generated 1503 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:51:24.646423 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-9b95c584-a374-4de1-a6f1-5e3af02c0eb0 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:51:24.647673 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-9b95c584-a374-4de1-a6f1-5e3af02c0eb0 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] [instance: 4c7b99a9-2ec4-4f4b-98e7-8e1ea2103735] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:51:24.662891 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9b95c584-a374-4de1-a6f1-5e3af02c0eb0 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:24.664423 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9b95c584-a374-4de1-a6f1-5e3af02c0eb0 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:24.665118 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9b95c584-a374-4de1-a6f1-5e3af02c0eb0 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:24.665803 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9b95c584-a374-4de1-a6f1-5e3af02c0eb0 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:24.666420 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9b95c584-a374-4de1-a6f1-5e3af02c0eb0 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:24.667006 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9b95c584-a374-4de1-a6f1-5e3af02c0eb0 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:24.854392 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-9b95c584-a374-4de1-a6f1-5e3af02c0eb0 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:51:24.862964 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-9b95c584-a374-4de1-a6f1-5e3af02c0eb0 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:51:24.864458 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-9b95c584-a374-4de1-a6f1-5e3af02c0eb0 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:51:24.865792 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-9b95c584-a374-4de1-a6f1-5e3af02c0eb0 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] 10.222.0.18 "GET /compute/v2.1/servers/4c7b99a9-2ec4-4f4b-98e7-8e1ea2103735" status: 200 len: 1410 microversion: 2.25 time: 0.224430 Oct 22 20:51:24.877798 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 336/722] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 20:51:24 2022] GET /compute/v2.1/servers/4c7b99a9-2ec4-4f4b-98e7-8e1ea2103735 => generated 1410 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 20:51:25.058072 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-3b1a25cb-cdaf-4c00-88c1-d48407e22f7f tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:51:25.058677 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-3b1a25cb-cdaf-4c00-88c1-d48407e22f7f tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] [instance: c190c6e5-8b3b-4946-bb18-01fa5aba6fd2] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:51:25.065757 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3b1a25cb-cdaf-4c00-88c1-d48407e22f7f tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:25.066238 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3b1a25cb-cdaf-4c00-88c1-d48407e22f7f tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:25.066672 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3b1a25cb-cdaf-4c00-88c1-d48407e22f7f tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:25.067390 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3b1a25cb-cdaf-4c00-88c1-d48407e22f7f tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:25.068031 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3b1a25cb-cdaf-4c00-88c1-d48407e22f7f tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:25.068443 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3b1a25cb-cdaf-4c00-88c1-d48407e22f7f tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:25.131464 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-3b1a25cb-cdaf-4c00-88c1-d48407e22f7f tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91cf84a287b74618ae1b3368785b0b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902e239d67664098895ab24340b0b780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:51:25.141237 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-3b1a25cb-cdaf-4c00-88c1-d48407e22f7f tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] 10.222.0.18 "GET /compute/v2.1/servers/c190c6e5-8b3b-4946-bb18-01fa5aba6fd2" status: 200 len: 1222 microversion: 2.1 time: 0.086798 Oct 22 20:51:25.141973 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 387/723] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:51:25 2022] GET /compute/v2.1/servers/c190c6e5-8b3b-4946-bb18-01fa5aba6fd2 => generated 1222 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:51:25.186488 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-fc1ffa53-79bd-4528-8dc2-c44110d91b5a tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:51:25.187704 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-fc1ffa53-79bd-4528-8dc2-c44110d91b5a tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] [instance: 58846d5b-1bfa-42cd-92a3-546b110ff64b] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:51:25.195588 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fc1ffa53-79bd-4528-8dc2-c44110d91b5a tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:25.196088 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fc1ffa53-79bd-4528-8dc2-c44110d91b5a tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:25.196526 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fc1ffa53-79bd-4528-8dc2-c44110d91b5a tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:25.197233 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fc1ffa53-79bd-4528-8dc2-c44110d91b5a tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:25.197688 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fc1ffa53-79bd-4528-8dc2-c44110d91b5a tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:25.198116 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fc1ffa53-79bd-4528-8dc2-c44110d91b5a tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:25.361026 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-fc1ffa53-79bd-4528-8dc2-c44110d91b5a tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da7143c3bfb46a7b193a8d96f1b75b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598f129979a34e7a856b83bd0e69f1b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:51:25.373235 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-fc1ffa53-79bd-4528-8dc2-c44110d91b5a tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] 10.222.0.18 "GET /compute/v2.1/servers/58846d5b-1bfa-42cd-92a3-546b110ff64b" status: 200 len: 1292 microversion: 2.1 time: 0.192792 Oct 22 20:51:25.389526 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 337/724] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:51:25 2022] GET /compute/v2.1/servers/58846d5b-1bfa-42cd-92a3-546b110ff64b => generated 1292 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:51:25.458747 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-20f5c828-f345-427b-9764-5b5c48d53256 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:51:25.459509 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-20f5c828-f345-427b-9764-5b5c48d53256 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] [instance: fe83cd49-4ceb-49aa-a775-cc2a4229fd76] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:51:25.465969 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-20f5c828-f345-427b-9764-5b5c48d53256 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:25.466607 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-20f5c828-f345-427b-9764-5b5c48d53256 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:25.467049 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-20f5c828-f345-427b-9764-5b5c48d53256 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:25.467796 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-20f5c828-f345-427b-9764-5b5c48d53256 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:25.468350 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-20f5c828-f345-427b-9764-5b5c48d53256 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:25.468791 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-20f5c828-f345-427b-9764-5b5c48d53256 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:25.613376 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-20f5c828-f345-427b-9764-5b5c48d53256 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c87f0356ca346f39c6216393d85da2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee8c8f7fc4e12bc1f9fcce3e7b581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:51:25.626059 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-20f5c828-f345-427b-9764-5b5c48d53256 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] 10.222.0.18 "GET /compute/v2.1/servers/fe83cd49-4ceb-49aa-a775-cc2a4229fd76" status: 200 len: 1503 microversion: 2.1 time: 0.170977 Oct 22 20:51:25.627481 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 388/725] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:51:25 2022] GET /compute/v2.1/servers/fe83cd49-4ceb-49aa-a775-cc2a4229fd76 => generated 1503 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:51:25.900613 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-961a263a-6776-4495-b2da-0c4b0f27ccb8 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:51:25.902787 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-961a263a-6776-4495-b2da-0c4b0f27ccb8 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] [instance: 4c7b99a9-2ec4-4f4b-98e7-8e1ea2103735] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:51:25.920272 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-961a263a-6776-4495-b2da-0c4b0f27ccb8 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:25.922790 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-961a263a-6776-4495-b2da-0c4b0f27ccb8 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:25.925618 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-961a263a-6776-4495-b2da-0c4b0f27ccb8 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:25.927179 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-961a263a-6776-4495-b2da-0c4b0f27ccb8 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:25.928549 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-961a263a-6776-4495-b2da-0c4b0f27ccb8 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:25.930433 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-961a263a-6776-4495-b2da-0c4b0f27ccb8 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:25.989044 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-c31c814b-d0ee-4742-899e-5eccfed8d677 req-149cdb59-b1ef-422d-b887-b3a544188b5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58846d5b-1bfa-42cd-92a3-546b110ff64b", "name": "network-vif-plugged", "status": "completed", "tag": "6fea6402-4ea4-46cb-b608-a01b3e495aa0"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:51:26.015508 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-c31c814b-d0ee-4742-899e-5eccfed8d677 req-149cdb59-b1ef-422d-b887-b3a544188b5d service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:26.015971 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-c31c814b-d0ee-4742-899e-5eccfed8d677 req-149cdb59-b1ef-422d-b887-b3a544188b5d service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:26.016416 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-c31c814b-d0ee-4742-899e-5eccfed8d677 req-149cdb59-b1ef-422d-b887-b3a544188b5d service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:26.020912 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell1:SELECT=100 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:51:26.037974 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-c31c814b-d0ee-4742-899e-5eccfed8d677 req-149cdb59-b1ef-422d-b887-b3a544188b5d service nova] Creating event network-vif-plugged:6fea6402-4ea4-46cb-b608-a01b3e495aa0 for instance 58846d5b-1bfa-42cd-92a3-546b110ff64b on nch1-master-1 Oct 22 20:51:26.053266 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-c31c814b-d0ee-4742-899e-5eccfed8d677 req-149cdb59-b1ef-422d-b887-b3a544188b5d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068359 Oct 22 20:51:26.053903 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 389/726] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:51:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:51:26.123559 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-961a263a-6776-4495-b2da-0c4b0f27ccb8 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:51:26.133895 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-961a263a-6776-4495-b2da-0c4b0f27ccb8 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:51:26.159523 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-961a263a-6776-4495-b2da-0c4b0f27ccb8 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:51:26.163427 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-961a263a-6776-4495-b2da-0c4b0f27ccb8 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] 10.222.0.18 "GET /compute/v2.1/servers/4c7b99a9-2ec4-4f4b-98e7-8e1ea2103735" status: 200 len: 1410 microversion: 2.25 time: 0.274831 Oct 22 20:51:26.171015 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-20f4d7c6-bb8d-4bf8-8cf1-8a9470189a98 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:51:26.172395 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-20f4d7c6-bb8d-4bf8-8cf1-8a9470189a98 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] [instance: c190c6e5-8b3b-4946-bb18-01fa5aba6fd2] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:51:26.179955 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 338/727] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 20:51:25 2022] GET /compute/v2.1/servers/4c7b99a9-2ec4-4f4b-98e7-8e1ea2103735 => generated 1410 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 20:51:26.191061 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-20f4d7c6-bb8d-4bf8-8cf1-8a9470189a98 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:26.195813 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-20f4d7c6-bb8d-4bf8-8cf1-8a9470189a98 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:26.199188 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-20f4d7c6-bb8d-4bf8-8cf1-8a9470189a98 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:26.207527 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-20f4d7c6-bb8d-4bf8-8cf1-8a9470189a98 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:26.211371 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-20f4d7c6-bb8d-4bf8-8cf1-8a9470189a98 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:26.212453 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-20f4d7c6-bb8d-4bf8-8cf1-8a9470189a98 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:26.402421 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-83b9b9af-664d-4003-a302-3c960c5d531a tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:51:26.403039 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-83b9b9af-664d-4003-a302-3c960c5d531a tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] [instance: 58846d5b-1bfa-42cd-92a3-546b110ff64b] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:51:26.422135 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-83b9b9af-664d-4003-a302-3c960c5d531a tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:26.422780 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-83b9b9af-664d-4003-a302-3c960c5d531a tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:26.424095 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-20f4d7c6-bb8d-4bf8-8cf1-8a9470189a98 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91cf84a287b74618ae1b3368785b0b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902e239d67664098895ab24340b0b780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:51:26.424812 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-83b9b9af-664d-4003-a302-3c960c5d531a tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:26.430279 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-83b9b9af-664d-4003-a302-3c960c5d531a tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:26.433120 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-83b9b9af-664d-4003-a302-3c960c5d531a tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:26.433576 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-83b9b9af-664d-4003-a302-3c960c5d531a tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:26.438054 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-20f4d7c6-bb8d-4bf8-8cf1-8a9470189a98 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] 10.222.0.18 "GET /compute/v2.1/servers/c190c6e5-8b3b-4946-bb18-01fa5aba6fd2" status: 200 len: 1222 microversion: 2.1 time: 0.272086 Oct 22 20:51:26.453199 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 390/728] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:51:26 2022] GET /compute/v2.1/servers/c190c6e5-8b3b-4946-bb18-01fa5aba6fd2 => generated 1222 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 20:51:26.678696 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-83b9b9af-664d-4003-a302-3c960c5d531a tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da7143c3bfb46a7b193a8d96f1b75b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598f129979a34e7a856b83bd0e69f1b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:51:26.690910 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-83b9b9af-664d-4003-a302-3c960c5d531a tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] 10.222.0.18 "GET /compute/v2.1/servers/58846d5b-1bfa-42cd-92a3-546b110ff64b" status: 200 len: 1292 microversion: 2.1 time: 0.293025 Oct 22 20:51:26.691523 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 339/729] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:51:26 2022] GET /compute/v2.1/servers/58846d5b-1bfa-42cd-92a3-546b110ff64b => generated 1292 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:51:26.699217 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-0c335041-7795-42a9-bc64-4ea260bddd2a tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:51:26.700345 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-0c335041-7795-42a9-bc64-4ea260bddd2a tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] [instance: fe83cd49-4ceb-49aa-a775-cc2a4229fd76] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:51:26.707168 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0c335041-7795-42a9-bc64-4ea260bddd2a tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:26.707761 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0c335041-7795-42a9-bc64-4ea260bddd2a tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:26.708273 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0c335041-7795-42a9-bc64-4ea260bddd2a tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:26.709043 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0c335041-7795-42a9-bc64-4ea260bddd2a tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:26.709563 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0c335041-7795-42a9-bc64-4ea260bddd2a tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:26.710081 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0c335041-7795-42a9-bc64-4ea260bddd2a tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:26.717960 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-90028e9d-1cee-4a5b-88ab-79878a858559 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-980974315", "imageRef": "085e4478-6edc-4a69-8e08-f9831713eb65", "flavorRef": "452"}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:51:26.774132 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.network.neutron [None req-90028e9d-1cee-4a5b-88ab-79878a858559 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] validate_networks() for None {{(pid=138745) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 20:51:26.939001 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-0c335041-7795-42a9-bc64-4ea260bddd2a tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c87f0356ca346f39c6216393d85da2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee8c8f7fc4e12bc1f9fcce3e7b581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:51:26.949195 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-0c335041-7795-42a9-bc64-4ea260bddd2a tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] 10.222.0.18 "GET /compute/v2.1/servers/fe83cd49-4ceb-49aa-a775-cc2a4229fd76" status: 200 len: 1503 microversion: 2.1 time: 0.255059 Oct 22 20:51:26.949778 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 340/730] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:51:26 2022] GET /compute/v2.1/servers/fe83cd49-4ceb-49aa-a775-cc2a4229fd76 => generated 1503 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:51:27.025547 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-90028e9d-1cee-4a5b-88ab-79878a858559 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Flavor limits 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 20:51:27.026068 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-90028e9d-1cee-4a5b-88ab-79878a858559 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Image limits 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 20:51:27.026617 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-90028e9d-1cee-4a5b-88ab-79878a858559 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Flavor pref 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 20:51:27.027153 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-90028e9d-1cee-4a5b-88ab-79878a858559 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Image pref 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 20:51:27.027683 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-90028e9d-1cee-4a5b-88ab-79878a858559 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 20:51:27.036953 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-90028e9d-1cee-4a5b-88ab-79878a858559 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:27.037525 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-90028e9d-1cee-4a5b-88ab-79878a858559 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:27.038033 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-90028e9d-1cee-4a5b-88ab-79878a858559 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:27.038832 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-90028e9d-1cee-4a5b-88ab-79878a858559 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:27.039378 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-90028e9d-1cee-4a5b-88ab-79878a858559 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:27.039877 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-90028e9d-1cee-4a5b-88ab-79878a858559 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:27.058288 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-90028e9d-1cee-4a5b-88ab-79878a858559 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Getting quotas for project 950a163a28d64f41855e56cf88e3b1d9. Resources: {'cores', 'instances', 'ram'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 20:51:27.064210 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-90028e9d-1cee-4a5b-88ab-79878a858559 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Getting quotas for user 084d99ccb7dc405f85b1d31cfd255e72 and project 950a163a28d64f41855e56cf88e3b1d9. Resources: {'cores', 'instances', 'ram'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 20:51:27.077226 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-90028e9d-1cee-4a5b-88ab-79878a858559 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Going to run 1 instances... {{(pid=138745) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 20:51:27.081003 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-90028e9d-1cee-4a5b-88ab-79878a858559 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] [instance: 6da11c1d-55e8-4d3f-b045-44f67f397741] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='085e4478-6edc-4a69-8e08-f9831713eb65',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138745) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 20:51:27.130042 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-90028e9d-1cee-4a5b-88ab-79878a858559 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.551316 Oct 22 20:51:27.131001 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 391/731] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Oct 22 20:51:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 553 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 22 20:51:27.143047 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-d597ea85-11ce-437e-acb8-08e88956a0e4 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:51:27.144009 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-d597ea85-11ce-437e-acb8-08e88956a0e4 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] [instance: 6da11c1d-55e8-4d3f-b045-44f67f397741] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:51:27.208112 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-d597ea85-11ce-437e-acb8-08e88956a0e4 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084d99ccb7dc405f85b1d31cfd255e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '950a163a28d64f41855e56cf88e3b1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:51:27.208741 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-ef5f9387-0584-407c-8207-0fa177f7b627 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:51:27.210511 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-ef5f9387-0584-407c-8207-0fa177f7b627 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] [instance: 4c7b99a9-2ec4-4f4b-98e7-8e1ea2103735] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:51:27.218041 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-d597ea85-11ce-437e-acb8-08e88956a0e4 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] 10.222.0.18 "GET /compute/v2.1/servers/6da11c1d-55e8-4d3f-b045-44f67f397741" status: 200 len: 1221 microversion: 2.1 time: 0.079697 Oct 22 20:51:27.219314 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 341/732] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:51:27 2022] GET /compute/v2.1/servers/6da11c1d-55e8-4d3f-b045-44f67f397741 => generated 1221 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:51:27.222315 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ef5f9387-0584-407c-8207-0fa177f7b627 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:27.223804 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ef5f9387-0584-407c-8207-0fa177f7b627 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:27.224413 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ef5f9387-0584-407c-8207-0fa177f7b627 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:27.225442 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ef5f9387-0584-407c-8207-0fa177f7b627 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:27.226048 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ef5f9387-0584-407c-8207-0fa177f7b627 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:27.226952 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ef5f9387-0584-407c-8207-0fa177f7b627 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:27.276372 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-5652ad0e-7591-4ce0-ba43-5dd49114e369 req-06de8fc6-44e6-4b2d-9b3b-42b03ff9f677 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ef975af-c582-4e7e-9913-e4be1688f81d", "tag": "15aed3a5-c90a-49b8-9c3c-f9d8afe7023d"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:51:27.294830 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-5652ad0e-7591-4ce0-ba43-5dd49114e369 req-06de8fc6-44e6-4b2d-9b3b-42b03ff9f677 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:27.295777 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-5652ad0e-7591-4ce0-ba43-5dd49114e369 req-06de8fc6-44e6-4b2d-9b3b-42b03ff9f677 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:27.296479 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-5652ad0e-7591-4ce0-ba43-5dd49114e369 req-06de8fc6-44e6-4b2d-9b3b-42b03ff9f677 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:27.312594 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-5652ad0e-7591-4ce0-ba43-5dd49114e369 req-06de8fc6-44e6-4b2d-9b3b-42b03ff9f677 service nova] Creating event network-changed:15aed3a5-c90a-49b8-9c3c-f9d8afe7023d for instance 4ef975af-c582-4e7e-9913-e4be1688f81d on nch2-master-1 Oct 22 20:51:27.323375 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-5652ad0e-7591-4ce0-ba43-5dd49114e369 req-06de8fc6-44e6-4b2d-9b3b-42b03ff9f677 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055374 Oct 22 20:51:27.324596 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 342/733] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:51:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 20:51:27.394427 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-ef5f9387-0584-407c-8207-0fa177f7b627 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:51:27.403721 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-ef5f9387-0584-407c-8207-0fa177f7b627 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:51:27.405402 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-ef5f9387-0584-407c-8207-0fa177f7b627 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:51:27.407134 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-ef5f9387-0584-407c-8207-0fa177f7b627 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] 10.222.0.18 "GET /compute/v2.1/servers/4c7b99a9-2ec4-4f4b-98e7-8e1ea2103735" status: 200 len: 1410 microversion: 2.25 time: 0.204777 Oct 22 20:51:27.408925 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 392/734] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 20:51:27 2022] GET /compute/v2.1/servers/4c7b99a9-2ec4-4f4b-98e7-8e1ea2103735 => generated 1410 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 22 20:51:27.463900 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-e4d8eb58-6053-4564-9db4-95f1c6c2e597 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:51:27.464817 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-e4d8eb58-6053-4564-9db4-95f1c6c2e597 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] [instance: c190c6e5-8b3b-4946-bb18-01fa5aba6fd2] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:51:27.471234 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e4d8eb58-6053-4564-9db4-95f1c6c2e597 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:27.471773 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e4d8eb58-6053-4564-9db4-95f1c6c2e597 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:27.472208 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e4d8eb58-6053-4564-9db4-95f1c6c2e597 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:27.472908 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e4d8eb58-6053-4564-9db4-95f1c6c2e597 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:27.473530 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e4d8eb58-6053-4564-9db4-95f1c6c2e597 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:27.474144 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e4d8eb58-6053-4564-9db4-95f1c6c2e597 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:27.549545 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-e4d8eb58-6053-4564-9db4-95f1c6c2e597 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91cf84a287b74618ae1b3368785b0b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902e239d67664098895ab24340b0b780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:51:27.560742 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-e4d8eb58-6053-4564-9db4-95f1c6c2e597 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] 10.222.0.18 "GET /compute/v2.1/servers/c190c6e5-8b3b-4946-bb18-01fa5aba6fd2" status: 200 len: 1270 microversion: 2.1 time: 0.101081 Oct 22 20:51:27.561531 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 343/735] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:51:27 2022] GET /compute/v2.1/servers/c190c6e5-8b3b-4946-bb18-01fa5aba6fd2 => generated 1270 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:51:27.713250 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-425172e8-51db-41d5-ad6d-d4ea1d615d96 tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:51:27.714392 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-425172e8-51db-41d5-ad6d-d4ea1d615d96 tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] [instance: 58846d5b-1bfa-42cd-92a3-546b110ff64b] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:51:27.723328 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-425172e8-51db-41d5-ad6d-d4ea1d615d96 tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:27.724075 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-425172e8-51db-41d5-ad6d-d4ea1d615d96 tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:27.724912 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-425172e8-51db-41d5-ad6d-d4ea1d615d96 tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:27.726200 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-425172e8-51db-41d5-ad6d-d4ea1d615d96 tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:27.727187 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-425172e8-51db-41d5-ad6d-d4ea1d615d96 tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:27.727818 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-425172e8-51db-41d5-ad6d-d4ea1d615d96 tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:27.908693 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-425172e8-51db-41d5-ad6d-d4ea1d615d96 tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da7143c3bfb46a7b193a8d96f1b75b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598f129979a34e7a856b83bd0e69f1b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:51:27.922158 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-425172e8-51db-41d5-ad6d-d4ea1d615d96 tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] 10.222.0.18 "GET /compute/v2.1/servers/58846d5b-1bfa-42cd-92a3-546b110ff64b" status: 200 len: 1292 microversion: 2.1 time: 0.212131 Oct 22 20:51:27.944312 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 393/736] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:51:27 2022] GET /compute/v2.1/servers/58846d5b-1bfa-42cd-92a3-546b110ff64b => generated 1292 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:51:27.976035 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-f44437f2-cf11-4af9-9a73-391fb6e490de tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:51:27.977741 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-f44437f2-cf11-4af9-9a73-391fb6e490de tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] [instance: fe83cd49-4ceb-49aa-a775-cc2a4229fd76] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:51:27.986651 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f44437f2-cf11-4af9-9a73-391fb6e490de tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:27.987321 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f44437f2-cf11-4af9-9a73-391fb6e490de tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:27.992551 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f44437f2-cf11-4af9-9a73-391fb6e490de tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:27.993329 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f44437f2-cf11-4af9-9a73-391fb6e490de tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:27.993787 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f44437f2-cf11-4af9-9a73-391fb6e490de tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:27.994224 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f44437f2-cf11-4af9-9a73-391fb6e490de tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:28.152487 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-f44437f2-cf11-4af9-9a73-391fb6e490de tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c87f0356ca346f39c6216393d85da2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee8c8f7fc4e12bc1f9fcce3e7b581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:51:28.163533 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-f44437f2-cf11-4af9-9a73-391fb6e490de tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] 10.222.0.18 "GET /compute/v2.1/servers/fe83cd49-4ceb-49aa-a775-cc2a4229fd76" status: 200 len: 1503 microversion: 2.1 time: 0.192067 Oct 22 20:51:28.164136 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 344/737] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:51:27 2022] GET /compute/v2.1/servers/fe83cd49-4ceb-49aa-a775-cc2a4229fd76 => generated 1503 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:51:28.244624 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-72e26e9e-5042-4334-89c6-5d7b2513ed68 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:51:28.246026 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-72e26e9e-5042-4334-89c6-5d7b2513ed68 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] [instance: 6da11c1d-55e8-4d3f-b045-44f67f397741] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:51:28.255125 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-72e26e9e-5042-4334-89c6-5d7b2513ed68 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:28.255678 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-72e26e9e-5042-4334-89c6-5d7b2513ed68 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:28.256224 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-72e26e9e-5042-4334-89c6-5d7b2513ed68 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:28.256937 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-72e26e9e-5042-4334-89c6-5d7b2513ed68 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:28.257392 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-72e26e9e-5042-4334-89c6-5d7b2513ed68 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:28.257817 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-72e26e9e-5042-4334-89c6-5d7b2513ed68 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:28.330374 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-72e26e9e-5042-4334-89c6-5d7b2513ed68 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084d99ccb7dc405f85b1d31cfd255e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '950a163a28d64f41855e56cf88e3b1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:51:28.338270 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-72e26e9e-5042-4334-89c6-5d7b2513ed68 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] 10.222.0.18 "GET /compute/v2.1/servers/6da11c1d-55e8-4d3f-b045-44f67f397741" status: 200 len: 1273 microversion: 2.1 time: 0.099742 Oct 22 20:51:28.339044 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 394/738] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:51:28 2022] GET /compute/v2.1/servers/6da11c1d-55e8-4d3f-b045-44f67f397741 => generated 1273 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:51:28.434761 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-20ef31ff-a6c1-4636-9a3c-a222c2aa7212 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:51:28.435469 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-20ef31ff-a6c1-4636-9a3c-a222c2aa7212 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] [instance: 4c7b99a9-2ec4-4f4b-98e7-8e1ea2103735] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:51:28.442875 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-20ef31ff-a6c1-4636-9a3c-a222c2aa7212 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:28.443793 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-20ef31ff-a6c1-4636-9a3c-a222c2aa7212 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:28.444388 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-20ef31ff-a6c1-4636-9a3c-a222c2aa7212 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:28.445239 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-20ef31ff-a6c1-4636-9a3c-a222c2aa7212 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:28.445837 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-20ef31ff-a6c1-4636-9a3c-a222c2aa7212 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:28.446947 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-20ef31ff-a6c1-4636-9a3c-a222c2aa7212 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:28.583806 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-0312d861-db0c-4c04-ba3a-25937fd1b500 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:51:28.584864 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-0312d861-db0c-4c04-ba3a-25937fd1b500 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] [instance: c190c6e5-8b3b-4946-bb18-01fa5aba6fd2] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:51:28.591798 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0312d861-db0c-4c04-ba3a-25937fd1b500 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:28.592799 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0312d861-db0c-4c04-ba3a-25937fd1b500 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:28.593491 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0312d861-db0c-4c04-ba3a-25937fd1b500 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:28.594994 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0312d861-db0c-4c04-ba3a-25937fd1b500 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:28.595759 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0312d861-db0c-4c04-ba3a-25937fd1b500 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:28.596439 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0312d861-db0c-4c04-ba3a-25937fd1b500 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:28.618035 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-20ef31ff-a6c1-4636-9a3c-a222c2aa7212 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:51:28.629369 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-20ef31ff-a6c1-4636-9a3c-a222c2aa7212 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:51:28.632512 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-20ef31ff-a6c1-4636-9a3c-a222c2aa7212 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:51:28.633923 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-20ef31ff-a6c1-4636-9a3c-a222c2aa7212 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] 10.222.0.18 "GET /compute/v2.1/servers/4c7b99a9-2ec4-4f4b-98e7-8e1ea2103735" status: 200 len: 1410 microversion: 2.25 time: 0.204324 Oct 22 20:51:28.653298 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 345/739] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 20:51:28 2022] GET /compute/v2.1/servers/4c7b99a9-2ec4-4f4b-98e7-8e1ea2103735 => generated 1410 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 20:51:28.703978 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-0312d861-db0c-4c04-ba3a-25937fd1b500 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91cf84a287b74618ae1b3368785b0b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902e239d67664098895ab24340b0b780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:51:28.712301 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-0312d861-db0c-4c04-ba3a-25937fd1b500 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] 10.222.0.18 "GET /compute/v2.1/servers/c190c6e5-8b3b-4946-bb18-01fa5aba6fd2" status: 200 len: 1270 microversion: 2.1 time: 0.132524 Oct 22 20:51:28.727781 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 395/740] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:51:28 2022] GET /compute/v2.1/servers/c190c6e5-8b3b-4946-bb18-01fa5aba6fd2 => generated 1270 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 20:51:28.946221 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-053caf05-950c-42fc-be49-7b0253214aeb tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:51:28.947244 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-053caf05-950c-42fc-be49-7b0253214aeb tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] [instance: 58846d5b-1bfa-42cd-92a3-546b110ff64b] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:51:28.953803 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-053caf05-950c-42fc-be49-7b0253214aeb tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:28.954298 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-053caf05-950c-42fc-be49-7b0253214aeb tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:28.954730 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-053caf05-950c-42fc-be49-7b0253214aeb tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:28.955496 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-053caf05-950c-42fc-be49-7b0253214aeb tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:28.955948 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-053caf05-950c-42fc-be49-7b0253214aeb tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:28.956371 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-053caf05-950c-42fc-be49-7b0253214aeb tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:29.091724 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-053caf05-950c-42fc-be49-7b0253214aeb tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da7143c3bfb46a7b193a8d96f1b75b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598f129979a34e7a856b83bd0e69f1b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:51:29.100358 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-053caf05-950c-42fc-be49-7b0253214aeb tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] 10.222.0.18 "GET /compute/v2.1/servers/58846d5b-1bfa-42cd-92a3-546b110ff64b" status: 200 len: 1483 microversion: 2.1 time: 0.158063 Oct 22 20:51:29.100936 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 346/741] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:51:28 2022] GET /compute/v2.1/servers/58846d5b-1bfa-42cd-92a3-546b110ff64b => generated 1483 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:51:29.123786 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-0cfbc786-c8f6-4258-893a-061c5c639559 tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:51:29.124328 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-0cfbc786-c8f6-4258-893a-061c5c639559 tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] [instance: 58846d5b-1bfa-42cd-92a3-546b110ff64b] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:51:29.130366 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0cfbc786-c8f6-4258-893a-061c5c639559 tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:29.130848 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0cfbc786-c8f6-4258-893a-061c5c639559 tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:29.131277 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0cfbc786-c8f6-4258-893a-061c5c639559 tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:29.132320 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0cfbc786-c8f6-4258-893a-061c5c639559 tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:29.132770 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0cfbc786-c8f6-4258-893a-061c5c639559 tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:29.133172 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0cfbc786-c8f6-4258-893a-061c5c639559 tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:29.189345 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-b0362d77-eeea-479f-9782-3159fbd71d7a tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:51:29.189911 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-b0362d77-eeea-479f-9782-3159fbd71d7a tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] [instance: fe83cd49-4ceb-49aa-a775-cc2a4229fd76] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:51:29.196621 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b0362d77-eeea-479f-9782-3159fbd71d7a tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:29.197413 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b0362d77-eeea-479f-9782-3159fbd71d7a tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:29.198017 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b0362d77-eeea-479f-9782-3159fbd71d7a tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:29.198847 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b0362d77-eeea-479f-9782-3159fbd71d7a tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:29.199475 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b0362d77-eeea-479f-9782-3159fbd71d7a tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:29.200270 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b0362d77-eeea-479f-9782-3159fbd71d7a tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:29.210314 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-0cfbc786-c8f6-4258-893a-061c5c639559 tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] 10.222.0.18 "GET /compute/v2.1/servers/58846d5b-1bfa-42cd-92a3-546b110ff64b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090476 Oct 22 20:51:29.211265 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 396/742] 10.222.0.18 () {58 vars in 1275 bytes} [Sat Oct 22 20:51:29 2022] GET /compute/v2.1/servers/58846d5b-1bfa-42cd-92a3-546b110ff64b/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:51:29.364021 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-159d397d-5b14-469f-98c6-6e100e8bb75f tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:51:29.364749 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-159d397d-5b14-469f-98c6-6e100e8bb75f tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] [instance: 6da11c1d-55e8-4d3f-b045-44f67f397741] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:51:29.374669 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-159d397d-5b14-469f-98c6-6e100e8bb75f tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:29.375519 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-159d397d-5b14-469f-98c6-6e100e8bb75f tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:29.376167 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-159d397d-5b14-469f-98c6-6e100e8bb75f tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:29.377155 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-159d397d-5b14-469f-98c6-6e100e8bb75f tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:29.377836 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-159d397d-5b14-469f-98c6-6e100e8bb75f tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:29.378468 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-159d397d-5b14-469f-98c6-6e100e8bb75f tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:29.474075 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-159d397d-5b14-469f-98c6-6e100e8bb75f tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084d99ccb7dc405f85b1d31cfd255e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '950a163a28d64f41855e56cf88e3b1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:51:29.482591 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-159d397d-5b14-469f-98c6-6e100e8bb75f tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] 10.222.0.18 "GET /compute/v2.1/servers/6da11c1d-55e8-4d3f-b045-44f67f397741" status: 200 len: 1281 microversion: 2.1 time: 0.124821 Oct 22 20:51:29.484027 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 397/743] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:51:29 2022] GET /compute/v2.1/servers/6da11c1d-55e8-4d3f-b045-44f67f397741 => generated 1281 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 20:51:29.520496 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-b0362d77-eeea-479f-9782-3159fbd71d7a tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c87f0356ca346f39c6216393d85da2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee8c8f7fc4e12bc1f9fcce3e7b581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:51:29.532620 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-b0362d77-eeea-479f-9782-3159fbd71d7a tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] 10.222.0.18 "GET /compute/v2.1/servers/fe83cd49-4ceb-49aa-a775-cc2a4229fd76" status: 200 len: 1503 microversion: 2.1 time: 0.347444 Oct 22 20:51:29.533778 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 347/744] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:51:29 2022] GET /compute/v2.1/servers/fe83cd49-4ceb-49aa-a775-cc2a4229fd76 => generated 1503 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 20:51:29.660151 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-e9578ce0-702b-44db-ad11-7010528dc67e tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:51:29.660766 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-e9578ce0-702b-44db-ad11-7010528dc67e tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] [instance: 4c7b99a9-2ec4-4f4b-98e7-8e1ea2103735] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:51:29.668191 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e9578ce0-702b-44db-ad11-7010528dc67e tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:29.668694 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e9578ce0-702b-44db-ad11-7010528dc67e tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:29.669371 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e9578ce0-702b-44db-ad11-7010528dc67e tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:29.670119 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e9578ce0-702b-44db-ad11-7010528dc67e tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:29.670572 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e9578ce0-702b-44db-ad11-7010528dc67e tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:29.670999 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e9578ce0-702b-44db-ad11-7010528dc67e tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:29.738822 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-965bbcb9-7217-4373-aa47-b8d3563df235 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:51:29.739791 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-965bbcb9-7217-4373-aa47-b8d3563df235 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] [instance: c190c6e5-8b3b-4946-bb18-01fa5aba6fd2] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:51:29.761685 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-965bbcb9-7217-4373-aa47-b8d3563df235 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:29.762465 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-965bbcb9-7217-4373-aa47-b8d3563df235 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:29.763112 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-965bbcb9-7217-4373-aa47-b8d3563df235 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:29.764178 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-965bbcb9-7217-4373-aa47-b8d3563df235 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:29.764787 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-965bbcb9-7217-4373-aa47-b8d3563df235 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:29.765426 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-965bbcb9-7217-4373-aa47-b8d3563df235 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:30.386305 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-e9578ce0-702b-44db-ad11-7010528dc67e tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:51:30.396890 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-e9578ce0-702b-44db-ad11-7010528dc67e tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:51:30.398403 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-e9578ce0-702b-44db-ad11-7010528dc67e tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:51:30.400064 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-e9578ce0-702b-44db-ad11-7010528dc67e tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] 10.222.0.18 "GET /compute/v2.1/servers/4c7b99a9-2ec4-4f4b-98e7-8e1ea2103735" status: 200 len: 1410 microversion: 2.25 time: 0.743969 Oct 22 20:51:30.400910 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 398/745] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 20:51:29 2022] GET /compute/v2.1/servers/4c7b99a9-2ec4-4f4b-98e7-8e1ea2103735 => generated 1410 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 20:51:30.404526 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-965bbcb9-7217-4373-aa47-b8d3563df235 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91cf84a287b74618ae1b3368785b0b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902e239d67664098895ab24340b0b780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:51:30.414994 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-965bbcb9-7217-4373-aa47-b8d3563df235 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] 10.222.0.18 "GET /compute/v2.1/servers/c190c6e5-8b3b-4946-bb18-01fa5aba6fd2" status: 200 len: 1318 microversion: 2.1 time: 0.679968 Oct 22 20:51:30.431710 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 348/746] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:51:29 2022] GET /compute/v2.1/servers/c190c6e5-8b3b-4946-bb18-01fa5aba6fd2 => generated 1318 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 20:51:30.434125 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-ca19b626-97e4-4576-9598-8db3817ea1cf req-2420998d-c024-4ed3-9b63-55cd6af86fd9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c7b99a9-2ec4-4f4b-98e7-8e1ea2103735", "name": "network-vif-plugged", "status": "completed", "tag": "54a65686-35c5-4655-a6b6-8d82393a2555"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:51:30.447399 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-ca19b626-97e4-4576-9598-8db3817ea1cf req-2420998d-c024-4ed3-9b63-55cd6af86fd9 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:30.448205 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-ca19b626-97e4-4576-9598-8db3817ea1cf req-2420998d-c024-4ed3-9b63-55cd6af86fd9 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:30.448874 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-ca19b626-97e4-4576-9598-8db3817ea1cf req-2420998d-c024-4ed3-9b63-55cd6af86fd9 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:30.473530 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-ca19b626-97e4-4576-9598-8db3817ea1cf req-2420998d-c024-4ed3-9b63-55cd6af86fd9 service nova] Creating event network-vif-plugged:54a65686-35c5-4655-a6b6-8d82393a2555 for instance 4c7b99a9-2ec4-4f4b-98e7-8e1ea2103735 on nch1-master-1 Oct 22 20:51:30.482482 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-ca19b626-97e4-4576-9598-8db3817ea1cf req-2420998d-c024-4ed3-9b63-55cd6af86fd9 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065879 Oct 22 20:51:30.488712 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 399/747] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:51:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:51:30.508620 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-4d763775-b1a2-4752-b96c-0b67c1e4666b tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:51:30.509376 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-4d763775-b1a2-4752-b96c-0b67c1e4666b tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] [instance: 6da11c1d-55e8-4d3f-b045-44f67f397741] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:51:30.532463 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4d763775-b1a2-4752-b96c-0b67c1e4666b tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:30.533674 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4d763775-b1a2-4752-b96c-0b67c1e4666b tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:30.534369 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4d763775-b1a2-4752-b96c-0b67c1e4666b tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:30.535364 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4d763775-b1a2-4752-b96c-0b67c1e4666b tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:30.536035 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4d763775-b1a2-4752-b96c-0b67c1e4666b tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:30.537185 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4d763775-b1a2-4752-b96c-0b67c1e4666b tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:30.558418 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-fb604acd-37da-4346-a66b-790b3f4a78b6 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:51:30.559584 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-fb604acd-37da-4346-a66b-790b3f4a78b6 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] [instance: fe83cd49-4ceb-49aa-a775-cc2a4229fd76] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:51:30.586816 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:51:30.598495 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fb604acd-37da-4346-a66b-790b3f4a78b6 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:30.604675 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fb604acd-37da-4346-a66b-790b3f4a78b6 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:30.606315 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fb604acd-37da-4346-a66b-790b3f4a78b6 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:30.607417 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fb604acd-37da-4346-a66b-790b3f4a78b6 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:30.608999 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fb604acd-37da-4346-a66b-790b3f4a78b6 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:30.610559 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fb604acd-37da-4346-a66b-790b3f4a78b6 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:30.698048 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-4d763775-b1a2-4752-b96c-0b67c1e4666b tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084d99ccb7dc405f85b1d31cfd255e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '950a163a28d64f41855e56cf88e3b1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:51:30.710520 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-4d763775-b1a2-4752-b96c-0b67c1e4666b tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] 10.222.0.18 "GET /compute/v2.1/servers/6da11c1d-55e8-4d3f-b045-44f67f397741" status: 200 len: 1279 microversion: 2.1 time: 0.206376 Oct 22 20:51:30.711118 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 349/748] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:51:30 2022] GET /compute/v2.1/servers/6da11c1d-55e8-4d3f-b045-44f67f397741 => generated 1279 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:51:31.067627 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-fb604acd-37da-4346-a66b-790b3f4a78b6 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c87f0356ca346f39c6216393d85da2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee8c8f7fc4e12bc1f9fcce3e7b581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:51:31.076541 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-fb604acd-37da-4346-a66b-790b3f4a78b6 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] 10.222.0.18 "GET /compute/v2.1/servers/fe83cd49-4ceb-49aa-a775-cc2a4229fd76" status: 200 len: 1503 microversion: 2.1 time: 0.523395 Oct 22 20:51:31.078170 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 400/749] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:51:30 2022] GET /compute/v2.1/servers/fe83cd49-4ceb-49aa-a775-cc2a4229fd76 => generated 1503 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 20:51:31.267301 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-fd64b457-8400-49b1-b13b-b5c9e8b0b696 req-8e9ce256-d56a-4985-807a-a9fbbb368036 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c190c6e5-8b3b-4946-bb18-01fa5aba6fd2", "tag": "03a35398-bc84-47a3-a7d7-714c7d535cfa"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:51:31.284428 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell0:SELECT=1 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:51:31.288199 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-fd64b457-8400-49b1-b13b-b5c9e8b0b696 req-8e9ce256-d56a-4985-807a-a9fbbb368036 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:31.288773 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-fd64b457-8400-49b1-b13b-b5c9e8b0b696 req-8e9ce256-d56a-4985-807a-a9fbbb368036 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:31.289467 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-fd64b457-8400-49b1-b13b-b5c9e8b0b696 req-8e9ce256-d56a-4985-807a-a9fbbb368036 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:31.308690 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-fd64b457-8400-49b1-b13b-b5c9e8b0b696 req-8e9ce256-d56a-4985-807a-a9fbbb368036 service nova] Creating event network-changed:03a35398-bc84-47a3-a7d7-714c7d535cfa for instance c190c6e5-8b3b-4946-bb18-01fa5aba6fd2 on nch1-master-1 Oct 22 20:51:31.316155 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-fd64b457-8400-49b1-b13b-b5c9e8b0b696 req-8e9ce256-d56a-4985-807a-a9fbbb368036 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053187 Oct 22 20:51:31.317233 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 350/750] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:51:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:51:31.431237 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-2f9a4733-ee75-4670-a24b-68d3d403a2a3 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:51:31.433847 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-2f9a4733-ee75-4670-a24b-68d3d403a2a3 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] [instance: 4c7b99a9-2ec4-4f4b-98e7-8e1ea2103735] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:51:31.445519 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2f9a4733-ee75-4670-a24b-68d3d403a2a3 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:31.446319 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-ea488117-1dbd-4ec5-a026-14808e05d868 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:51:31.447202 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-ea488117-1dbd-4ec5-a026-14808e05d868 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] [instance: c190c6e5-8b3b-4946-bb18-01fa5aba6fd2] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:51:31.448144 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2f9a4733-ee75-4670-a24b-68d3d403a2a3 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:31.449191 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2f9a4733-ee75-4670-a24b-68d3d403a2a3 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:31.450140 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2f9a4733-ee75-4670-a24b-68d3d403a2a3 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:31.451173 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2f9a4733-ee75-4670-a24b-68d3d403a2a3 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:31.451879 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2f9a4733-ee75-4670-a24b-68d3d403a2a3 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:31.455814 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ea488117-1dbd-4ec5-a026-14808e05d868 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:31.460022 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ea488117-1dbd-4ec5-a026-14808e05d868 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:31.460483 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ea488117-1dbd-4ec5-a026-14808e05d868 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:31.464817 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ea488117-1dbd-4ec5-a026-14808e05d868 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:31.465296 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ea488117-1dbd-4ec5-a026-14808e05d868 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:31.465755 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ea488117-1dbd-4ec5-a026-14808e05d868 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:31.729543 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-2f9a4733-ee75-4670-a24b-68d3d403a2a3 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:51:31.742632 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-2f9a4733-ee75-4670-a24b-68d3d403a2a3 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:51:31.746269 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-2f9a4733-ee75-4670-a24b-68d3d403a2a3 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:51:31.748537 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-2f9a4733-ee75-4670-a24b-68d3d403a2a3 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] 10.222.0.18 "GET /compute/v2.1/servers/4c7b99a9-2ec4-4f4b-98e7-8e1ea2103735" status: 200 len: 1410 microversion: 2.25 time: 0.325089 Oct 22 20:51:31.748688 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-ea488117-1dbd-4ec5-a026-14808e05d868 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91cf84a287b74618ae1b3368785b0b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902e239d67664098895ab24340b0b780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:51:31.749601 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 401/751] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 20:51:31 2022] GET /compute/v2.1/servers/4c7b99a9-2ec4-4f4b-98e7-8e1ea2103735 => generated 1410 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 20:51:31.757364 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-3afc1841-9680-453a-8ded-52004b2a5d9d tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:51:31.758375 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-3afc1841-9680-453a-8ded-52004b2a5d9d tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] [instance: 58846d5b-1bfa-42cd-92a3-546b110ff64b] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:51:31.763192 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-ea488117-1dbd-4ec5-a026-14808e05d868 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] 10.222.0.18 "GET /compute/v2.1/servers/c190c6e5-8b3b-4946-bb18-01fa5aba6fd2" status: 200 len: 1318 microversion: 2.1 time: 0.321934 Oct 22 20:51:31.775367 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 351/752] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:51:31 2022] GET /compute/v2.1/servers/c190c6e5-8b3b-4946-bb18-01fa5aba6fd2 => generated 1318 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 20:51:31.775367 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-099a427d-f317-4a37-9e6b-a617b91a0ddd req-a22eb336-97bb-443d-a02a-6319eca5f253 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58846d5b-1bfa-42cd-92a3-546b110ff64b", "tag": "6fea6402-4ea4-46cb-b608-a01b3e495aa0"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:51:31.779373 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3afc1841-9680-453a-8ded-52004b2a5d9d tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:31.779373 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3afc1841-9680-453a-8ded-52004b2a5d9d tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:31.779373 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3afc1841-9680-453a-8ded-52004b2a5d9d tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:31.779868 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3afc1841-9680-453a-8ded-52004b2a5d9d tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:31.780344 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3afc1841-9680-453a-8ded-52004b2a5d9d tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:31.781027 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3afc1841-9680-453a-8ded-52004b2a5d9d tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:31.795019 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-099a427d-f317-4a37-9e6b-a617b91a0ddd req-a22eb336-97bb-443d-a02a-6319eca5f253 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:31.795805 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-099a427d-f317-4a37-9e6b-a617b91a0ddd req-a22eb336-97bb-443d-a02a-6319eca5f253 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:31.796301 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-099a427d-f317-4a37-9e6b-a617b91a0ddd req-a22eb336-97bb-443d-a02a-6319eca5f253 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:31.811561 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-099a427d-f317-4a37-9e6b-a617b91a0ddd req-a22eb336-97bb-443d-a02a-6319eca5f253 service nova] Creating event network-changed:6fea6402-4ea4-46cb-b608-a01b3e495aa0 for instance 58846d5b-1bfa-42cd-92a3-546b110ff64b on nch1-master-1 Oct 22 20:51:31.825484 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-099a427d-f317-4a37-9e6b-a617b91a0ddd req-a22eb336-97bb-443d-a02a-6319eca5f253 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059730 Oct 22 20:51:31.826616 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 352/753] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:51:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:51:31.849123 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-dd5b6ea3-6893-404f-910a-277b47370cbe tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:51:31.849879 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-dd5b6ea3-6893-404f-910a-277b47370cbe tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] [instance: 6da11c1d-55e8-4d3f-b045-44f67f397741] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:51:31.857663 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-dd5b6ea3-6893-404f-910a-277b47370cbe tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:31.858168 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-dd5b6ea3-6893-404f-910a-277b47370cbe tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:31.858609 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-dd5b6ea3-6893-404f-910a-277b47370cbe tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:31.859413 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-dd5b6ea3-6893-404f-910a-277b47370cbe tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:31.859977 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-dd5b6ea3-6893-404f-910a-277b47370cbe tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:31.860626 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-dd5b6ea3-6893-404f-910a-277b47370cbe tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:31.995840 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-3afc1841-9680-453a-8ded-52004b2a5d9d tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da7143c3bfb46a7b193a8d96f1b75b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598f129979a34e7a856b83bd0e69f1b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:51:32.009133 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-3afc1841-9680-453a-8ded-52004b2a5d9d tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] 10.222.0.18 "GET /compute/v2.1/servers/58846d5b-1bfa-42cd-92a3-546b110ff64b" status: 200 len: 1483 microversion: 2.1 time: 0.257903 Oct 22 20:51:32.011878 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 402/754] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:51:31 2022] GET /compute/v2.1/servers/58846d5b-1bfa-42cd-92a3-546b110ff64b => generated 1483 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:51:32.072168 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-dd5b6ea3-6893-404f-910a-277b47370cbe tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084d99ccb7dc405f85b1d31cfd255e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '950a163a28d64f41855e56cf88e3b1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:51:32.081019 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-dd5b6ea3-6893-404f-910a-277b47370cbe tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] 10.222.0.18 "GET /compute/v2.1/servers/6da11c1d-55e8-4d3f-b045-44f67f397741" status: 200 len: 1321 microversion: 2.1 time: 0.253199 Oct 22 20:51:32.081625 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 353/755] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:51:31 2022] GET /compute/v2.1/servers/6da11c1d-55e8-4d3f-b045-44f67f397741 => generated 1321 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:51:32.104528 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-3be4894d-4e03-491b-ab5f-575d80cc446b tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:51:32.111504 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-3be4894d-4e03-491b-ab5f-575d80cc446b tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] [instance: fe83cd49-4ceb-49aa-a775-cc2a4229fd76] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:51:32.120484 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3be4894d-4e03-491b-ab5f-575d80cc446b tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:32.121778 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3be4894d-4e03-491b-ab5f-575d80cc446b tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:32.122410 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3be4894d-4e03-491b-ab5f-575d80cc446b tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:32.123120 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3be4894d-4e03-491b-ab5f-575d80cc446b tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:32.126417 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3be4894d-4e03-491b-ab5f-575d80cc446b tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:32.127896 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3be4894d-4e03-491b-ab5f-575d80cc446b tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:32.669079 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-3be4894d-4e03-491b-ab5f-575d80cc446b tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c87f0356ca346f39c6216393d85da2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee8c8f7fc4e12bc1f9fcce3e7b581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:51:32.694447 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-3be4894d-4e03-491b-ab5f-575d80cc446b tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] 10.222.0.18 "GET /compute/v2.1/servers/fe83cd49-4ceb-49aa-a775-cc2a4229fd76" status: 200 len: 1503 microversion: 2.1 time: 0.597260 Oct 22 20:51:32.699778 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 403/756] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:51:32 2022] GET /compute/v2.1/servers/fe83cd49-4ceb-49aa-a775-cc2a4229fd76 => generated 1503 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:51:32.779051 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-d4a2f0db-3c45-48ce-bc90-6d4b2833754a tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:51:32.779733 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-d4a2f0db-3c45-48ce-bc90-6d4b2833754a tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] [instance: 4c7b99a9-2ec4-4f4b-98e7-8e1ea2103735] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:51:32.788783 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-dffefcd5-1df7-47a5-bbc7-b9b2925a4f19 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:51:32.789744 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-dffefcd5-1df7-47a5-bbc7-b9b2925a4f19 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] [instance: c190c6e5-8b3b-4946-bb18-01fa5aba6fd2] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:51:32.797840 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-dffefcd5-1df7-47a5-bbc7-b9b2925a4f19 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:32.798822 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-dffefcd5-1df7-47a5-bbc7-b9b2925a4f19 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:32.799065 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d4a2f0db-3c45-48ce-bc90-6d4b2833754a tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:32.799615 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d4a2f0db-3c45-48ce-bc90-6d4b2833754a tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:32.799932 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-dffefcd5-1df7-47a5-bbc7-b9b2925a4f19 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:32.800044 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d4a2f0db-3c45-48ce-bc90-6d4b2833754a tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:32.800922 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d4a2f0db-3c45-48ce-bc90-6d4b2833754a tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:32.801168 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-dffefcd5-1df7-47a5-bbc7-b9b2925a4f19 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:32.801373 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d4a2f0db-3c45-48ce-bc90-6d4b2833754a tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:32.801929 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-dffefcd5-1df7-47a5-bbc7-b9b2925a4f19 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:32.802043 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d4a2f0db-3c45-48ce-bc90-6d4b2833754a tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:32.802699 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-dffefcd5-1df7-47a5-bbc7-b9b2925a4f19 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:33.116063 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-dffefcd5-1df7-47a5-bbc7-b9b2925a4f19 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91cf84a287b74618ae1b3368785b0b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902e239d67664098895ab24340b0b780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:51:33.120241 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-d4a2f0db-3c45-48ce-bc90-6d4b2833754a tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:51:33.126210 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-dffefcd5-1df7-47a5-bbc7-b9b2925a4f19 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] 10.222.0.18 "GET /compute/v2.1/servers/c190c6e5-8b3b-4946-bb18-01fa5aba6fd2" status: 200 len: 1318 microversion: 2.1 time: 0.342426 Oct 22 20:51:33.128192 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:SELECT=100 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:51:33.131849 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-d4a2f0db-3c45-48ce-bc90-6d4b2833754a tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:51:33.133653 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-d4a2f0db-3c45-48ce-bc90-6d4b2833754a tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:51:33.135168 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-d4a2f0db-3c45-48ce-bc90-6d4b2833754a tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] 10.222.0.18 "GET /compute/v2.1/servers/4c7b99a9-2ec4-4f4b-98e7-8e1ea2103735" status: 200 len: 1606 microversion: 2.25 time: 0.360718 Oct 22 20:51:33.135927 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 354/757] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 20:51:32 2022] GET /compute/v2.1/servers/4c7b99a9-2ec4-4f4b-98e7-8e1ea2103735 => generated 1606 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 20:51:33.147450 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 404/758] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:51:32 2022] GET /compute/v2.1/servers/c190c6e5-8b3b-4946-bb18-01fa5aba6fd2 => generated 1318 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:51:33.149567 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-f035df38-37d6-4963-b82f-480b411677fe req-237c62f1-215a-45d2-a84b-29f81d2a7501 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ef975af-c582-4e7e-9913-e4be1688f81d", "name": "network-vif-plugged", "status": "completed", "tag": "15aed3a5-c90a-49b8-9c3c-f9d8afe7023d"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:51:33.158854 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-3eb6486e-1015-43c9-99bc-94a2c77a5dc3 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:51:33.159593 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-3eb6486e-1015-43c9-99bc-94a2c77a5dc3 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] [instance: 6da11c1d-55e8-4d3f-b045-44f67f397741] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:51:33.168843 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-f035df38-37d6-4963-b82f-480b411677fe req-237c62f1-215a-45d2-a84b-29f81d2a7501 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:33.169856 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-f035df38-37d6-4963-b82f-480b411677fe req-237c62f1-215a-45d2-a84b-29f81d2a7501 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:33.170578 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3eb6486e-1015-43c9-99bc-94a2c77a5dc3 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:33.171028 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-f035df38-37d6-4963-b82f-480b411677fe req-237c62f1-215a-45d2-a84b-29f81d2a7501 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:33.171874 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3eb6486e-1015-43c9-99bc-94a2c77a5dc3 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:33.172519 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3eb6486e-1015-43c9-99bc-94a2c77a5dc3 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:33.173501 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3eb6486e-1015-43c9-99bc-94a2c77a5dc3 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:33.174169 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3eb6486e-1015-43c9-99bc-94a2c77a5dc3 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:33.174789 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3eb6486e-1015-43c9-99bc-94a2c77a5dc3 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:33.194496 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-f035df38-37d6-4963-b82f-480b411677fe req-237c62f1-215a-45d2-a84b-29f81d2a7501 service nova] Creating event network-vif-plugged:15aed3a5-c90a-49b8-9c3c-f9d8afe7023d for instance 4ef975af-c582-4e7e-9913-e4be1688f81d on nch2-master-1 Oct 22 20:51:33.201162 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-f035df38-37d6-4963-b82f-480b411677fe req-237c62f1-215a-45d2-a84b-29f81d2a7501 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058145 Oct 22 20:51:33.202090 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 405/759] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:51:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:51:33.209947 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-755d5cb6-1a2b-4890-8e98-e2d3c6970f0f tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:51:33.210540 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-755d5cb6-1a2b-4890-8e98-e2d3c6970f0f tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] [instance: 4c7b99a9-2ec4-4f4b-98e7-8e1ea2103735] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:51:33.217020 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-755d5cb6-1a2b-4890-8e98-e2d3c6970f0f tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:33.217513 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-755d5cb6-1a2b-4890-8e98-e2d3c6970f0f tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:33.217954 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-755d5cb6-1a2b-4890-8e98-e2d3c6970f0f tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:33.218912 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-755d5cb6-1a2b-4890-8e98-e2d3c6970f0f tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:33.219573 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-755d5cb6-1a2b-4890-8e98-e2d3c6970f0f tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:33.220014 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-755d5cb6-1a2b-4890-8e98-e2d3c6970f0f tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:33.330961 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-755d5cb6-1a2b-4890-8e98-e2d3c6970f0f tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] 10.222.0.18 "GET /compute/v2.1/servers/4c7b99a9-2ec4-4f4b-98e7-8e1ea2103735/os-interface" status: 200 len: 284 microversion: 2.25 time: 0.127388 Oct 22 20:51:33.332159 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 406/760] 10.222.0.18 () {60 vars in 1316 bytes} [Sat Oct 22 20:51:33 2022] GET /compute/v2.1/servers/4c7b99a9-2ec4-4f4b-98e7-8e1ea2103735/os-interface => generated 284 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 22 20:51:33.362335 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-1107aa5c-ac71-4477-b019-f6571b19e5f3 req-37de8e25-32f2-4171-9d0e-799d22dfd49d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6da11c1d-55e8-4d3f-b045-44f67f397741", "tag": "83b107b1-58e6-4421-bfb7-8ecd1dc64829"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:51:33.377189 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-1107aa5c-ac71-4477-b019-f6571b19e5f3 req-37de8e25-32f2-4171-9d0e-799d22dfd49d service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:33.377763 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-1107aa5c-ac71-4477-b019-f6571b19e5f3 req-37de8e25-32f2-4171-9d0e-799d22dfd49d service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:33.378447 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-1107aa5c-ac71-4477-b019-f6571b19e5f3 req-37de8e25-32f2-4171-9d0e-799d22dfd49d service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:33.396421 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-1107aa5c-ac71-4477-b019-f6571b19e5f3 req-37de8e25-32f2-4171-9d0e-799d22dfd49d service nova] Creating event network-changed:83b107b1-58e6-4421-bfb7-8ecd1dc64829 for instance 6da11c1d-55e8-4d3f-b045-44f67f397741 on nch2-master-1 Oct 22 20:51:33.406260 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-1107aa5c-ac71-4477-b019-f6571b19e5f3 req-37de8e25-32f2-4171-9d0e-799d22dfd49d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049107 Oct 22 20:51:33.407593 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 407/761] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:51:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:51:33.463258 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-3eb6486e-1015-43c9-99bc-94a2c77a5dc3 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084d99ccb7dc405f85b1d31cfd255e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '950a163a28d64f41855e56cf88e3b1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:51:33.475314 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-3eb6486e-1015-43c9-99bc-94a2c77a5dc3 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] 10.222.0.18 "GET /compute/v2.1/servers/6da11c1d-55e8-4d3f-b045-44f67f397741" status: 200 len: 1321 microversion: 2.1 time: 0.326161 Oct 22 20:51:33.477423 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 355/762] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:51:33 2022] GET /compute/v2.1/servers/6da11c1d-55e8-4d3f-b045-44f67f397741 => generated 1321 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:51:33.724317 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-7b8fda8f-2d29-4cc7-8e0a-c500ceb24760 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:51:33.725197 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-7b8fda8f-2d29-4cc7-8e0a-c500ceb24760 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] [instance: fe83cd49-4ceb-49aa-a775-cc2a4229fd76] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:51:33.733320 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7b8fda8f-2d29-4cc7-8e0a-c500ceb24760 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:33.734170 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7b8fda8f-2d29-4cc7-8e0a-c500ceb24760 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:33.734773 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7b8fda8f-2d29-4cc7-8e0a-c500ceb24760 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:33.735602 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7b8fda8f-2d29-4cc7-8e0a-c500ceb24760 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:33.736143 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7b8fda8f-2d29-4cc7-8e0a-c500ceb24760 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:33.736634 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7b8fda8f-2d29-4cc7-8e0a-c500ceb24760 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:33.972661 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-7b8fda8f-2d29-4cc7-8e0a-c500ceb24760 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c87f0356ca346f39c6216393d85da2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee8c8f7fc4e12bc1f9fcce3e7b581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:51:33.980917 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-7b8fda8f-2d29-4cc7-8e0a-c500ceb24760 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] 10.222.0.18 "GET /compute/v2.1/servers/fe83cd49-4ceb-49aa-a775-cc2a4229fd76" status: 200 len: 1493 microversion: 2.1 time: 0.261072 Oct 22 20:51:33.981526 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 408/763] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:51:33 2022] GET /compute/v2.1/servers/fe83cd49-4ceb-49aa-a775-cc2a4229fd76 => generated 1493 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:51:34.003402 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-4a53d089-59c7-4937-9d91-61e5b73ad4bb tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] Calling method '.version_select at 0x7fd3a4bbc700>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:51:34.006871 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4a53d089-59c7-4937-9d91-61e5b73ad4bb tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:34.007369 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4a53d089-59c7-4937-9d91-61e5b73ad4bb tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:34.007815 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4a53d089-59c7-4937-9d91-61e5b73ad4bb tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:34.017304 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-4a53d089-59c7-4937-9d91-61e5b73ad4bb tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] 10.222.0.18 "GET /compute/v2.1/os-migrations" status: 200 len: 1166 microversion: 2.1 time: 0.017829 Oct 22 20:51:34.017865 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 356/764] 10.222.0.18 () {58 vars in 1143 bytes} [Sat Oct 22 20:51:33 2022] GET /compute/v2.1/os-migrations => generated 1166 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:51:34.031718 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-1c06ca14-105e-4a67-a1a8-0b004002549b tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:51:34.032328 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-1c06ca14-105e-4a67-a1a8-0b004002549b tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] [instance: fe83cd49-4ceb-49aa-a775-cc2a4229fd76] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:51:34.038389 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1c06ca14-105e-4a67-a1a8-0b004002549b tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:34.038876 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1c06ca14-105e-4a67-a1a8-0b004002549b tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:34.039309 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1c06ca14-105e-4a67-a1a8-0b004002549b tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:34.040038 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1c06ca14-105e-4a67-a1a8-0b004002549b tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:34.040487 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1c06ca14-105e-4a67-a1a8-0b004002549b tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:34.040910 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1c06ca14-105e-4a67-a1a8-0b004002549b tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:34.148885 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-48eef11e-f9e4-4d74-bb8b-8e90579259ea tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:51:34.149504 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-48eef11e-f9e4-4d74-bb8b-8e90579259ea tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] [instance: c190c6e5-8b3b-4946-bb18-01fa5aba6fd2] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:51:34.163626 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-48eef11e-f9e4-4d74-bb8b-8e90579259ea tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:34.164222 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-48eef11e-f9e4-4d74-bb8b-8e90579259ea tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:34.164804 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-48eef11e-f9e4-4d74-bb8b-8e90579259ea tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:34.165614 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-48eef11e-f9e4-4d74-bb8b-8e90579259ea tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:34.166233 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-48eef11e-f9e4-4d74-bb8b-8e90579259ea tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:34.166842 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-48eef11e-f9e4-4d74-bb8b-8e90579259ea tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:34.302115 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell1:SELECT=100 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:51:34.308037 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-1c06ca14-105e-4a67-a1a8-0b004002549b tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/fe83cd49-4ceb-49aa-a775-cc2a4229fd76" status: 200 len: 1644 microversion: 2.1 time: 0.280050 Oct 22 20:51:34.308864 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 409/765] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:51:34 2022] GET /compute/v2.1/servers/fe83cd49-4ceb-49aa-a775-cc2a4229fd76 => generated 1644 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:51:34.399995 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-48eef11e-f9e4-4d74-bb8b-8e90579259ea tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91cf84a287b74618ae1b3368785b0b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902e239d67664098895ab24340b0b780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:51:34.408717 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-48eef11e-f9e4-4d74-bb8b-8e90579259ea tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] 10.222.0.18 "GET /compute/v2.1/servers/c190c6e5-8b3b-4946-bb18-01fa5aba6fd2" status: 200 len: 1318 microversion: 2.1 time: 0.263792 Oct 22 20:51:34.410063 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 357/766] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:51:34 2022] GET /compute/v2.1/servers/c190c6e5-8b3b-4946-bb18-01fa5aba6fd2 => generated 1318 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:51:34.441072 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-20bb59c0-643f-4d4e-bb82-b34c06e315c3 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1239349942", "imageRef": "085e4478-6edc-4a69-8e08-f9831713eb65", "flavorRef": "452", "networks": [{"uuid": "4282d9d7-1326-486a-8448-108826634658"}]}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:51:34.500877 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-0a7d850e-c3de-4e4a-b3b0-74abf6a04d6a tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:51:34.502127 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-0a7d850e-c3de-4e4a-b3b0-74abf6a04d6a tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] [instance: 6da11c1d-55e8-4d3f-b045-44f67f397741] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:51:34.503028 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.network.neutron [None req-20bb59c0-643f-4d4e-bb82-b34c06e315c3 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] validate_networks() for [('4282d9d7-1326-486a-8448-108826634658', None, None, None, None, None)] {{(pid=138745) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 20:51:34.509182 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0a7d850e-c3de-4e4a-b3b0-74abf6a04d6a tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:34.509675 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0a7d850e-c3de-4e4a-b3b0-74abf6a04d6a tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:34.510110 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0a7d850e-c3de-4e4a-b3b0-74abf6a04d6a tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:34.510923 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0a7d850e-c3de-4e4a-b3b0-74abf6a04d6a tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:34.511397 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0a7d850e-c3de-4e4a-b3b0-74abf6a04d6a tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:34.512208 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0a7d850e-c3de-4e4a-b3b0-74abf6a04d6a tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:34.737656 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-0a7d850e-c3de-4e4a-b3b0-74abf6a04d6a tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084d99ccb7dc405f85b1d31cfd255e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '950a163a28d64f41855e56cf88e3b1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:51:34.746244 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-0a7d850e-c3de-4e4a-b3b0-74abf6a04d6a tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] 10.222.0.18 "GET /compute/v2.1/servers/6da11c1d-55e8-4d3f-b045-44f67f397741" status: 200 len: 1321 microversion: 2.1 time: 0.252101 Oct 22 20:51:34.746832 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 358/767] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:51:34 2022] GET /compute/v2.1/servers/6da11c1d-55e8-4d3f-b045-44f67f397741 => generated 1321 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:51:34.762418 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-bb90f953-bb16-476a-bfed-5199cdbe5ec5 req-919a95aa-96db-4f45-a425-0c820214769d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c7b99a9-2ec4-4f4b-98e7-8e1ea2103735", "tag": "54a65686-35c5-4655-a6b6-8d82393a2555"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:51:34.772734 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-bb90f953-bb16-476a-bfed-5199cdbe5ec5 req-919a95aa-96db-4f45-a425-0c820214769d service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:34.773216 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-bb90f953-bb16-476a-bfed-5199cdbe5ec5 req-919a95aa-96db-4f45-a425-0c820214769d service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:34.773649 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-bb90f953-bb16-476a-bfed-5199cdbe5ec5 req-919a95aa-96db-4f45-a425-0c820214769d service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:34.787483 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-bb90f953-bb16-476a-bfed-5199cdbe5ec5 req-919a95aa-96db-4f45-a425-0c820214769d service nova] Creating event network-changed:54a65686-35c5-4655-a6b6-8d82393a2555 for instance 4c7b99a9-2ec4-4f4b-98e7-8e1ea2103735 on nch1-master-1 Oct 22 20:51:34.792908 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-bb90f953-bb16-476a-bfed-5199cdbe5ec5 req-919a95aa-96db-4f45-a425-0c820214769d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044687 Oct 22 20:51:34.793509 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 359/768] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:51:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:51:34.991538 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-20bb59c0-643f-4d4e-bb82-b34c06e315c3 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Flavor limits 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 20:51:34.992071 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-20bb59c0-643f-4d4e-bb82-b34c06e315c3 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Image limits 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 20:51:34.992457 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-20bb59c0-643f-4d4e-bb82-b34c06e315c3 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Flavor pref 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 20:51:34.992869 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-20bb59c0-643f-4d4e-bb82-b34c06e315c3 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Image pref 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 20:51:34.993314 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-20bb59c0-643f-4d4e-bb82-b34c06e315c3 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 20:51:35.003047 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-20bb59c0-643f-4d4e-bb82-b34c06e315c3 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:35.003587 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-20bb59c0-643f-4d4e-bb82-b34c06e315c3 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:35.004042 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-20bb59c0-643f-4d4e-bb82-b34c06e315c3 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:35.004779 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-20bb59c0-643f-4d4e-bb82-b34c06e315c3 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:35.005236 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-20bb59c0-643f-4d4e-bb82-b34c06e315c3 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:35.005665 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-20bb59c0-643f-4d4e-bb82-b34c06e315c3 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:35.022742 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-20bb59c0-643f-4d4e-bb82-b34c06e315c3 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Getting quotas for project 9f0ee8c8f7fc4e12bc1f9fcce3e7b581. Resources: {'cores', 'instances', 'ram'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 20:51:35.028256 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-20bb59c0-643f-4d4e-bb82-b34c06e315c3 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Getting quotas for user 2c87f0356ca346f39c6216393d85da2f and project 9f0ee8c8f7fc4e12bc1f9fcce3e7b581. Resources: {'cores', 'instances', 'ram'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 20:51:35.041091 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-20bb59c0-643f-4d4e-bb82-b34c06e315c3 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Going to run 1 instances... {{(pid=138745) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 20:51:35.043607 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-20bb59c0-643f-4d4e-bb82-b34c06e315c3 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] [instance: 2f02a0ad-4856-4643-9e69-50547f5c7a98] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='085e4478-6edc-4a69-8e08-f9831713eb65',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138745) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 20:51:35.091365 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-20bb59c0-643f-4d4e-bb82-b34c06e315c3 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.656277 Oct 22 20:51:35.098104 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 410/769] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Oct 22 20:51:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 658 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 20:51:35.105052 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-4e26f20a-9bcf-4d4c-835e-bfce670c99d6 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:51:35.105749 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-4e26f20a-9bcf-4d4c-835e-bfce670c99d6 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] [instance: 2f02a0ad-4856-4643-9e69-50547f5c7a98] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:51:35.175015 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-4e26f20a-9bcf-4d4c-835e-bfce670c99d6 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c87f0356ca346f39c6216393d85da2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee8c8f7fc4e12bc1f9fcce3e7b581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:51:35.185574 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-4e26f20a-9bcf-4d4c-835e-bfce670c99d6 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] 10.222.0.18 "GET /compute/v2.1/servers/2f02a0ad-4856-4643-9e69-50547f5c7a98" status: 200 len: 1211 microversion: 2.1 time: 0.085490 Oct 22 20:51:35.186351 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 360/770] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:51:35 2022] GET /compute/v2.1/servers/2f02a0ad-4856-4643-9e69-50547f5c7a98 => generated 1211 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:51:35.436080 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-2e0f20f5-a528-4056-a59d-990198b52211 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:51:35.437029 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-2e0f20f5-a528-4056-a59d-990198b52211 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] [instance: c190c6e5-8b3b-4946-bb18-01fa5aba6fd2] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:51:35.451067 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2e0f20f5-a528-4056-a59d-990198b52211 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:35.451677 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2e0f20f5-a528-4056-a59d-990198b52211 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:35.452110 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2e0f20f5-a528-4056-a59d-990198b52211 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:35.454357 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2e0f20f5-a528-4056-a59d-990198b52211 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:35.454844 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2e0f20f5-a528-4056-a59d-990198b52211 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:35.455274 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2e0f20f5-a528-4056-a59d-990198b52211 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:35.770808 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-d829ed3b-6adb-4999-baf0-b73e58a7389d tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:51:35.771801 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-d829ed3b-6adb-4999-baf0-b73e58a7389d tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] [instance: 6da11c1d-55e8-4d3f-b045-44f67f397741] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:51:35.779303 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d829ed3b-6adb-4999-baf0-b73e58a7389d tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:35.781357 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d829ed3b-6adb-4999-baf0-b73e58a7389d tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:35.781964 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d829ed3b-6adb-4999-baf0-b73e58a7389d tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:35.782862 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d829ed3b-6adb-4999-baf0-b73e58a7389d tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:35.783563 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d829ed3b-6adb-4999-baf0-b73e58a7389d tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:35.784237 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d829ed3b-6adb-4999-baf0-b73e58a7389d tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:35.789554 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-2e0f20f5-a528-4056-a59d-990198b52211 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91cf84a287b74618ae1b3368785b0b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902e239d67664098895ab24340b0b780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:51:35.798482 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-2e0f20f5-a528-4056-a59d-990198b52211 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] 10.222.0.18 "GET /compute/v2.1/servers/c190c6e5-8b3b-4946-bb18-01fa5aba6fd2" status: 200 len: 1318 microversion: 2.1 time: 0.368316 Oct 22 20:51:35.802179 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 411/771] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:51:35 2022] GET /compute/v2.1/servers/c190c6e5-8b3b-4946-bb18-01fa5aba6fd2 => generated 1318 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:51:36.099714 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-d829ed3b-6adb-4999-baf0-b73e58a7389d tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084d99ccb7dc405f85b1d31cfd255e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '950a163a28d64f41855e56cf88e3b1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:51:36.114381 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-d829ed3b-6adb-4999-baf0-b73e58a7389d tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] 10.222.0.18 "GET /compute/v2.1/servers/6da11c1d-55e8-4d3f-b045-44f67f397741" status: 200 len: 1321 microversion: 2.1 time: 0.346845 Oct 22 20:51:36.116831 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 361/772] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:51:35 2022] GET /compute/v2.1/servers/6da11c1d-55e8-4d3f-b045-44f67f397741 => generated 1321 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 20:51:36.210602 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-9079c866-f975-4882-a20a-cf46f152036b tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:51:36.211183 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-9079c866-f975-4882-a20a-cf46f152036b tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] [instance: 2f02a0ad-4856-4643-9e69-50547f5c7a98] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:51:36.217618 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9079c866-f975-4882-a20a-cf46f152036b tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:36.218413 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9079c866-f975-4882-a20a-cf46f152036b tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:36.218949 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9079c866-f975-4882-a20a-cf46f152036b tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:36.219774 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9079c866-f975-4882-a20a-cf46f152036b tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:36.220291 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9079c866-f975-4882-a20a-cf46f152036b tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:36.220778 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9079c866-f975-4882-a20a-cf46f152036b tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:36.293274 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-9079c866-f975-4882-a20a-cf46f152036b tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c87f0356ca346f39c6216393d85da2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee8c8f7fc4e12bc1f9fcce3e7b581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:51:36.301409 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-9079c866-f975-4882-a20a-cf46f152036b tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] 10.222.0.18 "GET /compute/v2.1/servers/2f02a0ad-4856-4643-9e69-50547f5c7a98" status: 200 len: 1263 microversion: 2.1 time: 0.095104 Oct 22 20:51:36.302108 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 412/773] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:51:36 2022] GET /compute/v2.1/servers/2f02a0ad-4856-4643-9e69-50547f5c7a98 => generated 1263 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:51:36.826250 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-eb5948a1-c9f4-40ce-88e6-775845e93f80 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:51:36.826945 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-eb5948a1-c9f4-40ce-88e6-775845e93f80 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] [instance: c190c6e5-8b3b-4946-bb18-01fa5aba6fd2] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:51:36.833204 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-eb5948a1-c9f4-40ce-88e6-775845e93f80 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:36.833796 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-eb5948a1-c9f4-40ce-88e6-775845e93f80 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:36.834303 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-eb5948a1-c9f4-40ce-88e6-775845e93f80 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:36.835067 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-eb5948a1-c9f4-40ce-88e6-775845e93f80 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:36.835784 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-eb5948a1-c9f4-40ce-88e6-775845e93f80 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:36.836272 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-eb5948a1-c9f4-40ce-88e6-775845e93f80 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:36.971631 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-eb5948a1-c9f4-40ce-88e6-775845e93f80 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91cf84a287b74618ae1b3368785b0b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902e239d67664098895ab24340b0b780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:51:36.980214 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-eb5948a1-c9f4-40ce-88e6-775845e93f80 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] 10.222.0.18 "GET /compute/v2.1/servers/c190c6e5-8b3b-4946-bb18-01fa5aba6fd2" status: 200 len: 1318 microversion: 2.1 time: 0.157822 Oct 22 20:51:36.980792 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 362/774] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:51:36 2022] GET /compute/v2.1/servers/c190c6e5-8b3b-4946-bb18-01fa5aba6fd2 => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:51:37.142400 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-25ec1f8b-d257-448f-943a-75b289301f05 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:51:37.143130 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-25ec1f8b-d257-448f-943a-75b289301f05 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] [instance: 6da11c1d-55e8-4d3f-b045-44f67f397741] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:51:37.152786 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-25ec1f8b-d257-448f-943a-75b289301f05 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:37.153276 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-25ec1f8b-d257-448f-943a-75b289301f05 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:37.153816 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-25ec1f8b-d257-448f-943a-75b289301f05 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:37.154524 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-25ec1f8b-d257-448f-943a-75b289301f05 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:37.154977 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-25ec1f8b-d257-448f-943a-75b289301f05 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:37.155460 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-25ec1f8b-d257-448f-943a-75b289301f05 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:37.326270 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-c19671b5-ca1d-4242-b713-0ca29d4eaf88 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:51:37.326927 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-c19671b5-ca1d-4242-b713-0ca29d4eaf88 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] [instance: 2f02a0ad-4856-4643-9e69-50547f5c7a98] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:51:37.327046 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-25ec1f8b-d257-448f-943a-75b289301f05 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084d99ccb7dc405f85b1d31cfd255e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '950a163a28d64f41855e56cf88e3b1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:51:37.337905 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c19671b5-ca1d-4242-b713-0ca29d4eaf88 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:37.338625 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c19671b5-ca1d-4242-b713-0ca29d4eaf88 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:37.339222 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c19671b5-ca1d-4242-b713-0ca29d4eaf88 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:37.340374 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c19671b5-ca1d-4242-b713-0ca29d4eaf88 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:37.340978 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c19671b5-ca1d-4242-b713-0ca29d4eaf88 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:37.341564 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c19671b5-ca1d-4242-b713-0ca29d4eaf88 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:37.342293 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-25ec1f8b-d257-448f-943a-75b289301f05 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] 10.222.0.18 "GET /compute/v2.1/servers/6da11c1d-55e8-4d3f-b045-44f67f397741" status: 200 len: 1321 microversion: 2.1 time: 0.203974 Oct 22 20:51:37.346585 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 413/775] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:51:37 2022] GET /compute/v2.1/servers/6da11c1d-55e8-4d3f-b045-44f67f397741 => generated 1321 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:51:37.412437 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-c19671b5-ca1d-4242-b713-0ca29d4eaf88 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c87f0356ca346f39c6216393d85da2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee8c8f7fc4e12bc1f9fcce3e7b581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:51:37.420453 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-c19671b5-ca1d-4242-b713-0ca29d4eaf88 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] 10.222.0.18 "GET /compute/v2.1/servers/2f02a0ad-4856-4643-9e69-50547f5c7a98" status: 200 len: 1269 microversion: 2.1 time: 0.099240 Oct 22 20:51:37.421253 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 363/776] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:51:37 2022] GET /compute/v2.1/servers/2f02a0ad-4856-4643-9e69-50547f5c7a98 => generated 1269 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:51:38.005135 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-ebf103a8-5850-470d-a47a-73d57a3c0c01 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:51:38.006335 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-ebf103a8-5850-470d-a47a-73d57a3c0c01 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] [instance: c190c6e5-8b3b-4946-bb18-01fa5aba6fd2] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:51:38.013097 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ebf103a8-5850-470d-a47a-73d57a3c0c01 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:38.013752 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ebf103a8-5850-470d-a47a-73d57a3c0c01 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:38.014022 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ebf103a8-5850-470d-a47a-73d57a3c0c01 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:38.014990 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ebf103a8-5850-470d-a47a-73d57a3c0c01 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:38.016229 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ebf103a8-5850-470d-a47a-73d57a3c0c01 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:38.016369 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ebf103a8-5850-470d-a47a-73d57a3c0c01 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:38.181029 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-ebf103a8-5850-470d-a47a-73d57a3c0c01 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91cf84a287b74618ae1b3368785b0b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902e239d67664098895ab24340b0b780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:51:38.190126 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-ebf103a8-5850-470d-a47a-73d57a3c0c01 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] 10.222.0.18 "GET /compute/v2.1/servers/c190c6e5-8b3b-4946-bb18-01fa5aba6fd2" status: 200 len: 1318 microversion: 2.1 time: 0.188752 Oct 22 20:51:38.191245 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 414/777] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:51:37 2022] GET /compute/v2.1/servers/c190c6e5-8b3b-4946-bb18-01fa5aba6fd2 => generated 1318 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:51:38.365340 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-47ad74fc-69fa-4358-a7d1-3b2faa7b337d tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:51:38.365964 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-47ad74fc-69fa-4358-a7d1-3b2faa7b337d tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] [instance: 6da11c1d-55e8-4d3f-b045-44f67f397741] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:51:38.369638 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_api:SELECT=100 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:51:38.374060 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-47ad74fc-69fa-4358-a7d1-3b2faa7b337d tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:38.374543 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-47ad74fc-69fa-4358-a7d1-3b2faa7b337d tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:38.375000 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-47ad74fc-69fa-4358-a7d1-3b2faa7b337d tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:38.375881 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-47ad74fc-69fa-4358-a7d1-3b2faa7b337d tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:38.376328 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-47ad74fc-69fa-4358-a7d1-3b2faa7b337d tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:38.376789 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-47ad74fc-69fa-4358-a7d1-3b2faa7b337d tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:38.446187 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-afbbfa65-0d9d-475b-a629-c4968e86c574 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:51:38.446882 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-afbbfa65-0d9d-475b-a629-c4968e86c574 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] [instance: 2f02a0ad-4856-4643-9e69-50547f5c7a98] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:51:38.454614 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-afbbfa65-0d9d-475b-a629-c4968e86c574 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:38.455154 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-afbbfa65-0d9d-475b-a629-c4968e86c574 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:38.455500 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-afbbfa65-0d9d-475b-a629-c4968e86c574 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:38.456474 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-afbbfa65-0d9d-475b-a629-c4968e86c574 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:38.456925 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-afbbfa65-0d9d-475b-a629-c4968e86c574 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:38.457345 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-afbbfa65-0d9d-475b-a629-c4968e86c574 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:38.534560 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-47ad74fc-69fa-4358-a7d1-3b2faa7b337d tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084d99ccb7dc405f85b1d31cfd255e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '950a163a28d64f41855e56cf88e3b1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:51:38.543044 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-47ad74fc-69fa-4358-a7d1-3b2faa7b337d tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] 10.222.0.18 "GET /compute/v2.1/servers/6da11c1d-55e8-4d3f-b045-44f67f397741" status: 200 len: 1321 microversion: 2.1 time: 0.181560 Oct 22 20:51:38.556438 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 364/778] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:51:38 2022] GET /compute/v2.1/servers/6da11c1d-55e8-4d3f-b045-44f67f397741 => generated 1321 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:51:38.569799 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-7434ed11-2dbc-4d58-a279-a33237f79956 req-39dbec02-8bc4-4d30-b828-334b1fe45527 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f02a0ad-4856-4643-9e69-50547f5c7a98", "tag": "eb2b7a79-4890-4efa-990a-815f0293cc40"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:51:38.582731 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-7434ed11-2dbc-4d58-a279-a33237f79956 req-39dbec02-8bc4-4d30-b828-334b1fe45527 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:38.583218 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-7434ed11-2dbc-4d58-a279-a33237f79956 req-39dbec02-8bc4-4d30-b828-334b1fe45527 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:38.583682 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-7434ed11-2dbc-4d58-a279-a33237f79956 req-39dbec02-8bc4-4d30-b828-334b1fe45527 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:38.600703 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-7434ed11-2dbc-4d58-a279-a33237f79956 req-39dbec02-8bc4-4d30-b828-334b1fe45527 service nova] Creating event network-changed:eb2b7a79-4890-4efa-990a-815f0293cc40 for instance 2f02a0ad-4856-4643-9e69-50547f5c7a98 on nch2-master-1 Oct 22 20:51:38.609217 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-7434ed11-2dbc-4d58-a279-a33237f79956 req-39dbec02-8bc4-4d30-b828-334b1fe45527 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049021 Oct 22 20:51:38.610264 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 365/779] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:51:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:51:38.886462 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-afbbfa65-0d9d-475b-a629-c4968e86c574 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c87f0356ca346f39c6216393d85da2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee8c8f7fc4e12bc1f9fcce3e7b581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:51:38.895548 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-afbbfa65-0d9d-475b-a629-c4968e86c574 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] 10.222.0.18 "GET /compute/v2.1/servers/2f02a0ad-4856-4643-9e69-50547f5c7a98" status: 200 len: 1311 microversion: 2.1 time: 0.453156 Oct 22 20:51:38.896129 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 415/780] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:51:38 2022] GET /compute/v2.1/servers/2f02a0ad-4856-4643-9e69-50547f5c7a98 => generated 1311 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 20:51:38.914203 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-59aa60b5-a8d9-45a1-8a59-d550f1033794 req-48cffc24-75bc-461f-8310-80eac9b49ec6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6da11c1d-55e8-4d3f-b045-44f67f397741", "name": "network-vif-plugged", "status": "completed", "tag": "83b107b1-58e6-4421-bfb7-8ecd1dc64829"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:51:38.924837 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-59aa60b5-a8d9-45a1-8a59-d550f1033794 req-48cffc24-75bc-461f-8310-80eac9b49ec6 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:38.926096 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-59aa60b5-a8d9-45a1-8a59-d550f1033794 req-48cffc24-75bc-461f-8310-80eac9b49ec6 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:38.926583 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-59aa60b5-a8d9-45a1-8a59-d550f1033794 req-48cffc24-75bc-461f-8310-80eac9b49ec6 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:38.939760 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-59aa60b5-a8d9-45a1-8a59-d550f1033794 req-48cffc24-75bc-461f-8310-80eac9b49ec6 service nova] Creating event network-vif-plugged:83b107b1-58e6-4421-bfb7-8ecd1dc64829 for instance 6da11c1d-55e8-4d3f-b045-44f67f397741 on nch2-master-1 Oct 22 20:51:38.945289 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-59aa60b5-a8d9-45a1-8a59-d550f1033794 req-48cffc24-75bc-461f-8310-80eac9b49ec6 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035658 Oct 22 20:51:38.946585 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 366/781] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:51:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:51:39.215125 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-ac3ee52b-3132-428b-9176-55539f4a2ef7 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:51:39.215846 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-ac3ee52b-3132-428b-9176-55539f4a2ef7 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] [instance: c190c6e5-8b3b-4946-bb18-01fa5aba6fd2] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:51:39.225064 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ac3ee52b-3132-428b-9176-55539f4a2ef7 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:39.225895 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ac3ee52b-3132-428b-9176-55539f4a2ef7 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:39.226849 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ac3ee52b-3132-428b-9176-55539f4a2ef7 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:39.227934 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ac3ee52b-3132-428b-9176-55539f4a2ef7 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:39.228500 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ac3ee52b-3132-428b-9176-55539f4a2ef7 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:39.229081 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ac3ee52b-3132-428b-9176-55539f4a2ef7 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:39.359862 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-ac3ee52b-3132-428b-9176-55539f4a2ef7 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91cf84a287b74618ae1b3368785b0b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902e239d67664098895ab24340b0b780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:51:39.368025 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-ac3ee52b-3132-428b-9176-55539f4a2ef7 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] 10.222.0.18 "GET /compute/v2.1/servers/c190c6e5-8b3b-4946-bb18-01fa5aba6fd2" status: 200 len: 1318 microversion: 2.1 time: 0.158002 Oct 22 20:51:39.368590 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 416/782] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:51:39 2022] GET /compute/v2.1/servers/c190c6e5-8b3b-4946-bb18-01fa5aba6fd2 => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:51:39.575020 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-95b19429-74e1-492e-95ce-5c9fba3e81f1 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:51:39.576076 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-95b19429-74e1-492e-95ce-5c9fba3e81f1 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] [instance: 6da11c1d-55e8-4d3f-b045-44f67f397741] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:51:39.587547 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-95b19429-74e1-492e-95ce-5c9fba3e81f1 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:39.588361 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-95b19429-74e1-492e-95ce-5c9fba3e81f1 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:39.589134 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-95b19429-74e1-492e-95ce-5c9fba3e81f1 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:39.590337 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-95b19429-74e1-492e-95ce-5c9fba3e81f1 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:39.591089 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-95b19429-74e1-492e-95ce-5c9fba3e81f1 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:39.591848 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-95b19429-74e1-492e-95ce-5c9fba3e81f1 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:39.734644 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-95b19429-74e1-492e-95ce-5c9fba3e81f1 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084d99ccb7dc405f85b1d31cfd255e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '950a163a28d64f41855e56cf88e3b1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:51:39.742730 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-95b19429-74e1-492e-95ce-5c9fba3e81f1 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] 10.222.0.18 "GET /compute/v2.1/servers/6da11c1d-55e8-4d3f-b045-44f67f397741" status: 200 len: 1321 microversion: 2.1 time: 0.175033 Oct 22 20:51:39.743274 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 367/783] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:51:39 2022] GET /compute/v2.1/servers/6da11c1d-55e8-4d3f-b045-44f67f397741 => generated 1321 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:51:39.919135 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-8018da97-11bb-4d94-abb8-ee10c89607e3 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:51:39.920421 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-8018da97-11bb-4d94-abb8-ee10c89607e3 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] [instance: 2f02a0ad-4856-4643-9e69-50547f5c7a98] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:51:39.927282 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8018da97-11bb-4d94-abb8-ee10c89607e3 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:39.928094 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8018da97-11bb-4d94-abb8-ee10c89607e3 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:39.928674 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8018da97-11bb-4d94-abb8-ee10c89607e3 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:39.929491 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8018da97-11bb-4d94-abb8-ee10c89607e3 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:39.930064 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8018da97-11bb-4d94-abb8-ee10c89607e3 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:39.930586 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8018da97-11bb-4d94-abb8-ee10c89607e3 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:40.069202 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-8018da97-11bb-4d94-abb8-ee10c89607e3 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c87f0356ca346f39c6216393d85da2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee8c8f7fc4e12bc1f9fcce3e7b581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:51:40.078722 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-8018da97-11bb-4d94-abb8-ee10c89607e3 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] 10.222.0.18 "GET /compute/v2.1/servers/2f02a0ad-4856-4643-9e69-50547f5c7a98" status: 200 len: 1311 microversion: 2.1 time: 0.164202 Oct 22 20:51:40.079366 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 417/784] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:51:39 2022] GET /compute/v2.1/servers/2f02a0ad-4856-4643-9e69-50547f5c7a98 => generated 1311 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:51:40.393235 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-446a54a1-02c8-4f6f-bcd3-7b15745403e3 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:51:40.393845 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-446a54a1-02c8-4f6f-bcd3-7b15745403e3 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] [instance: c190c6e5-8b3b-4946-bb18-01fa5aba6fd2] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:51:40.402920 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-446a54a1-02c8-4f6f-bcd3-7b15745403e3 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:40.403615 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-446a54a1-02c8-4f6f-bcd3-7b15745403e3 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:40.404269 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-446a54a1-02c8-4f6f-bcd3-7b15745403e3 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:40.405320 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-446a54a1-02c8-4f6f-bcd3-7b15745403e3 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:40.406026 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-446a54a1-02c8-4f6f-bcd3-7b15745403e3 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:40.406651 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-446a54a1-02c8-4f6f-bcd3-7b15745403e3 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:40.542996 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-446a54a1-02c8-4f6f-bcd3-7b15745403e3 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91cf84a287b74618ae1b3368785b0b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902e239d67664098895ab24340b0b780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:51:40.551969 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-446a54a1-02c8-4f6f-bcd3-7b15745403e3 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] 10.222.0.18 "GET /compute/v2.1/servers/c190c6e5-8b3b-4946-bb18-01fa5aba6fd2" status: 200 len: 1318 microversion: 2.1 time: 0.164298 Oct 22 20:51:40.552549 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 368/785] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:51:40 2022] GET /compute/v2.1/servers/c190c6e5-8b3b-4946-bb18-01fa5aba6fd2 => generated 1318 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:51:40.771182 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-d92dc450-96db-4239-9e29-520232533d0d tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:51:40.772255 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-d92dc450-96db-4239-9e29-520232533d0d tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] [instance: 6da11c1d-55e8-4d3f-b045-44f67f397741] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:51:40.780538 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d92dc450-96db-4239-9e29-520232533d0d tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:40.781450 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d92dc450-96db-4239-9e29-520232533d0d tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:40.782216 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d92dc450-96db-4239-9e29-520232533d0d tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:40.782923 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d92dc450-96db-4239-9e29-520232533d0d tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:40.783413 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d92dc450-96db-4239-9e29-520232533d0d tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:40.783955 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d92dc450-96db-4239-9e29-520232533d0d tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:40.935097 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-d92dc450-96db-4239-9e29-520232533d0d tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084d99ccb7dc405f85b1d31cfd255e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '950a163a28d64f41855e56cf88e3b1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:51:40.943745 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-d92dc450-96db-4239-9e29-520232533d0d tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] 10.222.0.18 "GET /compute/v2.1/servers/6da11c1d-55e8-4d3f-b045-44f67f397741" status: 200 len: 1321 microversion: 2.1 time: 0.180599 Oct 22 20:51:40.944328 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 418/786] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:51:40 2022] GET /compute/v2.1/servers/6da11c1d-55e8-4d3f-b045-44f67f397741 => generated 1321 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:51:40.966516 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-f7c8b130-d477-4b44-961c-5779123823ed req-5f7c555b-0532-437b-ae66-952d93f0e018 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c190c6e5-8b3b-4946-bb18-01fa5aba6fd2", "name": "network-vif-plugged", "status": "completed", "tag": "03a35398-bc84-47a3-a7d7-714c7d535cfa"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:51:40.977418 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-f7c8b130-d477-4b44-961c-5779123823ed req-5f7c555b-0532-437b-ae66-952d93f0e018 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:40.977898 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-f7c8b130-d477-4b44-961c-5779123823ed req-5f7c555b-0532-437b-ae66-952d93f0e018 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:40.978332 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-f7c8b130-d477-4b44-961c-5779123823ed req-5f7c555b-0532-437b-ae66-952d93f0e018 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:40.990518 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-f7c8b130-d477-4b44-961c-5779123823ed req-5f7c555b-0532-437b-ae66-952d93f0e018 service nova] Creating event network-vif-plugged:03a35398-bc84-47a3-a7d7-714c7d535cfa for instance c190c6e5-8b3b-4946-bb18-01fa5aba6fd2 on nch1-master-1 Oct 22 20:51:40.995625 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-f7c8b130-d477-4b44-961c-5779123823ed req-5f7c555b-0532-437b-ae66-952d93f0e018 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034654 Oct 22 20:51:41.000255 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 369/787] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:51:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:51:41.103675 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-41b25eb5-782a-47ea-86d5-b04f6e8a21c0 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:51:41.104501 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-41b25eb5-782a-47ea-86d5-b04f6e8a21c0 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] [instance: 2f02a0ad-4856-4643-9e69-50547f5c7a98] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:51:41.110869 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-41b25eb5-782a-47ea-86d5-b04f6e8a21c0 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:41.111581 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-41b25eb5-782a-47ea-86d5-b04f6e8a21c0 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:41.112358 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-41b25eb5-782a-47ea-86d5-b04f6e8a21c0 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:41.113081 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-41b25eb5-782a-47ea-86d5-b04f6e8a21c0 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:41.113701 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-41b25eb5-782a-47ea-86d5-b04f6e8a21c0 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:41.114261 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-41b25eb5-782a-47ea-86d5-b04f6e8a21c0 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:41.257161 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-41b25eb5-782a-47ea-86d5-b04f6e8a21c0 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c87f0356ca346f39c6216393d85da2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee8c8f7fc4e12bc1f9fcce3e7b581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:51:41.265050 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-41b25eb5-782a-47ea-86d5-b04f6e8a21c0 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] 10.222.0.18 "GET /compute/v2.1/servers/2f02a0ad-4856-4643-9e69-50547f5c7a98" status: 200 len: 1311 microversion: 2.1 time: 0.166957 Oct 22 20:51:41.265609 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 419/788] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:51:41 2022] GET /compute/v2.1/servers/2f02a0ad-4856-4643-9e69-50547f5c7a98 => generated 1311 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:51:41.577176 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-0d2f5e7c-b25b-4427-96bd-c40861a88344 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:51:41.577792 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-0d2f5e7c-b25b-4427-96bd-c40861a88344 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] [instance: c190c6e5-8b3b-4946-bb18-01fa5aba6fd2] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:51:41.584557 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0d2f5e7c-b25b-4427-96bd-c40861a88344 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:41.585041 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0d2f5e7c-b25b-4427-96bd-c40861a88344 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:41.585466 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0d2f5e7c-b25b-4427-96bd-c40861a88344 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:41.586549 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0d2f5e7c-b25b-4427-96bd-c40861a88344 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:41.586670 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0d2f5e7c-b25b-4427-96bd-c40861a88344 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:41.587033 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0d2f5e7c-b25b-4427-96bd-c40861a88344 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:41.742752 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-0d2f5e7c-b25b-4427-96bd-c40861a88344 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91cf84a287b74618ae1b3368785b0b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902e239d67664098895ab24340b0b780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:51:41.751365 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-0d2f5e7c-b25b-4427-96bd-c40861a88344 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] 10.222.0.18 "GET /compute/v2.1/servers/c190c6e5-8b3b-4946-bb18-01fa5aba6fd2" status: 200 len: 1318 microversion: 2.1 time: 0.178674 Oct 22 20:51:41.751959 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 370/789] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:51:41 2022] GET /compute/v2.1/servers/c190c6e5-8b3b-4946-bb18-01fa5aba6fd2 => generated 1318 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:51:41.953339 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-cd7256ec-1d1c-4837-9da7-67341c1f28f9 tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "52e959f8-e0fb-44b9-aad5-1abd5310b890"}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:51:41.955818 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-cd7256ec-1d1c-4837-9da7-67341c1f28f9 tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] [instance: 65381d5e-1265-418b-ac70-4ef749d9af14] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:51:41.963865 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cd7256ec-1d1c-4837-9da7-67341c1f28f9 tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:41.964348 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cd7256ec-1d1c-4837-9da7-67341c1f28f9 tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:41.964781 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cd7256ec-1d1c-4837-9da7-67341c1f28f9 tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:41.965474 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cd7256ec-1d1c-4837-9da7-67341c1f28f9 tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:41.965922 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cd7256ec-1d1c-4837-9da7-67341c1f28f9 tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:41.966349 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cd7256ec-1d1c-4837-9da7-67341c1f28f9 tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:41.973512 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-6b8d3059-30de-4428-82d9-066de1d3a012 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:51:41.974134 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-6b8d3059-30de-4428-82d9-066de1d3a012 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] [instance: 6da11c1d-55e8-4d3f-b045-44f67f397741] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:51:41.981530 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6b8d3059-30de-4428-82d9-066de1d3a012 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:41.982045 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6b8d3059-30de-4428-82d9-066de1d3a012 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:41.982488 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6b8d3059-30de-4428-82d9-066de1d3a012 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:41.983210 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6b8d3059-30de-4428-82d9-066de1d3a012 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:41.983711 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6b8d3059-30de-4428-82d9-066de1d3a012 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:41.984134 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6b8d3059-30de-4428-82d9-066de1d3a012 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:42.120106 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-6b8d3059-30de-4428-82d9-066de1d3a012 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084d99ccb7dc405f85b1d31cfd255e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '950a163a28d64f41855e56cf88e3b1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:51:42.129567 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-6b8d3059-30de-4428-82d9-066de1d3a012 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] 10.222.0.18 "GET /compute/v2.1/servers/6da11c1d-55e8-4d3f-b045-44f67f397741" status: 200 len: 1471 microversion: 2.1 time: 0.159897 Oct 22 20:51:42.130154 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 371/790] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:51:41 2022] GET /compute/v2.1/servers/6da11c1d-55e8-4d3f-b045-44f67f397741 => generated 1471 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:51:42.212325 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-cd011b8d-ee37-406d-88ae-2f1620f77878 tempest-ServersAdminNegativeTestJSON-1741816574 tempest-ServersAdminNegativeTestJSON-1741816574-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:51:42.212972 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-cd011b8d-ee37-406d-88ae-2f1620f77878 tempest-ServersAdminNegativeTestJSON-1741816574 tempest-ServersAdminNegativeTestJSON-1741816574-project-admin] [instance: a31d57bb-0ca6-454c-bec1-8376656576ad] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:51:42.218429 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-cd011b8d-ee37-406d-88ae-2f1620f77878 tempest-ServersAdminNegativeTestJSON-1741816574 tempest-ServersAdminNegativeTestJSON-1741816574-project-admin] HTTP exception thrown: Instance a31d57bb-0ca6-454c-bec1-8376656576ad could not be found. Oct 22 20:51:42.222093 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-cd011b8d-ee37-406d-88ae-2f1620f77878 tempest-ServersAdminNegativeTestJSON-1741816574 tempest-ServersAdminNegativeTestJSON-1741816574-project-admin] Request method failure captured: Oct 22 20:51:42.222093 ncdv-master-1 devstack@n-api.service[138744]: request: POST /compute/v2.1/servers/a31d57bb-0ca6-454c-bec1-8376656576ad/action HTTP/1.1 Oct 22 20:51:42.222093 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 20:51:42.222093 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 20:51:42.222093 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 20:51:42.222093 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 15 Oct 22 20:51:42.222093 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 20:51:42.222093 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 20:51:42.222093 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 20:51:42.222093 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 20:51:42.222093 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVFfONayD3VC8iPUF02I9JsqFkg9bcmni3e09PDhPzzw-Qv_YYx48K17893-eZ1DI7hAEu0y92ulqp3rAt7hhkseXJGmCFQUkrmzHwfNxLrWSOihy9Z9_DSp_mVErQnlwWBiJY6tpXW9jeLccTKKT6EK9IjZHpM8gAMCi0elXDLCuqMk Oct 22 20:51:42.222093 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 20:51:42.222093 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 20:51:42.222093 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 20:51:42.222093 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 20:51:42.222093 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 20:51:42.222093 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 20:51:42.222093 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: c5ce53e17c534bde8c9f215493ff3b6e Oct 22 20:51:42.222093 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1741816574 Oct 22 20:51:42.222093 ncdv-master-1 devstack@n-api.service[138744]: X-Role: admin,member,reader Oct 22 20:51:42.222093 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: admin,member,reader Oct 22 20:51:42.222093 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_c5ce53e17c534bde8c9f215493ff3b6e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c5ce53e17c534bde8c9f215493ff3b6e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/c5ce53e17c534bde8c9f215493ff3b6e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c5ce53e17c534bde8c9f215493ff3b6e"}]}] Oct 22 20:51:42.222093 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1741816574 Oct 22 20:51:42.222093 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: c5ce53e17c534bde8c9f215493ff3b6e Oct 22 20:51:42.222093 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1741816574 Oct 22 20:51:42.222093 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-ServersAdminNegativeTestJSON-1741816574-project-admin Oct 22 20:51:42.222093 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 20:51:42.222093 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 20:51:42.222093 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: c8abe86ff26d4342a73041c26e4533b5 Oct 22 20:51:42.222093 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1741816574-project-admin Oct 22 20:51:42.222093 ncdv-master-1 devstack@n-api.service[138744]: Oct 22 20:51:42.222093 ncdv-master-1 devstack@n-api.service[138744]: {"migrate": {}} Oct 22 20:51:42.222093 ncdv-master-1 devstack@n-api.service[138744]: method: > Oct 22 20:51:42.222093 ncdv-master-1 devstack@n-api.service[138744]: exception: Instance a31d57bb-0ca6-454c-bec1-8376656576ad could not be found. Oct 22 20:51:42.222093 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': 'a31d57bb-0ca6-454c-bec1-8376656576ad', 'body': {'migrate': {}}} Oct 22 20:51:42.222093 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:51:42.222093 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:51:42.222093 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 20:51:42.222093 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 20:51:42.222093 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 20:51:42.222093 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 20:51:42.222093 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 22 20:51:42.222093 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 22 20:51:42.222093 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a31d57bb-0ca6-454c-bec1-8376656576ad could not be found. Oct 22 20:51:42.222093 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:51:42.222093 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:51:42.222093 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:51:42.222093 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:51:42.222093 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:51:42.222093 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:51:42.222093 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:51:42.222093 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:51:42.222093 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:51:42.222093 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:51:42.222093 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 20:51:42.222093 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 20:51:42.222093 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 47, in _migrate Oct 22 20:51:42.222093 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id, Oct 22 20:51:42.222093 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 20:51:42.222093 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 20:51:42.222093 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a31d57bb-0ca6-454c-bec1-8376656576ad could not be found. Oct 22 20:51:42.222093 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:51:42.222093 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:51:42.222093 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:51:42.222093 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:51:42.227758 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:51:42.227758 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:51:42.227758 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 20:51:42.227758 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 20:51:42.227758 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a31d57bb-0ca6-454c-bec1-8376656576ad could not be found. Oct 22 20:51:42.227758 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:51:42.227758 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-cd011b8d-ee37-406d-88ae-2f1620f77878 tempest-ServersAdminNegativeTestJSON-1741816574 tempest-ServersAdminNegativeTestJSON-1741816574-project-admin] Returning 404 to user: Instance a31d57bb-0ca6-454c-bec1-8376656576ad could not be found. {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:51:42.227758 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-cd011b8d-ee37-406d-88ae-2f1620f77878 tempest-ServersAdminNegativeTestJSON-1741816574 tempest-ServersAdminNegativeTestJSON-1741816574-project-admin] 10.222.0.18 "POST /compute/v2.1/servers/a31d57bb-0ca6-454c-bec1-8376656576ad/action" status: 404 len: 111 microversion: 2.1 time: 0.074402 Oct 22 20:51:42.227758 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 372/791] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 20:51:42 2022] POST /compute/v2.1/servers/a31d57bb-0ca6-454c-bec1-8376656576ad/action => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 20:51:42.273936 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-cd7256ec-1d1c-4837-9da7-67341c1f28f9 tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] 10.222.0.18 "POST /compute/v2.1/servers/65381d5e-1265-418b-ac70-4ef749d9af14/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.324312 Oct 22 20:51:42.274555 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 420/792] 10.222.0.18 () {60 vars in 1323 bytes} [Sat Oct 22 20:51:41 2022] POST /compute/v2.1/servers/65381d5e-1265-418b-ac70-4ef749d9af14/os-volume_attachments => generated 194 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:51:42.277596 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-fc399d17-8b0c-4fef-90a9-82a475e2243a tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1034388756", "imageRef": "085e4478-6edc-4a69-8e08-f9831713eb65", "flavorRef": "452"}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:51:42.288913 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-5090f3d6-3751-4b7a-b8cf-31bf05ccd8a5 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:51:42.290262 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-5090f3d6-3751-4b7a-b8cf-31bf05ccd8a5 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] [instance: 2f02a0ad-4856-4643-9e69-50547f5c7a98] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:51:42.298307 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5090f3d6-3751-4b7a-b8cf-31bf05ccd8a5 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:42.298307 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5090f3d6-3751-4b7a-b8cf-31bf05ccd8a5 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:42.299125 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5090f3d6-3751-4b7a-b8cf-31bf05ccd8a5 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:42.299981 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5090f3d6-3751-4b7a-b8cf-31bf05ccd8a5 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:42.300669 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5090f3d6-3751-4b7a-b8cf-31bf05ccd8a5 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:42.301320 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5090f3d6-3751-4b7a-b8cf-31bf05ccd8a5 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:42.338265 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.network.neutron [None req-fc399d17-8b0c-4fef-90a9-82a475e2243a tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] validate_networks() for None {{(pid=138744) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 20:51:42.567438 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-5090f3d6-3751-4b7a-b8cf-31bf05ccd8a5 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c87f0356ca346f39c6216393d85da2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee8c8f7fc4e12bc1f9fcce3e7b581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:51:42.576086 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-5090f3d6-3751-4b7a-b8cf-31bf05ccd8a5 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] 10.222.0.18 "GET /compute/v2.1/servers/2f02a0ad-4856-4643-9e69-50547f5c7a98" status: 200 len: 1311 microversion: 2.1 time: 0.291723 Oct 22 20:51:42.577233 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 421/793] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:51:42 2022] GET /compute/v2.1/servers/2f02a0ad-4856-4643-9e69-50547f5c7a98 => generated 1311 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:51:42.631282 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-fc399d17-8b0c-4fef-90a9-82a475e2243a tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Flavor limits 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 20:51:42.631787 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-fc399d17-8b0c-4fef-90a9-82a475e2243a tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Image limits 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 20:51:42.632267 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-fc399d17-8b0c-4fef-90a9-82a475e2243a tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Flavor pref 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 20:51:42.632681 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-fc399d17-8b0c-4fef-90a9-82a475e2243a tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Image pref 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 20:51:42.633069 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-fc399d17-8b0c-4fef-90a9-82a475e2243a tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 20:51:42.655121 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fc399d17-8b0c-4fef-90a9-82a475e2243a tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:42.655667 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fc399d17-8b0c-4fef-90a9-82a475e2243a tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:42.656125 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fc399d17-8b0c-4fef-90a9-82a475e2243a tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:42.656861 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fc399d17-8b0c-4fef-90a9-82a475e2243a tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:42.657319 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fc399d17-8b0c-4fef-90a9-82a475e2243a tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:42.657758 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fc399d17-8b0c-4fef-90a9-82a475e2243a tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:42.679367 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-fc399d17-8b0c-4fef-90a9-82a475e2243a tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Getting quotas for project 950a163a28d64f41855e56cf88e3b1d9. Resources: {'cores', 'instances', 'ram'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 20:51:42.684901 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-fc399d17-8b0c-4fef-90a9-82a475e2243a tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Getting quotas for user 084d99ccb7dc405f85b1d31cfd255e72 and project 950a163a28d64f41855e56cf88e3b1d9. Resources: {'cores', 'instances', 'ram'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 20:51:42.699271 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-fc399d17-8b0c-4fef-90a9-82a475e2243a tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Going to run 1 instances... {{(pid=138744) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 20:51:42.701676 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-fc399d17-8b0c-4fef-90a9-82a475e2243a tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] [instance: bd166847-1e05-4e06-86b1-1f3773eb57f1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='085e4478-6edc-4a69-8e08-f9831713eb65',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138744) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 20:51:42.772623 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-fc399d17-8b0c-4fef-90a9-82a475e2243a tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.498698 Oct 22 20:51:42.774551 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-bed78c7d-0fa3-4ccf-9f85-665041cfd56c tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:51:42.775466 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-bed78c7d-0fa3-4ccf-9f85-665041cfd56c tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] [instance: c190c6e5-8b3b-4946-bb18-01fa5aba6fd2] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:51:42.780017 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 373/794] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Oct 22 20:51:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 507 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 22 20:51:42.785238 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-1edf2157-1d8a-4a91-93b0-b15e847b0d19 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:51:42.786068 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-1edf2157-1d8a-4a91-93b0-b15e847b0d19 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] [instance: bd166847-1e05-4e06-86b1-1f3773eb57f1] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:51:42.787229 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bed78c7d-0fa3-4ccf-9f85-665041cfd56c tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:42.789927 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bed78c7d-0fa3-4ccf-9f85-665041cfd56c tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:42.789927 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bed78c7d-0fa3-4ccf-9f85-665041cfd56c tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:42.791921 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bed78c7d-0fa3-4ccf-9f85-665041cfd56c tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:42.796405 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bed78c7d-0fa3-4ccf-9f85-665041cfd56c tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:42.797154 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bed78c7d-0fa3-4ccf-9f85-665041cfd56c tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:42.867152 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-1edf2157-1d8a-4a91-93b0-b15e847b0d19 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084d99ccb7dc405f85b1d31cfd255e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '950a163a28d64f41855e56cf88e3b1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:51:42.876446 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-1edf2157-1d8a-4a91-93b0-b15e847b0d19 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] 10.222.0.18 "GET /compute/v2.1/servers/bd166847-1e05-4e06-86b1-1f3773eb57f1" status: 200 len: 1222 microversion: 2.1 time: 0.094105 Oct 22 20:51:42.877683 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 374/795] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:51:42 2022] GET /compute/v2.1/servers/bd166847-1e05-4e06-86b1-1f3773eb57f1 => generated 1222 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:51:42.992324 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-bed78c7d-0fa3-4ccf-9f85-665041cfd56c tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91cf84a287b74618ae1b3368785b0b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902e239d67664098895ab24340b0b780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:51:43.002436 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-bed78c7d-0fa3-4ccf-9f85-665041cfd56c tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] 10.222.0.18 "GET /compute/v2.1/servers/c190c6e5-8b3b-4946-bb18-01fa5aba6fd2" status: 200 len: 1468 microversion: 2.1 time: 0.232076 Oct 22 20:51:43.004416 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 422/796] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:51:42 2022] GET /compute/v2.1/servers/c190c6e5-8b3b-4946-bb18-01fa5aba6fd2 => generated 1468 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 20:51:43.027148 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-e95f2179-7647-489c-afd4-e41854d9d91d tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:51:43.028586 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-e95f2179-7647-489c-afd4-e41854d9d91d tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] [instance: 4ef975af-c582-4e7e-9913-e4be1688f81d] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:51:43.035931 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e95f2179-7647-489c-afd4-e41854d9d91d tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:43.036668 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e95f2179-7647-489c-afd4-e41854d9d91d tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:43.037104 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e95f2179-7647-489c-afd4-e41854d9d91d tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:43.038253 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e95f2179-7647-489c-afd4-e41854d9d91d tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:43.038869 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e95f2179-7647-489c-afd4-e41854d9d91d tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:43.039175 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e95f2179-7647-489c-afd4-e41854d9d91d tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:43.198523 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-e95f2179-7647-489c-afd4-e41854d9d91d tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91cf84a287b74618ae1b3368785b0b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902e239d67664098895ab24340b0b780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:51:43.208354 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-e95f2179-7647-489c-afd4-e41854d9d91d tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] 10.222.0.18 "GET /compute/v2.1/servers/4ef975af-c582-4e7e-9913-e4be1688f81d" status: 200 len: 1468 microversion: 2.1 time: 0.184532 Oct 22 20:51:43.211387 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 375/797] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:51:43 2022] GET /compute/v2.1/servers/4ef975af-c582-4e7e-9913-e4be1688f81d => generated 1468 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:51:43.232529 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-4cd8e6b8-3ef6-440e-a902-9f7465f1e338 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:51:43.238320 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-4cd8e6b8-3ef6-440e-a902-9f7465f1e338 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '91cf84a287b74618ae1b3368785b0b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902e239d67664098895ab24340b0b780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:51:43.239209 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-4cd8e6b8-3ef6-440e-a902-9f7465f1e338 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Searching by: {'reservation_id': 'r-739ore40', 'deleted': False, 'project_id': '902e239d67664098895ab24340b0b780'} {{(pid=138745) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 22 20:51:43.245068 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4cd8e6b8-3ef6-440e-a902-9f7465f1e338 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:43.245576 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4cd8e6b8-3ef6-440e-a902-9f7465f1e338 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:43.246091 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4cd8e6b8-3ef6-440e-a902-9f7465f1e338 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:43.247019 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4cd8e6b8-3ef6-440e-a902-9f7465f1e338 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:43.247507 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4cd8e6b8-3ef6-440e-a902-9f7465f1e338 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:43.247948 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4cd8e6b8-3ef6-440e-a902-9f7465f1e338 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:43.348572 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.multi_cell_list [None req-4cd8e6b8-3ef6-440e-a902-9f7465f1e338 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=138745) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 22 20:51:43.431670 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-4cd8e6b8-3ef6-440e-a902-9f7465f1e338 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91cf84a287b74618ae1b3368785b0b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902e239d67664098895ab24340b0b780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:51:43.439083 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4cd8e6b8-3ef6-440e-a902-9f7465f1e338 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:43.439899 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4cd8e6b8-3ef6-440e-a902-9f7465f1e338 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:43.440584 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4cd8e6b8-3ef6-440e-a902-9f7465f1e338 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:43.577609 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-4cd8e6b8-3ef6-440e-a902-9f7465f1e338 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] 10.222.0.18 "GET /compute/v2.1/servers/detail?reservation_id=r-739ore40" status: 200 len: 2929 microversion: 2.1 time: 0.350576 Oct 22 20:51:43.580002 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 423/798] 10.222.0.18 () {58 vars in 1197 bytes} [Sat Oct 22 20:51:43 2022] GET /compute/v2.1/servers/detail?reservation_id=r-739ore40 => generated 2929 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 20:51:43.600877 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-41499937-0d37-4e27-b25e-414ff876b663 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:51:43.601491 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-41499937-0d37-4e27-b25e-414ff876b663 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] [instance: 2f02a0ad-4856-4643-9e69-50547f5c7a98] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:51:43.605720 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-e01b8b00-8177-49a9-8491-9cf7433d0497 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:51:43.608069 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-41499937-0d37-4e27-b25e-414ff876b663 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:43.608565 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-41499937-0d37-4e27-b25e-414ff876b663 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:43.609007 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-41499937-0d37-4e27-b25e-414ff876b663 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:43.609712 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-41499937-0d37-4e27-b25e-414ff876b663 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:43.610173 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-41499937-0d37-4e27-b25e-414ff876b663 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:43.610603 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-41499937-0d37-4e27-b25e-414ff876b663 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:43.624858 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.compute.server_groups [None req-e01b8b00-8177-49a9-8491-9cf7433d0497 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Querying cell 5972cb63-1ab7-4825-b0ae-86c7acab764c(cell1) for 2 instances {{(pid=138745) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 22 20:51:43.625892 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e01b8b00-8177-49a9-8491-9cf7433d0497 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:43.626527 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e01b8b00-8177-49a9-8491-9cf7433d0497 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:43.627181 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e01b8b00-8177-49a9-8491-9cf7433d0497 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:43.662205 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-e01b8b00-8177-49a9-8491-9cf7433d0497 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] 10.222.0.18 "GET /compute/v2.1/os-server-groups/c805829d-9330-44c4-abe6-ffa468507877" status: 200 len: 271 microversion: 2.1 time: 0.061245 Oct 22 20:51:43.663512 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 424/799] 10.222.0.18 () {58 vars in 1263 bytes} [Sat Oct 22 20:51:43 2022] GET /compute/v2.1/os-server-groups/c805829d-9330-44c4-abe6-ffa468507877 => generated 271 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:51:43.674621 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-d5514bd0-7299-400c-b9e3-0338ed49c36e tempest-ServersOnMultiNodesTest-1015080240 tempest-ServersOnMultiNodesTest-1015080240-project-admin] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:51:43.675232 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-d5514bd0-7299-400c-b9e3-0338ed49c36e tempest-ServersOnMultiNodesTest-1015080240 tempest-ServersOnMultiNodesTest-1015080240-project-admin] [instance: 4ef975af-c582-4e7e-9913-e4be1688f81d] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:51:43.682441 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d5514bd0-7299-400c-b9e3-0338ed49c36e tempest-ServersOnMultiNodesTest-1015080240 tempest-ServersOnMultiNodesTest-1015080240-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:43.682988 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d5514bd0-7299-400c-b9e3-0338ed49c36e tempest-ServersOnMultiNodesTest-1015080240 tempest-ServersOnMultiNodesTest-1015080240-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:43.683610 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d5514bd0-7299-400c-b9e3-0338ed49c36e tempest-ServersOnMultiNodesTest-1015080240 tempest-ServersOnMultiNodesTest-1015080240-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:43.684217 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d5514bd0-7299-400c-b9e3-0338ed49c36e tempest-ServersOnMultiNodesTest-1015080240 tempest-ServersOnMultiNodesTest-1015080240-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:43.684668 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d5514bd0-7299-400c-b9e3-0338ed49c36e tempest-ServersOnMultiNodesTest-1015080240 tempest-ServersOnMultiNodesTest-1015080240-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:43.685090 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d5514bd0-7299-400c-b9e3-0338ed49c36e tempest-ServersOnMultiNodesTest-1015080240 tempest-ServersOnMultiNodesTest-1015080240-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:43.711881 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:51:43.814948 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-41499937-0d37-4e27-b25e-414ff876b663 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c87f0356ca346f39c6216393d85da2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee8c8f7fc4e12bc1f9fcce3e7b581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:51:43.824422 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-41499937-0d37-4e27-b25e-414ff876b663 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] 10.222.0.18 "GET /compute/v2.1/servers/2f02a0ad-4856-4643-9e69-50547f5c7a98" status: 200 len: 1311 microversion: 2.1 time: 0.227099 Oct 22 20:51:43.831725 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 376/800] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:51:43 2022] GET /compute/v2.1/servers/2f02a0ad-4856-4643-9e69-50547f5c7a98 => generated 1311 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:51:43.873184 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-d5514bd0-7299-400c-b9e3-0338ed49c36e tempest-ServersOnMultiNodesTest-1015080240 tempest-ServersOnMultiNodesTest-1015080240-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/4ef975af-c582-4e7e-9913-e4be1688f81d" status: 200 len: 1619 microversion: 2.1 time: 0.202234 Oct 22 20:51:43.873950 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 425/801] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:51:43 2022] GET /compute/v2.1/servers/4ef975af-c582-4e7e-9913-e4be1688f81d => generated 1619 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:51:43.897152 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-494371b6-b6b6-4dbe-aead-d732c737719f tempest-ServersOnMultiNodesTest-1015080240 tempest-ServersOnMultiNodesTest-1015080240-project-admin] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:51:43.897913 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-494371b6-b6b6-4dbe-aead-d732c737719f tempest-ServersOnMultiNodesTest-1015080240 tempest-ServersOnMultiNodesTest-1015080240-project-admin] [instance: c190c6e5-8b3b-4946-bb18-01fa5aba6fd2] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:51:43.902526 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-f875efc8-571e-43c1-8cec-1cd8295f13a1 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:51:43.903178 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-f875efc8-571e-43c1-8cec-1cd8295f13a1 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] [instance: bd166847-1e05-4e06-86b1-1f3773eb57f1] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:51:43.905139 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-494371b6-b6b6-4dbe-aead-d732c737719f tempest-ServersOnMultiNodesTest-1015080240 tempest-ServersOnMultiNodesTest-1015080240-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:43.905696 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-494371b6-b6b6-4dbe-aead-d732c737719f tempest-ServersOnMultiNodesTest-1015080240 tempest-ServersOnMultiNodesTest-1015080240-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:43.906334 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-494371b6-b6b6-4dbe-aead-d732c737719f tempest-ServersOnMultiNodesTest-1015080240 tempest-ServersOnMultiNodesTest-1015080240-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:43.907125 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-494371b6-b6b6-4dbe-aead-d732c737719f tempest-ServersOnMultiNodesTest-1015080240 tempest-ServersOnMultiNodesTest-1015080240-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:43.907614 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-494371b6-b6b6-4dbe-aead-d732c737719f tempest-ServersOnMultiNodesTest-1015080240 tempest-ServersOnMultiNodesTest-1015080240-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:43.908046 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-494371b6-b6b6-4dbe-aead-d732c737719f tempest-ServersOnMultiNodesTest-1015080240 tempest-ServersOnMultiNodesTest-1015080240-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:43.909732 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f875efc8-571e-43c1-8cec-1cd8295f13a1 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:43.910220 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f875efc8-571e-43c1-8cec-1cd8295f13a1 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:43.910774 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f875efc8-571e-43c1-8cec-1cd8295f13a1 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:43.911604 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f875efc8-571e-43c1-8cec-1cd8295f13a1 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:43.912265 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f875efc8-571e-43c1-8cec-1cd8295f13a1 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:43.912766 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f875efc8-571e-43c1-8cec-1cd8295f13a1 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:44.001697 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-f875efc8-571e-43c1-8cec-1cd8295f13a1 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084d99ccb7dc405f85b1d31cfd255e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '950a163a28d64f41855e56cf88e3b1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:51:44.010454 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-f875efc8-571e-43c1-8cec-1cd8295f13a1 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] 10.222.0.18 "GET /compute/v2.1/servers/bd166847-1e05-4e06-86b1-1f3773eb57f1" status: 200 len: 1274 microversion: 2.1 time: 0.112082 Oct 22 20:51:44.011015 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 426/802] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:51:43 2022] GET /compute/v2.1/servers/bd166847-1e05-4e06-86b1-1f3773eb57f1 => generated 1274 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:51:44.065587 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-494371b6-b6b6-4dbe-aead-d732c737719f tempest-ServersOnMultiNodesTest-1015080240 tempest-ServersOnMultiNodesTest-1015080240-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/c190c6e5-8b3b-4946-bb18-01fa5aba6fd2" status: 200 len: 1619 microversion: 2.1 time: 0.172370 Oct 22 20:51:44.066130 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 377/803] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:51:43 2022] GET /compute/v2.1/servers/c190c6e5-8b3b-4946-bb18-01fa5aba6fd2 => generated 1619 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:51:44.183518 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-08a8b154-123f-4752-b319-871199156da2 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-367069400", "imageRef": "085e4478-6edc-4a69-8e08-f9831713eb65", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": "69ed98a2-c208-4765-88b1-3e76a09cc481"}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:51:44.239554 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.network.neutron [None req-08a8b154-123f-4752-b319-871199156da2 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] validate_networks() for None {{(pid=138745) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 20:51:44.463600 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-08a8b154-123f-4752-b319-871199156da2 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Flavor limits 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 20:51:44.463927 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-08a8b154-123f-4752-b319-871199156da2 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Image limits 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 20:51:44.464461 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-08a8b154-123f-4752-b319-871199156da2 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Flavor pref 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 20:51:44.464900 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-08a8b154-123f-4752-b319-871199156da2 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Image pref 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 20:51:44.465329 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-08a8b154-123f-4752-b319-871199156da2 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 20:51:44.475534 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-08a8b154-123f-4752-b319-871199156da2 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:44.476254 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-08a8b154-123f-4752-b319-871199156da2 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:44.477200 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-08a8b154-123f-4752-b319-871199156da2 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:44.477938 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-08a8b154-123f-4752-b319-871199156da2 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:44.478391 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-08a8b154-123f-4752-b319-871199156da2 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:44.479017 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-08a8b154-123f-4752-b319-871199156da2 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:44.486014 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell0:SELECT=11 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:51:44.499477 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-08a8b154-123f-4752-b319-871199156da2 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Getting quotas for project 902e239d67664098895ab24340b0b780. Resources: {'cores', 'instances', 'ram'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 20:51:44.507813 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-08a8b154-123f-4752-b319-871199156da2 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Getting quotas for user 91cf84a287b74618ae1b3368785b0b4c and project 902e239d67664098895ab24340b0b780. Resources: {'cores', 'instances', 'ram'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 20:51:44.523984 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-08a8b154-123f-4752-b319-871199156da2 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Going to run 1 instances... {{(pid=138745) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 20:51:44.526746 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-08a8b154-123f-4752-b319-871199156da2 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] [instance: 7a4f8d67-fade-412f-9554-78f39414132f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='085e4478-6edc-4a69-8e08-f9831713eb65',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138745) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 20:51:44.575172 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-08a8b154-123f-4752-b319-871199156da2 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.396541 Oct 22 20:51:44.576211 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 427/804] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Oct 22 20:51:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 398 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 20:51:44.588193 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-93f454be-ac63-4ea2-9f75-98a520cc2cc5 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:51:44.588856 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-93f454be-ac63-4ea2-9f75-98a520cc2cc5 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] [instance: 7a4f8d67-fade-412f-9554-78f39414132f] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:51:44.653275 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-93f454be-ac63-4ea2-9f75-98a520cc2cc5 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91cf84a287b74618ae1b3368785b0b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902e239d67664098895ab24340b0b780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:51:44.663642 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-93f454be-ac63-4ea2-9f75-98a520cc2cc5 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] 10.222.0.18 "GET /compute/v2.1/servers/7a4f8d67-fade-412f-9554-78f39414132f" status: 200 len: 1216 microversion: 2.1 time: 0.079468 Oct 22 20:51:44.664448 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 378/805] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:51:44 2022] GET /compute/v2.1/servers/7a4f8d67-fade-412f-9554-78f39414132f => generated 1216 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:51:44.854489 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-09ed45a8-671c-403b-a0bb-7a07e71689ff tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:51:44.855565 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-09ed45a8-671c-403b-a0bb-7a07e71689ff tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] [instance: 2f02a0ad-4856-4643-9e69-50547f5c7a98] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:51:44.865070 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-09ed45a8-671c-403b-a0bb-7a07e71689ff tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:44.865726 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-09ed45a8-671c-403b-a0bb-7a07e71689ff tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:44.866557 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-09ed45a8-671c-403b-a0bb-7a07e71689ff tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:44.867848 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-09ed45a8-671c-403b-a0bb-7a07e71689ff tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:44.868572 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-09ed45a8-671c-403b-a0bb-7a07e71689ff tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:44.869192 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-09ed45a8-671c-403b-a0bb-7a07e71689ff tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:44.903060 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-35e8bc9b-c467-4caf-8ec6-df1ba8cf9d56 req-a603bf15-ce89-4b07-a550-3c99eee94065 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f02a0ad-4856-4643-9e69-50547f5c7a98", "name": "network-vif-plugged", "status": "completed", "tag": "eb2b7a79-4890-4efa-990a-815f0293cc40"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:51:44.918817 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-35e8bc9b-c467-4caf-8ec6-df1ba8cf9d56 req-a603bf15-ce89-4b07-a550-3c99eee94065 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:44.919663 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-35e8bc9b-c467-4caf-8ec6-df1ba8cf9d56 req-a603bf15-ce89-4b07-a550-3c99eee94065 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:44.920420 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-35e8bc9b-c467-4caf-8ec6-df1ba8cf9d56 req-a603bf15-ce89-4b07-a550-3c99eee94065 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:44.937641 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-35e8bc9b-c467-4caf-8ec6-df1ba8cf9d56 req-a603bf15-ce89-4b07-a550-3c99eee94065 service nova] Creating event network-vif-plugged:eb2b7a79-4890-4efa-990a-815f0293cc40 for instance 2f02a0ad-4856-4643-9e69-50547f5c7a98 on nch2-master-1 Oct 22 20:51:44.944413 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-35e8bc9b-c467-4caf-8ec6-df1ba8cf9d56 req-a603bf15-ce89-4b07-a550-3c99eee94065 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046175 Oct 22 20:51:44.945665 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 379/806] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:51:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:51:45.035114 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-5076b984-cf20-42ae-8fc8-a2a8cb12cc41 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:51:45.036053 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-5076b984-cf20-42ae-8fc8-a2a8cb12cc41 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] [instance: bd166847-1e05-4e06-86b1-1f3773eb57f1] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:51:45.043112 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5076b984-cf20-42ae-8fc8-a2a8cb12cc41 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:45.043978 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5076b984-cf20-42ae-8fc8-a2a8cb12cc41 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:45.044750 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5076b984-cf20-42ae-8fc8-a2a8cb12cc41 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:45.045617 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5076b984-cf20-42ae-8fc8-a2a8cb12cc41 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:45.046223 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5076b984-cf20-42ae-8fc8-a2a8cb12cc41 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:45.046800 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5076b984-cf20-42ae-8fc8-a2a8cb12cc41 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:45.052607 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:SELECT=100 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:51:45.100026 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-09ed45a8-671c-403b-a0bb-7a07e71689ff tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c87f0356ca346f39c6216393d85da2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee8c8f7fc4e12bc1f9fcce3e7b581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:51:45.113390 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-09ed45a8-671c-403b-a0bb-7a07e71689ff tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] 10.222.0.18 "GET /compute/v2.1/servers/2f02a0ad-4856-4643-9e69-50547f5c7a98" status: 200 len: 1311 microversion: 2.1 time: 0.267910 Oct 22 20:51:45.128716 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 428/807] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:51:44 2022] GET /compute/v2.1/servers/2f02a0ad-4856-4643-9e69-50547f5c7a98 => generated 1311 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:51:45.134672 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-5076b984-cf20-42ae-8fc8-a2a8cb12cc41 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084d99ccb7dc405f85b1d31cfd255e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '950a163a28d64f41855e56cf88e3b1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:51:45.148840 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-5076b984-cf20-42ae-8fc8-a2a8cb12cc41 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] 10.222.0.18 "GET /compute/v2.1/servers/bd166847-1e05-4e06-86b1-1f3773eb57f1" status: 200 len: 1280 microversion: 2.1 time: 0.118280 Oct 22 20:51:45.149435 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 380/808] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:51:45 2022] GET /compute/v2.1/servers/bd166847-1e05-4e06-86b1-1f3773eb57f1 => generated 1280 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 20:51:45.686878 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-e119864e-9658-4120-810e-4dd0c883a8cf tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:51:45.687534 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-e119864e-9658-4120-810e-4dd0c883a8cf tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] [instance: 7a4f8d67-fade-412f-9554-78f39414132f] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:51:45.695369 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e119864e-9658-4120-810e-4dd0c883a8cf tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:45.696083 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e119864e-9658-4120-810e-4dd0c883a8cf tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:45.696528 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e119864e-9658-4120-810e-4dd0c883a8cf tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:45.697251 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e119864e-9658-4120-810e-4dd0c883a8cf tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:45.697707 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e119864e-9658-4120-810e-4dd0c883a8cf tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:45.698340 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e119864e-9658-4120-810e-4dd0c883a8cf tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:45.762024 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-e119864e-9658-4120-810e-4dd0c883a8cf tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91cf84a287b74618ae1b3368785b0b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902e239d67664098895ab24340b0b780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:51:45.769610 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-e119864e-9658-4120-810e-4dd0c883a8cf tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] 10.222.0.18 "GET /compute/v2.1/servers/7a4f8d67-fade-412f-9554-78f39414132f" status: 200 len: 1268 microversion: 2.1 time: 0.087276 Oct 22 20:51:45.770141 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 429/809] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:51:45 2022] GET /compute/v2.1/servers/7a4f8d67-fade-412f-9554-78f39414132f => generated 1268 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:51:46.073254 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-776b1eb3-cc22-4249-8a8d-c032a14b3ce5 req-59eb52e1-628c-4366-9daa-349cbf2fee18 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd166847-1e05-4e06-86b1-1f3773eb57f1", "tag": "9d56f899-b2af-4a81-9b71-b87b0c0ab451"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:51:46.085007 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-776b1eb3-cc22-4249-8a8d-c032a14b3ce5 req-59eb52e1-628c-4366-9daa-349cbf2fee18 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:46.085635 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-776b1eb3-cc22-4249-8a8d-c032a14b3ce5 req-59eb52e1-628c-4366-9daa-349cbf2fee18 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:46.086262 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-776b1eb3-cc22-4249-8a8d-c032a14b3ce5 req-59eb52e1-628c-4366-9daa-349cbf2fee18 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:46.097960 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-776b1eb3-cc22-4249-8a8d-c032a14b3ce5 req-59eb52e1-628c-4366-9daa-349cbf2fee18 service nova] Creating event network-changed:9d56f899-b2af-4a81-9b71-b87b0c0ab451 for instance bd166847-1e05-4e06-86b1-1f3773eb57f1 on nch2-master-1 Oct 22 20:51:46.103229 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-776b1eb3-cc22-4249-8a8d-c032a14b3ce5 req-59eb52e1-628c-4366-9daa-349cbf2fee18 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034198 Oct 22 20:51:46.104191 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 381/810] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:51:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:51:46.138288 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-33487cb4-ef6b-49b4-82e0-9e91a9f7c9f8 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:51:46.138874 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-33487cb4-ef6b-49b4-82e0-9e91a9f7c9f8 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] [instance: 2f02a0ad-4856-4643-9e69-50547f5c7a98] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:51:46.145436 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-33487cb4-ef6b-49b4-82e0-9e91a9f7c9f8 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:46.145917 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-33487cb4-ef6b-49b4-82e0-9e91a9f7c9f8 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:46.146351 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-33487cb4-ef6b-49b4-82e0-9e91a9f7c9f8 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:46.147096 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-33487cb4-ef6b-49b4-82e0-9e91a9f7c9f8 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:46.147766 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-33487cb4-ef6b-49b4-82e0-9e91a9f7c9f8 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:46.148333 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-33487cb4-ef6b-49b4-82e0-9e91a9f7c9f8 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:46.176353 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-6b74a62e-adad-4ff4-9917-c2985f526105 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:51:46.177062 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-6b74a62e-adad-4ff4-9917-c2985f526105 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] [instance: bd166847-1e05-4e06-86b1-1f3773eb57f1] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:51:46.183699 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6b74a62e-adad-4ff4-9917-c2985f526105 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:46.184262 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6b74a62e-adad-4ff4-9917-c2985f526105 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:46.184826 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6b74a62e-adad-4ff4-9917-c2985f526105 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:46.185565 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6b74a62e-adad-4ff4-9917-c2985f526105 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:46.186181 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6b74a62e-adad-4ff4-9917-c2985f526105 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:46.186593 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6b74a62e-adad-4ff4-9917-c2985f526105 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:46.328337 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-33487cb4-ef6b-49b4-82e0-9e91a9f7c9f8 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c87f0356ca346f39c6216393d85da2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee8c8f7fc4e12bc1f9fcce3e7b581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:51:46.337135 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-33487cb4-ef6b-49b4-82e0-9e91a9f7c9f8 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] 10.222.0.18 "GET /compute/v2.1/servers/2f02a0ad-4856-4643-9e69-50547f5c7a98" status: 200 len: 1311 microversion: 2.1 time: 0.202413 Oct 22 20:51:46.337772 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 430/811] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:51:46 2022] GET /compute/v2.1/servers/2f02a0ad-4856-4643-9e69-50547f5c7a98 => generated 1311 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:51:46.358781 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-6b74a62e-adad-4ff4-9917-c2985f526105 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084d99ccb7dc405f85b1d31cfd255e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '950a163a28d64f41855e56cf88e3b1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:51:46.367056 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-6b74a62e-adad-4ff4-9917-c2985f526105 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] 10.222.0.18 "GET /compute/v2.1/servers/bd166847-1e05-4e06-86b1-1f3773eb57f1" status: 200 len: 1322 microversion: 2.1 time: 0.194907 Oct 22 20:51:46.367678 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 382/812] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:51:46 2022] GET /compute/v2.1/servers/bd166847-1e05-4e06-86b1-1f3773eb57f1 => generated 1322 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:51:46.796107 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-27f84db7-5a3d-4f86-a2f8-07feba15f93a tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:51:46.796924 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-27f84db7-5a3d-4f86-a2f8-07feba15f93a tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] [instance: 7a4f8d67-fade-412f-9554-78f39414132f] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:51:46.806054 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-27f84db7-5a3d-4f86-a2f8-07feba15f93a tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:46.806537 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-27f84db7-5a3d-4f86-a2f8-07feba15f93a tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:46.806969 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-27f84db7-5a3d-4f86-a2f8-07feba15f93a tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:46.807690 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-27f84db7-5a3d-4f86-a2f8-07feba15f93a tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:46.808139 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-27f84db7-5a3d-4f86-a2f8-07feba15f93a tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:46.808557 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-27f84db7-5a3d-4f86-a2f8-07feba15f93a tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:46.882209 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-27f84db7-5a3d-4f86-a2f8-07feba15f93a tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91cf84a287b74618ae1b3368785b0b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902e239d67664098895ab24340b0b780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:51:46.890884 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-27f84db7-5a3d-4f86-a2f8-07feba15f93a tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] 10.222.0.18 "GET /compute/v2.1/servers/7a4f8d67-fade-412f-9554-78f39414132f" status: 200 len: 1268 microversion: 2.1 time: 0.100865 Oct 22 20:51:46.891685 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 431/813] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:51:46 2022] GET /compute/v2.1/servers/7a4f8d67-fade-412f-9554-78f39414132f => generated 1268 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:51:47.362232 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-3f443d9e-d75a-4eba-8270-1b2f4ca9c4cc tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:51:47.363535 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-3f443d9e-d75a-4eba-8270-1b2f4ca9c4cc tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] [instance: 2f02a0ad-4856-4643-9e69-50547f5c7a98] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:51:47.370985 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3f443d9e-d75a-4eba-8270-1b2f4ca9c4cc tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:47.371628 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3f443d9e-d75a-4eba-8270-1b2f4ca9c4cc tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:47.372067 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3f443d9e-d75a-4eba-8270-1b2f4ca9c4cc tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:47.372775 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3f443d9e-d75a-4eba-8270-1b2f4ca9c4cc tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:47.373225 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3f443d9e-d75a-4eba-8270-1b2f4ca9c4cc tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:47.373650 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3f443d9e-d75a-4eba-8270-1b2f4ca9c4cc tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:47.395131 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-0305d50d-cdc4-45a7-b048-9e6c7dcf614a tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:51:47.396255 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-0305d50d-cdc4-45a7-b048-9e6c7dcf614a tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] [instance: bd166847-1e05-4e06-86b1-1f3773eb57f1] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:51:47.404270 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0305d50d-cdc4-45a7-b048-9e6c7dcf614a tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:47.404853 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0305d50d-cdc4-45a7-b048-9e6c7dcf614a tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:47.405425 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0305d50d-cdc4-45a7-b048-9e6c7dcf614a tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:47.406605 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0305d50d-cdc4-45a7-b048-9e6c7dcf614a tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:47.407147 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0305d50d-cdc4-45a7-b048-9e6c7dcf614a tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:47.407986 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0305d50d-cdc4-45a7-b048-9e6c7dcf614a tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:47.592178 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-3f443d9e-d75a-4eba-8270-1b2f4ca9c4cc tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c87f0356ca346f39c6216393d85da2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee8c8f7fc4e12bc1f9fcce3e7b581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:51:47.600810 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-0305d50d-cdc4-45a7-b048-9e6c7dcf614a tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084d99ccb7dc405f85b1d31cfd255e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '950a163a28d64f41855e56cf88e3b1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:51:47.601970 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-3f443d9e-d75a-4eba-8270-1b2f4ca9c4cc tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] 10.222.0.18 "GET /compute/v2.1/servers/2f02a0ad-4856-4643-9e69-50547f5c7a98" status: 200 len: 1311 microversion: 2.1 time: 0.243448 Oct 22 20:51:47.602560 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 383/814] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:51:47 2022] GET /compute/v2.1/servers/2f02a0ad-4856-4643-9e69-50547f5c7a98 => generated 1311 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:51:47.609307 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-0305d50d-cdc4-45a7-b048-9e6c7dcf614a tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] 10.222.0.18 "GET /compute/v2.1/servers/bd166847-1e05-4e06-86b1-1f3773eb57f1" status: 200 len: 1322 microversion: 2.1 time: 0.218921 Oct 22 20:51:47.609870 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 432/815] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:51:47 2022] GET /compute/v2.1/servers/bd166847-1e05-4e06-86b1-1f3773eb57f1 => generated 1322 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:51:47.915758 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-a5a0ad13-1f12-4d4d-b429-dd5a7fbc2c37 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:51:47.916253 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-a5a0ad13-1f12-4d4d-b429-dd5a7fbc2c37 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] [instance: 7a4f8d67-fade-412f-9554-78f39414132f] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:51:47.922694 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a5a0ad13-1f12-4d4d-b429-dd5a7fbc2c37 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:47.923180 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a5a0ad13-1f12-4d4d-b429-dd5a7fbc2c37 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:47.923660 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a5a0ad13-1f12-4d4d-b429-dd5a7fbc2c37 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:47.924340 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a5a0ad13-1f12-4d4d-b429-dd5a7fbc2c37 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:47.924791 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a5a0ad13-1f12-4d4d-b429-dd5a7fbc2c37 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:47.925223 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a5a0ad13-1f12-4d4d-b429-dd5a7fbc2c37 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:47.991683 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-a5a0ad13-1f12-4d4d-b429-dd5a7fbc2c37 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91cf84a287b74618ae1b3368785b0b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902e239d67664098895ab24340b0b780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:51:48.000087 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-a5a0ad13-1f12-4d4d-b429-dd5a7fbc2c37 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] 10.222.0.18 "GET /compute/v2.1/servers/7a4f8d67-fade-412f-9554-78f39414132f" status: 200 len: 1268 microversion: 2.1 time: 0.088725 Oct 22 20:51:48.000663 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 384/816] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:51:47 2022] GET /compute/v2.1/servers/7a4f8d67-fade-412f-9554-78f39414132f => generated 1268 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:51:48.625530 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-d22857eb-e94c-4f26-9136-61260dc257d3 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:51:48.627436 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-d22857eb-e94c-4f26-9136-61260dc257d3 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] [instance: 2f02a0ad-4856-4643-9e69-50547f5c7a98] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:51:48.636691 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d22857eb-e94c-4f26-9136-61260dc257d3 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:48.637418 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-0ea90a53-48f1-440f-ae58-8e7eb7018ea7 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:51:48.638137 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-0ea90a53-48f1-440f-ae58-8e7eb7018ea7 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] [instance: bd166847-1e05-4e06-86b1-1f3773eb57f1] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:51:48.638566 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d22857eb-e94c-4f26-9136-61260dc257d3 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:48.639529 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d22857eb-e94c-4f26-9136-61260dc257d3 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:48.640944 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d22857eb-e94c-4f26-9136-61260dc257d3 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:48.641912 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d22857eb-e94c-4f26-9136-61260dc257d3 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:48.642507 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d22857eb-e94c-4f26-9136-61260dc257d3 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:48.645559 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0ea90a53-48f1-440f-ae58-8e7eb7018ea7 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:48.647523 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0ea90a53-48f1-440f-ae58-8e7eb7018ea7 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:48.649450 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0ea90a53-48f1-440f-ae58-8e7eb7018ea7 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:48.649450 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0ea90a53-48f1-440f-ae58-8e7eb7018ea7 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:48.649450 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0ea90a53-48f1-440f-ae58-8e7eb7018ea7 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:48.649781 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0ea90a53-48f1-440f-ae58-8e7eb7018ea7 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:48.882893 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-0ea90a53-48f1-440f-ae58-8e7eb7018ea7 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084d99ccb7dc405f85b1d31cfd255e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '950a163a28d64f41855e56cf88e3b1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:51:48.886766 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-d22857eb-e94c-4f26-9136-61260dc257d3 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c87f0356ca346f39c6216393d85da2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee8c8f7fc4e12bc1f9fcce3e7b581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:51:48.891228 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-0ea90a53-48f1-440f-ae58-8e7eb7018ea7 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] 10.222.0.18 "GET /compute/v2.1/servers/bd166847-1e05-4e06-86b1-1f3773eb57f1" status: 200 len: 1322 microversion: 2.1 time: 0.262462 Oct 22 20:51:48.891829 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 385/817] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:51:48 2022] GET /compute/v2.1/servers/bd166847-1e05-4e06-86b1-1f3773eb57f1 => generated 1322 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:51:48.894625 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-d22857eb-e94c-4f26-9136-61260dc257d3 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] 10.222.0.18 "GET /compute/v2.1/servers/2f02a0ad-4856-4643-9e69-50547f5c7a98" status: 200 len: 1311 microversion: 2.1 time: 0.273010 Oct 22 20:51:48.895287 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 433/818] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:51:48 2022] GET /compute/v2.1/servers/2f02a0ad-4856-4643-9e69-50547f5c7a98 => generated 1311 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:51:48.986058 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-1f6f5e6a-bd9f-4490-a3f7-b1e7270db251 tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:51:48.988325 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-1f6f5e6a-bd9f-4490-a3f7-b1e7270db251 tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] [instance: 65381d5e-1265-418b-ac70-4ef749d9af14] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:51:48.995933 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1f6f5e6a-bd9f-4490-a3f7-b1e7270db251 tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:48.996817 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1f6f5e6a-bd9f-4490-a3f7-b1e7270db251 tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:48.997613 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1f6f5e6a-bd9f-4490-a3f7-b1e7270db251 tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:48.998855 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1f6f5e6a-bd9f-4490-a3f7-b1e7270db251 tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:48.999741 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1f6f5e6a-bd9f-4490-a3f7-b1e7270db251 tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:49.000540 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1f6f5e6a-bd9f-4490-a3f7-b1e7270db251 tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:49.041549 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-1f6f5e6a-bd9f-4490-a3f7-b1e7270db251 tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] 10.222.0.18 "GET /compute/v2.1/servers/65381d5e-1265-418b-ac70-4ef749d9af14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059303 Oct 22 20:51:49.042880 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-94fac38d-2c51-486c-a45e-1a0f151e1a10 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:51:49.050713 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 386/819] 10.222.0.18 () {58 vars in 1302 bytes} [Sat Oct 22 20:51:48 2022] GET /compute/v2.1/servers/65381d5e-1265-418b-ac70-4ef749d9af14/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:51:49.051711 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-94fac38d-2c51-486c-a45e-1a0f151e1a10 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] [instance: 7a4f8d67-fade-412f-9554-78f39414132f] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:51:49.057841 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:51:49.058522 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-6b756c52-0f4b-4bac-adf6-35e73360516a tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:51:49.059512 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-6b756c52-0f4b-4bac-adf6-35e73360516a tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] [instance: 65381d5e-1265-418b-ac70-4ef749d9af14] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:51:49.059850 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-94fac38d-2c51-486c-a45e-1a0f151e1a10 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:49.060347 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-94fac38d-2c51-486c-a45e-1a0f151e1a10 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:49.060811 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-94fac38d-2c51-486c-a45e-1a0f151e1a10 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:49.061513 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-94fac38d-2c51-486c-a45e-1a0f151e1a10 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:49.067332 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6b756c52-0f4b-4bac-adf6-35e73360516a tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:49.068111 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6b756c52-0f4b-4bac-adf6-35e73360516a tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:49.068771 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6b756c52-0f4b-4bac-adf6-35e73360516a tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:49.070044 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6b756c52-0f4b-4bac-adf6-35e73360516a tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:49.071275 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6b756c52-0f4b-4bac-adf6-35e73360516a tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:49.071654 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-94fac38d-2c51-486c-a45e-1a0f151e1a10 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:49.072161 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6b756c52-0f4b-4bac-adf6-35e73360516a tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:49.072278 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-94fac38d-2c51-486c-a45e-1a0f151e1a10 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:49.160371 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-94fac38d-2c51-486c-a45e-1a0f151e1a10 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91cf84a287b74618ae1b3368785b0b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902e239d67664098895ab24340b0b780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:51:49.168971 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-94fac38d-2c51-486c-a45e-1a0f151e1a10 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] 10.222.0.18 "GET /compute/v2.1/servers/7a4f8d67-fade-412f-9554-78f39414132f" status: 200 len: 1268 microversion: 2.1 time: 0.149596 Oct 22 20:51:49.184198 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 434/820] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:51:49 2022] GET /compute/v2.1/servers/7a4f8d67-fade-412f-9554-78f39414132f => generated 1268 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 20:51:49.232614 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.objects.instance [None req-6b756c52-0f4b-4bac-adf6-35e73360516a tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] Lazy-loading 'services' on Instance uuid 65381d5e-1265-418b-ac70-4ef749d9af14 {{(pid=138744) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 20:51:49.371186 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-6b756c52-0f4b-4bac-adf6-35e73360516a tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] 10.222.0.18 "DELETE /compute/v2.1/servers/65381d5e-1265-418b-ac70-4ef749d9af14/os-volume_attachments/52e959f8-e0fb-44b9-aad5-1abd5310b890" status: 202 len: 0 microversion: 2.1 time: 0.318363 Oct 22 20:51:49.372001 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 387/821] 10.222.0.18 () {58 vars in 1416 bytes} [Sat Oct 22 20:51:49 2022] DELETE /compute/v2.1/servers/65381d5e-1265-418b-ac70-4ef749d9af14/os-volume_attachments/52e959f8-e0fb-44b9-aad5-1abd5310b890 => generated 0 bytes in 320 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 20:51:49.916241 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-69e44861-8567-479f-b865-1b605e90d937 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:51:49.916855 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-69e44861-8567-479f-b865-1b605e90d937 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] [instance: bd166847-1e05-4e06-86b1-1f3773eb57f1] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:51:49.919853 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-15f55ca1-5f17-43a7-be22-bd0a2a52a993 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:51:49.920257 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-15f55ca1-5f17-43a7-be22-bd0a2a52a993 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] [instance: 2f02a0ad-4856-4643-9e69-50547f5c7a98] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:51:49.924147 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-69e44861-8567-479f-b865-1b605e90d937 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:49.924708 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-69e44861-8567-479f-b865-1b605e90d937 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:49.925472 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-69e44861-8567-479f-b865-1b605e90d937 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:49.926187 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-69e44861-8567-479f-b865-1b605e90d937 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:49.926707 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-69e44861-8567-479f-b865-1b605e90d937 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:49.927099 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-69e44861-8567-479f-b865-1b605e90d937 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:49.929045 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-15f55ca1-5f17-43a7-be22-bd0a2a52a993 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:49.929664 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-15f55ca1-5f17-43a7-be22-bd0a2a52a993 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:49.930163 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-15f55ca1-5f17-43a7-be22-bd0a2a52a993 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:49.931092 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-15f55ca1-5f17-43a7-be22-bd0a2a52a993 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:49.932102 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-15f55ca1-5f17-43a7-be22-bd0a2a52a993 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:49.932736 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-15f55ca1-5f17-43a7-be22-bd0a2a52a993 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:50.123217 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-69e44861-8567-479f-b865-1b605e90d937 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084d99ccb7dc405f85b1d31cfd255e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '950a163a28d64f41855e56cf88e3b1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:51:50.127158 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-15f55ca1-5f17-43a7-be22-bd0a2a52a993 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c87f0356ca346f39c6216393d85da2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee8c8f7fc4e12bc1f9fcce3e7b581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:51:50.131737 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-69e44861-8567-479f-b865-1b605e90d937 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] 10.222.0.18 "GET /compute/v2.1/servers/bd166847-1e05-4e06-86b1-1f3773eb57f1" status: 200 len: 1322 microversion: 2.1 time: 0.219557 Oct 22 20:51:50.132890 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 435/822] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:51:49 2022] GET /compute/v2.1/servers/bd166847-1e05-4e06-86b1-1f3773eb57f1 => generated 1322 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:51:50.138330 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-15f55ca1-5f17-43a7-be22-bd0a2a52a993 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] 10.222.0.18 "GET /compute/v2.1/servers/2f02a0ad-4856-4643-9e69-50547f5c7a98" status: 200 len: 1493 microversion: 2.1 time: 0.223678 Oct 22 20:51:50.138948 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 388/823] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:51:49 2022] GET /compute/v2.1/servers/2f02a0ad-4856-4643-9e69-50547f5c7a98 => generated 1493 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:51:50.160641 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-35547dfb-a16c-4d89-b35f-4a9104e23e75 tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:51:50.161255 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-35547dfb-a16c-4d89-b35f-4a9104e23e75 tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] [instance: 2f02a0ad-4856-4643-9e69-50547f5c7a98] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:51:50.168577 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-35547dfb-a16c-4d89-b35f-4a9104e23e75 tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:50.169117 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-35547dfb-a16c-4d89-b35f-4a9104e23e75 tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:50.169584 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-35547dfb-a16c-4d89-b35f-4a9104e23e75 tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:50.170307 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-35547dfb-a16c-4d89-b35f-4a9104e23e75 tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:50.170765 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-35547dfb-a16c-4d89-b35f-4a9104e23e75 tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:50.171198 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-35547dfb-a16c-4d89-b35f-4a9104e23e75 tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:50.192590 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-8e41b123-c98d-460e-8273-3ca929078d8f tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:51:50.193349 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-8e41b123-c98d-460e-8273-3ca929078d8f tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] [instance: 7a4f8d67-fade-412f-9554-78f39414132f] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:51:50.199735 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8e41b123-c98d-460e-8273-3ca929078d8f tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:50.200289 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8e41b123-c98d-460e-8273-3ca929078d8f tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:50.200793 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8e41b123-c98d-460e-8273-3ca929078d8f tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:50.201591 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8e41b123-c98d-460e-8273-3ca929078d8f tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:50.202217 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8e41b123-c98d-460e-8273-3ca929078d8f tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:50.202807 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8e41b123-c98d-460e-8273-3ca929078d8f tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:50.411998 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-8e41b123-c98d-460e-8273-3ca929078d8f tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91cf84a287b74618ae1b3368785b0b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902e239d67664098895ab24340b0b780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:51:50.416310 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-35547dfb-a16c-4d89-b35f-4a9104e23e75 tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/2f02a0ad-4856-4643-9e69-50547f5c7a98" status: 200 len: 1644 microversion: 2.1 time: 0.259328 Oct 22 20:51:50.417050 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 436/824] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:51:50 2022] GET /compute/v2.1/servers/2f02a0ad-4856-4643-9e69-50547f5c7a98 => generated 1644 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:51:50.422148 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-8e41b123-c98d-460e-8273-3ca929078d8f tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] 10.222.0.18 "GET /compute/v2.1/servers/7a4f8d67-fade-412f-9554-78f39414132f" status: 200 len: 1316 microversion: 2.1 time: 0.233013 Oct 22 20:51:50.423246 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 389/825] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:51:50 2022] GET /compute/v2.1/servers/7a4f8d67-fade-412f-9554-78f39414132f => generated 1316 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:51:50.439731 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-862ce040-5749-4f21-8e01-f913b0a10b83 tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:51:50.440629 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-862ce040-5749-4f21-8e01-f913b0a10b83 tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] [instance: 2f02a0ad-4856-4643-9e69-50547f5c7a98] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:51:50.447256 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-862ce040-5749-4f21-8e01-f913b0a10b83 tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:50.447834 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-862ce040-5749-4f21-8e01-f913b0a10b83 tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:50.448277 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-862ce040-5749-4f21-8e01-f913b0a10b83 tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:50.448993 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-862ce040-5749-4f21-8e01-f913b0a10b83 tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:50.449679 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-862ce040-5749-4f21-8e01-f913b0a10b83 tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:50.450276 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-862ce040-5749-4f21-8e01-f913b0a10b83 tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:50.633179 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-862ce040-5749-4f21-8e01-f913b0a10b83 tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/2f02a0ad-4856-4643-9e69-50547f5c7a98" status: 200 len: 1644 microversion: 2.1 time: 0.197207 Oct 22 20:51:50.634284 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 437/826] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:51:50 2022] GET /compute/v2.1/servers/2f02a0ad-4856-4643-9e69-50547f5c7a98 => generated 1644 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:51:50.657067 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-4f4cde82-0b7b-44b3-b16f-56d92235f6c2 tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:51:50.661639 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4f4cde82-0b7b-44b3-b16f-56d92235f6c2 tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:50.662039 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4f4cde82-0b7b-44b3-b16f-56d92235f6c2 tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:50.662554 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4f4cde82-0b7b-44b3-b16f-56d92235f6c2 tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:50.663363 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4f4cde82-0b7b-44b3-b16f-56d92235f6c2 tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:50.663839 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4f4cde82-0b7b-44b3-b16f-56d92235f6c2 tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:50.664498 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4f4cde82-0b7b-44b3-b16f-56d92235f6c2 tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:50.688822 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-4f4cde82-0b7b-44b3-b16f-56d92235f6c2 tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] 10.222.0.18 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.035367 Oct 22 20:51:50.689342 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 390/827] 10.222.0.18 () {58 vars in 1176 bytes} [Sat Oct 22 20:51:50 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:51:50.702017 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-e17b3bbf-022f-420f-a40f-9c335a8a78d4 tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:51:50.702857 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-e17b3bbf-022f-420f-a40f-9c335a8a78d4 tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] [instance: 2f02a0ad-4856-4643-9e69-50547f5c7a98] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:51:50.709783 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e17b3bbf-022f-420f-a40f-9c335a8a78d4 tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:50.710392 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e17b3bbf-022f-420f-a40f-9c335a8a78d4 tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:50.710921 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e17b3bbf-022f-420f-a40f-9c335a8a78d4 tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:50.711714 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e17b3bbf-022f-420f-a40f-9c335a8a78d4 tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:50.712237 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e17b3bbf-022f-420f-a40f-9c335a8a78d4 tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:50.712994 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e17b3bbf-022f-420f-a40f-9c335a8a78d4 tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:50.784012 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-e17b3bbf-022f-420f-a40f-9c335a8a78d4 tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] 10.222.0.18 "POST /compute/v2.1/servers/2f02a0ad-4856-4643-9e69-50547f5c7a98/action" status: 202 len: 0 microversion: 2.1 time: 0.085674 Oct 22 20:51:50.785023 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 438/828] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 20:51:50 2022] POST /compute/v2.1/servers/2f02a0ad-4856-4643-9e69-50547f5c7a98/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 20:51:50.794259 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-9b5d1791-1892-49f2-99bf-5cbf001cedcd tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:51:50.794911 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-9b5d1791-1892-49f2-99bf-5cbf001cedcd tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] [instance: 2f02a0ad-4856-4643-9e69-50547f5c7a98] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:51:50.801755 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9b5d1791-1892-49f2-99bf-5cbf001cedcd tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:50.802283 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9b5d1791-1892-49f2-99bf-5cbf001cedcd tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:50.802725 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9b5d1791-1892-49f2-99bf-5cbf001cedcd tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:50.803507 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9b5d1791-1892-49f2-99bf-5cbf001cedcd tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:50.803985 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9b5d1791-1892-49f2-99bf-5cbf001cedcd tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:50.804377 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9b5d1791-1892-49f2-99bf-5cbf001cedcd tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:50.935098 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-9b5d1791-1892-49f2-99bf-5cbf001cedcd tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/2f02a0ad-4856-4643-9e69-50547f5c7a98" status: 200 len: 1649 microversion: 2.1 time: 0.145253 Oct 22 20:51:50.935747 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 391/829] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:51:50 2022] GET /compute/v2.1/servers/2f02a0ad-4856-4643-9e69-50547f5c7a98 => generated 1649 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:51:51.161379 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-72948b0e-95ae-4568-949d-86e78c37c6ed tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:51:51.162342 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-72948b0e-95ae-4568-949d-86e78c37c6ed tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] [instance: bd166847-1e05-4e06-86b1-1f3773eb57f1] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:51:51.173106 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-72948b0e-95ae-4568-949d-86e78c37c6ed tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:51.173908 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-72948b0e-95ae-4568-949d-86e78c37c6ed tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:51.174635 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-72948b0e-95ae-4568-949d-86e78c37c6ed tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:51.175841 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-72948b0e-95ae-4568-949d-86e78c37c6ed tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:51.176604 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-72948b0e-95ae-4568-949d-86e78c37c6ed tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:51.177367 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-72948b0e-95ae-4568-949d-86e78c37c6ed tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:51.329848 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-72948b0e-95ae-4568-949d-86e78c37c6ed tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084d99ccb7dc405f85b1d31cfd255e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '950a163a28d64f41855e56cf88e3b1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:51:51.338627 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-72948b0e-95ae-4568-949d-86e78c37c6ed tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] 10.222.0.18 "GET /compute/v2.1/servers/bd166847-1e05-4e06-86b1-1f3773eb57f1" status: 200 len: 1322 microversion: 2.1 time: 0.185879 Oct 22 20:51:51.339553 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 439/830] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:51:51 2022] GET /compute/v2.1/servers/bd166847-1e05-4e06-86b1-1f3773eb57f1 => generated 1322 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:51:51.446672 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-bb77b55d-2e1f-4f8c-8774-d42d7ccb3997 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:51:51.447292 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-bb77b55d-2e1f-4f8c-8774-d42d7ccb3997 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] [instance: 7a4f8d67-fade-412f-9554-78f39414132f] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:51:51.453707 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bb77b55d-2e1f-4f8c-8774-d42d7ccb3997 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:51.454202 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bb77b55d-2e1f-4f8c-8774-d42d7ccb3997 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:51.454646 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bb77b55d-2e1f-4f8c-8774-d42d7ccb3997 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:51.455327 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bb77b55d-2e1f-4f8c-8774-d42d7ccb3997 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:51.456030 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bb77b55d-2e1f-4f8c-8774-d42d7ccb3997 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:51.456478 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bb77b55d-2e1f-4f8c-8774-d42d7ccb3997 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:51.603095 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-2cbfc8a0-5414-4cb6-81a5-74884ae9ea63 tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:51:51.605636 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-2cbfc8a0-5414-4cb6-81a5-74884ae9ea63 tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] [instance: 65381d5e-1265-418b-ac70-4ef749d9af14] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:51:51.612172 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2cbfc8a0-5414-4cb6-81a5-74884ae9ea63 tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:51.612862 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2cbfc8a0-5414-4cb6-81a5-74884ae9ea63 tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:51.613301 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2cbfc8a0-5414-4cb6-81a5-74884ae9ea63 tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:51.614063 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2cbfc8a0-5414-4cb6-81a5-74884ae9ea63 tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:51.614522 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2cbfc8a0-5414-4cb6-81a5-74884ae9ea63 tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:51.614943 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2cbfc8a0-5414-4cb6-81a5-74884ae9ea63 tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:51.617864 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-bb77b55d-2e1f-4f8c-8774-d42d7ccb3997 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91cf84a287b74618ae1b3368785b0b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902e239d67664098895ab24340b0b780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:51:51.627086 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-bb77b55d-2e1f-4f8c-8774-d42d7ccb3997 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] 10.222.0.18 "GET /compute/v2.1/servers/7a4f8d67-fade-412f-9554-78f39414132f" status: 200 len: 1316 microversion: 2.1 time: 0.184692 Oct 22 20:51:51.628011 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 392/831] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:51:51 2022] GET /compute/v2.1/servers/7a4f8d67-fade-412f-9554-78f39414132f => generated 1316 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:51:51.650954 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-2cbfc8a0-5414-4cb6-81a5-74884ae9ea63 tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] 10.222.0.18 "GET /compute/v2.1/servers/65381d5e-1265-418b-ac70-4ef749d9af14/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052083 Oct 22 20:51:51.651573 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 440/832] 10.222.0.18 () {58 vars in 1302 bytes} [Sat Oct 22 20:51:51 2022] GET /compute/v2.1/servers/65381d5e-1265-418b-ac70-4ef749d9af14/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 22 20:51:51.728310 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-7ccd6035-100b-4455-b28b-13093a255fc6 tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:51:51.730757 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-7ccd6035-100b-4455-b28b-13093a255fc6 tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] [instance: 65381d5e-1265-418b-ac70-4ef749d9af14] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:51:51.737323 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7ccd6035-100b-4455-b28b-13093a255fc6 tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:51.737853 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7ccd6035-100b-4455-b28b-13093a255fc6 tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:51.738300 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7ccd6035-100b-4455-b28b-13093a255fc6 tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:51.739123 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7ccd6035-100b-4455-b28b-13093a255fc6 tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:51.739690 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7ccd6035-100b-4455-b28b-13093a255fc6 tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:51.740189 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7ccd6035-100b-4455-b28b-13093a255fc6 tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:51.784454 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-7ccd6035-100b-4455-b28b-13093a255fc6 tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] 10.222.0.18 "GET /compute/v2.1/servers/65381d5e-1265-418b-ac70-4ef749d9af14/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.062040 Oct 22 20:51:51.785233 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 393/833] 10.222.0.18 () {58 vars in 1302 bytes} [Sat Oct 22 20:51:51 2022] GET /compute/v2.1/servers/65381d5e-1265-418b-ac70-4ef749d9af14/os-volume_attachments => generated 25 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 22 20:51:51.858357 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-40644e91-4a7c-44e8-9f72-d1751c584335 tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:51:51.858863 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-40644e91-4a7c-44e8-9f72-d1751c584335 tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] [instance: 65381d5e-1265-418b-ac70-4ef749d9af14] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:51:51.865226 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-40644e91-4a7c-44e8-9f72-d1751c584335 tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:51.865758 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-40644e91-4a7c-44e8-9f72-d1751c584335 tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:51.866534 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-40644e91-4a7c-44e8-9f72-d1751c584335 tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:51.867642 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-40644e91-4a7c-44e8-9f72-d1751c584335 tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:51.868107 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-40644e91-4a7c-44e8-9f72-d1751c584335 tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:51.868581 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-40644e91-4a7c-44e8-9f72-d1751c584335 tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:51.895559 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-40644e91-4a7c-44e8-9f72-d1751c584335 tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] [instance: 65381d5e-1265-418b-ac70-4ef749d9af14] Going to try to terminate instance {{(pid=138745) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 20:51:51.898737 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:51:51.943408 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-cfb1060b-7106-4e86-8e85-b750f8d3c3cd req-fd611ce0-ec7e-4095-b042-3055cfe145df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a4f8d67-fade-412f-9554-78f39414132f", "tag": "a282ab7b-0cb4-4ab4-a8a5-cae0fe603953"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:51:51.954963 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-cfb1060b-7106-4e86-8e85-b750f8d3c3cd req-fd611ce0-ec7e-4095-b042-3055cfe145df service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:51.955882 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-cfb1060b-7106-4e86-8e85-b750f8d3c3cd req-fd611ce0-ec7e-4095-b042-3055cfe145df service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:51.956568 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-cfb1060b-7106-4e86-8e85-b750f8d3c3cd req-fd611ce0-ec7e-4095-b042-3055cfe145df service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:51.975329 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-cfb1060b-7106-4e86-8e85-b750f8d3c3cd req-fd611ce0-ec7e-4095-b042-3055cfe145df service nova] Creating event network-changed:a282ab7b-0cb4-4ab4-a8a5-cae0fe603953 for instance 7a4f8d67-fade-412f-9554-78f39414132f on nch2-master-1 Oct 22 20:51:51.982821 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-cfb1060b-7106-4e86-8e85-b750f8d3c3cd req-fd611ce0-ec7e-4095-b042-3055cfe145df service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045259 Oct 22 20:51:51.983637 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 394/834] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:51:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 20:51:51.989431 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-c8cc8644-f297-41d4-8e1c-e5b8158f4337 tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:51:51.990097 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-c8cc8644-f297-41d4-8e1c-e5b8158f4337 tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] [instance: 2f02a0ad-4856-4643-9e69-50547f5c7a98] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:51:52.001221 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c8cc8644-f297-41d4-8e1c-e5b8158f4337 tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:52.002127 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c8cc8644-f297-41d4-8e1c-e5b8158f4337 tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:52.002810 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c8cc8644-f297-41d4-8e1c-e5b8158f4337 tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:52.003764 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c8cc8644-f297-41d4-8e1c-e5b8158f4337 tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:52.004276 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-40644e91-4a7c-44e8-9f72-d1751c584335 tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] 10.222.0.18 "DELETE /compute/v2.1/servers/65381d5e-1265-418b-ac70-4ef749d9af14" status: 204 len: 0 microversion: 2.1 time: 0.149472 Oct 22 20:51:52.004904 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c8cc8644-f297-41d4-8e1c-e5b8158f4337 tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:52.005728 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 441/835] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 20:51:51 2022] DELETE /compute/v2.1/servers/65381d5e-1265-418b-ac70-4ef749d9af14 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 20:51:52.006546 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c8cc8644-f297-41d4-8e1c-e5b8158f4337 tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:52.028926 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-fea17467-ac26-42f9-9b8b-4bfa621f8355 tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:51:52.030795 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-fea17467-ac26-42f9-9b8b-4bfa621f8355 tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] [instance: 65381d5e-1265-418b-ac70-4ef749d9af14] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:51:52.038199 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fea17467-ac26-42f9-9b8b-4bfa621f8355 tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:52.039246 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fea17467-ac26-42f9-9b8b-4bfa621f8355 tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:52.040050 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fea17467-ac26-42f9-9b8b-4bfa621f8355 tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:52.041227 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fea17467-ac26-42f9-9b8b-4bfa621f8355 tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:52.041786 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fea17467-ac26-42f9-9b8b-4bfa621f8355 tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:52.042433 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fea17467-ac26-42f9-9b8b-4bfa621f8355 tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:52.221882 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-c8cc8644-f297-41d4-8e1c-e5b8158f4337 tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/2f02a0ad-4856-4643-9e69-50547f5c7a98" status: 200 len: 1629 microversion: 2.1 time: 0.236838 Oct 22 20:51:52.222450 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 395/836] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:51:51 2022] GET /compute/v2.1/servers/2f02a0ad-4856-4643-9e69-50547f5c7a98 => generated 1629 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:51:52.227244 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-fea17467-ac26-42f9-9b8b-4bfa621f8355 tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b892876156f34b0d99a6c853d0cd4905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b403b83cad4babab211dafade27bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:51:52.235488 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-fea17467-ac26-42f9-9b8b-4bfa621f8355 tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] 10.222.0.18 "GET /compute/v2.1/servers/65381d5e-1265-418b-ac70-4ef749d9af14" status: 200 len: 1681 microversion: 2.1 time: 0.221646 Oct 22 20:51:52.236115 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 442/837] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:51:52 2022] GET /compute/v2.1/servers/65381d5e-1265-418b-ac70-4ef749d9af14 => generated 1681 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:51:52.246122 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-1d00001b-6a2e-4413-8dbd-781f5c64fbba tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch1-master-1", "block_migration": true, "disk_over_commit": false}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:51:52.248734 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-1d00001b-6a2e-4413-8dbd-781f5c64fbba tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] [instance: 2f02a0ad-4856-4643-9e69-50547f5c7a98] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:51:52.255441 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1d00001b-6a2e-4413-8dbd-781f5c64fbba tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:52.255992 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1d00001b-6a2e-4413-8dbd-781f5c64fbba tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:52.256455 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1d00001b-6a2e-4413-8dbd-781f5c64fbba tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:52.257416 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1d00001b-6a2e-4413-8dbd-781f5c64fbba tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:52.258090 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1d00001b-6a2e-4413-8dbd-781f5c64fbba tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:52.258597 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1d00001b-6a2e-4413-8dbd-781f5c64fbba tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:52.283444 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.objects.instance [None req-1d00001b-6a2e-4413-8dbd-781f5c64fbba tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] Lazy-loading 'flavor' on Instance uuid 2f02a0ad-4856-4643-9e69-50547f5c7a98 {{(pid=138744) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 20:51:52.295586 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-1d00001b-6a2e-4413-8dbd-781f5c64fbba tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] [instance: 2f02a0ad-4856-4643-9e69-50547f5c7a98] Going to try to live migrate instance to nch1-master-1 {{(pid=138744) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 22 20:51:52.336990 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1,nova_cell1:UPDATE=1 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:51:52.363741 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-50587648-4c39-47cd-9036-ecfbb6e2ef9c tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:51:52.364453 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-50587648-4c39-47cd-9036-ecfbb6e2ef9c tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] [instance: bd166847-1e05-4e06-86b1-1f3773eb57f1] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:51:52.371047 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-50587648-4c39-47cd-9036-ecfbb6e2ef9c tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:52.371860 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-50587648-4c39-47cd-9036-ecfbb6e2ef9c tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:52.372307 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-50587648-4c39-47cd-9036-ecfbb6e2ef9c tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:52.374736 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-50587648-4c39-47cd-9036-ecfbb6e2ef9c tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:52.375636 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-50587648-4c39-47cd-9036-ecfbb6e2ef9c tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:52.376600 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-50587648-4c39-47cd-9036-ecfbb6e2ef9c tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:52.516403 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-50587648-4c39-47cd-9036-ecfbb6e2ef9c tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084d99ccb7dc405f85b1d31cfd255e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '950a163a28d64f41855e56cf88e3b1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:51:52.524899 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-50587648-4c39-47cd-9036-ecfbb6e2ef9c tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] 10.222.0.18 "GET /compute/v2.1/servers/bd166847-1e05-4e06-86b1-1f3773eb57f1" status: 200 len: 1322 microversion: 2.1 time: 0.165701 Oct 22 20:51:52.525574 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 443/838] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:51:52 2022] GET /compute/v2.1/servers/bd166847-1e05-4e06-86b1-1f3773eb57f1 => generated 1322 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 20:51:52.655214 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-e2b90961-1fac-483b-85ab-f38d039557b1 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:51:52.656002 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-e2b90961-1fac-483b-85ab-f38d039557b1 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] [instance: 7a4f8d67-fade-412f-9554-78f39414132f] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:51:52.662567 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e2b90961-1fac-483b-85ab-f38d039557b1 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:52.663312 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e2b90961-1fac-483b-85ab-f38d039557b1 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:52.663987 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e2b90961-1fac-483b-85ab-f38d039557b1 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:52.664685 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e2b90961-1fac-483b-85ab-f38d039557b1 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:52.665158 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e2b90961-1fac-483b-85ab-f38d039557b1 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:52.665573 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e2b90961-1fac-483b-85ab-f38d039557b1 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:52.813784 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-e2b90961-1fac-483b-85ab-f38d039557b1 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91cf84a287b74618ae1b3368785b0b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902e239d67664098895ab24340b0b780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:51:52.823754 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-e2b90961-1fac-483b-85ab-f38d039557b1 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] 10.222.0.18 "GET /compute/v2.1/servers/7a4f8d67-fade-412f-9554-78f39414132f" status: 200 len: 1316 microversion: 2.1 time: 0.172659 Oct 22 20:51:52.824610 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 444/839] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:51:52 2022] GET /compute/v2.1/servers/7a4f8d67-fade-412f-9554-78f39414132f => generated 1316 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:51:53.259396 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-802eff3d-e0fb-4d0a-b2ca-b09adf84cd1b tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:51:53.260041 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-802eff3d-e0fb-4d0a-b2ca-b09adf84cd1b tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] [instance: 65381d5e-1265-418b-ac70-4ef749d9af14] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:51:53.267260 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-802eff3d-e0fb-4d0a-b2ca-b09adf84cd1b tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:53.267796 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-802eff3d-e0fb-4d0a-b2ca-b09adf84cd1b tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:53.268277 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-802eff3d-e0fb-4d0a-b2ca-b09adf84cd1b tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:53.269028 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-802eff3d-e0fb-4d0a-b2ca-b09adf84cd1b tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:53.269482 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-802eff3d-e0fb-4d0a-b2ca-b09adf84cd1b tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:53.269916 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-802eff3d-e0fb-4d0a-b2ca-b09adf84cd1b tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:53.406997 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-802eff3d-e0fb-4d0a-b2ca-b09adf84cd1b tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b892876156f34b0d99a6c853d0cd4905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b403b83cad4babab211dafade27bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:51:53.416478 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-802eff3d-e0fb-4d0a-b2ca-b09adf84cd1b tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] 10.222.0.18 "GET /compute/v2.1/servers/65381d5e-1265-418b-ac70-4ef749d9af14" status: 200 len: 1681 microversion: 2.1 time: 0.161358 Oct 22 20:51:53.417059 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 445/840] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:51:53 2022] GET /compute/v2.1/servers/65381d5e-1265-418b-ac70-4ef749d9af14 => generated 1681 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:51:53.551113 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-fa0ad2cd-ece1-417b-8bd8-514a8d4c5ac1 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:51:53.551704 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-fa0ad2cd-ece1-417b-8bd8-514a8d4c5ac1 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] [instance: bd166847-1e05-4e06-86b1-1f3773eb57f1] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:51:53.559306 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fa0ad2cd-ece1-417b-8bd8-514a8d4c5ac1 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:53.560164 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fa0ad2cd-ece1-417b-8bd8-514a8d4c5ac1 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:53.560598 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fa0ad2cd-ece1-417b-8bd8-514a8d4c5ac1 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:53.561420 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fa0ad2cd-ece1-417b-8bd8-514a8d4c5ac1 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:53.562071 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fa0ad2cd-ece1-417b-8bd8-514a8d4c5ac1 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:53.562637 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fa0ad2cd-ece1-417b-8bd8-514a8d4c5ac1 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:53.699889 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-fa0ad2cd-ece1-417b-8bd8-514a8d4c5ac1 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084d99ccb7dc405f85b1d31cfd255e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '950a163a28d64f41855e56cf88e3b1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:51:53.708425 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-fa0ad2cd-ece1-417b-8bd8-514a8d4c5ac1 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] 10.222.0.18 "GET /compute/v2.1/servers/bd166847-1e05-4e06-86b1-1f3773eb57f1" status: 200 len: 1322 microversion: 2.1 time: 0.163175 Oct 22 20:51:53.723364 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 446/841] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:51:53 2022] GET /compute/v2.1/servers/bd166847-1e05-4e06-86b1-1f3773eb57f1 => generated 1322 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:51:53.847608 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-05b609a3-c278-4036-94dd-2e1ce22f9077 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:51:53.848170 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-05b609a3-c278-4036-94dd-2e1ce22f9077 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] [instance: 7a4f8d67-fade-412f-9554-78f39414132f] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:51:53.856447 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-05b609a3-c278-4036-94dd-2e1ce22f9077 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:53.856700 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-05b609a3-c278-4036-94dd-2e1ce22f9077 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:53.857225 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-05b609a3-c278-4036-94dd-2e1ce22f9077 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:53.859240 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-05b609a3-c278-4036-94dd-2e1ce22f9077 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:53.859240 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-05b609a3-c278-4036-94dd-2e1ce22f9077 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:53.859596 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-05b609a3-c278-4036-94dd-2e1ce22f9077 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:54.020061 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-05b609a3-c278-4036-94dd-2e1ce22f9077 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91cf84a287b74618ae1b3368785b0b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902e239d67664098895ab24340b0b780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:51:54.028523 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-05b609a3-c278-4036-94dd-2e1ce22f9077 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] 10.222.0.18 "GET /compute/v2.1/servers/7a4f8d67-fade-412f-9554-78f39414132f" status: 200 len: 1316 microversion: 2.1 time: 0.185287 Oct 22 20:51:54.029094 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 447/842] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:51:53 2022] GET /compute/v2.1/servers/7a4f8d67-fade-412f-9554-78f39414132f => generated 1316 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:51:54.441027 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-caa3ff84-b0fe-4846-9d23-2eb4a9c75168 tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:51:54.441755 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-caa3ff84-b0fe-4846-9d23-2eb4a9c75168 tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] [instance: 65381d5e-1265-418b-ac70-4ef749d9af14] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:51:54.448911 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-caa3ff84-b0fe-4846-9d23-2eb4a9c75168 tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:54.449404 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-caa3ff84-b0fe-4846-9d23-2eb4a9c75168 tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:54.449852 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-caa3ff84-b0fe-4846-9d23-2eb4a9c75168 tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:54.450992 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-caa3ff84-b0fe-4846-9d23-2eb4a9c75168 tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:54.450992 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-caa3ff84-b0fe-4846-9d23-2eb4a9c75168 tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:54.451443 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-caa3ff84-b0fe-4846-9d23-2eb4a9c75168 tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:54.494904 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell0:SELECT=1 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:51:54.515406 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell0:SELECT=54 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:51:54.592199 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-caa3ff84-b0fe-4846-9d23-2eb4a9c75168 tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b892876156f34b0d99a6c853d0cd4905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b403b83cad4babab211dafade27bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:51:54.600620 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-caa3ff84-b0fe-4846-9d23-2eb4a9c75168 tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] 10.222.0.18 "GET /compute/v2.1/servers/65381d5e-1265-418b-ac70-4ef749d9af14" status: 200 len: 1681 microversion: 2.1 time: 0.164248 Oct 22 20:51:54.601494 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 448/843] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:51:54 2022] GET /compute/v2.1/servers/65381d5e-1265-418b-ac70-4ef749d9af14 => generated 1681 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:51:54.659649 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell0:SELECT=21 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:51:54.714610 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-1d00001b-6a2e-4413-8dbd-781f5c64fbba tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] 10.222.0.18 "POST /compute/v2.1/servers/2f02a0ad-4856-4643-9e69-50547f5c7a98/action" status: 202 len: 0 microversion: 2.1 time: 2.472313 Oct 22 20:51:54.715133 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 396/844] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 20:51:52 2022] POST /compute/v2.1/servers/2f02a0ad-4856-4643-9e69-50547f5c7a98/action => generated 0 bytes in 2474 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 22 20:51:54.723796 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-cffc4791-5b05-4b94-9212-7160b1856d94 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:51:54.724412 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-cffc4791-5b05-4b94-9212-7160b1856d94 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] [instance: 2f02a0ad-4856-4643-9e69-50547f5c7a98] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:51:54.733507 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-6002c6d9-b922-4369-939a-71a53b0d1aa6 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:51:54.733667 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cffc4791-5b05-4b94-9212-7160b1856d94 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:54.734473 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-6002c6d9-b922-4369-939a-71a53b0d1aa6 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] [instance: bd166847-1e05-4e06-86b1-1f3773eb57f1] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:51:54.734606 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cffc4791-5b05-4b94-9212-7160b1856d94 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:54.736403 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cffc4791-5b05-4b94-9212-7160b1856d94 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:54.737079 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cffc4791-5b05-4b94-9212-7160b1856d94 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:54.737639 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cffc4791-5b05-4b94-9212-7160b1856d94 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:54.738324 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cffc4791-5b05-4b94-9212-7160b1856d94 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:54.743124 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6002c6d9-b922-4369-939a-71a53b0d1aa6 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:54.743721 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6002c6d9-b922-4369-939a-71a53b0d1aa6 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:54.744514 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6002c6d9-b922-4369-939a-71a53b0d1aa6 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:54.745547 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6002c6d9-b922-4369-939a-71a53b0d1aa6 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:54.746043 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6002c6d9-b922-4369-939a-71a53b0d1aa6 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:54.746456 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6002c6d9-b922-4369-939a-71a53b0d1aa6 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:54.983248 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-cffc4791-5b05-4b94-9212-7160b1856d94 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c87f0356ca346f39c6216393d85da2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee8c8f7fc4e12bc1f9fcce3e7b581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:51:54.986496 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-6002c6d9-b922-4369-939a-71a53b0d1aa6 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084d99ccb7dc405f85b1d31cfd255e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '950a163a28d64f41855e56cf88e3b1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:51:54.998091 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-cffc4791-5b05-4b94-9212-7160b1856d94 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] 10.222.0.18 "GET /compute/v2.1/servers/2f02a0ad-4856-4643-9e69-50547f5c7a98" status: 200 len: 1503 microversion: 2.1 time: 0.274794 Oct 22 20:51:54.998865 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 449/845] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:51:54 2022] GET /compute/v2.1/servers/2f02a0ad-4856-4643-9e69-50547f5c7a98 => generated 1503 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:51:54.998989 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-6002c6d9-b922-4369-939a-71a53b0d1aa6 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] 10.222.0.18 "GET /compute/v2.1/servers/bd166847-1e05-4e06-86b1-1f3773eb57f1" status: 200 len: 1322 microversion: 2.1 time: 0.269554 Oct 22 20:51:55.000436 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 397/846] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:51:54 2022] GET /compute/v2.1/servers/bd166847-1e05-4e06-86b1-1f3773eb57f1 => generated 1322 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:51:55.018018 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-76635827-1607-4d63-b746-de7aed94c8ad req-65d59d78-164e-40fb-ab5b-82b660701900 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd166847-1e05-4e06-86b1-1f3773eb57f1", "name": "network-vif-plugged", "status": "completed", "tag": "9d56f899-b2af-4a81-9b71-b87b0c0ab451"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:51:55.041838 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-76635827-1607-4d63-b746-de7aed94c8ad req-65d59d78-164e-40fb-ab5b-82b660701900 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:55.042341 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-76635827-1607-4d63-b746-de7aed94c8ad req-65d59d78-164e-40fb-ab5b-82b660701900 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:55.042787 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-76635827-1607-4d63-b746-de7aed94c8ad req-65d59d78-164e-40fb-ab5b-82b660701900 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:55.052309 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-0e0b1bbd-dde6-45f7-be32-4c02e6bf4fe2 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:51:55.053520 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-0e0b1bbd-dde6-45f7-be32-4c02e6bf4fe2 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] [instance: 7a4f8d67-fade-412f-9554-78f39414132f] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:51:55.059805 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-76635827-1607-4d63-b746-de7aed94c8ad req-65d59d78-164e-40fb-ab5b-82b660701900 service nova] Creating event network-vif-plugged:9d56f899-b2af-4a81-9b71-b87b0c0ab451 for instance bd166847-1e05-4e06-86b1-1f3773eb57f1 on nch2-master-1 Oct 22 20:51:55.064943 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0e0b1bbd-dde6-45f7-be32-4c02e6bf4fe2 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:55.065447 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0e0b1bbd-dde6-45f7-be32-4c02e6bf4fe2 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:55.065891 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0e0b1bbd-dde6-45f7-be32-4c02e6bf4fe2 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:55.066611 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0e0b1bbd-dde6-45f7-be32-4c02e6bf4fe2 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:55.067133 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0e0b1bbd-dde6-45f7-be32-4c02e6bf4fe2 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:55.067724 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0e0b1bbd-dde6-45f7-be32-4c02e6bf4fe2 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:55.070012 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-76635827-1607-4d63-b746-de7aed94c8ad req-65d59d78-164e-40fb-ab5b-82b660701900 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069273 Oct 22 20:51:55.071189 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 450/847] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:51:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:51:55.221071 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-ec42e37d-8a51-4373-b7a7-09ee622bfcb3 req-92a87ef7-f9c5-4585-8c4a-4fa887f1e3d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65381d5e-1265-418b-ac70-4ef749d9af14", "name": "network-vif-deleted", "tag": "2082100f-222c-49e5-af14-7af046476c87"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:51:55.223779 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-0e0b1bbd-dde6-45f7-be32-4c02e6bf4fe2 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91cf84a287b74618ae1b3368785b0b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902e239d67664098895ab24340b0b780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:51:55.232920 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-ec42e37d-8a51-4373-b7a7-09ee622bfcb3 req-92a87ef7-f9c5-4585-8c4a-4fa887f1e3d2 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:55.233545 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-ec42e37d-8a51-4373-b7a7-09ee622bfcb3 req-92a87ef7-f9c5-4585-8c4a-4fa887f1e3d2 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:55.233652 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-0e0b1bbd-dde6-45f7-be32-4c02e6bf4fe2 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] 10.222.0.18 "GET /compute/v2.1/servers/7a4f8d67-fade-412f-9554-78f39414132f" status: 200 len: 1316 microversion: 2.1 time: 0.185258 Oct 22 20:51:55.234404 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-ec42e37d-8a51-4373-b7a7-09ee622bfcb3 req-92a87ef7-f9c5-4585-8c4a-4fa887f1e3d2 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:55.234541 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 398/848] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:51:55 2022] GET /compute/v2.1/servers/7a4f8d67-fade-412f-9554-78f39414132f => generated 1316 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:51:55.246564 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-ec42e37d-8a51-4373-b7a7-09ee622bfcb3 req-92a87ef7-f9c5-4585-8c4a-4fa887f1e3d2 service nova] Creating event network-vif-deleted:2082100f-222c-49e5-af14-7af046476c87 for instance 65381d5e-1265-418b-ac70-4ef749d9af14 on nch2-master-1 Oct 22 20:51:55.252389 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-ec42e37d-8a51-4373-b7a7-09ee622bfcb3 req-92a87ef7-f9c5-4585-8c4a-4fa887f1e3d2 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037226 Oct 22 20:51:55.253111 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 451/849] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:51:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 20:51:55.627263 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-95b8352b-f7ca-49cc-b22b-811fcc40cac8 tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:51:55.628338 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-95b8352b-f7ca-49cc-b22b-811fcc40cac8 tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] [instance: 65381d5e-1265-418b-ac70-4ef749d9af14] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:51:55.643160 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-95b8352b-f7ca-49cc-b22b-811fcc40cac8 tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:55.644057 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-95b8352b-f7ca-49cc-b22b-811fcc40cac8 tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:55.647038 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-95b8352b-f7ca-49cc-b22b-811fcc40cac8 tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:55.648308 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-95b8352b-f7ca-49cc-b22b-811fcc40cac8 tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:55.653573 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-95b8352b-f7ca-49cc-b22b-811fcc40cac8 tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:55.656895 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-95b8352b-f7ca-49cc-b22b-811fcc40cac8 tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:55.816585 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-95b8352b-f7ca-49cc-b22b-811fcc40cac8 tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b892876156f34b0d99a6c853d0cd4905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b403b83cad4babab211dafade27bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:51:55.830188 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-95b8352b-f7ca-49cc-b22b-811fcc40cac8 tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] 10.222.0.18 "GET /compute/v2.1/servers/65381d5e-1265-418b-ac70-4ef749d9af14" status: 200 len: 1327 microversion: 2.1 time: 0.208443 Oct 22 20:51:55.833364 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 399/850] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:51:55 2022] GET /compute/v2.1/servers/65381d5e-1265-418b-ac70-4ef749d9af14 => generated 1327 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:51:56.033313 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-55e0d7cb-3318-449d-84c5-a4f053a7b2bb tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:51:56.034094 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-55e0d7cb-3318-449d-84c5-a4f053a7b2bb tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] [instance: bd166847-1e05-4e06-86b1-1f3773eb57f1] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:51:56.043021 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-55e0d7cb-3318-449d-84c5-a4f053a7b2bb tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:56.043754 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-55e0d7cb-3318-449d-84c5-a4f053a7b2bb tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:56.044999 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-55e0d7cb-3318-449d-84c5-a4f053a7b2bb tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:56.045419 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-55e0d7cb-3318-449d-84c5-a4f053a7b2bb tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:56.046114 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-55e0d7cb-3318-449d-84c5-a4f053a7b2bb tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:56.046723 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-55e0d7cb-3318-449d-84c5-a4f053a7b2bb tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:56.046847 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-94f9086a-ea17-44e9-92a9-50faa29b31e2 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:51:56.057192 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-94f9086a-ea17-44e9-92a9-50faa29b31e2 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] [instance: 2f02a0ad-4856-4643-9e69-50547f5c7a98] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:51:56.087817 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-94f9086a-ea17-44e9-92a9-50faa29b31e2 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:56.088608 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-94f9086a-ea17-44e9-92a9-50faa29b31e2 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:56.089475 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-94f9086a-ea17-44e9-92a9-50faa29b31e2 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:56.090391 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-94f9086a-ea17-44e9-92a9-50faa29b31e2 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:56.091108 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-94f9086a-ea17-44e9-92a9-50faa29b31e2 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:56.092611 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-94f9086a-ea17-44e9-92a9-50faa29b31e2 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:56.378758 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-55e0d7cb-3318-449d-84c5-a4f053a7b2bb tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084d99ccb7dc405f85b1d31cfd255e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '950a163a28d64f41855e56cf88e3b1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:51:56.387817 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-55e0d7cb-3318-449d-84c5-a4f053a7b2bb tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] 10.222.0.18 "GET /compute/v2.1/servers/bd166847-1e05-4e06-86b1-1f3773eb57f1" status: 200 len: 1322 microversion: 2.1 time: 0.359066 Oct 22 20:51:56.389423 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-94f9086a-ea17-44e9-92a9-50faa29b31e2 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c87f0356ca346f39c6216393d85da2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee8c8f7fc4e12bc1f9fcce3e7b581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:51:56.404156 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 452/851] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:51:56 2022] GET /compute/v2.1/servers/bd166847-1e05-4e06-86b1-1f3773eb57f1 => generated 1322 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:51:56.411852 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-1590189a-ced4-46fe-81dd-97eb1ff84cc4 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:51:56.412441 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-1590189a-ced4-46fe-81dd-97eb1ff84cc4 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] [instance: 7a4f8d67-fade-412f-9554-78f39414132f] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:51:56.414538 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-94f9086a-ea17-44e9-92a9-50faa29b31e2 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] 10.222.0.18 "GET /compute/v2.1/servers/2f02a0ad-4856-4643-9e69-50547f5c7a98" status: 200 len: 1503 microversion: 2.1 time: 0.375665 Oct 22 20:51:56.427432 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 400/852] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:51:56 2022] GET /compute/v2.1/servers/2f02a0ad-4856-4643-9e69-50547f5c7a98 => generated 1503 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 20:51:56.428086 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1590189a-ced4-46fe-81dd-97eb1ff84cc4 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:56.429650 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1590189a-ced4-46fe-81dd-97eb1ff84cc4 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:56.434580 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1590189a-ced4-46fe-81dd-97eb1ff84cc4 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:56.435595 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1590189a-ced4-46fe-81dd-97eb1ff84cc4 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:56.437380 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1590189a-ced4-46fe-81dd-97eb1ff84cc4 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:56.438675 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1590189a-ced4-46fe-81dd-97eb1ff84cc4 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:56.614629 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-1590189a-ced4-46fe-81dd-97eb1ff84cc4 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91cf84a287b74618ae1b3368785b0b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902e239d67664098895ab24340b0b780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:51:56.627280 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-1590189a-ced4-46fe-81dd-97eb1ff84cc4 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] 10.222.0.18 "GET /compute/v2.1/servers/7a4f8d67-fade-412f-9554-78f39414132f" status: 200 len: 1316 microversion: 2.1 time: 0.221702 Oct 22 20:51:56.628922 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 453/853] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:51:56 2022] GET /compute/v2.1/servers/7a4f8d67-fade-412f-9554-78f39414132f => generated 1316 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:51:56.872886 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-47293ddb-3f29-4de9-ba40-62d3bbe5a973 tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:51:56.874007 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-47293ddb-3f29-4de9-ba40-62d3bbe5a973 tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] [instance: 65381d5e-1265-418b-ac70-4ef749d9af14] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:51:56.896851 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-47293ddb-3f29-4de9-ba40-62d3bbe5a973 tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:56.897350 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-47293ddb-3f29-4de9-ba40-62d3bbe5a973 tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:56.899686 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-47293ddb-3f29-4de9-ba40-62d3bbe5a973 tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:56.901869 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-47293ddb-3f29-4de9-ba40-62d3bbe5a973 tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:56.904162 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-47293ddb-3f29-4de9-ba40-62d3bbe5a973 tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:56.906035 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-47293ddb-3f29-4de9-ba40-62d3bbe5a973 tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:56.947890 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-47293ddb-3f29-4de9-ba40-62d3bbe5a973 tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] HTTP exception thrown: Instance 65381d5e-1265-418b-ac70-4ef749d9af14 could not be found. Oct 22 20:51:56.951847 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-47293ddb-3f29-4de9-ba40-62d3bbe5a973 tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] Request method failure captured: Oct 22 20:51:56.951847 ncdv-master-1 devstack@n-api.service[138744]: request: GET /compute/v2.1/servers/65381d5e-1265-418b-ac70-4ef749d9af14 HTTP/1.1 Oct 22 20:51:56.951847 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 20:51:56.951847 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 20:51:56.951847 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 20:51:56.951847 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 0 Oct 22 20:51:56.951847 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 20:51:56.951847 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 20:51:56.951847 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 20:51:56.951847 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 20:51:56.951847 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVFdMJPpNOtE6TLHSkjrac_OO1GrYWPJd43LZJQDTHIhnrzCVEpLBS2rhvVa1d_IC66un2UlSwva7oTKkGkzjZim8z2hGClwyD8x6Yx21dq04LjKm2vtj0Ee7n-QjkNmtFet66TJpuMMZ9w1oZW59TVjrh9zWNcbwbIadJu6PQDvqlsQ Oct 22 20:51:56.951847 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 20:51:56.951847 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 20:51:56.951847 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 20:51:56.951847 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 20:51:56.951847 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 20:51:56.951847 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 20:51:56.951847 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: a7b403b83cad4babab211dafade27bde Oct 22 20:51:56.951847 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-2143007201 Oct 22 20:51:56.951847 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 20:51:56.951847 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 20:51:56.951847 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_a7b403b83cad4babab211dafade27bde"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a7b403b83cad4babab211dafade27bde"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/a7b403b83cad4babab211dafade27bde"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a7b403b83cad4babab211dafade27bde"}]}] Oct 22 20:51:56.951847 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-2143007201 Oct 22 20:51:56.951847 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: a7b403b83cad4babab211dafade27bde Oct 22 20:51:56.951847 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-2143007201 Oct 22 20:51:56.951847 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-AttachSCSIVolumeTestJSON-2143007201-project Oct 22 20:51:56.951847 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 20:51:56.951847 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 20:51:56.951847 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: b892876156f34b0d99a6c853d0cd4905 Oct 22 20:51:56.951847 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-2143007201-project Oct 22 20:51:56.951847 ncdv-master-1 devstack@n-api.service[138744]: method: > Oct 22 20:51:56.951847 ncdv-master-1 devstack@n-api.service[138744]: exception: Instance 65381d5e-1265-418b-ac70-4ef749d9af14 could not be found. Oct 22 20:51:56.951847 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': '65381d5e-1265-418b-ac70-4ef749d9af14'} Oct 22 20:51:56.951847 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:51:56.951847 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:51:56.951847 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 20:51:56.951847 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 20:51:56.951847 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 20:51:56.951847 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 20:51:56.951847 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 20:51:56.951847 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 20:51:56.951847 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 20:51:56.951847 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 20:51:56.951847 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 65381d5e-1265-418b-ac70-4ef749d9af14 could not be found. Oct 22 20:51:56.951847 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:51:56.951847 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:51:56.951847 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:51:56.951847 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:51:56.951847 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:51:56.951847 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:51:56.951847 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:51:56.951847 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:51:56.951847 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:51:56.951847 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:51:56.951847 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 20:51:56.951847 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 20:51:56.951847 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 20:51:56.951847 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 20:51:56.951847 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 20:51:56.951847 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 20:51:56.951847 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 65381d5e-1265-418b-ac70-4ef749d9af14 could not be found. Oct 22 20:51:56.951847 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:51:56.951847 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:51:56.951847 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:51:56.957166 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:51:56.957166 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:51:56.957166 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:51:56.957166 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 20:51:56.957166 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 20:51:56.957166 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 65381d5e-1265-418b-ac70-4ef749d9af14 could not be found. Oct 22 20:51:56.957166 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:51:56.960249 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-47293ddb-3f29-4de9-ba40-62d3bbe5a973 tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] Returning 404 to user: Instance 65381d5e-1265-418b-ac70-4ef749d9af14 could not be found. {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:51:56.962697 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-47293ddb-3f29-4de9-ba40-62d3bbe5a973 tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] 10.222.0.18 "GET /compute/v2.1/servers/65381d5e-1265-418b-ac70-4ef749d9af14" status: 404 len: 111 microversion: 2.1 time: 0.102817 Oct 22 20:51:56.964404 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 401/854] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:51:56 2022] GET /compute/v2.1/servers/65381d5e-1265-418b-ac70-4ef749d9af14 => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 20:51:56.985332 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-dd9d115f-38a2-40e2-9ad3-61e236e945ee tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] Calling method '.version_select at 0x7fd3a4300e50>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:51:57.025113 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-dd9d115f-38a2-40e2-9ad3-61e236e945ee tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1140613902" status: 202 len: 0 microversion: 2.1 time: 0.052682 Oct 22 20:51:57.026366 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 454/855] 10.222.0.18 () {58 vars in 1221 bytes} [Sat Oct 22 20:51:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1140613902 => generated 0 bytes in 58 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 22 20:51:57.418650 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-546e0756-7ae9-467b-bd6f-26d4f0d43527 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:51:57.419842 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-546e0756-7ae9-467b-bd6f-26d4f0d43527 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] [instance: bd166847-1e05-4e06-86b1-1f3773eb57f1] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:51:57.427480 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-546e0756-7ae9-467b-bd6f-26d4f0d43527 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:57.429439 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-546e0756-7ae9-467b-bd6f-26d4f0d43527 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:57.430201 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-546e0756-7ae9-467b-bd6f-26d4f0d43527 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:57.431492 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-546e0756-7ae9-467b-bd6f-26d4f0d43527 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:57.432232 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-546e0756-7ae9-467b-bd6f-26d4f0d43527 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:57.432877 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-546e0756-7ae9-467b-bd6f-26d4f0d43527 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:57.445277 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-19b6064e-1f08-4a59-a021-c1d3f6a0db8d tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:51:57.446046 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-19b6064e-1f08-4a59-a021-c1d3f6a0db8d tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] [instance: 2f02a0ad-4856-4643-9e69-50547f5c7a98] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:51:57.459817 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-19b6064e-1f08-4a59-a021-c1d3f6a0db8d tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:57.460306 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-19b6064e-1f08-4a59-a021-c1d3f6a0db8d tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:57.460905 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-19b6064e-1f08-4a59-a021-c1d3f6a0db8d tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:57.463594 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-19b6064e-1f08-4a59-a021-c1d3f6a0db8d tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:57.464074 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-19b6064e-1f08-4a59-a021-c1d3f6a0db8d tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:57.464518 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-19b6064e-1f08-4a59-a021-c1d3f6a0db8d tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:57.761199 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-19b6064e-1f08-4a59-a021-c1d3f6a0db8d tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c87f0356ca346f39c6216393d85da2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee8c8f7fc4e12bc1f9fcce3e7b581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:51:57.771243 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-19b6064e-1f08-4a59-a021-c1d3f6a0db8d tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] 10.222.0.18 "GET /compute/v2.1/servers/2f02a0ad-4856-4643-9e69-50547f5c7a98" status: 200 len: 1503 microversion: 2.1 time: 0.331055 Oct 22 20:51:57.772141 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 455/856] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:51:57 2022] GET /compute/v2.1/servers/2f02a0ad-4856-4643-9e69-50547f5c7a98 => generated 1503 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 20:51:57.778163 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-69f63696-b09a-439d-86eb-261892a4f4de tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:51:57.778724 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-69f63696-b09a-439d-86eb-261892a4f4de tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] [instance: 7a4f8d67-fade-412f-9554-78f39414132f] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:51:57.788859 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-546e0756-7ae9-467b-bd6f-26d4f0d43527 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084d99ccb7dc405f85b1d31cfd255e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '950a163a28d64f41855e56cf88e3b1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:51:57.798017 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-69f63696-b09a-439d-86eb-261892a4f4de tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:57.798520 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-69f63696-b09a-439d-86eb-261892a4f4de tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:57.799110 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-69f63696-b09a-439d-86eb-261892a4f4de tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:57.799887 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-69f63696-b09a-439d-86eb-261892a4f4de tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:57.800423 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-69f63696-b09a-439d-86eb-261892a4f4de tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:57.800863 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-69f63696-b09a-439d-86eb-261892a4f4de tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:57.805434 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-546e0756-7ae9-467b-bd6f-26d4f0d43527 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] 10.222.0.18 "GET /compute/v2.1/servers/bd166847-1e05-4e06-86b1-1f3773eb57f1" status: 200 len: 1322 microversion: 2.1 time: 0.391023 Oct 22 20:51:57.806352 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 402/857] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:51:57 2022] GET /compute/v2.1/servers/bd166847-1e05-4e06-86b1-1f3773eb57f1 => generated 1322 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:51:57.832567 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-b14617fe-d3b7-444a-a9a2-93b4244f300c req-1953e6b8-439a-452d-a193-2767821cef11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f02a0ad-4856-4643-9e69-50547f5c7a98", "name": "network-vif-unplugged", "status": "completed", "tag": "eb2b7a79-4890-4efa-990a-815f0293cc40"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:51:57.858897 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:51:57.862722 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-b14617fe-d3b7-444a-a9a2-93b4244f300c req-1953e6b8-439a-452d-a193-2767821cef11 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:57.865385 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-b14617fe-d3b7-444a-a9a2-93b4244f300c req-1953e6b8-439a-452d-a193-2767821cef11 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:57.866017 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-b14617fe-d3b7-444a-a9a2-93b4244f300c req-1953e6b8-439a-452d-a193-2767821cef11 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:57.894999 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-b14617fe-d3b7-444a-a9a2-93b4244f300c req-1953e6b8-439a-452d-a193-2767821cef11 service nova] Creating event network-vif-unplugged:eb2b7a79-4890-4efa-990a-815f0293cc40 for instance 2f02a0ad-4856-4643-9e69-50547f5c7a98 on nch2-master-1 Oct 22 20:51:57.909017 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-b14617fe-d3b7-444a-a9a2-93b4244f300c req-1953e6b8-439a-452d-a193-2767821cef11 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.101224 Oct 22 20:51:57.909632 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 403/858] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:51:57 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:51:58.075970 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-69f63696-b09a-439d-86eb-261892a4f4de tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91cf84a287b74618ae1b3368785b0b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902e239d67664098895ab24340b0b780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:51:58.092874 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-69f63696-b09a-439d-86eb-261892a4f4de tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] 10.222.0.18 "GET /compute/v2.1/servers/7a4f8d67-fade-412f-9554-78f39414132f" status: 200 len: 1316 microversion: 2.1 time: 0.318746 Oct 22 20:51:58.093265 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 456/859] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:51:57 2022] GET /compute/v2.1/servers/7a4f8d67-fade-412f-9554-78f39414132f => generated 1316 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:51:58.800532 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-f9957fc4-cb55-4ab0-a6bf-52dbc0dbcc61 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:51:58.801236 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-f9957fc4-cb55-4ab0-a6bf-52dbc0dbcc61 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] [instance: 2f02a0ad-4856-4643-9e69-50547f5c7a98] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:51:58.809011 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f9957fc4-cb55-4ab0-a6bf-52dbc0dbcc61 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:58.809499 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f9957fc4-cb55-4ab0-a6bf-52dbc0dbcc61 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:58.810914 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f9957fc4-cb55-4ab0-a6bf-52dbc0dbcc61 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:58.810914 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f9957fc4-cb55-4ab0-a6bf-52dbc0dbcc61 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:58.811130 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f9957fc4-cb55-4ab0-a6bf-52dbc0dbcc61 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:58.811567 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f9957fc4-cb55-4ab0-a6bf-52dbc0dbcc61 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:58.830067 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-d23f4d0f-b3cb-488c-9bfa-ff66b2facee5 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:51:58.831297 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-d23f4d0f-b3cb-488c-9bfa-ff66b2facee5 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] [instance: bd166847-1e05-4e06-86b1-1f3773eb57f1] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:51:58.839096 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d23f4d0f-b3cb-488c-9bfa-ff66b2facee5 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:58.839855 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d23f4d0f-b3cb-488c-9bfa-ff66b2facee5 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:58.840701 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d23f4d0f-b3cb-488c-9bfa-ff66b2facee5 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:58.841583 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d23f4d0f-b3cb-488c-9bfa-ff66b2facee5 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:58.842192 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d23f4d0f-b3cb-488c-9bfa-ff66b2facee5 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:58.842779 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d23f4d0f-b3cb-488c-9bfa-ff66b2facee5 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:59.042957 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-f9957fc4-cb55-4ab0-a6bf-52dbc0dbcc61 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c87f0356ca346f39c6216393d85da2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee8c8f7fc4e12bc1f9fcce3e7b581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:51:59.053227 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-d23f4d0f-b3cb-488c-9bfa-ff66b2facee5 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084d99ccb7dc405f85b1d31cfd255e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '950a163a28d64f41855e56cf88e3b1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:51:59.061298 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-f9957fc4-cb55-4ab0-a6bf-52dbc0dbcc61 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] 10.222.0.18 "GET /compute/v2.1/servers/2f02a0ad-4856-4643-9e69-50547f5c7a98" status: 200 len: 1503 microversion: 2.1 time: 0.266943 Oct 22 20:51:59.064455 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 404/860] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:51:58 2022] GET /compute/v2.1/servers/2f02a0ad-4856-4643-9e69-50547f5c7a98 => generated 1503 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:51:59.071060 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-04c75c6f-1530-4c48-aab4-07c7961df64c req-b50e478d-0aac-4d69-b048-682902ffefec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a4f8d67-fade-412f-9554-78f39414132f", "name": "network-vif-plugged", "status": "completed", "tag": "a282ab7b-0cb4-4ab4-a8a5-cae0fe603953"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:51:59.087217 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-d23f4d0f-b3cb-488c-9bfa-ff66b2facee5 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] 10.222.0.18 "GET /compute/v2.1/servers/bd166847-1e05-4e06-86b1-1f3773eb57f1" status: 200 len: 1472 microversion: 2.1 time: 0.261375 Oct 22 20:51:59.088146 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 457/861] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:51:58 2022] GET /compute/v2.1/servers/bd166847-1e05-4e06-86b1-1f3773eb57f1 => generated 1472 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:51:59.113591 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-04c75c6f-1530-4c48-aab4-07c7961df64c req-b50e478d-0aac-4d69-b048-682902ffefec service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:59.114264 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-04c75c6f-1530-4c48-aab4-07c7961df64c req-b50e478d-0aac-4d69-b048-682902ffefec service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:59.114861 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-04c75c6f-1530-4c48-aab4-07c7961df64c req-b50e478d-0aac-4d69-b048-682902ffefec service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:59.117624 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-ea02253e-a5f5-4bfa-8fb0-6a1952eaa40e tempest-ServersAdminNegativeTestJSON-1741816574 tempest-ServersAdminNegativeTestJSON-1741816574-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:51:59.118346 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-ea02253e-a5f5-4bfa-8fb0-6a1952eaa40e tempest-ServersAdminNegativeTestJSON-1741816574 tempest-ServersAdminNegativeTestJSON-1741816574-project-admin] [instance: bd166847-1e05-4e06-86b1-1f3773eb57f1] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:51:59.126998 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ea02253e-a5f5-4bfa-8fb0-6a1952eaa40e tempest-ServersAdminNegativeTestJSON-1741816574 tempest-ServersAdminNegativeTestJSON-1741816574-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:59.128115 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ea02253e-a5f5-4bfa-8fb0-6a1952eaa40e tempest-ServersAdminNegativeTestJSON-1741816574 tempest-ServersAdminNegativeTestJSON-1741816574-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:59.128897 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ea02253e-a5f5-4bfa-8fb0-6a1952eaa40e tempest-ServersAdminNegativeTestJSON-1741816574 tempest-ServersAdminNegativeTestJSON-1741816574-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:59.129910 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ea02253e-a5f5-4bfa-8fb0-6a1952eaa40e tempest-ServersAdminNegativeTestJSON-1741816574 tempest-ServersAdminNegativeTestJSON-1741816574-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:59.130727 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ea02253e-a5f5-4bfa-8fb0-6a1952eaa40e tempest-ServersAdminNegativeTestJSON-1741816574 tempest-ServersAdminNegativeTestJSON-1741816574-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:59.131582 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ea02253e-a5f5-4bfa-8fb0-6a1952eaa40e tempest-ServersAdminNegativeTestJSON-1741816574 tempest-ServersAdminNegativeTestJSON-1741816574-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:59.136281 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-04c75c6f-1530-4c48-aab4-07c7961df64c req-b50e478d-0aac-4d69-b048-682902ffefec service nova] Creating event network-vif-plugged:a282ab7b-0cb4-4ab4-a8a5-cae0fe603953 for instance 7a4f8d67-fade-412f-9554-78f39414132f on nch2-master-1 Oct 22 20:51:59.147613 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-04c75c6f-1530-4c48-aab4-07c7961df64c req-b50e478d-0aac-4d69-b048-682902ffefec service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081134 Oct 22 20:51:59.148565 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 405/862] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:51:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:51:59.160518 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-d489de07-661a-4125-9c63-8c0d0e9cef8d tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:51:59.162178 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-d489de07-661a-4125-9c63-8c0d0e9cef8d tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] [instance: 7a4f8d67-fade-412f-9554-78f39414132f] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:51:59.171020 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d489de07-661a-4125-9c63-8c0d0e9cef8d tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:59.171569 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d489de07-661a-4125-9c63-8c0d0e9cef8d tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:59.172009 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d489de07-661a-4125-9c63-8c0d0e9cef8d tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:59.177884 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d489de07-661a-4125-9c63-8c0d0e9cef8d tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:59.178429 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d489de07-661a-4125-9c63-8c0d0e9cef8d tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:59.178947 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d489de07-661a-4125-9c63-8c0d0e9cef8d tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:59.199549 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.objects.instance [None req-ea02253e-a5f5-4bfa-8fb0-6a1952eaa40e tempest-ServersAdminNegativeTestJSON-1741816574 tempest-ServersAdminNegativeTestJSON-1741816574-project-admin] Lazy-loading 'flavor' on Instance uuid bd166847-1e05-4e06-86b1-1f3773eb57f1 {{(pid=138745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 20:51:59.229317 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:51:59.335629 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-ea02253e-a5f5-4bfa-8fb0-6a1952eaa40e tempest-ServersAdminNegativeTestJSON-1741816574 tempest-ServersAdminNegativeTestJSON-1741816574-project-admin] 10.222.0.18 "POST /compute/v2.1/servers/bd166847-1e05-4e06-86b1-1f3773eb57f1/action" status: 202 len: 0 microversion: 2.1 time: 0.224977 Oct 22 20:51:59.337200 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 458/863] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 20:51:59 2022] POST /compute/v2.1/servers/bd166847-1e05-4e06-86b1-1f3773eb57f1/action => generated 0 bytes in 228 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 20:51:59.345738 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-0886c696-1112-4b91-82ed-18d9fa0a69e8 tempest-ServersAdminNegativeTestJSON-1741816574 tempest-ServersAdminNegativeTestJSON-1741816574-project-admin] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:51:59.346732 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-0886c696-1112-4b91-82ed-18d9fa0a69e8 tempest-ServersAdminNegativeTestJSON-1741816574 tempest-ServersAdminNegativeTestJSON-1741816574-project-admin] [instance: bd166847-1e05-4e06-86b1-1f3773eb57f1] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:51:59.354483 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0886c696-1112-4b91-82ed-18d9fa0a69e8 tempest-ServersAdminNegativeTestJSON-1741816574 tempest-ServersAdminNegativeTestJSON-1741816574-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:59.355573 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0886c696-1112-4b91-82ed-18d9fa0a69e8 tempest-ServersAdminNegativeTestJSON-1741816574 tempest-ServersAdminNegativeTestJSON-1741816574-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:59.356207 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0886c696-1112-4b91-82ed-18d9fa0a69e8 tempest-ServersAdminNegativeTestJSON-1741816574 tempest-ServersAdminNegativeTestJSON-1741816574-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:59.357312 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0886c696-1112-4b91-82ed-18d9fa0a69e8 tempest-ServersAdminNegativeTestJSON-1741816574 tempest-ServersAdminNegativeTestJSON-1741816574-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:59.357922 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0886c696-1112-4b91-82ed-18d9fa0a69e8 tempest-ServersAdminNegativeTestJSON-1741816574 tempest-ServersAdminNegativeTestJSON-1741816574-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:59.358498 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0886c696-1112-4b91-82ed-18d9fa0a69e8 tempest-ServersAdminNegativeTestJSON-1741816574 tempest-ServersAdminNegativeTestJSON-1741816574-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:59.405578 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-d489de07-661a-4125-9c63-8c0d0e9cef8d tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91cf84a287b74618ae1b3368785b0b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902e239d67664098895ab24340b0b780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:51:59.415758 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-d489de07-661a-4125-9c63-8c0d0e9cef8d tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] 10.222.0.18 "GET /compute/v2.1/servers/7a4f8d67-fade-412f-9554-78f39414132f" status: 200 len: 1316 microversion: 2.1 time: 0.265728 Oct 22 20:51:59.425811 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 406/864] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:51:59 2022] GET /compute/v2.1/servers/7a4f8d67-fade-412f-9554-78f39414132f => generated 1316 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:51:59.639004 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-0886c696-1112-4b91-82ed-18d9fa0a69e8 tempest-ServersAdminNegativeTestJSON-1741816574 tempest-ServersAdminNegativeTestJSON-1741816574-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/bd166847-1e05-4e06-86b1-1f3773eb57f1" status: 200 len: 1631 microversion: 2.1 time: 0.298442 Oct 22 20:51:59.639639 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 459/865] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:51:59 2022] GET /compute/v2.1/servers/bd166847-1e05-4e06-86b1-1f3773eb57f1 => generated 1631 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 20:51:59.938471 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-b15a9bc7-aa53-478e-8285-65febd9478bf req-abfa220e-158a-4945-a079-cb7092d853c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f02a0ad-4856-4643-9e69-50547f5c7a98", "tag": "eb2b7a79-4890-4efa-990a-815f0293cc40"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:51:59.950338 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-b15a9bc7-aa53-478e-8285-65febd9478bf req-abfa220e-158a-4945-a079-cb7092d853c3 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:51:59.951044 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-b15a9bc7-aa53-478e-8285-65febd9478bf req-abfa220e-158a-4945-a079-cb7092d853c3 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:51:59.951585 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-b15a9bc7-aa53-478e-8285-65febd9478bf req-abfa220e-158a-4945-a079-cb7092d853c3 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:51:59.964758 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-b15a9bc7-aa53-478e-8285-65febd9478bf req-abfa220e-158a-4945-a079-cb7092d853c3 service nova] Creating event network-changed:eb2b7a79-4890-4efa-990a-815f0293cc40 for instance 2f02a0ad-4856-4643-9e69-50547f5c7a98 on nch2-master-1 Oct 22 20:51:59.971756 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-b15a9bc7-aa53-478e-8285-65febd9478bf req-abfa220e-158a-4945-a079-cb7092d853c3 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038320 Oct 22 20:51:59.972534 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 407/866] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:51:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:52:00.090946 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-8b805241-0006-4b8a-b759-78ff09b060a3 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:52:00.091757 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-8b805241-0006-4b8a-b759-78ff09b060a3 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] [instance: 2f02a0ad-4856-4643-9e69-50547f5c7a98] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:52:00.099686 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8b805241-0006-4b8a-b759-78ff09b060a3 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:00.100247 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8b805241-0006-4b8a-b759-78ff09b060a3 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:00.100759 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8b805241-0006-4b8a-b759-78ff09b060a3 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:00.102187 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8b805241-0006-4b8a-b759-78ff09b060a3 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:00.102686 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8b805241-0006-4b8a-b759-78ff09b060a3 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:00.103126 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8b805241-0006-4b8a-b759-78ff09b060a3 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:00.149737 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-9808c407-6c57-4870-8766-cbfd9b408500 tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:52:00.150620 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-9808c407-6c57-4870-8766-cbfd9b408500 tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] [instance: 65381d5e-1265-418b-ac70-4ef749d9af14] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:52:00.158373 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9808c407-6c57-4870-8766-cbfd9b408500 tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:00.158984 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9808c407-6c57-4870-8766-cbfd9b408500 tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:00.159450 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9808c407-6c57-4870-8766-cbfd9b408500 tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:00.160184 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9808c407-6c57-4870-8766-cbfd9b408500 tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:00.160629 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9808c407-6c57-4870-8766-cbfd9b408500 tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:00.161085 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9808c407-6c57-4870-8766-cbfd9b408500 tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:00.179046 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-9808c407-6c57-4870-8766-cbfd9b408500 tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] HTTP exception thrown: Instance 65381d5e-1265-418b-ac70-4ef749d9af14 could not be found. Oct 22 20:52:00.181380 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-9808c407-6c57-4870-8766-cbfd9b408500 tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] Request method failure captured: Oct 22 20:52:00.181380 ncdv-master-1 devstack@n-api.service[138744]: request: DELETE /compute/v2.1/servers/65381d5e-1265-418b-ac70-4ef749d9af14 HTTP/1.1 Oct 22 20:52:00.181380 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 20:52:00.181380 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 20:52:00.181380 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 20:52:00.181380 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 0 Oct 22 20:52:00.181380 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 20:52:00.181380 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 20:52:00.181380 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 20:52:00.181380 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 20:52:00.181380 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVFdMJPpNOtE6TLHSkjrac_OO1GrYWPJd43LZJQDTHIhnrzCVEpLBS2rhvVa1d_IC66un2UlSwva7oTKkGkzjZim8z2hGClwyD8x6Yx21dq04LjKm2vtj0Ee7n-QjkNmtFet66TJpuMMZ9w1oZW59TVjrh9zWNcbwbIadJu6PQDvqlsQ Oct 22 20:52:00.181380 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 20:52:00.181380 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 20:52:00.181380 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 20:52:00.181380 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 20:52:00.181380 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 20:52:00.181380 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 20:52:00.181380 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: a7b403b83cad4babab211dafade27bde Oct 22 20:52:00.181380 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-2143007201 Oct 22 20:52:00.181380 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 20:52:00.181380 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 20:52:00.181380 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_a7b403b83cad4babab211dafade27bde"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a7b403b83cad4babab211dafade27bde"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/a7b403b83cad4babab211dafade27bde"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a7b403b83cad4babab211dafade27bde"}]}] Oct 22 20:52:00.181380 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-2143007201 Oct 22 20:52:00.181380 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: a7b403b83cad4babab211dafade27bde Oct 22 20:52:00.181380 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-2143007201 Oct 22 20:52:00.181380 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-AttachSCSIVolumeTestJSON-2143007201-project Oct 22 20:52:00.181380 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 20:52:00.181380 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 20:52:00.181380 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: b892876156f34b0d99a6c853d0cd4905 Oct 22 20:52:00.181380 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-2143007201-project Oct 22 20:52:00.181380 ncdv-master-1 devstack@n-api.service[138744]: method: > Oct 22 20:52:00.181380 ncdv-master-1 devstack@n-api.service[138744]: exception: Instance 65381d5e-1265-418b-ac70-4ef749d9af14 could not be found. Oct 22 20:52:00.181380 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': '65381d5e-1265-418b-ac70-4ef749d9af14'} Oct 22 20:52:00.181380 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:52:00.181380 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:52:00.181380 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 20:52:00.181380 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 20:52:00.181380 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 20:52:00.181380 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 20:52:00.181380 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 20:52:00.181380 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 20:52:00.181380 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 20:52:00.181380 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 20:52:00.181380 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 65381d5e-1265-418b-ac70-4ef749d9af14 could not be found. Oct 22 20:52:00.181380 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:52:00.181380 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:52:00.181380 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:52:00.181380 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:52:00.181380 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:52:00.181380 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:52:00.181380 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:52:00.181380 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:52:00.181380 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:52:00.181380 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:52:00.181380 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 22 20:52:00.181380 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 22 20:52:00.181380 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 22 20:52:00.181380 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 22 20:52:00.181380 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 20:52:00.181380 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 20:52:00.181380 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 20:52:00.181380 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 20:52:00.190316 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 65381d5e-1265-418b-ac70-4ef749d9af14 could not be found. Oct 22 20:52:00.190316 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:52:00.190316 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:52:00.190316 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:52:00.190316 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:52:00.190316 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:52:00.190316 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:52:00.190316 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 20:52:00.190316 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 20:52:00.190316 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 65381d5e-1265-418b-ac70-4ef749d9af14 could not be found. Oct 22 20:52:00.190316 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:52:00.190316 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-9808c407-6c57-4870-8766-cbfd9b408500 tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] Returning 404 to user: Instance 65381d5e-1265-418b-ac70-4ef749d9af14 could not be found. {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:52:00.190316 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-9808c407-6c57-4870-8766-cbfd9b408500 tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] 10.222.0.18 "DELETE /compute/v2.1/servers/65381d5e-1265-418b-ac70-4ef749d9af14" status: 404 len: 111 microversion: 2.1 time: 0.038916 Oct 22 20:52:00.190316 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 408/867] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 20:52:00 2022] DELETE /compute/v2.1/servers/65381d5e-1265-418b-ac70-4ef749d9af14 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 20:52:00.193161 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-d4a3f7a2-896d-4828-9784-f72c6e6a2213 tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:52:00.193874 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-d4a3f7a2-896d-4828-9784-f72c6e6a2213 tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] [instance: 65381d5e-1265-418b-ac70-4ef749d9af14] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:52:00.200666 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d4a3f7a2-896d-4828-9784-f72c6e6a2213 tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:00.201153 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d4a3f7a2-896d-4828-9784-f72c6e6a2213 tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:00.201589 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d4a3f7a2-896d-4828-9784-f72c6e6a2213 tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:00.202284 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d4a3f7a2-896d-4828-9784-f72c6e6a2213 tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:00.202734 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d4a3f7a2-896d-4828-9784-f72c6e6a2213 tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:00.203151 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d4a3f7a2-896d-4828-9784-f72c6e6a2213 tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:00.217402 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-d4a3f7a2-896d-4828-9784-f72c6e6a2213 tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] HTTP exception thrown: Instance 65381d5e-1265-418b-ac70-4ef749d9af14 could not be found. Oct 22 20:52:00.218890 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-d4a3f7a2-896d-4828-9784-f72c6e6a2213 tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] Request method failure captured: Oct 22 20:52:00.218890 ncdv-master-1 devstack@n-api.service[138744]: request: GET /compute/v2.1/servers/65381d5e-1265-418b-ac70-4ef749d9af14 HTTP/1.1 Oct 22 20:52:00.218890 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 20:52:00.218890 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 20:52:00.218890 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 20:52:00.218890 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 0 Oct 22 20:52:00.218890 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 20:52:00.218890 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 20:52:00.218890 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 20:52:00.218890 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 20:52:00.218890 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVFdMJPpNOtE6TLHSkjrac_OO1GrYWPJd43LZJQDTHIhnrzCVEpLBS2rhvVa1d_IC66un2UlSwva7oTKkGkzjZim8z2hGClwyD8x6Yx21dq04LjKm2vtj0Ee7n-QjkNmtFet66TJpuMMZ9w1oZW59TVjrh9zWNcbwbIadJu6PQDvqlsQ Oct 22 20:52:00.218890 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 20:52:00.218890 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 20:52:00.218890 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 20:52:00.218890 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 20:52:00.218890 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 20:52:00.218890 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 20:52:00.218890 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: a7b403b83cad4babab211dafade27bde Oct 22 20:52:00.218890 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-2143007201 Oct 22 20:52:00.218890 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 20:52:00.218890 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 20:52:00.218890 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_a7b403b83cad4babab211dafade27bde"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a7b403b83cad4babab211dafade27bde"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/a7b403b83cad4babab211dafade27bde"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a7b403b83cad4babab211dafade27bde"}]}] Oct 22 20:52:00.218890 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-2143007201 Oct 22 20:52:00.218890 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: a7b403b83cad4babab211dafade27bde Oct 22 20:52:00.218890 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-2143007201 Oct 22 20:52:00.218890 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-AttachSCSIVolumeTestJSON-2143007201-project Oct 22 20:52:00.218890 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 20:52:00.218890 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 20:52:00.218890 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: b892876156f34b0d99a6c853d0cd4905 Oct 22 20:52:00.218890 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-2143007201-project Oct 22 20:52:00.218890 ncdv-master-1 devstack@n-api.service[138744]: method: > Oct 22 20:52:00.218890 ncdv-master-1 devstack@n-api.service[138744]: exception: Instance 65381d5e-1265-418b-ac70-4ef749d9af14 could not be found. Oct 22 20:52:00.218890 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': '65381d5e-1265-418b-ac70-4ef749d9af14'} Oct 22 20:52:00.218890 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:52:00.218890 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:52:00.218890 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 20:52:00.218890 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 20:52:00.218890 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 20:52:00.218890 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 20:52:00.218890 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 20:52:00.218890 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 20:52:00.218890 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 20:52:00.218890 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 20:52:00.218890 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 65381d5e-1265-418b-ac70-4ef749d9af14 could not be found. Oct 22 20:52:00.218890 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:52:00.218890 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:52:00.218890 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:52:00.218890 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:52:00.218890 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:52:00.218890 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:52:00.218890 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:52:00.218890 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:52:00.218890 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:52:00.218890 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:52:00.218890 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 20:52:00.218890 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 20:52:00.218890 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 20:52:00.218890 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 20:52:00.218890 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 20:52:00.218890 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 20:52:00.218890 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 65381d5e-1265-418b-ac70-4ef749d9af14 could not be found. Oct 22 20:52:00.218890 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:52:00.218890 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:52:00.218890 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:52:00.223390 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:52:00.223390 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:52:00.223390 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:52:00.223390 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 20:52:00.223390 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 20:52:00.223390 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 65381d5e-1265-418b-ac70-4ef749d9af14 could not be found. Oct 22 20:52:00.223390 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:52:00.223390 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-d4a3f7a2-896d-4828-9784-f72c6e6a2213 tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] Returning 404 to user: Instance 65381d5e-1265-418b-ac70-4ef749d9af14 could not be found. {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:52:00.223390 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-d4a3f7a2-896d-4828-9784-f72c6e6a2213 tempest-AttachSCSIVolumeTestJSON-2143007201 tempest-AttachSCSIVolumeTestJSON-2143007201-project] 10.222.0.18 "GET /compute/v2.1/servers/65381d5e-1265-418b-ac70-4ef749d9af14" status: 404 len: 111 microversion: 2.1 time: 0.031519 Oct 22 20:52:00.223390 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 409/868] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:52:00 2022] GET /compute/v2.1/servers/65381d5e-1265-418b-ac70-4ef749d9af14 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 20:52:00.266219 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-8b805241-0006-4b8a-b759-78ff09b060a3 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c87f0356ca346f39c6216393d85da2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee8c8f7fc4e12bc1f9fcce3e7b581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:52:00.275631 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-8b805241-0006-4b8a-b759-78ff09b060a3 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] 10.222.0.18 "GET /compute/v2.1/servers/2f02a0ad-4856-4643-9e69-50547f5c7a98" status: 200 len: 1503 microversion: 2.1 time: 0.188601 Oct 22 20:52:00.276216 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 460/869] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:52:00 2022] GET /compute/v2.1/servers/2f02a0ad-4856-4643-9e69-50547f5c7a98 => generated 1503 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:52:00.442320 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-37847c44-aaaf-4af7-b950-bed878556127 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:52:00.442931 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-37847c44-aaaf-4af7-b950-bed878556127 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] [instance: 7a4f8d67-fade-412f-9554-78f39414132f] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:52:00.449615 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-37847c44-aaaf-4af7-b950-bed878556127 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:00.450120 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-37847c44-aaaf-4af7-b950-bed878556127 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:00.450543 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-37847c44-aaaf-4af7-b950-bed878556127 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:00.451256 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-37847c44-aaaf-4af7-b950-bed878556127 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:00.451761 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-37847c44-aaaf-4af7-b950-bed878556127 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:00.452179 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-37847c44-aaaf-4af7-b950-bed878556127 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:00.605568 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-37847c44-aaaf-4af7-b950-bed878556127 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91cf84a287b74618ae1b3368785b0b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902e239d67664098895ab24340b0b780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:52:00.615736 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-37847c44-aaaf-4af7-b950-bed878556127 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] 10.222.0.18 "GET /compute/v2.1/servers/7a4f8d67-fade-412f-9554-78f39414132f" status: 200 len: 1316 microversion: 2.1 time: 0.177024 Oct 22 20:52:00.616588 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 410/870] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:52:00 2022] GET /compute/v2.1/servers/7a4f8d67-fade-412f-9554-78f39414132f => generated 1316 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:52:00.665094 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-20c938ed-23c8-4ef2-b628-4e7814134e18 tempest-ServersAdminNegativeTestJSON-1741816574 tempest-ServersAdminNegativeTestJSON-1741816574-project-admin] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:52:00.666068 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-20c938ed-23c8-4ef2-b628-4e7814134e18 tempest-ServersAdminNegativeTestJSON-1741816574 tempest-ServersAdminNegativeTestJSON-1741816574-project-admin] [instance: bd166847-1e05-4e06-86b1-1f3773eb57f1] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:52:00.672582 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-20c938ed-23c8-4ef2-b628-4e7814134e18 tempest-ServersAdminNegativeTestJSON-1741816574 tempest-ServersAdminNegativeTestJSON-1741816574-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:00.673101 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-20c938ed-23c8-4ef2-b628-4e7814134e18 tempest-ServersAdminNegativeTestJSON-1741816574 tempest-ServersAdminNegativeTestJSON-1741816574-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:00.673539 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-20c938ed-23c8-4ef2-b628-4e7814134e18 tempest-ServersAdminNegativeTestJSON-1741816574 tempest-ServersAdminNegativeTestJSON-1741816574-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:00.674441 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-20c938ed-23c8-4ef2-b628-4e7814134e18 tempest-ServersAdminNegativeTestJSON-1741816574 tempest-ServersAdminNegativeTestJSON-1741816574-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:00.674906 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-20c938ed-23c8-4ef2-b628-4e7814134e18 tempest-ServersAdminNegativeTestJSON-1741816574 tempest-ServersAdminNegativeTestJSON-1741816574-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:00.675320 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-20c938ed-23c8-4ef2-b628-4e7814134e18 tempest-ServersAdminNegativeTestJSON-1741816574 tempest-ServersAdminNegativeTestJSON-1741816574-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:00.820859 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-20c938ed-23c8-4ef2-b628-4e7814134e18 tempest-ServersAdminNegativeTestJSON-1741816574 tempest-ServersAdminNegativeTestJSON-1741816574-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/bd166847-1e05-4e06-86b1-1f3773eb57f1" status: 200 len: 1614 microversion: 2.1 time: 0.159743 Oct 22 20:52:00.821644 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 461/871] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:52:00 2022] GET /compute/v2.1/servers/bd166847-1e05-4e06-86b1-1f3773eb57f1 => generated 1614 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 20:52:00.843597 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-943d1582-b0b8-4852-943b-afe3bc778f49 tempest-ServersAdminNegativeTestJSON-1741816574 tempest-ServersAdminNegativeTestJSON-1741816574-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:52:00.844182 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-943d1582-b0b8-4852-943b-afe3bc778f49 tempest-ServersAdminNegativeTestJSON-1741816574 tempest-ServersAdminNegativeTestJSON-1741816574-project-admin] [instance: bd166847-1e05-4e06-86b1-1f3773eb57f1] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:52:00.846191 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell0:SELECT=4 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:52:00.852402 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-943d1582-b0b8-4852-943b-afe3bc778f49 tempest-ServersAdminNegativeTestJSON-1741816574 tempest-ServersAdminNegativeTestJSON-1741816574-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:00.852913 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-943d1582-b0b8-4852-943b-afe3bc778f49 tempest-ServersAdminNegativeTestJSON-1741816574 tempest-ServersAdminNegativeTestJSON-1741816574-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:00.854156 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-943d1582-b0b8-4852-943b-afe3bc778f49 tempest-ServersAdminNegativeTestJSON-1741816574 tempest-ServersAdminNegativeTestJSON-1741816574-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:00.854909 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-943d1582-b0b8-4852-943b-afe3bc778f49 tempest-ServersAdminNegativeTestJSON-1741816574 tempest-ServersAdminNegativeTestJSON-1741816574-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:00.855399 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-943d1582-b0b8-4852-943b-afe3bc778f49 tempest-ServersAdminNegativeTestJSON-1741816574 tempest-ServersAdminNegativeTestJSON-1741816574-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:00.855840 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-943d1582-b0b8-4852-943b-afe3bc778f49 tempest-ServersAdminNegativeTestJSON-1741816574 tempest-ServersAdminNegativeTestJSON-1741816574-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:00.942413 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-943d1582-b0b8-4852-943b-afe3bc778f49 tempest-ServersAdminNegativeTestJSON-1741816574 tempest-ServersAdminNegativeTestJSON-1741816574-project-admin] HTTP exception thrown: Cannot 'migrate' instance bd166847-1e05-4e06-86b1-1f3773eb57f1 while it is in vm_state suspended Oct 22 20:52:00.944318 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-943d1582-b0b8-4852-943b-afe3bc778f49 tempest-ServersAdminNegativeTestJSON-1741816574 tempest-ServersAdminNegativeTestJSON-1741816574-project-admin] Request method failure captured: Oct 22 20:52:00.944318 ncdv-master-1 devstack@n-api.service[138744]: request: POST /compute/v2.1/servers/bd166847-1e05-4e06-86b1-1f3773eb57f1/action HTTP/1.1 Oct 22 20:52:00.944318 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 20:52:00.944318 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 20:52:00.944318 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 20:52:00.944318 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 15 Oct 22 20:52:00.944318 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 20:52:00.944318 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 20:52:00.944318 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 20:52:00.944318 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 20:52:00.944318 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVFfONayD3VC8iPUF02I9JsqFkg9bcmni3e09PDhPzzw-Qv_YYx48K17893-eZ1DI7hAEu0y92ulqp3rAt7hhkseXJGmCFQUkrmzHwfNxLrWSOihy9Z9_DSp_mVErQnlwWBiJY6tpXW9jeLccTKKT6EK9IjZHpM8gAMCi0elXDLCuqMk Oct 22 20:52:00.944318 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 20:52:00.944318 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 20:52:00.944318 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 20:52:00.944318 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 20:52:00.944318 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 20:52:00.944318 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 20:52:00.944318 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: c5ce53e17c534bde8c9f215493ff3b6e Oct 22 20:52:00.944318 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1741816574 Oct 22 20:52:00.944318 ncdv-master-1 devstack@n-api.service[138744]: X-Role: admin,member,reader Oct 22 20:52:00.944318 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: admin,member,reader Oct 22 20:52:00.944318 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_c5ce53e17c534bde8c9f215493ff3b6e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c5ce53e17c534bde8c9f215493ff3b6e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/c5ce53e17c534bde8c9f215493ff3b6e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c5ce53e17c534bde8c9f215493ff3b6e"}]}] Oct 22 20:52:00.944318 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1741816574 Oct 22 20:52:00.944318 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: c5ce53e17c534bde8c9f215493ff3b6e Oct 22 20:52:00.944318 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1741816574 Oct 22 20:52:00.944318 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-ServersAdminNegativeTestJSON-1741816574-project-admin Oct 22 20:52:00.944318 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 20:52:00.944318 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 20:52:00.944318 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: c8abe86ff26d4342a73041c26e4533b5 Oct 22 20:52:00.944318 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1741816574-project-admin Oct 22 20:52:00.944318 ncdv-master-1 devstack@n-api.service[138744]: Oct 22 20:52:00.944318 ncdv-master-1 devstack@n-api.service[138744]: {"migrate": {}} Oct 22 20:52:00.944318 ncdv-master-1 devstack@n-api.service[138744]: method: > Oct 22 20:52:00.944318 ncdv-master-1 devstack@n-api.service[138744]: exception: Cannot 'migrate' instance bd166847-1e05-4e06-86b1-1f3773eb57f1 while it is in vm_state suspended Oct 22 20:52:00.944318 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': 'bd166847-1e05-4e06-86b1-1f3773eb57f1', 'body': {'migrate': {}}} Oct 22 20:52:00.944318 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:52:00.944318 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:52:00.944318 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 58, in _migrate Oct 22 20:52:00.944318 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi self.compute_api.resize(req.environ['nova.context'], instance, Oct 22 20:52:00.944318 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 22 20:52:00.944318 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 22 20:52:00.944318 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 22 20:52:00.944318 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 22 20:52:00.944318 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 22 20:52:00.944318 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 22 20:52:00.944318 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 22 20:52:00.944318 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 22 20:52:00.944318 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 22 20:52:00.944318 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 22 20:52:00.944318 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance bd166847-1e05-4e06-86b1-1f3773eb57f1 in vm_state suspended. Cannot resize while the instance is in this state. Oct 22 20:52:00.944318 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:52:00.944318 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:52:00.944318 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:52:00.944318 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:52:00.944318 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:52:00.944318 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:52:00.944318 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:52:00.944318 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:52:00.944318 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:52:00.944318 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:52:00.944318 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 20:52:00.944318 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 20:52:00.944318 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 69, in _migrate Oct 22 20:52:00.954654 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 22 20:52:00.954654 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 22 20:52:00.954654 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 22 20:52:00.954654 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'migrate' instance bd166847-1e05-4e06-86b1-1f3773eb57f1 while it is in vm_state suspended Oct 22 20:52:00.954654 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:52:00.954654 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:52:00.954654 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:52:00.954654 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:52:00.954654 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:52:00.954654 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:52:00.954654 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 20:52:00.954654 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 20:52:00.954654 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'migrate' instance bd166847-1e05-4e06-86b1-1f3773eb57f1 while it is in vm_state suspended Oct 22 20:52:00.954654 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:52:00.954654 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-943d1582-b0b8-4852-943b-afe3bc778f49 tempest-ServersAdminNegativeTestJSON-1741816574 tempest-ServersAdminNegativeTestJSON-1741816574-project-admin] Returning 409 to user: Cannot 'migrate' instance bd166847-1e05-4e06-86b1-1f3773eb57f1 while it is in vm_state suspended {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:52:00.954654 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-943d1582-b0b8-4852-943b-afe3bc778f49 tempest-ServersAdminNegativeTestJSON-1741816574 tempest-ServersAdminNegativeTestJSON-1741816574-project-admin] 10.222.0.18 "POST /compute/v2.1/servers/bd166847-1e05-4e06-86b1-1f3773eb57f1/action" status: 409 len: 148 microversion: 2.1 time: 0.106231 Oct 22 20:52:00.954654 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 411/872] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 20:52:00 2022] POST /compute/v2.1/servers/bd166847-1e05-4e06-86b1-1f3773eb57f1/action => generated 148 bytes in 108 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 22 20:52:00.963091 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-4018fccc-1c0c-459f-868b-5f7d406b43cd tempest-ServersAdminNegativeTestJSON-1741816574 tempest-ServersAdminNegativeTestJSON-1741816574-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "invalid"}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:52:00.969557 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-4018fccc-1c0c-459f-868b-5f7d406b43cd tempest-ServersAdminNegativeTestJSON-1741816574 tempest-ServersAdminNegativeTestJSON-1741816574-project-admin] Request method failure captured: Oct 22 20:52:00.969557 ncdv-master-1 devstack@n-api.service[138745]: request: POST /compute/v2.1/servers/6da11c1d-55e8-4d3f-b045-44f67f397741/action HTTP/1.1 Oct 22 20:52:00.969557 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 20:52:00.969557 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 20:52:00.969557 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 20:52:00.969557 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 39 Oct 22 20:52:00.969557 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 20:52:00.969557 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 20:52:00.969557 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 20:52:00.969557 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 20:52:00.969557 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVFfONayD3VC8iPUF02I9JsqFkg9bcmni3e09PDhPzzw-Qv_YYx48K17893-eZ1DI7hAEu0y92ulqp3rAt7hhkseXJGmCFQUkrmzHwfNxLrWSOihy9Z9_DSp_mVErQnlwWBiJY6tpXW9jeLccTKKT6EK9IjZHpM8gAMCi0elXDLCuqMk Oct 22 20:52:00.969557 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 20:52:00.969557 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 20:52:00.969557 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 20:52:00.969557 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 20:52:00.969557 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 20:52:00.969557 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 20:52:00.969557 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: c5ce53e17c534bde8c9f215493ff3b6e Oct 22 20:52:00.969557 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1741816574 Oct 22 20:52:00.969557 ncdv-master-1 devstack@n-api.service[138745]: X-Role: admin,member,reader Oct 22 20:52:00.969557 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: admin,member,reader Oct 22 20:52:00.969557 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_c5ce53e17c534bde8c9f215493ff3b6e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c5ce53e17c534bde8c9f215493ff3b6e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/c5ce53e17c534bde8c9f215493ff3b6e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c5ce53e17c534bde8c9f215493ff3b6e"}]}] Oct 22 20:52:00.969557 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1741816574 Oct 22 20:52:00.969557 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: c5ce53e17c534bde8c9f215493ff3b6e Oct 22 20:52:00.969557 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1741816574 Oct 22 20:52:00.969557 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-ServersAdminNegativeTestJSON-1741816574-project-admin Oct 22 20:52:00.969557 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 20:52:00.969557 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 20:52:00.969557 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: c8abe86ff26d4342a73041c26e4533b5 Oct 22 20:52:00.969557 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1741816574-project-admin Oct 22 20:52:00.969557 ncdv-master-1 devstack@n-api.service[138745]: Oct 22 20:52:00.969557 ncdv-master-1 devstack@n-api.service[138745]: {"os-resetState": {"state": "invalid"}} Oct 22 20:52:00.969557 ncdv-master-1 devstack@n-api.service[138745]: method: > Oct 22 20:52:00.969557 ncdv-master-1 devstack@n-api.service[138745]: exception: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Oct 22 20:52:00.969557 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'id': '6da11c1d-55e8-4d3f-b045-44f67f397741', 'body': {'os-resetState': {'state': 'invalid'}}} Oct 22 20:52:00.969557 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:52:00.969557 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:52:00.969557 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 22 20:52:00.969557 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 22 20:52:00.969557 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 22 20:52:00.969557 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise error Oct 22 20:52:00.969557 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['active', 'error'] Oct 22 20:52:00.969557 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:52:00.969557 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['os-resetState']['properties']['state']: Oct 22 20:52:00.969557 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Oct 22 20:52:00.969557 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:52:00.969557 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Oct 22 20:52:00.969557 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi 'invalid' Oct 22 20:52:00.969557 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:52:00.969557 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:52:00.969557 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:52:00.969557 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:52:00.969557 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:52:00.969557 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:52:00.969557 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:52:00.969557 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:52:00.969557 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:52:00.969557 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:52:00.969557 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 22 20:52:00.969557 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 22 20:52:00.969557 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 22 20:52:00.969557 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 22 20:52:00.969557 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 22 20:52:00.969557 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 22 20:52:00.974806 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Oct 22 20:52:00.974806 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:52:00.974806 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:52:00.974806 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:52:00.974806 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:52:00.974806 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:52:00.974806 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:52:00.974806 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 22 20:52:00.974806 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 22 20:52:00.974806 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Oct 22 20:52:00.974806 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:52:00.974806 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-4018fccc-1c0c-459f-868b-5f7d406b43cd tempest-ServersAdminNegativeTestJSON-1741816574 tempest-ServersAdminNegativeTestJSON-1741816574-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:52:00.975849 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-4018fccc-1c0c-459f-868b-5f7d406b43cd tempest-ServersAdminNegativeTestJSON-1741816574 tempest-ServersAdminNegativeTestJSON-1741816574-project-admin] 10.222.0.18 "POST /compute/v2.1/servers/6da11c1d-55e8-4d3f-b045-44f67f397741/action" status: 400 len: 144 microversion: 2.1 time: 0.018994 Oct 22 20:52:00.977923 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 462/873] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 20:52:00 2022] POST /compute/v2.1/servers/6da11c1d-55e8-4d3f-b045-44f67f397741/action => generated 144 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 22 20:52:00.989175 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-5a150368-20e3-4490-a84d-de0ccce0674b tempest-ServersAdminNegativeTestJSON-1741816574 tempest-ServersAdminNegativeTestJSON-1741816574-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": 1}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:52:00.993165 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-5a150368-20e3-4490-a84d-de0ccce0674b tempest-ServersAdminNegativeTestJSON-1741816574 tempest-ServersAdminNegativeTestJSON-1741816574-project-admin] Request method failure captured: Oct 22 20:52:00.993165 ncdv-master-1 devstack@n-api.service[138744]: request: POST /compute/v2.1/servers/6da11c1d-55e8-4d3f-b045-44f67f397741/action HTTP/1.1 Oct 22 20:52:00.993165 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 20:52:00.993165 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 20:52:00.993165 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 20:52:00.993165 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 31 Oct 22 20:52:00.993165 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 20:52:00.993165 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 20:52:00.993165 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 20:52:00.993165 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 20:52:00.993165 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVFfONayD3VC8iPUF02I9JsqFkg9bcmni3e09PDhPzzw-Qv_YYx48K17893-eZ1DI7hAEu0y92ulqp3rAt7hhkseXJGmCFQUkrmzHwfNxLrWSOihy9Z9_DSp_mVErQnlwWBiJY6tpXW9jeLccTKKT6EK9IjZHpM8gAMCi0elXDLCuqMk Oct 22 20:52:00.993165 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 20:52:00.993165 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 20:52:00.993165 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 20:52:00.993165 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 20:52:00.993165 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 20:52:00.993165 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 20:52:00.993165 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: c5ce53e17c534bde8c9f215493ff3b6e Oct 22 20:52:00.993165 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1741816574 Oct 22 20:52:00.993165 ncdv-master-1 devstack@n-api.service[138744]: X-Role: admin,member,reader Oct 22 20:52:00.993165 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: admin,member,reader Oct 22 20:52:00.993165 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_c5ce53e17c534bde8c9f215493ff3b6e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c5ce53e17c534bde8c9f215493ff3b6e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/c5ce53e17c534bde8c9f215493ff3b6e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c5ce53e17c534bde8c9f215493ff3b6e"}]}] Oct 22 20:52:00.993165 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1741816574 Oct 22 20:52:00.993165 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: c5ce53e17c534bde8c9f215493ff3b6e Oct 22 20:52:00.993165 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1741816574 Oct 22 20:52:00.993165 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-ServersAdminNegativeTestJSON-1741816574-project-admin Oct 22 20:52:00.993165 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 20:52:00.993165 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 20:52:00.993165 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: c8abe86ff26d4342a73041c26e4533b5 Oct 22 20:52:00.993165 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1741816574-project-admin Oct 22 20:52:00.993165 ncdv-master-1 devstack@n-api.service[138744]: Oct 22 20:52:00.993165 ncdv-master-1 devstack@n-api.service[138744]: {"os-resetState": {"state": 1}} Oct 22 20:52:00.993165 ncdv-master-1 devstack@n-api.service[138744]: method: > Oct 22 20:52:00.993165 ncdv-master-1 devstack@n-api.service[138744]: exception: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Oct 22 20:52:00.993165 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': '6da11c1d-55e8-4d3f-b045-44f67f397741', 'body': {'os-resetState': {'state': 1}}} Oct 22 20:52:00.993165 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:52:00.993165 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:52:00.993165 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 22 20:52:00.993165 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 22 20:52:00.993165 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 22 20:52:00.993165 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise error Oct 22 20:52:00.993165 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 1 is not of type 'string' Oct 22 20:52:00.993165 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:52:00.993165 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['os-resetState']['properties']['state']: Oct 22 20:52:00.993165 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Oct 22 20:52:00.993165 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:52:00.993165 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Oct 22 20:52:00.993165 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi 1 Oct 22 20:52:00.993165 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:52:00.993165 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:52:00.993165 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:52:00.993165 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:52:00.993165 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:52:00.993165 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:52:00.993165 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:52:00.993165 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:52:00.993165 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:52:00.993165 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:52:00.993165 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 22 20:52:00.993165 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 22 20:52:00.993165 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 22 20:52:00.993165 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 22 20:52:00.993165 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 22 20:52:00.993165 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 22 20:52:00.993165 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Oct 22 20:52:00.993165 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:52:00.998782 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:52:00.998782 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:52:00.998782 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:52:00.998782 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:52:00.998782 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:52:00.998782 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 22 20:52:00.998782 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 22 20:52:00.998782 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Oct 22 20:52:00.998782 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:52:00.998782 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-5a150368-20e3-4490-a84d-de0ccce0674b tempest-ServersAdminNegativeTestJSON-1741816574 tempest-ServersAdminNegativeTestJSON-1741816574-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:52:00.998782 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-5a150368-20e3-4490-a84d-de0ccce0674b tempest-ServersAdminNegativeTestJSON-1741816574 tempest-ServersAdminNegativeTestJSON-1741816574-project-admin] 10.222.0.18 "POST /compute/v2.1/servers/6da11c1d-55e8-4d3f-b045-44f67f397741/action" status: 400 len: 120 microversion: 2.1 time: 0.012302 Oct 22 20:52:00.998782 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 412/874] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 20:52:00 2022] POST /compute/v2.1/servers/6da11c1d-55e8-4d3f-b045-44f67f397741/action => generated 120 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 22 20:52:01.009567 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-5c2c39fc-b7fe-4cb8-9cc4-cdd49c24bfec tempest-ServersAdminNegativeTestJSON-1741816574 tempest-ServersAdminNegativeTestJSON-1741816574-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:52:01.013178 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-5c2c39fc-b7fe-4cb8-9cc4-cdd49c24bfec tempest-ServersAdminNegativeTestJSON-1741816574 tempest-ServersAdminNegativeTestJSON-1741816574-project-admin] Failed to fetch instance by id 999 {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 22 20:52:01.014188 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.wsgi [None req-5c2c39fc-b7fe-4cb8-9cc4-cdd49c24bfec tempest-ServersAdminNegativeTestJSON-1741816574 tempest-ServersAdminNegativeTestJSON-1741816574-project-admin] HTTP exception thrown: Instance 999 could not be found. Oct 22 20:52:01.021072 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-5c2c39fc-b7fe-4cb8-9cc4-cdd49c24bfec tempest-ServersAdminNegativeTestJSON-1741816574 tempest-ServersAdminNegativeTestJSON-1741816574-project-admin] Request method failure captured: Oct 22 20:52:01.021072 ncdv-master-1 devstack@n-api.service[138745]: request: POST /compute/v2.1/servers/999/action HTTP/1.1 Oct 22 20:52:01.021072 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 20:52:01.021072 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 20:52:01.021072 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 20:52:01.021072 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 37 Oct 22 20:52:01.021072 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 20:52:01.021072 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 20:52:01.021072 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 20:52:01.021072 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 20:52:01.021072 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVFfONayD3VC8iPUF02I9JsqFkg9bcmni3e09PDhPzzw-Qv_YYx48K17893-eZ1DI7hAEu0y92ulqp3rAt7hhkseXJGmCFQUkrmzHwfNxLrWSOihy9Z9_DSp_mVErQnlwWBiJY6tpXW9jeLccTKKT6EK9IjZHpM8gAMCi0elXDLCuqMk Oct 22 20:52:01.021072 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 20:52:01.021072 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 20:52:01.021072 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 20:52:01.021072 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 20:52:01.021072 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 20:52:01.021072 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 20:52:01.021072 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: c5ce53e17c534bde8c9f215493ff3b6e Oct 22 20:52:01.021072 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1741816574 Oct 22 20:52:01.021072 ncdv-master-1 devstack@n-api.service[138745]: X-Role: admin,member,reader Oct 22 20:52:01.021072 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: admin,member,reader Oct 22 20:52:01.021072 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_c5ce53e17c534bde8c9f215493ff3b6e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c5ce53e17c534bde8c9f215493ff3b6e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/c5ce53e17c534bde8c9f215493ff3b6e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c5ce53e17c534bde8c9f215493ff3b6e"}]}] Oct 22 20:52:01.021072 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1741816574 Oct 22 20:52:01.021072 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: c5ce53e17c534bde8c9f215493ff3b6e Oct 22 20:52:01.021072 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1741816574 Oct 22 20:52:01.021072 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-ServersAdminNegativeTestJSON-1741816574-project-admin Oct 22 20:52:01.021072 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 20:52:01.021072 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 20:52:01.021072 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: c8abe86ff26d4342a73041c26e4533b5 Oct 22 20:52:01.021072 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1741816574-project-admin Oct 22 20:52:01.021072 ncdv-master-1 devstack@n-api.service[138745]: Oct 22 20:52:01.021072 ncdv-master-1 devstack@n-api.service[138745]: {"os-resetState": {"state": "error"}} Oct 22 20:52:01.021072 ncdv-master-1 devstack@n-api.service[138745]: method: > Oct 22 20:52:01.021072 ncdv-master-1 devstack@n-api.service[138745]: exception: Instance 999 could not be found. Oct 22 20:52:01.021072 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'id': '999', 'body': {'os-resetState': {'state': 'error'}}} Oct 22 20:52:01.021072 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:52:01.021072 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:52:01.021072 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 20:52:01.021072 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 20:52:01.021072 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 22 20:52:01.021072 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 22 20:52:01.021072 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Oct 22 20:52:01.021072 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:52:01.021072 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:52:01.021072 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:52:01.021072 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:52:01.021072 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:52:01.021072 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:52:01.021072 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:52:01.021072 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:52:01.021072 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:52:01.021072 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:52:01.021072 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 20:52:01.021072 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 20:52:01.021072 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/admin_actions.py", line 66, in _reset_state Oct 22 20:52:01.021072 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 22 20:52:01.021072 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 20:52:01.021072 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 20:52:01.021072 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Oct 22 20:52:01.021072 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:52:01.021072 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:52:01.021072 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:52:01.021072 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:52:01.021072 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:52:01.021072 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:52:01.021072 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 20:52:01.029739 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 20:52:01.029739 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Oct 22 20:52:01.029739 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:52:01.029739 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-5c2c39fc-b7fe-4cb8-9cc4-cdd49c24bfec tempest-ServersAdminNegativeTestJSON-1741816574 tempest-ServersAdminNegativeTestJSON-1741816574-project-admin] Returning 404 to user: Instance 999 could not be found. {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:52:01.029739 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-5c2c39fc-b7fe-4cb8-9cc4-cdd49c24bfec tempest-ServersAdminNegativeTestJSON-1741816574 tempest-ServersAdminNegativeTestJSON-1741816574-project-admin] 10.222.0.18 "POST /compute/v2.1/servers/999/action" status: 404 len: 78 microversion: 2.1 time: 0.019316 Oct 22 20:52:01.029739 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 463/875] 10.222.0.18 () {60 vars in 1179 bytes} [Sat Oct 22 20:52:01 2022] POST /compute/v2.1/servers/999/action => generated 78 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 22 20:52:01.033720 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-172c3a21-aa2e-4135-be22-f4d83ec63725 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:52:01.034266 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-172c3a21-aa2e-4135-be22-f4d83ec63725 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] [instance: bd166847-1e05-4e06-86b1-1f3773eb57f1] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:52:01.042094 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-172c3a21-aa2e-4135-be22-f4d83ec63725 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:01.042764 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-172c3a21-aa2e-4135-be22-f4d83ec63725 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:01.043463 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-172c3a21-aa2e-4135-be22-f4d83ec63725 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:01.044395 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-172c3a21-aa2e-4135-be22-f4d83ec63725 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:01.044881 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-172c3a21-aa2e-4135-be22-f4d83ec63725 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:01.045375 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-172c3a21-aa2e-4135-be22-f4d83ec63725 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:01.076750 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-172c3a21-aa2e-4135-be22-f4d83ec63725 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] [instance: bd166847-1e05-4e06-86b1-1f3773eb57f1] Going to try to terminate instance {{(pid=138744) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 20:52:01.176043 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-172c3a21-aa2e-4135-be22-f4d83ec63725 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] 10.222.0.18 "DELETE /compute/v2.1/servers/bd166847-1e05-4e06-86b1-1f3773eb57f1" status: 204 len: 0 microversion: 2.1 time: 0.146409 Oct 22 20:52:01.177379 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 413/876] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 20:52:01 2022] DELETE /compute/v2.1/servers/bd166847-1e05-4e06-86b1-1f3773eb57f1 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 20:52:01.188864 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-66f45d80-165a-4dc7-b9d9-c57a90ff4be3 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:52:01.189925 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-66f45d80-165a-4dc7-b9d9-c57a90ff4be3 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] [instance: bd166847-1e05-4e06-86b1-1f3773eb57f1] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:52:01.201444 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-66f45d80-165a-4dc7-b9d9-c57a90ff4be3 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:01.202266 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-66f45d80-165a-4dc7-b9d9-c57a90ff4be3 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:01.202845 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-66f45d80-165a-4dc7-b9d9-c57a90ff4be3 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:01.204753 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-66f45d80-165a-4dc7-b9d9-c57a90ff4be3 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:01.206126 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-66f45d80-165a-4dc7-b9d9-c57a90ff4be3 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:01.206520 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-66f45d80-165a-4dc7-b9d9-c57a90ff4be3 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:01.300806 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-44c52eaf-98f6-4960-b3f9-e7717c73f9d6 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:52:01.301606 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-44c52eaf-98f6-4960-b3f9-e7717c73f9d6 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] [instance: 2f02a0ad-4856-4643-9e69-50547f5c7a98] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:52:01.308450 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-44c52eaf-98f6-4960-b3f9-e7717c73f9d6 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:01.309058 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-44c52eaf-98f6-4960-b3f9-e7717c73f9d6 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:01.309563 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-44c52eaf-98f6-4960-b3f9-e7717c73f9d6 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:01.310342 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-44c52eaf-98f6-4960-b3f9-e7717c73f9d6 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:01.310856 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-44c52eaf-98f6-4960-b3f9-e7717c73f9d6 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:01.311376 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-44c52eaf-98f6-4960-b3f9-e7717c73f9d6 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:01.350259 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-66f45d80-165a-4dc7-b9d9-c57a90ff4be3 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084d99ccb7dc405f85b1d31cfd255e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '950a163a28d64f41855e56cf88e3b1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:52:01.366217 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-66f45d80-165a-4dc7-b9d9-c57a90ff4be3 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] 10.222.0.18 "GET /compute/v2.1/servers/bd166847-1e05-4e06-86b1-1f3773eb57f1" status: 200 len: 1469 microversion: 2.1 time: 0.183663 Oct 22 20:52:01.366809 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 464/877] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:52:01 2022] GET /compute/v2.1/servers/bd166847-1e05-4e06-86b1-1f3773eb57f1 => generated 1469 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:52:01.459178 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-44c52eaf-98f6-4960-b3f9-e7717c73f9d6 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c87f0356ca346f39c6216393d85da2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee8c8f7fc4e12bc1f9fcce3e7b581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:52:01.468196 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-44c52eaf-98f6-4960-b3f9-e7717c73f9d6 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] 10.222.0.18 "GET /compute/v2.1/servers/2f02a0ad-4856-4643-9e69-50547f5c7a98" status: 200 len: 1503 microversion: 2.1 time: 0.171681 Oct 22 20:52:01.468772 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 414/878] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:52:01 2022] GET /compute/v2.1/servers/2f02a0ad-4856-4643-9e69-50547f5c7a98 => generated 1503 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 20:52:01.646363 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-27e86393-0c6b-4120-bf2d-627efec4b49b tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:52:01.647187 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-27e86393-0c6b-4120-bf2d-627efec4b49b tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] [instance: 7a4f8d67-fade-412f-9554-78f39414132f] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:52:01.654409 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-27e86393-0c6b-4120-bf2d-627efec4b49b tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:01.654980 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-27e86393-0c6b-4120-bf2d-627efec4b49b tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:01.655541 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-27e86393-0c6b-4120-bf2d-627efec4b49b tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:01.656257 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-27e86393-0c6b-4120-bf2d-627efec4b49b tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:01.656748 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-27e86393-0c6b-4120-bf2d-627efec4b49b tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:01.657175 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-27e86393-0c6b-4120-bf2d-627efec4b49b tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:01.818628 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-27e86393-0c6b-4120-bf2d-627efec4b49b tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91cf84a287b74618ae1b3368785b0b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902e239d67664098895ab24340b0b780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:52:01.829351 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-27e86393-0c6b-4120-bf2d-627efec4b49b tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] 10.222.0.18 "GET /compute/v2.1/servers/7a4f8d67-fade-412f-9554-78f39414132f" status: 200 len: 1464 microversion: 2.1 time: 0.186863 Oct 22 20:52:01.830331 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 465/879] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:52:01 2022] GET /compute/v2.1/servers/7a4f8d67-fade-412f-9554-78f39414132f => generated 1464 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:52:01.853009 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-2e1e1a85-f39f-4b55-a1bb-53d2f73608cb tempest-ServersOnMultiNodesTest-1015080240 tempest-ServersOnMultiNodesTest-1015080240-project-admin] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:52:01.853865 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-2e1e1a85-f39f-4b55-a1bb-53d2f73608cb tempest-ServersOnMultiNodesTest-1015080240 tempest-ServersOnMultiNodesTest-1015080240-project-admin] [instance: 7a4f8d67-fade-412f-9554-78f39414132f] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:52:01.860466 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2e1e1a85-f39f-4b55-a1bb-53d2f73608cb tempest-ServersOnMultiNodesTest-1015080240 tempest-ServersOnMultiNodesTest-1015080240-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:01.861226 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2e1e1a85-f39f-4b55-a1bb-53d2f73608cb tempest-ServersOnMultiNodesTest-1015080240 tempest-ServersOnMultiNodesTest-1015080240-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:01.861838 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2e1e1a85-f39f-4b55-a1bb-53d2f73608cb tempest-ServersOnMultiNodesTest-1015080240 tempest-ServersOnMultiNodesTest-1015080240-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:01.862714 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2e1e1a85-f39f-4b55-a1bb-53d2f73608cb tempest-ServersOnMultiNodesTest-1015080240 tempest-ServersOnMultiNodesTest-1015080240-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:01.863331 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2e1e1a85-f39f-4b55-a1bb-53d2f73608cb tempest-ServersOnMultiNodesTest-1015080240 tempest-ServersOnMultiNodesTest-1015080240-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:01.864110 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2e1e1a85-f39f-4b55-a1bb-53d2f73608cb tempest-ServersOnMultiNodesTest-1015080240 tempest-ServersOnMultiNodesTest-1015080240-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:02.008732 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-2e1e1a85-f39f-4b55-a1bb-53d2f73608cb tempest-ServersOnMultiNodesTest-1015080240 tempest-ServersOnMultiNodesTest-1015080240-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/7a4f8d67-fade-412f-9554-78f39414132f" status: 200 len: 1615 microversion: 2.1 time: 0.159780 Oct 22 20:52:02.011832 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 415/880] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:52:01 2022] GET /compute/v2.1/servers/7a4f8d67-fade-412f-9554-78f39414132f => generated 1615 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:52:02.082570 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-d52e3ad7-a5a2-41dd-a250-3e071f28ce90 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1053315556", "imageRef": "085e4478-6edc-4a69-8e08-f9831713eb65", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": ["69ed98a2-c208-4765-88b1-3e76a09cc481"]}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:52:02.151498 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.network.neutron [None req-d52e3ad7-a5a2-41dd-a250-3e071f28ce90 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] validate_networks() for None {{(pid=138745) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 20:52:02.390834 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-ffaf78a1-bb4b-444f-8ec5-92bbf86cbd0a tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:52:02.392295 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-ffaf78a1-bb4b-444f-8ec5-92bbf86cbd0a tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] [instance: bd166847-1e05-4e06-86b1-1f3773eb57f1] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:52:02.409153 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ffaf78a1-bb4b-444f-8ec5-92bbf86cbd0a tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:02.409813 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ffaf78a1-bb4b-444f-8ec5-92bbf86cbd0a tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:02.410264 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ffaf78a1-bb4b-444f-8ec5-92bbf86cbd0a tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:02.410998 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ffaf78a1-bb4b-444f-8ec5-92bbf86cbd0a tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:02.411483 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ffaf78a1-bb4b-444f-8ec5-92bbf86cbd0a tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:02.412185 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ffaf78a1-bb4b-444f-8ec5-92bbf86cbd0a tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:02.433236 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:52:02.626562 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-d52e3ad7-a5a2-41dd-a250-3e071f28ce90 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Flavor limits 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 20:52:02.627173 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-d52e3ad7-a5a2-41dd-a250-3e071f28ce90 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Image limits 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 20:52:02.627807 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-d52e3ad7-a5a2-41dd-a250-3e071f28ce90 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Flavor pref 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 20:52:02.628326 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-d52e3ad7-a5a2-41dd-a250-3e071f28ce90 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Image pref 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 20:52:02.628813 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-d52e3ad7-a5a2-41dd-a250-3e071f28ce90 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 20:52:02.651320 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d52e3ad7-a5a2-41dd-a250-3e071f28ce90 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:02.651797 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d52e3ad7-a5a2-41dd-a250-3e071f28ce90 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:02.652244 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d52e3ad7-a5a2-41dd-a250-3e071f28ce90 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:02.657459 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d52e3ad7-a5a2-41dd-a250-3e071f28ce90 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:02.657960 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d52e3ad7-a5a2-41dd-a250-3e071f28ce90 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:02.658418 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d52e3ad7-a5a2-41dd-a250-3e071f28ce90 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:02.689549 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-ffaf78a1-bb4b-444f-8ec5-92bbf86cbd0a tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084d99ccb7dc405f85b1d31cfd255e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '950a163a28d64f41855e56cf88e3b1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:52:02.692641 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-d52e3ad7-a5a2-41dd-a250-3e071f28ce90 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Getting quotas for project 902e239d67664098895ab24340b0b780. Resources: {'cores', 'instances', 'ram'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 20:52:02.699295 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-d52e3ad7-a5a2-41dd-a250-3e071f28ce90 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Getting quotas for user 91cf84a287b74618ae1b3368785b0b4c and project 902e239d67664098895ab24340b0b780. Resources: {'cores', 'instances', 'ram'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 20:52:02.707039 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-ffaf78a1-bb4b-444f-8ec5-92bbf86cbd0a tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] 10.222.0.18 "GET /compute/v2.1/servers/bd166847-1e05-4e06-86b1-1f3773eb57f1" status: 200 len: 1469 microversion: 2.1 time: 0.320433 Oct 22 20:52:02.711742 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 416/881] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:52:02 2022] GET /compute/v2.1/servers/bd166847-1e05-4e06-86b1-1f3773eb57f1 => generated 1469 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 20:52:02.716863 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-d52e3ad7-a5a2-41dd-a250-3e071f28ce90 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Going to run 1 instances... {{(pid=138745) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 20:52:02.720042 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-d52e3ad7-a5a2-41dd-a250-3e071f28ce90 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] [instance: ea383564-25ff-4e81-9301-c8bcb13988c7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='085e4478-6edc-4a69-8e08-f9831713eb65',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138745) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 20:52:02.723291 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-2fca2a41-14d5-40af-a262-02985ad8190a tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:52:02.726263 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-2fca2a41-14d5-40af-a262-02985ad8190a tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] [instance: 2f02a0ad-4856-4643-9e69-50547f5c7a98] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:52:02.744205 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2fca2a41-14d5-40af-a262-02985ad8190a tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:02.746772 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2fca2a41-14d5-40af-a262-02985ad8190a tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:02.747430 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2fca2a41-14d5-40af-a262-02985ad8190a tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:02.751099 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2fca2a41-14d5-40af-a262-02985ad8190a tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:02.751860 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2fca2a41-14d5-40af-a262-02985ad8190a tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:02.753582 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2fca2a41-14d5-40af-a262-02985ad8190a tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:02.804628 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-d52e3ad7-a5a2-41dd-a250-3e071f28ce90 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.723308 Oct 22 20:52:02.805691 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 466/882] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Oct 22 20:52:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 729 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 20:52:02.827278 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-e14a1a0a-3ff0-41e7-82bb-aedddb59323f tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:52:02.830883 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-e14a1a0a-3ff0-41e7-82bb-aedddb59323f tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] [instance: ea383564-25ff-4e81-9301-c8bcb13988c7] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:52:02.993413 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-e14a1a0a-3ff0-41e7-82bb-aedddb59323f tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91cf84a287b74618ae1b3368785b0b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902e239d67664098895ab24340b0b780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:52:03.009437 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-e14a1a0a-3ff0-41e7-82bb-aedddb59323f tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] 10.222.0.18 "GET /compute/v2.1/servers/ea383564-25ff-4e81-9301-c8bcb13988c7" status: 200 len: 1217 microversion: 2.1 time: 0.190935 Oct 22 20:52:03.015400 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 467/883] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:52:02 2022] GET /compute/v2.1/servers/ea383564-25ff-4e81-9301-c8bcb13988c7 => generated 1217 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:52:03.075075 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-2fca2a41-14d5-40af-a262-02985ad8190a tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c87f0356ca346f39c6216393d85da2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee8c8f7fc4e12bc1f9fcce3e7b581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:52:03.084093 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-2fca2a41-14d5-40af-a262-02985ad8190a tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] 10.222.0.18 "GET /compute/v2.1/servers/2f02a0ad-4856-4643-9e69-50547f5c7a98" status: 200 len: 1503 microversion: 2.1 time: 0.371016 Oct 22 20:52:03.084682 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 417/884] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:52:02 2022] GET /compute/v2.1/servers/2f02a0ad-4856-4643-9e69-50547f5c7a98 => generated 1503 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:52:03.736123 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-0de0dc58-4dba-43db-b3ef-840f130fddf3 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:52:03.736882 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-0de0dc58-4dba-43db-b3ef-840f130fddf3 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] [instance: bd166847-1e05-4e06-86b1-1f3773eb57f1] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:52:03.745174 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0de0dc58-4dba-43db-b3ef-840f130fddf3 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:03.745671 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0de0dc58-4dba-43db-b3ef-840f130fddf3 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:03.746110 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0de0dc58-4dba-43db-b3ef-840f130fddf3 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:03.746822 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0de0dc58-4dba-43db-b3ef-840f130fddf3 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:03.747293 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0de0dc58-4dba-43db-b3ef-840f130fddf3 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:03.747783 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0de0dc58-4dba-43db-b3ef-840f130fddf3 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:03.944218 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-0de0dc58-4dba-43db-b3ef-840f130fddf3 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084d99ccb7dc405f85b1d31cfd255e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '950a163a28d64f41855e56cf88e3b1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:52:03.955769 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-0de0dc58-4dba-43db-b3ef-840f130fddf3 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] 10.222.0.18 "GET /compute/v2.1/servers/bd166847-1e05-4e06-86b1-1f3773eb57f1" status: 200 len: 1469 microversion: 2.1 time: 0.223428 Oct 22 20:52:03.957898 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 468/885] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:52:03 2022] GET /compute/v2.1/servers/bd166847-1e05-4e06-86b1-1f3773eb57f1 => generated 1469 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:52:04.036714 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-aac2bd57-43dc-4794-9a66-297cead358fb tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:52:04.037445 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-aac2bd57-43dc-4794-9a66-297cead358fb tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] [instance: ea383564-25ff-4e81-9301-c8bcb13988c7] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:52:04.052232 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-aac2bd57-43dc-4794-9a66-297cead358fb tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:04.052865 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-aac2bd57-43dc-4794-9a66-297cead358fb tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:04.053488 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-aac2bd57-43dc-4794-9a66-297cead358fb tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:04.057279 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-aac2bd57-43dc-4794-9a66-297cead358fb tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:04.058069 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-aac2bd57-43dc-4794-9a66-297cead358fb tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:04.058505 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-aac2bd57-43dc-4794-9a66-297cead358fb tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:04.117120 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-ad2457ba-ea30-43d3-942b-5953d4b9be68 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:52:04.118007 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-ad2457ba-ea30-43d3-942b-5953d4b9be68 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] [instance: 2f02a0ad-4856-4643-9e69-50547f5c7a98] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:52:04.130207 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ad2457ba-ea30-43d3-942b-5953d4b9be68 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:04.137764 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ad2457ba-ea30-43d3-942b-5953d4b9be68 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:04.138381 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ad2457ba-ea30-43d3-942b-5953d4b9be68 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:04.145028 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ad2457ba-ea30-43d3-942b-5953d4b9be68 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:04.147834 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ad2457ba-ea30-43d3-942b-5953d4b9be68 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:04.148405 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ad2457ba-ea30-43d3-942b-5953d4b9be68 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:04.508147 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-aac2bd57-43dc-4794-9a66-297cead358fb tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91cf84a287b74618ae1b3368785b0b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902e239d67664098895ab24340b0b780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:52:04.532310 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-aac2bd57-43dc-4794-9a66-297cead358fb tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] 10.222.0.18 "GET /compute/v2.1/servers/ea383564-25ff-4e81-9301-c8bcb13988c7" status: 200 len: 1269 microversion: 2.1 time: 0.489022 Oct 22 20:52:04.533767 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 418/886] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:52:04 2022] GET /compute/v2.1/servers/ea383564-25ff-4e81-9301-c8bcb13988c7 => generated 1269 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:52:04.553061 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-ebb12772-a88b-45b0-88a7-a3237cbdf1bc req-fe23e0e9-c398-4f84-affd-ceb02f543d37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd166847-1e05-4e06-86b1-1f3773eb57f1", "name": "network-vif-deleted", "tag": "9d56f899-b2af-4a81-9b71-b87b0c0ab451"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:52:04.567096 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-ebb12772-a88b-45b0-88a7-a3237cbdf1bc req-fe23e0e9-c398-4f84-affd-ceb02f543d37 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:04.567830 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-ebb12772-a88b-45b0-88a7-a3237cbdf1bc req-fe23e0e9-c398-4f84-affd-ceb02f543d37 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:04.569444 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-ebb12772-a88b-45b0-88a7-a3237cbdf1bc req-fe23e0e9-c398-4f84-affd-ceb02f543d37 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:04.583420 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-ebb12772-a88b-45b0-88a7-a3237cbdf1bc req-fe23e0e9-c398-4f84-affd-ceb02f543d37 service nova] Creating event network-vif-deleted:9d56f899-b2af-4a81-9b71-b87b0c0ab451 for instance bd166847-1e05-4e06-86b1-1f3773eb57f1 on nch2-master-1 Oct 22 20:52:04.591563 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-ebb12772-a88b-45b0-88a7-a3237cbdf1bc req-fe23e0e9-c398-4f84-affd-ceb02f543d37 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053164 Oct 22 20:52:04.593041 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 419/887] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:52:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:52:04.686885 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-ad2457ba-ea30-43d3-942b-5953d4b9be68 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c87f0356ca346f39c6216393d85da2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee8c8f7fc4e12bc1f9fcce3e7b581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:52:04.694989 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-ad2457ba-ea30-43d3-942b-5953d4b9be68 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] 10.222.0.18 "GET /compute/v2.1/servers/2f02a0ad-4856-4643-9e69-50547f5c7a98" status: 200 len: 1503 microversion: 2.1 time: 0.582649 Oct 22 20:52:04.695729 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 469/888] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:52:04 2022] GET /compute/v2.1/servers/2f02a0ad-4856-4643-9e69-50547f5c7a98 => generated 1503 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 20:52:04.982838 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-62f718e9-9167-47d8-a174-010395560866 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:52:04.983608 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-62f718e9-9167-47d8-a174-010395560866 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] [instance: bd166847-1e05-4e06-86b1-1f3773eb57f1] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:52:04.995381 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-62f718e9-9167-47d8-a174-010395560866 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:04.995860 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-62f718e9-9167-47d8-a174-010395560866 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:04.996311 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-62f718e9-9167-47d8-a174-010395560866 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:04.997028 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-62f718e9-9167-47d8-a174-010395560866 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:04.997495 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-62f718e9-9167-47d8-a174-010395560866 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:04.997919 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-62f718e9-9167-47d8-a174-010395560866 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:05.044274 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-62f718e9-9167-47d8-a174-010395560866 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:05.045527 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-62f718e9-9167-47d8-a174-010395560866 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:05.046314 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-62f718e9-9167-47d8-a174-010395560866 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:05.046989 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.objects.instance [None req-62f718e9-9167-47d8-a174-010395560866 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Lazy-loading 'fault' on Instance uuid bd166847-1e05-4e06-86b1-1f3773eb57f1 {{(pid=138744) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 20:52:05.108616 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-62f718e9-9167-47d8-a174-010395560866 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084d99ccb7dc405f85b1d31cfd255e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '950a163a28d64f41855e56cf88e3b1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:52:05.117776 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-62f718e9-9167-47d8-a174-010395560866 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] 10.222.0.18 "GET /compute/v2.1/servers/bd166847-1e05-4e06-86b1-1f3773eb57f1" status: 200 len: 1312 microversion: 2.1 time: 0.139140 Oct 22 20:52:05.120585 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 420/889] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:52:04 2022] GET /compute/v2.1/servers/bd166847-1e05-4e06-86b1-1f3773eb57f1 => generated 1312 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 20:52:05.562723 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-16b7c201-8c6c-4948-b4d9-6f83c96c947b tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:52:05.564067 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-16b7c201-8c6c-4948-b4d9-6f83c96c947b tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] [instance: ea383564-25ff-4e81-9301-c8bcb13988c7] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:52:05.574269 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-16b7c201-8c6c-4948-b4d9-6f83c96c947b tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:05.574762 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-16b7c201-8c6c-4948-b4d9-6f83c96c947b tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:05.575826 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-16b7c201-8c6c-4948-b4d9-6f83c96c947b tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:05.577090 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-16b7c201-8c6c-4948-b4d9-6f83c96c947b tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:05.578233 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-16b7c201-8c6c-4948-b4d9-6f83c96c947b tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:05.578928 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-16b7c201-8c6c-4948-b4d9-6f83c96c947b tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:05.659386 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-16b7c201-8c6c-4948-b4d9-6f83c96c947b tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91cf84a287b74618ae1b3368785b0b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902e239d67664098895ab24340b0b780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:52:05.668108 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-16b7c201-8c6c-4948-b4d9-6f83c96c947b tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] 10.222.0.18 "GET /compute/v2.1/servers/ea383564-25ff-4e81-9301-c8bcb13988c7" status: 200 len: 1275 microversion: 2.1 time: 0.109498 Oct 22 20:52:05.668830 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 470/890] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:52:05 2022] GET /compute/v2.1/servers/ea383564-25ff-4e81-9301-c8bcb13988c7 => generated 1275 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:52:05.722009 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-ad567654-88a9-4f9c-97a1-79acf5503fe7 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:52:05.722707 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-ad567654-88a9-4f9c-97a1-79acf5503fe7 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] [instance: 2f02a0ad-4856-4643-9e69-50547f5c7a98] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:52:05.730720 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ad567654-88a9-4f9c-97a1-79acf5503fe7 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:05.731322 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ad567654-88a9-4f9c-97a1-79acf5503fe7 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:05.731855 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ad567654-88a9-4f9c-97a1-79acf5503fe7 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:05.732629 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ad567654-88a9-4f9c-97a1-79acf5503fe7 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:05.733154 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ad567654-88a9-4f9c-97a1-79acf5503fe7 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:05.733649 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ad567654-88a9-4f9c-97a1-79acf5503fe7 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:05.750178 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-1c209893-335f-403e-8298-17e29a3c4c69 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:52:05.751382 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-1c209893-335f-403e-8298-17e29a3c4c69 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] [instance: 4c53f81e-f4d8-4b41-b03a-ba9acb867226] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:52:05.758268 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1c209893-335f-403e-8298-17e29a3c4c69 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:05.758476 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1c209893-335f-403e-8298-17e29a3c4c69 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:05.758900 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1c209893-335f-403e-8298-17e29a3c4c69 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:05.759835 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1c209893-335f-403e-8298-17e29a3c4c69 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:05.760294 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1c209893-335f-403e-8298-17e29a3c4c69 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:05.760908 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1c209893-335f-403e-8298-17e29a3c4c69 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:05.789652 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-1c209893-335f-403e-8298-17e29a3c4c69 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] [instance: 4c53f81e-f4d8-4b41-b03a-ba9acb867226] Going to try to terminate instance {{(pid=138745) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 20:52:05.897636 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-ad567654-88a9-4f9c-97a1-79acf5503fe7 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c87f0356ca346f39c6216393d85da2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee8c8f7fc4e12bc1f9fcce3e7b581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:52:05.906216 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-ad567654-88a9-4f9c-97a1-79acf5503fe7 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] 10.222.0.18 "GET /compute/v2.1/servers/2f02a0ad-4856-4643-9e69-50547f5c7a98" status: 200 len: 1503 microversion: 2.1 time: 0.188173 Oct 22 20:52:05.907127 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 421/891] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:52:05 2022] GET /compute/v2.1/servers/2f02a0ad-4856-4643-9e69-50547f5c7a98 => generated 1503 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:52:05.925233 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:52:05.936442 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-1c209893-335f-403e-8298-17e29a3c4c69 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] 10.222.0.18 "DELETE /compute/v2.1/servers/4c53f81e-f4d8-4b41-b03a-ba9acb867226" status: 204 len: 0 microversion: 2.1 time: 0.190127 Oct 22 20:52:05.937419 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 471/892] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 20:52:05 2022] DELETE /compute/v2.1/servers/4c53f81e-f4d8-4b41-b03a-ba9acb867226 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 22 20:52:06.043596 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-23f4e6cc-e0b2-4731-a327-d26b5f51c92e tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-1200837129", "imageRef": "085e4478-6edc-4a69-8e08-f9831713eb65", "flavorRef": "2037618959", "adminPass": "***", "networks": [{"uuid": "23d78391-5f1f-42d8-9cb4-080779546339"}], "security_groups": [{"name": "tempest-securitygroup--501915065"}], "key_name": "tempest-keypair-621297242", "user_data": "}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:52:06.144678 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-3df12b87-bc35-4726-8a34-a700054ac975 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:52:06.145539 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-3df12b87-bc35-4726-8a34-a700054ac975 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] [instance: bd166847-1e05-4e06-86b1-1f3773eb57f1] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:52:06.152635 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3df12b87-bc35-4726-8a34-a700054ac975 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:06.153268 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3df12b87-bc35-4726-8a34-a700054ac975 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:06.153829 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3df12b87-bc35-4726-8a34-a700054ac975 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:06.154528 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.network.neutron [None req-23f4e6cc-e0b2-4731-a327-d26b5f51c92e tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] validate_networks() for [('23d78391-5f1f-42d8-9cb4-080779546339', None, None, None, None, None)] {{(pid=138744) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 20:52:06.155136 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3df12b87-bc35-4726-8a34-a700054ac975 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:06.155350 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3df12b87-bc35-4726-8a34-a700054ac975 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:06.155889 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3df12b87-bc35-4726-8a34-a700054ac975 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:06.175947 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.wsgi [None req-3df12b87-bc35-4726-8a34-a700054ac975 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] HTTP exception thrown: Instance bd166847-1e05-4e06-86b1-1f3773eb57f1 could not be found. Oct 22 20:52:06.177923 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-3df12b87-bc35-4726-8a34-a700054ac975 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Request method failure captured: Oct 22 20:52:06.177923 ncdv-master-1 devstack@n-api.service[138745]: request: GET /compute/v2.1/servers/bd166847-1e05-4e06-86b1-1f3773eb57f1 HTTP/1.1 Oct 22 20:52:06.177923 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 20:52:06.177923 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 20:52:06.177923 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 20:52:06.177923 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 0 Oct 22 20:52:06.177923 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 20:52:06.177923 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 20:52:06.177923 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 20:52:06.177923 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 20:52:06.177923 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVFfN0gXQAZdpYVF_oFm9V2m2AgQLuq7vVRb-lc7wAfd1YL8EKMbcjgbpFvhfOzKRj3CD-oa_Ed1jlkF5s7rppEjDsBiW5FGkjaAXkMQ4dTmLHawcAQuKOrA9ggrVfLUAQJodjJiglUW61T4HGqvDrJZVRX7CKSlbTy0fy9Bz0bxHfZM Oct 22 20:52:06.177923 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 20:52:06.177923 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 20:52:06.177923 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 20:52:06.177923 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 20:52:06.177923 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 20:52:06.177923 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 20:52:06.177923 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: 950a163a28d64f41855e56cf88e3b1d9 Oct 22 20:52:06.177923 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-275249309 Oct 22 20:52:06.177923 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 20:52:06.177923 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 20:52:06.177923 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_950a163a28d64f41855e56cf88e3b1d9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/950a163a28d64f41855e56cf88e3b1d9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/950a163a28d64f41855e56cf88e3b1d9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/950a163a28d64f41855e56cf88e3b1d9"}]}] Oct 22 20:52:06.177923 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-ServersAdminNegativeTestJSON-275249309 Oct 22 20:52:06.177923 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: 950a163a28d64f41855e56cf88e3b1d9 Oct 22 20:52:06.177923 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-275249309 Oct 22 20:52:06.177923 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-ServersAdminNegativeTestJSON-275249309-project Oct 22 20:52:06.177923 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 20:52:06.177923 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 20:52:06.177923 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: 084d99ccb7dc405f85b1d31cfd255e72 Oct 22 20:52:06.177923 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-ServersAdminNegativeTestJSON-275249309-project Oct 22 20:52:06.177923 ncdv-master-1 devstack@n-api.service[138745]: method: > Oct 22 20:52:06.177923 ncdv-master-1 devstack@n-api.service[138745]: exception: Instance bd166847-1e05-4e06-86b1-1f3773eb57f1 could not be found. Oct 22 20:52:06.177923 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'id': 'bd166847-1e05-4e06-86b1-1f3773eb57f1'} Oct 22 20:52:06.177923 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:52:06.177923 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:52:06.177923 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 20:52:06.177923 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 20:52:06.177923 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 20:52:06.177923 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 20:52:06.177923 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 20:52:06.177923 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 20:52:06.177923 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 20:52:06.177923 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 20:52:06.177923 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bd166847-1e05-4e06-86b1-1f3773eb57f1 could not be found. Oct 22 20:52:06.177923 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:52:06.177923 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:52:06.177923 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:52:06.177923 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:52:06.177923 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:52:06.177923 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:52:06.177923 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:52:06.177923 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:52:06.177923 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:52:06.177923 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:52:06.177923 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 20:52:06.177923 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 20:52:06.177923 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 20:52:06.177923 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 20:52:06.177923 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 20:52:06.177923 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 20:52:06.177923 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd166847-1e05-4e06-86b1-1f3773eb57f1 could not be found. Oct 22 20:52:06.177923 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:52:06.177923 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:52:06.182562 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:52:06.182562 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:52:06.182562 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:52:06.182562 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:52:06.182562 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 20:52:06.182562 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 20:52:06.182562 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd166847-1e05-4e06-86b1-1f3773eb57f1 could not be found. Oct 22 20:52:06.182562 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:52:06.184434 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-3df12b87-bc35-4726-8a34-a700054ac975 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Returning 404 to user: Instance bd166847-1e05-4e06-86b1-1f3773eb57f1 could not be found. {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:52:06.185545 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-3df12b87-bc35-4726-8a34-a700054ac975 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] 10.222.0.18 "GET /compute/v2.1/servers/bd166847-1e05-4e06-86b1-1f3773eb57f1" status: 404 len: 111 microversion: 2.1 time: 0.046187 Oct 22 20:52:06.191223 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 472/893] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:52:06 2022] GET /compute/v2.1/servers/bd166847-1e05-4e06-86b1-1f3773eb57f1 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 22 20:52:06.198021 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-3778622c-dc0f-4f80-b1f5-94ee46494827 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:52:06.198688 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-3778622c-dc0f-4f80-b1f5-94ee46494827 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] [instance: 6da11c1d-55e8-4d3f-b045-44f67f397741] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:52:06.208466 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3778622c-dc0f-4f80-b1f5-94ee46494827 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:06.209367 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3778622c-dc0f-4f80-b1f5-94ee46494827 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:06.210045 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3778622c-dc0f-4f80-b1f5-94ee46494827 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:06.211162 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3778622c-dc0f-4f80-b1f5-94ee46494827 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:06.212062 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3778622c-dc0f-4f80-b1f5-94ee46494827 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:06.212751 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3778622c-dc0f-4f80-b1f5-94ee46494827 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:06.243658 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-3778622c-dc0f-4f80-b1f5-94ee46494827 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] [instance: 6da11c1d-55e8-4d3f-b045-44f67f397741] Going to try to terminate instance {{(pid=138745) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 20:52:06.331978 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-3778622c-dc0f-4f80-b1f5-94ee46494827 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] 10.222.0.18 "DELETE /compute/v2.1/servers/6da11c1d-55e8-4d3f-b045-44f67f397741" status: 204 len: 0 microversion: 2.1 time: 0.138963 Oct 22 20:52:06.332577 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 473/894] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 20:52:06 2022] DELETE /compute/v2.1/servers/6da11c1d-55e8-4d3f-b045-44f67f397741 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 20:52:06.342472 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-d5f45728-93f4-4cc4-ac8a-56012dc20b8e tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:52:06.344034 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-d5f45728-93f4-4cc4-ac8a-56012dc20b8e tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] [instance: 6da11c1d-55e8-4d3f-b045-44f67f397741] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:52:06.351056 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d5f45728-93f4-4cc4-ac8a-56012dc20b8e tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:06.351985 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d5f45728-93f4-4cc4-ac8a-56012dc20b8e tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:06.352429 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d5f45728-93f4-4cc4-ac8a-56012dc20b8e tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:06.353592 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d5f45728-93f4-4cc4-ac8a-56012dc20b8e tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:06.354233 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d5f45728-93f4-4cc4-ac8a-56012dc20b8e tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:06.354671 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d5f45728-93f4-4cc4-ac8a-56012dc20b8e tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:06.563682 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-d5f45728-93f4-4cc4-ac8a-56012dc20b8e tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084d99ccb7dc405f85b1d31cfd255e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '950a163a28d64f41855e56cf88e3b1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:52:06.577547 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-d5f45728-93f4-4cc4-ac8a-56012dc20b8e tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] 10.222.0.18 "GET /compute/v2.1/servers/6da11c1d-55e8-4d3f-b045-44f67f397741" status: 200 len: 1477 microversion: 2.1 time: 0.239849 Oct 22 20:52:06.579581 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 474/895] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:52:06 2022] GET /compute/v2.1/servers/6da11c1d-55e8-4d3f-b045-44f67f397741 => generated 1477 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 20:52:06.694379 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-98ebed19-910b-4eb4-be85-bea2bfe6852f tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:52:06.695320 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-98ebed19-910b-4eb4-be85-bea2bfe6852f tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] [instance: ea383564-25ff-4e81-9301-c8bcb13988c7] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:52:06.703749 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-98ebed19-910b-4eb4-be85-bea2bfe6852f tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:06.704439 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-98ebed19-910b-4eb4-be85-bea2bfe6852f tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:06.704881 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-98ebed19-910b-4eb4-be85-bea2bfe6852f tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:06.705599 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-98ebed19-910b-4eb4-be85-bea2bfe6852f tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:06.706081 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-98ebed19-910b-4eb4-be85-bea2bfe6852f tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:06.706720 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-98ebed19-910b-4eb4-be85-bea2bfe6852f tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:06.711548 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:52:06.798128 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-98ebed19-910b-4eb4-be85-bea2bfe6852f tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91cf84a287b74618ae1b3368785b0b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902e239d67664098895ab24340b0b780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:52:06.807996 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-98ebed19-910b-4eb4-be85-bea2bfe6852f tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] 10.222.0.18 "GET /compute/v2.1/servers/ea383564-25ff-4e81-9301-c8bcb13988c7" status: 200 len: 1275 microversion: 2.1 time: 0.119584 Oct 22 20:52:06.808770 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 475/896] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:52:06 2022] GET /compute/v2.1/servers/ea383564-25ff-4e81-9301-c8bcb13988c7 => generated 1275 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 20:52:06.833719 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-23f4e6cc-e0b2-4731-a327-d26b5f51c92e tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Flavor limits 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 20:52:06.835980 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-23f4e6cc-e0b2-4731-a327-d26b5f51c92e tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Image limits 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 20:52:06.837320 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-23f4e6cc-e0b2-4731-a327-d26b5f51c92e tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Flavor pref 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 20:52:06.837745 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-23f4e6cc-e0b2-4731-a327-d26b5f51c92e tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Image pref 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 20:52:06.838185 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-23f4e6cc-e0b2-4731-a327-d26b5f51c92e tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 20:52:06.848677 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-23f4e6cc-e0b2-4731-a327-d26b5f51c92e tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:06.849444 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-23f4e6cc-e0b2-4731-a327-d26b5f51c92e tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:06.850053 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-23f4e6cc-e0b2-4731-a327-d26b5f51c92e tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:06.852258 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-23f4e6cc-e0b2-4731-a327-d26b5f51c92e tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:06.853048 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-23f4e6cc-e0b2-4731-a327-d26b5f51c92e tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:06.853661 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-23f4e6cc-e0b2-4731-a327-d26b5f51c92e tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:06.877082 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-23f4e6cc-e0b2-4731-a327-d26b5f51c92e tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Getting quotas for project 30dbbdc150694e0ebc07c63e90280d40. Resources: {'cores', 'instances', 'ram'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 20:52:06.883972 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-23f4e6cc-e0b2-4731-a327-d26b5f51c92e tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Getting quotas for user f9bba9ed37d7430e82e7d310982b8e47 and project 30dbbdc150694e0ebc07c63e90280d40. Resources: {'cores', 'instances', 'ram'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 20:52:06.899396 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-23f4e6cc-e0b2-4731-a327-d26b5f51c92e tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Going to run 1 instances... {{(pid=138744) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 20:52:06.902105 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-23f4e6cc-e0b2-4731-a327-d26b5f51c92e tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] [instance: fa364234-023c-491a-bc88-97c048f6f0e2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='085e4478-6edc-4a69-8e08-f9831713eb65',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=-1,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=138744) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 20:52:06.932129 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-b2d4b116-0a84-40c2-987e-815195bbd818 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:52:06.933087 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-b2d4b116-0a84-40c2-987e-815195bbd818 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] [instance: 2f02a0ad-4856-4643-9e69-50547f5c7a98] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:52:06.944909 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b2d4b116-0a84-40c2-987e-815195bbd818 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:06.946015 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b2d4b116-0a84-40c2-987e-815195bbd818 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:06.946813 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b2d4b116-0a84-40c2-987e-815195bbd818 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:06.950704 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b2d4b116-0a84-40c2-987e-815195bbd818 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:06.951528 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b2d4b116-0a84-40c2-987e-815195bbd818 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:06.951987 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b2d4b116-0a84-40c2-987e-815195bbd818 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:07.034457 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-23f4e6cc-e0b2-4731-a327-d26b5f51c92e tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.993863 Oct 22 20:52:07.039768 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 422/897] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Oct 22 20:52:06 2022] POST /compute/v2.1/servers => generated 401 bytes in 1002 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 20:52:07.048477 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-115f80cf-8aee-4774-8c49-fdf965c975fa tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:52:07.049111 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-115f80cf-8aee-4774-8c49-fdf965c975fa tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] [instance: fa364234-023c-491a-bc88-97c048f6f0e2] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:52:07.187298 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-115f80cf-8aee-4774-8c49-fdf965c975fa tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9bba9ed37d7430e82e7d310982b8e47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30dbbdc150694e0ebc07c63e90280d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:52:07.197013 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-115f80cf-8aee-4774-8c49-fdf965c975fa tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] 10.222.0.18 "GET /compute/v2.1/servers/fa364234-023c-491a-bc88-97c048f6f0e2" status: 200 len: 1264 microversion: 2.1 time: 0.153052 Oct 22 20:52:07.198484 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 423/898] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:52:07 2022] GET /compute/v2.1/servers/fa364234-023c-491a-bc88-97c048f6f0e2 => generated 1264 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:52:07.388278 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-b2d4b116-0a84-40c2-987e-815195bbd818 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c87f0356ca346f39c6216393d85da2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee8c8f7fc4e12bc1f9fcce3e7b581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:52:07.397395 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-b2d4b116-0a84-40c2-987e-815195bbd818 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] 10.222.0.18 "GET /compute/v2.1/servers/2f02a0ad-4856-4643-9e69-50547f5c7a98" status: 200 len: 1503 microversion: 2.1 time: 0.469734 Oct 22 20:52:07.398297 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 476/899] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:52:06 2022] GET /compute/v2.1/servers/2f02a0ad-4856-4643-9e69-50547f5c7a98 => generated 1503 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 20:52:07.604794 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-df419c34-7680-4d31-82bb-70f292cf2644 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:52:07.605945 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-df419c34-7680-4d31-82bb-70f292cf2644 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] [instance: 6da11c1d-55e8-4d3f-b045-44f67f397741] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:52:07.618939 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-df419c34-7680-4d31-82bb-70f292cf2644 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:07.621080 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-df419c34-7680-4d31-82bb-70f292cf2644 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:07.621754 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-df419c34-7680-4d31-82bb-70f292cf2644 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:07.622711 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-df419c34-7680-4d31-82bb-70f292cf2644 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:07.623778 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-df419c34-7680-4d31-82bb-70f292cf2644 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:07.624470 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-df419c34-7680-4d31-82bb-70f292cf2644 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:07.831124 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-7b851923-bcc7-4f78-8da4-2c7eda1271d9 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:52:07.831925 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-7b851923-bcc7-4f78-8da4-2c7eda1271d9 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] [instance: ea383564-25ff-4e81-9301-c8bcb13988c7] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:52:07.839654 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7b851923-bcc7-4f78-8da4-2c7eda1271d9 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:07.840490 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7b851923-bcc7-4f78-8da4-2c7eda1271d9 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:07.841219 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7b851923-bcc7-4f78-8da4-2c7eda1271d9 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:07.843161 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7b851923-bcc7-4f78-8da4-2c7eda1271d9 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:07.843800 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7b851923-bcc7-4f78-8da4-2c7eda1271d9 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:07.844310 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7b851923-bcc7-4f78-8da4-2c7eda1271d9 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:07.949710 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-df419c34-7680-4d31-82bb-70f292cf2644 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084d99ccb7dc405f85b1d31cfd255e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '950a163a28d64f41855e56cf88e3b1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:52:07.971359 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-df419c34-7680-4d31-82bb-70f292cf2644 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] 10.222.0.18 "GET /compute/v2.1/servers/6da11c1d-55e8-4d3f-b045-44f67f397741" status: 200 len: 1477 microversion: 2.1 time: 0.371766 Oct 22 20:52:07.973507 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 424/900] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:52:07 2022] GET /compute/v2.1/servers/6da11c1d-55e8-4d3f-b045-44f67f397741 => generated 1477 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:52:08.093694 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-7b851923-bcc7-4f78-8da4-2c7eda1271d9 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91cf84a287b74618ae1b3368785b0b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902e239d67664098895ab24340b0b780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:52:08.107984 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-7b851923-bcc7-4f78-8da4-2c7eda1271d9 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] 10.222.0.18 "GET /compute/v2.1/servers/ea383564-25ff-4e81-9301-c8bcb13988c7" status: 200 len: 1317 microversion: 2.1 time: 0.280818 Oct 22 20:52:08.108586 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 477/901] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:52:07 2022] GET /compute/v2.1/servers/ea383564-25ff-4e81-9301-c8bcb13988c7 => generated 1317 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 20:52:08.222601 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-3b9389a0-aef5-4271-b7ce-c1a14d9bccee tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:52:08.225090 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-3b9389a0-aef5-4271-b7ce-c1a14d9bccee tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] [instance: fa364234-023c-491a-bc88-97c048f6f0e2] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:52:08.233919 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3b9389a0-aef5-4271-b7ce-c1a14d9bccee tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:08.236565 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3b9389a0-aef5-4271-b7ce-c1a14d9bccee tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:08.237116 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3b9389a0-aef5-4271-b7ce-c1a14d9bccee tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:08.238068 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3b9389a0-aef5-4271-b7ce-c1a14d9bccee tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:08.243446 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3b9389a0-aef5-4271-b7ce-c1a14d9bccee tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:08.244293 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3b9389a0-aef5-4271-b7ce-c1a14d9bccee tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:08.425535 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-240dc60b-5a6e-4ee0-806f-9bae4d67ab5d tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:52:08.426451 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-240dc60b-5a6e-4ee0-806f-9bae4d67ab5d tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] [instance: 2f02a0ad-4856-4643-9e69-50547f5c7a98] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:52:08.435854 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-240dc60b-5a6e-4ee0-806f-9bae4d67ab5d tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:08.441261 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-3b9389a0-aef5-4271-b7ce-c1a14d9bccee tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9bba9ed37d7430e82e7d310982b8e47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30dbbdc150694e0ebc07c63e90280d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:52:08.462737 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-240dc60b-5a6e-4ee0-806f-9bae4d67ab5d tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.027s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:08.464339 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-240dc60b-5a6e-4ee0-806f-9bae4d67ab5d tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:08.466876 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-240dc60b-5a6e-4ee0-806f-9bae4d67ab5d tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:08.468360 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-240dc60b-5a6e-4ee0-806f-9bae4d67ab5d tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:08.472879 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-240dc60b-5a6e-4ee0-806f-9bae4d67ab5d tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:08.475245 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-3b9389a0-aef5-4271-b7ce-c1a14d9bccee tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] 10.222.0.18 "GET /compute/v2.1/servers/fa364234-023c-491a-bc88-97c048f6f0e2" status: 200 len: 1316 microversion: 2.1 time: 0.257206 Oct 22 20:52:08.478267 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 425/902] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:52:08 2022] GET /compute/v2.1/servers/fa364234-023c-491a-bc88-97c048f6f0e2 => generated 1316 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:52:08.735651 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-240dc60b-5a6e-4ee0-806f-9bae4d67ab5d tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c87f0356ca346f39c6216393d85da2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee8c8f7fc4e12bc1f9fcce3e7b581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:52:08.748627 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-240dc60b-5a6e-4ee0-806f-9bae4d67ab5d tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] 10.222.0.18 "GET /compute/v2.1/servers/2f02a0ad-4856-4643-9e69-50547f5c7a98" status: 200 len: 1503 microversion: 2.1 time: 0.327670 Oct 22 20:52:08.749835 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 478/903] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:52:08 2022] GET /compute/v2.1/servers/2f02a0ad-4856-4643-9e69-50547f5c7a98 => generated 1503 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 20:52:08.999749 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-5c7d7811-83af-44aa-ad2c-38fd60684030 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:52:09.000385 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-5c7d7811-83af-44aa-ad2c-38fd60684030 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] [instance: 6da11c1d-55e8-4d3f-b045-44f67f397741] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:52:09.010264 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5c7d7811-83af-44aa-ad2c-38fd60684030 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:09.010678 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5c7d7811-83af-44aa-ad2c-38fd60684030 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:09.014872 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5c7d7811-83af-44aa-ad2c-38fd60684030 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:09.015882 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5c7d7811-83af-44aa-ad2c-38fd60684030 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:09.016513 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5c7d7811-83af-44aa-ad2c-38fd60684030 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:09.017106 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5c7d7811-83af-44aa-ad2c-38fd60684030 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:09.137550 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-b5aaf6d6-2019-43d3-837c-99d7e0aea425 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:52:09.139204 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-b5aaf6d6-2019-43d3-837c-99d7e0aea425 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] [instance: ea383564-25ff-4e81-9301-c8bcb13988c7] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:52:09.164928 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b5aaf6d6-2019-43d3-837c-99d7e0aea425 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:09.166303 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b5aaf6d6-2019-43d3-837c-99d7e0aea425 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:09.167009 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b5aaf6d6-2019-43d3-837c-99d7e0aea425 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:09.168364 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b5aaf6d6-2019-43d3-837c-99d7e0aea425 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:09.169040 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b5aaf6d6-2019-43d3-837c-99d7e0aea425 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:09.169634 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b5aaf6d6-2019-43d3-837c-99d7e0aea425 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:09.741199 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-b5aaf6d6-2019-43d3-837c-99d7e0aea425 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91cf84a287b74618ae1b3368785b0b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902e239d67664098895ab24340b0b780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:52:09.754034 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-b5aaf6d6-2019-43d3-837c-99d7e0aea425 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] 10.222.0.18 "GET /compute/v2.1/servers/ea383564-25ff-4e81-9301-c8bcb13988c7" status: 200 len: 1317 microversion: 2.1 time: 0.623285 Oct 22 20:52:09.756456 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 479/904] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:52:09 2022] GET /compute/v2.1/servers/ea383564-25ff-4e81-9301-c8bcb13988c7 => generated 1317 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 20:52:09.777925 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-b9295669-8ae3-4ec6-8895-06d4fb329f71 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:52:09.784477 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-b9295669-8ae3-4ec6-8895-06d4fb329f71 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] [instance: fa364234-023c-491a-bc88-97c048f6f0e2] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:52:09.796528 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-5c7d7811-83af-44aa-ad2c-38fd60684030 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084d99ccb7dc405f85b1d31cfd255e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '950a163a28d64f41855e56cf88e3b1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:52:09.822251 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-5c7d7811-83af-44aa-ad2c-38fd60684030 tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] 10.222.0.18 "GET /compute/v2.1/servers/6da11c1d-55e8-4d3f-b045-44f67f397741" status: 200 len: 1477 microversion: 2.1 time: 0.826499 Oct 22 20:52:09.825178 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b9295669-8ae3-4ec6-8895-06d4fb329f71 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:09.844593 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 426/905] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:52:08 2022] GET /compute/v2.1/servers/6da11c1d-55e8-4d3f-b045-44f67f397741 => generated 1477 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:52:09.846600 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b9295669-8ae3-4ec6-8895-06d4fb329f71 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:09.848137 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b9295669-8ae3-4ec6-8895-06d4fb329f71 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:09.851431 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b9295669-8ae3-4ec6-8895-06d4fb329f71 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:09.851431 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b9295669-8ae3-4ec6-8895-06d4fb329f71 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:09.851431 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b9295669-8ae3-4ec6-8895-06d4fb329f71 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:09.857558 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-b1db6942-b55b-42b8-8590-ae9a52c95080 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:52:09.860325 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-b1db6942-b55b-42b8-8590-ae9a52c95080 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] [instance: 2f02a0ad-4856-4643-9e69-50547f5c7a98] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:52:09.893574 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b1db6942-b55b-42b8-8590-ae9a52c95080 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:09.897892 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b1db6942-b55b-42b8-8590-ae9a52c95080 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:09.899211 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b1db6942-b55b-42b8-8590-ae9a52c95080 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:09.902959 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b1db6942-b55b-42b8-8590-ae9a52c95080 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:09.904359 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b1db6942-b55b-42b8-8590-ae9a52c95080 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:09.906687 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b1db6942-b55b-42b8-8590-ae9a52c95080 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:10.136377 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-b9295669-8ae3-4ec6-8895-06d4fb329f71 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9bba9ed37d7430e82e7d310982b8e47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30dbbdc150694e0ebc07c63e90280d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:52:10.154021 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-b9295669-8ae3-4ec6-8895-06d4fb329f71 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] 10.222.0.18 "GET /compute/v2.1/servers/fa364234-023c-491a-bc88-97c048f6f0e2" status: 200 len: 1322 microversion: 2.1 time: 0.396274 Oct 22 20:52:10.154916 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 480/906] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:52:09 2022] GET /compute/v2.1/servers/fa364234-023c-491a-bc88-97c048f6f0e2 => generated 1322 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:52:10.430530 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-b1db6942-b55b-42b8-8590-ae9a52c95080 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c87f0356ca346f39c6216393d85da2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee8c8f7fc4e12bc1f9fcce3e7b581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:52:10.449342 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-b1db6942-b55b-42b8-8590-ae9a52c95080 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] 10.222.0.18 "GET /compute/v2.1/servers/2f02a0ad-4856-4643-9e69-50547f5c7a98" status: 200 len: 1503 microversion: 2.1 time: 0.597347 Oct 22 20:52:10.450927 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 427/907] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:52:09 2022] GET /compute/v2.1/servers/2f02a0ad-4856-4643-9e69-50547f5c7a98 => generated 1503 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:52:10.518009 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-73c662a8-d385-43c5-adb8-aeb2422dde9a req-3476125f-bdb4-4529-84af-835515e83c71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6da11c1d-55e8-4d3f-b045-44f67f397741", "name": "network-vif-deleted", "tag": "83b107b1-58e6-4421-bfb7-8ecd1dc64829"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:52:10.537678 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-73c662a8-d385-43c5-adb8-aeb2422dde9a req-3476125f-bdb4-4529-84af-835515e83c71 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:10.538607 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-73c662a8-d385-43c5-adb8-aeb2422dde9a req-3476125f-bdb4-4529-84af-835515e83c71 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:10.539559 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-73c662a8-d385-43c5-adb8-aeb2422dde9a req-3476125f-bdb4-4529-84af-835515e83c71 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:10.566161 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-73c662a8-d385-43c5-adb8-aeb2422dde9a req-3476125f-bdb4-4529-84af-835515e83c71 service nova] Creating event network-vif-deleted:83b107b1-58e6-4421-bfb7-8ecd1dc64829 for instance 6da11c1d-55e8-4d3f-b045-44f67f397741 on nch2-master-1 Oct 22 20:52:10.575242 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-73c662a8-d385-43c5-adb8-aeb2422dde9a req-3476125f-bdb4-4529-84af-835515e83c71 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062357 Oct 22 20:52:10.582071 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 481/908] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:52:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:52:10.792786 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-068ce1bb-546f-4c36-9c67-6bc3105dff04 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:52:10.793651 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-068ce1bb-546f-4c36-9c67-6bc3105dff04 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] [instance: ea383564-25ff-4e81-9301-c8bcb13988c7] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:52:10.810684 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-068ce1bb-546f-4c36-9c67-6bc3105dff04 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:10.812666 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-068ce1bb-546f-4c36-9c67-6bc3105dff04 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:10.813700 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-068ce1bb-546f-4c36-9c67-6bc3105dff04 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:10.814997 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-068ce1bb-546f-4c36-9c67-6bc3105dff04 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:10.815751 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-068ce1bb-546f-4c36-9c67-6bc3105dff04 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:10.820564 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-068ce1bb-546f-4c36-9c67-6bc3105dff04 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:10.853778 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-5015ded8-07e2-499f-9ceb-5ef0d5a3062b tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:52:10.855007 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-5015ded8-07e2-499f-9ceb-5ef0d5a3062b tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] [instance: 6da11c1d-55e8-4d3f-b045-44f67f397741] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:52:10.869480 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5015ded8-07e2-499f-9ceb-5ef0d5a3062b tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:10.872376 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5015ded8-07e2-499f-9ceb-5ef0d5a3062b tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:10.873229 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5015ded8-07e2-499f-9ceb-5ef0d5a3062b tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:10.874916 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5015ded8-07e2-499f-9ceb-5ef0d5a3062b tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:10.880376 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5015ded8-07e2-499f-9ceb-5ef0d5a3062b tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:10.883753 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5015ded8-07e2-499f-9ceb-5ef0d5a3062b tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:10.972567 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5015ded8-07e2-499f-9ceb-5ef0d5a3062b tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:10.973075 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5015ded8-07e2-499f-9ceb-5ef0d5a3062b tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:10.973515 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5015ded8-07e2-499f-9ceb-5ef0d5a3062b tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:10.974580 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.objects.instance [None req-5015ded8-07e2-499f-9ceb-5ef0d5a3062b tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Lazy-loading 'fault' on Instance uuid 6da11c1d-55e8-4d3f-b045-44f67f397741 {{(pid=138745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 20:52:11.105242 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-5015ded8-07e2-499f-9ceb-5ef0d5a3062b tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084d99ccb7dc405f85b1d31cfd255e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '950a163a28d64f41855e56cf88e3b1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:52:11.118461 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-5015ded8-07e2-499f-9ceb-5ef0d5a3062b tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] 10.222.0.18 "GET /compute/v2.1/servers/6da11c1d-55e8-4d3f-b045-44f67f397741" status: 200 len: 1311 microversion: 2.1 time: 0.271207 Oct 22 20:52:11.119274 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 482/909] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:52:10 2022] GET /compute/v2.1/servers/6da11c1d-55e8-4d3f-b045-44f67f397741 => generated 1311 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:52:11.182298 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-0da09524-ae26-4012-8883-34ad8a0086f8 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:52:11.183124 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-0da09524-ae26-4012-8883-34ad8a0086f8 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] [instance: fa364234-023c-491a-bc88-97c048f6f0e2] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:52:11.191116 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0da09524-ae26-4012-8883-34ad8a0086f8 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:11.191779 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0da09524-ae26-4012-8883-34ad8a0086f8 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:11.192895 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0da09524-ae26-4012-8883-34ad8a0086f8 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:11.193963 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0da09524-ae26-4012-8883-34ad8a0086f8 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:11.194733 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0da09524-ae26-4012-8883-34ad8a0086f8 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:11.195189 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0da09524-ae26-4012-8883-34ad8a0086f8 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:11.306935 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-068ce1bb-546f-4c36-9c67-6bc3105dff04 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91cf84a287b74618ae1b3368785b0b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902e239d67664098895ab24340b0b780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:52:11.320431 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-068ce1bb-546f-4c36-9c67-6bc3105dff04 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] 10.222.0.18 "GET /compute/v2.1/servers/ea383564-25ff-4e81-9301-c8bcb13988c7" status: 200 len: 1317 microversion: 2.1 time: 0.537655 Oct 22 20:52:11.323603 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 428/910] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:52:10 2022] GET /compute/v2.1/servers/ea383564-25ff-4e81-9301-c8bcb13988c7 => generated 1317 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:52:11.371792 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-0da09524-ae26-4012-8883-34ad8a0086f8 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9bba9ed37d7430e82e7d310982b8e47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30dbbdc150694e0ebc07c63e90280d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:52:11.386284 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-0da09524-ae26-4012-8883-34ad8a0086f8 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] 10.222.0.18 "GET /compute/v2.1/servers/fa364234-023c-491a-bc88-97c048f6f0e2" status: 200 len: 1322 microversion: 2.1 time: 0.208254 Oct 22 20:52:11.389477 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 483/911] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:52:11 2022] GET /compute/v2.1/servers/fa364234-023c-491a-bc88-97c048f6f0e2 => generated 1322 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:52:11.475362 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-f93a1b4f-8228-4ad1-96a5-a6e2f3964e05 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:52:11.476287 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-f93a1b4f-8228-4ad1-96a5-a6e2f3964e05 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] [instance: 2f02a0ad-4856-4643-9e69-50547f5c7a98] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:52:11.486145 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f93a1b4f-8228-4ad1-96a5-a6e2f3964e05 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:11.486923 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f93a1b4f-8228-4ad1-96a5-a6e2f3964e05 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:11.487691 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f93a1b4f-8228-4ad1-96a5-a6e2f3964e05 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:11.488841 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f93a1b4f-8228-4ad1-96a5-a6e2f3964e05 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:11.489498 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f93a1b4f-8228-4ad1-96a5-a6e2f3964e05 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:11.490181 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f93a1b4f-8228-4ad1-96a5-a6e2f3964e05 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:12.143601 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-20bd7291-b1c3-4277-870b-711ecd560e3e tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:52:12.144613 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-20bd7291-b1c3-4277-870b-711ecd560e3e tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] [instance: 6da11c1d-55e8-4d3f-b045-44f67f397741] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:52:12.158855 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-20bd7291-b1c3-4277-870b-711ecd560e3e tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:12.163133 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-20bd7291-b1c3-4277-870b-711ecd560e3e tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:12.163964 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-20bd7291-b1c3-4277-870b-711ecd560e3e tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:12.165102 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-20bd7291-b1c3-4277-870b-711ecd560e3e tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:12.166086 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-20bd7291-b1c3-4277-870b-711ecd560e3e tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:12.168182 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-20bd7291-b1c3-4277-870b-711ecd560e3e tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:12.233450 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.wsgi [None req-20bd7291-b1c3-4277-870b-711ecd560e3e tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] HTTP exception thrown: Instance 6da11c1d-55e8-4d3f-b045-44f67f397741 could not be found. Oct 22 20:52:12.243801 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-20bd7291-b1c3-4277-870b-711ecd560e3e tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Request method failure captured: Oct 22 20:52:12.243801 ncdv-master-1 devstack@n-api.service[138745]: request: GET /compute/v2.1/servers/6da11c1d-55e8-4d3f-b045-44f67f397741 HTTP/1.1 Oct 22 20:52:12.243801 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 20:52:12.243801 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 20:52:12.243801 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 20:52:12.243801 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 0 Oct 22 20:52:12.243801 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 20:52:12.243801 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 20:52:12.243801 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 20:52:12.243801 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 20:52:12.243801 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVFfN0gXQAZdpYVF_oFm9V2m2AgQLuq7vVRb-lc7wAfd1YL8EKMbcjgbpFvhfOzKRj3CD-oa_Ed1jlkF5s7rppEjDsBiW5FGkjaAXkMQ4dTmLHawcAQuKOrA9ggrVfLUAQJodjJiglUW61T4HGqvDrJZVRX7CKSlbTy0fy9Bz0bxHfZM Oct 22 20:52:12.243801 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 20:52:12.243801 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 20:52:12.243801 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 20:52:12.243801 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 20:52:12.243801 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 20:52:12.243801 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 20:52:12.243801 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: 950a163a28d64f41855e56cf88e3b1d9 Oct 22 20:52:12.243801 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-275249309 Oct 22 20:52:12.243801 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 20:52:12.243801 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 20:52:12.243801 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_950a163a28d64f41855e56cf88e3b1d9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/950a163a28d64f41855e56cf88e3b1d9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/950a163a28d64f41855e56cf88e3b1d9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/950a163a28d64f41855e56cf88e3b1d9"}]}] Oct 22 20:52:12.243801 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-ServersAdminNegativeTestJSON-275249309 Oct 22 20:52:12.243801 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: 950a163a28d64f41855e56cf88e3b1d9 Oct 22 20:52:12.243801 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-275249309 Oct 22 20:52:12.243801 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-ServersAdminNegativeTestJSON-275249309-project Oct 22 20:52:12.243801 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 20:52:12.243801 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 20:52:12.243801 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: 084d99ccb7dc405f85b1d31cfd255e72 Oct 22 20:52:12.243801 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-ServersAdminNegativeTestJSON-275249309-project Oct 22 20:52:12.243801 ncdv-master-1 devstack@n-api.service[138745]: method: > Oct 22 20:52:12.243801 ncdv-master-1 devstack@n-api.service[138745]: exception: Instance 6da11c1d-55e8-4d3f-b045-44f67f397741 could not be found. Oct 22 20:52:12.243801 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'id': '6da11c1d-55e8-4d3f-b045-44f67f397741'} Oct 22 20:52:12.243801 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:52:12.243801 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:52:12.243801 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 20:52:12.243801 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 20:52:12.243801 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 20:52:12.243801 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 20:52:12.243801 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 20:52:12.243801 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 20:52:12.243801 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 20:52:12.243801 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 20:52:12.243801 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6da11c1d-55e8-4d3f-b045-44f67f397741 could not be found. Oct 22 20:52:12.243801 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:52:12.243801 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:52:12.243801 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:52:12.243801 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:52:12.243801 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:52:12.243801 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:52:12.243801 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:52:12.243801 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:52:12.243801 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:52:12.243801 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:52:12.243801 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 20:52:12.243801 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 20:52:12.243801 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 20:52:12.243801 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 20:52:12.243801 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 20:52:12.243801 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 20:52:12.243801 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6da11c1d-55e8-4d3f-b045-44f67f397741 could not be found. Oct 22 20:52:12.243801 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:52:12.243801 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:52:12.247833 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:52:12.247833 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:52:12.247833 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:52:12.247833 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:52:12.247833 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 20:52:12.247833 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 20:52:12.247833 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6da11c1d-55e8-4d3f-b045-44f67f397741 could not be found. Oct 22 20:52:12.247833 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:52:12.250553 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-20bd7291-b1c3-4277-870b-711ecd560e3e tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] Returning 404 to user: Instance 6da11c1d-55e8-4d3f-b045-44f67f397741 could not be found. {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:52:12.252367 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-20bd7291-b1c3-4277-870b-711ecd560e3e tempest-ServersAdminNegativeTestJSON-275249309 tempest-ServersAdminNegativeTestJSON-275249309-project] 10.222.0.18 "GET /compute/v2.1/servers/6da11c1d-55e8-4d3f-b045-44f67f397741" status: 404 len: 111 microversion: 2.1 time: 0.113238 Oct 22 20:52:12.260124 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 484/912] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:52:12 2022] GET /compute/v2.1/servers/6da11c1d-55e8-4d3f-b045-44f67f397741 => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 22 20:52:12.345667 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-77815a41-13ae-47ae-8857-86c2561d0199 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:52:12.346686 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-77815a41-13ae-47ae-8857-86c2561d0199 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] [instance: ea383564-25ff-4e81-9301-c8bcb13988c7] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:52:12.357826 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-77815a41-13ae-47ae-8857-86c2561d0199 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:12.358566 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-77815a41-13ae-47ae-8857-86c2561d0199 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:12.366359 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-77815a41-13ae-47ae-8857-86c2561d0199 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:12.367726 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-77815a41-13ae-47ae-8857-86c2561d0199 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:12.373474 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-77815a41-13ae-47ae-8857-86c2561d0199 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:12.375920 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-77815a41-13ae-47ae-8857-86c2561d0199 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:12.431420 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-f93a1b4f-8228-4ad1-96a5-a6e2f3964e05 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c87f0356ca346f39c6216393d85da2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee8c8f7fc4e12bc1f9fcce3e7b581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:52:12.477616 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-f93a1b4f-8228-4ad1-96a5-a6e2f3964e05 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] 10.222.0.18 "GET /compute/v2.1/servers/2f02a0ad-4856-4643-9e69-50547f5c7a98" status: 200 len: 1478 microversion: 2.1 time: 0.996562 Oct 22 20:52:12.531448 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 429/913] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:52:11 2022] GET /compute/v2.1/servers/2f02a0ad-4856-4643-9e69-50547f5c7a98 => generated 1478 bytes in 1061 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:52:12.551042 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-9a0b2f9e-0db0-4821-956e-d5888b4fd3c5 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:52:12.557838 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-9a0b2f9e-0db0-4821-956e-d5888b4fd3c5 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] [instance: fa364234-023c-491a-bc88-97c048f6f0e2] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:52:12.571373 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9a0b2f9e-0db0-4821-956e-d5888b4fd3c5 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:12.572095 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9a0b2f9e-0db0-4821-956e-d5888b4fd3c5 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:12.572813 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9a0b2f9e-0db0-4821-956e-d5888b4fd3c5 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:12.573689 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9a0b2f9e-0db0-4821-956e-d5888b4fd3c5 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:12.574444 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9a0b2f9e-0db0-4821-956e-d5888b4fd3c5 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:12.575789 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9a0b2f9e-0db0-4821-956e-d5888b4fd3c5 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:12.677641 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell0:SELECT=2 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:52:13.000078 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell0:SELECT=8 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:52:13.359770 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-77815a41-13ae-47ae-8857-86c2561d0199 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91cf84a287b74618ae1b3368785b0b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902e239d67664098895ab24340b0b780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:52:13.380868 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-77815a41-13ae-47ae-8857-86c2561d0199 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] 10.222.0.18 "GET /compute/v2.1/servers/ea383564-25ff-4e81-9301-c8bcb13988c7" status: 200 len: 1317 microversion: 2.1 time: 1.038255 Oct 22 20:52:13.382510 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 485/914] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:52:12 2022] GET /compute/v2.1/servers/ea383564-25ff-4e81-9301-c8bcb13988c7 => generated 1317 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 20:52:13.388799 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-833ac1db-1cc4-4c53-9527-0cbad8b3be6b tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] Calling method '.version_select at 0x7fd3a42e5940>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:52:13.396840 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-833ac1db-1cc4-4c53-9527-0cbad8b3be6b tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:13.398854 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-833ac1db-1cc4-4c53-9527-0cbad8b3be6b tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:13.400614 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-833ac1db-1cc4-4c53-9527-0cbad8b3be6b tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:13.428486 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-833ac1db-1cc4-4c53-9527-0cbad8b3be6b tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] 10.222.0.18 "GET /compute/v2.1/os-migrations" status: 200 len: 1552 microversion: 2.1 time: 0.043819 Oct 22 20:52:13.431686 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 486/915] 10.222.0.18 () {58 vars in 1143 bytes} [Sat Oct 22 20:52:13 2022] GET /compute/v2.1/os-migrations => generated 1552 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:52:13.450350 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-a934db28-d8e3-465b-a32b-59f9590fe783 req-277079dd-2a4c-485c-939a-b99074952de7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea383564-25ff-4e81-9301-c8bcb13988c7", "tag": "c6526ab3-0f3c-4934-a5e0-0cf443f467c7"}, {"server_uuid": "4c53f81e-f4d8-4b41-b03a-ba9acb867226", "name": "network-vif-deleted", "tag": "94e91c18-1bda-4ad5-9d8b-805c0859ebdd"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:52:13.484376 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-a934db28-d8e3-465b-a32b-59f9590fe783 req-277079dd-2a4c-485c-939a-b99074952de7 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:13.484993 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-a934db28-d8e3-465b-a32b-59f9590fe783 req-277079dd-2a4c-485c-939a-b99074952de7 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:13.485627 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-a934db28-d8e3-465b-a32b-59f9590fe783 req-277079dd-2a4c-485c-939a-b99074952de7 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:13.506108 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-a934db28-d8e3-465b-a32b-59f9590fe783 req-277079dd-2a4c-485c-939a-b99074952de7 service nova] Creating event network-changed:c6526ab3-0f3c-4934-a5e0-0cf443f467c7 for instance ea383564-25ff-4e81-9301-c8bcb13988c7 on nch2-master-1 Oct 22 20:52:13.506944 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-a934db28-d8e3-465b-a32b-59f9590fe783 req-277079dd-2a4c-485c-939a-b99074952de7 service nova] Creating event network-vif-deleted:94e91c18-1bda-4ad5-9d8b-805c0859ebdd for instance 4c53f81e-f4d8-4b41-b03a-ba9acb867226 on nch1-master-1 Oct 22 20:52:13.509837 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-9a0b2f9e-0db0-4821-956e-d5888b4fd3c5 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9bba9ed37d7430e82e7d310982b8e47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30dbbdc150694e0ebc07c63e90280d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:52:13.521216 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-a934db28-d8e3-465b-a32b-59f9590fe783 req-277079dd-2a4c-485c-939a-b99074952de7 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.086759 Oct 22 20:52:13.521423 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-9a0b2f9e-0db0-4821-956e-d5888b4fd3c5 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] 10.222.0.18 "GET /compute/v2.1/servers/fa364234-023c-491a-bc88-97c048f6f0e2" status: 200 len: 1389 microversion: 2.1 time: 0.983783 Oct 22 20:52:13.521851 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 430/916] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:52:12 2022] GET /compute/v2.1/servers/fa364234-023c-491a-bc88-97c048f6f0e2 => generated 1389 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:52:13.522631 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 487/917] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:52:13 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:52:13.543178 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-73a017b0-9bde-4cc9-ba86-53fc5cf8f037 tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:52:13.545262 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-73a017b0-9bde-4cc9-ba86-53fc5cf8f037 tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] [instance: 2f02a0ad-4856-4643-9e69-50547f5c7a98] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:52:13.564503 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-73a017b0-9bde-4cc9-ba86-53fc5cf8f037 tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:13.565619 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-73a017b0-9bde-4cc9-ba86-53fc5cf8f037 tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:13.566339 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-73a017b0-9bde-4cc9-ba86-53fc5cf8f037 tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:13.567761 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-73a017b0-9bde-4cc9-ba86-53fc5cf8f037 tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:13.576394 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-73a017b0-9bde-4cc9-ba86-53fc5cf8f037 tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:13.577164 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-73a017b0-9bde-4cc9-ba86-53fc5cf8f037 tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:14.167147 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-73a017b0-9bde-4cc9-ba86-53fc5cf8f037 tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/2f02a0ad-4856-4643-9e69-50547f5c7a98" status: 200 len: 1629 microversion: 2.1 time: 0.642929 Oct 22 20:52:14.168333 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 431/918] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:52:13 2022] GET /compute/v2.1/servers/2f02a0ad-4856-4643-9e69-50547f5c7a98 => generated 1629 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:52:14.204987 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-fbe62d54-43d7-4c3e-82e3-fe96fbbd746f tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Action: 'create', calling method: .version_select at 0x7fd3a429f670>, body: {"keypair": {"name": "tempest-keypair-319074667", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBJ568aiFPbxF/j7uTKGmXc36p8O6zPh7bKnlwrZrch9xCZ03MO6Tg9GA6r1PO1PJVD5MFauS/doItgW51PiLGQMBix+64SoKoAf9Z9gUgoHVAq5emjVB6Nksg09It1FhA=="}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:52:14.265712 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-fbe62d54-43d7-4c3e-82e3-fe96fbbd746f tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Getting quotas for project 9f0ee8c8f7fc4e12bc1f9fcce3e7b581. Resources: {'key_pairs'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 20:52:14.278069 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-fbe62d54-43d7-4c3e-82e3-fe96fbbd746f tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Getting quotas for user 2c87f0356ca346f39c6216393d85da2f and project 9f0ee8c8f7fc4e12bc1f9fcce3e7b581. Resources: {'key_pairs'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 20:52:14.356786 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-fbe62d54-43d7-4c3e-82e3-fe96fbbd746f tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.157219 Oct 22 20:52:14.358243 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 488/919] 10.222.0.18 () {60 vars in 1159 bytes} [Sat Oct 22 20:52:14 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:52:14.419283 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-550f63dd-ea0a-4526-b04f-6efeccbe4ba6 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:52:14.422060 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-550f63dd-ea0a-4526-b04f-6efeccbe4ba6 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] [instance: ea383564-25ff-4e81-9301-c8bcb13988c7] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:52:14.467656 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-550f63dd-ea0a-4526-b04f-6efeccbe4ba6 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:14.469438 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-550f63dd-ea0a-4526-b04f-6efeccbe4ba6 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:14.470212 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-550f63dd-ea0a-4526-b04f-6efeccbe4ba6 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:14.472521 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-550f63dd-ea0a-4526-b04f-6efeccbe4ba6 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:14.473640 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-550f63dd-ea0a-4526-b04f-6efeccbe4ba6 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:14.474359 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-550f63dd-ea0a-4526-b04f-6efeccbe4ba6 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:14.544980 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-1a29e997-deeb-4604-a4ba-e49b458b5bbc tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:52:14.545729 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-1a29e997-deeb-4604-a4ba-e49b458b5bbc tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] [instance: fa364234-023c-491a-bc88-97c048f6f0e2] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:52:14.558643 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1a29e997-deeb-4604-a4ba-e49b458b5bbc tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:14.559143 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1a29e997-deeb-4604-a4ba-e49b458b5bbc tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:14.561789 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1a29e997-deeb-4604-a4ba-e49b458b5bbc tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:14.562546 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1a29e997-deeb-4604-a4ba-e49b458b5bbc tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:14.563192 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1a29e997-deeb-4604-a4ba-e49b458b5bbc tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:14.566157 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1a29e997-deeb-4604-a4ba-e49b458b5bbc tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:14.989639 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-550f63dd-ea0a-4526-b04f-6efeccbe4ba6 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91cf84a287b74618ae1b3368785b0b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902e239d67664098895ab24340b0b780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:52:15.012327 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-550f63dd-ea0a-4526-b04f-6efeccbe4ba6 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] 10.222.0.18 "GET /compute/v2.1/servers/ea383564-25ff-4e81-9301-c8bcb13988c7" status: 200 len: 1317 microversion: 2.1 time: 0.610004 Oct 22 20:52:15.013920 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 432/920] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:52:14 2022] GET /compute/v2.1/servers/ea383564-25ff-4e81-9301-c8bcb13988c7 => generated 1317 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:52:15.020938 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-79fe7311-e09d-41c3-a279-275a44a99c0c req-bd3b424a-ce67-436e-8a1a-49e5f24f61c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa364234-023c-491a-bc88-97c048f6f0e2", "tag": "609bc1c1-807a-4ef4-bd5c-8679553bab8c"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:52:15.039737 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-79fe7311-e09d-41c3-a279-275a44a99c0c req-bd3b424a-ce67-436e-8a1a-49e5f24f61c4 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:15.041002 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-79fe7311-e09d-41c3-a279-275a44a99c0c req-bd3b424a-ce67-436e-8a1a-49e5f24f61c4 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:15.041646 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-79fe7311-e09d-41c3-a279-275a44a99c0c req-bd3b424a-ce67-436e-8a1a-49e5f24f61c4 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:15.063899 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-79fe7311-e09d-41c3-a279-275a44a99c0c req-bd3b424a-ce67-436e-8a1a-49e5f24f61c4 service nova] Creating event network-changed:609bc1c1-807a-4ef4-bd5c-8679553bab8c for instance fa364234-023c-491a-bc88-97c048f6f0e2 on nch2-master-1 Oct 22 20:52:15.072382 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-79fe7311-e09d-41c3-a279-275a44a99c0c req-bd3b424a-ce67-436e-8a1a-49e5f24f61c4 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056760 Oct 22 20:52:15.074207 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 433/921] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:52:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:52:15.104000 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-1a29e997-deeb-4604-a4ba-e49b458b5bbc tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9bba9ed37d7430e82e7d310982b8e47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30dbbdc150694e0ebc07c63e90280d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:52:15.143643 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-1a29e997-deeb-4604-a4ba-e49b458b5bbc tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] 10.222.0.18 "GET /compute/v2.1/servers/fa364234-023c-491a-bc88-97c048f6f0e2" status: 200 len: 1389 microversion: 2.1 time: 0.600587 Oct 22 20:52:15.148482 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 489/922] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:52:14 2022] GET /compute/v2.1/servers/fa364234-023c-491a-bc88-97c048f6f0e2 => generated 1389 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 20:52:16.038537 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-499ae640-3477-4250-9f47-ad62006c25b1 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:52:16.040580 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-499ae640-3477-4250-9f47-ad62006c25b1 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] [instance: ea383564-25ff-4e81-9301-c8bcb13988c7] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:52:16.055562 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-499ae640-3477-4250-9f47-ad62006c25b1 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:16.056555 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-499ae640-3477-4250-9f47-ad62006c25b1 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:16.057394 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-499ae640-3477-4250-9f47-ad62006c25b1 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:16.058731 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-499ae640-3477-4250-9f47-ad62006c25b1 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:16.059518 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-499ae640-3477-4250-9f47-ad62006c25b1 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:16.060463 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-499ae640-3477-4250-9f47-ad62006c25b1 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:16.187204 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-a710ba37-36c1-4917-9dd3-e1c2a10d89b5 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:52:16.190104 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-a710ba37-36c1-4917-9dd3-e1c2a10d89b5 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] [instance: fa364234-023c-491a-bc88-97c048f6f0e2] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:52:16.210027 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a710ba37-36c1-4917-9dd3-e1c2a10d89b5 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:16.210446 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a710ba37-36c1-4917-9dd3-e1c2a10d89b5 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:16.211114 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a710ba37-36c1-4917-9dd3-e1c2a10d89b5 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:16.211702 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a710ba37-36c1-4917-9dd3-e1c2a10d89b5 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:16.224141 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a710ba37-36c1-4917-9dd3-e1c2a10d89b5 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:16.224600 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a710ba37-36c1-4917-9dd3-e1c2a10d89b5 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:16.510308 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-499ae640-3477-4250-9f47-ad62006c25b1 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91cf84a287b74618ae1b3368785b0b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902e239d67664098895ab24340b0b780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:52:16.519368 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-499ae640-3477-4250-9f47-ad62006c25b1 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] 10.222.0.18 "GET /compute/v2.1/servers/ea383564-25ff-4e81-9301-c8bcb13988c7" status: 200 len: 1317 microversion: 2.1 time: 0.485834 Oct 22 20:52:16.520198 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 434/923] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:52:16 2022] GET /compute/v2.1/servers/ea383564-25ff-4e81-9301-c8bcb13988c7 => generated 1317 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:52:16.574899 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-a710ba37-36c1-4917-9dd3-e1c2a10d89b5 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9bba9ed37d7430e82e7d310982b8e47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30dbbdc150694e0ebc07c63e90280d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:52:16.585048 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-a710ba37-36c1-4917-9dd3-e1c2a10d89b5 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] 10.222.0.18 "GET /compute/v2.1/servers/fa364234-023c-491a-bc88-97c048f6f0e2" status: 200 len: 1389 microversion: 2.1 time: 0.415997 Oct 22 20:52:16.585661 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 490/924] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:52:16 2022] GET /compute/v2.1/servers/fa364234-023c-491a-bc88-97c048f6f0e2 => generated 1389 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:52:16.790110 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-50c045be-a14f-40f3-b0b9-bfeef663e8ed tempest-ImagesMetadataNegativeTestJSON-1842193541 tempest-ImagesMetadataNegativeTestJSON-1842193541-project] Calling method '.version_select at 0x7fd3a4051430>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:52:16.824108 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-50c045be-a14f-40f3-b0b9-bfeef663e8ed tempest-ImagesMetadataNegativeTestJSON-1842193541 tempest-ImagesMetadataNegativeTestJSON-1842193541-project] HTTP exception thrown: Image not found. Oct 22 20:52:16.862582 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-50c045be-a14f-40f3-b0b9-bfeef663e8ed tempest-ImagesMetadataNegativeTestJSON-1842193541 tempest-ImagesMetadataNegativeTestJSON-1842193541-project] Request method failure captured: Oct 22 20:52:16.862582 ncdv-master-1 devstack@n-api.service[138744]: request: DELETE /compute/v2.1/images/e9cee98f-f15c-4770-a413-9b1ca554e23c/metadata/os_distro HTTP/1.1 Oct 22 20:52:16.862582 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 20:52:16.862582 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 20:52:16.862582 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 20:52:16.862582 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 0 Oct 22 20:52:16.862582 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 20:52:16.862582 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 20:52:16.862582 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 20:52:16.862582 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 20:52:16.862582 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVFgAG_M7X-SbPCk1l9d4RyZS-kEPvU5u1o9eJtsmQ3YdkQ0-MoXUoBc1rXGxI9427s8mmGQHzHdRsLNGfXYK4_kjAmEEac17XAQxxFcEbAJERYriwQKUywoKofVoHeq5JuEVBHsm5UvdUgKs-d8dx7lDmjXy_HEt0SVjHBoeSP3k3pI Oct 22 20:52:16.862582 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 20:52:16.862582 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 20:52:16.862582 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 20:52:16.862582 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 20:52:16.862582 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 20:52:16.862582 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 20:52:16.862582 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: 92ef66123ccd4e8eb302f4c70a582740 Oct 22 20:52:16.862582 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1842193541 Oct 22 20:52:16.862582 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 20:52:16.862582 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 20:52:16.862582 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_92ef66123ccd4e8eb302f4c70a582740"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/92ef66123ccd4e8eb302f4c70a582740"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/92ef66123ccd4e8eb302f4c70a582740"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/92ef66123ccd4e8eb302f4c70a582740"}]}] Oct 22 20:52:16.862582 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1842193541 Oct 22 20:52:16.862582 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: 92ef66123ccd4e8eb302f4c70a582740 Oct 22 20:52:16.862582 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1842193541 Oct 22 20:52:16.862582 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-ImagesMetadataNegativeTestJSON-1842193541-project Oct 22 20:52:16.862582 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 20:52:16.862582 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 20:52:16.862582 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: 4c8071da60e7494bbb369df1a5eb53a9 Oct 22 20:52:16.862582 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1842193541-project Oct 22 20:52:16.862582 ncdv-master-1 devstack@n-api.service[138744]: method: Oct 22 20:52:16.862582 ncdv-master-1 devstack@n-api.service[138744]: exception: Image not found. Oct 22 20:52:16.862582 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'image_id': 'e9cee98f-f15c-4770-a413-9b1ca554e23c', 'id': 'os_distro'} Oct 22 20:52:16.862582 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:52:16.862582 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:52:16.862582 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 22 20:52:16.862582 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 22 20:52:16.862582 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 22 20:52:16.862582 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 22 20:52:16.862582 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 22 20:52:16.862582 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 22 20:52:16.862582 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 22 20:52:16.862582 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 22 20:52:16.862582 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 22 20:52:16.862582 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 22 20:52:16.862582 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 22 20:52:16.862582 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 22 20:52:16.862582 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 22 20:52:16.862582 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 22 20:52:16.862582 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 22 20:52:16.862582 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 22 20:52:16.862582 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID e9cee98f-f15c-4770-a413-9b1ca554e23c Oct 22 20:52:16.862582 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:52:16.862582 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:52:16.862582 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:52:16.862582 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:52:16.862582 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 22 20:52:16.862582 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 22 20:52:16.862582 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 22 20:52:16.862582 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 22 20:52:16.862582 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 22 20:52:16.862582 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 22 20:52:16.868301 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 22 20:52:16.868301 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 22 20:52:16.868301 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 22 20:52:16.868301 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 22 20:52:16.868301 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 22 20:52:16.868301 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 22 20:52:16.868301 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 22 20:52:16.868301 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 22 20:52:16.868301 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 22 20:52:16.868301 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 22 20:52:16.868301 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 22 20:52:16.868301 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 22 20:52:16.868301 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 22 20:52:16.868301 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 22 20:52:16.868301 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 22 20:52:16.868301 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 22 20:52:16.868301 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 22 20:52:16.868301 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 22 20:52:16.868301 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image e9cee98f-f15c-4770-a413-9b1ca554e23c could not be found. Oct 22 20:52:16.868301 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:52:16.868301 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:52:16.868301 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:52:16.868301 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:52:16.868301 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:52:16.868301 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:52:16.868301 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:52:16.868301 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:52:16.868301 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 22 20:52:16.868301 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 22 20:52:16.868301 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:52:16.868301 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:52:16.868301 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 125, in delete Oct 22 20:52:16.868301 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 22 20:52:16.868301 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 22 20:52:16.868301 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 22 20:52:16.868301 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 22 20:52:16.868301 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:52:16.868301 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:52:16.868301 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:52:16.868301 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:52:16.868301 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:52:16.868301 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:52:16.868301 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 20:52:16.868301 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 20:52:16.868301 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 22 20:52:16.868301 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:52:16.875692 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-50c045be-a14f-40f3-b0b9-bfeef663e8ed tempest-ImagesMetadataNegativeTestJSON-1842193541 tempest-ImagesMetadataNegativeTestJSON-1842193541-project] Returning 404 to user: Image not found. {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:52:16.876823 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-50c045be-a14f-40f3-b0b9-bfeef663e8ed tempest-ImagesMetadataNegativeTestJSON-1842193541 tempest-ImagesMetadataNegativeTestJSON-1842193541-project] 10.222.0.18 "DELETE /compute/v2.1/images/e9cee98f-f15c-4770-a413-9b1ca554e23c/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.355464 Oct 22 20:52:16.877805 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 435/925] 10.222.0.18 () {58 vars in 1293 bytes} [Sat Oct 22 20:52:16 2022] DELETE /compute/v2.1/images/e9cee98f-f15c-4770-a413-9b1ca554e23c/metadata/os_distro => generated 62 bytes in 357 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 22 20:52:16.888936 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-d1ea3886-ede7-4ad7-aca7-26cdb3e93bcc tempest-ImagesMetadataNegativeTestJSON-1842193541 tempest-ImagesMetadataNegativeTestJSON-1842193541-project] Calling method '.version_select at 0x7fd3a4464a60>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:52:16.919912 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.wsgi [None req-d1ea3886-ede7-4ad7-aca7-26cdb3e93bcc tempest-ImagesMetadataNegativeTestJSON-1842193541 tempest-ImagesMetadataNegativeTestJSON-1842193541-project] HTTP exception thrown: Image not found. Oct 22 20:52:16.924488 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-d1ea3886-ede7-4ad7-aca7-26cdb3e93bcc tempest-ImagesMetadataNegativeTestJSON-1842193541 tempest-ImagesMetadataNegativeTestJSON-1842193541-project] Request method failure captured: Oct 22 20:52:16.924488 ncdv-master-1 devstack@n-api.service[138745]: request: GET /compute/v2.1/images/35e01864-5c47-46a4-a97d-bb74deb1cb64/metadata/os_version HTTP/1.1 Oct 22 20:52:16.924488 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 20:52:16.924488 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 20:52:16.924488 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 20:52:16.924488 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 0 Oct 22 20:52:16.924488 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 20:52:16.924488 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 20:52:16.924488 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 20:52:16.924488 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 20:52:16.924488 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVFgAG_M7X-SbPCk1l9d4RyZS-kEPvU5u1o9eJtsmQ3YdkQ0-MoXUoBc1rXGxI9427s8mmGQHzHdRsLNGfXYK4_kjAmEEac17XAQxxFcEbAJERYriwQKUywoKofVoHeq5JuEVBHsm5UvdUgKs-d8dx7lDmjXy_HEt0SVjHBoeSP3k3pI Oct 22 20:52:16.924488 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 20:52:16.924488 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 20:52:16.924488 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 20:52:16.924488 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 20:52:16.924488 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 20:52:16.924488 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 20:52:16.924488 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: 92ef66123ccd4e8eb302f4c70a582740 Oct 22 20:52:16.924488 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1842193541 Oct 22 20:52:16.924488 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 20:52:16.924488 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 20:52:16.924488 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_92ef66123ccd4e8eb302f4c70a582740"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/92ef66123ccd4e8eb302f4c70a582740"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/92ef66123ccd4e8eb302f4c70a582740"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/92ef66123ccd4e8eb302f4c70a582740"}]}] Oct 22 20:52:16.924488 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1842193541 Oct 22 20:52:16.924488 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: 92ef66123ccd4e8eb302f4c70a582740 Oct 22 20:52:16.924488 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1842193541 Oct 22 20:52:16.924488 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-ImagesMetadataNegativeTestJSON-1842193541-project Oct 22 20:52:16.924488 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 20:52:16.924488 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 20:52:16.924488 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: 4c8071da60e7494bbb369df1a5eb53a9 Oct 22 20:52:16.924488 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1842193541-project Oct 22 20:52:16.924488 ncdv-master-1 devstack@n-api.service[138745]: method: Oct 22 20:52:16.924488 ncdv-master-1 devstack@n-api.service[138745]: exception: Image not found. Oct 22 20:52:16.924488 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'image_id': '35e01864-5c47-46a4-a97d-bb74deb1cb64', 'id': 'os_version'} Oct 22 20:52:16.924488 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:52:16.924488 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:52:16.924488 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 22 20:52:16.924488 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 22 20:52:16.924488 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 22 20:52:16.924488 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 22 20:52:16.924488 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 22 20:52:16.924488 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 22 20:52:16.924488 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 22 20:52:16.924488 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 22 20:52:16.924488 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 22 20:52:16.924488 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 22 20:52:16.924488 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 22 20:52:16.924488 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 22 20:52:16.924488 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 22 20:52:16.924488 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 22 20:52:16.924488 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 22 20:52:16.924488 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 22 20:52:16.924488 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 35e01864-5c47-46a4-a97d-bb74deb1cb64 Oct 22 20:52:16.924488 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:52:16.924488 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:52:16.924488 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:52:16.924488 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:52:16.924488 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 22 20:52:16.924488 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 22 20:52:16.924488 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 22 20:52:16.924488 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 22 20:52:16.924488 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 22 20:52:16.924488 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 22 20:52:16.928562 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 22 20:52:16.928562 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 22 20:52:16.928562 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 22 20:52:16.928562 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 22 20:52:16.928562 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 22 20:52:16.928562 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 22 20:52:16.928562 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 22 20:52:16.928562 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 22 20:52:16.928562 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 22 20:52:16.928562 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 22 20:52:16.928562 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 22 20:52:16.928562 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 22 20:52:16.928562 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 22 20:52:16.928562 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 22 20:52:16.928562 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 22 20:52:16.928562 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 22 20:52:16.928562 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 22 20:52:16.928562 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 22 20:52:16.928562 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 35e01864-5c47-46a4-a97d-bb74deb1cb64 could not be found. Oct 22 20:52:16.928562 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:52:16.928562 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:52:16.928562 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:52:16.928562 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:52:16.928562 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:52:16.928562 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:52:16.928562 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:52:16.928562 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:52:16.928562 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 22 20:52:16.928562 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 22 20:52:16.928562 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:52:16.928562 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:52:16.928562 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 58, in show Oct 22 20:52:16.928562 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Oct 22 20:52:16.928562 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 22 20:52:16.928562 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 22 20:52:16.928562 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 22 20:52:16.928562 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:52:16.928562 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:52:16.928562 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:52:16.928562 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:52:16.928562 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:52:16.928562 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:52:16.928562 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 20:52:16.928562 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 20:52:16.928562 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 22 20:52:16.928562 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:52:16.934260 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-d1ea3886-ede7-4ad7-aca7-26cdb3e93bcc tempest-ImagesMetadataNegativeTestJSON-1842193541 tempest-ImagesMetadataNegativeTestJSON-1842193541-project] Returning 404 to user: Image not found. {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:52:16.935413 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-d1ea3886-ede7-4ad7-aca7-26cdb3e93bcc tempest-ImagesMetadataNegativeTestJSON-1842193541 tempest-ImagesMetadataNegativeTestJSON-1842193541-project] 10.222.0.18 "GET /compute/v2.1/images/35e01864-5c47-46a4-a97d-bb74deb1cb64/metadata/os_version" status: 404 len: 62 microversion: 2.1 time: 0.051645 Oct 22 20:52:16.936496 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 491/926] 10.222.0.18 () {58 vars in 1293 bytes} [Sat Oct 22 20:52:16 2022] GET /compute/v2.1/images/35e01864-5c47-46a4-a97d-bb74deb1cb64/metadata/os_version => generated 62 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 22 20:52:16.945656 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell0:SELECT=2 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:52:16.951264 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-3e3e4044-c6f1-45fd-882a-5b7f42cae5df tempest-ImagesMetadataNegativeTestJSON-1842193541 tempest-ImagesMetadataNegativeTestJSON-1842193541-project] Calling method '.version_select at 0x7fd3a40e0430>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:52:16.979061 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-3e3e4044-c6f1-45fd-882a-5b7f42cae5df tempest-ImagesMetadataNegativeTestJSON-1842193541 tempest-ImagesMetadataNegativeTestJSON-1842193541-project] HTTP exception thrown: Image not found. Oct 22 20:52:16.981253 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-3e3e4044-c6f1-45fd-882a-5b7f42cae5df tempest-ImagesMetadataNegativeTestJSON-1842193541 tempest-ImagesMetadataNegativeTestJSON-1842193541-project] Request method failure captured: Oct 22 20:52:16.981253 ncdv-master-1 devstack@n-api.service[138744]: request: GET /compute/v2.1/images/aea3cca0-ebdc-455f-ba88-306f609b1f94/metadata HTTP/1.1 Oct 22 20:52:16.981253 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 20:52:16.981253 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 20:52:16.981253 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 20:52:16.981253 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 0 Oct 22 20:52:16.981253 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 20:52:16.981253 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 20:52:16.981253 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 20:52:16.981253 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 20:52:16.981253 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVFgAG_M7X-SbPCk1l9d4RyZS-kEPvU5u1o9eJtsmQ3YdkQ0-MoXUoBc1rXGxI9427s8mmGQHzHdRsLNGfXYK4_kjAmEEac17XAQxxFcEbAJERYriwQKUywoKofVoHeq5JuEVBHsm5UvdUgKs-d8dx7lDmjXy_HEt0SVjHBoeSP3k3pI Oct 22 20:52:16.981253 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 20:52:16.981253 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 20:52:16.981253 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 20:52:16.981253 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 20:52:16.981253 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 20:52:16.981253 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 20:52:16.981253 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: 92ef66123ccd4e8eb302f4c70a582740 Oct 22 20:52:16.981253 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1842193541 Oct 22 20:52:16.981253 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 20:52:16.981253 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 20:52:16.981253 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_92ef66123ccd4e8eb302f4c70a582740"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/92ef66123ccd4e8eb302f4c70a582740"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/92ef66123ccd4e8eb302f4c70a582740"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/92ef66123ccd4e8eb302f4c70a582740"}]}] Oct 22 20:52:16.981253 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1842193541 Oct 22 20:52:16.981253 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: 92ef66123ccd4e8eb302f4c70a582740 Oct 22 20:52:16.981253 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1842193541 Oct 22 20:52:16.981253 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-ImagesMetadataNegativeTestJSON-1842193541-project Oct 22 20:52:16.981253 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 20:52:16.981253 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 20:52:16.981253 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: 4c8071da60e7494bbb369df1a5eb53a9 Oct 22 20:52:16.981253 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1842193541-project Oct 22 20:52:16.981253 ncdv-master-1 devstack@n-api.service[138744]: method: Oct 22 20:52:16.981253 ncdv-master-1 devstack@n-api.service[138744]: exception: Image not found. Oct 22 20:52:16.981253 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'image_id': 'aea3cca0-ebdc-455f-ba88-306f609b1f94'} Oct 22 20:52:16.981253 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:52:16.981253 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:52:16.981253 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 22 20:52:16.981253 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 22 20:52:16.981253 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 22 20:52:16.981253 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 22 20:52:16.981253 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 22 20:52:16.981253 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 22 20:52:16.981253 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 22 20:52:16.981253 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 22 20:52:16.981253 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 22 20:52:16.981253 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 22 20:52:16.981253 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 22 20:52:16.981253 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 22 20:52:16.981253 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 22 20:52:16.981253 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 22 20:52:16.981253 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 22 20:52:16.981253 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 22 20:52:16.981253 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID aea3cca0-ebdc-455f-ba88-306f609b1f94 Oct 22 20:52:16.981253 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:52:16.981253 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:52:16.981253 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:52:16.981253 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:52:16.981253 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 22 20:52:16.981253 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 22 20:52:16.981253 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 22 20:52:16.981253 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 22 20:52:16.981253 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 22 20:52:16.981253 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 22 20:52:16.986500 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 22 20:52:16.986500 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 22 20:52:16.986500 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 22 20:52:16.986500 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 22 20:52:16.986500 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 22 20:52:16.986500 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 22 20:52:16.986500 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 22 20:52:16.986500 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 22 20:52:16.986500 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 22 20:52:16.986500 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 22 20:52:16.986500 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 22 20:52:16.986500 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 22 20:52:16.986500 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 22 20:52:16.986500 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 22 20:52:16.986500 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 22 20:52:16.986500 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 22 20:52:16.986500 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 22 20:52:16.986500 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 22 20:52:16.986500 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image aea3cca0-ebdc-455f-ba88-306f609b1f94 could not be found. Oct 22 20:52:16.986500 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:52:16.986500 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:52:16.986500 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:52:16.986500 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:52:16.986500 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:52:16.986500 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:52:16.986500 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:52:16.986500 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:52:16.986500 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 22 20:52:16.986500 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 22 20:52:16.986500 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:52:16.986500 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:52:16.986500 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 51, in index Oct 22 20:52:16.986500 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Oct 22 20:52:16.986500 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 22 20:52:16.986500 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 22 20:52:16.986500 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 22 20:52:16.986500 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:52:16.986500 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:52:16.986500 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:52:16.986500 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:52:16.986500 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:52:16.986500 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:52:16.986500 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 20:52:16.986500 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 20:52:16.986500 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 22 20:52:16.986500 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:52:16.986500 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-3e3e4044-c6f1-45fd-882a-5b7f42cae5df tempest-ImagesMetadataNegativeTestJSON-1842193541 tempest-ImagesMetadataNegativeTestJSON-1842193541-project] Returning 404 to user: Image not found. {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:52:16.986500 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-3e3e4044-c6f1-45fd-882a-5b7f42cae5df tempest-ImagesMetadataNegativeTestJSON-1842193541 tempest-ImagesMetadataNegativeTestJSON-1842193541-project] 10.222.0.18 "GET /compute/v2.1/images/aea3cca0-ebdc-455f-ba88-306f609b1f94/metadata" status: 404 len: 62 microversion: 2.1 time: 0.038186 Oct 22 20:52:16.986500 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 436/927] 10.222.0.18 () {58 vars in 1260 bytes} [Sat Oct 22 20:52:16 2022] GET /compute/v2.1/images/aea3cca0-ebdc-455f-ba88-306f609b1f94/metadata => generated 62 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 22 20:52:16.996300 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-6520ea42-a69d-4a54-bf6d-a640931c07b5 tempest-ImagesMetadataNegativeTestJSON-1842193541 tempest-ImagesMetadataNegativeTestJSON-1842193541-project] Action: 'update_all', calling method: .version_select at 0x7fd3a4464ee0>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:52:17.030219 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.wsgi [None req-6520ea42-a69d-4a54-bf6d-a640931c07b5 tempest-ImagesMetadataNegativeTestJSON-1842193541 tempest-ImagesMetadataNegativeTestJSON-1842193541-project] HTTP exception thrown: Image not found. Oct 22 20:52:17.032794 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-6520ea42-a69d-4a54-bf6d-a640931c07b5 tempest-ImagesMetadataNegativeTestJSON-1842193541 tempest-ImagesMetadataNegativeTestJSON-1842193541-project] Request method failure captured: Oct 22 20:52:17.032794 ncdv-master-1 devstack@n-api.service[138745]: request: PUT /compute/v2.1/images/07a8f4cc-75a2-4d0d-bc52-5b390ef1dc98/metadata HTTP/1.1 Oct 22 20:52:17.032794 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 20:52:17.032794 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 20:52:17.032794 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 20:52:17.032794 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 57 Oct 22 20:52:17.032794 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 20:52:17.032794 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 20:52:17.032794 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 20:52:17.032794 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 20:52:17.032794 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVFgAG_M7X-SbPCk1l9d4RyZS-kEPvU5u1o9eJtsmQ3YdkQ0-MoXUoBc1rXGxI9427s8mmGQHzHdRsLNGfXYK4_kjAmEEac17XAQxxFcEbAJERYriwQKUywoKofVoHeq5JuEVBHsm5UvdUgKs-d8dx7lDmjXy_HEt0SVjHBoeSP3k3pI Oct 22 20:52:17.032794 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 20:52:17.032794 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 20:52:17.032794 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 20:52:17.032794 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 20:52:17.032794 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 20:52:17.032794 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 20:52:17.032794 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: 92ef66123ccd4e8eb302f4c70a582740 Oct 22 20:52:17.032794 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1842193541 Oct 22 20:52:17.032794 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 20:52:17.032794 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 20:52:17.032794 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_92ef66123ccd4e8eb302f4c70a582740"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/92ef66123ccd4e8eb302f4c70a582740"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/92ef66123ccd4e8eb302f4c70a582740"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/92ef66123ccd4e8eb302f4c70a582740"}]}] Oct 22 20:52:17.032794 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1842193541 Oct 22 20:52:17.032794 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: 92ef66123ccd4e8eb302f4c70a582740 Oct 22 20:52:17.032794 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1842193541 Oct 22 20:52:17.032794 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-ImagesMetadataNegativeTestJSON-1842193541-project Oct 22 20:52:17.032794 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 20:52:17.032794 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 20:52:17.032794 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: 4c8071da60e7494bbb369df1a5eb53a9 Oct 22 20:52:17.032794 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1842193541-project Oct 22 20:52:17.032794 ncdv-master-1 devstack@n-api.service[138745]: Oct 22 20:52:17.032794 ncdv-master-1 devstack@n-api.service[138745]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Oct 22 20:52:17.032794 ncdv-master-1 devstack@n-api.service[138745]: method: Oct 22 20:52:17.032794 ncdv-master-1 devstack@n-api.service[138745]: exception: Image not found. Oct 22 20:52:17.032794 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'image_id': '07a8f4cc-75a2-4d0d-bc52-5b390ef1dc98', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Oct 22 20:52:17.032794 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:52:17.032794 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:52:17.032794 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 22 20:52:17.032794 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 22 20:52:17.032794 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 22 20:52:17.032794 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 22 20:52:17.032794 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 22 20:52:17.032794 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 22 20:52:17.032794 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 22 20:52:17.032794 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 22 20:52:17.032794 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 22 20:52:17.032794 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 22 20:52:17.032794 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 22 20:52:17.032794 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 22 20:52:17.032794 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 22 20:52:17.032794 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 22 20:52:17.032794 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 22 20:52:17.032794 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 22 20:52:17.032794 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 07a8f4cc-75a2-4d0d-bc52-5b390ef1dc98 Oct 22 20:52:17.032794 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:52:17.032794 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:52:17.032794 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:52:17.032794 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:52:17.032794 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 22 20:52:17.032794 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 22 20:52:17.032794 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 22 20:52:17.032794 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 22 20:52:17.032794 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 22 20:52:17.044585 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 22 20:52:17.044585 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 22 20:52:17.044585 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 22 20:52:17.044585 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 22 20:52:17.044585 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 22 20:52:17.044585 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 22 20:52:17.044585 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 22 20:52:17.044585 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 22 20:52:17.044585 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 22 20:52:17.044585 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 22 20:52:17.044585 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 22 20:52:17.044585 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 22 20:52:17.044585 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 22 20:52:17.044585 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 22 20:52:17.044585 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 22 20:52:17.044585 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 22 20:52:17.044585 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 22 20:52:17.044585 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 22 20:52:17.044585 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 22 20:52:17.044585 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 07a8f4cc-75a2-4d0d-bc52-5b390ef1dc98 could not be found. Oct 22 20:52:17.044585 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:52:17.044585 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:52:17.044585 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:52:17.044585 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:52:17.044585 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:52:17.044585 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:52:17.044585 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:52:17.044585 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:52:17.044585 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 22 20:52:17.044585 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 22 20:52:17.044585 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:52:17.044585 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:52:17.044585 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 20:52:17.044585 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 20:52:17.044585 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 109, in update_all Oct 22 20:52:17.044585 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 22 20:52:17.044585 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 22 20:52:17.044585 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 22 20:52:17.044585 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 22 20:52:17.044585 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:52:17.044585 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:52:17.044585 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:52:17.044585 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:52:17.044585 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:52:17.044585 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:52:17.044585 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 20:52:17.044585 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 20:52:17.044585 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 22 20:52:17.044585 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:52:17.044585 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-6520ea42-a69d-4a54-bf6d-a640931c07b5 tempest-ImagesMetadataNegativeTestJSON-1842193541 tempest-ImagesMetadataNegativeTestJSON-1842193541-project] Returning 404 to user: Image not found. {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:52:17.044585 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-6520ea42-a69d-4a54-bf6d-a640931c07b5 tempest-ImagesMetadataNegativeTestJSON-1842193541 tempest-ImagesMetadataNegativeTestJSON-1842193541-project] 10.222.0.18 "PUT /compute/v2.1/images/07a8f4cc-75a2-4d0d-bc52-5b390ef1dc98/metadata" status: 404 len: 62 microversion: 2.1 time: 0.043691 Oct 22 20:52:17.044585 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 492/928] 10.222.0.18 () {60 vars in 1280 bytes} [Sat Oct 22 20:52:16 2022] PUT /compute/v2.1/images/07a8f4cc-75a2-4d0d-bc52-5b390ef1dc98/metadata => generated 62 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 22 20:52:17.051267 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-8ddac5a8-29d8-4e1f-ae1c-eed18f3acd60 tempest-ImagesMetadataNegativeTestJSON-1842193541 tempest-ImagesMetadataNegativeTestJSON-1842193541-project] Action: 'update', calling method: .version_select at 0x7fd3a40660d0>, body: {"meta": {"os_distro": "alt"}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:52:17.081724 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-8ddac5a8-29d8-4e1f-ae1c-eed18f3acd60 tempest-ImagesMetadataNegativeTestJSON-1842193541 tempest-ImagesMetadataNegativeTestJSON-1842193541-project] HTTP exception thrown: Image not found. Oct 22 20:52:17.083926 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-8ddac5a8-29d8-4e1f-ae1c-eed18f3acd60 tempest-ImagesMetadataNegativeTestJSON-1842193541 tempest-ImagesMetadataNegativeTestJSON-1842193541-project] Request method failure captured: Oct 22 20:52:17.083926 ncdv-master-1 devstack@n-api.service[138744]: request: PUT /compute/v2.1/images/6f58ba6c-814e-4476-b3e5-b25303c8ee8a/metadata/os_distro HTTP/1.1 Oct 22 20:52:17.083926 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 20:52:17.083926 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 20:52:17.083926 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 20:52:17.083926 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 30 Oct 22 20:52:17.083926 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 20:52:17.083926 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 20:52:17.083926 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 20:52:17.083926 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 20:52:17.083926 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVFgAG_M7X-SbPCk1l9d4RyZS-kEPvU5u1o9eJtsmQ3YdkQ0-MoXUoBc1rXGxI9427s8mmGQHzHdRsLNGfXYK4_kjAmEEac17XAQxxFcEbAJERYriwQKUywoKofVoHeq5JuEVBHsm5UvdUgKs-d8dx7lDmjXy_HEt0SVjHBoeSP3k3pI Oct 22 20:52:17.083926 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 20:52:17.083926 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 20:52:17.083926 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 20:52:17.083926 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 20:52:17.083926 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 20:52:17.083926 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 20:52:17.083926 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: 92ef66123ccd4e8eb302f4c70a582740 Oct 22 20:52:17.083926 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1842193541 Oct 22 20:52:17.083926 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 20:52:17.083926 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 20:52:17.083926 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_92ef66123ccd4e8eb302f4c70a582740"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/92ef66123ccd4e8eb302f4c70a582740"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/92ef66123ccd4e8eb302f4c70a582740"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/92ef66123ccd4e8eb302f4c70a582740"}]}] Oct 22 20:52:17.083926 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1842193541 Oct 22 20:52:17.083926 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: 92ef66123ccd4e8eb302f4c70a582740 Oct 22 20:52:17.083926 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1842193541 Oct 22 20:52:17.083926 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-ImagesMetadataNegativeTestJSON-1842193541-project Oct 22 20:52:17.083926 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 20:52:17.083926 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 20:52:17.083926 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: 4c8071da60e7494bbb369df1a5eb53a9 Oct 22 20:52:17.083926 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1842193541-project Oct 22 20:52:17.083926 ncdv-master-1 devstack@n-api.service[138744]: Oct 22 20:52:17.083926 ncdv-master-1 devstack@n-api.service[138744]: {"meta": {"os_distro": "alt"}} Oct 22 20:52:17.083926 ncdv-master-1 devstack@n-api.service[138744]: method: Oct 22 20:52:17.083926 ncdv-master-1 devstack@n-api.service[138744]: exception: Image not found. Oct 22 20:52:17.083926 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'image_id': '6f58ba6c-814e-4476-b3e5-b25303c8ee8a', 'id': 'os_distro', 'body': {'meta': {'os_distro': 'alt'}}} Oct 22 20:52:17.083926 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:52:17.083926 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:52:17.083926 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 22 20:52:17.083926 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 22 20:52:17.083926 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 22 20:52:17.083926 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 22 20:52:17.083926 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 22 20:52:17.083926 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 22 20:52:17.083926 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 22 20:52:17.083926 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 22 20:52:17.083926 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 22 20:52:17.083926 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 22 20:52:17.083926 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 22 20:52:17.083926 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 22 20:52:17.083926 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 22 20:52:17.083926 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 22 20:52:17.083926 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 22 20:52:17.083926 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 22 20:52:17.083926 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 6f58ba6c-814e-4476-b3e5-b25303c8ee8a Oct 22 20:52:17.083926 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:52:17.083926 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:52:17.083926 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:52:17.083926 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:52:17.083926 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 22 20:52:17.083926 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 22 20:52:17.083926 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 22 20:52:17.083926 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 22 20:52:17.083926 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 22 20:52:17.083926 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 22 20:52:17.088708 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 22 20:52:17.088708 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 22 20:52:17.088708 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 22 20:52:17.088708 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 22 20:52:17.088708 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 22 20:52:17.088708 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 22 20:52:17.088708 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 22 20:52:17.088708 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 22 20:52:17.088708 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 22 20:52:17.088708 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 22 20:52:17.088708 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 22 20:52:17.088708 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 22 20:52:17.088708 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 22 20:52:17.088708 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 22 20:52:17.088708 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 22 20:52:17.088708 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 22 20:52:17.088708 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 22 20:52:17.088708 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 22 20:52:17.088708 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 6f58ba6c-814e-4476-b3e5-b25303c8ee8a could not be found. Oct 22 20:52:17.088708 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:52:17.088708 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:52:17.088708 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:52:17.088708 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:52:17.088708 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:52:17.088708 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:52:17.088708 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:52:17.088708 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:52:17.088708 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 22 20:52:17.088708 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 22 20:52:17.088708 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:52:17.088708 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:52:17.088708 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 20:52:17.088708 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 20:52:17.088708 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 93, in update Oct 22 20:52:17.088708 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 22 20:52:17.088708 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 22 20:52:17.088708 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 22 20:52:17.088708 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 22 20:52:17.088708 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:52:17.088708 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:52:17.088708 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:52:17.088708 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:52:17.088708 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:52:17.088708 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:52:17.088708 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 20:52:17.088708 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 20:52:17.088708 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 22 20:52:17.088708 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:52:17.088708 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-8ddac5a8-29d8-4e1f-ae1c-eed18f3acd60 tempest-ImagesMetadataNegativeTestJSON-1842193541 tempest-ImagesMetadataNegativeTestJSON-1842193541-project] Returning 404 to user: Image not found. {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:52:17.088708 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-8ddac5a8-29d8-4e1f-ae1c-eed18f3acd60 tempest-ImagesMetadataNegativeTestJSON-1842193541 tempest-ImagesMetadataNegativeTestJSON-1842193541-project] 10.222.0.18 "PUT /compute/v2.1/images/6f58ba6c-814e-4476-b3e5-b25303c8ee8a/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.042038 Oct 22 20:52:17.096143 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-3f5e08e5-e06c-46fd-88ca-7cbefcb25bf5 tempest-ImagesMetadataNegativeTestJSON-1842193541 tempest-ImagesMetadataNegativeTestJSON-1842193541-project] Action: 'create', calling method: .version_select at 0x7fd3a429fe50>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:52:17.101477 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 437/929] 10.222.0.18 () {60 vars in 1310 bytes} [Sat Oct 22 20:52:17 2022] PUT /compute/v2.1/images/6f58ba6c-814e-4476-b3e5-b25303c8ee8a/metadata/os_distro => generated 62 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 22 20:52:17.125269 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.wsgi [None req-3f5e08e5-e06c-46fd-88ca-7cbefcb25bf5 tempest-ImagesMetadataNegativeTestJSON-1842193541 tempest-ImagesMetadataNegativeTestJSON-1842193541-project] HTTP exception thrown: Image not found. Oct 22 20:52:17.127964 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-3f5e08e5-e06c-46fd-88ca-7cbefcb25bf5 tempest-ImagesMetadataNegativeTestJSON-1842193541 tempest-ImagesMetadataNegativeTestJSON-1842193541-project] Request method failure captured: Oct 22 20:52:17.127964 ncdv-master-1 devstack@n-api.service[138745]: request: POST /compute/v2.1/images/1cc644ae-1ccb-4588-82d5-13fce9658a24/metadata HTTP/1.1 Oct 22 20:52:17.127964 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 20:52:17.127964 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 20:52:17.127964 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 20:52:17.127964 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 57 Oct 22 20:52:17.127964 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 20:52:17.127964 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 20:52:17.127964 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 20:52:17.127964 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 20:52:17.127964 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVFgAG_M7X-SbPCk1l9d4RyZS-kEPvU5u1o9eJtsmQ3YdkQ0-MoXUoBc1rXGxI9427s8mmGQHzHdRsLNGfXYK4_kjAmEEac17XAQxxFcEbAJERYriwQKUywoKofVoHeq5JuEVBHsm5UvdUgKs-d8dx7lDmjXy_HEt0SVjHBoeSP3k3pI Oct 22 20:52:17.127964 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 20:52:17.127964 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 20:52:17.127964 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 20:52:17.127964 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 20:52:17.127964 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 20:52:17.127964 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 20:52:17.127964 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: 92ef66123ccd4e8eb302f4c70a582740 Oct 22 20:52:17.127964 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1842193541 Oct 22 20:52:17.127964 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 20:52:17.127964 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 20:52:17.127964 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_92ef66123ccd4e8eb302f4c70a582740"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/92ef66123ccd4e8eb302f4c70a582740"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/92ef66123ccd4e8eb302f4c70a582740"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/92ef66123ccd4e8eb302f4c70a582740"}]}] Oct 22 20:52:17.127964 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1842193541 Oct 22 20:52:17.127964 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: 92ef66123ccd4e8eb302f4c70a582740 Oct 22 20:52:17.127964 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1842193541 Oct 22 20:52:17.127964 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-ImagesMetadataNegativeTestJSON-1842193541-project Oct 22 20:52:17.127964 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 20:52:17.127964 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 20:52:17.127964 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: 4c8071da60e7494bbb369df1a5eb53a9 Oct 22 20:52:17.127964 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1842193541-project Oct 22 20:52:17.127964 ncdv-master-1 devstack@n-api.service[138745]: Oct 22 20:52:17.127964 ncdv-master-1 devstack@n-api.service[138745]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Oct 22 20:52:17.127964 ncdv-master-1 devstack@n-api.service[138745]: method: Oct 22 20:52:17.127964 ncdv-master-1 devstack@n-api.service[138745]: exception: Image not found. Oct 22 20:52:17.127964 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'image_id': '1cc644ae-1ccb-4588-82d5-13fce9658a24', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Oct 22 20:52:17.127964 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:52:17.127964 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:52:17.127964 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 22 20:52:17.127964 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 22 20:52:17.127964 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 22 20:52:17.127964 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 22 20:52:17.127964 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 22 20:52:17.127964 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 22 20:52:17.127964 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 22 20:52:17.127964 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 22 20:52:17.127964 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 22 20:52:17.127964 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 22 20:52:17.127964 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 22 20:52:17.127964 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 22 20:52:17.127964 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 22 20:52:17.127964 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 22 20:52:17.127964 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 22 20:52:17.127964 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 22 20:52:17.127964 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 1cc644ae-1ccb-4588-82d5-13fce9658a24 Oct 22 20:52:17.127964 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:52:17.127964 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:52:17.127964 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:52:17.127964 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:52:17.127964 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 22 20:52:17.127964 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 22 20:52:17.127964 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 22 20:52:17.127964 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 22 20:52:17.127964 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 22 20:52:17.134777 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 22 20:52:17.134777 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 22 20:52:17.134777 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 22 20:52:17.134777 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 22 20:52:17.134777 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 22 20:52:17.134777 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 22 20:52:17.134777 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 22 20:52:17.134777 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 22 20:52:17.134777 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 22 20:52:17.134777 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 22 20:52:17.134777 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 22 20:52:17.134777 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 22 20:52:17.134777 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 22 20:52:17.134777 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 22 20:52:17.134777 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 22 20:52:17.134777 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 22 20:52:17.134777 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 22 20:52:17.134777 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 22 20:52:17.134777 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 22 20:52:17.134777 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 1cc644ae-1ccb-4588-82d5-13fce9658a24 could not be found. Oct 22 20:52:17.134777 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:52:17.134777 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:52:17.134777 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:52:17.134777 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:52:17.134777 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:52:17.134777 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:52:17.134777 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:52:17.134777 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:52:17.134777 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 22 20:52:17.134777 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 22 20:52:17.134777 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:52:17.134777 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:52:17.134777 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 20:52:17.134777 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 20:52:17.134777 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 69, in create Oct 22 20:52:17.134777 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 22 20:52:17.134777 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 22 20:52:17.134777 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 22 20:52:17.134777 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 22 20:52:17.134777 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:52:17.134777 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:52:17.134777 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:52:17.134777 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:52:17.134777 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:52:17.134777 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:52:17.134777 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 20:52:17.134777 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 20:52:17.134777 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 22 20:52:17.134777 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:52:17.134777 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-3f5e08e5-e06c-46fd-88ca-7cbefcb25bf5 tempest-ImagesMetadataNegativeTestJSON-1842193541 tempest-ImagesMetadataNegativeTestJSON-1842193541-project] Returning 404 to user: Image not found. {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:52:17.134777 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-3f5e08e5-e06c-46fd-88ca-7cbefcb25bf5 tempest-ImagesMetadataNegativeTestJSON-1842193541 tempest-ImagesMetadataNegativeTestJSON-1842193541-project] 10.222.0.18 "POST /compute/v2.1/images/1cc644ae-1ccb-4588-82d5-13fce9658a24/metadata" status: 404 len: 62 microversion: 2.1 time: 0.037385 Oct 22 20:52:17.140113 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 493/930] 10.222.0.18 () {60 vars in 1281 bytes} [Sat Oct 22 20:52:17 2022] POST /compute/v2.1/images/1cc644ae-1ccb-4588-82d5-13fce9658a24/metadata => generated 62 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 22 20:52:17.261855 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell0:SELECT=8 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:52:17.267571 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-3943b862-5c04-4301-a7cc-370554d8d41f tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-205610098", "imageRef": "085e4478-6edc-4a69-8e08-f9831713eb65", "flavorRef": "452", "networks": [{"uuid": "4282d9d7-1326-486a-8448-108826634658"}], "security_groups": [{"name": "tempest-securitygroup--1736044608"}], "key_name": "tempest-keypair-319074667", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:52:17.392886 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.network.neutron [None req-3943b862-5c04-4301-a7cc-370554d8d41f tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] validate_networks() for [('4282d9d7-1326-486a-8448-108826634658', None, None, None, None, None)] {{(pid=138744) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 20:52:17.546245 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-87e58008-cad8-4969-8dd1-4eba6df967f0 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:52:17.547777 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-87e58008-cad8-4969-8dd1-4eba6df967f0 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] [instance: ea383564-25ff-4e81-9301-c8bcb13988c7] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:52:17.558721 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-87e58008-cad8-4969-8dd1-4eba6df967f0 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:17.560458 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-87e58008-cad8-4969-8dd1-4eba6df967f0 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:17.561689 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-87e58008-cad8-4969-8dd1-4eba6df967f0 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:17.563645 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-87e58008-cad8-4969-8dd1-4eba6df967f0 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:17.564359 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-87e58008-cad8-4969-8dd1-4eba6df967f0 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:17.564998 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-87e58008-cad8-4969-8dd1-4eba6df967f0 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:17.868186 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-87e58008-cad8-4969-8dd1-4eba6df967f0 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91cf84a287b74618ae1b3368785b0b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902e239d67664098895ab24340b0b780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:52:17.877667 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-87e58008-cad8-4969-8dd1-4eba6df967f0 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] 10.222.0.18 "GET /compute/v2.1/servers/ea383564-25ff-4e81-9301-c8bcb13988c7" status: 200 len: 1317 microversion: 2.1 time: 0.336183 Oct 22 20:52:17.878381 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 494/931] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:52:17 2022] GET /compute/v2.1/servers/ea383564-25ff-4e81-9301-c8bcb13988c7 => generated 1317 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:52:17.896403 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-c251a285-d56c-4788-ae81-34b893fabc6d tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:52:17.897670 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-c251a285-d56c-4788-ae81-34b893fabc6d tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] [instance: fa364234-023c-491a-bc88-97c048f6f0e2] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:52:17.906679 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c251a285-d56c-4788-ae81-34b893fabc6d tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:17.907382 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c251a285-d56c-4788-ae81-34b893fabc6d tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:17.908092 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c251a285-d56c-4788-ae81-34b893fabc6d tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:17.908999 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c251a285-d56c-4788-ae81-34b893fabc6d tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:17.909533 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c251a285-d56c-4788-ae81-34b893fabc6d tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:17.910022 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c251a285-d56c-4788-ae81-34b893fabc6d tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:18.069706 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-3943b862-5c04-4301-a7cc-370554d8d41f tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Flavor limits 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 20:52:18.073567 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-3943b862-5c04-4301-a7cc-370554d8d41f tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Image limits 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 20:52:18.074114 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-3943b862-5c04-4301-a7cc-370554d8d41f tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Flavor pref 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 20:52:18.074543 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-3943b862-5c04-4301-a7cc-370554d8d41f tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Image pref 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 20:52:18.075085 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-3943b862-5c04-4301-a7cc-370554d8d41f tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 20:52:18.089542 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3943b862-5c04-4301-a7cc-370554d8d41f tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:18.092198 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3943b862-5c04-4301-a7cc-370554d8d41f tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:18.092677 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3943b862-5c04-4301-a7cc-370554d8d41f tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:18.093347 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3943b862-5c04-4301-a7cc-370554d8d41f tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:18.095289 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3943b862-5c04-4301-a7cc-370554d8d41f tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:18.099715 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3943b862-5c04-4301-a7cc-370554d8d41f tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:18.111708 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-c251a285-d56c-4788-ae81-34b893fabc6d tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9bba9ed37d7430e82e7d310982b8e47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30dbbdc150694e0ebc07c63e90280d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:52:18.131758 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-c251a285-d56c-4788-ae81-34b893fabc6d tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] 10.222.0.18 "GET /compute/v2.1/servers/fa364234-023c-491a-bc88-97c048f6f0e2" status: 200 len: 1389 microversion: 2.1 time: 0.249547 Oct 22 20:52:18.132484 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 495/932] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:52:17 2022] GET /compute/v2.1/servers/fa364234-023c-491a-bc88-97c048f6f0e2 => generated 1389 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:52:18.139834 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-3943b862-5c04-4301-a7cc-370554d8d41f tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Getting quotas for project 9f0ee8c8f7fc4e12bc1f9fcce3e7b581. Resources: {'cores', 'instances', 'ram'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 20:52:18.152171 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-3943b862-5c04-4301-a7cc-370554d8d41f tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Getting quotas for user 2c87f0356ca346f39c6216393d85da2f and project 9f0ee8c8f7fc4e12bc1f9fcce3e7b581. Resources: {'cores', 'instances', 'ram'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 20:52:18.163217 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:52:18.168269 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-3943b862-5c04-4301-a7cc-370554d8d41f tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Going to run 1 instances... {{(pid=138744) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 20:52:18.170875 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-3943b862-5c04-4301-a7cc-370554d8d41f tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] [instance: 8f2e1da0-4586-460b-94dc-768fd618dc3d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='085e4478-6edc-4a69-8e08-f9831713eb65',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138744) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 20:52:18.225587 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-3943b862-5c04-4301-a7cc-370554d8d41f tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.964461 Oct 22 20:52:18.233632 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 438/933] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Oct 22 20:52:17 2022] POST /compute/v2.1/servers => generated 406 bytes in 973 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 20:52:18.245137 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-23893672-272b-408a-8cad-8f0ff57af8cc tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:52:18.245774 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-23893672-272b-408a-8cad-8f0ff57af8cc tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] [instance: 8f2e1da0-4586-460b-94dc-768fd618dc3d] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:52:18.333749 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-23893672-272b-408a-8cad-8f0ff57af8cc tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c87f0356ca346f39c6216393d85da2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee8c8f7fc4e12bc1f9fcce3e7b581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:52:18.344701 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-23893672-272b-408a-8cad-8f0ff57af8cc tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] 10.222.0.18 "GET /compute/v2.1/servers/8f2e1da0-4586-460b-94dc-768fd618dc3d" status: 200 len: 1233 microversion: 2.1 time: 0.110116 Oct 22 20:52:18.345482 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 496/934] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:52:18 2022] GET /compute/v2.1/servers/8f2e1da0-4586-460b-94dc-768fd618dc3d => generated 1233 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 20:52:18.906299 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-03d482eb-4203-4953-b3dd-e73ce4fc1310 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:52:18.908375 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-03d482eb-4203-4953-b3dd-e73ce4fc1310 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] [instance: ea383564-25ff-4e81-9301-c8bcb13988c7] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:52:18.924621 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-03d482eb-4203-4953-b3dd-e73ce4fc1310 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:18.926032 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-03d482eb-4203-4953-b3dd-e73ce4fc1310 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:18.927457 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-03d482eb-4203-4953-b3dd-e73ce4fc1310 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:18.928661 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-03d482eb-4203-4953-b3dd-e73ce4fc1310 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:18.929620 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-03d482eb-4203-4953-b3dd-e73ce4fc1310 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:18.930237 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-03d482eb-4203-4953-b3dd-e73ce4fc1310 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:18.966110 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:SELECT=100 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:52:19.185246 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-03d482eb-4203-4953-b3dd-e73ce4fc1310 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91cf84a287b74618ae1b3368785b0b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902e239d67664098895ab24340b0b780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:52:19.210577 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-03d482eb-4203-4953-b3dd-e73ce4fc1310 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] 10.222.0.18 "GET /compute/v2.1/servers/ea383564-25ff-4e81-9301-c8bcb13988c7" status: 200 len: 1317 microversion: 2.1 time: 0.308382 Oct 22 20:52:19.229554 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 439/935] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:52:18 2022] GET /compute/v2.1/servers/ea383564-25ff-4e81-9301-c8bcb13988c7 => generated 1317 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:52:19.241805 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-ace16179-3f29-4a5a-ab45-317f92b0c985 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:52:19.244926 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-ace16179-3f29-4a5a-ab45-317f92b0c985 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] [instance: fa364234-023c-491a-bc88-97c048f6f0e2] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:52:19.251235 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ace16179-3f29-4a5a-ab45-317f92b0c985 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:19.251848 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ace16179-3f29-4a5a-ab45-317f92b0c985 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:19.252385 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ace16179-3f29-4a5a-ab45-317f92b0c985 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:19.253319 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ace16179-3f29-4a5a-ab45-317f92b0c985 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:19.254103 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ace16179-3f29-4a5a-ab45-317f92b0c985 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:19.254608 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ace16179-3f29-4a5a-ab45-317f92b0c985 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:19.379578 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-b1256563-365d-4947-915f-6a10d431b7e9 tempest-ImagesDeleteNegativeTestJSON-1784826448 tempest-ImagesDeleteNegativeTestJSON-1784826448-project] 10.222.0.18 "DELETE /compute/v2.1/images/" status: 404 len: 112 microversion: - time: 0.235989 Oct 22 20:52:19.380309 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 497/936] 10.222.0.18 () {58 vars in 1128 bytes} [Sat Oct 22 20:52:19 2022] DELETE /compute/v2.1/images/ => generated 112 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 22 20:52:19.389112 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-6cc0bd4d-f9be-4876-b50e-7fa2ba70dddb tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:52:19.390207 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-6cc0bd4d-f9be-4876-b50e-7fa2ba70dddb tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] [instance: 8f2e1da0-4586-460b-94dc-768fd618dc3d] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:52:19.419112 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6cc0bd4d-f9be-4876-b50e-7fa2ba70dddb tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:19.420104 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6cc0bd4d-f9be-4876-b50e-7fa2ba70dddb tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:19.422769 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6cc0bd4d-f9be-4876-b50e-7fa2ba70dddb tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:19.423769 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6cc0bd4d-f9be-4876-b50e-7fa2ba70dddb tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:19.424430 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6cc0bd4d-f9be-4876-b50e-7fa2ba70dddb tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:19.425048 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6cc0bd4d-f9be-4876-b50e-7fa2ba70dddb tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:19.457989 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-ace16179-3f29-4a5a-ab45-317f92b0c985 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9bba9ed37d7430e82e7d310982b8e47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30dbbdc150694e0ebc07c63e90280d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:52:19.470532 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-ace16179-3f29-4a5a-ab45-317f92b0c985 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] 10.222.0.18 "GET /compute/v2.1/servers/fa364234-023c-491a-bc88-97c048f6f0e2" status: 200 len: 1389 microversion: 2.1 time: 0.239447 Oct 22 20:52:19.489225 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 440/937] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:52:19 2022] GET /compute/v2.1/servers/fa364234-023c-491a-bc88-97c048f6f0e2 => generated 1389 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:52:19.502812 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-2739e426-4889-4ed0-bcf9-1417aa2ceddf tempest-ImagesDeleteNegativeTestJSON-1784826448 tempest-ImagesDeleteNegativeTestJSON-1784826448-project] Calling method '.version_select at 0x7fd3a40d0c10>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:52:19.535992 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-6cc0bd4d-f9be-4876-b50e-7fa2ba70dddb tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c87f0356ca346f39c6216393d85da2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee8c8f7fc4e12bc1f9fcce3e7b581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:52:19.550598 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-6cc0bd4d-f9be-4876-b50e-7fa2ba70dddb tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] 10.222.0.18 "GET /compute/v2.1/servers/8f2e1da0-4586-460b-94dc-768fd618dc3d" status: 200 len: 1285 microversion: 2.1 time: 0.168494 Oct 22 20:52:19.551996 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 498/938] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:52:19 2022] GET /compute/v2.1/servers/8f2e1da0-4586-460b-94dc-768fd618dc3d => generated 1285 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:52:19.589649 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-2739e426-4889-4ed0-bcf9-1417aa2ceddf tempest-ImagesDeleteNegativeTestJSON-1784826448 tempest-ImagesDeleteNegativeTestJSON-1784826448-project] HTTP exception thrown: Image not found. Oct 22 20:52:19.593926 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-2739e426-4889-4ed0-bcf9-1417aa2ceddf tempest-ImagesDeleteNegativeTestJSON-1784826448 tempest-ImagesDeleteNegativeTestJSON-1784826448-project] Request method failure captured: Oct 22 20:52:19.593926 ncdv-master-1 devstack@n-api.service[138744]: request: DELETE /compute/v2.1/images/-1 HTTP/1.1 Oct 22 20:52:19.593926 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 20:52:19.593926 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 20:52:19.593926 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 20:52:19.593926 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 0 Oct 22 20:52:19.593926 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 20:52:19.593926 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 20:52:19.593926 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 20:52:19.593926 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 20:52:19.593926 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVFgCwtnI1YNMPALdnb7GVv7JAIm3cYwZonP1ha5A5jfZKo9eb1iSPbo_vCAmcHZmp5OJq6jvOO2vKqAz-zzY4PdVp3mhgaJOPWGFwqsh7B1ei923G2thN50z2MB46CN-iDA7gZuDZaKNd9HWhQXQqH5ZxjCId7u0heZPfyQ9eaVEly0 Oct 22 20:52:19.593926 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 20:52:19.593926 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 20:52:19.593926 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 20:52:19.593926 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 20:52:19.593926 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 20:52:19.593926 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 20:52:19.593926 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: 5cf485d30ff549908309ec9173d55222 Oct 22 20:52:19.593926 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1784826448 Oct 22 20:52:19.593926 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 20:52:19.593926 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 20:52:19.593926 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_5cf485d30ff549908309ec9173d55222"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5cf485d30ff549908309ec9173d55222"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/5cf485d30ff549908309ec9173d55222"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5cf485d30ff549908309ec9173d55222"}]}] Oct 22 20:52:19.593926 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1784826448 Oct 22 20:52:19.593926 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: 5cf485d30ff549908309ec9173d55222 Oct 22 20:52:19.593926 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1784826448 Oct 22 20:52:19.593926 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-ImagesDeleteNegativeTestJSON-1784826448-project Oct 22 20:52:19.593926 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 20:52:19.593926 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 20:52:19.593926 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: 6cd85790f36846adab0ad27568a177f4 Oct 22 20:52:19.593926 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1784826448-project Oct 22 20:52:19.593926 ncdv-master-1 devstack@n-api.service[138744]: method: Oct 22 20:52:19.593926 ncdv-master-1 devstack@n-api.service[138744]: exception: Image not found. Oct 22 20:52:19.593926 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': '-1'} Oct 22 20:52:19.593926 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:52:19.593926 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:52:19.593926 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 22 20:52:19.593926 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 22 20:52:19.593926 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 22 20:52:19.593926 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 22 20:52:19.593926 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 22 20:52:19.593926 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 22 20:52:19.593926 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 22 20:52:19.593926 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 22 20:52:19.593926 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 22 20:52:19.593926 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 22 20:52:19.593926 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 22 20:52:19.593926 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 22 20:52:19.593926 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 22 20:52:19.593926 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 22 20:52:19.593926 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image -1 to delete Oct 22 20:52:19.593926 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:52:19.593926 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:52:19.593926 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:52:19.593926 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:52:19.593926 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 22 20:52:19.593926 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 22 20:52:19.593926 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 22 20:52:19.593926 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 22 20:52:19.593926 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 22 20:52:19.593926 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 22 20:52:19.593926 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image -1 could not be found. Oct 22 20:52:19.593926 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:52:19.593926 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:52:19.593926 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:52:19.593926 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:52:19.598109 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:52:19.598109 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:52:19.598109 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:52:19.598109 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:52:19.598109 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 22 20:52:19.598109 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 22 20:52:19.598109 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:52:19.598109 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:52:19.598109 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 22 20:52:19.598109 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 22 20:52:19.598109 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 22 20:52:19.598109 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:52:19.598109 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:52:19.598109 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:52:19.598109 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:52:19.598109 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:52:19.598109 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:52:19.598109 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 20:52:19.598109 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 20:52:19.598109 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 22 20:52:19.598109 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:52:19.598109 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-2739e426-4889-4ed0-bcf9-1417aa2ceddf tempest-ImagesDeleteNegativeTestJSON-1784826448 tempest-ImagesDeleteNegativeTestJSON-1784826448-project] Returning 404 to user: Image not found. {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:52:19.598109 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-2739e426-4889-4ed0-bcf9-1417aa2ceddf tempest-ImagesDeleteNegativeTestJSON-1784826448 tempest-ImagesDeleteNegativeTestJSON-1784826448-project] 10.222.0.18 "DELETE /compute/v2.1/images/-1" status: 404 len: 62 microversion: 2.1 time: 0.106680 Oct 22 20:52:19.601148 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 441/939] 10.222.0.18 () {58 vars in 1134 bytes} [Sat Oct 22 20:52:19 2022] DELETE /compute/v2.1/images/-1 => generated 62 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 22 20:52:19.612614 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-e48e36e4-3830-4331-8491-73a3c52e3769 tempest-ImagesDeleteNegativeTestJSON-1784826448 tempest-ImagesDeleteNegativeTestJSON-1784826448-project] Calling method '.version_select at 0x7fd3a4266820>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:52:19.653811 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.wsgi [None req-e48e36e4-3830-4331-8491-73a3c52e3769 tempest-ImagesDeleteNegativeTestJSON-1784826448 tempest-ImagesDeleteNegativeTestJSON-1784826448-project] HTTP exception thrown: Image not found. Oct 22 20:52:19.656476 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-e48e36e4-3830-4331-8491-73a3c52e3769 tempest-ImagesDeleteNegativeTestJSON-1784826448 tempest-ImagesDeleteNegativeTestJSON-1784826448-project] Request method failure captured: Oct 22 20:52:19.656476 ncdv-master-1 devstack@n-api.service[138745]: request: DELETE /compute/v2.1/images/feffdbea-9371-47d5-8072-1336f14ec77j HTTP/1.1 Oct 22 20:52:19.656476 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 20:52:19.656476 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 20:52:19.656476 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 20:52:19.656476 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 0 Oct 22 20:52:19.656476 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 20:52:19.656476 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 20:52:19.656476 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 20:52:19.656476 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 20:52:19.656476 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVFgCwtnI1YNMPALdnb7GVv7JAIm3cYwZonP1ha5A5jfZKo9eb1iSPbo_vCAmcHZmp5OJq6jvOO2vKqAz-zzY4PdVp3mhgaJOPWGFwqsh7B1ei923G2thN50z2MB46CN-iDA7gZuDZaKNd9HWhQXQqH5ZxjCId7u0heZPfyQ9eaVEly0 Oct 22 20:52:19.656476 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 20:52:19.656476 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 20:52:19.656476 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 20:52:19.656476 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 20:52:19.656476 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 20:52:19.656476 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 20:52:19.656476 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: 5cf485d30ff549908309ec9173d55222 Oct 22 20:52:19.656476 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1784826448 Oct 22 20:52:19.656476 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 20:52:19.656476 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 20:52:19.656476 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_5cf485d30ff549908309ec9173d55222"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5cf485d30ff549908309ec9173d55222"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/5cf485d30ff549908309ec9173d55222"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5cf485d30ff549908309ec9173d55222"}]}] Oct 22 20:52:19.656476 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1784826448 Oct 22 20:52:19.656476 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: 5cf485d30ff549908309ec9173d55222 Oct 22 20:52:19.656476 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1784826448 Oct 22 20:52:19.656476 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-ImagesDeleteNegativeTestJSON-1784826448-project Oct 22 20:52:19.656476 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 20:52:19.656476 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 20:52:19.656476 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: 6cd85790f36846adab0ad27568a177f4 Oct 22 20:52:19.656476 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1784826448-project Oct 22 20:52:19.656476 ncdv-master-1 devstack@n-api.service[138745]: method: Oct 22 20:52:19.656476 ncdv-master-1 devstack@n-api.service[138745]: exception: Image not found. Oct 22 20:52:19.656476 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'id': 'feffdbea-9371-47d5-8072-1336f14ec77j'} Oct 22 20:52:19.656476 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:52:19.656476 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:52:19.656476 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 22 20:52:19.656476 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 22 20:52:19.656476 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 22 20:52:19.656476 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 22 20:52:19.656476 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 22 20:52:19.656476 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 22 20:52:19.656476 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 22 20:52:19.656476 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 22 20:52:19.656476 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 22 20:52:19.656476 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 22 20:52:19.656476 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 22 20:52:19.656476 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 22 20:52:19.656476 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 22 20:52:19.656476 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 22 20:52:19.656476 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image feffdbea-9371-47d5-8072-1336f14ec77j to delete Oct 22 20:52:19.656476 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:52:19.656476 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:52:19.656476 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:52:19.656476 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:52:19.656476 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 22 20:52:19.656476 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 22 20:52:19.656476 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 22 20:52:19.656476 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 22 20:52:19.656476 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 22 20:52:19.656476 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 22 20:52:19.656476 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image feffdbea-9371-47d5-8072-1336f14ec77j could not be found. Oct 22 20:52:19.656476 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:52:19.656476 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:52:19.656476 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:52:19.662499 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:52:19.662499 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:52:19.662499 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:52:19.662499 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:52:19.662499 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:52:19.662499 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 22 20:52:19.662499 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 22 20:52:19.662499 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:52:19.662499 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:52:19.662499 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 22 20:52:19.662499 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 22 20:52:19.662499 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 22 20:52:19.662499 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:52:19.662499 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:52:19.662499 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:52:19.662499 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:52:19.662499 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:52:19.662499 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:52:19.662499 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 20:52:19.662499 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 20:52:19.662499 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 22 20:52:19.662499 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:52:19.662499 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-e48e36e4-3830-4331-8491-73a3c52e3769 tempest-ImagesDeleteNegativeTestJSON-1784826448 tempest-ImagesDeleteNegativeTestJSON-1784826448-project] Returning 404 to user: Image not found. {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:52:19.666017 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-e48e36e4-3830-4331-8491-73a3c52e3769 tempest-ImagesDeleteNegativeTestJSON-1784826448 tempest-ImagesDeleteNegativeTestJSON-1784826448-project] 10.222.0.18 "DELETE /compute/v2.1/images/feffdbea-9371-47d5-8072-1336f14ec77j" status: 404 len: 62 microversion: 2.1 time: 0.057335 Oct 22 20:52:19.666152 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-06a50b8a-770f-4dc4-9bd4-b12744111ec2 req-5627cfd3-256c-43d3-a321-5224b5e25360 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea383564-25ff-4e81-9301-c8bcb13988c7", "name": "network-vif-plugged", "status": "completed", "tag": "c6526ab3-0f3c-4934-a5e0-0cf443f467c7"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:52:19.666302 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 499/940] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:52:19 2022] DELETE /compute/v2.1/images/feffdbea-9371-47d5-8072-1336f14ec77j => generated 62 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 22 20:52:19.674863 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-de4729ad-2ccd-44c7-8811-b3c404fd4455 tempest-ImagesDeleteNegativeTestJSON-1784826448 tempest-ImagesDeleteNegativeTestJSON-1784826448-project] Calling method '.version_select at 0x7fd3a42df9d0>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:52:19.685758 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-06a50b8a-770f-4dc4-9bd4-b12744111ec2 req-5627cfd3-256c-43d3-a321-5224b5e25360 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:19.686482 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-06a50b8a-770f-4dc4-9bd4-b12744111ec2 req-5627cfd3-256c-43d3-a321-5224b5e25360 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:19.687312 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-06a50b8a-770f-4dc4-9bd4-b12744111ec2 req-5627cfd3-256c-43d3-a321-5224b5e25360 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:19.694447 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.wsgi [None req-de4729ad-2ccd-44c7-8811-b3c404fd4455 tempest-ImagesDeleteNegativeTestJSON-1784826448 tempest-ImagesDeleteNegativeTestJSON-1784826448-project] HTTP exception thrown: Image not found. Oct 22 20:52:19.697359 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-de4729ad-2ccd-44c7-8811-b3c404fd4455 tempest-ImagesDeleteNegativeTestJSON-1784826448 tempest-ImagesDeleteNegativeTestJSON-1784826448-project] Request method failure captured: Oct 22 20:52:19.697359 ncdv-master-1 devstack@n-api.service[138745]: request: DELETE /compute/v2.1/images/892c8d81-9959-4d72-9958-e8ac579121591 HTTP/1.1 Oct 22 20:52:19.697359 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 20:52:19.697359 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 20:52:19.697359 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 20:52:19.697359 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 0 Oct 22 20:52:19.697359 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 20:52:19.697359 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 20:52:19.697359 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 20:52:19.697359 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 20:52:19.697359 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVFgCwtnI1YNMPALdnb7GVv7JAIm3cYwZonP1ha5A5jfZKo9eb1iSPbo_vCAmcHZmp5OJq6jvOO2vKqAz-zzY4PdVp3mhgaJOPWGFwqsh7B1ei923G2thN50z2MB46CN-iDA7gZuDZaKNd9HWhQXQqH5ZxjCId7u0heZPfyQ9eaVEly0 Oct 22 20:52:19.697359 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 20:52:19.697359 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 20:52:19.697359 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 20:52:19.697359 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 20:52:19.697359 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 20:52:19.697359 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 20:52:19.697359 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: 5cf485d30ff549908309ec9173d55222 Oct 22 20:52:19.697359 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1784826448 Oct 22 20:52:19.697359 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 20:52:19.697359 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 20:52:19.697359 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_5cf485d30ff549908309ec9173d55222"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5cf485d30ff549908309ec9173d55222"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/5cf485d30ff549908309ec9173d55222"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5cf485d30ff549908309ec9173d55222"}]}] Oct 22 20:52:19.697359 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1784826448 Oct 22 20:52:19.697359 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: 5cf485d30ff549908309ec9173d55222 Oct 22 20:52:19.697359 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1784826448 Oct 22 20:52:19.697359 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-ImagesDeleteNegativeTestJSON-1784826448-project Oct 22 20:52:19.697359 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 20:52:19.697359 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 20:52:19.697359 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: 6cd85790f36846adab0ad27568a177f4 Oct 22 20:52:19.697359 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1784826448-project Oct 22 20:52:19.697359 ncdv-master-1 devstack@n-api.service[138745]: method: Oct 22 20:52:19.697359 ncdv-master-1 devstack@n-api.service[138745]: exception: Image not found. Oct 22 20:52:19.697359 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'id': '892c8d81-9959-4d72-9958-e8ac579121591'} Oct 22 20:52:19.697359 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:52:19.697359 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:52:19.697359 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 22 20:52:19.697359 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 22 20:52:19.697359 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 22 20:52:19.697359 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 22 20:52:19.697359 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 22 20:52:19.697359 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 22 20:52:19.697359 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 22 20:52:19.697359 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 22 20:52:19.697359 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 22 20:52:19.697359 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 22 20:52:19.697359 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 22 20:52:19.697359 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 22 20:52:19.697359 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 22 20:52:19.697359 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 22 20:52:19.697359 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 892c8d81-9959-4d72-9958-e8ac579121591 to delete Oct 22 20:52:19.697359 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:52:19.697359 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:52:19.697359 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:52:19.697359 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:52:19.697359 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 22 20:52:19.697359 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 22 20:52:19.697359 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 22 20:52:19.697359 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 22 20:52:19.697359 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 22 20:52:19.697359 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 22 20:52:19.697359 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 892c8d81-9959-4d72-9958-e8ac579121591 could not be found. Oct 22 20:52:19.697359 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:52:19.697359 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:52:19.697359 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:52:19.701430 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:52:19.701430 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:52:19.701430 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:52:19.701430 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:52:19.701430 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:52:19.701430 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 22 20:52:19.701430 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 22 20:52:19.701430 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:52:19.701430 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:52:19.701430 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 22 20:52:19.701430 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 22 20:52:19.701430 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 22 20:52:19.701430 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:52:19.701430 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:52:19.701430 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:52:19.701430 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:52:19.701430 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:52:19.701430 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:52:19.701430 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 20:52:19.701430 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 20:52:19.701430 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 22 20:52:19.701430 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:52:19.705584 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-de4729ad-2ccd-44c7-8811-b3c404fd4455 tempest-ImagesDeleteNegativeTestJSON-1784826448 tempest-ImagesDeleteNegativeTestJSON-1784826448-project] Returning 404 to user: Image not found. {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:52:19.706741 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-de4729ad-2ccd-44c7-8811-b3c404fd4455 tempest-ImagesDeleteNegativeTestJSON-1784826448 tempest-ImagesDeleteNegativeTestJSON-1784826448-project] 10.222.0.18 "DELETE /compute/v2.1/images/892c8d81-9959-4d72-9958-e8ac579121591" status: 404 len: 62 microversion: 2.1 time: 0.036067 Oct 22 20:52:19.707226 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-06a50b8a-770f-4dc4-9bd4-b12744111ec2 req-5627cfd3-256c-43d3-a321-5224b5e25360 service nova] Creating event network-vif-plugged:c6526ab3-0f3c-4934-a5e0-0cf443f467c7 for instance ea383564-25ff-4e81-9301-c8bcb13988c7 on nch2-master-1 Oct 22 20:52:19.713079 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 500/941] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 20:52:19 2022] DELETE /compute/v2.1/images/892c8d81-9959-4d72-9958-e8ac579121591 => generated 62 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 22 20:52:19.718888 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-afe425fa-64f2-41fa-a19f-01e33e19f6ae tempest-ImagesDeleteNegativeTestJSON-1784826448 tempest-ImagesDeleteNegativeTestJSON-1784826448-project] Calling method '.version_select at 0x7fd3a4297f70>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:52:19.733000 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-06a50b8a-770f-4dc4-9bd4-b12744111ec2 req-5627cfd3-256c-43d3-a321-5224b5e25360 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074198 Oct 22 20:52:19.734280 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 442/942] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:52:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 20:52:19.747011 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.wsgi [None req-afe425fa-64f2-41fa-a19f-01e33e19f6ae tempest-ImagesDeleteNegativeTestJSON-1784826448 tempest-ImagesDeleteNegativeTestJSON-1784826448-project] HTTP exception thrown: Image not found. Oct 22 20:52:19.749103 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-afe425fa-64f2-41fa-a19f-01e33e19f6ae tempest-ImagesDeleteNegativeTestJSON-1784826448 tempest-ImagesDeleteNegativeTestJSON-1784826448-project] Request method failure captured: Oct 22 20:52:19.749103 ncdv-master-1 devstack@n-api.service[138745]: request: DELETE /compute/v2.1/images/tempest-invalid-2053560693 HTTP/1.1 Oct 22 20:52:19.749103 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 20:52:19.749103 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 20:52:19.749103 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 20:52:19.749103 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 0 Oct 22 20:52:19.749103 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 20:52:19.749103 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 20:52:19.749103 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 20:52:19.749103 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 20:52:19.749103 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVFgCwtnI1YNMPALdnb7GVv7JAIm3cYwZonP1ha5A5jfZKo9eb1iSPbo_vCAmcHZmp5OJq6jvOO2vKqAz-zzY4PdVp3mhgaJOPWGFwqsh7B1ei923G2thN50z2MB46CN-iDA7gZuDZaKNd9HWhQXQqH5ZxjCId7u0heZPfyQ9eaVEly0 Oct 22 20:52:19.749103 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 20:52:19.749103 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 20:52:19.749103 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 20:52:19.749103 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 20:52:19.749103 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 20:52:19.749103 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 20:52:19.749103 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: 5cf485d30ff549908309ec9173d55222 Oct 22 20:52:19.749103 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1784826448 Oct 22 20:52:19.749103 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 20:52:19.749103 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 20:52:19.749103 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_5cf485d30ff549908309ec9173d55222"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5cf485d30ff549908309ec9173d55222"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/5cf485d30ff549908309ec9173d55222"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5cf485d30ff549908309ec9173d55222"}]}] Oct 22 20:52:19.749103 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1784826448 Oct 22 20:52:19.749103 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: 5cf485d30ff549908309ec9173d55222 Oct 22 20:52:19.749103 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1784826448 Oct 22 20:52:19.749103 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-ImagesDeleteNegativeTestJSON-1784826448-project Oct 22 20:52:19.749103 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 20:52:19.749103 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 20:52:19.749103 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: 6cd85790f36846adab0ad27568a177f4 Oct 22 20:52:19.749103 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1784826448-project Oct 22 20:52:19.749103 ncdv-master-1 devstack@n-api.service[138745]: method: Oct 22 20:52:19.749103 ncdv-master-1 devstack@n-api.service[138745]: exception: Image not found. Oct 22 20:52:19.749103 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'id': 'tempest-invalid-2053560693'} Oct 22 20:52:19.749103 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:52:19.749103 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:52:19.749103 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 22 20:52:19.749103 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 22 20:52:19.749103 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 22 20:52:19.749103 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 22 20:52:19.749103 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 22 20:52:19.749103 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 22 20:52:19.749103 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 22 20:52:19.749103 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 22 20:52:19.749103 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 22 20:52:19.749103 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 22 20:52:19.749103 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 22 20:52:19.749103 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 22 20:52:19.749103 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 22 20:52:19.749103 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 22 20:52:19.749103 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image tempest-invalid-2053560693 to delete Oct 22 20:52:19.749103 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:52:19.749103 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:52:19.749103 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:52:19.749103 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:52:19.749103 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 22 20:52:19.749103 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 22 20:52:19.749103 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 22 20:52:19.749103 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 22 20:52:19.749103 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 22 20:52:19.749103 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 22 20:52:19.749103 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image tempest-invalid-2053560693 could not be found. Oct 22 20:52:19.749103 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:52:19.749103 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:52:19.749103 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:52:19.749103 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:52:19.758648 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:52:19.758648 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:52:19.758648 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:52:19.758648 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:52:19.758648 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 22 20:52:19.758648 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 22 20:52:19.758648 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:52:19.758648 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:52:19.758648 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 22 20:52:19.758648 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 22 20:52:19.758648 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 22 20:52:19.758648 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:52:19.758648 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:52:19.758648 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:52:19.758648 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:52:19.758648 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:52:19.758648 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:52:19.758648 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 20:52:19.758648 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 20:52:19.758648 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 22 20:52:19.758648 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:52:19.758648 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-afe425fa-64f2-41fa-a19f-01e33e19f6ae tempest-ImagesDeleteNegativeTestJSON-1784826448 tempest-ImagesDeleteNegativeTestJSON-1784826448-project] Returning 404 to user: Image not found. {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:52:19.758648 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-afe425fa-64f2-41fa-a19f-01e33e19f6ae tempest-ImagesDeleteNegativeTestJSON-1784826448 tempest-ImagesDeleteNegativeTestJSON-1784826448-project] 10.222.0.18 "DELETE /compute/v2.1/images/tempest-invalid-2053560693" status: 404 len: 62 microversion: 2.1 time: 0.036574 Oct 22 20:52:19.758648 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 501/943] 10.222.0.18 () {58 vars in 1206 bytes} [Sat Oct 22 20:52:19 2022] DELETE /compute/v2.1/images/tempest-invalid-2053560693 => generated 62 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 22 20:52:19.766920 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-4bfc6d1a-b235-41b0-b6a2-abfd5afefa89 tempest-ImagesDeleteNegativeTestJSON-1784826448 tempest-ImagesDeleteNegativeTestJSON-1784826448-project] Calling method '.version_select at 0x7fd3a4051700>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:52:19.801596 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-4bfc6d1a-b235-41b0-b6a2-abfd5afefa89 tempest-ImagesDeleteNegativeTestJSON-1784826448 tempest-ImagesDeleteNegativeTestJSON-1784826448-project] HTTP exception thrown: Image not found. Oct 22 20:52:19.805163 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-4bfc6d1a-b235-41b0-b6a2-abfd5afefa89 tempest-ImagesDeleteNegativeTestJSON-1784826448 tempest-ImagesDeleteNegativeTestJSON-1784826448-project] Request method failure captured: Oct 22 20:52:19.805163 ncdv-master-1 devstack@n-api.service[138744]: request: DELETE /compute/v2.1/images/f5c844dd-c6f7-4a5a-8bdc-dd4aa0b3dd8d HTTP/1.1 Oct 22 20:52:19.805163 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 20:52:19.805163 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 20:52:19.805163 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 20:52:19.805163 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 0 Oct 22 20:52:19.805163 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 20:52:19.805163 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 20:52:19.805163 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 20:52:19.805163 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 20:52:19.805163 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVFgCwtnI1YNMPALdnb7GVv7JAIm3cYwZonP1ha5A5jfZKo9eb1iSPbo_vCAmcHZmp5OJq6jvOO2vKqAz-zzY4PdVp3mhgaJOPWGFwqsh7B1ei923G2thN50z2MB46CN-iDA7gZuDZaKNd9HWhQXQqH5ZxjCId7u0heZPfyQ9eaVEly0 Oct 22 20:52:19.805163 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 20:52:19.805163 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 20:52:19.805163 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 20:52:19.805163 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 20:52:19.805163 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 20:52:19.805163 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 20:52:19.805163 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: 5cf485d30ff549908309ec9173d55222 Oct 22 20:52:19.805163 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1784826448 Oct 22 20:52:19.805163 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 20:52:19.805163 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 20:52:19.805163 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_5cf485d30ff549908309ec9173d55222"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5cf485d30ff549908309ec9173d55222"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/5cf485d30ff549908309ec9173d55222"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5cf485d30ff549908309ec9173d55222"}]}] Oct 22 20:52:19.805163 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1784826448 Oct 22 20:52:19.805163 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: 5cf485d30ff549908309ec9173d55222 Oct 22 20:52:19.805163 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1784826448 Oct 22 20:52:19.805163 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-ImagesDeleteNegativeTestJSON-1784826448-project Oct 22 20:52:19.805163 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 20:52:19.805163 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 20:52:19.805163 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: 6cd85790f36846adab0ad27568a177f4 Oct 22 20:52:19.805163 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1784826448-project Oct 22 20:52:19.805163 ncdv-master-1 devstack@n-api.service[138744]: method: Oct 22 20:52:19.805163 ncdv-master-1 devstack@n-api.service[138744]: exception: Image not found. Oct 22 20:52:19.805163 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': 'f5c844dd-c6f7-4a5a-8bdc-dd4aa0b3dd8d'} Oct 22 20:52:19.805163 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:52:19.805163 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:52:19.805163 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 22 20:52:19.805163 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 22 20:52:19.805163 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 22 20:52:19.805163 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 22 20:52:19.805163 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 22 20:52:19.805163 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 22 20:52:19.805163 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 22 20:52:19.805163 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 22 20:52:19.805163 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 22 20:52:19.805163 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 22 20:52:19.805163 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 22 20:52:19.805163 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 22 20:52:19.805163 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 22 20:52:19.805163 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 22 20:52:19.805163 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image f5c844dd-c6f7-4a5a-8bdc-dd4aa0b3dd8d to delete Oct 22 20:52:19.805163 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:52:19.805163 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:52:19.805163 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:52:19.805163 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:52:19.805163 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 22 20:52:19.805163 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 22 20:52:19.805163 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 22 20:52:19.805163 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 22 20:52:19.805163 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 22 20:52:19.805163 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 22 20:52:19.805163 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image f5c844dd-c6f7-4a5a-8bdc-dd4aa0b3dd8d could not be found. Oct 22 20:52:19.805163 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:52:19.805163 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:52:19.805163 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:52:19.810013 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:52:19.810013 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:52:19.810013 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:52:19.810013 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:52:19.810013 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:52:19.810013 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 22 20:52:19.810013 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 22 20:52:19.810013 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:52:19.810013 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:52:19.810013 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 22 20:52:19.810013 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 22 20:52:19.810013 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 22 20:52:19.810013 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:52:19.810013 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:52:19.810013 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:52:19.810013 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:52:19.810013 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:52:19.810013 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:52:19.810013 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 20:52:19.810013 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 20:52:19.810013 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 22 20:52:19.810013 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:52:19.815031 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-4bfc6d1a-b235-41b0-b6a2-abfd5afefa89 tempest-ImagesDeleteNegativeTestJSON-1784826448 tempest-ImagesDeleteNegativeTestJSON-1784826448-project] Returning 404 to user: Image not found. {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:52:19.816058 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-4bfc6d1a-b235-41b0-b6a2-abfd5afefa89 tempest-ImagesDeleteNegativeTestJSON-1784826448 tempest-ImagesDeleteNegativeTestJSON-1784826448-project] 10.222.0.18 "DELETE /compute/v2.1/images/f5c844dd-c6f7-4a5a-8bdc-dd4aa0b3dd8d" status: 404 len: 62 microversion: 2.1 time: 0.056704 Oct 22 20:52:19.816652 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 443/944] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:52:19 2022] DELETE /compute/v2.1/images/f5c844dd-c6f7-4a5a-8bdc-dd4aa0b3dd8d => generated 62 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 22 20:52:20.245493 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-10d21758-f79c-43b8-9604-d06fc2c5ecee tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:52:20.246707 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-10d21758-f79c-43b8-9604-d06fc2c5ecee tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] [instance: ea383564-25ff-4e81-9301-c8bcb13988c7] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:52:20.256826 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-10d21758-f79c-43b8-9604-d06fc2c5ecee tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:20.257873 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-10d21758-f79c-43b8-9604-d06fc2c5ecee tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:20.259987 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-10d21758-f79c-43b8-9604-d06fc2c5ecee tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:20.260878 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-10d21758-f79c-43b8-9604-d06fc2c5ecee tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:20.261420 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-10d21758-f79c-43b8-9604-d06fc2c5ecee tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:20.262678 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-10d21758-f79c-43b8-9604-d06fc2c5ecee tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:20.494579 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-10d21758-f79c-43b8-9604-d06fc2c5ecee tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91cf84a287b74618ae1b3368785b0b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902e239d67664098895ab24340b0b780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:52:20.497266 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-3eaec2b5-5c6b-4d32-99c3-6efd4a31f685 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:52:20.498685 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-3eaec2b5-5c6b-4d32-99c3-6efd4a31f685 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] [instance: fa364234-023c-491a-bc88-97c048f6f0e2] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:52:20.509351 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-10d21758-f79c-43b8-9604-d06fc2c5ecee tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] 10.222.0.18 "GET /compute/v2.1/servers/ea383564-25ff-4e81-9301-c8bcb13988c7" status: 200 len: 1317 microversion: 2.1 time: 0.274849 Oct 22 20:52:20.510210 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 502/945] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:52:20 2022] GET /compute/v2.1/servers/ea383564-25ff-4e81-9301-c8bcb13988c7 => generated 1317 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:52:20.521159 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3eaec2b5-5c6b-4d32-99c3-6efd4a31f685 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:20.522796 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3eaec2b5-5c6b-4d32-99c3-6efd4a31f685 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:20.526381 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3eaec2b5-5c6b-4d32-99c3-6efd4a31f685 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:20.528979 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3eaec2b5-5c6b-4d32-99c3-6efd4a31f685 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:20.531295 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3eaec2b5-5c6b-4d32-99c3-6efd4a31f685 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:20.532614 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3eaec2b5-5c6b-4d32-99c3-6efd4a31f685 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:20.578014 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-7d70f244-4a37-43bb-9961-8d31971edf68 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:52:20.578639 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-7d70f244-4a37-43bb-9961-8d31971edf68 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] [instance: 8f2e1da0-4586-460b-94dc-768fd618dc3d] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:52:20.591144 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7d70f244-4a37-43bb-9961-8d31971edf68 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:20.591714 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7d70f244-4a37-43bb-9961-8d31971edf68 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:20.592157 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7d70f244-4a37-43bb-9961-8d31971edf68 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:20.594637 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7d70f244-4a37-43bb-9961-8d31971edf68 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:20.595326 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7d70f244-4a37-43bb-9961-8d31971edf68 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:20.595986 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7d70f244-4a37-43bb-9961-8d31971edf68 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:20.602215 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell1:SELECT=100 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:52:20.731568 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-7d70f244-4a37-43bb-9961-8d31971edf68 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c87f0356ca346f39c6216393d85da2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee8c8f7fc4e12bc1f9fcce3e7b581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:52:20.747281 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-7d70f244-4a37-43bb-9961-8d31971edf68 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] 10.222.0.18 "GET /compute/v2.1/servers/8f2e1da0-4586-460b-94dc-768fd618dc3d" status: 200 len: 1291 microversion: 2.1 time: 0.173011 Oct 22 20:52:20.750061 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 503/946] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:52:20 2022] GET /compute/v2.1/servers/8f2e1da0-4586-460b-94dc-768fd618dc3d => generated 1291 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 20:52:20.870759 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-3eaec2b5-5c6b-4d32-99c3-6efd4a31f685 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9bba9ed37d7430e82e7d310982b8e47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30dbbdc150694e0ebc07c63e90280d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:52:20.880633 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-3eaec2b5-5c6b-4d32-99c3-6efd4a31f685 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] 10.222.0.18 "GET /compute/v2.1/servers/fa364234-023c-491a-bc88-97c048f6f0e2" status: 200 len: 1389 microversion: 2.1 time: 0.390130 Oct 22 20:52:20.886159 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 444/947] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:52:20 2022] GET /compute/v2.1/servers/fa364234-023c-491a-bc88-97c048f6f0e2 => generated 1389 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 20:52:21.537143 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-7224ae23-8c16-401b-9dce-862e29cd6a2b tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:52:21.542099 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-7224ae23-8c16-401b-9dce-862e29cd6a2b tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] [instance: ea383564-25ff-4e81-9301-c8bcb13988c7] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:52:21.567243 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7224ae23-8c16-401b-9dce-862e29cd6a2b tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:21.569666 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7224ae23-8c16-401b-9dce-862e29cd6a2b tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:21.571997 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7224ae23-8c16-401b-9dce-862e29cd6a2b tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:21.572951 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7224ae23-8c16-401b-9dce-862e29cd6a2b tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:21.575252 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7224ae23-8c16-401b-9dce-862e29cd6a2b tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:21.577124 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7224ae23-8c16-401b-9dce-862e29cd6a2b tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:21.777995 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-90133e93-c248-45d5-9030-a136582e3ccb tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:52:21.778713 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-90133e93-c248-45d5-9030-a136582e3ccb tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] [instance: 8f2e1da0-4586-460b-94dc-768fd618dc3d] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:52:21.792619 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-90133e93-c248-45d5-9030-a136582e3ccb tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:21.793352 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-90133e93-c248-45d5-9030-a136582e3ccb tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:21.794500 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-90133e93-c248-45d5-9030-a136582e3ccb tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:21.799108 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-90133e93-c248-45d5-9030-a136582e3ccb tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:21.800031 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-90133e93-c248-45d5-9030-a136582e3ccb tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:21.800670 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-90133e93-c248-45d5-9030-a136582e3ccb tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:21.888983 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-7224ae23-8c16-401b-9dce-862e29cd6a2b tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91cf84a287b74618ae1b3368785b0b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902e239d67664098895ab24340b0b780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:52:21.914163 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-7224ae23-8c16-401b-9dce-862e29cd6a2b tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] 10.222.0.18 "GET /compute/v2.1/servers/ea383564-25ff-4e81-9301-c8bcb13988c7" status: 200 len: 1317 microversion: 2.1 time: 0.375158 Oct 22 20:52:21.917979 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 504/948] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:52:21 2022] GET /compute/v2.1/servers/ea383564-25ff-4e81-9301-c8bcb13988c7 => generated 1317 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:52:21.937700 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-7f437d97-d47e-4275-9201-43bf1ef67728 req-c2a633f4-e3e5-48ae-8309-0f5681f4c50a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa364234-023c-491a-bc88-97c048f6f0e2", "name": "network-vif-plugged", "status": "completed", "tag": "609bc1c1-807a-4ef4-bd5c-8679553bab8c"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:52:21.971307 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-7f437d97-d47e-4275-9201-43bf1ef67728 req-c2a633f4-e3e5-48ae-8309-0f5681f4c50a service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:21.979847 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-7f437d97-d47e-4275-9201-43bf1ef67728 req-c2a633f4-e3e5-48ae-8309-0f5681f4c50a service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:21.980657 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-7f437d97-d47e-4275-9201-43bf1ef67728 req-c2a633f4-e3e5-48ae-8309-0f5681f4c50a service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:22.024029 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-7f437d97-d47e-4275-9201-43bf1ef67728 req-c2a633f4-e3e5-48ae-8309-0f5681f4c50a service nova] Creating event network-vif-plugged:609bc1c1-807a-4ef4-bd5c-8679553bab8c for instance fa364234-023c-491a-bc88-97c048f6f0e2 on nch2-master-1 Oct 22 20:52:22.037992 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-7f437d97-d47e-4275-9201-43bf1ef67728 req-c2a633f4-e3e5-48ae-8309-0f5681f4c50a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113887 Oct 22 20:52:22.038661 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 505/949] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:52:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:52:22.056987 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-598183e5-8c31-463c-8fab-12b973d368f5 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:52:22.069494 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-598183e5-8c31-463c-8fab-12b973d368f5 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] [instance: fa364234-023c-491a-bc88-97c048f6f0e2] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:52:22.087809 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-598183e5-8c31-463c-8fab-12b973d368f5 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:22.088296 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-598183e5-8c31-463c-8fab-12b973d368f5 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:22.093576 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-598183e5-8c31-463c-8fab-12b973d368f5 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:22.094339 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-598183e5-8c31-463c-8fab-12b973d368f5 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:22.094812 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-598183e5-8c31-463c-8fab-12b973d368f5 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:22.095240 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-598183e5-8c31-463c-8fab-12b973d368f5 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:22.201401 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-90133e93-c248-45d5-9030-a136582e3ccb tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c87f0356ca346f39c6216393d85da2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee8c8f7fc4e12bc1f9fcce3e7b581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:52:22.215904 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-90133e93-c248-45d5-9030-a136582e3ccb tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] 10.222.0.18 "GET /compute/v2.1/servers/8f2e1da0-4586-460b-94dc-768fd618dc3d" status: 200 len: 1359 microversion: 2.1 time: 0.447055 Oct 22 20:52:22.232186 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 445/950] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:52:21 2022] GET /compute/v2.1/servers/8f2e1da0-4586-460b-94dc-768fd618dc3d => generated 1359 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:52:22.403125 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-598183e5-8c31-463c-8fab-12b973d368f5 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9bba9ed37d7430e82e7d310982b8e47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30dbbdc150694e0ebc07c63e90280d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:52:22.421586 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-598183e5-8c31-463c-8fab-12b973d368f5 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] 10.222.0.18 "GET /compute/v2.1/servers/fa364234-023c-491a-bc88-97c048f6f0e2" status: 200 len: 1389 microversion: 2.1 time: 0.372260 Oct 22 20:52:22.422838 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 506/951] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:52:22 2022] GET /compute/v2.1/servers/fa364234-023c-491a-bc88-97c048f6f0e2 => generated 1389 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:52:22.943748 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-e5b2f30b-e6b7-42f0-8c66-7170bf6f848e tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:52:22.945421 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-e5b2f30b-e6b7-42f0-8c66-7170bf6f848e tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] [instance: ea383564-25ff-4e81-9301-c8bcb13988c7] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:52:22.952947 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e5b2f30b-e6b7-42f0-8c66-7170bf6f848e tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:22.953675 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e5b2f30b-e6b7-42f0-8c66-7170bf6f848e tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:22.954284 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e5b2f30b-e6b7-42f0-8c66-7170bf6f848e tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:22.955187 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e5b2f30b-e6b7-42f0-8c66-7170bf6f848e tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:22.955835 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e5b2f30b-e6b7-42f0-8c66-7170bf6f848e tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:22.956414 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e5b2f30b-e6b7-42f0-8c66-7170bf6f848e tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:23.246920 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-ea32985a-06bc-42a7-96f9-a314f48f865a tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:52:23.247567 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-ea32985a-06bc-42a7-96f9-a314f48f865a tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] [instance: 8f2e1da0-4586-460b-94dc-768fd618dc3d] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:52:23.265088 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ea32985a-06bc-42a7-96f9-a314f48f865a tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:23.265661 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ea32985a-06bc-42a7-96f9-a314f48f865a tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:23.266152 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ea32985a-06bc-42a7-96f9-a314f48f865a tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:23.267321 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ea32985a-06bc-42a7-96f9-a314f48f865a tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:23.267864 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ea32985a-06bc-42a7-96f9-a314f48f865a tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:23.268423 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ea32985a-06bc-42a7-96f9-a314f48f865a tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:23.575978 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-e5b2f30b-e6b7-42f0-8c66-7170bf6f848e tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91cf84a287b74618ae1b3368785b0b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902e239d67664098895ab24340b0b780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:52:23.586578 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-e5b2f30b-e6b7-42f0-8c66-7170bf6f848e tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] 10.222.0.18 "GET /compute/v2.1/servers/ea383564-25ff-4e81-9301-c8bcb13988c7" status: 200 len: 1467 microversion: 2.1 time: 0.646412 Oct 22 20:52:23.587810 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 446/952] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:52:22 2022] GET /compute/v2.1/servers/ea383564-25ff-4e81-9301-c8bcb13988c7 => generated 1467 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:52:23.594199 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-2c6b6c2d-6536-4845-8212-e47fe507ca15 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:52:23.594830 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-2c6b6c2d-6536-4845-8212-e47fe507ca15 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] [instance: fa364234-023c-491a-bc88-97c048f6f0e2] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:52:23.602907 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2c6b6c2d-6536-4845-8212-e47fe507ca15 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:23.603739 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2c6b6c2d-6536-4845-8212-e47fe507ca15 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:23.604364 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2c6b6c2d-6536-4845-8212-e47fe507ca15 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:23.605329 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2c6b6c2d-6536-4845-8212-e47fe507ca15 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:23.606351 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2c6b6c2d-6536-4845-8212-e47fe507ca15 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:23.607058 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2c6b6c2d-6536-4845-8212-e47fe507ca15 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:23.616793 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-ea32985a-06bc-42a7-96f9-a314f48f865a tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c87f0356ca346f39c6216393d85da2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee8c8f7fc4e12bc1f9fcce3e7b581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:52:23.657801 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-ea32985a-06bc-42a7-96f9-a314f48f865a tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] 10.222.0.18 "GET /compute/v2.1/servers/8f2e1da0-4586-460b-94dc-768fd618dc3d" status: 200 len: 1359 microversion: 2.1 time: 0.414622 Oct 22 20:52:23.671365 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 507/953] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:52:23 2022] GET /compute/v2.1/servers/8f2e1da0-4586-460b-94dc-768fd618dc3d => generated 1359 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:52:23.671365 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-0deeee21-ca73-49c3-9246-60ace25ba4f4 tempest-ServersOnMultiNodesTest-1015080240 tempest-ServersOnMultiNodesTest-1015080240-project-admin] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:52:23.671365 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-0deeee21-ca73-49c3-9246-60ace25ba4f4 tempest-ServersOnMultiNodesTest-1015080240 tempest-ServersOnMultiNodesTest-1015080240-project-admin] [instance: ea383564-25ff-4e81-9301-c8bcb13988c7] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:52:23.678764 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0deeee21-ca73-49c3-9246-60ace25ba4f4 tempest-ServersOnMultiNodesTest-1015080240 tempest-ServersOnMultiNodesTest-1015080240-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:23.679986 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0deeee21-ca73-49c3-9246-60ace25ba4f4 tempest-ServersOnMultiNodesTest-1015080240 tempest-ServersOnMultiNodesTest-1015080240-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:23.680661 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0deeee21-ca73-49c3-9246-60ace25ba4f4 tempest-ServersOnMultiNodesTest-1015080240 tempest-ServersOnMultiNodesTest-1015080240-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:23.681913 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0deeee21-ca73-49c3-9246-60ace25ba4f4 tempest-ServersOnMultiNodesTest-1015080240 tempest-ServersOnMultiNodesTest-1015080240-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:23.682811 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0deeee21-ca73-49c3-9246-60ace25ba4f4 tempest-ServersOnMultiNodesTest-1015080240 tempest-ServersOnMultiNodesTest-1015080240-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:23.683684 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0deeee21-ca73-49c3-9246-60ace25ba4f4 tempest-ServersOnMultiNodesTest-1015080240 tempest-ServersOnMultiNodesTest-1015080240-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:23.960329 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-2c6b6c2d-6536-4845-8212-e47fe507ca15 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9bba9ed37d7430e82e7d310982b8e47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30dbbdc150694e0ebc07c63e90280d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:52:23.984822 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-2c6b6c2d-6536-4845-8212-e47fe507ca15 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] 10.222.0.18 "GET /compute/v2.1/servers/fa364234-023c-491a-bc88-97c048f6f0e2" status: 200 len: 1389 microversion: 2.1 time: 0.392914 Oct 22 20:52:23.988536 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 447/954] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:52:23 2022] GET /compute/v2.1/servers/fa364234-023c-491a-bc88-97c048f6f0e2 => generated 1389 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:52:24.002103 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-0deeee21-ca73-49c3-9246-60ace25ba4f4 tempest-ServersOnMultiNodesTest-1015080240 tempest-ServersOnMultiNodesTest-1015080240-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/ea383564-25ff-4e81-9301-c8bcb13988c7" status: 200 len: 1618 microversion: 2.1 time: 0.339512 Oct 22 20:52:24.002697 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 508/955] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:52:23 2022] GET /compute/v2.1/servers/ea383564-25ff-4e81-9301-c8bcb13988c7 => generated 1618 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:52:24.192729 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-0a438423-6007-411a-806a-8b2016fd285f tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1449702502", "imageRef": "085e4478-6edc-4a69-8e08-f9831713eb65", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "69ed98a2-c208-4765-88b1-3e76a09cc481"}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:52:24.308845 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.network.neutron [None req-0a438423-6007-411a-806a-8b2016fd285f tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] validate_networks() for None {{(pid=138744) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 20:52:24.459233 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-026a28db-4ee0-42f7-ac99-cad53ce89839 req-a16d5a10-ad32-46a9-bf70-3a360142d64b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f2e1da0-4586-460b-94dc-768fd618dc3d", "tag": "4a4fea07-50e9-4003-ba39-6badf338429d"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:52:24.487075 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-026a28db-4ee0-42f7-ac99-cad53ce89839 req-a16d5a10-ad32-46a9-bf70-3a360142d64b service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:24.487741 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-026a28db-4ee0-42f7-ac99-cad53ce89839 req-a16d5a10-ad32-46a9-bf70-3a360142d64b service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:24.488149 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-026a28db-4ee0-42f7-ac99-cad53ce89839 req-a16d5a10-ad32-46a9-bf70-3a360142d64b service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:24.526666 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-026a28db-4ee0-42f7-ac99-cad53ce89839 req-a16d5a10-ad32-46a9-bf70-3a360142d64b service nova] Creating event network-changed:4a4fea07-50e9-4003-ba39-6badf338429d for instance 8f2e1da0-4586-460b-94dc-768fd618dc3d on nch1-master-1 Oct 22 20:52:24.536384 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-026a28db-4ee0-42f7-ac99-cad53ce89839 req-a16d5a10-ad32-46a9-bf70-3a360142d64b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081660 Oct 22 20:52:24.537000 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 509/956] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:52:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:52:24.688608 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-ebf9cf5d-aa90-4bb0-9c59-d6ad39bb190c tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:52:24.689320 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-ebf9cf5d-aa90-4bb0-9c59-d6ad39bb190c tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] [instance: 8f2e1da0-4586-460b-94dc-768fd618dc3d] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:52:24.704434 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ebf9cf5d-aa90-4bb0-9c59-d6ad39bb190c tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:24.704929 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ebf9cf5d-aa90-4bb0-9c59-d6ad39bb190c tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:24.705361 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ebf9cf5d-aa90-4bb0-9c59-d6ad39bb190c tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:24.711757 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ebf9cf5d-aa90-4bb0-9c59-d6ad39bb190c tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:24.712301 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ebf9cf5d-aa90-4bb0-9c59-d6ad39bb190c tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:24.712942 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ebf9cf5d-aa90-4bb0-9c59-d6ad39bb190c tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:24.778621 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-0a438423-6007-411a-806a-8b2016fd285f tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Flavor limits 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 20:52:24.779442 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-0a438423-6007-411a-806a-8b2016fd285f tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Image limits 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 20:52:24.780137 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-0a438423-6007-411a-806a-8b2016fd285f tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Flavor pref 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 20:52:24.780807 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-0a438423-6007-411a-806a-8b2016fd285f tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Image pref 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 20:52:24.781431 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-0a438423-6007-411a-806a-8b2016fd285f tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 20:52:24.796846 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0a438423-6007-411a-806a-8b2016fd285f tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:24.804583 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0a438423-6007-411a-806a-8b2016fd285f tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:24.805552 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0a438423-6007-411a-806a-8b2016fd285f tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:24.806807 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0a438423-6007-411a-806a-8b2016fd285f tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:24.807547 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0a438423-6007-411a-806a-8b2016fd285f tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:24.808213 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0a438423-6007-411a-806a-8b2016fd285f tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:24.852199 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-0a438423-6007-411a-806a-8b2016fd285f tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Getting quotas for project 902e239d67664098895ab24340b0b780. Resources: {'cores', 'instances', 'ram'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 20:52:24.869184 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-0a438423-6007-411a-806a-8b2016fd285f tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Getting quotas for user 91cf84a287b74618ae1b3368785b0b4c and project 902e239d67664098895ab24340b0b780. Resources: {'cores', 'instances', 'ram'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 20:52:24.890588 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-0a438423-6007-411a-806a-8b2016fd285f tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Going to run 1 instances... {{(pid=138744) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 20:52:24.896418 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-0a438423-6007-411a-806a-8b2016fd285f tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] [instance: eb28d061-deba-4b37-88ab-1eee24d6bed3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='085e4478-6edc-4a69-8e08-f9831713eb65',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138744) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 20:52:24.980871 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-0a438423-6007-411a-806a-8b2016fd285f tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.796340 Oct 22 20:52:24.982826 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 448/957] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Oct 22 20:52:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 799 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 22 20:52:24.995587 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-eb65e5f6-2261-483f-9ff2-ebbf324e0b83 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:52:24.996520 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-eb65e5f6-2261-483f-9ff2-ebbf324e0b83 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] [instance: eb28d061-deba-4b37-88ab-1eee24d6bed3] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:52:25.281306 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-eb65e5f6-2261-483f-9ff2-ebbf324e0b83 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91cf84a287b74618ae1b3368785b0b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902e239d67664098895ab24340b0b780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:52:25.292778 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-eb65e5f6-2261-483f-9ff2-ebbf324e0b83 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] 10.222.0.18 "GET /compute/v2.1/servers/eb28d061-deba-4b37-88ab-1eee24d6bed3" status: 200 len: 1217 microversion: 2.1 time: 0.300770 Oct 22 20:52:25.308894 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 449/958] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:52:24 2022] GET /compute/v2.1/servers/eb28d061-deba-4b37-88ab-1eee24d6bed3 => generated 1217 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:52:25.317144 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-b646a362-8cb3-44af-99b8-f13d92ad505b tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:52:25.317777 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-b646a362-8cb3-44af-99b8-f13d92ad505b tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] [instance: fa364234-023c-491a-bc88-97c048f6f0e2] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:52:25.326094 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b646a362-8cb3-44af-99b8-f13d92ad505b tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:25.326597 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b646a362-8cb3-44af-99b8-f13d92ad505b tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:25.327723 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b646a362-8cb3-44af-99b8-f13d92ad505b tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:25.328528 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b646a362-8cb3-44af-99b8-f13d92ad505b tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:25.329657 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b646a362-8cb3-44af-99b8-f13d92ad505b tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:25.330256 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b646a362-8cb3-44af-99b8-f13d92ad505b tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:25.345542 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-ebf9cf5d-aa90-4bb0-9c59-d6ad39bb190c tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c87f0356ca346f39c6216393d85da2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee8c8f7fc4e12bc1f9fcce3e7b581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:52:25.364986 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-ebf9cf5d-aa90-4bb0-9c59-d6ad39bb190c tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] 10.222.0.18 "GET /compute/v2.1/servers/8f2e1da0-4586-460b-94dc-768fd618dc3d" status: 200 len: 1359 microversion: 2.1 time: 0.680578 Oct 22 20:52:25.379618 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 510/959] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:52:24 2022] GET /compute/v2.1/servers/8f2e1da0-4586-460b-94dc-768fd618dc3d => generated 1359 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 20:52:25.754587 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-b646a362-8cb3-44af-99b8-f13d92ad505b tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9bba9ed37d7430e82e7d310982b8e47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30dbbdc150694e0ebc07c63e90280d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:52:25.768696 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-b646a362-8cb3-44af-99b8-f13d92ad505b tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] 10.222.0.18 "GET /compute/v2.1/servers/fa364234-023c-491a-bc88-97c048f6f0e2" status: 200 len: 1588 microversion: 2.1 time: 0.458053 Oct 22 20:52:25.784815 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 450/960] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:52:25 2022] GET /compute/v2.1/servers/fa364234-023c-491a-bc88-97c048f6f0e2 => generated 1588 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:52:25.795804 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-365ae58c-88e9-41ab-8381-62e50b7adf35 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:52:25.796357 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-365ae58c-88e9-41ab-8381-62e50b7adf35 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] [instance: fa364234-023c-491a-bc88-97c048f6f0e2] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:52:25.808558 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-365ae58c-88e9-41ab-8381-62e50b7adf35 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:25.809062 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-365ae58c-88e9-41ab-8381-62e50b7adf35 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:25.812600 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-365ae58c-88e9-41ab-8381-62e50b7adf35 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:25.813389 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-365ae58c-88e9-41ab-8381-62e50b7adf35 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:25.813872 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-365ae58c-88e9-41ab-8381-62e50b7adf35 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:25.814323 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-365ae58c-88e9-41ab-8381-62e50b7adf35 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:25.965126 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-365ae58c-88e9-41ab-8381-62e50b7adf35 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] 10.222.0.18 "GET /compute/v2.1/servers/fa364234-023c-491a-bc88-97c048f6f0e2/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.173778 Oct 22 20:52:25.966289 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 511/961] 10.222.0.18 () {58 vars in 1275 bytes} [Sat Oct 22 20:52:25 2022] GET /compute/v2.1/servers/fa364234-023c-491a-bc88-97c048f6f0e2/os-interface => generated 284 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:52:26.322840 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-454ab365-999b-4dc7-9c8b-ffd402230b55 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:52:26.323653 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-454ab365-999b-4dc7-9c8b-ffd402230b55 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] [instance: eb28d061-deba-4b37-88ab-1eee24d6bed3] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:52:26.335080 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-454ab365-999b-4dc7-9c8b-ffd402230b55 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:26.336863 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-454ab365-999b-4dc7-9c8b-ffd402230b55 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:26.338553 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-454ab365-999b-4dc7-9c8b-ffd402230b55 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:26.341610 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-454ab365-999b-4dc7-9c8b-ffd402230b55 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:26.342350 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-454ab365-999b-4dc7-9c8b-ffd402230b55 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:26.344202 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-454ab365-999b-4dc7-9c8b-ffd402230b55 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:26.393933 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-3f1f5add-72b0-4554-81a2-7b51f90dc4da tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:52:26.394553 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-3f1f5add-72b0-4554-81a2-7b51f90dc4da tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] [instance: 8f2e1da0-4586-460b-94dc-768fd618dc3d] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:52:26.409599 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3f1f5add-72b0-4554-81a2-7b51f90dc4da tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:26.410133 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3f1f5add-72b0-4554-81a2-7b51f90dc4da tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:26.410545 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3f1f5add-72b0-4554-81a2-7b51f90dc4da tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:26.414794 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3f1f5add-72b0-4554-81a2-7b51f90dc4da tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:26.415660 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3f1f5add-72b0-4554-81a2-7b51f90dc4da tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:26.416281 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3f1f5add-72b0-4554-81a2-7b51f90dc4da tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:26.544311 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-454ab365-999b-4dc7-9c8b-ffd402230b55 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91cf84a287b74618ae1b3368785b0b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902e239d67664098895ab24340b0b780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:52:26.556077 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-454ab365-999b-4dc7-9c8b-ffd402230b55 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] 10.222.0.18 "GET /compute/v2.1/servers/eb28d061-deba-4b37-88ab-1eee24d6bed3" status: 200 len: 1221 microversion: 2.1 time: 0.238932 Oct 22 20:52:26.558837 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 451/962] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:52:26 2022] GET /compute/v2.1/servers/eb28d061-deba-4b37-88ab-1eee24d6bed3 => generated 1221 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:52:26.713467 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-3f1f5add-72b0-4554-81a2-7b51f90dc4da tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c87f0356ca346f39c6216393d85da2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee8c8f7fc4e12bc1f9fcce3e7b581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:52:26.727295 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-3f1f5add-72b0-4554-81a2-7b51f90dc4da tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] 10.222.0.18 "GET /compute/v2.1/servers/8f2e1da0-4586-460b-94dc-768fd618dc3d" status: 200 len: 1359 microversion: 2.1 time: 0.337213 Oct 22 20:52:26.743367 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 512/963] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:52:26 2022] GET /compute/v2.1/servers/8f2e1da0-4586-460b-94dc-768fd618dc3d => generated 1359 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:52:27.586972 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-f85583f1-d34b-4a49-8c6e-38b33b61866a tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:52:27.588670 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-f85583f1-d34b-4a49-8c6e-38b33b61866a tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] [instance: eb28d061-deba-4b37-88ab-1eee24d6bed3] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:52:27.595373 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f85583f1-d34b-4a49-8c6e-38b33b61866a tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:27.596179 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f85583f1-d34b-4a49-8c6e-38b33b61866a tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:27.601833 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f85583f1-d34b-4a49-8c6e-38b33b61866a tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:27.602757 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f85583f1-d34b-4a49-8c6e-38b33b61866a tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:27.603386 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f85583f1-d34b-4a49-8c6e-38b33b61866a tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:27.603909 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f85583f1-d34b-4a49-8c6e-38b33b61866a tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:27.758295 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-60e7e9c0-d378-439d-ab19-24719d4b61a2 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:52:27.759051 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-60e7e9c0-d378-439d-ab19-24719d4b61a2 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] [instance: 8f2e1da0-4586-460b-94dc-768fd618dc3d] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:52:27.773576 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-60e7e9c0-d378-439d-ab19-24719d4b61a2 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:27.774254 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-60e7e9c0-d378-439d-ab19-24719d4b61a2 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:27.774802 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-60e7e9c0-d378-439d-ab19-24719d4b61a2 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:27.775681 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-60e7e9c0-d378-439d-ab19-24719d4b61a2 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:27.776228 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-60e7e9c0-d378-439d-ab19-24719d4b61a2 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:27.780224 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-60e7e9c0-d378-439d-ab19-24719d4b61a2 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:27.818453 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-f85583f1-d34b-4a49-8c6e-38b33b61866a tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91cf84a287b74618ae1b3368785b0b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902e239d67664098895ab24340b0b780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:52:27.830777 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-f85583f1-d34b-4a49-8c6e-38b33b61866a tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] 10.222.0.18 "GET /compute/v2.1/servers/eb28d061-deba-4b37-88ab-1eee24d6bed3" status: 200 len: 1221 microversion: 2.1 time: 0.254077 Oct 22 20:52:27.832062 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 452/964] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:52:27 2022] GET /compute/v2.1/servers/eb28d061-deba-4b37-88ab-1eee24d6bed3 => generated 1221 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:52:28.103676 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-60e7e9c0-d378-439d-ab19-24719d4b61a2 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c87f0356ca346f39c6216393d85da2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee8c8f7fc4e12bc1f9fcce3e7b581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:52:28.114393 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-60e7e9c0-d378-439d-ab19-24719d4b61a2 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] 10.222.0.18 "GET /compute/v2.1/servers/8f2e1da0-4586-460b-94dc-768fd618dc3d" status: 200 len: 1359 microversion: 2.1 time: 0.357967 Oct 22 20:52:28.128179 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 513/965] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:52:27 2022] GET /compute/v2.1/servers/8f2e1da0-4586-460b-94dc-768fd618dc3d => generated 1359 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:52:28.424207 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-94c762c8-e05c-4f47-9507-5a7cb3298fe3 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:52:28.425234 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-94c762c8-e05c-4f47-9507-5a7cb3298fe3 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] [instance: fa364234-023c-491a-bc88-97c048f6f0e2] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:52:28.430879 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-29a9077e-5576-44a3-ae69-d9249d38050f req-9bd19ef7-043d-4735-908a-ec906d2a809a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa364234-023c-491a-bc88-97c048f6f0e2", "tag": "609bc1c1-807a-4ef4-bd5c-8679553bab8c"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:52:28.433621 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-94c762c8-e05c-4f47-9507-5a7cb3298fe3 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:28.434299 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-94c762c8-e05c-4f47-9507-5a7cb3298fe3 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:28.435037 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-94c762c8-e05c-4f47-9507-5a7cb3298fe3 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:28.435981 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-94c762c8-e05c-4f47-9507-5a7cb3298fe3 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:28.436635 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-94c762c8-e05c-4f47-9507-5a7cb3298fe3 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:28.437695 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-94c762c8-e05c-4f47-9507-5a7cb3298fe3 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:28.442366 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell0:SELECT=6 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:52:28.462300 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-29a9077e-5576-44a3-ae69-d9249d38050f req-9bd19ef7-043d-4735-908a-ec906d2a809a service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:28.469056 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-29a9077e-5576-44a3-ae69-d9249d38050f req-9bd19ef7-043d-4735-908a-ec906d2a809a service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:28.470638 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-29a9077e-5576-44a3-ae69-d9249d38050f req-9bd19ef7-043d-4735-908a-ec906d2a809a service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:28.535004 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-29a9077e-5576-44a3-ae69-d9249d38050f req-9bd19ef7-043d-4735-908a-ec906d2a809a service nova] Creating event network-changed:609bc1c1-807a-4ef4-bd5c-8679553bab8c for instance fa364234-023c-491a-bc88-97c048f6f0e2 on nch2-master-1 Oct 22 20:52:28.554750 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-29a9077e-5576-44a3-ae69-d9249d38050f req-9bd19ef7-043d-4735-908a-ec906d2a809a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.128463 Oct 22 20:52:28.557683 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 514/966] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:52:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:52:28.790897 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-94c762c8-e05c-4f47-9507-5a7cb3298fe3 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9bba9ed37d7430e82e7d310982b8e47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30dbbdc150694e0ebc07c63e90280d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:52:28.808132 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-94c762c8-e05c-4f47-9507-5a7cb3298fe3 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] 10.222.0.18 "GET /compute/v2.1/servers/fa364234-023c-491a-bc88-97c048f6f0e2" status: 200 len: 1588 microversion: 2.1 time: 0.387194 Oct 22 20:52:28.811723 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 453/967] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:52:28 2022] GET /compute/v2.1/servers/fa364234-023c-491a-bc88-97c048f6f0e2 => generated 1588 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:52:28.862193 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-acc8e580-8b4e-46e0-9d63-f40deee05f29 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:52:28.863240 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-acc8e580-8b4e-46e0-9d63-f40deee05f29 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] [instance: eb28d061-deba-4b37-88ab-1eee24d6bed3] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:52:28.878740 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-acc8e580-8b4e-46e0-9d63-f40deee05f29 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:28.880936 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-acc8e580-8b4e-46e0-9d63-f40deee05f29 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:28.881205 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-b778097a-4c53-4a73-836d-6f8e20d9440b tempest-FloatingIPsTestJSON-1036292101 tempest-FloatingIPsTestJSON-1036292101-project] Action: 'create', calling method: .version_select at 0x7fd3a4266ca0>, body: {"pool": null} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:52:28.882243 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-acc8e580-8b4e-46e0-9d63-f40deee05f29 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:28.885357 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-acc8e580-8b4e-46e0-9d63-f40deee05f29 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:28.887647 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-acc8e580-8b4e-46e0-9d63-f40deee05f29 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:28.889789 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-acc8e580-8b4e-46e0-9d63-f40deee05f29 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:29.140376 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-acc8e580-8b4e-46e0-9d63-f40deee05f29 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91cf84a287b74618ae1b3368785b0b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902e239d67664098895ab24340b0b780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:52:29.156189 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-acc8e580-8b4e-46e0-9d63-f40deee05f29 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] 10.222.0.18 "GET /compute/v2.1/servers/eb28d061-deba-4b37-88ab-1eee24d6bed3" status: 200 len: 1269 microversion: 2.1 time: 0.298957 Oct 22 20:52:29.171373 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 454/968] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:52:28 2022] GET /compute/v2.1/servers/eb28d061-deba-4b37-88ab-1eee24d6bed3 => generated 1269 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:52:29.175879 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-fd2d6fd8-8e11-44cb-9e95-3795533b3073 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:52:29.181821 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-fd2d6fd8-8e11-44cb-9e95-3795533b3073 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] [instance: 8f2e1da0-4586-460b-94dc-768fd618dc3d] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:52:29.203522 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fd2d6fd8-8e11-44cb-9e95-3795533b3073 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:29.204953 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fd2d6fd8-8e11-44cb-9e95-3795533b3073 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:29.205461 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fd2d6fd8-8e11-44cb-9e95-3795533b3073 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:29.208366 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fd2d6fd8-8e11-44cb-9e95-3795533b3073 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:29.208918 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fd2d6fd8-8e11-44cb-9e95-3795533b3073 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:29.210033 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fd2d6fd8-8e11-44cb-9e95-3795533b3073 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:29.913880 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-fd2d6fd8-8e11-44cb-9e95-3795533b3073 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c87f0356ca346f39c6216393d85da2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee8c8f7fc4e12bc1f9fcce3e7b581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:52:29.941338 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-fd2d6fd8-8e11-44cb-9e95-3795533b3073 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] 10.222.0.18 "GET /compute/v2.1/servers/8f2e1da0-4586-460b-94dc-768fd618dc3d" status: 200 len: 1359 microversion: 2.1 time: 0.772963 Oct 22 20:52:29.942348 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 455/969] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:52:29 2022] GET /compute/v2.1/servers/8f2e1da0-4586-460b-94dc-768fd618dc3d => generated 1359 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:52:30.190516 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-cbadd615-2879-49a5-a1d9-47dd2a515eef tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:52:30.191648 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-cbadd615-2879-49a5-a1d9-47dd2a515eef tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] [instance: eb28d061-deba-4b37-88ab-1eee24d6bed3] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:52:30.205811 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cbadd615-2879-49a5-a1d9-47dd2a515eef tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:30.209854 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cbadd615-2879-49a5-a1d9-47dd2a515eef tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:30.215920 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cbadd615-2879-49a5-a1d9-47dd2a515eef tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:30.220864 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cbadd615-2879-49a5-a1d9-47dd2a515eef tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:30.222219 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cbadd615-2879-49a5-a1d9-47dd2a515eef tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:30.222871 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cbadd615-2879-49a5-a1d9-47dd2a515eef tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:30.586706 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-cbadd615-2879-49a5-a1d9-47dd2a515eef tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91cf84a287b74618ae1b3368785b0b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902e239d67664098895ab24340b0b780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:52:30.601387 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-cbadd615-2879-49a5-a1d9-47dd2a515eef tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] 10.222.0.18 "GET /compute/v2.1/servers/eb28d061-deba-4b37-88ab-1eee24d6bed3" status: 200 len: 1275 microversion: 2.1 time: 0.416571 Oct 22 20:52:30.602887 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 456/970] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:52:30 2022] GET /compute/v2.1/servers/eb28d061-deba-4b37-88ab-1eee24d6bed3 => generated 1275 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:52:30.970041 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-84ba7e2b-b656-4034-bcda-358ae0a66718 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:52:30.970692 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-84ba7e2b-b656-4034-bcda-358ae0a66718 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] [instance: 8f2e1da0-4586-460b-94dc-768fd618dc3d] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:52:30.980700 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-84ba7e2b-b656-4034-bcda-358ae0a66718 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:30.981191 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-84ba7e2b-b656-4034-bcda-358ae0a66718 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:30.982072 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-84ba7e2b-b656-4034-bcda-358ae0a66718 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:30.982941 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-84ba7e2b-b656-4034-bcda-358ae0a66718 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:30.985334 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-84ba7e2b-b656-4034-bcda-358ae0a66718 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:30.992551 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-84ba7e2b-b656-4034-bcda-358ae0a66718 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:31.448987 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-84ba7e2b-b656-4034-bcda-358ae0a66718 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c87f0356ca346f39c6216393d85da2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee8c8f7fc4e12bc1f9fcce3e7b581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:52:31.459559 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-84ba7e2b-b656-4034-bcda-358ae0a66718 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] 10.222.0.18 "GET /compute/v2.1/servers/8f2e1da0-4586-460b-94dc-768fd618dc3d" status: 200 len: 1359 microversion: 2.1 time: 0.493298 Oct 22 20:52:31.468726 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 457/971] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:52:30 2022] GET /compute/v2.1/servers/8f2e1da0-4586-460b-94dc-768fd618dc3d => generated 1359 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:52:31.626115 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-6576dbf1-dba6-41ee-a54d-31d3ecb51b30 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:52:31.626668 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-6576dbf1-dba6-41ee-a54d-31d3ecb51b30 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] [instance: eb28d061-deba-4b37-88ab-1eee24d6bed3] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:52:31.643724 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6576dbf1-dba6-41ee-a54d-31d3ecb51b30 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:31.644346 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6576dbf1-dba6-41ee-a54d-31d3ecb51b30 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:31.644794 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6576dbf1-dba6-41ee-a54d-31d3ecb51b30 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:31.645555 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6576dbf1-dba6-41ee-a54d-31d3ecb51b30 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:31.646164 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6576dbf1-dba6-41ee-a54d-31d3ecb51b30 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:31.646438 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6576dbf1-dba6-41ee-a54d-31d3ecb51b30 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:32.111093 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-6576dbf1-dba6-41ee-a54d-31d3ecb51b30 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91cf84a287b74618ae1b3368785b0b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902e239d67664098895ab24340b0b780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:52:32.130437 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-6576dbf1-dba6-41ee-a54d-31d3ecb51b30 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] 10.222.0.18 "GET /compute/v2.1/servers/eb28d061-deba-4b37-88ab-1eee24d6bed3" status: 200 len: 1317 microversion: 2.1 time: 0.508216 Oct 22 20:52:32.156845 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 458/972] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:52:31 2022] GET /compute/v2.1/servers/eb28d061-deba-4b37-88ab-1eee24d6bed3 => generated 1317 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 20:52:32.261149 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-2a13bb37-74e7-45e1-b2e8-aef1a7a92e13 req-fd661fb1-34ab-4493-847a-32c15bde38e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb28d061-deba-4b37-88ab-1eee24d6bed3", "tag": "eea7d66a-f230-41a5-a92f-93545da99415"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:52:32.292885 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-2a13bb37-74e7-45e1-b2e8-aef1a7a92e13 req-fd661fb1-34ab-4493-847a-32c15bde38e8 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:32.293697 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-2a13bb37-74e7-45e1-b2e8-aef1a7a92e13 req-fd661fb1-34ab-4493-847a-32c15bde38e8 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:32.295756 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-2a13bb37-74e7-45e1-b2e8-aef1a7a92e13 req-fd661fb1-34ab-4493-847a-32c15bde38e8 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:32.317776 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-2a13bb37-74e7-45e1-b2e8-aef1a7a92e13 req-fd661fb1-34ab-4493-847a-32c15bde38e8 service nova] Creating event network-changed:eea7d66a-f230-41a5-a92f-93545da99415 for instance eb28d061-deba-4b37-88ab-1eee24d6bed3 on nch1-master-1 Oct 22 20:52:32.331788 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-2a13bb37-74e7-45e1-b2e8-aef1a7a92e13 req-fd661fb1-34ab-4493-847a-32c15bde38e8 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073700 Oct 22 20:52:32.334125 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 459/973] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:52:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:52:32.517326 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-0c21c6ed-35e1-4d42-bbbd-7c274ebef5a2 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:52:32.520382 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-0c21c6ed-35e1-4d42-bbbd-7c274ebef5a2 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] [instance: 8f2e1da0-4586-460b-94dc-768fd618dc3d] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:52:32.532581 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0c21c6ed-35e1-4d42-bbbd-7c274ebef5a2 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:32.533427 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0c21c6ed-35e1-4d42-bbbd-7c274ebef5a2 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:32.535497 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0c21c6ed-35e1-4d42-bbbd-7c274ebef5a2 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:32.536987 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0c21c6ed-35e1-4d42-bbbd-7c274ebef5a2 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:32.537766 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0c21c6ed-35e1-4d42-bbbd-7c274ebef5a2 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:32.539717 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0c21c6ed-35e1-4d42-bbbd-7c274ebef5a2 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:33.014529 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-0c21c6ed-35e1-4d42-bbbd-7c274ebef5a2 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c87f0356ca346f39c6216393d85da2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee8c8f7fc4e12bc1f9fcce3e7b581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:52:33.028729 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-0c21c6ed-35e1-4d42-bbbd-7c274ebef5a2 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] 10.222.0.18 "GET /compute/v2.1/servers/8f2e1da0-4586-460b-94dc-768fd618dc3d" status: 200 len: 1359 microversion: 2.1 time: 0.533252 Oct 22 20:52:33.029666 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 460/974] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:52:32 2022] GET /compute/v2.1/servers/8f2e1da0-4586-460b-94dc-768fd618dc3d => generated 1359 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:52:33.052667 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-b778097a-4c53-4a73-836d-6f8e20d9440b tempest-FloatingIPsTestJSON-1036292101 tempest-FloatingIPsTestJSON-1036292101-project] 10.222.0.18 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 4.491072 Oct 22 20:52:33.054647 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 515/975] 10.222.0.18 () {60 vars in 1170 bytes} [Sat Oct 22 20:52:28 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4496 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:52:33.076981 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-6713dfc3-9519-478e-84f4-0153ac850edf tempest-FloatingIPsTestJSON-1036292101 tempest-FloatingIPsTestJSON-1036292101-project] Calling method '.version_select at 0x7fd3a426a5e0>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:52:33.125028 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-1fc76692-f272-44e1-94ad-95758e229c46 tempest-ImagesNegativeTestJSON-585030787 tempest-ImagesNegativeTestJSON-585030787-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesNegativeTestJSON-server-2102764320", "imageRef": "085e4478-6edc-4a69-8e08-f9831713eb65", "flavorRef": "452", "networks": [{"uuid": "de0f5259-db19-4055-8d95-096a7062416f"}]}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:52:33.217370 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.network.neutron [None req-1fc76692-f272-44e1-94ad-95758e229c46 tempest-ImagesNegativeTestJSON-585030787 tempest-ImagesNegativeTestJSON-585030787-project] validate_networks() for [('de0f5259-db19-4055-8d95-096a7062416f', None, None, None, None, None)] {{(pid=138744) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 20:52:33.445998 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-6713dfc3-9519-478e-84f4-0153ac850edf tempest-FloatingIPsTestJSON-1036292101 tempest-FloatingIPsTestJSON-1036292101-project] 10.222.0.18 "GET /compute/v2.1/os-floating-ips/3071e9a8-3f0e-4be2-96eb-8934923bd45f" status: 200 len: 142 microversion: 2.1 time: 0.380346 Oct 22 20:52:33.450850 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 516/976] 10.222.0.18 () {58 vars in 1260 bytes} [Sat Oct 22 20:52:33 2022] GET /compute/v2.1/os-floating-ips/3071e9a8-3f0e-4be2-96eb-8934923bd45f => generated 142 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:52:33.457769 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-2c111873-bcf1-4a20-9d43-4863f43b7176 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:52:33.465816 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-2c111873-bcf1-4a20-9d43-4863f43b7176 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] [instance: eb28d061-deba-4b37-88ab-1eee24d6bed3] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:52:33.477737 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2c111873-bcf1-4a20-9d43-4863f43b7176 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:33.478839 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2c111873-bcf1-4a20-9d43-4863f43b7176 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:33.479476 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2c111873-bcf1-4a20-9d43-4863f43b7176 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:33.480497 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2c111873-bcf1-4a20-9d43-4863f43b7176 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:33.481371 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2c111873-bcf1-4a20-9d43-4863f43b7176 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:33.483137 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2c111873-bcf1-4a20-9d43-4863f43b7176 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:33.772339 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-2c111873-bcf1-4a20-9d43-4863f43b7176 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91cf84a287b74618ae1b3368785b0b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902e239d67664098895ab24340b0b780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:52:33.795426 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-2c111873-bcf1-4a20-9d43-4863f43b7176 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] 10.222.0.18 "GET /compute/v2.1/servers/eb28d061-deba-4b37-88ab-1eee24d6bed3" status: 200 len: 1317 microversion: 2.1 time: 0.341335 Oct 22 20:52:33.800330 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 517/977] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:52:33 2022] GET /compute/v2.1/servers/eb28d061-deba-4b37-88ab-1eee24d6bed3 => generated 1317 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:52:33.813163 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-f284563f-c463-455e-85dc-78a45812856d tempest-FloatingIPsTestJSON-1036292101 tempest-FloatingIPsTestJSON-1036292101-project] Calling method '.version_select at 0x7fd3a429f790>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:52:33.974584 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-1fc76692-f272-44e1-94ad-95758e229c46 tempest-ImagesNegativeTestJSON-585030787 tempest-ImagesNegativeTestJSON-585030787-project] Flavor limits 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 20:52:33.975917 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-1fc76692-f272-44e1-94ad-95758e229c46 tempest-ImagesNegativeTestJSON-585030787 tempest-ImagesNegativeTestJSON-585030787-project] Image limits 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 20:52:33.977546 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-1fc76692-f272-44e1-94ad-95758e229c46 tempest-ImagesNegativeTestJSON-585030787 tempest-ImagesNegativeTestJSON-585030787-project] Flavor pref 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 20:52:33.978307 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-1fc76692-f272-44e1-94ad-95758e229c46 tempest-ImagesNegativeTestJSON-585030787 tempest-ImagesNegativeTestJSON-585030787-project] Image pref 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 20:52:33.979170 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-1fc76692-f272-44e1-94ad-95758e229c46 tempest-ImagesNegativeTestJSON-585030787 tempest-ImagesNegativeTestJSON-585030787-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 20:52:34.007747 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1fc76692-f272-44e1-94ad-95758e229c46 tempest-ImagesNegativeTestJSON-585030787 tempest-ImagesNegativeTestJSON-585030787-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:34.008721 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1fc76692-f272-44e1-94ad-95758e229c46 tempest-ImagesNegativeTestJSON-585030787 tempest-ImagesNegativeTestJSON-585030787-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:34.009738 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1fc76692-f272-44e1-94ad-95758e229c46 tempest-ImagesNegativeTestJSON-585030787 tempest-ImagesNegativeTestJSON-585030787-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:34.010943 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1fc76692-f272-44e1-94ad-95758e229c46 tempest-ImagesNegativeTestJSON-585030787 tempest-ImagesNegativeTestJSON-585030787-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:34.011871 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1fc76692-f272-44e1-94ad-95758e229c46 tempest-ImagesNegativeTestJSON-585030787 tempest-ImagesNegativeTestJSON-585030787-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:34.012494 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1fc76692-f272-44e1-94ad-95758e229c46 tempest-ImagesNegativeTestJSON-585030787 tempest-ImagesNegativeTestJSON-585030787-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:34.023806 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:SELECT=100 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:52:34.039674 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-1fc76692-f272-44e1-94ad-95758e229c46 tempest-ImagesNegativeTestJSON-585030787 tempest-ImagesNegativeTestJSON-585030787-project] Getting quotas for project 590a252c9203432eb15d9aef57cc3bb5. Resources: {'cores', 'instances', 'ram'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 20:52:34.046505 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-1fc76692-f272-44e1-94ad-95758e229c46 tempest-ImagesNegativeTestJSON-585030787 tempest-ImagesNegativeTestJSON-585030787-project] Getting quotas for user d553da484f5344169038bbe36a417699 and project 590a252c9203432eb15d9aef57cc3bb5. Resources: {'cores', 'instances', 'ram'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 20:52:34.064312 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-1fc76692-f272-44e1-94ad-95758e229c46 tempest-ImagesNegativeTestJSON-585030787 tempest-ImagesNegativeTestJSON-585030787-project] Going to run 1 instances... {{(pid=138744) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 20:52:34.070386 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-1fc76692-f272-44e1-94ad-95758e229c46 tempest-ImagesNegativeTestJSON-585030787 tempest-ImagesNegativeTestJSON-585030787-project] [instance: 950ff1c8-47a5-411f-bf47-efe6ff2982e4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='085e4478-6edc-4a69-8e08-f9831713eb65',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138744) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 20:52:34.127822 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-1fc76692-f272-44e1-94ad-95758e229c46 tempest-ImagesNegativeTestJSON-585030787 tempest-ImagesNegativeTestJSON-585030787-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.093240 Oct 22 20:52:34.128524 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 461/978] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Oct 22 20:52:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 1095 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 20:52:34.141632 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-480a9087-3b1f-499e-a70a-7feab55a5394 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:52:34.142153 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-480a9087-3b1f-499e-a70a-7feab55a5394 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] [instance: 8f2e1da0-4586-460b-94dc-768fd618dc3d] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:52:34.150585 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-480a9087-3b1f-499e-a70a-7feab55a5394 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:34.151283 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-480a9087-3b1f-499e-a70a-7feab55a5394 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:34.151949 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-480a9087-3b1f-499e-a70a-7feab55a5394 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:34.152853 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-480a9087-3b1f-499e-a70a-7feab55a5394 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:34.153569 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-480a9087-3b1f-499e-a70a-7feab55a5394 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:34.154231 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-480a9087-3b1f-499e-a70a-7feab55a5394 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:34.161586 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-f284563f-c463-455e-85dc-78a45812856d tempest-FloatingIPsTestJSON-1036292101 tempest-FloatingIPsTestJSON-1036292101-project] 10.222.0.18 "GET /compute/v2.1/os-floating-ips" status: 200 len: 145 microversion: 2.1 time: 0.358159 Oct 22 20:52:34.162255 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 518/979] 10.222.0.18 () {58 vars in 1149 bytes} [Sat Oct 22 20:52:33 2022] GET /compute/v2.1/os-floating-ips => generated 145 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:52:34.169497 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-a3a0f580-4593-4b2e-a8ce-790ab57ab843 tempest-ImagesNegativeTestJSON-585030787 tempest-ImagesNegativeTestJSON-585030787-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:52:34.170922 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-a3a0f580-4593-4b2e-a8ce-790ab57ab843 tempest-ImagesNegativeTestJSON-585030787 tempest-ImagesNegativeTestJSON-585030787-project] [instance: 950ff1c8-47a5-411f-bf47-efe6ff2982e4] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:52:34.280424 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-a3a0f580-4593-4b2e-a8ce-790ab57ab843 tempest-ImagesNegativeTestJSON-585030787 tempest-ImagesNegativeTestJSON-585030787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd553da484f5344169038bbe36a417699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '590a252c9203432eb15d9aef57cc3bb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:52:34.299157 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-a3a0f580-4593-4b2e-a8ce-790ab57ab843 tempest-ImagesNegativeTestJSON-585030787 tempest-ImagesNegativeTestJSON-585030787-project] 10.222.0.18 "GET /compute/v2.1/servers/950ff1c8-47a5-411f-bf47-efe6ff2982e4" status: 200 len: 1216 microversion: 2.1 time: 0.134145 Oct 22 20:52:34.299880 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 519/980] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:52:34 2022] GET /compute/v2.1/servers/950ff1c8-47a5-411f-bf47-efe6ff2982e4 => generated 1216 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:52:34.316749 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-fe3bf036-0807-47bb-90db-f08dcfbad473 tempest-FloatingIPsTestJSON-1036292101 tempest-FloatingIPsTestJSON-1036292101-project] Calling method '.version_select at 0x7fd3a42cf820>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:52:34.522678 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-480a9087-3b1f-499e-a70a-7feab55a5394 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c87f0356ca346f39c6216393d85da2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee8c8f7fc4e12bc1f9fcce3e7b581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:52:34.535527 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-480a9087-3b1f-499e-a70a-7feab55a5394 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] 10.222.0.18 "GET /compute/v2.1/servers/8f2e1da0-4586-460b-94dc-768fd618dc3d" status: 200 len: 1359 microversion: 2.1 time: 0.406107 Oct 22 20:52:34.538096 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 462/981] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:52:34 2022] GET /compute/v2.1/servers/8f2e1da0-4586-460b-94dc-768fd618dc3d => generated 1359 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:52:34.835819 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-d5126589-ec0a-4374-a30d-d9c7b253b393 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:52:34.836462 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-d5126589-ec0a-4374-a30d-d9c7b253b393 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] [instance: eb28d061-deba-4b37-88ab-1eee24d6bed3] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:52:34.846147 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d5126589-ec0a-4374-a30d-d9c7b253b393 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:34.847696 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d5126589-ec0a-4374-a30d-d9c7b253b393 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:34.848398 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d5126589-ec0a-4374-a30d-d9c7b253b393 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:34.851044 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d5126589-ec0a-4374-a30d-d9c7b253b393 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:34.852720 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d5126589-ec0a-4374-a30d-d9c7b253b393 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:34.853547 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d5126589-ec0a-4374-a30d-d9c7b253b393 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:35.431410 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-d5126589-ec0a-4374-a30d-d9c7b253b393 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91cf84a287b74618ae1b3368785b0b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902e239d67664098895ab24340b0b780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:52:35.441468 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-d5126589-ec0a-4374-a30d-d9c7b253b393 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] 10.222.0.18 "GET /compute/v2.1/servers/eb28d061-deba-4b37-88ab-1eee24d6bed3" status: 200 len: 1317 microversion: 2.1 time: 0.622541 Oct 22 20:52:35.445399 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 463/982] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:52:34 2022] GET /compute/v2.1/servers/eb28d061-deba-4b37-88ab-1eee24d6bed3 => generated 1317 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:52:35.460240 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-84978d8c-41c5-4e21-be10-b813da99a5fe tempest-ImagesNegativeTestJSON-585030787 tempest-ImagesNegativeTestJSON-585030787-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:52:35.464602 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-84978d8c-41c5-4e21-be10-b813da99a5fe tempest-ImagesNegativeTestJSON-585030787 tempest-ImagesNegativeTestJSON-585030787-project] [instance: 950ff1c8-47a5-411f-bf47-efe6ff2982e4] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:52:35.487931 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-84978d8c-41c5-4e21-be10-b813da99a5fe tempest-ImagesNegativeTestJSON-585030787 tempest-ImagesNegativeTestJSON-585030787-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:35.488598 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-84978d8c-41c5-4e21-be10-b813da99a5fe tempest-ImagesNegativeTestJSON-585030787 tempest-ImagesNegativeTestJSON-585030787-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:35.489362 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-84978d8c-41c5-4e21-be10-b813da99a5fe tempest-ImagesNegativeTestJSON-585030787 tempest-ImagesNegativeTestJSON-585030787-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:35.490306 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-84978d8c-41c5-4e21-be10-b813da99a5fe tempest-ImagesNegativeTestJSON-585030787 tempest-ImagesNegativeTestJSON-585030787-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:35.490869 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-84978d8c-41c5-4e21-be10-b813da99a5fe tempest-ImagesNegativeTestJSON-585030787 tempest-ImagesNegativeTestJSON-585030787-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:35.491533 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-84978d8c-41c5-4e21-be10-b813da99a5fe tempest-ImagesNegativeTestJSON-585030787 tempest-ImagesNegativeTestJSON-585030787-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:35.605663 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-84978d8c-41c5-4e21-be10-b813da99a5fe tempest-ImagesNegativeTestJSON-585030787 tempest-ImagesNegativeTestJSON-585030787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd553da484f5344169038bbe36a417699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '590a252c9203432eb15d9aef57cc3bb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:52:35.614664 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-84978d8c-41c5-4e21-be10-b813da99a5fe tempest-ImagesNegativeTestJSON-585030787 tempest-ImagesNegativeTestJSON-585030787-project] 10.222.0.18 "GET /compute/v2.1/servers/950ff1c8-47a5-411f-bf47-efe6ff2982e4" status: 200 len: 1268 microversion: 2.1 time: 0.167740 Oct 22 20:52:35.624192 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 464/983] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:52:35 2022] GET /compute/v2.1/servers/950ff1c8-47a5-411f-bf47-efe6ff2982e4 => generated 1268 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:52:35.650850 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-440a3242-f2bd-43f5-a706-1b4e5e00c4f5 req-c8ab24a5-6dbe-44f7-9e8f-9283b134aa60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f2e1da0-4586-460b-94dc-768fd618dc3d", "name": "network-vif-plugged", "status": "completed", "tag": "4a4fea07-50e9-4003-ba39-6badf338429d"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:52:35.669276 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-440a3242-f2bd-43f5-a706-1b4e5e00c4f5 req-c8ab24a5-6dbe-44f7-9e8f-9283b134aa60 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:35.669835 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-440a3242-f2bd-43f5-a706-1b4e5e00c4f5 req-c8ab24a5-6dbe-44f7-9e8f-9283b134aa60 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:35.670386 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-440a3242-f2bd-43f5-a706-1b4e5e00c4f5 req-c8ab24a5-6dbe-44f7-9e8f-9283b134aa60 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:35.685591 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-440a3242-f2bd-43f5-a706-1b4e5e00c4f5 req-c8ab24a5-6dbe-44f7-9e8f-9283b134aa60 service nova] Creating event network-vif-plugged:4a4fea07-50e9-4003-ba39-6badf338429d for instance 8f2e1da0-4586-460b-94dc-768fd618dc3d on nch1-master-1 Oct 22 20:52:35.692765 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-440a3242-f2bd-43f5-a706-1b4e5e00c4f5 req-c8ab24a5-6dbe-44f7-9e8f-9283b134aa60 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066447 Oct 22 20:52:35.693813 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 465/984] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:52:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:52:35.700534 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-8d335ac0-35b2-402f-bda8-a7db87a8d955 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:52:35.701337 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-8d335ac0-35b2-402f-bda8-a7db87a8d955 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] [instance: 8f2e1da0-4586-460b-94dc-768fd618dc3d] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:52:35.708562 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8d335ac0-35b2-402f-bda8-a7db87a8d955 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:35.709150 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8d335ac0-35b2-402f-bda8-a7db87a8d955 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:35.709818 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8d335ac0-35b2-402f-bda8-a7db87a8d955 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:35.710707 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8d335ac0-35b2-402f-bda8-a7db87a8d955 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:35.711181 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8d335ac0-35b2-402f-bda8-a7db87a8d955 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:35.711677 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8d335ac0-35b2-402f-bda8-a7db87a8d955 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:35.818185 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-fe3bf036-0807-47bb-90db-f08dcfbad473 tempest-FloatingIPsTestJSON-1036292101 tempest-FloatingIPsTestJSON-1036292101-project] 10.222.0.18 "DELETE /compute/v2.1/os-floating-ips/3071e9a8-3f0e-4be2-96eb-8934923bd45f" status: 202 len: 0 microversion: 2.1 time: 1.507992 Oct 22 20:52:35.818855 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 520/985] 10.222.0.18 () {58 vars in 1263 bytes} [Sat Oct 22 20:52:34 2022] DELETE /compute/v2.1/os-floating-ips/3071e9a8-3f0e-4be2-96eb-8934923bd45f => generated 0 bytes in 1510 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 20:52:35.829360 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-ba1204ac-3616-4b0e-bcc3-5c2331886933 tempest-FloatingIPsTestJSON-1036292101 tempest-FloatingIPsTestJSON-1036292101-project] Action: 'create', calling method: .version_select at 0x7fd3a429f1f0>, body: {"pool": null} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:52:35.971792 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-8d335ac0-35b2-402f-bda8-a7db87a8d955 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c87f0356ca346f39c6216393d85da2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee8c8f7fc4e12bc1f9fcce3e7b581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:52:35.985116 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-8d335ac0-35b2-402f-bda8-a7db87a8d955 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] 10.222.0.18 "GET /compute/v2.1/servers/8f2e1da0-4586-460b-94dc-768fd618dc3d" status: 200 len: 1359 microversion: 2.1 time: 0.289238 Oct 22 20:52:35.985953 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 466/986] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:52:35 2022] GET /compute/v2.1/servers/8f2e1da0-4586-460b-94dc-768fd618dc3d => generated 1359 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:52:36.468860 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-ed886535-b717-4732-92b2-114324d1c9ae tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:52:36.470718 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-ed886535-b717-4732-92b2-114324d1c9ae tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] [instance: eb28d061-deba-4b37-88ab-1eee24d6bed3] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:52:36.486078 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ed886535-b717-4732-92b2-114324d1c9ae tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:36.486927 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ed886535-b717-4732-92b2-114324d1c9ae tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:36.487797 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ed886535-b717-4732-92b2-114324d1c9ae tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:36.488697 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ed886535-b717-4732-92b2-114324d1c9ae tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:36.489403 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ed886535-b717-4732-92b2-114324d1c9ae tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:36.490081 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ed886535-b717-4732-92b2-114324d1c9ae tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:36.769975 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-ed886535-b717-4732-92b2-114324d1c9ae tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91cf84a287b74618ae1b3368785b0b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902e239d67664098895ab24340b0b780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:52:36.778567 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-ed886535-b717-4732-92b2-114324d1c9ae tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] 10.222.0.18 "GET /compute/v2.1/servers/eb28d061-deba-4b37-88ab-1eee24d6bed3" status: 200 len: 1317 microversion: 2.1 time: 0.315821 Oct 22 20:52:36.779389 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 467/987] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:52:36 2022] GET /compute/v2.1/servers/eb28d061-deba-4b37-88ab-1eee24d6bed3 => generated 1317 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 20:52:36.784242 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-68257c4f-592c-4968-ba51-26214bae3c96 tempest-ImagesNegativeTestJSON-585030787 tempest-ImagesNegativeTestJSON-585030787-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:52:36.785031 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-68257c4f-592c-4968-ba51-26214bae3c96 tempest-ImagesNegativeTestJSON-585030787 tempest-ImagesNegativeTestJSON-585030787-project] [instance: 950ff1c8-47a5-411f-bf47-efe6ff2982e4] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:52:36.792656 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-68257c4f-592c-4968-ba51-26214bae3c96 tempest-ImagesNegativeTestJSON-585030787 tempest-ImagesNegativeTestJSON-585030787-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:36.793366 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-68257c4f-592c-4968-ba51-26214bae3c96 tempest-ImagesNegativeTestJSON-585030787 tempest-ImagesNegativeTestJSON-585030787-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:36.794032 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-68257c4f-592c-4968-ba51-26214bae3c96 tempest-ImagesNegativeTestJSON-585030787 tempest-ImagesNegativeTestJSON-585030787-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:36.794965 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-68257c4f-592c-4968-ba51-26214bae3c96 tempest-ImagesNegativeTestJSON-585030787 tempest-ImagesNegativeTestJSON-585030787-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:36.795458 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-68257c4f-592c-4968-ba51-26214bae3c96 tempest-ImagesNegativeTestJSON-585030787 tempest-ImagesNegativeTestJSON-585030787-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:36.795883 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-68257c4f-592c-4968-ba51-26214bae3c96 tempest-ImagesNegativeTestJSON-585030787 tempest-ImagesNegativeTestJSON-585030787-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:37.044221 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-68257c4f-592c-4968-ba51-26214bae3c96 tempest-ImagesNegativeTestJSON-585030787 tempest-ImagesNegativeTestJSON-585030787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd553da484f5344169038bbe36a417699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '590a252c9203432eb15d9aef57cc3bb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:52:37.058604 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-68257c4f-592c-4968-ba51-26214bae3c96 tempest-ImagesNegativeTestJSON-585030787 tempest-ImagesNegativeTestJSON-585030787-project] 10.222.0.18 "GET /compute/v2.1/servers/950ff1c8-47a5-411f-bf47-efe6ff2982e4" status: 200 len: 1316 microversion: 2.1 time: 0.277868 Oct 22 20:52:37.060430 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 468/988] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:52:36 2022] GET /compute/v2.1/servers/950ff1c8-47a5-411f-bf47-efe6ff2982e4 => generated 1316 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:52:37.065365 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-76e83d6e-ffb7-4143-86c9-d8224d020efc tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:52:37.065984 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-76e83d6e-ffb7-4143-86c9-d8224d020efc tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] [instance: 8f2e1da0-4586-460b-94dc-768fd618dc3d] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:52:37.074144 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-76e83d6e-ffb7-4143-86c9-d8224d020efc tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:37.075240 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-76e83d6e-ffb7-4143-86c9-d8224d020efc tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:37.075880 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-76e83d6e-ffb7-4143-86c9-d8224d020efc tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:37.076794 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-76e83d6e-ffb7-4143-86c9-d8224d020efc tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:37.077394 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-76e83d6e-ffb7-4143-86c9-d8224d020efc tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:37.077979 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-76e83d6e-ffb7-4143-86c9-d8224d020efc tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:37.371999 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-76e83d6e-ffb7-4143-86c9-d8224d020efc tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c87f0356ca346f39c6216393d85da2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee8c8f7fc4e12bc1f9fcce3e7b581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:52:37.380742 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-76e83d6e-ffb7-4143-86c9-d8224d020efc tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] 10.222.0.18 "GET /compute/v2.1/servers/8f2e1da0-4586-460b-94dc-768fd618dc3d" status: 200 len: 1359 microversion: 2.1 time: 0.319096 Oct 22 20:52:37.395787 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 469/989] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:52:37 2022] GET /compute/v2.1/servers/8f2e1da0-4586-460b-94dc-768fd618dc3d => generated 1359 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:52:37.441205 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-ba1204ac-3616-4b0e-bcc3-5c2331886933 tempest-FloatingIPsTestJSON-1036292101 tempest-FloatingIPsTestJSON-1036292101-project] 10.222.0.18 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 1.616238 Oct 22 20:52:37.449620 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 521/990] 10.222.0.18 () {60 vars in 1170 bytes} [Sat Oct 22 20:52:35 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 1625 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 20:52:37.454650 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-11065319-1b60-4a03-8cf9-f507c342f655 tempest-FloatingIPsTestJSON-1036292101 tempest-FloatingIPsTestJSON-1036292101-project] Calling method '.version_select at 0x7fd39ff8d1f0>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:52:37.803102 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-25251a0f-4cc3-45b3-9e57-aaa6f1612536 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:52:37.805717 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-25251a0f-4cc3-45b3-9e57-aaa6f1612536 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] [instance: eb28d061-deba-4b37-88ab-1eee24d6bed3] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:52:37.812206 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:52:37.818102 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-25251a0f-4cc3-45b3-9e57-aaa6f1612536 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:37.819442 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-25251a0f-4cc3-45b3-9e57-aaa6f1612536 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:37.820538 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-25251a0f-4cc3-45b3-9e57-aaa6f1612536 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:37.821983 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-25251a0f-4cc3-45b3-9e57-aaa6f1612536 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:37.822606 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-25251a0f-4cc3-45b3-9e57-aaa6f1612536 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:37.823553 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-25251a0f-4cc3-45b3-9e57-aaa6f1612536 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:38.092010 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-25251a0f-4cc3-45b3-9e57-aaa6f1612536 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91cf84a287b74618ae1b3368785b0b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902e239d67664098895ab24340b0b780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:52:38.100421 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-25251a0f-4cc3-45b3-9e57-aaa6f1612536 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] 10.222.0.18 "GET /compute/v2.1/servers/eb28d061-deba-4b37-88ab-1eee24d6bed3" status: 200 len: 1317 microversion: 2.1 time: 0.302125 Oct 22 20:52:38.101978 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 522/991] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:52:37 2022] GET /compute/v2.1/servers/eb28d061-deba-4b37-88ab-1eee24d6bed3 => generated 1317 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 20:52:38.123558 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-7281c1fd-fe81-4aac-9da3-a6d3ffd82f2e tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:52:38.130058 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-7281c1fd-fe81-4aac-9da3-a6d3ffd82f2e tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6da7143c3bfb46a7b193a8d96f1b75b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598f129979a34e7a856b83bd0e69f1b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:52:38.131151 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-7281c1fd-fe81-4aac-9da3-a6d3ffd82f2e tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Searching by: {'deleted': False, 'project_id': '598f129979a34e7a856b83bd0e69f1b5'} {{(pid=138745) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 22 20:52:38.138526 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7281c1fd-fe81-4aac-9da3-a6d3ffd82f2e tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:38.139526 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7281c1fd-fe81-4aac-9da3-a6d3ffd82f2e tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:38.140972 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7281c1fd-fe81-4aac-9da3-a6d3ffd82f2e tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:38.143961 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7281c1fd-fe81-4aac-9da3-a6d3ffd82f2e tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:38.143961 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7281c1fd-fe81-4aac-9da3-a6d3ffd82f2e tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:38.144428 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7281c1fd-fe81-4aac-9da3-a6d3ffd82f2e tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:38.186181 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.multi_cell_list [None req-7281c1fd-fe81-4aac-9da3-a6d3ffd82f2e tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=138745) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 22 20:52:38.246082 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-7281c1fd-fe81-4aac-9da3-a6d3ffd82f2e tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] 10.222.0.18 "GET /compute/v2.1/servers" status: 200 len: 344 microversion: 2.1 time: 0.128260 Oct 22 20:52:38.257545 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 523/992] 10.222.0.18 () {58 vars in 1125 bytes} [Sat Oct 22 20:52:38 2022] GET /compute/v2.1/servers => generated 344 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:52:38.263851 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-e600dce3-7b0d-4c3b-a93b-ae87a4a5cd35 req-4757514d-06a3-4757-a352-746f6e98132a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "950ff1c8-47a5-411f-bf47-efe6ff2982e4", "tag": "21b44edc-3131-4251-8cd6-045205274faa"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:52:38.277521 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-e600dce3-7b0d-4c3b-a93b-ae87a4a5cd35 req-4757514d-06a3-4757-a352-746f6e98132a service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:38.278442 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-e600dce3-7b0d-4c3b-a93b-ae87a4a5cd35 req-4757514d-06a3-4757-a352-746f6e98132a service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:38.279234 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-e600dce3-7b0d-4c3b-a93b-ae87a4a5cd35 req-4757514d-06a3-4757-a352-746f6e98132a service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:38.295301 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-e600dce3-7b0d-4c3b-a93b-ae87a4a5cd35 req-4757514d-06a3-4757-a352-746f6e98132a service nova] Creating event network-changed:21b44edc-3131-4251-8cd6-045205274faa for instance 950ff1c8-47a5-411f-bf47-efe6ff2982e4 on nch2-master-1 Oct 22 20:52:38.316381 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-e600dce3-7b0d-4c3b-a93b-ae87a4a5cd35 req-4757514d-06a3-4757-a352-746f6e98132a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042353 Oct 22 20:52:38.317310 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 524/993] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:52:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:52:38.330447 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-a21cbf83-65f1-4a5e-912c-a311523ca031 tempest-ImagesNegativeTestJSON-585030787 tempest-ImagesNegativeTestJSON-585030787-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:52:38.333221 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-a21cbf83-65f1-4a5e-912c-a311523ca031 tempest-ImagesNegativeTestJSON-585030787 tempest-ImagesNegativeTestJSON-585030787-project] [instance: 950ff1c8-47a5-411f-bf47-efe6ff2982e4] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:52:38.354306 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a21cbf83-65f1-4a5e-912c-a311523ca031 tempest-ImagesNegativeTestJSON-585030787 tempest-ImagesNegativeTestJSON-585030787-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:38.354927 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a21cbf83-65f1-4a5e-912c-a311523ca031 tempest-ImagesNegativeTestJSON-585030787 tempest-ImagesNegativeTestJSON-585030787-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:38.357650 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a21cbf83-65f1-4a5e-912c-a311523ca031 tempest-ImagesNegativeTestJSON-585030787 tempest-ImagesNegativeTestJSON-585030787-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:38.358631 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a21cbf83-65f1-4a5e-912c-a311523ca031 tempest-ImagesNegativeTestJSON-585030787 tempest-ImagesNegativeTestJSON-585030787-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:38.360135 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a21cbf83-65f1-4a5e-912c-a311523ca031 tempest-ImagesNegativeTestJSON-585030787 tempest-ImagesNegativeTestJSON-585030787-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:38.361390 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a21cbf83-65f1-4a5e-912c-a311523ca031 tempest-ImagesNegativeTestJSON-585030787 tempest-ImagesNegativeTestJSON-585030787-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:38.459951 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-11065319-1b60-4a03-8cf9-f507c342f655 tempest-FloatingIPsTestJSON-1036292101 tempest-FloatingIPsTestJSON-1036292101-project] 10.222.0.18 "DELETE /compute/v2.1/os-floating-ips/4b7b37aa-cd9d-4265-916f-341b3310e0bc" status: 202 len: 0 microversion: 2.1 time: 1.009259 Oct 22 20:52:38.460632 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 470/994] 10.222.0.18 () {58 vars in 1263 bytes} [Sat Oct 22 20:52:37 2022] DELETE /compute/v2.1/os-floating-ips/4b7b37aa-cd9d-4265-916f-341b3310e0bc => generated 0 bytes in 1011 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 22 20:52:38.466384 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-c7eeac2d-a54d-43d3-bae0-06f2f20027b8 tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:52:38.471247 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-c7eeac2d-a54d-43d3-bae0-06f2f20027b8 tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6da7143c3bfb46a7b193a8d96f1b75b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598f129979a34e7a856b83bd0e69f1b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:52:38.472148 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-c7eeac2d-a54d-43d3-bae0-06f2f20027b8 tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Searching by: {'deleted': False, 'project_id': '598f129979a34e7a856b83bd0e69f1b5'} {{(pid=138744) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 22 20:52:38.479244 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c7eeac2d-a54d-43d3-bae0-06f2f20027b8 tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:38.479768 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c7eeac2d-a54d-43d3-bae0-06f2f20027b8 tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:38.480202 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c7eeac2d-a54d-43d3-bae0-06f2f20027b8 tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:38.480920 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c7eeac2d-a54d-43d3-bae0-06f2f20027b8 tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:38.481370 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c7eeac2d-a54d-43d3-bae0-06f2f20027b8 tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:38.481791 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c7eeac2d-a54d-43d3-bae0-06f2f20027b8 tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:38.578280 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-a21cbf83-65f1-4a5e-912c-a311523ca031 tempest-ImagesNegativeTestJSON-585030787 tempest-ImagesNegativeTestJSON-585030787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd553da484f5344169038bbe36a417699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '590a252c9203432eb15d9aef57cc3bb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:52:38.580504 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.multi_cell_list [None req-c7eeac2d-a54d-43d3-bae0-06f2f20027b8 tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=138744) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 22 20:52:38.588709 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-a21cbf83-65f1-4a5e-912c-a311523ca031 tempest-ImagesNegativeTestJSON-585030787 tempest-ImagesNegativeTestJSON-585030787-project] 10.222.0.18 "GET /compute/v2.1/servers/950ff1c8-47a5-411f-bf47-efe6ff2982e4" status: 200 len: 1316 microversion: 2.1 time: 0.266449 Oct 22 20:52:38.589858 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 525/995] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:52:38 2022] GET /compute/v2.1/servers/950ff1c8-47a5-411f-bf47-efe6ff2982e4 => generated 1316 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:52:38.598078 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-d7067dbc-c050-4e21-b627-897e7f1dfa34 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:52:38.598756 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-d7067dbc-c050-4e21-b627-897e7f1dfa34 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] [instance: 8f2e1da0-4586-460b-94dc-768fd618dc3d] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:52:38.609207 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d7067dbc-c050-4e21-b627-897e7f1dfa34 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:38.609980 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d7067dbc-c050-4e21-b627-897e7f1dfa34 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:38.610585 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d7067dbc-c050-4e21-b627-897e7f1dfa34 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:38.611476 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d7067dbc-c050-4e21-b627-897e7f1dfa34 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:38.612085 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d7067dbc-c050-4e21-b627-897e7f1dfa34 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:38.612708 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d7067dbc-c050-4e21-b627-897e7f1dfa34 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:38.664010 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-c7eeac2d-a54d-43d3-bae0-06f2f20027b8 tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da7143c3bfb46a7b193a8d96f1b75b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598f129979a34e7a856b83bd0e69f1b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:52:38.675021 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c7eeac2d-a54d-43d3-bae0-06f2f20027b8 tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:38.677180 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c7eeac2d-a54d-43d3-bae0-06f2f20027b8 tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:38.677704 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c7eeac2d-a54d-43d3-bae0-06f2f20027b8 tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:38.836308 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-d7067dbc-c050-4e21-b627-897e7f1dfa34 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c87f0356ca346f39c6216393d85da2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee8c8f7fc4e12bc1f9fcce3e7b581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:52:38.844287 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-d7067dbc-c050-4e21-b627-897e7f1dfa34 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] 10.222.0.18 "GET /compute/v2.1/servers/8f2e1da0-4586-460b-94dc-768fd618dc3d" status: 200 len: 1541 microversion: 2.1 time: 0.253168 Oct 22 20:52:38.844879 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 526/996] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:52:38 2022] GET /compute/v2.1/servers/8f2e1da0-4586-460b-94dc-768fd618dc3d => generated 1541 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:52:38.850124 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-add5a1de-fb48-499b-b91e-ee0e38bb3ac5 tempest-FloatingIPsTestJSON-1036292101 tempest-FloatingIPsTestJSON-1036292101-project] Calling method '.version_select at 0x7fd3a49724c0>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:52:38.875603 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-c7eeac2d-a54d-43d3-bae0-06f2f20027b8 tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] 10.222.0.18 "GET /compute/v2.1/servers/detail" status: 200 len: 1605 microversion: 2.1 time: 0.413634 Oct 22 20:52:38.876457 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 471/997] 10.222.0.18 () {58 vars in 1146 bytes} [Sat Oct 22 20:52:38 2022] GET /compute/v2.1/servers/detail => generated 1605 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:52:38.881786 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-e4c06715-5eae-4f97-8df8-50c382e8ac65 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:52:38.882268 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-e4c06715-5eae-4f97-8df8-50c382e8ac65 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] [instance: 8f2e1da0-4586-460b-94dc-768fd618dc3d] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:52:38.888659 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e4c06715-5eae-4f97-8df8-50c382e8ac65 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:38.889357 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e4c06715-5eae-4f97-8df8-50c382e8ac65 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:38.889946 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e4c06715-5eae-4f97-8df8-50c382e8ac65 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:38.891030 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e4c06715-5eae-4f97-8df8-50c382e8ac65 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:38.891737 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e4c06715-5eae-4f97-8df8-50c382e8ac65 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:38.892355 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e4c06715-5eae-4f97-8df8-50c382e8ac65 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:38.914234 ncdv-master-1 devstack@n-api.service[138745]: DEBUG neutronclient.v2_0.client [None req-add5a1de-fb48-499b-b91e-ee0e38bb3ac5 tempest-FloatingIPsTestJSON-1036292101 tempest-FloatingIPsTestJSON-1036292101-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 4b7b37aa-cd9d-4265-916f-341b3310e0bc could not be found", "detail": ""}} {{(pid=138745) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 22 20:52:38.914931 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.wsgi [None req-add5a1de-fb48-499b-b91e-ee0e38bb3ac5 tempest-FloatingIPsTestJSON-1036292101 tempest-FloatingIPsTestJSON-1036292101-project] HTTP exception thrown: Floating IP not found for ID 4b7b37aa-cd9d-4265-916f-341b3310e0bc Oct 22 20:52:38.954135 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-add5a1de-fb48-499b-b91e-ee0e38bb3ac5 tempest-FloatingIPsTestJSON-1036292101 tempest-FloatingIPsTestJSON-1036292101-project] Request method failure captured: Oct 22 20:52:38.954135 ncdv-master-1 devstack@n-api.service[138745]: request: GET /compute/v2.1/os-floating-ips/4b7b37aa-cd9d-4265-916f-341b3310e0bc HTTP/1.1 Oct 22 20:52:38.954135 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 20:52:38.954135 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 20:52:38.954135 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 20:52:38.954135 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 0 Oct 22 20:52:38.954135 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 20:52:38.954135 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 20:52:38.954135 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 20:52:38.954135 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 20:52:38.954135 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVFgMewhpiBc7yQATl2ZkUQn3vZyPQGEArI7UASd03LLu49eH4MADqb11gbSqb7XCtBOwUFTvaY0cPWslzJTuM2xWNziaGe6FU2KTHCpUE7FqRDwBlX0-6WWu4-SlOezRsIyWTimOFhNAy8I3mTVexaiyjCgZUfBXybgc_evyWBfcw04 Oct 22 20:52:38.954135 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 20:52:38.954135 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 20:52:38.954135 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 20:52:38.954135 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 20:52:38.954135 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 20:52:38.954135 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 20:52:38.954135 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: 20f70a3d090a416094dce56fbf095732 Oct 22 20:52:38.954135 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-FloatingIPsTestJSON-1036292101 Oct 22 20:52:38.954135 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 20:52:38.954135 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 20:52:38.954135 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_20f70a3d090a416094dce56fbf095732"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/20f70a3d090a416094dce56fbf095732"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/20f70a3d090a416094dce56fbf095732"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/20f70a3d090a416094dce56fbf095732"}]}] Oct 22 20:52:38.954135 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-FloatingIPsTestJSON-1036292101 Oct 22 20:52:38.954135 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: 20f70a3d090a416094dce56fbf095732 Oct 22 20:52:38.954135 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-FloatingIPsTestJSON-1036292101 Oct 22 20:52:38.954135 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-FloatingIPsTestJSON-1036292101-project Oct 22 20:52:38.954135 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 20:52:38.954135 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 20:52:38.954135 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: 0ba56db020444878bcf0f14145ec8bd8 Oct 22 20:52:38.954135 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-FloatingIPsTestJSON-1036292101-project Oct 22 20:52:38.954135 ncdv-master-1 devstack@n-api.service[138745]: method: Oct 22 20:52:38.954135 ncdv-master-1 devstack@n-api.service[138745]: exception: Floating IP not found for ID 4b7b37aa-cd9d-4265-916f-341b3310e0bc Oct 22 20:52:38.954135 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'id': '4b7b37aa-cd9d-4265-916f-341b3310e0bc'} Oct 22 20:52:38.954135 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:52:38.954135 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:52:38.954135 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 22 20:52:38.954135 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 22 20:52:38.954135 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 20:52:38.954135 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 20:52:38.954135 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 22 20:52:38.954135 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 22 20:52:38.954135 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 20:52:38.954135 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 20:52:38.954135 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 22 20:52:38.954135 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 22 20:52:38.954135 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 20:52:38.954135 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 20:52:38.954135 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 22 20:52:38.954135 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 22 20:52:38.954135 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 20:52:38.954135 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 20:52:38.954135 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 22 20:52:38.954135 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 22 20:52:38.954135 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 20:52:38.954135 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 20:52:38.954135 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 22 20:52:38.954135 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 22 20:52:38.954135 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 22 20:52:38.954135 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 22 20:52:38.954135 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 4b7b37aa-cd9d-4265-916f-341b3310e0bc could not be found Oct 22 20:52:38.954135 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3d9fd9ab-86f4-4906-a495-99d4d92d3c65'] Oct 22 20:52:38.954135 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:52:38.958690 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:52:38.958690 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:52:38.958690 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:52:38.958690 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Oct 22 20:52:38.958690 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 22 20:52:38.958690 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 22 20:52:38.958690 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 22 20:52:38.958690 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 4b7b37aa-cd9d-4265-916f-341b3310e0bc. Oct 22 20:52:38.958690 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:52:38.958690 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:52:38.958690 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:52:38.958690 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:52:38.958690 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:52:38.958690 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:52:38.958690 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:52:38.958690 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:52:38.958690 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 22 20:52:38.958690 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 22 20:52:38.958690 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:52:38.958690 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:52:38.958690 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Oct 22 20:52:38.958690 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 22 20:52:38.958690 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 4b7b37aa-cd9d-4265-916f-341b3310e0bc Oct 22 20:52:38.958690 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:52:38.958690 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:52:38.958690 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:52:38.958690 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:52:38.958690 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:52:38.958690 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:52:38.958690 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 20:52:38.958690 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 20:52:38.958690 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 4b7b37aa-cd9d-4265-916f-341b3310e0bc Oct 22 20:52:38.958690 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:52:38.958690 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-add5a1de-fb48-499b-b91e-ee0e38bb3ac5 tempest-FloatingIPsTestJSON-1036292101 tempest-FloatingIPsTestJSON-1036292101-project] Returning 404 to user: Floating IP not found for ID 4b7b37aa-cd9d-4265-916f-341b3310e0bc {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:52:38.958690 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-add5a1de-fb48-499b-b91e-ee0e38bb3ac5 tempest-FloatingIPsTestJSON-1036292101 tempest-FloatingIPsTestJSON-1036292101-project] 10.222.0.18 "GET /compute/v2.1/os-floating-ips/4b7b37aa-cd9d-4265-916f-341b3310e0bc" status: 404 len: 111 microversion: 2.1 time: 0.109667 Oct 22 20:52:38.958690 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 527/998] 10.222.0.18 () {58 vars in 1260 bytes} [Sat Oct 22 20:52:38 2022] GET /compute/v2.1/os-floating-ips/4b7b37aa-cd9d-4265-916f-341b3310e0bc => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 20:52:38.964665 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-2bf99f88-7c81-4666-a95a-030f76c262e4 tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:52:38.971720 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-2bf99f88-7c81-4666-a95a-030f76c262e4 tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] 10.222.0.18 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.014265 Oct 22 20:52:38.972293 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 528/999] 10.222.0.18 () {58 vars in 1137 bytes} [Sat Oct 22 20:52:38 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:52:38.977636 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-76c6e5bc-44c1-41b3-98bf-25d2d80175dd tempest-FloatingIPsTestJSON-1036292101 tempest-FloatingIPsTestJSON-1036292101-project] Calling method '.version_select at 0x7fd3a42e58b0>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:52:38.987966 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-e4c06715-5eae-4f97-8df8-50c382e8ac65 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] 10.222.0.18 "GET /compute/v2.1/servers/8f2e1da0-4586-460b-94dc-768fd618dc3d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.109740 Oct 22 20:52:38.988517 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 472/1000] 10.222.0.18 () {58 vars in 1275 bytes} [Sat Oct 22 20:52:38 2022] GET /compute/v2.1/servers/8f2e1da0-4586-460b-94dc-768fd618dc3d/os-interface => generated 284 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:52:39.026623 ncdv-master-1 devstack@n-api.service[138745]: DEBUG neutronclient.v2_0.client [None req-76c6e5bc-44c1-41b3-98bf-25d2d80175dd tempest-FloatingIPsTestJSON-1036292101 tempest-FloatingIPsTestJSON-1036292101-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 4b7b37aa-cd9d-4265-916f-341b3310e0bc could not be found", "detail": ""}} {{(pid=138745) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 22 20:52:39.028112 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.wsgi [None req-76c6e5bc-44c1-41b3-98bf-25d2d80175dd tempest-FloatingIPsTestJSON-1036292101 tempest-FloatingIPsTestJSON-1036292101-project] HTTP exception thrown: Floating IP not found for ID 4b7b37aa-cd9d-4265-916f-341b3310e0bc Oct 22 20:52:39.029966 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-76c6e5bc-44c1-41b3-98bf-25d2d80175dd tempest-FloatingIPsTestJSON-1036292101 tempest-FloatingIPsTestJSON-1036292101-project] Request method failure captured: Oct 22 20:52:39.029966 ncdv-master-1 devstack@n-api.service[138745]: request: DELETE /compute/v2.1/os-floating-ips/4b7b37aa-cd9d-4265-916f-341b3310e0bc HTTP/1.1 Oct 22 20:52:39.029966 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 20:52:39.029966 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 20:52:39.029966 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 20:52:39.029966 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 0 Oct 22 20:52:39.029966 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 20:52:39.029966 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 20:52:39.029966 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 20:52:39.029966 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 20:52:39.029966 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVFgMewhpiBc7yQATl2ZkUQn3vZyPQGEArI7UASd03LLu49eH4MADqb11gbSqb7XCtBOwUFTvaY0cPWslzJTuM2xWNziaGe6FU2KTHCpUE7FqRDwBlX0-6WWu4-SlOezRsIyWTimOFhNAy8I3mTVexaiyjCgZUfBXybgc_evyWBfcw04 Oct 22 20:52:39.029966 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 20:52:39.029966 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 20:52:39.029966 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 20:52:39.029966 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 20:52:39.029966 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 20:52:39.029966 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 20:52:39.029966 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: 20f70a3d090a416094dce56fbf095732 Oct 22 20:52:39.029966 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-FloatingIPsTestJSON-1036292101 Oct 22 20:52:39.029966 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 20:52:39.029966 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 20:52:39.029966 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_20f70a3d090a416094dce56fbf095732"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/20f70a3d090a416094dce56fbf095732"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/20f70a3d090a416094dce56fbf095732"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/20f70a3d090a416094dce56fbf095732"}]}] Oct 22 20:52:39.029966 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-FloatingIPsTestJSON-1036292101 Oct 22 20:52:39.029966 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: 20f70a3d090a416094dce56fbf095732 Oct 22 20:52:39.029966 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-FloatingIPsTestJSON-1036292101 Oct 22 20:52:39.029966 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-FloatingIPsTestJSON-1036292101-project Oct 22 20:52:39.029966 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 20:52:39.029966 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 20:52:39.029966 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: 0ba56db020444878bcf0f14145ec8bd8 Oct 22 20:52:39.029966 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-FloatingIPsTestJSON-1036292101-project Oct 22 20:52:39.029966 ncdv-master-1 devstack@n-api.service[138745]: method: Oct 22 20:52:39.029966 ncdv-master-1 devstack@n-api.service[138745]: exception: Floating IP not found for ID 4b7b37aa-cd9d-4265-916f-341b3310e0bc Oct 22 20:52:39.029966 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'id': '4b7b37aa-cd9d-4265-916f-341b3310e0bc'} Oct 22 20:52:39.029966 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:52:39.029966 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:52:39.029966 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 22 20:52:39.029966 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 22 20:52:39.029966 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 20:52:39.029966 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 20:52:39.029966 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 22 20:52:39.029966 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 22 20:52:39.029966 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 20:52:39.029966 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 20:52:39.029966 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 22 20:52:39.029966 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 22 20:52:39.029966 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 20:52:39.029966 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 20:52:39.029966 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 22 20:52:39.029966 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 22 20:52:39.029966 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 20:52:39.029966 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 20:52:39.029966 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 22 20:52:39.029966 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 22 20:52:39.029966 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 20:52:39.029966 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 20:52:39.029966 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 22 20:52:39.029966 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 22 20:52:39.029966 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 22 20:52:39.029966 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 22 20:52:39.029966 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 4b7b37aa-cd9d-4265-916f-341b3310e0bc could not be found Oct 22 20:52:39.029966 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1e7db0e3-b62b-42f3-96ca-1e2e8e4a49c8'] Oct 22 20:52:39.029966 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:52:39.034310 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:52:39.034310 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:52:39.034310 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:52:39.034310 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Oct 22 20:52:39.034310 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 22 20:52:39.034310 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 22 20:52:39.034310 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 22 20:52:39.034310 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 4b7b37aa-cd9d-4265-916f-341b3310e0bc. Oct 22 20:52:39.034310 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:52:39.034310 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:52:39.034310 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:52:39.034310 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:52:39.034310 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:52:39.034310 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:52:39.034310 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:52:39.034310 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:52:39.034310 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 22 20:52:39.034310 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 22 20:52:39.034310 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:52:39.034310 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:52:39.034310 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Oct 22 20:52:39.034310 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 22 20:52:39.034310 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 4b7b37aa-cd9d-4265-916f-341b3310e0bc Oct 22 20:52:39.034310 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:52:39.034310 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:52:39.034310 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:52:39.034310 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:52:39.034310 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:52:39.034310 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:52:39.034310 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 20:52:39.034310 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 20:52:39.034310 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 4b7b37aa-cd9d-4265-916f-341b3310e0bc Oct 22 20:52:39.034310 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:52:39.034310 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-76c6e5bc-44c1-41b3-98bf-25d2d80175dd tempest-FloatingIPsTestJSON-1036292101 tempest-FloatingIPsTestJSON-1036292101-project] Returning 404 to user: Floating IP not found for ID 4b7b37aa-cd9d-4265-916f-341b3310e0bc {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:52:39.034310 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-76c6e5bc-44c1-41b3-98bf-25d2d80175dd tempest-FloatingIPsTestJSON-1036292101 tempest-FloatingIPsTestJSON-1036292101-project] 10.222.0.18 "DELETE /compute/v2.1/os-floating-ips/4b7b37aa-cd9d-4265-916f-341b3310e0bc" status: 404 len: 111 microversion: 2.1 time: 0.057985 Oct 22 20:52:39.034310 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 529/1001] 10.222.0.18 () {58 vars in 1263 bytes} [Sat Oct 22 20:52:38 2022] DELETE /compute/v2.1/os-floating-ips/4b7b37aa-cd9d-4265-916f-341b3310e0bc => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 20:52:39.129029 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-dc8518f0-889e-47b3-a3fa-a1478f978fc9 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:52:39.130723 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-dc8518f0-889e-47b3-a3fa-a1478f978fc9 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] [instance: eb28d061-deba-4b37-88ab-1eee24d6bed3] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:52:39.134019 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:52:39.137862 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-dc8518f0-889e-47b3-a3fa-a1478f978fc9 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:39.138583 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-dc8518f0-889e-47b3-a3fa-a1478f978fc9 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:39.139198 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-dc8518f0-889e-47b3-a3fa-a1478f978fc9 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:39.140099 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-dc8518f0-889e-47b3-a3fa-a1478f978fc9 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:39.140706 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-dc8518f0-889e-47b3-a3fa-a1478f978fc9 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:39.141285 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-dc8518f0-889e-47b3-a3fa-a1478f978fc9 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:39.322246 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-b7647ba2-a2de-4534-acb5-c1b5b0b0318d tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:52:39.323020 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-b7647ba2-a2de-4534-acb5-c1b5b0b0318d tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] [instance: 58846d5b-1bfa-42cd-92a3-546b110ff64b] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:52:39.330953 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b7647ba2-a2de-4534-acb5-c1b5b0b0318d tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:39.331981 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b7647ba2-a2de-4534-acb5-c1b5b0b0318d tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:39.332620 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b7647ba2-a2de-4534-acb5-c1b5b0b0318d tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:39.333499 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b7647ba2-a2de-4534-acb5-c1b5b0b0318d tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:39.334439 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b7647ba2-a2de-4534-acb5-c1b5b0b0318d tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:39.335033 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b7647ba2-a2de-4534-acb5-c1b5b0b0318d tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:39.367218 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-dc8518f0-889e-47b3-a3fa-a1478f978fc9 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91cf84a287b74618ae1b3368785b0b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902e239d67664098895ab24340b0b780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:52:39.374994 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-dc8518f0-889e-47b3-a3fa-a1478f978fc9 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] 10.222.0.18 "GET /compute/v2.1/servers/eb28d061-deba-4b37-88ab-1eee24d6bed3" status: 200 len: 1317 microversion: 2.1 time: 0.250314 Oct 22 20:52:39.384092 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 473/1002] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:52:39 2022] GET /compute/v2.1/servers/eb28d061-deba-4b37-88ab-1eee24d6bed3 => generated 1317 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:52:39.395105 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-b7647ba2-a2de-4534-acb5-c1b5b0b0318d tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] [instance: 58846d5b-1bfa-42cd-92a3-546b110ff64b] Going to try to terminate instance {{(pid=138745) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 20:52:39.430970 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell1:SELECT=100 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:52:39.525809 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-b7647ba2-a2de-4534-acb5-c1b5b0b0318d tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] 10.222.0.18 "DELETE /compute/v2.1/servers/58846d5b-1bfa-42cd-92a3-546b110ff64b" status: 204 len: 0 microversion: 2.1 time: 0.206700 Oct 22 20:52:39.527072 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 530/1003] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 20:52:39 2022] DELETE /compute/v2.1/servers/58846d5b-1bfa-42cd-92a3-546b110ff64b => generated 0 bytes in 209 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 22 20:52:39.536602 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-b23d42df-a4a3-421e-b70e-a81da75a3cd5 tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:52:39.537939 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-b23d42df-a4a3-421e-b70e-a81da75a3cd5 tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] [instance: 58846d5b-1bfa-42cd-92a3-546b110ff64b] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:52:39.545014 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b23d42df-a4a3-421e-b70e-a81da75a3cd5 tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:39.546303 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b23d42df-a4a3-421e-b70e-a81da75a3cd5 tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:39.546936 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b23d42df-a4a3-421e-b70e-a81da75a3cd5 tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:39.547893 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b23d42df-a4a3-421e-b70e-a81da75a3cd5 tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:39.548575 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b23d42df-a4a3-421e-b70e-a81da75a3cd5 tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:39.549401 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b23d42df-a4a3-421e-b70e-a81da75a3cd5 tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:39.616028 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-53d60529-8a58-40d1-ab0c-f3657674e132 tempest-ImagesNegativeTestJSON-585030787 tempest-ImagesNegativeTestJSON-585030787-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:52:39.616899 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-53d60529-8a58-40d1-ab0c-f3657674e132 tempest-ImagesNegativeTestJSON-585030787 tempest-ImagesNegativeTestJSON-585030787-project] [instance: 950ff1c8-47a5-411f-bf47-efe6ff2982e4] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:52:39.626311 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-53d60529-8a58-40d1-ab0c-f3657674e132 tempest-ImagesNegativeTestJSON-585030787 tempest-ImagesNegativeTestJSON-585030787-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:39.626619 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-53d60529-8a58-40d1-ab0c-f3657674e132 tempest-ImagesNegativeTestJSON-585030787 tempest-ImagesNegativeTestJSON-585030787-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:39.627154 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-53d60529-8a58-40d1-ab0c-f3657674e132 tempest-ImagesNegativeTestJSON-585030787 tempest-ImagesNegativeTestJSON-585030787-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:39.628708 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-53d60529-8a58-40d1-ab0c-f3657674e132 tempest-ImagesNegativeTestJSON-585030787 tempest-ImagesNegativeTestJSON-585030787-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:39.628708 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-53d60529-8a58-40d1-ab0c-f3657674e132 tempest-ImagesNegativeTestJSON-585030787 tempest-ImagesNegativeTestJSON-585030787-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:39.629268 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-53d60529-8a58-40d1-ab0c-f3657674e132 tempest-ImagesNegativeTestJSON-585030787 tempest-ImagesNegativeTestJSON-585030787-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:39.852649 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-b23d42df-a4a3-421e-b70e-a81da75a3cd5 tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da7143c3bfb46a7b193a8d96f1b75b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598f129979a34e7a856b83bd0e69f1b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:52:39.878491 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-b23d42df-a4a3-421e-b70e-a81da75a3cd5 tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] 10.222.0.18 "GET /compute/v2.1/servers/58846d5b-1bfa-42cd-92a3-546b110ff64b" status: 200 len: 1608 microversion: 2.1 time: 0.343871 Oct 22 20:52:39.880238 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 474/1004] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:52:39 2022] GET /compute/v2.1/servers/58846d5b-1bfa-42cd-92a3-546b110ff64b => generated 1608 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 20:52:39.931094 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-53d60529-8a58-40d1-ab0c-f3657674e132 tempest-ImagesNegativeTestJSON-585030787 tempest-ImagesNegativeTestJSON-585030787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd553da484f5344169038bbe36a417699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '590a252c9203432eb15d9aef57cc3bb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:52:39.956074 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-53d60529-8a58-40d1-ab0c-f3657674e132 tempest-ImagesNegativeTestJSON-585030787 tempest-ImagesNegativeTestJSON-585030787-project] 10.222.0.18 "GET /compute/v2.1/servers/950ff1c8-47a5-411f-bf47-efe6ff2982e4" status: 200 len: 1316 microversion: 2.1 time: 0.346475 Oct 22 20:52:39.958384 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 531/1005] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:52:39 2022] GET /compute/v2.1/servers/950ff1c8-47a5-411f-bf47-efe6ff2982e4 => generated 1316 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:52:40.189399 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-429eb713-37bc-46e1-b2a8-b72691d09dce req-1f75ea1f-e5be-4d84-8ee0-b0814afc8108 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb28d061-deba-4b37-88ab-1eee24d6bed3", "name": "network-vif-plugged", "status": "completed", "tag": "eea7d66a-f230-41a5-a92f-93545da99415"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:52:40.200969 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-429eb713-37bc-46e1-b2a8-b72691d09dce req-1f75ea1f-e5be-4d84-8ee0-b0814afc8108 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:40.201987 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-429eb713-37bc-46e1-b2a8-b72691d09dce req-1f75ea1f-e5be-4d84-8ee0-b0814afc8108 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:40.202550 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-429eb713-37bc-46e1-b2a8-b72691d09dce req-1f75ea1f-e5be-4d84-8ee0-b0814afc8108 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:40.229216 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-429eb713-37bc-46e1-b2a8-b72691d09dce req-1f75ea1f-e5be-4d84-8ee0-b0814afc8108 service nova] Creating event network-vif-plugged:eea7d66a-f230-41a5-a92f-93545da99415 for instance eb28d061-deba-4b37-88ab-1eee24d6bed3 on nch1-master-1 Oct 22 20:52:40.245571 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-429eb713-37bc-46e1-b2a8-b72691d09dce req-1f75ea1f-e5be-4d84-8ee0-b0814afc8108 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059927 Oct 22 20:52:40.247008 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 475/1006] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:52:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:52:40.345196 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-4499b7c4-3942-436e-af87-240076b99cc6 req-22af9378-70e2-4f3c-8a63-c00d5f3eff68 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f2e1da0-4586-460b-94dc-768fd618dc3d", "tag": "4a4fea07-50e9-4003-ba39-6badf338429d"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:52:40.365325 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-4499b7c4-3942-436e-af87-240076b99cc6 req-22af9378-70e2-4f3c-8a63-c00d5f3eff68 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:40.365874 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-4499b7c4-3942-436e-af87-240076b99cc6 req-22af9378-70e2-4f3c-8a63-c00d5f3eff68 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:40.366265 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-4499b7c4-3942-436e-af87-240076b99cc6 req-22af9378-70e2-4f3c-8a63-c00d5f3eff68 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:40.393380 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-4499b7c4-3942-436e-af87-240076b99cc6 req-22af9378-70e2-4f3c-8a63-c00d5f3eff68 service nova] Creating event network-changed:4a4fea07-50e9-4003-ba39-6badf338429d for instance 8f2e1da0-4586-460b-94dc-768fd618dc3d on nch1-master-1 Oct 22 20:52:40.400630 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-513ffdfc-3ddd-468b-b416-fbb6f2759444 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:52:40.401354 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-513ffdfc-3ddd-468b-b416-fbb6f2759444 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] [instance: eb28d061-deba-4b37-88ab-1eee24d6bed3] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:52:40.408790 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-4499b7c4-3942-436e-af87-240076b99cc6 req-22af9378-70e2-4f3c-8a63-c00d5f3eff68 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067616 Oct 22 20:52:40.412785 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 532/1007] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:52:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:52:40.420325 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-513ffdfc-3ddd-468b-b416-fbb6f2759444 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:40.422047 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-513ffdfc-3ddd-468b-b416-fbb6f2759444 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:40.422590 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-513ffdfc-3ddd-468b-b416-fbb6f2759444 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:40.426269 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-513ffdfc-3ddd-468b-b416-fbb6f2759444 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:40.428209 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-513ffdfc-3ddd-468b-b416-fbb6f2759444 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:40.429541 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-513ffdfc-3ddd-468b-b416-fbb6f2759444 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:40.869758 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-513ffdfc-3ddd-468b-b416-fbb6f2759444 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91cf84a287b74618ae1b3368785b0b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902e239d67664098895ab24340b0b780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:52:40.878871 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-513ffdfc-3ddd-468b-b416-fbb6f2759444 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] 10.222.0.18 "GET /compute/v2.1/servers/eb28d061-deba-4b37-88ab-1eee24d6bed3" status: 200 len: 1317 microversion: 2.1 time: 0.484180 Oct 22 20:52:40.893963 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 476/1008] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:52:40 2022] GET /compute/v2.1/servers/eb28d061-deba-4b37-88ab-1eee24d6bed3 => generated 1317 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 20:52:40.903194 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-b9567a15-451e-404c-896d-93fdef83d2fd tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:52:40.903965 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-b9567a15-451e-404c-896d-93fdef83d2fd tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] [instance: 58846d5b-1bfa-42cd-92a3-546b110ff64b] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:52:40.920156 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b9567a15-451e-404c-896d-93fdef83d2fd tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:40.920650 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b9567a15-451e-404c-896d-93fdef83d2fd tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:40.921088 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b9567a15-451e-404c-896d-93fdef83d2fd tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:40.921808 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b9567a15-451e-404c-896d-93fdef83d2fd tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:40.922263 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b9567a15-451e-404c-896d-93fdef83d2fd tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:40.922689 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b9567a15-451e-404c-896d-93fdef83d2fd tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:40.978851 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-c718cd08-8deb-4954-bf45-d2925fae0a60 tempest-ImagesNegativeTestJSON-585030787 tempest-ImagesNegativeTestJSON-585030787-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:52:40.979416 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-c718cd08-8deb-4954-bf45-d2925fae0a60 tempest-ImagesNegativeTestJSON-585030787 tempest-ImagesNegativeTestJSON-585030787-project] [instance: 950ff1c8-47a5-411f-bf47-efe6ff2982e4] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:52:40.991273 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c718cd08-8deb-4954-bf45-d2925fae0a60 tempest-ImagesNegativeTestJSON-585030787 tempest-ImagesNegativeTestJSON-585030787-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:40.992357 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c718cd08-8deb-4954-bf45-d2925fae0a60 tempest-ImagesNegativeTestJSON-585030787 tempest-ImagesNegativeTestJSON-585030787-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:40.993997 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c718cd08-8deb-4954-bf45-d2925fae0a60 tempest-ImagesNegativeTestJSON-585030787 tempest-ImagesNegativeTestJSON-585030787-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:40.994935 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c718cd08-8deb-4954-bf45-d2925fae0a60 tempest-ImagesNegativeTestJSON-585030787 tempest-ImagesNegativeTestJSON-585030787-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:40.996098 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c718cd08-8deb-4954-bf45-d2925fae0a60 tempest-ImagesNegativeTestJSON-585030787 tempest-ImagesNegativeTestJSON-585030787-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:40.996716 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c718cd08-8deb-4954-bf45-d2925fae0a60 tempest-ImagesNegativeTestJSON-585030787 tempest-ImagesNegativeTestJSON-585030787-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:41.751729 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-b9567a15-451e-404c-896d-93fdef83d2fd tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da7143c3bfb46a7b193a8d96f1b75b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598f129979a34e7a856b83bd0e69f1b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:52:41.757327 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-c718cd08-8deb-4954-bf45-d2925fae0a60 tempest-ImagesNegativeTestJSON-585030787 tempest-ImagesNegativeTestJSON-585030787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd553da484f5344169038bbe36a417699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '590a252c9203432eb15d9aef57cc3bb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:52:41.761024 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-b9567a15-451e-404c-896d-93fdef83d2fd tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] 10.222.0.18 "GET /compute/v2.1/servers/58846d5b-1bfa-42cd-92a3-546b110ff64b" status: 200 len: 1608 microversion: 2.1 time: 0.862512 Oct 22 20:52:41.761743 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 533/1009] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:52:40 2022] GET /compute/v2.1/servers/58846d5b-1bfa-42cd-92a3-546b110ff64b => generated 1608 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:52:41.765557 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-c718cd08-8deb-4954-bf45-d2925fae0a60 tempest-ImagesNegativeTestJSON-585030787 tempest-ImagesNegativeTestJSON-585030787-project] 10.222.0.18 "GET /compute/v2.1/servers/950ff1c8-47a5-411f-bf47-efe6ff2982e4" status: 200 len: 1316 microversion: 2.1 time: 0.791316 Oct 22 20:52:41.766129 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 477/1010] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:52:40 2022] GET /compute/v2.1/servers/950ff1c8-47a5-411f-bf47-efe6ff2982e4 => generated 1316 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:52:41.916612 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-23d8ceab-0289-49eb-8ad8-6988fe1a83b4 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:52:41.917972 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-23d8ceab-0289-49eb-8ad8-6988fe1a83b4 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] [instance: eb28d061-deba-4b37-88ab-1eee24d6bed3] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:52:41.931626 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-23d8ceab-0289-49eb-8ad8-6988fe1a83b4 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:41.932802 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-23d8ceab-0289-49eb-8ad8-6988fe1a83b4 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:41.933888 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-23d8ceab-0289-49eb-8ad8-6988fe1a83b4 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:41.938561 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-23d8ceab-0289-49eb-8ad8-6988fe1a83b4 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:41.939051 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-23d8ceab-0289-49eb-8ad8-6988fe1a83b4 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:41.939573 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-23d8ceab-0289-49eb-8ad8-6988fe1a83b4 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:42.307821 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-23d8ceab-0289-49eb-8ad8-6988fe1a83b4 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91cf84a287b74618ae1b3368785b0b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902e239d67664098895ab24340b0b780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:52:42.320782 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-23d8ceab-0289-49eb-8ad8-6988fe1a83b4 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] 10.222.0.18 "GET /compute/v2.1/servers/eb28d061-deba-4b37-88ab-1eee24d6bed3" status: 200 len: 1317 microversion: 2.1 time: 0.409093 Oct 22 20:52:42.322053 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 534/1011] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:52:41 2022] GET /compute/v2.1/servers/eb28d061-deba-4b37-88ab-1eee24d6bed3 => generated 1317 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:52:42.785289 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-8ac88c0f-b189-4e5b-96c9-6265eba482f3 tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:52:42.785991 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-8ac88c0f-b189-4e5b-96c9-6265eba482f3 tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] [instance: 58846d5b-1bfa-42cd-92a3-546b110ff64b] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:52:42.788651 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-f7dd25f4-a1a1-4e8e-aa78-5183e6581551 tempest-ImagesNegativeTestJSON-585030787 tempest-ImagesNegativeTestJSON-585030787-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:52:42.789629 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-f7dd25f4-a1a1-4e8e-aa78-5183e6581551 tempest-ImagesNegativeTestJSON-585030787 tempest-ImagesNegativeTestJSON-585030787-project] [instance: 950ff1c8-47a5-411f-bf47-efe6ff2982e4] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:52:42.799418 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f7dd25f4-a1a1-4e8e-aa78-5183e6581551 tempest-ImagesNegativeTestJSON-585030787 tempest-ImagesNegativeTestJSON-585030787-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:42.800058 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8ac88c0f-b189-4e5b-96c9-6265eba482f3 tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:42.800551 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8ac88c0f-b189-4e5b-96c9-6265eba482f3 tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:42.801145 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8ac88c0f-b189-4e5b-96c9-6265eba482f3 tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:42.802083 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8ac88c0f-b189-4e5b-96c9-6265eba482f3 tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:42.802472 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8ac88c0f-b189-4e5b-96c9-6265eba482f3 tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:42.803101 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8ac88c0f-b189-4e5b-96c9-6265eba482f3 tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:42.804315 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f7dd25f4-a1a1-4e8e-aa78-5183e6581551 tempest-ImagesNegativeTestJSON-585030787 tempest-ImagesNegativeTestJSON-585030787-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:42.804820 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f7dd25f4-a1a1-4e8e-aa78-5183e6581551 tempest-ImagesNegativeTestJSON-585030787 tempest-ImagesNegativeTestJSON-585030787-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:42.805555 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f7dd25f4-a1a1-4e8e-aa78-5183e6581551 tempest-ImagesNegativeTestJSON-585030787 tempest-ImagesNegativeTestJSON-585030787-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:42.808211 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f7dd25f4-a1a1-4e8e-aa78-5183e6581551 tempest-ImagesNegativeTestJSON-585030787 tempest-ImagesNegativeTestJSON-585030787-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:42.808950 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f7dd25f4-a1a1-4e8e-aa78-5183e6581551 tempest-ImagesNegativeTestJSON-585030787 tempest-ImagesNegativeTestJSON-585030787-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:43.154462 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-8ac88c0f-b189-4e5b-96c9-6265eba482f3 tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da7143c3bfb46a7b193a8d96f1b75b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598f129979a34e7a856b83bd0e69f1b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:52:43.187068 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-f7dd25f4-a1a1-4e8e-aa78-5183e6581551 tempest-ImagesNegativeTestJSON-585030787 tempest-ImagesNegativeTestJSON-585030787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd553da484f5344169038bbe36a417699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '590a252c9203432eb15d9aef57cc3bb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:52:43.204553 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-8ac88c0f-b189-4e5b-96c9-6265eba482f3 tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] 10.222.0.18 "GET /compute/v2.1/servers/58846d5b-1bfa-42cd-92a3-546b110ff64b" status: 200 len: 1608 microversion: 2.1 time: 0.423112 Oct 22 20:52:43.205156 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 478/1012] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:52:42 2022] GET /compute/v2.1/servers/58846d5b-1bfa-42cd-92a3-546b110ff64b => generated 1608 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:52:43.212661 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-f7dd25f4-a1a1-4e8e-aa78-5183e6581551 tempest-ImagesNegativeTestJSON-585030787 tempest-ImagesNegativeTestJSON-585030787-project] 10.222.0.18 "GET /compute/v2.1/servers/950ff1c8-47a5-411f-bf47-efe6ff2982e4" status: 200 len: 1316 microversion: 2.1 time: 0.419129 Oct 22 20:52:43.213423 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 535/1013] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:52:42 2022] GET /compute/v2.1/servers/950ff1c8-47a5-411f-bf47-efe6ff2982e4 => generated 1316 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:52:43.348213 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-992e7087-1f7f-465f-ac42-f9b792741874 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:52:43.348841 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-992e7087-1f7f-465f-ac42-f9b792741874 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] [instance: eb28d061-deba-4b37-88ab-1eee24d6bed3] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:52:43.355559 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-992e7087-1f7f-465f-ac42-f9b792741874 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:43.356272 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-992e7087-1f7f-465f-ac42-f9b792741874 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:43.356710 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-992e7087-1f7f-465f-ac42-f9b792741874 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:43.357407 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-992e7087-1f7f-465f-ac42-f9b792741874 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:43.357859 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-992e7087-1f7f-465f-ac42-f9b792741874 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:43.358250 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-992e7087-1f7f-465f-ac42-f9b792741874 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:43.670339 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-2dfdf595-fe07-49a6-9df6-ff2e210eb23f req-7a763f26-63e2-47a9-9381-4af09e90fc49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "950ff1c8-47a5-411f-bf47-efe6ff2982e4", "name": "network-vif-plugged", "status": "completed", "tag": "21b44edc-3131-4251-8cd6-045205274faa"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:52:43.699899 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-2dfdf595-fe07-49a6-9df6-ff2e210eb23f req-7a763f26-63e2-47a9-9381-4af09e90fc49 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:43.700415 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-2dfdf595-fe07-49a6-9df6-ff2e210eb23f req-7a763f26-63e2-47a9-9381-4af09e90fc49 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:43.701035 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-2dfdf595-fe07-49a6-9df6-ff2e210eb23f req-7a763f26-63e2-47a9-9381-4af09e90fc49 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:43.715010 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-2dfdf595-fe07-49a6-9df6-ff2e210eb23f req-7a763f26-63e2-47a9-9381-4af09e90fc49 service nova] Creating event network-vif-plugged:21b44edc-3131-4251-8cd6-045205274faa for instance 950ff1c8-47a5-411f-bf47-efe6ff2982e4 on nch2-master-1 Oct 22 20:52:43.728612 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-2dfdf595-fe07-49a6-9df6-ff2e210eb23f req-7a763f26-63e2-47a9-9381-4af09e90fc49 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063510 Oct 22 20:52:43.729838 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 536/1014] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:52:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 20:52:43.747056 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-992e7087-1f7f-465f-ac42-f9b792741874 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91cf84a287b74618ae1b3368785b0b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902e239d67664098895ab24340b0b780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:52:43.770421 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-992e7087-1f7f-465f-ac42-f9b792741874 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] 10.222.0.18 "GET /compute/v2.1/servers/eb28d061-deba-4b37-88ab-1eee24d6bed3" status: 200 len: 1466 microversion: 2.1 time: 0.426282 Oct 22 20:52:43.789850 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 479/1015] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:52:43 2022] GET /compute/v2.1/servers/eb28d061-deba-4b37-88ab-1eee24d6bed3 => generated 1466 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:52:43.803292 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-c0f26a4b-f6cc-4cc6-aac5-5db53ee56cf3 tempest-ServersOnMultiNodesTest-1015080240 tempest-ServersOnMultiNodesTest-1015080240-project-admin] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:52:43.804419 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-c0f26a4b-f6cc-4cc6-aac5-5db53ee56cf3 tempest-ServersOnMultiNodesTest-1015080240 tempest-ServersOnMultiNodesTest-1015080240-project-admin] [instance: eb28d061-deba-4b37-88ab-1eee24d6bed3] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:52:43.819999 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c0f26a4b-f6cc-4cc6-aac5-5db53ee56cf3 tempest-ServersOnMultiNodesTest-1015080240 tempest-ServersOnMultiNodesTest-1015080240-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:43.822856 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c0f26a4b-f6cc-4cc6-aac5-5db53ee56cf3 tempest-ServersOnMultiNodesTest-1015080240 tempest-ServersOnMultiNodesTest-1015080240-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:43.823531 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c0f26a4b-f6cc-4cc6-aac5-5db53ee56cf3 tempest-ServersOnMultiNodesTest-1015080240 tempest-ServersOnMultiNodesTest-1015080240-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:43.824317 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c0f26a4b-f6cc-4cc6-aac5-5db53ee56cf3 tempest-ServersOnMultiNodesTest-1015080240 tempest-ServersOnMultiNodesTest-1015080240-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:43.824735 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c0f26a4b-f6cc-4cc6-aac5-5db53ee56cf3 tempest-ServersOnMultiNodesTest-1015080240 tempest-ServersOnMultiNodesTest-1015080240-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:43.825162 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c0f26a4b-f6cc-4cc6-aac5-5db53ee56cf3 tempest-ServersOnMultiNodesTest-1015080240 tempest-ServersOnMultiNodesTest-1015080240-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:44.075646 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-61e6f994-5ef4-4d3f-85a8-2945238b6fae req-a5428f76-e94f-4ccf-bbad-ae7e68bcffdd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58846d5b-1bfa-42cd-92a3-546b110ff64b", "name": "network-vif-deleted", "tag": "6fea6402-4ea4-46cb-b608-a01b3e495aa0"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:52:44.109580 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-61e6f994-5ef4-4d3f-85a8-2945238b6fae req-a5428f76-e94f-4ccf-bbad-ae7e68bcffdd service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:44.113855 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-61e6f994-5ef4-4d3f-85a8-2945238b6fae req-a5428f76-e94f-4ccf-bbad-ae7e68bcffdd service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:44.117637 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-61e6f994-5ef4-4d3f-85a8-2945238b6fae req-a5428f76-e94f-4ccf-bbad-ae7e68bcffdd service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:44.141877 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-c0f26a4b-f6cc-4cc6-aac5-5db53ee56cf3 tempest-ServersOnMultiNodesTest-1015080240 tempest-ServersOnMultiNodesTest-1015080240-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/eb28d061-deba-4b37-88ab-1eee24d6bed3" status: 200 len: 1617 microversion: 2.1 time: 0.342024 Oct 22 20:52:44.143398 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 537/1016] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:52:43 2022] GET /compute/v2.1/servers/eb28d061-deba-4b37-88ab-1eee24d6bed3 => generated 1617 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:52:44.153901 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-61e6f994-5ef4-4d3f-85a8-2945238b6fae req-a5428f76-e94f-4ccf-bbad-ae7e68bcffdd service nova] Creating event network-vif-deleted:6fea6402-4ea4-46cb-b608-a01b3e495aa0 for instance 58846d5b-1bfa-42cd-92a3-546b110ff64b on nch1-master-1 Oct 22 20:52:44.159178 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-61e6f994-5ef4-4d3f-85a8-2945238b6fae req-a5428f76-e94f-4ccf-bbad-ae7e68bcffdd service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089701 Oct 22 20:52:44.163791 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 480/1017] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:52:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 20:52:44.168196 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-3575eb80-b4a9-481a-8de9-a7d192cdee21 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:52:44.168790 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-3575eb80-b4a9-481a-8de9-a7d192cdee21 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] [instance: eb28d061-deba-4b37-88ab-1eee24d6bed3] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:52:44.182263 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3575eb80-b4a9-481a-8de9-a7d192cdee21 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:44.182879 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3575eb80-b4a9-481a-8de9-a7d192cdee21 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:44.187969 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3575eb80-b4a9-481a-8de9-a7d192cdee21 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:44.191031 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3575eb80-b4a9-481a-8de9-a7d192cdee21 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:44.197925 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3575eb80-b4a9-481a-8de9-a7d192cdee21 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:44.203818 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3575eb80-b4a9-481a-8de9-a7d192cdee21 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:44.232353 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-45a2851e-e873-4ac0-b5e8-418ec68955db tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:52:44.233402 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-45a2851e-e873-4ac0-b5e8-418ec68955db tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] [instance: 58846d5b-1bfa-42cd-92a3-546b110ff64b] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:52:44.254639 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-3575eb80-b4a9-481a-8de9-a7d192cdee21 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] [instance: eb28d061-deba-4b37-88ab-1eee24d6bed3] Going to try to terminate instance {{(pid=138745) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 20:52:44.262919 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-45a2851e-e873-4ac0-b5e8-418ec68955db tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:44.263444 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-45a2851e-e873-4ac0-b5e8-418ec68955db tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:44.263889 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-45a2851e-e873-4ac0-b5e8-418ec68955db tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:44.264593 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-45a2851e-e873-4ac0-b5e8-418ec68955db tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:44.269200 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-45a2851e-e873-4ac0-b5e8-418ec68955db tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:44.269667 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-45a2851e-e873-4ac0-b5e8-418ec68955db tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:44.272914 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:SELECT=100 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:52:44.294973 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell0:SELECT=2 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:52:44.473304 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-3575eb80-b4a9-481a-8de9-a7d192cdee21 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] 10.222.0.18 "DELETE /compute/v2.1/servers/eb28d061-deba-4b37-88ab-1eee24d6bed3" status: 204 len: 0 microversion: 2.1 time: 0.305608 Oct 22 20:52:44.474913 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 538/1018] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 20:52:44 2022] DELETE /compute/v2.1/servers/eb28d061-deba-4b37-88ab-1eee24d6bed3 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 20:52:44.490835 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-6df8cc52-63f1-48c7-b97a-b7b335dc5282 tempest-ImagesNegativeTestJSON-585030787 tempest-ImagesNegativeTestJSON-585030787-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:52:44.493070 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-6df8cc52-63f1-48c7-b97a-b7b335dc5282 tempest-ImagesNegativeTestJSON-585030787 tempest-ImagesNegativeTestJSON-585030787-project] [instance: 950ff1c8-47a5-411f-bf47-efe6ff2982e4] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:52:44.510709 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6df8cc52-63f1-48c7-b97a-b7b335dc5282 tempest-ImagesNegativeTestJSON-585030787 tempest-ImagesNegativeTestJSON-585030787-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:44.512974 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6df8cc52-63f1-48c7-b97a-b7b335dc5282 tempest-ImagesNegativeTestJSON-585030787 tempest-ImagesNegativeTestJSON-585030787-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:44.514490 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6df8cc52-63f1-48c7-b97a-b7b335dc5282 tempest-ImagesNegativeTestJSON-585030787 tempest-ImagesNegativeTestJSON-585030787-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:44.516211 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6df8cc52-63f1-48c7-b97a-b7b335dc5282 tempest-ImagesNegativeTestJSON-585030787 tempest-ImagesNegativeTestJSON-585030787-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:44.517921 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6df8cc52-63f1-48c7-b97a-b7b335dc5282 tempest-ImagesNegativeTestJSON-585030787 tempest-ImagesNegativeTestJSON-585030787-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:44.519082 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6df8cc52-63f1-48c7-b97a-b7b335dc5282 tempest-ImagesNegativeTestJSON-585030787 tempest-ImagesNegativeTestJSON-585030787-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:44.942297 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-45a2851e-e873-4ac0-b5e8-418ec68955db tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da7143c3bfb46a7b193a8d96f1b75b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598f129979a34e7a856b83bd0e69f1b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:52:44.955904 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-45a2851e-e873-4ac0-b5e8-418ec68955db tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] 10.222.0.18 "GET /compute/v2.1/servers/58846d5b-1bfa-42cd-92a3-546b110ff64b" status: 200 len: 1252 microversion: 2.1 time: 0.729337 Oct 22 20:52:44.956790 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 481/1019] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:52:44 2022] GET /compute/v2.1/servers/58846d5b-1bfa-42cd-92a3-546b110ff64b => generated 1252 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:52:44.964022 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-cb499124-c075-4205-b270-23ec063147d4 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:52:44.966466 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-cb499124-c075-4205-b270-23ec063147d4 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] [instance: eb28d061-deba-4b37-88ab-1eee24d6bed3] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:52:44.975135 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cb499124-c075-4205-b270-23ec063147d4 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:44.975772 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cb499124-c075-4205-b270-23ec063147d4 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:44.976957 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cb499124-c075-4205-b270-23ec063147d4 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:44.977848 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cb499124-c075-4205-b270-23ec063147d4 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:44.978309 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cb499124-c075-4205-b270-23ec063147d4 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:44.978768 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cb499124-c075-4205-b270-23ec063147d4 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:45.197877 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-6df8cc52-63f1-48c7-b97a-b7b335dc5282 tempest-ImagesNegativeTestJSON-585030787 tempest-ImagesNegativeTestJSON-585030787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd553da484f5344169038bbe36a417699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '590a252c9203432eb15d9aef57cc3bb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:52:45.213128 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-6df8cc52-63f1-48c7-b97a-b7b335dc5282 tempest-ImagesNegativeTestJSON-585030787 tempest-ImagesNegativeTestJSON-585030787-project] 10.222.0.18 "GET /compute/v2.1/servers/950ff1c8-47a5-411f-bf47-efe6ff2982e4" status: 200 len: 1316 microversion: 2.1 time: 0.733083 Oct 22 20:52:45.220683 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 539/1020] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:52:44 2022] GET /compute/v2.1/servers/950ff1c8-47a5-411f-bf47-efe6ff2982e4 => generated 1316 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:52:45.280272 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-cb499124-c075-4205-b270-23ec063147d4 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91cf84a287b74618ae1b3368785b0b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902e239d67664098895ab24340b0b780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:52:45.288547 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-cb499124-c075-4205-b270-23ec063147d4 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] 10.222.0.18 "GET /compute/v2.1/servers/eb28d061-deba-4b37-88ab-1eee24d6bed3" status: 200 len: 1472 microversion: 2.1 time: 0.330450 Oct 22 20:52:45.289441 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 482/1021] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:52:44 2022] GET /compute/v2.1/servers/eb28d061-deba-4b37-88ab-1eee24d6bed3 => generated 1472 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:52:45.374854 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-d3408ce0-4dea-44ad-bfd5-a73d7188f4b4 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "58bc667d-d54e-4146-bcf2-33215200e583"}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:52:45.377732 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-d3408ce0-4dea-44ad-bfd5-a73d7188f4b4 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] [instance: c475672d-99ba-4c6a-abaa-3332a392534d] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:52:45.384582 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d3408ce0-4dea-44ad-bfd5-a73d7188f4b4 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:45.385311 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d3408ce0-4dea-44ad-bfd5-a73d7188f4b4 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:45.385752 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d3408ce0-4dea-44ad-bfd5-a73d7188f4b4 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:45.386461 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d3408ce0-4dea-44ad-bfd5-a73d7188f4b4 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:45.387065 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d3408ce0-4dea-44ad-bfd5-a73d7188f4b4 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:45.387685 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d3408ce0-4dea-44ad-bfd5-a73d7188f4b4 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:45.895905 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-d3408ce0-4dea-44ad-bfd5-a73d7188f4b4 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] 10.222.0.18 "POST /compute/v2.1/servers/c475672d-99ba-4c6a-abaa-3332a392534d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.524516 Oct 22 20:52:45.896929 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 540/1022] 10.222.0.18 () {60 vars in 1323 bytes} [Sat Oct 22 20:52:45 2022] POST /compute/v2.1/servers/c475672d-99ba-4c6a-abaa-3332a392534d/os-volume_attachments => generated 194 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:52:46.006184 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-d00a179d-1042-4d45-8e82-ac3ab5351b69 tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:52:46.007016 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-d00a179d-1042-4d45-8e82-ac3ab5351b69 tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] [instance: 58846d5b-1bfa-42cd-92a3-546b110ff64b] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:52:46.025265 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d00a179d-1042-4d45-8e82-ac3ab5351b69 tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:46.025980 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d00a179d-1042-4d45-8e82-ac3ab5351b69 tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:46.026615 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d00a179d-1042-4d45-8e82-ac3ab5351b69 tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:46.030010 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d00a179d-1042-4d45-8e82-ac3ab5351b69 tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:46.030675 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d00a179d-1042-4d45-8e82-ac3ab5351b69 tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:46.031301 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d00a179d-1042-4d45-8e82-ac3ab5351b69 tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:46.118654 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d00a179d-1042-4d45-8e82-ac3ab5351b69 tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:46.121307 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d00a179d-1042-4d45-8e82-ac3ab5351b69 tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:46.122060 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d00a179d-1042-4d45-8e82-ac3ab5351b69 tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:46.124166 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.objects.instance [None req-d00a179d-1042-4d45-8e82-ac3ab5351b69 tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Lazy-loading 'fault' on Instance uuid 58846d5b-1bfa-42cd-92a3-546b110ff64b {{(pid=138744) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 20:52:46.245737 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-d84d3fea-a4bd-4fef-ac75-273ff343d2c3 tempest-ImagesNegativeTestJSON-585030787 tempest-ImagesNegativeTestJSON-585030787-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:52:46.246673 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-d84d3fea-a4bd-4fef-ac75-273ff343d2c3 tempest-ImagesNegativeTestJSON-585030787 tempest-ImagesNegativeTestJSON-585030787-project] [instance: 950ff1c8-47a5-411f-bf47-efe6ff2982e4] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:52:46.251949 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-d00a179d-1042-4d45-8e82-ac3ab5351b69 tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da7143c3bfb46a7b193a8d96f1b75b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598f129979a34e7a856b83bd0e69f1b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:52:46.262657 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d84d3fea-a4bd-4fef-ac75-273ff343d2c3 tempest-ImagesNegativeTestJSON-585030787 tempest-ImagesNegativeTestJSON-585030787-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:46.263402 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d84d3fea-a4bd-4fef-ac75-273ff343d2c3 tempest-ImagesNegativeTestJSON-585030787 tempest-ImagesNegativeTestJSON-585030787-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:46.264174 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d84d3fea-a4bd-4fef-ac75-273ff343d2c3 tempest-ImagesNegativeTestJSON-585030787 tempest-ImagesNegativeTestJSON-585030787-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:46.272414 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d84d3fea-a4bd-4fef-ac75-273ff343d2c3 tempest-ImagesNegativeTestJSON-585030787 tempest-ImagesNegativeTestJSON-585030787-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:46.276811 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-d00a179d-1042-4d45-8e82-ac3ab5351b69 tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] 10.222.0.18 "GET /compute/v2.1/servers/58846d5b-1bfa-42cd-92a3-546b110ff64b" status: 200 len: 1257 microversion: 2.1 time: 0.286705 Oct 22 20:52:46.277498 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 483/1023] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:52:45 2022] GET /compute/v2.1/servers/58846d5b-1bfa-42cd-92a3-546b110ff64b => generated 1257 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:52:46.281432 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d84d3fea-a4bd-4fef-ac75-273ff343d2c3 tempest-ImagesNegativeTestJSON-585030787 tempest-ImagesNegativeTestJSON-585030787-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:46.282359 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d84d3fea-a4bd-4fef-ac75-273ff343d2c3 tempest-ImagesNegativeTestJSON-585030787 tempest-ImagesNegativeTestJSON-585030787-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:46.320649 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-d51e73ec-66bd-439d-af30-6fcbe3decceb tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:52:46.322645 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-d51e73ec-66bd-439d-af30-6fcbe3decceb tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] [instance: eb28d061-deba-4b37-88ab-1eee24d6bed3] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:52:46.346990 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d51e73ec-66bd-439d-af30-6fcbe3decceb tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:46.363440 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d51e73ec-66bd-439d-af30-6fcbe3decceb tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:46.364292 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d51e73ec-66bd-439d-af30-6fcbe3decceb tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:46.364924 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d51e73ec-66bd-439d-af30-6fcbe3decceb tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:46.365416 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d51e73ec-66bd-439d-af30-6fcbe3decceb tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:46.365860 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d51e73ec-66bd-439d-af30-6fcbe3decceb tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:46.877197 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-d84d3fea-a4bd-4fef-ac75-273ff343d2c3 tempest-ImagesNegativeTestJSON-585030787 tempest-ImagesNegativeTestJSON-585030787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd553da484f5344169038bbe36a417699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '590a252c9203432eb15d9aef57cc3bb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:52:46.881985 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-d51e73ec-66bd-439d-af30-6fcbe3decceb tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91cf84a287b74618ae1b3368785b0b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902e239d67664098895ab24340b0b780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:52:46.891768 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-d51e73ec-66bd-439d-af30-6fcbe3decceb tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] 10.222.0.18 "GET /compute/v2.1/servers/eb28d061-deba-4b37-88ab-1eee24d6bed3" status: 200 len: 1472 microversion: 2.1 time: 0.582670 Oct 22 20:52:46.892531 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-d84d3fea-a4bd-4fef-ac75-273ff343d2c3 tempest-ImagesNegativeTestJSON-585030787 tempest-ImagesNegativeTestJSON-585030787-project] 10.222.0.18 "GET /compute/v2.1/servers/950ff1c8-47a5-411f-bf47-efe6ff2982e4" status: 200 len: 1504 microversion: 2.1 time: 0.653285 Oct 22 20:52:46.892718 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 484/1024] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:52:46 2022] GET /compute/v2.1/servers/eb28d061-deba-4b37-88ab-1eee24d6bed3 => generated 1472 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 20:52:46.894279 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 541/1025] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:52:46 2022] GET /compute/v2.1/servers/950ff1c8-47a5-411f-bf47-efe6ff2982e4 => generated 1504 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 20:52:46.917262 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-5f1b97e8-3033-4fac-bbca-5d50f7feffd0 tempest-ImagesNegativeTestJSON-585030787 tempest-ImagesNegativeTestJSON-585030787-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:52:46.918245 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-5f1b97e8-3033-4fac-bbca-5d50f7feffd0 tempest-ImagesNegativeTestJSON-585030787 tempest-ImagesNegativeTestJSON-585030787-project] [instance: 950ff1c8-47a5-411f-bf47-efe6ff2982e4] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:52:46.925681 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5f1b97e8-3033-4fac-bbca-5d50f7feffd0 tempest-ImagesNegativeTestJSON-585030787 tempest-ImagesNegativeTestJSON-585030787-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:46.927104 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5f1b97e8-3033-4fac-bbca-5d50f7feffd0 tempest-ImagesNegativeTestJSON-585030787 tempest-ImagesNegativeTestJSON-585030787-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:46.928243 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5f1b97e8-3033-4fac-bbca-5d50f7feffd0 tempest-ImagesNegativeTestJSON-585030787 tempest-ImagesNegativeTestJSON-585030787-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:46.929650 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5f1b97e8-3033-4fac-bbca-5d50f7feffd0 tempest-ImagesNegativeTestJSON-585030787 tempest-ImagesNegativeTestJSON-585030787-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:46.930437 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5f1b97e8-3033-4fac-bbca-5d50f7feffd0 tempest-ImagesNegativeTestJSON-585030787 tempest-ImagesNegativeTestJSON-585030787-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:46.931097 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5f1b97e8-3033-4fac-bbca-5d50f7feffd0 tempest-ImagesNegativeTestJSON-585030787 tempest-ImagesNegativeTestJSON-585030787-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:46.965832 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-5f1b97e8-3033-4fac-bbca-5d50f7feffd0 tempest-ImagesNegativeTestJSON-585030787 tempest-ImagesNegativeTestJSON-585030787-project] [instance: 950ff1c8-47a5-411f-bf47-efe6ff2982e4] Going to try to terminate instance {{(pid=138744) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 20:52:47.177465 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-26f1efc4-521e-4583-a733-f687ef56c008 req-5d2e9e6d-32b4-4702-a29b-3dedfe155190 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb28d061-deba-4b37-88ab-1eee24d6bed3", "name": "network-vif-deleted", "tag": "eea7d66a-f230-41a5-a92f-93545da99415"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:52:47.178115 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-5f1b97e8-3033-4fac-bbca-5d50f7feffd0 tempest-ImagesNegativeTestJSON-585030787 tempest-ImagesNegativeTestJSON-585030787-project] 10.222.0.18 "DELETE /compute/v2.1/servers/950ff1c8-47a5-411f-bf47-efe6ff2982e4" status: 204 len: 0 microversion: 2.1 time: 0.263193 Oct 22 20:52:47.181112 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 485/1026] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 20:52:46 2022] DELETE /compute/v2.1/servers/950ff1c8-47a5-411f-bf47-efe6ff2982e4 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 20:52:47.193715 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-26f1efc4-521e-4583-a733-f687ef56c008 req-5d2e9e6d-32b4-4702-a29b-3dedfe155190 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:47.194523 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-26f1efc4-521e-4583-a733-f687ef56c008 req-5d2e9e6d-32b4-4702-a29b-3dedfe155190 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:47.195144 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-26f1efc4-521e-4583-a733-f687ef56c008 req-5d2e9e6d-32b4-4702-a29b-3dedfe155190 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:47.200593 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-d1e9c22c-d740-4124-8992-fe8f01f1200f tempest-ImagesNegativeTestJSON-585030787 tempest-ImagesNegativeTestJSON-585030787-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:52:47.202081 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-d1e9c22c-d740-4124-8992-fe8f01f1200f tempest-ImagesNegativeTestJSON-585030787 tempest-ImagesNegativeTestJSON-585030787-project] [instance: 950ff1c8-47a5-411f-bf47-efe6ff2982e4] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:52:47.213508 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d1e9c22c-d740-4124-8992-fe8f01f1200f tempest-ImagesNegativeTestJSON-585030787 tempest-ImagesNegativeTestJSON-585030787-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:47.216850 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d1e9c22c-d740-4124-8992-fe8f01f1200f tempest-ImagesNegativeTestJSON-585030787 tempest-ImagesNegativeTestJSON-585030787-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:47.224811 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d1e9c22c-d740-4124-8992-fe8f01f1200f tempest-ImagesNegativeTestJSON-585030787 tempest-ImagesNegativeTestJSON-585030787-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:47.226212 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d1e9c22c-d740-4124-8992-fe8f01f1200f tempest-ImagesNegativeTestJSON-585030787 tempest-ImagesNegativeTestJSON-585030787-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:47.227180 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d1e9c22c-d740-4124-8992-fe8f01f1200f tempest-ImagesNegativeTestJSON-585030787 tempest-ImagesNegativeTestJSON-585030787-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:47.227873 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d1e9c22c-d740-4124-8992-fe8f01f1200f tempest-ImagesNegativeTestJSON-585030787 tempest-ImagesNegativeTestJSON-585030787-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:47.240242 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-26f1efc4-521e-4583-a733-f687ef56c008 req-5d2e9e6d-32b4-4702-a29b-3dedfe155190 service nova] Creating event network-vif-deleted:eea7d66a-f230-41a5-a92f-93545da99415 for instance eb28d061-deba-4b37-88ab-1eee24d6bed3 on nch1-master-1 Oct 22 20:52:47.256933 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-26f1efc4-521e-4583-a733-f687ef56c008 req-5d2e9e6d-32b4-4702-a29b-3dedfe155190 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083626 Oct 22 20:52:47.258525 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 542/1027] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:52:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 20:52:47.312218 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-4bf67a19-9f04-4ca4-b7dc-71ab30f6886e tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:52:47.313581 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-4bf67a19-9f04-4ca4-b7dc-71ab30f6886e tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] [instance: 58846d5b-1bfa-42cd-92a3-546b110ff64b] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:52:47.330308 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4bf67a19-9f04-4ca4-b7dc-71ab30f6886e tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:47.340838 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4bf67a19-9f04-4ca4-b7dc-71ab30f6886e tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:47.345794 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4bf67a19-9f04-4ca4-b7dc-71ab30f6886e tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:47.353869 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4bf67a19-9f04-4ca4-b7dc-71ab30f6886e tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:47.354871 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4bf67a19-9f04-4ca4-b7dc-71ab30f6886e tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:47.355507 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4bf67a19-9f04-4ca4-b7dc-71ab30f6886e tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:47.377215 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.wsgi [None req-4bf67a19-9f04-4ca4-b7dc-71ab30f6886e tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] HTTP exception thrown: Instance 58846d5b-1bfa-42cd-92a3-546b110ff64b could not be found. Oct 22 20:52:47.380115 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-4bf67a19-9f04-4ca4-b7dc-71ab30f6886e tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Request method failure captured: Oct 22 20:52:47.380115 ncdv-master-1 devstack@n-api.service[138745]: request: GET /compute/v2.1/servers/58846d5b-1bfa-42cd-92a3-546b110ff64b HTTP/1.1 Oct 22 20:52:47.380115 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 20:52:47.380115 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 20:52:47.380115 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 20:52:47.380115 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 0 Oct 22 20:52:47.380115 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 20:52:47.380115 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 20:52:47.380115 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 20:52:47.380115 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 20:52:47.380115 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVFd9Is49mbEwtuViDB8W5d6pUX5zqzzDxjxFKSiyHMcL2GE4MeRDoVoe041ozybFhsDi3fkivEM6h51PTYTkPkMFb54PyRus3rMV086BiSFWkAgjn4y-etn8wP-yGU3OYt_HgCnSD7lsic8gCoNdVH-i5JpO5YXq87oCp7-VfqRd5jY Oct 22 20:52:47.380115 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 20:52:47.380115 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 20:52:47.380115 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 20:52:47.380115 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 20:52:47.380115 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 20:52:47.380115 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 20:52:47.380115 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: 598f129979a34e7a856b83bd0e69f1b5 Oct 22 20:52:47.380115 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-ServersTestBootFromVolume-802420894 Oct 22 20:52:47.380115 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 20:52:47.380115 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 20:52:47.380115 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_598f129979a34e7a856b83bd0e69f1b5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/598f129979a34e7a856b83bd0e69f1b5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/598f129979a34e7a856b83bd0e69f1b5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/598f129979a34e7a856b83bd0e69f1b5"}]}] Oct 22 20:52:47.380115 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-ServersTestBootFromVolume-802420894 Oct 22 20:52:47.380115 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: 598f129979a34e7a856b83bd0e69f1b5 Oct 22 20:52:47.380115 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-ServersTestBootFromVolume-802420894 Oct 22 20:52:47.380115 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-ServersTestBootFromVolume-802420894-project Oct 22 20:52:47.380115 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 20:52:47.380115 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 20:52:47.380115 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: 6da7143c3bfb46a7b193a8d96f1b75b2 Oct 22 20:52:47.380115 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-ServersTestBootFromVolume-802420894-project Oct 22 20:52:47.380115 ncdv-master-1 devstack@n-api.service[138745]: method: > Oct 22 20:52:47.380115 ncdv-master-1 devstack@n-api.service[138745]: exception: Instance 58846d5b-1bfa-42cd-92a3-546b110ff64b could not be found. Oct 22 20:52:47.380115 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'id': '58846d5b-1bfa-42cd-92a3-546b110ff64b'} Oct 22 20:52:47.380115 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:52:47.380115 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:52:47.380115 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 20:52:47.380115 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 20:52:47.380115 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 20:52:47.380115 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 20:52:47.380115 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 20:52:47.380115 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 20:52:47.380115 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 20:52:47.380115 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 20:52:47.380115 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58846d5b-1bfa-42cd-92a3-546b110ff64b could not be found. Oct 22 20:52:47.380115 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:52:47.380115 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:52:47.380115 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:52:47.380115 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:52:47.380115 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:52:47.380115 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:52:47.380115 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:52:47.380115 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:52:47.380115 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:52:47.380115 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:52:47.380115 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 20:52:47.380115 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 20:52:47.380115 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 20:52:47.380115 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 20:52:47.380115 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 20:52:47.380115 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 20:52:47.380115 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58846d5b-1bfa-42cd-92a3-546b110ff64b could not be found. Oct 22 20:52:47.380115 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:52:47.380115 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:52:47.380115 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:52:47.386186 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:52:47.386186 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:52:47.386186 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:52:47.386186 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 20:52:47.386186 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 20:52:47.386186 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58846d5b-1bfa-42cd-92a3-546b110ff64b could not be found. Oct 22 20:52:47.386186 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:52:47.386730 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-4bf67a19-9f04-4ca4-b7dc-71ab30f6886e tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Returning 404 to user: Instance 58846d5b-1bfa-42cd-92a3-546b110ff64b could not be found. {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:52:47.388054 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-4bf67a19-9f04-4ca4-b7dc-71ab30f6886e tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] 10.222.0.18 "GET /compute/v2.1/servers/58846d5b-1bfa-42cd-92a3-546b110ff64b" status: 404 len: 111 microversion: 2.1 time: 0.087094 Oct 22 20:52:47.389108 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 543/1028] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:52:47 2022] GET /compute/v2.1/servers/58846d5b-1bfa-42cd-92a3-546b110ff64b => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 20:52:47.406143 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-4e413390-e1c1-4551-9a77-e71dc0155d57 tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] Calling method '.version_select at 0x7fd3a4108280>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:52:47.451703 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-4e413390-e1c1-4551-9a77-e71dc0155d57 tempest-ServersTestBootFromVolume-802420894 tempest-ServersTestBootFromVolume-802420894-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-578928425" status: 202 len: 0 microversion: 2.1 time: 0.057371 Oct 22 20:52:47.452807 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 544/1029] 10.222.0.18 () {58 vars in 1218 bytes} [Sat Oct 22 20:52:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-578928425 => generated 0 bytes in 60 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 20:52:47.587654 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-d1e9c22c-d740-4124-8992-fe8f01f1200f tempest-ImagesNegativeTestJSON-585030787 tempest-ImagesNegativeTestJSON-585030787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd553da484f5344169038bbe36a417699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '590a252c9203432eb15d9aef57cc3bb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:52:47.605812 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-d1e9c22c-d740-4124-8992-fe8f01f1200f tempest-ImagesNegativeTestJSON-585030787 tempest-ImagesNegativeTestJSON-585030787-project] 10.222.0.18 "GET /compute/v2.1/servers/950ff1c8-47a5-411f-bf47-efe6ff2982e4" status: 200 len: 1510 microversion: 2.1 time: 0.415816 Oct 22 20:52:47.611831 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 486/1030] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:52:47 2022] GET /compute/v2.1/servers/950ff1c8-47a5-411f-bf47-efe6ff2982e4 => generated 1510 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:52:47.915678 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-83f2f103-c6cb-4199-937d-b48e0576463a tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:52:47.918014 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-83f2f103-c6cb-4199-937d-b48e0576463a tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] [instance: eb28d061-deba-4b37-88ab-1eee24d6bed3] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:52:47.925409 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-83f2f103-c6cb-4199-937d-b48e0576463a tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:47.926874 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-83f2f103-c6cb-4199-937d-b48e0576463a tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:47.927606 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-83f2f103-c6cb-4199-937d-b48e0576463a tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:47.928779 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-83f2f103-c6cb-4199-937d-b48e0576463a tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:47.929537 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-83f2f103-c6cb-4199-937d-b48e0576463a tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:47.930191 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-83f2f103-c6cb-4199-937d-b48e0576463a tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:47.970018 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-83f2f103-c6cb-4199-937d-b48e0576463a tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:47.970663 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-83f2f103-c6cb-4199-937d-b48e0576463a tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:47.972108 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-83f2f103-c6cb-4199-937d-b48e0576463a tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:47.972821 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.objects.instance [None req-83f2f103-c6cb-4199-937d-b48e0576463a tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lazy-loading 'fault' on Instance uuid eb28d061-deba-4b37-88ab-1eee24d6bed3 {{(pid=138745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 20:52:48.021636 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-83f2f103-c6cb-4199-937d-b48e0576463a tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91cf84a287b74618ae1b3368785b0b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902e239d67664098895ab24340b0b780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:52:48.031460 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-83f2f103-c6cb-4199-937d-b48e0576463a tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] 10.222.0.18 "GET /compute/v2.1/servers/eb28d061-deba-4b37-88ab-1eee24d6bed3" status: 200 len: 1307 microversion: 2.1 time: 0.121008 Oct 22 20:52:48.032662 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 545/1031] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:52:47 2022] GET /compute/v2.1/servers/eb28d061-deba-4b37-88ab-1eee24d6bed3 => generated 1307 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:52:48.150548 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-645cff03-9124-4e8c-bf7e-42ea561e3b9c tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerTestJSON-server-689003358", "imageRef": "085e4478-6edc-4a69-8e08-f9831713eb65", "flavorRef": "452"}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:52:48.204929 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.network.neutron [None req-645cff03-9124-4e8c-bf7e-42ea561e3b9c tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] validate_networks() for None {{(pid=138744) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 20:52:48.436494 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-645cff03-9124-4e8c-bf7e-42ea561e3b9c tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Flavor limits 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 20:52:48.436926 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-645cff03-9124-4e8c-bf7e-42ea561e3b9c tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Image limits 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 20:52:48.437402 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-645cff03-9124-4e8c-bf7e-42ea561e3b9c tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Flavor pref 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 20:52:48.437879 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-645cff03-9124-4e8c-bf7e-42ea561e3b9c tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Image pref 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 20:52:48.438291 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-645cff03-9124-4e8c-bf7e-42ea561e3b9c tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 20:52:48.445412 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell0:SELECT=23 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:52:48.447882 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-645cff03-9124-4e8c-bf7e-42ea561e3b9c tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:48.448360 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-645cff03-9124-4e8c-bf7e-42ea561e3b9c tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:48.448803 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-645cff03-9124-4e8c-bf7e-42ea561e3b9c tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:48.449525 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-645cff03-9124-4e8c-bf7e-42ea561e3b9c tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:48.449972 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-645cff03-9124-4e8c-bf7e-42ea561e3b9c tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:48.450401 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-645cff03-9124-4e8c-bf7e-42ea561e3b9c tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:48.457846 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell0:SELECT=9 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:52:48.469892 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-645cff03-9124-4e8c-bf7e-42ea561e3b9c tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Getting quotas for project 0400ae826f8e4bd8a2e4c981880a59c5. Resources: {'cores', 'instances', 'ram'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 20:52:48.475091 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-645cff03-9124-4e8c-bf7e-42ea561e3b9c tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Getting quotas for user 01ba79ccd0d940a2899a035635862219 and project 0400ae826f8e4bd8a2e4c981880a59c5. Resources: {'cores', 'instances', 'ram'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 20:52:48.487917 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-645cff03-9124-4e8c-bf7e-42ea561e3b9c tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Going to run 1 instances... {{(pid=138744) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 20:52:48.490304 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-645cff03-9124-4e8c-bf7e-42ea561e3b9c tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] [instance: 472bbccc-485e-43ce-a9cd-a3148bfccdbd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='085e4478-6edc-4a69-8e08-f9831713eb65',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138744) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 20:52:48.550484 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-645cff03-9124-4e8c-bf7e-42ea561e3b9c tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.550328 Oct 22 20:52:48.558796 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 487/1032] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Oct 22 20:52:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 559 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 20:52:48.564184 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-17117f44-60fa-426c-9294-f091c8ae7f7c tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:52:48.565409 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-17117f44-60fa-426c-9294-f091c8ae7f7c tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] [instance: 472bbccc-485e-43ce-a9cd-a3148bfccdbd] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:52:48.567501 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell0:SELECT=2 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:52:48.635576 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-61b30e9e-f9de-4922-af99-e7cb6d6ecb1a tempest-ImagesNegativeTestJSON-585030787 tempest-ImagesNegativeTestJSON-585030787-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:52:48.636213 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-61b30e9e-f9de-4922-af99-e7cb6d6ecb1a tempest-ImagesNegativeTestJSON-585030787 tempest-ImagesNegativeTestJSON-585030787-project] [instance: 950ff1c8-47a5-411f-bf47-efe6ff2982e4] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:52:48.644524 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-61b30e9e-f9de-4922-af99-e7cb6d6ecb1a tempest-ImagesNegativeTestJSON-585030787 tempest-ImagesNegativeTestJSON-585030787-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:48.645467 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-61b30e9e-f9de-4922-af99-e7cb6d6ecb1a tempest-ImagesNegativeTestJSON-585030787 tempest-ImagesNegativeTestJSON-585030787-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:48.646061 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-61b30e9e-f9de-4922-af99-e7cb6d6ecb1a tempest-ImagesNegativeTestJSON-585030787 tempest-ImagesNegativeTestJSON-585030787-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:48.646944 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-61b30e9e-f9de-4922-af99-e7cb6d6ecb1a tempest-ImagesNegativeTestJSON-585030787 tempest-ImagesNegativeTestJSON-585030787-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:48.647423 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-61b30e9e-f9de-4922-af99-e7cb6d6ecb1a tempest-ImagesNegativeTestJSON-585030787 tempest-ImagesNegativeTestJSON-585030787-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:48.647939 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-61b30e9e-f9de-4922-af99-e7cb6d6ecb1a tempest-ImagesNegativeTestJSON-585030787 tempest-ImagesNegativeTestJSON-585030787-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:48.665691 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-17117f44-60fa-426c-9294-f091c8ae7f7c tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01ba79ccd0d940a2899a035635862219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0400ae826f8e4bd8a2e4c981880a59c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:52:48.673697 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-17117f44-60fa-426c-9294-f091c8ae7f7c tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] 10.222.0.18 "GET /compute/v2.1/servers/472bbccc-485e-43ce-a9cd-a3148bfccdbd" status: 200 len: 1216 microversion: 2.1 time: 0.113517 Oct 22 20:52:48.675149 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 546/1033] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:52:48 2022] GET /compute/v2.1/servers/472bbccc-485e-43ce-a9cd-a3148bfccdbd => generated 1216 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:52:48.808775 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-61b30e9e-f9de-4922-af99-e7cb6d6ecb1a tempest-ImagesNegativeTestJSON-585030787 tempest-ImagesNegativeTestJSON-585030787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd553da484f5344169038bbe36a417699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '590a252c9203432eb15d9aef57cc3bb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:52:48.823723 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-61b30e9e-f9de-4922-af99-e7cb6d6ecb1a tempest-ImagesNegativeTestJSON-585030787 tempest-ImagesNegativeTestJSON-585030787-project] 10.222.0.18 "GET /compute/v2.1/servers/950ff1c8-47a5-411f-bf47-efe6ff2982e4" status: 200 len: 1510 microversion: 2.1 time: 0.193416 Oct 22 20:52:48.826326 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 488/1034] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:52:48 2022] GET /compute/v2.1/servers/950ff1c8-47a5-411f-bf47-efe6ff2982e4 => generated 1510 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 20:52:49.055573 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-2e2238fc-c434-44c0-ac77-62988644fdde tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:52:49.056618 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-2e2238fc-c434-44c0-ac77-62988644fdde tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] [instance: eb28d061-deba-4b37-88ab-1eee24d6bed3] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:52:49.064919 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2e2238fc-c434-44c0-ac77-62988644fdde tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:49.065421 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2e2238fc-c434-44c0-ac77-62988644fdde tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:49.066062 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2e2238fc-c434-44c0-ac77-62988644fdde tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:49.066692 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2e2238fc-c434-44c0-ac77-62988644fdde tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:49.067153 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2e2238fc-c434-44c0-ac77-62988644fdde tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:49.067604 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2e2238fc-c434-44c0-ac77-62988644fdde tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:49.082692 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.wsgi [None req-2e2238fc-c434-44c0-ac77-62988644fdde tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] HTTP exception thrown: Instance eb28d061-deba-4b37-88ab-1eee24d6bed3 could not be found. Oct 22 20:52:49.084335 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-2e2238fc-c434-44c0-ac77-62988644fdde tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Request method failure captured: Oct 22 20:52:49.084335 ncdv-master-1 devstack@n-api.service[138745]: request: GET /compute/v2.1/servers/eb28d061-deba-4b37-88ab-1eee24d6bed3 HTTP/1.1 Oct 22 20:52:49.084335 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 20:52:49.084335 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 20:52:49.084335 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 20:52:49.084335 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 0 Oct 22 20:52:49.084335 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 20:52:49.084335 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 20:52:49.084335 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 20:52:49.084335 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 20:52:49.084335 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVFeL5NpvaUPvqiDt8qD72HqMh0DrXz0UtoQAeO42jMFpMPYqVC0YFDMA438gQzhAHNDHcP5InOc3xi8IB_k6cXq3If0lWEwoKo4DiRlB10MzTtg6EzpKpbfTqN9Yi6nvd2u_6U9lIt3lLKhkPDkM5OdhEDFJSGZOTF7Z9mtdL7wRjmc Oct 22 20:52:49.084335 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 20:52:49.084335 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 20:52:49.084335 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 20:52:49.084335 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 20:52:49.084335 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 20:52:49.084335 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 20:52:49.084335 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: 902e239d67664098895ab24340b0b780 Oct 22 20:52:49.084335 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-ServersOnMultiNodesTest-2081149331 Oct 22 20:52:49.084335 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 20:52:49.084335 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 20:52:49.084335 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_902e239d67664098895ab24340b0b780"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/902e239d67664098895ab24340b0b780"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/902e239d67664098895ab24340b0b780"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/902e239d67664098895ab24340b0b780"}]}] Oct 22 20:52:49.084335 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-ServersOnMultiNodesTest-2081149331 Oct 22 20:52:49.084335 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: 902e239d67664098895ab24340b0b780 Oct 22 20:52:49.084335 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-2081149331 Oct 22 20:52:49.084335 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-ServersOnMultiNodesTest-2081149331-project Oct 22 20:52:49.084335 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 20:52:49.084335 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 20:52:49.084335 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: 91cf84a287b74618ae1b3368785b0b4c Oct 22 20:52:49.084335 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-ServersOnMultiNodesTest-2081149331-project Oct 22 20:52:49.084335 ncdv-master-1 devstack@n-api.service[138745]: method: > Oct 22 20:52:49.084335 ncdv-master-1 devstack@n-api.service[138745]: exception: Instance eb28d061-deba-4b37-88ab-1eee24d6bed3 could not be found. Oct 22 20:52:49.084335 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'id': 'eb28d061-deba-4b37-88ab-1eee24d6bed3'} Oct 22 20:52:49.084335 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:52:49.084335 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:52:49.084335 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 20:52:49.084335 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 20:52:49.084335 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 20:52:49.084335 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 20:52:49.084335 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 20:52:49.084335 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 20:52:49.084335 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 20:52:49.084335 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 20:52:49.084335 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb28d061-deba-4b37-88ab-1eee24d6bed3 could not be found. Oct 22 20:52:49.084335 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:52:49.084335 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:52:49.084335 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:52:49.084335 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:52:49.084335 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:52:49.084335 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:52:49.084335 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:52:49.084335 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:52:49.084335 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:52:49.084335 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:52:49.084335 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 20:52:49.084335 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 20:52:49.084335 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 20:52:49.084335 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 20:52:49.084335 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 20:52:49.084335 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 20:52:49.084335 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb28d061-deba-4b37-88ab-1eee24d6bed3 could not be found. Oct 22 20:52:49.084335 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:52:49.084335 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:52:49.084335 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:52:49.089189 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:52:49.089189 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:52:49.089189 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:52:49.089189 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 20:52:49.089189 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 20:52:49.089189 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb28d061-deba-4b37-88ab-1eee24d6bed3 could not be found. Oct 22 20:52:49.089189 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:52:49.089189 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-2e2238fc-c434-44c0-ac77-62988644fdde tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Returning 404 to user: Instance eb28d061-deba-4b37-88ab-1eee24d6bed3 could not be found. {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:52:49.089189 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-2e2238fc-c434-44c0-ac77-62988644fdde tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] 10.222.0.18 "GET /compute/v2.1/servers/eb28d061-deba-4b37-88ab-1eee24d6bed3" status: 404 len: 111 microversion: 2.1 time: 0.034831 Oct 22 20:52:49.089189 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 547/1035] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:52:49 2022] GET /compute/v2.1/servers/eb28d061-deba-4b37-88ab-1eee24d6bed3 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 22 20:52:49.098347 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-b0f48944-4a1a-4e6b-afcc-2ea0e1dfb362 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:52:49.098925 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-b0f48944-4a1a-4e6b-afcc-2ea0e1dfb362 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] [instance: ea383564-25ff-4e81-9301-c8bcb13988c7] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:52:49.106122 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b0f48944-4a1a-4e6b-afcc-2ea0e1dfb362 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:49.106680 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b0f48944-4a1a-4e6b-afcc-2ea0e1dfb362 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:49.107434 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b0f48944-4a1a-4e6b-afcc-2ea0e1dfb362 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:49.108174 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b0f48944-4a1a-4e6b-afcc-2ea0e1dfb362 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:49.108697 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b0f48944-4a1a-4e6b-afcc-2ea0e1dfb362 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:49.109162 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b0f48944-4a1a-4e6b-afcc-2ea0e1dfb362 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:49.137404 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-b0f48944-4a1a-4e6b-afcc-2ea0e1dfb362 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] [instance: ea383564-25ff-4e81-9301-c8bcb13988c7] Going to try to terminate instance {{(pid=138744) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 20:52:49.235194 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-b0f48944-4a1a-4e6b-afcc-2ea0e1dfb362 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] 10.222.0.18 "DELETE /compute/v2.1/servers/ea383564-25ff-4e81-9301-c8bcb13988c7" status: 204 len: 0 microversion: 2.1 time: 0.139786 Oct 22 20:52:49.238761 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 489/1036] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 20:52:49 2022] DELETE /compute/v2.1/servers/ea383564-25ff-4e81-9301-c8bcb13988c7 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 20:52:49.251878 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-0959d3bb-240c-4e48-9f24-1ae7f6f04756 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:52:49.252736 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-0959d3bb-240c-4e48-9f24-1ae7f6f04756 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] [instance: ea383564-25ff-4e81-9301-c8bcb13988c7] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:52:49.259754 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0959d3bb-240c-4e48-9f24-1ae7f6f04756 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:49.260712 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0959d3bb-240c-4e48-9f24-1ae7f6f04756 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:49.261170 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0959d3bb-240c-4e48-9f24-1ae7f6f04756 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:49.261874 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0959d3bb-240c-4e48-9f24-1ae7f6f04756 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:49.262320 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0959d3bb-240c-4e48-9f24-1ae7f6f04756 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:49.263063 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0959d3bb-240c-4e48-9f24-1ae7f6f04756 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:49.281791 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell1:UPDATE=4,nova_cell1:SELECT=93,nova_cell1:INSERT=3 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:52:49.423582 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-0959d3bb-240c-4e48-9f24-1ae7f6f04756 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91cf84a287b74618ae1b3368785b0b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902e239d67664098895ab24340b0b780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:52:49.432988 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-0959d3bb-240c-4e48-9f24-1ae7f6f04756 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] 10.222.0.18 "GET /compute/v2.1/servers/ea383564-25ff-4e81-9301-c8bcb13988c7" status: 200 len: 1473 microversion: 2.1 time: 0.189002 Oct 22 20:52:49.435532 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 548/1037] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:52:49 2022] GET /compute/v2.1/servers/ea383564-25ff-4e81-9301-c8bcb13988c7 => generated 1473 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:52:49.502358 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-d3b494b2-69a1-4a3e-bfb3-c6c6a808cd67 req-6e71bcae-3bde-479b-b5f4-7cbce5759aed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "950ff1c8-47a5-411f-bf47-efe6ff2982e4", "name": "network-vif-deleted", "tag": "21b44edc-3131-4251-8cd6-045205274faa"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:52:49.532018 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-d3b494b2-69a1-4a3e-bfb3-c6c6a808cd67 req-6e71bcae-3bde-479b-b5f4-7cbce5759aed service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:49.532513 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-d3b494b2-69a1-4a3e-bfb3-c6c6a808cd67 req-6e71bcae-3bde-479b-b5f4-7cbce5759aed service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:49.533010 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-d3b494b2-69a1-4a3e-bfb3-c6c6a808cd67 req-6e71bcae-3bde-479b-b5f4-7cbce5759aed service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:49.547056 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-d3b494b2-69a1-4a3e-bfb3-c6c6a808cd67 req-6e71bcae-3bde-479b-b5f4-7cbce5759aed service nova] Creating event network-vif-deleted:21b44edc-3131-4251-8cd6-045205274faa for instance 950ff1c8-47a5-411f-bf47-efe6ff2982e4 on nch2-master-1 Oct 22 20:52:49.552323 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-d3b494b2-69a1-4a3e-bfb3-c6c6a808cd67 req-6e71bcae-3bde-479b-b5f4-7cbce5759aed service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055284 Oct 22 20:52:49.552971 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 490/1038] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:52:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:52:49.699619 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-b3f25cda-4386-4902-b9cb-b5ee38df8dd2 tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:52:49.702876 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-b3f25cda-4386-4902-b9cb-b5ee38df8dd2 tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] [instance: 472bbccc-485e-43ce-a9cd-a3148bfccdbd] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:52:49.725663 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b3f25cda-4386-4902-b9cb-b5ee38df8dd2 tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:49.726210 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b3f25cda-4386-4902-b9cb-b5ee38df8dd2 tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:49.729167 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b3f25cda-4386-4902-b9cb-b5ee38df8dd2 tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:49.733959 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b3f25cda-4386-4902-b9cb-b5ee38df8dd2 tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:49.734738 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b3f25cda-4386-4902-b9cb-b5ee38df8dd2 tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:49.735358 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b3f25cda-4386-4902-b9cb-b5ee38df8dd2 tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:49.852548 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-009c928c-55f0-41ad-83f7-94b43db40595 tempest-ImagesNegativeTestJSON-585030787 tempest-ImagesNegativeTestJSON-585030787-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:52:49.853537 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-009c928c-55f0-41ad-83f7-94b43db40595 tempest-ImagesNegativeTestJSON-585030787 tempest-ImagesNegativeTestJSON-585030787-project] [instance: 950ff1c8-47a5-411f-bf47-efe6ff2982e4] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:52:49.865294 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-009c928c-55f0-41ad-83f7-94b43db40595 tempest-ImagesNegativeTestJSON-585030787 tempest-ImagesNegativeTestJSON-585030787-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:49.873072 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-009c928c-55f0-41ad-83f7-94b43db40595 tempest-ImagesNegativeTestJSON-585030787 tempest-ImagesNegativeTestJSON-585030787-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:49.873715 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-009c928c-55f0-41ad-83f7-94b43db40595 tempest-ImagesNegativeTestJSON-585030787 tempest-ImagesNegativeTestJSON-585030787-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:49.874624 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-009c928c-55f0-41ad-83f7-94b43db40595 tempest-ImagesNegativeTestJSON-585030787 tempest-ImagesNegativeTestJSON-585030787-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:49.875391 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-009c928c-55f0-41ad-83f7-94b43db40595 tempest-ImagesNegativeTestJSON-585030787 tempest-ImagesNegativeTestJSON-585030787-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:49.875979 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-009c928c-55f0-41ad-83f7-94b43db40595 tempest-ImagesNegativeTestJSON-585030787 tempest-ImagesNegativeTestJSON-585030787-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:49.912830 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-b3f25cda-4386-4902-b9cb-b5ee38df8dd2 tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01ba79ccd0d940a2899a035635862219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0400ae826f8e4bd8a2e4c981880a59c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:52:49.936350 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-b3f25cda-4386-4902-b9cb-b5ee38df8dd2 tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] 10.222.0.18 "GET /compute/v2.1/servers/472bbccc-485e-43ce-a9cd-a3148bfccdbd" status: 200 len: 1220 microversion: 2.1 time: 0.241685 Oct 22 20:52:49.956394 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 549/1039] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:52:49 2022] GET /compute/v2.1/servers/472bbccc-485e-43ce-a9cd-a3148bfccdbd => generated 1220 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:52:50.017489 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-009c928c-55f0-41ad-83f7-94b43db40595 tempest-ImagesNegativeTestJSON-585030787 tempest-ImagesNegativeTestJSON-585030787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd553da484f5344169038bbe36a417699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '590a252c9203432eb15d9aef57cc3bb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:52:50.028903 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-009c928c-55f0-41ad-83f7-94b43db40595 tempest-ImagesNegativeTestJSON-585030787 tempest-ImagesNegativeTestJSON-585030787-project] 10.222.0.18 "GET /compute/v2.1/servers/950ff1c8-47a5-411f-bf47-efe6ff2982e4" status: 200 len: 1468 microversion: 2.1 time: 0.183683 Oct 22 20:52:50.029791 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 491/1040] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:52:49 2022] GET /compute/v2.1/servers/950ff1c8-47a5-411f-bf47-efe6ff2982e4 => generated 1468 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 20:52:50.456592 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-5d94ddbc-4d61-410d-a40e-eb9ab81e4ca3 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:52:50.458002 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-5d94ddbc-4d61-410d-a40e-eb9ab81e4ca3 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] [instance: ea383564-25ff-4e81-9301-c8bcb13988c7] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:52:50.474546 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5d94ddbc-4d61-410d-a40e-eb9ab81e4ca3 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:50.476142 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5d94ddbc-4d61-410d-a40e-eb9ab81e4ca3 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:50.477506 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5d94ddbc-4d61-410d-a40e-eb9ab81e4ca3 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:50.478503 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5d94ddbc-4d61-410d-a40e-eb9ab81e4ca3 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:50.479440 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5d94ddbc-4d61-410d-a40e-eb9ab81e4ca3 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:50.480267 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5d94ddbc-4d61-410d-a40e-eb9ab81e4ca3 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:50.693078 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-95c5c8f7-7a80-4ec7-87bf-44445fdd89a7 tempest-VolumesAdminNegativeTest-2068950585 tempest-VolumesAdminNegativeTest-2068950585-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "7d2e87bb-b589-4a8c-8ffb-041bc0c1e4fb"}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:52:50.697299 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-95c5c8f7-7a80-4ec7-87bf-44445fdd89a7 tempest-VolumesAdminNegativeTest-2068950585 tempest-VolumesAdminNegativeTest-2068950585-project-admin] [instance: c475672d-99ba-4c6a-abaa-3332a392534d] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:52:50.706505 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-95c5c8f7-7a80-4ec7-87bf-44445fdd89a7 tempest-VolumesAdminNegativeTest-2068950585 tempest-VolumesAdminNegativeTest-2068950585-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:50.707861 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-95c5c8f7-7a80-4ec7-87bf-44445fdd89a7 tempest-VolumesAdminNegativeTest-2068950585 tempest-VolumesAdminNegativeTest-2068950585-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:50.708544 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-95c5c8f7-7a80-4ec7-87bf-44445fdd89a7 tempest-VolumesAdminNegativeTest-2068950585 tempest-VolumesAdminNegativeTest-2068950585-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:50.709405 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-95c5c8f7-7a80-4ec7-87bf-44445fdd89a7 tempest-VolumesAdminNegativeTest-2068950585 tempest-VolumesAdminNegativeTest-2068950585-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:50.709976 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-95c5c8f7-7a80-4ec7-87bf-44445fdd89a7 tempest-VolumesAdminNegativeTest-2068950585 tempest-VolumesAdminNegativeTest-2068950585-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:50.710575 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-95c5c8f7-7a80-4ec7-87bf-44445fdd89a7 tempest-VolumesAdminNegativeTest-2068950585 tempest-VolumesAdminNegativeTest-2068950585-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:50.779047 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-5d94ddbc-4d61-410d-a40e-eb9ab81e4ca3 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91cf84a287b74618ae1b3368785b0b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902e239d67664098895ab24340b0b780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:52:50.789386 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-5d94ddbc-4d61-410d-a40e-eb9ab81e4ca3 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] 10.222.0.18 "GET /compute/v2.1/servers/ea383564-25ff-4e81-9301-c8bcb13988c7" status: 200 len: 1473 microversion: 2.1 time: 0.337235 Oct 22 20:52:50.791721 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 492/1041] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:52:50 2022] GET /compute/v2.1/servers/ea383564-25ff-4e81-9301-c8bcb13988c7 => generated 1473 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 20:52:50.981773 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-b4571fa3-8234-4430-bd74-4c2fdea32d72 tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:52:50.983077 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-b4571fa3-8234-4430-bd74-4c2fdea32d72 tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] [instance: 472bbccc-485e-43ce-a9cd-a3148bfccdbd] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:52:50.996235 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b4571fa3-8234-4430-bd74-4c2fdea32d72 tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:50.998764 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b4571fa3-8234-4430-bd74-4c2fdea32d72 tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:51.016109 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b4571fa3-8234-4430-bd74-4c2fdea32d72 tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:51.017252 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b4571fa3-8234-4430-bd74-4c2fdea32d72 tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:51.017774 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b4571fa3-8234-4430-bd74-4c2fdea32d72 tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:51.018190 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b4571fa3-8234-4430-bd74-4c2fdea32d72 tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:51.185894 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.wsgi [None req-95c5c8f7-7a80-4ec7-87bf-44445fdd89a7 tempest-VolumesAdminNegativeTest-2068950585 tempest-VolumesAdminNegativeTest-2068950585-project-admin] HTTP exception thrown: Volume 7d2e87bb-b589-4a8c-8ffb-041bc0c1e4fb could not be found. Oct 22 20:52:51.207313 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-b4571fa3-8234-4430-bd74-4c2fdea32d72 tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01ba79ccd0d940a2899a035635862219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0400ae826f8e4bd8a2e4c981880a59c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:52:51.220475 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-b4571fa3-8234-4430-bd74-4c2fdea32d72 tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] 10.222.0.18 "GET /compute/v2.1/servers/472bbccc-485e-43ce-a9cd-a3148bfccdbd" status: 200 len: 1276 microversion: 2.1 time: 0.245138 Oct 22 20:52:51.221088 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 493/1042] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:52:50 2022] GET /compute/v2.1/servers/472bbccc-485e-43ce-a9cd-a3148bfccdbd => generated 1276 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:52:51.222173 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-95c5c8f7-7a80-4ec7-87bf-44445fdd89a7 tempest-VolumesAdminNegativeTest-2068950585 tempest-VolumesAdminNegativeTest-2068950585-project-admin] Request method failure captured: Oct 22 20:52:51.222173 ncdv-master-1 devstack@n-api.service[138745]: request: PUT /compute/v2.1/servers/c475672d-99ba-4c6a-abaa-3332a392534d/os-volume_attachments/58bc667d-d54e-4146-bcf2-33215200e583 HTTP/1.1 Oct 22 20:52:51.222173 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 20:52:51.222173 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 20:52:51.222173 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 20:52:51.222173 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 74 Oct 22 20:52:51.222173 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 20:52:51.222173 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 20:52:51.222173 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 20:52:51.222173 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 20:52:51.222173 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVFelY17yFzd10HFRAnM8NLlkgq927QwD32EjaxJyKqPJ6CAajpUinHx_fAaHxu_HuZ6CRgUB2r_WWnp27sgpqGeLzirv3LwZsxYYmOrX2mdEWRdgEifiQXQqo3R_SHHTvf-oNsasY_XcD9y88wTuols6RdnyFtjMKTyQ8cLQC893lcs Oct 22 20:52:51.222173 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 20:52:51.222173 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 20:52:51.222173 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 20:52:51.222173 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 20:52:51.222173 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 20:52:51.222173 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 20:52:51.222173 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: 321cd01a30574c5abf2cd28db051492f Oct 22 20:52:51.222173 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-VolumesAdminNegativeTest-2068950585 Oct 22 20:52:51.222173 ncdv-master-1 devstack@n-api.service[138745]: X-Role: admin,member,reader Oct 22 20:52:51.222173 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: admin,member,reader Oct 22 20:52:51.222173 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_321cd01a30574c5abf2cd28db051492f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/321cd01a30574c5abf2cd28db051492f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/321cd01a30574c5abf2cd28db051492f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/321cd01a30574c5abf2cd28db051492f"}]}] Oct 22 20:52:51.222173 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-VolumesAdminNegativeTest-2068950585 Oct 22 20:52:51.222173 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: 321cd01a30574c5abf2cd28db051492f Oct 22 20:52:51.222173 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-2068950585 Oct 22 20:52:51.222173 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-VolumesAdminNegativeTest-2068950585-project-admin Oct 22 20:52:51.222173 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 20:52:51.222173 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 20:52:51.222173 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: 5d05db02c6db41409e308ce42c9e9361 Oct 22 20:52:51.222173 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-VolumesAdminNegativeTest-2068950585-project-admin Oct 22 20:52:51.222173 ncdv-master-1 devstack@n-api.service[138745]: Oct 22 20:52:51.222173 ncdv-master-1 devstack@n-api.service[138745]: {"volumeAttachment": {"volumeId": "7d2e87bb-b589-4a8c-8ffb-041bc0c1e4fb"}} Oct 22 20:52:51.222173 ncdv-master-1 devstack@n-api.service[138745]: method: > Oct 22 20:52:51.222173 ncdv-master-1 devstack@n-api.service[138745]: exception: Volume 7d2e87bb-b589-4a8c-8ffb-041bc0c1e4fb could not be found. Oct 22 20:52:51.222173 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'server_id': 'c475672d-99ba-4c6a-abaa-3332a392534d', 'id': '58bc667d-d54e-4146-bcf2-33215200e583', 'body': {'volumeAttachment': {'volumeId': '7d2e87bb-b589-4a8c-8ffb-041bc0c1e4fb'}}} Oct 22 20:52:51.222173 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:52:51.222173 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:52:51.222173 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 22 20:52:51.222173 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 22 20:52:51.222173 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 22 20:52:51.222173 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 22 20:52:51.222173 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 22 20:52:51.222173 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 22 20:52:51.222173 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 22 20:52:51.222173 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 22 20:52:51.222173 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 22 20:52:51.222173 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 22 20:52:51.222173 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 22 20:52:51.222173 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 22 20:52:51.222173 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 22 20:52:51.222173 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 22 20:52:51.222173 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 7d2e87bb-b589-4a8c-8ffb-041bc0c1e4fb could not be found. (HTTP 404) (Request-ID: req-9466c970-f65c-4ec9-9ee4-3180f3689f74) Oct 22 20:52:51.222173 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:52:51.222173 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:52:51.222173 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:52:51.222173 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:52:51.222173 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 436, in _update_volume_swap Oct 22 20:52:51.222173 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi new_volume = self.volume_api.get(context, new_volume_id) Oct 22 20:52:51.222173 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 22 20:52:51.222173 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 22 20:52:51.222173 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 22 20:52:51.228605 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 22 20:52:51.228605 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 22 20:52:51.228605 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 22 20:52:51.228605 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 22 20:52:51.228605 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 22 20:52:51.228605 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 22 20:52:51.228605 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 22 20:52:51.228605 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 22 20:52:51.228605 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 22 20:52:51.228605 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 22 20:52:51.228605 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 22 20:52:51.228605 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 22 20:52:51.228605 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 22 20:52:51.228605 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 22 20:52:51.228605 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 22 20:52:51.228605 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 22 20:52:51.228605 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 22 20:52:51.228605 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 7d2e87bb-b589-4a8c-8ffb-041bc0c1e4fb could not be found. Oct 22 20:52:51.228605 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:52:51.228605 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:52:51.228605 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:52:51.228605 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:52:51.228605 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:52:51.228605 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:52:51.228605 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:52:51.228605 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:52:51.228605 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:52:51.228605 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:52:51.228605 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 20:52:51.228605 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 20:52:51.228605 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 20:52:51.228605 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 20:52:51.228605 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Oct 22 20:52:51.228605 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Oct 22 20:52:51.228605 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 445, in _update_volume_swap Oct 22 20:52:51.228605 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 22 20:52:51.228605 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Volume 7d2e87bb-b589-4a8c-8ffb-041bc0c1e4fb could not be found. Oct 22 20:52:51.228605 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:52:51.228605 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:52:51.228605 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:52:51.228605 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:52:51.228605 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:52:51.228605 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:52:51.228605 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 20:52:51.228605 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 20:52:51.228605 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 7d2e87bb-b589-4a8c-8ffb-041bc0c1e4fb could not be found. Oct 22 20:52:51.228605 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:52:51.228605 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-95c5c8f7-7a80-4ec7-87bf-44445fdd89a7 tempest-VolumesAdminNegativeTest-2068950585 tempest-VolumesAdminNegativeTest-2068950585-project-admin] Returning 400 to user: Volume 7d2e87bb-b589-4a8c-8ffb-041bc0c1e4fb could not be found. {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:52:51.228605 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-95c5c8f7-7a80-4ec7-87bf-44445fdd89a7 tempest-VolumesAdminNegativeTest-2068950585 tempest-VolumesAdminNegativeTest-2068950585-project-admin] 10.222.0.18 "PUT /compute/v2.1/servers/c475672d-99ba-4c6a-abaa-3332a392534d/os-volume_attachments/58bc667d-d54e-4146-bcf2-33215200e583" status: 400 len: 107 microversion: 2.1 time: 0.807799 Oct 22 20:52:51.228605 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 550/1043] 10.222.0.18 () {60 vars in 1433 bytes} [Sat Oct 22 20:52:50 2022] PUT /compute/v2.1/servers/c475672d-99ba-4c6a-abaa-3332a392534d/os-volume_attachments/58bc667d-d54e-4146-bcf2-33215200e583 => generated 107 bytes in 810 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 22 20:52:51.232113 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-6e09dacf-1cae-4015-b266-6cb350527817 tempest-ImagesNegativeTestJSON-585030787 tempest-ImagesNegativeTestJSON-585030787-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:52:51.233956 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-6e09dacf-1cae-4015-b266-6cb350527817 tempest-ImagesNegativeTestJSON-585030787 tempest-ImagesNegativeTestJSON-585030787-project] [instance: 950ff1c8-47a5-411f-bf47-efe6ff2982e4] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:52:51.248150 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6e09dacf-1cae-4015-b266-6cb350527817 tempest-ImagesNegativeTestJSON-585030787 tempest-ImagesNegativeTestJSON-585030787-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:51.254201 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6e09dacf-1cae-4015-b266-6cb350527817 tempest-ImagesNegativeTestJSON-585030787 tempest-ImagesNegativeTestJSON-585030787-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:51.254818 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6e09dacf-1cae-4015-b266-6cb350527817 tempest-ImagesNegativeTestJSON-585030787 tempest-ImagesNegativeTestJSON-585030787-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:51.255621 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6e09dacf-1cae-4015-b266-6cb350527817 tempest-ImagesNegativeTestJSON-585030787 tempest-ImagesNegativeTestJSON-585030787-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:51.256087 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6e09dacf-1cae-4015-b266-6cb350527817 tempest-ImagesNegativeTestJSON-585030787 tempest-ImagesNegativeTestJSON-585030787-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:51.259001 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6e09dacf-1cae-4015-b266-6cb350527817 tempest-ImagesNegativeTestJSON-585030787 tempest-ImagesNegativeTestJSON-585030787-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:51.334448 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6e09dacf-1cae-4015-b266-6cb350527817 tempest-ImagesNegativeTestJSON-585030787 tempest-ImagesNegativeTestJSON-585030787-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:51.335620 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6e09dacf-1cae-4015-b266-6cb350527817 tempest-ImagesNegativeTestJSON-585030787 tempest-ImagesNegativeTestJSON-585030787-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:51.337648 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6e09dacf-1cae-4015-b266-6cb350527817 tempest-ImagesNegativeTestJSON-585030787 tempest-ImagesNegativeTestJSON-585030787-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:51.340229 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.objects.instance [None req-6e09dacf-1cae-4015-b266-6cb350527817 tempest-ImagesNegativeTestJSON-585030787 tempest-ImagesNegativeTestJSON-585030787-project] Lazy-loading 'fault' on Instance uuid 950ff1c8-47a5-411f-bf47-efe6ff2982e4 {{(pid=138745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 20:52:51.349953 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-f68ef3ff-539f-484b-97ef-d31cdcd57092 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:52:51.350786 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-f68ef3ff-539f-484b-97ef-d31cdcd57092 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] [instance: c475672d-99ba-4c6a-abaa-3332a392534d] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:52:51.363288 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f68ef3ff-539f-484b-97ef-d31cdcd57092 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:51.368272 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f68ef3ff-539f-484b-97ef-d31cdcd57092 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:51.369221 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f68ef3ff-539f-484b-97ef-d31cdcd57092 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:51.370684 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f68ef3ff-539f-484b-97ef-d31cdcd57092 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:51.371464 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f68ef3ff-539f-484b-97ef-d31cdcd57092 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:51.372507 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f68ef3ff-539f-484b-97ef-d31cdcd57092 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:51.549751 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.objects.instance [None req-f68ef3ff-539f-484b-97ef-d31cdcd57092 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Lazy-loading 'services' on Instance uuid c475672d-99ba-4c6a-abaa-3332a392534d {{(pid=138744) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 20:52:51.666195 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:52:51.687591 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-6e09dacf-1cae-4015-b266-6cb350527817 tempest-ImagesNegativeTestJSON-585030787 tempest-ImagesNegativeTestJSON-585030787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd553da484f5344169038bbe36a417699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '590a252c9203432eb15d9aef57cc3bb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:52:51.702562 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-f68ef3ff-539f-484b-97ef-d31cdcd57092 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] 10.222.0.18 "DELETE /compute/v2.1/servers/c475672d-99ba-4c6a-abaa-3332a392534d/os-volume_attachments/58bc667d-d54e-4146-bcf2-33215200e583" status: 202 len: 0 microversion: 2.1 time: 0.356993 Oct 22 20:52:51.707319 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-6e09dacf-1cae-4015-b266-6cb350527817 tempest-ImagesNegativeTestJSON-585030787 tempest-ImagesNegativeTestJSON-585030787-project] 10.222.0.18 "GET /compute/v2.1/servers/950ff1c8-47a5-411f-bf47-efe6ff2982e4" status: 200 len: 1306 microversion: 2.1 time: 0.477495 Oct 22 20:52:51.711326 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 494/1044] 10.222.0.18 () {58 vars in 1416 bytes} [Sat Oct 22 20:52:51 2022] DELETE /compute/v2.1/servers/c475672d-99ba-4c6a-abaa-3332a392534d/os-volume_attachments/58bc667d-d54e-4146-bcf2-33215200e583 => generated 0 bytes in 367 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 22 20:52:51.716667 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 551/1045] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:52:51 2022] GET /compute/v2.1/servers/950ff1c8-47a5-411f-bf47-efe6ff2982e4 => generated 1306 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:52:51.719278 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-f4bf69e3-0857-46a0-85bb-225ef5c73e1c req-2d297faf-c14f-4607-8842-a0b7b24eda17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea383564-25ff-4e81-9301-c8bcb13988c7", "name": "network-vif-deleted", "tag": "c6526ab3-0f3c-4934-a5e0-0cf443f467c7"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:52:51.736370 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-8d32f4e5-7b7b-4efd-b4b1-da8237233c43 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:52:51.738676 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-8d32f4e5-7b7b-4efd-b4b1-da8237233c43 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] [instance: c475672d-99ba-4c6a-abaa-3332a392534d] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:52:51.746373 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8d32f4e5-7b7b-4efd-b4b1-da8237233c43 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:51.747111 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8d32f4e5-7b7b-4efd-b4b1-da8237233c43 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:51.747830 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8d32f4e5-7b7b-4efd-b4b1-da8237233c43 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:51.748735 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8d32f4e5-7b7b-4efd-b4b1-da8237233c43 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:51.749346 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8d32f4e5-7b7b-4efd-b4b1-da8237233c43 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:51.749929 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8d32f4e5-7b7b-4efd-b4b1-da8237233c43 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:51.762402 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-f4bf69e3-0857-46a0-85bb-225ef5c73e1c req-2d297faf-c14f-4607-8842-a0b7b24eda17 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:51.762896 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-f4bf69e3-0857-46a0-85bb-225ef5c73e1c req-2d297faf-c14f-4607-8842-a0b7b24eda17 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:51.763329 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-f4bf69e3-0857-46a0-85bb-225ef5c73e1c req-2d297faf-c14f-4607-8842-a0b7b24eda17 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:51.785507 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-8d32f4e5-7b7b-4efd-b4b1-da8237233c43 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] 10.222.0.18 "GET /compute/v2.1/servers/c475672d-99ba-4c6a-abaa-3332a392534d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067618 Oct 22 20:52:51.786352 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 552/1046] 10.222.0.18 () {58 vars in 1302 bytes} [Sat Oct 22 20:52:51 2022] GET /compute/v2.1/servers/c475672d-99ba-4c6a-abaa-3332a392534d/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:52:51.793552 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-f4bf69e3-0857-46a0-85bb-225ef5c73e1c req-2d297faf-c14f-4607-8842-a0b7b24eda17 service nova] Creating event network-vif-deleted:c6526ab3-0f3c-4934-a5e0-0cf443f467c7 for instance ea383564-25ff-4e81-9301-c8bcb13988c7 on nch2-master-1 Oct 22 20:52:51.800414 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-f4bf69e3-0857-46a0-85bb-225ef5c73e1c req-2d297faf-c14f-4607-8842-a0b7b24eda17 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086760 Oct 22 20:52:51.801748 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 495/1047] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:52:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:52:51.817573 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-03478319-7b89-4add-bb98-06236b1c9e8d tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:52:51.818414 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-03478319-7b89-4add-bb98-06236b1c9e8d tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] [instance: ea383564-25ff-4e81-9301-c8bcb13988c7] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:52:51.827305 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-03478319-7b89-4add-bb98-06236b1c9e8d tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:51.828270 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-03478319-7b89-4add-bb98-06236b1c9e8d tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:51.828878 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-03478319-7b89-4add-bb98-06236b1c9e8d tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:51.829871 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-03478319-7b89-4add-bb98-06236b1c9e8d tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:51.830831 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-03478319-7b89-4add-bb98-06236b1c9e8d tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:51.831527 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-03478319-7b89-4add-bb98-06236b1c9e8d tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:51.896038 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-03478319-7b89-4add-bb98-06236b1c9e8d tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:51.896766 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-03478319-7b89-4add-bb98-06236b1c9e8d tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:51.897605 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-03478319-7b89-4add-bb98-06236b1c9e8d tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:51.899601 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.objects.instance [None req-03478319-7b89-4add-bb98-06236b1c9e8d tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lazy-loading 'fault' on Instance uuid ea383564-25ff-4e81-9301-c8bcb13988c7 {{(pid=138745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 20:52:51.996894 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-03478319-7b89-4add-bb98-06236b1c9e8d tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91cf84a287b74618ae1b3368785b0b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902e239d67664098895ab24340b0b780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:52:52.010563 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-03478319-7b89-4add-bb98-06236b1c9e8d tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] 10.222.0.18 "GET /compute/v2.1/servers/ea383564-25ff-4e81-9301-c8bcb13988c7" status: 200 len: 1307 microversion: 2.1 time: 0.199718 Oct 22 20:52:52.011557 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 553/1048] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:52:51 2022] GET /compute/v2.1/servers/ea383564-25ff-4e81-9301-c8bcb13988c7 => generated 1307 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:52:52.252146 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-e35fa495-9253-4eb4-a0ab-620e4b5cc9eb tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:52:52.253379 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-e35fa495-9253-4eb4-a0ab-620e4b5cc9eb tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] [instance: 472bbccc-485e-43ce-a9cd-a3148bfccdbd] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:52:52.264322 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e35fa495-9253-4eb4-a0ab-620e4b5cc9eb tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:52.264824 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e35fa495-9253-4eb4-a0ab-620e4b5cc9eb tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:52.265272 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e35fa495-9253-4eb4-a0ab-620e4b5cc9eb tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:52.266063 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e35fa495-9253-4eb4-a0ab-620e4b5cc9eb tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:52.266528 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e35fa495-9253-4eb4-a0ab-620e4b5cc9eb tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:52.266959 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e35fa495-9253-4eb4-a0ab-620e4b5cc9eb tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:52.374536 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-e35fa495-9253-4eb4-a0ab-620e4b5cc9eb tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01ba79ccd0d940a2899a035635862219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0400ae826f8e4bd8a2e4c981880a59c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:52:52.402925 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-e35fa495-9253-4eb4-a0ab-620e4b5cc9eb tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] 10.222.0.18 "GET /compute/v2.1/servers/472bbccc-485e-43ce-a9cd-a3148bfccdbd" status: 200 len: 1274 microversion: 2.1 time: 0.158429 Oct 22 20:52:52.427227 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 496/1049] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:52:52 2022] GET /compute/v2.1/servers/472bbccc-485e-43ce-a9cd-a3148bfccdbd => generated 1274 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:52:52.738114 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-44f1594d-42ee-423c-bf85-03e05454820d tempest-ImagesNegativeTestJSON-585030787 tempest-ImagesNegativeTestJSON-585030787-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:52:52.739774 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-44f1594d-42ee-423c-bf85-03e05454820d tempest-ImagesNegativeTestJSON-585030787 tempest-ImagesNegativeTestJSON-585030787-project] [instance: 950ff1c8-47a5-411f-bf47-efe6ff2982e4] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:52:52.747531 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-44f1594d-42ee-423c-bf85-03e05454820d tempest-ImagesNegativeTestJSON-585030787 tempest-ImagesNegativeTestJSON-585030787-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:52.751845 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-44f1594d-42ee-423c-bf85-03e05454820d tempest-ImagesNegativeTestJSON-585030787 tempest-ImagesNegativeTestJSON-585030787-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:52.752754 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-44f1594d-42ee-423c-bf85-03e05454820d tempest-ImagesNegativeTestJSON-585030787 tempest-ImagesNegativeTestJSON-585030787-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:52.754324 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-44f1594d-42ee-423c-bf85-03e05454820d tempest-ImagesNegativeTestJSON-585030787 tempest-ImagesNegativeTestJSON-585030787-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:52.754997 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-44f1594d-42ee-423c-bf85-03e05454820d tempest-ImagesNegativeTestJSON-585030787 tempest-ImagesNegativeTestJSON-585030787-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:52.755762 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-44f1594d-42ee-423c-bf85-03e05454820d tempest-ImagesNegativeTestJSON-585030787 tempest-ImagesNegativeTestJSON-585030787-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:52.779550 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.wsgi [None req-44f1594d-42ee-423c-bf85-03e05454820d tempest-ImagesNegativeTestJSON-585030787 tempest-ImagesNegativeTestJSON-585030787-project] HTTP exception thrown: Instance 950ff1c8-47a5-411f-bf47-efe6ff2982e4 could not be found. Oct 22 20:52:52.781379 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-44f1594d-42ee-423c-bf85-03e05454820d tempest-ImagesNegativeTestJSON-585030787 tempest-ImagesNegativeTestJSON-585030787-project] Request method failure captured: Oct 22 20:52:52.781379 ncdv-master-1 devstack@n-api.service[138745]: request: GET /compute/v2.1/servers/950ff1c8-47a5-411f-bf47-efe6ff2982e4 HTTP/1.1 Oct 22 20:52:52.781379 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 20:52:52.781379 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 20:52:52.781379 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 20:52:52.781379 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 0 Oct 22 20:52:52.781379 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 20:52:52.781379 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 20:52:52.781379 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 20:52:52.781379 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 20:52:52.781379 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVFgQxwfvGtfGti0A14mI6RkjAOtXHR3VrPD0rv9mLmP4TZNMfBODR0Nnflmf1rPAOx9rui9xD39m2cTPFBl5kOdXw68dvIFP421ZAjMJf3JsI1rtgMfZMpw05iufxZttkhehtXp2a1is-eGaNyB1-mn_vXTTJ3-sv5XmYrrKIG7sG10 Oct 22 20:52:52.781379 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 20:52:52.781379 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 20:52:52.781379 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 20:52:52.781379 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 20:52:52.781379 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 20:52:52.781379 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 20:52:52.781379 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: 590a252c9203432eb15d9aef57cc3bb5 Oct 22 20:52:52.781379 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-ImagesNegativeTestJSON-585030787 Oct 22 20:52:52.781379 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 20:52:52.781379 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 20:52:52.781379 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_590a252c9203432eb15d9aef57cc3bb5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/590a252c9203432eb15d9aef57cc3bb5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/590a252c9203432eb15d9aef57cc3bb5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/590a252c9203432eb15d9aef57cc3bb5"}]}] Oct 22 20:52:52.781379 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-ImagesNegativeTestJSON-585030787 Oct 22 20:52:52.781379 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: 590a252c9203432eb15d9aef57cc3bb5 Oct 22 20:52:52.781379 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-585030787 Oct 22 20:52:52.781379 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-ImagesNegativeTestJSON-585030787-project Oct 22 20:52:52.781379 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 20:52:52.781379 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 20:52:52.781379 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: d553da484f5344169038bbe36a417699 Oct 22 20:52:52.781379 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-ImagesNegativeTestJSON-585030787-project Oct 22 20:52:52.781379 ncdv-master-1 devstack@n-api.service[138745]: method: > Oct 22 20:52:52.781379 ncdv-master-1 devstack@n-api.service[138745]: exception: Instance 950ff1c8-47a5-411f-bf47-efe6ff2982e4 could not be found. Oct 22 20:52:52.781379 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'id': '950ff1c8-47a5-411f-bf47-efe6ff2982e4'} Oct 22 20:52:52.781379 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:52:52.781379 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:52:52.781379 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 20:52:52.781379 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 20:52:52.781379 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 20:52:52.781379 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 20:52:52.781379 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 20:52:52.781379 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 20:52:52.781379 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 20:52:52.781379 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 20:52:52.781379 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 950ff1c8-47a5-411f-bf47-efe6ff2982e4 could not be found. Oct 22 20:52:52.781379 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:52:52.781379 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:52:52.781379 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:52:52.781379 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:52:52.781379 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:52:52.781379 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:52:52.781379 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:52:52.781379 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:52:52.781379 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:52:52.781379 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:52:52.781379 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 20:52:52.781379 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 20:52:52.781379 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 20:52:52.781379 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 20:52:52.781379 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 20:52:52.781379 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 20:52:52.781379 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 950ff1c8-47a5-411f-bf47-efe6ff2982e4 could not be found. Oct 22 20:52:52.781379 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:52:52.781379 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:52:52.781379 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:52:52.786079 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:52:52.786079 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:52:52.786079 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:52:52.786079 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 20:52:52.786079 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 20:52:52.786079 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 950ff1c8-47a5-411f-bf47-efe6ff2982e4 could not be found. Oct 22 20:52:52.786079 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:52:52.788540 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-44f1594d-42ee-423c-bf85-03e05454820d tempest-ImagesNegativeTestJSON-585030787 tempest-ImagesNegativeTestJSON-585030787-project] Returning 404 to user: Instance 950ff1c8-47a5-411f-bf47-efe6ff2982e4 could not be found. {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:52:52.789281 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-44f1594d-42ee-423c-bf85-03e05454820d tempest-ImagesNegativeTestJSON-585030787 tempest-ImagesNegativeTestJSON-585030787-project] 10.222.0.18 "GET /compute/v2.1/servers/950ff1c8-47a5-411f-bf47-efe6ff2982e4" status: 404 len: 111 microversion: 2.1 time: 0.055286 Oct 22 20:52:52.790345 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 554/1050] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:52:52 2022] GET /compute/v2.1/servers/950ff1c8-47a5-411f-bf47-efe6ff2982e4 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 20:52:52.802076 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-cf245878-fbf0-4699-9755-6a43469ef1f5 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:52:52.805363 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-cf245878-fbf0-4699-9755-6a43469ef1f5 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] [instance: c475672d-99ba-4c6a-abaa-3332a392534d] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:52:52.836369 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cf245878-fbf0-4699-9755-6a43469ef1f5 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:52.836965 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-6565e817-7d1e-4b18-a454-84be3e758508 tempest-ImagesNegativeTestJSON-585030787 tempest-ImagesNegativeTestJSON-585030787-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-790409336", "metadata": {"image_type": "test"}}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:52:52.837929 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cf245878-fbf0-4699-9755-6a43469ef1f5 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:52.839653 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cf245878-fbf0-4699-9755-6a43469ef1f5 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:52.845573 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cf245878-fbf0-4699-9755-6a43469ef1f5 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:52.846300 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cf245878-fbf0-4699-9755-6a43469ef1f5 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:52.846910 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-6565e817-7d1e-4b18-a454-84be3e758508 tempest-ImagesNegativeTestJSON-585030787 tempest-ImagesNegativeTestJSON-585030787-project] [instance: 950ff1c8-47a5-411f-bf47-efe6ff2982e4] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:52:52.848027 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cf245878-fbf0-4699-9755-6a43469ef1f5 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:52.865169 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6565e817-7d1e-4b18-a454-84be3e758508 tempest-ImagesNegativeTestJSON-585030787 tempest-ImagesNegativeTestJSON-585030787-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:52.868395 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6565e817-7d1e-4b18-a454-84be3e758508 tempest-ImagesNegativeTestJSON-585030787 tempest-ImagesNegativeTestJSON-585030787-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:52.875647 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6565e817-7d1e-4b18-a454-84be3e758508 tempest-ImagesNegativeTestJSON-585030787 tempest-ImagesNegativeTestJSON-585030787-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:52.877113 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6565e817-7d1e-4b18-a454-84be3e758508 tempest-ImagesNegativeTestJSON-585030787 tempest-ImagesNegativeTestJSON-585030787-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:52.877834 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6565e817-7d1e-4b18-a454-84be3e758508 tempest-ImagesNegativeTestJSON-585030787 tempest-ImagesNegativeTestJSON-585030787-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:52.878494 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6565e817-7d1e-4b18-a454-84be3e758508 tempest-ImagesNegativeTestJSON-585030787 tempest-ImagesNegativeTestJSON-585030787-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:52.902571 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.wsgi [None req-6565e817-7d1e-4b18-a454-84be3e758508 tempest-ImagesNegativeTestJSON-585030787 tempest-ImagesNegativeTestJSON-585030787-project] HTTP exception thrown: Instance 950ff1c8-47a5-411f-bf47-efe6ff2982e4 could not be found. Oct 22 20:52:52.904721 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-6565e817-7d1e-4b18-a454-84be3e758508 tempest-ImagesNegativeTestJSON-585030787 tempest-ImagesNegativeTestJSON-585030787-project] Request method failure captured: Oct 22 20:52:52.904721 ncdv-master-1 devstack@n-api.service[138745]: request: POST /compute/v2.1/servers/950ff1c8-47a5-411f-bf47-efe6ff2982e4/action HTTP/1.1 Oct 22 20:52:52.904721 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 20:52:52.904721 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 20:52:52.904721 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 20:52:52.904721 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 111 Oct 22 20:52:52.904721 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 20:52:52.904721 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 20:52:52.904721 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 20:52:52.904721 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 20:52:52.904721 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVFgQxwfvGtfGti0A14mI6RkjAOtXHR3VrPD0rv9mLmP4TZNMfBODR0Nnflmf1rPAOx9rui9xD39m2cTPFBl5kOdXw68dvIFP421ZAjMJf3JsI1rtgMfZMpw05iufxZttkhehtXp2a1is-eGaNyB1-mn_vXTTJ3-sv5XmYrrKIG7sG10 Oct 22 20:52:52.904721 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 20:52:52.904721 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 20:52:52.904721 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 20:52:52.904721 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 20:52:52.904721 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 20:52:52.904721 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 20:52:52.904721 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: 590a252c9203432eb15d9aef57cc3bb5 Oct 22 20:52:52.904721 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-ImagesNegativeTestJSON-585030787 Oct 22 20:52:52.904721 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 20:52:52.904721 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 20:52:52.904721 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_590a252c9203432eb15d9aef57cc3bb5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/590a252c9203432eb15d9aef57cc3bb5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/590a252c9203432eb15d9aef57cc3bb5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/590a252c9203432eb15d9aef57cc3bb5"}]}] Oct 22 20:52:52.904721 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-ImagesNegativeTestJSON-585030787 Oct 22 20:52:52.904721 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: 590a252c9203432eb15d9aef57cc3bb5 Oct 22 20:52:52.904721 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-585030787 Oct 22 20:52:52.904721 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-ImagesNegativeTestJSON-585030787-project Oct 22 20:52:52.904721 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 20:52:52.904721 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 20:52:52.904721 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: d553da484f5344169038bbe36a417699 Oct 22 20:52:52.904721 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-ImagesNegativeTestJSON-585030787-project Oct 22 20:52:52.904721 ncdv-master-1 devstack@n-api.service[138745]: Oct 22 20:52:52.904721 ncdv-master-1 devstack@n-api.service[138745]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-790409336", "metadata": {"image_type": "test"}}} Oct 22 20:52:52.904721 ncdv-master-1 devstack@n-api.service[138745]: method: > Oct 22 20:52:52.904721 ncdv-master-1 devstack@n-api.service[138745]: exception: Instance 950ff1c8-47a5-411f-bf47-efe6ff2982e4 could not be found. Oct 22 20:52:52.904721 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'id': '950ff1c8-47a5-411f-bf47-efe6ff2982e4', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-790409336', 'metadata': {'image_type': 'test'}}}} Oct 22 20:52:52.904721 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:52:52.904721 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:52:52.904721 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 20:52:52.904721 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 20:52:52.904721 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 20:52:52.904721 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 20:52:52.904721 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 20:52:52.904721 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 20:52:52.904721 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 20:52:52.904721 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 20:52:52.904721 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 950ff1c8-47a5-411f-bf47-efe6ff2982e4 could not be found. Oct 22 20:52:52.904721 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:52:52.904721 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:52:52.904721 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:52:52.904721 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:52:52.904721 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:52:52.904721 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:52:52.904721 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:52:52.904721 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:52:52.904721 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:52:52.904721 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:52:52.904721 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 20:52:52.904721 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 20:52:52.904721 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 20:52:52.904721 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 20:52:52.904721 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 22 20:52:52.904721 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 22 20:52:52.904721 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 20:52:52.908646 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 20:52:52.908646 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 20:52:52.908646 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 20:52:52.908646 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 950ff1c8-47a5-411f-bf47-efe6ff2982e4 could not be found. Oct 22 20:52:52.908646 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:52:52.908646 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:52:52.908646 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:52:52.908646 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:52:52.908646 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:52:52.908646 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:52:52.908646 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 20:52:52.908646 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 20:52:52.908646 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 950ff1c8-47a5-411f-bf47-efe6ff2982e4 could not be found. Oct 22 20:52:52.908646 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:52:52.912185 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-6565e817-7d1e-4b18-a454-84be3e758508 tempest-ImagesNegativeTestJSON-585030787 tempest-ImagesNegativeTestJSON-585030787-project] Returning 404 to user: Instance 950ff1c8-47a5-411f-bf47-efe6ff2982e4 could not be found. {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:52:52.913615 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-6565e817-7d1e-4b18-a454-84be3e758508 tempest-ImagesNegativeTestJSON-585030787 tempest-ImagesNegativeTestJSON-585030787-project] 10.222.0.18 "POST /compute/v2.1/servers/950ff1c8-47a5-411f-bf47-efe6ff2982e4/action" status: 404 len: 111 microversion: 2.1 time: 0.104916 Oct 22 20:52:52.916102 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 555/1051] 10.222.0.18 () {60 vars in 1279 bytes} [Sat Oct 22 20:52:52 2022] POST /compute/v2.1/servers/950ff1c8-47a5-411f-bf47-efe6ff2982e4/action => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 20:52:52.930412 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-cf245878-fbf0-4699-9755-6a43469ef1f5 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] 10.222.0.18 "GET /compute/v2.1/servers/c475672d-99ba-4c6a-abaa-3332a392534d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.135081 Oct 22 20:52:52.931191 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 497/1052] 10.222.0.18 () {58 vars in 1302 bytes} [Sat Oct 22 20:52:52 2022] GET /compute/v2.1/servers/c475672d-99ba-4c6a-abaa-3332a392534d/os-volume_attachments => generated 25 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 22 20:52:52.934254 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-e2bc59b0-c71b-4854-b925-ae1322203d4a tempest-ImagesNegativeTestJSON-585030787 tempest-ImagesNegativeTestJSON-585030787-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-75762239", "metadata": {"image_type": "test"}}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:52:52.941121 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-e2bc59b0-c71b-4854-b925-ae1322203d4a tempest-ImagesNegativeTestJSON-585030787 tempest-ImagesNegativeTestJSON-585030787-project] Failed to fetch instance by id tempest-invalid-1105102324 {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 22 20:52:52.941443 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.wsgi [None req-e2bc59b0-c71b-4854-b925-ae1322203d4a tempest-ImagesNegativeTestJSON-585030787 tempest-ImagesNegativeTestJSON-585030787-project] HTTP exception thrown: Instance tempest-invalid-1105102324 could not be found. Oct 22 20:52:52.945393 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-e2bc59b0-c71b-4854-b925-ae1322203d4a tempest-ImagesNegativeTestJSON-585030787 tempest-ImagesNegativeTestJSON-585030787-project] Request method failure captured: Oct 22 20:52:52.945393 ncdv-master-1 devstack@n-api.service[138745]: request: POST /compute/v2.1/servers/tempest-invalid-1105102324/action HTTP/1.1 Oct 22 20:52:52.945393 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 20:52:52.945393 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 20:52:52.945393 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 20:52:52.945393 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 110 Oct 22 20:52:52.945393 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 20:52:52.945393 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 20:52:52.945393 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 20:52:52.945393 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 20:52:52.945393 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVFgQxwfvGtfGti0A14mI6RkjAOtXHR3VrPD0rv9mLmP4TZNMfBODR0Nnflmf1rPAOx9rui9xD39m2cTPFBl5kOdXw68dvIFP421ZAjMJf3JsI1rtgMfZMpw05iufxZttkhehtXp2a1is-eGaNyB1-mn_vXTTJ3-sv5XmYrrKIG7sG10 Oct 22 20:52:52.945393 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 20:52:52.945393 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 20:52:52.945393 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 20:52:52.945393 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 20:52:52.945393 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 20:52:52.945393 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 20:52:52.945393 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: 590a252c9203432eb15d9aef57cc3bb5 Oct 22 20:52:52.945393 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-ImagesNegativeTestJSON-585030787 Oct 22 20:52:52.945393 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 20:52:52.945393 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 20:52:52.945393 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_590a252c9203432eb15d9aef57cc3bb5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/590a252c9203432eb15d9aef57cc3bb5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/590a252c9203432eb15d9aef57cc3bb5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/590a252c9203432eb15d9aef57cc3bb5"}]}] Oct 22 20:52:52.945393 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-ImagesNegativeTestJSON-585030787 Oct 22 20:52:52.945393 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: 590a252c9203432eb15d9aef57cc3bb5 Oct 22 20:52:52.945393 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-585030787 Oct 22 20:52:52.945393 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-ImagesNegativeTestJSON-585030787-project Oct 22 20:52:52.945393 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 20:52:52.945393 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 20:52:52.945393 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: d553da484f5344169038bbe36a417699 Oct 22 20:52:52.945393 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-ImagesNegativeTestJSON-585030787-project Oct 22 20:52:52.945393 ncdv-master-1 devstack@n-api.service[138745]: Oct 22 20:52:52.945393 ncdv-master-1 devstack@n-api.service[138745]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-75762239", "metadata": {"image_type": "test"}}} Oct 22 20:52:52.945393 ncdv-master-1 devstack@n-api.service[138745]: method: > Oct 22 20:52:52.945393 ncdv-master-1 devstack@n-api.service[138745]: exception: Instance tempest-invalid-1105102324 could not be found. Oct 22 20:52:52.945393 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'id': 'tempest-invalid-1105102324', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-75762239', 'metadata': {'image_type': 'test'}}}} Oct 22 20:52:52.945393 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:52:52.945393 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:52:52.945393 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 20:52:52.945393 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 20:52:52.945393 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 22 20:52:52.945393 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 22 20:52:52.945393 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance tempest-invalid-1105102324 could not be found. Oct 22 20:52:52.945393 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:52:52.945393 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:52:52.945393 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:52:52.945393 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:52:52.945393 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:52:52.945393 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:52:52.945393 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:52:52.945393 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:52:52.945393 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:52:52.945393 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:52:52.945393 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 20:52:52.945393 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 20:52:52.945393 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 20:52:52.945393 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 20:52:52.945393 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 22 20:52:52.945393 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 22 20:52:52.945393 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 20:52:52.945393 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 20:52:52.945393 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 20:52:52.945393 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 20:52:52.945393 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance tempest-invalid-1105102324 could not be found. Oct 22 20:52:52.950113 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:52:52.950113 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:52:52.950113 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:52:52.950113 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:52:52.950113 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:52:52.950113 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:52:52.950113 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 20:52:52.950113 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 20:52:52.950113 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance tempest-invalid-1105102324 could not be found. Oct 22 20:52:52.950113 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:52:52.950113 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-e2bc59b0-c71b-4854-b925-ae1322203d4a tempest-ImagesNegativeTestJSON-585030787 tempest-ImagesNegativeTestJSON-585030787-project] Returning 404 to user: Instance tempest-invalid-1105102324 could not be found. {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:52:52.950113 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-e2bc59b0-c71b-4854-b925-ae1322203d4a tempest-ImagesNegativeTestJSON-585030787 tempest-ImagesNegativeTestJSON-585030787-project] 10.222.0.18 "POST /compute/v2.1/servers/tempest-invalid-1105102324/action" status: 404 len: 101 microversion: 2.1 time: 0.026685 Oct 22 20:52:52.955603 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 556/1053] 10.222.0.18 () {60 vars in 1249 bytes} [Sat Oct 22 20:52:52 2022] POST /compute/v2.1/servers/tempest-invalid-1105102324/action => generated 101 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 20:52:52.959734 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-2e88ca91-5f56-41ec-bc44-46dbf18dd6d3 tempest-ImagesNegativeTestJSON-585030787 tempest-ImagesNegativeTestJSON-585030787-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1257725397"}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:52:52.964026 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-2e88ca91-5f56-41ec-bc44-46dbf18dd6d3 tempest-ImagesNegativeTestJSON-585030787 tempest-ImagesNegativeTestJSON-585030787-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 22 20:52:52.964776 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-2e88ca91-5f56-41ec-bc44-46dbf18dd6d3 tempest-ImagesNegativeTestJSON-585030787 tempest-ImagesNegativeTestJSON-585030787-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 22 20:52:52.966720 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-2e88ca91-5f56-41ec-bc44-46dbf18dd6d3 tempest-ImagesNegativeTestJSON-585030787 tempest-ImagesNegativeTestJSON-585030787-project] Request method failure captured: Oct 22 20:52:52.966720 ncdv-master-1 devstack@n-api.service[138744]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Oct 22 20:52:52.966720 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 20:52:52.966720 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 20:52:52.966720 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 20:52:52.966720 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 57 Oct 22 20:52:52.966720 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 20:52:52.966720 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 20:52:52.966720 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 20:52:52.966720 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 20:52:52.966720 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVFgQxwfvGtfGti0A14mI6RkjAOtXHR3VrPD0rv9mLmP4TZNMfBODR0Nnflmf1rPAOx9rui9xD39m2cTPFBl5kOdXw68dvIFP421ZAjMJf3JsI1rtgMfZMpw05iufxZttkhehtXp2a1is-eGaNyB1-mn_vXTTJ3-sv5XmYrrKIG7sG10 Oct 22 20:52:52.966720 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 20:52:52.966720 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 20:52:52.966720 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 20:52:52.966720 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 20:52:52.966720 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 20:52:52.966720 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 20:52:52.966720 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: 590a252c9203432eb15d9aef57cc3bb5 Oct 22 20:52:52.966720 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-ImagesNegativeTestJSON-585030787 Oct 22 20:52:52.966720 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 20:52:52.966720 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 20:52:52.966720 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_590a252c9203432eb15d9aef57cc3bb5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/590a252c9203432eb15d9aef57cc3bb5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/590a252c9203432eb15d9aef57cc3bb5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/590a252c9203432eb15d9aef57cc3bb5"}]}] Oct 22 20:52:52.966720 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-ImagesNegativeTestJSON-585030787 Oct 22 20:52:52.966720 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: 590a252c9203432eb15d9aef57cc3bb5 Oct 22 20:52:52.966720 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-585030787 Oct 22 20:52:52.966720 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-ImagesNegativeTestJSON-585030787-project Oct 22 20:52:52.966720 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 20:52:52.966720 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 20:52:52.966720 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: d553da484f5344169038bbe36a417699 Oct 22 20:52:52.966720 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-ImagesNegativeTestJSON-585030787-project Oct 22 20:52:52.966720 ncdv-master-1 devstack@n-api.service[138744]: Oct 22 20:52:52.966720 ncdv-master-1 devstack@n-api.service[138744]: {"createImage": {"name": "tempest-test-snap-1257725397"}} Oct 22 20:52:52.966720 ncdv-master-1 devstack@n-api.service[138744]: method: > Oct 22 20:52:52.966720 ncdv-master-1 devstack@n-api.service[138744]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 22 20:52:52.966720 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-1257725397'}}} Oct 22 20:52:52.966720 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:52:52.966720 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:52:52.966720 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 20:52:52.966720 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 20:52:52.966720 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 22 20:52:52.966720 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 22 20:52:52.966720 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 22 20:52:52.966720 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:52:52.966720 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:52:52.966720 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:52:52.966720 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:52:52.966720 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:52:52.966720 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:52:52.966720 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:52:52.966720 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:52:52.966720 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:52:52.966720 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:52:52.966720 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 20:52:52.966720 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 20:52:52.966720 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 20:52:52.966720 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 20:52:52.966720 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 22 20:52:52.966720 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 22 20:52:52.966720 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 20:52:52.966720 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 20:52:52.966720 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 20:52:52.966720 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 20:52:52.966720 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 22 20:52:52.966720 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:52:52.971578 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:52:52.971578 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:52:52.971578 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:52:52.971578 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:52:52.971578 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:52:52.971578 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 20:52:52.971578 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 20:52:52.971578 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 22 20:52:52.971578 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:52:52.973758 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-2e88ca91-5f56-41ec-bc44-46dbf18dd6d3 tempest-ImagesNegativeTestJSON-585030787 tempest-ImagesNegativeTestJSON-585030787-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:52:52.974830 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-2e88ca91-5f56-41ec-bc44-46dbf18dd6d3 tempest-ImagesNegativeTestJSON-585030787 tempest-ImagesNegativeTestJSON-585030787-project] 10.222.0.18 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 110 microversion: 2.1 time: 0.019756 Oct 22 20:52:52.976000 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 498/1054] 10.222.0.18 () {60 vars in 1275 bytes} [Sat Oct 22 20:52:52 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 110 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 22 20:52:52.985496 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-7d447c13-16b8-4b9b-96dd-d28cf0692f22 tempest-ImagesNegativeTestJSON-585030787 tempest-ImagesNegativeTestJSON-585030787-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-174835228"}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:52:52.987832 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-7d447c13-16b8-4b9b-96dd-d28cf0692f22 tempest-ImagesNegativeTestJSON-585030787 tempest-ImagesNegativeTestJSON-585030787-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 22 20:52:52.988708 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.wsgi [None req-7d447c13-16b8-4b9b-96dd-d28cf0692f22 tempest-ImagesNegativeTestJSON-585030787 tempest-ImagesNegativeTestJSON-585030787-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 22 20:52:52.990796 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-7d447c13-16b8-4b9b-96dd-d28cf0692f22 tempest-ImagesNegativeTestJSON-585030787 tempest-ImagesNegativeTestJSON-585030787-project] Request method failure captured: Oct 22 20:52:52.990796 ncdv-master-1 devstack@n-api.service[138745]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Oct 22 20:52:52.990796 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 20:52:52.990796 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 20:52:52.990796 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 20:52:52.990796 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 56 Oct 22 20:52:52.990796 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 20:52:52.990796 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 20:52:52.990796 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 20:52:52.990796 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 20:52:52.990796 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVFgQxwfvGtfGti0A14mI6RkjAOtXHR3VrPD0rv9mLmP4TZNMfBODR0Nnflmf1rPAOx9rui9xD39m2cTPFBl5kOdXw68dvIFP421ZAjMJf3JsI1rtgMfZMpw05iufxZttkhehtXp2a1is-eGaNyB1-mn_vXTTJ3-sv5XmYrrKIG7sG10 Oct 22 20:52:52.990796 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 20:52:52.990796 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 20:52:52.990796 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 20:52:52.990796 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 20:52:52.990796 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 20:52:52.990796 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 20:52:52.990796 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: 590a252c9203432eb15d9aef57cc3bb5 Oct 22 20:52:52.990796 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-ImagesNegativeTestJSON-585030787 Oct 22 20:52:52.990796 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 20:52:52.990796 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 20:52:52.990796 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_590a252c9203432eb15d9aef57cc3bb5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/590a252c9203432eb15d9aef57cc3bb5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/590a252c9203432eb15d9aef57cc3bb5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/590a252c9203432eb15d9aef57cc3bb5"}]}] Oct 22 20:52:52.990796 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-ImagesNegativeTestJSON-585030787 Oct 22 20:52:52.990796 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: 590a252c9203432eb15d9aef57cc3bb5 Oct 22 20:52:52.990796 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-585030787 Oct 22 20:52:52.990796 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-ImagesNegativeTestJSON-585030787-project Oct 22 20:52:52.990796 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 20:52:52.990796 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 20:52:52.990796 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: d553da484f5344169038bbe36a417699 Oct 22 20:52:52.990796 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-ImagesNegativeTestJSON-585030787-project Oct 22 20:52:52.990796 ncdv-master-1 devstack@n-api.service[138745]: Oct 22 20:52:52.990796 ncdv-master-1 devstack@n-api.service[138745]: {"createImage": {"name": "tempest-test-snap-174835228"}} Oct 22 20:52:52.990796 ncdv-master-1 devstack@n-api.service[138745]: method: > Oct 22 20:52:52.990796 ncdv-master-1 devstack@n-api.service[138745]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 22 20:52:52.990796 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-174835228'}}} Oct 22 20:52:52.990796 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:52:52.990796 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:52:52.990796 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 20:52:52.990796 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 20:52:52.990796 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 22 20:52:52.990796 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 22 20:52:52.990796 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 22 20:52:52.990796 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:52:52.990796 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:52:52.990796 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:52:52.990796 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:52:52.990796 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:52:52.990796 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:52:52.990796 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:52:52.990796 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:52:52.990796 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:52:52.990796 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:52:52.990796 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 20:52:52.990796 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 20:52:52.990796 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 20:52:52.990796 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 20:52:52.990796 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 22 20:52:52.990796 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 22 20:52:52.990796 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 20:52:52.990796 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 20:52:52.990796 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 20:52:52.990796 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 20:52:52.990796 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 22 20:52:52.990796 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:52:52.998634 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:52:52.998634 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:52:52.998634 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:52:52.998634 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:52:52.998634 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:52:52.998634 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 20:52:52.998634 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 20:52:52.998634 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 22 20:52:52.998634 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:52:52.998634 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-7d447c13-16b8-4b9b-96dd-d28cf0692f22 tempest-ImagesNegativeTestJSON-585030787 tempest-ImagesNegativeTestJSON-585030787-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:52:52.998634 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-7d447c13-16b8-4b9b-96dd-d28cf0692f22 tempest-ImagesNegativeTestJSON-585030787 tempest-ImagesNegativeTestJSON-585030787-project] 10.222.0.18 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 112 microversion: 2.1 time: 0.011230 Oct 22 20:52:53.002361 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 557/1055] 10.222.0.18 () {60 vars in 1281 bytes} [Sat Oct 22 20:52:52 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 112 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 20:52:53.003485 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-45cec9cb-1f3b-4f7a-a540-5c65726f22d4 tempest-ImagesNegativeTestJSON-585030787 tempest-ImagesNegativeTestJSON-585030787-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:52:53.004002 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-45cec9cb-1f3b-4f7a-a540-5c65726f22d4 tempest-ImagesNegativeTestJSON-585030787 tempest-ImagesNegativeTestJSON-585030787-project] [instance: 950ff1c8-47a5-411f-bf47-efe6ff2982e4] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:52:53.012325 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-45cec9cb-1f3b-4f7a-a540-5c65726f22d4 tempest-ImagesNegativeTestJSON-585030787 tempest-ImagesNegativeTestJSON-585030787-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:53.012830 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-45cec9cb-1f3b-4f7a-a540-5c65726f22d4 tempest-ImagesNegativeTestJSON-585030787 tempest-ImagesNegativeTestJSON-585030787-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:53.013279 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-45cec9cb-1f3b-4f7a-a540-5c65726f22d4 tempest-ImagesNegativeTestJSON-585030787 tempest-ImagesNegativeTestJSON-585030787-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:53.014040 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-45cec9cb-1f3b-4f7a-a540-5c65726f22d4 tempest-ImagesNegativeTestJSON-585030787 tempest-ImagesNegativeTestJSON-585030787-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:53.014503 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-45cec9cb-1f3b-4f7a-a540-5c65726f22d4 tempest-ImagesNegativeTestJSON-585030787 tempest-ImagesNegativeTestJSON-585030787-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:53.014938 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-45cec9cb-1f3b-4f7a-a540-5c65726f22d4 tempest-ImagesNegativeTestJSON-585030787 tempest-ImagesNegativeTestJSON-585030787-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:53.030210 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-45cec9cb-1f3b-4f7a-a540-5c65726f22d4 tempest-ImagesNegativeTestJSON-585030787 tempest-ImagesNegativeTestJSON-585030787-project] HTTP exception thrown: Instance 950ff1c8-47a5-411f-bf47-efe6ff2982e4 could not be found. Oct 22 20:52:53.032520 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-45cec9cb-1f3b-4f7a-a540-5c65726f22d4 tempest-ImagesNegativeTestJSON-585030787 tempest-ImagesNegativeTestJSON-585030787-project] Request method failure captured: Oct 22 20:52:53.032520 ncdv-master-1 devstack@n-api.service[138744]: request: DELETE /compute/v2.1/servers/950ff1c8-47a5-411f-bf47-efe6ff2982e4 HTTP/1.1 Oct 22 20:52:53.032520 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 20:52:53.032520 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 20:52:53.032520 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 20:52:53.032520 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 0 Oct 22 20:52:53.032520 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 20:52:53.032520 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 20:52:53.032520 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 20:52:53.032520 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 20:52:53.032520 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVFgQxwfvGtfGti0A14mI6RkjAOtXHR3VrPD0rv9mLmP4TZNMfBODR0Nnflmf1rPAOx9rui9xD39m2cTPFBl5kOdXw68dvIFP421ZAjMJf3JsI1rtgMfZMpw05iufxZttkhehtXp2a1is-eGaNyB1-mn_vXTTJ3-sv5XmYrrKIG7sG10 Oct 22 20:52:53.032520 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 20:52:53.032520 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 20:52:53.032520 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 20:52:53.032520 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 20:52:53.032520 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 20:52:53.032520 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 20:52:53.032520 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: 590a252c9203432eb15d9aef57cc3bb5 Oct 22 20:52:53.032520 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-ImagesNegativeTestJSON-585030787 Oct 22 20:52:53.032520 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 20:52:53.032520 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 20:52:53.032520 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_590a252c9203432eb15d9aef57cc3bb5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/590a252c9203432eb15d9aef57cc3bb5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/590a252c9203432eb15d9aef57cc3bb5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/590a252c9203432eb15d9aef57cc3bb5"}]}] Oct 22 20:52:53.032520 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-ImagesNegativeTestJSON-585030787 Oct 22 20:52:53.032520 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: 590a252c9203432eb15d9aef57cc3bb5 Oct 22 20:52:53.032520 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-585030787 Oct 22 20:52:53.032520 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-ImagesNegativeTestJSON-585030787-project Oct 22 20:52:53.032520 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 20:52:53.032520 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 20:52:53.032520 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: d553da484f5344169038bbe36a417699 Oct 22 20:52:53.032520 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-ImagesNegativeTestJSON-585030787-project Oct 22 20:52:53.032520 ncdv-master-1 devstack@n-api.service[138744]: method: > Oct 22 20:52:53.032520 ncdv-master-1 devstack@n-api.service[138744]: exception: Instance 950ff1c8-47a5-411f-bf47-efe6ff2982e4 could not be found. Oct 22 20:52:53.032520 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': '950ff1c8-47a5-411f-bf47-efe6ff2982e4'} Oct 22 20:52:53.032520 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:52:53.032520 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:52:53.032520 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 20:52:53.032520 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 20:52:53.032520 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 20:52:53.032520 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 20:52:53.032520 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 20:52:53.032520 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 20:52:53.032520 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 20:52:53.032520 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 20:52:53.032520 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 950ff1c8-47a5-411f-bf47-efe6ff2982e4 could not be found. Oct 22 20:52:53.032520 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:52:53.032520 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:52:53.032520 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:52:53.032520 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:52:53.032520 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:52:53.032520 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:52:53.032520 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:52:53.032520 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:52:53.032520 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:52:53.032520 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:52:53.032520 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 22 20:52:53.032520 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 22 20:52:53.032520 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 22 20:52:53.032520 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 22 20:52:53.032520 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 20:52:53.032520 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 20:52:53.032520 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 20:52:53.032520 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 20:52:53.037455 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 950ff1c8-47a5-411f-bf47-efe6ff2982e4 could not be found. Oct 22 20:52:53.037455 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:52:53.037455 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:52:53.037455 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:52:53.037455 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:52:53.037455 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:52:53.037455 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:52:53.037455 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 20:52:53.037455 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 20:52:53.037455 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 950ff1c8-47a5-411f-bf47-efe6ff2982e4 could not be found. Oct 22 20:52:53.037455 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:52:53.038576 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-bd95eb71-5ef1-40d8-a8ce-cc7ad3964915 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:52:53.038738 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-bd95eb71-5ef1-40d8-a8ce-cc7ad3964915 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] [instance: ea383564-25ff-4e81-9301-c8bcb13988c7] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:52:53.044282 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-45cec9cb-1f3b-4f7a-a540-5c65726f22d4 tempest-ImagesNegativeTestJSON-585030787 tempest-ImagesNegativeTestJSON-585030787-project] Returning 404 to user: Instance 950ff1c8-47a5-411f-bf47-efe6ff2982e4 could not be found. {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:52:53.048183 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-45cec9cb-1f3b-4f7a-a540-5c65726f22d4 tempest-ImagesNegativeTestJSON-585030787 tempest-ImagesNegativeTestJSON-585030787-project] 10.222.0.18 "DELETE /compute/v2.1/servers/950ff1c8-47a5-411f-bf47-efe6ff2982e4" status: 404 len: 111 microversion: 2.1 time: 0.047070 Oct 22 20:52:53.054393 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bd95eb71-5ef1-40d8-a8ce-cc7ad3964915 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:53.054865 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 499/1056] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 20:52:52 2022] DELETE /compute/v2.1/servers/950ff1c8-47a5-411f-bf47-efe6ff2982e4 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 20:52:53.057010 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bd95eb71-5ef1-40d8-a8ce-cc7ad3964915 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:53.060127 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bd95eb71-5ef1-40d8-a8ce-cc7ad3964915 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:53.061037 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bd95eb71-5ef1-40d8-a8ce-cc7ad3964915 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:53.061638 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bd95eb71-5ef1-40d8-a8ce-cc7ad3964915 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:53.062643 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bd95eb71-5ef1-40d8-a8ce-cc7ad3964915 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:53.065111 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-aa087f21-c858-4436-ba4f-60ddea2dfc6e tempest-ImagesNegativeTestJSON-585030787 tempest-ImagesNegativeTestJSON-585030787-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:52:53.065731 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-aa087f21-c858-4436-ba4f-60ddea2dfc6e tempest-ImagesNegativeTestJSON-585030787 tempest-ImagesNegativeTestJSON-585030787-project] [instance: 950ff1c8-47a5-411f-bf47-efe6ff2982e4] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:52:53.085904 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-aa087f21-c858-4436-ba4f-60ddea2dfc6e tempest-ImagesNegativeTestJSON-585030787 tempest-ImagesNegativeTestJSON-585030787-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:53.086424 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-aa087f21-c858-4436-ba4f-60ddea2dfc6e tempest-ImagesNegativeTestJSON-585030787 tempest-ImagesNegativeTestJSON-585030787-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:53.086864 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-aa087f21-c858-4436-ba4f-60ddea2dfc6e tempest-ImagesNegativeTestJSON-585030787 tempest-ImagesNegativeTestJSON-585030787-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:53.087617 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-aa087f21-c858-4436-ba4f-60ddea2dfc6e tempest-ImagesNegativeTestJSON-585030787 tempest-ImagesNegativeTestJSON-585030787-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:53.088085 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-aa087f21-c858-4436-ba4f-60ddea2dfc6e tempest-ImagesNegativeTestJSON-585030787 tempest-ImagesNegativeTestJSON-585030787-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:53.088523 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-aa087f21-c858-4436-ba4f-60ddea2dfc6e tempest-ImagesNegativeTestJSON-585030787 tempest-ImagesNegativeTestJSON-585030787-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:53.099878 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.wsgi [None req-bd95eb71-5ef1-40d8-a8ce-cc7ad3964915 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] HTTP exception thrown: Instance ea383564-25ff-4e81-9301-c8bcb13988c7 could not be found. Oct 22 20:52:53.101802 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-bd95eb71-5ef1-40d8-a8ce-cc7ad3964915 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Request method failure captured: Oct 22 20:52:53.101802 ncdv-master-1 devstack@n-api.service[138745]: request: GET /compute/v2.1/servers/ea383564-25ff-4e81-9301-c8bcb13988c7 HTTP/1.1 Oct 22 20:52:53.101802 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 20:52:53.101802 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 20:52:53.101802 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 20:52:53.101802 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 0 Oct 22 20:52:53.101802 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 20:52:53.101802 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 20:52:53.101802 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 20:52:53.101802 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 20:52:53.101802 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVFeL5NpvaUPvqiDt8qD72HqMh0DrXz0UtoQAeO42jMFpMPYqVC0YFDMA438gQzhAHNDHcP5InOc3xi8IB_k6cXq3If0lWEwoKo4DiRlB10MzTtg6EzpKpbfTqN9Yi6nvd2u_6U9lIt3lLKhkPDkM5OdhEDFJSGZOTF7Z9mtdL7wRjmc Oct 22 20:52:53.101802 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 20:52:53.101802 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 20:52:53.101802 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 20:52:53.101802 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 20:52:53.101802 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 20:52:53.101802 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 20:52:53.101802 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: 902e239d67664098895ab24340b0b780 Oct 22 20:52:53.101802 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-ServersOnMultiNodesTest-2081149331 Oct 22 20:52:53.101802 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 20:52:53.101802 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 20:52:53.101802 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_902e239d67664098895ab24340b0b780"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/902e239d67664098895ab24340b0b780"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/902e239d67664098895ab24340b0b780"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/902e239d67664098895ab24340b0b780"}]}] Oct 22 20:52:53.101802 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-ServersOnMultiNodesTest-2081149331 Oct 22 20:52:53.101802 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: 902e239d67664098895ab24340b0b780 Oct 22 20:52:53.101802 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-2081149331 Oct 22 20:52:53.101802 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-ServersOnMultiNodesTest-2081149331-project Oct 22 20:52:53.101802 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 20:52:53.101802 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 20:52:53.101802 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: 91cf84a287b74618ae1b3368785b0b4c Oct 22 20:52:53.101802 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-ServersOnMultiNodesTest-2081149331-project Oct 22 20:52:53.101802 ncdv-master-1 devstack@n-api.service[138745]: method: > Oct 22 20:52:53.101802 ncdv-master-1 devstack@n-api.service[138745]: exception: Instance ea383564-25ff-4e81-9301-c8bcb13988c7 could not be found. Oct 22 20:52:53.101802 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'id': 'ea383564-25ff-4e81-9301-c8bcb13988c7'} Oct 22 20:52:53.101802 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:52:53.101802 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:52:53.101802 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 20:52:53.101802 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 20:52:53.101802 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 20:52:53.101802 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 20:52:53.101802 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 20:52:53.101802 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 20:52:53.101802 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 20:52:53.101802 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 20:52:53.101802 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea383564-25ff-4e81-9301-c8bcb13988c7 could not be found. Oct 22 20:52:53.101802 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:52:53.101802 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:52:53.101802 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:52:53.101802 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:52:53.101802 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:52:53.101802 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:52:53.101802 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:52:53.101802 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:52:53.101802 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:52:53.101802 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:52:53.101802 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 20:52:53.101802 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 20:52:53.101802 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 20:52:53.101802 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 20:52:53.101802 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 20:52:53.101802 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 20:52:53.101802 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea383564-25ff-4e81-9301-c8bcb13988c7 could not be found. Oct 22 20:52:53.101802 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:52:53.101802 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:52:53.101802 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:52:53.106291 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:52:53.106291 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:52:53.106291 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:52:53.106291 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 20:52:53.106291 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 20:52:53.106291 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea383564-25ff-4e81-9301-c8bcb13988c7 could not be found. Oct 22 20:52:53.106291 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:52:53.106733 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-bd95eb71-5ef1-40d8-a8ce-cc7ad3964915 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Returning 404 to user: Instance ea383564-25ff-4e81-9301-c8bcb13988c7 could not be found. {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:52:53.107999 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-bd95eb71-5ef1-40d8-a8ce-cc7ad3964915 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] 10.222.0.18 "GET /compute/v2.1/servers/ea383564-25ff-4e81-9301-c8bcb13988c7" status: 404 len: 111 microversion: 2.1 time: 0.073610 Oct 22 20:52:53.121419 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-aa087f21-c858-4436-ba4f-60ddea2dfc6e tempest-ImagesNegativeTestJSON-585030787 tempest-ImagesNegativeTestJSON-585030787-project] HTTP exception thrown: Instance 950ff1c8-47a5-411f-bf47-efe6ff2982e4 could not be found. Oct 22 20:52:53.122961 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-aa087f21-c858-4436-ba4f-60ddea2dfc6e tempest-ImagesNegativeTestJSON-585030787 tempest-ImagesNegativeTestJSON-585030787-project] Request method failure captured: Oct 22 20:52:53.122961 ncdv-master-1 devstack@n-api.service[138744]: request: GET /compute/v2.1/servers/950ff1c8-47a5-411f-bf47-efe6ff2982e4 HTTP/1.1 Oct 22 20:52:53.122961 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 20:52:53.122961 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 20:52:53.122961 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 20:52:53.122961 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 0 Oct 22 20:52:53.122961 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 20:52:53.122961 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 20:52:53.122961 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 20:52:53.122961 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 20:52:53.122961 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVFgQxwfvGtfGti0A14mI6RkjAOtXHR3VrPD0rv9mLmP4TZNMfBODR0Nnflmf1rPAOx9rui9xD39m2cTPFBl5kOdXw68dvIFP421ZAjMJf3JsI1rtgMfZMpw05iufxZttkhehtXp2a1is-eGaNyB1-mn_vXTTJ3-sv5XmYrrKIG7sG10 Oct 22 20:52:53.122961 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 20:52:53.122961 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 20:52:53.122961 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 20:52:53.122961 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 20:52:53.122961 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 20:52:53.122961 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 20:52:53.122961 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: 590a252c9203432eb15d9aef57cc3bb5 Oct 22 20:52:53.122961 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-ImagesNegativeTestJSON-585030787 Oct 22 20:52:53.122961 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 20:52:53.122961 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 20:52:53.122961 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_590a252c9203432eb15d9aef57cc3bb5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/590a252c9203432eb15d9aef57cc3bb5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/590a252c9203432eb15d9aef57cc3bb5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/590a252c9203432eb15d9aef57cc3bb5"}]}] Oct 22 20:52:53.122961 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-ImagesNegativeTestJSON-585030787 Oct 22 20:52:53.122961 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: 590a252c9203432eb15d9aef57cc3bb5 Oct 22 20:52:53.122961 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-585030787 Oct 22 20:52:53.122961 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-ImagesNegativeTestJSON-585030787-project Oct 22 20:52:53.122961 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 20:52:53.122961 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 20:52:53.122961 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: d553da484f5344169038bbe36a417699 Oct 22 20:52:53.122961 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-ImagesNegativeTestJSON-585030787-project Oct 22 20:52:53.122961 ncdv-master-1 devstack@n-api.service[138744]: method: > Oct 22 20:52:53.122961 ncdv-master-1 devstack@n-api.service[138744]: exception: Instance 950ff1c8-47a5-411f-bf47-efe6ff2982e4 could not be found. Oct 22 20:52:53.122961 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': '950ff1c8-47a5-411f-bf47-efe6ff2982e4'} Oct 22 20:52:53.122961 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:52:53.122961 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:52:53.122961 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 20:52:53.122961 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 20:52:53.122961 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 20:52:53.122961 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 20:52:53.122961 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 20:52:53.122961 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 20:52:53.122961 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 20:52:53.122961 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 20:52:53.122961 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 950ff1c8-47a5-411f-bf47-efe6ff2982e4 could not be found. Oct 22 20:52:53.122961 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:52:53.122961 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:52:53.122961 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:52:53.122961 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:52:53.122961 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:52:53.122961 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:52:53.122961 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:52:53.122961 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:52:53.122961 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:52:53.122961 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:52:53.122961 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 20:52:53.122961 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 20:52:53.122961 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 20:52:53.122961 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 20:52:53.122961 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 20:52:53.122961 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 20:52:53.122961 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 950ff1c8-47a5-411f-bf47-efe6ff2982e4 could not be found. Oct 22 20:52:53.122961 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:52:53.122961 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:52:53.122961 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:52:53.127521 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:52:53.127521 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:52:53.127521 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:52:53.127521 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 20:52:53.127521 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 20:52:53.127521 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 950ff1c8-47a5-411f-bf47-efe6ff2982e4 could not be found. Oct 22 20:52:53.127521 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:52:53.128086 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 558/1057] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:52:53 2022] GET /compute/v2.1/servers/ea383564-25ff-4e81-9301-c8bcb13988c7 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 20:52:53.136149 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-684c5771-b88b-46ce-9667-9a5d8993dfa8 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:52:53.137891 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-684c5771-b88b-46ce-9667-9a5d8993dfa8 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] [instance: 7a4f8d67-fade-412f-9554-78f39414132f] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:52:53.146640 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-aa087f21-c858-4436-ba4f-60ddea2dfc6e tempest-ImagesNegativeTestJSON-585030787 tempest-ImagesNegativeTestJSON-585030787-project] Returning 404 to user: Instance 950ff1c8-47a5-411f-bf47-efe6ff2982e4 could not be found. {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:52:53.150919 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-aa087f21-c858-4436-ba4f-60ddea2dfc6e tempest-ImagesNegativeTestJSON-585030787 tempest-ImagesNegativeTestJSON-585030787-project] 10.222.0.18 "GET /compute/v2.1/servers/950ff1c8-47a5-411f-bf47-efe6ff2982e4" status: 404 len: 111 microversion: 2.1 time: 0.094146 Oct 22 20:52:53.161376 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 500/1058] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:52:53 2022] GET /compute/v2.1/servers/950ff1c8-47a5-411f-bf47-efe6ff2982e4 => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 20:52:53.162923 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-684c5771-b88b-46ce-9667-9a5d8993dfa8 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:53.163646 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-684c5771-b88b-46ce-9667-9a5d8993dfa8 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:53.164211 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-684c5771-b88b-46ce-9667-9a5d8993dfa8 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:53.165112 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-684c5771-b88b-46ce-9667-9a5d8993dfa8 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:53.165770 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-684c5771-b88b-46ce-9667-9a5d8993dfa8 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:53.166255 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-684c5771-b88b-46ce-9667-9a5d8993dfa8 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:53.246680 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-7b1ad6ff-e6d2-42a1-a4f8-04ab96664a8d tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-703050555", "imageRef": "085e4478-6edc-4a69-8e08-f9831713eb65", "flavorRef": "452", "networks": [{"uuid": "310fed8a-623c-4efa-985c-2ea8005828e2"}]}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:52:53.249434 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-684c5771-b88b-46ce-9667-9a5d8993dfa8 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] [instance: 7a4f8d67-fade-412f-9554-78f39414132f] Going to try to terminate instance {{(pid=138745) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 20:52:53.339837 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.network.neutron [None req-7b1ad6ff-e6d2-42a1-a4f8-04ab96664a8d tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] validate_networks() for [('310fed8a-623c-4efa-985c-2ea8005828e2', None, None, None, None, None)] {{(pid=138744) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 20:52:53.436610 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-684c5771-b88b-46ce-9667-9a5d8993dfa8 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] 10.222.0.18 "DELETE /compute/v2.1/servers/7a4f8d67-fade-412f-9554-78f39414132f" status: 204 len: 0 microversion: 2.1 time: 0.310754 Oct 22 20:52:53.437537 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 559/1059] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 20:52:53 2022] DELETE /compute/v2.1/servers/7a4f8d67-fade-412f-9554-78f39414132f => generated 0 bytes in 313 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 20:52:53.448530 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-6c446ed3-cbd2-4d28-9883-39f1dce9df60 tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:52:53.449570 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-6c446ed3-cbd2-4d28-9883-39f1dce9df60 tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] [instance: 472bbccc-485e-43ce-a9cd-a3148bfccdbd] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:52:53.457184 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6c446ed3-cbd2-4d28-9883-39f1dce9df60 tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:53.457990 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6c446ed3-cbd2-4d28-9883-39f1dce9df60 tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:53.458592 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6c446ed3-cbd2-4d28-9883-39f1dce9df60 tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:53.459537 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6c446ed3-cbd2-4d28-9883-39f1dce9df60 tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:53.460278 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6c446ed3-cbd2-4d28-9883-39f1dce9df60 tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:53.460879 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6c446ed3-cbd2-4d28-9883-39f1dce9df60 tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:54.228263 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-6c446ed3-cbd2-4d28-9883-39f1dce9df60 tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01ba79ccd0d940a2899a035635862219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0400ae826f8e4bd8a2e4c981880a59c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:52:54.237913 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-6c446ed3-cbd2-4d28-9883-39f1dce9df60 tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] 10.222.0.18 "GET /compute/v2.1/servers/472bbccc-485e-43ce-a9cd-a3148bfccdbd" status: 200 len: 1316 microversion: 2.1 time: 0.795141 Oct 22 20:52:54.238844 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 560/1060] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:52:53 2022] GET /compute/v2.1/servers/472bbccc-485e-43ce-a9cd-a3148bfccdbd => generated 1316 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:52:54.244690 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-4f59daa0-e2e0-419f-9fa8-cbd3409d9583 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:52:54.245572 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-4f59daa0-e2e0-419f-9fa8-cbd3409d9583 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] [instance: 7a4f8d67-fade-412f-9554-78f39414132f] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:52:54.252317 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4f59daa0-e2e0-419f-9fa8-cbd3409d9583 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:54.253037 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4f59daa0-e2e0-419f-9fa8-cbd3409d9583 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:54.253628 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4f59daa0-e2e0-419f-9fa8-cbd3409d9583 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:54.254482 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4f59daa0-e2e0-419f-9fa8-cbd3409d9583 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:54.255092 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4f59daa0-e2e0-419f-9fa8-cbd3409d9583 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:54.256177 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4f59daa0-e2e0-419f-9fa8-cbd3409d9583 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:54.730115 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-4f59daa0-e2e0-419f-9fa8-cbd3409d9583 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91cf84a287b74618ae1b3368785b0b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902e239d67664098895ab24340b0b780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:52:54.738913 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-4f59daa0-e2e0-419f-9fa8-cbd3409d9583 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] 10.222.0.18 "GET /compute/v2.1/servers/7a4f8d67-fade-412f-9554-78f39414132f" status: 200 len: 1470 microversion: 2.1 time: 0.498561 Oct 22 20:52:54.740160 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 561/1061] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:52:54 2022] GET /compute/v2.1/servers/7a4f8d67-fade-412f-9554-78f39414132f => generated 1470 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:52:54.954337 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-7b1ad6ff-e6d2-42a1-a4f8-04ab96664a8d tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Flavor limits 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 20:52:54.955509 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-7b1ad6ff-e6d2-42a1-a4f8-04ab96664a8d tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Image limits 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 20:52:54.956099 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-7b1ad6ff-e6d2-42a1-a4f8-04ab96664a8d tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Flavor pref 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 20:52:54.956454 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-7b1ad6ff-e6d2-42a1-a4f8-04ab96664a8d tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Image pref 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 20:52:54.957143 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-7b1ad6ff-e6d2-42a1-a4f8-04ab96664a8d tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 20:52:54.967190 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7b1ad6ff-e6d2-42a1-a4f8-04ab96664a8d tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:54.967888 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7b1ad6ff-e6d2-42a1-a4f8-04ab96664a8d tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:54.968343 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7b1ad6ff-e6d2-42a1-a4f8-04ab96664a8d tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:54.969065 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7b1ad6ff-e6d2-42a1-a4f8-04ab96664a8d tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:54.969740 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7b1ad6ff-e6d2-42a1-a4f8-04ab96664a8d tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:54.970330 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7b1ad6ff-e6d2-42a1-a4f8-04ab96664a8d tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:54.992372 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-7b1ad6ff-e6d2-42a1-a4f8-04ab96664a8d tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Getting quotas for project 3e48413ed1ac4e1ea65fb38f097881db. Resources: {'cores', 'instances', 'ram'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 20:52:54.998977 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-7b1ad6ff-e6d2-42a1-a4f8-04ab96664a8d tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Getting quotas for user 34f8af8ee2b545bead90fffd6c6c4896 and project 3e48413ed1ac4e1ea65fb38f097881db. Resources: {'cores', 'instances', 'ram'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 20:52:55.013702 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-7b1ad6ff-e6d2-42a1-a4f8-04ab96664a8d tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Going to run 1 instances... {{(pid=138744) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 20:52:55.016988 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-7b1ad6ff-e6d2-42a1-a4f8-04ab96664a8d tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] [instance: 87fe386a-f98b-46b8-86f2-993e25292785] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='085e4478-6edc-4a69-8e08-f9831713eb65',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138744) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 20:52:55.076083 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-7b1ad6ff-e6d2-42a1-a4f8-04ab96664a8d tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.834864 Oct 22 20:52:55.076891 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 501/1062] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Oct 22 20:52:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 1836 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 20:52:55.089270 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-880a6433-45d9-40df-8e1d-bbab281c3b8f tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:52:55.090047 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-880a6433-45d9-40df-8e1d-bbab281c3b8f tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] [instance: 87fe386a-f98b-46b8-86f2-993e25292785] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:52:55.094581 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:52:55.195256 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-880a6433-45d9-40df-8e1d-bbab281c3b8f tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34f8af8ee2b545bead90fffd6c6c4896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48413ed1ac4e1ea65fb38f097881db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:52:55.213899 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-880a6433-45d9-40df-8e1d-bbab281c3b8f tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] 10.222.0.18 "GET /compute/v2.1/servers/87fe386a-f98b-46b8-86f2-993e25292785" status: 200 len: 1217 microversion: 2.1 time: 0.129196 Oct 22 20:52:55.214617 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 562/1063] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:52:55 2022] GET /compute/v2.1/servers/87fe386a-f98b-46b8-86f2-993e25292785 => generated 1217 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:52:55.261830 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-0816936e-c726-45a1-a649-fb36e174a1d7 tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:52:55.263769 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-0816936e-c726-45a1-a649-fb36e174a1d7 tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] [instance: 472bbccc-485e-43ce-a9cd-a3148bfccdbd] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:52:55.273514 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0816936e-c726-45a1-a649-fb36e174a1d7 tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:55.274801 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0816936e-c726-45a1-a649-fb36e174a1d7 tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:55.275434 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0816936e-c726-45a1-a649-fb36e174a1d7 tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:55.276322 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0816936e-c726-45a1-a649-fb36e174a1d7 tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:55.276926 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0816936e-c726-45a1-a649-fb36e174a1d7 tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:55.277614 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0816936e-c726-45a1-a649-fb36e174a1d7 tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:55.592966 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-0816936e-c726-45a1-a649-fb36e174a1d7 tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01ba79ccd0d940a2899a035635862219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0400ae826f8e4bd8a2e4c981880a59c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:52:55.603543 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-0816936e-c726-45a1-a649-fb36e174a1d7 tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] 10.222.0.18 "GET /compute/v2.1/servers/472bbccc-485e-43ce-a9cd-a3148bfccdbd" status: 200 len: 1316 microversion: 2.1 time: 0.343955 Oct 22 20:52:55.605754 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 502/1064] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:52:55 2022] GET /compute/v2.1/servers/472bbccc-485e-43ce-a9cd-a3148bfccdbd => generated 1316 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:52:55.763687 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-ddbeba21-d128-43e9-bf3a-a4bec0f22c2a tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:52:55.765287 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-ddbeba21-d128-43e9-bf3a-a4bec0f22c2a tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] [instance: 7a4f8d67-fade-412f-9554-78f39414132f] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:52:55.779845 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ddbeba21-d128-43e9-bf3a-a4bec0f22c2a tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:55.783662 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ddbeba21-d128-43e9-bf3a-a4bec0f22c2a tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:55.784403 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ddbeba21-d128-43e9-bf3a-a4bec0f22c2a tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:55.785678 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ddbeba21-d128-43e9-bf3a-a4bec0f22c2a tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:55.786385 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ddbeba21-d128-43e9-bf3a-a4bec0f22c2a tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:55.786975 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ddbeba21-d128-43e9-bf3a-a4bec0f22c2a tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:55.792906 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-57590eac-cd89-4ab3-b31a-e5e9089618ed req-13a0d7db-bed5-4f1e-959e-f2ecc2bd23c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a4f8d67-fade-412f-9554-78f39414132f", "name": "network-vif-deleted", "tag": "a282ab7b-0cb4-4ab4-a8a5-cae0fe603953"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:52:55.815153 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2,nova_api:INSERT=6 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:52:55.841933 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-57590eac-cd89-4ab3-b31a-e5e9089618ed req-13a0d7db-bed5-4f1e-959e-f2ecc2bd23c5 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:55.842958 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-57590eac-cd89-4ab3-b31a-e5e9089618ed req-13a0d7db-bed5-4f1e-959e-f2ecc2bd23c5 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:55.845906 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-57590eac-cd89-4ab3-b31a-e5e9089618ed req-13a0d7db-bed5-4f1e-959e-f2ecc2bd23c5 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:55.889190 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-57590eac-cd89-4ab3-b31a-e5e9089618ed req-13a0d7db-bed5-4f1e-959e-f2ecc2bd23c5 service nova] Creating event network-vif-deleted:a282ab7b-0cb4-4ab4-a8a5-cae0fe603953 for instance 7a4f8d67-fade-412f-9554-78f39414132f on nch2-master-1 Oct 22 20:52:55.895736 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-57590eac-cd89-4ab3-b31a-e5e9089618ed req-13a0d7db-bed5-4f1e-959e-f2ecc2bd23c5 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107211 Oct 22 20:52:55.897218 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 503/1065] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:52:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 20:52:55.915680 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-50d3a0a4-6bb1-4549-9598-c5d6cc378699 req-62ff764c-abee-4909-8a9d-da9dfcd0b897 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "472bbccc-485e-43ce-a9cd-a3148bfccdbd", "tag": "23775c97-962a-4643-9a82-cfb4b15013e8"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:52:55.930224 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-50d3a0a4-6bb1-4549-9598-c5d6cc378699 req-62ff764c-abee-4909-8a9d-da9dfcd0b897 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:55.931106 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-50d3a0a4-6bb1-4549-9598-c5d6cc378699 req-62ff764c-abee-4909-8a9d-da9dfcd0b897 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:55.932347 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-50d3a0a4-6bb1-4549-9598-c5d6cc378699 req-62ff764c-abee-4909-8a9d-da9dfcd0b897 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:55.948084 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-50d3a0a4-6bb1-4549-9598-c5d6cc378699 req-62ff764c-abee-4909-8a9d-da9dfcd0b897 service nova] Creating event network-changed:23775c97-962a-4643-9a82-cfb4b15013e8 for instance 472bbccc-485e-43ce-a9cd-a3148bfccdbd on nch1-master-1 Oct 22 20:52:55.955241 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-50d3a0a4-6bb1-4549-9598-c5d6cc378699 req-62ff764c-abee-4909-8a9d-da9dfcd0b897 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054089 Oct 22 20:52:55.957562 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 504/1066] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:52:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:52:56.003162 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-ddbeba21-d128-43e9-bf3a-a4bec0f22c2a tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91cf84a287b74618ae1b3368785b0b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902e239d67664098895ab24340b0b780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:52:56.015997 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-ddbeba21-d128-43e9-bf3a-a4bec0f22c2a tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] 10.222.0.18 "GET /compute/v2.1/servers/7a4f8d67-fade-412f-9554-78f39414132f" status: 200 len: 1428 microversion: 2.1 time: 0.257350 Oct 22 20:52:56.017111 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 563/1067] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:52:55 2022] GET /compute/v2.1/servers/7a4f8d67-fade-412f-9554-78f39414132f => generated 1428 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:52:56.243152 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-a3c19879-9c85-41df-aa37-f182151bc9ec tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:52:56.245724 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-a3c19879-9c85-41df-aa37-f182151bc9ec tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] [instance: 87fe386a-f98b-46b8-86f2-993e25292785] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:52:56.270191 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a3c19879-9c85-41df-aa37-f182151bc9ec tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:56.272827 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a3c19879-9c85-41df-aa37-f182151bc9ec tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:56.273327 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a3c19879-9c85-41df-aa37-f182151bc9ec tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:56.274067 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a3c19879-9c85-41df-aa37-f182151bc9ec tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:56.274524 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a3c19879-9c85-41df-aa37-f182151bc9ec tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:56.274952 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a3c19879-9c85-41df-aa37-f182151bc9ec tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:56.535648 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-a3c19879-9c85-41df-aa37-f182151bc9ec tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34f8af8ee2b545bead90fffd6c6c4896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48413ed1ac4e1ea65fb38f097881db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:52:56.546111 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-a3c19879-9c85-41df-aa37-f182151bc9ec tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] 10.222.0.18 "GET /compute/v2.1/servers/87fe386a-f98b-46b8-86f2-993e25292785" status: 200 len: 1213 microversion: 2.1 time: 0.309469 Oct 22 20:52:56.549732 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 505/1068] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:52:56 2022] GET /compute/v2.1/servers/87fe386a-f98b-46b8-86f2-993e25292785 => generated 1213 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:52:56.627595 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-b43ec400-d8b8-4c0a-8b02-0ee04a83d1eb tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:52:56.628214 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-b43ec400-d8b8-4c0a-8b02-0ee04a83d1eb tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] [instance: 472bbccc-485e-43ce-a9cd-a3148bfccdbd] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:52:56.636999 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b43ec400-d8b8-4c0a-8b02-0ee04a83d1eb tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:56.637822 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b43ec400-d8b8-4c0a-8b02-0ee04a83d1eb tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:56.638417 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b43ec400-d8b8-4c0a-8b02-0ee04a83d1eb tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:56.639323 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b43ec400-d8b8-4c0a-8b02-0ee04a83d1eb tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:56.639985 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b43ec400-d8b8-4c0a-8b02-0ee04a83d1eb tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:56.640581 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b43ec400-d8b8-4c0a-8b02-0ee04a83d1eb tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:56.988370 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-b43ec400-d8b8-4c0a-8b02-0ee04a83d1eb tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01ba79ccd0d940a2899a035635862219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0400ae826f8e4bd8a2e4c981880a59c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:52:56.998412 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-b43ec400-d8b8-4c0a-8b02-0ee04a83d1eb tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] 10.222.0.18 "GET /compute/v2.1/servers/472bbccc-485e-43ce-a9cd-a3148bfccdbd" status: 200 len: 1316 microversion: 2.1 time: 0.374754 Oct 22 20:52:57.004106 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 564/1069] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:52:56 2022] GET /compute/v2.1/servers/472bbccc-485e-43ce-a9cd-a3148bfccdbd => generated 1316 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:52:57.044432 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-81e22ec7-715a-4542-94e0-df84d6eadac8 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:52:57.045857 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-81e22ec7-715a-4542-94e0-df84d6eadac8 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] [instance: 7a4f8d67-fade-412f-9554-78f39414132f] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:52:57.056786 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-81e22ec7-715a-4542-94e0-df84d6eadac8 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:57.057958 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-81e22ec7-715a-4542-94e0-df84d6eadac8 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:57.058661 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-81e22ec7-715a-4542-94e0-df84d6eadac8 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:57.059702 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-81e22ec7-715a-4542-94e0-df84d6eadac8 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:57.060585 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-81e22ec7-715a-4542-94e0-df84d6eadac8 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:57.061215 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-81e22ec7-715a-4542-94e0-df84d6eadac8 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:57.099383 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-81e22ec7-715a-4542-94e0-df84d6eadac8 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] HTTP exception thrown: Instance 7a4f8d67-fade-412f-9554-78f39414132f could not be found. Oct 22 20:52:57.101373 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-81e22ec7-715a-4542-94e0-df84d6eadac8 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Request method failure captured: Oct 22 20:52:57.101373 ncdv-master-1 devstack@n-api.service[138744]: request: GET /compute/v2.1/servers/7a4f8d67-fade-412f-9554-78f39414132f HTTP/1.1 Oct 22 20:52:57.101373 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 20:52:57.101373 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 20:52:57.101373 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 20:52:57.101373 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 0 Oct 22 20:52:57.101373 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 20:52:57.101373 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 20:52:57.101373 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 20:52:57.101373 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 20:52:57.101373 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVFeL5NpvaUPvqiDt8qD72HqMh0DrXz0UtoQAeO42jMFpMPYqVC0YFDMA438gQzhAHNDHcP5InOc3xi8IB_k6cXq3If0lWEwoKo4DiRlB10MzTtg6EzpKpbfTqN9Yi6nvd2u_6U9lIt3lLKhkPDkM5OdhEDFJSGZOTF7Z9mtdL7wRjmc Oct 22 20:52:57.101373 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 20:52:57.101373 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 20:52:57.101373 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 20:52:57.101373 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 20:52:57.101373 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 20:52:57.101373 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 20:52:57.101373 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: 902e239d67664098895ab24340b0b780 Oct 22 20:52:57.101373 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-ServersOnMultiNodesTest-2081149331 Oct 22 20:52:57.101373 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 20:52:57.101373 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 20:52:57.101373 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_902e239d67664098895ab24340b0b780"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/902e239d67664098895ab24340b0b780"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/902e239d67664098895ab24340b0b780"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/902e239d67664098895ab24340b0b780"}]}] Oct 22 20:52:57.101373 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-ServersOnMultiNodesTest-2081149331 Oct 22 20:52:57.101373 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: 902e239d67664098895ab24340b0b780 Oct 22 20:52:57.101373 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-2081149331 Oct 22 20:52:57.101373 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-ServersOnMultiNodesTest-2081149331-project Oct 22 20:52:57.101373 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 20:52:57.101373 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 20:52:57.101373 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: 91cf84a287b74618ae1b3368785b0b4c Oct 22 20:52:57.101373 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-ServersOnMultiNodesTest-2081149331-project Oct 22 20:52:57.101373 ncdv-master-1 devstack@n-api.service[138744]: method: > Oct 22 20:52:57.101373 ncdv-master-1 devstack@n-api.service[138744]: exception: Instance 7a4f8d67-fade-412f-9554-78f39414132f could not be found. Oct 22 20:52:57.101373 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': '7a4f8d67-fade-412f-9554-78f39414132f'} Oct 22 20:52:57.101373 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:52:57.101373 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:52:57.101373 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 20:52:57.101373 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 20:52:57.101373 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 20:52:57.101373 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 20:52:57.101373 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 20:52:57.101373 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 20:52:57.101373 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 20:52:57.101373 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 20:52:57.101373 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7a4f8d67-fade-412f-9554-78f39414132f could not be found. Oct 22 20:52:57.101373 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:52:57.101373 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:52:57.101373 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:52:57.101373 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:52:57.101373 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:52:57.101373 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:52:57.101373 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:52:57.101373 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:52:57.101373 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:52:57.101373 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:52:57.101373 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 20:52:57.101373 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 20:52:57.101373 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 20:52:57.101373 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 20:52:57.101373 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 20:52:57.101373 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 20:52:57.101373 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7a4f8d67-fade-412f-9554-78f39414132f could not be found. Oct 22 20:52:57.101373 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:52:57.101373 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:52:57.101373 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:52:57.105624 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:52:57.105624 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:52:57.105624 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:52:57.105624 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 20:52:57.105624 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 20:52:57.105624 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7a4f8d67-fade-412f-9554-78f39414132f could not be found. Oct 22 20:52:57.105624 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:52:57.107505 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-81e22ec7-715a-4542-94e0-df84d6eadac8 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Returning 404 to user: Instance 7a4f8d67-fade-412f-9554-78f39414132f could not be found. {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:52:57.108528 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-81e22ec7-715a-4542-94e0-df84d6eadac8 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] 10.222.0.18 "GET /compute/v2.1/servers/7a4f8d67-fade-412f-9554-78f39414132f" status: 404 len: 111 microversion: 2.1 time: 0.068413 Oct 22 20:52:57.112653 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 506/1070] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:52:57 2022] GET /compute/v2.1/servers/7a4f8d67-fade-412f-9554-78f39414132f => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 20:52:57.117518 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-e996198b-50b2-4957-ad9a-efba20d9d935 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:52:57.118022 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-e996198b-50b2-4957-ad9a-efba20d9d935 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] [instance: 4ef975af-c582-4e7e-9913-e4be1688f81d] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:52:57.126369 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e996198b-50b2-4957-ad9a-efba20d9d935 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:57.126889 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e996198b-50b2-4957-ad9a-efba20d9d935 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:57.127330 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e996198b-50b2-4957-ad9a-efba20d9d935 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:57.130498 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e996198b-50b2-4957-ad9a-efba20d9d935 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:57.131190 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e996198b-50b2-4957-ad9a-efba20d9d935 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:57.135827 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e996198b-50b2-4957-ad9a-efba20d9d935 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:57.170682 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-e996198b-50b2-4957-ad9a-efba20d9d935 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] [instance: 4ef975af-c582-4e7e-9913-e4be1688f81d] Going to try to terminate instance {{(pid=138745) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 20:52:57.319864 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-e996198b-50b2-4957-ad9a-efba20d9d935 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] 10.222.0.18 "DELETE /compute/v2.1/servers/4ef975af-c582-4e7e-9913-e4be1688f81d" status: 204 len: 0 microversion: 2.1 time: 0.203947 Oct 22 20:52:57.322082 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 565/1071] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 20:52:57 2022] DELETE /compute/v2.1/servers/4ef975af-c582-4e7e-9913-e4be1688f81d => generated 0 bytes in 209 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 20:52:57.329911 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-7f736b8c-5e8e-49a4-8584-1251358abba5 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:52:57.330498 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-7f736b8c-5e8e-49a4-8584-1251358abba5 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] [instance: c190c6e5-8b3b-4946-bb18-01fa5aba6fd2] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:52:57.338720 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7f736b8c-5e8e-49a4-8584-1251358abba5 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:57.344247 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7f736b8c-5e8e-49a4-8584-1251358abba5 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:57.344961 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7f736b8c-5e8e-49a4-8584-1251358abba5 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:57.345873 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7f736b8c-5e8e-49a4-8584-1251358abba5 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:57.346484 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7f736b8c-5e8e-49a4-8584-1251358abba5 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:57.347169 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7f736b8c-5e8e-49a4-8584-1251358abba5 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:57.411205 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-7f736b8c-5e8e-49a4-8584-1251358abba5 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] [instance: c190c6e5-8b3b-4946-bb18-01fa5aba6fd2] Going to try to terminate instance {{(pid=138744) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 20:52:57.570989 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-3be94be5-8bcd-4d87-9a1c-87ac25b3ff4f tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:52:57.572114 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-3be94be5-8bcd-4d87-9a1c-87ac25b3ff4f tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] [instance: 87fe386a-f98b-46b8-86f2-993e25292785] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:52:57.586604 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-7f736b8c-5e8e-49a4-8584-1251358abba5 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] 10.222.0.18 "DELETE /compute/v2.1/servers/c190c6e5-8b3b-4946-bb18-01fa5aba6fd2" status: 204 len: 0 microversion: 2.1 time: 0.260147 Oct 22 20:52:57.587217 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 507/1072] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 20:52:57 2022] DELETE /compute/v2.1/servers/c190c6e5-8b3b-4946-bb18-01fa5aba6fd2 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 22 20:52:57.593072 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3be94be5-8bcd-4d87-9a1c-87ac25b3ff4f tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:57.594165 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3be94be5-8bcd-4d87-9a1c-87ac25b3ff4f tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:57.594827 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3be94be5-8bcd-4d87-9a1c-87ac25b3ff4f tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:57.596602 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-f8d15d2a-6fb0-4fb8-a07f-658fce86e0a3 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:52:57.596931 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3be94be5-8bcd-4d87-9a1c-87ac25b3ff4f tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:57.597328 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-f8d15d2a-6fb0-4fb8-a07f-658fce86e0a3 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] [instance: 4ef975af-c582-4e7e-9913-e4be1688f81d] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:52:57.597831 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3be94be5-8bcd-4d87-9a1c-87ac25b3ff4f tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:57.598475 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3be94be5-8bcd-4d87-9a1c-87ac25b3ff4f tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:57.611692 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f8d15d2a-6fb0-4fb8-a07f-658fce86e0a3 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:57.612475 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f8d15d2a-6fb0-4fb8-a07f-658fce86e0a3 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:57.615298 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f8d15d2a-6fb0-4fb8-a07f-658fce86e0a3 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:57.616419 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f8d15d2a-6fb0-4fb8-a07f-658fce86e0a3 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:57.617113 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f8d15d2a-6fb0-4fb8-a07f-658fce86e0a3 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:57.619433 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f8d15d2a-6fb0-4fb8-a07f-658fce86e0a3 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:57.658987 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:52:57.781873 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-3be94be5-8bcd-4d87-9a1c-87ac25b3ff4f tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34f8af8ee2b545bead90fffd6c6c4896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48413ed1ac4e1ea65fb38f097881db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:52:57.797341 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-3be94be5-8bcd-4d87-9a1c-87ac25b3ff4f tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] 10.222.0.18 "GET /compute/v2.1/servers/87fe386a-f98b-46b8-86f2-993e25292785" status: 200 len: 1277 microversion: 2.1 time: 0.230818 Oct 22 20:52:57.802325 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 566/1073] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:52:57 2022] GET /compute/v2.1/servers/87fe386a-f98b-46b8-86f2-993e25292785 => generated 1277 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 20:52:57.923714 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-f8d15d2a-6fb0-4fb8-a07f-658fce86e0a3 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91cf84a287b74618ae1b3368785b0b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902e239d67664098895ab24340b0b780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:52:57.933254 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-f8d15d2a-6fb0-4fb8-a07f-658fce86e0a3 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] 10.222.0.18 "GET /compute/v2.1/servers/4ef975af-c582-4e7e-9913-e4be1688f81d" status: 200 len: 1474 microversion: 2.1 time: 0.341404 Oct 22 20:52:57.933837 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 508/1074] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:52:57 2022] GET /compute/v2.1/servers/4ef975af-c582-4e7e-9913-e4be1688f81d => generated 1474 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:52:58.027075 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-7606d9ef-5a10-4020-8873-892d97560ede tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:52:58.029548 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-7606d9ef-5a10-4020-8873-892d97560ede tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] [instance: 472bbccc-485e-43ce-a9cd-a3148bfccdbd] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:52:58.043230 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7606d9ef-5a10-4020-8873-892d97560ede tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:58.046600 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7606d9ef-5a10-4020-8873-892d97560ede tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:58.047981 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7606d9ef-5a10-4020-8873-892d97560ede tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:58.049021 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7606d9ef-5a10-4020-8873-892d97560ede tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:58.050520 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7606d9ef-5a10-4020-8873-892d97560ede tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:58.051054 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7606d9ef-5a10-4020-8873-892d97560ede tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:58.330560 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-7606d9ef-5a10-4020-8873-892d97560ede tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01ba79ccd0d940a2899a035635862219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0400ae826f8e4bd8a2e4c981880a59c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:52:58.345438 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-7606d9ef-5a10-4020-8873-892d97560ede tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] 10.222.0.18 "GET /compute/v2.1/servers/472bbccc-485e-43ce-a9cd-a3148bfccdbd" status: 200 len: 1316 microversion: 2.1 time: 0.322593 Oct 22 20:52:58.358380 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 567/1075] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:52:58 2022] GET /compute/v2.1/servers/472bbccc-485e-43ce-a9cd-a3148bfccdbd => generated 1316 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:52:58.824785 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-cac60557-bff2-4d16-bcd5-2b437cf25a27 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:52:58.825493 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-cac60557-bff2-4d16-bcd5-2b437cf25a27 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] [instance: 87fe386a-f98b-46b8-86f2-993e25292785] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:52:58.832609 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cac60557-bff2-4d16-bcd5-2b437cf25a27 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:58.833207 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cac60557-bff2-4d16-bcd5-2b437cf25a27 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:58.833712 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cac60557-bff2-4d16-bcd5-2b437cf25a27 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:58.834561 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cac60557-bff2-4d16-bcd5-2b437cf25a27 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:58.835142 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cac60557-bff2-4d16-bcd5-2b437cf25a27 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:58.835626 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cac60557-bff2-4d16-bcd5-2b437cf25a27 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:58.926402 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-cac60557-bff2-4d16-bcd5-2b437cf25a27 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34f8af8ee2b545bead90fffd6c6c4896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48413ed1ac4e1ea65fb38f097881db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:52:58.937456 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-cac60557-bff2-4d16-bcd5-2b437cf25a27 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] 10.222.0.18 "GET /compute/v2.1/servers/87fe386a-f98b-46b8-86f2-993e25292785" status: 200 len: 1275 microversion: 2.1 time: 0.116844 Oct 22 20:52:58.938730 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 509/1076] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:52:58 2022] GET /compute/v2.1/servers/87fe386a-f98b-46b8-86f2-993e25292785 => generated 1275 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:52:58.959540 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-dd4fea5e-27fc-4a8e-93cb-99860152662e tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:52:58.960668 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-dd4fea5e-27fc-4a8e-93cb-99860152662e tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] [instance: 4ef975af-c582-4e7e-9913-e4be1688f81d] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:52:58.968691 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-dd4fea5e-27fc-4a8e-93cb-99860152662e tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:58.969516 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-dd4fea5e-27fc-4a8e-93cb-99860152662e tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:58.970190 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-dd4fea5e-27fc-4a8e-93cb-99860152662e tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:58.971238 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-dd4fea5e-27fc-4a8e-93cb-99860152662e tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:58.972104 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-dd4fea5e-27fc-4a8e-93cb-99860152662e tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:58.972758 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-dd4fea5e-27fc-4a8e-93cb-99860152662e tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:59.215782 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-dd4fea5e-27fc-4a8e-93cb-99860152662e tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91cf84a287b74618ae1b3368785b0b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902e239d67664098895ab24340b0b780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:52:59.226021 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-dd4fea5e-27fc-4a8e-93cb-99860152662e tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] 10.222.0.18 "GET /compute/v2.1/servers/4ef975af-c582-4e7e-9913-e4be1688f81d" status: 200 len: 1474 microversion: 2.1 time: 0.270172 Oct 22 20:52:59.229627 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 568/1077] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:52:58 2022] GET /compute/v2.1/servers/4ef975af-c582-4e7e-9913-e4be1688f81d => generated 1474 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:52:59.394529 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-7ebbdb35-ab99-4111-b282-767d04bfe6a0 tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:52:59.399986 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-7ebbdb35-ab99-4111-b282-767d04bfe6a0 tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] [instance: 472bbccc-485e-43ce-a9cd-a3148bfccdbd] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:52:59.410921 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7ebbdb35-ab99-4111-b282-767d04bfe6a0 tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:59.412849 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7ebbdb35-ab99-4111-b282-767d04bfe6a0 tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:59.416716 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7ebbdb35-ab99-4111-b282-767d04bfe6a0 tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:59.418362 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7ebbdb35-ab99-4111-b282-767d04bfe6a0 tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:59.420462 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7ebbdb35-ab99-4111-b282-767d04bfe6a0 tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:59.421175 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7ebbdb35-ab99-4111-b282-767d04bfe6a0 tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:59.781762 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-9a8510e0-aef9-4313-ae95-eddaa908d955 req-1f1920f0-0947-48ed-9039-b4210753e1fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ef975af-c582-4e7e-9913-e4be1688f81d", "name": "network-vif-deleted", "tag": "15aed3a5-c90a-49b8-9c3c-f9d8afe7023d"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:52:59.794611 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-7ebbdb35-ab99-4111-b282-767d04bfe6a0 tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01ba79ccd0d940a2899a035635862219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0400ae826f8e4bd8a2e4c981880a59c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:52:59.797735 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-9a8510e0-aef9-4313-ae95-eddaa908d955 req-1f1920f0-0947-48ed-9039-b4210753e1fb service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:59.801635 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-9a8510e0-aef9-4313-ae95-eddaa908d955 req-1f1920f0-0947-48ed-9039-b4210753e1fb service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:59.802283 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-9a8510e0-aef9-4313-ae95-eddaa908d955 req-1f1920f0-0947-48ed-9039-b4210753e1fb service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:59.819673 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-7ebbdb35-ab99-4111-b282-767d04bfe6a0 tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] 10.222.0.18 "GET /compute/v2.1/servers/472bbccc-485e-43ce-a9cd-a3148bfccdbd" status: 200 len: 1316 microversion: 2.1 time: 0.441706 Oct 22 20:52:59.820910 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 510/1078] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:52:59 2022] GET /compute/v2.1/servers/472bbccc-485e-43ce-a9cd-a3148bfccdbd => generated 1316 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:52:59.825236 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-9a8510e0-aef9-4313-ae95-eddaa908d955 req-1f1920f0-0947-48ed-9039-b4210753e1fb service nova] Creating event network-vif-deleted:15aed3a5-c90a-49b8-9c3c-f9d8afe7023d for instance 4ef975af-c582-4e7e-9913-e4be1688f81d on nch2-master-1 Oct 22 20:52:59.838151 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-9a8510e0-aef9-4313-ae95-eddaa908d955 req-1f1920f0-0947-48ed-9039-b4210753e1fb service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060215 Oct 22 20:52:59.839051 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 569/1079] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:52:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:52:59.961990 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-8bf80480-09ce-4f38-a347-6a1b25ed07bf tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:52:59.963421 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-8bf80480-09ce-4f38-a347-6a1b25ed07bf tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] [instance: 87fe386a-f98b-46b8-86f2-993e25292785] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:52:59.979403 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8bf80480-09ce-4f38-a347-6a1b25ed07bf tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:59.980428 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8bf80480-09ce-4f38-a347-6a1b25ed07bf tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:59.981063 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8bf80480-09ce-4f38-a347-6a1b25ed07bf tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:52:59.981973 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8bf80480-09ce-4f38-a347-6a1b25ed07bf tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:52:59.982615 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8bf80480-09ce-4f38-a347-6a1b25ed07bf tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:52:59.983314 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8bf80480-09ce-4f38-a347-6a1b25ed07bf tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:00.112381 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-8bf80480-09ce-4f38-a347-6a1b25ed07bf tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34f8af8ee2b545bead90fffd6c6c4896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48413ed1ac4e1ea65fb38f097881db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:53:00.133555 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-8bf80480-09ce-4f38-a347-6a1b25ed07bf tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] 10.222.0.18 "GET /compute/v2.1/servers/87fe386a-f98b-46b8-86f2-993e25292785" status: 200 len: 1275 microversion: 2.1 time: 0.175935 Oct 22 20:53:00.136110 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 511/1080] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:52:59 2022] GET /compute/v2.1/servers/87fe386a-f98b-46b8-86f2-993e25292785 => generated 1275 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:53:00.252848 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-32fd7ff6-277e-4a78-a283-ef218581c17b tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:53:00.254165 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-32fd7ff6-277e-4a78-a283-ef218581c17b tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] [instance: 4ef975af-c582-4e7e-9913-e4be1688f81d] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:53:00.261892 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-32fd7ff6-277e-4a78-a283-ef218581c17b tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:00.262682 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-32fd7ff6-277e-4a78-a283-ef218581c17b tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:00.263283 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-32fd7ff6-277e-4a78-a283-ef218581c17b tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:00.264039 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-32fd7ff6-277e-4a78-a283-ef218581c17b tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:00.264640 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-32fd7ff6-277e-4a78-a283-ef218581c17b tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:00.265537 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-32fd7ff6-277e-4a78-a283-ef218581c17b tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:00.378998 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-32fd7ff6-277e-4a78-a283-ef218581c17b tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:00.379475 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-32fd7ff6-277e-4a78-a283-ef218581c17b tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:00.379921 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-32fd7ff6-277e-4a78-a283-ef218581c17b tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:00.380567 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.objects.instance [None req-32fd7ff6-277e-4a78-a283-ef218581c17b tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lazy-loading 'fault' on Instance uuid 4ef975af-c582-4e7e-9913-e4be1688f81d {{(pid=138745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 20:53:00.478389 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-32fd7ff6-277e-4a78-a283-ef218581c17b tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91cf84a287b74618ae1b3368785b0b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902e239d67664098895ab24340b0b780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:53:00.513589 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-32fd7ff6-277e-4a78-a283-ef218581c17b tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] 10.222.0.18 "GET /compute/v2.1/servers/4ef975af-c582-4e7e-9913-e4be1688f81d" status: 200 len: 1308 microversion: 2.1 time: 0.261593 Oct 22 20:53:00.536798 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 570/1081] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:53:00 2022] GET /compute/v2.1/servers/4ef975af-c582-4e7e-9913-e4be1688f81d => generated 1308 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:53:00.844834 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-cc9c011e-b491-43b4-a9b7-edd40a50654d tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:53:00.845954 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-cc9c011e-b491-43b4-a9b7-edd40a50654d tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] [instance: 472bbccc-485e-43ce-a9cd-a3148bfccdbd] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:53:00.860602 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cc9c011e-b491-43b4-a9b7-edd40a50654d tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:00.861133 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cc9c011e-b491-43b4-a9b7-edd40a50654d tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:00.862573 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cc9c011e-b491-43b4-a9b7-edd40a50654d tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:00.864335 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cc9c011e-b491-43b4-a9b7-edd40a50654d tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:00.867840 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cc9c011e-b491-43b4-a9b7-edd40a50654d tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:00.868218 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cc9c011e-b491-43b4-a9b7-edd40a50654d tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:01.162433 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-d54284d3-fc61-44d3-9564-2c3a0b0a378e tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:53:01.163886 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-d54284d3-fc61-44d3-9564-2c3a0b0a378e tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] [instance: 87fe386a-f98b-46b8-86f2-993e25292785] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:53:01.172667 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d54284d3-fc61-44d3-9564-2c3a0b0a378e tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:01.177834 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d54284d3-fc61-44d3-9564-2c3a0b0a378e tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:01.179785 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d54284d3-fc61-44d3-9564-2c3a0b0a378e tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:01.183585 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d54284d3-fc61-44d3-9564-2c3a0b0a378e tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:01.184458 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d54284d3-fc61-44d3-9564-2c3a0b0a378e tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:01.185139 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d54284d3-fc61-44d3-9564-2c3a0b0a378e tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:01.588150 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-cc9c011e-b491-43b4-a9b7-edd40a50654d tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01ba79ccd0d940a2899a035635862219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0400ae826f8e4bd8a2e4c981880a59c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:53:01.599048 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-cc9c011e-b491-43b4-a9b7-edd40a50654d tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] 10.222.0.18 "GET /compute/v2.1/servers/472bbccc-485e-43ce-a9cd-a3148bfccdbd" status: 200 len: 1316 microversion: 2.1 time: 0.759712 Oct 22 20:53:01.618140 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 512/1082] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:53:00 2022] GET /compute/v2.1/servers/472bbccc-485e-43ce-a9cd-a3148bfccdbd => generated 1316 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 20:53:01.628683 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-e928b1ca-5bfe-41d1-a2c1-a64a38ca6569 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:53:01.629301 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-e928b1ca-5bfe-41d1-a2c1-a64a38ca6569 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] [instance: 4ef975af-c582-4e7e-9913-e4be1688f81d] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:53:01.648690 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e928b1ca-5bfe-41d1-a2c1-a64a38ca6569 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:01.649527 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e928b1ca-5bfe-41d1-a2c1-a64a38ca6569 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:01.650174 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e928b1ca-5bfe-41d1-a2c1-a64a38ca6569 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:01.652560 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e928b1ca-5bfe-41d1-a2c1-a64a38ca6569 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:01.656036 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e928b1ca-5bfe-41d1-a2c1-a64a38ca6569 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:01.657064 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e928b1ca-5bfe-41d1-a2c1-a64a38ca6569 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:01.685830 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-e928b1ca-5bfe-41d1-a2c1-a64a38ca6569 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] HTTP exception thrown: Instance 4ef975af-c582-4e7e-9913-e4be1688f81d could not be found. Oct 22 20:53:01.688828 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-e928b1ca-5bfe-41d1-a2c1-a64a38ca6569 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Request method failure captured: Oct 22 20:53:01.688828 ncdv-master-1 devstack@n-api.service[138744]: request: GET /compute/v2.1/servers/4ef975af-c582-4e7e-9913-e4be1688f81d HTTP/1.1 Oct 22 20:53:01.688828 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 20:53:01.688828 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 20:53:01.688828 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 20:53:01.688828 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 0 Oct 22 20:53:01.688828 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 20:53:01.688828 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 20:53:01.688828 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 20:53:01.688828 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 20:53:01.688828 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVFeL5NpvaUPvqiDt8qD72HqMh0DrXz0UtoQAeO42jMFpMPYqVC0YFDMA438gQzhAHNDHcP5InOc3xi8IB_k6cXq3If0lWEwoKo4DiRlB10MzTtg6EzpKpbfTqN9Yi6nvd2u_6U9lIt3lLKhkPDkM5OdhEDFJSGZOTF7Z9mtdL7wRjmc Oct 22 20:53:01.688828 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 20:53:01.688828 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 20:53:01.688828 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 20:53:01.688828 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 20:53:01.688828 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 20:53:01.688828 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 20:53:01.688828 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: 902e239d67664098895ab24340b0b780 Oct 22 20:53:01.688828 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-ServersOnMultiNodesTest-2081149331 Oct 22 20:53:01.688828 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 20:53:01.688828 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 20:53:01.688828 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_902e239d67664098895ab24340b0b780"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/902e239d67664098895ab24340b0b780"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/902e239d67664098895ab24340b0b780"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/902e239d67664098895ab24340b0b780"}]}] Oct 22 20:53:01.688828 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-ServersOnMultiNodesTest-2081149331 Oct 22 20:53:01.688828 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: 902e239d67664098895ab24340b0b780 Oct 22 20:53:01.688828 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-2081149331 Oct 22 20:53:01.688828 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-ServersOnMultiNodesTest-2081149331-project Oct 22 20:53:01.688828 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 20:53:01.688828 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 20:53:01.688828 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: 91cf84a287b74618ae1b3368785b0b4c Oct 22 20:53:01.688828 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-ServersOnMultiNodesTest-2081149331-project Oct 22 20:53:01.688828 ncdv-master-1 devstack@n-api.service[138744]: method: > Oct 22 20:53:01.688828 ncdv-master-1 devstack@n-api.service[138744]: exception: Instance 4ef975af-c582-4e7e-9913-e4be1688f81d could not be found. Oct 22 20:53:01.688828 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': '4ef975af-c582-4e7e-9913-e4be1688f81d'} Oct 22 20:53:01.688828 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:53:01.688828 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:53:01.688828 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 20:53:01.688828 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 20:53:01.688828 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 20:53:01.688828 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 20:53:01.688828 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 20:53:01.688828 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 20:53:01.688828 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 20:53:01.688828 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 20:53:01.688828 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ef975af-c582-4e7e-9913-e4be1688f81d could not be found. Oct 22 20:53:01.688828 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:53:01.688828 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:53:01.688828 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:53:01.688828 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:53:01.688828 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:53:01.688828 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:53:01.688828 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:53:01.688828 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:53:01.688828 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:53:01.688828 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:53:01.688828 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 20:53:01.688828 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 20:53:01.688828 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 20:53:01.688828 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 20:53:01.688828 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 20:53:01.688828 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 20:53:01.688828 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ef975af-c582-4e7e-9913-e4be1688f81d could not be found. Oct 22 20:53:01.688828 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:53:01.688828 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:53:01.688828 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:53:01.693742 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:53:01.693742 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:53:01.693742 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:53:01.693742 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 20:53:01.693742 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 20:53:01.693742 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ef975af-c582-4e7e-9913-e4be1688f81d could not be found. Oct 22 20:53:01.693742 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:53:01.696476 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-e928b1ca-5bfe-41d1-a2c1-a64a38ca6569 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Returning 404 to user: Instance 4ef975af-c582-4e7e-9913-e4be1688f81d could not be found. {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:53:01.697610 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-e928b1ca-5bfe-41d1-a2c1-a64a38ca6569 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] 10.222.0.18 "GET /compute/v2.1/servers/4ef975af-c582-4e7e-9913-e4be1688f81d" status: 404 len: 111 microversion: 2.1 time: 0.078371 Oct 22 20:53:01.703326 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 513/1083] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:53:01 2022] GET /compute/v2.1/servers/4ef975af-c582-4e7e-9913-e4be1688f81d => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 20:53:01.712175 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-83bf2945-28b3-4b29-a22d-5be39d82d15b tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:53:01.713096 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-83bf2945-28b3-4b29-a22d-5be39d82d15b tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] [instance: c190c6e5-8b3b-4946-bb18-01fa5aba6fd2] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:53:01.725940 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-83bf2945-28b3-4b29-a22d-5be39d82d15b tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:01.731927 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-83bf2945-28b3-4b29-a22d-5be39d82d15b tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:01.732470 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-83bf2945-28b3-4b29-a22d-5be39d82d15b tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:01.734836 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-83bf2945-28b3-4b29-a22d-5be39d82d15b tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:01.735360 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-83bf2945-28b3-4b29-a22d-5be39d82d15b tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:01.735824 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-83bf2945-28b3-4b29-a22d-5be39d82d15b tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:01.777303 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-d54284d3-fc61-44d3-9564-2c3a0b0a378e tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34f8af8ee2b545bead90fffd6c6c4896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48413ed1ac4e1ea65fb38f097881db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:53:01.793961 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-d54284d3-fc61-44d3-9564-2c3a0b0a378e tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] 10.222.0.18 "GET /compute/v2.1/servers/87fe386a-f98b-46b8-86f2-993e25292785" status: 200 len: 1317 microversion: 2.1 time: 0.635360 Oct 22 20:53:01.794880 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 571/1084] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:53:01 2022] GET /compute/v2.1/servers/87fe386a-f98b-46b8-86f2-993e25292785 => generated 1317 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:53:02.265576 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-9f8b996e-7b5d-430e-ae23-7727e72056cf req-d9100a72-db80-4c7a-a8e5-4284eb43d6af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87fe386a-f98b-46b8-86f2-993e25292785", "tag": "e5a9751a-054f-4649-be5b-0a1cbf094c02"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:53:02.281408 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-83bf2945-28b3-4b29-a22d-5be39d82d15b tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91cf84a287b74618ae1b3368785b0b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902e239d67664098895ab24340b0b780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:53:02.289349 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-9f8b996e-7b5d-430e-ae23-7727e72056cf req-d9100a72-db80-4c7a-a8e5-4284eb43d6af service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:02.290051 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-9f8b996e-7b5d-430e-ae23-7727e72056cf req-d9100a72-db80-4c7a-a8e5-4284eb43d6af service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:02.290597 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-9f8b996e-7b5d-430e-ae23-7727e72056cf req-d9100a72-db80-4c7a-a8e5-4284eb43d6af service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:02.318711 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-9f8b996e-7b5d-430e-ae23-7727e72056cf req-d9100a72-db80-4c7a-a8e5-4284eb43d6af service nova] Creating event network-changed:e5a9751a-054f-4649-be5b-0a1cbf094c02 for instance 87fe386a-f98b-46b8-86f2-993e25292785 on nch2-master-1 Oct 22 20:53:02.326509 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-83bf2945-28b3-4b29-a22d-5be39d82d15b tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] 10.222.0.18 "GET /compute/v2.1/servers/c190c6e5-8b3b-4946-bb18-01fa5aba6fd2" status: 200 len: 1474 microversion: 2.1 time: 0.616979 Oct 22 20:53:02.330353 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-9f8b996e-7b5d-430e-ae23-7727e72056cf req-d9100a72-db80-4c7a-a8e5-4284eb43d6af service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068559 Oct 22 20:53:02.330875 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 514/1085] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:53:01 2022] GET /compute/v2.1/servers/c190c6e5-8b3b-4946-bb18-01fa5aba6fd2 => generated 1474 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 20:53:02.337586 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 572/1086] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:53:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:53:02.625541 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-c5feac67-a730-4df8-8a9e-ec1c932a3567 tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:53:02.626871 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-c5feac67-a730-4df8-8a9e-ec1c932a3567 tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] [instance: 472bbccc-485e-43ce-a9cd-a3148bfccdbd] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:53:02.636343 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c5feac67-a730-4df8-8a9e-ec1c932a3567 tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:02.637191 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c5feac67-a730-4df8-8a9e-ec1c932a3567 tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:02.637846 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c5feac67-a730-4df8-8a9e-ec1c932a3567 tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:02.638917 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c5feac67-a730-4df8-8a9e-ec1c932a3567 tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:02.639696 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c5feac67-a730-4df8-8a9e-ec1c932a3567 tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:02.645263 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c5feac67-a730-4df8-8a9e-ec1c932a3567 tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:02.822161 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-a41f62e0-957f-40d7-b723-3e126c574e7c tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:53:02.824675 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-a41f62e0-957f-40d7-b723-3e126c574e7c tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] [instance: 87fe386a-f98b-46b8-86f2-993e25292785] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:53:02.867412 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a41f62e0-957f-40d7-b723-3e126c574e7c tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:02.868606 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a41f62e0-957f-40d7-b723-3e126c574e7c tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:02.872320 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a41f62e0-957f-40d7-b723-3e126c574e7c tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:02.875971 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a41f62e0-957f-40d7-b723-3e126c574e7c tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:02.877349 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a41f62e0-957f-40d7-b723-3e126c574e7c tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:02.878632 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a41f62e0-957f-40d7-b723-3e126c574e7c tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:03.796536 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-c5feac67-a730-4df8-8a9e-ec1c932a3567 tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01ba79ccd0d940a2899a035635862219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0400ae826f8e4bd8a2e4c981880a59c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:53:03.808509 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-c5feac67-a730-4df8-8a9e-ec1c932a3567 tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] 10.222.0.18 "GET /compute/v2.1/servers/472bbccc-485e-43ce-a9cd-a3148bfccdbd" status: 200 len: 1316 microversion: 2.1 time: 1.187260 Oct 22 20:53:03.809804 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 515/1087] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:53:02 2022] GET /compute/v2.1/servers/472bbccc-485e-43ce-a9cd-a3148bfccdbd => generated 1316 bytes in 1189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:53:03.830133 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-e2e407da-2e95-42d1-927b-7a3686e1e24a tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:53:03.831330 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-e2e407da-2e95-42d1-927b-7a3686e1e24a tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] [instance: c190c6e5-8b3b-4946-bb18-01fa5aba6fd2] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:53:03.840734 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-a41f62e0-957f-40d7-b723-3e126c574e7c tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34f8af8ee2b545bead90fffd6c6c4896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48413ed1ac4e1ea65fb38f097881db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:53:03.843252 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e2e407da-2e95-42d1-927b-7a3686e1e24a tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:03.843973 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e2e407da-2e95-42d1-927b-7a3686e1e24a tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:03.844643 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e2e407da-2e95-42d1-927b-7a3686e1e24a tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:03.845702 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e2e407da-2e95-42d1-927b-7a3686e1e24a tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:03.846644 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e2e407da-2e95-42d1-927b-7a3686e1e24a tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:03.847328 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e2e407da-2e95-42d1-927b-7a3686e1e24a tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:03.852292 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-a41f62e0-957f-40d7-b723-3e126c574e7c tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] 10.222.0.18 "GET /compute/v2.1/servers/87fe386a-f98b-46b8-86f2-993e25292785" status: 200 len: 1317 microversion: 2.1 time: 1.038098 Oct 22 20:53:03.852888 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 573/1088] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:53:02 2022] GET /compute/v2.1/servers/87fe386a-f98b-46b8-86f2-993e25292785 => generated 1317 bytes in 1040 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:53:03.864934 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=97,nova_cell1:UPDATE=1 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:53:03.867183 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-e2e407da-2e95-42d1-927b-7a3686e1e24a tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] HTTP exception thrown: Instance c190c6e5-8b3b-4946-bb18-01fa5aba6fd2 could not be found. Oct 22 20:53:03.869481 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-e2e407da-2e95-42d1-927b-7a3686e1e24a tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Request method failure captured: Oct 22 20:53:03.869481 ncdv-master-1 devstack@n-api.service[138744]: request: GET /compute/v2.1/servers/c190c6e5-8b3b-4946-bb18-01fa5aba6fd2 HTTP/1.1 Oct 22 20:53:03.869481 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 20:53:03.869481 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 20:53:03.869481 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 20:53:03.869481 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 0 Oct 22 20:53:03.869481 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 20:53:03.869481 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 20:53:03.869481 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 20:53:03.869481 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 20:53:03.869481 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVFeL5NpvaUPvqiDt8qD72HqMh0DrXz0UtoQAeO42jMFpMPYqVC0YFDMA438gQzhAHNDHcP5InOc3xi8IB_k6cXq3If0lWEwoKo4DiRlB10MzTtg6EzpKpbfTqN9Yi6nvd2u_6U9lIt3lLKhkPDkM5OdhEDFJSGZOTF7Z9mtdL7wRjmc Oct 22 20:53:03.869481 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 20:53:03.869481 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 20:53:03.869481 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 20:53:03.869481 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 20:53:03.869481 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 20:53:03.869481 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 20:53:03.869481 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: 902e239d67664098895ab24340b0b780 Oct 22 20:53:03.869481 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-ServersOnMultiNodesTest-2081149331 Oct 22 20:53:03.869481 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 20:53:03.869481 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 20:53:03.869481 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_902e239d67664098895ab24340b0b780"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/902e239d67664098895ab24340b0b780"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/902e239d67664098895ab24340b0b780"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/902e239d67664098895ab24340b0b780"}]}] Oct 22 20:53:03.869481 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-ServersOnMultiNodesTest-2081149331 Oct 22 20:53:03.869481 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: 902e239d67664098895ab24340b0b780 Oct 22 20:53:03.869481 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-2081149331 Oct 22 20:53:03.869481 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-ServersOnMultiNodesTest-2081149331-project Oct 22 20:53:03.869481 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 20:53:03.869481 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 20:53:03.869481 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: 91cf84a287b74618ae1b3368785b0b4c Oct 22 20:53:03.869481 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-ServersOnMultiNodesTest-2081149331-project Oct 22 20:53:03.869481 ncdv-master-1 devstack@n-api.service[138744]: method: > Oct 22 20:53:03.869481 ncdv-master-1 devstack@n-api.service[138744]: exception: Instance c190c6e5-8b3b-4946-bb18-01fa5aba6fd2 could not be found. Oct 22 20:53:03.869481 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': 'c190c6e5-8b3b-4946-bb18-01fa5aba6fd2'} Oct 22 20:53:03.869481 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:53:03.869481 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:53:03.869481 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 20:53:03.869481 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 20:53:03.869481 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 20:53:03.869481 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 20:53:03.869481 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 20:53:03.869481 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 20:53:03.869481 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 20:53:03.869481 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 20:53:03.869481 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c190c6e5-8b3b-4946-bb18-01fa5aba6fd2 could not be found. Oct 22 20:53:03.869481 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:53:03.869481 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:53:03.869481 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:53:03.869481 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:53:03.869481 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:53:03.869481 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:53:03.869481 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:53:03.869481 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:53:03.869481 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:53:03.869481 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:53:03.869481 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 20:53:03.869481 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 20:53:03.869481 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 20:53:03.869481 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 20:53:03.869481 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 20:53:03.869481 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 20:53:03.869481 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c190c6e5-8b3b-4946-bb18-01fa5aba6fd2 could not be found. Oct 22 20:53:03.869481 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:53:03.869481 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:53:03.869481 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:53:03.873465 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:53:03.873465 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:53:03.873465 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:53:03.873465 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 20:53:03.873465 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 20:53:03.873465 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c190c6e5-8b3b-4946-bb18-01fa5aba6fd2 could not be found. Oct 22 20:53:03.873465 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:53:03.879719 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-e2e407da-2e95-42d1-927b-7a3686e1e24a tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Returning 404 to user: Instance c190c6e5-8b3b-4946-bb18-01fa5aba6fd2 could not be found. {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:53:03.880765 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-e2e407da-2e95-42d1-927b-7a3686e1e24a tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] 10.222.0.18 "GET /compute/v2.1/servers/c190c6e5-8b3b-4946-bb18-01fa5aba6fd2" status: 404 len: 111 microversion: 2.1 time: 0.069560 Oct 22 20:53:03.881482 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 516/1089] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:53:03 2022] GET /compute/v2.1/servers/c190c6e5-8b3b-4946-bb18-01fa5aba6fd2 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 20:53:03.889864 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-4515726d-2de5-4c49-ba1d-91df006d2b8f tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:53:03.926990 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-4515726d-2de5-4c49-ba1d-91df006d2b8f tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] 10.222.0.18 "DELETE /compute/v2.1/os-server-groups/c805829d-9330-44c4-abe6-ffa468507877" status: 204 len: 0 microversion: 2.1 time: 0.040779 Oct 22 20:53:03.927821 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 574/1090] 10.222.0.18 () {58 vars in 1266 bytes} [Sat Oct 22 20:53:03 2022] DELETE /compute/v2.1/os-server-groups/c805829d-9330-44c4-abe6-ffa468507877 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 22 20:53:03.937258 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-735b5754-cc6c-4145-a12a-14395a2c9f91 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:53:03.937258 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-735b5754-cc6c-4145-a12a-14395a2c9f91 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] [instance: d992dc02-b690-452b-aaf2-1473b69a75cb] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:53:03.943939 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-735b5754-cc6c-4145-a12a-14395a2c9f91 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:03.944537 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-735b5754-cc6c-4145-a12a-14395a2c9f91 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:03.944981 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-735b5754-cc6c-4145-a12a-14395a2c9f91 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:03.945702 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-735b5754-cc6c-4145-a12a-14395a2c9f91 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:03.946152 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-735b5754-cc6c-4145-a12a-14395a2c9f91 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:03.946763 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-735b5754-cc6c-4145-a12a-14395a2c9f91 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:03.975609 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-735b5754-cc6c-4145-a12a-14395a2c9f91 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] [instance: d992dc02-b690-452b-aaf2-1473b69a75cb] Going to try to terminate instance {{(pid=138744) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 20:53:04.103494 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-735b5754-cc6c-4145-a12a-14395a2c9f91 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] 10.222.0.18 "DELETE /compute/v2.1/servers/d992dc02-b690-452b-aaf2-1473b69a75cb" status: 204 len: 0 microversion: 2.1 time: 0.170951 Oct 22 20:53:04.105841 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 517/1091] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 20:53:03 2022] DELETE /compute/v2.1/servers/d992dc02-b690-452b-aaf2-1473b69a75cb => generated 0 bytes in 174 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 20:53:04.113511 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-8cd45db0-0c21-4f33-b170-303b943d2059 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:53:04.114086 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-8cd45db0-0c21-4f33-b170-303b943d2059 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] [instance: 0923f68f-d334-4133-824a-7830b65acc28] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:53:04.126966 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8cd45db0-0c21-4f33-b170-303b943d2059 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:04.127539 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8cd45db0-0c21-4f33-b170-303b943d2059 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:04.128004 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8cd45db0-0c21-4f33-b170-303b943d2059 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:04.128639 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8cd45db0-0c21-4f33-b170-303b943d2059 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:04.129074 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8cd45db0-0c21-4f33-b170-303b943d2059 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:04.129508 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8cd45db0-0c21-4f33-b170-303b943d2059 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:04.185293 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-8cd45db0-0c21-4f33-b170-303b943d2059 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] [instance: 0923f68f-d334-4133-824a-7830b65acc28] Going to try to terminate instance {{(pid=138745) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 20:53:04.297682 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-8cd45db0-0c21-4f33-b170-303b943d2059 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] 10.222.0.18 "DELETE /compute/v2.1/servers/0923f68f-d334-4133-824a-7830b65acc28" status: 204 len: 0 microversion: 2.1 time: 0.187988 Oct 22 20:53:04.298284 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 575/1092] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 20:53:04 2022] DELETE /compute/v2.1/servers/0923f68f-d334-4133-824a-7830b65acc28 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 20:53:04.309766 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-0aac84dd-70b5-4c5c-8014-c81368d63e87 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:53:04.311084 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-0aac84dd-70b5-4c5c-8014-c81368d63e87 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] [instance: d992dc02-b690-452b-aaf2-1473b69a75cb] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:53:04.326312 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0aac84dd-70b5-4c5c-8014-c81368d63e87 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:04.327272 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0aac84dd-70b5-4c5c-8014-c81368d63e87 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:04.327959 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0aac84dd-70b5-4c5c-8014-c81368d63e87 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:04.328811 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0aac84dd-70b5-4c5c-8014-c81368d63e87 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:04.329484 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-2fd023d8-9a21-482f-948c-463bdb0e36db tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:53:04.331359 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0aac84dd-70b5-4c5c-8014-c81368d63e87 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:04.331909 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0aac84dd-70b5-4c5c-8014-c81368d63e87 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:04.332226 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-2fd023d8-9a21-482f-948c-463bdb0e36db tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] [instance: 4c7b99a9-2ec4-4f4b-98e7-8e1ea2103735] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:53:04.341275 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2fd023d8-9a21-482f-948c-463bdb0e36db tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:04.341906 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2fd023d8-9a21-482f-948c-463bdb0e36db tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:04.342339 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2fd023d8-9a21-482f-948c-463bdb0e36db tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:04.343036 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2fd023d8-9a21-482f-948c-463bdb0e36db tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:04.343699 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2fd023d8-9a21-482f-948c-463bdb0e36db tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:04.344681 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2fd023d8-9a21-482f-948c-463bdb0e36db tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:04.752782 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.objects.instance [None req-2fd023d8-9a21-482f-948c-463bdb0e36db tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] Lazy-loading 'services' on Instance uuid 4c7b99a9-2ec4-4f4b-98e7-8e1ea2103735 {{(pid=138745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 20:53:04.779899 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-2fd023d8-9a21-482f-948c-463bdb0e36db tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/4c7b99a9-2ec4-4f4b-98e7-8e1ea2103735" status: 200 len: 2342 microversion: 2.25 time: 0.465250 Oct 22 20:53:04.782614 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 576/1093] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 20:53:04 2022] GET /compute/v2.1/servers/4c7b99a9-2ec4-4f4b-98e7-8e1ea2103735 => generated 2342 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 22 20:53:04.794467 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-bcf0e500-5dd3-4f25-86c2-d0aab7e7d92d req-da47347c-0772-483b-b0af-fa2e3225d720 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c190c6e5-8b3b-4946-bb18-01fa5aba6fd2", "name": "network-vif-deleted", "tag": "03a35398-bc84-47a3-a7d7-714c7d535cfa"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:53:04.816207 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-bcf0e500-5dd3-4f25-86c2-d0aab7e7d92d req-da47347c-0772-483b-b0af-fa2e3225d720 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:04.816836 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-bcf0e500-5dd3-4f25-86c2-d0aab7e7d92d req-da47347c-0772-483b-b0af-fa2e3225d720 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:04.818448 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-bcf0e500-5dd3-4f25-86c2-d0aab7e7d92d req-da47347c-0772-483b-b0af-fa2e3225d720 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:04.843365 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-bcf0e500-5dd3-4f25-86c2-d0aab7e7d92d req-da47347c-0772-483b-b0af-fa2e3225d720 service nova] Creating event network-vif-deleted:03a35398-bc84-47a3-a7d7-714c7d535cfa for instance c190c6e5-8b3b-4946-bb18-01fa5aba6fd2 on nch1-master-1 Oct 22 20:53:04.848966 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-bcf0e500-5dd3-4f25-86c2-d0aab7e7d92d req-da47347c-0772-483b-b0af-fa2e3225d720 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064876 Oct 22 20:53:04.853101 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 577/1094] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:53:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:53:04.857971 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-0aac84dd-70b5-4c5c-8014-c81368d63e87 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91cf84a287b74618ae1b3368785b0b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902e239d67664098895ab24340b0b780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:53:04.865176 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-cbb150b3-e37d-40ea-a6db-2127095acc29 req-974c0d33-5e80-4011-9cf6-161a773985a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "472bbccc-485e-43ce-a9cd-a3148bfccdbd", "name": "network-vif-plugged", "status": "completed", "tag": "23775c97-962a-4643-9a82-cfb4b15013e8"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:53:04.875850 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-0aac84dd-70b5-4c5c-8014-c81368d63e87 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] 10.222.0.18 "GET /compute/v2.1/servers/d992dc02-b690-452b-aaf2-1473b69a75cb" status: 200 len: 1473 microversion: 2.1 time: 0.569781 Oct 22 20:53:04.877570 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 518/1095] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:53:04 2022] GET /compute/v2.1/servers/d992dc02-b690-452b-aaf2-1473b69a75cb => generated 1473 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:53:04.893251 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-bf298f5d-f0c3-4708-8a2e-f9f760f1e69d tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:53:04.900025 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bf298f5d-f0c3-4708-8a2e-f9f760f1e69d tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:04.900506 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-cbb150b3-e37d-40ea-a6db-2127095acc29 req-974c0d33-5e80-4011-9cf6-161a773985a0 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:04.900636 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bf298f5d-f0c3-4708-8a2e-f9f760f1e69d tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:04.900998 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-cbb150b3-e37d-40ea-a6db-2127095acc29 req-974c0d33-5e80-4011-9cf6-161a773985a0 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:04.901137 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bf298f5d-f0c3-4708-8a2e-f9f760f1e69d tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:04.904032 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bf298f5d-f0c3-4708-8a2e-f9f760f1e69d tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:04.904774 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bf298f5d-f0c3-4708-8a2e-f9f760f1e69d tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:04.905459 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bf298f5d-f0c3-4708-8a2e-f9f760f1e69d tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:04.907116 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-cbb150b3-e37d-40ea-a6db-2127095acc29 req-974c0d33-5e80-4011-9cf6-161a773985a0 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:04.923683 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-cbb150b3-e37d-40ea-a6db-2127095acc29 req-974c0d33-5e80-4011-9cf6-161a773985a0 service nova] Creating event network-vif-plugged:23775c97-962a-4643-9a82-cfb4b15013e8 for instance 472bbccc-485e-43ce-a9cd-a3148bfccdbd on nch1-master-1 Oct 22 20:53:04.930040 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-cbb150b3-e37d-40ea-a6db-2127095acc29 req-974c0d33-5e80-4011-9cf6-161a773985a0 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074825 Oct 22 20:53:04.931251 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 578/1096] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:53:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:53:04.938178 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-358b86f0-42ce-408c-bd5f-768f4b217045 tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:53:04.939711 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-358b86f0-42ce-408c-bd5f-768f4b217045 tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] [instance: 472bbccc-485e-43ce-a9cd-a3148bfccdbd] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:53:04.942422 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-bf298f5d-f0c3-4708-8a2e-f9f760f1e69d tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] 10.222.0.18 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.063519 Oct 22 20:53:04.943939 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 519/1097] 10.222.0.18 () {60 vars in 1217 bytes} [Sat Oct 22 20:53:04 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 22 20:53:04.947692 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-358b86f0-42ce-408c-bd5f-768f4b217045 tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:04.948355 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-358b86f0-42ce-408c-bd5f-768f4b217045 tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:04.949007 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-358b86f0-42ce-408c-bd5f-768f4b217045 tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:04.950326 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-358b86f0-42ce-408c-bd5f-768f4b217045 tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:04.951391 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-358b86f0-42ce-408c-bd5f-768f4b217045 tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:04.952184 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-358b86f0-42ce-408c-bd5f-768f4b217045 tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:04.955085 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-87121c6d-72b6-4d2f-9bdf-36f5968b3cb6 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:53:04.957208 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-87121c6d-72b6-4d2f-9bdf-36f5968b3cb6 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] [instance: 87fe386a-f98b-46b8-86f2-993e25292785] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:53:04.970890 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-87121c6d-72b6-4d2f-9bdf-36f5968b3cb6 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:04.974059 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-87121c6d-72b6-4d2f-9bdf-36f5968b3cb6 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:04.975875 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-87121c6d-72b6-4d2f-9bdf-36f5968b3cb6 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:04.978609 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-87121c6d-72b6-4d2f-9bdf-36f5968b3cb6 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:04.982038 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-87121c6d-72b6-4d2f-9bdf-36f5968b3cb6 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:04.982836 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-87121c6d-72b6-4d2f-9bdf-36f5968b3cb6 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:05.026749 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell0:SELECT=11 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:53:05.200628 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell0:SELECT=4 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:53:05.387989 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-358b86f0-42ce-408c-bd5f-768f4b217045 tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01ba79ccd0d940a2899a035635862219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0400ae826f8e4bd8a2e4c981880a59c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:53:05.426564 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-358b86f0-42ce-408c-bd5f-768f4b217045 tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] 10.222.0.18 "GET /compute/v2.1/servers/472bbccc-485e-43ce-a9cd-a3148bfccdbd" status: 200 len: 1316 microversion: 2.1 time: 0.479993 Oct 22 20:53:05.426564 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 579/1098] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:53:04 2022] GET /compute/v2.1/servers/472bbccc-485e-43ce-a9cd-a3148bfccdbd => generated 1316 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:53:05.498100 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-87121c6d-72b6-4d2f-9bdf-36f5968b3cb6 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34f8af8ee2b545bead90fffd6c6c4896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48413ed1ac4e1ea65fb38f097881db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:53:05.517990 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-87121c6d-72b6-4d2f-9bdf-36f5968b3cb6 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] 10.222.0.18 "GET /compute/v2.1/servers/87fe386a-f98b-46b8-86f2-993e25292785" status: 200 len: 1317 microversion: 2.1 time: 0.571606 Oct 22 20:53:05.521636 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 520/1099] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:53:04 2022] GET /compute/v2.1/servers/87fe386a-f98b-46b8-86f2-993e25292785 => generated 1317 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:53:05.697910 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-a4977631-f167-4f5d-a1c5-f9e2286b944b tempest-KeyPairsV2TestJSON-698180069 tempest-KeyPairsV2TestJSON-698180069-project] Action: 'create', calling method: .version_select at 0x7fd3a4138790>, body: {"keypair": {"name": "tempest-keypair-732239347", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGIWSDDKrU1bTEJGb7Knl7l1BaJmcDnIcNt7xbJdThtI2fqwr+yxDB4e7m6VlhJixL7+P+ep5Grc06c0ypOm9PHUTvqguEHwam9TAkcP2E9iOJMRo3URkZdgRorB5ugpVA=="}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:53:05.719116 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-a4977631-f167-4f5d-a1c5-f9e2286b944b tempest-KeyPairsV2TestJSON-698180069 tempest-KeyPairsV2TestJSON-698180069-project] Getting quotas for project e0527ceb1e844d07b5d7bd968f5c5565. Resources: {'key_pairs'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 20:53:05.727424 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-a4977631-f167-4f5d-a1c5-f9e2286b944b tempest-KeyPairsV2TestJSON-698180069 tempest-KeyPairsV2TestJSON-698180069-project] Getting quotas for user 8a6b455fcc744f38adf1095d6a58630c and project e0527ceb1e844d07b5d7bd968f5c5565. Resources: {'key_pairs'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 20:53:05.755598 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-a4977631-f167-4f5d-a1c5-f9e2286b944b tempest-KeyPairsV2TestJSON-698180069 tempest-KeyPairsV2TestJSON-698180069-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.211259 Oct 22 20:53:05.756883 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 580/1100] 10.222.0.18 () {60 vars in 1159 bytes} [Sat Oct 22 20:53:05 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:53:05.767585 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-860c2433-97de-46ed-b62d-add4dc979d60 tempest-KeyPairsV2TestJSON-698180069 tempest-KeyPairsV2TestJSON-698180069-project] Calling method '.version_select at 0x7fd39fe963a0>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:53:05.777284 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-860c2433-97de-46ed-b62d-add4dc979d60 tempest-KeyPairsV2TestJSON-698180069 tempest-KeyPairsV2TestJSON-698180069-project] 10.222.0.18 "GET /compute/v2.1/os-keypairs/tempest-keypair-732239347" status: 200 len: 497 microversion: 2.1 time: 0.013629 Oct 22 20:53:05.777846 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 521/1101] 10.222.0.18 () {58 vars in 1215 bytes} [Sat Oct 22 20:53:05 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-732239347 => generated 497 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:53:05.791553 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-d1bade13-2b5f-49df-8695-887e6cf3f765 tempest-KeyPairsV2TestJSON-698180069 tempest-KeyPairsV2TestJSON-698180069-project] Calling method '.version_select at 0x7fd3a40681f0>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:53:05.816487 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-d1bade13-2b5f-49df-8695-887e6cf3f765 tempest-KeyPairsV2TestJSON-698180069 tempest-KeyPairsV2TestJSON-698180069-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-732239347" status: 202 len: 0 microversion: 2.1 time: 0.028847 Oct 22 20:53:05.817565 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 581/1102] 10.222.0.18 () {58 vars in 1218 bytes} [Sat Oct 22 20:53:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-732239347 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 20:53:05.830189 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-ad3f9c2f-ca08-4ff8-b191-115d76ed7bab tempest-KeyPairsV2TestJSON-698180069 tempest-KeyPairsV2TestJSON-698180069-project] Action: 'create', calling method: .version_select at 0x7fd3a415dca0>, body: {"keypair": {"name": "tempest-keypair-552236753", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAhGX9q/RAiZ9Bb7Yn7mSYaaWWnhOBSDHgcRQpCKotfWsz2zeKI5+Z4A0dZsBColHuj5gv5jvhNFuE/cg+iauOw9GXgfZbE4Q5MbW1dJEMVOSyJhYRxzzwrnI0Pdjkzokw=="}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:53:05.848666 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-ad3f9c2f-ca08-4ff8-b191-115d76ed7bab tempest-KeyPairsV2TestJSON-698180069 tempest-KeyPairsV2TestJSON-698180069-project] Getting quotas for project e0527ceb1e844d07b5d7bd968f5c5565. Resources: {'key_pairs'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 20:53:05.858735 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-ad3f9c2f-ca08-4ff8-b191-115d76ed7bab tempest-KeyPairsV2TestJSON-698180069 tempest-KeyPairsV2TestJSON-698180069-project] Getting quotas for user 8a6b455fcc744f38adf1095d6a58630c and project e0527ceb1e844d07b5d7bd968f5c5565. Resources: {'key_pairs'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 20:53:05.885108 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-ad3f9c2f-ca08-4ff8-b191-115d76ed7bab tempest-KeyPairsV2TestJSON-698180069 tempest-KeyPairsV2TestJSON-698180069-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.059371 Oct 22 20:53:05.885716 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 522/1103] 10.222.0.18 () {60 vars in 1159 bytes} [Sat Oct 22 20:53:05 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:53:05.896697 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-439d011f-681c-41f5-abd9-2e5381794f43 tempest-KeyPairsV2TestJSON-698180069 tempest-KeyPairsV2TestJSON-698180069-project] Calling method '.version_select at 0x7fd3a4068940>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:53:05.902145 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-4b524f56-9aa7-4ec3-b8b9-5b8d163e337e tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:53:05.902767 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-4b524f56-9aa7-4ec3-b8b9-5b8d163e337e tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] [instance: d992dc02-b690-452b-aaf2-1473b69a75cb] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:53:05.909585 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4b524f56-9aa7-4ec3-b8b9-5b8d163e337e tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:05.910221 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4b524f56-9aa7-4ec3-b8b9-5b8d163e337e tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:05.910670 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4b524f56-9aa7-4ec3-b8b9-5b8d163e337e tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:05.911412 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4b524f56-9aa7-4ec3-b8b9-5b8d163e337e tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:05.911873 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4b524f56-9aa7-4ec3-b8b9-5b8d163e337e tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:05.912304 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4b524f56-9aa7-4ec3-b8b9-5b8d163e337e tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:05.945458 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-439d011f-681c-41f5-abd9-2e5381794f43 tempest-KeyPairsV2TestJSON-698180069 tempest-KeyPairsV2TestJSON-698180069-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-552236753" status: 202 len: 0 microversion: 2.1 time: 0.052770 Oct 22 20:53:05.946434 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 582/1104] 10.222.0.18 () {58 vars in 1218 bytes} [Sat Oct 22 20:53:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-552236753 => generated 0 bytes in 54 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 22 20:53:05.957495 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-dd6888e0-0c84-4950-a77a-9312526107a4 tempest-KeyPairsV2TestJSON-698180069 tempest-KeyPairsV2TestJSON-698180069-project] Action: 'create', calling method: .version_select at 0x7fd3a42e5af0>, body: {"keypair": {"name": "tempest-keypair-92211560", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:53:05.978591 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-dd6888e0-0c84-4950-a77a-9312526107a4 tempest-KeyPairsV2TestJSON-698180069 tempest-KeyPairsV2TestJSON-698180069-project] Getting quotas for project e0527ceb1e844d07b5d7bd968f5c5565. Resources: {'key_pairs'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 20:53:05.989096 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-dd6888e0-0c84-4950-a77a-9312526107a4 tempest-KeyPairsV2TestJSON-698180069 tempest-KeyPairsV2TestJSON-698180069-project] Getting quotas for user 8a6b455fcc744f38adf1095d6a58630c and project e0527ceb1e844d07b5d7bd968f5c5565. Resources: {'key_pairs'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 20:53:06.039990 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-dd6888e0-0c84-4950-a77a-9312526107a4 tempest-KeyPairsV2TestJSON-698180069 tempest-KeyPairsV2TestJSON-698180069-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 572 microversion: 2.1 time: 0.087071 Oct 22 20:53:06.041594 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 583/1105] 10.222.0.18 () {60 vars in 1159 bytes} [Sat Oct 22 20:53:05 2022] POST /compute/v2.1/os-keypairs => generated 572 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:53:06.059939 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-c6598a70-108b-4001-a12c-cb7209ebea7c tempest-KeyPairsV2TestJSON-698180069 tempest-KeyPairsV2TestJSON-698180069-project] Calling method '.version_select at 0x7fd3a4093d30>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:53:06.084931 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-4b524f56-9aa7-4ec3-b8b9-5b8d163e337e tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91cf84a287b74618ae1b3368785b0b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902e239d67664098895ab24340b0b780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:53:06.086305 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-c6598a70-108b-4001-a12c-cb7209ebea7c tempest-KeyPairsV2TestJSON-698180069 tempest-KeyPairsV2TestJSON-698180069-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-92211560" status: 202 len: 0 microversion: 2.1 time: 0.038672 Oct 22 20:53:06.095732 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 584/1106] 10.222.0.18 () {58 vars in 1215 bytes} [Sat Oct 22 20:53:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-92211560 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 22 20:53:06.098949 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-4b524f56-9aa7-4ec3-b8b9-5b8d163e337e tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] 10.222.0.18 "GET /compute/v2.1/servers/d992dc02-b690-452b-aaf2-1473b69a75cb" status: 200 len: 1473 microversion: 2.1 time: 0.200408 Oct 22 20:53:06.099946 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 523/1107] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:53:05 2022] GET /compute/v2.1/servers/d992dc02-b690-452b-aaf2-1473b69a75cb => generated 1473 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 20:53:06.101982 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-993d18be-a9e0-491c-9993-bce59c92ccb1 tempest-KeyPairsV2TestJSON-698180069 tempest-KeyPairsV2TestJSON-698180069-project] Action: 'create', calling method: .version_select at 0x7fd3a40a8a60>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-978415621", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFG9UtzqK/gOaA0aw9Fcf7hx67oXsMkyj2FQ106umWcJeGHnrCsigqcErpHxUVKOaa0J/YYmRpc9znajUpuRadGfZXQSDxJQyiPGjX3KMzDrSUnJDgN9hhd8HYcl6TGq+Q=="}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:53:06.117852 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-993d18be-a9e0-491c-9993-bce59c92ccb1 tempest-KeyPairsV2TestJSON-698180069 tempest-KeyPairsV2TestJSON-698180069-project] Getting quotas for project e0527ceb1e844d07b5d7bd968f5c5565. Resources: {'key_pairs'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 20:53:06.123355 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-993d18be-a9e0-491c-9993-bce59c92ccb1 tempest-KeyPairsV2TestJSON-698180069 tempest-KeyPairsV2TestJSON-698180069-project] Getting quotas for user 8a6b455fcc744f38adf1095d6a58630c and project e0527ceb1e844d07b5d7bd968f5c5565. Resources: {'key_pairs'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 20:53:06.125804 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=2,nova_api:DELETE=6,nova_api:INSERT=2 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:53:06.378820 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-993d18be-a9e0-491c-9993-bce59c92ccb1 tempest-KeyPairsV2TestJSON-698180069 tempest-KeyPairsV2TestJSON-698180069-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.281563 Oct 22 20:53:06.388050 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 585/1108] 10.222.0.18 () {60 vars in 1159 bytes} [Sat Oct 22 20:53:06 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:53:06.394715 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-e353b0aa-125a-4a26-b24b-f4f4492e6458 tempest-KeyPairsV2TestJSON-698180069 tempest-KeyPairsV2TestJSON-698180069-project] Action: 'create', calling method: .version_select at 0x7fd3a41e3e50>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-323842231", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIbez0icW83BSwJWwyj+eDo+dXqfW8We38RsYBxc3lGGKJNE93TFs0r4cuIXVrUovdmWrTI+me9en80Wln/8oVu73w7wynkNf/tOC4BrONLryydGpe7Qw0/ao6MB+AavDw=="}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:53:06.421020 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-e353b0aa-125a-4a26-b24b-f4f4492e6458 tempest-KeyPairsV2TestJSON-698180069 tempest-KeyPairsV2TestJSON-698180069-project] Getting quotas for project e0527ceb1e844d07b5d7bd968f5c5565. Resources: {'key_pairs'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 20:53:06.446492 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-e91fc694-cee1-41d2-b351-aba3c9abe72b tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:53:06.447420 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-e91fc694-cee1-41d2-b351-aba3c9abe72b tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] [instance: 472bbccc-485e-43ce-a9cd-a3148bfccdbd] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:53:06.448240 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-e353b0aa-125a-4a26-b24b-f4f4492e6458 tempest-KeyPairsV2TestJSON-698180069 tempest-KeyPairsV2TestJSON-698180069-project] Getting quotas for user 8a6b455fcc744f38adf1095d6a58630c and project e0527ceb1e844d07b5d7bd968f5c5565. Resources: {'key_pairs'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 20:53:06.462746 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e91fc694-cee1-41d2-b351-aba3c9abe72b tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:06.463527 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e91fc694-cee1-41d2-b351-aba3c9abe72b tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:06.465264 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e91fc694-cee1-41d2-b351-aba3c9abe72b tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:06.467152 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e91fc694-cee1-41d2-b351-aba3c9abe72b tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:06.467942 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e91fc694-cee1-41d2-b351-aba3c9abe72b tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:06.468597 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e91fc694-cee1-41d2-b351-aba3c9abe72b tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:06.511726 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-e353b0aa-125a-4a26-b24b-f4f4492e6458 tempest-KeyPairsV2TestJSON-698180069 tempest-KeyPairsV2TestJSON-698180069-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.121836 Oct 22 20:53:06.527690 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 524/1109] 10.222.0.18 () {60 vars in 1159 bytes} [Sat Oct 22 20:53:06 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 20:53:06.534313 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-6c3bb0c6-ff5c-42eb-b4f2-44bc95f39162 tempest-KeyPairsV2TestJSON-698180069 tempest-KeyPairsV2TestJSON-698180069-project] Action: 'create', calling method: .version_select at 0x7fd39feb7ca0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-883290730", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHtt7V39dl0zgZQhSmzTCxARuhib3rUq7633z9cavo8NSPVsc178FWJ4DniLhjeVO+74N+E0CJhH0rwRacf9k76MiHUHxLQCQHc1RzWeIaOWDXrYkmMAMyeL5w7SUMDVaQ=="}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:53:06.558120 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-6c3bb0c6-ff5c-42eb-b4f2-44bc95f39162 tempest-KeyPairsV2TestJSON-698180069 tempest-KeyPairsV2TestJSON-698180069-project] Getting quotas for project e0527ceb1e844d07b5d7bd968f5c5565. Resources: {'key_pairs'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 20:53:06.592363 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-6c3bb0c6-ff5c-42eb-b4f2-44bc95f39162 tempest-KeyPairsV2TestJSON-698180069 tempest-KeyPairsV2TestJSON-698180069-project] Getting quotas for user 8a6b455fcc744f38adf1095d6a58630c and project e0527ceb1e844d07b5d7bd968f5c5565. Resources: {'key_pairs'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 20:53:06.637648 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-6c3bb0c6-ff5c-42eb-b4f2-44bc95f39162 tempest-KeyPairsV2TestJSON-698180069 tempest-KeyPairsV2TestJSON-698180069-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.107691 Oct 22 20:53:06.638371 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 525/1110] 10.222.0.18 () {60 vars in 1159 bytes} [Sat Oct 22 20:53:06 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:53:06.646243 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-f0dd357b-a1b5-4d2a-99f7-09d17cd2723a tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:53:06.647315 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-f0dd357b-a1b5-4d2a-99f7-09d17cd2723a tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] [instance: 87fe386a-f98b-46b8-86f2-993e25292785] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:53:06.656333 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f0dd357b-a1b5-4d2a-99f7-09d17cd2723a tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:06.657250 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f0dd357b-a1b5-4d2a-99f7-09d17cd2723a tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:06.658062 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f0dd357b-a1b5-4d2a-99f7-09d17cd2723a tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:06.659482 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f0dd357b-a1b5-4d2a-99f7-09d17cd2723a tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:06.660511 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f0dd357b-a1b5-4d2a-99f7-09d17cd2723a tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:06.661308 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f0dd357b-a1b5-4d2a-99f7-09d17cd2723a tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:06.709344 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-e91fc694-cee1-41d2-b351-aba3c9abe72b tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01ba79ccd0d940a2899a035635862219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0400ae826f8e4bd8a2e4c981880a59c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:53:06.725232 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-e91fc694-cee1-41d2-b351-aba3c9abe72b tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] 10.222.0.18 "GET /compute/v2.1/servers/472bbccc-485e-43ce-a9cd-a3148bfccdbd" status: 200 len: 1316 microversion: 2.1 time: 0.285053 Oct 22 20:53:06.747494 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 586/1111] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:53:06 2022] GET /compute/v2.1/servers/472bbccc-485e-43ce-a9cd-a3148bfccdbd => generated 1316 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:53:06.753644 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-90d98ce1-47a3-4c21-9987-61772dc3b558 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:53:06.754533 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-90d98ce1-47a3-4c21-9987-61772dc3b558 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] [instance: fa364234-023c-491a-bc88-97c048f6f0e2] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:53:06.762222 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-90d98ce1-47a3-4c21-9987-61772dc3b558 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:06.762823 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-90d98ce1-47a3-4c21-9987-61772dc3b558 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:06.763702 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-90d98ce1-47a3-4c21-9987-61772dc3b558 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:06.765573 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-90d98ce1-47a3-4c21-9987-61772dc3b558 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:06.766170 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-90d98ce1-47a3-4c21-9987-61772dc3b558 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:06.767163 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-90d98ce1-47a3-4c21-9987-61772dc3b558 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:06.821095 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-90d98ce1-47a3-4c21-9987-61772dc3b558 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] [instance: fa364234-023c-491a-bc88-97c048f6f0e2] Going to try to terminate instance {{(pid=138745) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 20:53:06.961973 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-90d98ce1-47a3-4c21-9987-61772dc3b558 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] 10.222.0.18 "DELETE /compute/v2.1/servers/fa364234-023c-491a-bc88-97c048f6f0e2" status: 204 len: 0 microversion: 2.1 time: 0.211478 Oct 22 20:53:06.964216 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 587/1112] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 20:53:06 2022] DELETE /compute/v2.1/servers/fa364234-023c-491a-bc88-97c048f6f0e2 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 20:53:07.007914 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-406d8ab5-bf5c-4190-a75a-3698c9af2692 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0b640f14-ba0f-4242-a080-e77941655d79", "device": "/dev/xvdb"}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:53:07.020571 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-406d8ab5-bf5c-4190-a75a-3698c9af2692 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] [instance: 4c7b99a9-2ec4-4f4b-98e7-8e1ea2103735] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:53:07.024842 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-f0dd357b-a1b5-4d2a-99f7-09d17cd2723a tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34f8af8ee2b545bead90fffd6c6c4896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48413ed1ac4e1ea65fb38f097881db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:53:07.038124 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-f0dd357b-a1b5-4d2a-99f7-09d17cd2723a tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] 10.222.0.18 "GET /compute/v2.1/servers/87fe386a-f98b-46b8-86f2-993e25292785" status: 200 len: 1317 microversion: 2.1 time: 0.398229 Oct 22 20:53:07.038666 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 526/1113] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:53:06 2022] GET /compute/v2.1/servers/87fe386a-f98b-46b8-86f2-993e25292785 => generated 1317 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:53:07.046791 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-406d8ab5-bf5c-4190-a75a-3698c9af2692 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:07.048883 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-c11168c4-7c95-424f-8f3b-7632976929d2 tempest-KeyPairsV2TestJSON-698180069 tempest-KeyPairsV2TestJSON-698180069-project] Calling method '.version_select at 0x7fd39fed6c10>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:53:07.050337 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-406d8ab5-bf5c-4190-a75a-3698c9af2692 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:07.050906 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-406d8ab5-bf5c-4190-a75a-3698c9af2692 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:07.055543 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-406d8ab5-bf5c-4190-a75a-3698c9af2692 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:07.057794 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-406d8ab5-bf5c-4190-a75a-3698c9af2692 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:07.060791 ncdv-master-1 devstack@n-api.service[138744]: WARNING oslo_db.sqlalchemy.utils [None req-c11168c4-7c95-424f-8f3b-7632976929d2 tempest-KeyPairsV2TestJSON-698180069 tempest-KeyPairsV2TestJSON-698180069-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 22 20:53:07.061088 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-406d8ab5-bf5c-4190-a75a-3698c9af2692 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:07.079553 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-c11168c4-7c95-424f-8f3b-7632976929d2 tempest-KeyPairsV2TestJSON-698180069 tempest-KeyPairsV2TestJSON-698180069-project] 10.222.0.18 "GET /compute/v2.1/os-keypairs" status: 200 len: 1091 microversion: 2.1 time: 0.039545 Oct 22 20:53:07.085628 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 527/1114] 10.222.0.18 () {58 vars in 1137 bytes} [Sat Oct 22 20:53:07 2022] GET /compute/v2.1/os-keypairs => generated 1091 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:53:07.094115 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-7996fe9d-925d-4dea-a0d5-fdf2583445b0 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:53:07.094914 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-7996fe9d-925d-4dea-a0d5-fdf2583445b0 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] [instance: fa364234-023c-491a-bc88-97c048f6f0e2] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:53:07.111062 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7996fe9d-925d-4dea-a0d5-fdf2583445b0 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:07.117490 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7996fe9d-925d-4dea-a0d5-fdf2583445b0 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:07.118346 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7996fe9d-925d-4dea-a0d5-fdf2583445b0 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:07.119268 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7996fe9d-925d-4dea-a0d5-fdf2583445b0 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:07.120071 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7996fe9d-925d-4dea-a0d5-fdf2583445b0 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:07.120702 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7996fe9d-925d-4dea-a0d5-fdf2583445b0 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:07.235606 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:53:07.530765 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-7996fe9d-925d-4dea-a0d5-fdf2583445b0 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9bba9ed37d7430e82e7d310982b8e47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30dbbdc150694e0ebc07c63e90280d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:53:07.545214 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-7996fe9d-925d-4dea-a0d5-fdf2583445b0 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] 10.222.0.18 "GET /compute/v2.1/servers/fa364234-023c-491a-bc88-97c048f6f0e2" status: 200 len: 1712 microversion: 2.1 time: 0.457863 Oct 22 20:53:07.548668 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 528/1115] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:53:07 2022] GET /compute/v2.1/servers/fa364234-023c-491a-bc88-97c048f6f0e2 => generated 1712 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:53:07.561452 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-73962b29-1204-46d4-af5d-46b6675533d3 tempest-KeyPairsV2TestJSON-698180069 tempest-KeyPairsV2TestJSON-698180069-project] Calling method '.version_select at 0x7fd39febb4c0>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:53:07.567329 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-406d8ab5-bf5c-4190-a75a-3698c9af2692 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] 10.222.0.18 "POST /compute/v2.1/servers/4c7b99a9-2ec4-4f4b-98e7-8e1ea2103735/os-volume_attachments" status: 200 len: 194 microversion: 2.25 time: 0.599290 Oct 22 20:53:07.568835 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 588/1116] 10.222.0.18 () {62 vars in 1364 bytes} [Sat Oct 22 20:53:06 2022] POST /compute/v2.1/servers/4c7b99a9-2ec4-4f4b-98e7-8e1ea2103735/os-volume_attachments => generated 194 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 22 20:53:07.604362 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-114f654f-f0e3-46e2-9bb9-e2d0bdc63b3d tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:53:07.609010 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-73962b29-1204-46d4-af5d-46b6675533d3 tempest-KeyPairsV2TestJSON-698180069 tempest-KeyPairsV2TestJSON-698180069-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-883290730" status: 202 len: 0 microversion: 2.1 time: 0.057642 Oct 22 20:53:07.609414 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-114f654f-f0e3-46e2-9bb9-e2d0bdc63b3d tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] [instance: d992dc02-b690-452b-aaf2-1473b69a75cb] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:53:07.609702 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 529/1117] 10.222.0.18 () {58 vars in 1275 bytes} [Sat Oct 22 20:53:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-883290730 => generated 0 bytes in 60 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 20:53:07.618671 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-52e0f09f-7e8c-47d9-a5d9-b338f18a01a8 tempest-KeyPairsV2TestJSON-698180069 tempest-KeyPairsV2TestJSON-698180069-project] Calling method '.version_select at 0x7fd39feb7a60>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:53:07.619890 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-114f654f-f0e3-46e2-9bb9-e2d0bdc63b3d tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:07.620920 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-114f654f-f0e3-46e2-9bb9-e2d0bdc63b3d tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:07.621542 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-114f654f-f0e3-46e2-9bb9-e2d0bdc63b3d tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:07.622762 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-114f654f-f0e3-46e2-9bb9-e2d0bdc63b3d tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:07.623408 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-114f654f-f0e3-46e2-9bb9-e2d0bdc63b3d tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:07.624133 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-114f654f-f0e3-46e2-9bb9-e2d0bdc63b3d tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:07.657384 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:53:07.690419 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-52e0f09f-7e8c-47d9-a5d9-b338f18a01a8 tempest-KeyPairsV2TestJSON-698180069 tempest-KeyPairsV2TestJSON-698180069-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-323842231" status: 202 len: 0 microversion: 2.1 time: 0.076121 Oct 22 20:53:07.694282 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 530/1118] 10.222.0.18 () {58 vars in 1275 bytes} [Sat Oct 22 20:53:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-323842231 => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 22 20:53:07.710604 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-e6a93461-0510-4232-a8c7-ffac7207c20e tempest-KeyPairsV2TestJSON-698180069 tempest-KeyPairsV2TestJSON-698180069-project] Calling method '.version_select at 0x7fd39ff8d280>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:53:07.777271 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-e6a93461-0510-4232-a8c7-ffac7207c20e tempest-KeyPairsV2TestJSON-698180069 tempest-KeyPairsV2TestJSON-698180069-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-978415621" status: 202 len: 0 microversion: 2.1 time: 0.080085 Oct 22 20:53:07.779532 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 531/1119] 10.222.0.18 () {58 vars in 1275 bytes} [Sat Oct 22 20:53:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-978415621 => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 20:53:07.790149 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-a6ccec59-da6b-4cb0-a4e3-cbe54b4fbf64 tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:53:07.791567 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-a6ccec59-da6b-4cb0-a4e3-cbe54b4fbf64 tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] [instance: 472bbccc-485e-43ce-a9cd-a3148bfccdbd] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:53:07.809357 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a6ccec59-da6b-4cb0-a4e3-cbe54b4fbf64 tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:07.809872 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a6ccec59-da6b-4cb0-a4e3-cbe54b4fbf64 tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:07.813522 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a6ccec59-da6b-4cb0-a4e3-cbe54b4fbf64 tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:07.814889 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a6ccec59-da6b-4cb0-a4e3-cbe54b4fbf64 tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:07.815880 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a6ccec59-da6b-4cb0-a4e3-cbe54b4fbf64 tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:07.816126 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a6ccec59-da6b-4cb0-a4e3-cbe54b4fbf64 tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:08.233158 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-a6ccec59-da6b-4cb0-a4e3-cbe54b4fbf64 tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01ba79ccd0d940a2899a035635862219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0400ae826f8e4bd8a2e4c981880a59c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:53:08.246787 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-a6ccec59-da6b-4cb0-a4e3-cbe54b4fbf64 tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] 10.222.0.18 "GET /compute/v2.1/servers/472bbccc-485e-43ce-a9cd-a3148bfccdbd" status: 200 len: 1465 microversion: 2.1 time: 0.462013 Oct 22 20:53:08.247996 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 532/1120] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:53:07 2022] GET /compute/v2.1/servers/472bbccc-485e-43ce-a9cd-a3148bfccdbd => generated 1465 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:53:08.265358 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-492c7478-9da0-4448-9628-734efad8ab30 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:53:08.266255 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-492c7478-9da0-4448-9628-734efad8ab30 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] [instance: 87fe386a-f98b-46b8-86f2-993e25292785] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:53:08.273841 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-492c7478-9da0-4448-9628-734efad8ab30 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:08.274718 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-492c7478-9da0-4448-9628-734efad8ab30 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:08.275432 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-492c7478-9da0-4448-9628-734efad8ab30 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:08.276977 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-492c7478-9da0-4448-9628-734efad8ab30 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:08.277652 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-492c7478-9da0-4448-9628-734efad8ab30 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:08.278285 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-492c7478-9da0-4448-9628-734efad8ab30 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:08.285790 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-114f654f-f0e3-46e2-9bb9-e2d0bdc63b3d tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91cf84a287b74618ae1b3368785b0b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902e239d67664098895ab24340b0b780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:53:08.315914 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-114f654f-f0e3-46e2-9bb9-e2d0bdc63b3d tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] 10.222.0.18 "GET /compute/v2.1/servers/d992dc02-b690-452b-aaf2-1473b69a75cb" status: 200 len: 1473 microversion: 2.1 time: 0.725159 Oct 22 20:53:08.328339 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 589/1121] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:53:07 2022] GET /compute/v2.1/servers/d992dc02-b690-452b-aaf2-1473b69a75cb => generated 1473 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:53:08.361881 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-cc237df8-c8a8-4042-8bbd-0005ba78ce71 req-eee7e2a4-db99-4e36-b9c2-035e284844c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d992dc02-b690-452b-aaf2-1473b69a75cb", "name": "network-vif-deleted", "tag": "dd91ec1a-3d89-46f1-b7e7-fe796a7b20b7"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:53:08.414172 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-cc237df8-c8a8-4042-8bbd-0005ba78ce71 req-eee7e2a4-db99-4e36-b9c2-035e284844c1 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:08.417221 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-cc237df8-c8a8-4042-8bbd-0005ba78ce71 req-eee7e2a4-db99-4e36-b9c2-035e284844c1 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:08.419437 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-cc237df8-c8a8-4042-8bbd-0005ba78ce71 req-eee7e2a4-db99-4e36-b9c2-035e284844c1 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:08.503944 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-cc237df8-c8a8-4042-8bbd-0005ba78ce71 req-eee7e2a4-db99-4e36-b9c2-035e284844c1 service nova] Creating event network-vif-deleted:dd91ec1a-3d89-46f1-b7e7-fe796a7b20b7 for instance d992dc02-b690-452b-aaf2-1473b69a75cb on nch2-master-1 Oct 22 20:53:08.520080 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-cc237df8-c8a8-4042-8bbd-0005ba78ce71 req-eee7e2a4-db99-4e36-b9c2-035e284844c1 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.195086 Oct 22 20:53:08.523011 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 590/1122] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:53:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:53:08.549811 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-36b63e73-bb26-49b7-8f97-099a765fa4cf tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-image-2013521241", "metadata": {"image_type": "test"}}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:53:08.560554 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-36b63e73-bb26-49b7-8f97-099a765fa4cf tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] [instance: 472bbccc-485e-43ce-a9cd-a3148bfccdbd] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:53:08.589007 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-36b63e73-bb26-49b7-8f97-099a765fa4cf tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:08.591071 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-36b63e73-bb26-49b7-8f97-099a765fa4cf tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:08.593456 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-36b63e73-bb26-49b7-8f97-099a765fa4cf tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:08.595714 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-36b63e73-bb26-49b7-8f97-099a765fa4cf tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:08.597923 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-36b63e73-bb26-49b7-8f97-099a765fa4cf tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:08.600860 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-36b63e73-bb26-49b7-8f97-099a765fa4cf tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:08.752712 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-36b63e73-bb26-49b7-8f97-099a765fa4cf tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Getting quotas for project 0400ae826f8e4bd8a2e4c981880a59c5. Resources: dict_keys(['metadata_items']) {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 20:53:08.771537 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-36b63e73-bb26-49b7-8f97-099a765fa4cf tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Getting quotas for user 01ba79ccd0d940a2899a035635862219 and project 0400ae826f8e4bd8a2e4c981880a59c5. Resources: dict_keys(['metadata_items']) {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 20:53:09.001498 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-492c7478-9da0-4448-9628-734efad8ab30 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34f8af8ee2b545bead90fffd6c6c4896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48413ed1ac4e1ea65fb38f097881db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:53:09.012658 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-492c7478-9da0-4448-9628-734efad8ab30 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] 10.222.0.18 "GET /compute/v2.1/servers/87fe386a-f98b-46b8-86f2-993e25292785" status: 200 len: 1317 microversion: 2.1 time: 0.763073 Oct 22 20:53:09.016761 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 533/1123] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:53:08 2022] GET /compute/v2.1/servers/87fe386a-f98b-46b8-86f2-993e25292785 => generated 1317 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:53:09.025721 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-54dfc5f3-511e-471e-b37d-8a8ce23dfd14 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-1016908474", "imageRef": "085e4478-6edc-4a69-8e08-f9831713eb65", "flavorRef": "452", "networks": [{"uuid": "2e6b4d41-7122-49d4-abf0-759d6341075e"}, {"uuid": "e1a3bb1f-e3d6-405c-ab91-09c07e83a0e4"}, {"uuid": "2e6b4d41-7122-49d4-abf0-759d6341075e"}]}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:53:09.136226 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.network.neutron [None req-54dfc5f3-511e-471e-b37d-8a8ce23dfd14 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] validate_networks() for [('2e6b4d41-7122-49d4-abf0-759d6341075e', None, None, None, None, None), ('e1a3bb1f-e3d6-405c-ab91-09c07e83a0e4', None, None, None, None, None), ('2e6b4d41-7122-49d4-abf0-759d6341075e', None, None, None, None, None)] {{(pid=138744) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 20:53:09.340373 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-36b63e73-bb26-49b7-8f97-099a765fa4cf tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] 10.222.0.18 "POST /compute/v2.1/servers/472bbccc-485e-43ce-a9cd-a3148bfccdbd/action" status: 202 len: 0 microversion: 2.1 time: 0.815416 Oct 22 20:53:09.351057 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 591/1124] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 20:53:08 2022] POST /compute/v2.1/servers/472bbccc-485e-43ce-a9cd-a3148bfccdbd/action => generated 0 bytes in 827 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 22 20:53:09.363678 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-a668d5b6-ec89-4552-9e2e-710e0d65483f tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:53:09.364432 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-a668d5b6-ec89-4552-9e2e-710e0d65483f tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] [instance: fa364234-023c-491a-bc88-97c048f6f0e2] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:53:09.380090 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a668d5b6-ec89-4552-9e2e-710e0d65483f tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:09.383537 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a668d5b6-ec89-4552-9e2e-710e0d65483f tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:09.384026 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a668d5b6-ec89-4552-9e2e-710e0d65483f tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:09.384776 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a668d5b6-ec89-4552-9e2e-710e0d65483f tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:09.385241 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a668d5b6-ec89-4552-9e2e-710e0d65483f tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:09.385672 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a668d5b6-ec89-4552-9e2e-710e0d65483f tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:10.028140 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-a668d5b6-ec89-4552-9e2e-710e0d65483f tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9bba9ed37d7430e82e7d310982b8e47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30dbbdc150694e0ebc07c63e90280d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:53:10.054689 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-a668d5b6-ec89-4552-9e2e-710e0d65483f tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] 10.222.0.18 "GET /compute/v2.1/servers/fa364234-023c-491a-bc88-97c048f6f0e2" status: 200 len: 1712 microversion: 2.1 time: 0.701697 Oct 22 20:53:10.057265 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 592/1125] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:53:09 2022] GET /compute/v2.1/servers/fa364234-023c-491a-bc88-97c048f6f0e2 => generated 1712 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:53:10.066100 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-0e7c8bdb-9683-44c9-8120-f116f7c5ec11 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:53:10.067140 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-0e7c8bdb-9683-44c9-8120-f116f7c5ec11 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] [instance: d992dc02-b690-452b-aaf2-1473b69a75cb] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:53:10.086940 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0e7c8bdb-9683-44c9-8120-f116f7c5ec11 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:10.087516 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0e7c8bdb-9683-44c9-8120-f116f7c5ec11 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:10.087999 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0e7c8bdb-9683-44c9-8120-f116f7c5ec11 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:10.094076 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0e7c8bdb-9683-44c9-8120-f116f7c5ec11 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:10.094657 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0e7c8bdb-9683-44c9-8120-f116f7c5ec11 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:10.097675 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0e7c8bdb-9683-44c9-8120-f116f7c5ec11 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:10.127669 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.wsgi [None req-0e7c8bdb-9683-44c9-8120-f116f7c5ec11 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] HTTP exception thrown: Instance d992dc02-b690-452b-aaf2-1473b69a75cb could not be found. Oct 22 20:53:10.129747 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-0e7c8bdb-9683-44c9-8120-f116f7c5ec11 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Request method failure captured: Oct 22 20:53:10.129747 ncdv-master-1 devstack@n-api.service[138745]: request: GET /compute/v2.1/servers/d992dc02-b690-452b-aaf2-1473b69a75cb HTTP/1.1 Oct 22 20:53:10.129747 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 20:53:10.129747 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 20:53:10.129747 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 20:53:10.129747 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 0 Oct 22 20:53:10.129747 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 20:53:10.129747 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 20:53:10.129747 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 20:53:10.129747 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 20:53:10.129747 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVFeL5NpvaUPvqiDt8qD72HqMh0DrXz0UtoQAeO42jMFpMPYqVC0YFDMA438gQzhAHNDHcP5InOc3xi8IB_k6cXq3If0lWEwoKo4DiRlB10MzTtg6EzpKpbfTqN9Yi6nvd2u_6U9lIt3lLKhkPDkM5OdhEDFJSGZOTF7Z9mtdL7wRjmc Oct 22 20:53:10.129747 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 20:53:10.129747 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 20:53:10.129747 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 20:53:10.129747 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 20:53:10.129747 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 20:53:10.129747 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 20:53:10.129747 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: 902e239d67664098895ab24340b0b780 Oct 22 20:53:10.129747 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-ServersOnMultiNodesTest-2081149331 Oct 22 20:53:10.129747 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 20:53:10.129747 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 20:53:10.129747 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_902e239d67664098895ab24340b0b780"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/902e239d67664098895ab24340b0b780"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/902e239d67664098895ab24340b0b780"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/902e239d67664098895ab24340b0b780"}]}] Oct 22 20:53:10.129747 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-ServersOnMultiNodesTest-2081149331 Oct 22 20:53:10.129747 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: 902e239d67664098895ab24340b0b780 Oct 22 20:53:10.129747 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-2081149331 Oct 22 20:53:10.129747 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-ServersOnMultiNodesTest-2081149331-project Oct 22 20:53:10.129747 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 20:53:10.129747 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 20:53:10.129747 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: 91cf84a287b74618ae1b3368785b0b4c Oct 22 20:53:10.129747 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-ServersOnMultiNodesTest-2081149331-project Oct 22 20:53:10.129747 ncdv-master-1 devstack@n-api.service[138745]: method: > Oct 22 20:53:10.129747 ncdv-master-1 devstack@n-api.service[138745]: exception: Instance d992dc02-b690-452b-aaf2-1473b69a75cb could not be found. Oct 22 20:53:10.129747 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'id': 'd992dc02-b690-452b-aaf2-1473b69a75cb'} Oct 22 20:53:10.129747 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:53:10.129747 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:53:10.129747 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 20:53:10.129747 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 20:53:10.129747 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 20:53:10.129747 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 20:53:10.129747 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 20:53:10.129747 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 20:53:10.129747 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 20:53:10.129747 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 20:53:10.129747 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d992dc02-b690-452b-aaf2-1473b69a75cb could not be found. Oct 22 20:53:10.129747 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:53:10.129747 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:53:10.129747 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:53:10.129747 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:53:10.129747 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:53:10.129747 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:53:10.129747 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:53:10.129747 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:53:10.129747 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:53:10.129747 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:53:10.129747 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 20:53:10.129747 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 20:53:10.129747 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 20:53:10.129747 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 20:53:10.129747 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 20:53:10.129747 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 20:53:10.129747 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d992dc02-b690-452b-aaf2-1473b69a75cb could not be found. Oct 22 20:53:10.129747 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:53:10.129747 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:53:10.129747 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:53:10.134724 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:53:10.134724 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:53:10.134724 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:53:10.134724 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 20:53:10.134724 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 20:53:10.134724 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d992dc02-b690-452b-aaf2-1473b69a75cb could not be found. Oct 22 20:53:10.134724 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:53:10.136422 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-0e7c8bdb-9683-44c9-8120-f116f7c5ec11 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Returning 404 to user: Instance d992dc02-b690-452b-aaf2-1473b69a75cb could not be found. {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:53:10.137478 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-0e7c8bdb-9683-44c9-8120-f116f7c5ec11 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] 10.222.0.18 "GET /compute/v2.1/servers/d992dc02-b690-452b-aaf2-1473b69a75cb" status: 404 len: 111 microversion: 2.1 time: 0.077832 Oct 22 20:53:10.138536 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 593/1126] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:53:10 2022] GET /compute/v2.1/servers/d992dc02-b690-452b-aaf2-1473b69a75cb => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 20:53:10.143916 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-d3b42346-93b7-427b-bf6e-44db942823a1 tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Calling method '.version_select at 0x7fd3a420f040>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:53:10.210767 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-d3b42346-93b7-427b-bf6e-44db942823a1 tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] 10.222.0.18 "GET /compute/v2.1/images/9585a413-1cc7-4173-a4e4-f771201c7779" status: 200 len: 1424 microversion: 2.1 time: 0.070848 Oct 22 20:53:10.221441 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 594/1127] 10.222.0.18 () {58 vars in 1233 bytes} [Sat Oct 22 20:53:10 2022] GET /compute/v2.1/images/9585a413-1cc7-4173-a4e4-f771201c7779 => generated 1424 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:53:10.240584 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-cc40403d-c7b7-44c9-9472-aea7ad776ec7 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:53:10.245716 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-cc40403d-c7b7-44c9-9472-aea7ad776ec7 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] [instance: 87fe386a-f98b-46b8-86f2-993e25292785] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:53:10.266645 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cc40403d-c7b7-44c9-9472-aea7ad776ec7 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:10.272794 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cc40403d-c7b7-44c9-9472-aea7ad776ec7 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:10.276493 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cc40403d-c7b7-44c9-9472-aea7ad776ec7 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:10.277392 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cc40403d-c7b7-44c9-9472-aea7ad776ec7 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:10.277979 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cc40403d-c7b7-44c9-9472-aea7ad776ec7 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:10.278689 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cc40403d-c7b7-44c9-9472-aea7ad776ec7 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:11.606139 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-cc40403d-c7b7-44c9-9472-aea7ad776ec7 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34f8af8ee2b545bead90fffd6c6c4896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48413ed1ac4e1ea65fb38f097881db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:53:11.621985 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-cc40403d-c7b7-44c9-9472-aea7ad776ec7 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] 10.222.0.18 "GET /compute/v2.1/servers/87fe386a-f98b-46b8-86f2-993e25292785" status: 200 len: 1317 microversion: 2.1 time: 1.398973 Oct 22 20:53:11.625988 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 595/1128] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:53:10 2022] GET /compute/v2.1/servers/87fe386a-f98b-46b8-86f2-993e25292785 => generated 1317 bytes in 1404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:53:11.636503 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-10f5ef92-49a4-48f0-a2cd-764f950e4dcf req-93733457-fc4c-457f-96f8-dda6e46a531d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0923f68f-d334-4133-824a-7830b65acc28", "name": "network-vif-deleted", "tag": "e2f995f5-84a0-4b55-bc6a-8c2cd4d30e99"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:53:11.654059 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-10f5ef92-49a4-48f0-a2cd-764f950e4dcf req-93733457-fc4c-457f-96f8-dda6e46a531d service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:11.655055 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-10f5ef92-49a4-48f0-a2cd-764f950e4dcf req-93733457-fc4c-457f-96f8-dda6e46a531d service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:11.655973 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-10f5ef92-49a4-48f0-a2cd-764f950e4dcf req-93733457-fc4c-457f-96f8-dda6e46a531d service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:11.670482 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-10f5ef92-49a4-48f0-a2cd-764f950e4dcf req-93733457-fc4c-457f-96f8-dda6e46a531d service nova] Creating event network-vif-deleted:e2f995f5-84a0-4b55-bc6a-8c2cd4d30e99 for instance 0923f68f-d334-4133-824a-7830b65acc28 on nch2-master-1 Oct 22 20:53:11.680767 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-10f5ef92-49a4-48f0-a2cd-764f950e4dcf req-93733457-fc4c-457f-96f8-dda6e46a531d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048791 Oct 22 20:53:11.681873 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 596/1129] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:53:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:53:11.693097 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-44c43e30-4acd-4aff-89c1-629bd0460d07 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:53:11.694558 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-44c43e30-4acd-4aff-89c1-629bd0460d07 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] [instance: 0923f68f-d334-4133-824a-7830b65acc28] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:53:11.702319 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-44c43e30-4acd-4aff-89c1-629bd0460d07 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:11.703238 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-44c43e30-4acd-4aff-89c1-629bd0460d07 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:11.703873 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-44c43e30-4acd-4aff-89c1-629bd0460d07 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:11.704785 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-44c43e30-4acd-4aff-89c1-629bd0460d07 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:11.705406 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-44c43e30-4acd-4aff-89c1-629bd0460d07 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:11.706014 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-44c43e30-4acd-4aff-89c1-629bd0460d07 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:11.723028 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.wsgi [None req-44c43e30-4acd-4aff-89c1-629bd0460d07 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] HTTP exception thrown: Instance 0923f68f-d334-4133-824a-7830b65acc28 could not be found. Oct 22 20:53:11.724891 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-44c43e30-4acd-4aff-89c1-629bd0460d07 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Request method failure captured: Oct 22 20:53:11.724891 ncdv-master-1 devstack@n-api.service[138745]: request: GET /compute/v2.1/servers/0923f68f-d334-4133-824a-7830b65acc28 HTTP/1.1 Oct 22 20:53:11.724891 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 20:53:11.724891 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 20:53:11.724891 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 20:53:11.724891 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 0 Oct 22 20:53:11.724891 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 20:53:11.724891 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 20:53:11.724891 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 20:53:11.724891 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 20:53:11.724891 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVFeL5NpvaUPvqiDt8qD72HqMh0DrXz0UtoQAeO42jMFpMPYqVC0YFDMA438gQzhAHNDHcP5InOc3xi8IB_k6cXq3If0lWEwoKo4DiRlB10MzTtg6EzpKpbfTqN9Yi6nvd2u_6U9lIt3lLKhkPDkM5OdhEDFJSGZOTF7Z9mtdL7wRjmc Oct 22 20:53:11.724891 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 20:53:11.724891 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 20:53:11.724891 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 20:53:11.724891 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 20:53:11.724891 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 20:53:11.724891 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 20:53:11.724891 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: 902e239d67664098895ab24340b0b780 Oct 22 20:53:11.724891 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-ServersOnMultiNodesTest-2081149331 Oct 22 20:53:11.724891 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 20:53:11.724891 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 20:53:11.724891 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_902e239d67664098895ab24340b0b780"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/902e239d67664098895ab24340b0b780"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/902e239d67664098895ab24340b0b780"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/902e239d67664098895ab24340b0b780"}]}] Oct 22 20:53:11.724891 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-ServersOnMultiNodesTest-2081149331 Oct 22 20:53:11.724891 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: 902e239d67664098895ab24340b0b780 Oct 22 20:53:11.724891 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-2081149331 Oct 22 20:53:11.724891 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-ServersOnMultiNodesTest-2081149331-project Oct 22 20:53:11.724891 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 20:53:11.724891 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 20:53:11.724891 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: 91cf84a287b74618ae1b3368785b0b4c Oct 22 20:53:11.724891 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-ServersOnMultiNodesTest-2081149331-project Oct 22 20:53:11.724891 ncdv-master-1 devstack@n-api.service[138745]: method: > Oct 22 20:53:11.724891 ncdv-master-1 devstack@n-api.service[138745]: exception: Instance 0923f68f-d334-4133-824a-7830b65acc28 could not be found. Oct 22 20:53:11.724891 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'id': '0923f68f-d334-4133-824a-7830b65acc28'} Oct 22 20:53:11.724891 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:53:11.724891 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:53:11.724891 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 20:53:11.724891 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 20:53:11.724891 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 20:53:11.724891 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 20:53:11.724891 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 20:53:11.724891 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 20:53:11.724891 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 20:53:11.724891 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 20:53:11.724891 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0923f68f-d334-4133-824a-7830b65acc28 could not be found. Oct 22 20:53:11.724891 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:53:11.724891 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:53:11.724891 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:53:11.724891 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:53:11.724891 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:53:11.724891 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:53:11.724891 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:53:11.724891 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:53:11.724891 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:53:11.724891 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:53:11.724891 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 20:53:11.724891 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 20:53:11.724891 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 20:53:11.724891 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 20:53:11.724891 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 20:53:11.724891 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 20:53:11.724891 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0923f68f-d334-4133-824a-7830b65acc28 could not be found. Oct 22 20:53:11.724891 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:53:11.724891 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:53:11.724891 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:53:11.729158 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:53:11.729158 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:53:11.729158 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:53:11.729158 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 20:53:11.729158 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 20:53:11.729158 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0923f68f-d334-4133-824a-7830b65acc28 could not be found. Oct 22 20:53:11.729158 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:53:11.729158 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-44c43e30-4acd-4aff-89c1-629bd0460d07 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Returning 404 to user: Instance 0923f68f-d334-4133-824a-7830b65acc28 could not be found. {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:53:11.729158 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-44c43e30-4acd-4aff-89c1-629bd0460d07 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] 10.222.0.18 "GET /compute/v2.1/servers/0923f68f-d334-4133-824a-7830b65acc28" status: 404 len: 111 microversion: 2.1 time: 0.041254 Oct 22 20:53:11.735453 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 597/1130] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:53:11 2022] GET /compute/v2.1/servers/0923f68f-d334-4133-824a-7830b65acc28 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 20:53:11.739246 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-8908c02f-85a2-4ff1-94e0-981d691f04f0 req-0a2dea88-d985-4316-b0be-8a5b3d14f555 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87fe386a-f98b-46b8-86f2-993e25292785", "name": "network-vif-plugged", "status": "completed", "tag": "e5a9751a-054f-4649-be5b-0a1cbf094c02"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:53:11.751717 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-8908c02f-85a2-4ff1-94e0-981d691f04f0 req-0a2dea88-d985-4316-b0be-8a5b3d14f555 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:11.751717 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-8908c02f-85a2-4ff1-94e0-981d691f04f0 req-0a2dea88-d985-4316-b0be-8a5b3d14f555 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:11.752147 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-8908c02f-85a2-4ff1-94e0-981d691f04f0 req-0a2dea88-d985-4316-b0be-8a5b3d14f555 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:11.765699 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-8908c02f-85a2-4ff1-94e0-981d691f04f0 req-0a2dea88-d985-4316-b0be-8a5b3d14f555 service nova] Creating event network-vif-plugged:e5a9751a-054f-4649-be5b-0a1cbf094c02 for instance 87fe386a-f98b-46b8-86f2-993e25292785 on nch2-master-1 Oct 22 20:53:11.771736 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-8908c02f-85a2-4ff1-94e0-981d691f04f0 req-0a2dea88-d985-4316-b0be-8a5b3d14f555 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037368 Oct 22 20:53:11.772422 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 598/1131] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:53:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:53:11.783555 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-eff86026-b48e-4fde-8c97-3de922fb5eac tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:53:11.784309 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-eff86026-b48e-4fde-8c97-3de922fb5eac tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] [instance: fa364234-023c-491a-bc88-97c048f6f0e2] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:53:11.792880 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-eff86026-b48e-4fde-8c97-3de922fb5eac tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:11.793379 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-eff86026-b48e-4fde-8c97-3de922fb5eac tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:11.793822 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-eff86026-b48e-4fde-8c97-3de922fb5eac tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:11.794548 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-eff86026-b48e-4fde-8c97-3de922fb5eac tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:11.795534 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-eff86026-b48e-4fde-8c97-3de922fb5eac tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:11.795987 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-eff86026-b48e-4fde-8c97-3de922fb5eac tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:12.316142 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-eff86026-b48e-4fde-8c97-3de922fb5eac tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9bba9ed37d7430e82e7d310982b8e47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30dbbdc150694e0ebc07c63e90280d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:53:12.348287 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-eff86026-b48e-4fde-8c97-3de922fb5eac tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] 10.222.0.18 "GET /compute/v2.1/servers/fa364234-023c-491a-bc88-97c048f6f0e2" status: 200 len: 1712 microversion: 2.1 time: 0.574505 Oct 22 20:53:12.349690 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 599/1132] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:53:11 2022] GET /compute/v2.1/servers/fa364234-023c-491a-bc88-97c048f6f0e2 => generated 1712 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:53:12.357146 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-7fe61af0-48ac-4f19-b3ff-ffe2372bd7b8 tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Calling method '.version_select at 0x7fd3a4170310>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:53:12.439206 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-7fe61af0-48ac-4f19-b3ff-ffe2372bd7b8 tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] 10.222.0.18 "GET /compute/v2.1/images/9585a413-1cc7-4173-a4e4-f771201c7779" status: 200 len: 1424 microversion: 2.1 time: 0.087983 Oct 22 20:53:12.440424 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 600/1133] 10.222.0.18 () {58 vars in 1233 bytes} [Sat Oct 22 20:53:12 2022] GET /compute/v2.1/images/9585a413-1cc7-4173-a4e4-f771201c7779 => generated 1424 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:53:12.450207 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-ec189cef-e58f-4733-8baf-0ff1a55993f9 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:53:12.516008 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-ec189cef-e58f-4733-8baf-0ff1a55993f9 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] 10.222.0.18 "DELETE /compute/v2.1/os-server-groups/83091a39-89dc-40c4-ae59-edcc55a4b24d" status: 204 len: 0 microversion: 2.1 time: 0.073438 Oct 22 20:53:12.527887 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 601/1134] 10.222.0.18 () {58 vars in 1266 bytes} [Sat Oct 22 20:53:12 2022] DELETE /compute/v2.1/os-server-groups/83091a39-89dc-40c4-ae59-edcc55a4b24d => generated 0 bytes in 87 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 20:53:12.783677 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-0bd70878-61d6-4161-a558-f76dc12638fe tempest-KeyPairsNegativeTestJSON-735431762 tempest-KeyPairsNegativeTestJSON-735431762-project] Action: 'create', calling method: .version_select at 0x7fd3a4170280>, body: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDMKB3/YCzb01sH7yLbH7ZCRjNVkLAnpXsN/8xHMm8Eir6U8pdECG/0MbRQH5zgMJ6dYcCT3tSxYFyY7p5aqaaZBfJ+X9NFxm5zzdqnBPZeO4G9RSY+Wo4THTpRen3t3cw=="}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:53:12.788238 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-0bd70878-61d6-4161-a558-f76dc12638fe tempest-KeyPairsNegativeTestJSON-735431762 tempest-KeyPairsNegativeTestJSON-735431762-project] Request method failure captured: Oct 22 20:53:12.788238 ncdv-master-1 devstack@n-api.service[138745]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 22 20:53:12.788238 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 20:53:12.788238 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 20:53:12.788238 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 20:53:12.788238 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 257 Oct 22 20:53:12.788238 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 20:53:12.788238 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 20:53:12.788238 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 20:53:12.788238 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 20:53:12.788238 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVFg3JXNKJ4rNrVtgD9DbptJ1KaqN5WQg85q3VDjyHHRpsU33G0WSUPtO6_-YqlPS836okGDYvhI2WQuCznKfnZAQOQKhffsdV6YfMbmNh1SfdSOSkG6dxAhfL8RbcSUM7vMkuqp0ZKAjliM4j5VLb464_m8IDOIfBYuvIKHMITWddFU Oct 22 20:53:12.788238 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 20:53:12.788238 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 20:53:12.788238 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 20:53:12.788238 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 20:53:12.788238 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 20:53:12.788238 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 20:53:12.788238 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: da7c51c147a84e2fa88c823eefcd7459 Oct 22 20:53:12.788238 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-735431762 Oct 22 20:53:12.788238 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 20:53:12.788238 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 20:53:12.788238 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_da7c51c147a84e2fa88c823eefcd7459"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/da7c51c147a84e2fa88c823eefcd7459"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/da7c51c147a84e2fa88c823eefcd7459"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/da7c51c147a84e2fa88c823eefcd7459"}]}] Oct 22 20:53:12.788238 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-KeyPairsNegativeTestJSON-735431762 Oct 22 20:53:12.788238 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: da7c51c147a84e2fa88c823eefcd7459 Oct 22 20:53:12.788238 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-735431762 Oct 22 20:53:12.788238 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-KeyPairsNegativeTestJSON-735431762-project Oct 22 20:53:12.788238 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 20:53:12.788238 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 20:53:12.788238 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: 0f00b393125848d89a8fdaca9588b4e5 Oct 22 20:53:12.788238 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-KeyPairsNegativeTestJSON-735431762-project Oct 22 20:53:12.788238 ncdv-master-1 devstack@n-api.service[138745]: Oct 22 20:53:12.788238 ncdv-master-1 devstack@n-api.service[138745]: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDMKB3/YCzb01sH7yLbH7ZCRjNVkLAnpXsN/8xHMm8Eir6U8pdECG/0MbRQH5zgMJ6dYcCT3tSxYFyY7p5aqaaZBfJ+X9NFxm5zzdqnBPZeO4G9RSY+Wo4THTpRen3t3cw=="}} Oct 22 20:53:12.788238 ncdv-master-1 devstack@n-api.service[138745]: method: Oct 22 20:53:12.788238 ncdv-master-1 devstack@n-api.service[138745]: exception: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 22 20:53:12.788238 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'body': {'keypair': {'name': 'key_/.\\@:', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDMKB3/YCzb01sH7yLbH7ZCRjNVkLAnpXsN/8xHMm8Eir6U8pdECG/0MbRQH5zgMJ6dYcCT3tSxYFyY7p5aqaaZBfJ+X9NFxm5zzdqnBPZeO4G9RSY+Wo4THTpRen3t3cw=='}}} Oct 22 20:53:12.788238 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:53:12.788238 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:53:12.788238 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Oct 22 20:53:12.788238 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi result = func(instance) Oct 22 20:53:12.788238 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 161, in _validate_keypair_name_20 Oct 22 20:53:12.788238 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return _validate_keypair_name(keypair_name, safe_chars) Oct 22 20:53:12.788238 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 175, in _validate_keypair_name Oct 22 20:53:12.788238 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.InvalidName(reason=reason) Oct 22 20:53:12.788238 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.InvalidName: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 22 20:53:12.788238 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:53:12.788238 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 22 20:53:12.788238 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:53:12.788238 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:53:12.788238 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 22 20:53:12.788238 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 22 20:53:12.788238 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 22 20:53:12.788238 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise error Oct 22 20:53:12.788238 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'key_/.\\@:' is not a 'keypair_name_20' Oct 22 20:53:12.788238 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:53:12.788238 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['keypair']['properties']['name']['allOf'][1]: Oct 22 20:53:12.788238 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi {'format': 'keypair_name_20', Oct 22 20:53:12.788238 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi 'maxLength': 255, Oct 22 20:53:12.788238 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi 'minLength': 1, Oct 22 20:53:12.788238 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 22 20:53:12.788238 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:53:12.788238 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi On instance['keypair']['name']: Oct 22 20:53:12.788238 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi 'key_/.\\@:' Oct 22 20:53:12.788238 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:53:12.792603 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:53:12.792603 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:53:12.792603 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:53:12.792603 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:53:12.792603 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:53:12.792603 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:53:12.792603 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:53:12.792603 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 22 20:53:12.792603 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 22 20:53:12.792603 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:53:12.792603 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:53:12.792603 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 20:53:12.792603 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 20:53:12.792603 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 22 20:53:12.792603 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 22 20:53:12.792603 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 22 20:53:12.792603 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 22 20:53:12.792603 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 22 20:53:12.792603 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 22 20:53:12.792603 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 22 20:53:12.792603 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:53:12.792603 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:53:12.792603 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:53:12.792603 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:53:12.792603 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:53:12.792603 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:53:12.792603 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 22 20:53:12.792603 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 22 20:53:12.792603 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 22 20:53:12.792603 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:53:12.792603 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-0bd70878-61d6-4161-a558-f76dc12638fe tempest-KeyPairsNegativeTestJSON-735431762 tempest-KeyPairsNegativeTestJSON-735431762-project] Returning 400 to user: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:53:12.792603 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-0bd70878-61d6-4161-a558-f76dc12638fe tempest-KeyPairsNegativeTestJSON-735431762 tempest-KeyPairsNegativeTestJSON-735431762-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 400 len: 193 microversion: 2.1 time: 0.259470 Oct 22 20:53:12.800308 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 602/1135] 10.222.0.18 () {60 vars in 1159 bytes} [Sat Oct 22 20:53:12 2022] POST /compute/v2.1/os-keypairs => generated 193 bytes in 270 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 22 20:53:12.813730 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-233c6346-980e-451d-ae67-fb57c42a3b6b tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:53:12.818212 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-233c6346-980e-451d-ae67-fb57c42a3b6b tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] [instance: 4c7b99a9-2ec4-4f4b-98e7-8e1ea2103735] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:53:12.839448 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-233c6346-980e-451d-ae67-fb57c42a3b6b tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:12.840125 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-233c6346-980e-451d-ae67-fb57c42a3b6b tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:12.842008 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-233c6346-980e-451d-ae67-fb57c42a3b6b tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:12.843237 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-233c6346-980e-451d-ae67-fb57c42a3b6b tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:12.843898 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-233c6346-980e-451d-ae67-fb57c42a3b6b tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:12.844495 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-233c6346-980e-451d-ae67-fb57c42a3b6b tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:13.309087 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.objects.instance [None req-233c6346-980e-451d-ae67-fb57c42a3b6b tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] Lazy-loading 'services' on Instance uuid 4c7b99a9-2ec4-4f4b-98e7-8e1ea2103735 {{(pid=138745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 20:53:13.324008 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-233c6346-980e-451d-ae67-fb57c42a3b6b tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/4c7b99a9-2ec4-4f4b-98e7-8e1ea2103735" status: 200 len: 2420 microversion: 2.25 time: 0.522978 Oct 22 20:53:13.324586 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 603/1136] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 20:53:12 2022] GET /compute/v2.1/servers/4c7b99a9-2ec4-4f4b-98e7-8e1ea2103735 => generated 2420 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 20:53:13.329816 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-6006fd35-3b99-4030-96ae-0e5d0f0abcfc tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:53:13.330722 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-6006fd35-3b99-4030-96ae-0e5d0f0abcfc tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] [instance: 69ed98a2-c208-4765-88b1-3e76a09cc481] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:53:13.338688 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6006fd35-3b99-4030-96ae-0e5d0f0abcfc tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:13.339502 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6006fd35-3b99-4030-96ae-0e5d0f0abcfc tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:13.340116 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6006fd35-3b99-4030-96ae-0e5d0f0abcfc tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:13.341154 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6006fd35-3b99-4030-96ae-0e5d0f0abcfc tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:13.341765 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6006fd35-3b99-4030-96ae-0e5d0f0abcfc tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:13.342352 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6006fd35-3b99-4030-96ae-0e5d0f0abcfc tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:13.381068 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-6006fd35-3b99-4030-96ae-0e5d0f0abcfc tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] [instance: 69ed98a2-c208-4765-88b1-3e76a09cc481] Going to try to terminate instance {{(pid=138745) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 20:53:13.462037 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-54dfc5f3-511e-471e-b37d-8a8ce23dfd14 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Flavor limits 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 20:53:13.467749 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-54dfc5f3-511e-471e-b37d-8a8ce23dfd14 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Image limits 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 20:53:13.470093 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-54dfc5f3-511e-471e-b37d-8a8ce23dfd14 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Flavor pref 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 20:53:13.474047 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-54dfc5f3-511e-471e-b37d-8a8ce23dfd14 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Image pref 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 20:53:13.477436 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-54dfc5f3-511e-471e-b37d-8a8ce23dfd14 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 20:53:13.497222 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-6006fd35-3b99-4030-96ae-0e5d0f0abcfc tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] 10.222.0.18 "DELETE /compute/v2.1/servers/69ed98a2-c208-4765-88b1-3e76a09cc481" status: 204 len: 0 microversion: 2.1 time: 0.170779 Oct 22 20:53:13.499909 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 604/1137] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 20:53:13 2022] DELETE /compute/v2.1/servers/69ed98a2-c208-4765-88b1-3e76a09cc481 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 20:53:13.507914 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-228d8a7f-a911-4c3b-93fd-411f466404e6 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:53:13.508916 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-228d8a7f-a911-4c3b-93fd-411f466404e6 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] [instance: 87fe386a-f98b-46b8-86f2-993e25292785] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:53:13.510841 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-54dfc5f3-511e-471e-b37d-8a8ce23dfd14 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:13.512036 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-54dfc5f3-511e-471e-b37d-8a8ce23dfd14 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:13.512417 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-54dfc5f3-511e-471e-b37d-8a8ce23dfd14 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:13.516004 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-54dfc5f3-511e-471e-b37d-8a8ce23dfd14 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:13.516891 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-54dfc5f3-511e-471e-b37d-8a8ce23dfd14 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:13.517285 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-228d8a7f-a911-4c3b-93fd-411f466404e6 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:13.517943 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-228d8a7f-a911-4c3b-93fd-411f466404e6 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:13.518403 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-54dfc5f3-511e-471e-b37d-8a8ce23dfd14 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:13.518698 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-228d8a7f-a911-4c3b-93fd-411f466404e6 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:13.519591 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-228d8a7f-a911-4c3b-93fd-411f466404e6 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:13.520404 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-228d8a7f-a911-4c3b-93fd-411f466404e6 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:13.520985 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-228d8a7f-a911-4c3b-93fd-411f466404e6 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:13.567428 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-54dfc5f3-511e-471e-b37d-8a8ce23dfd14 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Getting quotas for project 6bacf9909082440f8a201771b64a75fa. Resources: {'cores', 'instances', 'ram'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 20:53:13.587434 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-54dfc5f3-511e-471e-b37d-8a8ce23dfd14 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Getting quotas for user c7f48d18691d4473bbe0284c44f14d09 and project 6bacf9909082440f8a201771b64a75fa. Resources: {'cores', 'instances', 'ram'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 20:53:13.634038 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-54dfc5f3-511e-471e-b37d-8a8ce23dfd14 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Going to run 1 instances... {{(pid=138744) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 20:53:13.639930 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-54dfc5f3-511e-471e-b37d-8a8ce23dfd14 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] [instance: f2f50f6b-6a3e-449f-836e-bd897f78279c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='085e4478-6edc-4a69-8e08-f9831713eb65',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138744) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 20:53:13.730552 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-54dfc5f3-511e-471e-b37d-8a8ce23dfd14 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.712349 Oct 22 20:53:13.741769 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 534/1138] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Oct 22 20:53:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 4724 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 20:53:13.748373 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-8f69dd32-a60b-4ed3-b07d-9929dcf1fe80 tempest-KeyPairsNegativeTestJSON-735431762 tempest-KeyPairsNegativeTestJSON-735431762-project] Action: 'create', calling method: .version_select at 0x7fd39feb7430>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1358355996", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:53:13.765469 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-228d8a7f-a911-4c3b-93fd-411f466404e6 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34f8af8ee2b545bead90fffd6c6c4896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48413ed1ac4e1ea65fb38f097881db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:53:13.772171 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-8f69dd32-a60b-4ed3-b07d-9929dcf1fe80 tempest-KeyPairsNegativeTestJSON-735431762 tempest-KeyPairsNegativeTestJSON-735431762-project] Getting quotas for project da7c51c147a84e2fa88c823eefcd7459. Resources: {'key_pairs'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 20:53:13.782082 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-8f69dd32-a60b-4ed3-b07d-9929dcf1fe80 tempest-KeyPairsNegativeTestJSON-735431762 tempest-KeyPairsNegativeTestJSON-735431762-project] Getting quotas for user 0f00b393125848d89a8fdaca9588b4e5 and project da7c51c147a84e2fa88c823eefcd7459. Resources: {'key_pairs'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 20:53:13.790342 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-228d8a7f-a911-4c3b-93fd-411f466404e6 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] 10.222.0.18 "GET /compute/v2.1/servers/87fe386a-f98b-46b8-86f2-993e25292785" status: 200 len: 1507 microversion: 2.1 time: 0.286016 Oct 22 20:53:13.792173 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 605/1139] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:53:13 2022] GET /compute/v2.1/servers/87fe386a-f98b-46b8-86f2-993e25292785 => generated 1507 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:53:13.804428 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-8f69dd32-a60b-4ed3-b07d-9929dcf1fe80 tempest-KeyPairsNegativeTestJSON-735431762 tempest-KeyPairsNegativeTestJSON-735431762-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Oct 22 20:53:13.807104 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-8a70e019-fdec-4a42-ba8b-8990ecb21169 req-fc13634e-bdf5-4e16-a005-f6d986f8d427 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa364234-023c-491a-bc88-97c048f6f0e2", "name": "network-vif-deleted", "tag": "609bc1c1-807a-4ef4-bd5c-8679553bab8c"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:53:13.815716 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-8f69dd32-a60b-4ed3-b07d-9929dcf1fe80 tempest-KeyPairsNegativeTestJSON-735431762 tempest-KeyPairsNegativeTestJSON-735431762-project] Request method failure captured: Oct 22 20:53:13.815716 ncdv-master-1 devstack@n-api.service[138744]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 22 20:53:13.815716 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 20:53:13.815716 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 20:53:13.815716 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 20:53:13.815716 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 2167 Oct 22 20:53:13.815716 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 20:53:13.815716 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 20:53:13.815716 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 20:53:13.815716 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 20:53:13.815716 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVFg3JXNKJ4rNrVtgD9DbptJ1KaqN5WQg85q3VDjyHHRpsU33G0WSUPtO6_-YqlPS836okGDYvhI2WQuCznKfnZAQOQKhffsdV6YfMbmNh1SfdSOSkG6dxAhfL8RbcSUM7vMkuqp0ZKAjliM4j5VLb464_m8IDOIfBYuvIKHMITWddFU Oct 22 20:53:13.815716 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 20:53:13.815716 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 20:53:13.815716 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 20:53:13.815716 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 20:53:13.815716 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 20:53:13.815716 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 20:53:13.815716 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: da7c51c147a84e2fa88c823eefcd7459 Oct 22 20:53:13.815716 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-735431762 Oct 22 20:53:13.815716 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 20:53:13.815716 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 20:53:13.815716 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_da7c51c147a84e2fa88c823eefcd7459"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/da7c51c147a84e2fa88c823eefcd7459"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/da7c51c147a84e2fa88c823eefcd7459"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/da7c51c147a84e2fa88c823eefcd7459"}]}] Oct 22 20:53:13.815716 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-KeyPairsNegativeTestJSON-735431762 Oct 22 20:53:13.815716 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: da7c51c147a84e2fa88c823eefcd7459 Oct 22 20:53:13.815716 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-735431762 Oct 22 20:53:13.815716 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-KeyPairsNegativeTestJSON-735431762-project Oct 22 20:53:13.815716 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 20:53:13.815716 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 20:53:13.815716 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: 0f00b393125848d89a8fdaca9588b4e5 Oct 22 20:53:13.815716 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-KeyPairsNegativeTestJSON-735431762-project Oct 22 20:53:13.815716 ncdv-master-1 devstack@n-api.service[138744]: Oct 22 20:53:13.815716 ncdv-master-1 devstack@n-api.service[138744]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1358355996", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} Oct 22 20:53:13.815716 ncdv-master-1 devstack@n-api.service[138744]: method: Oct 22 20:53:13.815716 ncdv-master-1 devstack@n-api.service[138744]: exception: Keypair data is invalid: failed to generate fingerprint Oct 22 20:53:13.817963 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1358355996', 'public_key': 'ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu'}}} Oct 22 20:53:13.817963 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:53:13.817963 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:53:13.817963 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Oct 22 20:53:13.817963 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Oct 22 20:53:13.817963 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 666, in load_ssh_public_key Oct 22 20:53:13.817963 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid key format") Oct 22 20:53:13.817963 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi ValueError: Invalid key format Oct 22 20:53:13.817963 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:53:13.817963 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:53:13.817963 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:53:13.817963 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:53:13.817963 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 22 20:53:13.817963 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 22 20:53:13.817963 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 22 20:53:13.817963 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 22 20:53:13.817963 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 22 20:53:13.817963 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 22 20:53:13.817963 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 22 20:53:13.817963 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise self.value Oct 22 20:53:13.817963 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 22 20:53:13.817963 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 22 20:53:13.817963 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Oct 22 20:53:13.817963 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Oct 22 20:53:13.817963 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Oct 22 20:53:13.817963 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Oct 22 20:53:13.817963 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Oct 22 20:53:13.817963 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Oct 22 20:53:13.817963 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Oct 22 20:53:13.817963 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:53:13.817963 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:53:13.817963 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:53:13.817963 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:53:13.817963 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:53:13.817963 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:53:13.817963 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:53:13.817963 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:53:13.817963 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 22 20:53:13.817963 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 22 20:53:13.817963 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:53:13.817963 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:53:13.820669 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 20:53:13.820669 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 20:53:13.820669 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 20:53:13.820669 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 20:53:13.820669 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 22 20:53:13.820669 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 22 20:53:13.820669 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Oct 22 20:53:13.820669 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Oct 22 20:53:13.820669 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Oct 22 20:53:13.820669 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:53:13.820669 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:53:13.820669 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:53:13.820669 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:53:13.820669 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:53:13.820669 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:53:13.820669 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 20:53:13.820669 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 20:53:13.820669 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Oct 22 20:53:13.820669 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:53:13.820669 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-8f69dd32-a60b-4ed3-b07d-9929dcf1fe80 tempest-KeyPairsNegativeTestJSON-735431762 tempest-KeyPairsNegativeTestJSON-735431762-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:53:13.820669 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-8f69dd32-a60b-4ed3-b07d-9929dcf1fe80 tempest-KeyPairsNegativeTestJSON-735431762 tempest-KeyPairsNegativeTestJSON-735431762-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.073839 Oct 22 20:53:13.824095 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 535/1140] 10.222.0.18 () {60 vars in 1160 bytes} [Sat Oct 22 20:53:13 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 81 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 22 20:53:13.829119 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-b8ed320a-6485-43b5-b7bc-fe9450bb4446 tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch2-master-1", "block_migration": "auto"}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:53:13.832716 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-8a70e019-fdec-4a42-ba8b-8990ecb21169 req-fc13634e-bdf5-4e16-a005-f6d986f8d427 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:13.833300 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-8a70e019-fdec-4a42-ba8b-8990ecb21169 req-fc13634e-bdf5-4e16-a005-f6d986f8d427 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:13.833822 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-8a70e019-fdec-4a42-ba8b-8990ecb21169 req-fc13634e-bdf5-4e16-a005-f6d986f8d427 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:13.836378 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-b8ed320a-6485-43b5-b7bc-fe9450bb4446 tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] [instance: 4c7b99a9-2ec4-4f4b-98e7-8e1ea2103735] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:53:13.847602 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b8ed320a-6485-43b5-b7bc-fe9450bb4446 tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:13.848110 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b8ed320a-6485-43b5-b7bc-fe9450bb4446 tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:13.848556 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b8ed320a-6485-43b5-b7bc-fe9450bb4446 tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:13.849486 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b8ed320a-6485-43b5-b7bc-fe9450bb4446 tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:13.850505 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b8ed320a-6485-43b5-b7bc-fe9450bb4446 tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:13.853070 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b8ed320a-6485-43b5-b7bc-fe9450bb4446 tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:13.860713 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-8a70e019-fdec-4a42-ba8b-8990ecb21169 req-fc13634e-bdf5-4e16-a005-f6d986f8d427 service nova] Creating event network-vif-deleted:609bc1c1-807a-4ef4-bd5c-8679553bab8c for instance fa364234-023c-491a-bc88-97c048f6f0e2 on nch2-master-1 Oct 22 20:53:13.880309 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-8a70e019-fdec-4a42-ba8b-8990ecb21169 req-fc13634e-bdf5-4e16-a005-f6d986f8d427 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077824 Oct 22 20:53:13.881348 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 606/1141] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:53:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:53:13.888919 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.objects.instance [None req-b8ed320a-6485-43b5-b7bc-fe9450bb4446 tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] Lazy-loading 'flavor' on Instance uuid 4c7b99a9-2ec4-4f4b-98e7-8e1ea2103735 {{(pid=138744) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 20:53:13.891216 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-6225ebde-a6a1-453d-81de-e833801dbbae tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:53:13.891986 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-6225ebde-a6a1-453d-81de-e833801dbbae tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] [instance: fa364234-023c-491a-bc88-97c048f6f0e2] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:53:13.905420 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-b8ed320a-6485-43b5-b7bc-fe9450bb4446 tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] [instance: 4c7b99a9-2ec4-4f4b-98e7-8e1ea2103735] Going to try to live migrate instance to nch2-master-1 {{(pid=138744) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 22 20:53:13.912379 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6225ebde-a6a1-453d-81de-e833801dbbae tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:13.912915 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6225ebde-a6a1-453d-81de-e833801dbbae tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:13.913353 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6225ebde-a6a1-453d-81de-e833801dbbae tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:13.916292 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6225ebde-a6a1-453d-81de-e833801dbbae tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:13.918808 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6225ebde-a6a1-453d-81de-e833801dbbae tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:13.920359 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6225ebde-a6a1-453d-81de-e833801dbbae tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:13.994719 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6225ebde-a6a1-453d-81de-e833801dbbae tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:13.995235 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6225ebde-a6a1-453d-81de-e833801dbbae tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:13.995699 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6225ebde-a6a1-453d-81de-e833801dbbae tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:14.000827 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.objects.instance [None req-6225ebde-a6a1-453d-81de-e833801dbbae tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Lazy-loading 'fault' on Instance uuid fa364234-023c-491a-bc88-97c048f6f0e2 {{(pid=138745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 20:53:14.123942 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-6225ebde-a6a1-453d-81de-e833801dbbae tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9bba9ed37d7430e82e7d310982b8e47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30dbbdc150694e0ebc07c63e90280d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:53:14.127544 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:53:14.141311 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-6225ebde-a6a1-453d-81de-e833801dbbae tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] 10.222.0.18 "GET /compute/v2.1/servers/fa364234-023c-491a-bc88-97c048f6f0e2" status: 200 len: 1354 microversion: 2.1 time: 0.258652 Oct 22 20:53:14.142729 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 607/1142] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:53:13 2022] GET /compute/v2.1/servers/fa364234-023c-491a-bc88-97c048f6f0e2 => generated 1354 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:53:14.151727 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-9036e491-b75e-44c4-8bcf-075800093a65 tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Calling method '.version_select at 0x7fd3a4266d30>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:53:14.245142 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-9036e491-b75e-44c4-8bcf-075800093a65 tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] 10.222.0.18 "GET /compute/v2.1/images/9585a413-1cc7-4173-a4e4-f771201c7779" status: 200 len: 1424 microversion: 2.1 time: 0.098745 Oct 22 20:53:14.248147 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 608/1143] 10.222.0.18 () {58 vars in 1233 bytes} [Sat Oct 22 20:53:14 2022] GET /compute/v2.1/images/9585a413-1cc7-4173-a4e4-f771201c7779 => generated 1424 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:53:14.262313 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-b68d5584-b138-431d-9781-7d85016c7ac2 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:53:14.262820 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-b68d5584-b138-431d-9781-7d85016c7ac2 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] [instance: 69ed98a2-c208-4765-88b1-3e76a09cc481] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:53:14.280237 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b68d5584-b138-431d-9781-7d85016c7ac2 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:14.286794 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b68d5584-b138-431d-9781-7d85016c7ac2 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:14.287457 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b68d5584-b138-431d-9781-7d85016c7ac2 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:14.288935 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b68d5584-b138-431d-9781-7d85016c7ac2 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:14.289651 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b68d5584-b138-431d-9781-7d85016c7ac2 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:14.292822 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b68d5584-b138-431d-9781-7d85016c7ac2 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:14.557915 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-b68d5584-b138-431d-9781-7d85016c7ac2 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91cf84a287b74618ae1b3368785b0b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902e239d67664098895ab24340b0b780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:53:14.571111 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-b68d5584-b138-431d-9781-7d85016c7ac2 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] 10.222.0.18 "GET /compute/v2.1/servers/69ed98a2-c208-4765-88b1-3e76a09cc481" status: 200 len: 1472 microversion: 2.1 time: 0.320448 Oct 22 20:53:14.585237 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 609/1144] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:53:14 2022] GET /compute/v2.1/servers/69ed98a2-c208-4765-88b1-3e76a09cc481 => generated 1472 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:53:14.608603 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-05cc1e79-355e-4bc9-b8b5-9c5f1e075a03 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:53:14.611223 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-05cc1e79-355e-4bc9-b8b5-9c5f1e075a03 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] [instance: f2f50f6b-6a3e-449f-836e-bd897f78279c] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:53:14.714077 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-05cc1e79-355e-4bc9-b8b5-9c5f1e075a03 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7f48d18691d4473bbe0284c44f14d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bacf9909082440f8a201771b64a75fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:53:14.725901 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-05cc1e79-355e-4bc9-b8b5-9c5f1e075a03 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] 10.222.0.18 "GET /compute/v2.1/servers/f2f50f6b-6a3e-449f-836e-bd897f78279c" status: 200 len: 1213 microversion: 2.1 time: 0.139062 Oct 22 20:53:14.748948 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 610/1145] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:53:14 2022] GET /compute/v2.1/servers/f2f50f6b-6a3e-449f-836e-bd897f78279c => generated 1213 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:53:14.761714 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-c3c53385-f6a2-47ea-bcdc-1e0b40a22eb1 tempest-KeyPairsNegativeTestJSON-735431762 tempest-KeyPairsNegativeTestJSON-735431762-project] Action: 'create', calling method: .version_select at 0x7fd3a4266d30>, body: {"keypair": {"name": "tempest-keypair-817063876", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLvfJdslc7nXIO5PEeeg+nlIW/OKmk4j8e5VGP/d4qh4I0T1etQiG6+HmZUzt09siYZsU8VbDrSpvdYyVjd5i/iHyzFgVM2rQ4FO+xiQnMAX935JfReaaTdi7Y027Ulyng=="}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:53:14.790007 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-c3c53385-f6a2-47ea-bcdc-1e0b40a22eb1 tempest-KeyPairsNegativeTestJSON-735431762 tempest-KeyPairsNegativeTestJSON-735431762-project] Getting quotas for project da7c51c147a84e2fa88c823eefcd7459. Resources: {'key_pairs'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 20:53:14.798359 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-c3c53385-f6a2-47ea-bcdc-1e0b40a22eb1 tempest-KeyPairsNegativeTestJSON-735431762 tempest-KeyPairsNegativeTestJSON-735431762-project] Getting quotas for user 0f00b393125848d89a8fdaca9588b4e5 and project da7c51c147a84e2fa88c823eefcd7459. Resources: {'key_pairs'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 20:53:14.861427 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-c3c53385-f6a2-47ea-bcdc-1e0b40a22eb1 tempest-KeyPairsNegativeTestJSON-735431762 tempest-KeyPairsNegativeTestJSON-735431762-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.110591 Oct 22 20:53:14.882758 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 611/1146] 10.222.0.18 () {60 vars in 1159 bytes} [Sat Oct 22 20:53:14 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:53:14.894055 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-5a6f60ac-5662-4a0c-b082-a848167e8822 tempest-KeyPairsNegativeTestJSON-735431762 tempest-KeyPairsNegativeTestJSON-735431762-project] Action: 'create', calling method: .version_select at 0x7fd3a420f0d0>, body: {"keypair": {"name": "tempest-keypair-817063876", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF8iZSGcSfihhoqpWEO7KtZzUmKd5VwYOZK4N5nll06G4lMCVX5TG3D9vjIVhAJHLXRb/jKtMZGQM3PpT/vRGU7IhLqpcNRINFHu5OudTxSjwWdikDEtJkVnHo6/OMnCig=="}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:53:14.950029 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-5a6f60ac-5662-4a0c-b082-a848167e8822 tempest-KeyPairsNegativeTestJSON-735431762 tempest-KeyPairsNegativeTestJSON-735431762-project] Getting quotas for project da7c51c147a84e2fa88c823eefcd7459. Resources: {'key_pairs'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 20:53:14.957192 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-5a6f60ac-5662-4a0c-b082-a848167e8822 tempest-KeyPairsNegativeTestJSON-735431762 tempest-KeyPairsNegativeTestJSON-735431762-project] Getting quotas for user 0f00b393125848d89a8fdaca9588b4e5 and project da7c51c147a84e2fa88c823eefcd7459. Resources: {'key_pairs'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 20:53:15.017463 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=2,nova_api:UPDATE=2,nova_api:DELETE=3 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:53:15.038004 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.wsgi [None req-5a6f60ac-5662-4a0c-b082-a848167e8822 tempest-KeyPairsNegativeTestJSON-735431762 tempest-KeyPairsNegativeTestJSON-735431762-project] HTTP exception thrown: Key pair 'tempest-keypair-817063876' already exists. Oct 22 20:53:15.076875 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-5a6f60ac-5662-4a0c-b082-a848167e8822 tempest-KeyPairsNegativeTestJSON-735431762 tempest-KeyPairsNegativeTestJSON-735431762-project] Request method failure captured: Oct 22 20:53:15.076875 ncdv-master-1 devstack@n-api.service[138745]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 22 20:53:15.076875 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 20:53:15.076875 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 20:53:15.076875 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 20:53:15.076875 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 272 Oct 22 20:53:15.076875 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 20:53:15.076875 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 20:53:15.076875 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 20:53:15.076875 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 20:53:15.076875 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVFg3JXNKJ4rNrVtgD9DbptJ1KaqN5WQg85q3VDjyHHRpsU33G0WSUPtO6_-YqlPS836okGDYvhI2WQuCznKfnZAQOQKhffsdV6YfMbmNh1SfdSOSkG6dxAhfL8RbcSUM7vMkuqp0ZKAjliM4j5VLb464_m8IDOIfBYuvIKHMITWddFU Oct 22 20:53:15.076875 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 20:53:15.076875 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 20:53:15.076875 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 20:53:15.076875 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 20:53:15.076875 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 20:53:15.076875 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 20:53:15.076875 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: da7c51c147a84e2fa88c823eefcd7459 Oct 22 20:53:15.076875 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-735431762 Oct 22 20:53:15.076875 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 20:53:15.076875 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 20:53:15.076875 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_da7c51c147a84e2fa88c823eefcd7459"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/da7c51c147a84e2fa88c823eefcd7459"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/da7c51c147a84e2fa88c823eefcd7459"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/da7c51c147a84e2fa88c823eefcd7459"}]}] Oct 22 20:53:15.076875 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-KeyPairsNegativeTestJSON-735431762 Oct 22 20:53:15.076875 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: da7c51c147a84e2fa88c823eefcd7459 Oct 22 20:53:15.076875 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-735431762 Oct 22 20:53:15.076875 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-KeyPairsNegativeTestJSON-735431762-project Oct 22 20:53:15.076875 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 20:53:15.076875 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 20:53:15.076875 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: 0f00b393125848d89a8fdaca9588b4e5 Oct 22 20:53:15.076875 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-KeyPairsNegativeTestJSON-735431762-project Oct 22 20:53:15.076875 ncdv-master-1 devstack@n-api.service[138745]: Oct 22 20:53:15.076875 ncdv-master-1 devstack@n-api.service[138745]: {"keypair": {"name": "tempest-keypair-817063876", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF8iZSGcSfihhoqpWEO7KtZzUmKd5VwYOZK4N5nll06G4lMCVX5TG3D9vjIVhAJHLXRb/jKtMZGQM3PpT/vRGU7IhLqpcNRINFHu5OudTxSjwWdikDEtJkVnHo6/OMnCig=="}} Oct 22 20:53:15.076875 ncdv-master-1 devstack@n-api.service[138745]: method: Oct 22 20:53:15.076875 ncdv-master-1 devstack@n-api.service[138745]: exception: Key pair 'tempest-keypair-817063876' already exists. Oct 22 20:53:15.076875 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'body': {'keypair': {'name': 'tempest-keypair-817063876', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF8iZSGcSfihhoqpWEO7KtZzUmKd5VwYOZK4N5nll06G4lMCVX5TG3D9vjIVhAJHLXRb/jKtMZGQM3PpT/vRGU7IhLqpcNRINFHu5OudTxSjwWdikDEtJkVnHo6/OMnCig=='}}} Oct 22 20:53:15.076875 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:53:15.076875 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:53:15.076875 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 22 20:53:15.076875 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 22 20:53:15.076875 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 22 20:53:15.076875 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 22 20:53:15.076875 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 22 20:53:15.076875 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 22 20:53:15.076875 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 22 20:53:15.076875 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 22 20:53:15.076875 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 22 20:53:15.076875 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 22 20:53:15.076875 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 22 20:53:15.076875 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi result.read() Oct 22 20:53:15.076875 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 22 20:53:15.076875 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 22 20:53:15.076875 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 22 20:53:15.076875 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 22 20:53:15.076875 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 22 20:53:15.076875 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 22 20:53:15.076875 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 22 20:53:15.076875 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 22 20:53:15.076875 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '0f00b393125848d89a8fdaca9588b4e5-tempest-keypair-817063876' for key 'key_pairs.uniq_key_pairs0user_id0name'") Oct 22 20:53:15.076875 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:53:15.086443 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 22 20:53:15.086443 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:53:15.086443 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:53:15.086443 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 69, in _create_in_db Oct 22 20:53:15.086443 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi kp.save(context.session) Oct 22 20:53:15.086443 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Oct 22 20:53:15.086443 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi session.flush() Oct 22 20:53:15.086443 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 22 20:53:15.086443 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi self._flush(objects) Oct 22 20:53:15.086443 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 22 20:53:15.086443 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Oct 22 20:53:15.086443 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 22 20:53:15.086443 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi compat.raise_( Oct 22 20:53:15.086443 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 22 20:53:15.086443 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception Oct 22 20:53:15.086443 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 22 20:53:15.086443 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi flush_context.execute() Oct 22 20:53:15.086443 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 22 20:53:15.086443 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi rec.execute(self) Oct 22 20:53:15.086443 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 22 20:53:15.086443 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Oct 22 20:53:15.086443 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 22 20:53:15.086443 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Oct 22 20:53:15.086443 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 22 20:53:15.086443 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Oct 22 20:53:15.086443 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 22 20:53:15.086443 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Oct 22 20:53:15.086443 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 22 20:53:15.086443 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Oct 22 20:53:15.086443 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 22 20:53:15.086443 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Oct 22 20:53:15.086443 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 22 20:53:15.086443 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Oct 22 20:53:15.086443 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 22 20:53:15.086443 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 22 20:53:15.086443 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 22 20:53:15.086443 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception Oct 22 20:53:15.086443 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 22 20:53:15.086443 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 22 20:53:15.086443 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 22 20:53:15.086443 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 22 20:53:15.086443 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 22 20:53:15.086443 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 22 20:53:15.086443 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 22 20:53:15.086443 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 22 20:53:15.086443 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 22 20:53:15.086443 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 22 20:53:15.086443 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 22 20:53:15.086443 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi result.read() Oct 22 20:53:15.086443 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 22 20:53:15.086443 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 22 20:53:15.086443 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 22 20:53:15.086443 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 22 20:53:15.086443 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 22 20:53:15.086443 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 22 20:53:15.086443 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 22 20:53:15.096559 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 22 20:53:15.096559 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '0f00b393125848d89a8fdaca9588b4e5-tempest-keypair-817063876' for key 'key_pairs.uniq_key_pairs0user_id0name'") Oct 22 20:53:15.096559 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO key_pairs (created_at, updated_at, name, user_id, fingerprint, public_key, type) VALUES (%(created_at)s, %(updated_at)s, %(name)s, %(user_id)s, %(fingerprint)s, %(public_key)s, %(type)s)] Oct 22 20:53:15.096559 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 10, 22, 20, 53, 15, 19893), 'updated_at': None, 'name': 'tempest-keypair-817063876', 'user_id': '0f00b393125848d89a8fdaca9588b4e5', 'fingerprint': '47:82:14:c1:47:23:4b:c0:f5:2c:a6:03:69:dd:f9:8c', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF8iZSGcSfihhoqpWEO7KtZzUmKd5VwYOZK4N5nll06G4lMCVX5TG3D9vjIVhAJHLXRb/jKtMZGQM3PpT/vRGU7IhLqpcNRINFHu5OudTxSjwWdikDEtJkVnHo6/OMnCig==', 'type': 'ssh'}] Oct 22 20:53:15.096559 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 22 20:53:15.096559 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:53:15.096559 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:53:15.096559 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:53:15.096559 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:53:15.096559 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 22 20:53:15.096559 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 22 20:53:15.096559 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 22 20:53:15.096559 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 22 20:53:15.096559 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 22 20:53:15.096559 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 22 20:53:15.096559 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 22 20:53:15.096559 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise self.value Oct 22 20:53:15.096559 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 22 20:53:15.096559 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 22 20:53:15.096559 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6777, in import_key_pair Oct 22 20:53:15.096559 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi keypair.create() Oct 22 20:53:15.096559 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 22 20:53:15.096559 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 22 20:53:15.096559 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 158, in create Oct 22 20:53:15.096559 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi self._create() Oct 22 20:53:15.096559 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 162, in _create Oct 22 20:53:15.096559 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi db_keypair = self._create_in_db(self._context, updates) Oct 22 20:53:15.096559 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 134, in _create_in_db Oct 22 20:53:15.096559 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return _create_in_db(context, values) Oct 22 20:53:15.096559 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 22 20:53:15.096559 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 22 20:53:15.096559 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 71, in _create_in_db Oct 22 20:53:15.096559 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.KeyPairExists(key_name=values['name']) Oct 22 20:53:15.096559 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.KeyPairExists: Key pair 'tempest-keypair-817063876' already exists. Oct 22 20:53:15.096559 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:53:15.096559 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:53:15.096559 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:53:15.096559 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:53:15.096559 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:53:15.096559 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:53:15.096559 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:53:15.096559 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:53:15.096559 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 22 20:53:15.096559 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 22 20:53:15.096559 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:53:15.096559 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:53:15.096559 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 20:53:15.096559 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 20:53:15.096559 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 20:53:15.096559 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 20:53:15.096559 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 22 20:53:15.096559 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 22 20:53:15.096559 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 132, in _create Oct 22 20:53:15.096559 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=exc.format_message()) Oct 22 20:53:15.096559 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Key pair 'tempest-keypair-817063876' already exists. Oct 22 20:53:15.107822 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:53:15.107822 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:53:15.107822 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:53:15.107822 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:53:15.107822 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:53:15.107822 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:53:15.107822 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 20:53:15.107822 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 20:53:15.107822 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Key pair 'tempest-keypair-817063876' already exists. Oct 22 20:53:15.107822 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:53:15.107822 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-5a6f60ac-5662-4a0c-b082-a848167e8822 tempest-KeyPairsNegativeTestJSON-735431762 tempest-KeyPairsNegativeTestJSON-735431762-project] Returning 409 to user: Key pair 'tempest-keypair-817063876' already exists. {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:53:15.107822 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-5a6f60ac-5662-4a0c-b082-a848167e8822 tempest-KeyPairsNegativeTestJSON-735431762 tempest-KeyPairsNegativeTestJSON-735431762-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 409 len: 104 microversion: 2.1 time: 0.194007 Oct 22 20:53:15.107822 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 612/1147] 10.222.0.18 () {60 vars in 1159 bytes} [Sat Oct 22 20:53:14 2022] POST /compute/v2.1/os-keypairs => generated 104 bytes in 200 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 22 20:53:15.107822 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-98891952-a313-4719-8a6e-bc1b38c36950 tempest-KeyPairsNegativeTestJSON-735431762 tempest-KeyPairsNegativeTestJSON-735431762-project] Calling method '.version_select at 0x7fd3a435a700>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:53:15.149151 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-98891952-a313-4719-8a6e-bc1b38c36950 tempest-KeyPairsNegativeTestJSON-735431762 tempest-KeyPairsNegativeTestJSON-735431762-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-817063876" status: 202 len: 0 microversion: 2.1 time: 0.062439 Oct 22 20:53:15.158449 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 613/1148] 10.222.0.18 () {58 vars in 1218 bytes} [Sat Oct 22 20:53:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-817063876 => generated 0 bytes in 64 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 20:53:15.175800 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-183a4743-2078-4a27-a49f-e424e7de37bf tempest-KeyPairsNegativeTestJSON-735431762 tempest-KeyPairsNegativeTestJSON-735431762-project] Action: 'create', calling method: .version_select at 0x7fd3a44645e0>, body: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA5QpNy5z+s558m8rAbYc/XcSV+mxeZiri9zRtBpylXye7zrWGz1NVMpFIyz5ia3c9WfP3L42V0CGt4Z9NJX92ydOw6VIeVMyQb92n5j++bESVb4Ce0AKAW40n4MEU9X7A=="}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:53:15.189524 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-183a4743-2078-4a27-a49f-e424e7de37bf tempest-KeyPairsNegativeTestJSON-735431762 tempest-KeyPairsNegativeTestJSON-735431762-project] Request method failure captured: Oct 22 20:53:15.189524 ncdv-master-1 devstack@n-api.service[138745]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 22 20:53:15.189524 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 20:53:15.189524 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 20:53:15.189524 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 20:53:15.189524 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 247 Oct 22 20:53:15.189524 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 20:53:15.189524 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 20:53:15.189524 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 20:53:15.189524 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 20:53:15.189524 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVFg3JXNKJ4rNrVtgD9DbptJ1KaqN5WQg85q3VDjyHHRpsU33G0WSUPtO6_-YqlPS836okGDYvhI2WQuCznKfnZAQOQKhffsdV6YfMbmNh1SfdSOSkG6dxAhfL8RbcSUM7vMkuqp0ZKAjliM4j5VLb464_m8IDOIfBYuvIKHMITWddFU Oct 22 20:53:15.189524 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 20:53:15.189524 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 20:53:15.189524 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 20:53:15.189524 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 20:53:15.189524 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 20:53:15.189524 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 20:53:15.189524 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: da7c51c147a84e2fa88c823eefcd7459 Oct 22 20:53:15.189524 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-735431762 Oct 22 20:53:15.189524 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 20:53:15.189524 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 20:53:15.189524 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_da7c51c147a84e2fa88c823eefcd7459"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/da7c51c147a84e2fa88c823eefcd7459"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/da7c51c147a84e2fa88c823eefcd7459"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/da7c51c147a84e2fa88c823eefcd7459"}]}] Oct 22 20:53:15.189524 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-KeyPairsNegativeTestJSON-735431762 Oct 22 20:53:15.189524 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: da7c51c147a84e2fa88c823eefcd7459 Oct 22 20:53:15.189524 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-735431762 Oct 22 20:53:15.189524 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-KeyPairsNegativeTestJSON-735431762-project Oct 22 20:53:15.189524 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 20:53:15.189524 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 20:53:15.189524 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: 0f00b393125848d89a8fdaca9588b4e5 Oct 22 20:53:15.189524 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-KeyPairsNegativeTestJSON-735431762-project Oct 22 20:53:15.189524 ncdv-master-1 devstack@n-api.service[138745]: Oct 22 20:53:15.189524 ncdv-master-1 devstack@n-api.service[138745]: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA5QpNy5z+s558m8rAbYc/XcSV+mxeZiri9zRtBpylXye7zrWGz1NVMpFIyz5ia3c9WfP3L42V0CGt4Z9NJX92ydOw6VIeVMyQb92n5j++bESVb4Ce0AKAW40n4MEU9X7A=="}} Oct 22 20:53:15.189524 ncdv-master-1 devstack@n-api.service[138745]: method: Oct 22 20:53:15.189524 ncdv-master-1 devstack@n-api.service[138745]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 22 20:53:15.189524 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'body': {'keypair': {'name': '', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA5QpNy5z+s558m8rAbYc/XcSV+mxeZiri9zRtBpylXye7zrWGz1NVMpFIyz5ia3c9WfP3L42V0CGt4Z9NJX92ydOw6VIeVMyQb92n5j++bESVb4Ce0AKAW40n4MEU9X7A=='}}} Oct 22 20:53:15.189524 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:53:15.189524 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:53:15.189524 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 22 20:53:15.189524 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 22 20:53:15.189524 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 22 20:53:15.189524 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise error Oct 22 20:53:15.189524 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 22 20:53:15.189524 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:53:15.189524 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Oct 22 20:53:15.189524 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 22 20:53:15.189524 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:53:15.189524 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi On instance['keypair']: Oct 22 20:53:15.189524 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi '' Oct 22 20:53:15.189524 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:53:15.189524 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:53:15.189524 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:53:15.189524 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:53:15.189524 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:53:15.189524 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:53:15.189524 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:53:15.189524 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:53:15.189524 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 22 20:53:15.189524 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 22 20:53:15.189524 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:53:15.189524 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:53:15.189524 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 20:53:15.189524 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 20:53:15.189524 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 22 20:53:15.189524 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 22 20:53:15.194383 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 22 20:53:15.194383 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 22 20:53:15.194383 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 22 20:53:15.194383 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 22 20:53:15.194383 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 22 20:53:15.194383 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:53:15.194383 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:53:15.194383 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:53:15.194383 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:53:15.194383 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:53:15.194383 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:53:15.194383 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 22 20:53:15.194383 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 22 20:53:15.194383 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 22 20:53:15.194383 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:53:15.199441 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-183a4743-2078-4a27-a49f-e424e7de37bf tempest-KeyPairsNegativeTestJSON-735431762 tempest-KeyPairsNegativeTestJSON-735431762-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:53:15.201887 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-183a4743-2078-4a27-a49f-e424e7de37bf tempest-KeyPairsNegativeTestJSON-735431762 tempest-KeyPairsNegativeTestJSON-735431762-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.040822 Oct 22 20:53:15.207080 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 614/1149] 10.222.0.18 () {60 vars in 1159 bytes} [Sat Oct 22 20:53:15 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 45 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 22 20:53:15.213329 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-7b1d878c-b30d-433f-afcb-6688ae214664 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:53:15.214976 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-7b1d878c-b30d-433f-afcb-6688ae214664 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] [instance: fa364234-023c-491a-bc88-97c048f6f0e2] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:53:15.223630 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7b1d878c-b30d-433f-afcb-6688ae214664 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:15.224367 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7b1d878c-b30d-433f-afcb-6688ae214664 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:15.224958 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7b1d878c-b30d-433f-afcb-6688ae214664 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:15.225987 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7b1d878c-b30d-433f-afcb-6688ae214664 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:15.230664 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7b1d878c-b30d-433f-afcb-6688ae214664 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:15.231315 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7b1d878c-b30d-433f-afcb-6688ae214664 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:15.250791 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.wsgi [None req-7b1d878c-b30d-433f-afcb-6688ae214664 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] HTTP exception thrown: Instance fa364234-023c-491a-bc88-97c048f6f0e2 could not be found. Oct 22 20:53:15.253145 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-7b1d878c-b30d-433f-afcb-6688ae214664 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Request method failure captured: Oct 22 20:53:15.253145 ncdv-master-1 devstack@n-api.service[138745]: request: GET /compute/v2.1/servers/fa364234-023c-491a-bc88-97c048f6f0e2 HTTP/1.1 Oct 22 20:53:15.253145 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 20:53:15.253145 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 20:53:15.253145 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 20:53:15.253145 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 0 Oct 22 20:53:15.253145 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 20:53:15.253145 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 20:53:15.253145 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 20:53:15.253145 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 20:53:15.253145 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVFdofXvJrSgjWpq-1isQhmgvdybS2tM0l8K04eElU-t1KAMj6H6Ujb1kYrO3fejFqrejK4vomxDY4wvClpj7VdOnMDtO7P0egZj5A5e0mukyNyBPnz4tbEDZqhzEcYtqt33InUTGLFjHRwEudbG0P6FAWG-p8a8hrQR1ntuUiFOsSEI Oct 22 20:53:15.253145 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 20:53:15.253145 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 20:53:15.253145 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 20:53:15.253145 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 20:53:15.253145 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 20:53:15.253145 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 20:53:15.253145 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: 30dbbdc150694e0ebc07c63e90280d40 Oct 22 20:53:15.253145 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-629684378 Oct 22 20:53:15.253145 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 20:53:15.253145 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 20:53:15.253145 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_30dbbdc150694e0ebc07c63e90280d40"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/30dbbdc150694e0ebc07c63e90280d40"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/30dbbdc150694e0ebc07c63e90280d40"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/30dbbdc150694e0ebc07c63e90280d40"}]}] Oct 22 20:53:15.253145 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-629684378 Oct 22 20:53:15.253145 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: 30dbbdc150694e0ebc07c63e90280d40 Oct 22 20:53:15.253145 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-629684378 Oct 22 20:53:15.253145 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-ServersWithSpecificFlavorTestJSON-629684378-project Oct 22 20:53:15.253145 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 20:53:15.253145 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 20:53:15.253145 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: f9bba9ed37d7430e82e7d310982b8e47 Oct 22 20:53:15.253145 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-629684378-project Oct 22 20:53:15.253145 ncdv-master-1 devstack@n-api.service[138745]: method: > Oct 22 20:53:15.253145 ncdv-master-1 devstack@n-api.service[138745]: exception: Instance fa364234-023c-491a-bc88-97c048f6f0e2 could not be found. Oct 22 20:53:15.253145 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'id': 'fa364234-023c-491a-bc88-97c048f6f0e2'} Oct 22 20:53:15.253145 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:53:15.253145 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:53:15.253145 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 20:53:15.253145 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 20:53:15.253145 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 20:53:15.253145 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 20:53:15.253145 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 20:53:15.253145 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 20:53:15.253145 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 20:53:15.253145 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 20:53:15.253145 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fa364234-023c-491a-bc88-97c048f6f0e2 could not be found. Oct 22 20:53:15.253145 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:53:15.253145 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:53:15.253145 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:53:15.253145 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:53:15.253145 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:53:15.253145 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:53:15.253145 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:53:15.253145 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:53:15.253145 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:53:15.253145 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:53:15.253145 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 20:53:15.253145 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 20:53:15.253145 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 20:53:15.253145 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 20:53:15.253145 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 20:53:15.253145 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 20:53:15.253145 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa364234-023c-491a-bc88-97c048f6f0e2 could not be found. Oct 22 20:53:15.253145 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:53:15.253145 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:53:15.259142 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:53:15.259142 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:53:15.259142 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:53:15.259142 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:53:15.259142 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 20:53:15.259142 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 20:53:15.259142 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa364234-023c-491a-bc88-97c048f6f0e2 could not be found. Oct 22 20:53:15.259142 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:53:15.261955 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-7b1d878c-b30d-433f-afcb-6688ae214664 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Returning 404 to user: Instance fa364234-023c-491a-bc88-97c048f6f0e2 could not be found. {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:53:15.263821 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-7b1d878c-b30d-433f-afcb-6688ae214664 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] 10.222.0.18 "GET /compute/v2.1/servers/fa364234-023c-491a-bc88-97c048f6f0e2" status: 404 len: 111 microversion: 2.1 time: 0.057745 Oct 22 20:53:15.267956 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 615/1150] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:53:15 2022] GET /compute/v2.1/servers/fa364234-023c-491a-bc88-97c048f6f0e2 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 20:53:15.274884 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-c0f3ef38-0ca3-436f-a0f5-e616f7016efc tempest-KeyPairsNegativeTestJSON-735431762 tempest-KeyPairsNegativeTestJSON-735431762-project] Action: 'create', calling method: .version_select at 0x7fd3a435aca0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1293948588", "public_key": " "}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:53:15.303795 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-c0f3ef38-0ca3-436f-a0f5-e616f7016efc tempest-KeyPairsNegativeTestJSON-735431762 tempest-KeyPairsNegativeTestJSON-735431762-project] Getting quotas for project da7c51c147a84e2fa88c823eefcd7459. Resources: {'key_pairs'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 20:53:15.310253 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-c0f3ef38-0ca3-436f-a0f5-e616f7016efc tempest-KeyPairsNegativeTestJSON-735431762 tempest-KeyPairsNegativeTestJSON-735431762-project] Getting quotas for user 0f00b393125848d89a8fdaca9588b4e5 and project da7c51c147a84e2fa88c823eefcd7459. Resources: {'key_pairs'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 20:53:15.379365 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.wsgi [None req-c0f3ef38-0ca3-436f-a0f5-e616f7016efc tempest-KeyPairsNegativeTestJSON-735431762 tempest-KeyPairsNegativeTestJSON-735431762-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Oct 22 20:53:15.383662 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-c0f3ef38-0ca3-436f-a0f5-e616f7016efc tempest-KeyPairsNegativeTestJSON-735431762 tempest-KeyPairsNegativeTestJSON-735431762-project] Request method failure captured: Oct 22 20:53:15.383662 ncdv-master-1 devstack@n-api.service[138745]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 22 20:53:15.383662 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 20:53:15.383662 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 20:53:15.383662 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 20:53:15.383662 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 95 Oct 22 20:53:15.383662 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 20:53:15.383662 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 20:53:15.383662 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 20:53:15.383662 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 20:53:15.383662 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVFg3JXNKJ4rNrVtgD9DbptJ1KaqN5WQg85q3VDjyHHRpsU33G0WSUPtO6_-YqlPS836okGDYvhI2WQuCznKfnZAQOQKhffsdV6YfMbmNh1SfdSOSkG6dxAhfL8RbcSUM7vMkuqp0ZKAjliM4j5VLb464_m8IDOIfBYuvIKHMITWddFU Oct 22 20:53:15.383662 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 20:53:15.383662 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 20:53:15.383662 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 20:53:15.383662 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 20:53:15.383662 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 20:53:15.383662 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 20:53:15.383662 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: da7c51c147a84e2fa88c823eefcd7459 Oct 22 20:53:15.383662 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-735431762 Oct 22 20:53:15.383662 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 20:53:15.383662 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 20:53:15.383662 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_da7c51c147a84e2fa88c823eefcd7459"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/da7c51c147a84e2fa88c823eefcd7459"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/da7c51c147a84e2fa88c823eefcd7459"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/da7c51c147a84e2fa88c823eefcd7459"}]}] Oct 22 20:53:15.383662 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-KeyPairsNegativeTestJSON-735431762 Oct 22 20:53:15.383662 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: da7c51c147a84e2fa88c823eefcd7459 Oct 22 20:53:15.383662 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-735431762 Oct 22 20:53:15.383662 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-KeyPairsNegativeTestJSON-735431762-project Oct 22 20:53:15.383662 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 20:53:15.383662 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 20:53:15.383662 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: 0f00b393125848d89a8fdaca9588b4e5 Oct 22 20:53:15.383662 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-KeyPairsNegativeTestJSON-735431762-project Oct 22 20:53:15.383662 ncdv-master-1 devstack@n-api.service[138745]: Oct 22 20:53:15.383662 ncdv-master-1 devstack@n-api.service[138745]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1293948588", "public_key": " "}} Oct 22 20:53:15.383662 ncdv-master-1 devstack@n-api.service[138745]: method: Oct 22 20:53:15.383662 ncdv-master-1 devstack@n-api.service[138745]: exception: Keypair data is invalid: failed to generate fingerprint Oct 22 20:53:15.383662 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1293948588', 'public_key': ' '}}} Oct 22 20:53:15.383662 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:53:15.383662 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:53:15.383662 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Oct 22 20:53:15.383662 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Oct 22 20:53:15.383662 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 650, in load_ssh_public_key Oct 22 20:53:15.383662 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid line format") Oct 22 20:53:15.383662 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi ValueError: Invalid line format Oct 22 20:53:15.383662 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:53:15.383662 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:53:15.383662 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:53:15.383662 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:53:15.383662 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 22 20:53:15.383662 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 22 20:53:15.383662 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 22 20:53:15.383662 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 22 20:53:15.383662 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 22 20:53:15.383662 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 22 20:53:15.383662 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 22 20:53:15.383662 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise self.value Oct 22 20:53:15.383662 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 22 20:53:15.383662 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 22 20:53:15.383662 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Oct 22 20:53:15.383662 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Oct 22 20:53:15.383662 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Oct 22 20:53:15.383662 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Oct 22 20:53:15.383662 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Oct 22 20:53:15.383662 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Oct 22 20:53:15.383662 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Oct 22 20:53:15.383662 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:53:15.383662 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:53:15.383662 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:53:15.390132 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:53:15.390132 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:53:15.390132 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:53:15.390132 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:53:15.390132 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:53:15.390132 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 22 20:53:15.390132 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 22 20:53:15.390132 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:53:15.390132 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:53:15.390132 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 20:53:15.390132 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 20:53:15.390132 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 20:53:15.390132 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 20:53:15.390132 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 22 20:53:15.390132 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 22 20:53:15.390132 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Oct 22 20:53:15.390132 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Oct 22 20:53:15.390132 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Oct 22 20:53:15.390132 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:53:15.390132 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:53:15.390132 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:53:15.390132 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:53:15.390132 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:53:15.390132 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:53:15.390132 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 20:53:15.390132 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 20:53:15.390132 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Oct 22 20:53:15.390132 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:53:15.390132 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-c0f3ef38-0ca3-436f-a0f5-e616f7016efc tempest-KeyPairsNegativeTestJSON-735431762 tempest-KeyPairsNegativeTestJSON-735431762-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:53:15.390132 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-c0f3ef38-0ca3-436f-a0f5-e616f7016efc tempest-KeyPairsNegativeTestJSON-735431762 tempest-KeyPairsNegativeTestJSON-735431762-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.117766 Oct 22 20:53:15.396706 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 616/1151] 10.222.0.18 () {60 vars in 1158 bytes} [Sat Oct 22 20:53:15 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 127 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 22 20:53:15.403209 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-107a0092-0d87-49d8-ad1d-962fc7c3737a tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Calling method '.version_select at 0x7fd3a44a4d30>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:53:15.497541 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-107a0092-0d87-49d8-ad1d-962fc7c3737a tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] 10.222.0.18 "GET /compute/v2.1/images/9585a413-1cc7-4173-a4e4-f771201c7779" status: 200 len: 1424 microversion: 2.1 time: 0.099390 Oct 22 20:53:15.498316 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 617/1152] 10.222.0.18 () {58 vars in 1233 bytes} [Sat Oct 22 20:53:15 2022] GET /compute/v2.1/images/9585a413-1cc7-4173-a4e4-f771201c7779 => generated 1424 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:53:15.504151 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-f95dbeed-06c5-4da4-aab8-423156d31463 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:53:15.504882 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-f95dbeed-06c5-4da4-aab8-423156d31463 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] [instance: 4c53f81e-f4d8-4b41-b03a-ba9acb867226] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:53:15.519470 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f95dbeed-06c5-4da4-aab8-423156d31463 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:15.520645 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f95dbeed-06c5-4da4-aab8-423156d31463 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:15.521276 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f95dbeed-06c5-4da4-aab8-423156d31463 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:15.522441 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f95dbeed-06c5-4da4-aab8-423156d31463 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:15.523096 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f95dbeed-06c5-4da4-aab8-423156d31463 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:15.523824 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f95dbeed-06c5-4da4-aab8-423156d31463 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:15.540715 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.wsgi [None req-f95dbeed-06c5-4da4-aab8-423156d31463 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] HTTP exception thrown: Instance 4c53f81e-f4d8-4b41-b03a-ba9acb867226 could not be found. Oct 22 20:53:15.543117 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-f95dbeed-06c5-4da4-aab8-423156d31463 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Request method failure captured: Oct 22 20:53:15.543117 ncdv-master-1 devstack@n-api.service[138745]: request: DELETE /compute/v2.1/servers/4c53f81e-f4d8-4b41-b03a-ba9acb867226 HTTP/1.1 Oct 22 20:53:15.543117 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 20:53:15.543117 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 20:53:15.543117 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 20:53:15.543117 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 0 Oct 22 20:53:15.543117 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 20:53:15.543117 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 20:53:15.543117 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 20:53:15.543117 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 20:53:15.543117 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVFdofXvJrSgjWpq-1isQhmgvdybS2tM0l8K04eElU-t1KAMj6H6Ujb1kYrO3fejFqrejK4vomxDY4wvClpj7VdOnMDtO7P0egZj5A5e0mukyNyBPnz4tbEDZqhzEcYtqt33InUTGLFjHRwEudbG0P6FAWG-p8a8hrQR1ntuUiFOsSEI Oct 22 20:53:15.543117 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 20:53:15.543117 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 20:53:15.543117 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 20:53:15.543117 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 20:53:15.543117 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 20:53:15.543117 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 20:53:15.543117 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: 30dbbdc150694e0ebc07c63e90280d40 Oct 22 20:53:15.543117 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-629684378 Oct 22 20:53:15.543117 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 20:53:15.543117 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 20:53:15.543117 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_30dbbdc150694e0ebc07c63e90280d40"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/30dbbdc150694e0ebc07c63e90280d40"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/30dbbdc150694e0ebc07c63e90280d40"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/30dbbdc150694e0ebc07c63e90280d40"}]}] Oct 22 20:53:15.543117 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-629684378 Oct 22 20:53:15.543117 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: 30dbbdc150694e0ebc07c63e90280d40 Oct 22 20:53:15.543117 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-629684378 Oct 22 20:53:15.543117 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-ServersWithSpecificFlavorTestJSON-629684378-project Oct 22 20:53:15.543117 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 20:53:15.543117 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 20:53:15.543117 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: f9bba9ed37d7430e82e7d310982b8e47 Oct 22 20:53:15.543117 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-629684378-project Oct 22 20:53:15.543117 ncdv-master-1 devstack@n-api.service[138745]: method: > Oct 22 20:53:15.543117 ncdv-master-1 devstack@n-api.service[138745]: exception: Instance 4c53f81e-f4d8-4b41-b03a-ba9acb867226 could not be found. Oct 22 20:53:15.543117 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'id': '4c53f81e-f4d8-4b41-b03a-ba9acb867226'} Oct 22 20:53:15.543117 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:53:15.543117 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:53:15.543117 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 20:53:15.543117 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 20:53:15.543117 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 20:53:15.543117 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 20:53:15.543117 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 20:53:15.543117 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 20:53:15.543117 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 20:53:15.543117 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 20:53:15.543117 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c53f81e-f4d8-4b41-b03a-ba9acb867226 could not be found. Oct 22 20:53:15.543117 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:53:15.543117 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:53:15.543117 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:53:15.543117 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:53:15.543117 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:53:15.543117 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:53:15.543117 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:53:15.543117 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:53:15.543117 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:53:15.543117 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:53:15.543117 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 22 20:53:15.543117 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 22 20:53:15.543117 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 22 20:53:15.543117 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 22 20:53:15.543117 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 20:53:15.543117 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 20:53:15.543117 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 20:53:15.543117 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 20:53:15.549028 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c53f81e-f4d8-4b41-b03a-ba9acb867226 could not be found. Oct 22 20:53:15.549028 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:53:15.549028 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:53:15.549028 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:53:15.549028 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:53:15.549028 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:53:15.549028 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:53:15.549028 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 20:53:15.549028 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 20:53:15.549028 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c53f81e-f4d8-4b41-b03a-ba9acb867226 could not be found. Oct 22 20:53:15.549028 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:53:15.549028 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-f95dbeed-06c5-4da4-aab8-423156d31463 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Returning 404 to user: Instance 4c53f81e-f4d8-4b41-b03a-ba9acb867226 could not be found. {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:53:15.549028 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-f95dbeed-06c5-4da4-aab8-423156d31463 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] 10.222.0.18 "DELETE /compute/v2.1/servers/4c53f81e-f4d8-4b41-b03a-ba9acb867226" status: 404 len: 111 microversion: 2.1 time: 0.044470 Oct 22 20:53:15.549028 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 618/1153] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 20:53:15 2022] DELETE /compute/v2.1/servers/4c53f81e-f4d8-4b41-b03a-ba9acb867226 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 20:53:15.554708 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-7a2d29f2-7cb7-43af-9167-e096f3e0a7ca tempest-KeyPairsNegativeTestJSON-735431762 tempest-KeyPairsNegativeTestJSON-735431762-project] Action: 'create', calling method: .version_select at 0x7fd3a44464c0>, body: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMqoL9YjwO4/0PbkvZVp7sRwwFCcOo5Tvy4Epry/6NOTvXug3kBejxJsPGJ6olNsi5HiOAKVBAbFH33mDvkf7NUbrDspF6mPre/cl5Ho1EbawQysYZxq60jvJeFOt3c+Qg=="}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:53:15.559176 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-7a2d29f2-7cb7-43af-9167-e096f3e0a7ca tempest-KeyPairsNegativeTestJSON-735431762 tempest-KeyPairsNegativeTestJSON-735431762-project] Request method failure captured: Oct 22 20:53:15.559176 ncdv-master-1 devstack@n-api.service[138745]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 22 20:53:15.559176 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 20:53:15.559176 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 20:53:15.559176 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 20:53:15.559176 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 507 Oct 22 20:53:15.559176 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 20:53:15.559176 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 20:53:15.559176 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 20:53:15.559176 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 20:53:15.559176 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVFg3JXNKJ4rNrVtgD9DbptJ1KaqN5WQg85q3VDjyHHRpsU33G0WSUPtO6_-YqlPS836okGDYvhI2WQuCznKfnZAQOQKhffsdV6YfMbmNh1SfdSOSkG6dxAhfL8RbcSUM7vMkuqp0ZKAjliM4j5VLb464_m8IDOIfBYuvIKHMITWddFU Oct 22 20:53:15.559176 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 20:53:15.559176 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 20:53:15.559176 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 20:53:15.559176 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 20:53:15.559176 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 20:53:15.559176 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 20:53:15.559176 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: da7c51c147a84e2fa88c823eefcd7459 Oct 22 20:53:15.559176 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-735431762 Oct 22 20:53:15.559176 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 20:53:15.559176 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 20:53:15.559176 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_da7c51c147a84e2fa88c823eefcd7459"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/da7c51c147a84e2fa88c823eefcd7459"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/da7c51c147a84e2fa88c823eefcd7459"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/da7c51c147a84e2fa88c823eefcd7459"}]}] Oct 22 20:53:15.559176 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-KeyPairsNegativeTestJSON-735431762 Oct 22 20:53:15.559176 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: da7c51c147a84e2fa88c823eefcd7459 Oct 22 20:53:15.559176 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-735431762 Oct 22 20:53:15.559176 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-KeyPairsNegativeTestJSON-735431762-project Oct 22 20:53:15.559176 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 20:53:15.559176 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 20:53:15.559176 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: 0f00b393125848d89a8fdaca9588b4e5 Oct 22 20:53:15.559176 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-KeyPairsNegativeTestJSON-735431762-project Oct 22 20:53:15.559176 ncdv-master-1 devstack@n-api.service[138745]: Oct 22 20:53:15.559176 ncdv-master-1 devstack@n-api.service[138745]: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMqoL9YjwO4/0PbkvZVp7sRwwFCcOo5Tvy4Epry/6NOTvXug3kBejxJsPGJ6olNsi5HiOAKVBAbFH33mDvkf7NUbrDspF6mPre/cl5Ho1EbawQysYZxq60jvJeFOt3c+Qg=="}} Oct 22 20:53:15.559176 ncdv-master-1 devstack@n-api.service[138745]: method: Oct 22 20:53:15.559176 ncdv-master-1 devstack@n-api.service[138745]: exception: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 22 20:53:15.559176 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'body': {'keypair': {'name': 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMqoL9YjwO4/0PbkvZVp7sRwwFCcOo5Tvy4Epry/6NOTvXug3kBejxJsPGJ6olNsi5HiOAKVBAbFH33mDvkf7NUbrDspF6mPre/cl5Ho1EbawQysYZxq60jvJeFOt3c+Qg=='}}} Oct 22 20:53:15.559176 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:53:15.559176 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:53:15.559176 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 22 20:53:15.559176 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 22 20:53:15.559176 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 22 20:53:15.559176 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise error Oct 22 20:53:15.559176 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 22 20:53:15.559176 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:53:15.559176 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Oct 22 20:53:15.559176 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 22 20:53:15.559176 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:53:15.559176 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi On instance['keypair']: Oct 22 20:53:15.559176 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' Oct 22 20:53:15.563503 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:53:15.563503 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:53:15.563503 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:53:15.563503 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:53:15.563503 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:53:15.563503 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:53:15.563503 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:53:15.563503 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:53:15.563503 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 22 20:53:15.563503 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 22 20:53:15.563503 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:53:15.563503 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:53:15.563503 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 20:53:15.563503 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 20:53:15.563503 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 22 20:53:15.563503 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 22 20:53:15.563503 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 22 20:53:15.563503 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 22 20:53:15.563503 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 22 20:53:15.563503 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 22 20:53:15.563503 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 22 20:53:15.563503 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:53:15.563503 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:53:15.563503 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:53:15.563503 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:53:15.563503 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:53:15.563503 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:53:15.563503 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 22 20:53:15.563503 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 22 20:53:15.563503 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 22 20:53:15.563503 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:53:15.563503 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-7a2d29f2-7cb7-43af-9167-e096f3e0a7ca tempest-KeyPairsNegativeTestJSON-735431762 tempest-KeyPairsNegativeTestJSON-735431762-project] Returning 400 to user: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:53:15.563503 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-7a2d29f2-7cb7-43af-9167-e096f3e0a7ca tempest-KeyPairsNegativeTestJSON-735431762 tempest-KeyPairsNegativeTestJSON-735431762-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 400 len: 627 microversion: 2.1 time: 0.014572 Oct 22 20:53:15.568473 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 619/1154] 10.222.0.18 () {60 vars in 1159 bytes} [Sat Oct 22 20:53:15 2022] POST /compute/v2.1/os-keypairs => generated 627 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 22 20:53:15.571038 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-b0ef67d8-6ae4-4488-87aa-15e355ad0ff0 tempest-VolumesAdminNegativeTest-2068950585 tempest-VolumesAdminNegativeTest-2068950585-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "2d7c08ac-89f6-47cb-ae33-2f8975ff7c7b"}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:53:15.573405 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-b0ef67d8-6ae4-4488-87aa-15e355ad0ff0 tempest-VolumesAdminNegativeTest-2068950585 tempest-VolumesAdminNegativeTest-2068950585-project-admin] [instance: 87fe386a-f98b-46b8-86f2-993e25292785] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:53:15.598374 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b0ef67d8-6ae4-4488-87aa-15e355ad0ff0 tempest-VolumesAdminNegativeTest-2068950585 tempest-VolumesAdminNegativeTest-2068950585-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:15.598879 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b0ef67d8-6ae4-4488-87aa-15e355ad0ff0 tempest-VolumesAdminNegativeTest-2068950585 tempest-VolumesAdminNegativeTest-2068950585-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:15.599822 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b0ef67d8-6ae4-4488-87aa-15e355ad0ff0 tempest-VolumesAdminNegativeTest-2068950585 tempest-VolumesAdminNegativeTest-2068950585-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:15.600749 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b0ef67d8-6ae4-4488-87aa-15e355ad0ff0 tempest-VolumesAdminNegativeTest-2068950585 tempest-VolumesAdminNegativeTest-2068950585-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:15.601374 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b0ef67d8-6ae4-4488-87aa-15e355ad0ff0 tempest-VolumesAdminNegativeTest-2068950585 tempest-VolumesAdminNegativeTest-2068950585-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:15.602306 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b0ef67d8-6ae4-4488-87aa-15e355ad0ff0 tempest-VolumesAdminNegativeTest-2068950585 tempest-VolumesAdminNegativeTest-2068950585-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:15.698460 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.wsgi [None req-b0ef67d8-6ae4-4488-87aa-15e355ad0ff0 tempest-VolumesAdminNegativeTest-2068950585 tempest-VolumesAdminNegativeTest-2068950585-project-admin] HTTP exception thrown: Volume 77fcd92e-f882-4f5e-9576-67cb6aba3251 could not be found. Oct 22 20:53:15.700752 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-b0ef67d8-6ae4-4488-87aa-15e355ad0ff0 tempest-VolumesAdminNegativeTest-2068950585 tempest-VolumesAdminNegativeTest-2068950585-project-admin] Request method failure captured: Oct 22 20:53:15.700752 ncdv-master-1 devstack@n-api.service[138745]: request: PUT /compute/v2.1/servers/87fe386a-f98b-46b8-86f2-993e25292785/os-volume_attachments/77fcd92e-f882-4f5e-9576-67cb6aba3251 HTTP/1.1 Oct 22 20:53:15.700752 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 20:53:15.700752 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 20:53:15.700752 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 20:53:15.700752 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 74 Oct 22 20:53:15.700752 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 20:53:15.700752 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 20:53:15.700752 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 20:53:15.700752 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 20:53:15.700752 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVFelY17yFzd10HFRAnM8NLlkgq927QwD32EjaxJyKqPJ6CAajpUinHx_fAaHxu_HuZ6CRgUB2r_WWnp27sgpqGeLzirv3LwZsxYYmOrX2mdEWRdgEifiQXQqo3R_SHHTvf-oNsasY_XcD9y88wTuols6RdnyFtjMKTyQ8cLQC893lcs Oct 22 20:53:15.700752 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 20:53:15.700752 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 20:53:15.700752 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 20:53:15.700752 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 20:53:15.700752 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 20:53:15.700752 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 20:53:15.700752 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: 321cd01a30574c5abf2cd28db051492f Oct 22 20:53:15.700752 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-VolumesAdminNegativeTest-2068950585 Oct 22 20:53:15.700752 ncdv-master-1 devstack@n-api.service[138745]: X-Role: admin,member,reader Oct 22 20:53:15.700752 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: admin,member,reader Oct 22 20:53:15.700752 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_321cd01a30574c5abf2cd28db051492f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/321cd01a30574c5abf2cd28db051492f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/321cd01a30574c5abf2cd28db051492f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/321cd01a30574c5abf2cd28db051492f"}]}] Oct 22 20:53:15.700752 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-VolumesAdminNegativeTest-2068950585 Oct 22 20:53:15.700752 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: 321cd01a30574c5abf2cd28db051492f Oct 22 20:53:15.700752 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-2068950585 Oct 22 20:53:15.700752 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-VolumesAdminNegativeTest-2068950585-project-admin Oct 22 20:53:15.700752 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 20:53:15.700752 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 20:53:15.700752 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: 5d05db02c6db41409e308ce42c9e9361 Oct 22 20:53:15.700752 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-VolumesAdminNegativeTest-2068950585-project-admin Oct 22 20:53:15.700752 ncdv-master-1 devstack@n-api.service[138745]: Oct 22 20:53:15.700752 ncdv-master-1 devstack@n-api.service[138745]: {"volumeAttachment": {"volumeId": "2d7c08ac-89f6-47cb-ae33-2f8975ff7c7b"}} Oct 22 20:53:15.700752 ncdv-master-1 devstack@n-api.service[138745]: method: > Oct 22 20:53:15.700752 ncdv-master-1 devstack@n-api.service[138745]: exception: Volume 77fcd92e-f882-4f5e-9576-67cb6aba3251 could not be found. Oct 22 20:53:15.700752 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'server_id': '87fe386a-f98b-46b8-86f2-993e25292785', 'id': '77fcd92e-f882-4f5e-9576-67cb6aba3251', 'body': {'volumeAttachment': {'volumeId': '2d7c08ac-89f6-47cb-ae33-2f8975ff7c7b'}}} Oct 22 20:53:15.700752 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:53:15.700752 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:53:15.700752 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 22 20:53:15.700752 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 22 20:53:15.700752 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 22 20:53:15.700752 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 22 20:53:15.700752 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 22 20:53:15.700752 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 22 20:53:15.700752 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 22 20:53:15.700752 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 22 20:53:15.700752 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 22 20:53:15.700752 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 22 20:53:15.700752 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 22 20:53:15.700752 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 22 20:53:15.700752 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 22 20:53:15.700752 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 22 20:53:15.700752 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 77fcd92e-f882-4f5e-9576-67cb6aba3251 could not be found. (HTTP 404) (Request-ID: req-1d654cb0-1e96-4041-870a-40b2e2c86861) Oct 22 20:53:15.700752 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:53:15.700752 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:53:15.700752 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:53:15.700752 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:53:15.700752 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 430, in _update_volume_swap Oct 22 20:53:15.700752 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi old_volume = self.volume_api.get(context, old_volume_id) Oct 22 20:53:15.700752 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 22 20:53:15.700752 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 22 20:53:15.700752 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 22 20:53:15.704845 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 22 20:53:15.704845 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 22 20:53:15.704845 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 22 20:53:15.704845 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 22 20:53:15.704845 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 22 20:53:15.704845 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 22 20:53:15.704845 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 22 20:53:15.704845 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 22 20:53:15.704845 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 22 20:53:15.704845 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 22 20:53:15.704845 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 22 20:53:15.704845 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 22 20:53:15.704845 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 22 20:53:15.704845 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 22 20:53:15.704845 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 22 20:53:15.704845 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 22 20:53:15.704845 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 22 20:53:15.704845 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 77fcd92e-f882-4f5e-9576-67cb6aba3251 could not be found. Oct 22 20:53:15.704845 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:53:15.704845 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:53:15.704845 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:53:15.704845 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:53:15.704845 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:53:15.704845 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:53:15.704845 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:53:15.704845 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:53:15.704845 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:53:15.704845 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:53:15.704845 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 20:53:15.704845 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 20:53:15.704845 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 20:53:15.704845 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 20:53:15.704845 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Oct 22 20:53:15.704845 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Oct 22 20:53:15.704845 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 432, in _update_volume_swap Oct 22 20:53:15.704845 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 20:53:15.704845 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 77fcd92e-f882-4f5e-9576-67cb6aba3251 could not be found. Oct 22 20:53:15.704845 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:53:15.704845 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:53:15.704845 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:53:15.704845 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:53:15.704845 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:53:15.704845 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:53:15.704845 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 20:53:15.704845 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 20:53:15.704845 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 77fcd92e-f882-4f5e-9576-67cb6aba3251 could not be found. Oct 22 20:53:15.704845 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:53:15.714197 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-b0ef67d8-6ae4-4488-87aa-15e355ad0ff0 tempest-VolumesAdminNegativeTest-2068950585 tempest-VolumesAdminNegativeTest-2068950585-project-admin] Returning 404 to user: Volume 77fcd92e-f882-4f5e-9576-67cb6aba3251 could not be found. {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:53:15.714197 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-b0ef67d8-6ae4-4488-87aa-15e355ad0ff0 tempest-VolumesAdminNegativeTest-2068950585 tempest-VolumesAdminNegativeTest-2068950585-project-admin] 10.222.0.18 "PUT /compute/v2.1/servers/87fe386a-f98b-46b8-86f2-993e25292785/os-volume_attachments/77fcd92e-f882-4f5e-9576-67cb6aba3251" status: 404 len: 109 microversion: 2.1 time: 0.145385 Oct 22 20:53:15.714197 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 620/1155] 10.222.0.18 () {60 vars in 1433 bytes} [Sat Oct 22 20:53:15 2022] PUT /compute/v2.1/servers/87fe386a-f98b-46b8-86f2-993e25292785/os-volume_attachments/77fcd92e-f882-4f5e-9576-67cb6aba3251 => generated 109 bytes in 146 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 20:53:15.734681 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-35101d0a-dbb5-449a-86c0-2cebe1f7d12d tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:53:15.740556 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-35101d0a-dbb5-449a-86c0-2cebe1f7d12d tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] [instance: 4c53f81e-f4d8-4b41-b03a-ba9acb867226] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:53:15.765829 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-35101d0a-dbb5-449a-86c0-2cebe1f7d12d tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:15.767472 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-35101d0a-dbb5-449a-86c0-2cebe1f7d12d tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:15.767946 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-35101d0a-dbb5-449a-86c0-2cebe1f7d12d tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:15.768709 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-35101d0a-dbb5-449a-86c0-2cebe1f7d12d tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:15.769747 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-35101d0a-dbb5-449a-86c0-2cebe1f7d12d tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:15.770617 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-35101d0a-dbb5-449a-86c0-2cebe1f7d12d tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:15.794323 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.wsgi [None req-35101d0a-dbb5-449a-86c0-2cebe1f7d12d tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] HTTP exception thrown: Instance 4c53f81e-f4d8-4b41-b03a-ba9acb867226 could not be found. Oct 22 20:53:15.797369 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-35101d0a-dbb5-449a-86c0-2cebe1f7d12d tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Request method failure captured: Oct 22 20:53:15.797369 ncdv-master-1 devstack@n-api.service[138745]: request: GET /compute/v2.1/servers/4c53f81e-f4d8-4b41-b03a-ba9acb867226 HTTP/1.1 Oct 22 20:53:15.797369 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 20:53:15.797369 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 20:53:15.797369 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 20:53:15.797369 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 0 Oct 22 20:53:15.797369 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 20:53:15.797369 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 20:53:15.797369 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 20:53:15.797369 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 20:53:15.797369 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVFdofXvJrSgjWpq-1isQhmgvdybS2tM0l8K04eElU-t1KAMj6H6Ujb1kYrO3fejFqrejK4vomxDY4wvClpj7VdOnMDtO7P0egZj5A5e0mukyNyBPnz4tbEDZqhzEcYtqt33InUTGLFjHRwEudbG0P6FAWG-p8a8hrQR1ntuUiFOsSEI Oct 22 20:53:15.797369 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 20:53:15.797369 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 20:53:15.797369 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 20:53:15.797369 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 20:53:15.797369 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 20:53:15.797369 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 20:53:15.797369 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: 30dbbdc150694e0ebc07c63e90280d40 Oct 22 20:53:15.797369 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-629684378 Oct 22 20:53:15.797369 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 20:53:15.797369 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 20:53:15.797369 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_30dbbdc150694e0ebc07c63e90280d40"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/30dbbdc150694e0ebc07c63e90280d40"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/30dbbdc150694e0ebc07c63e90280d40"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/30dbbdc150694e0ebc07c63e90280d40"}]}] Oct 22 20:53:15.797369 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-629684378 Oct 22 20:53:15.797369 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: 30dbbdc150694e0ebc07c63e90280d40 Oct 22 20:53:15.797369 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-629684378 Oct 22 20:53:15.797369 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-ServersWithSpecificFlavorTestJSON-629684378-project Oct 22 20:53:15.797369 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 20:53:15.797369 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 20:53:15.797369 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: f9bba9ed37d7430e82e7d310982b8e47 Oct 22 20:53:15.797369 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-629684378-project Oct 22 20:53:15.797369 ncdv-master-1 devstack@n-api.service[138745]: method: > Oct 22 20:53:15.797369 ncdv-master-1 devstack@n-api.service[138745]: exception: Instance 4c53f81e-f4d8-4b41-b03a-ba9acb867226 could not be found. Oct 22 20:53:15.797369 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'id': '4c53f81e-f4d8-4b41-b03a-ba9acb867226'} Oct 22 20:53:15.797369 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:53:15.797369 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:53:15.797369 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 20:53:15.797369 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 20:53:15.797369 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 20:53:15.797369 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 20:53:15.797369 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 20:53:15.797369 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 20:53:15.797369 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 20:53:15.797369 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 20:53:15.797369 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c53f81e-f4d8-4b41-b03a-ba9acb867226 could not be found. Oct 22 20:53:15.797369 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:53:15.797369 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:53:15.797369 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:53:15.797369 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:53:15.797369 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:53:15.797369 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:53:15.797369 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:53:15.797369 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:53:15.797369 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:53:15.797369 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:53:15.797369 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 20:53:15.797369 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 20:53:15.797369 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 20:53:15.797369 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 20:53:15.797369 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 20:53:15.797369 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 20:53:15.797369 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c53f81e-f4d8-4b41-b03a-ba9acb867226 could not be found. Oct 22 20:53:15.797369 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:53:15.797369 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:53:15.803787 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:53:15.803787 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:53:15.803787 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:53:15.803787 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:53:15.803787 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 20:53:15.803787 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 20:53:15.803787 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c53f81e-f4d8-4b41-b03a-ba9acb867226 could not be found. Oct 22 20:53:15.803787 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:53:15.803787 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-35101d0a-dbb5-449a-86c0-2cebe1f7d12d tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Returning 404 to user: Instance 4c53f81e-f4d8-4b41-b03a-ba9acb867226 could not be found. {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:53:15.803787 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-35101d0a-dbb5-449a-86c0-2cebe1f7d12d tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] 10.222.0.18 "GET /compute/v2.1/servers/4c53f81e-f4d8-4b41-b03a-ba9acb867226" status: 404 len: 111 microversion: 2.1 time: 0.085865 Oct 22 20:53:15.804965 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 621/1156] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:53:15 2022] GET /compute/v2.1/servers/4c53f81e-f4d8-4b41-b03a-ba9acb867226 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 20:53:15.824659 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-d815705b-91c5-45ae-97f4-09107e0f67e3 tempest-KeyPairsNegativeTestJSON-735431762 tempest-KeyPairsNegativeTestJSON-735431762-project] Action: 'create', calling method: .version_select at 0x7fd3a4446550>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-208532931", "public_key": "ssh-rsa JUNK nova@ubuntu"}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:53:15.854436 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-d815705b-91c5-45ae-97f4-09107e0f67e3 tempest-KeyPairsNegativeTestJSON-735431762 tempest-KeyPairsNegativeTestJSON-735431762-project] Getting quotas for project da7c51c147a84e2fa88c823eefcd7459. Resources: {'key_pairs'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 20:53:15.862094 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-d815705b-91c5-45ae-97f4-09107e0f67e3 tempest-KeyPairsNegativeTestJSON-735431762 tempest-KeyPairsNegativeTestJSON-735431762-project] Getting quotas for user 0f00b393125848d89a8fdaca9588b4e5 and project da7c51c147a84e2fa88c823eefcd7459. Resources: {'key_pairs'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 20:53:15.900075 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.wsgi [None req-d815705b-91c5-45ae-97f4-09107e0f67e3 tempest-KeyPairsNegativeTestJSON-735431762 tempest-KeyPairsNegativeTestJSON-735431762-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Oct 22 20:53:15.906342 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-d815705b-91c5-45ae-97f4-09107e0f67e3 tempest-KeyPairsNegativeTestJSON-735431762 tempest-KeyPairsNegativeTestJSON-735431762-project] Request method failure captured: Oct 22 20:53:15.906342 ncdv-master-1 devstack@n-api.service[138745]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 22 20:53:15.906342 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 20:53:15.906342 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 20:53:15.906342 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 20:53:15.906342 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 117 Oct 22 20:53:15.906342 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 20:53:15.906342 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 20:53:15.906342 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 20:53:15.906342 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 20:53:15.906342 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVFg3JXNKJ4rNrVtgD9DbptJ1KaqN5WQg85q3VDjyHHRpsU33G0WSUPtO6_-YqlPS836okGDYvhI2WQuCznKfnZAQOQKhffsdV6YfMbmNh1SfdSOSkG6dxAhfL8RbcSUM7vMkuqp0ZKAjliM4j5VLb464_m8IDOIfBYuvIKHMITWddFU Oct 22 20:53:15.906342 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 20:53:15.906342 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 20:53:15.906342 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 20:53:15.906342 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 20:53:15.906342 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 20:53:15.906342 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 20:53:15.906342 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: da7c51c147a84e2fa88c823eefcd7459 Oct 22 20:53:15.906342 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-735431762 Oct 22 20:53:15.906342 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 20:53:15.906342 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 20:53:15.906342 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_da7c51c147a84e2fa88c823eefcd7459"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/da7c51c147a84e2fa88c823eefcd7459"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/da7c51c147a84e2fa88c823eefcd7459"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/da7c51c147a84e2fa88c823eefcd7459"}]}] Oct 22 20:53:15.906342 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-KeyPairsNegativeTestJSON-735431762 Oct 22 20:53:15.906342 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: da7c51c147a84e2fa88c823eefcd7459 Oct 22 20:53:15.906342 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-735431762 Oct 22 20:53:15.906342 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-KeyPairsNegativeTestJSON-735431762-project Oct 22 20:53:15.906342 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 20:53:15.906342 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 20:53:15.906342 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: 0f00b393125848d89a8fdaca9588b4e5 Oct 22 20:53:15.906342 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-KeyPairsNegativeTestJSON-735431762-project Oct 22 20:53:15.906342 ncdv-master-1 devstack@n-api.service[138745]: Oct 22 20:53:15.906342 ncdv-master-1 devstack@n-api.service[138745]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-208532931", "public_key": "ssh-rsa JUNK nova@ubuntu"}} Oct 22 20:53:15.906342 ncdv-master-1 devstack@n-api.service[138745]: method: Oct 22 20:53:15.906342 ncdv-master-1 devstack@n-api.service[138745]: exception: Keypair data is invalid: failed to generate fingerprint Oct 22 20:53:15.906342 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-208532931', 'public_key': 'ssh-rsa JUNK nova@ubuntu'}}} Oct 22 20:53:15.906342 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:53:15.906342 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:53:15.906342 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Oct 22 20:53:15.906342 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Oct 22 20:53:15.906342 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 664, in load_ssh_public_key Oct 22 20:53:15.906342 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi inner_key_type, data = _get_sshstr(data) Oct 22 20:53:15.906342 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 134, in _get_sshstr Oct 22 20:53:15.906342 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi n, data = _get_u32(data) Oct 22 20:53:15.906342 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 121, in _get_u32 Oct 22 20:53:15.906342 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid data") Oct 22 20:53:15.906342 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi ValueError: Invalid data Oct 22 20:53:15.906342 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:53:15.906342 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:53:15.906342 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:53:15.906342 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:53:15.906342 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 22 20:53:15.906342 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 22 20:53:15.906342 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 22 20:53:15.906342 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 22 20:53:15.906342 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 22 20:53:15.906342 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 22 20:53:15.906342 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 22 20:53:15.906342 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise self.value Oct 22 20:53:15.906342 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 22 20:53:15.906342 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 22 20:53:15.906342 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Oct 22 20:53:15.906342 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Oct 22 20:53:15.906342 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Oct 22 20:53:15.906342 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Oct 22 20:53:15.910418 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Oct 22 20:53:15.910418 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Oct 22 20:53:15.910418 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Oct 22 20:53:15.910418 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:53:15.910418 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:53:15.910418 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:53:15.910418 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:53:15.910418 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:53:15.910418 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:53:15.910418 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:53:15.910418 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:53:15.910418 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 22 20:53:15.910418 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 22 20:53:15.910418 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:53:15.910418 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:53:15.910418 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 20:53:15.910418 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 20:53:15.910418 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 20:53:15.910418 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 20:53:15.910418 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 22 20:53:15.910418 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 22 20:53:15.910418 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Oct 22 20:53:15.910418 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Oct 22 20:53:15.910418 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Oct 22 20:53:15.910418 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:53:15.910418 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:53:15.910418 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:53:15.910418 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:53:15.910418 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:53:15.910418 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:53:15.910418 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 20:53:15.910418 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 20:53:15.910418 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Oct 22 20:53:15.910418 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:53:15.910418 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-d815705b-91c5-45ae-97f4-09107e0f67e3 tempest-KeyPairsNegativeTestJSON-735431762 tempest-KeyPairsNegativeTestJSON-735431762-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:53:15.912898 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-d815705b-91c5-45ae-97f4-09107e0f67e3 tempest-KeyPairsNegativeTestJSON-735431762 tempest-KeyPairsNegativeTestJSON-735431762-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.102804 Oct 22 20:53:15.921269 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 622/1157] 10.222.0.18 () {60 vars in 1159 bytes} [Sat Oct 22 20:53:15 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 113 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 22 20:53:15.951234 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-551507cd-da6f-4ed4-8882-336e12865394 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:53:15.957956 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-551507cd-da6f-4ed4-8882-336e12865394 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] [instance: 69ed98a2-c208-4765-88b1-3e76a09cc481] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:53:15.965263 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-551507cd-da6f-4ed4-8882-336e12865394 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:15.965818 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-551507cd-da6f-4ed4-8882-336e12865394 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:15.966485 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-551507cd-da6f-4ed4-8882-336e12865394 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:15.967860 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-551507cd-da6f-4ed4-8882-336e12865394 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:15.969319 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-551507cd-da6f-4ed4-8882-336e12865394 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:15.970888 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-551507cd-da6f-4ed4-8882-336e12865394 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:16.495803 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-551507cd-da6f-4ed4-8882-336e12865394 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91cf84a287b74618ae1b3368785b0b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902e239d67664098895ab24340b0b780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:53:16.510311 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-551507cd-da6f-4ed4-8882-336e12865394 tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] 10.222.0.18 "GET /compute/v2.1/servers/69ed98a2-c208-4765-88b1-3e76a09cc481" status: 200 len: 1472 microversion: 2.1 time: 0.587137 Oct 22 20:53:16.510931 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 623/1158] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:53:15 2022] GET /compute/v2.1/servers/69ed98a2-c208-4765-88b1-3e76a09cc481 => generated 1472 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:53:16.524038 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-06caf21f-8a51-48ca-9321-a2624bf6583a tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:53:16.524984 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-06caf21f-8a51-48ca-9321-a2624bf6583a tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] [instance: f2f50f6b-6a3e-449f-836e-bd897f78279c] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:53:16.548176 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-06caf21f-8a51-48ca-9321-a2624bf6583a tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:16.548845 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-06caf21f-8a51-48ca-9321-a2624bf6583a tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:16.549533 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-06caf21f-8a51-48ca-9321-a2624bf6583a tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:16.550391 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-06caf21f-8a51-48ca-9321-a2624bf6583a tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:16.550905 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-06caf21f-8a51-48ca-9321-a2624bf6583a tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:16.551755 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-06caf21f-8a51-48ca-9321-a2624bf6583a tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:16.722852 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-06caf21f-8a51-48ca-9321-a2624bf6583a tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7f48d18691d4473bbe0284c44f14d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bacf9909082440f8a201771b64a75fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:53:16.732845 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-06caf21f-8a51-48ca-9321-a2624bf6583a tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] 10.222.0.18 "GET /compute/v2.1/servers/f2f50f6b-6a3e-449f-836e-bd897f78279c" status: 200 len: 1271 microversion: 2.1 time: 0.217489 Oct 22 20:53:16.739718 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 624/1159] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:53:16 2022] GET /compute/v2.1/servers/f2f50f6b-6a3e-449f-836e-bd897f78279c => generated 1271 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:53:16.744667 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-7017985a-b63f-4166-a591-a8d54649db70 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Calling method '.version_select at 0x7fd3a41701f0>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:53:16.788800 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-7017985a-b63f-4166-a591-a8d54649db70 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-621297242" status: 202 len: 0 microversion: 2.1 time: 0.047796 Oct 22 20:53:16.789705 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 625/1160] 10.222.0.18 () {58 vars in 1218 bytes} [Sat Oct 22 20:53:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-621297242 => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 20:53:16.795315 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-c4574c58-86ac-4e80-b67e-26102805c01d tempest-KeyPairsNegativeTestJSON-735431762 tempest-KeyPairsNegativeTestJSON-735431762-project] Calling method '.version_select at 0x7fd3a4366a60>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:53:16.809472 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.wsgi [None req-c4574c58-86ac-4e80-b67e-26102805c01d tempest-KeyPairsNegativeTestJSON-735431762 tempest-KeyPairsNegativeTestJSON-735431762-project] HTTP exception thrown: Keypair tempest-keypair-non-existent-1961225009 not found for user 0f00b393125848d89a8fdaca9588b4e5 Oct 22 20:53:16.812399 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-c4574c58-86ac-4e80-b67e-26102805c01d tempest-KeyPairsNegativeTestJSON-735431762 tempest-KeyPairsNegativeTestJSON-735431762-project] Request method failure captured: Oct 22 20:53:16.812399 ncdv-master-1 devstack@n-api.service[138745]: request: DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1961225009 HTTP/1.1 Oct 22 20:53:16.812399 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 20:53:16.812399 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 20:53:16.812399 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 20:53:16.812399 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 0 Oct 22 20:53:16.812399 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 20:53:16.812399 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 20:53:16.812399 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 20:53:16.812399 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 20:53:16.812399 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVFg3JXNKJ4rNrVtgD9DbptJ1KaqN5WQg85q3VDjyHHRpsU33G0WSUPtO6_-YqlPS836okGDYvhI2WQuCznKfnZAQOQKhffsdV6YfMbmNh1SfdSOSkG6dxAhfL8RbcSUM7vMkuqp0ZKAjliM4j5VLb464_m8IDOIfBYuvIKHMITWddFU Oct 22 20:53:16.812399 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 20:53:16.812399 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 20:53:16.812399 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 20:53:16.812399 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 20:53:16.812399 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 20:53:16.812399 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 20:53:16.812399 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: da7c51c147a84e2fa88c823eefcd7459 Oct 22 20:53:16.812399 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-735431762 Oct 22 20:53:16.812399 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 20:53:16.812399 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 20:53:16.812399 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_da7c51c147a84e2fa88c823eefcd7459"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/da7c51c147a84e2fa88c823eefcd7459"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/da7c51c147a84e2fa88c823eefcd7459"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/da7c51c147a84e2fa88c823eefcd7459"}]}] Oct 22 20:53:16.812399 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-KeyPairsNegativeTestJSON-735431762 Oct 22 20:53:16.812399 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: da7c51c147a84e2fa88c823eefcd7459 Oct 22 20:53:16.812399 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-735431762 Oct 22 20:53:16.812399 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-KeyPairsNegativeTestJSON-735431762-project Oct 22 20:53:16.812399 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 20:53:16.812399 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 20:53:16.812399 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: 0f00b393125848d89a8fdaca9588b4e5 Oct 22 20:53:16.812399 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-KeyPairsNegativeTestJSON-735431762-project Oct 22 20:53:16.812399 ncdv-master-1 devstack@n-api.service[138745]: method: Oct 22 20:53:16.812399 ncdv-master-1 devstack@n-api.service[138745]: exception: Keypair tempest-keypair-non-existent-1961225009 not found for user 0f00b393125848d89a8fdaca9588b4e5 Oct 22 20:53:16.812399 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'id': 'tempest-keypair-non-existent-1961225009'} Oct 22 20:53:16.812399 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:53:16.812399 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:53:16.812399 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 170, in _delete Oct 22 20:53:16.812399 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi self.api.delete_key_pair(context, user_id, id) Oct 22 20:53:16.812399 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 22 20:53:16.812399 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 22 20:53:16.812399 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 22 20:53:16.812399 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 22 20:53:16.812399 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 22 20:53:16.812399 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise self.value Oct 22 20:53:16.812399 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 22 20:53:16.812399 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 22 20:53:16.812399 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6861, in delete_key_pair Oct 22 20:53:16.812399 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi keypair = self.get_key_pair(context, user_id, key_name) Oct 22 20:53:16.812399 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6882, in get_key_pair Oct 22 20:53:16.812399 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return objects.KeyPair.get_by_name(context, user_id, key_name) Oct 22 20:53:16.812399 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 22 20:53:16.812399 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 22 20:53:16.812399 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Oct 22 20:53:16.812399 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Oct 22 20:53:16.812399 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Oct 22 20:53:16.812399 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Oct 22 20:53:16.812399 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 22 20:53:16.812399 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 22 20:53:16.812399 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Oct 22 20:53:16.812399 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Oct 22 20:53:16.812399 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-keypair-non-existent-1961225009 not found for user 0f00b393125848d89a8fdaca9588b4e5 Oct 22 20:53:16.812399 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:53:16.812399 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:53:16.816292 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:53:16.816292 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:53:16.816292 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:53:16.816292 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:53:16.816292 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:53:16.816292 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:53:16.816292 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 22 20:53:16.816292 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 22 20:53:16.816292 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 22 20:53:16.816292 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 20:53:16.816292 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:53:16.816292 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:53:16.816292 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 143, in delete Oct 22 20:53:16.816292 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi self._delete(req, id) Oct 22 20:53:16.816292 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 172, in _delete Oct 22 20:53:16.816292 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=exc.format_message()) Oct 22 20:53:16.816292 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Keypair tempest-keypair-non-existent-1961225009 not found for user 0f00b393125848d89a8fdaca9588b4e5 Oct 22 20:53:16.816292 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:53:16.816292 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:53:16.816292 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:53:16.816292 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:53:16.816292 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:53:16.816292 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:53:16.816292 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 20:53:16.816292 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 20:53:16.816292 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair tempest-keypair-non-existent-1961225009 not found for user 0f00b393125848d89a8fdaca9588b4e5 Oct 22 20:53:16.816292 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:53:16.816292 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-c4574c58-86ac-4e80-b67e-26102805c01d tempest-KeyPairsNegativeTestJSON-735431762 tempest-KeyPairsNegativeTestJSON-735431762-project] Returning 404 to user: Keypair tempest-keypair-non-existent-1961225009 not found for user 0f00b393125848d89a8fdaca9588b4e5 {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:53:16.818186 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-c4574c58-86ac-4e80-b67e-26102805c01d tempest-KeyPairsNegativeTestJSON-735431762 tempest-KeyPairsNegativeTestJSON-735431762-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1961225009" status: 404 len: 145 microversion: 2.1 time: 0.026171 Oct 22 20:53:16.819331 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 626/1161] 10.222.0.18 () {58 vars in 1260 bytes} [Sat Oct 22 20:53:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1961225009 => generated 145 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 20:53:16.832063 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-12433975-fcf3-43d1-90ac-82b860cd13be tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Calling method '.version_select at 0x7fd3a40a2160>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:53:16.889700 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-12433975-fcf3-43d1-90ac-82b860cd13be tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] 10.222.0.18 "GET /compute/v2.1/images/9585a413-1cc7-4173-a4e4-f771201c7779" status: 200 len: 1424 microversion: 2.1 time: 0.064580 Oct 22 20:53:16.890751 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 627/1162] 10.222.0.18 () {58 vars in 1233 bytes} [Sat Oct 22 20:53:16 2022] GET /compute/v2.1/images/9585a413-1cc7-4173-a4e4-f771201c7779 => generated 1424 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:53:16.903056 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-3f47f493-51c1-4ccc-8100-15b70f6650e1 req-b8678a07-bfb1-44a6-b11f-ca3765d30d60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "472bbccc-485e-43ce-a9cd-a3148bfccdbd", "name": "network-vif-plugged", "status": "completed", "tag": "23775c97-962a-4643-9a82-cfb4b15013e8"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:53:16.922262 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-3f47f493-51c1-4ccc-8100-15b70f6650e1 req-b8678a07-bfb1-44a6-b11f-ca3765d30d60 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:16.922945 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-3f47f493-51c1-4ccc-8100-15b70f6650e1 req-b8678a07-bfb1-44a6-b11f-ca3765d30d60 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:16.925609 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-3f47f493-51c1-4ccc-8100-15b70f6650e1 req-b8678a07-bfb1-44a6-b11f-ca3765d30d60 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:16.947778 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-3f47f493-51c1-4ccc-8100-15b70f6650e1 req-b8678a07-bfb1-44a6-b11f-ca3765d30d60 service nova] Creating event network-vif-plugged:23775c97-962a-4643-9a82-cfb4b15013e8 for instance 472bbccc-485e-43ce-a9cd-a3148bfccdbd on nch1-master-1 Oct 22 20:53:16.954718 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-3f47f493-51c1-4ccc-8100-15b70f6650e1 req-b8678a07-bfb1-44a6-b11f-ca3765d30d60 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062127 Oct 22 20:53:16.955236 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 628/1163] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:53:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:53:16.985272 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-4e382ae7-f614-407d-8732-de6eaec3f58c tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:53:16.986167 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-4e382ae7-f614-407d-8732-de6eaec3f58c tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] [instance: 87fe386a-f98b-46b8-86f2-993e25292785] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:53:16.993831 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4e382ae7-f614-407d-8732-de6eaec3f58c tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:16.995333 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4e382ae7-f614-407d-8732-de6eaec3f58c tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:16.995333 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4e382ae7-f614-407d-8732-de6eaec3f58c tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:16.995665 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4e382ae7-f614-407d-8732-de6eaec3f58c tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:16.996075 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4e382ae7-f614-407d-8732-de6eaec3f58c tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:16.996679 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4e382ae7-f614-407d-8732-de6eaec3f58c tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:17.026785 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-4e382ae7-f614-407d-8732-de6eaec3f58c tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] [instance: 87fe386a-f98b-46b8-86f2-993e25292785] Going to try to terminate instance {{(pid=138745) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 20:53:17.137862 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-4e382ae7-f614-407d-8732-de6eaec3f58c tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] 10.222.0.18 "DELETE /compute/v2.1/servers/87fe386a-f98b-46b8-86f2-993e25292785" status: 204 len: 0 microversion: 2.1 time: 0.153929 Oct 22 20:53:17.138952 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 629/1164] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 20:53:16 2022] DELETE /compute/v2.1/servers/87fe386a-f98b-46b8-86f2-993e25292785 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 22 20:53:17.148078 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-0f677f1f-2247-4973-8b3b-878a19a512b0 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:53:17.149076 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-0f677f1f-2247-4973-8b3b-878a19a512b0 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] [instance: 87fe386a-f98b-46b8-86f2-993e25292785] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:53:17.156176 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0f677f1f-2247-4973-8b3b-878a19a512b0 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:17.156965 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0f677f1f-2247-4973-8b3b-878a19a512b0 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:17.157557 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0f677f1f-2247-4973-8b3b-878a19a512b0 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:17.158519 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0f677f1f-2247-4973-8b3b-878a19a512b0 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:17.159143 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0f677f1f-2247-4973-8b3b-878a19a512b0 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:17.159936 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0f677f1f-2247-4973-8b3b-878a19a512b0 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:17.850223 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-0f677f1f-2247-4973-8b3b-878a19a512b0 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34f8af8ee2b545bead90fffd6c6c4896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48413ed1ac4e1ea65fb38f097881db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:53:17.871520 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-0f677f1f-2247-4973-8b3b-878a19a512b0 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] 10.222.0.18 "GET /compute/v2.1/servers/87fe386a-f98b-46b8-86f2-993e25292785" status: 200 len: 1513 microversion: 2.1 time: 0.722445 Oct 22 20:53:17.883369 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 630/1165] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:53:17 2022] GET /compute/v2.1/servers/87fe386a-f98b-46b8-86f2-993e25292785 => generated 1513 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:53:17.884157 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-d3855955-292a-48c7-b0dd-0b005fba9dbb tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:53:17.884665 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-d3855955-292a-48c7-b0dd-0b005fba9dbb tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] [instance: 69ed98a2-c208-4765-88b1-3e76a09cc481] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:53:17.896500 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d3855955-292a-48c7-b0dd-0b005fba9dbb tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:17.897107 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d3855955-292a-48c7-b0dd-0b005fba9dbb tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:17.897595 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d3855955-292a-48c7-b0dd-0b005fba9dbb tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:17.902081 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d3855955-292a-48c7-b0dd-0b005fba9dbb tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:17.902190 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d3855955-292a-48c7-b0dd-0b005fba9dbb tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:17.911395 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d3855955-292a-48c7-b0dd-0b005fba9dbb tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:17.935043 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-b8ed320a-6485-43b5-b7bc-fe9450bb4446 tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] 10.222.0.18 "POST /compute/v2.1/servers/4c7b99a9-2ec4-4f4b-98e7-8e1ea2103735/action" status: 202 len: 0 microversion: 2.25 time: 4.109753 Oct 22 20:53:17.938831 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 536/1166] 10.222.0.18 () {62 vars in 1319 bytes} [Sat Oct 22 20:53:13 2022] POST /compute/v2.1/servers/4c7b99a9-2ec4-4f4b-98e7-8e1ea2103735/action => generated 0 bytes in 4111 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 22 20:53:17.942378 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-006f4a23-07b4-4481-8013-7acdbe6605df tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:53:17.944159 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-006f4a23-07b4-4481-8013-7acdbe6605df tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] [instance: f2f50f6b-6a3e-449f-836e-bd897f78279c] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:53:17.958359 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-006f4a23-07b4-4481-8013-7acdbe6605df tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:17.958949 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-006f4a23-07b4-4481-8013-7acdbe6605df tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:17.959627 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-006f4a23-07b4-4481-8013-7acdbe6605df tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:17.960366 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-006f4a23-07b4-4481-8013-7acdbe6605df tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:17.960884 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-006f4a23-07b4-4481-8013-7acdbe6605df tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:17.961376 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-006f4a23-07b4-4481-8013-7acdbe6605df tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:18.140726 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-d3855955-292a-48c7-b0dd-0b005fba9dbb tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91cf84a287b74618ae1b3368785b0b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902e239d67664098895ab24340b0b780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:53:18.152245 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-d3855955-292a-48c7-b0dd-0b005fba9dbb tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] 10.222.0.18 "GET /compute/v2.1/servers/69ed98a2-c208-4765-88b1-3e76a09cc481" status: 200 len: 1302 microversion: 2.1 time: 0.278186 Oct 22 20:53:18.168930 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 631/1167] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:53:17 2022] GET /compute/v2.1/servers/69ed98a2-c208-4765-88b1-3e76a09cc481 => generated 1302 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:53:18.176895 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-a8c8b566-f8d1-4d5e-b3c3-bfff1e344335 req-7ab69fd4-63ce-46c6-9fb4-cd1bdcf10326 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69ed98a2-c208-4765-88b1-3e76a09cc481", "name": "network-vif-deleted", "tag": "e967f24f-34ec-4633-8022-8dac0a05409f"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:53:18.195831 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-a8c8b566-f8d1-4d5e-b3c3-bfff1e344335 req-7ab69fd4-63ce-46c6-9fb4-cd1bdcf10326 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:18.196475 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-a8c8b566-f8d1-4d5e-b3c3-bfff1e344335 req-7ab69fd4-63ce-46c6-9fb4-cd1bdcf10326 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:18.196884 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-a8c8b566-f8d1-4d5e-b3c3-bfff1e344335 req-7ab69fd4-63ce-46c6-9fb4-cd1bdcf10326 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:18.216300 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-a8c8b566-f8d1-4d5e-b3c3-bfff1e344335 req-7ab69fd4-63ce-46c6-9fb4-cd1bdcf10326 service nova] Creating event network-vif-deleted:e967f24f-34ec-4633-8022-8dac0a05409f for instance 69ed98a2-c208-4765-88b1-3e76a09cc481 on nch1-master-1 Oct 22 20:53:18.224784 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-a8c8b566-f8d1-4d5e-b3c3-bfff1e344335 req-7ab69fd4-63ce-46c6-9fb4-cd1bdcf10326 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053332 Oct 22 20:53:18.227065 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 632/1168] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:53:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:53:18.235565 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-b5466f84-040d-4fa4-91fc-a239986928bb tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Calling method '.version_select at 0x7fd3a4266700>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:53:18.244796 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-006f4a23-07b4-4481-8013-7acdbe6605df tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7f48d18691d4473bbe0284c44f14d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bacf9909082440f8a201771b64a75fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:53:18.261699 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-006f4a23-07b4-4481-8013-7acdbe6605df tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] 10.222.0.18 "GET /compute/v2.1/servers/f2f50f6b-6a3e-449f-836e-bd897f78279c" status: 200 len: 1313 microversion: 2.1 time: 0.324553 Oct 22 20:53:18.275520 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 537/1169] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:53:17 2022] GET /compute/v2.1/servers/f2f50f6b-6a3e-449f-836e-bd897f78279c => generated 1313 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:53:18.280326 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-b85759be-60ee-4b23-bb0a-36ea7318e7f9 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:53:18.281023 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-b85759be-60ee-4b23-bb0a-36ea7318e7f9 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] [instance: 4c7b99a9-2ec4-4f4b-98e7-8e1ea2103735] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:53:18.288722 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b85759be-60ee-4b23-bb0a-36ea7318e7f9 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:18.289111 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b85759be-60ee-4b23-bb0a-36ea7318e7f9 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:18.289841 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b85759be-60ee-4b23-bb0a-36ea7318e7f9 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:18.290901 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b85759be-60ee-4b23-bb0a-36ea7318e7f9 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:18.291393 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b85759be-60ee-4b23-bb0a-36ea7318e7f9 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:18.291832 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b85759be-60ee-4b23-bb0a-36ea7318e7f9 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:18.356230 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-b5466f84-040d-4fa4-91fc-a239986928bb tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] 10.222.0.18 "GET /compute/v2.1/images/9585a413-1cc7-4173-a4e4-f771201c7779" status: 200 len: 1424 microversion: 2.1 time: 0.127621 Oct 22 20:53:18.360459 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 633/1170] 10.222.0.18 () {58 vars in 1233 bytes} [Sat Oct 22 20:53:18 2022] GET /compute/v2.1/images/9585a413-1cc7-4173-a4e4-f771201c7779 => generated 1424 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:53:18.602717 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-b85759be-60ee-4b23-bb0a-36ea7318e7f9 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:53:18.617253 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-b85759be-60ee-4b23-bb0a-36ea7318e7f9 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:53:18.619775 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-b85759be-60ee-4b23-bb0a-36ea7318e7f9 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:53:18.621219 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-b85759be-60ee-4b23-bb0a-36ea7318e7f9 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] 10.222.0.18 "GET /compute/v2.1/servers/4c7b99a9-2ec4-4f4b-98e7-8e1ea2103735" status: 200 len: 1812 microversion: 2.25 time: 0.346568 Oct 22 20:53:18.622256 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 538/1171] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 20:53:18 2022] GET /compute/v2.1/servers/4c7b99a9-2ec4-4f4b-98e7-8e1ea2103735 => generated 1812 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 20:53:18.778145 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-d9e9d357-e18a-4713-80f5-60b50cedae88 tempest-ServersWithSpecificFlavorTestJSON-1796401636 tempest-ServersWithSpecificFlavorTestJSON-1796401636-project-admin] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:53:18.854764 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-d9e9d357-e18a-4713-80f5-60b50cedae88 tempest-ServersWithSpecificFlavorTestJSON-1796401636 tempest-ServersWithSpecificFlavorTestJSON-1796401636-project-admin] 10.222.0.18 "DELETE /compute/v2.1/flavors/2046857660" status: 202 len: 0 microversion: 2.1 time: 0.082674 Oct 22 20:53:18.864511 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-2bb5324d-4746-4942-82b5-0536425c68dd tempest-ServersWithSpecificFlavorTestJSON-1796401636 tempest-ServersWithSpecificFlavorTestJSON-1796401636-project-admin] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:53:18.883787 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 634/1172] 10.222.0.18 () {58 vars in 1161 bytes} [Sat Oct 22 20:53:18 2022] DELETE /compute/v2.1/flavors/2046857660 => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 20:53:18.898169 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-c87f1b35-de0a-41c3-b95f-3e13dfaa596b tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:53:18.905321 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-c87f1b35-de0a-41c3-b95f-3e13dfaa596b tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] [instance: 87fe386a-f98b-46b8-86f2-993e25292785] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:53:18.921581 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-2bb5324d-4746-4942-82b5-0536425c68dd tempest-ServersWithSpecificFlavorTestJSON-1796401636 tempest-ServersWithSpecificFlavorTestJSON-1796401636-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 5406 microversion: 2.1 time: 0.059988 Oct 22 20:53:18.922206 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 539/1173] 10.222.0.18 () {58 vars in 1146 bytes} [Sat Oct 22 20:53:18 2022] GET /compute/v2.1/flavors/detail => generated 5406 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:53:18.943998 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c87f1b35-de0a-41c3-b95f-3e13dfaa596b tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:18.946734 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-4874deea-941f-4749-8138-a258ec6c2629 tempest-ServersWithSpecificFlavorTestJSON-1796401636 tempest-ServersWithSpecificFlavorTestJSON-1796401636-project-admin] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:53:18.949041 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c87f1b35-de0a-41c3-b95f-3e13dfaa596b tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:18.950230 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c87f1b35-de0a-41c3-b95f-3e13dfaa596b tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:18.953506 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c87f1b35-de0a-41c3-b95f-3e13dfaa596b tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:18.955308 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c87f1b35-de0a-41c3-b95f-3e13dfaa596b tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:18.966061 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c87f1b35-de0a-41c3-b95f-3e13dfaa596b tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:18.986537 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-4874deea-941f-4749-8138-a258ec6c2629 tempest-ServersWithSpecificFlavorTestJSON-1796401636 tempest-ServersWithSpecificFlavorTestJSON-1796401636-project-admin] 10.222.0.18 "DELETE /compute/v2.1/flavors/2037618959" status: 202 len: 0 microversion: 2.1 time: 0.047407 Oct 22 20:53:18.987448 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 540/1174] 10.222.0.18 () {58 vars in 1161 bytes} [Sat Oct 22 20:53:18 2022] DELETE /compute/v2.1/flavors/2037618959 => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 20:53:18.999009 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-e079b880-caae-4aef-af75-9d9eeb5fd11f tempest-ServersWithSpecificFlavorTestJSON-1796401636 tempest-ServersWithSpecificFlavorTestJSON-1796401636-project-admin] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:53:19.026951 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-e079b880-caae-4aef-af75-9d9eeb5fd11f tempest-ServersWithSpecificFlavorTestJSON-1796401636 tempest-ServersWithSpecificFlavorTestJSON-1796401636-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.034796 Oct 22 20:53:19.027864 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 541/1175] 10.222.0.18 () {58 vars in 1146 bytes} [Sat Oct 22 20:53:18 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:53:19.064851 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-9aaed636-bfab-44db-a972-21b9eaace9d3 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:53:19.065658 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-9aaed636-bfab-44db-a972-21b9eaace9d3 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] [instance: fa364234-023c-491a-bc88-97c048f6f0e2] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:53:19.074184 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9aaed636-bfab-44db-a972-21b9eaace9d3 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:19.074859 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9aaed636-bfab-44db-a972-21b9eaace9d3 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:19.075509 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9aaed636-bfab-44db-a972-21b9eaace9d3 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:19.076409 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9aaed636-bfab-44db-a972-21b9eaace9d3 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:19.077032 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9aaed636-bfab-44db-a972-21b9eaace9d3 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:19.078026 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9aaed636-bfab-44db-a972-21b9eaace9d3 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:19.120544 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-9aaed636-bfab-44db-a972-21b9eaace9d3 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] HTTP exception thrown: Instance fa364234-023c-491a-bc88-97c048f6f0e2 could not be found. Oct 22 20:53:19.122363 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-9aaed636-bfab-44db-a972-21b9eaace9d3 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Request method failure captured: Oct 22 20:53:19.122363 ncdv-master-1 devstack@n-api.service[138744]: request: DELETE /compute/v2.1/servers/fa364234-023c-491a-bc88-97c048f6f0e2 HTTP/1.1 Oct 22 20:53:19.122363 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 20:53:19.122363 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 20:53:19.122363 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 20:53:19.122363 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 0 Oct 22 20:53:19.122363 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 20:53:19.122363 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 20:53:19.122363 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 20:53:19.122363 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 20:53:19.122363 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVFdofXvJrSgjWpq-1isQhmgvdybS2tM0l8K04eElU-t1KAMj6H6Ujb1kYrO3fejFqrejK4vomxDY4wvClpj7VdOnMDtO7P0egZj5A5e0mukyNyBPnz4tbEDZqhzEcYtqt33InUTGLFjHRwEudbG0P6FAWG-p8a8hrQR1ntuUiFOsSEI Oct 22 20:53:19.122363 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 20:53:19.122363 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 20:53:19.122363 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 20:53:19.122363 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 20:53:19.122363 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 20:53:19.122363 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 20:53:19.122363 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: 30dbbdc150694e0ebc07c63e90280d40 Oct 22 20:53:19.122363 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-629684378 Oct 22 20:53:19.122363 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 20:53:19.122363 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 20:53:19.122363 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_30dbbdc150694e0ebc07c63e90280d40"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/30dbbdc150694e0ebc07c63e90280d40"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/30dbbdc150694e0ebc07c63e90280d40"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/30dbbdc150694e0ebc07c63e90280d40"}]}] Oct 22 20:53:19.122363 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-629684378 Oct 22 20:53:19.122363 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: 30dbbdc150694e0ebc07c63e90280d40 Oct 22 20:53:19.122363 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-629684378 Oct 22 20:53:19.122363 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-ServersWithSpecificFlavorTestJSON-629684378-project Oct 22 20:53:19.122363 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 20:53:19.122363 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 20:53:19.122363 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: f9bba9ed37d7430e82e7d310982b8e47 Oct 22 20:53:19.122363 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-629684378-project Oct 22 20:53:19.122363 ncdv-master-1 devstack@n-api.service[138744]: method: > Oct 22 20:53:19.122363 ncdv-master-1 devstack@n-api.service[138744]: exception: Instance fa364234-023c-491a-bc88-97c048f6f0e2 could not be found. Oct 22 20:53:19.122363 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': 'fa364234-023c-491a-bc88-97c048f6f0e2'} Oct 22 20:53:19.122363 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:53:19.122363 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:53:19.122363 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 20:53:19.122363 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 20:53:19.122363 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 20:53:19.122363 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 20:53:19.122363 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 20:53:19.122363 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 20:53:19.122363 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 20:53:19.122363 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 20:53:19.122363 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fa364234-023c-491a-bc88-97c048f6f0e2 could not be found. Oct 22 20:53:19.122363 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:53:19.122363 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:53:19.122363 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:53:19.122363 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:53:19.122363 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:53:19.122363 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:53:19.122363 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:53:19.122363 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:53:19.122363 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:53:19.122363 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:53:19.122363 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 22 20:53:19.122363 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 22 20:53:19.122363 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 22 20:53:19.122363 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 22 20:53:19.122363 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 20:53:19.122363 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 20:53:19.122363 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 20:53:19.122363 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 20:53:19.126256 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa364234-023c-491a-bc88-97c048f6f0e2 could not be found. Oct 22 20:53:19.126256 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:53:19.126256 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:53:19.126256 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:53:19.126256 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:53:19.126256 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:53:19.126256 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:53:19.126256 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 20:53:19.126256 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 20:53:19.126256 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa364234-023c-491a-bc88-97c048f6f0e2 could not be found. Oct 22 20:53:19.126256 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:53:19.129422 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-9aaed636-bfab-44db-a972-21b9eaace9d3 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Returning 404 to user: Instance fa364234-023c-491a-bc88-97c048f6f0e2 could not be found. {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:53:19.131873 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-9aaed636-bfab-44db-a972-21b9eaace9d3 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] 10.222.0.18 "DELETE /compute/v2.1/servers/fa364234-023c-491a-bc88-97c048f6f0e2" status: 404 len: 111 microversion: 2.1 time: 0.072887 Oct 22 20:53:19.139107 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 542/1176] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 20:53:19 2022] DELETE /compute/v2.1/servers/fa364234-023c-491a-bc88-97c048f6f0e2 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 20:53:19.144820 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-7c7bc3d6-ae7f-450c-bc85-fd2c9f5a09d8 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:53:19.145776 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-7c7bc3d6-ae7f-450c-bc85-fd2c9f5a09d8 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] [instance: fa364234-023c-491a-bc88-97c048f6f0e2] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:53:19.155008 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7c7bc3d6-ae7f-450c-bc85-fd2c9f5a09d8 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:19.167719 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7c7bc3d6-ae7f-450c-bc85-fd2c9f5a09d8 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:19.174464 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7c7bc3d6-ae7f-450c-bc85-fd2c9f5a09d8 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:19.175039 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7c7bc3d6-ae7f-450c-bc85-fd2c9f5a09d8 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:19.176055 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7c7bc3d6-ae7f-450c-bc85-fd2c9f5a09d8 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:19.178355 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7c7bc3d6-ae7f-450c-bc85-fd2c9f5a09d8 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:19.205357 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-7c7bc3d6-ae7f-450c-bc85-fd2c9f5a09d8 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] HTTP exception thrown: Instance fa364234-023c-491a-bc88-97c048f6f0e2 could not be found. Oct 22 20:53:19.207760 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-7c7bc3d6-ae7f-450c-bc85-fd2c9f5a09d8 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Request method failure captured: Oct 22 20:53:19.207760 ncdv-master-1 devstack@n-api.service[138744]: request: GET /compute/v2.1/servers/fa364234-023c-491a-bc88-97c048f6f0e2 HTTP/1.1 Oct 22 20:53:19.207760 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 20:53:19.207760 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 20:53:19.207760 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 20:53:19.207760 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 0 Oct 22 20:53:19.207760 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 20:53:19.207760 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 20:53:19.207760 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 20:53:19.207760 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 20:53:19.207760 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVFdofXvJrSgjWpq-1isQhmgvdybS2tM0l8K04eElU-t1KAMj6H6Ujb1kYrO3fejFqrejK4vomxDY4wvClpj7VdOnMDtO7P0egZj5A5e0mukyNyBPnz4tbEDZqhzEcYtqt33InUTGLFjHRwEudbG0P6FAWG-p8a8hrQR1ntuUiFOsSEI Oct 22 20:53:19.207760 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 20:53:19.207760 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 20:53:19.207760 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 20:53:19.207760 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 20:53:19.207760 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 20:53:19.207760 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 20:53:19.207760 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: 30dbbdc150694e0ebc07c63e90280d40 Oct 22 20:53:19.207760 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-629684378 Oct 22 20:53:19.207760 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 20:53:19.207760 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 20:53:19.207760 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_30dbbdc150694e0ebc07c63e90280d40"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/30dbbdc150694e0ebc07c63e90280d40"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/30dbbdc150694e0ebc07c63e90280d40"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/30dbbdc150694e0ebc07c63e90280d40"}]}] Oct 22 20:53:19.207760 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-629684378 Oct 22 20:53:19.207760 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: 30dbbdc150694e0ebc07c63e90280d40 Oct 22 20:53:19.207760 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-629684378 Oct 22 20:53:19.207760 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-ServersWithSpecificFlavorTestJSON-629684378-project Oct 22 20:53:19.207760 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 20:53:19.207760 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 20:53:19.207760 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: f9bba9ed37d7430e82e7d310982b8e47 Oct 22 20:53:19.207760 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-629684378-project Oct 22 20:53:19.207760 ncdv-master-1 devstack@n-api.service[138744]: method: > Oct 22 20:53:19.207760 ncdv-master-1 devstack@n-api.service[138744]: exception: Instance fa364234-023c-491a-bc88-97c048f6f0e2 could not be found. Oct 22 20:53:19.207760 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': 'fa364234-023c-491a-bc88-97c048f6f0e2'} Oct 22 20:53:19.207760 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:53:19.207760 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:53:19.207760 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 20:53:19.207760 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 20:53:19.207760 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 20:53:19.207760 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 20:53:19.207760 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 20:53:19.207760 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 20:53:19.207760 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 20:53:19.207760 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 20:53:19.207760 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fa364234-023c-491a-bc88-97c048f6f0e2 could not be found. Oct 22 20:53:19.207760 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:53:19.207760 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:53:19.207760 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:53:19.207760 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:53:19.207760 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:53:19.207760 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:53:19.207760 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:53:19.207760 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:53:19.207760 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:53:19.207760 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:53:19.207760 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 20:53:19.207760 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 20:53:19.207760 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 20:53:19.207760 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 20:53:19.207760 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 20:53:19.207760 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 20:53:19.207760 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa364234-023c-491a-bc88-97c048f6f0e2 could not be found. Oct 22 20:53:19.207760 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:53:19.207760 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:53:19.211889 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:53:19.211889 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:53:19.211889 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:53:19.211889 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:53:19.211889 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 20:53:19.211889 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 20:53:19.211889 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa364234-023c-491a-bc88-97c048f6f0e2 could not be found. Oct 22 20:53:19.211889 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:53:19.215752 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-7c7bc3d6-ae7f-450c-bc85-fd2c9f5a09d8 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Returning 404 to user: Instance fa364234-023c-491a-bc88-97c048f6f0e2 could not be found. {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:53:19.217143 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-7c7bc3d6-ae7f-450c-bc85-fd2c9f5a09d8 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] 10.222.0.18 "GET /compute/v2.1/servers/fa364234-023c-491a-bc88-97c048f6f0e2" status: 404 len: 111 microversion: 2.1 time: 0.076687 Oct 22 20:53:19.217867 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 543/1177] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:53:19 2022] GET /compute/v2.1/servers/fa364234-023c-491a-bc88-97c048f6f0e2 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 20:53:19.229238 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-87568409-237c-4af5-96d3-d913a17d20cb tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:53:19.230617 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-87568409-237c-4af5-96d3-d913a17d20cb tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] [instance: 69ed98a2-c208-4765-88b1-3e76a09cc481] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:53:19.238804 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-87568409-237c-4af5-96d3-d913a17d20cb tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:19.242431 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-87568409-237c-4af5-96d3-d913a17d20cb tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:19.243171 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-87568409-237c-4af5-96d3-d913a17d20cb tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:19.244115 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-87568409-237c-4af5-96d3-d913a17d20cb tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:19.244779 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-87568409-237c-4af5-96d3-d913a17d20cb tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:19.245570 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-87568409-237c-4af5-96d3-d913a17d20cb tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:19.272619 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-87568409-237c-4af5-96d3-d913a17d20cb tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] HTTP exception thrown: Instance 69ed98a2-c208-4765-88b1-3e76a09cc481 could not be found. Oct 22 20:53:19.274567 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-87568409-237c-4af5-96d3-d913a17d20cb tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Request method failure captured: Oct 22 20:53:19.274567 ncdv-master-1 devstack@n-api.service[138744]: request: GET /compute/v2.1/servers/69ed98a2-c208-4765-88b1-3e76a09cc481 HTTP/1.1 Oct 22 20:53:19.274567 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 20:53:19.274567 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 20:53:19.274567 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 20:53:19.274567 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 0 Oct 22 20:53:19.274567 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 20:53:19.274567 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 20:53:19.274567 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 20:53:19.274567 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 20:53:19.274567 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVFeL5NpvaUPvqiDt8qD72HqMh0DrXz0UtoQAeO42jMFpMPYqVC0YFDMA438gQzhAHNDHcP5InOc3xi8IB_k6cXq3If0lWEwoKo4DiRlB10MzTtg6EzpKpbfTqN9Yi6nvd2u_6U9lIt3lLKhkPDkM5OdhEDFJSGZOTF7Z9mtdL7wRjmc Oct 22 20:53:19.274567 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 20:53:19.274567 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 20:53:19.274567 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 20:53:19.274567 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 20:53:19.274567 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 20:53:19.274567 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 20:53:19.274567 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: 902e239d67664098895ab24340b0b780 Oct 22 20:53:19.274567 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-ServersOnMultiNodesTest-2081149331 Oct 22 20:53:19.274567 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 20:53:19.274567 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 20:53:19.274567 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_902e239d67664098895ab24340b0b780"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/902e239d67664098895ab24340b0b780"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/902e239d67664098895ab24340b0b780"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/902e239d67664098895ab24340b0b780"}]}] Oct 22 20:53:19.274567 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-ServersOnMultiNodesTest-2081149331 Oct 22 20:53:19.274567 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: 902e239d67664098895ab24340b0b780 Oct 22 20:53:19.274567 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-2081149331 Oct 22 20:53:19.274567 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-ServersOnMultiNodesTest-2081149331-project Oct 22 20:53:19.274567 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 20:53:19.274567 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 20:53:19.274567 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: 91cf84a287b74618ae1b3368785b0b4c Oct 22 20:53:19.274567 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-ServersOnMultiNodesTest-2081149331-project Oct 22 20:53:19.274567 ncdv-master-1 devstack@n-api.service[138744]: method: > Oct 22 20:53:19.274567 ncdv-master-1 devstack@n-api.service[138744]: exception: Instance 69ed98a2-c208-4765-88b1-3e76a09cc481 could not be found. Oct 22 20:53:19.274567 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': '69ed98a2-c208-4765-88b1-3e76a09cc481'} Oct 22 20:53:19.274567 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:53:19.274567 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:53:19.274567 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 20:53:19.274567 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 20:53:19.274567 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 20:53:19.274567 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 20:53:19.274567 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 20:53:19.274567 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 20:53:19.274567 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 20:53:19.274567 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 20:53:19.274567 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69ed98a2-c208-4765-88b1-3e76a09cc481 could not be found. Oct 22 20:53:19.274567 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:53:19.274567 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:53:19.274567 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:53:19.274567 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:53:19.274567 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:53:19.274567 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:53:19.274567 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:53:19.274567 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:53:19.274567 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:53:19.274567 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:53:19.274567 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 20:53:19.274567 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 20:53:19.274567 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 20:53:19.274567 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 20:53:19.274567 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 20:53:19.274567 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 20:53:19.274567 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69ed98a2-c208-4765-88b1-3e76a09cc481 could not be found. Oct 22 20:53:19.274567 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:53:19.274567 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:53:19.274567 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:53:19.279252 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:53:19.279252 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:53:19.279252 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:53:19.279252 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 20:53:19.279252 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 20:53:19.279252 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69ed98a2-c208-4765-88b1-3e76a09cc481 could not be found. Oct 22 20:53:19.279252 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:53:19.279252 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-87568409-237c-4af5-96d3-d913a17d20cb tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] Returning 404 to user: Instance 69ed98a2-c208-4765-88b1-3e76a09cc481 could not be found. {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:53:19.282456 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-87568409-237c-4af5-96d3-d913a17d20cb tempest-ServersOnMultiNodesTest-2081149331 tempest-ServersOnMultiNodesTest-2081149331-project] 10.222.0.18 "GET /compute/v2.1/servers/69ed98a2-c208-4765-88b1-3e76a09cc481" status: 404 len: 111 microversion: 2.1 time: 0.058103 Oct 22 20:53:19.282456 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 544/1178] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:53:19 2022] GET /compute/v2.1/servers/69ed98a2-c208-4765-88b1-3e76a09cc481 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 20:53:19.287204 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-b42f5cf5-c852-4ca8-9ed2-2e75a2945859 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:53:19.287832 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-b42f5cf5-c852-4ca8-9ed2-2e75a2945859 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] [instance: 4c53f81e-f4d8-4b41-b03a-ba9acb867226] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:53:19.296550 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b42f5cf5-c852-4ca8-9ed2-2e75a2945859 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:19.297199 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b42f5cf5-c852-4ca8-9ed2-2e75a2945859 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:19.297835 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b42f5cf5-c852-4ca8-9ed2-2e75a2945859 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:19.299236 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b42f5cf5-c852-4ca8-9ed2-2e75a2945859 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:19.301229 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b42f5cf5-c852-4ca8-9ed2-2e75a2945859 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:19.302425 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b42f5cf5-c852-4ca8-9ed2-2e75a2945859 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:19.311395 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:53:19.325178 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-b42f5cf5-c852-4ca8-9ed2-2e75a2945859 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] HTTP exception thrown: Instance 4c53f81e-f4d8-4b41-b03a-ba9acb867226 could not be found. Oct 22 20:53:19.327389 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-b42f5cf5-c852-4ca8-9ed2-2e75a2945859 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Request method failure captured: Oct 22 20:53:19.327389 ncdv-master-1 devstack@n-api.service[138744]: request: DELETE /compute/v2.1/servers/4c53f81e-f4d8-4b41-b03a-ba9acb867226 HTTP/1.1 Oct 22 20:53:19.327389 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 20:53:19.327389 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 20:53:19.327389 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 20:53:19.327389 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 0 Oct 22 20:53:19.327389 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 20:53:19.327389 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 20:53:19.327389 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 20:53:19.327389 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 20:53:19.327389 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVFdofXvJrSgjWpq-1isQhmgvdybS2tM0l8K04eElU-t1KAMj6H6Ujb1kYrO3fejFqrejK4vomxDY4wvClpj7VdOnMDtO7P0egZj5A5e0mukyNyBPnz4tbEDZqhzEcYtqt33InUTGLFjHRwEudbG0P6FAWG-p8a8hrQR1ntuUiFOsSEI Oct 22 20:53:19.327389 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 20:53:19.327389 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 20:53:19.327389 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 20:53:19.327389 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 20:53:19.327389 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 20:53:19.327389 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 20:53:19.327389 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: 30dbbdc150694e0ebc07c63e90280d40 Oct 22 20:53:19.327389 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-629684378 Oct 22 20:53:19.327389 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 20:53:19.327389 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 20:53:19.327389 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_30dbbdc150694e0ebc07c63e90280d40"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/30dbbdc150694e0ebc07c63e90280d40"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/30dbbdc150694e0ebc07c63e90280d40"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/30dbbdc150694e0ebc07c63e90280d40"}]}] Oct 22 20:53:19.327389 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-629684378 Oct 22 20:53:19.327389 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: 30dbbdc150694e0ebc07c63e90280d40 Oct 22 20:53:19.327389 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-629684378 Oct 22 20:53:19.327389 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-ServersWithSpecificFlavorTestJSON-629684378-project Oct 22 20:53:19.327389 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 20:53:19.327389 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 20:53:19.327389 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: f9bba9ed37d7430e82e7d310982b8e47 Oct 22 20:53:19.327389 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-629684378-project Oct 22 20:53:19.327389 ncdv-master-1 devstack@n-api.service[138744]: method: > Oct 22 20:53:19.327389 ncdv-master-1 devstack@n-api.service[138744]: exception: Instance 4c53f81e-f4d8-4b41-b03a-ba9acb867226 could not be found. Oct 22 20:53:19.327389 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': '4c53f81e-f4d8-4b41-b03a-ba9acb867226'} Oct 22 20:53:19.327389 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:53:19.327389 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:53:19.327389 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 20:53:19.327389 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 20:53:19.327389 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 20:53:19.327389 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 20:53:19.327389 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 20:53:19.327389 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 20:53:19.327389 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 20:53:19.327389 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 20:53:19.327389 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c53f81e-f4d8-4b41-b03a-ba9acb867226 could not be found. Oct 22 20:53:19.327389 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:53:19.327389 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:53:19.327389 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:53:19.327389 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:53:19.327389 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:53:19.327389 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:53:19.327389 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:53:19.327389 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:53:19.327389 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:53:19.327389 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:53:19.327389 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 22 20:53:19.327389 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 22 20:53:19.327389 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 22 20:53:19.327389 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 22 20:53:19.327389 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 20:53:19.327389 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 20:53:19.327389 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 20:53:19.327389 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 20:53:19.332411 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c53f81e-f4d8-4b41-b03a-ba9acb867226 could not be found. Oct 22 20:53:19.332411 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:53:19.332411 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:53:19.332411 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:53:19.332411 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:53:19.332411 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:53:19.332411 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:53:19.332411 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 20:53:19.332411 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 20:53:19.332411 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c53f81e-f4d8-4b41-b03a-ba9acb867226 could not be found. Oct 22 20:53:19.332411 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:53:19.332411 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-b42f5cf5-c852-4ca8-9ed2-2e75a2945859 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Returning 404 to user: Instance 4c53f81e-f4d8-4b41-b03a-ba9acb867226 could not be found. {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:53:19.335610 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-b42f5cf5-c852-4ca8-9ed2-2e75a2945859 tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] 10.222.0.18 "DELETE /compute/v2.1/servers/4c53f81e-f4d8-4b41-b03a-ba9acb867226" status: 404 len: 111 microversion: 2.1 time: 0.050767 Oct 22 20:53:19.335610 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 545/1179] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 20:53:19 2022] DELETE /compute/v2.1/servers/4c53f81e-f4d8-4b41-b03a-ba9acb867226 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 20:53:19.340328 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-4441233f-caa3-4313-a721-8a21bab12fe6 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:53:19.341487 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-4441233f-caa3-4313-a721-8a21bab12fe6 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] [instance: f2f50f6b-6a3e-449f-836e-bd897f78279c] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:53:19.349446 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4441233f-caa3-4313-a721-8a21bab12fe6 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:19.350188 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4441233f-caa3-4313-a721-8a21bab12fe6 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:19.350775 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4441233f-caa3-4313-a721-8a21bab12fe6 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:19.351977 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4441233f-caa3-4313-a721-8a21bab12fe6 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:19.352533 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4441233f-caa3-4313-a721-8a21bab12fe6 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:19.353061 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4441233f-caa3-4313-a721-8a21bab12fe6 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:19.595128 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-c87f1b35-de0a-41c3-b95f-3e13dfaa596b tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34f8af8ee2b545bead90fffd6c6c4896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48413ed1ac4e1ea65fb38f097881db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:53:19.609841 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-c87f1b35-de0a-41c3-b95f-3e13dfaa596b tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] 10.222.0.18 "GET /compute/v2.1/servers/87fe386a-f98b-46b8-86f2-993e25292785" status: 200 len: 1513 microversion: 2.1 time: 0.715291 Oct 22 20:53:19.610454 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 635/1180] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:53:18 2022] GET /compute/v2.1/servers/87fe386a-f98b-46b8-86f2-993e25292785 => generated 1513 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 20:53:19.625589 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-4f2bf666-b1f9-40b5-9060-dba47f3c87cc tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:53:19.626383 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-4f2bf666-b1f9-40b5-9060-dba47f3c87cc tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] [instance: 4c53f81e-f4d8-4b41-b03a-ba9acb867226] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:53:19.641444 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4f2bf666-b1f9-40b5-9060-dba47f3c87cc tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:19.642346 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4f2bf666-b1f9-40b5-9060-dba47f3c87cc tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:19.645378 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4f2bf666-b1f9-40b5-9060-dba47f3c87cc tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:19.646608 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4f2bf666-b1f9-40b5-9060-dba47f3c87cc tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:19.647774 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4f2bf666-b1f9-40b5-9060-dba47f3c87cc tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:19.649481 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4f2bf666-b1f9-40b5-9060-dba47f3c87cc tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:19.674185 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.wsgi [None req-4f2bf666-b1f9-40b5-9060-dba47f3c87cc tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] HTTP exception thrown: Instance 4c53f81e-f4d8-4b41-b03a-ba9acb867226 could not be found. Oct 22 20:53:19.682590 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-4f2bf666-b1f9-40b5-9060-dba47f3c87cc tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Request method failure captured: Oct 22 20:53:19.682590 ncdv-master-1 devstack@n-api.service[138745]: request: GET /compute/v2.1/servers/4c53f81e-f4d8-4b41-b03a-ba9acb867226 HTTP/1.1 Oct 22 20:53:19.682590 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 20:53:19.682590 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 20:53:19.682590 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 20:53:19.682590 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 0 Oct 22 20:53:19.682590 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 20:53:19.682590 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 20:53:19.682590 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 20:53:19.682590 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 20:53:19.682590 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVFdofXvJrSgjWpq-1isQhmgvdybS2tM0l8K04eElU-t1KAMj6H6Ujb1kYrO3fejFqrejK4vomxDY4wvClpj7VdOnMDtO7P0egZj5A5e0mukyNyBPnz4tbEDZqhzEcYtqt33InUTGLFjHRwEudbG0P6FAWG-p8a8hrQR1ntuUiFOsSEI Oct 22 20:53:19.682590 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 20:53:19.682590 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 20:53:19.682590 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 20:53:19.682590 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 20:53:19.682590 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 20:53:19.682590 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 20:53:19.682590 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: 30dbbdc150694e0ebc07c63e90280d40 Oct 22 20:53:19.682590 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-629684378 Oct 22 20:53:19.682590 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 20:53:19.682590 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 20:53:19.682590 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_30dbbdc150694e0ebc07c63e90280d40"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/30dbbdc150694e0ebc07c63e90280d40"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/30dbbdc150694e0ebc07c63e90280d40"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/30dbbdc150694e0ebc07c63e90280d40"}]}] Oct 22 20:53:19.682590 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-629684378 Oct 22 20:53:19.682590 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: 30dbbdc150694e0ebc07c63e90280d40 Oct 22 20:53:19.682590 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-629684378 Oct 22 20:53:19.682590 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-ServersWithSpecificFlavorTestJSON-629684378-project Oct 22 20:53:19.682590 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 20:53:19.682590 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 20:53:19.682590 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: f9bba9ed37d7430e82e7d310982b8e47 Oct 22 20:53:19.682590 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-629684378-project Oct 22 20:53:19.682590 ncdv-master-1 devstack@n-api.service[138745]: method: > Oct 22 20:53:19.682590 ncdv-master-1 devstack@n-api.service[138745]: exception: Instance 4c53f81e-f4d8-4b41-b03a-ba9acb867226 could not be found. Oct 22 20:53:19.682590 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'id': '4c53f81e-f4d8-4b41-b03a-ba9acb867226'} Oct 22 20:53:19.682590 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:53:19.682590 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:53:19.682590 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 20:53:19.682590 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 20:53:19.682590 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 20:53:19.682590 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 20:53:19.682590 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 20:53:19.682590 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 20:53:19.682590 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 20:53:19.682590 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 20:53:19.682590 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c53f81e-f4d8-4b41-b03a-ba9acb867226 could not be found. Oct 22 20:53:19.682590 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:53:19.682590 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:53:19.682590 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:53:19.682590 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:53:19.682590 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:53:19.682590 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:53:19.682590 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:53:19.682590 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:53:19.682590 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:53:19.682590 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:53:19.682590 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 20:53:19.682590 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 20:53:19.682590 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 20:53:19.682590 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 20:53:19.682590 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 20:53:19.682590 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 20:53:19.682590 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c53f81e-f4d8-4b41-b03a-ba9acb867226 could not be found. Oct 22 20:53:19.682590 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:53:19.682590 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:53:19.687356 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:53:19.687356 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:53:19.687356 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:53:19.687356 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:53:19.687356 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 20:53:19.687356 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 20:53:19.687356 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c53f81e-f4d8-4b41-b03a-ba9acb867226 could not be found. Oct 22 20:53:19.687356 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:53:19.687978 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-4441233f-caa3-4313-a721-8a21bab12fe6 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7f48d18691d4473bbe0284c44f14d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bacf9909082440f8a201771b64a75fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:53:19.690782 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-4f2bf666-b1f9-40b5-9060-dba47f3c87cc tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] Returning 404 to user: Instance 4c53f81e-f4d8-4b41-b03a-ba9acb867226 could not be found. {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:53:19.691961 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-4f2bf666-b1f9-40b5-9060-dba47f3c87cc tempest-ServersWithSpecificFlavorTestJSON-629684378 tempest-ServersWithSpecificFlavorTestJSON-629684378-project] 10.222.0.18 "GET /compute/v2.1/servers/4c53f81e-f4d8-4b41-b03a-ba9acb867226" status: 404 len: 111 microversion: 2.1 time: 0.077976 Oct 22 20:53:19.697887 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 636/1181] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:53:19 2022] GET /compute/v2.1/servers/4c53f81e-f4d8-4b41-b03a-ba9acb867226 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 20:53:19.704320 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-4441233f-caa3-4313-a721-8a21bab12fe6 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] 10.222.0.18 "GET /compute/v2.1/servers/f2f50f6b-6a3e-449f-836e-bd897f78279c" status: 200 len: 1313 microversion: 2.1 time: 0.365355 Oct 22 20:53:19.705551 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-912c8a5f-f3b9-49b6-9ce2-5df9cfdf65b3 tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Calling method '.version_select at 0x7fd3a44abca0>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:53:19.708466 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 546/1182] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:53:19 2022] GET /compute/v2.1/servers/f2f50f6b-6a3e-449f-836e-bd897f78279c => generated 1313 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:53:19.731374 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-e870e28a-7da8-4914-bdd9-f9c9b5bbee8a tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:53:19.733995 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-e870e28a-7da8-4914-bdd9-f9c9b5bbee8a tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] [instance: 4c7b99a9-2ec4-4f4b-98e7-8e1ea2103735] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:53:19.761703 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e870e28a-7da8-4914-bdd9-f9c9b5bbee8a tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:19.766176 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e870e28a-7da8-4914-bdd9-f9c9b5bbee8a tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:19.766755 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e870e28a-7da8-4914-bdd9-f9c9b5bbee8a tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:19.770023 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e870e28a-7da8-4914-bdd9-f9c9b5bbee8a tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:19.772933 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e870e28a-7da8-4914-bdd9-f9c9b5bbee8a tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:19.773990 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-912c8a5f-f3b9-49b6-9ce2-5df9cfdf65b3 tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] 10.222.0.18 "GET /compute/v2.1/images/9585a413-1cc7-4173-a4e4-f771201c7779" status: 200 len: 1424 microversion: 2.1 time: 0.074647 Oct 22 20:53:19.774711 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 637/1183] 10.222.0.18 () {58 vars in 1233 bytes} [Sat Oct 22 20:53:19 2022] GET /compute/v2.1/images/9585a413-1cc7-4173-a4e4-f771201c7779 => generated 1424 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:53:19.782580 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e870e28a-7da8-4914-bdd9-f9c9b5bbee8a tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:20.042990 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-e870e28a-7da8-4914-bdd9-f9c9b5bbee8a tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:53:20.053180 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-e870e28a-7da8-4914-bdd9-f9c9b5bbee8a tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:53:20.067177 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-e870e28a-7da8-4914-bdd9-f9c9b5bbee8a tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:53:20.068497 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-e870e28a-7da8-4914-bdd9-f9c9b5bbee8a tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] 10.222.0.18 "GET /compute/v2.1/servers/4c7b99a9-2ec4-4f4b-98e7-8e1ea2103735" status: 200 len: 1812 microversion: 2.25 time: 0.355814 Oct 22 20:53:20.069228 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 547/1184] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 20:53:19 2022] GET /compute/v2.1/servers/4c7b99a9-2ec4-4f4b-98e7-8e1ea2103735 => generated 1812 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 20:53:20.632346 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-7d0a245e-f653-49fc-980b-33bf50008a60 req-f0d908b1-d08e-4983-9c67-9973eeeb1985 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87fe386a-f98b-46b8-86f2-993e25292785", "name": "network-vif-deleted", "tag": "e5a9751a-054f-4649-be5b-0a1cbf094c02"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:53:20.657858 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-7d0a245e-f653-49fc-980b-33bf50008a60 req-f0d908b1-d08e-4983-9c67-9973eeeb1985 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:20.658713 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-7d0a245e-f653-49fc-980b-33bf50008a60 req-f0d908b1-d08e-4983-9c67-9973eeeb1985 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:20.662411 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-7d0a245e-f653-49fc-980b-33bf50008a60 req-f0d908b1-d08e-4983-9c67-9973eeeb1985 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:20.680878 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-7d0a245e-f653-49fc-980b-33bf50008a60 req-f0d908b1-d08e-4983-9c67-9973eeeb1985 service nova] Creating event network-vif-deleted:e5a9751a-054f-4649-be5b-0a1cbf094c02 for instance 87fe386a-f98b-46b8-86f2-993e25292785 on nch2-master-1 Oct 22 20:53:20.686502 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-7d0a245e-f653-49fc-980b-33bf50008a60 req-f0d908b1-d08e-4983-9c67-9973eeeb1985 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059117 Oct 22 20:53:20.687224 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 548/1185] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:53:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 20:53:20.696962 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-897fcf0d-422a-444f-8136-d96045186871 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:53:20.697871 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-897fcf0d-422a-444f-8136-d96045186871 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] [instance: 87fe386a-f98b-46b8-86f2-993e25292785] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:53:20.705346 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-897fcf0d-422a-444f-8136-d96045186871 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:20.706273 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-897fcf0d-422a-444f-8136-d96045186871 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:20.706973 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-897fcf0d-422a-444f-8136-d96045186871 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:20.708050 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-897fcf0d-422a-444f-8136-d96045186871 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:20.708778 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-897fcf0d-422a-444f-8136-d96045186871 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:20.709647 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-897fcf0d-422a-444f-8136-d96045186871 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:20.848078 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-3bb6dbeb-f248-4e23-88e6-6e7edc2bee78 tempest-AZV2TestJSON-1840851637 tempest-AZV2TestJSON-1840851637-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:53:20.850477 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3bb6dbeb-f248-4e23-88e6-6e7edc2bee78 tempest-AZV2TestJSON-1840851637 tempest-AZV2TestJSON-1840851637-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:20.851274 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3bb6dbeb-f248-4e23-88e6-6e7edc2bee78 tempest-AZV2TestJSON-1840851637 tempest-AZV2TestJSON-1840851637-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:20.852270 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3bb6dbeb-f248-4e23-88e6-6e7edc2bee78 tempest-AZV2TestJSON-1840851637 tempest-AZV2TestJSON-1840851637-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:20.853184 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3bb6dbeb-f248-4e23-88e6-6e7edc2bee78 tempest-AZV2TestJSON-1840851637 tempest-AZV2TestJSON-1840851637-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:20.854421 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3bb6dbeb-f248-4e23-88e6-6e7edc2bee78 tempest-AZV2TestJSON-1840851637 tempest-AZV2TestJSON-1840851637-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:20.859617 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-897fcf0d-422a-444f-8136-d96045186871 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34f8af8ee2b545bead90fffd6c6c4896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48413ed1ac4e1ea65fb38f097881db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:53:20.871819 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3bb6dbeb-f248-4e23-88e6-6e7edc2bee78 tempest-AZV2TestJSON-1840851637 tempest-AZV2TestJSON-1840851637-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:20.877654 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-897fcf0d-422a-444f-8136-d96045186871 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] 10.222.0.18 "GET /compute/v2.1/servers/87fe386a-f98b-46b8-86f2-993e25292785" status: 200 len: 1302 microversion: 2.1 time: 0.188169 Oct 22 20:53:20.895624 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 549/1186] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:53:20 2022] GET /compute/v2.1/servers/87fe386a-f98b-46b8-86f2-993e25292785 => generated 1302 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:53:20.907888 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-3c49a0e5-c961-4091-b847-434947823150 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:53:20.908460 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-3c49a0e5-c961-4091-b847-434947823150 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] [instance: f2f50f6b-6a3e-449f-836e-bd897f78279c] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:53:20.925356 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3c49a0e5-c961-4091-b847-434947823150 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:20.929147 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3c49a0e5-c961-4091-b847-434947823150 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:20.929596 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3c49a0e5-c961-4091-b847-434947823150 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:20.930360 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3c49a0e5-c961-4091-b847-434947823150 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:20.930809 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3c49a0e5-c961-4091-b847-434947823150 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:20.931233 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3c49a0e5-c961-4091-b847-434947823150 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:20.956610 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-3bb6dbeb-f248-4e23-88e6-6e7edc2bee78 tempest-AZV2TestJSON-1840851637 tempest-AZV2TestJSON-1840851637-project] 10.222.0.18 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.510482 Oct 22 20:53:20.966323 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 638/1187] 10.222.0.18 () {58 vars in 1164 bytes} [Sat Oct 22 20:53:20 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 22 20:53:20.982559 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-8523115a-4a65-4d79-8831-7220803067d1 tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Calling method '.version_select at 0x7fd3a44abe50>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:53:21.101922 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-8523115a-4a65-4d79-8831-7220803067d1 tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] 10.222.0.18 "GET /compute/v2.1/images/9585a413-1cc7-4173-a4e4-f771201c7779" status: 200 len: 1424 microversion: 2.1 time: 0.131382 Oct 22 20:53:21.105549 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 639/1188] 10.222.0.18 () {58 vars in 1233 bytes} [Sat Oct 22 20:53:20 2022] GET /compute/v2.1/images/9585a413-1cc7-4173-a4e4-f771201c7779 => generated 1424 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:53:21.134287 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-ae6959bc-7f9a-4ea6-bc1e-b4f7568de1c8 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:53:21.135809 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-ae6959bc-7f9a-4ea6-bc1e-b4f7568de1c8 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] [instance: 4c7b99a9-2ec4-4f4b-98e7-8e1ea2103735] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:53:21.152363 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ae6959bc-7f9a-4ea6-bc1e-b4f7568de1c8 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:21.153725 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ae6959bc-7f9a-4ea6-bc1e-b4f7568de1c8 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:21.155085 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ae6959bc-7f9a-4ea6-bc1e-b4f7568de1c8 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:21.156977 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ae6959bc-7f9a-4ea6-bc1e-b4f7568de1c8 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:21.158408 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ae6959bc-7f9a-4ea6-bc1e-b4f7568de1c8 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:21.159856 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ae6959bc-7f9a-4ea6-bc1e-b4f7568de1c8 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:21.441555 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-3c49a0e5-c961-4091-b847-434947823150 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7f48d18691d4473bbe0284c44f14d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bacf9909082440f8a201771b64a75fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:53:21.453477 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-3c49a0e5-c961-4091-b847-434947823150 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] 10.222.0.18 "GET /compute/v2.1/servers/f2f50f6b-6a3e-449f-836e-bd897f78279c" status: 200 len: 1334 microversion: 2.1 time: 0.556535 Oct 22 20:53:21.457471 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 550/1189] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:53:20 2022] GET /compute/v2.1/servers/f2f50f6b-6a3e-449f-836e-bd897f78279c => generated 1334 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:53:21.640805 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-ae6959bc-7f9a-4ea6-bc1e-b4f7568de1c8 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:53:21.653354 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-ae6959bc-7f9a-4ea6-bc1e-b4f7568de1c8 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:53:21.668898 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-ae6959bc-7f9a-4ea6-bc1e-b4f7568de1c8 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:53:21.670224 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-ae6959bc-7f9a-4ea6-bc1e-b4f7568de1c8 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] 10.222.0.18 "GET /compute/v2.1/servers/4c7b99a9-2ec4-4f4b-98e7-8e1ea2103735" status: 200 len: 1812 microversion: 2.25 time: 0.551731 Oct 22 20:53:21.680354 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 640/1190] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 20:53:21 2022] GET /compute/v2.1/servers/4c7b99a9-2ec4-4f4b-98e7-8e1ea2103735 => generated 1812 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 20:53:21.905675 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-b404256c-5c47-4fda-ad4b-2c61182c6ea6 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:53:21.906295 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-b404256c-5c47-4fda-ad4b-2c61182c6ea6 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] [instance: 87fe386a-f98b-46b8-86f2-993e25292785] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:53:21.913965 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b404256c-5c47-4fda-ad4b-2c61182c6ea6 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:21.914916 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b404256c-5c47-4fda-ad4b-2c61182c6ea6 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:21.915661 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b404256c-5c47-4fda-ad4b-2c61182c6ea6 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:21.916897 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b404256c-5c47-4fda-ad4b-2c61182c6ea6 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:21.917744 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b404256c-5c47-4fda-ad4b-2c61182c6ea6 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:21.918713 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b404256c-5c47-4fda-ad4b-2c61182c6ea6 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:21.940697 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-b404256c-5c47-4fda-ad4b-2c61182c6ea6 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] HTTP exception thrown: Instance 87fe386a-f98b-46b8-86f2-993e25292785 could not be found. Oct 22 20:53:21.944224 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-b404256c-5c47-4fda-ad4b-2c61182c6ea6 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Request method failure captured: Oct 22 20:53:21.944224 ncdv-master-1 devstack@n-api.service[138744]: request: GET /compute/v2.1/servers/87fe386a-f98b-46b8-86f2-993e25292785 HTTP/1.1 Oct 22 20:53:21.944224 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 20:53:21.944224 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 20:53:21.944224 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 20:53:21.944224 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 0 Oct 22 20:53:21.944224 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 20:53:21.944224 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 20:53:21.944224 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 20:53:21.944224 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 20:53:21.944224 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVFeNLLa88d1W7ImIcuLaw50drmGidKxt_ChF0JiWTA0dltYpiA9XWFUnls11INe_Vq3fF2Ubja8cWIIoGDLDq1pnfwhFXGbigl7-FxmudNFbqymJr6DV5ZVhkxQYhffUu6bf0gRwkPHFjfDIqYUFqXu3-aJfSfTBGJxlqhZwHc1ra5I Oct 22 20:53:21.944224 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 20:53:21.944224 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 20:53:21.944224 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 20:53:21.944224 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 20:53:21.944224 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 20:53:21.944224 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 20:53:21.944224 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: 3e48413ed1ac4e1ea65fb38f097881db Oct 22 20:53:21.944224 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-VolumesAdminNegativeTest-1470267362 Oct 22 20:53:21.944224 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 20:53:21.944224 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 20:53:21.944224 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_3e48413ed1ac4e1ea65fb38f097881db"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/3e48413ed1ac4e1ea65fb38f097881db"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/3e48413ed1ac4e1ea65fb38f097881db"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/3e48413ed1ac4e1ea65fb38f097881db"}]}] Oct 22 20:53:21.944224 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-VolumesAdminNegativeTest-1470267362 Oct 22 20:53:21.944224 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: 3e48413ed1ac4e1ea65fb38f097881db Oct 22 20:53:21.944224 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1470267362 Oct 22 20:53:21.944224 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-VolumesAdminNegativeTest-1470267362-project Oct 22 20:53:21.944224 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 20:53:21.944224 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 20:53:21.944224 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: 34f8af8ee2b545bead90fffd6c6c4896 Oct 22 20:53:21.944224 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-VolumesAdminNegativeTest-1470267362-project Oct 22 20:53:21.944224 ncdv-master-1 devstack@n-api.service[138744]: method: > Oct 22 20:53:21.944224 ncdv-master-1 devstack@n-api.service[138744]: exception: Instance 87fe386a-f98b-46b8-86f2-993e25292785 could not be found. Oct 22 20:53:21.944224 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': '87fe386a-f98b-46b8-86f2-993e25292785'} Oct 22 20:53:21.944224 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:53:21.944224 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:53:21.944224 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 20:53:21.944224 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 20:53:21.944224 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 20:53:21.944224 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 20:53:21.944224 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 20:53:21.944224 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 20:53:21.944224 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 20:53:21.944224 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 20:53:21.944224 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 87fe386a-f98b-46b8-86f2-993e25292785 could not be found. Oct 22 20:53:21.944224 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:53:21.944224 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:53:21.944224 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:53:21.944224 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:53:21.944224 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:53:21.944224 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:53:21.944224 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:53:21.944224 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:53:21.944224 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:53:21.944224 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:53:21.944224 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 20:53:21.944224 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 20:53:21.944224 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 20:53:21.944224 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 20:53:21.944224 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 20:53:21.944224 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 20:53:21.944224 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87fe386a-f98b-46b8-86f2-993e25292785 could not be found. Oct 22 20:53:21.944224 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:53:21.944224 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:53:21.944224 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:53:21.950078 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:53:21.950078 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:53:21.950078 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:53:21.950078 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 20:53:21.950078 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 20:53:21.950078 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87fe386a-f98b-46b8-86f2-993e25292785 could not be found. Oct 22 20:53:21.950078 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:53:21.953842 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-b404256c-5c47-4fda-ad4b-2c61182c6ea6 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Returning 404 to user: Instance 87fe386a-f98b-46b8-86f2-993e25292785 could not be found. {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:53:21.956290 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-b404256c-5c47-4fda-ad4b-2c61182c6ea6 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] 10.222.0.18 "GET /compute/v2.1/servers/87fe386a-f98b-46b8-86f2-993e25292785" status: 404 len: 111 microversion: 2.1 time: 0.057164 Oct 22 20:53:21.957400 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 551/1191] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:53:21 2022] GET /compute/v2.1/servers/87fe386a-f98b-46b8-86f2-993e25292785 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 20:53:22.120787 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-6b7f03f1-e5ef-48ef-962f-c4ae95b53da5 tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Calling method '.version_select at 0x7fd3a44ab8b0>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:53:22.254662 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-6b7f03f1-e5ef-48ef-962f-c4ae95b53da5 tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] 10.222.0.18 "GET /compute/v2.1/images/9585a413-1cc7-4173-a4e4-f771201c7779" status: 200 len: 1424 microversion: 2.1 time: 0.138220 Oct 22 20:53:22.255570 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 641/1192] 10.222.0.18 () {58 vars in 1233 bytes} [Sat Oct 22 20:53:22 2022] GET /compute/v2.1/images/9585a413-1cc7-4173-a4e4-f771201c7779 => generated 1424 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:53:22.489514 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-5c148063-1fcf-4fde-9af2-cd6b6689a8dc tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:53:22.491002 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-5c148063-1fcf-4fde-9af2-cd6b6689a8dc tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] [instance: f2f50f6b-6a3e-449f-836e-bd897f78279c] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:53:22.516736 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5c148063-1fcf-4fde-9af2-cd6b6689a8dc tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:22.518727 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5c148063-1fcf-4fde-9af2-cd6b6689a8dc tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:22.519789 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5c148063-1fcf-4fde-9af2-cd6b6689a8dc tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:22.523102 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5c148063-1fcf-4fde-9af2-cd6b6689a8dc tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:22.525432 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5c148063-1fcf-4fde-9af2-cd6b6689a8dc tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:22.527839 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5c148063-1fcf-4fde-9af2-cd6b6689a8dc tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:22.715497 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-d95ee03b-6d1c-4571-886d-4fb9736f5037 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:53:22.717716 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-d95ee03b-6d1c-4571-886d-4fb9736f5037 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] [instance: 4c7b99a9-2ec4-4f4b-98e7-8e1ea2103735] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:53:22.729070 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d95ee03b-6d1c-4571-886d-4fb9736f5037 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:22.729943 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d95ee03b-6d1c-4571-886d-4fb9736f5037 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:22.730723 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d95ee03b-6d1c-4571-886d-4fb9736f5037 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:22.732002 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d95ee03b-6d1c-4571-886d-4fb9736f5037 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:22.732800 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d95ee03b-6d1c-4571-886d-4fb9736f5037 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:22.733678 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d95ee03b-6d1c-4571-886d-4fb9736f5037 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:23.314787 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-d95ee03b-6d1c-4571-886d-4fb9736f5037 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:53:23.325489 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-d95ee03b-6d1c-4571-886d-4fb9736f5037 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:53:23.331529 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-d95ee03b-6d1c-4571-886d-4fb9736f5037 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:53:23.332892 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-d95ee03b-6d1c-4571-886d-4fb9736f5037 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] 10.222.0.18 "GET /compute/v2.1/servers/4c7b99a9-2ec4-4f4b-98e7-8e1ea2103735" status: 200 len: 1812 microversion: 2.25 time: 0.626238 Oct 22 20:53:23.357029 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 642/1193] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 20:53:22 2022] GET /compute/v2.1/servers/4c7b99a9-2ec4-4f4b-98e7-8e1ea2103735 => generated 1812 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 22 20:53:23.377209 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-2e6bcfb1-b4d8-40a7-b81d-577e0f26fdf1 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:53:23.378001 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-2e6bcfb1-b4d8-40a7-b81d-577e0f26fdf1 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] [instance: c475672d-99ba-4c6a-abaa-3332a392534d] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:53:23.399600 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2e6bcfb1-b4d8-40a7-b81d-577e0f26fdf1 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:23.401475 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2e6bcfb1-b4d8-40a7-b81d-577e0f26fdf1 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:23.405215 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2e6bcfb1-b4d8-40a7-b81d-577e0f26fdf1 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:23.406364 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2e6bcfb1-b4d8-40a7-b81d-577e0f26fdf1 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:23.407065 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2e6bcfb1-b4d8-40a7-b81d-577e0f26fdf1 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:23.407809 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2e6bcfb1-b4d8-40a7-b81d-577e0f26fdf1 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:23.435986 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-5c148063-1fcf-4fde-9af2-cd6b6689a8dc tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7f48d18691d4473bbe0284c44f14d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bacf9909082440f8a201771b64a75fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:53:23.456578 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-5c148063-1fcf-4fde-9af2-cd6b6689a8dc tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] 10.222.0.18 "GET /compute/v2.1/servers/f2f50f6b-6a3e-449f-836e-bd897f78279c" status: 200 len: 1334 microversion: 2.1 time: 0.972224 Oct 22 20:53:23.459600 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 552/1194] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:53:22 2022] GET /compute/v2.1/servers/f2f50f6b-6a3e-449f-836e-bd897f78279c => generated 1334 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:53:23.467187 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-54d487d8-6c1b-41a7-ac23-cd25a13ebe06 tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Calling method '.version_select at 0x7fd3a40e0670>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:53:23.496690 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-2e6bcfb1-b4d8-40a7-b81d-577e0f26fdf1 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] [instance: c475672d-99ba-4c6a-abaa-3332a392534d] Going to try to terminate instance {{(pid=138745) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 20:53:23.550900 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-54d487d8-6c1b-41a7-ac23-cd25a13ebe06 tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] 10.222.0.18 "GET /compute/v2.1/images/9585a413-1cc7-4173-a4e4-f771201c7779" status: 200 len: 1424 microversion: 2.1 time: 0.089564 Oct 22 20:53:23.552680 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 553/1195] 10.222.0.18 () {58 vars in 1233 bytes} [Sat Oct 22 20:53:23 2022] GET /compute/v2.1/images/9585a413-1cc7-4173-a4e4-f771201c7779 => generated 1424 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:53:23.707112 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-2e6bcfb1-b4d8-40a7-b81d-577e0f26fdf1 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] 10.222.0.18 "DELETE /compute/v2.1/servers/c475672d-99ba-4c6a-abaa-3332a392534d" status: 204 len: 0 microversion: 2.1 time: 0.340702 Oct 22 20:53:23.707746 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 643/1196] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 20:53:23 2022] DELETE /compute/v2.1/servers/c475672d-99ba-4c6a-abaa-3332a392534d => generated 0 bytes in 342 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 20:53:23.717334 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-a2cbcfa3-27ed-4005-9d08-6c155025aa04 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:53:23.718044 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-a2cbcfa3-27ed-4005-9d08-6c155025aa04 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] [instance: c475672d-99ba-4c6a-abaa-3332a392534d] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:53:23.727870 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell0:SELECT=7 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:53:23.732352 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a2cbcfa3-27ed-4005-9d08-6c155025aa04 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:23.735218 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a2cbcfa3-27ed-4005-9d08-6c155025aa04 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:23.736515 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a2cbcfa3-27ed-4005-9d08-6c155025aa04 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:23.738316 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a2cbcfa3-27ed-4005-9d08-6c155025aa04 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:23.739853 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a2cbcfa3-27ed-4005-9d08-6c155025aa04 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:23.740895 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a2cbcfa3-27ed-4005-9d08-6c155025aa04 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:23.803692 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell0:SELECT=22 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:53:24.112347 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-a2cbcfa3-27ed-4005-9d08-6c155025aa04 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34f8af8ee2b545bead90fffd6c6c4896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48413ed1ac4e1ea65fb38f097881db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:53:24.121368 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-a2cbcfa3-27ed-4005-9d08-6c155025aa04 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] 10.222.0.18 "GET /compute/v2.1/servers/c475672d-99ba-4c6a-abaa-3332a392534d" status: 200 len: 1681 microversion: 2.1 time: 0.408305 Oct 22 20:53:24.124240 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 554/1197] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:53:23 2022] GET /compute/v2.1/servers/c475672d-99ba-4c6a-abaa-3332a392534d => generated 1681 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:53:24.365086 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-e1086c81-7f4c-4f1d-8650-02ca02fac362 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:53:24.367252 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-e1086c81-7f4c-4f1d-8650-02ca02fac362 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] [instance: 4c7b99a9-2ec4-4f4b-98e7-8e1ea2103735] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:53:24.382851 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e1086c81-7f4c-4f1d-8650-02ca02fac362 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:24.384257 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e1086c81-7f4c-4f1d-8650-02ca02fac362 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:24.384721 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e1086c81-7f4c-4f1d-8650-02ca02fac362 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:24.391826 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e1086c81-7f4c-4f1d-8650-02ca02fac362 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:24.392631 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e1086c81-7f4c-4f1d-8650-02ca02fac362 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:24.393263 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e1086c81-7f4c-4f1d-8650-02ca02fac362 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:24.459863 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:53:24.495318 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-5d00f1b9-5220-49e8-b341-a363b39634a2 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:53:24.496343 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-5d00f1b9-5220-49e8-b341-a363b39634a2 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] [instance: f2f50f6b-6a3e-449f-836e-bd897f78279c] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:53:24.519256 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5d00f1b9-5220-49e8-b341-a363b39634a2 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:24.524945 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5d00f1b9-5220-49e8-b341-a363b39634a2 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:24.525732 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5d00f1b9-5220-49e8-b341-a363b39634a2 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:24.528643 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5d00f1b9-5220-49e8-b341-a363b39634a2 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:24.531113 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5d00f1b9-5220-49e8-b341-a363b39634a2 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:24.534390 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5d00f1b9-5220-49e8-b341-a363b39634a2 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:24.906307 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-e1086c81-7f4c-4f1d-8650-02ca02fac362 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:53:24.919476 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-e1086c81-7f4c-4f1d-8650-02ca02fac362 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:53:24.931664 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-e1086c81-7f4c-4f1d-8650-02ca02fac362 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:53:24.932935 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-e1086c81-7f4c-4f1d-8650-02ca02fac362 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] 10.222.0.18 "GET /compute/v2.1/servers/4c7b99a9-2ec4-4f4b-98e7-8e1ea2103735" status: 200 len: 1812 microversion: 2.25 time: 0.573636 Oct 22 20:53:24.933539 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 644/1198] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 20:53:24 2022] GET /compute/v2.1/servers/4c7b99a9-2ec4-4f4b-98e7-8e1ea2103735 => generated 1812 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 20:53:24.951869 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-27208e4c-8955-44c5-894c-0e6afc53d2c5 tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Calling method '.version_select at 0x7fd3a44abb80>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:53:25.023999 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-5d00f1b9-5220-49e8-b341-a363b39634a2 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7f48d18691d4473bbe0284c44f14d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bacf9909082440f8a201771b64a75fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:53:25.033635 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-5d00f1b9-5220-49e8-b341-a363b39634a2 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] 10.222.0.18 "GET /compute/v2.1/servers/f2f50f6b-6a3e-449f-836e-bd897f78279c" status: 200 len: 1355 microversion: 2.1 time: 0.551404 Oct 22 20:53:25.042722 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 555/1199] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:53:24 2022] GET /compute/v2.1/servers/f2f50f6b-6a3e-449f-836e-bd897f78279c => generated 1355 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:53:25.146180 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-4ccc9c66-2d9c-4f94-9609-04648cdd57f0 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:53:25.147381 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-4ccc9c66-2d9c-4f94-9609-04648cdd57f0 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] [instance: c475672d-99ba-4c6a-abaa-3332a392534d] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:53:25.155476 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4ccc9c66-2d9c-4f94-9609-04648cdd57f0 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:25.157393 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4ccc9c66-2d9c-4f94-9609-04648cdd57f0 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:25.158148 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4ccc9c66-2d9c-4f94-9609-04648cdd57f0 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:25.163130 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4ccc9c66-2d9c-4f94-9609-04648cdd57f0 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:25.163968 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4ccc9c66-2d9c-4f94-9609-04648cdd57f0 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:25.165089 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4ccc9c66-2d9c-4f94-9609-04648cdd57f0 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:25.579725 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-27208e4c-8955-44c5-894c-0e6afc53d2c5 tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] 10.222.0.18 "GET /compute/v2.1/images/9585a413-1cc7-4173-a4e4-f771201c7779" status: 200 len: 1424 microversion: 2.1 time: 0.642275 Oct 22 20:53:25.581237 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 645/1200] 10.222.0.18 () {58 vars in 1233 bytes} [Sat Oct 22 20:53:24 2022] GET /compute/v2.1/images/9585a413-1cc7-4173-a4e4-f771201c7779 => generated 1424 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:53:25.763737 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-4ccc9c66-2d9c-4f94-9609-04648cdd57f0 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34f8af8ee2b545bead90fffd6c6c4896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48413ed1ac4e1ea65fb38f097881db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:53:25.777766 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-4ccc9c66-2d9c-4f94-9609-04648cdd57f0 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] 10.222.0.18 "GET /compute/v2.1/servers/c475672d-99ba-4c6a-abaa-3332a392534d" status: 200 len: 1681 microversion: 2.1 time: 0.635739 Oct 22 20:53:25.786482 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 556/1201] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:53:25 2022] GET /compute/v2.1/servers/c475672d-99ba-4c6a-abaa-3332a392534d => generated 1681 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:53:25.965384 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell0:SELECT=30 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:53:25.973149 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-0e9c649b-1231-4160-93f2-6c68dbbb37d6 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:53:25.973786 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-0e9c649b-1231-4160-93f2-6c68dbbb37d6 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] [instance: 4c7b99a9-2ec4-4f4b-98e7-8e1ea2103735] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:53:25.991292 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0e9c649b-1231-4160-93f2-6c68dbbb37d6 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:25.992440 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0e9c649b-1231-4160-93f2-6c68dbbb37d6 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:25.993066 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0e9c649b-1231-4160-93f2-6c68dbbb37d6 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:25.994021 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0e9c649b-1231-4160-93f2-6c68dbbb37d6 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:25.996143 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0e9c649b-1231-4160-93f2-6c68dbbb37d6 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:25.997587 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0e9c649b-1231-4160-93f2-6c68dbbb37d6 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:26.095853 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-cb86ae4a-adb6-4f47-87c5-bd2e3fa7dc37 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:53:26.097072 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-cb86ae4a-adb6-4f47-87c5-bd2e3fa7dc37 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] [instance: f2f50f6b-6a3e-449f-836e-bd897f78279c] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:53:26.112646 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cb86ae4a-adb6-4f47-87c5-bd2e3fa7dc37 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:26.113174 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cb86ae4a-adb6-4f47-87c5-bd2e3fa7dc37 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:26.113622 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cb86ae4a-adb6-4f47-87c5-bd2e3fa7dc37 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:26.114351 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cb86ae4a-adb6-4f47-87c5-bd2e3fa7dc37 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:26.114802 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cb86ae4a-adb6-4f47-87c5-bd2e3fa7dc37 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:26.115228 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cb86ae4a-adb6-4f47-87c5-bd2e3fa7dc37 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:26.983919 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-0e9c649b-1231-4160-93f2-6c68dbbb37d6 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:53:27.003083 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-0e9c649b-1231-4160-93f2-6c68dbbb37d6 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:53:27.004609 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-0e9c649b-1231-4160-93f2-6c68dbbb37d6 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:53:27.011623 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-0e9c649b-1231-4160-93f2-6c68dbbb37d6 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] 10.222.0.18 "GET /compute/v2.1/servers/4c7b99a9-2ec4-4f4b-98e7-8e1ea2103735" status: 200 len: 1812 microversion: 2.25 time: 1.045779 Oct 22 20:53:27.012235 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 646/1202] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 20:53:25 2022] GET /compute/v2.1/servers/4c7b99a9-2ec4-4f4b-98e7-8e1ea2103735 => generated 1812 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 20:53:27.027080 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-212ec72d-f0f7-4951-bf7d-1b5ab36a4df1 req-76ca6ca7-c8e9-4c69-a217-1b8f80cf987b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c7b99a9-2ec4-4f4b-98e7-8e1ea2103735", "name": "network-vif-unplugged", "status": "completed", "tag": "54a65686-35c5-4655-a6b6-8d82393a2555"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:53:27.057481 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-cb86ae4a-adb6-4f47-87c5-bd2e3fa7dc37 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7f48d18691d4473bbe0284c44f14d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bacf9909082440f8a201771b64a75fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:53:27.074806 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-cb86ae4a-adb6-4f47-87c5-bd2e3fa7dc37 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] 10.222.0.18 "GET /compute/v2.1/servers/f2f50f6b-6a3e-449f-836e-bd897f78279c" status: 200 len: 1355 microversion: 2.1 time: 0.982007 Oct 22 20:53:27.075500 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 557/1203] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:53:26 2022] GET /compute/v2.1/servers/f2f50f6b-6a3e-449f-836e-bd897f78279c => generated 1355 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:53:27.080906 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-212ec72d-f0f7-4951-bf7d-1b5ab36a4df1 req-76ca6ca7-c8e9-4c69-a217-1b8f80cf987b service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:27.081408 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-212ec72d-f0f7-4951-bf7d-1b5ab36a4df1 req-76ca6ca7-c8e9-4c69-a217-1b8f80cf987b service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:27.081841 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-212ec72d-f0f7-4951-bf7d-1b5ab36a4df1 req-76ca6ca7-c8e9-4c69-a217-1b8f80cf987b service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:27.097309 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-40eeebc1-642b-43ac-95ed-63ac64b093ca tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Calling method '.version_select at 0x7fd39fe96ee0>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:53:27.126382 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-212ec72d-f0f7-4951-bf7d-1b5ab36a4df1 req-76ca6ca7-c8e9-4c69-a217-1b8f80cf987b service nova] Creating event network-vif-unplugged:54a65686-35c5-4655-a6b6-8d82393a2555 for instance 4c7b99a9-2ec4-4f4b-98e7-8e1ea2103735 on nch1-master-1 Oct 22 20:53:27.133848 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-212ec72d-f0f7-4951-bf7d-1b5ab36a4df1 req-76ca6ca7-c8e9-4c69-a217-1b8f80cf987b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.119804 Oct 22 20:53:27.134996 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 647/1204] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:53:27 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:53:27.140968 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-77223b38-a0a8-4447-989d-7962554956ad tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:53:27.141899 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-77223b38-a0a8-4447-989d-7962554956ad tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] [instance: c475672d-99ba-4c6a-abaa-3332a392534d] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:53:27.151607 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-77223b38-a0a8-4447-989d-7962554956ad tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:27.152365 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-77223b38-a0a8-4447-989d-7962554956ad tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:27.152955 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-77223b38-a0a8-4447-989d-7962554956ad tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:27.154625 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-77223b38-a0a8-4447-989d-7962554956ad tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:27.155365 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-77223b38-a0a8-4447-989d-7962554956ad tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:27.155951 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-77223b38-a0a8-4447-989d-7962554956ad tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:27.223491 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-40eeebc1-642b-43ac-95ed-63ac64b093ca tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] 10.222.0.18 "GET /compute/v2.1/images/9585a413-1cc7-4173-a4e4-f771201c7779" status: 200 len: 1424 microversion: 2.1 time: 0.146383 Oct 22 20:53:27.224298 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 558/1205] 10.222.0.18 () {58 vars in 1233 bytes} [Sat Oct 22 20:53:27 2022] GET /compute/v2.1/images/9585a413-1cc7-4173-a4e4-f771201c7779 => generated 1424 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:53:27.465590 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-c655915b-49b1-4e56-bc7f-13dcd1e59d3d tempest-TenantUsagesTestJSON-743245380 tempest-TenantUsagesTestJSON-743245380-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TenantUsagesTestJSON-server-931492793", "imageRef": "085e4478-6edc-4a69-8e08-f9831713eb65", "flavorRef": "452"}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:53:27.556172 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.network.neutron [None req-c655915b-49b1-4e56-bc7f-13dcd1e59d3d tempest-TenantUsagesTestJSON-743245380 tempest-TenantUsagesTestJSON-743245380-project] validate_networks() for None {{(pid=138744) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 20:53:27.676043 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-77223b38-a0a8-4447-989d-7962554956ad tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34f8af8ee2b545bead90fffd6c6c4896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48413ed1ac4e1ea65fb38f097881db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:53:27.689308 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-77223b38-a0a8-4447-989d-7962554956ad tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] 10.222.0.18 "GET /compute/v2.1/servers/c475672d-99ba-4c6a-abaa-3332a392534d" status: 200 len: 1681 microversion: 2.1 time: 0.552880 Oct 22 20:53:27.691861 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 648/1206] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:53:27 2022] GET /compute/v2.1/servers/c475672d-99ba-4c6a-abaa-3332a392534d => generated 1681 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:53:28.046415 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-be58a607-43ea-4612-b88d-78b329b88982 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:53:28.047073 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-be58a607-43ea-4612-b88d-78b329b88982 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] [instance: 4c7b99a9-2ec4-4f4b-98e7-8e1ea2103735] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:53:28.062444 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-be58a607-43ea-4612-b88d-78b329b88982 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:28.062952 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-be58a607-43ea-4612-b88d-78b329b88982 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:28.063424 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-be58a607-43ea-4612-b88d-78b329b88982 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:28.066892 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-be58a607-43ea-4612-b88d-78b329b88982 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:28.069270 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-be58a607-43ea-4612-b88d-78b329b88982 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:28.073347 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-be58a607-43ea-4612-b88d-78b329b88982 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:28.743866 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-c655915b-49b1-4e56-bc7f-13dcd1e59d3d tempest-TenantUsagesTestJSON-743245380 tempest-TenantUsagesTestJSON-743245380-project] Flavor limits 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 20:53:28.744922 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-c655915b-49b1-4e56-bc7f-13dcd1e59d3d tempest-TenantUsagesTestJSON-743245380 tempest-TenantUsagesTestJSON-743245380-project] Image limits 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 20:53:28.745767 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-c655915b-49b1-4e56-bc7f-13dcd1e59d3d tempest-TenantUsagesTestJSON-743245380 tempest-TenantUsagesTestJSON-743245380-project] Flavor pref 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 20:53:28.746488 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-c655915b-49b1-4e56-bc7f-13dcd1e59d3d tempest-TenantUsagesTestJSON-743245380 tempest-TenantUsagesTestJSON-743245380-project] Image pref 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 20:53:28.747468 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-c655915b-49b1-4e56-bc7f-13dcd1e59d3d tempest-TenantUsagesTestJSON-743245380 tempest-TenantUsagesTestJSON-743245380-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 20:53:28.770856 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c655915b-49b1-4e56-bc7f-13dcd1e59d3d tempest-TenantUsagesTestJSON-743245380 tempest-TenantUsagesTestJSON-743245380-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:28.771855 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c655915b-49b1-4e56-bc7f-13dcd1e59d3d tempest-TenantUsagesTestJSON-743245380 tempest-TenantUsagesTestJSON-743245380-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:28.772667 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c655915b-49b1-4e56-bc7f-13dcd1e59d3d tempest-TenantUsagesTestJSON-743245380 tempest-TenantUsagesTestJSON-743245380-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:28.774981 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c655915b-49b1-4e56-bc7f-13dcd1e59d3d tempest-TenantUsagesTestJSON-743245380 tempest-TenantUsagesTestJSON-743245380-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:28.777020 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c655915b-49b1-4e56-bc7f-13dcd1e59d3d tempest-TenantUsagesTestJSON-743245380 tempest-TenantUsagesTestJSON-743245380-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:28.777728 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c655915b-49b1-4e56-bc7f-13dcd1e59d3d tempest-TenantUsagesTestJSON-743245380 tempest-TenantUsagesTestJSON-743245380-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:28.823915 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-c655915b-49b1-4e56-bc7f-13dcd1e59d3d tempest-TenantUsagesTestJSON-743245380 tempest-TenantUsagesTestJSON-743245380-project] Getting quotas for project d5695737326d4a83828b92469dd3e676. Resources: {'cores', 'instances', 'ram'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 20:53:28.837358 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-c655915b-49b1-4e56-bc7f-13dcd1e59d3d tempest-TenantUsagesTestJSON-743245380 tempest-TenantUsagesTestJSON-743245380-project] Getting quotas for user 94d35abfd0aa4dd09b9d0ad56faebd66 and project d5695737326d4a83828b92469dd3e676. Resources: {'cores', 'instances', 'ram'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 20:53:28.874111 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-c655915b-49b1-4e56-bc7f-13dcd1e59d3d tempest-TenantUsagesTestJSON-743245380 tempest-TenantUsagesTestJSON-743245380-project] Going to run 1 instances... {{(pid=138744) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 20:53:28.882126 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-c655915b-49b1-4e56-bc7f-13dcd1e59d3d tempest-TenantUsagesTestJSON-743245380 tempest-TenantUsagesTestJSON-743245380-project] [instance: 49ed4929-87c4-4ef4-8b46-c4bb3ca5be9a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='085e4478-6edc-4a69-8e08-f9831713eb65',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138744) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 20:53:28.942706 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_api:SELECT=90,nova_api:DELETE=5,nova_api:INSERT=5 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:53:29.008757 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-c655915b-49b1-4e56-bc7f-13dcd1e59d3d tempest-TenantUsagesTestJSON-743245380 tempest-TenantUsagesTestJSON-743245380-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.779271 Oct 22 20:53:29.010607 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 559/1207] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Oct 22 20:53:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 1786 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 20:53:29.021553 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-79b44c2d-ac49-467c-8734-cade2c1561a5 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:53:29.024451 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-79b44c2d-ac49-467c-8734-cade2c1561a5 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] [instance: f2f50f6b-6a3e-449f-836e-bd897f78279c] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:53:29.061240 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-79b44c2d-ac49-467c-8734-cade2c1561a5 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:29.061707 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-79b44c2d-ac49-467c-8734-cade2c1561a5 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:29.062166 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-79b44c2d-ac49-467c-8734-cade2c1561a5 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:29.062918 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-79b44c2d-ac49-467c-8734-cade2c1561a5 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:29.070857 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-79b44c2d-ac49-467c-8734-cade2c1561a5 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:29.071460 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-79b44c2d-ac49-467c-8734-cade2c1561a5 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:29.407992 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-be58a607-43ea-4612-b88d-78b329b88982 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:53:29.434349 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-be58a607-43ea-4612-b88d-78b329b88982 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:53:29.436789 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-be58a607-43ea-4612-b88d-78b329b88982 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:53:29.438457 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-be58a607-43ea-4612-b88d-78b329b88982 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] 10.222.0.18 "GET /compute/v2.1/servers/4c7b99a9-2ec4-4f4b-98e7-8e1ea2103735" status: 200 len: 1812 microversion: 2.25 time: 1.396100 Oct 22 20:53:29.439620 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 649/1208] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 20:53:28 2022] GET /compute/v2.1/servers/4c7b99a9-2ec4-4f4b-98e7-8e1ea2103735 => generated 1812 bytes in 1398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 20:53:29.444750 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-86989277-2747-4f4b-9a31-7a5abe303ce0 tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Calling method '.version_select at 0x7fd3a4519700>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:53:29.540016 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-86989277-2747-4f4b-9a31-7a5abe303ce0 tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] 10.222.0.18 "GET /compute/v2.1/images/9585a413-1cc7-4173-a4e4-f771201c7779" status: 200 len: 1424 microversion: 2.1 time: 0.098972 Oct 22 20:53:29.540645 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 650/1209] 10.222.0.18 () {58 vars in 1233 bytes} [Sat Oct 22 20:53:29 2022] GET /compute/v2.1/images/9585a413-1cc7-4173-a4e4-f771201c7779 => generated 1424 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:53:29.565348 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-76281ba0-a26d-42f1-8461-43f112f2021a tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:53:29.565995 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-76281ba0-a26d-42f1-8461-43f112f2021a tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] [instance: c475672d-99ba-4c6a-abaa-3332a392534d] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:53:29.602740 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-76281ba0-a26d-42f1-8461-43f112f2021a tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:29.604067 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-76281ba0-a26d-42f1-8461-43f112f2021a tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:29.604500 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-76281ba0-a26d-42f1-8461-43f112f2021a tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:29.605278 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-76281ba0-a26d-42f1-8461-43f112f2021a tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:29.605759 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-76281ba0-a26d-42f1-8461-43f112f2021a tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:29.629492 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-76281ba0-a26d-42f1-8461-43f112f2021a tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:29.849039 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-79b44c2d-ac49-467c-8734-cade2c1561a5 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7f48d18691d4473bbe0284c44f14d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bacf9909082440f8a201771b64a75fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:53:29.868044 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-79b44c2d-ac49-467c-8734-cade2c1561a5 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] 10.222.0.18 "GET /compute/v2.1/servers/f2f50f6b-6a3e-449f-836e-bd897f78279c" status: 200 len: 1355 microversion: 2.1 time: 0.851074 Oct 22 20:53:29.870162 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 560/1210] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:53:29 2022] GET /compute/v2.1/servers/f2f50f6b-6a3e-449f-836e-bd897f78279c => generated 1355 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:53:29.892796 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-5f3684e2-cdd1-4b16-9b12-04f85c593f89 tempest-TenantUsagesTestJSON-743245380 tempest-TenantUsagesTestJSON-743245380-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:53:29.894576 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-5f3684e2-cdd1-4b16-9b12-04f85c593f89 tempest-TenantUsagesTestJSON-743245380 tempest-TenantUsagesTestJSON-743245380-project] [instance: 49ed4929-87c4-4ef4-8b46-c4bb3ca5be9a] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:53:29.914941 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-76281ba0-a26d-42f1-8461-43f112f2021a tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34f8af8ee2b545bead90fffd6c6c4896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48413ed1ac4e1ea65fb38f097881db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:53:29.935532 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-76281ba0-a26d-42f1-8461-43f112f2021a tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] 10.222.0.18 "GET /compute/v2.1/servers/c475672d-99ba-4c6a-abaa-3332a392534d" status: 200 len: 1613 microversion: 2.1 time: 0.393700 Oct 22 20:53:29.937967 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 651/1211] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:53:29 2022] GET /compute/v2.1/servers/c475672d-99ba-4c6a-abaa-3332a392534d => generated 1613 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:53:29.953741 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-dbfa83e3-c796-432d-bdf1-c8100da08c79 req-e64b2fe2-ddce-44d8-a411-cb36670ce42c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2f50f6b-6a3e-449f-836e-bd897f78279c", "tag": "a1f62079-48cd-4898-b101-1f21b055979f"}, {"name": "network-changed", "server_uuid": "4c7b99a9-2ec4-4f4b-98e7-8e1ea2103735", "tag": "54a65686-35c5-4655-a6b6-8d82393a2555"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:53:29.992383 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_api:INSERT=1,nova_api:SELECT=92,nova_api:DELETE=5,nova_api:UPDATE=2 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:53:29.997139 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-dbfa83e3-c796-432d-bdf1-c8100da08c79 req-e64b2fe2-ddce-44d8-a411-cb36670ce42c service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:29.998269 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-dbfa83e3-c796-432d-bdf1-c8100da08c79 req-e64b2fe2-ddce-44d8-a411-cb36670ce42c service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:30.000221 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-dbfa83e3-c796-432d-bdf1-c8100da08c79 req-e64b2fe2-ddce-44d8-a411-cb36670ce42c service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:30.034328 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-dbfa83e3-c796-432d-bdf1-c8100da08c79 req-e64b2fe2-ddce-44d8-a411-cb36670ce42c service nova] Creating event network-changed:a1f62079-48cd-4898-b101-1f21b055979f for instance f2f50f6b-6a3e-449f-836e-bd897f78279c on nch2-master-1 Oct 22 20:53:30.037369 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-dbfa83e3-c796-432d-bdf1-c8100da08c79 req-e64b2fe2-ddce-44d8-a411-cb36670ce42c service nova] Creating event network-changed:54a65686-35c5-4655-a6b6-8d82393a2555 for instance 4c7b99a9-2ec4-4f4b-98e7-8e1ea2103735 on nch1-master-1 Oct 22 20:53:30.086030 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-dbfa83e3-c796-432d-bdf1-c8100da08c79 req-e64b2fe2-ddce-44d8-a411-cb36670ce42c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.143582 Oct 22 20:53:30.088194 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 652/1212] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:53:29 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:53:30.100904 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-5f3684e2-cdd1-4b16-9b12-04f85c593f89 tempest-TenantUsagesTestJSON-743245380 tempest-TenantUsagesTestJSON-743245380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d35abfd0aa4dd09b9d0ad56faebd66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5695737326d4a83828b92469dd3e676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:53:30.116079 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-5f3684e2-cdd1-4b16-9b12-04f85c593f89 tempest-TenantUsagesTestJSON-743245380 tempest-TenantUsagesTestJSON-743245380-project] 10.222.0.18 "GET /compute/v2.1/servers/49ed4929-87c4-4ef4-8b46-c4bb3ca5be9a" status: 200 len: 1213 microversion: 2.1 time: 0.243770 Oct 22 20:53:30.117529 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-a4f26acd-dd3c-492f-9b92-32fe7852ae28 req-e6158b48-ffee-4d28-aaef-ac701596923f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c475672d-99ba-4c6a-abaa-3332a392534d", "name": "network-vif-deleted", "tag": "5a48f24d-ee6f-4bfc-9d60-4db767fe6dbd"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:53:30.122845 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 561/1213] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:53:29 2022] GET /compute/v2.1/servers/49ed4929-87c4-4ef4-8b46-c4bb3ca5be9a => generated 1213 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:53:30.141327 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-a4f26acd-dd3c-492f-9b92-32fe7852ae28 req-e6158b48-ffee-4d28-aaef-ac701596923f service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:30.145007 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-a4f26acd-dd3c-492f-9b92-32fe7852ae28 req-e6158b48-ffee-4d28-aaef-ac701596923f service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:30.145622 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-a4f26acd-dd3c-492f-9b92-32fe7852ae28 req-e6158b48-ffee-4d28-aaef-ac701596923f service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:30.185261 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-a4f26acd-dd3c-492f-9b92-32fe7852ae28 req-e6158b48-ffee-4d28-aaef-ac701596923f service nova] Creating event network-vif-deleted:5a48f24d-ee6f-4bfc-9d60-4db767fe6dbd for instance c475672d-99ba-4c6a-abaa-3332a392534d on nch1-master-1 Oct 22 20:53:30.201028 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-a4f26acd-dd3c-492f-9b92-32fe7852ae28 req-e6158b48-ffee-4d28-aaef-ac701596923f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105791 Oct 22 20:53:30.203627 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 653/1214] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:53:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:53:30.468747 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-60fa32b6-f2eb-4a8f-9440-144f22dafe2e tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:53:30.469740 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-60fa32b6-f2eb-4a8f-9440-144f22dafe2e tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] [instance: 4c7b99a9-2ec4-4f4b-98e7-8e1ea2103735] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:53:30.492284 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-60fa32b6-f2eb-4a8f-9440-144f22dafe2e tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:30.494093 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-60fa32b6-f2eb-4a8f-9440-144f22dafe2e tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:30.495888 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-60fa32b6-f2eb-4a8f-9440-144f22dafe2e tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:30.512242 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-60fa32b6-f2eb-4a8f-9440-144f22dafe2e tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:30.516264 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-60fa32b6-f2eb-4a8f-9440-144f22dafe2e tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:30.516951 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-60fa32b6-f2eb-4a8f-9440-144f22dafe2e tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:30.557529 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-90644f02-48ad-42a7-9229-dbd17429e4ab tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Calling method '.version_select at 0x7fd3a4446ca0>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:53:30.689750 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-90644f02-48ad-42a7-9229-dbd17429e4ab tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] 10.222.0.18 "GET /compute/v2.1/images/9585a413-1cc7-4173-a4e4-f771201c7779" status: 200 len: 1424 microversion: 2.1 time: 0.137344 Oct 22 20:53:30.690635 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 654/1215] 10.222.0.18 () {58 vars in 1233 bytes} [Sat Oct 22 20:53:30 2022] GET /compute/v2.1/images/9585a413-1cc7-4173-a4e4-f771201c7779 => generated 1424 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 20:53:30.893399 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-4791cced-db21-4f9d-bf66-c477daa8a698 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:53:30.895512 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-4791cced-db21-4f9d-bf66-c477daa8a698 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] [instance: f2f50f6b-6a3e-449f-836e-bd897f78279c] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:53:30.926111 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell0:SELECT=2 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:53:30.935395 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4791cced-db21-4f9d-bf66-c477daa8a698 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:30.936781 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4791cced-db21-4f9d-bf66-c477daa8a698 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:30.942302 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4791cced-db21-4f9d-bf66-c477daa8a698 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:30.943825 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4791cced-db21-4f9d-bf66-c477daa8a698 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:30.945196 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4791cced-db21-4f9d-bf66-c477daa8a698 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:30.947178 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4791cced-db21-4f9d-bf66-c477daa8a698 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:31.032361 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-60fa32b6-f2eb-4a8f-9440-144f22dafe2e tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:53:31.048571 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-60fa32b6-f2eb-4a8f-9440-144f22dafe2e tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:53:31.060896 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-60fa32b6-f2eb-4a8f-9440-144f22dafe2e tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:53:31.062240 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-60fa32b6-f2eb-4a8f-9440-144f22dafe2e tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] 10.222.0.18 "GET /compute/v2.1/servers/4c7b99a9-2ec4-4f4b-98e7-8e1ea2103735" status: 200 len: 1812 microversion: 2.25 time: 0.598020 Oct 22 20:53:31.062821 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 562/1216] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 20:53:30 2022] GET /compute/v2.1/servers/4c7b99a9-2ec4-4f4b-98e7-8e1ea2103735 => generated 1812 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 20:53:31.067467 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-e489ef13-afff-48d9-b0dc-64f86f39773c tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:53:31.068086 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-e489ef13-afff-48d9-b0dc-64f86f39773c tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] [instance: c475672d-99ba-4c6a-abaa-3332a392534d] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:53:31.082511 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e489ef13-afff-48d9-b0dc-64f86f39773c tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:31.082941 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e489ef13-afff-48d9-b0dc-64f86f39773c tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:31.083593 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e489ef13-afff-48d9-b0dc-64f86f39773c tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:31.084560 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e489ef13-afff-48d9-b0dc-64f86f39773c tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:31.085179 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e489ef13-afff-48d9-b0dc-64f86f39773c tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:31.085765 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e489ef13-afff-48d9-b0dc-64f86f39773c tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:31.157560 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e489ef13-afff-48d9-b0dc-64f86f39773c tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:31.167613 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e489ef13-afff-48d9-b0dc-64f86f39773c tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:31.168326 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e489ef13-afff-48d9-b0dc-64f86f39773c tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:31.168971 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.objects.instance [None req-e489ef13-afff-48d9-b0dc-64f86f39773c tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Lazy-loading 'fault' on Instance uuid c475672d-99ba-4c6a-abaa-3332a392534d {{(pid=138744) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 20:53:31.268846 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-e489ef13-afff-48d9-b0dc-64f86f39773c tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34f8af8ee2b545bead90fffd6c6c4896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48413ed1ac4e1ea65fb38f097881db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:53:31.279127 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-e489ef13-afff-48d9-b0dc-64f86f39773c tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] 10.222.0.18 "GET /compute/v2.1/servers/c475672d-99ba-4c6a-abaa-3332a392534d" status: 200 len: 1330 microversion: 2.1 time: 0.215234 Oct 22 20:53:31.292863 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 563/1217] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:53:31 2022] GET /compute/v2.1/servers/c475672d-99ba-4c6a-abaa-3332a392534d => generated 1330 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:53:31.312854 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-741c5e56-9f7f-419e-a992-a91389618d7b tempest-TenantUsagesTestJSON-743245380 tempest-TenantUsagesTestJSON-743245380-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:53:31.315699 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-741c5e56-9f7f-419e-a992-a91389618d7b tempest-TenantUsagesTestJSON-743245380 tempest-TenantUsagesTestJSON-743245380-project] [instance: 49ed4929-87c4-4ef4-8b46-c4bb3ca5be9a] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:53:31.325293 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-741c5e56-9f7f-419e-a992-a91389618d7b tempest-TenantUsagesTestJSON-743245380 tempest-TenantUsagesTestJSON-743245380-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:31.326248 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-741c5e56-9f7f-419e-a992-a91389618d7b tempest-TenantUsagesTestJSON-743245380 tempest-TenantUsagesTestJSON-743245380-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:31.326889 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-741c5e56-9f7f-419e-a992-a91389618d7b tempest-TenantUsagesTestJSON-743245380 tempest-TenantUsagesTestJSON-743245380-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:31.329215 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-741c5e56-9f7f-419e-a992-a91389618d7b tempest-TenantUsagesTestJSON-743245380 tempest-TenantUsagesTestJSON-743245380-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:31.330233 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-741c5e56-9f7f-419e-a992-a91389618d7b tempest-TenantUsagesTestJSON-743245380 tempest-TenantUsagesTestJSON-743245380-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:31.330902 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-741c5e56-9f7f-419e-a992-a91389618d7b tempest-TenantUsagesTestJSON-743245380 tempest-TenantUsagesTestJSON-743245380-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:31.766800 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-741c5e56-9f7f-419e-a992-a91389618d7b tempest-TenantUsagesTestJSON-743245380 tempest-TenantUsagesTestJSON-743245380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d35abfd0aa4dd09b9d0ad56faebd66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5695737326d4a83828b92469dd3e676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:53:31.778793 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-741c5e56-9f7f-419e-a992-a91389618d7b tempest-TenantUsagesTestJSON-743245380 tempest-TenantUsagesTestJSON-743245380-project] 10.222.0.18 "GET /compute/v2.1/servers/49ed4929-87c4-4ef4-8b46-c4bb3ca5be9a" status: 200 len: 1209 microversion: 2.1 time: 0.484517 Oct 22 20:53:31.779402 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 564/1218] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:53:31 2022] GET /compute/v2.1/servers/49ed4929-87c4-4ef4-8b46-c4bb3ca5be9a => generated 1209 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:53:31.795560 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-5a8165bd-9d52-4ab3-883c-c960517e411e tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Calling method '.version_select at 0x7fd39fe69ca0>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:53:31.866333 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-4791cced-db21-4f9d-bf66-c477daa8a698 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7f48d18691d4473bbe0284c44f14d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bacf9909082440f8a201771b64a75fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:53:31.879132 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-5a8165bd-9d52-4ab3-883c-c960517e411e tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] 10.222.0.18 "GET /compute/v2.1/images/9585a413-1cc7-4173-a4e4-f771201c7779" status: 200 len: 1424 microversion: 2.1 time: 0.097031 Oct 22 20:53:31.881502 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-4791cced-db21-4f9d-bf66-c477daa8a698 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] 10.222.0.18 "GET /compute/v2.1/servers/f2f50f6b-6a3e-449f-836e-bd897f78279c" status: 200 len: 1355 microversion: 2.1 time: 0.994616 Oct 22 20:53:31.891354 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 655/1219] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:53:30 2022] GET /compute/v2.1/servers/f2f50f6b-6a3e-449f-836e-bd897f78279c => generated 1355 bytes in 1006 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:53:31.891929 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 565/1220] 10.222.0.18 () {58 vars in 1233 bytes} [Sat Oct 22 20:53:31 2022] GET /compute/v2.1/images/9585a413-1cc7-4173-a4e4-f771201c7779 => generated 1424 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:53:32.094009 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-17e7a607-6197-441c-ab30-bc25ea6e88b1 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:53:32.094663 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-17e7a607-6197-441c-ab30-bc25ea6e88b1 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] [instance: 4c7b99a9-2ec4-4f4b-98e7-8e1ea2103735] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:53:32.110723 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-17e7a607-6197-441c-ab30-bc25ea6e88b1 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:32.112515 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-17e7a607-6197-441c-ab30-bc25ea6e88b1 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:32.112977 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-17e7a607-6197-441c-ab30-bc25ea6e88b1 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:32.113759 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-17e7a607-6197-441c-ab30-bc25ea6e88b1 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:32.115581 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-17e7a607-6197-441c-ab30-bc25ea6e88b1 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:32.116066 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-17e7a607-6197-441c-ab30-bc25ea6e88b1 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:32.295160 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-de733e98-7af7-4e60-b697-beb78f009bba req-646a9d84-4655-4761-ab3e-3adabc2ee5be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2f50f6b-6a3e-449f-836e-bd897f78279c", "tag": "16c272f7-7571-4436-bc1e-a2535cce8300"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:53:32.327312 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-de733e98-7af7-4e60-b697-beb78f009bba req-646a9d84-4655-4761-ab3e-3adabc2ee5be service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:32.330579 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-de733e98-7af7-4e60-b697-beb78f009bba req-646a9d84-4655-4761-ab3e-3adabc2ee5be service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:32.332366 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-de733e98-7af7-4e60-b697-beb78f009bba req-646a9d84-4655-4761-ab3e-3adabc2ee5be service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:32.361911 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-de733e98-7af7-4e60-b697-beb78f009bba req-646a9d84-4655-4761-ab3e-3adabc2ee5be service nova] Creating event network-changed:16c272f7-7571-4436-bc1e-a2535cce8300 for instance f2f50f6b-6a3e-449f-836e-bd897f78279c on nch2-master-1 Oct 22 20:53:32.370664 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-de733e98-7af7-4e60-b697-beb78f009bba req-646a9d84-4655-4761-ab3e-3adabc2ee5be service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083968 Oct 22 20:53:32.386474 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 566/1221] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:53:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:53:32.398183 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-6f36ae0f-e85d-4794-9a15-bf7f8d6b4cab tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:53:32.399253 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-6f36ae0f-e85d-4794-9a15-bf7f8d6b4cab tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] [instance: c475672d-99ba-4c6a-abaa-3332a392534d] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:53:32.420706 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-17e7a607-6197-441c-ab30-bc25ea6e88b1 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:53:32.430627 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6f36ae0f-e85d-4794-9a15-bf7f8d6b4cab tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:32.431436 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6f36ae0f-e85d-4794-9a15-bf7f8d6b4cab tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:32.433645 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6f36ae0f-e85d-4794-9a15-bf7f8d6b4cab tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:32.435256 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6f36ae0f-e85d-4794-9a15-bf7f8d6b4cab tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:32.438405 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6f36ae0f-e85d-4794-9a15-bf7f8d6b4cab tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:32.441586 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6f36ae0f-e85d-4794-9a15-bf7f8d6b4cab tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:32.446562 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-17e7a607-6197-441c-ab30-bc25ea6e88b1 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:53:32.451561 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-17e7a607-6197-441c-ab30-bc25ea6e88b1 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:53:32.457235 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-17e7a607-6197-441c-ab30-bc25ea6e88b1 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] 10.222.0.18 "GET /compute/v2.1/servers/4c7b99a9-2ec4-4f4b-98e7-8e1ea2103735" status: 200 len: 1812 microversion: 2.25 time: 0.368308 Oct 22 20:53:32.461480 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 656/1222] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 20:53:32 2022] GET /compute/v2.1/servers/4c7b99a9-2ec4-4f4b-98e7-8e1ea2103735 => generated 1812 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 20:53:32.533285 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-6f36ae0f-e85d-4794-9a15-bf7f8d6b4cab tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] HTTP exception thrown: Instance c475672d-99ba-4c6a-abaa-3332a392534d could not be found. Oct 22 20:53:32.545376 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-6f36ae0f-e85d-4794-9a15-bf7f8d6b4cab tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Request method failure captured: Oct 22 20:53:32.545376 ncdv-master-1 devstack@n-api.service[138744]: request: GET /compute/v2.1/servers/c475672d-99ba-4c6a-abaa-3332a392534d HTTP/1.1 Oct 22 20:53:32.545376 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 20:53:32.545376 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 20:53:32.545376 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 20:53:32.545376 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 0 Oct 22 20:53:32.545376 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 20:53:32.545376 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 20:53:32.545376 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 20:53:32.545376 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 20:53:32.545376 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVFeNLLa88d1W7ImIcuLaw50drmGidKxt_ChF0JiWTA0dltYpiA9XWFUnls11INe_Vq3fF2Ubja8cWIIoGDLDq1pnfwhFXGbigl7-FxmudNFbqymJr6DV5ZVhkxQYhffUu6bf0gRwkPHFjfDIqYUFqXu3-aJfSfTBGJxlqhZwHc1ra5I Oct 22 20:53:32.545376 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 20:53:32.545376 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 20:53:32.545376 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 20:53:32.545376 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 20:53:32.545376 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 20:53:32.545376 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 20:53:32.545376 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: 3e48413ed1ac4e1ea65fb38f097881db Oct 22 20:53:32.545376 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-VolumesAdminNegativeTest-1470267362 Oct 22 20:53:32.545376 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 20:53:32.545376 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 20:53:32.545376 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_3e48413ed1ac4e1ea65fb38f097881db"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/3e48413ed1ac4e1ea65fb38f097881db"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/3e48413ed1ac4e1ea65fb38f097881db"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/3e48413ed1ac4e1ea65fb38f097881db"}]}] Oct 22 20:53:32.545376 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-VolumesAdminNegativeTest-1470267362 Oct 22 20:53:32.545376 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: 3e48413ed1ac4e1ea65fb38f097881db Oct 22 20:53:32.545376 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1470267362 Oct 22 20:53:32.545376 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-VolumesAdminNegativeTest-1470267362-project Oct 22 20:53:32.545376 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 20:53:32.545376 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 20:53:32.545376 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: 34f8af8ee2b545bead90fffd6c6c4896 Oct 22 20:53:32.545376 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-VolumesAdminNegativeTest-1470267362-project Oct 22 20:53:32.545376 ncdv-master-1 devstack@n-api.service[138744]: method: > Oct 22 20:53:32.545376 ncdv-master-1 devstack@n-api.service[138744]: exception: Instance c475672d-99ba-4c6a-abaa-3332a392534d could not be found. Oct 22 20:53:32.545376 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': 'c475672d-99ba-4c6a-abaa-3332a392534d'} Oct 22 20:53:32.545376 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:53:32.545376 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:53:32.545376 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 20:53:32.545376 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 20:53:32.545376 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 20:53:32.545376 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 20:53:32.545376 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 20:53:32.545376 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 20:53:32.545376 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 20:53:32.545376 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 20:53:32.545376 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c475672d-99ba-4c6a-abaa-3332a392534d could not be found. Oct 22 20:53:32.545376 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:53:32.545376 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:53:32.545376 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:53:32.545376 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:53:32.545376 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:53:32.545376 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:53:32.545376 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:53:32.545376 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:53:32.545376 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:53:32.545376 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:53:32.545376 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 20:53:32.545376 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 20:53:32.545376 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 20:53:32.545376 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 20:53:32.545376 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 20:53:32.545376 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 20:53:32.545376 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c475672d-99ba-4c6a-abaa-3332a392534d could not be found. Oct 22 20:53:32.545376 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:53:32.545376 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:53:32.545376 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:53:32.549543 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:53:32.549543 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:53:32.549543 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:53:32.549543 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 20:53:32.549543 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 20:53:32.549543 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c475672d-99ba-4c6a-abaa-3332a392534d could not be found. Oct 22 20:53:32.549543 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:53:32.552237 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-6f36ae0f-e85d-4794-9a15-bf7f8d6b4cab tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Returning 404 to user: Instance c475672d-99ba-4c6a-abaa-3332a392534d could not be found. {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:53:32.560658 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-6f36ae0f-e85d-4794-9a15-bf7f8d6b4cab tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] 10.222.0.18 "GET /compute/v2.1/servers/c475672d-99ba-4c6a-abaa-3332a392534d" status: 404 len: 111 microversion: 2.1 time: 0.169555 Oct 22 20:53:32.564552 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 567/1223] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:53:32 2022] GET /compute/v2.1/servers/c475672d-99ba-4c6a-abaa-3332a392534d => generated 111 bytes in 177 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 20:53:32.576129 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-47f34a3c-0c47-4041-bb47-e16363f911d1 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] Calling method '.version_select at 0x7fd3a435aa60>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:53:32.662892 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-47f34a3c-0c47-4041-bb47-e16363f911d1 tempest-VolumesAdminNegativeTest-1470267362 tempest-VolumesAdminNegativeTest-1470267362-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-609268957" status: 202 len: 0 microversion: 2.1 time: 0.092212 Oct 22 20:53:32.667877 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 657/1224] 10.222.0.18 () {58 vars in 1218 bytes} [Sat Oct 22 20:53:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-609268957 => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 20:53:32.811797 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-1db874b1-3c23-48db-af03-24f155c7b10b tempest-TenantUsagesTestJSON-743245380 tempest-TenantUsagesTestJSON-743245380-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:53:32.812905 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-1db874b1-3c23-48db-af03-24f155c7b10b tempest-TenantUsagesTestJSON-743245380 tempest-TenantUsagesTestJSON-743245380-project] [instance: 49ed4929-87c4-4ef4-8b46-c4bb3ca5be9a] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:53:32.823821 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1db874b1-3c23-48db-af03-24f155c7b10b tempest-TenantUsagesTestJSON-743245380 tempest-TenantUsagesTestJSON-743245380-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:32.824581 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1db874b1-3c23-48db-af03-24f155c7b10b tempest-TenantUsagesTestJSON-743245380 tempest-TenantUsagesTestJSON-743245380-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:32.831988 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1db874b1-3c23-48db-af03-24f155c7b10b tempest-TenantUsagesTestJSON-743245380 tempest-TenantUsagesTestJSON-743245380-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:32.837560 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1db874b1-3c23-48db-af03-24f155c7b10b tempest-TenantUsagesTestJSON-743245380 tempest-TenantUsagesTestJSON-743245380-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:32.839726 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1db874b1-3c23-48db-af03-24f155c7b10b tempest-TenantUsagesTestJSON-743245380 tempest-TenantUsagesTestJSON-743245380-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:32.840497 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1db874b1-3c23-48db-af03-24f155c7b10b tempest-TenantUsagesTestJSON-743245380 tempest-TenantUsagesTestJSON-743245380-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:32.902355 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-5add2ca9-1cf0-44cb-a8a2-f1f8c60283dd tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Calling method '.version_select at 0x7fd3a412f4c0>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:53:32.978798 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-5add2ca9-1cf0-44cb-a8a2-f1f8c60283dd tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] 10.222.0.18 "GET /compute/v2.1/images/9585a413-1cc7-4173-a4e4-f771201c7779" status: 200 len: 1424 microversion: 2.1 time: 0.082880 Oct 22 20:53:32.984555 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 658/1225] 10.222.0.18 () {58 vars in 1233 bytes} [Sat Oct 22 20:53:32 2022] GET /compute/v2.1/images/9585a413-1cc7-4173-a4e4-f771201c7779 => generated 1424 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 20:53:33.009420 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-f52506b6-7965-48c2-ad4d-0a2462f3fef7 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:53:33.010705 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-f52506b6-7965-48c2-ad4d-0a2462f3fef7 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] [instance: f2f50f6b-6a3e-449f-836e-bd897f78279c] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:53:33.022061 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-1db874b1-3c23-48db-af03-24f155c7b10b tempest-TenantUsagesTestJSON-743245380 tempest-TenantUsagesTestJSON-743245380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d35abfd0aa4dd09b9d0ad56faebd66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5695737326d4a83828b92469dd3e676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:53:33.033101 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f52506b6-7965-48c2-ad4d-0a2462f3fef7 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:33.035754 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f52506b6-7965-48c2-ad4d-0a2462f3fef7 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:33.037339 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f52506b6-7965-48c2-ad4d-0a2462f3fef7 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:33.038573 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f52506b6-7965-48c2-ad4d-0a2462f3fef7 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:33.038878 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-1db874b1-3c23-48db-af03-24f155c7b10b tempest-TenantUsagesTestJSON-743245380 tempest-TenantUsagesTestJSON-743245380-project] 10.222.0.18 "GET /compute/v2.1/servers/49ed4929-87c4-4ef4-8b46-c4bb3ca5be9a" status: 200 len: 1283 microversion: 2.1 time: 0.238245 Oct 22 20:53:33.039727 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f52506b6-7965-48c2-ad4d-0a2462f3fef7 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:33.042158 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f52506b6-7965-48c2-ad4d-0a2462f3fef7 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:33.042993 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 568/1226] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:53:32 2022] GET /compute/v2.1/servers/49ed4929-87c4-4ef4-8b46-c4bb3ca5be9a => generated 1283 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:53:33.406807 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-f52506b6-7965-48c2-ad4d-0a2462f3fef7 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7f48d18691d4473bbe0284c44f14d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bacf9909082440f8a201771b64a75fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:53:33.429916 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-f52506b6-7965-48c2-ad4d-0a2462f3fef7 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] 10.222.0.18 "GET /compute/v2.1/servers/f2f50f6b-6a3e-449f-836e-bd897f78279c" status: 200 len: 1355 microversion: 2.1 time: 0.441588 Oct 22 20:53:33.444132 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 659/1227] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:53:32 2022] GET /compute/v2.1/servers/f2f50f6b-6a3e-449f-836e-bd897f78279c => generated 1355 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:53:33.483425 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-511e12ed-bafa-464f-aab9-80ddc1d16acd tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:53:33.484835 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-511e12ed-bafa-464f-aab9-80ddc1d16acd tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] [instance: 4c7b99a9-2ec4-4f4b-98e7-8e1ea2103735] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:53:33.492340 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-511e12ed-bafa-464f-aab9-80ddc1d16acd tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:33.493193 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-511e12ed-bafa-464f-aab9-80ddc1d16acd tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:33.493807 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-511e12ed-bafa-464f-aab9-80ddc1d16acd tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:33.495069 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-511e12ed-bafa-464f-aab9-80ddc1d16acd tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:33.495770 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-511e12ed-bafa-464f-aab9-80ddc1d16acd tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:33.496367 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-511e12ed-bafa-464f-aab9-80ddc1d16acd tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:33.523890 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:SELECT=100 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:53:33.746962 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-511e12ed-bafa-464f-aab9-80ddc1d16acd tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:53:33.760568 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-511e12ed-bafa-464f-aab9-80ddc1d16acd tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:53:33.762746 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-511e12ed-bafa-464f-aab9-80ddc1d16acd tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:53:33.764607 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-511e12ed-bafa-464f-aab9-80ddc1d16acd tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] 10.222.0.18 "GET /compute/v2.1/servers/4c7b99a9-2ec4-4f4b-98e7-8e1ea2103735" status: 200 len: 1812 microversion: 2.25 time: 0.285276 Oct 22 20:53:33.765795 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 569/1228] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 20:53:33 2022] GET /compute/v2.1/servers/4c7b99a9-2ec4-4f4b-98e7-8e1ea2103735 => generated 1812 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 20:53:33.999216 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-901d55c4-2b82-4bb8-ab67-4bfba81f1378 tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Calling method '.version_select at 0x7fd3a44e90d0>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:53:34.070221 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-f66babc1-8b31-415f-8c3b-648fe7b53155 tempest-TenantUsagesTestJSON-743245380 tempest-TenantUsagesTestJSON-743245380-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:53:34.070853 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-f66babc1-8b31-415f-8c3b-648fe7b53155 tempest-TenantUsagesTestJSON-743245380 tempest-TenantUsagesTestJSON-743245380-project] [instance: 49ed4929-87c4-4ef4-8b46-c4bb3ca5be9a] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:53:34.090820 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-901d55c4-2b82-4bb8-ab67-4bfba81f1378 tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] 10.222.0.18 "GET /compute/v2.1/images/9585a413-1cc7-4173-a4e4-f771201c7779" status: 200 len: 1424 microversion: 2.1 time: 0.095446 Oct 22 20:53:34.122965 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 660/1229] 10.222.0.18 () {58 vars in 1233 bytes} [Sat Oct 22 20:53:33 2022] GET /compute/v2.1/images/9585a413-1cc7-4173-a4e4-f771201c7779 => generated 1424 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:53:34.124021 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f66babc1-8b31-415f-8c3b-648fe7b53155 tempest-TenantUsagesTestJSON-743245380 tempest-TenantUsagesTestJSON-743245380-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:34.128166 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f66babc1-8b31-415f-8c3b-648fe7b53155 tempest-TenantUsagesTestJSON-743245380 tempest-TenantUsagesTestJSON-743245380-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:34.128903 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f66babc1-8b31-415f-8c3b-648fe7b53155 tempest-TenantUsagesTestJSON-743245380 tempest-TenantUsagesTestJSON-743245380-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:34.132558 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f66babc1-8b31-415f-8c3b-648fe7b53155 tempest-TenantUsagesTestJSON-743245380 tempest-TenantUsagesTestJSON-743245380-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:34.133346 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f66babc1-8b31-415f-8c3b-648fe7b53155 tempest-TenantUsagesTestJSON-743245380 tempest-TenantUsagesTestJSON-743245380-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:34.134339 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f66babc1-8b31-415f-8c3b-648fe7b53155 tempest-TenantUsagesTestJSON-743245380 tempest-TenantUsagesTestJSON-743245380-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:34.459469 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-48dac5c0-2c89-4cab-ab89-fdb05ae876db tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:53:34.460669 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-48dac5c0-2c89-4cab-ab89-fdb05ae876db tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] [instance: f2f50f6b-6a3e-449f-836e-bd897f78279c] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:53:34.481448 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-48dac5c0-2c89-4cab-ab89-fdb05ae876db tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:34.484646 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-48dac5c0-2c89-4cab-ab89-fdb05ae876db tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:34.487159 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-48dac5c0-2c89-4cab-ab89-fdb05ae876db tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:34.490318 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-48dac5c0-2c89-4cab-ab89-fdb05ae876db tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:34.491237 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-48dac5c0-2c89-4cab-ab89-fdb05ae876db tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:34.491993 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-48dac5c0-2c89-4cab-ab89-fdb05ae876db tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:34.603699 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-f66babc1-8b31-415f-8c3b-648fe7b53155 tempest-TenantUsagesTestJSON-743245380 tempest-TenantUsagesTestJSON-743245380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d35abfd0aa4dd09b9d0ad56faebd66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5695737326d4a83828b92469dd3e676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:53:34.619680 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-f66babc1-8b31-415f-8c3b-648fe7b53155 tempest-TenantUsagesTestJSON-743245380 tempest-TenantUsagesTestJSON-743245380-project] 10.222.0.18 "GET /compute/v2.1/servers/49ed4929-87c4-4ef4-8b46-c4bb3ca5be9a" status: 200 len: 1271 microversion: 2.1 time: 0.553836 Oct 22 20:53:34.622215 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 570/1230] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:53:34 2022] GET /compute/v2.1/servers/49ed4929-87c4-4ef4-8b46-c4bb3ca5be9a => generated 1271 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 20:53:34.797712 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-d2bc45e0-95e6-40f4-b95d-30cf9192b024 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:53:34.798361 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-d2bc45e0-95e6-40f4-b95d-30cf9192b024 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] [instance: 4c7b99a9-2ec4-4f4b-98e7-8e1ea2103735] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:53:34.822144 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d2bc45e0-95e6-40f4-b95d-30cf9192b024 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:34.822797 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d2bc45e0-95e6-40f4-b95d-30cf9192b024 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:34.823483 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d2bc45e0-95e6-40f4-b95d-30cf9192b024 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:34.824406 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d2bc45e0-95e6-40f4-b95d-30cf9192b024 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:34.825025 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d2bc45e0-95e6-40f4-b95d-30cf9192b024 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:34.825770 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d2bc45e0-95e6-40f4-b95d-30cf9192b024 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:35.100997 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-48dac5c0-2c89-4cab-ab89-fdb05ae876db tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7f48d18691d4473bbe0284c44f14d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bacf9909082440f8a201771b64a75fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:53:35.117714 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-48dac5c0-2c89-4cab-ab89-fdb05ae876db tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] 10.222.0.18 "GET /compute/v2.1/servers/f2f50f6b-6a3e-449f-836e-bd897f78279c" status: 200 len: 1355 microversion: 2.1 time: 0.663121 Oct 22 20:53:35.126032 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 661/1231] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:53:34 2022] GET /compute/v2.1/servers/f2f50f6b-6a3e-449f-836e-bd897f78279c => generated 1355 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:53:35.155810 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-aadb306b-08f3-408f-80fb-6707a0a6b4d8 tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Calling method '.version_select at 0x7fd3a45199d0>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:53:35.230629 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-aadb306b-08f3-408f-80fb-6707a0a6b4d8 tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] 10.222.0.18 "GET /compute/v2.1/images/9585a413-1cc7-4173-a4e4-f771201c7779" status: 200 len: 1424 microversion: 2.1 time: 0.099847 Oct 22 20:53:35.231441 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 662/1232] 10.222.0.18 () {58 vars in 1233 bytes} [Sat Oct 22 20:53:35 2022] GET /compute/v2.1/images/9585a413-1cc7-4173-a4e4-f771201c7779 => generated 1424 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:53:35.292059 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-d2bc45e0-95e6-40f4-b95d-30cf9192b024 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:53:35.305654 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-d2bc45e0-95e6-40f4-b95d-30cf9192b024 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:53:35.307019 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-d2bc45e0-95e6-40f4-b95d-30cf9192b024 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:53:35.316546 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-d2bc45e0-95e6-40f4-b95d-30cf9192b024 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] 10.222.0.18 "GET /compute/v2.1/servers/4c7b99a9-2ec4-4f4b-98e7-8e1ea2103735" status: 200 len: 1812 microversion: 2.25 time: 0.528152 Oct 22 20:53:35.317156 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 571/1233] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 20:53:34 2022] GET /compute/v2.1/servers/4c7b99a9-2ec4-4f4b-98e7-8e1ea2103735 => generated 1812 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 22 20:53:35.646362 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-c99e3ddf-75a5-4fd1-93c9-c84315e52592 tempest-TenantUsagesTestJSON-743245380 tempest-TenantUsagesTestJSON-743245380-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:53:35.647145 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-c99e3ddf-75a5-4fd1-93c9-c84315e52592 tempest-TenantUsagesTestJSON-743245380 tempest-TenantUsagesTestJSON-743245380-project] [instance: 49ed4929-87c4-4ef4-8b46-c4bb3ca5be9a] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:53:35.656025 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c99e3ddf-75a5-4fd1-93c9-c84315e52592 tempest-TenantUsagesTestJSON-743245380 tempest-TenantUsagesTestJSON-743245380-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:35.656526 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c99e3ddf-75a5-4fd1-93c9-c84315e52592 tempest-TenantUsagesTestJSON-743245380 tempest-TenantUsagesTestJSON-743245380-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:35.656975 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c99e3ddf-75a5-4fd1-93c9-c84315e52592 tempest-TenantUsagesTestJSON-743245380 tempest-TenantUsagesTestJSON-743245380-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:35.660267 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c99e3ddf-75a5-4fd1-93c9-c84315e52592 tempest-TenantUsagesTestJSON-743245380 tempest-TenantUsagesTestJSON-743245380-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:35.661577 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c99e3ddf-75a5-4fd1-93c9-c84315e52592 tempest-TenantUsagesTestJSON-743245380 tempest-TenantUsagesTestJSON-743245380-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:35.663019 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c99e3ddf-75a5-4fd1-93c9-c84315e52592 tempest-TenantUsagesTestJSON-743245380 tempest-TenantUsagesTestJSON-743245380-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:35.738632 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-f3c0b46b-44ef-4e9e-8355-c2e1d9b0ecb1 req-ea74d153-0215-4908-a97b-128f5d2b423f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2f50f6b-6a3e-449f-836e-bd897f78279c", "tag": "8be47bf4-2a35-45fb-93e7-e1ccf22b8551"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:53:35.756377 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-f3c0b46b-44ef-4e9e-8355-c2e1d9b0ecb1 req-ea74d153-0215-4908-a97b-128f5d2b423f service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:35.757794 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-f3c0b46b-44ef-4e9e-8355-c2e1d9b0ecb1 req-ea74d153-0215-4908-a97b-128f5d2b423f service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:35.759050 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-f3c0b46b-44ef-4e9e-8355-c2e1d9b0ecb1 req-ea74d153-0215-4908-a97b-128f5d2b423f service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:35.774841 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-f3c0b46b-44ef-4e9e-8355-c2e1d9b0ecb1 req-ea74d153-0215-4908-a97b-128f5d2b423f service nova] Creating event network-changed:8be47bf4-2a35-45fb-93e7-e1ccf22b8551 for instance f2f50f6b-6a3e-449f-836e-bd897f78279c on nch2-master-1 Oct 22 20:53:35.780909 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-f3c0b46b-44ef-4e9e-8355-c2e1d9b0ecb1 req-ea74d153-0215-4908-a97b-128f5d2b423f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.190582 Oct 22 20:53:35.782186 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 663/1234] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:53:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:53:35.934956 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-c99e3ddf-75a5-4fd1-93c9-c84315e52592 tempest-TenantUsagesTestJSON-743245380 tempest-TenantUsagesTestJSON-743245380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d35abfd0aa4dd09b9d0ad56faebd66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5695737326d4a83828b92469dd3e676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:53:35.943916 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-c99e3ddf-75a5-4fd1-93c9-c84315e52592 tempest-TenantUsagesTestJSON-743245380 tempest-TenantUsagesTestJSON-743245380-project] 10.222.0.18 "GET /compute/v2.1/servers/49ed4929-87c4-4ef4-8b46-c4bb3ca5be9a" status: 200 len: 1313 microversion: 2.1 time: 0.301291 Oct 22 20:53:35.947084 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 572/1235] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:53:35 2022] GET /compute/v2.1/servers/49ed4929-87c4-4ef4-8b46-c4bb3ca5be9a => generated 1313 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 20:53:36.164192 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-0ed28116-e668-41cd-a8ce-964569c75495 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:53:36.172933 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-0ed28116-e668-41cd-a8ce-964569c75495 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] [instance: f2f50f6b-6a3e-449f-836e-bd897f78279c] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:53:36.184309 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0ed28116-e668-41cd-a8ce-964569c75495 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:36.185227 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0ed28116-e668-41cd-a8ce-964569c75495 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:36.186030 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0ed28116-e668-41cd-a8ce-964569c75495 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:36.186950 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0ed28116-e668-41cd-a8ce-964569c75495 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:36.187672 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0ed28116-e668-41cd-a8ce-964569c75495 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:36.188321 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0ed28116-e668-41cd-a8ce-964569c75495 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:36.297328 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-d7804720-ba5c-42ae-bcd6-64c465824b80 req-f10a16fa-b402-4e2b-a51c-36e147bdad2a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49ed4929-87c4-4ef4-8b46-c4bb3ca5be9a", "tag": "cb168a1a-ebc7-470c-8810-5b9a894facd3"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:53:36.310975 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-d7804720-ba5c-42ae-bcd6-64c465824b80 req-f10a16fa-b402-4e2b-a51c-36e147bdad2a service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:36.311737 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-d7804720-ba5c-42ae-bcd6-64c465824b80 req-f10a16fa-b402-4e2b-a51c-36e147bdad2a service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:36.312326 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-d7804720-ba5c-42ae-bcd6-64c465824b80 req-f10a16fa-b402-4e2b-a51c-36e147bdad2a service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:36.326709 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-d7804720-ba5c-42ae-bcd6-64c465824b80 req-f10a16fa-b402-4e2b-a51c-36e147bdad2a service nova] Creating event network-changed:cb168a1a-ebc7-470c-8810-5b9a894facd3 for instance 49ed4929-87c4-4ef4-8b46-c4bb3ca5be9a on nch1-master-1 Oct 22 20:53:36.334003 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-d7804720-ba5c-42ae-bcd6-64c465824b80 req-f10a16fa-b402-4e2b-a51c-36e147bdad2a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.150537 Oct 22 20:53:36.335424 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 573/1236] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:53:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 20:53:36.341566 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-552df236-bd72-4920-b9d1-35661fcdaabb tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Calling method '.version_select at 0x7fd39feb7dc0>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:53:36.407285 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-552df236-bd72-4920-b9d1-35661fcdaabb tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] 10.222.0.18 "GET /compute/v2.1/images/9585a413-1cc7-4173-a4e4-f771201c7779" status: 200 len: 1424 microversion: 2.1 time: 0.070441 Oct 22 20:53:36.408644 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 574/1237] 10.222.0.18 () {58 vars in 1233 bytes} [Sat Oct 22 20:53:36 2022] GET /compute/v2.1/images/9585a413-1cc7-4173-a4e4-f771201c7779 => generated 1424 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:53:36.423757 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-e304ac1c-06df-4e5b-aaab-6a3135fdee59 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:53:36.424937 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-e304ac1c-06df-4e5b-aaab-6a3135fdee59 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] [instance: 4c7b99a9-2ec4-4f4b-98e7-8e1ea2103735] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:53:36.433921 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e304ac1c-06df-4e5b-aaab-6a3135fdee59 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:36.436619 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e304ac1c-06df-4e5b-aaab-6a3135fdee59 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:36.437848 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e304ac1c-06df-4e5b-aaab-6a3135fdee59 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:36.438628 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e304ac1c-06df-4e5b-aaab-6a3135fdee59 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:36.439319 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e304ac1c-06df-4e5b-aaab-6a3135fdee59 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:36.439975 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e304ac1c-06df-4e5b-aaab-6a3135fdee59 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:36.921026 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-0ed28116-e668-41cd-a8ce-964569c75495 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7f48d18691d4473bbe0284c44f14d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bacf9909082440f8a201771b64a75fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:53:36.934476 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-0ed28116-e668-41cd-a8ce-964569c75495 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] 10.222.0.18 "GET /compute/v2.1/servers/f2f50f6b-6a3e-449f-836e-bd897f78279c" status: 200 len: 1355 microversion: 2.1 time: 0.786201 Oct 22 20:53:36.937242 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 664/1238] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:53:36 2022] GET /compute/v2.1/servers/f2f50f6b-6a3e-449f-836e-bd897f78279c => generated 1355 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 20:53:36.969161 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-f2e879ba-3a55-4ede-b8f2-75b49084e143 tempest-TenantUsagesTestJSON-743245380 tempest-TenantUsagesTestJSON-743245380-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:53:36.970136 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-f2e879ba-3a55-4ede-b8f2-75b49084e143 tempest-TenantUsagesTestJSON-743245380 tempest-TenantUsagesTestJSON-743245380-project] [instance: 49ed4929-87c4-4ef4-8b46-c4bb3ca5be9a] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:53:36.981047 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f2e879ba-3a55-4ede-b8f2-75b49084e143 tempest-TenantUsagesTestJSON-743245380 tempest-TenantUsagesTestJSON-743245380-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:36.981820 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f2e879ba-3a55-4ede-b8f2-75b49084e143 tempest-TenantUsagesTestJSON-743245380 tempest-TenantUsagesTestJSON-743245380-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:36.982521 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f2e879ba-3a55-4ede-b8f2-75b49084e143 tempest-TenantUsagesTestJSON-743245380 tempest-TenantUsagesTestJSON-743245380-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:36.983734 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f2e879ba-3a55-4ede-b8f2-75b49084e143 tempest-TenantUsagesTestJSON-743245380 tempest-TenantUsagesTestJSON-743245380-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:36.984353 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f2e879ba-3a55-4ede-b8f2-75b49084e143 tempest-TenantUsagesTestJSON-743245380 tempest-TenantUsagesTestJSON-743245380-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:36.984942 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f2e879ba-3a55-4ede-b8f2-75b49084e143 tempest-TenantUsagesTestJSON-743245380 tempest-TenantUsagesTestJSON-743245380-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:37.092646 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-e304ac1c-06df-4e5b-aaab-6a3135fdee59 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:53:37.110803 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-e304ac1c-06df-4e5b-aaab-6a3135fdee59 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:53:37.115223 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-e304ac1c-06df-4e5b-aaab-6a3135fdee59 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:53:37.117348 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-e304ac1c-06df-4e5b-aaab-6a3135fdee59 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] 10.222.0.18 "GET /compute/v2.1/servers/4c7b99a9-2ec4-4f4b-98e7-8e1ea2103735" status: 200 len: 1812 microversion: 2.25 time: 0.707366 Oct 22 20:53:37.118569 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 575/1239] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 20:53:36 2022] GET /compute/v2.1/servers/4c7b99a9-2ec4-4f4b-98e7-8e1ea2103735 => generated 1812 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 20:53:37.290666 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-f2e879ba-3a55-4ede-b8f2-75b49084e143 tempest-TenantUsagesTestJSON-743245380 tempest-TenantUsagesTestJSON-743245380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d35abfd0aa4dd09b9d0ad56faebd66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5695737326d4a83828b92469dd3e676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:53:37.306648 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-f2e879ba-3a55-4ede-b8f2-75b49084e143 tempest-TenantUsagesTestJSON-743245380 tempest-TenantUsagesTestJSON-743245380-project] 10.222.0.18 "GET /compute/v2.1/servers/49ed4929-87c4-4ef4-8b46-c4bb3ca5be9a" status: 200 len: 1313 microversion: 2.1 time: 0.342768 Oct 22 20:53:37.317518 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 665/1240] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:53:36 2022] GET /compute/v2.1/servers/49ed4929-87c4-4ef4-8b46-c4bb3ca5be9a => generated 1313 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:53:37.433284 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-55714f82-9b2a-4656-b372-b4f56d574528 tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Calling method '.version_select at 0x7fd39febb0d0>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:53:37.512305 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-55714f82-9b2a-4656-b372-b4f56d574528 tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] 10.222.0.18 "GET /compute/v2.1/images/9585a413-1cc7-4173-a4e4-f771201c7779" status: 200 len: 1424 microversion: 2.1 time: 0.089107 Oct 22 20:53:37.514514 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 576/1241] 10.222.0.18 () {58 vars in 1233 bytes} [Sat Oct 22 20:53:37 2022] GET /compute/v2.1/images/9585a413-1cc7-4173-a4e4-f771201c7779 => generated 1424 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:53:37.958200 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-88d93bbc-49d2-4f8b-a15a-ce98b70357e0 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:53:37.958717 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-88d93bbc-49d2-4f8b-a15a-ce98b70357e0 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] [instance: f2f50f6b-6a3e-449f-836e-bd897f78279c] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:53:37.972588 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-88d93bbc-49d2-4f8b-a15a-ce98b70357e0 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:37.973417 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-88d93bbc-49d2-4f8b-a15a-ce98b70357e0 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:37.973875 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-88d93bbc-49d2-4f8b-a15a-ce98b70357e0 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:37.974650 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-88d93bbc-49d2-4f8b-a15a-ce98b70357e0 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:37.975118 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-88d93bbc-49d2-4f8b-a15a-ce98b70357e0 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:37.975589 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-88d93bbc-49d2-4f8b-a15a-ce98b70357e0 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:38.146453 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-1d8dc17a-06f9-4aec-ab21-75db193c18fc tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:53:38.148982 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-1d8dc17a-06f9-4aec-ab21-75db193c18fc tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] [instance: 4c7b99a9-2ec4-4f4b-98e7-8e1ea2103735] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:53:38.160161 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1d8dc17a-06f9-4aec-ab21-75db193c18fc tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:38.162655 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1d8dc17a-06f9-4aec-ab21-75db193c18fc tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:38.163942 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1d8dc17a-06f9-4aec-ab21-75db193c18fc tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:38.168971 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1d8dc17a-06f9-4aec-ab21-75db193c18fc tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:38.170128 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1d8dc17a-06f9-4aec-ab21-75db193c18fc tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:38.172309 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1d8dc17a-06f9-4aec-ab21-75db193c18fc tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:38.574363 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-88d93bbc-49d2-4f8b-a15a-ce98b70357e0 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7f48d18691d4473bbe0284c44f14d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bacf9909082440f8a201771b64a75fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:53:38.593715 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-88d93bbc-49d2-4f8b-a15a-ce98b70357e0 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] 10.222.0.18 "GET /compute/v2.1/servers/f2f50f6b-6a3e-449f-836e-bd897f78279c" status: 200 len: 1355 microversion: 2.1 time: 0.639322 Oct 22 20:53:38.616564 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 666/1242] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:53:37 2022] GET /compute/v2.1/servers/f2f50f6b-6a3e-449f-836e-bd897f78279c => generated 1355 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:53:38.660427 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-aed99ccc-c191-445c-b24a-99b768af4d2a tempest-TenantUsagesTestJSON-743245380 tempest-TenantUsagesTestJSON-743245380-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:53:38.662338 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-aed99ccc-c191-445c-b24a-99b768af4d2a tempest-TenantUsagesTestJSON-743245380 tempest-TenantUsagesTestJSON-743245380-project] [instance: 49ed4929-87c4-4ef4-8b46-c4bb3ca5be9a] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:53:38.696061 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-aed99ccc-c191-445c-b24a-99b768af4d2a tempest-TenantUsagesTestJSON-743245380 tempest-TenantUsagesTestJSON-743245380-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:38.696574 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-aed99ccc-c191-445c-b24a-99b768af4d2a tempest-TenantUsagesTestJSON-743245380 tempest-TenantUsagesTestJSON-743245380-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:38.697025 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-aed99ccc-c191-445c-b24a-99b768af4d2a tempest-TenantUsagesTestJSON-743245380 tempest-TenantUsagesTestJSON-743245380-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:38.697765 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-aed99ccc-c191-445c-b24a-99b768af4d2a tempest-TenantUsagesTestJSON-743245380 tempest-TenantUsagesTestJSON-743245380-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:38.704240 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-aed99ccc-c191-445c-b24a-99b768af4d2a tempest-TenantUsagesTestJSON-743245380 tempest-TenantUsagesTestJSON-743245380-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:38.704987 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-aed99ccc-c191-445c-b24a-99b768af4d2a tempest-TenantUsagesTestJSON-743245380 tempest-TenantUsagesTestJSON-743245380-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:38.814378 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell0:SELECT=2 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:53:39.260345 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-1d8dc17a-06f9-4aec-ab21-75db193c18fc tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:53:39.269455 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-1d8dc17a-06f9-4aec-ab21-75db193c18fc tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:53:39.277565 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-1d8dc17a-06f9-4aec-ab21-75db193c18fc tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:53:39.278841 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-1d8dc17a-06f9-4aec-ab21-75db193c18fc tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] 10.222.0.18 "GET /compute/v2.1/servers/4c7b99a9-2ec4-4f4b-98e7-8e1ea2103735" status: 200 len: 1812 microversion: 2.25 time: 1.138549 Oct 22 20:53:39.286605 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 577/1243] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 20:53:38 2022] GET /compute/v2.1/servers/4c7b99a9-2ec4-4f4b-98e7-8e1ea2103735 => generated 1812 bytes in 1147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 22 20:53:39.292344 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-d7ee2395-4729-4e4d-a1a9-1fc098c03591 tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Calling method '.version_select at 0x7fd39feb7e50>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:53:39.363369 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-d7ee2395-4729-4e4d-a1a9-1fc098c03591 tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] 10.222.0.18 "GET /compute/v2.1/images/9585a413-1cc7-4173-a4e4-f771201c7779" status: 200 len: 1424 microversion: 2.1 time: 0.075244 Oct 22 20:53:39.364368 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 578/1244] 10.222.0.18 () {58 vars in 1233 bytes} [Sat Oct 22 20:53:39 2022] GET /compute/v2.1/images/9585a413-1cc7-4173-a4e4-f771201c7779 => generated 1424 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:53:39.401749 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-aed99ccc-c191-445c-b24a-99b768af4d2a tempest-TenantUsagesTestJSON-743245380 tempest-TenantUsagesTestJSON-743245380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d35abfd0aa4dd09b9d0ad56faebd66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5695737326d4a83828b92469dd3e676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:53:39.410963 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-aed99ccc-c191-445c-b24a-99b768af4d2a tempest-TenantUsagesTestJSON-743245380 tempest-TenantUsagesTestJSON-743245380-project] 10.222.0.18 "GET /compute/v2.1/servers/49ed4929-87c4-4ef4-8b46-c4bb3ca5be9a" status: 200 len: 1313 microversion: 2.1 time: 0.793140 Oct 22 20:53:39.421484 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 667/1245] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:53:38 2022] GET /compute/v2.1/servers/49ed4929-87c4-4ef4-8b46-c4bb3ca5be9a => generated 1313 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:53:39.624124 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-278b26a7-346e-44a0-b5ef-e6eb65a01065 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:53:39.625072 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-278b26a7-346e-44a0-b5ef-e6eb65a01065 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] [instance: f2f50f6b-6a3e-449f-836e-bd897f78279c] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:53:39.642720 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-278b26a7-346e-44a0-b5ef-e6eb65a01065 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:39.643674 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-278b26a7-346e-44a0-b5ef-e6eb65a01065 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:39.644362 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-278b26a7-346e-44a0-b5ef-e6eb65a01065 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:39.645301 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-278b26a7-346e-44a0-b5ef-e6eb65a01065 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:39.645977 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-278b26a7-346e-44a0-b5ef-e6eb65a01065 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:39.646726 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-278b26a7-346e-44a0-b5ef-e6eb65a01065 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:40.107867 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell0:SELECT=8 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:53:40.308526 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-1806f97a-78bc-42a9-96cc-77e4953a804c tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:53:40.309149 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-1806f97a-78bc-42a9-96cc-77e4953a804c tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] [instance: 4c7b99a9-2ec4-4f4b-98e7-8e1ea2103735] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:53:40.327322 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1806f97a-78bc-42a9-96cc-77e4953a804c tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:40.339318 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1806f97a-78bc-42a9-96cc-77e4953a804c tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:40.343374 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1806f97a-78bc-42a9-96cc-77e4953a804c tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:40.344503 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1806f97a-78bc-42a9-96cc-77e4953a804c tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:40.345438 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1806f97a-78bc-42a9-96cc-77e4953a804c tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:40.346765 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1806f97a-78bc-42a9-96cc-77e4953a804c tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:41.175137 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-278b26a7-346e-44a0-b5ef-e6eb65a01065 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7f48d18691d4473bbe0284c44f14d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bacf9909082440f8a201771b64a75fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:53:41.199283 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-278b26a7-346e-44a0-b5ef-e6eb65a01065 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] 10.222.0.18 "GET /compute/v2.1/servers/f2f50f6b-6a3e-449f-836e-bd897f78279c" status: 200 len: 1355 microversion: 2.1 time: 1.580909 Oct 22 20:53:41.201260 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 579/1246] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:53:39 2022] GET /compute/v2.1/servers/f2f50f6b-6a3e-449f-836e-bd897f78279c => generated 1355 bytes in 1583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:53:41.207030 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-4e59e45c-d188-4044-8e11-0c1f5e03712b tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Calling method '.version_select at 0x7fd39febba60>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:53:41.270234 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-4e59e45c-d188-4044-8e11-0c1f5e03712b tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] 10.222.0.18 "GET /compute/v2.1/images/9585a413-1cc7-4173-a4e4-f771201c7779" status: 200 len: 1424 microversion: 2.1 time: 0.067870 Oct 22 20:53:41.271082 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 580/1247] 10.222.0.18 () {58 vars in 1233 bytes} [Sat Oct 22 20:53:41 2022] GET /compute/v2.1/images/9585a413-1cc7-4173-a4e4-f771201c7779 => generated 1424 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:53:41.283441 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-d50745c1-1a27-4e41-826a-8f3f1e54a48d tempest-TenantUsagesTestJSON-743245380 tempest-TenantUsagesTestJSON-743245380-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:53:41.284554 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-d50745c1-1a27-4e41-826a-8f3f1e54a48d tempest-TenantUsagesTestJSON-743245380 tempest-TenantUsagesTestJSON-743245380-project] [instance: 49ed4929-87c4-4ef4-8b46-c4bb3ca5be9a] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:53:41.298909 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d50745c1-1a27-4e41-826a-8f3f1e54a48d tempest-TenantUsagesTestJSON-743245380 tempest-TenantUsagesTestJSON-743245380-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:41.300611 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d50745c1-1a27-4e41-826a-8f3f1e54a48d tempest-TenantUsagesTestJSON-743245380 tempest-TenantUsagesTestJSON-743245380-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:41.301660 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d50745c1-1a27-4e41-826a-8f3f1e54a48d tempest-TenantUsagesTestJSON-743245380 tempest-TenantUsagesTestJSON-743245380-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:41.305675 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d50745c1-1a27-4e41-826a-8f3f1e54a48d tempest-TenantUsagesTestJSON-743245380 tempest-TenantUsagesTestJSON-743245380-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:41.306231 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d50745c1-1a27-4e41-826a-8f3f1e54a48d tempest-TenantUsagesTestJSON-743245380 tempest-TenantUsagesTestJSON-743245380-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:41.307891 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d50745c1-1a27-4e41-826a-8f3f1e54a48d tempest-TenantUsagesTestJSON-743245380 tempest-TenantUsagesTestJSON-743245380-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:41.939024 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-1806f97a-78bc-42a9-96cc-77e4953a804c tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:53:41.952162 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-1806f97a-78bc-42a9-96cc-77e4953a804c tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:53:41.954740 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-1806f97a-78bc-42a9-96cc-77e4953a804c tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:53:41.956909 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-1806f97a-78bc-42a9-96cc-77e4953a804c tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] 10.222.0.18 "GET /compute/v2.1/servers/4c7b99a9-2ec4-4f4b-98e7-8e1ea2103735" status: 200 len: 1812 microversion: 2.25 time: 1.652189 Oct 22 20:53:41.958756 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 668/1248] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 20:53:40 2022] GET /compute/v2.1/servers/4c7b99a9-2ec4-4f4b-98e7-8e1ea2103735 => generated 1812 bytes in 1655 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 22 20:53:42.231485 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-62ad3d68-4414-4f92-9537-eaa4735e75d3 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:53:42.232103 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-62ad3d68-4414-4f92-9537-eaa4735e75d3 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] [instance: f2f50f6b-6a3e-449f-836e-bd897f78279c] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:53:42.245972 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-d50745c1-1a27-4e41-826a-8f3f1e54a48d tempest-TenantUsagesTestJSON-743245380 tempest-TenantUsagesTestJSON-743245380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d35abfd0aa4dd09b9d0ad56faebd66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5695737326d4a83828b92469dd3e676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:53:42.256518 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-d50745c1-1a27-4e41-826a-8f3f1e54a48d tempest-TenantUsagesTestJSON-743245380 tempest-TenantUsagesTestJSON-743245380-project] 10.222.0.18 "GET /compute/v2.1/servers/49ed4929-87c4-4ef4-8b46-c4bb3ca5be9a" status: 200 len: 1313 microversion: 2.1 time: 0.982724 Oct 22 20:53:42.277872 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 581/1249] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:53:41 2022] GET /compute/v2.1/servers/49ed4929-87c4-4ef4-8b46-c4bb3ca5be9a => generated 1313 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:53:42.278391 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-62ad3d68-4414-4f92-9537-eaa4735e75d3 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:42.279749 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-62ad3d68-4414-4f92-9537-eaa4735e75d3 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:42.280359 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-62ad3d68-4414-4f92-9537-eaa4735e75d3 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:42.281418 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-62ad3d68-4414-4f92-9537-eaa4735e75d3 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:42.287506 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-62ad3d68-4414-4f92-9537-eaa4735e75d3 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:42.288013 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-62ad3d68-4414-4f92-9537-eaa4735e75d3 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:42.293002 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-86b08d2f-29ee-4c53-ab3a-a2ef5b96975a tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Calling method '.version_select at 0x7fd39feb7790>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:53:42.342572 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-86b08d2f-29ee-4c53-ab3a-a2ef5b96975a tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] 10.222.0.18 "GET /compute/v2.1/images/9585a413-1cc7-4173-a4e4-f771201c7779" status: 200 len: 1433 microversion: 2.1 time: 0.058818 Oct 22 20:53:42.344002 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 582/1250] 10.222.0.18 () {58 vars in 1233 bytes} [Sat Oct 22 20:53:42 2022] GET /compute/v2.1/images/9585a413-1cc7-4173-a4e4-f771201c7779 => generated 1433 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:53:42.358696 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-20fe8879-65f5-41c5-b52c-1aea25c0c9be tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Calling method '.version_select at 0x7fd39fee3160>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:53:42.436971 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-20fe8879-65f5-41c5-b52c-1aea25c0c9be tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] 10.222.0.18 "GET /compute/v2.1/images/9585a413-1cc7-4173-a4e4-f771201c7779" status: 200 len: 1433 microversion: 2.1 time: 0.082491 Oct 22 20:53:42.437894 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 583/1251] 10.222.0.18 () {58 vars in 1233 bytes} [Sat Oct 22 20:53:42 2022] GET /compute/v2.1/images/9585a413-1cc7-4173-a4e4-f771201c7779 => generated 1433 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:53:42.452199 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-f3696d65-d58a-4c3f-867f-e8fe433a1b2b tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:53:42.453163 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-f3696d65-d58a-4c3f-867f-e8fe433a1b2b tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] [instance: 472bbccc-485e-43ce-a9cd-a3148bfccdbd] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:53:42.461265 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f3696d65-d58a-4c3f-867f-e8fe433a1b2b tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:42.462197 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f3696d65-d58a-4c3f-867f-e8fe433a1b2b tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:42.462825 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f3696d65-d58a-4c3f-867f-e8fe433a1b2b tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:42.463816 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f3696d65-d58a-4c3f-867f-e8fe433a1b2b tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:42.464453 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f3696d65-d58a-4c3f-867f-e8fe433a1b2b tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:42.465175 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f3696d65-d58a-4c3f-867f-e8fe433a1b2b tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:42.927247 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-62ad3d68-4414-4f92-9537-eaa4735e75d3 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7f48d18691d4473bbe0284c44f14d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bacf9909082440f8a201771b64a75fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:53:42.943955 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-62ad3d68-4414-4f92-9537-eaa4735e75d3 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] 10.222.0.18 "GET /compute/v2.1/servers/f2f50f6b-6a3e-449f-836e-bd897f78279c" status: 200 len: 1355 microversion: 2.1 time: 0.718346 Oct 22 20:53:42.950418 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 669/1252] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:53:42 2022] GET /compute/v2.1/servers/f2f50f6b-6a3e-449f-836e-bd897f78279c => generated 1355 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:53:42.983607 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-3e48fd74-0d4b-4ce2-b98f-1f4037bc1c75 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:53:42.984223 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-3e48fd74-0d4b-4ce2-b98f-1f4037bc1c75 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] [instance: 4c7b99a9-2ec4-4f4b-98e7-8e1ea2103735] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:53:42.990877 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3e48fd74-0d4b-4ce2-b98f-1f4037bc1c75 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:42.991658 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3e48fd74-0d4b-4ce2-b98f-1f4037bc1c75 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:42.992280 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3e48fd74-0d4b-4ce2-b98f-1f4037bc1c75 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:42.993212 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3e48fd74-0d4b-4ce2-b98f-1f4037bc1c75 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:42.993822 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3e48fd74-0d4b-4ce2-b98f-1f4037bc1c75 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:42.994403 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3e48fd74-0d4b-4ce2-b98f-1f4037bc1c75 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:43.033363 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell1:SELECT=100 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:53:43.229209 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-f3696d65-d58a-4c3f-867f-e8fe433a1b2b tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01ba79ccd0d940a2899a035635862219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0400ae826f8e4bd8a2e4c981880a59c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:53:43.247934 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-f3696d65-d58a-4c3f-867f-e8fe433a1b2b tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] 10.222.0.18 "GET /compute/v2.1/servers/472bbccc-485e-43ce-a9cd-a3148bfccdbd" status: 200 len: 1478 microversion: 2.1 time: 0.796222 Oct 22 20:53:43.249634 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 584/1253] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:53:42 2022] GET /compute/v2.1/servers/472bbccc-485e-43ce-a9cd-a3148bfccdbd => generated 1478 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 20:53:43.283205 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-a8379d78-4b31-4f05-8644-929270b5d937 tempest-TenantUsagesTestJSON-743245380 tempest-TenantUsagesTestJSON-743245380-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:53:43.284027 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-a8379d78-4b31-4f05-8644-929270b5d937 tempest-TenantUsagesTestJSON-743245380 tempest-TenantUsagesTestJSON-743245380-project] [instance: 49ed4929-87c4-4ef4-8b46-c4bb3ca5be9a] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:53:43.303204 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a8379d78-4b31-4f05-8644-929270b5d937 tempest-TenantUsagesTestJSON-743245380 tempest-TenantUsagesTestJSON-743245380-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:43.305173 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a8379d78-4b31-4f05-8644-929270b5d937 tempest-TenantUsagesTestJSON-743245380 tempest-TenantUsagesTestJSON-743245380-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:43.305955 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a8379d78-4b31-4f05-8644-929270b5d937 tempest-TenantUsagesTestJSON-743245380 tempest-TenantUsagesTestJSON-743245380-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:43.306896 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a8379d78-4b31-4f05-8644-929270b5d937 tempest-TenantUsagesTestJSON-743245380 tempest-TenantUsagesTestJSON-743245380-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:43.307550 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a8379d78-4b31-4f05-8644-929270b5d937 tempest-TenantUsagesTestJSON-743245380 tempest-TenantUsagesTestJSON-743245380-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:43.308969 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a8379d78-4b31-4f05-8644-929270b5d937 tempest-TenantUsagesTestJSON-743245380 tempest-TenantUsagesTestJSON-743245380-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:43.540088 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-3e48fd74-0d4b-4ce2-b98f-1f4037bc1c75 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:53:43.559380 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-3e48fd74-0d4b-4ce2-b98f-1f4037bc1c75 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:53:43.566623 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-3e48fd74-0d4b-4ce2-b98f-1f4037bc1c75 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:53:43.572892 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-3e48fd74-0d4b-4ce2-b98f-1f4037bc1c75 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] 10.222.0.18 "GET /compute/v2.1/servers/4c7b99a9-2ec4-4f4b-98e7-8e1ea2103735" status: 200 len: 1812 microversion: 2.25 time: 0.593278 Oct 22 20:53:43.573516 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 670/1254] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 20:53:42 2022] GET /compute/v2.1/servers/4c7b99a9-2ec4-4f4b-98e7-8e1ea2103735 => generated 1812 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 22 20:53:43.888278 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-a8379d78-4b31-4f05-8644-929270b5d937 tempest-TenantUsagesTestJSON-743245380 tempest-TenantUsagesTestJSON-743245380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d35abfd0aa4dd09b9d0ad56faebd66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5695737326d4a83828b92469dd3e676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:53:43.897822 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-a8379d78-4b31-4f05-8644-929270b5d937 tempest-TenantUsagesTestJSON-743245380 tempest-TenantUsagesTestJSON-743245380-project] 10.222.0.18 "GET /compute/v2.1/servers/49ed4929-87c4-4ef4-8b46-c4bb3ca5be9a" status: 200 len: 1313 microversion: 2.1 time: 0.619323 Oct 22 20:53:43.899506 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 585/1255] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:53:43 2022] GET /compute/v2.1/servers/49ed4929-87c4-4ef4-8b46-c4bb3ca5be9a => generated 1313 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 20:53:43.971543 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-eda40064-daa2-4d19-9f21-79fd17268aa9 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:53:43.973233 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-eda40064-daa2-4d19-9f21-79fd17268aa9 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] [instance: f2f50f6b-6a3e-449f-836e-bd897f78279c] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:53:43.981662 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-eda40064-daa2-4d19-9f21-79fd17268aa9 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:43.982437 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-eda40064-daa2-4d19-9f21-79fd17268aa9 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:43.983465 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-eda40064-daa2-4d19-9f21-79fd17268aa9 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:43.989680 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-eda40064-daa2-4d19-9f21-79fd17268aa9 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:43.990712 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-eda40064-daa2-4d19-9f21-79fd17268aa9 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:43.991551 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-eda40064-daa2-4d19-9f21-79fd17268aa9 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:44.277442 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-331e962a-485a-419a-b764-50c00a2185b1 tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:53:44.278610 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-331e962a-485a-419a-b764-50c00a2185b1 tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] [instance: 472bbccc-485e-43ce-a9cd-a3148bfccdbd] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:53:44.289504 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-331e962a-485a-419a-b764-50c00a2185b1 tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:44.293720 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-331e962a-485a-419a-b764-50c00a2185b1 tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:44.297505 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-331e962a-485a-419a-b764-50c00a2185b1 tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:44.298366 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-331e962a-485a-419a-b764-50c00a2185b1 tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:44.298925 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-331e962a-485a-419a-b764-50c00a2185b1 tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:44.299885 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-331e962a-485a-419a-b764-50c00a2185b1 tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:44.454218 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-eda40064-daa2-4d19-9f21-79fd17268aa9 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7f48d18691d4473bbe0284c44f14d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bacf9909082440f8a201771b64a75fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:53:44.471828 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-eda40064-daa2-4d19-9f21-79fd17268aa9 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] 10.222.0.18 "GET /compute/v2.1/servers/f2f50f6b-6a3e-449f-836e-bd897f78279c" status: 200 len: 1355 microversion: 2.1 time: 0.505227 Oct 22 20:53:44.478960 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 671/1256] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:53:43 2022] GET /compute/v2.1/servers/f2f50f6b-6a3e-449f-836e-bd897f78279c => generated 1355 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:53:44.604162 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-2f82fdf1-9cb9-4c31-9ef6-790f89570e4e tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:53:44.604781 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-2f82fdf1-9cb9-4c31-9ef6-790f89570e4e tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] [instance: 4c7b99a9-2ec4-4f4b-98e7-8e1ea2103735] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:53:44.614173 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2f82fdf1-9cb9-4c31-9ef6-790f89570e4e tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:44.614666 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2f82fdf1-9cb9-4c31-9ef6-790f89570e4e tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:44.615166 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2f82fdf1-9cb9-4c31-9ef6-790f89570e4e tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:44.618598 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2f82fdf1-9cb9-4c31-9ef6-790f89570e4e tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:44.619102 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2f82fdf1-9cb9-4c31-9ef6-790f89570e4e tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:44.619545 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2f82fdf1-9cb9-4c31-9ef6-790f89570e4e tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:44.844306 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-331e962a-485a-419a-b764-50c00a2185b1 tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01ba79ccd0d940a2899a035635862219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0400ae826f8e4bd8a2e4c981880a59c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:53:44.865768 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-331e962a-485a-419a-b764-50c00a2185b1 tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] 10.222.0.18 "GET /compute/v2.1/servers/472bbccc-485e-43ce-a9cd-a3148bfccdbd" status: 200 len: 1465 microversion: 2.1 time: 0.592812 Oct 22 20:53:44.873780 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 586/1257] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:53:44 2022] GET /compute/v2.1/servers/472bbccc-485e-43ce-a9cd-a3148bfccdbd => generated 1465 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:53:44.894748 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-ea70f0e6-4416-4f94-ab91-c1a1bd1f790b tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Calling method '.version_select at 0x7fd39ff8d3a0>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:53:44.978172 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-ea70f0e6-4416-4f94-ab91-c1a1bd1f790b tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] 10.222.0.18 "GET /compute/v2.1/images/085e4478-6edc-4a69-8e08-f9831713eb65" status: 200 len: 784 microversion: 2.1 time: 0.087351 Oct 22 20:53:44.978777 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 587/1258] 10.222.0.18 () {58 vars in 1233 bytes} [Sat Oct 22 20:53:44 2022] GET /compute/v2.1/images/085e4478-6edc-4a69-8e08-f9831713eb65 => generated 784 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 20:53:45.007495 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-7a9c2c6f-dfc7-40db-9d24-858ec52fe3d5 tempest-TenantUsagesTestJSON-743245380 tempest-TenantUsagesTestJSON-743245380-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:53:45.011597 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-7a9c2c6f-dfc7-40db-9d24-858ec52fe3d5 tempest-TenantUsagesTestJSON-743245380 tempest-TenantUsagesTestJSON-743245380-project] [instance: 49ed4929-87c4-4ef4-8b46-c4bb3ca5be9a] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:53:45.048138 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7a9c2c6f-dfc7-40db-9d24-858ec52fe3d5 tempest-TenantUsagesTestJSON-743245380 tempest-TenantUsagesTestJSON-743245380-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:45.048782 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7a9c2c6f-dfc7-40db-9d24-858ec52fe3d5 tempest-TenantUsagesTestJSON-743245380 tempest-TenantUsagesTestJSON-743245380-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:45.049309 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7a9c2c6f-dfc7-40db-9d24-858ec52fe3d5 tempest-TenantUsagesTestJSON-743245380 tempest-TenantUsagesTestJSON-743245380-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:45.050084 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7a9c2c6f-dfc7-40db-9d24-858ec52fe3d5 tempest-TenantUsagesTestJSON-743245380 tempest-TenantUsagesTestJSON-743245380-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:45.050551 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7a9c2c6f-dfc7-40db-9d24-858ec52fe3d5 tempest-TenantUsagesTestJSON-743245380 tempest-TenantUsagesTestJSON-743245380-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:45.051071 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7a9c2c6f-dfc7-40db-9d24-858ec52fe3d5 tempest-TenantUsagesTestJSON-743245380 tempest-TenantUsagesTestJSON-743245380-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:45.663826 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-2f82fdf1-9cb9-4c31-9ef6-790f89570e4e tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:53:45.682502 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-2f82fdf1-9cb9-4c31-9ef6-790f89570e4e tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:53:45.688343 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-2f82fdf1-9cb9-4c31-9ef6-790f89570e4e tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:53:45.692047 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-2f82fdf1-9cb9-4c31-9ef6-790f89570e4e tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] 10.222.0.18 "GET /compute/v2.1/servers/4c7b99a9-2ec4-4f4b-98e7-8e1ea2103735" status: 200 len: 1802 microversion: 2.25 time: 1.091647 Oct 22 20:53:45.694548 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 672/1259] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 20:53:44 2022] GET /compute/v2.1/servers/4c7b99a9-2ec4-4f4b-98e7-8e1ea2103735 => generated 1802 bytes in 1096 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 20:53:45.702292 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-a7504bab-6dc5-4fe7-a09f-4d22f62dda25 tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:53:45.713087 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-a7504bab-6dc5-4fe7-a09f-4d22f62dda25 tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] 10.222.0.18 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.017200 Oct 22 20:53:45.716792 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 673/1260] 10.222.0.18 () {58 vars in 1137 bytes} [Sat Oct 22 20:53:45 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:53:45.731563 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-60a193b5-ded2-4761-8637-d13caed32f03 req-efff89b8-0549-4919-b790-46793bead945 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49ed4929-87c4-4ef4-8b46-c4bb3ca5be9a", "name": "network-vif-plugged", "status": "completed", "tag": "cb168a1a-ebc7-470c-8810-5b9a894facd3"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:53:45.763717 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-60a193b5-ded2-4761-8637-d13caed32f03 req-efff89b8-0549-4919-b790-46793bead945 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:45.764208 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-60a193b5-ded2-4761-8637-d13caed32f03 req-efff89b8-0549-4919-b790-46793bead945 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:45.764639 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-60a193b5-ded2-4761-8637-d13caed32f03 req-efff89b8-0549-4919-b790-46793bead945 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:45.793208 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-60a193b5-ded2-4761-8637-d13caed32f03 req-efff89b8-0549-4919-b790-46793bead945 service nova] Creating event network-vif-plugged:cb168a1a-ebc7-470c-8810-5b9a894facd3 for instance 49ed4929-87c4-4ef4-8b46-c4bb3ca5be9a on nch1-master-1 Oct 22 20:53:45.803102 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-60a193b5-ded2-4761-8637-d13caed32f03 req-efff89b8-0549-4919-b790-46793bead945 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083805 Oct 22 20:53:45.804032 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 674/1261] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:53:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:53:45.810865 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-f5ef72b7-6339-4b87-a2ce-e0657302f021 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:53:45.828880 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-f5ef72b7-6339-4b87-a2ce-e0657302f021 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] [instance: f2f50f6b-6a3e-449f-836e-bd897f78279c] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:53:45.885621 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f5ef72b7-6339-4b87-a2ce-e0657302f021 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:45.887374 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f5ef72b7-6339-4b87-a2ce-e0657302f021 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:45.888149 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f5ef72b7-6339-4b87-a2ce-e0657302f021 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:45.891126 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f5ef72b7-6339-4b87-a2ce-e0657302f021 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:45.894488 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f5ef72b7-6339-4b87-a2ce-e0657302f021 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:45.896679 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f5ef72b7-6339-4b87-a2ce-e0657302f021 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:46.355830 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-7a9c2c6f-dfc7-40db-9d24-858ec52fe3d5 tempest-TenantUsagesTestJSON-743245380 tempest-TenantUsagesTestJSON-743245380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d35abfd0aa4dd09b9d0ad56faebd66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5695737326d4a83828b92469dd3e676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:53:46.378832 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-7a9c2c6f-dfc7-40db-9d24-858ec52fe3d5 tempest-TenantUsagesTestJSON-743245380 tempest-TenantUsagesTestJSON-743245380-project] 10.222.0.18 "GET /compute/v2.1/servers/49ed4929-87c4-4ef4-8b46-c4bb3ca5be9a" status: 200 len: 1313 microversion: 2.1 time: 1.398591 Oct 22 20:53:46.405340 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 588/1262] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:53:44 2022] GET /compute/v2.1/servers/49ed4929-87c4-4ef4-8b46-c4bb3ca5be9a => generated 1313 bytes in 1426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:53:46.411835 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-f5ef72b7-6339-4b87-a2ce-e0657302f021 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7f48d18691d4473bbe0284c44f14d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bacf9909082440f8a201771b64a75fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:53:46.428661 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-f5ef72b7-6339-4b87-a2ce-e0657302f021 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] 10.222.0.18 "GET /compute/v2.1/servers/f2f50f6b-6a3e-449f-836e-bd897f78279c" status: 200 len: 1355 microversion: 2.1 time: 0.621042 Oct 22 20:53:46.431229 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 675/1263] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:53:45 2022] GET /compute/v2.1/servers/f2f50f6b-6a3e-449f-836e-bd897f78279c => generated 1355 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:53:46.445032 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-58da53e8-c34f-4ef5-ab9c-19d9047a942a tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] Calling method '.version_select at 0x7fd3a4e3a9d0>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:53:46.451109 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-ffd32a6e-f72b-421a-a32b-4e45b30bda0b tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Calling method '.version_select at 0x7fd3a405f1f0>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:53:46.452735 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-58da53e8-c34f-4ef5-ab9c-19d9047a942a tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:46.453585 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-58da53e8-c34f-4ef5-ab9c-19d9047a942a tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:46.455798 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-58da53e8-c34f-4ef5-ab9c-19d9047a942a tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:46.481213 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-58da53e8-c34f-4ef5-ab9c-19d9047a942a tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] 10.222.0.18 "GET /compute/v2.1/os-migrations" status: 200 len: 2360 microversion: 2.25 time: 0.047466 Oct 22 20:53:46.482737 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 676/1264] 10.222.0.18 () {60 vars in 1184 bytes} [Sat Oct 22 20:53:46 2022] GET /compute/v2.1/os-migrations => generated 2360 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 20:53:46.498623 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-bba49240-9b29-430f-ad99-5d0015ca649f tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:53:46.499489 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-bba49240-9b29-430f-ad99-5d0015ca649f tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] [instance: 4c7b99a9-2ec4-4f4b-98e7-8e1ea2103735] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:53:46.509892 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bba49240-9b29-430f-ad99-5d0015ca649f tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:46.513280 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bba49240-9b29-430f-ad99-5d0015ca649f tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:46.514095 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bba49240-9b29-430f-ad99-5d0015ca649f tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:46.515466 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bba49240-9b29-430f-ad99-5d0015ca649f tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:46.517891 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bba49240-9b29-430f-ad99-5d0015ca649f tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:46.519366 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bba49240-9b29-430f-ad99-5d0015ca649f tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:46.794852 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.objects.instance [None req-bba49240-9b29-430f-ad99-5d0015ca649f tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] Lazy-loading 'services' on Instance uuid 4c7b99a9-2ec4-4f4b-98e7-8e1ea2103735 {{(pid=138745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 20:53:46.834400 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-bba49240-9b29-430f-ad99-5d0015ca649f tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/4c7b99a9-2ec4-4f4b-98e7-8e1ea2103735" status: 200 len: 2420 microversion: 2.25 time: 0.336735 Oct 22 20:53:46.837105 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 677/1265] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 20:53:46 2022] GET /compute/v2.1/servers/4c7b99a9-2ec4-4f4b-98e7-8e1ea2103735 => generated 2420 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 20:53:46.871960 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-1c2b4f9f-5af9-4d07-a59f-c8d7e183be48 tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:53:46.872854 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-1c2b4f9f-5af9-4d07-a59f-c8d7e183be48 tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] [instance: 4c7b99a9-2ec4-4f4b-98e7-8e1ea2103735] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:53:46.880724 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1c2b4f9f-5af9-4d07-a59f-c8d7e183be48 tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:46.881706 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1c2b4f9f-5af9-4d07-a59f-c8d7e183be48 tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:46.882365 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1c2b4f9f-5af9-4d07-a59f-c8d7e183be48 tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:46.883540 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1c2b4f9f-5af9-4d07-a59f-c8d7e183be48 tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:46.884179 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1c2b4f9f-5af9-4d07-a59f-c8d7e183be48 tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:46.885003 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1c2b4f9f-5af9-4d07-a59f-c8d7e183be48 tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:47.223977 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.objects.instance [None req-1c2b4f9f-5af9-4d07-a59f-c8d7e183be48 tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] Lazy-loading 'services' on Instance uuid 4c7b99a9-2ec4-4f4b-98e7-8e1ea2103735 {{(pid=138745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 20:53:47.246938 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-1c2b4f9f-5af9-4d07-a59f-c8d7e183be48 tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/4c7b99a9-2ec4-4f4b-98e7-8e1ea2103735" status: 200 len: 2420 microversion: 2.25 time: 0.389620 Oct 22 20:53:47.247823 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 678/1266] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 20:53:46 2022] GET /compute/v2.1/servers/4c7b99a9-2ec4-4f4b-98e7-8e1ea2103735 => generated 2420 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 20:53:47.374117 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-b994be6a-12f0-4b80-9d09-111a8f7326ad tempest-InstanceActionsV221TestJSON-976463296 tempest-InstanceActionsV221TestJSON-976463296-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsV221TestJSON-server-1595013480", "imageRef": "085e4478-6edc-4a69-8e08-f9831713eb65", "flavorRef": "452", "networks": [{"uuid": "7f1dfdd4-2f3b-4d49-b802-547aca550c1e"}]}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:53:47.435597 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.network.neutron [None req-b994be6a-12f0-4b80-9d09-111a8f7326ad tempest-InstanceActionsV221TestJSON-976463296 tempest-InstanceActionsV221TestJSON-976463296-project] validate_networks() for [('7f1dfdd4-2f3b-4d49-b802-547aca550c1e', None, None, None, None, None)] {{(pid=138745) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 20:53:47.525837 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-ffd32a6e-f72b-421a-a32b-4e45b30bda0b tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] 10.222.0.18 "DELETE /compute/v2.1/images/9585a413-1cc7-4173-a4e4-f771201c7779" status: 204 len: 0 microversion: 2.1 time: 1.118673 Oct 22 20:53:47.526407 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 589/1267] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:53:46 2022] DELETE /compute/v2.1/images/9585a413-1cc7-4173-a4e4-f771201c7779 => generated 0 bytes in 1120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 20:53:47.531755 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-e118aa8a-6990-4387-8082-32a39e71b219 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:53:47.532490 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-e118aa8a-6990-4387-8082-32a39e71b219 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] [instance: 4c7b99a9-2ec4-4f4b-98e7-8e1ea2103735] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:53:47.541185 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e118aa8a-6990-4387-8082-32a39e71b219 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:47.542455 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e118aa8a-6990-4387-8082-32a39e71b219 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:47.543231 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e118aa8a-6990-4387-8082-32a39e71b219 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:47.544313 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e118aa8a-6990-4387-8082-32a39e71b219 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:47.544990 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e118aa8a-6990-4387-8082-32a39e71b219 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:47.545619 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e118aa8a-6990-4387-8082-32a39e71b219 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:47.672718 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.objects.instance [None req-e118aa8a-6990-4387-8082-32a39e71b219 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lazy-loading 'services' on Instance uuid 4c7b99a9-2ec4-4f4b-98e7-8e1ea2103735 {{(pid=138744) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 20:53:47.778486 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-e118aa8a-6990-4387-8082-32a39e71b219 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] 10.222.0.18 "DELETE /compute/v2.1/servers/4c7b99a9-2ec4-4f4b-98e7-8e1ea2103735/os-volume_attachments/0b640f14-ba0f-4242-a080-e77941655d79" status: 202 len: 0 microversion: 2.25 time: 0.250460 Oct 22 20:53:47.782640 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 590/1268] 10.222.0.18 () {60 vars in 1457 bytes} [Sat Oct 22 20:53:47 2022] DELETE /compute/v2.1/servers/4c7b99a9-2ec4-4f4b-98e7-8e1ea2103735/os-volume_attachments/0b640f14-ba0f-4242-a080-e77941655d79 => generated 0 bytes in 255 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 22 20:53:47.798085 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-87b71f32-3548-490f-ae6d-9b1216d18d01 tempest-TenantUsagesTestJSON-743245380 tempest-TenantUsagesTestJSON-743245380-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:53:47.816420 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-87b71f32-3548-490f-ae6d-9b1216d18d01 tempest-TenantUsagesTestJSON-743245380 tempest-TenantUsagesTestJSON-743245380-project] [instance: 49ed4929-87c4-4ef4-8b46-c4bb3ca5be9a] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:53:47.823709 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-87b71f32-3548-490f-ae6d-9b1216d18d01 tempest-TenantUsagesTestJSON-743245380 tempest-TenantUsagesTestJSON-743245380-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:47.824607 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-87b71f32-3548-490f-ae6d-9b1216d18d01 tempest-TenantUsagesTestJSON-743245380 tempest-TenantUsagesTestJSON-743245380-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:47.825297 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-87b71f32-3548-490f-ae6d-9b1216d18d01 tempest-TenantUsagesTestJSON-743245380 tempest-TenantUsagesTestJSON-743245380-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:47.826268 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-87b71f32-3548-490f-ae6d-9b1216d18d01 tempest-TenantUsagesTestJSON-743245380 tempest-TenantUsagesTestJSON-743245380-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:47.826982 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-87b71f32-3548-490f-ae6d-9b1216d18d01 tempest-TenantUsagesTestJSON-743245380 tempest-TenantUsagesTestJSON-743245380-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:47.827694 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-87b71f32-3548-490f-ae6d-9b1216d18d01 tempest-TenantUsagesTestJSON-743245380 tempest-TenantUsagesTestJSON-743245380-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:48.215592 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-87b71f32-3548-490f-ae6d-9b1216d18d01 tempest-TenantUsagesTestJSON-743245380 tempest-TenantUsagesTestJSON-743245380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d35abfd0aa4dd09b9d0ad56faebd66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5695737326d4a83828b92469dd3e676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:53:48.238038 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-87b71f32-3548-490f-ae6d-9b1216d18d01 tempest-TenantUsagesTestJSON-743245380 tempest-TenantUsagesTestJSON-743245380-project] 10.222.0.18 "GET /compute/v2.1/servers/49ed4929-87c4-4ef4-8b46-c4bb3ca5be9a" status: 200 len: 1313 microversion: 2.1 time: 0.453411 Oct 22 20:53:48.253804 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 591/1269] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:53:47 2022] GET /compute/v2.1/servers/49ed4929-87c4-4ef4-8b46-c4bb3ca5be9a => generated 1313 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:53:48.258672 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-1b9d755b-ded4-4e21-8edf-9cb2037a5706 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:53:48.259290 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-1b9d755b-ded4-4e21-8edf-9cb2037a5706 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] [instance: f2f50f6b-6a3e-449f-836e-bd897f78279c] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:53:48.266568 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1b9d755b-ded4-4e21-8edf-9cb2037a5706 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:48.267607 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1b9d755b-ded4-4e21-8edf-9cb2037a5706 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:48.268232 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1b9d755b-ded4-4e21-8edf-9cb2037a5706 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:48.269226 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1b9d755b-ded4-4e21-8edf-9cb2037a5706 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:48.270083 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1b9d755b-ded4-4e21-8edf-9cb2037a5706 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:48.270733 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1b9d755b-ded4-4e21-8edf-9cb2037a5706 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:48.463667 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-b994be6a-12f0-4b80-9d09-111a8f7326ad tempest-InstanceActionsV221TestJSON-976463296 tempest-InstanceActionsV221TestJSON-976463296-project] Flavor limits 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 20:53:48.464155 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-b994be6a-12f0-4b80-9d09-111a8f7326ad tempest-InstanceActionsV221TestJSON-976463296 tempest-InstanceActionsV221TestJSON-976463296-project] Image limits 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 20:53:48.464750 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-b994be6a-12f0-4b80-9d09-111a8f7326ad tempest-InstanceActionsV221TestJSON-976463296 tempest-InstanceActionsV221TestJSON-976463296-project] Flavor pref 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 20:53:48.465894 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-b994be6a-12f0-4b80-9d09-111a8f7326ad tempest-InstanceActionsV221TestJSON-976463296 tempest-InstanceActionsV221TestJSON-976463296-project] Image pref 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 20:53:48.466324 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-b994be6a-12f0-4b80-9d09-111a8f7326ad tempest-InstanceActionsV221TestJSON-976463296 tempest-InstanceActionsV221TestJSON-976463296-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 20:53:48.481574 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b994be6a-12f0-4b80-9d09-111a8f7326ad tempest-InstanceActionsV221TestJSON-976463296 tempest-InstanceActionsV221TestJSON-976463296-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:48.482093 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b994be6a-12f0-4b80-9d09-111a8f7326ad tempest-InstanceActionsV221TestJSON-976463296 tempest-InstanceActionsV221TestJSON-976463296-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:48.482509 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b994be6a-12f0-4b80-9d09-111a8f7326ad tempest-InstanceActionsV221TestJSON-976463296 tempest-InstanceActionsV221TestJSON-976463296-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:48.483241 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b994be6a-12f0-4b80-9d09-111a8f7326ad tempest-InstanceActionsV221TestJSON-976463296 tempest-InstanceActionsV221TestJSON-976463296-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:48.483739 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b994be6a-12f0-4b80-9d09-111a8f7326ad tempest-InstanceActionsV221TestJSON-976463296 tempest-InstanceActionsV221TestJSON-976463296-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:48.484167 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b994be6a-12f0-4b80-9d09-111a8f7326ad tempest-InstanceActionsV221TestJSON-976463296 tempest-InstanceActionsV221TestJSON-976463296-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:48.523180 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-b994be6a-12f0-4b80-9d09-111a8f7326ad tempest-InstanceActionsV221TestJSON-976463296 tempest-InstanceActionsV221TestJSON-976463296-project] Getting quotas for project 6f7808ed44e84de4a1574e8aacd71c4e. Resources: {'cores', 'instances', 'ram'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 20:53:48.529049 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-b994be6a-12f0-4b80-9d09-111a8f7326ad tempest-InstanceActionsV221TestJSON-976463296 tempest-InstanceActionsV221TestJSON-976463296-project] Getting quotas for user e13c3673ebe14b7e997ec664499b9e82 and project 6f7808ed44e84de4a1574e8aacd71c4e. Resources: {'cores', 'instances', 'ram'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 20:53:48.544749 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-b994be6a-12f0-4b80-9d09-111a8f7326ad tempest-InstanceActionsV221TestJSON-976463296 tempest-InstanceActionsV221TestJSON-976463296-project] Going to run 1 instances... {{(pid=138745) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 20:53:48.555918 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-b994be6a-12f0-4b80-9d09-111a8f7326ad tempest-InstanceActionsV221TestJSON-976463296 tempest-InstanceActionsV221TestJSON-976463296-project] [instance: 304975d8-d62e-4156-9697-09c3a9724371] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='085e4478-6edc-4a69-8e08-f9831713eb65',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138745) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 20:53:48.568305 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-1b9d755b-ded4-4e21-8edf-9cb2037a5706 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7f48d18691d4473bbe0284c44f14d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bacf9909082440f8a201771b64a75fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:53:48.582066 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-1b9d755b-ded4-4e21-8edf-9cb2037a5706 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] 10.222.0.18 "GET /compute/v2.1/servers/f2f50f6b-6a3e-449f-836e-bd897f78279c" status: 200 len: 1355 microversion: 2.1 time: 0.330451 Oct 22 20:53:48.582654 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 592/1270] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:53:48 2022] GET /compute/v2.1/servers/f2f50f6b-6a3e-449f-836e-bd897f78279c => generated 1355 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:53:48.596243 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-80a9c183-2f79-40f4-984b-4efb2f82d3dd tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Calling method '.version_select at 0x7fd39fed6f70>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:53:48.643158 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-80a9c183-2f79-40f4-984b-4efb2f82d3dd tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] HTTP exception thrown: Image not found. Oct 22 20:53:48.645878 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-80a9c183-2f79-40f4-984b-4efb2f82d3dd tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Request method failure captured: Oct 22 20:53:48.645878 ncdv-master-1 devstack@n-api.service[138744]: request: GET /compute/v2.1/images/9585a413-1cc7-4173-a4e4-f771201c7779 HTTP/1.1 Oct 22 20:53:48.645878 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 20:53:48.645878 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 20:53:48.645878 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 20:53:48.645878 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 0 Oct 22 20:53:48.645878 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 20:53:48.645878 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 20:53:48.645878 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 20:53:48.645878 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 20:53:48.645878 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVFgfbDqlMbbcVsIQGadAvBPZz8r5GC-oGNB3Snt-dfXaCXrgz_GtUcLSUgMs2MQqo0otZKIX84y4vMPH6M8jteEdeaEvGJu60ZpfzRYx0J8iU-yneOFONCqD6_B1k7kGvXS092S_SutdOlOU3ozDByeqLPQtUIX77mZjZvvTb7ZZnFU Oct 22 20:53:48.645878 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 20:53:48.645878 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 20:53:48.645878 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 20:53:48.645878 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 20:53:48.645878 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 20:53:48.645878 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 20:53:48.645878 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: 0400ae826f8e4bd8a2e4c981880a59c5 Oct 22 20:53:48.645878 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-ImagesOneServerTestJSON-1366907274 Oct 22 20:53:48.645878 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 20:53:48.645878 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 20:53:48.645878 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_0400ae826f8e4bd8a2e4c981880a59c5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0400ae826f8e4bd8a2e4c981880a59c5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/0400ae826f8e4bd8a2e4c981880a59c5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0400ae826f8e4bd8a2e4c981880a59c5"}]}] Oct 22 20:53:48.645878 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-ImagesOneServerTestJSON-1366907274 Oct 22 20:53:48.645878 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: 0400ae826f8e4bd8a2e4c981880a59c5 Oct 22 20:53:48.645878 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1366907274 Oct 22 20:53:48.645878 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-ImagesOneServerTestJSON-1366907274-project Oct 22 20:53:48.645878 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 20:53:48.645878 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 20:53:48.645878 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: 01ba79ccd0d940a2899a035635862219 Oct 22 20:53:48.645878 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-ImagesOneServerTestJSON-1366907274-project Oct 22 20:53:48.645878 ncdv-master-1 devstack@n-api.service[138744]: method: Oct 22 20:53:48.645878 ncdv-master-1 devstack@n-api.service[138744]: exception: Image not found. Oct 22 20:53:48.645878 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': '9585a413-1cc7-4173-a4e4-f771201c7779'} Oct 22 20:53:48.645878 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:53:48.645878 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:53:48.645878 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 22 20:53:48.645878 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 22 20:53:48.645878 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 22 20:53:48.645878 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 22 20:53:48.645878 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 22 20:53:48.645878 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 22 20:53:48.645878 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 22 20:53:48.645878 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 22 20:53:48.645878 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 22 20:53:48.645878 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 22 20:53:48.645878 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 22 20:53:48.645878 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 22 20:53:48.645878 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 22 20:53:48.645878 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 22 20:53:48.645878 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 22 20:53:48.645878 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 22 20:53:48.645878 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 9585a413-1cc7-4173-a4e4-f771201c7779 Oct 22 20:53:48.645878 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:53:48.645878 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:53:48.645878 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:53:48.645878 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:53:48.645878 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 22 20:53:48.645878 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 22 20:53:48.645878 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 22 20:53:48.645878 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 22 20:53:48.645878 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 22 20:53:48.645878 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 22 20:53:48.645878 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 22 20:53:48.650290 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 22 20:53:48.650290 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 22 20:53:48.650290 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 22 20:53:48.650290 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 22 20:53:48.650290 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 22 20:53:48.650290 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 22 20:53:48.650290 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 22 20:53:48.650290 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 22 20:53:48.650290 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 22 20:53:48.650290 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 22 20:53:48.650290 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 22 20:53:48.650290 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 22 20:53:48.650290 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 22 20:53:48.650290 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 22 20:53:48.650290 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 22 20:53:48.650290 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 22 20:53:48.650290 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 22 20:53:48.650290 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 9585a413-1cc7-4173-a4e4-f771201c7779 could not be found. Oct 22 20:53:48.650290 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:53:48.650290 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:53:48.650290 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:53:48.650290 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:53:48.650290 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:53:48.650290 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:53:48.650290 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:53:48.650290 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:53:48.650290 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 22 20:53:48.650290 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 22 20:53:48.650290 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:53:48.650290 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:53:48.650290 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 22 20:53:48.650290 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 22 20:53:48.650290 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 22 20:53:48.650290 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:53:48.650290 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:53:48.650290 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:53:48.650290 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:53:48.650290 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:53:48.650290 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:53:48.650290 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 20:53:48.650290 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 20:53:48.650290 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 22 20:53:48.650290 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:53:48.655980 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-80a9c183-2f79-40f4-984b-4efb2f82d3dd tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Returning 404 to user: Image not found. {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:53:48.656103 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-80a9c183-2f79-40f4-984b-4efb2f82d3dd tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] 10.222.0.18 "GET /compute/v2.1/images/9585a413-1cc7-4173-a4e4-f771201c7779" status: 404 len: 62 microversion: 2.1 time: 0.063381 Oct 22 20:53:48.657113 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 593/1271] 10.222.0.18 () {58 vars in 1233 bytes} [Sat Oct 22 20:53:48 2022] GET /compute/v2.1/images/9585a413-1cc7-4173-a4e4-f771201c7779 => generated 62 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 22 20:53:48.663469 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-85210375-b209-4e87-96d2-fad56ba95af5 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:53:48.674533 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-85210375-b209-4e87-96d2-fad56ba95af5 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] [instance: 4c7b99a9-2ec4-4f4b-98e7-8e1ea2103735] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:53:48.681720 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-b994be6a-12f0-4b80-9d09-111a8f7326ad tempest-InstanceActionsV221TestJSON-976463296 tempest-InstanceActionsV221TestJSON-976463296-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.21 time: 1.432713 Oct 22 20:53:48.683964 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 679/1272] 10.222.0.18 () {62 vars in 1188 bytes} [Sat Oct 22 20:53:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 1435 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 22 20:53:48.690168 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-2ac8c6c5-aa20-45ea-9ddf-b5e9f14acb82 req-071440ae-2338-406c-85ad-8f25398f3587 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "472bbccc-485e-43ce-a9cd-a3148bfccdbd", "name": "network-vif-unplugged", "status": "completed", "tag": "23775c97-962a-4643-9a82-cfb4b15013e8"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:53:48.705435 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-2ac8c6c5-aa20-45ea-9ddf-b5e9f14acb82 req-071440ae-2338-406c-85ad-8f25398f3587 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:48.706507 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-2ac8c6c5-aa20-45ea-9ddf-b5e9f14acb82 req-071440ae-2338-406c-85ad-8f25398f3587 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:48.707388 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-2ac8c6c5-aa20-45ea-9ddf-b5e9f14acb82 req-071440ae-2338-406c-85ad-8f25398f3587 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:48.716170 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-85210375-b209-4e87-96d2-fad56ba95af5 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:48.721071 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-2ac8c6c5-aa20-45ea-9ddf-b5e9f14acb82 req-071440ae-2338-406c-85ad-8f25398f3587 service nova] Creating event network-vif-unplugged:23775c97-962a-4643-9a82-cfb4b15013e8 for instance 472bbccc-485e-43ce-a9cd-a3148bfccdbd on nch1-master-1 Oct 22 20:53:48.721720 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-85210375-b209-4e87-96d2-fad56ba95af5 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:48.722179 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-85210375-b209-4e87-96d2-fad56ba95af5 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:48.722922 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-85210375-b209-4e87-96d2-fad56ba95af5 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:48.723399 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-85210375-b209-4e87-96d2-fad56ba95af5 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:48.723836 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-85210375-b209-4e87-96d2-fad56ba95af5 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:48.729060 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-2ac8c6c5-aa20-45ea-9ddf-b5e9f14acb82 req-071440ae-2338-406c-85ad-8f25398f3587 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043180 Oct 22 20:53:48.729989 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 680/1273] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:53:48 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:53:48.737567 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-068f6649-b946-4db2-b5c3-d84fa762381c tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-\u20a1-2094989805"}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:53:48.740791 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-068f6649-b946-4db2-b5c3-d84fa762381c tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] [instance: 472bbccc-485e-43ce-a9cd-a3148bfccdbd] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:53:48.749318 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-068f6649-b946-4db2-b5c3-d84fa762381c tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:48.750034 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-068f6649-b946-4db2-b5c3-d84fa762381c tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:48.751295 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-068f6649-b946-4db2-b5c3-d84fa762381c tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:48.752234 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-068f6649-b946-4db2-b5c3-d84fa762381c tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:48.752856 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-068f6649-b946-4db2-b5c3-d84fa762381c tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:48.753447 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-068f6649-b946-4db2-b5c3-d84fa762381c tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:48.803208 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-85210375-b209-4e87-96d2-fad56ba95af5 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] 10.222.0.18 "GET /compute/v2.1/servers/4c7b99a9-2ec4-4f4b-98e7-8e1ea2103735/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.142715 Oct 22 20:53:48.803934 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 594/1274] 10.222.0.18 () {60 vars in 1343 bytes} [Sat Oct 22 20:53:48 2022] GET /compute/v2.1/servers/4c7b99a9-2ec4-4f4b-98e7-8e1ea2103735/os-volume_attachments => generated 197 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 22 20:53:48.816234 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-b355e080-b16c-4417-9720-3f1e9aed3696 tempest-InstanceActionsV221TestJSON-976463296 tempest-InstanceActionsV221TestJSON-976463296-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:53:48.816847 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-b355e080-b16c-4417-9720-3f1e9aed3696 tempest-InstanceActionsV221TestJSON-976463296 tempest-InstanceActionsV221TestJSON-976463296-project] [instance: 304975d8-d62e-4156-9697-09c3a9724371] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:53:48.963997 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-b355e080-b16c-4417-9720-3f1e9aed3696 tempest-InstanceActionsV221TestJSON-976463296 tempest-InstanceActionsV221TestJSON-976463296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13c3673ebe14b7e997ec664499b9e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f7808ed44e84de4a1574e8aacd71c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:53:48.979529 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-b355e080-b16c-4417-9720-3f1e9aed3696 tempest-InstanceActionsV221TestJSON-976463296 tempest-InstanceActionsV221TestJSON-976463296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e13c3673ebe14b7e997ec664499b9e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f7808ed44e84de4a1574e8aacd71c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:53:48.980784 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-b355e080-b16c-4417-9720-3f1e9aed3696 tempest-InstanceActionsV221TestJSON-976463296 tempest-InstanceActionsV221TestJSON-976463296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e13c3673ebe14b7e997ec664499b9e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f7808ed44e84de4a1574e8aacd71c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:53:48.982013 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-b355e080-b16c-4417-9720-3f1e9aed3696 tempest-InstanceActionsV221TestJSON-976463296 tempest-InstanceActionsV221TestJSON-976463296-project] 10.222.0.18 "GET /compute/v2.1/servers/304975d8-d62e-4156-9697-09c3a9724371" status: 200 len: 1259 microversion: 2.21 time: 0.169753 Oct 22 20:53:48.995509 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 595/1275] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 20:53:48 2022] GET /compute/v2.1/servers/304975d8-d62e-4156-9697-09c3a9724371 => generated 1259 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 20:53:49.037624 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-068f6649-b946-4db2-b5c3-d84fa762381c tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] 10.222.0.18 "POST /compute/v2.1/servers/472bbccc-485e-43ce-a9cd-a3148bfccdbd/action" status: 202 len: 0 microversion: 2.1 time: 0.305272 Oct 22 20:53:49.039099 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 681/1276] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 20:53:48 2022] POST /compute/v2.1/servers/472bbccc-485e-43ce-a9cd-a3148bfccdbd/action => generated 0 bytes in 308 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 22 20:53:49.050739 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-540c5533-ea0d-40e4-95e5-5e88d586ab20 tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Calling method '.version_select at 0x7fd3a4051700>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:53:49.110311 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-540c5533-ea0d-40e4-95e5-5e88d586ab20 tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] 10.222.0.18 "GET /compute/v2.1/images/2c26b155-ef26-40a2-b7db-1b550c12a2cf" status: 200 len: 1429 microversion: 2.1 time: 0.064077 Oct 22 20:53:49.110885 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 596/1277] 10.222.0.18 () {58 vars in 1233 bytes} [Sat Oct 22 20:53:49 2022] GET /compute/v2.1/images/2c26b155-ef26-40a2-b7db-1b550c12a2cf => generated 1429 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:53:49.263684 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-4e4fa6d1-e458-40d7-b194-81665190a30c tempest-TenantUsagesTestJSON-743245380 tempest-TenantUsagesTestJSON-743245380-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:53:49.264611 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-4e4fa6d1-e458-40d7-b194-81665190a30c tempest-TenantUsagesTestJSON-743245380 tempest-TenantUsagesTestJSON-743245380-project] [instance: 49ed4929-87c4-4ef4-8b46-c4bb3ca5be9a] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:53:49.277635 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4e4fa6d1-e458-40d7-b194-81665190a30c tempest-TenantUsagesTestJSON-743245380 tempest-TenantUsagesTestJSON-743245380-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:49.279830 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4e4fa6d1-e458-40d7-b194-81665190a30c tempest-TenantUsagesTestJSON-743245380 tempest-TenantUsagesTestJSON-743245380-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:49.283165 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4e4fa6d1-e458-40d7-b194-81665190a30c tempest-TenantUsagesTestJSON-743245380 tempest-TenantUsagesTestJSON-743245380-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:49.284186 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4e4fa6d1-e458-40d7-b194-81665190a30c tempest-TenantUsagesTestJSON-743245380 tempest-TenantUsagesTestJSON-743245380-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:49.284815 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4e4fa6d1-e458-40d7-b194-81665190a30c tempest-TenantUsagesTestJSON-743245380 tempest-TenantUsagesTestJSON-743245380-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:49.286333 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4e4fa6d1-e458-40d7-b194-81665190a30c tempest-TenantUsagesTestJSON-743245380 tempest-TenantUsagesTestJSON-743245380-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:49.564233 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-4e4fa6d1-e458-40d7-b194-81665190a30c tempest-TenantUsagesTestJSON-743245380 tempest-TenantUsagesTestJSON-743245380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d35abfd0aa4dd09b9d0ad56faebd66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5695737326d4a83828b92469dd3e676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:53:49.595113 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-4e4fa6d1-e458-40d7-b194-81665190a30c tempest-TenantUsagesTestJSON-743245380 tempest-TenantUsagesTestJSON-743245380-project] 10.222.0.18 "GET /compute/v2.1/servers/49ed4929-87c4-4ef4-8b46-c4bb3ca5be9a" status: 200 len: 1462 microversion: 2.1 time: 0.332916 Oct 22 20:53:49.596043 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 682/1278] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:53:49 2022] GET /compute/v2.1/servers/49ed4929-87c4-4ef4-8b46-c4bb3ca5be9a => generated 1462 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:53:49.606568 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-a926c295-5794-4a1f-b52f-80a6d4ac5896 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:53:49.607376 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-a926c295-5794-4a1f-b52f-80a6d4ac5896 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] [instance: f2f50f6b-6a3e-449f-836e-bd897f78279c] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:53:49.618817 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a926c295-5794-4a1f-b52f-80a6d4ac5896 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:49.631843 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a926c295-5794-4a1f-b52f-80a6d4ac5896 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:49.636328 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a926c295-5794-4a1f-b52f-80a6d4ac5896 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:49.640826 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a926c295-5794-4a1f-b52f-80a6d4ac5896 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:49.642173 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a926c295-5794-4a1f-b52f-80a6d4ac5896 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:49.644332 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a926c295-5794-4a1f-b52f-80a6d4ac5896 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:49.655050 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:53:50.031899 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-e1b9b61e-b3bc-4eed-8e29-eeba27d1252b tempest-TenantUsagesTestJSON-1826517071 tempest-TenantUsagesTestJSON-1826517071-project-admin] Calling method '.version_select at 0x7fd3a466e280>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:53:50.047553 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e1b9b61e-b3bc-4eed-8e29-eeba27d1252b tempest-TenantUsagesTestJSON-1826517071 tempest-TenantUsagesTestJSON-1826517071-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:50.048205 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e1b9b61e-b3bc-4eed-8e29-eeba27d1252b tempest-TenantUsagesTestJSON-1826517071 tempest-TenantUsagesTestJSON-1826517071-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:50.048767 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e1b9b61e-b3bc-4eed-8e29-eeba27d1252b tempest-TenantUsagesTestJSON-1826517071 tempest-TenantUsagesTestJSON-1826517071-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:50.081318 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-a926c295-5794-4a1f-b52f-80a6d4ac5896 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7f48d18691d4473bbe0284c44f14d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bacf9909082440f8a201771b64a75fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:53:50.096050 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e1b9b61e-b3bc-4eed-8e29-eeba27d1252b tempest-TenantUsagesTestJSON-1826517071 tempest-TenantUsagesTestJSON-1826517071-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:50.096305 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-a926c295-5794-4a1f-b52f-80a6d4ac5896 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] 10.222.0.18 "GET /compute/v2.1/servers/f2f50f6b-6a3e-449f-836e-bd897f78279c" status: 200 len: 1355 microversion: 2.1 time: 0.493803 Oct 22 20:53:50.096984 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e1b9b61e-b3bc-4eed-8e29-eeba27d1252b tempest-TenantUsagesTestJSON-1826517071 tempest-TenantUsagesTestJSON-1826517071-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:50.097906 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e1b9b61e-b3bc-4eed-8e29-eeba27d1252b tempest-TenantUsagesTestJSON-1826517071 tempest-TenantUsagesTestJSON-1826517071-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:50.100619 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 597/1279] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:53:49 2022] GET /compute/v2.1/servers/f2f50f6b-6a3e-449f-836e-bd897f78279c => generated 1355 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:53:50.109298 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-bcf80bba-bd37-417c-a621-71a6f6313539 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:53:50.114088 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-bcf80bba-bd37-417c-a621-71a6f6313539 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] [instance: 4c7b99a9-2ec4-4f4b-98e7-8e1ea2103735] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:53:50.133809 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bcf80bba-bd37-417c-a621-71a6f6313539 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:50.134395 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bcf80bba-bd37-417c-a621-71a6f6313539 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:50.136206 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bcf80bba-bd37-417c-a621-71a6f6313539 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:50.136979 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bcf80bba-bd37-417c-a621-71a6f6313539 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:50.137434 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bcf80bba-bd37-417c-a621-71a6f6313539 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:50.137863 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bcf80bba-bd37-417c-a621-71a6f6313539 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:50.159289 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-e1b9b61e-b3bc-4eed-8e29-eeba27d1252b tempest-TenantUsagesTestJSON-1826517071 tempest-TenantUsagesTestJSON-1826517071-project-admin] 10.222.0.18 "GET /compute/v2.1/os-simple-tenant-usage/d5695737326d4a83828b92469dd3e676?start=2022-10-21T20%3A53%3A49.618580&end=2022-10-23T20%3A53%3A49.618580" status: 200 len: 694 microversion: 2.1 time: 0.536091 Oct 22 20:53:50.167307 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 683/1280] 10.222.0.18 () {58 vars in 1412 bytes} [Sat Oct 22 20:53:49 2022] GET /compute/v2.1/os-simple-tenant-usage/d5695737326d4a83828b92469dd3e676?start=2022-10-21T20%3A53%3A49.618580&end=2022-10-23T20%3A53%3A49.618580 => generated 694 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:53:50.190154 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-8b50cfc3-84b8-4a3a-8b4e-588ccee4be61 tempest-InstanceActionsV221TestJSON-976463296 tempest-InstanceActionsV221TestJSON-976463296-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:53:50.192502 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-8b50cfc3-84b8-4a3a-8b4e-588ccee4be61 tempest-InstanceActionsV221TestJSON-976463296 tempest-InstanceActionsV221TestJSON-976463296-project] [instance: 304975d8-d62e-4156-9697-09c3a9724371] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:53:50.213846 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8b50cfc3-84b8-4a3a-8b4e-588ccee4be61 tempest-InstanceActionsV221TestJSON-976463296 tempest-InstanceActionsV221TestJSON-976463296-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:50.216951 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8b50cfc3-84b8-4a3a-8b4e-588ccee4be61 tempest-InstanceActionsV221TestJSON-976463296 tempest-InstanceActionsV221TestJSON-976463296-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:50.218546 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8b50cfc3-84b8-4a3a-8b4e-588ccee4be61 tempest-InstanceActionsV221TestJSON-976463296 tempest-InstanceActionsV221TestJSON-976463296-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:50.221878 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-bcf80bba-bd37-417c-a621-71a6f6313539 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] 10.222.0.18 "GET /compute/v2.1/servers/4c7b99a9-2ec4-4f4b-98e7-8e1ea2103735/os-volume_attachments" status: 200 len: 25 microversion: 2.25 time: 0.120390 Oct 22 20:53:50.224448 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8b50cfc3-84b8-4a3a-8b4e-588ccee4be61 tempest-InstanceActionsV221TestJSON-976463296 tempest-InstanceActionsV221TestJSON-976463296-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:50.225182 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8b50cfc3-84b8-4a3a-8b4e-588ccee4be61 tempest-InstanceActionsV221TestJSON-976463296 tempest-InstanceActionsV221TestJSON-976463296-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:50.226004 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8b50cfc3-84b8-4a3a-8b4e-588ccee4be61 tempest-InstanceActionsV221TestJSON-976463296 tempest-InstanceActionsV221TestJSON-976463296-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:50.230828 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 598/1281] 10.222.0.18 () {60 vars in 1343 bytes} [Sat Oct 22 20:53:50 2022] GET /compute/v2.1/servers/4c7b99a9-2ec4-4f4b-98e7-8e1ea2103735/os-volume_attachments => generated 25 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:53:50.236775 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-7a88bec3-c41e-412d-aa57-00c1fbc32d7f tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Calling method '.version_select at 0x7fd3a40e0430>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:53:50.353826 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-7a88bec3-c41e-412d-aa57-00c1fbc32d7f tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] 10.222.0.18 "GET /compute/v2.1/images/2c26b155-ef26-40a2-b7db-1b550c12a2cf" status: 200 len: 1429 microversion: 2.1 time: 0.120955 Oct 22 20:53:50.373746 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 599/1282] 10.222.0.18 () {58 vars in 1233 bytes} [Sat Oct 22 20:53:50 2022] GET /compute/v2.1/images/2c26b155-ef26-40a2-b7db-1b550c12a2cf => generated 1429 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:53:50.391320 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-fc833a70-af1a-4e56-9bbc-573ecaa9f844 tempest-TenantUsagesTestJSON-743245380 tempest-TenantUsagesTestJSON-743245380-project] Calling method '.version_select at 0x7fd39fee3a60>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:53:50.407529 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fc833a70-af1a-4e56-9bbc-573ecaa9f844 tempest-TenantUsagesTestJSON-743245380 tempest-TenantUsagesTestJSON-743245380-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:50.408591 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fc833a70-af1a-4e56-9bbc-573ecaa9f844 tempest-TenantUsagesTestJSON-743245380 tempest-TenantUsagesTestJSON-743245380-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:50.409218 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fc833a70-af1a-4e56-9bbc-573ecaa9f844 tempest-TenantUsagesTestJSON-743245380 tempest-TenantUsagesTestJSON-743245380-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:50.433060 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fc833a70-af1a-4e56-9bbc-573ecaa9f844 tempest-TenantUsagesTestJSON-743245380 tempest-TenantUsagesTestJSON-743245380-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:50.433881 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fc833a70-af1a-4e56-9bbc-573ecaa9f844 tempest-TenantUsagesTestJSON-743245380 tempest-TenantUsagesTestJSON-743245380-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:50.434543 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fc833a70-af1a-4e56-9bbc-573ecaa9f844 tempest-TenantUsagesTestJSON-743245380 tempest-TenantUsagesTestJSON-743245380-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:50.468953 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-fc833a70-af1a-4e56-9bbc-573ecaa9f844 tempest-TenantUsagesTestJSON-743245380 tempest-TenantUsagesTestJSON-743245380-project] 10.222.0.18 "GET /compute/v2.1/os-simple-tenant-usage/d5695737326d4a83828b92469dd3e676?start=2022-10-21T20%3A53%3A49.618580&end=2022-10-23T20%3A53%3A49.618580" status: 200 len: 694 microversion: 2.1 time: 0.093171 Oct 22 20:53:50.481883 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 600/1283] 10.222.0.18 () {58 vars in 1412 bytes} [Sat Oct 22 20:53:50 2022] GET /compute/v2.1/os-simple-tenant-usage/d5695737326d4a83828b92469dd3e676?start=2022-10-21T20%3A53%3A49.618580&end=2022-10-23T20%3A53%3A49.618580 => generated 694 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:53:50.491118 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-230621de-3b34-4f89-bebe-7d030d77aa12 tempest-TenantUsagesTestJSON-1826517071 tempest-TenantUsagesTestJSON-1826517071-project-admin] Calling method '.version_select at 0x7fd39febbc10>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:53:50.505266 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-230621de-3b34-4f89-bebe-7d030d77aa12 tempest-TenantUsagesTestJSON-1826517071 tempest-TenantUsagesTestJSON-1826517071-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:50.506230 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-230621de-3b34-4f89-bebe-7d030d77aa12 tempest-TenantUsagesTestJSON-1826517071 tempest-TenantUsagesTestJSON-1826517071-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:50.506907 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-230621de-3b34-4f89-bebe-7d030d77aa12 tempest-TenantUsagesTestJSON-1826517071 tempest-TenantUsagesTestJSON-1826517071-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:50.527105 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-230621de-3b34-4f89-bebe-7d030d77aa12 tempest-TenantUsagesTestJSON-1826517071 tempest-TenantUsagesTestJSON-1826517071-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:50.528118 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-230621de-3b34-4f89-bebe-7d030d77aa12 tempest-TenantUsagesTestJSON-1826517071 tempest-TenantUsagesTestJSON-1826517071-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:50.528806 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-230621de-3b34-4f89-bebe-7d030d77aa12 tempest-TenantUsagesTestJSON-1826517071 tempest-TenantUsagesTestJSON-1826517071-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:50.676313 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-230621de-3b34-4f89-bebe-7d030d77aa12 tempest-TenantUsagesTestJSON-1826517071 tempest-TenantUsagesTestJSON-1826517071-project-admin] 10.222.0.18 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-21T20%3A53%3A49.618580&end=2022-10-23T20%3A53%3A49.618580&detailed=1" status: 200 len: 15523 microversion: 2.1 time: 0.189464 Oct 22 20:53:50.679409 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 601/1284] 10.222.0.18 () {58 vars in 1335 bytes} [Sat Oct 22 20:53:50 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-21T20%3A53%3A49.618580&end=2022-10-23T20%3A53%3A49.618580&detailed=1 => generated 15523 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 22 20:53:50.720169 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-e3fce14f-5913-4634-8560-1800f3818b7d tempest-TenantUsagesTestJSON-743245380 tempest-TenantUsagesTestJSON-743245380-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:53:50.723679 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-e3fce14f-5913-4634-8560-1800f3818b7d tempest-TenantUsagesTestJSON-743245380 tempest-TenantUsagesTestJSON-743245380-project] [instance: 49ed4929-87c4-4ef4-8b46-c4bb3ca5be9a] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:53:50.744777 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e3fce14f-5913-4634-8560-1800f3818b7d tempest-TenantUsagesTestJSON-743245380 tempest-TenantUsagesTestJSON-743245380-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:50.745223 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e3fce14f-5913-4634-8560-1800f3818b7d tempest-TenantUsagesTestJSON-743245380 tempest-TenantUsagesTestJSON-743245380-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:50.746052 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e3fce14f-5913-4634-8560-1800f3818b7d tempest-TenantUsagesTestJSON-743245380 tempest-TenantUsagesTestJSON-743245380-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:50.747121 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e3fce14f-5913-4634-8560-1800f3818b7d tempest-TenantUsagesTestJSON-743245380 tempest-TenantUsagesTestJSON-743245380-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:50.747773 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e3fce14f-5913-4634-8560-1800f3818b7d tempest-TenantUsagesTestJSON-743245380 tempest-TenantUsagesTestJSON-743245380-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:50.748380 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e3fce14f-5913-4634-8560-1800f3818b7d tempest-TenantUsagesTestJSON-743245380 tempest-TenantUsagesTestJSON-743245380-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:50.787227 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-e3fce14f-5913-4634-8560-1800f3818b7d tempest-TenantUsagesTestJSON-743245380 tempest-TenantUsagesTestJSON-743245380-project] [instance: 49ed4929-87c4-4ef4-8b46-c4bb3ca5be9a] Going to try to terminate instance {{(pid=138744) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 20:53:50.994298 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-e3fce14f-5913-4634-8560-1800f3818b7d tempest-TenantUsagesTestJSON-743245380 tempest-TenantUsagesTestJSON-743245380-project] 10.222.0.18 "DELETE /compute/v2.1/servers/49ed4929-87c4-4ef4-8b46-c4bb3ca5be9a" status: 204 len: 0 microversion: 2.1 time: 0.288882 Oct 22 20:53:50.994866 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 602/1285] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 20:53:50 2022] DELETE /compute/v2.1/servers/49ed4929-87c4-4ef4-8b46-c4bb3ca5be9a => generated 0 bytes in 291 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 20:53:51.323177 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-c981873f-5110-4d9f-9d6d-3f5a4e6d0ada req-17e28df9-7da0-4227-86d9-d614aad15c78 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2f50f6b-6a3e-449f-836e-bd897f78279c", "name": "network-vif-plugged", "status": "completed", "tag": "16c272f7-7571-4436-bc1e-a2535cce8300"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:53:51.326177 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-8b50cfc3-84b8-4a3a-8b4e-588ccee4be61 tempest-InstanceActionsV221TestJSON-976463296 tempest-InstanceActionsV221TestJSON-976463296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13c3673ebe14b7e997ec664499b9e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f7808ed44e84de4a1574e8aacd71c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:53:51.344747 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-8b50cfc3-84b8-4a3a-8b4e-588ccee4be61 tempest-InstanceActionsV221TestJSON-976463296 tempest-InstanceActionsV221TestJSON-976463296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e13c3673ebe14b7e997ec664499b9e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f7808ed44e84de4a1574e8aacd71c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:53:51.346967 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-8b50cfc3-84b8-4a3a-8b4e-588ccee4be61 tempest-InstanceActionsV221TestJSON-976463296 tempest-InstanceActionsV221TestJSON-976463296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e13c3673ebe14b7e997ec664499b9e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f7808ed44e84de4a1574e8aacd71c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:53:51.347897 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-c981873f-5110-4d9f-9d6d-3f5a4e6d0ada req-17e28df9-7da0-4227-86d9-d614aad15c78 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:51.349811 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-8b50cfc3-84b8-4a3a-8b4e-588ccee4be61 tempest-InstanceActionsV221TestJSON-976463296 tempest-InstanceActionsV221TestJSON-976463296-project] 10.222.0.18 "GET /compute/v2.1/servers/304975d8-d62e-4156-9697-09c3a9724371" status: 200 len: 1311 microversion: 2.21 time: 1.180839 Oct 22 20:53:51.353222 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-c981873f-5110-4d9f-9d6d-3f5a4e6d0ada req-17e28df9-7da0-4227-86d9-d614aad15c78 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:51.354410 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-c981873f-5110-4d9f-9d6d-3f5a4e6d0ada req-17e28df9-7da0-4227-86d9-d614aad15c78 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:51.371379 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 684/1286] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 20:53:50 2022] GET /compute/v2.1/servers/304975d8-d62e-4156-9697-09c3a9724371 => generated 1311 bytes in 1189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 20:53:51.371379 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-46394294-09a4-486a-92c0-d48bb07c166c tempest-TenantUsagesTestJSON-743245380 tempest-TenantUsagesTestJSON-743245380-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:53:51.371379 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-46394294-09a4-486a-92c0-d48bb07c166c tempest-TenantUsagesTestJSON-743245380 tempest-TenantUsagesTestJSON-743245380-project] [instance: 49ed4929-87c4-4ef4-8b46-c4bb3ca5be9a] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:53:51.403711 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-46394294-09a4-486a-92c0-d48bb07c166c tempest-TenantUsagesTestJSON-743245380 tempest-TenantUsagesTestJSON-743245380-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:51.404594 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-46394294-09a4-486a-92c0-d48bb07c166c tempest-TenantUsagesTestJSON-743245380 tempest-TenantUsagesTestJSON-743245380-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:51.408544 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-46394294-09a4-486a-92c0-d48bb07c166c tempest-TenantUsagesTestJSON-743245380 tempest-TenantUsagesTestJSON-743245380-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:51.410995 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-46394294-09a4-486a-92c0-d48bb07c166c tempest-TenantUsagesTestJSON-743245380 tempest-TenantUsagesTestJSON-743245380-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:51.412594 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-46394294-09a4-486a-92c0-d48bb07c166c tempest-TenantUsagesTestJSON-743245380 tempest-TenantUsagesTestJSON-743245380-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:51.415590 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-46394294-09a4-486a-92c0-d48bb07c166c tempest-TenantUsagesTestJSON-743245380 tempest-TenantUsagesTestJSON-743245380-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:51.417874 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-c981873f-5110-4d9f-9d6d-3f5a4e6d0ada req-17e28df9-7da0-4227-86d9-d614aad15c78 service nova] Creating event network-vif-plugged:16c272f7-7571-4436-bc1e-a2535cce8300 for instance f2f50f6b-6a3e-449f-836e-bd897f78279c on nch2-master-1 Oct 22 20:53:51.437884 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-c981873f-5110-4d9f-9d6d-3f5a4e6d0ada req-17e28df9-7da0-4227-86d9-d614aad15c78 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.441343 Oct 22 20:53:51.442486 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 603/1287] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:53:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:53:51.493874 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-1445fd9a-8651-4991-8da7-21540fa4301d tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:53:51.500417 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-1445fd9a-8651-4991-8da7-21540fa4301d tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] [instance: f2f50f6b-6a3e-449f-836e-bd897f78279c] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:53:51.534511 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1445fd9a-8651-4991-8da7-21540fa4301d tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:51.535442 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1445fd9a-8651-4991-8da7-21540fa4301d tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:51.537115 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1445fd9a-8651-4991-8da7-21540fa4301d tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:51.542080 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1445fd9a-8651-4991-8da7-21540fa4301d tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:51.543146 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1445fd9a-8651-4991-8da7-21540fa4301d tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:51.548735 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1445fd9a-8651-4991-8da7-21540fa4301d tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:52.268423 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-46394294-09a4-486a-92c0-d48bb07c166c tempest-TenantUsagesTestJSON-743245380 tempest-TenantUsagesTestJSON-743245380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d35abfd0aa4dd09b9d0ad56faebd66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5695737326d4a83828b92469dd3e676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:53:52.284080 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-46394294-09a4-486a-92c0-d48bb07c166c tempest-TenantUsagesTestJSON-743245380 tempest-TenantUsagesTestJSON-743245380-project] 10.222.0.18 "GET /compute/v2.1/servers/49ed4929-87c4-4ef4-8b46-c4bb3ca5be9a" status: 200 len: 1468 microversion: 2.1 time: 0.922826 Oct 22 20:53:52.298072 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 685/1288] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:53:51 2022] GET /compute/v2.1/servers/49ed4929-87c4-4ef4-8b46-c4bb3ca5be9a => generated 1468 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:53:52.315442 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-578d6f9c-8bfb-4112-9da0-2b66205f6c70 tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Calling method '.version_select at 0x7fd3a40a2550>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:53:52.321171 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-1445fd9a-8651-4991-8da7-21540fa4301d tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7f48d18691d4473bbe0284c44f14d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bacf9909082440f8a201771b64a75fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:53:52.346703 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-1445fd9a-8651-4991-8da7-21540fa4301d tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] 10.222.0.18 "GET /compute/v2.1/servers/f2f50f6b-6a3e-449f-836e-bd897f78279c" status: 200 len: 1355 microversion: 2.1 time: 0.898020 Oct 22 20:53:52.362968 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 604/1289] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:53:51 2022] GET /compute/v2.1/servers/f2f50f6b-6a3e-449f-836e-bd897f78279c => generated 1355 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:53:52.393189 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-9a561e58-0c22-4cab-b241-8d7ffd938abd tempest-InstanceActionsV221TestJSON-976463296 tempest-InstanceActionsV221TestJSON-976463296-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:53:52.393965 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-9a561e58-0c22-4cab-b241-8d7ffd938abd tempest-InstanceActionsV221TestJSON-976463296 tempest-InstanceActionsV221TestJSON-976463296-project] [instance: 304975d8-d62e-4156-9697-09c3a9724371] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:53:52.418020 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9a561e58-0c22-4cab-b241-8d7ffd938abd tempest-InstanceActionsV221TestJSON-976463296 tempest-InstanceActionsV221TestJSON-976463296-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:52.418639 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9a561e58-0c22-4cab-b241-8d7ffd938abd tempest-InstanceActionsV221TestJSON-976463296 tempest-InstanceActionsV221TestJSON-976463296-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:52.422031 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9a561e58-0c22-4cab-b241-8d7ffd938abd tempest-InstanceActionsV221TestJSON-976463296 tempest-InstanceActionsV221TestJSON-976463296-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:52.423097 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9a561e58-0c22-4cab-b241-8d7ffd938abd tempest-InstanceActionsV221TestJSON-976463296 tempest-InstanceActionsV221TestJSON-976463296-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:52.423685 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9a561e58-0c22-4cab-b241-8d7ffd938abd tempest-InstanceActionsV221TestJSON-976463296 tempest-InstanceActionsV221TestJSON-976463296-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:52.431944 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9a561e58-0c22-4cab-b241-8d7ffd938abd tempest-InstanceActionsV221TestJSON-976463296 tempest-InstanceActionsV221TestJSON-976463296-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:52.444374 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-578d6f9c-8bfb-4112-9da0-2b66205f6c70 tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] 10.222.0.18 "GET /compute/v2.1/images/2c26b155-ef26-40a2-b7db-1b550c12a2cf" status: 200 len: 1429 microversion: 2.1 time: 0.143999 Oct 22 20:53:52.446483 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 686/1290] 10.222.0.18 () {58 vars in 1233 bytes} [Sat Oct 22 20:53:52 2022] GET /compute/v2.1/images/2c26b155-ef26-40a2-b7db-1b550c12a2cf => generated 1429 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:53:52.621100 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-9a561e58-0c22-4cab-b241-8d7ffd938abd tempest-InstanceActionsV221TestJSON-976463296 tempest-InstanceActionsV221TestJSON-976463296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13c3673ebe14b7e997ec664499b9e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f7808ed44e84de4a1574e8aacd71c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:53:52.663051 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-9a561e58-0c22-4cab-b241-8d7ffd938abd tempest-InstanceActionsV221TestJSON-976463296 tempest-InstanceActionsV221TestJSON-976463296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e13c3673ebe14b7e997ec664499b9e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f7808ed44e84de4a1574e8aacd71c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:53:52.683381 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-9a561e58-0c22-4cab-b241-8d7ffd938abd tempest-InstanceActionsV221TestJSON-976463296 tempest-InstanceActionsV221TestJSON-976463296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e13c3673ebe14b7e997ec664499b9e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f7808ed44e84de4a1574e8aacd71c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:53:52.684668 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-9a561e58-0c22-4cab-b241-8d7ffd938abd tempest-InstanceActionsV221TestJSON-976463296 tempest-InstanceActionsV221TestJSON-976463296-project] 10.222.0.18 "GET /compute/v2.1/servers/304975d8-d62e-4156-9697-09c3a9724371" status: 200 len: 1317 microversion: 2.21 time: 0.296957 Oct 22 20:53:52.701194 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 605/1291] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 20:53:52 2022] GET /compute/v2.1/servers/304975d8-d62e-4156-9697-09c3a9724371 => generated 1317 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 22 20:53:52.999840 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-d92e760f-82ee-4c73-9f08-ddb201a68a46 tempest-HypervisorAdminNegativeTestJSON-1130511083 tempest-HypervisorAdminNegativeTestJSON-1130511083-project] Calling method '.version_select at 0x7fd3a44e9e50>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:53:53.001983 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-d92e760f-82ee-4c73-9f08-ddb201a68a46 tempest-HypervisorAdminNegativeTestJSON-1130511083 tempest-HypervisorAdminNegativeTestJSON-1130511083-project] Policy check for os_compute_api:os-hypervisors:list-detail failed with credentials {'is_admin': False, 'user_id': 'fe173d8585d8411b9bb7cd16c740b1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14e3157728354ced869bc104f463d9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:53:53.006660 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-d92e760f-82ee-4c73-9f08-ddb201a68a46 tempest-HypervisorAdminNegativeTestJSON-1130511083 tempest-HypervisorAdminNegativeTestJSON-1130511083-project] Request method failure captured: Oct 22 20:53:53.006660 ncdv-master-1 devstack@n-api.service[138745]: request: GET /compute/v2.1/os-hypervisors/detail HTTP/1.1 Oct 22 20:53:53.006660 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 20:53:53.006660 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 20:53:53.006660 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 20:53:53.006660 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 0 Oct 22 20:53:53.006660 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 20:53:53.006660 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 20:53:53.006660 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 20:53:53.006660 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 20:53:53.006660 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVFheAoN1hj-tS6kn8Ago27t83sJpHlayOUg3PFKK5ZJMI1mpyFZjjhx_ngmNUY7CT6nagOtfsoKxa4XUYKHs7pKPMn7xiX6u9UFWNURm1RnUQPQjmFrv1tCLGlGLvNeWP0_GA3TvRgryEOAVXVmEuQwp4tPKxuQmYvoFLAIKwYH8re8 Oct 22 20:53:53.006660 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 20:53:53.006660 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 20:53:53.006660 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 20:53:53.006660 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 20:53:53.006660 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 20:53:53.006660 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 20:53:53.006660 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: 14e3157728354ced869bc104f463d9e1 Oct 22 20:53:53.006660 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1130511083 Oct 22 20:53:53.006660 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 20:53:53.006660 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 20:53:53.006660 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_14e3157728354ced869bc104f463d9e1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/14e3157728354ced869bc104f463d9e1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/14e3157728354ced869bc104f463d9e1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/14e3157728354ced869bc104f463d9e1"}]}] Oct 22 20:53:53.006660 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1130511083 Oct 22 20:53:53.006660 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: 14e3157728354ced869bc104f463d9e1 Oct 22 20:53:53.006660 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1130511083 Oct 22 20:53:53.006660 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-HypervisorAdminNegativeTestJSON-1130511083-project Oct 22 20:53:53.006660 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 20:53:53.006660 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 20:53:53.006660 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: fe173d8585d8411b9bb7cd16c740b1c9 Oct 22 20:53:53.006660 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1130511083-project Oct 22 20:53:53.006660 ncdv-master-1 devstack@n-api.service[138745]: method: Oct 22 20:53:53.006660 ncdv-master-1 devstack@n-api.service[138745]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Oct 22 20:53:53.006660 ncdv-master-1 devstack@n-api.service[138745]: action_args: {} Oct 22 20:53:53.006660 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:53:53.006660 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:53:53.006660 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:53:53.006660 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:53:53.006660 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:53:53.006660 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:53:53.006660 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 22 20:53:53.006660 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 22 20:53:53.006660 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:53:53.006660 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:53:53.006660 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 285, in detail Oct 22 20:53:53.006660 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return self._detail(req) Oct 22 20:53:53.006660 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 289, in _detail Oct 22 20:53:53.006660 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list-detail', target={}) Oct 22 20:53:53.006660 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 22 20:53:53.006660 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 22 20:53:53.006660 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 22 20:53:53.006660 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 22 20:53:53.006660 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 22 20:53:53.006660 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 22 20:53:53.006660 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 22 20:53:53.006660 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise self.value Oct 22 20:53:53.006660 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 22 20:53:53.006660 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 22 20:53:53.006660 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 22 20:53:53.006660 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 22 20:53:53.006660 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 22 20:53:53.006660 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 22 20:53:53.006660 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Oct 22 20:53:53.006660 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:53:53.013663 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:53:53.013663 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:53:53.013663 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:53:53.013663 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:53:53.013663 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:53:53.013663 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 22 20:53:53.013663 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 22 20:53:53.013663 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Oct 22 20:53:53.013663 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:53:53.013663 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-d92e760f-82ee-4c73-9f08-ddb201a68a46 tempest-HypervisorAdminNegativeTestJSON-1130511083 tempest-HypervisorAdminNegativeTestJSON-1130511083-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:53:53.013663 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-d92e760f-82ee-4c73-9f08-ddb201a68a46 tempest-HypervisorAdminNegativeTestJSON-1130511083 tempest-HypervisorAdminNegativeTestJSON-1130511083-project] 10.222.0.18 "GET /compute/v2.1/os-hypervisors/detail" status: 403 len: 122 microversion: 2.1 time: 0.312126 Oct 22 20:53:53.013663 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 687/1292] 10.222.0.18 () {58 vars in 1167 bytes} [Sat Oct 22 20:53:52 2022] GET /compute/v2.1/os-hypervisors/detail => generated 122 bytes in 313 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 22 20:53:53.018906 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-854828ed-9331-49d1-a6a8-5d8ca53b6bc8 tempest-HypervisorAdminNegativeTestJSON-1130511083 tempest-HypervisorAdminNegativeTestJSON-1130511083-project] Calling method '.version_select at 0x7fd3a4051b80>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:53:53.021311 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-854828ed-9331-49d1-a6a8-5d8ca53b6bc8 tempest-HypervisorAdminNegativeTestJSON-1130511083 tempest-HypervisorAdminNegativeTestJSON-1130511083-project] Policy check for os_compute_api:os-hypervisors:list failed with credentials {'is_admin': False, 'user_id': 'fe173d8585d8411b9bb7cd16c740b1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14e3157728354ced869bc104f463d9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:53:53.023812 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-854828ed-9331-49d1-a6a8-5d8ca53b6bc8 tempest-HypervisorAdminNegativeTestJSON-1130511083 tempest-HypervisorAdminNegativeTestJSON-1130511083-project] Request method failure captured: Oct 22 20:53:53.023812 ncdv-master-1 devstack@n-api.service[138744]: request: GET /compute/v2.1/os-hypervisors HTTP/1.1 Oct 22 20:53:53.023812 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 20:53:53.023812 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 20:53:53.023812 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 20:53:53.023812 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 0 Oct 22 20:53:53.023812 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 20:53:53.023812 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 20:53:53.023812 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 20:53:53.023812 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 20:53:53.023812 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVFheAoN1hj-tS6kn8Ago27t83sJpHlayOUg3PFKK5ZJMI1mpyFZjjhx_ngmNUY7CT6nagOtfsoKxa4XUYKHs7pKPMn7xiX6u9UFWNURm1RnUQPQjmFrv1tCLGlGLvNeWP0_GA3TvRgryEOAVXVmEuQwp4tPKxuQmYvoFLAIKwYH8re8 Oct 22 20:53:53.023812 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 20:53:53.023812 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 20:53:53.023812 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 20:53:53.023812 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 20:53:53.023812 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 20:53:53.023812 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 20:53:53.023812 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: 14e3157728354ced869bc104f463d9e1 Oct 22 20:53:53.023812 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1130511083 Oct 22 20:53:53.023812 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 20:53:53.023812 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 20:53:53.023812 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_14e3157728354ced869bc104f463d9e1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/14e3157728354ced869bc104f463d9e1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/14e3157728354ced869bc104f463d9e1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/14e3157728354ced869bc104f463d9e1"}]}] Oct 22 20:53:53.023812 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1130511083 Oct 22 20:53:53.023812 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: 14e3157728354ced869bc104f463d9e1 Oct 22 20:53:53.023812 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1130511083 Oct 22 20:53:53.023812 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-HypervisorAdminNegativeTestJSON-1130511083-project Oct 22 20:53:53.023812 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 20:53:53.023812 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 20:53:53.023812 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: fe173d8585d8411b9bb7cd16c740b1c9 Oct 22 20:53:53.023812 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1130511083-project Oct 22 20:53:53.023812 ncdv-master-1 devstack@n-api.service[138744]: method: Oct 22 20:53:53.023812 ncdv-master-1 devstack@n-api.service[138744]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Oct 22 20:53:53.023812 ncdv-master-1 devstack@n-api.service[138744]: action_args: {} Oct 22 20:53:53.023812 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:53:53.023812 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:53:53.023812 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:53:53.023812 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:53:53.023812 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:53:53.023812 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:53:53.023812 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 22 20:53:53.023812 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 22 20:53:53.023812 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:53:53.023812 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:53:53.023812 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 253, in index Oct 22 20:53:53.023812 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return self._index(req) Oct 22 20:53:53.023812 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 257, in _index Oct 22 20:53:53.023812 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list', target={}) Oct 22 20:53:53.023812 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 22 20:53:53.023812 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 22 20:53:53.023812 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 22 20:53:53.023812 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 22 20:53:53.023812 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 22 20:53:53.023812 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 22 20:53:53.023812 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 22 20:53:53.023812 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise self.value Oct 22 20:53:53.023812 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 22 20:53:53.023812 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 22 20:53:53.023812 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 22 20:53:53.023812 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 22 20:53:53.023812 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 22 20:53:53.023812 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 22 20:53:53.023812 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Oct 22 20:53:53.023812 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:53:53.028641 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:53:53.028641 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:53:53.028641 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:53:53.028641 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:53:53.028641 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:53:53.028641 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 22 20:53:53.028641 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 22 20:53:53.028641 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Oct 22 20:53:53.028641 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:53:53.028641 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-854828ed-9331-49d1-a6a8-5d8ca53b6bc8 tempest-HypervisorAdminNegativeTestJSON-1130511083 tempest-HypervisorAdminNegativeTestJSON-1130511083-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:53:53.028641 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-854828ed-9331-49d1-a6a8-5d8ca53b6bc8 tempest-HypervisorAdminNegativeTestJSON-1130511083 tempest-HypervisorAdminNegativeTestJSON-1130511083-project] 10.222.0.18 "GET /compute/v2.1/os-hypervisors" status: 403 len: 115 microversion: 2.1 time: 0.010906 Oct 22 20:53:53.033319 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 606/1293] 10.222.0.18 () {58 vars in 1146 bytes} [Sat Oct 22 20:53:53 2022] GET /compute/v2.1/os-hypervisors => generated 115 bytes in 18 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 22 20:53:53.050745 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-6c76865b-bff8-4d8f-8181-44be0e0a5565 tempest-HypervisorAdminNegativeTestJSON-1130511083 tempest-HypervisorAdminNegativeTestJSON-1130511083-project] Calling method '.version_select at 0x7fd3a47ada60>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:53:53.052766 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-6c76865b-bff8-4d8f-8181-44be0e0a5565 tempest-HypervisorAdminNegativeTestJSON-1130511083 tempest-HypervisorAdminNegativeTestJSON-1130511083-project] Policy check for os_compute_api:os-hypervisors:statistics failed with credentials {'is_admin': False, 'user_id': 'fe173d8585d8411b9bb7cd16c740b1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14e3157728354ced869bc104f463d9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:53:53.060809 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-6c76865b-bff8-4d8f-8181-44be0e0a5565 tempest-HypervisorAdminNegativeTestJSON-1130511083 tempest-HypervisorAdminNegativeTestJSON-1130511083-project] Request method failure captured: Oct 22 20:53:53.060809 ncdv-master-1 devstack@n-api.service[138745]: request: GET /compute/v2.1/os-hypervisors/statistics HTTP/1.1 Oct 22 20:53:53.060809 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 20:53:53.060809 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 20:53:53.060809 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 20:53:53.060809 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 0 Oct 22 20:53:53.060809 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 20:53:53.060809 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 20:53:53.060809 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 20:53:53.060809 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 20:53:53.060809 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVFheAoN1hj-tS6kn8Ago27t83sJpHlayOUg3PFKK5ZJMI1mpyFZjjhx_ngmNUY7CT6nagOtfsoKxa4XUYKHs7pKPMn7xiX6u9UFWNURm1RnUQPQjmFrv1tCLGlGLvNeWP0_GA3TvRgryEOAVXVmEuQwp4tPKxuQmYvoFLAIKwYH8re8 Oct 22 20:53:53.060809 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 20:53:53.060809 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 20:53:53.060809 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 20:53:53.060809 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 20:53:53.060809 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 20:53:53.060809 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 20:53:53.060809 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: 14e3157728354ced869bc104f463d9e1 Oct 22 20:53:53.060809 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1130511083 Oct 22 20:53:53.060809 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 20:53:53.060809 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 20:53:53.060809 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_14e3157728354ced869bc104f463d9e1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/14e3157728354ced869bc104f463d9e1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/14e3157728354ced869bc104f463d9e1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/14e3157728354ced869bc104f463d9e1"}]}] Oct 22 20:53:53.060809 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1130511083 Oct 22 20:53:53.060809 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: 14e3157728354ced869bc104f463d9e1 Oct 22 20:53:53.060809 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1130511083 Oct 22 20:53:53.060809 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-HypervisorAdminNegativeTestJSON-1130511083-project Oct 22 20:53:53.060809 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 20:53:53.060809 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 20:53:53.060809 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: fe173d8585d8411b9bb7cd16c740b1c9 Oct 22 20:53:53.060809 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1130511083-project Oct 22 20:53:53.060809 ncdv-master-1 devstack@n-api.service[138745]: method: Oct 22 20:53:53.060809 ncdv-master-1 devstack@n-api.service[138745]: exception: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Oct 22 20:53:53.060809 ncdv-master-1 devstack@n-api.service[138745]: action_args: {} Oct 22 20:53:53.060809 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:53:53.060809 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:53:53.060809 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:53:53.060809 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:53:53.060809 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:53:53.060809 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:53:53.060809 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 22 20:53:53.060809 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 22 20:53:53.060809 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:53:53.060809 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:53:53.060809 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 521, in statistics Oct 22 20:53:53.060809 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'statistics', target={}) Oct 22 20:53:53.060809 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 22 20:53:53.060809 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 22 20:53:53.060809 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 22 20:53:53.060809 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 22 20:53:53.060809 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 22 20:53:53.060809 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 22 20:53:53.060809 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 22 20:53:53.060809 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise self.value Oct 22 20:53:53.060809 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 22 20:53:53.060809 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 22 20:53:53.060809 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 22 20:53:53.060809 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 22 20:53:53.060809 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 22 20:53:53.060809 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 22 20:53:53.060809 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Oct 22 20:53:53.060809 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:53:53.060809 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:53:53.060809 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:53:53.060809 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:53:53.065841 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:53:53.065841 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:53:53.065841 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 22 20:53:53.065841 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 22 20:53:53.065841 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Oct 22 20:53:53.065841 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:53:53.065841 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-6c76865b-bff8-4d8f-8181-44be0e0a5565 tempest-HypervisorAdminNegativeTestJSON-1130511083 tempest-HypervisorAdminNegativeTestJSON-1130511083-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:53:53.065841 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-6c76865b-bff8-4d8f-8181-44be0e0a5565 tempest-HypervisorAdminNegativeTestJSON-1130511083 tempest-HypervisorAdminNegativeTestJSON-1130511083-project] 10.222.0.18 "GET /compute/v2.1/os-hypervisors/statistics" status: 403 len: 121 microversion: 2.1 time: 0.027669 Oct 22 20:53:53.068382 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 688/1294] 10.222.0.18 () {58 vars in 1179 bytes} [Sat Oct 22 20:53:53 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 121 bytes in 35 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 22 20:53:53.148273 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-320514e5-5996-489d-860b-5210496528a9 tempest-HypervisorAdminNegativeTestJSON-1854279351 tempest-HypervisorAdminNegativeTestJSON-1854279351-project-admin] Calling method '.version_select at 0x7fd39fef14c0>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:53:53.151288 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-320514e5-5996-489d-860b-5210496528a9 tempest-HypervisorAdminNegativeTestJSON-1854279351 tempest-HypervisorAdminNegativeTestJSON-1854279351-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:53.152412 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-320514e5-5996-489d-860b-5210496528a9 tempest-HypervisorAdminNegativeTestJSON-1854279351 tempest-HypervisorAdminNegativeTestJSON-1854279351-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:53.153009 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-320514e5-5996-489d-860b-5210496528a9 tempest-HypervisorAdminNegativeTestJSON-1854279351 tempest-HypervisorAdminNegativeTestJSON-1854279351-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:53.177170 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-320514e5-5996-489d-860b-5210496528a9 tempest-HypervisorAdminNegativeTestJSON-1854279351 tempest-HypervisorAdminNegativeTestJSON-1854279351-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:53.177965 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-320514e5-5996-489d-860b-5210496528a9 tempest-HypervisorAdminNegativeTestJSON-1854279351 tempest-HypervisorAdminNegativeTestJSON-1854279351-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:53.179153 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-320514e5-5996-489d-860b-5210496528a9 tempest-HypervisorAdminNegativeTestJSON-1854279351 tempest-HypervisorAdminNegativeTestJSON-1854279351-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:53.194848 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-320514e5-5996-489d-860b-5210496528a9 tempest-HypervisorAdminNegativeTestJSON-1854279351 tempest-HypervisorAdminNegativeTestJSON-1854279351-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:53.195369 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-320514e5-5996-489d-860b-5210496528a9 tempest-HypervisorAdminNegativeTestJSON-1854279351 tempest-HypervisorAdminNegativeTestJSON-1854279351-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:53.195982 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-320514e5-5996-489d-860b-5210496528a9 tempest-HypervisorAdminNegativeTestJSON-1854279351 tempest-HypervisorAdminNegativeTestJSON-1854279351-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:53.203649 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-320514e5-5996-489d-860b-5210496528a9 tempest-HypervisorAdminNegativeTestJSON-1854279351 tempest-HypervisorAdminNegativeTestJSON-1854279351-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.134924 Oct 22 20:53:53.210923 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 607/1295] 10.222.0.18 () {58 vars in 1146 bytes} [Sat Oct 22 20:53:53 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:53:53.216024 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-f6b5aa57-8844-45d0-8b00-f20555710129 tempest-HypervisorAdminNegativeTestJSON-1130511083 tempest-HypervisorAdminNegativeTestJSON-1130511083-project] Calling method '.version_select at 0x7fd3a4519040>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:53:53.218028 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-f6b5aa57-8844-45d0-8b00-f20555710129 tempest-HypervisorAdminNegativeTestJSON-1130511083 tempest-HypervisorAdminNegativeTestJSON-1130511083-project] Policy check for os_compute_api:os-hypervisors:uptime failed with credentials {'is_admin': False, 'user_id': 'fe173d8585d8411b9bb7cd16c740b1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14e3157728354ced869bc104f463d9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:53:53.219678 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-f6b5aa57-8844-45d0-8b00-f20555710129 tempest-HypervisorAdminNegativeTestJSON-1130511083 tempest-HypervisorAdminNegativeTestJSON-1130511083-project] Request method failure captured: Oct 22 20:53:53.219678 ncdv-master-1 devstack@n-api.service[138745]: request: GET /compute/v2.1/os-hypervisors/1/uptime HTTP/1.1 Oct 22 20:53:53.219678 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 20:53:53.219678 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 20:53:53.219678 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 20:53:53.219678 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 0 Oct 22 20:53:53.219678 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 20:53:53.219678 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 20:53:53.219678 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 20:53:53.219678 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 20:53:53.219678 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVFheAoN1hj-tS6kn8Ago27t83sJpHlayOUg3PFKK5ZJMI1mpyFZjjhx_ngmNUY7CT6nagOtfsoKxa4XUYKHs7pKPMn7xiX6u9UFWNURm1RnUQPQjmFrv1tCLGlGLvNeWP0_GA3TvRgryEOAVXVmEuQwp4tPKxuQmYvoFLAIKwYH8re8 Oct 22 20:53:53.219678 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 20:53:53.219678 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 20:53:53.219678 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 20:53:53.219678 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 20:53:53.219678 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 20:53:53.219678 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 20:53:53.219678 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: 14e3157728354ced869bc104f463d9e1 Oct 22 20:53:53.219678 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1130511083 Oct 22 20:53:53.219678 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 20:53:53.219678 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 20:53:53.219678 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_14e3157728354ced869bc104f463d9e1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/14e3157728354ced869bc104f463d9e1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/14e3157728354ced869bc104f463d9e1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/14e3157728354ced869bc104f463d9e1"}]}] Oct 22 20:53:53.219678 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1130511083 Oct 22 20:53:53.219678 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: 14e3157728354ced869bc104f463d9e1 Oct 22 20:53:53.219678 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1130511083 Oct 22 20:53:53.219678 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-HypervisorAdminNegativeTestJSON-1130511083-project Oct 22 20:53:53.219678 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 20:53:53.219678 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 20:53:53.219678 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: fe173d8585d8411b9bb7cd16c740b1c9 Oct 22 20:53:53.219678 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1130511083-project Oct 22 20:53:53.219678 ncdv-master-1 devstack@n-api.service[138745]: method: Oct 22 20:53:53.219678 ncdv-master-1 devstack@n-api.service[138745]: exception: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Oct 22 20:53:53.219678 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'id': '1'} Oct 22 20:53:53.219678 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:53:53.219678 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:53:53.219678 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:53:53.219678 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:53:53.219678 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:53:53.219678 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:53:53.219678 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 22 20:53:53.219678 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 22 20:53:53.219678 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:53:53.219678 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:53:53.219678 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 387, in uptime Oct 22 20:53:53.219678 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'uptime', target={}) Oct 22 20:53:53.219678 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 22 20:53:53.219678 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 22 20:53:53.219678 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 22 20:53:53.219678 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 22 20:53:53.219678 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 22 20:53:53.219678 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 22 20:53:53.219678 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 22 20:53:53.219678 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise self.value Oct 22 20:53:53.219678 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 22 20:53:53.219678 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 22 20:53:53.219678 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 22 20:53:53.219678 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 22 20:53:53.219678 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 22 20:53:53.219678 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 22 20:53:53.219678 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Oct 22 20:53:53.219678 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:53:53.219678 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:53:53.219678 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:53:53.219678 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:53:53.225099 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:53:53.225099 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:53:53.225099 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 22 20:53:53.225099 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 22 20:53:53.225099 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Oct 22 20:53:53.225099 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:53:53.228448 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-f6b5aa57-8844-45d0-8b00-f20555710129 tempest-HypervisorAdminNegativeTestJSON-1130511083 tempest-HypervisorAdminNegativeTestJSON-1130511083-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:53:53.229562 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-f6b5aa57-8844-45d0-8b00-f20555710129 tempest-HypervisorAdminNegativeTestJSON-1130511083 tempest-HypervisorAdminNegativeTestJSON-1130511083-project] 10.222.0.18 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 403 len: 117 microversion: 2.1 time: 0.017599 Oct 22 20:53:53.230701 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 689/1296] 10.222.0.18 () {58 vars in 1173 bytes} [Sat Oct 22 20:53:53 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 117 bytes in 19 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 22 20:53:53.240484 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-37e51b39-adb5-4095-875d-020c0b3bff9e tempest-HypervisorAdminNegativeTestJSON-1854279351 tempest-HypervisorAdminNegativeTestJSON-1854279351-project-admin] Calling method '.version_select at 0x7fd39fed65e0>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:53:53.243533 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-37e51b39-adb5-4095-875d-020c0b3bff9e tempest-HypervisorAdminNegativeTestJSON-1854279351 tempest-HypervisorAdminNegativeTestJSON-1854279351-project-admin] HTTP exception thrown: Hypervisor with ID '91ed8768-dcbb-4d03-9ab2-0322980ceb6e' could not be found. Oct 22 20:53:53.261614 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-37e51b39-adb5-4095-875d-020c0b3bff9e tempest-HypervisorAdminNegativeTestJSON-1854279351 tempest-HypervisorAdminNegativeTestJSON-1854279351-project-admin] Request method failure captured: Oct 22 20:53:53.261614 ncdv-master-1 devstack@n-api.service[138744]: request: GET /compute/v2.1/os-hypervisors/91ed8768-dcbb-4d03-9ab2-0322980ceb6e/uptime HTTP/1.1 Oct 22 20:53:53.261614 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 20:53:53.261614 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 20:53:53.261614 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 20:53:53.261614 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 0 Oct 22 20:53:53.261614 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 20:53:53.261614 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 20:53:53.261614 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 20:53:53.261614 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 20:53:53.261614 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVFhg7PaqSrvjvHpjLnuCzlfxUB3tRf7xPZHYtbOAHMetPfH02pu8IH4ZKMoQ6nP5aycGqVSBiUi59mdYnaFZRq4_sygTVKDOflrOcnbpWB0BvC8wuar0iZgtAznHexIc7seXFuxUmTF0G07s0ZX3bHUOmOLiQX6zFa9CqdK8UP1xfkE Oct 22 20:53:53.261614 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 20:53:53.261614 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 20:53:53.261614 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 20:53:53.261614 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 20:53:53.261614 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 20:53:53.261614 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 20:53:53.261614 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: 07f68865411e463aaec7fabf42867892 Oct 22 20:53:53.261614 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1854279351 Oct 22 20:53:53.261614 ncdv-master-1 devstack@n-api.service[138744]: X-Role: admin,member,reader Oct 22 20:53:53.261614 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: admin,member,reader Oct 22 20:53:53.261614 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_07f68865411e463aaec7fabf42867892"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/07f68865411e463aaec7fabf42867892"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/07f68865411e463aaec7fabf42867892"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/07f68865411e463aaec7fabf42867892"}]}] Oct 22 20:53:53.261614 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1854279351 Oct 22 20:53:53.261614 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: 07f68865411e463aaec7fabf42867892 Oct 22 20:53:53.261614 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1854279351 Oct 22 20:53:53.261614 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-HypervisorAdminNegativeTestJSON-1854279351-project-admin Oct 22 20:53:53.261614 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 20:53:53.261614 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 20:53:53.261614 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: 18a01a6dfe4542178f17bc82b2224b58 Oct 22 20:53:53.261614 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1854279351-project-admin Oct 22 20:53:53.261614 ncdv-master-1 devstack@n-api.service[138744]: method: Oct 22 20:53:53.261614 ncdv-master-1 devstack@n-api.service[138744]: exception: Hypervisor with ID '91ed8768-dcbb-4d03-9ab2-0322980ceb6e' could not be found. Oct 22 20:53:53.261614 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': '91ed8768-dcbb-4d03-9ab2-0322980ceb6e'} Oct 22 20:53:53.261614 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:53:53.261614 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:53:53.261614 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Oct 22 20:53:53.261614 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi value = int(str(value)) Oct 22 20:53:53.261614 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '91ed8768-dcbb-4d03-9ab2-0322980ceb6e' Oct 22 20:53:53.261614 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:53:53.261614 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:53:53.261614 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:53:53.261614 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:53:53.261614 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Oct 22 20:53:53.261614 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Oct 22 20:53:53.261614 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Oct 22 20:53:53.261614 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Oct 22 20:53:53.261614 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Oct 22 20:53:53.261614 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:53:53.261614 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:53:53.261614 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:53:53.261614 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:53:53.261614 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Oct 22 20:53:53.261614 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Oct 22 20:53:53.261614 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Oct 22 20:53:53.261614 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Oct 22 20:53:53.261614 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Oct 22 20:53:53.261614 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:53:53.261614 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:53:53.261614 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:53:53.261614 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:53:53.261614 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:53:53.261614 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:53:53.261614 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:53:53.261614 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:53:53.261614 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 22 20:53:53.266893 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 22 20:53:53.266893 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:53:53.266893 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:53:53.266893 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 389, in uptime Oct 22 20:53:53.266893 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Oct 22 20:53:53.266893 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Oct 22 20:53:53.266893 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 22 20:53:53.266893 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '91ed8768-dcbb-4d03-9ab2-0322980ceb6e' could not be found. Oct 22 20:53:53.266893 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:53:53.266893 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:53:53.266893 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:53:53.266893 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:53:53.266893 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:53:53.266893 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:53:53.266893 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 20:53:53.266893 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 20:53:53.266893 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '91ed8768-dcbb-4d03-9ab2-0322980ceb6e' could not be found. Oct 22 20:53:53.266893 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:53:53.269813 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-37e51b39-adb5-4095-875d-020c0b3bff9e tempest-HypervisorAdminNegativeTestJSON-1854279351 tempest-HypervisorAdminNegativeTestJSON-1854279351-project-admin] Returning 404 to user: Hypervisor with ID '91ed8768-dcbb-4d03-9ab2-0322980ceb6e' could not be found. {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:53:53.273336 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-37e51b39-adb5-4095-875d-020c0b3bff9e tempest-HypervisorAdminNegativeTestJSON-1854279351 tempest-HypervisorAdminNegativeTestJSON-1854279351-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hypervisors/91ed8768-dcbb-4d03-9ab2-0322980ceb6e/uptime" status: 404 len: 123 microversion: 2.1 time: 0.037061 Oct 22 20:53:53.276565 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 608/1297] 10.222.0.18 () {58 vars in 1278 bytes} [Sat Oct 22 20:53:53 2022] GET /compute/v2.1/os-hypervisors/91ed8768-dcbb-4d03-9ab2-0322980ceb6e/uptime => generated 123 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 20:53:53.291369 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-9e2e2fa1-ed1c-48aa-9db6-135178f71963 tempest-HypervisorAdminNegativeTestJSON-1854279351 tempest-HypervisorAdminNegativeTestJSON-1854279351-project-admin] Calling method '.version_select at 0x7fd3a4d123a0>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:53:53.293569 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9e2e2fa1-ed1c-48aa-9db6-135178f71963 tempest-HypervisorAdminNegativeTestJSON-1854279351 tempest-HypervisorAdminNegativeTestJSON-1854279351-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:53.295200 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9e2e2fa1-ed1c-48aa-9db6-135178f71963 tempest-HypervisorAdminNegativeTestJSON-1854279351 tempest-HypervisorAdminNegativeTestJSON-1854279351-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:53.295790 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9e2e2fa1-ed1c-48aa-9db6-135178f71963 tempest-HypervisorAdminNegativeTestJSON-1854279351 tempest-HypervisorAdminNegativeTestJSON-1854279351-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:53.315135 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9e2e2fa1-ed1c-48aa-9db6-135178f71963 tempest-HypervisorAdminNegativeTestJSON-1854279351 tempest-HypervisorAdminNegativeTestJSON-1854279351-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:53.315660 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-3e0eb9dd-41f5-4ccb-9301-5cbf4803f71c tempest-TenantUsagesTestJSON-743245380 tempest-TenantUsagesTestJSON-743245380-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:53:53.315955 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9e2e2fa1-ed1c-48aa-9db6-135178f71963 tempest-HypervisorAdminNegativeTestJSON-1854279351 tempest-HypervisorAdminNegativeTestJSON-1854279351-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:53.316434 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9e2e2fa1-ed1c-48aa-9db6-135178f71963 tempest-HypervisorAdminNegativeTestJSON-1854279351 tempest-HypervisorAdminNegativeTestJSON-1854279351-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:53.316959 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-3e0eb9dd-41f5-4ccb-9301-5cbf4803f71c tempest-TenantUsagesTestJSON-743245380 tempest-TenantUsagesTestJSON-743245380-project] [instance: 49ed4929-87c4-4ef4-8b46-c4bb3ca5be9a] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:53:53.332999 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9e2e2fa1-ed1c-48aa-9db6-135178f71963 tempest-HypervisorAdminNegativeTestJSON-1854279351 tempest-HypervisorAdminNegativeTestJSON-1854279351-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:53.333917 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9e2e2fa1-ed1c-48aa-9db6-135178f71963 tempest-HypervisorAdminNegativeTestJSON-1854279351 tempest-HypervisorAdminNegativeTestJSON-1854279351-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:53.334598 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9e2e2fa1-ed1c-48aa-9db6-135178f71963 tempest-HypervisorAdminNegativeTestJSON-1854279351 tempest-HypervisorAdminNegativeTestJSON-1854279351-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:53.338474 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3e0eb9dd-41f5-4ccb-9301-5cbf4803f71c tempest-TenantUsagesTestJSON-743245380 tempest-TenantUsagesTestJSON-743245380-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:53.339214 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3e0eb9dd-41f5-4ccb-9301-5cbf4803f71c tempest-TenantUsagesTestJSON-743245380 tempest-TenantUsagesTestJSON-743245380-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:53.339939 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3e0eb9dd-41f5-4ccb-9301-5cbf4803f71c tempest-TenantUsagesTestJSON-743245380 tempest-TenantUsagesTestJSON-743245380-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:53.340949 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3e0eb9dd-41f5-4ccb-9301-5cbf4803f71c tempest-TenantUsagesTestJSON-743245380 tempest-TenantUsagesTestJSON-743245380-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:53.341898 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3e0eb9dd-41f5-4ccb-9301-5cbf4803f71c tempest-TenantUsagesTestJSON-743245380 tempest-TenantUsagesTestJSON-743245380-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:53.343787 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3e0eb9dd-41f5-4ccb-9301-5cbf4803f71c tempest-TenantUsagesTestJSON-743245380 tempest-TenantUsagesTestJSON-743245380-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:53.344330 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-9e2e2fa1-ed1c-48aa-9db6-135178f71963 tempest-HypervisorAdminNegativeTestJSON-1854279351 tempest-HypervisorAdminNegativeTestJSON-1854279351-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.059200 Oct 22 20:53:53.352174 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 690/1298] 10.222.0.18 () {58 vars in 1146 bytes} [Sat Oct 22 20:53:53 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:53:53.357064 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-36ed156e-b8dc-48d3-b847-1e70204cd3ef tempest-HypervisorAdminNegativeTestJSON-1130511083 tempest-HypervisorAdminNegativeTestJSON-1130511083-project] Calling method '.version_select at 0x7fd3a40a2430>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:53:53.358840 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-36ed156e-b8dc-48d3-b847-1e70204cd3ef tempest-HypervisorAdminNegativeTestJSON-1130511083 tempest-HypervisorAdminNegativeTestJSON-1130511083-project] Policy check for os_compute_api:os-hypervisors:show failed with credentials {'is_admin': False, 'user_id': 'fe173d8585d8411b9bb7cd16c740b1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14e3157728354ced869bc104f463d9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:53:53.368132 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-36ed156e-b8dc-48d3-b847-1e70204cd3ef tempest-HypervisorAdminNegativeTestJSON-1130511083 tempest-HypervisorAdminNegativeTestJSON-1130511083-project] Request method failure captured: Oct 22 20:53:53.368132 ncdv-master-1 devstack@n-api.service[138745]: request: GET /compute/v2.1/os-hypervisors/1 HTTP/1.1 Oct 22 20:53:53.368132 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 20:53:53.368132 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 20:53:53.368132 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 20:53:53.368132 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 0 Oct 22 20:53:53.368132 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 20:53:53.368132 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 20:53:53.368132 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 20:53:53.368132 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 20:53:53.368132 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVFheAoN1hj-tS6kn8Ago27t83sJpHlayOUg3PFKK5ZJMI1mpyFZjjhx_ngmNUY7CT6nagOtfsoKxa4XUYKHs7pKPMn7xiX6u9UFWNURm1RnUQPQjmFrv1tCLGlGLvNeWP0_GA3TvRgryEOAVXVmEuQwp4tPKxuQmYvoFLAIKwYH8re8 Oct 22 20:53:53.368132 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 20:53:53.368132 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 20:53:53.368132 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 20:53:53.368132 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 20:53:53.368132 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 20:53:53.368132 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 20:53:53.368132 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: 14e3157728354ced869bc104f463d9e1 Oct 22 20:53:53.368132 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1130511083 Oct 22 20:53:53.368132 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 20:53:53.368132 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 20:53:53.368132 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_14e3157728354ced869bc104f463d9e1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/14e3157728354ced869bc104f463d9e1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/14e3157728354ced869bc104f463d9e1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/14e3157728354ced869bc104f463d9e1"}]}] Oct 22 20:53:53.368132 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1130511083 Oct 22 20:53:53.368132 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: 14e3157728354ced869bc104f463d9e1 Oct 22 20:53:53.368132 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1130511083 Oct 22 20:53:53.368132 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-HypervisorAdminNegativeTestJSON-1130511083-project Oct 22 20:53:53.368132 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 20:53:53.368132 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 20:53:53.368132 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: fe173d8585d8411b9bb7cd16c740b1c9 Oct 22 20:53:53.368132 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1130511083-project Oct 22 20:53:53.368132 ncdv-master-1 devstack@n-api.service[138745]: method: Oct 22 20:53:53.368132 ncdv-master-1 devstack@n-api.service[138745]: exception: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Oct 22 20:53:53.368132 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'id': '1'} Oct 22 20:53:53.368132 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:53:53.368132 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:53:53.368132 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:53:53.368132 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:53:53.368132 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:53:53.368132 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:53:53.368132 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 22 20:53:53.368132 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 22 20:53:53.368132 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:53:53.368132 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:53:53.368132 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Oct 22 20:53:53.368132 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return self._show(req, id) Oct 22 20:53:53.368132 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 341, in _show Oct 22 20:53:53.368132 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'show', target={}) Oct 22 20:53:53.368132 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 22 20:53:53.368132 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 22 20:53:53.368132 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 22 20:53:53.368132 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 22 20:53:53.368132 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 22 20:53:53.368132 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 22 20:53:53.368132 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 22 20:53:53.368132 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise self.value Oct 22 20:53:53.368132 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 22 20:53:53.368132 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 22 20:53:53.368132 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 22 20:53:53.368132 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 22 20:53:53.368132 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 22 20:53:53.368132 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 22 20:53:53.368132 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Oct 22 20:53:53.368132 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:53:53.377566 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:53:53.377566 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:53:53.377566 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:53:53.377566 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:53:53.377566 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:53:53.377566 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 22 20:53:53.377566 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 22 20:53:53.377566 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Oct 22 20:53:53.377566 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:53:53.377566 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-36ed156e-b8dc-48d3-b847-1e70204cd3ef tempest-HypervisorAdminNegativeTestJSON-1130511083 tempest-HypervisorAdminNegativeTestJSON-1130511083-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:53:53.377566 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-36ed156e-b8dc-48d3-b847-1e70204cd3ef tempest-HypervisorAdminNegativeTestJSON-1130511083 tempest-HypervisorAdminNegativeTestJSON-1130511083-project] 10.222.0.18 "GET /compute/v2.1/os-hypervisors/1" status: 403 len: 115 microversion: 2.1 time: 0.016620 Oct 22 20:53:53.377566 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 691/1299] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Oct 22 20:53:53 2022] GET /compute/v2.1/os-hypervisors/1 => generated 115 bytes in 18 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 22 20:53:53.383372 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-5498a4d1-e1e3-4d07-bc19-3448e113176d tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:53:53.387354 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-5498a4d1-e1e3-4d07-bc19-3448e113176d tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] [instance: f2f50f6b-6a3e-449f-836e-bd897f78279c] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:53:53.403740 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5498a4d1-e1e3-4d07-bc19-3448e113176d tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:53.404542 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5498a4d1-e1e3-4d07-bc19-3448e113176d tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:53.406204 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5498a4d1-e1e3-4d07-bc19-3448e113176d tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:53.406958 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5498a4d1-e1e3-4d07-bc19-3448e113176d tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:53.407491 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5498a4d1-e1e3-4d07-bc19-3448e113176d tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:53.407909 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5498a4d1-e1e3-4d07-bc19-3448e113176d tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:53.647624 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-3e0eb9dd-41f5-4ccb-9301-5cbf4803f71c tempest-TenantUsagesTestJSON-743245380 tempest-TenantUsagesTestJSON-743245380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d35abfd0aa4dd09b9d0ad56faebd66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5695737326d4a83828b92469dd3e676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:53:53.655780 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-3e0eb9dd-41f5-4ccb-9301-5cbf4803f71c tempest-TenantUsagesTestJSON-743245380 tempest-TenantUsagesTestJSON-743245380-project] 10.222.0.18 "GET /compute/v2.1/servers/49ed4929-87c4-4ef4-8b46-c4bb3ca5be9a" status: 200 len: 1468 microversion: 2.1 time: 0.348812 Oct 22 20:53:53.656281 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 609/1300] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:53:53 2022] GET /compute/v2.1/servers/49ed4929-87c4-4ef4-8b46-c4bb3ca5be9a => generated 1468 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:53:53.664245 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-bc2a9b65-81c5-4fb5-96b7-3e46ae4af803 tempest-HypervisorAdminNegativeTestJSON-1854279351 tempest-HypervisorAdminNegativeTestJSON-1854279351-project-admin] Calling method '.version_select at 0x7fd39fef1040>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:53:53.665833 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-bc2a9b65-81c5-4fb5-96b7-3e46ae4af803 tempest-HypervisorAdminNegativeTestJSON-1854279351 tempest-HypervisorAdminNegativeTestJSON-1854279351-project-admin] HTTP exception thrown: Hypervisor with ID 'cb9b4651-4bd2-4f62-aa8f-6ddc264c0c4e' could not be found. Oct 22 20:53:53.672998 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-bc2a9b65-81c5-4fb5-96b7-3e46ae4af803 tempest-HypervisorAdminNegativeTestJSON-1854279351 tempest-HypervisorAdminNegativeTestJSON-1854279351-project-admin] Request method failure captured: Oct 22 20:53:53.672998 ncdv-master-1 devstack@n-api.service[138744]: request: GET /compute/v2.1/os-hypervisors/cb9b4651-4bd2-4f62-aa8f-6ddc264c0c4e HTTP/1.1 Oct 22 20:53:53.672998 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 20:53:53.672998 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 20:53:53.672998 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 20:53:53.672998 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 0 Oct 22 20:53:53.672998 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 20:53:53.672998 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 20:53:53.672998 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 20:53:53.672998 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 20:53:53.672998 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVFhg7PaqSrvjvHpjLnuCzlfxUB3tRf7xPZHYtbOAHMetPfH02pu8IH4ZKMoQ6nP5aycGqVSBiUi59mdYnaFZRq4_sygTVKDOflrOcnbpWB0BvC8wuar0iZgtAznHexIc7seXFuxUmTF0G07s0ZX3bHUOmOLiQX6zFa9CqdK8UP1xfkE Oct 22 20:53:53.672998 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 20:53:53.672998 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 20:53:53.672998 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 20:53:53.672998 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 20:53:53.672998 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 20:53:53.672998 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 20:53:53.672998 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: 07f68865411e463aaec7fabf42867892 Oct 22 20:53:53.672998 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1854279351 Oct 22 20:53:53.672998 ncdv-master-1 devstack@n-api.service[138744]: X-Role: admin,member,reader Oct 22 20:53:53.672998 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: admin,member,reader Oct 22 20:53:53.672998 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_07f68865411e463aaec7fabf42867892"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/07f68865411e463aaec7fabf42867892"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/07f68865411e463aaec7fabf42867892"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/07f68865411e463aaec7fabf42867892"}]}] Oct 22 20:53:53.672998 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1854279351 Oct 22 20:53:53.672998 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: 07f68865411e463aaec7fabf42867892 Oct 22 20:53:53.672998 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1854279351 Oct 22 20:53:53.672998 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-HypervisorAdminNegativeTestJSON-1854279351-project-admin Oct 22 20:53:53.672998 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 20:53:53.672998 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 20:53:53.672998 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: 18a01a6dfe4542178f17bc82b2224b58 Oct 22 20:53:53.672998 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1854279351-project-admin Oct 22 20:53:53.672998 ncdv-master-1 devstack@n-api.service[138744]: method: Oct 22 20:53:53.672998 ncdv-master-1 devstack@n-api.service[138744]: exception: Hypervisor with ID 'cb9b4651-4bd2-4f62-aa8f-6ddc264c0c4e' could not be found. Oct 22 20:53:53.672998 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': 'cb9b4651-4bd2-4f62-aa8f-6ddc264c0c4e'} Oct 22 20:53:53.672998 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:53:53.672998 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:53:53.672998 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Oct 22 20:53:53.672998 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi value = int(str(value)) Oct 22 20:53:53.672998 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: 'cb9b4651-4bd2-4f62-aa8f-6ddc264c0c4e' Oct 22 20:53:53.672998 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:53:53.672998 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:53:53.672998 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:53:53.672998 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:53:53.672998 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Oct 22 20:53:53.672998 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Oct 22 20:53:53.672998 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Oct 22 20:53:53.672998 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Oct 22 20:53:53.672998 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Oct 22 20:53:53.672998 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:53:53.672998 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:53:53.672998 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:53:53.672998 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:53:53.672998 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Oct 22 20:53:53.672998 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Oct 22 20:53:53.672998 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Oct 22 20:53:53.672998 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Oct 22 20:53:53.672998 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Oct 22 20:53:53.672998 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:53:53.672998 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:53:53.672998 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:53:53.672998 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:53:53.672998 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:53:53.672998 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:53:53.672998 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:53:53.672998 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:53:53.672998 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 22 20:53:53.680617 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 22 20:53:53.680617 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:53:53.680617 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:53:53.680617 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Oct 22 20:53:53.680617 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return self._show(req, id) Oct 22 20:53:53.680617 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 343, in _show Oct 22 20:53:53.680617 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Oct 22 20:53:53.680617 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Oct 22 20:53:53.680617 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 22 20:53:53.680617 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID 'cb9b4651-4bd2-4f62-aa8f-6ddc264c0c4e' could not be found. Oct 22 20:53:53.680617 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:53:53.680617 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:53:53.680617 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:53:53.680617 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:53:53.680617 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:53:53.680617 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:53:53.680617 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 20:53:53.680617 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 20:53:53.680617 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID 'cb9b4651-4bd2-4f62-aa8f-6ddc264c0c4e' could not be found. Oct 22 20:53:53.680617 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:53:53.680617 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-bc2a9b65-81c5-4fb5-96b7-3e46ae4af803 tempest-HypervisorAdminNegativeTestJSON-1854279351 tempest-HypervisorAdminNegativeTestJSON-1854279351-project-admin] Returning 404 to user: Hypervisor with ID 'cb9b4651-4bd2-4f62-aa8f-6ddc264c0c4e' could not be found. {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:53:53.680617 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-bc2a9b65-81c5-4fb5-96b7-3e46ae4af803 tempest-HypervisorAdminNegativeTestJSON-1854279351 tempest-HypervisorAdminNegativeTestJSON-1854279351-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hypervisors/cb9b4651-4bd2-4f62-aa8f-6ddc264c0c4e" status: 404 len: 123 microversion: 2.1 time: 0.017192 Oct 22 20:53:53.680617 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 610/1301] 10.222.0.18 () {58 vars in 1257 bytes} [Sat Oct 22 20:53:53 2022] GET /compute/v2.1/os-hypervisors/cb9b4651-4bd2-4f62-aa8f-6ddc264c0c4e => generated 123 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 20:53:53.689216 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-6107010e-2e78-4af7-94be-a6d0dbb2fc87 tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Calling method '.version_select at 0x7fd3a4051f70>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:53:53.718793 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-5498a4d1-e1e3-4d07-bc19-3448e113176d tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7f48d18691d4473bbe0284c44f14d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bacf9909082440f8a201771b64a75fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:53:53.729548 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-5498a4d1-e1e3-4d07-bc19-3448e113176d tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] 10.222.0.18 "GET /compute/v2.1/servers/f2f50f6b-6a3e-449f-836e-bd897f78279c" status: 200 len: 1355 microversion: 2.1 time: 0.358288 Oct 22 20:53:53.731829 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 692/1302] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:53:53 2022] GET /compute/v2.1/servers/f2f50f6b-6a3e-449f-836e-bd897f78279c => generated 1355 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:53:53.744702 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-e82983b3-81f1-4a8f-bcf5-55391d1ee788 req-b1999dc1-e444-4980-b20e-4ee5cdc22910 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2f50f6b-6a3e-449f-836e-bd897f78279c", "name": "network-vif-plugged", "status": "completed", "tag": "a1f62079-48cd-4898-b101-1f21b055979f"}, {"server_uuid": "f2f50f6b-6a3e-449f-836e-bd897f78279c", "name": "network-vif-plugged", "status": "completed", "tag": "8be47bf4-2a35-45fb-93e7-e1ccf22b8551"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:53:53.767169 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-6107010e-2e78-4af7-94be-a6d0dbb2fc87 tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] 10.222.0.18 "GET /compute/v2.1/images/2c26b155-ef26-40a2-b7db-1b550c12a2cf" status: 200 len: 1429 microversion: 2.1 time: 0.088997 Oct 22 20:53:53.768451 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-e82983b3-81f1-4a8f-bcf5-55391d1ee788 req-b1999dc1-e444-4980-b20e-4ee5cdc22910 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:53.769230 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 611/1303] 10.222.0.18 () {58 vars in 1233 bytes} [Sat Oct 22 20:53:53 2022] GET /compute/v2.1/images/2c26b155-ef26-40a2-b7db-1b550c12a2cf => generated 1429 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:53:53.770963 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-e82983b3-81f1-4a8f-bcf5-55391d1ee788 req-b1999dc1-e444-4980-b20e-4ee5cdc22910 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:53.771848 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-e82983b3-81f1-4a8f-bcf5-55391d1ee788 req-b1999dc1-e444-4980-b20e-4ee5cdc22910 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:53.779486 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-f62430b8-8da6-4104-b34d-cc2ce81e5bda tempest-InstanceActionsV221TestJSON-976463296 tempest-InstanceActionsV221TestJSON-976463296-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:53:53.787630 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-e82983b3-81f1-4a8f-bcf5-55391d1ee788 req-b1999dc1-e444-4980-b20e-4ee5cdc22910 service nova] Creating event network-vif-plugged:a1f62079-48cd-4898-b101-1f21b055979f for instance f2f50f6b-6a3e-449f-836e-bd897f78279c on nch2-master-1 Oct 22 20:53:53.788693 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-e82983b3-81f1-4a8f-bcf5-55391d1ee788 req-b1999dc1-e444-4980-b20e-4ee5cdc22910 service nova] Creating event network-vif-plugged:8be47bf4-2a35-45fb-93e7-e1ccf22b8551 for instance f2f50f6b-6a3e-449f-836e-bd897f78279c on nch2-master-1 Oct 22 20:53:53.789833 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-f62430b8-8da6-4104-b34d-cc2ce81e5bda tempest-InstanceActionsV221TestJSON-976463296 tempest-InstanceActionsV221TestJSON-976463296-project] [instance: 304975d8-d62e-4156-9697-09c3a9724371] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:53:53.797357 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-e82983b3-81f1-4a8f-bcf5-55391d1ee788 req-b1999dc1-e444-4980-b20e-4ee5cdc22910 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.056815 Oct 22 20:53:53.806312 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 693/1304] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:53:53 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:53:53.806603 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f62430b8-8da6-4104-b34d-cc2ce81e5bda tempest-InstanceActionsV221TestJSON-976463296 tempest-InstanceActionsV221TestJSON-976463296-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:53.807114 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f62430b8-8da6-4104-b34d-cc2ce81e5bda tempest-InstanceActionsV221TestJSON-976463296 tempest-InstanceActionsV221TestJSON-976463296-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:53.807873 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f62430b8-8da6-4104-b34d-cc2ce81e5bda tempest-InstanceActionsV221TestJSON-976463296 tempest-InstanceActionsV221TestJSON-976463296-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:53.808761 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f62430b8-8da6-4104-b34d-cc2ce81e5bda tempest-InstanceActionsV221TestJSON-976463296 tempest-InstanceActionsV221TestJSON-976463296-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:53.809369 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f62430b8-8da6-4104-b34d-cc2ce81e5bda tempest-InstanceActionsV221TestJSON-976463296 tempest-InstanceActionsV221TestJSON-976463296-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:53.809952 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f62430b8-8da6-4104-b34d-cc2ce81e5bda tempest-InstanceActionsV221TestJSON-976463296 tempest-InstanceActionsV221TestJSON-976463296-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:53.905766 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-f62430b8-8da6-4104-b34d-cc2ce81e5bda tempest-InstanceActionsV221TestJSON-976463296 tempest-InstanceActionsV221TestJSON-976463296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13c3673ebe14b7e997ec664499b9e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f7808ed44e84de4a1574e8aacd71c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:53:53.911077 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-e5732161-8d96-4a11-8baa-e58b6315f7af tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-76466443", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "03a467bd-c608-425f-8923-ff356110df6b"}], "block_device_mapping_v2": [{"uuid": "d22119e1-5f3f-4632-9662-a540dcccb909", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:53:53.915321 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-f62430b8-8da6-4104-b34d-cc2ce81e5bda tempest-InstanceActionsV221TestJSON-976463296 tempest-InstanceActionsV221TestJSON-976463296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e13c3673ebe14b7e997ec664499b9e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f7808ed44e84de4a1574e8aacd71c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:53:53.916822 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-f62430b8-8da6-4104-b34d-cc2ce81e5bda tempest-InstanceActionsV221TestJSON-976463296 tempest-InstanceActionsV221TestJSON-976463296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e13c3673ebe14b7e997ec664499b9e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f7808ed44e84de4a1574e8aacd71c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:53:53.917962 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-f62430b8-8da6-4104-b34d-cc2ce81e5bda tempest-InstanceActionsV221TestJSON-976463296 tempest-InstanceActionsV221TestJSON-976463296-project] 10.222.0.18 "GET /compute/v2.1/servers/304975d8-d62e-4156-9697-09c3a9724371" status: 200 len: 1317 microversion: 2.21 time: 0.146601 Oct 22 20:53:53.918512 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 612/1305] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 20:53:53 2022] GET /compute/v2.1/servers/304975d8-d62e-4156-9697-09c3a9724371 => generated 1317 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 20:53:54.002096 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.network.neutron [None req-e5732161-8d96-4a11-8baa-e58b6315f7af tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] validate_networks() for [('03a467bd-c608-425f-8923-ff356110df6b', None, None, None, None, None)] {{(pid=138745) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 20:53:54.271994 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-a2df1c00-1f2e-46c5-98a7-50e9327c0069 req-69b832fb-1914-481b-af06-a655ec259f52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49ed4929-87c4-4ef4-8b46-c4bb3ca5be9a", "name": "network-vif-deleted", "tag": "cb168a1a-ebc7-470c-8810-5b9a894facd3"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:53:54.300704 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-a2df1c00-1f2e-46c5-98a7-50e9327c0069 req-69b832fb-1914-481b-af06-a655ec259f52 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:54.301541 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-a2df1c00-1f2e-46c5-98a7-50e9327c0069 req-69b832fb-1914-481b-af06-a655ec259f52 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:54.302416 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-a2df1c00-1f2e-46c5-98a7-50e9327c0069 req-69b832fb-1914-481b-af06-a655ec259f52 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:54.325419 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-a2df1c00-1f2e-46c5-98a7-50e9327c0069 req-69b832fb-1914-481b-af06-a655ec259f52 service nova] Creating event network-vif-deleted:cb168a1a-ebc7-470c-8810-5b9a894facd3 for instance 49ed4929-87c4-4ef4-8b46-c4bb3ca5be9a on nch1-master-1 Oct 22 20:53:54.332521 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-a2df1c00-1f2e-46c5-98a7-50e9327c0069 req-69b832fb-1914-481b-af06-a655ec259f52 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066376 Oct 22 20:53:54.333912 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 613/1306] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:53:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:53:54.680503 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-60ff62b1-e02c-445c-87f2-7ed831f53b4a tempest-TenantUsagesTestJSON-743245380 tempest-TenantUsagesTestJSON-743245380-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:53:54.681996 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-60ff62b1-e02c-445c-87f2-7ed831f53b4a tempest-TenantUsagesTestJSON-743245380 tempest-TenantUsagesTestJSON-743245380-project] [instance: 49ed4929-87c4-4ef4-8b46-c4bb3ca5be9a] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:53:54.694422 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-60ff62b1-e02c-445c-87f2-7ed831f53b4a tempest-TenantUsagesTestJSON-743245380 tempest-TenantUsagesTestJSON-743245380-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:54.700330 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-e5732161-8d96-4a11-8baa-e58b6315f7af tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Flavor limits 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 20:53:54.700999 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-e5732161-8d96-4a11-8baa-e58b6315f7af tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Image limits 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 20:53:54.701629 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-e5732161-8d96-4a11-8baa-e58b6315f7af tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Flavor pref 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 20:53:54.702228 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-e5732161-8d96-4a11-8baa-e58b6315f7af tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Image pref 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 20:53:54.702793 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-e5732161-8d96-4a11-8baa-e58b6315f7af tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 20:53:54.705172 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-60ff62b1-e02c-445c-87f2-7ed831f53b4a tempest-TenantUsagesTestJSON-743245380 tempest-TenantUsagesTestJSON-743245380-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:54.705640 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-60ff62b1-e02c-445c-87f2-7ed831f53b4a tempest-TenantUsagesTestJSON-743245380 tempest-TenantUsagesTestJSON-743245380-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:54.706397 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-60ff62b1-e02c-445c-87f2-7ed831f53b4a tempest-TenantUsagesTestJSON-743245380 tempest-TenantUsagesTestJSON-743245380-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:54.706856 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-60ff62b1-e02c-445c-87f2-7ed831f53b4a tempest-TenantUsagesTestJSON-743245380 tempest-TenantUsagesTestJSON-743245380-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:54.707315 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-60ff62b1-e02c-445c-87f2-7ed831f53b4a tempest-TenantUsagesTestJSON-743245380 tempest-TenantUsagesTestJSON-743245380-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:54.724494 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e5732161-8d96-4a11-8baa-e58b6315f7af tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:54.725020 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e5732161-8d96-4a11-8baa-e58b6315f7af tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:54.725438 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e5732161-8d96-4a11-8baa-e58b6315f7af tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:54.726171 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e5732161-8d96-4a11-8baa-e58b6315f7af tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:54.732730 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e5732161-8d96-4a11-8baa-e58b6315f7af tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:54.734076 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e5732161-8d96-4a11-8baa-e58b6315f7af tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:54.773126 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-60ff62b1-e02c-445c-87f2-7ed831f53b4a tempest-TenantUsagesTestJSON-743245380 tempest-TenantUsagesTestJSON-743245380-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:54.773525 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-60ff62b1-e02c-445c-87f2-7ed831f53b4a tempest-TenantUsagesTestJSON-743245380 tempest-TenantUsagesTestJSON-743245380-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:54.774483 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-60ff62b1-e02c-445c-87f2-7ed831f53b4a tempest-TenantUsagesTestJSON-743245380 tempest-TenantUsagesTestJSON-743245380-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:54.774957 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.objects.instance [None req-60ff62b1-e02c-445c-87f2-7ed831f53b4a tempest-TenantUsagesTestJSON-743245380 tempest-TenantUsagesTestJSON-743245380-project] Lazy-loading 'fault' on Instance uuid 49ed4929-87c4-4ef4-8b46-c4bb3ca5be9a {{(pid=138744) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 20:53:54.787602 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-e5732161-8d96-4a11-8baa-e58b6315f7af tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Getting quotas for project 11060bbcab6b45cabb1457319d72b982. Resources: {'cores', 'instances', 'ram'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 20:53:54.800548 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-e5732161-8d96-4a11-8baa-e58b6315f7af tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Getting quotas for user 93c41b7be1724632b0d6bd2bd3b57f8f and project 11060bbcab6b45cabb1457319d72b982. Resources: {'cores', 'instances', 'ram'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 20:53:54.836880 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-60ff62b1-e02c-445c-87f2-7ed831f53b4a tempest-TenantUsagesTestJSON-743245380 tempest-TenantUsagesTestJSON-743245380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d35abfd0aa4dd09b9d0ad56faebd66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5695737326d4a83828b92469dd3e676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:53:54.848112 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-60ff62b1-e02c-445c-87f2-7ed831f53b4a tempest-TenantUsagesTestJSON-743245380 tempest-TenantUsagesTestJSON-743245380-project] 10.222.0.18 "GET /compute/v2.1/servers/49ed4929-87c4-4ef4-8b46-c4bb3ca5be9a" status: 200 len: 1303 microversion: 2.1 time: 0.172741 Oct 22 20:53:54.848708 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 614/1307] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:53:54 2022] GET /compute/v2.1/servers/49ed4929-87c4-4ef4-8b46-c4bb3ca5be9a => generated 1303 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 20:53:54.872059 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-0fa439f0-c7ce-4eaa-948d-fa98ab6a7828 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:53:54.880291 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-0fa439f0-c7ce-4eaa-948d-fa98ab6a7828 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] [instance: f2f50f6b-6a3e-449f-836e-bd897f78279c] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:53:54.897420 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0fa439f0-c7ce-4eaa-948d-fa98ab6a7828 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:54.897920 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0fa439f0-c7ce-4eaa-948d-fa98ab6a7828 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:54.901037 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0fa439f0-c7ce-4eaa-948d-fa98ab6a7828 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:54.901037 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0fa439f0-c7ce-4eaa-948d-fa98ab6a7828 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:54.901037 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0fa439f0-c7ce-4eaa-948d-fa98ab6a7828 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:54.901037 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0fa439f0-c7ce-4eaa-948d-fa98ab6a7828 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:54.944936 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-e5732161-8d96-4a11-8baa-e58b6315f7af tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Going to run 1 instances... {{(pid=138745) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 20:53:54.947319 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-e5732161-8d96-4a11-8baa-e58b6315f7af tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] [instance: f499ce97-cdf8-4dcf-9c28-3758aea5e78c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d22119e1-5f3f-4632-9662-a540dcccb909',volume_size=None,volume_type=None)] {{(pid=138745) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 20:53:55.220243 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-e5732161-8d96-4a11-8baa-e58b6315f7af tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.319974 Oct 22 20:53:55.229979 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 694/1308] 10.222.0.18 () {62 vars in 1188 bytes} [Sat Oct 22 20:53:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 1331 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 22 20:53:55.247865 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-885a5a6c-6f35-4c8d-8bc2-ea9aeeb3029d tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Calling method '.version_select at 0x7fd3a4464310>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:53:55.352652 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-885a5a6c-6f35-4c8d-8bc2-ea9aeeb3029d tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] 10.222.0.18 "GET /compute/v2.1/images/2c26b155-ef26-40a2-b7db-1b550c12a2cf" status: 200 len: 1429 microversion: 2.1 time: 0.120513 Oct 22 20:53:55.353341 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 695/1309] 10.222.0.18 () {58 vars in 1233 bytes} [Sat Oct 22 20:53:55 2022] GET /compute/v2.1/images/2c26b155-ef26-40a2-b7db-1b550c12a2cf => generated 1429 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:53:55.367054 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-6a7af726-f045-42ec-9359-c17e1b03b5a5 tempest-InstanceActionsV221TestJSON-976463296 tempest-InstanceActionsV221TestJSON-976463296-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:53:55.367716 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-6a7af726-f045-42ec-9359-c17e1b03b5a5 tempest-InstanceActionsV221TestJSON-976463296 tempest-InstanceActionsV221TestJSON-976463296-project] [instance: 304975d8-d62e-4156-9697-09c3a9724371] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:53:55.384988 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-0fa439f0-c7ce-4eaa-948d-fa98ab6a7828 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7f48d18691d4473bbe0284c44f14d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bacf9909082440f8a201771b64a75fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:53:55.387251 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6a7af726-f045-42ec-9359-c17e1b03b5a5 tempest-InstanceActionsV221TestJSON-976463296 tempest-InstanceActionsV221TestJSON-976463296-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:55.387752 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6a7af726-f045-42ec-9359-c17e1b03b5a5 tempest-InstanceActionsV221TestJSON-976463296 tempest-InstanceActionsV221TestJSON-976463296-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:55.390166 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6a7af726-f045-42ec-9359-c17e1b03b5a5 tempest-InstanceActionsV221TestJSON-976463296 tempest-InstanceActionsV221TestJSON-976463296-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:55.391986 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6a7af726-f045-42ec-9359-c17e1b03b5a5 tempest-InstanceActionsV221TestJSON-976463296 tempest-InstanceActionsV221TestJSON-976463296-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:55.393136 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6a7af726-f045-42ec-9359-c17e1b03b5a5 tempest-InstanceActionsV221TestJSON-976463296 tempest-InstanceActionsV221TestJSON-976463296-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:55.393816 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6a7af726-f045-42ec-9359-c17e1b03b5a5 tempest-InstanceActionsV221TestJSON-976463296 tempest-InstanceActionsV221TestJSON-976463296-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:55.394952 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-0fa439f0-c7ce-4eaa-948d-fa98ab6a7828 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] 10.222.0.18 "GET /compute/v2.1/servers/f2f50f6b-6a3e-449f-836e-bd897f78279c" status: 200 len: 1355 microversion: 2.1 time: 0.543156 Oct 22 20:53:55.407374 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 615/1310] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:53:54 2022] GET /compute/v2.1/servers/f2f50f6b-6a3e-449f-836e-bd897f78279c => generated 1355 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:53:55.407374 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-2ce5745c-0acf-4144-9948-2acf163b0b7c tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:53:55.407374 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-2ce5745c-0acf-4144-9948-2acf163b0b7c tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] [instance: f499ce97-cdf8-4dcf-9c28-3758aea5e78c] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:53:55.462273 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_api:INSERT=1,nova_api:SELECT=98,nova_api:UPDATE=1 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:53:55.601350 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-2ce5745c-0acf-4144-9948-2acf163b0b7c tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:53:55.615373 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-2ce5745c-0acf-4144-9948-2acf163b0b7c tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:53:55.617147 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-2ce5745c-0acf-4144-9948-2acf163b0b7c tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:53:55.617934 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-2ce5745c-0acf-4144-9948-2acf163b0b7c tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] 10.222.0.18 "GET /compute/v2.1/servers/f499ce97-cdf8-4dcf-9c28-3758aea5e78c" status: 200 len: 1102 microversion: 2.25 time: 0.219755 Oct 22 20:53:55.618493 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 616/1311] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 20:53:55 2022] GET /compute/v2.1/servers/f499ce97-cdf8-4dcf-9c28-3758aea5e78c => generated 1102 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 20:53:55.831097 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-e1ceaf9c-e506-4b4d-be5f-7c1ee6f00853 req-47fc42a9-2448-487e-9a62-1fe594a4ff85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "472bbccc-485e-43ce-a9cd-a3148bfccdbd", "name": "network-vif-plugged", "status": "completed", "tag": "23775c97-962a-4643-9a82-cfb4b15013e8"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:53:55.849119 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-6a7af726-f045-42ec-9359-c17e1b03b5a5 tempest-InstanceActionsV221TestJSON-976463296 tempest-InstanceActionsV221TestJSON-976463296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13c3673ebe14b7e997ec664499b9e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f7808ed44e84de4a1574e8aacd71c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:53:55.853212 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:53:55.853568 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-e1ceaf9c-e506-4b4d-be5f-7c1ee6f00853 req-47fc42a9-2448-487e-9a62-1fe594a4ff85 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:55.854192 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-e1ceaf9c-e506-4b4d-be5f-7c1ee6f00853 req-47fc42a9-2448-487e-9a62-1fe594a4ff85 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:55.854838 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-e1ceaf9c-e506-4b4d-be5f-7c1ee6f00853 req-47fc42a9-2448-487e-9a62-1fe594a4ff85 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:55.864146 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-6a7af726-f045-42ec-9359-c17e1b03b5a5 tempest-InstanceActionsV221TestJSON-976463296 tempest-InstanceActionsV221TestJSON-976463296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e13c3673ebe14b7e997ec664499b9e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f7808ed44e84de4a1574e8aacd71c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:53:55.868645 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-6a7af726-f045-42ec-9359-c17e1b03b5a5 tempest-InstanceActionsV221TestJSON-976463296 tempest-InstanceActionsV221TestJSON-976463296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e13c3673ebe14b7e997ec664499b9e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f7808ed44e84de4a1574e8aacd71c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:53:55.871217 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-6a7af726-f045-42ec-9359-c17e1b03b5a5 tempest-InstanceActionsV221TestJSON-976463296 tempest-InstanceActionsV221TestJSON-976463296-project] 10.222.0.18 "GET /compute/v2.1/servers/304975d8-d62e-4156-9697-09c3a9724371" status: 200 len: 1359 microversion: 2.21 time: 0.514606 Oct 22 20:53:55.872665 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 696/1312] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 20:53:55 2022] GET /compute/v2.1/servers/304975d8-d62e-4156-9697-09c3a9724371 => generated 1359 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 20:53:55.877014 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-e1ceaf9c-e506-4b4d-be5f-7c1ee6f00853 req-47fc42a9-2448-487e-9a62-1fe594a4ff85 service nova] Creating event network-vif-plugged:23775c97-962a-4643-9a82-cfb4b15013e8 for instance 472bbccc-485e-43ce-a9cd-a3148bfccdbd on nch1-master-1 Oct 22 20:53:55.889078 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-7ebe8411-3292-431a-95ac-31df17f3921e tempest-TenantUsagesTestJSON-743245380 tempest-TenantUsagesTestJSON-743245380-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:53:55.889355 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-e1ceaf9c-e506-4b4d-be5f-7c1ee6f00853 req-47fc42a9-2448-487e-9a62-1fe594a4ff85 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061903 Oct 22 20:53:55.890590 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-7ebe8411-3292-431a-95ac-31df17f3921e tempest-TenantUsagesTestJSON-743245380 tempest-TenantUsagesTestJSON-743245380-project] [instance: 49ed4929-87c4-4ef4-8b46-c4bb3ca5be9a] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:53:55.891401 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 617/1313] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:53:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 20:53:55.898916 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=1,nova_api:INSERT=6 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:53:55.907515 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-3e1d2823-c87b-4391-805e-1b3ca7d36293 tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:53:55.912559 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-3e1d2823-c87b-4391-805e-1b3ca7d36293 tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] [instance: 8f2e1da0-4586-460b-94dc-768fd618dc3d] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:53:55.916287 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7ebe8411-3292-431a-95ac-31df17f3921e tempest-TenantUsagesTestJSON-743245380 tempest-TenantUsagesTestJSON-743245380-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:55.917165 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7ebe8411-3292-431a-95ac-31df17f3921e tempest-TenantUsagesTestJSON-743245380 tempest-TenantUsagesTestJSON-743245380-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:55.917984 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7ebe8411-3292-431a-95ac-31df17f3921e tempest-TenantUsagesTestJSON-743245380 tempest-TenantUsagesTestJSON-743245380-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:55.918986 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7ebe8411-3292-431a-95ac-31df17f3921e tempest-TenantUsagesTestJSON-743245380 tempest-TenantUsagesTestJSON-743245380-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:55.919676 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7ebe8411-3292-431a-95ac-31df17f3921e tempest-TenantUsagesTestJSON-743245380 tempest-TenantUsagesTestJSON-743245380-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:55.920401 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7ebe8411-3292-431a-95ac-31df17f3921e tempest-TenantUsagesTestJSON-743245380 tempest-TenantUsagesTestJSON-743245380-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:55.930053 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3e1d2823-c87b-4391-805e-1b3ca7d36293 tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:55.930682 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3e1d2823-c87b-4391-805e-1b3ca7d36293 tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:55.931429 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3e1d2823-c87b-4391-805e-1b3ca7d36293 tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:55.933316 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3e1d2823-c87b-4391-805e-1b3ca7d36293 tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:55.934298 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3e1d2823-c87b-4391-805e-1b3ca7d36293 tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:55.935676 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3e1d2823-c87b-4391-805e-1b3ca7d36293 tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:55.944917 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.wsgi [None req-7ebe8411-3292-431a-95ac-31df17f3921e tempest-TenantUsagesTestJSON-743245380 tempest-TenantUsagesTestJSON-743245380-project] HTTP exception thrown: Instance 49ed4929-87c4-4ef4-8b46-c4bb3ca5be9a could not be found. Oct 22 20:53:55.947171 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-7ebe8411-3292-431a-95ac-31df17f3921e tempest-TenantUsagesTestJSON-743245380 tempest-TenantUsagesTestJSON-743245380-project] Request method failure captured: Oct 22 20:53:55.947171 ncdv-master-1 devstack@n-api.service[138745]: request: GET /compute/v2.1/servers/49ed4929-87c4-4ef4-8b46-c4bb3ca5be9a HTTP/1.1 Oct 22 20:53:55.947171 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 20:53:55.947171 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 20:53:55.947171 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 20:53:55.947171 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 0 Oct 22 20:53:55.947171 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 20:53:55.947171 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 20:53:55.947171 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 20:53:55.947171 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 20:53:55.947171 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVFhEbdoSQ7Of-yxlIerhhjbvzhoFCBAI-aZujmNDQbnJyDLKilL8kca8h8H4qDyTlc8Ocg5Up25Q6N9uQJlSvDtoOSGTSrblFpkGGstCnJ2KezdqYdjGh6q15OSCRD8rU2WDczNnmZhJjWSIxqQ5RP2RfmOUUpGR01icd2kw1zE9X9Q Oct 22 20:53:55.947171 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 20:53:55.947171 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 20:53:55.947171 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 20:53:55.947171 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 20:53:55.947171 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 20:53:55.947171 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 20:53:55.947171 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: d5695737326d4a83828b92469dd3e676 Oct 22 20:53:55.947171 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-TenantUsagesTestJSON-743245380 Oct 22 20:53:55.947171 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 20:53:55.947171 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 20:53:55.947171 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_d5695737326d4a83828b92469dd3e676"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d5695737326d4a83828b92469dd3e676"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/d5695737326d4a83828b92469dd3e676"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d5695737326d4a83828b92469dd3e676"}]}] Oct 22 20:53:55.947171 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-TenantUsagesTestJSON-743245380 Oct 22 20:53:55.947171 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: d5695737326d4a83828b92469dd3e676 Oct 22 20:53:55.947171 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-TenantUsagesTestJSON-743245380 Oct 22 20:53:55.947171 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-TenantUsagesTestJSON-743245380-project Oct 22 20:53:55.947171 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 20:53:55.947171 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 20:53:55.947171 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: 94d35abfd0aa4dd09b9d0ad56faebd66 Oct 22 20:53:55.947171 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-TenantUsagesTestJSON-743245380-project Oct 22 20:53:55.947171 ncdv-master-1 devstack@n-api.service[138745]: method: > Oct 22 20:53:55.947171 ncdv-master-1 devstack@n-api.service[138745]: exception: Instance 49ed4929-87c4-4ef4-8b46-c4bb3ca5be9a could not be found. Oct 22 20:53:55.947171 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'id': '49ed4929-87c4-4ef4-8b46-c4bb3ca5be9a'} Oct 22 20:53:55.947171 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:53:55.947171 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:53:55.947171 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 20:53:55.947171 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 20:53:55.947171 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 20:53:55.947171 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 20:53:55.947171 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 20:53:55.947171 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 20:53:55.947171 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 20:53:55.947171 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 20:53:55.947171 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 49ed4929-87c4-4ef4-8b46-c4bb3ca5be9a could not be found. Oct 22 20:53:55.947171 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:53:55.947171 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:53:55.947171 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:53:55.947171 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:53:55.947171 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:53:55.947171 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:53:55.947171 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:53:55.947171 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:53:55.947171 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:53:55.947171 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:53:55.947171 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 20:53:55.947171 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 20:53:55.947171 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 20:53:55.947171 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 20:53:55.947171 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 20:53:55.947171 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 20:53:55.947171 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 49ed4929-87c4-4ef4-8b46-c4bb3ca5be9a could not be found. Oct 22 20:53:55.947171 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:53:55.947171 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:53:55.947171 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:53:55.952910 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:53:55.952910 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:53:55.952910 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:53:55.952910 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 20:53:55.952910 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 20:53:55.952910 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 49ed4929-87c4-4ef4-8b46-c4bb3ca5be9a could not be found. Oct 22 20:53:55.952910 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:53:55.955779 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-7ebe8411-3292-431a-95ac-31df17f3921e tempest-TenantUsagesTestJSON-743245380 tempest-TenantUsagesTestJSON-743245380-project] Returning 404 to user: Instance 49ed4929-87c4-4ef4-8b46-c4bb3ca5be9a could not be found. {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:53:55.957957 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-7ebe8411-3292-431a-95ac-31df17f3921e tempest-TenantUsagesTestJSON-743245380 tempest-TenantUsagesTestJSON-743245380-project] 10.222.0.18 "GET /compute/v2.1/servers/49ed4929-87c4-4ef4-8b46-c4bb3ca5be9a" status: 404 len: 111 microversion: 2.1 time: 0.083403 Oct 22 20:53:55.959096 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 697/1314] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:53:55 2022] GET /compute/v2.1/servers/49ed4929-87c4-4ef4-8b46-c4bb3ca5be9a => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 20:53:56.375031 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-1d85e626-b820-48c8-bdac-c70c9bc5098e tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Calling method '.version_select at 0x7fd3a4968700>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:53:56.471636 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-1d85e626-b820-48c8-bdac-c70c9bc5098e tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] 10.222.0.18 "GET /compute/v2.1/images/2c26b155-ef26-40a2-b7db-1b550c12a2cf" status: 200 len: 1429 microversion: 2.1 time: 0.106661 Oct 22 20:53:56.472871 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 698/1315] 10.222.0.18 () {58 vars in 1233 bytes} [Sat Oct 22 20:53:56 2022] GET /compute/v2.1/images/2c26b155-ef26-40a2-b7db-1b550c12a2cf => generated 1429 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 20:53:56.488011 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-3e1d2823-c87b-4391-805e-1b3ca7d36293 tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/8f2e1da0-4586-460b-94dc-768fd618dc3d" status: 200 len: 1810 microversion: 2.1 time: 0.584740 Oct 22 20:53:56.488503 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-2aee18b5-e794-4833-a5bf-9ead8612607e req-ef0093c0-ed06-4710-aa77-c5ad0bd7de00 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "304975d8-d62e-4156-9697-09c3a9724371", "tag": "75b0deee-22d9-412a-9096-15c6aafa06da"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:53:56.499789 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 618/1316] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:53:55 2022] GET /compute/v2.1/servers/8f2e1da0-4586-460b-94dc-768fd618dc3d => generated 1810 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:53:56.512574 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-2aee18b5-e794-4833-a5bf-9ead8612607e req-ef0093c0-ed06-4710-aa77-c5ad0bd7de00 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:56.514015 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-2aee18b5-e794-4833-a5bf-9ead8612607e req-ef0093c0-ed06-4710-aa77-c5ad0bd7de00 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:56.516023 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-2aee18b5-e794-4833-a5bf-9ead8612607e req-ef0093c0-ed06-4710-aa77-c5ad0bd7de00 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:56.517725 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-ef8abaaa-325a-457d-9f55-9bf6355d0e57 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:53:56.521017 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-ef8abaaa-325a-457d-9f55-9bf6355d0e57 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] [instance: f2f50f6b-6a3e-449f-836e-bd897f78279c] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:53:56.540829 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ef8abaaa-325a-457d-9f55-9bf6355d0e57 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:56.543461 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ef8abaaa-325a-457d-9f55-9bf6355d0e57 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:56.544062 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ef8abaaa-325a-457d-9f55-9bf6355d0e57 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:56.545991 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ef8abaaa-325a-457d-9f55-9bf6355d0e57 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:56.546126 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-2aee18b5-e794-4833-a5bf-9ead8612607e req-ef0093c0-ed06-4710-aa77-c5ad0bd7de00 service nova] Creating event network-changed:75b0deee-22d9-412a-9096-15c6aafa06da for instance 304975d8-d62e-4156-9697-09c3a9724371 on nch2-master-1 Oct 22 20:53:56.549621 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ef8abaaa-325a-457d-9f55-9bf6355d0e57 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:56.550461 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ef8abaaa-325a-457d-9f55-9bf6355d0e57 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:56.558865 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-2aee18b5-e794-4833-a5bf-9ead8612607e req-ef0093c0-ed06-4710-aa77-c5ad0bd7de00 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084474 Oct 22 20:53:56.569990 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 699/1317] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:53:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:53:56.582532 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-68ad6402-fd6c-4a87-92af-bbc3dafc6f36 tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:53:56.596354 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-68ad6402-fd6c-4a87-92af-bbc3dafc6f36 tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:56.597409 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-68ad6402-fd6c-4a87-92af-bbc3dafc6f36 tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:56.599449 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-68ad6402-fd6c-4a87-92af-bbc3dafc6f36 tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:56.601368 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-68ad6402-fd6c-4a87-92af-bbc3dafc6f36 tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:56.602681 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-68ad6402-fd6c-4a87-92af-bbc3dafc6f36 tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:56.604586 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-68ad6402-fd6c-4a87-92af-bbc3dafc6f36 tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:56.692567 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-68ad6402-fd6c-4a87-92af-bbc3dafc6f36 tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] 10.222.0.18 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.120891 Oct 22 20:53:56.700621 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 700/1318] 10.222.0.18 () {58 vars in 1176 bytes} [Sat Oct 22 20:53:56 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:53:56.706838 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-5d2740d8-8279-467d-a818-ef130e5d4558 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:53:56.708124 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-5d2740d8-8279-467d-a818-ef130e5d4558 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] [instance: f499ce97-cdf8-4dcf-9c28-3758aea5e78c] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:53:56.719664 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5d2740d8-8279-467d-a818-ef130e5d4558 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:56.720407 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5d2740d8-8279-467d-a818-ef130e5d4558 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:56.721074 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5d2740d8-8279-467d-a818-ef130e5d4558 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:56.722488 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5d2740d8-8279-467d-a818-ef130e5d4558 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:56.723297 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5d2740d8-8279-467d-a818-ef130e5d4558 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:56.724002 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5d2740d8-8279-467d-a818-ef130e5d4558 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:56.884604 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-5d2740d8-8279-467d-a818-ef130e5d4558 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:53:56.898844 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-5d2740d8-8279-467d-a818-ef130e5d4558 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:53:56.903089 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-5d2740d8-8279-467d-a818-ef130e5d4558 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:53:56.907696 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-5d2740d8-8279-467d-a818-ef130e5d4558 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] 10.222.0.18 "GET /compute/v2.1/servers/f499ce97-cdf8-4dcf-9c28-3758aea5e78c" status: 200 len: 1231 microversion: 2.25 time: 0.204225 Oct 22 20:53:56.909393 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 701/1319] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 20:53:56 2022] GET /compute/v2.1/servers/f499ce97-cdf8-4dcf-9c28-3758aea5e78c => generated 1231 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 20:53:56.922466 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-b29d0d9b-0ac2-43cf-8508-9ca2ec56df1d tempest-InstanceActionsV221TestJSON-976463296 tempest-InstanceActionsV221TestJSON-976463296-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:53:56.924797 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-b29d0d9b-0ac2-43cf-8508-9ca2ec56df1d tempest-InstanceActionsV221TestJSON-976463296 tempest-InstanceActionsV221TestJSON-976463296-project] [instance: 304975d8-d62e-4156-9697-09c3a9724371] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:53:56.952203 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b29d0d9b-0ac2-43cf-8508-9ca2ec56df1d tempest-InstanceActionsV221TestJSON-976463296 tempest-InstanceActionsV221TestJSON-976463296-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:56.954496 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b29d0d9b-0ac2-43cf-8508-9ca2ec56df1d tempest-InstanceActionsV221TestJSON-976463296 tempest-InstanceActionsV221TestJSON-976463296-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:56.956493 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b29d0d9b-0ac2-43cf-8508-9ca2ec56df1d tempest-InstanceActionsV221TestJSON-976463296 tempest-InstanceActionsV221TestJSON-976463296-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:56.959079 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b29d0d9b-0ac2-43cf-8508-9ca2ec56df1d tempest-InstanceActionsV221TestJSON-976463296 tempest-InstanceActionsV221TestJSON-976463296-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:56.961645 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b29d0d9b-0ac2-43cf-8508-9ca2ec56df1d tempest-InstanceActionsV221TestJSON-976463296 tempest-InstanceActionsV221TestJSON-976463296-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:56.962273 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b29d0d9b-0ac2-43cf-8508-9ca2ec56df1d tempest-InstanceActionsV221TestJSON-976463296 tempest-InstanceActionsV221TestJSON-976463296-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:57.192466 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-ef8abaaa-325a-457d-9f55-9bf6355d0e57 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7f48d18691d4473bbe0284c44f14d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bacf9909082440f8a201771b64a75fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:53:57.205112 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-ef8abaaa-325a-457d-9f55-9bf6355d0e57 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] 10.222.0.18 "GET /compute/v2.1/servers/f2f50f6b-6a3e-449f-836e-bd897f78279c" status: 200 len: 1805 microversion: 2.1 time: 0.702950 Oct 22 20:53:57.207367 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 619/1320] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:53:56 2022] GET /compute/v2.1/servers/f2f50f6b-6a3e-449f-836e-bd897f78279c => generated 1805 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:53:57.236236 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-340a101b-555e-41ab-bcfe-5e2936f286da tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:53:57.237292 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-340a101b-555e-41ab-bcfe-5e2936f286da tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] [instance: f2f50f6b-6a3e-449f-836e-bd897f78279c] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:53:57.270679 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-340a101b-555e-41ab-bcfe-5e2936f286da tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:57.271567 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-340a101b-555e-41ab-bcfe-5e2936f286da tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:57.272194 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-340a101b-555e-41ab-bcfe-5e2936f286da tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:57.273109 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-340a101b-555e-41ab-bcfe-5e2936f286da tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:57.279193 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-340a101b-555e-41ab-bcfe-5e2936f286da tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:57.279821 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-340a101b-555e-41ab-bcfe-5e2936f286da tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:57.348144 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-340a101b-555e-41ab-bcfe-5e2936f286da tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] 10.222.0.18 "GET /compute/v2.1/servers/f2f50f6b-6a3e-449f-836e-bd897f78279c/ips" status: 200 len: 218 microversion: 2.1 time: 0.116365 Oct 22 20:53:57.355245 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 620/1321] 10.222.0.18 () {58 vars in 1248 bytes} [Sat Oct 22 20:53:57 2022] GET /compute/v2.1/servers/f2f50f6b-6a3e-449f-836e-bd897f78279c/ips => generated 218 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:53:57.360804 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-2f748d88-5e20-4ae1-ab20-4436429d3e4a tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:53:57.361598 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-2f748d88-5e20-4ae1-ab20-4436429d3e4a tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] [instance: f2f50f6b-6a3e-449f-836e-bd897f78279c] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:53:57.368212 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2f748d88-5e20-4ae1-ab20-4436429d3e4a tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:57.369223 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2f748d88-5e20-4ae1-ab20-4436429d3e4a tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:57.369877 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2f748d88-5e20-4ae1-ab20-4436429d3e4a tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:57.371023 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2f748d88-5e20-4ae1-ab20-4436429d3e4a tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:57.371688 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2f748d88-5e20-4ae1-ab20-4436429d3e4a tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:57.372571 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2f748d88-5e20-4ae1-ab20-4436429d3e4a tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:57.399894 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:53:57.409705 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-2f748d88-5e20-4ae1-ab20-4436429d3e4a tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] [instance: f2f50f6b-6a3e-449f-836e-bd897f78279c] Going to try to terminate instance {{(pid=138744) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 20:53:57.518017 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-b29d0d9b-0ac2-43cf-8508-9ca2ec56df1d tempest-InstanceActionsV221TestJSON-976463296 tempest-InstanceActionsV221TestJSON-976463296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13c3673ebe14b7e997ec664499b9e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f7808ed44e84de4a1574e8aacd71c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:53:57.530650 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-b29d0d9b-0ac2-43cf-8508-9ca2ec56df1d tempest-InstanceActionsV221TestJSON-976463296 tempest-InstanceActionsV221TestJSON-976463296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e13c3673ebe14b7e997ec664499b9e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f7808ed44e84de4a1574e8aacd71c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:53:57.534191 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-b29d0d9b-0ac2-43cf-8508-9ca2ec56df1d tempest-InstanceActionsV221TestJSON-976463296 tempest-InstanceActionsV221TestJSON-976463296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e13c3673ebe14b7e997ec664499b9e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f7808ed44e84de4a1574e8aacd71c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:53:57.536641 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-b29d0d9b-0ac2-43cf-8508-9ca2ec56df1d tempest-InstanceActionsV221TestJSON-976463296 tempest-InstanceActionsV221TestJSON-976463296-project] 10.222.0.18 "GET /compute/v2.1/servers/304975d8-d62e-4156-9697-09c3a9724371" status: 200 len: 1359 microversion: 2.21 time: 0.622160 Oct 22 20:53:57.537221 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 702/1322] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 20:53:56 2022] GET /compute/v2.1/servers/304975d8-d62e-4156-9697-09c3a9724371 => generated 1359 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 20:53:57.545564 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-ea2049b8-baea-4521-a479-4495e5d7688c tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Calling method '.version_select at 0x7fd3a44abc10>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:53:57.603708 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-2f748d88-5e20-4ae1-ab20-4436429d3e4a tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] 10.222.0.18 "DELETE /compute/v2.1/servers/f2f50f6b-6a3e-449f-836e-bd897f78279c" status: 204 len: 0 microversion: 2.1 time: 0.246587 Oct 22 20:53:57.606539 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 621/1323] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 20:53:57 2022] DELETE /compute/v2.1/servers/f2f50f6b-6a3e-449f-836e-bd897f78279c => generated 0 bytes in 250 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 22 20:53:57.617216 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-fead7ef0-fcf6-4b1f-9246-709642a57d7c tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:53:57.617913 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-fead7ef0-fcf6-4b1f-9246-709642a57d7c tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] [instance: f2f50f6b-6a3e-449f-836e-bd897f78279c] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:53:57.623396 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-ea2049b8-baea-4521-a479-4495e5d7688c tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] 10.222.0.18 "GET /compute/v2.1/images/2c26b155-ef26-40a2-b7db-1b550c12a2cf" status: 200 len: 1429 microversion: 2.1 time: 0.085070 Oct 22 20:53:57.631733 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 703/1324] 10.222.0.18 () {58 vars in 1233 bytes} [Sat Oct 22 20:53:57 2022] GET /compute/v2.1/images/2c26b155-ef26-40a2-b7db-1b550c12a2cf => generated 1429 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:53:57.641245 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fead7ef0-fcf6-4b1f-9246-709642a57d7c tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:57.641739 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fead7ef0-fcf6-4b1f-9246-709642a57d7c tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:57.642190 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fead7ef0-fcf6-4b1f-9246-709642a57d7c tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:57.655209 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fead7ef0-fcf6-4b1f-9246-709642a57d7c tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:57.655840 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fead7ef0-fcf6-4b1f-9246-709642a57d7c tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:57.656303 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fead7ef0-fcf6-4b1f-9246-709642a57d7c tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:57.938462 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-f1a3a3ea-0fb8-45e3-9e30-0f6d663840c7 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:53:57.939110 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-f1a3a3ea-0fb8-45e3-9e30-0f6d663840c7 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] [instance: f499ce97-cdf8-4dcf-9c28-3758aea5e78c] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:53:57.960668 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-fead7ef0-fcf6-4b1f-9246-709642a57d7c tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7f48d18691d4473bbe0284c44f14d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bacf9909082440f8a201771b64a75fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:53:57.972849 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-fead7ef0-fcf6-4b1f-9246-709642a57d7c tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] 10.222.0.18 "GET /compute/v2.1/servers/f2f50f6b-6a3e-449f-836e-bd897f78279c" status: 200 len: 1811 microversion: 2.1 time: 0.361847 Oct 22 20:53:57.973458 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 622/1325] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:53:57 2022] GET /compute/v2.1/servers/f2f50f6b-6a3e-449f-836e-bd897f78279c => generated 1811 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:53:57.989161 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f1a3a3ea-0fb8-45e3-9e30-0f6d663840c7 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:57.990021 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f1a3a3ea-0fb8-45e3-9e30-0f6d663840c7 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:57.991031 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f1a3a3ea-0fb8-45e3-9e30-0f6d663840c7 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:57.995045 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f1a3a3ea-0fb8-45e3-9e30-0f6d663840c7 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:57.995992 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f1a3a3ea-0fb8-45e3-9e30-0f6d663840c7 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:57.996709 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f1a3a3ea-0fb8-45e3-9e30-0f6d663840c7 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:58.116692 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-f1a3a3ea-0fb8-45e3-9e30-0f6d663840c7 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:53:58.136958 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-f1a3a3ea-0fb8-45e3-9e30-0f6d663840c7 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:53:58.143820 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-f1a3a3ea-0fb8-45e3-9e30-0f6d663840c7 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:53:58.145585 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-f1a3a3ea-0fb8-45e3-9e30-0f6d663840c7 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] 10.222.0.18 "GET /compute/v2.1/servers/f499ce97-cdf8-4dcf-9c28-3758aea5e78c" status: 200 len: 1249 microversion: 2.25 time: 0.213132 Oct 22 20:53:58.147291 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 704/1326] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 20:53:57 2022] GET /compute/v2.1/servers/f499ce97-cdf8-4dcf-9c28-3758aea5e78c => generated 1249 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 22 20:53:58.484897 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-bf87c45c-d2ba-4a71-a940-7bbf36ae7970 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ea0d4b51-ed12-4296-878c-d315f57fb330", "device": "/dev/xvdb"}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:53:58.488505 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-bf87c45c-d2ba-4a71-a940-7bbf36ae7970 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] [instance: 8f2e1da0-4586-460b-94dc-768fd618dc3d] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:53:58.508228 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bf87c45c-d2ba-4a71-a940-7bbf36ae7970 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:58.513377 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bf87c45c-d2ba-4a71-a940-7bbf36ae7970 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:58.514133 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bf87c45c-d2ba-4a71-a940-7bbf36ae7970 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:58.517332 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bf87c45c-d2ba-4a71-a940-7bbf36ae7970 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:58.517976 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bf87c45c-d2ba-4a71-a940-7bbf36ae7970 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:58.520796 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bf87c45c-d2ba-4a71-a940-7bbf36ae7970 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:58.576281 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-001ac6f4-1c50-4b41-8c68-bbf0b9c4f9fd tempest-InstanceActionsV221TestJSON-976463296 tempest-InstanceActionsV221TestJSON-976463296-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:53:58.579015 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-001ac6f4-1c50-4b41-8c68-bbf0b9c4f9fd tempest-InstanceActionsV221TestJSON-976463296 tempest-InstanceActionsV221TestJSON-976463296-project] [instance: 304975d8-d62e-4156-9697-09c3a9724371] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:53:58.619609 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-001ac6f4-1c50-4b41-8c68-bbf0b9c4f9fd tempest-InstanceActionsV221TestJSON-976463296 tempest-InstanceActionsV221TestJSON-976463296-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:58.625636 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-001ac6f4-1c50-4b41-8c68-bbf0b9c4f9fd tempest-InstanceActionsV221TestJSON-976463296 tempest-InstanceActionsV221TestJSON-976463296-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:58.628250 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-001ac6f4-1c50-4b41-8c68-bbf0b9c4f9fd tempest-InstanceActionsV221TestJSON-976463296 tempest-InstanceActionsV221TestJSON-976463296-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:58.629959 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-001ac6f4-1c50-4b41-8c68-bbf0b9c4f9fd tempest-InstanceActionsV221TestJSON-976463296 tempest-InstanceActionsV221TestJSON-976463296-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:58.638624 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-001ac6f4-1c50-4b41-8c68-bbf0b9c4f9fd tempest-InstanceActionsV221TestJSON-976463296 tempest-InstanceActionsV221TestJSON-976463296-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:58.640559 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-001ac6f4-1c50-4b41-8c68-bbf0b9c4f9fd tempest-InstanceActionsV221TestJSON-976463296 tempest-InstanceActionsV221TestJSON-976463296-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:59.116014 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-bf87c45c-d2ba-4a71-a940-7bbf36ae7970 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] 10.222.0.18 "POST /compute/v2.1/servers/8f2e1da0-4586-460b-94dc-768fd618dc3d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.635035 Oct 22 20:53:59.126291 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 623/1327] 10.222.0.18 () {60 vars in 1323 bytes} [Sat Oct 22 20:53:58 2022] POST /compute/v2.1/servers/8f2e1da0-4586-460b-94dc-768fd618dc3d/os-volume_attachments => generated 194 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:53:59.142027 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-8cc04cf1-c70b-4b22-ac94-1338c17c5f9a tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Calling method '.version_select at 0x7fd39fef1af0>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:53:59.216890 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-001ac6f4-1c50-4b41-8c68-bbf0b9c4f9fd tempest-InstanceActionsV221TestJSON-976463296 tempest-InstanceActionsV221TestJSON-976463296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13c3673ebe14b7e997ec664499b9e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f7808ed44e84de4a1574e8aacd71c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:53:59.231684 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-8cc04cf1-c70b-4b22-ac94-1338c17c5f9a tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] 10.222.0.18 "GET /compute/v2.1/images/2c26b155-ef26-40a2-b7db-1b550c12a2cf" status: 200 len: 1429 microversion: 2.1 time: 0.102985 Oct 22 20:53:59.232280 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 624/1328] 10.222.0.18 () {58 vars in 1233 bytes} [Sat Oct 22 20:53:59 2022] GET /compute/v2.1/images/2c26b155-ef26-40a2-b7db-1b550c12a2cf => generated 1429 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:53:59.240445 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-b47d7c20-c5e9-435d-ad77-228860fb7fd1 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:53:59.247422 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-b47d7c20-c5e9-435d-ad77-228860fb7fd1 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] [instance: f2f50f6b-6a3e-449f-836e-bd897f78279c] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:53:59.253041 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-001ac6f4-1c50-4b41-8c68-bbf0b9c4f9fd tempest-InstanceActionsV221TestJSON-976463296 tempest-InstanceActionsV221TestJSON-976463296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e13c3673ebe14b7e997ec664499b9e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f7808ed44e84de4a1574e8aacd71c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:53:59.266422 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-001ac6f4-1c50-4b41-8c68-bbf0b9c4f9fd tempest-InstanceActionsV221TestJSON-976463296 tempest-InstanceActionsV221TestJSON-976463296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e13c3673ebe14b7e997ec664499b9e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f7808ed44e84de4a1574e8aacd71c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:53:59.268850 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b47d7c20-c5e9-435d-ad77-228860fb7fd1 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:59.269564 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b47d7c20-c5e9-435d-ad77-228860fb7fd1 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:59.270210 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b47d7c20-c5e9-435d-ad77-228860fb7fd1 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:59.271240 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b47d7c20-c5e9-435d-ad77-228860fb7fd1 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:59.272237 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b47d7c20-c5e9-435d-ad77-228860fb7fd1 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:59.272872 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b47d7c20-c5e9-435d-ad77-228860fb7fd1 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:59.274309 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-001ac6f4-1c50-4b41-8c68-bbf0b9c4f9fd tempest-InstanceActionsV221TestJSON-976463296 tempest-InstanceActionsV221TestJSON-976463296-project] 10.222.0.18 "GET /compute/v2.1/servers/304975d8-d62e-4156-9697-09c3a9724371" status: 200 len: 1359 microversion: 2.21 time: 0.708611 Oct 22 20:53:59.279614 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 705/1329] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 20:53:58 2022] GET /compute/v2.1/servers/304975d8-d62e-4156-9697-09c3a9724371 => generated 1359 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 20:53:59.300990 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-fe642dd4-da7d-4432-a202-4a24a72943ec tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:53:59.308374 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-fe642dd4-da7d-4432-a202-4a24a72943ec tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] [instance: f499ce97-cdf8-4dcf-9c28-3758aea5e78c] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:53:59.322008 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fe642dd4-da7d-4432-a202-4a24a72943ec tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:59.325669 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fe642dd4-da7d-4432-a202-4a24a72943ec tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:59.326592 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fe642dd4-da7d-4432-a202-4a24a72943ec tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:59.330104 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fe642dd4-da7d-4432-a202-4a24a72943ec tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:53:59.332918 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fe642dd4-da7d-4432-a202-4a24a72943ec tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:53:59.333930 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fe642dd4-da7d-4432-a202-4a24a72943ec tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:53:59.789758 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-fe642dd4-da7d-4432-a202-4a24a72943ec tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:53:59.804238 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-fe642dd4-da7d-4432-a202-4a24a72943ec tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:53:59.806064 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-fe642dd4-da7d-4432-a202-4a24a72943ec tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:53:59.811845 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-fe642dd4-da7d-4432-a202-4a24a72943ec tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] 10.222.0.18 "GET /compute/v2.1/servers/f499ce97-cdf8-4dcf-9c28-3758aea5e78c" status: 200 len: 1291 microversion: 2.25 time: 0.529293 Oct 22 20:53:59.812651 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 706/1330] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 20:53:59 2022] GET /compute/v2.1/servers/f499ce97-cdf8-4dcf-9c28-3758aea5e78c => generated 1291 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 20:54:00.046781 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-b47d7c20-c5e9-435d-ad77-228860fb7fd1 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7f48d18691d4473bbe0284c44f14d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bacf9909082440f8a201771b64a75fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:54:00.078140 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-f3ba31e8-f8d6-455d-87bc-098ed133d1e6 req-65b2548c-391c-44a9-9a64-51ab05d2c414 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f499ce97-cdf8-4dcf-9c28-3758aea5e78c", "tag": "c45f11d9-428c-4566-a627-5dbe8e1e8d6d"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:54:00.093951 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-b47d7c20-c5e9-435d-ad77-228860fb7fd1 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] 10.222.0.18 "GET /compute/v2.1/servers/f2f50f6b-6a3e-449f-836e-bd897f78279c" status: 200 len: 1811 microversion: 2.1 time: 0.858902 Oct 22 20:54:00.126240 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 625/1331] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:53:59 2022] GET /compute/v2.1/servers/f2f50f6b-6a3e-449f-836e-bd897f78279c => generated 1811 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:54:00.146383 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-f3ba31e8-f8d6-455d-87bc-098ed133d1e6 req-65b2548c-391c-44a9-9a64-51ab05d2c414 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:00.146983 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-f3ba31e8-f8d6-455d-87bc-098ed133d1e6 req-65b2548c-391c-44a9-9a64-51ab05d2c414 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:00.148560 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-f3ba31e8-f8d6-455d-87bc-098ed133d1e6 req-65b2548c-391c-44a9-9a64-51ab05d2c414 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:00.181536 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-f3ba31e8-f8d6-455d-87bc-098ed133d1e6 req-65b2548c-391c-44a9-9a64-51ab05d2c414 service nova] Creating event network-changed:c45f11d9-428c-4566-a627-5dbe8e1e8d6d for instance f499ce97-cdf8-4dcf-9c28-3758aea5e78c on nch1-master-1 Oct 22 20:54:00.198070 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-f3ba31e8-f8d6-455d-87bc-098ed133d1e6 req-65b2548c-391c-44a9-9a64-51ab05d2c414 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.134556 Oct 22 20:54:00.202313 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 707/1332] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:54:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:54:00.252451 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-10221565-9419-4c24-9890-a8a8535fc70a tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Calling method '.version_select at 0x7fd3a4ea3160>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:54:00.310926 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-30774671-7ead-4097-b9d2-ba79ba0d7f0a tempest-InstanceActionsV221TestJSON-976463296 tempest-InstanceActionsV221TestJSON-976463296-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:54:00.312306 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-30774671-7ead-4097-b9d2-ba79ba0d7f0a tempest-InstanceActionsV221TestJSON-976463296 tempest-InstanceActionsV221TestJSON-976463296-project] [instance: 304975d8-d62e-4156-9697-09c3a9724371] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:54:00.343551 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-30774671-7ead-4097-b9d2-ba79ba0d7f0a tempest-InstanceActionsV221TestJSON-976463296 tempest-InstanceActionsV221TestJSON-976463296-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:00.345769 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-30774671-7ead-4097-b9d2-ba79ba0d7f0a tempest-InstanceActionsV221TestJSON-976463296 tempest-InstanceActionsV221TestJSON-976463296-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:00.347648 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-30774671-7ead-4097-b9d2-ba79ba0d7f0a tempest-InstanceActionsV221TestJSON-976463296 tempest-InstanceActionsV221TestJSON-976463296-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:00.359247 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-30774671-7ead-4097-b9d2-ba79ba0d7f0a tempest-InstanceActionsV221TestJSON-976463296 tempest-InstanceActionsV221TestJSON-976463296-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:00.362656 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-30774671-7ead-4097-b9d2-ba79ba0d7f0a tempest-InstanceActionsV221TestJSON-976463296 tempest-InstanceActionsV221TestJSON-976463296-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:00.363698 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-30774671-7ead-4097-b9d2-ba79ba0d7f0a tempest-InstanceActionsV221TestJSON-976463296 tempest-InstanceActionsV221TestJSON-976463296-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:00.377230 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-10221565-9419-4c24-9890-a8a8535fc70a tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] 10.222.0.18 "GET /compute/v2.1/images/2c26b155-ef26-40a2-b7db-1b550c12a2cf" status: 200 len: 1429 microversion: 2.1 time: 0.132583 Oct 22 20:54:00.380179 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 626/1333] 10.222.0.18 () {58 vars in 1233 bytes} [Sat Oct 22 20:54:00 2022] GET /compute/v2.1/images/2c26b155-ef26-40a2-b7db-1b550c12a2cf => generated 1429 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:54:00.841280 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-4d4d1726-a4c3-4b60-80f7-b517eeb116b9 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:54:00.842808 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-4d4d1726-a4c3-4b60-80f7-b517eeb116b9 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] [instance: f499ce97-cdf8-4dcf-9c28-3758aea5e78c] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:54:00.847856 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell0:SELECT=4 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:54:00.903861 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4d4d1726-a4c3-4b60-80f7-b517eeb116b9 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:00.908749 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4d4d1726-a4c3-4b60-80f7-b517eeb116b9 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:00.910630 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4d4d1726-a4c3-4b60-80f7-b517eeb116b9 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:00.915267 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4d4d1726-a4c3-4b60-80f7-b517eeb116b9 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:00.916075 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4d4d1726-a4c3-4b60-80f7-b517eeb116b9 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:00.930675 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4d4d1726-a4c3-4b60-80f7-b517eeb116b9 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:00.940946 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-30774671-7ead-4097-b9d2-ba79ba0d7f0a tempest-InstanceActionsV221TestJSON-976463296 tempest-InstanceActionsV221TestJSON-976463296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13c3673ebe14b7e997ec664499b9e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f7808ed44e84de4a1574e8aacd71c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:54:00.955389 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-30774671-7ead-4097-b9d2-ba79ba0d7f0a tempest-InstanceActionsV221TestJSON-976463296 tempest-InstanceActionsV221TestJSON-976463296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e13c3673ebe14b7e997ec664499b9e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f7808ed44e84de4a1574e8aacd71c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:54:00.957494 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-30774671-7ead-4097-b9d2-ba79ba0d7f0a tempest-InstanceActionsV221TestJSON-976463296 tempest-InstanceActionsV221TestJSON-976463296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e13c3673ebe14b7e997ec664499b9e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f7808ed44e84de4a1574e8aacd71c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:54:00.960285 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-30774671-7ead-4097-b9d2-ba79ba0d7f0a tempest-InstanceActionsV221TestJSON-976463296 tempest-InstanceActionsV221TestJSON-976463296-project] 10.222.0.18 "GET /compute/v2.1/servers/304975d8-d62e-4156-9697-09c3a9724371" status: 200 len: 1359 microversion: 2.21 time: 0.655925 Oct 22 20:54:00.962139 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 708/1334] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 20:54:00 2022] GET /compute/v2.1/servers/304975d8-d62e-4156-9697-09c3a9724371 => generated 1359 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 20:54:01.142960 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-fc53a6f9-3bff-47d0-877e-53e2842c2aea tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:54:01.143619 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-fc53a6f9-3bff-47d0-877e-53e2842c2aea tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] [instance: f2f50f6b-6a3e-449f-836e-bd897f78279c] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:54:01.170016 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fc53a6f9-3bff-47d0-877e-53e2842c2aea tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:01.171861 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fc53a6f9-3bff-47d0-877e-53e2842c2aea tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:01.172482 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fc53a6f9-3bff-47d0-877e-53e2842c2aea tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:01.174596 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fc53a6f9-3bff-47d0-877e-53e2842c2aea tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:01.175548 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fc53a6f9-3bff-47d0-877e-53e2842c2aea tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:01.176785 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fc53a6f9-3bff-47d0-877e-53e2842c2aea tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:01.390738 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-4d4d1726-a4c3-4b60-80f7-b517eeb116b9 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:54:01.405778 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-4d4d1726-a4c3-4b60-80f7-b517eeb116b9 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:54:01.413244 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-4d4d1726-a4c3-4b60-80f7-b517eeb116b9 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:54:01.417209 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-4d4d1726-a4c3-4b60-80f7-b517eeb116b9 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] 10.222.0.18 "GET /compute/v2.1/servers/f499ce97-cdf8-4dcf-9c28-3758aea5e78c" status: 200 len: 1279 microversion: 2.25 time: 0.581366 Oct 22 20:54:01.441272 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 627/1335] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 20:54:00 2022] GET /compute/v2.1/servers/f499ce97-cdf8-4dcf-9c28-3758aea5e78c => generated 1279 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 20:54:01.521318 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-fc53a6f9-3bff-47d0-877e-53e2842c2aea tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7f48d18691d4473bbe0284c44f14d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bacf9909082440f8a201771b64a75fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:54:01.538313 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-fc53a6f9-3bff-47d0-877e-53e2842c2aea tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] 10.222.0.18 "GET /compute/v2.1/servers/f2f50f6b-6a3e-449f-836e-bd897f78279c" status: 200 len: 1811 microversion: 2.1 time: 0.400188 Oct 22 20:54:01.540601 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 709/1336] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:54:01 2022] GET /compute/v2.1/servers/f2f50f6b-6a3e-449f-836e-bd897f78279c => generated 1811 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:54:01.549128 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-38689b46-dd6a-4d75-966c-2273dc369cb1 tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Calling method '.version_select at 0x7fd3a4aca820>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:54:01.638526 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-38689b46-dd6a-4d75-966c-2273dc369cb1 tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] 10.222.0.18 "GET /compute/v2.1/images/2c26b155-ef26-40a2-b7db-1b550c12a2cf" status: 200 len: 1429 microversion: 2.1 time: 0.096226 Oct 22 20:54:01.642956 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 710/1337] 10.222.0.18 () {58 vars in 1233 bytes} [Sat Oct 22 20:54:01 2022] GET /compute/v2.1/images/2c26b155-ef26-40a2-b7db-1b550c12a2cf => generated 1429 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:54:01.931957 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-35f13483-0d4f-475a-ac0b-e5f80441bb3a req-fff20e99-1bee-4b99-ad6a-cd32883876a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "304975d8-d62e-4156-9697-09c3a9724371", "name": "network-vif-plugged", "status": "completed", "tag": "75b0deee-22d9-412a-9096-15c6aafa06da"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:54:01.953989 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-35f13483-0d4f-475a-ac0b-e5f80441bb3a req-fff20e99-1bee-4b99-ad6a-cd32883876a1 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:01.957124 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-35f13483-0d4f-475a-ac0b-e5f80441bb3a req-fff20e99-1bee-4b99-ad6a-cd32883876a1 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:01.957751 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-35f13483-0d4f-475a-ac0b-e5f80441bb3a req-fff20e99-1bee-4b99-ad6a-cd32883876a1 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:01.988763 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-35f13483-0d4f-475a-ac0b-e5f80441bb3a req-fff20e99-1bee-4b99-ad6a-cd32883876a1 service nova] Creating event network-vif-plugged:75b0deee-22d9-412a-9096-15c6aafa06da for instance 304975d8-d62e-4156-9697-09c3a9724371 on nch2-master-1 Oct 22 20:54:01.993340 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-4d817c5b-e285-4ebf-baac-bae9c60b497d tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1878949024", "imageRef": "085e4478-6edc-4a69-8e08-f9831713eb65", "flavorRef": "452"}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:54:02.000633 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-35f13483-0d4f-475a-ac0b-e5f80441bb3a req-fff20e99-1bee-4b99-ad6a-cd32883876a1 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073678 Oct 22 20:54:02.002990 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 711/1338] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:54:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:54:02.010671 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-db489175-1fe2-4f08-9e42-bd13243a76ee tempest-InstanceActionsV221TestJSON-976463296 tempest-InstanceActionsV221TestJSON-976463296-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:54:02.017079 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-db489175-1fe2-4f08-9e42-bd13243a76ee tempest-InstanceActionsV221TestJSON-976463296 tempest-InstanceActionsV221TestJSON-976463296-project] [instance: 304975d8-d62e-4156-9697-09c3a9724371] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:54:02.029113 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-db489175-1fe2-4f08-9e42-bd13243a76ee tempest-InstanceActionsV221TestJSON-976463296 tempest-InstanceActionsV221TestJSON-976463296-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:02.030101 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-db489175-1fe2-4f08-9e42-bd13243a76ee tempest-InstanceActionsV221TestJSON-976463296 tempest-InstanceActionsV221TestJSON-976463296-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:02.030721 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-db489175-1fe2-4f08-9e42-bd13243a76ee tempest-InstanceActionsV221TestJSON-976463296 tempest-InstanceActionsV221TestJSON-976463296-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:02.049525 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-db489175-1fe2-4f08-9e42-bd13243a76ee tempest-InstanceActionsV221TestJSON-976463296 tempest-InstanceActionsV221TestJSON-976463296-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:02.052644 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-db489175-1fe2-4f08-9e42-bd13243a76ee tempest-InstanceActionsV221TestJSON-976463296 tempest-InstanceActionsV221TestJSON-976463296-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:02.059713 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-db489175-1fe2-4f08-9e42-bd13243a76ee tempest-InstanceActionsV221TestJSON-976463296 tempest-InstanceActionsV221TestJSON-976463296-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:02.129400 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.network.neutron [None req-4d817c5b-e285-4ebf-baac-bae9c60b497d tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] validate_networks() for None {{(pid=138744) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 20:54:02.997675 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-db489175-1fe2-4f08-9e42-bd13243a76ee tempest-InstanceActionsV221TestJSON-976463296 tempest-InstanceActionsV221TestJSON-976463296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13c3673ebe14b7e997ec664499b9e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f7808ed44e84de4a1574e8aacd71c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:54:03.013079 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-db489175-1fe2-4f08-9e42-bd13243a76ee tempest-InstanceActionsV221TestJSON-976463296 tempest-InstanceActionsV221TestJSON-976463296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e13c3673ebe14b7e997ec664499b9e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f7808ed44e84de4a1574e8aacd71c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:54:03.014682 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-db489175-1fe2-4f08-9e42-bd13243a76ee tempest-InstanceActionsV221TestJSON-976463296 tempest-InstanceActionsV221TestJSON-976463296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e13c3673ebe14b7e997ec664499b9e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f7808ed44e84de4a1574e8aacd71c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:54:03.022505 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-db489175-1fe2-4f08-9e42-bd13243a76ee tempest-InstanceActionsV221TestJSON-976463296 tempest-InstanceActionsV221TestJSON-976463296-project] 10.222.0.18 "GET /compute/v2.1/servers/304975d8-d62e-4156-9697-09c3a9724371" status: 200 len: 1359 microversion: 2.21 time: 1.017812 Oct 22 20:54:03.029866 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 712/1339] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 20:54:02 2022] GET /compute/v2.1/servers/304975d8-d62e-4156-9697-09c3a9724371 => generated 1359 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 20:54:03.043637 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-2fa54ae3-4450-4e63-8863-90e2b7ea357f tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:54:03.049436 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-2fa54ae3-4450-4e63-8863-90e2b7ea357f tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] [instance: f499ce97-cdf8-4dcf-9c28-3758aea5e78c] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:54:03.067995 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2fa54ae3-4450-4e63-8863-90e2b7ea357f tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:03.068257 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2fa54ae3-4450-4e63-8863-90e2b7ea357f tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:03.068669 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2fa54ae3-4450-4e63-8863-90e2b7ea357f tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:03.072233 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2fa54ae3-4450-4e63-8863-90e2b7ea357f tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:03.072712 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2fa54ae3-4450-4e63-8863-90e2b7ea357f tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:03.073154 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2fa54ae3-4450-4e63-8863-90e2b7ea357f tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:03.154360 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-4d817c5b-e285-4ebf-baac-bae9c60b497d tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Flavor limits 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 20:54:03.155582 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-4d817c5b-e285-4ebf-baac-bae9c60b497d tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Image limits 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 20:54:03.156268 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-4d817c5b-e285-4ebf-baac-bae9c60b497d tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Flavor pref 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 20:54:03.156884 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-4d817c5b-e285-4ebf-baac-bae9c60b497d tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Image pref 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 20:54:03.158253 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-4d817c5b-e285-4ebf-baac-bae9c60b497d tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 20:54:03.186411 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4d817c5b-e285-4ebf-baac-bae9c60b497d tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:03.188552 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4d817c5b-e285-4ebf-baac-bae9c60b497d tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:03.189888 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4d817c5b-e285-4ebf-baac-bae9c60b497d tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:03.192912 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4d817c5b-e285-4ebf-baac-bae9c60b497d tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:03.194576 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4d817c5b-e285-4ebf-baac-bae9c60b497d tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:03.195316 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4d817c5b-e285-4ebf-baac-bae9c60b497d tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:03.216702 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-4d817c5b-e285-4ebf-baac-bae9c60b497d tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Getting quotas for project 49238b8686d24ae698679e4a1957735d. Resources: {'cores', 'instances', 'ram'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 20:54:03.222553 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-4d817c5b-e285-4ebf-baac-bae9c60b497d tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Getting quotas for user e0d3d7458af447bdb3f03e83a2d8559f and project 49238b8686d24ae698679e4a1957735d. Resources: {'cores', 'instances', 'ram'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 20:54:03.241485 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-4d817c5b-e285-4ebf-baac-bae9c60b497d tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Going to run 1 instances... {{(pid=138744) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 20:54:03.244210 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-4d817c5b-e285-4ebf-baac-bae9c60b497d tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] [instance: 40e6c6e3-3d47-4781-b8a8-aafd671d7287] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='085e4478-6edc-4a69-8e08-f9831713eb65',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138744) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 20:54:03.274757 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-2fa54ae3-4450-4e63-8863-90e2b7ea357f tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:54:03.285018 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-2fa54ae3-4450-4e63-8863-90e2b7ea357f tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:54:03.290365 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-2fa54ae3-4450-4e63-8863-90e2b7ea357f tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:54:03.293267 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-2fa54ae3-4450-4e63-8863-90e2b7ea357f tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] 10.222.0.18 "GET /compute/v2.1/servers/f499ce97-cdf8-4dcf-9c28-3758aea5e78c" status: 200 len: 1279 microversion: 2.25 time: 0.262045 Oct 22 20:54:03.294424 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 713/1340] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 20:54:03 2022] GET /compute/v2.1/servers/f499ce97-cdf8-4dcf-9c28-3758aea5e78c => generated 1279 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 20:54:03.300623 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-2df64df2-9b00-4287-90fe-7d1ca202fdfd tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:54:03.301558 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-2df64df2-9b00-4287-90fe-7d1ca202fdfd tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] [instance: f2f50f6b-6a3e-449f-836e-bd897f78279c] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:54:03.309161 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2df64df2-9b00-4287-90fe-7d1ca202fdfd tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:03.310202 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2df64df2-9b00-4287-90fe-7d1ca202fdfd tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:03.310864 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2df64df2-9b00-4287-90fe-7d1ca202fdfd tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:03.311923 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2df64df2-9b00-4287-90fe-7d1ca202fdfd tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:03.312651 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2df64df2-9b00-4287-90fe-7d1ca202fdfd tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:03.313310 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2df64df2-9b00-4287-90fe-7d1ca202fdfd tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:03.336203 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-4d817c5b-e285-4ebf-baac-bae9c60b497d tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.891972 Oct 22 20:54:03.344542 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 628/1341] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Oct 22 20:54:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 1903 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 20:54:03.352123 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-c7b82b4f-1728-4478-8cff-5a74175c8651 tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Calling method '.version_select at 0x7fd3a4066820>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:54:03.419225 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-c7b82b4f-1728-4478-8cff-5a74175c8651 tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] 10.222.0.18 "GET /compute/v2.1/images/2c26b155-ef26-40a2-b7db-1b550c12a2cf" status: 200 len: 1429 microversion: 2.1 time: 0.071082 Oct 22 20:54:03.430748 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 629/1342] 10.222.0.18 () {58 vars in 1233 bytes} [Sat Oct 22 20:54:03 2022] GET /compute/v2.1/images/2c26b155-ef26-40a2-b7db-1b550c12a2cf => generated 1429 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:54:03.445227 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-a224eba2-c43f-40fb-9b0c-53d455021d16 req-f222ee1a-0cef-4dd6-835b-b3679246686b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2f50f6b-6a3e-449f-836e-bd897f78279c", "name": "network-vif-deleted", "tag": "a1f62079-48cd-4898-b101-1f21b055979f"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:54:03.473815 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-a224eba2-c43f-40fb-9b0c-53d455021d16 req-f222ee1a-0cef-4dd6-835b-b3679246686b service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:03.475326 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-a224eba2-c43f-40fb-9b0c-53d455021d16 req-f222ee1a-0cef-4dd6-835b-b3679246686b service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:03.476348 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-a224eba2-c43f-40fb-9b0c-53d455021d16 req-f222ee1a-0cef-4dd6-835b-b3679246686b service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:03.508062 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-a224eba2-c43f-40fb-9b0c-53d455021d16 req-f222ee1a-0cef-4dd6-835b-b3679246686b service nova] Creating event network-vif-deleted:a1f62079-48cd-4898-b101-1f21b055979f for instance f2f50f6b-6a3e-449f-836e-bd897f78279c on nch2-master-1 Oct 22 20:54:03.521213 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-a224eba2-c43f-40fb-9b0c-53d455021d16 req-f222ee1a-0cef-4dd6-835b-b3679246686b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088331 Oct 22 20:54:03.523741 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 630/1343] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:54:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:54:03.547652 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-44b3ab92-6d10-485b-8814-d16613ce1b12 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:54:03.548336 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-44b3ab92-6d10-485b-8814-d16613ce1b12 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] [instance: 40e6c6e3-3d47-4781-b8a8-aafd671d7287] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:54:03.656837 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-44b3ab92-6d10-485b-8814-d16613ce1b12 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d3d7458af447bdb3f03e83a2d8559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49238b8686d24ae698679e4a1957735d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:54:03.665757 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-44b3ab92-6d10-485b-8814-d16613ce1b12 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] 10.222.0.18 "GET /compute/v2.1/servers/40e6c6e3-3d47-4781-b8a8-aafd671d7287" status: 200 len: 1213 microversion: 2.1 time: 0.139702 Oct 22 20:54:03.668939 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 631/1344] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:54:03 2022] GET /compute/v2.1/servers/40e6c6e3-3d47-4781-b8a8-aafd671d7287 => generated 1213 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:54:03.687388 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-2df64df2-9b00-4287-90fe-7d1ca202fdfd tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7f48d18691d4473bbe0284c44f14d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bacf9909082440f8a201771b64a75fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:54:03.700621 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-2df64df2-9b00-4287-90fe-7d1ca202fdfd tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] 10.222.0.18 "GET /compute/v2.1/servers/f2f50f6b-6a3e-449f-836e-bd897f78279c" status: 200 len: 1790 microversion: 2.1 time: 0.403910 Oct 22 20:54:03.701470 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 714/1345] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:54:03 2022] GET /compute/v2.1/servers/f2f50f6b-6a3e-449f-836e-bd897f78279c => generated 1790 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:54:04.056354 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-c93405ef-06e2-4af4-9bfd-ce00a7ab185a tempest-InstanceActionsV221TestJSON-976463296 tempest-InstanceActionsV221TestJSON-976463296-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:54:04.057319 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-c93405ef-06e2-4af4-9bfd-ce00a7ab185a tempest-InstanceActionsV221TestJSON-976463296 tempest-InstanceActionsV221TestJSON-976463296-project] [instance: 304975d8-d62e-4156-9697-09c3a9724371] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:54:04.077290 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c93405ef-06e2-4af4-9bfd-ce00a7ab185a tempest-InstanceActionsV221TestJSON-976463296 tempest-InstanceActionsV221TestJSON-976463296-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:04.078714 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c93405ef-06e2-4af4-9bfd-ce00a7ab185a tempest-InstanceActionsV221TestJSON-976463296 tempest-InstanceActionsV221TestJSON-976463296-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:04.082562 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c93405ef-06e2-4af4-9bfd-ce00a7ab185a tempest-InstanceActionsV221TestJSON-976463296 tempest-InstanceActionsV221TestJSON-976463296-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:04.085391 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c93405ef-06e2-4af4-9bfd-ce00a7ab185a tempest-InstanceActionsV221TestJSON-976463296 tempest-InstanceActionsV221TestJSON-976463296-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:04.086314 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c93405ef-06e2-4af4-9bfd-ce00a7ab185a tempest-InstanceActionsV221TestJSON-976463296 tempest-InstanceActionsV221TestJSON-976463296-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:04.086932 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c93405ef-06e2-4af4-9bfd-ce00a7ab185a tempest-InstanceActionsV221TestJSON-976463296 tempest-InstanceActionsV221TestJSON-976463296-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:04.100231 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-945f031a-86a7-46fc-b61a-5664b733461c req-ee7823d1-1a1b-4349-a5b8-e47640000dfb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2f50f6b-6a3e-449f-836e-bd897f78279c", "name": "network-vif-unplugged", "status": "completed", "tag": "16c272f7-7571-4436-bc1e-a2535cce8300"}, {"server_uuid": "f2f50f6b-6a3e-449f-836e-bd897f78279c", "name": "network-vif-unplugged", "status": "completed", "tag": "8be47bf4-2a35-45fb-93e7-e1ccf22b8551"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:54:04.144825 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-945f031a-86a7-46fc-b61a-5664b733461c req-ee7823d1-1a1b-4349-a5b8-e47640000dfb service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:04.150353 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-945f031a-86a7-46fc-b61a-5664b733461c req-ee7823d1-1a1b-4349-a5b8-e47640000dfb service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:04.150859 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-945f031a-86a7-46fc-b61a-5664b733461c req-ee7823d1-1a1b-4349-a5b8-e47640000dfb service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:04.213964 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-945f031a-86a7-46fc-b61a-5664b733461c req-ee7823d1-1a1b-4349-a5b8-e47640000dfb service nova] Creating event network-vif-unplugged:16c272f7-7571-4436-bc1e-a2535cce8300 for instance f2f50f6b-6a3e-449f-836e-bd897f78279c on nch2-master-1 Oct 22 20:54:04.214476 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-945f031a-86a7-46fc-b61a-5664b733461c req-ee7823d1-1a1b-4349-a5b8-e47640000dfb service nova] Creating event network-vif-unplugged:8be47bf4-2a35-45fb-93e7-e1ccf22b8551 for instance f2f50f6b-6a3e-449f-836e-bd897f78279c on nch2-master-1 Oct 22 20:54:04.250071 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-945f031a-86a7-46fc-b61a-5664b733461c req-ee7823d1-1a1b-4349-a5b8-e47640000dfb service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 358 microversion: 2.1 time: 0.160155 Oct 22 20:54:04.259964 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 715/1346] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:54:04 2022] POST /compute/v2.1/os-server-external-events => generated 358 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 20:54:04.333676 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-7b265612-897e-425a-b6c6-6fd1c97bf077 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:54:04.337560 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-7b265612-897e-425a-b6c6-6fd1c97bf077 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] [instance: f499ce97-cdf8-4dcf-9c28-3758aea5e78c] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:54:04.357828 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7b265612-897e-425a-b6c6-6fd1c97bf077 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:04.363431 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7b265612-897e-425a-b6c6-6fd1c97bf077 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:04.365141 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7b265612-897e-425a-b6c6-6fd1c97bf077 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:04.370738 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7b265612-897e-425a-b6c6-6fd1c97bf077 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:04.372217 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7b265612-897e-425a-b6c6-6fd1c97bf077 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:04.376767 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7b265612-897e-425a-b6c6-6fd1c97bf077 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:04.731731 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-c93405ef-06e2-4af4-9bfd-ce00a7ab185a tempest-InstanceActionsV221TestJSON-976463296 tempest-InstanceActionsV221TestJSON-976463296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13c3673ebe14b7e997ec664499b9e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f7808ed44e84de4a1574e8aacd71c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:54:04.755756 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-c93405ef-06e2-4af4-9bfd-ce00a7ab185a tempest-InstanceActionsV221TestJSON-976463296 tempest-InstanceActionsV221TestJSON-976463296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e13c3673ebe14b7e997ec664499b9e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f7808ed44e84de4a1574e8aacd71c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:54:04.762499 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-c93405ef-06e2-4af4-9bfd-ce00a7ab185a tempest-InstanceActionsV221TestJSON-976463296 tempest-InstanceActionsV221TestJSON-976463296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e13c3673ebe14b7e997ec664499b9e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f7808ed44e84de4a1574e8aacd71c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:54:04.768283 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-c93405ef-06e2-4af4-9bfd-ce00a7ab185a tempest-InstanceActionsV221TestJSON-976463296 tempest-InstanceActionsV221TestJSON-976463296-project] 10.222.0.18 "GET /compute/v2.1/servers/304975d8-d62e-4156-9697-09c3a9724371" status: 200 len: 1359 microversion: 2.21 time: 0.715339 Oct 22 20:54:04.775973 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 632/1347] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 20:54:04 2022] GET /compute/v2.1/servers/304975d8-d62e-4156-9697-09c3a9724371 => generated 1359 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 20:54:04.793648 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-b01d1ba0-93f6-42be-aeaf-5b26eb6adc42 tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Calling method '.version_select at 0x7fd39feb7af0>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:54:04.817419 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell0:SELECT=12 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:54:04.905459 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-b01d1ba0-93f6-42be-aeaf-5b26eb6adc42 tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] 10.222.0.18 "GET /compute/v2.1/images/2c26b155-ef26-40a2-b7db-1b550c12a2cf" status: 200 len: 1429 microversion: 2.1 time: 0.128324 Oct 22 20:54:04.914292 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 633/1348] 10.222.0.18 () {58 vars in 1233 bytes} [Sat Oct 22 20:54:04 2022] GET /compute/v2.1/images/2c26b155-ef26-40a2-b7db-1b550c12a2cf => generated 1429 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:54:04.920587 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-e3c3ef08-123e-4996-a335-be12a3e29e1b tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:54:04.921403 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-e3c3ef08-123e-4996-a335-be12a3e29e1b tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] [instance: 40e6c6e3-3d47-4781-b8a8-aafd671d7287] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:54:04.931367 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e3c3ef08-123e-4996-a335-be12a3e29e1b tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:04.932162 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e3c3ef08-123e-4996-a335-be12a3e29e1b tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:04.932789 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e3c3ef08-123e-4996-a335-be12a3e29e1b tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:04.933906 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e3c3ef08-123e-4996-a335-be12a3e29e1b tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:04.934710 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e3c3ef08-123e-4996-a335-be12a3e29e1b tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:04.935322 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e3c3ef08-123e-4996-a335-be12a3e29e1b tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:04.972820 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-7b265612-897e-425a-b6c6-6fd1c97bf077 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:54:04.988729 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-7b265612-897e-425a-b6c6-6fd1c97bf077 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:54:04.991695 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-7b265612-897e-425a-b6c6-6fd1c97bf077 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:54:04.996433 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-7b265612-897e-425a-b6c6-6fd1c97bf077 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] 10.222.0.18 "GET /compute/v2.1/servers/f499ce97-cdf8-4dcf-9c28-3758aea5e78c" status: 200 len: 1279 microversion: 2.25 time: 0.676513 Oct 22 20:54:04.999959 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 716/1349] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 20:54:04 2022] GET /compute/v2.1/servers/f499ce97-cdf8-4dcf-9c28-3758aea5e78c => generated 1279 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 20:54:05.015685 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-7f78d58c-8100-42af-9b1b-a478093be6db tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:54:05.018868 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-7f78d58c-8100-42af-9b1b-a478093be6db tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] [instance: f2f50f6b-6a3e-449f-836e-bd897f78279c] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:54:05.037883 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7f78d58c-8100-42af-9b1b-a478093be6db tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:05.038372 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7f78d58c-8100-42af-9b1b-a478093be6db tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:05.038811 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7f78d58c-8100-42af-9b1b-a478093be6db tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:05.044221 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7f78d58c-8100-42af-9b1b-a478093be6db tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:05.044775 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7f78d58c-8100-42af-9b1b-a478093be6db tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:05.046002 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7f78d58c-8100-42af-9b1b-a478093be6db tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:05.093069 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-e3c3ef08-123e-4996-a335-be12a3e29e1b tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d3d7458af447bdb3f03e83a2d8559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49238b8686d24ae698679e4a1957735d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:54:05.110332 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-e3c3ef08-123e-4996-a335-be12a3e29e1b tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] 10.222.0.18 "GET /compute/v2.1/servers/40e6c6e3-3d47-4781-b8a8-aafd671d7287" status: 200 len: 1265 microversion: 2.1 time: 0.194293 Oct 22 20:54:05.111629 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 634/1350] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:54:04 2022] GET /compute/v2.1/servers/40e6c6e3-3d47-4781-b8a8-aafd671d7287 => generated 1265 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:54:05.120672 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-4cf2ad8a-fbd1-4c7b-8382-43d1e1088c72 tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:54:05.122859 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-4cf2ad8a-fbd1-4c7b-8382-43d1e1088c72 tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] [instance: 8f2e1da0-4586-460b-94dc-768fd618dc3d] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:54:05.138753 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4cf2ad8a-fbd1-4c7b-8382-43d1e1088c72 tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:05.139248 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4cf2ad8a-fbd1-4c7b-8382-43d1e1088c72 tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:05.139717 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4cf2ad8a-fbd1-4c7b-8382-43d1e1088c72 tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:05.140434 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4cf2ad8a-fbd1-4c7b-8382-43d1e1088c72 tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:05.140885 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4cf2ad8a-fbd1-4c7b-8382-43d1e1088c72 tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:05.141920 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4cf2ad8a-fbd1-4c7b-8382-43d1e1088c72 tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:05.472715 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-7f78d58c-8100-42af-9b1b-a478093be6db tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7f48d18691d4473bbe0284c44f14d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bacf9909082440f8a201771b64a75fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:54:05.483140 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-7f78d58c-8100-42af-9b1b-a478093be6db tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] 10.222.0.18 "GET /compute/v2.1/servers/f2f50f6b-6a3e-449f-836e-bd897f78279c" status: 200 len: 1655 microversion: 2.1 time: 0.479940 Oct 22 20:54:05.519291 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 717/1351] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:54:05 2022] GET /compute/v2.1/servers/f2f50f6b-6a3e-449f-836e-bd897f78279c => generated 1655 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:54:05.520503 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-4cf2ad8a-fbd1-4c7b-8382-43d1e1088c72 tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/8f2e1da0-4586-460b-94dc-768fd618dc3d" status: 200 len: 1856 microversion: 2.1 time: 0.407146 Oct 22 20:54:05.522635 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 635/1352] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:54:05 2022] GET /compute/v2.1/servers/8f2e1da0-4586-460b-94dc-768fd618dc3d => generated 1856 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:54:05.547868 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-6c47dd2b-41ec-4f93-a74f-856dda6583df tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch2-master-1", "block_migration": true, "disk_over_commit": false}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:54:05.551087 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-6c47dd2b-41ec-4f93-a74f-856dda6583df tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] [instance: 8f2e1da0-4586-460b-94dc-768fd618dc3d] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:54:05.573579 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-49eeec04-f7cc-4353-ae67-72ff4fe93fd3 req-7bbb56f3-20c9-46bc-9c29-a9e14d63a5ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2f50f6b-6a3e-449f-836e-bd897f78279c", "name": "network-vif-deleted", "tag": "16c272f7-7571-4436-bc1e-a2535cce8300"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:54:05.582047 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6c47dd2b-41ec-4f93-a74f-856dda6583df tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:05.582555 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6c47dd2b-41ec-4f93-a74f-856dda6583df tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:05.585833 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6c47dd2b-41ec-4f93-a74f-856dda6583df tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:05.587313 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6c47dd2b-41ec-4f93-a74f-856dda6583df tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:05.588430 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6c47dd2b-41ec-4f93-a74f-856dda6583df tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:05.590291 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6c47dd2b-41ec-4f93-a74f-856dda6583df tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:05.600501 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-49eeec04-f7cc-4353-ae67-72ff4fe93fd3 req-7bbb56f3-20c9-46bc-9c29-a9e14d63a5ad service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:05.609824 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-49eeec04-f7cc-4353-ae67-72ff4fe93fd3 req-7bbb56f3-20c9-46bc-9c29-a9e14d63a5ad service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:05.610921 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-49eeec04-f7cc-4353-ae67-72ff4fe93fd3 req-7bbb56f3-20c9-46bc-9c29-a9e14d63a5ad service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:05.661697 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-49eeec04-f7cc-4353-ae67-72ff4fe93fd3 req-7bbb56f3-20c9-46bc-9c29-a9e14d63a5ad service nova] Creating event network-vif-deleted:16c272f7-7571-4436-bc1e-a2535cce8300 for instance f2f50f6b-6a3e-449f-836e-bd897f78279c on nch2-master-1 Oct 22 20:54:05.686708 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-49eeec04-f7cc-4353-ae67-72ff4fe93fd3 req-7bbb56f3-20c9-46bc-9c29-a9e14d63a5ad service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116993 Oct 22 20:54:05.687466 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 636/1353] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:54:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:54:05.694076 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.objects.instance [None req-6c47dd2b-41ec-4f93-a74f-856dda6583df tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] Lazy-loading 'flavor' on Instance uuid 8f2e1da0-4586-460b-94dc-768fd618dc3d {{(pid=138745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 20:54:05.731112 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-6c47dd2b-41ec-4f93-a74f-856dda6583df tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] [instance: 8f2e1da0-4586-460b-94dc-768fd618dc3d] Going to try to live migrate instance to nch2-master-1 {{(pid=138745) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 22 20:54:05.801561 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-8f619c67-6801-4bb0-8f0a-575d3c823680 tempest-InstanceActionsV221TestJSON-976463296 tempest-InstanceActionsV221TestJSON-976463296-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:54:05.803128 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-8f619c67-6801-4bb0-8f0a-575d3c823680 tempest-InstanceActionsV221TestJSON-976463296 tempest-InstanceActionsV221TestJSON-976463296-project] [instance: 304975d8-d62e-4156-9697-09c3a9724371] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:54:05.813842 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8f619c67-6801-4bb0-8f0a-575d3c823680 tempest-InstanceActionsV221TestJSON-976463296 tempest-InstanceActionsV221TestJSON-976463296-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:05.817203 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8f619c67-6801-4bb0-8f0a-575d3c823680 tempest-InstanceActionsV221TestJSON-976463296 tempest-InstanceActionsV221TestJSON-976463296-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:05.818017 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8f619c67-6801-4bb0-8f0a-575d3c823680 tempest-InstanceActionsV221TestJSON-976463296 tempest-InstanceActionsV221TestJSON-976463296-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:05.820804 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8f619c67-6801-4bb0-8f0a-575d3c823680 tempest-InstanceActionsV221TestJSON-976463296 tempest-InstanceActionsV221TestJSON-976463296-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:05.823873 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8f619c67-6801-4bb0-8f0a-575d3c823680 tempest-InstanceActionsV221TestJSON-976463296 tempest-InstanceActionsV221TestJSON-976463296-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:05.824667 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8f619c67-6801-4bb0-8f0a-575d3c823680 tempest-InstanceActionsV221TestJSON-976463296 tempest-InstanceActionsV221TestJSON-976463296-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:05.867884 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:54:06.452201 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-8f619c67-6801-4bb0-8f0a-575d3c823680 tempest-InstanceActionsV221TestJSON-976463296 tempest-InstanceActionsV221TestJSON-976463296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13c3673ebe14b7e997ec664499b9e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f7808ed44e84de4a1574e8aacd71c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:54:06.467083 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-8f619c67-6801-4bb0-8f0a-575d3c823680 tempest-InstanceActionsV221TestJSON-976463296 tempest-InstanceActionsV221TestJSON-976463296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e13c3673ebe14b7e997ec664499b9e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f7808ed44e84de4a1574e8aacd71c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:54:06.472330 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-8f619c67-6801-4bb0-8f0a-575d3c823680 tempest-InstanceActionsV221TestJSON-976463296 tempest-InstanceActionsV221TestJSON-976463296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e13c3673ebe14b7e997ec664499b9e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f7808ed44e84de4a1574e8aacd71c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:54:06.485171 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-8f619c67-6801-4bb0-8f0a-575d3c823680 tempest-InstanceActionsV221TestJSON-976463296 tempest-InstanceActionsV221TestJSON-976463296-project] 10.222.0.18 "GET /compute/v2.1/servers/304975d8-d62e-4156-9697-09c3a9724371" status: 200 len: 1553 microversion: 2.21 time: 0.678790 Oct 22 20:54:06.489335 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 637/1354] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 20:54:05 2022] GET /compute/v2.1/servers/304975d8-d62e-4156-9697-09c3a9724371 => generated 1553 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 20:54:06.503890 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-f9ec9f90-5e84-4e67-8e3d-30be5c08ea29 tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Calling method '.version_select at 0x7fd3a41e3a60>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:54:06.602401 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-f9ec9f90-5e84-4e67-8e3d-30be5c08ea29 tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] 10.222.0.18 "GET /compute/v2.1/images/2c26b155-ef26-40a2-b7db-1b550c12a2cf" status: 200 len: 1429 microversion: 2.1 time: 0.109222 Oct 22 20:54:06.603959 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 638/1355] 10.222.0.18 () {58 vars in 1233 bytes} [Sat Oct 22 20:54:06 2022] GET /compute/v2.1/images/2c26b155-ef26-40a2-b7db-1b550c12a2cf => generated 1429 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:54:06.623773 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-56d10663-53b4-4e92-9790-eeb32b5fa477 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:54:06.625906 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-56d10663-53b4-4e92-9790-eeb32b5fa477 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] [instance: f499ce97-cdf8-4dcf-9c28-3758aea5e78c] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:54:06.630945 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell0:SELECT=8 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:54:06.647565 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-56d10663-53b4-4e92-9790-eeb32b5fa477 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:06.654610 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-56d10663-53b4-4e92-9790-eeb32b5fa477 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:06.661656 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-56d10663-53b4-4e92-9790-eeb32b5fa477 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:06.666548 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-56d10663-53b4-4e92-9790-eeb32b5fa477 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:06.671908 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-56d10663-53b4-4e92-9790-eeb32b5fa477 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:06.675533 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-56d10663-53b4-4e92-9790-eeb32b5fa477 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:07.465311 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-56d10663-53b4-4e92-9790-eeb32b5fa477 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:54:07.479628 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-56d10663-53b4-4e92-9790-eeb32b5fa477 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:54:07.483981 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-56d10663-53b4-4e92-9790-eeb32b5fa477 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:54:07.486099 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-56d10663-53b4-4e92-9790-eeb32b5fa477 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] 10.222.0.18 "GET /compute/v2.1/servers/f499ce97-cdf8-4dcf-9c28-3758aea5e78c" status: 200 len: 1279 microversion: 2.25 time: 0.871847 Oct 22 20:54:07.488684 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 639/1356] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 20:54:06 2022] GET /compute/v2.1/servers/f499ce97-cdf8-4dcf-9c28-3758aea5e78c => generated 1279 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 20:54:07.502083 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-edafe8fb-2aa6-4925-84b0-4cd424a3ec62 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:54:07.502806 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-edafe8fb-2aa6-4925-84b0-4cd424a3ec62 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] [instance: 40e6c6e3-3d47-4781-b8a8-aafd671d7287] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:54:07.516983 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-edafe8fb-2aa6-4925-84b0-4cd424a3ec62 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:07.517493 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-edafe8fb-2aa6-4925-84b0-4cd424a3ec62 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:07.517945 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-edafe8fb-2aa6-4925-84b0-4cd424a3ec62 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:07.518683 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-edafe8fb-2aa6-4925-84b0-4cd424a3ec62 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:07.519146 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-edafe8fb-2aa6-4925-84b0-4cd424a3ec62 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:07.524829 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-edafe8fb-2aa6-4925-84b0-4cd424a3ec62 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:07.797593 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-edafe8fb-2aa6-4925-84b0-4cd424a3ec62 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d3d7458af447bdb3f03e83a2d8559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49238b8686d24ae698679e4a1957735d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:54:07.812291 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-edafe8fb-2aa6-4925-84b0-4cd424a3ec62 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] 10.222.0.18 "GET /compute/v2.1/servers/40e6c6e3-3d47-4781-b8a8-aafd671d7287" status: 200 len: 1271 microversion: 2.1 time: 0.320665 Oct 22 20:54:07.816446 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 640/1357] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:54:07 2022] GET /compute/v2.1/servers/40e6c6e3-3d47-4781-b8a8-aafd671d7287 => generated 1271 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:54:07.825248 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-8098b2b7-4094-482e-a793-bea9e994b69a tempest-InstanceActionsV221TestJSON-976463296 tempest-InstanceActionsV221TestJSON-976463296-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:54:07.827700 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-8098b2b7-4094-482e-a793-bea9e994b69a tempest-InstanceActionsV221TestJSON-976463296 tempest-InstanceActionsV221TestJSON-976463296-project] [instance: 304975d8-d62e-4156-9697-09c3a9724371] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:54:07.847214 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8098b2b7-4094-482e-a793-bea9e994b69a tempest-InstanceActionsV221TestJSON-976463296 tempest-InstanceActionsV221TestJSON-976463296-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:07.848013 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8098b2b7-4094-482e-a793-bea9e994b69a tempest-InstanceActionsV221TestJSON-976463296 tempest-InstanceActionsV221TestJSON-976463296-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:07.848697 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8098b2b7-4094-482e-a793-bea9e994b69a tempest-InstanceActionsV221TestJSON-976463296 tempest-InstanceActionsV221TestJSON-976463296-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:07.850107 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8098b2b7-4094-482e-a793-bea9e994b69a tempest-InstanceActionsV221TestJSON-976463296 tempest-InstanceActionsV221TestJSON-976463296-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:07.850815 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8098b2b7-4094-482e-a793-bea9e994b69a tempest-InstanceActionsV221TestJSON-976463296 tempest-InstanceActionsV221TestJSON-976463296-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:07.851785 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8098b2b7-4094-482e-a793-bea9e994b69a tempest-InstanceActionsV221TestJSON-976463296 tempest-InstanceActionsV221TestJSON-976463296-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:07.889210 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-8098b2b7-4094-482e-a793-bea9e994b69a tempest-InstanceActionsV221TestJSON-976463296 tempest-InstanceActionsV221TestJSON-976463296-project] [instance: 304975d8-d62e-4156-9697-09c3a9724371] Going to try to terminate instance {{(pid=138744) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 20:54:07.982560 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:54:08.059561 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-8098b2b7-4094-482e-a793-bea9e994b69a tempest-InstanceActionsV221TestJSON-976463296 tempest-InstanceActionsV221TestJSON-976463296-project] 10.222.0.18 "DELETE /compute/v2.1/servers/304975d8-d62e-4156-9697-09c3a9724371" status: 204 len: 0 microversion: 2.21 time: 0.240776 Oct 22 20:54:08.061180 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 641/1358] 10.222.0.18 () {60 vars in 1280 bytes} [Sat Oct 22 20:54:07 2022] DELETE /compute/v2.1/servers/304975d8-d62e-4156-9697-09c3a9724371 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 22 20:54:08.075554 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-1919e6ed-d003-43c0-96c5-233dcb7796a3 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:54:08.076669 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-1919e6ed-d003-43c0-96c5-233dcb7796a3 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] [instance: f2f50f6b-6a3e-449f-836e-bd897f78279c] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:54:08.087106 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1919e6ed-d003-43c0-96c5-233dcb7796a3 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:08.087959 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1919e6ed-d003-43c0-96c5-233dcb7796a3 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:08.088682 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1919e6ed-d003-43c0-96c5-233dcb7796a3 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:08.089698 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1919e6ed-d003-43c0-96c5-233dcb7796a3 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:08.090354 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1919e6ed-d003-43c0-96c5-233dcb7796a3 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:08.091045 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1919e6ed-d003-43c0-96c5-233dcb7796a3 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:08.114340 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-1919e6ed-d003-43c0-96c5-233dcb7796a3 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] HTTP exception thrown: Instance f2f50f6b-6a3e-449f-836e-bd897f78279c could not be found. Oct 22 20:54:08.117924 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-1919e6ed-d003-43c0-96c5-233dcb7796a3 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Request method failure captured: Oct 22 20:54:08.117924 ncdv-master-1 devstack@n-api.service[138744]: request: GET /compute/v2.1/servers/f2f50f6b-6a3e-449f-836e-bd897f78279c HTTP/1.1 Oct 22 20:54:08.117924 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 20:54:08.117924 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 20:54:08.117924 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 20:54:08.117924 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 0 Oct 22 20:54:08.117924 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 20:54:08.117924 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 20:54:08.117924 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 20:54:08.117924 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 20:54:08.117924 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVFgxbjSpGJnDbAWtrhnhC3ohqhWL21P8V9oDjyt8Cp6-mNYigmWbnwACLhgZ0m-_WayZUZqCvLsIuxozONgEQsFKqbQFe3bHeuZuSmUq3cgCyl657QToCeJnxSAksP09Z2EUvKIoF_d3xV0V1EMSYGQaEwV-nD-C00mu8qSleDqsp7Y Oct 22 20:54:08.117924 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 20:54:08.117924 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 20:54:08.117924 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 20:54:08.117924 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 20:54:08.117924 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 20:54:08.117924 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 20:54:08.117924 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: 6bacf9909082440f8a201771b64a75fa Oct 22 20:54:08.117924 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-ServersTestMultiNic-712697786 Oct 22 20:54:08.117924 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 20:54:08.117924 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 20:54:08.117924 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_6bacf9909082440f8a201771b64a75fa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6bacf9909082440f8a201771b64a75fa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/6bacf9909082440f8a201771b64a75fa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6bacf9909082440f8a201771b64a75fa"}]}] Oct 22 20:54:08.117924 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-ServersTestMultiNic-712697786 Oct 22 20:54:08.117924 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: 6bacf9909082440f8a201771b64a75fa Oct 22 20:54:08.117924 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-ServersTestMultiNic-712697786 Oct 22 20:54:08.117924 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-ServersTestMultiNic-712697786-project Oct 22 20:54:08.117924 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 20:54:08.117924 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 20:54:08.117924 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: c7f48d18691d4473bbe0284c44f14d09 Oct 22 20:54:08.117924 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-ServersTestMultiNic-712697786-project Oct 22 20:54:08.117924 ncdv-master-1 devstack@n-api.service[138744]: method: > Oct 22 20:54:08.117924 ncdv-master-1 devstack@n-api.service[138744]: exception: Instance f2f50f6b-6a3e-449f-836e-bd897f78279c could not be found. Oct 22 20:54:08.117924 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': 'f2f50f6b-6a3e-449f-836e-bd897f78279c'} Oct 22 20:54:08.117924 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:54:08.117924 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:54:08.117924 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 20:54:08.117924 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 20:54:08.117924 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 20:54:08.117924 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 20:54:08.117924 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 20:54:08.117924 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 20:54:08.117924 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 20:54:08.117924 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 20:54:08.117924 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f2f50f6b-6a3e-449f-836e-bd897f78279c could not be found. Oct 22 20:54:08.117924 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:54:08.117924 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:54:08.117924 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:54:08.117924 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:54:08.117924 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:54:08.117924 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:54:08.117924 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:54:08.117924 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:54:08.117924 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:54:08.117924 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:54:08.117924 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 20:54:08.117924 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 20:54:08.117924 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 20:54:08.117924 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 20:54:08.117924 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 20:54:08.117924 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 20:54:08.117924 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2f50f6b-6a3e-449f-836e-bd897f78279c could not be found. Oct 22 20:54:08.117924 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:54:08.117924 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:54:08.117924 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:54:08.124133 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:54:08.124133 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:54:08.124133 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:54:08.124133 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 20:54:08.124133 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 20:54:08.124133 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2f50f6b-6a3e-449f-836e-bd897f78279c could not be found. Oct 22 20:54:08.124133 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:54:08.125511 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-1919e6ed-d003-43c0-96c5-233dcb7796a3 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Returning 404 to user: Instance f2f50f6b-6a3e-449f-836e-bd897f78279c could not be found. {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:54:08.128648 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-1919e6ed-d003-43c0-96c5-233dcb7796a3 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] 10.222.0.18 "GET /compute/v2.1/servers/f2f50f6b-6a3e-449f-836e-bd897f78279c" status: 404 len: 111 microversion: 2.1 time: 0.062321 Oct 22 20:54:08.131562 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 642/1359] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:54:08 2022] GET /compute/v2.1/servers/f2f50f6b-6a3e-449f-836e-bd897f78279c => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 20:54:08.140559 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-1e603028-3618-424a-a5a8-405ed3a7d340 tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Calling method '.version_select at 0x7fd3a41e3310>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:54:08.225711 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-1e603028-3618-424a-a5a8-405ed3a7d340 tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] 10.222.0.18 "GET /compute/v2.1/images/2c26b155-ef26-40a2-b7db-1b550c12a2cf" status: 200 len: 1429 microversion: 2.1 time: 0.092803 Oct 22 20:54:08.234519 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 643/1360] 10.222.0.18 () {58 vars in 1233 bytes} [Sat Oct 22 20:54:08 2022] GET /compute/v2.1/images/2c26b155-ef26-40a2-b7db-1b550c12a2cf => generated 1429 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:54:08.238241 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-36c64741-b914-4e91-8807-db7d8c7e5e4b req-2b3fa574-4585-4d1e-abfb-03bb126d8e1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2f50f6b-6a3e-449f-836e-bd897f78279c", "name": "network-vif-deleted", "tag": "8be47bf4-2a35-45fb-93e7-e1ccf22b8551"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:54:08.261602 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-36c64741-b914-4e91-8807-db7d8c7e5e4b req-2b3fa574-4585-4d1e-abfb-03bb126d8e1e service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:08.262102 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-36c64741-b914-4e91-8807-db7d8c7e5e4b req-2b3fa574-4585-4d1e-abfb-03bb126d8e1e service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:08.262545 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-36c64741-b914-4e91-8807-db7d8c7e5e4b req-2b3fa574-4585-4d1e-abfb-03bb126d8e1e service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:08.293379 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-36c64741-b914-4e91-8807-db7d8c7e5e4b req-2b3fa574-4585-4d1e-abfb-03bb126d8e1e service nova] Creating event network-vif-deleted:8be47bf4-2a35-45fb-93e7-e1ccf22b8551 for instance f2f50f6b-6a3e-449f-836e-bd897f78279c on nch2-master-1 Oct 22 20:54:08.305932 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-36c64741-b914-4e91-8807-db7d8c7e5e4b req-2b3fa574-4585-4d1e-abfb-03bb126d8e1e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076436 Oct 22 20:54:08.306263 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 644/1361] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:54:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:54:08.311986 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-d54ddff5-d6b7-497d-abd4-259ae898154d tempest-InstanceActionsV221TestJSON-976463296 tempest-InstanceActionsV221TestJSON-976463296-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:54:08.312700 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-d54ddff5-d6b7-497d-abd4-259ae898154d tempest-InstanceActionsV221TestJSON-976463296 tempest-InstanceActionsV221TestJSON-976463296-project] [instance: 304975d8-d62e-4156-9697-09c3a9724371] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:54:08.330678 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d54ddff5-d6b7-497d-abd4-259ae898154d tempest-InstanceActionsV221TestJSON-976463296 tempest-InstanceActionsV221TestJSON-976463296-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:08.336995 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d54ddff5-d6b7-497d-abd4-259ae898154d tempest-InstanceActionsV221TestJSON-976463296 tempest-InstanceActionsV221TestJSON-976463296-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:08.337777 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d54ddff5-d6b7-497d-abd4-259ae898154d tempest-InstanceActionsV221TestJSON-976463296 tempest-InstanceActionsV221TestJSON-976463296-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:08.338760 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d54ddff5-d6b7-497d-abd4-259ae898154d tempest-InstanceActionsV221TestJSON-976463296 tempest-InstanceActionsV221TestJSON-976463296-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:08.339447 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d54ddff5-d6b7-497d-abd4-259ae898154d tempest-InstanceActionsV221TestJSON-976463296 tempest-InstanceActionsV221TestJSON-976463296-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:08.340093 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d54ddff5-d6b7-497d-abd4-259ae898154d tempest-InstanceActionsV221TestJSON-976463296 tempest-InstanceActionsV221TestJSON-976463296-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:08.445957 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-6c47dd2b-41ec-4f93-a74f-856dda6583df tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] 10.222.0.18 "POST /compute/v2.1/servers/8f2e1da0-4586-460b-94dc-768fd618dc3d/action" status: 202 len: 0 microversion: 2.1 time: 2.902282 Oct 22 20:54:08.450112 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 718/1362] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 20:54:05 2022] POST /compute/v2.1/servers/8f2e1da0-4586-460b-94dc-768fd618dc3d/action => generated 0 bytes in 2907 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 20:54:08.457650 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-3aecd20b-53a7-4861-a8c0-dcb2a1753ee0 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:54:08.460235 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-3aecd20b-53a7-4861-a8c0-dcb2a1753ee0 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] [instance: 8f2e1da0-4586-460b-94dc-768fd618dc3d] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:54:08.488487 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3aecd20b-53a7-4861-a8c0-dcb2a1753ee0 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:08.489646 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3aecd20b-53a7-4861-a8c0-dcb2a1753ee0 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:08.490388 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3aecd20b-53a7-4861-a8c0-dcb2a1753ee0 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:08.491394 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3aecd20b-53a7-4861-a8c0-dcb2a1753ee0 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:08.492256 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3aecd20b-53a7-4861-a8c0-dcb2a1753ee0 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:08.493186 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3aecd20b-53a7-4861-a8c0-dcb2a1753ee0 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:09.619998 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-d54ddff5-d6b7-497d-abd4-259ae898154d tempest-InstanceActionsV221TestJSON-976463296 tempest-InstanceActionsV221TestJSON-976463296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13c3673ebe14b7e997ec664499b9e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f7808ed44e84de4a1574e8aacd71c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:54:09.629817 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-d54ddff5-d6b7-497d-abd4-259ae898154d tempest-InstanceActionsV221TestJSON-976463296 tempest-InstanceActionsV221TestJSON-976463296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e13c3673ebe14b7e997ec664499b9e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f7808ed44e84de4a1574e8aacd71c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:54:09.637354 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-d54ddff5-d6b7-497d-abd4-259ae898154d tempest-InstanceActionsV221TestJSON-976463296 tempest-InstanceActionsV221TestJSON-976463296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e13c3673ebe14b7e997ec664499b9e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f7808ed44e84de4a1574e8aacd71c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:54:09.638986 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-d54ddff5-d6b7-497d-abd4-259ae898154d tempest-InstanceActionsV221TestJSON-976463296 tempest-InstanceActionsV221TestJSON-976463296-project] 10.222.0.18 "GET /compute/v2.1/servers/304975d8-d62e-4156-9697-09c3a9724371" status: 200 len: 1559 microversion: 2.21 time: 1.331427 Oct 22 20:54:09.643166 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 645/1363] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 20:54:08 2022] GET /compute/v2.1/servers/304975d8-d62e-4156-9697-09c3a9724371 => generated 1559 bytes in 1335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 20:54:09.648578 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-c6efa96b-d3be-4e5b-add3-4039b5cc5bd1 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:54:09.657963 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-c6efa96b-d3be-4e5b-add3-4039b5cc5bd1 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] [instance: f499ce97-cdf8-4dcf-9c28-3758aea5e78c] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:54:09.675119 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c6efa96b-d3be-4e5b-add3-4039b5cc5bd1 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:09.676068 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c6efa96b-d3be-4e5b-add3-4039b5cc5bd1 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:09.676757 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c6efa96b-d3be-4e5b-add3-4039b5cc5bd1 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:09.677855 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c6efa96b-d3be-4e5b-add3-4039b5cc5bd1 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:09.678590 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c6efa96b-d3be-4e5b-add3-4039b5cc5bd1 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:09.679251 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c6efa96b-d3be-4e5b-add3-4039b5cc5bd1 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:10.316581 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-3aecd20b-53a7-4861-a8c0-dcb2a1753ee0 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c87f0356ca346f39c6216393d85da2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee8c8f7fc4e12bc1f9fcce3e7b581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:54:10.336843 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-3aecd20b-53a7-4861-a8c0-dcb2a1753ee0 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] 10.222.0.18 "GET /compute/v2.1/servers/8f2e1da0-4586-460b-94dc-768fd618dc3d" status: 200 len: 1715 microversion: 2.1 time: 1.885113 Oct 22 20:54:10.352286 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 719/1364] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:54:08 2022] GET /compute/v2.1/servers/8f2e1da0-4586-460b-94dc-768fd618dc3d => generated 1715 bytes in 1901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:54:10.367870 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-f7d184d4-797e-4950-89d5-c5b3df93b133 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:54:10.368689 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-f7d184d4-797e-4950-89d5-c5b3df93b133 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] [instance: 40e6c6e3-3d47-4781-b8a8-aafd671d7287] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:54:10.389616 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f7d184d4-797e-4950-89d5-c5b3df93b133 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:10.390128 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f7d184d4-797e-4950-89d5-c5b3df93b133 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:10.390584 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f7d184d4-797e-4950-89d5-c5b3df93b133 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:10.391320 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f7d184d4-797e-4950-89d5-c5b3df93b133 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:10.401028 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f7d184d4-797e-4950-89d5-c5b3df93b133 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:10.401795 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f7d184d4-797e-4950-89d5-c5b3df93b133 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:11.009024 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-c6efa96b-d3be-4e5b-add3-4039b5cc5bd1 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:54:11.031331 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-c6efa96b-d3be-4e5b-add3-4039b5cc5bd1 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:54:11.038926 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-c6efa96b-d3be-4e5b-add3-4039b5cc5bd1 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:54:11.046791 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-c6efa96b-d3be-4e5b-add3-4039b5cc5bd1 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] 10.222.0.18 "GET /compute/v2.1/servers/f499ce97-cdf8-4dcf-9c28-3758aea5e78c" status: 200 len: 1279 microversion: 2.25 time: 1.400579 Oct 22 20:54:11.047436 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 646/1365] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 20:54:09 2022] GET /compute/v2.1/servers/f499ce97-cdf8-4dcf-9c28-3758aea5e78c => generated 1279 bytes in 1403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 20:54:11.071134 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-a3a58688-f502-418d-98bb-5a135fdecb5a tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Calling method '.version_select at 0x7fd3a4238940>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:54:11.203020 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-a3a58688-f502-418d-98bb-5a135fdecb5a tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] 10.222.0.18 "GET /compute/v2.1/images/2c26b155-ef26-40a2-b7db-1b550c12a2cf" status: 200 len: 1429 microversion: 2.1 time: 0.151831 Oct 22 20:54:11.204298 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 647/1366] 10.222.0.18 () {58 vars in 1233 bytes} [Sat Oct 22 20:54:11 2022] GET /compute/v2.1/images/2c26b155-ef26-40a2-b7db-1b550c12a2cf => generated 1429 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:54:11.224870 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-a06e5afb-b310-4422-abd0-e3a9b62c9d7a tempest-InstanceActionsV221TestJSON-976463296 tempest-InstanceActionsV221TestJSON-976463296-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:54:11.225976 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-a06e5afb-b310-4422-abd0-e3a9b62c9d7a tempest-InstanceActionsV221TestJSON-976463296 tempest-InstanceActionsV221TestJSON-976463296-project] [instance: 304975d8-d62e-4156-9697-09c3a9724371] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:54:11.252519 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a06e5afb-b310-4422-abd0-e3a9b62c9d7a tempest-InstanceActionsV221TestJSON-976463296 tempest-InstanceActionsV221TestJSON-976463296-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:11.253783 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a06e5afb-b310-4422-abd0-e3a9b62c9d7a tempest-InstanceActionsV221TestJSON-976463296 tempest-InstanceActionsV221TestJSON-976463296-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:11.256044 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a06e5afb-b310-4422-abd0-e3a9b62c9d7a tempest-InstanceActionsV221TestJSON-976463296 tempest-InstanceActionsV221TestJSON-976463296-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:11.260086 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a06e5afb-b310-4422-abd0-e3a9b62c9d7a tempest-InstanceActionsV221TestJSON-976463296 tempest-InstanceActionsV221TestJSON-976463296-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:11.260817 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a06e5afb-b310-4422-abd0-e3a9b62c9d7a tempest-InstanceActionsV221TestJSON-976463296 tempest-InstanceActionsV221TestJSON-976463296-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:11.261474 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a06e5afb-b310-4422-abd0-e3a9b62c9d7a tempest-InstanceActionsV221TestJSON-976463296 tempest-InstanceActionsV221TestJSON-976463296-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:11.616290 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-a06e5afb-b310-4422-abd0-e3a9b62c9d7a tempest-InstanceActionsV221TestJSON-976463296 tempest-InstanceActionsV221TestJSON-976463296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13c3673ebe14b7e997ec664499b9e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f7808ed44e84de4a1574e8aacd71c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:54:11.639103 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-a06e5afb-b310-4422-abd0-e3a9b62c9d7a tempest-InstanceActionsV221TestJSON-976463296 tempest-InstanceActionsV221TestJSON-976463296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e13c3673ebe14b7e997ec664499b9e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f7808ed44e84de4a1574e8aacd71c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:54:11.647821 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-a06e5afb-b310-4422-abd0-e3a9b62c9d7a tempest-InstanceActionsV221TestJSON-976463296 tempest-InstanceActionsV221TestJSON-976463296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e13c3673ebe14b7e997ec664499b9e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f7808ed44e84de4a1574e8aacd71c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:54:11.658444 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-a06e5afb-b310-4422-abd0-e3a9b62c9d7a tempest-InstanceActionsV221TestJSON-976463296 tempest-InstanceActionsV221TestJSON-976463296-project] 10.222.0.18 "GET /compute/v2.1/servers/304975d8-d62e-4156-9697-09c3a9724371" status: 200 len: 1344 microversion: 2.21 time: 0.448809 Oct 22 20:54:11.667648 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 648/1367] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 20:54:11 2022] GET /compute/v2.1/servers/304975d8-d62e-4156-9697-09c3a9724371 => generated 1344 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 20:54:11.693494 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-6915bfb7-2fc0-4e85-a200-0f5b98e693a7 req-57abe215-8c6f-4dc7-8434-8ce8e87b0996 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "304975d8-d62e-4156-9697-09c3a9724371", "name": "network-vif-deleted", "tag": "75b0deee-22d9-412a-9096-15c6aafa06da"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:54:11.747997 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-6915bfb7-2fc0-4e85-a200-0f5b98e693a7 req-57abe215-8c6f-4dc7-8434-8ce8e87b0996 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:11.749772 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-6915bfb7-2fc0-4e85-a200-0f5b98e693a7 req-57abe215-8c6f-4dc7-8434-8ce8e87b0996 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:11.750719 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-6915bfb7-2fc0-4e85-a200-0f5b98e693a7 req-57abe215-8c6f-4dc7-8434-8ce8e87b0996 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:11.780966 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-f7d184d4-797e-4950-89d5-c5b3df93b133 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d3d7458af447bdb3f03e83a2d8559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49238b8686d24ae698679e4a1957735d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:54:11.794876 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-f7d184d4-797e-4950-89d5-c5b3df93b133 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] 10.222.0.18 "GET /compute/v2.1/servers/40e6c6e3-3d47-4781-b8a8-aafd671d7287" status: 200 len: 1313 microversion: 2.1 time: 1.440703 Oct 22 20:54:11.810900 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-6915bfb7-2fc0-4e85-a200-0f5b98e693a7 req-57abe215-8c6f-4dc7-8434-8ce8e87b0996 service nova] Creating event network-vif-deleted:75b0deee-22d9-412a-9096-15c6aafa06da for instance 304975d8-d62e-4156-9697-09c3a9724371 on nch2-master-1 Oct 22 20:54:11.813806 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 720/1368] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:54:10 2022] GET /compute/v2.1/servers/40e6c6e3-3d47-4781-b8a8-aafd671d7287 => generated 1313 bytes in 1461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:54:11.828894 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-6915bfb7-2fc0-4e85-a200-0f5b98e693a7 req-57abe215-8c6f-4dc7-8434-8ce8e87b0996 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.159631 Oct 22 20:54:11.830002 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 649/1369] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:54:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:54:11.836659 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-202a8370-72fb-4e54-8af4-79dcc29b3a9b tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:54:11.846072 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-202a8370-72fb-4e54-8af4-79dcc29b3a9b tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] [instance: 8f2e1da0-4586-460b-94dc-768fd618dc3d] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:54:11.858703 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-202a8370-72fb-4e54-8af4-79dcc29b3a9b tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:11.871244 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-202a8370-72fb-4e54-8af4-79dcc29b3a9b tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:11.871995 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-202a8370-72fb-4e54-8af4-79dcc29b3a9b tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:11.872939 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-202a8370-72fb-4e54-8af4-79dcc29b3a9b tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:11.873557 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-202a8370-72fb-4e54-8af4-79dcc29b3a9b tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:11.874157 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-202a8370-72fb-4e54-8af4-79dcc29b3a9b tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:12.076460 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-f6dfee40-abb8-4998-a299-df9f0f9221b6 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:54:12.078040 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-f6dfee40-abb8-4998-a299-df9f0f9221b6 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] [instance: f499ce97-cdf8-4dcf-9c28-3758aea5e78c] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:54:12.091201 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f6dfee40-abb8-4998-a299-df9f0f9221b6 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:12.095691 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f6dfee40-abb8-4998-a299-df9f0f9221b6 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:12.096263 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f6dfee40-abb8-4998-a299-df9f0f9221b6 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:12.097041 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f6dfee40-abb8-4998-a299-df9f0f9221b6 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:12.097508 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f6dfee40-abb8-4998-a299-df9f0f9221b6 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:12.098113 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f6dfee40-abb8-4998-a299-df9f0f9221b6 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:12.517724 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-202a8370-72fb-4e54-8af4-79dcc29b3a9b tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c87f0356ca346f39c6216393d85da2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee8c8f7fc4e12bc1f9fcce3e7b581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:54:12.532563 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-202a8370-72fb-4e54-8af4-79dcc29b3a9b tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] 10.222.0.18 "GET /compute/v2.1/servers/8f2e1da0-4586-460b-94dc-768fd618dc3d" status: 200 len: 1715 microversion: 2.1 time: 0.699941 Oct 22 20:54:12.535494 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 721/1370] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:54:11 2022] GET /compute/v2.1/servers/8f2e1da0-4586-460b-94dc-768fd618dc3d => generated 1715 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:54:12.552478 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-b54b7e8f-8e3c-4cb7-bdd4-7836442cb8c2 tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Calling method '.version_select at 0x7fd3a44abdc0>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:54:12.635486 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-b54b7e8f-8e3c-4cb7-bdd4-7836442cb8c2 tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] 10.222.0.18 "GET /compute/v2.1/images/2c26b155-ef26-40a2-b7db-1b550c12a2cf" status: 200 len: 1429 microversion: 2.1 time: 0.098421 Oct 22 20:54:12.637320 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 722/1371] 10.222.0.18 () {58 vars in 1233 bytes} [Sat Oct 22 20:54:12 2022] GET /compute/v2.1/images/2c26b155-ef26-40a2-b7db-1b550c12a2cf => generated 1429 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:54:12.650025 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-850de17c-6aab-43b2-a6d2-6f6dc7da34fa req-8546055b-8b87-4c9c-b5fa-39a590f61941 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f499ce97-cdf8-4dcf-9c28-3758aea5e78c", "name": "network-vif-plugged", "status": "completed", "tag": "c45f11d9-428c-4566-a627-5dbe8e1e8d6d"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:54:12.668370 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-850de17c-6aab-43b2-a6d2-6f6dc7da34fa req-8546055b-8b87-4c9c-b5fa-39a590f61941 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:12.674576 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-850de17c-6aab-43b2-a6d2-6f6dc7da34fa req-8546055b-8b87-4c9c-b5fa-39a590f61941 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:12.675522 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-850de17c-6aab-43b2-a6d2-6f6dc7da34fa req-8546055b-8b87-4c9c-b5fa-39a590f61941 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:12.705323 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-850de17c-6aab-43b2-a6d2-6f6dc7da34fa req-8546055b-8b87-4c9c-b5fa-39a590f61941 service nova] Creating event network-vif-plugged:c45f11d9-428c-4566-a627-5dbe8e1e8d6d for instance f499ce97-cdf8-4dcf-9c28-3758aea5e78c on nch1-master-1 Oct 22 20:54:12.723503 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-850de17c-6aab-43b2-a6d2-6f6dc7da34fa req-8546055b-8b87-4c9c-b5fa-39a590f61941 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084640 Oct 22 20:54:12.735835 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 723/1372] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:54:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:54:12.741990 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-e5e3648b-cb35-4961-afdb-f44e2306f66d tempest-InstanceActionsV221TestJSON-976463296 tempest-InstanceActionsV221TestJSON-976463296-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:54:12.748962 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-e5e3648b-cb35-4961-afdb-f44e2306f66d tempest-InstanceActionsV221TestJSON-976463296 tempest-InstanceActionsV221TestJSON-976463296-project] [instance: 304975d8-d62e-4156-9697-09c3a9724371] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:54:12.766119 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e5e3648b-cb35-4961-afdb-f44e2306f66d tempest-InstanceActionsV221TestJSON-976463296 tempest-InstanceActionsV221TestJSON-976463296-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:12.767027 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e5e3648b-cb35-4961-afdb-f44e2306f66d tempest-InstanceActionsV221TestJSON-976463296 tempest-InstanceActionsV221TestJSON-976463296-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:12.767716 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e5e3648b-cb35-4961-afdb-f44e2306f66d tempest-InstanceActionsV221TestJSON-976463296 tempest-InstanceActionsV221TestJSON-976463296-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:12.769347 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e5e3648b-cb35-4961-afdb-f44e2306f66d tempest-InstanceActionsV221TestJSON-976463296 tempest-InstanceActionsV221TestJSON-976463296-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:12.770038 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e5e3648b-cb35-4961-afdb-f44e2306f66d tempest-InstanceActionsV221TestJSON-976463296 tempest-InstanceActionsV221TestJSON-976463296-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:12.770816 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e5e3648b-cb35-4961-afdb-f44e2306f66d tempest-InstanceActionsV221TestJSON-976463296 tempest-InstanceActionsV221TestJSON-976463296-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:12.802138 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.wsgi [None req-e5e3648b-cb35-4961-afdb-f44e2306f66d tempest-InstanceActionsV221TestJSON-976463296 tempest-InstanceActionsV221TestJSON-976463296-project] HTTP exception thrown: Instance 304975d8-d62e-4156-9697-09c3a9724371 could not be found. Oct 22 20:54:12.805637 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-e5e3648b-cb35-4961-afdb-f44e2306f66d tempest-InstanceActionsV221TestJSON-976463296 tempest-InstanceActionsV221TestJSON-976463296-project] Request method failure captured: Oct 22 20:54:12.805637 ncdv-master-1 devstack@n-api.service[138745]: request: GET /compute/v2.1/servers/304975d8-d62e-4156-9697-09c3a9724371 HTTP/1.1 Oct 22 20:54:12.805637 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 20:54:12.805637 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 20:54:12.805637 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 20:54:12.805637 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 0 Oct 22 20:54:12.805637 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 20:54:12.805637 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 20:54:12.805637 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 20:54:12.805637 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 20:54:12.805637 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVFhaqjyzBfG0Qpw3Dr3OsvkC1shKOxgYhjgH-hXNBJfqXpBF3eRxNGslwcU9gX0durIkANbTOdcwM0lA8fh-98aD4NsDrVf7hqP6vhdYkVry20jxBdtOKZxUJmrQ6Sbj2hzl_ANft-5OMBRGlOmQV5tvi2x2RxxKMgy_59wrn1vf0-M Oct 22 20:54:12.805637 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 20:54:12.805637 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 20:54:12.805637 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 20:54:12.805637 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 20:54:12.805637 ncdv-master-1 devstack@n-api.service[138745]: X-Openstack-Nova-Api-Version: 2.21 Oct 22 20:54:12.805637 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 20:54:12.805637 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 20:54:12.805637 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: 6f7808ed44e84de4a1574e8aacd71c4e Oct 22 20:54:12.805637 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-InstanceActionsV221TestJSON-976463296 Oct 22 20:54:12.805637 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 20:54:12.805637 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 20:54:12.805637 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_6f7808ed44e84de4a1574e8aacd71c4e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6f7808ed44e84de4a1574e8aacd71c4e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/6f7808ed44e84de4a1574e8aacd71c4e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6f7808ed44e84de4a1574e8aacd71c4e"}]}] Oct 22 20:54:12.805637 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-InstanceActionsV221TestJSON-976463296 Oct 22 20:54:12.805637 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: 6f7808ed44e84de4a1574e8aacd71c4e Oct 22 20:54:12.805637 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-976463296 Oct 22 20:54:12.805637 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-InstanceActionsV221TestJSON-976463296-project Oct 22 20:54:12.805637 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 20:54:12.805637 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 20:54:12.805637 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: e13c3673ebe14b7e997ec664499b9e82 Oct 22 20:54:12.805637 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-InstanceActionsV221TestJSON-976463296-project Oct 22 20:54:12.805637 ncdv-master-1 devstack@n-api.service[138745]: method: > Oct 22 20:54:12.805637 ncdv-master-1 devstack@n-api.service[138745]: exception: Instance 304975d8-d62e-4156-9697-09c3a9724371 could not be found. Oct 22 20:54:12.805637 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'id': '304975d8-d62e-4156-9697-09c3a9724371'} Oct 22 20:54:12.805637 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:54:12.805637 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:54:12.805637 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 20:54:12.805637 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 20:54:12.805637 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 20:54:12.805637 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 20:54:12.805637 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 20:54:12.805637 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 20:54:12.805637 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 20:54:12.805637 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 20:54:12.805637 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 304975d8-d62e-4156-9697-09c3a9724371 could not be found. Oct 22 20:54:12.805637 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:54:12.805637 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:54:12.805637 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:54:12.805637 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:54:12.805637 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:54:12.805637 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:54:12.805637 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:54:12.805637 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:54:12.805637 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:54:12.805637 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:54:12.805637 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 20:54:12.805637 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 20:54:12.805637 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 20:54:12.805637 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 20:54:12.805637 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 20:54:12.805637 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 20:54:12.805637 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 304975d8-d62e-4156-9697-09c3a9724371 could not be found. Oct 22 20:54:12.805637 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:54:12.805637 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:54:12.810110 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:54:12.810110 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:54:12.810110 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:54:12.810110 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:54:12.810110 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 20:54:12.810110 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 20:54:12.810110 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 304975d8-d62e-4156-9697-09c3a9724371 could not be found. Oct 22 20:54:12.810110 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:54:12.812049 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-e5e3648b-cb35-4961-afdb-f44e2306f66d tempest-InstanceActionsV221TestJSON-976463296 tempest-InstanceActionsV221TestJSON-976463296-project] Returning 404 to user: Instance 304975d8-d62e-4156-9697-09c3a9724371 could not be found. {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:54:12.813148 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-e5e3648b-cb35-4961-afdb-f44e2306f66d tempest-InstanceActionsV221TestJSON-976463296 tempest-InstanceActionsV221TestJSON-976463296-project] 10.222.0.18 "GET /compute/v2.1/servers/304975d8-d62e-4156-9697-09c3a9724371" status: 404 len: 111 microversion: 2.21 time: 0.075885 Oct 22 20:54:12.814043 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 724/1373] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 20:54:12 2022] GET /compute/v2.1/servers/304975d8-d62e-4156-9697-09c3a9724371 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 22 20:54:12.822475 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-7e199bd9-d290-4519-b22c-9b476c07b3e3 tempest-InstanceActionsV221TestJSON-976463296 tempest-InstanceActionsV221TestJSON-976463296-project] Calling method '.version_select at 0x7fd3a4a3b9d0>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:54:12.832347 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-7e199bd9-d290-4519-b22c-9b476c07b3e3 tempest-InstanceActionsV221TestJSON-976463296 tempest-InstanceActionsV221TestJSON-976463296-project] [instance: 304975d8-d62e-4156-9697-09c3a9724371] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:54:12.846503 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7e199bd9-d290-4519-b22c-9b476c07b3e3 tempest-InstanceActionsV221TestJSON-976463296 tempest-InstanceActionsV221TestJSON-976463296-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:12.847297 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7e199bd9-d290-4519-b22c-9b476c07b3e3 tempest-InstanceActionsV221TestJSON-976463296 tempest-InstanceActionsV221TestJSON-976463296-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:12.847996 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7e199bd9-d290-4519-b22c-9b476c07b3e3 tempest-InstanceActionsV221TestJSON-976463296 tempest-InstanceActionsV221TestJSON-976463296-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:12.849205 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7e199bd9-d290-4519-b22c-9b476c07b3e3 tempest-InstanceActionsV221TestJSON-976463296 tempest-InstanceActionsV221TestJSON-976463296-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:12.849902 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7e199bd9-d290-4519-b22c-9b476c07b3e3 tempest-InstanceActionsV221TestJSON-976463296 tempest-InstanceActionsV221TestJSON-976463296-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:12.850549 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7e199bd9-d290-4519-b22c-9b476c07b3e3 tempest-InstanceActionsV221TestJSON-976463296 tempest-InstanceActionsV221TestJSON-976463296-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:12.952349 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-7e199bd9-d290-4519-b22c-9b476c07b3e3 tempest-InstanceActionsV221TestJSON-976463296 tempest-InstanceActionsV221TestJSON-976463296-project] 10.222.0.18 "GET /compute/v2.1/servers/304975d8-d62e-4156-9697-09c3a9724371/os-instance-actions" status: 200 len: 611 microversion: 2.21 time: 0.133773 Oct 22 20:54:12.953566 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 725/1374] 10.222.0.18 () {60 vars in 1337 bytes} [Sat Oct 22 20:54:12 2022] GET /compute/v2.1/servers/304975d8-d62e-4156-9697-09c3a9724371/os-instance-actions => generated 611 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 22 20:54:12.958470 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-660666ad-8d3b-40c3-8ab7-123e77944449 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:54:12.959409 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-660666ad-8d3b-40c3-8ab7-123e77944449 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] [instance: 40e6c6e3-3d47-4781-b8a8-aafd671d7287] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:54:12.971842 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-660666ad-8d3b-40c3-8ab7-123e77944449 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:12.972548 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-660666ad-8d3b-40c3-8ab7-123e77944449 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:12.973145 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-660666ad-8d3b-40c3-8ab7-123e77944449 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:12.974360 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-660666ad-8d3b-40c3-8ab7-123e77944449 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:12.975333 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-660666ad-8d3b-40c3-8ab7-123e77944449 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:12.976083 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-660666ad-8d3b-40c3-8ab7-123e77944449 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:13.204318 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell0:SELECT=2 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:54:13.325644 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-f6dfee40-abb8-4998-a299-df9f0f9221b6 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:54:13.343571 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-f6dfee40-abb8-4998-a299-df9f0f9221b6 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:54:13.345073 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-f6dfee40-abb8-4998-a299-df9f0f9221b6 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:54:13.346281 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-f6dfee40-abb8-4998-a299-df9f0f9221b6 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] 10.222.0.18 "GET /compute/v2.1/servers/f499ce97-cdf8-4dcf-9c28-3758aea5e78c" status: 200 len: 1279 microversion: 2.25 time: 1.275336 Oct 22 20:54:13.375236 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 650/1375] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 20:54:12 2022] GET /compute/v2.1/servers/f499ce97-cdf8-4dcf-9c28-3758aea5e78c => generated 1279 bytes in 1305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 22 20:54:13.386438 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-8759ea85-279b-4e46-8632-d8d93b916a43 tempest-InstanceActionsV221TestJSON-976463296 tempest-InstanceActionsV221TestJSON-976463296-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:54:13.386954 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-8759ea85-279b-4e46-8632-d8d93b916a43 tempest-InstanceActionsV221TestJSON-976463296 tempest-InstanceActionsV221TestJSON-976463296-project] [instance: 304975d8-d62e-4156-9697-09c3a9724371] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:54:13.412951 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8759ea85-279b-4e46-8632-d8d93b916a43 tempest-InstanceActionsV221TestJSON-976463296 tempest-InstanceActionsV221TestJSON-976463296-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:13.413749 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8759ea85-279b-4e46-8632-d8d93b916a43 tempest-InstanceActionsV221TestJSON-976463296 tempest-InstanceActionsV221TestJSON-976463296-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:13.414203 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8759ea85-279b-4e46-8632-d8d93b916a43 tempest-InstanceActionsV221TestJSON-976463296 tempest-InstanceActionsV221TestJSON-976463296-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:13.415160 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8759ea85-279b-4e46-8632-d8d93b916a43 tempest-InstanceActionsV221TestJSON-976463296 tempest-InstanceActionsV221TestJSON-976463296-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:13.415660 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8759ea85-279b-4e46-8632-d8d93b916a43 tempest-InstanceActionsV221TestJSON-976463296 tempest-InstanceActionsV221TestJSON-976463296-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:13.416260 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8759ea85-279b-4e46-8632-d8d93b916a43 tempest-InstanceActionsV221TestJSON-976463296 tempest-InstanceActionsV221TestJSON-976463296-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:13.456666 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-8759ea85-279b-4e46-8632-d8d93b916a43 tempest-InstanceActionsV221TestJSON-976463296 tempest-InstanceActionsV221TestJSON-976463296-project] HTTP exception thrown: Instance 304975d8-d62e-4156-9697-09c3a9724371 could not be found. Oct 22 20:54:13.461950 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-8759ea85-279b-4e46-8632-d8d93b916a43 tempest-InstanceActionsV221TestJSON-976463296 tempest-InstanceActionsV221TestJSON-976463296-project] Request method failure captured: Oct 22 20:54:13.461950 ncdv-master-1 devstack@n-api.service[138744]: request: DELETE /compute/v2.1/servers/304975d8-d62e-4156-9697-09c3a9724371 HTTP/1.1 Oct 22 20:54:13.461950 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 20:54:13.461950 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 20:54:13.461950 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 20:54:13.461950 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 0 Oct 22 20:54:13.461950 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 20:54:13.461950 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 20:54:13.461950 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 20:54:13.461950 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 20:54:13.461950 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVFhaqjyzBfG0Qpw3Dr3OsvkC1shKOxgYhjgH-hXNBJfqXpBF3eRxNGslwcU9gX0durIkANbTOdcwM0lA8fh-98aD4NsDrVf7hqP6vhdYkVry20jxBdtOKZxUJmrQ6Sbj2hzl_ANft-5OMBRGlOmQV5tvi2x2RxxKMgy_59wrn1vf0-M Oct 22 20:54:13.461950 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 20:54:13.461950 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 20:54:13.461950 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 20:54:13.461950 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 20:54:13.461950 ncdv-master-1 devstack@n-api.service[138744]: X-Openstack-Nova-Api-Version: 2.21 Oct 22 20:54:13.461950 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 20:54:13.461950 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 20:54:13.461950 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: 6f7808ed44e84de4a1574e8aacd71c4e Oct 22 20:54:13.461950 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-InstanceActionsV221TestJSON-976463296 Oct 22 20:54:13.461950 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 20:54:13.461950 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 20:54:13.461950 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_6f7808ed44e84de4a1574e8aacd71c4e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6f7808ed44e84de4a1574e8aacd71c4e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/6f7808ed44e84de4a1574e8aacd71c4e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6f7808ed44e84de4a1574e8aacd71c4e"}]}] Oct 22 20:54:13.461950 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-InstanceActionsV221TestJSON-976463296 Oct 22 20:54:13.461950 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: 6f7808ed44e84de4a1574e8aacd71c4e Oct 22 20:54:13.461950 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-976463296 Oct 22 20:54:13.461950 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-InstanceActionsV221TestJSON-976463296-project Oct 22 20:54:13.461950 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 20:54:13.461950 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 20:54:13.461950 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: e13c3673ebe14b7e997ec664499b9e82 Oct 22 20:54:13.461950 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-InstanceActionsV221TestJSON-976463296-project Oct 22 20:54:13.461950 ncdv-master-1 devstack@n-api.service[138744]: method: > Oct 22 20:54:13.461950 ncdv-master-1 devstack@n-api.service[138744]: exception: Instance 304975d8-d62e-4156-9697-09c3a9724371 could not be found. Oct 22 20:54:13.461950 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': '304975d8-d62e-4156-9697-09c3a9724371'} Oct 22 20:54:13.461950 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:54:13.461950 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:54:13.461950 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 20:54:13.461950 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 20:54:13.461950 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 20:54:13.461950 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 20:54:13.461950 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 20:54:13.461950 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 20:54:13.461950 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 20:54:13.461950 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 20:54:13.461950 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 304975d8-d62e-4156-9697-09c3a9724371 could not be found. Oct 22 20:54:13.461950 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:54:13.461950 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:54:13.461950 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:54:13.461950 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:54:13.461950 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:54:13.461950 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:54:13.461950 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:54:13.461950 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:54:13.461950 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:54:13.461950 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:54:13.461950 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 22 20:54:13.461950 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 22 20:54:13.461950 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 22 20:54:13.461950 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 22 20:54:13.461950 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 20:54:13.461950 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 20:54:13.461950 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 20:54:13.461950 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 20:54:13.466890 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 304975d8-d62e-4156-9697-09c3a9724371 could not be found. Oct 22 20:54:13.466890 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:54:13.466890 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:54:13.466890 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:54:13.466890 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:54:13.466890 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:54:13.466890 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:54:13.466890 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 20:54:13.466890 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 20:54:13.466890 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 304975d8-d62e-4156-9697-09c3a9724371 could not be found. Oct 22 20:54:13.466890 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:54:13.466890 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-8759ea85-279b-4e46-8632-d8d93b916a43 tempest-InstanceActionsV221TestJSON-976463296 tempest-InstanceActionsV221TestJSON-976463296-project] Returning 404 to user: Instance 304975d8-d62e-4156-9697-09c3a9724371 could not be found. {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:54:13.468775 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-8759ea85-279b-4e46-8632-d8d93b916a43 tempest-InstanceActionsV221TestJSON-976463296 tempest-InstanceActionsV221TestJSON-976463296-project] 10.222.0.18 "DELETE /compute/v2.1/servers/304975d8-d62e-4156-9697-09c3a9724371" status: 404 len: 111 microversion: 2.21 time: 0.091941 Oct 22 20:54:13.470108 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 651/1376] 10.222.0.18 () {60 vars in 1280 bytes} [Sat Oct 22 20:54:13 2022] DELETE /compute/v2.1/servers/304975d8-d62e-4156-9697-09c3a9724371 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 22 20:54:13.482362 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-13bdf441-038c-4d7f-8a58-66044148066a tempest-InstanceActionsV221TestJSON-976463296 tempest-InstanceActionsV221TestJSON-976463296-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:54:13.484064 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-13bdf441-038c-4d7f-8a58-66044148066a tempest-InstanceActionsV221TestJSON-976463296 tempest-InstanceActionsV221TestJSON-976463296-project] [instance: 304975d8-d62e-4156-9697-09c3a9724371] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:54:13.502299 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-13bdf441-038c-4d7f-8a58-66044148066a tempest-InstanceActionsV221TestJSON-976463296 tempest-InstanceActionsV221TestJSON-976463296-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:13.503562 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-13bdf441-038c-4d7f-8a58-66044148066a tempest-InstanceActionsV221TestJSON-976463296 tempest-InstanceActionsV221TestJSON-976463296-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:13.504410 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-13bdf441-038c-4d7f-8a58-66044148066a tempest-InstanceActionsV221TestJSON-976463296 tempest-InstanceActionsV221TestJSON-976463296-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:13.509000 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-13bdf441-038c-4d7f-8a58-66044148066a tempest-InstanceActionsV221TestJSON-976463296 tempest-InstanceActionsV221TestJSON-976463296-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:13.509884 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-13bdf441-038c-4d7f-8a58-66044148066a tempest-InstanceActionsV221TestJSON-976463296 tempest-InstanceActionsV221TestJSON-976463296-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:13.515032 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-13bdf441-038c-4d7f-8a58-66044148066a tempest-InstanceActionsV221TestJSON-976463296 tempest-InstanceActionsV221TestJSON-976463296-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:13.537584 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-13bdf441-038c-4d7f-8a58-66044148066a tempest-InstanceActionsV221TestJSON-976463296 tempest-InstanceActionsV221TestJSON-976463296-project] HTTP exception thrown: Instance 304975d8-d62e-4156-9697-09c3a9724371 could not be found. Oct 22 20:54:13.539119 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-13bdf441-038c-4d7f-8a58-66044148066a tempest-InstanceActionsV221TestJSON-976463296 tempest-InstanceActionsV221TestJSON-976463296-project] Request method failure captured: Oct 22 20:54:13.539119 ncdv-master-1 devstack@n-api.service[138744]: request: GET /compute/v2.1/servers/304975d8-d62e-4156-9697-09c3a9724371 HTTP/1.1 Oct 22 20:54:13.539119 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 20:54:13.539119 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 20:54:13.539119 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 20:54:13.539119 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 0 Oct 22 20:54:13.539119 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 20:54:13.539119 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 20:54:13.539119 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 20:54:13.539119 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 20:54:13.539119 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVFhaqjyzBfG0Qpw3Dr3OsvkC1shKOxgYhjgH-hXNBJfqXpBF3eRxNGslwcU9gX0durIkANbTOdcwM0lA8fh-98aD4NsDrVf7hqP6vhdYkVry20jxBdtOKZxUJmrQ6Sbj2hzl_ANft-5OMBRGlOmQV5tvi2x2RxxKMgy_59wrn1vf0-M Oct 22 20:54:13.539119 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 20:54:13.539119 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 20:54:13.539119 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 20:54:13.539119 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 20:54:13.539119 ncdv-master-1 devstack@n-api.service[138744]: X-Openstack-Nova-Api-Version: 2.21 Oct 22 20:54:13.539119 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 20:54:13.539119 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 20:54:13.539119 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: 6f7808ed44e84de4a1574e8aacd71c4e Oct 22 20:54:13.539119 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-InstanceActionsV221TestJSON-976463296 Oct 22 20:54:13.539119 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 20:54:13.539119 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 20:54:13.539119 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_6f7808ed44e84de4a1574e8aacd71c4e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6f7808ed44e84de4a1574e8aacd71c4e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/6f7808ed44e84de4a1574e8aacd71c4e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6f7808ed44e84de4a1574e8aacd71c4e"}]}] Oct 22 20:54:13.539119 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-InstanceActionsV221TestJSON-976463296 Oct 22 20:54:13.539119 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: 6f7808ed44e84de4a1574e8aacd71c4e Oct 22 20:54:13.539119 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-976463296 Oct 22 20:54:13.539119 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-InstanceActionsV221TestJSON-976463296-project Oct 22 20:54:13.539119 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 20:54:13.539119 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 20:54:13.539119 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: e13c3673ebe14b7e997ec664499b9e82 Oct 22 20:54:13.539119 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-InstanceActionsV221TestJSON-976463296-project Oct 22 20:54:13.539119 ncdv-master-1 devstack@n-api.service[138744]: method: > Oct 22 20:54:13.539119 ncdv-master-1 devstack@n-api.service[138744]: exception: Instance 304975d8-d62e-4156-9697-09c3a9724371 could not be found. Oct 22 20:54:13.539119 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': '304975d8-d62e-4156-9697-09c3a9724371'} Oct 22 20:54:13.539119 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:54:13.539119 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:54:13.539119 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 20:54:13.539119 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 20:54:13.539119 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 20:54:13.539119 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 20:54:13.539119 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 20:54:13.539119 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 20:54:13.539119 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 20:54:13.539119 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 20:54:13.539119 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 304975d8-d62e-4156-9697-09c3a9724371 could not be found. Oct 22 20:54:13.539119 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:54:13.539119 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:54:13.539119 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:54:13.539119 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:54:13.539119 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:54:13.539119 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:54:13.539119 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:54:13.539119 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:54:13.539119 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:54:13.539119 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:54:13.539119 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 20:54:13.539119 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 20:54:13.539119 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 20:54:13.539119 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 20:54:13.539119 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 20:54:13.539119 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 20:54:13.539119 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 304975d8-d62e-4156-9697-09c3a9724371 could not be found. Oct 22 20:54:13.539119 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:54:13.539119 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:54:13.543366 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:54:13.543366 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:54:13.543366 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:54:13.543366 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:54:13.543366 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 20:54:13.543366 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 20:54:13.543366 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 304975d8-d62e-4156-9697-09c3a9724371 could not be found. Oct 22 20:54:13.543366 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:54:13.543366 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-13bdf441-038c-4d7f-8a58-66044148066a tempest-InstanceActionsV221TestJSON-976463296 tempest-InstanceActionsV221TestJSON-976463296-project] Returning 404 to user: Instance 304975d8-d62e-4156-9697-09c3a9724371 could not be found. {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:54:13.543366 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-13bdf441-038c-4d7f-8a58-66044148066a tempest-InstanceActionsV221TestJSON-976463296 tempest-InstanceActionsV221TestJSON-976463296-project] 10.222.0.18 "GET /compute/v2.1/servers/304975d8-d62e-4156-9697-09c3a9724371" status: 404 len: 111 microversion: 2.21 time: 0.066908 Oct 22 20:54:13.543366 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 652/1377] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 20:54:13 2022] GET /compute/v2.1/servers/304975d8-d62e-4156-9697-09c3a9724371 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 22 20:54:13.562668 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-aa09c78c-b838-4826-9dd0-6c776576808e tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:54:13.566249 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-aa09c78c-b838-4826-9dd0-6c776576808e tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] [instance: 8f2e1da0-4586-460b-94dc-768fd618dc3d] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:54:13.578074 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-aa09c78c-b838-4826-9dd0-6c776576808e tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:13.578965 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-aa09c78c-b838-4826-9dd0-6c776576808e tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:13.579672 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-aa09c78c-b838-4826-9dd0-6c776576808e tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:13.581290 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-aa09c78c-b838-4826-9dd0-6c776576808e tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:13.581999 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-aa09c78c-b838-4826-9dd0-6c776576808e tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:13.582657 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-aa09c78c-b838-4826-9dd0-6c776576808e tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:13.664484 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell0:SELECT=12 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:54:14.127866 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-660666ad-8d3b-40c3-8ab7-123e77944449 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d3d7458af447bdb3f03e83a2d8559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49238b8686d24ae698679e4a1957735d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:54:14.140459 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-660666ad-8d3b-40c3-8ab7-123e77944449 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] 10.222.0.18 "GET /compute/v2.1/servers/40e6c6e3-3d47-4781-b8a8-aafd671d7287" status: 200 len: 1313 microversion: 2.1 time: 1.185508 Oct 22 20:54:14.146424 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 726/1378] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:54:12 2022] GET /compute/v2.1/servers/40e6c6e3-3d47-4781-b8a8-aafd671d7287 => generated 1313 bytes in 1192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:54:14.161975 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-10561441-1972-4349-9b6e-32986dd2903f tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Calling method '.version_select at 0x7fd3a477d820>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:54:14.279592 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-10561441-1972-4349-9b6e-32986dd2903f tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] 10.222.0.18 "GET /compute/v2.1/images/2c26b155-ef26-40a2-b7db-1b550c12a2cf" status: 200 len: 1429 microversion: 2.1 time: 0.131939 Oct 22 20:54:14.280184 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 727/1379] 10.222.0.18 () {58 vars in 1233 bytes} [Sat Oct 22 20:54:14 2022] GET /compute/v2.1/images/2c26b155-ef26-40a2-b7db-1b550c12a2cf => generated 1429 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:54:14.375544 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-214ced92-b596-4567-b74f-71c229792566 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:54:14.376248 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-214ced92-b596-4567-b74f-71c229792566 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] [instance: f499ce97-cdf8-4dcf-9c28-3758aea5e78c] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:54:14.392281 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-214ced92-b596-4567-b74f-71c229792566 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:14.392950 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-214ced92-b596-4567-b74f-71c229792566 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:14.393270 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-214ced92-b596-4567-b74f-71c229792566 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:14.393972 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-214ced92-b596-4567-b74f-71c229792566 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:14.394439 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-214ced92-b596-4567-b74f-71c229792566 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:14.394872 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-214ced92-b596-4567-b74f-71c229792566 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:14.664356 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-aa09c78c-b838-4826-9dd0-6c776576808e tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c87f0356ca346f39c6216393d85da2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee8c8f7fc4e12bc1f9fcce3e7b581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:54:14.700696 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-aa09c78c-b838-4826-9dd0-6c776576808e tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] 10.222.0.18 "GET /compute/v2.1/servers/8f2e1da0-4586-460b-94dc-768fd618dc3d" status: 200 len: 1715 microversion: 2.1 time: 1.140456 Oct 22 20:54:14.702058 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 653/1380] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:54:13 2022] GET /compute/v2.1/servers/8f2e1da0-4586-460b-94dc-768fd618dc3d => generated 1715 bytes in 1144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 20:54:15.125213 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-214ced92-b596-4567-b74f-71c229792566 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:54:15.142242 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-214ced92-b596-4567-b74f-71c229792566 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:54:15.143547 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-214ced92-b596-4567-b74f-71c229792566 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:54:15.144699 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-214ced92-b596-4567-b74f-71c229792566 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] 10.222.0.18 "GET /compute/v2.1/servers/f499ce97-cdf8-4dcf-9c28-3758aea5e78c" status: 200 len: 1279 microversion: 2.25 time: 0.773249 Oct 22 20:54:15.158189 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 728/1381] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 20:54:14 2022] GET /compute/v2.1/servers/f499ce97-cdf8-4dcf-9c28-3758aea5e78c => generated 1279 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 20:54:15.170309 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-0051c81e-2cbc-4d6e-9ae2-c574852fb015 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:54:15.173113 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-0051c81e-2cbc-4d6e-9ae2-c574852fb015 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] [instance: 40e6c6e3-3d47-4781-b8a8-aafd671d7287] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:54:15.204920 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0051c81e-2cbc-4d6e-9ae2-c574852fb015 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:15.217207 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0051c81e-2cbc-4d6e-9ae2-c574852fb015 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:15.218097 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0051c81e-2cbc-4d6e-9ae2-c574852fb015 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:15.222266 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0051c81e-2cbc-4d6e-9ae2-c574852fb015 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:15.223317 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0051c81e-2cbc-4d6e-9ae2-c574852fb015 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:15.225298 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0051c81e-2cbc-4d6e-9ae2-c574852fb015 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:15.295461 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-00b56ebc-9a35-47c6-ab95-d4cab988f6c3 tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Calling method '.version_select at 0x7fd3a4aca790>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:54:15.365121 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-00b56ebc-9a35-47c6-ab95-d4cab988f6c3 tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] 10.222.0.18 "GET /compute/v2.1/images/2c26b155-ef26-40a2-b7db-1b550c12a2cf" status: 200 len: 1429 microversion: 2.1 time: 0.073493 Oct 22 20:54:15.373447 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 729/1382] 10.222.0.18 () {58 vars in 1233 bytes} [Sat Oct 22 20:54:15 2022] GET /compute/v2.1/images/2c26b155-ef26-40a2-b7db-1b550c12a2cf => generated 1429 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 20:54:15.380610 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-b1aea0bf-15a4-46e7-ab19-7e874838f4c1 req-69160ff9-3506-402d-9730-56d7644c79b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40e6c6e3-3d47-4781-b8a8-aafd671d7287", "tag": "3f86770d-1d07-4131-85b9-86ddae7d31e5"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:54:15.405771 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-b1aea0bf-15a4-46e7-ab19-7e874838f4c1 req-69160ff9-3506-402d-9730-56d7644c79b4 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:15.406272 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-b1aea0bf-15a4-46e7-ab19-7e874838f4c1 req-69160ff9-3506-402d-9730-56d7644c79b4 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:15.406720 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-b1aea0bf-15a4-46e7-ab19-7e874838f4c1 req-69160ff9-3506-402d-9730-56d7644c79b4 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:15.427783 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-b1aea0bf-15a4-46e7-ab19-7e874838f4c1 req-69160ff9-3506-402d-9730-56d7644c79b4 service nova] Creating event network-changed:3f86770d-1d07-4131-85b9-86ddae7d31e5 for instance 40e6c6e3-3d47-4781-b8a8-aafd671d7287 on nch2-master-1 Oct 22 20:54:15.448953 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-b1aea0bf-15a4-46e7-ab19-7e874838f4c1 req-69160ff9-3506-402d-9730-56d7644c79b4 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073877 Oct 22 20:54:15.450146 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 730/1383] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:54:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:54:15.731422 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-ff333881-9079-4448-9a98-5517e29b1835 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:54:15.732558 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-ff333881-9079-4448-9a98-5517e29b1835 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] [instance: 8f2e1da0-4586-460b-94dc-768fd618dc3d] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:54:15.752727 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ff333881-9079-4448-9a98-5517e29b1835 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:15.753637 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ff333881-9079-4448-9a98-5517e29b1835 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:15.754350 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ff333881-9079-4448-9a98-5517e29b1835 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:15.755440 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ff333881-9079-4448-9a98-5517e29b1835 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:15.758518 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ff333881-9079-4448-9a98-5517e29b1835 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:15.759242 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ff333881-9079-4448-9a98-5517e29b1835 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:16.135745 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-0051c81e-2cbc-4d6e-9ae2-c574852fb015 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d3d7458af447bdb3f03e83a2d8559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49238b8686d24ae698679e4a1957735d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:54:16.152680 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-0051c81e-2cbc-4d6e-9ae2-c574852fb015 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] 10.222.0.18 "GET /compute/v2.1/servers/40e6c6e3-3d47-4781-b8a8-aafd671d7287" status: 200 len: 1313 microversion: 2.1 time: 0.987675 Oct 22 20:54:16.159993 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 654/1384] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:54:15 2022] GET /compute/v2.1/servers/40e6c6e3-3d47-4781-b8a8-aafd671d7287 => generated 1313 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:54:16.174311 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-41855f92-ffc5-45c8-ace1-71a5e3026cb2 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:54:16.175962 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-41855f92-ffc5-45c8-ace1-71a5e3026cb2 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] [instance: f499ce97-cdf8-4dcf-9c28-3758aea5e78c] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:54:16.197542 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-41855f92-ffc5-45c8-ace1-71a5e3026cb2 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:16.198489 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-41855f92-ffc5-45c8-ace1-71a5e3026cb2 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:16.199232 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-41855f92-ffc5-45c8-ace1-71a5e3026cb2 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:16.202410 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-41855f92-ffc5-45c8-ace1-71a5e3026cb2 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:16.203133 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-41855f92-ffc5-45c8-ace1-71a5e3026cb2 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:16.205173 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-41855f92-ffc5-45c8-ace1-71a5e3026cb2 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:16.747977 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-ff333881-9079-4448-9a98-5517e29b1835 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c87f0356ca346f39c6216393d85da2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee8c8f7fc4e12bc1f9fcce3e7b581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:54:16.765149 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-ff333881-9079-4448-9a98-5517e29b1835 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] 10.222.0.18 "GET /compute/v2.1/servers/8f2e1da0-4586-460b-94dc-768fd618dc3d" status: 200 len: 1715 microversion: 2.1 time: 1.038497 Oct 22 20:54:16.766882 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 731/1385] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:54:15 2022] GET /compute/v2.1/servers/8f2e1da0-4586-460b-94dc-768fd618dc3d => generated 1715 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 20:54:16.785230 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-a5dc8f18-a955-456e-b49c-86a717b647fa tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Calling method '.version_select at 0x7fd3a46d1940>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:54:16.886933 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-a5dc8f18-a955-456e-b49c-86a717b647fa tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] 10.222.0.18 "GET /compute/v2.1/images/2c26b155-ef26-40a2-b7db-1b550c12a2cf" status: 200 len: 1429 microversion: 2.1 time: 0.114573 Oct 22 20:54:16.895589 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 732/1386] 10.222.0.18 () {58 vars in 1233 bytes} [Sat Oct 22 20:54:16 2022] GET /compute/v2.1/images/2c26b155-ef26-40a2-b7db-1b550c12a2cf => generated 1429 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:54:17.004033 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-41855f92-ffc5-45c8-ace1-71a5e3026cb2 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:54:17.026341 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-41855f92-ffc5-45c8-ace1-71a5e3026cb2 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:54:17.032951 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-41855f92-ffc5-45c8-ace1-71a5e3026cb2 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:54:17.037882 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-41855f92-ffc5-45c8-ace1-71a5e3026cb2 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] 10.222.0.18 "GET /compute/v2.1/servers/f499ce97-cdf8-4dcf-9c28-3758aea5e78c" status: 200 len: 1476 microversion: 2.25 time: 0.870650 Oct 22 20:54:17.046488 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 655/1387] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 20:54:16 2022] GET /compute/v2.1/servers/f499ce97-cdf8-4dcf-9c28-3758aea5e78c => generated 1476 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 20:54:17.079859 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-b2dbc8ea-b380-4858-acbd-431c1a8ee72e tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:54:17.080496 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-b2dbc8ea-b380-4858-acbd-431c1a8ee72e tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] [instance: f499ce97-cdf8-4dcf-9c28-3758aea5e78c] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:54:17.095187 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b2dbc8ea-b380-4858-acbd-431c1a8ee72e tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:17.095929 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b2dbc8ea-b380-4858-acbd-431c1a8ee72e tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:17.096545 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b2dbc8ea-b380-4858-acbd-431c1a8ee72e tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:17.097480 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b2dbc8ea-b380-4858-acbd-431c1a8ee72e tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:17.097940 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b2dbc8ea-b380-4858-acbd-431c1a8ee72e tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:17.098375 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b2dbc8ea-b380-4858-acbd-431c1a8ee72e tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:17.186759 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-74897d85-6507-4ff8-8aa5-d868c724fc08 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:54:17.187482 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-74897d85-6507-4ff8-8aa5-d868c724fc08 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] [instance: 40e6c6e3-3d47-4781-b8a8-aafd671d7287] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:54:17.202045 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-74897d85-6507-4ff8-8aa5-d868c724fc08 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:17.202447 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-74897d85-6507-4ff8-8aa5-d868c724fc08 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:17.202888 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-74897d85-6507-4ff8-8aa5-d868c724fc08 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:17.222317 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-74897d85-6507-4ff8-8aa5-d868c724fc08 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:17.225613 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-74897d85-6507-4ff8-8aa5-d868c724fc08 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:17.226881 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-74897d85-6507-4ff8-8aa5-d868c724fc08 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:17.931092 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.objects.instance [None req-b2dbc8ea-b380-4858-acbd-431c1a8ee72e tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] Lazy-loading 'services' on Instance uuid f499ce97-cdf8-4dcf-9c28-3758aea5e78c {{(pid=138745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 20:54:17.972602 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-b2dbc8ea-b380-4858-acbd-431c1a8ee72e tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/f499ce97-cdf8-4dcf-9c28-3758aea5e78c" status: 200 len: 1967 microversion: 2.25 time: 0.886243 Oct 22 20:54:17.974698 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 733/1388] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 20:54:17 2022] GET /compute/v2.1/servers/f499ce97-cdf8-4dcf-9c28-3758aea5e78c => generated 1967 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 20:54:18.000287 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-b91da25c-c544-4740-a656-9d728278ae4d tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:54:18.012835 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-b91da25c-c544-4740-a656-9d728278ae4d tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] [instance: 8f2e1da0-4586-460b-94dc-768fd618dc3d] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:54:18.026950 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b91da25c-c544-4740-a656-9d728278ae4d tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:18.027984 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b91da25c-c544-4740-a656-9d728278ae4d tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:18.028605 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b91da25c-c544-4740-a656-9d728278ae4d tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:18.029525 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b91da25c-c544-4740-a656-9d728278ae4d tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:18.030146 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b91da25c-c544-4740-a656-9d728278ae4d tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:18.030746 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b91da25c-c544-4740-a656-9d728278ae4d tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:18.995705 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-74897d85-6507-4ff8-8aa5-d868c724fc08 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d3d7458af447bdb3f03e83a2d8559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49238b8686d24ae698679e4a1957735d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:54:19.008022 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-74897d85-6507-4ff8-8aa5-d868c724fc08 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] 10.222.0.18 "GET /compute/v2.1/servers/40e6c6e3-3d47-4781-b8a8-aafd671d7287" status: 200 len: 1313 microversion: 2.1 time: 1.822005 Oct 22 20:54:19.013106 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 656/1389] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:54:17 2022] GET /compute/v2.1/servers/40e6c6e3-3d47-4781-b8a8-aafd671d7287 => generated 1313 bytes in 1832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 20:54:19.029756 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-db91254c-0426-4891-9078-123269cc1071 tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Calling method '.version_select at 0x7fd39fed63a0>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:54:19.154652 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-db91254c-0426-4891-9078-123269cc1071 tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] 10.222.0.18 "GET /compute/v2.1/images/2c26b155-ef26-40a2-b7db-1b550c12a2cf" status: 200 len: 1429 microversion: 2.1 time: 0.140292 Oct 22 20:54:19.155252 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 657/1390] 10.222.0.18 () {58 vars in 1233 bytes} [Sat Oct 22 20:54:19 2022] GET /compute/v2.1/images/2c26b155-ef26-40a2-b7db-1b550c12a2cf => generated 1429 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:54:19.177711 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-5c883344-73c3-4a9c-9d82-da8be7e33433 tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:54:19.181439 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-5c883344-73c3-4a9c-9d82-da8be7e33433 tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] [instance: f499ce97-cdf8-4dcf-9c28-3758aea5e78c] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:54:19.206601 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5c883344-73c3-4a9c-9d82-da8be7e33433 tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:19.212942 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5c883344-73c3-4a9c-9d82-da8be7e33433 tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:19.214335 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5c883344-73c3-4a9c-9d82-da8be7e33433 tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:19.217291 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5c883344-73c3-4a9c-9d82-da8be7e33433 tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:19.218140 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5c883344-73c3-4a9c-9d82-da8be7e33433 tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:19.218807 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5c883344-73c3-4a9c-9d82-da8be7e33433 tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:19.666169 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-b91da25c-c544-4740-a656-9d728278ae4d tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c87f0356ca346f39c6216393d85da2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee8c8f7fc4e12bc1f9fcce3e7b581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:54:19.677675 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-b91da25c-c544-4740-a656-9d728278ae4d tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] 10.222.0.18 "GET /compute/v2.1/servers/8f2e1da0-4586-460b-94dc-768fd618dc3d" status: 200 len: 1715 microversion: 2.1 time: 1.701550 Oct 22 20:54:19.699230 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 734/1391] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:54:17 2022] GET /compute/v2.1/servers/8f2e1da0-4586-460b-94dc-768fd618dc3d => generated 1715 bytes in 1724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:54:19.859327 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.objects.instance [None req-5c883344-73c3-4a9c-9d82-da8be7e33433 tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] Lazy-loading 'services' on Instance uuid f499ce97-cdf8-4dcf-9c28-3758aea5e78c {{(pid=138744) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 20:54:19.896194 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-5c883344-73c3-4a9c-9d82-da8be7e33433 tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/f499ce97-cdf8-4dcf-9c28-3758aea5e78c" status: 200 len: 1967 microversion: 2.25 time: 0.738420 Oct 22 20:54:19.897274 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 658/1392] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 20:54:19 2022] GET /compute/v2.1/servers/f499ce97-cdf8-4dcf-9c28-3758aea5e78c => generated 1967 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 20:54:19.925254 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-879bd7af-ae37-4a3d-ac56-266b2cace5fb tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:54:19.929914 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-879bd7af-ae37-4a3d-ac56-266b2cace5fb tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:19.931362 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-879bd7af-ae37-4a3d-ac56-266b2cace5fb tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:19.932079 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-879bd7af-ae37-4a3d-ac56-266b2cace5fb tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:19.933090 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-879bd7af-ae37-4a3d-ac56-266b2cace5fb tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:19.933781 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-879bd7af-ae37-4a3d-ac56-266b2cace5fb tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:19.934943 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-879bd7af-ae37-4a3d-ac56-266b2cace5fb tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:19.985564 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-e9c4ea66-0297-45e3-a016-0599aae73291 req-479d3272-0cfd-4174-8c7f-471277d6bc29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f2e1da0-4586-460b-94dc-768fd618dc3d", "name": "network-vif-unplugged", "status": "completed", "tag": "4a4fea07-50e9-4003-ba39-6badf338429d"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:54:20.011651 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-e9c4ea66-0297-45e3-a016-0599aae73291 req-479d3272-0cfd-4174-8c7f-471277d6bc29 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:20.022894 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-e9c4ea66-0297-45e3-a016-0599aae73291 req-479d3272-0cfd-4174-8c7f-471277d6bc29 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:20.025889 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-e9c4ea66-0297-45e3-a016-0599aae73291 req-479d3272-0cfd-4174-8c7f-471277d6bc29 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:20.044855 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-879bd7af-ae37-4a3d-ac56-266b2cace5fb tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] 10.222.0.18 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.123509 Oct 22 20:54:20.058050 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 735/1393] 10.222.0.18 () {60 vars in 1217 bytes} [Sat Oct 22 20:54:19 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 22 20:54:20.070097 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-e9c4ea66-0297-45e3-a016-0599aae73291 req-479d3272-0cfd-4174-8c7f-471277d6bc29 service nova] Creating event network-vif-unplugged:4a4fea07-50e9-4003-ba39-6badf338429d for instance 8f2e1da0-4586-460b-94dc-768fd618dc3d on nch1-master-1 Oct 22 20:54:20.071246 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-31356879-0a97-43d2-8ac9-46171a379ee1 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:54:20.077539 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-31356879-0a97-43d2-8ac9-46171a379ee1 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] [instance: 40e6c6e3-3d47-4781-b8a8-aafd671d7287] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:54:20.089079 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-e9c4ea66-0297-45e3-a016-0599aae73291 req-479d3272-0cfd-4174-8c7f-471277d6bc29 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.107666 Oct 22 20:54:20.093401 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 659/1394] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:54:19 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 20:54:20.095717 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-31356879-0a97-43d2-8ac9-46171a379ee1 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:20.096617 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-31356879-0a97-43d2-8ac9-46171a379ee1 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:20.098219 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-31356879-0a97-43d2-8ac9-46171a379ee1 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:20.103465 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-f690e6f6-cfd1-4449-89db-027957237947 tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch2-master-1", "block_migration": "auto"}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:54:20.105087 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-31356879-0a97-43d2-8ac9-46171a379ee1 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:20.106217 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-31356879-0a97-43d2-8ac9-46171a379ee1 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:20.109015 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-31356879-0a97-43d2-8ac9-46171a379ee1 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:20.118421 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-f690e6f6-cfd1-4449-89db-027957237947 tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] [instance: f499ce97-cdf8-4dcf-9c28-3758aea5e78c] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:54:20.128216 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:54:20.145112 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f690e6f6-cfd1-4449-89db-027957237947 tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:20.146133 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f690e6f6-cfd1-4449-89db-027957237947 tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:20.146931 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f690e6f6-cfd1-4449-89db-027957237947 tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:20.148416 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f690e6f6-cfd1-4449-89db-027957237947 tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:20.149114 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f690e6f6-cfd1-4449-89db-027957237947 tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:20.150596 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f690e6f6-cfd1-4449-89db-027957237947 tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:20.260180 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.objects.instance [None req-f690e6f6-cfd1-4449-89db-027957237947 tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] Lazy-loading 'flavor' on Instance uuid f499ce97-cdf8-4dcf-9c28-3758aea5e78c {{(pid=138744) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 20:54:20.294044 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-f690e6f6-cfd1-4449-89db-027957237947 tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] [instance: f499ce97-cdf8-4dcf-9c28-3758aea5e78c] Going to try to live migrate instance to nch2-master-1 {{(pid=138744) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 22 20:54:20.962608 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-31356879-0a97-43d2-8ac9-46171a379ee1 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d3d7458af447bdb3f03e83a2d8559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49238b8686d24ae698679e4a1957735d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:54:20.972023 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-31356879-0a97-43d2-8ac9-46171a379ee1 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] 10.222.0.18 "GET /compute/v2.1/servers/40e6c6e3-3d47-4781-b8a8-aafd671d7287" status: 200 len: 1313 microversion: 2.1 time: 0.912745 Oct 22 20:54:20.979294 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 736/1395] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:54:20 2022] GET /compute/v2.1/servers/40e6c6e3-3d47-4781-b8a8-aafd671d7287 => generated 1313 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:54:20.984383 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-7c5d9941-7478-4b31-a44c-c67d51b27e0f tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Calling method '.version_select at 0x7fd3a4799310>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:54:21.130026 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-7c5d9941-7478-4b31-a44c-c67d51b27e0f tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] 10.222.0.18 "GET /compute/v2.1/images/2c26b155-ef26-40a2-b7db-1b550c12a2cf" status: 200 len: 1429 microversion: 2.1 time: 0.149242 Oct 22 20:54:21.140500 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 737/1396] 10.222.0.18 () {58 vars in 1233 bytes} [Sat Oct 22 20:54:20 2022] GET /compute/v2.1/images/2c26b155-ef26-40a2-b7db-1b550c12a2cf => generated 1429 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:54:21.151756 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-ffe37b50-8587-494e-8aa6-422f9331893c tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:54:21.152765 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-ffe37b50-8587-494e-8aa6-422f9331893c tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] [instance: 8f2e1da0-4586-460b-94dc-768fd618dc3d] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:54:21.159486 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ffe37b50-8587-494e-8aa6-422f9331893c tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:21.160333 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ffe37b50-8587-494e-8aa6-422f9331893c tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:21.161255 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ffe37b50-8587-494e-8aa6-422f9331893c tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:21.162255 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ffe37b50-8587-494e-8aa6-422f9331893c tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:21.162959 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ffe37b50-8587-494e-8aa6-422f9331893c tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:21.163669 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ffe37b50-8587-494e-8aa6-422f9331893c tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:22.076984 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-ffe37b50-8587-494e-8aa6-422f9331893c tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c87f0356ca346f39c6216393d85da2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee8c8f7fc4e12bc1f9fcce3e7b581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:54:22.091121 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-ffe37b50-8587-494e-8aa6-422f9331893c tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] 10.222.0.18 "GET /compute/v2.1/servers/8f2e1da0-4586-460b-94dc-768fd618dc3d" status: 200 len: 1715 microversion: 2.1 time: 0.949109 Oct 22 20:54:22.103655 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 738/1397] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:54:21 2022] GET /compute/v2.1/servers/8f2e1da0-4586-460b-94dc-768fd618dc3d => generated 1715 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:54:22.113689 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-e4ce1e5a-02aa-4c1d-a55f-0876eecdbf91 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:54:22.114758 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-e4ce1e5a-02aa-4c1d-a55f-0876eecdbf91 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] [instance: 40e6c6e3-3d47-4781-b8a8-aafd671d7287] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:54:22.121875 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e4ce1e5a-02aa-4c1d-a55f-0876eecdbf91 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:22.123641 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e4ce1e5a-02aa-4c1d-a55f-0876eecdbf91 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:22.124593 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e4ce1e5a-02aa-4c1d-a55f-0876eecdbf91 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:22.125649 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e4ce1e5a-02aa-4c1d-a55f-0876eecdbf91 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:22.126361 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e4ce1e5a-02aa-4c1d-a55f-0876eecdbf91 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:22.127082 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e4ce1e5a-02aa-4c1d-a55f-0876eecdbf91 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:22.784071 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-e4ce1e5a-02aa-4c1d-a55f-0876eecdbf91 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d3d7458af447bdb3f03e83a2d8559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49238b8686d24ae698679e4a1957735d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:54:22.797133 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-e4ce1e5a-02aa-4c1d-a55f-0876eecdbf91 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] 10.222.0.18 "GET /compute/v2.1/servers/40e6c6e3-3d47-4781-b8a8-aafd671d7287" status: 200 len: 1313 microversion: 2.1 time: 0.685692 Oct 22 20:54:22.811973 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 739/1398] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:54:22 2022] GET /compute/v2.1/servers/40e6c6e3-3d47-4781-b8a8-aafd671d7287 => generated 1313 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:54:23.186414 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-3273c1b5-d068-4ce1-893c-39ae62f5248f tempest-FloatingIPDetailsNegativeTestJSON-1462238469 tempest-FloatingIPDetailsNegativeTestJSON-1462238469-project] Calling method '.version_select at 0x7fd39febee50>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:54:23.346265 ncdv-master-1 devstack@n-api.service[138745]: DEBUG neutronclient.v2_0.client [None req-3273c1b5-d068-4ce1-893c-39ae62f5248f tempest-FloatingIPDetailsNegativeTestJSON-1462238469 tempest-FloatingIPDetailsNegativeTestJSON-1462238469-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP c5d4e81a-3970-40a3-a807-7d2cc44a551b could not be found", "detail": ""}} {{(pid=138745) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 22 20:54:23.347374 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.wsgi [None req-3273c1b5-d068-4ce1-893c-39ae62f5248f tempest-FloatingIPDetailsNegativeTestJSON-1462238469 tempest-FloatingIPDetailsNegativeTestJSON-1462238469-project] HTTP exception thrown: Floating IP not found for ID c5d4e81a-3970-40a3-a807-7d2cc44a551b Oct 22 20:54:23.350312 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-3273c1b5-d068-4ce1-893c-39ae62f5248f tempest-FloatingIPDetailsNegativeTestJSON-1462238469 tempest-FloatingIPDetailsNegativeTestJSON-1462238469-project] Request method failure captured: Oct 22 20:54:23.350312 ncdv-master-1 devstack@n-api.service[138745]: request: GET /compute/v2.1/os-floating-ips/c5d4e81a-3970-40a3-a807-7d2cc44a551b HTTP/1.1 Oct 22 20:54:23.350312 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 20:54:23.350312 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 20:54:23.350312 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 20:54:23.350312 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 0 Oct 22 20:54:23.350312 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 20:54:23.350312 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 20:54:23.350312 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 20:54:23.350312 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 20:54:23.350312 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVFh9InKD3girweq1EK4l7skRwrOF-RXiMmQ1-_-2q4dOQs1fvQ5OThNqg_NORFHz5Z6PacRePJZw4ruZ43tkpbPKei8SgKCO1ewMNys7rn5QoDUi_qUrDThN8Ce841sU6INHLdstyDluS3Ze5IdS3i_eqeeXLHDbxj8vPEjuRTtgpbY Oct 22 20:54:23.350312 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 20:54:23.350312 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 20:54:23.350312 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 20:54:23.350312 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 20:54:23.350312 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 20:54:23.350312 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 20:54:23.350312 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: f5a5df13b7004d358c6829433774ee11 Oct 22 20:54:23.350312 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-FloatingIPDetailsNegativeTestJSON-1462238469 Oct 22 20:54:23.350312 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 20:54:23.350312 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 20:54:23.350312 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_f5a5df13b7004d358c6829433774ee11"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f5a5df13b7004d358c6829433774ee11"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/f5a5df13b7004d358c6829433774ee11"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f5a5df13b7004d358c6829433774ee11"}]}] Oct 22 20:54:23.350312 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-FloatingIPDetailsNegativeTestJSON-1462238469 Oct 22 20:54:23.350312 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: f5a5df13b7004d358c6829433774ee11 Oct 22 20:54:23.350312 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-FloatingIPDetailsNegativeTestJSON-1462238469 Oct 22 20:54:23.350312 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-FloatingIPDetailsNegativeTestJSON-1462238469-project Oct 22 20:54:23.350312 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 20:54:23.350312 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 20:54:23.350312 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: 6829888fa4014357a2dcc80a3fb58887 Oct 22 20:54:23.350312 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-FloatingIPDetailsNegativeTestJSON-1462238469-project Oct 22 20:54:23.350312 ncdv-master-1 devstack@n-api.service[138745]: method: Oct 22 20:54:23.350312 ncdv-master-1 devstack@n-api.service[138745]: exception: Floating IP not found for ID c5d4e81a-3970-40a3-a807-7d2cc44a551b Oct 22 20:54:23.350312 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'id': 'c5d4e81a-3970-40a3-a807-7d2cc44a551b'} Oct 22 20:54:23.350312 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:54:23.350312 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:54:23.350312 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 22 20:54:23.350312 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 22 20:54:23.350312 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 20:54:23.350312 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 20:54:23.350312 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 22 20:54:23.350312 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 22 20:54:23.350312 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 20:54:23.350312 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 20:54:23.350312 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 22 20:54:23.350312 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 22 20:54:23.350312 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 20:54:23.350312 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 20:54:23.350312 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 22 20:54:23.350312 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 22 20:54:23.350312 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 20:54:23.350312 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 20:54:23.350312 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 22 20:54:23.350312 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 22 20:54:23.350312 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 20:54:23.350312 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 20:54:23.350312 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 22 20:54:23.350312 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 22 20:54:23.350312 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 22 20:54:23.350312 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 22 20:54:23.350312 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP c5d4e81a-3970-40a3-a807-7d2cc44a551b could not be found Oct 22 20:54:23.354826 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3cfbec9d-f3a6-4403-8437-d055ef556b1f'] Oct 22 20:54:23.354826 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:54:23.354826 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:54:23.354826 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:54:23.354826 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:54:23.354826 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Oct 22 20:54:23.354826 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 22 20:54:23.354826 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 22 20:54:23.354826 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 22 20:54:23.354826 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID c5d4e81a-3970-40a3-a807-7d2cc44a551b. Oct 22 20:54:23.354826 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:54:23.354826 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:54:23.354826 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:54:23.354826 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:54:23.354826 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:54:23.354826 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:54:23.354826 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:54:23.354826 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:54:23.354826 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 22 20:54:23.354826 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 22 20:54:23.354826 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:54:23.354826 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:54:23.354826 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Oct 22 20:54:23.354826 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 22 20:54:23.354826 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID c5d4e81a-3970-40a3-a807-7d2cc44a551b Oct 22 20:54:23.354826 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:54:23.354826 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:54:23.354826 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:54:23.354826 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:54:23.354826 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:54:23.354826 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:54:23.354826 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 20:54:23.354826 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 20:54:23.354826 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID c5d4e81a-3970-40a3-a807-7d2cc44a551b Oct 22 20:54:23.354826 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:54:23.354826 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-3273c1b5-d068-4ce1-893c-39ae62f5248f tempest-FloatingIPDetailsNegativeTestJSON-1462238469 tempest-FloatingIPDetailsNegativeTestJSON-1462238469-project] Returning 404 to user: Floating IP not found for ID c5d4e81a-3970-40a3-a807-7d2cc44a551b {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:54:23.354826 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-3273c1b5-d068-4ce1-893c-39ae62f5248f tempest-FloatingIPDetailsNegativeTestJSON-1462238469 tempest-FloatingIPDetailsNegativeTestJSON-1462238469-project] 10.222.0.18 "GET /compute/v2.1/os-floating-ips/c5d4e81a-3970-40a3-a807-7d2cc44a551b" status: 404 len: 111 microversion: 2.1 time: 0.544817 Oct 22 20:54:23.357323 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 740/1399] 10.222.0.18 () {58 vars in 1260 bytes} [Sat Oct 22 20:54:22 2022] GET /compute/v2.1/os-floating-ips/c5d4e81a-3970-40a3-a807-7d2cc44a551b => generated 111 bytes in 547 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 20:54:23.364208 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-5e5b4f15-d160-41ee-87d1-e4b37780fed9 tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Calling method '.version_select at 0x7fd3a49688b0>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:54:23.448280 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-5e5b4f15-d160-41ee-87d1-e4b37780fed9 tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] 10.222.0.18 "GET /compute/v2.1/images/2c26b155-ef26-40a2-b7db-1b550c12a2cf" status: 200 len: 1429 microversion: 2.1 time: 0.092219 Oct 22 20:54:23.448874 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 741/1400] 10.222.0.18 () {58 vars in 1233 bytes} [Sat Oct 22 20:54:23 2022] GET /compute/v2.1/images/2c26b155-ef26-40a2-b7db-1b550c12a2cf => generated 1429 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:54:23.458528 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-f5791c1c-9d55-4a67-b89b-81068eb7333a req-45698416-69a9-4969-b527-65fd91447e83 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f2e1da0-4586-460b-94dc-768fd618dc3d", "tag": "4a4fea07-50e9-4003-ba39-6badf338429d"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:54:23.493209 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-f5791c1c-9d55-4a67-b89b-81068eb7333a req-45698416-69a9-4969-b527-65fd91447e83 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:23.496614 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-f5791c1c-9d55-4a67-b89b-81068eb7333a req-45698416-69a9-4969-b527-65fd91447e83 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:23.497904 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-f5791c1c-9d55-4a67-b89b-81068eb7333a req-45698416-69a9-4969-b527-65fd91447e83 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:23.553202 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-f5791c1c-9d55-4a67-b89b-81068eb7333a req-45698416-69a9-4969-b527-65fd91447e83 service nova] Creating event network-changed:4a4fea07-50e9-4003-ba39-6badf338429d for instance 8f2e1da0-4586-460b-94dc-768fd618dc3d on nch1-master-1 Oct 22 20:54:23.571859 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-f5791c1c-9d55-4a67-b89b-81068eb7333a req-45698416-69a9-4969-b527-65fd91447e83 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120166 Oct 22 20:54:23.573494 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 742/1401] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:54:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:54:23.591473 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-76d016bf-a7f2-4b52-b8c5-41732320c569 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:54:23.592533 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-76d016bf-a7f2-4b52-b8c5-41732320c569 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] [instance: 8f2e1da0-4586-460b-94dc-768fd618dc3d] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:54:23.622830 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-76d016bf-a7f2-4b52-b8c5-41732320c569 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:23.626478 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-76d016bf-a7f2-4b52-b8c5-41732320c569 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:23.627452 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-76d016bf-a7f2-4b52-b8c5-41732320c569 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:23.631487 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-76d016bf-a7f2-4b52-b8c5-41732320c569 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:23.633880 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-76d016bf-a7f2-4b52-b8c5-41732320c569 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:23.634888 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-76d016bf-a7f2-4b52-b8c5-41732320c569 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:24.922958 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-76d016bf-a7f2-4b52-b8c5-41732320c569 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c87f0356ca346f39c6216393d85da2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee8c8f7fc4e12bc1f9fcce3e7b581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:54:24.932048 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-76d016bf-a7f2-4b52-b8c5-41732320c569 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] 10.222.0.18 "GET /compute/v2.1/servers/8f2e1da0-4586-460b-94dc-768fd618dc3d" status: 200 len: 1715 microversion: 2.1 time: 1.355517 Oct 22 20:54:24.932634 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 743/1402] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:54:23 2022] GET /compute/v2.1/servers/8f2e1da0-4586-460b-94dc-768fd618dc3d => generated 1715 bytes in 1357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:54:24.951198 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-38d6ce43-e7ad-455b-a7a0-a3c6b7d31f08 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:54:24.951842 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-38d6ce43-e7ad-455b-a7a0-a3c6b7d31f08 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] [instance: 40e6c6e3-3d47-4781-b8a8-aafd671d7287] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:54:24.959074 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-38d6ce43-e7ad-455b-a7a0-a3c6b7d31f08 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:24.964005 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-38d6ce43-e7ad-455b-a7a0-a3c6b7d31f08 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:24.964667 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-38d6ce43-e7ad-455b-a7a0-a3c6b7d31f08 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:24.965574 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-38d6ce43-e7ad-455b-a7a0-a3c6b7d31f08 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:24.966183 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-38d6ce43-e7ad-455b-a7a0-a3c6b7d31f08 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:24.966788 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-38d6ce43-e7ad-455b-a7a0-a3c6b7d31f08 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:25.426577 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-38d6ce43-e7ad-455b-a7a0-a3c6b7d31f08 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d3d7458af447bdb3f03e83a2d8559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49238b8686d24ae698679e4a1957735d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:54:25.439326 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-38d6ce43-e7ad-455b-a7a0-a3c6b7d31f08 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] 10.222.0.18 "GET /compute/v2.1/servers/40e6c6e3-3d47-4781-b8a8-aafd671d7287" status: 200 len: 1313 microversion: 2.1 time: 0.505562 Oct 22 20:54:25.448553 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 744/1403] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:54:24 2022] GET /compute/v2.1/servers/40e6c6e3-3d47-4781-b8a8-aafd671d7287 => generated 1313 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:54:25.454309 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-98242cc0-8bdc-4553-ad8a-f46fb795e8cd tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-1879489341", "imageRef": "085e4478-6edc-4a69-8e08-f9831713eb65", "flavorRef": "452", "networks": [{"uuid": "c7cc5424-76de-49ad-b81e-26c2e65ddd67"}, {"uuid": "2a3df69a-5bca-4855-b973-b9cf5f310bfa"}]}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:54:25.491758 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-f690e6f6-cfd1-4449-89db-027957237947 tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] 10.222.0.18 "POST /compute/v2.1/servers/f499ce97-cdf8-4dcf-9c28-3758aea5e78c/action" status: 202 len: 0 microversion: 2.25 time: 5.395675 Oct 22 20:54:25.492961 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 660/1404] 10.222.0.18 () {62 vars in 1319 bytes} [Sat Oct 22 20:54:20 2022] POST /compute/v2.1/servers/f499ce97-cdf8-4dcf-9c28-3758aea5e78c/action => generated 0 bytes in 5398 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 22 20:54:25.498242 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-1c9d379b-a768-4773-87e0-1aa5b2ac3d99 tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Calling method '.version_select at 0x7fd3a4344430>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:54:25.629131 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.network.neutron [None req-98242cc0-8bdc-4553-ad8a-f46fb795e8cd tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] validate_networks() for [('c7cc5424-76de-49ad-b81e-26c2e65ddd67', None, None, None, None, None), ('2a3df69a-5bca-4855-b973-b9cf5f310bfa', None, None, None, None, None)] {{(pid=138745) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 20:54:25.653079 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-1c9d379b-a768-4773-87e0-1aa5b2ac3d99 tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] 10.222.0.18 "GET /compute/v2.1/images/2c26b155-ef26-40a2-b7db-1b550c12a2cf" status: 200 len: 1429 microversion: 2.1 time: 0.158992 Oct 22 20:54:25.653782 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 661/1405] 10.222.0.18 () {58 vars in 1233 bytes} [Sat Oct 22 20:54:25 2022] GET /compute/v2.1/images/2c26b155-ef26-40a2-b7db-1b550c12a2cf => generated 1429 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:54:25.677851 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-f9d8ad23-d4ee-42b7-8314-43e3c70d7621 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:54:25.681981 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-f9d8ad23-d4ee-42b7-8314-43e3c70d7621 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] [instance: f499ce97-cdf8-4dcf-9c28-3758aea5e78c] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:54:25.727994 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f9d8ad23-d4ee-42b7-8314-43e3c70d7621 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:25.734694 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f9d8ad23-d4ee-42b7-8314-43e3c70d7621 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:25.735444 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f9d8ad23-d4ee-42b7-8314-43e3c70d7621 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:25.737727 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f9d8ad23-d4ee-42b7-8314-43e3c70d7621 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:25.738410 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f9d8ad23-d4ee-42b7-8314-43e3c70d7621 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:25.739083 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f9d8ad23-d4ee-42b7-8314-43e3c70d7621 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:26.521764 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-f9d8ad23-d4ee-42b7-8314-43e3c70d7621 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:54:26.530710 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-f9d8ad23-d4ee-42b7-8314-43e3c70d7621 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:54:26.535568 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-f9d8ad23-d4ee-42b7-8314-43e3c70d7621 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:54:26.549021 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-f9d8ad23-d4ee-42b7-8314-43e3c70d7621 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] 10.222.0.18 "GET /compute/v2.1/servers/f499ce97-cdf8-4dcf-9c28-3758aea5e78c" status: 200 len: 1486 microversion: 2.25 time: 0.894026 Oct 22 20:54:26.563819 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 662/1406] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 20:54:25 2022] GET /compute/v2.1/servers/f499ce97-cdf8-4dcf-9c28-3758aea5e78c => generated 1486 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 20:54:26.573988 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-82d83de9-6ed4-4c4f-8691-37f024f42ce3 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:54:26.574811 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-82d83de9-6ed4-4c4f-8691-37f024f42ce3 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] [instance: 8f2e1da0-4586-460b-94dc-768fd618dc3d] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:54:26.588990 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-82d83de9-6ed4-4c4f-8691-37f024f42ce3 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:26.589712 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-82d83de9-6ed4-4c4f-8691-37f024f42ce3 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:26.592190 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-82d83de9-6ed4-4c4f-8691-37f024f42ce3 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:26.593529 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-82d83de9-6ed4-4c4f-8691-37f024f42ce3 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:26.595580 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-82d83de9-6ed4-4c4f-8691-37f024f42ce3 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:26.604907 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-82d83de9-6ed4-4c4f-8691-37f024f42ce3 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:27.148842 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-82d83de9-6ed4-4c4f-8691-37f024f42ce3 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c87f0356ca346f39c6216393d85da2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee8c8f7fc4e12bc1f9fcce3e7b581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:54:27.156287 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:54:27.159042 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-82d83de9-6ed4-4c4f-8691-37f024f42ce3 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] 10.222.0.18 "GET /compute/v2.1/servers/8f2e1da0-4586-460b-94dc-768fd618dc3d" status: 200 len: 1715 microversion: 2.1 time: 0.593828 Oct 22 20:54:27.159692 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 663/1407] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:54:26 2022] GET /compute/v2.1/servers/8f2e1da0-4586-460b-94dc-768fd618dc3d => generated 1715 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:54:27.180453 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-e4e3e48b-c438-4044-9133-febfa7db84bd tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:54:27.181090 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-e4e3e48b-c438-4044-9133-febfa7db84bd tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] [instance: 40e6c6e3-3d47-4781-b8a8-aafd671d7287] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:54:27.216096 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e4e3e48b-c438-4044-9133-febfa7db84bd tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:27.217299 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e4e3e48b-c438-4044-9133-febfa7db84bd tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:27.218331 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e4e3e48b-c438-4044-9133-febfa7db84bd tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:27.220109 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e4e3e48b-c438-4044-9133-febfa7db84bd tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:27.220832 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e4e3e48b-c438-4044-9133-febfa7db84bd tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:27.221548 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e4e3e48b-c438-4044-9133-febfa7db84bd tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:28.013964 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-e4e3e48b-c438-4044-9133-febfa7db84bd tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d3d7458af447bdb3f03e83a2d8559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49238b8686d24ae698679e4a1957735d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:54:28.031032 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-e4e3e48b-c438-4044-9133-febfa7db84bd tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] 10.222.0.18 "GET /compute/v2.1/servers/40e6c6e3-3d47-4781-b8a8-aafd671d7287" status: 200 len: 1313 microversion: 2.1 time: 0.870223 Oct 22 20:54:28.032253 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 664/1408] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:54:27 2022] GET /compute/v2.1/servers/40e6c6e3-3d47-4781-b8a8-aafd671d7287 => generated 1313 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:54:28.038707 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-0b2d5619-0c7a-4cfc-bc4c-3071592dcb19 req-221b85d5-19ed-4508-9e80-4b5b528dce56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40e6c6e3-3d47-4781-b8a8-aafd671d7287", "name": "network-vif-plugged", "status": "completed", "tag": "3f86770d-1d07-4131-85b9-86ddae7d31e5"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:54:28.074914 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-0b2d5619-0c7a-4cfc-bc4c-3071592dcb19 req-221b85d5-19ed-4508-9e80-4b5b528dce56 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:28.076029 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-0b2d5619-0c7a-4cfc-bc4c-3071592dcb19 req-221b85d5-19ed-4508-9e80-4b5b528dce56 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:28.076742 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-0b2d5619-0c7a-4cfc-bc4c-3071592dcb19 req-221b85d5-19ed-4508-9e80-4b5b528dce56 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:28.092783 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-0b2d5619-0c7a-4cfc-bc4c-3071592dcb19 req-221b85d5-19ed-4508-9e80-4b5b528dce56 service nova] Creating event network-vif-plugged:3f86770d-1d07-4131-85b9-86ddae7d31e5 for instance 40e6c6e3-3d47-4781-b8a8-aafd671d7287 on nch2-master-1 Oct 22 20:54:28.104910 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-0b2d5619-0c7a-4cfc-bc4c-3071592dcb19 req-221b85d5-19ed-4508-9e80-4b5b528dce56 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070475 Oct 22 20:54:28.106508 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 665/1409] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:54:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:54:28.112670 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-2e0757d5-1cbe-45c5-b73f-851ddf274bb9 tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Calling method '.version_select at 0x7fd3a42483a0>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:54:28.219865 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-2e0757d5-1cbe-45c5-b73f-851ddf274bb9 tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] 10.222.0.18 "GET /compute/v2.1/images/2c26b155-ef26-40a2-b7db-1b550c12a2cf" status: 200 len: 1438 microversion: 2.1 time: 0.111423 Oct 22 20:54:28.223599 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 666/1410] 10.222.0.18 () {58 vars in 1233 bytes} [Sat Oct 22 20:54:28 2022] GET /compute/v2.1/images/2c26b155-ef26-40a2-b7db-1b550c12a2cf => generated 1438 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:54:28.330374 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-7a731ced-b62f-4803-ae91-cc6591dc5e12 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-969158361", "imageRef": "085e4478-6edc-4a69-8e08-f9831713eb65", "flavorRef": "452", "networks": [{"uuid": "ba2fbd7d-5bd8-4316-b6a5-ea0e685a80cc"}]}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:54:28.411975 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-98242cc0-8bdc-4553-ad8a-f46fb795e8cd tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Flavor limits 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 20:54:28.412490 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-98242cc0-8bdc-4553-ad8a-f46fb795e8cd tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Image limits 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 20:54:28.412986 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-98242cc0-8bdc-4553-ad8a-f46fb795e8cd tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Flavor pref 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 20:54:28.413734 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-98242cc0-8bdc-4553-ad8a-f46fb795e8cd tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Image pref 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 20:54:28.413869 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.network.neutron [None req-7a731ced-b62f-4803-ae91-cc6591dc5e12 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] validate_networks() for [('ba2fbd7d-5bd8-4316-b6a5-ea0e685a80cc', None, None, None, None, None)] {{(pid=138744) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 20:54:28.415269 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-98242cc0-8bdc-4553-ad8a-f46fb795e8cd tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 20:54:28.422743 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_api:SELECT=83 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:54:28.431687 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-98242cc0-8bdc-4553-ad8a-f46fb795e8cd tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:28.433317 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-98242cc0-8bdc-4553-ad8a-f46fb795e8cd tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:28.435974 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-98242cc0-8bdc-4553-ad8a-f46fb795e8cd tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:28.437284 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-98242cc0-8bdc-4553-ad8a-f46fb795e8cd tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:28.438271 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-98242cc0-8bdc-4553-ad8a-f46fb795e8cd tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:28.438930 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-98242cc0-8bdc-4553-ad8a-f46fb795e8cd tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:28.452808 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:54:28.467624 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-98242cc0-8bdc-4553-ad8a-f46fb795e8cd tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Getting quotas for project 6bacf9909082440f8a201771b64a75fa. Resources: {'cores', 'instances', 'ram'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 20:54:28.475087 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-98242cc0-8bdc-4553-ad8a-f46fb795e8cd tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Getting quotas for user c7f48d18691d4473bbe0284c44f14d09 and project 6bacf9909082440f8a201771b64a75fa. Resources: {'cores', 'instances', 'ram'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 20:54:28.493635 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-98242cc0-8bdc-4553-ad8a-f46fb795e8cd tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Going to run 1 instances... {{(pid=138745) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 20:54:28.498081 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-98242cc0-8bdc-4553-ad8a-f46fb795e8cd tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] [instance: 0e92c2df-261e-44fd-b584-2f870190e8ce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='085e4478-6edc-4a69-8e08-f9831713eb65',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138745) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 20:54:28.580639 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-98242cc0-8bdc-4553-ad8a-f46fb795e8cd tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.129997 Oct 22 20:54:28.581322 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 745/1411] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Oct 22 20:54:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 3132 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 20:54:28.586175 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-b3bedabe-d322-472a-a2d3-ab5bfc8da803 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:54:28.586778 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-b3bedabe-d322-472a-a2d3-ab5bfc8da803 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] [instance: f499ce97-cdf8-4dcf-9c28-3758aea5e78c] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:54:28.612241 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b3bedabe-d322-472a-a2d3-ab5bfc8da803 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:28.615110 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b3bedabe-d322-472a-a2d3-ab5bfc8da803 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:28.616218 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b3bedabe-d322-472a-a2d3-ab5bfc8da803 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:28.617170 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b3bedabe-d322-472a-a2d3-ab5bfc8da803 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:28.617799 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b3bedabe-d322-472a-a2d3-ab5bfc8da803 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:28.618400 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b3bedabe-d322-472a-a2d3-ab5bfc8da803 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:29.323439 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-b3bedabe-d322-472a-a2d3-ab5bfc8da803 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:54:29.359044 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-b3bedabe-d322-472a-a2d3-ab5bfc8da803 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:54:29.363669 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-b3bedabe-d322-472a-a2d3-ab5bfc8da803 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:54:29.370335 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-b3bedabe-d322-472a-a2d3-ab5bfc8da803 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] 10.222.0.18 "GET /compute/v2.1/servers/f499ce97-cdf8-4dcf-9c28-3758aea5e78c" status: 200 len: 1486 microversion: 2.25 time: 0.787666 Oct 22 20:54:29.372874 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 746/1412] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 20:54:28 2022] GET /compute/v2.1/servers/f499ce97-cdf8-4dcf-9c28-3758aea5e78c => generated 1486 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 20:54:29.394559 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-52f71f39-2eec-40dd-85e1-811c6ff43985 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:54:29.395267 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-52f71f39-2eec-40dd-85e1-811c6ff43985 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] [instance: 8f2e1da0-4586-460b-94dc-768fd618dc3d] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:54:29.409483 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-52f71f39-2eec-40dd-85e1-811c6ff43985 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:29.410176 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-52f71f39-2eec-40dd-85e1-811c6ff43985 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:29.410811 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-52f71f39-2eec-40dd-85e1-811c6ff43985 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:29.412826 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-52f71f39-2eec-40dd-85e1-811c6ff43985 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:29.414002 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-52f71f39-2eec-40dd-85e1-811c6ff43985 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:29.414606 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-52f71f39-2eec-40dd-85e1-811c6ff43985 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:29.885831 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-52f71f39-2eec-40dd-85e1-811c6ff43985 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c87f0356ca346f39c6216393d85da2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee8c8f7fc4e12bc1f9fcce3e7b581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:54:29.896738 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-52f71f39-2eec-40dd-85e1-811c6ff43985 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] 10.222.0.18 "GET /compute/v2.1/servers/8f2e1da0-4586-460b-94dc-768fd618dc3d" status: 200 len: 1715 microversion: 2.1 time: 0.522654 Oct 22 20:54:29.897337 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 747/1413] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:54:29 2022] GET /compute/v2.1/servers/8f2e1da0-4586-460b-94dc-768fd618dc3d => generated 1715 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:54:29.908617 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-0e739615-8f7c-47bb-a3b6-1c0a9cb102b8 tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Calling method '.version_select at 0x7fd39fe43160>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:54:30.023252 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-0e739615-8f7c-47bb-a3b6-1c0a9cb102b8 tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] 10.222.0.18 "GET /compute/v2.1/images/2c26b155-ef26-40a2-b7db-1b550c12a2cf" status: 200 len: 1438 microversion: 2.1 time: 0.119312 Oct 22 20:54:30.026196 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 748/1414] 10.222.0.18 () {58 vars in 1233 bytes} [Sat Oct 22 20:54:29 2022] GET /compute/v2.1/images/2c26b155-ef26-40a2-b7db-1b550c12a2cf => generated 1438 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:54:30.042989 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-0395d330-df86-4034-ac29-1f120fbd896e tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:54:30.044136 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-0395d330-df86-4034-ac29-1f120fbd896e tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] [instance: 0e92c2df-261e-44fd-b584-2f870190e8ce] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:54:30.051325 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0395d330-df86-4034-ac29-1f120fbd896e tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:30.052294 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0395d330-df86-4034-ac29-1f120fbd896e tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:30.052896 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0395d330-df86-4034-ac29-1f120fbd896e tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:30.054532 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0395d330-df86-4034-ac29-1f120fbd896e tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:30.055211 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0395d330-df86-4034-ac29-1f120fbd896e tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:30.055916 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0395d330-df86-4034-ac29-1f120fbd896e tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:30.188875 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-7a731ced-b62f-4803-ae91-cc6591dc5e12 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Flavor limits 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 20:54:30.190092 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-7a731ced-b62f-4803-ae91-cc6591dc5e12 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Image limits 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 20:54:30.190750 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-7a731ced-b62f-4803-ae91-cc6591dc5e12 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Flavor pref 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 20:54:30.191273 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-7a731ced-b62f-4803-ae91-cc6591dc5e12 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Image pref 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 20:54:30.191814 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-7a731ced-b62f-4803-ae91-cc6591dc5e12 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 20:54:30.192442 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-0395d330-df86-4034-ac29-1f120fbd896e tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7f48d18691d4473bbe0284c44f14d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bacf9909082440f8a201771b64a75fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:54:30.205957 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-0395d330-df86-4034-ac29-1f120fbd896e tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] 10.222.0.18 "GET /compute/v2.1/servers/0e92c2df-261e-44fd-b584-2f870190e8ce" status: 200 len: 1265 microversion: 2.1 time: 0.175952 Oct 22 20:54:30.208697 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 749/1415] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:54:30 2022] GET /compute/v2.1/servers/0e92c2df-261e-44fd-b584-2f870190e8ce => generated 1265 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:54:30.217832 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7a731ced-b62f-4803-ae91-cc6591dc5e12 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:30.218365 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-bc567494-0d4b-4a74-84b3-81f0ec028eb8 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:54:30.219806 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-bc567494-0d4b-4a74-84b3-81f0ec028eb8 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] [instance: 40e6c6e3-3d47-4781-b8a8-aafd671d7287] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:54:30.221475 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7a731ced-b62f-4803-ae91-cc6591dc5e12 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:30.223096 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7a731ced-b62f-4803-ae91-cc6591dc5e12 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:30.229086 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7a731ced-b62f-4803-ae91-cc6591dc5e12 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:30.232770 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7a731ced-b62f-4803-ae91-cc6591dc5e12 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:30.233469 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7a731ced-b62f-4803-ae91-cc6591dc5e12 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:30.234568 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bc567494-0d4b-4a74-84b3-81f0ec028eb8 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:30.238327 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bc567494-0d4b-4a74-84b3-81f0ec028eb8 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:30.239750 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bc567494-0d4b-4a74-84b3-81f0ec028eb8 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:30.242292 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bc567494-0d4b-4a74-84b3-81f0ec028eb8 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:30.243113 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bc567494-0d4b-4a74-84b3-81f0ec028eb8 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:30.244409 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bc567494-0d4b-4a74-84b3-81f0ec028eb8 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:30.289786 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-7a731ced-b62f-4803-ae91-cc6591dc5e12 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Getting quotas for project 42111ed6bcc3465d8c1f5291da248e74. Resources: {'cores', 'instances', 'ram'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 20:54:30.313158 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-7a731ced-b62f-4803-ae91-cc6591dc5e12 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Getting quotas for user 5be93cabff0d46ccb2a3db0db1a13796 and project 42111ed6bcc3465d8c1f5291da248e74. Resources: {'cores', 'instances', 'ram'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 20:54:30.352136 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-7a731ced-b62f-4803-ae91-cc6591dc5e12 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Going to run 1 instances... {{(pid=138744) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 20:54:30.357717 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-7a731ced-b62f-4803-ae91-cc6591dc5e12 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] [instance: 29a351ac-ecf5-4b11-9bdd-f1c93df1335a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='085e4478-6edc-4a69-8e08-f9831713eb65',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138744) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 20:54:30.482218 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-7a731ced-b62f-4803-ae91-cc6591dc5e12 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.252764 Oct 22 20:54:30.483784 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 667/1416] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Oct 22 20:54:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 2259 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 20:54:30.506525 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-bf85aa79-8ed4-4afb-bbb5-a44643cf6581 tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:54:30.507676 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-bf85aa79-8ed4-4afb-bbb5-a44643cf6581 tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] [instance: 472bbccc-485e-43ce-a9cd-a3148bfccdbd] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:54:30.524181 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bf85aa79-8ed4-4afb-bbb5-a44643cf6581 tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:30.525082 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bf85aa79-8ed4-4afb-bbb5-a44643cf6581 tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:30.526340 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bf85aa79-8ed4-4afb-bbb5-a44643cf6581 tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:30.528392 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bf85aa79-8ed4-4afb-bbb5-a44643cf6581 tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:30.533115 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bf85aa79-8ed4-4afb-bbb5-a44643cf6581 tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:30.533450 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bf85aa79-8ed4-4afb-bbb5-a44643cf6581 tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:30.713577 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-bc567494-0d4b-4a74-84b3-81f0ec028eb8 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d3d7458af447bdb3f03e83a2d8559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49238b8686d24ae698679e4a1957735d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:54:30.727520 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-bc567494-0d4b-4a74-84b3-81f0ec028eb8 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] 10.222.0.18 "GET /compute/v2.1/servers/40e6c6e3-3d47-4781-b8a8-aafd671d7287" status: 200 len: 1313 microversion: 2.1 time: 0.516525 Oct 22 20:54:30.732603 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 750/1417] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:54:30 2022] GET /compute/v2.1/servers/40e6c6e3-3d47-4781-b8a8-aafd671d7287 => generated 1313 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:54:30.740705 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-ee9791fe-da99-41a5-826c-215392775c0b tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:54:30.743905 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-ee9791fe-da99-41a5-826c-215392775c0b tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] [instance: f499ce97-cdf8-4dcf-9c28-3758aea5e78c] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:54:30.765873 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ee9791fe-da99-41a5-826c-215392775c0b tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:30.768545 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ee9791fe-da99-41a5-826c-215392775c0b tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:30.770718 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ee9791fe-da99-41a5-826c-215392775c0b tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:30.772648 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ee9791fe-da99-41a5-826c-215392775c0b tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:30.775258 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ee9791fe-da99-41a5-826c-215392775c0b tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:30.779132 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ee9791fe-da99-41a5-826c-215392775c0b tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:31.290502 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-bf85aa79-8ed4-4afb-bbb5-a44643cf6581 tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01ba79ccd0d940a2899a035635862219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0400ae826f8e4bd8a2e4c981880a59c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:54:31.301453 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-bf85aa79-8ed4-4afb-bbb5-a44643cf6581 tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] 10.222.0.18 "GET /compute/v2.1/servers/472bbccc-485e-43ce-a9cd-a3148bfccdbd" status: 200 len: 1465 microversion: 2.1 time: 0.814368 Oct 22 20:54:31.305479 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 668/1418] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:54:30 2022] GET /compute/v2.1/servers/472bbccc-485e-43ce-a9cd-a3148bfccdbd => generated 1465 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:54:31.315856 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-397ec050-a756-47fd-96a4-8df262d5b6c8 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:54:31.321009 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-397ec050-a756-47fd-96a4-8df262d5b6c8 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] [instance: 29a351ac-ecf5-4b11-9bdd-f1c93df1335a] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:54:31.536654 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-397ec050-a756-47fd-96a4-8df262d5b6c8 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be93cabff0d46ccb2a3db0db1a13796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42111ed6bcc3465d8c1f5291da248e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:54:31.549500 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-397ec050-a756-47fd-96a4-8df262d5b6c8 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] 10.222.0.18 "GET /compute/v2.1/servers/29a351ac-ecf5-4b11-9bdd-f1c93df1335a" status: 200 len: 1223 microversion: 2.1 time: 0.241754 Oct 22 20:54:31.553545 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 669/1419] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:54:31 2022] GET /compute/v2.1/servers/29a351ac-ecf5-4b11-9bdd-f1c93df1335a => generated 1223 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:54:31.564462 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-3c6533ed-5c38-4a66-8b68-1bfa0aa81244 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:54:31.566740 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-3c6533ed-5c38-4a66-8b68-1bfa0aa81244 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] [instance: 8f2e1da0-4586-460b-94dc-768fd618dc3d] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:54:31.584094 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3c6533ed-5c38-4a66-8b68-1bfa0aa81244 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:31.585553 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3c6533ed-5c38-4a66-8b68-1bfa0aa81244 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:31.586177 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3c6533ed-5c38-4a66-8b68-1bfa0aa81244 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:31.588337 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3c6533ed-5c38-4a66-8b68-1bfa0aa81244 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:31.589003 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3c6533ed-5c38-4a66-8b68-1bfa0aa81244 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:31.590706 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3c6533ed-5c38-4a66-8b68-1bfa0aa81244 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:32.072967 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-ee9791fe-da99-41a5-826c-215392775c0b tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:54:32.096855 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-ee9791fe-da99-41a5-826c-215392775c0b tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:54:32.101808 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-ee9791fe-da99-41a5-826c-215392775c0b tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:54:32.107497 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-ee9791fe-da99-41a5-826c-215392775c0b tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] 10.222.0.18 "GET /compute/v2.1/servers/f499ce97-cdf8-4dcf-9c28-3758aea5e78c" status: 200 len: 1486 microversion: 2.25 time: 1.369382 Oct 22 20:54:32.108402 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 751/1420] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 20:54:30 2022] GET /compute/v2.1/servers/f499ce97-cdf8-4dcf-9c28-3758aea5e78c => generated 1486 bytes in 1375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 20:54:32.119812 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-b9fa3acb-58f7-4edc-8eb1-f96eb124a114 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:54:32.120752 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-b9fa3acb-58f7-4edc-8eb1-f96eb124a114 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] [instance: 0e92c2df-261e-44fd-b584-2f870190e8ce] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:54:32.133281 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b9fa3acb-58f7-4edc-8eb1-f96eb124a114 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:32.136511 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b9fa3acb-58f7-4edc-8eb1-f96eb124a114 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:32.137134 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b9fa3acb-58f7-4edc-8eb1-f96eb124a114 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:32.141565 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b9fa3acb-58f7-4edc-8eb1-f96eb124a114 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:32.142046 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b9fa3acb-58f7-4edc-8eb1-f96eb124a114 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:32.142508 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b9fa3acb-58f7-4edc-8eb1-f96eb124a114 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:32.450525 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-3c6533ed-5c38-4a66-8b68-1bfa0aa81244 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c87f0356ca346f39c6216393d85da2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee8c8f7fc4e12bc1f9fcce3e7b581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:54:32.473514 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-3c6533ed-5c38-4a66-8b68-1bfa0aa81244 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] 10.222.0.18 "GET /compute/v2.1/servers/8f2e1da0-4586-460b-94dc-768fd618dc3d" status: 200 len: 1715 microversion: 2.1 time: 0.916589 Oct 22 20:54:32.482490 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 670/1421] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:54:31 2022] GET /compute/v2.1/servers/8f2e1da0-4586-460b-94dc-768fd618dc3d => generated 1715 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:54:32.498595 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-ddf15493-5956-40f9-976b-7729ee7e144b tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Calling method '.version_select at 0x7fd3a41f59d0>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:54:32.862213 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-b9fa3acb-58f7-4edc-8eb1-f96eb124a114 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7f48d18691d4473bbe0284c44f14d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bacf9909082440f8a201771b64a75fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:54:32.883840 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-b9fa3acb-58f7-4edc-8eb1-f96eb124a114 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] 10.222.0.18 "GET /compute/v2.1/servers/0e92c2df-261e-44fd-b584-2f870190e8ce" status: 200 len: 1313 microversion: 2.1 time: 0.773995 Oct 22 20:54:32.890671 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 752/1422] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:54:32 2022] GET /compute/v2.1/servers/0e92c2df-261e-44fd-b584-2f870190e8ce => generated 1313 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:54:32.902269 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-2b52a003-2d7e-4c86-8f1e-4816505e9c8f tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:54:32.906258 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-2b52a003-2d7e-4c86-8f1e-4816505e9c8f tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] [instance: 40e6c6e3-3d47-4781-b8a8-aafd671d7287] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:54:32.954631 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2b52a003-2d7e-4c86-8f1e-4816505e9c8f tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:32.955591 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2b52a003-2d7e-4c86-8f1e-4816505e9c8f tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:32.956223 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2b52a003-2d7e-4c86-8f1e-4816505e9c8f tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:32.957396 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2b52a003-2d7e-4c86-8f1e-4816505e9c8f tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:32.958133 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2b52a003-2d7e-4c86-8f1e-4816505e9c8f tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:32.959634 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2b52a003-2d7e-4c86-8f1e-4816505e9c8f tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:33.772547 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-ddf15493-5956-40f9-976b-7729ee7e144b tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] 10.222.0.18 "DELETE /compute/v2.1/images/2c26b155-ef26-40a2-b7db-1b550c12a2cf" status: 204 len: 0 microversion: 2.1 time: 1.288342 Oct 22 20:54:33.773483 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 671/1423] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:54:32 2022] DELETE /compute/v2.1/images/2c26b155-ef26-40a2-b7db-1b550c12a2cf => generated 0 bytes in 1290 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 20:54:33.780302 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-13a09c20-12a2-438e-af18-72a4f5d1b6ff req-6f404350-55d6-4f98-9d9d-f0f6c6bf5277 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "472bbccc-485e-43ce-a9cd-a3148bfccdbd", "name": "network-vif-unplugged", "status": "completed", "tag": "23775c97-962a-4643-9a82-cfb4b15013e8"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:54:33.815297 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-13a09c20-12a2-438e-af18-72a4f5d1b6ff req-6f404350-55d6-4f98-9d9d-f0f6c6bf5277 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:33.815883 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-13a09c20-12a2-438e-af18-72a4f5d1b6ff req-6f404350-55d6-4f98-9d9d-f0f6c6bf5277 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:33.816376 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-13a09c20-12a2-438e-af18-72a4f5d1b6ff req-6f404350-55d6-4f98-9d9d-f0f6c6bf5277 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:33.849977 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-13a09c20-12a2-438e-af18-72a4f5d1b6ff req-6f404350-55d6-4f98-9d9d-f0f6c6bf5277 service nova] Creating event network-vif-unplugged:23775c97-962a-4643-9a82-cfb4b15013e8 for instance 472bbccc-485e-43ce-a9cd-a3148bfccdbd on nch1-master-1 Oct 22 20:54:33.872493 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-13a09c20-12a2-438e-af18-72a4f5d1b6ff req-6f404350-55d6-4f98-9d9d-f0f6c6bf5277 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.090591 Oct 22 20:54:33.873608 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 672/1424] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:54:33 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:54:33.879492 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-c47076aa-bd8a-408b-98bf-236ba85af793 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:54:33.880541 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-c47076aa-bd8a-408b-98bf-236ba85af793 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] [instance: 29a351ac-ecf5-4b11-9bdd-f1c93df1335a] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:54:33.887880 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c47076aa-bd8a-408b-98bf-236ba85af793 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:33.888872 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c47076aa-bd8a-408b-98bf-236ba85af793 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:33.889575 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c47076aa-bd8a-408b-98bf-236ba85af793 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:33.890517 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c47076aa-bd8a-408b-98bf-236ba85af793 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:33.891193 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c47076aa-bd8a-408b-98bf-236ba85af793 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:33.891918 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c47076aa-bd8a-408b-98bf-236ba85af793 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:34.208835 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-c47076aa-bd8a-408b-98bf-236ba85af793 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be93cabff0d46ccb2a3db0db1a13796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42111ed6bcc3465d8c1f5291da248e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:54:34.223752 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-c47076aa-bd8a-408b-98bf-236ba85af793 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] 10.222.0.18 "GET /compute/v2.1/servers/29a351ac-ecf5-4b11-9bdd-f1c93df1335a" status: 200 len: 1281 microversion: 2.1 time: 0.348374 Oct 22 20:54:34.224799 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 673/1425] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:54:33 2022] GET /compute/v2.1/servers/29a351ac-ecf5-4b11-9bdd-f1c93df1335a => generated 1281 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:54:34.231647 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-7d4c407f-01f5-4caf-b309-d2e4d99c91d1 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:54:34.232496 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-7d4c407f-01f5-4caf-b309-d2e4d99c91d1 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] [instance: f499ce97-cdf8-4dcf-9c28-3758aea5e78c] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:54:34.240022 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7d4c407f-01f5-4caf-b309-d2e4d99c91d1 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:34.240767 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7d4c407f-01f5-4caf-b309-d2e4d99c91d1 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:34.241195 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7d4c407f-01f5-4caf-b309-d2e4d99c91d1 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:34.242104 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7d4c407f-01f5-4caf-b309-d2e4d99c91d1 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:34.242557 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7d4c407f-01f5-4caf-b309-d2e4d99c91d1 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:34.242979 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7d4c407f-01f5-4caf-b309-d2e4d99c91d1 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:34.833804 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-2b52a003-2d7e-4c86-8f1e-4816505e9c8f tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d3d7458af447bdb3f03e83a2d8559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49238b8686d24ae698679e4a1957735d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:54:34.855659 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-2b52a003-2d7e-4c86-8f1e-4816505e9c8f tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] 10.222.0.18 "GET /compute/v2.1/servers/40e6c6e3-3d47-4781-b8a8-aafd671d7287" status: 200 len: 1463 microversion: 2.1 time: 1.960906 Oct 22 20:54:34.892417 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 753/1426] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:54:32 2022] GET /compute/v2.1/servers/40e6c6e3-3d47-4781-b8a8-aafd671d7287 => generated 1463 bytes in 1997 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:54:34.905098 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-a884f5f2-3eb6-410f-ad71-dcd77338654f tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:54:34.905814 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-a884f5f2-3eb6-410f-ad71-dcd77338654f tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] [instance: 8f2e1da0-4586-460b-94dc-768fd618dc3d] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:54:34.916796 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a884f5f2-3eb6-410f-ad71-dcd77338654f tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:34.918216 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a884f5f2-3eb6-410f-ad71-dcd77338654f tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:34.920326 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a884f5f2-3eb6-410f-ad71-dcd77338654f tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:34.921313 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a884f5f2-3eb6-410f-ad71-dcd77338654f tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:34.922675 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a884f5f2-3eb6-410f-ad71-dcd77338654f tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:34.923669 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a884f5f2-3eb6-410f-ad71-dcd77338654f tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:35.076422 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-7d4c407f-01f5-4caf-b309-d2e4d99c91d1 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:54:35.087440 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-7d4c407f-01f5-4caf-b309-d2e4d99c91d1 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:54:35.094908 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-7d4c407f-01f5-4caf-b309-d2e4d99c91d1 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:54:35.098502 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-7d4c407f-01f5-4caf-b309-d2e4d99c91d1 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] 10.222.0.18 "GET /compute/v2.1/servers/f499ce97-cdf8-4dcf-9c28-3758aea5e78c" status: 200 len: 1486 microversion: 2.25 time: 0.870658 Oct 22 20:54:35.099453 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 674/1427] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 20:54:34 2022] GET /compute/v2.1/servers/f499ce97-cdf8-4dcf-9c28-3758aea5e78c => generated 1486 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 20:54:35.117647 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-8f7a4f54-ab12-4302-a3a4-93e064393037 tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Calling method '.version_select at 0x7fd3a4066160>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:54:35.190660 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-8f7a4f54-ab12-4302-a3a4-93e064393037 tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] HTTP exception thrown: Image not found. Oct 22 20:54:35.194777 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-8f7a4f54-ab12-4302-a3a4-93e064393037 tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Request method failure captured: Oct 22 20:54:35.194777 ncdv-master-1 devstack@n-api.service[138744]: request: DELETE /compute/v2.1/images/9585a413-1cc7-4173-a4e4-f771201c7779 HTTP/1.1 Oct 22 20:54:35.194777 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 20:54:35.194777 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 20:54:35.194777 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 20:54:35.194777 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 0 Oct 22 20:54:35.194777 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 20:54:35.194777 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 20:54:35.194777 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 20:54:35.194777 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 20:54:35.194777 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVFgfbDqlMbbcVsIQGadAvBPZz8r5GC-oGNB3Snt-dfXaCXrgz_GtUcLSUgMs2MQqo0otZKIX84y4vMPH6M8jteEdeaEvGJu60ZpfzRYx0J8iU-yneOFONCqD6_B1k7kGvXS092S_SutdOlOU3ozDByeqLPQtUIX77mZjZvvTb7ZZnFU Oct 22 20:54:35.194777 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 20:54:35.194777 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 20:54:35.194777 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 20:54:35.194777 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 20:54:35.194777 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 20:54:35.194777 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 20:54:35.194777 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: 0400ae826f8e4bd8a2e4c981880a59c5 Oct 22 20:54:35.194777 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-ImagesOneServerTestJSON-1366907274 Oct 22 20:54:35.194777 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 20:54:35.194777 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 20:54:35.194777 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_0400ae826f8e4bd8a2e4c981880a59c5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0400ae826f8e4bd8a2e4c981880a59c5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/0400ae826f8e4bd8a2e4c981880a59c5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0400ae826f8e4bd8a2e4c981880a59c5"}]}] Oct 22 20:54:35.194777 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-ImagesOneServerTestJSON-1366907274 Oct 22 20:54:35.194777 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: 0400ae826f8e4bd8a2e4c981880a59c5 Oct 22 20:54:35.194777 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1366907274 Oct 22 20:54:35.194777 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-ImagesOneServerTestJSON-1366907274-project Oct 22 20:54:35.194777 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 20:54:35.194777 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 20:54:35.194777 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: 01ba79ccd0d940a2899a035635862219 Oct 22 20:54:35.194777 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-ImagesOneServerTestJSON-1366907274-project Oct 22 20:54:35.194777 ncdv-master-1 devstack@n-api.service[138744]: method: Oct 22 20:54:35.194777 ncdv-master-1 devstack@n-api.service[138744]: exception: Image not found. Oct 22 20:54:35.194777 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': '9585a413-1cc7-4173-a4e4-f771201c7779'} Oct 22 20:54:35.194777 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:54:35.194777 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:54:35.194777 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 22 20:54:35.194777 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 22 20:54:35.194777 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 22 20:54:35.194777 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 22 20:54:35.194777 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 22 20:54:35.194777 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 22 20:54:35.194777 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 22 20:54:35.194777 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 22 20:54:35.194777 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 22 20:54:35.194777 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 22 20:54:35.194777 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 22 20:54:35.194777 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 22 20:54:35.194777 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 22 20:54:35.194777 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 22 20:54:35.194777 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 9585a413-1cc7-4173-a4e4-f771201c7779 to delete Oct 22 20:54:35.194777 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:54:35.194777 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:54:35.194777 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:54:35.194777 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:54:35.194777 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 22 20:54:35.194777 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 22 20:54:35.194777 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 22 20:54:35.194777 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 22 20:54:35.194777 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 22 20:54:35.194777 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 22 20:54:35.194777 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 9585a413-1cc7-4173-a4e4-f771201c7779 could not be found. Oct 22 20:54:35.194777 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:54:35.194777 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:54:35.194777 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:54:35.194777 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:54:35.200514 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:54:35.200514 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:54:35.200514 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:54:35.200514 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:54:35.200514 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 22 20:54:35.200514 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 22 20:54:35.200514 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:54:35.200514 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:54:35.200514 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 22 20:54:35.200514 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 22 20:54:35.200514 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 22 20:54:35.200514 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:54:35.200514 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:54:35.200514 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:54:35.200514 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:54:35.200514 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:54:35.200514 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:54:35.200514 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 20:54:35.200514 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 20:54:35.200514 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 22 20:54:35.200514 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:54:35.205486 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-8f7a4f54-ab12-4302-a3a4-93e064393037 tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Returning 404 to user: Image not found. {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:54:35.206587 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-8f7a4f54-ab12-4302-a3a4-93e064393037 tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] 10.222.0.18 "DELETE /compute/v2.1/images/9585a413-1cc7-4173-a4e4-f771201c7779" status: 404 len: 62 microversion: 2.1 time: 0.105281 Oct 22 20:54:35.207728 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 675/1428] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:54:35 2022] DELETE /compute/v2.1/images/9585a413-1cc7-4173-a4e4-f771201c7779 => generated 62 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 22 20:54:35.216058 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-606f0926-2705-423c-b87b-d5af78723927 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:54:35.216893 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-606f0926-2705-423c-b87b-d5af78723927 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] [instance: 0e92c2df-261e-44fd-b584-2f870190e8ce] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:54:35.237636 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-606f0926-2705-423c-b87b-d5af78723927 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:35.238467 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-606f0926-2705-423c-b87b-d5af78723927 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:35.239949 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-606f0926-2705-423c-b87b-d5af78723927 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:35.241967 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-606f0926-2705-423c-b87b-d5af78723927 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:35.244218 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-606f0926-2705-423c-b87b-d5af78723927 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:35.245068 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-606f0926-2705-423c-b87b-d5af78723927 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:35.549675 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-a884f5f2-3eb6-410f-ad71-dcd77338654f tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c87f0356ca346f39c6216393d85da2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee8c8f7fc4e12bc1f9fcce3e7b581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:54:35.561981 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-a884f5f2-3eb6-410f-ad71-dcd77338654f tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] 10.222.0.18 "GET /compute/v2.1/servers/8f2e1da0-4586-460b-94dc-768fd618dc3d" status: 200 len: 1715 microversion: 2.1 time: 0.668225 Oct 22 20:54:35.563424 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 754/1429] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:54:34 2022] GET /compute/v2.1/servers/8f2e1da0-4586-460b-94dc-768fd618dc3d => generated 1715 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:54:35.611431 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-606f0926-2705-423c-b87b-d5af78723927 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7f48d18691d4473bbe0284c44f14d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bacf9909082440f8a201771b64a75fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:54:35.625506 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-606f0926-2705-423c-b87b-d5af78723927 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] 10.222.0.18 "GET /compute/v2.1/servers/0e92c2df-261e-44fd-b584-2f870190e8ce" status: 200 len: 1334 microversion: 2.1 time: 0.416067 Oct 22 20:54:35.628210 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 676/1430] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:54:35 2022] GET /compute/v2.1/servers/0e92c2df-261e-44fd-b584-2f870190e8ce => generated 1334 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:54:35.637411 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-f5c5fa7c-f0b7-406a-ab6c-eaf258a62cfe tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:54:35.648019 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-f5c5fa7c-f0b7-406a-ab6c-eaf258a62cfe tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] [instance: 472bbccc-485e-43ce-a9cd-a3148bfccdbd] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:54:35.675905 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f5c5fa7c-f0b7-406a-ab6c-eaf258a62cfe tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:35.679751 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f5c5fa7c-f0b7-406a-ab6c-eaf258a62cfe tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:35.683009 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f5c5fa7c-f0b7-406a-ab6c-eaf258a62cfe tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:35.684178 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f5c5fa7c-f0b7-406a-ab6c-eaf258a62cfe tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:35.684842 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f5c5fa7c-f0b7-406a-ab6c-eaf258a62cfe tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:35.686358 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f5c5fa7c-f0b7-406a-ab6c-eaf258a62cfe tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:35.760249 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-f5c5fa7c-f0b7-406a-ab6c-eaf258a62cfe tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] [instance: 472bbccc-485e-43ce-a9cd-a3148bfccdbd] Going to try to terminate instance {{(pid=138744) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 20:54:35.949783 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-f5c5fa7c-f0b7-406a-ab6c-eaf258a62cfe tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] 10.222.0.18 "DELETE /compute/v2.1/servers/472bbccc-485e-43ce-a9cd-a3148bfccdbd" status: 204 len: 0 microversion: 2.1 time: 0.316083 Oct 22 20:54:35.952859 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 677/1431] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 20:54:35 2022] DELETE /compute/v2.1/servers/472bbccc-485e-43ce-a9cd-a3148bfccdbd => generated 0 bytes in 322 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 20:54:35.966727 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-dd793c89-4932-4e87-852a-6a6dd79e33b1 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:54:35.968913 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-dd793c89-4932-4e87-852a-6a6dd79e33b1 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] [instance: 29a351ac-ecf5-4b11-9bdd-f1c93df1335a] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:54:35.987693 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-dd793c89-4932-4e87-852a-6a6dd79e33b1 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:35.989665 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-dd793c89-4932-4e87-852a-6a6dd79e33b1 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:35.990986 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-dd793c89-4932-4e87-852a-6a6dd79e33b1 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:35.993184 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-dd793c89-4932-4e87-852a-6a6dd79e33b1 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:35.993888 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-dd793c89-4932-4e87-852a-6a6dd79e33b1 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:35.994505 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-dd793c89-4932-4e87-852a-6a6dd79e33b1 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:35.998085 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-8f619b29-7e4c-43d5-aaf5-05849b86aa24 tempest-MigrationsAdminTest-1403807426 tempest-MigrationsAdminTest-1403807426-project-admin] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:54:35.999302 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-8f619b29-7e4c-43d5-aaf5-05849b86aa24 tempest-MigrationsAdminTest-1403807426 tempest-MigrationsAdminTest-1403807426-project-admin] [instance: 40e6c6e3-3d47-4781-b8a8-aafd671d7287] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:54:36.010744 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8f619b29-7e4c-43d5-aaf5-05849b86aa24 tempest-MigrationsAdminTest-1403807426 tempest-MigrationsAdminTest-1403807426-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:36.015968 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8f619b29-7e4c-43d5-aaf5-05849b86aa24 tempest-MigrationsAdminTest-1403807426 tempest-MigrationsAdminTest-1403807426-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:36.017075 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8f619b29-7e4c-43d5-aaf5-05849b86aa24 tempest-MigrationsAdminTest-1403807426 tempest-MigrationsAdminTest-1403807426-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:36.018947 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8f619b29-7e4c-43d5-aaf5-05849b86aa24 tempest-MigrationsAdminTest-1403807426 tempest-MigrationsAdminTest-1403807426-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:36.021370 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8f619b29-7e4c-43d5-aaf5-05849b86aa24 tempest-MigrationsAdminTest-1403807426 tempest-MigrationsAdminTest-1403807426-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:36.023614 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8f619b29-7e4c-43d5-aaf5-05849b86aa24 tempest-MigrationsAdminTest-1403807426 tempest-MigrationsAdminTest-1403807426-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:36.398605 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-dd793c89-4932-4e87-852a-6a6dd79e33b1 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be93cabff0d46ccb2a3db0db1a13796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42111ed6bcc3465d8c1f5291da248e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:54:36.427218 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-dd793c89-4932-4e87-852a-6a6dd79e33b1 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] 10.222.0.18 "GET /compute/v2.1/servers/29a351ac-ecf5-4b11-9bdd-f1c93df1335a" status: 200 len: 1323 microversion: 2.1 time: 0.462510 Oct 22 20:54:36.430841 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 678/1432] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:54:35 2022] GET /compute/v2.1/servers/29a351ac-ecf5-4b11-9bdd-f1c93df1335a => generated 1323 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:54:36.439572 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-b62422f3-ec28-401e-8ff9-fd4917cad09b tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:54:36.441420 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-b62422f3-ec28-401e-8ff9-fd4917cad09b tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] [instance: 472bbccc-485e-43ce-a9cd-a3148bfccdbd] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:54:36.456821 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b62422f3-ec28-401e-8ff9-fd4917cad09b tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:36.465151 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b62422f3-ec28-401e-8ff9-fd4917cad09b tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:36.469055 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b62422f3-ec28-401e-8ff9-fd4917cad09b tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:36.470356 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b62422f3-ec28-401e-8ff9-fd4917cad09b tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:36.471541 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b62422f3-ec28-401e-8ff9-fd4917cad09b tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:36.472716 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b62422f3-ec28-401e-8ff9-fd4917cad09b tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:36.803301 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-8f619b29-7e4c-43d5-aaf5-05849b86aa24 tempest-MigrationsAdminTest-1403807426 tempest-MigrationsAdminTest-1403807426-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/40e6c6e3-3d47-4781-b8a8-aafd671d7287" status: 200 len: 1614 microversion: 2.1 time: 1.238527 Oct 22 20:54:36.806908 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 755/1433] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:54:35 2022] GET /compute/v2.1/servers/40e6c6e3-3d47-4781-b8a8-aafd671d7287 => generated 1614 bytes in 1243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:54:36.827950 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-b0c8873a-d398-42b8-bbcf-fbdd39801391 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:54:36.829038 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-b0c8873a-d398-42b8-bbcf-fbdd39801391 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] [instance: f499ce97-cdf8-4dcf-9c28-3758aea5e78c] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:54:36.838832 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b0c8873a-d398-42b8-bbcf-fbdd39801391 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:36.839733 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b0c8873a-d398-42b8-bbcf-fbdd39801391 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:36.840987 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b0c8873a-d398-42b8-bbcf-fbdd39801391 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:36.842507 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b0c8873a-d398-42b8-bbcf-fbdd39801391 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:36.843363 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b0c8873a-d398-42b8-bbcf-fbdd39801391 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:36.844230 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b0c8873a-d398-42b8-bbcf-fbdd39801391 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:36.867369 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-b62422f3-ec28-401e-8ff9-fd4917cad09b tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01ba79ccd0d940a2899a035635862219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0400ae826f8e4bd8a2e4c981880a59c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:54:36.875762 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-b62422f3-ec28-401e-8ff9-fd4917cad09b tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] 10.222.0.18 "GET /compute/v2.1/servers/472bbccc-485e-43ce-a9cd-a3148bfccdbd" status: 200 len: 1471 microversion: 2.1 time: 0.443482 Oct 22 20:54:36.891524 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 679/1434] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:54:36 2022] GET /compute/v2.1/servers/472bbccc-485e-43ce-a9cd-a3148bfccdbd => generated 1471 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:54:36.905131 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-15dde9bb-dae3-41d1-80cc-20565ef48cd5 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:54:36.906428 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-15dde9bb-dae3-41d1-80cc-20565ef48cd5 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] [instance: 8f2e1da0-4586-460b-94dc-768fd618dc3d] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:54:36.913291 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-15dde9bb-dae3-41d1-80cc-20565ef48cd5 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:36.913940 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-15dde9bb-dae3-41d1-80cc-20565ef48cd5 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:36.914492 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-15dde9bb-dae3-41d1-80cc-20565ef48cd5 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:36.915303 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-15dde9bb-dae3-41d1-80cc-20565ef48cd5 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:36.916468 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-15dde9bb-dae3-41d1-80cc-20565ef48cd5 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:36.917008 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-15dde9bb-dae3-41d1-80cc-20565ef48cd5 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:37.406199 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-15dde9bb-dae3-41d1-80cc-20565ef48cd5 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c87f0356ca346f39c6216393d85da2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee8c8f7fc4e12bc1f9fcce3e7b581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:54:37.442013 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-15dde9bb-dae3-41d1-80cc-20565ef48cd5 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] 10.222.0.18 "GET /compute/v2.1/servers/8f2e1da0-4586-460b-94dc-768fd618dc3d" status: 200 len: 1705 microversion: 2.1 time: 0.559804 Oct 22 20:54:37.443083 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 680/1435] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:54:36 2022] GET /compute/v2.1/servers/8f2e1da0-4586-460b-94dc-768fd618dc3d => generated 1705 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:54:37.462132 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-08c5128d-ee0b-42a9-bae6-4691ec071f19 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:54:37.467767 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-08c5128d-ee0b-42a9-bae6-4691ec071f19 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] [instance: 0e92c2df-261e-44fd-b584-2f870190e8ce] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:54:37.480572 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-b0c8873a-d398-42b8-bbcf-fbdd39801391 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:54:37.539315 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-b0c8873a-d398-42b8-bbcf-fbdd39801391 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:54:37.543131 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-08c5128d-ee0b-42a9-bae6-4691ec071f19 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:37.544810 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-08c5128d-ee0b-42a9-bae6-4691ec071f19 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:37.546719 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-08c5128d-ee0b-42a9-bae6-4691ec071f19 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:37.553687 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-08c5128d-ee0b-42a9-bae6-4691ec071f19 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:37.554882 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-08c5128d-ee0b-42a9-bae6-4691ec071f19 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:37.556914 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-08c5128d-ee0b-42a9-bae6-4691ec071f19 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:37.573022 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-b0c8873a-d398-42b8-bbcf-fbdd39801391 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:54:37.597861 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-b0c8873a-d398-42b8-bbcf-fbdd39801391 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] 10.222.0.18 "GET /compute/v2.1/servers/f499ce97-cdf8-4dcf-9c28-3758aea5e78c" status: 200 len: 1486 microversion: 2.25 time: 0.765601 Oct 22 20:54:37.605055 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 756/1436] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 20:54:36 2022] GET /compute/v2.1/servers/f499ce97-cdf8-4dcf-9c28-3758aea5e78c => generated 1486 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 20:54:37.650226 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-8b35b1cd-ba63-415d-976a-a2ef3844bf98 tempest-MigrationsAdminTest-1403807426 tempest-MigrationsAdminTest-1403807426-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:54:37.651199 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-8b35b1cd-ba63-415d-976a-a2ef3844bf98 tempest-MigrationsAdminTest-1403807426 tempest-MigrationsAdminTest-1403807426-project-admin] [instance: 40e6c6e3-3d47-4781-b8a8-aafd671d7287] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:54:37.669550 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8b35b1cd-ba63-415d-976a-a2ef3844bf98 tempest-MigrationsAdminTest-1403807426 tempest-MigrationsAdminTest-1403807426-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:37.681308 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8b35b1cd-ba63-415d-976a-a2ef3844bf98 tempest-MigrationsAdminTest-1403807426 tempest-MigrationsAdminTest-1403807426-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:37.682131 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8b35b1cd-ba63-415d-976a-a2ef3844bf98 tempest-MigrationsAdminTest-1403807426 tempest-MigrationsAdminTest-1403807426-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:37.693142 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8b35b1cd-ba63-415d-976a-a2ef3844bf98 tempest-MigrationsAdminTest-1403807426 tempest-MigrationsAdminTest-1403807426-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:37.694008 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8b35b1cd-ba63-415d-976a-a2ef3844bf98 tempest-MigrationsAdminTest-1403807426 tempest-MigrationsAdminTest-1403807426-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:37.694752 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8b35b1cd-ba63-415d-976a-a2ef3844bf98 tempest-MigrationsAdminTest-1403807426 tempest-MigrationsAdminTest-1403807426-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:38.029717 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-8b35b1cd-ba63-415d-976a-a2ef3844bf98 tempest-MigrationsAdminTest-1403807426 tempest-MigrationsAdminTest-1403807426-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '3a4182f462944ed395775d823014f847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164ae46cbb694cd999c7b4b0bcb4fdba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:54:38.044589 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-8b35b1cd-ba63-415d-976a-a2ef3844bf98 tempest-MigrationsAdminTest-1403807426 tempest-MigrationsAdminTest-1403807426-project-admin] [instance: 40e6c6e3-3d47-4781-b8a8-aafd671d7287] flavor_id is None. Assuming migration. {{(pid=138745) resize /opt/stack/nova/nova/compute/api.py:4196}} Oct 22 20:54:38.046365 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-8b35b1cd-ba63-415d-976a-a2ef3844bf98 tempest-MigrationsAdminTest-1403807426 tempest-MigrationsAdminTest-1403807426-project-admin] [instance: 40e6c6e3-3d47-4781-b8a8-aafd671d7287] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=138745) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 22 20:54:38.454280 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell0:SELECT=4 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:54:38.484644 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell0:SELECT=6 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:54:38.718430 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-8b35b1cd-ba63-415d-976a-a2ef3844bf98 tempest-MigrationsAdminTest-1403807426 tempest-MigrationsAdminTest-1403807426-project-admin] 10.222.0.18 "POST /compute/v2.1/servers/40e6c6e3-3d47-4781-b8a8-aafd671d7287/action" status: 202 len: 0 microversion: 2.1 time: 1.111419 Oct 22 20:54:38.719954 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 757/1437] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 20:54:37 2022] POST /compute/v2.1/servers/40e6c6e3-3d47-4781-b8a8-aafd671d7287/action => generated 0 bytes in 1114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 20:54:38.728723 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-ce83a389-093b-4be1-aaab-1e65efd2c5e1 req-4ba3cb59-6bca-4d08-bba1-9f8dd60d5a5d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e92c2df-261e-44fd-b584-2f870190e8ce", "tag": "0179715f-adee-41ed-a569-67196aa24ae5"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:54:38.744068 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-ce83a389-093b-4be1-aaab-1e65efd2c5e1 req-4ba3cb59-6bca-4d08-bba1-9f8dd60d5a5d service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:38.744983 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-ce83a389-093b-4be1-aaab-1e65efd2c5e1 req-4ba3cb59-6bca-4d08-bba1-9f8dd60d5a5d service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:38.745697 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-ce83a389-093b-4be1-aaab-1e65efd2c5e1 req-4ba3cb59-6bca-4d08-bba1-9f8dd60d5a5d service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:38.746350 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-08c5128d-ee0b-42a9-bae6-4691ec071f19 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7f48d18691d4473bbe0284c44f14d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bacf9909082440f8a201771b64a75fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:54:38.760347 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-08c5128d-ee0b-42a9-bae6-4691ec071f19 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] 10.222.0.18 "GET /compute/v2.1/servers/0e92c2df-261e-44fd-b584-2f870190e8ce" status: 200 len: 1334 microversion: 2.1 time: 1.314590 Oct 22 20:54:38.762433 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 681/1438] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:54:37 2022] GET /compute/v2.1/servers/0e92c2df-261e-44fd-b584-2f870190e8ce => generated 1334 bytes in 1318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:54:38.771150 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-2969528a-fd9d-41a3-a866-f29913bb7bf9 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:54:38.772058 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-2969528a-fd9d-41a3-a866-f29913bb7bf9 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] [instance: 29a351ac-ecf5-4b11-9bdd-f1c93df1335a] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:54:38.782052 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-ce83a389-093b-4be1-aaab-1e65efd2c5e1 req-4ba3cb59-6bca-4d08-bba1-9f8dd60d5a5d service nova] Creating event network-changed:0179715f-adee-41ed-a569-67196aa24ae5 for instance 0e92c2df-261e-44fd-b584-2f870190e8ce on nch1-master-1 Oct 22 20:54:38.791956 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-ce83a389-093b-4be1-aaab-1e65efd2c5e1 req-4ba3cb59-6bca-4d08-bba1-9f8dd60d5a5d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068975 Oct 22 20:54:38.793560 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 758/1439] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:54:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:54:38.794438 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2969528a-fd9d-41a3-a866-f29913bb7bf9 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:38.796020 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2969528a-fd9d-41a3-a866-f29913bb7bf9 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:38.796474 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2969528a-fd9d-41a3-a866-f29913bb7bf9 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:38.798379 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2969528a-fd9d-41a3-a866-f29913bb7bf9 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:38.800619 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2969528a-fd9d-41a3-a866-f29913bb7bf9 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:38.801235 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2969528a-fd9d-41a3-a866-f29913bb7bf9 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:38.803200 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-92071097-2a61-441a-bfca-bda12d02c7ef tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] Calling method '.version_select at 0x7fd3a4968940>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:54:38.808868 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-92071097-2a61-441a-bfca-bda12d02c7ef tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:38.809841 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-92071097-2a61-441a-bfca-bda12d02c7ef tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:38.814284 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-92071097-2a61-441a-bfca-bda12d02c7ef tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:38.843596 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-92071097-2a61-441a-bfca-bda12d02c7ef tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] 10.222.0.18 "GET /compute/v2.1/os-migrations" status: 200 len: 2699 microversion: 2.1 time: 0.048244 Oct 22 20:54:38.846457 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 759/1440] 10.222.0.18 () {58 vars in 1143 bytes} [Sat Oct 22 20:54:38 2022] GET /compute/v2.1/os-migrations => generated 2699 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:54:38.873653 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-d696e188-5ecc-4825-a1bf-501f1e047a9b tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:54:38.875859 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-d696e188-5ecc-4825-a1bf-501f1e047a9b tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] [instance: 472bbccc-485e-43ce-a9cd-a3148bfccdbd] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:54:38.891712 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d696e188-5ecc-4825-a1bf-501f1e047a9b tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:38.893233 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d696e188-5ecc-4825-a1bf-501f1e047a9b tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:38.894458 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d696e188-5ecc-4825-a1bf-501f1e047a9b tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:38.896023 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d696e188-5ecc-4825-a1bf-501f1e047a9b tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:38.896759 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d696e188-5ecc-4825-a1bf-501f1e047a9b tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:38.897675 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d696e188-5ecc-4825-a1bf-501f1e047a9b tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:39.454497 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-d696e188-5ecc-4825-a1bf-501f1e047a9b tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01ba79ccd0d940a2899a035635862219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0400ae826f8e4bd8a2e4c981880a59c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:54:39.475204 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-d696e188-5ecc-4825-a1bf-501f1e047a9b tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] 10.222.0.18 "GET /compute/v2.1/servers/472bbccc-485e-43ce-a9cd-a3148bfccdbd" status: 200 len: 1471 microversion: 2.1 time: 0.612938 Oct 22 20:54:39.479260 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 760/1441] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:54:38 2022] GET /compute/v2.1/servers/472bbccc-485e-43ce-a9cd-a3148bfccdbd => generated 1471 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:54:39.484585 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-9dbd3388-f98c-458a-b609-7855c20c09be tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:54:39.491333 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-9dbd3388-f98c-458a-b609-7855c20c09be tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] [instance: f499ce97-cdf8-4dcf-9c28-3758aea5e78c] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:54:39.516567 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9dbd3388-f98c-458a-b609-7855c20c09be tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:39.520163 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9dbd3388-f98c-458a-b609-7855c20c09be tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:39.522417 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9dbd3388-f98c-458a-b609-7855c20c09be tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:39.523295 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9dbd3388-f98c-458a-b609-7855c20c09be tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:39.524481 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-2969528a-fd9d-41a3-a866-f29913bb7bf9 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be93cabff0d46ccb2a3db0db1a13796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42111ed6bcc3465d8c1f5291da248e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:54:39.525903 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9dbd3388-f98c-458a-b609-7855c20c09be tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:39.526813 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9dbd3388-f98c-458a-b609-7855c20c09be tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:39.541212 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-2969528a-fd9d-41a3-a866-f29913bb7bf9 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] 10.222.0.18 "GET /compute/v2.1/servers/29a351ac-ecf5-4b11-9bdd-f1c93df1335a" status: 200 len: 1323 microversion: 2.1 time: 0.776121 Oct 22 20:54:39.542919 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 682/1442] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:54:38 2022] GET /compute/v2.1/servers/29a351ac-ecf5-4b11-9bdd-f1c93df1335a => generated 1323 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:54:39.548094 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-def1c319-20c4-4ca8-98a7-e8dd8919882e tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:54:39.548930 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-def1c319-20c4-4ca8-98a7-e8dd8919882e tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] [instance: 40e6c6e3-3d47-4781-b8a8-aafd671d7287] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:54:39.556205 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-def1c319-20c4-4ca8-98a7-e8dd8919882e tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:39.556947 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-def1c319-20c4-4ca8-98a7-e8dd8919882e tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:39.557551 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-def1c319-20c4-4ca8-98a7-e8dd8919882e tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:39.558451 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-def1c319-20c4-4ca8-98a7-e8dd8919882e tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:39.559056 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-def1c319-20c4-4ca8-98a7-e8dd8919882e tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:39.559688 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-def1c319-20c4-4ca8-98a7-e8dd8919882e tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:40.047582 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-9dbd3388-f98c-458a-b609-7855c20c09be tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:54:40.058216 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-9dbd3388-f98c-458a-b609-7855c20c09be tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:54:40.067204 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-def1c319-20c4-4ca8-98a7-e8dd8919882e tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d3d7458af447bdb3f03e83a2d8559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49238b8686d24ae698679e4a1957735d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:54:40.073549 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-9dbd3388-f98c-458a-b609-7855c20c09be tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:54:40.078626 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-def1c319-20c4-4ca8-98a7-e8dd8919882e tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] 10.222.0.18 "GET /compute/v2.1/servers/40e6c6e3-3d47-4781-b8a8-aafd671d7287" status: 200 len: 1472 microversion: 2.1 time: 0.534424 Oct 22 20:54:40.081650 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 683/1443] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:54:39 2022] GET /compute/v2.1/servers/40e6c6e3-3d47-4781-b8a8-aafd671d7287 => generated 1472 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:54:40.084386 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-9dbd3388-f98c-458a-b609-7855c20c09be tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] 10.222.0.18 "GET /compute/v2.1/servers/f499ce97-cdf8-4dcf-9c28-3758aea5e78c" status: 200 len: 1486 microversion: 2.25 time: 0.600562 Oct 22 20:54:40.091080 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 761/1444] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 20:54:39 2022] GET /compute/v2.1/servers/f499ce97-cdf8-4dcf-9c28-3758aea5e78c => generated 1486 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 20:54:40.100261 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-ca86f0e6-5147-4e81-9898-7e2e3424f11d tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:54:40.112255 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-ca86f0e6-5147-4e81-9898-7e2e3424f11d tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] [instance: 8f2e1da0-4586-460b-94dc-768fd618dc3d] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:54:40.118969 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-e16101e6-bbd8-46ab-b2fa-e046c69d9ff0 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:54:40.120169 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-e16101e6-bbd8-46ab-b2fa-e046c69d9ff0 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] [instance: 0e92c2df-261e-44fd-b584-2f870190e8ce] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:54:40.139368 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ca86f0e6-5147-4e81-9898-7e2e3424f11d tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:40.141334 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e16101e6-bbd8-46ab-b2fa-e046c69d9ff0 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:40.142131 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ca86f0e6-5147-4e81-9898-7e2e3424f11d tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:40.147540 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e16101e6-bbd8-46ab-b2fa-e046c69d9ff0 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:40.148016 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ca86f0e6-5147-4e81-9898-7e2e3424f11d tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:40.148915 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ca86f0e6-5147-4e81-9898-7e2e3424f11d tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:40.149447 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e16101e6-bbd8-46ab-b2fa-e046c69d9ff0 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:40.150634 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e16101e6-bbd8-46ab-b2fa-e046c69d9ff0 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:40.151067 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ca86f0e6-5147-4e81-9898-7e2e3424f11d tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:40.151634 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ca86f0e6-5147-4e81-9898-7e2e3424f11d tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:40.152341 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e16101e6-bbd8-46ab-b2fa-e046c69d9ff0 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:40.155959 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e16101e6-bbd8-46ab-b2fa-e046c69d9ff0 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:40.269680 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell0:SELECT=2 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:54:40.572857 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:54:40.587768 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-ca86f0e6-5147-4e81-9898-7e2e3424f11d tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/8f2e1da0-4586-460b-94dc-768fd618dc3d" status: 200 len: 1856 microversion: 2.1 time: 0.503104 Oct 22 20:54:40.594482 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 684/1445] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:54:40 2022] GET /compute/v2.1/servers/8f2e1da0-4586-460b-94dc-768fd618dc3d => generated 1856 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:54:40.604280 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-02d38bcb-9899-4558-a130-fab39f0125e4 req-49d89842-ca43-49b5-aacc-7f70f1e9dfdf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "472bbccc-485e-43ce-a9cd-a3148bfccdbd", "name": "network-vif-deleted", "tag": "23775c97-962a-4643-9a82-cfb4b15013e8"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:54:40.629253 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-02d38bcb-9899-4558-a130-fab39f0125e4 req-49d89842-ca43-49b5-aacc-7f70f1e9dfdf service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:40.630093 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-02d38bcb-9899-4558-a130-fab39f0125e4 req-49d89842-ca43-49b5-aacc-7f70f1e9dfdf service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:40.630750 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-02d38bcb-9899-4558-a130-fab39f0125e4 req-49d89842-ca43-49b5-aacc-7f70f1e9dfdf service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:40.647008 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-02d38bcb-9899-4558-a130-fab39f0125e4 req-49d89842-ca43-49b5-aacc-7f70f1e9dfdf service nova] Creating event network-vif-deleted:23775c97-962a-4643-9a82-cfb4b15013e8 for instance 472bbccc-485e-43ce-a9cd-a3148bfccdbd on nch1-master-1 Oct 22 20:54:40.653447 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-02d38bcb-9899-4558-a130-fab39f0125e4 req-49d89842-ca43-49b5-aacc-7f70f1e9dfdf service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057328 Oct 22 20:54:40.654625 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 685/1446] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:54:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:54:40.660668 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-cd40ca46-efba-46a8-959a-4e3ae5d7026f tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:54:40.662218 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-cd40ca46-efba-46a8-959a-4e3ae5d7026f tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] [instance: 472bbccc-485e-43ce-a9cd-a3148bfccdbd] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:54:40.683400 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cd40ca46-efba-46a8-959a-4e3ae5d7026f tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:40.684782 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cd40ca46-efba-46a8-959a-4e3ae5d7026f tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:40.689538 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cd40ca46-efba-46a8-959a-4e3ae5d7026f tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:40.694110 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cd40ca46-efba-46a8-959a-4e3ae5d7026f tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:40.698691 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cd40ca46-efba-46a8-959a-4e3ae5d7026f tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:40.702061 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cd40ca46-efba-46a8-959a-4e3ae5d7026f tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:40.761616 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cd40ca46-efba-46a8-959a-4e3ae5d7026f tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:40.763013 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cd40ca46-efba-46a8-959a-4e3ae5d7026f tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:40.772190 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cd40ca46-efba-46a8-959a-4e3ae5d7026f tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:40.775100 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.objects.instance [None req-cd40ca46-efba-46a8-959a-4e3ae5d7026f tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Lazy-loading 'fault' on Instance uuid 472bbccc-485e-43ce-a9cd-a3148bfccdbd {{(pid=138744) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 20:54:41.087158 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-cd40ca46-efba-46a8-959a-4e3ae5d7026f tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01ba79ccd0d940a2899a035635862219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0400ae826f8e4bd8a2e4c981880a59c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:54:41.098556 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-cd40ca46-efba-46a8-959a-4e3ae5d7026f tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] 10.222.0.18 "GET /compute/v2.1/servers/472bbccc-485e-43ce-a9cd-a3148bfccdbd" status: 200 len: 1306 microversion: 2.1 time: 0.440799 Oct 22 20:54:41.098556 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 686/1447] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:54:40 2022] GET /compute/v2.1/servers/472bbccc-485e-43ce-a9cd-a3148bfccdbd => generated 1306 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:54:41.110593 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-ca660582-1fab-4d58-9b02-932bb7c9f80e tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:54:41.113437 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-ca660582-1fab-4d58-9b02-932bb7c9f80e tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] [instance: 29a351ac-ecf5-4b11-9bdd-f1c93df1335a] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:54:41.128557 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ca660582-1fab-4d58-9b02-932bb7c9f80e tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:41.129049 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ca660582-1fab-4d58-9b02-932bb7c9f80e tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:41.134920 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ca660582-1fab-4d58-9b02-932bb7c9f80e tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:41.134920 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ca660582-1fab-4d58-9b02-932bb7c9f80e tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:41.135587 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ca660582-1fab-4d58-9b02-932bb7c9f80e tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:41.136518 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ca660582-1fab-4d58-9b02-932bb7c9f80e tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:41.548945 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell0:SELECT=8 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:54:41.895445 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-e16101e6-bbd8-46ab-b2fa-e046c69d9ff0 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7f48d18691d4473bbe0284c44f14d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bacf9909082440f8a201771b64a75fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:54:41.907177 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-e16101e6-bbd8-46ab-b2fa-e046c69d9ff0 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] 10.222.0.18 "GET /compute/v2.1/servers/0e92c2df-261e-44fd-b584-2f870190e8ce" status: 200 len: 1334 microversion: 2.1 time: 1.814143 Oct 22 20:54:41.926808 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 762/1448] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:54:40 2022] GET /compute/v2.1/servers/0e92c2df-261e-44fd-b584-2f870190e8ce => generated 1334 bytes in 1831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:54:41.935478 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-5cab66b2-6958-4afe-8b35-5205776aa375 tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:54:41.936454 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-5cab66b2-6958-4afe-8b35-5205776aa375 tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] [instance: 8f2e1da0-4586-460b-94dc-768fd618dc3d] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:54:41.947580 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5cab66b2-6958-4afe-8b35-5205776aa375 tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:41.948721 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5cab66b2-6958-4afe-8b35-5205776aa375 tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:41.949402 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5cab66b2-6958-4afe-8b35-5205776aa375 tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:41.950364 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5cab66b2-6958-4afe-8b35-5205776aa375 tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:41.951058 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5cab66b2-6958-4afe-8b35-5205776aa375 tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:41.951776 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5cab66b2-6958-4afe-8b35-5205776aa375 tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:41.961529 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:54:42.006332 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-ca660582-1fab-4d58-9b02-932bb7c9f80e tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be93cabff0d46ccb2a3db0db1a13796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42111ed6bcc3465d8c1f5291da248e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:54:42.036553 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-ca660582-1fab-4d58-9b02-932bb7c9f80e tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] 10.222.0.18 "GET /compute/v2.1/servers/29a351ac-ecf5-4b11-9bdd-f1c93df1335a" status: 200 len: 1323 microversion: 2.1 time: 0.935555 Oct 22 20:54:42.054532 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 687/1449] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:54:41 2022] GET /compute/v2.1/servers/29a351ac-ecf5-4b11-9bdd-f1c93df1335a => generated 1323 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:54:42.061068 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-78a03e66-adb0-4789-acd7-9b22a9f099cd req-c470e8f1-47a7-408e-af17-fa32e11ba66c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29a351ac-ecf5-4b11-9bdd-f1c93df1335a", "tag": "07fb8283-cc10-46e3-bd70-2c1e5b8c3aef"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:54:42.077394 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-78a03e66-adb0-4789-acd7-9b22a9f099cd req-c470e8f1-47a7-408e-af17-fa32e11ba66c service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:42.078390 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-78a03e66-adb0-4789-acd7-9b22a9f099cd req-c470e8f1-47a7-408e-af17-fa32e11ba66c service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:42.079068 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-78a03e66-adb0-4789-acd7-9b22a9f099cd req-c470e8f1-47a7-408e-af17-fa32e11ba66c service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:42.099039 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-78a03e66-adb0-4789-acd7-9b22a9f099cd req-c470e8f1-47a7-408e-af17-fa32e11ba66c service nova] Creating event network-changed:07fb8283-cc10-46e3-bd70-2c1e5b8c3aef for instance 29a351ac-ecf5-4b11-9bdd-f1c93df1335a on nch2-master-1 Oct 22 20:54:42.108239 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-78a03e66-adb0-4789-acd7-9b22a9f099cd req-c470e8f1-47a7-408e-af17-fa32e11ba66c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051728 Oct 22 20:54:42.109475 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 688/1450] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:54:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:54:42.118141 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-0fd33b34-526c-492a-8568-9345fb60042f tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:54:42.119123 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-0fd33b34-526c-492a-8568-9345fb60042f tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] [instance: 40e6c6e3-3d47-4781-b8a8-aafd671d7287] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:54:42.128069 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0fd33b34-526c-492a-8568-9345fb60042f tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:42.128934 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0fd33b34-526c-492a-8568-9345fb60042f tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:42.130183 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0fd33b34-526c-492a-8568-9345fb60042f tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:42.131484 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0fd33b34-526c-492a-8568-9345fb60042f tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:42.132194 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0fd33b34-526c-492a-8568-9345fb60042f tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:42.132889 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0fd33b34-526c-492a-8568-9345fb60042f tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:42.274487 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-5cab66b2-6958-4afe-8b35-5205776aa375 tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/8f2e1da0-4586-460b-94dc-768fd618dc3d" status: 200 len: 1856 microversion: 2.1 time: 0.344454 Oct 22 20:54:42.277432 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 763/1451] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:54:41 2022] GET /compute/v2.1/servers/8f2e1da0-4586-460b-94dc-768fd618dc3d => generated 1856 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:54:42.331012 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-ad20636b-4d37-4974-85ec-c00a19a30c6d tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:54:42.333648 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-ad20636b-4d37-4974-85ec-c00a19a30c6d tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] [instance: f499ce97-cdf8-4dcf-9c28-3758aea5e78c] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:54:42.349165 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ad20636b-4d37-4974-85ec-c00a19a30c6d tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:42.351285 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ad20636b-4d37-4974-85ec-c00a19a30c6d tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:42.352600 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ad20636b-4d37-4974-85ec-c00a19a30c6d tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:42.354219 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ad20636b-4d37-4974-85ec-c00a19a30c6d tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:42.357820 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ad20636b-4d37-4974-85ec-c00a19a30c6d tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:42.359259 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ad20636b-4d37-4974-85ec-c00a19a30c6d tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:42.627184 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-0fd33b34-526c-492a-8568-9345fb60042f tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d3d7458af447bdb3f03e83a2d8559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49238b8686d24ae698679e4a1957735d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:54:42.642788 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-0fd33b34-526c-492a-8568-9345fb60042f tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] 10.222.0.18 "GET /compute/v2.1/servers/40e6c6e3-3d47-4781-b8a8-aafd671d7287" status: 200 len: 1472 microversion: 2.1 time: 0.531582 Oct 22 20:54:42.643669 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 689/1452] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:54:42 2022] GET /compute/v2.1/servers/40e6c6e3-3d47-4781-b8a8-aafd671d7287 => generated 1472 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:54:42.649001 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-926f9864-d2a9-4bc4-9aa2-6875c48921c1 tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:54:42.660191 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-926f9864-d2a9-4bc4-9aa2-6875c48921c1 tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] [instance: 472bbccc-485e-43ce-a9cd-a3148bfccdbd] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:54:42.667808 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-926f9864-d2a9-4bc4-9aa2-6875c48921c1 tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:42.668445 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-926f9864-d2a9-4bc4-9aa2-6875c48921c1 tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:42.668974 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-926f9864-d2a9-4bc4-9aa2-6875c48921c1 tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:42.671548 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-926f9864-d2a9-4bc4-9aa2-6875c48921c1 tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:42.672344 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-926f9864-d2a9-4bc4-9aa2-6875c48921c1 tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:42.674402 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-926f9864-d2a9-4bc4-9aa2-6875c48921c1 tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:42.714400 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-926f9864-d2a9-4bc4-9aa2-6875c48921c1 tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] HTTP exception thrown: Instance 472bbccc-485e-43ce-a9cd-a3148bfccdbd could not be found. Oct 22 20:54:42.717657 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-926f9864-d2a9-4bc4-9aa2-6875c48921c1 tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Request method failure captured: Oct 22 20:54:42.717657 ncdv-master-1 devstack@n-api.service[138744]: request: GET /compute/v2.1/servers/472bbccc-485e-43ce-a9cd-a3148bfccdbd HTTP/1.1 Oct 22 20:54:42.717657 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 20:54:42.717657 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 20:54:42.717657 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 20:54:42.717657 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 0 Oct 22 20:54:42.717657 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 20:54:42.717657 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 20:54:42.717657 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 20:54:42.717657 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 20:54:42.717657 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVFgfbDqlMbbcVsIQGadAvBPZz8r5GC-oGNB3Snt-dfXaCXrgz_GtUcLSUgMs2MQqo0otZKIX84y4vMPH6M8jteEdeaEvGJu60ZpfzRYx0J8iU-yneOFONCqD6_B1k7kGvXS092S_SutdOlOU3ozDByeqLPQtUIX77mZjZvvTb7ZZnFU Oct 22 20:54:42.717657 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 20:54:42.717657 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 20:54:42.717657 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 20:54:42.717657 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 20:54:42.717657 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 20:54:42.717657 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 20:54:42.717657 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: 0400ae826f8e4bd8a2e4c981880a59c5 Oct 22 20:54:42.717657 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-ImagesOneServerTestJSON-1366907274 Oct 22 20:54:42.717657 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 20:54:42.717657 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 20:54:42.717657 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_0400ae826f8e4bd8a2e4c981880a59c5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0400ae826f8e4bd8a2e4c981880a59c5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/0400ae826f8e4bd8a2e4c981880a59c5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0400ae826f8e4bd8a2e4c981880a59c5"}]}] Oct 22 20:54:42.717657 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-ImagesOneServerTestJSON-1366907274 Oct 22 20:54:42.717657 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: 0400ae826f8e4bd8a2e4c981880a59c5 Oct 22 20:54:42.717657 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1366907274 Oct 22 20:54:42.717657 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-ImagesOneServerTestJSON-1366907274-project Oct 22 20:54:42.717657 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 20:54:42.717657 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 20:54:42.717657 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: 01ba79ccd0d940a2899a035635862219 Oct 22 20:54:42.717657 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-ImagesOneServerTestJSON-1366907274-project Oct 22 20:54:42.717657 ncdv-master-1 devstack@n-api.service[138744]: method: > Oct 22 20:54:42.717657 ncdv-master-1 devstack@n-api.service[138744]: exception: Instance 472bbccc-485e-43ce-a9cd-a3148bfccdbd could not be found. Oct 22 20:54:42.717657 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': '472bbccc-485e-43ce-a9cd-a3148bfccdbd'} Oct 22 20:54:42.717657 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:54:42.717657 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:54:42.717657 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 20:54:42.717657 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 20:54:42.717657 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 20:54:42.717657 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 20:54:42.717657 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 20:54:42.717657 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 20:54:42.717657 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 20:54:42.717657 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 20:54:42.717657 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 472bbccc-485e-43ce-a9cd-a3148bfccdbd could not be found. Oct 22 20:54:42.717657 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:54:42.717657 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:54:42.717657 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:54:42.717657 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:54:42.717657 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:54:42.717657 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:54:42.717657 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:54:42.717657 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:54:42.717657 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:54:42.717657 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:54:42.717657 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 20:54:42.717657 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 20:54:42.717657 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 20:54:42.717657 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 20:54:42.717657 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 20:54:42.717657 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 20:54:42.717657 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 472bbccc-485e-43ce-a9cd-a3148bfccdbd could not be found. Oct 22 20:54:42.717657 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:54:42.717657 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:54:42.717657 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:54:42.724732 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:54:42.724732 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:54:42.724732 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:54:42.724732 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 20:54:42.724732 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 20:54:42.724732 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 472bbccc-485e-43ce-a9cd-a3148bfccdbd could not be found. Oct 22 20:54:42.724732 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:54:42.724732 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-926f9864-d2a9-4bc4-9aa2-6875c48921c1 tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] Returning 404 to user: Instance 472bbccc-485e-43ce-a9cd-a3148bfccdbd could not be found. {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:54:42.724732 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-926f9864-d2a9-4bc4-9aa2-6875c48921c1 tempest-ImagesOneServerTestJSON-1366907274 tempest-ImagesOneServerTestJSON-1366907274-project] 10.222.0.18 "GET /compute/v2.1/servers/472bbccc-485e-43ce-a9cd-a3148bfccdbd" status: 404 len: 111 microversion: 2.1 time: 0.075371 Oct 22 20:54:42.724732 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 690/1453] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:54:42 2022] GET /compute/v2.1/servers/472bbccc-485e-43ce-a9cd-a3148bfccdbd => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 20:54:42.732833 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-1f560a00-4b68-40b3-b267-b238fb0adbf9 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:54:42.733383 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-1f560a00-4b68-40b3-b267-b238fb0adbf9 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] [instance: 8f2e1da0-4586-460b-94dc-768fd618dc3d] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:54:42.751984 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1f560a00-4b68-40b3-b267-b238fb0adbf9 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:42.756476 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1f560a00-4b68-40b3-b267-b238fb0adbf9 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:42.757547 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1f560a00-4b68-40b3-b267-b238fb0adbf9 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:42.761256 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1f560a00-4b68-40b3-b267-b238fb0adbf9 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:42.761995 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1f560a00-4b68-40b3-b267-b238fb0adbf9 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:42.763289 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1f560a00-4b68-40b3-b267-b238fb0adbf9 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:43.027232 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.objects.instance [None req-1f560a00-4b68-40b3-b267-b238fb0adbf9 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lazy-loading 'services' on Instance uuid 8f2e1da0-4586-460b-94dc-768fd618dc3d {{(pid=138744) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 20:54:43.123301 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-ad20636b-4d37-4974-85ec-c00a19a30c6d tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:54:43.133439 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-ad20636b-4d37-4974-85ec-c00a19a30c6d tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:54:43.141387 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-ad20636b-4d37-4974-85ec-c00a19a30c6d tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:54:43.149724 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-ad20636b-4d37-4974-85ec-c00a19a30c6d tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] 10.222.0.18 "GET /compute/v2.1/servers/f499ce97-cdf8-4dcf-9c28-3758aea5e78c" status: 200 len: 1486 microversion: 2.25 time: 0.871348 Oct 22 20:54:43.158724 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 764/1454] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 20:54:42 2022] GET /compute/v2.1/servers/f499ce97-cdf8-4dcf-9c28-3758aea5e78c => generated 1486 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 20:54:43.163950 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-cdd4806d-4ea8-448e-bd0e-0f491a674afa tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:54:43.179885 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-cdd4806d-4ea8-448e-bd0e-0f491a674afa tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] [instance: 0e92c2df-261e-44fd-b584-2f870190e8ce] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:54:43.198319 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cdd4806d-4ea8-448e-bd0e-0f491a674afa tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:43.198812 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cdd4806d-4ea8-448e-bd0e-0f491a674afa tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:43.205583 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cdd4806d-4ea8-448e-bd0e-0f491a674afa tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:43.206627 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cdd4806d-4ea8-448e-bd0e-0f491a674afa tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:43.207404 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cdd4806d-4ea8-448e-bd0e-0f491a674afa tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:43.208037 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cdd4806d-4ea8-448e-bd0e-0f491a674afa tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:43.245947 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-1f560a00-4b68-40b3-b267-b238fb0adbf9 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] 10.222.0.18 "DELETE /compute/v2.1/servers/8f2e1da0-4586-460b-94dc-768fd618dc3d/os-volume_attachments/ea0d4b51-ed12-4296-878c-d315f57fb330" status: 202 len: 0 microversion: 2.1 time: 0.522942 Oct 22 20:54:43.247139 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 691/1455] 10.222.0.18 () {58 vars in 1416 bytes} [Sat Oct 22 20:54:42 2022] DELETE /compute/v2.1/servers/8f2e1da0-4586-460b-94dc-768fd618dc3d/os-volume_attachments/ea0d4b51-ed12-4296-878c-d315f57fb330 => generated 0 bytes in 525 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 20:54:43.263424 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-9f7b7ff2-da8a-4e5b-b378-1f0cdafbf11d tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:54:43.265828 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-9f7b7ff2-da8a-4e5b-b378-1f0cdafbf11d tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] [instance: 29a351ac-ecf5-4b11-9bdd-f1c93df1335a] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:54:43.283486 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9f7b7ff2-da8a-4e5b-b378-1f0cdafbf11d tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:43.287821 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9f7b7ff2-da8a-4e5b-b378-1f0cdafbf11d tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:43.289464 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9f7b7ff2-da8a-4e5b-b378-1f0cdafbf11d tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:43.302778 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9f7b7ff2-da8a-4e5b-b378-1f0cdafbf11d tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:43.306444 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9f7b7ff2-da8a-4e5b-b378-1f0cdafbf11d tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:43.307164 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9f7b7ff2-da8a-4e5b-b378-1f0cdafbf11d tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:43.764598 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-cdd4806d-4ea8-448e-bd0e-0f491a674afa tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7f48d18691d4473bbe0284c44f14d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bacf9909082440f8a201771b64a75fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:54:43.781742 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-cdd4806d-4ea8-448e-bd0e-0f491a674afa tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] 10.222.0.18 "GET /compute/v2.1/servers/0e92c2df-261e-44fd-b584-2f870190e8ce" status: 200 len: 1334 microversion: 2.1 time: 0.617532 Oct 22 20:54:43.783414 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 765/1456] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:54:43 2022] GET /compute/v2.1/servers/0e92c2df-261e-44fd-b584-2f870190e8ce => generated 1334 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:54:43.819723 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-43bb42fe-4ef2-4c0b-9f2c-dc3ce084064f tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:54:43.836984 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-43bb42fe-4ef2-4c0b-9f2c-dc3ce084064f tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] [instance: 8f2e1da0-4586-460b-94dc-768fd618dc3d] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:54:43.839579 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-9f7b7ff2-da8a-4e5b-b378-1f0cdafbf11d tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be93cabff0d46ccb2a3db0db1a13796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42111ed6bcc3465d8c1f5291da248e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:54:43.852390 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-9f7b7ff2-da8a-4e5b-b378-1f0cdafbf11d tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] 10.222.0.18 "GET /compute/v2.1/servers/29a351ac-ecf5-4b11-9bdd-f1c93df1335a" status: 200 len: 1323 microversion: 2.1 time: 0.603334 Oct 22 20:54:43.854163 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 692/1457] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:54:43 2022] GET /compute/v2.1/servers/29a351ac-ecf5-4b11-9bdd-f1c93df1335a => generated 1323 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:54:43.858180 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-43bb42fe-4ef2-4c0b-9f2c-dc3ce084064f tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:43.858818 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-43bb42fe-4ef2-4c0b-9f2c-dc3ce084064f tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:43.861380 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-43bb42fe-4ef2-4c0b-9f2c-dc3ce084064f tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:43.862714 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-43bb42fe-4ef2-4c0b-9f2c-dc3ce084064f tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:43.863296 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-3b0bf117-a91a-4694-b659-f4db1d141438 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:54:43.865149 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-43bb42fe-4ef2-4c0b-9f2c-dc3ce084064f tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:43.865961 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-3b0bf117-a91a-4694-b659-f4db1d141438 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] [instance: 40e6c6e3-3d47-4781-b8a8-aafd671d7287] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:54:43.867595 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-43bb42fe-4ef2-4c0b-9f2c-dc3ce084064f tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:43.883915 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3b0bf117-a91a-4694-b659-f4db1d141438 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:43.884786 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3b0bf117-a91a-4694-b659-f4db1d141438 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:43.885409 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3b0bf117-a91a-4694-b659-f4db1d141438 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:43.892232 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3b0bf117-a91a-4694-b659-f4db1d141438 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:43.892952 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3b0bf117-a91a-4694-b659-f4db1d141438 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:43.893548 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3b0bf117-a91a-4694-b659-f4db1d141438 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:43.947199 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-43bb42fe-4ef2-4c0b-9f2c-dc3ce084064f tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] 10.222.0.18 "GET /compute/v2.1/servers/8f2e1da0-4586-460b-94dc-768fd618dc3d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.161963 Oct 22 20:54:43.954854 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 766/1458] 10.222.0.18 () {58 vars in 1302 bytes} [Sat Oct 22 20:54:43 2022] GET /compute/v2.1/servers/8f2e1da0-4586-460b-94dc-768fd618dc3d/os-volume_attachments => generated 197 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:54:44.177369 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-5a9902bb-3694-420a-944a-f21f1e084d3a tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:54:44.178950 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-5a9902bb-3694-420a-944a-f21f1e084d3a tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] [instance: f499ce97-cdf8-4dcf-9c28-3758aea5e78c] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:54:44.209632 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5a9902bb-3694-420a-944a-f21f1e084d3a tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:44.213686 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5a9902bb-3694-420a-944a-f21f1e084d3a tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:44.215057 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5a9902bb-3694-420a-944a-f21f1e084d3a tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:44.217795 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5a9902bb-3694-420a-944a-f21f1e084d3a tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:44.220191 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5a9902bb-3694-420a-944a-f21f1e084d3a tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:44.223025 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5a9902bb-3694-420a-944a-f21f1e084d3a tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:44.327310 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-3b0bf117-a91a-4694-b659-f4db1d141438 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d3d7458af447bdb3f03e83a2d8559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49238b8686d24ae698679e4a1957735d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:54:44.337972 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-3b0bf117-a91a-4694-b659-f4db1d141438 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] 10.222.0.18 "GET /compute/v2.1/servers/40e6c6e3-3d47-4781-b8a8-aafd671d7287" status: 200 len: 1472 microversion: 2.1 time: 0.478659 Oct 22 20:54:44.347751 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 693/1459] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:54:43 2022] GET /compute/v2.1/servers/40e6c6e3-3d47-4781-b8a8-aafd671d7287 => generated 1472 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:54:44.353597 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-91626c8d-5727-4391-b277-5fe8b1ab85c1 req-52d2e553-0157-40b6-beff-82a9838034e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e92c2df-261e-44fd-b584-2f870190e8ce", "tag": "e1a5f050-1369-4771-864c-213c8500e5e6"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:54:44.379676 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-91626c8d-5727-4391-b277-5fe8b1ab85c1 req-52d2e553-0157-40b6-beff-82a9838034e7 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:44.381663 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-91626c8d-5727-4391-b277-5fe8b1ab85c1 req-52d2e553-0157-40b6-beff-82a9838034e7 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:44.387452 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-91626c8d-5727-4391-b277-5fe8b1ab85c1 req-52d2e553-0157-40b6-beff-82a9838034e7 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:44.407481 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-91626c8d-5727-4391-b277-5fe8b1ab85c1 req-52d2e553-0157-40b6-beff-82a9838034e7 service nova] Creating event network-changed:e1a5f050-1369-4771-864c-213c8500e5e6 for instance 0e92c2df-261e-44fd-b584-2f870190e8ce on nch1-master-1 Oct 22 20:54:44.416728 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-91626c8d-5727-4391-b277-5fe8b1ab85c1 req-52d2e553-0157-40b6-beff-82a9838034e7 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066140 Oct 22 20:54:44.417768 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 694/1460] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:54:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:54:44.527419 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-5a9902bb-3694-420a-944a-f21f1e084d3a tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:54:44.538837 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-5a9902bb-3694-420a-944a-f21f1e084d3a tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:54:44.541309 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-5a9902bb-3694-420a-944a-f21f1e084d3a tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:54:44.543569 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-5a9902bb-3694-420a-944a-f21f1e084d3a tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] 10.222.0.18 "GET /compute/v2.1/servers/f499ce97-cdf8-4dcf-9c28-3758aea5e78c" status: 200 len: 1486 microversion: 2.25 time: 0.371752 Oct 22 20:54:44.545074 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 767/1461] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 20:54:44 2022] GET /compute/v2.1/servers/f499ce97-cdf8-4dcf-9c28-3758aea5e78c => generated 1486 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 20:54:44.812312 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-bcf74641-b365-433c-9153-989922946e51 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:54:44.813879 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-bcf74641-b365-433c-9153-989922946e51 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] [instance: 0e92c2df-261e-44fd-b584-2f870190e8ce] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:54:44.821132 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bcf74641-b365-433c-9153-989922946e51 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:44.821765 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bcf74641-b365-433c-9153-989922946e51 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:44.822261 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bcf74641-b365-433c-9153-989922946e51 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:44.823020 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bcf74641-b365-433c-9153-989922946e51 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:44.823513 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bcf74641-b365-433c-9153-989922946e51 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:44.823946 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bcf74641-b365-433c-9153-989922946e51 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:44.879107 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-940c7d8c-6602-4480-9181-e572a9610ad3 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:54:44.880429 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-940c7d8c-6602-4480-9181-e572a9610ad3 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] [instance: 29a351ac-ecf5-4b11-9bdd-f1c93df1335a] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:54:44.889146 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-940c7d8c-6602-4480-9181-e572a9610ad3 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:44.890420 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-940c7d8c-6602-4480-9181-e572a9610ad3 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:44.891111 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-940c7d8c-6602-4480-9181-e572a9610ad3 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:44.892083 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-940c7d8c-6602-4480-9181-e572a9610ad3 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:44.892760 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-940c7d8c-6602-4480-9181-e572a9610ad3 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:44.893407 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-940c7d8c-6602-4480-9181-e572a9610ad3 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:45.073443 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-bcf74641-b365-433c-9153-989922946e51 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7f48d18691d4473bbe0284c44f14d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bacf9909082440f8a201771b64a75fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:54:45.088652 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-bcf74641-b365-433c-9153-989922946e51 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] 10.222.0.18 "GET /compute/v2.1/servers/0e92c2df-261e-44fd-b584-2f870190e8ce" status: 200 len: 1334 microversion: 2.1 time: 0.282886 Oct 22 20:54:45.091093 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 695/1462] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:54:44 2022] GET /compute/v2.1/servers/0e92c2df-261e-44fd-b584-2f870190e8ce => generated 1334 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:54:45.110693 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-7915df39-8880-4f26-8d97-0c47cc0ff37a tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:54:45.114322 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-7915df39-8880-4f26-8d97-0c47cc0ff37a tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] [instance: 8f2e1da0-4586-460b-94dc-768fd618dc3d] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:54:45.133837 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7915df39-8880-4f26-8d97-0c47cc0ff37a tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:45.139012 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7915df39-8880-4f26-8d97-0c47cc0ff37a tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:45.139715 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7915df39-8880-4f26-8d97-0c47cc0ff37a tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:45.140512 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7915df39-8880-4f26-8d97-0c47cc0ff37a tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:45.140978 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7915df39-8880-4f26-8d97-0c47cc0ff37a tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:45.141582 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7915df39-8880-4f26-8d97-0c47cc0ff37a tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:45.184445 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-940c7d8c-6602-4480-9181-e572a9610ad3 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be93cabff0d46ccb2a3db0db1a13796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42111ed6bcc3465d8c1f5291da248e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:54:45.195096 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-940c7d8c-6602-4480-9181-e572a9610ad3 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] 10.222.0.18 "GET /compute/v2.1/servers/29a351ac-ecf5-4b11-9bdd-f1c93df1335a" status: 200 len: 1323 microversion: 2.1 time: 0.320455 Oct 22 20:54:45.197272 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-7915df39-8880-4f26-8d97-0c47cc0ff37a tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] 10.222.0.18 "GET /compute/v2.1/servers/8f2e1da0-4586-460b-94dc-768fd618dc3d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.091133 Oct 22 20:54:45.197533 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 768/1463] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:54:44 2022] GET /compute/v2.1/servers/29a351ac-ecf5-4b11-9bdd-f1c93df1335a => generated 1323 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 20:54:45.204247 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 696/1464] 10.222.0.18 () {58 vars in 1302 bytes} [Sat Oct 22 20:54:45 2022] GET /compute/v2.1/servers/8f2e1da0-4586-460b-94dc-768fd618dc3d/os-volume_attachments => generated 25 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 22 20:54:45.370154 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-4e727b78-3e27-4a29-aa1c-680accaf6394 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:54:45.370776 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-4e727b78-3e27-4a29-aa1c-680accaf6394 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] [instance: 40e6c6e3-3d47-4781-b8a8-aafd671d7287] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:54:45.392360 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4e727b78-3e27-4a29-aa1c-680accaf6394 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:45.392859 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4e727b78-3e27-4a29-aa1c-680accaf6394 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:45.393302 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4e727b78-3e27-4a29-aa1c-680accaf6394 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:45.394357 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4e727b78-3e27-4a29-aa1c-680accaf6394 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:45.394908 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4e727b78-3e27-4a29-aa1c-680accaf6394 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:45.395463 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4e727b78-3e27-4a29-aa1c-680accaf6394 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:45.573754 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-d5dabf28-cbc6-4148-a203-13a3a51761cd tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:54:45.574392 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-d5dabf28-cbc6-4148-a203-13a3a51761cd tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] [instance: f499ce97-cdf8-4dcf-9c28-3758aea5e78c] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:54:45.589022 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d5dabf28-cbc6-4148-a203-13a3a51761cd tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:45.590329 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d5dabf28-cbc6-4148-a203-13a3a51761cd tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:45.593326 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d5dabf28-cbc6-4148-a203-13a3a51761cd tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:45.598396 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d5dabf28-cbc6-4148-a203-13a3a51761cd tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:45.600334 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d5dabf28-cbc6-4148-a203-13a3a51761cd tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:45.603169 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d5dabf28-cbc6-4148-a203-13a3a51761cd tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:46.256295 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-4e727b78-3e27-4a29-aa1c-680accaf6394 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d3d7458af447bdb3f03e83a2d8559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49238b8686d24ae698679e4a1957735d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:54:46.267176 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-4e727b78-3e27-4a29-aa1c-680accaf6394 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] 10.222.0.18 "GET /compute/v2.1/servers/40e6c6e3-3d47-4781-b8a8-aafd671d7287" status: 200 len: 1472 microversion: 2.1 time: 0.901968 Oct 22 20:54:46.267830 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 769/1465] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:54:45 2022] GET /compute/v2.1/servers/40e6c6e3-3d47-4781-b8a8-aafd671d7287 => generated 1472 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:54:46.285705 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-c3461009-07d4-4a57-b063-cd4067d3878b tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:54:46.288532 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-c3461009-07d4-4a57-b063-cd4067d3878b tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] [instance: 0e92c2df-261e-44fd-b584-2f870190e8ce] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:54:46.292402 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-d5dabf28-cbc6-4148-a203-13a3a51761cd tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:54:46.306177 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-d5dabf28-cbc6-4148-a203-13a3a51761cd tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:54:46.310337 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c3461009-07d4-4a57-b063-cd4067d3878b tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:46.311086 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c3461009-07d4-4a57-b063-cd4067d3878b tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:46.311738 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c3461009-07d4-4a57-b063-cd4067d3878b tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:46.312616 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c3461009-07d4-4a57-b063-cd4067d3878b tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:46.313665 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-d5dabf28-cbc6-4148-a203-13a3a51761cd tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:54:46.314344 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c3461009-07d4-4a57-b063-cd4067d3878b tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:46.315773 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-d5dabf28-cbc6-4148-a203-13a3a51761cd tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] 10.222.0.18 "GET /compute/v2.1/servers/f499ce97-cdf8-4dcf-9c28-3758aea5e78c" status: 200 len: 1486 microversion: 2.25 time: 0.747411 Oct 22 20:54:46.316443 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c3461009-07d4-4a57-b063-cd4067d3878b tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:46.317583 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 697/1466] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 20:54:45 2022] GET /compute/v2.1/servers/f499ce97-cdf8-4dcf-9c28-3758aea5e78c => generated 1486 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 20:54:46.339180 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-29feefee-f606-4625-8cc6-4e266851dcf0 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:54:46.341395 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-29feefee-f606-4625-8cc6-4e266851dcf0 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] [instance: 29a351ac-ecf5-4b11-9bdd-f1c93df1335a] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:54:46.361392 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-29feefee-f606-4625-8cc6-4e266851dcf0 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:46.364080 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-29feefee-f606-4625-8cc6-4e266851dcf0 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:46.365146 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-29feefee-f606-4625-8cc6-4e266851dcf0 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:46.366125 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-29feefee-f606-4625-8cc6-4e266851dcf0 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:46.368096 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-29feefee-f606-4625-8cc6-4e266851dcf0 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:46.370067 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-29feefee-f606-4625-8cc6-4e266851dcf0 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:47.109441 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-29feefee-f606-4625-8cc6-4e266851dcf0 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be93cabff0d46ccb2a3db0db1a13796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42111ed6bcc3465d8c1f5291da248e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:54:47.121630 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-c3461009-07d4-4a57-b063-cd4067d3878b tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7f48d18691d4473bbe0284c44f14d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bacf9909082440f8a201771b64a75fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:54:47.152689 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-29feefee-f606-4625-8cc6-4e266851dcf0 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] 10.222.0.18 "GET /compute/v2.1/servers/29a351ac-ecf5-4b11-9bdd-f1c93df1335a" status: 200 len: 1323 microversion: 2.1 time: 0.829760 Oct 22 20:54:47.163698 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 698/1467] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:54:46 2022] GET /compute/v2.1/servers/29a351ac-ecf5-4b11-9bdd-f1c93df1335a => generated 1323 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:54:47.168861 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-c3461009-07d4-4a57-b063-cd4067d3878b tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] 10.222.0.18 "GET /compute/v2.1/servers/0e92c2df-261e-44fd-b584-2f870190e8ce" status: 200 len: 1334 microversion: 2.1 time: 0.898527 Oct 22 20:54:47.184081 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 770/1468] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:54:46 2022] GET /compute/v2.1/servers/0e92c2df-261e-44fd-b584-2f870190e8ce => generated 1334 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:54:47.304408 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-40ff437d-7571-4655-a2ed-0fc24e58ece2 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:54:47.307246 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-40ff437d-7571-4655-a2ed-0fc24e58ece2 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] [instance: 40e6c6e3-3d47-4781-b8a8-aafd671d7287] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:54:47.322139 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-55ea426b-2d57-41a4-9eb7-9aad65330834 req-4a13f47b-1081-4c86-ac87-acedc4941a60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29a351ac-ecf5-4b11-9bdd-f1c93df1335a", "name": "network-vif-plugged", "status": "completed", "tag": "07fb8283-cc10-46e3-bd70-2c1e5b8c3aef"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:54:47.322666 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-40ff437d-7571-4655-a2ed-0fc24e58ece2 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:47.322789 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-40ff437d-7571-4655-a2ed-0fc24e58ece2 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:47.323230 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-40ff437d-7571-4655-a2ed-0fc24e58ece2 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:47.325218 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-40ff437d-7571-4655-a2ed-0fc24e58ece2 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:47.325696 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-40ff437d-7571-4655-a2ed-0fc24e58ece2 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:47.326208 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-40ff437d-7571-4655-a2ed-0fc24e58ece2 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:47.345113 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-55ea426b-2d57-41a4-9eb7-9aad65330834 req-4a13f47b-1081-4c86-ac87-acedc4941a60 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:47.345620 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-55ea426b-2d57-41a4-9eb7-9aad65330834 req-4a13f47b-1081-4c86-ac87-acedc4941a60 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:47.346026 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-55ea426b-2d57-41a4-9eb7-9aad65330834 req-4a13f47b-1081-4c86-ac87-acedc4941a60 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:47.371877 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-55ea426b-2d57-41a4-9eb7-9aad65330834 req-4a13f47b-1081-4c86-ac87-acedc4941a60 service nova] Creating event network-vif-plugged:07fb8283-cc10-46e3-bd70-2c1e5b8c3aef for instance 29a351ac-ecf5-4b11-9bdd-f1c93df1335a on nch2-master-1 Oct 22 20:54:47.377579 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-55ea426b-2d57-41a4-9eb7-9aad65330834 req-4a13f47b-1081-4c86-ac87-acedc4941a60 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059945 Oct 22 20:54:47.378194 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 771/1469] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:54:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 20:54:47.394824 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-edbd9dfa-55bf-4919-951d-07243698e8c9 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:54:47.395563 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-edbd9dfa-55bf-4919-951d-07243698e8c9 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] [instance: f499ce97-cdf8-4dcf-9c28-3758aea5e78c] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:54:47.417991 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-edbd9dfa-55bf-4919-951d-07243698e8c9 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:47.418487 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-edbd9dfa-55bf-4919-951d-07243698e8c9 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:47.418932 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-edbd9dfa-55bf-4919-951d-07243698e8c9 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:47.419685 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-edbd9dfa-55bf-4919-951d-07243698e8c9 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:47.420139 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-edbd9dfa-55bf-4919-951d-07243698e8c9 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:47.420555 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-edbd9dfa-55bf-4919-951d-07243698e8c9 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:48.220761 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-40ff437d-7571-4655-a2ed-0fc24e58ece2 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d3d7458af447bdb3f03e83a2d8559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49238b8686d24ae698679e4a1957735d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:54:48.232964 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-edbd9dfa-55bf-4919-951d-07243698e8c9 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:54:48.241742 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-40ff437d-7571-4655-a2ed-0fc24e58ece2 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] 10.222.0.18 "GET /compute/v2.1/servers/40e6c6e3-3d47-4781-b8a8-aafd671d7287" status: 200 len: 1477 microversion: 2.1 time: 0.946736 Oct 22 20:54:48.242836 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 699/1470] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:54:47 2022] GET /compute/v2.1/servers/40e6c6e3-3d47-4781-b8a8-aafd671d7287 => generated 1477 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:54:48.257930 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-edbd9dfa-55bf-4919-951d-07243698e8c9 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:54:48.258381 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-edbd9dfa-55bf-4919-951d-07243698e8c9 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:54:48.261719 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-edbd9dfa-55bf-4919-951d-07243698e8c9 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] 10.222.0.18 "GET /compute/v2.1/servers/f499ce97-cdf8-4dcf-9c28-3758aea5e78c" status: 200 len: 1486 microversion: 2.25 time: 0.880230 Oct 22 20:54:48.274433 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-9276541d-09df-4307-aebc-b3649997fced req-ec39b769-5f06-4fd0-8d40-2cd951610163 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f499ce97-cdf8-4dcf-9c28-3758aea5e78c", "name": "network-vif-unplugged", "status": "completed", "tag": "c45f11d9-428c-4566-a627-5dbe8e1e8d6d"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:54:48.275760 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 772/1471] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 20:54:47 2022] GET /compute/v2.1/servers/f499ce97-cdf8-4dcf-9c28-3758aea5e78c => generated 1486 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 20:54:48.285535 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-1783a335-b2bb-4663-b15b-4b7ce0b9dd34 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:54:48.286566 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-1783a335-b2bb-4663-b15b-4b7ce0b9dd34 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] [instance: 29a351ac-ecf5-4b11-9bdd-f1c93df1335a] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:54:48.295318 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1783a335-b2bb-4663-b15b-4b7ce0b9dd34 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:48.296132 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1783a335-b2bb-4663-b15b-4b7ce0b9dd34 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:48.296746 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1783a335-b2bb-4663-b15b-4b7ce0b9dd34 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:48.298028 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1783a335-b2bb-4663-b15b-4b7ce0b9dd34 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:48.298745 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1783a335-b2bb-4663-b15b-4b7ce0b9dd34 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:48.299361 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1783a335-b2bb-4663-b15b-4b7ce0b9dd34 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:48.300288 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-9276541d-09df-4307-aebc-b3649997fced req-ec39b769-5f06-4fd0-8d40-2cd951610163 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:48.302441 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-9276541d-09df-4307-aebc-b3649997fced req-ec39b769-5f06-4fd0-8d40-2cd951610163 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:48.303087 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-9276541d-09df-4307-aebc-b3649997fced req-ec39b769-5f06-4fd0-8d40-2cd951610163 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:48.329222 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-9276541d-09df-4307-aebc-b3649997fced req-ec39b769-5f06-4fd0-8d40-2cd951610163 service nova] Creating event network-vif-unplugged:c45f11d9-428c-4566-a627-5dbe8e1e8d6d for instance f499ce97-cdf8-4dcf-9c28-3758aea5e78c on nch1-master-1 Oct 22 20:54:48.337242 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-9276541d-09df-4307-aebc-b3649997fced req-ec39b769-5f06-4fd0-8d40-2cd951610163 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.069142 Oct 22 20:54:48.338521 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 700/1472] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:54:48 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:54:48.345848 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-e6d7e821-d81d-48ea-be96-b20b0ceefd62 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:54:48.347060 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-e6d7e821-d81d-48ea-be96-b20b0ceefd62 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] [instance: 0e92c2df-261e-44fd-b584-2f870190e8ce] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:54:48.349959 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:54:48.357513 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e6d7e821-d81d-48ea-be96-b20b0ceefd62 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:48.358334 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e6d7e821-d81d-48ea-be96-b20b0ceefd62 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:48.358929 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e6d7e821-d81d-48ea-be96-b20b0ceefd62 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:48.359899 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e6d7e821-d81d-48ea-be96-b20b0ceefd62 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:48.360515 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e6d7e821-d81d-48ea-be96-b20b0ceefd62 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:48.361123 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e6d7e821-d81d-48ea-be96-b20b0ceefd62 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:48.818067 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-1783a335-b2bb-4663-b15b-4b7ce0b9dd34 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be93cabff0d46ccb2a3db0db1a13796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42111ed6bcc3465d8c1f5291da248e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:54:48.828172 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-1783a335-b2bb-4663-b15b-4b7ce0b9dd34 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] 10.222.0.18 "GET /compute/v2.1/servers/29a351ac-ecf5-4b11-9bdd-f1c93df1335a" status: 200 len: 1323 microversion: 2.1 time: 0.551189 Oct 22 20:54:48.828765 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 773/1473] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:54:48 2022] GET /compute/v2.1/servers/29a351ac-ecf5-4b11-9bdd-f1c93df1335a => generated 1323 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:54:48.845039 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-e1c2fae7-28ce-4ffb-885d-4ff4988e51de tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1929249640", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "4282d9d7-1326-486a-8448-108826634658"}], "block_device_mapping_v2": [{"uuid": "e0d87279-2183-4c20-872e-8170476b3f01", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:54:49.024514 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.network.neutron [None req-e1c2fae7-28ce-4ffb-885d-4ff4988e51de tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] validate_networks() for [('4282d9d7-1326-486a-8448-108826634658', None, None, None, None, None)] {{(pid=138745) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 20:54:49.444570 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-e6d7e821-d81d-48ea-be96-b20b0ceefd62 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7f48d18691d4473bbe0284c44f14d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bacf9909082440f8a201771b64a75fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:54:49.457879 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-e6d7e821-d81d-48ea-be96-b20b0ceefd62 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] 10.222.0.18 "GET /compute/v2.1/servers/0e92c2df-261e-44fd-b584-2f870190e8ce" status: 200 len: 1334 microversion: 2.1 time: 1.117165 Oct 22 20:54:49.459659 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 701/1474] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:54:48 2022] GET /compute/v2.1/servers/0e92c2df-261e-44fd-b584-2f870190e8ce => generated 1334 bytes in 1120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:54:49.477498 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-f9b49a92-4bd6-4e51-a935-7decb9d3eca8 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:54:49.479101 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-f9b49a92-4bd6-4e51-a935-7decb9d3eca8 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] [instance: 40e6c6e3-3d47-4781-b8a8-aafd671d7287] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:54:49.494062 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f9b49a92-4bd6-4e51-a935-7decb9d3eca8 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:49.496267 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f9b49a92-4bd6-4e51-a935-7decb9d3eca8 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:49.498113 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f9b49a92-4bd6-4e51-a935-7decb9d3eca8 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:49.499719 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f9b49a92-4bd6-4e51-a935-7decb9d3eca8 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:49.502854 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f9b49a92-4bd6-4e51-a935-7decb9d3eca8 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:49.503375 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f9b49a92-4bd6-4e51-a935-7decb9d3eca8 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:50.245390 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-f9b49a92-4bd6-4e51-a935-7decb9d3eca8 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d3d7458af447bdb3f03e83a2d8559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49238b8686d24ae698679e4a1957735d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:54:50.274381 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-f9b49a92-4bd6-4e51-a935-7decb9d3eca8 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] 10.222.0.18 "GET /compute/v2.1/servers/40e6c6e3-3d47-4781-b8a8-aafd671d7287" status: 200 len: 1477 microversion: 2.1 time: 0.807786 Oct 22 20:54:50.280384 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 702/1475] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:54:49 2022] GET /compute/v2.1/servers/40e6c6e3-3d47-4781-b8a8-aafd671d7287 => generated 1477 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:54:50.289010 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-a1d2c749-d639-435b-b3bd-607d1e4ca803 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:54:50.290312 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-a1d2c749-d639-435b-b3bd-607d1e4ca803 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] [instance: f499ce97-cdf8-4dcf-9c28-3758aea5e78c] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:54:50.305318 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a1d2c749-d639-435b-b3bd-607d1e4ca803 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:50.309959 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a1d2c749-d639-435b-b3bd-607d1e4ca803 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:50.311059 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a1d2c749-d639-435b-b3bd-607d1e4ca803 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:50.312610 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a1d2c749-d639-435b-b3bd-607d1e4ca803 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:50.313634 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a1d2c749-d639-435b-b3bd-607d1e4ca803 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:50.316006 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a1d2c749-d639-435b-b3bd-607d1e4ca803 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:50.711054 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-a1d2c749-d639-435b-b3bd-607d1e4ca803 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:54:50.720024 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:54:50.754991 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-a1d2c749-d639-435b-b3bd-607d1e4ca803 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:54:50.756839 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-a1d2c749-d639-435b-b3bd-607d1e4ca803 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:54:50.761206 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-a1d2c749-d639-435b-b3bd-607d1e4ca803 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] 10.222.0.18 "GET /compute/v2.1/servers/f499ce97-cdf8-4dcf-9c28-3758aea5e78c" status: 200 len: 1486 microversion: 2.25 time: 0.478243 Oct 22 20:54:50.762484 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 703/1476] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 20:54:50 2022] GET /compute/v2.1/servers/f499ce97-cdf8-4dcf-9c28-3758aea5e78c => generated 1486 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 20:54:50.767734 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-d17a6982-1a5e-4425-86a6-2858d7123e4e tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:54:50.769220 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-d17a6982-1a5e-4425-86a6-2858d7123e4e tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] [instance: 29a351ac-ecf5-4b11-9bdd-f1c93df1335a] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:54:50.777566 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d17a6982-1a5e-4425-86a6-2858d7123e4e tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:50.778325 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d17a6982-1a5e-4425-86a6-2858d7123e4e tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:50.779989 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d17a6982-1a5e-4425-86a6-2858d7123e4e tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:50.781090 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d17a6982-1a5e-4425-86a6-2858d7123e4e tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:50.781842 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d17a6982-1a5e-4425-86a6-2858d7123e4e tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:50.782945 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d17a6982-1a5e-4425-86a6-2858d7123e4e tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:50.951765 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-e1c2fae7-28ce-4ffb-885d-4ff4988e51de tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Flavor limits 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 20:54:50.953698 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-e1c2fae7-28ce-4ffb-885d-4ff4988e51de tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Image limits 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 20:54:50.954614 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-e1c2fae7-28ce-4ffb-885d-4ff4988e51de tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Flavor pref 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 20:54:50.957429 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-e1c2fae7-28ce-4ffb-885d-4ff4988e51de tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Image pref 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 20:54:50.960456 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-e1c2fae7-28ce-4ffb-885d-4ff4988e51de tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 20:54:50.982549 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e1c2fae7-28ce-4ffb-885d-4ff4988e51de tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:50.984257 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e1c2fae7-28ce-4ffb-885d-4ff4988e51de tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:50.984964 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e1c2fae7-28ce-4ffb-885d-4ff4988e51de tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:50.986008 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e1c2fae7-28ce-4ffb-885d-4ff4988e51de tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:50.986918 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e1c2fae7-28ce-4ffb-885d-4ff4988e51de tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:50.988009 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e1c2fae7-28ce-4ffb-885d-4ff4988e51de tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:51.031209 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-e1c2fae7-28ce-4ffb-885d-4ff4988e51de tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Getting quotas for project 9f0ee8c8f7fc4e12bc1f9fcce3e7b581. Resources: {'cores', 'instances', 'ram'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 20:54:51.042241 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-e1c2fae7-28ce-4ffb-885d-4ff4988e51de tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Getting quotas for user 2c87f0356ca346f39c6216393d85da2f and project 9f0ee8c8f7fc4e12bc1f9fcce3e7b581. Resources: {'cores', 'instances', 'ram'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 20:54:51.050441 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-d17a6982-1a5e-4425-86a6-2858d7123e4e tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be93cabff0d46ccb2a3db0db1a13796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42111ed6bcc3465d8c1f5291da248e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:54:51.061640 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-d17a6982-1a5e-4425-86a6-2858d7123e4e tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] 10.222.0.18 "GET /compute/v2.1/servers/29a351ac-ecf5-4b11-9bdd-f1c93df1335a" status: 200 len: 1519 microversion: 2.1 time: 0.297817 Oct 22 20:54:51.064320 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 704/1477] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:54:50 2022] GET /compute/v2.1/servers/29a351ac-ecf5-4b11-9bdd-f1c93df1335a => generated 1519 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:54:51.069405 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-7c6762b6-6469-4460-a9c1-fec81d145395 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:54:51.071786 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-7c6762b6-6469-4460-a9c1-fec81d145395 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] [instance: 0e92c2df-261e-44fd-b584-2f870190e8ce] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:54:51.082587 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7c6762b6-6469-4460-a9c1-fec81d145395 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:51.083522 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7c6762b6-6469-4460-a9c1-fec81d145395 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:51.084471 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7c6762b6-6469-4460-a9c1-fec81d145395 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:51.085807 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7c6762b6-6469-4460-a9c1-fec81d145395 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:51.092771 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7c6762b6-6469-4460-a9c1-fec81d145395 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:51.096366 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7c6762b6-6469-4460-a9c1-fec81d145395 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:51.234235 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-e1c2fae7-28ce-4ffb-885d-4ff4988e51de tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Going to run 1 instances... {{(pid=138745) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 20:54:51.236469 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-e1c2fae7-28ce-4ffb-885d-4ff4988e51de tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] [instance: fbb34507-cef9-4d78-9ed7-5d6eab4ca806] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e0d87279-2183-4c20-872e-8170476b3f01',volume_size=None,volume_type=None)] {{(pid=138745) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 20:54:51.576593 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-7c6762b6-6469-4460-a9c1-fec81d145395 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7f48d18691d4473bbe0284c44f14d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bacf9909082440f8a201771b64a75fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:54:51.590084 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-7c6762b6-6469-4460-a9c1-fec81d145395 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] 10.222.0.18 "GET /compute/v2.1/servers/0e92c2df-261e-44fd-b584-2f870190e8ce" status: 200 len: 1334 microversion: 2.1 time: 0.524359 Oct 22 20:54:51.614830 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 705/1478] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:54:51 2022] GET /compute/v2.1/servers/0e92c2df-261e-44fd-b584-2f870190e8ce => generated 1334 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:54:51.621012 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-e1c2fae7-28ce-4ffb-885d-4ff4988e51de tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.786795 Oct 22 20:54:51.621678 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 774/1479] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Oct 22 20:54:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 2788 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 20:54:51.625855 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-330ae1ed-084c-45b6-bf81-e1d251a35af3 req-de57a2df-8949-42ab-9c73-5bc16ae7dabe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f499ce97-cdf8-4dcf-9c28-3758aea5e78c", "tag": "c45f11d9-428c-4566-a627-5dbe8e1e8d6d"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:54:51.642226 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-e79dcf47-a0c9-4e5d-8c14-237041f26f8c tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Action: 'create', calling method: .version_select at 0x7fd3a4ad6ee0>, body: {"pool": null} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:54:51.675116 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-330ae1ed-084c-45b6-bf81-e1d251a35af3 req-de57a2df-8949-42ab-9c73-5bc16ae7dabe service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:51.675627 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-330ae1ed-084c-45b6-bf81-e1d251a35af3 req-de57a2df-8949-42ab-9c73-5bc16ae7dabe service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:51.684803 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-330ae1ed-084c-45b6-bf81-e1d251a35af3 req-de57a2df-8949-42ab-9c73-5bc16ae7dabe service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:51.702994 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-330ae1ed-084c-45b6-bf81-e1d251a35af3 req-de57a2df-8949-42ab-9c73-5bc16ae7dabe service nova] Creating event network-changed:c45f11d9-428c-4566-a627-5dbe8e1e8d6d for instance f499ce97-cdf8-4dcf-9c28-3758aea5e78c on nch1-master-1 Oct 22 20:54:51.721815 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-330ae1ed-084c-45b6-bf81-e1d251a35af3 req-de57a2df-8949-42ab-9c73-5bc16ae7dabe service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105299 Oct 22 20:54:51.722479 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 706/1480] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:54:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:54:51.745236 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-14d6ac59-94b7-44f5-9ee2-9069eca392d7 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:54:51.746420 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-14d6ac59-94b7-44f5-9ee2-9069eca392d7 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] [instance: 40e6c6e3-3d47-4781-b8a8-aafd671d7287] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:54:51.775711 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-14d6ac59-94b7-44f5-9ee2-9069eca392d7 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:51.776166 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-14d6ac59-94b7-44f5-9ee2-9069eca392d7 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:51.776865 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-14d6ac59-94b7-44f5-9ee2-9069eca392d7 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:51.778291 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-14d6ac59-94b7-44f5-9ee2-9069eca392d7 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:51.778907 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-14d6ac59-94b7-44f5-9ee2-9069eca392d7 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:51.779657 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-14d6ac59-94b7-44f5-9ee2-9069eca392d7 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:52.111199 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-14d6ac59-94b7-44f5-9ee2-9069eca392d7 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d3d7458af447bdb3f03e83a2d8559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49238b8686d24ae698679e4a1957735d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:54:52.120328 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-14d6ac59-94b7-44f5-9ee2-9069eca392d7 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] 10.222.0.18 "GET /compute/v2.1/servers/40e6c6e3-3d47-4781-b8a8-aafd671d7287" status: 200 len: 1477 microversion: 2.1 time: 0.395238 Oct 22 20:54:52.139935 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 707/1481] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:54:51 2022] GET /compute/v2.1/servers/40e6c6e3-3d47-4781-b8a8-aafd671d7287 => generated 1477 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:54:52.139935 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-04ac7094-1340-4335-b817-c4df695abc49 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:54:52.139935 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-04ac7094-1340-4335-b817-c4df695abc49 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] [instance: fbb34507-cef9-4d78-9ed7-5d6eab4ca806] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:54:52.250824 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-04ac7094-1340-4335-b817-c4df695abc49 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c87f0356ca346f39c6216393d85da2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee8c8f7fc4e12bc1f9fcce3e7b581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:54:52.262179 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-04ac7094-1340-4335-b817-c4df695abc49 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] 10.222.0.18 "GET /compute/v2.1/servers/fbb34507-cef9-4d78-9ed7-5d6eab4ca806" status: 200 len: 1053 microversion: 2.1 time: 0.132844 Oct 22 20:54:52.262954 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 708/1482] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:54:52 2022] GET /compute/v2.1/servers/fbb34507-cef9-4d78-9ed7-5d6eab4ca806 => generated 1053 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:54:52.546643 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-404fc3ee-5843-469c-84c8-de0e050f4267 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-tempest.common.compute-instance-965558081", "imageRef": "085e4478-6edc-4a69-8e08-f9831713eb65", "flavorRef": "452", "min_count": 2, "networks": [{"uuid": "0bf7b42c-fe4f-4b88-ab34-fdd96f4baf2a"}]}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:54:52.698455 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.network.neutron [None req-404fc3ee-5843-469c-84c8-de0e050f4267 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] validate_networks() for [('0bf7b42c-fe4f-4b88-ab34-fdd96f4baf2a', None, None, None, None, None)] {{(pid=138744) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 20:54:55.766512 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-404fc3ee-5843-469c-84c8-de0e050f4267 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Flavor limits 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 20:54:55.768037 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-404fc3ee-5843-469c-84c8-de0e050f4267 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Image limits 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 20:54:55.769557 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-404fc3ee-5843-469c-84c8-de0e050f4267 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Flavor pref 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 20:54:55.770364 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-404fc3ee-5843-469c-84c8-de0e050f4267 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Image pref 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 20:54:55.771119 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-404fc3ee-5843-469c-84c8-de0e050f4267 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 20:54:55.804948 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-404fc3ee-5843-469c-84c8-de0e050f4267 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:55.807483 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-404fc3ee-5843-469c-84c8-de0e050f4267 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:55.811496 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-404fc3ee-5843-469c-84c8-de0e050f4267 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:55.815897 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-404fc3ee-5843-469c-84c8-de0e050f4267 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:55.817440 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-404fc3ee-5843-469c-84c8-de0e050f4267 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:55.821140 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-404fc3ee-5843-469c-84c8-de0e050f4267 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:55.897440 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-404fc3ee-5843-469c-84c8-de0e050f4267 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Getting quotas for project a4cc7342bf7941d2ad7ebc70032dd52e. Resources: {'cores', 'instances', 'ram'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 20:54:55.914424 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-404fc3ee-5843-469c-84c8-de0e050f4267 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Getting quotas for user 1b638db630404ebbbcc2253db30844c5 and project a4cc7342bf7941d2ad7ebc70032dd52e. Resources: {'cores', 'instances', 'ram'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 20:54:55.965134 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-404fc3ee-5843-469c-84c8-de0e050f4267 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Going to run 2 instances... {{(pid=138744) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 20:54:55.973867 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-404fc3ee-5843-469c-84c8-de0e050f4267 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] [instance: c2cedf74-885c-404c-b12f-9b7f7d15734c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='085e4478-6edc-4a69-8e08-f9831713eb65',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138744) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 20:54:56.092688 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-404fc3ee-5843-469c-84c8-de0e050f4267 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] [instance: 04d927bb-da77-4ca1-a828-562a01f07892] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='085e4478-6edc-4a69-8e08-f9831713eb65',instance=,instance_uuid=c2cedf74-885c-404c-b12f-9b7f7d15734c,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138744) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 20:54:56.267992 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-404fc3ee-5843-469c-84c8-de0e050f4267 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.987360 Oct 22 20:54:56.268990 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 709/1483] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Oct 22 20:54:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 3997 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 20:54:56.287898 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-598969b6-e860-43b7-a68e-60b2b941620d tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:54:56.289786 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-598969b6-e860-43b7-a68e-60b2b941620d tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] [instance: f499ce97-cdf8-4dcf-9c28-3758aea5e78c] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:54:56.300519 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-598969b6-e860-43b7-a68e-60b2b941620d tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:56.304174 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-598969b6-e860-43b7-a68e-60b2b941620d tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:56.305059 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-598969b6-e860-43b7-a68e-60b2b941620d tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:56.306168 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-598969b6-e860-43b7-a68e-60b2b941620d tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:56.307179 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-598969b6-e860-43b7-a68e-60b2b941620d tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:56.307901 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-598969b6-e860-43b7-a68e-60b2b941620d tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:57.202543 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-598969b6-e860-43b7-a68e-60b2b941620d tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:54:57.221941 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-598969b6-e860-43b7-a68e-60b2b941620d tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:54:57.233474 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-598969b6-e860-43b7-a68e-60b2b941620d tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:54:57.238338 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-598969b6-e860-43b7-a68e-60b2b941620d tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] 10.222.0.18 "GET /compute/v2.1/servers/f499ce97-cdf8-4dcf-9c28-3758aea5e78c" status: 200 len: 1486 microversion: 2.25 time: 0.956065 Oct 22 20:54:57.239644 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 710/1484] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 20:54:56 2022] GET /compute/v2.1/servers/f499ce97-cdf8-4dcf-9c28-3758aea5e78c => generated 1486 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 20:54:57.257868 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-11afa47f-adbe-4656-af8c-f54518b785f0 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:54:57.263171 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-11afa47f-adbe-4656-af8c-f54518b785f0 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] [instance: 0e92c2df-261e-44fd-b584-2f870190e8ce] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:54:57.312001 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-11afa47f-adbe-4656-af8c-f54518b785f0 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:57.312769 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-11afa47f-adbe-4656-af8c-f54518b785f0 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:57.318449 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-11afa47f-adbe-4656-af8c-f54518b785f0 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:57.320515 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-11afa47f-adbe-4656-af8c-f54518b785f0 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:57.325275 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-11afa47f-adbe-4656-af8c-f54518b785f0 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:57.328181 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-11afa47f-adbe-4656-af8c-f54518b785f0 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:58.750193 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-11afa47f-adbe-4656-af8c-f54518b785f0 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7f48d18691d4473bbe0284c44f14d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bacf9909082440f8a201771b64a75fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:54:58.770649 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-11afa47f-adbe-4656-af8c-f54518b785f0 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] 10.222.0.18 "GET /compute/v2.1/servers/0e92c2df-261e-44fd-b584-2f870190e8ce" status: 200 len: 1334 microversion: 2.1 time: 1.525843 Oct 22 20:54:58.774021 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 711/1485] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:54:57 2022] GET /compute/v2.1/servers/0e92c2df-261e-44fd-b584-2f870190e8ce => generated 1334 bytes in 1531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:54:58.803152 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-8ee83d27-cff0-4994-ae6a-eaf48320d8e0 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:54:58.805766 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-8ee83d27-cff0-4994-ae6a-eaf48320d8e0 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] [instance: 40e6c6e3-3d47-4781-b8a8-aafd671d7287] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:54:58.822714 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8ee83d27-cff0-4994-ae6a-eaf48320d8e0 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:58.823222 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8ee83d27-cff0-4994-ae6a-eaf48320d8e0 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:58.826900 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8ee83d27-cff0-4994-ae6a-eaf48320d8e0 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:58.831530 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8ee83d27-cff0-4994-ae6a-eaf48320d8e0 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:58.832230 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8ee83d27-cff0-4994-ae6a-eaf48320d8e0 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:58.833595 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8ee83d27-cff0-4994-ae6a-eaf48320d8e0 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:59.585533 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-e79dcf47-a0c9-4e5d-8c14-237041f26f8c tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] 10.222.0.18 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 7.962667 Oct 22 20:54:59.601994 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 775/1486] 10.222.0.18 () {60 vars in 1170 bytes} [Sat Oct 22 20:54:51 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 7980 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:54:59.608961 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-22848ff3-7329-44e7-8868-4381395009d7 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:54:59.609497 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-22848ff3-7329-44e7-8868-4381395009d7 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] [instance: fbb34507-cef9-4d78-9ed7-5d6eab4ca806] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:54:59.640074 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=6 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:54:59.643142 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-22848ff3-7329-44e7-8868-4381395009d7 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:59.643683 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-22848ff3-7329-44e7-8868-4381395009d7 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:59.644128 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-22848ff3-7329-44e7-8868-4381395009d7 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:59.644959 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-22848ff3-7329-44e7-8868-4381395009d7 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:59.645475 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-22848ff3-7329-44e7-8868-4381395009d7 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:59.645917 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-22848ff3-7329-44e7-8868-4381395009d7 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:59.744400 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-8ee83d27-cff0-4994-ae6a-eaf48320d8e0 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d3d7458af447bdb3f03e83a2d8559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49238b8686d24ae698679e4a1957735d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:54:59.768502 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-8ee83d27-cff0-4994-ae6a-eaf48320d8e0 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] 10.222.0.18 "GET /compute/v2.1/servers/40e6c6e3-3d47-4781-b8a8-aafd671d7287" status: 200 len: 1477 microversion: 2.1 time: 0.974983 Oct 22 20:54:59.773532 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 712/1487] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:54:58 2022] GET /compute/v2.1/servers/40e6c6e3-3d47-4781-b8a8-aafd671d7287 => generated 1477 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:54:59.788853 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-67ebd469-5f9d-4f67-be43-428f12110b6b req-3e8347c2-b8fe-4f75-82b6-ccf900a04cba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e92c2df-261e-44fd-b584-2f870190e8ce", "name": "network-vif-plugged", "status": "completed", "tag": "e1a5f050-1369-4771-864c-213c8500e5e6"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:54:59.807851 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-67ebd469-5f9d-4f67-be43-428f12110b6b req-3e8347c2-b8fe-4f75-82b6-ccf900a04cba service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:59.808967 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-67ebd469-5f9d-4f67-be43-428f12110b6b req-3e8347c2-b8fe-4f75-82b6-ccf900a04cba service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:59.810854 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-67ebd469-5f9d-4f67-be43-428f12110b6b req-3e8347c2-b8fe-4f75-82b6-ccf900a04cba service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:59.863312 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-67ebd469-5f9d-4f67-be43-428f12110b6b req-3e8347c2-b8fe-4f75-82b6-ccf900a04cba service nova] Creating event network-vif-plugged:e1a5f050-1369-4771-864c-213c8500e5e6 for instance 0e92c2df-261e-44fd-b584-2f870190e8ce on nch1-master-1 Oct 22 20:54:59.874392 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-67ebd469-5f9d-4f67-be43-428f12110b6b req-3e8347c2-b8fe-4f75-82b6-ccf900a04cba service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094823 Oct 22 20:54:59.875011 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 713/1488] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:54:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:54:59.888511 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-0e3bb6b8-11b8-4a20-b4f0-4aa9bbd4fd65 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:54:59.901066 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-0e3bb6b8-11b8-4a20-b4f0-4aa9bbd4fd65 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1b638db630404ebbbcc2253db30844c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cc7342bf7941d2ad7ebc70032dd52e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:54:59.903206 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-0e3bb6b8-11b8-4a20-b4f0-4aa9bbd4fd65 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Searching by: {'deleted': False, 'project_id': 'a4cc7342bf7941d2ad7ebc70032dd52e'} {{(pid=138744) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 22 20:54:59.923908 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0e3bb6b8-11b8-4a20-b4f0-4aa9bbd4fd65 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:59.924449 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0e3bb6b8-11b8-4a20-b4f0-4aa9bbd4fd65 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:59.924900 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0e3bb6b8-11b8-4a20-b4f0-4aa9bbd4fd65 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:59.928564 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0e3bb6b8-11b8-4a20-b4f0-4aa9bbd4fd65 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:54:59.929227 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0e3bb6b8-11b8-4a20-b4f0-4aa9bbd4fd65 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:54:59.929680 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0e3bb6b8-11b8-4a20-b4f0-4aa9bbd4fd65 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:54:59.992418 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.multi_cell_list [None req-0e3bb6b8-11b8-4a20-b4f0-4aa9bbd4fd65 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=138744) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 22 20:55:00.060405 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-0e3bb6b8-11b8-4a20-b4f0-4aa9bbd4fd65 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] 10.222.0.18 "GET /compute/v2.1/servers" status: 200 len: 675 microversion: 2.1 time: 0.183775 Oct 22 20:55:00.061005 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 714/1489] 10.222.0.18 () {58 vars in 1125 bytes} [Sat Oct 22 20:54:59 2022] GET /compute/v2.1/servers => generated 675 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:55:00.077263 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-affa3fe4-0060-47b2-8469-8b80aa525efb tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:55:00.078194 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-affa3fe4-0060-47b2-8469-8b80aa525efb tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] [instance: f499ce97-cdf8-4dcf-9c28-3758aea5e78c] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:55:00.093845 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-affa3fe4-0060-47b2-8469-8b80aa525efb tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:00.095116 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-affa3fe4-0060-47b2-8469-8b80aa525efb tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:00.095604 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-affa3fe4-0060-47b2-8469-8b80aa525efb tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:00.098942 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-affa3fe4-0060-47b2-8469-8b80aa525efb tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:00.099458 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-affa3fe4-0060-47b2-8469-8b80aa525efb tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:00.099949 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-affa3fe4-0060-47b2-8469-8b80aa525efb tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:00.470493 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-22848ff3-7329-44e7-8868-4381395009d7 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c87f0356ca346f39c6216393d85da2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee8c8f7fc4e12bc1f9fcce3e7b581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:55:00.485302 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-22848ff3-7329-44e7-8868-4381395009d7 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] 10.222.0.18 "GET /compute/v2.1/servers/fbb34507-cef9-4d78-9ed7-5d6eab4ca806" status: 200 len: 1199 microversion: 2.1 time: 0.881811 Oct 22 20:55:00.500972 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 776/1490] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:54:59 2022] GET /compute/v2.1/servers/fbb34507-cef9-4d78-9ed7-5d6eab4ca806 => generated 1199 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:55:00.528353 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-06afffdd-861c-450a-a584-4022201a532f tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:55:00.529321 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-06afffdd-861c-450a-a584-4022201a532f tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] [instance: 0e92c2df-261e-44fd-b584-2f870190e8ce] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:55:00.572812 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-06afffdd-861c-450a-a584-4022201a532f tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:00.576094 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-06afffdd-861c-450a-a584-4022201a532f tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:00.576980 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-06afffdd-861c-450a-a584-4022201a532f tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:00.577942 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-06afffdd-861c-450a-a584-4022201a532f tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:00.580655 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-06afffdd-861c-450a-a584-4022201a532f tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:00.581302 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-06afffdd-861c-450a-a584-4022201a532f tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:00.841908 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-affa3fe4-0060-47b2-8469-8b80aa525efb tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:55:00.855389 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-affa3fe4-0060-47b2-8469-8b80aa525efb tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:55:00.864915 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-affa3fe4-0060-47b2-8469-8b80aa525efb tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:55:00.872907 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-affa3fe4-0060-47b2-8469-8b80aa525efb tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] 10.222.0.18 "GET /compute/v2.1/servers/f499ce97-cdf8-4dcf-9c28-3758aea5e78c" status: 200 len: 1486 microversion: 2.25 time: 0.806077 Oct 22 20:55:00.875707 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 715/1491] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 20:55:00 2022] GET /compute/v2.1/servers/f499ce97-cdf8-4dcf-9c28-3758aea5e78c => generated 1486 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 20:55:00.891920 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-fff6101d-818e-4830-b6e5-f09b929b1dbd tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-1373021633", "imageRef": "085e4478-6edc-4a69-8e08-f9831713eb65", "flavorRef": "452", "networks": [{"uuid": "ba2fbd7d-5bd8-4316-b6a5-ea0e685a80cc"}]}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:55:01.003503 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell0:SELECT=2 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:55:01.005636 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.network.neutron [None req-fff6101d-818e-4830-b6e5-f09b929b1dbd tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] validate_networks() for [('ba2fbd7d-5bd8-4316-b6a5-ea0e685a80cc', None, None, None, None, None)] {{(pid=138744) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 20:55:01.086168 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell0:SELECT=6 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:55:01.314068 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-06afffdd-861c-450a-a584-4022201a532f tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7f48d18691d4473bbe0284c44f14d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bacf9909082440f8a201771b64a75fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:55:01.326252 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-06afffdd-861c-450a-a584-4022201a532f tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] 10.222.0.18 "GET /compute/v2.1/servers/0e92c2df-261e-44fd-b584-2f870190e8ce" status: 200 len: 1334 microversion: 2.1 time: 0.822790 Oct 22 20:55:01.334371 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 777/1492] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:55:00 2022] GET /compute/v2.1/servers/0e92c2df-261e-44fd-b584-2f870190e8ce => generated 1334 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:55:01.339684 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-9e354cd3-48fd-4d09-a8b1-3cf30daccf9c tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:55:01.341517 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-9e354cd3-48fd-4d09-a8b1-3cf30daccf9c tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] [instance: 04d927bb-da77-4ca1-a828-562a01f07892] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:55:01.351936 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9e354cd3-48fd-4d09-a8b1-3cf30daccf9c tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:01.352746 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9e354cd3-48fd-4d09-a8b1-3cf30daccf9c tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:01.353410 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9e354cd3-48fd-4d09-a8b1-3cf30daccf9c tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:01.354452 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9e354cd3-48fd-4d09-a8b1-3cf30daccf9c tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:01.355481 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9e354cd3-48fd-4d09-a8b1-3cf30daccf9c tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:01.356810 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9e354cd3-48fd-4d09-a8b1-3cf30daccf9c tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:01.548608 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-9e354cd3-48fd-4d09-a8b1-3cf30daccf9c tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b638db630404ebbbcc2253db30844c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cc7342bf7941d2ad7ebc70032dd52e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:55:01.574616 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-9e354cd3-48fd-4d09-a8b1-3cf30daccf9c tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] 10.222.0.18 "GET /compute/v2.1/servers/04d927bb-da77-4ca1-a828-562a01f07892" status: 200 len: 1277 microversion: 2.1 time: 0.238733 Oct 22 20:55:01.575427 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 778/1493] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:55:01 2022] GET /compute/v2.1/servers/04d927bb-da77-4ca1-a828-562a01f07892 => generated 1277 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:55:01.584179 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-c3f726ec-b232-4f87-9b0b-604586157fa7 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:55:01.585111 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-c3f726ec-b232-4f87-9b0b-604586157fa7 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] [instance: 40e6c6e3-3d47-4781-b8a8-aafd671d7287] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:55:01.604836 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c3f726ec-b232-4f87-9b0b-604586157fa7 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:01.609157 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c3f726ec-b232-4f87-9b0b-604586157fa7 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:01.609653 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c3f726ec-b232-4f87-9b0b-604586157fa7 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:01.613927 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c3f726ec-b232-4f87-9b0b-604586157fa7 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:01.614851 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c3f726ec-b232-4f87-9b0b-604586157fa7 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:01.615531 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c3f726ec-b232-4f87-9b0b-604586157fa7 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:02.482527 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-c3f726ec-b232-4f87-9b0b-604586157fa7 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d3d7458af447bdb3f03e83a2d8559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49238b8686d24ae698679e4a1957735d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:55:02.492752 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-c3f726ec-b232-4f87-9b0b-604586157fa7 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] 10.222.0.18 "GET /compute/v2.1/servers/40e6c6e3-3d47-4781-b8a8-aafd671d7287" status: 200 len: 1477 microversion: 2.1 time: 0.916068 Oct 22 20:55:02.493495 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 779/1494] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:55:01 2022] GET /compute/v2.1/servers/40e6c6e3-3d47-4781-b8a8-aafd671d7287 => generated 1477 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:55:02.498384 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-2f62349f-5e8d-4c1d-b91d-7d88ec3a80db tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:55:02.499019 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-2f62349f-5e8d-4c1d-b91d-7d88ec3a80db tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] [instance: fbb34507-cef9-4d78-9ed7-5d6eab4ca806] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:55:02.505279 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2f62349f-5e8d-4c1d-b91d-7d88ec3a80db tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:02.505998 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2f62349f-5e8d-4c1d-b91d-7d88ec3a80db tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:02.506437 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2f62349f-5e8d-4c1d-b91d-7d88ec3a80db tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:02.507138 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2f62349f-5e8d-4c1d-b91d-7d88ec3a80db tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:02.507625 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2f62349f-5e8d-4c1d-b91d-7d88ec3a80db tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:02.508053 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2f62349f-5e8d-4c1d-b91d-7d88ec3a80db tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:03.297171 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-2f62349f-5e8d-4c1d-b91d-7d88ec3a80db tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c87f0356ca346f39c6216393d85da2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee8c8f7fc4e12bc1f9fcce3e7b581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:55:03.308989 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-2f62349f-5e8d-4c1d-b91d-7d88ec3a80db tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] 10.222.0.18 "GET /compute/v2.1/servers/fbb34507-cef9-4d78-9ed7-5d6eab4ca806" status: 200 len: 1199 microversion: 2.1 time: 0.814160 Oct 22 20:55:03.313044 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 780/1495] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:55:02 2022] GET /compute/v2.1/servers/fbb34507-cef9-4d78-9ed7-5d6eab4ca806 => generated 1199 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:55:03.326102 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-e91ad399-300e-454e-92aa-2561332a00b7 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:55:03.330803 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-e91ad399-300e-454e-92aa-2561332a00b7 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] [instance: f499ce97-cdf8-4dcf-9c28-3758aea5e78c] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:55:03.365716 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e91ad399-300e-454e-92aa-2561332a00b7 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:03.366989 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e91ad399-300e-454e-92aa-2561332a00b7 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:03.369060 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e91ad399-300e-454e-92aa-2561332a00b7 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:03.370202 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e91ad399-300e-454e-92aa-2561332a00b7 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:03.373653 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e91ad399-300e-454e-92aa-2561332a00b7 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:03.374330 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e91ad399-300e-454e-92aa-2561332a00b7 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:03.612382 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-fff6101d-818e-4830-b6e5-f09b929b1dbd tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Flavor limits 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 20:55:03.615193 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-fff6101d-818e-4830-b6e5-f09b929b1dbd tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Image limits 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 20:55:03.615993 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-fff6101d-818e-4830-b6e5-f09b929b1dbd tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Flavor pref 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 20:55:03.616601 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-fff6101d-818e-4830-b6e5-f09b929b1dbd tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Image pref 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 20:55:03.617215 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-fff6101d-818e-4830-b6e5-f09b929b1dbd tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 20:55:03.651102 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fff6101d-818e-4830-b6e5-f09b929b1dbd tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:03.656131 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fff6101d-818e-4830-b6e5-f09b929b1dbd tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:03.656608 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fff6101d-818e-4830-b6e5-f09b929b1dbd tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:03.657677 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fff6101d-818e-4830-b6e5-f09b929b1dbd tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:03.658353 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fff6101d-818e-4830-b6e5-f09b929b1dbd tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:03.658962 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fff6101d-818e-4830-b6e5-f09b929b1dbd tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:03.723978 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-fff6101d-818e-4830-b6e5-f09b929b1dbd tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Getting quotas for project 42111ed6bcc3465d8c1f5291da248e74. Resources: {'cores', 'instances', 'ram'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 20:55:03.734460 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-fff6101d-818e-4830-b6e5-f09b929b1dbd tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Getting quotas for user 5be93cabff0d46ccb2a3db0db1a13796 and project 42111ed6bcc3465d8c1f5291da248e74. Resources: {'cores', 'instances', 'ram'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 20:55:03.769608 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-fff6101d-818e-4830-b6e5-f09b929b1dbd tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Going to run 1 instances... {{(pid=138744) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 20:55:03.777056 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-fff6101d-818e-4830-b6e5-f09b929b1dbd tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] [instance: 532d6e6a-71ab-4ef0-a5bf-c042055c5121] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='085e4478-6edc-4a69-8e08-f9831713eb65',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138744) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 20:55:03.862579 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-e91ad399-300e-454e-92aa-2561332a00b7 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:55:03.874575 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-e91ad399-300e-454e-92aa-2561332a00b7 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:55:03.880605 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-e91ad399-300e-454e-92aa-2561332a00b7 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:55:03.882347 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-e91ad399-300e-454e-92aa-2561332a00b7 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] 10.222.0.18 "GET /compute/v2.1/servers/f499ce97-cdf8-4dcf-9c28-3758aea5e78c" status: 200 len: 1476 microversion: 2.25 time: 0.567560 Oct 22 20:55:03.883480 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 781/1496] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 20:55:03 2022] GET /compute/v2.1/servers/f499ce97-cdf8-4dcf-9c28-3758aea5e78c => generated 1476 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 20:55:03.901316 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-d52c4411-c27d-46aa-b4b2-e7a29f033bc3 req-e1048a10-5037-4626-8155-8d45d768dee2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e92c2df-261e-44fd-b584-2f870190e8ce", "name": "network-vif-plugged", "status": "completed", "tag": "0179715f-adee-41ed-a569-67196aa24ae5"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:55:03.932706 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-fff6101d-818e-4830-b6e5-f09b929b1dbd tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.051722 Oct 22 20:55:03.933893 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 716/1497] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Oct 22 20:55:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 3057 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 20:55:03.944595 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-751e8b67-d171-4cc8-8f4e-1063a91f8496 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:55:03.948753 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-751e8b67-d171-4cc8-8f4e-1063a91f8496 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] [instance: 0e92c2df-261e-44fd-b584-2f870190e8ce] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:55:03.950582 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-d52c4411-c27d-46aa-b4b2-e7a29f033bc3 req-e1048a10-5037-4626-8155-8d45d768dee2 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:03.959581 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-d52c4411-c27d-46aa-b4b2-e7a29f033bc3 req-e1048a10-5037-4626-8155-8d45d768dee2 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:03.960165 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-d52c4411-c27d-46aa-b4b2-e7a29f033bc3 req-e1048a10-5037-4626-8155-8d45d768dee2 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:03.970585 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-751e8b67-d171-4cc8-8f4e-1063a91f8496 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:03.972553 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-751e8b67-d171-4cc8-8f4e-1063a91f8496 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:03.973470 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-751e8b67-d171-4cc8-8f4e-1063a91f8496 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:03.978711 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-751e8b67-d171-4cc8-8f4e-1063a91f8496 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:03.979841 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-751e8b67-d171-4cc8-8f4e-1063a91f8496 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:03.981551 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-751e8b67-d171-4cc8-8f4e-1063a91f8496 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:04.024432 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell1:SELECT=100 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:55:04.031950 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-d52c4411-c27d-46aa-b4b2-e7a29f033bc3 req-e1048a10-5037-4626-8155-8d45d768dee2 service nova] Creating event network-vif-plugged:0179715f-adee-41ed-a569-67196aa24ae5 for instance 0e92c2df-261e-44fd-b584-2f870190e8ce on nch1-master-1 Oct 22 20:55:04.045349 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-d52c4411-c27d-46aa-b4b2-e7a29f033bc3 req-e1048a10-5037-4626-8155-8d45d768dee2 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.159741 Oct 22 20:55:04.049049 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 782/1498] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:55:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:55:04.205401 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-1b49d654-909d-4d6a-99a7-9ab2f5e7bdf3 tempest-SecurityGroupsNegativeTestJSON-565994106 tempest-SecurityGroupsNegativeTestJSON-565994106-project] Calling method '.version_select at 0x7fd3a4230f70>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:55:04.401822 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-751e8b67-d171-4cc8-8f4e-1063a91f8496 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7f48d18691d4473bbe0284c44f14d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bacf9909082440f8a201771b64a75fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:55:04.416493 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-751e8b67-d171-4cc8-8f4e-1063a91f8496 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] 10.222.0.18 "GET /compute/v2.1/servers/0e92c2df-261e-44fd-b584-2f870190e8ce" status: 200 len: 1334 microversion: 2.1 time: 0.480215 Oct 22 20:55:04.438189 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 717/1499] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:55:03 2022] GET /compute/v2.1/servers/0e92c2df-261e-44fd-b584-2f870190e8ce => generated 1334 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:55:04.448583 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-34d72861-cc82-4d6c-afa4-0b926f77b5b6 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:55:04.456239 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-34d72861-cc82-4d6c-afa4-0b926f77b5b6 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] [instance: 04d927bb-da77-4ca1-a828-562a01f07892] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:55:04.470293 ncdv-master-1 devstack@n-api.service[138745]: DEBUG neutronclient.v2_0.client [None req-1b49d654-909d-4d6a-99a7-9ab2f5e7bdf3 tempest-SecurityGroupsNegativeTestJSON-565994106 tempest-SecurityGroupsNegativeTestJSON-565994106-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group c8c0e846-90ef-4b0b-bd05-cbc4424ed596 does not exist", "detail": ""}} {{(pid=138745) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 22 20:55:04.474007 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-34d72861-cc82-4d6c-afa4-0b926f77b5b6 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:04.474247 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.network.security_group_api [None req-1b49d654-909d-4d6a-99a7-9ab2f5e7bdf3 tempest-SecurityGroupsNegativeTestJSON-565994106 tempest-SecurityGroupsNegativeTestJSON-565994106-project] Neutron security group c8c0e846-90ef-4b0b-bd05-cbc4424ed596 not found {{(pid=138745) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 22 20:55:04.475468 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.wsgi [None req-1b49d654-909d-4d6a-99a7-9ab2f5e7bdf3 tempest-SecurityGroupsNegativeTestJSON-565994106 tempest-SecurityGroupsNegativeTestJSON-565994106-project] HTTP exception thrown: Security group c8c0e846-90ef-4b0b-bd05-cbc4424ed596 does not exist Oct 22 20:55:04.475468 ncdv-master-1 devstack@n-api.service[138745]: Neutron server returns request_ids: ['req-26e8fb77-de59-4e6d-b6ae-de4a44600afb'] Oct 22 20:55:04.476809 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-34d72861-cc82-4d6c-afa4-0b926f77b5b6 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:04.481247 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-34d72861-cc82-4d6c-afa4-0b926f77b5b6 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:04.500426 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-34d72861-cc82-4d6c-afa4-0b926f77b5b6 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:04.506584 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-34d72861-cc82-4d6c-afa4-0b926f77b5b6 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:04.510251 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-34d72861-cc82-4d6c-afa4-0b926f77b5b6 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:04.513553 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-1b49d654-909d-4d6a-99a7-9ab2f5e7bdf3 tempest-SecurityGroupsNegativeTestJSON-565994106 tempest-SecurityGroupsNegativeTestJSON-565994106-project] Request method failure captured: Oct 22 20:55:04.513553 ncdv-master-1 devstack@n-api.service[138745]: request: DELETE /compute/v2.1/os-security-groups/c8c0e846-90ef-4b0b-bd05-cbc4424ed596 HTTP/1.1 Oct 22 20:55:04.513553 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 20:55:04.513553 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 20:55:04.513553 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 20:55:04.513553 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 0 Oct 22 20:55:04.513553 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 20:55:04.513553 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 20:55:04.513553 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 20:55:04.513553 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 20:55:04.513553 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVFimXF3Ln5E_gYMZHk-3t3SO-eu7sVKWtZrnZ2RGyEl4c7jdw-E6E7cUUjqe8-4ht5f7o0Bi7sEtrsPepffOE8mmp9JsTBJ3GHuKi_SEVnI5ByGy0qVtbTROxo2Qa4XkB9BrRkUAM3SpVJGWrkrmo969bVSqw0_y0Vf-F8TReCbjSpA Oct 22 20:55:04.513553 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 20:55:04.513553 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 20:55:04.513553 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 20:55:04.513553 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 20:55:04.513553 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 20:55:04.513553 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 20:55:04.513553 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: a675afb1c0124470804c1d2eb0620a60 Oct 22 20:55:04.513553 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-565994106 Oct 22 20:55:04.513553 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 20:55:04.513553 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 20:55:04.513553 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_a675afb1c0124470804c1d2eb0620a60"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a675afb1c0124470804c1d2eb0620a60"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/a675afb1c0124470804c1d2eb0620a60"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a675afb1c0124470804c1d2eb0620a60"}]}] Oct 22 20:55:04.513553 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-565994106 Oct 22 20:55:04.513553 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: a675afb1c0124470804c1d2eb0620a60 Oct 22 20:55:04.513553 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-565994106 Oct 22 20:55:04.513553 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-SecurityGroupsNegativeTestJSON-565994106-project Oct 22 20:55:04.513553 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 20:55:04.513553 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 20:55:04.513553 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: 8dd36113b6fa4cbab58edb75b08d17e1 Oct 22 20:55:04.513553 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-565994106-project Oct 22 20:55:04.513553 ncdv-master-1 devstack@n-api.service[138745]: method: Oct 22 20:55:04.513553 ncdv-master-1 devstack@n-api.service[138745]: exception: Security group c8c0e846-90ef-4b0b-bd05-cbc4424ed596 does not exist Oct 22 20:55:04.513553 ncdv-master-1 devstack@n-api.service[138745]: Neutron server returns request_ids: ['req-26e8fb77-de59-4e6d-b6ae-de4a44600afb'] Oct 22 20:55:04.513553 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'id': 'c8c0e846-90ef-4b0b-bd05-cbc4424ed596'} Oct 22 20:55:04.513553 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:55:04.513553 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:55:04.513553 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 22 20:55:04.513553 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 22 20:55:04.513553 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 20:55:04.513553 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 20:55:04.513553 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 22 20:55:04.513553 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 22 20:55:04.513553 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 20:55:04.513553 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 20:55:04.513553 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 22 20:55:04.513553 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 22 20:55:04.513553 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 20:55:04.513553 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 20:55:04.513553 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 22 20:55:04.513553 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 22 20:55:04.513553 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 20:55:04.513553 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 20:55:04.513553 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 22 20:55:04.513553 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 22 20:55:04.513553 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 20:55:04.513553 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 20:55:04.513553 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 22 20:55:04.513553 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 22 20:55:04.513553 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 22 20:55:04.513553 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 22 20:55:04.513553 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group c8c0e846-90ef-4b0b-bd05-cbc4424ed596 does not exist Oct 22 20:55:04.518581 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-26e8fb77-de59-4e6d-b6ae-de4a44600afb'] Oct 22 20:55:04.518581 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:55:04.518581 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:55:04.518581 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:55:04.518581 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:55:04.518581 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 22 20:55:04.518581 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 22 20:55:04.518581 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 22 20:55:04.518581 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 22 20:55:04.518581 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group c8c0e846-90ef-4b0b-bd05-cbc4424ed596 does not exist Oct 22 20:55:04.518581 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-26e8fb77-de59-4e6d-b6ae-de4a44600afb'] Oct 22 20:55:04.518581 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:55:04.518581 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:55:04.518581 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:55:04.518581 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:55:04.518581 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:55:04.518581 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:55:04.518581 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:55:04.518581 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:55:04.518581 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 22 20:55:04.518581 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 22 20:55:04.518581 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:55:04.518581 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:55:04.518581 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 22 20:55:04.518581 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 22 20:55:04.518581 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group c8c0e846-90ef-4b0b-bd05-cbc4424ed596 does not exist Oct 22 20:55:04.518581 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-26e8fb77-de59-4e6d-b6ae-de4a44600afb'] Oct 22 20:55:04.518581 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:55:04.518581 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:55:04.518581 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:55:04.518581 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:55:04.518581 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:55:04.518581 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:55:04.518581 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 20:55:04.518581 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 20:55:04.518581 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group c8c0e846-90ef-4b0b-bd05-cbc4424ed596 does not exist Oct 22 20:55:04.518581 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-26e8fb77-de59-4e6d-b6ae-de4a44600afb'] Oct 22 20:55:04.518581 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:55:04.525447 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-1b49d654-909d-4d6a-99a7-9ab2f5e7bdf3 tempest-SecurityGroupsNegativeTestJSON-565994106 tempest-SecurityGroupsNegativeTestJSON-565994106-project] Returning 404 to user: Security group c8c0e846-90ef-4b0b-bd05-cbc4424ed596 does not exist Oct 22 20:55:04.525447 ncdv-master-1 devstack@n-api.service[138745]: Neutron server returns request_ids: ['req-26e8fb77-de59-4e6d-b6ae-de4a44600afb'] {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:55:04.525447 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-1b49d654-909d-4d6a-99a7-9ab2f5e7bdf3 tempest-SecurityGroupsNegativeTestJSON-565994106 tempest-SecurityGroupsNegativeTestJSON-565994106-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/c8c0e846-90ef-4b0b-bd05-cbc4424ed596" status: 404 len: 194 microversion: 2.1 time: 0.454807 Oct 22 20:55:04.525447 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 783/1500] 10.222.0.18 () {58 vars in 1272 bytes} [Sat Oct 22 20:55:04 2022] DELETE /compute/v2.1/os-security-groups/c8c0e846-90ef-4b0b-bd05-cbc4424ed596 => generated 194 bytes in 474 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 20:55:04.537662 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-0eccb3d9-8c12-4b26-bdea-3b8dc8f018f3 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:55:04.545256 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-0eccb3d9-8c12-4b26-bdea-3b8dc8f018f3 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] [instance: 40e6c6e3-3d47-4781-b8a8-aafd671d7287] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:55:04.566666 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0eccb3d9-8c12-4b26-bdea-3b8dc8f018f3 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:04.567169 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0eccb3d9-8c12-4b26-bdea-3b8dc8f018f3 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:04.567722 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0eccb3d9-8c12-4b26-bdea-3b8dc8f018f3 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:04.568480 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0eccb3d9-8c12-4b26-bdea-3b8dc8f018f3 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:04.568903 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0eccb3d9-8c12-4b26-bdea-3b8dc8f018f3 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:04.569338 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0eccb3d9-8c12-4b26-bdea-3b8dc8f018f3 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:04.841419 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-34d72861-cc82-4d6c-afa4-0b926f77b5b6 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b638db630404ebbbcc2253db30844c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cc7342bf7941d2ad7ebc70032dd52e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:55:04.856878 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-34d72861-cc82-4d6c-afa4-0b926f77b5b6 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] 10.222.0.18 "GET /compute/v2.1/servers/04d927bb-da77-4ca1-a828-562a01f07892" status: 200 len: 1277 microversion: 2.1 time: 0.415321 Oct 22 20:55:04.857558 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 718/1501] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:55:04 2022] GET /compute/v2.1/servers/04d927bb-da77-4ca1-a828-562a01f07892 => generated 1277 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:55:05.003868 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-a01463de-4bff-4e15-8b1e-0402efe42c0e tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-895017940", "imageRef": "085e4478-6edc-4a69-8e08-f9831713eb65", "flavorRef": "452", "networks": [{"uuid": "14f6a6b1-55b6-42d0-a3eb-c2e4d989429e"}]}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:55:05.100314 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.network.neutron [None req-a01463de-4bff-4e15-8b1e-0402efe42c0e tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] validate_networks() for [('14f6a6b1-55b6-42d0-a3eb-c2e4d989429e', None, None, None, None, None)] {{(pid=138744) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 20:55:05.195509 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-0eccb3d9-8c12-4b26-bdea-3b8dc8f018f3 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d3d7458af447bdb3f03e83a2d8559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49238b8686d24ae698679e4a1957735d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:55:05.211186 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-0eccb3d9-8c12-4b26-bdea-3b8dc8f018f3 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] 10.222.0.18 "GET /compute/v2.1/servers/40e6c6e3-3d47-4781-b8a8-aafd671d7287" status: 200 len: 1476 microversion: 2.1 time: 0.685031 Oct 22 20:55:05.212379 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 784/1502] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:55:04 2022] GET /compute/v2.1/servers/40e6c6e3-3d47-4781-b8a8-aafd671d7287 => generated 1476 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:55:05.219271 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-67b5ef22-1d89-4b37-bccc-1b892787026d tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] Calling method '.version_select at 0x7fd39fde6040>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:55:05.225639 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-67b5ef22-1d89-4b37-bccc-1b892787026d tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:05.226961 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-67b5ef22-1d89-4b37-bccc-1b892787026d tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:05.228202 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-67b5ef22-1d89-4b37-bccc-1b892787026d tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:05.246715 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-67b5ef22-1d89-4b37-bccc-1b892787026d tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] 10.222.0.18 "GET /compute/v2.1/os-migrations" status: 200 len: 3385 microversion: 2.25 time: 0.032841 Oct 22 20:55:05.249713 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 785/1503] 10.222.0.18 () {60 vars in 1184 bytes} [Sat Oct 22 20:55:05 2022] GET /compute/v2.1/os-migrations => generated 3385 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 20:55:05.257250 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-f5b7691e-2202-4395-b60e-890313fa349d tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:55:05.258265 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-f5b7691e-2202-4395-b60e-890313fa349d tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] [instance: 532d6e6a-71ab-4ef0-a5bf-c042055c5121] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:55:05.268226 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f5b7691e-2202-4395-b60e-890313fa349d tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:05.269379 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f5b7691e-2202-4395-b60e-890313fa349d tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:05.270359 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f5b7691e-2202-4395-b60e-890313fa349d tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:05.272409 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f5b7691e-2202-4395-b60e-890313fa349d tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:05.273476 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f5b7691e-2202-4395-b60e-890313fa349d tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:05.274282 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f5b7691e-2202-4395-b60e-890313fa349d tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:05.441644 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-f5b7691e-2202-4395-b60e-890313fa349d tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be93cabff0d46ccb2a3db0db1a13796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42111ed6bcc3465d8c1f5291da248e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:55:05.473811 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-f5b7691e-2202-4395-b60e-890313fa349d tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] 10.222.0.18 "GET /compute/v2.1/servers/532d6e6a-71ab-4ef0-a5bf-c042055c5121" status: 200 len: 1220 microversion: 2.1 time: 0.221450 Oct 22 20:55:05.479966 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 786/1504] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:55:05 2022] GET /compute/v2.1/servers/532d6e6a-71ab-4ef0-a5bf-c042055c5121 => generated 1220 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:55:05.495796 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-652ed655-c689-4444-a0bd-88f51ced8b78 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:55:05.496425 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-652ed655-c689-4444-a0bd-88f51ced8b78 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] [instance: fbb34507-cef9-4d78-9ed7-5d6eab4ca806] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:55:05.512311 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-652ed655-c689-4444-a0bd-88f51ced8b78 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:05.512816 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-652ed655-c689-4444-a0bd-88f51ced8b78 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:05.513477 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-652ed655-c689-4444-a0bd-88f51ced8b78 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:05.514372 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-652ed655-c689-4444-a0bd-88f51ced8b78 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:05.514990 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-652ed655-c689-4444-a0bd-88f51ced8b78 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:05.515621 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-652ed655-c689-4444-a0bd-88f51ced8b78 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:06.108072 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-652ed655-c689-4444-a0bd-88f51ced8b78 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c87f0356ca346f39c6216393d85da2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee8c8f7fc4e12bc1f9fcce3e7b581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:55:06.122157 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-652ed655-c689-4444-a0bd-88f51ced8b78 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] 10.222.0.18 "GET /compute/v2.1/servers/fbb34507-cef9-4d78-9ed7-5d6eab4ca806" status: 200 len: 1199 microversion: 2.1 time: 0.640752 Oct 22 20:55:06.127871 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 787/1505] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:55:05 2022] GET /compute/v2.1/servers/fbb34507-cef9-4d78-9ed7-5d6eab4ca806 => generated 1199 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:55:06.144180 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-75413a22-9880-4294-8fd9-71708d120171 tempest-SecurityGroupsNegativeTestJSON-565994106 tempest-SecurityGroupsNegativeTestJSON-565994106-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/" status: 404 len: 112 microversion: - time: 0.013704 Oct 22 20:55:06.145261 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 788/1506] 10.222.0.18 () {58 vars in 1164 bytes} [Sat Oct 22 20:55:06 2022] DELETE /compute/v2.1/os-security-groups/ => generated 112 bytes in 16 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 22 20:55:06.154089 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-2082b9b1-4c44-437d-bb8a-35500e413b59 req-4eaee4f4-899e-4da7-8ab0-e517dbdc6345 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fbb34507-cef9-4d78-9ed7-5d6eab4ca806", "tag": "21ed77e4-8dab-449b-afdb-01e27ef6b85c"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:55:06.180490 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-2082b9b1-4c44-437d-bb8a-35500e413b59 req-4eaee4f4-899e-4da7-8ab0-e517dbdc6345 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:06.182174 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-2082b9b1-4c44-437d-bb8a-35500e413b59 req-4eaee4f4-899e-4da7-8ab0-e517dbdc6345 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:06.182868 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-2082b9b1-4c44-437d-bb8a-35500e413b59 req-4eaee4f4-899e-4da7-8ab0-e517dbdc6345 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:06.223144 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-2082b9b1-4c44-437d-bb8a-35500e413b59 req-4eaee4f4-899e-4da7-8ab0-e517dbdc6345 service nova] Creating event network-changed:21ed77e4-8dab-449b-afdb-01e27ef6b85c for instance fbb34507-cef9-4d78-9ed7-5d6eab4ca806 on nch1-master-1 Oct 22 20:55:06.243624 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-2082b9b1-4c44-437d-bb8a-35500e413b59 req-4eaee4f4-899e-4da7-8ab0-e517dbdc6345 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096823 Oct 22 20:55:06.245177 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 789/1507] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:55:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:55:06.264504 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-3f05c5a9-7919-4a10-8f8d-fc7c7d1bad9b tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:55:06.265666 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-3f05c5a9-7919-4a10-8f8d-fc7c7d1bad9b tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] [instance: f499ce97-cdf8-4dcf-9c28-3758aea5e78c] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:55:06.290763 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3f05c5a9-7919-4a10-8f8d-fc7c7d1bad9b tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:06.296277 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3f05c5a9-7919-4a10-8f8d-fc7c7d1bad9b tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:06.299275 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3f05c5a9-7919-4a10-8f8d-fc7c7d1bad9b tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:06.302616 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3f05c5a9-7919-4a10-8f8d-fc7c7d1bad9b tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:06.306106 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3f05c5a9-7919-4a10-8f8d-fc7c7d1bad9b tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:06.311191 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3f05c5a9-7919-4a10-8f8d-fc7c7d1bad9b tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:07.461770 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-a01463de-4bff-4e15-8b1e-0402efe42c0e tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Flavor limits 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 20:55:07.463705 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-a01463de-4bff-4e15-8b1e-0402efe42c0e tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Image limits 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 20:55:07.464377 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-a01463de-4bff-4e15-8b1e-0402efe42c0e tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Flavor pref 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 20:55:07.464997 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-a01463de-4bff-4e15-8b1e-0402efe42c0e tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Image pref 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 20:55:07.465681 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-a01463de-4bff-4e15-8b1e-0402efe42c0e tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 20:55:07.493754 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a01463de-4bff-4e15-8b1e-0402efe42c0e tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:07.494387 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a01463de-4bff-4e15-8b1e-0402efe42c0e tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:07.498447 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a01463de-4bff-4e15-8b1e-0402efe42c0e tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:07.499731 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a01463de-4bff-4e15-8b1e-0402efe42c0e tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:07.502143 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a01463de-4bff-4e15-8b1e-0402efe42c0e tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:07.504692 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a01463de-4bff-4e15-8b1e-0402efe42c0e tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:07.541919 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.objects.instance [None req-3f05c5a9-7919-4a10-8f8d-fc7c7d1bad9b tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] Lazy-loading 'services' on Instance uuid f499ce97-cdf8-4dcf-9c28-3758aea5e78c {{(pid=138745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 20:55:07.573870 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-a01463de-4bff-4e15-8b1e-0402efe42c0e tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Getting quotas for project 594624ed28aa433d907c8833d360b82e. Resources: {'cores', 'instances', 'ram'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 20:55:07.585489 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-a01463de-4bff-4e15-8b1e-0402efe42c0e tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Getting quotas for user b392ad1fe1fd4b2a9e6be03a7435deb9 and project 594624ed28aa433d907c8833d360b82e. Resources: {'cores', 'instances', 'ram'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 20:55:07.612965 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-3f05c5a9-7919-4a10-8f8d-fc7c7d1bad9b tempest-LiveAutoBlockMigrationV225Test-1881980506 tempest-LiveAutoBlockMigrationV225Test-1881980506-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/f499ce97-cdf8-4dcf-9c28-3758aea5e78c" status: 200 len: 1967 microversion: 2.25 time: 1.364767 Oct 22 20:55:07.614012 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 790/1508] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 20:55:06 2022] GET /compute/v2.1/servers/f499ce97-cdf8-4dcf-9c28-3758aea5e78c => generated 1967 bytes in 1367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 20:55:07.619040 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-15127382-1e33-4381-9bc8-8a43358d9879 req-63c3aa20-2dde-4c5c-b54e-802d383e155d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40e6c6e3-3d47-4781-b8a8-aafd671d7287", "name": "network-vif-unplugged", "status": "completed", "tag": "3f86770d-1d07-4131-85b9-86ddae7d31e5"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:55:07.670296 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-15127382-1e33-4381-9bc8-8a43358d9879 req-63c3aa20-2dde-4c5c-b54e-802d383e155d service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:07.670648 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-a01463de-4bff-4e15-8b1e-0402efe42c0e tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Going to run 1 instances... {{(pid=138744) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 20:55:07.672723 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-15127382-1e33-4381-9bc8-8a43358d9879 req-63c3aa20-2dde-4c5c-b54e-802d383e155d service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:07.673005 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-a01463de-4bff-4e15-8b1e-0402efe42c0e tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] [instance: a64fa89e-32f6-4994-a0b2-3788cf1c92ec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='085e4478-6edc-4a69-8e08-f9831713eb65',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138744) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 20:55:07.675059 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-15127382-1e33-4381-9bc8-8a43358d9879 req-63c3aa20-2dde-4c5c-b54e-802d383e155d service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:07.702397 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-15127382-1e33-4381-9bc8-8a43358d9879 req-63c3aa20-2dde-4c5c-b54e-802d383e155d service nova] Creating event network-vif-unplugged:3f86770d-1d07-4131-85b9-86ddae7d31e5 for instance 40e6c6e3-3d47-4781-b8a8-aafd671d7287 on nch1-master-1 Oct 22 20:55:07.715306 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [req-15127382-1e33-4381-9bc8-8a43358d9879 req-63c3aa20-2dde-4c5c-b54e-802d383e155d service nova] Instance 40e6c6e3-3d47-4781-b8a8-aafd671d7287 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=138745) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 22 20:55:07.738551 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-15127382-1e33-4381-9bc8-8a43358d9879 req-63c3aa20-2dde-4c5c-b54e-802d383e155d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.122806 Oct 22 20:55:07.740304 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 791/1509] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:55:07 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:55:07.747296 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-71cd86fc-81de-4290-8e4e-4203715cfbac tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:55:07.748523 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-71cd86fc-81de-4290-8e4e-4203715cfbac tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] [instance: 0e92c2df-261e-44fd-b584-2f870190e8ce] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:55:07.758530 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-71cd86fc-81de-4290-8e4e-4203715cfbac tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:07.759468 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-71cd86fc-81de-4290-8e4e-4203715cfbac tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:07.760203 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-71cd86fc-81de-4290-8e4e-4203715cfbac tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:07.761293 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-71cd86fc-81de-4290-8e4e-4203715cfbac tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:07.762649 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-71cd86fc-81de-4290-8e4e-4203715cfbac tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:07.763357 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-71cd86fc-81de-4290-8e4e-4203715cfbac tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:07.781696 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-a01463de-4bff-4e15-8b1e-0402efe42c0e tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.920512 Oct 22 20:55:07.782454 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 719/1510] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Oct 22 20:55:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 2924 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 20:55:07.797881 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-d4bdd347-b7c9-4470-9101-10b21853d06e tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:55:07.798631 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-d4bdd347-b7c9-4470-9101-10b21853d06e tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] [instance: 04d927bb-da77-4ca1-a828-562a01f07892] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:55:07.810417 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d4bdd347-b7c9-4470-9101-10b21853d06e tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:07.810853 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d4bdd347-b7c9-4470-9101-10b21853d06e tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:07.814355 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d4bdd347-b7c9-4470-9101-10b21853d06e tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:07.815979 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d4bdd347-b7c9-4470-9101-10b21853d06e tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:07.831512 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d4bdd347-b7c9-4470-9101-10b21853d06e tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:07.840104 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d4bdd347-b7c9-4470-9101-10b21853d06e tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:08.187488 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-d4bdd347-b7c9-4470-9101-10b21853d06e tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b638db630404ebbbcc2253db30844c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cc7342bf7941d2ad7ebc70032dd52e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:55:08.202560 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-d4bdd347-b7c9-4470-9101-10b21853d06e tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] 10.222.0.18 "GET /compute/v2.1/servers/04d927bb-da77-4ca1-a828-562a01f07892" status: 200 len: 1319 microversion: 2.1 time: 0.418407 Oct 22 20:55:08.216048 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 720/1511] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:55:07 2022] GET /compute/v2.1/servers/04d927bb-da77-4ca1-a828-562a01f07892 => generated 1319 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:55:08.224679 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-b5d8861b-dff4-413e-8d4e-cc93c63814f7 tempest-SecurityGroupsNegativeTestJSON-565994106 tempest-SecurityGroupsNegativeTestJSON-565994106-project] Calling method '.version_select at 0x7fd39fef1dc0>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:55:08.443918 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-71cd86fc-81de-4290-8e4e-4203715cfbac tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7f48d18691d4473bbe0284c44f14d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bacf9909082440f8a201771b64a75fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:55:08.461653 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-71cd86fc-81de-4290-8e4e-4203715cfbac tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] 10.222.0.18 "GET /compute/v2.1/servers/0e92c2df-261e-44fd-b584-2f870190e8ce" status: 200 len: 1668 microversion: 2.1 time: 0.719539 Oct 22 20:55:08.463003 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 792/1512] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:55:07 2022] GET /compute/v2.1/servers/0e92c2df-261e-44fd-b584-2f870190e8ce => generated 1668 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:55:08.474565 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-a1c7e4f0-71d9-41f4-be57-0bba6f493d27 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:55:08.478678 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-a1c7e4f0-71d9-41f4-be57-0bba6f493d27 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] [instance: 40e6c6e3-3d47-4781-b8a8-aafd671d7287] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:55:08.494572 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a1c7e4f0-71d9-41f4-be57-0bba6f493d27 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:08.495467 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a1c7e4f0-71d9-41f4-be57-0bba6f493d27 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:08.500650 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a1c7e4f0-71d9-41f4-be57-0bba6f493d27 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:08.501606 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a1c7e4f0-71d9-41f4-be57-0bba6f493d27 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:08.504456 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a1c7e4f0-71d9-41f4-be57-0bba6f493d27 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:08.505302 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a1c7e4f0-71d9-41f4-be57-0bba6f493d27 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:08.822889 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-a1c7e4f0-71d9-41f4-be57-0bba6f493d27 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d3d7458af447bdb3f03e83a2d8559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49238b8686d24ae698679e4a1957735d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:55:08.838607 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-a1c7e4f0-71d9-41f4-be57-0bba6f493d27 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] 10.222.0.18 "GET /compute/v2.1/servers/40e6c6e3-3d47-4781-b8a8-aafd671d7287" status: 200 len: 1476 microversion: 2.1 time: 0.373843 Oct 22 20:55:08.841056 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 793/1513] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:55:08 2022] GET /compute/v2.1/servers/40e6c6e3-3d47-4781-b8a8-aafd671d7287 => generated 1476 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:55:08.852509 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-6ce894cb-3b30-4eb0-82ae-b0a2ce764adf tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:55:08.855450 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-6ce894cb-3b30-4eb0-82ae-b0a2ce764adf tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] [instance: 532d6e6a-71ab-4ef0-a5bf-c042055c5121] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:55:08.869849 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6ce894cb-3b30-4eb0-82ae-b0a2ce764adf tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:08.871742 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6ce894cb-3b30-4eb0-82ae-b0a2ce764adf tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:08.872432 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6ce894cb-3b30-4eb0-82ae-b0a2ce764adf tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:08.874119 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6ce894cb-3b30-4eb0-82ae-b0a2ce764adf tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:08.876678 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6ce894cb-3b30-4eb0-82ae-b0a2ce764adf tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:08.878542 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6ce894cb-3b30-4eb0-82ae-b0a2ce764adf tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:09.190053 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-6ce894cb-3b30-4eb0-82ae-b0a2ce764adf tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be93cabff0d46ccb2a3db0db1a13796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42111ed6bcc3465d8c1f5291da248e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:55:09.206544 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-6ce894cb-3b30-4eb0-82ae-b0a2ce764adf tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] 10.222.0.18 "GET /compute/v2.1/servers/532d6e6a-71ab-4ef0-a5bf-c042055c5121" status: 200 len: 1324 microversion: 2.1 time: 0.363754 Oct 22 20:55:09.215788 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 794/1514] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:55:08 2022] GET /compute/v2.1/servers/532d6e6a-71ab-4ef0-a5bf-c042055c5121 => generated 1324 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:55:09.228136 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-87c4c0b9-f9ea-4642-8fad-15de68e3f8b4 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:55:09.232045 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-87c4c0b9-f9ea-4642-8fad-15de68e3f8b4 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] [instance: fbb34507-cef9-4d78-9ed7-5d6eab4ca806] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:55:09.250456 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-87c4c0b9-f9ea-4642-8fad-15de68e3f8b4 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:09.254209 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-87c4c0b9-f9ea-4642-8fad-15de68e3f8b4 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:09.255164 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-87c4c0b9-f9ea-4642-8fad-15de68e3f8b4 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:09.272762 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-87c4c0b9-f9ea-4642-8fad-15de68e3f8b4 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:09.276836 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-87c4c0b9-f9ea-4642-8fad-15de68e3f8b4 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:09.278780 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-87c4c0b9-f9ea-4642-8fad-15de68e3f8b4 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:09.381019 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-b5d8861b-dff4-413e-8d4e-cc93c63814f7 tempest-SecurityGroupsNegativeTestJSON-565994106 tempest-SecurityGroupsNegativeTestJSON-565994106-project] 10.222.0.18 "GET /compute/v2.1/os-security-groups" status: 200 len: 707 microversion: 2.1 time: 1.163764 Oct 22 20:55:09.383038 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 721/1515] 10.222.0.18 () {58 vars in 1158 bytes} [Sat Oct 22 20:55:08 2022] GET /compute/v2.1/os-security-groups => generated 707 bytes in 1167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:55:09.388781 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-bbd3ee9b-a0e7-4be6-9812-bfc46246c7ef tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:55:09.389476 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-bbd3ee9b-a0e7-4be6-9812-bfc46246c7ef tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] [instance: f499ce97-cdf8-4dcf-9c28-3758aea5e78c] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:55:09.409112 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bbd3ee9b-a0e7-4be6-9812-bfc46246c7ef tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:09.413611 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bbd3ee9b-a0e7-4be6-9812-bfc46246c7ef tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:09.414357 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bbd3ee9b-a0e7-4be6-9812-bfc46246c7ef tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:09.415708 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bbd3ee9b-a0e7-4be6-9812-bfc46246c7ef tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:09.416380 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bbd3ee9b-a0e7-4be6-9812-bfc46246c7ef tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:09.418152 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bbd3ee9b-a0e7-4be6-9812-bfc46246c7ef tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:09.494553 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-bbd3ee9b-a0e7-4be6-9812-bfc46246c7ef tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] [instance: f499ce97-cdf8-4dcf-9c28-3758aea5e78c] Going to try to terminate instance {{(pid=138744) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 20:55:09.704396 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-bbd3ee9b-a0e7-4be6-9812-bfc46246c7ef tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] 10.222.0.18 "DELETE /compute/v2.1/servers/f499ce97-cdf8-4dcf-9c28-3758aea5e78c" status: 204 len: 0 microversion: 2.25 time: 0.319837 Oct 22 20:55:09.714764 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 722/1516] 10.222.0.18 () {60 vars in 1280 bytes} [Sat Oct 22 20:55:09 2022] DELETE /compute/v2.1/servers/f499ce97-cdf8-4dcf-9c28-3758aea5e78c => generated 0 bytes in 331 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 22 20:55:09.731885 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-ee153186-dad5-4b5b-81e4-9b3d04e3ecd1 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:55:09.732633 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-ee153186-dad5-4b5b-81e4-9b3d04e3ecd1 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] [instance: a64fa89e-32f6-4994-a0b2-3788cf1c92ec] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:55:09.745476 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ee153186-dad5-4b5b-81e4-9b3d04e3ecd1 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:09.746000 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ee153186-dad5-4b5b-81e4-9b3d04e3ecd1 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:09.746448 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ee153186-dad5-4b5b-81e4-9b3d04e3ecd1 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:09.747188 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ee153186-dad5-4b5b-81e4-9b3d04e3ecd1 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:09.747684 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ee153186-dad5-4b5b-81e4-9b3d04e3ecd1 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:09.748124 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ee153186-dad5-4b5b-81e4-9b3d04e3ecd1 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:09.772464 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-87c4c0b9-f9ea-4642-8fad-15de68e3f8b4 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c87f0356ca346f39c6216393d85da2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee8c8f7fc4e12bc1f9fcce3e7b581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:55:09.785075 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-87c4c0b9-f9ea-4642-8fad-15de68e3f8b4 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] 10.222.0.18 "GET /compute/v2.1/servers/fbb34507-cef9-4d78-9ed7-5d6eab4ca806" status: 200 len: 1199 microversion: 2.1 time: 0.568284 Oct 22 20:55:09.805626 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 795/1517] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:55:09 2022] GET /compute/v2.1/servers/fbb34507-cef9-4d78-9ed7-5d6eab4ca806 => generated 1199 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:55:09.811209 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-fb670a9f-cfe5-4a91-94ab-596122e0a265 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:55:09.818993 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-fb670a9f-cfe5-4a91-94ab-596122e0a265 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] [instance: 0e92c2df-261e-44fd-b584-2f870190e8ce] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:55:09.830375 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fb670a9f-cfe5-4a91-94ab-596122e0a265 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:09.831059 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fb670a9f-cfe5-4a91-94ab-596122e0a265 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:09.838511 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fb670a9f-cfe5-4a91-94ab-596122e0a265 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:09.840425 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fb670a9f-cfe5-4a91-94ab-596122e0a265 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:09.841167 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fb670a9f-cfe5-4a91-94ab-596122e0a265 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:09.847938 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fb670a9f-cfe5-4a91-94ab-596122e0a265 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:09.903245 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-fb670a9f-cfe5-4a91-94ab-596122e0a265 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] 10.222.0.18 "GET /compute/v2.1/servers/0e92c2df-261e-44fd-b584-2f870190e8ce/ips" status: 200 len: 178 microversion: 2.1 time: 0.096022 Oct 22 20:55:09.904508 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 796/1518] 10.222.0.18 () {58 vars in 1248 bytes} [Sat Oct 22 20:55:09 2022] GET /compute/v2.1/servers/0e92c2df-261e-44fd-b584-2f870190e8ce/ips => generated 178 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:55:09.909827 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-0a748ef4-0c0d-47c7-baea-9bc9c55f0abe tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:55:09.910734 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-0a748ef4-0c0d-47c7-baea-9bc9c55f0abe tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] [instance: 04d927bb-da77-4ca1-a828-562a01f07892] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:55:09.919628 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0a748ef4-0c0d-47c7-baea-9bc9c55f0abe tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:09.920408 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0a748ef4-0c0d-47c7-baea-9bc9c55f0abe tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:09.921624 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0a748ef4-0c0d-47c7-baea-9bc9c55f0abe tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:09.922567 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0a748ef4-0c0d-47c7-baea-9bc9c55f0abe tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:09.923195 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0a748ef4-0c0d-47c7-baea-9bc9c55f0abe tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:09.923805 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0a748ef4-0c0d-47c7-baea-9bc9c55f0abe tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:09.946235 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-ee153186-dad5-4b5b-81e4-9b3d04e3ecd1 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b392ad1fe1fd4b2a9e6be03a7435deb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594624ed28aa433d907c8833d360b82e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:55:09.956730 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:55:09.961188 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-ee153186-dad5-4b5b-81e4-9b3d04e3ecd1 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] 10.222.0.18 "GET /compute/v2.1/servers/a64fa89e-32f6-4994-a0b2-3788cf1c92ec" status: 200 len: 1276 microversion: 2.1 time: 0.244945 Oct 22 20:55:09.963453 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 723/1519] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:55:09 2022] GET /compute/v2.1/servers/a64fa89e-32f6-4994-a0b2-3788cf1c92ec => generated 1276 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:55:10.009292 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-f9ce1f57-0ae2-454c-a6d2-945c6f93b95f tempest-SecurityGroupsNegativeTestJSON-565994106 tempest-SecurityGroupsNegativeTestJSON-565994106-project] Calling method '.version_select at 0x7fd39feb7b80>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:55:10.261933 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-0a748ef4-0c0d-47c7-baea-9bc9c55f0abe tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b638db630404ebbbcc2253db30844c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cc7342bf7941d2ad7ebc70032dd52e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:55:10.273936 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-0a748ef4-0c0d-47c7-baea-9bc9c55f0abe tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] 10.222.0.18 "GET /compute/v2.1/servers/04d927bb-da77-4ca1-a828-562a01f07892" status: 200 len: 1319 microversion: 2.1 time: 0.366817 Oct 22 20:55:10.292275 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 797/1520] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:55:09 2022] GET /compute/v2.1/servers/04d927bb-da77-4ca1-a828-562a01f07892 => generated 1319 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:55:10.307530 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-3a65e3a3-b39d-4e74-8895-f7cff123aa9f tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:55:10.308551 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-3a65e3a3-b39d-4e74-8895-f7cff123aa9f tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] [instance: f499ce97-cdf8-4dcf-9c28-3758aea5e78c] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:55:10.324773 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3a65e3a3-b39d-4e74-8895-f7cff123aa9f tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:10.326354 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3a65e3a3-b39d-4e74-8895-f7cff123aa9f tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:10.331064 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3a65e3a3-b39d-4e74-8895-f7cff123aa9f tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:10.332016 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3a65e3a3-b39d-4e74-8895-f7cff123aa9f tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:10.332780 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3a65e3a3-b39d-4e74-8895-f7cff123aa9f tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:10.333233 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3a65e3a3-b39d-4e74-8895-f7cff123aa9f tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:10.515289 ncdv-master-1 devstack@n-api.service[138744]: DEBUG neutronclient.v2_0.client [None req-f9ce1f57-0ae2-454c-a6d2-945c6f93b95f tempest-SecurityGroupsNegativeTestJSON-565994106 tempest-SecurityGroupsNegativeTestJSON-565994106-project] Error message: {"NeutronError": {"type": "SecurityGroupCannotRemoveDefault", "message": "Insufficient rights for removing default security group.", "detail": ""}} {{(pid=138744) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 22 20:55:10.517188 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-f9ce1f57-0ae2-454c-a6d2-945c6f93b95f tempest-SecurityGroupsNegativeTestJSON-565994106 tempest-SecurityGroupsNegativeTestJSON-565994106-project] HTTP exception thrown: Insufficient rights for removing default security group. Oct 22 20:55:10.517188 ncdv-master-1 devstack@n-api.service[138744]: Neutron server returns request_ids: ['req-42144ec1-a615-4601-a297-ff0f40ac983f'] Oct 22 20:55:10.524645 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-f9ce1f57-0ae2-454c-a6d2-945c6f93b95f tempest-SecurityGroupsNegativeTestJSON-565994106 tempest-SecurityGroupsNegativeTestJSON-565994106-project] Request method failure captured: Oct 22 20:55:10.524645 ncdv-master-1 devstack@n-api.service[138744]: request: DELETE /compute/v2.1/os-security-groups/67607d6e-fed2-48a9-8924-0be32465db0c HTTP/1.1 Oct 22 20:55:10.524645 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 20:55:10.524645 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 20:55:10.524645 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 20:55:10.524645 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 0 Oct 22 20:55:10.524645 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 20:55:10.524645 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 20:55:10.524645 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 20:55:10.524645 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 20:55:10.524645 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVFimXF3Ln5E_gYMZHk-3t3SO-eu7sVKWtZrnZ2RGyEl4c7jdw-E6E7cUUjqe8-4ht5f7o0Bi7sEtrsPepffOE8mmp9JsTBJ3GHuKi_SEVnI5ByGy0qVtbTROxo2Qa4XkB9BrRkUAM3SpVJGWrkrmo969bVSqw0_y0Vf-F8TReCbjSpA Oct 22 20:55:10.524645 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 20:55:10.524645 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 20:55:10.524645 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 20:55:10.524645 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 20:55:10.524645 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 20:55:10.524645 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 20:55:10.524645 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: a675afb1c0124470804c1d2eb0620a60 Oct 22 20:55:10.524645 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-565994106 Oct 22 20:55:10.524645 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 20:55:10.524645 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 20:55:10.524645 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_a675afb1c0124470804c1d2eb0620a60"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a675afb1c0124470804c1d2eb0620a60"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/a675afb1c0124470804c1d2eb0620a60"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a675afb1c0124470804c1d2eb0620a60"}]}] Oct 22 20:55:10.524645 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-565994106 Oct 22 20:55:10.524645 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: a675afb1c0124470804c1d2eb0620a60 Oct 22 20:55:10.524645 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-565994106 Oct 22 20:55:10.524645 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-SecurityGroupsNegativeTestJSON-565994106-project Oct 22 20:55:10.524645 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 20:55:10.524645 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 20:55:10.524645 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: 8dd36113b6fa4cbab58edb75b08d17e1 Oct 22 20:55:10.524645 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-565994106-project Oct 22 20:55:10.524645 ncdv-master-1 devstack@n-api.service[138744]: method: Oct 22 20:55:10.524645 ncdv-master-1 devstack@n-api.service[138744]: exception: Insufficient rights for removing default security group. Oct 22 20:55:10.524645 ncdv-master-1 devstack@n-api.service[138744]: Neutron server returns request_ids: ['req-42144ec1-a615-4601-a297-ff0f40ac983f'] Oct 22 20:55:10.524645 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': '67607d6e-fed2-48a9-8924-0be32465db0c'} Oct 22 20:55:10.524645 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:55:10.524645 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:55:10.524645 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Oct 22 20:55:10.524645 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Oct 22 20:55:10.524645 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 20:55:10.524645 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 20:55:10.524645 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Oct 22 20:55:10.524645 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Oct 22 20:55:10.524645 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 20:55:10.524645 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 20:55:10.524645 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Oct 22 20:55:10.524645 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Oct 22 20:55:10.524645 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 20:55:10.524645 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 20:55:10.524645 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 22 20:55:10.524645 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 22 20:55:10.524645 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 20:55:10.524645 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 20:55:10.524645 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 22 20:55:10.524645 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 22 20:55:10.524645 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 20:55:10.524645 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 20:55:10.524645 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 22 20:55:10.524645 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 22 20:55:10.524645 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 22 20:55:10.524645 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 22 20:55:10.524645 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Insufficient rights for removing default security group. Oct 22 20:55:10.530242 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-42144ec1-a615-4601-a297-ff0f40ac983f'] Oct 22 20:55:10.530242 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:55:10.530242 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:55:10.530242 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:55:10.530242 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:55:10.530242 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Oct 22 20:55:10.530242 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Oct 22 20:55:10.530242 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Oct 22 20:55:10.530242 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Oct 22 20:55:10.530242 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Insufficient rights for removing default security group. Oct 22 20:55:10.530242 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-42144ec1-a615-4601-a297-ff0f40ac983f'] Oct 22 20:55:10.530242 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:55:10.530242 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:55:10.530242 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:55:10.530242 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:55:10.530242 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:55:10.530242 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:55:10.530242 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:55:10.530242 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:55:10.530242 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 22 20:55:10.530242 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 22 20:55:10.530242 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:55:10.530242 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:55:10.530242 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Oct 22 20:55:10.530242 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 22 20:55:10.530242 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Insufficient rights for removing default security group. Oct 22 20:55:10.530242 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-42144ec1-a615-4601-a297-ff0f40ac983f'] Oct 22 20:55:10.530242 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:55:10.530242 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:55:10.530242 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:55:10.530242 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:55:10.530242 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:55:10.530242 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:55:10.530242 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 20:55:10.530242 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 20:55:10.530242 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Insufficient rights for removing default security group. Oct 22 20:55:10.530242 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-42144ec1-a615-4601-a297-ff0f40ac983f'] Oct 22 20:55:10.530242 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:55:10.536921 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-f9ce1f57-0ae2-454c-a6d2-945c6f93b95f tempest-SecurityGroupsNegativeTestJSON-565994106 tempest-SecurityGroupsNegativeTestJSON-565994106-project] Returning 400 to user: Insufficient rights for removing default security group. Oct 22 20:55:10.536921 ncdv-master-1 devstack@n-api.service[138744]: Neutron server returns request_ids: ['req-42144ec1-a615-4601-a297-ff0f40ac983f'] {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:55:10.538990 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-f9ce1f57-0ae2-454c-a6d2-945c6f93b95f tempest-SecurityGroupsNegativeTestJSON-565994106 tempest-SecurityGroupsNegativeTestJSON-565994106-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/67607d6e-fed2-48a9-8924-0be32465db0c" status: 400 len: 182 microversion: 2.1 time: 0.545213 Oct 22 20:55:10.540429 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 724/1521] 10.222.0.18 () {58 vars in 1272 bytes} [Sat Oct 22 20:55:09 2022] DELETE /compute/v2.1/os-security-groups/67607d6e-fed2-48a9-8924-0be32465db0c => generated 182 bytes in 549 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 22 20:55:10.546979 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-a89b327d-36be-4ec7-92b5-91933302e761 req-55ec2af2-73fb-4a51-b393-3da6cf0d60d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c2cedf74-885c-404c-b12f-9b7f7d15734c", "tag": "ef76c4a9-664c-45a4-9ef1-72702dee483a"}, {"name": "network-changed", "server_uuid": "40e6c6e3-3d47-4781-b8a8-aafd671d7287", "tag": "3f86770d-1d07-4131-85b9-86ddae7d31e5"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:55:10.563985 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-a89b327d-36be-4ec7-92b5-91933302e761 req-55ec2af2-73fb-4a51-b393-3da6cf0d60d8 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:10.565122 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-a89b327d-36be-4ec7-92b5-91933302e761 req-55ec2af2-73fb-4a51-b393-3da6cf0d60d8 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:10.565797 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-a89b327d-36be-4ec7-92b5-91933302e761 req-55ec2af2-73fb-4a51-b393-3da6cf0d60d8 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:10.587786 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-a89b327d-36be-4ec7-92b5-91933302e761 req-55ec2af2-73fb-4a51-b393-3da6cf0d60d8 service nova] Creating event network-changed:ef76c4a9-664c-45a4-9ef1-72702dee483a for instance c2cedf74-885c-404c-b12f-9b7f7d15734c on nch2-master-1 Oct 22 20:55:10.588441 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-a89b327d-36be-4ec7-92b5-91933302e761 req-55ec2af2-73fb-4a51-b393-3da6cf0d60d8 service nova] Creating event network-changed:3f86770d-1d07-4131-85b9-86ddae7d31e5 for instance 40e6c6e3-3d47-4781-b8a8-aafd671d7287 on nch1-master-1 Oct 22 20:55:10.597366 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [req-a89b327d-36be-4ec7-92b5-91933302e761 req-55ec2af2-73fb-4a51-b393-3da6cf0d60d8 service nova] Instance 40e6c6e3-3d47-4781-b8a8-aafd671d7287 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=138744) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 22 20:55:10.611382 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-a89b327d-36be-4ec7-92b5-91933302e761 req-55ec2af2-73fb-4a51-b393-3da6cf0d60d8 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.069215 Oct 22 20:55:10.612434 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 725/1522] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:55:10 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:55:10.617910 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-7e33fa7e-43e7-447c-8732-434905d187a4 req-823b0b32-f504-40eb-91cf-a56e356412b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04d927bb-da77-4ca1-a828-562a01f07892", "tag": "0747114c-f2e1-42d3-a601-70006dee0431"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:55:10.622990 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=12,nova_api:UPDATE=1 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:55:10.630340 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-7e33fa7e-43e7-447c-8732-434905d187a4 req-823b0b32-f504-40eb-91cf-a56e356412b0 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:10.631068 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-7e33fa7e-43e7-447c-8732-434905d187a4 req-823b0b32-f504-40eb-91cf-a56e356412b0 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:10.631712 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-7e33fa7e-43e7-447c-8732-434905d187a4 req-823b0b32-f504-40eb-91cf-a56e356412b0 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:10.653225 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-7e33fa7e-43e7-447c-8732-434905d187a4 req-823b0b32-f504-40eb-91cf-a56e356412b0 service nova] Creating event network-changed:0747114c-f2e1-42d3-a601-70006dee0431 for instance 04d927bb-da77-4ca1-a828-562a01f07892 on nch2-master-1 Oct 22 20:55:10.659743 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-7e33fa7e-43e7-447c-8732-434905d187a4 req-823b0b32-f504-40eb-91cf-a56e356412b0 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045121 Oct 22 20:55:10.661166 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 726/1523] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:55:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:55:10.668975 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-60e294b9-e15a-4636-8eb9-f7f240c031cf tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:55:10.669782 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-60e294b9-e15a-4636-8eb9-f7f240c031cf tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] [instance: 40e6c6e3-3d47-4781-b8a8-aafd671d7287] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:55:10.681235 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-60e294b9-e15a-4636-8eb9-f7f240c031cf tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:10.682300 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-60e294b9-e15a-4636-8eb9-f7f240c031cf tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:10.683155 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-60e294b9-e15a-4636-8eb9-f7f240c031cf tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:10.684086 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-60e294b9-e15a-4636-8eb9-f7f240c031cf tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:10.684701 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-60e294b9-e15a-4636-8eb9-f7f240c031cf tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:10.685283 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-60e294b9-e15a-4636-8eb9-f7f240c031cf tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:10.777302 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-3a65e3a3-b39d-4e74-8895-f7cff123aa9f tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:55:10.792431 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-3a65e3a3-b39d-4e74-8895-f7cff123aa9f tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:55:10.796975 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-3a65e3a3-b39d-4e74-8895-f7cff123aa9f tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:55:10.800086 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-3a65e3a3-b39d-4e74-8895-f7cff123aa9f tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] 10.222.0.18 "GET /compute/v2.1/servers/f499ce97-cdf8-4dcf-9c28-3758aea5e78c" status: 200 len: 1482 microversion: 2.25 time: 0.506605 Oct 22 20:55:10.821266 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 798/1524] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 20:55:10 2022] GET /compute/v2.1/servers/f499ce97-cdf8-4dcf-9c28-3758aea5e78c => generated 1482 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 20:55:10.841216 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-9f1f9a48-2f9d-4958-a79c-89f427902c4c tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:55:10.841854 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-9f1f9a48-2f9d-4958-a79c-89f427902c4c tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] [instance: 0e92c2df-261e-44fd-b584-2f870190e8ce] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:55:10.857192 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9f1f9a48-2f9d-4958-a79c-89f427902c4c tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:10.859258 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9f1f9a48-2f9d-4958-a79c-89f427902c4c tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:10.860853 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9f1f9a48-2f9d-4958-a79c-89f427902c4c tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:10.863102 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9f1f9a48-2f9d-4958-a79c-89f427902c4c tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:10.865656 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9f1f9a48-2f9d-4958-a79c-89f427902c4c tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:10.866660 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9f1f9a48-2f9d-4958-a79c-89f427902c4c tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:10.914067 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-9f1f9a48-2f9d-4958-a79c-89f427902c4c tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] [instance: 0e92c2df-261e-44fd-b584-2f870190e8ce] Going to try to terminate instance {{(pid=138745) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 20:55:10.966496 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-60e294b9-e15a-4636-8eb9-f7f240c031cf tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d3d7458af447bdb3f03e83a2d8559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49238b8686d24ae698679e4a1957735d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:55:10.978353 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-60e294b9-e15a-4636-8eb9-f7f240c031cf tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] 10.222.0.18 "GET /compute/v2.1/servers/40e6c6e3-3d47-4781-b8a8-aafd671d7287" status: 200 len: 1474 microversion: 2.1 time: 0.315620 Oct 22 20:55:10.983113 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 727/1525] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:55:10 2022] GET /compute/v2.1/servers/40e6c6e3-3d47-4781-b8a8-aafd671d7287 => generated 1474 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:55:10.991443 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-b724005f-c9f4-4996-991f-8e12342bd208 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:55:10.992403 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-b724005f-c9f4-4996-991f-8e12342bd208 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] [instance: 532d6e6a-71ab-4ef0-a5bf-c042055c5121] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:55:11.003815 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b724005f-c9f4-4996-991f-8e12342bd208 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:11.004542 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b724005f-c9f4-4996-991f-8e12342bd208 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:11.004876 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b724005f-c9f4-4996-991f-8e12342bd208 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:11.005603 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b724005f-c9f4-4996-991f-8e12342bd208 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:11.006068 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b724005f-c9f4-4996-991f-8e12342bd208 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:11.006506 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b724005f-c9f4-4996-991f-8e12342bd208 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:11.119123 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-9f1f9a48-2f9d-4958-a79c-89f427902c4c tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] 10.222.0.18 "DELETE /compute/v2.1/servers/0e92c2df-261e-44fd-b584-2f870190e8ce" status: 204 len: 0 microversion: 2.1 time: 0.295332 Oct 22 20:55:11.132698 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 799/1526] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 20:55:10 2022] DELETE /compute/v2.1/servers/0e92c2df-261e-44fd-b584-2f870190e8ce => generated 0 bytes in 311 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 20:55:11.140602 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-2caff7c8-4098-44d7-af56-d4ce03a573b6 tempest-SecurityGroupsNegativeTestJSON-565994106 tempest-SecurityGroupsNegativeTestJSON-565994106-project] Calling method '.version_select at 0x7fd39fe5dca0>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:55:11.199072 ncdv-master-1 devstack@n-api.service[138745]: DEBUG neutronclient.v2_0.client [None req-2caff7c8-4098-44d7-af56-d4ce03a573b6 tempest-SecurityGroupsNegativeTestJSON-565994106 tempest-SecurityGroupsNegativeTestJSON-565994106-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 6539b6ed-d3ee-4e8f-9f1d-6b16330b1a64 does not exist", "detail": ""}} {{(pid=138745) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 22 20:55:11.200328 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.network.security_group_api [None req-2caff7c8-4098-44d7-af56-d4ce03a573b6 tempest-SecurityGroupsNegativeTestJSON-565994106 tempest-SecurityGroupsNegativeTestJSON-565994106-project] Neutron security group 6539b6ed-d3ee-4e8f-9f1d-6b16330b1a64 not found {{(pid=138745) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 22 20:55:11.201128 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.wsgi [None req-2caff7c8-4098-44d7-af56-d4ce03a573b6 tempest-SecurityGroupsNegativeTestJSON-565994106 tempest-SecurityGroupsNegativeTestJSON-565994106-project] HTTP exception thrown: Security group 6539b6ed-d3ee-4e8f-9f1d-6b16330b1a64 does not exist Oct 22 20:55:11.201128 ncdv-master-1 devstack@n-api.service[138745]: Neutron server returns request_ids: ['req-4c9f563a-4d5f-4157-b5cb-6e1791cf65ab'] Oct 22 20:55:11.203947 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-2caff7c8-4098-44d7-af56-d4ce03a573b6 tempest-SecurityGroupsNegativeTestJSON-565994106 tempest-SecurityGroupsNegativeTestJSON-565994106-project] Request method failure captured: Oct 22 20:55:11.203947 ncdv-master-1 devstack@n-api.service[138745]: request: GET /compute/v2.1/os-security-groups/6539b6ed-d3ee-4e8f-9f1d-6b16330b1a64 HTTP/1.1 Oct 22 20:55:11.203947 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 20:55:11.203947 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 20:55:11.203947 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 20:55:11.203947 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 0 Oct 22 20:55:11.203947 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 20:55:11.203947 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 20:55:11.203947 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 20:55:11.203947 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 20:55:11.203947 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVFimXF3Ln5E_gYMZHk-3t3SO-eu7sVKWtZrnZ2RGyEl4c7jdw-E6E7cUUjqe8-4ht5f7o0Bi7sEtrsPepffOE8mmp9JsTBJ3GHuKi_SEVnI5ByGy0qVtbTROxo2Qa4XkB9BrRkUAM3SpVJGWrkrmo969bVSqw0_y0Vf-F8TReCbjSpA Oct 22 20:55:11.203947 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 20:55:11.203947 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 20:55:11.203947 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 20:55:11.203947 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 20:55:11.203947 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 20:55:11.203947 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 20:55:11.203947 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: a675afb1c0124470804c1d2eb0620a60 Oct 22 20:55:11.203947 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-565994106 Oct 22 20:55:11.203947 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 20:55:11.203947 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 20:55:11.203947 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_a675afb1c0124470804c1d2eb0620a60"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a675afb1c0124470804c1d2eb0620a60"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/a675afb1c0124470804c1d2eb0620a60"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a675afb1c0124470804c1d2eb0620a60"}]}] Oct 22 20:55:11.203947 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-565994106 Oct 22 20:55:11.203947 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: a675afb1c0124470804c1d2eb0620a60 Oct 22 20:55:11.203947 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-565994106 Oct 22 20:55:11.203947 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-SecurityGroupsNegativeTestJSON-565994106-project Oct 22 20:55:11.203947 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 20:55:11.203947 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 20:55:11.203947 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: 8dd36113b6fa4cbab58edb75b08d17e1 Oct 22 20:55:11.203947 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-565994106-project Oct 22 20:55:11.203947 ncdv-master-1 devstack@n-api.service[138745]: method: Oct 22 20:55:11.203947 ncdv-master-1 devstack@n-api.service[138745]: exception: Security group 6539b6ed-d3ee-4e8f-9f1d-6b16330b1a64 does not exist Oct 22 20:55:11.203947 ncdv-master-1 devstack@n-api.service[138745]: Neutron server returns request_ids: ['req-4c9f563a-4d5f-4157-b5cb-6e1791cf65ab'] Oct 22 20:55:11.203947 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'id': '6539b6ed-d3ee-4e8f-9f1d-6b16330b1a64'} Oct 22 20:55:11.203947 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:55:11.203947 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:55:11.203947 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 22 20:55:11.203947 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 22 20:55:11.203947 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 20:55:11.203947 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 20:55:11.203947 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 22 20:55:11.203947 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 22 20:55:11.203947 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 20:55:11.203947 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 20:55:11.203947 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 22 20:55:11.203947 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 22 20:55:11.203947 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 20:55:11.203947 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 20:55:11.203947 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 22 20:55:11.203947 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 22 20:55:11.203947 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 20:55:11.203947 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 20:55:11.203947 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 22 20:55:11.203947 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 22 20:55:11.203947 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 20:55:11.203947 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 20:55:11.203947 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 22 20:55:11.203947 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 22 20:55:11.203947 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 22 20:55:11.203947 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 22 20:55:11.203947 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 6539b6ed-d3ee-4e8f-9f1d-6b16330b1a64 does not exist Oct 22 20:55:11.208671 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4c9f563a-4d5f-4157-b5cb-6e1791cf65ab'] Oct 22 20:55:11.208671 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:55:11.208671 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:55:11.208671 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:55:11.208671 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:55:11.208671 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 22 20:55:11.208671 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 22 20:55:11.208671 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 22 20:55:11.208671 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 22 20:55:11.208671 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 6539b6ed-d3ee-4e8f-9f1d-6b16330b1a64 does not exist Oct 22 20:55:11.208671 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4c9f563a-4d5f-4157-b5cb-6e1791cf65ab'] Oct 22 20:55:11.208671 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:55:11.208671 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:55:11.208671 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:55:11.208671 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:55:11.208671 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:55:11.208671 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:55:11.208671 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:55:11.208671 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:55:11.208671 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 22 20:55:11.208671 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 22 20:55:11.208671 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:55:11.208671 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:55:11.208671 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 22 20:55:11.208671 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 22 20:55:11.208671 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 6539b6ed-d3ee-4e8f-9f1d-6b16330b1a64 does not exist Oct 22 20:55:11.208671 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4c9f563a-4d5f-4157-b5cb-6e1791cf65ab'] Oct 22 20:55:11.208671 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:55:11.208671 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:55:11.208671 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:55:11.208671 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:55:11.208671 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:55:11.208671 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:55:11.208671 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 20:55:11.208671 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 20:55:11.208671 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 6539b6ed-d3ee-4e8f-9f1d-6b16330b1a64 does not exist Oct 22 20:55:11.208671 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4c9f563a-4d5f-4157-b5cb-6e1791cf65ab'] Oct 22 20:55:11.208671 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:55:11.212870 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-2caff7c8-4098-44d7-af56-d4ce03a573b6 tempest-SecurityGroupsNegativeTestJSON-565994106 tempest-SecurityGroupsNegativeTestJSON-565994106-project] Returning 404 to user: Security group 6539b6ed-d3ee-4e8f-9f1d-6b16330b1a64 does not exist Oct 22 20:55:11.212870 ncdv-master-1 devstack@n-api.service[138745]: Neutron server returns request_ids: ['req-4c9f563a-4d5f-4157-b5cb-6e1791cf65ab'] {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:55:11.214471 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-2caff7c8-4098-44d7-af56-d4ce03a573b6 tempest-SecurityGroupsNegativeTestJSON-565994106 tempest-SecurityGroupsNegativeTestJSON-565994106-project] 10.222.0.18 "GET /compute/v2.1/os-security-groups/6539b6ed-d3ee-4e8f-9f1d-6b16330b1a64" status: 404 len: 194 microversion: 2.1 time: 0.080151 Oct 22 20:55:11.215237 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 800/1527] 10.222.0.18 () {58 vars in 1269 bytes} [Sat Oct 22 20:55:11 2022] GET /compute/v2.1/os-security-groups/6539b6ed-d3ee-4e8f-9f1d-6b16330b1a64 => generated 194 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 20:55:11.229314 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-b899d715-d165-43b0-8961-d53d2af5eb9c tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:55:11.230352 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-b899d715-d165-43b0-8961-d53d2af5eb9c tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] [instance: fbb34507-cef9-4d78-9ed7-5d6eab4ca806] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:55:11.243429 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b899d715-d165-43b0-8961-d53d2af5eb9c tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:11.244292 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b899d715-d165-43b0-8961-d53d2af5eb9c tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:11.245090 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b899d715-d165-43b0-8961-d53d2af5eb9c tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:11.246683 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b899d715-d165-43b0-8961-d53d2af5eb9c tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:11.247326 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b899d715-d165-43b0-8961-d53d2af5eb9c tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:11.248110 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b899d715-d165-43b0-8961-d53d2af5eb9c tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:11.267757 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-b724005f-c9f4-4996-991f-8e12342bd208 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be93cabff0d46ccb2a3db0db1a13796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42111ed6bcc3465d8c1f5291da248e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:55:11.276373 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-b724005f-c9f4-4996-991f-8e12342bd208 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] 10.222.0.18 "GET /compute/v2.1/servers/532d6e6a-71ab-4ef0-a5bf-c042055c5121" status: 200 len: 1324 microversion: 2.1 time: 0.291900 Oct 22 20:55:11.276971 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 728/1528] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:55:10 2022] GET /compute/v2.1/servers/532d6e6a-71ab-4ef0-a5bf-c042055c5121 => generated 1324 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:55:11.295855 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-44d202bf-8a62-4835-8ef0-7c660b9b186b tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:55:11.296465 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-44d202bf-8a62-4835-8ef0-7c660b9b186b tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] [instance: a64fa89e-32f6-4994-a0b2-3788cf1c92ec] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:55:11.305400 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-44d202bf-8a62-4835-8ef0-7c660b9b186b tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:11.305914 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-44d202bf-8a62-4835-8ef0-7c660b9b186b tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:11.306367 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-44d202bf-8a62-4835-8ef0-7c660b9b186b tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:11.307080 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-44d202bf-8a62-4835-8ef0-7c660b9b186b tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:11.307580 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-44d202bf-8a62-4835-8ef0-7c660b9b186b tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:11.308015 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-44d202bf-8a62-4835-8ef0-7c660b9b186b tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:11.403145 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-44d202bf-8a62-4835-8ef0-7c660b9b186b tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b392ad1fe1fd4b2a9e6be03a7435deb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594624ed28aa433d907c8833d360b82e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:55:11.415493 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-44d202bf-8a62-4835-8ef0-7c660b9b186b tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] 10.222.0.18 "GET /compute/v2.1/servers/a64fa89e-32f6-4994-a0b2-3788cf1c92ec" status: 200 len: 1282 microversion: 2.1 time: 0.137337 Oct 22 20:55:11.416917 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 729/1529] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:55:11 2022] GET /compute/v2.1/servers/a64fa89e-32f6-4994-a0b2-3788cf1c92ec => generated 1282 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:55:11.422939 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-9e21b200-8a87-49e2-8e45-9d6cb99e87c1 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:55:11.423917 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-9e21b200-8a87-49e2-8e45-9d6cb99e87c1 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] [instance: 0e92c2df-261e-44fd-b584-2f870190e8ce] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:55:11.431382 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9e21b200-8a87-49e2-8e45-9d6cb99e87c1 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:11.433149 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9e21b200-8a87-49e2-8e45-9d6cb99e87c1 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:11.433149 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9e21b200-8a87-49e2-8e45-9d6cb99e87c1 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:11.433950 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9e21b200-8a87-49e2-8e45-9d6cb99e87c1 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:11.434650 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9e21b200-8a87-49e2-8e45-9d6cb99e87c1 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:11.435402 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9e21b200-8a87-49e2-8e45-9d6cb99e87c1 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:11.449152 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-b899d715-d165-43b0-8961-d53d2af5eb9c tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c87f0356ca346f39c6216393d85da2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee8c8f7fc4e12bc1f9fcce3e7b581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:55:11.468568 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-b899d715-d165-43b0-8961-d53d2af5eb9c tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] 10.222.0.18 "GET /compute/v2.1/servers/fbb34507-cef9-4d78-9ed7-5d6eab4ca806" status: 200 len: 1199 microversion: 2.1 time: 0.251515 Oct 22 20:55:11.470100 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 801/1530] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:55:11 2022] GET /compute/v2.1/servers/fbb34507-cef9-4d78-9ed7-5d6eab4ca806 => generated 1199 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:55:11.475867 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-5ba69147-f5a3-4750-a269-ca068c6c686e tempest-SecurityGroupsNegativeTestJSON-565994106 tempest-SecurityGroupsNegativeTestJSON-565994106-project] Action: 'update', calling method: .version_select at 0x7fd39fe4e670>, body: {"security_group": {"name": "tempest-sg-939615259", "description": "tempest-description-471078189"}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:55:11.504702 ncdv-master-1 devstack@n-api.service[138745]: DEBUG neutronclient.v2_0.client [None req-5ba69147-f5a3-4750-a269-ca068c6c686e tempest-SecurityGroupsNegativeTestJSON-565994106 tempest-SecurityGroupsNegativeTestJSON-565994106-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group e37b54a3-8e7b-4576-befb-324e0b57011f does not exist", "detail": ""}} {{(pid=138745) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 22 20:55:11.505932 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.network.security_group_api [None req-5ba69147-f5a3-4750-a269-ca068c6c686e tempest-SecurityGroupsNegativeTestJSON-565994106 tempest-SecurityGroupsNegativeTestJSON-565994106-project] Neutron security group e37b54a3-8e7b-4576-befb-324e0b57011f not found {{(pid=138745) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 22 20:55:11.506650 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.wsgi [None req-5ba69147-f5a3-4750-a269-ca068c6c686e tempest-SecurityGroupsNegativeTestJSON-565994106 tempest-SecurityGroupsNegativeTestJSON-565994106-project] HTTP exception thrown: Security group e37b54a3-8e7b-4576-befb-324e0b57011f does not exist Oct 22 20:55:11.506650 ncdv-master-1 devstack@n-api.service[138745]: Neutron server returns request_ids: ['req-980ee6d6-1048-48bb-8554-ee077cc51f3f'] Oct 22 20:55:11.509044 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-5ba69147-f5a3-4750-a269-ca068c6c686e tempest-SecurityGroupsNegativeTestJSON-565994106 tempest-SecurityGroupsNegativeTestJSON-565994106-project] Request method failure captured: Oct 22 20:55:11.509044 ncdv-master-1 devstack@n-api.service[138745]: request: PUT /compute/v2.1/os-security-groups/e37b54a3-8e7b-4576-befb-324e0b57011f HTTP/1.1 Oct 22 20:55:11.509044 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 20:55:11.509044 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 20:55:11.509044 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 20:55:11.509044 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 100 Oct 22 20:55:11.509044 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 20:55:11.509044 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 20:55:11.509044 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 20:55:11.509044 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 20:55:11.509044 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVFimXF3Ln5E_gYMZHk-3t3SO-eu7sVKWtZrnZ2RGyEl4c7jdw-E6E7cUUjqe8-4ht5f7o0Bi7sEtrsPepffOE8mmp9JsTBJ3GHuKi_SEVnI5ByGy0qVtbTROxo2Qa4XkB9BrRkUAM3SpVJGWrkrmo969bVSqw0_y0Vf-F8TReCbjSpA Oct 22 20:55:11.509044 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 20:55:11.509044 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 20:55:11.509044 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 20:55:11.509044 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 20:55:11.509044 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 20:55:11.509044 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 20:55:11.509044 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: a675afb1c0124470804c1d2eb0620a60 Oct 22 20:55:11.509044 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-565994106 Oct 22 20:55:11.509044 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 20:55:11.509044 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 20:55:11.509044 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_a675afb1c0124470804c1d2eb0620a60"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a675afb1c0124470804c1d2eb0620a60"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/a675afb1c0124470804c1d2eb0620a60"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a675afb1c0124470804c1d2eb0620a60"}]}] Oct 22 20:55:11.509044 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-565994106 Oct 22 20:55:11.509044 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: a675afb1c0124470804c1d2eb0620a60 Oct 22 20:55:11.509044 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-565994106 Oct 22 20:55:11.509044 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-SecurityGroupsNegativeTestJSON-565994106-project Oct 22 20:55:11.509044 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 20:55:11.509044 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 20:55:11.509044 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: 8dd36113b6fa4cbab58edb75b08d17e1 Oct 22 20:55:11.509044 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-565994106-project Oct 22 20:55:11.509044 ncdv-master-1 devstack@n-api.service[138745]: Oct 22 20:55:11.509044 ncdv-master-1 devstack@n-api.service[138745]: {"security_group": {"name": "tempest-sg-939615259", "description": "tempest-description-471078189"}} Oct 22 20:55:11.509044 ncdv-master-1 devstack@n-api.service[138745]: method: Oct 22 20:55:11.509044 ncdv-master-1 devstack@n-api.service[138745]: exception: Security group e37b54a3-8e7b-4576-befb-324e0b57011f does not exist Oct 22 20:55:11.509044 ncdv-master-1 devstack@n-api.service[138745]: Neutron server returns request_ids: ['req-980ee6d6-1048-48bb-8554-ee077cc51f3f'] Oct 22 20:55:11.509044 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'id': 'e37b54a3-8e7b-4576-befb-324e0b57011f', 'body': {'security_group': {'name': 'tempest-sg-939615259', 'description': 'tempest-description-471078189'}}} Oct 22 20:55:11.509044 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:55:11.509044 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:55:11.509044 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 22 20:55:11.509044 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 22 20:55:11.509044 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 20:55:11.509044 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 20:55:11.509044 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 22 20:55:11.509044 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 22 20:55:11.509044 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 20:55:11.509044 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 20:55:11.509044 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 22 20:55:11.509044 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 22 20:55:11.509044 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 20:55:11.509044 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 20:55:11.509044 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 22 20:55:11.509044 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 22 20:55:11.509044 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 20:55:11.509044 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 20:55:11.509044 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 22 20:55:11.509044 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 22 20:55:11.509044 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 20:55:11.509044 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 20:55:11.509044 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 22 20:55:11.509044 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 22 20:55:11.509044 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 22 20:55:11.514229 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 22 20:55:11.514229 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group e37b54a3-8e7b-4576-befb-324e0b57011f does not exist Oct 22 20:55:11.514229 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-980ee6d6-1048-48bb-8554-ee077cc51f3f'] Oct 22 20:55:11.514229 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:55:11.514229 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:55:11.514229 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:55:11.514229 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:55:11.514229 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 246, in update Oct 22 20:55:11.514229 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 22 20:55:11.514229 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 22 20:55:11.514229 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 22 20:55:11.514229 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group e37b54a3-8e7b-4576-befb-324e0b57011f does not exist Oct 22 20:55:11.514229 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-980ee6d6-1048-48bb-8554-ee077cc51f3f'] Oct 22 20:55:11.514229 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:55:11.514229 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:55:11.514229 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:55:11.514229 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:55:11.514229 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:55:11.514229 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:55:11.514229 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:55:11.514229 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:55:11.514229 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 22 20:55:11.514229 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 22 20:55:11.514229 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:55:11.514229 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:55:11.514229 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 248, in update Oct 22 20:55:11.514229 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 22 20:55:11.514229 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group e37b54a3-8e7b-4576-befb-324e0b57011f does not exist Oct 22 20:55:11.514229 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-980ee6d6-1048-48bb-8554-ee077cc51f3f'] Oct 22 20:55:11.514229 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:55:11.514229 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:55:11.514229 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:55:11.514229 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:55:11.514229 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:55:11.514229 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:55:11.514229 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 20:55:11.514229 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 20:55:11.514229 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group e37b54a3-8e7b-4576-befb-324e0b57011f does not exist Oct 22 20:55:11.514229 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-980ee6d6-1048-48bb-8554-ee077cc51f3f'] Oct 22 20:55:11.514229 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:55:11.520813 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-5ba69147-f5a3-4750-a269-ca068c6c686e tempest-SecurityGroupsNegativeTestJSON-565994106 tempest-SecurityGroupsNegativeTestJSON-565994106-project] Returning 404 to user: Security group e37b54a3-8e7b-4576-befb-324e0b57011f does not exist Oct 22 20:55:11.520813 ncdv-master-1 devstack@n-api.service[138745]: Neutron server returns request_ids: ['req-980ee6d6-1048-48bb-8554-ee077cc51f3f'] {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:55:11.521429 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-5ba69147-f5a3-4750-a269-ca068c6c686e tempest-SecurityGroupsNegativeTestJSON-565994106 tempest-SecurityGroupsNegativeTestJSON-565994106-project] 10.222.0.18 "PUT /compute/v2.1/os-security-groups/e37b54a3-8e7b-4576-befb-324e0b57011f" status: 404 len: 194 microversion: 2.1 time: 0.049768 Oct 22 20:55:11.522198 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 802/1531] 10.222.0.18 () {60 vars in 1290 bytes} [Sat Oct 22 20:55:11 2022] PUT /compute/v2.1/os-security-groups/e37b54a3-8e7b-4576-befb-324e0b57011f => generated 194 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 20:55:11.528241 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-01a70745-a530-4dff-9bd5-079caa71938f tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:55:11.533579 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-01a70745-a530-4dff-9bd5-079caa71938f tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] [instance: 04d927bb-da77-4ca1-a828-562a01f07892] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:55:11.548476 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-01a70745-a530-4dff-9bd5-079caa71938f tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:11.549063 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-01a70745-a530-4dff-9bd5-079caa71938f tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:11.549504 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-01a70745-a530-4dff-9bd5-079caa71938f tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:11.550737 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-01a70745-a530-4dff-9bd5-079caa71938f tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:11.551190 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-01a70745-a530-4dff-9bd5-079caa71938f tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:11.551712 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-01a70745-a530-4dff-9bd5-079caa71938f tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:11.577557 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:55:11.713502 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-9e21b200-8a87-49e2-8e45-9d6cb99e87c1 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7f48d18691d4473bbe0284c44f14d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bacf9909082440f8a201771b64a75fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:55:11.728394 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-9e21b200-8a87-49e2-8e45-9d6cb99e87c1 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] 10.222.0.18 "GET /compute/v2.1/servers/0e92c2df-261e-44fd-b584-2f870190e8ce" status: 200 len: 1674 microversion: 2.1 time: 0.309968 Oct 22 20:55:11.729545 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 730/1532] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:55:11 2022] GET /compute/v2.1/servers/0e92c2df-261e-44fd-b584-2f870190e8ce => generated 1674 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:55:11.735002 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-8a12dfaa-6f0b-4c82-a7db-a8461afecd29 req-18db81ee-0397-49bf-b68d-c00b2c2b442b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2cedf74-885c-404c-b12f-9b7f7d15734c", "name": "network-vif-plugged", "status": "completed", "tag": "ef76c4a9-664c-45a4-9ef1-72702dee483a"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:55:11.747666 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-8a12dfaa-6f0b-4c82-a7db-a8461afecd29 req-18db81ee-0397-49bf-b68d-c00b2c2b442b service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:11.748397 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-8a12dfaa-6f0b-4c82-a7db-a8461afecd29 req-18db81ee-0397-49bf-b68d-c00b2c2b442b service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:11.749003 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-8a12dfaa-6f0b-4c82-a7db-a8461afecd29 req-18db81ee-0397-49bf-b68d-c00b2c2b442b service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:11.757192 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-01a70745-a530-4dff-9bd5-079caa71938f tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b638db630404ebbbcc2253db30844c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cc7342bf7941d2ad7ebc70032dd52e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:55:11.762472 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-8a12dfaa-6f0b-4c82-a7db-a8461afecd29 req-18db81ee-0397-49bf-b68d-c00b2c2b442b service nova] Creating event network-vif-plugged:ef76c4a9-664c-45a4-9ef1-72702dee483a for instance c2cedf74-885c-404c-b12f-9b7f7d15734c on nch2-master-1 Oct 22 20:55:11.767947 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-01a70745-a530-4dff-9bd5-079caa71938f tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] 10.222.0.18 "GET /compute/v2.1/servers/04d927bb-da77-4ca1-a828-562a01f07892" status: 200 len: 1319 microversion: 2.1 time: 0.243722 Oct 22 20:55:11.769030 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 803/1533] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:55:11 2022] GET /compute/v2.1/servers/04d927bb-da77-4ca1-a828-562a01f07892 => generated 1319 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:55:11.769716 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-8a12dfaa-6f0b-4c82-a7db-a8461afecd29 req-18db81ee-0397-49bf-b68d-c00b2c2b442b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038397 Oct 22 20:55:11.770795 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 731/1534] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:55:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:55:11.834804 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-2f97d678-6c1d-419e-b1c6-ee0792cb1478 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:55:11.836064 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-2f97d678-6c1d-419e-b1c6-ee0792cb1478 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] [instance: f499ce97-cdf8-4dcf-9c28-3758aea5e78c] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:55:11.843199 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2f97d678-6c1d-419e-b1c6-ee0792cb1478 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:11.843879 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2f97d678-6c1d-419e-b1c6-ee0792cb1478 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:11.844796 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2f97d678-6c1d-419e-b1c6-ee0792cb1478 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:11.846009 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2f97d678-6c1d-419e-b1c6-ee0792cb1478 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:11.846830 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2f97d678-6c1d-419e-b1c6-ee0792cb1478 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:11.847847 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2f97d678-6c1d-419e-b1c6-ee0792cb1478 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:11.997516 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-2f97d678-6c1d-419e-b1c6-ee0792cb1478 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:55:12.004571 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-83043f36-3c65-45eb-9f86-7e88cbd134a9 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:55:12.005388 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-83043f36-3c65-45eb-9f86-7e88cbd134a9 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] [instance: 40e6c6e3-3d47-4781-b8a8-aafd671d7287] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:55:12.006897 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-2f97d678-6c1d-419e-b1c6-ee0792cb1478 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:55:12.008592 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-2f97d678-6c1d-419e-b1c6-ee0792cb1478 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:55:12.010409 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-2f97d678-6c1d-419e-b1c6-ee0792cb1478 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] 10.222.0.18 "GET /compute/v2.1/servers/f499ce97-cdf8-4dcf-9c28-3758aea5e78c" status: 200 len: 1482 microversion: 2.25 time: 0.179972 Oct 22 20:55:12.011490 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 804/1535] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 20:55:11 2022] GET /compute/v2.1/servers/f499ce97-cdf8-4dcf-9c28-3758aea5e78c => generated 1482 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 20:55:12.012717 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-83043f36-3c65-45eb-9f86-7e88cbd134a9 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:12.013210 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-83043f36-3c65-45eb-9f86-7e88cbd134a9 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:12.013856 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-83043f36-3c65-45eb-9f86-7e88cbd134a9 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:12.014574 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-83043f36-3c65-45eb-9f86-7e88cbd134a9 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:12.015063 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-83043f36-3c65-45eb-9f86-7e88cbd134a9 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:12.015649 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-83043f36-3c65-45eb-9f86-7e88cbd134a9 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:12.150612 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-83043f36-3c65-45eb-9f86-7e88cbd134a9 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d3d7458af447bdb3f03e83a2d8559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49238b8686d24ae698679e4a1957735d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:55:12.160002 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-83043f36-3c65-45eb-9f86-7e88cbd134a9 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] 10.222.0.18 "GET /compute/v2.1/servers/40e6c6e3-3d47-4781-b8a8-aafd671d7287" status: 200 len: 1474 microversion: 2.1 time: 0.159834 Oct 22 20:55:12.160587 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 732/1536] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:55:11 2022] GET /compute/v2.1/servers/40e6c6e3-3d47-4781-b8a8-aafd671d7287 => generated 1474 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:55:12.299881 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-58d1f525-c3f6-4c68-98a7-59cf73cfb430 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:55:12.300249 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-58d1f525-c3f6-4c68-98a7-59cf73cfb430 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] [instance: 532d6e6a-71ab-4ef0-a5bf-c042055c5121] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:55:12.312021 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-58d1f525-c3f6-4c68-98a7-59cf73cfb430 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:12.312665 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-58d1f525-c3f6-4c68-98a7-59cf73cfb430 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:12.313203 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-58d1f525-c3f6-4c68-98a7-59cf73cfb430 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:12.314028 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-58d1f525-c3f6-4c68-98a7-59cf73cfb430 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:12.316750 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-58d1f525-c3f6-4c68-98a7-59cf73cfb430 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:12.317305 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-58d1f525-c3f6-4c68-98a7-59cf73cfb430 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:12.443436 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-de29cbb2-26c0-4dca-82d8-c3f0557ee55b tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:55:12.444389 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-de29cbb2-26c0-4dca-82d8-c3f0557ee55b tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] [instance: a64fa89e-32f6-4994-a0b2-3788cf1c92ec] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:55:12.450800 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-de29cbb2-26c0-4dca-82d8-c3f0557ee55b tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:12.451644 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-de29cbb2-26c0-4dca-82d8-c3f0557ee55b tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:12.452276 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-de29cbb2-26c0-4dca-82d8-c3f0557ee55b tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:12.453185 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-de29cbb2-26c0-4dca-82d8-c3f0557ee55b tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:12.453917 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-de29cbb2-26c0-4dca-82d8-c3f0557ee55b tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:12.454516 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-de29cbb2-26c0-4dca-82d8-c3f0557ee55b tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:12.585512 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-de29cbb2-26c0-4dca-82d8-c3f0557ee55b tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b392ad1fe1fd4b2a9e6be03a7435deb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594624ed28aa433d907c8833d360b82e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:55:12.608494 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-de29cbb2-26c0-4dca-82d8-c3f0557ee55b tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] 10.222.0.18 "GET /compute/v2.1/servers/a64fa89e-32f6-4994-a0b2-3788cf1c92ec" status: 200 len: 1282 microversion: 2.1 time: 0.169497 Oct 22 20:55:12.609935 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 733/1537] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:55:12 2022] GET /compute/v2.1/servers/a64fa89e-32f6-4994-a0b2-3788cf1c92ec => generated 1282 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 20:55:12.624178 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-57cb0185-02a0-4d42-bac5-ec1bb98fdfbc tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:55:12.625177 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-57cb0185-02a0-4d42-bac5-ec1bb98fdfbc tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] [instance: fbb34507-cef9-4d78-9ed7-5d6eab4ca806] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:55:12.633801 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-57cb0185-02a0-4d42-bac5-ec1bb98fdfbc tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:12.634299 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-57cb0185-02a0-4d42-bac5-ec1bb98fdfbc tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:12.634748 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-57cb0185-02a0-4d42-bac5-ec1bb98fdfbc tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:12.636160 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-57cb0185-02a0-4d42-bac5-ec1bb98fdfbc tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:12.636828 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-57cb0185-02a0-4d42-bac5-ec1bb98fdfbc tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:12.637460 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-57cb0185-02a0-4d42-bac5-ec1bb98fdfbc tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:12.723737 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-58d1f525-c3f6-4c68-98a7-59cf73cfb430 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be93cabff0d46ccb2a3db0db1a13796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42111ed6bcc3465d8c1f5291da248e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:55:12.736388 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-58d1f525-c3f6-4c68-98a7-59cf73cfb430 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] 10.222.0.18 "GET /compute/v2.1/servers/532d6e6a-71ab-4ef0-a5bf-c042055c5121" status: 200 len: 1324 microversion: 2.1 time: 0.440548 Oct 22 20:55:12.737012 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 805/1538] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:55:12 2022] GET /compute/v2.1/servers/532d6e6a-71ab-4ef0-a5bf-c042055c5121 => generated 1324 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:55:12.742934 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-3df20c80-2030-4dfd-8669-9628eee375bd req-2519ce7d-8ac3-4cff-a3d0-5e94ceb04636 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "532d6e6a-71ab-4ef0-a5bf-c042055c5121", "tag": "7c68227f-68b8-459e-8cf6-9b169351d597"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:55:12.755473 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-3df20c80-2030-4dfd-8669-9628eee375bd req-2519ce7d-8ac3-4cff-a3d0-5e94ceb04636 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:12.755947 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-3df20c80-2030-4dfd-8669-9628eee375bd req-2519ce7d-8ac3-4cff-a3d0-5e94ceb04636 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:12.756569 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-3df20c80-2030-4dfd-8669-9628eee375bd req-2519ce7d-8ac3-4cff-a3d0-5e94ceb04636 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:12.768585 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-3df20c80-2030-4dfd-8669-9628eee375bd req-2519ce7d-8ac3-4cff-a3d0-5e94ceb04636 service nova] Creating event network-changed:7c68227f-68b8-459e-8cf6-9b169351d597 for instance 532d6e6a-71ab-4ef0-a5bf-c042055c5121 on nch1-master-1 Oct 22 20:55:12.774262 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-3df20c80-2030-4dfd-8669-9628eee375bd req-2519ce7d-8ac3-4cff-a3d0-5e94ceb04636 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034844 Oct 22 20:55:12.775146 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 806/1539] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:55:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:55:12.781175 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-57dafd62-84d2-4397-a9d3-5627914c460b tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:55:12.781860 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-57dafd62-84d2-4397-a9d3-5627914c460b tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] [instance: 0e92c2df-261e-44fd-b584-2f870190e8ce] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:55:12.789100 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-57dafd62-84d2-4397-a9d3-5627914c460b tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:12.789815 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-57dafd62-84d2-4397-a9d3-5627914c460b tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:12.790423 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-57dafd62-84d2-4397-a9d3-5627914c460b tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:12.791305 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-57dafd62-84d2-4397-a9d3-5627914c460b tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:12.791931 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-57dafd62-84d2-4397-a9d3-5627914c460b tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:12.792893 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-57dafd62-84d2-4397-a9d3-5627914c460b tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:12.910834 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-57cb0185-02a0-4d42-bac5-ec1bb98fdfbc tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c87f0356ca346f39c6216393d85da2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee8c8f7fc4e12bc1f9fcce3e7b581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:55:12.922319 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-57cb0185-02a0-4d42-bac5-ec1bb98fdfbc tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] 10.222.0.18 "GET /compute/v2.1/servers/fbb34507-cef9-4d78-9ed7-5d6eab4ca806" status: 200 len: 1199 microversion: 2.1 time: 0.310872 Oct 22 20:55:12.928335 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 734/1540] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:55:12 2022] GET /compute/v2.1/servers/fbb34507-cef9-4d78-9ed7-5d6eab4ca806 => generated 1199 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:55:12.934880 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-ce921fa0-d240-47c7-9be4-986526f536ad tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:55:12.935890 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-ce921fa0-d240-47c7-9be4-986526f536ad tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] [instance: 04d927bb-da77-4ca1-a828-562a01f07892] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:55:12.948274 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ce921fa0-d240-47c7-9be4-986526f536ad tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:12.950829 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ce921fa0-d240-47c7-9be4-986526f536ad tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:12.952141 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ce921fa0-d240-47c7-9be4-986526f536ad tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:12.953510 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ce921fa0-d240-47c7-9be4-986526f536ad tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:12.954370 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ce921fa0-d240-47c7-9be4-986526f536ad tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:12.954949 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ce921fa0-d240-47c7-9be4-986526f536ad tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:13.178058 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-57dafd62-84d2-4397-a9d3-5627914c460b tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7f48d18691d4473bbe0284c44f14d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bacf9909082440f8a201771b64a75fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:55:13.189421 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-57dafd62-84d2-4397-a9d3-5627914c460b tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] 10.222.0.18 "GET /compute/v2.1/servers/0e92c2df-261e-44fd-b584-2f870190e8ce" status: 200 len: 1674 microversion: 2.1 time: 0.412912 Oct 22 20:55:13.192340 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 807/1541] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:55:12 2022] GET /compute/v2.1/servers/0e92c2df-261e-44fd-b584-2f870190e8ce => generated 1674 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:55:13.205506 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-b4d71b9b-b688-4ea0-8ef6-b8875e7e6575 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:55:13.206142 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-b4d71b9b-b688-4ea0-8ef6-b8875e7e6575 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] [instance: f499ce97-cdf8-4dcf-9c28-3758aea5e78c] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:55:13.214830 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b4d71b9b-b688-4ea0-8ef6-b8875e7e6575 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:13.215327 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b4d71b9b-b688-4ea0-8ef6-b8875e7e6575 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:13.215816 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b4d71b9b-b688-4ea0-8ef6-b8875e7e6575 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:13.216577 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b4d71b9b-b688-4ea0-8ef6-b8875e7e6575 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:13.217191 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b4d71b9b-b688-4ea0-8ef6-b8875e7e6575 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:13.217632 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b4d71b9b-b688-4ea0-8ef6-b8875e7e6575 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:13.265031 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-ce921fa0-d240-47c7-9be4-986526f536ad tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b638db630404ebbbcc2253db30844c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cc7342bf7941d2ad7ebc70032dd52e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:55:13.276208 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-ce921fa0-d240-47c7-9be4-986526f536ad tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] 10.222.0.18 "GET /compute/v2.1/servers/04d927bb-da77-4ca1-a828-562a01f07892" status: 200 len: 1319 microversion: 2.1 time: 0.346214 Oct 22 20:55:13.277055 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 735/1542] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:55:12 2022] GET /compute/v2.1/servers/04d927bb-da77-4ca1-a828-562a01f07892 => generated 1319 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:55:13.283669 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-42d33ed1-b643-4e87-a2e3-b80118c53bff tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:55:13.284509 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-42d33ed1-b643-4e87-a2e3-b80118c53bff tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] [instance: 40e6c6e3-3d47-4781-b8a8-aafd671d7287] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:55:13.292686 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-42d33ed1-b643-4e87-a2e3-b80118c53bff tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:13.293360 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-42d33ed1-b643-4e87-a2e3-b80118c53bff tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:13.294147 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-42d33ed1-b643-4e87-a2e3-b80118c53bff tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:13.295016 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-42d33ed1-b643-4e87-a2e3-b80118c53bff tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:13.295763 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-42d33ed1-b643-4e87-a2e3-b80118c53bff tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:13.296340 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-42d33ed1-b643-4e87-a2e3-b80118c53bff tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:13.318632 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-b4d71b9b-b688-4ea0-8ef6-b8875e7e6575 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:55:13.328211 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-b4d71b9b-b688-4ea0-8ef6-b8875e7e6575 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:55:13.329798 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-b4d71b9b-b688-4ea0-8ef6-b8875e7e6575 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:55:13.331137 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-b4d71b9b-b688-4ea0-8ef6-b8875e7e6575 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] 10.222.0.18 "GET /compute/v2.1/servers/f499ce97-cdf8-4dcf-9c28-3758aea5e78c" status: 200 len: 1264 microversion: 2.25 time: 0.137518 Oct 22 20:55:13.332141 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 808/1543] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 20:55:13 2022] GET /compute/v2.1/servers/f499ce97-cdf8-4dcf-9c28-3758aea5e78c => generated 1264 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 20:55:13.524898 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-42d33ed1-b643-4e87-a2e3-b80118c53bff tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d3d7458af447bdb3f03e83a2d8559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49238b8686d24ae698679e4a1957735d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:55:13.536758 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-42d33ed1-b643-4e87-a2e3-b80118c53bff tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] 10.222.0.18 "GET /compute/v2.1/servers/40e6c6e3-3d47-4781-b8a8-aafd671d7287" status: 200 len: 1474 microversion: 2.1 time: 0.258276 Oct 22 20:55:13.550373 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 736/1544] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:55:13 2022] GET /compute/v2.1/servers/40e6c6e3-3d47-4781-b8a8-aafd671d7287 => generated 1474 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:55:13.634930 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-73156a61-fa88-43cb-8406-b4c92500487a tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:55:13.635980 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-73156a61-fa88-43cb-8406-b4c92500487a tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] [instance: a64fa89e-32f6-4994-a0b2-3788cf1c92ec] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:55:13.649954 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-73156a61-fa88-43cb-8406-b4c92500487a tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:13.653041 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-73156a61-fa88-43cb-8406-b4c92500487a tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:13.655371 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-73156a61-fa88-43cb-8406-b4c92500487a tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:13.656358 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-73156a61-fa88-43cb-8406-b4c92500487a tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:13.659127 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-73156a61-fa88-43cb-8406-b4c92500487a tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:13.662305 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-73156a61-fa88-43cb-8406-b4c92500487a tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:13.766194 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-2002d08d-4c7b-4a92-9fff-7f88c9fe0ba8 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:55:13.769861 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-2002d08d-4c7b-4a92-9fff-7f88c9fe0ba8 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] [instance: 532d6e6a-71ab-4ef0-a5bf-c042055c5121] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:55:13.790140 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2002d08d-4c7b-4a92-9fff-7f88c9fe0ba8 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:13.791136 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2002d08d-4c7b-4a92-9fff-7f88c9fe0ba8 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:13.792116 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2002d08d-4c7b-4a92-9fff-7f88c9fe0ba8 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:13.793123 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2002d08d-4c7b-4a92-9fff-7f88c9fe0ba8 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:13.793799 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2002d08d-4c7b-4a92-9fff-7f88c9fe0ba8 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:13.794589 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2002d08d-4c7b-4a92-9fff-7f88c9fe0ba8 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:14.100480 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-73156a61-fa88-43cb-8406-b4c92500487a tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b392ad1fe1fd4b2a9e6be03a7435deb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594624ed28aa433d907c8833d360b82e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:55:14.111185 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-73156a61-fa88-43cb-8406-b4c92500487a tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] 10.222.0.18 "GET /compute/v2.1/servers/a64fa89e-32f6-4994-a0b2-3788cf1c92ec" status: 200 len: 1324 microversion: 2.1 time: 0.481200 Oct 22 20:55:14.113274 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 809/1545] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:55:13 2022] GET /compute/v2.1/servers/a64fa89e-32f6-4994-a0b2-3788cf1c92ec => generated 1324 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:55:14.131053 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-321f9c71-4ef1-40ed-bbc4-8ef0457d2925 req-41c00063-2fe5-4fae-aa47-65a912f1ce00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fbb34507-cef9-4d78-9ed7-5d6eab4ca806", "name": "network-vif-plugged", "status": "completed", "tag": "21ed77e4-8dab-449b-afdb-01e27ef6b85c"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:55:14.143803 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-321f9c71-4ef1-40ed-bbc4-8ef0457d2925 req-41c00063-2fe5-4fae-aa47-65a912f1ce00 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:14.144706 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-321f9c71-4ef1-40ed-bbc4-8ef0457d2925 req-41c00063-2fe5-4fae-aa47-65a912f1ce00 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:14.145379 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-321f9c71-4ef1-40ed-bbc4-8ef0457d2925 req-41c00063-2fe5-4fae-aa47-65a912f1ce00 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:14.152512 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-2002d08d-4c7b-4a92-9fff-7f88c9fe0ba8 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be93cabff0d46ccb2a3db0db1a13796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42111ed6bcc3465d8c1f5291da248e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:55:14.163716 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-2002d08d-4c7b-4a92-9fff-7f88c9fe0ba8 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] 10.222.0.18 "GET /compute/v2.1/servers/532d6e6a-71ab-4ef0-a5bf-c042055c5121" status: 200 len: 1324 microversion: 2.1 time: 0.403787 Oct 22 20:55:14.165020 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 737/1546] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:55:13 2022] GET /compute/v2.1/servers/532d6e6a-71ab-4ef0-a5bf-c042055c5121 => generated 1324 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:55:14.165393 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-321f9c71-4ef1-40ed-bbc4-8ef0457d2925 req-41c00063-2fe5-4fae-aa47-65a912f1ce00 service nova] Creating event network-vif-plugged:21ed77e4-8dab-449b-afdb-01e27ef6b85c for instance fbb34507-cef9-4d78-9ed7-5d6eab4ca806 on nch1-master-1 Oct 22 20:55:14.171023 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-09c623ce-13d6-4718-b732-17bf3bcfee2c tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:55:14.172839 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-09c623ce-13d6-4718-b732-17bf3bcfee2c tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] [instance: fbb34507-cef9-4d78-9ed7-5d6eab4ca806] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:55:14.174414 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-321f9c71-4ef1-40ed-bbc4-8ef0457d2925 req-41c00063-2fe5-4fae-aa47-65a912f1ce00 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059131 Oct 22 20:55:14.175678 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 810/1547] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:55:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:55:14.180773 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-09c623ce-13d6-4718-b732-17bf3bcfee2c tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:14.181755 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-09c623ce-13d6-4718-b732-17bf3bcfee2c tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:14.182352 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-09c623ce-13d6-4718-b732-17bf3bcfee2c tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:14.182948 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-09c623ce-13d6-4718-b732-17bf3bcfee2c tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:14.185011 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-09c623ce-13d6-4718-b732-17bf3bcfee2c tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:14.185584 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-09c623ce-13d6-4718-b732-17bf3bcfee2c tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:14.217268 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-3f0ee6ac-9010-4277-a1b0-56c56d1a0f7e tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:55:14.218657 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-3f0ee6ac-9010-4277-a1b0-56c56d1a0f7e tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] [instance: 0e92c2df-261e-44fd-b584-2f870190e8ce] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:55:14.226639 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3f0ee6ac-9010-4277-a1b0-56c56d1a0f7e tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:14.227489 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3f0ee6ac-9010-4277-a1b0-56c56d1a0f7e tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:14.227858 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3f0ee6ac-9010-4277-a1b0-56c56d1a0f7e tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:14.228559 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3f0ee6ac-9010-4277-a1b0-56c56d1a0f7e tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:14.229030 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3f0ee6ac-9010-4277-a1b0-56c56d1a0f7e tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:14.229461 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3f0ee6ac-9010-4277-a1b0-56c56d1a0f7e tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:14.417355 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-09c623ce-13d6-4718-b732-17bf3bcfee2c tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c87f0356ca346f39c6216393d85da2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee8c8f7fc4e12bc1f9fcce3e7b581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:55:14.428864 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-09c623ce-13d6-4718-b732-17bf3bcfee2c tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] 10.222.0.18 "GET /compute/v2.1/servers/fbb34507-cef9-4d78-9ed7-5d6eab4ca806" status: 200 len: 1199 microversion: 2.1 time: 0.260970 Oct 22 20:55:14.438737 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 738/1548] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:55:14 2022] GET /compute/v2.1/servers/fbb34507-cef9-4d78-9ed7-5d6eab4ca806 => generated 1199 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:55:14.438737 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-870d69c2-58df-482e-bf2b-5171e9c57673 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:55:14.438737 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-870d69c2-58df-482e-bf2b-5171e9c57673 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] [instance: 04d927bb-da77-4ca1-a828-562a01f07892] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:55:14.448036 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-870d69c2-58df-482e-bf2b-5171e9c57673 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:14.448687 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-870d69c2-58df-482e-bf2b-5171e9c57673 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:14.449156 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-870d69c2-58df-482e-bf2b-5171e9c57673 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:14.450046 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-870d69c2-58df-482e-bf2b-5171e9c57673 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:14.451942 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-870d69c2-58df-482e-bf2b-5171e9c57673 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:14.452053 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-870d69c2-58df-482e-bf2b-5171e9c57673 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:14.456728 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-3f0ee6ac-9010-4277-a1b0-56c56d1a0f7e tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7f48d18691d4473bbe0284c44f14d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bacf9909082440f8a201771b64a75fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:55:14.466779 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-3f0ee6ac-9010-4277-a1b0-56c56d1a0f7e tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] 10.222.0.18 "GET /compute/v2.1/servers/0e92c2df-261e-44fd-b584-2f870190e8ce" status: 200 len: 1674 microversion: 2.1 time: 0.255646 Oct 22 20:55:14.476741 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 811/1549] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:55:14 2022] GET /compute/v2.1/servers/0e92c2df-261e-44fd-b584-2f870190e8ce => generated 1674 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:55:14.484189 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-fc885c5d-147a-4ef0-ba5a-a1bab63397b3 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:55:14.484800 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-fc885c5d-147a-4ef0-ba5a-a1bab63397b3 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] [instance: f499ce97-cdf8-4dcf-9c28-3758aea5e78c] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:55:14.494818 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fc885c5d-147a-4ef0-ba5a-a1bab63397b3 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:14.495388 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fc885c5d-147a-4ef0-ba5a-a1bab63397b3 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:14.495881 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fc885c5d-147a-4ef0-ba5a-a1bab63397b3 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:14.509032 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fc885c5d-147a-4ef0-ba5a-a1bab63397b3 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:14.509737 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fc885c5d-147a-4ef0-ba5a-a1bab63397b3 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:14.510195 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fc885c5d-147a-4ef0-ba5a-a1bab63397b3 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:14.542893 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.wsgi [None req-fc885c5d-147a-4ef0-ba5a-a1bab63397b3 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] HTTP exception thrown: Instance f499ce97-cdf8-4dcf-9c28-3758aea5e78c could not be found. Oct 22 20:55:14.546183 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-fc885c5d-147a-4ef0-ba5a-a1bab63397b3 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Request method failure captured: Oct 22 20:55:14.546183 ncdv-master-1 devstack@n-api.service[138745]: request: GET /compute/v2.1/servers/f499ce97-cdf8-4dcf-9c28-3758aea5e78c HTTP/1.1 Oct 22 20:55:14.546183 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 20:55:14.546183 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 20:55:14.546183 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 20:55:14.546183 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 0 Oct 22 20:55:14.546183 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 20:55:14.546183 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 20:55:14.546183 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 20:55:14.546183 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 20:55:14.546183 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVFc6ze-JvRNBYUoDY8DxRahatFrOlr2DH1Jj7tx4qgH6khVz1HoW_8kE7y_rlkudvvybXKphF1vkSLvPaAzyp66bqbcfISFjN01CiLISj28Sbh99A72aXrDBEAGyFUniWRH7nPnKw64FY4yGK7_HqZN5InCILmg2TRDUJKhlz6tDI4s Oct 22 20:55:14.546183 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 20:55:14.546183 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 20:55:14.546183 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 20:55:14.546183 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 20:55:14.546183 ncdv-master-1 devstack@n-api.service[138745]: X-Openstack-Nova-Api-Version: 2.25 Oct 22 20:55:14.546183 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 20:55:14.546183 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 20:55:14.546183 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: 11060bbcab6b45cabb1457319d72b982 Oct 22 20:55:14.546183 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1332499062 Oct 22 20:55:14.546183 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 20:55:14.546183 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 20:55:14.546183 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_11060bbcab6b45cabb1457319d72b982"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/11060bbcab6b45cabb1457319d72b982"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/11060bbcab6b45cabb1457319d72b982"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/11060bbcab6b45cabb1457319d72b982"}]}] Oct 22 20:55:14.546183 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1332499062 Oct 22 20:55:14.546183 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: 11060bbcab6b45cabb1457319d72b982 Oct 22 20:55:14.546183 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1332499062 Oct 22 20:55:14.546183 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-LiveAutoBlockMigrationV225Test-1332499062-project Oct 22 20:55:14.546183 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 20:55:14.546183 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 20:55:14.546183 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: 93c41b7be1724632b0d6bd2bd3b57f8f Oct 22 20:55:14.546183 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1332499062-project Oct 22 20:55:14.546183 ncdv-master-1 devstack@n-api.service[138745]: method: > Oct 22 20:55:14.546183 ncdv-master-1 devstack@n-api.service[138745]: exception: Instance f499ce97-cdf8-4dcf-9c28-3758aea5e78c could not be found. Oct 22 20:55:14.546183 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'id': 'f499ce97-cdf8-4dcf-9c28-3758aea5e78c'} Oct 22 20:55:14.546183 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:55:14.546183 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:55:14.546183 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 20:55:14.546183 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 20:55:14.546183 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 20:55:14.546183 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 20:55:14.546183 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 20:55:14.546183 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 20:55:14.546183 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 20:55:14.546183 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 20:55:14.546183 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f499ce97-cdf8-4dcf-9c28-3758aea5e78c could not be found. Oct 22 20:55:14.546183 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:55:14.546183 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:55:14.546183 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:55:14.546183 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:55:14.546183 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:55:14.546183 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:55:14.546183 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:55:14.546183 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:55:14.546183 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:55:14.546183 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:55:14.546183 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 20:55:14.546183 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 20:55:14.546183 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 20:55:14.546183 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 20:55:14.546183 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 20:55:14.546183 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 20:55:14.546183 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f499ce97-cdf8-4dcf-9c28-3758aea5e78c could not be found. Oct 22 20:55:14.546183 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:55:14.553098 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:55:14.553098 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:55:14.553098 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:55:14.553098 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:55:14.553098 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:55:14.553098 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 20:55:14.553098 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 20:55:14.553098 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f499ce97-cdf8-4dcf-9c28-3758aea5e78c could not be found. Oct 22 20:55:14.553098 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:55:14.561847 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-fc885c5d-147a-4ef0-ba5a-a1bab63397b3 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Returning 404 to user: Instance f499ce97-cdf8-4dcf-9c28-3758aea5e78c could not be found. {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:55:14.567111 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-fc885c5d-147a-4ef0-ba5a-a1bab63397b3 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] 10.222.0.18 "GET /compute/v2.1/servers/f499ce97-cdf8-4dcf-9c28-3758aea5e78c" status: 404 len: 111 microversion: 2.25 time: 0.087460 Oct 22 20:55:14.568312 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 812/1550] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 20:55:14 2022] GET /compute/v2.1/servers/f499ce97-cdf8-4dcf-9c28-3758aea5e78c => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 22 20:55:14.576064 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-db85c04a-047b-44b6-8fc1-89a5d96db705 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:55:14.578135 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-db85c04a-047b-44b6-8fc1-89a5d96db705 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] [instance: 40e6c6e3-3d47-4781-b8a8-aafd671d7287] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:55:14.585360 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-db85c04a-047b-44b6-8fc1-89a5d96db705 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:14.585866 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-db85c04a-047b-44b6-8fc1-89a5d96db705 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:14.586466 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-db85c04a-047b-44b6-8fc1-89a5d96db705 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:14.588929 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-db85c04a-047b-44b6-8fc1-89a5d96db705 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:14.589645 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-db85c04a-047b-44b6-8fc1-89a5d96db705 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:14.590236 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-db85c04a-047b-44b6-8fc1-89a5d96db705 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:14.959394 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-870d69c2-58df-482e-bf2b-5171e9c57673 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b638db630404ebbbcc2253db30844c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cc7342bf7941d2ad7ebc70032dd52e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:55:14.981073 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-870d69c2-58df-482e-bf2b-5171e9c57673 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] 10.222.0.18 "GET /compute/v2.1/servers/04d927bb-da77-4ca1-a828-562a01f07892" status: 200 len: 1319 microversion: 2.1 time: 0.541921 Oct 22 20:55:15.002504 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 739/1551] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:55:14 2022] GET /compute/v2.1/servers/04d927bb-da77-4ca1-a828-562a01f07892 => generated 1319 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:55:15.026800 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-82dfb3b5-a1db-4393-a75d-0d613ab46d78 req-8386a7fb-aec5-44ba-abb2-d495dc71bc3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f499ce97-cdf8-4dcf-9c28-3758aea5e78c", "name": "network-vif-deleted", "tag": "c45f11d9-428c-4566-a627-5dbe8e1e8d6d"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:55:15.054603 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-82dfb3b5-a1db-4393-a75d-0d613ab46d78 req-8386a7fb-aec5-44ba-abb2-d495dc71bc3a service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:15.055203 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-82dfb3b5-a1db-4393-a75d-0d613ab46d78 req-8386a7fb-aec5-44ba-abb2-d495dc71bc3a service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:15.055922 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-82dfb3b5-a1db-4393-a75d-0d613ab46d78 req-8386a7fb-aec5-44ba-abb2-d495dc71bc3a service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:15.122387 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-82dfb3b5-a1db-4393-a75d-0d613ab46d78 req-8386a7fb-aec5-44ba-abb2-d495dc71bc3a service nova] Creating event network-vif-deleted:c45f11d9-428c-4566-a627-5dbe8e1e8d6d for instance f499ce97-cdf8-4dcf-9c28-3758aea5e78c on nch2-master-1 Oct 22 20:55:15.137440 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-82dfb3b5-a1db-4393-a75d-0d613ab46d78 req-8386a7fb-aec5-44ba-abb2-d495dc71bc3a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125924 Oct 22 20:55:15.139283 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 740/1552] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:55:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:55:15.148643 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-db85c04a-047b-44b6-8fc1-89a5d96db705 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d3d7458af447bdb3f03e83a2d8559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49238b8686d24ae698679e4a1957735d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:55:15.150558 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-bfb0daca-29db-42ea-a361-c28d37abe52f tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:55:15.151579 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-bfb0daca-29db-42ea-a361-c28d37abe52f tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] [instance: a64fa89e-32f6-4994-a0b2-3788cf1c92ec] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:55:15.160131 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bfb0daca-29db-42ea-a361-c28d37abe52f tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:15.161915 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bfb0daca-29db-42ea-a361-c28d37abe52f tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:15.162566 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-db85c04a-047b-44b6-8fc1-89a5d96db705 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] 10.222.0.18 "GET /compute/v2.1/servers/40e6c6e3-3d47-4781-b8a8-aafd671d7287" status: 200 len: 1474 microversion: 2.1 time: 0.590954 Oct 22 20:55:15.162773 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bfb0daca-29db-42ea-a361-c28d37abe52f tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:15.163462 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 813/1553] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:55:14 2022] GET /compute/v2.1/servers/40e6c6e3-3d47-4781-b8a8-aafd671d7287 => generated 1474 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:55:15.165002 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bfb0daca-29db-42ea-a361-c28d37abe52f tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:15.165518 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bfb0daca-29db-42ea-a361-c28d37abe52f tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:15.165963 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bfb0daca-29db-42ea-a361-c28d37abe52f tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:15.195069 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-4f4bd4a1-f963-4581-809c-f07e656f6554 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:55:15.196323 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-4f4bd4a1-f963-4581-809c-f07e656f6554 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] [instance: 532d6e6a-71ab-4ef0-a5bf-c042055c5121] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:55:15.206857 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4f4bd4a1-f963-4581-809c-f07e656f6554 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:15.209471 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4f4bd4a1-f963-4581-809c-f07e656f6554 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:15.210455 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4f4bd4a1-f963-4581-809c-f07e656f6554 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:15.211492 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4f4bd4a1-f963-4581-809c-f07e656f6554 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:15.212168 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4f4bd4a1-f963-4581-809c-f07e656f6554 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:15.213922 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4f4bd4a1-f963-4581-809c-f07e656f6554 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:16.018009 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-bfb0daca-29db-42ea-a361-c28d37abe52f tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b392ad1fe1fd4b2a9e6be03a7435deb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594624ed28aa433d907c8833d360b82e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:55:16.048655 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-bfb0daca-29db-42ea-a361-c28d37abe52f tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] 10.222.0.18 "GET /compute/v2.1/servers/a64fa89e-32f6-4994-a0b2-3788cf1c92ec" status: 200 len: 1324 microversion: 2.1 time: 0.907441 Oct 22 20:55:16.052651 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 741/1554] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:55:15 2022] GET /compute/v2.1/servers/a64fa89e-32f6-4994-a0b2-3788cf1c92ec => generated 1324 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:55:16.062247 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-e705f65d-d607-46fb-8326-ea07c4b203c6 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:55:16.064418 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-e705f65d-d607-46fb-8326-ea07c4b203c6 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] [instance: fbb34507-cef9-4d78-9ed7-5d6eab4ca806] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:55:16.077850 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e705f65d-d607-46fb-8326-ea07c4b203c6 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:16.078684 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e705f65d-d607-46fb-8326-ea07c4b203c6 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:16.080482 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e705f65d-d607-46fb-8326-ea07c4b203c6 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:16.083718 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e705f65d-d607-46fb-8326-ea07c4b203c6 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:16.086242 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e705f65d-d607-46fb-8326-ea07c4b203c6 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:16.086811 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e705f65d-d607-46fb-8326-ea07c4b203c6 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:16.195025 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-4f4bd4a1-f963-4581-809c-f07e656f6554 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be93cabff0d46ccb2a3db0db1a13796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42111ed6bcc3465d8c1f5291da248e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:55:16.203858 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-4f4bd4a1-f963-4581-809c-f07e656f6554 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] 10.222.0.18 "GET /compute/v2.1/servers/532d6e6a-71ab-4ef0-a5bf-c042055c5121" status: 200 len: 1324 microversion: 2.1 time: 1.015703 Oct 22 20:55:16.205119 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 814/1555] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:55:15 2022] GET /compute/v2.1/servers/532d6e6a-71ab-4ef0-a5bf-c042055c5121 => generated 1324 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:55:16.212111 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-230b1d6b-7577-4d8f-b0b6-a3aff8821f58 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:55:16.213197 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-230b1d6b-7577-4d8f-b0b6-a3aff8821f58 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] [instance: 0e92c2df-261e-44fd-b584-2f870190e8ce] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:55:16.220376 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-230b1d6b-7577-4d8f-b0b6-a3aff8821f58 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:16.221274 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-230b1d6b-7577-4d8f-b0b6-a3aff8821f58 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:16.222168 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-230b1d6b-7577-4d8f-b0b6-a3aff8821f58 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:16.223474 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-230b1d6b-7577-4d8f-b0b6-a3aff8821f58 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:16.224154 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-230b1d6b-7577-4d8f-b0b6-a3aff8821f58 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:16.224803 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-230b1d6b-7577-4d8f-b0b6-a3aff8821f58 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:16.652960 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-230b1d6b-7577-4d8f-b0b6-a3aff8821f58 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7f48d18691d4473bbe0284c44f14d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bacf9909082440f8a201771b64a75fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:55:16.665527 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-e705f65d-d607-46fb-8326-ea07c4b203c6 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c87f0356ca346f39c6216393d85da2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee8c8f7fc4e12bc1f9fcce3e7b581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:55:16.670089 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-230b1d6b-7577-4d8f-b0b6-a3aff8821f58 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] 10.222.0.18 "GET /compute/v2.1/servers/0e92c2df-261e-44fd-b584-2f870190e8ce" status: 200 len: 1674 microversion: 2.1 time: 0.463516 Oct 22 20:55:16.683404 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 815/1556] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:55:16 2022] GET /compute/v2.1/servers/0e92c2df-261e-44fd-b584-2f870190e8ce => generated 1674 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:55:16.688844 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-697962c5-9cbe-40c0-b398-55511bfa4d48 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:55:16.689567 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-697962c5-9cbe-40c0-b398-55511bfa4d48 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] [instance: 4c7b99a9-2ec4-4f4b-98e7-8e1ea2103735] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:55:16.700823 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-697962c5-9cbe-40c0-b398-55511bfa4d48 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:16.701805 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-697962c5-9cbe-40c0-b398-55511bfa4d48 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:16.702421 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-697962c5-9cbe-40c0-b398-55511bfa4d48 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:16.703437 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-697962c5-9cbe-40c0-b398-55511bfa4d48 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:16.704055 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-697962c5-9cbe-40c0-b398-55511bfa4d48 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:16.704826 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-697962c5-9cbe-40c0-b398-55511bfa4d48 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:16.707879 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-e705f65d-d607-46fb-8326-ea07c4b203c6 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] 10.222.0.18 "GET /compute/v2.1/servers/fbb34507-cef9-4d78-9ed7-5d6eab4ca806" status: 200 len: 1199 microversion: 2.1 time: 0.651816 Oct 22 20:55:16.710676 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 742/1557] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:55:16 2022] GET /compute/v2.1/servers/fbb34507-cef9-4d78-9ed7-5d6eab4ca806 => generated 1199 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:55:16.720584 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-61f06070-9332-4435-a570-9126a7398d29 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:55:16.725263 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-61f06070-9332-4435-a570-9126a7398d29 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] [instance: 04d927bb-da77-4ca1-a828-562a01f07892] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:55:16.739481 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-61f06070-9332-4435-a570-9126a7398d29 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:16.740801 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-61f06070-9332-4435-a570-9126a7398d29 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:16.741412 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-61f06070-9332-4435-a570-9126a7398d29 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:16.742366 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-61f06070-9332-4435-a570-9126a7398d29 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:16.743007 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-61f06070-9332-4435-a570-9126a7398d29 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:16.743836 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-61f06070-9332-4435-a570-9126a7398d29 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:16.755503 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-697962c5-9cbe-40c0-b398-55511bfa4d48 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] [instance: 4c7b99a9-2ec4-4f4b-98e7-8e1ea2103735] Going to try to terminate instance {{(pid=138745) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 20:55:16.912625 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-697962c5-9cbe-40c0-b398-55511bfa4d48 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] 10.222.0.18 "DELETE /compute/v2.1/servers/4c7b99a9-2ec4-4f4b-98e7-8e1ea2103735" status: 204 len: 0 microversion: 2.25 time: 0.237788 Oct 22 20:55:16.915140 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 816/1558] 10.222.0.18 () {60 vars in 1280 bytes} [Sat Oct 22 20:55:16 2022] DELETE /compute/v2.1/servers/4c7b99a9-2ec4-4f4b-98e7-8e1ea2103735 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 22 20:55:16.924296 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-e7b7d13c-aa41-4bd3-b10c-0e3d87cf9459 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:55:16.926728 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-e7b7d13c-aa41-4bd3-b10c-0e3d87cf9459 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] [instance: 40e6c6e3-3d47-4781-b8a8-aafd671d7287] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:55:16.937109 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e7b7d13c-aa41-4bd3-b10c-0e3d87cf9459 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:16.938634 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e7b7d13c-aa41-4bd3-b10c-0e3d87cf9459 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:16.940234 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e7b7d13c-aa41-4bd3-b10c-0e3d87cf9459 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:16.941455 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e7b7d13c-aa41-4bd3-b10c-0e3d87cf9459 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:16.942599 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e7b7d13c-aa41-4bd3-b10c-0e3d87cf9459 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:16.943250 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e7b7d13c-aa41-4bd3-b10c-0e3d87cf9459 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:17.370132 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-61f06070-9332-4435-a570-9126a7398d29 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b638db630404ebbbcc2253db30844c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cc7342bf7941d2ad7ebc70032dd52e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:55:17.372888 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:SELECT=100 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:55:17.386858 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-61f06070-9332-4435-a570-9126a7398d29 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] 10.222.0.18 "GET /compute/v2.1/servers/04d927bb-da77-4ca1-a828-562a01f07892" status: 200 len: 1319 microversion: 2.1 time: 0.673841 Oct 22 20:55:17.387597 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 743/1559] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:55:16 2022] GET /compute/v2.1/servers/04d927bb-da77-4ca1-a828-562a01f07892 => generated 1319 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:55:17.398361 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-07782953-384c-4614-9e25-a453600b51b3 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:55:17.400496 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-07782953-384c-4614-9e25-a453600b51b3 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] [instance: 4c7b99a9-2ec4-4f4b-98e7-8e1ea2103735] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:55:17.411908 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-07782953-384c-4614-9e25-a453600b51b3 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:17.413384 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-07782953-384c-4614-9e25-a453600b51b3 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:17.414431 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-07782953-384c-4614-9e25-a453600b51b3 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:17.415428 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-07782953-384c-4614-9e25-a453600b51b3 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:17.416114 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-07782953-384c-4614-9e25-a453600b51b3 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:17.416789 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-07782953-384c-4614-9e25-a453600b51b3 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:17.471476 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-e7b7d13c-aa41-4bd3-b10c-0e3d87cf9459 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d3d7458af447bdb3f03e83a2d8559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49238b8686d24ae698679e4a1957735d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:55:17.491112 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-e7b7d13c-aa41-4bd3-b10c-0e3d87cf9459 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] 10.222.0.18 "GET /compute/v2.1/servers/40e6c6e3-3d47-4781-b8a8-aafd671d7287" status: 200 len: 1471 microversion: 2.1 time: 0.572859 Oct 22 20:55:17.493754 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 817/1560] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:55:16 2022] GET /compute/v2.1/servers/40e6c6e3-3d47-4781-b8a8-aafd671d7287 => generated 1471 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:55:17.499067 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-7b703b9f-91cc-4b96-8d4b-9f9f31392b58 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:55:17.500025 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-7b703b9f-91cc-4b96-8d4b-9f9f31392b58 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] [instance: a64fa89e-32f6-4994-a0b2-3788cf1c92ec] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:55:17.507100 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7b703b9f-91cc-4b96-8d4b-9f9f31392b58 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:17.508549 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7b703b9f-91cc-4b96-8d4b-9f9f31392b58 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:17.509946 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7b703b9f-91cc-4b96-8d4b-9f9f31392b58 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:17.510913 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7b703b9f-91cc-4b96-8d4b-9f9f31392b58 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:17.511566 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7b703b9f-91cc-4b96-8d4b-9f9f31392b58 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:17.512204 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7b703b9f-91cc-4b96-8d4b-9f9f31392b58 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:17.528955 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell0:SELECT=8 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:55:17.596038 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell0:SELECT=20 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:55:18.110587 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-07782953-384c-4614-9e25-a453600b51b3 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:55:18.125277 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-07782953-384c-4614-9e25-a453600b51b3 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:55:18.127029 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-07782953-384c-4614-9e25-a453600b51b3 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:55:18.128783 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-07782953-384c-4614-9e25-a453600b51b3 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] 10.222.0.18 "GET /compute/v2.1/servers/4c7b99a9-2ec4-4f4b-98e7-8e1ea2103735" status: 200 len: 1730 microversion: 2.25 time: 0.739470 Oct 22 20:55:18.144117 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 744/1561] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 20:55:17 2022] GET /compute/v2.1/servers/4c7b99a9-2ec4-4f4b-98e7-8e1ea2103735 => generated 1730 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 20:55:18.153381 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-8bee408e-02fb-4a06-84d8-e13c7acac9ec tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:55:18.154654 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-8bee408e-02fb-4a06-84d8-e13c7acac9ec tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] [instance: 532d6e6a-71ab-4ef0-a5bf-c042055c5121] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:55:18.167402 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8bee408e-02fb-4a06-84d8-e13c7acac9ec tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:18.168180 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8bee408e-02fb-4a06-84d8-e13c7acac9ec tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:18.168832 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8bee408e-02fb-4a06-84d8-e13c7acac9ec tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:18.169744 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8bee408e-02fb-4a06-84d8-e13c7acac9ec tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:18.170373 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8bee408e-02fb-4a06-84d8-e13c7acac9ec tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:18.170977 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8bee408e-02fb-4a06-84d8-e13c7acac9ec tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:18.194285 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-7b703b9f-91cc-4b96-8d4b-9f9f31392b58 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b392ad1fe1fd4b2a9e6be03a7435deb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594624ed28aa433d907c8833d360b82e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:55:18.215865 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-7b703b9f-91cc-4b96-8d4b-9f9f31392b58 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] 10.222.0.18 "GET /compute/v2.1/servers/a64fa89e-32f6-4994-a0b2-3788cf1c92ec" status: 200 len: 1324 microversion: 2.1 time: 0.718754 Oct 22 20:55:18.219790 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 818/1562] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:55:17 2022] GET /compute/v2.1/servers/a64fa89e-32f6-4994-a0b2-3788cf1c92ec => generated 1324 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:55:18.235494 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-03bb0ee0-652d-4b9d-9d98-4b683cd59a30 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:55:18.240614 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-03bb0ee0-652d-4b9d-9d98-4b683cd59a30 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] [instance: 40e6c6e3-3d47-4781-b8a8-aafd671d7287] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:55:18.259162 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-03bb0ee0-652d-4b9d-9d98-4b683cd59a30 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:18.261068 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-03bb0ee0-652d-4b9d-9d98-4b683cd59a30 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:18.264025 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-03bb0ee0-652d-4b9d-9d98-4b683cd59a30 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:18.267102 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-03bb0ee0-652d-4b9d-9d98-4b683cd59a30 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:18.267634 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-03bb0ee0-652d-4b9d-9d98-4b683cd59a30 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:18.269298 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-03bb0ee0-652d-4b9d-9d98-4b683cd59a30 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:18.359685 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:55:18.405785 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-03bb0ee0-652d-4b9d-9d98-4b683cd59a30 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] 10.222.0.18 "POST /compute/v2.1/servers/40e6c6e3-3d47-4781-b8a8-aafd671d7287/action" status: 204 len: 0 microversion: 2.1 time: 0.182976 Oct 22 20:55:18.406878 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 819/1563] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 20:55:18 2022] POST /compute/v2.1/servers/40e6c6e3-3d47-4781-b8a8-aafd671d7287/action => generated 0 bytes in 186 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 20:55:18.415294 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-d7255b25-35e7-4f4f-bafa-14d8c222d5c4 req-5c9f2c93-940b-4d69-a43e-ced3e2d5f2aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04d927bb-da77-4ca1-a828-562a01f07892", "name": "network-vif-plugged", "status": "completed", "tag": "0747114c-f2e1-42d3-a601-70006dee0431"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:55:18.437374 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-d7255b25-35e7-4f4f-bafa-14d8c222d5c4 req-5c9f2c93-940b-4d69-a43e-ced3e2d5f2aa service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:18.437891 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-d7255b25-35e7-4f4f-bafa-14d8c222d5c4 req-5c9f2c93-940b-4d69-a43e-ced3e2d5f2aa service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:18.438439 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-d7255b25-35e7-4f4f-bafa-14d8c222d5c4 req-5c9f2c93-940b-4d69-a43e-ced3e2d5f2aa service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:18.455976 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-d7255b25-35e7-4f4f-bafa-14d8c222d5c4 req-5c9f2c93-940b-4d69-a43e-ced3e2d5f2aa service nova] Creating event network-vif-plugged:0747114c-f2e1-42d3-a601-70006dee0431 for instance 04d927bb-da77-4ca1-a828-562a01f07892 on nch2-master-1 Oct 22 20:55:18.463250 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-d7255b25-35e7-4f4f-bafa-14d8c222d5c4 req-5c9f2c93-940b-4d69-a43e-ced3e2d5f2aa service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054312 Oct 22 20:55:18.466765 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 820/1564] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:55:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:55:18.484486 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-af00d258-69a7-41a6-81dc-71ae3cabec4c req-5d142945-da46-4556-bb9c-6107dee9f4a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a64fa89e-32f6-4994-a0b2-3788cf1c92ec", "tag": "e916fb42-f87f-4b20-b6b6-8abd516f5e15"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:55:18.497645 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-af00d258-69a7-41a6-81dc-71ae3cabec4c req-5d142945-da46-4556-bb9c-6107dee9f4a2 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:18.498449 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-af00d258-69a7-41a6-81dc-71ae3cabec4c req-5d142945-da46-4556-bb9c-6107dee9f4a2 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:18.499766 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-af00d258-69a7-41a6-81dc-71ae3cabec4c req-5d142945-da46-4556-bb9c-6107dee9f4a2 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:18.521330 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-af00d258-69a7-41a6-81dc-71ae3cabec4c req-5d142945-da46-4556-bb9c-6107dee9f4a2 service nova] Creating event network-changed:e916fb42-f87f-4b20-b6b6-8abd516f5e15 for instance a64fa89e-32f6-4994-a0b2-3788cf1c92ec on nch2-master-1 Oct 22 20:55:18.532706 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-af00d258-69a7-41a6-81dc-71ae3cabec4c req-5d142945-da46-4556-bb9c-6107dee9f4a2 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059658 Oct 22 20:55:18.534037 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 821/1565] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:55:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:55:18.544435 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-0644719b-0230-4027-a50a-6b9a7a55aae8 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:55:18.545516 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-0644719b-0230-4027-a50a-6b9a7a55aae8 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] [instance: 0e92c2df-261e-44fd-b584-2f870190e8ce] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:55:18.566243 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0644719b-0230-4027-a50a-6b9a7a55aae8 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:18.568611 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0644719b-0230-4027-a50a-6b9a7a55aae8 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:18.572910 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0644719b-0230-4027-a50a-6b9a7a55aae8 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:18.576256 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0644719b-0230-4027-a50a-6b9a7a55aae8 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:18.576962 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0644719b-0230-4027-a50a-6b9a7a55aae8 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:18.579024 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0644719b-0230-4027-a50a-6b9a7a55aae8 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:18.662540 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-8bee408e-02fb-4a06-84d8-e13c7acac9ec tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be93cabff0d46ccb2a3db0db1a13796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42111ed6bcc3465d8c1f5291da248e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:55:18.672627 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-8bee408e-02fb-4a06-84d8-e13c7acac9ec tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] 10.222.0.18 "GET /compute/v2.1/servers/532d6e6a-71ab-4ef0-a5bf-c042055c5121" status: 200 len: 1324 microversion: 2.1 time: 0.526609 Oct 22 20:55:18.673585 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 745/1566] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:55:18 2022] GET /compute/v2.1/servers/532d6e6a-71ab-4ef0-a5bf-c042055c5121 => generated 1324 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:55:18.679165 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-f494dd2f-b56a-4dec-8b4f-9b79d775d85a tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:55:18.680064 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-f494dd2f-b56a-4dec-8b4f-9b79d775d85a tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] [instance: fbb34507-cef9-4d78-9ed7-5d6eab4ca806] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:55:18.686637 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f494dd2f-b56a-4dec-8b4f-9b79d775d85a tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:18.687396 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f494dd2f-b56a-4dec-8b4f-9b79d775d85a tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:18.688022 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f494dd2f-b56a-4dec-8b4f-9b79d775d85a tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:18.688902 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f494dd2f-b56a-4dec-8b4f-9b79d775d85a tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:18.689527 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f494dd2f-b56a-4dec-8b4f-9b79d775d85a tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:18.690124 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f494dd2f-b56a-4dec-8b4f-9b79d775d85a tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:19.045911 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-0644719b-0230-4027-a50a-6b9a7a55aae8 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7f48d18691d4473bbe0284c44f14d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bacf9909082440f8a201771b64a75fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:55:19.054372 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-0644719b-0230-4027-a50a-6b9a7a55aae8 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] 10.222.0.18 "GET /compute/v2.1/servers/0e92c2df-261e-44fd-b584-2f870190e8ce" status: 200 len: 1653 microversion: 2.1 time: 0.518359 Oct 22 20:55:19.055125 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 822/1567] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:55:18 2022] GET /compute/v2.1/servers/0e92c2df-261e-44fd-b584-2f870190e8ce => generated 1653 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:55:19.059942 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-7232d98e-b9c5-496f-abd9-5b9a6945fe0d req-e741738f-f2c1-4614-98e0-757eaeafd456 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e92c2df-261e-44fd-b584-2f870190e8ce", "name": "network-vif-deleted", "tag": "0179715f-adee-41ed-a569-67196aa24ae5"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:55:19.072491 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-7232d98e-b9c5-496f-abd9-5b9a6945fe0d req-e741738f-f2c1-4614-98e0-757eaeafd456 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:19.072970 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-7232d98e-b9c5-496f-abd9-5b9a6945fe0d req-e741738f-f2c1-4614-98e0-757eaeafd456 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:19.073910 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-7232d98e-b9c5-496f-abd9-5b9a6945fe0d req-e741738f-f2c1-4614-98e0-757eaeafd456 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:19.086597 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-7232d98e-b9c5-496f-abd9-5b9a6945fe0d req-e741738f-f2c1-4614-98e0-757eaeafd456 service nova] Creating event network-vif-deleted:0179715f-adee-41ed-a569-67196aa24ae5 for instance 0e92c2df-261e-44fd-b584-2f870190e8ce on nch1-master-1 Oct 22 20:55:19.091677 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-7232d98e-b9c5-496f-abd9-5b9a6945fe0d req-e741738f-f2c1-4614-98e0-757eaeafd456 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035049 Oct 22 20:55:19.092670 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 823/1568] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:55:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:55:19.098028 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-22205db8-190a-4ff1-a1ad-445f0d5e1811 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:55:19.098733 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-22205db8-190a-4ff1-a1ad-445f0d5e1811 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] [instance: 04d927bb-da77-4ca1-a828-562a01f07892] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:55:19.105472 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-22205db8-190a-4ff1-a1ad-445f0d5e1811 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:19.106281 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-22205db8-190a-4ff1-a1ad-445f0d5e1811 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:19.106721 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-22205db8-190a-4ff1-a1ad-445f0d5e1811 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:19.107564 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-22205db8-190a-4ff1-a1ad-445f0d5e1811 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:19.108016 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-22205db8-190a-4ff1-a1ad-445f0d5e1811 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:19.108603 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-22205db8-190a-4ff1-a1ad-445f0d5e1811 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:19.111878 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-f494dd2f-b56a-4dec-8b4f-9b79d775d85a tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c87f0356ca346f39c6216393d85da2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee8c8f7fc4e12bc1f9fcce3e7b581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:55:19.122523 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-f494dd2f-b56a-4dec-8b4f-9b79d775d85a tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] 10.222.0.18 "GET /compute/v2.1/servers/fbb34507-cef9-4d78-9ed7-5d6eab4ca806" status: 200 len: 1382 microversion: 2.1 time: 0.447650 Oct 22 20:55:19.135827 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 746/1569] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:55:18 2022] GET /compute/v2.1/servers/fbb34507-cef9-4d78-9ed7-5d6eab4ca806 => generated 1382 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:55:19.146356 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-812e343d-f6b5-48d0-8642-84cf04454e83 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:55:19.146981 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-812e343d-f6b5-48d0-8642-84cf04454e83 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] [instance: 40e6c6e3-3d47-4781-b8a8-aafd671d7287] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:55:19.160323 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-812e343d-f6b5-48d0-8642-84cf04454e83 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:19.160823 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-812e343d-f6b5-48d0-8642-84cf04454e83 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:19.161259 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-812e343d-f6b5-48d0-8642-84cf04454e83 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:19.162176 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-812e343d-f6b5-48d0-8642-84cf04454e83 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:19.162638 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-812e343d-f6b5-48d0-8642-84cf04454e83 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:19.163068 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-812e343d-f6b5-48d0-8642-84cf04454e83 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:19.389935 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-22205db8-190a-4ff1-a1ad-445f0d5e1811 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b638db630404ebbbcc2253db30844c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cc7342bf7941d2ad7ebc70032dd52e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:55:19.400875 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-22205db8-190a-4ff1-a1ad-445f0d5e1811 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] 10.222.0.18 "GET /compute/v2.1/servers/04d927bb-da77-4ca1-a828-562a01f07892" status: 200 len: 1319 microversion: 2.1 time: 0.306164 Oct 22 20:55:19.418610 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 824/1570] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:55:19 2022] GET /compute/v2.1/servers/04d927bb-da77-4ca1-a828-562a01f07892 => generated 1319 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:55:19.424913 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-1edb3253-e5e7-4a0e-a9c0-dda81d0c7a46 tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:55:19.426267 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-1edb3253-e5e7-4a0e-a9c0-dda81d0c7a46 tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] [instance: fbb34507-cef9-4d78-9ed7-5d6eab4ca806] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:55:19.430495 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:55:19.438052 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1edb3253-e5e7-4a0e-a9c0-dda81d0c7a46 tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:19.439177 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1edb3253-e5e7-4a0e-a9c0-dda81d0c7a46 tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:19.440000 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1edb3253-e5e7-4a0e-a9c0-dda81d0c7a46 tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:19.441837 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1edb3253-e5e7-4a0e-a9c0-dda81d0c7a46 tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:19.442737 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1edb3253-e5e7-4a0e-a9c0-dda81d0c7a46 tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:19.444352 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1edb3253-e5e7-4a0e-a9c0-dda81d0c7a46 tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:19.770021 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-812e343d-f6b5-48d0-8642-84cf04454e83 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d3d7458af447bdb3f03e83a2d8559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49238b8686d24ae698679e4a1957735d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:55:19.780123 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-812e343d-f6b5-48d0-8642-84cf04454e83 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] 10.222.0.18 "GET /compute/v2.1/servers/40e6c6e3-3d47-4781-b8a8-aafd671d7287" status: 200 len: 1471 microversion: 2.1 time: 0.642538 Oct 22 20:55:19.781456 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 747/1571] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:55:19 2022] GET /compute/v2.1/servers/40e6c6e3-3d47-4781-b8a8-aafd671d7287 => generated 1471 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:55:19.789153 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-cdbd6396-5362-4e82-b6eb-e706f274ddd0 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:55:19.790172 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-cdbd6396-5362-4e82-b6eb-e706f274ddd0 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] [instance: 4c7b99a9-2ec4-4f4b-98e7-8e1ea2103735] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:55:19.797303 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cdbd6396-5362-4e82-b6eb-e706f274ddd0 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:19.797940 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cdbd6396-5362-4e82-b6eb-e706f274ddd0 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:19.798489 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cdbd6396-5362-4e82-b6eb-e706f274ddd0 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:19.799626 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cdbd6396-5362-4e82-b6eb-e706f274ddd0 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:19.800421 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cdbd6396-5362-4e82-b6eb-e706f274ddd0 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:19.801220 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cdbd6396-5362-4e82-b6eb-e706f274ddd0 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:19.893579 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-cdbd6396-5362-4e82-b6eb-e706f274ddd0 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:55:19.908246 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-cdbd6396-5362-4e82-b6eb-e706f274ddd0 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:55:19.909728 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-cdbd6396-5362-4e82-b6eb-e706f274ddd0 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:55:19.910918 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-cdbd6396-5362-4e82-b6eb-e706f274ddd0 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] 10.222.0.18 "GET /compute/v2.1/servers/4c7b99a9-2ec4-4f4b-98e7-8e1ea2103735" status: 200 len: 1662 microversion: 2.25 time: 0.128130 Oct 22 20:55:19.911720 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 748/1572] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 20:55:19 2022] GET /compute/v2.1/servers/4c7b99a9-2ec4-4f4b-98e7-8e1ea2103735 => generated 1662 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 20:55:19.934531 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-463d9767-3529-4f00-ba52-f5248a1f4756 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:55:19.935548 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-463d9767-3529-4f00-ba52-f5248a1f4756 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] [instance: a64fa89e-32f6-4994-a0b2-3788cf1c92ec] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:55:19.943287 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-463d9767-3529-4f00-ba52-f5248a1f4756 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:19.944033 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-463d9767-3529-4f00-ba52-f5248a1f4756 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:19.944652 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-463d9767-3529-4f00-ba52-f5248a1f4756 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:19.946154 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-463d9767-3529-4f00-ba52-f5248a1f4756 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:19.946855 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-463d9767-3529-4f00-ba52-f5248a1f4756 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:19.947490 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-463d9767-3529-4f00-ba52-f5248a1f4756 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:19.954986 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-1edb3253-e5e7-4a0e-a9c0-dda81d0c7a46 tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/fbb34507-cef9-4d78-9ed7-5d6eab4ca806" status: 200 len: 1533 microversion: 2.1 time: 0.534553 Oct 22 20:55:19.969419 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 825/1573] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:55:19 2022] GET /compute/v2.1/servers/fbb34507-cef9-4d78-9ed7-5d6eab4ca806 => generated 1533 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:55:19.976933 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-c304eadd-3914-424d-a64b-d5c3cda27a46 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:55:19.977846 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-c304eadd-3914-424d-a64b-d5c3cda27a46 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] [instance: 532d6e6a-71ab-4ef0-a5bf-c042055c5121] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:55:19.984557 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c304eadd-3914-424d-a64b-d5c3cda27a46 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:19.985491 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c304eadd-3914-424d-a64b-d5c3cda27a46 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:19.986176 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c304eadd-3914-424d-a64b-d5c3cda27a46 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:19.987138 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c304eadd-3914-424d-a64b-d5c3cda27a46 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:19.988690 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c304eadd-3914-424d-a64b-d5c3cda27a46 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:19.989494 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c304eadd-3914-424d-a64b-d5c3cda27a46 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:20.148839 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-463d9767-3529-4f00-ba52-f5248a1f4756 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b392ad1fe1fd4b2a9e6be03a7435deb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594624ed28aa433d907c8833d360b82e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:55:20.161025 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-463d9767-3529-4f00-ba52-f5248a1f4756 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] 10.222.0.18 "GET /compute/v2.1/servers/a64fa89e-32f6-4994-a0b2-3788cf1c92ec" status: 200 len: 1324 microversion: 2.1 time: 0.235725 Oct 22 20:55:20.163023 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 749/1574] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:55:19 2022] GET /compute/v2.1/servers/a64fa89e-32f6-4994-a0b2-3788cf1c92ec => generated 1324 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:55:20.168322 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-54a0879d-6e87-41e2-866f-672a2655d824 tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:55:20.169349 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-54a0879d-6e87-41e2-866f-672a2655d824 tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] [instance: fbb34507-cef9-4d78-9ed7-5d6eab4ca806] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:55:20.183689 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-c304eadd-3914-424d-a64b-d5c3cda27a46 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be93cabff0d46ccb2a3db0db1a13796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42111ed6bcc3465d8c1f5291da248e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:55:20.212511 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-c304eadd-3914-424d-a64b-d5c3cda27a46 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] 10.222.0.18 "GET /compute/v2.1/servers/532d6e6a-71ab-4ef0-a5bf-c042055c5121" status: 200 len: 1324 microversion: 2.1 time: 0.241799 Oct 22 20:55:20.214444 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-54a0879d-6e87-41e2-866f-672a2655d824 tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:20.227472 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 826/1575] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:55:19 2022] GET /compute/v2.1/servers/532d6e6a-71ab-4ef0-a5bf-c042055c5121 => generated 1324 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:55:20.228088 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-54a0879d-6e87-41e2-866f-672a2655d824 tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:20.228088 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-54a0879d-6e87-41e2-866f-672a2655d824 tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:20.228088 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-54a0879d-6e87-41e2-866f-672a2655d824 tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:20.228088 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-54a0879d-6e87-41e2-866f-672a2655d824 tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:20.228088 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-54a0879d-6e87-41e2-866f-672a2655d824 tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:20.229334 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-07ddf96a-5245-4e4e-acd3-9ce5c3802aef tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:55:20.235863 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-07ddf96a-5245-4e4e-acd3-9ce5c3802aef tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] [instance: 0e92c2df-261e-44fd-b584-2f870190e8ce] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:55:20.260354 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-07ddf96a-5245-4e4e-acd3-9ce5c3802aef tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:20.260858 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-07ddf96a-5245-4e4e-acd3-9ce5c3802aef tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:20.261514 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-07ddf96a-5245-4e4e-acd3-9ce5c3802aef tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:20.262627 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-07ddf96a-5245-4e4e-acd3-9ce5c3802aef tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:20.263267 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-07ddf96a-5245-4e4e-acd3-9ce5c3802aef tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:20.264484 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-07ddf96a-5245-4e4e-acd3-9ce5c3802aef tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:20.511845 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-07ddf96a-5245-4e4e-acd3-9ce5c3802aef tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7f48d18691d4473bbe0284c44f14d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bacf9909082440f8a201771b64a75fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:55:20.525920 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-07ddf96a-5245-4e4e-acd3-9ce5c3802aef tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] 10.222.0.18 "GET /compute/v2.1/servers/0e92c2df-261e-44fd-b584-2f870190e8ce" status: 200 len: 1611 microversion: 2.1 time: 0.308358 Oct 22 20:55:20.526531 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 827/1576] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:55:20 2022] GET /compute/v2.1/servers/0e92c2df-261e-44fd-b584-2f870190e8ce => generated 1611 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:55:20.540403 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-ee53a34c-d310-4668-bbc8-4d00a809da07 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:55:20.545848 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-ee53a34c-d310-4668-bbc8-4d00a809da07 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] [instance: 04d927bb-da77-4ca1-a828-562a01f07892] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:55:20.554207 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ee53a34c-d310-4668-bbc8-4d00a809da07 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:20.554932 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ee53a34c-d310-4668-bbc8-4d00a809da07 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:20.555566 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ee53a34c-d310-4668-bbc8-4d00a809da07 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:20.556679 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ee53a34c-d310-4668-bbc8-4d00a809da07 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:20.557340 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ee53a34c-d310-4668-bbc8-4d00a809da07 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:20.557932 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ee53a34c-d310-4668-bbc8-4d00a809da07 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:20.654870 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-54a0879d-6e87-41e2-866f-672a2655d824 tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/fbb34507-cef9-4d78-9ed7-5d6eab4ca806" status: 200 len: 1533 microversion: 2.1 time: 0.490186 Oct 22 20:55:20.655733 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 750/1577] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:55:20 2022] GET /compute/v2.1/servers/fbb34507-cef9-4d78-9ed7-5d6eab4ca806 => generated 1533 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:55:20.661402 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-57fa9ed4-3dfa-4ccd-ac27-57ee310c2c0f req-947792ac-f09d-4449-ad90-b44d56be44f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40e6c6e3-3d47-4781-b8a8-aafd671d7287", "name": "network-vif-plugged", "status": "completed", "tag": "3f86770d-1d07-4131-85b9-86ddae7d31e5"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:55:20.672053 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-57fa9ed4-3dfa-4ccd-ac27-57ee310c2c0f req-947792ac-f09d-4449-ad90-b44d56be44f6 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:20.672768 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-57fa9ed4-3dfa-4ccd-ac27-57ee310c2c0f req-947792ac-f09d-4449-ad90-b44d56be44f6 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:20.673393 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-57fa9ed4-3dfa-4ccd-ac27-57ee310c2c0f req-947792ac-f09d-4449-ad90-b44d56be44f6 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:20.687251 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-57fa9ed4-3dfa-4ccd-ac27-57ee310c2c0f req-947792ac-f09d-4449-ad90-b44d56be44f6 service nova] Creating event network-vif-plugged:3f86770d-1d07-4131-85b9-86ddae7d31e5 for instance 40e6c6e3-3d47-4781-b8a8-aafd671d7287 on nch1-master-1 Oct 22 20:55:20.693297 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [req-57fa9ed4-3dfa-4ccd-ac27-57ee310c2c0f req-947792ac-f09d-4449-ad90-b44d56be44f6 service nova] Instance 40e6c6e3-3d47-4781-b8a8-aafd671d7287 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=138744) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 22 20:55:20.705784 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-57fa9ed4-3dfa-4ccd-ac27-57ee310c2c0f req-947792ac-f09d-4449-ad90-b44d56be44f6 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048255 Oct 22 20:55:20.707079 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 751/1578] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:55:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:55:20.714081 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-02a19365-e3cd-43fe-9550-d1a00ff29500 req-c01b4b07-2977-4725-859e-2442974653de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c7b99a9-2ec4-4f4b-98e7-8e1ea2103735", "name": "network-vif-deleted", "tag": "54a65686-35c5-4655-a6b6-8d82393a2555"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:55:20.725902 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-02a19365-e3cd-43fe-9550-d1a00ff29500 req-c01b4b07-2977-4725-859e-2442974653de service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:20.726923 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-02a19365-e3cd-43fe-9550-d1a00ff29500 req-c01b4b07-2977-4725-859e-2442974653de service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:20.727608 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-02a19365-e3cd-43fe-9550-d1a00ff29500 req-c01b4b07-2977-4725-859e-2442974653de service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:20.741102 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-02a19365-e3cd-43fe-9550-d1a00ff29500 req-c01b4b07-2977-4725-859e-2442974653de service nova] Creating event network-vif-deleted:54a65686-35c5-4655-a6b6-8d82393a2555 for instance 4c7b99a9-2ec4-4f4b-98e7-8e1ea2103735 on nch2-master-1 Oct 22 20:55:20.747204 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-02a19365-e3cd-43fe-9550-d1a00ff29500 req-c01b4b07-2977-4725-859e-2442974653de service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038553 Oct 22 20:55:20.748295 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 752/1579] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:55:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:55:20.765722 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-d9e139aa-3ef2-4309-89f7-cb66ba6c2348 tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:55:20.772544 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d9e139aa-3ef2-4309-89f7-cb66ba6c2348 tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:20.773427 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d9e139aa-3ef2-4309-89f7-cb66ba6c2348 tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:20.774097 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d9e139aa-3ef2-4309-89f7-cb66ba6c2348 tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:20.775126 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d9e139aa-3ef2-4309-89f7-cb66ba6c2348 tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:20.775887 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d9e139aa-3ef2-4309-89f7-cb66ba6c2348 tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:20.776566 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d9e139aa-3ef2-4309-89f7-cb66ba6c2348 tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:20.823401 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-d9e139aa-3ef2-4309-89f7-cb66ba6c2348 tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] 10.222.0.18 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.068303 Oct 22 20:55:20.824545 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 753/1580] 10.222.0.18 () {58 vars in 1176 bytes} [Sat Oct 22 20:55:20 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:55:20.826925 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-ee53a34c-d310-4668-bbc8-4d00a809da07 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b638db630404ebbbcc2253db30844c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cc7342bf7941d2ad7ebc70032dd52e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:55:20.836204 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-caa2d32a-8e7a-494a-a81d-5ab57dabc76a tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:55:20.837394 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-caa2d32a-8e7a-494a-a81d-5ab57dabc76a tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] [instance: 40e6c6e3-3d47-4781-b8a8-aafd671d7287] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:55:20.845064 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-caa2d32a-8e7a-494a-a81d-5ab57dabc76a tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:20.847379 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-caa2d32a-8e7a-494a-a81d-5ab57dabc76a tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:20.848552 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-caa2d32a-8e7a-494a-a81d-5ab57dabc76a tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:20.850325 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-caa2d32a-8e7a-494a-a81d-5ab57dabc76a tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:20.851023 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-ee53a34c-d310-4668-bbc8-4d00a809da07 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] 10.222.0.18 "GET /compute/v2.1/servers/04d927bb-da77-4ca1-a828-562a01f07892" status: 200 len: 1319 microversion: 2.1 time: 0.318351 Oct 22 20:55:20.851932 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-caa2d32a-8e7a-494a-a81d-5ab57dabc76a tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:20.852849 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-caa2d32a-8e7a-494a-a81d-5ab57dabc76a tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:20.859665 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 828/1581] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:55:20 2022] GET /compute/v2.1/servers/04d927bb-da77-4ca1-a828-562a01f07892 => generated 1319 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:55:20.880691 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-efface9f-ee4c-4706-ab59-ee2188bd894f tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch2-master-1", "block_migration": false, "disk_over_commit": false}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:55:20.893331 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-efface9f-ee4c-4706-ab59-ee2188bd894f tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] [instance: fbb34507-cef9-4d78-9ed7-5d6eab4ca806] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:55:20.918389 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-efface9f-ee4c-4706-ab59-ee2188bd894f tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:20.918901 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-efface9f-ee4c-4706-ab59-ee2188bd894f tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:20.924163 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-efface9f-ee4c-4706-ab59-ee2188bd894f tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:20.925192 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-efface9f-ee4c-4706-ab59-ee2188bd894f tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:20.925831 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-efface9f-ee4c-4706-ab59-ee2188bd894f tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:20.926344 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-efface9f-ee4c-4706-ab59-ee2188bd894f tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:20.981192 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.objects.instance [None req-efface9f-ee4c-4706-ab59-ee2188bd894f tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] Lazy-loading 'flavor' on Instance uuid fbb34507-cef9-4d78-9ed7-5d6eab4ca806 {{(pid=138745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 20:55:21.006540 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-efface9f-ee4c-4706-ab59-ee2188bd894f tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] [instance: fbb34507-cef9-4d78-9ed7-5d6eab4ca806] Going to try to live migrate instance to nch2-master-1 {{(pid=138745) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 22 20:55:21.186707 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-caa2d32a-8e7a-494a-a81d-5ab57dabc76a tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d3d7458af447bdb3f03e83a2d8559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49238b8686d24ae698679e4a1957735d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:55:21.204676 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-caa2d32a-8e7a-494a-a81d-5ab57dabc76a tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] 10.222.0.18 "GET /compute/v2.1/servers/40e6c6e3-3d47-4781-b8a8-aafd671d7287" status: 200 len: 1471 microversion: 2.1 time: 0.377916 Oct 22 20:55:21.220566 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 754/1582] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:55:20 2022] GET /compute/v2.1/servers/40e6c6e3-3d47-4781-b8a8-aafd671d7287 => generated 1471 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:55:21.245000 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-f6e32cec-3c3d-4db5-9bc7-4cc37ffe9521 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:55:21.245794 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-f6e32cec-3c3d-4db5-9bc7-4cc37ffe9521 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] [instance: 4c7b99a9-2ec4-4f4b-98e7-8e1ea2103735] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:55:21.266196 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f6e32cec-3c3d-4db5-9bc7-4cc37ffe9521 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:21.271111 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f6e32cec-3c3d-4db5-9bc7-4cc37ffe9521 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:21.271782 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f6e32cec-3c3d-4db5-9bc7-4cc37ffe9521 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:21.272559 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f6e32cec-3c3d-4db5-9bc7-4cc37ffe9521 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:21.273042 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f6e32cec-3c3d-4db5-9bc7-4cc37ffe9521 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:21.273478 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f6e32cec-3c3d-4db5-9bc7-4cc37ffe9521 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:21.397056 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f6e32cec-3c3d-4db5-9bc7-4cc37ffe9521 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:21.399402 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f6e32cec-3c3d-4db5-9bc7-4cc37ffe9521 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:21.400386 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f6e32cec-3c3d-4db5-9bc7-4cc37ffe9521 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:21.401668 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.objects.instance [None req-f6e32cec-3c3d-4db5-9bc7-4cc37ffe9521 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lazy-loading 'fault' on Instance uuid 4c7b99a9-2ec4-4f4b-98e7-8e1ea2103735 {{(pid=138744) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 20:55:21.486202 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-f6e32cec-3c3d-4db5-9bc7-4cc37ffe9521 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:55:21.499034 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-f6e32cec-3c3d-4db5-9bc7-4cc37ffe9521 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:55:21.506971 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-f6e32cec-3c3d-4db5-9bc7-4cc37ffe9521 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:55:21.510456 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-f6e32cec-3c3d-4db5-9bc7-4cc37ffe9521 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] 10.222.0.18 "GET /compute/v2.1/servers/4c7b99a9-2ec4-4f4b-98e7-8e1ea2103735" status: 200 len: 1374 microversion: 2.25 time: 0.288403 Oct 22 20:55:21.513064 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 755/1583] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 20:55:21 2022] GET /compute/v2.1/servers/4c7b99a9-2ec4-4f4b-98e7-8e1ea2103735 => generated 1374 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 20:55:21.521722 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-5d0bd92e-789b-42ea-bba5-4b1c4836d777 req-5752cb78-2648-4786-9e10-5bd09e702d00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e92c2df-261e-44fd-b584-2f870190e8ce", "name": "network-vif-deleted", "tag": "e1a5f050-1369-4771-864c-213c8500e5e6"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:55:21.536833 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-5d0bd92e-789b-42ea-bba5-4b1c4836d777 req-5752cb78-2648-4786-9e10-5bd09e702d00 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:21.537769 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-5d0bd92e-789b-42ea-bba5-4b1c4836d777 req-5752cb78-2648-4786-9e10-5bd09e702d00 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:21.538531 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-5d0bd92e-789b-42ea-bba5-4b1c4836d777 req-5752cb78-2648-4786-9e10-5bd09e702d00 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:21.555493 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-5d0bd92e-789b-42ea-bba5-4b1c4836d777 req-5752cb78-2648-4786-9e10-5bd09e702d00 service nova] Creating event network-vif-deleted:e1a5f050-1369-4771-864c-213c8500e5e6 for instance 0e92c2df-261e-44fd-b584-2f870190e8ce on nch1-master-1 Oct 22 20:55:21.562258 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-5d0bd92e-789b-42ea-bba5-4b1c4836d777 req-5752cb78-2648-4786-9e10-5bd09e702d00 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047637 Oct 22 20:55:21.568699 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 756/1584] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:55:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:55:21.576676 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-bb90c13d-703a-4e10-b5d3-b8f2e56c8512 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:55:21.578113 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-bb90c13d-703a-4e10-b5d3-b8f2e56c8512 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] [instance: a64fa89e-32f6-4994-a0b2-3788cf1c92ec] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:55:21.587147 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bb90c13d-703a-4e10-b5d3-b8f2e56c8512 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:21.588063 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bb90c13d-703a-4e10-b5d3-b8f2e56c8512 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:21.589917 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bb90c13d-703a-4e10-b5d3-b8f2e56c8512 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:21.591012 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bb90c13d-703a-4e10-b5d3-b8f2e56c8512 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:21.591892 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bb90c13d-703a-4e10-b5d3-b8f2e56c8512 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:21.592588 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bb90c13d-703a-4e10-b5d3-b8f2e56c8512 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:21.887652 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-bb90c13d-703a-4e10-b5d3-b8f2e56c8512 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b392ad1fe1fd4b2a9e6be03a7435deb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594624ed28aa433d907c8833d360b82e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:55:21.900179 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-bb90c13d-703a-4e10-b5d3-b8f2e56c8512 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] 10.222.0.18 "GET /compute/v2.1/servers/a64fa89e-32f6-4994-a0b2-3788cf1c92ec" status: 200 len: 1324 microversion: 2.1 time: 0.329779 Oct 22 20:55:21.900823 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 757/1585] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:55:21 2022] GET /compute/v2.1/servers/a64fa89e-32f6-4994-a0b2-3788cf1c92ec => generated 1324 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:55:21.919846 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-0d56952c-c91f-4134-9c1b-b9829f3d02f6 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:55:21.919846 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-0d56952c-c91f-4134-9c1b-b9829f3d02f6 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] [instance: 532d6e6a-71ab-4ef0-a5bf-c042055c5121] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:55:21.929521 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0d56952c-c91f-4134-9c1b-b9829f3d02f6 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:21.930254 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0d56952c-c91f-4134-9c1b-b9829f3d02f6 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:21.930930 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0d56952c-c91f-4134-9c1b-b9829f3d02f6 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:21.932022 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0d56952c-c91f-4134-9c1b-b9829f3d02f6 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:21.932654 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0d56952c-c91f-4134-9c1b-b9829f3d02f6 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:21.933693 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0d56952c-c91f-4134-9c1b-b9829f3d02f6 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:22.252142 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-0d56952c-c91f-4134-9c1b-b9829f3d02f6 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be93cabff0d46ccb2a3db0db1a13796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42111ed6bcc3465d8c1f5291da248e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:55:22.264727 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-0d56952c-c91f-4134-9c1b-b9829f3d02f6 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] 10.222.0.18 "GET /compute/v2.1/servers/532d6e6a-71ab-4ef0-a5bf-c042055c5121" status: 200 len: 1324 microversion: 2.1 time: 0.362532 Oct 22 20:55:22.266310 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 758/1586] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:55:21 2022] GET /compute/v2.1/servers/532d6e6a-71ab-4ef0-a5bf-c042055c5121 => generated 1324 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:55:22.272747 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-47164819-3cc8-4230-9fe9-985011ecafbb tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:55:22.273615 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-47164819-3cc8-4230-9fe9-985011ecafbb tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] [instance: 0e92c2df-261e-44fd-b584-2f870190e8ce] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:55:22.281822 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-47164819-3cc8-4230-9fe9-985011ecafbb tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:22.282413 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-47164819-3cc8-4230-9fe9-985011ecafbb tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:22.282946 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-47164819-3cc8-4230-9fe9-985011ecafbb tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:22.283781 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-47164819-3cc8-4230-9fe9-985011ecafbb tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:22.284305 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-47164819-3cc8-4230-9fe9-985011ecafbb tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:22.285275 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-47164819-3cc8-4230-9fe9-985011ecafbb tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:22.333419 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-47164819-3cc8-4230-9fe9-985011ecafbb tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:22.334289 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-47164819-3cc8-4230-9fe9-985011ecafbb tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:22.335034 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-47164819-3cc8-4230-9fe9-985011ecafbb tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:22.335724 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.objects.instance [None req-47164819-3cc8-4230-9fe9-985011ecafbb tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lazy-loading 'fault' on Instance uuid 0e92c2df-261e-44fd-b584-2f870190e8ce {{(pid=138744) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 20:55:22.382749 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-47164819-3cc8-4230-9fe9-985011ecafbb tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7f48d18691d4473bbe0284c44f14d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bacf9909082440f8a201771b64a75fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:55:22.391419 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-47164819-3cc8-4230-9fe9-985011ecafbb tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] 10.222.0.18 "GET /compute/v2.1/servers/0e92c2df-261e-44fd-b584-2f870190e8ce" status: 200 len: 1303 microversion: 2.1 time: 0.123579 Oct 22 20:55:22.404137 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 759/1587] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:55:22 2022] GET /compute/v2.1/servers/0e92c2df-261e-44fd-b584-2f870190e8ce => generated 1303 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:55:22.412778 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-a12a3768-ad45-4cf8-9fc5-0d79d5a7c1eb tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:55:22.413322 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-a12a3768-ad45-4cf8-9fc5-0d79d5a7c1eb tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] [instance: 04d927bb-da77-4ca1-a828-562a01f07892] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:55:22.443978 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a12a3768-ad45-4cf8-9fc5-0d79d5a7c1eb tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:22.444534 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a12a3768-ad45-4cf8-9fc5-0d79d5a7c1eb tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:22.447321 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a12a3768-ad45-4cf8-9fc5-0d79d5a7c1eb tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:22.449926 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a12a3768-ad45-4cf8-9fc5-0d79d5a7c1eb tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:22.451506 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a12a3768-ad45-4cf8-9fc5-0d79d5a7c1eb tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:22.452308 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a12a3768-ad45-4cf8-9fc5-0d79d5a7c1eb tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:22.709052 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-a12a3768-ad45-4cf8-9fc5-0d79d5a7c1eb tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b638db630404ebbbcc2253db30844c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cc7342bf7941d2ad7ebc70032dd52e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:55:22.720669 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-a12a3768-ad45-4cf8-9fc5-0d79d5a7c1eb tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] 10.222.0.18 "GET /compute/v2.1/servers/04d927bb-da77-4ca1-a828-562a01f07892" status: 200 len: 1508 microversion: 2.1 time: 0.315306 Oct 22 20:55:22.725486 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 760/1588] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:55:22 2022] GET /compute/v2.1/servers/04d927bb-da77-4ca1-a828-562a01f07892 => generated 1508 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:55:22.735172 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-c84723a2-719a-49c8-9dd1-c524f8ff8a1f tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:55:22.739398 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-c84723a2-719a-49c8-9dd1-c524f8ff8a1f tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] [instance: 40e6c6e3-3d47-4781-b8a8-aafd671d7287] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:55:22.746697 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c84723a2-719a-49c8-9dd1-c524f8ff8a1f tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:22.747216 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c84723a2-719a-49c8-9dd1-c524f8ff8a1f tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:22.747718 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c84723a2-719a-49c8-9dd1-c524f8ff8a1f tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:22.748490 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c84723a2-719a-49c8-9dd1-c524f8ff8a1f tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:22.748955 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c84723a2-719a-49c8-9dd1-c524f8ff8a1f tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:22.749393 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c84723a2-719a-49c8-9dd1-c524f8ff8a1f tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:23.044819 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-c84723a2-719a-49c8-9dd1-c524f8ff8a1f tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d3d7458af447bdb3f03e83a2d8559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49238b8686d24ae698679e4a1957735d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:55:23.054534 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-c84723a2-719a-49c8-9dd1-c524f8ff8a1f tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] 10.222.0.18 "GET /compute/v2.1/servers/40e6c6e3-3d47-4781-b8a8-aafd671d7287" status: 200 len: 1471 microversion: 2.1 time: 0.327355 Oct 22 20:55:23.055842 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 761/1589] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:55:22 2022] GET /compute/v2.1/servers/40e6c6e3-3d47-4781-b8a8-aafd671d7287 => generated 1471 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:55:23.060972 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-ff2e8c35-e974-44ca-889f-8160836f3d2b tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:55:23.061917 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-ff2e8c35-e974-44ca-889f-8160836f3d2b tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] [instance: 4c7b99a9-2ec4-4f4b-98e7-8e1ea2103735] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:55:23.073136 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ff2e8c35-e974-44ca-889f-8160836f3d2b tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:23.075991 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ff2e8c35-e974-44ca-889f-8160836f3d2b tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:23.076680 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ff2e8c35-e974-44ca-889f-8160836f3d2b tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:23.077769 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ff2e8c35-e974-44ca-889f-8160836f3d2b tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:23.078469 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ff2e8c35-e974-44ca-889f-8160836f3d2b tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:23.079133 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ff2e8c35-e974-44ca-889f-8160836f3d2b tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:23.084907 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:SELECT=100 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:55:23.100398 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-ff2e8c35-e974-44ca-889f-8160836f3d2b tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] HTTP exception thrown: Instance 4c7b99a9-2ec4-4f4b-98e7-8e1ea2103735 could not be found. Oct 22 20:55:23.102978 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-ff2e8c35-e974-44ca-889f-8160836f3d2b tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Request method failure captured: Oct 22 20:55:23.102978 ncdv-master-1 devstack@n-api.service[138744]: request: GET /compute/v2.1/servers/4c7b99a9-2ec4-4f4b-98e7-8e1ea2103735 HTTP/1.1 Oct 22 20:55:23.102978 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 20:55:23.102978 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 20:55:23.102978 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 20:55:23.102978 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 0 Oct 22 20:55:23.102978 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 20:55:23.102978 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 20:55:23.102978 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 20:55:23.102978 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 20:55:23.102978 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVFc6ze-JvRNBYUoDY8DxRahatFrOlr2DH1Jj7tx4qgH6khVz1HoW_8kE7y_rlkudvvybXKphF1vkSLvPaAzyp66bqbcfISFjN01CiLISj28Sbh99A72aXrDBEAGyFUniWRH7nPnKw64FY4yGK7_HqZN5InCILmg2TRDUJKhlz6tDI4s Oct 22 20:55:23.102978 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 20:55:23.102978 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 20:55:23.102978 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 20:55:23.102978 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 20:55:23.102978 ncdv-master-1 devstack@n-api.service[138744]: X-Openstack-Nova-Api-Version: 2.25 Oct 22 20:55:23.102978 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 20:55:23.102978 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 20:55:23.102978 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: 11060bbcab6b45cabb1457319d72b982 Oct 22 20:55:23.102978 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1332499062 Oct 22 20:55:23.102978 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 20:55:23.102978 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 20:55:23.102978 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_11060bbcab6b45cabb1457319d72b982"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/11060bbcab6b45cabb1457319d72b982"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/11060bbcab6b45cabb1457319d72b982"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/11060bbcab6b45cabb1457319d72b982"}]}] Oct 22 20:55:23.102978 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1332499062 Oct 22 20:55:23.102978 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: 11060bbcab6b45cabb1457319d72b982 Oct 22 20:55:23.102978 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1332499062 Oct 22 20:55:23.102978 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-LiveAutoBlockMigrationV225Test-1332499062-project Oct 22 20:55:23.102978 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 20:55:23.102978 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 20:55:23.102978 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: 93c41b7be1724632b0d6bd2bd3b57f8f Oct 22 20:55:23.102978 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1332499062-project Oct 22 20:55:23.102978 ncdv-master-1 devstack@n-api.service[138744]: method: > Oct 22 20:55:23.102978 ncdv-master-1 devstack@n-api.service[138744]: exception: Instance 4c7b99a9-2ec4-4f4b-98e7-8e1ea2103735 could not be found. Oct 22 20:55:23.102978 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': '4c7b99a9-2ec4-4f4b-98e7-8e1ea2103735'} Oct 22 20:55:23.102978 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:55:23.102978 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:55:23.102978 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 20:55:23.102978 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 20:55:23.102978 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 20:55:23.102978 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 20:55:23.102978 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 20:55:23.102978 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 20:55:23.102978 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 20:55:23.102978 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 20:55:23.102978 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c7b99a9-2ec4-4f4b-98e7-8e1ea2103735 could not be found. Oct 22 20:55:23.102978 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:55:23.102978 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:55:23.102978 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:55:23.102978 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:55:23.102978 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:55:23.102978 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:55:23.102978 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:55:23.102978 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:55:23.102978 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:55:23.102978 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:55:23.102978 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 20:55:23.102978 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 20:55:23.102978 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 20:55:23.102978 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 20:55:23.102978 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 20:55:23.102978 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 20:55:23.102978 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c7b99a9-2ec4-4f4b-98e7-8e1ea2103735 could not be found. Oct 22 20:55:23.102978 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:55:23.107432 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:55:23.107432 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:55:23.107432 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:55:23.107432 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:55:23.107432 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:55:23.107432 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 20:55:23.107432 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 20:55:23.107432 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c7b99a9-2ec4-4f4b-98e7-8e1ea2103735 could not be found. Oct 22 20:55:23.107432 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:55:23.109881 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-ff2e8c35-e974-44ca-889f-8160836f3d2b tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Returning 404 to user: Instance 4c7b99a9-2ec4-4f4b-98e7-8e1ea2103735 could not be found. {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:55:23.110961 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-ff2e8c35-e974-44ca-889f-8160836f3d2b tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] 10.222.0.18 "GET /compute/v2.1/servers/4c7b99a9-2ec4-4f4b-98e7-8e1ea2103735" status: 404 len: 111 microversion: 2.25 time: 0.053730 Oct 22 20:55:23.111326 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 762/1590] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 20:55:23 2022] GET /compute/v2.1/servers/4c7b99a9-2ec4-4f4b-98e7-8e1ea2103735 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 22 20:55:23.117344 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-05f56bbc-ca80-43f8-be43-c67d6405daf8 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:55:23.118134 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-05f56bbc-ca80-43f8-be43-c67d6405daf8 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] [instance: c2cedf74-885c-404c-b12f-9b7f7d15734c] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:55:23.127408 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-05f56bbc-ca80-43f8-be43-c67d6405daf8 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:23.128219 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-05f56bbc-ca80-43f8-be43-c67d6405daf8 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:23.128833 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-05f56bbc-ca80-43f8-be43-c67d6405daf8 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:23.129989 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-05f56bbc-ca80-43f8-be43-c67d6405daf8 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:23.130601 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-05f56bbc-ca80-43f8-be43-c67d6405daf8 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:23.131185 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-05f56bbc-ca80-43f8-be43-c67d6405daf8 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:23.541187 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-05f56bbc-ca80-43f8-be43-c67d6405daf8 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b638db630404ebbbcc2253db30844c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cc7342bf7941d2ad7ebc70032dd52e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:55:23.557025 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-05f56bbc-ca80-43f8-be43-c67d6405daf8 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] 10.222.0.18 "GET /compute/v2.1/servers/c2cedf74-885c-404c-b12f-9b7f7d15734c" status: 200 len: 1507 microversion: 2.1 time: 0.444418 Oct 22 20:55:23.558884 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 763/1591] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:55:23 2022] GET /compute/v2.1/servers/c2cedf74-885c-404c-b12f-9b7f7d15734c => generated 1507 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:55:23.567585 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-34345d61-0f34-4261-849c-9d7f83e05466 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:55:23.568537 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-34345d61-0f34-4261-849c-9d7f83e05466 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] [instance: a64fa89e-32f6-4994-a0b2-3788cf1c92ec] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:55:23.580497 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-34345d61-0f34-4261-849c-9d7f83e05466 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:23.581250 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-34345d61-0f34-4261-849c-9d7f83e05466 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:23.582079 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-34345d61-0f34-4261-849c-9d7f83e05466 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:23.583009 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-34345d61-0f34-4261-849c-9d7f83e05466 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:23.583880 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-34345d61-0f34-4261-849c-9d7f83e05466 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:23.584509 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-34345d61-0f34-4261-849c-9d7f83e05466 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:23.652261 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-efface9f-ee4c-4706-ab59-ee2188bd894f tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] 10.222.0.18 "POST /compute/v2.1/servers/fbb34507-cef9-4d78-9ed7-5d6eab4ca806/action" status: 202 len: 0 microversion: 2.1 time: 2.775480 Oct 22 20:55:23.654134 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 829/1592] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 20:55:20 2022] POST /compute/v2.1/servers/fbb34507-cef9-4d78-9ed7-5d6eab4ca806/action => generated 0 bytes in 2794 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 20:55:23.662431 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-608f51c0-fe7c-404e-b31e-96866db8bcf1 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Calling method '.version_select at 0x7fd39fd7b0d0>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:55:23.721022 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-608f51c0-fe7c-404e-b31e-96866db8bcf1 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-250920229" status: 204 len: 0 microversion: 2.25 time: 0.065250 Oct 22 20:55:23.726927 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 830/1593] 10.222.0.18 () {60 vars in 1259 bytes} [Sat Oct 22 20:55:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-250920229 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 22 20:55:23.738587 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-20e7887a-6ea0-4b36-89fa-49e6204f66b7 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:55:23.743583 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-20e7887a-6ea0-4b36-89fa-49e6204f66b7 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] [instance: 532d6e6a-71ab-4ef0-a5bf-c042055c5121] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:55:23.773228 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-20e7887a-6ea0-4b36-89fa-49e6204f66b7 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:23.773806 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-20e7887a-6ea0-4b36-89fa-49e6204f66b7 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:23.774260 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-20e7887a-6ea0-4b36-89fa-49e6204f66b7 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:23.775018 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-20e7887a-6ea0-4b36-89fa-49e6204f66b7 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:23.775986 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-20e7887a-6ea0-4b36-89fa-49e6204f66b7 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:23.776139 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-20e7887a-6ea0-4b36-89fa-49e6204f66b7 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:24.026292 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-34345d61-0f34-4261-849c-9d7f83e05466 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b392ad1fe1fd4b2a9e6be03a7435deb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594624ed28aa433d907c8833d360b82e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:55:24.049554 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-34345d61-0f34-4261-849c-9d7f83e05466 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] 10.222.0.18 "GET /compute/v2.1/servers/a64fa89e-32f6-4994-a0b2-3788cf1c92ec" status: 200 len: 1324 microversion: 2.1 time: 0.486528 Oct 22 20:55:24.051574 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 764/1594] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:55:23 2022] GET /compute/v2.1/servers/a64fa89e-32f6-4994-a0b2-3788cf1c92ec => generated 1324 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:55:24.082360 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-9509c630-2507-42bb-810f-14c46bcd263e tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:55:24.083252 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-9509c630-2507-42bb-810f-14c46bcd263e tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] [instance: 0e92c2df-261e-44fd-b584-2f870190e8ce] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:55:24.104341 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-20e7887a-6ea0-4b36-89fa-49e6204f66b7 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be93cabff0d46ccb2a3db0db1a13796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42111ed6bcc3465d8c1f5291da248e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:55:24.109599 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9509c630-2507-42bb-810f-14c46bcd263e tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:24.110239 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9509c630-2507-42bb-810f-14c46bcd263e tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:24.110727 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9509c630-2507-42bb-810f-14c46bcd263e tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:24.111932 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9509c630-2507-42bb-810f-14c46bcd263e tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:24.113210 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9509c630-2507-42bb-810f-14c46bcd263e tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:24.113989 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9509c630-2507-42bb-810f-14c46bcd263e tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:24.117177 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-20e7887a-6ea0-4b36-89fa-49e6204f66b7 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] 10.222.0.18 "GET /compute/v2.1/servers/532d6e6a-71ab-4ef0-a5bf-c042055c5121" status: 200 len: 1324 microversion: 2.1 time: 0.387264 Oct 22 20:55:24.118107 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 831/1595] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:55:23 2022] GET /compute/v2.1/servers/532d6e6a-71ab-4ef0-a5bf-c042055c5121 => generated 1324 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:55:24.145479 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-30754031-4221-40fe-b0df-7e7cd81ae6e8 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:55:24.146163 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-30754031-4221-40fe-b0df-7e7cd81ae6e8 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] [instance: c2cedf74-885c-404c-b12f-9b7f7d15734c] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:55:24.155260 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-9509c630-2507-42bb-810f-14c46bcd263e tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] HTTP exception thrown: Instance 0e92c2df-261e-44fd-b584-2f870190e8ce could not be found. Oct 22 20:55:24.162826 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-9509c630-2507-42bb-810f-14c46bcd263e tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Request method failure captured: Oct 22 20:55:24.162826 ncdv-master-1 devstack@n-api.service[138744]: request: GET /compute/v2.1/servers/0e92c2df-261e-44fd-b584-2f870190e8ce HTTP/1.1 Oct 22 20:55:24.162826 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 20:55:24.162826 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 20:55:24.162826 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 20:55:24.162826 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 0 Oct 22 20:55:24.162826 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 20:55:24.162826 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 20:55:24.162826 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 20:55:24.162826 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 20:55:24.162826 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVFgxbjSpGJnDbAWtrhnhC3ohqhWL21P8V9oDjyt8Cp6-mNYigmWbnwACLhgZ0m-_WayZUZqCvLsIuxozONgEQsFKqbQFe3bHeuZuSmUq3cgCyl657QToCeJnxSAksP09Z2EUvKIoF_d3xV0V1EMSYGQaEwV-nD-C00mu8qSleDqsp7Y Oct 22 20:55:24.162826 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 20:55:24.162826 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 20:55:24.162826 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 20:55:24.162826 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 20:55:24.162826 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 20:55:24.162826 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 20:55:24.162826 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: 6bacf9909082440f8a201771b64a75fa Oct 22 20:55:24.162826 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-ServersTestMultiNic-712697786 Oct 22 20:55:24.162826 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 20:55:24.162826 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 20:55:24.162826 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_6bacf9909082440f8a201771b64a75fa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6bacf9909082440f8a201771b64a75fa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/6bacf9909082440f8a201771b64a75fa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6bacf9909082440f8a201771b64a75fa"}]}] Oct 22 20:55:24.162826 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-ServersTestMultiNic-712697786 Oct 22 20:55:24.162826 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: 6bacf9909082440f8a201771b64a75fa Oct 22 20:55:24.162826 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-ServersTestMultiNic-712697786 Oct 22 20:55:24.162826 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-ServersTestMultiNic-712697786-project Oct 22 20:55:24.162826 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 20:55:24.162826 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 20:55:24.162826 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: c7f48d18691d4473bbe0284c44f14d09 Oct 22 20:55:24.162826 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-ServersTestMultiNic-712697786-project Oct 22 20:55:24.162826 ncdv-master-1 devstack@n-api.service[138744]: method: > Oct 22 20:55:24.162826 ncdv-master-1 devstack@n-api.service[138744]: exception: Instance 0e92c2df-261e-44fd-b584-2f870190e8ce could not be found. Oct 22 20:55:24.162826 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': '0e92c2df-261e-44fd-b584-2f870190e8ce'} Oct 22 20:55:24.162826 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:55:24.162826 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:55:24.162826 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 20:55:24.162826 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 20:55:24.162826 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 20:55:24.162826 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 20:55:24.162826 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 20:55:24.162826 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 20:55:24.162826 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 20:55:24.162826 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 20:55:24.162826 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e92c2df-261e-44fd-b584-2f870190e8ce could not be found. Oct 22 20:55:24.162826 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:55:24.162826 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:55:24.162826 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:55:24.162826 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:55:24.162826 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:55:24.162826 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:55:24.162826 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:55:24.162826 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:55:24.162826 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:55:24.162826 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:55:24.162826 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 20:55:24.162826 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 20:55:24.162826 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 20:55:24.162826 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 20:55:24.162826 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 20:55:24.162826 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 20:55:24.162826 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e92c2df-261e-44fd-b584-2f870190e8ce could not be found. Oct 22 20:55:24.162826 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:55:24.162826 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:55:24.162826 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:55:24.168318 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:55:24.168318 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:55:24.168318 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:55:24.168318 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 20:55:24.168318 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 20:55:24.168318 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e92c2df-261e-44fd-b584-2f870190e8ce could not be found. Oct 22 20:55:24.168318 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:55:24.168870 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-30754031-4221-40fe-b0df-7e7cd81ae6e8 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:24.170599 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-30754031-4221-40fe-b0df-7e7cd81ae6e8 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:24.171060 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-30754031-4221-40fe-b0df-7e7cd81ae6e8 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:24.173376 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-9509c630-2507-42bb-810f-14c46bcd263e tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Returning 404 to user: Instance 0e92c2df-261e-44fd-b584-2f870190e8ce could not be found. {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:55:24.176921 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-9509c630-2507-42bb-810f-14c46bcd263e tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] 10.222.0.18 "GET /compute/v2.1/servers/0e92c2df-261e-44fd-b584-2f870190e8ce" status: 404 len: 111 microversion: 2.1 time: 0.122331 Oct 22 20:55:24.179244 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 765/1596] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:55:24 2022] GET /compute/v2.1/servers/0e92c2df-261e-44fd-b584-2f870190e8ce => generated 111 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 20:55:24.182497 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-30754031-4221-40fe-b0df-7e7cd81ae6e8 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:24.185972 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-30754031-4221-40fe-b0df-7e7cd81ae6e8 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:24.186645 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-30754031-4221-40fe-b0df-7e7cd81ae6e8 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:24.191202 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-2ed08978-a6ee-445b-a69f-19db88f49ec4 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:55:24.192044 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-2ed08978-a6ee-445b-a69f-19db88f49ec4 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] [instance: fbb34507-cef9-4d78-9ed7-5d6eab4ca806] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:55:24.198618 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2ed08978-a6ee-445b-a69f-19db88f49ec4 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:24.200028 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2ed08978-a6ee-445b-a69f-19db88f49ec4 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:24.200648 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2ed08978-a6ee-445b-a69f-19db88f49ec4 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:24.201378 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2ed08978-a6ee-445b-a69f-19db88f49ec4 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:24.201831 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2ed08978-a6ee-445b-a69f-19db88f49ec4 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:24.202262 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2ed08978-a6ee-445b-a69f-19db88f49ec4 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:24.226673 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-30754031-4221-40fe-b0df-7e7cd81ae6e8 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] [instance: c2cedf74-885c-404c-b12f-9b7f7d15734c] Going to try to terminate instance {{(pid=138745) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 20:55:24.336165 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-30754031-4221-40fe-b0df-7e7cd81ae6e8 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] 10.222.0.18 "DELETE /compute/v2.1/servers/c2cedf74-885c-404c-b12f-9b7f7d15734c" status: 204 len: 0 microversion: 2.1 time: 0.203326 Oct 22 20:55:24.337975 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 832/1597] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 20:55:24 2022] DELETE /compute/v2.1/servers/c2cedf74-885c-404c-b12f-9b7f7d15734c => generated 0 bytes in 209 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 20:55:24.349972 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-7fabe89f-a7d8-43ed-9801-0f8bf01df737 req-b391a709-6dd3-473d-9eaa-da6cda8c3095 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "532d6e6a-71ab-4ef0-a5bf-c042055c5121", "name": "network-vif-plugged", "status": "completed", "tag": "7c68227f-68b8-459e-8cf6-9b169351d597"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:55:24.370260 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-7fabe89f-a7d8-43ed-9801-0f8bf01df737 req-b391a709-6dd3-473d-9eaa-da6cda8c3095 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:24.370767 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-7fabe89f-a7d8-43ed-9801-0f8bf01df737 req-b391a709-6dd3-473d-9eaa-da6cda8c3095 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:24.371489 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-7fabe89f-a7d8-43ed-9801-0f8bf01df737 req-b391a709-6dd3-473d-9eaa-da6cda8c3095 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:24.386419 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-7fabe89f-a7d8-43ed-9801-0f8bf01df737 req-b391a709-6dd3-473d-9eaa-da6cda8c3095 service nova] Creating event network-vif-plugged:7c68227f-68b8-459e-8cf6-9b169351d597 for instance 532d6e6a-71ab-4ef0-a5bf-c042055c5121 on nch1-master-1 Oct 22 20:55:24.393168 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-7fabe89f-a7d8-43ed-9801-0f8bf01df737 req-b391a709-6dd3-473d-9eaa-da6cda8c3095 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052465 Oct 22 20:55:24.394149 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 833/1598] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:55:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:55:24.408164 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-316d747f-3da7-46ec-be14-1a75218105df tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:55:24.411112 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-316d747f-3da7-46ec-be14-1a75218105df tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] [instance: 40e6c6e3-3d47-4781-b8a8-aafd671d7287] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:55:24.422182 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-316d747f-3da7-46ec-be14-1a75218105df tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:24.423575 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-316d747f-3da7-46ec-be14-1a75218105df tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:24.425351 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-316d747f-3da7-46ec-be14-1a75218105df tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:24.444635 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-316d747f-3da7-46ec-be14-1a75218105df tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:24.445565 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-316d747f-3da7-46ec-be14-1a75218105df tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:24.447101 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-316d747f-3da7-46ec-be14-1a75218105df tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:24.463249 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-2ed08978-a6ee-445b-a69f-19db88f49ec4 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c87f0356ca346f39c6216393d85da2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee8c8f7fc4e12bc1f9fcce3e7b581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:55:24.476806 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-2ed08978-a6ee-445b-a69f-19db88f49ec4 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] 10.222.0.18 "GET /compute/v2.1/servers/fbb34507-cef9-4d78-9ed7-5d6eab4ca806" status: 200 len: 1392 microversion: 2.1 time: 0.293657 Oct 22 20:55:24.492569 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 766/1599] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:55:24 2022] GET /compute/v2.1/servers/fbb34507-cef9-4d78-9ed7-5d6eab4ca806 => generated 1392 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:55:24.501192 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-2504e2fb-ce9e-4863-8b67-d7d6897c6bb9 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:55:24.502542 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-2504e2fb-ce9e-4863-8b67-d7d6897c6bb9 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] [instance: 04d927bb-da77-4ca1-a828-562a01f07892] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:55:24.509575 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2504e2fb-ce9e-4863-8b67-d7d6897c6bb9 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:24.510956 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2504e2fb-ce9e-4863-8b67-d7d6897c6bb9 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:24.511621 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2504e2fb-ce9e-4863-8b67-d7d6897c6bb9 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:24.513026 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2504e2fb-ce9e-4863-8b67-d7d6897c6bb9 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:24.513800 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2504e2fb-ce9e-4863-8b67-d7d6897c6bb9 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:24.514419 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2504e2fb-ce9e-4863-8b67-d7d6897c6bb9 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:24.549273 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-2504e2fb-ce9e-4863-8b67-d7d6897c6bb9 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] [instance: 04d927bb-da77-4ca1-a828-562a01f07892] Going to try to terminate instance {{(pid=138744) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 20:55:24.671005 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-2504e2fb-ce9e-4863-8b67-d7d6897c6bb9 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] 10.222.0.18 "DELETE /compute/v2.1/servers/04d927bb-da77-4ca1-a828-562a01f07892" status: 204 len: 0 microversion: 2.1 time: 0.176233 Oct 22 20:55:24.684646 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 767/1600] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 20:55:24 2022] DELETE /compute/v2.1/servers/04d927bb-da77-4ca1-a828-562a01f07892 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 20:55:24.825909 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-0a5dbd09-7027-441a-befb-280f00fd0fdb tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateTestJSON-server-1508563206", "imageRef": "085e4478-6edc-4a69-8e08-f9831713eb65", "flavorRef": "452", "min_count": 1, "max_count": 2, "return_reservation_id": true, "networks": [{"uuid": "0bf7b42c-fe4f-4b88-ab34-fdd96f4baf2a"}]}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:55:24.867783 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-316d747f-3da7-46ec-be14-1a75218105df tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d3d7458af447bdb3f03e83a2d8559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49238b8686d24ae698679e4a1957735d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:55:24.882440 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-316d747f-3da7-46ec-be14-1a75218105df tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] 10.222.0.18 "GET /compute/v2.1/servers/40e6c6e3-3d47-4781-b8a8-aafd671d7287" status: 200 len: 1463 microversion: 2.1 time: 0.486054 Oct 22 20:55:24.883203 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 834/1601] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:55:24 2022] GET /compute/v2.1/servers/40e6c6e3-3d47-4781-b8a8-aafd671d7287 => generated 1463 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:55:24.897878 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.network.neutron [None req-0a5dbd09-7027-441a-befb-280f00fd0fdb tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] validate_networks() for [('0bf7b42c-fe4f-4b88-ab34-fdd96f4baf2a', None, None, None, None, None)] {{(pid=138744) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 20:55:24.912770 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-adfb0c70-fe9a-4e70-9b34-632de7b6e033 tempest-MigrationsAdminTest-1403807426 tempest-MigrationsAdminTest-1403807426-project-admin] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:55:24.913859 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-adfb0c70-fe9a-4e70-9b34-632de7b6e033 tempest-MigrationsAdminTest-1403807426 tempest-MigrationsAdminTest-1403807426-project-admin] [instance: 40e6c6e3-3d47-4781-b8a8-aafd671d7287] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:55:24.920519 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-adfb0c70-fe9a-4e70-9b34-632de7b6e033 tempest-MigrationsAdminTest-1403807426 tempest-MigrationsAdminTest-1403807426-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:24.921243 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-adfb0c70-fe9a-4e70-9b34-632de7b6e033 tempest-MigrationsAdminTest-1403807426 tempest-MigrationsAdminTest-1403807426-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:24.921678 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-adfb0c70-fe9a-4e70-9b34-632de7b6e033 tempest-MigrationsAdminTest-1403807426 tempest-MigrationsAdminTest-1403807426-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:24.922389 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-adfb0c70-fe9a-4e70-9b34-632de7b6e033 tempest-MigrationsAdminTest-1403807426 tempest-MigrationsAdminTest-1403807426-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:24.922839 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-adfb0c70-fe9a-4e70-9b34-632de7b6e033 tempest-MigrationsAdminTest-1403807426 tempest-MigrationsAdminTest-1403807426-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:24.923265 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-adfb0c70-fe9a-4e70-9b34-632de7b6e033 tempest-MigrationsAdminTest-1403807426 tempest-MigrationsAdminTest-1403807426-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:25.242789 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-adfb0c70-fe9a-4e70-9b34-632de7b6e033 tempest-MigrationsAdminTest-1403807426 tempest-MigrationsAdminTest-1403807426-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/40e6c6e3-3d47-4781-b8a8-aafd671d7287" status: 200 len: 1614 microversion: 2.1 time: 0.334324 Oct 22 20:55:25.244554 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 835/1602] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:55:24 2022] GET /compute/v2.1/servers/40e6c6e3-3d47-4781-b8a8-aafd671d7287 => generated 1614 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:55:25.257792 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-adfa1dff-3f46-46c7-96e4-e97a003c0ec4 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:55:25.259363 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-adfa1dff-3f46-46c7-96e4-e97a003c0ec4 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] [instance: a64fa89e-32f6-4994-a0b2-3788cf1c92ec] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:55:25.268605 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-adfa1dff-3f46-46c7-96e4-e97a003c0ec4 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:25.272085 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-adfa1dff-3f46-46c7-96e4-e97a003c0ec4 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:25.272770 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-adfa1dff-3f46-46c7-96e4-e97a003c0ec4 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:25.273321 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-adfa1dff-3f46-46c7-96e4-e97a003c0ec4 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:25.273793 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-adfa1dff-3f46-46c7-96e4-e97a003c0ec4 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:25.274218 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-adfa1dff-3f46-46c7-96e4-e97a003c0ec4 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:25.282789 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell1:UPDATE=4,nova_cell1:SELECT=93,nova_cell1:INSERT=3 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:55:25.562400 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-adfa1dff-3f46-46c7-96e4-e97a003c0ec4 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b392ad1fe1fd4b2a9e6be03a7435deb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594624ed28aa433d907c8833d360b82e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:55:25.579291 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-adfa1dff-3f46-46c7-96e4-e97a003c0ec4 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] 10.222.0.18 "GET /compute/v2.1/servers/a64fa89e-32f6-4994-a0b2-3788cf1c92ec" status: 200 len: 1324 microversion: 2.1 time: 0.332542 Oct 22 20:55:25.580153 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 836/1603] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:55:25 2022] GET /compute/v2.1/servers/a64fa89e-32f6-4994-a0b2-3788cf1c92ec => generated 1324 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:55:25.597689 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-ab4e77fc-85a9-40e5-8ca6-99c676562810 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:55:25.606231 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-ab4e77fc-85a9-40e5-8ca6-99c676562810 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] [instance: 532d6e6a-71ab-4ef0-a5bf-c042055c5121] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:55:25.624372 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ab4e77fc-85a9-40e5-8ca6-99c676562810 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:25.624875 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ab4e77fc-85a9-40e5-8ca6-99c676562810 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:25.625323 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ab4e77fc-85a9-40e5-8ca6-99c676562810 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:25.626050 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ab4e77fc-85a9-40e5-8ca6-99c676562810 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:25.626506 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ab4e77fc-85a9-40e5-8ca6-99c676562810 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:25.626937 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ab4e77fc-85a9-40e5-8ca6-99c676562810 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:25.836172 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-0a5dbd09-7027-441a-befb-280f00fd0fdb tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Flavor limits 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 20:55:25.838722 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-0a5dbd09-7027-441a-befb-280f00fd0fdb tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Image limits 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 20:55:25.839216 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-0a5dbd09-7027-441a-befb-280f00fd0fdb tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Flavor pref 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 20:55:25.839803 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-0a5dbd09-7027-441a-befb-280f00fd0fdb tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Image pref 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 20:55:25.840189 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-0a5dbd09-7027-441a-befb-280f00fd0fdb tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 20:55:25.850645 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0a5dbd09-7027-441a-befb-280f00fd0fdb tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:25.851868 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0a5dbd09-7027-441a-befb-280f00fd0fdb tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:25.852509 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0a5dbd09-7027-441a-befb-280f00fd0fdb tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:25.853478 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0a5dbd09-7027-441a-befb-280f00fd0fdb tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:25.854106 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0a5dbd09-7027-441a-befb-280f00fd0fdb tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:25.854749 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0a5dbd09-7027-441a-befb-280f00fd0fdb tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:25.873390 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:55:25.879333 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-0a5dbd09-7027-441a-befb-280f00fd0fdb tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Getting quotas for project a4cc7342bf7941d2ad7ebc70032dd52e. Resources: {'cores', 'instances', 'ram'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 20:55:25.886462 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-0a5dbd09-7027-441a-befb-280f00fd0fdb tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Getting quotas for user 1b638db630404ebbbcc2253db30844c5 and project a4cc7342bf7941d2ad7ebc70032dd52e. Resources: {'cores', 'instances', 'ram'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 20:55:25.902363 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-0a5dbd09-7027-441a-befb-280f00fd0fdb tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Going to run 2 instances... {{(pid=138744) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 20:55:25.903918 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-ab4e77fc-85a9-40e5-8ca6-99c676562810 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be93cabff0d46ccb2a3db0db1a13796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42111ed6bcc3465d8c1f5291da248e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:55:25.905689 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-0a5dbd09-7027-441a-befb-280f00fd0fdb tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] [instance: 73404cab-dc0f-4f1c-b38b-a1505a5dc8b2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='085e4478-6edc-4a69-8e08-f9831713eb65',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138744) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 20:55:25.917511 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-ab4e77fc-85a9-40e5-8ca6-99c676562810 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] 10.222.0.18 "GET /compute/v2.1/servers/532d6e6a-71ab-4ef0-a5bf-c042055c5121" status: 200 len: 1324 microversion: 2.1 time: 0.334631 Oct 22 20:55:25.918894 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 837/1604] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:55:25 2022] GET /compute/v2.1/servers/532d6e6a-71ab-4ef0-a5bf-c042055c5121 => generated 1324 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:55:25.924703 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-d4632cef-f791-414b-950d-c2a6a3ccede7 tempest-MigrationsAdminTest-1403807426 tempest-MigrationsAdminTest-1403807426-project-admin] Calling method '.version_select at 0x7fd39fd4a940>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:55:25.929476 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d4632cef-f791-414b-950d-c2a6a3ccede7 tempest-MigrationsAdminTest-1403807426 tempest-MigrationsAdminTest-1403807426-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:25.930973 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d4632cef-f791-414b-950d-c2a6a3ccede7 tempest-MigrationsAdminTest-1403807426 tempest-MigrationsAdminTest-1403807426-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:25.931851 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d4632cef-f791-414b-950d-c2a6a3ccede7 tempest-MigrationsAdminTest-1403807426 tempest-MigrationsAdminTest-1403807426-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:25.947391 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-d4632cef-f791-414b-950d-c2a6a3ccede7 tempest-MigrationsAdminTest-1403807426 tempest-MigrationsAdminTest-1403807426-project-admin] 10.222.0.18 "GET /compute/v2.1/os-migrations" status: 200 len: 2713 microversion: 2.1 time: 0.027016 Oct 22 20:55:25.949202 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 838/1605] 10.222.0.18 () {58 vars in 1143 bytes} [Sat Oct 22 20:55:25 2022] GET /compute/v2.1/os-migrations => generated 2713 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:55:25.964383 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-b17f9c8f-67d3-48de-868d-93e5e7d1fe76 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:55:25.965823 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-b17f9c8f-67d3-48de-868d-93e5e7d1fe76 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] [instance: 254dfdd3-3716-43cf-aadc-f678aff08d27] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:55:25.982380 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-0a5dbd09-7027-441a-befb-280f00fd0fdb tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] [instance: bccbf2b3-70e3-406d-b844-e48d765732cf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='085e4478-6edc-4a69-8e08-f9831713eb65',instance=,instance_uuid=73404cab-dc0f-4f1c-b38b-a1505a5dc8b2,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138744) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 20:55:25.984314 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b17f9c8f-67d3-48de-868d-93e5e7d1fe76 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:25.984821 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b17f9c8f-67d3-48de-868d-93e5e7d1fe76 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:25.985269 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b17f9c8f-67d3-48de-868d-93e5e7d1fe76 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:25.988263 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b17f9c8f-67d3-48de-868d-93e5e7d1fe76 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:25.991886 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b17f9c8f-67d3-48de-868d-93e5e7d1fe76 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:25.992615 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b17f9c8f-67d3-48de-868d-93e5e7d1fe76 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:26.032999 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-b17f9c8f-67d3-48de-868d-93e5e7d1fe76 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] [instance: 254dfdd3-3716-43cf-aadc-f678aff08d27] Going to try to terminate instance {{(pid=138745) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 20:55:26.082506 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-0a5dbd09-7027-441a-befb-280f00fd0fdb tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.260962 Oct 22 20:55:26.083380 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 768/1606] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Oct 22 20:55:24 2022] POST /compute/v2.1/servers => generated 32 bytes in 1263 msecs (HTTP/1.1 202) 9 headers in 362 bytes (2 switches on core 0) Oct 22 20:55:26.163643 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-b17f9c8f-67d3-48de-868d-93e5e7d1fe76 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] 10.222.0.18 "DELETE /compute/v2.1/servers/254dfdd3-3716-43cf-aadc-f678aff08d27" status: 204 len: 0 microversion: 2.25 time: 0.212238 Oct 22 20:55:26.166695 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 839/1607] 10.222.0.18 () {60 vars in 1280 bytes} [Sat Oct 22 20:55:25 2022] DELETE /compute/v2.1/servers/254dfdd3-3716-43cf-aadc-f678aff08d27 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 22 20:55:26.174474 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-512321e4-e501-4950-b4bc-1ee8df3d31f1 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:55:26.180887 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-512321e4-e501-4950-b4bc-1ee8df3d31f1 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1b638db630404ebbbcc2253db30844c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cc7342bf7941d2ad7ebc70032dd52e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:55:26.181944 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-512321e4-e501-4950-b4bc-1ee8df3d31f1 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Searching by: {'deleted': False, 'project_id': 'a4cc7342bf7941d2ad7ebc70032dd52e'} {{(pid=138745) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 22 20:55:26.201118 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-512321e4-e501-4950-b4bc-1ee8df3d31f1 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:26.204407 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-512321e4-e501-4950-b4bc-1ee8df3d31f1 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:26.206341 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-512321e4-e501-4950-b4bc-1ee8df3d31f1 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:26.207497 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-512321e4-e501-4950-b4bc-1ee8df3d31f1 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:26.208438 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-512321e4-e501-4950-b4bc-1ee8df3d31f1 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:26.209047 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-512321e4-e501-4950-b4bc-1ee8df3d31f1 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:26.245797 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.multi_cell_list [None req-512321e4-e501-4950-b4bc-1ee8df3d31f1 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Listed batch of 2 results from cell out of 998 limit. Returned 2 total so far. {{(pid=138745) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 22 20:55:26.278403 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-512321e4-e501-4950-b4bc-1ee8df3d31f1 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] 10.222.0.18 "GET /compute/v2.1/servers" status: 200 len: 1335 microversion: 2.1 time: 0.110283 Oct 22 20:55:26.279332 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 840/1608] 10.222.0.18 () {58 vars in 1125 bytes} [Sat Oct 22 20:55:26 2022] GET /compute/v2.1/servers => generated 1335 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:55:26.293958 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-1f6edb03-7136-4a38-82c3-5ab25f57474a tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-910376235", "imageRef": "085e4478-6edc-4a69-8e08-f9831713eb65", "flavorRef": "452"}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:55:26.378818 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.network.neutron [None req-1f6edb03-7136-4a38-82c3-5ab25f57474a tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] validate_networks() for None {{(pid=138745) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 20:55:26.574730 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-615eec83-bcbe-4f2c-9690-60bc4a40bb43 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:55:26.575376 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-615eec83-bcbe-4f2c-9690-60bc4a40bb43 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] [instance: fbb34507-cef9-4d78-9ed7-5d6eab4ca806] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:55:26.582816 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-615eec83-bcbe-4f2c-9690-60bc4a40bb43 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:26.596081 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-615eec83-bcbe-4f2c-9690-60bc4a40bb43 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:26.596538 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-615eec83-bcbe-4f2c-9690-60bc4a40bb43 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:26.597335 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-615eec83-bcbe-4f2c-9690-60bc4a40bb43 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:26.597790 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-615eec83-bcbe-4f2c-9690-60bc4a40bb43 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:26.598390 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-615eec83-bcbe-4f2c-9690-60bc4a40bb43 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:27.123050 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-615eec83-bcbe-4f2c-9690-60bc4a40bb43 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c87f0356ca346f39c6216393d85da2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee8c8f7fc4e12bc1f9fcce3e7b581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:55:27.135243 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-615eec83-bcbe-4f2c-9690-60bc4a40bb43 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] 10.222.0.18 "GET /compute/v2.1/servers/fbb34507-cef9-4d78-9ed7-5d6eab4ca806" status: 200 len: 1392 microversion: 2.1 time: 1.048908 Oct 22 20:55:27.135900 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 769/1609] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:55:26 2022] GET /compute/v2.1/servers/fbb34507-cef9-4d78-9ed7-5d6eab4ca806 => generated 1392 bytes in 1052 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:55:27.151151 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-7c051cf3-c5e4-4527-a54a-7afe5a452196 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:55:27.151816 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-7c051cf3-c5e4-4527-a54a-7afe5a452196 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] [instance: 254dfdd3-3716-43cf-aadc-f678aff08d27] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:55:27.161859 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7c051cf3-c5e4-4527-a54a-7afe5a452196 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:27.162364 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7c051cf3-c5e4-4527-a54a-7afe5a452196 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:27.162807 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7c051cf3-c5e4-4527-a54a-7afe5a452196 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:27.163569 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7c051cf3-c5e4-4527-a54a-7afe5a452196 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:27.164027 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7c051cf3-c5e4-4527-a54a-7afe5a452196 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:27.164456 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7c051cf3-c5e4-4527-a54a-7afe5a452196 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:27.933001 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-1f6edb03-7136-4a38-82c3-5ab25f57474a tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Flavor limits 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 20:55:27.934752 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-1f6edb03-7136-4a38-82c3-5ab25f57474a tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Image limits 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 20:55:27.935604 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-1f6edb03-7136-4a38-82c3-5ab25f57474a tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Flavor pref 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 20:55:27.936235 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-1f6edb03-7136-4a38-82c3-5ab25f57474a tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Image pref 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 20:55:27.936857 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-1f6edb03-7136-4a38-82c3-5ab25f57474a tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 20:55:27.959367 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1f6edb03-7136-4a38-82c3-5ab25f57474a tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:27.962440 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1f6edb03-7136-4a38-82c3-5ab25f57474a tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:27.963111 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1f6edb03-7136-4a38-82c3-5ab25f57474a tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:27.965278 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1f6edb03-7136-4a38-82c3-5ab25f57474a tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:27.966485 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1f6edb03-7136-4a38-82c3-5ab25f57474a tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:27.969912 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1f6edb03-7136-4a38-82c3-5ab25f57474a tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:28.052489 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-1f6edb03-7136-4a38-82c3-5ab25f57474a tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Getting quotas for project 49238b8686d24ae698679e4a1957735d. Resources: {'cores', 'instances', 'ram'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 20:55:28.067403 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-1f6edb03-7136-4a38-82c3-5ab25f57474a tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Getting quotas for user e0d3d7458af447bdb3f03e83a2d8559f and project 49238b8686d24ae698679e4a1957735d. Resources: {'cores', 'instances', 'ram'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 20:55:28.087467 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-1f6edb03-7136-4a38-82c3-5ab25f57474a tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Going to run 1 instances... {{(pid=138745) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 20:55:28.091001 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-1f6edb03-7136-4a38-82c3-5ab25f57474a tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] [instance: 98f48cb1-54ed-4e82-8a25-fd004ddb5758] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='085e4478-6edc-4a69-8e08-f9831713eb65',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138745) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 20:55:28.199143 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-7c051cf3-c5e4-4527-a54a-7afe5a452196 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:55:28.203126 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-1f6edb03-7136-4a38-82c3-5ab25f57474a tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.922359 Oct 22 20:55:28.204437 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 841/1610] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Oct 22 20:55:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 1924 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 20:55:28.211413 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-22b5da69-664b-4657-91fc-23569f7e7f81 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:55:28.212741 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-22b5da69-664b-4657-91fc-23569f7e7f81 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] [instance: bccbf2b3-70e3-406d-b844-e48d765732cf] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:55:28.219910 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-7c051cf3-c5e4-4527-a54a-7afe5a452196 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:55:28.224455 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-22b5da69-664b-4657-91fc-23569f7e7f81 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:28.225247 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-22b5da69-664b-4657-91fc-23569f7e7f81 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:28.226074 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-22b5da69-664b-4657-91fc-23569f7e7f81 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:28.227872 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-22b5da69-664b-4657-91fc-23569f7e7f81 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:28.228958 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-22b5da69-664b-4657-91fc-23569f7e7f81 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:28.230112 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-7c051cf3-c5e4-4527-a54a-7afe5a452196 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:55:28.230581 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-22b5da69-664b-4657-91fc-23569f7e7f81 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:28.232986 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-7c051cf3-c5e4-4527-a54a-7afe5a452196 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] 10.222.0.18 "GET /compute/v2.1/servers/254dfdd3-3716-43cf-aadc-f678aff08d27" status: 200 len: 1549 microversion: 2.25 time: 1.096062 Oct 22 20:55:28.236627 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 770/1611] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 20:55:27 2022] GET /compute/v2.1/servers/254dfdd3-3716-43cf-aadc-f678aff08d27 => generated 1549 bytes in 1100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 20:55:28.266041 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-41f63651-3f5e-4c3e-a5cb-dacf8498b4d8 req-e955df08-a1d4-4544-b226-2b72f0415a8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a64fa89e-32f6-4994-a0b2-3788cf1c92ec", "name": "network-vif-plugged", "status": "completed", "tag": "e916fb42-f87f-4b20-b6b6-8abd516f5e15"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:55:28.292990 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-41f63651-3f5e-4c3e-a5cb-dacf8498b4d8 req-e955df08-a1d4-4544-b226-2b72f0415a8b service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:28.295692 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-41f63651-3f5e-4c3e-a5cb-dacf8498b4d8 req-e955df08-a1d4-4544-b226-2b72f0415a8b service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:28.296366 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-41f63651-3f5e-4c3e-a5cb-dacf8498b4d8 req-e955df08-a1d4-4544-b226-2b72f0415a8b service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:28.330364 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-41f63651-3f5e-4c3e-a5cb-dacf8498b4d8 req-e955df08-a1d4-4544-b226-2b72f0415a8b service nova] Creating event network-vif-plugged:e916fb42-f87f-4b20-b6b6-8abd516f5e15 for instance a64fa89e-32f6-4994-a0b2-3788cf1c92ec on nch2-master-1 Oct 22 20:55:28.344001 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-41f63651-3f5e-4c3e-a5cb-dacf8498b4d8 req-e955df08-a1d4-4544-b226-2b72f0415a8b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087129 Oct 22 20:55:28.346860 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 771/1612] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:55:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:55:28.378612 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-2ae10822-077c-4946-8f42-0e0e559d8e4d tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:55:28.382442 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-2ae10822-077c-4946-8f42-0e0e559d8e4d tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] [instance: a64fa89e-32f6-4994-a0b2-3788cf1c92ec] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:55:28.407531 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2ae10822-077c-4946-8f42-0e0e559d8e4d tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:28.408014 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2ae10822-077c-4946-8f42-0e0e559d8e4d tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:28.412023 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2ae10822-077c-4946-8f42-0e0e559d8e4d tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:28.414025 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2ae10822-077c-4946-8f42-0e0e559d8e4d tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:28.414709 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2ae10822-077c-4946-8f42-0e0e559d8e4d tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:28.422198 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2ae10822-077c-4946-8f42-0e0e559d8e4d tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:28.430004 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-22b5da69-664b-4657-91fc-23569f7e7f81 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b638db630404ebbbcc2253db30844c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cc7342bf7941d2ad7ebc70032dd52e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:55:28.438623 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-22b5da69-664b-4657-91fc-23569f7e7f81 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] 10.222.0.18 "GET /compute/v2.1/servers/bccbf2b3-70e3-406d-b844-e48d765732cf" status: 200 len: 1270 microversion: 2.1 time: 0.232905 Oct 22 20:55:28.458993 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 842/1613] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:55:28 2022] GET /compute/v2.1/servers/bccbf2b3-70e3-406d-b844-e48d765732cf => generated 1270 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:55:28.476712 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-962123c6-3efa-4b9a-854d-1d54926d28d9 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:55:28.484080 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-962123c6-3efa-4b9a-854d-1d54926d28d9 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] [instance: 532d6e6a-71ab-4ef0-a5bf-c042055c5121] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:55:28.502675 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-962123c6-3efa-4b9a-854d-1d54926d28d9 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:28.503365 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-962123c6-3efa-4b9a-854d-1d54926d28d9 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:28.503897 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-962123c6-3efa-4b9a-854d-1d54926d28d9 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:28.504633 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-962123c6-3efa-4b9a-854d-1d54926d28d9 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:28.505085 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-962123c6-3efa-4b9a-854d-1d54926d28d9 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:28.505624 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-962123c6-3efa-4b9a-854d-1d54926d28d9 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:29.147937 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-2ae10822-077c-4946-8f42-0e0e559d8e4d tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b392ad1fe1fd4b2a9e6be03a7435deb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594624ed28aa433d907c8833d360b82e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:55:29.169297 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-2ae10822-077c-4946-8f42-0e0e559d8e4d tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] 10.222.0.18 "GET /compute/v2.1/servers/a64fa89e-32f6-4994-a0b2-3788cf1c92ec" status: 200 len: 1324 microversion: 2.1 time: 0.817937 Oct 22 20:55:29.191783 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 772/1614] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:55:28 2022] GET /compute/v2.1/servers/a64fa89e-32f6-4994-a0b2-3788cf1c92ec => generated 1324 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:55:29.211780 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-c077e780-9c32-45f4-b145-86fe79453ee2 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:55:29.213889 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-c077e780-9c32-45f4-b145-86fe79453ee2 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] [instance: fbb34507-cef9-4d78-9ed7-5d6eab4ca806] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:55:29.231813 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c077e780-9c32-45f4-b145-86fe79453ee2 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:29.232642 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c077e780-9c32-45f4-b145-86fe79453ee2 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:29.235527 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c077e780-9c32-45f4-b145-86fe79453ee2 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:29.236584 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c077e780-9c32-45f4-b145-86fe79453ee2 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:29.237305 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c077e780-9c32-45f4-b145-86fe79453ee2 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:29.238697 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c077e780-9c32-45f4-b145-86fe79453ee2 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:30.264377 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-962123c6-3efa-4b9a-854d-1d54926d28d9 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be93cabff0d46ccb2a3db0db1a13796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42111ed6bcc3465d8c1f5291da248e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:55:30.290234 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-962123c6-3efa-4b9a-854d-1d54926d28d9 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] 10.222.0.18 "GET /compute/v2.1/servers/532d6e6a-71ab-4ef0-a5bf-c042055c5121" status: 200 len: 1520 microversion: 2.1 time: 1.819811 Oct 22 20:55:30.303369 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 843/1615] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:55:28 2022] GET /compute/v2.1/servers/532d6e6a-71ab-4ef0-a5bf-c042055c5121 => generated 1520 bytes in 1832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:55:30.303369 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-9bd1e362-ea25-43b0-b6b8-7c0a2bc1a3dd tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:55:30.303369 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-9bd1e362-ea25-43b0-b6b8-7c0a2bc1a3dd tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] [instance: 98f48cb1-54ed-4e82-8a25-fd004ddb5758] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:55:30.320857 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9bd1e362-ea25-43b0-b6b8-7c0a2bc1a3dd tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:30.324713 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9bd1e362-ea25-43b0-b6b8-7c0a2bc1a3dd tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:30.326071 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9bd1e362-ea25-43b0-b6b8-7c0a2bc1a3dd tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:30.336444 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9bd1e362-ea25-43b0-b6b8-7c0a2bc1a3dd tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:30.337076 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9bd1e362-ea25-43b0-b6b8-7c0a2bc1a3dd tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:30.338413 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9bd1e362-ea25-43b0-b6b8-7c0a2bc1a3dd tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:30.738488 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-9bd1e362-ea25-43b0-b6b8-7c0a2bc1a3dd tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d3d7458af447bdb3f03e83a2d8559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49238b8686d24ae698679e4a1957735d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:55:30.757358 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-9bd1e362-ea25-43b0-b6b8-7c0a2bc1a3dd tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] 10.222.0.18 "GET /compute/v2.1/servers/98f48cb1-54ed-4e82-8a25-fd004ddb5758" status: 200 len: 1264 microversion: 2.1 time: 0.464498 Oct 22 20:55:30.758323 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 844/1616] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:55:30 2022] GET /compute/v2.1/servers/98f48cb1-54ed-4e82-8a25-fd004ddb5758 => generated 1264 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:55:30.763042 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-894ed89b-3602-4879-81f7-e78e49a9da3b tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:55:30.763697 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-894ed89b-3602-4879-81f7-e78e49a9da3b tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] [instance: 254dfdd3-3716-43cf-aadc-f678aff08d27] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:55:30.784744 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-894ed89b-3602-4879-81f7-e78e49a9da3b tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:30.786008 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-894ed89b-3602-4879-81f7-e78e49a9da3b tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:30.787218 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-894ed89b-3602-4879-81f7-e78e49a9da3b tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:30.788406 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-894ed89b-3602-4879-81f7-e78e49a9da3b tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:30.789104 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-894ed89b-3602-4879-81f7-e78e49a9da3b tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:30.789880 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-894ed89b-3602-4879-81f7-e78e49a9da3b tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:30.795522 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-c077e780-9c32-45f4-b145-86fe79453ee2 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c87f0356ca346f39c6216393d85da2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee8c8f7fc4e12bc1f9fcce3e7b581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:55:30.804592 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-c077e780-9c32-45f4-b145-86fe79453ee2 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] 10.222.0.18 "GET /compute/v2.1/servers/fbb34507-cef9-4d78-9ed7-5d6eab4ca806" status: 200 len: 1392 microversion: 2.1 time: 1.610272 Oct 22 20:55:30.805178 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 773/1617] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:55:29 2022] GET /compute/v2.1/servers/fbb34507-cef9-4d78-9ed7-5d6eab4ca806 => generated 1392 bytes in 1612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:55:30.839913 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-674fe89b-08b1-46e9-a90e-4f4e9c8de88d tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:55:30.840740 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-674fe89b-08b1-46e9-a90e-4f4e9c8de88d tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] [instance: bccbf2b3-70e3-406d-b844-e48d765732cf] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:55:30.855679 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-674fe89b-08b1-46e9-a90e-4f4e9c8de88d tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:30.856598 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-674fe89b-08b1-46e9-a90e-4f4e9c8de88d tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:30.858598 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-674fe89b-08b1-46e9-a90e-4f4e9c8de88d tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:30.859597 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-674fe89b-08b1-46e9-a90e-4f4e9c8de88d tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:30.860251 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-674fe89b-08b1-46e9-a90e-4f4e9c8de88d tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:30.860877 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-674fe89b-08b1-46e9-a90e-4f4e9c8de88d tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:30.866162 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-894ed89b-3602-4879-81f7-e78e49a9da3b tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:30.867668 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-894ed89b-3602-4879-81f7-e78e49a9da3b tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:30.868261 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-894ed89b-3602-4879-81f7-e78e49a9da3b tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:30.868890 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.objects.instance [None req-894ed89b-3602-4879-81f7-e78e49a9da3b tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lazy-loading 'fault' on Instance uuid 254dfdd3-3716-43cf-aadc-f678aff08d27 {{(pid=138745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 20:55:30.966552 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-894ed89b-3602-4879-81f7-e78e49a9da3b tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:55:30.980637 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-894ed89b-3602-4879-81f7-e78e49a9da3b tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:55:30.983984 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-894ed89b-3602-4879-81f7-e78e49a9da3b tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:55:30.985582 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-894ed89b-3602-4879-81f7-e78e49a9da3b tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] 10.222.0.18 "GET /compute/v2.1/servers/254dfdd3-3716-43cf-aadc-f678aff08d27" status: 200 len: 1352 microversion: 2.25 time: 0.226103 Oct 22 20:55:30.988864 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 845/1618] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 20:55:30 2022] GET /compute/v2.1/servers/254dfdd3-3716-43cf-aadc-f678aff08d27 => generated 1352 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 20:55:30.993763 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-e447fbd0-b4df-4340-b950-9a48fdae3654 req-9656ce0b-86ae-43ea-8616-40643ca9d734 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "254dfdd3-3716-43cf-aadc-f678aff08d27", "name": "network-vif-deleted", "tag": "aa3c904e-442d-4f48-8da8-c9451b740c64"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:55:31.005861 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-e447fbd0-b4df-4340-b950-9a48fdae3654 req-9656ce0b-86ae-43ea-8616-40643ca9d734 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:31.006341 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-e447fbd0-b4df-4340-b950-9a48fdae3654 req-9656ce0b-86ae-43ea-8616-40643ca9d734 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:31.006771 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-e447fbd0-b4df-4340-b950-9a48fdae3654 req-9656ce0b-86ae-43ea-8616-40643ca9d734 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:31.027095 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-e447fbd0-b4df-4340-b950-9a48fdae3654 req-9656ce0b-86ae-43ea-8616-40643ca9d734 service nova] Creating event network-vif-deleted:aa3c904e-442d-4f48-8da8-c9451b740c64 for instance 254dfdd3-3716-43cf-aadc-f678aff08d27 on nch1-master-1 Oct 22 20:55:31.034057 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-e447fbd0-b4df-4340-b950-9a48fdae3654 req-9656ce0b-86ae-43ea-8616-40643ca9d734 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043663 Oct 22 20:55:31.035212 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 846/1619] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:55:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:55:31.042457 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-7ad5b5b0-7220-4bd0-82b0-3a468695f08e tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:55:31.043599 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-7ad5b5b0-7220-4bd0-82b0-3a468695f08e tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] [instance: a64fa89e-32f6-4994-a0b2-3788cf1c92ec] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:55:31.055995 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7ad5b5b0-7220-4bd0-82b0-3a468695f08e tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:31.056714 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7ad5b5b0-7220-4bd0-82b0-3a468695f08e tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:31.057204 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7ad5b5b0-7220-4bd0-82b0-3a468695f08e tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:31.059321 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7ad5b5b0-7220-4bd0-82b0-3a468695f08e tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:31.064210 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-674fe89b-08b1-46e9-a90e-4f4e9c8de88d tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b638db630404ebbbcc2253db30844c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cc7342bf7941d2ad7ebc70032dd52e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:55:31.070218 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7ad5b5b0-7220-4bd0-82b0-3a468695f08e tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:31.072017 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7ad5b5b0-7220-4bd0-82b0-3a468695f08e tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:31.076433 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-674fe89b-08b1-46e9-a90e-4f4e9c8de88d tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] 10.222.0.18 "GET /compute/v2.1/servers/bccbf2b3-70e3-406d-b844-e48d765732cf" status: 200 len: 1276 microversion: 2.1 time: 0.249312 Oct 22 20:55:31.078764 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 774/1620] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:55:30 2022] GET /compute/v2.1/servers/bccbf2b3-70e3-406d-b844-e48d765732cf => generated 1276 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:55:31.093330 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-1c5e9570-8299-4ad2-b011-73044e42222c tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:55:31.094393 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-1c5e9570-8299-4ad2-b011-73044e42222c tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] [instance: 0e92c2df-261e-44fd-b584-2f870190e8ce] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:55:31.105302 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1c5e9570-8299-4ad2-b011-73044e42222c tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:31.106066 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1c5e9570-8299-4ad2-b011-73044e42222c tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:31.106657 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1c5e9570-8299-4ad2-b011-73044e42222c tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:31.107912 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1c5e9570-8299-4ad2-b011-73044e42222c tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:31.108579 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1c5e9570-8299-4ad2-b011-73044e42222c tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:31.109007 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1c5e9570-8299-4ad2-b011-73044e42222c tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:31.129291 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-1c5e9570-8299-4ad2-b011-73044e42222c tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] HTTP exception thrown: Instance 0e92c2df-261e-44fd-b584-2f870190e8ce could not be found. Oct 22 20:55:31.131866 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-1c5e9570-8299-4ad2-b011-73044e42222c tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Request method failure captured: Oct 22 20:55:31.131866 ncdv-master-1 devstack@n-api.service[138744]: request: DELETE /compute/v2.1/servers/0e92c2df-261e-44fd-b584-2f870190e8ce HTTP/1.1 Oct 22 20:55:31.131866 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 20:55:31.131866 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 20:55:31.131866 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 20:55:31.131866 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 0 Oct 22 20:55:31.131866 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 20:55:31.131866 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 20:55:31.131866 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 20:55:31.131866 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 20:55:31.131866 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVFgxbjSpGJnDbAWtrhnhC3ohqhWL21P8V9oDjyt8Cp6-mNYigmWbnwACLhgZ0m-_WayZUZqCvLsIuxozONgEQsFKqbQFe3bHeuZuSmUq3cgCyl657QToCeJnxSAksP09Z2EUvKIoF_d3xV0V1EMSYGQaEwV-nD-C00mu8qSleDqsp7Y Oct 22 20:55:31.131866 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 20:55:31.131866 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 20:55:31.131866 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 20:55:31.131866 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 20:55:31.131866 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 20:55:31.131866 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 20:55:31.131866 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: 6bacf9909082440f8a201771b64a75fa Oct 22 20:55:31.131866 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-ServersTestMultiNic-712697786 Oct 22 20:55:31.131866 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 20:55:31.131866 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 20:55:31.131866 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_6bacf9909082440f8a201771b64a75fa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6bacf9909082440f8a201771b64a75fa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/6bacf9909082440f8a201771b64a75fa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6bacf9909082440f8a201771b64a75fa"}]}] Oct 22 20:55:31.131866 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-ServersTestMultiNic-712697786 Oct 22 20:55:31.131866 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: 6bacf9909082440f8a201771b64a75fa Oct 22 20:55:31.131866 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-ServersTestMultiNic-712697786 Oct 22 20:55:31.131866 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-ServersTestMultiNic-712697786-project Oct 22 20:55:31.131866 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 20:55:31.131866 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 20:55:31.131866 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: c7f48d18691d4473bbe0284c44f14d09 Oct 22 20:55:31.131866 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-ServersTestMultiNic-712697786-project Oct 22 20:55:31.131866 ncdv-master-1 devstack@n-api.service[138744]: method: > Oct 22 20:55:31.131866 ncdv-master-1 devstack@n-api.service[138744]: exception: Instance 0e92c2df-261e-44fd-b584-2f870190e8ce could not be found. Oct 22 20:55:31.131866 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': '0e92c2df-261e-44fd-b584-2f870190e8ce'} Oct 22 20:55:31.131866 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:55:31.131866 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:55:31.131866 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 20:55:31.131866 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 20:55:31.131866 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 20:55:31.131866 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 20:55:31.131866 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 20:55:31.131866 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 20:55:31.131866 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 20:55:31.131866 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 20:55:31.131866 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e92c2df-261e-44fd-b584-2f870190e8ce could not be found. Oct 22 20:55:31.131866 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:55:31.131866 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:55:31.131866 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:55:31.131866 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:55:31.131866 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:55:31.131866 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:55:31.131866 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:55:31.131866 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:55:31.131866 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:55:31.131866 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:55:31.131866 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 22 20:55:31.131866 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 22 20:55:31.131866 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 22 20:55:31.131866 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 22 20:55:31.131866 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 20:55:31.131866 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 20:55:31.131866 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 20:55:31.131866 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 20:55:31.136915 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e92c2df-261e-44fd-b584-2f870190e8ce could not be found. Oct 22 20:55:31.136915 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:55:31.136915 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:55:31.136915 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:55:31.136915 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:55:31.136915 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:55:31.136915 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:55:31.136915 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 20:55:31.136915 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 20:55:31.136915 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e92c2df-261e-44fd-b584-2f870190e8ce could not be found. Oct 22 20:55:31.136915 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:55:31.140208 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-1c5e9570-8299-4ad2-b011-73044e42222c tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Returning 404 to user: Instance 0e92c2df-261e-44fd-b584-2f870190e8ce could not be found. {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:55:31.141290 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-1c5e9570-8299-4ad2-b011-73044e42222c tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] 10.222.0.18 "DELETE /compute/v2.1/servers/0e92c2df-261e-44fd-b584-2f870190e8ce" status: 404 len: 111 microversion: 2.1 time: 0.062431 Oct 22 20:55:31.142433 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 775/1621] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 20:55:31 2022] DELETE /compute/v2.1/servers/0e92c2df-261e-44fd-b584-2f870190e8ce => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 20:55:31.152398 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-70c54cac-40af-4ed1-bb9a-f978aae03852 req-fe60d6fe-6f8d-4c13-aee3-8c301202fbf2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2cedf74-885c-404c-b12f-9b7f7d15734c", "name": "network-vif-deleted", "tag": "ef76c4a9-664c-45a4-9ef1-72702dee483a"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:55:31.166674 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-70c54cac-40af-4ed1-bb9a-f978aae03852 req-fe60d6fe-6f8d-4c13-aee3-8c301202fbf2 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:31.167383 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-70c54cac-40af-4ed1-bb9a-f978aae03852 req-fe60d6fe-6f8d-4c13-aee3-8c301202fbf2 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:31.168068 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-70c54cac-40af-4ed1-bb9a-f978aae03852 req-fe60d6fe-6f8d-4c13-aee3-8c301202fbf2 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:31.183977 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-70c54cac-40af-4ed1-bb9a-f978aae03852 req-fe60d6fe-6f8d-4c13-aee3-8c301202fbf2 service nova] Creating event network-vif-deleted:ef76c4a9-664c-45a4-9ef1-72702dee483a for instance c2cedf74-885c-404c-b12f-9b7f7d15734c on nch2-master-1 Oct 22 20:55:31.190171 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-70c54cac-40af-4ed1-bb9a-f978aae03852 req-fe60d6fe-6f8d-4c13-aee3-8c301202fbf2 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044942 Oct 22 20:55:31.192150 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 776/1622] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:55:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:55:31.198795 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-a3121b13-3afa-4a02-8cda-24dbded081a7 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Action: 'action', calling method: .version_select at 0x7fd3a5d11040>, body: {"addFloatingIp": {"address": "172.35.2.224"}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:55:31.202087 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-a3121b13-3afa-4a02-8cda-24dbded081a7 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] [instance: 29a351ac-ecf5-4b11-9bdd-f1c93df1335a] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:55:31.213630 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a3121b13-3afa-4a02-8cda-24dbded081a7 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:31.213630 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a3121b13-3afa-4a02-8cda-24dbded081a7 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:31.213630 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a3121b13-3afa-4a02-8cda-24dbded081a7 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:31.214071 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a3121b13-3afa-4a02-8cda-24dbded081a7 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:31.214511 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a3121b13-3afa-4a02-8cda-24dbded081a7 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:31.215021 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a3121b13-3afa-4a02-8cda-24dbded081a7 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:31.299112 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a3121b13-3afa-4a02-8cda-24dbded081a7 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Acquiring lock "refresh_cache-29a351ac-ecf5-4b11-9bdd-f1c93df1335a" {{(pid=138744) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 22 20:55:31.299554 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a3121b13-3afa-4a02-8cda-24dbded081a7 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Acquired lock "refresh_cache-29a351ac-ecf5-4b11-9bdd-f1c93df1335a" {{(pid=138744) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 22 20:55:31.463432 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-7ad5b5b0-7220-4bd0-82b0-3a468695f08e tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b392ad1fe1fd4b2a9e6be03a7435deb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594624ed28aa433d907c8833d360b82e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:55:31.499960 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-7ad5b5b0-7220-4bd0-82b0-3a468695f08e tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] 10.222.0.18 "GET /compute/v2.1/servers/a64fa89e-32f6-4994-a0b2-3788cf1c92ec" status: 200 len: 1521 microversion: 2.1 time: 0.463412 Oct 22 20:55:31.512353 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 847/1623] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:55:31 2022] GET /compute/v2.1/servers/a64fa89e-32f6-4994-a0b2-3788cf1c92ec => generated 1521 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:55:31.517556 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-72563d04-9670-4432-93fa-618b7fec5ee1 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:55:31.518416 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-72563d04-9670-4432-93fa-618b7fec5ee1 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] [instance: 0e92c2df-261e-44fd-b584-2f870190e8ce] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:55:31.527111 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-72563d04-9670-4432-93fa-618b7fec5ee1 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:31.528321 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-72563d04-9670-4432-93fa-618b7fec5ee1 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:31.529126 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-72563d04-9670-4432-93fa-618b7fec5ee1 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:31.530261 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-72563d04-9670-4432-93fa-618b7fec5ee1 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:31.530929 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-72563d04-9670-4432-93fa-618b7fec5ee1 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:31.531773 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-72563d04-9670-4432-93fa-618b7fec5ee1 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:31.560256 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.wsgi [None req-72563d04-9670-4432-93fa-618b7fec5ee1 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] HTTP exception thrown: Instance 0e92c2df-261e-44fd-b584-2f870190e8ce could not be found. Oct 22 20:55:31.562197 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-72563d04-9670-4432-93fa-618b7fec5ee1 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Request method failure captured: Oct 22 20:55:31.562197 ncdv-master-1 devstack@n-api.service[138745]: request: GET /compute/v2.1/servers/0e92c2df-261e-44fd-b584-2f870190e8ce HTTP/1.1 Oct 22 20:55:31.562197 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 20:55:31.562197 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 20:55:31.562197 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 20:55:31.562197 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 0 Oct 22 20:55:31.562197 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 20:55:31.562197 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 20:55:31.562197 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 20:55:31.562197 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 20:55:31.562197 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVFgxbjSpGJnDbAWtrhnhC3ohqhWL21P8V9oDjyt8Cp6-mNYigmWbnwACLhgZ0m-_WayZUZqCvLsIuxozONgEQsFKqbQFe3bHeuZuSmUq3cgCyl657QToCeJnxSAksP09Z2EUvKIoF_d3xV0V1EMSYGQaEwV-nD-C00mu8qSleDqsp7Y Oct 22 20:55:31.562197 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 20:55:31.562197 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 20:55:31.562197 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 20:55:31.562197 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 20:55:31.562197 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 20:55:31.562197 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 20:55:31.562197 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: 6bacf9909082440f8a201771b64a75fa Oct 22 20:55:31.562197 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-ServersTestMultiNic-712697786 Oct 22 20:55:31.562197 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 20:55:31.562197 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 20:55:31.562197 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_6bacf9909082440f8a201771b64a75fa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6bacf9909082440f8a201771b64a75fa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/6bacf9909082440f8a201771b64a75fa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6bacf9909082440f8a201771b64a75fa"}]}] Oct 22 20:55:31.562197 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-ServersTestMultiNic-712697786 Oct 22 20:55:31.562197 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: 6bacf9909082440f8a201771b64a75fa Oct 22 20:55:31.562197 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-ServersTestMultiNic-712697786 Oct 22 20:55:31.562197 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-ServersTestMultiNic-712697786-project Oct 22 20:55:31.562197 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 20:55:31.562197 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 20:55:31.562197 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: c7f48d18691d4473bbe0284c44f14d09 Oct 22 20:55:31.562197 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-ServersTestMultiNic-712697786-project Oct 22 20:55:31.562197 ncdv-master-1 devstack@n-api.service[138745]: method: > Oct 22 20:55:31.562197 ncdv-master-1 devstack@n-api.service[138745]: exception: Instance 0e92c2df-261e-44fd-b584-2f870190e8ce could not be found. Oct 22 20:55:31.562197 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'id': '0e92c2df-261e-44fd-b584-2f870190e8ce'} Oct 22 20:55:31.562197 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:55:31.562197 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:55:31.562197 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 20:55:31.562197 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 20:55:31.562197 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 20:55:31.562197 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 20:55:31.562197 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 20:55:31.562197 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 20:55:31.562197 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 20:55:31.562197 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 20:55:31.562197 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e92c2df-261e-44fd-b584-2f870190e8ce could not be found. Oct 22 20:55:31.562197 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:55:31.562197 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:55:31.562197 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:55:31.562197 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:55:31.562197 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:55:31.562197 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:55:31.562197 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:55:31.562197 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:55:31.562197 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:55:31.562197 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:55:31.562197 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 20:55:31.562197 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 20:55:31.562197 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 20:55:31.562197 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 20:55:31.562197 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 20:55:31.562197 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 20:55:31.562197 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e92c2df-261e-44fd-b584-2f870190e8ce could not be found. Oct 22 20:55:31.562197 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:55:31.562197 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:55:31.562197 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:55:31.567779 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:55:31.567779 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:55:31.567779 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:55:31.567779 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 20:55:31.567779 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 20:55:31.567779 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e92c2df-261e-44fd-b584-2f870190e8ce could not be found. Oct 22 20:55:31.567779 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:55:31.567779 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-72563d04-9670-4432-93fa-618b7fec5ee1 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Returning 404 to user: Instance 0e92c2df-261e-44fd-b584-2f870190e8ce could not be found. {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:55:31.567779 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-72563d04-9670-4432-93fa-618b7fec5ee1 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] 10.222.0.18 "GET /compute/v2.1/servers/0e92c2df-261e-44fd-b584-2f870190e8ce" status: 404 len: 111 microversion: 2.1 time: 0.049931 Oct 22 20:55:31.567779 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 848/1624] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:55:31 2022] GET /compute/v2.1/servers/0e92c2df-261e-44fd-b584-2f870190e8ce => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 20:55:31.571945 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-4de8e93a-f7e3-4d21-9e43-4f6b3e51aa6f tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:55:31.572647 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-4de8e93a-f7e3-4d21-9e43-4f6b3e51aa6f tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] [instance: a64fa89e-32f6-4994-a0b2-3788cf1c92ec] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:55:31.584347 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4de8e93a-f7e3-4d21-9e43-4f6b3e51aa6f tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:31.585142 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4de8e93a-f7e3-4d21-9e43-4f6b3e51aa6f tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:31.585781 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4de8e93a-f7e3-4d21-9e43-4f6b3e51aa6f tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:31.586766 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4de8e93a-f7e3-4d21-9e43-4f6b3e51aa6f tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:31.587459 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4de8e93a-f7e3-4d21-9e43-4f6b3e51aa6f tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:31.588084 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4de8e93a-f7e3-4d21-9e43-4f6b3e51aa6f tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:32.126272 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-4de8e93a-f7e3-4d21-9e43-4f6b3e51aa6f tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b392ad1fe1fd4b2a9e6be03a7435deb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594624ed28aa433d907c8833d360b82e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:55:32.138228 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-4de8e93a-f7e3-4d21-9e43-4f6b3e51aa6f tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] 10.222.0.18 "GET /compute/v2.1/servers/a64fa89e-32f6-4994-a0b2-3788cf1c92ec" status: 200 len: 1521 microversion: 2.1 time: 0.571817 Oct 22 20:55:32.139270 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 849/1625] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:55:31 2022] GET /compute/v2.1/servers/a64fa89e-32f6-4994-a0b2-3788cf1c92ec => generated 1521 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:55:32.151097 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-b08570e1-bf77-4b16-ad2b-edfe1252e351 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:55:32.154470 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-b08570e1-bf77-4b16-ad2b-edfe1252e351 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] [instance: f2f50f6b-6a3e-449f-836e-bd897f78279c] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:55:32.163433 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b08570e1-bf77-4b16-ad2b-edfe1252e351 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:32.163943 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b08570e1-bf77-4b16-ad2b-edfe1252e351 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:32.164387 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b08570e1-bf77-4b16-ad2b-edfe1252e351 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:32.165318 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b08570e1-bf77-4b16-ad2b-edfe1252e351 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:32.165929 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b08570e1-bf77-4b16-ad2b-edfe1252e351 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:32.166510 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b08570e1-bf77-4b16-ad2b-edfe1252e351 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:32.183466 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.wsgi [None req-b08570e1-bf77-4b16-ad2b-edfe1252e351 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] HTTP exception thrown: Instance f2f50f6b-6a3e-449f-836e-bd897f78279c could not be found. Oct 22 20:55:32.185892 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-b08570e1-bf77-4b16-ad2b-edfe1252e351 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Request method failure captured: Oct 22 20:55:32.185892 ncdv-master-1 devstack@n-api.service[138745]: request: DELETE /compute/v2.1/servers/f2f50f6b-6a3e-449f-836e-bd897f78279c HTTP/1.1 Oct 22 20:55:32.185892 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 20:55:32.185892 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 20:55:32.185892 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 20:55:32.185892 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 0 Oct 22 20:55:32.185892 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 20:55:32.185892 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 20:55:32.185892 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 20:55:32.185892 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 20:55:32.185892 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVFgxbjSpGJnDbAWtrhnhC3ohqhWL21P8V9oDjyt8Cp6-mNYigmWbnwACLhgZ0m-_WayZUZqCvLsIuxozONgEQsFKqbQFe3bHeuZuSmUq3cgCyl657QToCeJnxSAksP09Z2EUvKIoF_d3xV0V1EMSYGQaEwV-nD-C00mu8qSleDqsp7Y Oct 22 20:55:32.185892 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 20:55:32.185892 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 20:55:32.185892 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 20:55:32.185892 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 20:55:32.185892 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 20:55:32.185892 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 20:55:32.185892 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: 6bacf9909082440f8a201771b64a75fa Oct 22 20:55:32.185892 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-ServersTestMultiNic-712697786 Oct 22 20:55:32.185892 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 20:55:32.185892 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 20:55:32.185892 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_6bacf9909082440f8a201771b64a75fa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6bacf9909082440f8a201771b64a75fa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/6bacf9909082440f8a201771b64a75fa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6bacf9909082440f8a201771b64a75fa"}]}] Oct 22 20:55:32.185892 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-ServersTestMultiNic-712697786 Oct 22 20:55:32.185892 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: 6bacf9909082440f8a201771b64a75fa Oct 22 20:55:32.185892 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-ServersTestMultiNic-712697786 Oct 22 20:55:32.185892 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-ServersTestMultiNic-712697786-project Oct 22 20:55:32.185892 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 20:55:32.185892 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 20:55:32.185892 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: c7f48d18691d4473bbe0284c44f14d09 Oct 22 20:55:32.185892 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-ServersTestMultiNic-712697786-project Oct 22 20:55:32.185892 ncdv-master-1 devstack@n-api.service[138745]: method: > Oct 22 20:55:32.185892 ncdv-master-1 devstack@n-api.service[138745]: exception: Instance f2f50f6b-6a3e-449f-836e-bd897f78279c could not be found. Oct 22 20:55:32.185892 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'id': 'f2f50f6b-6a3e-449f-836e-bd897f78279c'} Oct 22 20:55:32.185892 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:55:32.185892 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:55:32.185892 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 20:55:32.185892 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 20:55:32.185892 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 20:55:32.185892 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 20:55:32.185892 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 20:55:32.185892 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 20:55:32.185892 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 20:55:32.185892 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 20:55:32.185892 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f2f50f6b-6a3e-449f-836e-bd897f78279c could not be found. Oct 22 20:55:32.185892 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:55:32.185892 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:55:32.185892 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:55:32.185892 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:55:32.185892 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:55:32.185892 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:55:32.185892 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:55:32.185892 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:55:32.185892 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:55:32.185892 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:55:32.185892 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 22 20:55:32.185892 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 22 20:55:32.185892 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 22 20:55:32.185892 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 22 20:55:32.185892 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 20:55:32.185892 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 20:55:32.185892 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 20:55:32.185892 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 20:55:32.191091 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2f50f6b-6a3e-449f-836e-bd897f78279c could not be found. Oct 22 20:55:32.191091 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:55:32.191091 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:55:32.191091 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:55:32.191091 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:55:32.191091 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:55:32.191091 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:55:32.191091 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 20:55:32.191091 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 20:55:32.191091 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2f50f6b-6a3e-449f-836e-bd897f78279c could not be found. Oct 22 20:55:32.191091 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:55:32.191091 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-b08570e1-bf77-4b16-ad2b-edfe1252e351 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Returning 404 to user: Instance f2f50f6b-6a3e-449f-836e-bd897f78279c could not be found. {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:55:32.191091 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-b08570e1-bf77-4b16-ad2b-edfe1252e351 tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] 10.222.0.18 "DELETE /compute/v2.1/servers/f2f50f6b-6a3e-449f-836e-bd897f78279c" status: 404 len: 111 microversion: 2.1 time: 0.047878 Oct 22 20:55:32.191091 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 850/1626] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 20:55:32 2022] DELETE /compute/v2.1/servers/f2f50f6b-6a3e-449f-836e-bd897f78279c => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 20:55:32.201533 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-bedb7b55-912e-4bb1-85d9-f8691e2c4726 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:55:32.202383 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-bedb7b55-912e-4bb1-85d9-f8691e2c4726 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] [instance: 98f48cb1-54ed-4e82-8a25-fd004ddb5758] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:55:32.212544 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bedb7b55-912e-4bb1-85d9-f8691e2c4726 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:32.213558 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bedb7b55-912e-4bb1-85d9-f8691e2c4726 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:32.214188 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bedb7b55-912e-4bb1-85d9-f8691e2c4726 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:32.215244 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bedb7b55-912e-4bb1-85d9-f8691e2c4726 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:32.215907 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bedb7b55-912e-4bb1-85d9-f8691e2c4726 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:32.216756 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bedb7b55-912e-4bb1-85d9-f8691e2c4726 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:32.755539 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-bedb7b55-912e-4bb1-85d9-f8691e2c4726 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d3d7458af447bdb3f03e83a2d8559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49238b8686d24ae698679e4a1957735d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:55:32.765822 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-bedb7b55-912e-4bb1-85d9-f8691e2c4726 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] 10.222.0.18 "GET /compute/v2.1/servers/98f48cb1-54ed-4e82-8a25-fd004ddb5758" status: 200 len: 1270 microversion: 2.1 time: 0.574749 Oct 22 20:55:32.766757 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 851/1627] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:55:32 2022] GET /compute/v2.1/servers/98f48cb1-54ed-4e82-8a25-fd004ddb5758 => generated 1270 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:55:32.773304 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-887332ec-9e4f-4d03-90d2-283861161211 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:55:32.774116 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-887332ec-9e4f-4d03-90d2-283861161211 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] [instance: fbb34507-cef9-4d78-9ed7-5d6eab4ca806] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:55:32.781274 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-887332ec-9e4f-4d03-90d2-283861161211 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:32.782045 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-887332ec-9e4f-4d03-90d2-283861161211 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:32.782551 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-887332ec-9e4f-4d03-90d2-283861161211 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:32.783319 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-887332ec-9e4f-4d03-90d2-283861161211 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:32.783878 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-887332ec-9e4f-4d03-90d2-283861161211 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:32.784708 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-887332ec-9e4f-4d03-90d2-283861161211 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:33.214744 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-887332ec-9e4f-4d03-90d2-283861161211 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c87f0356ca346f39c6216393d85da2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee8c8f7fc4e12bc1f9fcce3e7b581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:55:33.224183 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-887332ec-9e4f-4d03-90d2-283861161211 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] 10.222.0.18 "GET /compute/v2.1/servers/fbb34507-cef9-4d78-9ed7-5d6eab4ca806" status: 200 len: 1392 microversion: 2.1 time: 0.455949 Oct 22 20:55:33.235364 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 852/1628] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:55:32 2022] GET /compute/v2.1/servers/fbb34507-cef9-4d78-9ed7-5d6eab4ca806 => generated 1392 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:55:33.240785 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-43cdeae3-d4cc-4d17-b017-a554f7ce606c tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:55:33.241737 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-43cdeae3-d4cc-4d17-b017-a554f7ce606c tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] [instance: 254dfdd3-3716-43cf-aadc-f678aff08d27] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:55:33.253858 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-43cdeae3-d4cc-4d17-b017-a554f7ce606c tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:33.255121 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-43cdeae3-d4cc-4d17-b017-a554f7ce606c tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:33.256197 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-43cdeae3-d4cc-4d17-b017-a554f7ce606c tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:33.257034 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-43cdeae3-d4cc-4d17-b017-a554f7ce606c tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:33.257598 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-43cdeae3-d4cc-4d17-b017-a554f7ce606c tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:33.258202 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-43cdeae3-d4cc-4d17-b017-a554f7ce606c tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:33.274556 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.wsgi [None req-43cdeae3-d4cc-4d17-b017-a554f7ce606c tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] HTTP exception thrown: Instance 254dfdd3-3716-43cf-aadc-f678aff08d27 could not be found. Oct 22 20:55:33.276438 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-43cdeae3-d4cc-4d17-b017-a554f7ce606c tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Request method failure captured: Oct 22 20:55:33.276438 ncdv-master-1 devstack@n-api.service[138745]: request: GET /compute/v2.1/servers/254dfdd3-3716-43cf-aadc-f678aff08d27 HTTP/1.1 Oct 22 20:55:33.276438 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 20:55:33.276438 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 20:55:33.276438 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 20:55:33.276438 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 0 Oct 22 20:55:33.276438 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 20:55:33.276438 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 20:55:33.276438 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 20:55:33.276438 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 20:55:33.276438 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVFc6ze-JvRNBYUoDY8DxRahatFrOlr2DH1Jj7tx4qgH6khVz1HoW_8kE7y_rlkudvvybXKphF1vkSLvPaAzyp66bqbcfISFjN01CiLISj28Sbh99A72aXrDBEAGyFUniWRH7nPnKw64FY4yGK7_HqZN5InCILmg2TRDUJKhlz6tDI4s Oct 22 20:55:33.276438 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 20:55:33.276438 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 20:55:33.276438 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 20:55:33.276438 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 20:55:33.276438 ncdv-master-1 devstack@n-api.service[138745]: X-Openstack-Nova-Api-Version: 2.25 Oct 22 20:55:33.276438 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 20:55:33.276438 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 20:55:33.276438 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: 11060bbcab6b45cabb1457319d72b982 Oct 22 20:55:33.276438 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1332499062 Oct 22 20:55:33.276438 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 20:55:33.276438 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 20:55:33.276438 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_11060bbcab6b45cabb1457319d72b982"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/11060bbcab6b45cabb1457319d72b982"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/11060bbcab6b45cabb1457319d72b982"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/11060bbcab6b45cabb1457319d72b982"}]}] Oct 22 20:55:33.276438 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1332499062 Oct 22 20:55:33.276438 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: 11060bbcab6b45cabb1457319d72b982 Oct 22 20:55:33.276438 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1332499062 Oct 22 20:55:33.276438 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-LiveAutoBlockMigrationV225Test-1332499062-project Oct 22 20:55:33.276438 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 20:55:33.276438 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 20:55:33.276438 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: 93c41b7be1724632b0d6bd2bd3b57f8f Oct 22 20:55:33.276438 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1332499062-project Oct 22 20:55:33.276438 ncdv-master-1 devstack@n-api.service[138745]: method: > Oct 22 20:55:33.276438 ncdv-master-1 devstack@n-api.service[138745]: exception: Instance 254dfdd3-3716-43cf-aadc-f678aff08d27 could not be found. Oct 22 20:55:33.276438 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'id': '254dfdd3-3716-43cf-aadc-f678aff08d27'} Oct 22 20:55:33.276438 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:55:33.276438 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:55:33.276438 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 20:55:33.276438 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 20:55:33.276438 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 20:55:33.276438 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 20:55:33.276438 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 20:55:33.276438 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 20:55:33.276438 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 20:55:33.276438 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 20:55:33.276438 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 254dfdd3-3716-43cf-aadc-f678aff08d27 could not be found. Oct 22 20:55:33.276438 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:55:33.276438 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:55:33.276438 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:55:33.276438 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:55:33.276438 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:55:33.276438 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:55:33.276438 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:55:33.276438 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:55:33.276438 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:55:33.276438 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:55:33.276438 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 20:55:33.276438 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 20:55:33.276438 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 20:55:33.276438 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 20:55:33.276438 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 20:55:33.276438 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 20:55:33.276438 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 254dfdd3-3716-43cf-aadc-f678aff08d27 could not be found. Oct 22 20:55:33.276438 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:55:33.282257 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:55:33.282257 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:55:33.282257 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:55:33.282257 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:55:33.282257 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:55:33.282257 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 20:55:33.282257 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 20:55:33.282257 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 254dfdd3-3716-43cf-aadc-f678aff08d27 could not be found. Oct 22 20:55:33.282257 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:55:33.282257 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-43cdeae3-d4cc-4d17-b017-a554f7ce606c tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Returning 404 to user: Instance 254dfdd3-3716-43cf-aadc-f678aff08d27 could not be found. {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:55:33.282257 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-43cdeae3-d4cc-4d17-b017-a554f7ce606c tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] 10.222.0.18 "GET /compute/v2.1/servers/254dfdd3-3716-43cf-aadc-f678aff08d27" status: 404 len: 111 microversion: 2.25 time: 0.054090 Oct 22 20:55:33.284548 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 853/1629] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 20:55:33 2022] GET /compute/v2.1/servers/254dfdd3-3716-43cf-aadc-f678aff08d27 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 22 20:55:33.289121 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-24992cd4-f025-4d85-8e76-e1ee4cc9de7a tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:55:33.289898 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-24992cd4-f025-4d85-8e76-e1ee4cc9de7a tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] [instance: bccbf2b3-70e3-406d-b844-e48d765732cf] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:55:33.297541 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-24992cd4-f025-4d85-8e76-e1ee4cc9de7a tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:33.298209 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-24992cd4-f025-4d85-8e76-e1ee4cc9de7a tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:33.298775 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-24992cd4-f025-4d85-8e76-e1ee4cc9de7a tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:33.299654 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-24992cd4-f025-4d85-8e76-e1ee4cc9de7a tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:33.300415 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-24992cd4-f025-4d85-8e76-e1ee4cc9de7a tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:33.300949 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-24992cd4-f025-4d85-8e76-e1ee4cc9de7a tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:33.320409 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:55:33.791217 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-24992cd4-f025-4d85-8e76-e1ee4cc9de7a tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b638db630404ebbbcc2253db30844c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cc7342bf7941d2ad7ebc70032dd52e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:55:33.803439 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-24992cd4-f025-4d85-8e76-e1ee4cc9de7a tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] 10.222.0.18 "GET /compute/v2.1/servers/bccbf2b3-70e3-406d-b844-e48d765732cf" status: 200 len: 1318 microversion: 2.1 time: 0.518871 Oct 22 20:55:33.804020 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 854/1630] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:55:33 2022] GET /compute/v2.1/servers/bccbf2b3-70e3-406d-b844-e48d765732cf => generated 1318 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:55:33.813188 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-3f24c968-809c-4a30-8edc-ddfd1a026fb0 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-250293565", "metadata": {"": ""}}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:55:33.820893 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-3f24c968-809c-4a30-8edc-ddfd1a026fb0 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Request method failure captured: Oct 22 20:55:33.820893 ncdv-master-1 devstack@n-api.service[138745]: request: POST /compute/v2.1/servers/a64fa89e-32f6-4994-a0b2-3788cf1c92ec/action HTTP/1.1 Oct 22 20:55:33.820893 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 20:55:33.820893 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 20:55:33.820893 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 20:55:33.820893 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 106 Oct 22 20:55:33.820893 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 20:55:33.820893 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 20:55:33.820893 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 20:55:33.820893 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 20:55:33.820893 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVFinkWQQBhkrT1IKOpDugEkOlAPWNZyP_2NMwr13b9XeVy4UUzw2acgfBjDE3p8vwfHK2_Q3RMg9yYmateTjw8EQOHA7IN0HeuqzZ5uQWL0ysIIG3e_nACVRZdRICvuIM06IV17ajtcJTdsfcK0wPQNbKtAOZi6_8a2UUHyQ1NeNuzI Oct 22 20:55:33.820893 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 20:55:33.820893 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 20:55:33.820893 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 20:55:33.820893 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 20:55:33.820893 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 20:55:33.820893 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 20:55:33.820893 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: 594624ed28aa433d907c8833d360b82e Oct 22 20:55:33.820893 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-477371163 Oct 22 20:55:33.820893 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 20:55:33.820893 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 20:55:33.820893 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_594624ed28aa433d907c8833d360b82e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/594624ed28aa433d907c8833d360b82e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/594624ed28aa433d907c8833d360b82e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/594624ed28aa433d907c8833d360b82e"}]}] Oct 22 20:55:33.820893 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-477371163 Oct 22 20:55:33.820893 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: 594624ed28aa433d907c8833d360b82e Oct 22 20:55:33.820893 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-477371163 Oct 22 20:55:33.820893 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-ImagesOneServerNegativeTestJSON-477371163-project Oct 22 20:55:33.820893 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 20:55:33.820893 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 20:55:33.820893 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: b392ad1fe1fd4b2a9e6be03a7435deb9 Oct 22 20:55:33.820893 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-477371163-project Oct 22 20:55:33.820893 ncdv-master-1 devstack@n-api.service[138745]: Oct 22 20:55:33.820893 ncdv-master-1 devstack@n-api.service[138745]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-250293565", "metadata": {"": ""}}} Oct 22 20:55:33.820893 ncdv-master-1 devstack@n-api.service[138745]: method: > Oct 22 20:55:33.820893 ncdv-master-1 devstack@n-api.service[138745]: exception: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 22 20:55:33.820893 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'id': 'a64fa89e-32f6-4994-a0b2-3788cf1c92ec', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-250293565', 'metadata': {'': ''}}}} Oct 22 20:55:33.820893 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:55:33.820893 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:55:33.820893 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 22 20:55:33.820893 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 22 20:55:33.820893 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 22 20:55:33.820893 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise error Oct 22 20:55:33.820893 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 22 20:55:33.820893 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:55:33.820893 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Oct 22 20:55:33.820893 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 22 20:55:33.820893 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 22 20:55:33.820893 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 22 20:55:33.820893 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 22 20:55:33.820893 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:55:33.820893 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi On instance['createImage']: Oct 22 20:55:33.820893 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi {'': ''} Oct 22 20:55:33.820893 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:55:33.820893 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:55:33.820893 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:55:33.820893 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:55:33.820893 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:55:33.820893 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:55:33.820893 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:55:33.820893 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:55:33.820893 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:55:33.820893 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:55:33.820893 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 20:55:33.820893 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 20:55:33.820893 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 22 20:55:33.826590 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 22 20:55:33.826590 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 22 20:55:33.826590 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 22 20:55:33.826590 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 22 20:55:33.826590 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 22 20:55:33.826590 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 22 20:55:33.826590 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:55:33.826590 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:55:33.826590 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:55:33.826590 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:55:33.826590 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:55:33.826590 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:55:33.826590 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 22 20:55:33.826590 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 22 20:55:33.826590 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 22 20:55:33.826590 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:55:33.834336 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-3f24c968-809c-4a30-8edc-ddfd1a026fb0 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:55:33.842381 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-3f24c968-809c-4a30-8edc-ddfd1a026fb0 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] 10.222.0.18 "POST /compute/v2.1/servers/a64fa89e-32f6-4994-a0b2-3788cf1c92ec/action" status: 400 len: 170 microversion: 2.1 time: 0.034770 Oct 22 20:55:33.843247 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 855/1631] 10.222.0.18 () {60 vars in 1279 bytes} [Sat Oct 22 20:55:33 2022] POST /compute/v2.1/servers/a64fa89e-32f6-4994-a0b2-3788cf1c92ec/action => generated 170 bytes in 38 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 22 20:55:33.855593 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-7a7867be-a6b4-4de2-afee-607e563f873d tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:55:33.860140 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-7a7867be-a6b4-4de2-afee-607e563f873d tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] [instance: f2f50f6b-6a3e-449f-836e-bd897f78279c] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:55:33.873154 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7a7867be-a6b4-4de2-afee-607e563f873d tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:33.876486 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7a7867be-a6b4-4de2-afee-607e563f873d tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:33.877123 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7a7867be-a6b4-4de2-afee-607e563f873d tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:33.882514 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7a7867be-a6b4-4de2-afee-607e563f873d tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:33.883245 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7a7867be-a6b4-4de2-afee-607e563f873d tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:33.883885 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7a7867be-a6b4-4de2-afee-607e563f873d tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:33.918681 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.wsgi [None req-7a7867be-a6b4-4de2-afee-607e563f873d tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] HTTP exception thrown: Instance f2f50f6b-6a3e-449f-836e-bd897f78279c could not be found. Oct 22 20:55:33.924631 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-7a7867be-a6b4-4de2-afee-607e563f873d tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Request method failure captured: Oct 22 20:55:33.924631 ncdv-master-1 devstack@n-api.service[138745]: request: GET /compute/v2.1/servers/f2f50f6b-6a3e-449f-836e-bd897f78279c HTTP/1.1 Oct 22 20:55:33.924631 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 20:55:33.924631 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 20:55:33.924631 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 20:55:33.924631 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 0 Oct 22 20:55:33.924631 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 20:55:33.924631 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 20:55:33.924631 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 20:55:33.924631 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 20:55:33.924631 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVFgxbjSpGJnDbAWtrhnhC3ohqhWL21P8V9oDjyt8Cp6-mNYigmWbnwACLhgZ0m-_WayZUZqCvLsIuxozONgEQsFKqbQFe3bHeuZuSmUq3cgCyl657QToCeJnxSAksP09Z2EUvKIoF_d3xV0V1EMSYGQaEwV-nD-C00mu8qSleDqsp7Y Oct 22 20:55:33.924631 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 20:55:33.924631 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 20:55:33.924631 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 20:55:33.924631 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 20:55:33.924631 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 20:55:33.924631 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 20:55:33.924631 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: 6bacf9909082440f8a201771b64a75fa Oct 22 20:55:33.924631 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-ServersTestMultiNic-712697786 Oct 22 20:55:33.924631 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 20:55:33.924631 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 20:55:33.924631 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_6bacf9909082440f8a201771b64a75fa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6bacf9909082440f8a201771b64a75fa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/6bacf9909082440f8a201771b64a75fa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6bacf9909082440f8a201771b64a75fa"}]}] Oct 22 20:55:33.924631 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-ServersTestMultiNic-712697786 Oct 22 20:55:33.924631 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: 6bacf9909082440f8a201771b64a75fa Oct 22 20:55:33.924631 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-ServersTestMultiNic-712697786 Oct 22 20:55:33.924631 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-ServersTestMultiNic-712697786-project Oct 22 20:55:33.924631 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 20:55:33.924631 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 20:55:33.924631 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: c7f48d18691d4473bbe0284c44f14d09 Oct 22 20:55:33.924631 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-ServersTestMultiNic-712697786-project Oct 22 20:55:33.924631 ncdv-master-1 devstack@n-api.service[138745]: method: > Oct 22 20:55:33.924631 ncdv-master-1 devstack@n-api.service[138745]: exception: Instance f2f50f6b-6a3e-449f-836e-bd897f78279c could not be found. Oct 22 20:55:33.924631 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'id': 'f2f50f6b-6a3e-449f-836e-bd897f78279c'} Oct 22 20:55:33.924631 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:55:33.924631 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:55:33.924631 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 20:55:33.924631 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 20:55:33.924631 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 20:55:33.924631 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 20:55:33.924631 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 20:55:33.924631 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 20:55:33.924631 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 20:55:33.924631 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 20:55:33.924631 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f2f50f6b-6a3e-449f-836e-bd897f78279c could not be found. Oct 22 20:55:33.924631 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:55:33.924631 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:55:33.924631 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:55:33.924631 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:55:33.924631 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:55:33.924631 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:55:33.924631 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:55:33.924631 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:55:33.924631 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:55:33.924631 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:55:33.924631 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 20:55:33.924631 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 20:55:33.924631 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 20:55:33.924631 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 20:55:33.924631 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 20:55:33.924631 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 20:55:33.924631 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2f50f6b-6a3e-449f-836e-bd897f78279c could not be found. Oct 22 20:55:33.924631 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:55:33.924631 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:55:33.924631 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:55:33.930074 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:55:33.930074 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:55:33.930074 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:55:33.930074 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 20:55:33.930074 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 20:55:33.930074 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2f50f6b-6a3e-449f-836e-bd897f78279c could not be found. Oct 22 20:55:33.930074 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:55:33.930074 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-7a7867be-a6b4-4de2-afee-607e563f873d tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] Returning 404 to user: Instance f2f50f6b-6a3e-449f-836e-bd897f78279c could not be found. {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:55:33.930074 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-7a7867be-a6b4-4de2-afee-607e563f873d tempest-ServersTestMultiNic-712697786 tempest-ServersTestMultiNic-712697786-project] 10.222.0.18 "GET /compute/v2.1/servers/f2f50f6b-6a3e-449f-836e-bd897f78279c" status: 404 len: 111 microversion: 2.1 time: 0.079957 Oct 22 20:55:33.931535 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 856/1632] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:55:33 2022] GET /compute/v2.1/servers/f2f50f6b-6a3e-449f-836e-bd897f78279c => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 20:55:33.945935 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-bdedd861-48b9-48e2-b02a-09383e72a64a tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:55:33.946630 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-bdedd861-48b9-48e2-b02a-09383e72a64a tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] [instance: 1d613848-05f4-478f-a569-b4c50576edb7] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:55:33.959810 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bdedd861-48b9-48e2-b02a-09383e72a64a tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:33.960317 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bdedd861-48b9-48e2-b02a-09383e72a64a tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:33.960759 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bdedd861-48b9-48e2-b02a-09383e72a64a tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:33.961488 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bdedd861-48b9-48e2-b02a-09383e72a64a tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:33.967293 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bdedd861-48b9-48e2-b02a-09383e72a64a tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:33.971220 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bdedd861-48b9-48e2-b02a-09383e72a64a tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:34.032794 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-bdedd861-48b9-48e2-b02a-09383e72a64a tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] [instance: 1d613848-05f4-478f-a569-b4c50576edb7] Going to try to terminate instance {{(pid=138745) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 20:55:34.186560 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-bdedd861-48b9-48e2-b02a-09383e72a64a tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] 10.222.0.18 "DELETE /compute/v2.1/servers/1d613848-05f4-478f-a569-b4c50576edb7" status: 204 len: 0 microversion: 2.25 time: 0.253642 Oct 22 20:55:34.187437 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 857/1633] 10.222.0.18 () {60 vars in 1280 bytes} [Sat Oct 22 20:55:33 2022] DELETE /compute/v2.1/servers/1d613848-05f4-478f-a569-b4c50576edb7 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 22 20:55:34.197833 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-6c277fd3-3489-4d95-9681-9ac826038b91 req-e404b7e4-0021-4af0-9f84-19772c871e2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04d927bb-da77-4ca1-a828-562a01f07892", "name": "network-vif-deleted", "tag": "0747114c-f2e1-42d3-a601-70006dee0431"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:55:34.208279 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=1,nova_api:UPDATE=3,nova_api:INSERT=3 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:55:34.213146 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-6c277fd3-3489-4d95-9681-9ac826038b91 req-e404b7e4-0021-4af0-9f84-19772c871e2d service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:34.214407 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-6c277fd3-3489-4d95-9681-9ac826038b91 req-e404b7e4-0021-4af0-9f84-19772c871e2d service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:34.215042 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-6c277fd3-3489-4d95-9681-9ac826038b91 req-e404b7e4-0021-4af0-9f84-19772c871e2d service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:34.238316 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-6c277fd3-3489-4d95-9681-9ac826038b91 req-e404b7e4-0021-4af0-9f84-19772c871e2d service nova] Creating event network-vif-deleted:0747114c-f2e1-42d3-a601-70006dee0431 for instance 04d927bb-da77-4ca1-a828-562a01f07892 on nch2-master-1 Oct 22 20:55:34.248694 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-6c277fd3-3489-4d95-9681-9ac826038b91 req-e404b7e4-0021-4af0-9f84-19772c871e2d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059342 Oct 22 20:55:34.250136 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 858/1634] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:55:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:55:34.259948 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-6326d5bd-026b-4ff4-b958-93cda249f623 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:55:34.261002 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-6326d5bd-026b-4ff4-b958-93cda249f623 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] [instance: 98f48cb1-54ed-4e82-8a25-fd004ddb5758] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:55:34.288782 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6326d5bd-026b-4ff4-b958-93cda249f623 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:34.289959 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6326d5bd-026b-4ff4-b958-93cda249f623 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:34.290597 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6326d5bd-026b-4ff4-b958-93cda249f623 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:34.291805 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6326d5bd-026b-4ff4-b958-93cda249f623 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:34.294194 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6326d5bd-026b-4ff4-b958-93cda249f623 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:34.294844 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6326d5bd-026b-4ff4-b958-93cda249f623 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:34.801412 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-6326d5bd-026b-4ff4-b958-93cda249f623 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d3d7458af447bdb3f03e83a2d8559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49238b8686d24ae698679e4a1957735d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:55:34.810500 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-6326d5bd-026b-4ff4-b958-93cda249f623 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] 10.222.0.18 "GET /compute/v2.1/servers/98f48cb1-54ed-4e82-8a25-fd004ddb5758" status: 200 len: 1312 microversion: 2.1 time: 0.557293 Oct 22 20:55:34.811764 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 859/1635] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:55:34 2022] GET /compute/v2.1/servers/98f48cb1-54ed-4e82-8a25-fd004ddb5758 => generated 1312 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:55:34.817698 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-634378f0-bfa5-446f-ac20-549d59db55d7 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:55:34.818782 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-634378f0-bfa5-446f-ac20-549d59db55d7 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] [instance: a64fa89e-32f6-4994-a0b2-3788cf1c92ec] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:55:34.825381 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-634378f0-bfa5-446f-ac20-549d59db55d7 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:34.826085 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-634378f0-bfa5-446f-ac20-549d59db55d7 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:34.826759 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-634378f0-bfa5-446f-ac20-549d59db55d7 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:34.827872 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-634378f0-bfa5-446f-ac20-549d59db55d7 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:34.828742 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-634378f0-bfa5-446f-ac20-549d59db55d7 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:34.829379 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-634378f0-bfa5-446f-ac20-549d59db55d7 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:35.593397 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.network.neutron [None req-a3121b13-3afa-4a02-8cda-24dbded081a7 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] [instance: 29a351ac-ecf5-4b11-9bdd-f1c93df1335a] Building network info cache for instance {{(pid=138744) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 22 20:55:35.811248 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-634378f0-bfa5-446f-ac20-549d59db55d7 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b392ad1fe1fd4b2a9e6be03a7435deb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594624ed28aa433d907c8833d360b82e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:55:35.856140 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-634378f0-bfa5-446f-ac20-549d59db55d7 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] 10.222.0.18 "GET /compute/v2.1/servers/a64fa89e-32f6-4994-a0b2-3788cf1c92ec" status: 200 len: 1521 microversion: 2.1 time: 1.035106 Oct 22 20:55:35.857462 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 860/1636] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:55:34 2022] GET /compute/v2.1/servers/a64fa89e-32f6-4994-a0b2-3788cf1c92ec => generated 1521 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:55:35.866969 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell0:SELECT=4 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:55:35.868632 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-362e9da9-d00b-4f71-a398-2754b60d9f35 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:55:35.871416 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-362e9da9-d00b-4f71-a398-2754b60d9f35 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] [instance: 1d613848-05f4-478f-a569-b4c50576edb7] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:55:35.885293 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-362e9da9-d00b-4f71-a398-2754b60d9f35 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:35.890677 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-362e9da9-d00b-4f71-a398-2754b60d9f35 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:35.891533 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-362e9da9-d00b-4f71-a398-2754b60d9f35 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:35.892512 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-362e9da9-d00b-4f71-a398-2754b60d9f35 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:35.893215 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-362e9da9-d00b-4f71-a398-2754b60d9f35 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:35.894448 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-362e9da9-d00b-4f71-a398-2754b60d9f35 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:35.896051 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell0:SELECT=6 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:55:36.610262 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-362e9da9-d00b-4f71-a398-2754b60d9f35 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:55:36.621897 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-362e9da9-d00b-4f71-a398-2754b60d9f35 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:55:36.628121 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-362e9da9-d00b-4f71-a398-2754b60d9f35 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:55:36.631136 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-362e9da9-d00b-4f71-a398-2754b60d9f35 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] 10.222.0.18 "GET /compute/v2.1/servers/1d613848-05f4-478f-a569-b4c50576edb7" status: 200 len: 1565 microversion: 2.25 time: 0.772393 Oct 22 20:55:36.633506 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 861/1637] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 20:55:35 2022] GET /compute/v2.1/servers/1d613848-05f4-478f-a569-b4c50576edb7 => generated 1565 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 20:55:36.661507 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-e7c0efe5-6c1a-48c8-9c74-a8f7701f3e3e tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:55:36.662540 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-e7c0efe5-6c1a-48c8-9c74-a8f7701f3e3e tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] [instance: fbb34507-cef9-4d78-9ed7-5d6eab4ca806] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:55:36.683798 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e7c0efe5-6c1a-48c8-9c74-a8f7701f3e3e tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:36.687484 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e7c0efe5-6c1a-48c8-9c74-a8f7701f3e3e tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:36.688393 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e7c0efe5-6c1a-48c8-9c74-a8f7701f3e3e tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:36.689437 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e7c0efe5-6c1a-48c8-9c74-a8f7701f3e3e tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:36.692589 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e7c0efe5-6c1a-48c8-9c74-a8f7701f3e3e tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:36.693728 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e7c0efe5-6c1a-48c8-9c74-a8f7701f3e3e tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:37.263952 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-e7c0efe5-6c1a-48c8-9c74-a8f7701f3e3e tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c87f0356ca346f39c6216393d85da2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee8c8f7fc4e12bc1f9fcce3e7b581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:55:37.301017 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-e7c0efe5-6c1a-48c8-9c74-a8f7701f3e3e tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] 10.222.0.18 "GET /compute/v2.1/servers/fbb34507-cef9-4d78-9ed7-5d6eab4ca806" status: 200 len: 1392 microversion: 2.1 time: 0.644339 Oct 22 20:55:37.332540 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 862/1638] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:55:36 2022] GET /compute/v2.1/servers/fbb34507-cef9-4d78-9ed7-5d6eab4ca806 => generated 1392 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:55:37.354253 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-9421b06b-6ca3-4b70-aa6e-bd4d154d4990 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:55:37.356945 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-9421b06b-6ca3-4b70-aa6e-bd4d154d4990 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] [instance: bccbf2b3-70e3-406d-b844-e48d765732cf] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:55:37.373729 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9421b06b-6ca3-4b70-aa6e-bd4d154d4990 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:37.376800 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9421b06b-6ca3-4b70-aa6e-bd4d154d4990 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:37.377334 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9421b06b-6ca3-4b70-aa6e-bd4d154d4990 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:37.380338 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9421b06b-6ca3-4b70-aa6e-bd4d154d4990 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:37.382389 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9421b06b-6ca3-4b70-aa6e-bd4d154d4990 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:37.385666 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9421b06b-6ca3-4b70-aa6e-bd4d154d4990 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:38.031390 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell0:SELECT=4 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:55:38.080265 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell0:SELECT=6 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:55:38.107168 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-9421b06b-6ca3-4b70-aa6e-bd4d154d4990 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b638db630404ebbbcc2253db30844c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cc7342bf7941d2ad7ebc70032dd52e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:55:38.123231 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-9421b06b-6ca3-4b70-aa6e-bd4d154d4990 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] 10.222.0.18 "GET /compute/v2.1/servers/bccbf2b3-70e3-406d-b844-e48d765732cf" status: 200 len: 1318 microversion: 2.1 time: 0.789073 Oct 22 20:55:38.126719 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 863/1639] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:55:37 2022] GET /compute/v2.1/servers/bccbf2b3-70e3-406d-b844-e48d765732cf => generated 1318 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:55:38.146472 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-4c124a2e-b2e0-4c87-8ec9-e58f9eaf5273 req-88328209-fc7e-4aa8-85b3-9f204f686739 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29a351ac-ecf5-4b11-9bdd-f1c93df1335a", "tag": "07fb8283-cc10-46e3-bd70-2c1e5b8c3aef"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:55:38.176622 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-4c124a2e-b2e0-4c87-8ec9-e58f9eaf5273 req-88328209-fc7e-4aa8-85b3-9f204f686739 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:38.178021 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-4c124a2e-b2e0-4c87-8ec9-e58f9eaf5273 req-88328209-fc7e-4aa8-85b3-9f204f686739 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:38.179054 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-4c124a2e-b2e0-4c87-8ec9-e58f9eaf5273 req-88328209-fc7e-4aa8-85b3-9f204f686739 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:38.193158 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-4c124a2e-b2e0-4c87-8ec9-e58f9eaf5273 req-88328209-fc7e-4aa8-85b3-9f204f686739 service nova] Creating event network-changed:07fb8283-cc10-46e3-bd70-2c1e5b8c3aef for instance 29a351ac-ecf5-4b11-9bdd-f1c93df1335a on nch2-master-1 Oct 22 20:55:38.199470 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-4c124a2e-b2e0-4c87-8ec9-e58f9eaf5273 req-88328209-fc7e-4aa8-85b3-9f204f686739 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069964 Oct 22 20:55:38.200813 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 864/1640] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:55:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:55:38.207269 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-4a160053-2b7b-4b51-8baf-6c1a2cf3946d tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:55:38.208458 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-4a160053-2b7b-4b51-8baf-6c1a2cf3946d tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] [instance: 98f48cb1-54ed-4e82-8a25-fd004ddb5758] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:55:38.215829 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4a160053-2b7b-4b51-8baf-6c1a2cf3946d tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:38.217230 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4a160053-2b7b-4b51-8baf-6c1a2cf3946d tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:38.217953 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4a160053-2b7b-4b51-8baf-6c1a2cf3946d tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:38.218947 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4a160053-2b7b-4b51-8baf-6c1a2cf3946d tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:38.219778 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4a160053-2b7b-4b51-8baf-6c1a2cf3946d tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:38.220469 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4a160053-2b7b-4b51-8baf-6c1a2cf3946d tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:38.833818 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.network.neutron [None req-a3121b13-3afa-4a02-8cda-24dbded081a7 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] [instance: 29a351ac-ecf5-4b11-9bdd-f1c93df1335a] Updating instance_info_cache with network_info: [{"id": "07fb8283-cc10-46e3-bd70-2c1e5b8c3aef", "address": "fa:16:3e:7a:11:63", "network": {"id": "ba2fbd7d-5bd8-4316-b6a5-ea0e685a80cc", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1738311782-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.2.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "42111ed6bcc3465d8c1f5291da248e74", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap07fb8283-cc", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=138744) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 22 20:55:38.840398 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-4a160053-2b7b-4b51-8baf-6c1a2cf3946d tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d3d7458af447bdb3f03e83a2d8559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49238b8686d24ae698679e4a1957735d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:55:38.856314 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-4a160053-2b7b-4b51-8baf-6c1a2cf3946d tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] 10.222.0.18 "GET /compute/v2.1/servers/98f48cb1-54ed-4e82-8a25-fd004ddb5758" status: 200 len: 1312 microversion: 2.1 time: 0.653774 Oct 22 20:55:38.859752 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a3121b13-3afa-4a02-8cda-24dbded081a7 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Releasing lock "refresh_cache-29a351ac-ecf5-4b11-9bdd-f1c93df1335a" {{(pid=138744) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 22 20:55:38.861113 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-a3121b13-3afa-4a02-8cda-24dbded081a7 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] 10.222.0.18 "POST /compute/v2.1/servers/29a351ac-ecf5-4b11-9bdd-f1c93df1335a/action" status: 202 len: 0 microversion: 2.1 time: 7.667644 Oct 22 20:55:38.862007 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 777/1641] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 20:55:31 2022] POST /compute/v2.1/servers/29a351ac-ecf5-4b11-9bdd-f1c93df1335a/action => generated 0 bytes in 7669 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 22 20:55:38.867708 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-5f74e5c8-e2a1-4c72-933e-f624dd7ba4e4 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:55:38.868775 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-5f74e5c8-e2a1-4c72-933e-f624dd7ba4e4 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] [instance: a64fa89e-32f6-4994-a0b2-3788cf1c92ec] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:55:38.872356 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 865/1642] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:55:38 2022] GET /compute/v2.1/servers/98f48cb1-54ed-4e82-8a25-fd004ddb5758 => generated 1312 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:55:38.876412 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5f74e5c8-e2a1-4c72-933e-f624dd7ba4e4 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:38.876914 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5f74e5c8-e2a1-4c72-933e-f624dd7ba4e4 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:38.877568 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5f74e5c8-e2a1-4c72-933e-f624dd7ba4e4 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:38.879168 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5f74e5c8-e2a1-4c72-933e-f624dd7ba4e4 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:38.879797 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5f74e5c8-e2a1-4c72-933e-f624dd7ba4e4 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:38.880236 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5f74e5c8-e2a1-4c72-933e-f624dd7ba4e4 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:38.883477 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-ce8786ee-0723-49b0-b617-5bacb6f03ea5 req-fff413c4-1386-4443-9de4-c38b04c7d627 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fbb34507-cef9-4d78-9ed7-5d6eab4ca806", "name": "network-vif-unplugged", "status": "completed", "tag": "21ed77e4-8dab-449b-afdb-01e27ef6b85c"}, {"name": "network-changed", "server_uuid": "73404cab-dc0f-4f1c-b38b-a1505a5dc8b2", "tag": "fbd90195-446f-40e0-bd14-a4a338e00ca1"}, {"name": "network-changed", "server_uuid": "fbb34507-cef9-4d78-9ed7-5d6eab4ca806", "tag": "21ed77e4-8dab-449b-afdb-01e27ef6b85c"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:55:38.896559 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-ce8786ee-0723-49b0-b617-5bacb6f03ea5 req-fff413c4-1386-4443-9de4-c38b04c7d627 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:38.897048 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-ce8786ee-0723-49b0-b617-5bacb6f03ea5 req-fff413c4-1386-4443-9de4-c38b04c7d627 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:38.897485 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-ce8786ee-0723-49b0-b617-5bacb6f03ea5 req-fff413c4-1386-4443-9de4-c38b04c7d627 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:38.916039 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-ce8786ee-0723-49b0-b617-5bacb6f03ea5 req-fff413c4-1386-4443-9de4-c38b04c7d627 service nova] Creating event network-vif-unplugged:21ed77e4-8dab-449b-afdb-01e27ef6b85c for instance fbb34507-cef9-4d78-9ed7-5d6eab4ca806 on nch1-master-1 Oct 22 20:55:38.916717 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-ce8786ee-0723-49b0-b617-5bacb6f03ea5 req-fff413c4-1386-4443-9de4-c38b04c7d627 service nova] Creating event network-changed:fbd90195-446f-40e0-bd14-a4a338e00ca1 for instance 73404cab-dc0f-4f1c-b38b-a1505a5dc8b2 on nch1-master-1 Oct 22 20:55:38.917226 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-ce8786ee-0723-49b0-b617-5bacb6f03ea5 req-fff413c4-1386-4443-9de4-c38b04c7d627 service nova] Creating event network-changed:21ed77e4-8dab-449b-afdb-01e27ef6b85c for instance fbb34507-cef9-4d78-9ed7-5d6eab4ca806 on nch1-master-1 Oct 22 20:55:38.925236 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-ce8786ee-0723-49b0-b617-5bacb6f03ea5 req-fff413c4-1386-4443-9de4-c38b04c7d627 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 519 microversion: 2.1 time: 0.051336 Oct 22 20:55:38.926185 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 866/1643] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:55:38 2022] POST /compute/v2.1/os-server-external-events => generated 519 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:55:38.932266 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-4a31c25b-e8dd-45f1-9f91-7a0a74cc237a tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:55:38.932988 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-4a31c25b-e8dd-45f1-9f91-7a0a74cc237a tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] [instance: 1d613848-05f4-478f-a569-b4c50576edb7] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:55:38.940359 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4a31c25b-e8dd-45f1-9f91-7a0a74cc237a tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:38.940861 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4a31c25b-e8dd-45f1-9f91-7a0a74cc237a tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:38.941351 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4a31c25b-e8dd-45f1-9f91-7a0a74cc237a tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:38.942564 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4a31c25b-e8dd-45f1-9f91-7a0a74cc237a tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:38.943027 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4a31c25b-e8dd-45f1-9f91-7a0a74cc237a tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:38.943676 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4a31c25b-e8dd-45f1-9f91-7a0a74cc237a tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:38.981433 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4a31c25b-e8dd-45f1-9f91-7a0a74cc237a tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:38.982253 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4a31c25b-e8dd-45f1-9f91-7a0a74cc237a tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:38.983718 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4a31c25b-e8dd-45f1-9f91-7a0a74cc237a tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:38.984384 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.objects.instance [None req-4a31c25b-e8dd-45f1-9f91-7a0a74cc237a tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lazy-loading 'fault' on Instance uuid 1d613848-05f4-478f-a569-b4c50576edb7 {{(pid=138745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 20:55:39.059682 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-4a31c25b-e8dd-45f1-9f91-7a0a74cc237a tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:55:39.078882 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-4a31c25b-e8dd-45f1-9f91-7a0a74cc237a tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:55:39.084952 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-4a31c25b-e8dd-45f1-9f91-7a0a74cc237a tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c41b7be1724632b0d6bd2bd3b57f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11060bbcab6b45cabb1457319d72b982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:55:39.086783 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-4a31c25b-e8dd-45f1-9f91-7a0a74cc237a tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] 10.222.0.18 "GET /compute/v2.1/servers/1d613848-05f4-478f-a569-b4c50576edb7" status: 200 len: 1352 microversion: 2.25 time: 0.158854 Oct 22 20:55:39.102726 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 867/1644] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 20:55:38 2022] GET /compute/v2.1/servers/1d613848-05f4-478f-a569-b4c50576edb7 => generated 1352 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 20:55:39.107612 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-2293f15b-e0ca-459e-96f4-ee1837956f35 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:55:39.108233 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-2293f15b-e0ca-459e-96f4-ee1837956f35 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] [instance: fbb34507-cef9-4d78-9ed7-5d6eab4ca806] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:55:39.126521 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2293f15b-e0ca-459e-96f4-ee1837956f35 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:39.127459 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2293f15b-e0ca-459e-96f4-ee1837956f35 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:39.128172 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2293f15b-e0ca-459e-96f4-ee1837956f35 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:39.129277 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2293f15b-e0ca-459e-96f4-ee1837956f35 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:39.129854 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2293f15b-e0ca-459e-96f4-ee1837956f35 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:39.130287 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2293f15b-e0ca-459e-96f4-ee1837956f35 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:39.265958 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-5f74e5c8-e2a1-4c72-933e-f624dd7ba4e4 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b392ad1fe1fd4b2a9e6be03a7435deb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594624ed28aa433d907c8833d360b82e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:55:39.276205 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-5f74e5c8-e2a1-4c72-933e-f624dd7ba4e4 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] 10.222.0.18 "GET /compute/v2.1/servers/a64fa89e-32f6-4994-a0b2-3788cf1c92ec" status: 200 len: 1521 microversion: 2.1 time: 0.412849 Oct 22 20:55:39.278807 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 778/1645] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:55:38 2022] GET /compute/v2.1/servers/a64fa89e-32f6-4994-a0b2-3788cf1c92ec => generated 1521 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:55:39.283759 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-c8bb493c-1324-4326-aae3-0f6ea051c530 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.35.2.224"}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:55:39.286371 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-c8bb493c-1324-4326-aae3-0f6ea051c530 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] [instance: 532d6e6a-71ab-4ef0-a5bf-c042055c5121] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:55:39.295630 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c8bb493c-1324-4326-aae3-0f6ea051c530 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:39.296394 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c8bb493c-1324-4326-aae3-0f6ea051c530 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:39.297050 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c8bb493c-1324-4326-aae3-0f6ea051c530 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:39.298232 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c8bb493c-1324-4326-aae3-0f6ea051c530 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:39.303732 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c8bb493c-1324-4326-aae3-0f6ea051c530 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:39.304352 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c8bb493c-1324-4326-aae3-0f6ea051c530 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:39.407165 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c8bb493c-1324-4326-aae3-0f6ea051c530 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Acquiring lock "refresh_cache-532d6e6a-71ab-4ef0-a5bf-c042055c5121" {{(pid=138744) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 22 20:55:39.408000 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c8bb493c-1324-4326-aae3-0f6ea051c530 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Acquired lock "refresh_cache-532d6e6a-71ab-4ef0-a5bf-c042055c5121" {{(pid=138744) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 22 20:55:39.478760 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-2293f15b-e0ca-459e-96f4-ee1837956f35 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c87f0356ca346f39c6216393d85da2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee8c8f7fc4e12bc1f9fcce3e7b581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:55:39.487955 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-2293f15b-e0ca-459e-96f4-ee1837956f35 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] 10.222.0.18 "GET /compute/v2.1/servers/fbb34507-cef9-4d78-9ed7-5d6eab4ca806" status: 200 len: 1392 microversion: 2.1 time: 0.384033 Oct 22 20:55:39.499366 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 868/1646] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:55:39 2022] GET /compute/v2.1/servers/fbb34507-cef9-4d78-9ed7-5d6eab4ca806 => generated 1392 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:55:39.553322 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-c06757cb-9dd4-422b-83d3-5a8bd245653b tempest-ServersTestFqdnHostnames-400258971 tempest-ServersTestFqdnHostnames-400258971-project] Action: 'create', calling method: .version_select at 0x7fd39fcd8af0>, body: {"keypair": {"name": "tempest-keypair-1094706457", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF4iAxw8S/pB4w8Z2SDQOU4p4JiGNNzvXCR1B//QeqJ9kHL09H/FmKWZ63RQFaz9JX40CCHKpaGaS4bzpK071T1uoKw/jfMdiNf8Mon3tcrJGFn9GBUtqBfcvyP0fHWd3A=="}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:55:39.618788 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-c06757cb-9dd4-422b-83d3-5a8bd245653b tempest-ServersTestFqdnHostnames-400258971 tempest-ServersTestFqdnHostnames-400258971-project] Getting quotas for project b3b75771ecf442919c647f15d499880e. Resources: {'key_pairs'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 20:55:39.625817 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-c06757cb-9dd4-422b-83d3-5a8bd245653b tempest-ServersTestFqdnHostnames-400258971 tempest-ServersTestFqdnHostnames-400258971-project] Getting quotas for user 02fdeda494a547f1a8714007e05e874d and project b3b75771ecf442919c647f15d499880e. Resources: {'key_pairs'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 20:55:39.684051 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-c06757cb-9dd4-422b-83d3-5a8bd245653b tempest-ServersTestFqdnHostnames-400258971 tempest-ServersTestFqdnHostnames-400258971-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.193957 Oct 22 20:55:39.691069 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 869/1647] 10.222.0.18 () {60 vars in 1159 bytes} [Sat Oct 22 20:55:39 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:55:39.696607 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-31252047-800e-4d53-9478-0574f947c62e tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:55:39.697440 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-31252047-800e-4d53-9478-0574f947c62e tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] [instance: bccbf2b3-70e3-406d-b844-e48d765732cf] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:55:39.704962 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-31252047-800e-4d53-9478-0574f947c62e tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:39.705702 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-31252047-800e-4d53-9478-0574f947c62e tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:39.706377 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-31252047-800e-4d53-9478-0574f947c62e tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:39.707293 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-31252047-800e-4d53-9478-0574f947c62e tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:39.707937 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-31252047-800e-4d53-9478-0574f947c62e tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:39.708525 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-31252047-800e-4d53-9478-0574f947c62e tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:40.160039 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-31252047-800e-4d53-9478-0574f947c62e tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b638db630404ebbbcc2253db30844c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cc7342bf7941d2ad7ebc70032dd52e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:55:40.171776 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-31252047-800e-4d53-9478-0574f947c62e tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] 10.222.0.18 "GET /compute/v2.1/servers/bccbf2b3-70e3-406d-b844-e48d765732cf" status: 200 len: 1318 microversion: 2.1 time: 0.479169 Oct 22 20:55:40.174753 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 870/1648] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:55:39 2022] GET /compute/v2.1/servers/bccbf2b3-70e3-406d-b844-e48d765732cf => generated 1318 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:55:40.193089 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-414a1d3e-6a09-4aa9-a76f-a7a294160152 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-548225067", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:55:40.201429 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-414a1d3e-6a09-4aa9-a76f-a7a294160152 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Request method failure captured: Oct 22 20:55:40.201429 ncdv-master-1 devstack@n-api.service[138745]: request: POST /compute/v2.1/servers/a64fa89e-32f6-4994-a0b2-3788cf1c92ec/action HTTP/1.1 Oct 22 20:55:40.201429 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 20:55:40.201429 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 20:55:40.201429 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 20:55:40.201429 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 618 Oct 22 20:55:40.201429 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 20:55:40.201429 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 20:55:40.201429 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 20:55:40.201429 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 20:55:40.201429 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVFinkWQQBhkrT1IKOpDugEkOlAPWNZyP_2NMwr13b9XeVy4UUzw2acgfBjDE3p8vwfHK2_Q3RMg9yYmateTjw8EQOHA7IN0HeuqzZ5uQWL0ysIIG3e_nACVRZdRICvuIM06IV17ajtcJTdsfcK0wPQNbKtAOZi6_8a2UUHyQ1NeNuzI Oct 22 20:55:40.201429 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 20:55:40.201429 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 20:55:40.201429 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 20:55:40.201429 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 20:55:40.201429 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 20:55:40.201429 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 20:55:40.201429 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: 594624ed28aa433d907c8833d360b82e Oct 22 20:55:40.201429 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-477371163 Oct 22 20:55:40.201429 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 20:55:40.201429 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 20:55:40.201429 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_594624ed28aa433d907c8833d360b82e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/594624ed28aa433d907c8833d360b82e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/594624ed28aa433d907c8833d360b82e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/594624ed28aa433d907c8833d360b82e"}]}] Oct 22 20:55:40.201429 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-477371163 Oct 22 20:55:40.201429 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: 594624ed28aa433d907c8833d360b82e Oct 22 20:55:40.201429 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-477371163 Oct 22 20:55:40.201429 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-ImagesOneServerNegativeTestJSON-477371163-project Oct 22 20:55:40.201429 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 20:55:40.201429 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 20:55:40.201429 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: b392ad1fe1fd4b2a9e6be03a7435deb9 Oct 22 20:55:40.201429 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-477371163-project Oct 22 20:55:40.201429 ncdv-master-1 devstack@n-api.service[138745]: Oct 22 20:55:40.201429 ncdv-master-1 devstack@n-api.service[138745]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-548225067", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} Oct 22 20:55:40.201429 ncdv-master-1 devstack@n-api.service[138745]: method: > Oct 22 20:55:40.201429 ncdv-master-1 devstack@n-api.service[138745]: exception: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 22 20:55:40.201429 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'id': 'a64fa89e-32f6-4994-a0b2-3788cf1c92ec', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-548225067', 'metadata': {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}}}} Oct 22 20:55:40.201429 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:55:40.201429 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:55:40.201429 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 22 20:55:40.201429 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 22 20:55:40.201429 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 22 20:55:40.201429 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise error Oct 22 20:55:40.205232 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 22 20:55:40.205232 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:55:40.205232 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Oct 22 20:55:40.205232 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 22 20:55:40.205232 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 22 20:55:40.205232 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 22 20:55:40.205232 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 22 20:55:40.205232 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:55:40.205232 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi On instance['createImage']: Oct 22 20:55:40.205232 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'} Oct 22 20:55:40.205232 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:55:40.205232 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:55:40.205232 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:55:40.205232 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:55:40.205232 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:55:40.205232 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:55:40.205232 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:55:40.205232 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:55:40.205232 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:55:40.205232 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:55:40.205232 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 20:55:40.205232 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 20:55:40.205232 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 22 20:55:40.205232 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 22 20:55:40.205232 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 22 20:55:40.205232 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 22 20:55:40.205232 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 22 20:55:40.205232 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 22 20:55:40.205232 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 22 20:55:40.205232 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:55:40.205232 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:55:40.205232 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:55:40.205232 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:55:40.205232 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:55:40.205232 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:55:40.205232 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 22 20:55:40.205232 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 22 20:55:40.205232 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 22 20:55:40.205232 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:55:40.213903 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-414a1d3e-6a09-4aa9-a76f-a7a294160152 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:55:40.215011 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-414a1d3e-6a09-4aa9-a76f-a7a294160152 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] 10.222.0.18 "POST /compute/v2.1/servers/a64fa89e-32f6-4994-a0b2-3788cf1c92ec/action" status: 400 len: 938 microversion: 2.1 time: 0.039047 Oct 22 20:55:40.215829 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 871/1649] 10.222.0.18 () {60 vars in 1279 bytes} [Sat Oct 22 20:55:40 2022] POST /compute/v2.1/servers/a64fa89e-32f6-4994-a0b2-3788cf1c92ec/action => generated 938 bytes in 40 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 22 20:55:40.232793 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-147a0e9e-f9e0-4072-811c-49730ee6cb24 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:55:40.233725 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-147a0e9e-f9e0-4072-811c-49730ee6cb24 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] [instance: 98f48cb1-54ed-4e82-8a25-fd004ddb5758] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:55:40.247214 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-147a0e9e-f9e0-4072-811c-49730ee6cb24 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:40.250497 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-147a0e9e-f9e0-4072-811c-49730ee6cb24 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:40.251156 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-147a0e9e-f9e0-4072-811c-49730ee6cb24 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:40.252084 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-147a0e9e-f9e0-4072-811c-49730ee6cb24 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:40.255677 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-147a0e9e-f9e0-4072-811c-49730ee6cb24 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:40.256320 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-147a0e9e-f9e0-4072-811c-49730ee6cb24 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:40.721009 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-147a0e9e-f9e0-4072-811c-49730ee6cb24 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d3d7458af447bdb3f03e83a2d8559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49238b8686d24ae698679e4a1957735d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:55:40.735238 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-147a0e9e-f9e0-4072-811c-49730ee6cb24 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] 10.222.0.18 "GET /compute/v2.1/servers/98f48cb1-54ed-4e82-8a25-fd004ddb5758" status: 200 len: 1312 microversion: 2.1 time: 0.511409 Oct 22 20:55:40.735914 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 872/1650] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:55:40 2022] GET /compute/v2.1/servers/98f48cb1-54ed-4e82-8a25-fd004ddb5758 => generated 1312 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:55:40.752170 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-13ad44a8-e55c-4d90-94b6-527f643cc4d6 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:55:40.752856 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-13ad44a8-e55c-4d90-94b6-527f643cc4d6 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] [instance: 1d613848-05f4-478f-a569-b4c50576edb7] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:55:40.777105 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-13ad44a8-e55c-4d90-94b6-527f643cc4d6 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:40.787761 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-13ad44a8-e55c-4d90-94b6-527f643cc4d6 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:40.789077 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-13ad44a8-e55c-4d90-94b6-527f643cc4d6 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:40.794693 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-13ad44a8-e55c-4d90-94b6-527f643cc4d6 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:40.797491 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-13ad44a8-e55c-4d90-94b6-527f643cc4d6 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:40.808416 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-13ad44a8-e55c-4d90-94b6-527f643cc4d6 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:40.834154 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.wsgi [None req-13ad44a8-e55c-4d90-94b6-527f643cc4d6 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] HTTP exception thrown: Instance 1d613848-05f4-478f-a569-b4c50576edb7 could not be found. Oct 22 20:55:40.837736 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-13ad44a8-e55c-4d90-94b6-527f643cc4d6 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Request method failure captured: Oct 22 20:55:40.837736 ncdv-master-1 devstack@n-api.service[138745]: request: GET /compute/v2.1/servers/1d613848-05f4-478f-a569-b4c50576edb7 HTTP/1.1 Oct 22 20:55:40.837736 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 20:55:40.837736 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 20:55:40.837736 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 20:55:40.837736 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 0 Oct 22 20:55:40.837736 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 20:55:40.837736 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 20:55:40.837736 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 20:55:40.837736 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 20:55:40.837736 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVFc6ze-JvRNBYUoDY8DxRahatFrOlr2DH1Jj7tx4qgH6khVz1HoW_8kE7y_rlkudvvybXKphF1vkSLvPaAzyp66bqbcfISFjN01CiLISj28Sbh99A72aXrDBEAGyFUniWRH7nPnKw64FY4yGK7_HqZN5InCILmg2TRDUJKhlz6tDI4s Oct 22 20:55:40.837736 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 20:55:40.837736 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 20:55:40.837736 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 20:55:40.837736 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 20:55:40.837736 ncdv-master-1 devstack@n-api.service[138745]: X-Openstack-Nova-Api-Version: 2.25 Oct 22 20:55:40.837736 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 20:55:40.837736 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 20:55:40.837736 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: 11060bbcab6b45cabb1457319d72b982 Oct 22 20:55:40.837736 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1332499062 Oct 22 20:55:40.837736 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 20:55:40.837736 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 20:55:40.837736 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_11060bbcab6b45cabb1457319d72b982"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/11060bbcab6b45cabb1457319d72b982"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/11060bbcab6b45cabb1457319d72b982"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/11060bbcab6b45cabb1457319d72b982"}]}] Oct 22 20:55:40.837736 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1332499062 Oct 22 20:55:40.837736 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: 11060bbcab6b45cabb1457319d72b982 Oct 22 20:55:40.837736 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1332499062 Oct 22 20:55:40.837736 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-LiveAutoBlockMigrationV225Test-1332499062-project Oct 22 20:55:40.837736 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 20:55:40.837736 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 20:55:40.837736 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: 93c41b7be1724632b0d6bd2bd3b57f8f Oct 22 20:55:40.837736 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1332499062-project Oct 22 20:55:40.837736 ncdv-master-1 devstack@n-api.service[138745]: method: > Oct 22 20:55:40.837736 ncdv-master-1 devstack@n-api.service[138745]: exception: Instance 1d613848-05f4-478f-a569-b4c50576edb7 could not be found. Oct 22 20:55:40.837736 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'id': '1d613848-05f4-478f-a569-b4c50576edb7'} Oct 22 20:55:40.837736 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:55:40.837736 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:55:40.837736 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 20:55:40.837736 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 20:55:40.837736 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 20:55:40.837736 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 20:55:40.837736 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 20:55:40.837736 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 20:55:40.837736 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 20:55:40.837736 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 20:55:40.837736 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1d613848-05f4-478f-a569-b4c50576edb7 could not be found. Oct 22 20:55:40.837736 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:55:40.837736 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:55:40.837736 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:55:40.837736 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:55:40.837736 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:55:40.837736 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:55:40.837736 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:55:40.837736 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:55:40.837736 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:55:40.837736 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:55:40.837736 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 20:55:40.837736 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 20:55:40.837736 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 20:55:40.837736 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 20:55:40.837736 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 20:55:40.837736 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 20:55:40.837736 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1d613848-05f4-478f-a569-b4c50576edb7 could not be found. Oct 22 20:55:40.837736 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:55:40.848641 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:55:40.848641 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:55:40.848641 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:55:40.848641 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:55:40.848641 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:55:40.848641 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 20:55:40.848641 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 20:55:40.848641 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1d613848-05f4-478f-a569-b4c50576edb7 could not be found. Oct 22 20:55:40.848641 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:55:40.852844 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-13ad44a8-e55c-4d90-94b6-527f643cc4d6 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] Returning 404 to user: Instance 1d613848-05f4-478f-a569-b4c50576edb7 could not be found. {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:55:40.858151 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-13ad44a8-e55c-4d90-94b6-527f643cc4d6 tempest-LiveAutoBlockMigrationV225Test-1332499062 tempest-LiveAutoBlockMigrationV225Test-1332499062-project] 10.222.0.18 "GET /compute/v2.1/servers/1d613848-05f4-478f-a569-b4c50576edb7" status: 404 len: 111 microversion: 2.25 time: 0.117238 Oct 22 20:55:40.859831 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 873/1651] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 20:55:40 2022] GET /compute/v2.1/servers/1d613848-05f4-478f-a569-b4c50576edb7 => generated 111 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 22 20:55:40.867167 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-f0d2ca89-bd1f-4857-887d-ace3768c1506 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:55:40.884066 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-f0d2ca89-bd1f-4857-887d-ace3768c1506 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] [instance: a64fa89e-32f6-4994-a0b2-3788cf1c92ec] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:55:40.907379 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f0d2ca89-bd1f-4857-887d-ace3768c1506 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:40.910439 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f0d2ca89-bd1f-4857-887d-ace3768c1506 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:40.910971 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f0d2ca89-bd1f-4857-887d-ace3768c1506 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:40.911817 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f0d2ca89-bd1f-4857-887d-ace3768c1506 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:40.912280 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f0d2ca89-bd1f-4857-887d-ace3768c1506 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:40.912675 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f0d2ca89-bd1f-4857-887d-ace3768c1506 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:41.401841 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-f0d2ca89-bd1f-4857-887d-ace3768c1506 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b392ad1fe1fd4b2a9e6be03a7435deb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594624ed28aa433d907c8833d360b82e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:55:41.413330 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-f0d2ca89-bd1f-4857-887d-ace3768c1506 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] 10.222.0.18 "GET /compute/v2.1/servers/a64fa89e-32f6-4994-a0b2-3788cf1c92ec" status: 200 len: 1521 microversion: 2.1 time: 0.551733 Oct 22 20:55:41.415006 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 874/1652] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:55:40 2022] GET /compute/v2.1/servers/a64fa89e-32f6-4994-a0b2-3788cf1c92ec => generated 1521 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:55:41.444963 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-91c0fdca-5b6f-4984-bb61-0f14546424df tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:55:41.446805 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-91c0fdca-5b6f-4984-bb61-0f14546424df tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] [instance: fbb34507-cef9-4d78-9ed7-5d6eab4ca806] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:55:41.461401 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-91c0fdca-5b6f-4984-bb61-0f14546424df tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:41.462616 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-91c0fdca-5b6f-4984-bb61-0f14546424df tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:41.463458 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-91c0fdca-5b6f-4984-bb61-0f14546424df tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:41.465826 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-91c0fdca-5b6f-4984-bb61-0f14546424df tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:41.466632 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-91c0fdca-5b6f-4984-bb61-0f14546424df tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:41.467382 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-91c0fdca-5b6f-4984-bb61-0f14546424df tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:41.501786 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:55:41.911262 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-91c0fdca-5b6f-4984-bb61-0f14546424df tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c87f0356ca346f39c6216393d85da2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee8c8f7fc4e12bc1f9fcce3e7b581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:55:41.926322 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-91c0fdca-5b6f-4984-bb61-0f14546424df tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] 10.222.0.18 "GET /compute/v2.1/servers/fbb34507-cef9-4d78-9ed7-5d6eab4ca806" status: 200 len: 1392 microversion: 2.1 time: 0.510028 Oct 22 20:55:41.927118 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 875/1653] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:55:41 2022] GET /compute/v2.1/servers/fbb34507-cef9-4d78-9ed7-5d6eab4ca806 => generated 1392 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:55:41.936021 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-97c3ffeb-c7af-43b8-945d-aee14f507d6d req-641ce1ea-d3cc-4db1-a85b-64a8bce55f5a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bccbf2b3-70e3-406d-b844-e48d765732cf", "tag": "f10bd596-45de-410e-8f59-646e0dbcc5cc"}, {"server_uuid": "1d613848-05f4-478f-a569-b4c50576edb7", "name": "network-vif-deleted", "tag": "6bf75146-c298-478b-aee3-b0be607e5d87"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:55:41.953913 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-97c3ffeb-c7af-43b8-945d-aee14f507d6d req-641ce1ea-d3cc-4db1-a85b-64a8bce55f5a service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:41.954791 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-97c3ffeb-c7af-43b8-945d-aee14f507d6d req-641ce1ea-d3cc-4db1-a85b-64a8bce55f5a service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:41.955527 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-97c3ffeb-c7af-43b8-945d-aee14f507d6d req-641ce1ea-d3cc-4db1-a85b-64a8bce55f5a service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:41.982871 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-97c3ffeb-c7af-43b8-945d-aee14f507d6d req-641ce1ea-d3cc-4db1-a85b-64a8bce55f5a service nova] Creating event network-changed:f10bd596-45de-410e-8f59-646e0dbcc5cc for instance bccbf2b3-70e3-406d-b844-e48d765732cf on nch2-master-1 Oct 22 20:55:41.983842 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-97c3ffeb-c7af-43b8-945d-aee14f507d6d req-641ce1ea-d3cc-4db1-a85b-64a8bce55f5a service nova] Creating event network-vif-deleted:6bf75146-c298-478b-aee3-b0be607e5d87 for instance 1d613848-05f4-478f-a569-b4c50576edb7 on nch1-master-1 Oct 22 20:55:42.000488 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-97c3ffeb-c7af-43b8-945d-aee14f507d6d req-641ce1ea-d3cc-4db1-a85b-64a8bce55f5a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.070787 Oct 22 20:55:42.001773 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 876/1654] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:55:41 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:55:42.008936 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-cbf69ea9-b103-41b9-8c7e-c0e57a7fac4a req-d281918a-0ee1-4b48-afe2-60dcfc642ce3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98f48cb1-54ed-4e82-8a25-fd004ddb5758", "tag": "1d82207b-0e45-42ab-8c7f-4bf4bac8d993"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:55:42.050847 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-cbf69ea9-b103-41b9-8c7e-c0e57a7fac4a req-d281918a-0ee1-4b48-afe2-60dcfc642ce3 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:42.051964 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-cbf69ea9-b103-41b9-8c7e-c0e57a7fac4a req-d281918a-0ee1-4b48-afe2-60dcfc642ce3 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:42.052580 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-cbf69ea9-b103-41b9-8c7e-c0e57a7fac4a req-d281918a-0ee1-4b48-afe2-60dcfc642ce3 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:42.077924 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-cbf69ea9-b103-41b9-8c7e-c0e57a7fac4a req-d281918a-0ee1-4b48-afe2-60dcfc642ce3 service nova] Creating event network-changed:1d82207b-0e45-42ab-8c7f-4bf4bac8d993 for instance 98f48cb1-54ed-4e82-8a25-fd004ddb5758 on nch2-master-1 Oct 22 20:55:42.093964 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-cbf69ea9-b103-41b9-8c7e-c0e57a7fac4a req-d281918a-0ee1-4b48-afe2-60dcfc642ce3 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089052 Oct 22 20:55:42.094931 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 877/1655] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:55:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:55:42.105806 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-d748e60e-9b8f-4f7c-b037-7d7317cf9133 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:55:42.110104 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-d748e60e-9b8f-4f7c-b037-7d7317cf9133 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] [instance: bccbf2b3-70e3-406d-b844-e48d765732cf] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:55:42.117557 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d748e60e-9b8f-4f7c-b037-7d7317cf9133 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:42.121623 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d748e60e-9b8f-4f7c-b037-7d7317cf9133 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:42.122137 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d748e60e-9b8f-4f7c-b037-7d7317cf9133 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:42.122882 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d748e60e-9b8f-4f7c-b037-7d7317cf9133 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:42.127155 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d748e60e-9b8f-4f7c-b037-7d7317cf9133 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:42.127916 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d748e60e-9b8f-4f7c-b037-7d7317cf9133 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:43.064789 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-d748e60e-9b8f-4f7c-b037-7d7317cf9133 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b638db630404ebbbcc2253db30844c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cc7342bf7941d2ad7ebc70032dd52e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:55:43.075911 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-d748e60e-9b8f-4f7c-b037-7d7317cf9133 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] 10.222.0.18 "GET /compute/v2.1/servers/bccbf2b3-70e3-406d-b844-e48d765732cf" status: 200 len: 1318 microversion: 2.1 time: 0.975813 Oct 22 20:55:43.088873 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 878/1656] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:55:42 2022] GET /compute/v2.1/servers/bccbf2b3-70e3-406d-b844-e48d765732cf => generated 1318 bytes in 992 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:55:43.102369 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-dddfe9af-79ed-4322-b5ca-7cb87deac111 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:55:43.103385 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-dddfe9af-79ed-4322-b5ca-7cb87deac111 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] [instance: a64fa89e-32f6-4994-a0b2-3788cf1c92ec] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:55:43.114443 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-dddfe9af-79ed-4322-b5ca-7cb87deac111 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:43.115368 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-dddfe9af-79ed-4322-b5ca-7cb87deac111 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:43.115823 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-dddfe9af-79ed-4322-b5ca-7cb87deac111 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:43.116670 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-dddfe9af-79ed-4322-b5ca-7cb87deac111 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:43.117125 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-dddfe9af-79ed-4322-b5ca-7cb87deac111 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:43.117740 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-dddfe9af-79ed-4322-b5ca-7cb87deac111 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:43.738864 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-dddfe9af-79ed-4322-b5ca-7cb87deac111 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b392ad1fe1fd4b2a9e6be03a7435deb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594624ed28aa433d907c8833d360b82e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:55:43.757610 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-dddfe9af-79ed-4322-b5ca-7cb87deac111 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] 10.222.0.18 "GET /compute/v2.1/servers/a64fa89e-32f6-4994-a0b2-3788cf1c92ec" status: 200 len: 1521 microversion: 2.1 time: 0.661861 Oct 22 20:55:43.759370 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 879/1657] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:55:43 2022] GET /compute/v2.1/servers/a64fa89e-32f6-4994-a0b2-3788cf1c92ec => generated 1521 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:55:43.773805 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-e7d8187e-f62f-402b-934d-80e48f527daf tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:55:43.774795 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-e7d8187e-f62f-402b-934d-80e48f527daf tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] [instance: 98f48cb1-54ed-4e82-8a25-fd004ddb5758] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:55:43.787712 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e7d8187e-f62f-402b-934d-80e48f527daf tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:43.788856 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e7d8187e-f62f-402b-934d-80e48f527daf tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:43.790606 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e7d8187e-f62f-402b-934d-80e48f527daf tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:43.791749 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e7d8187e-f62f-402b-934d-80e48f527daf tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:43.792530 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e7d8187e-f62f-402b-934d-80e48f527daf tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:43.793494 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e7d8187e-f62f-402b-934d-80e48f527daf tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:44.158460 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-e7d8187e-f62f-402b-934d-80e48f527daf tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d3d7458af447bdb3f03e83a2d8559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49238b8686d24ae698679e4a1957735d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:55:44.188782 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-e7d8187e-f62f-402b-934d-80e48f527daf tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] 10.222.0.18 "GET /compute/v2.1/servers/98f48cb1-54ed-4e82-8a25-fd004ddb5758" status: 200 len: 1312 microversion: 2.1 time: 0.428225 Oct 22 20:55:44.191261 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 880/1658] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:55:43 2022] GET /compute/v2.1/servers/98f48cb1-54ed-4e82-8a25-fd004ddb5758 => generated 1312 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:55:44.196184 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-098da107-c5a5-487e-9c9a-e20636531fd1 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:55:44.196804 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-098da107-c5a5-487e-9c9a-e20636531fd1 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] [instance: fbb34507-cef9-4d78-9ed7-5d6eab4ca806] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:55:44.216698 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-098da107-c5a5-487e-9c9a-e20636531fd1 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:44.217198 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-098da107-c5a5-487e-9c9a-e20636531fd1 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:44.217640 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-098da107-c5a5-487e-9c9a-e20636531fd1 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:44.218378 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-098da107-c5a5-487e-9c9a-e20636531fd1 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:44.218832 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-098da107-c5a5-487e-9c9a-e20636531fd1 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:44.219257 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-098da107-c5a5-487e-9c9a-e20636531fd1 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:44.636020 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-098da107-c5a5-487e-9c9a-e20636531fd1 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c87f0356ca346f39c6216393d85da2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee8c8f7fc4e12bc1f9fcce3e7b581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:55:44.672164 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-098da107-c5a5-487e-9c9a-e20636531fd1 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] 10.222.0.18 "GET /compute/v2.1/servers/fbb34507-cef9-4d78-9ed7-5d6eab4ca806" status: 200 len: 1392 microversion: 2.1 time: 0.479564 Oct 22 20:55:44.676316 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 881/1659] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:55:44 2022] GET /compute/v2.1/servers/fbb34507-cef9-4d78-9ed7-5d6eab4ca806 => generated 1392 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:55:44.686937 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-f650062f-9375-4d8c-9223-4ffac7b3708a tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Action: 'action', calling method: >, body: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:55:44.696851 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-f650062f-9375-4d8c-9223-4ffac7b3708a tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Request method failure captured: Oct 22 20:55:44.696851 ncdv-master-1 devstack@n-api.service[138745]: request: POST /compute/v2.1/servers/a64fa89e-32f6-4994-a0b2-3788cf1c92ec/action HTTP/1.1 Oct 22 20:55:44.696851 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 20:55:44.696851 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 20:55:44.696851 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 20:55:44.696851 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 285 Oct 22 20:55:44.696851 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 20:55:44.696851 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 20:55:44.696851 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 20:55:44.696851 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 20:55:44.696851 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVFinkWQQBhkrT1IKOpDugEkOlAPWNZyP_2NMwr13b9XeVy4UUzw2acgfBjDE3p8vwfHK2_Q3RMg9yYmateTjw8EQOHA7IN0HeuqzZ5uQWL0ysIIG3e_nACVRZdRICvuIM06IV17ajtcJTdsfcK0wPQNbKtAOZi6_8a2UUHyQ1NeNuzI Oct 22 20:55:44.696851 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 20:55:44.696851 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 20:55:44.696851 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 20:55:44.696851 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 20:55:44.696851 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 20:55:44.696851 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 20:55:44.696851 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: 594624ed28aa433d907c8833d360b82e Oct 22 20:55:44.696851 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-477371163 Oct 22 20:55:44.696851 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 20:55:44.696851 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 20:55:44.696851 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_594624ed28aa433d907c8833d360b82e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/594624ed28aa433d907c8833d360b82e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/594624ed28aa433d907c8833d360b82e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/594624ed28aa433d907c8833d360b82e"}]}] Oct 22 20:55:44.696851 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-477371163 Oct 22 20:55:44.696851 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: 594624ed28aa433d907c8833d360b82e Oct 22 20:55:44.696851 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-477371163 Oct 22 20:55:44.696851 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-ImagesOneServerNegativeTestJSON-477371163-project Oct 22 20:55:44.696851 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 20:55:44.696851 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 20:55:44.696851 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: b392ad1fe1fd4b2a9e6be03a7435deb9 Oct 22 20:55:44.696851 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-477371163-project Oct 22 20:55:44.696851 ncdv-master-1 devstack@n-api.service[138745]: Oct 22 20:55:44.696851 ncdv-master-1 devstack@n-api.service[138745]: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Oct 22 20:55:44.696851 ncdv-master-1 devstack@n-api.service[138745]: method: > Oct 22 20:55:44.696851 ncdv-master-1 devstack@n-api.service[138745]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 22 20:55:44.696851 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'id': 'a64fa89e-32f6-4994-a0b2-3788cf1c92ec', 'body': {'createImage': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Oct 22 20:55:44.696851 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:55:44.696851 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:55:44.696851 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 22 20:55:44.696851 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 22 20:55:44.696851 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 22 20:55:44.696851 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise error Oct 22 20:55:44.696851 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 22 20:55:44.696851 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:55:44.696851 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['createImage']['properties']['name']: Oct 22 20:55:44.696851 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 22 20:55:44.696851 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:55:44.696851 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi On instance['createImage']: Oct 22 20:55:44.696851 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 22 20:55:44.696851 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:55:44.696851 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:55:44.696851 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:55:44.696851 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:55:44.704206 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:55:44.704206 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:55:44.704206 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:55:44.704206 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:55:44.704206 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:55:44.704206 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:55:44.704206 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 20:55:44.704206 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 20:55:44.704206 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 22 20:55:44.704206 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 22 20:55:44.704206 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 22 20:55:44.704206 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 22 20:55:44.704206 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 22 20:55:44.704206 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 22 20:55:44.704206 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 22 20:55:44.704206 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:55:44.704206 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:55:44.704206 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:55:44.704206 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:55:44.704206 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:55:44.704206 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:55:44.704206 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 22 20:55:44.704206 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 22 20:55:44.704206 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 22 20:55:44.704206 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:55:44.704206 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-f650062f-9375-4d8c-9223-4ffac7b3708a tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:55:44.707906 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-f650062f-9375-4d8c-9223-4ffac7b3708a tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] 10.222.0.18 "POST /compute/v2.1/servers/a64fa89e-32f6-4994-a0b2-3788cf1c92ec/action" status: 400 len: 619 microversion: 2.1 time: 0.027759 Oct 22 20:55:44.707906 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 882/1660] 10.222.0.18 () {60 vars in 1279 bytes} [Sat Oct 22 20:55:44 2022] POST /compute/v2.1/servers/a64fa89e-32f6-4994-a0b2-3788cf1c92ec/action => generated 619 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 22 20:55:44.718127 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-3eee3b3d-c29c-44d4-81cb-913bf98227bd tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:55:44.719242 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-3eee3b3d-c29c-44d4-81cb-913bf98227bd tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] [instance: bccbf2b3-70e3-406d-b844-e48d765732cf] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:55:44.737750 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3eee3b3d-c29c-44d4-81cb-913bf98227bd tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:44.738292 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3eee3b3d-c29c-44d4-81cb-913bf98227bd tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:44.738930 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3eee3b3d-c29c-44d4-81cb-913bf98227bd tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:44.739772 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3eee3b3d-c29c-44d4-81cb-913bf98227bd tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:44.740240 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3eee3b3d-c29c-44d4-81cb-913bf98227bd tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:44.740667 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3eee3b3d-c29c-44d4-81cb-913bf98227bd tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:45.019787 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.network.neutron [None req-c8bb493c-1324-4326-aae3-0f6ea051c530 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] [instance: 532d6e6a-71ab-4ef0-a5bf-c042055c5121] re-assign floating IP 172.35.2.224 from instance 29a351ac-ecf5-4b11-9bdd-f1c93df1335a Oct 22 20:55:45.098412 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-3eee3b3d-c29c-44d4-81cb-913bf98227bd tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b638db630404ebbbcc2253db30844c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cc7342bf7941d2ad7ebc70032dd52e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:55:45.109887 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-3eee3b3d-c29c-44d4-81cb-913bf98227bd tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] 10.222.0.18 "GET /compute/v2.1/servers/bccbf2b3-70e3-406d-b844-e48d765732cf" status: 200 len: 1318 microversion: 2.1 time: 0.402261 Oct 22 20:55:45.130244 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.network.neutron [None req-c8bb493c-1324-4326-aae3-0f6ea051c530 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] [instance: 29a351ac-ecf5-4b11-9bdd-f1c93df1335a] Building network info cache for instance {{(pid=138744) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 22 20:55:45.134946 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 883/1661] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:55:44 2022] GET /compute/v2.1/servers/bccbf2b3-70e3-406d-b844-e48d765732cf => generated 1318 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:55:45.139896 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-faabc9c7-d6d1-4f74-8e03-701d0fae867c req-6a494612-30be-46ab-b35e-2ae509d7744c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98f48cb1-54ed-4e82-8a25-fd004ddb5758", "name": "network-vif-plugged", "status": "completed", "tag": "1d82207b-0e45-42ab-8c7f-4bf4bac8d993"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:55:45.146647 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:55:45.162163 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-faabc9c7-d6d1-4f74-8e03-701d0fae867c req-6a494612-30be-46ab-b35e-2ae509d7744c service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:45.162780 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-faabc9c7-d6d1-4f74-8e03-701d0fae867c req-6a494612-30be-46ab-b35e-2ae509d7744c service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:45.163090 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-faabc9c7-d6d1-4f74-8e03-701d0fae867c req-6a494612-30be-46ab-b35e-2ae509d7744c service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:45.179552 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-faabc9c7-d6d1-4f74-8e03-701d0fae867c req-6a494612-30be-46ab-b35e-2ae509d7744c service nova] Creating event network-vif-plugged:1d82207b-0e45-42ab-8c7f-4bf4bac8d993 for instance 98f48cb1-54ed-4e82-8a25-fd004ddb5758 on nch2-master-1 Oct 22 20:55:45.186114 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-faabc9c7-d6d1-4f74-8e03-701d0fae867c req-6a494612-30be-46ab-b35e-2ae509d7744c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049794 Oct 22 20:55:45.187293 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 884/1662] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:55:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:55:45.192932 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-c12c54f3-1dcc-456c-ba65-1946c4fc574f tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:55:45.193907 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-c12c54f3-1dcc-456c-ba65-1946c4fc574f tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] [instance: a64fa89e-32f6-4994-a0b2-3788cf1c92ec] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:55:45.200924 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c12c54f3-1dcc-456c-ba65-1946c4fc574f tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:45.201648 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c12c54f3-1dcc-456c-ba65-1946c4fc574f tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:45.202275 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c12c54f3-1dcc-456c-ba65-1946c4fc574f tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:45.203169 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c12c54f3-1dcc-456c-ba65-1946c4fc574f tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:45.203811 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c12c54f3-1dcc-456c-ba65-1946c4fc574f tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:45.204426 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c12c54f3-1dcc-456c-ba65-1946c4fc574f tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:45.569040 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-c12c54f3-1dcc-456c-ba65-1946c4fc574f tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b392ad1fe1fd4b2a9e6be03a7435deb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594624ed28aa433d907c8833d360b82e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:55:45.601984 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-c12c54f3-1dcc-456c-ba65-1946c4fc574f tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] 10.222.0.18 "GET /compute/v2.1/servers/a64fa89e-32f6-4994-a0b2-3788cf1c92ec" status: 200 len: 1521 microversion: 2.1 time: 0.412643 Oct 22 20:55:45.605234 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 885/1663] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:55:45 2022] GET /compute/v2.1/servers/a64fa89e-32f6-4994-a0b2-3788cf1c92ec => generated 1521 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:55:45.611280 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-9fcfa800-ad37-4fbc-9852-1204689dc100 req-40601bb9-05cb-4cbc-921b-be7b1588ff29 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29a351ac-ecf5-4b11-9bdd-f1c93df1335a", "tag": "07fb8283-cc10-46e3-bd70-2c1e5b8c3aef"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:55:45.626279 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-9fcfa800-ad37-4fbc-9852-1204689dc100 req-40601bb9-05cb-4cbc-921b-be7b1588ff29 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:45.627149 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-9fcfa800-ad37-4fbc-9852-1204689dc100 req-40601bb9-05cb-4cbc-921b-be7b1588ff29 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:45.628654 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-9fcfa800-ad37-4fbc-9852-1204689dc100 req-40601bb9-05cb-4cbc-921b-be7b1588ff29 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:45.643843 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-9fcfa800-ad37-4fbc-9852-1204689dc100 req-40601bb9-05cb-4cbc-921b-be7b1588ff29 service nova] Creating event network-changed:07fb8283-cc10-46e3-bd70-2c1e5b8c3aef for instance 29a351ac-ecf5-4b11-9bdd-f1c93df1335a on nch2-master-1 Oct 22 20:55:45.650876 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-9fcfa800-ad37-4fbc-9852-1204689dc100 req-40601bb9-05cb-4cbc-921b-be7b1588ff29 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043770 Oct 22 20:55:45.655392 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 886/1664] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:55:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:55:45.687784 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-e40a4b76-5d15-476e-b095-90eecf2e3145 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:55:45.688874 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-e40a4b76-5d15-476e-b095-90eecf2e3145 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] [instance: 98f48cb1-54ed-4e82-8a25-fd004ddb5758] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:55:45.700987 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e40a4b76-5d15-476e-b095-90eecf2e3145 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:45.702084 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e40a4b76-5d15-476e-b095-90eecf2e3145 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:45.702705 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e40a4b76-5d15-476e-b095-90eecf2e3145 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:45.704043 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e40a4b76-5d15-476e-b095-90eecf2e3145 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:45.705167 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e40a4b76-5d15-476e-b095-90eecf2e3145 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:45.706011 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e40a4b76-5d15-476e-b095-90eecf2e3145 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:46.135801 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-e40a4b76-5d15-476e-b095-90eecf2e3145 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d3d7458af447bdb3f03e83a2d8559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49238b8686d24ae698679e4a1957735d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:55:46.171416 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-e40a4b76-5d15-476e-b095-90eecf2e3145 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] 10.222.0.18 "GET /compute/v2.1/servers/98f48cb1-54ed-4e82-8a25-fd004ddb5758" status: 200 len: 1312 microversion: 2.1 time: 0.510793 Oct 22 20:55:46.203826 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 887/1665] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:55:45 2022] GET /compute/v2.1/servers/98f48cb1-54ed-4e82-8a25-fd004ddb5758 => generated 1312 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:55:46.210592 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-657b8af8-4c14-45d6-96d3-b7135a69ad6e tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:55:46.211948 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-657b8af8-4c14-45d6-96d3-b7135a69ad6e tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] [instance: a64fa89e-32f6-4994-a0b2-3788cf1c92ec] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:55:46.230152 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-657b8af8-4c14-45d6-96d3-b7135a69ad6e tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:46.231505 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-657b8af8-4c14-45d6-96d3-b7135a69ad6e tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:46.232177 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-657b8af8-4c14-45d6-96d3-b7135a69ad6e tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:46.233116 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-657b8af8-4c14-45d6-96d3-b7135a69ad6e tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:46.233941 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-657b8af8-4c14-45d6-96d3-b7135a69ad6e tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:46.234672 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-657b8af8-4c14-45d6-96d3-b7135a69ad6e tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:46.626427 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-657b8af8-4c14-45d6-96d3-b7135a69ad6e tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b392ad1fe1fd4b2a9e6be03a7435deb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594624ed28aa433d907c8833d360b82e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:55:46.641824 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-657b8af8-4c14-45d6-96d3-b7135a69ad6e tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] 10.222.0.18 "GET /compute/v2.1/servers/a64fa89e-32f6-4994-a0b2-3788cf1c92ec" status: 200 len: 1521 microversion: 2.1 time: 0.436166 Oct 22 20:55:46.668386 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 888/1666] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:55:46 2022] GET /compute/v2.1/servers/a64fa89e-32f6-4994-a0b2-3788cf1c92ec => generated 1521 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:55:46.675401 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-05be6263-bdf2-476b-a533-09fd86f1f2b9 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:55:46.676411 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-05be6263-bdf2-476b-a533-09fd86f1f2b9 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] [instance: fbb34507-cef9-4d78-9ed7-5d6eab4ca806] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:55:46.685552 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-05be6263-bdf2-476b-a533-09fd86f1f2b9 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:46.687086 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-05be6263-bdf2-476b-a533-09fd86f1f2b9 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:46.687956 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-05be6263-bdf2-476b-a533-09fd86f1f2b9 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:46.690694 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-05be6263-bdf2-476b-a533-09fd86f1f2b9 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:46.692053 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-05be6263-bdf2-476b-a533-09fd86f1f2b9 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:46.693032 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-05be6263-bdf2-476b-a533-09fd86f1f2b9 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:46.982697 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-05be6263-bdf2-476b-a533-09fd86f1f2b9 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c87f0356ca346f39c6216393d85da2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee8c8f7fc4e12bc1f9fcce3e7b581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:55:46.994938 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-05be6263-bdf2-476b-a533-09fd86f1f2b9 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] 10.222.0.18 "GET /compute/v2.1/servers/fbb34507-cef9-4d78-9ed7-5d6eab4ca806" status: 200 len: 1392 microversion: 2.1 time: 0.323449 Oct 22 20:55:46.999294 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 889/1667] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:55:46 2022] GET /compute/v2.1/servers/fbb34507-cef9-4d78-9ed7-5d6eab4ca806 => generated 1392 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:55:47.012950 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-c35d34b6-26ac-483c-891e-9053acdb4723 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:55:47.016301 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-c35d34b6-26ac-483c-891e-9053acdb4723 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] [instance: bccbf2b3-70e3-406d-b844-e48d765732cf] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:55:47.030662 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c35d34b6-26ac-483c-891e-9053acdb4723 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:47.031521 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c35d34b6-26ac-483c-891e-9053acdb4723 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:47.032178 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c35d34b6-26ac-483c-891e-9053acdb4723 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:47.034095 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c35d34b6-26ac-483c-891e-9053acdb4723 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:47.034912 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c35d34b6-26ac-483c-891e-9053acdb4723 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:47.035561 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c35d34b6-26ac-483c-891e-9053acdb4723 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:47.163682 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.network.neutron [None req-c8bb493c-1324-4326-aae3-0f6ea051c530 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] [instance: 29a351ac-ecf5-4b11-9bdd-f1c93df1335a] Updating instance_info_cache with network_info: [{"id": "07fb8283-cc10-46e3-bd70-2c1e5b8c3aef", "address": "fa:16:3e:7a:11:63", "network": {"id": "ba2fbd7d-5bd8-4316-b6a5-ea0e685a80cc", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1738311782-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "42111ed6bcc3465d8c1f5291da248e74", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap07fb8283-cc", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=138744) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 22 20:55:47.208147 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.network.neutron [None req-c8bb493c-1324-4326-aae3-0f6ea051c530 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] [instance: 532d6e6a-71ab-4ef0-a5bf-c042055c5121] Building network info cache for instance {{(pid=138744) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 22 20:55:48.248187 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-c35d34b6-26ac-483c-891e-9053acdb4723 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b638db630404ebbbcc2253db30844c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cc7342bf7941d2ad7ebc70032dd52e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:55:48.260542 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-c35d34b6-26ac-483c-891e-9053acdb4723 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] 10.222.0.18 "GET /compute/v2.1/servers/bccbf2b3-70e3-406d-b844-e48d765732cf" status: 200 len: 1318 microversion: 2.1 time: 1.257082 Oct 22 20:55:48.263148 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 890/1668] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:55:46 2022] GET /compute/v2.1/servers/bccbf2b3-70e3-406d-b844-e48d765732cf => generated 1318 bytes in 1262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:55:48.278644 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-3a6a6a17-824c-4bf0-961e-d3876e5dc4be tempest-ServersTestFqdnHostnames-400258971 tempest-ServersTestFqdnHostnames-400258971-project] Action: 'create', calling method: >, body: {"server": {"name": "guest-instance-1.domain.com", "imageRef": "085e4478-6edc-4a69-8e08-f9831713eb65", "flavorRef": "452", "adminPass": "***", "accessIPv4": "2.2.2.2", "networks": [{"uuid": "813e81de-3eed-47a3-9358-0ddc752a6be5"}], "security_groups": [{"name": "tempest-securitygroup--1646616389"}], "key_name": "tempest-keypair-1094706457", "user_data": "}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:55:48.771939 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.network.neutron [None req-3a6a6a17-824c-4bf0-961e-d3876e5dc4be tempest-ServersTestFqdnHostnames-400258971 tempest-ServersTestFqdnHostnames-400258971-project] validate_networks() for [('813e81de-3eed-47a3-9358-0ddc752a6be5', None, None, None, None, None)] {{(pid=138745) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 20:55:49.293067 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=6 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:55:49.365412 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.network.neutron [None req-c8bb493c-1324-4326-aae3-0f6ea051c530 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] [instance: 532d6e6a-71ab-4ef0-a5bf-c042055c5121] Updating instance_info_cache with network_info: [{"id": "7c68227f-68b8-459e-8cf6-9b169351d597", "address": "fa:16:3e:f5:a4:2f", "network": {"id": "ba2fbd7d-5bd8-4316-b6a5-ea0e685a80cc", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1738311782-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.2.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "42111ed6bcc3465d8c1f5291da248e74", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap7c68227f-68", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=138744) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 22 20:55:49.381773 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c8bb493c-1324-4326-aae3-0f6ea051c530 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Releasing lock "refresh_cache-532d6e6a-71ab-4ef0-a5bf-c042055c5121" {{(pid=138744) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 22 20:55:49.382812 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-c8bb493c-1324-4326-aae3-0f6ea051c530 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] 10.222.0.18 "POST /compute/v2.1/servers/532d6e6a-71ab-4ef0-a5bf-c042055c5121/action" status: 202 len: 0 microversion: 2.1 time: 10.102810 Oct 22 20:55:49.385242 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 779/1669] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 20:55:39 2022] POST /compute/v2.1/servers/532d6e6a-71ab-4ef0-a5bf-c042055c5121/action => generated 0 bytes in 10105 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 22 20:55:49.398198 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-a8d9f5d5-8565-4c55-b923-c32a462a55aa tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1258959807"}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:55:49.411890 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-a8d9f5d5-8565-4c55-b923-c32a462a55aa tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] [instance: a64fa89e-32f6-4994-a0b2-3788cf1c92ec] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:55:49.426546 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a8d9f5d5-8565-4c55-b923-c32a462a55aa tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:49.427045 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a8d9f5d5-8565-4c55-b923-c32a462a55aa tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:49.427555 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a8d9f5d5-8565-4c55-b923-c32a462a55aa tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:49.428291 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a8d9f5d5-8565-4c55-b923-c32a462a55aa tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:49.438210 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a8d9f5d5-8565-4c55-b923-c32a462a55aa tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:49.438756 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a8d9f5d5-8565-4c55-b923-c32a462a55aa tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:49.648259 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell0:SELECT=4 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:55:49.974803 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-a8d9f5d5-8565-4c55-b923-c32a462a55aa tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] 10.222.0.18 "POST /compute/v2.1/servers/a64fa89e-32f6-4994-a0b2-3788cf1c92ec/action" status: 202 len: 0 microversion: 2.1 time: 0.587519 Oct 22 20:55:49.976051 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 780/1670] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 20:55:49 2022] POST /compute/v2.1/servers/a64fa89e-32f6-4994-a0b2-3788cf1c92ec/action => generated 0 bytes in 590 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 22 20:55:49.996069 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-79509609-7bfd-4ddf-bc0c-8ef3c07f5937 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:55:49.997881 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-79509609-7bfd-4ddf-bc0c-8ef3c07f5937 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] [instance: 98f48cb1-54ed-4e82-8a25-fd004ddb5758] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:55:50.006878 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-79509609-7bfd-4ddf-bc0c-8ef3c07f5937 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:50.007774 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-79509609-7bfd-4ddf-bc0c-8ef3c07f5937 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:50.008450 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-79509609-7bfd-4ddf-bc0c-8ef3c07f5937 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:50.009728 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-79509609-7bfd-4ddf-bc0c-8ef3c07f5937 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:50.010637 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-79509609-7bfd-4ddf-bc0c-8ef3c07f5937 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:50.011426 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-79509609-7bfd-4ddf-bc0c-8ef3c07f5937 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:50.295718 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-3a6a6a17-824c-4bf0-961e-d3876e5dc4be tempest-ServersTestFqdnHostnames-400258971 tempest-ServersTestFqdnHostnames-400258971-project] Flavor limits 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 20:55:50.296223 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-3a6a6a17-824c-4bf0-961e-d3876e5dc4be tempest-ServersTestFqdnHostnames-400258971 tempest-ServersTestFqdnHostnames-400258971-project] Image limits 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 20:55:50.296799 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-3a6a6a17-824c-4bf0-961e-d3876e5dc4be tempest-ServersTestFqdnHostnames-400258971 tempest-ServersTestFqdnHostnames-400258971-project] Flavor pref 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 20:55:50.297211 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-3a6a6a17-824c-4bf0-961e-d3876e5dc4be tempest-ServersTestFqdnHostnames-400258971 tempest-ServersTestFqdnHostnames-400258971-project] Image pref 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 20:55:50.297861 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-3a6a6a17-824c-4bf0-961e-d3876e5dc4be tempest-ServersTestFqdnHostnames-400258971 tempest-ServersTestFqdnHostnames-400258971-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 20:55:50.309520 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3a6a6a17-824c-4bf0-961e-d3876e5dc4be tempest-ServersTestFqdnHostnames-400258971 tempest-ServersTestFqdnHostnames-400258971-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:50.310237 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3a6a6a17-824c-4bf0-961e-d3876e5dc4be tempest-ServersTestFqdnHostnames-400258971 tempest-ServersTestFqdnHostnames-400258971-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:50.310995 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3a6a6a17-824c-4bf0-961e-d3876e5dc4be tempest-ServersTestFqdnHostnames-400258971 tempest-ServersTestFqdnHostnames-400258971-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:50.312787 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3a6a6a17-824c-4bf0-961e-d3876e5dc4be tempest-ServersTestFqdnHostnames-400258971 tempest-ServersTestFqdnHostnames-400258971-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:50.313756 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3a6a6a17-824c-4bf0-961e-d3876e5dc4be tempest-ServersTestFqdnHostnames-400258971 tempest-ServersTestFqdnHostnames-400258971-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:50.330733 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3a6a6a17-824c-4bf0-961e-d3876e5dc4be tempest-ServersTestFqdnHostnames-400258971 tempest-ServersTestFqdnHostnames-400258971-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:50.376855 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-79509609-7bfd-4ddf-bc0c-8ef3c07f5937 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d3d7458af447bdb3f03e83a2d8559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49238b8686d24ae698679e4a1957735d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:55:50.390299 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-79509609-7bfd-4ddf-bc0c-8ef3c07f5937 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] 10.222.0.18 "GET /compute/v2.1/servers/98f48cb1-54ed-4e82-8a25-fd004ddb5758" status: 200 len: 1460 microversion: 2.1 time: 0.401364 Oct 22 20:55:50.393996 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 781/1671] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:55:49 2022] GET /compute/v2.1/servers/98f48cb1-54ed-4e82-8a25-fd004ddb5758 => generated 1460 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:55:50.401304 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-53876d84-375b-47d1-8d04-810d3a032f68 req-ff9779b6-6e21-4ba5-9ed3-05f395d833f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73404cab-dc0f-4f1c-b38b-a1505a5dc8b2", "name": "network-vif-plugged", "status": "completed", "tag": "fbd90195-446f-40e0-bd14-a4a338e00ca1"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:55:50.422587 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-3a6a6a17-824c-4bf0-961e-d3876e5dc4be tempest-ServersTestFqdnHostnames-400258971 tempest-ServersTestFqdnHostnames-400258971-project] Getting quotas for project b3b75771ecf442919c647f15d499880e. Resources: {'cores', 'instances', 'ram'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 20:55:50.426889 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-53876d84-375b-47d1-8d04-810d3a032f68 req-ff9779b6-6e21-4ba5-9ed3-05f395d833f3 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:50.427406 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-53876d84-375b-47d1-8d04-810d3a032f68 req-ff9779b6-6e21-4ba5-9ed3-05f395d833f3 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:50.427855 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-53876d84-375b-47d1-8d04-810d3a032f68 req-ff9779b6-6e21-4ba5-9ed3-05f395d833f3 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:50.434488 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-3a6a6a17-824c-4bf0-961e-d3876e5dc4be tempest-ServersTestFqdnHostnames-400258971 tempest-ServersTestFqdnHostnames-400258971-project] Getting quotas for user 02fdeda494a547f1a8714007e05e874d and project b3b75771ecf442919c647f15d499880e. Resources: {'cores', 'instances', 'ram'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 20:55:50.456751 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-3a6a6a17-824c-4bf0-961e-d3876e5dc4be tempest-ServersTestFqdnHostnames-400258971 tempest-ServersTestFqdnHostnames-400258971-project] Going to run 1 instances... {{(pid=138745) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 20:55:50.460556 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-53876d84-375b-47d1-8d04-810d3a032f68 req-ff9779b6-6e21-4ba5-9ed3-05f395d833f3 service nova] Creating event network-vif-plugged:fbd90195-446f-40e0-bd14-a4a338e00ca1 for instance 73404cab-dc0f-4f1c-b38b-a1505a5dc8b2 on nch1-master-1 Oct 22 20:55:50.460918 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-3a6a6a17-824c-4bf0-961e-d3876e5dc4be tempest-ServersTestFqdnHostnames-400258971 tempest-ServersTestFqdnHostnames-400258971-project] [instance: 78aef3f6-9cff-4db4-95c1-f0d5480b7a3c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='085e4478-6edc-4a69-8e08-f9831713eb65',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138745) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 20:55:50.491457 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-53876d84-375b-47d1-8d04-810d3a032f68 req-ff9779b6-6e21-4ba5-9ed3-05f395d833f3 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090241 Oct 22 20:55:50.494008 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 782/1672] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:55:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:55:50.509486 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-24c0bfe4-3682-47ae-b055-f5b796bf8c3f req-050f215d-5c43-48e9-9f9f-5cc7034db865 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "532d6e6a-71ab-4ef0-a5bf-c042055c5121", "tag": "7c68227f-68b8-459e-8cf6-9b169351d597"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:55:50.537874 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-24c0bfe4-3682-47ae-b055-f5b796bf8c3f req-050f215d-5c43-48e9-9f9f-5cc7034db865 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:50.538390 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-24c0bfe4-3682-47ae-b055-f5b796bf8c3f req-050f215d-5c43-48e9-9f9f-5cc7034db865 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:50.538847 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-24c0bfe4-3682-47ae-b055-f5b796bf8c3f req-050f215d-5c43-48e9-9f9f-5cc7034db865 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:50.571784 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-24c0bfe4-3682-47ae-b055-f5b796bf8c3f req-050f215d-5c43-48e9-9f9f-5cc7034db865 service nova] Creating event network-changed:7c68227f-68b8-459e-8cf6-9b169351d597 for instance 532d6e6a-71ab-4ef0-a5bf-c042055c5121 on nch1-master-1 Oct 22 20:55:50.578695 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-24c0bfe4-3682-47ae-b055-f5b796bf8c3f req-050f215d-5c43-48e9-9f9f-5cc7034db865 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082984 Oct 22 20:55:50.580004 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 783/1673] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:55:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:55:50.582629 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-3a6a6a17-824c-4bf0-961e-d3876e5dc4be tempest-ServersTestFqdnHostnames-400258971 tempest-ServersTestFqdnHostnames-400258971-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 2.317070 Oct 22 20:55:50.585777 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-45eeff5c-147a-42d1-a4ec-6368c9981c89 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:55:50.586422 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-45eeff5c-147a-42d1-a4ec-6368c9981c89 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] [instance: fbb34507-cef9-4d78-9ed7-5d6eab4ca806] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:55:50.591141 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 891/1674] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Oct 22 20:55:48 2022] POST /compute/v2.1/servers => generated 409 bytes in 2327 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 20:55:50.596961 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-c5e35fcf-b3f5-46fc-9568-70094a1879f9 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:55:50.598116 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-c5e35fcf-b3f5-46fc-9568-70094a1879f9 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] [instance: bccbf2b3-70e3-406d-b844-e48d765732cf] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:55:50.606983 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c5e35fcf-b3f5-46fc-9568-70094a1879f9 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:50.607995 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c5e35fcf-b3f5-46fc-9568-70094a1879f9 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:50.610084 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c5e35fcf-b3f5-46fc-9568-70094a1879f9 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:50.610084 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c5e35fcf-b3f5-46fc-9568-70094a1879f9 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:50.610084 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c5e35fcf-b3f5-46fc-9568-70094a1879f9 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:50.610392 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-45eeff5c-147a-42d1-a4ec-6368c9981c89 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:50.610556 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-45eeff5c-147a-42d1-a4ec-6368c9981c89 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:50.611198 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-45eeff5c-147a-42d1-a4ec-6368c9981c89 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:50.611621 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c5e35fcf-b3f5-46fc-9568-70094a1879f9 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:50.612623 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-45eeff5c-147a-42d1-a4ec-6368c9981c89 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:50.613476 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-45eeff5c-147a-42d1-a4ec-6368c9981c89 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:50.614130 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-45eeff5c-147a-42d1-a4ec-6368c9981c89 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:51.135641 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-c5e35fcf-b3f5-46fc-9568-70094a1879f9 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b638db630404ebbbcc2253db30844c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cc7342bf7941d2ad7ebc70032dd52e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:55:51.149554 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-c5e35fcf-b3f5-46fc-9568-70094a1879f9 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] 10.222.0.18 "GET /compute/v2.1/servers/bccbf2b3-70e3-406d-b844-e48d765732cf" status: 200 len: 1318 microversion: 2.1 time: 0.557024 Oct 22 20:55:51.150152 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 892/1675] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:55:50 2022] GET /compute/v2.1/servers/bccbf2b3-70e3-406d-b844-e48d765732cf => generated 1318 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:55:51.154964 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-04040082-b660-43d5-9d7d-d5ffd4748fe0 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Action: 'action', calling method: .version_select at 0x7fd3a5d0d8b0>, body: {"removeFloatingIp": {"address": "172.35.2.224"}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:55:51.210004 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-45eeff5c-147a-42d1-a4ec-6368c9981c89 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c87f0356ca346f39c6216393d85da2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee8c8f7fc4e12bc1f9fcce3e7b581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:55:51.224387 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-45eeff5c-147a-42d1-a4ec-6368c9981c89 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] 10.222.0.18 "GET /compute/v2.1/servers/fbb34507-cef9-4d78-9ed7-5d6eab4ca806" status: 200 len: 1382 microversion: 2.1 time: 0.642973 Oct 22 20:55:51.226851 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 784/1676] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:55:50 2022] GET /compute/v2.1/servers/fbb34507-cef9-4d78-9ed7-5d6eab4ca806 => generated 1382 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:55:51.232382 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-53a7eb88-bed4-4512-9ea3-fc5e3f4b7083 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-464947301"}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:55:51.234736 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-53a7eb88-bed4-4512-9ea3-fc5e3f4b7083 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] [instance: a64fa89e-32f6-4994-a0b2-3788cf1c92ec] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:55:51.242644 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-53a7eb88-bed4-4512-9ea3-fc5e3f4b7083 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:51.243152 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-53a7eb88-bed4-4512-9ea3-fc5e3f4b7083 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:51.243614 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-53a7eb88-bed4-4512-9ea3-fc5e3f4b7083 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:51.244363 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-53a7eb88-bed4-4512-9ea3-fc5e3f4b7083 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:51.244824 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-53a7eb88-bed4-4512-9ea3-fc5e3f4b7083 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:51.245254 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-53a7eb88-bed4-4512-9ea3-fc5e3f4b7083 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:51.341034 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-53a7eb88-bed4-4512-9ea3-fc5e3f4b7083 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] HTTP exception thrown: Cannot 'createImage' instance a64fa89e-32f6-4994-a0b2-3788cf1c92ec while it is in task_state image_snapshot Oct 22 20:55:51.342843 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-53a7eb88-bed4-4512-9ea3-fc5e3f4b7083 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Request method failure captured: Oct 22 20:55:51.342843 ncdv-master-1 devstack@n-api.service[138744]: request: POST /compute/v2.1/servers/a64fa89e-32f6-4994-a0b2-3788cf1c92ec/action HTTP/1.1 Oct 22 20:55:51.342843 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 20:55:51.342843 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 20:55:51.342843 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 20:55:51.342843 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 84 Oct 22 20:55:51.342843 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 20:55:51.342843 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 20:55:51.342843 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 20:55:51.342843 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 20:55:51.342843 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVFinkWQQBhkrT1IKOpDugEkOlAPWNZyP_2NMwr13b9XeVy4UUzw2acgfBjDE3p8vwfHK2_Q3RMg9yYmateTjw8EQOHA7IN0HeuqzZ5uQWL0ysIIG3e_nACVRZdRICvuIM06IV17ajtcJTdsfcK0wPQNbKtAOZi6_8a2UUHyQ1NeNuzI Oct 22 20:55:51.342843 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 20:55:51.342843 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 20:55:51.342843 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 20:55:51.342843 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 20:55:51.342843 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 20:55:51.342843 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 20:55:51.342843 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: 594624ed28aa433d907c8833d360b82e Oct 22 20:55:51.342843 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-477371163 Oct 22 20:55:51.342843 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 20:55:51.342843 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 20:55:51.342843 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_594624ed28aa433d907c8833d360b82e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/594624ed28aa433d907c8833d360b82e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/594624ed28aa433d907c8833d360b82e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/594624ed28aa433d907c8833d360b82e"}]}] Oct 22 20:55:51.342843 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-477371163 Oct 22 20:55:51.342843 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: 594624ed28aa433d907c8833d360b82e Oct 22 20:55:51.342843 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-477371163 Oct 22 20:55:51.342843 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-ImagesOneServerNegativeTestJSON-477371163-project Oct 22 20:55:51.342843 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 20:55:51.342843 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 20:55:51.342843 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: b392ad1fe1fd4b2a9e6be03a7435deb9 Oct 22 20:55:51.342843 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-477371163-project Oct 22 20:55:51.342843 ncdv-master-1 devstack@n-api.service[138744]: Oct 22 20:55:51.342843 ncdv-master-1 devstack@n-api.service[138744]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-464947301"}} Oct 22 20:55:51.342843 ncdv-master-1 devstack@n-api.service[138744]: method: > Oct 22 20:55:51.342843 ncdv-master-1 devstack@n-api.service[138744]: exception: Cannot 'createImage' instance a64fa89e-32f6-4994-a0b2-3788cf1c92ec while it is in task_state image_snapshot Oct 22 20:55:51.342843 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': 'a64fa89e-32f6-4994-a0b2-3788cf1c92ec', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-464947301'}}} Oct 22 20:55:51.342843 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:55:51.342843 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:55:51.342843 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1349, in _action_create_image Oct 22 20:55:51.342843 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi image = self.compute_api.snapshot(context, Oct 22 20:55:51.342843 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 155, in inner Oct 22 20:55:51.342843 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 22 20:55:51.342843 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance a64fa89e-32f6-4994-a0b2-3788cf1c92ec in task_state image_snapshot. Cannot snapshot while the instance is in this state. Oct 22 20:55:51.342843 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:55:51.342843 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:55:51.342843 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:55:51.342843 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:55:51.342843 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:55:51.342843 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:55:51.342843 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:55:51.342843 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:55:51.342843 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:55:51.342843 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:55:51.342843 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 20:55:51.342843 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 20:55:51.342843 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 20:55:51.342843 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 20:55:51.342843 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1354, in _action_create_image Oct 22 20:55:51.342843 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 22 20:55:51.342843 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 22 20:55:51.342843 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 22 20:55:51.342843 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'createImage' instance a64fa89e-32f6-4994-a0b2-3788cf1c92ec while it is in task_state image_snapshot Oct 22 20:55:51.348206 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:55:51.348206 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:55:51.348206 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:55:51.348206 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:55:51.348206 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:55:51.348206 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:55:51.348206 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 20:55:51.348206 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 20:55:51.348206 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'createImage' instance a64fa89e-32f6-4994-a0b2-3788cf1c92ec while it is in task_state image_snapshot Oct 22 20:55:51.348206 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:55:51.348206 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-53a7eb88-bed4-4512-9ea3-fc5e3f4b7083 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Returning 409 to user: Cannot 'createImage' instance a64fa89e-32f6-4994-a0b2-3788cf1c92ec while it is in task_state image_snapshot {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:55:51.348206 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-53a7eb88-bed4-4512-9ea3-fc5e3f4b7083 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] 10.222.0.18 "POST /compute/v2.1/servers/a64fa89e-32f6-4994-a0b2-3788cf1c92ec/action" status: 409 len: 159 microversion: 2.1 time: 0.116284 Oct 22 20:55:51.350741 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 785/1677] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 20:55:51 2022] POST /compute/v2.1/servers/a64fa89e-32f6-4994-a0b2-3788cf1c92ec/action => generated 159 bytes in 123 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 22 20:55:51.362701 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-f0784933-3406-4b3b-9865-50d5d00ec21b tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:55:51.365059 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-f0784933-3406-4b3b-9865-50d5d00ec21b tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] [instance: 98f48cb1-54ed-4e82-8a25-fd004ddb5758] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:55:51.391117 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f0784933-3406-4b3b-9865-50d5d00ec21b tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:51.391812 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f0784933-3406-4b3b-9865-50d5d00ec21b tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:51.392120 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f0784933-3406-4b3b-9865-50d5d00ec21b tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:51.392857 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f0784933-3406-4b3b-9865-50d5d00ec21b tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:51.393437 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f0784933-3406-4b3b-9865-50d5d00ec21b tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:51.394816 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f0784933-3406-4b3b-9865-50d5d00ec21b tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:51.445353 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-04040082-b660-43d5-9d7d-d5ffd4748fe0 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] [instance: 532d6e6a-71ab-4ef0-a5bf-c042055c5121] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:55:51.453375 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-04040082-b660-43d5-9d7d-d5ffd4748fe0 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:51.454041 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-04040082-b660-43d5-9d7d-d5ffd4748fe0 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:51.454478 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-04040082-b660-43d5-9d7d-d5ffd4748fe0 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:51.456230 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-04040082-b660-43d5-9d7d-d5ffd4748fe0 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:51.457610 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-04040082-b660-43d5-9d7d-d5ffd4748fe0 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:51.458236 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-04040082-b660-43d5-9d7d-d5ffd4748fe0 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:51.581455 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-f0784933-3406-4b3b-9865-50d5d00ec21b tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'e0d3d7458af447bdb3f03e83a2d8559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49238b8686d24ae698679e4a1957735d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:55:51.589244 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-f0784933-3406-4b3b-9865-50d5d00ec21b tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] [instance: 98f48cb1-54ed-4e82-8a25-fd004ddb5758] Old instance type m1.heat2, new instance type m1.heat {{(pid=138744) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 22 20:55:51.601632 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-f0784933-3406-4b3b-9865-50d5d00ec21b tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Flavor limits 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 20:55:51.602138 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-f0784933-3406-4b3b-9865-50d5d00ec21b tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Image limits 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 20:55:51.603239 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-f0784933-3406-4b3b-9865-50d5d00ec21b tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Flavor pref 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 20:55:51.603676 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-f0784933-3406-4b3b-9865-50d5d00ec21b tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Image pref 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 20:55:51.604166 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-f0784933-3406-4b3b-9865-50d5d00ec21b tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 20:55:51.787757 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-f0784933-3406-4b3b-9865-50d5d00ec21b tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] 10.222.0.18 "POST /compute/v2.1/servers/98f48cb1-54ed-4e82-8a25-fd004ddb5758/action" status: 202 len: 0 microversion: 2.1 time: 0.433904 Oct 22 20:55:51.791721 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 786/1678] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 20:55:51 2022] POST /compute/v2.1/servers/98f48cb1-54ed-4e82-8a25-fd004ddb5758/action => generated 0 bytes in 440 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 20:55:51.805331 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-91b6b829-da04-4d6e-be03-79f36fc879a8 tempest-ServersTestFqdnHostnames-400258971 tempest-ServersTestFqdnHostnames-400258971-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:55:51.806962 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-91b6b829-da04-4d6e-be03-79f36fc879a8 tempest-ServersTestFqdnHostnames-400258971 tempest-ServersTestFqdnHostnames-400258971-project] [instance: 78aef3f6-9cff-4db4-95c1-f0d5480b7a3c] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:55:51.826208 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-91b6b829-da04-4d6e-be03-79f36fc879a8 tempest-ServersTestFqdnHostnames-400258971 tempest-ServersTestFqdnHostnames-400258971-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:51.827129 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-91b6b829-da04-4d6e-be03-79f36fc879a8 tempest-ServersTestFqdnHostnames-400258971 tempest-ServersTestFqdnHostnames-400258971-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:51.827614 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-91b6b829-da04-4d6e-be03-79f36fc879a8 tempest-ServersTestFqdnHostnames-400258971 tempest-ServersTestFqdnHostnames-400258971-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:51.828414 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-91b6b829-da04-4d6e-be03-79f36fc879a8 tempest-ServersTestFqdnHostnames-400258971 tempest-ServersTestFqdnHostnames-400258971-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:51.829090 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-91b6b829-da04-4d6e-be03-79f36fc879a8 tempest-ServersTestFqdnHostnames-400258971 tempest-ServersTestFqdnHostnames-400258971-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:51.829896 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-91b6b829-da04-4d6e-be03-79f36fc879a8 tempest-ServersTestFqdnHostnames-400258971 tempest-ServersTestFqdnHostnames-400258971-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:51.847594 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.wsgi [None req-04040082-b660-43d5-9d7d-d5ffd4748fe0 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] HTTP exception thrown: Floating IP 172.35.2.224 is not associated with instance 29a351ac-ecf5-4b11-9bdd-f1c93df1335a. Oct 22 20:55:51.849835 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-04040082-b660-43d5-9d7d-d5ffd4748fe0 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Request method failure captured: Oct 22 20:55:51.849835 ncdv-master-1 devstack@n-api.service[138745]: request: POST /compute/v2.1/servers/29a351ac-ecf5-4b11-9bdd-f1c93df1335a/action HTTP/1.1 Oct 22 20:55:51.849835 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 20:55:51.849835 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 20:55:51.849835 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 20:55:51.849835 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 49 Oct 22 20:55:51.849835 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 20:55:51.849835 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 20:55:51.849835 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 20:55:51.849835 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 20:55:51.849835 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVFiCX4qi1toITSNXXZAA4zJRL4Z-tEaLsPig7vwCIxFzHhgpfZzKEZgzHRjqoMZPu5dyrSuPgrW5CAgewXSUJpj2NyXzw_QN2lPPiKoYaJrXQqGbBy3YIoLoq2X1cQW9oGz__9NYXLj4hRYCsg2qiZ71RuufQk6o4LVHRRj38STOBi8 Oct 22 20:55:51.849835 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 20:55:51.849835 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 20:55:51.849835 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 20:55:51.849835 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 20:55:51.849835 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 20:55:51.849835 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 20:55:51.849835 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: 42111ed6bcc3465d8c1f5291da248e74 Oct 22 20:55:51.849835 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-462023843 Oct 22 20:55:51.849835 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 20:55:51.849835 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 20:55:51.849835 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_42111ed6bcc3465d8c1f5291da248e74"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/42111ed6bcc3465d8c1f5291da248e74"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/42111ed6bcc3465d8c1f5291da248e74"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/42111ed6bcc3465d8c1f5291da248e74"}]}] Oct 22 20:55:51.849835 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-462023843 Oct 22 20:55:51.849835 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: 42111ed6bcc3465d8c1f5291da248e74 Oct 22 20:55:51.849835 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-462023843 Oct 22 20:55:51.849835 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-FloatingIPsAssociationTestJSON-462023843-project Oct 22 20:55:51.849835 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 20:55:51.849835 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 20:55:51.849835 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: 5be93cabff0d46ccb2a3db0db1a13796 Oct 22 20:55:51.849835 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-462023843-project Oct 22 20:55:51.849835 ncdv-master-1 devstack@n-api.service[138745]: Oct 22 20:55:51.849835 ncdv-master-1 devstack@n-api.service[138745]: {"removeFloatingIp": {"address": "172.35.2.224"}} Oct 22 20:55:51.849835 ncdv-master-1 devstack@n-api.service[138745]: method: Oct 22 20:55:51.849835 ncdv-master-1 devstack@n-api.service[138745]: exception: Floating IP 172.35.2.224 is not associated with instance 29a351ac-ecf5-4b11-9bdd-f1c93df1335a. Oct 22 20:55:51.849835 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'id': '29a351ac-ecf5-4b11-9bdd-f1c93df1335a', 'body': {'removeFloatingIp': {'address': '172.35.2.224'}}} Oct 22 20:55:51.849835 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:55:51.849835 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:55:51.849835 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:55:51.849835 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:55:51.849835 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:55:51.849835 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:55:51.849835 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 22 20:55:51.849835 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 22 20:55:51.849835 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:55:51.849835 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:55:51.849835 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 20:55:51.849835 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 20:55:51.849835 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 300, in _remove_floating_ip Oct 22 20:55:51.849835 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 22 20:55:51.849835 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Floating IP 172.35.2.224 is not associated with instance 29a351ac-ecf5-4b11-9bdd-f1c93df1335a. Oct 22 20:55:51.849835 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:55:51.849835 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:55:51.849835 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:55:51.849835 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:55:51.849835 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:55:51.849835 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:55:51.849835 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 20:55:51.849835 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 20:55:51.849835 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP 172.35.2.224 is not associated with instance 29a351ac-ecf5-4b11-9bdd-f1c93df1335a. Oct 22 20:55:51.849835 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:55:51.856985 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-04040082-b660-43d5-9d7d-d5ffd4748fe0 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Returning 409 to user: Floating IP 172.35.2.224 is not associated with instance 29a351ac-ecf5-4b11-9bdd-f1c93df1335a. {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:55:51.858272 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-04040082-b660-43d5-9d7d-d5ffd4748fe0 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] 10.222.0.18 "POST /compute/v2.1/servers/29a351ac-ecf5-4b11-9bdd-f1c93df1335a/action" status: 409 len: 146 microversion: 2.1 time: 0.706935 Oct 22 20:55:51.863026 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 893/1679] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 20:55:51 2022] POST /compute/v2.1/servers/29a351ac-ecf5-4b11-9bdd-f1c93df1335a/action => generated 146 bytes in 712 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 22 20:55:51.954726 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-91b6b829-da04-4d6e-be03-79f36fc879a8 tempest-ServersTestFqdnHostnames-400258971 tempest-ServersTestFqdnHostnames-400258971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02fdeda494a547f1a8714007e05e874d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b75771ecf442919c647f15d499880e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:55:51.972172 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-91b6b829-da04-4d6e-be03-79f36fc879a8 tempest-ServersTestFqdnHostnames-400258971 tempest-ServersTestFqdnHostnames-400258971-project] 10.222.0.18 "GET /compute/v2.1/servers/78aef3f6-9cff-4db4-95c1-f0d5480b7a3c" status: 200 len: 1230 microversion: 2.1 time: 0.179011 Oct 22 20:55:51.988421 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 787/1680] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:55:51 2022] GET /compute/v2.1/servers/78aef3f6-9cff-4db4-95c1-f0d5480b7a3c => generated 1230 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:55:51.994716 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-58f80ee4-bd2f-4a99-b4bf-087448997d1d tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Calling method '.version_select at 0x7fd3a4448700>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:55:52.233956 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-58f80ee4-bd2f-4a99-b4bf-087448997d1d tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] 10.222.0.18 "DELETE /compute/v2.1/images/474ae65f-4a05-438e-94bb-dd4bc5b0a82e" status: 204 len: 0 microversion: 2.1 time: 0.244520 Oct 22 20:55:52.238519 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 788/1681] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:55:51 2022] DELETE /compute/v2.1/images/474ae65f-4a05-438e-94bb-dd4bc5b0a82e => generated 0 bytes in 246 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 20:55:52.246064 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-287cb04a-22b3-4c43-a4bd-f60404a8cf67 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:55:52.247267 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-287cb04a-22b3-4c43-a4bd-f60404a8cf67 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] [instance: 98f48cb1-54ed-4e82-8a25-fd004ddb5758] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:55:52.248700 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-a8705f3c-8b60-461b-a0ed-76416ee95365 tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] Calling method '.version_select at 0x7fd39fd34670>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:55:52.253699 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a8705f3c-8b60-461b-a0ed-76416ee95365 tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:52.254290 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a8705f3c-8b60-461b-a0ed-76416ee95365 tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:52.255502 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-287cb04a-22b3-4c43-a4bd-f60404a8cf67 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:52.255858 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a8705f3c-8b60-461b-a0ed-76416ee95365 tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:52.256157 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-287cb04a-22b3-4c43-a4bd-f60404a8cf67 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:52.256910 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-287cb04a-22b3-4c43-a4bd-f60404a8cf67 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:52.258307 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-287cb04a-22b3-4c43-a4bd-f60404a8cf67 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:52.259305 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-287cb04a-22b3-4c43-a4bd-f60404a8cf67 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:52.260017 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-287cb04a-22b3-4c43-a4bd-f60404a8cf67 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:52.272865 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-a8705f3c-8b60-461b-a0ed-76416ee95365 tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] 10.222.0.18 "GET /compute/v2.1/os-migrations" status: 200 len: 2288 microversion: 2.1 time: 0.408177 Oct 22 20:55:52.274278 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 894/1682] 10.222.0.18 () {58 vars in 1143 bytes} [Sat Oct 22 20:55:51 2022] GET /compute/v2.1/os-migrations => generated 2288 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:55:52.281711 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-5dff17b1-6e32-4e8b-9e94-d73d5a54fb4e tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.35.2.224"}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:55:52.666372 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-5dff17b1-6e32-4e8b-9e94-d73d5a54fb4e tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] [instance: 532d6e6a-71ab-4ef0-a5bf-c042055c5121] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:55:52.675137 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5dff17b1-6e32-4e8b-9e94-d73d5a54fb4e tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:52.676162 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5dff17b1-6e32-4e8b-9e94-d73d5a54fb4e tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:52.677631 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5dff17b1-6e32-4e8b-9e94-d73d5a54fb4e tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:52.681076 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5dff17b1-6e32-4e8b-9e94-d73d5a54fb4e tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:52.682178 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5dff17b1-6e32-4e8b-9e94-d73d5a54fb4e tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:52.682875 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5dff17b1-6e32-4e8b-9e94-d73d5a54fb4e tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:53.042614 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-287cb04a-22b3-4c43-a4bd-f60404a8cf67 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d3d7458af447bdb3f03e83a2d8559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49238b8686d24ae698679e4a1957735d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:55:53.057449 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-287cb04a-22b3-4c43-a4bd-f60404a8cf67 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] 10.222.0.18 "GET /compute/v2.1/servers/98f48cb1-54ed-4e82-8a25-fd004ddb5758" status: 200 len: 1469 microversion: 2.1 time: 0.812868 Oct 22 20:55:53.062123 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 789/1683] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:55:52 2022] GET /compute/v2.1/servers/98f48cb1-54ed-4e82-8a25-fd004ddb5758 => generated 1469 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:55:53.075446 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-2afa9680-98b5-4ec3-8108-5ade83e1cbc1 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:55:53.076212 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-2afa9680-98b5-4ec3-8108-5ade83e1cbc1 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] [instance: bccbf2b3-70e3-406d-b844-e48d765732cf] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:55:53.090587 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2afa9680-98b5-4ec3-8108-5ade83e1cbc1 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:53.091562 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2afa9680-98b5-4ec3-8108-5ade83e1cbc1 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:53.092368 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2afa9680-98b5-4ec3-8108-5ade83e1cbc1 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:53.093337 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2afa9680-98b5-4ec3-8108-5ade83e1cbc1 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:53.094047 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2afa9680-98b5-4ec3-8108-5ade83e1cbc1 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:53.104008 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2afa9680-98b5-4ec3-8108-5ade83e1cbc1 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:53.158543 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5dff17b1-6e32-4e8b-9e94-d73d5a54fb4e tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Acquiring lock "refresh_cache-532d6e6a-71ab-4ef0-a5bf-c042055c5121" {{(pid=138745) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 22 20:55:53.159305 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5dff17b1-6e32-4e8b-9e94-d73d5a54fb4e tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Acquired lock "refresh_cache-532d6e6a-71ab-4ef0-a5bf-c042055c5121" {{(pid=138745) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 22 20:55:53.472471 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-2afa9680-98b5-4ec3-8108-5ade83e1cbc1 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b638db630404ebbbcc2253db30844c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cc7342bf7941d2ad7ebc70032dd52e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:55:53.491323 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-2afa9680-98b5-4ec3-8108-5ade83e1cbc1 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] 10.222.0.18 "GET /compute/v2.1/servers/bccbf2b3-70e3-406d-b844-e48d765732cf" status: 200 len: 1318 microversion: 2.1 time: 0.423849 Oct 22 20:55:53.492815 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 790/1684] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:55:53 2022] GET /compute/v2.1/servers/bccbf2b3-70e3-406d-b844-e48d765732cf => generated 1318 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:55:53.505505 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-56e91453-83dc-4ddb-9626-e607f02ff448 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:55:53.509829 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-56e91453-83dc-4ddb-9626-e607f02ff448 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] [instance: a64fa89e-32f6-4994-a0b2-3788cf1c92ec] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:55:53.523313 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-56e91453-83dc-4ddb-9626-e607f02ff448 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:53.523915 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-56e91453-83dc-4ddb-9626-e607f02ff448 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:53.524275 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-56e91453-83dc-4ddb-9626-e607f02ff448 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:53.531551 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-56e91453-83dc-4ddb-9626-e607f02ff448 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:53.535472 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-56e91453-83dc-4ddb-9626-e607f02ff448 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:53.536201 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-56e91453-83dc-4ddb-9626-e607f02ff448 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:53.940639 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-56e91453-83dc-4ddb-9626-e607f02ff448 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b392ad1fe1fd4b2a9e6be03a7435deb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594624ed28aa433d907c8833d360b82e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:55:53.950306 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-56e91453-83dc-4ddb-9626-e607f02ff448 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] 10.222.0.18 "GET /compute/v2.1/servers/a64fa89e-32f6-4994-a0b2-3788cf1c92ec" status: 200 len: 1539 microversion: 2.1 time: 0.456188 Oct 22 20:55:53.968141 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 791/1685] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:55:53 2022] GET /compute/v2.1/servers/a64fa89e-32f6-4994-a0b2-3788cf1c92ec => generated 1539 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:55:53.980988 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-8a133ddc-b094-4567-a2aa-8790253ee18e tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:55:53.981904 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-8a133ddc-b094-4567-a2aa-8790253ee18e tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] [instance: fbb34507-cef9-4d78-9ed7-5d6eab4ca806] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:55:53.993781 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8a133ddc-b094-4567-a2aa-8790253ee18e tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:53.994581 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8a133ddc-b094-4567-a2aa-8790253ee18e tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:53.996398 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8a133ddc-b094-4567-a2aa-8790253ee18e tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:53.998163 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8a133ddc-b094-4567-a2aa-8790253ee18e tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:53.999402 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8a133ddc-b094-4567-a2aa-8790253ee18e tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:54.000259 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8a133ddc-b094-4567-a2aa-8790253ee18e tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:54.853988 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-8a133ddc-b094-4567-a2aa-8790253ee18e tempest-LiveMigrationTest-1665192420 tempest-LiveMigrationTest-1665192420-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/fbb34507-cef9-4d78-9ed7-5d6eab4ca806" status: 200 len: 1533 microversion: 2.1 time: 0.880129 Oct 22 20:55:54.871394 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 792/1686] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:55:53 2022] GET /compute/v2.1/servers/fbb34507-cef9-4d78-9ed7-5d6eab4ca806 => generated 1533 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:55:54.871394 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-7bed7c2f-b4ce-4dba-929d-248b4317e15e req-ad087a5f-c4c4-4ce0-a811-cff65d783a42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bccbf2b3-70e3-406d-b844-e48d765732cf", "name": "network-vif-plugged", "status": "completed", "tag": "f10bd596-45de-410e-8f59-646e0dbcc5cc"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:55:54.889347 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-7bed7c2f-b4ce-4dba-929d-248b4317e15e req-ad087a5f-c4c4-4ce0-a811-cff65d783a42 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:54.889347 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-7bed7c2f-b4ce-4dba-929d-248b4317e15e req-ad087a5f-c4c4-4ce0-a811-cff65d783a42 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:54.889347 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-7bed7c2f-b4ce-4dba-929d-248b4317e15e req-ad087a5f-c4c4-4ce0-a811-cff65d783a42 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:54.905443 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-7bed7c2f-b4ce-4dba-929d-248b4317e15e req-ad087a5f-c4c4-4ce0-a811-cff65d783a42 service nova] Creating event network-vif-plugged:f10bd596-45de-410e-8f59-646e0dbcc5cc for instance bccbf2b3-70e3-406d-b844-e48d765732cf on nch2-master-1 Oct 22 20:55:54.912867 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-7bed7c2f-b4ce-4dba-929d-248b4317e15e req-ad087a5f-c4c4-4ce0-a811-cff65d783a42 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050786 Oct 22 20:55:54.913804 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 793/1687] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:55:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:55:54.922830 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-8d774659-a650-4b58-9417-56f7f86534bd tempest-ServersTestFqdnHostnames-400258971 tempest-ServersTestFqdnHostnames-400258971-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:55:54.924185 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-8d774659-a650-4b58-9417-56f7f86534bd tempest-ServersTestFqdnHostnames-400258971 tempest-ServersTestFqdnHostnames-400258971-project] [instance: 78aef3f6-9cff-4db4-95c1-f0d5480b7a3c] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:55:54.934386 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8d774659-a650-4b58-9417-56f7f86534bd tempest-ServersTestFqdnHostnames-400258971 tempest-ServersTestFqdnHostnames-400258971-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:54.935052 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8d774659-a650-4b58-9417-56f7f86534bd tempest-ServersTestFqdnHostnames-400258971 tempest-ServersTestFqdnHostnames-400258971-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:54.935619 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8d774659-a650-4b58-9417-56f7f86534bd tempest-ServersTestFqdnHostnames-400258971 tempest-ServersTestFqdnHostnames-400258971-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:54.937127 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8d774659-a650-4b58-9417-56f7f86534bd tempest-ServersTestFqdnHostnames-400258971 tempest-ServersTestFqdnHostnames-400258971-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:54.937771 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8d774659-a650-4b58-9417-56f7f86534bd tempest-ServersTestFqdnHostnames-400258971 tempest-ServersTestFqdnHostnames-400258971-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:54.938339 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8d774659-a650-4b58-9417-56f7f86534bd tempest-ServersTestFqdnHostnames-400258971 tempest-ServersTestFqdnHostnames-400258971-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:55.075130 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-8d774659-a650-4b58-9417-56f7f86534bd tempest-ServersTestFqdnHostnames-400258971 tempest-ServersTestFqdnHostnames-400258971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02fdeda494a547f1a8714007e05e874d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b75771ecf442919c647f15d499880e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:55:55.088622 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:SELECT=90,nova_cell1:SAVEPOINT=2,nova_cell1:UPDATE=4,nova_cell1:RELEASE=2,nova_cell1:INSERT=2 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:55:55.092325 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-8d774659-a650-4b58-9417-56f7f86534bd tempest-ServersTestFqdnHostnames-400258971 tempest-ServersTestFqdnHostnames-400258971-project] 10.222.0.18 "GET /compute/v2.1/servers/78aef3f6-9cff-4db4-95c1-f0d5480b7a3c" status: 200 len: 1284 microversion: 2.1 time: 0.177100 Oct 22 20:55:55.094455 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 794/1688] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:55:54 2022] GET /compute/v2.1/servers/78aef3f6-9cff-4db4-95c1-f0d5480b7a3c => generated 1284 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:55:55.212747 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-63d85c91-eca1-425a-b215-54eabb06632b tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1800526150", "imageRef": "085e4478-6edc-4a69-8e08-f9831713eb65", "flavorRef": "452", "networks": [{"uuid": "a92562c3-4652-47d9-939e-7f79a0b7461f"}]}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:55:55.224036 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.network.neutron [None req-5dff17b1-6e32-4e8b-9e94-d73d5a54fb4e tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] [instance: 532d6e6a-71ab-4ef0-a5bf-c042055c5121] Building network info cache for instance {{(pid=138745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 22 20:55:55.332115 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.network.neutron [None req-63d85c91-eca1-425a-b215-54eabb06632b tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] validate_networks() for [('a92562c3-4652-47d9-939e-7f79a0b7461f', None, None, None, None, None)] {{(pid=138744) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 20:55:56.550212 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-63d85c91-eca1-425a-b215-54eabb06632b tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Flavor limits 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 20:55:56.552097 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-63d85c91-eca1-425a-b215-54eabb06632b tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Image limits 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 20:55:56.553066 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-63d85c91-eca1-425a-b215-54eabb06632b tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Flavor pref 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 20:55:56.553804 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-63d85c91-eca1-425a-b215-54eabb06632b tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Image pref 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 20:55:56.554534 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-63d85c91-eca1-425a-b215-54eabb06632b tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 20:55:56.585637 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-63d85c91-eca1-425a-b215-54eabb06632b tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:56.586656 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-63d85c91-eca1-425a-b215-54eabb06632b tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:56.587462 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-63d85c91-eca1-425a-b215-54eabb06632b tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:56.588459 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-63d85c91-eca1-425a-b215-54eabb06632b tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:56.590332 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-63d85c91-eca1-425a-b215-54eabb06632b tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:56.591847 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-63d85c91-eca1-425a-b215-54eabb06632b tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:56.665250 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-63d85c91-eca1-425a-b215-54eabb06632b tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Getting quotas for project 371ecb87e8d34859971be23c1a1bc443. Resources: {'cores', 'instances', 'ram'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 20:55:56.680120 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-63d85c91-eca1-425a-b215-54eabb06632b tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Getting quotas for user e787e0b494764176a0f13d75c47d77fa and project 371ecb87e8d34859971be23c1a1bc443. Resources: {'cores', 'instances', 'ram'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 20:55:56.710450 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-63d85c91-eca1-425a-b215-54eabb06632b tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Going to run 1 instances... {{(pid=138744) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 20:55:56.713111 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-63d85c91-eca1-425a-b215-54eabb06632b tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] [instance: 28c2b09f-e43f-472b-b8db-f407c341acfd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='085e4478-6edc-4a69-8e08-f9831713eb65',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138744) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 20:55:56.777434 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-63d85c91-eca1-425a-b215-54eabb06632b tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.681385 Oct 22 20:55:56.779316 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 795/1689] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Oct 22 20:55:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 1684 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 20:55:56.786070 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-557fbdb6-ff03-4d9c-b8d7-f73fc723c981 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:55:56.786966 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-557fbdb6-ff03-4d9c-b8d7-f73fc723c981 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] [instance: 98f48cb1-54ed-4e82-8a25-fd004ddb5758] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:55:56.805806 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.network.neutron [None req-5dff17b1-6e32-4e8b-9e94-d73d5a54fb4e tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] [instance: 532d6e6a-71ab-4ef0-a5bf-c042055c5121] Updating instance_info_cache with network_info: [{"id": "7c68227f-68b8-459e-8cf6-9b169351d597", "address": "fa:16:3e:f5:a4:2f", "network": {"id": "ba2fbd7d-5bd8-4316-b6a5-ea0e685a80cc", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1738311782-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "42111ed6bcc3465d8c1f5291da248e74", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap7c68227f-68", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=138745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 22 20:55:56.818003 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-557fbdb6-ff03-4d9c-b8d7-f73fc723c981 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:56.818722 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-557fbdb6-ff03-4d9c-b8d7-f73fc723c981 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:56.820652 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-557fbdb6-ff03-4d9c-b8d7-f73fc723c981 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:56.821338 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-557fbdb6-ff03-4d9c-b8d7-f73fc723c981 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:56.821819 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-557fbdb6-ff03-4d9c-b8d7-f73fc723c981 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:56.823823 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-557fbdb6-ff03-4d9c-b8d7-f73fc723c981 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:56.867159 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5dff17b1-6e32-4e8b-9e94-d73d5a54fb4e tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Releasing lock "refresh_cache-532d6e6a-71ab-4ef0-a5bf-c042055c5121" {{(pid=138745) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 22 20:55:56.868198 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-5dff17b1-6e32-4e8b-9e94-d73d5a54fb4e tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] 10.222.0.18 "POST /compute/v2.1/servers/532d6e6a-71ab-4ef0-a5bf-c042055c5121/action" status: 202 len: 0 microversion: 2.1 time: 4.591290 Oct 22 20:55:56.869028 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 895/1690] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 20:55:52 2022] POST /compute/v2.1/servers/532d6e6a-71ab-4ef0-a5bf-c042055c5121/action => generated 0 bytes in 4594 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 22 20:55:56.881735 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-ca766ed9-dbf2-4d7c-8469-8b2e7dde8800 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:55:56.882509 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-ca766ed9-dbf2-4d7c-8469-8b2e7dde8800 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] [instance: bccbf2b3-70e3-406d-b844-e48d765732cf] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:55:56.899239 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ca766ed9-dbf2-4d7c-8469-8b2e7dde8800 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:56.902793 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ca766ed9-dbf2-4d7c-8469-8b2e7dde8800 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:56.908844 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ca766ed9-dbf2-4d7c-8469-8b2e7dde8800 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:56.910236 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ca766ed9-dbf2-4d7c-8469-8b2e7dde8800 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:56.911044 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ca766ed9-dbf2-4d7c-8469-8b2e7dde8800 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:56.911705 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ca766ed9-dbf2-4d7c-8469-8b2e7dde8800 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:56.958314 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell1:SELECT=97,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:55:57.152202 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-557fbdb6-ff03-4d9c-b8d7-f73fc723c981 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d3d7458af447bdb3f03e83a2d8559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49238b8686d24ae698679e4a1957735d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:55:57.165212 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-557fbdb6-ff03-4d9c-b8d7-f73fc723c981 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] 10.222.0.18 "GET /compute/v2.1/servers/98f48cb1-54ed-4e82-8a25-fd004ddb5758" status: 200 len: 1474 microversion: 2.1 time: 0.383807 Oct 22 20:55:57.172757 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 796/1691] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:55:56 2022] GET /compute/v2.1/servers/98f48cb1-54ed-4e82-8a25-fd004ddb5758 => generated 1474 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:55:57.180029 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-457feaef-f847-4b3f-bd10-e570d051d3ab tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:55:57.182946 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-457feaef-f847-4b3f-bd10-e570d051d3ab tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] [instance: fbb34507-cef9-4d78-9ed7-5d6eab4ca806] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:55:57.197511 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-457feaef-f847-4b3f-bd10-e570d051d3ab tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:57.198270 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-457feaef-f847-4b3f-bd10-e570d051d3ab tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:57.198829 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-457feaef-f847-4b3f-bd10-e570d051d3ab tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:57.200259 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-457feaef-f847-4b3f-bd10-e570d051d3ab tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:57.200915 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-457feaef-f847-4b3f-bd10-e570d051d3ab tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:57.201538 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-457feaef-f847-4b3f-bd10-e570d051d3ab tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:57.245596 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-457feaef-f847-4b3f-bd10-e570d051d3ab tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] [instance: fbb34507-cef9-4d78-9ed7-5d6eab4ca806] Going to try to terminate instance {{(pid=138744) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 20:55:57.253358 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-ca766ed9-dbf2-4d7c-8469-8b2e7dde8800 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b638db630404ebbbcc2253db30844c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cc7342bf7941d2ad7ebc70032dd52e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:55:57.266088 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-ca766ed9-dbf2-4d7c-8469-8b2e7dde8800 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] 10.222.0.18 "GET /compute/v2.1/servers/bccbf2b3-70e3-406d-b844-e48d765732cf" status: 200 len: 1506 microversion: 2.1 time: 0.395734 Oct 22 20:55:57.266686 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 896/1692] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:55:56 2022] GET /compute/v2.1/servers/bccbf2b3-70e3-406d-b844-e48d765732cf => generated 1506 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:55:57.286125 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-24533ff9-ee71-4687-9d22-48a98aef4349 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:55:57.288776 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-24533ff9-ee71-4687-9d22-48a98aef4349 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] [instance: a64fa89e-32f6-4994-a0b2-3788cf1c92ec] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:55:57.294948 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:55:57.307182 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-24533ff9-ee71-4687-9d22-48a98aef4349 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:57.307680 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-24533ff9-ee71-4687-9d22-48a98aef4349 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:57.311075 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-24533ff9-ee71-4687-9d22-48a98aef4349 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:57.311981 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-24533ff9-ee71-4687-9d22-48a98aef4349 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:57.312647 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-24533ff9-ee71-4687-9d22-48a98aef4349 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:57.313036 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-24533ff9-ee71-4687-9d22-48a98aef4349 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:57.468566 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-457feaef-f847-4b3f-bd10-e570d051d3ab tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] 10.222.0.18 "DELETE /compute/v2.1/servers/fbb34507-cef9-4d78-9ed7-5d6eab4ca806" status: 204 len: 0 microversion: 2.1 time: 0.293755 Oct 22 20:55:57.469689 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 797/1693] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 20:55:57 2022] DELETE /compute/v2.1/servers/fbb34507-cef9-4d78-9ed7-5d6eab4ca806 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 20:55:57.480910 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-29bcf35d-8fc8-4027-8493-fb1f5d8fe692 req-18ca2028-1a64-491f-9c35-afa15dbac1c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "532d6e6a-71ab-4ef0-a5bf-c042055c5121", "tag": "7c68227f-68b8-459e-8cf6-9b169351d597"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:55:57.505815 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-29bcf35d-8fc8-4027-8493-fb1f5d8fe692 req-18ca2028-1a64-491f-9c35-afa15dbac1c0 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:57.506584 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-29bcf35d-8fc8-4027-8493-fb1f5d8fe692 req-18ca2028-1a64-491f-9c35-afa15dbac1c0 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:57.508769 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-29bcf35d-8fc8-4027-8493-fb1f5d8fe692 req-18ca2028-1a64-491f-9c35-afa15dbac1c0 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:57.540016 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-29bcf35d-8fc8-4027-8493-fb1f5d8fe692 req-18ca2028-1a64-491f-9c35-afa15dbac1c0 service nova] Creating event network-changed:7c68227f-68b8-459e-8cf6-9b169351d597 for instance 532d6e6a-71ab-4ef0-a5bf-c042055c5121 on nch1-master-1 Oct 22 20:55:57.551146 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-29bcf35d-8fc8-4027-8493-fb1f5d8fe692 req-18ca2028-1a64-491f-9c35-afa15dbac1c0 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078640 Oct 22 20:55:57.555227 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 798/1694] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:55:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:55:57.569047 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-f48643bf-8373-4f12-af8c-c9fef62b7355 tempest-ServersTestFqdnHostnames-400258971 tempest-ServersTestFqdnHostnames-400258971-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:55:57.570416 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-f48643bf-8373-4f12-af8c-c9fef62b7355 tempest-ServersTestFqdnHostnames-400258971 tempest-ServersTestFqdnHostnames-400258971-project] [instance: 78aef3f6-9cff-4db4-95c1-f0d5480b7a3c] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:55:57.587669 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f48643bf-8373-4f12-af8c-c9fef62b7355 tempest-ServersTestFqdnHostnames-400258971 tempest-ServersTestFqdnHostnames-400258971-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:57.588224 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f48643bf-8373-4f12-af8c-c9fef62b7355 tempest-ServersTestFqdnHostnames-400258971 tempest-ServersTestFqdnHostnames-400258971-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:57.591480 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f48643bf-8373-4f12-af8c-c9fef62b7355 tempest-ServersTestFqdnHostnames-400258971 tempest-ServersTestFqdnHostnames-400258971-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:57.593634 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f48643bf-8373-4f12-af8c-c9fef62b7355 tempest-ServersTestFqdnHostnames-400258971 tempest-ServersTestFqdnHostnames-400258971-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:57.594306 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f48643bf-8373-4f12-af8c-c9fef62b7355 tempest-ServersTestFqdnHostnames-400258971 tempest-ServersTestFqdnHostnames-400258971-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:57.594954 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f48643bf-8373-4f12-af8c-c9fef62b7355 tempest-ServersTestFqdnHostnames-400258971 tempest-ServersTestFqdnHostnames-400258971-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:58.000767 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-24533ff9-ee71-4687-9d22-48a98aef4349 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b392ad1fe1fd4b2a9e6be03a7435deb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594624ed28aa433d907c8833d360b82e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:55:58.035944 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-24533ff9-ee71-4687-9d22-48a98aef4349 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] 10.222.0.18 "GET /compute/v2.1/servers/a64fa89e-32f6-4994-a0b2-3788cf1c92ec" status: 200 len: 1521 microversion: 2.1 time: 0.763057 Oct 22 20:55:58.039160 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 897/1695] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:55:57 2022] GET /compute/v2.1/servers/a64fa89e-32f6-4994-a0b2-3788cf1c92ec => generated 1521 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:55:58.046744 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-8c31a2a3-b471-45a3-a1e0-bae2384e3cfd tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1526610006", "imageRef": "085e4478-6edc-4a69-8e08-f9831713eb65", "flavorRef": "452", "networks": [{"uuid": "a92562c3-4652-47d9-939e-7f79a0b7461f"}]}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:55:58.166200 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.network.neutron [None req-8c31a2a3-b471-45a3-a1e0-bae2384e3cfd tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] validate_networks() for [('a92562c3-4652-47d9-939e-7f79a0b7461f', None, None, None, None, None)] {{(pid=138745) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 20:55:58.330573 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-f48643bf-8373-4f12-af8c-c9fef62b7355 tempest-ServersTestFqdnHostnames-400258971 tempest-ServersTestFqdnHostnames-400258971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02fdeda494a547f1a8714007e05e874d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b75771ecf442919c647f15d499880e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:55:58.345210 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-f48643bf-8373-4f12-af8c-c9fef62b7355 tempest-ServersTestFqdnHostnames-400258971 tempest-ServersTestFqdnHostnames-400258971-project] 10.222.0.18 "GET /compute/v2.1/servers/78aef3f6-9cff-4db4-95c1-f0d5480b7a3c" status: 200 len: 1352 microversion: 2.1 time: 0.788354 Oct 22 20:55:58.346089 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 799/1696] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:55:57 2022] GET /compute/v2.1/servers/78aef3f6-9cff-4db4-95c1-f0d5480b7a3c => generated 1352 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:55:58.365347 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-b2a95f07-4b71-4c07-b805-1ab802b87ee5 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:55:58.366497 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-b2a95f07-4b71-4c07-b805-1ab802b87ee5 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] [instance: 532d6e6a-71ab-4ef0-a5bf-c042055c5121] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:55:58.373026 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b2a95f07-4b71-4c07-b805-1ab802b87ee5 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:58.373521 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b2a95f07-4b71-4c07-b805-1ab802b87ee5 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:58.380826 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b2a95f07-4b71-4c07-b805-1ab802b87ee5 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:58.381691 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b2a95f07-4b71-4c07-b805-1ab802b87ee5 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:58.382185 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b2a95f07-4b71-4c07-b805-1ab802b87ee5 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:58.382635 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b2a95f07-4b71-4c07-b805-1ab802b87ee5 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:58.452333 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-b2a95f07-4b71-4c07-b805-1ab802b87ee5 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] [instance: 532d6e6a-71ab-4ef0-a5bf-c042055c5121] Going to try to terminate instance {{(pid=138744) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 20:55:58.617283 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-b2a95f07-4b71-4c07-b805-1ab802b87ee5 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] 10.222.0.18 "DELETE /compute/v2.1/servers/532d6e6a-71ab-4ef0-a5bf-c042055c5121" status: 204 len: 0 microversion: 2.1 time: 0.261086 Oct 22 20:55:58.617889 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 800/1697] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 20:55:58 2022] DELETE /compute/v2.1/servers/532d6e6a-71ab-4ef0-a5bf-c042055c5121 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 20:55:58.626013 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-d5c33513-7235-4959-862b-812461e2661d req-b88fe73e-7342-452e-9861-d59fb0e1fa12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a64fa89e-32f6-4994-a0b2-3788cf1c92ec", "name": "network-vif-plugged", "status": "completed", "tag": "e916fb42-f87f-4b20-b6b6-8abd516f5e15"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:55:58.659557 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-d5c33513-7235-4959-862b-812461e2661d req-b88fe73e-7342-452e-9861-d59fb0e1fa12 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:58.660327 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-d5c33513-7235-4959-862b-812461e2661d req-b88fe73e-7342-452e-9861-d59fb0e1fa12 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:58.660963 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-d5c33513-7235-4959-862b-812461e2661d req-b88fe73e-7342-452e-9861-d59fb0e1fa12 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:58.690046 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-d5c33513-7235-4959-862b-812461e2661d req-b88fe73e-7342-452e-9861-d59fb0e1fa12 service nova] Creating event network-vif-plugged:e916fb42-f87f-4b20-b6b6-8abd516f5e15 for instance a64fa89e-32f6-4994-a0b2-3788cf1c92ec on nch2-master-1 Oct 22 20:55:58.696002 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-d5c33513-7235-4959-862b-812461e2661d req-b88fe73e-7342-452e-9861-d59fb0e1fa12 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076286 Oct 22 20:55:58.700606 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 801/1698] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:55:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:55:58.707674 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-dbb56a85-854c-46a2-8e4b-bd2a13dbf13f tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:55:58.708405 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-dbb56a85-854c-46a2-8e4b-bd2a13dbf13f tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] [instance: 73404cab-dc0f-4f1c-b38b-a1505a5dc8b2] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:55:58.717029 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-dbb56a85-854c-46a2-8e4b-bd2a13dbf13f tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:58.717532 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-dbb56a85-854c-46a2-8e4b-bd2a13dbf13f tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:58.717973 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-dbb56a85-854c-46a2-8e4b-bd2a13dbf13f tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:58.718684 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-dbb56a85-854c-46a2-8e4b-bd2a13dbf13f tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:58.719130 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-dbb56a85-854c-46a2-8e4b-bd2a13dbf13f tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:58.719654 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-dbb56a85-854c-46a2-8e4b-bd2a13dbf13f tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:59.120708 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-dbb56a85-854c-46a2-8e4b-bd2a13dbf13f tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b638db630404ebbbcc2253db30844c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cc7342bf7941d2ad7ebc70032dd52e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:55:59.131428 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-dbb56a85-854c-46a2-8e4b-bd2a13dbf13f tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] 10.222.0.18 "GET /compute/v2.1/servers/73404cab-dc0f-4f1c-b38b-a1505a5dc8b2" status: 200 len: 1506 microversion: 2.1 time: 0.429083 Oct 22 20:55:59.132411 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 802/1699] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:55:58 2022] GET /compute/v2.1/servers/73404cab-dc0f-4f1c-b38b-a1505a5dc8b2 => generated 1506 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:55:59.139004 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-84e062c9-7639-4aea-8104-b57bb671d357 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:55:59.140233 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-84e062c9-7639-4aea-8104-b57bb671d357 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] [instance: fbb34507-cef9-4d78-9ed7-5d6eab4ca806] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:55:59.147626 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-84e062c9-7639-4aea-8104-b57bb671d357 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:59.148985 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-84e062c9-7639-4aea-8104-b57bb671d357 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:59.149824 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-84e062c9-7639-4aea-8104-b57bb671d357 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:59.150788 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-84e062c9-7639-4aea-8104-b57bb671d357 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:59.151759 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-84e062c9-7639-4aea-8104-b57bb671d357 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:59.152436 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-84e062c9-7639-4aea-8104-b57bb671d357 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:59.497864 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-84e062c9-7639-4aea-8104-b57bb671d357 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c87f0356ca346f39c6216393d85da2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee8c8f7fc4e12bc1f9fcce3e7b581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:55:59.511614 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-84e062c9-7639-4aea-8104-b57bb671d357 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] 10.222.0.18 "GET /compute/v2.1/servers/fbb34507-cef9-4d78-9ed7-5d6eab4ca806" status: 200 len: 1388 microversion: 2.1 time: 0.377656 Oct 22 20:55:59.512647 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 803/1700] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:55:59 2022] GET /compute/v2.1/servers/fbb34507-cef9-4d78-9ed7-5d6eab4ca806 => generated 1388 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:55:59.520891 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-208a7566-e8fc-4e4c-8435-2eebf419efd7 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:55:59.522159 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-208a7566-e8fc-4e4c-8435-2eebf419efd7 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] [instance: a64fa89e-32f6-4994-a0b2-3788cf1c92ec] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:55:59.543782 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-208a7566-e8fc-4e4c-8435-2eebf419efd7 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:59.544295 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-208a7566-e8fc-4e4c-8435-2eebf419efd7 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:59.544747 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-208a7566-e8fc-4e4c-8435-2eebf419efd7 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:59.548318 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-208a7566-e8fc-4e4c-8435-2eebf419efd7 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:59.549731 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-208a7566-e8fc-4e4c-8435-2eebf419efd7 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:59.550202 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-208a7566-e8fc-4e4c-8435-2eebf419efd7 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:59.593532 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-8c31a2a3-b471-45a3-a1e0-bae2384e3cfd tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Flavor limits 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 20:55:59.594954 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-8c31a2a3-b471-45a3-a1e0-bae2384e3cfd tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Image limits 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 20:55:59.595635 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-208a7566-e8fc-4e4c-8435-2eebf419efd7 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] [instance: a64fa89e-32f6-4994-a0b2-3788cf1c92ec] Going to try to terminate instance {{(pid=138744) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 20:55:59.595865 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-8c31a2a3-b471-45a3-a1e0-bae2384e3cfd tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Flavor pref 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 20:55:59.596973 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-8c31a2a3-b471-45a3-a1e0-bae2384e3cfd tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Image pref 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 20:55:59.597698 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-8c31a2a3-b471-45a3-a1e0-bae2384e3cfd tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 20:55:59.619277 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8c31a2a3-b471-45a3-a1e0-bae2384e3cfd tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:59.619829 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8c31a2a3-b471-45a3-a1e0-bae2384e3cfd tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:59.621924 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8c31a2a3-b471-45a3-a1e0-bae2384e3cfd tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:59.623950 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8c31a2a3-b471-45a3-a1e0-bae2384e3cfd tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:59.625236 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8c31a2a3-b471-45a3-a1e0-bae2384e3cfd tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:59.628662 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8c31a2a3-b471-45a3-a1e0-bae2384e3cfd tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:59.676988 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-8c31a2a3-b471-45a3-a1e0-bae2384e3cfd tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Getting quotas for project 371ecb87e8d34859971be23c1a1bc443. Resources: {'cores', 'instances', 'ram'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 20:55:59.703821 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-8c31a2a3-b471-45a3-a1e0-bae2384e3cfd tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Getting quotas for user e787e0b494764176a0f13d75c47d77fa and project 371ecb87e8d34859971be23c1a1bc443. Resources: {'cores', 'instances', 'ram'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 20:55:59.739276 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-8c31a2a3-b471-45a3-a1e0-bae2384e3cfd tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Going to run 1 instances... {{(pid=138745) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 20:55:59.742678 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-8c31a2a3-b471-45a3-a1e0-bae2384e3cfd tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] [instance: c5db8404-7c9d-41d4-a018-a27058378d35] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='085e4478-6edc-4a69-8e08-f9831713eb65',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138745) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 20:55:59.752463 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-208a7566-e8fc-4e4c-8435-2eebf419efd7 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] 10.222.0.18 "DELETE /compute/v2.1/servers/a64fa89e-32f6-4994-a0b2-3788cf1c92ec" status: 204 len: 0 microversion: 2.1 time: 0.237592 Oct 22 20:55:59.754701 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 804/1701] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 20:55:59 2022] DELETE /compute/v2.1/servers/a64fa89e-32f6-4994-a0b2-3788cf1c92ec => generated 0 bytes in 241 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 20:55:59.764159 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-6f18e980-d104-4b8d-a9a2-441aaf83f6c9 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:55:59.766160 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-6f18e980-d104-4b8d-a9a2-441aaf83f6c9 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] [instance: 98f48cb1-54ed-4e82-8a25-fd004ddb5758] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:55:59.775067 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6f18e980-d104-4b8d-a9a2-441aaf83f6c9 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:59.776220 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6f18e980-d104-4b8d-a9a2-441aaf83f6c9 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:59.778375 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6f18e980-d104-4b8d-a9a2-441aaf83f6c9 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:59.779810 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6f18e980-d104-4b8d-a9a2-441aaf83f6c9 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:59.782885 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6f18e980-d104-4b8d-a9a2-441aaf83f6c9 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:59.783924 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6f18e980-d104-4b8d-a9a2-441aaf83f6c9 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:59.803080 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-8c31a2a3-b471-45a3-a1e0-bae2384e3cfd tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.761168 Oct 22 20:55:59.817015 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 898/1702] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Oct 22 20:55:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 1777 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 20:55:59.838758 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-7bf00b8d-cfb8-4b72-b9f7-a4f4cdf25e3b req-f4d2591a-d875-478e-8c46-e3cf8ec9b1f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "78aef3f6-9cff-4db4-95c1-f0d5480b7a3c", "tag": "1b3feae7-78b5-47fa-a825-d1a96beffac1"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:55:59.880933 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-7bf00b8d-cfb8-4b72-b9f7-a4f4cdf25e3b req-f4d2591a-d875-478e-8c46-e3cf8ec9b1f1 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:59.881764 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-7bf00b8d-cfb8-4b72-b9f7-a4f4cdf25e3b req-f4d2591a-d875-478e-8c46-e3cf8ec9b1f1 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:59.886158 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-7bf00b8d-cfb8-4b72-b9f7-a4f4cdf25e3b req-f4d2591a-d875-478e-8c46-e3cf8ec9b1f1 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:59.917019 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-7bf00b8d-cfb8-4b72-b9f7-a4f4cdf25e3b req-f4d2591a-d875-478e-8c46-e3cf8ec9b1f1 service nova] Creating event network-changed:1b3feae7-78b5-47fa-a825-d1a96beffac1 for instance 78aef3f6-9cff-4db4-95c1-f0d5480b7a3c on nch1-master-1 Oct 22 20:55:59.930222 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-7bf00b8d-cfb8-4b72-b9f7-a4f4cdf25e3b req-f4d2591a-d875-478e-8c46-e3cf8ec9b1f1 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100745 Oct 22 20:55:59.935834 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 899/1703] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:55:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:55:59.948463 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-5ebb2376-d7dd-423c-8999-ae1f8c5043ae tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Action: 'action', calling method: .version_select at 0x7fd3a5d0d820>, body: {"addFloatingIp": {"address": "172.35.2.224"}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:55:59.959048 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-5ebb2376-d7dd-423c-8999-ae1f8c5043ae tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] [instance: 29a351ac-ecf5-4b11-9bdd-f1c93df1335a] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:55:59.980650 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5ebb2376-d7dd-423c-8999-ae1f8c5043ae tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:59.982538 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5ebb2376-d7dd-423c-8999-ae1f8c5043ae tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:59.983024 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5ebb2376-d7dd-423c-8999-ae1f8c5043ae tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:55:59.983823 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5ebb2376-d7dd-423c-8999-ae1f8c5043ae tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:55:59.987109 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5ebb2376-d7dd-423c-8999-ae1f8c5043ae tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:55:59.988291 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5ebb2376-d7dd-423c-8999-ae1f8c5043ae tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:00.066486 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5ebb2376-d7dd-423c-8999-ae1f8c5043ae tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Acquiring lock "refresh_cache-29a351ac-ecf5-4b11-9bdd-f1c93df1335a" {{(pid=138745) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 22 20:56:00.066907 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5ebb2376-d7dd-423c-8999-ae1f8c5043ae tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Acquired lock "refresh_cache-29a351ac-ecf5-4b11-9bdd-f1c93df1335a" {{(pid=138745) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 22 20:56:00.844497 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-6f18e980-d104-4b8d-a9a2-441aaf83f6c9 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d3d7458af447bdb3f03e83a2d8559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49238b8686d24ae698679e4a1957735d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:56:00.859792 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-6f18e980-d104-4b8d-a9a2-441aaf83f6c9 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] 10.222.0.18 "GET /compute/v2.1/servers/98f48cb1-54ed-4e82-8a25-fd004ddb5758" status: 200 len: 1474 microversion: 2.1 time: 1.103127 Oct 22 20:56:00.860758 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 805/1704] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:55:59 2022] GET /compute/v2.1/servers/98f48cb1-54ed-4e82-8a25-fd004ddb5758 => generated 1474 bytes in 1105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:56:00.868503 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-63eca8cc-538e-48d5-b757-058857d2a00a tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:56:00.868924 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-63eca8cc-538e-48d5-b757-058857d2a00a tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] [instance: 73404cab-dc0f-4f1c-b38b-a1505a5dc8b2] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:56:00.878559 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-63eca8cc-538e-48d5-b757-058857d2a00a tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:00.879190 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-63eca8cc-538e-48d5-b757-058857d2a00a tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:00.879687 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-63eca8cc-538e-48d5-b757-058857d2a00a tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:00.880576 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-63eca8cc-538e-48d5-b757-058857d2a00a tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:00.881227 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-63eca8cc-538e-48d5-b757-058857d2a00a tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:00.881673 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-63eca8cc-538e-48d5-b757-058857d2a00a tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:00.919104 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-63eca8cc-538e-48d5-b757-058857d2a00a tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] [instance: 73404cab-dc0f-4f1c-b38b-a1505a5dc8b2] Going to try to terminate instance {{(pid=138744) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 20:56:00.994865 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=4,nova_cell1:INSERT=4 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:56:01.042194 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-63eca8cc-538e-48d5-b757-058857d2a00a tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] 10.222.0.18 "DELETE /compute/v2.1/servers/73404cab-dc0f-4f1c-b38b-a1505a5dc8b2" status: 204 len: 0 microversion: 2.1 time: 0.180148 Oct 22 20:56:01.042902 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 806/1705] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 20:56:00 2022] DELETE /compute/v2.1/servers/73404cab-dc0f-4f1c-b38b-a1505a5dc8b2 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 20:56:01.050030 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-fc7afa4e-d38b-4304-a02d-a43a5396e35e tempest-ServersTestFqdnHostnames-400258971 tempest-ServersTestFqdnHostnames-400258971-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:56:01.051330 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-fc7afa4e-d38b-4304-a02d-a43a5396e35e tempest-ServersTestFqdnHostnames-400258971 tempest-ServersTestFqdnHostnames-400258971-project] [instance: 78aef3f6-9cff-4db4-95c1-f0d5480b7a3c] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:56:01.057444 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fc7afa4e-d38b-4304-a02d-a43a5396e35e tempest-ServersTestFqdnHostnames-400258971 tempest-ServersTestFqdnHostnames-400258971-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:01.058044 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fc7afa4e-d38b-4304-a02d-a43a5396e35e tempest-ServersTestFqdnHostnames-400258971 tempest-ServersTestFqdnHostnames-400258971-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:01.058581 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fc7afa4e-d38b-4304-a02d-a43a5396e35e tempest-ServersTestFqdnHostnames-400258971 tempest-ServersTestFqdnHostnames-400258971-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:01.059670 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fc7afa4e-d38b-4304-a02d-a43a5396e35e tempest-ServersTestFqdnHostnames-400258971 tempest-ServersTestFqdnHostnames-400258971-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:01.060190 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fc7afa4e-d38b-4304-a02d-a43a5396e35e tempest-ServersTestFqdnHostnames-400258971 tempest-ServersTestFqdnHostnames-400258971-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:01.060681 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fc7afa4e-d38b-4304-a02d-a43a5396e35e tempest-ServersTestFqdnHostnames-400258971 tempest-ServersTestFqdnHostnames-400258971-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:01.609215 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-fc7afa4e-d38b-4304-a02d-a43a5396e35e tempest-ServersTestFqdnHostnames-400258971 tempest-ServersTestFqdnHostnames-400258971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02fdeda494a547f1a8714007e05e874d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b75771ecf442919c647f15d499880e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:56:01.628829 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-fc7afa4e-d38b-4304-a02d-a43a5396e35e tempest-ServersTestFqdnHostnames-400258971 tempest-ServersTestFqdnHostnames-400258971-project] 10.222.0.18 "GET /compute/v2.1/servers/78aef3f6-9cff-4db4-95c1-f0d5480b7a3c" status: 200 len: 1352 microversion: 2.1 time: 0.582819 Oct 22 20:56:01.633331 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 807/1706] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:56:01 2022] GET /compute/v2.1/servers/78aef3f6-9cff-4db4-95c1-f0d5480b7a3c => generated 1352 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:56:01.648792 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-d7def2a0-c0ca-4245-bc84-aca50c659f09 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:56:01.653382 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-d7def2a0-c0ca-4245-bc84-aca50c659f09 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] [instance: a64fa89e-32f6-4994-a0b2-3788cf1c92ec] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:56:01.666395 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d7def2a0-c0ca-4245-bc84-aca50c659f09 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:01.691141 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d7def2a0-c0ca-4245-bc84-aca50c659f09 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:01.691887 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d7def2a0-c0ca-4245-bc84-aca50c659f09 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:01.694044 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d7def2a0-c0ca-4245-bc84-aca50c659f09 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:01.702674 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d7def2a0-c0ca-4245-bc84-aca50c659f09 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:01.707256 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d7def2a0-c0ca-4245-bc84-aca50c659f09 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:02.228032 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-d7def2a0-c0ca-4245-bc84-aca50c659f09 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b392ad1fe1fd4b2a9e6be03a7435deb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594624ed28aa433d907c8833d360b82e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:56:02.241278 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-d7def2a0-c0ca-4245-bc84-aca50c659f09 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] 10.222.0.18 "GET /compute/v2.1/servers/a64fa89e-32f6-4994-a0b2-3788cf1c92ec" status: 200 len: 1527 microversion: 2.1 time: 0.601543 Oct 22 20:56:02.242723 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 808/1707] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:56:01 2022] GET /compute/v2.1/servers/a64fa89e-32f6-4994-a0b2-3788cf1c92ec => generated 1527 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:56:02.247537 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-cdc19584-7a1e-4349-9180-a0e674a31aa9 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-788991809", "imageRef": "085e4478-6edc-4a69-8e08-f9831713eb65", "flavorRef": "451", "networks": [{"uuid": "a92562c3-4652-47d9-939e-7f79a0b7461f"}]}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:56:02.277581 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=3,nova_api:UPDATE=4 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:56:02.374061 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.network.neutron [None req-cdc19584-7a1e-4349-9180-a0e674a31aa9 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] validate_networks() for [('a92562c3-4652-47d9-939e-7f79a0b7461f', None, None, None, None, None)] {{(pid=138744) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 20:56:03.865703 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-cdc19584-7a1e-4349-9180-a0e674a31aa9 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Flavor limits 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 20:56:03.866297 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-cdc19584-7a1e-4349-9180-a0e674a31aa9 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Image limits 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 20:56:03.866868 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-cdc19584-7a1e-4349-9180-a0e674a31aa9 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Flavor pref 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 20:56:03.867409 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-cdc19584-7a1e-4349-9180-a0e674a31aa9 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Image pref 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 20:56:03.867922 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-cdc19584-7a1e-4349-9180-a0e674a31aa9 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 20:56:03.884940 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cdc19584-7a1e-4349-9180-a0e674a31aa9 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:03.885949 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cdc19584-7a1e-4349-9180-a0e674a31aa9 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:03.886065 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cdc19584-7a1e-4349-9180-a0e674a31aa9 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:03.886843 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cdc19584-7a1e-4349-9180-a0e674a31aa9 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:03.887389 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cdc19584-7a1e-4349-9180-a0e674a31aa9 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:03.887920 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cdc19584-7a1e-4349-9180-a0e674a31aa9 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:03.933330 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-cdc19584-7a1e-4349-9180-a0e674a31aa9 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Getting quotas for project 371ecb87e8d34859971be23c1a1bc443. Resources: {'cores', 'instances', 'ram'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 20:56:03.939883 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-cdc19584-7a1e-4349-9180-a0e674a31aa9 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Getting quotas for user e787e0b494764176a0f13d75c47d77fa and project 371ecb87e8d34859971be23c1a1bc443. Resources: {'cores', 'instances', 'ram'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 20:56:03.971918 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-cdc19584-7a1e-4349-9180-a0e674a31aa9 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Going to run 1 instances... {{(pid=138744) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 20:56:03.976023 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-cdc19584-7a1e-4349-9180-a0e674a31aa9 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] [instance: df5f7e8f-5ed6-4ad6-9bcb-eaa54b4ee320] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='085e4478-6edc-4a69-8e08-f9831713eb65',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138744) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 20:56:04.093882 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-cdc19584-7a1e-4349-9180-a0e674a31aa9 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.849115 Oct 22 20:56:04.094813 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 809/1708] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Oct 22 20:56:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 1852 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 20:56:04.105474 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-9b29f9c5-ae4c-4d6b-8f9b-0fb0f73c94a2 req-7ed4618d-23c5-40c5-9912-6b1399df6db3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fbb34507-cef9-4d78-9ed7-5d6eab4ca806", "name": "network-vif-deleted", "tag": "21ed77e4-8dab-449b-afdb-01e27ef6b85c"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:56:04.133544 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-9b29f9c5-ae4c-4d6b-8f9b-0fb0f73c94a2 req-7ed4618d-23c5-40c5-9912-6b1399df6db3 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:04.134915 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-9b29f9c5-ae4c-4d6b-8f9b-0fb0f73c94a2 req-7ed4618d-23c5-40c5-9912-6b1399df6db3 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:04.138484 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-9b29f9c5-ae4c-4d6b-8f9b-0fb0f73c94a2 req-7ed4618d-23c5-40c5-9912-6b1399df6db3 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:04.163027 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-9b29f9c5-ae4c-4d6b-8f9b-0fb0f73c94a2 req-7ed4618d-23c5-40c5-9912-6b1399df6db3 service nova] Creating event network-vif-deleted:21ed77e4-8dab-449b-afdb-01e27ef6b85c for instance fbb34507-cef9-4d78-9ed7-5d6eab4ca806 on nch2-master-1 Oct 22 20:56:04.173879 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-9b29f9c5-ae4c-4d6b-8f9b-0fb0f73c94a2 req-7ed4618d-23c5-40c5-9912-6b1399df6db3 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077033 Oct 22 20:56:04.178115 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 810/1709] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:56:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:56:04.195415 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-19e52945-817a-4d07-ad1e-25915ee2e1de tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:56:04.196500 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-19e52945-817a-4d07-ad1e-25915ee2e1de tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] [instance: fbb34507-cef9-4d78-9ed7-5d6eab4ca806] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:56:04.213679 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-19e52945-817a-4d07-ad1e-25915ee2e1de tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:04.214482 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-19e52945-817a-4d07-ad1e-25915ee2e1de tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:04.215976 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-19e52945-817a-4d07-ad1e-25915ee2e1de tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:04.216945 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-19e52945-817a-4d07-ad1e-25915ee2e1de tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:04.220318 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-19e52945-817a-4d07-ad1e-25915ee2e1de tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:04.222451 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-19e52945-817a-4d07-ad1e-25915ee2e1de tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:04.255800 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.network.neutron [None req-5ebb2376-d7dd-423c-8999-ae1f8c5043ae tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] [instance: 29a351ac-ecf5-4b11-9bdd-f1c93df1335a] Building network info cache for instance {{(pid=138745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 22 20:56:04.260565 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-19e52945-817a-4d07-ad1e-25915ee2e1de tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] HTTP exception thrown: Instance fbb34507-cef9-4d78-9ed7-5d6eab4ca806 could not be found. Oct 22 20:56:04.265182 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-19e52945-817a-4d07-ad1e-25915ee2e1de tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Request method failure captured: Oct 22 20:56:04.265182 ncdv-master-1 devstack@n-api.service[138744]: request: GET /compute/v2.1/servers/fbb34507-cef9-4d78-9ed7-5d6eab4ca806 HTTP/1.1 Oct 22 20:56:04.265182 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 20:56:04.265182 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 20:56:04.265182 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 20:56:04.265182 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 0 Oct 22 20:56:04.265182 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 20:56:04.265182 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 20:56:04.265182 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 20:56:04.265182 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 20:56:04.265182 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVFd3L1O9buG2NKok4Z3OhlPg9uJowRL-QIrWO2UXrdAMWoEA07U7Qwd3UcRw5_kRV78yVlG8-xf-9bQgrD-lSc6Kuqan6Pt9NTBZahyGUD3ZZ-4gkCHlC4kIKTqF1xcLu4qJCXK_NR7T7vH-rSU8EgD59OAikcfPJ0amh6d8LDt5JQQ Oct 22 20:56:04.265182 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 20:56:04.265182 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 20:56:04.265182 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 20:56:04.265182 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 20:56:04.265182 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 20:56:04.265182 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 20:56:04.265182 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: 9f0ee8c8f7fc4e12bc1f9fcce3e7b581 Oct 22 20:56:04.265182 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-LiveMigrationTest-26615209 Oct 22 20:56:04.265182 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 20:56:04.265182 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 20:56:04.265182 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_9f0ee8c8f7fc4e12bc1f9fcce3e7b581"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9f0ee8c8f7fc4e12bc1f9fcce3e7b581"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/9f0ee8c8f7fc4e12bc1f9fcce3e7b581"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9f0ee8c8f7fc4e12bc1f9fcce3e7b581"}]}] Oct 22 20:56:04.265182 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-LiveMigrationTest-26615209 Oct 22 20:56:04.265182 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: 9f0ee8c8f7fc4e12bc1f9fcce3e7b581 Oct 22 20:56:04.265182 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-LiveMigrationTest-26615209 Oct 22 20:56:04.265182 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-LiveMigrationTest-26615209-project Oct 22 20:56:04.265182 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 20:56:04.265182 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 20:56:04.265182 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: 2c87f0356ca346f39c6216393d85da2f Oct 22 20:56:04.265182 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-LiveMigrationTest-26615209-project Oct 22 20:56:04.265182 ncdv-master-1 devstack@n-api.service[138744]: method: > Oct 22 20:56:04.265182 ncdv-master-1 devstack@n-api.service[138744]: exception: Instance fbb34507-cef9-4d78-9ed7-5d6eab4ca806 could not be found. Oct 22 20:56:04.265182 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': 'fbb34507-cef9-4d78-9ed7-5d6eab4ca806'} Oct 22 20:56:04.265182 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:56:04.265182 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:56:04.265182 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 20:56:04.265182 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 20:56:04.265182 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 20:56:04.265182 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 20:56:04.265182 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 20:56:04.265182 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 20:56:04.265182 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 20:56:04.265182 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 20:56:04.265182 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fbb34507-cef9-4d78-9ed7-5d6eab4ca806 could not be found. Oct 22 20:56:04.265182 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:56:04.265182 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:56:04.265182 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:56:04.265182 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:56:04.265182 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:56:04.265182 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:56:04.265182 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:56:04.265182 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:56:04.265182 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:56:04.265182 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:56:04.265182 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 20:56:04.265182 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 20:56:04.265182 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 20:56:04.265182 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 20:56:04.265182 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 20:56:04.265182 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 20:56:04.265182 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fbb34507-cef9-4d78-9ed7-5d6eab4ca806 could not be found. Oct 22 20:56:04.265182 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:56:04.265182 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:56:04.265182 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:56:04.270885 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:56:04.270885 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:56:04.270885 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:56:04.270885 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 20:56:04.270885 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 20:56:04.270885 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fbb34507-cef9-4d78-9ed7-5d6eab4ca806 could not be found. Oct 22 20:56:04.270885 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:56:04.275321 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-19e52945-817a-4d07-ad1e-25915ee2e1de tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Returning 404 to user: Instance fbb34507-cef9-4d78-9ed7-5d6eab4ca806 could not be found. {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:56:04.279685 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-19e52945-817a-4d07-ad1e-25915ee2e1de tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] 10.222.0.18 "GET /compute/v2.1/servers/fbb34507-cef9-4d78-9ed7-5d6eab4ca806" status: 404 len: 111 microversion: 2.1 time: 0.096932 Oct 22 20:56:04.280830 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 811/1710] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:56:04 2022] GET /compute/v2.1/servers/fbb34507-cef9-4d78-9ed7-5d6eab4ca806 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 20:56:04.293068 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-00fef965-ef64-451c-abcf-16e9168fdc9e req-6dfe1148-b6b1-4c3c-9e5c-264ef7cd741f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a64fa89e-32f6-4994-a0b2-3788cf1c92ec", "name": "network-vif-unplugged", "status": "completed", "tag": "e916fb42-f87f-4b20-b6b6-8abd516f5e15"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:56:04.321609 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-00fef965-ef64-451c-abcf-16e9168fdc9e req-6dfe1148-b6b1-4c3c-9e5c-264ef7cd741f service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:04.324049 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-00fef965-ef64-451c-abcf-16e9168fdc9e req-6dfe1148-b6b1-4c3c-9e5c-264ef7cd741f service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:04.325067 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-00fef965-ef64-451c-abcf-16e9168fdc9e req-6dfe1148-b6b1-4c3c-9e5c-264ef7cd741f service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:04.345015 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-00fef965-ef64-451c-abcf-16e9168fdc9e req-6dfe1148-b6b1-4c3c-9e5c-264ef7cd741f service nova] Creating event network-vif-unplugged:e916fb42-f87f-4b20-b6b6-8abd516f5e15 for instance a64fa89e-32f6-4994-a0b2-3788cf1c92ec on nch2-master-1 Oct 22 20:56:04.351889 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-00fef965-ef64-451c-abcf-16e9168fdc9e req-6dfe1148-b6b1-4c3c-9e5c-264ef7cd741f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.069084 Oct 22 20:56:04.358319 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 812/1711] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:56:04 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:56:04.365238 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-1c879fe8-5292-44a8-8c87-a5e9130a82f6 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:56:04.366299 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-1c879fe8-5292-44a8-8c87-a5e9130a82f6 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] [instance: bccbf2b3-70e3-406d-b844-e48d765732cf] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:56:04.375398 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1c879fe8-5292-44a8-8c87-a5e9130a82f6 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:04.376602 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1c879fe8-5292-44a8-8c87-a5e9130a82f6 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:04.377507 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1c879fe8-5292-44a8-8c87-a5e9130a82f6 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:04.379170 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1c879fe8-5292-44a8-8c87-a5e9130a82f6 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:04.380111 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1c879fe8-5292-44a8-8c87-a5e9130a82f6 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:04.423325 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1c879fe8-5292-44a8-8c87-a5e9130a82f6 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:04.515881 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-1c879fe8-5292-44a8-8c87-a5e9130a82f6 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] [instance: bccbf2b3-70e3-406d-b844-e48d765732cf] Going to try to terminate instance {{(pid=138744) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 20:56:04.702425 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-1c879fe8-5292-44a8-8c87-a5e9130a82f6 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] 10.222.0.18 "DELETE /compute/v2.1/servers/bccbf2b3-70e3-406d-b844-e48d765732cf" status: 204 len: 0 microversion: 2.1 time: 0.341037 Oct 22 20:56:04.703502 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 813/1712] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 20:56:04 2022] DELETE /compute/v2.1/servers/bccbf2b3-70e3-406d-b844-e48d765732cf => generated 0 bytes in 344 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 20:56:04.712572 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-3889c43a-7a94-46d8-9385-2ae52b258e43 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:56:04.713523 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-3889c43a-7a94-46d8-9385-2ae52b258e43 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] [instance: 98f48cb1-54ed-4e82-8a25-fd004ddb5758] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:56:04.722341 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3889c43a-7a94-46d8-9385-2ae52b258e43 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:04.723370 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3889c43a-7a94-46d8-9385-2ae52b258e43 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:04.723974 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3889c43a-7a94-46d8-9385-2ae52b258e43 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:04.724787 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3889c43a-7a94-46d8-9385-2ae52b258e43 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:04.725475 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3889c43a-7a94-46d8-9385-2ae52b258e43 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:04.725906 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3889c43a-7a94-46d8-9385-2ae52b258e43 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:05.281301 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-3889c43a-7a94-46d8-9385-2ae52b258e43 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d3d7458af447bdb3f03e83a2d8559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49238b8686d24ae698679e4a1957735d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:56:05.296486 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-3889c43a-7a94-46d8-9385-2ae52b258e43 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] 10.222.0.18 "GET /compute/v2.1/servers/98f48cb1-54ed-4e82-8a25-fd004ddb5758" status: 200 len: 1474 microversion: 2.1 time: 0.591496 Oct 22 20:56:05.297423 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 814/1713] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:56:04 2022] GET /compute/v2.1/servers/98f48cb1-54ed-4e82-8a25-fd004ddb5758 => generated 1474 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:56:05.316823 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-ecce37f7-c81f-4694-b406-d7ee78ba6288 tempest-ServersTestFqdnHostnames-400258971 tempest-ServersTestFqdnHostnames-400258971-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:56:05.317574 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-ecce37f7-c81f-4694-b406-d7ee78ba6288 tempest-ServersTestFqdnHostnames-400258971 tempest-ServersTestFqdnHostnames-400258971-project] [instance: 78aef3f6-9cff-4db4-95c1-f0d5480b7a3c] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:56:05.329882 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ecce37f7-c81f-4694-b406-d7ee78ba6288 tempest-ServersTestFqdnHostnames-400258971 tempest-ServersTestFqdnHostnames-400258971-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:05.330426 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ecce37f7-c81f-4694-b406-d7ee78ba6288 tempest-ServersTestFqdnHostnames-400258971 tempest-ServersTestFqdnHostnames-400258971-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:05.330874 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ecce37f7-c81f-4694-b406-d7ee78ba6288 tempest-ServersTestFqdnHostnames-400258971 tempest-ServersTestFqdnHostnames-400258971-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:05.331672 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ecce37f7-c81f-4694-b406-d7ee78ba6288 tempest-ServersTestFqdnHostnames-400258971 tempest-ServersTestFqdnHostnames-400258971-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:05.332143 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ecce37f7-c81f-4694-b406-d7ee78ba6288 tempest-ServersTestFqdnHostnames-400258971 tempest-ServersTestFqdnHostnames-400258971-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:05.332580 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ecce37f7-c81f-4694-b406-d7ee78ba6288 tempest-ServersTestFqdnHostnames-400258971 tempest-ServersTestFqdnHostnames-400258971-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:05.888504 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-ecce37f7-c81f-4694-b406-d7ee78ba6288 tempest-ServersTestFqdnHostnames-400258971 tempest-ServersTestFqdnHostnames-400258971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02fdeda494a547f1a8714007e05e874d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b75771ecf442919c647f15d499880e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:56:05.897444 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-ecce37f7-c81f-4694-b406-d7ee78ba6288 tempest-ServersTestFqdnHostnames-400258971 tempest-ServersTestFqdnHostnames-400258971-project] 10.222.0.18 "GET /compute/v2.1/servers/78aef3f6-9cff-4db4-95c1-f0d5480b7a3c" status: 200 len: 1352 microversion: 2.1 time: 0.598934 Oct 22 20:56:05.904466 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 815/1714] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:56:05 2022] GET /compute/v2.1/servers/78aef3f6-9cff-4db4-95c1-f0d5480b7a3c => generated 1352 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:56:05.918372 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-655bde8b-8542-4301-afc1-e58b3d8d2571 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:56:05.919016 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-655bde8b-8542-4301-afc1-e58b3d8d2571 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] [instance: a64fa89e-32f6-4994-a0b2-3788cf1c92ec] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:56:05.933585 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-655bde8b-8542-4301-afc1-e58b3d8d2571 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:05.934083 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-655bde8b-8542-4301-afc1-e58b3d8d2571 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:05.935735 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-655bde8b-8542-4301-afc1-e58b3d8d2571 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:05.936535 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-655bde8b-8542-4301-afc1-e58b3d8d2571 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:05.937019 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-655bde8b-8542-4301-afc1-e58b3d8d2571 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:05.937517 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-655bde8b-8542-4301-afc1-e58b3d8d2571 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:05.970541 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-655bde8b-8542-4301-afc1-e58b3d8d2571 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] HTTP exception thrown: Instance a64fa89e-32f6-4994-a0b2-3788cf1c92ec could not be found. Oct 22 20:56:05.973384 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-655bde8b-8542-4301-afc1-e58b3d8d2571 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Request method failure captured: Oct 22 20:56:05.973384 ncdv-master-1 devstack@n-api.service[138744]: request: GET /compute/v2.1/servers/a64fa89e-32f6-4994-a0b2-3788cf1c92ec HTTP/1.1 Oct 22 20:56:05.973384 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 20:56:05.973384 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 20:56:05.973384 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 20:56:05.973384 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 0 Oct 22 20:56:05.973384 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 20:56:05.973384 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 20:56:05.973384 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 20:56:05.973384 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 20:56:05.973384 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVFinkWQQBhkrT1IKOpDugEkOlAPWNZyP_2NMwr13b9XeVy4UUzw2acgfBjDE3p8vwfHK2_Q3RMg9yYmateTjw8EQOHA7IN0HeuqzZ5uQWL0ysIIG3e_nACVRZdRICvuIM06IV17ajtcJTdsfcK0wPQNbKtAOZi6_8a2UUHyQ1NeNuzI Oct 22 20:56:05.973384 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 20:56:05.973384 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 20:56:05.973384 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 20:56:05.973384 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 20:56:05.973384 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 20:56:05.973384 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 20:56:05.973384 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: 594624ed28aa433d907c8833d360b82e Oct 22 20:56:05.973384 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-477371163 Oct 22 20:56:05.973384 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 20:56:05.973384 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 20:56:05.973384 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_594624ed28aa433d907c8833d360b82e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/594624ed28aa433d907c8833d360b82e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/594624ed28aa433d907c8833d360b82e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/594624ed28aa433d907c8833d360b82e"}]}] Oct 22 20:56:05.973384 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-477371163 Oct 22 20:56:05.973384 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: 594624ed28aa433d907c8833d360b82e Oct 22 20:56:05.973384 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-477371163 Oct 22 20:56:05.973384 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-ImagesOneServerNegativeTestJSON-477371163-project Oct 22 20:56:05.973384 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 20:56:05.973384 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 20:56:05.973384 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: b392ad1fe1fd4b2a9e6be03a7435deb9 Oct 22 20:56:05.973384 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-477371163-project Oct 22 20:56:05.973384 ncdv-master-1 devstack@n-api.service[138744]: method: > Oct 22 20:56:05.973384 ncdv-master-1 devstack@n-api.service[138744]: exception: Instance a64fa89e-32f6-4994-a0b2-3788cf1c92ec could not be found. Oct 22 20:56:05.973384 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': 'a64fa89e-32f6-4994-a0b2-3788cf1c92ec'} Oct 22 20:56:05.973384 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:56:05.973384 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:56:05.973384 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 20:56:05.973384 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 20:56:05.973384 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 20:56:05.973384 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 20:56:05.973384 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 20:56:05.973384 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 20:56:05.973384 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 20:56:05.973384 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 20:56:05.973384 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a64fa89e-32f6-4994-a0b2-3788cf1c92ec could not be found. Oct 22 20:56:05.973384 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:56:05.973384 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:56:05.973384 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:56:05.973384 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:56:05.973384 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:56:05.973384 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:56:05.973384 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:56:05.973384 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:56:05.973384 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:56:05.973384 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:56:05.973384 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 20:56:05.973384 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 20:56:05.973384 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 20:56:05.973384 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 20:56:05.973384 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 20:56:05.973384 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 20:56:05.973384 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a64fa89e-32f6-4994-a0b2-3788cf1c92ec could not be found. Oct 22 20:56:05.973384 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:56:05.973384 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:56:05.978910 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:56:05.978910 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:56:05.978910 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:56:05.978910 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:56:05.978910 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 20:56:05.978910 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 20:56:05.978910 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a64fa89e-32f6-4994-a0b2-3788cf1c92ec could not be found. Oct 22 20:56:05.978910 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:56:05.978910 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-655bde8b-8542-4301-afc1-e58b3d8d2571 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Returning 404 to user: Instance a64fa89e-32f6-4994-a0b2-3788cf1c92ec could not be found. {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:56:05.978910 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-655bde8b-8542-4301-afc1-e58b3d8d2571 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] 10.222.0.18 "GET /compute/v2.1/servers/a64fa89e-32f6-4994-a0b2-3788cf1c92ec" status: 404 len: 111 microversion: 2.1 time: 0.069436 Oct 22 20:56:05.984396 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 816/1715] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:56:05 2022] GET /compute/v2.1/servers/a64fa89e-32f6-4994-a0b2-3788cf1c92ec => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 20:56:05.991595 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-eeb8577f-9991-4338-be1f-c2b1788b3fbb req-f1f95170-1639-42c4-8d4b-1354619cbfca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "28c2b09f-e43f-472b-b8db-f407c341acfd", "tag": "e6478c54-1e5c-45df-8338-b5b4413b28b0"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:56:06.053786 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-eeb8577f-9991-4338-be1f-c2b1788b3fbb req-f1f95170-1639-42c4-8d4b-1354619cbfca service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:06.054285 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-eeb8577f-9991-4338-be1f-c2b1788b3fbb req-f1f95170-1639-42c4-8d4b-1354619cbfca service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:06.054730 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-eeb8577f-9991-4338-be1f-c2b1788b3fbb req-f1f95170-1639-42c4-8d4b-1354619cbfca service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:06.074040 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-eeb8577f-9991-4338-be1f-c2b1788b3fbb req-f1f95170-1639-42c4-8d4b-1354619cbfca service nova] Creating event network-changed:e6478c54-1e5c-45df-8338-b5b4413b28b0 for instance 28c2b09f-e43f-472b-b8db-f407c341acfd on nch1-master-1 Oct 22 20:56:06.082000 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-eeb8577f-9991-4338-be1f-c2b1788b3fbb req-f1f95170-1639-42c4-8d4b-1354619cbfca service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095519 Oct 22 20:56:06.083071 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 817/1716] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:56:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:56:06.088773 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-2de132ae-dc57-4937-9156-82e61608b996 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:56:06.089487 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-2de132ae-dc57-4937-9156-82e61608b996 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] [instance: df5f7e8f-5ed6-4ad6-9bcb-eaa54b4ee320] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:56:06.097764 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2de132ae-dc57-4937-9156-82e61608b996 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:06.098270 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2de132ae-dc57-4937-9156-82e61608b996 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:06.098720 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2de132ae-dc57-4937-9156-82e61608b996 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:06.099537 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2de132ae-dc57-4937-9156-82e61608b996 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:06.101832 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2de132ae-dc57-4937-9156-82e61608b996 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:06.102296 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2de132ae-dc57-4937-9156-82e61608b996 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:06.503986 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-2de132ae-dc57-4937-9156-82e61608b996 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e787e0b494764176a0f13d75c47d77fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '371ecb87e8d34859971be23c1a1bc443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:56:06.515295 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-2de132ae-dc57-4937-9156-82e61608b996 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] 10.222.0.18 "GET /compute/v2.1/servers/df5f7e8f-5ed6-4ad6-9bcb-eaa54b4ee320" status: 200 len: 1216 microversion: 2.1 time: 0.430683 Oct 22 20:56:06.519227 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 818/1717] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:56:06 2022] GET /compute/v2.1/servers/df5f7e8f-5ed6-4ad6-9bcb-eaa54b4ee320 => generated 1216 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:56:06.532881 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-1fe7392f-da70-4c36-9840-2d83dcfb4551 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:56:06.534994 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-1fe7392f-da70-4c36-9840-2d83dcfb4551 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] [instance: 73404cab-dc0f-4f1c-b38b-a1505a5dc8b2] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:56:06.554309 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1fe7392f-da70-4c36-9840-2d83dcfb4551 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:06.554719 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1fe7392f-da70-4c36-9840-2d83dcfb4551 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:06.556609 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1fe7392f-da70-4c36-9840-2d83dcfb4551 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:06.559178 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1fe7392f-da70-4c36-9840-2d83dcfb4551 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:06.561447 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1fe7392f-da70-4c36-9840-2d83dcfb4551 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:06.562116 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1fe7392f-da70-4c36-9840-2d83dcfb4551 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:06.730069 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.network.neutron [None req-5ebb2376-d7dd-423c-8999-ae1f8c5043ae tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] [instance: 29a351ac-ecf5-4b11-9bdd-f1c93df1335a] Updating instance_info_cache with network_info: [{"id": "07fb8283-cc10-46e3-bd70-2c1e5b8c3aef", "address": "fa:16:3e:7a:11:63", "network": {"id": "ba2fbd7d-5bd8-4316-b6a5-ea0e685a80cc", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1738311782-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.2.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "42111ed6bcc3465d8c1f5291da248e74", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap07fb8283-cc", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=138745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 22 20:56:06.759837 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5ebb2376-d7dd-423c-8999-ae1f8c5043ae tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Releasing lock "refresh_cache-29a351ac-ecf5-4b11-9bdd-f1c93df1335a" {{(pid=138745) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 22 20:56:06.762551 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-5ebb2376-d7dd-423c-8999-ae1f8c5043ae tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] 10.222.0.18 "POST /compute/v2.1/servers/29a351ac-ecf5-4b11-9bdd-f1c93df1335a/action" status: 202 len: 0 microversion: 2.1 time: 6.825037 Oct 22 20:56:06.770458 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 900/1718] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 20:55:59 2022] POST /compute/v2.1/servers/29a351ac-ecf5-4b11-9bdd-f1c93df1335a/action => generated 0 bytes in 6833 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 22 20:56:06.782822 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-05a25fbd-5e2d-41af-8d45-c24b71253fed tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:56:06.784057 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-05a25fbd-5e2d-41af-8d45-c24b71253fed tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] [instance: 8f2e1da0-4586-460b-94dc-768fd618dc3d] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:56:06.794363 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-05a25fbd-5e2d-41af-8d45-c24b71253fed tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:06.799835 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-05a25fbd-5e2d-41af-8d45-c24b71253fed tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:06.800373 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-05a25fbd-5e2d-41af-8d45-c24b71253fed tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:06.801983 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-05a25fbd-5e2d-41af-8d45-c24b71253fed tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:06.802474 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-05a25fbd-5e2d-41af-8d45-c24b71253fed tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:06.802906 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-05a25fbd-5e2d-41af-8d45-c24b71253fed tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:06.867488 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-05a25fbd-5e2d-41af-8d45-c24b71253fed tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] [instance: 8f2e1da0-4586-460b-94dc-768fd618dc3d] Going to try to terminate instance {{(pid=138745) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 20:56:06.908573 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-1fe7392f-da70-4c36-9840-2d83dcfb4551 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b638db630404ebbbcc2253db30844c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cc7342bf7941d2ad7ebc70032dd52e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:56:06.921156 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-1fe7392f-da70-4c36-9840-2d83dcfb4551 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] 10.222.0.18 "GET /compute/v2.1/servers/73404cab-dc0f-4f1c-b38b-a1505a5dc8b2" status: 200 len: 1303 microversion: 2.1 time: 0.398957 Oct 22 20:56:06.921987 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 819/1719] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:56:06 2022] GET /compute/v2.1/servers/73404cab-dc0f-4f1c-b38b-a1505a5dc8b2 => generated 1303 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:56:06.940620 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-a5198067-ce96-4228-96d6-afc74d3344d9 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Action: 'create', calling method: .version_select at 0x7fd3a89ed820>, body: {"keypair": {"name": "tempest-keypair-785660458", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO3Nn529hf62zMt/Y1OgbHenHvIr4Tl8crMaoTD2iGJCTcQ1PMq+FLi+4eKrJKSw10lX8rsHDxr5E4MlfpD3rhxIgYOk7MrlCEyhfxb3PvprciQpXuiKaXONdwPBodNTQg=="}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:56:06.964319 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-a5198067-ce96-4228-96d6-afc74d3344d9 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Getting quotas for project 594624ed28aa433d907c8833d360b82e. Resources: {'key_pairs'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 20:56:06.969970 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-a5198067-ce96-4228-96d6-afc74d3344d9 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Getting quotas for user b392ad1fe1fd4b2a9e6be03a7435deb9 and project 594624ed28aa433d907c8833d360b82e. Resources: {'key_pairs'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 20:56:07.001293 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-a5198067-ce96-4228-96d6-afc74d3344d9 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.078231 Oct 22 20:56:07.001983 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 820/1720] 10.222.0.18 () {60 vars in 1159 bytes} [Sat Oct 22 20:56:06 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:56:07.007354 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-e43ea7f5-e4fc-448e-934a-75dc82bf6cfc req-986ea990-a53c-44e4-9576-167ecc33279d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "532d6e6a-71ab-4ef0-a5bf-c042055c5121", "name": "network-vif-deleted", "tag": "7c68227f-68b8-459e-8cf6-9b169351d597"}, {"server_uuid": "a64fa89e-32f6-4994-a0b2-3788cf1c92ec", "name": "network-vif-deleted", "tag": "e916fb42-f87f-4b20-b6b6-8abd516f5e15"}, {"name": "network-changed", "server_uuid": "29a351ac-ecf5-4b11-9bdd-f1c93df1335a", "tag": "07fb8283-cc10-46e3-bd70-2c1e5b8c3aef"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:56:07.029743 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-e43ea7f5-e4fc-448e-934a-75dc82bf6cfc req-986ea990-a53c-44e4-9576-167ecc33279d service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:07.030146 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-e43ea7f5-e4fc-448e-934a-75dc82bf6cfc req-986ea990-a53c-44e4-9576-167ecc33279d service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:07.030786 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-e43ea7f5-e4fc-448e-934a-75dc82bf6cfc req-986ea990-a53c-44e4-9576-167ecc33279d service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:07.046414 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-e43ea7f5-e4fc-448e-934a-75dc82bf6cfc req-986ea990-a53c-44e4-9576-167ecc33279d service nova] Creating event network-vif-deleted:7c68227f-68b8-459e-8cf6-9b169351d597 for instance 532d6e6a-71ab-4ef0-a5bf-c042055c5121 on nch1-master-1 Oct 22 20:56:07.046414 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-e43ea7f5-e4fc-448e-934a-75dc82bf6cfc req-986ea990-a53c-44e4-9576-167ecc33279d service nova] Creating event network-vif-deleted:e916fb42-f87f-4b20-b6b6-8abd516f5e15 for instance a64fa89e-32f6-4994-a0b2-3788cf1c92ec on nch2-master-1 Oct 22 20:56:07.046773 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-e43ea7f5-e4fc-448e-934a-75dc82bf6cfc req-986ea990-a53c-44e4-9576-167ecc33279d service nova] Creating event network-changed:07fb8283-cc10-46e3-bd70-2c1e5b8c3aef for instance 29a351ac-ecf5-4b11-9bdd-f1c93df1335a on nch2-master-1 Oct 22 20:56:07.048283 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-05a25fbd-5e2d-41af-8d45-c24b71253fed tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] 10.222.0.18 "DELETE /compute/v2.1/servers/8f2e1da0-4586-460b-94dc-768fd618dc3d" status: 204 len: 0 microversion: 2.1 time: 0.276281 Oct 22 20:56:07.050389 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 901/1721] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 20:56:06 2022] DELETE /compute/v2.1/servers/8f2e1da0-4586-460b-94dc-768fd618dc3d => generated 0 bytes in 279 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 20:56:07.060644 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-bdab845b-e660-49ce-be42-3dc94cc2f3df tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:56:07.063830 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-bdab845b-e660-49ce-be42-3dc94cc2f3df tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] [instance: 98f48cb1-54ed-4e82-8a25-fd004ddb5758] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:56:07.066358 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-e43ea7f5-e4fc-448e-934a-75dc82bf6cfc req-986ea990-a53c-44e4-9576-167ecc33279d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 521 microversion: 2.1 time: 0.063056 Oct 22 20:56:07.068832 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 821/1722] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:56:07 2022] POST /compute/v2.1/os-server-external-events => generated 521 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:56:07.073369 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bdab845b-e660-49ce-be42-3dc94cc2f3df tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:07.074236 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bdab845b-e660-49ce-be42-3dc94cc2f3df tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:07.074436 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-3ab98ab6-9b69-4647-8415-fcc8b5cd7789 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Calling method '.version_select at 0x7fd3a8b05ee0>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:56:07.075993 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bdab845b-e660-49ce-be42-3dc94cc2f3df tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:07.077089 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bdab845b-e660-49ce-be42-3dc94cc2f3df tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:07.077743 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bdab845b-e660-49ce-be42-3dc94cc2f3df tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:07.078408 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bdab845b-e660-49ce-be42-3dc94cc2f3df tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:07.669042 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-bdab845b-e660-49ce-be42-3dc94cc2f3df tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d3d7458af447bdb3f03e83a2d8559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49238b8686d24ae698679e4a1957735d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:56:07.680008 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-bdab845b-e660-49ce-be42-3dc94cc2f3df tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] 10.222.0.18 "GET /compute/v2.1/servers/98f48cb1-54ed-4e82-8a25-fd004ddb5758" status: 200 len: 1474 microversion: 2.1 time: 0.627387 Oct 22 20:56:07.682156 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 902/1723] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:56:07 2022] GET /compute/v2.1/servers/98f48cb1-54ed-4e82-8a25-fd004ddb5758 => generated 1474 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:56:07.701208 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-bfbc8d66-594e-4542-b469-fc19fae59307 tempest-ServersTestFqdnHostnames-400258971 tempest-ServersTestFqdnHostnames-400258971-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:56:07.702160 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-bfbc8d66-594e-4542-b469-fc19fae59307 tempest-ServersTestFqdnHostnames-400258971 tempest-ServersTestFqdnHostnames-400258971-project] [instance: 78aef3f6-9cff-4db4-95c1-f0d5480b7a3c] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:56:07.709144 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bfbc8d66-594e-4542-b469-fc19fae59307 tempest-ServersTestFqdnHostnames-400258971 tempest-ServersTestFqdnHostnames-400258971-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:07.711961 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bfbc8d66-594e-4542-b469-fc19fae59307 tempest-ServersTestFqdnHostnames-400258971 tempest-ServersTestFqdnHostnames-400258971-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:07.712679 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bfbc8d66-594e-4542-b469-fc19fae59307 tempest-ServersTestFqdnHostnames-400258971 tempest-ServersTestFqdnHostnames-400258971-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:07.715926 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bfbc8d66-594e-4542-b469-fc19fae59307 tempest-ServersTestFqdnHostnames-400258971 tempest-ServersTestFqdnHostnames-400258971-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:07.720067 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bfbc8d66-594e-4542-b469-fc19fae59307 tempest-ServersTestFqdnHostnames-400258971 tempest-ServersTestFqdnHostnames-400258971-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:07.720945 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bfbc8d66-594e-4542-b469-fc19fae59307 tempest-ServersTestFqdnHostnames-400258971 tempest-ServersTestFqdnHostnames-400258971-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:07.783731 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-3ab98ab6-9b69-4647-8415-fcc8b5cd7789 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] 10.222.0.18 "GET /compute/v2.1/os-floating-ips/af6594f3-fc4d-4e50-8065-37150f5c810c" status: 200 len: 184 microversion: 2.1 time: 0.713548 Oct 22 20:56:07.784756 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 822/1724] 10.222.0.18 () {58 vars in 1260 bytes} [Sat Oct 22 20:56:07 2022] GET /compute/v2.1/os-floating-ips/af6594f3-fc4d-4e50-8065-37150f5c810c => generated 184 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:56:07.792176 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-b182417c-149c-455d-b89d-4704f11af994 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:56:07.793653 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-b182417c-149c-455d-b89d-4704f11af994 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] [instance: 8f2e1da0-4586-460b-94dc-768fd618dc3d] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:56:07.808363 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b182417c-149c-455d-b89d-4704f11af994 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:07.809834 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b182417c-149c-455d-b89d-4704f11af994 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:07.811017 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b182417c-149c-455d-b89d-4704f11af994 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:07.827713 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b182417c-149c-455d-b89d-4704f11af994 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:07.828466 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b182417c-149c-455d-b89d-4704f11af994 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:07.829865 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b182417c-149c-455d-b89d-4704f11af994 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:08.954108 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-bfbc8d66-594e-4542-b469-fc19fae59307 tempest-ServersTestFqdnHostnames-400258971 tempest-ServersTestFqdnHostnames-400258971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02fdeda494a547f1a8714007e05e874d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b75771ecf442919c647f15d499880e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:56:08.968167 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-bfbc8d66-594e-4542-b469-fc19fae59307 tempest-ServersTestFqdnHostnames-400258971 tempest-ServersTestFqdnHostnames-400258971-project] 10.222.0.18 "GET /compute/v2.1/servers/78aef3f6-9cff-4db4-95c1-f0d5480b7a3c" status: 200 len: 1352 microversion: 2.1 time: 1.275642 Oct 22 20:56:08.968870 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 903/1725] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:56:07 2022] GET /compute/v2.1/servers/78aef3f6-9cff-4db4-95c1-f0d5480b7a3c => generated 1352 bytes in 1282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:56:08.980813 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-303666d0-8154-4f21-9ded-ebbd9df0f03e tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:56:08.991064 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-303666d0-8154-4f21-9ded-ebbd9df0f03e tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] [instance: df5f7e8f-5ed6-4ad6-9bcb-eaa54b4ee320] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:56:08.998771 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-303666d0-8154-4f21-9ded-ebbd9df0f03e tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:08.999684 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-303666d0-8154-4f21-9ded-ebbd9df0f03e tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:09.000575 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-303666d0-8154-4f21-9ded-ebbd9df0f03e tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:09.001516 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-303666d0-8154-4f21-9ded-ebbd9df0f03e tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:09.002297 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-303666d0-8154-4f21-9ded-ebbd9df0f03e tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:09.002526 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-b182417c-149c-455d-b89d-4704f11af994 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c87f0356ca346f39c6216393d85da2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee8c8f7fc4e12bc1f9fcce3e7b581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:56:09.003375 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-303666d0-8154-4f21-9ded-ebbd9df0f03e tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:09.013669 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-b182417c-149c-455d-b89d-4704f11af994 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] 10.222.0.18 "GET /compute/v2.1/servers/8f2e1da0-4586-460b-94dc-768fd618dc3d" status: 200 len: 1665 microversion: 2.1 time: 1.227377 Oct 22 20:56:09.020205 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 823/1726] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:56:07 2022] GET /compute/v2.1/servers/8f2e1da0-4586-460b-94dc-768fd618dc3d => generated 1665 bytes in 1235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:56:09.042166 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-4f913959-5c42-4dda-a3d4-a5261c9432c4 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Action: 'action', calling method: .version_select at 0x7fd3a5d11790>, body: {"removeFloatingIp": {"address": "172.35.2.224"}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:56:09.155332 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-303666d0-8154-4f21-9ded-ebbd9df0f03e tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e787e0b494764176a0f13d75c47d77fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '371ecb87e8d34859971be23c1a1bc443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:56:09.168369 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-303666d0-8154-4f21-9ded-ebbd9df0f03e tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] 10.222.0.18 "GET /compute/v2.1/servers/df5f7e8f-5ed6-4ad6-9bcb-eaa54b4ee320" status: 200 len: 1278 microversion: 2.1 time: 0.197710 Oct 22 20:56:09.168985 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 904/1727] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:56:08 2022] GET /compute/v2.1/servers/df5f7e8f-5ed6-4ad6-9bcb-eaa54b4ee320 => generated 1278 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:56:09.179398 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-092e19d9-bd4c-4229-b2ec-3d810fed6aff tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:56:09.180019 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-092e19d9-bd4c-4229-b2ec-3d810fed6aff tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] [instance: 73404cab-dc0f-4f1c-b38b-a1505a5dc8b2] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:56:09.190179 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-092e19d9-bd4c-4229-b2ec-3d810fed6aff tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:09.190672 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-092e19d9-bd4c-4229-b2ec-3d810fed6aff tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:09.191109 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-092e19d9-bd4c-4229-b2ec-3d810fed6aff tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:09.192100 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-092e19d9-bd4c-4229-b2ec-3d810fed6aff tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:09.192725 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-092e19d9-bd4c-4229-b2ec-3d810fed6aff tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:09.195980 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-092e19d9-bd4c-4229-b2ec-3d810fed6aff tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:09.252578 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-092e19d9-bd4c-4229-b2ec-3d810fed6aff tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:09.253485 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-092e19d9-bd4c-4229-b2ec-3d810fed6aff tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:09.254996 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-092e19d9-bd4c-4229-b2ec-3d810fed6aff tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:09.255723 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.objects.instance [None req-092e19d9-bd4c-4229-b2ec-3d810fed6aff tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Lazy-loading 'fault' on Instance uuid 73404cab-dc0f-4f1c-b38b-a1505a5dc8b2 {{(pid=138745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 20:56:09.360859 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-092e19d9-bd4c-4229-b2ec-3d810fed6aff tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b638db630404ebbbcc2253db30844c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cc7342bf7941d2ad7ebc70032dd52e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:56:09.378663 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-092e19d9-bd4c-4229-b2ec-3d810fed6aff tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] 10.222.0.18 "GET /compute/v2.1/servers/73404cab-dc0f-4f1c-b38b-a1505a5dc8b2" status: 200 len: 1308 microversion: 2.1 time: 0.205309 Oct 22 20:56:09.379409 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 905/1728] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:56:09 2022] GET /compute/v2.1/servers/73404cab-dc0f-4f1c-b38b-a1505a5dc8b2 => generated 1308 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:56:09.389580 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-133d39d7-184c-4b54-aa02-86ecbba8e3fe req-bc2de967-77d1-4e01-8b5a-8a89e2237138 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73404cab-dc0f-4f1c-b38b-a1505a5dc8b2", "name": "network-vif-deleted", "tag": "fbd90195-446f-40e0-bd14-a4a338e00ca1"}, {"name": "network-changed", "server_uuid": "c5db8404-7c9d-41d4-a018-a27058378d35", "tag": "cb9e18be-499d-410c-bbe2-d450122802d7"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:56:09.395626 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-4f913959-5c42-4dda-a3d4-a5261c9432c4 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] [instance: 29a351ac-ecf5-4b11-9bdd-f1c93df1335a] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:56:09.402766 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4f913959-5c42-4dda-a3d4-a5261c9432c4 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:09.403392 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4f913959-5c42-4dda-a3d4-a5261c9432c4 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:09.403912 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4f913959-5c42-4dda-a3d4-a5261c9432c4 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:09.404706 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4f913959-5c42-4dda-a3d4-a5261c9432c4 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:09.409593 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4f913959-5c42-4dda-a3d4-a5261c9432c4 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:09.410183 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4f913959-5c42-4dda-a3d4-a5261c9432c4 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:09.436169 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-133d39d7-184c-4b54-aa02-86ecbba8e3fe req-bc2de967-77d1-4e01-8b5a-8a89e2237138 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:09.436763 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-133d39d7-184c-4b54-aa02-86ecbba8e3fe req-bc2de967-77d1-4e01-8b5a-8a89e2237138 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:09.439208 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-133d39d7-184c-4b54-aa02-86ecbba8e3fe req-bc2de967-77d1-4e01-8b5a-8a89e2237138 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:09.483488 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-133d39d7-184c-4b54-aa02-86ecbba8e3fe req-bc2de967-77d1-4e01-8b5a-8a89e2237138 service nova] Creating event network-vif-deleted:fbd90195-446f-40e0-bd14-a4a338e00ca1 for instance 73404cab-dc0f-4f1c-b38b-a1505a5dc8b2 on nch1-master-1 Oct 22 20:56:09.484484 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-133d39d7-184c-4b54-aa02-86ecbba8e3fe req-bc2de967-77d1-4e01-8b5a-8a89e2237138 service nova] Creating event network-changed:cb9e18be-499d-410c-bbe2-d450122802d7 for instance c5db8404-7c9d-41d4-a018-a27058378d35 on nch2-master-1 Oct 22 20:56:09.507890 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-133d39d7-184c-4b54-aa02-86ecbba8e3fe req-bc2de967-77d1-4e01-8b5a-8a89e2237138 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.126868 Oct 22 20:56:09.509152 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 906/1729] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:56:09 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:56:09.514597 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-39955a23-910a-4ed5-8393-19b4bcece6c0 req-3c78dc43-4338-43e8-86a2-99559bc87650 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78aef3f6-9cff-4db4-95c1-f0d5480b7a3c", "name": "network-vif-plugged", "status": "completed", "tag": "1b3feae7-78b5-47fa-a825-d1a96beffac1"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:56:09.543421 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-39955a23-910a-4ed5-8393-19b4bcece6c0 req-3c78dc43-4338-43e8-86a2-99559bc87650 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:09.545072 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-39955a23-910a-4ed5-8393-19b4bcece6c0 req-3c78dc43-4338-43e8-86a2-99559bc87650 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:09.545599 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-39955a23-910a-4ed5-8393-19b4bcece6c0 req-3c78dc43-4338-43e8-86a2-99559bc87650 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:09.567300 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-39955a23-910a-4ed5-8393-19b4bcece6c0 req-3c78dc43-4338-43e8-86a2-99559bc87650 service nova] Creating event network-vif-plugged:1b3feae7-78b5-47fa-a825-d1a96beffac1 for instance 78aef3f6-9cff-4db4-95c1-f0d5480b7a3c on nch1-master-1 Oct 22 20:56:09.572820 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-39955a23-910a-4ed5-8393-19b4bcece6c0 req-3c78dc43-4338-43e8-86a2-99559bc87650 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062069 Oct 22 20:56:09.573750 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 907/1730] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:56:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:56:09.578877 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-817fdd16-0ed0-475b-b9dd-634c959b5c12 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:56:09.579643 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-817fdd16-0ed0-475b-b9dd-634c959b5c12 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] [instance: 98f48cb1-54ed-4e82-8a25-fd004ddb5758] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:56:09.597283 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-817fdd16-0ed0-475b-b9dd-634c959b5c12 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:09.597767 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-817fdd16-0ed0-475b-b9dd-634c959b5c12 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:09.598453 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-817fdd16-0ed0-475b-b9dd-634c959b5c12 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:09.599256 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-817fdd16-0ed0-475b-b9dd-634c959b5c12 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:09.599746 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-817fdd16-0ed0-475b-b9dd-634c959b5c12 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:09.600363 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-817fdd16-0ed0-475b-b9dd-634c959b5c12 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:09.649881 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell0:SELECT=4 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:56:09.725832 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4f913959-5c42-4dda-a3d4-a5261c9432c4 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Acquiring lock "refresh_cache-29a351ac-ecf5-4b11-9bdd-f1c93df1335a" {{(pid=138744) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 22 20:56:09.726811 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4f913959-5c42-4dda-a3d4-a5261c9432c4 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Acquired lock "refresh_cache-29a351ac-ecf5-4b11-9bdd-f1c93df1335a" {{(pid=138744) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 22 20:56:09.729438 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell0:SELECT=12 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:56:10.304978 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-817fdd16-0ed0-475b-b9dd-634c959b5c12 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d3d7458af447bdb3f03e83a2d8559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49238b8686d24ae698679e4a1957735d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:56:10.333041 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-817fdd16-0ed0-475b-b9dd-634c959b5c12 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] 10.222.0.18 "GET /compute/v2.1/servers/98f48cb1-54ed-4e82-8a25-fd004ddb5758" status: 200 len: 1474 microversion: 2.1 time: 0.757981 Oct 22 20:56:10.333927 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 908/1731] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:56:09 2022] GET /compute/v2.1/servers/98f48cb1-54ed-4e82-8a25-fd004ddb5758 => generated 1474 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:56:10.353369 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-be0d65a2-30df-4a4c-8cbf-75d824d17938 req-b3954b98-e123-430d-b43b-6b8069e9f6a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bccbf2b3-70e3-406d-b844-e48d765732cf", "name": "network-vif-deleted", "tag": "f10bd596-45de-410e-8f59-646e0dbcc5cc"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:56:10.367903 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-be0d65a2-30df-4a4c-8cbf-75d824d17938 req-b3954b98-e123-430d-b43b-6b8069e9f6a1 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:10.369042 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-be0d65a2-30df-4a4c-8cbf-75d824d17938 req-b3954b98-e123-430d-b43b-6b8069e9f6a1 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:10.369870 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-be0d65a2-30df-4a4c-8cbf-75d824d17938 req-b3954b98-e123-430d-b43b-6b8069e9f6a1 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:10.388061 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-be0d65a2-30df-4a4c-8cbf-75d824d17938 req-b3954b98-e123-430d-b43b-6b8069e9f6a1 service nova] Creating event network-vif-deleted:f10bd596-45de-410e-8f59-646e0dbcc5cc for instance bccbf2b3-70e3-406d-b844-e48d765732cf on nch2-master-1 Oct 22 20:56:10.402301 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-be0d65a2-30df-4a4c-8cbf-75d824d17938 req-b3954b98-e123-430d-b43b-6b8069e9f6a1 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059211 Oct 22 20:56:10.403135 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 909/1732] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:56:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:56:10.412384 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-db38ae86-b256-4198-aa81-262473882ec4 tempest-ServersTestFqdnHostnames-400258971 tempest-ServersTestFqdnHostnames-400258971-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:56:10.413152 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-db38ae86-b256-4198-aa81-262473882ec4 tempest-ServersTestFqdnHostnames-400258971 tempest-ServersTestFqdnHostnames-400258971-project] [instance: 78aef3f6-9cff-4db4-95c1-f0d5480b7a3c] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:56:10.420732 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-db38ae86-b256-4198-aa81-262473882ec4 tempest-ServersTestFqdnHostnames-400258971 tempest-ServersTestFqdnHostnames-400258971-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:10.421446 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-db38ae86-b256-4198-aa81-262473882ec4 tempest-ServersTestFqdnHostnames-400258971 tempest-ServersTestFqdnHostnames-400258971-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:10.422091 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-db38ae86-b256-4198-aa81-262473882ec4 tempest-ServersTestFqdnHostnames-400258971 tempest-ServersTestFqdnHostnames-400258971-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:10.424885 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-db38ae86-b256-4198-aa81-262473882ec4 tempest-ServersTestFqdnHostnames-400258971 tempest-ServersTestFqdnHostnames-400258971-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:10.425480 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-db38ae86-b256-4198-aa81-262473882ec4 tempest-ServersTestFqdnHostnames-400258971 tempest-ServersTestFqdnHostnames-400258971-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:10.425925 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-db38ae86-b256-4198-aa81-262473882ec4 tempest-ServersTestFqdnHostnames-400258971 tempest-ServersTestFqdnHostnames-400258971-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:10.770294 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-db38ae86-b256-4198-aa81-262473882ec4 tempest-ServersTestFqdnHostnames-400258971 tempest-ServersTestFqdnHostnames-400258971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02fdeda494a547f1a8714007e05e874d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b75771ecf442919c647f15d499880e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:56:10.783778 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-db38ae86-b256-4198-aa81-262473882ec4 tempest-ServersTestFqdnHostnames-400258971 tempest-ServersTestFqdnHostnames-400258971-project] 10.222.0.18 "GET /compute/v2.1/servers/78aef3f6-9cff-4db4-95c1-f0d5480b7a3c" status: 200 len: 1352 microversion: 2.1 time: 0.375352 Oct 22 20:56:10.799618 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 910/1733] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:56:10 2022] GET /compute/v2.1/servers/78aef3f6-9cff-4db4-95c1-f0d5480b7a3c => generated 1352 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:56:10.807953 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-141763f2-8bec-46fa-9495-4a028197ece4 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:56:10.808642 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-141763f2-8bec-46fa-9495-4a028197ece4 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] [instance: 8f2e1da0-4586-460b-94dc-768fd618dc3d] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:56:10.818625 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-141763f2-8bec-46fa-9495-4a028197ece4 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:10.819227 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-141763f2-8bec-46fa-9495-4a028197ece4 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:10.819761 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-141763f2-8bec-46fa-9495-4a028197ece4 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:10.821191 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-141763f2-8bec-46fa-9495-4a028197ece4 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:10.821892 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-141763f2-8bec-46fa-9495-4a028197ece4 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:10.822518 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-141763f2-8bec-46fa-9495-4a028197ece4 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:10.962966 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-141763f2-8bec-46fa-9495-4a028197ece4 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c87f0356ca346f39c6216393d85da2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee8c8f7fc4e12bc1f9fcce3e7b581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:56:10.980810 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-141763f2-8bec-46fa-9495-4a028197ece4 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] 10.222.0.18 "GET /compute/v2.1/servers/8f2e1da0-4586-460b-94dc-768fd618dc3d" status: 200 len: 1597 microversion: 2.1 time: 0.179418 Oct 22 20:56:10.981646 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 911/1734] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:56:10 2022] GET /compute/v2.1/servers/8f2e1da0-4586-460b-94dc-768fd618dc3d => generated 1597 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:56:10.986268 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-71a9ce67-3950-4bbb-8126-f3e099e10a8b tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:56:10.987029 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-71a9ce67-3950-4bbb-8126-f3e099e10a8b tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] [instance: df5f7e8f-5ed6-4ad6-9bcb-eaa54b4ee320] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:56:11.000907 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-71a9ce67-3950-4bbb-8126-f3e099e10a8b tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:11.001802 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-71a9ce67-3950-4bbb-8126-f3e099e10a8b tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:11.002632 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-71a9ce67-3950-4bbb-8126-f3e099e10a8b tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:11.003640 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-71a9ce67-3950-4bbb-8126-f3e099e10a8b tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:11.004307 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-71a9ce67-3950-4bbb-8126-f3e099e10a8b tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:11.004935 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-71a9ce67-3950-4bbb-8126-f3e099e10a8b tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:11.371866 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.network.neutron [None req-4f913959-5c42-4dda-a3d4-a5261c9432c4 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] [instance: 29a351ac-ecf5-4b11-9bdd-f1c93df1335a] Building network info cache for instance {{(pid=138744) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 22 20:56:11.474465 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-71a9ce67-3950-4bbb-8126-f3e099e10a8b tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e787e0b494764176a0f13d75c47d77fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '371ecb87e8d34859971be23c1a1bc443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:56:11.492416 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-71a9ce67-3950-4bbb-8126-f3e099e10a8b tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] 10.222.0.18 "GET /compute/v2.1/servers/df5f7e8f-5ed6-4ad6-9bcb-eaa54b4ee320" status: 200 len: 1320 microversion: 2.1 time: 0.508477 Oct 22 20:56:11.498162 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 912/1735] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:56:10 2022] GET /compute/v2.1/servers/df5f7e8f-5ed6-4ad6-9bcb-eaa54b4ee320 => generated 1320 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:56:11.504070 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-dbc0fb93-96b2-444e-9ebd-0484410719d5 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:56:11.511461 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-dbc0fb93-96b2-444e-9ebd-0484410719d5 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] [instance: 73404cab-dc0f-4f1c-b38b-a1505a5dc8b2] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:56:11.528599 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-dbc0fb93-96b2-444e-9ebd-0484410719d5 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:11.529421 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-dbc0fb93-96b2-444e-9ebd-0484410719d5 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:11.531312 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-dbc0fb93-96b2-444e-9ebd-0484410719d5 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:11.534106 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-dbc0fb93-96b2-444e-9ebd-0484410719d5 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:11.535089 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-dbc0fb93-96b2-444e-9ebd-0484410719d5 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:11.544685 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-dbc0fb93-96b2-444e-9ebd-0484410719d5 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:11.581746 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.wsgi [None req-dbc0fb93-96b2-444e-9ebd-0484410719d5 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] HTTP exception thrown: Instance 73404cab-dc0f-4f1c-b38b-a1505a5dc8b2 could not be found. Oct 22 20:56:11.586407 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-dbc0fb93-96b2-444e-9ebd-0484410719d5 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Request method failure captured: Oct 22 20:56:11.586407 ncdv-master-1 devstack@n-api.service[138745]: request: GET /compute/v2.1/servers/73404cab-dc0f-4f1c-b38b-a1505a5dc8b2 HTTP/1.1 Oct 22 20:56:11.586407 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 20:56:11.586407 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 20:56:11.586407 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 20:56:11.586407 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 0 Oct 22 20:56:11.586407 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 20:56:11.586407 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 20:56:11.586407 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 20:56:11.586407 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 20:56:11.586407 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVFib06GwT4Tgcdoj-PILar2vRur3S-rUdOwm4Cx1PT7PW-yoYnxsx-OnsTebBJBYy0yEkpuJKijclB1_k6GBbBNIBaYd6PNOkhPKLIxNQS_OySDDXiSROYzzcHTovkYyQFOxrgw-0PM-IbgZsPgufFuIB_x4X8eHhdHHX3Pi6Wghlzk Oct 22 20:56:11.586407 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 20:56:11.586407 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 20:56:11.586407 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 20:56:11.586407 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 20:56:11.586407 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 20:56:11.586407 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 20:56:11.586407 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: a4cc7342bf7941d2ad7ebc70032dd52e Oct 22 20:56:11.586407 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-MultipleCreateTestJSON-1741424417 Oct 22 20:56:11.586407 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 20:56:11.586407 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 20:56:11.586407 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_a4cc7342bf7941d2ad7ebc70032dd52e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a4cc7342bf7941d2ad7ebc70032dd52e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/a4cc7342bf7941d2ad7ebc70032dd52e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a4cc7342bf7941d2ad7ebc70032dd52e"}]}] Oct 22 20:56:11.586407 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-MultipleCreateTestJSON-1741424417 Oct 22 20:56:11.586407 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: a4cc7342bf7941d2ad7ebc70032dd52e Oct 22 20:56:11.586407 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-MultipleCreateTestJSON-1741424417 Oct 22 20:56:11.586407 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-MultipleCreateTestJSON-1741424417-project Oct 22 20:56:11.586407 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 20:56:11.586407 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 20:56:11.586407 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: 1b638db630404ebbbcc2253db30844c5 Oct 22 20:56:11.586407 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-MultipleCreateTestJSON-1741424417-project Oct 22 20:56:11.586407 ncdv-master-1 devstack@n-api.service[138745]: method: > Oct 22 20:56:11.586407 ncdv-master-1 devstack@n-api.service[138745]: exception: Instance 73404cab-dc0f-4f1c-b38b-a1505a5dc8b2 could not be found. Oct 22 20:56:11.586407 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'id': '73404cab-dc0f-4f1c-b38b-a1505a5dc8b2'} Oct 22 20:56:11.586407 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:56:11.586407 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:56:11.586407 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 20:56:11.586407 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 20:56:11.586407 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 20:56:11.586407 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 20:56:11.586407 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 20:56:11.586407 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 20:56:11.586407 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 20:56:11.586407 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 20:56:11.586407 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73404cab-dc0f-4f1c-b38b-a1505a5dc8b2 could not be found. Oct 22 20:56:11.586407 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:56:11.586407 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:56:11.586407 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:56:11.586407 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:56:11.586407 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:56:11.586407 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:56:11.586407 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:56:11.586407 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:56:11.586407 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:56:11.586407 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:56:11.586407 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 20:56:11.586407 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 20:56:11.586407 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 20:56:11.586407 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 20:56:11.586407 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 20:56:11.586407 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 20:56:11.586407 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73404cab-dc0f-4f1c-b38b-a1505a5dc8b2 could not be found. Oct 22 20:56:11.586407 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:56:11.586407 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:56:11.586407 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:56:11.604066 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:56:11.604066 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:56:11.604066 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:56:11.604066 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 20:56:11.604066 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 20:56:11.604066 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73404cab-dc0f-4f1c-b38b-a1505a5dc8b2 could not be found. Oct 22 20:56:11.604066 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:56:11.604066 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-dbc0fb93-96b2-444e-9ebd-0484410719d5 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Returning 404 to user: Instance 73404cab-dc0f-4f1c-b38b-a1505a5dc8b2 could not be found. {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:56:11.604066 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-dbc0fb93-96b2-444e-9ebd-0484410719d5 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] 10.222.0.18 "GET /compute/v2.1/servers/73404cab-dc0f-4f1c-b38b-a1505a5dc8b2" status: 404 len: 111 microversion: 2.1 time: 0.089068 Oct 22 20:56:11.604066 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 913/1736] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:56:11 2022] GET /compute/v2.1/servers/73404cab-dc0f-4f1c-b38b-a1505a5dc8b2 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 20:56:11.616463 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-77307225-d431-4e02-8863-32756b153e50 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:56:11.626256 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-77307225-d431-4e02-8863-32756b153e50 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] [instance: 98f48cb1-54ed-4e82-8a25-fd004ddb5758] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:56:11.659688 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-77307225-d431-4e02-8863-32756b153e50 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:11.660185 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-77307225-d431-4e02-8863-32756b153e50 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:11.661128 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-77307225-d431-4e02-8863-32756b153e50 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:11.661865 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-77307225-d431-4e02-8863-32756b153e50 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:11.662319 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-77307225-d431-4e02-8863-32756b153e50 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:11.664074 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-77307225-d431-4e02-8863-32756b153e50 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:11.696949 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell1:SELECT=95,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=2,nova_cell1:RELEASE=1,nova_cell1:INSERT=1 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:56:12.112900 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-77307225-d431-4e02-8863-32756b153e50 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d3d7458af447bdb3f03e83a2d8559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49238b8686d24ae698679e4a1957735d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:56:12.135088 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-77307225-d431-4e02-8863-32756b153e50 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] 10.222.0.18 "GET /compute/v2.1/servers/98f48cb1-54ed-4e82-8a25-fd004ddb5758" status: 200 len: 1474 microversion: 2.1 time: 0.528862 Oct 22 20:56:12.142981 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 914/1737] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:56:11 2022] GET /compute/v2.1/servers/98f48cb1-54ed-4e82-8a25-fd004ddb5758 => generated 1474 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:56:12.152292 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-98554839-efbe-4cd3-b43c-6cd422c33168 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:56:12.155176 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-98554839-efbe-4cd3-b43c-6cd422c33168 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] [instance: bccbf2b3-70e3-406d-b844-e48d765732cf] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:56:12.178017 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-98554839-efbe-4cd3-b43c-6cd422c33168 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:12.180234 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-98554839-efbe-4cd3-b43c-6cd422c33168 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:12.181015 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-98554839-efbe-4cd3-b43c-6cd422c33168 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:12.190048 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-98554839-efbe-4cd3-b43c-6cd422c33168 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:12.190736 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-98554839-efbe-4cd3-b43c-6cd422c33168 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:12.191381 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-98554839-efbe-4cd3-b43c-6cd422c33168 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:12.210767 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.wsgi [None req-98554839-efbe-4cd3-b43c-6cd422c33168 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] HTTP exception thrown: Instance bccbf2b3-70e3-406d-b844-e48d765732cf could not be found. Oct 22 20:56:12.216270 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-98554839-efbe-4cd3-b43c-6cd422c33168 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Request method failure captured: Oct 22 20:56:12.216270 ncdv-master-1 devstack@n-api.service[138745]: request: GET /compute/v2.1/servers/bccbf2b3-70e3-406d-b844-e48d765732cf HTTP/1.1 Oct 22 20:56:12.216270 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 20:56:12.216270 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 20:56:12.216270 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 20:56:12.216270 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 0 Oct 22 20:56:12.216270 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 20:56:12.216270 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 20:56:12.216270 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 20:56:12.216270 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 20:56:12.216270 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVFib06GwT4Tgcdoj-PILar2vRur3S-rUdOwm4Cx1PT7PW-yoYnxsx-OnsTebBJBYy0yEkpuJKijclB1_k6GBbBNIBaYd6PNOkhPKLIxNQS_OySDDXiSROYzzcHTovkYyQFOxrgw-0PM-IbgZsPgufFuIB_x4X8eHhdHHX3Pi6Wghlzk Oct 22 20:56:12.216270 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 20:56:12.216270 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 20:56:12.216270 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 20:56:12.216270 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 20:56:12.216270 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 20:56:12.216270 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 20:56:12.216270 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: a4cc7342bf7941d2ad7ebc70032dd52e Oct 22 20:56:12.216270 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-MultipleCreateTestJSON-1741424417 Oct 22 20:56:12.216270 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 20:56:12.216270 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 20:56:12.216270 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_a4cc7342bf7941d2ad7ebc70032dd52e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a4cc7342bf7941d2ad7ebc70032dd52e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/a4cc7342bf7941d2ad7ebc70032dd52e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a4cc7342bf7941d2ad7ebc70032dd52e"}]}] Oct 22 20:56:12.216270 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-MultipleCreateTestJSON-1741424417 Oct 22 20:56:12.216270 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: a4cc7342bf7941d2ad7ebc70032dd52e Oct 22 20:56:12.216270 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-MultipleCreateTestJSON-1741424417 Oct 22 20:56:12.216270 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-MultipleCreateTestJSON-1741424417-project Oct 22 20:56:12.216270 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 20:56:12.216270 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 20:56:12.216270 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: 1b638db630404ebbbcc2253db30844c5 Oct 22 20:56:12.216270 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-MultipleCreateTestJSON-1741424417-project Oct 22 20:56:12.216270 ncdv-master-1 devstack@n-api.service[138745]: method: > Oct 22 20:56:12.216270 ncdv-master-1 devstack@n-api.service[138745]: exception: Instance bccbf2b3-70e3-406d-b844-e48d765732cf could not be found. Oct 22 20:56:12.216270 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'id': 'bccbf2b3-70e3-406d-b844-e48d765732cf'} Oct 22 20:56:12.216270 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:56:12.216270 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:56:12.216270 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 20:56:12.216270 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 20:56:12.216270 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 20:56:12.216270 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 20:56:12.216270 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 20:56:12.216270 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 20:56:12.216270 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 20:56:12.216270 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 20:56:12.216270 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bccbf2b3-70e3-406d-b844-e48d765732cf could not be found. Oct 22 20:56:12.216270 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:56:12.216270 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:56:12.216270 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:56:12.216270 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:56:12.216270 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:56:12.216270 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:56:12.216270 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:56:12.216270 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:56:12.216270 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:56:12.216270 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:56:12.216270 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 20:56:12.216270 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 20:56:12.216270 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 20:56:12.216270 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 20:56:12.216270 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 20:56:12.216270 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 20:56:12.216270 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bccbf2b3-70e3-406d-b844-e48d765732cf could not be found. Oct 22 20:56:12.216270 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:56:12.216270 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:56:12.216270 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:56:12.222194 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:56:12.222194 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:56:12.222194 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:56:12.222194 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 20:56:12.222194 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 20:56:12.222194 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bccbf2b3-70e3-406d-b844-e48d765732cf could not be found. Oct 22 20:56:12.222194 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:56:12.229212 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-98554839-efbe-4cd3-b43c-6cd422c33168 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] Returning 404 to user: Instance bccbf2b3-70e3-406d-b844-e48d765732cf could not be found. {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:56:12.230340 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-98554839-efbe-4cd3-b43c-6cd422c33168 tempest-MultipleCreateTestJSON-1741424417 tempest-MultipleCreateTestJSON-1741424417-project] 10.222.0.18 "GET /compute/v2.1/servers/bccbf2b3-70e3-406d-b844-e48d765732cf" status: 404 len: 111 microversion: 2.1 time: 0.085892 Oct 22 20:56:12.231434 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 915/1738] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:56:12 2022] GET /compute/v2.1/servers/bccbf2b3-70e3-406d-b844-e48d765732cf => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 20:56:12.239073 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-3837be95-c8cc-4c00-903f-4505a542dc68 tempest-ServersTestFqdnHostnames-400258971 tempest-ServersTestFqdnHostnames-400258971-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:56:12.253883 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-3837be95-c8cc-4c00-903f-4505a542dc68 tempest-ServersTestFqdnHostnames-400258971 tempest-ServersTestFqdnHostnames-400258971-project] [instance: 78aef3f6-9cff-4db4-95c1-f0d5480b7a3c] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:56:12.277264 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3837be95-c8cc-4c00-903f-4505a542dc68 tempest-ServersTestFqdnHostnames-400258971 tempest-ServersTestFqdnHostnames-400258971-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:12.278574 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3837be95-c8cc-4c00-903f-4505a542dc68 tempest-ServersTestFqdnHostnames-400258971 tempest-ServersTestFqdnHostnames-400258971-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:12.281331 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3837be95-c8cc-4c00-903f-4505a542dc68 tempest-ServersTestFqdnHostnames-400258971 tempest-ServersTestFqdnHostnames-400258971-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:12.282279 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3837be95-c8cc-4c00-903f-4505a542dc68 tempest-ServersTestFqdnHostnames-400258971 tempest-ServersTestFqdnHostnames-400258971-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:12.282913 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3837be95-c8cc-4c00-903f-4505a542dc68 tempest-ServersTestFqdnHostnames-400258971 tempest-ServersTestFqdnHostnames-400258971-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:12.283636 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3837be95-c8cc-4c00-903f-4505a542dc68 tempest-ServersTestFqdnHostnames-400258971 tempest-ServersTestFqdnHostnames-400258971-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:12.782083 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-3837be95-c8cc-4c00-903f-4505a542dc68 tempest-ServersTestFqdnHostnames-400258971 tempest-ServersTestFqdnHostnames-400258971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02fdeda494a547f1a8714007e05e874d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b75771ecf442919c647f15d499880e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:56:12.801238 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-3837be95-c8cc-4c00-903f-4505a542dc68 tempest-ServersTestFqdnHostnames-400258971 tempest-ServersTestFqdnHostnames-400258971-project] 10.222.0.18 "GET /compute/v2.1/servers/78aef3f6-9cff-4db4-95c1-f0d5480b7a3c" status: 200 len: 1539 microversion: 2.1 time: 0.568206 Oct 22 20:56:12.802345 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 916/1739] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:56:12 2022] GET /compute/v2.1/servers/78aef3f6-9cff-4db4-95c1-f0d5480b7a3c => generated 1539 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:56:12.807278 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-e0408076-afe8-4853-9594-6678d885e42b tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:56:12.813502 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-e0408076-afe8-4853-9594-6678d885e42b tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] [instance: 8f2e1da0-4586-460b-94dc-768fd618dc3d] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:56:12.825897 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e0408076-afe8-4853-9594-6678d885e42b tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:12.826854 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e0408076-afe8-4853-9594-6678d885e42b tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:12.828077 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e0408076-afe8-4853-9594-6678d885e42b tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:12.831001 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e0408076-afe8-4853-9594-6678d885e42b tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:12.832501 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e0408076-afe8-4853-9594-6678d885e42b tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:12.835596 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e0408076-afe8-4853-9594-6678d885e42b tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:12.896285 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e0408076-afe8-4853-9594-6678d885e42b tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:12.897179 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e0408076-afe8-4853-9594-6678d885e42b tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:12.897908 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e0408076-afe8-4853-9594-6678d885e42b tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:12.898587 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.objects.instance [None req-e0408076-afe8-4853-9594-6678d885e42b tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lazy-loading 'fault' on Instance uuid 8f2e1da0-4586-460b-94dc-768fd618dc3d {{(pid=138745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 20:56:13.360142 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-e0408076-afe8-4853-9594-6678d885e42b tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c87f0356ca346f39c6216393d85da2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee8c8f7fc4e12bc1f9fcce3e7b581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:56:13.368888 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-e0408076-afe8-4853-9594-6678d885e42b tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] 10.222.0.18 "GET /compute/v2.1/servers/8f2e1da0-4586-460b-94dc-768fd618dc3d" status: 200 len: 1323 microversion: 2.1 time: 0.565250 Oct 22 20:56:13.374931 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 917/1740] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:56:12 2022] GET /compute/v2.1/servers/8f2e1da0-4586-460b-94dc-768fd618dc3d => generated 1323 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:56:13.387431 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-f5dbf470-9433-4a49-b5e7-ac6c23522f46 req-8a16d3b8-6da7-447e-aa2b-5bd6626d3587 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29a351ac-ecf5-4b11-9bdd-f1c93df1335a", "tag": "07fb8283-cc10-46e3-bd70-2c1e5b8c3aef"}, {"server_uuid": "8f2e1da0-4586-460b-94dc-768fd618dc3d", "name": "network-vif-deleted", "tag": "4a4fea07-50e9-4003-ba39-6badf338429d"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:56:13.402105 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-f5dbf470-9433-4a49-b5e7-ac6c23522f46 req-8a16d3b8-6da7-447e-aa2b-5bd6626d3587 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:13.403089 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-f5dbf470-9433-4a49-b5e7-ac6c23522f46 req-8a16d3b8-6da7-447e-aa2b-5bd6626d3587 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:13.405033 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-f5dbf470-9433-4a49-b5e7-ac6c23522f46 req-8a16d3b8-6da7-447e-aa2b-5bd6626d3587 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:13.436305 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-f5dbf470-9433-4a49-b5e7-ac6c23522f46 req-8a16d3b8-6da7-447e-aa2b-5bd6626d3587 service nova] Creating event network-changed:07fb8283-cc10-46e3-bd70-2c1e5b8c3aef for instance 29a351ac-ecf5-4b11-9bdd-f1c93df1335a on nch2-master-1 Oct 22 20:56:13.436305 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-f5dbf470-9433-4a49-b5e7-ac6c23522f46 req-8a16d3b8-6da7-447e-aa2b-5bd6626d3587 service nova] Creating event network-vif-deleted:4a4fea07-50e9-4003-ba39-6badf338429d for instance 8f2e1da0-4586-460b-94dc-768fd618dc3d on nch2-master-1 Oct 22 20:56:13.447036 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-f5dbf470-9433-4a49-b5e7-ac6c23522f46 req-8a16d3b8-6da7-447e-aa2b-5bd6626d3587 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.070282 Oct 22 20:56:13.453011 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 918/1741] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:56:13 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:56:13.477612 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-5d34c72d-06a2-4db5-823e-0a2778a94de0 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:56:13.478345 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-5d34c72d-06a2-4db5-823e-0a2778a94de0 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] [instance: df5f7e8f-5ed6-4ad6-9bcb-eaa54b4ee320] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:56:13.495172 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5d34c72d-06a2-4db5-823e-0a2778a94de0 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:13.495709 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5d34c72d-06a2-4db5-823e-0a2778a94de0 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:13.496152 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5d34c72d-06a2-4db5-823e-0a2778a94de0 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:13.496893 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5d34c72d-06a2-4db5-823e-0a2778a94de0 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:13.497335 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5d34c72d-06a2-4db5-823e-0a2778a94de0 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:13.497766 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5d34c72d-06a2-4db5-823e-0a2778a94de0 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:13.766748 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.network.neutron [None req-4f913959-5c42-4dda-a3d4-a5261c9432c4 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] [instance: 29a351ac-ecf5-4b11-9bdd-f1c93df1335a] Updating instance_info_cache with network_info: [{"id": "07fb8283-cc10-46e3-bd70-2c1e5b8c3aef", "address": "fa:16:3e:7a:11:63", "network": {"id": "ba2fbd7d-5bd8-4316-b6a5-ea0e685a80cc", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1738311782-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "42111ed6bcc3465d8c1f5291da248e74", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap07fb8283-cc", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=138744) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 22 20:56:13.788469 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4f913959-5c42-4dda-a3d4-a5261c9432c4 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Releasing lock "refresh_cache-29a351ac-ecf5-4b11-9bdd-f1c93df1335a" {{(pid=138744) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 22 20:56:13.790397 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-4f913959-5c42-4dda-a3d4-a5261c9432c4 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] 10.222.0.18 "POST /compute/v2.1/servers/29a351ac-ecf5-4b11-9bdd-f1c93df1335a/action" status: 202 len: 0 microversion: 2.1 time: 4.756704 Oct 22 20:56:13.792139 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 824/1742] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 20:56:09 2022] POST /compute/v2.1/servers/29a351ac-ecf5-4b11-9bdd-f1c93df1335a/action => generated 0 bytes in 4759 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 22 20:56:13.808553 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-a47d0b83-eef3-49e3-92a7-22077b73d5e3 tempest-ServersTestFqdnHostnames-400258971 tempest-ServersTestFqdnHostnames-400258971-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:56:13.809551 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-a47d0b83-eef3-49e3-92a7-22077b73d5e3 tempest-ServersTestFqdnHostnames-400258971 tempest-ServersTestFqdnHostnames-400258971-project] [instance: 78aef3f6-9cff-4db4-95c1-f0d5480b7a3c] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:56:13.819846 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-5d34c72d-06a2-4db5-823e-0a2778a94de0 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e787e0b494764176a0f13d75c47d77fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '371ecb87e8d34859971be23c1a1bc443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:56:13.824079 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a47d0b83-eef3-49e3-92a7-22077b73d5e3 tempest-ServersTestFqdnHostnames-400258971 tempest-ServersTestFqdnHostnames-400258971-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:13.824586 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a47d0b83-eef3-49e3-92a7-22077b73d5e3 tempest-ServersTestFqdnHostnames-400258971 tempest-ServersTestFqdnHostnames-400258971-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:13.825514 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a47d0b83-eef3-49e3-92a7-22077b73d5e3 tempest-ServersTestFqdnHostnames-400258971 tempest-ServersTestFqdnHostnames-400258971-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:13.826413 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a47d0b83-eef3-49e3-92a7-22077b73d5e3 tempest-ServersTestFqdnHostnames-400258971 tempest-ServersTestFqdnHostnames-400258971-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:13.826885 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a47d0b83-eef3-49e3-92a7-22077b73d5e3 tempest-ServersTestFqdnHostnames-400258971 tempest-ServersTestFqdnHostnames-400258971-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:13.827520 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a47d0b83-eef3-49e3-92a7-22077b73d5e3 tempest-ServersTestFqdnHostnames-400258971 tempest-ServersTestFqdnHostnames-400258971-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:13.836280 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-5d34c72d-06a2-4db5-823e-0a2778a94de0 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] 10.222.0.18 "GET /compute/v2.1/servers/df5f7e8f-5ed6-4ad6-9bcb-eaa54b4ee320" status: 200 len: 1320 microversion: 2.1 time: 0.381628 Oct 22 20:56:13.857888 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 919/1743] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:56:13 2022] GET /compute/v2.1/servers/df5f7e8f-5ed6-4ad6-9bcb-eaa54b4ee320 => generated 1320 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:56:13.869645 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-d1e68917-8eb5-4f3b-ab60-cb5318315c84 req-8baf17ef-1991-44dc-98f4-8bec8b8d5c56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28c2b09f-e43f-472b-b8db-f407c341acfd", "name": "network-vif-plugged", "status": "completed", "tag": "e6478c54-1e5c-45df-8338-b5b4413b28b0"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:56:13.886426 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-d1e68917-8eb5-4f3b-ab60-cb5318315c84 req-8baf17ef-1991-44dc-98f4-8bec8b8d5c56 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:13.886923 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-d1e68917-8eb5-4f3b-ab60-cb5318315c84 req-8baf17ef-1991-44dc-98f4-8bec8b8d5c56 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:13.887394 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-d1e68917-8eb5-4f3b-ab60-cb5318315c84 req-8baf17ef-1991-44dc-98f4-8bec8b8d5c56 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:13.901953 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-d1e68917-8eb5-4f3b-ab60-cb5318315c84 req-8baf17ef-1991-44dc-98f4-8bec8b8d5c56 service nova] Creating event network-vif-plugged:e6478c54-1e5c-45df-8338-b5b4413b28b0 for instance 28c2b09f-e43f-472b-b8db-f407c341acfd on nch1-master-1 Oct 22 20:56:13.907073 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-d1e68917-8eb5-4f3b-ab60-cb5318315c84 req-8baf17ef-1991-44dc-98f4-8bec8b8d5c56 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047647 Oct 22 20:56:13.908401 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 920/1744] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:56:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:56:13.914190 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-9c27d42b-00fa-4890-9a08-626da03a7b76 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:56:13.915158 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-9c27d42b-00fa-4890-9a08-626da03a7b76 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] [instance: 98f48cb1-54ed-4e82-8a25-fd004ddb5758] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:56:13.920712 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell0:SELECT=4 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:56:13.922583 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9c27d42b-00fa-4890-9a08-626da03a7b76 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:13.923263 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9c27d42b-00fa-4890-9a08-626da03a7b76 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:13.924057 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9c27d42b-00fa-4890-9a08-626da03a7b76 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:13.925328 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9c27d42b-00fa-4890-9a08-626da03a7b76 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:13.926037 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9c27d42b-00fa-4890-9a08-626da03a7b76 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:13.926714 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9c27d42b-00fa-4890-9a08-626da03a7b76 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:13.997292 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-a47d0b83-eef3-49e3-92a7-22077b73d5e3 tempest-ServersTestFqdnHostnames-400258971 tempest-ServersTestFqdnHostnames-400258971-project] 10.222.0.18 "GET /compute/v2.1/servers/78aef3f6-9cff-4db4-95c1-f0d5480b7a3c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.203639 Oct 22 20:56:13.999628 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 825/1745] 10.222.0.18 () {58 vars in 1275 bytes} [Sat Oct 22 20:56:13 2022] GET /compute/v2.1/servers/78aef3f6-9cff-4db4-95c1-f0d5480b7a3c/os-interface => generated 284 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:56:14.005218 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-ef00090e-fd8c-454f-bcae-35b329744d46 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:56:14.006875 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-ef00090e-fd8c-454f-bcae-35b329744d46 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] [instance: 532d6e6a-71ab-4ef0-a5bf-c042055c5121] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:56:14.014560 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ef00090e-fd8c-454f-bcae-35b329744d46 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:14.015473 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ef00090e-fd8c-454f-bcae-35b329744d46 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:14.016385 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ef00090e-fd8c-454f-bcae-35b329744d46 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:14.017366 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ef00090e-fd8c-454f-bcae-35b329744d46 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:14.018350 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ef00090e-fd8c-454f-bcae-35b329744d46 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:14.018851 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ef00090e-fd8c-454f-bcae-35b329744d46 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:14.034687 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-ef00090e-fd8c-454f-bcae-35b329744d46 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] HTTP exception thrown: Instance 532d6e6a-71ab-4ef0-a5bf-c042055c5121 could not be found. Oct 22 20:56:14.037265 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-ef00090e-fd8c-454f-bcae-35b329744d46 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Request method failure captured: Oct 22 20:56:14.037265 ncdv-master-1 devstack@n-api.service[138744]: request: DELETE /compute/v2.1/servers/532d6e6a-71ab-4ef0-a5bf-c042055c5121 HTTP/1.1 Oct 22 20:56:14.037265 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 20:56:14.037265 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 20:56:14.037265 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 20:56:14.037265 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 0 Oct 22 20:56:14.037265 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 20:56:14.037265 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 20:56:14.037265 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 20:56:14.037265 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 20:56:14.037265 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVFiCX4qi1toITSNXXZAA4zJRL4Z-tEaLsPig7vwCIxFzHhgpfZzKEZgzHRjqoMZPu5dyrSuPgrW5CAgewXSUJpj2NyXzw_QN2lPPiKoYaJrXQqGbBy3YIoLoq2X1cQW9oGz__9NYXLj4hRYCsg2qiZ71RuufQk6o4LVHRRj38STOBi8 Oct 22 20:56:14.037265 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 20:56:14.037265 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 20:56:14.037265 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 20:56:14.037265 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 20:56:14.037265 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 20:56:14.037265 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 20:56:14.037265 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: 42111ed6bcc3465d8c1f5291da248e74 Oct 22 20:56:14.037265 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-462023843 Oct 22 20:56:14.037265 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 20:56:14.037265 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 20:56:14.037265 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_42111ed6bcc3465d8c1f5291da248e74"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/42111ed6bcc3465d8c1f5291da248e74"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/42111ed6bcc3465d8c1f5291da248e74"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/42111ed6bcc3465d8c1f5291da248e74"}]}] Oct 22 20:56:14.037265 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-462023843 Oct 22 20:56:14.037265 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: 42111ed6bcc3465d8c1f5291da248e74 Oct 22 20:56:14.037265 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-462023843 Oct 22 20:56:14.037265 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-FloatingIPsAssociationTestJSON-462023843-project Oct 22 20:56:14.037265 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 20:56:14.037265 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 20:56:14.037265 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: 5be93cabff0d46ccb2a3db0db1a13796 Oct 22 20:56:14.037265 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-462023843-project Oct 22 20:56:14.037265 ncdv-master-1 devstack@n-api.service[138744]: method: > Oct 22 20:56:14.037265 ncdv-master-1 devstack@n-api.service[138744]: exception: Instance 532d6e6a-71ab-4ef0-a5bf-c042055c5121 could not be found. Oct 22 20:56:14.037265 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': '532d6e6a-71ab-4ef0-a5bf-c042055c5121'} Oct 22 20:56:14.037265 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:56:14.037265 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:56:14.037265 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 20:56:14.037265 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 20:56:14.037265 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 20:56:14.037265 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 20:56:14.037265 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 20:56:14.037265 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 20:56:14.037265 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 20:56:14.037265 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 20:56:14.037265 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 532d6e6a-71ab-4ef0-a5bf-c042055c5121 could not be found. Oct 22 20:56:14.037265 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:56:14.037265 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:56:14.037265 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:56:14.037265 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:56:14.037265 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:56:14.037265 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:56:14.037265 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:56:14.037265 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:56:14.037265 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:56:14.037265 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:56:14.037265 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 22 20:56:14.037265 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 22 20:56:14.037265 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 22 20:56:14.037265 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 22 20:56:14.037265 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 20:56:14.037265 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 20:56:14.037265 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 20:56:14.037265 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 20:56:14.043218 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 532d6e6a-71ab-4ef0-a5bf-c042055c5121 could not be found. Oct 22 20:56:14.043218 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:56:14.043218 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:56:14.043218 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:56:14.043218 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:56:14.043218 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:56:14.043218 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:56:14.043218 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 20:56:14.043218 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 20:56:14.043218 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 532d6e6a-71ab-4ef0-a5bf-c042055c5121 could not be found. Oct 22 20:56:14.043218 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:56:14.043218 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-ef00090e-fd8c-454f-bcae-35b329744d46 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Returning 404 to user: Instance 532d6e6a-71ab-4ef0-a5bf-c042055c5121 could not be found. {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:56:14.043218 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-ef00090e-fd8c-454f-bcae-35b329744d46 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] 10.222.0.18 "DELETE /compute/v2.1/servers/532d6e6a-71ab-4ef0-a5bf-c042055c5121" status: 404 len: 111 microversion: 2.1 time: 0.038273 Oct 22 20:56:14.045131 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 826/1746] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 20:56:13 2022] DELETE /compute/v2.1/servers/532d6e6a-71ab-4ef0-a5bf-c042055c5121 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 20:56:14.052514 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-05f7fda2-21a0-4684-987a-c49b195f0c48 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:56:14.057366 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-05f7fda2-21a0-4684-987a-c49b195f0c48 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] [instance: 532d6e6a-71ab-4ef0-a5bf-c042055c5121] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:56:14.070723 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-05f7fda2-21a0-4684-987a-c49b195f0c48 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:14.071172 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-05f7fda2-21a0-4684-987a-c49b195f0c48 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:14.071726 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-05f7fda2-21a0-4684-987a-c49b195f0c48 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:14.072448 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-05f7fda2-21a0-4684-987a-c49b195f0c48 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:14.072908 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-05f7fda2-21a0-4684-987a-c49b195f0c48 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:14.074028 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-05f7fda2-21a0-4684-987a-c49b195f0c48 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:14.091014 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-05f7fda2-21a0-4684-987a-c49b195f0c48 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] HTTP exception thrown: Instance 532d6e6a-71ab-4ef0-a5bf-c042055c5121 could not be found. Oct 22 20:56:14.092992 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-05f7fda2-21a0-4684-987a-c49b195f0c48 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Request method failure captured: Oct 22 20:56:14.092992 ncdv-master-1 devstack@n-api.service[138744]: request: GET /compute/v2.1/servers/532d6e6a-71ab-4ef0-a5bf-c042055c5121 HTTP/1.1 Oct 22 20:56:14.092992 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 20:56:14.092992 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 20:56:14.092992 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 20:56:14.092992 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 0 Oct 22 20:56:14.092992 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 20:56:14.092992 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 20:56:14.092992 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 20:56:14.092992 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 20:56:14.092992 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVFiCX4qi1toITSNXXZAA4zJRL4Z-tEaLsPig7vwCIxFzHhgpfZzKEZgzHRjqoMZPu5dyrSuPgrW5CAgewXSUJpj2NyXzw_QN2lPPiKoYaJrXQqGbBy3YIoLoq2X1cQW9oGz__9NYXLj4hRYCsg2qiZ71RuufQk6o4LVHRRj38STOBi8 Oct 22 20:56:14.092992 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 20:56:14.092992 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 20:56:14.092992 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 20:56:14.092992 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 20:56:14.092992 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 20:56:14.092992 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 20:56:14.092992 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: 42111ed6bcc3465d8c1f5291da248e74 Oct 22 20:56:14.092992 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-462023843 Oct 22 20:56:14.092992 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 20:56:14.092992 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 20:56:14.092992 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_42111ed6bcc3465d8c1f5291da248e74"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/42111ed6bcc3465d8c1f5291da248e74"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/42111ed6bcc3465d8c1f5291da248e74"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/42111ed6bcc3465d8c1f5291da248e74"}]}] Oct 22 20:56:14.092992 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-462023843 Oct 22 20:56:14.092992 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: 42111ed6bcc3465d8c1f5291da248e74 Oct 22 20:56:14.092992 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-462023843 Oct 22 20:56:14.092992 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-FloatingIPsAssociationTestJSON-462023843-project Oct 22 20:56:14.092992 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 20:56:14.092992 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 20:56:14.092992 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: 5be93cabff0d46ccb2a3db0db1a13796 Oct 22 20:56:14.092992 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-462023843-project Oct 22 20:56:14.092992 ncdv-master-1 devstack@n-api.service[138744]: method: > Oct 22 20:56:14.092992 ncdv-master-1 devstack@n-api.service[138744]: exception: Instance 532d6e6a-71ab-4ef0-a5bf-c042055c5121 could not be found. Oct 22 20:56:14.092992 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': '532d6e6a-71ab-4ef0-a5bf-c042055c5121'} Oct 22 20:56:14.092992 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:56:14.092992 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:56:14.092992 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 20:56:14.092992 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 20:56:14.092992 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 20:56:14.092992 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 20:56:14.092992 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 20:56:14.092992 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 20:56:14.092992 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 20:56:14.092992 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 20:56:14.092992 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 532d6e6a-71ab-4ef0-a5bf-c042055c5121 could not be found. Oct 22 20:56:14.092992 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:56:14.092992 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:56:14.092992 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:56:14.092992 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:56:14.092992 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:56:14.092992 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:56:14.092992 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:56:14.092992 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:56:14.092992 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:56:14.092992 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:56:14.092992 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 20:56:14.092992 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 20:56:14.092992 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 20:56:14.092992 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 20:56:14.092992 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 20:56:14.092992 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 20:56:14.092992 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 532d6e6a-71ab-4ef0-a5bf-c042055c5121 could not be found. Oct 22 20:56:14.092992 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:56:14.092992 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:56:14.098457 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:56:14.098457 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:56:14.098457 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:56:14.098457 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:56:14.098457 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 20:56:14.098457 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 20:56:14.098457 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 532d6e6a-71ab-4ef0-a5bf-c042055c5121 could not be found. Oct 22 20:56:14.098457 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:56:14.101469 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-05f7fda2-21a0-4684-987a-c49b195f0c48 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Returning 404 to user: Instance 532d6e6a-71ab-4ef0-a5bf-c042055c5121 could not be found. {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:56:14.102635 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-05f7fda2-21a0-4684-987a-c49b195f0c48 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] 10.222.0.18 "GET /compute/v2.1/servers/532d6e6a-71ab-4ef0-a5bf-c042055c5121" status: 404 len: 111 microversion: 2.1 time: 0.057739 Oct 22 20:56:14.103826 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 827/1747] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:56:14 2022] GET /compute/v2.1/servers/532d6e6a-71ab-4ef0-a5bf-c042055c5121 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 20:56:14.112782 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-860817e4-a60c-4201-b13f-386620531ee8 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Calling method '.version_select at 0x7fd39f88f3a0>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:56:14.251699 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-9c27d42b-00fa-4890-9a08-626da03a7b76 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d3d7458af447bdb3f03e83a2d8559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49238b8686d24ae698679e4a1957735d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:56:14.268078 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-9c27d42b-00fa-4890-9a08-626da03a7b76 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] 10.222.0.18 "GET /compute/v2.1/servers/98f48cb1-54ed-4e82-8a25-fd004ddb5758" status: 200 len: 1474 microversion: 2.1 time: 0.357370 Oct 22 20:56:14.269344 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 921/1748] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:56:13 2022] GET /compute/v2.1/servers/98f48cb1-54ed-4e82-8a25-fd004ddb5758 => generated 1474 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:56:14.405213 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-c1879dc4-16ed-4933-af51-b1bf0693294e tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:56:14.407579 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-c1879dc4-16ed-4933-af51-b1bf0693294e tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] [instance: 8f2e1da0-4586-460b-94dc-768fd618dc3d] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:56:14.421817 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c1879dc4-16ed-4933-af51-b1bf0693294e tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:14.422446 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c1879dc4-16ed-4933-af51-b1bf0693294e tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:14.423028 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c1879dc4-16ed-4933-af51-b1bf0693294e tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:14.424253 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c1879dc4-16ed-4933-af51-b1bf0693294e tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:14.424927 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c1879dc4-16ed-4933-af51-b1bf0693294e tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:14.425590 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c1879dc4-16ed-4933-af51-b1bf0693294e tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:14.463070 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.wsgi [None req-c1879dc4-16ed-4933-af51-b1bf0693294e tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] HTTP exception thrown: Instance 8f2e1da0-4586-460b-94dc-768fd618dc3d could not be found. Oct 22 20:56:14.468842 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-c1879dc4-16ed-4933-af51-b1bf0693294e tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Request method failure captured: Oct 22 20:56:14.468842 ncdv-master-1 devstack@n-api.service[138745]: request: GET /compute/v2.1/servers/8f2e1da0-4586-460b-94dc-768fd618dc3d HTTP/1.1 Oct 22 20:56:14.468842 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 20:56:14.468842 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 20:56:14.468842 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 20:56:14.468842 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 0 Oct 22 20:56:14.468842 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 20:56:14.468842 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 20:56:14.468842 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 20:56:14.468842 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 20:56:14.468842 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVFd3L1O9buG2NKok4Z3OhlPg9uJowRL-QIrWO2UXrdAMWoEA07U7Qwd3UcRw5_kRV78yVlG8-xf-9bQgrD-lSc6Kuqan6Pt9NTBZahyGUD3ZZ-4gkCHlC4kIKTqF1xcLu4qJCXK_NR7T7vH-rSU8EgD59OAikcfPJ0amh6d8LDt5JQQ Oct 22 20:56:14.468842 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 20:56:14.468842 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 20:56:14.468842 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 20:56:14.468842 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 20:56:14.468842 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 20:56:14.468842 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 20:56:14.468842 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: 9f0ee8c8f7fc4e12bc1f9fcce3e7b581 Oct 22 20:56:14.468842 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-LiveMigrationTest-26615209 Oct 22 20:56:14.468842 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 20:56:14.468842 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 20:56:14.468842 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_9f0ee8c8f7fc4e12bc1f9fcce3e7b581"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9f0ee8c8f7fc4e12bc1f9fcce3e7b581"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/9f0ee8c8f7fc4e12bc1f9fcce3e7b581"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9f0ee8c8f7fc4e12bc1f9fcce3e7b581"}]}] Oct 22 20:56:14.468842 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-LiveMigrationTest-26615209 Oct 22 20:56:14.468842 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: 9f0ee8c8f7fc4e12bc1f9fcce3e7b581 Oct 22 20:56:14.468842 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-LiveMigrationTest-26615209 Oct 22 20:56:14.468842 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-LiveMigrationTest-26615209-project Oct 22 20:56:14.468842 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 20:56:14.468842 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 20:56:14.468842 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: 2c87f0356ca346f39c6216393d85da2f Oct 22 20:56:14.468842 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-LiveMigrationTest-26615209-project Oct 22 20:56:14.468842 ncdv-master-1 devstack@n-api.service[138745]: method: > Oct 22 20:56:14.468842 ncdv-master-1 devstack@n-api.service[138745]: exception: Instance 8f2e1da0-4586-460b-94dc-768fd618dc3d could not be found. Oct 22 20:56:14.468842 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'id': '8f2e1da0-4586-460b-94dc-768fd618dc3d'} Oct 22 20:56:14.468842 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:56:14.468842 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:56:14.468842 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 20:56:14.468842 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 20:56:14.468842 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 20:56:14.468842 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 20:56:14.468842 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 20:56:14.468842 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 20:56:14.468842 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 20:56:14.468842 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 20:56:14.468842 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f2e1da0-4586-460b-94dc-768fd618dc3d could not be found. Oct 22 20:56:14.468842 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:56:14.468842 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:56:14.468842 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:56:14.468842 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:56:14.468842 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:56:14.468842 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:56:14.468842 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:56:14.468842 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:56:14.468842 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:56:14.468842 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:56:14.468842 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 20:56:14.468842 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 20:56:14.468842 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 20:56:14.468842 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 20:56:14.468842 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 20:56:14.468842 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 20:56:14.468842 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f2e1da0-4586-460b-94dc-768fd618dc3d could not be found. Oct 22 20:56:14.468842 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:56:14.468842 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:56:14.468842 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:56:14.473716 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:56:14.473716 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:56:14.473716 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:56:14.473716 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 20:56:14.473716 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 20:56:14.473716 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f2e1da0-4586-460b-94dc-768fd618dc3d could not be found. Oct 22 20:56:14.473716 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:56:14.480945 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-c1879dc4-16ed-4933-af51-b1bf0693294e tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Returning 404 to user: Instance 8f2e1da0-4586-460b-94dc-768fd618dc3d could not be found. {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:56:14.486278 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-c1879dc4-16ed-4933-af51-b1bf0693294e tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] 10.222.0.18 "GET /compute/v2.1/servers/8f2e1da0-4586-460b-94dc-768fd618dc3d" status: 404 len: 111 microversion: 2.1 time: 0.086042 Oct 22 20:56:14.487404 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 922/1749] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:56:14 2022] GET /compute/v2.1/servers/8f2e1da0-4586-460b-94dc-768fd618dc3d => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 20:56:14.512311 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-10cda9d6-c903-466f-b728-274711ce1b24 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Calling method '.version_select at 0x7fd39fcddd30>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:56:14.554574 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-10cda9d6-c903-466f-b728-274711ce1b24 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-319074667" status: 202 len: 0 microversion: 2.1 time: 0.052628 Oct 22 20:56:14.556300 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 923/1750] 10.222.0.18 () {58 vars in 1218 bytes} [Sat Oct 22 20:56:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-319074667 => generated 0 bytes in 62 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 20:56:14.780310 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-f36d697f-d076-4269-b425-9e7eb8b1890a tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-949409327", "imageRef": "085e4478-6edc-4a69-8e08-f9831713eb65", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:56:14.855450 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.network.neutron [None req-f36d697f-d076-4269-b425-9e7eb8b1890a tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] validate_networks() for [('14f6a6b1-55b6-42d0-a3eb-c2e4d989429e', None, None, None, None, None)] {{(pid=138745) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 20:56:16.980232 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell0:SELECT=16 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:56:17.262625 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-f36d697f-d076-4269-b425-9e7eb8b1890a tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Flavor limits 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 20:56:17.263930 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-f36d697f-d076-4269-b425-9e7eb8b1890a tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Image limits 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 20:56:17.264662 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-f36d697f-d076-4269-b425-9e7eb8b1890a tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Flavor pref 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 20:56:17.265385 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-f36d697f-d076-4269-b425-9e7eb8b1890a tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Image pref 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 20:56:17.266662 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-f36d697f-d076-4269-b425-9e7eb8b1890a tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 20:56:17.289772 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f36d697f-d076-4269-b425-9e7eb8b1890a tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:17.294138 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f36d697f-d076-4269-b425-9e7eb8b1890a tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:17.295002 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f36d697f-d076-4269-b425-9e7eb8b1890a tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:17.296117 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f36d697f-d076-4269-b425-9e7eb8b1890a tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:17.296768 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f36d697f-d076-4269-b425-9e7eb8b1890a tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:17.297195 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f36d697f-d076-4269-b425-9e7eb8b1890a tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:17.340447 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-f36d697f-d076-4269-b425-9e7eb8b1890a tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Getting quotas for project 594624ed28aa433d907c8833d360b82e. Resources: {'cores', 'instances', 'ram'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 20:56:17.352947 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-860817e4-a60c-4201-b13f-386620531ee8 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] 10.222.0.18 "DELETE /compute/v2.1/os-floating-ips/af6594f3-fc4d-4e50-8065-37150f5c810c" status: 202 len: 0 microversion: 2.1 time: 3.245273 Oct 22 20:56:17.353775 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 828/1751] 10.222.0.18 () {58 vars in 1263 bytes} [Sat Oct 22 20:56:14 2022] DELETE /compute/v2.1/os-floating-ips/af6594f3-fc4d-4e50-8065-37150f5c810c => generated 0 bytes in 3247 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 20:56:17.359491 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-f8d829aa-8460-4c42-bdae-0c9354ce4ca1 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:56:17.360328 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-f8d829aa-8460-4c42-bdae-0c9354ce4ca1 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] [instance: df5f7e8f-5ed6-4ad6-9bcb-eaa54b4ee320] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:56:17.364239 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-f36d697f-d076-4269-b425-9e7eb8b1890a tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Getting quotas for user b392ad1fe1fd4b2a9e6be03a7435deb9 and project 594624ed28aa433d907c8833d360b82e. Resources: {'cores', 'instances', 'ram'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 20:56:17.376732 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f8d829aa-8460-4c42-bdae-0c9354ce4ca1 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:17.377309 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f8d829aa-8460-4c42-bdae-0c9354ce4ca1 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:17.377763 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f8d829aa-8460-4c42-bdae-0c9354ce4ca1 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:17.382020 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f8d829aa-8460-4c42-bdae-0c9354ce4ca1 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:17.385206 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f8d829aa-8460-4c42-bdae-0c9354ce4ca1 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:17.385687 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f8d829aa-8460-4c42-bdae-0c9354ce4ca1 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:17.396339 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-f36d697f-d076-4269-b425-9e7eb8b1890a tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Going to run 1 instances... {{(pid=138745) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 20:56:17.400741 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-f36d697f-d076-4269-b425-9e7eb8b1890a tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] [instance: 3de7ee82-86b9-4c34-8b81-46f09d6239d0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='085e4478-6edc-4a69-8e08-f9831713eb65',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138745) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 20:56:17.572383 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-f36d697f-d076-4269-b425-9e7eb8b1890a tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.798489 Oct 22 20:56:17.573393 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 924/1752] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Oct 22 20:56:14 2022] POST /compute/v2.1/servers => generated 383 bytes in 2800 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 20:56:17.580178 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-276ff3ad-ebef-435a-82f4-21ddda3b5abd tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:56:17.581070 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-276ff3ad-ebef-435a-82f4-21ddda3b5abd tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] [instance: 98f48cb1-54ed-4e82-8a25-fd004ddb5758] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:56:17.588702 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-276ff3ad-ebef-435a-82f4-21ddda3b5abd tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:17.589642 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-276ff3ad-ebef-435a-82f4-21ddda3b5abd tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:17.590266 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-276ff3ad-ebef-435a-82f4-21ddda3b5abd tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:17.591203 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-276ff3ad-ebef-435a-82f4-21ddda3b5abd tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:17.591948 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-276ff3ad-ebef-435a-82f4-21ddda3b5abd tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:17.592553 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-276ff3ad-ebef-435a-82f4-21ddda3b5abd tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:18.037961 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-f8d829aa-8460-4c42-bdae-0c9354ce4ca1 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e787e0b494764176a0f13d75c47d77fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '371ecb87e8d34859971be23c1a1bc443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:56:18.053784 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-f8d829aa-8460-4c42-bdae-0c9354ce4ca1 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] 10.222.0.18 "GET /compute/v2.1/servers/df5f7e8f-5ed6-4ad6-9bcb-eaa54b4ee320" status: 200 len: 1320 microversion: 2.1 time: 0.697285 Oct 22 20:56:18.056770 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 829/1753] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:56:17 2022] GET /compute/v2.1/servers/df5f7e8f-5ed6-4ad6-9bcb-eaa54b4ee320 => generated 1320 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:56:18.066203 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-1fdef6d7-3016-468c-a749-297344b4f637 req-20c74b5d-bc27-4926-b1e6-b4773e6ac765 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5db8404-7c9d-41d4-a018-a27058378d35", "name": "network-vif-plugged", "status": "completed", "tag": "cb9e18be-499d-410c-bbe2-d450122802d7"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:56:18.082726 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-1fdef6d7-3016-468c-a749-297344b4f637 req-20c74b5d-bc27-4926-b1e6-b4773e6ac765 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:18.084851 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-1fdef6d7-3016-468c-a749-297344b4f637 req-20c74b5d-bc27-4926-b1e6-b4773e6ac765 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:18.087320 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-1fdef6d7-3016-468c-a749-297344b4f637 req-20c74b5d-bc27-4926-b1e6-b4773e6ac765 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:18.115322 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-1fdef6d7-3016-468c-a749-297344b4f637 req-20c74b5d-bc27-4926-b1e6-b4773e6ac765 service nova] Creating event network-vif-plugged:cb9e18be-499d-410c-bbe2-d450122802d7 for instance c5db8404-7c9d-41d4-a018-a27058378d35 on nch2-master-1 Oct 22 20:56:18.126600 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-1fdef6d7-3016-468c-a749-297344b4f637 req-20c74b5d-bc27-4926-b1e6-b4773e6ac765 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064929 Oct 22 20:56:18.128680 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 830/1754] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:56:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:56:18.136230 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-67d44428-1115-4d5a-b284-c78de6e7b49b req-080ba834-a223-4052-9972-b979114a77f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df5f7e8f-5ed6-4ad6-9bcb-eaa54b4ee320", "tag": "4ddf90b6-ac04-4e00-bc1f-0e465ebdb869"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:56:18.149688 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-67d44428-1115-4d5a-b284-c78de6e7b49b req-080ba834-a223-4052-9972-b979114a77f5 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:18.150640 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-67d44428-1115-4d5a-b284-c78de6e7b49b req-080ba834-a223-4052-9972-b979114a77f5 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:18.151494 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-67d44428-1115-4d5a-b284-c78de6e7b49b req-080ba834-a223-4052-9972-b979114a77f5 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:18.174503 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:56:18.193895 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-67d44428-1115-4d5a-b284-c78de6e7b49b req-080ba834-a223-4052-9972-b979114a77f5 service nova] Creating event network-changed:4ddf90b6-ac04-4e00-bc1f-0e465ebdb869 for instance df5f7e8f-5ed6-4ad6-9bcb-eaa54b4ee320 on nch2-master-1 Oct 22 20:56:18.219913 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-67d44428-1115-4d5a-b284-c78de6e7b49b req-080ba834-a223-4052-9972-b979114a77f5 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080643 Oct 22 20:56:18.221690 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 831/1755] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:56:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:56:18.241335 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-6b845636-031f-4028-a236-198165501fd5 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:56:18.244063 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-6b845636-031f-4028-a236-198165501fd5 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] [instance: 29a351ac-ecf5-4b11-9bdd-f1c93df1335a] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:56:18.244538 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-276ff3ad-ebef-435a-82f4-21ddda3b5abd tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d3d7458af447bdb3f03e83a2d8559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49238b8686d24ae698679e4a1957735d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:56:18.259704 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-276ff3ad-ebef-435a-82f4-21ddda3b5abd tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] 10.222.0.18 "GET /compute/v2.1/servers/98f48cb1-54ed-4e82-8a25-fd004ddb5758" status: 200 len: 1474 microversion: 2.1 time: 0.685091 Oct 22 20:56:18.263821 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 925/1756] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:56:17 2022] GET /compute/v2.1/servers/98f48cb1-54ed-4e82-8a25-fd004ddb5758 => generated 1474 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:56:18.265654 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6b845636-031f-4028-a236-198165501fd5 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:18.267369 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6b845636-031f-4028-a236-198165501fd5 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:18.269558 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6b845636-031f-4028-a236-198165501fd5 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:18.273230 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6b845636-031f-4028-a236-198165501fd5 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:18.274049 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6b845636-031f-4028-a236-198165501fd5 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:18.275564 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6b845636-031f-4028-a236-198165501fd5 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:18.306251 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-5fae0e57-5851-4ef8-a6d0-20ba4dd1c3f2 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:56:18.306878 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-5fae0e57-5851-4ef8-a6d0-20ba4dd1c3f2 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] [instance: 3de7ee82-86b9-4c34-8b81-46f09d6239d0] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:56:18.358067 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:56:18.418798 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-6b845636-031f-4028-a236-198165501fd5 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] [instance: 29a351ac-ecf5-4b11-9bdd-f1c93df1335a] Going to try to terminate instance {{(pid=138744) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 20:56:18.699669 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-6b845636-031f-4028-a236-198165501fd5 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] 10.222.0.18 "DELETE /compute/v2.1/servers/29a351ac-ecf5-4b11-9bdd-f1c93df1335a" status: 204 len: 0 microversion: 2.1 time: 0.476057 Oct 22 20:56:18.700901 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 832/1757] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 20:56:18 2022] DELETE /compute/v2.1/servers/29a351ac-ecf5-4b11-9bdd-f1c93df1335a => generated 0 bytes in 478 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 20:56:18.716027 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-56d080a8-5105-4d5b-bd70-9cce6734a6cd tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:56:18.718345 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-56d080a8-5105-4d5b-bd70-9cce6734a6cd tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] [instance: 29a351ac-ecf5-4b11-9bdd-f1c93df1335a] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:56:18.740566 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-56d080a8-5105-4d5b-bd70-9cce6734a6cd tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:18.740966 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-56d080a8-5105-4d5b-bd70-9cce6734a6cd tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:18.741412 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-56d080a8-5105-4d5b-bd70-9cce6734a6cd tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:18.742131 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-56d080a8-5105-4d5b-bd70-9cce6734a6cd tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:18.742594 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-56d080a8-5105-4d5b-bd70-9cce6734a6cd tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:18.743024 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-56d080a8-5105-4d5b-bd70-9cce6734a6cd tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:18.790068 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-5fae0e57-5851-4ef8-a6d0-20ba4dd1c3f2 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b392ad1fe1fd4b2a9e6be03a7435deb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594624ed28aa433d907c8833d360b82e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:56:18.803536 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-5fae0e57-5851-4ef8-a6d0-20ba4dd1c3f2 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] 10.222.0.18 "GET /compute/v2.1/servers/3de7ee82-86b9-4c34-8b81-46f09d6239d0" status: 200 len: 1224 microversion: 2.1 time: 0.524276 Oct 22 20:56:18.806108 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 926/1758] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:56:18 2022] GET /compute/v2.1/servers/3de7ee82-86b9-4c34-8b81-46f09d6239d0 => generated 1224 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:56:18.819176 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-31ff5694-9121-4ec5-b985-97baac8e9fbb tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:56:18.820480 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-31ff5694-9121-4ec5-b985-97baac8e9fbb tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] [instance: 2f02a0ad-4856-4643-9e69-50547f5c7a98] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:56:18.843613 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-31ff5694-9121-4ec5-b985-97baac8e9fbb tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:18.844138 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-31ff5694-9121-4ec5-b985-97baac8e9fbb tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:18.844579 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-31ff5694-9121-4ec5-b985-97baac8e9fbb tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:18.845316 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-31ff5694-9121-4ec5-b985-97baac8e9fbb tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:18.845836 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-31ff5694-9121-4ec5-b985-97baac8e9fbb tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:18.846271 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-31ff5694-9121-4ec5-b985-97baac8e9fbb tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:18.905689 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-31ff5694-9121-4ec5-b985-97baac8e9fbb tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] [instance: 2f02a0ad-4856-4643-9e69-50547f5c7a98] Going to try to terminate instance {{(pid=138745) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 20:56:19.093253 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-31ff5694-9121-4ec5-b985-97baac8e9fbb tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] 10.222.0.18 "DELETE /compute/v2.1/servers/2f02a0ad-4856-4643-9e69-50547f5c7a98" status: 204 len: 0 microversion: 2.1 time: 0.283366 Oct 22 20:56:19.095170 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 927/1759] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 20:56:18 2022] DELETE /compute/v2.1/servers/2f02a0ad-4856-4643-9e69-50547f5c7a98 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 20:56:19.108759 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-b1e484b8-acb8-4ae3-9476-2b4610404cc0 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:56:19.115154 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-b1e484b8-acb8-4ae3-9476-2b4610404cc0 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] [instance: df5f7e8f-5ed6-4ad6-9bcb-eaa54b4ee320] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:56:19.131000 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b1e484b8-acb8-4ae3-9476-2b4610404cc0 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:19.132748 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b1e484b8-acb8-4ae3-9476-2b4610404cc0 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:19.135489 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b1e484b8-acb8-4ae3-9476-2b4610404cc0 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:19.136527 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b1e484b8-acb8-4ae3-9476-2b4610404cc0 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:19.137176 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b1e484b8-acb8-4ae3-9476-2b4610404cc0 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:19.137610 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b1e484b8-acb8-4ae3-9476-2b4610404cc0 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:19.271715 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-56d080a8-5105-4d5b-bd70-9cce6734a6cd tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be93cabff0d46ccb2a3db0db1a13796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42111ed6bcc3465d8c1f5291da248e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:56:19.294122 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-56d080a8-5105-4d5b-bd70-9cce6734a6cd tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] 10.222.0.18 "GET /compute/v2.1/servers/29a351ac-ecf5-4b11-9bdd-f1c93df1335a" status: 200 len: 1525 microversion: 2.1 time: 0.586935 Oct 22 20:56:19.295019 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 833/1760] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:56:18 2022] GET /compute/v2.1/servers/29a351ac-ecf5-4b11-9bdd-f1c93df1335a => generated 1525 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:56:19.300375 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-ea5d5444-4418-4b31-b3ab-e2c77552b8c0 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:56:19.301275 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-ea5d5444-4418-4b31-b3ab-e2c77552b8c0 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] [instance: 2f02a0ad-4856-4643-9e69-50547f5c7a98] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:56:19.310662 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ea5d5444-4418-4b31-b3ab-e2c77552b8c0 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:19.311426 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ea5d5444-4418-4b31-b3ab-e2c77552b8c0 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:19.312596 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ea5d5444-4418-4b31-b3ab-e2c77552b8c0 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:19.320384 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ea5d5444-4418-4b31-b3ab-e2c77552b8c0 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:19.321058 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ea5d5444-4418-4b31-b3ab-e2c77552b8c0 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:19.321663 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ea5d5444-4418-4b31-b3ab-e2c77552b8c0 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:19.633914 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-b1e484b8-acb8-4ae3-9476-2b4610404cc0 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e787e0b494764176a0f13d75c47d77fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '371ecb87e8d34859971be23c1a1bc443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:56:19.645320 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-b1e484b8-acb8-4ae3-9476-2b4610404cc0 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] 10.222.0.18 "GET /compute/v2.1/servers/df5f7e8f-5ed6-4ad6-9bcb-eaa54b4ee320" status: 200 len: 1320 microversion: 2.1 time: 0.543042 Oct 22 20:56:19.646218 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 928/1761] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:56:19 2022] GET /compute/v2.1/servers/df5f7e8f-5ed6-4ad6-9bcb-eaa54b4ee320 => generated 1320 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:56:19.680921 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-38d868b0-f99a-43c1-b2e7-9c84aeffc6ae tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:56:19.680921 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-38d868b0-f99a-43c1-b2e7-9c84aeffc6ae tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] [instance: 98f48cb1-54ed-4e82-8a25-fd004ddb5758] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:56:19.683584 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-38d868b0-f99a-43c1-b2e7-9c84aeffc6ae tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:19.684187 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-38d868b0-f99a-43c1-b2e7-9c84aeffc6ae tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:19.687322 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-38d868b0-f99a-43c1-b2e7-9c84aeffc6ae tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:19.688395 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-38d868b0-f99a-43c1-b2e7-9c84aeffc6ae tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:19.689031 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-38d868b0-f99a-43c1-b2e7-9c84aeffc6ae tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:19.690575 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-38d868b0-f99a-43c1-b2e7-9c84aeffc6ae tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:19.806086 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-ea5d5444-4418-4b31-b3ab-e2c77552b8c0 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c87f0356ca346f39c6216393d85da2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee8c8f7fc4e12bc1f9fcce3e7b581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:56:19.818093 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-ea5d5444-4418-4b31-b3ab-e2c77552b8c0 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] 10.222.0.18 "GET /compute/v2.1/servers/2f02a0ad-4856-4643-9e69-50547f5c7a98" status: 200 len: 1484 microversion: 2.1 time: 0.521764 Oct 22 20:56:19.832120 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 834/1762] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:56:19 2022] GET /compute/v2.1/servers/2f02a0ad-4856-4643-9e69-50547f5c7a98 => generated 1484 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:56:19.836800 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-892965c3-7ad3-4f28-b53a-aabfff8bf464 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:56:19.838291 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-892965c3-7ad3-4f28-b53a-aabfff8bf464 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] [instance: 3de7ee82-86b9-4c34-8b81-46f09d6239d0] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:56:19.851013 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-892965c3-7ad3-4f28-b53a-aabfff8bf464 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:19.852286 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-892965c3-7ad3-4f28-b53a-aabfff8bf464 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:19.852801 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-892965c3-7ad3-4f28-b53a-aabfff8bf464 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:19.853589 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-892965c3-7ad3-4f28-b53a-aabfff8bf464 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:19.854114 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-892965c3-7ad3-4f28-b53a-aabfff8bf464 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:19.854606 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-892965c3-7ad3-4f28-b53a-aabfff8bf464 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:20.038698 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-892965c3-7ad3-4f28-b53a-aabfff8bf464 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b392ad1fe1fd4b2a9e6be03a7435deb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594624ed28aa433d907c8833d360b82e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:56:20.058322 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-892965c3-7ad3-4f28-b53a-aabfff8bf464 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] 10.222.0.18 "GET /compute/v2.1/servers/3de7ee82-86b9-4c34-8b81-46f09d6239d0" status: 200 len: 1220 microversion: 2.1 time: 0.222124 Oct 22 20:56:20.060028 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 835/1763] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:56:19 2022] GET /compute/v2.1/servers/3de7ee82-86b9-4c34-8b81-46f09d6239d0 => generated 1220 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 20:56:20.258443 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-fea6d4b7-01f2-434b-a237-b211891875c9 req-b7a7add8-291f-4b59-9aca-e3aa83655863 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "78aef3f6-9cff-4db4-95c1-f0d5480b7a3c", "tag": "1b3feae7-78b5-47fa-a825-d1a96beffac1"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:56:20.285706 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-fea6d4b7-01f2-434b-a237-b211891875c9 req-b7a7add8-291f-4b59-9aca-e3aa83655863 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:20.292349 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-fea6d4b7-01f2-434b-a237-b211891875c9 req-b7a7add8-291f-4b59-9aca-e3aa83655863 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:20.293259 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-fea6d4b7-01f2-434b-a237-b211891875c9 req-b7a7add8-291f-4b59-9aca-e3aa83655863 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:20.331449 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-fea6d4b7-01f2-434b-a237-b211891875c9 req-b7a7add8-291f-4b59-9aca-e3aa83655863 service nova] Creating event network-changed:1b3feae7-78b5-47fa-a825-d1a96beffac1 for instance 78aef3f6-9cff-4db4-95c1-f0d5480b7a3c on nch1-master-1 Oct 22 20:56:20.348173 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-fea6d4b7-01f2-434b-a237-b211891875c9 req-b7a7add8-291f-4b59-9aca-e3aa83655863 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095837 Oct 22 20:56:20.355541 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 836/1764] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:56:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 20:56:20.368806 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-2931a6e4-3cac-4cb2-80b4-cb70fc22ea18 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:56:20.369966 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-2931a6e4-3cac-4cb2-80b4-cb70fc22ea18 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] [instance: 29a351ac-ecf5-4b11-9bdd-f1c93df1335a] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:56:20.393084 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2931a6e4-3cac-4cb2-80b4-cb70fc22ea18 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:20.394025 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2931a6e4-3cac-4cb2-80b4-cb70fc22ea18 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:20.394674 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2931a6e4-3cac-4cb2-80b4-cb70fc22ea18 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:20.395697 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2931a6e4-3cac-4cb2-80b4-cb70fc22ea18 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:20.396326 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2931a6e4-3cac-4cb2-80b4-cb70fc22ea18 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:20.396926 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2931a6e4-3cac-4cb2-80b4-cb70fc22ea18 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:20.615827 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-38d868b0-f99a-43c1-b2e7-9c84aeffc6ae tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d3d7458af447bdb3f03e83a2d8559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49238b8686d24ae698679e4a1957735d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:56:20.629583 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-38d868b0-f99a-43c1-b2e7-9c84aeffc6ae tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] 10.222.0.18 "GET /compute/v2.1/servers/98f48cb1-54ed-4e82-8a25-fd004ddb5758" status: 200 len: 1474 microversion: 2.1 time: 0.982087 Oct 22 20:56:20.635124 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 929/1765] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:56:19 2022] GET /compute/v2.1/servers/98f48cb1-54ed-4e82-8a25-fd004ddb5758 => generated 1474 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:56:20.671225 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-7e1ff9ed-dd6b-4c86-84f6-f11dc665ea20 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:56:20.671928 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-7e1ff9ed-dd6b-4c86-84f6-f11dc665ea20 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] [instance: df5f7e8f-5ed6-4ad6-9bcb-eaa54b4ee320] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:56:20.695005 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7e1ff9ed-dd6b-4c86-84f6-f11dc665ea20 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:20.695556 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7e1ff9ed-dd6b-4c86-84f6-f11dc665ea20 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:20.698242 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7e1ff9ed-dd6b-4c86-84f6-f11dc665ea20 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:20.699161 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7e1ff9ed-dd6b-4c86-84f6-f11dc665ea20 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:20.699694 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7e1ff9ed-dd6b-4c86-84f6-f11dc665ea20 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:20.701114 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7e1ff9ed-dd6b-4c86-84f6-f11dc665ea20 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:21.423166 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-2931a6e4-3cac-4cb2-80b4-cb70fc22ea18 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be93cabff0d46ccb2a3db0db1a13796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42111ed6bcc3465d8c1f5291da248e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:56:21.433881 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-2931a6e4-3cac-4cb2-80b4-cb70fc22ea18 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] 10.222.0.18 "GET /compute/v2.1/servers/29a351ac-ecf5-4b11-9bdd-f1c93df1335a" status: 200 len: 1525 microversion: 2.1 time: 1.076506 Oct 22 20:56:21.437258 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 837/1766] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:56:20 2022] GET /compute/v2.1/servers/29a351ac-ecf5-4b11-9bdd-f1c93df1335a => generated 1525 bytes in 1081 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:56:21.449525 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-fd94dd76-4867-4c54-860a-47a7a6d3c31f tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:56:21.450922 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-fd94dd76-4867-4c54-860a-47a7a6d3c31f tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] [instance: 2f02a0ad-4856-4643-9e69-50547f5c7a98] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:56:21.471115 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fd94dd76-4867-4c54-860a-47a7a6d3c31f tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:21.472271 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fd94dd76-4867-4c54-860a-47a7a6d3c31f tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:21.473039 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fd94dd76-4867-4c54-860a-47a7a6d3c31f tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:21.474018 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fd94dd76-4867-4c54-860a-47a7a6d3c31f tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:21.474708 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fd94dd76-4867-4c54-860a-47a7a6d3c31f tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:21.475777 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fd94dd76-4867-4c54-860a-47a7a6d3c31f tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:21.702988 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-7e1ff9ed-dd6b-4c86-84f6-f11dc665ea20 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e787e0b494764176a0f13d75c47d77fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '371ecb87e8d34859971be23c1a1bc443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:56:21.712693 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-7e1ff9ed-dd6b-4c86-84f6-f11dc665ea20 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] 10.222.0.18 "GET /compute/v2.1/servers/df5f7e8f-5ed6-4ad6-9bcb-eaa54b4ee320" status: 200 len: 1320 microversion: 2.1 time: 1.047276 Oct 22 20:56:21.714201 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 930/1767] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:56:20 2022] GET /compute/v2.1/servers/df5f7e8f-5ed6-4ad6-9bcb-eaa54b4ee320 => generated 1320 bytes in 1049 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:56:21.719785 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-cb31b014-c8f0-44f2-a19c-c07d02b20a85 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:56:21.721834 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-cb31b014-c8f0-44f2-a19c-c07d02b20a85 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] [instance: 3de7ee82-86b9-4c34-8b81-46f09d6239d0] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:56:21.733231 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cb31b014-c8f0-44f2-a19c-c07d02b20a85 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:21.733979 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cb31b014-c8f0-44f2-a19c-c07d02b20a85 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:21.734611 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cb31b014-c8f0-44f2-a19c-c07d02b20a85 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:21.736577 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cb31b014-c8f0-44f2-a19c-c07d02b20a85 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:21.737357 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cb31b014-c8f0-44f2-a19c-c07d02b20a85 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:21.739433 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cb31b014-c8f0-44f2-a19c-c07d02b20a85 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:22.248163 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-cb31b014-c8f0-44f2-a19c-c07d02b20a85 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b392ad1fe1fd4b2a9e6be03a7435deb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594624ed28aa433d907c8833d360b82e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:56:22.256850 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-cb31b014-c8f0-44f2-a19c-c07d02b20a85 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] 10.222.0.18 "GET /compute/v2.1/servers/3de7ee82-86b9-4c34-8b81-46f09d6239d0" status: 200 len: 1282 microversion: 2.1 time: 0.541413 Oct 22 20:56:22.264493 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 931/1768] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:56:21 2022] GET /compute/v2.1/servers/3de7ee82-86b9-4c34-8b81-46f09d6239d0 => generated 1282 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:56:22.270104 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-ce8777dc-b36d-4c4c-9508-4236c7fe4649 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:56:22.270733 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-ce8777dc-b36d-4c4c-9508-4236c7fe4649 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] [instance: 98f48cb1-54ed-4e82-8a25-fd004ddb5758] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:56:22.287187 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ce8777dc-b36d-4c4c-9508-4236c7fe4649 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:22.288048 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ce8777dc-b36d-4c4c-9508-4236c7fe4649 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:22.288672 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ce8777dc-b36d-4c4c-9508-4236c7fe4649 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:22.289589 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ce8777dc-b36d-4c4c-9508-4236c7fe4649 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:22.290222 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ce8777dc-b36d-4c4c-9508-4236c7fe4649 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:22.293554 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ce8777dc-b36d-4c4c-9508-4236c7fe4649 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:22.589946 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-fd94dd76-4867-4c54-860a-47a7a6d3c31f tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c87f0356ca346f39c6216393d85da2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee8c8f7fc4e12bc1f9fcce3e7b581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:56:22.608634 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-fd94dd76-4867-4c54-860a-47a7a6d3c31f tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] 10.222.0.18 "GET /compute/v2.1/servers/2f02a0ad-4856-4643-9e69-50547f5c7a98" status: 200 len: 1484 microversion: 2.1 time: 1.169000 Oct 22 20:56:22.633032 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 838/1769] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:56:21 2022] GET /compute/v2.1/servers/2f02a0ad-4856-4643-9e69-50547f5c7a98 => generated 1484 bytes in 1195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:56:22.641502 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-5c018b83-93c7-4fd0-baef-9252185530eb tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:56:22.642643 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-5c018b83-93c7-4fd0-baef-9252185530eb tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] [instance: 29a351ac-ecf5-4b11-9bdd-f1c93df1335a] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:56:22.651260 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5c018b83-93c7-4fd0-baef-9252185530eb tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:22.651965 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5c018b83-93c7-4fd0-baef-9252185530eb tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:22.652747 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5c018b83-93c7-4fd0-baef-9252185530eb tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:22.653672 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5c018b83-93c7-4fd0-baef-9252185530eb tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:22.654421 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5c018b83-93c7-4fd0-baef-9252185530eb tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:22.655053 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5c018b83-93c7-4fd0-baef-9252185530eb tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:23.161551 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-ce8777dc-b36d-4c4c-9508-4236c7fe4649 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d3d7458af447bdb3f03e83a2d8559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49238b8686d24ae698679e4a1957735d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:56:23.184188 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-ce8777dc-b36d-4c4c-9508-4236c7fe4649 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] 10.222.0.18 "GET /compute/v2.1/servers/98f48cb1-54ed-4e82-8a25-fd004ddb5758" status: 200 len: 1473 microversion: 2.1 time: 0.917832 Oct 22 20:56:23.232916 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 932/1770] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:56:22 2022] GET /compute/v2.1/servers/98f48cb1-54ed-4e82-8a25-fd004ddb5758 => generated 1473 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:56:23.248820 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-1ac025b0-9f63-47d9-90e3-574748518c43 req-520b96fd-18ee-47cd-9e22-55203d3cfd60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98f48cb1-54ed-4e82-8a25-fd004ddb5758", "name": "network-vif-unplugged", "status": "completed", "tag": "1d82207b-0e45-42ab-8c7f-4bf4bac8d993"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:56:23.272740 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-1ac025b0-9f63-47d9-90e3-574748518c43 req-520b96fd-18ee-47cd-9e22-55203d3cfd60 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:23.273523 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-1ac025b0-9f63-47d9-90e3-574748518c43 req-520b96fd-18ee-47cd-9e22-55203d3cfd60 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:23.274160 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-1ac025b0-9f63-47d9-90e3-574748518c43 req-520b96fd-18ee-47cd-9e22-55203d3cfd60 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:23.306819 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-1ac025b0-9f63-47d9-90e3-574748518c43 req-520b96fd-18ee-47cd-9e22-55203d3cfd60 service nova] Creating event network-vif-unplugged:1d82207b-0e45-42ab-8c7f-4bf4bac8d993 for instance 98f48cb1-54ed-4e82-8a25-fd004ddb5758 on nch1-master-1 Oct 22 20:56:23.317416 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [req-1ac025b0-9f63-47d9-90e3-574748518c43 req-520b96fd-18ee-47cd-9e22-55203d3cfd60 service nova] Instance 98f48cb1-54ed-4e82-8a25-fd004ddb5758 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=138745) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 22 20:56:23.330737 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-1ac025b0-9f63-47d9-90e3-574748518c43 req-520b96fd-18ee-47cd-9e22-55203d3cfd60 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.096099 Oct 22 20:56:23.332053 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 933/1771] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:56:23 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:56:23.338169 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-42a13b76-be67-4215-84e5-2b0ed864d7c8 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:56:23.339232 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-42a13b76-be67-4215-84e5-2b0ed864d7c8 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] [instance: df5f7e8f-5ed6-4ad6-9bcb-eaa54b4ee320] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:56:23.347489 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-42a13b76-be67-4215-84e5-2b0ed864d7c8 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:23.348099 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-42a13b76-be67-4215-84e5-2b0ed864d7c8 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:23.348566 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-42a13b76-be67-4215-84e5-2b0ed864d7c8 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:23.349528 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-42a13b76-be67-4215-84e5-2b0ed864d7c8 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:23.350161 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-42a13b76-be67-4215-84e5-2b0ed864d7c8 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:23.350764 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-42a13b76-be67-4215-84e5-2b0ed864d7c8 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:23.648418 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-5c018b83-93c7-4fd0-baef-9252185530eb tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be93cabff0d46ccb2a3db0db1a13796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42111ed6bcc3465d8c1f5291da248e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:56:23.666094 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-5c018b83-93c7-4fd0-baef-9252185530eb tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] 10.222.0.18 "GET /compute/v2.1/servers/29a351ac-ecf5-4b11-9bdd-f1c93df1335a" status: 200 len: 1525 microversion: 2.1 time: 1.029937 Oct 22 20:56:23.669426 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 839/1772] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:56:22 2022] GET /compute/v2.1/servers/29a351ac-ecf5-4b11-9bdd-f1c93df1335a => generated 1525 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:56:23.688969 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-485a51cf-c865-4460-badc-9f479d7b894f tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:56:23.691734 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-485a51cf-c865-4460-badc-9f479d7b894f tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] [instance: 3de7ee82-86b9-4c34-8b81-46f09d6239d0] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:56:23.704993 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-485a51cf-c865-4460-badc-9f479d7b894f tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:23.708427 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-485a51cf-c865-4460-badc-9f479d7b894f tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:23.709420 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-485a51cf-c865-4460-badc-9f479d7b894f tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:23.712024 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-485a51cf-c865-4460-badc-9f479d7b894f tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:23.712529 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-485a51cf-c865-4460-badc-9f479d7b894f tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:23.714350 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-485a51cf-c865-4460-badc-9f479d7b894f tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:23.827399 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-42a13b76-be67-4215-84e5-2b0ed864d7c8 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e787e0b494764176a0f13d75c47d77fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '371ecb87e8d34859971be23c1a1bc443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:56:23.834335 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:56:23.863433 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-42a13b76-be67-4215-84e5-2b0ed864d7c8 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] 10.222.0.18 "GET /compute/v2.1/servers/df5f7e8f-5ed6-4ad6-9bcb-eaa54b4ee320" status: 200 len: 1320 microversion: 2.1 time: 0.529334 Oct 22 20:56:23.864360 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 934/1773] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:56:23 2022] GET /compute/v2.1/servers/df5f7e8f-5ed6-4ad6-9bcb-eaa54b4ee320 => generated 1320 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:56:23.886099 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-a9a4d72e-6ed9-40ee-a105-f0af2ddfde42 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:56:23.892591 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-a9a4d72e-6ed9-40ee-a105-f0af2ddfde42 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] [instance: 2f02a0ad-4856-4643-9e69-50547f5c7a98] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:56:23.904939 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a9a4d72e-6ed9-40ee-a105-f0af2ddfde42 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:23.905791 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a9a4d72e-6ed9-40ee-a105-f0af2ddfde42 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:23.906435 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a9a4d72e-6ed9-40ee-a105-f0af2ddfde42 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:23.913323 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a9a4d72e-6ed9-40ee-a105-f0af2ddfde42 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:23.915983 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a9a4d72e-6ed9-40ee-a105-f0af2ddfde42 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:23.926417 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a9a4d72e-6ed9-40ee-a105-f0af2ddfde42 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:24.200238 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-485a51cf-c865-4460-badc-9f479d7b894f tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b392ad1fe1fd4b2a9e6be03a7435deb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594624ed28aa433d907c8833d360b82e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:56:24.209393 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-485a51cf-c865-4460-badc-9f479d7b894f tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] 10.222.0.18 "GET /compute/v2.1/servers/3de7ee82-86b9-4c34-8b81-46f09d6239d0" status: 200 len: 1282 microversion: 2.1 time: 0.535990 Oct 22 20:56:24.219784 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-a9a4d72e-6ed9-40ee-a105-f0af2ddfde42 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c87f0356ca346f39c6216393d85da2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee8c8f7fc4e12bc1f9fcce3e7b581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:56:24.232384 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 840/1774] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:56:23 2022] GET /compute/v2.1/servers/3de7ee82-86b9-4c34-8b81-46f09d6239d0 => generated 1282 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:56:24.244018 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-a9a4d72e-6ed9-40ee-a105-f0af2ddfde42 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] 10.222.0.18 "GET /compute/v2.1/servers/2f02a0ad-4856-4643-9e69-50547f5c7a98" status: 200 len: 1442 microversion: 2.1 time: 0.378209 Oct 22 20:56:24.247783 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-36d69b45-86ee-4d4c-8998-158b55008b4c req-67cd14f0-7a9c-4cfa-9410-1051e24aba43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f02a0ad-4856-4643-9e69-50547f5c7a98", "name": "network-vif-deleted", "tag": "eb2b7a79-4890-4efa-990a-815f0293cc40"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:56:24.248552 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 935/1775] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:56:23 2022] GET /compute/v2.1/servers/2f02a0ad-4856-4643-9e69-50547f5c7a98 => generated 1442 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:56:24.265354 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-98bc7149-52c8-4ad8-8dba-fd040570b071 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:56:24.269313 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-98bc7149-52c8-4ad8-8dba-fd040570b071 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] [instance: 98f48cb1-54ed-4e82-8a25-fd004ddb5758] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:56:24.308624 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-36d69b45-86ee-4d4c-8998-158b55008b4c req-67cd14f0-7a9c-4cfa-9410-1051e24aba43 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:24.309736 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-98bc7149-52c8-4ad8-8dba-fd040570b071 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:24.310705 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-98bc7149-52c8-4ad8-8dba-fd040570b071 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:24.311202 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-98bc7149-52c8-4ad8-8dba-fd040570b071 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:24.311809 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-36d69b45-86ee-4d4c-8998-158b55008b4c req-67cd14f0-7a9c-4cfa-9410-1051e24aba43 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:24.312611 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-98bc7149-52c8-4ad8-8dba-fd040570b071 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:24.313116 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-36d69b45-86ee-4d4c-8998-158b55008b4c req-67cd14f0-7a9c-4cfa-9410-1051e24aba43 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:24.318473 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-98bc7149-52c8-4ad8-8dba-fd040570b071 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:24.319076 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-98bc7149-52c8-4ad8-8dba-fd040570b071 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:24.346707 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-36d69b45-86ee-4d4c-8998-158b55008b4c req-67cd14f0-7a9c-4cfa-9410-1051e24aba43 service nova] Creating event network-vif-deleted:eb2b7a79-4890-4efa-990a-815f0293cc40 for instance 2f02a0ad-4856-4643-9e69-50547f5c7a98 on nch1-master-1 Oct 22 20:56:24.369536 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-36d69b45-86ee-4d4c-8998-158b55008b4c req-67cd14f0-7a9c-4cfa-9410-1051e24aba43 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.135339 Oct 22 20:56:24.381507 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 841/1776] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:56:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:56:24.695198 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-698cee4e-c91b-4267-9d3a-04a63c88c99a tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:56:24.696612 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-698cee4e-c91b-4267-9d3a-04a63c88c99a tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] [instance: 29a351ac-ecf5-4b11-9bdd-f1c93df1335a] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:56:24.710451 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-698cee4e-c91b-4267-9d3a-04a63c88c99a tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:24.710953 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-698cee4e-c91b-4267-9d3a-04a63c88c99a tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:24.711421 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-698cee4e-c91b-4267-9d3a-04a63c88c99a tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:24.712145 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-698cee4e-c91b-4267-9d3a-04a63c88c99a tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:24.721695 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-698cee4e-c91b-4267-9d3a-04a63c88c99a tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:24.722243 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-698cee4e-c91b-4267-9d3a-04a63c88c99a tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:24.792907 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4,nova_api:UPDATE=2 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:56:24.806711 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-698cee4e-c91b-4267-9d3a-04a63c88c99a tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:24.807399 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-698cee4e-c91b-4267-9d3a-04a63c88c99a tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:24.809479 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-698cee4e-c91b-4267-9d3a-04a63c88c99a tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:24.810266 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.objects.instance [None req-698cee4e-c91b-4267-9d3a-04a63c88c99a tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Lazy-loading 'fault' on Instance uuid 29a351ac-ecf5-4b11-9bdd-f1c93df1335a {{(pid=138744) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 20:56:25.125769 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-698cee4e-c91b-4267-9d3a-04a63c88c99a tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be93cabff0d46ccb2a3db0db1a13796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42111ed6bcc3465d8c1f5291da248e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:56:25.149799 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-698cee4e-c91b-4267-9d3a-04a63c88c99a tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] 10.222.0.18 "GET /compute/v2.1/servers/29a351ac-ecf5-4b11-9bdd-f1c93df1335a" status: 200 len: 1313 microversion: 2.1 time: 0.458564 Oct 22 20:56:25.152641 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 842/1777] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:56:24 2022] GET /compute/v2.1/servers/29a351ac-ecf5-4b11-9bdd-f1c93df1335a => generated 1313 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 20:56:25.171977 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-2aa2c011-f079-4e92-8270-8638104c20b3 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:56:25.173389 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-2aa2c011-f079-4e92-8270-8638104c20b3 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] [instance: df5f7e8f-5ed6-4ad6-9bcb-eaa54b4ee320] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:56:25.191517 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2aa2c011-f079-4e92-8270-8638104c20b3 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:25.192217 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2aa2c011-f079-4e92-8270-8638104c20b3 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:25.193709 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2aa2c011-f079-4e92-8270-8638104c20b3 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:25.196373 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2aa2c011-f079-4e92-8270-8638104c20b3 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:25.197046 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2aa2c011-f079-4e92-8270-8638104c20b3 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:25.198223 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2aa2c011-f079-4e92-8270-8638104c20b3 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:25.242543 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-98bc7149-52c8-4ad8-8dba-fd040570b071 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d3d7458af447bdb3f03e83a2d8559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49238b8686d24ae698679e4a1957735d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:56:25.262455 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-98bc7149-52c8-4ad8-8dba-fd040570b071 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] 10.222.0.18 "GET /compute/v2.1/servers/98f48cb1-54ed-4e82-8a25-fd004ddb5758" status: 200 len: 1473 microversion: 2.1 time: 1.012007 Oct 22 20:56:25.267004 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 936/1778] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:56:24 2022] GET /compute/v2.1/servers/98f48cb1-54ed-4e82-8a25-fd004ddb5758 => generated 1473 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:56:25.291665 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-f2ab6f95-2a0b-432b-ab1b-c218513d566b tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:56:25.309436 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-f2ab6f95-2a0b-432b-ab1b-c218513d566b tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] [instance: 3de7ee82-86b9-4c34-8b81-46f09d6239d0] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:56:25.327597 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f2ab6f95-2a0b-432b-ab1b-c218513d566b tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:25.330297 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f2ab6f95-2a0b-432b-ab1b-c218513d566b tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:25.331211 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f2ab6f95-2a0b-432b-ab1b-c218513d566b tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:25.334795 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f2ab6f95-2a0b-432b-ab1b-c218513d566b tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:25.336122 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f2ab6f95-2a0b-432b-ab1b-c218513d566b tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:25.337310 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f2ab6f95-2a0b-432b-ab1b-c218513d566b tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:25.661422 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-f2ab6f95-2a0b-432b-ab1b-c218513d566b tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b392ad1fe1fd4b2a9e6be03a7435deb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594624ed28aa433d907c8833d360b82e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:56:25.670213 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-f2ab6f95-2a0b-432b-ab1b-c218513d566b tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] 10.222.0.18 "GET /compute/v2.1/servers/3de7ee82-86b9-4c34-8b81-46f09d6239d0" status: 200 len: 1282 microversion: 2.1 time: 0.399220 Oct 22 20:56:25.671178 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 937/1779] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:56:25 2022] GET /compute/v2.1/servers/3de7ee82-86b9-4c34-8b81-46f09d6239d0 => generated 1282 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:56:25.677106 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-e0b2bd84-7f75-49ff-bd7b-e94a6f06489d tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:56:25.677989 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-e0b2bd84-7f75-49ff-bd7b-e94a6f06489d tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] [instance: 2f02a0ad-4856-4643-9e69-50547f5c7a98] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:56:25.686631 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e0b2bd84-7f75-49ff-bd7b-e94a6f06489d tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:25.688339 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e0b2bd84-7f75-49ff-bd7b-e94a6f06489d tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:25.689243 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e0b2bd84-7f75-49ff-bd7b-e94a6f06489d tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:25.690316 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e0b2bd84-7f75-49ff-bd7b-e94a6f06489d tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:25.691137 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e0b2bd84-7f75-49ff-bd7b-e94a6f06489d tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:25.691858 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e0b2bd84-7f75-49ff-bd7b-e94a6f06489d tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:25.710528 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.wsgi [None req-e0b2bd84-7f75-49ff-bd7b-e94a6f06489d tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] HTTP exception thrown: Instance 2f02a0ad-4856-4643-9e69-50547f5c7a98 could not be found. Oct 22 20:56:25.712657 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-e0b2bd84-7f75-49ff-bd7b-e94a6f06489d tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Request method failure captured: Oct 22 20:56:25.712657 ncdv-master-1 devstack@n-api.service[138745]: request: GET /compute/v2.1/servers/2f02a0ad-4856-4643-9e69-50547f5c7a98 HTTP/1.1 Oct 22 20:56:25.712657 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 20:56:25.712657 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 20:56:25.712657 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 20:56:25.712657 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 0 Oct 22 20:56:25.712657 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 20:56:25.712657 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 20:56:25.712657 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 20:56:25.712657 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 20:56:25.712657 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVFd3L1O9buG2NKok4Z3OhlPg9uJowRL-QIrWO2UXrdAMWoEA07U7Qwd3UcRw5_kRV78yVlG8-xf-9bQgrD-lSc6Kuqan6Pt9NTBZahyGUD3ZZ-4gkCHlC4kIKTqF1xcLu4qJCXK_NR7T7vH-rSU8EgD59OAikcfPJ0amh6d8LDt5JQQ Oct 22 20:56:25.712657 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 20:56:25.712657 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 20:56:25.712657 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 20:56:25.712657 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 20:56:25.712657 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 20:56:25.712657 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 20:56:25.712657 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: 9f0ee8c8f7fc4e12bc1f9fcce3e7b581 Oct 22 20:56:25.712657 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-LiveMigrationTest-26615209 Oct 22 20:56:25.712657 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 20:56:25.712657 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 20:56:25.712657 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_9f0ee8c8f7fc4e12bc1f9fcce3e7b581"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9f0ee8c8f7fc4e12bc1f9fcce3e7b581"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/9f0ee8c8f7fc4e12bc1f9fcce3e7b581"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9f0ee8c8f7fc4e12bc1f9fcce3e7b581"}]}] Oct 22 20:56:25.712657 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-LiveMigrationTest-26615209 Oct 22 20:56:25.712657 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: 9f0ee8c8f7fc4e12bc1f9fcce3e7b581 Oct 22 20:56:25.712657 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-LiveMigrationTest-26615209 Oct 22 20:56:25.712657 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-LiveMigrationTest-26615209-project Oct 22 20:56:25.712657 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 20:56:25.712657 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 20:56:25.712657 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: 2c87f0356ca346f39c6216393d85da2f Oct 22 20:56:25.712657 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-LiveMigrationTest-26615209-project Oct 22 20:56:25.712657 ncdv-master-1 devstack@n-api.service[138745]: method: > Oct 22 20:56:25.712657 ncdv-master-1 devstack@n-api.service[138745]: exception: Instance 2f02a0ad-4856-4643-9e69-50547f5c7a98 could not be found. Oct 22 20:56:25.712657 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'id': '2f02a0ad-4856-4643-9e69-50547f5c7a98'} Oct 22 20:56:25.712657 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:56:25.712657 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:56:25.712657 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 20:56:25.712657 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 20:56:25.712657 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 20:56:25.712657 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 20:56:25.712657 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 20:56:25.712657 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 20:56:25.712657 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 20:56:25.712657 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 20:56:25.712657 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2f02a0ad-4856-4643-9e69-50547f5c7a98 could not be found. Oct 22 20:56:25.712657 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:56:25.712657 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:56:25.712657 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:56:25.712657 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:56:25.712657 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:56:25.712657 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:56:25.712657 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:56:25.712657 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:56:25.712657 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:56:25.712657 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:56:25.712657 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 20:56:25.712657 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 20:56:25.712657 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 20:56:25.712657 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 20:56:25.712657 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 20:56:25.712657 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 20:56:25.712657 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2f02a0ad-4856-4643-9e69-50547f5c7a98 could not be found. Oct 22 20:56:25.712657 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:56:25.712657 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:56:25.712657 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:56:25.717691 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:56:25.717691 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:56:25.717691 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:56:25.717691 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 20:56:25.717691 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 20:56:25.717691 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2f02a0ad-4856-4643-9e69-50547f5c7a98 could not be found. Oct 22 20:56:25.717691 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:56:25.722253 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-e0b2bd84-7f75-49ff-bd7b-e94a6f06489d tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Returning 404 to user: Instance 2f02a0ad-4856-4643-9e69-50547f5c7a98 could not be found. {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:56:25.723449 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-e0b2bd84-7f75-49ff-bd7b-e94a6f06489d tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] 10.222.0.18 "GET /compute/v2.1/servers/2f02a0ad-4856-4643-9e69-50547f5c7a98" status: 404 len: 111 microversion: 2.1 time: 0.050972 Oct 22 20:56:25.724566 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 938/1780] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:56:25 2022] GET /compute/v2.1/servers/2f02a0ad-4856-4643-9e69-50547f5c7a98 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 20:56:25.733381 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-0e281f47-9ff0-4cc3-836a-c9c4ba0bbefa req-4c38cd5a-9479-4678-a831-6dc5cbe05239 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98f48cb1-54ed-4e82-8a25-fd004ddb5758", "tag": "1d82207b-0e45-42ab-8c7f-4bf4bac8d993"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:56:25.765978 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-0e281f47-9ff0-4cc3-836a-c9c4ba0bbefa req-4c38cd5a-9479-4678-a831-6dc5cbe05239 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:25.766593 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-0e281f47-9ff0-4cc3-836a-c9c4ba0bbefa req-4c38cd5a-9479-4678-a831-6dc5cbe05239 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:25.767112 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-0e281f47-9ff0-4cc3-836a-c9c4ba0bbefa req-4c38cd5a-9479-4678-a831-6dc5cbe05239 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:25.784787 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-0e281f47-9ff0-4cc3-836a-c9c4ba0bbefa req-4c38cd5a-9479-4678-a831-6dc5cbe05239 service nova] Creating event network-changed:1d82207b-0e45-42ab-8c7f-4bf4bac8d993 for instance 98f48cb1-54ed-4e82-8a25-fd004ddb5758 on nch1-master-1 Oct 22 20:56:25.793475 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [req-0e281f47-9ff0-4cc3-836a-c9c4ba0bbefa req-4c38cd5a-9479-4678-a831-6dc5cbe05239 service nova] Instance 98f48cb1-54ed-4e82-8a25-fd004ddb5758 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=138745) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 22 20:56:25.806659 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-0e281f47-9ff0-4cc3-836a-c9c4ba0bbefa req-4c38cd5a-9479-4678-a831-6dc5cbe05239 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080528 Oct 22 20:56:25.808649 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 939/1781] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:56:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:56:25.815547 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-060899c7-7dd7-4dba-9f44-3b0458c9c2b4 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:56:25.816446 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-060899c7-7dd7-4dba-9f44-3b0458c9c2b4 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] [instance: fe83cd49-4ceb-49aa-a775-cc2a4229fd76] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:56:25.834238 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-060899c7-7dd7-4dba-9f44-3b0458c9c2b4 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:25.835175 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-060899c7-7dd7-4dba-9f44-3b0458c9c2b4 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:25.835918 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-060899c7-7dd7-4dba-9f44-3b0458c9c2b4 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:25.836892 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-060899c7-7dd7-4dba-9f44-3b0458c9c2b4 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:25.837585 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-060899c7-7dd7-4dba-9f44-3b0458c9c2b4 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:25.838248 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-060899c7-7dd7-4dba-9f44-3b0458c9c2b4 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:25.879952 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-060899c7-7dd7-4dba-9f44-3b0458c9c2b4 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] [instance: fe83cd49-4ceb-49aa-a775-cc2a4229fd76] Going to try to terminate instance {{(pid=138745) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 20:56:25.895561 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-2aa2c011-f079-4e92-8270-8638104c20b3 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e787e0b494764176a0f13d75c47d77fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '371ecb87e8d34859971be23c1a1bc443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:56:25.912911 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-2aa2c011-f079-4e92-8270-8638104c20b3 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] 10.222.0.18 "GET /compute/v2.1/servers/df5f7e8f-5ed6-4ad6-9bcb-eaa54b4ee320" status: 200 len: 1320 microversion: 2.1 time: 0.757277 Oct 22 20:56:25.913629 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 843/1782] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:56:25 2022] GET /compute/v2.1/servers/df5f7e8f-5ed6-4ad6-9bcb-eaa54b4ee320 => generated 1320 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:56:26.013823 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-060899c7-7dd7-4dba-9f44-3b0458c9c2b4 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] 10.222.0.18 "DELETE /compute/v2.1/servers/fe83cd49-4ceb-49aa-a775-cc2a4229fd76" status: 204 len: 0 microversion: 2.1 time: 0.202897 Oct 22 20:56:26.015013 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 940/1783] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 20:56:25 2022] DELETE /compute/v2.1/servers/fe83cd49-4ceb-49aa-a775-cc2a4229fd76 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 20:56:26.023323 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-40632756-1d4f-429c-b35e-850080719072 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:56:26.024132 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-40632756-1d4f-429c-b35e-850080719072 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] [instance: fe83cd49-4ceb-49aa-a775-cc2a4229fd76] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:56:26.032855 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-40632756-1d4f-429c-b35e-850080719072 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:26.036286 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-40632756-1d4f-429c-b35e-850080719072 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:26.036766 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-40632756-1d4f-429c-b35e-850080719072 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:26.037791 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-40632756-1d4f-429c-b35e-850080719072 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:26.038256 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-40632756-1d4f-429c-b35e-850080719072 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:26.038989 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-40632756-1d4f-429c-b35e-850080719072 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:26.177278 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-234da37d-93f5-4273-bc31-d31335b98e81 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:56:26.177991 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-234da37d-93f5-4273-bc31-d31335b98e81 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] [instance: 29a351ac-ecf5-4b11-9bdd-f1c93df1335a] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:56:26.188426 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-234da37d-93f5-4273-bc31-d31335b98e81 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:26.192317 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-234da37d-93f5-4273-bc31-d31335b98e81 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:26.192830 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-234da37d-93f5-4273-bc31-d31335b98e81 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:26.193588 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-234da37d-93f5-4273-bc31-d31335b98e81 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:26.194058 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-234da37d-93f5-4273-bc31-d31335b98e81 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:26.194489 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-234da37d-93f5-4273-bc31-d31335b98e81 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:26.212097 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.wsgi [None req-234da37d-93f5-4273-bc31-d31335b98e81 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] HTTP exception thrown: Instance 29a351ac-ecf5-4b11-9bdd-f1c93df1335a could not be found. Oct 22 20:56:26.213797 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-234da37d-93f5-4273-bc31-d31335b98e81 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Request method failure captured: Oct 22 20:56:26.213797 ncdv-master-1 devstack@n-api.service[138745]: request: GET /compute/v2.1/servers/29a351ac-ecf5-4b11-9bdd-f1c93df1335a HTTP/1.1 Oct 22 20:56:26.213797 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 20:56:26.213797 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 20:56:26.213797 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 20:56:26.213797 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 0 Oct 22 20:56:26.213797 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 20:56:26.213797 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 20:56:26.213797 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 20:56:26.213797 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 20:56:26.213797 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVFiCX4qi1toITSNXXZAA4zJRL4Z-tEaLsPig7vwCIxFzHhgpfZzKEZgzHRjqoMZPu5dyrSuPgrW5CAgewXSUJpj2NyXzw_QN2lPPiKoYaJrXQqGbBy3YIoLoq2X1cQW9oGz__9NYXLj4hRYCsg2qiZ71RuufQk6o4LVHRRj38STOBi8 Oct 22 20:56:26.213797 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 20:56:26.213797 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 20:56:26.213797 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 20:56:26.213797 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 20:56:26.213797 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 20:56:26.213797 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 20:56:26.213797 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: 42111ed6bcc3465d8c1f5291da248e74 Oct 22 20:56:26.213797 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-462023843 Oct 22 20:56:26.213797 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 20:56:26.213797 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 20:56:26.213797 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_42111ed6bcc3465d8c1f5291da248e74"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/42111ed6bcc3465d8c1f5291da248e74"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/42111ed6bcc3465d8c1f5291da248e74"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/42111ed6bcc3465d8c1f5291da248e74"}]}] Oct 22 20:56:26.213797 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-462023843 Oct 22 20:56:26.213797 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: 42111ed6bcc3465d8c1f5291da248e74 Oct 22 20:56:26.213797 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-462023843 Oct 22 20:56:26.213797 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-FloatingIPsAssociationTestJSON-462023843-project Oct 22 20:56:26.213797 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 20:56:26.213797 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 20:56:26.213797 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: 5be93cabff0d46ccb2a3db0db1a13796 Oct 22 20:56:26.213797 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-462023843-project Oct 22 20:56:26.213797 ncdv-master-1 devstack@n-api.service[138745]: method: > Oct 22 20:56:26.213797 ncdv-master-1 devstack@n-api.service[138745]: exception: Instance 29a351ac-ecf5-4b11-9bdd-f1c93df1335a could not be found. Oct 22 20:56:26.213797 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'id': '29a351ac-ecf5-4b11-9bdd-f1c93df1335a'} Oct 22 20:56:26.213797 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:56:26.213797 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:56:26.213797 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 20:56:26.213797 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 20:56:26.213797 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 20:56:26.213797 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 20:56:26.213797 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 20:56:26.213797 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 20:56:26.213797 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 20:56:26.213797 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 20:56:26.213797 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 29a351ac-ecf5-4b11-9bdd-f1c93df1335a could not be found. Oct 22 20:56:26.213797 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:56:26.213797 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:56:26.213797 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:56:26.213797 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:56:26.213797 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:56:26.213797 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:56:26.213797 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:56:26.213797 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:56:26.213797 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:56:26.213797 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:56:26.213797 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 20:56:26.213797 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 20:56:26.213797 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 20:56:26.213797 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 20:56:26.213797 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 20:56:26.213797 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 20:56:26.213797 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 29a351ac-ecf5-4b11-9bdd-f1c93df1335a could not be found. Oct 22 20:56:26.213797 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:56:26.213797 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:56:26.218734 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:56:26.218734 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:56:26.218734 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:56:26.218734 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:56:26.218734 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 20:56:26.218734 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 20:56:26.218734 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 29a351ac-ecf5-4b11-9bdd-f1c93df1335a could not be found. Oct 22 20:56:26.218734 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:56:26.218734 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-234da37d-93f5-4273-bc31-d31335b98e81 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] Returning 404 to user: Instance 29a351ac-ecf5-4b11-9bdd-f1c93df1335a could not be found. {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:56:26.218734 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-234da37d-93f5-4273-bc31-d31335b98e81 tempest-FloatingIPsAssociationTestJSON-462023843 tempest-FloatingIPsAssociationTestJSON-462023843-project] 10.222.0.18 "GET /compute/v2.1/servers/29a351ac-ecf5-4b11-9bdd-f1c93df1335a" status: 404 len: 111 microversion: 2.1 time: 0.044556 Oct 22 20:56:26.218734 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 941/1784] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:56:26 2022] GET /compute/v2.1/servers/29a351ac-ecf5-4b11-9bdd-f1c93df1335a => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 20:56:26.296145 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-6bbc06ef-3085-482c-9563-c6ace735fb97 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:56:26.296768 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-6bbc06ef-3085-482c-9563-c6ace735fb97 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] [instance: 98f48cb1-54ed-4e82-8a25-fd004ddb5758] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:56:26.308673 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6bbc06ef-3085-482c-9563-c6ace735fb97 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:26.313567 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6bbc06ef-3085-482c-9563-c6ace735fb97 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:26.314029 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6bbc06ef-3085-482c-9563-c6ace735fb97 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:26.314880 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6bbc06ef-3085-482c-9563-c6ace735fb97 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:26.315332 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6bbc06ef-3085-482c-9563-c6ace735fb97 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:26.315792 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6bbc06ef-3085-482c-9563-c6ace735fb97 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:27.086063 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-40632756-1d4f-429c-b35e-850080719072 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c87f0356ca346f39c6216393d85da2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee8c8f7fc4e12bc1f9fcce3e7b581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:56:27.102729 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-40632756-1d4f-429c-b35e-850080719072 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] 10.222.0.18 "GET /compute/v2.1/servers/fe83cd49-4ceb-49aa-a775-cc2a4229fd76" status: 200 len: 1499 microversion: 2.1 time: 1.078061 Oct 22 20:56:27.103756 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 844/1785] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:56:26 2022] GET /compute/v2.1/servers/fe83cd49-4ceb-49aa-a775-cc2a4229fd76 => generated 1499 bytes in 1085 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 20:56:27.116556 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-d122de8a-8651-41c7-9cba-51260f46b625 req-3e91ff82-6017-4270-b705-bd67a60a7a4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29a351ac-ecf5-4b11-9bdd-f1c93df1335a", "name": "network-vif-deleted", "tag": "07fb8283-cc10-46e3-bd70-2c1e5b8c3aef"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:56:27.155868 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-d122de8a-8651-41c7-9cba-51260f46b625 req-3e91ff82-6017-4270-b705-bd67a60a7a4e service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:27.156399 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-d122de8a-8651-41c7-9cba-51260f46b625 req-3e91ff82-6017-4270-b705-bd67a60a7a4e service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:27.156829 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-d122de8a-8651-41c7-9cba-51260f46b625 req-3e91ff82-6017-4270-b705-bd67a60a7a4e service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:27.189633 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-d122de8a-8651-41c7-9cba-51260f46b625 req-3e91ff82-6017-4270-b705-bd67a60a7a4e service nova] Creating event network-vif-deleted:07fb8283-cc10-46e3-bd70-2c1e5b8c3aef for instance 29a351ac-ecf5-4b11-9bdd-f1c93df1335a on nch2-master-1 Oct 22 20:56:27.205749 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-d122de8a-8651-41c7-9cba-51260f46b625 req-3e91ff82-6017-4270-b705-bd67a60a7a4e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100292 Oct 22 20:56:27.206986 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 845/1786] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:56:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:56:27.212724 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-4c393624-5add-4252-93a5-c638adb058c4 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:56:27.213914 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-4c393624-5add-4252-93a5-c638adb058c4 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] [instance: 3de7ee82-86b9-4c34-8b81-46f09d6239d0] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:56:27.223121 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-6bbc06ef-3085-482c-9563-c6ace735fb97 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d3d7458af447bdb3f03e83a2d8559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49238b8686d24ae698679e4a1957735d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:56:27.226834 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4c393624-5add-4252-93a5-c638adb058c4 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:27.228164 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4c393624-5add-4252-93a5-c638adb058c4 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:27.228802 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4c393624-5add-4252-93a5-c638adb058c4 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:27.229704 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4c393624-5add-4252-93a5-c638adb058c4 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:27.232345 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4c393624-5add-4252-93a5-c638adb058c4 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:27.233126 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4c393624-5add-4252-93a5-c638adb058c4 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:27.238032 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-6bbc06ef-3085-482c-9563-c6ace735fb97 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] 10.222.0.18 "GET /compute/v2.1/servers/98f48cb1-54ed-4e82-8a25-fd004ddb5758" status: 200 len: 1471 microversion: 2.1 time: 0.944867 Oct 22 20:56:27.239548 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 942/1787] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:56:26 2022] GET /compute/v2.1/servers/98f48cb1-54ed-4e82-8a25-fd004ddb5758 => generated 1471 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:56:27.250865 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-e734561c-7196-4a27-8579-b11eaf1cc4fa tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:56:27.256133 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-e734561c-7196-4a27-8579-b11eaf1cc4fa tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] [instance: df5f7e8f-5ed6-4ad6-9bcb-eaa54b4ee320] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:56:27.264028 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e734561c-7196-4a27-8579-b11eaf1cc4fa tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:27.264633 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e734561c-7196-4a27-8579-b11eaf1cc4fa tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:27.265117 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e734561c-7196-4a27-8579-b11eaf1cc4fa tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:27.265896 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e734561c-7196-4a27-8579-b11eaf1cc4fa tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:27.266419 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e734561c-7196-4a27-8579-b11eaf1cc4fa tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:27.266899 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e734561c-7196-4a27-8579-b11eaf1cc4fa tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:27.324014 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell0:SELECT=2 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:56:27.750581 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-4c393624-5add-4252-93a5-c638adb058c4 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b392ad1fe1fd4b2a9e6be03a7435deb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594624ed28aa433d907c8833d360b82e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:56:27.761758 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-4c393624-5add-4252-93a5-c638adb058c4 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] 10.222.0.18 "GET /compute/v2.1/servers/3de7ee82-86b9-4c34-8b81-46f09d6239d0" status: 200 len: 1324 microversion: 2.1 time: 0.553266 Oct 22 20:56:27.775176 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 846/1788] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:56:27 2022] GET /compute/v2.1/servers/3de7ee82-86b9-4c34-8b81-46f09d6239d0 => generated 1324 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:56:27.865740 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-e734561c-7196-4a27-8579-b11eaf1cc4fa tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e787e0b494764176a0f13d75c47d77fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '371ecb87e8d34859971be23c1a1bc443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:56:27.875304 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-e734561c-7196-4a27-8579-b11eaf1cc4fa tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] 10.222.0.18 "GET /compute/v2.1/servers/df5f7e8f-5ed6-4ad6-9bcb-eaa54b4ee320" status: 200 len: 1320 microversion: 2.1 time: 0.633879 Oct 22 20:56:27.888021 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 943/1789] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:56:27 2022] GET /compute/v2.1/servers/df5f7e8f-5ed6-4ad6-9bcb-eaa54b4ee320 => generated 1320 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:56:28.126132 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-16204a91-e4fc-4099-80a2-bfb075046f52 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:56:28.128070 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-16204a91-e4fc-4099-80a2-bfb075046f52 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] [instance: fe83cd49-4ceb-49aa-a775-cc2a4229fd76] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:56:28.151244 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-16204a91-e4fc-4099-80a2-bfb075046f52 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:28.152059 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-16204a91-e4fc-4099-80a2-bfb075046f52 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:28.152515 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-16204a91-e4fc-4099-80a2-bfb075046f52 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:28.154983 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-16204a91-e4fc-4099-80a2-bfb075046f52 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:28.155486 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-16204a91-e4fc-4099-80a2-bfb075046f52 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:28.156517 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-16204a91-e4fc-4099-80a2-bfb075046f52 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:28.264304 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-5bf89a0e-8d32-4a11-ad7a-4768d5a67954 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:56:28.264914 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-5bf89a0e-8d32-4a11-ad7a-4768d5a67954 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] [instance: 98f48cb1-54ed-4e82-8a25-fd004ddb5758] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:56:28.276004 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5bf89a0e-8d32-4a11-ad7a-4768d5a67954 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:28.278123 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5bf89a0e-8d32-4a11-ad7a-4768d5a67954 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:28.278762 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5bf89a0e-8d32-4a11-ad7a-4768d5a67954 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:28.280887 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5bf89a0e-8d32-4a11-ad7a-4768d5a67954 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:28.288169 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5bf89a0e-8d32-4a11-ad7a-4768d5a67954 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:28.288800 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5bf89a0e-8d32-4a11-ad7a-4768d5a67954 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:28.794769 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell0:SELECT=8 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:56:28.918940 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-16204a91-e4fc-4099-80a2-bfb075046f52 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c87f0356ca346f39c6216393d85da2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee8c8f7fc4e12bc1f9fcce3e7b581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:56:28.939498 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-16204a91-e4fc-4099-80a2-bfb075046f52 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] 10.222.0.18 "GET /compute/v2.1/servers/fe83cd49-4ceb-49aa-a775-cc2a4229fd76" status: 200 len: 1499 microversion: 2.1 time: 0.816924 Oct 22 20:56:28.940682 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 847/1790] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:56:28 2022] GET /compute/v2.1/servers/fe83cd49-4ceb-49aa-a775-cc2a4229fd76 => generated 1499 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 20:56:28.951206 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-0a53ceb4-8c11-4f6e-b48c-13949c525939 req-f7d6ae3a-e779-4bd0-822b-816330e0e169 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df5f7e8f-5ed6-4ad6-9bcb-eaa54b4ee320", "name": "network-vif-plugged", "status": "completed", "tag": "4ddf90b6-ac04-4e00-bc1f-0e465ebdb869"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:56:28.964131 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-5bf89a0e-8d32-4a11-ad7a-4768d5a67954 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d3d7458af447bdb3f03e83a2d8559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49238b8686d24ae698679e4a1957735d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:56:28.983895 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-5bf89a0e-8d32-4a11-ad7a-4768d5a67954 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] 10.222.0.18 "GET /compute/v2.1/servers/98f48cb1-54ed-4e82-8a25-fd004ddb5758" status: 200 len: 1471 microversion: 2.1 time: 0.721913 Oct 22 20:56:28.987136 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 944/1791] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:56:28 2022] GET /compute/v2.1/servers/98f48cb1-54ed-4e82-8a25-fd004ddb5758 => generated 1471 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:56:29.006123 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-0a53ceb4-8c11-4f6e-b48c-13949c525939 req-f7d6ae3a-e779-4bd0-822b-816330e0e169 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:29.006511 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-ccf80382-7834-4eeb-83a9-64e1f70bf14e tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:56:29.007249 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-0a53ceb4-8c11-4f6e-b48c-13949c525939 req-f7d6ae3a-e779-4bd0-822b-816330e0e169 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:29.008007 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-ccf80382-7834-4eeb-83a9-64e1f70bf14e tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] [instance: 3de7ee82-86b9-4c34-8b81-46f09d6239d0] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:56:29.008555 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-0a53ceb4-8c11-4f6e-b48c-13949c525939 req-f7d6ae3a-e779-4bd0-822b-816330e0e169 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:29.023361 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ccf80382-7834-4eeb-83a9-64e1f70bf14e tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:29.027401 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ccf80382-7834-4eeb-83a9-64e1f70bf14e tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:29.030587 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ccf80382-7834-4eeb-83a9-64e1f70bf14e tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:29.031898 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ccf80382-7834-4eeb-83a9-64e1f70bf14e tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:29.032543 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ccf80382-7834-4eeb-83a9-64e1f70bf14e tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:29.033107 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ccf80382-7834-4eeb-83a9-64e1f70bf14e tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:29.040464 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-0a53ceb4-8c11-4f6e-b48c-13949c525939 req-f7d6ae3a-e779-4bd0-822b-816330e0e169 service nova] Creating event network-vif-plugged:4ddf90b6-ac04-4e00-bc1f-0e465ebdb869 for instance df5f7e8f-5ed6-4ad6-9bcb-eaa54b4ee320 on nch2-master-1 Oct 22 20:56:29.060191 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-0a53ceb4-8c11-4f6e-b48c-13949c525939 req-f7d6ae3a-e779-4bd0-822b-816330e0e169 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114042 Oct 22 20:56:29.065270 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 848/1792] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:56:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:56:29.102791 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-852c3302-7738-4e7d-9e1d-59b0c7c615f0 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:56:29.107757 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-852c3302-7738-4e7d-9e1d-59b0c7c615f0 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] [instance: df5f7e8f-5ed6-4ad6-9bcb-eaa54b4ee320] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:56:29.124905 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-852c3302-7738-4e7d-9e1d-59b0c7c615f0 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:29.126045 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-852c3302-7738-4e7d-9e1d-59b0c7c615f0 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:29.126772 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-852c3302-7738-4e7d-9e1d-59b0c7c615f0 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:29.128760 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-852c3302-7738-4e7d-9e1d-59b0c7c615f0 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:29.129477 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-852c3302-7738-4e7d-9e1d-59b0c7c615f0 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:29.130104 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-852c3302-7738-4e7d-9e1d-59b0c7c615f0 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:29.135853 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:56:29.630543 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-852c3302-7738-4e7d-9e1d-59b0c7c615f0 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e787e0b494764176a0f13d75c47d77fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '371ecb87e8d34859971be23c1a1bc443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:56:29.654417 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-852c3302-7738-4e7d-9e1d-59b0c7c615f0 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] 10.222.0.18 "GET /compute/v2.1/servers/df5f7e8f-5ed6-4ad6-9bcb-eaa54b4ee320" status: 200 len: 1320 microversion: 2.1 time: 0.566450 Oct 22 20:56:29.656658 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 849/1793] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:56:29 2022] GET /compute/v2.1/servers/df5f7e8f-5ed6-4ad6-9bcb-eaa54b4ee320 => generated 1320 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:56:29.753430 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-ccf80382-7834-4eeb-83a9-64e1f70bf14e tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b392ad1fe1fd4b2a9e6be03a7435deb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594624ed28aa433d907c8833d360b82e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:56:29.768022 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-ccf80382-7834-4eeb-83a9-64e1f70bf14e tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] 10.222.0.18 "GET /compute/v2.1/servers/3de7ee82-86b9-4c34-8b81-46f09d6239d0" status: 200 len: 1324 microversion: 2.1 time: 0.777346 Oct 22 20:56:29.776324 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 945/1794] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:56:28 2022] GET /compute/v2.1/servers/3de7ee82-86b9-4c34-8b81-46f09d6239d0 => generated 1324 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:56:29.983702 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-74d330fd-574b-4095-88f4-d14a1b2e53e7 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:56:29.989426 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-74d330fd-574b-4095-88f4-d14a1b2e53e7 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] [instance: fe83cd49-4ceb-49aa-a775-cc2a4229fd76] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:56:30.010993 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-2af0886e-2869-45a2-8f3a-edd9e3b09da0 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:56:30.012331 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-2af0886e-2869-45a2-8f3a-edd9e3b09da0 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] [instance: 98f48cb1-54ed-4e82-8a25-fd004ddb5758] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:56:30.025013 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2af0886e-2869-45a2-8f3a-edd9e3b09da0 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:30.025836 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2af0886e-2869-45a2-8f3a-edd9e3b09da0 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:30.026444 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2af0886e-2869-45a2-8f3a-edd9e3b09da0 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:30.026620 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-74d330fd-574b-4095-88f4-d14a1b2e53e7 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:30.027548 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2af0886e-2869-45a2-8f3a-edd9e3b09da0 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:30.029201 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2af0886e-2869-45a2-8f3a-edd9e3b09da0 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:30.029596 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-74d330fd-574b-4095-88f4-d14a1b2e53e7 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:30.030329 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-74d330fd-574b-4095-88f4-d14a1b2e53e7 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:30.030733 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2af0886e-2869-45a2-8f3a-edd9e3b09da0 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:30.031595 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-74d330fd-574b-4095-88f4-d14a1b2e53e7 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:30.032073 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-74d330fd-574b-4095-88f4-d14a1b2e53e7 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:30.034307 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-74d330fd-574b-4095-88f4-d14a1b2e53e7 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:30.615875 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-74d330fd-574b-4095-88f4-d14a1b2e53e7 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c87f0356ca346f39c6216393d85da2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee8c8f7fc4e12bc1f9fcce3e7b581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:56:30.630202 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-2af0886e-2869-45a2-8f3a-edd9e3b09da0 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d3d7458af447bdb3f03e83a2d8559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49238b8686d24ae698679e4a1957735d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:56:30.639109 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-2af0886e-2869-45a2-8f3a-edd9e3b09da0 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] 10.222.0.18 "GET /compute/v2.1/servers/98f48cb1-54ed-4e82-8a25-fd004ddb5758" status: 200 len: 1468 microversion: 2.1 time: 0.632100 Oct 22 20:56:30.641527 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 946/1795] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:56:30 2022] GET /compute/v2.1/servers/98f48cb1-54ed-4e82-8a25-fd004ddb5758 => generated 1468 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:56:30.666213 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-a6ffa96f-c3ca-4aca-9a35-a877758e7ac0 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:56:30.669068 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-a6ffa96f-c3ca-4aca-9a35-a877758e7ac0 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] [instance: 98f48cb1-54ed-4e82-8a25-fd004ddb5758] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:56:30.669388 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-74d330fd-574b-4095-88f4-d14a1b2e53e7 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] 10.222.0.18 "GET /compute/v2.1/servers/fe83cd49-4ceb-49aa-a775-cc2a4229fd76" status: 200 len: 1499 microversion: 2.1 time: 0.679841 Oct 22 20:56:30.688594 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 850/1796] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:56:29 2022] GET /compute/v2.1/servers/fe83cd49-4ceb-49aa-a775-cc2a4229fd76 => generated 1499 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:56:30.689770 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a6ffa96f-c3ca-4aca-9a35-a877758e7ac0 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:30.690762 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a6ffa96f-c3ca-4aca-9a35-a877758e7ac0 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:30.691421 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a6ffa96f-c3ca-4aca-9a35-a877758e7ac0 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:30.692399 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a6ffa96f-c3ca-4aca-9a35-a877758e7ac0 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:30.693032 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a6ffa96f-c3ca-4aca-9a35-a877758e7ac0 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:30.693668 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a6ffa96f-c3ca-4aca-9a35-a877758e7ac0 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:30.708061 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-f048552c-3b38-43db-9c43-6a19489bc83b tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:56:30.708775 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-f048552c-3b38-43db-9c43-6a19489bc83b tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] [instance: df5f7e8f-5ed6-4ad6-9bcb-eaa54b4ee320] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:56:30.721386 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f048552c-3b38-43db-9c43-6a19489bc83b tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:30.722005 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f048552c-3b38-43db-9c43-6a19489bc83b tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:30.722494 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f048552c-3b38-43db-9c43-6a19489bc83b tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:30.723238 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f048552c-3b38-43db-9c43-6a19489bc83b tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:30.723730 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f048552c-3b38-43db-9c43-6a19489bc83b tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:30.724262 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f048552c-3b38-43db-9c43-6a19489bc83b tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:30.841649 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-a6ffa96f-c3ca-4aca-9a35-a877758e7ac0 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] 10.222.0.18 "POST /compute/v2.1/servers/98f48cb1-54ed-4e82-8a25-fd004ddb5758/action" status: 204 len: 0 microversion: 2.1 time: 0.179342 Oct 22 20:56:30.842785 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 947/1797] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 20:56:30 2022] POST /compute/v2.1/servers/98f48cb1-54ed-4e82-8a25-fd004ddb5758/action => generated 0 bytes in 181 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 20:56:30.874939 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-8fcb5acf-1d0b-472d-9df3-5aad1dcf7062 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:56:30.887918 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-8fcb5acf-1d0b-472d-9df3-5aad1dcf7062 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] [instance: 3de7ee82-86b9-4c34-8b81-46f09d6239d0] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:56:30.906488 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8fcb5acf-1d0b-472d-9df3-5aad1dcf7062 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:30.907283 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8fcb5acf-1d0b-472d-9df3-5aad1dcf7062 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:30.909222 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8fcb5acf-1d0b-472d-9df3-5aad1dcf7062 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:30.912021 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8fcb5acf-1d0b-472d-9df3-5aad1dcf7062 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:30.912811 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8fcb5acf-1d0b-472d-9df3-5aad1dcf7062 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:30.914620 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8fcb5acf-1d0b-472d-9df3-5aad1dcf7062 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:31.532337 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-8fcb5acf-1d0b-472d-9df3-5aad1dcf7062 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b392ad1fe1fd4b2a9e6be03a7435deb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594624ed28aa433d907c8833d360b82e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:56:31.546239 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-8fcb5acf-1d0b-472d-9df3-5aad1dcf7062 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] 10.222.0.18 "GET /compute/v2.1/servers/3de7ee82-86b9-4c34-8b81-46f09d6239d0" status: 200 len: 1324 microversion: 2.1 time: 0.702116 Oct 22 20:56:31.547100 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 948/1798] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:56:30 2022] GET /compute/v2.1/servers/3de7ee82-86b9-4c34-8b81-46f09d6239d0 => generated 1324 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:56:31.563282 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-a5d0824c-6695-409a-9b47-61d51f7cb97d tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:56:31.564346 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-a5d0824c-6695-409a-9b47-61d51f7cb97d tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] [instance: 98f48cb1-54ed-4e82-8a25-fd004ddb5758] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:56:31.570855 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a5d0824c-6695-409a-9b47-61d51f7cb97d tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:31.571653 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a5d0824c-6695-409a-9b47-61d51f7cb97d tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:31.572269 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a5d0824c-6695-409a-9b47-61d51f7cb97d tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:31.573179 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a5d0824c-6695-409a-9b47-61d51f7cb97d tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:31.573808 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a5d0824c-6695-409a-9b47-61d51f7cb97d tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:31.574408 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a5d0824c-6695-409a-9b47-61d51f7cb97d tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:32.174927 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-f048552c-3b38-43db-9c43-6a19489bc83b tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e787e0b494764176a0f13d75c47d77fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '371ecb87e8d34859971be23c1a1bc443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:56:32.200401 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-f048552c-3b38-43db-9c43-6a19489bc83b tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] 10.222.0.18 "GET /compute/v2.1/servers/df5f7e8f-5ed6-4ad6-9bcb-eaa54b4ee320" status: 200 len: 1512 microversion: 2.1 time: 1.509251 Oct 22 20:56:32.207598 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 851/1799] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:56:30 2022] GET /compute/v2.1/servers/df5f7e8f-5ed6-4ad6-9bcb-eaa54b4ee320 => generated 1512 bytes in 1517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:56:32.214497 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-f941ebe5-dd2d-47d5-9f33-c8164159bc07 req-e97e32fc-6ebb-4725-ac84-598ef4503f05 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3de7ee82-86b9-4c34-8b81-46f09d6239d0", "tag": "1f69f669-8018-4f6c-a6cf-2f988963a116"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:56:32.229407 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-f941ebe5-dd2d-47d5-9f33-c8164159bc07 req-e97e32fc-6ebb-4725-ac84-598ef4503f05 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:32.230203 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-f941ebe5-dd2d-47d5-9f33-c8164159bc07 req-e97e32fc-6ebb-4725-ac84-598ef4503f05 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:32.230836 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-f941ebe5-dd2d-47d5-9f33-c8164159bc07 req-e97e32fc-6ebb-4725-ac84-598ef4503f05 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:32.254173 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-f941ebe5-dd2d-47d5-9f33-c8164159bc07 req-e97e32fc-6ebb-4725-ac84-598ef4503f05 service nova] Creating event network-changed:1f69f669-8018-4f6c-a6cf-2f988963a116 for instance 3de7ee82-86b9-4c34-8b81-46f09d6239d0 on nch1-master-1 Oct 22 20:56:32.272252 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-f941ebe5-dd2d-47d5-9f33-c8164159bc07 req-e97e32fc-6ebb-4725-ac84-598ef4503f05 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062977 Oct 22 20:56:32.273503 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 852/1800] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:56:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:56:32.289853 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-cba3ef8d-1240-4567-9f20-ab02065c2ef8 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:56:32.310070 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-cba3ef8d-1240-4567-9f20-ab02065c2ef8 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] [instance: fe83cd49-4ceb-49aa-a775-cc2a4229fd76] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:56:32.348469 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cba3ef8d-1240-4567-9f20-ab02065c2ef8 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:32.349011 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cba3ef8d-1240-4567-9f20-ab02065c2ef8 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:32.349468 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cba3ef8d-1240-4567-9f20-ab02065c2ef8 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:32.350244 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cba3ef8d-1240-4567-9f20-ab02065c2ef8 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:32.350715 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cba3ef8d-1240-4567-9f20-ab02065c2ef8 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:32.351562 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cba3ef8d-1240-4567-9f20-ab02065c2ef8 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:32.432664 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cba3ef8d-1240-4567-9f20-ab02065c2ef8 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:32.435859 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cba3ef8d-1240-4567-9f20-ab02065c2ef8 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:32.436684 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cba3ef8d-1240-4567-9f20-ab02065c2ef8 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:32.444334 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.objects.instance [None req-cba3ef8d-1240-4567-9f20-ab02065c2ef8 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lazy-loading 'fault' on Instance uuid fe83cd49-4ceb-49aa-a775-cc2a4229fd76 {{(pid=138744) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 20:56:32.518243 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-a5d0824c-6695-409a-9b47-61d51f7cb97d tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d3d7458af447bdb3f03e83a2d8559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49238b8686d24ae698679e4a1957735d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:56:32.534455 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-a5d0824c-6695-409a-9b47-61d51f7cb97d tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] 10.222.0.18 "GET /compute/v2.1/servers/98f48cb1-54ed-4e82-8a25-fd004ddb5758" status: 200 len: 1468 microversion: 2.1 time: 0.985946 Oct 22 20:56:32.551759 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 949/1801] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:56:31 2022] GET /compute/v2.1/servers/98f48cb1-54ed-4e82-8a25-fd004ddb5758 => generated 1468 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:56:32.557192 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-5fc8020d-4ab0-4c97-b153-88e26a66da41 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:56:32.557850 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-5fc8020d-4ab0-4c97-b153-88e26a66da41 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] [instance: 28c2b09f-e43f-472b-b8db-f407c341acfd] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:56:32.566536 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5fc8020d-4ab0-4c97-b153-88e26a66da41 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:32.567045 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5fc8020d-4ab0-4c97-b153-88e26a66da41 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:32.567565 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5fc8020d-4ab0-4c97-b153-88e26a66da41 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:32.568290 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5fc8020d-4ab0-4c97-b153-88e26a66da41 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:32.580467 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5fc8020d-4ab0-4c97-b153-88e26a66da41 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:32.581323 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5fc8020d-4ab0-4c97-b153-88e26a66da41 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:32.615051 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:56:32.804842 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-cba3ef8d-1240-4567-9f20-ab02065c2ef8 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c87f0356ca346f39c6216393d85da2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee8c8f7fc4e12bc1f9fcce3e7b581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:56:32.814388 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-cba3ef8d-1240-4567-9f20-ab02065c2ef8 tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] 10.222.0.18 "GET /compute/v2.1/servers/fe83cd49-4ceb-49aa-a775-cc2a4229fd76" status: 200 len: 1300 microversion: 2.1 time: 0.538649 Oct 22 20:56:32.831800 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 853/1802] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:56:32 2022] GET /compute/v2.1/servers/fe83cd49-4ceb-49aa-a775-cc2a4229fd76 => generated 1300 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:56:32.837954 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-bde010e1-0798-4a51-9dcb-d6424da0a4c5 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:56:32.838782 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-bde010e1-0798-4a51-9dcb-d6424da0a4c5 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] [instance: 3de7ee82-86b9-4c34-8b81-46f09d6239d0] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:56:32.845400 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bde010e1-0798-4a51-9dcb-d6424da0a4c5 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:32.846539 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bde010e1-0798-4a51-9dcb-d6424da0a4c5 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:32.847182 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bde010e1-0798-4a51-9dcb-d6424da0a4c5 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:32.848145 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bde010e1-0798-4a51-9dcb-d6424da0a4c5 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:32.848779 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bde010e1-0798-4a51-9dcb-d6424da0a4c5 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:32.849383 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bde010e1-0798-4a51-9dcb-d6424da0a4c5 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:33.639632 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-bde010e1-0798-4a51-9dcb-d6424da0a4c5 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b392ad1fe1fd4b2a9e6be03a7435deb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594624ed28aa433d907c8833d360b82e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:56:33.649372 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-bde010e1-0798-4a51-9dcb-d6424da0a4c5 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] 10.222.0.18 "GET /compute/v2.1/servers/3de7ee82-86b9-4c34-8b81-46f09d6239d0" status: 200 len: 1324 microversion: 2.1 time: 0.816312 Oct 22 20:56:33.667221 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 854/1803] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:56:32 2022] GET /compute/v2.1/servers/3de7ee82-86b9-4c34-8b81-46f09d6239d0 => generated 1324 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:56:33.675165 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-e0c35e7a-99c2-4807-8b75-8c70e321fcba req-f835c86b-6eda-4c3d-92ef-91e912a5ace9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98f48cb1-54ed-4e82-8a25-fd004ddb5758", "name": "network-vif-plugged", "status": "completed", "tag": "1d82207b-0e45-42ab-8c7f-4bf4bac8d993"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:56:33.692800 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-e0c35e7a-99c2-4807-8b75-8c70e321fcba req-f835c86b-6eda-4c3d-92ef-91e912a5ace9 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:33.693591 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-e0c35e7a-99c2-4807-8b75-8c70e321fcba req-f835c86b-6eda-4c3d-92ef-91e912a5ace9 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:33.695559 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-e0c35e7a-99c2-4807-8b75-8c70e321fcba req-f835c86b-6eda-4c3d-92ef-91e912a5ace9 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:33.699137 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-5fc8020d-4ab0-4c97-b153-88e26a66da41 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e787e0b494764176a0f13d75c47d77fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '371ecb87e8d34859971be23c1a1bc443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:56:33.708504 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-5fc8020d-4ab0-4c97-b153-88e26a66da41 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] 10.222.0.18 "GET /compute/v2.1/servers/28c2b09f-e43f-472b-b8db-f407c341acfd" status: 200 len: 1512 microversion: 2.1 time: 1.155225 Oct 22 20:56:33.718468 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-e0c35e7a-99c2-4807-8b75-8c70e321fcba req-f835c86b-6eda-4c3d-92ef-91e912a5ace9 service nova] Creating event network-vif-plugged:1d82207b-0e45-42ab-8c7f-4bf4bac8d993 for instance 98f48cb1-54ed-4e82-8a25-fd004ddb5758 on nch1-master-1 Oct 22 20:56:33.728094 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [req-e0c35e7a-99c2-4807-8b75-8c70e321fcba req-f835c86b-6eda-4c3d-92ef-91e912a5ace9 service nova] Instance 98f48cb1-54ed-4e82-8a25-fd004ddb5758 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=138744) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 22 20:56:33.730163 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 950/1804] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:56:32 2022] GET /compute/v2.1/servers/28c2b09f-e43f-472b-b8db-f407c341acfd => generated 1512 bytes in 1177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:56:33.738380 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-3227ff9c-0e99-4b27-92e0-a4b643f47e35 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:56:33.741617 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-3227ff9c-0e99-4b27-92e0-a4b643f47e35 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] [instance: 98f48cb1-54ed-4e82-8a25-fd004ddb5758] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:56:33.757702 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-e0c35e7a-99c2-4807-8b75-8c70e321fcba req-f835c86b-6eda-4c3d-92ef-91e912a5ace9 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087744 Oct 22 20:56:33.758049 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3227ff9c-0e99-4b27-92e0-a4b643f47e35 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:33.759631 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3227ff9c-0e99-4b27-92e0-a4b643f47e35 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:33.759784 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 855/1805] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:56:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:56:33.760081 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3227ff9c-0e99-4b27-92e0-a4b643f47e35 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:33.761741 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3227ff9c-0e99-4b27-92e0-a4b643f47e35 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:33.762212 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3227ff9c-0e99-4b27-92e0-a4b643f47e35 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:33.762644 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3227ff9c-0e99-4b27-92e0-a4b643f47e35 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:33.767605 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-8d1372b1-7d79-40d4-9e98-13f1932356f1 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:56:33.768583 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-8d1372b1-7d79-40d4-9e98-13f1932356f1 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] [instance: c5db8404-7c9d-41d4-a018-a27058378d35] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:56:33.780403 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8d1372b1-7d79-40d4-9e98-13f1932356f1 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:33.781183 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8d1372b1-7d79-40d4-9e98-13f1932356f1 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:33.781825 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8d1372b1-7d79-40d4-9e98-13f1932356f1 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:33.782819 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8d1372b1-7d79-40d4-9e98-13f1932356f1 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:33.783506 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8d1372b1-7d79-40d4-9e98-13f1932356f1 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:33.784271 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8d1372b1-7d79-40d4-9e98-13f1932356f1 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:34.201122 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-8d1372b1-7d79-40d4-9e98-13f1932356f1 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e787e0b494764176a0f13d75c47d77fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '371ecb87e8d34859971be23c1a1bc443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:56:34.210252 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-3227ff9c-0e99-4b27-92e0-a4b643f47e35 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d3d7458af447bdb3f03e83a2d8559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49238b8686d24ae698679e4a1957735d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:56:34.211079 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-8d1372b1-7d79-40d4-9e98-13f1932356f1 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] 10.222.0.18 "GET /compute/v2.1/servers/c5db8404-7c9d-41d4-a018-a27058378d35" status: 200 len: 1513 microversion: 2.1 time: 0.449190 Oct 22 20:56:34.212322 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 856/1806] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:56:33 2022] GET /compute/v2.1/servers/c5db8404-7c9d-41d4-a018-a27058378d35 => generated 1513 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:56:34.217808 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-739c3f25-2cc8-4233-bed3-eb1774a0d79a tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:56:34.218684 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-739c3f25-2cc8-4233-bed3-eb1774a0d79a tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] [instance: fe83cd49-4ceb-49aa-a775-cc2a4229fd76] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:56:34.226864 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-739c3f25-2cc8-4233-bed3-eb1774a0d79a tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:34.228027 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-739c3f25-2cc8-4233-bed3-eb1774a0d79a tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:34.228544 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-739c3f25-2cc8-4233-bed3-eb1774a0d79a tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:34.229888 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-739c3f25-2cc8-4233-bed3-eb1774a0d79a tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:34.230593 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-739c3f25-2cc8-4233-bed3-eb1774a0d79a tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:34.231235 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-739c3f25-2cc8-4233-bed3-eb1774a0d79a tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:34.236149 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-3227ff9c-0e99-4b27-92e0-a4b643f47e35 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] 10.222.0.18 "GET /compute/v2.1/servers/98f48cb1-54ed-4e82-8a25-fd004ddb5758" status: 200 len: 1468 microversion: 2.1 time: 0.504061 Oct 22 20:56:34.237929 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 951/1807] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:56:33 2022] GET /compute/v2.1/servers/98f48cb1-54ed-4e82-8a25-fd004ddb5758 => generated 1468 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:56:34.244651 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-305e43be-311a-4340-8a18-ccc1d06da3a9 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:56:34.250344 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-305e43be-311a-4340-8a18-ccc1d06da3a9 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e787e0b494764176a0f13d75c47d77fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '371ecb87e8d34859971be23c1a1bc443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:56:34.251672 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-305e43be-311a-4340-8a18-ccc1d06da3a9 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '371ecb87e8d34859971be23c1a1bc443'} {{(pid=138745) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 22 20:56:34.268747 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-739c3f25-2cc8-4233-bed3-eb1774a0d79a tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] HTTP exception thrown: Instance fe83cd49-4ceb-49aa-a775-cc2a4229fd76 could not be found. Oct 22 20:56:34.270780 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-305e43be-311a-4340-8a18-ccc1d06da3a9 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:34.271256 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-739c3f25-2cc8-4233-bed3-eb1774a0d79a tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Request method failure captured: Oct 22 20:56:34.271256 ncdv-master-1 devstack@n-api.service[138744]: request: GET /compute/v2.1/servers/fe83cd49-4ceb-49aa-a775-cc2a4229fd76 HTTP/1.1 Oct 22 20:56:34.271256 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 20:56:34.271256 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 20:56:34.271256 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 20:56:34.271256 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 0 Oct 22 20:56:34.271256 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 20:56:34.271256 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 20:56:34.271256 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 20:56:34.271256 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 20:56:34.271256 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVFd3L1O9buG2NKok4Z3OhlPg9uJowRL-QIrWO2UXrdAMWoEA07U7Qwd3UcRw5_kRV78yVlG8-xf-9bQgrD-lSc6Kuqan6Pt9NTBZahyGUD3ZZ-4gkCHlC4kIKTqF1xcLu4qJCXK_NR7T7vH-rSU8EgD59OAikcfPJ0amh6d8LDt5JQQ Oct 22 20:56:34.271256 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 20:56:34.271256 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 20:56:34.271256 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 20:56:34.271256 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 20:56:34.271256 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 20:56:34.271256 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 20:56:34.271256 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: 9f0ee8c8f7fc4e12bc1f9fcce3e7b581 Oct 22 20:56:34.271256 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-LiveMigrationTest-26615209 Oct 22 20:56:34.271256 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 20:56:34.271256 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 20:56:34.271256 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_9f0ee8c8f7fc4e12bc1f9fcce3e7b581"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9f0ee8c8f7fc4e12bc1f9fcce3e7b581"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/9f0ee8c8f7fc4e12bc1f9fcce3e7b581"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9f0ee8c8f7fc4e12bc1f9fcce3e7b581"}]}] Oct 22 20:56:34.271256 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-LiveMigrationTest-26615209 Oct 22 20:56:34.271256 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: 9f0ee8c8f7fc4e12bc1f9fcce3e7b581 Oct 22 20:56:34.271256 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-LiveMigrationTest-26615209 Oct 22 20:56:34.271256 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-LiveMigrationTest-26615209-project Oct 22 20:56:34.271256 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 20:56:34.271256 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 20:56:34.271256 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: 2c87f0356ca346f39c6216393d85da2f Oct 22 20:56:34.271256 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-LiveMigrationTest-26615209-project Oct 22 20:56:34.271256 ncdv-master-1 devstack@n-api.service[138744]: method: > Oct 22 20:56:34.271256 ncdv-master-1 devstack@n-api.service[138744]: exception: Instance fe83cd49-4ceb-49aa-a775-cc2a4229fd76 could not be found. Oct 22 20:56:34.271256 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': 'fe83cd49-4ceb-49aa-a775-cc2a4229fd76'} Oct 22 20:56:34.271256 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:56:34.271256 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:56:34.271256 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 20:56:34.271256 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 20:56:34.271256 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 20:56:34.271256 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 20:56:34.271256 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 20:56:34.271256 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 20:56:34.271256 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 20:56:34.271256 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 20:56:34.271256 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe83cd49-4ceb-49aa-a775-cc2a4229fd76 could not be found. Oct 22 20:56:34.271256 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:56:34.271256 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:56:34.271256 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:56:34.271256 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:56:34.271256 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:56:34.271256 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:56:34.271256 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:56:34.271256 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:56:34.271256 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:56:34.271256 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:56:34.271256 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 20:56:34.271256 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 20:56:34.271256 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 20:56:34.271256 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 20:56:34.271256 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 20:56:34.271256 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 20:56:34.271256 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe83cd49-4ceb-49aa-a775-cc2a4229fd76 could not be found. Oct 22 20:56:34.271256 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:56:34.271256 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:56:34.271256 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:56:34.278126 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:56:34.278126 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:56:34.278126 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:56:34.278126 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 20:56:34.278126 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 20:56:34.278126 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe83cd49-4ceb-49aa-a775-cc2a4229fd76 could not be found. Oct 22 20:56:34.278126 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:56:34.280080 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-305e43be-311a-4340-8a18-ccc1d06da3a9 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:34.286161 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-305e43be-311a-4340-8a18-ccc1d06da3a9 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:34.288348 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-739c3f25-2cc8-4233-bed3-eb1774a0d79a tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] Returning 404 to user: Instance fe83cd49-4ceb-49aa-a775-cc2a4229fd76 could not be found. {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:56:34.288862 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-305e43be-311a-4340-8a18-ccc1d06da3a9 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:34.289947 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-739c3f25-2cc8-4233-bed3-eb1774a0d79a tempest-LiveMigrationTest-26615209 tempest-LiveMigrationTest-26615209-project] 10.222.0.18 "GET /compute/v2.1/servers/fe83cd49-4ceb-49aa-a775-cc2a4229fd76" status: 404 len: 111 microversion: 2.1 time: 0.076388 Oct 22 20:56:34.290115 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-305e43be-311a-4340-8a18-ccc1d06da3a9 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:34.291254 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 857/1808] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:56:34 2022] GET /compute/v2.1/servers/fe83cd49-4ceb-49aa-a775-cc2a4229fd76 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 20:56:34.291426 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-305e43be-311a-4340-8a18-ccc1d06da3a9 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:34.310534 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-f7ea0a8e-9f30-4a08-bc6a-6dc9224da3e2 req-6b269813-734a-4f16-b2a7-43e450743e7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe83cd49-4ceb-49aa-a775-cc2a4229fd76", "name": "network-vif-deleted", "tag": "5f1c98e3-36fa-4e76-8bc6-b184fe0c58b3"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:56:34.332106 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-f7ea0a8e-9f30-4a08-bc6a-6dc9224da3e2 req-6b269813-734a-4f16-b2a7-43e450743e7a service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:34.332931 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-f7ea0a8e-9f30-4a08-bc6a-6dc9224da3e2 req-6b269813-734a-4f16-b2a7-43e450743e7a service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:34.333630 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-f7ea0a8e-9f30-4a08-bc6a-6dc9224da3e2 req-6b269813-734a-4f16-b2a7-43e450743e7a service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:34.355152 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-f7ea0a8e-9f30-4a08-bc6a-6dc9224da3e2 req-6b269813-734a-4f16-b2a7-43e450743e7a service nova] Creating event network-vif-deleted:5f1c98e3-36fa-4e76-8bc6-b184fe0c58b3 for instance fe83cd49-4ceb-49aa-a775-cc2a4229fd76 on nch1-master-1 Oct 22 20:56:34.363885 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-f7ea0a8e-9f30-4a08-bc6a-6dc9224da3e2 req-6b269813-734a-4f16-b2a7-43e450743e7a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055730 Oct 22 20:56:34.364915 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 858/1809] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:56:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 20:56:34.417715 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.multi_cell_list [None req-305e43be-311a-4340-8a18-ccc1d06da3a9 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=138745) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 22 20:56:34.561466 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-305e43be-311a-4340-8a18-ccc1d06da3a9 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e787e0b494764176a0f13d75c47d77fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '371ecb87e8d34859971be23c1a1bc443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:56:34.569987 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-305e43be-311a-4340-8a18-ccc1d06da3a9 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:34.570485 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-305e43be-311a-4340-8a18-ccc1d06da3a9 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:34.570981 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-305e43be-311a-4340-8a18-ccc1d06da3a9 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:34.674676 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-f1100b18-774a-470c-b551-a869560d7a85 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:56:34.676189 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-f1100b18-774a-470c-b551-a869560d7a85 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] [instance: 3de7ee82-86b9-4c34-8b81-46f09d6239d0] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:56:34.683268 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f1100b18-774a-470c-b551-a869560d7a85 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:34.684090 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f1100b18-774a-470c-b551-a869560d7a85 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:34.684768 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f1100b18-774a-470c-b551-a869560d7a85 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:34.685744 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f1100b18-774a-470c-b551-a869560d7a85 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:34.686426 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f1100b18-774a-470c-b551-a869560d7a85 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:34.687078 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f1100b18-774a-470c-b551-a869560d7a85 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:35.012118 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-305e43be-311a-4340-8a18-ccc1d06da3a9 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] 10.222.0.18 "GET /compute/v2.1/servers/detail?flavor=451" status: 200 len: 1515 microversion: 2.1 time: 0.772781 Oct 22 20:56:35.012712 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 952/1810] 10.222.0.18 () {58 vars in 1167 bytes} [Sat Oct 22 20:56:34 2022] GET /compute/v2.1/servers/detail?flavor=451 => generated 1515 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:56:35.038412 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-f1c80ff6-b99b-4a93-b526-b48f4cb35f97 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:56:35.044401 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-f1c80ff6-b99b-4a93-b526-b48f4cb35f97 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e787e0b494764176a0f13d75c47d77fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '371ecb87e8d34859971be23c1a1bc443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:56:35.045454 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-f1c80ff6-b99b-4a93-b526-b48f4cb35f97 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-1800526150', 'deleted': False, 'project_id': '371ecb87e8d34859971be23c1a1bc443'} {{(pid=138745) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 22 20:56:35.052157 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f1c80ff6-b99b-4a93-b526-b48f4cb35f97 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:35.052839 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f1c80ff6-b99b-4a93-b526-b48f4cb35f97 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:35.054142 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f1c80ff6-b99b-4a93-b526-b48f4cb35f97 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:35.055212 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f1c80ff6-b99b-4a93-b526-b48f4cb35f97 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:35.066695 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f1c80ff6-b99b-4a93-b526-b48f4cb35f97 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:35.067489 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f1c80ff6-b99b-4a93-b526-b48f4cb35f97 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:35.326707 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-f1100b18-774a-470c-b551-a869560d7a85 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b392ad1fe1fd4b2a9e6be03a7435deb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594624ed28aa433d907c8833d360b82e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:56:35.342524 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-f1100b18-774a-470c-b551-a869560d7a85 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] 10.222.0.18 "GET /compute/v2.1/servers/3de7ee82-86b9-4c34-8b81-46f09d6239d0" status: 200 len: 1324 microversion: 2.1 time: 0.672152 Oct 22 20:56:35.363064 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 859/1811] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:56:34 2022] GET /compute/v2.1/servers/3de7ee82-86b9-4c34-8b81-46f09d6239d0 => generated 1324 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:56:35.371855 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-6284952f-c64a-47ce-a8b9-6adaefbe445f tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:56:35.372495 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-6284952f-c64a-47ce-a8b9-6adaefbe445f tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] [instance: 98f48cb1-54ed-4e82-8a25-fd004ddb5758] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:56:35.391873 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6284952f-c64a-47ce-a8b9-6adaefbe445f tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:35.393065 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6284952f-c64a-47ce-a8b9-6adaefbe445f tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:35.394288 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6284952f-c64a-47ce-a8b9-6adaefbe445f tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:35.398209 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6284952f-c64a-47ce-a8b9-6adaefbe445f tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:35.398835 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6284952f-c64a-47ce-a8b9-6adaefbe445f tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:35.399329 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6284952f-c64a-47ce-a8b9-6adaefbe445f tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:35.749950 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.multi_cell_list [None req-f1c80ff6-b99b-4a93-b526-b48f4cb35f97 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=138745) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 22 20:56:35.868346 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-f1c80ff6-b99b-4a93-b526-b48f4cb35f97 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e787e0b494764176a0f13d75c47d77fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '371ecb87e8d34859971be23c1a1bc443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:56:35.876199 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f1c80ff6-b99b-4a93-b526-b48f4cb35f97 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:35.876973 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f1c80ff6-b99b-4a93-b526-b48f4cb35f97 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:35.877645 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f1c80ff6-b99b-4a93-b526-b48f4cb35f97 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:36.029644 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-6284952f-c64a-47ce-a8b9-6adaefbe445f tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d3d7458af447bdb3f03e83a2d8559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49238b8686d24ae698679e4a1957735d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:56:36.049872 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-6284952f-c64a-47ce-a8b9-6adaefbe445f tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] 10.222.0.18 "GET /compute/v2.1/servers/98f48cb1-54ed-4e82-8a25-fd004ddb5758" status: 200 len: 1460 microversion: 2.1 time: 0.685419 Oct 22 20:56:36.052358 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 860/1812] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:56:35 2022] GET /compute/v2.1/servers/98f48cb1-54ed-4e82-8a25-fd004ddb5758 => generated 1460 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:56:36.075247 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-beb59732-a7f2-45ab-873b-3acc8285e082 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:56:36.076145 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-beb59732-a7f2-45ab-873b-3acc8285e082 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] [instance: 98f48cb1-54ed-4e82-8a25-fd004ddb5758] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:56:36.084621 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-beb59732-a7f2-45ab-873b-3acc8285e082 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:36.085475 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-beb59732-a7f2-45ab-873b-3acc8285e082 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:36.086131 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-beb59732-a7f2-45ab-873b-3acc8285e082 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:36.087196 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-beb59732-a7f2-45ab-873b-3acc8285e082 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:36.087843 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-beb59732-a7f2-45ab-873b-3acc8285e082 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:36.088467 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-beb59732-a7f2-45ab-873b-3acc8285e082 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:36.318986 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-f1c80ff6-b99b-4a93-b526-b48f4cb35f97 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] 10.222.0.18 "GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-1800526150" status: 200 len: 1515 microversion: 2.1 time: 1.283947 Oct 22 20:56:36.321013 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 953/1813] 10.222.0.18 () {58 vars in 1263 bytes} [Sat Oct 22 20:56:35 2022] GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-1800526150 => generated 1515 bytes in 1287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:56:36.344409 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-a87270eb-e825-4747-859f-eff34a9f8a55 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:56:36.350439 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-a87270eb-e825-4747-859f-eff34a9f8a55 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e787e0b494764176a0f13d75c47d77fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '371ecb87e8d34859971be23c1a1bc443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:56:36.351881 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-a87270eb-e825-4747-859f-eff34a9f8a55 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '371ecb87e8d34859971be23c1a1bc443'} {{(pid=138745) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 22 20:56:36.357677 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a87270eb-e825-4747-859f-eff34a9f8a55 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:36.358434 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a87270eb-e825-4747-859f-eff34a9f8a55 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:36.359096 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a87270eb-e825-4747-859f-eff34a9f8a55 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:36.360073 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a87270eb-e825-4747-859f-eff34a9f8a55 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:36.360747 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a87270eb-e825-4747-859f-eff34a9f8a55 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:36.361403 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a87270eb-e825-4747-859f-eff34a9f8a55 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:36.470288 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.multi_cell_list [None req-a87270eb-e825-4747-859f-eff34a9f8a55 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=138745) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 22 20:56:36.574825 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-a87270eb-e825-4747-859f-eff34a9f8a55 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e787e0b494764176a0f13d75c47d77fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '371ecb87e8d34859971be23c1a1bc443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:56:36.585095 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a87270eb-e825-4747-859f-eff34a9f8a55 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:36.586138 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a87270eb-e825-4747-859f-eff34a9f8a55 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:36.586741 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a87270eb-e825-4747-859f-eff34a9f8a55 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:36.917234 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-beb59732-a7f2-45ab-873b-3acc8285e082 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d3d7458af447bdb3f03e83a2d8559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49238b8686d24ae698679e4a1957735d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:56:36.937441 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-beb59732-a7f2-45ab-873b-3acc8285e082 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] 10.222.0.18 "GET /compute/v2.1/servers/98f48cb1-54ed-4e82-8a25-fd004ddb5758" status: 200 len: 1460 microversion: 2.1 time: 0.863962 Oct 22 20:56:36.961946 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 861/1814] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:56:36 2022] GET /compute/v2.1/servers/98f48cb1-54ed-4e82-8a25-fd004ddb5758 => generated 1460 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:56:36.977246 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-fcb22640-da68-4084-8e07-3d5da7bb8d73 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:56:36.979430 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-fcb22640-da68-4084-8e07-3d5da7bb8d73 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] [instance: 3de7ee82-86b9-4c34-8b81-46f09d6239d0] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:56:36.993258 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fcb22640-da68-4084-8e07-3d5da7bb8d73 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:36.995754 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fcb22640-da68-4084-8e07-3d5da7bb8d73 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:36.997526 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fcb22640-da68-4084-8e07-3d5da7bb8d73 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:36.999714 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fcb22640-da68-4084-8e07-3d5da7bb8d73 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:37.001938 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fcb22640-da68-4084-8e07-3d5da7bb8d73 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:37.004351 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fcb22640-da68-4084-8e07-3d5da7bb8d73 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:37.379929 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-a87270eb-e825-4747-859f-eff34a9f8a55 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] 10.222.0.18 "GET /compute/v2.1/servers/detail?status=active" status: 200 len: 4520 microversion: 2.1 time: 1.039156 Oct 22 20:56:37.381901 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 954/1815] 10.222.0.18 () {58 vars in 1173 bytes} [Sat Oct 22 20:56:36 2022] GET /compute/v2.1/servers/detail?status=active => generated 4520 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:56:37.390600 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-7bae8e51-2611-41c7-a3cf-a78fa9afe021 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Action: 'create', calling method: .version_select at 0x7fd39fc635e0>, body: {"keypair": {"name": "tempest-keypair-1223693064", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPLuIZMV/qF/dDxnHalKSbET46XvyCnjvOFOP0HvS6RoDOlfPsCiuKqNopr+iRps8x7jOKsoDZ5rsAkkITUOjqVsJFUCh003W8avnSgpJ63sMngj7KWOyNERfrGB3xorFA=="}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:56:37.435646 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-7bae8e51-2611-41c7-a3cf-a78fa9afe021 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Getting quotas for project 49238b8686d24ae698679e4a1957735d. Resources: {'key_pairs'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 20:56:37.442785 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-7bae8e51-2611-41c7-a3cf-a78fa9afe021 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Getting quotas for user e0d3d7458af447bdb3f03e83a2d8559f and project 49238b8686d24ae698679e4a1957735d. Resources: {'key_pairs'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 20:56:37.488889 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-7bae8e51-2611-41c7-a3cf-a78fa9afe021 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.103786 Oct 22 20:56:37.490312 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 955/1816] 10.222.0.18 () {60 vars in 1159 bytes} [Sat Oct 22 20:56:37 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:56:37.497699 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-bec4647f-3cf3-4959-847b-6bd0e2706297 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:56:37.507683 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-bec4647f-3cf3-4959-847b-6bd0e2706297 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e787e0b494764176a0f13d75c47d77fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '371ecb87e8d34859971be23c1a1bc443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:56:37.508156 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.compute.servers [None req-bec4647f-3cf3-4959-847b-6bd0e2706297 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Removing options 'limit' from query {{(pid=138745) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 22 20:56:37.508926 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-bec4647f-3cf3-4959-847b-6bd0e2706297 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Searching by: {'deleted': False, 'project_id': '371ecb87e8d34859971be23c1a1bc443'} {{(pid=138745) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 22 20:56:37.538856 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bec4647f-3cf3-4959-847b-6bd0e2706297 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:37.539424 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bec4647f-3cf3-4959-847b-6bd0e2706297 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:37.539820 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bec4647f-3cf3-4959-847b-6bd0e2706297 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:37.540550 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bec4647f-3cf3-4959-847b-6bd0e2706297 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:37.541205 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bec4647f-3cf3-4959-847b-6bd0e2706297 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:37.552139 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bec4647f-3cf3-4959-847b-6bd0e2706297 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:37.742553 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-bec4647f-3cf3-4959-847b-6bd0e2706297 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e787e0b494764176a0f13d75c47d77fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '371ecb87e8d34859971be23c1a1bc443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:56:37.756157 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bec4647f-3cf3-4959-847b-6bd0e2706297 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:37.756694 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bec4647f-3cf3-4959-847b-6bd0e2706297 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:37.757575 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bec4647f-3cf3-4959-847b-6bd0e2706297 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:38.076287 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-fcb22640-da68-4084-8e07-3d5da7bb8d73 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b392ad1fe1fd4b2a9e6be03a7435deb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594624ed28aa433d907c8833d360b82e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:56:38.089615 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-fcb22640-da68-4084-8e07-3d5da7bb8d73 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] 10.222.0.18 "GET /compute/v2.1/servers/3de7ee82-86b9-4c34-8b81-46f09d6239d0" status: 200 len: 1324 microversion: 2.1 time: 1.125233 Oct 22 20:56:38.095702 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 862/1817] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:56:36 2022] GET /compute/v2.1/servers/3de7ee82-86b9-4c34-8b81-46f09d6239d0 => generated 1324 bytes in 1134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:56:38.446044 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-bec4647f-3cf3-4959-847b-6bd0e2706297 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] 10.222.0.18 "GET /compute/v2.1/servers/detail?limit=1" status: 200 len: 1661 microversion: 2.1 time: 0.954200 Oct 22 20:56:38.447975 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 956/1818] 10.222.0.18 () {58 vars in 1161 bytes} [Sat Oct 22 20:56:37 2022] GET /compute/v2.1/servers/detail?limit=1 => generated 1661 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:56:38.473463 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-dda15c29-5bcb-4a0c-8b97-e47d4412bf54 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:56:38.483922 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-dda15c29-5bcb-4a0c-8b97-e47d4412bf54 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e787e0b494764176a0f13d75c47d77fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '371ecb87e8d34859971be23c1a1bc443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:56:38.486670 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-dda15c29-5bcb-4a0c-8b97-e47d4412bf54 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '371ecb87e8d34859971be23c1a1bc443'} {{(pid=138744) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 22 20:56:38.502888 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-dda15c29-5bcb-4a0c-8b97-e47d4412bf54 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:38.504349 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-dda15c29-5bcb-4a0c-8b97-e47d4412bf54 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:38.505529 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-dda15c29-5bcb-4a0c-8b97-e47d4412bf54 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:38.508373 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-dda15c29-5bcb-4a0c-8b97-e47d4412bf54 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:38.510960 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-dda15c29-5bcb-4a0c-8b97-e47d4412bf54 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:38.515574 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-dda15c29-5bcb-4a0c-8b97-e47d4412bf54 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:38.687177 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.multi_cell_list [None req-dda15c29-5bcb-4a0c-8b97-e47d4412bf54 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=138744) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 22 20:56:38.815190 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-dda15c29-5bcb-4a0c-8b97-e47d4412bf54 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] 10.222.0.18 "GET /compute/v2.1/servers?status=active" status: 200 len: 1011 microversion: 2.1 time: 0.346939 Oct 22 20:56:38.817483 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 863/1819] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Oct 22 20:56:38 2022] GET /compute/v2.1/servers?status=active => generated 1011 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:56:38.833917 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-fbe1e2b5-95bb-4d0f-bc3c-66aac0fea995 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:56:38.840527 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-fbe1e2b5-95bb-4d0f-bc3c-66aac0fea995 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e787e0b494764176a0f13d75c47d77fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '371ecb87e8d34859971be23c1a1bc443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:56:38.840983 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.compute.servers [None req-fbe1e2b5-95bb-4d0f-bc3c-66aac0fea995 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Removing options 'limit' from query {{(pid=138745) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 22 20:56:38.841650 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-fbe1e2b5-95bb-4d0f-bc3c-66aac0fea995 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Searching by: {'deleted': False, 'project_id': '371ecb87e8d34859971be23c1a1bc443'} {{(pid=138745) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 22 20:56:38.858420 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fbe1e2b5-95bb-4d0f-bc3c-66aac0fea995 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:38.861481 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fbe1e2b5-95bb-4d0f-bc3c-66aac0fea995 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:38.863403 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fbe1e2b5-95bb-4d0f-bc3c-66aac0fea995 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:38.864934 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fbe1e2b5-95bb-4d0f-bc3c-66aac0fea995 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:38.865868 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fbe1e2b5-95bb-4d0f-bc3c-66aac0fea995 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:38.867536 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fbe1e2b5-95bb-4d0f-bc3c-66aac0fea995 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:38.929774 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.multi_cell_list [None req-fbe1e2b5-95bb-4d0f-bc3c-66aac0fea995 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=138745) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 22 20:56:38.999738 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-fbe1e2b5-95bb-4d0f-bc3c-66aac0fea995 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] 10.222.0.18 "GET /compute/v2.1/servers?limit=100000" status: 200 len: 1011 microversion: 2.1 time: 0.170201 Oct 22 20:56:39.001166 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 957/1820] 10.222.0.18 () {58 vars in 1150 bytes} [Sat Oct 22 20:56:38 2022] GET /compute/v2.1/servers?limit=100000 => generated 1011 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:56:39.015760 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-ed9c69aa-1db0-4d38-bc15-4700b813bf04 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:56:39.022861 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-ed9c69aa-1db0-4d38-bc15-4700b813bf04 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e787e0b494764176a0f13d75c47d77fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '371ecb87e8d34859971be23c1a1bc443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:56:39.025825 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-ed9c69aa-1db0-4d38-bc15-4700b813bf04 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Searching by: {'deleted': False, 'project_id': '371ecb87e8d34859971be23c1a1bc443'} {{(pid=138744) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 22 20:56:39.039742 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ed9c69aa-1db0-4d38-bc15-4700b813bf04 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:39.040233 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ed9c69aa-1db0-4d38-bc15-4700b813bf04 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:39.040675 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ed9c69aa-1db0-4d38-bc15-4700b813bf04 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:39.043606 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ed9c69aa-1db0-4d38-bc15-4700b813bf04 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:39.044773 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ed9c69aa-1db0-4d38-bc15-4700b813bf04 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:39.046830 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ed9c69aa-1db0-4d38-bc15-4700b813bf04 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:39.103578 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.multi_cell_list [None req-ed9c69aa-1db0-4d38-bc15-4700b813bf04 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=138744) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 22 20:56:39.118419 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-3b6e7873-1755-4186-b20f-410cdc26b525 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:56:39.119428 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-3b6e7873-1755-4186-b20f-410cdc26b525 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] [instance: 3de7ee82-86b9-4c34-8b81-46f09d6239d0] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:56:39.129491 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3b6e7873-1755-4186-b20f-410cdc26b525 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:39.134448 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3b6e7873-1755-4186-b20f-410cdc26b525 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:39.136013 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3b6e7873-1755-4186-b20f-410cdc26b525 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:39.140237 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3b6e7873-1755-4186-b20f-410cdc26b525 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:39.142485 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3b6e7873-1755-4186-b20f-410cdc26b525 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:39.143119 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3b6e7873-1755-4186-b20f-410cdc26b525 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:39.206931 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-ed9c69aa-1db0-4d38-bc15-4700b813bf04 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] 10.222.0.18 "GET /compute/v2.1/servers" status: 200 len: 1011 microversion: 2.1 time: 0.197054 Oct 22 20:56:39.209807 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 864/1821] 10.222.0.18 () {58 vars in 1125 bytes} [Sat Oct 22 20:56:39 2022] GET /compute/v2.1/servers => generated 1011 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:56:39.237020 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-7590b05d-0c17-4ba2-ac94-ed9ca3466276 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:56:39.254112 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-7590b05d-0c17-4ba2-ac94-ed9ca3466276 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e787e0b494764176a0f13d75c47d77fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '371ecb87e8d34859971be23c1a1bc443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:56:39.258095 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-7590b05d-0c17-4ba2-ac94-ed9ca3466276 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '371ecb87e8d34859971be23c1a1bc443'} {{(pid=138744) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 22 20:56:39.298243 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7590b05d-0c17-4ba2-ac94-ed9ca3466276 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:39.299425 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7590b05d-0c17-4ba2-ac94-ed9ca3466276 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:39.301829 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7590b05d-0c17-4ba2-ac94-ed9ca3466276 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:39.303155 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7590b05d-0c17-4ba2-ac94-ed9ca3466276 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:39.303944 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7590b05d-0c17-4ba2-ac94-ed9ca3466276 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:39.306202 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7590b05d-0c17-4ba2-ac94-ed9ca3466276 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:39.548144 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.multi_cell_list [None req-7590b05d-0c17-4ba2-ac94-ed9ca3466276 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=138744) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 22 20:56:39.695015 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-7590b05d-0c17-4ba2-ac94-ed9ca3466276 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] 10.222.0.18 "GET /compute/v2.1/servers?flavor=451" status: 200 len: 345 microversion: 2.1 time: 0.472972 Oct 22 20:56:39.710640 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 865/1822] 10.222.0.18 () {58 vars in 1146 bytes} [Sat Oct 22 20:56:39 2022] GET /compute/v2.1/servers?flavor=451 => generated 345 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:56:39.716488 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-ee6c1f1b-49d9-49f3-b83a-292b17b5a781 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:56:39.732540 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-ee6c1f1b-49d9-49f3-b83a-292b17b5a781 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e787e0b494764176a0f13d75c47d77fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '371ecb87e8d34859971be23c1a1bc443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:56:39.733298 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.compute.servers [None req-ee6c1f1b-49d9-49f3-b83a-292b17b5a781 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Removing options 'limit' from query {{(pid=138744) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 22 20:56:39.736324 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-ee6c1f1b-49d9-49f3-b83a-292b17b5a781 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Searching by: {'deleted': False, 'project_id': '371ecb87e8d34859971be23c1a1bc443'} {{(pid=138744) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 22 20:56:39.753938 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ee6c1f1b-49d9-49f3-b83a-292b17b5a781 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:39.754722 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ee6c1f1b-49d9-49f3-b83a-292b17b5a781 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:39.755411 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ee6c1f1b-49d9-49f3-b83a-292b17b5a781 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:39.756542 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ee6c1f1b-49d9-49f3-b83a-292b17b5a781 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:39.757285 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ee6c1f1b-49d9-49f3-b83a-292b17b5a781 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:39.757915 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ee6c1f1b-49d9-49f3-b83a-292b17b5a781 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:39.811805 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-ee6c1f1b-49d9-49f3-b83a-292b17b5a781 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] 10.222.0.18 "GET /compute/v2.1/servers?limit=1" status: 200 len: 484 microversion: 2.1 time: 0.099489 Oct 22 20:56:39.820753 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 866/1823] 10.222.0.18 () {58 vars in 1140 bytes} [Sat Oct 22 20:56:39 2022] GET /compute/v2.1/servers?limit=1 => generated 484 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:56:39.830941 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-d9e4ce21-f7d2-41bd-8ac3-c475a129f4bc tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:56:39.840311 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-d9e4ce21-f7d2-41bd-8ac3-c475a129f4bc tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e787e0b494764176a0f13d75c47d77fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '371ecb87e8d34859971be23c1a1bc443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:56:39.844061 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-d9e4ce21-f7d2-41bd-8ac3-c475a129f4bc tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-1800526150', 'deleted': False, 'project_id': '371ecb87e8d34859971be23c1a1bc443'} {{(pid=138744) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 22 20:56:39.861837 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d9e4ce21-f7d2-41bd-8ac3-c475a129f4bc tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:39.862736 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d9e4ce21-f7d2-41bd-8ac3-c475a129f4bc tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:39.863416 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d9e4ce21-f7d2-41bd-8ac3-c475a129f4bc tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:39.864417 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d9e4ce21-f7d2-41bd-8ac3-c475a129f4bc tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:39.865096 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d9e4ce21-f7d2-41bd-8ac3-c475a129f4bc tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:39.865791 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d9e4ce21-f7d2-41bd-8ac3-c475a129f4bc tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:40.038854 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:SELECT=100 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:56:40.062683 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.multi_cell_list [None req-d9e4ce21-f7d2-41bd-8ac3-c475a129f4bc tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=138744) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 22 20:56:40.079073 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-3b6e7873-1755-4186-b20f-410cdc26b525 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b392ad1fe1fd4b2a9e6be03a7435deb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594624ed28aa433d907c8833d360b82e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:56:40.088649 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-3b6e7873-1755-4186-b20f-410cdc26b525 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] 10.222.0.18 "GET /compute/v2.1/servers/3de7ee82-86b9-4c34-8b81-46f09d6239d0" status: 200 len: 1324 microversion: 2.1 time: 0.974282 Oct 22 20:56:40.094727 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 958/1824] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:56:39 2022] GET /compute/v2.1/servers/3de7ee82-86b9-4c34-8b81-46f09d6239d0 => generated 1324 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:56:40.136986 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-d9e4ce21-f7d2-41bd-8ac3-c475a129f4bc tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] 10.222.0.18 "GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-1800526150" status: 200 len: 346 microversion: 2.1 time: 0.314629 Oct 22 20:56:40.138851 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 867/1825] 10.222.0.18 () {58 vars in 1242 bytes} [Sat Oct 22 20:56:39 2022] GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-1800526150 => generated 346 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:56:40.151566 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-a6492087-53d9-4a2c-861f-fd17db0ac137 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:56:40.160072 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a6492087-53d9-4a2c-861f-fd17db0ac137 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:40.162773 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a6492087-53d9-4a2c-861f-fd17db0ac137 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:40.164225 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a6492087-53d9-4a2c-861f-fd17db0ac137 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:40.310082 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-a6492087-53d9-4a2c-861f-fd17db0ac137 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] [instance: 28c2b09f-e43f-472b-b8db-f407c341acfd] Going to try to stop instance {{(pid=138745) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 22 20:56:40.382805 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-a6492087-53d9-4a2c-861f-fd17db0ac137 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] 10.222.0.18 "POST /compute/v2.1/servers/28c2b09f-e43f-472b-b8db-f407c341acfd/action" status: 202 len: 0 microversion: 2.1 time: 0.235162 Oct 22 20:56:40.383820 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 959/1826] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 20:56:40 2022] POST /compute/v2.1/servers/28c2b09f-e43f-472b-b8db-f407c341acfd/action => generated 0 bytes in 237 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 20:56:40.392575 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-e64be211-69b0-475d-9a0b-ccdba2265968 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:56:40.393663 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-e64be211-69b0-475d-9a0b-ccdba2265968 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] [instance: 28c2b09f-e43f-472b-b8db-f407c341acfd] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:56:40.404490 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e64be211-69b0-475d-9a0b-ccdba2265968 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:40.405945 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e64be211-69b0-475d-9a0b-ccdba2265968 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:40.406512 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e64be211-69b0-475d-9a0b-ccdba2265968 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:40.409319 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e64be211-69b0-475d-9a0b-ccdba2265968 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:40.409995 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e64be211-69b0-475d-9a0b-ccdba2265968 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:40.413244 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e64be211-69b0-475d-9a0b-ccdba2265968 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:40.822862 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-f0c7a0fb-7bdc-4832-8a09-54acfcae61c3 req-07f96a27-dfeb-4657-8593-4b1836295fc7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3de7ee82-86b9-4c34-8b81-46f09d6239d0", "name": "network-vif-plugged", "status": "completed", "tag": "1f69f669-8018-4f6c-a6cf-2f988963a116"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:56:40.832872 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:56:40.842367 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-f0c7a0fb-7bdc-4832-8a09-54acfcae61c3 req-07f96a27-dfeb-4657-8593-4b1836295fc7 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:40.842964 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-f0c7a0fb-7bdc-4832-8a09-54acfcae61c3 req-07f96a27-dfeb-4657-8593-4b1836295fc7 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:40.843610 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-f0c7a0fb-7bdc-4832-8a09-54acfcae61c3 req-07f96a27-dfeb-4657-8593-4b1836295fc7 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:40.878329 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-f0c7a0fb-7bdc-4832-8a09-54acfcae61c3 req-07f96a27-dfeb-4657-8593-4b1836295fc7 service nova] Creating event network-vif-plugged:1f69f669-8018-4f6c-a6cf-2f988963a116 for instance 3de7ee82-86b9-4c34-8b81-46f09d6239d0 on nch1-master-1 Oct 22 20:56:40.891560 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-f0c7a0fb-7bdc-4832-8a09-54acfcae61c3 req-07f96a27-dfeb-4657-8593-4b1836295fc7 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075074 Oct 22 20:56:40.896271 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 960/1827] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:56:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:56:41.118665 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-747a358e-19f7-4498-bf09-16fb44a241d0 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:56:41.119572 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-747a358e-19f7-4498-bf09-16fb44a241d0 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] [instance: 3de7ee82-86b9-4c34-8b81-46f09d6239d0] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:56:41.133451 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-747a358e-19f7-4498-bf09-16fb44a241d0 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:41.134109 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-747a358e-19f7-4498-bf09-16fb44a241d0 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:41.134682 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-747a358e-19f7-4498-bf09-16fb44a241d0 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:41.139940 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-747a358e-19f7-4498-bf09-16fb44a241d0 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:41.140687 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-747a358e-19f7-4498-bf09-16fb44a241d0 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:41.143834 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-747a358e-19f7-4498-bf09-16fb44a241d0 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:41.236445 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-e64be211-69b0-475d-9a0b-ccdba2265968 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e787e0b494764176a0f13d75c47d77fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '371ecb87e8d34859971be23c1a1bc443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:56:41.245682 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-e64be211-69b0-475d-9a0b-ccdba2265968 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] 10.222.0.18 "GET /compute/v2.1/servers/28c2b09f-e43f-472b-b8db-f407c341acfd" status: 200 len: 1522 microversion: 2.1 time: 0.857404 Oct 22 20:56:41.246767 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 868/1828] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:56:40 2022] GET /compute/v2.1/servers/28c2b09f-e43f-472b-b8db-f407c341acfd => generated 1522 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:56:42.268805 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-30ac921a-3023-49ff-8972-b6eaa311e189 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:56:42.270261 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-30ac921a-3023-49ff-8972-b6eaa311e189 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] [instance: 28c2b09f-e43f-472b-b8db-f407c341acfd] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:56:42.290346 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-30ac921a-3023-49ff-8972-b6eaa311e189 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:42.303959 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-30ac921a-3023-49ff-8972-b6eaa311e189 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:42.304857 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-30ac921a-3023-49ff-8972-b6eaa311e189 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:42.329761 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-30ac921a-3023-49ff-8972-b6eaa311e189 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:42.330713 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-30ac921a-3023-49ff-8972-b6eaa311e189 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:42.331433 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-30ac921a-3023-49ff-8972-b6eaa311e189 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:42.651039 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-747a358e-19f7-4498-bf09-16fb44a241d0 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b392ad1fe1fd4b2a9e6be03a7435deb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594624ed28aa433d907c8833d360b82e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:56:42.661691 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-747a358e-19f7-4498-bf09-16fb44a241d0 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] 10.222.0.18 "GET /compute/v2.1/servers/3de7ee82-86b9-4c34-8b81-46f09d6239d0" status: 200 len: 1324 microversion: 2.1 time: 1.547828 Oct 22 20:56:42.668023 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 961/1829] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:56:41 2022] GET /compute/v2.1/servers/3de7ee82-86b9-4c34-8b81-46f09d6239d0 => generated 1324 bytes in 1555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 20:56:43.123022 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-30ac921a-3023-49ff-8972-b6eaa311e189 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e787e0b494764176a0f13d75c47d77fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '371ecb87e8d34859971be23c1a1bc443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:56:43.145830 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-30ac921a-3023-49ff-8972-b6eaa311e189 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] 10.222.0.18 "GET /compute/v2.1/servers/28c2b09f-e43f-472b-b8db-f407c341acfd" status: 200 len: 1522 microversion: 2.1 time: 0.880900 Oct 22 20:56:43.151417 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 869/1830] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:56:42 2022] GET /compute/v2.1/servers/28c2b09f-e43f-472b-b8db-f407c341acfd => generated 1522 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 20:56:43.698250 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-cc7f63dd-410b-48c4-a50f-d66e496facb5 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:56:43.699659 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-cc7f63dd-410b-48c4-a50f-d66e496facb5 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] [instance: 3de7ee82-86b9-4c34-8b81-46f09d6239d0] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:56:43.714444 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cc7f63dd-410b-48c4-a50f-d66e496facb5 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:43.716475 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cc7f63dd-410b-48c4-a50f-d66e496facb5 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:43.720720 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cc7f63dd-410b-48c4-a50f-d66e496facb5 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:43.721741 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cc7f63dd-410b-48c4-a50f-d66e496facb5 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:43.722224 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cc7f63dd-410b-48c4-a50f-d66e496facb5 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:43.722664 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cc7f63dd-410b-48c4-a50f-d66e496facb5 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:44.172809 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-a338a364-41f4-4033-81c2-bd5dba261c96 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:56:44.174120 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-a338a364-41f4-4033-81c2-bd5dba261c96 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] [instance: 28c2b09f-e43f-472b-b8db-f407c341acfd] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:56:44.183268 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a338a364-41f4-4033-81c2-bd5dba261c96 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:44.184255 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a338a364-41f4-4033-81c2-bd5dba261c96 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:44.185068 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a338a364-41f4-4033-81c2-bd5dba261c96 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:44.186002 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a338a364-41f4-4033-81c2-bd5dba261c96 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:44.186811 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a338a364-41f4-4033-81c2-bd5dba261c96 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:44.187449 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a338a364-41f4-4033-81c2-bd5dba261c96 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:44.324164 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-cc7f63dd-410b-48c4-a50f-d66e496facb5 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b392ad1fe1fd4b2a9e6be03a7435deb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594624ed28aa433d907c8833d360b82e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:56:44.338694 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-cc7f63dd-410b-48c4-a50f-d66e496facb5 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] 10.222.0.18 "GET /compute/v2.1/servers/3de7ee82-86b9-4c34-8b81-46f09d6239d0" status: 200 len: 1520 microversion: 2.1 time: 0.644768 Oct 22 20:56:44.345560 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 962/1831] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:56:43 2022] GET /compute/v2.1/servers/3de7ee82-86b9-4c34-8b81-46f09d6239d0 => generated 1520 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:56:44.374758 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-82ae5c60-b066-4ecf-b451-705cbfff7227 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:56:44.376048 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-82ae5c60-b066-4ecf-b451-705cbfff7227 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] [instance: 3de7ee82-86b9-4c34-8b81-46f09d6239d0] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:56:44.389515 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-82ae5c60-b066-4ecf-b451-705cbfff7227 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:44.390017 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-82ae5c60-b066-4ecf-b451-705cbfff7227 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:44.390757 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-82ae5c60-b066-4ecf-b451-705cbfff7227 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:44.392688 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-82ae5c60-b066-4ecf-b451-705cbfff7227 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:44.393755 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-82ae5c60-b066-4ecf-b451-705cbfff7227 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:44.394551 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-82ae5c60-b066-4ecf-b451-705cbfff7227 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:44.882487 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-a338a364-41f4-4033-81c2-bd5dba261c96 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e787e0b494764176a0f13d75c47d77fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '371ecb87e8d34859971be23c1a1bc443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:56:44.899884 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-a338a364-41f4-4033-81c2-bd5dba261c96 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] 10.222.0.18 "GET /compute/v2.1/servers/28c2b09f-e43f-472b-b8db-f407c341acfd" status: 200 len: 1522 microversion: 2.1 time: 0.731354 Oct 22 20:56:44.901800 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 870/1832] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:56:44 2022] GET /compute/v2.1/servers/28c2b09f-e43f-472b-b8db-f407c341acfd => generated 1522 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 20:56:45.144552 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-9ed4bafc-9741-4243-a884-2c9ef33465b8 tempest-MigrationsAdminTest-1403807426 tempest-MigrationsAdminTest-1403807426-project-admin] Calling method '.version_select at 0x7fd39f8ac550>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:56:45.148481 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9ed4bafc-9741-4243-a884-2c9ef33465b8 tempest-MigrationsAdminTest-1403807426 tempest-MigrationsAdminTest-1403807426-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:45.149251 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9ed4bafc-9741-4243-a884-2c9ef33465b8 tempest-MigrationsAdminTest-1403807426 tempest-MigrationsAdminTest-1403807426-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:45.149955 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9ed4bafc-9741-4243-a884-2c9ef33465b8 tempest-MigrationsAdminTest-1403807426 tempest-MigrationsAdminTest-1403807426-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:45.158491 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-9ed4bafc-9741-4243-a884-2c9ef33465b8 tempest-MigrationsAdminTest-1403807426 tempest-MigrationsAdminTest-1403807426-project-admin] 10.222.0.18 "GET /compute/v2.1/os-migrations" status: 200 len: 803 microversion: 2.1 time: 0.018015 Oct 22 20:56:45.159805 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 871/1833] 10.222.0.18 () {58 vars in 1143 bytes} [Sat Oct 22 20:56:45 2022] GET /compute/v2.1/os-migrations => generated 803 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:56:45.184894 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-4ea7ec11-1816-4d2b-a50e-5b9e85cca19e tempest-MigrationsAdminTest-1403807426 tempest-MigrationsAdminTest-1403807426-project-admin] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:56:45.192042 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-4ea7ec11-1816-4d2b-a50e-5b9e85cca19e tempest-MigrationsAdminTest-1403807426 tempest-MigrationsAdminTest-1403807426-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.010980 Oct 22 20:56:45.193311 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 872/1834] 10.222.0.18 () {58 vars in 1137 bytes} [Sat Oct 22 20:56:45 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 20:56:45.206439 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-aef5f510-5572-4356-b066-b582a2976895 tempest-MigrationsAdminTest-1403807426 tempest-MigrationsAdminTest-1403807426-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_resize_flavor_-328072302", "ram": 1024, "disk": 1, "vcpus": 1}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:56:45.235739 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-aef5f510-5572-4356-b066-b582a2976895 tempest-MigrationsAdminTest-1403807426 tempest-MigrationsAdminTest-1403807426-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 498 microversion: 2.1 time: 0.034043 Oct 22 20:56:45.237106 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 873/1835] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Oct 22 20:56:45 2022] POST /compute/v2.1/flavors => generated 498 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 20:56:45.253801 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-322b90b7-b111-43c1-b995-885329b17735 tempest-MigrationsAdminTest-1403807426 tempest-MigrationsAdminTest-1403807426-project-admin] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:56:45.263518 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-322b90b7-b111-43c1-b995-885329b17735 tempest-MigrationsAdminTest-1403807426 tempest-MigrationsAdminTest-1403807426-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.018126 Oct 22 20:56:45.276900 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 874/1836] 10.222.0.18 () {58 vars in 1182 bytes} [Sat Oct 22 20:56:45 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 22 20:56:45.306186 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-82ae5c60-b066-4ecf-b451-705cbfff7227 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b392ad1fe1fd4b2a9e6be03a7435deb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594624ed28aa433d907c8833d360b82e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:56:45.327947 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-82ae5c60-b066-4ecf-b451-705cbfff7227 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] 10.222.0.18 "GET /compute/v2.1/servers/3de7ee82-86b9-4c34-8b81-46f09d6239d0" status: 200 len: 1520 microversion: 2.1 time: 0.958930 Oct 22 20:56:45.330211 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 963/1837] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:56:44 2022] GET /compute/v2.1/servers/3de7ee82-86b9-4c34-8b81-46f09d6239d0 => generated 1520 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 20:56:45.353901 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-a53e523b-f8dc-4f1b-a264-f5e591a10cfc tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1794268338"}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:56:45.356552 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-a53e523b-f8dc-4f1b-a264-f5e591a10cfc tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] [instance: 3de7ee82-86b9-4c34-8b81-46f09d6239d0] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:56:45.365390 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a53e523b-f8dc-4f1b-a264-f5e591a10cfc tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:45.366661 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a53e523b-f8dc-4f1b-a264-f5e591a10cfc tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:45.367576 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a53e523b-f8dc-4f1b-a264-f5e591a10cfc tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:45.368318 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a53e523b-f8dc-4f1b-a264-f5e591a10cfc tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:45.369334 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a53e523b-f8dc-4f1b-a264-f5e591a10cfc tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:45.369783 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a53e523b-f8dc-4f1b-a264-f5e591a10cfc tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:45.510047 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-bfb7ea81-57f2-4160-9df0-b2fb86bba41f tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1251988208", "imageRef": "085e4478-6edc-4a69-8e08-f9831713eb65", "flavorRef": "1576c14a-5e9b-4ca1-91da-5d29cbf3cec9"}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:56:45.589272 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.network.neutron [None req-bfb7ea81-57f2-4160-9df0-b2fb86bba41f tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] validate_networks() for None {{(pid=138745) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 20:56:45.830269 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-a53e523b-f8dc-4f1b-a264-f5e591a10cfc tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] 10.222.0.18 "POST /compute/v2.1/servers/3de7ee82-86b9-4c34-8b81-46f09d6239d0/action" status: 202 len: 0 microversion: 2.1 time: 0.481244 Oct 22 20:56:45.831583 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 875/1838] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 20:56:45 2022] POST /compute/v2.1/servers/3de7ee82-86b9-4c34-8b81-46f09d6239d0/action => generated 0 bytes in 484 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 22 20:56:45.844554 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-b8969a24-41f7-44fa-889c-634927bd95ae tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Calling method '.version_select at 0x7fd3a89e4430>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:56:46.060018 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-b8969a24-41f7-44fa-889c-634927bd95ae tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] 10.222.0.18 "DELETE /compute/v2.1/images/67100460-5801-4548-a9fc-190c376e00e6" status: 204 len: 0 microversion: 2.1 time: 0.221148 Oct 22 20:56:46.060982 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 876/1839] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:56:45 2022] DELETE /compute/v2.1/images/67100460-5801-4548-a9fc-190c376e00e6 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 22 20:56:46.068530 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-b8077e37-cb15-4c5f-8d39-9bad2a9e636c tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:56:46.069531 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-b8077e37-cb15-4c5f-8d39-9bad2a9e636c tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] [instance: 28c2b09f-e43f-472b-b8db-f407c341acfd] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:56:46.096894 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b8077e37-cb15-4c5f-8d39-9bad2a9e636c tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:46.097394 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b8077e37-cb15-4c5f-8d39-9bad2a9e636c tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:46.098051 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b8077e37-cb15-4c5f-8d39-9bad2a9e636c tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:46.098986 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b8077e37-cb15-4c5f-8d39-9bad2a9e636c tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:46.099634 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b8077e37-cb15-4c5f-8d39-9bad2a9e636c tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:46.100228 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b8077e37-cb15-4c5f-8d39-9bad2a9e636c tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:46.882628 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-b8077e37-cb15-4c5f-8d39-9bad2a9e636c tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e787e0b494764176a0f13d75c47d77fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '371ecb87e8d34859971be23c1a1bc443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:56:46.890757 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-b8077e37-cb15-4c5f-8d39-9bad2a9e636c tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] 10.222.0.18 "GET /compute/v2.1/servers/28c2b09f-e43f-472b-b8db-f407c341acfd" status: 200 len: 1499 microversion: 2.1 time: 0.828263 Oct 22 20:56:46.905219 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 877/1840] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:56:46 2022] GET /compute/v2.1/servers/28c2b09f-e43f-472b-b8db-f407c341acfd => generated 1499 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:56:46.910868 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-f4dc06ce-6d54-423a-b077-eafc3ffd0395 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Calling method '.version_select at 0x7fd39f6b1670>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:56:46.961292 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-f4dc06ce-6d54-423a-b077-eafc3ffd0395 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] HTTP exception thrown: Image not found. Oct 22 20:56:46.969047 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-f4dc06ce-6d54-423a-b077-eafc3ffd0395 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Request method failure captured: Oct 22 20:56:46.969047 ncdv-master-1 devstack@n-api.service[138744]: request: GET /compute/v2.1/images/67100460-5801-4548-a9fc-190c376e00e6 HTTP/1.1 Oct 22 20:56:46.969047 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 20:56:46.969047 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 20:56:46.969047 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 20:56:46.969047 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 0 Oct 22 20:56:46.969047 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 20:56:46.969047 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 20:56:46.969047 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 20:56:46.969047 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 20:56:46.969047 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVFinkWQQBhkrT1IKOpDugEkOlAPWNZyP_2NMwr13b9XeVy4UUzw2acgfBjDE3p8vwfHK2_Q3RMg9yYmateTjw8EQOHA7IN0HeuqzZ5uQWL0ysIIG3e_nACVRZdRICvuIM06IV17ajtcJTdsfcK0wPQNbKtAOZi6_8a2UUHyQ1NeNuzI Oct 22 20:56:46.969047 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 20:56:46.969047 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 20:56:46.969047 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 20:56:46.969047 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 20:56:46.969047 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 20:56:46.969047 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 20:56:46.969047 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: 594624ed28aa433d907c8833d360b82e Oct 22 20:56:46.969047 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-477371163 Oct 22 20:56:46.969047 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 20:56:46.969047 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 20:56:46.969047 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_594624ed28aa433d907c8833d360b82e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/594624ed28aa433d907c8833d360b82e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/594624ed28aa433d907c8833d360b82e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/594624ed28aa433d907c8833d360b82e"}]}] Oct 22 20:56:46.969047 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-477371163 Oct 22 20:56:46.969047 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: 594624ed28aa433d907c8833d360b82e Oct 22 20:56:46.969047 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-477371163 Oct 22 20:56:46.969047 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-ImagesOneServerNegativeTestJSON-477371163-project Oct 22 20:56:46.969047 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 20:56:46.969047 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 20:56:46.969047 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: b392ad1fe1fd4b2a9e6be03a7435deb9 Oct 22 20:56:46.969047 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-477371163-project Oct 22 20:56:46.969047 ncdv-master-1 devstack@n-api.service[138744]: method: Oct 22 20:56:46.969047 ncdv-master-1 devstack@n-api.service[138744]: exception: Image not found. Oct 22 20:56:46.969047 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': '67100460-5801-4548-a9fc-190c376e00e6'} Oct 22 20:56:46.969047 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:56:46.969047 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:56:46.969047 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 22 20:56:46.969047 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 22 20:56:46.969047 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 22 20:56:46.969047 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 22 20:56:46.969047 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 22 20:56:46.969047 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 22 20:56:46.969047 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 22 20:56:46.969047 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 22 20:56:46.969047 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 22 20:56:46.969047 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 22 20:56:46.969047 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 22 20:56:46.969047 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 22 20:56:46.969047 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 22 20:56:46.969047 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 22 20:56:46.969047 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 22 20:56:46.969047 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 22 20:56:46.969047 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 67100460-5801-4548-a9fc-190c376e00e6 Oct 22 20:56:46.969047 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:56:46.969047 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:56:46.969047 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:56:46.969047 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:56:46.969047 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 22 20:56:46.969047 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 22 20:56:46.969047 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 22 20:56:46.969047 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 22 20:56:46.969047 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 22 20:56:46.969047 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 22 20:56:46.969047 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 22 20:56:46.975127 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 22 20:56:46.975127 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 22 20:56:46.975127 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 22 20:56:46.975127 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 22 20:56:46.975127 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 22 20:56:46.975127 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 22 20:56:46.975127 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 22 20:56:46.975127 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 22 20:56:46.975127 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 22 20:56:46.975127 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 22 20:56:46.975127 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 22 20:56:46.975127 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 22 20:56:46.975127 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 22 20:56:46.975127 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 22 20:56:46.975127 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 22 20:56:46.975127 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 22 20:56:46.975127 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 22 20:56:46.975127 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 67100460-5801-4548-a9fc-190c376e00e6 could not be found. Oct 22 20:56:46.975127 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:56:46.975127 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:56:46.975127 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:56:46.975127 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:56:46.975127 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:56:46.975127 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:56:46.975127 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:56:46.975127 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:56:46.975127 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 22 20:56:46.975127 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 22 20:56:46.975127 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:56:46.975127 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:56:46.975127 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 22 20:56:46.975127 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 22 20:56:46.975127 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 22 20:56:46.975127 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:56:46.975127 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:56:46.975127 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:56:46.975127 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:56:46.975127 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:56:46.975127 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:56:46.975127 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 20:56:46.975127 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 20:56:46.975127 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 22 20:56:46.975127 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:56:46.984004 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-f4dc06ce-6d54-423a-b077-eafc3ffd0395 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Returning 404 to user: Image not found. {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:56:46.985138 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-f4dc06ce-6d54-423a-b077-eafc3ffd0395 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] 10.222.0.18 "GET /compute/v2.1/images/67100460-5801-4548-a9fc-190c376e00e6" status: 404 len: 62 microversion: 2.1 time: 0.084598 Oct 22 20:56:46.986166 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 878/1841] 10.222.0.18 () {58 vars in 1233 bytes} [Sat Oct 22 20:56:46 2022] GET /compute/v2.1/images/67100460-5801-4548-a9fc-190c376e00e6 => generated 62 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 22 20:56:46.993525 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-d756f6b3-f2fe-44a7-b897-84b689968793 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:56:47.000569 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-d756f6b3-f2fe-44a7-b897-84b689968793 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e787e0b494764176a0f13d75c47d77fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '371ecb87e8d34859971be23c1a1bc443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:56:47.001956 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-d756f6b3-f2fe-44a7-b897-84b689968793 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Searching by: {'vm_state': ['stopped'], 'deleted': False, 'project_id': '371ecb87e8d34859971be23c1a1bc443'} {{(pid=138744) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 22 20:56:47.008514 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d756f6b3-f2fe-44a7-b897-84b689968793 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:47.009304 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d756f6b3-f2fe-44a7-b897-84b689968793 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:47.010876 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d756f6b3-f2fe-44a7-b897-84b689968793 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:47.011798 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d756f6b3-f2fe-44a7-b897-84b689968793 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:47.012276 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d756f6b3-f2fe-44a7-b897-84b689968793 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:47.012710 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d756f6b3-f2fe-44a7-b897-84b689968793 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:47.046132 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.multi_cell_list [None req-d756f6b3-f2fe-44a7-b897-84b689968793 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=138744) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 22 20:56:47.086933 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-d756f6b3-f2fe-44a7-b897-84b689968793 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] 10.222.0.18 "GET /compute/v2.1/servers?status=shutoff" status: 200 len: 346 microversion: 2.1 time: 0.099378 Oct 22 20:56:47.087786 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 879/1842] 10.222.0.18 () {58 vars in 1154 bytes} [Sat Oct 22 20:56:46 2022] GET /compute/v2.1/servers?status=shutoff => generated 346 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:56:47.095554 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-8e1ce5f1-f3b3-4894-b126-0c96bf4722f6 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:56:47.096199 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-8e1ce5f1-f3b3-4894-b126-0c96bf4722f6 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] [instance: 3de7ee82-86b9-4c34-8b81-46f09d6239d0] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:56:47.102739 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8e1ce5f1-f3b3-4894-b126-0c96bf4722f6 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:47.103219 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8e1ce5f1-f3b3-4894-b126-0c96bf4722f6 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:47.103680 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8e1ce5f1-f3b3-4894-b126-0c96bf4722f6 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:47.104376 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8e1ce5f1-f3b3-4894-b126-0c96bf4722f6 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:47.104827 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8e1ce5f1-f3b3-4894-b126-0c96bf4722f6 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:47.105250 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8e1ce5f1-f3b3-4894-b126-0c96bf4722f6 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:47.140593 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-bfb7ea81-57f2-4160-9df0-b2fb86bba41f tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Flavor limits 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 20:56:47.142345 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-bfb7ea81-57f2-4160-9df0-b2fb86bba41f tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Image limits 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 20:56:47.143179 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-bfb7ea81-57f2-4160-9df0-b2fb86bba41f tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Flavor pref 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 20:56:47.143658 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-bfb7ea81-57f2-4160-9df0-b2fb86bba41f tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Image pref 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 20:56:47.144089 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-bfb7ea81-57f2-4160-9df0-b2fb86bba41f tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 20:56:47.155259 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bfb7ea81-57f2-4160-9df0-b2fb86bba41f tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:47.156470 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bfb7ea81-57f2-4160-9df0-b2fb86bba41f tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:47.156920 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bfb7ea81-57f2-4160-9df0-b2fb86bba41f tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:47.157782 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bfb7ea81-57f2-4160-9df0-b2fb86bba41f tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:47.158265 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bfb7ea81-57f2-4160-9df0-b2fb86bba41f tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:47.158677 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bfb7ea81-57f2-4160-9df0-b2fb86bba41f tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:47.185324 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-bfb7ea81-57f2-4160-9df0-b2fb86bba41f tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Getting quotas for project 49238b8686d24ae698679e4a1957735d. Resources: {'cores', 'instances', 'ram'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 20:56:47.193785 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-bfb7ea81-57f2-4160-9df0-b2fb86bba41f tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Getting quotas for user e0d3d7458af447bdb3f03e83a2d8559f and project 49238b8686d24ae698679e4a1957735d. Resources: {'cores', 'instances', 'ram'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 20:56:47.236153 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-bfb7ea81-57f2-4160-9df0-b2fb86bba41f tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Going to run 1 instances... {{(pid=138745) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 20:56:47.238871 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-bfb7ea81-57f2-4160-9df0-b2fb86bba41f tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] [instance: aee36c9d-baf4-453c-b88f-31b8f23638c2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='085e4478-6edc-4a69-8e08-f9831713eb65',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138745) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 20:56:47.326409 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-bfb7ea81-57f2-4160-9df0-b2fb86bba41f tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.820203 Oct 22 20:56:47.334221 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 964/1843] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Oct 22 20:56:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 1829 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 20:56:47.339635 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-5ac5be82-8b07-47e7-9c53-4a9706d0d5aa tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:56:47.347080 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5ac5be82-8b07-47e7-9c53-4a9706d0d5aa tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:47.347913 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5ac5be82-8b07-47e7-9c53-4a9706d0d5aa tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:47.348610 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5ac5be82-8b07-47e7-9c53-4a9706d0d5aa tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:47.382809 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-5ac5be82-8b07-47e7-9c53-4a9706d0d5aa tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] [instance: 28c2b09f-e43f-472b-b8db-f407c341acfd] Going to try to start instance {{(pid=138745) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 22 20:56:47.402637 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:56:47.471211 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-5ac5be82-8b07-47e7-9c53-4a9706d0d5aa tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] 10.222.0.18 "POST /compute/v2.1/servers/28c2b09f-e43f-472b-b8db-f407c341acfd/action" status: 202 len: 0 microversion: 2.1 time: 0.133335 Oct 22 20:56:47.473123 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 965/1844] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 20:56:47 2022] POST /compute/v2.1/servers/28c2b09f-e43f-472b-b8db-f407c341acfd/action => generated 0 bytes in 138 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 20:56:47.486912 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-19296dce-6c59-4091-b5bd-5712a7a35dfd tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:56:47.489457 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-19296dce-6c59-4091-b5bd-5712a7a35dfd tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] [instance: aee36c9d-baf4-453c-b88f-31b8f23638c2] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:56:47.897319 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-19296dce-6c59-4091-b5bd-5712a7a35dfd tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d3d7458af447bdb3f03e83a2d8559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49238b8686d24ae698679e4a1957735d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:56:47.905867 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-19296dce-6c59-4091-b5bd-5712a7a35dfd tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] 10.222.0.18 "GET /compute/v2.1/servers/aee36c9d-baf4-453c-b88f-31b8f23638c2" status: 200 len: 1279 microversion: 2.1 time: 0.431181 Oct 22 20:56:47.913803 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 966/1845] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:56:47 2022] GET /compute/v2.1/servers/aee36c9d-baf4-453c-b88f-31b8f23638c2 => generated 1279 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:56:47.922800 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-d62dcb7f-9274-419b-b18b-bc4386927e76 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:56:47.939027 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-d62dcb7f-9274-419b-b18b-bc4386927e76 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] [instance: 28c2b09f-e43f-472b-b8db-f407c341acfd] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:56:47.952227 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d62dcb7f-9274-419b-b18b-bc4386927e76 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:47.963773 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d62dcb7f-9274-419b-b18b-bc4386927e76 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:47.964312 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d62dcb7f-9274-419b-b18b-bc4386927e76 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:47.967099 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d62dcb7f-9274-419b-b18b-bc4386927e76 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:47.968403 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d62dcb7f-9274-419b-b18b-bc4386927e76 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:47.969459 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d62dcb7f-9274-419b-b18b-bc4386927e76 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:48.167251 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-8e1ce5f1-f3b3-4894-b126-0c96bf4722f6 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b392ad1fe1fd4b2a9e6be03a7435deb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594624ed28aa433d907c8833d360b82e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:56:48.184681 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-8e1ce5f1-f3b3-4894-b126-0c96bf4722f6 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] 10.222.0.18 "GET /compute/v2.1/servers/3de7ee82-86b9-4c34-8b81-46f09d6239d0" status: 200 len: 1532 microversion: 2.1 time: 1.095778 Oct 22 20:56:48.186304 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 880/1846] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:56:47 2022] GET /compute/v2.1/servers/3de7ee82-86b9-4c34-8b81-46f09d6239d0 => generated 1532 bytes in 1098 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:56:48.552097 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-f6da455c-0a31-4be5-ad52-a81186b514e2 tempest-ServerMetadataNegativeTestJSON-1253820515 tempest-ServerMetadataNegativeTestJSON-1253820515-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1400451178", "imageRef": "085e4478-6edc-4a69-8e08-f9831713eb65", "flavorRef": "452", "metadata": {}, "networks": [{"uuid": "b12dbc60-e91e-47e6-b028-a9d8abe94afd"}]}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:56:48.646600 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.network.neutron [None req-f6da455c-0a31-4be5-ad52-a81186b514e2 tempest-ServerMetadataNegativeTestJSON-1253820515 tempest-ServerMetadataNegativeTestJSON-1253820515-project] validate_networks() for [('b12dbc60-e91e-47e6-b028-a9d8abe94afd', None, None, None, None, None)] {{(pid=138744) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 20:56:49.109133 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-d62dcb7f-9274-419b-b18b-bc4386927e76 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e787e0b494764176a0f13d75c47d77fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '371ecb87e8d34859971be23c1a1bc443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:56:49.129450 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-d62dcb7f-9274-419b-b18b-bc4386927e76 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] 10.222.0.18 "GET /compute/v2.1/servers/28c2b09f-e43f-472b-b8db-f407c341acfd" status: 200 len: 1508 microversion: 2.1 time: 1.210719 Oct 22 20:56:49.134051 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 967/1847] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:56:47 2022] GET /compute/v2.1/servers/28c2b09f-e43f-472b-b8db-f407c341acfd => generated 1508 bytes in 1219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:56:49.150595 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-0183074e-8e6e-460b-bae8-074f17c9235e tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:56:49.156604 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-0183074e-8e6e-460b-bae8-074f17c9235e tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] [instance: aee36c9d-baf4-453c-b88f-31b8f23638c2] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:56:49.177018 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0183074e-8e6e-460b-bae8-074f17c9235e tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:49.180791 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0183074e-8e6e-460b-bae8-074f17c9235e tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:49.181623 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0183074e-8e6e-460b-bae8-074f17c9235e tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:49.182806 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0183074e-8e6e-460b-bae8-074f17c9235e tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:49.184693 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0183074e-8e6e-460b-bae8-074f17c9235e tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:49.186922 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0183074e-8e6e-460b-bae8-074f17c9235e tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:49.611415 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-0183074e-8e6e-460b-bae8-074f17c9235e tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d3d7458af447bdb3f03e83a2d8559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49238b8686d24ae698679e4a1957735d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:56:49.628994 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-0183074e-8e6e-460b-bae8-074f17c9235e tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] 10.222.0.18 "GET /compute/v2.1/servers/aee36c9d-baf4-453c-b88f-31b8f23638c2" status: 200 len: 1331 microversion: 2.1 time: 0.491209 Oct 22 20:56:49.631081 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 968/1848] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:56:49 2022] GET /compute/v2.1/servers/aee36c9d-baf4-453c-b88f-31b8f23638c2 => generated 1331 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:56:49.666514 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-7f99d2ff-4aa9-440d-9639-7f098337f5e0 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:56:49.667898 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-7f99d2ff-4aa9-440d-9639-7f098337f5e0 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] [instance: 3de7ee82-86b9-4c34-8b81-46f09d6239d0] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:56:49.682336 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7f99d2ff-4aa9-440d-9639-7f098337f5e0 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:49.685560 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7f99d2ff-4aa9-440d-9639-7f098337f5e0 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:49.687737 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7f99d2ff-4aa9-440d-9639-7f098337f5e0 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:49.689716 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7f99d2ff-4aa9-440d-9639-7f098337f5e0 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:49.693624 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7f99d2ff-4aa9-440d-9639-7f098337f5e0 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:49.694385 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7f99d2ff-4aa9-440d-9639-7f098337f5e0 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:50.527773 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-7f99d2ff-4aa9-440d-9639-7f098337f5e0 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b392ad1fe1fd4b2a9e6be03a7435deb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594624ed28aa433d907c8833d360b82e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:56:50.552507 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-7f99d2ff-4aa9-440d-9639-7f098337f5e0 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] 10.222.0.18 "GET /compute/v2.1/servers/3de7ee82-86b9-4c34-8b81-46f09d6239d0" status: 200 len: 1538 microversion: 2.1 time: 0.905578 Oct 22 20:56:50.553627 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 969/1849] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:56:49 2022] GET /compute/v2.1/servers/3de7ee82-86b9-4c34-8b81-46f09d6239d0 => generated 1538 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:56:50.558463 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-9802b3b5-0ae3-4880-9b2a-702c3565fdea tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:56:50.559422 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-9802b3b5-0ae3-4880-9b2a-702c3565fdea tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] [instance: 28c2b09f-e43f-472b-b8db-f407c341acfd] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:56:50.578944 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9802b3b5-0ae3-4880-9b2a-702c3565fdea tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:50.579940 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9802b3b5-0ae3-4880-9b2a-702c3565fdea tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:50.581332 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9802b3b5-0ae3-4880-9b2a-702c3565fdea tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:50.582352 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9802b3b5-0ae3-4880-9b2a-702c3565fdea tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:50.583045 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9802b3b5-0ae3-4880-9b2a-702c3565fdea tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:50.583741 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9802b3b5-0ae3-4880-9b2a-702c3565fdea tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:51.100554 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-9802b3b5-0ae3-4880-9b2a-702c3565fdea tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e787e0b494764176a0f13d75c47d77fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '371ecb87e8d34859971be23c1a1bc443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:56:51.113881 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-9802b3b5-0ae3-4880-9b2a-702c3565fdea tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] 10.222.0.18 "GET /compute/v2.1/servers/28c2b09f-e43f-472b-b8db-f407c341acfd" status: 200 len: 1508 microversion: 2.1 time: 0.559038 Oct 22 20:56:51.114486 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 970/1850] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:56:50 2022] GET /compute/v2.1/servers/28c2b09f-e43f-472b-b8db-f407c341acfd => generated 1508 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:56:51.145722 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-f1ea3c7c-0752-4ca1-8e05-75219af7906f tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:56:51.146627 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-f1ea3c7c-0752-4ca1-8e05-75219af7906f tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] [instance: aee36c9d-baf4-453c-b88f-31b8f23638c2] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:56:51.159449 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f1ea3c7c-0752-4ca1-8e05-75219af7906f tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:51.160266 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f1ea3c7c-0752-4ca1-8e05-75219af7906f tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:51.160901 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f1ea3c7c-0752-4ca1-8e05-75219af7906f tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:51.161827 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f1ea3c7c-0752-4ca1-8e05-75219af7906f tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:51.162455 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f1ea3c7c-0752-4ca1-8e05-75219af7906f tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:51.163056 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f1ea3c7c-0752-4ca1-8e05-75219af7906f tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:51.392618 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-f1ea3c7c-0752-4ca1-8e05-75219af7906f tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d3d7458af447bdb3f03e83a2d8559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49238b8686d24ae698679e4a1957735d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:56:51.405355 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-f1ea3c7c-0752-4ca1-8e05-75219af7906f tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] 10.222.0.18 "GET /compute/v2.1/servers/aee36c9d-baf4-453c-b88f-31b8f23638c2" status: 200 len: 1337 microversion: 2.1 time: 0.276205 Oct 22 20:56:51.419372 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 971/1851] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:56:51 2022] GET /compute/v2.1/servers/aee36c9d-baf4-453c-b88f-31b8f23638c2 => generated 1337 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:56:51.580898 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-539aa297-4321-4ade-8330-1d9d1d31078c tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:56:51.581696 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-539aa297-4321-4ade-8330-1d9d1d31078c tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] [instance: 3de7ee82-86b9-4c34-8b81-46f09d6239d0] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:56:51.597886 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-539aa297-4321-4ade-8330-1d9d1d31078c tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:51.600262 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-539aa297-4321-4ade-8330-1d9d1d31078c tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:51.602218 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-539aa297-4321-4ade-8330-1d9d1d31078c tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:51.604744 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-539aa297-4321-4ade-8330-1d9d1d31078c tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:51.606204 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-539aa297-4321-4ade-8330-1d9d1d31078c tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:51.607686 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-539aa297-4321-4ade-8330-1d9d1d31078c tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:51.704868 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-f6da455c-0a31-4be5-ad52-a81186b514e2 tempest-ServerMetadataNegativeTestJSON-1253820515 tempest-ServerMetadataNegativeTestJSON-1253820515-project] Flavor limits 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 20:56:51.706153 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-f6da455c-0a31-4be5-ad52-a81186b514e2 tempest-ServerMetadataNegativeTestJSON-1253820515 tempest-ServerMetadataNegativeTestJSON-1253820515-project] Image limits 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 20:56:51.707088 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-f6da455c-0a31-4be5-ad52-a81186b514e2 tempest-ServerMetadataNegativeTestJSON-1253820515 tempest-ServerMetadataNegativeTestJSON-1253820515-project] Flavor pref 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 20:56:51.707787 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-f6da455c-0a31-4be5-ad52-a81186b514e2 tempest-ServerMetadataNegativeTestJSON-1253820515 tempest-ServerMetadataNegativeTestJSON-1253820515-project] Image pref 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 20:56:51.708604 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-f6da455c-0a31-4be5-ad52-a81186b514e2 tempest-ServerMetadataNegativeTestJSON-1253820515 tempest-ServerMetadataNegativeTestJSON-1253820515-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 20:56:51.731081 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f6da455c-0a31-4be5-ad52-a81186b514e2 tempest-ServerMetadataNegativeTestJSON-1253820515 tempest-ServerMetadataNegativeTestJSON-1253820515-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:51.738509 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f6da455c-0a31-4be5-ad52-a81186b514e2 tempest-ServerMetadataNegativeTestJSON-1253820515 tempest-ServerMetadataNegativeTestJSON-1253820515-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:51.739421 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f6da455c-0a31-4be5-ad52-a81186b514e2 tempest-ServerMetadataNegativeTestJSON-1253820515 tempest-ServerMetadataNegativeTestJSON-1253820515-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:51.740574 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f6da455c-0a31-4be5-ad52-a81186b514e2 tempest-ServerMetadataNegativeTestJSON-1253820515 tempest-ServerMetadataNegativeTestJSON-1253820515-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:51.741161 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f6da455c-0a31-4be5-ad52-a81186b514e2 tempest-ServerMetadataNegativeTestJSON-1253820515 tempest-ServerMetadataNegativeTestJSON-1253820515-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:51.741865 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f6da455c-0a31-4be5-ad52-a81186b514e2 tempest-ServerMetadataNegativeTestJSON-1253820515 tempest-ServerMetadataNegativeTestJSON-1253820515-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:51.785995 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-f6da455c-0a31-4be5-ad52-a81186b514e2 tempest-ServerMetadataNegativeTestJSON-1253820515 tempest-ServerMetadataNegativeTestJSON-1253820515-project] Getting quotas for project 9be467d2547d46089b833ae4b5f9dd05. Resources: {'cores', 'instances', 'ram'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 20:56:51.795187 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-f6da455c-0a31-4be5-ad52-a81186b514e2 tempest-ServerMetadataNegativeTestJSON-1253820515 tempest-ServerMetadataNegativeTestJSON-1253820515-project] Getting quotas for user 153f7059fd924dc5b19f323e0a400381 and project 9be467d2547d46089b833ae4b5f9dd05. Resources: {'cores', 'instances', 'ram'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 20:56:51.820969 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-f6da455c-0a31-4be5-ad52-a81186b514e2 tempest-ServerMetadataNegativeTestJSON-1253820515 tempest-ServerMetadataNegativeTestJSON-1253820515-project] Going to run 1 instances... {{(pid=138744) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 20:56:51.825265 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-f6da455c-0a31-4be5-ad52-a81186b514e2 tempest-ServerMetadataNegativeTestJSON-1253820515 tempest-ServerMetadataNegativeTestJSON-1253820515-project] [instance: 674e9bd2-7dfd-4854-83e8-56d8970e56bc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='085e4478-6edc-4a69-8e08-f9831713eb65',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138744) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 20:56:51.926656 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-f6da455c-0a31-4be5-ad52-a81186b514e2 tempest-ServerMetadataNegativeTestJSON-1253820515 tempest-ServerMetadataNegativeTestJSON-1253820515-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.717908 Oct 22 20:56:51.928372 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 881/1852] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Oct 22 20:56:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 3721 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 20:56:51.946311 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-0b73f616-7c50-43cf-b5c9-97168b1c8707 tempest-ServerMetadataNegativeTestJSON-1253820515 tempest-ServerMetadataNegativeTestJSON-1253820515-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:56:51.947131 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-0b73f616-7c50-43cf-b5c9-97168b1c8707 tempest-ServerMetadataNegativeTestJSON-1253820515 tempest-ServerMetadataNegativeTestJSON-1253820515-project] [instance: 674e9bd2-7dfd-4854-83e8-56d8970e56bc] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:56:52.146143 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-0b73f616-7c50-43cf-b5c9-97168b1c8707 tempest-ServerMetadataNegativeTestJSON-1253820515 tempest-ServerMetadataNegativeTestJSON-1253820515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153f7059fd924dc5b19f323e0a400381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be467d2547d46089b833ae4b5f9dd05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:56:52.154241 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-0b73f616-7c50-43cf-b5c9-97168b1c8707 tempest-ServerMetadataNegativeTestJSON-1253820515 tempest-ServerMetadataNegativeTestJSON-1253820515-project] 10.222.0.18 "GET /compute/v2.1/servers/674e9bd2-7dfd-4854-83e8-56d8970e56bc" status: 200 len: 1224 microversion: 2.1 time: 0.217449 Oct 22 20:56:52.175589 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 882/1853] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:56:51 2022] GET /compute/v2.1/servers/674e9bd2-7dfd-4854-83e8-56d8970e56bc => generated 1224 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:56:52.192353 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-a7d1f02f-e8cf-490d-bdc1-30ef205cee3f tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:56:52.193093 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-a7d1f02f-e8cf-490d-bdc1-30ef205cee3f tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] [instance: 28c2b09f-e43f-472b-b8db-f407c341acfd] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:56:52.193486 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-539aa297-4321-4ade-8330-1d9d1d31078c tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b392ad1fe1fd4b2a9e6be03a7435deb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594624ed28aa433d907c8833d360b82e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:56:52.200598 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a7d1f02f-e8cf-490d-bdc1-30ef205cee3f tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:52.201104 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a7d1f02f-e8cf-490d-bdc1-30ef205cee3f tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:52.201643 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a7d1f02f-e8cf-490d-bdc1-30ef205cee3f tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:52.202372 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a7d1f02f-e8cf-490d-bdc1-30ef205cee3f tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:52.202838 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a7d1f02f-e8cf-490d-bdc1-30ef205cee3f tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:52.203273 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a7d1f02f-e8cf-490d-bdc1-30ef205cee3f tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:52.209766 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-539aa297-4321-4ade-8330-1d9d1d31078c tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] 10.222.0.18 "GET /compute/v2.1/servers/3de7ee82-86b9-4c34-8b81-46f09d6239d0" status: 200 len: 1538 microversion: 2.1 time: 0.634208 Oct 22 20:56:52.216856 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 972/1854] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:56:51 2022] GET /compute/v2.1/servers/3de7ee82-86b9-4c34-8b81-46f09d6239d0 => generated 1538 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:56:52.433921 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-4b347f1f-30f7-419b-a002-d81ed8230bbf tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:56:52.436061 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-4b347f1f-30f7-419b-a002-d81ed8230bbf tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] [instance: aee36c9d-baf4-453c-b88f-31b8f23638c2] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:56:52.448384 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4b347f1f-30f7-419b-a002-d81ed8230bbf tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:52.450167 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4b347f1f-30f7-419b-a002-d81ed8230bbf tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:52.451996 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4b347f1f-30f7-419b-a002-d81ed8230bbf tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:52.452938 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4b347f1f-30f7-419b-a002-d81ed8230bbf tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:52.455362 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4b347f1f-30f7-419b-a002-d81ed8230bbf tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:52.460048 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4b347f1f-30f7-419b-a002-d81ed8230bbf tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:52.565108 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-a7d1f02f-e8cf-490d-bdc1-30ef205cee3f tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e787e0b494764176a0f13d75c47d77fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '371ecb87e8d34859971be23c1a1bc443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:56:52.579606 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-a7d1f02f-e8cf-490d-bdc1-30ef205cee3f tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] 10.222.0.18 "GET /compute/v2.1/servers/28c2b09f-e43f-472b-b8db-f407c341acfd" status: 200 len: 1508 microversion: 2.1 time: 0.402326 Oct 22 20:56:52.583807 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 883/1855] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:56:52 2022] GET /compute/v2.1/servers/28c2b09f-e43f-472b-b8db-f407c341acfd => generated 1508 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:56:52.694114 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-4b347f1f-30f7-419b-a002-d81ed8230bbf tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d3d7458af447bdb3f03e83a2d8559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49238b8686d24ae698679e4a1957735d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:56:52.714354 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-4b347f1f-30f7-419b-a002-d81ed8230bbf tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] 10.222.0.18 "GET /compute/v2.1/servers/aee36c9d-baf4-453c-b88f-31b8f23638c2" status: 200 len: 1337 microversion: 2.1 time: 0.285223 Oct 22 20:56:52.719008 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 973/1856] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:56:52 2022] GET /compute/v2.1/servers/aee36c9d-baf4-453c-b88f-31b8f23638c2 => generated 1337 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 20:56:53.186441 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-58393f99-af0b-48cd-b44a-cc3dfb762041 tempest-ServerMetadataNegativeTestJSON-1253820515 tempest-ServerMetadataNegativeTestJSON-1253820515-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:56:53.189158 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-58393f99-af0b-48cd-b44a-cc3dfb762041 tempest-ServerMetadataNegativeTestJSON-1253820515 tempest-ServerMetadataNegativeTestJSON-1253820515-project] [instance: 674e9bd2-7dfd-4854-83e8-56d8970e56bc] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:56:53.209774 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:56:53.217312 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-58393f99-af0b-48cd-b44a-cc3dfb762041 tempest-ServerMetadataNegativeTestJSON-1253820515 tempest-ServerMetadataNegativeTestJSON-1253820515-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:53.218373 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-58393f99-af0b-48cd-b44a-cc3dfb762041 tempest-ServerMetadataNegativeTestJSON-1253820515 tempest-ServerMetadataNegativeTestJSON-1253820515-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:53.219652 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-58393f99-af0b-48cd-b44a-cc3dfb762041 tempest-ServerMetadataNegativeTestJSON-1253820515 tempest-ServerMetadataNegativeTestJSON-1253820515-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:53.231257 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-58393f99-af0b-48cd-b44a-cc3dfb762041 tempest-ServerMetadataNegativeTestJSON-1253820515 tempest-ServerMetadataNegativeTestJSON-1253820515-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:53.233202 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-58393f99-af0b-48cd-b44a-cc3dfb762041 tempest-ServerMetadataNegativeTestJSON-1253820515 tempest-ServerMetadataNegativeTestJSON-1253820515-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:53.234301 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-58393f99-af0b-48cd-b44a-cc3dfb762041 tempest-ServerMetadataNegativeTestJSON-1253820515 tempest-ServerMetadataNegativeTestJSON-1253820515-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:53.245494 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-5df989e5-50ee-4bf3-86d1-33e933a5c747 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:56:53.246413 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-5df989e5-50ee-4bf3-86d1-33e933a5c747 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] [instance: 3de7ee82-86b9-4c34-8b81-46f09d6239d0] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:56:53.263499 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5df989e5-50ee-4bf3-86d1-33e933a5c747 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:53.266045 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5df989e5-50ee-4bf3-86d1-33e933a5c747 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:53.268640 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5df989e5-50ee-4bf3-86d1-33e933a5c747 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:53.278239 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5df989e5-50ee-4bf3-86d1-33e933a5c747 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:53.278959 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5df989e5-50ee-4bf3-86d1-33e933a5c747 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:53.279617 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5df989e5-50ee-4bf3-86d1-33e933a5c747 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:53.970806 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-58393f99-af0b-48cd-b44a-cc3dfb762041 tempest-ServerMetadataNegativeTestJSON-1253820515 tempest-ServerMetadataNegativeTestJSON-1253820515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153f7059fd924dc5b19f323e0a400381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be467d2547d46089b833ae4b5f9dd05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:56:53.988038 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-58393f99-af0b-48cd-b44a-cc3dfb762041 tempest-ServerMetadataNegativeTestJSON-1253820515 tempest-ServerMetadataNegativeTestJSON-1253820515-project] 10.222.0.18 "GET /compute/v2.1/servers/674e9bd2-7dfd-4854-83e8-56d8970e56bc" status: 200 len: 1220 microversion: 2.1 time: 0.809522 Oct 22 20:56:53.988935 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 884/1857] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:56:53 2022] GET /compute/v2.1/servers/674e9bd2-7dfd-4854-83e8-56d8970e56bc => generated 1220 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:56:53.993755 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-4664d847-c809-4f36-aa6d-9cf36276eb9c tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:56:53.994561 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-4664d847-c809-4f36-aa6d-9cf36276eb9c tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] [instance: 28c2b09f-e43f-472b-b8db-f407c341acfd] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:56:54.011903 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4664d847-c809-4f36-aa6d-9cf36276eb9c tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:54.012717 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4664d847-c809-4f36-aa6d-9cf36276eb9c tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:54.013835 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4664d847-c809-4f36-aa6d-9cf36276eb9c tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:54.014758 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4664d847-c809-4f36-aa6d-9cf36276eb9c tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:54.015405 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4664d847-c809-4f36-aa6d-9cf36276eb9c tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:54.015994 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4664d847-c809-4f36-aa6d-9cf36276eb9c tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:54.144863 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-5df989e5-50ee-4bf3-86d1-33e933a5c747 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b392ad1fe1fd4b2a9e6be03a7435deb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594624ed28aa433d907c8833d360b82e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:56:54.159886 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-5df989e5-50ee-4bf3-86d1-33e933a5c747 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] 10.222.0.18 "GET /compute/v2.1/servers/3de7ee82-86b9-4c34-8b81-46f09d6239d0" status: 200 len: 1538 microversion: 2.1 time: 0.918762 Oct 22 20:56:54.162682 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 974/1858] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:56:53 2022] GET /compute/v2.1/servers/3de7ee82-86b9-4c34-8b81-46f09d6239d0 => generated 1538 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 20:56:54.174093 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-b7c4326c-004a-4d86-bca8-565b8bd5b224 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:56:54.180384 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-b7c4326c-004a-4d86-bca8-565b8bd5b224 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] [instance: aee36c9d-baf4-453c-b88f-31b8f23638c2] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:56:54.196784 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b7c4326c-004a-4d86-bca8-565b8bd5b224 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:54.197677 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b7c4326c-004a-4d86-bca8-565b8bd5b224 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:54.200071 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b7c4326c-004a-4d86-bca8-565b8bd5b224 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:54.203717 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b7c4326c-004a-4d86-bca8-565b8bd5b224 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:54.204480 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b7c4326c-004a-4d86-bca8-565b8bd5b224 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:54.205424 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b7c4326c-004a-4d86-bca8-565b8bd5b224 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:55.547729 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-4664d847-c809-4f36-aa6d-9cf36276eb9c tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e787e0b494764176a0f13d75c47d77fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '371ecb87e8d34859971be23c1a1bc443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:56:55.561335 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-4664d847-c809-4f36-aa6d-9cf36276eb9c tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] 10.222.0.18 "GET /compute/v2.1/servers/28c2b09f-e43f-472b-b8db-f407c341acfd" status: 200 len: 1512 microversion: 2.1 time: 1.568648 Oct 22 20:56:55.565105 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 885/1859] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:56:53 2022] GET /compute/v2.1/servers/28c2b09f-e43f-472b-b8db-f407c341acfd => generated 1512 bytes in 1575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:56:55.584728 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-f124aeba-54b1-457f-baca-6f7e633ef4fa req-396e96ef-6779-4089-a515-2e4fcab15bfb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3de7ee82-86b9-4c34-8b81-46f09d6239d0", "name": "network-vif-plugged", "status": "completed", "tag": "1f69f669-8018-4f6c-a6cf-2f988963a116"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:56:55.608760 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-f124aeba-54b1-457f-baca-6f7e633ef4fa req-396e96ef-6779-4089-a515-2e4fcab15bfb service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:55.609770 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-f124aeba-54b1-457f-baca-6f7e633ef4fa req-396e96ef-6779-4089-a515-2e4fcab15bfb service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:55.616505 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-f124aeba-54b1-457f-baca-6f7e633ef4fa req-396e96ef-6779-4089-a515-2e4fcab15bfb service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:55.664033 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-f124aeba-54b1-457f-baca-6f7e633ef4fa req-396e96ef-6779-4089-a515-2e4fcab15bfb service nova] Creating event network-vif-plugged:1f69f669-8018-4f6c-a6cf-2f988963a116 for instance 3de7ee82-86b9-4c34-8b81-46f09d6239d0 on nch1-master-1 Oct 22 20:56:55.689467 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-f124aeba-54b1-457f-baca-6f7e633ef4fa req-396e96ef-6779-4089-a515-2e4fcab15bfb service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122396 Oct 22 20:56:55.698196 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 886/1860] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:56:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:56:55.712023 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-a47a6f9b-89f7-4aa8-921a-705a6602ec59 tempest-ServerMetadataNegativeTestJSON-1253820515 tempest-ServerMetadataNegativeTestJSON-1253820515-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:56:55.717431 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-a47a6f9b-89f7-4aa8-921a-705a6602ec59 tempest-ServerMetadataNegativeTestJSON-1253820515 tempest-ServerMetadataNegativeTestJSON-1253820515-project] [instance: 674e9bd2-7dfd-4854-83e8-56d8970e56bc] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:56:55.749823 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a47a6f9b-89f7-4aa8-921a-705a6602ec59 tempest-ServerMetadataNegativeTestJSON-1253820515 tempest-ServerMetadataNegativeTestJSON-1253820515-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:55.751781 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a47a6f9b-89f7-4aa8-921a-705a6602ec59 tempest-ServerMetadataNegativeTestJSON-1253820515 tempest-ServerMetadataNegativeTestJSON-1253820515-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:55.753978 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a47a6f9b-89f7-4aa8-921a-705a6602ec59 tempest-ServerMetadataNegativeTestJSON-1253820515 tempest-ServerMetadataNegativeTestJSON-1253820515-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:55.758539 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a47a6f9b-89f7-4aa8-921a-705a6602ec59 tempest-ServerMetadataNegativeTestJSON-1253820515 tempest-ServerMetadataNegativeTestJSON-1253820515-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:55.761873 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a47a6f9b-89f7-4aa8-921a-705a6602ec59 tempest-ServerMetadataNegativeTestJSON-1253820515 tempest-ServerMetadataNegativeTestJSON-1253820515-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:55.764342 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a47a6f9b-89f7-4aa8-921a-705a6602ec59 tempest-ServerMetadataNegativeTestJSON-1253820515 tempest-ServerMetadataNegativeTestJSON-1253820515-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:55.936096 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-b7c4326c-004a-4d86-bca8-565b8bd5b224 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d3d7458af447bdb3f03e83a2d8559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49238b8686d24ae698679e4a1957735d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:56:55.951785 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-b7c4326c-004a-4d86-bca8-565b8bd5b224 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] 10.222.0.18 "GET /compute/v2.1/servers/aee36c9d-baf4-453c-b88f-31b8f23638c2" status: 200 len: 1379 microversion: 2.1 time: 1.786206 Oct 22 20:56:55.953527 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 975/1861] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:56:54 2022] GET /compute/v2.1/servers/aee36c9d-baf4-453c-b88f-31b8f23638c2 => generated 1379 bytes in 1790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:56:55.963851 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-c72a434c-fc37-4703-9b01-8895745b2ad2 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:56:55.965997 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-c72a434c-fc37-4703-9b01-8895745b2ad2 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] [instance: 3de7ee82-86b9-4c34-8b81-46f09d6239d0] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:56:55.978063 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c72a434c-fc37-4703-9b01-8895745b2ad2 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:55.978986 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c72a434c-fc37-4703-9b01-8895745b2ad2 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:55.979788 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c72a434c-fc37-4703-9b01-8895745b2ad2 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:55.981196 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c72a434c-fc37-4703-9b01-8895745b2ad2 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:55.981874 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c72a434c-fc37-4703-9b01-8895745b2ad2 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:55.982538 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c72a434c-fc37-4703-9b01-8895745b2ad2 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:56.091870 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-a47a6f9b-89f7-4aa8-921a-705a6602ec59 tempest-ServerMetadataNegativeTestJSON-1253820515 tempest-ServerMetadataNegativeTestJSON-1253820515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153f7059fd924dc5b19f323e0a400381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be467d2547d46089b833ae4b5f9dd05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:56:56.091870 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-a47a6f9b-89f7-4aa8-921a-705a6602ec59 tempest-ServerMetadataNegativeTestJSON-1253820515 tempest-ServerMetadataNegativeTestJSON-1253820515-project] 10.222.0.18 "GET /compute/v2.1/servers/674e9bd2-7dfd-4854-83e8-56d8970e56bc" status: 200 len: 1282 microversion: 2.1 time: 0.359017 Oct 22 20:56:56.091870 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 887/1862] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:56:55 2022] GET /compute/v2.1/servers/674e9bd2-7dfd-4854-83e8-56d8970e56bc => generated 1282 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:56:56.117068 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-a0a5337d-b8c6-436d-b443-432ac39acde2 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:56:56.123115 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-a0a5337d-b8c6-436d-b443-432ac39acde2 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e787e0b494764176a0f13d75c47d77fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '371ecb87e8d34859971be23c1a1bc443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:56:56.124694 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.compute.servers [None req-a0a5337d-b8c6-436d-b443-432ac39acde2 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Removing options 'limit' from query {{(pid=138744) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 22 20:56:56.126422 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-a0a5337d-b8c6-436d-b443-432ac39acde2 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Searching by: {'deleted': False, 'project_id': '371ecb87e8d34859971be23c1a1bc443'} {{(pid=138744) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 22 20:56:56.128949 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a0a5337d-b8c6-436d-b443-432ac39acde2 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:56.130136 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a0a5337d-b8c6-436d-b443-432ac39acde2 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:56.130781 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a0a5337d-b8c6-436d-b443-432ac39acde2 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:56.131777 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a0a5337d-b8c6-436d-b443-432ac39acde2 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:56.132516 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a0a5337d-b8c6-436d-b443-432ac39acde2 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:56.133304 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a0a5337d-b8c6-436d-b443-432ac39acde2 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:56.140519 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-a0a5337d-b8c6-436d-b443-432ac39acde2 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] 10.222.0.18 "GET /compute/v2.1/servers?limit=0" status: 200 len: 15 microversion: 2.1 time: 0.066360 Oct 22 20:56:56.141315 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 888/1863] 10.222.0.18 () {58 vars in 1140 bytes} [Sat Oct 22 20:56:56 2022] GET /compute/v2.1/servers?limit=0 => generated 15 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 22 20:56:56.158327 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-08499373-57a3-4606-88c1-cb9f3d439d9f tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:56:56.160083 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-08499373-57a3-4606-88c1-cb9f3d439d9f tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] [instance: 28c2b09f-e43f-472b-b8db-f407c341acfd] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:56:56.171605 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-08499373-57a3-4606-88c1-cb9f3d439d9f tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:56.173022 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-08499373-57a3-4606-88c1-cb9f3d439d9f tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:56.174017 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-08499373-57a3-4606-88c1-cb9f3d439d9f tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:56.175046 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-08499373-57a3-4606-88c1-cb9f3d439d9f tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:56.175731 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-08499373-57a3-4606-88c1-cb9f3d439d9f tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:56.176656 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-08499373-57a3-4606-88c1-cb9f3d439d9f tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:56.665053 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-08499373-57a3-4606-88c1-cb9f3d439d9f tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e787e0b494764176a0f13d75c47d77fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '371ecb87e8d34859971be23c1a1bc443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:56:56.674793 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-08499373-57a3-4606-88c1-cb9f3d439d9f tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] 10.222.0.18 "GET /compute/v2.1/servers/28c2b09f-e43f-472b-b8db-f407c341acfd" status: 200 len: 1512 microversion: 2.1 time: 0.523963 Oct 22 20:56:56.679070 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 889/1864] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:56:56 2022] GET /compute/v2.1/servers/28c2b09f-e43f-472b-b8db-f407c341acfd => generated 1512 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:56:56.737850 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-c72a434c-fc37-4703-9b01-8895745b2ad2 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b392ad1fe1fd4b2a9e6be03a7435deb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594624ed28aa433d907c8833d360b82e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:56:56.750972 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-c72a434c-fc37-4703-9b01-8895745b2ad2 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] 10.222.0.18 "GET /compute/v2.1/servers/3de7ee82-86b9-4c34-8b81-46f09d6239d0" status: 200 len: 1520 microversion: 2.1 time: 0.795901 Oct 22 20:56:56.754327 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 976/1865] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:56:55 2022] GET /compute/v2.1/servers/3de7ee82-86b9-4c34-8b81-46f09d6239d0 => generated 1520 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:56:56.762024 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-6b1e2010-b1c7-4adf-bdd7-af4a3a6de4d1 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:56:56.763016 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-6b1e2010-b1c7-4adf-bdd7-af4a3a6de4d1 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] [instance: c5db8404-7c9d-41d4-a018-a27058378d35] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:56:56.776169 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6b1e2010-b1c7-4adf-bdd7-af4a3a6de4d1 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:56.776840 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6b1e2010-b1c7-4adf-bdd7-af4a3a6de4d1 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:56.777413 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6b1e2010-b1c7-4adf-bdd7-af4a3a6de4d1 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:56.778282 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6b1e2010-b1c7-4adf-bdd7-af4a3a6de4d1 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:56.778881 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6b1e2010-b1c7-4adf-bdd7-af4a3a6de4d1 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:56.779489 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6b1e2010-b1c7-4adf-bdd7-af4a3a6de4d1 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:56.923291 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-14cc76a1-bcb2-4475-a16e-7ba89c7a6212 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationNegativeTestJSON-server-3989040", "imageRef": "085e4478-6edc-4a69-8e08-f9831713eb65", "flavorRef": "452", "networks": [{"uuid": "f91354a8-e9f6-4d96-999f-cacf94b2f223"}]}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:56:56.991838 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.network.neutron [None req-14cc76a1-bcb2-4475-a16e-7ba89c7a6212 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] validate_networks() for [('f91354a8-e9f6-4d96-999f-cacf94b2f223', None, None, None, None, None)] {{(pid=138744) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 20:56:57.168533 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell0:SELECT=12 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:56:57.247681 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-6b1e2010-b1c7-4adf-bdd7-af4a3a6de4d1 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e787e0b494764176a0f13d75c47d77fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '371ecb87e8d34859971be23c1a1bc443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:56:57.260205 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-6b1e2010-b1c7-4adf-bdd7-af4a3a6de4d1 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] 10.222.0.18 "GET /compute/v2.1/servers/c5db8404-7c9d-41d4-a018-a27058378d35" status: 200 len: 1513 microversion: 2.1 time: 0.504093 Oct 22 20:56:57.269115 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 977/1866] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:56:56 2022] GET /compute/v2.1/servers/c5db8404-7c9d-41d4-a018-a27058378d35 => generated 1513 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:56:57.345611 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-8dafe0cb-a5b7-42d9-94d1-a4fac8431f7e tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-419597856", "imageRef": "085e4478-6edc-4a69-8e08-f9831713eb65", "flavorRef": "452"}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:56:57.400587 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.network.neutron [None req-8dafe0cb-a5b7-42d9-94d1-a4fac8431f7e tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] validate_networks() for None {{(pid=138745) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 20:56:57.903502 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell0:SELECT=20 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:56:58.549971 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-8dafe0cb-a5b7-42d9-94d1-a4fac8431f7e tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Flavor limits 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 20:56:58.550571 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-8dafe0cb-a5b7-42d9-94d1-a4fac8431f7e tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Image limits 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 20:56:58.550871 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-8dafe0cb-a5b7-42d9-94d1-a4fac8431f7e tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Flavor pref 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 20:56:58.551289 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-8dafe0cb-a5b7-42d9-94d1-a4fac8431f7e tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Image pref 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 20:56:58.551999 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-8dafe0cb-a5b7-42d9-94d1-a4fac8431f7e tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 20:56:58.564705 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8dafe0cb-a5b7-42d9-94d1-a4fac8431f7e tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:58.565346 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8dafe0cb-a5b7-42d9-94d1-a4fac8431f7e tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:58.565957 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8dafe0cb-a5b7-42d9-94d1-a4fac8431f7e tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:58.566772 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8dafe0cb-a5b7-42d9-94d1-a4fac8431f7e tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:58.567421 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8dafe0cb-a5b7-42d9-94d1-a4fac8431f7e tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:58.568239 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8dafe0cb-a5b7-42d9-94d1-a4fac8431f7e tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:58.655884 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-8dafe0cb-a5b7-42d9-94d1-a4fac8431f7e tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Getting quotas for project a8b58ab4af674c778b4819f177045651. Resources: {'cores', 'instances', 'ram'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 20:56:58.666129 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-8dafe0cb-a5b7-42d9-94d1-a4fac8431f7e tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Getting quotas for user 0d0d808e98f843dd9621822682c9d278 and project a8b58ab4af674c778b4819f177045651. Resources: {'cores', 'instances', 'ram'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 20:56:58.682120 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-8dafe0cb-a5b7-42d9-94d1-a4fac8431f7e tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Going to run 1 instances... {{(pid=138745) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 20:56:58.684715 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-8dafe0cb-a5b7-42d9-94d1-a4fac8431f7e tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] [instance: cc3236d7-3b9f-40f2-8a53-3096f986e87e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='085e4478-6edc-4a69-8e08-f9831713eb65',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138745) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 20:56:58.832514 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-8dafe0cb-a5b7-42d9-94d1-a4fac8431f7e tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.556028 Oct 22 20:56:58.841239 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 978/1867] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Oct 22 20:56:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 1567 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 20:56:58.847876 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-b80ef2fc-98e6-41f5-b15c-3baf2a46ba21 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:56:58.848418 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-b80ef2fc-98e6-41f5-b15c-3baf2a46ba21 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] [instance: 3de7ee82-86b9-4c34-8b81-46f09d6239d0] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:56:58.856005 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b80ef2fc-98e6-41f5-b15c-3baf2a46ba21 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:58.856602 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b80ef2fc-98e6-41f5-b15c-3baf2a46ba21 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:58.857492 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b80ef2fc-98e6-41f5-b15c-3baf2a46ba21 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:58.858627 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b80ef2fc-98e6-41f5-b15c-3baf2a46ba21 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:58.859264 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b80ef2fc-98e6-41f5-b15c-3baf2a46ba21 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:58.859973 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b80ef2fc-98e6-41f5-b15c-3baf2a46ba21 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:58.906306 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-b80ef2fc-98e6-41f5-b15c-3baf2a46ba21 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] [instance: 3de7ee82-86b9-4c34-8b81-46f09d6239d0] Going to try to terminate instance {{(pid=138745) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 20:56:58.906810 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-14cc76a1-bcb2-4475-a16e-7ba89c7a6212 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] Flavor limits 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 20:56:58.907495 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-14cc76a1-bcb2-4475-a16e-7ba89c7a6212 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] Image limits 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 20:56:58.908324 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-14cc76a1-bcb2-4475-a16e-7ba89c7a6212 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] Flavor pref 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 20:56:58.908939 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-14cc76a1-bcb2-4475-a16e-7ba89c7a6212 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] Image pref 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 20:56:58.909509 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-14cc76a1-bcb2-4475-a16e-7ba89c7a6212 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 20:56:58.940465 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-14cc76a1-bcb2-4475-a16e-7ba89c7a6212 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:58.942244 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-14cc76a1-bcb2-4475-a16e-7ba89c7a6212 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:58.948160 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-14cc76a1-bcb2-4475-a16e-7ba89c7a6212 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:58.949070 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-14cc76a1-bcb2-4475-a16e-7ba89c7a6212 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:58.954696 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-14cc76a1-bcb2-4475-a16e-7ba89c7a6212 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:58.955425 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-14cc76a1-bcb2-4475-a16e-7ba89c7a6212 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:59.016500 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-14cc76a1-bcb2-4475-a16e-7ba89c7a6212 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] Getting quotas for project 7e883d7e73084efeb725945ae0bab317. Resources: {'cores', 'instances', 'ram'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 20:56:59.028447 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-14cc76a1-bcb2-4475-a16e-7ba89c7a6212 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] Getting quotas for user 5660f7f9d86f473eaa83e2be362ca63c and project 7e883d7e73084efeb725945ae0bab317. Resources: {'cores', 'instances', 'ram'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 20:56:59.072903 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-14cc76a1-bcb2-4475-a16e-7ba89c7a6212 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] Going to run 1 instances... {{(pid=138744) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 20:56:59.075757 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-14cc76a1-bcb2-4475-a16e-7ba89c7a6212 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] [instance: 18183d64-42b7-4b9f-9bca-6d018f17eeb3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='085e4478-6edc-4a69-8e08-f9831713eb65',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138744) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 20:56:59.164198 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-b80ef2fc-98e6-41f5-b15c-3baf2a46ba21 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] 10.222.0.18 "DELETE /compute/v2.1/servers/3de7ee82-86b9-4c34-8b81-46f09d6239d0" status: 204 len: 0 microversion: 2.1 time: 0.319238 Oct 22 20:56:59.168132 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 979/1868] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 20:56:58 2022] DELETE /compute/v2.1/servers/3de7ee82-86b9-4c34-8b81-46f09d6239d0 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 20:56:59.194868 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-77912b8e-0f66-4306-b8b3-61c89a6c4b20 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:56:59.195635 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-77912b8e-0f66-4306-b8b3-61c89a6c4b20 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] [instance: aee36c9d-baf4-453c-b88f-31b8f23638c2] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:56:59.215448 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-14cc76a1-bcb2-4475-a16e-7ba89c7a6212 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.533777 Oct 22 20:56:59.219062 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-77912b8e-0f66-4306-b8b3-61c89a6c4b20 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:59.235987 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 890/1869] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Oct 22 20:56:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 2556 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 20:56:59.237065 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-77912b8e-0f66-4306-b8b3-61c89a6c4b20 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:59.242716 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-77912b8e-0f66-4306-b8b3-61c89a6c4b20 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:59.243972 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-77912b8e-0f66-4306-b8b3-61c89a6c4b20 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:59.244594 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-77912b8e-0f66-4306-b8b3-61c89a6c4b20 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:59.245170 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-77912b8e-0f66-4306-b8b3-61c89a6c4b20 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:59.250643 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-1e406e8b-a1fd-4cd3-9f0c-7c83aff73cc4 tempest-ServerMetadataNegativeTestJSON-1253820515 tempest-ServerMetadataNegativeTestJSON-1253820515-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:56:59.251732 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-1e406e8b-a1fd-4cd3-9f0c-7c83aff73cc4 tempest-ServerMetadataNegativeTestJSON-1253820515 tempest-ServerMetadataNegativeTestJSON-1253820515-project] [instance: 674e9bd2-7dfd-4854-83e8-56d8970e56bc] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:56:59.270580 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1e406e8b-a1fd-4cd3-9f0c-7c83aff73cc4 tempest-ServerMetadataNegativeTestJSON-1253820515 tempest-ServerMetadataNegativeTestJSON-1253820515-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:59.272487 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1e406e8b-a1fd-4cd3-9f0c-7c83aff73cc4 tempest-ServerMetadataNegativeTestJSON-1253820515 tempest-ServerMetadataNegativeTestJSON-1253820515-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:59.273655 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1e406e8b-a1fd-4cd3-9f0c-7c83aff73cc4 tempest-ServerMetadataNegativeTestJSON-1253820515 tempest-ServerMetadataNegativeTestJSON-1253820515-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:59.275134 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1e406e8b-a1fd-4cd3-9f0c-7c83aff73cc4 tempest-ServerMetadataNegativeTestJSON-1253820515 tempest-ServerMetadataNegativeTestJSON-1253820515-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:59.276344 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1e406e8b-a1fd-4cd3-9f0c-7c83aff73cc4 tempest-ServerMetadataNegativeTestJSON-1253820515 tempest-ServerMetadataNegativeTestJSON-1253820515-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:59.279443 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1e406e8b-a1fd-4cd3-9f0c-7c83aff73cc4 tempest-ServerMetadataNegativeTestJSON-1253820515 tempest-ServerMetadataNegativeTestJSON-1253820515-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:59.360922 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:56:59.806935 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-77912b8e-0f66-4306-b8b3-61c89a6c4b20 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d3d7458af447bdb3f03e83a2d8559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49238b8686d24ae698679e4a1957735d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:56:59.816464 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-77912b8e-0f66-4306-b8b3-61c89a6c4b20 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] 10.222.0.18 "GET /compute/v2.1/servers/aee36c9d-baf4-453c-b88f-31b8f23638c2" status: 200 len: 1379 microversion: 2.1 time: 0.637044 Oct 22 20:56:59.817076 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 980/1870] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:56:59 2022] GET /compute/v2.1/servers/aee36c9d-baf4-453c-b88f-31b8f23638c2 => generated 1379 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:56:59.832319 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-1cdec3ad-2914-4122-9d91-546e60ff6c62 req-21b5de76-a6b4-4fb1-b391-971da37eaf4e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aee36c9d-baf4-453c-b88f-31b8f23638c2", "tag": "f8ab0e3e-04fa-4f80-97a2-b20b84653be1"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:56:59.854947 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-1cdec3ad-2914-4122-9d91-546e60ff6c62 req-21b5de76-a6b4-4fb1-b391-971da37eaf4e service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:59.855479 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-1cdec3ad-2914-4122-9d91-546e60ff6c62 req-21b5de76-a6b4-4fb1-b391-971da37eaf4e service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:59.855933 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-1cdec3ad-2914-4122-9d91-546e60ff6c62 req-21b5de76-a6b4-4fb1-b391-971da37eaf4e service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:59.882348 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-1cdec3ad-2914-4122-9d91-546e60ff6c62 req-21b5de76-a6b4-4fb1-b391-971da37eaf4e service nova] Creating event network-changed:f8ab0e3e-04fa-4f80-97a2-b20b84653be1 for instance aee36c9d-baf4-453c-b88f-31b8f23638c2 on nch1-master-1 Oct 22 20:56:59.902752 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-1cdec3ad-2914-4122-9d91-546e60ff6c62 req-21b5de76-a6b4-4fb1-b391-971da37eaf4e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073816 Oct 22 20:56:59.902752 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 981/1871] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:56:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:56:59.914792 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-38858307-e7c1-4e95-80db-a0c8a005c044 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:56:59.915969 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-38858307-e7c1-4e95-80db-a0c8a005c044 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] [instance: df5f7e8f-5ed6-4ad6-9bcb-eaa54b4ee320] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:56:59.935524 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-38858307-e7c1-4e95-80db-a0c8a005c044 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:59.937848 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-38858307-e7c1-4e95-80db-a0c8a005c044 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:59.938327 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-38858307-e7c1-4e95-80db-a0c8a005c044 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:59.939222 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-38858307-e7c1-4e95-80db-a0c8a005c044 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:56:59.939726 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-38858307-e7c1-4e95-80db-a0c8a005c044 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:56:59.953625 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-38858307-e7c1-4e95-80db-a0c8a005c044 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:56:59.974510 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:57:00.200761 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-1e406e8b-a1fd-4cd3-9f0c-7c83aff73cc4 tempest-ServerMetadataNegativeTestJSON-1253820515 tempest-ServerMetadataNegativeTestJSON-1253820515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153f7059fd924dc5b19f323e0a400381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be467d2547d46089b833ae4b5f9dd05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:57:00.224110 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-1e406e8b-a1fd-4cd3-9f0c-7c83aff73cc4 tempest-ServerMetadataNegativeTestJSON-1253820515 tempest-ServerMetadataNegativeTestJSON-1253820515-project] 10.222.0.18 "GET /compute/v2.1/servers/674e9bd2-7dfd-4854-83e8-56d8970e56bc" status: 200 len: 1324 microversion: 2.1 time: 0.980758 Oct 22 20:57:00.225095 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 891/1872] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:56:59 2022] GET /compute/v2.1/servers/674e9bd2-7dfd-4854-83e8-56d8970e56bc => generated 1324 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:57:00.236206 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-7e5d0d67-5437-46fb-a93c-b07c52b0a585 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:57:00.237100 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-7e5d0d67-5437-46fb-a93c-b07c52b0a585 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] [instance: cc3236d7-3b9f-40f2-8a53-3096f986e87e] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:57:00.261455 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7e5d0d67-5437-46fb-a93c-b07c52b0a585 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:00.262124 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7e5d0d67-5437-46fb-a93c-b07c52b0a585 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:00.262918 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7e5d0d67-5437-46fb-a93c-b07c52b0a585 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:00.263815 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7e5d0d67-5437-46fb-a93c-b07c52b0a585 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:00.268972 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7e5d0d67-5437-46fb-a93c-b07c52b0a585 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:00.269644 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7e5d0d67-5437-46fb-a93c-b07c52b0a585 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:00.406216 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-7e5d0d67-5437-46fb-a93c-b07c52b0a585 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d808e98f843dd9621822682c9d278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b58ab4af674c778b4819f177045651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:57:00.415470 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-7e5d0d67-5437-46fb-a93c-b07c52b0a585 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] 10.222.0.18 "GET /compute/v2.1/servers/cc3236d7-3b9f-40f2-8a53-3096f986e87e" status: 200 len: 1222 microversion: 2.1 time: 0.188987 Oct 22 20:57:00.416346 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 892/1873] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:57:00 2022] GET /compute/v2.1/servers/cc3236d7-3b9f-40f2-8a53-3096f986e87e => generated 1222 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:57:00.417542 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-38858307-e7c1-4e95-80db-a0c8a005c044 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e787e0b494764176a0f13d75c47d77fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '371ecb87e8d34859971be23c1a1bc443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:57:00.428471 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-38858307-e7c1-4e95-80db-a0c8a005c044 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] 10.222.0.18 "GET /compute/v2.1/servers/df5f7e8f-5ed6-4ad6-9bcb-eaa54b4ee320" status: 200 len: 1512 microversion: 2.1 time: 0.532292 Oct 22 20:57:00.428594 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-1212ae4f-837d-4ef0-98b3-dd7039330c2e tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:57:00.429190 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 982/1874] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:56:59 2022] GET /compute/v2.1/servers/df5f7e8f-5ed6-4ad6-9bcb-eaa54b4ee320 => generated 1512 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:57:00.429792 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-1212ae4f-837d-4ef0-98b3-dd7039330c2e tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] [instance: 3de7ee82-86b9-4c34-8b81-46f09d6239d0] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:57:00.437287 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1212ae4f-837d-4ef0-98b3-dd7039330c2e tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:00.438085 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1212ae4f-837d-4ef0-98b3-dd7039330c2e tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:00.438887 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1212ae4f-837d-4ef0-98b3-dd7039330c2e tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:00.440537 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1212ae4f-837d-4ef0-98b3-dd7039330c2e tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:00.442186 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1212ae4f-837d-4ef0-98b3-dd7039330c2e tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:00.442833 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-90e9853f-4b90-4db9-aa61-b3de15c18fd1 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:57:00.443105 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1212ae4f-837d-4ef0-98b3-dd7039330c2e tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:00.443505 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-90e9853f-4b90-4db9-aa61-b3de15c18fd1 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] [instance: 18183d64-42b7-4b9f-9bca-6d018f17eeb3] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:57:00.458397 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-90e9853f-4b90-4db9-aa61-b3de15c18fd1 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:00.458814 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-90e9853f-4b90-4db9-aa61-b3de15c18fd1 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:00.459953 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-90e9853f-4b90-4db9-aa61-b3de15c18fd1 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:00.460876 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-90e9853f-4b90-4db9-aa61-b3de15c18fd1 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:00.461664 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-90e9853f-4b90-4db9-aa61-b3de15c18fd1 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:00.462290 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-90e9853f-4b90-4db9-aa61-b3de15c18fd1 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:00.590555 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-90e9853f-4b90-4db9-aa61-b3de15c18fd1 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5660f7f9d86f473eaa83e2be362ca63c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e883d7e73084efeb725945ae0bab317', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:57:00.600770 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-90e9853f-4b90-4db9-aa61-b3de15c18fd1 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] 10.222.0.18 "GET /compute/v2.1/servers/18183d64-42b7-4b9f-9bca-6d018f17eeb3" status: 200 len: 1233 microversion: 2.1 time: 0.169773 Oct 22 20:57:00.601719 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 983/1875] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:57:00 2022] GET /compute/v2.1/servers/18183d64-42b7-4b9f-9bca-6d018f17eeb3 => generated 1233 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:57:00.609867 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-ce8185cd-6781-4720-b83f-57791c869ee9 req-7956dd76-5158-4af1-92a5-356f83d74aab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3de7ee82-86b9-4c34-8b81-46f09d6239d0", "name": "network-vif-unplugged", "status": "completed", "tag": "1f69f669-8018-4f6c-a6cf-2f988963a116"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:57:00.622488 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-ce8185cd-6781-4720-b83f-57791c869ee9 req-7956dd76-5158-4af1-92a5-356f83d74aab service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:00.623043 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-ce8185cd-6781-4720-b83f-57791c869ee9 req-7956dd76-5158-4af1-92a5-356f83d74aab service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:00.623724 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-ce8185cd-6781-4720-b83f-57791c869ee9 req-7956dd76-5158-4af1-92a5-356f83d74aab service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:00.648847 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-ce8185cd-6781-4720-b83f-57791c869ee9 req-7956dd76-5158-4af1-92a5-356f83d74aab service nova] Creating event network-vif-unplugged:1f69f669-8018-4f6c-a6cf-2f988963a116 for instance 3de7ee82-86b9-4c34-8b81-46f09d6239d0 on nch1-master-1 Oct 22 20:57:00.654847 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-ce8185cd-6781-4720-b83f-57791c869ee9 req-7956dd76-5158-4af1-92a5-356f83d74aab service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.050894 Oct 22 20:57:00.655653 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 984/1876] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:57:00 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:57:00.661050 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-26488054-22c0-4c00-aab7-82caddf3f712 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:57:00.666200 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-26488054-22c0-4c00-aab7-82caddf3f712 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e787e0b494764176a0f13d75c47d77fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '371ecb87e8d34859971be23c1a1bc443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:57:00.666984 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-26488054-22c0-4c00-aab7-82caddf3f712 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Searching by: {'ip': '172.20.0.12', 'deleted': False, 'project_id': '371ecb87e8d34859971be23c1a1bc443'} {{(pid=138745) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 22 20:57:00.679767 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-1212ae4f-837d-4ef0-98b3-dd7039330c2e tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b392ad1fe1fd4b2a9e6be03a7435deb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594624ed28aa433d907c8833d360b82e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:57:00.688810 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-1212ae4f-837d-4ef0-98b3-dd7039330c2e tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] 10.222.0.18 "GET /compute/v2.1/servers/3de7ee82-86b9-4c34-8b81-46f09d6239d0" status: 200 len: 1526 microversion: 2.1 time: 0.271180 Oct 22 20:57:00.689702 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 893/1877] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:57:00 2022] GET /compute/v2.1/servers/3de7ee82-86b9-4c34-8b81-46f09d6239d0 => generated 1526 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:57:00.809124 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-26488054-22c0-4c00-aab7-82caddf3f712 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:00.810203 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-26488054-22c0-4c00-aab7-82caddf3f712 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:00.810869 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-26488054-22c0-4c00-aab7-82caddf3f712 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:00.811846 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-26488054-22c0-4c00-aab7-82caddf3f712 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:00.812510 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-26488054-22c0-4c00-aab7-82caddf3f712 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:00.813530 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-26488054-22c0-4c00-aab7-82caddf3f712 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:00.841772 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-341faa22-1ee7-4ecd-82e0-3228d419e468 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:57:00.842651 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-341faa22-1ee7-4ecd-82e0-3228d419e468 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] [instance: aee36c9d-baf4-453c-b88f-31b8f23638c2] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:57:00.852462 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-341faa22-1ee7-4ecd-82e0-3228d419e468 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:00.853256 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-341faa22-1ee7-4ecd-82e0-3228d419e468 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:00.854333 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-341faa22-1ee7-4ecd-82e0-3228d419e468 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:00.855369 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-341faa22-1ee7-4ecd-82e0-3228d419e468 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:00.856213 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-341faa22-1ee7-4ecd-82e0-3228d419e468 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:00.857036 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-341faa22-1ee7-4ecd-82e0-3228d419e468 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:00.957329 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.multi_cell_list [None req-26488054-22c0-4c00-aab7-82caddf3f712 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=138745) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 22 20:57:01.045485 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-26488054-22c0-4c00-aab7-82caddf3f712 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] 10.222.0.18 "GET /compute/v2.1/servers?ip=172.20.0.12" status: 200 len: 345 microversion: 2.1 time: 0.388557 Oct 22 20:57:01.047478 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 985/1878] 10.222.0.18 () {58 vars in 1154 bytes} [Sat Oct 22 20:57:00 2022] GET /compute/v2.1/servers?ip=172.20.0.12 => generated 345 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:57:01.067579 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-4714202a-97ea-4b5e-86e2-1026f3333933 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:57:01.069608 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-4714202a-97ea-4b5e-86e2-1026f3333933 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] [instance: 28c2b09f-e43f-472b-b8db-f407c341acfd] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:57:01.082931 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4714202a-97ea-4b5e-86e2-1026f3333933 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:01.083950 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4714202a-97ea-4b5e-86e2-1026f3333933 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:01.084588 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4714202a-97ea-4b5e-86e2-1026f3333933 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:01.085665 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4714202a-97ea-4b5e-86e2-1026f3333933 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:01.086436 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4714202a-97ea-4b5e-86e2-1026f3333933 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:01.087056 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4714202a-97ea-4b5e-86e2-1026f3333933 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:01.103579 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-341faa22-1ee7-4ecd-82e0-3228d419e468 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d3d7458af447bdb3f03e83a2d8559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49238b8686d24ae698679e4a1957735d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:57:01.118387 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-341faa22-1ee7-4ecd-82e0-3228d419e468 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] 10.222.0.18 "GET /compute/v2.1/servers/aee36c9d-baf4-453c-b88f-31b8f23638c2" status: 200 len: 1379 microversion: 2.1 time: 0.281693 Oct 22 20:57:01.127862 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 894/1879] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:57:00 2022] GET /compute/v2.1/servers/aee36c9d-baf4-453c-b88f-31b8f23638c2 => generated 1379 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 20:57:01.255026 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-7580d86a-f7d1-4474-98c1-17551210268e tempest-ServerMetadataNegativeTestJSON-1253820515 tempest-ServerMetadataNegativeTestJSON-1253820515-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:57:01.256467 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-7580d86a-f7d1-4474-98c1-17551210268e tempest-ServerMetadataNegativeTestJSON-1253820515 tempest-ServerMetadataNegativeTestJSON-1253820515-project] [instance: 674e9bd2-7dfd-4854-83e8-56d8970e56bc] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:57:01.266527 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7580d86a-f7d1-4474-98c1-17551210268e tempest-ServerMetadataNegativeTestJSON-1253820515 tempest-ServerMetadataNegativeTestJSON-1253820515-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:01.268275 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7580d86a-f7d1-4474-98c1-17551210268e tempest-ServerMetadataNegativeTestJSON-1253820515 tempest-ServerMetadataNegativeTestJSON-1253820515-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:01.269800 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7580d86a-f7d1-4474-98c1-17551210268e tempest-ServerMetadataNegativeTestJSON-1253820515 tempest-ServerMetadataNegativeTestJSON-1253820515-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:01.270811 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7580d86a-f7d1-4474-98c1-17551210268e tempest-ServerMetadataNegativeTestJSON-1253820515 tempest-ServerMetadataNegativeTestJSON-1253820515-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:01.272344 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7580d86a-f7d1-4474-98c1-17551210268e tempest-ServerMetadataNegativeTestJSON-1253820515 tempest-ServerMetadataNegativeTestJSON-1253820515-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:01.273122 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7580d86a-f7d1-4474-98c1-17551210268e tempest-ServerMetadataNegativeTestJSON-1253820515 tempest-ServerMetadataNegativeTestJSON-1253820515-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:01.362509 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-4714202a-97ea-4b5e-86e2-1026f3333933 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e787e0b494764176a0f13d75c47d77fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '371ecb87e8d34859971be23c1a1bc443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:57:01.376754 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-4714202a-97ea-4b5e-86e2-1026f3333933 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] 10.222.0.18 "GET /compute/v2.1/servers/28c2b09f-e43f-472b-b8db-f407c341acfd" status: 200 len: 1512 microversion: 2.1 time: 0.320008 Oct 22 20:57:01.377482 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 986/1880] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:57:01 2022] GET /compute/v2.1/servers/28c2b09f-e43f-472b-b8db-f407c341acfd => generated 1512 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:57:01.398951 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-50896f5c-d950-42ef-ae1f-a992c7bf4fae tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:57:01.399861 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-50896f5c-d950-42ef-ae1f-a992c7bf4fae tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] [instance: c5db8404-7c9d-41d4-a018-a27058378d35] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:57:01.405780 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-50896f5c-d950-42ef-ae1f-a992c7bf4fae tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:01.406263 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-50896f5c-d950-42ef-ae1f-a992c7bf4fae tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:01.406702 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-50896f5c-d950-42ef-ae1f-a992c7bf4fae tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:01.407573 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-50896f5c-d950-42ef-ae1f-a992c7bf4fae tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:01.408031 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-50896f5c-d950-42ef-ae1f-a992c7bf4fae tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:01.408458 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-50896f5c-d950-42ef-ae1f-a992c7bf4fae tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:01.576415 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-7580d86a-f7d1-4474-98c1-17551210268e tempest-ServerMetadataNegativeTestJSON-1253820515 tempest-ServerMetadataNegativeTestJSON-1253820515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153f7059fd924dc5b19f323e0a400381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be467d2547d46089b833ae4b5f9dd05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:57:01.592138 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-7580d86a-f7d1-4474-98c1-17551210268e tempest-ServerMetadataNegativeTestJSON-1253820515 tempest-ServerMetadataNegativeTestJSON-1253820515-project] 10.222.0.18 "GET /compute/v2.1/servers/674e9bd2-7dfd-4854-83e8-56d8970e56bc" status: 200 len: 1324 microversion: 2.1 time: 0.345011 Oct 22 20:57:01.592739 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 895/1881] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:57:01 2022] GET /compute/v2.1/servers/674e9bd2-7dfd-4854-83e8-56d8970e56bc => generated 1324 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:57:01.601626 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-c60234b3-9fc7-4b63-b9a9-b00ea29aec42 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:57:01.602420 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-c60234b3-9fc7-4b63-b9a9-b00ea29aec42 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] [instance: cc3236d7-3b9f-40f2-8a53-3096f986e87e] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:57:01.612385 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c60234b3-9fc7-4b63-b9a9-b00ea29aec42 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:01.613248 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c60234b3-9fc7-4b63-b9a9-b00ea29aec42 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:01.613697 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c60234b3-9fc7-4b63-b9a9-b00ea29aec42 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:01.615079 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c60234b3-9fc7-4b63-b9a9-b00ea29aec42 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:01.615867 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c60234b3-9fc7-4b63-b9a9-b00ea29aec42 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:01.616432 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c60234b3-9fc7-4b63-b9a9-b00ea29aec42 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:01.637748 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-50896f5c-d950-42ef-ae1f-a992c7bf4fae tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e787e0b494764176a0f13d75c47d77fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '371ecb87e8d34859971be23c1a1bc443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:57:01.649937 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-50896f5c-d950-42ef-ae1f-a992c7bf4fae tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] 10.222.0.18 "GET /compute/v2.1/servers/c5db8404-7c9d-41d4-a018-a27058378d35" status: 200 len: 1513 microversion: 2.1 time: 0.254751 Oct 22 20:57:01.650779 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 987/1882] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:57:01 2022] GET /compute/v2.1/servers/c5db8404-7c9d-41d4-a018-a27058378d35 => generated 1513 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 20:57:01.655755 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-d6526e8e-598d-47e4-9e03-cf0a1d5674ac tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:57:01.656373 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-d6526e8e-598d-47e4-9e03-cf0a1d5674ac tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] [instance: 18183d64-42b7-4b9f-9bca-6d018f17eeb3] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:57:01.663295 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d6526e8e-598d-47e4-9e03-cf0a1d5674ac tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:01.663859 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d6526e8e-598d-47e4-9e03-cf0a1d5674ac tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:01.664311 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d6526e8e-598d-47e4-9e03-cf0a1d5674ac tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:01.665081 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d6526e8e-598d-47e4-9e03-cf0a1d5674ac tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:01.665516 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d6526e8e-598d-47e4-9e03-cf0a1d5674ac tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:01.665956 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d6526e8e-598d-47e4-9e03-cf0a1d5674ac tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:01.744768 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-d6526e8e-598d-47e4-9e03-cf0a1d5674ac tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5660f7f9d86f473eaa83e2be362ca63c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e883d7e73084efeb725945ae0bab317', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:57:01.754952 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-d6526e8e-598d-47e4-9e03-cf0a1d5674ac tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] 10.222.0.18 "GET /compute/v2.1/servers/18183d64-42b7-4b9f-9bca-6d018f17eeb3" status: 200 len: 1233 microversion: 2.1 time: 0.103243 Oct 22 20:57:01.756023 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 988/1883] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:57:01 2022] GET /compute/v2.1/servers/18183d64-42b7-4b9f-9bca-6d018f17eeb3 => generated 1233 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:57:01.761023 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-332be3b2-b298-41e7-b54f-f4468e9d907a tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:57:01.761648 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-332be3b2-b298-41e7-b54f-f4468e9d907a tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] [instance: df5f7e8f-5ed6-4ad6-9bcb-eaa54b4ee320] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:57:01.768501 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-332be3b2-b298-41e7-b54f-f4468e9d907a tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:01.769007 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-332be3b2-b298-41e7-b54f-f4468e9d907a tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:01.769512 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-332be3b2-b298-41e7-b54f-f4468e9d907a tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:01.770254 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-332be3b2-b298-41e7-b54f-f4468e9d907a tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:01.770732 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-332be3b2-b298-41e7-b54f-f4468e9d907a tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:01.771182 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-332be3b2-b298-41e7-b54f-f4468e9d907a tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:01.952485 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-332be3b2-b298-41e7-b54f-f4468e9d907a tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e787e0b494764176a0f13d75c47d77fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '371ecb87e8d34859971be23c1a1bc443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:57:01.955401 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-c60234b3-9fc7-4b63-b9a9-b00ea29aec42 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d808e98f843dd9621822682c9d278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b58ab4af674c778b4819f177045651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:57:01.961502 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-332be3b2-b298-41e7-b54f-f4468e9d907a tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] 10.222.0.18 "GET /compute/v2.1/servers/df5f7e8f-5ed6-4ad6-9bcb-eaa54b4ee320" status: 200 len: 1512 microversion: 2.1 time: 0.204353 Oct 22 20:57:01.962075 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 989/1884] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:57:01 2022] GET /compute/v2.1/servers/df5f7e8f-5ed6-4ad6-9bcb-eaa54b4ee320 => generated 1512 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:57:01.963111 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-c60234b3-9fc7-4b63-b9a9-b00ea29aec42 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] 10.222.0.18 "GET /compute/v2.1/servers/cc3236d7-3b9f-40f2-8a53-3096f986e87e" status: 200 len: 1222 microversion: 2.1 time: 0.369222 Oct 22 20:57:01.963983 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 896/1885] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:57:01 2022] GET /compute/v2.1/servers/cc3236d7-3b9f-40f2-8a53-3096f986e87e => generated 1222 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:57:01.977428 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-eeb807bb-75f7-4d7b-aab7-31c5acf53a33 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:57:01.978840 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-eeb807bb-75f7-4d7b-aab7-31c5acf53a33 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] [instance: 3de7ee82-86b9-4c34-8b81-46f09d6239d0] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:57:01.983554 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-853c7f99-5049-4b39-b5f9-2992d35b6925 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:57:01.985509 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-eeb807bb-75f7-4d7b-aab7-31c5acf53a33 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:01.986367 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-eeb807bb-75f7-4d7b-aab7-31c5acf53a33 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:01.986915 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-eeb807bb-75f7-4d7b-aab7-31c5acf53a33 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:01.987686 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-eeb807bb-75f7-4d7b-aab7-31c5acf53a33 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:01.988142 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-eeb807bb-75f7-4d7b-aab7-31c5acf53a33 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:01.988444 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-853c7f99-5049-4b39-b5f9-2992d35b6925 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e787e0b494764176a0f13d75c47d77fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '371ecb87e8d34859971be23c1a1bc443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:57:01.988735 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-eeb807bb-75f7-4d7b-aab7-31c5acf53a33 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:01.989205 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-853c7f99-5049-4b39-b5f9-2992d35b6925 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Searching by: {'deleted': False, 'project_id': '371ecb87e8d34859971be23c1a1bc443'} {{(pid=138744) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 22 20:57:01.994607 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-853c7f99-5049-4b39-b5f9-2992d35b6925 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:01.995091 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-853c7f99-5049-4b39-b5f9-2992d35b6925 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:01.995576 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-853c7f99-5049-4b39-b5f9-2992d35b6925 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:01.996310 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-853c7f99-5049-4b39-b5f9-2992d35b6925 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:01.996764 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-853c7f99-5049-4b39-b5f9-2992d35b6925 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:01.997194 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-853c7f99-5049-4b39-b5f9-2992d35b6925 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:02.032525 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.multi_cell_list [None req-853c7f99-5049-4b39-b5f9-2992d35b6925 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=138744) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 22 20:57:02.074303 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-853c7f99-5049-4b39-b5f9-2992d35b6925 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e787e0b494764176a0f13d75c47d77fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '371ecb87e8d34859971be23c1a1bc443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:57:02.084821 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-853c7f99-5049-4b39-b5f9-2992d35b6925 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:02.085432 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-853c7f99-5049-4b39-b5f9-2992d35b6925 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:02.085876 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-853c7f99-5049-4b39-b5f9-2992d35b6925 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:02.162499 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-eeb807bb-75f7-4d7b-aab7-31c5acf53a33 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b392ad1fe1fd4b2a9e6be03a7435deb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594624ed28aa433d907c8833d360b82e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:57:02.171499 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-eeb807bb-75f7-4d7b-aab7-31c5acf53a33 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] 10.222.0.18 "GET /compute/v2.1/servers/3de7ee82-86b9-4c34-8b81-46f09d6239d0" status: 200 len: 1526 microversion: 2.1 time: 0.207558 Oct 22 20:57:02.172414 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 990/1886] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:57:01 2022] GET /compute/v2.1/servers/3de7ee82-86b9-4c34-8b81-46f09d6239d0 => generated 1526 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:57:02.177663 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-7f98e227-77f8-46cb-8ff1-62714efdfa3b req-da5ba081-39ad-4d37-b28b-834df20dc8f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "674e9bd2-7dfd-4854-83e8-56d8970e56bc", "tag": "f884f034-3e3e-4a4b-bb90-9fe55e33a473"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:57:02.192291 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-7f98e227-77f8-46cb-8ff1-62714efdfa3b req-da5ba081-39ad-4d37-b28b-834df20dc8f2 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:02.192770 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-7f98e227-77f8-46cb-8ff1-62714efdfa3b req-da5ba081-39ad-4d37-b28b-834df20dc8f2 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:02.193210 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-7f98e227-77f8-46cb-8ff1-62714efdfa3b req-da5ba081-39ad-4d37-b28b-834df20dc8f2 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:02.208194 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-7f98e227-77f8-46cb-8ff1-62714efdfa3b req-da5ba081-39ad-4d37-b28b-834df20dc8f2 service nova] Creating event network-changed:f884f034-3e3e-4a4b-bb90-9fe55e33a473 for instance 674e9bd2-7dfd-4854-83e8-56d8970e56bc on nch2-master-1 Oct 22 20:57:02.214179 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-7f98e227-77f8-46cb-8ff1-62714efdfa3b req-da5ba081-39ad-4d37-b28b-834df20dc8f2 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040364 Oct 22 20:57:02.215746 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 991/1887] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:57:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:57:02.222495 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-ca2a68a8-c3b9-4be3-b0f7-8b6dfdd8c1a3 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:57:02.223417 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-ca2a68a8-c3b9-4be3-b0f7-8b6dfdd8c1a3 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] [instance: aee36c9d-baf4-453c-b88f-31b8f23638c2] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:57:02.231309 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ca2a68a8-c3b9-4be3-b0f7-8b6dfdd8c1a3 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:02.231935 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ca2a68a8-c3b9-4be3-b0f7-8b6dfdd8c1a3 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:02.232450 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ca2a68a8-c3b9-4be3-b0f7-8b6dfdd8c1a3 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:02.233246 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ca2a68a8-c3b9-4be3-b0f7-8b6dfdd8c1a3 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:02.233723 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ca2a68a8-c3b9-4be3-b0f7-8b6dfdd8c1a3 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:02.234141 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ca2a68a8-c3b9-4be3-b0f7-8b6dfdd8c1a3 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:02.242925 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-853c7f99-5049-4b39-b5f9-2992d35b6925 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] 10.222.0.18 "GET /compute/v2.1/servers/detail" status: 200 len: 4520 microversion: 2.1 time: 0.262978 Oct 22 20:57:02.243720 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 897/1888] 10.222.0.18 () {58 vars in 1146 bytes} [Sat Oct 22 20:57:01 2022] GET /compute/v2.1/servers/detail => generated 4520 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 20:57:02.269891 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-ca067b48-01b1-4976-92b9-cab78e65c656 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:57:02.274851 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-ca067b48-01b1-4976-92b9-cab78e65c656 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e787e0b494764176a0f13d75c47d77fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '371ecb87e8d34859971be23c1a1bc443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:57:02.275552 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-ca067b48-01b1-4976-92b9-cab78e65c656 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Searching by: {'ip': '172.20.0.', 'deleted': False, 'project_id': '371ecb87e8d34859971be23c1a1bc443'} {{(pid=138744) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 22 20:57:02.379958 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ca067b48-01b1-4976-92b9-cab78e65c656 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:02.380455 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ca067b48-01b1-4976-92b9-cab78e65c656 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:02.381084 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ca067b48-01b1-4976-92b9-cab78e65c656 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:02.382003 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ca067b48-01b1-4976-92b9-cab78e65c656 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:02.382828 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ca067b48-01b1-4976-92b9-cab78e65c656 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:02.383446 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ca067b48-01b1-4976-92b9-cab78e65c656 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:02.429449 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-ca2a68a8-c3b9-4be3-b0f7-8b6dfdd8c1a3 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d3d7458af447bdb3f03e83a2d8559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49238b8686d24ae698679e4a1957735d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:57:02.437667 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-ca2a68a8-c3b9-4be3-b0f7-8b6dfdd8c1a3 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] 10.222.0.18 "GET /compute/v2.1/servers/aee36c9d-baf4-453c-b88f-31b8f23638c2" status: 200 len: 1379 microversion: 2.1 time: 0.220493 Oct 22 20:57:02.438979 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 992/1889] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:57:02 2022] GET /compute/v2.1/servers/aee36c9d-baf4-453c-b88f-31b8f23638c2 => generated 1379 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:57:02.481939 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.multi_cell_list [None req-ca067b48-01b1-4976-92b9-cab78e65c656 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=138744) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 22 20:57:02.545565 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-ca067b48-01b1-4976-92b9-cab78e65c656 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] 10.222.0.18 "GET /compute/v2.1/servers?ip=172.20.0." status: 200 len: 1011 microversion: 2.1 time: 0.280146 Oct 22 20:57:02.546471 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 898/1890] 10.222.0.18 () {58 vars in 1150 bytes} [Sat Oct 22 20:57:02 2022] GET /compute/v2.1/servers?ip=172.20.0. => generated 1011 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 20:57:02.560333 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-5673fdca-883a-4d88-953b-5078a5bcce74 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:57:02.565502 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-5673fdca-883a-4d88-953b-5078a5bcce74 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e787e0b494764176a0f13d75c47d77fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '371ecb87e8d34859971be23c1a1bc443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:57:02.566274 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-5673fdca-883a-4d88-953b-5078a5bcce74 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Searching by: {'name': '^.*\\-instance\\-[0-9]+$', 'deleted': False, 'project_id': '371ecb87e8d34859971be23c1a1bc443'} {{(pid=138745) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 22 20:57:02.568648 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:57:02.573444 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5673fdca-883a-4d88-953b-5078a5bcce74 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:02.573920 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5673fdca-883a-4d88-953b-5078a5bcce74 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:02.574354 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5673fdca-883a-4d88-953b-5078a5bcce74 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:02.575071 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5673fdca-883a-4d88-953b-5078a5bcce74 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:02.575550 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5673fdca-883a-4d88-953b-5078a5bcce74 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:02.575971 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5673fdca-883a-4d88-953b-5078a5bcce74 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:02.618112 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-d1b2794a-9e88-47a0-be90-95a246d9d551 tempest-ServerMetadataNegativeTestJSON-1253820515 tempest-ServerMetadataNegativeTestJSON-1253820515-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:57:02.618877 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-d1b2794a-9e88-47a0-be90-95a246d9d551 tempest-ServerMetadataNegativeTestJSON-1253820515 tempest-ServerMetadataNegativeTestJSON-1253820515-project] [instance: 674e9bd2-7dfd-4854-83e8-56d8970e56bc] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:57:02.648552 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d1b2794a-9e88-47a0-be90-95a246d9d551 tempest-ServerMetadataNegativeTestJSON-1253820515 tempest-ServerMetadataNegativeTestJSON-1253820515-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:02.649353 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d1b2794a-9e88-47a0-be90-95a246d9d551 tempest-ServerMetadataNegativeTestJSON-1253820515 tempest-ServerMetadataNegativeTestJSON-1253820515-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:02.650260 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d1b2794a-9e88-47a0-be90-95a246d9d551 tempest-ServerMetadataNegativeTestJSON-1253820515 tempest-ServerMetadataNegativeTestJSON-1253820515-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:02.651263 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d1b2794a-9e88-47a0-be90-95a246d9d551 tempest-ServerMetadataNegativeTestJSON-1253820515 tempest-ServerMetadataNegativeTestJSON-1253820515-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:02.651762 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d1b2794a-9e88-47a0-be90-95a246d9d551 tempest-ServerMetadataNegativeTestJSON-1253820515 tempest-ServerMetadataNegativeTestJSON-1253820515-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:02.652317 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d1b2794a-9e88-47a0-be90-95a246d9d551 tempest-ServerMetadataNegativeTestJSON-1253820515 tempest-ServerMetadataNegativeTestJSON-1253820515-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:02.690289 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.multi_cell_list [None req-5673fdca-883a-4d88-953b-5078a5bcce74 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=138745) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 22 20:57:02.754826 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-5673fdca-883a-4d88-953b-5078a5bcce74 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] 10.222.0.18 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24" status: 200 len: 1011 microversion: 2.1 time: 0.198331 Oct 22 20:57:02.755742 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 993/1891] 10.222.0.18 () {58 vars in 1212 bytes} [Sat Oct 22 20:57:02 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24 => generated 1011 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:57:02.768390 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-b15d09b6-1c84-4382-a083-a19756ff2b57 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:57:02.773784 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-b15d09b6-1c84-4382-a083-a19756ff2b57 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e787e0b494764176a0f13d75c47d77fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '371ecb87e8d34859971be23c1a1bc443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:57:02.774499 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-b15d09b6-1c84-4382-a083-a19756ff2b57 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Searching by: {'name': '^.*\\-instance\\-.*$', 'deleted': False, 'project_id': '371ecb87e8d34859971be23c1a1bc443'} {{(pid=138745) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 22 20:57:02.779864 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b15d09b6-1c84-4382-a083-a19756ff2b57 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:02.780440 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b15d09b6-1c84-4382-a083-a19756ff2b57 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:02.781359 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b15d09b6-1c84-4382-a083-a19756ff2b57 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:02.781752 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b15d09b6-1c84-4382-a083-a19756ff2b57 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:02.782375 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b15d09b6-1c84-4382-a083-a19756ff2b57 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:02.783569 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b15d09b6-1c84-4382-a083-a19756ff2b57 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:02.871732 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.multi_cell_list [None req-b15d09b6-1c84-4382-a083-a19756ff2b57 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=138745) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 22 20:57:02.907750 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-d1b2794a-9e88-47a0-be90-95a246d9d551 tempest-ServerMetadataNegativeTestJSON-1253820515 tempest-ServerMetadataNegativeTestJSON-1253820515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153f7059fd924dc5b19f323e0a400381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be467d2547d46089b833ae4b5f9dd05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:57:02.916174 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-d1b2794a-9e88-47a0-be90-95a246d9d551 tempest-ServerMetadataNegativeTestJSON-1253820515 tempest-ServerMetadataNegativeTestJSON-1253820515-project] 10.222.0.18 "GET /compute/v2.1/servers/674e9bd2-7dfd-4854-83e8-56d8970e56bc" status: 200 len: 1324 microversion: 2.1 time: 0.302665 Oct 22 20:57:02.916971 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 899/1892] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:57:02 2022] GET /compute/v2.1/servers/674e9bd2-7dfd-4854-83e8-56d8970e56bc => generated 1324 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 20:57:02.921818 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-58c0a90c-7d1d-4353-8d82-b59e2a2735d0 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:57:02.922582 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-58c0a90c-7d1d-4353-8d82-b59e2a2735d0 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] [instance: 18183d64-42b7-4b9f-9bca-6d018f17eeb3] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:57:02.929632 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-58c0a90c-7d1d-4353-8d82-b59e2a2735d0 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:02.930397 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-58c0a90c-7d1d-4353-8d82-b59e2a2735d0 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:02.930976 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-58c0a90c-7d1d-4353-8d82-b59e2a2735d0 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:02.931899 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-58c0a90c-7d1d-4353-8d82-b59e2a2735d0 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:02.933122 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-58c0a90c-7d1d-4353-8d82-b59e2a2735d0 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:02.933697 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-58c0a90c-7d1d-4353-8d82-b59e2a2735d0 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:02.952106 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-b15d09b6-1c84-4382-a083-a19756ff2b57 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] 10.222.0.18 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24" status: 200 len: 1011 microversion: 2.1 time: 0.187175 Oct 22 20:57:02.952426 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 994/1893] 10.222.0.18 () {58 vars in 1196 bytes} [Sat Oct 22 20:57:02 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24 => generated 1011 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:57:02.966085 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-2fa6eeae-5c28-42ac-819a-15f01ce33c60 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:57:02.971955 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-2fa6eeae-5c28-42ac-819a-15f01ce33c60 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e787e0b494764176a0f13d75c47d77fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '371ecb87e8d34859971be23c1a1bc443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:57:02.972745 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-2fa6eeae-5c28-42ac-819a-15f01ce33c60 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Searching by: {'name': '1800526150', 'deleted': False, 'project_id': '371ecb87e8d34859971be23c1a1bc443'} {{(pid=138745) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 22 20:57:02.980849 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2fa6eeae-5c28-42ac-819a-15f01ce33c60 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:02.980849 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2fa6eeae-5c28-42ac-819a-15f01ce33c60 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:02.981421 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2fa6eeae-5c28-42ac-819a-15f01ce33c60 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:02.982269 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2fa6eeae-5c28-42ac-819a-15f01ce33c60 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:02.982818 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2fa6eeae-5c28-42ac-819a-15f01ce33c60 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:02.983754 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2fa6eeae-5c28-42ac-819a-15f01ce33c60 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:03.042624 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-58c0a90c-7d1d-4353-8d82-b59e2a2735d0 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5660f7f9d86f473eaa83e2be362ca63c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e883d7e73084efeb725945ae0bab317', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:57:03.069948 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-58c0a90c-7d1d-4353-8d82-b59e2a2735d0 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] 10.222.0.18 "GET /compute/v2.1/servers/18183d64-42b7-4b9f-9bca-6d018f17eeb3" status: 200 len: 1233 microversion: 2.1 time: 0.151122 Oct 22 20:57:03.074508 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.multi_cell_list [None req-2fa6eeae-5c28-42ac-819a-15f01ce33c60 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=138745) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 22 20:57:03.084537 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 900/1894] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:57:02 2022] GET /compute/v2.1/servers/18183d64-42b7-4b9f-9bca-6d018f17eeb3 => generated 1233 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:57:03.093861 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-ce8925f9-7f0d-4424-a971-064651bd4fe6 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:57:03.095739 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-ce8925f9-7f0d-4424-a971-064651bd4fe6 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] [instance: cc3236d7-3b9f-40f2-8a53-3096f986e87e] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:57:03.103141 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ce8925f9-7f0d-4424-a971-064651bd4fe6 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:03.103892 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ce8925f9-7f0d-4424-a971-064651bd4fe6 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:03.104474 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ce8925f9-7f0d-4424-a971-064651bd4fe6 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:03.105749 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ce8925f9-7f0d-4424-a971-064651bd4fe6 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:03.106346 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ce8925f9-7f0d-4424-a971-064651bd4fe6 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:03.106915 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ce8925f9-7f0d-4424-a971-064651bd4fe6 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:03.171669 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-2fa6eeae-5c28-42ac-819a-15f01ce33c60 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] 10.222.0.18 "GET /compute/v2.1/servers?name=1800526150" status: 200 len: 346 microversion: 2.1 time: 0.209756 Oct 22 20:57:03.172368 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 995/1895] 10.222.0.18 () {58 vars in 1156 bytes} [Sat Oct 22 20:57:02 2022] GET /compute/v2.1/servers?name=1800526150 => generated 346 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:57:03.249601 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-ce8925f9-7f0d-4424-a971-064651bd4fe6 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d808e98f843dd9621822682c9d278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b58ab4af674c778b4819f177045651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:57:03.261232 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-ce8925f9-7f0d-4424-a971-064651bd4fe6 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] 10.222.0.18 "GET /compute/v2.1/servers/cc3236d7-3b9f-40f2-8a53-3096f986e87e" status: 200 len: 1222 microversion: 2.1 time: 0.175170 Oct 22 20:57:03.262264 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 901/1896] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:57:03 2022] GET /compute/v2.1/servers/cc3236d7-3b9f-40f2-8a53-3096f986e87e => generated 1222 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:57:03.267202 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-772dd324-53d5-4e9b-96c1-278a46dcc83d tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:57:03.272756 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-772dd324-53d5-4e9b-96c1-278a46dcc83d tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e787e0b494764176a0f13d75c47d77fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '371ecb87e8d34859971be23c1a1bc443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:57:03.274097 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-772dd324-53d5-4e9b-96c1-278a46dcc83d tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Searching by: {'name': '-instance', 'deleted': False, 'project_id': '371ecb87e8d34859971be23c1a1bc443'} {{(pid=138744) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 22 20:57:03.280717 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-772dd324-53d5-4e9b-96c1-278a46dcc83d tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:03.281413 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-772dd324-53d5-4e9b-96c1-278a46dcc83d tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:03.282039 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-772dd324-53d5-4e9b-96c1-278a46dcc83d tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:03.283108 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-772dd324-53d5-4e9b-96c1-278a46dcc83d tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:03.283884 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-772dd324-53d5-4e9b-96c1-278a46dcc83d tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:03.284573 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-772dd324-53d5-4e9b-96c1-278a46dcc83d tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:03.314170 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-6ce02001-1e60-4415-9ca4-76ea71e27ea4 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-747816438", "imageRef": "085e4478-6edc-4a69-8e08-f9831713eb65", "flavorRef": "452"}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:57:03.378650 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.network.neutron [None req-6ce02001-1e60-4415-9ca4-76ea71e27ea4 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] validate_networks() for None {{(pid=138745) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 20:57:03.411143 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.multi_cell_list [None req-772dd324-53d5-4e9b-96c1-278a46dcc83d tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=138744) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 22 20:57:03.483682 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-772dd324-53d5-4e9b-96c1-278a46dcc83d tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] 10.222.0.18 "GET /compute/v2.1/servers?name=-instance" status: 200 len: 1011 microversion: 2.1 time: 0.220147 Oct 22 20:57:03.484277 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 902/1897] 10.222.0.18 () {58 vars in 1154 bytes} [Sat Oct 22 20:57:03 2022] GET /compute/v2.1/servers?name=-instance => generated 1011 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:57:03.495920 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-4d197b0a-c04f-4493-b2f8-d32d2e4e20ac tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:57:03.496541 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-4d197b0a-c04f-4493-b2f8-d32d2e4e20ac tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] [instance: 3de7ee82-86b9-4c34-8b81-46f09d6239d0] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:57:03.502887 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4d197b0a-c04f-4493-b2f8-d32d2e4e20ac tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:03.503402 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4d197b0a-c04f-4493-b2f8-d32d2e4e20ac tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:03.503847 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4d197b0a-c04f-4493-b2f8-d32d2e4e20ac tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:03.504693 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4d197b0a-c04f-4493-b2f8-d32d2e4e20ac tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:03.505487 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4d197b0a-c04f-4493-b2f8-d32d2e4e20ac tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:03.506073 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4d197b0a-c04f-4493-b2f8-d32d2e4e20ac tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:04.325129 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-4d197b0a-c04f-4493-b2f8-d32d2e4e20ac tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b392ad1fe1fd4b2a9e6be03a7435deb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594624ed28aa433d907c8833d360b82e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:57:04.336422 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-4d197b0a-c04f-4493-b2f8-d32d2e4e20ac tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] 10.222.0.18 "GET /compute/v2.1/servers/3de7ee82-86b9-4c34-8b81-46f09d6239d0" status: 200 len: 1526 microversion: 2.1 time: 0.850816 Oct 22 20:57:04.337216 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 903/1898] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:57:03 2022] GET /compute/v2.1/servers/3de7ee82-86b9-4c34-8b81-46f09d6239d0 => generated 1526 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:57:04.342491 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-203a95ab-a34a-40e2-bada-ac557f72b3a7 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:57:04.343146 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-203a95ab-a34a-40e2-bada-ac557f72b3a7 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] [instance: aee36c9d-baf4-453c-b88f-31b8f23638c2] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:57:04.349472 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-203a95ab-a34a-40e2-bada-ac557f72b3a7 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:04.350368 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-203a95ab-a34a-40e2-bada-ac557f72b3a7 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:04.352046 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-203a95ab-a34a-40e2-bada-ac557f72b3a7 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:04.352929 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-203a95ab-a34a-40e2-bada-ac557f72b3a7 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:04.353591 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-203a95ab-a34a-40e2-bada-ac557f72b3a7 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:04.354228 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-203a95ab-a34a-40e2-bada-ac557f72b3a7 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:04.388916 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-6ce02001-1e60-4415-9ca4-76ea71e27ea4 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Flavor limits 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 20:57:04.389857 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-6ce02001-1e60-4415-9ca4-76ea71e27ea4 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Image limits 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 20:57:04.390618 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-6ce02001-1e60-4415-9ca4-76ea71e27ea4 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Flavor pref 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 20:57:04.391165 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-6ce02001-1e60-4415-9ca4-76ea71e27ea4 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Image pref 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 20:57:04.392083 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-6ce02001-1e60-4415-9ca4-76ea71e27ea4 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 20:57:04.402331 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6ce02001-1e60-4415-9ca4-76ea71e27ea4 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:04.402809 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6ce02001-1e60-4415-9ca4-76ea71e27ea4 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:04.403480 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6ce02001-1e60-4415-9ca4-76ea71e27ea4 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:04.404279 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6ce02001-1e60-4415-9ca4-76ea71e27ea4 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:04.404904 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6ce02001-1e60-4415-9ca4-76ea71e27ea4 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:04.405333 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6ce02001-1e60-4415-9ca4-76ea71e27ea4 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:04.423488 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-6ce02001-1e60-4415-9ca4-76ea71e27ea4 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Getting quotas for project 8351b01e07cd43f9be973ab45e522bf0. Resources: {'cores', 'instances', 'ram'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 20:57:04.429379 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-6ce02001-1e60-4415-9ca4-76ea71e27ea4 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Getting quotas for user 57dbe89a7e11480194d3d86f82983499 and project 8351b01e07cd43f9be973ab45e522bf0. Resources: {'cores', 'instances', 'ram'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 20:57:04.442767 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-6ce02001-1e60-4415-9ca4-76ea71e27ea4 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Going to run 1 instances... {{(pid=138745) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 20:57:04.445955 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-6ce02001-1e60-4415-9ca4-76ea71e27ea4 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] [instance: f070b144-3a1a-4456-8e5b-02af12557c6a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='085e4478-6edc-4a69-8e08-f9831713eb65',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138745) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 20:57:04.498195 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-6ce02001-1e60-4415-9ca4-76ea71e27ea4 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.322492 Oct 22 20:57:04.534443 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 996/1899] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Oct 22 20:57:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 1359 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 20:57:04.552419 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-62e51e4a-a465-4a80-911a-f0eb60eeed33 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:57:04.572222 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-62e51e4a-a465-4a80-911a-f0eb60eeed33 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e787e0b494764176a0f13d75c47d77fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '371ecb87e8d34859971be23c1a1bc443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:57:04.573311 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-62e51e4a-a465-4a80-911a-f0eb60eeed33 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Searching by: {'name': 't-ListServerFiltersTestJSON-instance-180052615', 'deleted': False, 'project_id': '371ecb87e8d34859971be23c1a1bc443'} {{(pid=138745) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 22 20:57:04.583139 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-62e51e4a-a465-4a80-911a-f0eb60eeed33 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:04.584492 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-62e51e4a-a465-4a80-911a-f0eb60eeed33 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:04.584627 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-62e51e4a-a465-4a80-911a-f0eb60eeed33 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:04.585361 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-62e51e4a-a465-4a80-911a-f0eb60eeed33 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:04.585814 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-62e51e4a-a465-4a80-911a-f0eb60eeed33 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:04.586240 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-62e51e4a-a465-4a80-911a-f0eb60eeed33 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:04.592076 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-203a95ab-a34a-40e2-bada-ac557f72b3a7 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d3d7458af447bdb3f03e83a2d8559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49238b8686d24ae698679e4a1957735d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:57:04.607014 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-203a95ab-a34a-40e2-bada-ac557f72b3a7 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] 10.222.0.18 "GET /compute/v2.1/servers/aee36c9d-baf4-453c-b88f-31b8f23638c2" status: 200 len: 1379 microversion: 2.1 time: 0.268188 Oct 22 20:57:04.613165 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 904/1900] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:57:04 2022] GET /compute/v2.1/servers/aee36c9d-baf4-453c-b88f-31b8f23638c2 => generated 1379 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:57:04.626481 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-ea78c685-8ec6-41b1-912d-5ddf3eb141d6 tempest-ServerMetadataNegativeTestJSON-1253820515 tempest-ServerMetadataNegativeTestJSON-1253820515-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:57:04.634548 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-ea78c685-8ec6-41b1-912d-5ddf3eb141d6 tempest-ServerMetadataNegativeTestJSON-1253820515 tempest-ServerMetadataNegativeTestJSON-1253820515-project] [instance: 674e9bd2-7dfd-4854-83e8-56d8970e56bc] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:57:04.653736 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ea78c685-8ec6-41b1-912d-5ddf3eb141d6 tempest-ServerMetadataNegativeTestJSON-1253820515 tempest-ServerMetadataNegativeTestJSON-1253820515-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:04.654243 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ea78c685-8ec6-41b1-912d-5ddf3eb141d6 tempest-ServerMetadataNegativeTestJSON-1253820515 tempest-ServerMetadataNegativeTestJSON-1253820515-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:04.654689 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ea78c685-8ec6-41b1-912d-5ddf3eb141d6 tempest-ServerMetadataNegativeTestJSON-1253820515 tempest-ServerMetadataNegativeTestJSON-1253820515-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:04.666651 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ea78c685-8ec6-41b1-912d-5ddf3eb141d6 tempest-ServerMetadataNegativeTestJSON-1253820515 tempest-ServerMetadataNegativeTestJSON-1253820515-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:04.667257 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ea78c685-8ec6-41b1-912d-5ddf3eb141d6 tempest-ServerMetadataNegativeTestJSON-1253820515 tempest-ServerMetadataNegativeTestJSON-1253820515-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:04.668017 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ea78c685-8ec6-41b1-912d-5ddf3eb141d6 tempest-ServerMetadataNegativeTestJSON-1253820515 tempest-ServerMetadataNegativeTestJSON-1253820515-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:04.744729 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.multi_cell_list [None req-62e51e4a-a465-4a80-911a-f0eb60eeed33 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=138745) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 22 20:57:04.869758 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-62e51e4a-a465-4a80-911a-f0eb60eeed33 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] 10.222.0.18 "GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-180052615" status: 200 len: 346 microversion: 2.1 time: 0.333655 Oct 22 20:57:04.870701 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 997/1901] 10.222.0.18 () {58 vars in 1228 bytes} [Sat Oct 22 20:57:04 2022] GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-180052615 => generated 346 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:57:04.887594 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-a89adb97-3609-42e4-853a-8046e220d826 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:57:04.888276 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-a89adb97-3609-42e4-853a-8046e220d826 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] [instance: 18183d64-42b7-4b9f-9bca-6d018f17eeb3] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:57:04.905206 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a89adb97-3609-42e4-853a-8046e220d826 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:04.905720 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a89adb97-3609-42e4-853a-8046e220d826 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:04.906171 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a89adb97-3609-42e4-853a-8046e220d826 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:04.906947 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a89adb97-3609-42e4-853a-8046e220d826 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:04.911939 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a89adb97-3609-42e4-853a-8046e220d826 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:04.912472 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a89adb97-3609-42e4-853a-8046e220d826 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:05.261123 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-ea78c685-8ec6-41b1-912d-5ddf3eb141d6 tempest-ServerMetadataNegativeTestJSON-1253820515 tempest-ServerMetadataNegativeTestJSON-1253820515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153f7059fd924dc5b19f323e0a400381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be467d2547d46089b833ae4b5f9dd05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:57:05.278036 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-ea78c685-8ec6-41b1-912d-5ddf3eb141d6 tempest-ServerMetadataNegativeTestJSON-1253820515 tempest-ServerMetadataNegativeTestJSON-1253820515-project] 10.222.0.18 "GET /compute/v2.1/servers/674e9bd2-7dfd-4854-83e8-56d8970e56bc" status: 200 len: 1324 microversion: 2.1 time: 0.663643 Oct 22 20:57:05.291603 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 905/1902] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:57:04 2022] GET /compute/v2.1/servers/674e9bd2-7dfd-4854-83e8-56d8970e56bc => generated 1324 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:57:05.293210 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-63dd4712-cc98-4b80-aa85-f4e349a20fcb tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:57:05.300641 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-63dd4712-cc98-4b80-aa85-f4e349a20fcb tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] [instance: cc3236d7-3b9f-40f2-8a53-3096f986e87e] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:57:05.310218 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-63dd4712-cc98-4b80-aa85-f4e349a20fcb tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:05.311147 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-63dd4712-cc98-4b80-aa85-f4e349a20fcb tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:05.311863 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-63dd4712-cc98-4b80-aa85-f4e349a20fcb tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:05.312933 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-63dd4712-cc98-4b80-aa85-f4e349a20fcb tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:05.315175 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-63dd4712-cc98-4b80-aa85-f4e349a20fcb tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:05.316103 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-63dd4712-cc98-4b80-aa85-f4e349a20fcb tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:05.430323 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-a89adb97-3609-42e4-853a-8046e220d826 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5660f7f9d86f473eaa83e2be362ca63c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e883d7e73084efeb725945ae0bab317', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:57:05.455713 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-a89adb97-3609-42e4-853a-8046e220d826 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] 10.222.0.18 "GET /compute/v2.1/servers/18183d64-42b7-4b9f-9bca-6d018f17eeb3" status: 200 len: 1329 microversion: 2.1 time: 0.582973 Oct 22 20:57:05.458651 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 998/1903] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:57:04 2022] GET /compute/v2.1/servers/18183d64-42b7-4b9f-9bca-6d018f17eeb3 => generated 1329 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:57:05.475768 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-b2adc9d3-3052-4109-b39f-c2a37bffce3c tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-408488855", "imageRef": "085e4478-6edc-4a69-8e08-f9831713eb65", "flavorRef": "452"}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:57:05.485049 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-63dd4712-cc98-4b80-aa85-f4e349a20fcb tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d808e98f843dd9621822682c9d278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b58ab4af674c778b4819f177045651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:57:05.502199 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:SELECT=100 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:57:05.519181 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-63dd4712-cc98-4b80-aa85-f4e349a20fcb tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] 10.222.0.18 "GET /compute/v2.1/servers/cc3236d7-3b9f-40f2-8a53-3096f986e87e" status: 200 len: 1276 microversion: 2.1 time: 0.232662 Oct 22 20:57:05.524145 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 906/1904] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:57:05 2022] GET /compute/v2.1/servers/cc3236d7-3b9f-40f2-8a53-3096f986e87e => generated 1276 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:57:05.536290 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-f3f80820-5b42-4cf6-b0b6-90a0d79439f0 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:57:05.536961 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-f3f80820-5b42-4cf6-b0b6-90a0d79439f0 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] [instance: df5f7e8f-5ed6-4ad6-9bcb-eaa54b4ee320] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:57:05.557769 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f3f80820-5b42-4cf6-b0b6-90a0d79439f0 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:05.558392 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f3f80820-5b42-4cf6-b0b6-90a0d79439f0 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:05.559573 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f3f80820-5b42-4cf6-b0b6-90a0d79439f0 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:05.561100 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f3f80820-5b42-4cf6-b0b6-90a0d79439f0 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:05.563784 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f3f80820-5b42-4cf6-b0b6-90a0d79439f0 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:05.564311 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f3f80820-5b42-4cf6-b0b6-90a0d79439f0 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:05.593149 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.network.neutron [None req-b2adc9d3-3052-4109-b39f-c2a37bffce3c tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] validate_networks() for None {{(pid=138745) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 20:57:05.638880 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-f3f80820-5b42-4cf6-b0b6-90a0d79439f0 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] [instance: df5f7e8f-5ed6-4ad6-9bcb-eaa54b4ee320] Going to try to terminate instance {{(pid=138744) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 20:57:05.785608 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-f3f80820-5b42-4cf6-b0b6-90a0d79439f0 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] 10.222.0.18 "DELETE /compute/v2.1/servers/df5f7e8f-5ed6-4ad6-9bcb-eaa54b4ee320" status: 204 len: 0 microversion: 2.1 time: 0.258830 Oct 22 20:57:05.786208 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 907/1905] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 20:57:05 2022] DELETE /compute/v2.1/servers/df5f7e8f-5ed6-4ad6-9bcb-eaa54b4ee320 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 20:57:05.800482 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-75d5b11b-ec85-49fa-a5ad-3e958a8f37c6 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:57:05.801208 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-75d5b11b-ec85-49fa-a5ad-3e958a8f37c6 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] [instance: 3de7ee82-86b9-4c34-8b81-46f09d6239d0] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:57:05.818670 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-75d5b11b-ec85-49fa-a5ad-3e958a8f37c6 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:05.819195 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-75d5b11b-ec85-49fa-a5ad-3e958a8f37c6 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:05.819656 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-75d5b11b-ec85-49fa-a5ad-3e958a8f37c6 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:05.820379 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-75d5b11b-ec85-49fa-a5ad-3e958a8f37c6 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:05.820968 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-75d5b11b-ec85-49fa-a5ad-3e958a8f37c6 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:05.821652 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-75d5b11b-ec85-49fa-a5ad-3e958a8f37c6 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:05.858405 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-75d5b11b-ec85-49fa-a5ad-3e958a8f37c6 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:05.859321 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-75d5b11b-ec85-49fa-a5ad-3e958a8f37c6 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:05.860330 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-75d5b11b-ec85-49fa-a5ad-3e958a8f37c6 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:05.861049 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.objects.instance [None req-75d5b11b-ec85-49fa-a5ad-3e958a8f37c6 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lazy-loading 'fault' on Instance uuid 3de7ee82-86b9-4c34-8b81-46f09d6239d0 {{(pid=138744) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 20:57:05.947912 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-75d5b11b-ec85-49fa-a5ad-3e958a8f37c6 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b392ad1fe1fd4b2a9e6be03a7435deb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594624ed28aa433d907c8833d360b82e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:57:05.958219 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-75d5b11b-ec85-49fa-a5ad-3e958a8f37c6 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] 10.222.0.18 "GET /compute/v2.1/servers/3de7ee82-86b9-4c34-8b81-46f09d6239d0" status: 200 len: 1314 microversion: 2.1 time: 0.170468 Oct 22 20:57:05.959234 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 908/1906] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:57:05 2022] GET /compute/v2.1/servers/3de7ee82-86b9-4c34-8b81-46f09d6239d0 => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:57:05.969243 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-d640fba5-77c3-470c-8076-0543506743eb req-765d0102-910d-4510-b114-d91a7a7946a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3de7ee82-86b9-4c34-8b81-46f09d6239d0", "name": "network-vif-deleted", "tag": "1f69f669-8018-4f6c-a6cf-2f988963a116"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:57:05.996066 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-d640fba5-77c3-470c-8076-0543506743eb req-765d0102-910d-4510-b114-d91a7a7946a6 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:05.996678 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-d640fba5-77c3-470c-8076-0543506743eb req-765d0102-910d-4510-b114-d91a7a7946a6 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:05.997208 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-d640fba5-77c3-470c-8076-0543506743eb req-765d0102-910d-4510-b114-d91a7a7946a6 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:06.016981 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-d640fba5-77c3-470c-8076-0543506743eb req-765d0102-910d-4510-b114-d91a7a7946a6 service nova] Creating event network-vif-deleted:1f69f669-8018-4f6c-a6cf-2f988963a116 for instance 3de7ee82-86b9-4c34-8b81-46f09d6239d0 on nch1-master-1 Oct 22 20:57:06.024507 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-d640fba5-77c3-470c-8076-0543506743eb req-765d0102-910d-4510-b114-d91a7a7946a6 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063683 Oct 22 20:57:06.025653 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 909/1907] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:57:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:57:06.032359 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-ffbcc405-4dc4-4fe9-9195-1808f5444441 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:57:06.033853 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-ffbcc405-4dc4-4fe9-9195-1808f5444441 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] [instance: aee36c9d-baf4-453c-b88f-31b8f23638c2] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:57:06.046647 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-b2adc9d3-3052-4109-b39f-c2a37bffce3c tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Flavor limits 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 20:57:06.047148 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-b2adc9d3-3052-4109-b39f-c2a37bffce3c tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Image limits 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 20:57:06.047839 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ffbcc405-4dc4-4fe9-9195-1808f5444441 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:06.047947 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-b2adc9d3-3052-4109-b39f-c2a37bffce3c tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Flavor pref 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 20:57:06.048356 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-b2adc9d3-3052-4109-b39f-c2a37bffce3c tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Image pref 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 20:57:06.048837 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ffbcc405-4dc4-4fe9-9195-1808f5444441 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:06.048955 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-b2adc9d3-3052-4109-b39f-c2a37bffce3c tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 20:57:06.049596 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ffbcc405-4dc4-4fe9-9195-1808f5444441 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:06.050486 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ffbcc405-4dc4-4fe9-9195-1808f5444441 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:06.051239 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ffbcc405-4dc4-4fe9-9195-1808f5444441 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:06.052040 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ffbcc405-4dc4-4fe9-9195-1808f5444441 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:06.060309 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b2adc9d3-3052-4109-b39f-c2a37bffce3c tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:06.061227 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b2adc9d3-3052-4109-b39f-c2a37bffce3c tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:06.061760 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b2adc9d3-3052-4109-b39f-c2a37bffce3c tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:06.062589 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b2adc9d3-3052-4109-b39f-c2a37bffce3c tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:06.063162 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b2adc9d3-3052-4109-b39f-c2a37bffce3c tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:06.064220 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b2adc9d3-3052-4109-b39f-c2a37bffce3c tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:06.092190 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-b2adc9d3-3052-4109-b39f-c2a37bffce3c tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Getting quotas for project 8351b01e07cd43f9be973ab45e522bf0. Resources: {'cores', 'instances', 'ram'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 20:57:06.101395 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-b2adc9d3-3052-4109-b39f-c2a37bffce3c tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Getting quotas for user 57dbe89a7e11480194d3d86f82983499 and project 8351b01e07cd43f9be973ab45e522bf0. Resources: {'cores', 'instances', 'ram'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 20:57:06.119410 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-b2adc9d3-3052-4109-b39f-c2a37bffce3c tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Going to run 1 instances... {{(pid=138745) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 20:57:06.122596 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-b2adc9d3-3052-4109-b39f-c2a37bffce3c tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] [instance: 7c5c7ad1-4e7b-427e-8f66-862cc9b2f457] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='085e4478-6edc-4a69-8e08-f9831713eb65',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138745) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 20:57:06.186012 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-b2adc9d3-3052-4109-b39f-c2a37bffce3c tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.724863 Oct 22 20:57:06.187264 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 999/1908] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Oct 22 20:57:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 727 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 20:57:06.194534 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-8380062f-62b7-460d-ac6b-aae012a3eb5f tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:57:06.195234 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-8380062f-62b7-460d-ac6b-aae012a3eb5f tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] [instance: df5f7e8f-5ed6-4ad6-9bcb-eaa54b4ee320] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:57:06.204152 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8380062f-62b7-460d-ac6b-aae012a3eb5f tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:06.205113 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8380062f-62b7-460d-ac6b-aae012a3eb5f tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:06.205753 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8380062f-62b7-460d-ac6b-aae012a3eb5f tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:06.206615 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8380062f-62b7-460d-ac6b-aae012a3eb5f tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:06.207169 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8380062f-62b7-460d-ac6b-aae012a3eb5f tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:06.207692 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8380062f-62b7-460d-ac6b-aae012a3eb5f tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:06.257202 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell1:SELECT=100 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:57:06.262890 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-ffbcc405-4dc4-4fe9-9195-1808f5444441 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d3d7458af447bdb3f03e83a2d8559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49238b8686d24ae698679e4a1957735d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:57:06.289243 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-ffbcc405-4dc4-4fe9-9195-1808f5444441 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] 10.222.0.18 "GET /compute/v2.1/servers/aee36c9d-baf4-453c-b88f-31b8f23638c2" status: 200 len: 1379 microversion: 2.1 time: 0.262069 Oct 22 20:57:06.295632 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 910/1909] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:57:06 2022] GET /compute/v2.1/servers/aee36c9d-baf4-453c-b88f-31b8f23638c2 => generated 1379 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:57:06.300259 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-7f155ebd-5703-4442-90f3-39dea682c65e tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:57:06.301441 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-7f155ebd-5703-4442-90f3-39dea682c65e tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] [instance: 7c5c7ad1-4e7b-427e-8f66-862cc9b2f457] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:57:06.383132 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-7f155ebd-5703-4442-90f3-39dea682c65e tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dbe89a7e11480194d3d86f82983499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8351b01e07cd43f9be973ab45e522bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:57:06.392487 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-7f155ebd-5703-4442-90f3-39dea682c65e tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] 10.222.0.18 "GET /compute/v2.1/servers/7c5c7ad1-4e7b-427e-8f66-862cc9b2f457" status: 200 len: 1213 microversion: 2.1 time: 0.100769 Oct 22 20:57:06.395041 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 911/1910] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:57:06 2022] GET /compute/v2.1/servers/7c5c7ad1-4e7b-427e-8f66-862cc9b2f457 => generated 1213 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:57:06.408805 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-7fc38d01-7037-40a6-bfb8-260b8c64a5b4 tempest-ServerMetadataNegativeTestJSON-1253820515 tempest-ServerMetadataNegativeTestJSON-1253820515-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:57:06.409667 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-7fc38d01-7037-40a6-bfb8-260b8c64a5b4 tempest-ServerMetadataNegativeTestJSON-1253820515 tempest-ServerMetadataNegativeTestJSON-1253820515-project] [instance: 674e9bd2-7dfd-4854-83e8-56d8970e56bc] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:57:06.418303 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7fc38d01-7037-40a6-bfb8-260b8c64a5b4 tempest-ServerMetadataNegativeTestJSON-1253820515 tempest-ServerMetadataNegativeTestJSON-1253820515-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:06.419028 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7fc38d01-7037-40a6-bfb8-260b8c64a5b4 tempest-ServerMetadataNegativeTestJSON-1253820515 tempest-ServerMetadataNegativeTestJSON-1253820515-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:06.419680 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7fc38d01-7037-40a6-bfb8-260b8c64a5b4 tempest-ServerMetadataNegativeTestJSON-1253820515 tempest-ServerMetadataNegativeTestJSON-1253820515-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:06.430136 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7fc38d01-7037-40a6-bfb8-260b8c64a5b4 tempest-ServerMetadataNegativeTestJSON-1253820515 tempest-ServerMetadataNegativeTestJSON-1253820515-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:06.431090 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7fc38d01-7037-40a6-bfb8-260b8c64a5b4 tempest-ServerMetadataNegativeTestJSON-1253820515 tempest-ServerMetadataNegativeTestJSON-1253820515-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:06.431831 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7fc38d01-7037-40a6-bfb8-260b8c64a5b4 tempest-ServerMetadataNegativeTestJSON-1253820515 tempest-ServerMetadataNegativeTestJSON-1253820515-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:06.535777 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-8380062f-62b7-460d-ac6b-aae012a3eb5f tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e787e0b494764176a0f13d75c47d77fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '371ecb87e8d34859971be23c1a1bc443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:57:06.545664 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-8380062f-62b7-460d-ac6b-aae012a3eb5f tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] 10.222.0.18 "GET /compute/v2.1/servers/df5f7e8f-5ed6-4ad6-9bcb-eaa54b4ee320" status: 200 len: 1518 microversion: 2.1 time: 0.357160 Oct 22 20:57:06.546262 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1000/1911] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:57:06 2022] GET /compute/v2.1/servers/df5f7e8f-5ed6-4ad6-9bcb-eaa54b4ee320 => generated 1518 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:57:06.563705 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-61ca8ce3-6c4e-4a25-a305-f4db893b9d58 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:57:06.564361 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-61ca8ce3-6c4e-4a25-a305-f4db893b9d58 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] [instance: 18183d64-42b7-4b9f-9bca-6d018f17eeb3] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:57:06.584928 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-61ca8ce3-6c4e-4a25-a305-f4db893b9d58 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:06.585996 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-61ca8ce3-6c4e-4a25-a305-f4db893b9d58 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:06.586464 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-61ca8ce3-6c4e-4a25-a305-f4db893b9d58 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:06.587221 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-61ca8ce3-6c4e-4a25-a305-f4db893b9d58 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:06.587708 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-61ca8ce3-6c4e-4a25-a305-f4db893b9d58 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:06.588138 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-61ca8ce3-6c4e-4a25-a305-f4db893b9d58 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:06.629877 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-7fc38d01-7037-40a6-bfb8-260b8c64a5b4 tempest-ServerMetadataNegativeTestJSON-1253820515 tempest-ServerMetadataNegativeTestJSON-1253820515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153f7059fd924dc5b19f323e0a400381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be467d2547d46089b833ae4b5f9dd05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:57:06.646398 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-7fc38d01-7037-40a6-bfb8-260b8c64a5b4 tempest-ServerMetadataNegativeTestJSON-1253820515 tempest-ServerMetadataNegativeTestJSON-1253820515-project] 10.222.0.18 "GET /compute/v2.1/servers/674e9bd2-7dfd-4854-83e8-56d8970e56bc" status: 200 len: 1324 microversion: 2.1 time: 0.248085 Oct 22 20:57:06.649294 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 912/1912] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:57:06 2022] GET /compute/v2.1/servers/674e9bd2-7dfd-4854-83e8-56d8970e56bc => generated 1324 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:57:06.665913 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-2993620d-de50-4d29-931e-54aed3e4536a tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:57:06.666890 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-2993620d-de50-4d29-931e-54aed3e4536a tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] [instance: cc3236d7-3b9f-40f2-8a53-3096f986e87e] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:57:06.691478 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2993620d-de50-4d29-931e-54aed3e4536a tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:06.692594 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2993620d-de50-4d29-931e-54aed3e4536a tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:06.693475 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2993620d-de50-4d29-931e-54aed3e4536a tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:06.695130 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2993620d-de50-4d29-931e-54aed3e4536a tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:06.695884 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2993620d-de50-4d29-931e-54aed3e4536a tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:06.697289 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2993620d-de50-4d29-931e-54aed3e4536a tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:06.824448 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-2993620d-de50-4d29-931e-54aed3e4536a tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d808e98f843dd9621822682c9d278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b58ab4af674c778b4819f177045651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:57:06.836895 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-2993620d-de50-4d29-931e-54aed3e4536a tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] 10.222.0.18 "GET /compute/v2.1/servers/cc3236d7-3b9f-40f2-8a53-3096f986e87e" status: 200 len: 1276 microversion: 2.1 time: 0.186224 Oct 22 20:57:06.837643 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 913/1913] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:57:06 2022] GET /compute/v2.1/servers/cc3236d7-3b9f-40f2-8a53-3096f986e87e => generated 1276 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:57:06.854368 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-61ca8ce3-6c4e-4a25-a305-f4db893b9d58 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5660f7f9d86f473eaa83e2be362ca63c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e883d7e73084efeb725945ae0bab317', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:57:06.864644 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-61ca8ce3-6c4e-4a25-a305-f4db893b9d58 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] 10.222.0.18 "GET /compute/v2.1/servers/18183d64-42b7-4b9f-9bca-6d018f17eeb3" status: 200 len: 1329 microversion: 2.1 time: 0.311251 Oct 22 20:57:06.864644 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1001/1914] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:57:06 2022] GET /compute/v2.1/servers/18183d64-42b7-4b9f-9bca-6d018f17eeb3 => generated 1329 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:57:06.983027 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-bfed6360-e095-4c0d-8dbb-43018262a6e4 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:57:06.983512 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-bfed6360-e095-4c0d-8dbb-43018262a6e4 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] [instance: 3de7ee82-86b9-4c34-8b81-46f09d6239d0] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:57:06.991926 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bfed6360-e095-4c0d-8dbb-43018262a6e4 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:06.992557 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bfed6360-e095-4c0d-8dbb-43018262a6e4 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:06.992925 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bfed6360-e095-4c0d-8dbb-43018262a6e4 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:06.994080 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bfed6360-e095-4c0d-8dbb-43018262a6e4 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:06.994539 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bfed6360-e095-4c0d-8dbb-43018262a6e4 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:06.994976 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bfed6360-e095-4c0d-8dbb-43018262a6e4 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:07.012643 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-bfed6360-e095-4c0d-8dbb-43018262a6e4 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] HTTP exception thrown: Instance 3de7ee82-86b9-4c34-8b81-46f09d6239d0 could not be found. Oct 22 20:57:07.013815 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-bfed6360-e095-4c0d-8dbb-43018262a6e4 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Request method failure captured: Oct 22 20:57:07.013815 ncdv-master-1 devstack@n-api.service[138744]: request: GET /compute/v2.1/servers/3de7ee82-86b9-4c34-8b81-46f09d6239d0 HTTP/1.1 Oct 22 20:57:07.013815 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 20:57:07.013815 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 20:57:07.013815 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 20:57:07.013815 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 0 Oct 22 20:57:07.013815 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 20:57:07.013815 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 20:57:07.013815 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 20:57:07.013815 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 20:57:07.013815 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVFinkWQQBhkrT1IKOpDugEkOlAPWNZyP_2NMwr13b9XeVy4UUzw2acgfBjDE3p8vwfHK2_Q3RMg9yYmateTjw8EQOHA7IN0HeuqzZ5uQWL0ysIIG3e_nACVRZdRICvuIM06IV17ajtcJTdsfcK0wPQNbKtAOZi6_8a2UUHyQ1NeNuzI Oct 22 20:57:07.013815 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 20:57:07.013815 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 20:57:07.013815 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 20:57:07.013815 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 20:57:07.013815 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 20:57:07.013815 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 20:57:07.013815 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: 594624ed28aa433d907c8833d360b82e Oct 22 20:57:07.013815 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-477371163 Oct 22 20:57:07.013815 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 20:57:07.013815 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 20:57:07.013815 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_594624ed28aa433d907c8833d360b82e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/594624ed28aa433d907c8833d360b82e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/594624ed28aa433d907c8833d360b82e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/594624ed28aa433d907c8833d360b82e"}]}] Oct 22 20:57:07.013815 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-477371163 Oct 22 20:57:07.013815 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: 594624ed28aa433d907c8833d360b82e Oct 22 20:57:07.013815 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-477371163 Oct 22 20:57:07.013815 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-ImagesOneServerNegativeTestJSON-477371163-project Oct 22 20:57:07.013815 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 20:57:07.013815 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 20:57:07.013815 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: b392ad1fe1fd4b2a9e6be03a7435deb9 Oct 22 20:57:07.013815 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-477371163-project Oct 22 20:57:07.013815 ncdv-master-1 devstack@n-api.service[138744]: method: > Oct 22 20:57:07.013815 ncdv-master-1 devstack@n-api.service[138744]: exception: Instance 3de7ee82-86b9-4c34-8b81-46f09d6239d0 could not be found. Oct 22 20:57:07.013815 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': '3de7ee82-86b9-4c34-8b81-46f09d6239d0'} Oct 22 20:57:07.013815 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:57:07.013815 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:57:07.013815 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 20:57:07.013815 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 20:57:07.013815 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 20:57:07.013815 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 20:57:07.013815 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 20:57:07.013815 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 20:57:07.013815 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 20:57:07.013815 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 20:57:07.013815 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3de7ee82-86b9-4c34-8b81-46f09d6239d0 could not be found. Oct 22 20:57:07.013815 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:57:07.013815 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:57:07.013815 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:57:07.013815 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:57:07.013815 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:57:07.013815 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:57:07.013815 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:57:07.013815 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:57:07.013815 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:57:07.013815 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:57:07.013815 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 20:57:07.013815 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 20:57:07.013815 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 20:57:07.013815 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 20:57:07.013815 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 20:57:07.013815 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 20:57:07.013815 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3de7ee82-86b9-4c34-8b81-46f09d6239d0 could not be found. Oct 22 20:57:07.013815 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:57:07.013815 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:57:07.017041 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:57:07.017041 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:57:07.017041 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:57:07.017041 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:57:07.017041 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 20:57:07.017041 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 20:57:07.017041 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3de7ee82-86b9-4c34-8b81-46f09d6239d0 could not be found. Oct 22 20:57:07.017041 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:57:07.017041 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-bfed6360-e095-4c0d-8dbb-43018262a6e4 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Returning 404 to user: Instance 3de7ee82-86b9-4c34-8b81-46f09d6239d0 could not be found. {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:57:07.017041 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-bfed6360-e095-4c0d-8dbb-43018262a6e4 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] 10.222.0.18 "GET /compute/v2.1/servers/3de7ee82-86b9-4c34-8b81-46f09d6239d0" status: 404 len: 111 microversion: 2.1 time: 0.037692 Oct 22 20:57:07.018245 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 914/1915] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:57:06 2022] GET /compute/v2.1/servers/3de7ee82-86b9-4c34-8b81-46f09d6239d0 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 20:57:07.125713 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-061574aa-285d-4164-9a54-bca96a8fe6cd tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-589014543", "imageRef": "085e4478-6edc-4a69-8e08-f9831713eb65", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:57:07.181548 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.network.neutron [None req-061574aa-285d-4164-9a54-bca96a8fe6cd tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] validate_networks() for [('14f6a6b1-55b6-42d0-a3eb-c2e4d989429e', None, None, None, None, None)] {{(pid=138745) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 20:57:07.312932 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-7e2f4e82-d51b-4e45-8ed7-8ea8ee7f7241 req-6d602ee1-e082-455c-9222-02a28d114b58 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "18183d64-42b7-4b9f-9bca-6d018f17eeb3", "tag": "26816847-4085-4357-9ca7-d768088c1a37"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:57:07.329204 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-7e2f4e82-d51b-4e45-8ed7-8ea8ee7f7241 req-6d602ee1-e082-455c-9222-02a28d114b58 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:07.330973 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-7e2f4e82-d51b-4e45-8ed7-8ea8ee7f7241 req-6d602ee1-e082-455c-9222-02a28d114b58 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:07.331773 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-7e2f4e82-d51b-4e45-8ed7-8ea8ee7f7241 req-6d602ee1-e082-455c-9222-02a28d114b58 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:07.347003 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-7e2f4e82-d51b-4e45-8ed7-8ea8ee7f7241 req-6d602ee1-e082-455c-9222-02a28d114b58 service nova] Creating event network-changed:26816847-4085-4357-9ca7-d768088c1a37 for instance 18183d64-42b7-4b9f-9bca-6d018f17eeb3 on nch1-master-1 Oct 22 20:57:07.353520 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-7e2f4e82-d51b-4e45-8ed7-8ea8ee7f7241 req-6d602ee1-e082-455c-9222-02a28d114b58 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046543 Oct 22 20:57:07.354542 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 915/1916] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:57:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:57:07.360245 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-e1e39bea-afc0-4f8f-8b7c-0c6c5aafe0c7 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:57:07.362313 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-e1e39bea-afc0-4f8f-8b7c-0c6c5aafe0c7 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] [instance: aee36c9d-baf4-453c-b88f-31b8f23638c2] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:57:07.375809 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e1e39bea-afc0-4f8f-8b7c-0c6c5aafe0c7 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:07.376321 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e1e39bea-afc0-4f8f-8b7c-0c6c5aafe0c7 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:07.376773 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e1e39bea-afc0-4f8f-8b7c-0c6c5aafe0c7 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:07.377505 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e1e39bea-afc0-4f8f-8b7c-0c6c5aafe0c7 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:07.377966 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e1e39bea-afc0-4f8f-8b7c-0c6c5aafe0c7 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:07.378433 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e1e39bea-afc0-4f8f-8b7c-0c6c5aafe0c7 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:07.895010 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-e1e39bea-afc0-4f8f-8b7c-0c6c5aafe0c7 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d3d7458af447bdb3f03e83a2d8559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49238b8686d24ae698679e4a1957735d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:57:07.907590 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-e1e39bea-afc0-4f8f-8b7c-0c6c5aafe0c7 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] 10.222.0.18 "GET /compute/v2.1/servers/aee36c9d-baf4-453c-b88f-31b8f23638c2" status: 200 len: 1379 microversion: 2.1 time: 0.547910 Oct 22 20:57:07.908533 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 916/1917] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:57:07 2022] GET /compute/v2.1/servers/aee36c9d-baf4-453c-b88f-31b8f23638c2 => generated 1379 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:57:07.915879 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-62a41187-6e8b-49f3-be6d-cc4f5f2d12ca tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:57:07.916498 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-62a41187-6e8b-49f3-be6d-cc4f5f2d12ca tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] [instance: 7c5c7ad1-4e7b-427e-8f66-862cc9b2f457] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:57:07.929680 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-62a41187-6e8b-49f3-be6d-cc4f5f2d12ca tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:07.930208 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-62a41187-6e8b-49f3-be6d-cc4f5f2d12ca tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:07.930635 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-62a41187-6e8b-49f3-be6d-cc4f5f2d12ca tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:07.931387 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-62a41187-6e8b-49f3-be6d-cc4f5f2d12ca tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:07.931841 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-62a41187-6e8b-49f3-be6d-cc4f5f2d12ca tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:07.932371 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-62a41187-6e8b-49f3-be6d-cc4f5f2d12ca tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:08.120728 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-62a41187-6e8b-49f3-be6d-cc4f5f2d12ca tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dbe89a7e11480194d3d86f82983499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8351b01e07cd43f9be973ab45e522bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:57:08.144819 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-62a41187-6e8b-49f3-be6d-cc4f5f2d12ca tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] 10.222.0.18 "GET /compute/v2.1/servers/7c5c7ad1-4e7b-427e-8f66-862cc9b2f457" status: 200 len: 1265 microversion: 2.1 time: 0.235006 Oct 22 20:57:08.146059 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 917/1918] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:57:07 2022] GET /compute/v2.1/servers/7c5c7ad1-4e7b-427e-8f66-862cc9b2f457 => generated 1265 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:57:08.160045 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-df5fc485-860b-41f9-b2a4-5df0a6a927cb tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:57:08.162155 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-df5fc485-860b-41f9-b2a4-5df0a6a927cb tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] [instance: df5f7e8f-5ed6-4ad6-9bcb-eaa54b4ee320] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:57:08.173499 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-df5fc485-860b-41f9-b2a4-5df0a6a927cb tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:08.174279 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-df5fc485-860b-41f9-b2a4-5df0a6a927cb tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:08.176122 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-df5fc485-860b-41f9-b2a4-5df0a6a927cb tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:08.177039 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-df5fc485-860b-41f9-b2a4-5df0a6a927cb tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:08.177683 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-df5fc485-860b-41f9-b2a4-5df0a6a927cb tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:08.180151 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-df5fc485-860b-41f9-b2a4-5df0a6a927cb tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:08.375854 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-061574aa-285d-4164-9a54-bca96a8fe6cd tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Flavor limits 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 20:57:08.376347 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-061574aa-285d-4164-9a54-bca96a8fe6cd tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Image limits 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 20:57:08.377193 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-061574aa-285d-4164-9a54-bca96a8fe6cd tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Flavor pref 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 20:57:08.377628 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-061574aa-285d-4164-9a54-bca96a8fe6cd tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Image pref 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 20:57:08.378034 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-061574aa-285d-4164-9a54-bca96a8fe6cd tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 20:57:08.396611 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-061574aa-285d-4164-9a54-bca96a8fe6cd tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:08.397356 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-061574aa-285d-4164-9a54-bca96a8fe6cd tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:08.398207 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-061574aa-285d-4164-9a54-bca96a8fe6cd tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:08.399185 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-061574aa-285d-4164-9a54-bca96a8fe6cd tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:08.400330 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-061574aa-285d-4164-9a54-bca96a8fe6cd tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:08.400935 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-061574aa-285d-4164-9a54-bca96a8fe6cd tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:08.436173 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-061574aa-285d-4164-9a54-bca96a8fe6cd tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Getting quotas for project 594624ed28aa433d907c8833d360b82e. Resources: {'cores', 'instances', 'ram'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 20:57:08.444768 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-061574aa-285d-4164-9a54-bca96a8fe6cd tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Getting quotas for user b392ad1fe1fd4b2a9e6be03a7435deb9 and project 594624ed28aa433d907c8833d360b82e. Resources: {'cores', 'instances', 'ram'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 20:57:08.460629 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-061574aa-285d-4164-9a54-bca96a8fe6cd tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Going to run 1 instances... {{(pid=138745) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 20:57:08.464899 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-061574aa-285d-4164-9a54-bca96a8fe6cd tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] [instance: 5fadabfa-64f5-4c20-9778-b986d965a632] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='085e4478-6edc-4a69-8e08-f9831713eb65',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138745) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 20:57:08.466182 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-df5fc485-860b-41f9-b2a4-5df0a6a927cb tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e787e0b494764176a0f13d75c47d77fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '371ecb87e8d34859971be23c1a1bc443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:57:08.477079 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-df5fc485-860b-41f9-b2a4-5df0a6a927cb tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] 10.222.0.18 "GET /compute/v2.1/servers/df5f7e8f-5ed6-4ad6-9bcb-eaa54b4ee320" status: 200 len: 1518 microversion: 2.1 time: 0.329337 Oct 22 20:57:08.478499 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 918/1919] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:57:08 2022] GET /compute/v2.1/servers/df5f7e8f-5ed6-4ad6-9bcb-eaa54b4ee320 => generated 1518 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:57:08.484078 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-9078f7b2-d3f0-4283-8747-f060a7d559a4 tempest-ServerMetadataNegativeTestJSON-1253820515 tempest-ServerMetadataNegativeTestJSON-1253820515-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:57:08.485830 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-9078f7b2-d3f0-4283-8747-f060a7d559a4 tempest-ServerMetadataNegativeTestJSON-1253820515 tempest-ServerMetadataNegativeTestJSON-1253820515-project] [instance: 674e9bd2-7dfd-4854-83e8-56d8970e56bc] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:57:08.494187 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9078f7b2-d3f0-4283-8747-f060a7d559a4 tempest-ServerMetadataNegativeTestJSON-1253820515 tempest-ServerMetadataNegativeTestJSON-1253820515-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:08.495491 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9078f7b2-d3f0-4283-8747-f060a7d559a4 tempest-ServerMetadataNegativeTestJSON-1253820515 tempest-ServerMetadataNegativeTestJSON-1253820515-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:08.496205 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9078f7b2-d3f0-4283-8747-f060a7d559a4 tempest-ServerMetadataNegativeTestJSON-1253820515 tempest-ServerMetadataNegativeTestJSON-1253820515-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:08.497324 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9078f7b2-d3f0-4283-8747-f060a7d559a4 tempest-ServerMetadataNegativeTestJSON-1253820515 tempest-ServerMetadataNegativeTestJSON-1253820515-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:08.498117 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9078f7b2-d3f0-4283-8747-f060a7d559a4 tempest-ServerMetadataNegativeTestJSON-1253820515 tempest-ServerMetadataNegativeTestJSON-1253820515-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:08.499090 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9078f7b2-d3f0-4283-8747-f060a7d559a4 tempest-ServerMetadataNegativeTestJSON-1253820515 tempest-ServerMetadataNegativeTestJSON-1253820515-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:08.554079 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-061574aa-285d-4164-9a54-bca96a8fe6cd tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.430589 Oct 22 20:57:08.556563 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1002/1920] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Oct 22 20:57:07 2022] POST /compute/v2.1/servers => generated 383 bytes in 1435 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 20:57:08.565567 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-31eb25ac-f5cb-4a44-bccc-911d9c8b802c tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:57:08.567524 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-31eb25ac-f5cb-4a44-bccc-911d9c8b802c tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] [instance: cc3236d7-3b9f-40f2-8a53-3096f986e87e] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:57:08.575704 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-31eb25ac-f5cb-4a44-bccc-911d9c8b802c tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:08.578349 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-31eb25ac-f5cb-4a44-bccc-911d9c8b802c tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:08.578886 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-31eb25ac-f5cb-4a44-bccc-911d9c8b802c tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:08.579751 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-31eb25ac-f5cb-4a44-bccc-911d9c8b802c tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:08.580190 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-31eb25ac-f5cb-4a44-bccc-911d9c8b802c tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:08.580631 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-31eb25ac-f5cb-4a44-bccc-911d9c8b802c tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:08.859402 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-9078f7b2-d3f0-4283-8747-f060a7d559a4 tempest-ServerMetadataNegativeTestJSON-1253820515 tempest-ServerMetadataNegativeTestJSON-1253820515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153f7059fd924dc5b19f323e0a400381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be467d2547d46089b833ae4b5f9dd05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:57:08.877951 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-9078f7b2-d3f0-4283-8747-f060a7d559a4 tempest-ServerMetadataNegativeTestJSON-1253820515 tempest-ServerMetadataNegativeTestJSON-1253820515-project] 10.222.0.18 "GET /compute/v2.1/servers/674e9bd2-7dfd-4854-83e8-56d8970e56bc" status: 200 len: 1324 microversion: 2.1 time: 0.398034 Oct 22 20:57:08.905384 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-31eb25ac-f5cb-4a44-bccc-911d9c8b802c tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d808e98f843dd9621822682c9d278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b58ab4af674c778b4819f177045651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:57:08.917278 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 919/1921] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:57:08 2022] GET /compute/v2.1/servers/674e9bd2-7dfd-4854-83e8-56d8970e56bc => generated 1324 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:57:08.931484 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-31eb25ac-f5cb-4a44-bccc-911d9c8b802c tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] 10.222.0.18 "GET /compute/v2.1/servers/cc3236d7-3b9f-40f2-8a53-3096f986e87e" status: 200 len: 1318 microversion: 2.1 time: 0.373672 Oct 22 20:57:08.943577 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1003/1922] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:57:08 2022] GET /compute/v2.1/servers/cc3236d7-3b9f-40f2-8a53-3096f986e87e => generated 1318 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:57:08.953035 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-700bdfd0-45cc-4367-ac4c-1e78b1b6506d tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:57:08.955506 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-700bdfd0-45cc-4367-ac4c-1e78b1b6506d tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] [instance: 18183d64-42b7-4b9f-9bca-6d018f17eeb3] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:57:08.964308 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-774a3d6e-ce92-47cc-a2a0-c2789ef68c72 req-fd1bfec3-783d-426c-83d7-b8c30ebb8e02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "674e9bd2-7dfd-4854-83e8-56d8970e56bc", "name": "network-vif-plugged", "status": "completed", "tag": "f884f034-3e3e-4a4b-bb90-9fe55e33a473"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:57:08.975422 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-700bdfd0-45cc-4367-ac4c-1e78b1b6506d tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:08.976732 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-700bdfd0-45cc-4367-ac4c-1e78b1b6506d tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:08.979233 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-700bdfd0-45cc-4367-ac4c-1e78b1b6506d tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:08.980358 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-700bdfd0-45cc-4367-ac4c-1e78b1b6506d tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:08.981036 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-700bdfd0-45cc-4367-ac4c-1e78b1b6506d tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:08.983528 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-700bdfd0-45cc-4367-ac4c-1e78b1b6506d tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:08.996273 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-774a3d6e-ce92-47cc-a2a0-c2789ef68c72 req-fd1bfec3-783d-426c-83d7-b8c30ebb8e02 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:08.997352 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-774a3d6e-ce92-47cc-a2a0-c2789ef68c72 req-fd1bfec3-783d-426c-83d7-b8c30ebb8e02 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:08.998927 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-774a3d6e-ce92-47cc-a2a0-c2789ef68c72 req-fd1bfec3-783d-426c-83d7-b8c30ebb8e02 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:09.031639 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-774a3d6e-ce92-47cc-a2a0-c2789ef68c72 req-fd1bfec3-783d-426c-83d7-b8c30ebb8e02 service nova] Creating event network-vif-plugged:f884f034-3e3e-4a4b-bb90-9fe55e33a473 for instance 674e9bd2-7dfd-4854-83e8-56d8970e56bc on nch2-master-1 Oct 22 20:57:09.050026 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-774a3d6e-ce92-47cc-a2a0-c2789ef68c72 req-fd1bfec3-783d-426c-83d7-b8c30ebb8e02 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097891 Oct 22 20:57:09.054810 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1004/1923] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:57:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:57:09.068826 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-69c1275c-56c1-4d05-bfd2-32ad8bd05a05 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:57:09.069568 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-69c1275c-56c1-4d05-bfd2-32ad8bd05a05 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] [instance: 5fadabfa-64f5-4c20-9778-b986d965a632] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:57:09.623273 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-69c1275c-56c1-4d05-bfd2-32ad8bd05a05 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b392ad1fe1fd4b2a9e6be03a7435deb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594624ed28aa433d907c8833d360b82e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:57:09.632701 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-69c1275c-56c1-4d05-bfd2-32ad8bd05a05 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] 10.222.0.18 "GET /compute/v2.1/servers/5fadabfa-64f5-4c20-9778-b986d965a632" status: 200 len: 1224 microversion: 2.1 time: 0.576111 Oct 22 20:57:09.633439 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1005/1924] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:57:09 2022] GET /compute/v2.1/servers/5fadabfa-64f5-4c20-9778-b986d965a632 => generated 1224 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:57:09.639291 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-1eae7f51-fc69-4c9c-8746-debffffdb8e9 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:57:09.640118 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-1eae7f51-fc69-4c9c-8746-debffffdb8e9 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] [instance: aee36c9d-baf4-453c-b88f-31b8f23638c2] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:57:09.659603 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1eae7f51-fc69-4c9c-8746-debffffdb8e9 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:09.660109 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1eae7f51-fc69-4c9c-8746-debffffdb8e9 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:09.660557 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1eae7f51-fc69-4c9c-8746-debffffdb8e9 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:09.661404 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1eae7f51-fc69-4c9c-8746-debffffdb8e9 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:09.661723 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1eae7f51-fc69-4c9c-8746-debffffdb8e9 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:09.662152 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1eae7f51-fc69-4c9c-8746-debffffdb8e9 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:09.819685 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-700bdfd0-45cc-4367-ac4c-1e78b1b6506d tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5660f7f9d86f473eaa83e2be362ca63c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e883d7e73084efeb725945ae0bab317', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:57:09.834893 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-700bdfd0-45cc-4367-ac4c-1e78b1b6506d tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] 10.222.0.18 "GET /compute/v2.1/servers/18183d64-42b7-4b9f-9bca-6d018f17eeb3" status: 200 len: 1329 microversion: 2.1 time: 0.909913 Oct 22 20:57:09.835320 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 920/1925] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:57:08 2022] GET /compute/v2.1/servers/18183d64-42b7-4b9f-9bca-6d018f17eeb3 => generated 1329 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:57:09.840508 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-acad0ec9-3b5d-46ed-9587-fcb131197d65 req-4be8d4b4-8a41-404d-80f2-997d0b4b7b19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df5f7e8f-5ed6-4ad6-9bcb-eaa54b4ee320", "name": "network-vif-deleted", "tag": "4ddf90b6-ac04-4e00-bc1f-0e465ebdb869"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:57:09.856856 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-acad0ec9-3b5d-46ed-9587-fcb131197d65 req-4be8d4b4-8a41-404d-80f2-997d0b4b7b19 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:09.857587 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-acad0ec9-3b5d-46ed-9587-fcb131197d65 req-4be8d4b4-8a41-404d-80f2-997d0b4b7b19 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:09.858171 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-acad0ec9-3b5d-46ed-9587-fcb131197d65 req-4be8d4b4-8a41-404d-80f2-997d0b4b7b19 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:09.870720 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-acad0ec9-3b5d-46ed-9587-fcb131197d65 req-4be8d4b4-8a41-404d-80f2-997d0b4b7b19 service nova] Creating event network-vif-deleted:4ddf90b6-ac04-4e00-bc1f-0e465ebdb869 for instance df5f7e8f-5ed6-4ad6-9bcb-eaa54b4ee320 on nch2-master-1 Oct 22 20:57:09.876107 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-acad0ec9-3b5d-46ed-9587-fcb131197d65 req-4be8d4b4-8a41-404d-80f2-997d0b4b7b19 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038933 Oct 22 20:57:09.876721 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 921/1926] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:57:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:57:09.881858 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-a2bfe9cc-fbc3-49ca-82cf-864ecd2c3a40 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:57:09.882569 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-a2bfe9cc-fbc3-49ca-82cf-864ecd2c3a40 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] [instance: 7c5c7ad1-4e7b-427e-8f66-862cc9b2f457] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:57:09.888813 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a2bfe9cc-fbc3-49ca-82cf-864ecd2c3a40 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:09.889246 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a2bfe9cc-fbc3-49ca-82cf-864ecd2c3a40 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:09.889688 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a2bfe9cc-fbc3-49ca-82cf-864ecd2c3a40 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:09.890397 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a2bfe9cc-fbc3-49ca-82cf-864ecd2c3a40 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:09.890882 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a2bfe9cc-fbc3-49ca-82cf-864ecd2c3a40 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:09.891537 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a2bfe9cc-fbc3-49ca-82cf-864ecd2c3a40 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:09.916565 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-1eae7f51-fc69-4c9c-8746-debffffdb8e9 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d3d7458af447bdb3f03e83a2d8559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49238b8686d24ae698679e4a1957735d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:57:09.925246 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-1eae7f51-fc69-4c9c-8746-debffffdb8e9 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] 10.222.0.18 "GET /compute/v2.1/servers/aee36c9d-baf4-453c-b88f-31b8f23638c2" status: 200 len: 1379 microversion: 2.1 time: 0.290371 Oct 22 20:57:09.925868 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1006/1927] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:57:09 2022] GET /compute/v2.1/servers/aee36c9d-baf4-453c-b88f-31b8f23638c2 => generated 1379 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:57:09.930749 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-d36c3219-08b2-40e0-b2b7-484b38f16ad4 req-5288fee2-280f-4410-85ad-e56ad730e4a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc3236d7-3b9f-40f2-8a53-3096f986e87e", "tag": "61d2ab3f-b602-485a-9534-df55ed5059a1"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:57:09.940872 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-d36c3219-08b2-40e0-b2b7-484b38f16ad4 req-5288fee2-280f-4410-85ad-e56ad730e4a0 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:09.941350 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-d36c3219-08b2-40e0-b2b7-484b38f16ad4 req-5288fee2-280f-4410-85ad-e56ad730e4a0 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:09.941947 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-d36c3219-08b2-40e0-b2b7-484b38f16ad4 req-5288fee2-280f-4410-85ad-e56ad730e4a0 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:09.953528 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-d36c3219-08b2-40e0-b2b7-484b38f16ad4 req-5288fee2-280f-4410-85ad-e56ad730e4a0 service nova] Creating event network-changed:61d2ab3f-b602-485a-9534-df55ed5059a1 for instance cc3236d7-3b9f-40f2-8a53-3096f986e87e on nch1-master-1 Oct 22 20:57:09.958604 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-d36c3219-08b2-40e0-b2b7-484b38f16ad4 req-5288fee2-280f-4410-85ad-e56ad730e4a0 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031462 Oct 22 20:57:09.959201 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1007/1928] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:57:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:57:09.965038 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-74ef2cf2-4f0f-4470-9fc7-c56c904b1d95 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:57:09.965928 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-74ef2cf2-4f0f-4470-9fc7-c56c904b1d95 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] [instance: df5f7e8f-5ed6-4ad6-9bcb-eaa54b4ee320] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:57:09.972839 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-a2bfe9cc-fbc3-49ca-82cf-864ecd2c3a40 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dbe89a7e11480194d3d86f82983499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8351b01e07cd43f9be973ab45e522bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:57:09.973621 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-74ef2cf2-4f0f-4470-9fc7-c56c904b1d95 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:09.974322 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-74ef2cf2-4f0f-4470-9fc7-c56c904b1d95 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:09.978636 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-74ef2cf2-4f0f-4470-9fc7-c56c904b1d95 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:09.979583 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-74ef2cf2-4f0f-4470-9fc7-c56c904b1d95 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:09.980190 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-74ef2cf2-4f0f-4470-9fc7-c56c904b1d95 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:09.980766 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-74ef2cf2-4f0f-4470-9fc7-c56c904b1d95 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:09.982017 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-a2bfe9cc-fbc3-49ca-82cf-864ecd2c3a40 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] 10.222.0.18 "GET /compute/v2.1/servers/7c5c7ad1-4e7b-427e-8f66-862cc9b2f457" status: 200 len: 1271 microversion: 2.1 time: 0.104120 Oct 22 20:57:09.982715 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 922/1929] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:57:09 2022] GET /compute/v2.1/servers/7c5c7ad1-4e7b-427e-8f66-862cc9b2f457 => generated 1271 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:57:09.988178 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-78433690-6f4d-4263-b826-5a84b72022a0 tempest-ServerMetadataNegativeTestJSON-1253820515 tempest-ServerMetadataNegativeTestJSON-1253820515-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:57:09.989008 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-78433690-6f4d-4263-b826-5a84b72022a0 tempest-ServerMetadataNegativeTestJSON-1253820515 tempest-ServerMetadataNegativeTestJSON-1253820515-project] [instance: 674e9bd2-7dfd-4854-83e8-56d8970e56bc] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:57:09.994933 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:57:10.014550 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.wsgi [None req-74ef2cf2-4f0f-4470-9fc7-c56c904b1d95 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] HTTP exception thrown: Instance df5f7e8f-5ed6-4ad6-9bcb-eaa54b4ee320 could not be found. Oct 22 20:57:10.015137 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-78433690-6f4d-4263-b826-5a84b72022a0 tempest-ServerMetadataNegativeTestJSON-1253820515 tempest-ServerMetadataNegativeTestJSON-1253820515-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:10.015833 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-78433690-6f4d-4263-b826-5a84b72022a0 tempest-ServerMetadataNegativeTestJSON-1253820515 tempest-ServerMetadataNegativeTestJSON-1253820515-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:10.016398 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-78433690-6f4d-4263-b826-5a84b72022a0 tempest-ServerMetadataNegativeTestJSON-1253820515 tempest-ServerMetadataNegativeTestJSON-1253820515-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:10.017169 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-78433690-6f4d-4263-b826-5a84b72022a0 tempest-ServerMetadataNegativeTestJSON-1253820515 tempest-ServerMetadataNegativeTestJSON-1253820515-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:10.017654 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-74ef2cf2-4f0f-4470-9fc7-c56c904b1d95 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Request method failure captured: Oct 22 20:57:10.017654 ncdv-master-1 devstack@n-api.service[138745]: request: GET /compute/v2.1/servers/df5f7e8f-5ed6-4ad6-9bcb-eaa54b4ee320 HTTP/1.1 Oct 22 20:57:10.017654 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 20:57:10.017654 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 20:57:10.017654 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 20:57:10.017654 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 0 Oct 22 20:57:10.017654 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 20:57:10.017654 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 20:57:10.017654 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 20:57:10.017654 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 20:57:10.017654 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVFjYv4p50pKm8yQakerG7q0mSmw6otGG1EIXq7SL7p47_tL_BzbnQ6yshTzdvSSRVPQrm4IIp-tF4e8RwoazpQebhn6C2339q2qSRT1to0lI2g1NqgKTs2-VzTHnzA1Scc09uq7l8P8iPxC6_1j4JK51RzNGS-E0J731EqNX09e4YDg Oct 22 20:57:10.017654 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 20:57:10.017654 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 20:57:10.017654 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 20:57:10.017654 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 20:57:10.017654 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 20:57:10.017654 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 20:57:10.017654 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: 371ecb87e8d34859971be23c1a1bc443 Oct 22 20:57:10.017654 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-ListServerFiltersTestJSON-1003295825 Oct 22 20:57:10.017654 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 20:57:10.017654 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 20:57:10.017654 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_371ecb87e8d34859971be23c1a1bc443"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/371ecb87e8d34859971be23c1a1bc443"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/371ecb87e8d34859971be23c1a1bc443"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/371ecb87e8d34859971be23c1a1bc443"}]}] Oct 22 20:57:10.017654 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-ListServerFiltersTestJSON-1003295825 Oct 22 20:57:10.017654 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: 371ecb87e8d34859971be23c1a1bc443 Oct 22 20:57:10.017654 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1003295825 Oct 22 20:57:10.017654 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-ListServerFiltersTestJSON-1003295825-project Oct 22 20:57:10.017654 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 20:57:10.017654 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 20:57:10.017654 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: e787e0b494764176a0f13d75c47d77fa Oct 22 20:57:10.017654 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-ListServerFiltersTestJSON-1003295825-project Oct 22 20:57:10.017654 ncdv-master-1 devstack@n-api.service[138745]: method: > Oct 22 20:57:10.017654 ncdv-master-1 devstack@n-api.service[138745]: exception: Instance df5f7e8f-5ed6-4ad6-9bcb-eaa54b4ee320 could not be found. Oct 22 20:57:10.017654 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'id': 'df5f7e8f-5ed6-4ad6-9bcb-eaa54b4ee320'} Oct 22 20:57:10.017654 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:57:10.017654 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:57:10.017654 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 20:57:10.017654 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 20:57:10.017654 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 20:57:10.017654 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 20:57:10.017654 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 20:57:10.017654 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 20:57:10.017654 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 20:57:10.017654 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 20:57:10.017654 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df5f7e8f-5ed6-4ad6-9bcb-eaa54b4ee320 could not be found. Oct 22 20:57:10.017654 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:57:10.017654 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:57:10.017654 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:57:10.017654 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:57:10.017654 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:57:10.017654 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:57:10.017654 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:57:10.017654 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:57:10.017654 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:57:10.017654 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:57:10.017654 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 20:57:10.017654 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 20:57:10.017654 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 20:57:10.017654 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 20:57:10.017654 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 20:57:10.017654 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 20:57:10.017654 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df5f7e8f-5ed6-4ad6-9bcb-eaa54b4ee320 could not be found. Oct 22 20:57:10.017654 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:57:10.017654 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:57:10.017654 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:57:10.020795 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:57:10.020795 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:57:10.020795 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:57:10.020795 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 20:57:10.020795 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 20:57:10.020795 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df5f7e8f-5ed6-4ad6-9bcb-eaa54b4ee320 could not be found. Oct 22 20:57:10.020795 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:57:10.021145 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-78433690-6f4d-4263-b826-5a84b72022a0 tempest-ServerMetadataNegativeTestJSON-1253820515 tempest-ServerMetadataNegativeTestJSON-1253820515-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:10.021145 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-78433690-6f4d-4263-b826-5a84b72022a0 tempest-ServerMetadataNegativeTestJSON-1253820515 tempest-ServerMetadataNegativeTestJSON-1253820515-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:10.022194 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-74ef2cf2-4f0f-4470-9fc7-c56c904b1d95 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Returning 404 to user: Instance df5f7e8f-5ed6-4ad6-9bcb-eaa54b4ee320 could not be found. {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:57:10.023390 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-74ef2cf2-4f0f-4470-9fc7-c56c904b1d95 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] 10.222.0.18 "GET /compute/v2.1/servers/df5f7e8f-5ed6-4ad6-9bcb-eaa54b4ee320" status: 404 len: 111 microversion: 2.1 time: 0.062906 Oct 22 20:57:10.024440 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1008/1930] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:57:09 2022] GET /compute/v2.1/servers/df5f7e8f-5ed6-4ad6-9bcb-eaa54b4ee320 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 20:57:10.030250 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-2cacfb33-a8eb-411d-9ad8-d18ea8c3f369 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:57:10.030982 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-2cacfb33-a8eb-411d-9ad8-d18ea8c3f369 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] [instance: cc3236d7-3b9f-40f2-8a53-3096f986e87e] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:57:10.037670 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2cacfb33-a8eb-411d-9ad8-d18ea8c3f369 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:10.038170 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2cacfb33-a8eb-411d-9ad8-d18ea8c3f369 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:10.038607 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2cacfb33-a8eb-411d-9ad8-d18ea8c3f369 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:10.039311 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2cacfb33-a8eb-411d-9ad8-d18ea8c3f369 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:10.039788 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2cacfb33-a8eb-411d-9ad8-d18ea8c3f369 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:10.040215 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2cacfb33-a8eb-411d-9ad8-d18ea8c3f369 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:10.310586 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-78433690-6f4d-4263-b826-5a84b72022a0 tempest-ServerMetadataNegativeTestJSON-1253820515 tempest-ServerMetadataNegativeTestJSON-1253820515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153f7059fd924dc5b19f323e0a400381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be467d2547d46089b833ae4b5f9dd05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:57:10.320421 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-2cacfb33-a8eb-411d-9ad8-d18ea8c3f369 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d808e98f843dd9621822682c9d278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b58ab4af674c778b4819f177045651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:57:10.326266 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-78433690-6f4d-4263-b826-5a84b72022a0 tempest-ServerMetadataNegativeTestJSON-1253820515 tempest-ServerMetadataNegativeTestJSON-1253820515-project] 10.222.0.18 "GET /compute/v2.1/servers/674e9bd2-7dfd-4854-83e8-56d8970e56bc" status: 200 len: 1324 microversion: 2.1 time: 0.342056 Oct 22 20:57:10.339667 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-2cacfb33-a8eb-411d-9ad8-d18ea8c3f369 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] 10.222.0.18 "GET /compute/v2.1/servers/cc3236d7-3b9f-40f2-8a53-3096f986e87e" status: 200 len: 1318 microversion: 2.1 time: 0.310065 Oct 22 20:57:10.339667 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1009/1931] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:57:10 2022] GET /compute/v2.1/servers/cc3236d7-3b9f-40f2-8a53-3096f986e87e => generated 1318 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:57:10.340214 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 923/1932] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:57:09 2022] GET /compute/v2.1/servers/674e9bd2-7dfd-4854-83e8-56d8970e56bc => generated 1324 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:57:10.368413 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-eff75bfd-c04b-4597-b7a3-ef21aebb8007 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:57:10.369867 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-eff75bfd-c04b-4597-b7a3-ef21aebb8007 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] [instance: c5db8404-7c9d-41d4-a018-a27058378d35] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:57:10.382563 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-eff75bfd-c04b-4597-b7a3-ef21aebb8007 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:10.383067 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-eff75bfd-c04b-4597-b7a3-ef21aebb8007 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:10.383540 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-eff75bfd-c04b-4597-b7a3-ef21aebb8007 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:10.384264 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-eff75bfd-c04b-4597-b7a3-ef21aebb8007 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:10.385680 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-eff75bfd-c04b-4597-b7a3-ef21aebb8007 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:10.386113 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-eff75bfd-c04b-4597-b7a3-ef21aebb8007 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:10.416116 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-eff75bfd-c04b-4597-b7a3-ef21aebb8007 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] [instance: c5db8404-7c9d-41d4-a018-a27058378d35] Going to try to terminate instance {{(pid=138745) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 20:57:10.507079 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-eff75bfd-c04b-4597-b7a3-ef21aebb8007 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] 10.222.0.18 "DELETE /compute/v2.1/servers/c5db8404-7c9d-41d4-a018-a27058378d35" status: 204 len: 0 microversion: 2.1 time: 0.168311 Oct 22 20:57:10.507799 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1010/1933] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 20:57:10 2022] DELETE /compute/v2.1/servers/c5db8404-7c9d-41d4-a018-a27058378d35 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 20:57:10.527098 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-06be8638-e140-4a8d-a4aa-8bf1badcf5dc tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:57:10.527779 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-06be8638-e140-4a8d-a4aa-8bf1badcf5dc tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] [instance: c5db8404-7c9d-41d4-a018-a27058378d35] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:57:10.541226 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-06be8638-e140-4a8d-a4aa-8bf1badcf5dc tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:10.541973 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-06be8638-e140-4a8d-a4aa-8bf1badcf5dc tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:10.542495 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-06be8638-e140-4a8d-a4aa-8bf1badcf5dc tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:10.543239 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-06be8638-e140-4a8d-a4aa-8bf1badcf5dc tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:10.546080 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-06be8638-e140-4a8d-a4aa-8bf1badcf5dc tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:10.546611 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-06be8638-e140-4a8d-a4aa-8bf1badcf5dc tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:10.656457 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-90237d43-07b2-485e-a016-877c6db33a40 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:57:10.657681 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-90237d43-07b2-485e-a016-877c6db33a40 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] [instance: 5fadabfa-64f5-4c20-9778-b986d965a632] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:57:10.668404 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-90237d43-07b2-485e-a016-877c6db33a40 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:10.669488 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-90237d43-07b2-485e-a016-877c6db33a40 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:10.670291 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-90237d43-07b2-485e-a016-877c6db33a40 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:10.671822 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-90237d43-07b2-485e-a016-877c6db33a40 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:10.674332 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-90237d43-07b2-485e-a016-877c6db33a40 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:10.675036 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-90237d43-07b2-485e-a016-877c6db33a40 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:10.893535 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-90237d43-07b2-485e-a016-877c6db33a40 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b392ad1fe1fd4b2a9e6be03a7435deb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594624ed28aa433d907c8833d360b82e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:57:10.905204 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-90237d43-07b2-485e-a016-877c6db33a40 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] 10.222.0.18 "GET /compute/v2.1/servers/5fadabfa-64f5-4c20-9778-b986d965a632" status: 200 len: 1228 microversion: 2.1 time: 0.253119 Oct 22 20:57:10.905831 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1011/1934] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:57:10 2022] GET /compute/v2.1/servers/5fadabfa-64f5-4c20-9778-b986d965a632 => generated 1228 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 20:57:10.910815 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-03b7c85e-4caa-409a-83d3-673a9853e122 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:57:10.911475 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-03b7c85e-4caa-409a-83d3-673a9853e122 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] [instance: 18183d64-42b7-4b9f-9bca-6d018f17eeb3] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:57:10.939937 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-03b7c85e-4caa-409a-83d3-673a9853e122 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:10.940621 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-03b7c85e-4caa-409a-83d3-673a9853e122 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:10.941118 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-03b7c85e-4caa-409a-83d3-673a9853e122 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:10.941855 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-03b7c85e-4caa-409a-83d3-673a9853e122 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:10.942463 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-03b7c85e-4caa-409a-83d3-673a9853e122 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:10.942892 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-03b7c85e-4caa-409a-83d3-673a9853e122 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:11.090721 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-06be8638-e140-4a8d-a4aa-8bf1badcf5dc tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e787e0b494764176a0f13d75c47d77fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '371ecb87e8d34859971be23c1a1bc443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:57:11.102589 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-06be8638-e140-4a8d-a4aa-8bf1badcf5dc tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] 10.222.0.18 "GET /compute/v2.1/servers/c5db8404-7c9d-41d4-a018-a27058378d35" status: 200 len: 1519 microversion: 2.1 time: 0.590203 Oct 22 20:57:11.103922 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 924/1935] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:57:10 2022] GET /compute/v2.1/servers/c5db8404-7c9d-41d4-a018-a27058378d35 => generated 1519 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 20:57:11.111925 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-92433d17-d6bb-4da9-bba5-3d9b81da8386 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:57:11.112829 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-92433d17-d6bb-4da9-bba5-3d9b81da8386 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] [instance: aee36c9d-baf4-453c-b88f-31b8f23638c2] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:57:11.131687 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-92433d17-d6bb-4da9-bba5-3d9b81da8386 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:11.132604 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-92433d17-d6bb-4da9-bba5-3d9b81da8386 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:11.133513 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-92433d17-d6bb-4da9-bba5-3d9b81da8386 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:11.135096 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-92433d17-d6bb-4da9-bba5-3d9b81da8386 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:11.135755 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-92433d17-d6bb-4da9-bba5-3d9b81da8386 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:11.136544 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-92433d17-d6bb-4da9-bba5-3d9b81da8386 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:11.143916 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:57:11.195708 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-03b7c85e-4caa-409a-83d3-673a9853e122 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5660f7f9d86f473eaa83e2be362ca63c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e883d7e73084efeb725945ae0bab317', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:57:11.211388 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-03b7c85e-4caa-409a-83d3-673a9853e122 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] 10.222.0.18 "GET /compute/v2.1/servers/18183d64-42b7-4b9f-9bca-6d018f17eeb3" status: 200 len: 1329 microversion: 2.1 time: 0.303865 Oct 22 20:57:11.227825 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1012/1936] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:57:10 2022] GET /compute/v2.1/servers/18183d64-42b7-4b9f-9bca-6d018f17eeb3 => generated 1329 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:57:11.234266 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-ace3f5f0-cb06-484f-a765-80d63b3c6aa4 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:57:11.235042 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-ace3f5f0-cb06-484f-a765-80d63b3c6aa4 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] [instance: 7c5c7ad1-4e7b-427e-8f66-862cc9b2f457] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:57:11.243488 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ace3f5f0-cb06-484f-a765-80d63b3c6aa4 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:11.244003 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ace3f5f0-cb06-484f-a765-80d63b3c6aa4 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:11.244612 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ace3f5f0-cb06-484f-a765-80d63b3c6aa4 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:11.245357 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ace3f5f0-cb06-484f-a765-80d63b3c6aa4 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:11.245991 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ace3f5f0-cb06-484f-a765-80d63b3c6aa4 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:11.246569 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ace3f5f0-cb06-484f-a765-80d63b3c6aa4 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:11.477972 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-92433d17-d6bb-4da9-bba5-3d9b81da8386 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d3d7458af447bdb3f03e83a2d8559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49238b8686d24ae698679e4a1957735d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:57:11.486733 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-92433d17-d6bb-4da9-bba5-3d9b81da8386 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] 10.222.0.18 "GET /compute/v2.1/servers/aee36c9d-baf4-453c-b88f-31b8f23638c2" status: 200 len: 1379 microversion: 2.1 time: 0.381136 Oct 22 20:57:11.487371 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 925/1937] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:57:11 2022] GET /compute/v2.1/servers/aee36c9d-baf4-453c-b88f-31b8f23638c2 => generated 1379 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:57:11.492120 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-22f75d9f-9b37-4729-833e-2be5a466c666 req-af6e3167-c53c-45b1-9e10-cab3a8001ed4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aee36c9d-baf4-453c-b88f-31b8f23638c2", "name": "network-vif-plugged", "status": "completed", "tag": "f8ab0e3e-04fa-4f80-97a2-b20b84653be1"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:57:11.502114 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-22f75d9f-9b37-4729-833e-2be5a466c666 req-af6e3167-c53c-45b1-9e10-cab3a8001ed4 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:11.502625 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-22f75d9f-9b37-4729-833e-2be5a466c666 req-af6e3167-c53c-45b1-9e10-cab3a8001ed4 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:11.503248 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-22f75d9f-9b37-4729-833e-2be5a466c666 req-af6e3167-c53c-45b1-9e10-cab3a8001ed4 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:11.516432 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-22f75d9f-9b37-4729-833e-2be5a466c666 req-af6e3167-c53c-45b1-9e10-cab3a8001ed4 service nova] Creating event network-vif-plugged:f8ab0e3e-04fa-4f80-97a2-b20b84653be1 for instance aee36c9d-baf4-453c-b88f-31b8f23638c2 on nch1-master-1 Oct 22 20:57:11.521536 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-22f75d9f-9b37-4729-833e-2be5a466c666 req-af6e3167-c53c-45b1-9e10-cab3a8001ed4 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033020 Oct 22 20:57:11.523165 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 926/1938] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:57:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:57:11.527926 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-ace3f5f0-cb06-484f-a765-80d63b3c6aa4 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dbe89a7e11480194d3d86f82983499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8351b01e07cd43f9be973ab45e522bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:57:11.530316 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-1db5df62-83fa-4504-8529-c031c019f82b tempest-ServerMetadataNegativeTestJSON-1253820515 tempest-ServerMetadataNegativeTestJSON-1253820515-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:57:11.531820 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-1db5df62-83fa-4504-8529-c031c019f82b tempest-ServerMetadataNegativeTestJSON-1253820515 tempest-ServerMetadataNegativeTestJSON-1253820515-project] [instance: 674e9bd2-7dfd-4854-83e8-56d8970e56bc] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:57:11.540242 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-ace3f5f0-cb06-484f-a765-80d63b3c6aa4 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] 10.222.0.18 "GET /compute/v2.1/servers/7c5c7ad1-4e7b-427e-8f66-862cc9b2f457" status: 200 len: 1313 microversion: 2.1 time: 0.317289 Oct 22 20:57:11.540836 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1013/1939] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:57:11 2022] GET /compute/v2.1/servers/7c5c7ad1-4e7b-427e-8f66-862cc9b2f457 => generated 1313 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:57:11.556044 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1db5df62-83fa-4504-8529-c031c019f82b tempest-ServerMetadataNegativeTestJSON-1253820515 tempest-ServerMetadataNegativeTestJSON-1253820515-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:11.556044 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1db5df62-83fa-4504-8529-c031c019f82b tempest-ServerMetadataNegativeTestJSON-1253820515 tempest-ServerMetadataNegativeTestJSON-1253820515-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:11.556044 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1db5df62-83fa-4504-8529-c031c019f82b tempest-ServerMetadataNegativeTestJSON-1253820515 tempest-ServerMetadataNegativeTestJSON-1253820515-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:11.556044 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1db5df62-83fa-4504-8529-c031c019f82b tempest-ServerMetadataNegativeTestJSON-1253820515 tempest-ServerMetadataNegativeTestJSON-1253820515-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:11.556044 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1db5df62-83fa-4504-8529-c031c019f82b tempest-ServerMetadataNegativeTestJSON-1253820515 tempest-ServerMetadataNegativeTestJSON-1253820515-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:11.556044 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1db5df62-83fa-4504-8529-c031c019f82b tempest-ServerMetadataNegativeTestJSON-1253820515 tempest-ServerMetadataNegativeTestJSON-1253820515-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:11.590750 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-dd6bf454-73ca-4c83-8459-f4ab765ecbc6 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:57:11.594693 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-dd6bf454-73ca-4c83-8459-f4ab765ecbc6 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] [instance: cc3236d7-3b9f-40f2-8a53-3096f986e87e] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:57:11.616306 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-dd6bf454-73ca-4c83-8459-f4ab765ecbc6 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:11.618326 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-dd6bf454-73ca-4c83-8459-f4ab765ecbc6 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:11.619548 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-dd6bf454-73ca-4c83-8459-f4ab765ecbc6 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:11.620995 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-dd6bf454-73ca-4c83-8459-f4ab765ecbc6 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:11.623611 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-dd6bf454-73ca-4c83-8459-f4ab765ecbc6 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:11.624492 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-dd6bf454-73ca-4c83-8459-f4ab765ecbc6 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:12.119096 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-1db5df62-83fa-4504-8529-c031c019f82b tempest-ServerMetadataNegativeTestJSON-1253820515 tempest-ServerMetadataNegativeTestJSON-1253820515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153f7059fd924dc5b19f323e0a400381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be467d2547d46089b833ae4b5f9dd05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:57:12.129913 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-1db5df62-83fa-4504-8529-c031c019f82b tempest-ServerMetadataNegativeTestJSON-1253820515 tempest-ServerMetadataNegativeTestJSON-1253820515-project] 10.222.0.18 "GET /compute/v2.1/servers/674e9bd2-7dfd-4854-83e8-56d8970e56bc" status: 200 len: 1324 microversion: 2.1 time: 0.605252 Oct 22 20:57:12.130762 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 927/1940] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:57:11 2022] GET /compute/v2.1/servers/674e9bd2-7dfd-4854-83e8-56d8970e56bc => generated 1324 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:57:12.136173 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-c8d0dd91-b9e8-460e-bf3f-cb777f42b42c tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:57:12.136962 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-c8d0dd91-b9e8-460e-bf3f-cb777f42b42c tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] [instance: 5fadabfa-64f5-4c20-9778-b986d965a632] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:57:12.144916 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c8d0dd91-b9e8-460e-bf3f-cb777f42b42c tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:12.146463 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c8d0dd91-b9e8-460e-bf3f-cb777f42b42c tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:12.147147 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c8d0dd91-b9e8-460e-bf3f-cb777f42b42c tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:12.148111 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c8d0dd91-b9e8-460e-bf3f-cb777f42b42c tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:12.148774 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c8d0dd91-b9e8-460e-bf3f-cb777f42b42c tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:12.149424 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c8d0dd91-b9e8-460e-bf3f-cb777f42b42c tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:12.331507 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-c8d0dd91-b9e8-460e-bf3f-cb777f42b42c tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b392ad1fe1fd4b2a9e6be03a7435deb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594624ed28aa433d907c8833d360b82e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:57:12.341597 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-c8d0dd91-b9e8-460e-bf3f-cb777f42b42c tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] 10.222.0.18 "GET /compute/v2.1/servers/5fadabfa-64f5-4c20-9778-b986d965a632" status: 200 len: 1282 microversion: 2.1 time: 0.209408 Oct 22 20:57:12.342180 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 928/1941] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:57:12 2022] GET /compute/v2.1/servers/5fadabfa-64f5-4c20-9778-b986d965a632 => generated 1282 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:57:12.347552 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-d9ffd993-519d-441c-9117-7e749d002edf tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:57:12.348604 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-d9ffd993-519d-441c-9117-7e749d002edf tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] [instance: c5db8404-7c9d-41d4-a018-a27058378d35] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:57:12.355691 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d9ffd993-519d-441c-9117-7e749d002edf tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:12.356549 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d9ffd993-519d-441c-9117-7e749d002edf tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:12.357190 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d9ffd993-519d-441c-9117-7e749d002edf tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:12.358130 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d9ffd993-519d-441c-9117-7e749d002edf tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:12.358801 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d9ffd993-519d-441c-9117-7e749d002edf tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:12.359272 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d9ffd993-519d-441c-9117-7e749d002edf tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:12.377047 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-dd6bf454-73ca-4c83-8459-f4ab765ecbc6 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d808e98f843dd9621822682c9d278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b58ab4af674c778b4819f177045651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:57:12.404350 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-dd6bf454-73ca-4c83-8459-f4ab765ecbc6 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] 10.222.0.18 "GET /compute/v2.1/servers/cc3236d7-3b9f-40f2-8a53-3096f986e87e" status: 200 len: 1318 microversion: 2.1 time: 0.829440 Oct 22 20:57:12.405515 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1014/1942] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:57:11 2022] GET /compute/v2.1/servers/cc3236d7-3b9f-40f2-8a53-3096f986e87e => generated 1318 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:57:12.411025 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-784474ff-e998-480b-ad9f-95faa9ca5cb5 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:57:12.411871 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-784474ff-e998-480b-ad9f-95faa9ca5cb5 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] [instance: 18183d64-42b7-4b9f-9bca-6d018f17eeb3] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:57:12.420681 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-784474ff-e998-480b-ad9f-95faa9ca5cb5 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:12.421171 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-784474ff-e998-480b-ad9f-95faa9ca5cb5 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:12.421603 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-784474ff-e998-480b-ad9f-95faa9ca5cb5 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:12.422419 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-784474ff-e998-480b-ad9f-95faa9ca5cb5 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:12.423446 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-784474ff-e998-480b-ad9f-95faa9ca5cb5 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:12.424204 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-784474ff-e998-480b-ad9f-95faa9ca5cb5 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:12.962769 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-d9ffd993-519d-441c-9117-7e749d002edf tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e787e0b494764176a0f13d75c47d77fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '371ecb87e8d34859971be23c1a1bc443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:57:12.974406 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-d9ffd993-519d-441c-9117-7e749d002edf tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] 10.222.0.18 "GET /compute/v2.1/servers/c5db8404-7c9d-41d4-a018-a27058378d35" status: 200 len: 1519 microversion: 2.1 time: 0.630815 Oct 22 20:57:12.988549 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 929/1943] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:57:12 2022] GET /compute/v2.1/servers/c5db8404-7c9d-41d4-a018-a27058378d35 => generated 1519 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:57:12.997570 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-0dcaa6c8-19a2-4795-83a7-4cf4bc33a632 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:57:12.998732 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-0dcaa6c8-19a2-4795-83a7-4cf4bc33a632 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] [instance: aee36c9d-baf4-453c-b88f-31b8f23638c2] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:57:13.005178 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0dcaa6c8-19a2-4795-83a7-4cf4bc33a632 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:13.005762 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0dcaa6c8-19a2-4795-83a7-4cf4bc33a632 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:13.006213 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0dcaa6c8-19a2-4795-83a7-4cf4bc33a632 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:13.006930 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0dcaa6c8-19a2-4795-83a7-4cf4bc33a632 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:13.007574 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0dcaa6c8-19a2-4795-83a7-4cf4bc33a632 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:13.008296 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0dcaa6c8-19a2-4795-83a7-4cf4bc33a632 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:13.048481 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-784474ff-e998-480b-ad9f-95faa9ca5cb5 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5660f7f9d86f473eaa83e2be362ca63c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e883d7e73084efeb725945ae0bab317', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:57:13.059373 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-784474ff-e998-480b-ad9f-95faa9ca5cb5 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] 10.222.0.18 "GET /compute/v2.1/servers/18183d64-42b7-4b9f-9bca-6d018f17eeb3" status: 200 len: 1329 microversion: 2.1 time: 0.652512 Oct 22 20:57:13.060409 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1015/1944] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:57:12 2022] GET /compute/v2.1/servers/18183d64-42b7-4b9f-9bca-6d018f17eeb3 => generated 1329 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:57:13.065849 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-a0922754-0661-45b8-a734-2fefde0a7164 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:57:13.066752 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-a0922754-0661-45b8-a734-2fefde0a7164 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] [instance: 7c5c7ad1-4e7b-427e-8f66-862cc9b2f457] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:57:13.076455 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a0922754-0661-45b8-a734-2fefde0a7164 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:13.079935 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a0922754-0661-45b8-a734-2fefde0a7164 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:13.080521 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a0922754-0661-45b8-a734-2fefde0a7164 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:13.081408 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a0922754-0661-45b8-a734-2fefde0a7164 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:13.081986 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a0922754-0661-45b8-a734-2fefde0a7164 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:13.082526 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a0922754-0661-45b8-a734-2fefde0a7164 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:13.319365 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell0:SELECT=22 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:57:13.493000 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-0dcaa6c8-19a2-4795-83a7-4cf4bc33a632 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d3d7458af447bdb3f03e83a2d8559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49238b8686d24ae698679e4a1957735d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:57:13.501079 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-0dcaa6c8-19a2-4795-83a7-4cf4bc33a632 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] 10.222.0.18 "GET /compute/v2.1/servers/aee36c9d-baf4-453c-b88f-31b8f23638c2" status: 200 len: 1379 microversion: 2.1 time: 0.511261 Oct 22 20:57:13.501647 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 930/1945] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:57:12 2022] GET /compute/v2.1/servers/aee36c9d-baf4-453c-b88f-31b8f23638c2 => generated 1379 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:57:13.506133 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-b85d9820-ac68-4728-8f17-4f27b2784647 req-ed9ab796-bfa5-4c74-a2b0-2a717eb03ff9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f070b144-3a1a-4456-8e5b-02af12557c6a", "tag": "9c49ccea-f5ad-47be-9a9c-61df2a8933d5"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:57:13.515579 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-b85d9820-ac68-4728-8f17-4f27b2784647 req-ed9ab796-bfa5-4c74-a2b0-2a717eb03ff9 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:13.516071 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-b85d9820-ac68-4728-8f17-4f27b2784647 req-ed9ab796-bfa5-4c74-a2b0-2a717eb03ff9 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:13.516514 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-b85d9820-ac68-4728-8f17-4f27b2784647 req-ed9ab796-bfa5-4c74-a2b0-2a717eb03ff9 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:13.527898 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-b85d9820-ac68-4728-8f17-4f27b2784647 req-ed9ab796-bfa5-4c74-a2b0-2a717eb03ff9 service nova] Creating event network-changed:9c49ccea-f5ad-47be-9a9c-61df2a8933d5 for instance f070b144-3a1a-4456-8e5b-02af12557c6a on nch2-master-1 Oct 22 20:57:13.532667 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-b85d9820-ac68-4728-8f17-4f27b2784647 req-ed9ab796-bfa5-4c74-a2b0-2a717eb03ff9 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029902 Oct 22 20:57:13.533254 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 931/1946] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:57:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:57:13.538231 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-7f66a438-055c-41ce-a557-10cbf24df45d req-a7ad34e8-fab7-4802-b29c-dc1a10b14fe4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c5c7ad1-4e7b-427e-8f66-862cc9b2f457", "tag": "058b5ead-f160-4367-a819-2697169cb3fa"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:57:13.548202 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-7f66a438-055c-41ce-a557-10cbf24df45d req-a7ad34e8-fab7-4802-b29c-dc1a10b14fe4 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:13.548671 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-7f66a438-055c-41ce-a557-10cbf24df45d req-a7ad34e8-fab7-4802-b29c-dc1a10b14fe4 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:13.549113 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-7f66a438-055c-41ce-a557-10cbf24df45d req-a7ad34e8-fab7-4802-b29c-dc1a10b14fe4 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:13.560245 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-7f66a438-055c-41ce-a557-10cbf24df45d req-a7ad34e8-fab7-4802-b29c-dc1a10b14fe4 service nova] Creating event network-changed:058b5ead-f160-4367-a819-2697169cb3fa for instance 7c5c7ad1-4e7b-427e-8f66-862cc9b2f457 on nch2-master-1 Oct 22 20:57:13.565148 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-7f66a438-055c-41ce-a557-10cbf24df45d req-a7ad34e8-fab7-4802-b29c-dc1a10b14fe4 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030636 Oct 22 20:57:13.565750 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 932/1947] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:57:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:57:13.574036 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-03fe5b07-e3ea-4350-8b9c-07d51c7ab9cb tempest-ServerMetadataNegativeTestJSON-1253820515 tempest-ServerMetadataNegativeTestJSON-1253820515-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:57:13.574753 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-03fe5b07-e3ea-4350-8b9c-07d51c7ab9cb tempest-ServerMetadataNegativeTestJSON-1253820515 tempest-ServerMetadataNegativeTestJSON-1253820515-project] [instance: 674e9bd2-7dfd-4854-83e8-56d8970e56bc] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:57:13.581078 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-03fe5b07-e3ea-4350-8b9c-07d51c7ab9cb tempest-ServerMetadataNegativeTestJSON-1253820515 tempest-ServerMetadataNegativeTestJSON-1253820515-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:13.581564 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-03fe5b07-e3ea-4350-8b9c-07d51c7ab9cb tempest-ServerMetadataNegativeTestJSON-1253820515 tempest-ServerMetadataNegativeTestJSON-1253820515-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:13.582005 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-03fe5b07-e3ea-4350-8b9c-07d51c7ab9cb tempest-ServerMetadataNegativeTestJSON-1253820515 tempest-ServerMetadataNegativeTestJSON-1253820515-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:13.582801 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-03fe5b07-e3ea-4350-8b9c-07d51c7ab9cb tempest-ServerMetadataNegativeTestJSON-1253820515 tempest-ServerMetadataNegativeTestJSON-1253820515-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:13.583150 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-03fe5b07-e3ea-4350-8b9c-07d51c7ab9cb tempest-ServerMetadataNegativeTestJSON-1253820515 tempest-ServerMetadataNegativeTestJSON-1253820515-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:13.583604 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-03fe5b07-e3ea-4350-8b9c-07d51c7ab9cb tempest-ServerMetadataNegativeTestJSON-1253820515 tempest-ServerMetadataNegativeTestJSON-1253820515-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:13.585886 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-a0922754-0661-45b8-a734-2fefde0a7164 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dbe89a7e11480194d3d86f82983499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8351b01e07cd43f9be973ab45e522bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:57:13.595323 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-a0922754-0661-45b8-a734-2fefde0a7164 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] 10.222.0.18 "GET /compute/v2.1/servers/7c5c7ad1-4e7b-427e-8f66-862cc9b2f457" status: 200 len: 1313 microversion: 2.1 time: 0.533295 Oct 22 20:57:13.596414 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1016/1948] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:57:13 2022] GET /compute/v2.1/servers/7c5c7ad1-4e7b-427e-8f66-862cc9b2f457 => generated 1313 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:57:13.601578 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-cc053ac9-4cda-489d-9d15-14d4975ac63f tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:57:13.602490 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-cc053ac9-4cda-489d-9d15-14d4975ac63f tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] [instance: 5fadabfa-64f5-4c20-9778-b986d965a632] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:57:13.608850 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cc053ac9-4cda-489d-9d15-14d4975ac63f tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:13.609619 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cc053ac9-4cda-489d-9d15-14d4975ac63f tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:13.610996 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cc053ac9-4cda-489d-9d15-14d4975ac63f tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:13.611859 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cc053ac9-4cda-489d-9d15-14d4975ac63f tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:13.613578 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cc053ac9-4cda-489d-9d15-14d4975ac63f tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:13.614230 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cc053ac9-4cda-489d-9d15-14d4975ac63f tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:14.071256 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-cc053ac9-4cda-489d-9d15-14d4975ac63f tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b392ad1fe1fd4b2a9e6be03a7435deb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594624ed28aa433d907c8833d360b82e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:57:14.079721 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-cc053ac9-4cda-489d-9d15-14d4975ac63f tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] 10.222.0.18 "GET /compute/v2.1/servers/5fadabfa-64f5-4c20-9778-b986d965a632" status: 200 len: 1282 microversion: 2.1 time: 0.482070 Oct 22 20:57:14.089268 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1017/1949] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:57:13 2022] GET /compute/v2.1/servers/5fadabfa-64f5-4c20-9778-b986d965a632 => generated 1282 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:57:14.089268 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-727d5517-1dcb-440a-a498-cdc96e0e48fc tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:57:14.089268 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-727d5517-1dcb-440a-a498-cdc96e0e48fc tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] [instance: cc3236d7-3b9f-40f2-8a53-3096f986e87e] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:57:14.089268 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=9,nova_api:UPDATE=1 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:57:14.093940 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-727d5517-1dcb-440a-a498-cdc96e0e48fc tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:14.094607 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-727d5517-1dcb-440a-a498-cdc96e0e48fc tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:14.095149 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-727d5517-1dcb-440a-a498-cdc96e0e48fc tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:14.096152 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-727d5517-1dcb-440a-a498-cdc96e0e48fc tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:14.096872 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-727d5517-1dcb-440a-a498-cdc96e0e48fc tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:14.097036 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-727d5517-1dcb-440a-a498-cdc96e0e48fc tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:14.256741 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-03fe5b07-e3ea-4350-8b9c-07d51c7ab9cb tempest-ServerMetadataNegativeTestJSON-1253820515 tempest-ServerMetadataNegativeTestJSON-1253820515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153f7059fd924dc5b19f323e0a400381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be467d2547d46089b833ae4b5f9dd05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:57:14.265120 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-03fe5b07-e3ea-4350-8b9c-07d51c7ab9cb tempest-ServerMetadataNegativeTestJSON-1253820515 tempest-ServerMetadataNegativeTestJSON-1253820515-project] 10.222.0.18 "GET /compute/v2.1/servers/674e9bd2-7dfd-4854-83e8-56d8970e56bc" status: 200 len: 1521 microversion: 2.1 time: 0.695220 Oct 22 20:57:14.265683 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 933/1950] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:57:13 2022] GET /compute/v2.1/servers/674e9bd2-7dfd-4854-83e8-56d8970e56bc => generated 1521 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:57:14.270283 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-ffca677e-fa92-4023-b8f0-aa44b2206523 req-7f397d29-753a-4ac0-887d-0d6cdc30fcc8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18183d64-42b7-4b9f-9bca-6d018f17eeb3", "name": "network-vif-plugged", "status": "completed", "tag": "26816847-4085-4357-9ca7-d768088c1a37"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:57:14.280078 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-ffca677e-fa92-4023-b8f0-aa44b2206523 req-7f397d29-753a-4ac0-887d-0d6cdc30fcc8 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:14.280582 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-ffca677e-fa92-4023-b8f0-aa44b2206523 req-7f397d29-753a-4ac0-887d-0d6cdc30fcc8 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:14.281017 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-ffca677e-fa92-4023-b8f0-aa44b2206523 req-7f397d29-753a-4ac0-887d-0d6cdc30fcc8 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:14.296025 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-ffca677e-fa92-4023-b8f0-aa44b2206523 req-7f397d29-753a-4ac0-887d-0d6cdc30fcc8 service nova] Creating event network-vif-plugged:26816847-4085-4357-9ca7-d768088c1a37 for instance 18183d64-42b7-4b9f-9bca-6d018f17eeb3 on nch1-master-1 Oct 22 20:57:14.301575 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-ffca677e-fa92-4023-b8f0-aa44b2206523 req-7f397d29-753a-4ac0-887d-0d6cdc30fcc8 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034698 Oct 22 20:57:14.302151 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 934/1951] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:57:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:57:14.310643 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-48f68d62-903c-4088-8185-b45b3e67a22b tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:57:14.311603 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-48f68d62-903c-4088-8185-b45b3e67a22b tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] [instance: c5db8404-7c9d-41d4-a018-a27058378d35] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:57:14.319224 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-48f68d62-903c-4088-8185-b45b3e67a22b tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:14.319746 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-48f68d62-903c-4088-8185-b45b3e67a22b tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:14.320298 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-48f68d62-903c-4088-8185-b45b3e67a22b tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:14.320867 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-48f68d62-903c-4088-8185-b45b3e67a22b tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:14.321482 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-48f68d62-903c-4088-8185-b45b3e67a22b tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:14.322548 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-48f68d62-903c-4088-8185-b45b3e67a22b tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:14.424812 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-727d5517-1dcb-440a-a498-cdc96e0e48fc tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d808e98f843dd9621822682c9d278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b58ab4af674c778b4819f177045651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:57:14.437598 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:57:14.445684 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-727d5517-1dcb-440a-a498-cdc96e0e48fc tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] 10.222.0.18 "GET /compute/v2.1/servers/cc3236d7-3b9f-40f2-8a53-3096f986e87e" status: 200 len: 1318 microversion: 2.1 time: 0.364054 Oct 22 20:57:14.446802 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1018/1952] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:57:14 2022] GET /compute/v2.1/servers/cc3236d7-3b9f-40f2-8a53-3096f986e87e => generated 1318 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:57:14.451981 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-36aa3228-aacc-4bae-9b44-3ef05b93ec6c tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:57:14.452961 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-36aa3228-aacc-4bae-9b44-3ef05b93ec6c tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] [instance: 18183d64-42b7-4b9f-9bca-6d018f17eeb3] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:57:14.460049 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-36aa3228-aacc-4bae-9b44-3ef05b93ec6c tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:14.461034 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-36aa3228-aacc-4bae-9b44-3ef05b93ec6c tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:14.461656 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-36aa3228-aacc-4bae-9b44-3ef05b93ec6c tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:14.468393 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-36aa3228-aacc-4bae-9b44-3ef05b93ec6c tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:14.469335 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-36aa3228-aacc-4bae-9b44-3ef05b93ec6c tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:14.470019 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-36aa3228-aacc-4bae-9b44-3ef05b93ec6c tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:14.561946 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-48f68d62-903c-4088-8185-b45b3e67a22b tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e787e0b494764176a0f13d75c47d77fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '371ecb87e8d34859971be23c1a1bc443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:57:14.578515 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-48f68d62-903c-4088-8185-b45b3e67a22b tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] 10.222.0.18 "GET /compute/v2.1/servers/c5db8404-7c9d-41d4-a018-a27058378d35" status: 200 len: 1477 microversion: 2.1 time: 0.271672 Oct 22 20:57:14.595416 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 935/1953] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:57:14 2022] GET /compute/v2.1/servers/c5db8404-7c9d-41d4-a018-a27058378d35 => generated 1477 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:57:14.602374 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-29e7b63d-7c33-4d32-9344-2411b813fa8d tempest-ServerMetadataNegativeTestJSON-1253820515 tempest-ServerMetadataNegativeTestJSON-1253820515-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1815300081", "imageRef": "085e4478-6edc-4a69-8e08-f9831713eb65", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "b12dbc60-e91e-47e6-b028-a9d8abe94afd"}]}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:57:14.615931 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-29e7b63d-7c33-4d32-9344-2411b813fa8d tempest-ServerMetadataNegativeTestJSON-1253820515 tempest-ServerMetadataNegativeTestJSON-1253820515-project] Request method failure captured: Oct 22 20:57:14.615931 ncdv-master-1 devstack@n-api.service[138744]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 22 20:57:14.615931 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 20:57:14.615931 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 20:57:14.615931 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 20:57:14.615931 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 243 Oct 22 20:57:14.615931 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 20:57:14.615931 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 20:57:14.615931 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 20:57:14.615931 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 20:57:14.615931 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVFkP-OPnnJAqnv5Vl_qiDumPkYSxzD6Lkt4grXBrubAE37i2toaOx27e7DT0jWmvJcWzGKhPXwpF_4K4K5_s49zBmjXAp7bRtL2teV862hikPRv-Oqdp2Z9FAOqZaslMfFN4lsF_zKvB0takdeeasPQ-TSWheMbUTyBE7r1aeYOttEE Oct 22 20:57:14.615931 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 20:57:14.615931 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 20:57:14.615931 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 20:57:14.615931 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 20:57:14.615931 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 20:57:14.615931 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 20:57:14.615931 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: 9be467d2547d46089b833ae4b5f9dd05 Oct 22 20:57:14.615931 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1253820515 Oct 22 20:57:14.615931 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 20:57:14.615931 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 20:57:14.615931 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_9be467d2547d46089b833ae4b5f9dd05"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9be467d2547d46089b833ae4b5f9dd05"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/9be467d2547d46089b833ae4b5f9dd05"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9be467d2547d46089b833ae4b5f9dd05"}]}] Oct 22 20:57:14.615931 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1253820515 Oct 22 20:57:14.615931 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: 9be467d2547d46089b833ae4b5f9dd05 Oct 22 20:57:14.615931 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1253820515 Oct 22 20:57:14.615931 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-ServerMetadataNegativeTestJSON-1253820515-project Oct 22 20:57:14.615931 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 20:57:14.615931 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 20:57:14.615931 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: 153f7059fd924dc5b19f323e0a400381 Oct 22 20:57:14.615931 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1253820515-project Oct 22 20:57:14.615931 ncdv-master-1 devstack@n-api.service[138744]: Oct 22 20:57:14.615931 ncdv-master-1 devstack@n-api.service[138744]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1815300081", "imageRef": "085e4478-6edc-4a69-8e08-f9831713eb65", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "b12dbc60-e91e-47e6-b028-a9d8abe94afd"}]}} Oct 22 20:57:14.615931 ncdv-master-1 devstack@n-api.service[138744]: method: > Oct 22 20:57:14.615931 ncdv-master-1 devstack@n-api.service[138744]: exception: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 22 20:57:14.615931 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1815300081', 'imageRef': '085e4478-6edc-4a69-8e08-f9831713eb65', 'flavorRef': '452', 'metadata': {'': 'data1'}, 'networks': [{'uuid': 'b12dbc60-e91e-47e6-b028-a9d8abe94afd'}]}}} Oct 22 20:57:14.615931 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:57:14.615931 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:57:14.615931 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 22 20:57:14.615931 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 22 20:57:14.615931 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 22 20:57:14.615931 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise error Oct 22 20:57:14.615931 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 22 20:57:14.615931 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:57:14.615931 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 22 20:57:14.615931 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 22 20:57:14.615931 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 22 20:57:14.615931 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 22 20:57:14.615931 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 22 20:57:14.615931 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:57:14.615931 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 22 20:57:14.615931 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi {'': 'data1'} Oct 22 20:57:14.615931 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:57:14.615931 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:57:14.615931 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:57:14.615931 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:57:14.615931 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:57:14.615931 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:57:14.615931 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:57:14.615931 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:57:14.615931 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:57:14.615931 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:57:14.615931 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 20:57:14.619142 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 20:57:14.619142 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 22 20:57:14.619142 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 22 20:57:14.619142 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 22 20:57:14.619142 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 22 20:57:14.619142 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 22 20:57:14.619142 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 22 20:57:14.619142 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 22 20:57:14.619142 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:57:14.619142 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:57:14.619142 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:57:14.619142 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:57:14.619142 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:57:14.619142 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:57:14.619142 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 22 20:57:14.619142 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 22 20:57:14.619142 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 22 20:57:14.619142 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:57:14.619142 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-29e7b63d-7c33-4d32-9344-2411b813fa8d tempest-ServerMetadataNegativeTestJSON-1253820515 tempest-ServerMetadataNegativeTestJSON-1253820515-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:57:14.619142 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-29e7b63d-7c33-4d32-9344-2411b813fa8d tempest-ServerMetadataNegativeTestJSON-1253820515 tempest-ServerMetadataNegativeTestJSON-1253820515-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 400 len: 175 microversion: 2.1 time: 0.020865 Oct 22 20:57:14.619142 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 936/1954] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Oct 22 20:57:14 2022] POST /compute/v2.1/servers => generated 175 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 22 20:57:14.630296 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-1a8c0f47-0e16-4e2b-bb3f-71caaffa8319 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:57:14.631855 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-1a8c0f47-0e16-4e2b-bb3f-71caaffa8319 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] [instance: aee36c9d-baf4-453c-b88f-31b8f23638c2] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:57:14.640736 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1a8c0f47-0e16-4e2b-bb3f-71caaffa8319 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:14.641554 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1a8c0f47-0e16-4e2b-bb3f-71caaffa8319 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:14.641971 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1a8c0f47-0e16-4e2b-bb3f-71caaffa8319 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:14.642771 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1a8c0f47-0e16-4e2b-bb3f-71caaffa8319 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:14.644280 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1a8c0f47-0e16-4e2b-bb3f-71caaffa8319 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:14.644730 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1a8c0f47-0e16-4e2b-bb3f-71caaffa8319 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:14.908347 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-36aa3228-aacc-4bae-9b44-3ef05b93ec6c tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5660f7f9d86f473eaa83e2be362ca63c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e883d7e73084efeb725945ae0bab317', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:57:14.916646 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-36aa3228-aacc-4bae-9b44-3ef05b93ec6c tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] 10.222.0.18 "GET /compute/v2.1/servers/18183d64-42b7-4b9f-9bca-6d018f17eeb3" status: 200 len: 1329 microversion: 2.1 time: 0.468231 Oct 22 20:57:14.917284 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1019/1955] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:57:14 2022] GET /compute/v2.1/servers/18183d64-42b7-4b9f-9bca-6d018f17eeb3 => generated 1329 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:57:14.922269 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-1ed91443-4e8f-4a86-b7e1-6f0313a78523 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:57:14.922784 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-1ed91443-4e8f-4a86-b7e1-6f0313a78523 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] [instance: 7c5c7ad1-4e7b-427e-8f66-862cc9b2f457] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:57:14.929102 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1ed91443-4e8f-4a86-b7e1-6f0313a78523 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:14.929634 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1ed91443-4e8f-4a86-b7e1-6f0313a78523 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:14.930060 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1ed91443-4e8f-4a86-b7e1-6f0313a78523 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:14.930464 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-1a8c0f47-0e16-4e2b-bb3f-71caaffa8319 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d3d7458af447bdb3f03e83a2d8559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49238b8686d24ae698679e4a1957735d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:57:14.930762 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1ed91443-4e8f-4a86-b7e1-6f0313a78523 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:14.931405 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1ed91443-4e8f-4a86-b7e1-6f0313a78523 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:14.931838 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1ed91443-4e8f-4a86-b7e1-6f0313a78523 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:14.939141 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-1a8c0f47-0e16-4e2b-bb3f-71caaffa8319 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] 10.222.0.18 "GET /compute/v2.1/servers/aee36c9d-baf4-453c-b88f-31b8f23638c2" status: 200 len: 1379 microversion: 2.1 time: 0.319414 Oct 22 20:57:14.939806 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 937/1956] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:57:14 2022] GET /compute/v2.1/servers/aee36c9d-baf4-453c-b88f-31b8f23638c2 => generated 1379 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:57:14.945062 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-cb4e37f4-7706-4494-9143-e0775464ee04 tempest-ServerMetadataNegativeTestJSON-1253820515 tempest-ServerMetadataNegativeTestJSON-1253820515-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:57:14.945718 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-cb4e37f4-7706-4494-9143-e0775464ee04 tempest-ServerMetadataNegativeTestJSON-1253820515 tempest-ServerMetadataNegativeTestJSON-1253820515-project] [instance: f72bf3c6-87b1-47d0-9b77-2043dcab1d0e] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:57:14.951596 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-cb4e37f4-7706-4494-9143-e0775464ee04 tempest-ServerMetadataNegativeTestJSON-1253820515 tempest-ServerMetadataNegativeTestJSON-1253820515-project] HTTP exception thrown: Instance f72bf3c6-87b1-47d0-9b77-2043dcab1d0e could not be found. Oct 22 20:57:14.959703 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-cb4e37f4-7706-4494-9143-e0775464ee04 tempest-ServerMetadataNegativeTestJSON-1253820515 tempest-ServerMetadataNegativeTestJSON-1253820515-project] Request method failure captured: Oct 22 20:57:14.959703 ncdv-master-1 devstack@n-api.service[138744]: request: GET /compute/v2.1/servers/f72bf3c6-87b1-47d0-9b77-2043dcab1d0e/metadata HTTP/1.1 Oct 22 20:57:14.959703 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 20:57:14.959703 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 20:57:14.959703 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 20:57:14.959703 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 0 Oct 22 20:57:14.959703 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 20:57:14.959703 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 20:57:14.959703 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 20:57:14.959703 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 20:57:14.959703 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVFkP-OPnnJAqnv5Vl_qiDumPkYSxzD6Lkt4grXBrubAE37i2toaOx27e7DT0jWmvJcWzGKhPXwpF_4K4K5_s49zBmjXAp7bRtL2teV862hikPRv-Oqdp2Z9FAOqZaslMfFN4lsF_zKvB0takdeeasPQ-TSWheMbUTyBE7r1aeYOttEE Oct 22 20:57:14.959703 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 20:57:14.959703 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 20:57:14.959703 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 20:57:14.959703 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 20:57:14.959703 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 20:57:14.959703 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 20:57:14.959703 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: 9be467d2547d46089b833ae4b5f9dd05 Oct 22 20:57:14.959703 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1253820515 Oct 22 20:57:14.959703 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 20:57:14.959703 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 20:57:14.959703 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_9be467d2547d46089b833ae4b5f9dd05"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9be467d2547d46089b833ae4b5f9dd05"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/9be467d2547d46089b833ae4b5f9dd05"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9be467d2547d46089b833ae4b5f9dd05"}]}] Oct 22 20:57:14.959703 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1253820515 Oct 22 20:57:14.959703 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: 9be467d2547d46089b833ae4b5f9dd05 Oct 22 20:57:14.959703 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1253820515 Oct 22 20:57:14.959703 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-ServerMetadataNegativeTestJSON-1253820515-project Oct 22 20:57:14.959703 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 20:57:14.959703 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 20:57:14.959703 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: 153f7059fd924dc5b19f323e0a400381 Oct 22 20:57:14.959703 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1253820515-project Oct 22 20:57:14.959703 ncdv-master-1 devstack@n-api.service[138744]: method: > Oct 22 20:57:14.959703 ncdv-master-1 devstack@n-api.service[138744]: exception: Instance f72bf3c6-87b1-47d0-9b77-2043dcab1d0e could not be found. Oct 22 20:57:14.959703 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'server_id': 'f72bf3c6-87b1-47d0-9b77-2043dcab1d0e'} Oct 22 20:57:14.959703 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:57:14.959703 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:57:14.959703 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 20:57:14.959703 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 20:57:14.959703 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 20:57:14.959703 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 20:57:14.959703 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 22 20:57:14.959703 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 22 20:57:14.959703 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f72bf3c6-87b1-47d0-9b77-2043dcab1d0e could not be found. Oct 22 20:57:14.959703 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:57:14.959703 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:57:14.959703 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:57:14.959703 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:57:14.959703 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:57:14.959703 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:57:14.959703 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:57:14.959703 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:57:14.959703 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:57:14.959703 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:57:14.959703 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 54, in index Oct 22 20:57:14.959703 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Oct 22 20:57:14.959703 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 20:57:14.959703 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 20:57:14.959703 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f72bf3c6-87b1-47d0-9b77-2043dcab1d0e could not be found. Oct 22 20:57:14.959703 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:57:14.959703 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:57:14.959703 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:57:14.959703 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:57:14.959703 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:57:14.959703 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:57:14.963487 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 20:57:14.963487 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 20:57:14.963487 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f72bf3c6-87b1-47d0-9b77-2043dcab1d0e could not be found. Oct 22 20:57:14.963487 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:57:14.963487 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-cb4e37f4-7706-4494-9143-e0775464ee04 tempest-ServerMetadataNegativeTestJSON-1253820515 tempest-ServerMetadataNegativeTestJSON-1253820515-project] Returning 404 to user: Instance f72bf3c6-87b1-47d0-9b77-2043dcab1d0e could not be found. {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:57:14.963487 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-cb4e37f4-7706-4494-9143-e0775464ee04 tempest-ServerMetadataNegativeTestJSON-1253820515 tempest-ServerMetadataNegativeTestJSON-1253820515-project] 10.222.0.18 "GET /compute/v2.1/servers/f72bf3c6-87b1-47d0-9b77-2043dcab1d0e/metadata" status: 404 len: 111 microversion: 2.1 time: 0.020328 Oct 22 20:57:14.963487 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 938/1957] 10.222.0.18 () {58 vars in 1263 bytes} [Sat Oct 22 20:57:14 2022] GET /compute/v2.1/servers/f72bf3c6-87b1-47d0-9b77-2043dcab1d0e/metadata => generated 111 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 20:57:15.035774 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-0728c037-fa6f-4838-88e3-e66aaf702734 tempest-ServerMetadataNegativeTestJSON-1253820515 tempest-ServerMetadataNegativeTestJSON-1253820515-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-578909861", "imageRef": "085e4478-6edc-4a69-8e08-f9831713eb65", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "b12dbc60-e91e-47e6-b028-a9d8abe94afd"}]}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:57:15.040942 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-0728c037-fa6f-4838-88e3-e66aaf702734 tempest-ServerMetadataNegativeTestJSON-1253820515 tempest-ServerMetadataNegativeTestJSON-1253820515-project] Request method failure captured: Oct 22 20:57:15.040942 ncdv-master-1 devstack@n-api.service[138744]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 22 20:57:15.040942 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 20:57:15.040942 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 20:57:15.040942 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 20:57:15.040942 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 498 Oct 22 20:57:15.040942 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 20:57:15.040942 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 20:57:15.040942 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 20:57:15.040942 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 20:57:15.040942 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVFkP-OPnnJAqnv5Vl_qiDumPkYSxzD6Lkt4grXBrubAE37i2toaOx27e7DT0jWmvJcWzGKhPXwpF_4K4K5_s49zBmjXAp7bRtL2teV862hikPRv-Oqdp2Z9FAOqZaslMfFN4lsF_zKvB0takdeeasPQ-TSWheMbUTyBE7r1aeYOttEE Oct 22 20:57:15.040942 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 20:57:15.040942 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 20:57:15.040942 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 20:57:15.040942 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 20:57:15.040942 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 20:57:15.040942 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 20:57:15.040942 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: 9be467d2547d46089b833ae4b5f9dd05 Oct 22 20:57:15.040942 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1253820515 Oct 22 20:57:15.040942 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 20:57:15.040942 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 20:57:15.040942 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_9be467d2547d46089b833ae4b5f9dd05"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9be467d2547d46089b833ae4b5f9dd05"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/9be467d2547d46089b833ae4b5f9dd05"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9be467d2547d46089b833ae4b5f9dd05"}]}] Oct 22 20:57:15.040942 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1253820515 Oct 22 20:57:15.040942 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: 9be467d2547d46089b833ae4b5f9dd05 Oct 22 20:57:15.040942 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1253820515 Oct 22 20:57:15.040942 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-ServerMetadataNegativeTestJSON-1253820515-project Oct 22 20:57:15.040942 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 20:57:15.040942 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 20:57:15.040942 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: 153f7059fd924dc5b19f323e0a400381 Oct 22 20:57:15.040942 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1253820515-project Oct 22 20:57:15.040942 ncdv-master-1 devstack@n-api.service[138744]: Oct 22 20:57:15.040942 ncdv-master-1 devstack@n-api.service[138744]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-578909861", "imageRef": "085e4478-6edc-4a69-8e08-f9831713eb65", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "b12dbc60-e91e-47e6-b028-a9d8abe94afd"}]}} Oct 22 20:57:15.040942 ncdv-master-1 devstack@n-api.service[138744]: method: > Oct 22 20:57:15.040942 ncdv-master-1 devstack@n-api.service[138744]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 22 20:57:15.040942 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-578909861', 'imageRef': '085e4478-6edc-4a69-8e08-f9831713eb65', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': 'b12dbc60-e91e-47e6-b028-a9d8abe94afd'}]}}} Oct 22 20:57:15.040942 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:57:15.040942 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:57:15.040942 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 22 20:57:15.040942 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 22 20:57:15.040942 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 22 20:57:15.040942 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise error Oct 22 20:57:15.040942 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 22 20:57:15.040942 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:57:15.040942 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 22 20:57:15.040942 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 22 20:57:15.040942 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 22 20:57:15.040942 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 22 20:57:15.043874 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 22 20:57:15.043874 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:57:15.043874 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 22 20:57:15.043874 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 22 20:57:15.043874 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:57:15.043874 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:57:15.043874 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:57:15.043874 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:57:15.043874 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:57:15.043874 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:57:15.043874 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:57:15.043874 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:57:15.043874 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:57:15.043874 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:57:15.043874 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 20:57:15.043874 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 20:57:15.043874 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 22 20:57:15.043874 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 22 20:57:15.043874 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 22 20:57:15.043874 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 22 20:57:15.043874 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 22 20:57:15.043874 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 22 20:57:15.043874 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 22 20:57:15.043874 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:57:15.043874 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:57:15.043874 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:57:15.043874 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:57:15.043874 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:57:15.043874 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:57:15.043874 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 22 20:57:15.043874 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 22 20:57:15.043874 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 22 20:57:15.043874 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:57:15.046411 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-0728c037-fa6f-4838-88e3-e66aaf702734 tempest-ServerMetadataNegativeTestJSON-1253820515 tempest-ServerMetadataNegativeTestJSON-1253820515-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:57:15.047267 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-0728c037-fa6f-4838-88e3-e66aaf702734 tempest-ServerMetadataNegativeTestJSON-1253820515 tempest-ServerMetadataNegativeTestJSON-1253820515-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 400 len: 687 microversion: 2.1 time: 0.015889 Oct 22 20:57:15.047914 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 939/1958] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Oct 22 20:57:15 2022] POST /compute/v2.1/servers => generated 687 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 22 20:57:15.099587 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-dca575f2-e11a-4fb9-96a1-6d21539c009d tempest-ServerMetadataNegativeTestJSON-1253820515 tempest-ServerMetadataNegativeTestJSON-1253820515-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-740059910", "imageRef": "085e4478-6edc-4a69-8e08-f9831713eb65", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "b12dbc60-e91e-47e6-b028-a9d8abe94afd"}]}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:57:15.104505 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-dca575f2-e11a-4fb9-96a1-6d21539c009d tempest-ServerMetadataNegativeTestJSON-1253820515 tempest-ServerMetadataNegativeTestJSON-1253820515-project] Request method failure captured: Oct 22 20:57:15.104505 ncdv-master-1 devstack@n-api.service[138744]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 22 20:57:15.104505 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 20:57:15.104505 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 20:57:15.104505 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 20:57:15.104505 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 499 Oct 22 20:57:15.104505 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 20:57:15.104505 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 20:57:15.104505 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 20:57:15.104505 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 20:57:15.104505 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVFkP-OPnnJAqnv5Vl_qiDumPkYSxzD6Lkt4grXBrubAE37i2toaOx27e7DT0jWmvJcWzGKhPXwpF_4K4K5_s49zBmjXAp7bRtL2teV862hikPRv-Oqdp2Z9FAOqZaslMfFN4lsF_zKvB0takdeeasPQ-TSWheMbUTyBE7r1aeYOttEE Oct 22 20:57:15.104505 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 20:57:15.104505 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 20:57:15.104505 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 20:57:15.104505 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 20:57:15.104505 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 20:57:15.104505 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 20:57:15.104505 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: 9be467d2547d46089b833ae4b5f9dd05 Oct 22 20:57:15.104505 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1253820515 Oct 22 20:57:15.104505 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 20:57:15.104505 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 20:57:15.104505 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_9be467d2547d46089b833ae4b5f9dd05"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9be467d2547d46089b833ae4b5f9dd05"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/9be467d2547d46089b833ae4b5f9dd05"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9be467d2547d46089b833ae4b5f9dd05"}]}] Oct 22 20:57:15.104505 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1253820515 Oct 22 20:57:15.104505 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: 9be467d2547d46089b833ae4b5f9dd05 Oct 22 20:57:15.104505 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1253820515 Oct 22 20:57:15.104505 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-ServerMetadataNegativeTestJSON-1253820515-project Oct 22 20:57:15.104505 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 20:57:15.104505 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 20:57:15.104505 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: 153f7059fd924dc5b19f323e0a400381 Oct 22 20:57:15.104505 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1253820515-project Oct 22 20:57:15.104505 ncdv-master-1 devstack@n-api.service[138744]: Oct 22 20:57:15.104505 ncdv-master-1 devstack@n-api.service[138744]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-740059910", "imageRef": "085e4478-6edc-4a69-8e08-f9831713eb65", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "b12dbc60-e91e-47e6-b028-a9d8abe94afd"}]}} Oct 22 20:57:15.104505 ncdv-master-1 devstack@n-api.service[138744]: method: > Oct 22 20:57:15.104505 ncdv-master-1 devstack@n-api.service[138744]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 22 20:57:15.104505 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-740059910', 'imageRef': '085e4478-6edc-4a69-8e08-f9831713eb65', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': 'b12dbc60-e91e-47e6-b028-a9d8abe94afd'}]}}} Oct 22 20:57:15.104505 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:57:15.104505 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:57:15.104505 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 22 20:57:15.104505 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 22 20:57:15.104505 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 22 20:57:15.104505 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise error Oct 22 20:57:15.104505 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 22 20:57:15.104505 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:57:15.104505 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 22 20:57:15.104505 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 22 20:57:15.104505 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 22 20:57:15.104505 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 22 20:57:15.107747 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 22 20:57:15.107747 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:57:15.107747 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 22 20:57:15.107747 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 22 20:57:15.107747 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:57:15.107747 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:57:15.107747 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:57:15.107747 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:57:15.107747 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:57:15.107747 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:57:15.107747 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:57:15.107747 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:57:15.107747 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:57:15.107747 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:57:15.107747 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 20:57:15.107747 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 20:57:15.107747 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 22 20:57:15.107747 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 22 20:57:15.107747 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 22 20:57:15.107747 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 22 20:57:15.107747 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 22 20:57:15.107747 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 22 20:57:15.107747 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 22 20:57:15.107747 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:57:15.107747 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:57:15.107747 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:57:15.107747 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:57:15.107747 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:57:15.107747 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:57:15.107747 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 22 20:57:15.107747 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 22 20:57:15.107747 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 22 20:57:15.107747 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:57:15.107747 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-dca575f2-e11a-4fb9-96a1-6d21539c009d tempest-ServerMetadataNegativeTestJSON-1253820515 tempest-ServerMetadataNegativeTestJSON-1253820515-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:57:15.107747 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-dca575f2-e11a-4fb9-96a1-6d21539c009d tempest-ServerMetadataNegativeTestJSON-1253820515 tempest-ServerMetadataNegativeTestJSON-1253820515-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 400 len: 689 microversion: 2.1 time: 0.012939 Oct 22 20:57:15.111509 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 940/1959] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Oct 22 20:57:15 2022] POST /compute/v2.1/servers => generated 689 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 22 20:57:15.112247 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-1ed91443-4e8f-4a86-b7e1-6f0313a78523 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dbe89a7e11480194d3d86f82983499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8351b01e07cd43f9be973ab45e522bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:57:15.117022 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-c92d6ae5-86b7-4142-a216-3f871c8679ff tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:57:15.117645 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-c92d6ae5-86b7-4142-a216-3f871c8679ff tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] [instance: 5fadabfa-64f5-4c20-9778-b986d965a632] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:57:15.120687 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-1ed91443-4e8f-4a86-b7e1-6f0313a78523 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] 10.222.0.18 "GET /compute/v2.1/servers/7c5c7ad1-4e7b-427e-8f66-862cc9b2f457" status: 200 len: 1313 microversion: 2.1 time: 0.202379 Oct 22 20:57:15.121444 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1020/1960] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:57:14 2022] GET /compute/v2.1/servers/7c5c7ad1-4e7b-427e-8f66-862cc9b2f457 => generated 1313 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:57:15.124888 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c92d6ae5-86b7-4142-a216-3f871c8679ff tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:15.125381 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c92d6ae5-86b7-4142-a216-3f871c8679ff tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:15.125873 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c92d6ae5-86b7-4142-a216-3f871c8679ff tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:15.126573 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c92d6ae5-86b7-4142-a216-3f871c8679ff tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:15.127023 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c92d6ae5-86b7-4142-a216-3f871c8679ff tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:15.127471 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c92d6ae5-86b7-4142-a216-3f871c8679ff tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:15.158594 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-6001e148-1113-40a0-9915-07ab890ade43 tempest-ServerMetadataNegativeTestJSON-1253820515 tempest-ServerMetadataNegativeTestJSON-1253820515-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-20904083", "imageRef": "085e4478-6edc-4a69-8e08-f9831713eb65", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "b12dbc60-e91e-47e6-b028-a9d8abe94afd"}]}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:57:15.163455 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-6001e148-1113-40a0-9915-07ab890ade43 tempest-ServerMetadataNegativeTestJSON-1253820515 tempest-ServerMetadataNegativeTestJSON-1253820515-project] Request method failure captured: Oct 22 20:57:15.163455 ncdv-master-1 devstack@n-api.service[138745]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 22 20:57:15.163455 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 20:57:15.163455 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 20:57:15.163455 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 20:57:15.163455 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 752 Oct 22 20:57:15.163455 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 20:57:15.163455 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 20:57:15.163455 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 20:57:15.163455 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 20:57:15.163455 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVFkP-OPnnJAqnv5Vl_qiDumPkYSxzD6Lkt4grXBrubAE37i2toaOx27e7DT0jWmvJcWzGKhPXwpF_4K4K5_s49zBmjXAp7bRtL2teV862hikPRv-Oqdp2Z9FAOqZaslMfFN4lsF_zKvB0takdeeasPQ-TSWheMbUTyBE7r1aeYOttEE Oct 22 20:57:15.163455 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 20:57:15.163455 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 20:57:15.163455 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 20:57:15.163455 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 20:57:15.163455 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 20:57:15.163455 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 20:57:15.163455 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: 9be467d2547d46089b833ae4b5f9dd05 Oct 22 20:57:15.163455 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1253820515 Oct 22 20:57:15.163455 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 20:57:15.163455 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 20:57:15.163455 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_9be467d2547d46089b833ae4b5f9dd05"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9be467d2547d46089b833ae4b5f9dd05"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/9be467d2547d46089b833ae4b5f9dd05"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9be467d2547d46089b833ae4b5f9dd05"}]}] Oct 22 20:57:15.163455 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1253820515 Oct 22 20:57:15.163455 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: 9be467d2547d46089b833ae4b5f9dd05 Oct 22 20:57:15.163455 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1253820515 Oct 22 20:57:15.163455 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-ServerMetadataNegativeTestJSON-1253820515-project Oct 22 20:57:15.163455 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 20:57:15.163455 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 20:57:15.163455 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: 153f7059fd924dc5b19f323e0a400381 Oct 22 20:57:15.163455 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1253820515-project Oct 22 20:57:15.163455 ncdv-master-1 devstack@n-api.service[138745]: Oct 22 20:57:15.163455 ncdv-master-1 devstack@n-api.service[138745]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-20904083", "imageRef": "085e4478-6edc-4a69-8e08-f9831713eb65", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "b12dbc60-e91e-47e6-b028-a9d8abe94afd"}]}} Oct 22 20:57:15.163455 ncdv-master-1 devstack@n-api.service[138745]: method: > Oct 22 20:57:15.163455 ncdv-master-1 devstack@n-api.service[138745]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 22 20:57:15.163455 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-20904083', 'imageRef': '085e4478-6edc-4a69-8e08-f9831713eb65', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': 'b12dbc60-e91e-47e6-b028-a9d8abe94afd'}]}}} Oct 22 20:57:15.163455 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:57:15.163455 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:57:15.163455 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 22 20:57:15.163455 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 22 20:57:15.163455 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 22 20:57:15.166117 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise error Oct 22 20:57:15.166117 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 22 20:57:15.166117 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:57:15.166117 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 22 20:57:15.166117 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 22 20:57:15.166117 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 22 20:57:15.166117 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 22 20:57:15.166117 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 22 20:57:15.166117 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:57:15.166117 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 22 20:57:15.166117 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 22 20:57:15.166117 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:57:15.166117 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:57:15.166117 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:57:15.166117 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:57:15.166117 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:57:15.166117 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:57:15.166117 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:57:15.166117 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:57:15.166117 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:57:15.166117 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:57:15.166117 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 20:57:15.166117 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 20:57:15.166117 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 22 20:57:15.166117 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 22 20:57:15.166117 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 22 20:57:15.166117 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 22 20:57:15.166117 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 22 20:57:15.166117 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 22 20:57:15.166117 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 22 20:57:15.166117 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:57:15.166117 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:57:15.166117 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:57:15.166117 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:57:15.166117 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:57:15.166117 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:57:15.166117 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 22 20:57:15.166117 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 22 20:57:15.168885 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 22 20:57:15.168885 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:57:15.168885 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-6001e148-1113-40a0-9915-07ab890ade43 tempest-ServerMetadataNegativeTestJSON-1253820515 tempest-ServerMetadataNegativeTestJSON-1253820515-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:57:15.168885 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-6001e148-1113-40a0-9915-07ab890ade43 tempest-ServerMetadataNegativeTestJSON-1253820515 tempest-ServerMetadataNegativeTestJSON-1253820515-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 400 len: 1197 microversion: 2.1 time: 0.010536 Oct 22 20:57:15.168885 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1021/1961] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Oct 22 20:57:15 2022] POST /compute/v2.1/servers => generated 1197 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 382 bytes (2 switches on core 0) Oct 22 20:57:15.216883 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-f8c1a031-d708-4358-854b-2baa69fc3aba tempest-ServerMetadataNegativeTestJSON-1253820515 tempest-ServerMetadataNegativeTestJSON-1253820515-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1113607180", "imageRef": "085e4478-6edc-4a69-8e08-f9831713eb65", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "b12dbc60-e91e-47e6-b028-a9d8abe94afd"}]}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:57:15.221667 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-f8c1a031-d708-4358-854b-2baa69fc3aba tempest-ServerMetadataNegativeTestJSON-1253820515 tempest-ServerMetadataNegativeTestJSON-1253820515-project] Request method failure captured: Oct 22 20:57:15.221667 ncdv-master-1 devstack@n-api.service[138745]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 22 20:57:15.221667 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 20:57:15.221667 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 20:57:15.221667 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 20:57:15.221667 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 1266 Oct 22 20:57:15.221667 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 20:57:15.221667 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 20:57:15.221667 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 20:57:15.221667 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 20:57:15.221667 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVFkP-OPnnJAqnv5Vl_qiDumPkYSxzD6Lkt4grXBrubAE37i2toaOx27e7DT0jWmvJcWzGKhPXwpF_4K4K5_s49zBmjXAp7bRtL2teV862hikPRv-Oqdp2Z9FAOqZaslMfFN4lsF_zKvB0takdeeasPQ-TSWheMbUTyBE7r1aeYOttEE Oct 22 20:57:15.221667 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 20:57:15.221667 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 20:57:15.221667 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 20:57:15.221667 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 20:57:15.221667 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 20:57:15.221667 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 20:57:15.221667 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: 9be467d2547d46089b833ae4b5f9dd05 Oct 22 20:57:15.221667 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1253820515 Oct 22 20:57:15.221667 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 20:57:15.221667 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 20:57:15.221667 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_9be467d2547d46089b833ae4b5f9dd05"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9be467d2547d46089b833ae4b5f9dd05"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/9be467d2547d46089b833ae4b5f9dd05"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9be467d2547d46089b833ae4b5f9dd05"}]}] Oct 22 20:57:15.221667 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1253820515 Oct 22 20:57:15.221667 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: 9be467d2547d46089b833ae4b5f9dd05 Oct 22 20:57:15.221667 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1253820515 Oct 22 20:57:15.221667 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-ServerMetadataNegativeTestJSON-1253820515-project Oct 22 20:57:15.221667 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 20:57:15.221667 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 20:57:15.221667 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: 153f7059fd924dc5b19f323e0a400381 Oct 22 20:57:15.221667 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1253820515-project Oct 22 20:57:15.221667 ncdv-master-1 devstack@n-api.service[138745]: Oct 22 20:57:15.221667 ncdv-master-1 devstack@n-api.service[138745]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1113607180", "imageRef": "085e4478-6edc-4a69-8e08-f9831713eb65", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "b12dbc60-e91e-47e6-b028-a9d8abe94afd"}]}} Oct 22 20:57:15.221667 ncdv-master-1 devstack@n-api.service[138745]: method: > Oct 22 20:57:15.223773 ncdv-master-1 devstack@n-api.service[138745]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 22 20:57:15.223773 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1113607180', 'imageRef': '085e4478-6edc-4a69-8e08-f9831713eb65', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': 'b12dbc60-e91e-47e6-b028-a9d8abe94afd'}]}}} Oct 22 20:57:15.223773 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:57:15.223773 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:57:15.223773 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 22 20:57:15.223773 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 22 20:57:15.223773 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 22 20:57:15.223773 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise error Oct 22 20:57:15.223773 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 22 20:57:15.223773 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:57:15.223773 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 22 20:57:15.223773 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 22 20:57:15.223773 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 22 20:57:15.223773 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 22 20:57:15.223773 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 22 20:57:15.223773 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:57:15.223773 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 22 20:57:15.224841 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 22 20:57:15.224841 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:57:15.224841 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:57:15.224841 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:57:15.224841 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:57:15.224841 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:57:15.224841 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:57:15.224841 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:57:15.224841 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:57:15.224841 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:57:15.224841 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:57:15.224841 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 20:57:15.224841 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 20:57:15.224841 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 22 20:57:15.224841 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 22 20:57:15.224841 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 22 20:57:15.224841 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 22 20:57:15.224841 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 22 20:57:15.224841 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 22 20:57:15.224841 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 22 20:57:15.224841 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:57:15.224841 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:57:15.224841 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:57:15.224841 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:57:15.224841 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:57:15.224841 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:57:15.224841 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 22 20:57:15.224841 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 22 20:57:15.226883 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 22 20:57:15.226883 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:57:15.226883 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-f8c1a031-d708-4358-854b-2baa69fc3aba tempest-ServerMetadataNegativeTestJSON-1253820515 tempest-ServerMetadataNegativeTestJSON-1253820515-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:57:15.226883 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-f8c1a031-d708-4358-854b-2baa69fc3aba tempest-ServerMetadataNegativeTestJSON-1253820515 tempest-ServerMetadataNegativeTestJSON-1253820515-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 400 len: 2221 microversion: 2.1 time: 0.012229 Oct 22 20:57:15.227202 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1022/1962] 10.222.0.18 () {60 vars in 1148 bytes} [Sat Oct 22 20:57:15 2022] POST /compute/v2.1/servers => generated 2221 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Oct 22 20:57:15.238061 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-5f2e5a4e-a68f-401f-b4bd-f23e0536e1d6 tempest-ServerMetadataNegativeTestJSON-1253820515 tempest-ServerMetadataNegativeTestJSON-1253820515-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:57:15.238557 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-5f2e5a4e-a68f-401f-b4bd-f23e0536e1d6 tempest-ServerMetadataNegativeTestJSON-1253820515 tempest-ServerMetadataNegativeTestJSON-1253820515-project] [instance: b5aefabb-c1c8-47ba-bc00-dc00d1339526] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:57:15.244229 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.wsgi [None req-5f2e5a4e-a68f-401f-b4bd-f23e0536e1d6 tempest-ServerMetadataNegativeTestJSON-1253820515 tempest-ServerMetadataNegativeTestJSON-1253820515-project] HTTP exception thrown: Instance b5aefabb-c1c8-47ba-bc00-dc00d1339526 could not be found. Oct 22 20:57:15.245969 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-5f2e5a4e-a68f-401f-b4bd-f23e0536e1d6 tempest-ServerMetadataNegativeTestJSON-1253820515 tempest-ServerMetadataNegativeTestJSON-1253820515-project] Request method failure captured: Oct 22 20:57:15.245969 ncdv-master-1 devstack@n-api.service[138745]: request: GET /compute/v2.1/servers/b5aefabb-c1c8-47ba-bc00-dc00d1339526/metadata/test2 HTTP/1.1 Oct 22 20:57:15.245969 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 20:57:15.245969 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 20:57:15.245969 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 20:57:15.245969 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 0 Oct 22 20:57:15.245969 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 20:57:15.245969 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 20:57:15.245969 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 20:57:15.245969 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 20:57:15.245969 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVFkP-OPnnJAqnv5Vl_qiDumPkYSxzD6Lkt4grXBrubAE37i2toaOx27e7DT0jWmvJcWzGKhPXwpF_4K4K5_s49zBmjXAp7bRtL2teV862hikPRv-Oqdp2Z9FAOqZaslMfFN4lsF_zKvB0takdeeasPQ-TSWheMbUTyBE7r1aeYOttEE Oct 22 20:57:15.245969 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 20:57:15.245969 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 20:57:15.245969 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 20:57:15.245969 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 20:57:15.245969 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 20:57:15.245969 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 20:57:15.245969 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: 9be467d2547d46089b833ae4b5f9dd05 Oct 22 20:57:15.245969 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1253820515 Oct 22 20:57:15.245969 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 20:57:15.245969 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 20:57:15.245969 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_9be467d2547d46089b833ae4b5f9dd05"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9be467d2547d46089b833ae4b5f9dd05"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/9be467d2547d46089b833ae4b5f9dd05"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9be467d2547d46089b833ae4b5f9dd05"}]}] Oct 22 20:57:15.245969 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1253820515 Oct 22 20:57:15.245969 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: 9be467d2547d46089b833ae4b5f9dd05 Oct 22 20:57:15.245969 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1253820515 Oct 22 20:57:15.245969 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-ServerMetadataNegativeTestJSON-1253820515-project Oct 22 20:57:15.245969 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 20:57:15.245969 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 20:57:15.245969 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: 153f7059fd924dc5b19f323e0a400381 Oct 22 20:57:15.245969 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1253820515-project Oct 22 20:57:15.245969 ncdv-master-1 devstack@n-api.service[138745]: method: > Oct 22 20:57:15.245969 ncdv-master-1 devstack@n-api.service[138745]: exception: Instance b5aefabb-c1c8-47ba-bc00-dc00d1339526 could not be found. Oct 22 20:57:15.245969 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'server_id': 'b5aefabb-c1c8-47ba-bc00-dc00d1339526', 'id': 'test2'} Oct 22 20:57:15.245969 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:57:15.245969 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:57:15.245969 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 20:57:15.245969 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 20:57:15.245969 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 20:57:15.245969 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 20:57:15.245969 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 22 20:57:15.245969 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 22 20:57:15.245969 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b5aefabb-c1c8-47ba-bc00-dc00d1339526 could not be found. Oct 22 20:57:15.245969 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:57:15.245969 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:57:15.245969 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:57:15.245969 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:57:15.245969 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:57:15.245969 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:57:15.245969 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:57:15.245969 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:57:15.245969 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:57:15.245969 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:57:15.245969 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 129, in show Oct 22 20:57:15.245969 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Oct 22 20:57:15.245969 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 20:57:15.245969 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 20:57:15.245969 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b5aefabb-c1c8-47ba-bc00-dc00d1339526 could not be found. Oct 22 20:57:15.245969 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:57:15.245969 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:57:15.245969 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:57:15.245969 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:57:15.245969 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:57:15.245969 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:57:15.249468 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 20:57:15.249468 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 20:57:15.249468 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b5aefabb-c1c8-47ba-bc00-dc00d1339526 could not be found. Oct 22 20:57:15.249468 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:57:15.249468 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-5f2e5a4e-a68f-401f-b4bd-f23e0536e1d6 tempest-ServerMetadataNegativeTestJSON-1253820515 tempest-ServerMetadataNegativeTestJSON-1253820515-project] Returning 404 to user: Instance b5aefabb-c1c8-47ba-bc00-dc00d1339526 could not be found. {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:57:15.249468 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-5f2e5a4e-a68f-401f-b4bd-f23e0536e1d6 tempest-ServerMetadataNegativeTestJSON-1253820515 tempest-ServerMetadataNegativeTestJSON-1253820515-project] 10.222.0.18 "GET /compute/v2.1/servers/b5aefabb-c1c8-47ba-bc00-dc00d1339526/metadata/test2" status: 404 len: 111 microversion: 2.1 time: 0.014570 Oct 22 20:57:15.249468 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1023/1963] 10.222.0.18 () {58 vars in 1281 bytes} [Sat Oct 22 20:57:15 2022] GET /compute/v2.1/servers/b5aefabb-c1c8-47ba-bc00-dc00d1339526/metadata/test2 => generated 111 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 20:57:15.263206 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-6326d046-dfbf-463e-84dc-ac4479aaf2a2 tempest-ServerMetadataNegativeTestJSON-1253820515 tempest-ServerMetadataNegativeTestJSON-1253820515-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:57:15.263732 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-6326d046-dfbf-463e-84dc-ac4479aaf2a2 tempest-ServerMetadataNegativeTestJSON-1253820515 tempest-ServerMetadataNegativeTestJSON-1253820515-project] [instance: 674e9bd2-7dfd-4854-83e8-56d8970e56bc] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:57:15.268681 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-c92d6ae5-86b7-4142-a216-3f871c8679ff tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b392ad1fe1fd4b2a9e6be03a7435deb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594624ed28aa433d907c8833d360b82e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:57:15.270211 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6326d046-dfbf-463e-84dc-ac4479aaf2a2 tempest-ServerMetadataNegativeTestJSON-1253820515 tempest-ServerMetadataNegativeTestJSON-1253820515-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:15.270696 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6326d046-dfbf-463e-84dc-ac4479aaf2a2 tempest-ServerMetadataNegativeTestJSON-1253820515 tempest-ServerMetadataNegativeTestJSON-1253820515-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:15.271133 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6326d046-dfbf-463e-84dc-ac4479aaf2a2 tempest-ServerMetadataNegativeTestJSON-1253820515 tempest-ServerMetadataNegativeTestJSON-1253820515-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:15.271870 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6326d046-dfbf-463e-84dc-ac4479aaf2a2 tempest-ServerMetadataNegativeTestJSON-1253820515 tempest-ServerMetadataNegativeTestJSON-1253820515-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:15.272324 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6326d046-dfbf-463e-84dc-ac4479aaf2a2 tempest-ServerMetadataNegativeTestJSON-1253820515 tempest-ServerMetadataNegativeTestJSON-1253820515-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:15.272754 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6326d046-dfbf-463e-84dc-ac4479aaf2a2 tempest-ServerMetadataNegativeTestJSON-1253820515 tempest-ServerMetadataNegativeTestJSON-1253820515-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:15.277368 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-c92d6ae5-86b7-4142-a216-3f871c8679ff tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] 10.222.0.18 "GET /compute/v2.1/servers/5fadabfa-64f5-4c20-9778-b986d965a632" status: 200 len: 1324 microversion: 2.1 time: 0.164293 Oct 22 20:57:15.277957 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 941/1964] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:57:15 2022] GET /compute/v2.1/servers/5fadabfa-64f5-4c20-9778-b986d965a632 => generated 1324 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:57:15.298365 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-6326d046-dfbf-463e-84dc-ac4479aaf2a2 tempest-ServerMetadataNegativeTestJSON-1253820515 tempest-ServerMetadataNegativeTestJSON-1253820515-project] [instance: 674e9bd2-7dfd-4854-83e8-56d8970e56bc] Going to try to terminate instance {{(pid=138745) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 20:57:15.387290 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-6326d046-dfbf-463e-84dc-ac4479aaf2a2 tempest-ServerMetadataNegativeTestJSON-1253820515 tempest-ServerMetadataNegativeTestJSON-1253820515-project] 10.222.0.18 "DELETE /compute/v2.1/servers/674e9bd2-7dfd-4854-83e8-56d8970e56bc" status: 204 len: 0 microversion: 2.1 time: 0.129212 Oct 22 20:57:15.387906 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1024/1965] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 20:57:15 2022] DELETE /compute/v2.1/servers/674e9bd2-7dfd-4854-83e8-56d8970e56bc => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 20:57:15.396363 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-66e278f2-76f6-470e-aac8-a9e752fbf10f tempest-ServerMetadataNegativeTestJSON-1253820515 tempest-ServerMetadataNegativeTestJSON-1253820515-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:57:15.396975 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-66e278f2-76f6-470e-aac8-a9e752fbf10f tempest-ServerMetadataNegativeTestJSON-1253820515 tempest-ServerMetadataNegativeTestJSON-1253820515-project] [instance: 674e9bd2-7dfd-4854-83e8-56d8970e56bc] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:57:15.403332 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-66e278f2-76f6-470e-aac8-a9e752fbf10f tempest-ServerMetadataNegativeTestJSON-1253820515 tempest-ServerMetadataNegativeTestJSON-1253820515-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:15.403863 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-66e278f2-76f6-470e-aac8-a9e752fbf10f tempest-ServerMetadataNegativeTestJSON-1253820515 tempest-ServerMetadataNegativeTestJSON-1253820515-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:15.404303 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-66e278f2-76f6-470e-aac8-a9e752fbf10f tempest-ServerMetadataNegativeTestJSON-1253820515 tempest-ServerMetadataNegativeTestJSON-1253820515-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:15.405002 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-66e278f2-76f6-470e-aac8-a9e752fbf10f tempest-ServerMetadataNegativeTestJSON-1253820515 tempest-ServerMetadataNegativeTestJSON-1253820515-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:15.405445 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-66e278f2-76f6-470e-aac8-a9e752fbf10f tempest-ServerMetadataNegativeTestJSON-1253820515 tempest-ServerMetadataNegativeTestJSON-1253820515-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:15.405873 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-66e278f2-76f6-470e-aac8-a9e752fbf10f tempest-ServerMetadataNegativeTestJSON-1253820515 tempest-ServerMetadataNegativeTestJSON-1253820515-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:15.474325 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-94152f1a-80a5-4add-a560-4727ad2b8a75 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:57:15.474946 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-94152f1a-80a5-4add-a560-4727ad2b8a75 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] [instance: cc3236d7-3b9f-40f2-8a53-3096f986e87e] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:57:15.481583 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-94152f1a-80a5-4add-a560-4727ad2b8a75 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:15.482069 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-94152f1a-80a5-4add-a560-4727ad2b8a75 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:15.482504 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-94152f1a-80a5-4add-a560-4727ad2b8a75 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:15.483257 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-94152f1a-80a5-4add-a560-4727ad2b8a75 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:15.483785 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-94152f1a-80a5-4add-a560-4727ad2b8a75 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:15.484287 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-94152f1a-80a5-4add-a560-4727ad2b8a75 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:15.598068 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-66e278f2-76f6-470e-aac8-a9e752fbf10f tempest-ServerMetadataNegativeTestJSON-1253820515 tempest-ServerMetadataNegativeTestJSON-1253820515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153f7059fd924dc5b19f323e0a400381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be467d2547d46089b833ae4b5f9dd05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:57:15.607019 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-66e278f2-76f6-470e-aac8-a9e752fbf10f tempest-ServerMetadataNegativeTestJSON-1253820515 tempest-ServerMetadataNegativeTestJSON-1253820515-project] 10.222.0.18 "GET /compute/v2.1/servers/674e9bd2-7dfd-4854-83e8-56d8970e56bc" status: 200 len: 1527 microversion: 2.1 time: 0.214524 Oct 22 20:57:15.607647 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 942/1966] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:57:15 2022] GET /compute/v2.1/servers/674e9bd2-7dfd-4854-83e8-56d8970e56bc => generated 1527 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 20:57:15.621143 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-c29afa4f-8243-425c-bf23-78c8b6171ac7 req-f73c8bd2-1521-438e-ba4c-ecae91aa33ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5db8404-7c9d-41d4-a018-a27058378d35", "name": "network-vif-deleted", "tag": "cb9e18be-499d-410c-bbe2-d450122802d7"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:57:15.632876 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-c29afa4f-8243-425c-bf23-78c8b6171ac7 req-f73c8bd2-1521-438e-ba4c-ecae91aa33ef service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:15.633344 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-c29afa4f-8243-425c-bf23-78c8b6171ac7 req-f73c8bd2-1521-438e-ba4c-ecae91aa33ef service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:15.633970 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-c29afa4f-8243-425c-bf23-78c8b6171ac7 req-f73c8bd2-1521-438e-ba4c-ecae91aa33ef service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:15.650541 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-94152f1a-80a5-4add-a560-4727ad2b8a75 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d808e98f843dd9621822682c9d278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b58ab4af674c778b4819f177045651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:57:15.651740 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-c29afa4f-8243-425c-bf23-78c8b6171ac7 req-f73c8bd2-1521-438e-ba4c-ecae91aa33ef service nova] Creating event network-vif-deleted:cb9e18be-499d-410c-bbe2-d450122802d7 for instance c5db8404-7c9d-41d4-a018-a27058378d35 on nch2-master-1 Oct 22 20:57:15.658878 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-c29afa4f-8243-425c-bf23-78c8b6171ac7 req-f73c8bd2-1521-438e-ba4c-ecae91aa33ef service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049084 Oct 22 20:57:15.659095 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-94152f1a-80a5-4add-a560-4727ad2b8a75 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] 10.222.0.18 "GET /compute/v2.1/servers/cc3236d7-3b9f-40f2-8a53-3096f986e87e" status: 200 len: 1318 microversion: 2.1 time: 0.189161 Oct 22 20:57:15.659601 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1025/1967] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:57:15 2022] GET /compute/v2.1/servers/cc3236d7-3b9f-40f2-8a53-3096f986e87e => generated 1318 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:57:15.660109 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 943/1968] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:57:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:57:15.666842 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-30110b4a-155f-4af3-b5b4-f3fe7e1cd012 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:57:15.667476 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-30110b4a-155f-4af3-b5b4-f3fe7e1cd012 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] [instance: c5db8404-7c9d-41d4-a018-a27058378d35] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:57:15.674765 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-30110b4a-155f-4af3-b5b4-f3fe7e1cd012 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:15.675244 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-30110b4a-155f-4af3-b5b4-f3fe7e1cd012 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:15.675709 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-30110b4a-155f-4af3-b5b4-f3fe7e1cd012 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:15.676413 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-30110b4a-155f-4af3-b5b4-f3fe7e1cd012 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:15.676863 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-30110b4a-155f-4af3-b5b4-f3fe7e1cd012 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:15.677282 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-30110b4a-155f-4af3-b5b4-f3fe7e1cd012 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:15.711548 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-30110b4a-155f-4af3-b5b4-f3fe7e1cd012 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:15.712030 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-30110b4a-155f-4af3-b5b4-f3fe7e1cd012 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:15.712455 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-30110b4a-155f-4af3-b5b4-f3fe7e1cd012 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:15.712915 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.objects.instance [None req-30110b4a-155f-4af3-b5b4-f3fe7e1cd012 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lazy-loading 'fault' on Instance uuid c5db8404-7c9d-41d4-a018-a27058378d35 {{(pid=138745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 20:57:15.754595 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-30110b4a-155f-4af3-b5b4-f3fe7e1cd012 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e787e0b494764176a0f13d75c47d77fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '371ecb87e8d34859971be23c1a1bc443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:57:15.762294 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-30110b4a-155f-4af3-b5b4-f3fe7e1cd012 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] 10.222.0.18 "GET /compute/v2.1/servers/c5db8404-7c9d-41d4-a018-a27058378d35" status: 200 len: 1311 microversion: 2.1 time: 0.101735 Oct 22 20:57:15.762865 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1026/1969] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:57:15 2022] GET /compute/v2.1/servers/c5db8404-7c9d-41d4-a018-a27058378d35 => generated 1311 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:57:15.946117 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-2b4fcb94-a69e-4002-8868-7f8ce86e7c4a tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:57:15.947153 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-2b4fcb94-a69e-4002-8868-7f8ce86e7c4a tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] [instance: 18183d64-42b7-4b9f-9bca-6d018f17eeb3] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:57:15.954837 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2b4fcb94-a69e-4002-8868-7f8ce86e7c4a tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:15.957261 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2b4fcb94-a69e-4002-8868-7f8ce86e7c4a tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:15.957261 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2b4fcb94-a69e-4002-8868-7f8ce86e7c4a tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:15.957261 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2b4fcb94-a69e-4002-8868-7f8ce86e7c4a tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:15.957556 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2b4fcb94-a69e-4002-8868-7f8ce86e7c4a tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:15.957961 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2b4fcb94-a69e-4002-8868-7f8ce86e7c4a tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:15.962964 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-2af1517b-8ad1-4dce-948a-8ac29518c231 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:57:15.963561 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-2af1517b-8ad1-4dce-948a-8ac29518c231 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] [instance: aee36c9d-baf4-453c-b88f-31b8f23638c2] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:57:15.978428 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2af1517b-8ad1-4dce-948a-8ac29518c231 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:15.978922 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2af1517b-8ad1-4dce-948a-8ac29518c231 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:15.979391 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2af1517b-8ad1-4dce-948a-8ac29518c231 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:15.980103 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2af1517b-8ad1-4dce-948a-8ac29518c231 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:15.980557 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2af1517b-8ad1-4dce-948a-8ac29518c231 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:15.980979 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2af1517b-8ad1-4dce-948a-8ac29518c231 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:16.227161 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-2b4fcb94-a69e-4002-8868-7f8ce86e7c4a tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5660f7f9d86f473eaa83e2be362ca63c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e883d7e73084efeb725945ae0bab317', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:57:16.231378 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-2af1517b-8ad1-4dce-948a-8ac29518c231 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d3d7458af447bdb3f03e83a2d8559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49238b8686d24ae698679e4a1957735d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:57:16.236634 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-2b4fcb94-a69e-4002-8868-7f8ce86e7c4a tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] 10.222.0.18 "GET /compute/v2.1/servers/18183d64-42b7-4b9f-9bca-6d018f17eeb3" status: 200 len: 1329 microversion: 2.1 time: 0.296439 Oct 22 20:57:16.237301 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 944/1970] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:57:15 2022] GET /compute/v2.1/servers/18183d64-42b7-4b9f-9bca-6d018f17eeb3 => generated 1329 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:57:16.241887 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-1bc82ec0-8cbd-4535-9d16-0c1436aff19d tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:57:16.242734 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-1bc82ec0-8cbd-4535-9d16-0c1436aff19d tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] [instance: 7c5c7ad1-4e7b-427e-8f66-862cc9b2f457] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:57:16.249253 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1bc82ec0-8cbd-4535-9d16-0c1436aff19d tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:16.249737 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1bc82ec0-8cbd-4535-9d16-0c1436aff19d tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:16.250177 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1bc82ec0-8cbd-4535-9d16-0c1436aff19d tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:16.250871 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1bc82ec0-8cbd-4535-9d16-0c1436aff19d tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:16.251567 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1bc82ec0-8cbd-4535-9d16-0c1436aff19d tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:16.252672 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1bc82ec0-8cbd-4535-9d16-0c1436aff19d tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:16.256534 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-2af1517b-8ad1-4dce-948a-8ac29518c231 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] 10.222.0.18 "GET /compute/v2.1/servers/aee36c9d-baf4-453c-b88f-31b8f23638c2" status: 200 len: 1379 microversion: 2.1 time: 0.297312 Oct 22 20:57:16.257428 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1027/1971] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:57:15 2022] GET /compute/v2.1/servers/aee36c9d-baf4-453c-b88f-31b8f23638c2 => generated 1379 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:57:16.299799 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-2aa4139b-fa97-4113-9723-33aef062b96c tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:57:16.300821 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-2aa4139b-fa97-4113-9723-33aef062b96c tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] [instance: 5fadabfa-64f5-4c20-9778-b986d965a632] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:57:16.313537 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2aa4139b-fa97-4113-9723-33aef062b96c tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:16.315557 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2aa4139b-fa97-4113-9723-33aef062b96c tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:16.316168 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2aa4139b-fa97-4113-9723-33aef062b96c tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:16.317071 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2aa4139b-fa97-4113-9723-33aef062b96c tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:16.317714 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2aa4139b-fa97-4113-9723-33aef062b96c tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:16.318298 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2aa4139b-fa97-4113-9723-33aef062b96c tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:16.388042 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell0:SELECT=18 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:57:16.610097 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-1bc82ec0-8cbd-4535-9d16-0c1436aff19d tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dbe89a7e11480194d3d86f82983499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8351b01e07cd43f9be973ab45e522bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:57:16.617461 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-2aa4139b-fa97-4113-9723-33aef062b96c tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b392ad1fe1fd4b2a9e6be03a7435deb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594624ed28aa433d907c8833d360b82e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:57:16.618341 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-1bc82ec0-8cbd-4535-9d16-0c1436aff19d tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] 10.222.0.18 "GET /compute/v2.1/servers/7c5c7ad1-4e7b-427e-8f66-862cc9b2f457" status: 200 len: 1313 microversion: 2.1 time: 0.380012 Oct 22 20:57:16.619416 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 945/1972] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:57:16 2022] GET /compute/v2.1/servers/7c5c7ad1-4e7b-427e-8f66-862cc9b2f457 => generated 1313 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:57:16.630255 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-2aa4139b-fa97-4113-9723-33aef062b96c tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] 10.222.0.18 "GET /compute/v2.1/servers/5fadabfa-64f5-4c20-9778-b986d965a632" status: 200 len: 1324 microversion: 2.1 time: 0.334627 Oct 22 20:57:16.639650 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-39da672f-a751-45a2-b8b2-818224aabc99 tempest-ServerMetadataNegativeTestJSON-1253820515 tempest-ServerMetadataNegativeTestJSON-1253820515-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:57:16.640578 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-39da672f-a751-45a2-b8b2-818224aabc99 tempest-ServerMetadataNegativeTestJSON-1253820515 tempest-ServerMetadataNegativeTestJSON-1253820515-project] [instance: 674e9bd2-7dfd-4854-83e8-56d8970e56bc] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:57:16.641765 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1028/1973] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:57:16 2022] GET /compute/v2.1/servers/5fadabfa-64f5-4c20-9778-b986d965a632 => generated 1324 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 20:57:16.647367 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-39da672f-a751-45a2-b8b2-818224aabc99 tempest-ServerMetadataNegativeTestJSON-1253820515 tempest-ServerMetadataNegativeTestJSON-1253820515-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:16.647873 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-39da672f-a751-45a2-b8b2-818224aabc99 tempest-ServerMetadataNegativeTestJSON-1253820515 tempest-ServerMetadataNegativeTestJSON-1253820515-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:16.648284 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-39da672f-a751-45a2-b8b2-818224aabc99 tempest-ServerMetadataNegativeTestJSON-1253820515 tempest-ServerMetadataNegativeTestJSON-1253820515-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:16.649045 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-39da672f-a751-45a2-b8b2-818224aabc99 tempest-ServerMetadataNegativeTestJSON-1253820515 tempest-ServerMetadataNegativeTestJSON-1253820515-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:16.649473 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-39da672f-a751-45a2-b8b2-818224aabc99 tempest-ServerMetadataNegativeTestJSON-1253820515 tempest-ServerMetadataNegativeTestJSON-1253820515-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:16.649900 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-39da672f-a751-45a2-b8b2-818224aabc99 tempest-ServerMetadataNegativeTestJSON-1253820515 tempest-ServerMetadataNegativeTestJSON-1253820515-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:16.682253 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-eb5a8aa0-ec9a-484b-b6b7-118466178c08 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:57:16.682872 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-eb5a8aa0-ec9a-484b-b6b7-118466178c08 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] [instance: cc3236d7-3b9f-40f2-8a53-3096f986e87e] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:57:16.689878 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-eb5a8aa0-ec9a-484b-b6b7-118466178c08 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:16.690365 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-eb5a8aa0-ec9a-484b-b6b7-118466178c08 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:16.690803 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-eb5a8aa0-ec9a-484b-b6b7-118466178c08 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:16.691553 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-eb5a8aa0-ec9a-484b-b6b7-118466178c08 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:16.692008 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-eb5a8aa0-ec9a-484b-b6b7-118466178c08 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:16.692434 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-eb5a8aa0-ec9a-484b-b6b7-118466178c08 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:16.940951 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-39da672f-a751-45a2-b8b2-818224aabc99 tempest-ServerMetadataNegativeTestJSON-1253820515 tempest-ServerMetadataNegativeTestJSON-1253820515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153f7059fd924dc5b19f323e0a400381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be467d2547d46089b833ae4b5f9dd05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:57:16.949455 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-39da672f-a751-45a2-b8b2-818224aabc99 tempest-ServerMetadataNegativeTestJSON-1253820515 tempest-ServerMetadataNegativeTestJSON-1253820515-project] 10.222.0.18 "GET /compute/v2.1/servers/674e9bd2-7dfd-4854-83e8-56d8970e56bc" status: 200 len: 1527 microversion: 2.1 time: 0.313730 Oct 22 20:57:16.950113 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 946/1974] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:57:16 2022] GET /compute/v2.1/servers/674e9bd2-7dfd-4854-83e8-56d8970e56bc => generated 1527 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:57:16.969958 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-3300f894-3298-4128-a9ce-0d269502886f tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:57:16.970680 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-3300f894-3298-4128-a9ce-0d269502886f tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] [instance: c5db8404-7c9d-41d4-a018-a27058378d35] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:57:16.977408 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3300f894-3298-4128-a9ce-0d269502886f tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:16.977894 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3300f894-3298-4128-a9ce-0d269502886f tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:16.978438 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3300f894-3298-4128-a9ce-0d269502886f tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:16.979021 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3300f894-3298-4128-a9ce-0d269502886f tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:16.979689 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3300f894-3298-4128-a9ce-0d269502886f tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:16.980119 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3300f894-3298-4128-a9ce-0d269502886f tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:16.981762 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-eb5a8aa0-ec9a-484b-b6b7-118466178c08 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d808e98f843dd9621822682c9d278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b58ab4af674c778b4819f177045651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:57:16.990689 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-eb5a8aa0-ec9a-484b-b6b7-118466178c08 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] 10.222.0.18 "GET /compute/v2.1/servers/cc3236d7-3b9f-40f2-8a53-3096f986e87e" status: 200 len: 1318 microversion: 2.1 time: 0.312377 Oct 22 20:57:16.991686 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1029/1975] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:57:16 2022] GET /compute/v2.1/servers/cc3236d7-3b9f-40f2-8a53-3096f986e87e => generated 1318 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 20:57:17.012174 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3300f894-3298-4128-a9ce-0d269502886f tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:17.012662 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3300f894-3298-4128-a9ce-0d269502886f tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:17.013102 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3300f894-3298-4128-a9ce-0d269502886f tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:17.013559 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.objects.instance [None req-3300f894-3298-4128-a9ce-0d269502886f tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lazy-loading 'fault' on Instance uuid c5db8404-7c9d-41d4-a018-a27058378d35 {{(pid=138744) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 20:57:17.062949 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-3300f894-3298-4128-a9ce-0d269502886f tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e787e0b494764176a0f13d75c47d77fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '371ecb87e8d34859971be23c1a1bc443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:57:17.071036 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-3300f894-3298-4128-a9ce-0d269502886f tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] 10.222.0.18 "GET /compute/v2.1/servers/c5db8404-7c9d-41d4-a018-a27058378d35" status: 200 len: 1311 microversion: 2.1 time: 0.106536 Oct 22 20:57:17.071655 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 947/1976] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:57:16 2022] GET /compute/v2.1/servers/c5db8404-7c9d-41d4-a018-a27058378d35 => generated 1311 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:57:17.260537 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-52c76398-5fad-46d5-847a-464b7eb68432 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:57:17.261855 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-52c76398-5fad-46d5-847a-464b7eb68432 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] [instance: 18183d64-42b7-4b9f-9bca-6d018f17eeb3] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:57:17.267996 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-52c76398-5fad-46d5-847a-464b7eb68432 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:17.268557 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-52c76398-5fad-46d5-847a-464b7eb68432 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:17.268989 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-52c76398-5fad-46d5-847a-464b7eb68432 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:17.269862 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-52c76398-5fad-46d5-847a-464b7eb68432 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:17.270601 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-52c76398-5fad-46d5-847a-464b7eb68432 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:17.271082 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-52c76398-5fad-46d5-847a-464b7eb68432 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:17.280929 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-356fc61d-20d1-4fee-b6f7-f9a213a56e6d tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:57:17.282160 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-356fc61d-20d1-4fee-b6f7-f9a213a56e6d tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] [instance: aee36c9d-baf4-453c-b88f-31b8f23638c2] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:57:17.298530 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-356fc61d-20d1-4fee-b6f7-f9a213a56e6d tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:17.302303 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-356fc61d-20d1-4fee-b6f7-f9a213a56e6d tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:17.302866 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-356fc61d-20d1-4fee-b6f7-f9a213a56e6d tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:17.309683 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-356fc61d-20d1-4fee-b6f7-f9a213a56e6d tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:17.310195 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-356fc61d-20d1-4fee-b6f7-f9a213a56e6d tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:17.310632 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-356fc61d-20d1-4fee-b6f7-f9a213a56e6d tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:17.700599 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-52c76398-5fad-46d5-847a-464b7eb68432 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5660f7f9d86f473eaa83e2be362ca63c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e883d7e73084efeb725945ae0bab317', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:57:17.716180 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-52c76398-5fad-46d5-847a-464b7eb68432 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] 10.222.0.18 "GET /compute/v2.1/servers/18183d64-42b7-4b9f-9bca-6d018f17eeb3" status: 200 len: 1329 microversion: 2.1 time: 0.459605 Oct 22 20:57:17.716759 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1030/1977] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:57:17 2022] GET /compute/v2.1/servers/18183d64-42b7-4b9f-9bca-6d018f17eeb3 => generated 1329 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:57:17.721419 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-d81de38a-62fd-4ec1-9e79-326cfce9a93b tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:57:17.722032 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-d81de38a-62fd-4ec1-9e79-326cfce9a93b tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] [instance: 7c5c7ad1-4e7b-427e-8f66-862cc9b2f457] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:57:17.728474 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d81de38a-62fd-4ec1-9e79-326cfce9a93b tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:17.728956 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d81de38a-62fd-4ec1-9e79-326cfce9a93b tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:17.729392 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d81de38a-62fd-4ec1-9e79-326cfce9a93b tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:17.730095 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d81de38a-62fd-4ec1-9e79-326cfce9a93b tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:17.731028 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d81de38a-62fd-4ec1-9e79-326cfce9a93b tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:17.731492 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d81de38a-62fd-4ec1-9e79-326cfce9a93b tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:17.924869 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-356fc61d-20d1-4fee-b6f7-f9a213a56e6d tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d3d7458af447bdb3f03e83a2d8559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49238b8686d24ae698679e4a1957735d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:57:17.931242 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:SELECT=100 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:57:17.940531 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-356fc61d-20d1-4fee-b6f7-f9a213a56e6d tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] 10.222.0.18 "GET /compute/v2.1/servers/aee36c9d-baf4-453c-b88f-31b8f23638c2" status: 200 len: 1528 microversion: 2.1 time: 0.663695 Oct 22 20:57:17.941731 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 948/1978] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:57:17 2022] GET /compute/v2.1/servers/aee36c9d-baf4-453c-b88f-31b8f23638c2 => generated 1528 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 20:57:17.948670 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-623dbf80-be29-415d-aed4-3e3e1cf8c8fe tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:57:17.949493 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-623dbf80-be29-415d-aed4-3e3e1cf8c8fe tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] [instance: 5fadabfa-64f5-4c20-9778-b986d965a632] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:57:17.967656 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-623dbf80-be29-415d-aed4-3e3e1cf8c8fe tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:17.968479 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-623dbf80-be29-415d-aed4-3e3e1cf8c8fe tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:17.968974 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-623dbf80-be29-415d-aed4-3e3e1cf8c8fe tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:17.969741 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-623dbf80-be29-415d-aed4-3e3e1cf8c8fe tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:17.970303 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-623dbf80-be29-415d-aed4-3e3e1cf8c8fe tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:17.973701 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-623dbf80-be29-415d-aed4-3e3e1cf8c8fe tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:18.258325 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-d81de38a-62fd-4ec1-9e79-326cfce9a93b tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dbe89a7e11480194d3d86f82983499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8351b01e07cd43f9be973ab45e522bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:57:18.278613 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-d81de38a-62fd-4ec1-9e79-326cfce9a93b tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] 10.222.0.18 "GET /compute/v2.1/servers/7c5c7ad1-4e7b-427e-8f66-862cc9b2f457" status: 200 len: 1313 microversion: 2.1 time: 0.560714 Oct 22 20:57:18.283178 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1031/1979] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:57:17 2022] GET /compute/v2.1/servers/7c5c7ad1-4e7b-427e-8f66-862cc9b2f457 => generated 1313 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:57:18.298810 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-cfe526c8-6466-4e1b-80b7-3f9bd541663b req-4dd7daf2-4da5-4b75-8e9b-73310d3f4f81 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5fadabfa-64f5-4c20-9778-b986d965a632", "tag": "b491f705-01d8-463c-9ac5-b840e865c43f"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:57:18.324225 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-cfe526c8-6466-4e1b-80b7-3f9bd541663b req-4dd7daf2-4da5-4b75-8e9b-73310d3f4f81 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:18.324722 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-cfe526c8-6466-4e1b-80b7-3f9bd541663b req-4dd7daf2-4da5-4b75-8e9b-73310d3f4f81 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:18.325334 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-cfe526c8-6466-4e1b-80b7-3f9bd541663b req-4dd7daf2-4da5-4b75-8e9b-73310d3f4f81 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:18.369836 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-cfe526c8-6466-4e1b-80b7-3f9bd541663b req-4dd7daf2-4da5-4b75-8e9b-73310d3f4f81 service nova] Creating event network-changed:b491f705-01d8-463c-9ac5-b840e865c43f for instance 5fadabfa-64f5-4c20-9778-b986d965a632 on nch1-master-1 Oct 22 20:57:18.377520 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-cfe526c8-6466-4e1b-80b7-3f9bd541663b req-4dd7daf2-4da5-4b75-8e9b-73310d3f4f81 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092097 Oct 22 20:57:18.378881 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1032/1980] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:57:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:57:18.384855 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-62ed5dbc-469c-4d96-b9a6-eeeabb5e4ac3 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:57:18.385943 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-62ed5dbc-469c-4d96-b9a6-eeeabb5e4ac3 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] [instance: aee36c9d-baf4-453c-b88f-31b8f23638c2] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:57:18.395306 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-62ed5dbc-469c-4d96-b9a6-eeeabb5e4ac3 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:18.396038 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-62ed5dbc-469c-4d96-b9a6-eeeabb5e4ac3 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:18.396709 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-62ed5dbc-469c-4d96-b9a6-eeeabb5e4ac3 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:18.397580 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-62ed5dbc-469c-4d96-b9a6-eeeabb5e4ac3 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:18.398187 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-62ed5dbc-469c-4d96-b9a6-eeeabb5e4ac3 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:18.398922 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-62ed5dbc-469c-4d96-b9a6-eeeabb5e4ac3 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:18.420014 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell0:SELECT=18 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:57:18.813485 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-623dbf80-be29-415d-aed4-3e3e1cf8c8fe tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b392ad1fe1fd4b2a9e6be03a7435deb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594624ed28aa433d907c8833d360b82e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:57:18.834269 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-623dbf80-be29-415d-aed4-3e3e1cf8c8fe tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] 10.222.0.18 "GET /compute/v2.1/servers/5fadabfa-64f5-4c20-9778-b986d965a632" status: 200 len: 1324 microversion: 2.1 time: 0.891285 Oct 22 20:57:18.835308 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 949/1981] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:57:17 2022] GET /compute/v2.1/servers/5fadabfa-64f5-4c20-9778-b986d965a632 => generated 1324 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:57:18.840123 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-49375355-4bb1-4891-a8b6-8dd4755a92b1 tempest-ServerMetadataNegativeTestJSON-1253820515 tempest-ServerMetadataNegativeTestJSON-1253820515-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:57:18.841010 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-49375355-4bb1-4891-a8b6-8dd4755a92b1 tempest-ServerMetadataNegativeTestJSON-1253820515 tempest-ServerMetadataNegativeTestJSON-1253820515-project] [instance: 674e9bd2-7dfd-4854-83e8-56d8970e56bc] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:57:18.865716 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-49375355-4bb1-4891-a8b6-8dd4755a92b1 tempest-ServerMetadataNegativeTestJSON-1253820515 tempest-ServerMetadataNegativeTestJSON-1253820515-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:18.878793 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-49375355-4bb1-4891-a8b6-8dd4755a92b1 tempest-ServerMetadataNegativeTestJSON-1253820515 tempest-ServerMetadataNegativeTestJSON-1253820515-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:18.882987 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-49375355-4bb1-4891-a8b6-8dd4755a92b1 tempest-ServerMetadataNegativeTestJSON-1253820515 tempest-ServerMetadataNegativeTestJSON-1253820515-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:18.885122 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-49375355-4bb1-4891-a8b6-8dd4755a92b1 tempest-ServerMetadataNegativeTestJSON-1253820515 tempest-ServerMetadataNegativeTestJSON-1253820515-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:18.886881 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-49375355-4bb1-4891-a8b6-8dd4755a92b1 tempest-ServerMetadataNegativeTestJSON-1253820515 tempest-ServerMetadataNegativeTestJSON-1253820515-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:18.887827 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-49375355-4bb1-4891-a8b6-8dd4755a92b1 tempest-ServerMetadataNegativeTestJSON-1253820515 tempest-ServerMetadataNegativeTestJSON-1253820515-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:18.952488 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-49375355-4bb1-4891-a8b6-8dd4755a92b1 tempest-ServerMetadataNegativeTestJSON-1253820515 tempest-ServerMetadataNegativeTestJSON-1253820515-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:18.953653 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-49375355-4bb1-4891-a8b6-8dd4755a92b1 tempest-ServerMetadataNegativeTestJSON-1253820515 tempest-ServerMetadataNegativeTestJSON-1253820515-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:18.954337 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-49375355-4bb1-4891-a8b6-8dd4755a92b1 tempest-ServerMetadataNegativeTestJSON-1253820515 tempest-ServerMetadataNegativeTestJSON-1253820515-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:18.955178 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.objects.instance [None req-49375355-4bb1-4891-a8b6-8dd4755a92b1 tempest-ServerMetadataNegativeTestJSON-1253820515 tempest-ServerMetadataNegativeTestJSON-1253820515-project] Lazy-loading 'fault' on Instance uuid 674e9bd2-7dfd-4854-83e8-56d8970e56bc {{(pid=138744) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 20:57:19.048748 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-49375355-4bb1-4891-a8b6-8dd4755a92b1 tempest-ServerMetadataNegativeTestJSON-1253820515 tempest-ServerMetadataNegativeTestJSON-1253820515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153f7059fd924dc5b19f323e0a400381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be467d2547d46089b833ae4b5f9dd05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:57:19.057226 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-49375355-4bb1-4891-a8b6-8dd4755a92b1 tempest-ServerMetadataNegativeTestJSON-1253820515 tempest-ServerMetadataNegativeTestJSON-1253820515-project] 10.222.0.18 "GET /compute/v2.1/servers/674e9bd2-7dfd-4854-83e8-56d8970e56bc" status: 200 len: 1314 microversion: 2.1 time: 0.220701 Oct 22 20:57:19.074407 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 950/1982] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:57:18 2022] GET /compute/v2.1/servers/674e9bd2-7dfd-4854-83e8-56d8970e56bc => generated 1314 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:57:19.079580 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-52cc8475-6465-44d3-bc80-ce23df8e2e0d tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:57:19.080207 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-52cc8475-6465-44d3-bc80-ce23df8e2e0d tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] [instance: cc3236d7-3b9f-40f2-8a53-3096f986e87e] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:57:19.086383 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-52cc8475-6465-44d3-bc80-ce23df8e2e0d tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:19.086871 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-52cc8475-6465-44d3-bc80-ce23df8e2e0d tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:19.087508 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-52cc8475-6465-44d3-bc80-ce23df8e2e0d tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:19.088360 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-52cc8475-6465-44d3-bc80-ce23df8e2e0d tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:19.088853 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-52cc8475-6465-44d3-bc80-ce23df8e2e0d tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:19.089249 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-52cc8475-6465-44d3-bc80-ce23df8e2e0d tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:19.116658 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-62ed5dbc-469c-4d96-b9a6-eeeabb5e4ac3 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d3d7458af447bdb3f03e83a2d8559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49238b8686d24ae698679e4a1957735d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:57:19.127370 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-62ed5dbc-469c-4d96-b9a6-eeeabb5e4ac3 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] 10.222.0.18 "GET /compute/v2.1/servers/aee36c9d-baf4-453c-b88f-31b8f23638c2" status: 200 len: 1528 microversion: 2.1 time: 0.746948 Oct 22 20:57:19.128074 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1033/1983] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:57:18 2022] GET /compute/v2.1/servers/aee36c9d-baf4-453c-b88f-31b8f23638c2 => generated 1528 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:57:19.141186 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-dd551236-ce37-4b2d-9dc4-7a349e5b0e62 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:57:19.142017 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-dd551236-ce37-4b2d-9dc4-7a349e5b0e62 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] [instance: c5db8404-7c9d-41d4-a018-a27058378d35] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:57:19.148769 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-dd551236-ce37-4b2d-9dc4-7a349e5b0e62 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:19.149335 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-dd551236-ce37-4b2d-9dc4-7a349e5b0e62 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:19.149862 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-dd551236-ce37-4b2d-9dc4-7a349e5b0e62 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:19.150693 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-dd551236-ce37-4b2d-9dc4-7a349e5b0e62 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:19.151220 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-dd551236-ce37-4b2d-9dc4-7a349e5b0e62 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:19.151721 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-dd551236-ce37-4b2d-9dc4-7a349e5b0e62 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:19.166488 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.wsgi [None req-dd551236-ce37-4b2d-9dc4-7a349e5b0e62 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] HTTP exception thrown: Instance c5db8404-7c9d-41d4-a018-a27058378d35 could not be found. Oct 22 20:57:19.168223 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-dd551236-ce37-4b2d-9dc4-7a349e5b0e62 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Request method failure captured: Oct 22 20:57:19.168223 ncdv-master-1 devstack@n-api.service[138745]: request: GET /compute/v2.1/servers/c5db8404-7c9d-41d4-a018-a27058378d35 HTTP/1.1 Oct 22 20:57:19.168223 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 20:57:19.168223 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 20:57:19.168223 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 20:57:19.168223 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 0 Oct 22 20:57:19.168223 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 20:57:19.168223 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 20:57:19.168223 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 20:57:19.168223 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 20:57:19.168223 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVFjYv4p50pKm8yQakerG7q0mSmw6otGG1EIXq7SL7p47_tL_BzbnQ6yshTzdvSSRVPQrm4IIp-tF4e8RwoazpQebhn6C2339q2qSRT1to0lI2g1NqgKTs2-VzTHnzA1Scc09uq7l8P8iPxC6_1j4JK51RzNGS-E0J731EqNX09e4YDg Oct 22 20:57:19.168223 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 20:57:19.168223 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 20:57:19.168223 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 20:57:19.168223 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 20:57:19.168223 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 20:57:19.168223 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 20:57:19.168223 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: 371ecb87e8d34859971be23c1a1bc443 Oct 22 20:57:19.168223 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-ListServerFiltersTestJSON-1003295825 Oct 22 20:57:19.168223 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 20:57:19.168223 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 20:57:19.168223 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_371ecb87e8d34859971be23c1a1bc443"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/371ecb87e8d34859971be23c1a1bc443"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/371ecb87e8d34859971be23c1a1bc443"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/371ecb87e8d34859971be23c1a1bc443"}]}] Oct 22 20:57:19.168223 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-ListServerFiltersTestJSON-1003295825 Oct 22 20:57:19.168223 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: 371ecb87e8d34859971be23c1a1bc443 Oct 22 20:57:19.168223 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1003295825 Oct 22 20:57:19.168223 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-ListServerFiltersTestJSON-1003295825-project Oct 22 20:57:19.168223 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 20:57:19.168223 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 20:57:19.168223 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: e787e0b494764176a0f13d75c47d77fa Oct 22 20:57:19.168223 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-ListServerFiltersTestJSON-1003295825-project Oct 22 20:57:19.168223 ncdv-master-1 devstack@n-api.service[138745]: method: > Oct 22 20:57:19.168223 ncdv-master-1 devstack@n-api.service[138745]: exception: Instance c5db8404-7c9d-41d4-a018-a27058378d35 could not be found. Oct 22 20:57:19.168223 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'id': 'c5db8404-7c9d-41d4-a018-a27058378d35'} Oct 22 20:57:19.168223 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:57:19.168223 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:57:19.168223 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 20:57:19.168223 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 20:57:19.168223 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 20:57:19.168223 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 20:57:19.168223 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 20:57:19.168223 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 20:57:19.168223 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 20:57:19.168223 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 20:57:19.168223 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c5db8404-7c9d-41d4-a018-a27058378d35 could not be found. Oct 22 20:57:19.168223 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:57:19.168223 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:57:19.168223 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:57:19.168223 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:57:19.168223 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:57:19.168223 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:57:19.168223 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:57:19.168223 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:57:19.168223 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:57:19.168223 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:57:19.168223 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 20:57:19.168223 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 20:57:19.168223 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 20:57:19.168223 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 20:57:19.168223 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 20:57:19.168223 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 20:57:19.168223 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c5db8404-7c9d-41d4-a018-a27058378d35 could not be found. Oct 22 20:57:19.168223 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:57:19.168223 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:57:19.168223 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:57:19.172399 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:57:19.172399 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:57:19.172399 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:57:19.172399 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 20:57:19.172399 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 20:57:19.172399 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c5db8404-7c9d-41d4-a018-a27058378d35 could not be found. Oct 22 20:57:19.172399 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:57:19.172399 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-dd551236-ce37-4b2d-9dc4-7a349e5b0e62 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Returning 404 to user: Instance c5db8404-7c9d-41d4-a018-a27058378d35 could not be found. {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:57:19.172399 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-dd551236-ce37-4b2d-9dc4-7a349e5b0e62 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] 10.222.0.18 "GET /compute/v2.1/servers/c5db8404-7c9d-41d4-a018-a27058378d35" status: 404 len: 111 microversion: 2.1 time: 0.032648 Oct 22 20:57:19.173402 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1034/1984] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:57:19 2022] GET /compute/v2.1/servers/c5db8404-7c9d-41d4-a018-a27058378d35 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 20:57:19.177972 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-cc055343-90d4-45f9-bf20-2daec241b4d1 req-52ab2328-29d6-4e37-8499-15c4ce01c85d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "674e9bd2-7dfd-4854-83e8-56d8970e56bc", "name": "network-vif-deleted", "tag": "f884f034-3e3e-4a4b-bb90-9fe55e33a473"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:57:19.188205 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-cc055343-90d4-45f9-bf20-2daec241b4d1 req-52ab2328-29d6-4e37-8499-15c4ce01c85d service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:19.188793 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-cc055343-90d4-45f9-bf20-2daec241b4d1 req-52ab2328-29d6-4e37-8499-15c4ce01c85d service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:19.189495 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-cc055343-90d4-45f9-bf20-2daec241b4d1 req-52ab2328-29d6-4e37-8499-15c4ce01c85d service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:19.201179 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-cc055343-90d4-45f9-bf20-2daec241b4d1 req-52ab2328-29d6-4e37-8499-15c4ce01c85d service nova] Creating event network-vif-deleted:f884f034-3e3e-4a4b-bb90-9fe55e33a473 for instance 674e9bd2-7dfd-4854-83e8-56d8970e56bc on nch2-master-1 Oct 22 20:57:19.206508 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-cc055343-90d4-45f9-bf20-2daec241b4d1 req-52ab2328-29d6-4e37-8499-15c4ce01c85d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031844 Oct 22 20:57:19.209093 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1035/1985] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:57:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:57:19.212769 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-079bc002-84ee-4b55-97c7-7e61eb9e42c8 req-c416ea6e-5f75-4a79-94a5-ae9bcfba5e80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c5c7ad1-4e7b-427e-8f66-862cc9b2f457", "name": "network-vif-plugged", "status": "completed", "tag": "058b5ead-f160-4367-a819-2697169cb3fa"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:57:19.222965 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-079bc002-84ee-4b55-97c7-7e61eb9e42c8 req-c416ea6e-5f75-4a79-94a5-ae9bcfba5e80 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:19.223578 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-079bc002-84ee-4b55-97c7-7e61eb9e42c8 req-c416ea6e-5f75-4a79-94a5-ae9bcfba5e80 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:19.223953 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-079bc002-84ee-4b55-97c7-7e61eb9e42c8 req-c416ea6e-5f75-4a79-94a5-ae9bcfba5e80 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:19.237142 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-079bc002-84ee-4b55-97c7-7e61eb9e42c8 req-c416ea6e-5f75-4a79-94a5-ae9bcfba5e80 service nova] Creating event network-vif-plugged:058b5ead-f160-4367-a819-2697169cb3fa for instance 7c5c7ad1-4e7b-427e-8f66-862cc9b2f457 on nch2-master-1 Oct 22 20:57:19.241944 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-079bc002-84ee-4b55-97c7-7e61eb9e42c8 req-c416ea6e-5f75-4a79-94a5-ae9bcfba5e80 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033104 Oct 22 20:57:19.242482 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1036/1986] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:57:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:57:19.247687 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-c95110f4-414e-4820-b326-f9ed7299128a tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:57:19.248391 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-c95110f4-414e-4820-b326-f9ed7299128a tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] [instance: 18183d64-42b7-4b9f-9bca-6d018f17eeb3] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:57:19.256336 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c95110f4-414e-4820-b326-f9ed7299128a tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:19.257003 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c95110f4-414e-4820-b326-f9ed7299128a tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:19.257545 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c95110f4-414e-4820-b326-f9ed7299128a tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:19.258357 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c95110f4-414e-4820-b326-f9ed7299128a tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:19.259082 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c95110f4-414e-4820-b326-f9ed7299128a tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:19.260018 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c95110f4-414e-4820-b326-f9ed7299128a tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:19.303205 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-52cc8475-6465-44d3-bc80-ce23df8e2e0d tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d808e98f843dd9621822682c9d278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b58ab4af674c778b4819f177045651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:57:19.311707 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-52cc8475-6465-44d3-bc80-ce23df8e2e0d tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] 10.222.0.18 "GET /compute/v2.1/servers/cc3236d7-3b9f-40f2-8a53-3096f986e87e" status: 200 len: 1318 microversion: 2.1 time: 0.236059 Oct 22 20:57:19.312551 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 951/1987] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:57:19 2022] GET /compute/v2.1/servers/cc3236d7-3b9f-40f2-8a53-3096f986e87e => generated 1318 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:57:19.317118 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-0c2d3b66-26e0-475e-af68-e1cc1eaef2da tempest-MigrationsAdminTest-1403807426 tempest-MigrationsAdminTest-1403807426-project-admin] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:57:19.338820 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-0c2d3b66-26e0-475e-af68-e1cc1eaef2da tempest-MigrationsAdminTest-1403807426 tempest-MigrationsAdminTest-1403807426-project-admin] 10.222.0.18 "DELETE /compute/v2.1/flavors/1576c14a-5e9b-4ca1-91da-5d29cbf3cec9" status: 202 len: 0 microversion: 2.1 time: 0.024915 Oct 22 20:57:19.339999 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 952/1988] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 20:57:19 2022] DELETE /compute/v2.1/flavors/1576c14a-5e9b-4ca1-91da-5d29cbf3cec9 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 20:57:19.346267 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-811e1333-fc2b-4250-900a-6b1951e54cc2 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:57:19.346887 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-811e1333-fc2b-4250-900a-6b1951e54cc2 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] [instance: 28c2b09f-e43f-472b-b8db-f407c341acfd] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:57:19.353487 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-811e1333-fc2b-4250-900a-6b1951e54cc2 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:19.354053 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-811e1333-fc2b-4250-900a-6b1951e54cc2 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:19.354503 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-811e1333-fc2b-4250-900a-6b1951e54cc2 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:19.355408 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-811e1333-fc2b-4250-900a-6b1951e54cc2 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:19.356028 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-811e1333-fc2b-4250-900a-6b1951e54cc2 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:19.356741 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-811e1333-fc2b-4250-900a-6b1951e54cc2 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:19.384646 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-811e1333-fc2b-4250-900a-6b1951e54cc2 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] [instance: 28c2b09f-e43f-472b-b8db-f407c341acfd] Going to try to terminate instance {{(pid=138744) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 20:57:19.451667 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-c95110f4-414e-4820-b326-f9ed7299128a tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5660f7f9d86f473eaa83e2be362ca63c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e883d7e73084efeb725945ae0bab317', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:57:19.461392 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-c95110f4-414e-4820-b326-f9ed7299128a tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] 10.222.0.18 "GET /compute/v2.1/servers/18183d64-42b7-4b9f-9bca-6d018f17eeb3" status: 200 len: 1532 microversion: 2.1 time: 0.217550 Oct 22 20:57:19.475365 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-811e1333-fc2b-4250-900a-6b1951e54cc2 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] 10.222.0.18 "DELETE /compute/v2.1/servers/28c2b09f-e43f-472b-b8db-f407c341acfd" status: 204 len: 0 microversion: 2.1 time: 0.123717 Oct 22 20:57:19.475365 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 953/1989] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 20:57:19 2022] DELETE /compute/v2.1/servers/28c2b09f-e43f-472b-b8db-f407c341acfd => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 20:57:19.475365 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-ca6da83e-7f11-4485-8cf4-6de4414b9c38 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:57:19.475365 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-ca6da83e-7f11-4485-8cf4-6de4414b9c38 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] [instance: 7c5c7ad1-4e7b-427e-8f66-862cc9b2f457] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:57:19.478685 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ca6da83e-7f11-4485-8cf4-6de4414b9c38 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:19.479359 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ca6da83e-7f11-4485-8cf4-6de4414b9c38 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:19.479828 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ca6da83e-7f11-4485-8cf4-6de4414b9c38 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:19.480677 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1037/1990] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:57:19 2022] GET /compute/v2.1/servers/18183d64-42b7-4b9f-9bca-6d018f17eeb3 => generated 1532 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:57:19.480795 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ca6da83e-7f11-4485-8cf4-6de4414b9c38 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:19.481165 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ca6da83e-7f11-4485-8cf4-6de4414b9c38 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:19.481598 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ca6da83e-7f11-4485-8cf4-6de4414b9c38 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:19.485665 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-39f49605-8bca-4398-87db-79a8fcca863c tempest-MigrationsAdminTest-1403807426 tempest-MigrationsAdminTest-1403807426-project-admin] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:57:19.505856 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-39f49605-8bca-4398-87db-79a8fcca863c tempest-MigrationsAdminTest-1403807426 tempest-MigrationsAdminTest-1403807426-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.023690 Oct 22 20:57:19.506348 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1038/1991] 10.222.0.18 () {58 vars in 1146 bytes} [Sat Oct 22 20:57:19 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:57:19.510699 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-72143f92-1078-4f6a-b5c5-b7f453915be3 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:57:19.511312 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-72143f92-1078-4f6a-b5c5-b7f453915be3 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] [instance: 28c2b09f-e43f-472b-b8db-f407c341acfd] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:57:19.517986 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-72143f92-1078-4f6a-b5c5-b7f453915be3 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:19.518468 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-72143f92-1078-4f6a-b5c5-b7f453915be3 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:19.518883 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-72143f92-1078-4f6a-b5c5-b7f453915be3 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:19.519647 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-72143f92-1078-4f6a-b5c5-b7f453915be3 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:19.520042 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-72143f92-1078-4f6a-b5c5-b7f453915be3 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:19.520622 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-72143f92-1078-4f6a-b5c5-b7f453915be3 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:19.639545 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell0:SELECT=26 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:57:19.673749 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-ca6da83e-7f11-4485-8cf4-6de4414b9c38 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dbe89a7e11480194d3d86f82983499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8351b01e07cd43f9be973ab45e522bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:57:19.681703 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-ca6da83e-7f11-4485-8cf4-6de4414b9c38 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] 10.222.0.18 "GET /compute/v2.1/servers/7c5c7ad1-4e7b-427e-8f66-862cc9b2f457" status: 200 len: 1313 microversion: 2.1 time: 0.214278 Oct 22 20:57:19.682559 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 954/1992] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:57:19 2022] GET /compute/v2.1/servers/7c5c7ad1-4e7b-427e-8f66-862cc9b2f457 => generated 1313 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:57:19.687411 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-0baf9a54-5d76-4ba3-884e-60d84da138ad tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] Action: 'create', calling method: .version_select at 0x7fd3a8bad160>, body: {"pool": "355a8481-8802-4295-9cce-2185db0a47d1"} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:57:19.784963 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-72143f92-1078-4f6a-b5c5-b7f453915be3 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e787e0b494764176a0f13d75c47d77fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '371ecb87e8d34859971be23c1a1bc443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:57:19.793802 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-72143f92-1078-4f6a-b5c5-b7f453915be3 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] 10.222.0.18 "GET /compute/v2.1/servers/28c2b09f-e43f-472b-b8db-f407c341acfd" status: 200 len: 1518 microversion: 2.1 time: 0.286479 Oct 22 20:57:19.794596 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1039/1993] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:57:19 2022] GET /compute/v2.1/servers/28c2b09f-e43f-472b-b8db-f407c341acfd => generated 1518 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:57:19.807478 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-887255a9-61ef-44f5-83ab-b727eb03942d tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:57:19.810474 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-887255a9-61ef-44f5-83ab-b727eb03942d tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] [instance: aee36c9d-baf4-453c-b88f-31b8f23638c2] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:57:19.817259 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-887255a9-61ef-44f5-83ab-b727eb03942d tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:19.817793 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-887255a9-61ef-44f5-83ab-b727eb03942d tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:19.818445 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-887255a9-61ef-44f5-83ab-b727eb03942d tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:19.819160 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-887255a9-61ef-44f5-83ab-b727eb03942d tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:19.819644 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-887255a9-61ef-44f5-83ab-b727eb03942d tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:19.820051 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-887255a9-61ef-44f5-83ab-b727eb03942d tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:19.823060 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:57:19.911374 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-887255a9-61ef-44f5-83ab-b727eb03942d tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'e0d3d7458af447bdb3f03e83a2d8559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49238b8686d24ae698679e4a1957735d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:57:19.917384 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-887255a9-61ef-44f5-83ab-b727eb03942d tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] [instance: aee36c9d-baf4-453c-b88f-31b8f23638c2] Old instance type tempest-test_resize_flavor_-328072302, new instance type m1.heat {{(pid=138745) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 22 20:57:19.924350 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-887255a9-61ef-44f5-83ab-b727eb03942d tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Flavor limits 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 20:57:19.924774 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-887255a9-61ef-44f5-83ab-b727eb03942d tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Image limits 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 20:57:19.925241 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-887255a9-61ef-44f5-83ab-b727eb03942d tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Flavor pref 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 20:57:19.925648 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-887255a9-61ef-44f5-83ab-b727eb03942d tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Image pref 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 20:57:19.926055 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-887255a9-61ef-44f5-83ab-b727eb03942d tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 20:57:20.043273 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-887255a9-61ef-44f5-83ab-b727eb03942d tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] 10.222.0.18 "POST /compute/v2.1/servers/aee36c9d-baf4-453c-b88f-31b8f23638c2/action" status: 202 len: 0 microversion: 2.1 time: 0.247471 Oct 22 20:57:20.047363 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1040/1994] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 20:57:19 2022] POST /compute/v2.1/servers/aee36c9d-baf4-453c-b88f-31b8f23638c2/action => generated 0 bytes in 249 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 20:57:20.050298 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-83edfed9-b0f0-4bdb-9091-62eb5131f23b tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:57:20.051147 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-83edfed9-b0f0-4bdb-9091-62eb5131f23b tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] [instance: 5fadabfa-64f5-4c20-9778-b986d965a632] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:57:20.058207 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-83edfed9-b0f0-4bdb-9091-62eb5131f23b tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:20.058681 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-83edfed9-b0f0-4bdb-9091-62eb5131f23b tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:20.059151 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-83edfed9-b0f0-4bdb-9091-62eb5131f23b tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:20.059992 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-83edfed9-b0f0-4bdb-9091-62eb5131f23b tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:20.060526 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-83edfed9-b0f0-4bdb-9091-62eb5131f23b tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:20.060958 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-83edfed9-b0f0-4bdb-9091-62eb5131f23b tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:20.348291 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-83edfed9-b0f0-4bdb-9091-62eb5131f23b tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b392ad1fe1fd4b2a9e6be03a7435deb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594624ed28aa433d907c8833d360b82e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:57:20.363441 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-83edfed9-b0f0-4bdb-9091-62eb5131f23b tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] 10.222.0.18 "GET /compute/v2.1/servers/5fadabfa-64f5-4c20-9778-b986d965a632" status: 200 len: 1324 microversion: 2.1 time: 0.317411 Oct 22 20:57:20.364076 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1041/1995] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:57:20 2022] GET /compute/v2.1/servers/5fadabfa-64f5-4c20-9778-b986d965a632 => generated 1324 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:57:20.370853 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-8b61fcd0-40ce-4f16-a0e4-c06a43569256 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:57:20.371833 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-8b61fcd0-40ce-4f16-a0e4-c06a43569256 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] [instance: aee36c9d-baf4-453c-b88f-31b8f23638c2] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:57:20.381491 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8b61fcd0-40ce-4f16-a0e4-c06a43569256 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:20.381979 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8b61fcd0-40ce-4f16-a0e4-c06a43569256 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:20.382412 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8b61fcd0-40ce-4f16-a0e4-c06a43569256 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:20.383731 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8b61fcd0-40ce-4f16-a0e4-c06a43569256 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:20.384403 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8b61fcd0-40ce-4f16-a0e4-c06a43569256 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:20.385137 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8b61fcd0-40ce-4f16-a0e4-c06a43569256 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:20.670714 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-8b61fcd0-40ce-4f16-a0e4-c06a43569256 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d3d7458af447bdb3f03e83a2d8559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49238b8686d24ae698679e4a1957735d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:57:20.686280 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-8b61fcd0-40ce-4f16-a0e4-c06a43569256 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] 10.222.0.18 "GET /compute/v2.1/servers/aee36c9d-baf4-453c-b88f-31b8f23638c2" status: 200 len: 1537 microversion: 2.1 time: 0.319933 Oct 22 20:57:20.687470 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1042/1996] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:57:20 2022] GET /compute/v2.1/servers/aee36c9d-baf4-453c-b88f-31b8f23638c2 => generated 1537 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:57:20.693613 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-d50c3d8c-2290-4078-9429-5dc6b159362f tempest-ServerMetadataNegativeTestJSON-1253820515 tempest-ServerMetadataNegativeTestJSON-1253820515-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:57:20.694488 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-d50c3d8c-2290-4078-9429-5dc6b159362f tempest-ServerMetadataNegativeTestJSON-1253820515 tempest-ServerMetadataNegativeTestJSON-1253820515-project] [instance: 674e9bd2-7dfd-4854-83e8-56d8970e56bc] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:57:20.703749 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d50c3d8c-2290-4078-9429-5dc6b159362f tempest-ServerMetadataNegativeTestJSON-1253820515 tempest-ServerMetadataNegativeTestJSON-1253820515-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:20.704909 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d50c3d8c-2290-4078-9429-5dc6b159362f tempest-ServerMetadataNegativeTestJSON-1253820515 tempest-ServerMetadataNegativeTestJSON-1253820515-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:20.706107 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d50c3d8c-2290-4078-9429-5dc6b159362f tempest-ServerMetadataNegativeTestJSON-1253820515 tempest-ServerMetadataNegativeTestJSON-1253820515-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:20.707064 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d50c3d8c-2290-4078-9429-5dc6b159362f tempest-ServerMetadataNegativeTestJSON-1253820515 tempest-ServerMetadataNegativeTestJSON-1253820515-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:20.707630 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d50c3d8c-2290-4078-9429-5dc6b159362f tempest-ServerMetadataNegativeTestJSON-1253820515 tempest-ServerMetadataNegativeTestJSON-1253820515-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:20.708164 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d50c3d8c-2290-4078-9429-5dc6b159362f tempest-ServerMetadataNegativeTestJSON-1253820515 tempest-ServerMetadataNegativeTestJSON-1253820515-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:20.724279 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.wsgi [None req-d50c3d8c-2290-4078-9429-5dc6b159362f tempest-ServerMetadataNegativeTestJSON-1253820515 tempest-ServerMetadataNegativeTestJSON-1253820515-project] HTTP exception thrown: Instance 674e9bd2-7dfd-4854-83e8-56d8970e56bc could not be found. Oct 22 20:57:20.726567 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-d50c3d8c-2290-4078-9429-5dc6b159362f tempest-ServerMetadataNegativeTestJSON-1253820515 tempest-ServerMetadataNegativeTestJSON-1253820515-project] Request method failure captured: Oct 22 20:57:20.726567 ncdv-master-1 devstack@n-api.service[138745]: request: GET /compute/v2.1/servers/674e9bd2-7dfd-4854-83e8-56d8970e56bc HTTP/1.1 Oct 22 20:57:20.726567 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 20:57:20.726567 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 20:57:20.726567 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 20:57:20.726567 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 0 Oct 22 20:57:20.726567 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 20:57:20.726567 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 20:57:20.726567 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 20:57:20.726567 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 20:57:20.726567 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVFkP-OPnnJAqnv5Vl_qiDumPkYSxzD6Lkt4grXBrubAE37i2toaOx27e7DT0jWmvJcWzGKhPXwpF_4K4K5_s49zBmjXAp7bRtL2teV862hikPRv-Oqdp2Z9FAOqZaslMfFN4lsF_zKvB0takdeeasPQ-TSWheMbUTyBE7r1aeYOttEE Oct 22 20:57:20.726567 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 20:57:20.726567 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 20:57:20.726567 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 20:57:20.726567 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 20:57:20.726567 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 20:57:20.726567 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 20:57:20.726567 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: 9be467d2547d46089b833ae4b5f9dd05 Oct 22 20:57:20.726567 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1253820515 Oct 22 20:57:20.726567 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 20:57:20.726567 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 20:57:20.726567 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_9be467d2547d46089b833ae4b5f9dd05"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9be467d2547d46089b833ae4b5f9dd05"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/9be467d2547d46089b833ae4b5f9dd05"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9be467d2547d46089b833ae4b5f9dd05"}]}] Oct 22 20:57:20.726567 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1253820515 Oct 22 20:57:20.726567 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: 9be467d2547d46089b833ae4b5f9dd05 Oct 22 20:57:20.726567 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1253820515 Oct 22 20:57:20.726567 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-ServerMetadataNegativeTestJSON-1253820515-project Oct 22 20:57:20.726567 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 20:57:20.726567 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 20:57:20.726567 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: 153f7059fd924dc5b19f323e0a400381 Oct 22 20:57:20.726567 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1253820515-project Oct 22 20:57:20.726567 ncdv-master-1 devstack@n-api.service[138745]: method: > Oct 22 20:57:20.726567 ncdv-master-1 devstack@n-api.service[138745]: exception: Instance 674e9bd2-7dfd-4854-83e8-56d8970e56bc could not be found. Oct 22 20:57:20.726567 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'id': '674e9bd2-7dfd-4854-83e8-56d8970e56bc'} Oct 22 20:57:20.726567 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:57:20.726567 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:57:20.726567 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 20:57:20.726567 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 20:57:20.726567 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 20:57:20.726567 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 20:57:20.726567 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 20:57:20.726567 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 20:57:20.726567 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 20:57:20.726567 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 20:57:20.726567 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 674e9bd2-7dfd-4854-83e8-56d8970e56bc could not be found. Oct 22 20:57:20.726567 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:57:20.726567 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:57:20.726567 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:57:20.726567 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:57:20.726567 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:57:20.726567 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:57:20.726567 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:57:20.726567 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:57:20.726567 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:57:20.726567 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:57:20.726567 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 20:57:20.726567 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 20:57:20.726567 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 20:57:20.726567 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 20:57:20.726567 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 20:57:20.726567 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 20:57:20.726567 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 674e9bd2-7dfd-4854-83e8-56d8970e56bc could not be found. Oct 22 20:57:20.726567 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:57:20.726567 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:57:20.730288 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:57:20.730288 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:57:20.730288 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:57:20.730288 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:57:20.730288 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 20:57:20.730288 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 20:57:20.730288 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 674e9bd2-7dfd-4854-83e8-56d8970e56bc could not be found. Oct 22 20:57:20.730288 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:57:20.730288 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-d50c3d8c-2290-4078-9429-5dc6b159362f tempest-ServerMetadataNegativeTestJSON-1253820515 tempest-ServerMetadataNegativeTestJSON-1253820515-project] Returning 404 to user: Instance 674e9bd2-7dfd-4854-83e8-56d8970e56bc could not be found. {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:57:20.730288 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-d50c3d8c-2290-4078-9429-5dc6b159362f tempest-ServerMetadataNegativeTestJSON-1253820515 tempest-ServerMetadataNegativeTestJSON-1253820515-project] 10.222.0.18 "GET /compute/v2.1/servers/674e9bd2-7dfd-4854-83e8-56d8970e56bc" status: 404 len: 111 microversion: 2.1 time: 0.039711 Oct 22 20:57:20.730288 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1043/1997] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:57:20 2022] GET /compute/v2.1/servers/674e9bd2-7dfd-4854-83e8-56d8970e56bc => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 20:57:20.736726 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-757902de-3396-4c6c-9326-49fe73bb83f1 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:57:20.737383 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-757902de-3396-4c6c-9326-49fe73bb83f1 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] [instance: cc3236d7-3b9f-40f2-8a53-3096f986e87e] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:57:20.745300 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-757902de-3396-4c6c-9326-49fe73bb83f1 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:20.745824 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-757902de-3396-4c6c-9326-49fe73bb83f1 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:20.746262 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-757902de-3396-4c6c-9326-49fe73bb83f1 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:20.746976 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-757902de-3396-4c6c-9326-49fe73bb83f1 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:20.747472 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-757902de-3396-4c6c-9326-49fe73bb83f1 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:20.747904 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-757902de-3396-4c6c-9326-49fe73bb83f1 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:21.062529 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-757902de-3396-4c6c-9326-49fe73bb83f1 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d808e98f843dd9621822682c9d278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b58ab4af674c778b4819f177045651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:57:21.072753 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-757902de-3396-4c6c-9326-49fe73bb83f1 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] 10.222.0.18 "GET /compute/v2.1/servers/cc3236d7-3b9f-40f2-8a53-3096f986e87e" status: 200 len: 1318 microversion: 2.1 time: 0.341818 Oct 22 20:57:21.073577 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1044/1998] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:57:20 2022] GET /compute/v2.1/servers/cc3236d7-3b9f-40f2-8a53-3096f986e87e => generated 1318 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:57:21.087261 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-0ed4cca7-d1d2-42e6-91ea-88167bcea0f0 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:57:21.087970 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-0ed4cca7-d1d2-42e6-91ea-88167bcea0f0 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] [instance: 7c5c7ad1-4e7b-427e-8f66-862cc9b2f457] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:57:21.094558 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0ed4cca7-d1d2-42e6-91ea-88167bcea0f0 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:21.095166 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0ed4cca7-d1d2-42e6-91ea-88167bcea0f0 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:21.095688 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0ed4cca7-d1d2-42e6-91ea-88167bcea0f0 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:21.096420 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0ed4cca7-d1d2-42e6-91ea-88167bcea0f0 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:21.096881 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0ed4cca7-d1d2-42e6-91ea-88167bcea0f0 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:21.097314 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0ed4cca7-d1d2-42e6-91ea-88167bcea0f0 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:21.405163 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-0ed4cca7-d1d2-42e6-91ea-88167bcea0f0 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dbe89a7e11480194d3d86f82983499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8351b01e07cd43f9be973ab45e522bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:57:21.414304 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-0ed4cca7-d1d2-42e6-91ea-88167bcea0f0 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] 10.222.0.18 "GET /compute/v2.1/servers/7c5c7ad1-4e7b-427e-8f66-862cc9b2f457" status: 200 len: 1463 microversion: 2.1 time: 0.330897 Oct 22 20:57:21.414959 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1045/1999] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:57:21 2022] GET /compute/v2.1/servers/7c5c7ad1-4e7b-427e-8f66-862cc9b2f457 => generated 1463 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:57:21.420219 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-99a78af0-aa51-4362-9760-d3907d5bec68 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:57:21.421067 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-99a78af0-aa51-4362-9760-d3907d5bec68 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] [instance: 28c2b09f-e43f-472b-b8db-f407c341acfd] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:57:21.427526 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-99a78af0-aa51-4362-9760-d3907d5bec68 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:21.428031 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-99a78af0-aa51-4362-9760-d3907d5bec68 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:21.428798 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-99a78af0-aa51-4362-9760-d3907d5bec68 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:21.429652 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-99a78af0-aa51-4362-9760-d3907d5bec68 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:21.430187 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-99a78af0-aa51-4362-9760-d3907d5bec68 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:21.430688 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-99a78af0-aa51-4362-9760-d3907d5bec68 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:22.119808 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-99a78af0-aa51-4362-9760-d3907d5bec68 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e787e0b494764176a0f13d75c47d77fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '371ecb87e8d34859971be23c1a1bc443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:57:22.128414 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-99a78af0-aa51-4362-9760-d3907d5bec68 tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] 10.222.0.18 "GET /compute/v2.1/servers/28c2b09f-e43f-472b-b8db-f407c341acfd" status: 200 len: 1518 microversion: 2.1 time: 0.712184 Oct 22 20:57:22.128996 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1046/2000] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:57:21 2022] GET /compute/v2.1/servers/28c2b09f-e43f-472b-b8db-f407c341acfd => generated 1518 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:57:22.133457 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-7b99b1e3-ffc0-42ff-beea-1bd897afbb9f req-b7b1a1f0-5a77-4e91-bb7b-0a06b2471cfb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f070b144-3a1a-4456-8e5b-02af12557c6a", "name": "network-vif-plugged", "status": "completed", "tag": "9c49ccea-f5ad-47be-9a9c-61df2a8933d5"}, {"server_uuid": "cc3236d7-3b9f-40f2-8a53-3096f986e87e", "name": "network-vif-plugged", "status": "completed", "tag": "61d2ab3f-b602-485a-9534-df55ed5059a1"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:57:22.144403 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-7b99b1e3-ffc0-42ff-beea-1bd897afbb9f req-b7b1a1f0-5a77-4e91-bb7b-0a06b2471cfb service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:22.144885 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-7b99b1e3-ffc0-42ff-beea-1bd897afbb9f req-b7b1a1f0-5a77-4e91-bb7b-0a06b2471cfb service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:22.145318 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-7b99b1e3-ffc0-42ff-beea-1bd897afbb9f req-b7b1a1f0-5a77-4e91-bb7b-0a06b2471cfb service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:22.158551 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-7b99b1e3-ffc0-42ff-beea-1bd897afbb9f req-b7b1a1f0-5a77-4e91-bb7b-0a06b2471cfb service nova] Creating event network-vif-plugged:9c49ccea-f5ad-47be-9a9c-61df2a8933d5 for instance f070b144-3a1a-4456-8e5b-02af12557c6a on nch2-master-1 Oct 22 20:57:22.159074 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-7b99b1e3-ffc0-42ff-beea-1bd897afbb9f req-b7b1a1f0-5a77-4e91-bb7b-0a06b2471cfb service nova] Creating event network-vif-plugged:61d2ab3f-b602-485a-9534-df55ed5059a1 for instance cc3236d7-3b9f-40f2-8a53-3096f986e87e on nch1-master-1 Oct 22 20:57:22.167537 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-7b99b1e3-ffc0-42ff-beea-1bd897afbb9f req-b7b1a1f0-5a77-4e91-bb7b-0a06b2471cfb service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.037352 Oct 22 20:57:22.168149 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1047/2001] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:57:22 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:57:22.173227 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-43d8af2d-d5b7-44e8-b4bd-fb32d79f1ec3 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:57:22.173955 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-43d8af2d-d5b7-44e8-b4bd-fb32d79f1ec3 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] [instance: 5fadabfa-64f5-4c20-9778-b986d965a632] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:57:22.180320 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-43d8af2d-d5b7-44e8-b4bd-fb32d79f1ec3 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:22.180808 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-43d8af2d-d5b7-44e8-b4bd-fb32d79f1ec3 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:22.181295 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-43d8af2d-d5b7-44e8-b4bd-fb32d79f1ec3 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:22.182609 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-43d8af2d-d5b7-44e8-b4bd-fb32d79f1ec3 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:22.183068 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-43d8af2d-d5b7-44e8-b4bd-fb32d79f1ec3 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:22.184051 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-43d8af2d-d5b7-44e8-b4bd-fb32d79f1ec3 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:22.241715 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-0baf9a54-5d76-4ba3-884e-60d84da138ad tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] 10.222.0.18 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.557933 Oct 22 20:57:22.249729 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 955/2002] 10.222.0.18 () {60 vars in 1170 bytes} [Sat Oct 22 20:57:19 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2566 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:57:22.255126 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-3a2718ee-db87-4289-b1c5-6971d6f54440 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:57:22.255976 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-3a2718ee-db87-4289-b1c5-6971d6f54440 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] [instance: f070b144-3a1a-4456-8e5b-02af12557c6a] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:57:22.262998 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3a2718ee-db87-4289-b1c5-6971d6f54440 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:22.263543 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3a2718ee-db87-4289-b1c5-6971d6f54440 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:22.263990 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3a2718ee-db87-4289-b1c5-6971d6f54440 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:22.264703 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3a2718ee-db87-4289-b1c5-6971d6f54440 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:22.265169 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3a2718ee-db87-4289-b1c5-6971d6f54440 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:22.266275 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3a2718ee-db87-4289-b1c5-6971d6f54440 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:22.569392 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-43d8af2d-d5b7-44e8-b4bd-fb32d79f1ec3 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b392ad1fe1fd4b2a9e6be03a7435deb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594624ed28aa433d907c8833d360b82e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:57:22.576920 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-3a2718ee-db87-4289-b1c5-6971d6f54440 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dbe89a7e11480194d3d86f82983499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8351b01e07cd43f9be973ab45e522bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:57:22.578049 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-43d8af2d-d5b7-44e8-b4bd-fb32d79f1ec3 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] 10.222.0.18 "GET /compute/v2.1/servers/5fadabfa-64f5-4c20-9778-b986d965a632" status: 200 len: 1324 microversion: 2.1 time: 0.408711 Oct 22 20:57:22.578731 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1048/2003] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:57:22 2022] GET /compute/v2.1/servers/5fadabfa-64f5-4c20-9778-b986d965a632 => generated 1324 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:57:22.585436 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-3a2718ee-db87-4289-b1c5-6971d6f54440 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] 10.222.0.18 "GET /compute/v2.1/servers/f070b144-3a1a-4456-8e5b-02af12557c6a" status: 200 len: 1313 microversion: 2.1 time: 0.334329 Oct 22 20:57:22.586007 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 956/2004] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:57:22 2022] GET /compute/v2.1/servers/f070b144-3a1a-4456-8e5b-02af12557c6a => generated 1313 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:57:22.590413 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-a40ed3cf-f49f-4053-ac96-5502004514a2 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:57:22.591323 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-a40ed3cf-f49f-4053-ac96-5502004514a2 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] [instance: cc3236d7-3b9f-40f2-8a53-3096f986e87e] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:57:22.592365 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-42cdf8bb-310f-480e-be7f-f0046fccf45b tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:57:22.593173 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-42cdf8bb-310f-480e-be7f-f0046fccf45b tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] [instance: aee36c9d-baf4-453c-b88f-31b8f23638c2] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:57:22.597962 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a40ed3cf-f49f-4053-ac96-5502004514a2 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:22.598629 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a40ed3cf-f49f-4053-ac96-5502004514a2 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:22.599217 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a40ed3cf-f49f-4053-ac96-5502004514a2 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:22.600117 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a40ed3cf-f49f-4053-ac96-5502004514a2 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:22.600717 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a40ed3cf-f49f-4053-ac96-5502004514a2 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:22.601570 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-42cdf8bb-310f-480e-be7f-f0046fccf45b tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:22.601837 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a40ed3cf-f49f-4053-ac96-5502004514a2 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:22.602282 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-42cdf8bb-310f-480e-be7f-f0046fccf45b tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:22.602777 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-42cdf8bb-310f-480e-be7f-f0046fccf45b tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:22.603570 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-42cdf8bb-310f-480e-be7f-f0046fccf45b tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:22.604112 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-42cdf8bb-310f-480e-be7f-f0046fccf45b tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:22.604543 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-42cdf8bb-310f-480e-be7f-f0046fccf45b tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:22.914864 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-a40ed3cf-f49f-4053-ac96-5502004514a2 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d808e98f843dd9621822682c9d278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b58ab4af674c778b4819f177045651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:57:22.919638 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-42cdf8bb-310f-480e-be7f-f0046fccf45b tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d3d7458af447bdb3f03e83a2d8559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49238b8686d24ae698679e4a1957735d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:57:22.923373 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-a40ed3cf-f49f-4053-ac96-5502004514a2 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] 10.222.0.18 "GET /compute/v2.1/servers/cc3236d7-3b9f-40f2-8a53-3096f986e87e" status: 200 len: 1318 microversion: 2.1 time: 0.336015 Oct 22 20:57:22.924066 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 957/2005] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:57:22 2022] GET /compute/v2.1/servers/cc3236d7-3b9f-40f2-8a53-3096f986e87e => generated 1318 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:57:22.928598 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-42cdf8bb-310f-480e-be7f-f0046fccf45b tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] 10.222.0.18 "GET /compute/v2.1/servers/aee36c9d-baf4-453c-b88f-31b8f23638c2" status: 200 len: 1537 microversion: 2.1 time: 0.348552 Oct 22 20:57:22.929193 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1049/2006] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:57:22 2022] GET /compute/v2.1/servers/aee36c9d-baf4-453c-b88f-31b8f23638c2 => generated 1537 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:57:22.945067 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-c166bf3e-7218-4a5a-b3b1-f02f849c1ab3 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.35.2.230"}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:57:22.947702 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-c166bf3e-7218-4a5a-b3b1-f02f849c1ab3 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] [instance: 18183d64-42b7-4b9f-9bca-6d018f17eeb3] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:57:22.954087 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c166bf3e-7218-4a5a-b3b1-f02f849c1ab3 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:22.954606 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c166bf3e-7218-4a5a-b3b1-f02f849c1ab3 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:22.955123 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c166bf3e-7218-4a5a-b3b1-f02f849c1ab3 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:22.955879 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c166bf3e-7218-4a5a-b3b1-f02f849c1ab3 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:22.956330 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c166bf3e-7218-4a5a-b3b1-f02f849c1ab3 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:22.956780 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c166bf3e-7218-4a5a-b3b1-f02f849c1ab3 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:22.984515 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c166bf3e-7218-4a5a-b3b1-f02f849c1ab3 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] Acquiring lock "refresh_cache-18183d64-42b7-4b9f-9bca-6d018f17eeb3" {{(pid=138744) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 22 20:57:22.984928 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c166bf3e-7218-4a5a-b3b1-f02f849c1ab3 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] Acquired lock "refresh_cache-18183d64-42b7-4b9f-9bca-6d018f17eeb3" {{(pid=138744) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 22 20:57:23.152668 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-b55276c7-3c99-4cda-9f24-8b464d362c3a tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:57:23.153626 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-b55276c7-3c99-4cda-9f24-8b464d362c3a tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] [instance: 28c2b09f-e43f-472b-b8db-f407c341acfd] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:57:23.160709 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b55276c7-3c99-4cda-9f24-8b464d362c3a tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:23.161209 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b55276c7-3c99-4cda-9f24-8b464d362c3a tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:23.161646 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b55276c7-3c99-4cda-9f24-8b464d362c3a tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:23.162419 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b55276c7-3c99-4cda-9f24-8b464d362c3a tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:23.162822 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b55276c7-3c99-4cda-9f24-8b464d362c3a tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:23.163250 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b55276c7-3c99-4cda-9f24-8b464d362c3a tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:23.754637 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-b55276c7-3c99-4cda-9f24-8b464d362c3a tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e787e0b494764176a0f13d75c47d77fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '371ecb87e8d34859971be23c1a1bc443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:57:23.774591 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-b55276c7-3c99-4cda-9f24-8b464d362c3a tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] 10.222.0.18 "GET /compute/v2.1/servers/28c2b09f-e43f-472b-b8db-f407c341acfd" status: 200 len: 1518 microversion: 2.1 time: 0.625683 Oct 22 20:57:23.777135 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1050/2007] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:57:23 2022] GET /compute/v2.1/servers/28c2b09f-e43f-472b-b8db-f407c341acfd => generated 1518 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:57:23.782628 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-c4599afd-e2de-4ad7-a59e-641b8eb163cf tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:57:23.783471 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-c4599afd-e2de-4ad7-a59e-641b8eb163cf tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] [instance: 5fadabfa-64f5-4c20-9778-b986d965a632] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:57:23.793366 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c4599afd-e2de-4ad7-a59e-641b8eb163cf tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:23.794128 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c4599afd-e2de-4ad7-a59e-641b8eb163cf tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:23.794565 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c4599afd-e2de-4ad7-a59e-641b8eb163cf tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:23.795245 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c4599afd-e2de-4ad7-a59e-641b8eb163cf tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:23.795909 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c4599afd-e2de-4ad7-a59e-641b8eb163cf tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:23.796339 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c4599afd-e2de-4ad7-a59e-641b8eb163cf tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:24.586333 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-c4599afd-e2de-4ad7-a59e-641b8eb163cf tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b392ad1fe1fd4b2a9e6be03a7435deb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594624ed28aa433d907c8833d360b82e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:57:24.595853 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-c4599afd-e2de-4ad7-a59e-641b8eb163cf tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] 10.222.0.18 "GET /compute/v2.1/servers/5fadabfa-64f5-4c20-9778-b986d965a632" status: 200 len: 1324 microversion: 2.1 time: 0.817354 Oct 22 20:57:24.600362 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1051/2008] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:57:23 2022] GET /compute/v2.1/servers/5fadabfa-64f5-4c20-9778-b986d965a632 => generated 1324 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:57:24.613999 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-da9ff29f-5ba9-4bc9-b046-85ff77e329c1 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:57:24.616563 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-da9ff29f-5ba9-4bc9-b046-85ff77e329c1 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] [instance: f070b144-3a1a-4456-8e5b-02af12557c6a] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:57:24.623896 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-da9ff29f-5ba9-4bc9-b046-85ff77e329c1 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:24.625326 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-da9ff29f-5ba9-4bc9-b046-85ff77e329c1 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:24.627231 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-da9ff29f-5ba9-4bc9-b046-85ff77e329c1 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:24.628217 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-da9ff29f-5ba9-4bc9-b046-85ff77e329c1 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:24.628785 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-da9ff29f-5ba9-4bc9-b046-85ff77e329c1 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:24.629319 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-da9ff29f-5ba9-4bc9-b046-85ff77e329c1 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:25.101742 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-da9ff29f-5ba9-4bc9-b046-85ff77e329c1 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dbe89a7e11480194d3d86f82983499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8351b01e07cd43f9be973ab45e522bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:57:25.113507 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-da9ff29f-5ba9-4bc9-b046-85ff77e329c1 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] 10.222.0.18 "GET /compute/v2.1/servers/f070b144-3a1a-4456-8e5b-02af12557c6a" status: 200 len: 1463 microversion: 2.1 time: 0.505496 Oct 22 20:57:25.114549 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1052/2009] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:57:24 2022] GET /compute/v2.1/servers/f070b144-3a1a-4456-8e5b-02af12557c6a => generated 1463 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:57:25.121230 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-16296849-f77b-438e-b886-82e9ab9c8837 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:57:25.122040 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-16296849-f77b-438e-b886-82e9ab9c8837 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] [instance: cc3236d7-3b9f-40f2-8a53-3096f986e87e] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:57:25.130251 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-16296849-f77b-438e-b886-82e9ab9c8837 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:25.130750 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-16296849-f77b-438e-b886-82e9ab9c8837 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:25.131283 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-16296849-f77b-438e-b886-82e9ab9c8837 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:25.132022 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-16296849-f77b-438e-b886-82e9ab9c8837 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:25.132482 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-16296849-f77b-438e-b886-82e9ab9c8837 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:25.132910 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-16296849-f77b-438e-b886-82e9ab9c8837 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:25.564615 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-16296849-f77b-438e-b886-82e9ab9c8837 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d808e98f843dd9621822682c9d278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b58ab4af674c778b4819f177045651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:57:25.580213 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-16296849-f77b-438e-b886-82e9ab9c8837 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] 10.222.0.18 "GET /compute/v2.1/servers/cc3236d7-3b9f-40f2-8a53-3096f986e87e" status: 200 len: 1318 microversion: 2.1 time: 0.460196 Oct 22 20:57:25.591411 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1053/2010] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:57:25 2022] GET /compute/v2.1/servers/cc3236d7-3b9f-40f2-8a53-3096f986e87e => generated 1318 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:57:25.591411 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-eceeeda7-d23e-4671-b9e5-ab4ff70df0b2 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:57:25.591411 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-eceeeda7-d23e-4671-b9e5-ab4ff70df0b2 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] [instance: aee36c9d-baf4-453c-b88f-31b8f23638c2] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:57:25.605099 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-eceeeda7-d23e-4671-b9e5-ab4ff70df0b2 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:25.605495 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-eceeeda7-d23e-4671-b9e5-ab4ff70df0b2 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:25.606108 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-eceeeda7-d23e-4671-b9e5-ab4ff70df0b2 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:25.609388 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-eceeeda7-d23e-4671-b9e5-ab4ff70df0b2 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:25.609869 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-eceeeda7-d23e-4671-b9e5-ab4ff70df0b2 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:25.610354 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-eceeeda7-d23e-4671-b9e5-ab4ff70df0b2 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:26.193293 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-eceeeda7-d23e-4671-b9e5-ab4ff70df0b2 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d3d7458af447bdb3f03e83a2d8559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49238b8686d24ae698679e4a1957735d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:57:26.203765 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-eceeeda7-d23e-4671-b9e5-ab4ff70df0b2 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] 10.222.0.18 "GET /compute/v2.1/servers/aee36c9d-baf4-453c-b88f-31b8f23638c2" status: 200 len: 1542 microversion: 2.1 time: 0.618174 Oct 22 20:57:26.204532 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1054/2011] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:57:25 2022] GET /compute/v2.1/servers/aee36c9d-baf4-453c-b88f-31b8f23638c2 => generated 1542 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:57:26.214443 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-e2fd4f3a-b760-4581-8a03-d112d141b937 req-0ae3d57a-c682-4ff2-883b-d61c5cb38201 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28c2b09f-e43f-472b-b8db-f407c341acfd", "name": "network-vif-deleted", "tag": "e6478c54-1e5c-45df-8338-b5b4413b28b0"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:57:26.231005 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-e2fd4f3a-b760-4581-8a03-d112d141b937 req-0ae3d57a-c682-4ff2-883b-d61c5cb38201 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:26.231554 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-e2fd4f3a-b760-4581-8a03-d112d141b937 req-0ae3d57a-c682-4ff2-883b-d61c5cb38201 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:26.232369 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-e2fd4f3a-b760-4581-8a03-d112d141b937 req-0ae3d57a-c682-4ff2-883b-d61c5cb38201 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:26.244289 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-e2fd4f3a-b760-4581-8a03-d112d141b937 req-0ae3d57a-c682-4ff2-883b-d61c5cb38201 service nova] Creating event network-vif-deleted:e6478c54-1e5c-45df-8338-b5b4413b28b0 for instance 28c2b09f-e43f-472b-b8db-f407c341acfd on nch1-master-1 Oct 22 20:57:26.249425 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-e2fd4f3a-b760-4581-8a03-d112d141b937 req-0ae3d57a-c682-4ff2-883b-d61c5cb38201 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043540 Oct 22 20:57:26.250461 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1055/2012] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:57:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:57:26.255878 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-56956470-87c2-4904-9aa0-0da3db8ed75b tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:57:26.256564 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-56956470-87c2-4904-9aa0-0da3db8ed75b tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] [instance: 28c2b09f-e43f-472b-b8db-f407c341acfd] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:57:26.264003 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-56956470-87c2-4904-9aa0-0da3db8ed75b tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:26.264649 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-56956470-87c2-4904-9aa0-0da3db8ed75b tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:26.266000 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-56956470-87c2-4904-9aa0-0da3db8ed75b tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:26.267298 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-56956470-87c2-4904-9aa0-0da3db8ed75b tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:26.268157 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-56956470-87c2-4904-9aa0-0da3db8ed75b tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:26.268978 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-56956470-87c2-4904-9aa0-0da3db8ed75b tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:26.287111 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.wsgi [None req-56956470-87c2-4904-9aa0-0da3db8ed75b tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] HTTP exception thrown: Instance 28c2b09f-e43f-472b-b8db-f407c341acfd could not be found. Oct 22 20:57:26.289742 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-56956470-87c2-4904-9aa0-0da3db8ed75b tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Request method failure captured: Oct 22 20:57:26.289742 ncdv-master-1 devstack@n-api.service[138745]: request: GET /compute/v2.1/servers/28c2b09f-e43f-472b-b8db-f407c341acfd HTTP/1.1 Oct 22 20:57:26.289742 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 20:57:26.289742 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 20:57:26.289742 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 20:57:26.289742 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 0 Oct 22 20:57:26.289742 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 20:57:26.289742 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 20:57:26.289742 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 20:57:26.289742 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 20:57:26.289742 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVFjYv4p50pKm8yQakerG7q0mSmw6otGG1EIXq7SL7p47_tL_BzbnQ6yshTzdvSSRVPQrm4IIp-tF4e8RwoazpQebhn6C2339q2qSRT1to0lI2g1NqgKTs2-VzTHnzA1Scc09uq7l8P8iPxC6_1j4JK51RzNGS-E0J731EqNX09e4YDg Oct 22 20:57:26.289742 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 20:57:26.289742 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 20:57:26.289742 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 20:57:26.289742 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 20:57:26.289742 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 20:57:26.289742 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 20:57:26.289742 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: 371ecb87e8d34859971be23c1a1bc443 Oct 22 20:57:26.289742 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-ListServerFiltersTestJSON-1003295825 Oct 22 20:57:26.289742 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 20:57:26.289742 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 20:57:26.289742 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_371ecb87e8d34859971be23c1a1bc443"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/371ecb87e8d34859971be23c1a1bc443"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/371ecb87e8d34859971be23c1a1bc443"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/371ecb87e8d34859971be23c1a1bc443"}]}] Oct 22 20:57:26.289742 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-ListServerFiltersTestJSON-1003295825 Oct 22 20:57:26.289742 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: 371ecb87e8d34859971be23c1a1bc443 Oct 22 20:57:26.289742 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1003295825 Oct 22 20:57:26.289742 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-ListServerFiltersTestJSON-1003295825-project Oct 22 20:57:26.289742 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 20:57:26.289742 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 20:57:26.289742 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: e787e0b494764176a0f13d75c47d77fa Oct 22 20:57:26.289742 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-ListServerFiltersTestJSON-1003295825-project Oct 22 20:57:26.289742 ncdv-master-1 devstack@n-api.service[138745]: method: > Oct 22 20:57:26.289742 ncdv-master-1 devstack@n-api.service[138745]: exception: Instance 28c2b09f-e43f-472b-b8db-f407c341acfd could not be found. Oct 22 20:57:26.289742 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'id': '28c2b09f-e43f-472b-b8db-f407c341acfd'} Oct 22 20:57:26.289742 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:57:26.289742 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:57:26.289742 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 20:57:26.289742 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 20:57:26.289742 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 20:57:26.289742 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 20:57:26.289742 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 20:57:26.289742 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 20:57:26.289742 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 20:57:26.289742 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 20:57:26.289742 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 28c2b09f-e43f-472b-b8db-f407c341acfd could not be found. Oct 22 20:57:26.289742 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:57:26.289742 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:57:26.289742 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:57:26.289742 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:57:26.289742 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:57:26.289742 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:57:26.289742 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:57:26.289742 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:57:26.289742 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:57:26.289742 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:57:26.289742 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 20:57:26.289742 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 20:57:26.289742 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 20:57:26.289742 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 20:57:26.289742 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 20:57:26.289742 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 20:57:26.289742 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 28c2b09f-e43f-472b-b8db-f407c341acfd could not be found. Oct 22 20:57:26.289742 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:57:26.289742 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:57:26.289742 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:57:26.293188 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:57:26.293188 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:57:26.293188 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:57:26.293188 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 20:57:26.293188 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 20:57:26.293188 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 28c2b09f-e43f-472b-b8db-f407c341acfd could not be found. Oct 22 20:57:26.293188 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:57:26.294987 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-56956470-87c2-4904-9aa0-0da3db8ed75b tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] Returning 404 to user: Instance 28c2b09f-e43f-472b-b8db-f407c341acfd could not be found. {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:57:26.296092 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-56956470-87c2-4904-9aa0-0da3db8ed75b tempest-ListServerFiltersTestJSON-1003295825 tempest-ListServerFiltersTestJSON-1003295825-project] 10.222.0.18 "GET /compute/v2.1/servers/28c2b09f-e43f-472b-b8db-f407c341acfd" status: 404 len: 111 microversion: 2.1 time: 0.044549 Oct 22 20:57:26.297382 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1056/2013] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:57:26 2022] GET /compute/v2.1/servers/28c2b09f-e43f-472b-b8db-f407c341acfd => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 20:57:26.303087 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-b8f3d187-db44-416a-80a7-d006c4b9aedd tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-505568350", "imageRef": "085e4478-6edc-4a69-8e08-f9831713eb65", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "f070b144-3a1a-4456-8e5b-02af12557c6a"}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:57:26.364336 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.network.neutron [None req-b8f3d187-db44-416a-80a7-d006c4b9aedd tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] validate_networks() for None {{(pid=138745) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 20:57:26.694625 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.network.neutron [None req-c166bf3e-7218-4a5a-b3b1-f02f849c1ab3 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] [instance: 18183d64-42b7-4b9f-9bca-6d018f17eeb3] Building network info cache for instance {{(pid=138744) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 22 20:57:27.036040 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-b8f3d187-db44-416a-80a7-d006c4b9aedd tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Flavor limits 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 20:57:27.036663 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-b8f3d187-db44-416a-80a7-d006c4b9aedd tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Image limits 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 20:57:27.037125 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-b8f3d187-db44-416a-80a7-d006c4b9aedd tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Flavor pref 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 20:57:27.037706 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-b8f3d187-db44-416a-80a7-d006c4b9aedd tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Image pref 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 20:57:27.038311 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-b8f3d187-db44-416a-80a7-d006c4b9aedd tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 20:57:27.048259 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b8f3d187-db44-416a-80a7-d006c4b9aedd tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:27.048880 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b8f3d187-db44-416a-80a7-d006c4b9aedd tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:27.049487 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b8f3d187-db44-416a-80a7-d006c4b9aedd tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:27.050406 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b8f3d187-db44-416a-80a7-d006c4b9aedd tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:27.050867 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b8f3d187-db44-416a-80a7-d006c4b9aedd tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:27.051280 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b8f3d187-db44-416a-80a7-d006c4b9aedd tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:27.078424 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-b8f3d187-db44-416a-80a7-d006c4b9aedd tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Getting quotas for project 8351b01e07cd43f9be973ab45e522bf0. Resources: {'cores', 'instances', 'ram'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 20:57:27.084874 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-b8f3d187-db44-416a-80a7-d006c4b9aedd tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Getting quotas for user 57dbe89a7e11480194d3d86f82983499 and project 8351b01e07cd43f9be973ab45e522bf0. Resources: {'cores', 'instances', 'ram'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 20:57:27.099132 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-b8f3d187-db44-416a-80a7-d006c4b9aedd tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Going to run 1 instances... {{(pid=138745) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 20:57:27.102157 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-b8f3d187-db44-416a-80a7-d006c4b9aedd tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] [instance: fd812b37-71ed-400f-ba94-050254f85f9e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='085e4478-6edc-4a69-8e08-f9831713eb65',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138745) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 20:57:27.131680 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=1,nova_api:INSERT=2 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:57:27.170615 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-b8f3d187-db44-416a-80a7-d006c4b9aedd tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.871521 Oct 22 20:57:27.172091 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1057/2014] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Oct 22 20:57:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 874 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 20:57:27.184982 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-fcbbe06b-c6e5-4cc3-9aa2-710610c292e2 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:57:27.185662 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-fcbbe06b-c6e5-4cc3-9aa2-710610c292e2 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] [instance: 5fadabfa-64f5-4c20-9778-b986d965a632] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:57:27.194239 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fcbbe06b-c6e5-4cc3-9aa2-710610c292e2 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:27.194822 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fcbbe06b-c6e5-4cc3-9aa2-710610c292e2 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:27.195150 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fcbbe06b-c6e5-4cc3-9aa2-710610c292e2 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:27.195890 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fcbbe06b-c6e5-4cc3-9aa2-710610c292e2 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:27.196354 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fcbbe06b-c6e5-4cc3-9aa2-710610c292e2 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:27.196773 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fcbbe06b-c6e5-4cc3-9aa2-710610c292e2 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:27.518623 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-fcbbe06b-c6e5-4cc3-9aa2-710610c292e2 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b392ad1fe1fd4b2a9e6be03a7435deb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594624ed28aa433d907c8833d360b82e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:57:27.521527 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:57:27.534353 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-fcbbe06b-c6e5-4cc3-9aa2-710610c292e2 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] 10.222.0.18 "GET /compute/v2.1/servers/5fadabfa-64f5-4c20-9778-b986d965a632" status: 200 len: 1324 microversion: 2.1 time: 0.360726 Oct 22 20:57:27.535668 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1058/2015] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:57:27 2022] GET /compute/v2.1/servers/5fadabfa-64f5-4c20-9778-b986d965a632 => generated 1324 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:57:27.544414 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-5bc76ecb-1fb3-4fcb-a1e5-ca436e7f69a4 req-10185010-a3b7-4dfb-a3d8-9656f14acda0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5fadabfa-64f5-4c20-9778-b986d965a632", "name": "network-vif-plugged", "status": "completed", "tag": "b491f705-01d8-463c-9ac5-b840e865c43f"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:57:27.569305 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-5bc76ecb-1fb3-4fcb-a1e5-ca436e7f69a4 req-10185010-a3b7-4dfb-a3d8-9656f14acda0 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:27.569813 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-5bc76ecb-1fb3-4fcb-a1e5-ca436e7f69a4 req-10185010-a3b7-4dfb-a3d8-9656f14acda0 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:27.570584 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-5bc76ecb-1fb3-4fcb-a1e5-ca436e7f69a4 req-10185010-a3b7-4dfb-a3d8-9656f14acda0 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:27.585710 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-5bc76ecb-1fb3-4fcb-a1e5-ca436e7f69a4 req-10185010-a3b7-4dfb-a3d8-9656f14acda0 service nova] Creating event network-vif-plugged:b491f705-01d8-463c-9ac5-b840e865c43f for instance 5fadabfa-64f5-4c20-9778-b986d965a632 on nch1-master-1 Oct 22 20:57:27.590752 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-5bc76ecb-1fb3-4fcb-a1e5-ca436e7f69a4 req-10185010-a3b7-4dfb-a3d8-9656f14acda0 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053613 Oct 22 20:57:27.591965 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1059/2016] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:57:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:57:27.597471 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-221415c9-3eea-4dc5-834a-e2e4f825741a tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:57:27.598383 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-221415c9-3eea-4dc5-834a-e2e4f825741a tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] [instance: cc3236d7-3b9f-40f2-8a53-3096f986e87e] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:57:27.605864 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-221415c9-3eea-4dc5-834a-e2e4f825741a tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:27.606610 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-221415c9-3eea-4dc5-834a-e2e4f825741a tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:27.607728 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-221415c9-3eea-4dc5-834a-e2e4f825741a tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:27.608951 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-221415c9-3eea-4dc5-834a-e2e4f825741a tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:27.609561 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-221415c9-3eea-4dc5-834a-e2e4f825741a tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:27.610162 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-221415c9-3eea-4dc5-834a-e2e4f825741a tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:28.531145 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-221415c9-3eea-4dc5-834a-e2e4f825741a tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d808e98f843dd9621822682c9d278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b58ab4af674c778b4819f177045651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:57:28.543326 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-221415c9-3eea-4dc5-834a-e2e4f825741a tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] 10.222.0.18 "GET /compute/v2.1/servers/cc3236d7-3b9f-40f2-8a53-3096f986e87e" status: 200 len: 1468 microversion: 2.1 time: 0.949992 Oct 22 20:57:28.544097 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1060/2017] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:57:27 2022] GET /compute/v2.1/servers/cc3236d7-3b9f-40f2-8a53-3096f986e87e => generated 1468 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:57:28.548858 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-4ca7d858-f559-4672-a0fc-1e78e667a348 req-d16a18bc-7987-408e-8eab-968cfde8b4ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "18183d64-42b7-4b9f-9bca-6d018f17eeb3", "tag": "26816847-4085-4357-9ca7-d768088c1a37"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:57:28.559056 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-4ca7d858-f559-4672-a0fc-1e78e667a348 req-d16a18bc-7987-408e-8eab-968cfde8b4ac service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:28.560051 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-4ca7d858-f559-4672-a0fc-1e78e667a348 req-d16a18bc-7987-408e-8eab-968cfde8b4ac service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:28.560762 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-4ca7d858-f559-4672-a0fc-1e78e667a348 req-d16a18bc-7987-408e-8eab-968cfde8b4ac service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:28.591293 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-4ca7d858-f559-4672-a0fc-1e78e667a348 req-d16a18bc-7987-408e-8eab-968cfde8b4ac service nova] Creating event network-changed:26816847-4085-4357-9ca7-d768088c1a37 for instance 18183d64-42b7-4b9f-9bca-6d018f17eeb3 on nch1-master-1 Oct 22 20:57:28.596524 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-4ca7d858-f559-4672-a0fc-1e78e667a348 req-d16a18bc-7987-408e-8eab-968cfde8b4ac service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051008 Oct 22 20:57:28.597401 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1061/2018] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:57:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:57:28.604544 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-d9c952f3-0510-4285-954b-8202eade201c tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:57:28.605492 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-d9c952f3-0510-4285-954b-8202eade201c tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] [instance: fd812b37-71ed-400f-ba94-050254f85f9e] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:57:28.631758 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d9c952f3-0510-4285-954b-8202eade201c tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:28.639269 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d9c952f3-0510-4285-954b-8202eade201c tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:28.639269 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d9c952f3-0510-4285-954b-8202eade201c tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:28.639269 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d9c952f3-0510-4285-954b-8202eade201c tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:28.639269 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d9c952f3-0510-4285-954b-8202eade201c tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:28.639269 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d9c952f3-0510-4285-954b-8202eade201c tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:28.698188 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.network.neutron [None req-c166bf3e-7218-4a5a-b3b1-f02f849c1ab3 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] [instance: 18183d64-42b7-4b9f-9bca-6d018f17eeb3] Updating instance_info_cache with network_info: [{"id": "26816847-4085-4357-9ca7-d768088c1a37", "address": "fa:16:3e:76:ee:d6", "network": {"id": "f91354a8-e9f6-4d96-999f-cacf94b2f223", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-515688257-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.2.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "7e883d7e73084efeb725945ae0bab317", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap26816847-40", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=138744) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 22 20:57:28.718044 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c166bf3e-7218-4a5a-b3b1-f02f849c1ab3 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] Releasing lock "refresh_cache-18183d64-42b7-4b9f-9bca-6d018f17eeb3" {{(pid=138744) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 22 20:57:28.719024 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-c166bf3e-7218-4a5a-b3b1-f02f849c1ab3 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] 10.222.0.18 "POST /compute/v2.1/servers/18183d64-42b7-4b9f-9bca-6d018f17eeb3/action" status: 202 len: 0 microversion: 2.1 time: 5.781540 Oct 22 20:57:28.719826 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 958/2019] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 20:57:22 2022] POST /compute/v2.1/servers/18183d64-42b7-4b9f-9bca-6d018f17eeb3/action => generated 0 bytes in 5795 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 22 20:57:28.727515 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-2d6aceaa-ae15-4d80-ae07-7c09d15ca19a tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:57:28.728047 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-2d6aceaa-ae15-4d80-ae07-7c09d15ca19a tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] [instance: aee36c9d-baf4-453c-b88f-31b8f23638c2] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:57:28.733582 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-d9c952f3-0510-4285-954b-8202eade201c tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dbe89a7e11480194d3d86f82983499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8351b01e07cd43f9be973ab45e522bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:57:28.735458 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2d6aceaa-ae15-4d80-ae07-7c09d15ca19a tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:28.736303 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2d6aceaa-ae15-4d80-ae07-7c09d15ca19a tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:28.736963 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2d6aceaa-ae15-4d80-ae07-7c09d15ca19a tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:28.737881 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2d6aceaa-ae15-4d80-ae07-7c09d15ca19a tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:28.738500 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2d6aceaa-ae15-4d80-ae07-7c09d15ca19a tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:28.739215 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2d6aceaa-ae15-4d80-ae07-7c09d15ca19a tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:28.746909 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-d9c952f3-0510-4285-954b-8202eade201c tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] 10.222.0.18 "GET /compute/v2.1/servers/fd812b37-71ed-400f-ba94-050254f85f9e" status: 200 len: 1265 microversion: 2.1 time: 0.148066 Oct 22 20:57:28.760268 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1062/2020] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:57:28 2022] GET /compute/v2.1/servers/fd812b37-71ed-400f-ba94-050254f85f9e => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:57:28.769838 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-263deff8-606c-416a-9043-2913c44aff58 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:57:28.776193 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-263deff8-606c-416a-9043-2913c44aff58 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] [instance: 5fadabfa-64f5-4c20-9778-b986d965a632] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:57:28.790011 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-263deff8-606c-416a-9043-2913c44aff58 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:28.790823 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-263deff8-606c-416a-9043-2913c44aff58 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:28.791639 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-263deff8-606c-416a-9043-2913c44aff58 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:28.793478 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-263deff8-606c-416a-9043-2913c44aff58 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:28.794147 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-263deff8-606c-416a-9043-2913c44aff58 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:28.794749 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-263deff8-606c-416a-9043-2913c44aff58 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:29.249959 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-263deff8-606c-416a-9043-2913c44aff58 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b392ad1fe1fd4b2a9e6be03a7435deb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594624ed28aa433d907c8833d360b82e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:57:29.259986 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-2d6aceaa-ae15-4d80-ae07-7c09d15ca19a tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d3d7458af447bdb3f03e83a2d8559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49238b8686d24ae698679e4a1957735d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:57:29.265474 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-263deff8-606c-416a-9043-2913c44aff58 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] 10.222.0.18 "GET /compute/v2.1/servers/5fadabfa-64f5-4c20-9778-b986d965a632" status: 200 len: 1324 microversion: 2.1 time: 0.502443 Oct 22 20:57:29.266079 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1063/2021] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:57:28 2022] GET /compute/v2.1/servers/5fadabfa-64f5-4c20-9778-b986d965a632 => generated 1324 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:57:29.270467 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-2d6aceaa-ae15-4d80-ae07-7c09d15ca19a tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] 10.222.0.18 "GET /compute/v2.1/servers/aee36c9d-baf4-453c-b88f-31b8f23638c2" status: 200 len: 1542 microversion: 2.1 time: 0.549359 Oct 22 20:57:29.272057 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 959/2022] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:57:28 2022] GET /compute/v2.1/servers/aee36c9d-baf4-453c-b88f-31b8f23638c2 => generated 1542 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:57:29.295795 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-a6db19db-c89d-462a-8ed1-ad773a9084a4 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] Action: 'create', calling method: .version_select at 0x7fd3a8c09b80>, body: {"pool": "355a8481-8802-4295-9cce-2185db0a47d1"} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:57:29.613195 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-a2ad1253-2971-4ac8-a7f5-6d4976d1bdd6 tempest-LiveMigrationNegativeTest-1259453977 tempest-LiveMigrationNegativeTest-1259453977-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "tempest-host-955536229", "block_migration": true, "disk_over_commit": false}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:57:29.616257 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-a2ad1253-2971-4ac8-a7f5-6d4976d1bdd6 tempest-LiveMigrationNegativeTest-1259453977 tempest-LiveMigrationNegativeTest-1259453977-project-admin] [instance: cc3236d7-3b9f-40f2-8a53-3096f986e87e] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:57:29.624959 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a2ad1253-2971-4ac8-a7f5-6d4976d1bdd6 tempest-LiveMigrationNegativeTest-1259453977 tempest-LiveMigrationNegativeTest-1259453977-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:29.625742 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a2ad1253-2971-4ac8-a7f5-6d4976d1bdd6 tempest-LiveMigrationNegativeTest-1259453977 tempest-LiveMigrationNegativeTest-1259453977-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:29.626280 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a2ad1253-2971-4ac8-a7f5-6d4976d1bdd6 tempest-LiveMigrationNegativeTest-1259453977 tempest-LiveMigrationNegativeTest-1259453977-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:29.627300 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a2ad1253-2971-4ac8-a7f5-6d4976d1bdd6 tempest-LiveMigrationNegativeTest-1259453977 tempest-LiveMigrationNegativeTest-1259453977-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:29.628038 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a2ad1253-2971-4ac8-a7f5-6d4976d1bdd6 tempest-LiveMigrationNegativeTest-1259453977 tempest-LiveMigrationNegativeTest-1259453977-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:29.628618 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a2ad1253-2971-4ac8-a7f5-6d4976d1bdd6 tempest-LiveMigrationNegativeTest-1259453977 tempest-LiveMigrationNegativeTest-1259453977-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:29.666620 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.objects.instance [None req-a2ad1253-2971-4ac8-a7f5-6d4976d1bdd6 tempest-LiveMigrationNegativeTest-1259453977 tempest-LiveMigrationNegativeTest-1259453977-project-admin] Lazy-loading 'flavor' on Instance uuid cc3236d7-3b9f-40f2-8a53-3096f986e87e {{(pid=138745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 20:57:29.697384 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-a2ad1253-2971-4ac8-a7f5-6d4976d1bdd6 tempest-LiveMigrationNegativeTest-1259453977 tempest-LiveMigrationNegativeTest-1259453977-project-admin] [instance: cc3236d7-3b9f-40f2-8a53-3096f986e87e] Going to try to live migrate instance to tempest-host-955536229 {{(pid=138745) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 22 20:57:29.709021 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.wsgi [None req-a2ad1253-2971-4ac8-a7f5-6d4976d1bdd6 tempest-LiveMigrationNegativeTest-1259453977 tempest-LiveMigrationNegativeTest-1259453977-project-admin] HTTP exception thrown: Compute host tempest-host-955536229 could not be found. Oct 22 20:57:29.720150 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-a2ad1253-2971-4ac8-a7f5-6d4976d1bdd6 tempest-LiveMigrationNegativeTest-1259453977 tempest-LiveMigrationNegativeTest-1259453977-project-admin] Request method failure captured: Oct 22 20:57:29.720150 ncdv-master-1 devstack@n-api.service[138745]: request: POST /compute/v2.1/servers/cc3236d7-3b9f-40f2-8a53-3096f986e87e/action HTTP/1.1 Oct 22 20:57:29.720150 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 20:57:29.720150 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 20:57:29.720150 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 20:57:29.720150 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 106 Oct 22 20:57:29.720150 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 20:57:29.720150 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 20:57:29.720150 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 20:57:29.720150 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 20:57:29.720150 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVFkYeD1NYVSqkbc7m3wiemIxbtdbMPl4_E3wWH8TlZAo5oNiXQvav-t8cOvEsFGJWnKGeRIPlt4QQDKWDamJ2M4aikg9uG95yfmcR2LOQdQLtyj2nrza1FXApvIG7XMSIL-NErKhjqUuT0dfyHn9KnmPY8josOf9qcQbNVO-Gu0gQkk Oct 22 20:57:29.720150 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 20:57:29.720150 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 20:57:29.720150 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 20:57:29.720150 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 20:57:29.720150 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 20:57:29.720150 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 20:57:29.720150 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: 3f61a419b4c04c41beda5ee46a20d750 Oct 22 20:57:29.720150 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-LiveMigrationNegativeTest-1259453977 Oct 22 20:57:29.720150 ncdv-master-1 devstack@n-api.service[138745]: X-Role: admin,member,reader Oct 22 20:57:29.720150 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: admin,member,reader Oct 22 20:57:29.720150 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_3f61a419b4c04c41beda5ee46a20d750"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/3f61a419b4c04c41beda5ee46a20d750"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/3f61a419b4c04c41beda5ee46a20d750"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/3f61a419b4c04c41beda5ee46a20d750"}]}] Oct 22 20:57:29.720150 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-LiveMigrationNegativeTest-1259453977 Oct 22 20:57:29.720150 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: 3f61a419b4c04c41beda5ee46a20d750 Oct 22 20:57:29.720150 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1259453977 Oct 22 20:57:29.720150 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-LiveMigrationNegativeTest-1259453977-project-admin Oct 22 20:57:29.720150 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 20:57:29.720150 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 20:57:29.720150 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: 780d25299fec4d658c0bf856ca2381db Oct 22 20:57:29.720150 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-LiveMigrationNegativeTest-1259453977-project-admin Oct 22 20:57:29.720150 ncdv-master-1 devstack@n-api.service[138745]: Oct 22 20:57:29.720150 ncdv-master-1 devstack@n-api.service[138745]: {"os-migrateLive": {"host": "tempest-host-955536229", "block_migration": true, "disk_over_commit": false}} Oct 22 20:57:29.720150 ncdv-master-1 devstack@n-api.service[138745]: method: > Oct 22 20:57:29.720150 ncdv-master-1 devstack@n-api.service[138745]: exception: Compute host tempest-host-955536229 could not be found. Oct 22 20:57:29.720150 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'id': 'cc3236d7-3b9f-40f2-8a53-3096f986e87e', 'body': {'os-migrateLive': {'host': 'tempest-host-955536229', 'block_migration': True, 'disk_over_commit': False}}} Oct 22 20:57:29.720150 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:57:29.720150 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:57:29.720150 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Oct 22 20:57:29.720150 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Oct 22 20:57:29.720150 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 22 20:57:29.720150 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 22 20:57:29.720150 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 22 20:57:29.720150 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 22 20:57:29.720150 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 22 20:57:29.720150 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 22 20:57:29.720150 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 22 20:57:29.720150 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 22 20:57:29.720150 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 22 20:57:29.720150 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 22 20:57:29.720150 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Oct 22 20:57:29.720150 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 22 20:57:29.720150 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 22 20:57:29.720150 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 22 20:57:29.720150 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 22 20:57:29.720150 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 22 20:57:29.720150 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5488, in live_migrate Oct 22 20:57:29.720150 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nodes = objects.ComputeNodeList.get_all_by_host(context, host_name) Oct 22 20:57:29.720150 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 22 20:57:29.720150 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 22 20:57:29.720150 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 476, in get_all_by_host Oct 22 20:57:29.720150 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi db_computes = cls._db_compute_node_get_all_by_host(context, host, Oct 22 20:57:29.724659 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 179, in wrapper Oct 22 20:57:29.724659 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:57:29.724659 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 472, in _db_compute_node_get_all_by_host Oct 22 20:57:29.724659 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return db.compute_node_get_all_by_host(context, host) Oct 22 20:57:29.724659 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 241, in wrapper Oct 22 20:57:29.724659 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(context, *args, **kwargs) Oct 22 20:57:29.724659 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 740, in compute_node_get_all_by_host Oct 22 20:57:29.724659 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host) Oct 22 20:57:29.724659 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-host-955536229 could not be found. Oct 22 20:57:29.724659 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:57:29.724659 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:57:29.724659 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:57:29.724659 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:57:29.724659 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:57:29.724659 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:57:29.724659 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:57:29.724659 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:57:29.724659 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:57:29.724659 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:57:29.724659 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 20:57:29.724659 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 20:57:29.724659 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 20:57:29.724659 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 20:57:29.724659 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 20:57:29.724659 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 20:57:29.724659 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 22 20:57:29.724659 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 150, in _migrate_live Oct 22 20:57:29.724659 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 22 20:57:29.724659 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Compute host tempest-host-955536229 could not be found. Oct 22 20:57:29.724659 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:57:29.724659 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:57:29.724659 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:57:29.724659 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:57:29.724659 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:57:29.724659 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:57:29.724659 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 20:57:29.724659 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 20:57:29.724659 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-host-955536229 could not be found. Oct 22 20:57:29.724659 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:57:29.730637 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-a2ad1253-2971-4ac8-a7f5-6d4976d1bdd6 tempest-LiveMigrationNegativeTest-1259453977 tempest-LiveMigrationNegativeTest-1259453977-project-admin] Returning 400 to user: Compute host tempest-host-955536229 could not be found. {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:57:29.733172 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-a2ad1253-2971-4ac8-a7f5-6d4976d1bdd6 tempest-LiveMigrationNegativeTest-1259453977 tempest-LiveMigrationNegativeTest-1259453977-project-admin] 10.222.0.18 "POST /compute/v2.1/servers/cc3236d7-3b9f-40f2-8a53-3096f986e87e/action" status: 400 len: 99 microversion: 2.1 time: 0.452566 Oct 22 20:57:29.735198 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1064/2023] 10.222.0.18 () {60 vars in 1279 bytes} [Sat Oct 22 20:57:29 2022] POST /compute/v2.1/servers/cc3236d7-3b9f-40f2-8a53-3096f986e87e/action => generated 99 bytes in 469 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 22 20:57:29.750797 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-19700232-8035-494b-a78a-3a51cbd1268c tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:57:29.752928 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-19700232-8035-494b-a78a-3a51cbd1268c tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] [instance: cc3236d7-3b9f-40f2-8a53-3096f986e87e] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:57:29.771752 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-19700232-8035-494b-a78a-3a51cbd1268c tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:29.772532 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-19700232-8035-494b-a78a-3a51cbd1268c tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:29.773119 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-19700232-8035-494b-a78a-3a51cbd1268c tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:29.774024 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-19700232-8035-494b-a78a-3a51cbd1268c tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:29.774617 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-19700232-8035-494b-a78a-3a51cbd1268c tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:29.775319 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-19700232-8035-494b-a78a-3a51cbd1268c tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:30.359327 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-19700232-8035-494b-a78a-3a51cbd1268c tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d808e98f843dd9621822682c9d278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b58ab4af674c778b4819f177045651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:57:30.369811 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-19700232-8035-494b-a78a-3a51cbd1268c tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] 10.222.0.18 "GET /compute/v2.1/servers/cc3236d7-3b9f-40f2-8a53-3096f986e87e" status: 200 len: 1468 microversion: 2.1 time: 0.629213 Oct 22 20:57:30.370808 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1065/2024] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:57:29 2022] GET /compute/v2.1/servers/cc3236d7-3b9f-40f2-8a53-3096f986e87e => generated 1468 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:57:30.376617 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-d2a90c7d-8638-4000-8c6f-2bac8e681543 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:57:30.377762 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-d2a90c7d-8638-4000-8c6f-2bac8e681543 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] [instance: fd812b37-71ed-400f-ba94-050254f85f9e] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:57:30.385447 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d2a90c7d-8638-4000-8c6f-2bac8e681543 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:30.386319 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d2a90c7d-8638-4000-8c6f-2bac8e681543 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:30.391175 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d2a90c7d-8638-4000-8c6f-2bac8e681543 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:30.394240 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d2a90c7d-8638-4000-8c6f-2bac8e681543 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:30.395423 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d2a90c7d-8638-4000-8c6f-2bac8e681543 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:30.395873 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d2a90c7d-8638-4000-8c6f-2bac8e681543 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:30.531293 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-d2a90c7d-8638-4000-8c6f-2bac8e681543 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dbe89a7e11480194d3d86f82983499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8351b01e07cd43f9be973ab45e522bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:57:30.540007 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-d2a90c7d-8638-4000-8c6f-2bac8e681543 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] 10.222.0.18 "GET /compute/v2.1/servers/fd812b37-71ed-400f-ba94-050254f85f9e" status: 200 len: 1271 microversion: 2.1 time: 0.167561 Oct 22 20:57:30.541524 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1066/2025] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:57:30 2022] GET /compute/v2.1/servers/fd812b37-71ed-400f-ba94-050254f85f9e => generated 1271 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:57:30.546846 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-497daf3d-093f-4592-9d5a-a2c6c941dd38 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:57:30.547888 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-497daf3d-093f-4592-9d5a-a2c6c941dd38 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] [instance: 5fadabfa-64f5-4c20-9778-b986d965a632] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:57:30.556195 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-497daf3d-093f-4592-9d5a-a2c6c941dd38 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:30.557891 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-497daf3d-093f-4592-9d5a-a2c6c941dd38 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:30.560192 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-497daf3d-093f-4592-9d5a-a2c6c941dd38 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:30.565175 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-497daf3d-093f-4592-9d5a-a2c6c941dd38 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:30.567389 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-497daf3d-093f-4592-9d5a-a2c6c941dd38 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:30.569464 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-497daf3d-093f-4592-9d5a-a2c6c941dd38 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:31.165354 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-497daf3d-093f-4592-9d5a-a2c6c941dd38 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b392ad1fe1fd4b2a9e6be03a7435deb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594624ed28aa433d907c8833d360b82e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:57:31.185797 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-497daf3d-093f-4592-9d5a-a2c6c941dd38 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] 10.222.0.18 "GET /compute/v2.1/servers/5fadabfa-64f5-4c20-9778-b986d965a632" status: 200 len: 1520 microversion: 2.1 time: 0.639172 Oct 22 20:57:31.203294 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1067/2026] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:57:30 2022] GET /compute/v2.1/servers/5fadabfa-64f5-4c20-9778-b986d965a632 => generated 1520 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:57:31.205581 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-463da94f-752e-4750-b73c-fb0e2084cc98 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:57:31.206476 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-463da94f-752e-4750-b73c-fb0e2084cc98 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] [instance: aee36c9d-baf4-453c-b88f-31b8f23638c2] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:57:31.224535 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-463da94f-752e-4750-b73c-fb0e2084cc98 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:31.225735 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-463da94f-752e-4750-b73c-fb0e2084cc98 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:31.226626 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-463da94f-752e-4750-b73c-fb0e2084cc98 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:31.227447 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-463da94f-752e-4750-b73c-fb0e2084cc98 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:31.228576 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-463da94f-752e-4750-b73c-fb0e2084cc98 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:31.229631 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-463da94f-752e-4750-b73c-fb0e2084cc98 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:31.969808 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-463da94f-752e-4750-b73c-fb0e2084cc98 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d3d7458af447bdb3f03e83a2d8559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49238b8686d24ae698679e4a1957735d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:57:31.978237 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-463da94f-752e-4750-b73c-fb0e2084cc98 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] 10.222.0.18 "GET /compute/v2.1/servers/aee36c9d-baf4-453c-b88f-31b8f23638c2" status: 200 len: 1542 microversion: 2.1 time: 0.788927 Oct 22 20:57:31.985495 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1068/2027] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:57:31 2022] GET /compute/v2.1/servers/aee36c9d-baf4-453c-b88f-31b8f23638c2 => generated 1542 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:57:32.002427 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-520ce83b-d6b6-4c58-9005-066a93e78e17 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-720815949", "imageRef": "085e4478-6edc-4a69-8e08-f9831713eb65", "flavorRef": "452"}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:57:32.064206 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.network.neutron [None req-520ce83b-d6b6-4c58-9005-066a93e78e17 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] validate_networks() for None {{(pid=138745) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 20:57:32.649567 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-520ce83b-d6b6-4c58-9005-066a93e78e17 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Flavor limits 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 20:57:32.650927 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-520ce83b-d6b6-4c58-9005-066a93e78e17 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Image limits 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 20:57:32.651595 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-520ce83b-d6b6-4c58-9005-066a93e78e17 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Flavor pref 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 20:57:32.652162 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-520ce83b-d6b6-4c58-9005-066a93e78e17 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Image pref 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 20:57:32.652722 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-520ce83b-d6b6-4c58-9005-066a93e78e17 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 20:57:32.665732 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-520ce83b-d6b6-4c58-9005-066a93e78e17 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:32.666490 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-520ce83b-d6b6-4c58-9005-066a93e78e17 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:32.667078 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-520ce83b-d6b6-4c58-9005-066a93e78e17 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:32.669650 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-520ce83b-d6b6-4c58-9005-066a93e78e17 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:32.670386 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-520ce83b-d6b6-4c58-9005-066a93e78e17 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:32.670986 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-520ce83b-d6b6-4c58-9005-066a93e78e17 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:32.694049 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-520ce83b-d6b6-4c58-9005-066a93e78e17 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Getting quotas for project a8b58ab4af674c778b4819f177045651. Resources: {'cores', 'instances', 'ram'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 20:57:32.702209 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-520ce83b-d6b6-4c58-9005-066a93e78e17 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Getting quotas for user 0d0d808e98f843dd9621822682c9d278 and project a8b58ab4af674c778b4819f177045651. Resources: {'cores', 'instances', 'ram'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 20:57:32.720397 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-520ce83b-d6b6-4c58-9005-066a93e78e17 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Going to run 1 instances... {{(pid=138745) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 20:57:32.723482 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-520ce83b-d6b6-4c58-9005-066a93e78e17 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] [instance: 829a4155-cf7c-470d-a127-c729e32747fe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='085e4478-6edc-4a69-8e08-f9831713eb65',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138745) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 20:57:32.811110 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-520ce83b-d6b6-4c58-9005-066a93e78e17 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.824114 Oct 22 20:57:32.818115 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1069/2028] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Oct 22 20:57:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 831 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 20:57:32.832685 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-61f9a262-1af6-45d6-8228-10ce131db506 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:57:32.833550 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-61f9a262-1af6-45d6-8228-10ce131db506 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] [instance: 5fadabfa-64f5-4c20-9778-b986d965a632] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:57:32.851616 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-61f9a262-1af6-45d6-8228-10ce131db506 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:32.852352 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-61f9a262-1af6-45d6-8228-10ce131db506 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:32.854061 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-61f9a262-1af6-45d6-8228-10ce131db506 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:32.855533 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-61f9a262-1af6-45d6-8228-10ce131db506 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:32.856154 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-61f9a262-1af6-45d6-8228-10ce131db506 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:32.856723 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-61f9a262-1af6-45d6-8228-10ce131db506 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:32.896028 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-61f9a262-1af6-45d6-8228-10ce131db506 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] [instance: 5fadabfa-64f5-4c20-9778-b986d965a632] Going to try to terminate instance {{(pid=138745) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 20:57:33.082310 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-61f9a262-1af6-45d6-8228-10ce131db506 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] 10.222.0.18 "DELETE /compute/v2.1/servers/5fadabfa-64f5-4c20-9778-b986d965a632" status: 204 len: 0 microversion: 2.1 time: 0.261600 Oct 22 20:57:33.083907 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1070/2029] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 20:57:32 2022] DELETE /compute/v2.1/servers/5fadabfa-64f5-4c20-9778-b986d965a632 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 20:57:33.100548 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-ae0c4ee6-49f6-4031-b0e3-f1ab7d125c6f tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:57:33.102429 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-ae0c4ee6-49f6-4031-b0e3-f1ab7d125c6f tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] [instance: fd812b37-71ed-400f-ba94-050254f85f9e] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:57:33.112621 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ae0c4ee6-49f6-4031-b0e3-f1ab7d125c6f tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:33.113920 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ae0c4ee6-49f6-4031-b0e3-f1ab7d125c6f tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:33.114508 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ae0c4ee6-49f6-4031-b0e3-f1ab7d125c6f tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:33.115412 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ae0c4ee6-49f6-4031-b0e3-f1ab7d125c6f tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:33.116041 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ae0c4ee6-49f6-4031-b0e3-f1ab7d125c6f tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:33.116614 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ae0c4ee6-49f6-4031-b0e3-f1ab7d125c6f tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:33.579316 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-a6db19db-c89d-462a-8ed1-ad773a9084a4 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] 10.222.0.18 "POST /compute/v2.1/os-floating-ips" status: 200 len: 140 microversion: 2.1 time: 4.305278 Oct 22 20:57:33.589844 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 960/2030] 10.222.0.18 () {60 vars in 1170 bytes} [Sat Oct 22 20:57:29 2022] POST /compute/v2.1/os-floating-ips => generated 140 bytes in 4317 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:57:33.597455 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-1390e433-9eaa-4090-aa0d-170c7aca8628 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:57:33.598474 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-1390e433-9eaa-4090-aa0d-170c7aca8628 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] [instance: 829a4155-cf7c-470d-a127-c729e32747fe] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:57:33.616265 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1390e433-9eaa-4090-aa0d-170c7aca8628 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:33.617791 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1390e433-9eaa-4090-aa0d-170c7aca8628 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:33.618476 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1390e433-9eaa-4090-aa0d-170c7aca8628 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:33.619292 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1390e433-9eaa-4090-aa0d-170c7aca8628 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:33.619997 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1390e433-9eaa-4090-aa0d-170c7aca8628 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:33.620531 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1390e433-9eaa-4090-aa0d-170c7aca8628 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:33.620659 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-ae0c4ee6-49f6-4031-b0e3-f1ab7d125c6f tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dbe89a7e11480194d3d86f82983499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8351b01e07cd43f9be973ab45e522bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:57:33.633995 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-ae0c4ee6-49f6-4031-b0e3-f1ab7d125c6f tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] 10.222.0.18 "GET /compute/v2.1/servers/fd812b37-71ed-400f-ba94-050254f85f9e" status: 200 len: 1313 microversion: 2.1 time: 0.548720 Oct 22 20:57:33.634774 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1071/2031] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:57:33 2022] GET /compute/v2.1/servers/fd812b37-71ed-400f-ba94-050254f85f9e => generated 1313 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:57:33.643120 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-8c0c3c6d-230c-4358-bd63-53694b11fc2f tempest-ServersTestFqdnHostnames-400258971 tempest-ServersTestFqdnHostnames-400258971-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:57:33.654375 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-8c0c3c6d-230c-4358-bd63-53694b11fc2f tempest-ServersTestFqdnHostnames-400258971 tempest-ServersTestFqdnHostnames-400258971-project] [instance: 78aef3f6-9cff-4db4-95c1-f0d5480b7a3c] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:57:33.664432 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8c0c3c6d-230c-4358-bd63-53694b11fc2f tempest-ServersTestFqdnHostnames-400258971 tempest-ServersTestFqdnHostnames-400258971-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:33.668029 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8c0c3c6d-230c-4358-bd63-53694b11fc2f tempest-ServersTestFqdnHostnames-400258971 tempest-ServersTestFqdnHostnames-400258971-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:33.668743 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8c0c3c6d-230c-4358-bd63-53694b11fc2f tempest-ServersTestFqdnHostnames-400258971 tempest-ServersTestFqdnHostnames-400258971-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:33.679954 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8c0c3c6d-230c-4358-bd63-53694b11fc2f tempest-ServersTestFqdnHostnames-400258971 tempest-ServersTestFqdnHostnames-400258971-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:33.689354 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8c0c3c6d-230c-4358-bd63-53694b11fc2f tempest-ServersTestFqdnHostnames-400258971 tempest-ServersTestFqdnHostnames-400258971-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:33.690163 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8c0c3c6d-230c-4358-bd63-53694b11fc2f tempest-ServersTestFqdnHostnames-400258971 tempest-ServersTestFqdnHostnames-400258971-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:33.735908 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-8c0c3c6d-230c-4358-bd63-53694b11fc2f tempest-ServersTestFqdnHostnames-400258971 tempest-ServersTestFqdnHostnames-400258971-project] [instance: 78aef3f6-9cff-4db4-95c1-f0d5480b7a3c] Going to try to terminate instance {{(pid=138745) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 20:57:33.760847 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-1390e433-9eaa-4090-aa0d-170c7aca8628 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d808e98f843dd9621822682c9d278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b58ab4af674c778b4819f177045651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:57:33.777241 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-1390e433-9eaa-4090-aa0d-170c7aca8628 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] 10.222.0.18 "GET /compute/v2.1/servers/829a4155-cf7c-470d-a127-c729e32747fe" status: 200 len: 1214 microversion: 2.1 time: 0.185747 Oct 22 20:57:33.777847 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 961/2032] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:57:33 2022] GET /compute/v2.1/servers/829a4155-cf7c-470d-a127-c729e32747fe => generated 1214 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:57:33.788903 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-e1bdda2a-c9a1-4bd9-85a8-d883e2a02c76 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:57:33.796749 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-e1bdda2a-c9a1-4bd9-85a8-d883e2a02c76 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] [instance: aee36c9d-baf4-453c-b88f-31b8f23638c2] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:57:33.817632 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e1bdda2a-c9a1-4bd9-85a8-d883e2a02c76 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:33.818132 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e1bdda2a-c9a1-4bd9-85a8-d883e2a02c76 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:33.818581 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e1bdda2a-c9a1-4bd9-85a8-d883e2a02c76 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:33.819311 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e1bdda2a-c9a1-4bd9-85a8-d883e2a02c76 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:33.819805 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e1bdda2a-c9a1-4bd9-85a8-d883e2a02c76 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:33.820237 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e1bdda2a-c9a1-4bd9-85a8-d883e2a02c76 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:33.909291 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-8c0c3c6d-230c-4358-bd63-53694b11fc2f tempest-ServersTestFqdnHostnames-400258971 tempest-ServersTestFqdnHostnames-400258971-project] 10.222.0.18 "DELETE /compute/v2.1/servers/78aef3f6-9cff-4db4-95c1-f0d5480b7a3c" status: 204 len: 0 microversion: 2.1 time: 0.272980 Oct 22 20:57:33.910019 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1072/2033] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 20:57:33 2022] DELETE /compute/v2.1/servers/78aef3f6-9cff-4db4-95c1-f0d5480b7a3c => generated 0 bytes in 275 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 20:57:33.920751 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-d68c705f-f1ed-4855-aa97-aa6f3894286d tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:57:33.921665 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-d68c705f-f1ed-4855-aa97-aa6f3894286d tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] [instance: 5fadabfa-64f5-4c20-9778-b986d965a632] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:57:33.930276 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d68c705f-f1ed-4855-aa97-aa6f3894286d tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:33.930276 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d68c705f-f1ed-4855-aa97-aa6f3894286d tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:33.933703 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d68c705f-f1ed-4855-aa97-aa6f3894286d tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:33.933703 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d68c705f-f1ed-4855-aa97-aa6f3894286d tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:33.933703 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d68c705f-f1ed-4855-aa97-aa6f3894286d tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:33.933703 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d68c705f-f1ed-4855-aa97-aa6f3894286d tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:34.391668 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-e1bdda2a-c9a1-4bd9-85a8-d883e2a02c76 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d3d7458af447bdb3f03e83a2d8559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49238b8686d24ae698679e4a1957735d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:57:34.400539 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-e1bdda2a-c9a1-4bd9-85a8-d883e2a02c76 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] 10.222.0.18 "GET /compute/v2.1/servers/aee36c9d-baf4-453c-b88f-31b8f23638c2" status: 200 len: 1542 microversion: 2.1 time: 0.618570 Oct 22 20:57:34.403966 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 962/2034] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:57:33 2022] GET /compute/v2.1/servers/aee36c9d-baf4-453c-b88f-31b8f23638c2 => generated 1542 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:57:34.408843 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-645b1e8a-635b-439a-93fc-e1de55844c1c tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.35.2.8"}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:57:34.415758 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-645b1e8a-635b-439a-93fc-e1de55844c1c tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] [instance: 18183d64-42b7-4b9f-9bca-6d018f17eeb3] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:57:34.430914 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-d68c705f-f1ed-4855-aa97-aa6f3894286d tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b392ad1fe1fd4b2a9e6be03a7435deb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594624ed28aa433d907c8833d360b82e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:57:34.443791 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-645b1e8a-635b-439a-93fc-e1de55844c1c tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:34.444395 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-645b1e8a-635b-439a-93fc-e1de55844c1c tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:34.445010 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-645b1e8a-635b-439a-93fc-e1de55844c1c tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:34.446477 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-645b1e8a-635b-439a-93fc-e1de55844c1c tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:34.447076 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-645b1e8a-635b-439a-93fc-e1de55844c1c tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:34.447741 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-645b1e8a-635b-439a-93fc-e1de55844c1c tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:34.466589 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:57:34.497031 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-645b1e8a-635b-439a-93fc-e1de55844c1c tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] Acquiring lock "refresh_cache-18183d64-42b7-4b9f-9bca-6d018f17eeb3" {{(pid=138744) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 22 20:57:34.497441 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-645b1e8a-635b-439a-93fc-e1de55844c1c tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] Acquired lock "refresh_cache-18183d64-42b7-4b9f-9bca-6d018f17eeb3" {{(pid=138744) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 22 20:57:34.514836 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-d68c705f-f1ed-4855-aa97-aa6f3894286d tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] 10.222.0.18 "GET /compute/v2.1/servers/5fadabfa-64f5-4c20-9778-b986d965a632" status: 200 len: 1526 microversion: 2.1 time: 0.603517 Oct 22 20:57:34.523502 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1073/2035] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:57:33 2022] GET /compute/v2.1/servers/5fadabfa-64f5-4c20-9778-b986d965a632 => generated 1526 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:57:34.547645 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-a14ecb61-12fc-4926-bb6c-64ef7652e428 tempest-ServersTestFqdnHostnames-400258971 tempest-ServersTestFqdnHostnames-400258971-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:57:34.548294 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-a14ecb61-12fc-4926-bb6c-64ef7652e428 tempest-ServersTestFqdnHostnames-400258971 tempest-ServersTestFqdnHostnames-400258971-project] [instance: 78aef3f6-9cff-4db4-95c1-f0d5480b7a3c] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:57:34.564494 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a14ecb61-12fc-4926-bb6c-64ef7652e428 tempest-ServersTestFqdnHostnames-400258971 tempest-ServersTestFqdnHostnames-400258971-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:34.564979 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a14ecb61-12fc-4926-bb6c-64ef7652e428 tempest-ServersTestFqdnHostnames-400258971 tempest-ServersTestFqdnHostnames-400258971-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:34.565412 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a14ecb61-12fc-4926-bb6c-64ef7652e428 tempest-ServersTestFqdnHostnames-400258971 tempest-ServersTestFqdnHostnames-400258971-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:34.566343 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a14ecb61-12fc-4926-bb6c-64ef7652e428 tempest-ServersTestFqdnHostnames-400258971 tempest-ServersTestFqdnHostnames-400258971-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:34.567271 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a14ecb61-12fc-4926-bb6c-64ef7652e428 tempest-ServersTestFqdnHostnames-400258971 tempest-ServersTestFqdnHostnames-400258971-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:34.567735 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a14ecb61-12fc-4926-bb6c-64ef7652e428 tempest-ServersTestFqdnHostnames-400258971 tempest-ServersTestFqdnHostnames-400258971-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:35.592777 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-a14ecb61-12fc-4926-bb6c-64ef7652e428 tempest-ServersTestFqdnHostnames-400258971 tempest-ServersTestFqdnHostnames-400258971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02fdeda494a547f1a8714007e05e874d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b75771ecf442919c647f15d499880e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:57:35.603072 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-a14ecb61-12fc-4926-bb6c-64ef7652e428 tempest-ServersTestFqdnHostnames-400258971 tempest-ServersTestFqdnHostnames-400258971-project] 10.222.0.18 "GET /compute/v2.1/servers/78aef3f6-9cff-4db4-95c1-f0d5480b7a3c" status: 200 len: 1664 microversion: 2.1 time: 1.076789 Oct 22 20:57:35.603756 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1074/2036] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:57:34 2022] GET /compute/v2.1/servers/78aef3f6-9cff-4db4-95c1-f0d5480b7a3c => generated 1664 bytes in 1080 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:57:35.622364 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-4b13080c-33d2-4220-95fd-c3dc25238785 req-cf265234-32c7-4217-bf7d-ff8283901697 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd812b37-71ed-400f-ba94-050254f85f9e", "tag": "99a319fa-6647-42c1-9395-fd51c25a466c"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:57:35.642635 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-4b13080c-33d2-4220-95fd-c3dc25238785 req-cf265234-32c7-4217-bf7d-ff8283901697 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:35.643134 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-4b13080c-33d2-4220-95fd-c3dc25238785 req-cf265234-32c7-4217-bf7d-ff8283901697 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:35.643636 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-4b13080c-33d2-4220-95fd-c3dc25238785 req-cf265234-32c7-4217-bf7d-ff8283901697 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:35.683180 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-4b13080c-33d2-4220-95fd-c3dc25238785 req-cf265234-32c7-4217-bf7d-ff8283901697 service nova] Creating event network-changed:99a319fa-6647-42c1-9395-fd51c25a466c for instance fd812b37-71ed-400f-ba94-050254f85f9e on nch2-master-1 Oct 22 20:57:35.695287 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-4b13080c-33d2-4220-95fd-c3dc25238785 req-cf265234-32c7-4217-bf7d-ff8283901697 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090301 Oct 22 20:57:35.698471 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1075/2037] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:57:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:57:35.708757 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-94db59c7-06f6-40f0-be54-d568b1e7cf21 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:57:35.709543 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-94db59c7-06f6-40f0-be54-d568b1e7cf21 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] [instance: fd812b37-71ed-400f-ba94-050254f85f9e] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:57:35.728568 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-94db59c7-06f6-40f0-be54-d568b1e7cf21 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:35.729487 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-94db59c7-06f6-40f0-be54-d568b1e7cf21 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:35.729487 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-94db59c7-06f6-40f0-be54-d568b1e7cf21 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:35.730255 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-94db59c7-06f6-40f0-be54-d568b1e7cf21 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:35.730713 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-94db59c7-06f6-40f0-be54-d568b1e7cf21 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:35.731236 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-94db59c7-06f6-40f0-be54-d568b1e7cf21 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:36.661614 ncdv-master-1 devstack@n-api.service[138744]: DEBUG neutronclient.v2_0.client [None req-645b1e8a-635b-439a-93fc-e1de55844c1c tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] Error message: {"NeutronError": {"type": "FloatingIPPortAlreadyAssociated", "message": "Cannot associate floating IP 172.35.2.8 (670e70e9-348f-4287-a4ed-11c248406829) with port 26816847-4085-4357-9ca7-d768088c1a37 using fixed IP 172.20.0.3, as that fixed IP already has a floating IP on external network 355a8481-8802-4295-9cce-2185db0a47d1.", "detail": ""}} {{(pid=138744) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 22 20:57:36.662220 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-645b1e8a-635b-439a-93fc-e1de55844c1c tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] Releasing lock "refresh_cache-18183d64-42b7-4b9f-9bca-6d018f17eeb3" {{(pid=138744) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 22 20:57:36.668168 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-645b1e8a-635b-439a-93fc-e1de55844c1c tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] HTTP exception thrown: Cannot associate floating IP 172.35.2.8 (670e70e9-348f-4287-a4ed-11c248406829) with port 26816847-4085-4357-9ca7-d768088c1a37 using fixed IP 172.20.0.3, as that fixed IP already has a floating IP on external network 355a8481-8802-4295-9cce-2185db0a47d1. Oct 22 20:57:36.668168 ncdv-master-1 devstack@n-api.service[138744]: Neutron server returns request_ids: ['req-40c06680-bc31-4b31-a6a0-78f0b3c2f467'] Oct 22 20:57:36.671660 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-645b1e8a-635b-439a-93fc-e1de55844c1c tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] Request method failure captured: Oct 22 20:57:36.671660 ncdv-master-1 devstack@n-api.service[138744]: request: POST /compute/v2.1/servers/18183d64-42b7-4b9f-9bca-6d018f17eeb3/action HTTP/1.1 Oct 22 20:57:36.671660 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 20:57:36.671660 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 20:57:36.671660 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 20:57:36.671660 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 44 Oct 22 20:57:36.671660 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 20:57:36.671660 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 20:57:36.671660 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 20:57:36.671660 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 20:57:36.671660 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVFkXuiu5o7_mkf-T6g2hJ9V3zhz6b158xzEeQn2hLYFzTm7eWg1McjcIpfQyHxZ4hCvKyo-lO4kjjeE9oMC47EVd9nh5yoCww3JiBIb9THOnFtV8XT__oHmWbKSrDo3becuY-aCCDuC3aMWP-ibtAxHnxcfn7uTMu-Mh-GxZuahHHAg Oct 22 20:57:36.671660 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 20:57:36.671660 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 20:57:36.671660 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 20:57:36.671660 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 20:57:36.671660 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 20:57:36.671660 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 20:57:36.671660 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: 7e883d7e73084efeb725945ae0bab317 Oct 22 20:57:36.671660 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 Oct 22 20:57:36.671660 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 20:57:36.671660 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 20:57:36.671660 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_7e883d7e73084efeb725945ae0bab317"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7e883d7e73084efeb725945ae0bab317"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/7e883d7e73084efeb725945ae0bab317"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7e883d7e73084efeb725945ae0bab317"}]}] Oct 22 20:57:36.671660 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 Oct 22 20:57:36.671660 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: 7e883d7e73084efeb725945ae0bab317 Oct 22 20:57:36.671660 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 Oct 22 20:57:36.671660 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project Oct 22 20:57:36.671660 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 20:57:36.671660 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 20:57:36.671660 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: 5660f7f9d86f473eaa83e2be362ca63c Oct 22 20:57:36.671660 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project Oct 22 20:57:36.671660 ncdv-master-1 devstack@n-api.service[138744]: Oct 22 20:57:36.671660 ncdv-master-1 devstack@n-api.service[138744]: {"addFloatingIp": {"address": "172.35.2.8"}} Oct 22 20:57:36.671660 ncdv-master-1 devstack@n-api.service[138744]: method: Oct 22 20:57:36.671660 ncdv-master-1 devstack@n-api.service[138744]: exception: Cannot associate floating IP 172.35.2.8 (670e70e9-348f-4287-a4ed-11c248406829) with port 26816847-4085-4357-9ca7-d768088c1a37 using fixed IP 172.20.0.3, as that fixed IP already has a floating IP on external network 355a8481-8802-4295-9cce-2185db0a47d1. Oct 22 20:57:36.671660 ncdv-master-1 devstack@n-api.service[138744]: Neutron server returns request_ids: ['req-40c06680-bc31-4b31-a6a0-78f0b3c2f467'] Oct 22 20:57:36.671660 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': '18183d64-42b7-4b9f-9bca-6d018f17eeb3', 'body': {'addFloatingIp': {'address': '172.35.2.8'}}} Oct 22 20:57:36.671660 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:57:36.671660 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:57:36.671660 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2703, in associate_floating_ip Oct 22 20:57:36.671660 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi client.update_floatingip(fip['id'], {'floatingip': param}) Oct 22 20:57:36.671660 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 20:57:36.671660 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 20:57:36.671660 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1016, in update_floatingip Oct 22 20:57:36.671660 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return self._update_resource(self.floatingip_path % (floatingip), Oct 22 20:57:36.671660 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 20:57:36.671660 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 20:57:36.671660 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 2548, in _update_resource Oct 22 20:57:36.671660 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return self.put(path, **kwargs) Oct 22 20:57:36.671660 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 20:57:36.671660 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 20:57:36.671660 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 365, in put Oct 22 20:57:36.671660 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return self.retry_request("PUT", action, body=body, Oct 22 20:57:36.671660 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 20:57:36.671660 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 20:57:36.671660 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 22 20:57:36.671660 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 22 20:57:36.671660 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 20:57:36.671660 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 20:57:36.671660 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 22 20:57:36.671660 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 22 20:57:36.676533 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 20:57:36.676533 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 20:57:36.676533 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 22 20:57:36.676533 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 22 20:57:36.676533 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 22 20:57:36.676533 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 22 20:57:36.676533 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Cannot associate floating IP 172.35.2.8 (670e70e9-348f-4287-a4ed-11c248406829) with port 26816847-4085-4357-9ca7-d768088c1a37 using fixed IP 172.20.0.3, as that fixed IP already has a floating IP on external network 355a8481-8802-4295-9cce-2185db0a47d1. Oct 22 20:57:36.676533 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-40c06680-bc31-4b31-a6a0-78f0b3c2f467'] Oct 22 20:57:36.676533 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:57:36.676533 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:57:36.676533 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:57:36.676533 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:57:36.676533 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Oct 22 20:57:36.676533 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Oct 22 20:57:36.676533 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 165, in wrapper Oct 22 20:57:36.676533 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Oct 22 20:57:36.676533 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2705, in associate_floating_ip Oct 22 20:57:36.676533 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpAssociateFailed(str(e)) Oct 22 20:57:36.676533 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpAssociateFailed: Cannot associate floating IP 172.35.2.8 (670e70e9-348f-4287-a4ed-11c248406829) with port 26816847-4085-4357-9ca7-d768088c1a37 using fixed IP 172.20.0.3, as that fixed IP already has a floating IP on external network 355a8481-8802-4295-9cce-2185db0a47d1. Oct 22 20:57:36.676533 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-40c06680-bc31-4b31-a6a0-78f0b3c2f467'] Oct 22 20:57:36.676533 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:57:36.676533 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:57:36.676533 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:57:36.676533 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:57:36.676533 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:57:36.676533 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:57:36.676533 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:57:36.676533 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:57:36.676533 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 22 20:57:36.676533 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 22 20:57:36.676533 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:57:36.676533 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:57:36.676533 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 20:57:36.676533 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 20:57:36.676533 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 246, in _add_floating_ip Oct 22 20:57:36.676533 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=e.format_message()) Oct 22 20:57:36.676533 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Cannot associate floating IP 172.35.2.8 (670e70e9-348f-4287-a4ed-11c248406829) with port 26816847-4085-4357-9ca7-d768088c1a37 using fixed IP 172.20.0.3, as that fixed IP already has a floating IP on external network 355a8481-8802-4295-9cce-2185db0a47d1. Oct 22 20:57:36.676533 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-40c06680-bc31-4b31-a6a0-78f0b3c2f467'] Oct 22 20:57:36.676533 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:57:36.676533 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:57:36.676533 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:57:36.676533 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:57:36.676533 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:57:36.676533 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:57:36.676533 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 20:57:36.676533 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 20:57:36.676533 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot associate floating IP 172.35.2.8 (670e70e9-348f-4287-a4ed-11c248406829) with port 26816847-4085-4357-9ca7-d768088c1a37 using fixed IP 172.20.0.3, as that fixed IP already has a floating IP on external network 355a8481-8802-4295-9cce-2185db0a47d1. Oct 22 20:57:36.676533 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-40c06680-bc31-4b31-a6a0-78f0b3c2f467'] Oct 22 20:57:36.676533 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:57:36.681102 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-645b1e8a-635b-439a-93fc-e1de55844c1c tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] Returning 400 to user: Cannot associate floating IP 172.35.2.8 (670e70e9-348f-4287-a4ed-11c248406829) with port 26816847-4085-4357-9ca7-d768088c1a37 using fixed IP 172.20.0.3, as that fixed IP already has a floating IP on external network 355a8481-8802-4295-9cce-2185db0a47d1. Oct 22 20:57:36.681102 ncdv-master-1 devstack@n-api.service[138744]: Neutron server returns request_ids: ['req-40c06680-bc31-4b31-a6a0-78f0b3c2f467'] {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:57:36.682261 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-645b1e8a-635b-439a-93fc-e1de55844c1c tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] 10.222.0.18 "POST /compute/v2.1/servers/18183d64-42b7-4b9f-9bca-6d018f17eeb3/action" status: 400 len: 379 microversion: 2.1 time: 2.277344 Oct 22 20:57:36.686201 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 963/2038] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 20:57:34 2022] POST /compute/v2.1/servers/18183d64-42b7-4b9f-9bca-6d018f17eeb3/action => generated 379 bytes in 2282 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 22 20:57:36.699793 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-9d06518e-3650-4b42-907c-13d4c8589213 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:57:36.700925 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-9d06518e-3650-4b42-907c-13d4c8589213 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] [instance: 829a4155-cf7c-470d-a127-c729e32747fe] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:57:36.716708 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9d06518e-3650-4b42-907c-13d4c8589213 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:36.717848 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9d06518e-3650-4b42-907c-13d4c8589213 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:36.718972 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9d06518e-3650-4b42-907c-13d4c8589213 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:36.720021 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9d06518e-3650-4b42-907c-13d4c8589213 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:36.721374 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9d06518e-3650-4b42-907c-13d4c8589213 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:36.722047 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9d06518e-3650-4b42-907c-13d4c8589213 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:36.768315 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-94db59c7-06f6-40f0-be54-d568b1e7cf21 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dbe89a7e11480194d3d86f82983499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8351b01e07cd43f9be973ab45e522bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:57:36.786469 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-94db59c7-06f6-40f0-be54-d568b1e7cf21 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] 10.222.0.18 "GET /compute/v2.1/servers/fd812b37-71ed-400f-ba94-050254f85f9e" status: 200 len: 1313 microversion: 2.1 time: 1.086690 Oct 22 20:57:36.816357 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1076/2039] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:57:35 2022] GET /compute/v2.1/servers/fd812b37-71ed-400f-ba94-050254f85f9e => generated 1313 bytes in 1117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:57:36.823675 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-b729b03e-abf5-4ec8-bb34-6af7eb5c352a tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:57:36.826071 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-b729b03e-abf5-4ec8-bb34-6af7eb5c352a tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] [instance: aee36c9d-baf4-453c-b88f-31b8f23638c2] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:57:36.835286 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b729b03e-abf5-4ec8-bb34-6af7eb5c352a tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:36.836094 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b729b03e-abf5-4ec8-bb34-6af7eb5c352a tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:36.837247 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b729b03e-abf5-4ec8-bb34-6af7eb5c352a tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:36.838164 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b729b03e-abf5-4ec8-bb34-6af7eb5c352a tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:36.838817 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b729b03e-abf5-4ec8-bb34-6af7eb5c352a tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:36.839411 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b729b03e-abf5-4ec8-bb34-6af7eb5c352a tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:36.918467 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-9d06518e-3650-4b42-907c-13d4c8589213 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d808e98f843dd9621822682c9d278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b58ab4af674c778b4819f177045651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:57:36.945509 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-9d06518e-3650-4b42-907c-13d4c8589213 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] 10.222.0.18 "GET /compute/v2.1/servers/829a4155-cf7c-470d-a127-c729e32747fe" status: 200 len: 1276 microversion: 2.1 time: 0.255945 Oct 22 20:57:36.947176 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 964/2040] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:57:36 2022] GET /compute/v2.1/servers/829a4155-cf7c-470d-a127-c729e32747fe => generated 1276 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:57:36.957639 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-13f3593c-c343-4e4e-8641-ea31cf1808ed tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:57:36.958652 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-13f3593c-c343-4e4e-8641-ea31cf1808ed tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] [instance: 5fadabfa-64f5-4c20-9778-b986d965a632] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:57:36.975785 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-13f3593c-c343-4e4e-8641-ea31cf1808ed tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:36.976922 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-13f3593c-c343-4e4e-8641-ea31cf1808ed tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:36.977578 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-13f3593c-c343-4e4e-8641-ea31cf1808ed tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:36.978447 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-13f3593c-c343-4e4e-8641-ea31cf1808ed tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:36.979111 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-13f3593c-c343-4e4e-8641-ea31cf1808ed tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:36.979767 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-13f3593c-c343-4e4e-8641-ea31cf1808ed tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:37.993237 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-b729b03e-abf5-4ec8-bb34-6af7eb5c352a tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d3d7458af447bdb3f03e83a2d8559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49238b8686d24ae698679e4a1957735d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:57:38.002197 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-b729b03e-abf5-4ec8-bb34-6af7eb5c352a tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] 10.222.0.18 "GET /compute/v2.1/servers/aee36c9d-baf4-453c-b88f-31b8f23638c2" status: 200 len: 1542 microversion: 2.1 time: 1.184430 Oct 22 20:57:38.016938 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1077/2041] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:57:36 2022] GET /compute/v2.1/servers/aee36c9d-baf4-453c-b88f-31b8f23638c2 => generated 1542 bytes in 1200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:57:38.025605 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-b434e1a6-08ec-4077-a519-91671e6f06bc tempest-ServersTestFqdnHostnames-400258971 tempest-ServersTestFqdnHostnames-400258971-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:57:38.026467 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-b434e1a6-08ec-4077-a519-91671e6f06bc tempest-ServersTestFqdnHostnames-400258971 tempest-ServersTestFqdnHostnames-400258971-project] [instance: 78aef3f6-9cff-4db4-95c1-f0d5480b7a3c] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:57:38.033409 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b434e1a6-08ec-4077-a519-91671e6f06bc tempest-ServersTestFqdnHostnames-400258971 tempest-ServersTestFqdnHostnames-400258971-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:38.034134 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b434e1a6-08ec-4077-a519-91671e6f06bc tempest-ServersTestFqdnHostnames-400258971 tempest-ServersTestFqdnHostnames-400258971-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:38.034706 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b434e1a6-08ec-4077-a519-91671e6f06bc tempest-ServersTestFqdnHostnames-400258971 tempest-ServersTestFqdnHostnames-400258971-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:38.035598 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b434e1a6-08ec-4077-a519-91671e6f06bc tempest-ServersTestFqdnHostnames-400258971 tempest-ServersTestFqdnHostnames-400258971-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:38.036203 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b434e1a6-08ec-4077-a519-91671e6f06bc tempest-ServersTestFqdnHostnames-400258971 tempest-ServersTestFqdnHostnames-400258971-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:38.036866 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b434e1a6-08ec-4077-a519-91671e6f06bc tempest-ServersTestFqdnHostnames-400258971 tempest-ServersTestFqdnHostnames-400258971-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:38.327525 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-13f3593c-c343-4e4e-8641-ea31cf1808ed tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b392ad1fe1fd4b2a9e6be03a7435deb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594624ed28aa433d907c8833d360b82e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:57:38.336111 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-13f3593c-c343-4e4e-8641-ea31cf1808ed tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] 10.222.0.18 "GET /compute/v2.1/servers/5fadabfa-64f5-4c20-9778-b986d965a632" status: 200 len: 1526 microversion: 2.1 time: 1.387351 Oct 22 20:57:38.340616 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 965/2042] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:57:36 2022] GET /compute/v2.1/servers/5fadabfa-64f5-4c20-9778-b986d965a632 => generated 1526 bytes in 1392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:57:38.347221 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-143b48eb-9053-4264-b1c6-24e281415252 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] Calling method '.version_select at 0x7fd3a4ea3160>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:57:38.446644 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-b434e1a6-08ec-4077-a519-91671e6f06bc tempest-ServersTestFqdnHostnames-400258971 tempest-ServersTestFqdnHostnames-400258971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02fdeda494a547f1a8714007e05e874d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b75771ecf442919c647f15d499880e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:57:38.459733 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-b434e1a6-08ec-4077-a519-91671e6f06bc tempest-ServersTestFqdnHostnames-400258971 tempest-ServersTestFqdnHostnames-400258971-project] 10.222.0.18 "GET /compute/v2.1/servers/78aef3f6-9cff-4db4-95c1-f0d5480b7a3c" status: 200 len: 1596 microversion: 2.1 time: 0.441247 Oct 22 20:57:38.476337 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1078/2043] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:57:38 2022] GET /compute/v2.1/servers/78aef3f6-9cff-4db4-95c1-f0d5480b7a3c => generated 1596 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:57:38.490859 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-1095299f-c2f6-4ff3-94bc-b54110710eea tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:57:38.491529 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-1095299f-c2f6-4ff3-94bc-b54110710eea tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] [instance: fd812b37-71ed-400f-ba94-050254f85f9e] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:57:38.512894 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1095299f-c2f6-4ff3-94bc-b54110710eea tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:38.513563 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1095299f-c2f6-4ff3-94bc-b54110710eea tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:38.514167 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1095299f-c2f6-4ff3-94bc-b54110710eea tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:38.515051 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1095299f-c2f6-4ff3-94bc-b54110710eea tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:38.515540 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1095299f-c2f6-4ff3-94bc-b54110710eea tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:38.516111 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1095299f-c2f6-4ff3-94bc-b54110710eea tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:39.278846 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-1095299f-c2f6-4ff3-94bc-b54110710eea tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dbe89a7e11480194d3d86f82983499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8351b01e07cd43f9be973ab45e522bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:57:39.288415 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-1095299f-c2f6-4ff3-94bc-b54110710eea tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] 10.222.0.18 "GET /compute/v2.1/servers/fd812b37-71ed-400f-ba94-050254f85f9e" status: 200 len: 1313 microversion: 2.1 time: 0.810368 Oct 22 20:57:39.301562 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1079/2044] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:57:38 2022] GET /compute/v2.1/servers/fd812b37-71ed-400f-ba94-050254f85f9e => generated 1313 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:57:39.320203 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-265313a7-7793-4285-8307-0041d45b0a15 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:57:39.320827 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-265313a7-7793-4285-8307-0041d45b0a15 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] [instance: 829a4155-cf7c-470d-a127-c729e32747fe] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:57:39.327260 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-265313a7-7793-4285-8307-0041d45b0a15 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:39.327774 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-265313a7-7793-4285-8307-0041d45b0a15 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:39.328207 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-265313a7-7793-4285-8307-0041d45b0a15 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:39.329020 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-265313a7-7793-4285-8307-0041d45b0a15 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:39.329550 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-265313a7-7793-4285-8307-0041d45b0a15 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:39.330003 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-265313a7-7793-4285-8307-0041d45b0a15 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:39.532351 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-265313a7-7793-4285-8307-0041d45b0a15 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d808e98f843dd9621822682c9d278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b58ab4af674c778b4819f177045651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:57:39.544379 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-265313a7-7793-4285-8307-0041d45b0a15 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] 10.222.0.18 "GET /compute/v2.1/servers/829a4155-cf7c-470d-a127-c729e32747fe" status: 200 len: 1276 microversion: 2.1 time: 0.227327 Oct 22 20:57:39.555459 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1080/2045] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:57:39 2022] GET /compute/v2.1/servers/829a4155-cf7c-470d-a127-c729e32747fe => generated 1276 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:57:39.555459 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-61bfd233-7d9c-4e37-bb4c-bcad7ad683de req-740c8e0d-d8b3-43ee-80ee-605454658120 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78aef3f6-9cff-4db4-95c1-f0d5480b7a3c", "name": "network-vif-deleted", "tag": "1b3feae7-78b5-47fa-a825-d1a96beffac1"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:57:39.561361 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-61bfd233-7d9c-4e37-bb4c-bcad7ad683de req-740c8e0d-d8b3-43ee-80ee-605454658120 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:39.562138 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-61bfd233-7d9c-4e37-bb4c-bcad7ad683de req-740c8e0d-d8b3-43ee-80ee-605454658120 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:39.562798 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-61bfd233-7d9c-4e37-bb4c-bcad7ad683de req-740c8e0d-d8b3-43ee-80ee-605454658120 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:39.575445 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-61bfd233-7d9c-4e37-bb4c-bcad7ad683de req-740c8e0d-d8b3-43ee-80ee-605454658120 service nova] Creating event network-vif-deleted:1b3feae7-78b5-47fa-a825-d1a96beffac1 for instance 78aef3f6-9cff-4db4-95c1-f0d5480b7a3c on nch1-master-1 Oct 22 20:57:39.582792 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-61bfd233-7d9c-4e37-bb4c-bcad7ad683de req-740c8e0d-d8b3-43ee-80ee-605454658120 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036021 Oct 22 20:57:39.585465 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1081/2046] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:57:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:57:39.588262 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-61bfd233-7d9c-4e37-bb4c-bcad7ad683de req-740c8e0d-d8b3-43ee-80ee-605454658120 service nova] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:57:39.592502 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-61bfd233-7d9c-4e37-bb4c-bcad7ad683de req-740c8e0d-d8b3-43ee-80ee-605454658120 service nova] 10.222.0.18 "GET /compute//" status: 200 len: 377 microversion: - time: 0.003461 Oct 22 20:57:39.594922 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1082/2047] 10.222.0.18 () {56 vars in 886 bytes} [Sat Oct 22 20:57:39 2022] GET /compute/ => generated 377 bytes in 9 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 22 20:57:39.602493 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-b2e214d1-a44b-430d-b178-e2ae103a2f6e tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:57:39.607878 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-b2e214d1-a44b-430d-b178-e2ae103a2f6e tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] [instance: aee36c9d-baf4-453c-b88f-31b8f23638c2] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:57:39.623750 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b2e214d1-a44b-430d-b178-e2ae103a2f6e tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:39.624373 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b2e214d1-a44b-430d-b178-e2ae103a2f6e tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:39.625134 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b2e214d1-a44b-430d-b178-e2ae103a2f6e tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:39.627166 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b2e214d1-a44b-430d-b178-e2ae103a2f6e tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:39.628256 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b2e214d1-a44b-430d-b178-e2ae103a2f6e tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:39.629282 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b2e214d1-a44b-430d-b178-e2ae103a2f6e tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:40.795470 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-b2e214d1-a44b-430d-b178-e2ae103a2f6e tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d3d7458af447bdb3f03e83a2d8559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49238b8686d24ae698679e4a1957735d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:57:40.813425 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-b2e214d1-a44b-430d-b178-e2ae103a2f6e tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] 10.222.0.18 "GET /compute/v2.1/servers/aee36c9d-baf4-453c-b88f-31b8f23638c2" status: 200 len: 1542 microversion: 2.1 time: 1.216930 Oct 22 20:57:40.814871 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1083/2048] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:57:39 2022] GET /compute/v2.1/servers/aee36c9d-baf4-453c-b88f-31b8f23638c2 => generated 1542 bytes in 1219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:57:40.824646 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-fab9230c-64d0-40d9-bb9d-0225ae4a710f tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:57:40.825587 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-fab9230c-64d0-40d9-bb9d-0225ae4a710f tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] [instance: 5fadabfa-64f5-4c20-9778-b986d965a632] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:57:40.839041 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fab9230c-64d0-40d9-bb9d-0225ae4a710f tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:40.840106 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fab9230c-64d0-40d9-bb9d-0225ae4a710f tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:40.840756 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fab9230c-64d0-40d9-bb9d-0225ae4a710f tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:40.843290 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fab9230c-64d0-40d9-bb9d-0225ae4a710f tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:40.844123 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fab9230c-64d0-40d9-bb9d-0225ae4a710f tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:40.844819 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fab9230c-64d0-40d9-bb9d-0225ae4a710f tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:40.876649 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.wsgi [None req-fab9230c-64d0-40d9-bb9d-0225ae4a710f tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] HTTP exception thrown: Instance 5fadabfa-64f5-4c20-9778-b986d965a632 could not be found. Oct 22 20:57:40.878396 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-fab9230c-64d0-40d9-bb9d-0225ae4a710f tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Request method failure captured: Oct 22 20:57:40.878396 ncdv-master-1 devstack@n-api.service[138745]: request: GET /compute/v2.1/servers/5fadabfa-64f5-4c20-9778-b986d965a632 HTTP/1.1 Oct 22 20:57:40.878396 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 20:57:40.878396 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 20:57:40.878396 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 20:57:40.878396 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 0 Oct 22 20:57:40.878396 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 20:57:40.878396 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 20:57:40.878396 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 20:57:40.878396 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 20:57:40.878396 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVFinkWQQBhkrT1IKOpDugEkOlAPWNZyP_2NMwr13b9XeVy4UUzw2acgfBjDE3p8vwfHK2_Q3RMg9yYmateTjw8EQOHA7IN0HeuqzZ5uQWL0ysIIG3e_nACVRZdRICvuIM06IV17ajtcJTdsfcK0wPQNbKtAOZi6_8a2UUHyQ1NeNuzI Oct 22 20:57:40.878396 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 20:57:40.878396 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 20:57:40.878396 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 20:57:40.878396 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 20:57:40.878396 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 20:57:40.878396 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 20:57:40.878396 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: 594624ed28aa433d907c8833d360b82e Oct 22 20:57:40.878396 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-477371163 Oct 22 20:57:40.878396 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 20:57:40.878396 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 20:57:40.878396 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_594624ed28aa433d907c8833d360b82e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/594624ed28aa433d907c8833d360b82e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/594624ed28aa433d907c8833d360b82e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/594624ed28aa433d907c8833d360b82e"}]}] Oct 22 20:57:40.878396 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-477371163 Oct 22 20:57:40.878396 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: 594624ed28aa433d907c8833d360b82e Oct 22 20:57:40.878396 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-477371163 Oct 22 20:57:40.878396 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-ImagesOneServerNegativeTestJSON-477371163-project Oct 22 20:57:40.878396 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 20:57:40.878396 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 20:57:40.878396 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: b392ad1fe1fd4b2a9e6be03a7435deb9 Oct 22 20:57:40.878396 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-477371163-project Oct 22 20:57:40.878396 ncdv-master-1 devstack@n-api.service[138745]: method: > Oct 22 20:57:40.878396 ncdv-master-1 devstack@n-api.service[138745]: exception: Instance 5fadabfa-64f5-4c20-9778-b986d965a632 could not be found. Oct 22 20:57:40.878396 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'id': '5fadabfa-64f5-4c20-9778-b986d965a632'} Oct 22 20:57:40.878396 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:57:40.878396 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:57:40.878396 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 20:57:40.878396 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 20:57:40.878396 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 20:57:40.878396 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 20:57:40.878396 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 20:57:40.878396 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 20:57:40.878396 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 20:57:40.878396 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 20:57:40.878396 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5fadabfa-64f5-4c20-9778-b986d965a632 could not be found. Oct 22 20:57:40.878396 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:57:40.878396 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:57:40.878396 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:57:40.878396 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:57:40.878396 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:57:40.878396 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:57:40.878396 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:57:40.878396 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:57:40.878396 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:57:40.878396 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:57:40.878396 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 20:57:40.878396 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 20:57:40.878396 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 20:57:40.878396 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 20:57:40.878396 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 20:57:40.878396 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 20:57:40.878396 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5fadabfa-64f5-4c20-9778-b986d965a632 could not be found. Oct 22 20:57:40.878396 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:57:40.878396 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:57:40.881628 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:57:40.881628 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:57:40.881628 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:57:40.881628 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:57:40.881628 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 20:57:40.881628 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 20:57:40.881628 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5fadabfa-64f5-4c20-9778-b986d965a632 could not be found. Oct 22 20:57:40.881628 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:57:40.881628 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-fab9230c-64d0-40d9-bb9d-0225ae4a710f tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Returning 404 to user: Instance 5fadabfa-64f5-4c20-9778-b986d965a632 could not be found. {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:57:40.884136 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-fab9230c-64d0-40d9-bb9d-0225ae4a710f tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] 10.222.0.18 "GET /compute/v2.1/servers/5fadabfa-64f5-4c20-9778-b986d965a632" status: 404 len: 111 microversion: 2.1 time: 0.067853 Oct 22 20:57:40.885206 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1084/2049] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:57:40 2022] GET /compute/v2.1/servers/5fadabfa-64f5-4c20-9778-b986d965a632 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 20:57:40.890238 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-6b744ee8-a66d-426d-8af0-7726a792949c tempest-ServersTestFqdnHostnames-400258971 tempest-ServersTestFqdnHostnames-400258971-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:57:40.890856 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-6b744ee8-a66d-426d-8af0-7726a792949c tempest-ServersTestFqdnHostnames-400258971 tempest-ServersTestFqdnHostnames-400258971-project] [instance: 78aef3f6-9cff-4db4-95c1-f0d5480b7a3c] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:57:40.903483 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6b744ee8-a66d-426d-8af0-7726a792949c tempest-ServersTestFqdnHostnames-400258971 tempest-ServersTestFqdnHostnames-400258971-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:40.904130 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6b744ee8-a66d-426d-8af0-7726a792949c tempest-ServersTestFqdnHostnames-400258971 tempest-ServersTestFqdnHostnames-400258971-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:40.905199 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6b744ee8-a66d-426d-8af0-7726a792949c tempest-ServersTestFqdnHostnames-400258971 tempest-ServersTestFqdnHostnames-400258971-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:40.906099 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6b744ee8-a66d-426d-8af0-7726a792949c tempest-ServersTestFqdnHostnames-400258971 tempest-ServersTestFqdnHostnames-400258971-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:40.907301 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6b744ee8-a66d-426d-8af0-7726a792949c tempest-ServersTestFqdnHostnames-400258971 tempest-ServersTestFqdnHostnames-400258971-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:40.907959 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6b744ee8-a66d-426d-8af0-7726a792949c tempest-ServersTestFqdnHostnames-400258971 tempest-ServersTestFqdnHostnames-400258971-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:40.936431 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.wsgi [None req-6b744ee8-a66d-426d-8af0-7726a792949c tempest-ServersTestFqdnHostnames-400258971 tempest-ServersTestFqdnHostnames-400258971-project] HTTP exception thrown: Instance 78aef3f6-9cff-4db4-95c1-f0d5480b7a3c could not be found. Oct 22 20:57:40.938565 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-6b744ee8-a66d-426d-8af0-7726a792949c tempest-ServersTestFqdnHostnames-400258971 tempest-ServersTestFqdnHostnames-400258971-project] Request method failure captured: Oct 22 20:57:40.938565 ncdv-master-1 devstack@n-api.service[138745]: request: GET /compute/v2.1/servers/78aef3f6-9cff-4db4-95c1-f0d5480b7a3c HTTP/1.1 Oct 22 20:57:40.938565 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 20:57:40.938565 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 20:57:40.938565 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 20:57:40.938565 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 0 Oct 22 20:57:40.938565 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 20:57:40.938565 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 20:57:40.938565 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 20:57:40.938565 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 20:57:40.938565 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVFjKAdTTPJGfAE2DEVOTVXH930gqU1AnAsyspO9YDVJfl73LBcdna93MpneYHxw1T0vLRPA57xQOuh6snMZoURB7PThCRAg78Bq1pHWwjo6hpxURxqjFpMSAaYi1xLd6LEbO5RQCxrME1kCTuRi7kG1xrrm9aGFew5NSDg8NLTQEESE Oct 22 20:57:40.938565 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 20:57:40.938565 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 20:57:40.938565 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 20:57:40.938565 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 20:57:40.938565 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 20:57:40.938565 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 20:57:40.938565 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: b3b75771ecf442919c647f15d499880e Oct 22 20:57:40.938565 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-ServersTestFqdnHostnames-400258971 Oct 22 20:57:40.938565 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 20:57:40.938565 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 20:57:40.938565 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_b3b75771ecf442919c647f15d499880e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b3b75771ecf442919c647f15d499880e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/b3b75771ecf442919c647f15d499880e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b3b75771ecf442919c647f15d499880e"}]}] Oct 22 20:57:40.938565 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-ServersTestFqdnHostnames-400258971 Oct 22 20:57:40.938565 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: b3b75771ecf442919c647f15d499880e Oct 22 20:57:40.938565 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-ServersTestFqdnHostnames-400258971 Oct 22 20:57:40.938565 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-ServersTestFqdnHostnames-400258971-project Oct 22 20:57:40.938565 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 20:57:40.938565 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 20:57:40.938565 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: 02fdeda494a547f1a8714007e05e874d Oct 22 20:57:40.938565 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-ServersTestFqdnHostnames-400258971-project Oct 22 20:57:40.938565 ncdv-master-1 devstack@n-api.service[138745]: method: > Oct 22 20:57:40.938565 ncdv-master-1 devstack@n-api.service[138745]: exception: Instance 78aef3f6-9cff-4db4-95c1-f0d5480b7a3c could not be found. Oct 22 20:57:40.938565 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'id': '78aef3f6-9cff-4db4-95c1-f0d5480b7a3c'} Oct 22 20:57:40.938565 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:57:40.938565 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:57:40.938565 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 20:57:40.938565 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 20:57:40.938565 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 20:57:40.938565 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 20:57:40.938565 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 20:57:40.938565 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 20:57:40.938565 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 20:57:40.938565 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 20:57:40.938565 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 78aef3f6-9cff-4db4-95c1-f0d5480b7a3c could not be found. Oct 22 20:57:40.938565 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:57:40.938565 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:57:40.938565 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:57:40.938565 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:57:40.938565 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:57:40.938565 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:57:40.938565 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:57:40.938565 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:57:40.938565 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:57:40.938565 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:57:40.938565 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 20:57:40.938565 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 20:57:40.938565 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 20:57:40.938565 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 20:57:40.938565 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 20:57:40.938565 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 20:57:40.938565 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 78aef3f6-9cff-4db4-95c1-f0d5480b7a3c could not be found. Oct 22 20:57:40.938565 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:57:40.938565 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:57:40.938565 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:57:40.943712 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:57:40.943712 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:57:40.943712 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:57:40.943712 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 20:57:40.943712 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 20:57:40.943712 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 78aef3f6-9cff-4db4-95c1-f0d5480b7a3c could not be found. Oct 22 20:57:40.943712 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:57:40.943712 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-6b744ee8-a66d-426d-8af0-7726a792949c tempest-ServersTestFqdnHostnames-400258971 tempest-ServersTestFqdnHostnames-400258971-project] Returning 404 to user: Instance 78aef3f6-9cff-4db4-95c1-f0d5480b7a3c could not be found. {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:57:40.944365 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-6b744ee8-a66d-426d-8af0-7726a792949c tempest-ServersTestFqdnHostnames-400258971 tempest-ServersTestFqdnHostnames-400258971-project] 10.222.0.18 "GET /compute/v2.1/servers/78aef3f6-9cff-4db4-95c1-f0d5480b7a3c" status: 404 len: 111 microversion: 2.1 time: 0.056756 Oct 22 20:57:40.945531 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1085/2050] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:57:40 2022] GET /compute/v2.1/servers/78aef3f6-9cff-4db4-95c1-f0d5480b7a3c => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 20:57:40.950760 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-de55443a-3798-4e51-977d-b4be3395a094 req-6458d251-74ba-473b-b8df-d876cb842a3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5fadabfa-64f5-4c20-9778-b986d965a632", "name": "network-vif-deleted", "tag": "b491f705-01d8-463c-9ac5-b840e865c43f"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:57:40.962155 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-de55443a-3798-4e51-977d-b4be3395a094 req-6458d251-74ba-473b-b8df-d876cb842a3f service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:40.963029 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-de55443a-3798-4e51-977d-b4be3395a094 req-6458d251-74ba-473b-b8df-d876cb842a3f service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:40.963987 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-de55443a-3798-4e51-977d-b4be3395a094 req-6458d251-74ba-473b-b8df-d876cb842a3f service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:40.984404 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-de55443a-3798-4e51-977d-b4be3395a094 req-6458d251-74ba-473b-b8df-d876cb842a3f service nova] Creating event network-vif-deleted:b491f705-01d8-463c-9ac5-b840e865c43f for instance 5fadabfa-64f5-4c20-9778-b986d965a632 on nch1-master-1 Oct 22 20:57:40.990878 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-de55443a-3798-4e51-977d-b4be3395a094 req-6458d251-74ba-473b-b8df-d876cb842a3f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043763 Oct 22 20:57:40.992008 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1086/2051] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:57:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:57:40.998419 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-e31944b0-0603-458f-9366-3baf5670629b tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:57:40.999427 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-e31944b0-0603-458f-9366-3baf5670629b tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] [instance: fd812b37-71ed-400f-ba94-050254f85f9e] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:57:41.008457 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e31944b0-0603-458f-9366-3baf5670629b tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:41.009144 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e31944b0-0603-458f-9366-3baf5670629b tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:41.009726 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e31944b0-0603-458f-9366-3baf5670629b tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:41.011202 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e31944b0-0603-458f-9366-3baf5670629b tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:41.011915 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e31944b0-0603-458f-9366-3baf5670629b tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:41.012487 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e31944b0-0603-458f-9366-3baf5670629b tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:41.871562 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-e31944b0-0603-458f-9366-3baf5670629b tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dbe89a7e11480194d3d86f82983499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8351b01e07cd43f9be973ab45e522bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:57:41.885813 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-e31944b0-0603-458f-9366-3baf5670629b tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] 10.222.0.18 "GET /compute/v2.1/servers/fd812b37-71ed-400f-ba94-050254f85f9e" status: 200 len: 1313 microversion: 2.1 time: 0.892274 Oct 22 20:57:41.886728 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1087/2052] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:57:40 2022] GET /compute/v2.1/servers/fd812b37-71ed-400f-ba94-050254f85f9e => generated 1313 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:57:41.892518 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-f8c37960-ea00-4927-8914-7b73d0148582 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:57:41.893124 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-f8c37960-ea00-4927-8914-7b73d0148582 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] [instance: 829a4155-cf7c-470d-a127-c729e32747fe] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:57:41.913939 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f8c37960-ea00-4927-8914-7b73d0148582 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:41.914441 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f8c37960-ea00-4927-8914-7b73d0148582 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:41.917608 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f8c37960-ea00-4927-8914-7b73d0148582 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:41.918439 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f8c37960-ea00-4927-8914-7b73d0148582 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:41.918911 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f8c37960-ea00-4927-8914-7b73d0148582 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:41.920769 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f8c37960-ea00-4927-8914-7b73d0148582 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:42.075769 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-143b48eb-9053-4264-b1c6-24e281415252 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] 10.222.0.18 "DELETE /compute/v2.1/os-floating-ips/670e70e9-348f-4287-a4ed-11c248406829" status: 202 len: 0 microversion: 2.1 time: 3.733525 Oct 22 20:57:42.078097 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 966/2053] 10.222.0.18 () {58 vars in 1263 bytes} [Sat Oct 22 20:57:38 2022] DELETE /compute/v2.1/os-floating-ips/670e70e9-348f-4287-a4ed-11c248406829 => generated 0 bytes in 3737 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 20:57:42.090885 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-2be3b970-4db6-4bec-b3a3-cec1efce7b2f tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Calling method '.version_select at 0x7fd3a440adc0>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:57:42.131113 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-2be3b970-4db6-4bec-b3a3-cec1efce7b2f tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] HTTP exception thrown: Image not found. Oct 22 20:57:42.134407 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-2be3b970-4db6-4bec-b3a3-cec1efce7b2f tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Request method failure captured: Oct 22 20:57:42.134407 ncdv-master-1 devstack@n-api.service[138744]: request: DELETE /compute/v2.1/images/67100460-5801-4548-a9fc-190c376e00e6 HTTP/1.1 Oct 22 20:57:42.134407 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 20:57:42.134407 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 20:57:42.134407 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 20:57:42.134407 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 0 Oct 22 20:57:42.134407 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 20:57:42.134407 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 20:57:42.134407 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 20:57:42.134407 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 20:57:42.134407 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVFinkWQQBhkrT1IKOpDugEkOlAPWNZyP_2NMwr13b9XeVy4UUzw2acgfBjDE3p8vwfHK2_Q3RMg9yYmateTjw8EQOHA7IN0HeuqzZ5uQWL0ysIIG3e_nACVRZdRICvuIM06IV17ajtcJTdsfcK0wPQNbKtAOZi6_8a2UUHyQ1NeNuzI Oct 22 20:57:42.134407 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 20:57:42.134407 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 20:57:42.134407 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 20:57:42.134407 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 20:57:42.134407 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 20:57:42.134407 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 20:57:42.134407 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: 594624ed28aa433d907c8833d360b82e Oct 22 20:57:42.134407 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-477371163 Oct 22 20:57:42.134407 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 20:57:42.134407 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 20:57:42.134407 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_594624ed28aa433d907c8833d360b82e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/594624ed28aa433d907c8833d360b82e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/594624ed28aa433d907c8833d360b82e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/594624ed28aa433d907c8833d360b82e"}]}] Oct 22 20:57:42.134407 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-477371163 Oct 22 20:57:42.134407 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: 594624ed28aa433d907c8833d360b82e Oct 22 20:57:42.134407 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-477371163 Oct 22 20:57:42.134407 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-ImagesOneServerNegativeTestJSON-477371163-project Oct 22 20:57:42.134407 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 20:57:42.134407 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 20:57:42.134407 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: b392ad1fe1fd4b2a9e6be03a7435deb9 Oct 22 20:57:42.134407 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-477371163-project Oct 22 20:57:42.134407 ncdv-master-1 devstack@n-api.service[138744]: method: Oct 22 20:57:42.134407 ncdv-master-1 devstack@n-api.service[138744]: exception: Image not found. Oct 22 20:57:42.134407 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': '67100460-5801-4548-a9fc-190c376e00e6'} Oct 22 20:57:42.134407 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:57:42.134407 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:57:42.134407 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 22 20:57:42.134407 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 22 20:57:42.134407 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 22 20:57:42.134407 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 22 20:57:42.134407 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 22 20:57:42.134407 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 22 20:57:42.134407 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 22 20:57:42.134407 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 22 20:57:42.134407 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 22 20:57:42.134407 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 22 20:57:42.134407 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 22 20:57:42.134407 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 22 20:57:42.134407 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 22 20:57:42.134407 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 22 20:57:42.134407 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 67100460-5801-4548-a9fc-190c376e00e6 to delete Oct 22 20:57:42.134407 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:57:42.134407 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:57:42.134407 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:57:42.134407 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:57:42.134407 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 22 20:57:42.134407 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 22 20:57:42.134407 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 22 20:57:42.134407 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 22 20:57:42.134407 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 22 20:57:42.134407 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 22 20:57:42.134407 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 67100460-5801-4548-a9fc-190c376e00e6 could not be found. Oct 22 20:57:42.134407 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:57:42.134407 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:57:42.134407 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:57:42.137843 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:57:42.137843 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:57:42.137843 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:57:42.137843 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:57:42.137843 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:57:42.137843 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 22 20:57:42.137843 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 22 20:57:42.137843 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:57:42.137843 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:57:42.137843 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 22 20:57:42.137843 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 22 20:57:42.137843 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 22 20:57:42.137843 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:57:42.137843 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:57:42.137843 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:57:42.137843 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:57:42.137843 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:57:42.137843 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:57:42.137843 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 20:57:42.137843 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 20:57:42.137843 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 22 20:57:42.137843 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:57:42.141848 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-2be3b970-4db6-4bec-b3a3-cec1efce7b2f tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Returning 404 to user: Image not found. {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:57:42.144597 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-2be3b970-4db6-4bec-b3a3-cec1efce7b2f tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] 10.222.0.18 "DELETE /compute/v2.1/images/67100460-5801-4548-a9fc-190c376e00e6" status: 404 len: 62 microversion: 2.1 time: 0.058792 Oct 22 20:57:42.151251 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 967/2054] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:57:42 2022] DELETE /compute/v2.1/images/67100460-5801-4548-a9fc-190c376e00e6 => generated 62 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 22 20:57:42.186771 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-5133d795-7105-4a54-8668-ea477cd19264 tempest-ServersTestFqdnHostnames-400258971 tempest-ServersTestFqdnHostnames-400258971-project] Calling method '.version_select at 0x7fd39f8f9b80>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:57:42.223040 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_api:SELECT=86,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:57:42.249811 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-5133d795-7105-4a54-8668-ea477cd19264 tempest-ServersTestFqdnHostnames-400258971 tempest-ServersTestFqdnHostnames-400258971-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1094706457" status: 202 len: 0 microversion: 2.1 time: 0.095034 Oct 22 20:57:42.255784 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 968/2055] 10.222.0.18 () {58 vars in 1221 bytes} [Sat Oct 22 20:57:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1094706457 => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 20:57:42.264835 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-4215402e-95e5-4ba0-b250-5c716af2f95b tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:57:42.266310 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-4215402e-95e5-4ba0-b250-5c716af2f95b tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] [instance: aee36c9d-baf4-453c-b88f-31b8f23638c2] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:57:42.274876 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4215402e-95e5-4ba0-b250-5c716af2f95b tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:42.275813 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4215402e-95e5-4ba0-b250-5c716af2f95b tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:42.276487 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4215402e-95e5-4ba0-b250-5c716af2f95b tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:42.277493 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4215402e-95e5-4ba0-b250-5c716af2f95b tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:42.279072 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4215402e-95e5-4ba0-b250-5c716af2f95b tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:42.279778 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4215402e-95e5-4ba0-b250-5c716af2f95b tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:42.299450 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-f8c37960-ea00-4927-8914-7b73d0148582 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d808e98f843dd9621822682c9d278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b58ab4af674c778b4819f177045651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:57:42.309449 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-f8c37960-ea00-4927-8914-7b73d0148582 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] 10.222.0.18 "GET /compute/v2.1/servers/829a4155-cf7c-470d-a127-c729e32747fe" status: 200 len: 1318 microversion: 2.1 time: 0.421629 Oct 22 20:57:42.311995 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1088/2056] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:57:41 2022] GET /compute/v2.1/servers/829a4155-cf7c-470d-a127-c729e32747fe => generated 1318 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:57:42.322162 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-9496f86b-e755-4c38-a098-258d531ef4cd tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.35.2.230"}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:57:42.335002 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:57:42.684665 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell0:SELECT=4 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:57:42.711769 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell0:SELECT=12 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:57:42.819116 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-4215402e-95e5-4ba0-b250-5c716af2f95b tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d3d7458af447bdb3f03e83a2d8559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49238b8686d24ae698679e4a1957735d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:57:42.831287 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-4215402e-95e5-4ba0-b250-5c716af2f95b tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] 10.222.0.18 "GET /compute/v2.1/servers/aee36c9d-baf4-453c-b88f-31b8f23638c2" status: 200 len: 1542 microversion: 2.1 time: 0.573827 Oct 22 20:57:42.852539 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-9496f86b-e755-4c38-a098-258d531ef4cd tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] [instance: 18183d64-42b7-4b9f-9bca-6d018f17eeb3] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:57:42.865863 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9496f86b-e755-4c38-a098-258d531ef4cd tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:42.866521 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 969/2057] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:57:42 2022] GET /compute/v2.1/servers/aee36c9d-baf4-453c-b88f-31b8f23638c2 => generated 1542 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:57:42.867838 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9496f86b-e755-4c38-a098-258d531ef4cd tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:42.870156 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9496f86b-e755-4c38-a098-258d531ef4cd tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:42.871153 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9496f86b-e755-4c38-a098-258d531ef4cd tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:42.873049 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9496f86b-e755-4c38-a098-258d531ef4cd tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:42.874748 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9496f86b-e755-4c38-a098-258d531ef4cd tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:42.882633 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-42f0ee47-5ffc-4887-b52b-1138ea9046c8 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:57:42.884436 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-42f0ee47-5ffc-4887-b52b-1138ea9046c8 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] [instance: 3de7ee82-86b9-4c34-8b81-46f09d6239d0] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:57:42.904702 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-42f0ee47-5ffc-4887-b52b-1138ea9046c8 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:42.905356 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-42f0ee47-5ffc-4887-b52b-1138ea9046c8 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:42.905821 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-42f0ee47-5ffc-4887-b52b-1138ea9046c8 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:42.907201 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-42f0ee47-5ffc-4887-b52b-1138ea9046c8 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:42.907464 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-42f0ee47-5ffc-4887-b52b-1138ea9046c8 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:42.911935 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-42f0ee47-5ffc-4887-b52b-1138ea9046c8 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:42.965910 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-42f0ee47-5ffc-4887-b52b-1138ea9046c8 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] HTTP exception thrown: Instance 3de7ee82-86b9-4c34-8b81-46f09d6239d0 could not be found. Oct 22 20:57:42.968606 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-42f0ee47-5ffc-4887-b52b-1138ea9046c8 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Request method failure captured: Oct 22 20:57:42.968606 ncdv-master-1 devstack@n-api.service[138744]: request: DELETE /compute/v2.1/servers/3de7ee82-86b9-4c34-8b81-46f09d6239d0 HTTP/1.1 Oct 22 20:57:42.968606 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 20:57:42.968606 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 20:57:42.968606 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 20:57:42.968606 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 0 Oct 22 20:57:42.968606 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 20:57:42.968606 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 20:57:42.968606 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 20:57:42.968606 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 20:57:42.968606 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVFinkWQQBhkrT1IKOpDugEkOlAPWNZyP_2NMwr13b9XeVy4UUzw2acgfBjDE3p8vwfHK2_Q3RMg9yYmateTjw8EQOHA7IN0HeuqzZ5uQWL0ysIIG3e_nACVRZdRICvuIM06IV17ajtcJTdsfcK0wPQNbKtAOZi6_8a2UUHyQ1NeNuzI Oct 22 20:57:42.968606 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 20:57:42.968606 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 20:57:42.968606 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 20:57:42.968606 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 20:57:42.968606 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 20:57:42.968606 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 20:57:42.968606 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: 594624ed28aa433d907c8833d360b82e Oct 22 20:57:42.968606 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-477371163 Oct 22 20:57:42.968606 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 20:57:42.968606 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 20:57:42.968606 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_594624ed28aa433d907c8833d360b82e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/594624ed28aa433d907c8833d360b82e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/594624ed28aa433d907c8833d360b82e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/594624ed28aa433d907c8833d360b82e"}]}] Oct 22 20:57:42.968606 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-477371163 Oct 22 20:57:42.968606 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: 594624ed28aa433d907c8833d360b82e Oct 22 20:57:42.968606 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-477371163 Oct 22 20:57:42.968606 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-ImagesOneServerNegativeTestJSON-477371163-project Oct 22 20:57:42.968606 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 20:57:42.968606 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 20:57:42.968606 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: b392ad1fe1fd4b2a9e6be03a7435deb9 Oct 22 20:57:42.968606 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-477371163-project Oct 22 20:57:42.968606 ncdv-master-1 devstack@n-api.service[138744]: method: > Oct 22 20:57:42.968606 ncdv-master-1 devstack@n-api.service[138744]: exception: Instance 3de7ee82-86b9-4c34-8b81-46f09d6239d0 could not be found. Oct 22 20:57:42.968606 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': '3de7ee82-86b9-4c34-8b81-46f09d6239d0'} Oct 22 20:57:42.968606 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:57:42.968606 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:57:42.968606 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 20:57:42.968606 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 20:57:42.968606 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 20:57:42.968606 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 20:57:42.968606 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 20:57:42.968606 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 20:57:42.968606 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 20:57:42.968606 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 20:57:42.968606 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3de7ee82-86b9-4c34-8b81-46f09d6239d0 could not be found. Oct 22 20:57:42.968606 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:57:42.968606 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:57:42.968606 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:57:42.968606 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:57:42.968606 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:57:42.968606 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:57:42.968606 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:57:42.968606 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:57:42.968606 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:57:42.968606 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:57:42.968606 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 22 20:57:42.968606 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 22 20:57:42.968606 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 22 20:57:42.968606 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 22 20:57:42.968606 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 20:57:42.968606 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 20:57:42.968606 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 20:57:42.968606 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 20:57:42.972037 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3de7ee82-86b9-4c34-8b81-46f09d6239d0 could not be found. Oct 22 20:57:42.972037 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:57:42.972037 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:57:42.972037 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:57:42.972037 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:57:42.972037 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:57:42.972037 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:57:42.972037 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 20:57:42.972037 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 20:57:42.972037 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3de7ee82-86b9-4c34-8b81-46f09d6239d0 could not be found. Oct 22 20:57:42.972037 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:57:42.972037 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-42f0ee47-5ffc-4887-b52b-1138ea9046c8 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Returning 404 to user: Instance 3de7ee82-86b9-4c34-8b81-46f09d6239d0 could not be found. {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:57:42.972037 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-42f0ee47-5ffc-4887-b52b-1138ea9046c8 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] 10.222.0.18 "DELETE /compute/v2.1/servers/3de7ee82-86b9-4c34-8b81-46f09d6239d0" status: 404 len: 111 microversion: 2.1 time: 0.101720 Oct 22 20:57:42.976306 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 970/2058] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 20:57:42 2022] DELETE /compute/v2.1/servers/3de7ee82-86b9-4c34-8b81-46f09d6239d0 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 20:57:42.981544 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-d3469157-38e1-4a5e-baaf-11726be77e9d req-d3ddf17f-db37-4e6f-83db-02159d705b54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd812b37-71ed-400f-ba94-050254f85f9e", "name": "network-vif-plugged", "status": "completed", "tag": "99a319fa-6647-42c1-9395-fd51c25a466c"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:57:43.013852 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-d3469157-38e1-4a5e-baaf-11726be77e9d req-d3ddf17f-db37-4e6f-83db-02159d705b54 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:43.018119 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-d3469157-38e1-4a5e-baaf-11726be77e9d req-d3ddf17f-db37-4e6f-83db-02159d705b54 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:43.019778 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-d3469157-38e1-4a5e-baaf-11726be77e9d req-d3ddf17f-db37-4e6f-83db-02159d705b54 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:43.052301 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-d3469157-38e1-4a5e-baaf-11726be77e9d req-d3ddf17f-db37-4e6f-83db-02159d705b54 service nova] Creating event network-vif-plugged:99a319fa-6647-42c1-9395-fd51c25a466c for instance fd812b37-71ed-400f-ba94-050254f85f9e on nch2-master-1 Oct 22 20:57:43.063431 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-d3469157-38e1-4a5e-baaf-11726be77e9d req-d3ddf17f-db37-4e6f-83db-02159d705b54 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085580 Oct 22 20:57:43.069077 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 971/2059] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:57:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:57:43.089344 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-4fc42aa7-caa9-4367-9ac4-e1882dded7ee tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:57:43.091976 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-4fc42aa7-caa9-4367-9ac4-e1882dded7ee tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] [instance: fd812b37-71ed-400f-ba94-050254f85f9e] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:57:43.103559 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4fc42aa7-caa9-4367-9ac4-e1882dded7ee tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:43.104310 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4fc42aa7-caa9-4367-9ac4-e1882dded7ee tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:43.104944 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4fc42aa7-caa9-4367-9ac4-e1882dded7ee tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:43.106118 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4fc42aa7-caa9-4367-9ac4-e1882dded7ee tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:43.106747 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4fc42aa7-caa9-4367-9ac4-e1882dded7ee tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:43.107320 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4fc42aa7-caa9-4367-9ac4-e1882dded7ee tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:43.408406 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9496f86b-e755-4c38-a098-258d531ef4cd tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] Acquiring lock "refresh_cache-18183d64-42b7-4b9f-9bca-6d018f17eeb3" {{(pid=138745) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 22 20:57:43.409304 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9496f86b-e755-4c38-a098-258d531ef4cd tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] Acquired lock "refresh_cache-18183d64-42b7-4b9f-9bca-6d018f17eeb3" {{(pid=138745) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 22 20:57:43.810180 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-4fc42aa7-caa9-4367-9ac4-e1882dded7ee tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dbe89a7e11480194d3d86f82983499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8351b01e07cd43f9be973ab45e522bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:57:43.818846 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-4fc42aa7-caa9-4367-9ac4-e1882dded7ee tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] 10.222.0.18 "GET /compute/v2.1/servers/fd812b37-71ed-400f-ba94-050254f85f9e" status: 200 len: 1313 microversion: 2.1 time: 0.744415 Oct 22 20:57:43.831790 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 972/2060] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:57:43 2022] GET /compute/v2.1/servers/fd812b37-71ed-400f-ba94-050254f85f9e => generated 1313 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:57:43.840524 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-65b03195-ac87-463e-bdf3-32267104dc32 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:57:43.841672 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-65b03195-ac87-463e-bdf3-32267104dc32 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] [instance: 3de7ee82-86b9-4c34-8b81-46f09d6239d0] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:57:43.848296 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-65b03195-ac87-463e-bdf3-32267104dc32 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:43.848939 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-65b03195-ac87-463e-bdf3-32267104dc32 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:43.849526 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-65b03195-ac87-463e-bdf3-32267104dc32 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:43.850409 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-65b03195-ac87-463e-bdf3-32267104dc32 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:43.851329 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-65b03195-ac87-463e-bdf3-32267104dc32 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:43.851927 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-65b03195-ac87-463e-bdf3-32267104dc32 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:43.866776 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-65b03195-ac87-463e-bdf3-32267104dc32 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] HTTP exception thrown: Instance 3de7ee82-86b9-4c34-8b81-46f09d6239d0 could not be found. Oct 22 20:57:43.868765 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-65b03195-ac87-463e-bdf3-32267104dc32 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Request method failure captured: Oct 22 20:57:43.868765 ncdv-master-1 devstack@n-api.service[138744]: request: GET /compute/v2.1/servers/3de7ee82-86b9-4c34-8b81-46f09d6239d0 HTTP/1.1 Oct 22 20:57:43.868765 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 20:57:43.868765 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 20:57:43.868765 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 20:57:43.868765 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 0 Oct 22 20:57:43.868765 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 20:57:43.868765 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 20:57:43.868765 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 20:57:43.868765 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 20:57:43.868765 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVFinkWQQBhkrT1IKOpDugEkOlAPWNZyP_2NMwr13b9XeVy4UUzw2acgfBjDE3p8vwfHK2_Q3RMg9yYmateTjw8EQOHA7IN0HeuqzZ5uQWL0ysIIG3e_nACVRZdRICvuIM06IV17ajtcJTdsfcK0wPQNbKtAOZi6_8a2UUHyQ1NeNuzI Oct 22 20:57:43.868765 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 20:57:43.868765 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 20:57:43.868765 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 20:57:43.868765 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 20:57:43.868765 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 20:57:43.868765 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 20:57:43.868765 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: 594624ed28aa433d907c8833d360b82e Oct 22 20:57:43.868765 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-477371163 Oct 22 20:57:43.868765 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 20:57:43.868765 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 20:57:43.868765 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_594624ed28aa433d907c8833d360b82e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/594624ed28aa433d907c8833d360b82e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/594624ed28aa433d907c8833d360b82e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/594624ed28aa433d907c8833d360b82e"}]}] Oct 22 20:57:43.868765 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-477371163 Oct 22 20:57:43.868765 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: 594624ed28aa433d907c8833d360b82e Oct 22 20:57:43.868765 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-477371163 Oct 22 20:57:43.868765 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-ImagesOneServerNegativeTestJSON-477371163-project Oct 22 20:57:43.868765 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 20:57:43.868765 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 20:57:43.868765 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: b392ad1fe1fd4b2a9e6be03a7435deb9 Oct 22 20:57:43.868765 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-477371163-project Oct 22 20:57:43.868765 ncdv-master-1 devstack@n-api.service[138744]: method: > Oct 22 20:57:43.868765 ncdv-master-1 devstack@n-api.service[138744]: exception: Instance 3de7ee82-86b9-4c34-8b81-46f09d6239d0 could not be found. Oct 22 20:57:43.868765 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': '3de7ee82-86b9-4c34-8b81-46f09d6239d0'} Oct 22 20:57:43.868765 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:57:43.868765 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:57:43.868765 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 20:57:43.868765 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 20:57:43.868765 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 20:57:43.868765 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 20:57:43.868765 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 20:57:43.868765 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 20:57:43.868765 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 20:57:43.868765 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 20:57:43.868765 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3de7ee82-86b9-4c34-8b81-46f09d6239d0 could not be found. Oct 22 20:57:43.868765 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:57:43.868765 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:57:43.868765 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:57:43.868765 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:57:43.868765 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:57:43.868765 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:57:43.868765 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:57:43.868765 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:57:43.868765 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:57:43.868765 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:57:43.868765 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 20:57:43.868765 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 20:57:43.868765 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 20:57:43.868765 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 20:57:43.868765 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 20:57:43.868765 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 20:57:43.868765 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3de7ee82-86b9-4c34-8b81-46f09d6239d0 could not be found. Oct 22 20:57:43.868765 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:57:43.868765 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:57:43.872766 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:57:43.872766 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:57:43.872766 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:57:43.872766 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:57:43.872766 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 20:57:43.872766 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 20:57:43.872766 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3de7ee82-86b9-4c34-8b81-46f09d6239d0 could not be found. Oct 22 20:57:43.872766 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:57:43.873962 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-65b03195-ac87-463e-bdf3-32267104dc32 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Returning 404 to user: Instance 3de7ee82-86b9-4c34-8b81-46f09d6239d0 could not be found. {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:57:43.874960 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-65b03195-ac87-463e-bdf3-32267104dc32 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] 10.222.0.18 "GET /compute/v2.1/servers/3de7ee82-86b9-4c34-8b81-46f09d6239d0" status: 404 len: 111 microversion: 2.1 time: 0.041884 Oct 22 20:57:43.876090 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 973/2061] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:57:43 2022] GET /compute/v2.1/servers/3de7ee82-86b9-4c34-8b81-46f09d6239d0 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 20:57:43.885869 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-2ea0c191-4dd6-4b07-8b88-b314e283895c req-1240488d-bbb5-4e11-a8f9-49d80b2184c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "829a4155-cf7c-470d-a127-c729e32747fe", "tag": "5057fe59-3905-4c87-83f6-a39a4b64f2fe"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:57:43.897809 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-2ea0c191-4dd6-4b07-8b88-b314e283895c req-1240488d-bbb5-4e11-a8f9-49d80b2184c0 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:43.898453 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-2ea0c191-4dd6-4b07-8b88-b314e283895c req-1240488d-bbb5-4e11-a8f9-49d80b2184c0 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:43.898993 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-2ea0c191-4dd6-4b07-8b88-b314e283895c req-1240488d-bbb5-4e11-a8f9-49d80b2184c0 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:43.932487 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-2ea0c191-4dd6-4b07-8b88-b314e283895c req-1240488d-bbb5-4e11-a8f9-49d80b2184c0 service nova] Creating event network-changed:5057fe59-3905-4c87-83f6-a39a4b64f2fe for instance 829a4155-cf7c-470d-a127-c729e32747fe on nch2-master-1 Oct 22 20:57:43.944630 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-2ea0c191-4dd6-4b07-8b88-b314e283895c req-1240488d-bbb5-4e11-a8f9-49d80b2184c0 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066650 Oct 22 20:57:43.945566 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 974/2062] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:57:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:57:43.955481 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-76f59727-5fc7-4888-90bc-e5edc520fc45 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:57:43.957844 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-76f59727-5fc7-4888-90bc-e5edc520fc45 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] [instance: 829a4155-cf7c-470d-a127-c729e32747fe] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:57:43.971940 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-76f59727-5fc7-4888-90bc-e5edc520fc45 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:43.973066 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-76f59727-5fc7-4888-90bc-e5edc520fc45 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:43.973515 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-76f59727-5fc7-4888-90bc-e5edc520fc45 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:43.974258 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-76f59727-5fc7-4888-90bc-e5edc520fc45 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:43.974723 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-76f59727-5fc7-4888-90bc-e5edc520fc45 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:43.975170 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-76f59727-5fc7-4888-90bc-e5edc520fc45 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:44.674507 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-76f59727-5fc7-4888-90bc-e5edc520fc45 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d808e98f843dd9621822682c9d278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b58ab4af674c778b4819f177045651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:57:44.686247 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-76f59727-5fc7-4888-90bc-e5edc520fc45 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] 10.222.0.18 "GET /compute/v2.1/servers/829a4155-cf7c-470d-a127-c729e32747fe" status: 200 len: 1318 microversion: 2.1 time: 0.738170 Oct 22 20:57:44.690031 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 975/2063] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:57:43 2022] GET /compute/v2.1/servers/829a4155-cf7c-470d-a127-c729e32747fe => generated 1318 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:57:44.699010 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-63981fcd-6207-47b5-b16b-cf7193b37cc6 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:57:44.700067 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-63981fcd-6207-47b5-b16b-cf7193b37cc6 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] [instance: aee36c9d-baf4-453c-b88f-31b8f23638c2] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:57:44.708795 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-63981fcd-6207-47b5-b16b-cf7193b37cc6 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:44.709730 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-63981fcd-6207-47b5-b16b-cf7193b37cc6 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:44.710588 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-63981fcd-6207-47b5-b16b-cf7193b37cc6 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:44.711876 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-63981fcd-6207-47b5-b16b-cf7193b37cc6 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:44.712888 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-63981fcd-6207-47b5-b16b-cf7193b37cc6 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:44.713575 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-63981fcd-6207-47b5-b16b-cf7193b37cc6 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:45.096548 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-63981fcd-6207-47b5-b16b-cf7193b37cc6 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d3d7458af447bdb3f03e83a2d8559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49238b8686d24ae698679e4a1957735d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:57:45.105588 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-63981fcd-6207-47b5-b16b-cf7193b37cc6 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] 10.222.0.18 "GET /compute/v2.1/servers/aee36c9d-baf4-453c-b88f-31b8f23638c2" status: 200 len: 1542 microversion: 2.1 time: 0.413619 Oct 22 20:57:45.113988 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 976/2064] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:57:44 2022] GET /compute/v2.1/servers/aee36c9d-baf4-453c-b88f-31b8f23638c2 => generated 1542 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:57:45.128040 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-6743df9f-813d-4b1c-a191-d31db820dfd4 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Calling method '.version_select at 0x7fd39f8f9280>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:57:45.174930 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-6743df9f-813d-4b1c-a191-d31db820dfd4 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-785660458" status: 202 len: 0 microversion: 2.1 time: 0.059471 Oct 22 20:57:45.180376 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 977/2065] 10.222.0.18 () {58 vars in 1218 bytes} [Sat Oct 22 20:57:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-785660458 => generated 0 bytes in 66 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 20:57:45.185428 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-9726b155-966b-4f04-810f-abf2edf31b13 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:57:45.186329 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-9726b155-966b-4f04-810f-abf2edf31b13 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] [instance: fd812b37-71ed-400f-ba94-050254f85f9e] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:57:45.200502 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9726b155-966b-4f04-810f-abf2edf31b13 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:45.203151 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9726b155-966b-4f04-810f-abf2edf31b13 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:45.205856 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9726b155-966b-4f04-810f-abf2edf31b13 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:45.207517 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9726b155-966b-4f04-810f-abf2edf31b13 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:45.209456 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9726b155-966b-4f04-810f-abf2edf31b13 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:45.210115 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9726b155-966b-4f04-810f-abf2edf31b13 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:45.652296 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-9726b155-966b-4f04-810f-abf2edf31b13 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dbe89a7e11480194d3d86f82983499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8351b01e07cd43f9be973ab45e522bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:57:45.666061 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-9726b155-966b-4f04-810f-abf2edf31b13 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] 10.222.0.18 "GET /compute/v2.1/servers/fd812b37-71ed-400f-ba94-050254f85f9e" status: 200 len: 1463 microversion: 2.1 time: 0.484368 Oct 22 20:57:45.666939 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 978/2066] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:57:45 2022] GET /compute/v2.1/servers/fd812b37-71ed-400f-ba94-050254f85f9e => generated 1463 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:57:45.670476 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.network.neutron [None req-9496f86b-e755-4c38-a098-258d531ef4cd tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] [instance: 18183d64-42b7-4b9f-9bca-6d018f17eeb3] Building network info cache for instance {{(pid=138745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 22 20:57:46.044389 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-538e68e7-243c-4de8-83b9-c7bcb1c75e3e tempest-ServersAdminTestJSON-1747089598 tempest-ServersAdminTestJSON-1747089598-project-admin] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:57:46.050197 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-538e68e7-243c-4de8-83b9-c7bcb1c75e3e tempest-ServersAdminTestJSON-1747089598 tempest-ServersAdminTestJSON-1747089598-project-admin] Searching by: {'deleted': False, 'project_id': 'a5a6a96d256e458e9885273afe6b24fe'} {{(pid=138744) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 22 20:57:46.063894 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-538e68e7-243c-4de8-83b9-c7bcb1c75e3e tempest-ServersAdminTestJSON-1747089598 tempest-ServersAdminTestJSON-1747089598-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:46.064839 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-538e68e7-243c-4de8-83b9-c7bcb1c75e3e tempest-ServersAdminTestJSON-1747089598 tempest-ServersAdminTestJSON-1747089598-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:46.065983 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-538e68e7-243c-4de8-83b9-c7bcb1c75e3e tempest-ServersAdminTestJSON-1747089598 tempest-ServersAdminTestJSON-1747089598-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:46.072347 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-538e68e7-243c-4de8-83b9-c7bcb1c75e3e tempest-ServersAdminTestJSON-1747089598 tempest-ServersAdminTestJSON-1747089598-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:46.073217 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-538e68e7-243c-4de8-83b9-c7bcb1c75e3e tempest-ServersAdminTestJSON-1747089598 tempest-ServersAdminTestJSON-1747089598-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:46.074279 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-538e68e7-243c-4de8-83b9-c7bcb1c75e3e tempest-ServersAdminTestJSON-1747089598 tempest-ServersAdminTestJSON-1747089598-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:46.122851 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-538e68e7-243c-4de8-83b9-c7bcb1c75e3e tempest-ServersAdminTestJSON-1747089598 tempest-ServersAdminTestJSON-1747089598-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/detail" status: 200 len: 15 microversion: 2.1 time: 0.431105 Oct 22 20:57:46.124178 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 979/2067] 10.222.0.18 () {58 vars in 1146 bytes} [Sat Oct 22 20:57:45 2022] GET /compute/v2.1/servers/detail => generated 15 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 22 20:57:46.130311 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-25cd0852-989f-4cde-86e9-859951156fb2 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:57:46.131225 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-25cd0852-989f-4cde-86e9-859951156fb2 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] [instance: 829a4155-cf7c-470d-a127-c729e32747fe] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:57:46.138957 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-25cd0852-989f-4cde-86e9-859951156fb2 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:46.140130 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-25cd0852-989f-4cde-86e9-859951156fb2 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:46.140789 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-25cd0852-989f-4cde-86e9-859951156fb2 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:46.141767 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-25cd0852-989f-4cde-86e9-859951156fb2 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:46.142424 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-25cd0852-989f-4cde-86e9-859951156fb2 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:46.143058 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-25cd0852-989f-4cde-86e9-859951156fb2 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:46.944795 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-25cd0852-989f-4cde-86e9-859951156fb2 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d808e98f843dd9621822682c9d278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b58ab4af674c778b4819f177045651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:57:46.959566 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-25cd0852-989f-4cde-86e9-859951156fb2 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] 10.222.0.18 "GET /compute/v2.1/servers/829a4155-cf7c-470d-a127-c729e32747fe" status: 200 len: 1318 microversion: 2.1 time: 0.833995 Oct 22 20:57:46.960469 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 980/2068] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:57:46 2022] GET /compute/v2.1/servers/829a4155-cf7c-470d-a127-c729e32747fe => generated 1318 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:57:46.965647 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-f4d6b444-cbf9-4eed-bbcb-5e917ddce6d2 req-3cfa1271-2905-4191-8930-940a98e3329b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "18183d64-42b7-4b9f-9bca-6d018f17eeb3", "tag": "26816847-4085-4357-9ca7-d768088c1a37"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:57:46.978572 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-f4d6b444-cbf9-4eed-bbcb-5e917ddce6d2 req-3cfa1271-2905-4191-8930-940a98e3329b service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:46.979399 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-f4d6b444-cbf9-4eed-bbcb-5e917ddce6d2 req-3cfa1271-2905-4191-8930-940a98e3329b service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:46.980130 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-f4d6b444-cbf9-4eed-bbcb-5e917ddce6d2 req-3cfa1271-2905-4191-8930-940a98e3329b service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:46.993723 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-f4d6b444-cbf9-4eed-bbcb-5e917ddce6d2 req-3cfa1271-2905-4191-8930-940a98e3329b service nova] Creating event network-changed:26816847-4085-4357-9ca7-d768088c1a37 for instance 18183d64-42b7-4b9f-9bca-6d018f17eeb3 on nch1-master-1 Oct 22 20:57:47.009608 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-f4d6b444-cbf9-4eed-bbcb-5e917ddce6d2 req-3cfa1271-2905-4191-8930-940a98e3329b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047774 Oct 22 20:57:47.015758 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 981/2069] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:57:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:57:47.032450 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-f1c3e391-c145-4b5f-a3a4-09e25979e30b tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:57:47.033443 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-f1c3e391-c145-4b5f-a3a4-09e25979e30b tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] [instance: aee36c9d-baf4-453c-b88f-31b8f23638c2] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:57:47.053485 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f1c3e391-c145-4b5f-a3a4-09e25979e30b tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:47.054698 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f1c3e391-c145-4b5f-a3a4-09e25979e30b tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:47.056802 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f1c3e391-c145-4b5f-a3a4-09e25979e30b tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:47.058935 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f1c3e391-c145-4b5f-a3a4-09e25979e30b tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:47.061961 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f1c3e391-c145-4b5f-a3a4-09e25979e30b tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:47.062891 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f1c3e391-c145-4b5f-a3a4-09e25979e30b tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:47.881617 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-f1c3e391-c145-4b5f-a3a4-09e25979e30b tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d3d7458af447bdb3f03e83a2d8559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49238b8686d24ae698679e4a1957735d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:57:47.899923 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-f1c3e391-c145-4b5f-a3a4-09e25979e30b tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] 10.222.0.18 "GET /compute/v2.1/servers/aee36c9d-baf4-453c-b88f-31b8f23638c2" status: 200 len: 1542 microversion: 2.1 time: 0.882353 Oct 22 20:57:47.917700 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 982/2070] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:57:47 2022] GET /compute/v2.1/servers/aee36c9d-baf4-453c-b88f-31b8f23638c2 => generated 1542 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:57:47.922845 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.network.neutron [None req-9496f86b-e755-4c38-a098-258d531ef4cd tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] [instance: 18183d64-42b7-4b9f-9bca-6d018f17eeb3] Updating instance_info_cache with network_info: [{"id": "26816847-4085-4357-9ca7-d768088c1a37", "address": "fa:16:3e:76:ee:d6", "network": {"id": "f91354a8-e9f6-4d96-999f-cacf94b2f223", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-515688257-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "7e883d7e73084efeb725945ae0bab317", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap26816847-40", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=138745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 22 20:57:47.924623 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-aab71c82-5bb5-48a5-ae09-39858a7f802b tempest-ServersAdminTestJSON-1747089598 tempest-ServersAdminTestJSON-1747089598-project-admin] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:57:47.931447 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-aab71c82-5bb5-48a5-ae09-39858a7f802b tempest-ServersAdminTestJSON-1747089598 tempest-ServersAdminTestJSON-1747089598-project-admin] Searching by: {'deleted': False} {{(pid=138744) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 22 20:57:47.947501 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9496f86b-e755-4c38-a098-258d531ef4cd tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] Releasing lock "refresh_cache-18183d64-42b7-4b9f-9bca-6d018f17eeb3" {{(pid=138745) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 22 20:57:47.948785 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-9496f86b-e755-4c38-a098-258d531ef4cd tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] 10.222.0.18 "POST /compute/v2.1/servers/18183d64-42b7-4b9f-9bca-6d018f17eeb3/action" status: 202 len: 0 microversion: 2.1 time: 5.635666 Oct 22 20:57:47.949935 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1089/2071] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 20:57:42 2022] POST /compute/v2.1/servers/18183d64-42b7-4b9f-9bca-6d018f17eeb3/action => generated 0 bytes in 5637 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 22 20:57:47.956890 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-8d7f277a-82b0-4470-8eea-3cd84e0d9fc7 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Calling method '.version_select at 0x7fd39fcddb80>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:57:47.962349 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-aab71c82-5bb5-48a5-ae09-39858a7f802b tempest-ServersAdminTestJSON-1747089598 tempest-ServersAdminTestJSON-1747089598-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:47.964584 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-aab71c82-5bb5-48a5-ae09-39858a7f802b tempest-ServersAdminTestJSON-1747089598 tempest-ServersAdminTestJSON-1747089598-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:47.967026 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-aab71c82-5bb5-48a5-ae09-39858a7f802b tempest-ServersAdminTestJSON-1747089598 tempest-ServersAdminTestJSON-1747089598-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:47.969302 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-aab71c82-5bb5-48a5-ae09-39858a7f802b tempest-ServersAdminTestJSON-1747089598 tempest-ServersAdminTestJSON-1747089598-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:47.970487 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-aab71c82-5bb5-48a5-ae09-39858a7f802b tempest-ServersAdminTestJSON-1747089598 tempest-ServersAdminTestJSON-1747089598-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:47.971110 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-aab71c82-5bb5-48a5-ae09-39858a7f802b tempest-ServersAdminTestJSON-1747089598 tempest-ServersAdminTestJSON-1747089598-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:47.998227 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.wsgi [None req-8d7f277a-82b0-4470-8eea-3cd84e0d9fc7 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] HTTP exception thrown: Image not found. Oct 22 20:57:48.000260 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-8d7f277a-82b0-4470-8eea-3cd84e0d9fc7 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Request method failure captured: Oct 22 20:57:48.000260 ncdv-master-1 devstack@n-api.service[138745]: request: DELETE /compute/v2.1/images/474ae65f-4a05-438e-94bb-dd4bc5b0a82e HTTP/1.1 Oct 22 20:57:48.000260 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 20:57:48.000260 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 20:57:48.000260 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 20:57:48.000260 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 0 Oct 22 20:57:48.000260 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 20:57:48.000260 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 20:57:48.000260 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 20:57:48.000260 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 20:57:48.000260 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVFinkWQQBhkrT1IKOpDugEkOlAPWNZyP_2NMwr13b9XeVy4UUzw2acgfBjDE3p8vwfHK2_Q3RMg9yYmateTjw8EQOHA7IN0HeuqzZ5uQWL0ysIIG3e_nACVRZdRICvuIM06IV17ajtcJTdsfcK0wPQNbKtAOZi6_8a2UUHyQ1NeNuzI Oct 22 20:57:48.000260 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 20:57:48.000260 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 20:57:48.000260 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 20:57:48.000260 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 20:57:48.000260 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 20:57:48.000260 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 20:57:48.000260 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: 594624ed28aa433d907c8833d360b82e Oct 22 20:57:48.000260 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-477371163 Oct 22 20:57:48.000260 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 20:57:48.000260 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 20:57:48.000260 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_594624ed28aa433d907c8833d360b82e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/594624ed28aa433d907c8833d360b82e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/594624ed28aa433d907c8833d360b82e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/594624ed28aa433d907c8833d360b82e"}]}] Oct 22 20:57:48.000260 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-477371163 Oct 22 20:57:48.000260 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: 594624ed28aa433d907c8833d360b82e Oct 22 20:57:48.000260 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-477371163 Oct 22 20:57:48.000260 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-ImagesOneServerNegativeTestJSON-477371163-project Oct 22 20:57:48.000260 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 20:57:48.000260 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 20:57:48.000260 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: b392ad1fe1fd4b2a9e6be03a7435deb9 Oct 22 20:57:48.000260 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-477371163-project Oct 22 20:57:48.000260 ncdv-master-1 devstack@n-api.service[138745]: method: Oct 22 20:57:48.000260 ncdv-master-1 devstack@n-api.service[138745]: exception: Image not found. Oct 22 20:57:48.000260 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'id': '474ae65f-4a05-438e-94bb-dd4bc5b0a82e'} Oct 22 20:57:48.000260 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:57:48.000260 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:57:48.000260 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 22 20:57:48.000260 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 22 20:57:48.000260 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 22 20:57:48.000260 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 22 20:57:48.000260 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 22 20:57:48.000260 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 22 20:57:48.000260 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 22 20:57:48.000260 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 22 20:57:48.000260 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 22 20:57:48.000260 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 22 20:57:48.000260 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 22 20:57:48.000260 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 22 20:57:48.000260 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 22 20:57:48.000260 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 22 20:57:48.000260 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 474ae65f-4a05-438e-94bb-dd4bc5b0a82e to delete Oct 22 20:57:48.000260 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:57:48.000260 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:57:48.000260 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:57:48.000260 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:57:48.000260 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 22 20:57:48.000260 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 22 20:57:48.000260 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 22 20:57:48.000260 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 22 20:57:48.000260 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 22 20:57:48.000260 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 22 20:57:48.000260 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 474ae65f-4a05-438e-94bb-dd4bc5b0a82e could not be found. Oct 22 20:57:48.000260 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:57:48.000260 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:57:48.000260 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:57:48.003787 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:57:48.003787 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:57:48.003787 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:57:48.003787 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:57:48.003787 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:57:48.003787 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 22 20:57:48.003787 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 22 20:57:48.003787 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:57:48.003787 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:57:48.003787 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 22 20:57:48.003787 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 22 20:57:48.003787 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 22 20:57:48.003787 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:57:48.003787 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:57:48.003787 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:57:48.003787 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:57:48.003787 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:57:48.003787 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:57:48.003787 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 20:57:48.003787 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 20:57:48.003787 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 22 20:57:48.003787 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:57:48.006519 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-8d7f277a-82b0-4470-8eea-3cd84e0d9fc7 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Returning 404 to user: Image not found. {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:57:48.007588 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-8d7f277a-82b0-4470-8eea-3cd84e0d9fc7 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] 10.222.0.18 "DELETE /compute/v2.1/images/474ae65f-4a05-438e-94bb-dd4bc5b0a82e" status: 404 len: 62 microversion: 2.1 time: 0.056467 Oct 22 20:57:48.008253 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1090/2072] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:57:47 2022] DELETE /compute/v2.1/images/474ae65f-4a05-438e-94bb-dd4bc5b0a82e => generated 62 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 22 20:57:48.176150 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.multi_cell_list [None req-aab71c82-5bb5-48a5-ae09-39858a7f802b tempest-ServersAdminTestJSON-1747089598 tempest-ServersAdminTestJSON-1747089598-project-admin] Listed batch of 9 results from cell out of 1000 limit. Returned 9 total so far. {{(pid=138744) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 22 20:57:48.275279 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-aab71c82-5bb5-48a5-ae09-39858a7f802b tempest-ServersAdminTestJSON-1747089598 tempest-ServersAdminTestJSON-1747089598-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:48.276193 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-aab71c82-5bb5-48a5-ae09-39858a7f802b tempest-ServersAdminTestJSON-1747089598 tempest-ServersAdminTestJSON-1747089598-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:48.277205 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-aab71c82-5bb5-48a5-ae09-39858a7f802b tempest-ServersAdminTestJSON-1747089598 tempest-ServersAdminTestJSON-1747089598-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:48.427707 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-c9435037-1410-4d26-8a70-d8e136e9d452 tempest-ServerPasswordTestJSON-1023240106 tempest-ServerPasswordTestJSON-1023240106-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerPasswordTestJSON-server-1771089125", "imageRef": "085e4478-6edc-4a69-8e08-f9831713eb65", "flavorRef": "452", "networks": [{"uuid": "b60b0231-52aa-4c88-9a7e-1c8e66b28e0e"}]}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:57:48.494417 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.network.neutron [None req-c9435037-1410-4d26-8a70-d8e136e9d452 tempest-ServerPasswordTestJSON-1023240106 tempest-ServerPasswordTestJSON-1023240106-project] validate_networks() for [('b60b0231-52aa-4c88-9a7e-1c8e66b28e0e', None, None, None, None, None)] {{(pid=138745) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 20:57:50.080614 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-aab71c82-5bb5-48a5-ae09-39858a7f802b tempest-ServersAdminTestJSON-1747089598 tempest-ServersAdminTestJSON-1747089598-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/detail?all_tenants=" status: 200 len: 14453 microversion: 2.1 time: 2.160062 Oct 22 20:57:50.082094 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 983/2073] 10.222.0.18 () {58 vars in 1171 bytes} [Sat Oct 22 20:57:47 2022] GET /compute/v2.1/servers/detail?all_tenants= => generated 14453 bytes in 2163 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 22 20:57:50.094501 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-5f7a9012-5d7b-41cf-aab5-8147eef7e248 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] Calling method '.version_select at 0x7fd3a45640d0>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:57:50.545295 ncdv-master-1 devstack@n-api.service[138745]: ERROR sqlalchemy.pool.impl.QueuePool [-] Exception during reset or similar: AssertionError: do not call blocking functions from the mainloop Oct 22 20:57:50.545295 ncdv-master-1 devstack@n-api.service[138745]: ERROR sqlalchemy.pool.impl.QueuePool Traceback (most recent call last): Oct 22 20:57:50.545295 ncdv-master-1 devstack@n-api.service[138745]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/pool/base.py", line 739, in _finalize_fairy Oct 22 20:57:50.545295 ncdv-master-1 devstack@n-api.service[138745]: ERROR sqlalchemy.pool.impl.QueuePool fairy._reset(pool) Oct 22 20:57:50.545295 ncdv-master-1 devstack@n-api.service[138745]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/pool/base.py", line 988, in _reset Oct 22 20:57:50.545295 ncdv-master-1 devstack@n-api.service[138745]: ERROR sqlalchemy.pool.impl.QueuePool pool._dialect.do_rollback(self) Oct 22 20:57:50.545295 ncdv-master-1 devstack@n-api.service[138745]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 682, in do_rollback Oct 22 20:57:50.545295 ncdv-master-1 devstack@n-api.service[138745]: ERROR sqlalchemy.pool.impl.QueuePool dbapi_connection.rollback() Oct 22 20:57:50.545295 ncdv-master-1 devstack@n-api.service[138745]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 480, in rollback Oct 22 20:57:50.545295 ncdv-master-1 devstack@n-api.service[138745]: ERROR sqlalchemy.pool.impl.QueuePool self._read_ok_packet() Oct 22 20:57:50.545295 ncdv-master-1 devstack@n-api.service[138745]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 443, in _read_ok_packet Oct 22 20:57:50.545295 ncdv-master-1 devstack@n-api.service[138745]: ERROR sqlalchemy.pool.impl.QueuePool pkt = self._read_packet() Oct 22 20:57:50.545295 ncdv-master-1 devstack@n-api.service[138745]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 692, in _read_packet Oct 22 20:57:50.545295 ncdv-master-1 devstack@n-api.service[138745]: ERROR sqlalchemy.pool.impl.QueuePool packet_header = self._read_bytes(4) Oct 22 20:57:50.545295 ncdv-master-1 devstack@n-api.service[138745]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 732, in _read_bytes Oct 22 20:57:50.545295 ncdv-master-1 devstack@n-api.service[138745]: ERROR sqlalchemy.pool.impl.QueuePool data = self._rfile.read(num_bytes) Oct 22 20:57:50.545295 ncdv-master-1 devstack@n-api.service[138745]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/lib/python3.8/socket.py", line 669, in readinto Oct 22 20:57:50.545295 ncdv-master-1 devstack@n-api.service[138745]: ERROR sqlalchemy.pool.impl.QueuePool return self._sock.recv_into(b) Oct 22 20:57:50.545295 ncdv-master-1 devstack@n-api.service[138745]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/eventlet/greenio/base.py", line 376, in recv_into Oct 22 20:57:50.545295 ncdv-master-1 devstack@n-api.service[138745]: ERROR sqlalchemy.pool.impl.QueuePool return self._recv_loop(self.fd.recv_into, 0, buffer, nbytes, flags) Oct 22 20:57:50.545295 ncdv-master-1 devstack@n-api.service[138745]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/eventlet/greenio/base.py", line 364, in _recv_loop Oct 22 20:57:50.545295 ncdv-master-1 devstack@n-api.service[138745]: ERROR sqlalchemy.pool.impl.QueuePool self._read_trampoline() Oct 22 20:57:50.545295 ncdv-master-1 devstack@n-api.service[138745]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/eventlet/greenio/base.py", line 332, in _read_trampoline Oct 22 20:57:50.545295 ncdv-master-1 devstack@n-api.service[138745]: ERROR sqlalchemy.pool.impl.QueuePool self._trampoline( Oct 22 20:57:50.545295 ncdv-master-1 devstack@n-api.service[138745]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/eventlet/greenio/base.py", line 211, in _trampoline Oct 22 20:57:50.545295 ncdv-master-1 devstack@n-api.service[138745]: ERROR sqlalchemy.pool.impl.QueuePool return trampoline(fd, read=read, write=write, timeout=timeout, Oct 22 20:57:50.545295 ncdv-master-1 devstack@n-api.service[138745]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/__init__.py", line 141, in trampoline Oct 22 20:57:50.545295 ncdv-master-1 devstack@n-api.service[138745]: ERROR sqlalchemy.pool.impl.QueuePool assert hub.greenlet is not current, 'do not call blocking functions from the mainloop' Oct 22 20:57:50.545295 ncdv-master-1 devstack@n-api.service[138745]: ERROR sqlalchemy.pool.impl.QueuePool AssertionError: do not call blocking functions from the mainloop Oct 22 20:57:50.545295 ncdv-master-1 devstack@n-api.service[138745]: ERROR sqlalchemy.pool.impl.QueuePool Oct 22 20:57:50.548216 ncdv-master-1 devstack@n-api.service[138745]: Exception ignored in: . at 0x7fd39fbdc1f0> Oct 22 20:57:50.548355 ncdv-master-1 devstack@n-api.service[138745]: Traceback (most recent call last): Oct 22 20:57:50.548537 ncdv-master-1 devstack@n-api.service[138745]: File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/pool/base.py", line 488, in Oct 22 20:57:50.548985 ncdv-master-1 devstack@n-api.service[138745]: and _finalize_fairy(None, rec, pool, ref, echo, True), Oct 22 20:57:50.549128 ncdv-master-1 devstack@n-api.service[138745]: File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/pool/base.py", line 774, in _finalize_fairy Oct 22 20:57:50.550509 ncdv-master-1 devstack@n-api.service[138745]: connection_record.checkin() Oct 22 20:57:50.550666 ncdv-master-1 devstack@n-api.service[138745]: File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/pool/base.py", line 521, in checkin Oct 22 20:57:50.551066 ncdv-master-1 devstack@n-api.service[138745]: pool.dispatch.checkin(connection, self) Oct 22 20:57:50.551449 ncdv-master-1 devstack@n-api.service[138745]: File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/event/attr.py", line 343, in __call__ Oct 22 20:57:50.558166 ncdv-master-1 devstack@n-api.service[138745]: fn(*args, **kw) Oct 22 20:57:50.558166 ncdv-master-1 devstack@n-api.service[138745]: File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py", line 52, in _thread_yield Oct 22 20:57:50.560364 ncdv-master-1 devstack@n-api.service[138745]: time.sleep(0) Oct 22 20:57:50.560364 ncdv-master-1 devstack@n-api.service[138745]: File "/usr/local/lib/python3.8/dist-packages/eventlet/greenthread.py", line 33, in sleep Oct 22 20:57:50.567976 ncdv-master-1 devstack@n-api.service[138745]: assert hub.greenlet is not current, 'do not call blocking functions from the mainloop' Oct 22 20:57:50.568399 ncdv-master-1 devstack@n-api.service[138745]: AssertionError: do not call blocking functions from the mainloop Oct 22 20:57:50.945893 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-c9435037-1410-4d26-8a70-d8e136e9d452 tempest-ServerPasswordTestJSON-1023240106 tempest-ServerPasswordTestJSON-1023240106-project] Flavor limits 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 20:57:50.945893 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-c9435037-1410-4d26-8a70-d8e136e9d452 tempest-ServerPasswordTestJSON-1023240106 tempest-ServerPasswordTestJSON-1023240106-project] Image limits 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 20:57:50.945893 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-c9435037-1410-4d26-8a70-d8e136e9d452 tempest-ServerPasswordTestJSON-1023240106 tempest-ServerPasswordTestJSON-1023240106-project] Flavor pref 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 20:57:50.945893 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-c9435037-1410-4d26-8a70-d8e136e9d452 tempest-ServerPasswordTestJSON-1023240106 tempest-ServerPasswordTestJSON-1023240106-project] Image pref 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 20:57:50.945893 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-c9435037-1410-4d26-8a70-d8e136e9d452 tempest-ServerPasswordTestJSON-1023240106 tempest-ServerPasswordTestJSON-1023240106-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 20:57:50.962822 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c9435037-1410-4d26-8a70-d8e136e9d452 tempest-ServerPasswordTestJSON-1023240106 tempest-ServerPasswordTestJSON-1023240106-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:50.963326 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c9435037-1410-4d26-8a70-d8e136e9d452 tempest-ServerPasswordTestJSON-1023240106 tempest-ServerPasswordTestJSON-1023240106-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:50.963799 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c9435037-1410-4d26-8a70-d8e136e9d452 tempest-ServerPasswordTestJSON-1023240106 tempest-ServerPasswordTestJSON-1023240106-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:50.964540 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c9435037-1410-4d26-8a70-d8e136e9d452 tempest-ServerPasswordTestJSON-1023240106 tempest-ServerPasswordTestJSON-1023240106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:50.969615 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c9435037-1410-4d26-8a70-d8e136e9d452 tempest-ServerPasswordTestJSON-1023240106 tempest-ServerPasswordTestJSON-1023240106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:50.971119 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c9435037-1410-4d26-8a70-d8e136e9d452 tempest-ServerPasswordTestJSON-1023240106 tempest-ServerPasswordTestJSON-1023240106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:50.996339 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-c9435037-1410-4d26-8a70-d8e136e9d452 tempest-ServerPasswordTestJSON-1023240106 tempest-ServerPasswordTestJSON-1023240106-project] Getting quotas for project 3e9492cfb8c4487989bce6074736df04. Resources: {'cores', 'instances', 'ram'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 20:57:51.003972 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-c9435037-1410-4d26-8a70-d8e136e9d452 tempest-ServerPasswordTestJSON-1023240106 tempest-ServerPasswordTestJSON-1023240106-project] Getting quotas for user 3466ea643c9142cfa0678d4cc277faab and project 3e9492cfb8c4487989bce6074736df04. Resources: {'cores', 'instances', 'ram'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 20:57:51.022485 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_api:INSERT=4,nova_api:SELECT=94,nova_api:UPDATE=2 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:57:51.024571 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-c9435037-1410-4d26-8a70-d8e136e9d452 tempest-ServerPasswordTestJSON-1023240106 tempest-ServerPasswordTestJSON-1023240106-project] Going to run 1 instances... {{(pid=138745) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 20:57:51.028899 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-c9435037-1410-4d26-8a70-d8e136e9d452 tempest-ServerPasswordTestJSON-1023240106 tempest-ServerPasswordTestJSON-1023240106-project] [instance: 659e6aaf-82b7-4361-8289-970d6de4a7b7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='085e4478-6edc-4a69-8e08-f9831713eb65',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138745) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 20:57:51.154816 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-c9435037-1410-4d26-8a70-d8e136e9d452 tempest-ServerPasswordTestJSON-1023240106 tempest-ServerPasswordTestJSON-1023240106-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.144644 Oct 22 20:57:51.155539 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1091/2074] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Oct 22 20:57:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 3147 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 20:57:51.171810 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-76dc5b2a-846b-4a6b-b63d-1da9b89001f1 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:57:51.174365 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-76dc5b2a-846b-4a6b-b63d-1da9b89001f1 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] [instance: 829a4155-cf7c-470d-a127-c729e32747fe] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:57:51.190470 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-76dc5b2a-846b-4a6b-b63d-1da9b89001f1 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:51.191332 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-76dc5b2a-846b-4a6b-b63d-1da9b89001f1 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:51.192066 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-76dc5b2a-846b-4a6b-b63d-1da9b89001f1 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:51.194623 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-76dc5b2a-846b-4a6b-b63d-1da9b89001f1 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:51.197204 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-76dc5b2a-846b-4a6b-b63d-1da9b89001f1 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:51.198005 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-76dc5b2a-846b-4a6b-b63d-1da9b89001f1 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:51.870208 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-76dc5b2a-846b-4a6b-b63d-1da9b89001f1 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d808e98f843dd9621822682c9d278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b58ab4af674c778b4819f177045651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:57:51.884135 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-76dc5b2a-846b-4a6b-b63d-1da9b89001f1 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] 10.222.0.18 "GET /compute/v2.1/servers/829a4155-cf7c-470d-a127-c729e32747fe" status: 200 len: 1318 microversion: 2.1 time: 0.723338 Oct 22 20:57:51.885925 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1092/2075] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:57:51 2022] GET /compute/v2.1/servers/829a4155-cf7c-470d-a127-c729e32747fe => generated 1318 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:57:51.902885 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-702803ad-597a-4269-9143-dd085bba4b59 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:57:51.903576 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-702803ad-597a-4269-9143-dd085bba4b59 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] [instance: a64fa89e-32f6-4994-a0b2-3788cf1c92ec] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:57:51.915174 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-702803ad-597a-4269-9143-dd085bba4b59 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:51.919940 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-702803ad-597a-4269-9143-dd085bba4b59 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:51.921274 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-702803ad-597a-4269-9143-dd085bba4b59 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:51.923622 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-702803ad-597a-4269-9143-dd085bba4b59 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:51.924255 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-702803ad-597a-4269-9143-dd085bba4b59 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:51.925023 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-702803ad-597a-4269-9143-dd085bba4b59 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:51.944664 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.wsgi [None req-702803ad-597a-4269-9143-dd085bba4b59 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] HTTP exception thrown: Instance a64fa89e-32f6-4994-a0b2-3788cf1c92ec could not be found. Oct 22 20:57:51.947323 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-702803ad-597a-4269-9143-dd085bba4b59 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Request method failure captured: Oct 22 20:57:51.947323 ncdv-master-1 devstack@n-api.service[138745]: request: DELETE /compute/v2.1/servers/a64fa89e-32f6-4994-a0b2-3788cf1c92ec HTTP/1.1 Oct 22 20:57:51.947323 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 20:57:51.947323 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 20:57:51.947323 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 20:57:51.947323 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 0 Oct 22 20:57:51.947323 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 20:57:51.947323 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 20:57:51.947323 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 20:57:51.947323 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 20:57:51.947323 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVFinkWQQBhkrT1IKOpDugEkOlAPWNZyP_2NMwr13b9XeVy4UUzw2acgfBjDE3p8vwfHK2_Q3RMg9yYmateTjw8EQOHA7IN0HeuqzZ5uQWL0ysIIG3e_nACVRZdRICvuIM06IV17ajtcJTdsfcK0wPQNbKtAOZi6_8a2UUHyQ1NeNuzI Oct 22 20:57:51.947323 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 20:57:51.947323 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 20:57:51.947323 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 20:57:51.947323 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 20:57:51.947323 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 20:57:51.947323 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 20:57:51.947323 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: 594624ed28aa433d907c8833d360b82e Oct 22 20:57:51.947323 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-477371163 Oct 22 20:57:51.947323 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 20:57:51.947323 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 20:57:51.947323 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_594624ed28aa433d907c8833d360b82e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/594624ed28aa433d907c8833d360b82e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/594624ed28aa433d907c8833d360b82e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/594624ed28aa433d907c8833d360b82e"}]}] Oct 22 20:57:51.947323 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-477371163 Oct 22 20:57:51.947323 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: 594624ed28aa433d907c8833d360b82e Oct 22 20:57:51.947323 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-477371163 Oct 22 20:57:51.947323 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-ImagesOneServerNegativeTestJSON-477371163-project Oct 22 20:57:51.947323 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 20:57:51.947323 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 20:57:51.947323 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: b392ad1fe1fd4b2a9e6be03a7435deb9 Oct 22 20:57:51.947323 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-477371163-project Oct 22 20:57:51.947323 ncdv-master-1 devstack@n-api.service[138745]: method: > Oct 22 20:57:51.947323 ncdv-master-1 devstack@n-api.service[138745]: exception: Instance a64fa89e-32f6-4994-a0b2-3788cf1c92ec could not be found. Oct 22 20:57:51.947323 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'id': 'a64fa89e-32f6-4994-a0b2-3788cf1c92ec'} Oct 22 20:57:51.947323 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:57:51.947323 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:57:51.947323 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 20:57:51.947323 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 20:57:51.947323 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 20:57:51.947323 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 20:57:51.947323 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 20:57:51.947323 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 20:57:51.947323 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 20:57:51.947323 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 20:57:51.947323 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a64fa89e-32f6-4994-a0b2-3788cf1c92ec could not be found. Oct 22 20:57:51.947323 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:57:51.947323 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:57:51.947323 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:57:51.947323 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:57:51.947323 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:57:51.947323 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:57:51.947323 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:57:51.947323 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:57:51.947323 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:57:51.947323 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:57:51.947323 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 22 20:57:51.947323 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 22 20:57:51.947323 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 22 20:57:51.947323 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 22 20:57:51.947323 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 20:57:51.947323 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 20:57:51.947323 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 20:57:51.947323 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 20:57:51.950851 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a64fa89e-32f6-4994-a0b2-3788cf1c92ec could not be found. Oct 22 20:57:51.950851 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:57:51.950851 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:57:51.950851 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:57:51.950851 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:57:51.950851 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:57:51.950851 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:57:51.950851 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 20:57:51.950851 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 20:57:51.950851 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a64fa89e-32f6-4994-a0b2-3788cf1c92ec could not be found. Oct 22 20:57:51.950851 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:57:51.952842 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-702803ad-597a-4269-9143-dd085bba4b59 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Returning 404 to user: Instance a64fa89e-32f6-4994-a0b2-3788cf1c92ec could not be found. {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:57:51.954030 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-702803ad-597a-4269-9143-dd085bba4b59 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] 10.222.0.18 "DELETE /compute/v2.1/servers/a64fa89e-32f6-4994-a0b2-3788cf1c92ec" status: 404 len: 111 microversion: 2.1 time: 0.067147 Oct 22 20:57:51.954739 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1093/2076] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 20:57:51 2022] DELETE /compute/v2.1/servers/a64fa89e-32f6-4994-a0b2-3788cf1c92ec => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 20:57:51.965527 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-21208963-c189-4646-9272-0dc47a7b5fe4 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:57:51.966416 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-21208963-c189-4646-9272-0dc47a7b5fe4 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] [instance: aee36c9d-baf4-453c-b88f-31b8f23638c2] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:57:51.975044 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-21208963-c189-4646-9272-0dc47a7b5fe4 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:51.975628 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-21208963-c189-4646-9272-0dc47a7b5fe4 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:51.976418 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-21208963-c189-4646-9272-0dc47a7b5fe4 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:51.977144 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-21208963-c189-4646-9272-0dc47a7b5fe4 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:51.977612 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-21208963-c189-4646-9272-0dc47a7b5fe4 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:51.978047 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-21208963-c189-4646-9272-0dc47a7b5fe4 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:52.746772 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-21208963-c189-4646-9272-0dc47a7b5fe4 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d3d7458af447bdb3f03e83a2d8559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49238b8686d24ae698679e4a1957735d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:57:52.761150 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-21208963-c189-4646-9272-0dc47a7b5fe4 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] 10.222.0.18 "GET /compute/v2.1/servers/aee36c9d-baf4-453c-b88f-31b8f23638c2" status: 200 len: 1541 microversion: 2.1 time: 0.800884 Oct 22 20:57:52.763100 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1094/2077] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:57:51 2022] GET /compute/v2.1/servers/aee36c9d-baf4-453c-b88f-31b8f23638c2 => generated 1541 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:57:52.788137 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-9b573618-d681-439b-abf2-686041c4dc6d req-1dcf76d7-ff39-45c6-b129-131665c5a317 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "829a4155-cf7c-470d-a127-c729e32747fe", "name": "network-vif-plugged", "status": "completed", "tag": "5057fe59-3905-4c87-83f6-a39a4b64f2fe"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:57:52.820107 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-9b573618-d681-439b-abf2-686041c4dc6d req-1dcf76d7-ff39-45c6-b129-131665c5a317 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:52.823484 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-9b573618-d681-439b-abf2-686041c4dc6d req-1dcf76d7-ff39-45c6-b129-131665c5a317 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:52.827949 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-9b573618-d681-439b-abf2-686041c4dc6d req-1dcf76d7-ff39-45c6-b129-131665c5a317 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:52.864547 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-9b573618-d681-439b-abf2-686041c4dc6d req-1dcf76d7-ff39-45c6-b129-131665c5a317 service nova] Creating event network-vif-plugged:5057fe59-3905-4c87-83f6-a39a4b64f2fe for instance 829a4155-cf7c-470d-a127-c729e32747fe on nch2-master-1 Oct 22 20:57:52.876749 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-9b573618-d681-439b-abf2-686041c4dc6d req-1dcf76d7-ff39-45c6-b129-131665c5a317 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108514 Oct 22 20:57:52.877625 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1095/2078] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:57:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:57:52.893161 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-dcd37444-2ac3-4670-8390-30e58ac38dd9 tempest-ServersAdminTestJSON-1747089598 tempest-ServersAdminTestJSON-1747089598-project-admin] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:57:52.906894 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-dcd37444-2ac3-4670-8390-30e58ac38dd9 tempest-ServersAdminTestJSON-1747089598 tempest-ServersAdminTestJSON-1747089598-project-admin] Searching by: {'deleted': False, 'project_id': 'a5a6a96d256e458e9885273afe6b24fe'} {{(pid=138745) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 22 20:57:52.925754 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-dcd37444-2ac3-4670-8390-30e58ac38dd9 tempest-ServersAdminTestJSON-1747089598 tempest-ServersAdminTestJSON-1747089598-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:52.926247 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-dcd37444-2ac3-4670-8390-30e58ac38dd9 tempest-ServersAdminTestJSON-1747089598 tempest-ServersAdminTestJSON-1747089598-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:52.926687 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-dcd37444-2ac3-4670-8390-30e58ac38dd9 tempest-ServersAdminTestJSON-1747089598 tempest-ServersAdminTestJSON-1747089598-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:52.927460 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-dcd37444-2ac3-4670-8390-30e58ac38dd9 tempest-ServersAdminTestJSON-1747089598 tempest-ServersAdminTestJSON-1747089598-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:52.928454 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-dcd37444-2ac3-4670-8390-30e58ac38dd9 tempest-ServersAdminTestJSON-1747089598 tempest-ServersAdminTestJSON-1747089598-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:52.928895 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-dcd37444-2ac3-4670-8390-30e58ac38dd9 tempest-ServersAdminTestJSON-1747089598 tempest-ServersAdminTestJSON-1747089598-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:53.035731 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-dcd37444-2ac3-4670-8390-30e58ac38dd9 tempest-ServersAdminTestJSON-1747089598 tempest-ServersAdminTestJSON-1747089598-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/detail?tenant_id=8351b01e07cd43f9be973ab45e522bf0" status: 200 len: 15 microversion: 2.1 time: 0.152736 Oct 22 20:57:53.038016 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1096/2079] 10.222.0.18 () {58 vars in 1231 bytes} [Sat Oct 22 20:57:52 2022] GET /compute/v2.1/servers/detail?tenant_id=8351b01e07cd43f9be973ab45e522bf0 => generated 15 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 22 20:57:53.050466 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-d8f6c676-87c7-4134-bbd0-daca938d6a3c req-7bf4ab2a-aa5d-4c38-ae97-57f8b00d814a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aee36c9d-baf4-453c-b88f-31b8f23638c2", "name": "network-vif-unplugged", "status": "completed", "tag": "f8ab0e3e-04fa-4f80-97a2-b20b84653be1"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:57:53.095405 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-d8f6c676-87c7-4134-bbd0-daca938d6a3c req-7bf4ab2a-aa5d-4c38-ae97-57f8b00d814a service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:53.096721 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-d8f6c676-87c7-4134-bbd0-daca938d6a3c req-7bf4ab2a-aa5d-4c38-ae97-57f8b00d814a service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:53.097166 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-d8f6c676-87c7-4134-bbd0-daca938d6a3c req-7bf4ab2a-aa5d-4c38-ae97-57f8b00d814a service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:53.135137 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-d8f6c676-87c7-4134-bbd0-daca938d6a3c req-7bf4ab2a-aa5d-4c38-ae97-57f8b00d814a service nova] Creating event network-vif-unplugged:f8ab0e3e-04fa-4f80-97a2-b20b84653be1 for instance aee36c9d-baf4-453c-b88f-31b8f23638c2 on nch2-master-1 Oct 22 20:57:53.146670 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell1:SELECT=97,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:57:53.148091 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [req-d8f6c676-87c7-4134-bbd0-daca938d6a3c req-7bf4ab2a-aa5d-4c38-ae97-57f8b00d814a service nova] Instance aee36c9d-baf4-453c-b88f-31b8f23638c2 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=138745) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 22 20:57:53.183708 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-d8f6c676-87c7-4134-bbd0-daca938d6a3c req-7bf4ab2a-aa5d-4c38-ae97-57f8b00d814a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.136105 Oct 22 20:57:53.185952 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1097/2080] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:57:53 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:57:53.209353 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-385dfc67-50fa-4f77-a30b-ea8768c8afb6 tempest-ServerPasswordTestJSON-1023240106 tempest-ServerPasswordTestJSON-1023240106-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:57:53.210302 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-385dfc67-50fa-4f77-a30b-ea8768c8afb6 tempest-ServerPasswordTestJSON-1023240106 tempest-ServerPasswordTestJSON-1023240106-project] [instance: 659e6aaf-82b7-4361-8289-970d6de4a7b7] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:57:53.228713 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-385dfc67-50fa-4f77-a30b-ea8768c8afb6 tempest-ServerPasswordTestJSON-1023240106 tempest-ServerPasswordTestJSON-1023240106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:53.229258 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-385dfc67-50fa-4f77-a30b-ea8768c8afb6 tempest-ServerPasswordTestJSON-1023240106 tempest-ServerPasswordTestJSON-1023240106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:53.229674 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-385dfc67-50fa-4f77-a30b-ea8768c8afb6 tempest-ServerPasswordTestJSON-1023240106 tempest-ServerPasswordTestJSON-1023240106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:53.230587 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-385dfc67-50fa-4f77-a30b-ea8768c8afb6 tempest-ServerPasswordTestJSON-1023240106 tempest-ServerPasswordTestJSON-1023240106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:53.231042 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-385dfc67-50fa-4f77-a30b-ea8768c8afb6 tempest-ServerPasswordTestJSON-1023240106 tempest-ServerPasswordTestJSON-1023240106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:53.231494 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-385dfc67-50fa-4f77-a30b-ea8768c8afb6 tempest-ServerPasswordTestJSON-1023240106 tempest-ServerPasswordTestJSON-1023240106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:53.412772 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-385dfc67-50fa-4f77-a30b-ea8768c8afb6 tempest-ServerPasswordTestJSON-1023240106 tempest-ServerPasswordTestJSON-1023240106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3466ea643c9142cfa0678d4cc277faab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9492cfb8c4487989bce6074736df04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:57:53.430820 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-385dfc67-50fa-4f77-a30b-ea8768c8afb6 tempest-ServerPasswordTestJSON-1023240106 tempest-ServerPasswordTestJSON-1023240106-project] 10.222.0.18 "GET /compute/v2.1/servers/659e6aaf-82b7-4361-8289-970d6de4a7b7" status: 200 len: 1274 microversion: 2.1 time: 0.234355 Oct 22 20:57:53.432037 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1098/2081] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:57:53 2022] GET /compute/v2.1/servers/659e6aaf-82b7-4361-8289-970d6de4a7b7 => generated 1274 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:57:53.437216 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-e2955dc8-15d8-4c2a-b186-7edfe524ba04 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:57:53.438221 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-e2955dc8-15d8-4c2a-b186-7edfe524ba04 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] [instance: a64fa89e-32f6-4994-a0b2-3788cf1c92ec] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:57:53.444331 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-5f7a9012-5d7b-41cf-aab5-8147eef7e248 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] 10.222.0.18 "DELETE /compute/v2.1/os-floating-ips/273a5c78-6021-483d-a536-c8ba115c627d" status: 202 len: 0 microversion: 2.1 time: 3.357921 Oct 22 20:57:53.449616 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 984/2082] 10.222.0.18 () {58 vars in 1263 bytes} [Sat Oct 22 20:57:50 2022] DELETE /compute/v2.1/os-floating-ips/273a5c78-6021-483d-a536-c8ba115c627d => generated 0 bytes in 3359 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 20:57:53.454404 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-bc25eb42-f0ce-4a02-b399-6e283ae2788f tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:57:53.455039 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-bc25eb42-f0ce-4a02-b399-6e283ae2788f tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] [instance: 829a4155-cf7c-470d-a127-c729e32747fe] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:57:53.457836 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e2955dc8-15d8-4c2a-b186-7edfe524ba04 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:53.463860 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e2955dc8-15d8-4c2a-b186-7edfe524ba04 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:53.464529 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e2955dc8-15d8-4c2a-b186-7edfe524ba04 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:53.466082 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e2955dc8-15d8-4c2a-b186-7edfe524ba04 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:53.466547 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e2955dc8-15d8-4c2a-b186-7edfe524ba04 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:53.466978 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e2955dc8-15d8-4c2a-b186-7edfe524ba04 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:53.478511 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bc25eb42-f0ce-4a02-b399-6e283ae2788f tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:53.479056 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bc25eb42-f0ce-4a02-b399-6e283ae2788f tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:53.483175 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bc25eb42-f0ce-4a02-b399-6e283ae2788f tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:53.484339 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bc25eb42-f0ce-4a02-b399-6e283ae2788f tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:53.491979 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bc25eb42-f0ce-4a02-b399-6e283ae2788f tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:53.492704 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bc25eb42-f0ce-4a02-b399-6e283ae2788f tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:53.516977 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.wsgi [None req-e2955dc8-15d8-4c2a-b186-7edfe524ba04 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] HTTP exception thrown: Instance a64fa89e-32f6-4994-a0b2-3788cf1c92ec could not be found. Oct 22 20:57:53.522352 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-e2955dc8-15d8-4c2a-b186-7edfe524ba04 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Request method failure captured: Oct 22 20:57:53.522352 ncdv-master-1 devstack@n-api.service[138745]: request: GET /compute/v2.1/servers/a64fa89e-32f6-4994-a0b2-3788cf1c92ec HTTP/1.1 Oct 22 20:57:53.522352 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 20:57:53.522352 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 20:57:53.522352 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 20:57:53.522352 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 0 Oct 22 20:57:53.522352 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 20:57:53.522352 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 20:57:53.522352 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 20:57:53.522352 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 20:57:53.522352 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVFinkWQQBhkrT1IKOpDugEkOlAPWNZyP_2NMwr13b9XeVy4UUzw2acgfBjDE3p8vwfHK2_Q3RMg9yYmateTjw8EQOHA7IN0HeuqzZ5uQWL0ysIIG3e_nACVRZdRICvuIM06IV17ajtcJTdsfcK0wPQNbKtAOZi6_8a2UUHyQ1NeNuzI Oct 22 20:57:53.522352 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 20:57:53.522352 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 20:57:53.522352 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 20:57:53.522352 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 20:57:53.522352 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 20:57:53.522352 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 20:57:53.522352 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: 594624ed28aa433d907c8833d360b82e Oct 22 20:57:53.522352 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-477371163 Oct 22 20:57:53.522352 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 20:57:53.522352 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 20:57:53.522352 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_594624ed28aa433d907c8833d360b82e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/594624ed28aa433d907c8833d360b82e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/594624ed28aa433d907c8833d360b82e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/594624ed28aa433d907c8833d360b82e"}]}] Oct 22 20:57:53.522352 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-477371163 Oct 22 20:57:53.522352 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: 594624ed28aa433d907c8833d360b82e Oct 22 20:57:53.522352 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-477371163 Oct 22 20:57:53.522352 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-ImagesOneServerNegativeTestJSON-477371163-project Oct 22 20:57:53.522352 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 20:57:53.522352 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 20:57:53.522352 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: b392ad1fe1fd4b2a9e6be03a7435deb9 Oct 22 20:57:53.522352 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-477371163-project Oct 22 20:57:53.522352 ncdv-master-1 devstack@n-api.service[138745]: method: > Oct 22 20:57:53.522352 ncdv-master-1 devstack@n-api.service[138745]: exception: Instance a64fa89e-32f6-4994-a0b2-3788cf1c92ec could not be found. Oct 22 20:57:53.522352 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'id': 'a64fa89e-32f6-4994-a0b2-3788cf1c92ec'} Oct 22 20:57:53.522352 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:57:53.522352 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:57:53.522352 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 20:57:53.522352 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 20:57:53.522352 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 20:57:53.522352 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 20:57:53.522352 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 20:57:53.522352 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 20:57:53.522352 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 20:57:53.522352 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 20:57:53.522352 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a64fa89e-32f6-4994-a0b2-3788cf1c92ec could not be found. Oct 22 20:57:53.522352 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:57:53.522352 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:57:53.522352 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:57:53.522352 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:57:53.522352 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:57:53.522352 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:57:53.522352 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:57:53.522352 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:57:53.522352 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:57:53.522352 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:57:53.522352 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 20:57:53.522352 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 20:57:53.522352 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 20:57:53.522352 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 20:57:53.522352 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 20:57:53.522352 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 20:57:53.522352 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a64fa89e-32f6-4994-a0b2-3788cf1c92ec could not be found. Oct 22 20:57:53.522352 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:57:53.522352 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:57:53.526829 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:57:53.526829 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:57:53.526829 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:57:53.526829 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:57:53.526829 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 20:57:53.526829 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 20:57:53.526829 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a64fa89e-32f6-4994-a0b2-3788cf1c92ec could not be found. Oct 22 20:57:53.526829 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:57:53.526829 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-e2955dc8-15d8-4c2a-b186-7edfe524ba04 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] Returning 404 to user: Instance a64fa89e-32f6-4994-a0b2-3788cf1c92ec could not be found. {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:57:53.527962 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-e2955dc8-15d8-4c2a-b186-7edfe524ba04 tempest-ImagesOneServerNegativeTestJSON-477371163 tempest-ImagesOneServerNegativeTestJSON-477371163-project] 10.222.0.18 "GET /compute/v2.1/servers/a64fa89e-32f6-4994-a0b2-3788cf1c92ec" status: 404 len: 111 microversion: 2.1 time: 0.093519 Oct 22 20:57:53.528527 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1099/2083] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:57:53 2022] GET /compute/v2.1/servers/a64fa89e-32f6-4994-a0b2-3788cf1c92ec => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 20:57:53.534378 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-3a238135-6051-48c8-94e8-4a80f8bc7072 tempest-ServersAdminTestJSON-1747089598 tempest-ServersAdminTestJSON-1747089598-project-admin] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:57:53.542371 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-3a238135-6051-48c8-94e8-4a80f8bc7072 tempest-ServersAdminTestJSON-1747089598 tempest-ServersAdminTestJSON-1747089598-project-admin] Searching by: {'tenant_id': '8351b01e07cd43f9be973ab45e522bf0', 'deleted': False} {{(pid=138745) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 22 20:57:53.549086 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3a238135-6051-48c8-94e8-4a80f8bc7072 tempest-ServersAdminTestJSON-1747089598 tempest-ServersAdminTestJSON-1747089598-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:53.549581 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3a238135-6051-48c8-94e8-4a80f8bc7072 tempest-ServersAdminTestJSON-1747089598 tempest-ServersAdminTestJSON-1747089598-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:53.550019 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3a238135-6051-48c8-94e8-4a80f8bc7072 tempest-ServersAdminTestJSON-1747089598 tempest-ServersAdminTestJSON-1747089598-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:53.550757 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3a238135-6051-48c8-94e8-4a80f8bc7072 tempest-ServersAdminTestJSON-1747089598 tempest-ServersAdminTestJSON-1747089598-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:53.551222 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3a238135-6051-48c8-94e8-4a80f8bc7072 tempest-ServersAdminTestJSON-1747089598 tempest-ServersAdminTestJSON-1747089598-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:53.551829 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3a238135-6051-48c8-94e8-4a80f8bc7072 tempest-ServersAdminTestJSON-1747089598 tempest-ServersAdminTestJSON-1747089598-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:53.593455 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.multi_cell_list [None req-3a238135-6051-48c8-94e8-4a80f8bc7072 tempest-ServersAdminTestJSON-1747089598 tempest-ServersAdminTestJSON-1747089598-project-admin] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=138745) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 22 20:57:53.694875 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3a238135-6051-48c8-94e8-4a80f8bc7072 tempest-ServersAdminTestJSON-1747089598 tempest-ServersAdminTestJSON-1747089598-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:53.695643 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3a238135-6051-48c8-94e8-4a80f8bc7072 tempest-ServersAdminTestJSON-1747089598 tempest-ServersAdminTestJSON-1747089598-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:53.696355 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3a238135-6051-48c8-94e8-4a80f8bc7072 tempest-ServersAdminTestJSON-1747089598 tempest-ServersAdminTestJSON-1747089598-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:54.241301 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-bc25eb42-f0ce-4a02-b399-6e283ae2788f tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d808e98f843dd9621822682c9d278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b58ab4af674c778b4819f177045651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:57:54.257105 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-bc25eb42-f0ce-4a02-b399-6e283ae2788f tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] 10.222.0.18 "GET /compute/v2.1/servers/829a4155-cf7c-470d-a127-c729e32747fe" status: 200 len: 1318 microversion: 2.1 time: 0.805587 Oct 22 20:57:54.258093 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 985/2084] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:57:53 2022] GET /compute/v2.1/servers/829a4155-cf7c-470d-a127-c729e32747fe => generated 1318 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:57:54.276500 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-21414188-1f8c-498e-9bdc-54c1f62ad1a5 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": ""}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:57:54.287182 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-21414188-1f8c-498e-9bdc-54c1f62ad1a5 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] Request method failure captured: Oct 22 20:57:54.287182 ncdv-master-1 devstack@n-api.service[138744]: request: POST /compute/v2.1/servers/18183d64-42b7-4b9f-9bca-6d018f17eeb3/action HTTP/1.1 Oct 22 20:57:54.287182 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 20:57:54.287182 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 20:57:54.287182 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 20:57:54.287182 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 34 Oct 22 20:57:54.287182 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 20:57:54.287182 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 20:57:54.287182 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 20:57:54.287182 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 20:57:54.287182 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVFkXuiu5o7_mkf-T6g2hJ9V3zhz6b158xzEeQn2hLYFzTm7eWg1McjcIpfQyHxZ4hCvKyo-lO4kjjeE9oMC47EVd9nh5yoCww3JiBIb9THOnFtV8XT__oHmWbKSrDo3becuY-aCCDuC3aMWP-ibtAxHnxcfn7uTMu-Mh-GxZuahHHAg Oct 22 20:57:54.287182 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 20:57:54.287182 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 20:57:54.287182 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 20:57:54.287182 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 20:57:54.287182 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 20:57:54.287182 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 20:57:54.287182 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: 7e883d7e73084efeb725945ae0bab317 Oct 22 20:57:54.287182 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 Oct 22 20:57:54.287182 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 20:57:54.287182 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 20:57:54.287182 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_7e883d7e73084efeb725945ae0bab317"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7e883d7e73084efeb725945ae0bab317"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/7e883d7e73084efeb725945ae0bab317"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7e883d7e73084efeb725945ae0bab317"}]}] Oct 22 20:57:54.287182 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 Oct 22 20:57:54.287182 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: 7e883d7e73084efeb725945ae0bab317 Oct 22 20:57:54.287182 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 Oct 22 20:57:54.287182 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project Oct 22 20:57:54.287182 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 20:57:54.287182 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 20:57:54.287182 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: 5660f7f9d86f473eaa83e2be362ca63c Oct 22 20:57:54.287182 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project Oct 22 20:57:54.287182 ncdv-master-1 devstack@n-api.service[138744]: Oct 22 20:57:54.287182 ncdv-master-1 devstack@n-api.service[138744]: {"addFloatingIp": {"address": ""}} Oct 22 20:57:54.287182 ncdv-master-1 devstack@n-api.service[138744]: method: Oct 22 20:57:54.287182 ncdv-master-1 devstack@n-api.service[138744]: exception: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Oct 22 20:57:54.287182 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': '18183d64-42b7-4b9f-9bca-6d018f17eeb3', 'body': {'addFloatingIp': {'address': ''}}} Oct 22 20:57:54.287182 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:57:54.287182 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:57:54.287182 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 22 20:57:54.287182 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 22 20:57:54.287182 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 22 20:57:54.287182 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise error Oct 22 20:57:54.287182 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is not valid under any of the given schemas Oct 22 20:57:54.287182 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:57:54.287182 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['addFloatingIp']['properties']['address']: Oct 22 20:57:54.287182 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'ipv4'}, {'format': 'ipv6'}], 'type': 'string'} Oct 22 20:57:54.287182 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:57:54.287182 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi On instance['addFloatingIp']: Oct 22 20:57:54.287182 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi '' Oct 22 20:57:54.287182 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:57:54.287182 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:57:54.287182 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:57:54.287182 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:57:54.287182 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:57:54.287182 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:57:54.287182 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:57:54.287182 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:57:54.287182 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 22 20:57:54.287182 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 22 20:57:54.287182 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:57:54.287182 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:57:54.287182 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 22 20:57:54.287182 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 22 20:57:54.287182 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 22 20:57:54.287182 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 22 20:57:54.287182 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 22 20:57:54.293627 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 22 20:57:54.293627 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Oct 22 20:57:54.293627 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:57:54.293627 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:57:54.293627 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:57:54.293627 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:57:54.293627 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:57:54.293627 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:57:54.293627 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 22 20:57:54.293627 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 22 20:57:54.293627 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Oct 22 20:57:54.293627 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:57:54.293627 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-21414188-1f8c-498e-9bdc-54c1f62ad1a5 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] Returning 400 to user: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:57:54.293627 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-21414188-1f8c-498e-9bdc-54c1f62ad1a5 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] 10.222.0.18 "POST /compute/v2.1/servers/18183d64-42b7-4b9f-9bca-6d018f17eeb3/action" status: 400 len: 142 microversion: 2.1 time: 0.030016 Oct 22 20:57:54.293627 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 986/2085] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 20:57:54 2022] POST /compute/v2.1/servers/18183d64-42b7-4b9f-9bca-6d018f17eeb3/action => generated 142 bytes in 32 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 22 20:57:54.313834 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-6c3c1afd-c42b-4e6c-a397-110d5bf945bb tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:57:54.314472 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-6c3c1afd-c42b-4e6c-a397-110d5bf945bb tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] [instance: aee36c9d-baf4-453c-b88f-31b8f23638c2] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:57:54.329507 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6c3c1afd-c42b-4e6c-a397-110d5bf945bb tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:54.331135 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6c3c1afd-c42b-4e6c-a397-110d5bf945bb tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:54.332058 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6c3c1afd-c42b-4e6c-a397-110d5bf945bb tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:54.332331 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-3a238135-6051-48c8-94e8-4a80f8bc7072 tempest-ServersAdminTestJSON-1747089598 tempest-ServersAdminTestJSON-1747089598-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=8351b01e07cd43f9be973ab45e522bf0" status: 200 len: 4825 microversion: 2.1 time: 0.801679 Oct 22 20:57:54.334251 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6c3c1afd-c42b-4e6c-a397-110d5bf945bb tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:54.335223 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1100/2086] 10.222.0.18 () {58 vars in 1257 bytes} [Sat Oct 22 20:57:53 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=8351b01e07cd43f9be973ab45e522bf0 => generated 4825 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:57:54.336009 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6c3c1afd-c42b-4e6c-a397-110d5bf945bb tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:54.336604 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6c3c1afd-c42b-4e6c-a397-110d5bf945bb tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:54.341012 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-e4fcfb72-7cb9-4fbf-8e7b-66e0820e714d tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "0.0.0.0"}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:57:54.350329 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-e4fcfb72-7cb9-4fbf-8e7b-66e0820e714d tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] [instance: 18183d64-42b7-4b9f-9bca-6d018f17eeb3] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:57:54.371064 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e4fcfb72-7cb9-4fbf-8e7b-66e0820e714d tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:54.371591 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e4fcfb72-7cb9-4fbf-8e7b-66e0820e714d tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:54.372039 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e4fcfb72-7cb9-4fbf-8e7b-66e0820e714d tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:54.372788 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e4fcfb72-7cb9-4fbf-8e7b-66e0820e714d tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:54.373245 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e4fcfb72-7cb9-4fbf-8e7b-66e0820e714d tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:54.373676 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e4fcfb72-7cb9-4fbf-8e7b-66e0820e714d tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:54.421897 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e4fcfb72-7cb9-4fbf-8e7b-66e0820e714d tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] Acquiring lock "refresh_cache-18183d64-42b7-4b9f-9bca-6d018f17eeb3" {{(pid=138745) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 22 20:57:54.422408 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e4fcfb72-7cb9-4fbf-8e7b-66e0820e714d tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] Acquired lock "refresh_cache-18183d64-42b7-4b9f-9bca-6d018f17eeb3" {{(pid=138745) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 22 20:57:54.696755 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e4fcfb72-7cb9-4fbf-8e7b-66e0820e714d tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] Releasing lock "refresh_cache-18183d64-42b7-4b9f-9bca-6d018f17eeb3" {{(pid=138745) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 22 20:57:54.697729 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.wsgi [None req-e4fcfb72-7cb9-4fbf-8e7b-66e0820e714d tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] HTTP exception thrown: floating IP not found Oct 22 20:57:54.699665 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-e4fcfb72-7cb9-4fbf-8e7b-66e0820e714d tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] Request method failure captured: Oct 22 20:57:54.699665 ncdv-master-1 devstack@n-api.service[138745]: request: POST /compute/v2.1/servers/18183d64-42b7-4b9f-9bca-6d018f17eeb3/action HTTP/1.1 Oct 22 20:57:54.699665 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 20:57:54.699665 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 20:57:54.699665 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 20:57:54.699665 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 41 Oct 22 20:57:54.699665 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 20:57:54.699665 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 20:57:54.699665 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 20:57:54.699665 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 20:57:54.699665 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVFkXuiu5o7_mkf-T6g2hJ9V3zhz6b158xzEeQn2hLYFzTm7eWg1McjcIpfQyHxZ4hCvKyo-lO4kjjeE9oMC47EVd9nh5yoCww3JiBIb9THOnFtV8XT__oHmWbKSrDo3becuY-aCCDuC3aMWP-ibtAxHnxcfn7uTMu-Mh-GxZuahHHAg Oct 22 20:57:54.699665 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 20:57:54.699665 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 20:57:54.699665 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 20:57:54.699665 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 20:57:54.699665 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 20:57:54.699665 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 20:57:54.699665 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: 7e883d7e73084efeb725945ae0bab317 Oct 22 20:57:54.699665 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 Oct 22 20:57:54.699665 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 20:57:54.699665 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 20:57:54.699665 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_7e883d7e73084efeb725945ae0bab317"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7e883d7e73084efeb725945ae0bab317"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/7e883d7e73084efeb725945ae0bab317"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7e883d7e73084efeb725945ae0bab317"}]}] Oct 22 20:57:54.699665 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 Oct 22 20:57:54.699665 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: 7e883d7e73084efeb725945ae0bab317 Oct 22 20:57:54.699665 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 Oct 22 20:57:54.699665 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project Oct 22 20:57:54.699665 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 20:57:54.699665 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 20:57:54.699665 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: 5660f7f9d86f473eaa83e2be362ca63c Oct 22 20:57:54.699665 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project Oct 22 20:57:54.699665 ncdv-master-1 devstack@n-api.service[138745]: Oct 22 20:57:54.699665 ncdv-master-1 devstack@n-api.service[138745]: {"addFloatingIp": {"address": "0.0.0.0"}} Oct 22 20:57:54.699665 ncdv-master-1 devstack@n-api.service[138745]: method: Oct 22 20:57:54.699665 ncdv-master-1 devstack@n-api.service[138745]: exception: floating IP not found Oct 22 20:57:54.699665 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'id': '18183d64-42b7-4b9f-9bca-6d018f17eeb3', 'body': {'addFloatingIp': {'address': '0.0.0.0'}}} Oct 22 20:57:54.699665 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:57:54.699665 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:57:54.699665 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Oct 22 20:57:54.699665 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Oct 22 20:57:54.699665 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 165, in wrapper Oct 22 20:57:54.699665 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Oct 22 20:57:54.699665 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2699, in associate_floating_ip Oct 22 20:57:54.699665 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, floating_address) Oct 22 20:57:54.699665 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3011, in _get_floating_ip_by_address Oct 22 20:57:54.699665 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Oct 22 20:57:54.699665 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Oct 22 20:57:54.699665 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:57:54.699665 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:57:54.699665 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:57:54.699665 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:57:54.699665 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:57:54.699665 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:57:54.699665 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:57:54.699665 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:57:54.699665 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 22 20:57:54.699665 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 22 20:57:54.699665 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:57:54.699665 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:57:54.699665 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 20:57:54.699665 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 20:57:54.699665 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 252, in _add_floating_ip Oct 22 20:57:54.699665 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 22 20:57:54.699665 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: floating IP not found Oct 22 20:57:54.699665 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:57:54.703328 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:57:54.703328 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:57:54.703328 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:57:54.703328 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:57:54.703328 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:57:54.703328 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 20:57:54.703328 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 20:57:54.703328 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: floating IP not found Oct 22 20:57:54.703328 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:57:54.705402 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-e4fcfb72-7cb9-4fbf-8e7b-66e0820e714d tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] Returning 404 to user: floating IP not found {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:57:54.706531 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-e4fcfb72-7cb9-4fbf-8e7b-66e0820e714d tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] 10.222.0.18 "POST /compute/v2.1/servers/18183d64-42b7-4b9f-9bca-6d018f17eeb3/action" status: 404 len: 67 microversion: 2.1 time: 0.370350 Oct 22 20:57:54.707955 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1101/2087] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 20:57:54 2022] POST /compute/v2.1/servers/18183d64-42b7-4b9f-9bca-6d018f17eeb3/action => generated 67 bytes in 372 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 22 20:57:54.715938 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-70d284ca-f948-46bd-a9b7-9d6e1c19383b tempest-ServersAdminTestJSON-1747089598 tempest-ServersAdminTestJSON-1747089598-project-admin] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:57:54.730149 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-70d284ca-f948-46bd-a9b7-9d6e1c19383b tempest-ServersAdminTestJSON-1747089598 tempest-ServersAdminTestJSON-1747089598-project-admin] Searching by: {'tenant_id': 'a5a6a96d256e458e9885273afe6b24fe', 'deleted': False} {{(pid=138745) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 22 20:57:54.742850 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-70d284ca-f948-46bd-a9b7-9d6e1c19383b tempest-ServersAdminTestJSON-1747089598 tempest-ServersAdminTestJSON-1747089598-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:54.744413 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-70d284ca-f948-46bd-a9b7-9d6e1c19383b tempest-ServersAdminTestJSON-1747089598 tempest-ServersAdminTestJSON-1747089598-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:54.746038 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-70d284ca-f948-46bd-a9b7-9d6e1c19383b tempest-ServersAdminTestJSON-1747089598 tempest-ServersAdminTestJSON-1747089598-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:54.748235 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-70d284ca-f948-46bd-a9b7-9d6e1c19383b tempest-ServersAdminTestJSON-1747089598 tempest-ServersAdminTestJSON-1747089598-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:54.749498 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-70d284ca-f948-46bd-a9b7-9d6e1c19383b tempest-ServersAdminTestJSON-1747089598 tempest-ServersAdminTestJSON-1747089598-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:54.750633 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-70d284ca-f948-46bd-a9b7-9d6e1c19383b tempest-ServersAdminTestJSON-1747089598 tempest-ServersAdminTestJSON-1747089598-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:54.821157 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-70d284ca-f948-46bd-a9b7-9d6e1c19383b tempest-ServersAdminTestJSON-1747089598 tempest-ServersAdminTestJSON-1747089598-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=a5a6a96d256e458e9885273afe6b24fe" status: 200 len: 15 microversion: 2.1 time: 0.109483 Oct 22 20:57:54.822095 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1102/2088] 10.222.0.18 () {58 vars in 1257 bytes} [Sat Oct 22 20:57:54 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=a5a6a96d256e458e9885273afe6b24fe => generated 15 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 22 20:57:54.835164 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-53c1963b-3b13-417d-bbbd-4e1d7870e9f6 tempest-ServerPasswordTestJSON-1023240106 tempest-ServerPasswordTestJSON-1023240106-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:57:54.836637 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-53c1963b-3b13-417d-bbbd-4e1d7870e9f6 tempest-ServerPasswordTestJSON-1023240106 tempest-ServerPasswordTestJSON-1023240106-project] [instance: 659e6aaf-82b7-4361-8289-970d6de4a7b7] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:57:54.853061 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-53c1963b-3b13-417d-bbbd-4e1d7870e9f6 tempest-ServerPasswordTestJSON-1023240106 tempest-ServerPasswordTestJSON-1023240106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:54.853566 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-53c1963b-3b13-417d-bbbd-4e1d7870e9f6 tempest-ServerPasswordTestJSON-1023240106 tempest-ServerPasswordTestJSON-1023240106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:54.854015 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-53c1963b-3b13-417d-bbbd-4e1d7870e9f6 tempest-ServerPasswordTestJSON-1023240106 tempest-ServerPasswordTestJSON-1023240106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:54.854739 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-53c1963b-3b13-417d-bbbd-4e1d7870e9f6 tempest-ServerPasswordTestJSON-1023240106 tempest-ServerPasswordTestJSON-1023240106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:54.855201 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-53c1963b-3b13-417d-bbbd-4e1d7870e9f6 tempest-ServerPasswordTestJSON-1023240106 tempest-ServerPasswordTestJSON-1023240106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:54.860643 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-53c1963b-3b13-417d-bbbd-4e1d7870e9f6 tempest-ServerPasswordTestJSON-1023240106 tempest-ServerPasswordTestJSON-1023240106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:55.044836 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-53c1963b-3b13-417d-bbbd-4e1d7870e9f6 tempest-ServerPasswordTestJSON-1023240106 tempest-ServerPasswordTestJSON-1023240106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3466ea643c9142cfa0678d4cc277faab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9492cfb8c4487989bce6074736df04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:57:55.056469 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-53c1963b-3b13-417d-bbbd-4e1d7870e9f6 tempest-ServerPasswordTestJSON-1023240106 tempest-ServerPasswordTestJSON-1023240106-project] 10.222.0.18 "GET /compute/v2.1/servers/659e6aaf-82b7-4361-8289-970d6de4a7b7" status: 200 len: 1274 microversion: 2.1 time: 0.231506 Oct 22 20:57:55.058808 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1103/2089] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:57:54 2022] GET /compute/v2.1/servers/659e6aaf-82b7-4361-8289-970d6de4a7b7 => generated 1274 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:57:55.065520 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-ca339c0d-bddb-4f7e-aa74-a512c45519d3 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "0.0.0.0"}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:57:55.507673 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-6c3c1afd-c42b-4e6c-a397-110d5bf945bb tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d3d7458af447bdb3f03e83a2d8559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49238b8686d24ae698679e4a1957735d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:57:55.555550 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-6c3c1afd-c42b-4e6c-a397-110d5bf945bb tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] 10.222.0.18 "GET /compute/v2.1/servers/aee36c9d-baf4-453c-b88f-31b8f23638c2" status: 200 len: 1541 microversion: 2.1 time: 1.244342 Oct 22 20:57:55.555550 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 987/2090] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:57:54 2022] GET /compute/v2.1/servers/aee36c9d-baf4-453c-b88f-31b8f23638c2 => generated 1541 bytes in 1265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:57:55.565299 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-9f90f390-ae02-4e9b-a32a-9788df51bea1 tempest-ServersAdminTestJSON-1747089598 tempest-ServersAdminTestJSON-1747089598-project-admin] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:57:55.581495 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-9f90f390-ae02-4e9b-a32a-9788df51bea1 tempest-ServersAdminTestJSON-1747089598 tempest-ServersAdminTestJSON-1747089598-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/detail?status=invalid_status" status: 200 len: 15 microversion: 2.1 time: 0.023623 Oct 22 20:57:55.582016 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 988/2091] 10.222.0.18 () {58 vars in 1189 bytes} [Sat Oct 22 20:57:55 2022] GET /compute/v2.1/servers/detail?status=invalid_status => generated 15 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 22 20:57:55.587249 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-6983ac5d-e1ac-4a23-8fd1-3fe2cc153e91 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:57:55.587890 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-6983ac5d-e1ac-4a23-8fd1-3fe2cc153e91 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] [instance: 829a4155-cf7c-470d-a127-c729e32747fe] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:57:55.595408 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6983ac5d-e1ac-4a23-8fd1-3fe2cc153e91 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:55.596220 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6983ac5d-e1ac-4a23-8fd1-3fe2cc153e91 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:55.596905 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6983ac5d-e1ac-4a23-8fd1-3fe2cc153e91 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:55.597784 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6983ac5d-e1ac-4a23-8fd1-3fe2cc153e91 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:55.598404 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6983ac5d-e1ac-4a23-8fd1-3fe2cc153e91 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:55.598989 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6983ac5d-e1ac-4a23-8fd1-3fe2cc153e91 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:55.619301 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.wsgi [None req-ca339c0d-bddb-4f7e-aa74-a512c45519d3 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] HTTP exception thrown: Floating IP not found for address 0.0.0.0. Oct 22 20:57:55.621355 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-ca339c0d-bddb-4f7e-aa74-a512c45519d3 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] Request method failure captured: Oct 22 20:57:55.621355 ncdv-master-1 devstack@n-api.service[138745]: request: POST /compute/v2.1/servers/18183d64-42b7-4b9f-9bca-6d018f17eeb3/action HTTP/1.1 Oct 22 20:57:55.621355 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 20:57:55.621355 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 20:57:55.621355 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 20:57:55.621355 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 44 Oct 22 20:57:55.621355 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 20:57:55.621355 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 20:57:55.621355 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 20:57:55.621355 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 20:57:55.621355 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVFkXuiu5o7_mkf-T6g2hJ9V3zhz6b158xzEeQn2hLYFzTm7eWg1McjcIpfQyHxZ4hCvKyo-lO4kjjeE9oMC47EVd9nh5yoCww3JiBIb9THOnFtV8XT__oHmWbKSrDo3becuY-aCCDuC3aMWP-ibtAxHnxcfn7uTMu-Mh-GxZuahHHAg Oct 22 20:57:55.621355 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 20:57:55.621355 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 20:57:55.621355 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 20:57:55.621355 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 20:57:55.621355 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 20:57:55.621355 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 20:57:55.621355 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: 7e883d7e73084efeb725945ae0bab317 Oct 22 20:57:55.621355 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 Oct 22 20:57:55.621355 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 20:57:55.621355 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 20:57:55.621355 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_7e883d7e73084efeb725945ae0bab317"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7e883d7e73084efeb725945ae0bab317"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/7e883d7e73084efeb725945ae0bab317"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7e883d7e73084efeb725945ae0bab317"}]}] Oct 22 20:57:55.621355 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 Oct 22 20:57:55.621355 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: 7e883d7e73084efeb725945ae0bab317 Oct 22 20:57:55.621355 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 Oct 22 20:57:55.621355 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project Oct 22 20:57:55.621355 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 20:57:55.621355 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 20:57:55.621355 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: 5660f7f9d86f473eaa83e2be362ca63c Oct 22 20:57:55.621355 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project Oct 22 20:57:55.621355 ncdv-master-1 devstack@n-api.service[138745]: Oct 22 20:57:55.621355 ncdv-master-1 devstack@n-api.service[138745]: {"removeFloatingIp": {"address": "0.0.0.0"}} Oct 22 20:57:55.621355 ncdv-master-1 devstack@n-api.service[138745]: method: Oct 22 20:57:55.621355 ncdv-master-1 devstack@n-api.service[138745]: exception: Floating IP not found for address 0.0.0.0. Oct 22 20:57:55.621355 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'id': '18183d64-42b7-4b9f-9bca-6d018f17eeb3', 'body': {'removeFloatingIp': {'address': '0.0.0.0'}}} Oct 22 20:57:55.621355 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:57:55.621355 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:57:55.621355 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 58, in get_instance_by_floating_ip_addr Oct 22 20:57:55.621355 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi self.network_api.get_instance_id_by_floating_address( Oct 22 20:57:55.621355 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2927, in get_instance_id_by_floating_address Oct 22 20:57:55.621355 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, address) Oct 22 20:57:55.621355 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3011, in _get_floating_ip_by_address Oct 22 20:57:55.621355 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Oct 22 20:57:55.621355 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Oct 22 20:57:55.621355 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:57:55.621355 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:57:55.621355 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:57:55.621355 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:57:55.621355 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:57:55.621355 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:57:55.621355 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:57:55.621355 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:57:55.621355 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 22 20:57:55.621355 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 22 20:57:55.621355 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:57:55.621355 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:57:55.621355 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 20:57:55.621355 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 20:57:55.621355 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 277, in _remove_floating_ip Oct 22 20:57:55.621355 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = get_instance_by_floating_ip_addr(self, context, address) Oct 22 20:57:55.621355 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 61, in get_instance_by_floating_ip_addr Oct 22 20:57:55.621355 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=ex.format_message()) Oct 22 20:57:55.625379 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for address 0.0.0.0. Oct 22 20:57:55.625379 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:57:55.625379 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:57:55.625379 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:57:55.625379 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:57:55.625379 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:57:55.625379 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:57:55.625379 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 20:57:55.625379 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 20:57:55.625379 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for address 0.0.0.0. Oct 22 20:57:55.625379 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:57:55.625379 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-ca339c0d-bddb-4f7e-aa74-a512c45519d3 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] Returning 404 to user: Floating IP not found for address 0.0.0.0. {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:57:55.625379 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-ca339c0d-bddb-4f7e-aa74-a512c45519d3 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] 10.222.0.18 "POST /compute/v2.1/servers/18183d64-42b7-4b9f-9bca-6d018f17eeb3/action" status: 404 len: 88 microversion: 2.1 time: 0.562252 Oct 22 20:57:55.625379 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1104/2092] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 20:57:55 2022] POST /compute/v2.1/servers/18183d64-42b7-4b9f-9bca-6d018f17eeb3/action => generated 88 bytes in 564 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 22 20:57:55.632282 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-83e0487e-68a6-4d2d-8e3b-48d672374f95 req-f5adba56-1145-479d-9356-ed8426f7b9b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aee36c9d-baf4-453c-b88f-31b8f23638c2", "tag": "f8ab0e3e-04fa-4f80-97a2-b20b84653be1"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:57:55.655532 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-83e0487e-68a6-4d2d-8e3b-48d672374f95 req-f5adba56-1145-479d-9356-ed8426f7b9b2 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:55.656922 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-83e0487e-68a6-4d2d-8e3b-48d672374f95 req-f5adba56-1145-479d-9356-ed8426f7b9b2 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:55.659359 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-83e0487e-68a6-4d2d-8e3b-48d672374f95 req-f5adba56-1145-479d-9356-ed8426f7b9b2 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:55.687162 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-83e0487e-68a6-4d2d-8e3b-48d672374f95 req-f5adba56-1145-479d-9356-ed8426f7b9b2 service nova] Creating event network-changed:f8ab0e3e-04fa-4f80-97a2-b20b84653be1 for instance aee36c9d-baf4-453c-b88f-31b8f23638c2 on nch2-master-1 Oct 22 20:57:55.701789 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [req-83e0487e-68a6-4d2d-8e3b-48d672374f95 req-f5adba56-1145-479d-9356-ed8426f7b9b2 service nova] Instance aee36c9d-baf4-453c-b88f-31b8f23638c2 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=138745) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 22 20:57:55.725194 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-83e0487e-68a6-4d2d-8e3b-48d672374f95 req-f5adba56-1145-479d-9356-ed8426f7b9b2 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100565 Oct 22 20:57:55.726899 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1105/2093] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:57:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:57:55.734867 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-6e7ba4d2-1b44-4fef-b4a9-432198d8c322 tempest-ServersAdminTestJSON-1747089598 tempest-ServersAdminTestJSON-1747089598-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:57:55.751158 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-6e7ba4d2-1b44-4fef-b4a9-432198d8c322 tempest-ServersAdminTestJSON-1747089598 tempest-ServersAdminTestJSON-1747089598-project-admin] [instance: f070b144-3a1a-4456-8e5b-02af12557c6a] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:57:55.767611 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6e7ba4d2-1b44-4fef-b4a9-432198d8c322 tempest-ServersAdminTestJSON-1747089598 tempest-ServersAdminTestJSON-1747089598-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:55.768945 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6e7ba4d2-1b44-4fef-b4a9-432198d8c322 tempest-ServersAdminTestJSON-1747089598 tempest-ServersAdminTestJSON-1747089598-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:55.770922 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6e7ba4d2-1b44-4fef-b4a9-432198d8c322 tempest-ServersAdminTestJSON-1747089598 tempest-ServersAdminTestJSON-1747089598-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:55.773736 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6e7ba4d2-1b44-4fef-b4a9-432198d8c322 tempest-ServersAdminTestJSON-1747089598 tempest-ServersAdminTestJSON-1747089598-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:55.774396 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6e7ba4d2-1b44-4fef-b4a9-432198d8c322 tempest-ServersAdminTestJSON-1747089598 tempest-ServersAdminTestJSON-1747089598-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:55.775896 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6e7ba4d2-1b44-4fef-b4a9-432198d8c322 tempest-ServersAdminTestJSON-1747089598 tempest-ServersAdminTestJSON-1747089598-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:55.927695 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-6e7ba4d2-1b44-4fef-b4a9-432198d8c322 tempest-ServersAdminTestJSON-1747089598 tempest-ServersAdminTestJSON-1747089598-project-admin] 10.222.0.18 "POST /compute/v2.1/servers/f070b144-3a1a-4456-8e5b-02af12557c6a/action" status: 202 len: 0 microversion: 2.1 time: 0.196231 Oct 22 20:57:55.928850 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1106/2094] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 20:57:55 2022] POST /compute/v2.1/servers/f070b144-3a1a-4456-8e5b-02af12557c6a/action => generated 0 bytes in 201 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 20:57:55.936263 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-c04a3128-20dd-4b89-a6cb-9307d121df8c tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:57:55.937017 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-c04a3128-20dd-4b89-a6cb-9307d121df8c tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] [instance: 18183d64-42b7-4b9f-9bca-6d018f17eeb3] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:57:55.945980 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c04a3128-20dd-4b89-a6cb-9307d121df8c tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:55.946718 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c04a3128-20dd-4b89-a6cb-9307d121df8c tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:55.949732 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c04a3128-20dd-4b89-a6cb-9307d121df8c tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:55.950709 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c04a3128-20dd-4b89-a6cb-9307d121df8c tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:55.951311 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c04a3128-20dd-4b89-a6cb-9307d121df8c tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:55.951900 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c04a3128-20dd-4b89-a6cb-9307d121df8c tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:55.986061 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-c04a3128-20dd-4b89-a6cb-9307d121df8c tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] [instance: 18183d64-42b7-4b9f-9bca-6d018f17eeb3] Going to try to terminate instance {{(pid=138745) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 20:57:56.026180 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-6983ac5d-e1ac-4a23-8fd1-3fe2cc153e91 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d808e98f843dd9621822682c9d278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b58ab4af674c778b4819f177045651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:57:56.039216 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-6983ac5d-e1ac-4a23-8fd1-3fe2cc153e91 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] 10.222.0.18 "GET /compute/v2.1/servers/829a4155-cf7c-470d-a127-c729e32747fe" status: 200 len: 1468 microversion: 2.1 time: 0.455608 Oct 22 20:57:56.040659 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 989/2095] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:57:55 2022] GET /compute/v2.1/servers/829a4155-cf7c-470d-a127-c729e32747fe => generated 1468 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:57:56.048769 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-ebba125f-3569-4439-9ac1-447e3940a455 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:57:56.055295 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-ebba125f-3569-4439-9ac1-447e3940a455 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '57dbe89a7e11480194d3d86f82983499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8351b01e07cd43f9be973ab45e522bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:57:56.056599 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-ebba125f-3569-4439-9ac1-447e3940a455 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Searching by: {'vm_state': ['error'], 'deleted': False, 'project_id': '8351b01e07cd43f9be973ab45e522bf0'} {{(pid=138744) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 22 20:57:56.063678 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ebba125f-3569-4439-9ac1-447e3940a455 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:56.064648 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ebba125f-3569-4439-9ac1-447e3940a455 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:56.065384 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ebba125f-3569-4439-9ac1-447e3940a455 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:56.066597 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ebba125f-3569-4439-9ac1-447e3940a455 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:56.067299 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ebba125f-3569-4439-9ac1-447e3940a455 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:56.068314 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ebba125f-3569-4439-9ac1-447e3940a455 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:56.101559 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.multi_cell_list [None req-ebba125f-3569-4439-9ac1-447e3940a455 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=138744) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 22 20:57:56.143067 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-ebba125f-3569-4439-9ac1-447e3940a455 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] 10.222.0.18 "GET /compute/v2.1/servers?status=error" status: 200 len: 338 microversion: 2.1 time: 0.099731 Oct 22 20:57:56.149114 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-c04a3128-20dd-4b89-a6cb-9307d121df8c tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] 10.222.0.18 "DELETE /compute/v2.1/servers/18183d64-42b7-4b9f-9bca-6d018f17eeb3" status: 204 len: 0 microversion: 2.1 time: 0.218498 Oct 22 20:57:56.152461 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 990/2097] 10.222.0.18 () {58 vars in 1150 bytes} [Sat Oct 22 20:57:56 2022] GET /compute/v2.1/servers?status=error => generated 338 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:57:56.155596 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1107/2097] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 20:57:55 2022] DELETE /compute/v2.1/servers/18183d64-42b7-4b9f-9bca-6d018f17eeb3 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 20:57:56.170308 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-a7285bc1-9826-4f58-b8bd-c407d683865d tempest-ServerPasswordTestJSON-1023240106 tempest-ServerPasswordTestJSON-1023240106-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:57:56.176760 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-82b39434-392e-4d36-8f7a-2a47fd6b2490 tempest-LiveMigrationNegativeTest-1259453977 tempest-LiveMigrationNegativeTest-1259453977-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:57:56.177956 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-82b39434-392e-4d36-8f7a-2a47fd6b2490 tempest-LiveMigrationNegativeTest-1259453977 tempest-LiveMigrationNegativeTest-1259453977-project-admin] [instance: 829a4155-cf7c-470d-a127-c729e32747fe] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:57:56.185704 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-82b39434-392e-4d36-8f7a-2a47fd6b2490 tempest-LiveMigrationNegativeTest-1259453977 tempest-LiveMigrationNegativeTest-1259453977-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:56.186477 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-82b39434-392e-4d36-8f7a-2a47fd6b2490 tempest-LiveMigrationNegativeTest-1259453977 tempest-LiveMigrationNegativeTest-1259453977-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:56.187130 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-82b39434-392e-4d36-8f7a-2a47fd6b2490 tempest-LiveMigrationNegativeTest-1259453977 tempest-LiveMigrationNegativeTest-1259453977-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:56.187820 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-a7285bc1-9826-4f58-b8bd-c407d683865d tempest-ServerPasswordTestJSON-1023240106 tempest-ServerPasswordTestJSON-1023240106-project] [instance: 659e6aaf-82b7-4361-8289-970d6de4a7b7] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:57:56.188730 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-82b39434-392e-4d36-8f7a-2a47fd6b2490 tempest-LiveMigrationNegativeTest-1259453977 tempest-LiveMigrationNegativeTest-1259453977-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:56.189431 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-82b39434-392e-4d36-8f7a-2a47fd6b2490 tempest-LiveMigrationNegativeTest-1259453977 tempest-LiveMigrationNegativeTest-1259453977-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:56.190070 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-82b39434-392e-4d36-8f7a-2a47fd6b2490 tempest-LiveMigrationNegativeTest-1259453977 tempest-LiveMigrationNegativeTest-1259453977-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:56.200706 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a7285bc1-9826-4f58-b8bd-c407d683865d tempest-ServerPasswordTestJSON-1023240106 tempest-ServerPasswordTestJSON-1023240106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:56.204808 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a7285bc1-9826-4f58-b8bd-c407d683865d tempest-ServerPasswordTestJSON-1023240106 tempest-ServerPasswordTestJSON-1023240106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:56.205514 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a7285bc1-9826-4f58-b8bd-c407d683865d tempest-ServerPasswordTestJSON-1023240106 tempest-ServerPasswordTestJSON-1023240106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:56.206421 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a7285bc1-9826-4f58-b8bd-c407d683865d tempest-ServerPasswordTestJSON-1023240106 tempest-ServerPasswordTestJSON-1023240106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:56.207895 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a7285bc1-9826-4f58-b8bd-c407d683865d tempest-ServerPasswordTestJSON-1023240106 tempest-ServerPasswordTestJSON-1023240106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:56.208934 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a7285bc1-9826-4f58-b8bd-c407d683865d tempest-ServerPasswordTestJSON-1023240106 tempest-ServerPasswordTestJSON-1023240106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:56.231976 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.objects.instance [None req-82b39434-392e-4d36-8f7a-2a47fd6b2490 tempest-LiveMigrationNegativeTest-1259453977 tempest-LiveMigrationNegativeTest-1259453977-project-admin] Lazy-loading 'flavor' on Instance uuid 829a4155-cf7c-470d-a127-c729e32747fe {{(pid=138744) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 20:57:56.317610 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:57:56.393195 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-82b39434-392e-4d36-8f7a-2a47fd6b2490 tempest-LiveMigrationNegativeTest-1259453977 tempest-LiveMigrationNegativeTest-1259453977-project-admin] 10.222.0.18 "POST /compute/v2.1/servers/829a4155-cf7c-470d-a127-c729e32747fe/action" status: 202 len: 0 microversion: 2.1 time: 0.234859 Oct 22 20:57:56.393800 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 991/2098] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 20:57:56 2022] POST /compute/v2.1/servers/829a4155-cf7c-470d-a127-c729e32747fe/action => generated 0 bytes in 241 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 20:57:56.403763 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-89df1a41-9c2d-4196-8213-f0a6e289afb7 tempest-ServersAdminTestJSON-1747089598 tempest-ServersAdminTestJSON-1747089598-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:57:56.406334 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-89df1a41-9c2d-4196-8213-f0a6e289afb7 tempest-ServersAdminTestJSON-1747089598 tempest-ServersAdminTestJSON-1747089598-project-admin] [instance: f070b144-3a1a-4456-8e5b-02af12557c6a] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:57:56.414784 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-89df1a41-9c2d-4196-8213-f0a6e289afb7 tempest-ServersAdminTestJSON-1747089598 tempest-ServersAdminTestJSON-1747089598-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:56.415578 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-89df1a41-9c2d-4196-8213-f0a6e289afb7 tempest-ServersAdminTestJSON-1747089598 tempest-ServersAdminTestJSON-1747089598-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:56.416167 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-89df1a41-9c2d-4196-8213-f0a6e289afb7 tempest-ServersAdminTestJSON-1747089598 tempest-ServersAdminTestJSON-1747089598-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:56.417059 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-89df1a41-9c2d-4196-8213-f0a6e289afb7 tempest-ServersAdminTestJSON-1747089598 tempest-ServersAdminTestJSON-1747089598-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:56.417848 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-89df1a41-9c2d-4196-8213-f0a6e289afb7 tempest-ServersAdminTestJSON-1747089598 tempest-ServersAdminTestJSON-1747089598-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:56.418426 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-89df1a41-9c2d-4196-8213-f0a6e289afb7 tempest-ServersAdminTestJSON-1747089598 tempest-ServersAdminTestJSON-1747089598-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:56.563477 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-89df1a41-9c2d-4196-8213-f0a6e289afb7 tempest-ServersAdminTestJSON-1747089598 tempest-ServersAdminTestJSON-1747089598-project-admin] 10.222.0.18 "POST /compute/v2.1/servers/f070b144-3a1a-4456-8e5b-02af12557c6a/action" status: 202 len: 0 microversion: 2.1 time: 0.167903 Oct 22 20:57:56.564605 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 992/2099] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 20:57:56 2022] POST /compute/v2.1/servers/f070b144-3a1a-4456-8e5b-02af12557c6a/action => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 20:57:56.570607 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-73de70e3-06b2-4f5d-a696-aff65843024e tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:57:56.572106 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-73de70e3-06b2-4f5d-a696-aff65843024e tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] [instance: 18183d64-42b7-4b9f-9bca-6d018f17eeb3] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:57:56.584548 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-73de70e3-06b2-4f5d-a696-aff65843024e tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:56.585278 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-73de70e3-06b2-4f5d-a696-aff65843024e tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:56.586412 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-73de70e3-06b2-4f5d-a696-aff65843024e tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:56.587239 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-73de70e3-06b2-4f5d-a696-aff65843024e tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:56.587686 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-a7285bc1-9826-4f58-b8bd-c407d683865d tempest-ServerPasswordTestJSON-1023240106 tempest-ServerPasswordTestJSON-1023240106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3466ea643c9142cfa0678d4cc277faab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9492cfb8c4487989bce6074736df04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:57:56.587962 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-73de70e3-06b2-4f5d-a696-aff65843024e tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:56.588499 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-73de70e3-06b2-4f5d-a696-aff65843024e tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:56.602100 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-a7285bc1-9826-4f58-b8bd-c407d683865d tempest-ServerPasswordTestJSON-1023240106 tempest-ServerPasswordTestJSON-1023240106-project] 10.222.0.18 "GET /compute/v2.1/servers/659e6aaf-82b7-4361-8289-970d6de4a7b7" status: 200 len: 1316 microversion: 2.1 time: 0.444990 Oct 22 20:57:56.603671 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1108/2100] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:57:56 2022] GET /compute/v2.1/servers/659e6aaf-82b7-4361-8289-970d6de4a7b7 => generated 1316 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:57:56.609351 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-b5da503a-0fb4-42e7-9580-e27f664ca4ee tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:57:56.610875 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-b5da503a-0fb4-42e7-9580-e27f664ca4ee tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] [instance: 829a4155-cf7c-470d-a127-c729e32747fe] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:57:56.639921 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b5da503a-0fb4-42e7-9580-e27f664ca4ee tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:56.642548 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b5da503a-0fb4-42e7-9580-e27f664ca4ee tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:56.646159 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b5da503a-0fb4-42e7-9580-e27f664ca4ee tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:56.647176 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b5da503a-0fb4-42e7-9580-e27f664ca4ee tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:56.649152 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b5da503a-0fb4-42e7-9580-e27f664ca4ee tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:56.649757 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b5da503a-0fb4-42e7-9580-e27f664ca4ee tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:56.886497 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-73de70e3-06b2-4f5d-a696-aff65843024e tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5660f7f9d86f473eaa83e2be362ca63c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e883d7e73084efeb725945ae0bab317', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:57:56.907251 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-73de70e3-06b2-4f5d-a696-aff65843024e tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] 10.222.0.18 "GET /compute/v2.1/servers/18183d64-42b7-4b9f-9bca-6d018f17eeb3" status: 200 len: 1538 microversion: 2.1 time: 0.341255 Oct 22 20:57:56.908289 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 993/2101] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:57:56 2022] GET /compute/v2.1/servers/18183d64-42b7-4b9f-9bca-6d018f17eeb3 => generated 1538 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:57:56.914484 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-d4dd850f-254e-40b3-8d52-f535b7b8558e tempest-ServersAdminTestJSON-1747089598 tempest-ServersAdminTestJSON-1747089598-project-admin] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:57:56.915106 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-d4dd850f-254e-40b3-8d52-f535b7b8558e tempest-ServersAdminTestJSON-1747089598 tempest-ServersAdminTestJSON-1747089598-project-admin] [instance: f070b144-3a1a-4456-8e5b-02af12557c6a] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:57:56.921547 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d4dd850f-254e-40b3-8d52-f535b7b8558e tempest-ServersAdminTestJSON-1747089598 tempest-ServersAdminTestJSON-1747089598-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:56.922396 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d4dd850f-254e-40b3-8d52-f535b7b8558e tempest-ServersAdminTestJSON-1747089598 tempest-ServersAdminTestJSON-1747089598-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:56.923595 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d4dd850f-254e-40b3-8d52-f535b7b8558e tempest-ServersAdminTestJSON-1747089598 tempest-ServersAdminTestJSON-1747089598-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:56.924512 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d4dd850f-254e-40b3-8d52-f535b7b8558e tempest-ServersAdminTestJSON-1747089598 tempest-ServersAdminTestJSON-1747089598-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:56.925249 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d4dd850f-254e-40b3-8d52-f535b7b8558e tempest-ServersAdminTestJSON-1747089598 tempest-ServersAdminTestJSON-1747089598-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:56.925847 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d4dd850f-254e-40b3-8d52-f535b7b8558e tempest-ServersAdminTestJSON-1747089598 tempest-ServersAdminTestJSON-1747089598-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:56.953723 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-b5da503a-0fb4-42e7-9580-e27f664ca4ee tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d808e98f843dd9621822682c9d278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b58ab4af674c778b4819f177045651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:57:56.974269 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-b5da503a-0fb4-42e7-9580-e27f664ca4ee tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] 10.222.0.18 "GET /compute/v2.1/servers/829a4155-cf7c-470d-a127-c729e32747fe" status: 200 len: 1476 microversion: 2.1 time: 0.366399 Oct 22 20:57:56.978519 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1109/2102] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:57:56 2022] GET /compute/v2.1/servers/829a4155-cf7c-470d-a127-c729e32747fe => generated 1476 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:57:56.989752 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-a65651e2-283d-4f32-bbcd-dec623a1dfa7 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:57:56.991515 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-a65651e2-283d-4f32-bbcd-dec623a1dfa7 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] [instance: aee36c9d-baf4-453c-b88f-31b8f23638c2] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:57:57.012781 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a65651e2-283d-4f32-bbcd-dec623a1dfa7 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:57.013476 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a65651e2-283d-4f32-bbcd-dec623a1dfa7 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:57.014129 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a65651e2-283d-4f32-bbcd-dec623a1dfa7 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:57.015231 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a65651e2-283d-4f32-bbcd-dec623a1dfa7 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:57.016006 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a65651e2-283d-4f32-bbcd-dec623a1dfa7 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:57.016577 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a65651e2-283d-4f32-bbcd-dec623a1dfa7 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:57.268483 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-d4dd850f-254e-40b3-8d52-f535b7b8558e tempest-ServersAdminTestJSON-1747089598 tempest-ServersAdminTestJSON-1747089598-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/f070b144-3a1a-4456-8e5b-02af12557c6a" status: 200 len: 1614 microversion: 2.1 time: 0.358040 Oct 22 20:57:57.288682 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 994/2103] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:57:56 2022] GET /compute/v2.1/servers/f070b144-3a1a-4456-8e5b-02af12557c6a => generated 1614 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:57:57.300601 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-fddafac8-ff3c-4bfc-ab83-f6291f682b25 tempest-ServersAdminTestJSON-1747089598 tempest-ServersAdminTestJSON-1747089598-project-admin] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:57:57.301243 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-fddafac8-ff3c-4bfc-ab83-f6291f682b25 tempest-ServersAdminTestJSON-1747089598 tempest-ServersAdminTestJSON-1747089598-project-admin] [instance: f070b144-3a1a-4456-8e5b-02af12557c6a] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:57:57.315662 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fddafac8-ff3c-4bfc-ab83-f6291f682b25 tempest-ServersAdminTestJSON-1747089598 tempest-ServersAdminTestJSON-1747089598-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:57.316180 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fddafac8-ff3c-4bfc-ab83-f6291f682b25 tempest-ServersAdminTestJSON-1747089598 tempest-ServersAdminTestJSON-1747089598-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:57.316651 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fddafac8-ff3c-4bfc-ab83-f6291f682b25 tempest-ServersAdminTestJSON-1747089598 tempest-ServersAdminTestJSON-1747089598-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:57.317398 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fddafac8-ff3c-4bfc-ab83-f6291f682b25 tempest-ServersAdminTestJSON-1747089598 tempest-ServersAdminTestJSON-1747089598-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:57.317863 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fddafac8-ff3c-4bfc-ab83-f6291f682b25 tempest-ServersAdminTestJSON-1747089598 tempest-ServersAdminTestJSON-1747089598-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:57.318291 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fddafac8-ff3c-4bfc-ab83-f6291f682b25 tempest-ServersAdminTestJSON-1747089598 tempest-ServersAdminTestJSON-1747089598-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:57.485727 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-a65651e2-283d-4f32-bbcd-dec623a1dfa7 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d3d7458af447bdb3f03e83a2d8559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49238b8686d24ae698679e4a1957735d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:57:57.494818 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-a65651e2-283d-4f32-bbcd-dec623a1dfa7 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] 10.222.0.18 "GET /compute/v2.1/servers/aee36c9d-baf4-453c-b88f-31b8f23638c2" status: 200 len: 1473 microversion: 2.1 time: 0.514210 Oct 22 20:57:57.495420 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1110/2104] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:57:56 2022] GET /compute/v2.1/servers/aee36c9d-baf4-453c-b88f-31b8f23638c2 => generated 1473 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:57:57.629348 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-8a31e4c7-c859-46a7-82e5-aea132f9281a tempest-ServerPasswordTestJSON-1023240106 tempest-ServerPasswordTestJSON-1023240106-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:57:57.630565 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-8a31e4c7-c859-46a7-82e5-aea132f9281a tempest-ServerPasswordTestJSON-1023240106 tempest-ServerPasswordTestJSON-1023240106-project] [instance: 659e6aaf-82b7-4361-8289-970d6de4a7b7] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:57:57.638109 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8a31e4c7-c859-46a7-82e5-aea132f9281a tempest-ServerPasswordTestJSON-1023240106 tempest-ServerPasswordTestJSON-1023240106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:57.638660 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8a31e4c7-c859-46a7-82e5-aea132f9281a tempest-ServerPasswordTestJSON-1023240106 tempest-ServerPasswordTestJSON-1023240106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:57.639029 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8a31e4c7-c859-46a7-82e5-aea132f9281a tempest-ServerPasswordTestJSON-1023240106 tempest-ServerPasswordTestJSON-1023240106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:57.639837 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8a31e4c7-c859-46a7-82e5-aea132f9281a tempest-ServerPasswordTestJSON-1023240106 tempest-ServerPasswordTestJSON-1023240106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:57.640281 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8a31e4c7-c859-46a7-82e5-aea132f9281a tempest-ServerPasswordTestJSON-1023240106 tempest-ServerPasswordTestJSON-1023240106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:57.640869 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8a31e4c7-c859-46a7-82e5-aea132f9281a tempest-ServerPasswordTestJSON-1023240106 tempest-ServerPasswordTestJSON-1023240106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:57.874473 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-fddafac8-ff3c-4bfc-ab83-f6291f682b25 tempest-ServersAdminTestJSON-1747089598 tempest-ServersAdminTestJSON-1747089598-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/f070b144-3a1a-4456-8e5b-02af12557c6a" status: 200 len: 1614 microversion: 2.1 time: 0.578359 Oct 22 20:57:57.887923 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 995/2105] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:57:57 2022] GET /compute/v2.1/servers/f070b144-3a1a-4456-8e5b-02af12557c6a => generated 1614 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 20:57:57.900874 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-c04079aa-0209-4cd2-8fbd-07a186ec2902 tempest-ServersAdminTestJSON-1747089598 tempest-ServersAdminTestJSON-1747089598-project-admin] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:57:57.908686 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-c04079aa-0209-4cd2-8fbd-07a186ec2902 tempest-ServersAdminTestJSON-1747089598 tempest-ServersAdminTestJSON-1747089598-project-admin] Searching by: {'host': 'nch2-master-1', 'deleted': False} {{(pid=138744) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 22 20:57:57.915298 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c04079aa-0209-4cd2-8fbd-07a186ec2902 tempest-ServersAdminTestJSON-1747089598 tempest-ServersAdminTestJSON-1747089598-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:57.916105 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c04079aa-0209-4cd2-8fbd-07a186ec2902 tempest-ServersAdminTestJSON-1747089598 tempest-ServersAdminTestJSON-1747089598-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:57.916688 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c04079aa-0209-4cd2-8fbd-07a186ec2902 tempest-ServersAdminTestJSON-1747089598 tempest-ServersAdminTestJSON-1747089598-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:57.917594 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c04079aa-0209-4cd2-8fbd-07a186ec2902 tempest-ServersAdminTestJSON-1747089598 tempest-ServersAdminTestJSON-1747089598-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:57.918195 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c04079aa-0209-4cd2-8fbd-07a186ec2902 tempest-ServersAdminTestJSON-1747089598 tempest-ServersAdminTestJSON-1747089598-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:57.919494 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c04079aa-0209-4cd2-8fbd-07a186ec2902 tempest-ServersAdminTestJSON-1747089598 tempest-ServersAdminTestJSON-1747089598-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:58.025745 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.multi_cell_list [None req-c04079aa-0209-4cd2-8fbd-07a186ec2902 tempest-ServersAdminTestJSON-1747089598 tempest-ServersAdminTestJSON-1747089598-project-admin] Listed batch of 5 results from cell out of 1000 limit. Returned 5 total so far. {{(pid=138744) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 22 20:57:58.129159 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-c04079aa-0209-4cd2-8fbd-07a186ec2902 tempest-ServersAdminTestJSON-1747089598 tempest-ServersAdminTestJSON-1747089598-project-admin] 10.222.0.18 "GET /compute/v2.1/servers?host=nch2-master-1&all_tenants=1" status: 200 len: 1643 microversion: 2.1 time: 0.232196 Oct 22 20:57:58.139779 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 996/2106] 10.222.0.18 () {58 vars in 1190 bytes} [Sat Oct 22 20:57:57 2022] GET /compute/v2.1/servers?host=nch2-master-1&all_tenants=1 => generated 1643 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:57:58.145362 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-c700e06d-a11e-4b4c-bb05-e57d43c858bd tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:57:58.146191 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-c700e06d-a11e-4b4c-bb05-e57d43c858bd tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] [instance: 18183d64-42b7-4b9f-9bca-6d018f17eeb3] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:57:58.155208 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c700e06d-a11e-4b4c-bb05-e57d43c858bd tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:58.155980 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c700e06d-a11e-4b4c-bb05-e57d43c858bd tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:58.156608 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c700e06d-a11e-4b4c-bb05-e57d43c858bd tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:58.157573 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c700e06d-a11e-4b4c-bb05-e57d43c858bd tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:58.158808 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c700e06d-a11e-4b4c-bb05-e57d43c858bd tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:58.159718 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c700e06d-a11e-4b4c-bb05-e57d43c858bd tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:58.259558 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell0:SELECT=2 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:57:58.271900 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-8a31e4c7-c859-46a7-82e5-aea132f9281a tempest-ServerPasswordTestJSON-1023240106 tempest-ServerPasswordTestJSON-1023240106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3466ea643c9142cfa0678d4cc277faab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9492cfb8c4487989bce6074736df04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:57:58.286953 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-8a31e4c7-c859-46a7-82e5-aea132f9281a tempest-ServerPasswordTestJSON-1023240106 tempest-ServerPasswordTestJSON-1023240106-project] 10.222.0.18 "GET /compute/v2.1/servers/659e6aaf-82b7-4361-8289-970d6de4a7b7" status: 200 len: 1316 microversion: 2.1 time: 0.661905 Oct 22 20:57:58.289142 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1111/2107] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:57:57 2022] GET /compute/v2.1/servers/659e6aaf-82b7-4361-8289-970d6de4a7b7 => generated 1316 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:57:58.307756 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-0c01b5e4-de9b-4e5a-95f3-1237ade1c109 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:57:58.308681 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-0c01b5e4-de9b-4e5a-95f3-1237ade1c109 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] [instance: 829a4155-cf7c-470d-a127-c729e32747fe] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:57:58.319892 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0c01b5e4-de9b-4e5a-95f3-1237ade1c109 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:58.320656 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0c01b5e4-de9b-4e5a-95f3-1237ade1c109 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:58.321249 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0c01b5e4-de9b-4e5a-95f3-1237ade1c109 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:58.322120 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0c01b5e4-de9b-4e5a-95f3-1237ade1c109 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:58.322716 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0c01b5e4-de9b-4e5a-95f3-1237ade1c109 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:58.323314 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0c01b5e4-de9b-4e5a-95f3-1237ade1c109 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:59.028626 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-c700e06d-a11e-4b4c-bb05-e57d43c858bd tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5660f7f9d86f473eaa83e2be362ca63c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e883d7e73084efeb725945ae0bab317', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:57:59.037293 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-c700e06d-a11e-4b4c-bb05-e57d43c858bd tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] 10.222.0.18 "GET /compute/v2.1/servers/18183d64-42b7-4b9f-9bca-6d018f17eeb3" status: 200 len: 1538 microversion: 2.1 time: 0.896275 Oct 22 20:57:59.037880 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 997/2108] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:57:58 2022] GET /compute/v2.1/servers/18183d64-42b7-4b9f-9bca-6d018f17eeb3 => generated 1538 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:57:59.050457 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-635e1f04-c499-45a8-826c-4b4c8603e5ec tempest-ServersAdminTestJSON-1747089598 tempest-ServersAdminTestJSON-1747089598-project-admin] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:57:59.061028 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-635e1f04-c499-45a8-826c-4b4c8603e5ec tempest-ServersAdminTestJSON-1747089598 tempest-ServersAdminTestJSON-1747089598-project-admin] Searching by: {'host': 'nonexistent_host', 'deleted': False} {{(pid=138744) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 22 20:57:59.066515 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-635e1f04-c499-45a8-826c-4b4c8603e5ec tempest-ServersAdminTestJSON-1747089598 tempest-ServersAdminTestJSON-1747089598-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:59.071974 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-635e1f04-c499-45a8-826c-4b4c8603e5ec tempest-ServersAdminTestJSON-1747089598 tempest-ServersAdminTestJSON-1747089598-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:59.072423 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-635e1f04-c499-45a8-826c-4b4c8603e5ec tempest-ServersAdminTestJSON-1747089598 tempest-ServersAdminTestJSON-1747089598-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:59.073188 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-635e1f04-c499-45a8-826c-4b4c8603e5ec tempest-ServersAdminTestJSON-1747089598 tempest-ServersAdminTestJSON-1747089598-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:59.082033 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-635e1f04-c499-45a8-826c-4b4c8603e5ec tempest-ServersAdminTestJSON-1747089598 tempest-ServersAdminTestJSON-1747089598-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:59.082639 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-635e1f04-c499-45a8-826c-4b4c8603e5ec tempest-ServersAdminTestJSON-1747089598 tempest-ServersAdminTestJSON-1747089598-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:59.120665 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-635e1f04-c499-45a8-826c-4b4c8603e5ec tempest-ServersAdminTestJSON-1747089598 tempest-ServersAdminTestJSON-1747089598-project-admin] 10.222.0.18 "GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1" status: 200 len: 15 microversion: 2.1 time: 0.073714 Oct 22 20:57:59.123041 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 998/2109] 10.222.0.18 () {58 vars in 1196 bytes} [Sat Oct 22 20:57:59 2022] GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1 => generated 15 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 22 20:57:59.159031 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-60b58eea-70c7-4e5c-8047-97e859b1bb58 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:57:59.160591 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-60b58eea-70c7-4e5c-8047-97e859b1bb58 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] [instance: aee36c9d-baf4-453c-b88f-31b8f23638c2] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:57:59.170491 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-60b58eea-70c7-4e5c-8047-97e859b1bb58 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:59.171001 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-60b58eea-70c7-4e5c-8047-97e859b1bb58 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:59.171653 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-60b58eea-70c7-4e5c-8047-97e859b1bb58 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:59.175278 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-60b58eea-70c7-4e5c-8047-97e859b1bb58 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:59.175978 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-60b58eea-70c7-4e5c-8047-97e859b1bb58 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:59.176596 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-60b58eea-70c7-4e5c-8047-97e859b1bb58 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:59.246932 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-0c01b5e4-de9b-4e5a-95f3-1237ade1c109 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d808e98f843dd9621822682c9d278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b58ab4af674c778b4819f177045651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:57:59.259871 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-0c01b5e4-de9b-4e5a-95f3-1237ade1c109 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] 10.222.0.18 "GET /compute/v2.1/servers/829a4155-cf7c-470d-a127-c729e32747fe" status: 200 len: 1459 microversion: 2.1 time: 0.969588 Oct 22 20:57:59.260760 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1112/2110] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:57:58 2022] GET /compute/v2.1/servers/829a4155-cf7c-470d-a127-c729e32747fe => generated 1459 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:57:59.267042 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-edeccbfe-c7cb-41b7-9007-dda6b4d72ee2 tempest-ServersAdminTestJSON-1747089598 tempest-ServersAdminTestJSON-1747089598-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:57:59.280615 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-edeccbfe-c7cb-41b7-9007-dda6b4d72ee2 tempest-ServersAdminTestJSON-1747089598 tempest-ServersAdminTestJSON-1747089598-project-admin] [instance: f070b144-3a1a-4456-8e5b-02af12557c6a] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:57:59.303689 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-edeccbfe-c7cb-41b7-9007-dda6b4d72ee2 tempest-ServersAdminTestJSON-1747089598 tempest-ServersAdminTestJSON-1747089598-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:59.304438 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-edeccbfe-c7cb-41b7-9007-dda6b4d72ee2 tempest-ServersAdminTestJSON-1747089598 tempest-ServersAdminTestJSON-1747089598-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:59.305141 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-edeccbfe-c7cb-41b7-9007-dda6b4d72ee2 tempest-ServersAdminTestJSON-1747089598 tempest-ServersAdminTestJSON-1747089598-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:59.306159 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-edeccbfe-c7cb-41b7-9007-dda6b4d72ee2 tempest-ServersAdminTestJSON-1747089598 tempest-ServersAdminTestJSON-1747089598-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:59.306845 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-edeccbfe-c7cb-41b7-9007-dda6b4d72ee2 tempest-ServersAdminTestJSON-1747089598 tempest-ServersAdminTestJSON-1747089598-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:59.307526 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-edeccbfe-c7cb-41b7-9007-dda6b4d72ee2 tempest-ServersAdminTestJSON-1747089598 tempest-ServersAdminTestJSON-1747089598-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:59.343746 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:57:59.440664 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-edeccbfe-c7cb-41b7-9007-dda6b4d72ee2 tempest-ServersAdminTestJSON-1747089598 tempest-ServersAdminTestJSON-1747089598-project-admin] 10.222.0.18 "POST /compute/v2.1/servers/f070b144-3a1a-4456-8e5b-02af12557c6a/action" status: 202 len: 0 microversion: 2.1 time: 0.177970 Oct 22 20:57:59.442258 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1113/2111] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 20:57:59 2022] POST /compute/v2.1/servers/f070b144-3a1a-4456-8e5b-02af12557c6a/action => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 20:57:59.451295 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-6323864c-730a-4953-9f83-8b390da41e56 tempest-LiveMigrationNegativeTest-1259453977 tempest-LiveMigrationNegativeTest-1259453977-project-admin] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:57:59.451945 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-6323864c-730a-4953-9f83-8b390da41e56 tempest-LiveMigrationNegativeTest-1259453977 tempest-LiveMigrationNegativeTest-1259453977-project-admin] [instance: 829a4155-cf7c-470d-a127-c729e32747fe] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:57:59.460854 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6323864c-730a-4953-9f83-8b390da41e56 tempest-LiveMigrationNegativeTest-1259453977 tempest-LiveMigrationNegativeTest-1259453977-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:59.461353 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6323864c-730a-4953-9f83-8b390da41e56 tempest-LiveMigrationNegativeTest-1259453977 tempest-LiveMigrationNegativeTest-1259453977-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:59.462356 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6323864c-730a-4953-9f83-8b390da41e56 tempest-LiveMigrationNegativeTest-1259453977 tempest-LiveMigrationNegativeTest-1259453977-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:59.463559 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6323864c-730a-4953-9f83-8b390da41e56 tempest-LiveMigrationNegativeTest-1259453977 tempest-LiveMigrationNegativeTest-1259453977-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:59.464322 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6323864c-730a-4953-9f83-8b390da41e56 tempest-LiveMigrationNegativeTest-1259453977 tempest-LiveMigrationNegativeTest-1259453977-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:59.466083 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6323864c-730a-4953-9f83-8b390da41e56 tempest-LiveMigrationNegativeTest-1259453977 tempest-LiveMigrationNegativeTest-1259453977-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:59.881678 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-60b58eea-70c7-4e5c-8047-97e859b1bb58 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d3d7458af447bdb3f03e83a2d8559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49238b8686d24ae698679e4a1957735d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:57:59.898437 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-60b58eea-70c7-4e5c-8047-97e859b1bb58 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] 10.222.0.18 "GET /compute/v2.1/servers/aee36c9d-baf4-453c-b88f-31b8f23638c2" status: 200 len: 1470 microversion: 2.1 time: 0.756369 Oct 22 20:57:59.913196 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 999/2112] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:57:59 2022] GET /compute/v2.1/servers/aee36c9d-baf4-453c-b88f-31b8f23638c2 => generated 1470 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:57:59.927557 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-ebbebbe3-5d62-41b8-bf6a-e904fed726fe req-3a17e1f1-bd67-4a6e-84c0-c15801feac34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18183d64-42b7-4b9f-9bca-6d018f17eeb3", "name": "network-vif-deleted", "tag": "26816847-4085-4357-9ca7-d768088c1a37"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:57:59.948508 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-ebbebbe3-5d62-41b8-bf6a-e904fed726fe req-3a17e1f1-bd67-4a6e-84c0-c15801feac34 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:59.949357 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-ebbebbe3-5d62-41b8-bf6a-e904fed726fe req-3a17e1f1-bd67-4a6e-84c0-c15801feac34 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:59.950017 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-ebbebbe3-5d62-41b8-bf6a-e904fed726fe req-3a17e1f1-bd67-4a6e-84c0-c15801feac34 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:57:59.971541 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-ebbebbe3-5d62-41b8-bf6a-e904fed726fe req-3a17e1f1-bd67-4a6e-84c0-c15801feac34 service nova] Creating event network-vif-deleted:26816847-4085-4357-9ca7-d768088c1a37 for instance 18183d64-42b7-4b9f-9bca-6d018f17eeb3 on nch1-master-1 Oct 22 20:57:59.978136 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-ebbebbe3-5d62-41b8-bf6a-e904fed726fe req-3a17e1f1-bd67-4a6e-84c0-c15801feac34 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055851 Oct 22 20:57:59.979492 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1000/2113] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:57:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:57:59.987084 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-5e12c81e-acd1-4d15-97fe-1a4cb0e9b8e8 tempest-ServerPasswordTestJSON-1023240106 tempest-ServerPasswordTestJSON-1023240106-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:57:59.989832 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-5e12c81e-acd1-4d15-97fe-1a4cb0e9b8e8 tempest-ServerPasswordTestJSON-1023240106 tempest-ServerPasswordTestJSON-1023240106-project] [instance: 659e6aaf-82b7-4361-8289-970d6de4a7b7] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:57:59.997667 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5e12c81e-acd1-4d15-97fe-1a4cb0e9b8e8 tempest-ServerPasswordTestJSON-1023240106 tempest-ServerPasswordTestJSON-1023240106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:57:59.998185 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5e12c81e-acd1-4d15-97fe-1a4cb0e9b8e8 tempest-ServerPasswordTestJSON-1023240106 tempest-ServerPasswordTestJSON-1023240106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:57:59.998967 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5e12c81e-acd1-4d15-97fe-1a4cb0e9b8e8 tempest-ServerPasswordTestJSON-1023240106 tempest-ServerPasswordTestJSON-1023240106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:00.000488 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5e12c81e-acd1-4d15-97fe-1a4cb0e9b8e8 tempest-ServerPasswordTestJSON-1023240106 tempest-ServerPasswordTestJSON-1023240106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:00.001308 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5e12c81e-acd1-4d15-97fe-1a4cb0e9b8e8 tempest-ServerPasswordTestJSON-1023240106 tempest-ServerPasswordTestJSON-1023240106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:00.001895 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5e12c81e-acd1-4d15-97fe-1a4cb0e9b8e8 tempest-ServerPasswordTestJSON-1023240106 tempest-ServerPasswordTestJSON-1023240106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:00.540926 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-5e12c81e-acd1-4d15-97fe-1a4cb0e9b8e8 tempest-ServerPasswordTestJSON-1023240106 tempest-ServerPasswordTestJSON-1023240106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3466ea643c9142cfa0678d4cc277faab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9492cfb8c4487989bce6074736df04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:58:00.561643 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-5e12c81e-acd1-4d15-97fe-1a4cb0e9b8e8 tempest-ServerPasswordTestJSON-1023240106 tempest-ServerPasswordTestJSON-1023240106-project] 10.222.0.18 "GET /compute/v2.1/servers/659e6aaf-82b7-4361-8289-970d6de4a7b7" status: 200 len: 1316 microversion: 2.1 time: 0.580472 Oct 22 20:58:00.566308 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1001/2114] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:57:59 2022] GET /compute/v2.1/servers/659e6aaf-82b7-4361-8289-970d6de4a7b7 => generated 1316 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:58:00.575435 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-bd58b50c-026e-4f55-b72e-6183ed44988d tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "085e4478-6edc-4a69-8e08-f9831713eb65"}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:58:00.582196 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-bd58b50c-026e-4f55-b72e-6183ed44988d tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] [instance: f070b144-3a1a-4456-8e5b-02af12557c6a] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:58:00.595404 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bd58b50c-026e-4f55-b72e-6183ed44988d tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:00.596649 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bd58b50c-026e-4f55-b72e-6183ed44988d tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:00.597509 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bd58b50c-026e-4f55-b72e-6183ed44988d tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:00.598511 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bd58b50c-026e-4f55-b72e-6183ed44988d tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:00.599309 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bd58b50c-026e-4f55-b72e-6183ed44988d tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:00.600294 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bd58b50c-026e-4f55-b72e-6183ed44988d tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:00.748104 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-bd58b50c-026e-4f55-b72e-6183ed44988d tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Flavor limits 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 20:58:00.748735 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-bd58b50c-026e-4f55-b72e-6183ed44988d tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Image limits 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 20:58:00.749716 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-bd58b50c-026e-4f55-b72e-6183ed44988d tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Flavor pref 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 20:58:00.750931 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-bd58b50c-026e-4f55-b72e-6183ed44988d tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Image pref 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 20:58:00.751782 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-bd58b50c-026e-4f55-b72e-6183ed44988d tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 20:58:00.819473 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-6323864c-730a-4953-9f83-8b390da41e56 tempest-LiveMigrationNegativeTest-1259453977 tempest-LiveMigrationNegativeTest-1259453977-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/829a4155-cf7c-470d-a127-c729e32747fe" status: 200 len: 1610 microversion: 2.1 time: 1.374938 Oct 22 20:58:00.821788 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1114/2115] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:57:59 2022] GET /compute/v2.1/servers/829a4155-cf7c-470d-a127-c729e32747fe => generated 1610 bytes in 1379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:58:00.834928 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-1624c166-cfd7-4e42-a836-98d01dd2cddc tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:58:00.836686 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-1624c166-cfd7-4e42-a836-98d01dd2cddc tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] [instance: aee36c9d-baf4-453c-b88f-31b8f23638c2] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:58:00.862101 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1624c166-cfd7-4e42-a836-98d01dd2cddc tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:00.868636 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1624c166-cfd7-4e42-a836-98d01dd2cddc tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:00.870447 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1624c166-cfd7-4e42-a836-98d01dd2cddc tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:00.875579 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1624c166-cfd7-4e42-a836-98d01dd2cddc tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:00.878678 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1624c166-cfd7-4e42-a836-98d01dd2cddc tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:00.879890 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1624c166-cfd7-4e42-a836-98d01dd2cddc tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:00.999134 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-bd58b50c-026e-4f55-b72e-6183ed44988d tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] [instance: f070b144-3a1a-4456-8e5b-02af12557c6a] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:58:01.043113 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bd58b50c-026e-4f55-b72e-6183ed44988d tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:01.055945 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bd58b50c-026e-4f55-b72e-6183ed44988d tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:01.056743 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bd58b50c-026e-4f55-b72e-6183ed44988d tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:01.058910 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bd58b50c-026e-4f55-b72e-6183ed44988d tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:01.064105 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bd58b50c-026e-4f55-b72e-6183ed44988d tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:01.066372 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bd58b50c-026e-4f55-b72e-6183ed44988d tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:01.129172 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1624c166-cfd7-4e42-a836-98d01dd2cddc tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:01.130961 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1624c166-cfd7-4e42-a836-98d01dd2cddc tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:01.131597 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1624c166-cfd7-4e42-a836-98d01dd2cddc tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:01.134941 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1624c166-cfd7-4e42-a836-98d01dd2cddc tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:01.135812 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1624c166-cfd7-4e42-a836-98d01dd2cddc tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:01.136469 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1624c166-cfd7-4e42-a836-98d01dd2cddc tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:01.182787 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-bd58b50c-026e-4f55-b72e-6183ed44988d tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] 10.222.0.18 "POST /compute/v2.1/servers/f070b144-3a1a-4456-8e5b-02af12557c6a/action" status: 202 len: 1067 microversion: 2.1 time: 0.613615 Oct 22 20:58:01.190066 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1002/2116] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 20:58:00 2022] POST /compute/v2.1/servers/f070b144-3a1a-4456-8e5b-02af12557c6a/action => generated 1067 bytes in 623 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 22 20:58:01.224693 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-55e26159-6430-4cc1-bd10-f95a64f54159 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:58:01.227363 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-55e26159-6430-4cc1-bd10-f95a64f54159 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] [instance: 18183d64-42b7-4b9f-9bca-6d018f17eeb3] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:58:01.234254 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-1624c166-cfd7-4e42-a836-98d01dd2cddc tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Getting quotas for project 49238b8686d24ae698679e4a1957735d. Resources: {'ram', 'cores'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 20:58:01.240617 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-1624c166-cfd7-4e42-a836-98d01dd2cddc tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Getting quotas for user e0d3d7458af447bdb3f03e83a2d8559f and project 49238b8686d24ae698679e4a1957735d. Resources: {'ram', 'cores'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 20:58:01.256687 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-55e26159-6430-4cc1-bd10-f95a64f54159 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:01.260023 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-55e26159-6430-4cc1-bd10-f95a64f54159 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:01.262197 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-55e26159-6430-4cc1-bd10-f95a64f54159 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:01.268598 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-55e26159-6430-4cc1-bd10-f95a64f54159 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:01.274740 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-55e26159-6430-4cc1-bd10-f95a64f54159 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:01.277299 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-55e26159-6430-4cc1-bd10-f95a64f54159 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:01.321841 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-55e26159-6430-4cc1-bd10-f95a64f54159 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] HTTP exception thrown: Instance 18183d64-42b7-4b9f-9bca-6d018f17eeb3 could not be found. Oct 22 20:58:01.324626 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-55e26159-6430-4cc1-bd10-f95a64f54159 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] Request method failure captured: Oct 22 20:58:01.324626 ncdv-master-1 devstack@n-api.service[138744]: request: GET /compute/v2.1/servers/18183d64-42b7-4b9f-9bca-6d018f17eeb3 HTTP/1.1 Oct 22 20:58:01.324626 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 20:58:01.324626 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 20:58:01.324626 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 20:58:01.324626 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 0 Oct 22 20:58:01.324626 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 20:58:01.324626 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 20:58:01.324626 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 20:58:01.324626 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 20:58:01.324626 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVFkXuiu5o7_mkf-T6g2hJ9V3zhz6b158xzEeQn2hLYFzTm7eWg1McjcIpfQyHxZ4hCvKyo-lO4kjjeE9oMC47EVd9nh5yoCww3JiBIb9THOnFtV8XT__oHmWbKSrDo3becuY-aCCDuC3aMWP-ibtAxHnxcfn7uTMu-Mh-GxZuahHHAg Oct 22 20:58:01.324626 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 20:58:01.324626 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 20:58:01.324626 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 20:58:01.324626 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 20:58:01.324626 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 20:58:01.324626 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 20:58:01.324626 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: 7e883d7e73084efeb725945ae0bab317 Oct 22 20:58:01.324626 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 Oct 22 20:58:01.324626 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 20:58:01.324626 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 20:58:01.324626 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_7e883d7e73084efeb725945ae0bab317"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7e883d7e73084efeb725945ae0bab317"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/7e883d7e73084efeb725945ae0bab317"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7e883d7e73084efeb725945ae0bab317"}]}] Oct 22 20:58:01.324626 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 Oct 22 20:58:01.324626 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: 7e883d7e73084efeb725945ae0bab317 Oct 22 20:58:01.324626 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 Oct 22 20:58:01.324626 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project Oct 22 20:58:01.324626 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 20:58:01.324626 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 20:58:01.324626 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: 5660f7f9d86f473eaa83e2be362ca63c Oct 22 20:58:01.324626 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project Oct 22 20:58:01.324626 ncdv-master-1 devstack@n-api.service[138744]: method: > Oct 22 20:58:01.324626 ncdv-master-1 devstack@n-api.service[138744]: exception: Instance 18183d64-42b7-4b9f-9bca-6d018f17eeb3 could not be found. Oct 22 20:58:01.324626 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': '18183d64-42b7-4b9f-9bca-6d018f17eeb3'} Oct 22 20:58:01.324626 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:58:01.324626 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:58:01.324626 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 20:58:01.324626 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 20:58:01.324626 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 20:58:01.324626 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 20:58:01.324626 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 20:58:01.324626 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 20:58:01.324626 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 20:58:01.324626 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 20:58:01.324626 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 18183d64-42b7-4b9f-9bca-6d018f17eeb3 could not be found. Oct 22 20:58:01.324626 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:58:01.324626 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:58:01.324626 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:58:01.324626 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:58:01.324626 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:58:01.324626 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:58:01.324626 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:58:01.324626 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:58:01.324626 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:58:01.324626 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:58:01.324626 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 20:58:01.324626 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 20:58:01.324626 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 20:58:01.324626 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 20:58:01.324626 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 20:58:01.324626 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 20:58:01.324626 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 18183d64-42b7-4b9f-9bca-6d018f17eeb3 could not be found. Oct 22 20:58:01.324626 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:58:01.328334 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:58:01.328334 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:58:01.328334 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:58:01.328334 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:58:01.328334 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:58:01.328334 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 20:58:01.328334 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 20:58:01.328334 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 18183d64-42b7-4b9f-9bca-6d018f17eeb3 could not be found. Oct 22 20:58:01.328334 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:58:01.330899 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-55e26159-6430-4cc1-bd10-f95a64f54159 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] Returning 404 to user: Instance 18183d64-42b7-4b9f-9bca-6d018f17eeb3 could not be found. {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:58:01.332310 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-55e26159-6430-4cc1-bd10-f95a64f54159 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444 tempest-FloatingIPsAssociationNegativeTestJSON-1664528444-project] 10.222.0.18 "GET /compute/v2.1/servers/18183d64-42b7-4b9f-9bca-6d018f17eeb3" status: 404 len: 111 microversion: 2.1 time: 0.140655 Oct 22 20:58:01.333907 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1003/2117] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:58:01 2022] GET /compute/v2.1/servers/18183d64-42b7-4b9f-9bca-6d018f17eeb3 => generated 111 bytes in 143 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 20:58:01.340074 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-31adf969-baad-40ab-b980-2c2610e2db09 req-3e981344-3f7a-4ea3-9272-c65ce0dbea9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aee36c9d-baf4-453c-b88f-31b8f23638c2", "name": "network-vif-plugged", "status": "completed", "tag": "f8ab0e3e-04fa-4f80-97a2-b20b84653be1"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:58:01.357015 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-31adf969-baad-40ab-b980-2c2610e2db09 req-3e981344-3f7a-4ea3-9272-c65ce0dbea9a service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:01.357971 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-31adf969-baad-40ab-b980-2c2610e2db09 req-3e981344-3f7a-4ea3-9272-c65ce0dbea9a service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:01.358690 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-31adf969-baad-40ab-b980-2c2610e2db09 req-3e981344-3f7a-4ea3-9272-c65ce0dbea9a service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:01.377000 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-31adf969-baad-40ab-b980-2c2610e2db09 req-3e981344-3f7a-4ea3-9272-c65ce0dbea9a service nova] Creating event network-vif-plugged:f8ab0e3e-04fa-4f80-97a2-b20b84653be1 for instance aee36c9d-baf4-453c-b88f-31b8f23638c2 on nch2-master-1 Oct 22 20:58:01.388403 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [req-31adf969-baad-40ab-b980-2c2610e2db09 req-3e981344-3f7a-4ea3-9272-c65ce0dbea9a service nova] Instance aee36c9d-baf4-453c-b88f-31b8f23638c2 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=138744) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 22 20:58:01.412036 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-31adf969-baad-40ab-b980-2c2610e2db09 req-3e981344-3f7a-4ea3-9272-c65ce0dbea9a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076334 Oct 22 20:58:01.413726 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1004/2118] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:58:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:58:01.421380 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-008d201c-4cdd-412a-8c11-19f4daffa1f0 tempest-LiveMigrationNegativeTest-1259453977 tempest-LiveMigrationNegativeTest-1259453977-project-admin] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:58:01.429122 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-008d201c-4cdd-412a-8c11-19f4daffa1f0 tempest-LiveMigrationNegativeTest-1259453977 tempest-LiveMigrationNegativeTest-1259453977-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:01.430148 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-008d201c-4cdd-412a-8c11-19f4daffa1f0 tempest-LiveMigrationNegativeTest-1259453977 tempest-LiveMigrationNegativeTest-1259453977-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:01.430852 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-008d201c-4cdd-412a-8c11-19f4daffa1f0 tempest-LiveMigrationNegativeTest-1259453977 tempest-LiveMigrationNegativeTest-1259453977-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:01.432047 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-008d201c-4cdd-412a-8c11-19f4daffa1f0 tempest-LiveMigrationNegativeTest-1259453977 tempest-LiveMigrationNegativeTest-1259453977-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:01.432917 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-008d201c-4cdd-412a-8c11-19f4daffa1f0 tempest-LiveMigrationNegativeTest-1259453977 tempest-LiveMigrationNegativeTest-1259453977-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:01.433722 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-008d201c-4cdd-412a-8c11-19f4daffa1f0 tempest-LiveMigrationNegativeTest-1259453977 tempest-LiveMigrationNegativeTest-1259453977-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:01.468421 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-1624c166-cfd7-4e42-a836-98d01dd2cddc tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] 10.222.0.18 "POST /compute/v2.1/servers/aee36c9d-baf4-453c-b88f-31b8f23638c2/action" status: 202 len: 0 microversion: 2.1 time: 0.639232 Oct 22 20:58:01.470289 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1115/2119] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 20:58:00 2022] POST /compute/v2.1/servers/aee36c9d-baf4-453c-b88f-31b8f23638c2/action => generated 0 bytes in 647 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 20:58:01.483261 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-59ae37d2-288b-4f1e-ac2b-cb62fa3bc4ae req-e556dfda-d731-4026-a4b8-8003de95c7aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "659e6aaf-82b7-4361-8289-970d6de4a7b7", "tag": "c000a86e-3b85-400e-bac9-43e74449f4c7"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:58:01.522048 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-59ae37d2-288b-4f1e-ac2b-cb62fa3bc4ae req-e556dfda-d731-4026-a4b8-8003de95c7aa service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:01.522613 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-59ae37d2-288b-4f1e-ac2b-cb62fa3bc4ae req-e556dfda-d731-4026-a4b8-8003de95c7aa service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:01.522947 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-59ae37d2-288b-4f1e-ac2b-cb62fa3bc4ae req-e556dfda-d731-4026-a4b8-8003de95c7aa service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:01.532657 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-008d201c-4cdd-412a-8c11-19f4daffa1f0 tempest-LiveMigrationNegativeTest-1259453977 tempest-LiveMigrationNegativeTest-1259453977-project-admin] 10.222.0.18 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.116055 Oct 22 20:58:01.534778 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1005/2120] 10.222.0.18 () {58 vars in 1176 bytes} [Sat Oct 22 20:58:01 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:58:01.551887 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-f751f01e-6a00-42b1-8bdf-4df165f070f6 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:58:01.552843 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-f751f01e-6a00-42b1-8bdf-4df165f070f6 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] [instance: f070b144-3a1a-4456-8e5b-02af12557c6a] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:58:01.562176 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-59ae37d2-288b-4f1e-ac2b-cb62fa3bc4ae req-e556dfda-d731-4026-a4b8-8003de95c7aa service nova] Creating event network-changed:c000a86e-3b85-400e-bac9-43e74449f4c7 for instance 659e6aaf-82b7-4361-8289-970d6de4a7b7 on nch1-master-1 Oct 22 20:58:01.563645 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f751f01e-6a00-42b1-8bdf-4df165f070f6 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:01.564279 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f751f01e-6a00-42b1-8bdf-4df165f070f6 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:01.564740 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f751f01e-6a00-42b1-8bdf-4df165f070f6 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:01.567548 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f751f01e-6a00-42b1-8bdf-4df165f070f6 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:01.568689 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f751f01e-6a00-42b1-8bdf-4df165f070f6 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:01.569408 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f751f01e-6a00-42b1-8bdf-4df165f070f6 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:01.585576 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-59ae37d2-288b-4f1e-ac2b-cb62fa3bc4ae req-e556dfda-d731-4026-a4b8-8003de95c7aa service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113591 Oct 22 20:58:01.587451 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1116/2121] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:58:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:58:01.593741 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-eb1f2fb4-c669-4236-b6a5-f72b0d2c4316 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:58:01.611953 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-eb1f2fb4-c669-4236-b6a5-f72b0d2c4316 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] [instance: aee36c9d-baf4-453c-b88f-31b8f23638c2] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:58:01.621810 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-eb1f2fb4-c669-4236-b6a5-f72b0d2c4316 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:01.622922 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-eb1f2fb4-c669-4236-b6a5-f72b0d2c4316 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:01.629964 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-eb1f2fb4-c669-4236-b6a5-f72b0d2c4316 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:01.631000 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-eb1f2fb4-c669-4236-b6a5-f72b0d2c4316 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:01.632631 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-eb1f2fb4-c669-4236-b6a5-f72b0d2c4316 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:01.634321 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-eb1f2fb4-c669-4236-b6a5-f72b0d2c4316 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:02.355118 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-f751f01e-6a00-42b1-8bdf-4df165f070f6 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dbe89a7e11480194d3d86f82983499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8351b01e07cd43f9be973ab45e522bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:58:02.359053 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:58:02.364738 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-f751f01e-6a00-42b1-8bdf-4df165f070f6 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] 10.222.0.18 "GET /compute/v2.1/servers/f070b144-3a1a-4456-8e5b-02af12557c6a" status: 200 len: 1471 microversion: 2.1 time: 0.828756 Oct 22 20:58:02.371971 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1006/2122] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:58:01 2022] GET /compute/v2.1/servers/f070b144-3a1a-4456-8e5b-02af12557c6a => generated 1471 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:58:02.378184 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-5ff42a60-f4a8-416b-9fb4-ef9afd739404 tempest-LiveMigrationNegativeTest-1259453977 tempest-LiveMigrationNegativeTest-1259453977-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch1-master-1", "block_migration": true, "disk_over_commit": false}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:58:02.381246 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-5ff42a60-f4a8-416b-9fb4-ef9afd739404 tempest-LiveMigrationNegativeTest-1259453977 tempest-LiveMigrationNegativeTest-1259453977-project-admin] [instance: 829a4155-cf7c-470d-a127-c729e32747fe] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:58:02.390043 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5ff42a60-f4a8-416b-9fb4-ef9afd739404 tempest-LiveMigrationNegativeTest-1259453977 tempest-LiveMigrationNegativeTest-1259453977-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:02.390825 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5ff42a60-f4a8-416b-9fb4-ef9afd739404 tempest-LiveMigrationNegativeTest-1259453977 tempest-LiveMigrationNegativeTest-1259453977-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:02.392041 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5ff42a60-f4a8-416b-9fb4-ef9afd739404 tempest-LiveMigrationNegativeTest-1259453977 tempest-LiveMigrationNegativeTest-1259453977-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:02.393284 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5ff42a60-f4a8-416b-9fb4-ef9afd739404 tempest-LiveMigrationNegativeTest-1259453977 tempest-LiveMigrationNegativeTest-1259453977-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:02.393963 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5ff42a60-f4a8-416b-9fb4-ef9afd739404 tempest-LiveMigrationNegativeTest-1259453977 tempest-LiveMigrationNegativeTest-1259453977-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:02.394618 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5ff42a60-f4a8-416b-9fb4-ef9afd739404 tempest-LiveMigrationNegativeTest-1259453977 tempest-LiveMigrationNegativeTest-1259453977-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:02.518198 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.objects.instance [None req-5ff42a60-f4a8-416b-9fb4-ef9afd739404 tempest-LiveMigrationNegativeTest-1259453977 tempest-LiveMigrationNegativeTest-1259453977-project-admin] Lazy-loading 'flavor' on Instance uuid 829a4155-cf7c-470d-a127-c729e32747fe {{(pid=138744) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 20:58:02.564542 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-5ff42a60-f4a8-416b-9fb4-ef9afd739404 tempest-LiveMigrationNegativeTest-1259453977 tempest-LiveMigrationNegativeTest-1259453977-project-admin] HTTP exception thrown: Cannot 'os-migrateLive' instance 829a4155-cf7c-470d-a127-c729e32747fe while it is in vm_state suspended Oct 22 20:58:02.572614 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-5ff42a60-f4a8-416b-9fb4-ef9afd739404 tempest-LiveMigrationNegativeTest-1259453977 tempest-LiveMigrationNegativeTest-1259453977-project-admin] Request method failure captured: Oct 22 20:58:02.572614 ncdv-master-1 devstack@n-api.service[138744]: request: POST /compute/v2.1/servers/829a4155-cf7c-470d-a127-c729e32747fe/action HTTP/1.1 Oct 22 20:58:02.572614 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 20:58:02.572614 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 20:58:02.572614 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 20:58:02.572614 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 97 Oct 22 20:58:02.572614 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 20:58:02.572614 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 20:58:02.572614 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 20:58:02.572614 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 20:58:02.572614 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVFkYeD1NYVSqkbc7m3wiemIxbtdbMPl4_E3wWH8TlZAo5oNiXQvav-t8cOvEsFGJWnKGeRIPlt4QQDKWDamJ2M4aikg9uG95yfmcR2LOQdQLtyj2nrza1FXApvIG7XMSIL-NErKhjqUuT0dfyHn9KnmPY8josOf9qcQbNVO-Gu0gQkk Oct 22 20:58:02.572614 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 20:58:02.572614 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 20:58:02.572614 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 20:58:02.572614 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 20:58:02.572614 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 20:58:02.572614 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 20:58:02.572614 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: 3f61a419b4c04c41beda5ee46a20d750 Oct 22 20:58:02.572614 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-LiveMigrationNegativeTest-1259453977 Oct 22 20:58:02.572614 ncdv-master-1 devstack@n-api.service[138744]: X-Role: admin,member,reader Oct 22 20:58:02.572614 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: admin,member,reader Oct 22 20:58:02.572614 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_3f61a419b4c04c41beda5ee46a20d750"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/3f61a419b4c04c41beda5ee46a20d750"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/3f61a419b4c04c41beda5ee46a20d750"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/3f61a419b4c04c41beda5ee46a20d750"}]}] Oct 22 20:58:02.572614 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-LiveMigrationNegativeTest-1259453977 Oct 22 20:58:02.572614 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: 3f61a419b4c04c41beda5ee46a20d750 Oct 22 20:58:02.572614 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1259453977 Oct 22 20:58:02.572614 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-LiveMigrationNegativeTest-1259453977-project-admin Oct 22 20:58:02.572614 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 20:58:02.572614 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 20:58:02.572614 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: 780d25299fec4d658c0bf856ca2381db Oct 22 20:58:02.572614 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-LiveMigrationNegativeTest-1259453977-project-admin Oct 22 20:58:02.572614 ncdv-master-1 devstack@n-api.service[138744]: Oct 22 20:58:02.572614 ncdv-master-1 devstack@n-api.service[138744]: {"os-migrateLive": {"host": "nch1-master-1", "block_migration": true, "disk_over_commit": false}} Oct 22 20:58:02.572614 ncdv-master-1 devstack@n-api.service[138744]: method: > Oct 22 20:58:02.572614 ncdv-master-1 devstack@n-api.service[138744]: exception: Cannot 'os-migrateLive' instance 829a4155-cf7c-470d-a127-c729e32747fe while it is in vm_state suspended Oct 22 20:58:02.572614 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': '829a4155-cf7c-470d-a127-c729e32747fe', 'body': {'os-migrateLive': {'host': 'nch1-master-1', 'block_migration': True, 'disk_over_commit': False}}} Oct 22 20:58:02.572614 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:58:02.572614 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:58:02.572614 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Oct 22 20:58:02.572614 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Oct 22 20:58:02.572614 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 22 20:58:02.572614 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 22 20:58:02.572614 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 22 20:58:02.572614 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 22 20:58:02.572614 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 22 20:58:02.572614 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 22 20:58:02.572614 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 22 20:58:02.572614 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 22 20:58:02.572614 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 22 20:58:02.572614 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 22 20:58:02.572614 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Oct 22 20:58:02.572614 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 22 20:58:02.572614 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 22 20:58:02.572614 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 22 20:58:02.572614 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 22 20:58:02.572614 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 22 20:58:02.572614 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 829a4155-cf7c-470d-a127-c729e32747fe in vm_state suspended. Cannot live_migrate while the instance is in this state. Oct 22 20:58:02.572614 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:58:02.572614 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:58:02.572614 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:58:02.572614 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:58:02.572614 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:58:02.576923 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:58:02.576923 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:58:02.576923 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:58:02.576923 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:58:02.576923 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:58:02.576923 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 20:58:02.576923 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 20:58:02.576923 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 20:58:02.576923 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 20:58:02.576923 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 20:58:02.576923 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 20:58:02.576923 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 22 20:58:02.576923 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 152, in _migrate_live Oct 22 20:58:02.576923 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 22 20:58:02.576923 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 22 20:58:02.576923 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 22 20:58:02.576923 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'os-migrateLive' instance 829a4155-cf7c-470d-a127-c729e32747fe while it is in vm_state suspended Oct 22 20:58:02.576923 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:58:02.576923 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:58:02.576923 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:58:02.576923 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:58:02.576923 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:58:02.576923 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:58:02.576923 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 20:58:02.576923 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 20:58:02.576923 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'os-migrateLive' instance 829a4155-cf7c-470d-a127-c729e32747fe while it is in vm_state suspended Oct 22 20:58:02.576923 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:58:02.581320 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-5ff42a60-f4a8-416b-9fb4-ef9afd739404 tempest-LiveMigrationNegativeTest-1259453977 tempest-LiveMigrationNegativeTest-1259453977-project-admin] Returning 409 to user: Cannot 'os-migrateLive' instance 829a4155-cf7c-470d-a127-c729e32747fe while it is in vm_state suspended {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:58:02.582460 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-5ff42a60-f4a8-416b-9fb4-ef9afd739404 tempest-LiveMigrationNegativeTest-1259453977 tempest-LiveMigrationNegativeTest-1259453977-project-admin] 10.222.0.18 "POST /compute/v2.1/servers/829a4155-cf7c-470d-a127-c729e32747fe/action" status: 409 len: 155 microversion: 2.1 time: 0.209219 Oct 22 20:58:02.583567 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1007/2123] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 20:58:02 2022] POST /compute/v2.1/servers/829a4155-cf7c-470d-a127-c729e32747fe/action => generated 155 bytes in 211 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 22 20:58:02.594775 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-fd313907-23c5-492f-98c8-d5dbf853a174 tempest-ServerPasswordTestJSON-1023240106 tempest-ServerPasswordTestJSON-1023240106-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:58:02.595805 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-fd313907-23c5-492f-98c8-d5dbf853a174 tempest-ServerPasswordTestJSON-1023240106 tempest-ServerPasswordTestJSON-1023240106-project] [instance: 659e6aaf-82b7-4361-8289-970d6de4a7b7] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:58:02.605501 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fd313907-23c5-492f-98c8-d5dbf853a174 tempest-ServerPasswordTestJSON-1023240106 tempest-ServerPasswordTestJSON-1023240106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:02.606295 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fd313907-23c5-492f-98c8-d5dbf853a174 tempest-ServerPasswordTestJSON-1023240106 tempest-ServerPasswordTestJSON-1023240106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:02.606903 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fd313907-23c5-492f-98c8-d5dbf853a174 tempest-ServerPasswordTestJSON-1023240106 tempest-ServerPasswordTestJSON-1023240106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:02.607962 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fd313907-23c5-492f-98c8-d5dbf853a174 tempest-ServerPasswordTestJSON-1023240106 tempest-ServerPasswordTestJSON-1023240106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:02.608613 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fd313907-23c5-492f-98c8-d5dbf853a174 tempest-ServerPasswordTestJSON-1023240106 tempest-ServerPasswordTestJSON-1023240106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:02.609254 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fd313907-23c5-492f-98c8-d5dbf853a174 tempest-ServerPasswordTestJSON-1023240106 tempest-ServerPasswordTestJSON-1023240106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:02.799596 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-eb1f2fb4-c669-4236-b6a5-f72b0d2c4316 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d3d7458af447bdb3f03e83a2d8559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49238b8686d24ae698679e4a1957735d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:58:02.819539 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-eb1f2fb4-c669-4236-b6a5-f72b0d2c4316 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] 10.222.0.18 "GET /compute/v2.1/servers/aee36c9d-baf4-453c-b88f-31b8f23638c2" status: 200 len: 1469 microversion: 2.1 time: 1.229755 Oct 22 20:58:02.824272 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1117/2124] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:58:01 2022] GET /compute/v2.1/servers/aee36c9d-baf4-453c-b88f-31b8f23638c2 => generated 1469 bytes in 1235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:58:02.840413 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-ae2a3c85-9eb6-443b-951a-3f4330d03a10 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:58:02.842209 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-ae2a3c85-9eb6-443b-951a-3f4330d03a10 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] [instance: 829a4155-cf7c-470d-a127-c729e32747fe] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:58:02.855888 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ae2a3c85-9eb6-443b-951a-3f4330d03a10 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:02.856399 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ae2a3c85-9eb6-443b-951a-3f4330d03a10 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:02.856833 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ae2a3c85-9eb6-443b-951a-3f4330d03a10 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:02.857555 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ae2a3c85-9eb6-443b-951a-3f4330d03a10 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:02.858017 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ae2a3c85-9eb6-443b-951a-3f4330d03a10 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:02.858446 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ae2a3c85-9eb6-443b-951a-3f4330d03a10 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:02.918804 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-ae2a3c85-9eb6-443b-951a-3f4330d03a10 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] [instance: 829a4155-cf7c-470d-a127-c729e32747fe] Going to try to terminate instance {{(pid=138745) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 20:58:03.148379 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-ae2a3c85-9eb6-443b-951a-3f4330d03a10 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] 10.222.0.18 "DELETE /compute/v2.1/servers/829a4155-cf7c-470d-a127-c729e32747fe" status: 204 len: 0 microversion: 2.1 time: 0.320029 Oct 22 20:58:03.149921 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1118/2125] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 20:58:02 2022] DELETE /compute/v2.1/servers/829a4155-cf7c-470d-a127-c729e32747fe => generated 0 bytes in 324 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 20:58:03.166179 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-50e0bc12-c7ae-495e-a15e-cac5d3443bb2 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:58:03.167420 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-50e0bc12-c7ae-495e-a15e-cac5d3443bb2 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] [instance: 829a4155-cf7c-470d-a127-c729e32747fe] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:58:03.180721 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-50e0bc12-c7ae-495e-a15e-cac5d3443bb2 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:03.182448 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-50e0bc12-c7ae-495e-a15e-cac5d3443bb2 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:03.183522 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-50e0bc12-c7ae-495e-a15e-cac5d3443bb2 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:03.184949 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-50e0bc12-c7ae-495e-a15e-cac5d3443bb2 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:03.185630 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-50e0bc12-c7ae-495e-a15e-cac5d3443bb2 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:03.186532 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-50e0bc12-c7ae-495e-a15e-cac5d3443bb2 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:03.560454 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-fd313907-23c5-492f-98c8-d5dbf853a174 tempest-ServerPasswordTestJSON-1023240106 tempest-ServerPasswordTestJSON-1023240106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3466ea643c9142cfa0678d4cc277faab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9492cfb8c4487989bce6074736df04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:58:03.573555 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-fd313907-23c5-492f-98c8-d5dbf853a174 tempest-ServerPasswordTestJSON-1023240106 tempest-ServerPasswordTestJSON-1023240106-project] 10.222.0.18 "GET /compute/v2.1/servers/659e6aaf-82b7-4361-8289-970d6de4a7b7" status: 200 len: 1316 microversion: 2.1 time: 0.988284 Oct 22 20:58:03.588128 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1008/2126] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:58:02 2022] GET /compute/v2.1/servers/659e6aaf-82b7-4361-8289-970d6de4a7b7 => generated 1316 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:58:03.608689 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-014b4705-5bec-4db4-948b-28e3b0746551 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:58:03.612936 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-014b4705-5bec-4db4-948b-28e3b0746551 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] [instance: f070b144-3a1a-4456-8e5b-02af12557c6a] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:58:03.623155 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-014b4705-5bec-4db4-948b-28e3b0746551 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:03.627996 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-014b4705-5bec-4db4-948b-28e3b0746551 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:03.630524 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-014b4705-5bec-4db4-948b-28e3b0746551 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:03.656888 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-014b4705-5bec-4db4-948b-28e3b0746551 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:03.658069 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-014b4705-5bec-4db4-948b-28e3b0746551 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:03.660127 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-014b4705-5bec-4db4-948b-28e3b0746551 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:03.681421 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell0:SELECT=8 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:58:03.874482 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-50e0bc12-c7ae-495e-a15e-cac5d3443bb2 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d808e98f843dd9621822682c9d278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b58ab4af674c778b4819f177045651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:58:03.892189 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-50e0bc12-c7ae-495e-a15e-cac5d3443bb2 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] 10.222.0.18 "GET /compute/v2.1/servers/829a4155-cf7c-470d-a127-c729e32747fe" status: 200 len: 1465 microversion: 2.1 time: 0.737764 Oct 22 20:58:03.909929 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1119/2127] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:58:03 2022] GET /compute/v2.1/servers/829a4155-cf7c-470d-a127-c729e32747fe => generated 1465 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:58:03.915395 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-721a8293-a3cb-4f50-aaac-696c67993854 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:58:03.916176 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-721a8293-a3cb-4f50-aaac-696c67993854 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] [instance: aee36c9d-baf4-453c-b88f-31b8f23638c2] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:58:03.938174 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-721a8293-a3cb-4f50-aaac-696c67993854 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:03.939420 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-721a8293-a3cb-4f50-aaac-696c67993854 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:03.944779 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-721a8293-a3cb-4f50-aaac-696c67993854 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:03.945575 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-721a8293-a3cb-4f50-aaac-696c67993854 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:03.946060 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-721a8293-a3cb-4f50-aaac-696c67993854 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:03.946522 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-721a8293-a3cb-4f50-aaac-696c67993854 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:04.101820 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-014b4705-5bec-4db4-948b-28e3b0746551 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dbe89a7e11480194d3d86f82983499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8351b01e07cd43f9be973ab45e522bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:58:04.112136 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-014b4705-5bec-4db4-948b-28e3b0746551 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] 10.222.0.18 "GET /compute/v2.1/servers/f070b144-3a1a-4456-8e5b-02af12557c6a" status: 200 len: 1471 microversion: 2.1 time: 0.521290 Oct 22 20:58:04.112749 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1009/2128] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:58:03 2022] GET /compute/v2.1/servers/f070b144-3a1a-4456-8e5b-02af12557c6a => generated 1471 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:58:04.604362 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-505d33be-9338-4a4d-8212-bf92a6245fe0 tempest-ServerPasswordTestJSON-1023240106 tempest-ServerPasswordTestJSON-1023240106-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:58:04.605067 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-505d33be-9338-4a4d-8212-bf92a6245fe0 tempest-ServerPasswordTestJSON-1023240106 tempest-ServerPasswordTestJSON-1023240106-project] [instance: 659e6aaf-82b7-4361-8289-970d6de4a7b7] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:58:04.630789 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-505d33be-9338-4a4d-8212-bf92a6245fe0 tempest-ServerPasswordTestJSON-1023240106 tempest-ServerPasswordTestJSON-1023240106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:04.631775 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-505d33be-9338-4a4d-8212-bf92a6245fe0 tempest-ServerPasswordTestJSON-1023240106 tempest-ServerPasswordTestJSON-1023240106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:04.648478 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-505d33be-9338-4a4d-8212-bf92a6245fe0 tempest-ServerPasswordTestJSON-1023240106 tempest-ServerPasswordTestJSON-1023240106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:04.652671 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-505d33be-9338-4a4d-8212-bf92a6245fe0 tempest-ServerPasswordTestJSON-1023240106 tempest-ServerPasswordTestJSON-1023240106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:04.653932 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-505d33be-9338-4a4d-8212-bf92a6245fe0 tempest-ServerPasswordTestJSON-1023240106 tempest-ServerPasswordTestJSON-1023240106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:04.655053 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-505d33be-9338-4a4d-8212-bf92a6245fe0 tempest-ServerPasswordTestJSON-1023240106 tempest-ServerPasswordTestJSON-1023240106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:05.109628 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-721a8293-a3cb-4f50-aaac-696c67993854 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d3d7458af447bdb3f03e83a2d8559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49238b8686d24ae698679e4a1957735d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:58:05.119232 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-721a8293-a3cb-4f50-aaac-696c67993854 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] 10.222.0.18 "GET /compute/v2.1/servers/aee36c9d-baf4-453c-b88f-31b8f23638c2" status: 200 len: 1469 microversion: 2.1 time: 1.223761 Oct 22 20:58:05.123025 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1120/2129] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:58:03 2022] GET /compute/v2.1/servers/aee36c9d-baf4-453c-b88f-31b8f23638c2 => generated 1469 bytes in 1228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:58:05.137237 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-37811ba6-22a5-4ce6-810c-36528e1dffa3 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:58:05.146951 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-37811ba6-22a5-4ce6-810c-36528e1dffa3 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] [instance: 829a4155-cf7c-470d-a127-c729e32747fe] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:58:05.164157 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-37811ba6-22a5-4ce6-810c-36528e1dffa3 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:05.164887 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-37811ba6-22a5-4ce6-810c-36528e1dffa3 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:05.165497 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-37811ba6-22a5-4ce6-810c-36528e1dffa3 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:05.166388 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-37811ba6-22a5-4ce6-810c-36528e1dffa3 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:05.167027 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-37811ba6-22a5-4ce6-810c-36528e1dffa3 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:05.172081 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-37811ba6-22a5-4ce6-810c-36528e1dffa3 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:06.009163 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-505d33be-9338-4a4d-8212-bf92a6245fe0 tempest-ServerPasswordTestJSON-1023240106 tempest-ServerPasswordTestJSON-1023240106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3466ea643c9142cfa0678d4cc277faab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9492cfb8c4487989bce6074736df04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:58:06.027930 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-505d33be-9338-4a4d-8212-bf92a6245fe0 tempest-ServerPasswordTestJSON-1023240106 tempest-ServerPasswordTestJSON-1023240106-project] 10.222.0.18 "GET /compute/v2.1/servers/659e6aaf-82b7-4361-8289-970d6de4a7b7" status: 200 len: 1316 microversion: 2.1 time: 1.429003 Oct 22 20:58:06.033597 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1010/2130] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:58:04 2022] GET /compute/v2.1/servers/659e6aaf-82b7-4361-8289-970d6de4a7b7 => generated 1316 bytes in 1435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:58:06.050331 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-853128a0-195a-4732-b9f3-106a0a6191ac tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:58:06.051723 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-853128a0-195a-4732-b9f3-106a0a6191ac tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] [instance: f070b144-3a1a-4456-8e5b-02af12557c6a] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:58:06.079325 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-853128a0-195a-4732-b9f3-106a0a6191ac tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:06.080281 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-853128a0-195a-4732-b9f3-106a0a6191ac tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:06.081235 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-853128a0-195a-4732-b9f3-106a0a6191ac tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:06.087318 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-853128a0-195a-4732-b9f3-106a0a6191ac tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:06.096346 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-853128a0-195a-4732-b9f3-106a0a6191ac tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:06.097193 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-853128a0-195a-4732-b9f3-106a0a6191ac tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:06.212800 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-37811ba6-22a5-4ce6-810c-36528e1dffa3 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d808e98f843dd9621822682c9d278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b58ab4af674c778b4819f177045651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:58:06.235672 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-37811ba6-22a5-4ce6-810c-36528e1dffa3 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] 10.222.0.18 "GET /compute/v2.1/servers/829a4155-cf7c-470d-a127-c729e32747fe" status: 200 len: 1465 microversion: 2.1 time: 1.105659 Oct 22 20:58:06.236352 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1121/2131] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:58:05 2022] GET /compute/v2.1/servers/829a4155-cf7c-470d-a127-c729e32747fe => generated 1465 bytes in 1113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:58:06.270984 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-5f8f42f4-ad78-44cb-b391-2f31b71d3e87 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:58:06.278038 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-5f8f42f4-ad78-44cb-b391-2f31b71d3e87 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] [instance: aee36c9d-baf4-453c-b88f-31b8f23638c2] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:58:06.305492 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5f8f42f4-ad78-44cb-b391-2f31b71d3e87 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:06.310250 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5f8f42f4-ad78-44cb-b391-2f31b71d3e87 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:06.311836 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5f8f42f4-ad78-44cb-b391-2f31b71d3e87 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:06.318136 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5f8f42f4-ad78-44cb-b391-2f31b71d3e87 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:06.318267 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5f8f42f4-ad78-44cb-b391-2f31b71d3e87 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:06.318732 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5f8f42f4-ad78-44cb-b391-2f31b71d3e87 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:07.556937 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-5f8f42f4-ad78-44cb-b391-2f31b71d3e87 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d3d7458af447bdb3f03e83a2d8559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49238b8686d24ae698679e4a1957735d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:58:07.568312 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-5f8f42f4-ad78-44cb-b391-2f31b71d3e87 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] 10.222.0.18 "GET /compute/v2.1/servers/aee36c9d-baf4-453c-b88f-31b8f23638c2" status: 200 len: 1469 microversion: 2.1 time: 1.316318 Oct 22 20:58:07.573696 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1122/2132] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:58:06 2022] GET /compute/v2.1/servers/aee36c9d-baf4-453c-b88f-31b8f23638c2 => generated 1469 bytes in 1337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:58:07.584806 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-6e891b51-b9cf-4a4c-b1af-1419880b9fd3 tempest-ServerPasswordTestJSON-1023240106 tempest-ServerPasswordTestJSON-1023240106-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:58:07.588141 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-6e891b51-b9cf-4a4c-b1af-1419880b9fd3 tempest-ServerPasswordTestJSON-1023240106 tempest-ServerPasswordTestJSON-1023240106-project] [instance: 659e6aaf-82b7-4361-8289-970d6de4a7b7] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:58:07.601720 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:UPDATE=3 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:58:07.618252 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6e891b51-b9cf-4a4c-b1af-1419880b9fd3 tempest-ServerPasswordTestJSON-1023240106 tempest-ServerPasswordTestJSON-1023240106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:07.624867 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6e891b51-b9cf-4a4c-b1af-1419880b9fd3 tempest-ServerPasswordTestJSON-1023240106 tempest-ServerPasswordTestJSON-1023240106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:07.625769 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6e891b51-b9cf-4a4c-b1af-1419880b9fd3 tempest-ServerPasswordTestJSON-1023240106 tempest-ServerPasswordTestJSON-1023240106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:07.628669 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6e891b51-b9cf-4a4c-b1af-1419880b9fd3 tempest-ServerPasswordTestJSON-1023240106 tempest-ServerPasswordTestJSON-1023240106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:07.664676 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6e891b51-b9cf-4a4c-b1af-1419880b9fd3 tempest-ServerPasswordTestJSON-1023240106 tempest-ServerPasswordTestJSON-1023240106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:07.667172 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6e891b51-b9cf-4a4c-b1af-1419880b9fd3 tempest-ServerPasswordTestJSON-1023240106 tempest-ServerPasswordTestJSON-1023240106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.033s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:08.041129 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-853128a0-195a-4732-b9f3-106a0a6191ac tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dbe89a7e11480194d3d86f82983499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8351b01e07cd43f9be973ab45e522bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:58:08.056879 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-853128a0-195a-4732-b9f3-106a0a6191ac tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] 10.222.0.18 "GET /compute/v2.1/servers/f070b144-3a1a-4456-8e5b-02af12557c6a" status: 200 len: 1471 microversion: 2.1 time: 2.021072 Oct 22 20:58:08.075615 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1011/2133] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:58:06 2022] GET /compute/v2.1/servers/f070b144-3a1a-4456-8e5b-02af12557c6a => generated 1471 bytes in 2040 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:58:08.085774 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-05bcbe14-bdaa-4dd5-afd7-ea555445b2fe tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:58:08.086467 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-05bcbe14-bdaa-4dd5-afd7-ea555445b2fe tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] [instance: 829a4155-cf7c-470d-a127-c729e32747fe] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:58:08.098265 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-05bcbe14-bdaa-4dd5-afd7-ea555445b2fe tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:08.098820 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-05bcbe14-bdaa-4dd5-afd7-ea555445b2fe tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:08.099275 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-05bcbe14-bdaa-4dd5-afd7-ea555445b2fe tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:08.100124 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-05bcbe14-bdaa-4dd5-afd7-ea555445b2fe tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:08.100588 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-05bcbe14-bdaa-4dd5-afd7-ea555445b2fe tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:08.101418 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-05bcbe14-bdaa-4dd5-afd7-ea555445b2fe tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:08.276033 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-6e891b51-b9cf-4a4c-b1af-1419880b9fd3 tempest-ServerPasswordTestJSON-1023240106 tempest-ServerPasswordTestJSON-1023240106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3466ea643c9142cfa0678d4cc277faab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9492cfb8c4487989bce6074736df04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:58:08.286065 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-6e891b51-b9cf-4a4c-b1af-1419880b9fd3 tempest-ServerPasswordTestJSON-1023240106 tempest-ServerPasswordTestJSON-1023240106-project] 10.222.0.18 "GET /compute/v2.1/servers/659e6aaf-82b7-4361-8289-970d6de4a7b7" status: 200 len: 1316 microversion: 2.1 time: 0.711019 Oct 22 20:58:08.286657 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1123/2134] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:58:07 2022] GET /compute/v2.1/servers/659e6aaf-82b7-4361-8289-970d6de4a7b7 => generated 1316 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:58:08.303399 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-dccb0fc9-6565-4798-bf8e-1b4bc7d244cc req-4072fa1d-26d9-4453-a263-9adc4519c93d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "829a4155-cf7c-470d-a127-c729e32747fe", "name": "network-vif-unplugged", "status": "completed", "tag": "5057fe59-3905-4c87-83f6-a39a4b64f2fe"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:58:08.314435 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-dccb0fc9-6565-4798-bf8e-1b4bc7d244cc req-4072fa1d-26d9-4453-a263-9adc4519c93d service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:08.315096 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-dccb0fc9-6565-4798-bf8e-1b4bc7d244cc req-4072fa1d-26d9-4453-a263-9adc4519c93d service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:08.315742 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-dccb0fc9-6565-4798-bf8e-1b4bc7d244cc req-4072fa1d-26d9-4453-a263-9adc4519c93d service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:08.339670 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-dccb0fc9-6565-4798-bf8e-1b4bc7d244cc req-4072fa1d-26d9-4453-a263-9adc4519c93d service nova] Creating event network-vif-unplugged:5057fe59-3905-4c87-83f6-a39a4b64f2fe for instance 829a4155-cf7c-470d-a127-c729e32747fe on nch2-master-1 Oct 22 20:58:08.354392 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-dccb0fc9-6565-4798-bf8e-1b4bc7d244cc req-4072fa1d-26d9-4453-a263-9adc4519c93d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.061599 Oct 22 20:58:08.355375 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1124/2135] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:58:08 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:58:08.618327 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-81865ebe-1f3c-4d91-84fc-4943134a4e5d tempest-ListImageFiltersNegativeTestJSON-1857764919 tempest-ListImageFiltersNegativeTestJSON-1857764919-project] Calling method '.version_select at 0x7fd39fda5f70>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:58:08.648053 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-05bcbe14-bdaa-4dd5-afd7-ea555445b2fe tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d808e98f843dd9621822682c9d278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b58ab4af674c778b4819f177045651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:58:08.650291 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.wsgi [None req-81865ebe-1f3c-4d91-84fc-4943134a4e5d tempest-ListImageFiltersNegativeTestJSON-1857764919 tempest-ListImageFiltersNegativeTestJSON-1857764919-project] HTTP exception thrown: Image not found. Oct 22 20:58:08.652780 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-81865ebe-1f3c-4d91-84fc-4943134a4e5d tempest-ListImageFiltersNegativeTestJSON-1857764919 tempest-ListImageFiltersNegativeTestJSON-1857764919-project] Request method failure captured: Oct 22 20:58:08.652780 ncdv-master-1 devstack@n-api.service[138745]: request: GET /compute/v2.1/images/b3faf4f0-08a9-4c64-ad66-93c6b75db697 HTTP/1.1 Oct 22 20:58:08.652780 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 20:58:08.652780 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 20:58:08.652780 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 20:58:08.652780 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 0 Oct 22 20:58:08.652780 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 20:58:08.652780 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 20:58:08.652780 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 20:58:08.652780 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 20:58:08.652780 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVFlfa-WbdAc_AYAFMY3uAfHCdmFZV3ZTR7c6tAbE3Pm137Ut9mkvmexGQOsQ9J7IBJ5Wy8rxVMCAol-a-iqPxAfQ5v1xAvqRdiWyrIUeDZkM1U2OFIAj07Esf0JEV8UQR2LlxqXeSdBxQh0VCtqoz_CBNnqU7gd9W2T5yhzNbRGls0A Oct 22 20:58:08.652780 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 20:58:08.652780 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 20:58:08.652780 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 20:58:08.652780 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 20:58:08.652780 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 20:58:08.652780 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 20:58:08.652780 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: 0296c31c791944fda540e09f48a0ddf7 Oct 22 20:58:08.652780 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-ListImageFiltersNegativeTestJSON-1857764919 Oct 22 20:58:08.652780 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 20:58:08.652780 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 20:58:08.652780 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_0296c31c791944fda540e09f48a0ddf7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0296c31c791944fda540e09f48a0ddf7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/0296c31c791944fda540e09f48a0ddf7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0296c31c791944fda540e09f48a0ddf7"}]}] Oct 22 20:58:08.652780 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-ListImageFiltersNegativeTestJSON-1857764919 Oct 22 20:58:08.652780 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: 0296c31c791944fda540e09f48a0ddf7 Oct 22 20:58:08.652780 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-ListImageFiltersNegativeTestJSON-1857764919 Oct 22 20:58:08.652780 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-ListImageFiltersNegativeTestJSON-1857764919-project Oct 22 20:58:08.652780 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 20:58:08.652780 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 20:58:08.652780 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: ed00e637e3f74c82a10e8e28f3c0600b Oct 22 20:58:08.652780 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-ListImageFiltersNegativeTestJSON-1857764919-project Oct 22 20:58:08.652780 ncdv-master-1 devstack@n-api.service[138745]: method: Oct 22 20:58:08.652780 ncdv-master-1 devstack@n-api.service[138745]: exception: Image not found. Oct 22 20:58:08.652780 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'id': 'b3faf4f0-08a9-4c64-ad66-93c6b75db697'} Oct 22 20:58:08.652780 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:58:08.652780 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:58:08.652780 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 22 20:58:08.652780 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 22 20:58:08.652780 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 22 20:58:08.652780 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 22 20:58:08.652780 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 22 20:58:08.652780 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 22 20:58:08.652780 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 22 20:58:08.652780 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 22 20:58:08.652780 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 22 20:58:08.652780 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 22 20:58:08.652780 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 22 20:58:08.652780 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 22 20:58:08.652780 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 22 20:58:08.652780 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 22 20:58:08.652780 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 22 20:58:08.652780 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 22 20:58:08.652780 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID b3faf4f0-08a9-4c64-ad66-93c6b75db697 Oct 22 20:58:08.652780 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:58:08.652780 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:58:08.652780 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:58:08.652780 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:58:08.652780 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 22 20:58:08.652780 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 22 20:58:08.652780 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 22 20:58:08.652780 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 22 20:58:08.652780 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 22 20:58:08.652780 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 22 20:58:08.652780 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 22 20:58:08.656948 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 22 20:58:08.656948 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 22 20:58:08.656948 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 22 20:58:08.656948 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 22 20:58:08.656948 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 22 20:58:08.656948 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 22 20:58:08.656948 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 22 20:58:08.656948 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 22 20:58:08.656948 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 22 20:58:08.656948 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 22 20:58:08.656948 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 22 20:58:08.656948 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 22 20:58:08.656948 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 22 20:58:08.656948 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 22 20:58:08.656948 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 22 20:58:08.656948 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 22 20:58:08.656948 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 22 20:58:08.656948 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image b3faf4f0-08a9-4c64-ad66-93c6b75db697 could not be found. Oct 22 20:58:08.656948 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:58:08.656948 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:58:08.656948 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:58:08.656948 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:58:08.656948 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:58:08.656948 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:58:08.656948 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:58:08.656948 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:58:08.656948 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 22 20:58:08.656948 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 22 20:58:08.656948 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:58:08.656948 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:58:08.656948 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 22 20:58:08.656948 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 22 20:58:08.656948 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 22 20:58:08.656948 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:58:08.656948 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:58:08.656948 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:58:08.656948 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:58:08.656948 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:58:08.656948 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:58:08.656948 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 20:58:08.656948 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 20:58:08.656948 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 22 20:58:08.656948 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:58:08.656948 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-81865ebe-1f3c-4d91-84fc-4943134a4e5d tempest-ListImageFiltersNegativeTestJSON-1857764919 tempest-ListImageFiltersNegativeTestJSON-1857764919-project] Returning 404 to user: Image not found. {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:58:08.656948 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-81865ebe-1f3c-4d91-84fc-4943134a4e5d tempest-ListImageFiltersNegativeTestJSON-1857764919 tempest-ListImageFiltersNegativeTestJSON-1857764919-project] 10.222.0.18 "GET /compute/v2.1/images/b3faf4f0-08a9-4c64-ad66-93c6b75db697" status: 404 len: 62 microversion: 2.1 time: 0.297453 Oct 22 20:58:08.656948 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1125/2136] 10.222.0.18 () {58 vars in 1233 bytes} [Sat Oct 22 20:58:08 2022] GET /compute/v2.1/images/b3faf4f0-08a9-4c64-ad66-93c6b75db697 => generated 62 bytes in 299 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 22 20:58:08.668877 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-05bcbe14-bdaa-4dd5-afd7-ea555445b2fe tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] 10.222.0.18 "GET /compute/v2.1/servers/829a4155-cf7c-470d-a127-c729e32747fe" status: 200 len: 1465 microversion: 2.1 time: 0.590646 Oct 22 20:58:08.669754 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1012/2137] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:58:08 2022] GET /compute/v2.1/servers/829a4155-cf7c-470d-a127-c729e32747fe => generated 1465 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:58:08.675306 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-e117103a-e319-46d8-934f-21d31e3d5f72 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:58:08.680475 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-e117103a-e319-46d8-934f-21d31e3d5f72 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] [instance: aee36c9d-baf4-453c-b88f-31b8f23638c2] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:58:08.693658 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e117103a-e319-46d8-934f-21d31e3d5f72 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:08.696012 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e117103a-e319-46d8-934f-21d31e3d5f72 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:08.696542 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e117103a-e319-46d8-934f-21d31e3d5f72 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:08.697352 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e117103a-e319-46d8-934f-21d31e3d5f72 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:08.698074 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e117103a-e319-46d8-934f-21d31e3d5f72 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:08.698607 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e117103a-e319-46d8-934f-21d31e3d5f72 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:08.763996 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-5178ecee-fcbe-4038-a202-b641c0eb9956 tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] Action: 'create', calling method: .version_select at 0x7fd39fc94790>, body: {"keypair": {"name": "tempest-keypair-1358369103", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKWUHJq2DgmR8rhyggfHsAvR5Beu+eVyBuMj4uyNI3wi7vIJ4NU+a1mR2oT6WohyggdtxD5sTjqhCe6byaY7XoGfpiFA6/h6/DpK5EKb7XG5Oi2z8+ML96OaMxqpHBb8BQ=="}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:58:08.784070 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-5178ecee-fcbe-4038-a202-b641c0eb9956 tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] Getting quotas for project 5af194191cdc4b34a470c821a932e2fd. Resources: {'key_pairs'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 20:58:08.790435 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-5178ecee-fcbe-4038-a202-b641c0eb9956 tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] Getting quotas for user 5bb8017457354ed68be65cb426965cb2 and project 5af194191cdc4b34a470c821a932e2fd. Resources: {'key_pairs'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 20:58:08.836653 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-5178ecee-fcbe-4038-a202-b641c0eb9956 tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.179525 Oct 22 20:58:08.848399 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1126/2138] 10.222.0.18 () {60 vars in 1159 bytes} [Sat Oct 22 20:58:08 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:58:08.869556 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-554cfda9-d682-4b03-ac4c-4305c68792ad req-e437604d-e948-4f01-b631-087ad7639a63 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "829a4155-cf7c-470d-a127-c729e32747fe", "name": "network-vif-deleted", "tag": "5057fe59-3905-4c87-83f6-a39a4b64f2fe"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:58:08.899135 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-554cfda9-d682-4b03-ac4c-4305c68792ad req-e437604d-e948-4f01-b631-087ad7639a63 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:08.900971 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-554cfda9-d682-4b03-ac4c-4305c68792ad req-e437604d-e948-4f01-b631-087ad7639a63 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:08.903374 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-554cfda9-d682-4b03-ac4c-4305c68792ad req-e437604d-e948-4f01-b631-087ad7639a63 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:08.933721 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-554cfda9-d682-4b03-ac4c-4305c68792ad req-e437604d-e948-4f01-b631-087ad7639a63 service nova] Creating event network-vif-deleted:5057fe59-3905-4c87-83f6-a39a4b64f2fe for instance 829a4155-cf7c-470d-a127-c729e32747fe on nch2-master-1 Oct 22 20:58:08.945441 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-554cfda9-d682-4b03-ac4c-4305c68792ad req-e437604d-e948-4f01-b631-087ad7639a63 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091017 Oct 22 20:58:08.949145 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1127/2139] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:58:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:58:09.083021 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-1aa5f79d-9a5a-4845-9aca-bda4c06c9e70 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:58:09.083985 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-1aa5f79d-9a5a-4845-9aca-bda4c06c9e70 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] [instance: f070b144-3a1a-4456-8e5b-02af12557c6a] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:58:09.097995 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1aa5f79d-9a5a-4845-9aca-bda4c06c9e70 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:09.098742 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1aa5f79d-9a5a-4845-9aca-bda4c06c9e70 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:09.100307 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1aa5f79d-9a5a-4845-9aca-bda4c06c9e70 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:09.103227 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1aa5f79d-9a5a-4845-9aca-bda4c06c9e70 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:09.103893 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1aa5f79d-9a5a-4845-9aca-bda4c06c9e70 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:09.106959 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1aa5f79d-9a5a-4845-9aca-bda4c06c9e70 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:09.109789 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-e117103a-e319-46d8-934f-21d31e3d5f72 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d3d7458af447bdb3f03e83a2d8559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49238b8686d24ae698679e4a1957735d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:58:09.113910 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell1:INSERT=3,nova_cell1:SELECT=92,nova_cell1:UPDATE=5 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:58:09.126563 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-e117103a-e319-46d8-934f-21d31e3d5f72 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] 10.222.0.18 "GET /compute/v2.1/servers/aee36c9d-baf4-453c-b88f-31b8f23638c2" status: 200 len: 1469 microversion: 2.1 time: 0.455535 Oct 22 20:58:09.132601 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1013/2140] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:58:08 2022] GET /compute/v2.1/servers/aee36c9d-baf4-453c-b88f-31b8f23638c2 => generated 1469 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:58:09.311471 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-ca178edc-2915-4396-b096-b991f46f33a0 tempest-ServerPasswordTestJSON-1023240106 tempest-ServerPasswordTestJSON-1023240106-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:58:09.312160 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-ca178edc-2915-4396-b096-b991f46f33a0 tempest-ServerPasswordTestJSON-1023240106 tempest-ServerPasswordTestJSON-1023240106-project] [instance: 659e6aaf-82b7-4361-8289-970d6de4a7b7] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:58:09.327207 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_api:SELECT=98,nova_api:DELETE=2 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:58:09.330690 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ca178edc-2915-4396-b096-b991f46f33a0 tempest-ServerPasswordTestJSON-1023240106 tempest-ServerPasswordTestJSON-1023240106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:09.331189 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ca178edc-2915-4396-b096-b991f46f33a0 tempest-ServerPasswordTestJSON-1023240106 tempest-ServerPasswordTestJSON-1023240106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:09.338576 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ca178edc-2915-4396-b096-b991f46f33a0 tempest-ServerPasswordTestJSON-1023240106 tempest-ServerPasswordTestJSON-1023240106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:09.339399 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ca178edc-2915-4396-b096-b991f46f33a0 tempest-ServerPasswordTestJSON-1023240106 tempest-ServerPasswordTestJSON-1023240106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:09.339840 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ca178edc-2915-4396-b096-b991f46f33a0 tempest-ServerPasswordTestJSON-1023240106 tempest-ServerPasswordTestJSON-1023240106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:09.342094 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ca178edc-2915-4396-b096-b991f46f33a0 tempest-ServerPasswordTestJSON-1023240106 tempest-ServerPasswordTestJSON-1023240106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:09.602344 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-1aa5f79d-9a5a-4845-9aca-bda4c06c9e70 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dbe89a7e11480194d3d86f82983499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8351b01e07cd43f9be973ab45e522bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:58:09.617483 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-1aa5f79d-9a5a-4845-9aca-bda4c06c9e70 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] 10.222.0.18 "GET /compute/v2.1/servers/f070b144-3a1a-4456-8e5b-02af12557c6a" status: 200 len: 1471 microversion: 2.1 time: 0.538173 Oct 22 20:58:09.624508 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1128/2141] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:58:09 2022] GET /compute/v2.1/servers/f070b144-3a1a-4456-8e5b-02af12557c6a => generated 1471 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 20:58:09.696685 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-6f4fe138-b0ed-4b4d-9c32-40c0254f3f7f tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:58:09.698256 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-6f4fe138-b0ed-4b4d-9c32-40c0254f3f7f tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] [instance: 829a4155-cf7c-470d-a127-c729e32747fe] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:58:09.714612 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-ca178edc-2915-4396-b096-b991f46f33a0 tempest-ServerPasswordTestJSON-1023240106 tempest-ServerPasswordTestJSON-1023240106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3466ea643c9142cfa0678d4cc277faab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9492cfb8c4487989bce6074736df04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:58:09.733370 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-ca178edc-2915-4396-b096-b991f46f33a0 tempest-ServerPasswordTestJSON-1023240106 tempest-ServerPasswordTestJSON-1023240106-project] 10.222.0.18 "GET /compute/v2.1/servers/659e6aaf-82b7-4361-8289-970d6de4a7b7" status: 200 len: 1316 microversion: 2.1 time: 0.426409 Oct 22 20:58:09.733585 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6f4fe138-b0ed-4b4d-9c32-40c0254f3f7f tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:09.734671 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1014/2142] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:58:09 2022] GET /compute/v2.1/servers/659e6aaf-82b7-4361-8289-970d6de4a7b7 => generated 1316 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 20:58:09.755915 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6f4fe138-b0ed-4b4d-9c32-40c0254f3f7f tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:09.756377 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6f4fe138-b0ed-4b4d-9c32-40c0254f3f7f tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:09.763669 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6f4fe138-b0ed-4b4d-9c32-40c0254f3f7f tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:09.764203 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6f4fe138-b0ed-4b4d-9c32-40c0254f3f7f tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:09.778770 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6f4fe138-b0ed-4b4d-9c32-40c0254f3f7f tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:09.862234 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6f4fe138-b0ed-4b4d-9c32-40c0254f3f7f tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:09.862923 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6f4fe138-b0ed-4b4d-9c32-40c0254f3f7f tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:09.881269 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6f4fe138-b0ed-4b4d-9c32-40c0254f3f7f tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:09.881913 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.objects.instance [None req-6f4fe138-b0ed-4b4d-9c32-40c0254f3f7f tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Lazy-loading 'fault' on Instance uuid 829a4155-cf7c-470d-a127-c729e32747fe {{(pid=138745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 20:58:10.080410 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-6f4fe138-b0ed-4b4d-9c32-40c0254f3f7f tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d808e98f843dd9621822682c9d278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b58ab4af674c778b4819f177045651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:58:10.098774 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-6f4fe138-b0ed-4b4d-9c32-40c0254f3f7f tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] 10.222.0.18 "GET /compute/v2.1/servers/829a4155-cf7c-470d-a127-c729e32747fe" status: 200 len: 1308 microversion: 2.1 time: 0.405959 Oct 22 20:58:10.105288 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1129/2143] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:58:09 2022] GET /compute/v2.1/servers/829a4155-cf7c-470d-a127-c729e32747fe => generated 1308 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 20:58:10.154338 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-4686704f-8950-4668-b838-452c91fd8fa1 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:58:10.154986 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-4686704f-8950-4668-b838-452c91fd8fa1 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] [instance: aee36c9d-baf4-453c-b88f-31b8f23638c2] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:58:10.163198 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4686704f-8950-4668-b838-452c91fd8fa1 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:10.171598 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4686704f-8950-4668-b838-452c91fd8fa1 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:10.172349 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4686704f-8950-4668-b838-452c91fd8fa1 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:10.173525 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4686704f-8950-4668-b838-452c91fd8fa1 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:10.175932 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4686704f-8950-4668-b838-452c91fd8fa1 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:10.176548 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4686704f-8950-4668-b838-452c91fd8fa1 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:10.464791 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-42f60e9c-14a2-4405-9f38-805bbc7a372b req-0aed75a7-71f1-4da3-b83f-98a0fb2be177 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "659e6aaf-82b7-4361-8289-970d6de4a7b7", "name": "network-vif-plugged", "status": "completed", "tag": "c000a86e-3b85-400e-bac9-43e74449f4c7"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:58:10.483854 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-42f60e9c-14a2-4405-9f38-805bbc7a372b req-0aed75a7-71f1-4da3-b83f-98a0fb2be177 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:10.484370 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-42f60e9c-14a2-4405-9f38-805bbc7a372b req-0aed75a7-71f1-4da3-b83f-98a0fb2be177 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:10.485219 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-42f60e9c-14a2-4405-9f38-805bbc7a372b req-0aed75a7-71f1-4da3-b83f-98a0fb2be177 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:10.511603 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-42f60e9c-14a2-4405-9f38-805bbc7a372b req-0aed75a7-71f1-4da3-b83f-98a0fb2be177 service nova] Creating event network-vif-plugged:c000a86e-3b85-400e-bac9-43e74449f4c7 for instance 659e6aaf-82b7-4361-8289-970d6de4a7b7 on nch1-master-1 Oct 22 20:58:10.538287 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-42f60e9c-14a2-4405-9f38-805bbc7a372b req-0aed75a7-71f1-4da3-b83f-98a0fb2be177 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078334 Oct 22 20:58:10.540376 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1130/2144] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:58:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 20:58:10.652293 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-830f1498-0183-4919-9ce6-e4d43a07c0b2 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:58:10.653017 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-830f1498-0183-4919-9ce6-e4d43a07c0b2 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] [instance: f070b144-3a1a-4456-8e5b-02af12557c6a] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:58:10.675376 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-830f1498-0183-4919-9ce6-e4d43a07c0b2 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:10.678142 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-830f1498-0183-4919-9ce6-e4d43a07c0b2 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:10.678622 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-830f1498-0183-4919-9ce6-e4d43a07c0b2 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:10.679418 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-830f1498-0183-4919-9ce6-e4d43a07c0b2 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:10.685954 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-830f1498-0183-4919-9ce6-e4d43a07c0b2 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:10.686986 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-830f1498-0183-4919-9ce6-e4d43a07c0b2 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:11.094007 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-4686704f-8950-4668-b838-452c91fd8fa1 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d3d7458af447bdb3f03e83a2d8559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49238b8686d24ae698679e4a1957735d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:58:11.104321 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-4686704f-8950-4668-b838-452c91fd8fa1 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] 10.222.0.18 "GET /compute/v2.1/servers/aee36c9d-baf4-453c-b88f-31b8f23638c2" status: 200 len: 1535 microversion: 2.1 time: 0.954341 Oct 22 20:58:11.116262 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1015/2145] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:58:10 2022] GET /compute/v2.1/servers/aee36c9d-baf4-453c-b88f-31b8f23638c2 => generated 1535 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:58:11.128549 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-6273e870-4688-43d7-9253-670b2546a59f tempest-ServerPasswordTestJSON-1023240106 tempest-ServerPasswordTestJSON-1023240106-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:58:11.129788 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-6273e870-4688-43d7-9253-670b2546a59f tempest-ServerPasswordTestJSON-1023240106 tempest-ServerPasswordTestJSON-1023240106-project] [instance: 659e6aaf-82b7-4361-8289-970d6de4a7b7] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:58:11.145013 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6273e870-4688-43d7-9253-670b2546a59f tempest-ServerPasswordTestJSON-1023240106 tempest-ServerPasswordTestJSON-1023240106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:11.145949 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6273e870-4688-43d7-9253-670b2546a59f tempest-ServerPasswordTestJSON-1023240106 tempest-ServerPasswordTestJSON-1023240106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:11.150474 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6273e870-4688-43d7-9253-670b2546a59f tempest-ServerPasswordTestJSON-1023240106 tempest-ServerPasswordTestJSON-1023240106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:11.153111 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6273e870-4688-43d7-9253-670b2546a59f tempest-ServerPasswordTestJSON-1023240106 tempest-ServerPasswordTestJSON-1023240106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:11.153743 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6273e870-4688-43d7-9253-670b2546a59f tempest-ServerPasswordTestJSON-1023240106 tempest-ServerPasswordTestJSON-1023240106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:11.155983 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6273e870-4688-43d7-9253-670b2546a59f tempest-ServerPasswordTestJSON-1023240106 tempest-ServerPasswordTestJSON-1023240106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:11.163096 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell0:SELECT=11 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:58:11.368680 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-830f1498-0183-4919-9ce6-e4d43a07c0b2 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dbe89a7e11480194d3d86f82983499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8351b01e07cd43f9be973ab45e522bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:58:11.381512 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-830f1498-0183-4919-9ce6-e4d43a07c0b2 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] 10.222.0.18 "GET /compute/v2.1/servers/f070b144-3a1a-4456-8e5b-02af12557c6a" status: 200 len: 1471 microversion: 2.1 time: 0.733718 Oct 22 20:58:11.383719 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1131/2146] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:58:10 2022] GET /compute/v2.1/servers/f070b144-3a1a-4456-8e5b-02af12557c6a => generated 1471 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:58:11.388582 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-aaaed929-7c99-4e43-a500-8f1169a39085 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:58:11.400737 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-aaaed929-7c99-4e43-a500-8f1169a39085 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] [instance: 829a4155-cf7c-470d-a127-c729e32747fe] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:58:11.407481 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-aaaed929-7c99-4e43-a500-8f1169a39085 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:11.411183 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-aaaed929-7c99-4e43-a500-8f1169a39085 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:11.411700 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-aaaed929-7c99-4e43-a500-8f1169a39085 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:11.412419 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-aaaed929-7c99-4e43-a500-8f1169a39085 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:11.412878 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-aaaed929-7c99-4e43-a500-8f1169a39085 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:11.413310 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-aaaed929-7c99-4e43-a500-8f1169a39085 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:11.436944 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.wsgi [None req-aaaed929-7c99-4e43-a500-8f1169a39085 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] HTTP exception thrown: Instance 829a4155-cf7c-470d-a127-c729e32747fe could not be found. Oct 22 20:58:11.438890 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-aaaed929-7c99-4e43-a500-8f1169a39085 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Request method failure captured: Oct 22 20:58:11.438890 ncdv-master-1 devstack@n-api.service[138745]: request: GET /compute/v2.1/servers/829a4155-cf7c-470d-a127-c729e32747fe HTTP/1.1 Oct 22 20:58:11.438890 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 20:58:11.438890 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 20:58:11.438890 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 20:58:11.438890 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 0 Oct 22 20:58:11.438890 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 20:58:11.438890 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 20:58:11.438890 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 20:58:11.438890 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 20:58:11.438890 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVFkXUdrwDaJLKZCaitdq-vFy5ZeDp_TSY_IlBHRRrpu9k61FtGoEan0qOWELXC5fscRnSCCpJGmnhxbXpaQn9Lj9KJtAlpISMSh5zj-GCQxOFMoXNHq57C9xUeVdlD7VbwmQlyoxuJwil15St3n33CesU2i_7Q5WugvD4vsQm-_JV9A Oct 22 20:58:11.438890 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 20:58:11.438890 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 20:58:11.438890 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 20:58:11.438890 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 20:58:11.438890 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 20:58:11.438890 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 20:58:11.438890 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: a8b58ab4af674c778b4819f177045651 Oct 22 20:58:11.438890 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-LiveMigrationNegativeTest-1482658301 Oct 22 20:58:11.438890 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 20:58:11.438890 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 20:58:11.438890 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_a8b58ab4af674c778b4819f177045651"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a8b58ab4af674c778b4819f177045651"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/a8b58ab4af674c778b4819f177045651"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a8b58ab4af674c778b4819f177045651"}]}] Oct 22 20:58:11.438890 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-LiveMigrationNegativeTest-1482658301 Oct 22 20:58:11.438890 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: a8b58ab4af674c778b4819f177045651 Oct 22 20:58:11.438890 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1482658301 Oct 22 20:58:11.438890 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-LiveMigrationNegativeTest-1482658301-project Oct 22 20:58:11.438890 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 20:58:11.438890 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 20:58:11.438890 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: 0d0d808e98f843dd9621822682c9d278 Oct 22 20:58:11.438890 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-LiveMigrationNegativeTest-1482658301-project Oct 22 20:58:11.438890 ncdv-master-1 devstack@n-api.service[138745]: method: > Oct 22 20:58:11.438890 ncdv-master-1 devstack@n-api.service[138745]: exception: Instance 829a4155-cf7c-470d-a127-c729e32747fe could not be found. Oct 22 20:58:11.438890 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'id': '829a4155-cf7c-470d-a127-c729e32747fe'} Oct 22 20:58:11.438890 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:58:11.438890 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:58:11.438890 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 20:58:11.438890 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 20:58:11.438890 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 20:58:11.438890 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 20:58:11.438890 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 20:58:11.438890 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 20:58:11.438890 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 20:58:11.438890 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 20:58:11.438890 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 829a4155-cf7c-470d-a127-c729e32747fe could not be found. Oct 22 20:58:11.438890 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:58:11.438890 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:58:11.438890 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:58:11.438890 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:58:11.438890 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:58:11.438890 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:58:11.438890 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:58:11.438890 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:58:11.438890 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:58:11.438890 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:58:11.438890 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 20:58:11.438890 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 20:58:11.438890 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 20:58:11.438890 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 20:58:11.438890 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 20:58:11.438890 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 20:58:11.438890 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 829a4155-cf7c-470d-a127-c729e32747fe could not be found. Oct 22 20:58:11.438890 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:58:11.438890 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:58:11.438890 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:58:11.443483 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:58:11.443483 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:58:11.443483 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:58:11.443483 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 20:58:11.443483 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 20:58:11.443483 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 829a4155-cf7c-470d-a127-c729e32747fe could not be found. Oct 22 20:58:11.443483 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:58:11.449663 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell0:SELECT=12 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:58:11.451026 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-aaaed929-7c99-4e43-a500-8f1169a39085 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Returning 404 to user: Instance 829a4155-cf7c-470d-a127-c729e32747fe could not be found. {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:58:11.451758 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-aaaed929-7c99-4e43-a500-8f1169a39085 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] 10.222.0.18 "GET /compute/v2.1/servers/829a4155-cf7c-470d-a127-c729e32747fe" status: 404 len: 111 microversion: 2.1 time: 0.066740 Oct 22 20:58:11.452729 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1132/2147] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:58:11 2022] GET /compute/v2.1/servers/829a4155-cf7c-470d-a127-c729e32747fe => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 20:58:11.463054 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-a5f876af-fde3-4cd4-a7d7-cca7b488fbf6 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:58:11.463792 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-a5f876af-fde3-4cd4-a7d7-cca7b488fbf6 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] [instance: cc3236d7-3b9f-40f2-8a53-3096f986e87e] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:58:11.478484 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a5f876af-fde3-4cd4-a7d7-cca7b488fbf6 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:11.479270 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a5f876af-fde3-4cd4-a7d7-cca7b488fbf6 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:11.479882 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a5f876af-fde3-4cd4-a7d7-cca7b488fbf6 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:11.480774 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a5f876af-fde3-4cd4-a7d7-cca7b488fbf6 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:11.481230 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a5f876af-fde3-4cd4-a7d7-cca7b488fbf6 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:11.481655 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a5f876af-fde3-4cd4-a7d7-cca7b488fbf6 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:11.540032 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-a5f876af-fde3-4cd4-a7d7-cca7b488fbf6 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] [instance: cc3236d7-3b9f-40f2-8a53-3096f986e87e] Going to try to terminate instance {{(pid=138745) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 20:58:11.733531 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-6273e870-4688-43d7-9253-670b2546a59f tempest-ServerPasswordTestJSON-1023240106 tempest-ServerPasswordTestJSON-1023240106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3466ea643c9142cfa0678d4cc277faab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9492cfb8c4487989bce6074736df04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:58:11.760825 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-6273e870-4688-43d7-9253-670b2546a59f tempest-ServerPasswordTestJSON-1023240106 tempest-ServerPasswordTestJSON-1023240106-project] 10.222.0.18 "GET /compute/v2.1/servers/659e6aaf-82b7-4361-8289-970d6de4a7b7" status: 200 len: 1316 microversion: 2.1 time: 0.647878 Oct 22 20:58:11.763439 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1016/2148] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:58:11 2022] GET /compute/v2.1/servers/659e6aaf-82b7-4361-8289-970d6de4a7b7 => generated 1316 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:58:11.794760 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-a5f876af-fde3-4cd4-a7d7-cca7b488fbf6 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] 10.222.0.18 "DELETE /compute/v2.1/servers/cc3236d7-3b9f-40f2-8a53-3096f986e87e" status: 204 len: 0 microversion: 2.1 time: 0.333965 Oct 22 20:58:11.796793 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1133/2149] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 20:58:11 2022] DELETE /compute/v2.1/servers/cc3236d7-3b9f-40f2-8a53-3096f986e87e => generated 0 bytes in 338 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 22 20:58:11.805461 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-650f0f1e-2064-43e2-9963-b3fc4add0b99 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:58:11.806200 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-650f0f1e-2064-43e2-9963-b3fc4add0b99 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] [instance: cc3236d7-3b9f-40f2-8a53-3096f986e87e] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:58:11.837294 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-650f0f1e-2064-43e2-9963-b3fc4add0b99 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:11.837956 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-650f0f1e-2064-43e2-9963-b3fc4add0b99 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:11.838429 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-650f0f1e-2064-43e2-9963-b3fc4add0b99 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:11.839192 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-650f0f1e-2064-43e2-9963-b3fc4add0b99 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:11.839677 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-650f0f1e-2064-43e2-9963-b3fc4add0b99 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:11.840110 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-650f0f1e-2064-43e2-9963-b3fc4add0b99 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:12.131807 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-c935e7a8-effc-40da-9daa-4be405203b2f tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:58:12.132684 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-c935e7a8-effc-40da-9daa-4be405203b2f tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] [instance: aee36c9d-baf4-453c-b88f-31b8f23638c2] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:58:12.151147 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c935e7a8-effc-40da-9daa-4be405203b2f tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:12.155257 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c935e7a8-effc-40da-9daa-4be405203b2f tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:12.155748 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c935e7a8-effc-40da-9daa-4be405203b2f tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:12.162426 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c935e7a8-effc-40da-9daa-4be405203b2f tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:12.162943 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c935e7a8-effc-40da-9daa-4be405203b2f tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:12.165779 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c935e7a8-effc-40da-9daa-4be405203b2f tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:12.656793 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-650f0f1e-2064-43e2-9963-b3fc4add0b99 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d808e98f843dd9621822682c9d278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b58ab4af674c778b4819f177045651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:58:12.684227 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-650f0f1e-2064-43e2-9963-b3fc4add0b99 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] 10.222.0.18 "GET /compute/v2.1/servers/cc3236d7-3b9f-40f2-8a53-3096f986e87e" status: 200 len: 1474 microversion: 2.1 time: 0.875693 Oct 22 20:58:12.684928 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1017/2150] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:58:11 2022] GET /compute/v2.1/servers/cc3236d7-3b9f-40f2-8a53-3096f986e87e => generated 1474 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:58:12.697959 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-e238bfaf-2867-4697-a645-071d801a16bc req-f1d3108d-9940-4306-b78c-d6bd93d02cbb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aee36c9d-baf4-453c-b88f-31b8f23638c2", "name": "network-vif-unplugged", "status": "completed", "tag": "f8ab0e3e-04fa-4f80-97a2-b20b84653be1"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:58:12.738168 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-e238bfaf-2867-4697-a645-071d801a16bc req-f1d3108d-9940-4306-b78c-d6bd93d02cbb service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:12.739749 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-e238bfaf-2867-4697-a645-071d801a16bc req-f1d3108d-9940-4306-b78c-d6bd93d02cbb service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:12.740342 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-e238bfaf-2867-4697-a645-071d801a16bc req-f1d3108d-9940-4306-b78c-d6bd93d02cbb service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:12.769811 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-e238bfaf-2867-4697-a645-071d801a16bc req-f1d3108d-9940-4306-b78c-d6bd93d02cbb service nova] Creating event network-vif-unplugged:f8ab0e3e-04fa-4f80-97a2-b20b84653be1 for instance aee36c9d-baf4-453c-b88f-31b8f23638c2 on nch1-master-1 Oct 22 20:58:12.776510 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [req-e238bfaf-2867-4697-a645-071d801a16bc req-f1d3108d-9940-4306-b78c-d6bd93d02cbb service nova] Instance aee36c9d-baf4-453c-b88f-31b8f23638c2 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=138744) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 22 20:58:12.793764 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-e238bfaf-2867-4697-a645-071d801a16bc req-f1d3108d-9940-4306-b78c-d6bd93d02cbb service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.107495 Oct 22 20:58:12.798757 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1018/2151] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:58:12 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:58:12.808429 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-22cac6a5-9ee9-4048-a8d8-8498da7c437c tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:58:12.809517 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-22cac6a5-9ee9-4048-a8d8-8498da7c437c tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] [instance: f070b144-3a1a-4456-8e5b-02af12557c6a] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:58:12.822480 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-22cac6a5-9ee9-4048-a8d8-8498da7c437c tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:12.823178 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-22cac6a5-9ee9-4048-a8d8-8498da7c437c tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:12.823839 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-22cac6a5-9ee9-4048-a8d8-8498da7c437c tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:12.824666 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-22cac6a5-9ee9-4048-a8d8-8498da7c437c tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:12.825243 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-22cac6a5-9ee9-4048-a8d8-8498da7c437c tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:12.825905 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-22cac6a5-9ee9-4048-a8d8-8498da7c437c tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:13.877928 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-c935e7a8-effc-40da-9daa-4be405203b2f tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d3d7458af447bdb3f03e83a2d8559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49238b8686d24ae698679e4a1957735d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:58:13.891790 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-c935e7a8-effc-40da-9daa-4be405203b2f tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] 10.222.0.18 "GET /compute/v2.1/servers/aee36c9d-baf4-453c-b88f-31b8f23638c2" status: 200 len: 1535 microversion: 2.1 time: 1.764651 Oct 22 20:58:13.894205 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1134/2152] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:58:12 2022] GET /compute/v2.1/servers/aee36c9d-baf4-453c-b88f-31b8f23638c2 => generated 1535 bytes in 1769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:58:13.912945 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-c501e7a3-9b8d-42de-82f6-38b695d91213 tempest-ServerPasswordTestJSON-1023240106 tempest-ServerPasswordTestJSON-1023240106-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:58:13.914000 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-c501e7a3-9b8d-42de-82f6-38b695d91213 tempest-ServerPasswordTestJSON-1023240106 tempest-ServerPasswordTestJSON-1023240106-project] [instance: 659e6aaf-82b7-4361-8289-970d6de4a7b7] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:58:13.922577 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c501e7a3-9b8d-42de-82f6-38b695d91213 tempest-ServerPasswordTestJSON-1023240106 tempest-ServerPasswordTestJSON-1023240106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:13.923454 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c501e7a3-9b8d-42de-82f6-38b695d91213 tempest-ServerPasswordTestJSON-1023240106 tempest-ServerPasswordTestJSON-1023240106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:13.924109 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c501e7a3-9b8d-42de-82f6-38b695d91213 tempest-ServerPasswordTestJSON-1023240106 tempest-ServerPasswordTestJSON-1023240106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:13.925039 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c501e7a3-9b8d-42de-82f6-38b695d91213 tempest-ServerPasswordTestJSON-1023240106 tempest-ServerPasswordTestJSON-1023240106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:13.925725 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c501e7a3-9b8d-42de-82f6-38b695d91213 tempest-ServerPasswordTestJSON-1023240106 tempest-ServerPasswordTestJSON-1023240106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:13.926361 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c501e7a3-9b8d-42de-82f6-38b695d91213 tempest-ServerPasswordTestJSON-1023240106 tempest-ServerPasswordTestJSON-1023240106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:13.994744 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-22cac6a5-9ee9-4048-a8d8-8498da7c437c tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dbe89a7e11480194d3d86f82983499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8351b01e07cd43f9be973ab45e522bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:58:14.004897 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-22cac6a5-9ee9-4048-a8d8-8498da7c437c tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] 10.222.0.18 "GET /compute/v2.1/servers/f070b144-3a1a-4456-8e5b-02af12557c6a" status: 200 len: 1471 microversion: 2.1 time: 1.204705 Oct 22 20:58:14.006202 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1019/2153] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:58:12 2022] GET /compute/v2.1/servers/f070b144-3a1a-4456-8e5b-02af12557c6a => generated 1471 bytes in 1207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:58:14.012083 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-2e0982e5-4060-4455-8952-3e1c93d3e2d0 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:58:14.012852 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-2e0982e5-4060-4455-8952-3e1c93d3e2d0 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] [instance: cc3236d7-3b9f-40f2-8a53-3096f986e87e] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:58:14.019653 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2e0982e5-4060-4455-8952-3e1c93d3e2d0 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:14.020326 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2e0982e5-4060-4455-8952-3e1c93d3e2d0 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:14.020877 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2e0982e5-4060-4455-8952-3e1c93d3e2d0 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:14.022296 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2e0982e5-4060-4455-8952-3e1c93d3e2d0 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:14.022984 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2e0982e5-4060-4455-8952-3e1c93d3e2d0 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:14.023659 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2e0982e5-4060-4455-8952-3e1c93d3e2d0 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:14.662324 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-c501e7a3-9b8d-42de-82f6-38b695d91213 tempest-ServerPasswordTestJSON-1023240106 tempest-ServerPasswordTestJSON-1023240106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3466ea643c9142cfa0678d4cc277faab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9492cfb8c4487989bce6074736df04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:58:14.666847 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-2e0982e5-4060-4455-8952-3e1c93d3e2d0 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d808e98f843dd9621822682c9d278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b58ab4af674c778b4819f177045651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:58:14.680237 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-c501e7a3-9b8d-42de-82f6-38b695d91213 tempest-ServerPasswordTestJSON-1023240106 tempest-ServerPasswordTestJSON-1023240106-project] 10.222.0.18 "GET /compute/v2.1/servers/659e6aaf-82b7-4361-8289-970d6de4a7b7" status: 200 len: 1504 microversion: 2.1 time: 0.782743 Oct 22 20:58:14.682336 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1135/2154] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:58:13 2022] GET /compute/v2.1/servers/659e6aaf-82b7-4361-8289-970d6de4a7b7 => generated 1504 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:58:14.702426 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-2e0982e5-4060-4455-8952-3e1c93d3e2d0 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] 10.222.0.18 "GET /compute/v2.1/servers/cc3236d7-3b9f-40f2-8a53-3096f986e87e" status: 200 len: 1474 microversion: 2.1 time: 0.690854 Oct 22 20:58:14.703693 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1020/2155] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:58:14 2022] GET /compute/v2.1/servers/cc3236d7-3b9f-40f2-8a53-3096f986e87e => generated 1474 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:58:14.710529 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-ae71f364-7ccb-45c4-9d49-82a0c2ed3e66 tempest-ServerPasswordTestJSON-1023240106 tempest-ServerPasswordTestJSON-1023240106-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:58:14.711064 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-ae71f364-7ccb-45c4-9d49-82a0c2ed3e66 tempest-ServerPasswordTestJSON-1023240106 tempest-ServerPasswordTestJSON-1023240106-project] [instance: 659e6aaf-82b7-4361-8289-970d6de4a7b7] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:58:14.724278 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ae71f364-7ccb-45c4-9d49-82a0c2ed3e66 tempest-ServerPasswordTestJSON-1023240106 tempest-ServerPasswordTestJSON-1023240106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:14.724968 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ae71f364-7ccb-45c4-9d49-82a0c2ed3e66 tempest-ServerPasswordTestJSON-1023240106 tempest-ServerPasswordTestJSON-1023240106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:14.725631 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ae71f364-7ccb-45c4-9d49-82a0c2ed3e66 tempest-ServerPasswordTestJSON-1023240106 tempest-ServerPasswordTestJSON-1023240106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:14.726922 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ae71f364-7ccb-45c4-9d49-82a0c2ed3e66 tempest-ServerPasswordTestJSON-1023240106 tempest-ServerPasswordTestJSON-1023240106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:14.727627 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ae71f364-7ccb-45c4-9d49-82a0c2ed3e66 tempest-ServerPasswordTestJSON-1023240106 tempest-ServerPasswordTestJSON-1023240106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:14.728269 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ae71f364-7ccb-45c4-9d49-82a0c2ed3e66 tempest-ServerPasswordTestJSON-1023240106 tempest-ServerPasswordTestJSON-1023240106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:14.815305 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-ae71f364-7ccb-45c4-9d49-82a0c2ed3e66 tempest-ServerPasswordTestJSON-1023240106 tempest-ServerPasswordTestJSON-1023240106-project] 10.222.0.18 "DELETE /compute/v2.1/servers/659e6aaf-82b7-4361-8289-970d6de4a7b7/os-server-password" status: 204 len: 0 microversion: 2.1 time: 0.112625 Oct 22 20:58:14.816600 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1136/2156] 10.222.0.18 () {58 vars in 1296 bytes} [Sat Oct 22 20:58:14 2022] DELETE /compute/v2.1/servers/659e6aaf-82b7-4361-8289-970d6de4a7b7/os-server-password => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 22 20:58:14.826529 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-58078b07-c9da-4ef7-b0e1-8bb2e10383fd tempest-ServerPasswordTestJSON-1023240106 tempest-ServerPasswordTestJSON-1023240106-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:58:14.827138 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-58078b07-c9da-4ef7-b0e1-8bb2e10383fd tempest-ServerPasswordTestJSON-1023240106 tempest-ServerPasswordTestJSON-1023240106-project] [instance: 659e6aaf-82b7-4361-8289-970d6de4a7b7] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:58:14.835843 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-58078b07-c9da-4ef7-b0e1-8bb2e10383fd tempest-ServerPasswordTestJSON-1023240106 tempest-ServerPasswordTestJSON-1023240106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:14.836678 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-58078b07-c9da-4ef7-b0e1-8bb2e10383fd tempest-ServerPasswordTestJSON-1023240106 tempest-ServerPasswordTestJSON-1023240106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:14.837379 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-58078b07-c9da-4ef7-b0e1-8bb2e10383fd tempest-ServerPasswordTestJSON-1023240106 tempest-ServerPasswordTestJSON-1023240106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:14.838444 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-58078b07-c9da-4ef7-b0e1-8bb2e10383fd tempest-ServerPasswordTestJSON-1023240106 tempest-ServerPasswordTestJSON-1023240106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:14.839274 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-58078b07-c9da-4ef7-b0e1-8bb2e10383fd tempest-ServerPasswordTestJSON-1023240106 tempest-ServerPasswordTestJSON-1023240106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:14.840309 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-58078b07-c9da-4ef7-b0e1-8bb2e10383fd tempest-ServerPasswordTestJSON-1023240106 tempest-ServerPasswordTestJSON-1023240106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:14.874519 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-58078b07-c9da-4ef7-b0e1-8bb2e10383fd tempest-ServerPasswordTestJSON-1023240106 tempest-ServerPasswordTestJSON-1023240106-project] 10.222.0.18 "GET /compute/v2.1/servers/659e6aaf-82b7-4361-8289-970d6de4a7b7/os-server-password" status: 200 len: 16 microversion: 2.1 time: 0.052833 Oct 22 20:58:14.888309 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-b7ec52f6-acb0-4e02-b455-76070211b5a9 req-c4943b0a-6133-47b0-a658-fa46610a1f9f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aee36c9d-baf4-453c-b88f-31b8f23638c2", "tag": "f8ab0e3e-04fa-4f80-97a2-b20b84653be1"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:58:14.895612 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1021/2157] 10.222.0.18 () {58 vars in 1293 bytes} [Sat Oct 22 20:58:14 2022] GET /compute/v2.1/servers/659e6aaf-82b7-4361-8289-970d6de4a7b7/os-server-password => generated 16 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 22 20:58:14.909193 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-b9884818-1b7f-4bfd-b768-eff10988737a tempest-ServerPasswordTestJSON-1023240106 tempest-ServerPasswordTestJSON-1023240106-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:58:14.910059 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-b9884818-1b7f-4bfd-b768-eff10988737a tempest-ServerPasswordTestJSON-1023240106 tempest-ServerPasswordTestJSON-1023240106-project] [instance: 659e6aaf-82b7-4361-8289-970d6de4a7b7] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:58:14.916072 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-b7ec52f6-acb0-4e02-b455-76070211b5a9 req-c4943b0a-6133-47b0-a658-fa46610a1f9f service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:14.916576 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-b7ec52f6-acb0-4e02-b455-76070211b5a9 req-c4943b0a-6133-47b0-a658-fa46610a1f9f service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:14.917032 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-b7ec52f6-acb0-4e02-b455-76070211b5a9 req-c4943b0a-6133-47b0-a658-fa46610a1f9f service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:14.919668 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b9884818-1b7f-4bfd-b768-eff10988737a tempest-ServerPasswordTestJSON-1023240106 tempest-ServerPasswordTestJSON-1023240106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:14.921119 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b9884818-1b7f-4bfd-b768-eff10988737a tempest-ServerPasswordTestJSON-1023240106 tempest-ServerPasswordTestJSON-1023240106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:14.922694 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b9884818-1b7f-4bfd-b768-eff10988737a tempest-ServerPasswordTestJSON-1023240106 tempest-ServerPasswordTestJSON-1023240106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:14.923739 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b9884818-1b7f-4bfd-b768-eff10988737a tempest-ServerPasswordTestJSON-1023240106 tempest-ServerPasswordTestJSON-1023240106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:14.925696 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b9884818-1b7f-4bfd-b768-eff10988737a tempest-ServerPasswordTestJSON-1023240106 tempest-ServerPasswordTestJSON-1023240106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:14.926579 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b9884818-1b7f-4bfd-b768-eff10988737a tempest-ServerPasswordTestJSON-1023240106 tempest-ServerPasswordTestJSON-1023240106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:14.967756 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-b7ec52f6-acb0-4e02-b455-76070211b5a9 req-c4943b0a-6133-47b0-a658-fa46610a1f9f service nova] Creating event network-changed:f8ab0e3e-04fa-4f80-97a2-b20b84653be1 for instance aee36c9d-baf4-453c-b88f-31b8f23638c2 on nch1-master-1 Oct 22 20:58:14.984593 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [req-b7ec52f6-acb0-4e02-b455-76070211b5a9 req-c4943b0a-6133-47b0-a658-fa46610a1f9f service nova] Instance aee36c9d-baf4-453c-b88f-31b8f23638c2 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=138745) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 22 20:58:15.005940 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-b9884818-1b7f-4bfd-b768-eff10988737a tempest-ServerPasswordTestJSON-1023240106 tempest-ServerPasswordTestJSON-1023240106-project] [instance: 659e6aaf-82b7-4361-8289-970d6de4a7b7] Going to try to terminate instance {{(pid=138744) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 20:58:15.006433 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-b7ec52f6-acb0-4e02-b455-76070211b5a9 req-c4943b0a-6133-47b0-a658-fa46610a1f9f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.127951 Oct 22 20:58:15.006876 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1137/2158] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:58:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:58:15.013886 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-9009a3c8-f31b-4453-838d-2da75ab8d0b3 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:58:15.014617 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-9009a3c8-f31b-4453-838d-2da75ab8d0b3 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] [instance: aee36c9d-baf4-453c-b88f-31b8f23638c2] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:58:15.023778 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9009a3c8-f31b-4453-838d-2da75ab8d0b3 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:15.024338 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9009a3c8-f31b-4453-838d-2da75ab8d0b3 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:15.024788 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9009a3c8-f31b-4453-838d-2da75ab8d0b3 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:15.026241 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9009a3c8-f31b-4453-838d-2da75ab8d0b3 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:15.026984 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9009a3c8-f31b-4453-838d-2da75ab8d0b3 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:15.028437 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9009a3c8-f31b-4453-838d-2da75ab8d0b3 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:15.109404 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:58:15.161369 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-b9884818-1b7f-4bfd-b768-eff10988737a tempest-ServerPasswordTestJSON-1023240106 tempest-ServerPasswordTestJSON-1023240106-project] 10.222.0.18 "DELETE /compute/v2.1/servers/659e6aaf-82b7-4361-8289-970d6de4a7b7" status: 204 len: 0 microversion: 2.1 time: 0.258684 Oct 22 20:58:15.166794 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1022/2159] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 20:58:14 2022] DELETE /compute/v2.1/servers/659e6aaf-82b7-4361-8289-970d6de4a7b7 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 22 20:58:15.201418 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-2372c14b-6958-457f-8de8-54d5bd62cb10 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:58:15.207915 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-2372c14b-6958-457f-8de8-54d5bd62cb10 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] [instance: f070b144-3a1a-4456-8e5b-02af12557c6a] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:58:15.225885 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2372c14b-6958-457f-8de8-54d5bd62cb10 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:15.228194 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2372c14b-6958-457f-8de8-54d5bd62cb10 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:15.230319 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2372c14b-6958-457f-8de8-54d5bd62cb10 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:15.233692 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2372c14b-6958-457f-8de8-54d5bd62cb10 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:15.234884 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2372c14b-6958-457f-8de8-54d5bd62cb10 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:15.235836 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2372c14b-6958-457f-8de8-54d5bd62cb10 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:15.596001 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-9009a3c8-f31b-4453-838d-2da75ab8d0b3 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d3d7458af447bdb3f03e83a2d8559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49238b8686d24ae698679e4a1957735d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:58:15.608346 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-9009a3c8-f31b-4453-838d-2da75ab8d0b3 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] 10.222.0.18 "GET /compute/v2.1/servers/aee36c9d-baf4-453c-b88f-31b8f23638c2" status: 200 len: 1535 microversion: 2.1 time: 0.599989 Oct 22 20:58:15.608936 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1138/2160] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:58:15 2022] GET /compute/v2.1/servers/aee36c9d-baf4-453c-b88f-31b8f23638c2 => generated 1535 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:58:15.626418 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-8faa5857-31b1-48cb-aa3d-bc883b3cf075 req-fdb0d8fc-fca2-49fe-b81a-8e9c91802c30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc3236d7-3b9f-40f2-8a53-3096f986e87e", "name": "network-vif-deleted", "tag": "61d2ab3f-b602-485a-9534-df55ed5059a1"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:58:15.669838 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-8faa5857-31b1-48cb-aa3d-bc883b3cf075 req-fdb0d8fc-fca2-49fe-b81a-8e9c91802c30 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:15.670526 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-8faa5857-31b1-48cb-aa3d-bc883b3cf075 req-fdb0d8fc-fca2-49fe-b81a-8e9c91802c30 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:15.671180 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-8faa5857-31b1-48cb-aa3d-bc883b3cf075 req-fdb0d8fc-fca2-49fe-b81a-8e9c91802c30 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:15.683993 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-8faa5857-31b1-48cb-aa3d-bc883b3cf075 req-fdb0d8fc-fca2-49fe-b81a-8e9c91802c30 service nova] Creating event network-vif-deleted:61d2ab3f-b602-485a-9534-df55ed5059a1 for instance cc3236d7-3b9f-40f2-8a53-3096f986e87e on nch1-master-1 Oct 22 20:58:15.696577 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-8faa5857-31b1-48cb-aa3d-bc883b3cf075 req-fdb0d8fc-fca2-49fe-b81a-8e9c91802c30 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086127 Oct 22 20:58:15.697752 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1139/2161] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:58:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:58:15.705037 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-694e1264-0133-4d04-a233-6c2ca7711f38 tempest-ServerPasswordTestJSON-1023240106 tempest-ServerPasswordTestJSON-1023240106-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:58:15.705978 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-694e1264-0133-4d04-a233-6c2ca7711f38 tempest-ServerPasswordTestJSON-1023240106 tempest-ServerPasswordTestJSON-1023240106-project] [instance: 659e6aaf-82b7-4361-8289-970d6de4a7b7] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:58:15.713961 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-694e1264-0133-4d04-a233-6c2ca7711f38 tempest-ServerPasswordTestJSON-1023240106 tempest-ServerPasswordTestJSON-1023240106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:15.714560 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-694e1264-0133-4d04-a233-6c2ca7711f38 tempest-ServerPasswordTestJSON-1023240106 tempest-ServerPasswordTestJSON-1023240106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:15.715179 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-694e1264-0133-4d04-a233-6c2ca7711f38 tempest-ServerPasswordTestJSON-1023240106 tempest-ServerPasswordTestJSON-1023240106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:15.716238 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-694e1264-0133-4d04-a233-6c2ca7711f38 tempest-ServerPasswordTestJSON-1023240106 tempest-ServerPasswordTestJSON-1023240106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:15.716786 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-694e1264-0133-4d04-a233-6c2ca7711f38 tempest-ServerPasswordTestJSON-1023240106 tempest-ServerPasswordTestJSON-1023240106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:15.717312 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-694e1264-0133-4d04-a233-6c2ca7711f38 tempest-ServerPasswordTestJSON-1023240106 tempest-ServerPasswordTestJSON-1023240106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:15.888364 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-2372c14b-6958-457f-8de8-54d5bd62cb10 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dbe89a7e11480194d3d86f82983499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8351b01e07cd43f9be973ab45e522bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:58:15.904782 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-2372c14b-6958-457f-8de8-54d5bd62cb10 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] 10.222.0.18 "GET /compute/v2.1/servers/f070b144-3a1a-4456-8e5b-02af12557c6a" status: 200 len: 1477 microversion: 2.1 time: 0.735299 Oct 22 20:58:15.919799 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1023/2162] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:58:15 2022] GET /compute/v2.1/servers/f070b144-3a1a-4456-8e5b-02af12557c6a => generated 1477 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:58:15.920991 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-f01312e5-b88a-4d84-8c17-ccf3cccab7ca tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1172849293", "imageRef": "085e4478-6edc-4a69-8e08-f9831713eb65", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "46d7c350-a8f4-40d4-834d-704b298b5127"}], "security_groups": [{"name": "tempest-securitygroup--611760411"}], "key_name": "tempest-keypair-1358369103", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:58:16.238133 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-694e1264-0133-4d04-a233-6c2ca7711f38 tempest-ServerPasswordTestJSON-1023240106 tempest-ServerPasswordTestJSON-1023240106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3466ea643c9142cfa0678d4cc277faab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9492cfb8c4487989bce6074736df04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:58:16.246929 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-694e1264-0133-4d04-a233-6c2ca7711f38 tempest-ServerPasswordTestJSON-1023240106 tempest-ServerPasswordTestJSON-1023240106-project] 10.222.0.18 "GET /compute/v2.1/servers/659e6aaf-82b7-4361-8289-970d6de4a7b7" status: 200 len: 1510 microversion: 2.1 time: 0.547634 Oct 22 20:58:16.250416 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1140/2163] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:58:15 2022] GET /compute/v2.1/servers/659e6aaf-82b7-4361-8289-970d6de4a7b7 => generated 1510 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:58:16.281444 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-26f09158-c0d3-43f1-ad0d-72d3ea28f404 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:58:16.285342 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-26f09158-c0d3-43f1-ad0d-72d3ea28f404 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] [instance: cc3236d7-3b9f-40f2-8a53-3096f986e87e] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:58:16.301310 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-26f09158-c0d3-43f1-ad0d-72d3ea28f404 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:16.302130 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-26f09158-c0d3-43f1-ad0d-72d3ea28f404 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:16.303891 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-26f09158-c0d3-43f1-ad0d-72d3ea28f404 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:16.304930 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-26f09158-c0d3-43f1-ad0d-72d3ea28f404 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:16.306937 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-26f09158-c0d3-43f1-ad0d-72d3ea28f404 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:16.307703 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-26f09158-c0d3-43f1-ad0d-72d3ea28f404 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:16.362159 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.network.neutron [None req-f01312e5-b88a-4d84-8c17-ccf3cccab7ca tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] validate_networks() for [('46d7c350-a8f4-40d4-834d-704b298b5127', None, None, None, None, None)] {{(pid=138744) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 20:58:16.410137 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-26f09158-c0d3-43f1-ad0d-72d3ea28f404 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:16.410662 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-26f09158-c0d3-43f1-ad0d-72d3ea28f404 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:16.411965 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-26f09158-c0d3-43f1-ad0d-72d3ea28f404 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:16.412615 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.objects.instance [None req-26f09158-c0d3-43f1-ad0d-72d3ea28f404 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Lazy-loading 'fault' on Instance uuid cc3236d7-3b9f-40f2-8a53-3096f986e87e {{(pid=138745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 20:58:16.657531 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-26f09158-c0d3-43f1-ad0d-72d3ea28f404 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d808e98f843dd9621822682c9d278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b58ab4af674c778b4819f177045651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:58:16.666410 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-26f09158-c0d3-43f1-ad0d-72d3ea28f404 tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] 10.222.0.18 "GET /compute/v2.1/servers/cc3236d7-3b9f-40f2-8a53-3096f986e87e" status: 200 len: 1308 microversion: 2.1 time: 0.414691 Oct 22 20:58:16.688270 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1141/2164] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:58:16 2022] GET /compute/v2.1/servers/cc3236d7-3b9f-40f2-8a53-3096f986e87e => generated 1308 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:58:16.695966 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-53d4bc6c-c0bb-47f2-9a57-72e51301ef70 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:58:16.696808 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-53d4bc6c-c0bb-47f2-9a57-72e51301ef70 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] [instance: aee36c9d-baf4-453c-b88f-31b8f23638c2] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:58:16.705307 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-53d4bc6c-c0bb-47f2-9a57-72e51301ef70 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:16.706166 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-53d4bc6c-c0bb-47f2-9a57-72e51301ef70 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:16.706872 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-53d4bc6c-c0bb-47f2-9a57-72e51301ef70 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:16.707902 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-53d4bc6c-c0bb-47f2-9a57-72e51301ef70 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:16.708851 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-53d4bc6c-c0bb-47f2-9a57-72e51301ef70 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:16.709492 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-53d4bc6c-c0bb-47f2-9a57-72e51301ef70 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:17.714211 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-53d4bc6c-c0bb-47f2-9a57-72e51301ef70 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d3d7458af447bdb3f03e83a2d8559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49238b8686d24ae698679e4a1957735d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:58:17.728572 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-53d4bc6c-c0bb-47f2-9a57-72e51301ef70 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] 10.222.0.18 "GET /compute/v2.1/servers/aee36c9d-baf4-453c-b88f-31b8f23638c2" status: 200 len: 1535 microversion: 2.1 time: 1.037664 Oct 22 20:58:17.729372 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1142/2165] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:58:16 2022] GET /compute/v2.1/servers/aee36c9d-baf4-453c-b88f-31b8f23638c2 => generated 1535 bytes in 1040 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:58:17.744712 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-25297d81-51bb-4611-ad25-8e5e2917b169 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:58:17.751751 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-25297d81-51bb-4611-ad25-8e5e2917b169 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] [instance: f070b144-3a1a-4456-8e5b-02af12557c6a] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:58:17.767833 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-25297d81-51bb-4611-ad25-8e5e2917b169 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:17.768632 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-25297d81-51bb-4611-ad25-8e5e2917b169 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:17.769068 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-25297d81-51bb-4611-ad25-8e5e2917b169 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:17.771494 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-25297d81-51bb-4611-ad25-8e5e2917b169 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:17.773442 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-25297d81-51bb-4611-ad25-8e5e2917b169 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:17.778482 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-25297d81-51bb-4611-ad25-8e5e2917b169 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:17.818687 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=2,nova_cell1:INSERT=5 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:58:18.169788 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-25297d81-51bb-4611-ad25-8e5e2917b169 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dbe89a7e11480194d3d86f82983499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8351b01e07cd43f9be973ab45e522bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:58:18.186657 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-25297d81-51bb-4611-ad25-8e5e2917b169 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] 10.222.0.18 "GET /compute/v2.1/servers/f070b144-3a1a-4456-8e5b-02af12557c6a" status: 200 len: 1477 microversion: 2.1 time: 0.455006 Oct 22 20:58:18.208011 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1143/2166] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:58:17 2022] GET /compute/v2.1/servers/f070b144-3a1a-4456-8e5b-02af12557c6a => generated 1477 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:58:18.223278 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-44b55774-7784-4d09-8cb4-e1b433ea471f tempest-ServerPasswordTestJSON-1023240106 tempest-ServerPasswordTestJSON-1023240106-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:58:18.224109 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-44b55774-7784-4d09-8cb4-e1b433ea471f tempest-ServerPasswordTestJSON-1023240106 tempest-ServerPasswordTestJSON-1023240106-project] [instance: 659e6aaf-82b7-4361-8289-970d6de4a7b7] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:58:18.244454 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-44b55774-7784-4d09-8cb4-e1b433ea471f tempest-ServerPasswordTestJSON-1023240106 tempest-ServerPasswordTestJSON-1023240106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:18.246481 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-44b55774-7784-4d09-8cb4-e1b433ea471f tempest-ServerPasswordTestJSON-1023240106 tempest-ServerPasswordTestJSON-1023240106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:18.247446 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-44b55774-7784-4d09-8cb4-e1b433ea471f tempest-ServerPasswordTestJSON-1023240106 tempest-ServerPasswordTestJSON-1023240106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:18.248798 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-44b55774-7784-4d09-8cb4-e1b433ea471f tempest-ServerPasswordTestJSON-1023240106 tempest-ServerPasswordTestJSON-1023240106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:18.249465 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-44b55774-7784-4d09-8cb4-e1b433ea471f tempest-ServerPasswordTestJSON-1023240106 tempest-ServerPasswordTestJSON-1023240106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:18.259026 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-44b55774-7784-4d09-8cb4-e1b433ea471f tempest-ServerPasswordTestJSON-1023240106 tempest-ServerPasswordTestJSON-1023240106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:18.409228 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-44b55774-7784-4d09-8cb4-e1b433ea471f tempest-ServerPasswordTestJSON-1023240106 tempest-ServerPasswordTestJSON-1023240106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3466ea643c9142cfa0678d4cc277faab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9492cfb8c4487989bce6074736df04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:58:18.417345 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-44b55774-7784-4d09-8cb4-e1b433ea471f tempest-ServerPasswordTestJSON-1023240106 tempest-ServerPasswordTestJSON-1023240106-project] 10.222.0.18 "GET /compute/v2.1/servers/659e6aaf-82b7-4361-8289-970d6de4a7b7" status: 200 len: 1468 microversion: 2.1 time: 0.199878 Oct 22 20:58:18.421729 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1144/2167] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:58:18 2022] GET /compute/v2.1/servers/659e6aaf-82b7-4361-8289-970d6de4a7b7 => generated 1468 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:58:18.426739 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-eec43d28-a5b3-4a2d-9ab3-1ea1662906ee tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:58:18.432653 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-eec43d28-a5b3-4a2d-9ab3-1ea1662906ee tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] [instance: cc3236d7-3b9f-40f2-8a53-3096f986e87e] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:58:18.435644 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-f01312e5-b88a-4d84-8c17-ccf3cccab7ca tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] Getting quotas for project 5af194191cdc4b34a470c821a932e2fd. Resources: dict_keys(['metadata_items']) {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 20:58:18.449723 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-eec43d28-a5b3-4a2d-9ab3-1ea1662906ee tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:18.450419 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-eec43d28-a5b3-4a2d-9ab3-1ea1662906ee tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:18.451227 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-f01312e5-b88a-4d84-8c17-ccf3cccab7ca tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] Getting quotas for user 5bb8017457354ed68be65cb426965cb2 and project 5af194191cdc4b34a470c821a932e2fd. Resources: dict_keys(['metadata_items']) {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 20:58:18.451402 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-eec43d28-a5b3-4a2d-9ab3-1ea1662906ee tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:18.452422 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-eec43d28-a5b3-4a2d-9ab3-1ea1662906ee tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:18.453659 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-eec43d28-a5b3-4a2d-9ab3-1ea1662906ee tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:18.454769 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-eec43d28-a5b3-4a2d-9ab3-1ea1662906ee tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:18.480394 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-f01312e5-b88a-4d84-8c17-ccf3cccab7ca tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] Flavor limits 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 20:58:18.480813 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-f01312e5-b88a-4d84-8c17-ccf3cccab7ca tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] Image limits 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 20:58:18.481302 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-f01312e5-b88a-4d84-8c17-ccf3cccab7ca tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] Flavor pref 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 20:58:18.481756 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-f01312e5-b88a-4d84-8c17-ccf3cccab7ca tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] Image pref 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 20:58:18.482207 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-f01312e5-b88a-4d84-8c17-ccf3cccab7ca tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 20:58:18.482474 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.wsgi [None req-eec43d28-a5b3-4a2d-9ab3-1ea1662906ee tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] HTTP exception thrown: Instance cc3236d7-3b9f-40f2-8a53-3096f986e87e could not be found. Oct 22 20:58:18.485838 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-eec43d28-a5b3-4a2d-9ab3-1ea1662906ee tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Request method failure captured: Oct 22 20:58:18.485838 ncdv-master-1 devstack@n-api.service[138745]: request: GET /compute/v2.1/servers/cc3236d7-3b9f-40f2-8a53-3096f986e87e HTTP/1.1 Oct 22 20:58:18.485838 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 20:58:18.485838 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 20:58:18.485838 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 20:58:18.485838 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 0 Oct 22 20:58:18.485838 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 20:58:18.485838 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 20:58:18.485838 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 20:58:18.485838 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 20:58:18.485838 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVFkXUdrwDaJLKZCaitdq-vFy5ZeDp_TSY_IlBHRRrpu9k61FtGoEan0qOWELXC5fscRnSCCpJGmnhxbXpaQn9Lj9KJtAlpISMSh5zj-GCQxOFMoXNHq57C9xUeVdlD7VbwmQlyoxuJwil15St3n33CesU2i_7Q5WugvD4vsQm-_JV9A Oct 22 20:58:18.485838 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 20:58:18.485838 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 20:58:18.485838 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 20:58:18.485838 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 20:58:18.485838 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 20:58:18.485838 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 20:58:18.485838 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: a8b58ab4af674c778b4819f177045651 Oct 22 20:58:18.485838 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-LiveMigrationNegativeTest-1482658301 Oct 22 20:58:18.485838 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 20:58:18.485838 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 20:58:18.485838 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_a8b58ab4af674c778b4819f177045651"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a8b58ab4af674c778b4819f177045651"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/a8b58ab4af674c778b4819f177045651"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a8b58ab4af674c778b4819f177045651"}]}] Oct 22 20:58:18.485838 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-LiveMigrationNegativeTest-1482658301 Oct 22 20:58:18.485838 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: a8b58ab4af674c778b4819f177045651 Oct 22 20:58:18.485838 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1482658301 Oct 22 20:58:18.485838 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-LiveMigrationNegativeTest-1482658301-project Oct 22 20:58:18.485838 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 20:58:18.485838 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 20:58:18.485838 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: 0d0d808e98f843dd9621822682c9d278 Oct 22 20:58:18.485838 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-LiveMigrationNegativeTest-1482658301-project Oct 22 20:58:18.485838 ncdv-master-1 devstack@n-api.service[138745]: method: > Oct 22 20:58:18.485838 ncdv-master-1 devstack@n-api.service[138745]: exception: Instance cc3236d7-3b9f-40f2-8a53-3096f986e87e could not be found. Oct 22 20:58:18.485838 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'id': 'cc3236d7-3b9f-40f2-8a53-3096f986e87e'} Oct 22 20:58:18.485838 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:58:18.485838 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:58:18.485838 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 20:58:18.485838 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 20:58:18.485838 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 20:58:18.485838 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 20:58:18.485838 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 20:58:18.485838 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 20:58:18.485838 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 20:58:18.485838 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 20:58:18.485838 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc3236d7-3b9f-40f2-8a53-3096f986e87e could not be found. Oct 22 20:58:18.485838 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:58:18.485838 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:58:18.485838 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:58:18.485838 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:58:18.485838 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:58:18.485838 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:58:18.485838 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:58:18.485838 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:58:18.485838 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:58:18.485838 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:58:18.485838 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 20:58:18.485838 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 20:58:18.485838 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 20:58:18.485838 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 20:58:18.485838 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 20:58:18.485838 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 20:58:18.485838 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc3236d7-3b9f-40f2-8a53-3096f986e87e could not be found. Oct 22 20:58:18.485838 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:58:18.485838 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:58:18.485838 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:58:18.490829 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:58:18.490829 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:58:18.490829 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:58:18.490829 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 20:58:18.490829 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 20:58:18.490829 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc3236d7-3b9f-40f2-8a53-3096f986e87e could not be found. Oct 22 20:58:18.490829 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:58:18.493398 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-eec43d28-a5b3-4a2d-9ab3-1ea1662906ee tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] Returning 404 to user: Instance cc3236d7-3b9f-40f2-8a53-3096f986e87e could not be found. {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:58:18.495120 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-eec43d28-a5b3-4a2d-9ab3-1ea1662906ee tempest-LiveMigrationNegativeTest-1482658301 tempest-LiveMigrationNegativeTest-1482658301-project] 10.222.0.18 "GET /compute/v2.1/servers/cc3236d7-3b9f-40f2-8a53-3096f986e87e" status: 404 len: 111 microversion: 2.1 time: 0.072131 Oct 22 20:58:18.496936 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1145/2168] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:58:18 2022] GET /compute/v2.1/servers/cc3236d7-3b9f-40f2-8a53-3096f986e87e => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 20:58:18.506136 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-f760f544-62d0-4496-a108-82ea67730221 req-a45b2348-4820-4002-bbc8-5716d89ed5ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "659e6aaf-82b7-4361-8289-970d6de4a7b7", "name": "network-vif-deleted", "tag": "c000a86e-3b85-400e-bac9-43e74449f4c7"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:58:18.510042 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f01312e5-b88a-4d84-8c17-ccf3cccab7ca tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:18.510543 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f01312e5-b88a-4d84-8c17-ccf3cccab7ca tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:18.510990 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f01312e5-b88a-4d84-8c17-ccf3cccab7ca tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:18.521467 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-f760f544-62d0-4496-a108-82ea67730221 req-a45b2348-4820-4002-bbc8-5716d89ed5ae service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:18.522197 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-f760f544-62d0-4496-a108-82ea67730221 req-a45b2348-4820-4002-bbc8-5716d89ed5ae service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:18.523105 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-f760f544-62d0-4496-a108-82ea67730221 req-a45b2348-4820-4002-bbc8-5716d89ed5ae service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:18.529939 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f01312e5-b88a-4d84-8c17-ccf3cccab7ca tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:18.530458 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f01312e5-b88a-4d84-8c17-ccf3cccab7ca tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:18.531449 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f01312e5-b88a-4d84-8c17-ccf3cccab7ca tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:18.538669 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-f760f544-62d0-4496-a108-82ea67730221 req-a45b2348-4820-4002-bbc8-5716d89ed5ae service nova] Creating event network-vif-deleted:c000a86e-3b85-400e-bac9-43e74449f4c7 for instance 659e6aaf-82b7-4361-8289-970d6de4a7b7 on nch1-master-1 Oct 22 20:58:18.545331 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-f760f544-62d0-4496-a108-82ea67730221 req-a45b2348-4820-4002-bbc8-5716d89ed5ae service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046339 Oct 22 20:58:18.546152 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1146/2169] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:58:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:58:18.552164 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-a1f2bb76-06d9-48fc-ab1a-c3a7b366d859 tempest-ImagesMetadataTestJSON-540542917 tempest-ImagesMetadataTestJSON-540542917-project] Calling method '.version_select at 0x7fd39fd7b160>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:58:18.583464 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-f01312e5-b88a-4d84-8c17-ccf3cccab7ca tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] Getting quotas for project 5af194191cdc4b34a470c821a932e2fd. Resources: {'cores', 'instances', 'ram'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 20:58:18.597629 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-f01312e5-b88a-4d84-8c17-ccf3cccab7ca tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] Getting quotas for user 5bb8017457354ed68be65cb426965cb2 and project 5af194191cdc4b34a470c821a932e2fd. Resources: {'cores', 'instances', 'ram'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 20:58:18.613192 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-a1f2bb76-06d9-48fc-ab1a-c3a7b366d859 tempest-ImagesMetadataTestJSON-540542917 tempest-ImagesMetadataTestJSON-540542917-project] 10.222.0.18 "GET /compute/v2.1/images/cca411ce-7ae8-4278-bf05-360c443077f8" status: 200 len: 637 microversion: 2.1 time: 0.065558 Oct 22 20:58:18.614319 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1147/2170] 10.222.0.18 () {58 vars in 1233 bytes} [Sat Oct 22 20:58:18 2022] GET /compute/v2.1/images/cca411ce-7ae8-4278-bf05-360c443077f8 => generated 637 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:58:18.622098 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-d3f3aac2-a505-4e91-9723-e18146a2cb1d req-dcc6b1f2-1359-49fc-925e-9c580e8b9bd4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f070b144-3a1a-4456-8e5b-02af12557c6a", "name": "network-vif-plugged", "status": "completed", "tag": "9c49ccea-f5ad-47be-9a9c-61df2a8933d5"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:58:18.632326 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-f01312e5-b88a-4d84-8c17-ccf3cccab7ca tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] Going to run 1 instances... {{(pid=138744) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 20:58:18.635667 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-f01312e5-b88a-4d84-8c17-ccf3cccab7ca tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] [instance: 19465083-6d3a-485d-9101-950d9c45abaf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='085e4478-6edc-4a69-8e08-f9831713eb65',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138744) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 20:58:18.653671 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-d3f3aac2-a505-4e91-9723-e18146a2cb1d req-dcc6b1f2-1359-49fc-925e-9c580e8b9bd4 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:18.655405 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-d3f3aac2-a505-4e91-9723-e18146a2cb1d req-dcc6b1f2-1359-49fc-925e-9c580e8b9bd4 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:18.656135 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-d3f3aac2-a505-4e91-9723-e18146a2cb1d req-dcc6b1f2-1359-49fc-925e-9c580e8b9bd4 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:18.680769 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-d3f3aac2-a505-4e91-9723-e18146a2cb1d req-dcc6b1f2-1359-49fc-925e-9c580e8b9bd4 service nova] Creating event network-vif-plugged:9c49ccea-f5ad-47be-9a9c-61df2a8933d5 for instance f070b144-3a1a-4456-8e5b-02af12557c6a on nch2-master-1 Oct 22 20:58:18.690879 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-d3f3aac2-a505-4e91-9723-e18146a2cb1d req-dcc6b1f2-1359-49fc-925e-9c580e8b9bd4 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075210 Oct 22 20:58:18.692049 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1148/2171] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:58:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:58:18.699178 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-70a26650-c47b-4648-9381-7bc73bb31863 tempest-ImagesMetadataTestJSON-540542917 tempest-ImagesMetadataTestJSON-540542917-project] Action: 'update_all', calling method: .version_select at 0x7fd39fb9b700>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:58:18.712713 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-f01312e5-b88a-4d84-8c17-ccf3cccab7ca tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.803839 Oct 22 20:58:18.715728 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1024/2172] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Oct 22 20:58:15 2022] POST /compute/v2.1/servers => generated 406 bytes in 2808 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 20:58:18.727888 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-bf615917-027c-414c-90b3-d7b3294fa573 tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:58:18.730737 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-bf615917-027c-414c-90b3-d7b3294fa573 tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] [instance: 19465083-6d3a-485d-9101-950d9c45abaf] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:58:18.805133 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell0:SELECT=4 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:58:18.852109 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-70a26650-c47b-4648-9381-7bc73bb31863 tempest-ImagesMetadataTestJSON-540542917 tempest-ImagesMetadataTestJSON-540542917-project] Getting quotas for project 09ca841aa454436bb5a39886ad584f89. Resources: dict_keys(['metadata_items']) {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 20:58:18.872052 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-70a26650-c47b-4648-9381-7bc73bb31863 tempest-ImagesMetadataTestJSON-540542917 tempest-ImagesMetadataTestJSON-540542917-project] Getting quotas for user b484e4419e934590b5bbf6adf35cdd45 and project 09ca841aa454436bb5a39886ad584f89. Resources: dict_keys(['metadata_items']) {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 20:58:18.928188 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-bf615917-027c-414c-90b3-d7b3294fa573 tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb8017457354ed68be65cb426965cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af194191cdc4b34a470c821a932e2fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:58:18.939303 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-bf615917-027c-414c-90b3-d7b3294fa573 tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] 10.222.0.18 "GET /compute/v2.1/servers/19465083-6d3a-485d-9101-950d9c45abaf" status: 200 len: 1270 microversion: 2.1 time: 0.215584 Oct 22 20:58:18.940738 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1025/2173] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:58:18 2022] GET /compute/v2.1/servers/19465083-6d3a-485d-9101-950d9c45abaf => generated 1270 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:58:18.947133 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-6382fc22-be1b-4e03-bca9-a4724d76e9db tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:58:18.951230 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-6382fc22-be1b-4e03-bca9-a4724d76e9db tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] [instance: aee36c9d-baf4-453c-b88f-31b8f23638c2] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:58:18.978023 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6382fc22-be1b-4e03-bca9-a4724d76e9db tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:18.978776 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6382fc22-be1b-4e03-bca9-a4724d76e9db tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:18.979475 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6382fc22-be1b-4e03-bca9-a4724d76e9db tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:18.980335 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6382fc22-be1b-4e03-bca9-a4724d76e9db tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:18.982764 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6382fc22-be1b-4e03-bca9-a4724d76e9db tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:18.983197 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6382fc22-be1b-4e03-bca9-a4724d76e9db tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:19.506651 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-70a26650-c47b-4648-9381-7bc73bb31863 tempest-ImagesMetadataTestJSON-540542917 tempest-ImagesMetadataTestJSON-540542917-project] 10.222.0.18 "PUT /compute/v2.1/images/cca411ce-7ae8-4278-bf05-360c443077f8/metadata" status: 200 len: 61 microversion: 2.1 time: 0.813086 Oct 22 20:58:19.507262 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1149/2174] 10.222.0.18 () {60 vars in 1280 bytes} [Sat Oct 22 20:58:18 2022] PUT /compute/v2.1/images/cca411ce-7ae8-4278-bf05-360c443077f8/metadata => generated 61 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 22 20:58:19.512659 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-38952553-a49b-4d64-980e-857117b533da tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:58:19.513807 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-38952553-a49b-4d64-980e-857117b533da tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] [instance: f070b144-3a1a-4456-8e5b-02af12557c6a] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:58:19.534620 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-38952553-a49b-4d64-980e-857117b533da tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:19.535466 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-38952553-a49b-4d64-980e-857117b533da tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:19.536080 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-38952553-a49b-4d64-980e-857117b533da tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:19.537693 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-38952553-a49b-4d64-980e-857117b533da tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:19.540990 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-38952553-a49b-4d64-980e-857117b533da tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:19.541593 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-38952553-a49b-4d64-980e-857117b533da tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:19.554853 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-6382fc22-be1b-4e03-bca9-a4724d76e9db tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d3d7458af447bdb3f03e83a2d8559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49238b8686d24ae698679e4a1957735d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:58:19.566174 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-6382fc22-be1b-4e03-bca9-a4724d76e9db tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] 10.222.0.18 "GET /compute/v2.1/servers/aee36c9d-baf4-453c-b88f-31b8f23638c2" status: 200 len: 1535 microversion: 2.1 time: 0.624089 Oct 22 20:58:19.568731 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1026/2175] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:58:18 2022] GET /compute/v2.1/servers/aee36c9d-baf4-453c-b88f-31b8f23638c2 => generated 1535 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:58:19.578232 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-c81bf906-e140-46b6-81f2-1cb27519dab9 tempest-ServerPasswordTestJSON-1023240106 tempest-ServerPasswordTestJSON-1023240106-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:58:19.580933 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-c81bf906-e140-46b6-81f2-1cb27519dab9 tempest-ServerPasswordTestJSON-1023240106 tempest-ServerPasswordTestJSON-1023240106-project] [instance: 659e6aaf-82b7-4361-8289-970d6de4a7b7] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:58:19.606025 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c81bf906-e140-46b6-81f2-1cb27519dab9 tempest-ServerPasswordTestJSON-1023240106 tempest-ServerPasswordTestJSON-1023240106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:19.609461 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c81bf906-e140-46b6-81f2-1cb27519dab9 tempest-ServerPasswordTestJSON-1023240106 tempest-ServerPasswordTestJSON-1023240106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:19.610221 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c81bf906-e140-46b6-81f2-1cb27519dab9 tempest-ServerPasswordTestJSON-1023240106 tempest-ServerPasswordTestJSON-1023240106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:19.610964 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c81bf906-e140-46b6-81f2-1cb27519dab9 tempest-ServerPasswordTestJSON-1023240106 tempest-ServerPasswordTestJSON-1023240106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:19.613341 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c81bf906-e140-46b6-81f2-1cb27519dab9 tempest-ServerPasswordTestJSON-1023240106 tempest-ServerPasswordTestJSON-1023240106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:19.613779 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c81bf906-e140-46b6-81f2-1cb27519dab9 tempest-ServerPasswordTestJSON-1023240106 tempest-ServerPasswordTestJSON-1023240106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:19.808865 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-c81bf906-e140-46b6-81f2-1cb27519dab9 tempest-ServerPasswordTestJSON-1023240106 tempest-ServerPasswordTestJSON-1023240106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3466ea643c9142cfa0678d4cc277faab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9492cfb8c4487989bce6074736df04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:58:19.820898 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-c81bf906-e140-46b6-81f2-1cb27519dab9 tempest-ServerPasswordTestJSON-1023240106 tempest-ServerPasswordTestJSON-1023240106-project] 10.222.0.18 "GET /compute/v2.1/servers/659e6aaf-82b7-4361-8289-970d6de4a7b7" status: 200 len: 1468 microversion: 2.1 time: 0.250539 Oct 22 20:58:19.822291 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1027/2176] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:58:19 2022] GET /compute/v2.1/servers/659e6aaf-82b7-4361-8289-970d6de4a7b7 => generated 1468 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:58:19.839737 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-717d9363-ba85-4930-8714-01a1028db9e7 tempest-ImagesMetadataTestJSON-540542917 tempest-ImagesMetadataTestJSON-540542917-project] Calling method '.version_select at 0x7fd3a40c4940>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:58:20.074330 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-38952553-a49b-4d64-980e-857117b533da tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dbe89a7e11480194d3d86f82983499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8351b01e07cd43f9be973ab45e522bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:58:20.096824 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-38952553-a49b-4d64-980e-857117b533da tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] 10.222.0.18 "GET /compute/v2.1/servers/f070b144-3a1a-4456-8e5b-02af12557c6a" status: 200 len: 1477 microversion: 2.1 time: 0.587532 Oct 22 20:58:20.115630 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1150/2177] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:58:19 2022] GET /compute/v2.1/servers/f070b144-3a1a-4456-8e5b-02af12557c6a => generated 1477 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:58:20.121342 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-b125008d-8aaa-4193-b336-55a7efdd386a tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:58:20.122230 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-b125008d-8aaa-4193-b336-55a7efdd386a tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] [instance: 19465083-6d3a-485d-9101-950d9c45abaf] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:58:20.130001 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b125008d-8aaa-4193-b336-55a7efdd386a tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:20.130719 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b125008d-8aaa-4193-b336-55a7efdd386a tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:20.131425 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b125008d-8aaa-4193-b336-55a7efdd386a tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:20.132277 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b125008d-8aaa-4193-b336-55a7efdd386a tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:20.132872 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b125008d-8aaa-4193-b336-55a7efdd386a tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:20.133457 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b125008d-8aaa-4193-b336-55a7efdd386a tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:20.248713 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-b125008d-8aaa-4193-b336-55a7efdd386a tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb8017457354ed68be65cb426965cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af194191cdc4b34a470c821a932e2fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:58:20.258126 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-b125008d-8aaa-4193-b336-55a7efdd386a tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] 10.222.0.18 "GET /compute/v2.1/servers/19465083-6d3a-485d-9101-950d9c45abaf" status: 200 len: 1274 microversion: 2.1 time: 0.141098 Oct 22 20:58:20.270720 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-717d9363-ba85-4930-8714-01a1028db9e7 tempest-ImagesMetadataTestJSON-540542917 tempest-ImagesMetadataTestJSON-540542917-project] 10.222.0.18 "DELETE /compute/v2.1/images/cca411ce-7ae8-4278-bf05-360c443077f8/metadata/os_version" status: 204 len: 0 microversion: 2.1 time: 0.446968 Oct 22 20:58:20.271729 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1028/2178] 10.222.0.18 () {58 vars in 1296 bytes} [Sat Oct 22 20:58:19 2022] DELETE /compute/v2.1/images/cca411ce-7ae8-4278-bf05-360c443077f8/metadata/os_version => generated 0 bytes in 449 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 20:58:20.272347 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1151/2179] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:58:20 2022] GET /compute/v2.1/servers/19465083-6d3a-485d-9101-950d9c45abaf => generated 1274 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:58:20.284314 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-849d52d7-2c25-4526-83c4-0edab6fa2138 tempest-ImagesMetadataTestJSON-540542917 tempest-ImagesMetadataTestJSON-540542917-project] Calling method '.version_select at 0x7fd3a40d0b80>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:58:20.355920 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-849d52d7-2c25-4526-83c4-0edab6fa2138 tempest-ImagesMetadataTestJSON-540542917 tempest-ImagesMetadataTestJSON-540542917-project] 10.222.0.18 "GET /compute/v2.1/images/cca411ce-7ae8-4278-bf05-360c443077f8/metadata" status: 200 len: 37 microversion: 2.1 time: 0.079857 Oct 22 20:58:20.372666 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-49fe868a-0ef6-437a-b172-0a867570a33a tempest-ImagesMetadataTestJSON-540542917 tempest-ImagesMetadataTestJSON-540542917-project] Action: 'update_all', calling method: .version_select at 0x7fd39fd30550>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:58:20.373957 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1029/2180] 10.222.0.18 () {58 vars in 1260 bytes} [Sat Oct 22 20:58:20 2022] GET /compute/v2.1/images/cca411ce-7ae8-4278-bf05-360c443077f8/metadata => generated 37 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 22 20:58:20.443328 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-49fe868a-0ef6-437a-b172-0a867570a33a tempest-ImagesMetadataTestJSON-540542917 tempest-ImagesMetadataTestJSON-540542917-project] Getting quotas for project 09ca841aa454436bb5a39886ad584f89. Resources: dict_keys(['metadata_items']) {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 20:58:20.450403 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-49fe868a-0ef6-437a-b172-0a867570a33a tempest-ImagesMetadataTestJSON-540542917 tempest-ImagesMetadataTestJSON-540542917-project] Getting quotas for user b484e4419e934590b5bbf6adf35cdd45 and project 09ca841aa454436bb5a39886ad584f89. Resources: dict_keys(['metadata_items']) {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 20:58:20.604427 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-fdcf8b24-06e4-4118-a853-1cb435b1db67 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:58:20.606280 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-fdcf8b24-06e4-4118-a853-1cb435b1db67 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] [instance: aee36c9d-baf4-453c-b88f-31b8f23638c2] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:58:20.634298 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fdcf8b24-06e4-4118-a853-1cb435b1db67 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:20.635046 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fdcf8b24-06e4-4118-a853-1cb435b1db67 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:20.635715 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fdcf8b24-06e4-4118-a853-1cb435b1db67 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:20.636871 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fdcf8b24-06e4-4118-a853-1cb435b1db67 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:20.637542 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fdcf8b24-06e4-4118-a853-1cb435b1db67 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:20.638833 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fdcf8b24-06e4-4118-a853-1cb435b1db67 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:21.044876 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-49fe868a-0ef6-437a-b172-0a867570a33a tempest-ImagesMetadataTestJSON-540542917 tempest-ImagesMetadataTestJSON-540542917-project] 10.222.0.18 "PUT /compute/v2.1/images/cca411ce-7ae8-4278-bf05-360c443077f8/metadata" status: 200 len: 61 microversion: 2.1 time: 0.678319 Oct 22 20:58:21.046001 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1152/2181] 10.222.0.18 () {60 vars in 1280 bytes} [Sat Oct 22 20:58:20 2022] PUT /compute/v2.1/images/cca411ce-7ae8-4278-bf05-360c443077f8/metadata => generated 61 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 22 20:58:21.052239 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-b1182c77-be29-4542-803c-c2c1c97a9107 tempest-ServerPasswordTestJSON-1023240106 tempest-ServerPasswordTestJSON-1023240106-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:58:21.053327 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-b1182c77-be29-4542-803c-c2c1c97a9107 tempest-ServerPasswordTestJSON-1023240106 tempest-ServerPasswordTestJSON-1023240106-project] [instance: 659e6aaf-82b7-4361-8289-970d6de4a7b7] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:58:21.061213 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b1182c77-be29-4542-803c-c2c1c97a9107 tempest-ServerPasswordTestJSON-1023240106 tempest-ServerPasswordTestJSON-1023240106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:21.062349 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b1182c77-be29-4542-803c-c2c1c97a9107 tempest-ServerPasswordTestJSON-1023240106 tempest-ServerPasswordTestJSON-1023240106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:21.063051 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b1182c77-be29-4542-803c-c2c1c97a9107 tempest-ServerPasswordTestJSON-1023240106 tempest-ServerPasswordTestJSON-1023240106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:21.064177 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b1182c77-be29-4542-803c-c2c1c97a9107 tempest-ServerPasswordTestJSON-1023240106 tempest-ServerPasswordTestJSON-1023240106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:21.065141 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b1182c77-be29-4542-803c-c2c1c97a9107 tempest-ServerPasswordTestJSON-1023240106 tempest-ServerPasswordTestJSON-1023240106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:21.066654 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b1182c77-be29-4542-803c-c2c1c97a9107 tempest-ServerPasswordTestJSON-1023240106 tempest-ServerPasswordTestJSON-1023240106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:21.149635 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b1182c77-be29-4542-803c-c2c1c97a9107 tempest-ServerPasswordTestJSON-1023240106 tempest-ServerPasswordTestJSON-1023240106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:21.150943 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b1182c77-be29-4542-803c-c2c1c97a9107 tempest-ServerPasswordTestJSON-1023240106 tempest-ServerPasswordTestJSON-1023240106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:21.152261 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b1182c77-be29-4542-803c-c2c1c97a9107 tempest-ServerPasswordTestJSON-1023240106 tempest-ServerPasswordTestJSON-1023240106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:21.155956 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.objects.instance [None req-b1182c77-be29-4542-803c-c2c1c97a9107 tempest-ServerPasswordTestJSON-1023240106 tempest-ServerPasswordTestJSON-1023240106-project] Lazy-loading 'fault' on Instance uuid 659e6aaf-82b7-4361-8289-970d6de4a7b7 {{(pid=138745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 20:58:21.230337 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-fdcf8b24-06e4-4118-a853-1cb435b1db67 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d3d7458af447bdb3f03e83a2d8559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49238b8686d24ae698679e4a1957735d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:58:21.249005 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-fdcf8b24-06e4-4118-a853-1cb435b1db67 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] 10.222.0.18 "GET /compute/v2.1/servers/aee36c9d-baf4-453c-b88f-31b8f23638c2" status: 200 len: 1535 microversion: 2.1 time: 0.660043 Oct 22 20:58:21.251090 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1030/2182] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:58:20 2022] GET /compute/v2.1/servers/aee36c9d-baf4-453c-b88f-31b8f23638c2 => generated 1535 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 20:58:21.268846 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-4a512f83-a58e-4477-8846-d161922a5353 tempest-ImagesMetadataTestJSON-540542917 tempest-ImagesMetadataTestJSON-540542917-project] Calling method '.version_select at 0x7fd3a40665e0>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:58:21.299599 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-b1182c77-be29-4542-803c-c2c1c97a9107 tempest-ServerPasswordTestJSON-1023240106 tempest-ServerPasswordTestJSON-1023240106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3466ea643c9142cfa0678d4cc277faab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9492cfb8c4487989bce6074736df04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:58:21.341006 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-b1182c77-be29-4542-803c-c2c1c97a9107 tempest-ServerPasswordTestJSON-1023240106 tempest-ServerPasswordTestJSON-1023240106-project] 10.222.0.18 "GET /compute/v2.1/servers/659e6aaf-82b7-4361-8289-970d6de4a7b7" status: 200 len: 1306 microversion: 2.1 time: 0.284399 Oct 22 20:58:21.346702 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-4a512f83-a58e-4477-8846-d161922a5353 tempest-ImagesMetadataTestJSON-540542917 tempest-ImagesMetadataTestJSON-540542917-project] 10.222.0.18 "GET /compute/v2.1/images/cca411ce-7ae8-4278-bf05-360c443077f8/metadata/os_distro" status: 200 len: 33 microversion: 2.1 time: 0.090668 Oct 22 20:58:21.349508 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1031/2183] 10.222.0.18 () {58 vars in 1290 bytes} [Sat Oct 22 20:58:21 2022] GET /compute/v2.1/images/cca411ce-7ae8-4278-bf05-360c443077f8/metadata/os_distro => generated 33 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 22 20:58:21.361471 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1153/2184] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:58:21 2022] GET /compute/v2.1/servers/659e6aaf-82b7-4361-8289-970d6de4a7b7 => generated 1306 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:58:21.366542 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-716a96e6-f435-47d4-be15-cb6ac3fd51e3 tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:58:21.370732 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-716a96e6-f435-47d4-be15-cb6ac3fd51e3 tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] [instance: 19465083-6d3a-485d-9101-950d9c45abaf] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:58:21.382126 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-716a96e6-f435-47d4-be15-cb6ac3fd51e3 tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:21.382858 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-716a96e6-f435-47d4-be15-cb6ac3fd51e3 tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:21.383472 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-716a96e6-f435-47d4-be15-cb6ac3fd51e3 tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:21.384329 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-716a96e6-f435-47d4-be15-cb6ac3fd51e3 tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:21.384916 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-716a96e6-f435-47d4-be15-cb6ac3fd51e3 tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:21.385565 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-716a96e6-f435-47d4-be15-cb6ac3fd51e3 tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:21.388754 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-8f895a0a-abe5-4b18-88cd-e14fdabb44d4 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:58:21.393206 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-8f895a0a-abe5-4b18-88cd-e14fdabb44d4 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] [instance: f070b144-3a1a-4456-8e5b-02af12557c6a] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:58:21.434851 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8f895a0a-abe5-4b18-88cd-e14fdabb44d4 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:21.437301 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8f895a0a-abe5-4b18-88cd-e14fdabb44d4 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:21.440550 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8f895a0a-abe5-4b18-88cd-e14fdabb44d4 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:21.446282 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8f895a0a-abe5-4b18-88cd-e14fdabb44d4 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:21.446782 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8f895a0a-abe5-4b18-88cd-e14fdabb44d4 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:21.448123 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8f895a0a-abe5-4b18-88cd-e14fdabb44d4 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:21.623446 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-716a96e6-f435-47d4-be15-cb6ac3fd51e3 tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb8017457354ed68be65cb426965cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af194191cdc4b34a470c821a932e2fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:58:21.649359 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-716a96e6-f435-47d4-be15-cb6ac3fd51e3 tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] 10.222.0.18 "GET /compute/v2.1/servers/19465083-6d3a-485d-9101-950d9c45abaf" status: 200 len: 1330 microversion: 2.1 time: 0.286548 Oct 22 20:58:21.656023 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1154/2185] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:58:21 2022] GET /compute/v2.1/servers/19465083-6d3a-485d-9101-950d9c45abaf => generated 1330 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:58:21.689078 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-d9e92348-aec8-4bcd-933f-1f62b2326df5 tempest-ImagesMetadataTestJSON-540542917 tempest-ImagesMetadataTestJSON-540542917-project] Action: 'update_all', calling method: .version_select at 0x7fd39fd7b790>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:58:21.825050 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-d9e92348-aec8-4bcd-933f-1f62b2326df5 tempest-ImagesMetadataTestJSON-540542917 tempest-ImagesMetadataTestJSON-540542917-project] Getting quotas for project 09ca841aa454436bb5a39886ad584f89. Resources: dict_keys(['metadata_items']) {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 20:58:21.852440 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-d9e92348-aec8-4bcd-933f-1f62b2326df5 tempest-ImagesMetadataTestJSON-540542917 tempest-ImagesMetadataTestJSON-540542917-project] Getting quotas for user b484e4419e934590b5bbf6adf35cdd45 and project 09ca841aa454436bb5a39886ad584f89. Resources: dict_keys(['metadata_items']) {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 20:58:21.887929 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:58:22.033016 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-8f895a0a-abe5-4b18-88cd-e14fdabb44d4 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dbe89a7e11480194d3d86f82983499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8351b01e07cd43f9be973ab45e522bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:58:22.044795 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-8f895a0a-abe5-4b18-88cd-e14fdabb44d4 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] 10.222.0.18 "GET /compute/v2.1/servers/f070b144-3a1a-4456-8e5b-02af12557c6a" status: 200 len: 1463 microversion: 2.1 time: 0.693939 Oct 22 20:58:22.064777 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1032/2186] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:58:21 2022] GET /compute/v2.1/servers/f070b144-3a1a-4456-8e5b-02af12557c6a => generated 1463 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:58:22.085591 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-1b816876-81fc-4355-abf1-a3298155aa1a tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:58:22.089930 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-1b816876-81fc-4355-abf1-a3298155aa1a tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] [instance: f070b144-3a1a-4456-8e5b-02af12557c6a] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:58:22.116869 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1b816876-81fc-4355-abf1-a3298155aa1a tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:22.117459 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1b816876-81fc-4355-abf1-a3298155aa1a tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:22.121028 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1b816876-81fc-4355-abf1-a3298155aa1a tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:22.122945 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1b816876-81fc-4355-abf1-a3298155aa1a tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:22.123636 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1b816876-81fc-4355-abf1-a3298155aa1a tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:22.129627 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1b816876-81fc-4355-abf1-a3298155aa1a tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:22.192865 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-d9e92348-aec8-4bcd-933f-1f62b2326df5 tempest-ImagesMetadataTestJSON-540542917 tempest-ImagesMetadataTestJSON-540542917-project] 10.222.0.18 "PUT /compute/v2.1/images/cca411ce-7ae8-4278-bf05-360c443077f8/metadata" status: 200 len: 61 microversion: 2.1 time: 0.528031 Oct 22 20:58:22.199855 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1155/2187] 10.222.0.18 () {60 vars in 1280 bytes} [Sat Oct 22 20:58:21 2022] PUT /compute/v2.1/images/cca411ce-7ae8-4278-bf05-360c443077f8/metadata => generated 61 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 22 20:58:22.207674 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-8baeaf9b-f829-4e0f-ba9b-cbb4c2443a17 tempest-ImagesMetadataTestJSON-540542917 tempest-ImagesMetadataTestJSON-540542917-project] Calling method '.version_select at 0x7fd39fbe48b0>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:58:22.281459 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-8baeaf9b-f829-4e0f-ba9b-cbb4c2443a17 tempest-ImagesMetadataTestJSON-540542917 tempest-ImagesMetadataTestJSON-540542917-project] 10.222.0.18 "GET /compute/v2.1/images/cca411ce-7ae8-4278-bf05-360c443077f8/metadata" status: 200 len: 61 microversion: 2.1 time: 0.079687 Oct 22 20:58:22.282716 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1156/2188] 10.222.0.18 () {58 vars in 1260 bytes} [Sat Oct 22 20:58:22 2022] GET /compute/v2.1/images/cca411ce-7ae8-4278-bf05-360c443077f8/metadata => generated 61 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 22 20:58:22.289488 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-a6706672-9dd9-4411-afcb-8c9014e70ca2 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:58:22.290500 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-a6706672-9dd9-4411-afcb-8c9014e70ca2 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] [instance: aee36c9d-baf4-453c-b88f-31b8f23638c2] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:58:22.305889 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a6706672-9dd9-4411-afcb-8c9014e70ca2 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:22.307610 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a6706672-9dd9-4411-afcb-8c9014e70ca2 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:22.309605 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a6706672-9dd9-4411-afcb-8c9014e70ca2 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:22.310599 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a6706672-9dd9-4411-afcb-8c9014e70ca2 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:22.313656 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a6706672-9dd9-4411-afcb-8c9014e70ca2 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:22.314378 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a6706672-9dd9-4411-afcb-8c9014e70ca2 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:22.670107 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-1b816876-81fc-4355-abf1-a3298155aa1a tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dbe89a7e11480194d3d86f82983499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8351b01e07cd43f9be973ab45e522bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:58:22.681732 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-1b816876-81fc-4355-abf1-a3298155aa1a tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] 10.222.0.18 "GET /compute/v2.1/servers/f070b144-3a1a-4456-8e5b-02af12557c6a" status: 200 len: 1463 microversion: 2.1 time: 0.607638 Oct 22 20:58:22.684813 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1033/2189] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:58:22 2022] GET /compute/v2.1/servers/f070b144-3a1a-4456-8e5b-02af12557c6a => generated 1463 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 20:58:22.694220 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-98c63935-b1f8-4e7a-88e7-210c3d59e8f4 tempest-ImagesMetadataTestJSON-540542917 tempest-ImagesMetadataTestJSON-540542917-project] Action: 'update_all', calling method: .version_select at 0x7fd39fed6280>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:58:22.773519 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-98c63935-b1f8-4e7a-88e7-210c3d59e8f4 tempest-ImagesMetadataTestJSON-540542917 tempest-ImagesMetadataTestJSON-540542917-project] Getting quotas for project 09ca841aa454436bb5a39886ad584f89. Resources: dict_keys(['metadata_items']) {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 20:58:22.779997 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-98c63935-b1f8-4e7a-88e7-210c3d59e8f4 tempest-ImagesMetadataTestJSON-540542917 tempest-ImagesMetadataTestJSON-540542917-project] Getting quotas for user b484e4419e934590b5bbf6adf35cdd45 and project 09ca841aa454436bb5a39886ad584f89. Resources: dict_keys(['metadata_items']) {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 20:58:22.900442 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-a6706672-9dd9-4411-afcb-8c9014e70ca2 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d3d7458af447bdb3f03e83a2d8559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49238b8686d24ae698679e4a1957735d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:58:22.917697 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-a6706672-9dd9-4411-afcb-8c9014e70ca2 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] 10.222.0.18 "GET /compute/v2.1/servers/aee36c9d-baf4-453c-b88f-31b8f23638c2" status: 200 len: 1528 microversion: 2.1 time: 0.632575 Oct 22 20:58:22.918613 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1157/2190] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:58:22 2022] GET /compute/v2.1/servers/aee36c9d-baf4-453c-b88f-31b8f23638c2 => generated 1528 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:58:22.924944 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-18fc80b5-9891-4a8b-9b3b-2f503ee52e26 tempest-ServerPasswordTestJSON-1023240106 tempest-ServerPasswordTestJSON-1023240106-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:58:22.932718 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-18fc80b5-9891-4a8b-9b3b-2f503ee52e26 tempest-ServerPasswordTestJSON-1023240106 tempest-ServerPasswordTestJSON-1023240106-project] [instance: 659e6aaf-82b7-4361-8289-970d6de4a7b7] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:58:22.941303 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-18fc80b5-9891-4a8b-9b3b-2f503ee52e26 tempest-ServerPasswordTestJSON-1023240106 tempest-ServerPasswordTestJSON-1023240106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:22.942612 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-18fc80b5-9891-4a8b-9b3b-2f503ee52e26 tempest-ServerPasswordTestJSON-1023240106 tempest-ServerPasswordTestJSON-1023240106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:22.949405 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-18fc80b5-9891-4a8b-9b3b-2f503ee52e26 tempest-ServerPasswordTestJSON-1023240106 tempest-ServerPasswordTestJSON-1023240106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:22.950543 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-18fc80b5-9891-4a8b-9b3b-2f503ee52e26 tempest-ServerPasswordTestJSON-1023240106 tempest-ServerPasswordTestJSON-1023240106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:22.951277 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-18fc80b5-9891-4a8b-9b3b-2f503ee52e26 tempest-ServerPasswordTestJSON-1023240106 tempest-ServerPasswordTestJSON-1023240106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:22.951972 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-18fc80b5-9891-4a8b-9b3b-2f503ee52e26 tempest-ServerPasswordTestJSON-1023240106 tempest-ServerPasswordTestJSON-1023240106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:22.974950 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.wsgi [None req-18fc80b5-9891-4a8b-9b3b-2f503ee52e26 tempest-ServerPasswordTestJSON-1023240106 tempest-ServerPasswordTestJSON-1023240106-project] HTTP exception thrown: Instance 659e6aaf-82b7-4361-8289-970d6de4a7b7 could not be found. Oct 22 20:58:22.977396 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-18fc80b5-9891-4a8b-9b3b-2f503ee52e26 tempest-ServerPasswordTestJSON-1023240106 tempest-ServerPasswordTestJSON-1023240106-project] Request method failure captured: Oct 22 20:58:22.977396 ncdv-master-1 devstack@n-api.service[138745]: request: GET /compute/v2.1/servers/659e6aaf-82b7-4361-8289-970d6de4a7b7 HTTP/1.1 Oct 22 20:58:22.977396 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 20:58:22.977396 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 20:58:22.977396 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 20:58:22.977396 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 0 Oct 22 20:58:22.977396 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 20:58:22.977396 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 20:58:22.977396 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 20:58:22.977396 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 20:58:22.977396 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVFlLiBfBrYjqy5gq5KIWFF78YBZoM_mvmVUAJMFzIaOcq59s0mx0E4OdPph2zz1Sx8dz0RETPbUl6s-Uva6cXcHU9Mqc9-VxOFDMCJ7ZICY_a88-4BWnlt_rmXW2rGD6miJsQ5hMHqi56X5YxzWtHhK-z2qaIfZ9g2nuvIMzCg7eq2A Oct 22 20:58:22.977396 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 20:58:22.977396 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 20:58:22.977396 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 20:58:22.977396 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 20:58:22.977396 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 20:58:22.977396 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 20:58:22.977396 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: 3e9492cfb8c4487989bce6074736df04 Oct 22 20:58:22.977396 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-ServerPasswordTestJSON-1023240106 Oct 22 20:58:22.977396 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 20:58:22.977396 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 20:58:22.977396 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_3e9492cfb8c4487989bce6074736df04"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/3e9492cfb8c4487989bce6074736df04"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/3e9492cfb8c4487989bce6074736df04"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/3e9492cfb8c4487989bce6074736df04"}]}] Oct 22 20:58:22.977396 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-ServerPasswordTestJSON-1023240106 Oct 22 20:58:22.977396 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: 3e9492cfb8c4487989bce6074736df04 Oct 22 20:58:22.977396 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-ServerPasswordTestJSON-1023240106 Oct 22 20:58:22.977396 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-ServerPasswordTestJSON-1023240106-project Oct 22 20:58:22.977396 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 20:58:22.977396 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 20:58:22.977396 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: 3466ea643c9142cfa0678d4cc277faab Oct 22 20:58:22.977396 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-ServerPasswordTestJSON-1023240106-project Oct 22 20:58:22.977396 ncdv-master-1 devstack@n-api.service[138745]: method: > Oct 22 20:58:22.977396 ncdv-master-1 devstack@n-api.service[138745]: exception: Instance 659e6aaf-82b7-4361-8289-970d6de4a7b7 could not be found. Oct 22 20:58:22.977396 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'id': '659e6aaf-82b7-4361-8289-970d6de4a7b7'} Oct 22 20:58:22.977396 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:58:22.977396 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:58:22.977396 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 20:58:22.977396 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 20:58:22.977396 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 20:58:22.977396 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 20:58:22.977396 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 20:58:22.977396 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 20:58:22.977396 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 20:58:22.977396 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 20:58:22.977396 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 659e6aaf-82b7-4361-8289-970d6de4a7b7 could not be found. Oct 22 20:58:22.977396 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:58:22.977396 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:58:22.977396 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:58:22.977396 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:58:22.977396 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:58:22.977396 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:58:22.977396 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:58:22.977396 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:58:22.977396 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:58:22.977396 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:58:22.977396 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 20:58:22.977396 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 20:58:22.977396 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 20:58:22.977396 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 20:58:22.977396 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 20:58:22.977396 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 20:58:22.977396 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 659e6aaf-82b7-4361-8289-970d6de4a7b7 could not be found. Oct 22 20:58:22.977396 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:58:22.977396 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:58:22.977396 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:58:22.981459 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:58:22.981459 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:58:22.981459 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:58:22.981459 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 20:58:22.981459 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 20:58:22.981459 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 659e6aaf-82b7-4361-8289-970d6de4a7b7 could not be found. Oct 22 20:58:22.981459 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:58:22.983780 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-18fc80b5-9891-4a8b-9b3b-2f503ee52e26 tempest-ServerPasswordTestJSON-1023240106 tempest-ServerPasswordTestJSON-1023240106-project] Returning 404 to user: Instance 659e6aaf-82b7-4361-8289-970d6de4a7b7 could not be found. {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:58:22.984986 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-18fc80b5-9891-4a8b-9b3b-2f503ee52e26 tempest-ServerPasswordTestJSON-1023240106 tempest-ServerPasswordTestJSON-1023240106-project] 10.222.0.18 "GET /compute/v2.1/servers/659e6aaf-82b7-4361-8289-970d6de4a7b7" status: 404 len: 111 microversion: 2.1 time: 0.064076 Oct 22 20:58:22.989158 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1158/2191] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:58:22 2022] GET /compute/v2.1/servers/659e6aaf-82b7-4361-8289-970d6de4a7b7 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 20:58:23.000500 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-ddf4a4ae-3471-46e6-81e6-1e16640cf2b4 tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:58:23.001129 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-ddf4a4ae-3471-46e6-81e6-1e16640cf2b4 tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] [instance: 19465083-6d3a-485d-9101-950d9c45abaf] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:58:23.015583 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ddf4a4ae-3471-46e6-81e6-1e16640cf2b4 tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:23.016128 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ddf4a4ae-3471-46e6-81e6-1e16640cf2b4 tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:23.016509 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ddf4a4ae-3471-46e6-81e6-1e16640cf2b4 tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:23.019954 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ddf4a4ae-3471-46e6-81e6-1e16640cf2b4 tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:23.020452 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ddf4a4ae-3471-46e6-81e6-1e16640cf2b4 tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:23.020898 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ddf4a4ae-3471-46e6-81e6-1e16640cf2b4 tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:23.145684 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-98c63935-b1f8-4e7a-88e7-210c3d59e8f4 tempest-ImagesMetadataTestJSON-540542917 tempest-ImagesMetadataTestJSON-540542917-project] 10.222.0.18 "PUT /compute/v2.1/images/cca411ce-7ae8-4278-bf05-360c443077f8/metadata" status: 200 len: 61 microversion: 2.1 time: 0.459543 Oct 22 20:58:23.151272 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1034/2192] 10.222.0.18 () {60 vars in 1280 bytes} [Sat Oct 22 20:58:22 2022] PUT /compute/v2.1/images/cca411ce-7ae8-4278-bf05-360c443077f8/metadata => generated 61 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 22 20:58:23.159701 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-f77f81ad-c985-49d3-a8c8-acaffaaed193 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "085e4478-6edc-4a69-8e08-f9831713eb65"}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:58:23.172113 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-f77f81ad-c985-49d3-a8c8-acaffaaed193 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] [instance: f070b144-3a1a-4456-8e5b-02af12557c6a] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:58:23.185103 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f77f81ad-c985-49d3-a8c8-acaffaaed193 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:23.185904 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f77f81ad-c985-49d3-a8c8-acaffaaed193 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:23.186505 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f77f81ad-c985-49d3-a8c8-acaffaaed193 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:23.192524 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f77f81ad-c985-49d3-a8c8-acaffaaed193 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:23.193450 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f77f81ad-c985-49d3-a8c8-acaffaaed193 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:23.193918 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f77f81ad-c985-49d3-a8c8-acaffaaed193 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:23.682929 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-ddf4a4ae-3471-46e6-81e6-1e16640cf2b4 tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb8017457354ed68be65cb426965cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af194191cdc4b34a470c821a932e2fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:58:23.695396 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-ddf4a4ae-3471-46e6-81e6-1e16640cf2b4 tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] 10.222.0.18 "GET /compute/v2.1/servers/19465083-6d3a-485d-9101-950d9c45abaf" status: 200 len: 1328 microversion: 2.1 time: 0.706099 Oct 22 20:58:23.715676 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1159/2193] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:58:22 2022] GET /compute/v2.1/servers/19465083-6d3a-485d-9101-950d9c45abaf => generated 1328 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:58:23.734380 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-09bc1c48-fb5b-4f65-aabf-94952daa47a6 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:58:23.735541 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-09bc1c48-fb5b-4f65-aabf-94952daa47a6 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] [instance: aee36c9d-baf4-453c-b88f-31b8f23638c2] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:58:23.750617 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-09bc1c48-fb5b-4f65-aabf-94952daa47a6 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:23.751453 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-09bc1c48-fb5b-4f65-aabf-94952daa47a6 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:23.753441 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-09bc1c48-fb5b-4f65-aabf-94952daa47a6 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:23.754365 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-09bc1c48-fb5b-4f65-aabf-94952daa47a6 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:23.756297 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-09bc1c48-fb5b-4f65-aabf-94952daa47a6 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:23.758302 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-09bc1c48-fb5b-4f65-aabf-94952daa47a6 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:23.917415 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-f77f81ad-c985-49d3-a8c8-acaffaaed193 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Flavor limits 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 20:58:23.919756 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-f77f81ad-c985-49d3-a8c8-acaffaaed193 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Image limits 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 20:58:23.920458 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-f77f81ad-c985-49d3-a8c8-acaffaaed193 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Flavor pref 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 20:58:23.922299 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-f77f81ad-c985-49d3-a8c8-acaffaaed193 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Image pref 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 20:58:23.923273 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-f77f81ad-c985-49d3-a8c8-acaffaaed193 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 20:58:23.976280 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-09bc1c48-fb5b-4f65-aabf-94952daa47a6 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d3d7458af447bdb3f03e83a2d8559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49238b8686d24ae698679e4a1957735d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:58:23.984151 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-09bc1c48-fb5b-4f65-aabf-94952daa47a6 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] 10.222.0.18 "GET /compute/v2.1/servers/aee36c9d-baf4-453c-b88f-31b8f23638c2" status: 200 len: 1528 microversion: 2.1 time: 0.265948 Oct 22 20:58:23.990672 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1160/2194] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:58:23 2022] GET /compute/v2.1/servers/aee36c9d-baf4-453c-b88f-31b8f23638c2 => generated 1528 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:58:23.999477 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-2e5a168f-32cf-4bd6-8961-65f43f87d28a tempest-ImagesMetadataTestJSON-540542917 tempest-ImagesMetadataTestJSON-540542917-project] Action: 'update_all', calling method: .version_select at 0x7fd39fc28790>, body: {"metadata": {"os_version": "value2", "architecture": "value3"}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:58:24.098566 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-2e5a168f-32cf-4bd6-8961-65f43f87d28a tempest-ImagesMetadataTestJSON-540542917 tempest-ImagesMetadataTestJSON-540542917-project] Getting quotas for project 09ca841aa454436bb5a39886ad584f89. Resources: dict_keys(['metadata_items']) {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 20:58:24.105647 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-f77f81ad-c985-49d3-a8c8-acaffaaed193 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] [instance: f070b144-3a1a-4456-8e5b-02af12557c6a] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:58:24.120900 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-2e5a168f-32cf-4bd6-8961-65f43f87d28a tempest-ImagesMetadataTestJSON-540542917 tempest-ImagesMetadataTestJSON-540542917-project] Getting quotas for user b484e4419e934590b5bbf6adf35cdd45 and project 09ca841aa454436bb5a39886ad584f89. Resources: dict_keys(['metadata_items']) {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 20:58:24.122871 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f77f81ad-c985-49d3-a8c8-acaffaaed193 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:24.124852 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f77f81ad-c985-49d3-a8c8-acaffaaed193 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:24.126465 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f77f81ad-c985-49d3-a8c8-acaffaaed193 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:24.128684 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f77f81ad-c985-49d3-a8c8-acaffaaed193 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:24.129420 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f77f81ad-c985-49d3-a8c8-acaffaaed193 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:24.131142 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f77f81ad-c985-49d3-a8c8-acaffaaed193 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:24.201148 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-f77f81ad-c985-49d3-a8c8-acaffaaed193 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] 10.222.0.18 "POST /compute/v2.1/servers/f070b144-3a1a-4456-8e5b-02af12557c6a/action" status: 202 len: 1067 microversion: 2.1 time: 1.047170 Oct 22 20:58:24.202677 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1035/2195] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 20:58:23 2022] POST /compute/v2.1/servers/f070b144-3a1a-4456-8e5b-02af12557c6a/action => generated 1067 bytes in 1051 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 22 20:58:24.209715 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-ecb2c4bf-2477-4e10-9105-4eed7777d803 tempest-MigrationsAdminTest-1403807426 tempest-MigrationsAdminTest-1403807426-project-admin] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:58:24.218138 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-ecb2c4bf-2477-4e10-9105-4eed7777d803 tempest-MigrationsAdminTest-1403807426 tempest-MigrationsAdminTest-1403807426-project-admin] HTTP exception thrown: Flavor 1576c14a-5e9b-4ca1-91da-5d29cbf3cec9 could not be found. Oct 22 20:58:24.235541 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-ecb2c4bf-2477-4e10-9105-4eed7777d803 tempest-MigrationsAdminTest-1403807426 tempest-MigrationsAdminTest-1403807426-project-admin] Request method failure captured: Oct 22 20:58:24.235541 ncdv-master-1 devstack@n-api.service[138744]: request: DELETE /compute/v2.1/flavors/1576c14a-5e9b-4ca1-91da-5d29cbf3cec9 HTTP/1.1 Oct 22 20:58:24.235541 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 20:58:24.235541 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 20:58:24.235541 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 20:58:24.235541 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 0 Oct 22 20:58:24.235541 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 20:58:24.235541 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 20:58:24.235541 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 20:58:24.235541 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 20:58:24.235541 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVFhodIifut3og6QSMXLVivzBhdDta9peQykTMkaQK7C6Rn-0CRXiSMq3fJfnXbUvEj28ZX91fuUrcXqkDCVrH71t-ivgLiNvmd24OJbSe_oNVpJdXvsJxEuhNZJjE_Gwxs5aobAlwI3wIJCfCemAJylnyQdniWEmJRX3Ndi5Hc9xzo8 Oct 22 20:58:24.235541 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 20:58:24.235541 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 20:58:24.235541 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 20:58:24.235541 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 20:58:24.235541 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 20:58:24.235541 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 20:58:24.235541 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: 164ae46cbb694cd999c7b4b0bcb4fdba Oct 22 20:58:24.235541 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-MigrationsAdminTest-1403807426 Oct 22 20:58:24.235541 ncdv-master-1 devstack@n-api.service[138744]: X-Role: admin,member,reader Oct 22 20:58:24.235541 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: admin,member,reader Oct 22 20:58:24.235541 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_164ae46cbb694cd999c7b4b0bcb4fdba"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/164ae46cbb694cd999c7b4b0bcb4fdba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/164ae46cbb694cd999c7b4b0bcb4fdba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/164ae46cbb694cd999c7b4b0bcb4fdba"}]}] Oct 22 20:58:24.235541 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-MigrationsAdminTest-1403807426 Oct 22 20:58:24.235541 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: 164ae46cbb694cd999c7b4b0bcb4fdba Oct 22 20:58:24.235541 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-MigrationsAdminTest-1403807426 Oct 22 20:58:24.235541 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-MigrationsAdminTest-1403807426-project-admin Oct 22 20:58:24.235541 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 20:58:24.235541 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 20:58:24.235541 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: 3a4182f462944ed395775d823014f847 Oct 22 20:58:24.235541 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-MigrationsAdminTest-1403807426-project-admin Oct 22 20:58:24.235541 ncdv-master-1 devstack@n-api.service[138744]: method: > Oct 22 20:58:24.235541 ncdv-master-1 devstack@n-api.service[138744]: exception: Flavor 1576c14a-5e9b-4ca1-91da-5d29cbf3cec9 could not be found. Oct 22 20:58:24.235541 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': '1576c14a-5e9b-4ca1-91da-5d29cbf3cec9'} Oct 22 20:58:24.235541 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:58:24.235541 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:58:24.235541 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 43, in _delete Oct 22 20:58:24.235541 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi flavor.destroy() Oct 22 20:58:24.235541 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 22 20:58:24.235541 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 22 20:58:24.235541 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 558, in destroy Oct 22 20:58:24.235541 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi db_flavor = self._flavor_destroy(self._context, Oct 22 20:58:24.235541 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 544, in _flavor_destroy Oct 22 20:58:24.235541 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return _flavor_destroy(context, flavor_id=flavor_id, flavorid=flavorid) Oct 22 20:58:24.235541 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 22 20:58:24.235541 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 22 20:58:24.235541 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 185, in _flavor_destroy Oct 22 20:58:24.235541 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=(flavor_id or flavorid)) Oct 22 20:58:24.235541 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 1576c14a-5e9b-4ca1-91da-5d29cbf3cec9 could not be found. Oct 22 20:58:24.235541 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:58:24.235541 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:58:24.235541 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:58:24.235541 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:58:24.235541 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:58:24.235541 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:58:24.235541 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:58:24.235541 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:58:24.235541 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:58:24.235541 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:58:24.235541 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 45, in _delete Oct 22 20:58:24.235541 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 22 20:58:24.235541 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 1576c14a-5e9b-4ca1-91da-5d29cbf3cec9 could not be found. Oct 22 20:58:24.235541 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:58:24.235541 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:58:24.238995 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:58:24.238995 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:58:24.238995 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:58:24.238995 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:58:24.238995 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 20:58:24.238995 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 20:58:24.238995 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1576c14a-5e9b-4ca1-91da-5d29cbf3cec9 could not be found. Oct 22 20:58:24.238995 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:58:24.243711 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-ecb2c4bf-2477-4e10-9105-4eed7777d803 tempest-MigrationsAdminTest-1403807426 tempest-MigrationsAdminTest-1403807426-project-admin] Returning 404 to user: Flavor 1576c14a-5e9b-4ca1-91da-5d29cbf3cec9 could not be found. {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:58:24.244880 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-ecb2c4bf-2477-4e10-9105-4eed7777d803 tempest-MigrationsAdminTest-1403807426 tempest-MigrationsAdminTest-1403807426-project-admin] 10.222.0.18 "DELETE /compute/v2.1/flavors/1576c14a-5e9b-4ca1-91da-5d29cbf3cec9" status: 404 len: 109 microversion: 2.1 time: 0.040656 Oct 22 20:58:24.245611 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1036/2196] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 20:58:24 2022] DELETE /compute/v2.1/flavors/1576c14a-5e9b-4ca1-91da-5d29cbf3cec9 => generated 109 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 20:58:24.267324 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-60470308-4f12-4f80-b054-d5b97449d5de tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:58:24.268762 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-60470308-4f12-4f80-b054-d5b97449d5de tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] [instance: f070b144-3a1a-4456-8e5b-02af12557c6a] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:58:24.334247 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-60470308-4f12-4f80-b054-d5b97449d5de tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:24.334788 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-60470308-4f12-4f80-b054-d5b97449d5de tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:24.336238 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-60470308-4f12-4f80-b054-d5b97449d5de tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:24.337176 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-60470308-4f12-4f80-b054-d5b97449d5de tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:24.340040 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-60470308-4f12-4f80-b054-d5b97449d5de tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:24.341031 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-60470308-4f12-4f80-b054-d5b97449d5de tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:24.883196 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-2e5a168f-32cf-4bd6-8961-65f43f87d28a tempest-ImagesMetadataTestJSON-540542917 tempest-ImagesMetadataTestJSON-540542917-project] 10.222.0.18 "PUT /compute/v2.1/images/cca411ce-7ae8-4278-bf05-360c443077f8/metadata" status: 200 len: 64 microversion: 2.1 time: 0.891009 Oct 22 20:58:24.887167 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1161/2197] 10.222.0.18 () {60 vars in 1280 bytes} [Sat Oct 22 20:58:23 2022] PUT /compute/v2.1/images/cca411ce-7ae8-4278-bf05-360c443077f8/metadata => generated 64 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 22 20:58:24.894193 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-61079ef5-2c1c-4951-b4a9-909cd3ca01ce tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-163601591", "imageRef": "085e4478-6edc-4a69-8e08-f9831713eb65", "flavorRef": "452"}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:58:24.963231 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.network.neutron [None req-61079ef5-2c1c-4951-b4a9-909cd3ca01ce tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] validate_networks() for None {{(pid=138745) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 20:58:25.462994 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-60470308-4f12-4f80-b054-d5b97449d5de tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dbe89a7e11480194d3d86f82983499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8351b01e07cd43f9be973ab45e522bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:58:25.477236 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-60470308-4f12-4f80-b054-d5b97449d5de tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] 10.222.0.18 "GET /compute/v2.1/servers/f070b144-3a1a-4456-8e5b-02af12557c6a" status: 200 len: 1472 microversion: 2.1 time: 1.228316 Oct 22 20:58:25.479923 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1037/2198] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:58:24 2022] GET /compute/v2.1/servers/f070b144-3a1a-4456-8e5b-02af12557c6a => generated 1472 bytes in 1233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:58:25.658951 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-46daa16d-e466-433d-b81f-058c74526f7d tempest-NetworksTest-188170813 tempest-NetworksTest-188170813-project-admin] Calling method '.version_select at 0x7fd3a4448dc0>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:58:26.213386 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-46daa16d-e466-433d-b81f-058c74526f7d tempest-NetworksTest-188170813 tempest-NetworksTest-188170813-project-admin] 10.222.0.18 "GET /compute/v2.1/os-networks" status: 200 len: 3985 microversion: 2.1 time: 0.731464 Oct 22 20:58:26.214211 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1038/2199] 10.222.0.18 () {58 vars in 1137 bytes} [Sat Oct 22 20:58:25 2022] GET /compute/v2.1/os-networks => generated 3985 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:58:26.222421 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-090e45e2-bfc8-4903-90c0-d25bd937ede6 tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:58:26.223053 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-090e45e2-bfc8-4903-90c0-d25bd937ede6 tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] [instance: 19465083-6d3a-485d-9101-950d9c45abaf] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:58:26.233240 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-090e45e2-bfc8-4903-90c0-d25bd937ede6 tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:26.234037 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-090e45e2-bfc8-4903-90c0-d25bd937ede6 tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:26.234741 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-090e45e2-bfc8-4903-90c0-d25bd937ede6 tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:26.235753 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-090e45e2-bfc8-4903-90c0-d25bd937ede6 tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:26.236372 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-090e45e2-bfc8-4903-90c0-d25bd937ede6 tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:26.237177 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-090e45e2-bfc8-4903-90c0-d25bd937ede6 tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:26.365050 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-61079ef5-2c1c-4951-b4a9-909cd3ca01ce tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Flavor limits 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 20:58:26.365570 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-61079ef5-2c1c-4951-b4a9-909cd3ca01ce tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Image limits 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 20:58:26.366026 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-61079ef5-2c1c-4951-b4a9-909cd3ca01ce tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Flavor pref 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 20:58:26.366567 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-61079ef5-2c1c-4951-b4a9-909cd3ca01ce tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Image pref 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 20:58:26.367085 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-61079ef5-2c1c-4951-b4a9-909cd3ca01ce tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 20:58:26.399815 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-61079ef5-2c1c-4951-b4a9-909cd3ca01ce tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:26.401199 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-61079ef5-2c1c-4951-b4a9-909cd3ca01ce tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:26.402031 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-61079ef5-2c1c-4951-b4a9-909cd3ca01ce tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:26.403322 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-61079ef5-2c1c-4951-b4a9-909cd3ca01ce tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:26.404031 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-61079ef5-2c1c-4951-b4a9-909cd3ca01ce tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:26.404849 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-61079ef5-2c1c-4951-b4a9-909cd3ca01ce tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:26.454200 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-61079ef5-2c1c-4951-b4a9-909cd3ca01ce tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Getting quotas for project 49238b8686d24ae698679e4a1957735d. Resources: {'cores', 'instances', 'ram'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 20:58:26.462209 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-61079ef5-2c1c-4951-b4a9-909cd3ca01ce tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Getting quotas for user e0d3d7458af447bdb3f03e83a2d8559f and project 49238b8686d24ae698679e4a1957735d. Resources: {'cores', 'instances', 'ram'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 20:58:26.491588 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-61079ef5-2c1c-4951-b4a9-909cd3ca01ce tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Going to run 1 instances... {{(pid=138745) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 20:58:26.518059 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-61079ef5-2c1c-4951-b4a9-909cd3ca01ce tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] [instance: c3e6246d-c32a-490d-ba83-84b54822f971] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='085e4478-6edc-4a69-8e08-f9831713eb65',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138745) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 20:58:26.609136 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-61079ef5-2c1c-4951-b4a9-909cd3ca01ce tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.720359 Oct 22 20:58:26.618442 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1162/2200] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Oct 22 20:58:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 1730 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 20:58:26.624315 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-656217c5-ba26-4b25-9b8c-266dc425dcec tempest-ImagesMetadataTestJSON-540542917 tempest-ImagesMetadataTestJSON-540542917-project] Calling method '.version_select at 0x7fd39fb9b700>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:58:26.721203 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-656217c5-ba26-4b25-9b8c-266dc425dcec tempest-ImagesMetadataTestJSON-540542917 tempest-ImagesMetadataTestJSON-540542917-project] 10.222.0.18 "GET /compute/v2.1/images/cca411ce-7ae8-4278-bf05-360c443077f8/metadata" status: 200 len: 64 microversion: 2.1 time: 0.100425 Oct 22 20:58:26.722119 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1163/2201] 10.222.0.18 () {58 vars in 1260 bytes} [Sat Oct 22 20:58:26 2022] GET /compute/v2.1/images/cca411ce-7ae8-4278-bf05-360c443077f8/metadata => generated 64 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 22 20:58:26.737902 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-5b0622e7-dd9d-4aab-8583-fb0a31bd3562 tempest-NetworksTest-188170813 tempest-NetworksTest-188170813-project-admin] Calling method '.version_select at 0x7fd39f0d05e0>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:58:26.767469 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-090e45e2-bfc8-4903-90c0-d25bd937ede6 tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb8017457354ed68be65cb426965cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af194191cdc4b34a470c821a932e2fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:58:26.781908 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-090e45e2-bfc8-4903-90c0-d25bd937ede6 tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] 10.222.0.18 "GET /compute/v2.1/servers/19465083-6d3a-485d-9101-950d9c45abaf" status: 200 len: 1395 microversion: 2.1 time: 0.566264 Oct 22 20:58:26.795370 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1039/2202] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:58:26 2022] GET /compute/v2.1/servers/19465083-6d3a-485d-9101-950d9c45abaf => generated 1395 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:58:26.802253 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-793065b1-b6b1-48e0-b0d6-94bf6b662fcc tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:58:26.802253 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-793065b1-b6b1-48e0-b0d6-94bf6b662fcc tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] [instance: f070b144-3a1a-4456-8e5b-02af12557c6a] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:58:26.818214 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-793065b1-b6b1-48e0-b0d6-94bf6b662fcc tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:26.818731 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-793065b1-b6b1-48e0-b0d6-94bf6b662fcc tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:26.822523 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-793065b1-b6b1-48e0-b0d6-94bf6b662fcc tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:26.825816 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-793065b1-b6b1-48e0-b0d6-94bf6b662fcc tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:26.826381 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-793065b1-b6b1-48e0-b0d6-94bf6b662fcc tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:26.829135 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-793065b1-b6b1-48e0-b0d6-94bf6b662fcc tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:27.187253 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-5b0622e7-dd9d-4aab-8583-fb0a31bd3562 tempest-NetworksTest-188170813 tempest-NetworksTest-188170813-project-admin] 10.222.0.18 "GET /compute/v2.1/os-networks/355a8481-8802-4295-9cce-2185db0a47d1" status: 200 len: 652 microversion: 2.1 time: 0.462242 Oct 22 20:58:27.188269 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1164/2203] 10.222.0.18 () {58 vars in 1248 bytes} [Sat Oct 22 20:58:26 2022] GET /compute/v2.1/os-networks/355a8481-8802-4295-9cce-2185db0a47d1 => generated 652 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:58:27.197386 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-534c0d70-560c-4c62-bf18-a00a7019edc3 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:58:27.198074 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-534c0d70-560c-4c62-bf18-a00a7019edc3 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] [instance: c3e6246d-c32a-490d-ba83-84b54822f971] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:58:27.575989 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-534c0d70-560c-4c62-bf18-a00a7019edc3 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d3d7458af447bdb3f03e83a2d8559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49238b8686d24ae698679e4a1957735d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:58:27.625165 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-534c0d70-560c-4c62-bf18-a00a7019edc3 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] 10.222.0.18 "GET /compute/v2.1/servers/c3e6246d-c32a-490d-ba83-84b54822f971" status: 200 len: 1212 microversion: 2.1 time: 0.407048 Oct 22 20:58:27.626830 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1165/2204] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:58:27 2022] GET /compute/v2.1/servers/c3e6246d-c32a-490d-ba83-84b54822f971 => generated 1212 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:58:27.665106 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-4b33cef1-091f-4b6c-abe9-087628a6fa8a tempest-ImagesMetadataTestJSON-540542917 tempest-ImagesMetadataTestJSON-540542917-project] Action: 'update_all', calling method: .version_select at 0x7fd39fd300d0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:58:27.785194 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-4b33cef1-091f-4b6c-abe9-087628a6fa8a tempest-ImagesMetadataTestJSON-540542917 tempest-ImagesMetadataTestJSON-540542917-project] Getting quotas for project 09ca841aa454436bb5a39886ad584f89. Resources: dict_keys(['metadata_items']) {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 20:58:27.809304 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-4b33cef1-091f-4b6c-abe9-087628a6fa8a tempest-ImagesMetadataTestJSON-540542917 tempest-ImagesMetadataTestJSON-540542917-project] Getting quotas for user b484e4419e934590b5bbf6adf35cdd45 and project 09ca841aa454436bb5a39886ad584f89. Resources: dict_keys(['metadata_items']) {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 20:58:28.070195 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-793065b1-b6b1-48e0-b0d6-94bf6b662fcc tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dbe89a7e11480194d3d86f82983499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8351b01e07cd43f9be973ab45e522bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:58:28.086009 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-793065b1-b6b1-48e0-b0d6-94bf6b662fcc tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] 10.222.0.18 "GET /compute/v2.1/servers/f070b144-3a1a-4456-8e5b-02af12557c6a" status: 200 len: 1472 microversion: 2.1 time: 1.300459 Oct 22 20:58:28.106035 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1040/2205] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:58:26 2022] GET /compute/v2.1/servers/f070b144-3a1a-4456-8e5b-02af12557c6a => generated 1472 bytes in 1321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:58:28.118969 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-fa384a9d-16ab-4606-aa1f-32c48ca656e5 tempest-NetworksTest-188170813 tempest-NetworksTest-188170813-project-admin] Calling method '.version_select at 0x7fd3a4051b80>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:58:28.480062 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-4b33cef1-091f-4b6c-abe9-087628a6fa8a tempest-ImagesMetadataTestJSON-540542917 tempest-ImagesMetadataTestJSON-540542917-project] 10.222.0.18 "PUT /compute/v2.1/images/cca411ce-7ae8-4278-bf05-360c443077f8/metadata" status: 200 len: 61 microversion: 2.1 time: 0.847308 Oct 22 20:58:28.482483 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1166/2206] 10.222.0.18 () {60 vars in 1280 bytes} [Sat Oct 22 20:58:27 2022] PUT /compute/v2.1/images/cca411ce-7ae8-4278-bf05-360c443077f8/metadata => generated 61 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 22 20:58:28.490709 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-2cf325c0-278b-4ca1-80c5-5eb7e4c55d1d req-c33c5ec6-14c0-47fb-af5b-60005618c921 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aee36c9d-baf4-453c-b88f-31b8f23638c2", "name": "network-vif-plugged", "status": "completed", "tag": "f8ab0e3e-04fa-4f80-97a2-b20b84653be1"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:58:28.525458 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-2cf325c0-278b-4ca1-80c5-5eb7e4c55d1d req-c33c5ec6-14c0-47fb-af5b-60005618c921 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:28.526536 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-2cf325c0-278b-4ca1-80c5-5eb7e4c55d1d req-c33c5ec6-14c0-47fb-af5b-60005618c921 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:28.527251 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-2cf325c0-278b-4ca1-80c5-5eb7e4c55d1d req-c33c5ec6-14c0-47fb-af5b-60005618c921 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:28.562330 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-2cf325c0-278b-4ca1-80c5-5eb7e4c55d1d req-c33c5ec6-14c0-47fb-af5b-60005618c921 service nova] Creating event network-vif-plugged:f8ab0e3e-04fa-4f80-97a2-b20b84653be1 for instance aee36c9d-baf4-453c-b88f-31b8f23638c2 on nch1-master-1 Oct 22 20:58:28.563559 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell0:SELECT=2 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:58:28.571855 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-2cf325c0-278b-4ca1-80c5-5eb7e4c55d1d req-c33c5ec6-14c0-47fb-af5b-60005618c921 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087461 Oct 22 20:58:28.572942 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1167/2207] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:58:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:58:28.582493 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-b3299cf6-15f6-4f34-a883-f396190d4a5d req-2ea27ba5-b522-4b95-bc13-8987970e6415 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19465083-6d3a-485d-9101-950d9c45abaf", "tag": "cdb0c7d2-5618-446f-9f1a-9ed8b48f5bc2"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:58:28.603039 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-fa384a9d-16ab-4606-aa1f-32c48ca656e5 tempest-NetworksTest-188170813 tempest-NetworksTest-188170813-project-admin] 10.222.0.18 "GET /compute/v2.1/os-networks" status: 200 len: 3985 microversion: 2.1 time: 0.495806 Oct 22 20:58:28.603457 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-b3299cf6-15f6-4f34-a883-f396190d4a5d req-2ea27ba5-b522-4b95-bc13-8987970e6415 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:28.603826 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-b3299cf6-15f6-4f34-a883-f396190d4a5d req-2ea27ba5-b522-4b95-bc13-8987970e6415 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:28.604326 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-b3299cf6-15f6-4f34-a883-f396190d4a5d req-2ea27ba5-b522-4b95-bc13-8987970e6415 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:28.604976 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1041/2208] 10.222.0.18 () {58 vars in 1137 bytes} [Sat Oct 22 20:58:28 2022] GET /compute/v2.1/os-networks => generated 3985 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:58:28.614239 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-9474532d-9010-4aed-8672-00c6d75da301 tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:58:28.615982 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-9474532d-9010-4aed-8672-00c6d75da301 tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] [instance: 19465083-6d3a-485d-9101-950d9c45abaf] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:58:28.618279 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-b3299cf6-15f6-4f34-a883-f396190d4a5d req-2ea27ba5-b522-4b95-bc13-8987970e6415 service nova] Creating event network-changed:cdb0c7d2-5618-446f-9f1a-9ed8b48f5bc2 for instance 19465083-6d3a-485d-9101-950d9c45abaf on nch2-master-1 Oct 22 20:58:28.625283 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-b3299cf6-15f6-4f34-a883-f396190d4a5d req-2ea27ba5-b522-4b95-bc13-8987970e6415 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050472 Oct 22 20:58:28.627256 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1168/2209] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:58:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:58:28.644531 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9474532d-9010-4aed-8672-00c6d75da301 tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:28.646843 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9474532d-9010-4aed-8672-00c6d75da301 tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:28.661882 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9474532d-9010-4aed-8672-00c6d75da301 tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:28.664842 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9474532d-9010-4aed-8672-00c6d75da301 tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:28.666540 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-42ce18f9-938e-40d3-93a5-57980fbd4310 tempest-ImagesMetadataTestJSON-540542917 tempest-ImagesMetadataTestJSON-540542917-project] Action: 'update', calling method: .version_select at 0x7fd39f0d0700>, body: {"meta": {"os_version": "alt"}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:58:28.668087 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9474532d-9010-4aed-8672-00c6d75da301 tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:28.669771 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9474532d-9010-4aed-8672-00c6d75da301 tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:28.754146 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-42ce18f9-938e-40d3-93a5-57980fbd4310 tempest-ImagesMetadataTestJSON-540542917 tempest-ImagesMetadataTestJSON-540542917-project] Getting quotas for project 09ca841aa454436bb5a39886ad584f89. Resources: dict_keys(['metadata_items']) {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 20:58:28.762498 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-42ce18f9-938e-40d3-93a5-57980fbd4310 tempest-ImagesMetadataTestJSON-540542917 tempest-ImagesMetadataTestJSON-540542917-project] Getting quotas for user b484e4419e934590b5bbf6adf35cdd45 and project 09ca841aa454436bb5a39886ad584f89. Resources: dict_keys(['metadata_items']) {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 20:58:29.337029 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-42ce18f9-938e-40d3-93a5-57980fbd4310 tempest-ImagesMetadataTestJSON-540542917 tempest-ImagesMetadataTestJSON-540542917-project] 10.222.0.18 "PUT /compute/v2.1/images/cca411ce-7ae8-4278-bf05-360c443077f8/metadata/os_version" status: 200 len: 31 microversion: 2.1 time: 0.708021 Oct 22 20:58:29.338451 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1169/2210] 10.222.0.18 () {60 vars in 1313 bytes} [Sat Oct 22 20:58:28 2022] PUT /compute/v2.1/images/cca411ce-7ae8-4278-bf05-360c443077f8/metadata/os_version => generated 31 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 22 20:58:29.351958 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-b4299cc7-0b40-44a4-b304-26c03f5f7250 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:58:29.352989 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-b4299cc7-0b40-44a4-b304-26c03f5f7250 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] [instance: c3e6246d-c32a-490d-ba83-84b54822f971] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:58:29.360025 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b4299cc7-0b40-44a4-b304-26c03f5f7250 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:29.360524 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b4299cc7-0b40-44a4-b304-26c03f5f7250 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:29.360968 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b4299cc7-0b40-44a4-b304-26c03f5f7250 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:29.361697 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b4299cc7-0b40-44a4-b304-26c03f5f7250 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:29.362152 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b4299cc7-0b40-44a4-b304-26c03f5f7250 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:29.362579 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b4299cc7-0b40-44a4-b304-26c03f5f7250 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:29.378276 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-9474532d-9010-4aed-8672-00c6d75da301 tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb8017457354ed68be65cb426965cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af194191cdc4b34a470c821a932e2fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:58:29.396088 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-9474532d-9010-4aed-8672-00c6d75da301 tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] 10.222.0.18 "GET /compute/v2.1/servers/19465083-6d3a-485d-9101-950d9c45abaf" status: 200 len: 1395 microversion: 2.1 time: 0.789548 Oct 22 20:58:29.396822 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1042/2211] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:58:28 2022] GET /compute/v2.1/servers/19465083-6d3a-485d-9101-950d9c45abaf => generated 1395 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:58:29.401547 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-75556ab7-fb6c-4a81-ba8a-b66fee6500d4 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:58:29.402385 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-75556ab7-fb6c-4a81-ba8a-b66fee6500d4 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] [instance: f070b144-3a1a-4456-8e5b-02af12557c6a] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:58:29.418561 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-75556ab7-fb6c-4a81-ba8a-b66fee6500d4 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:29.419165 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-75556ab7-fb6c-4a81-ba8a-b66fee6500d4 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:29.419705 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-75556ab7-fb6c-4a81-ba8a-b66fee6500d4 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:29.420502 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-75556ab7-fb6c-4a81-ba8a-b66fee6500d4 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:29.421031 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-75556ab7-fb6c-4a81-ba8a-b66fee6500d4 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:29.421734 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-75556ab7-fb6c-4a81-ba8a-b66fee6500d4 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:29.532969 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-b4299cc7-0b40-44a4-b304-26c03f5f7250 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d3d7458af447bdb3f03e83a2d8559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49238b8686d24ae698679e4a1957735d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:58:29.542104 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-b4299cc7-0b40-44a4-b304-26c03f5f7250 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] 10.222.0.18 "GET /compute/v2.1/servers/c3e6246d-c32a-490d-ba83-84b54822f971" status: 200 len: 1270 microversion: 2.1 time: 0.202068 Oct 22 20:58:29.555373 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1170/2212] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:58:29 2022] GET /compute/v2.1/servers/c3e6246d-c32a-490d-ba83-84b54822f971 => generated 1270 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:58:29.563957 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-532e27e5-13ff-4b2b-ad4b-71f98bb1d27d tempest-ImagesMetadataTestJSON-540542917 tempest-ImagesMetadataTestJSON-540542917-project] Calling method '.version_select at 0x7fd39f0f4f70>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:58:29.621716 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-532e27e5-13ff-4b2b-ad4b-71f98bb1d27d tempest-ImagesMetadataTestJSON-540542917 tempest-ImagesMetadataTestJSON-540542917-project] 10.222.0.18 "GET /compute/v2.1/images/cca411ce-7ae8-4278-bf05-360c443077f8/metadata" status: 200 len: 58 microversion: 2.1 time: 0.077365 Oct 22 20:58:29.630427 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1171/2213] 10.222.0.18 () {58 vars in 1260 bytes} [Sat Oct 22 20:58:29 2022] GET /compute/v2.1/images/cca411ce-7ae8-4278-bf05-360c443077f8/metadata => generated 58 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 22 20:58:29.637682 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-0be9e87b-257f-430f-b160-3c7e07d342e9 tempest-ImagesMetadataTestJSON-540542917 tempest-ImagesMetadataTestJSON-540542917-project] Action: 'update_all', calling method: .version_select at 0x7fd39fd30d30>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:58:30.072354 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-75556ab7-fb6c-4a81-ba8a-b66fee6500d4 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dbe89a7e11480194d3d86f82983499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8351b01e07cd43f9be973ab45e522bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:58:30.086807 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-75556ab7-fb6c-4a81-ba8a-b66fee6500d4 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] 10.222.0.18 "GET /compute/v2.1/servers/f070b144-3a1a-4456-8e5b-02af12557c6a" status: 200 len: 1472 microversion: 2.1 time: 0.688640 Oct 22 20:58:30.091087 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1043/2214] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:58:29 2022] GET /compute/v2.1/servers/f070b144-3a1a-4456-8e5b-02af12557c6a => generated 1472 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:58:30.233271 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-0be9e87b-257f-430f-b160-3c7e07d342e9 tempest-ImagesMetadataTestJSON-540542917 tempest-ImagesMetadataTestJSON-540542917-project] Getting quotas for project 09ca841aa454436bb5a39886ad584f89. Resources: dict_keys(['metadata_items']) {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 20:58:30.239397 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-0be9e87b-257f-430f-b160-3c7e07d342e9 tempest-ImagesMetadataTestJSON-540542917 tempest-ImagesMetadataTestJSON-540542917-project] Getting quotas for user b484e4419e934590b5bbf6adf35cdd45 and project 09ca841aa454436bb5a39886ad584f89. Resources: dict_keys(['metadata_items']) {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 20:58:30.418074 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-6d1f1599-598d-42ad-a4c6-38cfb6461b85 tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:58:30.418713 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-6d1f1599-598d-42ad-a4c6-38cfb6461b85 tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] [instance: 19465083-6d3a-485d-9101-950d9c45abaf] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:58:30.440082 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6d1f1599-598d-42ad-a4c6-38cfb6461b85 tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:30.440800 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6d1f1599-598d-42ad-a4c6-38cfb6461b85 tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:30.441421 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6d1f1599-598d-42ad-a4c6-38cfb6461b85 tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:30.442345 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6d1f1599-598d-42ad-a4c6-38cfb6461b85 tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:30.443096 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6d1f1599-598d-42ad-a4c6-38cfb6461b85 tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:30.443706 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6d1f1599-598d-42ad-a4c6-38cfb6461b85 tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:30.640742 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-0be9e87b-257f-430f-b160-3c7e07d342e9 tempest-ImagesMetadataTestJSON-540542917 tempest-ImagesMetadataTestJSON-540542917-project] 10.222.0.18 "PUT /compute/v2.1/images/cca411ce-7ae8-4278-bf05-360c443077f8/metadata" status: 200 len: 61 microversion: 2.1 time: 1.008720 Oct 22 20:58:30.643159 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1172/2215] 10.222.0.18 () {60 vars in 1280 bytes} [Sat Oct 22 20:58:29 2022] PUT /compute/v2.1/images/cca411ce-7ae8-4278-bf05-360c443077f8/metadata => generated 61 bytes in 1012 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 22 20:58:30.657726 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-9289861b-11a1-4f7f-b292-03d844747d46 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:58:30.658585 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-9289861b-11a1-4f7f-b292-03d844747d46 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] [instance: c3e6246d-c32a-490d-ba83-84b54822f971] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:58:30.669078 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9289861b-11a1-4f7f-b292-03d844747d46 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:30.673817 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9289861b-11a1-4f7f-b292-03d844747d46 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:30.674421 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9289861b-11a1-4f7f-b292-03d844747d46 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:30.676308 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9289861b-11a1-4f7f-b292-03d844747d46 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:30.678797 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9289861b-11a1-4f7f-b292-03d844747d46 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:30.680235 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9289861b-11a1-4f7f-b292-03d844747d46 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:30.863548 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-9289861b-11a1-4f7f-b292-03d844747d46 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d3d7458af447bdb3f03e83a2d8559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49238b8686d24ae698679e4a1957735d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:58:30.873532 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-9289861b-11a1-4f7f-b292-03d844747d46 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] 10.222.0.18 "GET /compute/v2.1/servers/c3e6246d-c32a-490d-ba83-84b54822f971" status: 200 len: 1270 microversion: 2.1 time: 0.228856 Oct 22 20:58:30.887097 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1173/2216] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:58:30 2022] GET /compute/v2.1/servers/c3e6246d-c32a-490d-ba83-84b54822f971 => generated 1270 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:58:30.895287 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-4132e259-c023-4b06-9d57-e387ee83e5a2 tempest-ImagesMetadataTestJSON-540542917 tempest-ImagesMetadataTestJSON-540542917-project] Action: 'create', calling method: .version_select at 0x7fd39fbdb310>, body: {"metadata": {"os_version": "alt1", "architecture": "value3"}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:58:30.951632 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-4132e259-c023-4b06-9d57-e387ee83e5a2 tempest-ImagesMetadataTestJSON-540542917 tempest-ImagesMetadataTestJSON-540542917-project] Getting quotas for project 09ca841aa454436bb5a39886ad584f89. Resources: dict_keys(['metadata_items']) {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 20:58:30.959802 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-4132e259-c023-4b06-9d57-e387ee83e5a2 tempest-ImagesMetadataTestJSON-540542917 tempest-ImagesMetadataTestJSON-540542917-project] Getting quotas for user b484e4419e934590b5bbf6adf35cdd45 and project 09ca841aa454436bb5a39886ad584f89. Resources: dict_keys(['metadata_items']) {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 20:58:31.117280 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-6d1f1599-598d-42ad-a4c6-38cfb6461b85 tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb8017457354ed68be65cb426965cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af194191cdc4b34a470c821a932e2fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:58:31.132332 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-6d1f1599-598d-42ad-a4c6-38cfb6461b85 tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] 10.222.0.18 "GET /compute/v2.1/servers/19465083-6d3a-485d-9101-950d9c45abaf" status: 200 len: 1395 microversion: 2.1 time: 0.717938 Oct 22 20:58:31.133269 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1044/2217] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:58:30 2022] GET /compute/v2.1/servers/19465083-6d3a-485d-9101-950d9c45abaf => generated 1395 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 20:58:31.137806 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-f29ca5e6-3489-43a4-bb82-acb6bac83596 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:58:31.138421 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-f29ca5e6-3489-43a4-bb82-acb6bac83596 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] [instance: f070b144-3a1a-4456-8e5b-02af12557c6a] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:58:31.159905 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f29ca5e6-3489-43a4-bb82-acb6bac83596 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:31.160439 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f29ca5e6-3489-43a4-bb82-acb6bac83596 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:31.160899 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f29ca5e6-3489-43a4-bb82-acb6bac83596 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:31.172971 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f29ca5e6-3489-43a4-bb82-acb6bac83596 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:31.173486 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f29ca5e6-3489-43a4-bb82-acb6bac83596 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:31.174116 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f29ca5e6-3489-43a4-bb82-acb6bac83596 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:31.380042 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-4132e259-c023-4b06-9d57-e387ee83e5a2 tempest-ImagesMetadataTestJSON-540542917 tempest-ImagesMetadataTestJSON-540542917-project] 10.222.0.18 "POST /compute/v2.1/images/cca411ce-7ae8-4278-bf05-360c443077f8/metadata" status: 200 len: 85 microversion: 2.1 time: 0.491610 Oct 22 20:58:31.380887 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1174/2218] 10.222.0.18 () {60 vars in 1281 bytes} [Sat Oct 22 20:58:30 2022] POST /compute/v2.1/images/cca411ce-7ae8-4278-bf05-360c443077f8/metadata => generated 85 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 22 20:58:31.392682 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-94bd3dab-be9e-49cc-81ca-0a6a2529f09c tempest-ImagesMetadataTestJSON-540542917 tempest-ImagesMetadataTestJSON-540542917-project] Calling method '.version_select at 0x7fd39fbe4f70>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:58:31.505437 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-94bd3dab-be9e-49cc-81ca-0a6a2529f09c tempest-ImagesMetadataTestJSON-540542917 tempest-ImagesMetadataTestJSON-540542917-project] 10.222.0.18 "GET /compute/v2.1/images/cca411ce-7ae8-4278-bf05-360c443077f8/metadata" status: 200 len: 85 microversion: 2.1 time: 0.118465 Oct 22 20:58:31.506189 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1175/2219] 10.222.0.18 () {58 vars in 1260 bytes} [Sat Oct 22 20:58:31 2022] GET /compute/v2.1/images/cca411ce-7ae8-4278-bf05-360c443077f8/metadata => generated 85 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 22 20:58:31.526108 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-f29ca5e6-3489-43a4-bb82-acb6bac83596 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dbe89a7e11480194d3d86f82983499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8351b01e07cd43f9be973ab45e522bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:58:31.529755 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:58:31.542246 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-f29ca5e6-3489-43a4-bb82-acb6bac83596 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] 10.222.0.18 "GET /compute/v2.1/servers/f070b144-3a1a-4456-8e5b-02af12557c6a" status: 200 len: 1472 microversion: 2.1 time: 0.407619 Oct 22 20:58:31.544362 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1045/2220] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:58:31 2022] GET /compute/v2.1/servers/f070b144-3a1a-4456-8e5b-02af12557c6a => generated 1472 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:58:31.902604 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-29169da5-8abb-44a2-80e9-0325b04982f4 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:58:31.904178 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-29169da5-8abb-44a2-80e9-0325b04982f4 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] [instance: c3e6246d-c32a-490d-ba83-84b54822f971] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:58:31.929882 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-29169da5-8abb-44a2-80e9-0325b04982f4 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:31.930747 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-29169da5-8abb-44a2-80e9-0325b04982f4 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:31.931609 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-29169da5-8abb-44a2-80e9-0325b04982f4 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:31.936405 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-29169da5-8abb-44a2-80e9-0325b04982f4 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:31.937454 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-29169da5-8abb-44a2-80e9-0325b04982f4 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:31.938359 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-29169da5-8abb-44a2-80e9-0325b04982f4 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:32.156100 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-92679e30-7420-4c65-8ecb-612600e64897 tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:58:32.161558 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-92679e30-7420-4c65-8ecb-612600e64897 tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] [instance: 19465083-6d3a-485d-9101-950d9c45abaf] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:58:32.179674 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-92679e30-7420-4c65-8ecb-612600e64897 tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:32.180193 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-92679e30-7420-4c65-8ecb-612600e64897 tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:32.180663 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-92679e30-7420-4c65-8ecb-612600e64897 tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:32.189788 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-92679e30-7420-4c65-8ecb-612600e64897 tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:32.193511 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-92679e30-7420-4c65-8ecb-612600e64897 tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:32.194309 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-92679e30-7420-4c65-8ecb-612600e64897 tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:32.790593 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell0:SELECT=16 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:58:32.791882 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-29169da5-8abb-44a2-80e9-0325b04982f4 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d3d7458af447bdb3f03e83a2d8559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49238b8686d24ae698679e4a1957735d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:58:32.813374 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-29169da5-8abb-44a2-80e9-0325b04982f4 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] 10.222.0.18 "GET /compute/v2.1/servers/c3e6246d-c32a-490d-ba83-84b54822f971" status: 200 len: 1312 microversion: 2.1 time: 0.916955 Oct 22 20:58:32.814319 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1176/2221] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:58:31 2022] GET /compute/v2.1/servers/c3e6246d-c32a-490d-ba83-84b54822f971 => generated 1312 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:58:32.822105 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-69b21772-e46e-410e-a99e-ec668c989387 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:58:32.822954 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-69b21772-e46e-410e-a99e-ec668c989387 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] [instance: f070b144-3a1a-4456-8e5b-02af12557c6a] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:58:32.835939 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-69b21772-e46e-410e-a99e-ec668c989387 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:32.836785 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-69b21772-e46e-410e-a99e-ec668c989387 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:32.837435 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-69b21772-e46e-410e-a99e-ec668c989387 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:32.838362 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-69b21772-e46e-410e-a99e-ec668c989387 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:32.839020 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-69b21772-e46e-410e-a99e-ec668c989387 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:32.839695 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-69b21772-e46e-410e-a99e-ec668c989387 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:32.973843 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-92679e30-7420-4c65-8ecb-612600e64897 tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb8017457354ed68be65cb426965cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af194191cdc4b34a470c821a932e2fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:58:32.985127 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-92679e30-7420-4c65-8ecb-612600e64897 tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] 10.222.0.18 "GET /compute/v2.1/servers/19465083-6d3a-485d-9101-950d9c45abaf" status: 200 len: 1395 microversion: 2.1 time: 0.833606 Oct 22 20:58:33.003044 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1046/2222] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:58:32 2022] GET /compute/v2.1/servers/19465083-6d3a-485d-9101-950d9c45abaf => generated 1395 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:58:33.279579 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-69b21772-e46e-410e-a99e-ec668c989387 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dbe89a7e11480194d3d86f82983499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8351b01e07cd43f9be973ab45e522bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:58:33.296467 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-69b21772-e46e-410e-a99e-ec668c989387 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] 10.222.0.18 "GET /compute/v2.1/servers/f070b144-3a1a-4456-8e5b-02af12557c6a" status: 200 len: 1472 microversion: 2.1 time: 0.480074 Oct 22 20:58:33.297591 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1177/2223] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:58:32 2022] GET /compute/v2.1/servers/f070b144-3a1a-4456-8e5b-02af12557c6a => generated 1472 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:58:33.840186 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-86e9f873-9d26-4d4d-89db-cc589d4190b2 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:58:33.840814 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-86e9f873-9d26-4d4d-89db-cc589d4190b2 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] [instance: c3e6246d-c32a-490d-ba83-84b54822f971] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:58:33.853174 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-86e9f873-9d26-4d4d-89db-cc589d4190b2 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:33.860966 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-86e9f873-9d26-4d4d-89db-cc589d4190b2 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:33.861906 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-86e9f873-9d26-4d4d-89db-cc589d4190b2 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:33.862843 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-86e9f873-9d26-4d4d-89db-cc589d4190b2 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:33.863491 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-86e9f873-9d26-4d4d-89db-cc589d4190b2 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:33.864098 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-86e9f873-9d26-4d4d-89db-cc589d4190b2 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:34.012368 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-7d4a8adc-2a9f-45ae-9fe8-8fbbb7daadb1 tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:58:34.013472 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-7d4a8adc-2a9f-45ae-9fe8-8fbbb7daadb1 tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] [instance: 19465083-6d3a-485d-9101-950d9c45abaf] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:58:34.027511 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7d4a8adc-2a9f-45ae-9fe8-8fbbb7daadb1 tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:34.031426 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7d4a8adc-2a9f-45ae-9fe8-8fbbb7daadb1 tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:34.033887 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7d4a8adc-2a9f-45ae-9fe8-8fbbb7daadb1 tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:34.034955 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7d4a8adc-2a9f-45ae-9fe8-8fbbb7daadb1 tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:34.036851 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7d4a8adc-2a9f-45ae-9fe8-8fbbb7daadb1 tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:34.037696 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7d4a8adc-2a9f-45ae-9fe8-8fbbb7daadb1 tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:34.221724 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-86e9f873-9d26-4d4d-89db-cc589d4190b2 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d3d7458af447bdb3f03e83a2d8559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49238b8686d24ae698679e4a1957735d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:58:34.233145 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-86e9f873-9d26-4d4d-89db-cc589d4190b2 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] 10.222.0.18 "GET /compute/v2.1/servers/c3e6246d-c32a-490d-ba83-84b54822f971" status: 200 len: 1312 microversion: 2.1 time: 0.397046 Oct 22 20:58:34.235097 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1047/2224] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:58:33 2022] GET /compute/v2.1/servers/c3e6246d-c32a-490d-ba83-84b54822f971 => generated 1312 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:58:34.272888 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-7d4a8adc-2a9f-45ae-9fe8-8fbbb7daadb1 tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb8017457354ed68be65cb426965cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af194191cdc4b34a470c821a932e2fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:58:34.287848 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-7d4a8adc-2a9f-45ae-9fe8-8fbbb7daadb1 tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] 10.222.0.18 "GET /compute/v2.1/servers/19465083-6d3a-485d-9101-950d9c45abaf" status: 200 len: 1395 microversion: 2.1 time: 0.280770 Oct 22 20:58:34.313112 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1178/2225] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:58:34 2022] GET /compute/v2.1/servers/19465083-6d3a-485d-9101-950d9c45abaf => generated 1395 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 20:58:34.324919 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-0a5f5f43-0e77-4133-9f7c-60d24bfae702 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:58:34.325551 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-0a5f5f43-0e77-4133-9f7c-60d24bfae702 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] [instance: f070b144-3a1a-4456-8e5b-02af12557c6a] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:58:34.328044 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:58:34.334753 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0a5f5f43-0e77-4133-9f7c-60d24bfae702 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:34.335271 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0a5f5f43-0e77-4133-9f7c-60d24bfae702 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:34.335765 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0a5f5f43-0e77-4133-9f7c-60d24bfae702 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:34.336588 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0a5f5f43-0e77-4133-9f7c-60d24bfae702 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:34.337051 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0a5f5f43-0e77-4133-9f7c-60d24bfae702 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:34.337579 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0a5f5f43-0e77-4133-9f7c-60d24bfae702 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:34.533084 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-0a5f5f43-0e77-4133-9f7c-60d24bfae702 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dbe89a7e11480194d3d86f82983499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8351b01e07cd43f9be973ab45e522bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:58:34.549457 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-0a5f5f43-0e77-4133-9f7c-60d24bfae702 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] 10.222.0.18 "GET /compute/v2.1/servers/f070b144-3a1a-4456-8e5b-02af12557c6a" status: 200 len: 1472 microversion: 2.1 time: 0.228490 Oct 22 20:58:34.551545 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1048/2226] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:58:34 2022] GET /compute/v2.1/servers/f070b144-3a1a-4456-8e5b-02af12557c6a => generated 1472 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:58:35.260354 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-bc8ae6fe-6881-4f2c-86a8-30215cc3414c tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:58:35.261214 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-bc8ae6fe-6881-4f2c-86a8-30215cc3414c tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] [instance: c3e6246d-c32a-490d-ba83-84b54822f971] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:58:35.273189 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bc8ae6fe-6881-4f2c-86a8-30215cc3414c tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:35.273789 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bc8ae6fe-6881-4f2c-86a8-30215cc3414c tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:35.277035 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bc8ae6fe-6881-4f2c-86a8-30215cc3414c tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:35.279154 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bc8ae6fe-6881-4f2c-86a8-30215cc3414c tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:35.281606 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bc8ae6fe-6881-4f2c-86a8-30215cc3414c tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:35.282248 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bc8ae6fe-6881-4f2c-86a8-30215cc3414c tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:35.287819 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-801af729-efdb-4c35-8602-0384f259fda9 req-a7441e20-fbe9-4483-a7b0-ac52864c4697 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3e6246d-c32a-490d-ba83-84b54822f971", "tag": "140cd909-abde-4ea9-89c0-b130f4264b5b"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:58:35.316061 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-801af729-efdb-4c35-8602-0384f259fda9 req-a7441e20-fbe9-4483-a7b0-ac52864c4697 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:35.316635 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-801af729-efdb-4c35-8602-0384f259fda9 req-a7441e20-fbe9-4483-a7b0-ac52864c4697 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:35.319295 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-801af729-efdb-4c35-8602-0384f259fda9 req-a7441e20-fbe9-4483-a7b0-ac52864c4697 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:35.359434 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-801af729-efdb-4c35-8602-0384f259fda9 req-a7441e20-fbe9-4483-a7b0-ac52864c4697 service nova] Creating event network-changed:140cd909-abde-4ea9-89c0-b130f4264b5b for instance c3e6246d-c32a-490d-ba83-84b54822f971 on nch1-master-1 Oct 22 20:58:35.367316 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell1:SELECT=100 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:58:35.384488 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-801af729-efdb-4c35-8602-0384f259fda9 req-a7441e20-fbe9-4483-a7b0-ac52864c4697 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096778 Oct 22 20:58:35.387423 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1049/2227] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:58:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:58:35.412135 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-06046787-85a8-4544-917f-e3f539fc5481 tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:58:35.415680 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-06046787-85a8-4544-917f-e3f539fc5481 tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] [instance: 19465083-6d3a-485d-9101-950d9c45abaf] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:58:35.429571 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-06046787-85a8-4544-917f-e3f539fc5481 tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:35.434829 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-06046787-85a8-4544-917f-e3f539fc5481 tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:35.438796 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-06046787-85a8-4544-917f-e3f539fc5481 tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:35.441024 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-06046787-85a8-4544-917f-e3f539fc5481 tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:35.441249 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-06046787-85a8-4544-917f-e3f539fc5481 tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:35.444759 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-06046787-85a8-4544-917f-e3f539fc5481 tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:36.255881 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-bc8ae6fe-6881-4f2c-86a8-30215cc3414c tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d3d7458af447bdb3f03e83a2d8559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49238b8686d24ae698679e4a1957735d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:58:36.264603 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-bc8ae6fe-6881-4f2c-86a8-30215cc3414c tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] 10.222.0.18 "GET /compute/v2.1/servers/c3e6246d-c32a-490d-ba83-84b54822f971" status: 200 len: 1312 microversion: 2.1 time: 1.010637 Oct 22 20:58:36.265361 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1179/2228] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:58:35 2022] GET /compute/v2.1/servers/c3e6246d-c32a-490d-ba83-84b54822f971 => generated 1312 bytes in 1012 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:58:36.282968 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-154f3cd7-f5aa-48a0-a30e-c46bcad9c140 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:58:36.286674 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-154f3cd7-f5aa-48a0-a30e-c46bcad9c140 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] [instance: f070b144-3a1a-4456-8e5b-02af12557c6a] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:58:36.299263 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-154f3cd7-f5aa-48a0-a30e-c46bcad9c140 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:36.300503 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-154f3cd7-f5aa-48a0-a30e-c46bcad9c140 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:36.301181 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-154f3cd7-f5aa-48a0-a30e-c46bcad9c140 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:36.302225 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-154f3cd7-f5aa-48a0-a30e-c46bcad9c140 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:36.303480 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-154f3cd7-f5aa-48a0-a30e-c46bcad9c140 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:36.305540 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-154f3cd7-f5aa-48a0-a30e-c46bcad9c140 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:36.426486 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell0:SELECT=2 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:58:36.744416 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-154f3cd7-f5aa-48a0-a30e-c46bcad9c140 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dbe89a7e11480194d3d86f82983499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8351b01e07cd43f9be973ab45e522bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:58:36.766925 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-06046787-85a8-4544-917f-e3f539fc5481 tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb8017457354ed68be65cb426965cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af194191cdc4b34a470c821a932e2fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:58:36.775207 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-154f3cd7-f5aa-48a0-a30e-c46bcad9c140 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] 10.222.0.18 "GET /compute/v2.1/servers/f070b144-3a1a-4456-8e5b-02af12557c6a" status: 200 len: 1472 microversion: 2.1 time: 0.488197 Oct 22 20:58:36.777048 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1180/2229] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:58:36 2022] GET /compute/v2.1/servers/f070b144-3a1a-4456-8e5b-02af12557c6a => generated 1472 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:58:36.793793 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-06046787-85a8-4544-917f-e3f539fc5481 tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] 10.222.0.18 "GET /compute/v2.1/servers/19465083-6d3a-485d-9101-950d9c45abaf" status: 200 len: 1395 microversion: 2.1 time: 1.398342 Oct 22 20:58:36.799408 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1050/2230] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:58:35 2022] GET /compute/v2.1/servers/19465083-6d3a-485d-9101-950d9c45abaf => generated 1395 bytes in 1407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:58:36.804467 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-b42eb422-0e2e-4e48-ac03-8a0dd2ddf1b3 req-4d2e2698-d4d0-409e-90c4-2ee7edaf2b18 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19465083-6d3a-485d-9101-950d9c45abaf", "name": "network-vif-plugged", "status": "completed", "tag": "cdb0c7d2-5618-446f-9f1a-9ed8b48f5bc2"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:58:36.841324 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-b42eb422-0e2e-4e48-ac03-8a0dd2ddf1b3 req-4d2e2698-d4d0-409e-90c4-2ee7edaf2b18 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:36.841823 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-b42eb422-0e2e-4e48-ac03-8a0dd2ddf1b3 req-4d2e2698-d4d0-409e-90c4-2ee7edaf2b18 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:36.842628 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-b42eb422-0e2e-4e48-ac03-8a0dd2ddf1b3 req-4d2e2698-d4d0-409e-90c4-2ee7edaf2b18 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:36.879708 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-b42eb422-0e2e-4e48-ac03-8a0dd2ddf1b3 req-4d2e2698-d4d0-409e-90c4-2ee7edaf2b18 service nova] Creating event network-vif-plugged:cdb0c7d2-5618-446f-9f1a-9ed8b48f5bc2 for instance 19465083-6d3a-485d-9101-950d9c45abaf on nch2-master-1 Oct 22 20:58:36.896309 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-b42eb422-0e2e-4e48-ac03-8a0dd2ddf1b3 req-4d2e2698-d4d0-409e-90c4-2ee7edaf2b18 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115325 Oct 22 20:58:36.896928 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1181/2231] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:58:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:58:37.289241 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-5342c696-e899-4bae-8f46-607ae3c67449 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:58:37.289881 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-5342c696-e899-4bae-8f46-607ae3c67449 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] [instance: c3e6246d-c32a-490d-ba83-84b54822f971] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:58:37.300223 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5342c696-e899-4bae-8f46-607ae3c67449 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:37.300732 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5342c696-e899-4bae-8f46-607ae3c67449 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:37.306994 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5342c696-e899-4bae-8f46-607ae3c67449 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:37.307957 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5342c696-e899-4bae-8f46-607ae3c67449 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:37.308458 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5342c696-e899-4bae-8f46-607ae3c67449 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:37.308893 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5342c696-e899-4bae-8f46-607ae3c67449 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:37.665821 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-5342c696-e899-4bae-8f46-607ae3c67449 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d3d7458af447bdb3f03e83a2d8559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49238b8686d24ae698679e4a1957735d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:58:37.679272 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-5342c696-e899-4bae-8f46-607ae3c67449 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] 10.222.0.18 "GET /compute/v2.1/servers/c3e6246d-c32a-490d-ba83-84b54822f971" status: 200 len: 1312 microversion: 2.1 time: 0.394475 Oct 22 20:58:37.680712 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1051/2232] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:58:37 2022] GET /compute/v2.1/servers/c3e6246d-c32a-490d-ba83-84b54822f971 => generated 1312 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:58:37.807154 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-68059a10-00e4-4d9f-bd51-c4283500ff5e tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:58:37.807978 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-68059a10-00e4-4d9f-bd51-c4283500ff5e tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] [instance: f070b144-3a1a-4456-8e5b-02af12557c6a] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:58:37.817455 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-218ca724-4d3f-4819-afb3-1092be68851b tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:58:37.818763 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-218ca724-4d3f-4819-afb3-1092be68851b tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] [instance: 19465083-6d3a-485d-9101-950d9c45abaf] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:58:37.831828 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-68059a10-00e4-4d9f-bd51-c4283500ff5e tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:37.833926 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-218ca724-4d3f-4819-afb3-1092be68851b tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:37.834730 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-218ca724-4d3f-4819-afb3-1092be68851b tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:37.835301 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-218ca724-4d3f-4819-afb3-1092be68851b tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:37.836200 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-218ca724-4d3f-4819-afb3-1092be68851b tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:37.836884 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-68059a10-00e4-4d9f-bd51-c4283500ff5e tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:37.837483 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-218ca724-4d3f-4819-afb3-1092be68851b tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:37.838063 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-68059a10-00e4-4d9f-bd51-c4283500ff5e tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:37.839702 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-218ca724-4d3f-4819-afb3-1092be68851b tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:37.840375 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-68059a10-00e4-4d9f-bd51-c4283500ff5e tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:37.841886 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-68059a10-00e4-4d9f-bd51-c4283500ff5e tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:37.842469 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-68059a10-00e4-4d9f-bd51-c4283500ff5e tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:38.270764 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-218ca724-4d3f-4819-afb3-1092be68851b tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb8017457354ed68be65cb426965cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af194191cdc4b34a470c821a932e2fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:58:38.287612 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-218ca724-4d3f-4819-afb3-1092be68851b tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] 10.222.0.18 "GET /compute/v2.1/servers/19465083-6d3a-485d-9101-950d9c45abaf" status: 200 len: 1395 microversion: 2.1 time: 0.473861 Oct 22 20:58:38.305368 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1052/2233] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:58:37 2022] GET /compute/v2.1/servers/19465083-6d3a-485d-9101-950d9c45abaf => generated 1395 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 20:58:38.376636 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-68059a10-00e4-4d9f-bd51-c4283500ff5e tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dbe89a7e11480194d3d86f82983499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8351b01e07cd43f9be973ab45e522bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:58:38.404458 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-68059a10-00e4-4d9f-bd51-c4283500ff5e tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] 10.222.0.18 "GET /compute/v2.1/servers/f070b144-3a1a-4456-8e5b-02af12557c6a" status: 200 len: 1472 microversion: 2.1 time: 0.599734 Oct 22 20:58:38.408693 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1182/2234] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:58:37 2022] GET /compute/v2.1/servers/f070b144-3a1a-4456-8e5b-02af12557c6a => generated 1472 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:58:38.534237 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-929a8fe7-f5d2-4967-98af-7e953ecd0fea tempest-TenantUsagesNegativeTestJSON-885271231 tempest-TenantUsagesNegativeTestJSON-885271231-project-admin] 10.222.0.18 "GET /compute/v2.1/os-simple-tenant-usage/?start=2022-10-21T20%3A58%3A38.101687&end=2022-10-23T20%3A58%3A38.101687" status: 404 len: 112 microversion: - time: 0.226840 Oct 22 20:58:38.535071 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1053/2235] 10.222.0.18 () {58 vars in 1316 bytes} [Sat Oct 22 20:58:38 2022] GET /compute/v2.1/os-simple-tenant-usage/?start=2022-10-21T20%3A58%3A38.101687&end=2022-10-23T20%3A58%3A38.101687 => generated 112 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 22 20:58:38.544895 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-852a524f-953d-40b6-95b1-24e0534d20c1 tempest-TenantUsagesNegativeTestJSON-885271231 tempest-TenantUsagesNegativeTestJSON-885271231-project-admin] Calling method '.version_select at 0x7fd39fcdd430>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:58:38.549836 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.wsgi [None req-852a524f-953d-40b6-95b1-24e0534d20c1 tempest-TenantUsagesNegativeTestJSON-885271231 tempest-TenantUsagesNegativeTestJSON-885271231-project-admin] HTTP exception thrown: Invalid start time. The start time cannot occur after the end time. Oct 22 20:58:38.560573 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-852a524f-953d-40b6-95b1-24e0534d20c1 tempest-TenantUsagesNegativeTestJSON-885271231 tempest-TenantUsagesNegativeTestJSON-885271231-project-admin] Request method failure captured: Oct 22 20:58:38.560573 ncdv-master-1 devstack@n-api.service[138745]: request: GET /compute/v2.1/os-simple-tenant-usage/bce89783642643d49a2f012e4f6f34d3?start=2022-10-23T20%3A58%3A38.101687&end=2022-10-21T20%3A58%3A38.101687 HTTP/1.1 Oct 22 20:58:38.560573 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 20:58:38.560573 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 20:58:38.560573 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 20:58:38.560573 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 0 Oct 22 20:58:38.560573 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 20:58:38.560573 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 20:58:38.560573 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 20:58:38.560573 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 20:58:38.560573 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVFl9G25gagtegfHiAPOwzosoh4FrWDyIn8zrIk6mhEa_D60urZwJJuSTOCIIFaTwIfLgjlPTruKhI0QRQ5DF6AvdOveA3qYgtvDyMunc-FTBmueZ6gt2_Mnc3YOdxW1Qwm7_lg3yKbWKrrwXwruHqttjz2YMXAv3SELvZiOWKezW6tg Oct 22 20:58:38.560573 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 20:58:38.560573 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 20:58:38.560573 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 20:58:38.560573 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 20:58:38.560573 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 20:58:38.560573 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 20:58:38.560573 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: 8795ed84450040b4b44b322dc01c35ce Oct 22 20:58:38.560573 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-885271231 Oct 22 20:58:38.560573 ncdv-master-1 devstack@n-api.service[138745]: X-Role: admin,member,reader Oct 22 20:58:38.560573 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: admin,member,reader Oct 22 20:58:38.560573 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_8795ed84450040b4b44b322dc01c35ce"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8795ed84450040b4b44b322dc01c35ce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/8795ed84450040b4b44b322dc01c35ce"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8795ed84450040b4b44b322dc01c35ce"}]}] Oct 22 20:58:38.560573 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-885271231 Oct 22 20:58:38.560573 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: 8795ed84450040b4b44b322dc01c35ce Oct 22 20:58:38.560573 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-885271231 Oct 22 20:58:38.560573 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-TenantUsagesNegativeTestJSON-885271231-project-admin Oct 22 20:58:38.560573 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 20:58:38.560573 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 20:58:38.560573 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: 71c9b5a0bdf94d759864c2b366501abd Oct 22 20:58:38.560573 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-885271231-project-admin Oct 22 20:58:38.560573 ncdv-master-1 devstack@n-api.service[138745]: method: Oct 22 20:58:38.560573 ncdv-master-1 devstack@n-api.service[138745]: exception: Invalid start time. The start time cannot occur after the end time. Oct 22 20:58:38.560573 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'id': 'bce89783642643d49a2f012e4f6f34d3'} Oct 22 20:58:38.560573 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:58:38.560573 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:58:38.560573 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:58:38.560573 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:58:38.560573 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:58:38.560573 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:58:38.560573 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 22 20:58:38.560573 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 22 20:58:38.560573 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 22 20:58:38.560573 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 20:58:38.560573 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:58:38.560573 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:58:38.560573 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 292, in show Oct 22 20:58:38.560573 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return self._show(req, id) Oct 22 20:58:38.560573 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 338, in _show Oct 22 20:58:38.560573 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi (period_start, period_stop, ignore) = self._get_datetime_range( Oct 22 20:58:38.560573 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 259, in _get_datetime_range Oct 22 20:58:38.560573 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 22 20:58:38.560573 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid start time. The start time cannot occur after the end time. Oct 22 20:58:38.560573 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:58:38.560573 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:58:38.560573 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:58:38.560573 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:58:38.560573 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:58:38.560573 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:58:38.560573 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 20:58:38.560573 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 20:58:38.560573 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid start time. The start time cannot occur after the end time. Oct 22 20:58:38.560573 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:58:38.566243 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-852a524f-953d-40b6-95b1-24e0534d20c1 tempest-TenantUsagesNegativeTestJSON-885271231 tempest-TenantUsagesNegativeTestJSON-885271231-project-admin] Returning 400 to user: Invalid start time. The start time cannot occur after the end time. {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:58:38.567436 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-852a524f-953d-40b6-95b1-24e0534d20c1 tempest-TenantUsagesNegativeTestJSON-885271231 tempest-TenantUsagesNegativeTestJSON-885271231-project-admin] 10.222.0.18 "GET /compute/v2.1/os-simple-tenant-usage/bce89783642643d49a2f012e4f6f34d3?start=2022-10-23T20%3A58%3A38.101687&end=2022-10-21T20%3A58%3A38.101687" status: 400 len: 111 microversion: 2.1 time: 0.026549 Oct 22 20:58:38.573336 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1183/2236] 10.222.0.18 () {58 vars in 1412 bytes} [Sat Oct 22 20:58:38 2022] GET /compute/v2.1/os-simple-tenant-usage/bce89783642643d49a2f012e4f6f34d3?start=2022-10-23T20%3A58%3A38.101687&end=2022-10-21T20%3A58%3A38.101687 => generated 111 bytes in 33 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 22 20:58:38.712762 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-d65b6e89-9064-43bb-93af-18b45ee94841 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:58:38.714565 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-d65b6e89-9064-43bb-93af-18b45ee94841 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] [instance: c3e6246d-c32a-490d-ba83-84b54822f971] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:58:38.734741 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d65b6e89-9064-43bb-93af-18b45ee94841 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:38.735670 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d65b6e89-9064-43bb-93af-18b45ee94841 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:38.736915 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d65b6e89-9064-43bb-93af-18b45ee94841 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:38.738875 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d65b6e89-9064-43bb-93af-18b45ee94841 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:38.739381 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d65b6e89-9064-43bb-93af-18b45ee94841 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:38.741472 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d65b6e89-9064-43bb-93af-18b45ee94841 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:38.930892 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-1a3e6f04-a8bb-4fbd-abdf-82015d01c5d5 tempest-TenantUsagesNegativeTestJSON-474605450 tempest-TenantUsagesNegativeTestJSON-474605450-project] Calling method '.version_select at 0x7fd39fed6790>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:58:38.936893 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-1a3e6f04-a8bb-4fbd-abdf-82015d01c5d5 tempest-TenantUsagesNegativeTestJSON-474605450 tempest-TenantUsagesNegativeTestJSON-474605450-project] Policy check for os_compute_api:os-simple-tenant-usage:list failed with credentials {'is_admin': False, 'user_id': '8132e198f39d4f2eacc8f1309782f331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce89783642643d49a2f012e4f6f34d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:58:38.940039 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-1a3e6f04-a8bb-4fbd-abdf-82015d01c5d5 tempest-TenantUsagesNegativeTestJSON-474605450 tempest-TenantUsagesNegativeTestJSON-474605450-project] Request method failure captured: Oct 22 20:58:38.940039 ncdv-master-1 devstack@n-api.service[138744]: request: GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-21T20%3A58%3A38.101687&end=2022-10-23T20%3A58%3A38.101687&detailed=1 HTTP/1.1 Oct 22 20:58:38.940039 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 20:58:38.940039 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 20:58:38.940039 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 20:58:38.940039 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 0 Oct 22 20:58:38.940039 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 20:58:38.940039 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 20:58:38.940039 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 20:58:38.940039 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 20:58:38.940039 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVFl8efCfcuobndK1zAKEAEw62VxCcFzf-fiuZwVTF6jkz0A9GQiTyutgB0j6R5ma10opMkPNI0wJQ5l5nRjHisf3H57pyCnx6LzedfLnQMz6xpYQtC3Is-XGPxO_zlZETLUAWo20JnYOZFjlPiBas3FxnMzgIQ9wwD4TBAnqy1eSfBg Oct 22 20:58:38.940039 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 20:58:38.940039 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 20:58:38.940039 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 20:58:38.940039 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 20:58:38.940039 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 20:58:38.940039 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 20:58:38.940039 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: bce89783642643d49a2f012e4f6f34d3 Oct 22 20:58:38.940039 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-474605450 Oct 22 20:58:38.940039 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 20:58:38.940039 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 20:58:38.940039 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_bce89783642643d49a2f012e4f6f34d3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/bce89783642643d49a2f012e4f6f34d3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/bce89783642643d49a2f012e4f6f34d3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/bce89783642643d49a2f012e4f6f34d3"}]}] Oct 22 20:58:38.940039 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-474605450 Oct 22 20:58:38.940039 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: bce89783642643d49a2f012e4f6f34d3 Oct 22 20:58:38.940039 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-474605450 Oct 22 20:58:38.940039 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-TenantUsagesNegativeTestJSON-474605450-project Oct 22 20:58:38.940039 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 20:58:38.940039 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 20:58:38.940039 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: 8132e198f39d4f2eacc8f1309782f331 Oct 22 20:58:38.940039 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-474605450-project Oct 22 20:58:38.940039 ncdv-master-1 devstack@n-api.service[138744]: method: Oct 22 20:58:38.940039 ncdv-master-1 devstack@n-api.service[138744]: exception: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Oct 22 20:58:38.940039 ncdv-master-1 devstack@n-api.service[138744]: action_args: {} Oct 22 20:58:38.940039 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:58:38.940039 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:58:38.940039 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:58:38.940039 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:58:38.940039 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:58:38.940039 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:58:38.940039 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 22 20:58:38.940039 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 22 20:58:38.940039 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 22 20:58:38.940039 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 20:58:38.940039 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:58:38.940039 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:58:38.940039 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 277, in index Oct 22 20:58:38.940039 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return self._index(req) Oct 22 20:58:38.940039 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 297, in _index Oct 22 20:58:38.940039 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi context.can(stu_policies.POLICY_ROOT % 'list') Oct 22 20:58:38.940039 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 22 20:58:38.940039 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 22 20:58:38.940039 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 22 20:58:38.940039 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 22 20:58:38.940039 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 22 20:58:38.940039 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 22 20:58:38.940039 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 22 20:58:38.940039 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise self.value Oct 22 20:58:38.940039 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 22 20:58:38.940039 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 22 20:58:38.940039 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 22 20:58:38.940039 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 22 20:58:38.940039 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 22 20:58:38.940039 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 22 20:58:38.944554 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Oct 22 20:58:38.944554 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:58:38.944554 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:58:38.944554 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:58:38.944554 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:58:38.944554 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:58:38.944554 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:58:38.944554 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 22 20:58:38.944554 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 22 20:58:38.944554 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Oct 22 20:58:38.944554 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:58:38.947919 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-1a3e6f04-a8bb-4fbd-abdf-82015d01c5d5 tempest-TenantUsagesNegativeTestJSON-474605450 tempest-TenantUsagesNegativeTestJSON-474605450-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:58:38.949299 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-1a3e6f04-a8bb-4fbd-abdf-82015d01c5d5 tempest-TenantUsagesNegativeTestJSON-474605450 tempest-TenantUsagesNegativeTestJSON-474605450-project] 10.222.0.18 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-21T20%3A58%3A38.101687&end=2022-10-23T20%3A58%3A38.101687&detailed=1" status: 403 len: 123 microversion: 2.1 time: 0.374928 Oct 22 20:58:38.954475 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1054/2237] 10.222.0.18 () {58 vars in 1335 bytes} [Sat Oct 22 20:58:38 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-21T20%3A58%3A38.101687&end=2022-10-23T20%3A58%3A38.101687&detailed=1 => generated 123 bytes in 381 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 22 20:58:39.215623 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-d65b6e89-9064-43bb-93af-18b45ee94841 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d3d7458af447bdb3f03e83a2d8559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49238b8686d24ae698679e4a1957735d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:58:39.229387 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-d65b6e89-9064-43bb-93af-18b45ee94841 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] 10.222.0.18 "GET /compute/v2.1/servers/c3e6246d-c32a-490d-ba83-84b54822f971" status: 200 len: 1312 microversion: 2.1 time: 0.528329 Oct 22 20:58:39.243806 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1184/2238] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:58:38 2022] GET /compute/v2.1/servers/c3e6246d-c32a-490d-ba83-84b54822f971 => generated 1312 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 20:58:39.310918 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-724e6173-4dc5-4080-b555-695910c3787c tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:58:39.313415 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-724e6173-4dc5-4080-b555-695910c3787c tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] [instance: 19465083-6d3a-485d-9101-950d9c45abaf] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:58:39.332012 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-724e6173-4dc5-4080-b555-695910c3787c tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:39.334147 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-724e6173-4dc5-4080-b555-695910c3787c tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:39.334617 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-724e6173-4dc5-4080-b555-695910c3787c tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:39.335397 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-724e6173-4dc5-4080-b555-695910c3787c tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:39.336013 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-724e6173-4dc5-4080-b555-695910c3787c tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:39.336919 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-724e6173-4dc5-4080-b555-695910c3787c tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:39.435538 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-0bbf8291-326f-448b-a2cb-033517967137 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:58:39.436414 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-0bbf8291-326f-448b-a2cb-033517967137 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] [instance: f070b144-3a1a-4456-8e5b-02af12557c6a] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:58:39.447650 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0bbf8291-326f-448b-a2cb-033517967137 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:39.449582 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0bbf8291-326f-448b-a2cb-033517967137 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:39.450261 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0bbf8291-326f-448b-a2cb-033517967137 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:39.452046 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0bbf8291-326f-448b-a2cb-033517967137 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:39.456103 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0bbf8291-326f-448b-a2cb-033517967137 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:39.456793 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0bbf8291-326f-448b-a2cb-033517967137 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:39.827730 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-724e6173-4dc5-4080-b555-695910c3787c tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb8017457354ed68be65cb426965cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af194191cdc4b34a470c821a932e2fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:58:39.838388 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-0bbf8291-326f-448b-a2cb-033517967137 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dbe89a7e11480194d3d86f82983499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8351b01e07cd43f9be973ab45e522bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:58:39.841537 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-724e6173-4dc5-4080-b555-695910c3787c tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] 10.222.0.18 "GET /compute/v2.1/servers/19465083-6d3a-485d-9101-950d9c45abaf" status: 200 len: 1575 microversion: 2.1 time: 0.534668 Oct 22 20:58:39.844854 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1055/2239] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:58:39 2022] GET /compute/v2.1/servers/19465083-6d3a-485d-9101-950d9c45abaf => generated 1575 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:58:39.857626 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-0bbf8291-326f-448b-a2cb-033517967137 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] 10.222.0.18 "GET /compute/v2.1/servers/f070b144-3a1a-4456-8e5b-02af12557c6a" status: 200 len: 1472 microversion: 2.1 time: 0.427224 Oct 22 20:58:39.858218 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1185/2240] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:58:39 2022] GET /compute/v2.1/servers/f070b144-3a1a-4456-8e5b-02af12557c6a => generated 1472 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 20:58:39.887721 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-ae84911d-1550-4dc8-94ab-6d294d2e61f0 tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:58:39.888247 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-ae84911d-1550-4dc8-94ab-6d294d2e61f0 tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] [instance: 19465083-6d3a-485d-9101-950d9c45abaf] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:58:39.895745 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ae84911d-1550-4dc8-94ab-6d294d2e61f0 tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:39.896731 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ae84911d-1550-4dc8-94ab-6d294d2e61f0 tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:39.897396 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ae84911d-1550-4dc8-94ab-6d294d2e61f0 tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:39.898366 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ae84911d-1550-4dc8-94ab-6d294d2e61f0 tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:39.899084 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ae84911d-1550-4dc8-94ab-6d294d2e61f0 tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:39.899768 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ae84911d-1550-4dc8-94ab-6d294d2e61f0 tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:40.085732 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-ae84911d-1550-4dc8-94ab-6d294d2e61f0 tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] 10.222.0.18 "GET /compute/v2.1/servers/19465083-6d3a-485d-9101-950d9c45abaf/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.214010 Oct 22 20:58:40.096482 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1056/2241] 10.222.0.18 () {58 vars in 1275 bytes} [Sat Oct 22 20:58:39 2022] GET /compute/v2.1/servers/19465083-6d3a-485d-9101-950d9c45abaf/os-interface => generated 284 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:58:40.254977 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-75d66ba9-22c2-46c2-a7a1-9bae34b4b236 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:58:40.256311 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-75d66ba9-22c2-46c2-a7a1-9bae34b4b236 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] [instance: c3e6246d-c32a-490d-ba83-84b54822f971] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:58:40.267580 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-75d66ba9-22c2-46c2-a7a1-9bae34b4b236 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:40.268338 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-75d66ba9-22c2-46c2-a7a1-9bae34b4b236 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:40.270608 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-75d66ba9-22c2-46c2-a7a1-9bae34b4b236 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:40.272582 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-75d66ba9-22c2-46c2-a7a1-9bae34b4b236 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:40.275443 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-75d66ba9-22c2-46c2-a7a1-9bae34b4b236 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:40.276277 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-75d66ba9-22c2-46c2-a7a1-9bae34b4b236 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:40.887217 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-b895ce20-e9d2-435a-a0df-a6f01325838f tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:58:40.887864 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-b895ce20-e9d2-435a-a0df-a6f01325838f tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] [instance: f070b144-3a1a-4456-8e5b-02af12557c6a] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:58:40.895062 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b895ce20-e9d2-435a-a0df-a6f01325838f tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:40.895896 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b895ce20-e9d2-435a-a0df-a6f01325838f tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:40.896677 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b895ce20-e9d2-435a-a0df-a6f01325838f tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:40.897635 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b895ce20-e9d2-435a-a0df-a6f01325838f tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:40.898419 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b895ce20-e9d2-435a-a0df-a6f01325838f tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:40.899054 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b895ce20-e9d2-435a-a0df-a6f01325838f tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:40.969788 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell0:SELECT=40 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:58:41.187215 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-75d66ba9-22c2-46c2-a7a1-9bae34b4b236 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d3d7458af447bdb3f03e83a2d8559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49238b8686d24ae698679e4a1957735d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:58:41.208854 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-75d66ba9-22c2-46c2-a7a1-9bae34b4b236 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] 10.222.0.18 "GET /compute/v2.1/servers/c3e6246d-c32a-490d-ba83-84b54822f971" status: 200 len: 1312 microversion: 2.1 time: 0.959373 Oct 22 20:58:41.216197 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1186/2242] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:58:40 2022] GET /compute/v2.1/servers/c3e6246d-c32a-490d-ba83-84b54822f971 => generated 1312 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:58:41.533892 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-b895ce20-e9d2-435a-a0df-a6f01325838f tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dbe89a7e11480194d3d86f82983499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8351b01e07cd43f9be973ab45e522bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:58:41.544540 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-b895ce20-e9d2-435a-a0df-a6f01325838f tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] 10.222.0.18 "GET /compute/v2.1/servers/f070b144-3a1a-4456-8e5b-02af12557c6a" status: 200 len: 1472 microversion: 2.1 time: 0.662266 Oct 22 20:58:41.559363 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1057/2243] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:58:40 2022] GET /compute/v2.1/servers/f070b144-3a1a-4456-8e5b-02af12557c6a => generated 1472 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 20:58:42.240916 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-00cf0cbc-be53-431d-bd9b-704de902c0b1 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:58:42.242114 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-00cf0cbc-be53-431d-bd9b-704de902c0b1 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] [instance: c3e6246d-c32a-490d-ba83-84b54822f971] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:58:42.256036 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-00cf0cbc-be53-431d-bd9b-704de902c0b1 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:42.260562 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-00cf0cbc-be53-431d-bd9b-704de902c0b1 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:42.265816 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-00cf0cbc-be53-431d-bd9b-704de902c0b1 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:42.267044 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-00cf0cbc-be53-431d-bd9b-704de902c0b1 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:42.271929 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-00cf0cbc-be53-431d-bd9b-704de902c0b1 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:42.272605 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-00cf0cbc-be53-431d-bd9b-704de902c0b1 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:42.570439 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-f612f980-f306-450b-b8cc-a723dbfae1ee tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:58:42.571065 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-f612f980-f306-450b-b8cc-a723dbfae1ee tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] [instance: f070b144-3a1a-4456-8e5b-02af12557c6a] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:58:42.587893 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f612f980-f306-450b-b8cc-a723dbfae1ee tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:42.588390 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f612f980-f306-450b-b8cc-a723dbfae1ee tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:42.588833 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f612f980-f306-450b-b8cc-a723dbfae1ee tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:42.589545 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f612f980-f306-450b-b8cc-a723dbfae1ee tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:42.589998 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f612f980-f306-450b-b8cc-a723dbfae1ee tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:42.590420 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f612f980-f306-450b-b8cc-a723dbfae1ee tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:43.019518 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-00cf0cbc-be53-431d-bd9b-704de902c0b1 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d3d7458af447bdb3f03e83a2d8559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49238b8686d24ae698679e4a1957735d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:58:43.036891 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-00cf0cbc-be53-431d-bd9b-704de902c0b1 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] 10.222.0.18 "GET /compute/v2.1/servers/c3e6246d-c32a-490d-ba83-84b54822f971" status: 200 len: 1312 microversion: 2.1 time: 0.799845 Oct 22 20:58:43.049634 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1187/2244] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:58:42 2022] GET /compute/v2.1/servers/c3e6246d-c32a-490d-ba83-84b54822f971 => generated 1312 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:58:43.105684 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-6d1aab8a-0c7b-4724-8317-4ccd2f7bc827 req-7ad6c77c-f323-4b90-aadb-580df4359937 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3e6246d-c32a-490d-ba83-84b54822f971", "name": "network-vif-plugged", "status": "completed", "tag": "140cd909-abde-4ea9-89c0-b130f4264b5b"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:58:43.119451 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:58:43.121632 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-6d1aab8a-0c7b-4724-8317-4ccd2f7bc827 req-7ad6c77c-f323-4b90-aadb-580df4359937 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:43.122331 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-6d1aab8a-0c7b-4724-8317-4ccd2f7bc827 req-7ad6c77c-f323-4b90-aadb-580df4359937 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:43.123383 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-6d1aab8a-0c7b-4724-8317-4ccd2f7bc827 req-7ad6c77c-f323-4b90-aadb-580df4359937 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:43.155481 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-6d1aab8a-0c7b-4724-8317-4ccd2f7bc827 req-7ad6c77c-f323-4b90-aadb-580df4359937 service nova] Creating event network-vif-plugged:140cd909-abde-4ea9-89c0-b130f4264b5b for instance c3e6246d-c32a-490d-ba83-84b54822f971 on nch1-master-1 Oct 22 20:58:43.163715 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-6d1aab8a-0c7b-4724-8317-4ccd2f7bc827 req-7ad6c77c-f323-4b90-aadb-580df4359937 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061222 Oct 22 20:58:43.165035 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1188/2245] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:58:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:58:43.295700 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-f612f980-f306-450b-b8cc-a723dbfae1ee tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dbe89a7e11480194d3d86f82983499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8351b01e07cd43f9be973ab45e522bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:58:43.312819 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-f612f980-f306-450b-b8cc-a723dbfae1ee tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] 10.222.0.18 "GET /compute/v2.1/servers/f070b144-3a1a-4456-8e5b-02af12557c6a" status: 200 len: 1472 microversion: 2.1 time: 0.745974 Oct 22 20:58:43.315994 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1058/2246] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:58:42 2022] GET /compute/v2.1/servers/f070b144-3a1a-4456-8e5b-02af12557c6a => generated 1472 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:58:43.541418 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-52915a36-f3ee-4e43-a02f-4a36d36f6d27 tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:58:43.543860 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-52915a36-f3ee-4e43-a02f-4a36d36f6d27 tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] [instance: 19465083-6d3a-485d-9101-950d9c45abaf] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:58:43.577663 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-52915a36-f3ee-4e43-a02f-4a36d36f6d27 tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:43.578248 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-52915a36-f3ee-4e43-a02f-4a36d36f6d27 tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:43.578628 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-52915a36-f3ee-4e43-a02f-4a36d36f6d27 tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:43.580609 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-52915a36-f3ee-4e43-a02f-4a36d36f6d27 tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:43.584459 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-52915a36-f3ee-4e43-a02f-4a36d36f6d27 tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:43.585141 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-52915a36-f3ee-4e43-a02f-4a36d36f6d27 tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:43.866255 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-9340f5a8-a52f-49d6-897f-d6abce641951 req-31d5f597-ee4e-4941-8dc9-2b05ad600683 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19465083-6d3a-485d-9101-950d9c45abaf", "tag": "cdb0c7d2-5618-446f-9f1a-9ed8b48f5bc2"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:58:43.894209 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-9340f5a8-a52f-49d6-897f-d6abce641951 req-31d5f597-ee4e-4941-8dc9-2b05ad600683 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:43.894953 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-9340f5a8-a52f-49d6-897f-d6abce641951 req-31d5f597-ee4e-4941-8dc9-2b05ad600683 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:43.895373 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-9340f5a8-a52f-49d6-897f-d6abce641951 req-31d5f597-ee4e-4941-8dc9-2b05ad600683 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:43.926691 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-9340f5a8-a52f-49d6-897f-d6abce641951 req-31d5f597-ee4e-4941-8dc9-2b05ad600683 service nova] Creating event network-changed:cdb0c7d2-5618-446f-9f1a-9ed8b48f5bc2 for instance 19465083-6d3a-485d-9101-950d9c45abaf on nch2-master-1 Oct 22 20:58:43.928133 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-52915a36-f3ee-4e43-a02f-4a36d36f6d27 tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb8017457354ed68be65cb426965cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af194191cdc4b34a470c821a932e2fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:58:43.939990 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-9340f5a8-a52f-49d6-897f-d6abce641951 req-31d5f597-ee4e-4941-8dc9-2b05ad600683 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.379322 Oct 22 20:58:43.940824 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1059/2247] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:58:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 20:58:43.945478 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-52915a36-f3ee-4e43-a02f-4a36d36f6d27 tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] 10.222.0.18 "GET /compute/v2.1/servers/19465083-6d3a-485d-9101-950d9c45abaf" status: 200 len: 1575 microversion: 2.1 time: 0.408650 Oct 22 20:58:43.955780 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1189/2248] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:58:43 2022] GET /compute/v2.1/servers/19465083-6d3a-485d-9101-950d9c45abaf => generated 1575 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:58:44.064278 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-7f5420d8-a643-43ba-9ec4-ffdd043c3688 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:58:44.065731 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-7f5420d8-a643-43ba-9ec4-ffdd043c3688 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] [instance: c3e6246d-c32a-490d-ba83-84b54822f971] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:58:44.083858 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7f5420d8-a643-43ba-9ec4-ffdd043c3688 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:44.084404 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7f5420d8-a643-43ba-9ec4-ffdd043c3688 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:44.084858 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7f5420d8-a643-43ba-9ec4-ffdd043c3688 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:44.092152 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7f5420d8-a643-43ba-9ec4-ffdd043c3688 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:44.092853 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7f5420d8-a643-43ba-9ec4-ffdd043c3688 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:44.098066 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7f5420d8-a643-43ba-9ec4-ffdd043c3688 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:44.336891 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-419a0b36-8f4c-47af-b3d2-21254ecb9a2b tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:58:44.338467 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-419a0b36-8f4c-47af-b3d2-21254ecb9a2b tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] [instance: f070b144-3a1a-4456-8e5b-02af12557c6a] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:58:44.348557 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-419a0b36-8f4c-47af-b3d2-21254ecb9a2b tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:44.354133 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-419a0b36-8f4c-47af-b3d2-21254ecb9a2b tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:44.354934 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-419a0b36-8f4c-47af-b3d2-21254ecb9a2b tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:44.355885 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-419a0b36-8f4c-47af-b3d2-21254ecb9a2b tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:44.357904 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-419a0b36-8f4c-47af-b3d2-21254ecb9a2b tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:44.358590 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-419a0b36-8f4c-47af-b3d2-21254ecb9a2b tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:44.905779 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-7f5420d8-a643-43ba-9ec4-ffdd043c3688 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d3d7458af447bdb3f03e83a2d8559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49238b8686d24ae698679e4a1957735d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:58:44.919693 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-7f5420d8-a643-43ba-9ec4-ffdd043c3688 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] 10.222.0.18 "GET /compute/v2.1/servers/c3e6246d-c32a-490d-ba83-84b54822f971" status: 200 len: 1312 microversion: 2.1 time: 0.861011 Oct 22 20:58:44.924515 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1060/2249] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:58:44 2022] GET /compute/v2.1/servers/c3e6246d-c32a-490d-ba83-84b54822f971 => generated 1312 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:58:45.078744 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-419a0b36-8f4c-47af-b3d2-21254ecb9a2b tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dbe89a7e11480194d3d86f82983499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8351b01e07cd43f9be973ab45e522bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:58:45.087321 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-419a0b36-8f4c-47af-b3d2-21254ecb9a2b tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] 10.222.0.18 "GET /compute/v2.1/servers/f070b144-3a1a-4456-8e5b-02af12557c6a" status: 200 len: 1472 microversion: 2.1 time: 0.754292 Oct 22 20:58:45.087948 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1190/2250] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:58:44 2022] GET /compute/v2.1/servers/f070b144-3a1a-4456-8e5b-02af12557c6a => generated 1472 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 20:58:45.945053 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-f9000503-9f16-4f6a-8e09-1c47995a6ba0 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:58:45.946262 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-f9000503-9f16-4f6a-8e09-1c47995a6ba0 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] [instance: c3e6246d-c32a-490d-ba83-84b54822f971] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:58:45.953701 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f9000503-9f16-4f6a-8e09-1c47995a6ba0 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:45.960532 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f9000503-9f16-4f6a-8e09-1c47995a6ba0 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:45.961235 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f9000503-9f16-4f6a-8e09-1c47995a6ba0 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:45.962160 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f9000503-9f16-4f6a-8e09-1c47995a6ba0 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:45.964322 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f9000503-9f16-4f6a-8e09-1c47995a6ba0 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:45.966974 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f9000503-9f16-4f6a-8e09-1c47995a6ba0 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:46.112363 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-dd0a3103-c6ee-4c42-a51e-c89bcbc3bf50 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:58:46.112976 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-dd0a3103-c6ee-4c42-a51e-c89bcbc3bf50 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] [instance: f070b144-3a1a-4456-8e5b-02af12557c6a] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:58:46.127460 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-dd0a3103-c6ee-4c42-a51e-c89bcbc3bf50 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:46.128406 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-dd0a3103-c6ee-4c42-a51e-c89bcbc3bf50 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:46.129024 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-dd0a3103-c6ee-4c42-a51e-c89bcbc3bf50 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:46.129905 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-dd0a3103-c6ee-4c42-a51e-c89bcbc3bf50 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:46.131097 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-dd0a3103-c6ee-4c42-a51e-c89bcbc3bf50 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:46.133042 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-dd0a3103-c6ee-4c42-a51e-c89bcbc3bf50 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:46.618049 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-dd0a3103-c6ee-4c42-a51e-c89bcbc3bf50 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dbe89a7e11480194d3d86f82983499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8351b01e07cd43f9be973ab45e522bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:58:46.643862 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-dd0a3103-c6ee-4c42-a51e-c89bcbc3bf50 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] 10.222.0.18 "GET /compute/v2.1/servers/f070b144-3a1a-4456-8e5b-02af12557c6a" status: 200 len: 1472 microversion: 2.1 time: 0.534371 Oct 22 20:58:46.671134 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-f9000503-9f16-4f6a-8e09-1c47995a6ba0 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d3d7458af447bdb3f03e83a2d8559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49238b8686d24ae698679e4a1957735d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:58:46.674799 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1191/2251] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:58:46 2022] GET /compute/v2.1/servers/f070b144-3a1a-4456-8e5b-02af12557c6a => generated 1472 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:58:46.681351 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-f9000503-9f16-4f6a-8e09-1c47995a6ba0 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] 10.222.0.18 "GET /compute/v2.1/servers/c3e6246d-c32a-490d-ba83-84b54822f971" status: 200 len: 1462 microversion: 2.1 time: 0.740165 Oct 22 20:58:46.684363 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1061/2252] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:58:45 2022] GET /compute/v2.1/servers/c3e6246d-c32a-490d-ba83-84b54822f971 => generated 1462 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:58:46.709052 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-289c8230-7ca6-4b9a-95da-5f024546bd3c tempest-MigrationsAdminTest-1403807426 tempest-MigrationsAdminTest-1403807426-project-admin] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:58:46.709933 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-289c8230-7ca6-4b9a-95da-5f024546bd3c tempest-MigrationsAdminTest-1403807426 tempest-MigrationsAdminTest-1403807426-project-admin] [instance: c3e6246d-c32a-490d-ba83-84b54822f971] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:58:46.717236 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-289c8230-7ca6-4b9a-95da-5f024546bd3c tempest-MigrationsAdminTest-1403807426 tempest-MigrationsAdminTest-1403807426-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:46.718083 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-289c8230-7ca6-4b9a-95da-5f024546bd3c tempest-MigrationsAdminTest-1403807426 tempest-MigrationsAdminTest-1403807426-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:46.719069 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-289c8230-7ca6-4b9a-95da-5f024546bd3c tempest-MigrationsAdminTest-1403807426 tempest-MigrationsAdminTest-1403807426-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:46.720571 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-289c8230-7ca6-4b9a-95da-5f024546bd3c tempest-MigrationsAdminTest-1403807426 tempest-MigrationsAdminTest-1403807426-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:46.721198 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-289c8230-7ca6-4b9a-95da-5f024546bd3c tempest-MigrationsAdminTest-1403807426 tempest-MigrationsAdminTest-1403807426-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:46.721893 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-289c8230-7ca6-4b9a-95da-5f024546bd3c tempest-MigrationsAdminTest-1403807426 tempest-MigrationsAdminTest-1403807426-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:46.987044 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-289c8230-7ca6-4b9a-95da-5f024546bd3c tempest-MigrationsAdminTest-1403807426 tempest-MigrationsAdminTest-1403807426-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/c3e6246d-c32a-490d-ba83-84b54822f971" status: 200 len: 1613 microversion: 2.1 time: 0.280986 Oct 22 20:58:46.990212 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1192/2253] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:58:46 2022] GET /compute/v2.1/servers/c3e6246d-c32a-490d-ba83-84b54822f971 => generated 1613 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:58:47.012630 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-60b965f8-a762-4a15-9909-af2200db9d1a tempest-MigrationsAdminTest-1403807426 tempest-MigrationsAdminTest-1403807426-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:58:47.013835 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-60b965f8-a762-4a15-9909-af2200db9d1a tempest-MigrationsAdminTest-1403807426 tempest-MigrationsAdminTest-1403807426-project-admin] [instance: c3e6246d-c32a-490d-ba83-84b54822f971] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:58:47.031964 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-60b965f8-a762-4a15-9909-af2200db9d1a tempest-MigrationsAdminTest-1403807426 tempest-MigrationsAdminTest-1403807426-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:47.033276 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-60b965f8-a762-4a15-9909-af2200db9d1a tempest-MigrationsAdminTest-1403807426 tempest-MigrationsAdminTest-1403807426-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:47.036226 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-60b965f8-a762-4a15-9909-af2200db9d1a tempest-MigrationsAdminTest-1403807426 tempest-MigrationsAdminTest-1403807426-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:47.037222 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-60b965f8-a762-4a15-9909-af2200db9d1a tempest-MigrationsAdminTest-1403807426 tempest-MigrationsAdminTest-1403807426-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:47.042997 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-60b965f8-a762-4a15-9909-af2200db9d1a tempest-MigrationsAdminTest-1403807426 tempest-MigrationsAdminTest-1403807426-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:47.044169 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-60b965f8-a762-4a15-9909-af2200db9d1a tempest-MigrationsAdminTest-1403807426 tempest-MigrationsAdminTest-1403807426-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:47.110083 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-60b965f8-a762-4a15-9909-af2200db9d1a tempest-MigrationsAdminTest-1403807426 tempest-MigrationsAdminTest-1403807426-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '3a4182f462944ed395775d823014f847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164ae46cbb694cd999c7b4b0bcb4fdba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:58:47.110700 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-60b965f8-a762-4a15-9909-af2200db9d1a tempest-MigrationsAdminTest-1403807426 tempest-MigrationsAdminTest-1403807426-project-admin] [instance: c3e6246d-c32a-490d-ba83-84b54822f971] flavor_id is None. Assuming migration. {{(pid=138744) resize /opt/stack/nova/nova/compute/api.py:4196}} Oct 22 20:58:47.111254 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-60b965f8-a762-4a15-9909-af2200db9d1a tempest-MigrationsAdminTest-1403807426 tempest-MigrationsAdminTest-1403807426-project-admin] [instance: c3e6246d-c32a-490d-ba83-84b54822f971] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=138744) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 22 20:58:47.686203 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-ab06361d-825f-4a74-87c4-3f7a50beff8d tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:58:47.689845 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-ab06361d-825f-4a74-87c4-3f7a50beff8d tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] [instance: f070b144-3a1a-4456-8e5b-02af12557c6a] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:58:47.714409 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-60b965f8-a762-4a15-9909-af2200db9d1a tempest-MigrationsAdminTest-1403807426 tempest-MigrationsAdminTest-1403807426-project-admin] 10.222.0.18 "POST /compute/v2.1/servers/c3e6246d-c32a-490d-ba83-84b54822f971/action" status: 202 len: 0 microversion: 2.1 time: 0.706803 Oct 22 20:58:47.715379 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1062/2254] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 20:58:47 2022] POST /compute/v2.1/servers/c3e6246d-c32a-490d-ba83-84b54822f971/action => generated 0 bytes in 709 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 20:58:47.724810 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-fa4fc602-9e52-44b0-8283-06bbe522605a tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:58:47.725754 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-fa4fc602-9e52-44b0-8283-06bbe522605a tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] [instance: c3e6246d-c32a-490d-ba83-84b54822f971] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:58:47.729421 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ab06361d-825f-4a74-87c4-3f7a50beff8d tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:47.730338 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ab06361d-825f-4a74-87c4-3f7a50beff8d tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:47.733846 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fa4fc602-9e52-44b0-8283-06bbe522605a tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:47.734716 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fa4fc602-9e52-44b0-8283-06bbe522605a tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:47.734937 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ab06361d-825f-4a74-87c4-3f7a50beff8d tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:47.735565 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fa4fc602-9e52-44b0-8283-06bbe522605a tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:47.735942 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ab06361d-825f-4a74-87c4-3f7a50beff8d tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:47.737852 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ab06361d-825f-4a74-87c4-3f7a50beff8d tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:47.738852 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fa4fc602-9e52-44b0-8283-06bbe522605a tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:47.739530 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fa4fc602-9e52-44b0-8283-06bbe522605a tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:47.740023 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ab06361d-825f-4a74-87c4-3f7a50beff8d tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:47.741795 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fa4fc602-9e52-44b0-8283-06bbe522605a tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:48.154147 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-ab06361d-825f-4a74-87c4-3f7a50beff8d tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dbe89a7e11480194d3d86f82983499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8351b01e07cd43f9be973ab45e522bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:58:48.168540 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-ab06361d-825f-4a74-87c4-3f7a50beff8d tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] 10.222.0.18 "GET /compute/v2.1/servers/f070b144-3a1a-4456-8e5b-02af12557c6a" status: 200 len: 1472 microversion: 2.1 time: 0.489291 Oct 22 20:58:48.169168 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1193/2255] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:58:47 2022] GET /compute/v2.1/servers/f070b144-3a1a-4456-8e5b-02af12557c6a => generated 1472 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 20:58:48.279120 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-fa4fc602-9e52-44b0-8283-06bbe522605a tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d3d7458af447bdb3f03e83a2d8559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49238b8686d24ae698679e4a1957735d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:58:48.289220 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-fa4fc602-9e52-44b0-8283-06bbe522605a tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] 10.222.0.18 "GET /compute/v2.1/servers/c3e6246d-c32a-490d-ba83-84b54822f971" status: 200 len: 1471 microversion: 2.1 time: 0.569440 Oct 22 20:58:48.299399 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1063/2256] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:58:47 2022] GET /compute/v2.1/servers/c3e6246d-c32a-490d-ba83-84b54822f971 => generated 1471 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:58:49.197206 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-175205ee-3821-46fc-bc72-9203fe40dfd1 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:58:49.198030 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-175205ee-3821-46fc-bc72-9203fe40dfd1 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] [instance: f070b144-3a1a-4456-8e5b-02af12557c6a] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:58:49.215144 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-175205ee-3821-46fc-bc72-9203fe40dfd1 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:49.221295 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-175205ee-3821-46fc-bc72-9203fe40dfd1 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:49.223237 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-175205ee-3821-46fc-bc72-9203fe40dfd1 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:49.224611 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-175205ee-3821-46fc-bc72-9203fe40dfd1 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:49.229526 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-175205ee-3821-46fc-bc72-9203fe40dfd1 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:49.237485 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-175205ee-3821-46fc-bc72-9203fe40dfd1 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:49.322569 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-ab1b4219-5684-46cf-8e64-173fe49c026d tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:58:49.323374 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-ab1b4219-5684-46cf-8e64-173fe49c026d tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] [instance: c3e6246d-c32a-490d-ba83-84b54822f971] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:58:49.344101 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ab1b4219-5684-46cf-8e64-173fe49c026d tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:49.345515 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ab1b4219-5684-46cf-8e64-173fe49c026d tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:49.350560 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ab1b4219-5684-46cf-8e64-173fe49c026d tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:49.352564 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ab1b4219-5684-46cf-8e64-173fe49c026d tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:49.356797 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ab1b4219-5684-46cf-8e64-173fe49c026d tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:49.357363 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ab1b4219-5684-46cf-8e64-173fe49c026d tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:49.457532 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:58:51.147993 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-175205ee-3821-46fc-bc72-9203fe40dfd1 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dbe89a7e11480194d3d86f82983499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8351b01e07cd43f9be973ab45e522bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:58:51.157827 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-ab1b4219-5684-46cf-8e64-173fe49c026d tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d3d7458af447bdb3f03e83a2d8559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49238b8686d24ae698679e4a1957735d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:58:51.162300 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-175205ee-3821-46fc-bc72-9203fe40dfd1 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] 10.222.0.18 "GET /compute/v2.1/servers/f070b144-3a1a-4456-8e5b-02af12557c6a" status: 200 len: 1472 microversion: 2.1 time: 1.972146 Oct 22 20:58:51.163141 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1194/2257] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:58:49 2022] GET /compute/v2.1/servers/f070b144-3a1a-4456-8e5b-02af12557c6a => generated 1472 bytes in 1976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:58:51.167417 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-ab1b4219-5684-46cf-8e64-173fe49c026d tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] 10.222.0.18 "GET /compute/v2.1/servers/c3e6246d-c32a-490d-ba83-84b54822f971" status: 200 len: 1471 microversion: 2.1 time: 1.849132 Oct 22 20:58:51.167995 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1064/2258] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:58:49 2022] GET /compute/v2.1/servers/c3e6246d-c32a-490d-ba83-84b54822f971 => generated 1471 bytes in 1850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:58:52.197922 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-b03521e1-550d-4b46-9863-01aa6a36c5d3 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:58:52.198543 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-b03521e1-550d-4b46-9863-01aa6a36c5d3 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] [instance: f070b144-3a1a-4456-8e5b-02af12557c6a] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:58:52.202901 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-e2717899-2a98-4b7e-b955-5aab000ed486 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:58:52.204243 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-e2717899-2a98-4b7e-b955-5aab000ed486 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] [instance: c3e6246d-c32a-490d-ba83-84b54822f971] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:58:52.216092 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e2717899-2a98-4b7e-b955-5aab000ed486 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:52.218582 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e2717899-2a98-4b7e-b955-5aab000ed486 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:52.219269 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e2717899-2a98-4b7e-b955-5aab000ed486 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:52.221590 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e2717899-2a98-4b7e-b955-5aab000ed486 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:52.222424 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e2717899-2a98-4b7e-b955-5aab000ed486 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:52.223486 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e2717899-2a98-4b7e-b955-5aab000ed486 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:52.229087 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b03521e1-550d-4b46-9863-01aa6a36c5d3 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:52.232997 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b03521e1-550d-4b46-9863-01aa6a36c5d3 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:52.236193 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b03521e1-550d-4b46-9863-01aa6a36c5d3 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:52.239191 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b03521e1-550d-4b46-9863-01aa6a36c5d3 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:52.242315 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b03521e1-550d-4b46-9863-01aa6a36c5d3 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:52.242968 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b03521e1-550d-4b46-9863-01aa6a36c5d3 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:52.835212 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-e2717899-2a98-4b7e-b955-5aab000ed486 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d3d7458af447bdb3f03e83a2d8559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49238b8686d24ae698679e4a1957735d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:58:52.860366 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-e2717899-2a98-4b7e-b955-5aab000ed486 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] 10.222.0.18 "GET /compute/v2.1/servers/c3e6246d-c32a-490d-ba83-84b54822f971" status: 200 len: 1471 microversion: 2.1 time: 0.661870 Oct 22 20:58:52.862047 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1065/2259] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:58:52 2022] GET /compute/v2.1/servers/c3e6246d-c32a-490d-ba83-84b54822f971 => generated 1471 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:58:53.127948 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-f166abde-0829-41aa-bd5b-16e365911a51 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Action: 'create', calling method: .version_select at 0x7fd3a4344790>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1089174612", "description": "tempest-description-1212319775"}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:58:53.357227 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-b03521e1-550d-4b46-9863-01aa6a36c5d3 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dbe89a7e11480194d3d86f82983499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8351b01e07cd43f9be973ab45e522bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:58:53.377520 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-b03521e1-550d-4b46-9863-01aa6a36c5d3 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] 10.222.0.18 "GET /compute/v2.1/servers/f070b144-3a1a-4456-8e5b-02af12557c6a" status: 200 len: 1478 microversion: 2.1 time: 1.184377 Oct 22 20:58:53.379507 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1195/2260] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:58:52 2022] GET /compute/v2.1/servers/f070b144-3a1a-4456-8e5b-02af12557c6a => generated 1478 bytes in 1190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:58:53.899030 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-c800ee1a-29d7-4568-9318-92ab092a511d tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:58:53.900560 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-c800ee1a-29d7-4568-9318-92ab092a511d tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] [instance: c3e6246d-c32a-490d-ba83-84b54822f971] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:58:53.922926 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c800ee1a-29d7-4568-9318-92ab092a511d tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:53.925888 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c800ee1a-29d7-4568-9318-92ab092a511d tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:53.927715 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c800ee1a-29d7-4568-9318-92ab092a511d tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:53.931024 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c800ee1a-29d7-4568-9318-92ab092a511d tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:53.931797 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c800ee1a-29d7-4568-9318-92ab092a511d tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:53.934826 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c800ee1a-29d7-4568-9318-92ab092a511d tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:54.091690 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-f166abde-0829-41aa-bd5b-16e365911a51 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] 10.222.0.18 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 1.228199 Oct 22 20:58:54.092309 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1066/2261] 10.222.0.18 () {60 vars in 1180 bytes} [Sat Oct 22 20:58:52 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 1230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:58:54.108601 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-f863ba20-8bfb-4c03-9400-8186a2a7d837 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Action: 'create', calling method: .version_select at 0x7fd3a40c4160>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-887294930", "description": "tempest-description-1242824348"}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:58:55.238264 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-c800ee1a-29d7-4568-9318-92ab092a511d tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d3d7458af447bdb3f03e83a2d8559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49238b8686d24ae698679e4a1957735d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:58:55.258220 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-c800ee1a-29d7-4568-9318-92ab092a511d tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] 10.222.0.18 "GET /compute/v2.1/servers/c3e6246d-c32a-490d-ba83-84b54822f971" status: 200 len: 1476 microversion: 2.1 time: 1.373612 Oct 22 20:58:55.267516 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1196/2262] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:58:53 2022] GET /compute/v2.1/servers/c3e6246d-c32a-490d-ba83-84b54822f971 => generated 1476 bytes in 1384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:58:55.287212 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-5bece6f4-ec8d-4f88-a7be-8c9e1cd35d54 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:58:55.291752 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-5bece6f4-ec8d-4f88-a7be-8c9e1cd35d54 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] [instance: f070b144-3a1a-4456-8e5b-02af12557c6a] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:58:55.301707 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5bece6f4-ec8d-4f88-a7be-8c9e1cd35d54 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:55.302223 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5bece6f4-ec8d-4f88-a7be-8c9e1cd35d54 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:55.302670 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5bece6f4-ec8d-4f88-a7be-8c9e1cd35d54 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:55.303443 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5bece6f4-ec8d-4f88-a7be-8c9e1cd35d54 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:55.312356 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5bece6f4-ec8d-4f88-a7be-8c9e1cd35d54 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:55.313550 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5bece6f4-ec8d-4f88-a7be-8c9e1cd35d54 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:55.903921 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-f863ba20-8bfb-4c03-9400-8186a2a7d837 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] 10.222.0.18 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 1.801409 Oct 22 20:58:55.905343 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1067/2263] 10.222.0.18 () {60 vars in 1180 bytes} [Sat Oct 22 20:58:54 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 1804 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:58:56.010897 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-84920883-4ab3-44c4-b7e2-7227ab81c391 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-1661396126", "imageRef": "085e4478-6edc-4a69-8e08-f9831713eb65", "flavorRef": "452", "networks": [{"uuid": "a5d4328d-f0bd-4bb4-b222-8621ca60aa66"}]}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:58:56.105572 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-5bece6f4-ec8d-4f88-a7be-8c9e1cd35d54 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dbe89a7e11480194d3d86f82983499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8351b01e07cd43f9be973ab45e522bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:58:56.123362 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.network.neutron [None req-84920883-4ab3-44c4-b7e2-7227ab81c391 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] validate_networks() for [('a5d4328d-f0bd-4bb4-b222-8621ca60aa66', None, None, None, None, None)] {{(pid=138744) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 20:58:56.124951 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-5bece6f4-ec8d-4f88-a7be-8c9e1cd35d54 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] 10.222.0.18 "GET /compute/v2.1/servers/f070b144-3a1a-4456-8e5b-02af12557c6a" status: 200 len: 1478 microversion: 2.1 time: 0.854063 Oct 22 20:58:56.125581 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1197/2264] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:58:55 2022] GET /compute/v2.1/servers/f070b144-3a1a-4456-8e5b-02af12557c6a => generated 1478 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:58:56.286897 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-4434097f-6246-44ff-b834-1a64eaa4d967 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:58:56.287628 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-4434097f-6246-44ff-b834-1a64eaa4d967 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] [instance: c3e6246d-c32a-490d-ba83-84b54822f971] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:58:56.305294 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4434097f-6246-44ff-b834-1a64eaa4d967 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:56.306150 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4434097f-6246-44ff-b834-1a64eaa4d967 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:56.306807 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4434097f-6246-44ff-b834-1a64eaa4d967 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:56.307746 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4434097f-6246-44ff-b834-1a64eaa4d967 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:56.308212 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4434097f-6246-44ff-b834-1a64eaa4d967 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:56.308651 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4434097f-6246-44ff-b834-1a64eaa4d967 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:56.348596 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell1:SELECT=100 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:58:57.136622 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-4434097f-6246-44ff-b834-1a64eaa4d967 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d3d7458af447bdb3f03e83a2d8559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49238b8686d24ae698679e4a1957735d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:58:57.149324 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-4434097f-6246-44ff-b834-1a64eaa4d967 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] 10.222.0.18 "GET /compute/v2.1/servers/c3e6246d-c32a-490d-ba83-84b54822f971" status: 200 len: 1476 microversion: 2.1 time: 0.866776 Oct 22 20:58:57.150700 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1198/2265] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:58:56 2022] GET /compute/v2.1/servers/c3e6246d-c32a-490d-ba83-84b54822f971 => generated 1476 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 20:58:57.155921 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-90dc620d-70cc-4183-bd1c-9e29979548d9 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:58:57.156829 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-90dc620d-70cc-4183-bd1c-9e29979548d9 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] [instance: f070b144-3a1a-4456-8e5b-02af12557c6a] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:58:57.177223 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-90dc620d-70cc-4183-bd1c-9e29979548d9 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:57.178378 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-90dc620d-70cc-4183-bd1c-9e29979548d9 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:57.179412 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-90dc620d-70cc-4183-bd1c-9e29979548d9 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:57.181879 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-90dc620d-70cc-4183-bd1c-9e29979548d9 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:57.182805 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-90dc620d-70cc-4183-bd1c-9e29979548d9 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:57.184652 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-90dc620d-70cc-4183-bd1c-9e29979548d9 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:57.621920 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-84920883-4ab3-44c4-b7e2-7227ab81c391 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Flavor limits 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 20:58:57.622411 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-84920883-4ab3-44c4-b7e2-7227ab81c391 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Image limits 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 20:58:57.623057 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-84920883-4ab3-44c4-b7e2-7227ab81c391 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Flavor pref 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 20:58:57.624127 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-84920883-4ab3-44c4-b7e2-7227ab81c391 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Image pref 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 20:58:57.624713 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-84920883-4ab3-44c4-b7e2-7227ab81c391 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 20:58:57.640076 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-84920883-4ab3-44c4-b7e2-7227ab81c391 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:57.640577 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-84920883-4ab3-44c4-b7e2-7227ab81c391 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:57.641024 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-84920883-4ab3-44c4-b7e2-7227ab81c391 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:57.641948 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-84920883-4ab3-44c4-b7e2-7227ab81c391 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:57.643358 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-84920883-4ab3-44c4-b7e2-7227ab81c391 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:57.644405 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-84920883-4ab3-44c4-b7e2-7227ab81c391 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:57.673273 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-84920883-4ab3-44c4-b7e2-7227ab81c391 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Getting quotas for project ed31e93b0e8a43f28e497f94318815ce. Resources: {'cores', 'instances', 'ram'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 20:58:57.678088 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-90dc620d-70cc-4183-bd1c-9e29979548d9 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dbe89a7e11480194d3d86f82983499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8351b01e07cd43f9be973ab45e522bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:58:57.680778 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-84920883-4ab3-44c4-b7e2-7227ab81c391 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Getting quotas for user 46d49952dbca4d95a25411b65d56552b and project ed31e93b0e8a43f28e497f94318815ce. Resources: {'cores', 'instances', 'ram'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 20:58:57.687639 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-90dc620d-70cc-4183-bd1c-9e29979548d9 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] 10.222.0.18 "GET /compute/v2.1/servers/f070b144-3a1a-4456-8e5b-02af12557c6a" status: 200 len: 1478 microversion: 2.1 time: 0.535433 Oct 22 20:58:57.692733 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1199/2266] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:58:57 2022] GET /compute/v2.1/servers/f070b144-3a1a-4456-8e5b-02af12557c6a => generated 1478 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:58:57.712128 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-84920883-4ab3-44c4-b7e2-7227ab81c391 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Going to run 1 instances... {{(pid=138744) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 20:58:57.716640 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-84920883-4ab3-44c4-b7e2-7227ab81c391 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] [instance: 61d89bc7-fcfe-479b-baa1-7307a4395cc3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='085e4478-6edc-4a69-8e08-f9831713eb65',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138744) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 20:58:57.799115 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-84920883-4ab3-44c4-b7e2-7227ab81c391 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.792172 Oct 22 20:58:57.826170 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-1653f6e0-e254-4a85-a154-45a828ea70f1 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:58:57.827546 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1068/2267] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Oct 22 20:58:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 1822 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 22 20:58:57.827707 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-1653f6e0-e254-4a85-a154-45a828ea70f1 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] [instance: 61d89bc7-fcfe-479b-baa1-7307a4395cc3] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:58:57.997789 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-1653f6e0-e254-4a85-a154-45a828ea70f1 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d49952dbca4d95a25411b65d56552b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed31e93b0e8a43f28e497f94318815ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:58:58.038565 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-1653f6e0-e254-4a85-a154-45a828ea70f1 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] 10.222.0.18 "GET /compute/v2.1/servers/61d89bc7-fcfe-479b-baa1-7307a4395cc3" status: 200 len: 1216 microversion: 2.1 time: 0.215062 Oct 22 20:58:58.048286 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1200/2268] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:58:57 2022] GET /compute/v2.1/servers/61d89bc7-fcfe-479b-baa1-7307a4395cc3 => generated 1216 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:58:58.176792 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-f629bb2c-af8f-4567-965f-ab05a6ca73f6 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:58:58.177745 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-f629bb2c-af8f-4567-965f-ab05a6ca73f6 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] [instance: c3e6246d-c32a-490d-ba83-84b54822f971] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:58:58.193484 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f629bb2c-af8f-4567-965f-ab05a6ca73f6 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:58.196804 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f629bb2c-af8f-4567-965f-ab05a6ca73f6 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:58.198680 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f629bb2c-af8f-4567-965f-ab05a6ca73f6 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:58.201264 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f629bb2c-af8f-4567-965f-ab05a6ca73f6 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:58.204127 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f629bb2c-af8f-4567-965f-ab05a6ca73f6 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:58.206410 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f629bb2c-af8f-4567-965f-ab05a6ca73f6 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:58.721175 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-f2e15aa8-d1af-45a0-ba1b-cb8ea3bda69e tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:58:58.723857 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-f2e15aa8-d1af-45a0-ba1b-cb8ea3bda69e tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] [instance: f070b144-3a1a-4456-8e5b-02af12557c6a] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:58:58.750255 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f2e15aa8-d1af-45a0-ba1b-cb8ea3bda69e tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:58.751760 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f2e15aa8-d1af-45a0-ba1b-cb8ea3bda69e tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:58.753608 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f2e15aa8-d1af-45a0-ba1b-cb8ea3bda69e tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:58.754658 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f2e15aa8-d1af-45a0-ba1b-cb8ea3bda69e tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:58.755750 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f2e15aa8-d1af-45a0-ba1b-cb8ea3bda69e tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:58.756420 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f2e15aa8-d1af-45a0-ba1b-cb8ea3bda69e tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:59.090264 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-f629bb2c-af8f-4567-965f-ab05a6ca73f6 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d3d7458af447bdb3f03e83a2d8559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49238b8686d24ae698679e4a1957735d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:58:59.103517 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-f629bb2c-af8f-4567-965f-ab05a6ca73f6 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] 10.222.0.18 "GET /compute/v2.1/servers/c3e6246d-c32a-490d-ba83-84b54822f971" status: 200 len: 1476 microversion: 2.1 time: 0.930620 Oct 22 20:58:59.115012 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1069/2269] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:58:58 2022] GET /compute/v2.1/servers/c3e6246d-c32a-490d-ba83-84b54822f971 => generated 1476 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:58:59.135463 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-cb8459b2-1acf-4659-b3f0-88818e37a23f tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:58:59.136572 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-cb8459b2-1acf-4659-b3f0-88818e37a23f tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] [instance: 61d89bc7-fcfe-479b-baa1-7307a4395cc3] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:58:59.143845 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cb8459b2-1acf-4659-b3f0-88818e37a23f tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:59.144686 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cb8459b2-1acf-4659-b3f0-88818e37a23f tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:59.145460 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cb8459b2-1acf-4659-b3f0-88818e37a23f tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:59.150810 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cb8459b2-1acf-4659-b3f0-88818e37a23f tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:59.151650 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cb8459b2-1acf-4659-b3f0-88818e37a23f tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:59.157780 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cb8459b2-1acf-4659-b3f0-88818e37a23f tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:59.377395 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-cb8459b2-1acf-4659-b3f0-88818e37a23f tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d49952dbca4d95a25411b65d56552b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed31e93b0e8a43f28e497f94318815ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:58:59.386339 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-cb8459b2-1acf-4659-b3f0-88818e37a23f tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] 10.222.0.18 "GET /compute/v2.1/servers/61d89bc7-fcfe-479b-baa1-7307a4395cc3" status: 200 len: 1268 microversion: 2.1 time: 0.269760 Oct 22 20:58:59.405820 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1070/2270] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:58:59 2022] GET /compute/v2.1/servers/61d89bc7-fcfe-479b-baa1-7307a4395cc3 => generated 1268 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:58:59.495282 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-f2e15aa8-d1af-45a0-ba1b-cb8ea3bda69e tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dbe89a7e11480194d3d86f82983499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8351b01e07cd43f9be973ab45e522bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:58:59.519667 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-f2e15aa8-d1af-45a0-ba1b-cb8ea3bda69e tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] 10.222.0.18 "GET /compute/v2.1/servers/f070b144-3a1a-4456-8e5b-02af12557c6a" status: 200 len: 1478 microversion: 2.1 time: 0.792659 Oct 22 20:58:59.522701 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1201/2271] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:58:58 2022] GET /compute/v2.1/servers/f070b144-3a1a-4456-8e5b-02af12557c6a => generated 1478 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:58:59.859359 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-8aa2cf1c-c698-4fe8-972a-9577398738a0 req-47f6505d-77b7-4353-a76b-916fbde21969 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f070b144-3a1a-4456-8e5b-02af12557c6a", "name": "network-vif-plugged", "status": "completed", "tag": "9c49ccea-f5ad-47be-9a9c-61df2a8933d5"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:58:59.895230 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-8aa2cf1c-c698-4fe8-972a-9577398738a0 req-47f6505d-77b7-4353-a76b-916fbde21969 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:58:59.907133 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-8aa2cf1c-c698-4fe8-972a-9577398738a0 req-47f6505d-77b7-4353-a76b-916fbde21969 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:58:59.907730 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-8aa2cf1c-c698-4fe8-972a-9577398738a0 req-47f6505d-77b7-4353-a76b-916fbde21969 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:58:59.947222 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-8aa2cf1c-c698-4fe8-972a-9577398738a0 req-47f6505d-77b7-4353-a76b-916fbde21969 service nova] Creating event network-vif-plugged:9c49ccea-f5ad-47be-9a9c-61df2a8933d5 for instance f070b144-3a1a-4456-8e5b-02af12557c6a on nch2-master-1 Oct 22 20:58:59.959132 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-8aa2cf1c-c698-4fe8-972a-9577398738a0 req-47f6505d-77b7-4353-a76b-916fbde21969 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.271941 Oct 22 20:58:59.960565 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1071/2272] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:58:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:59:00.140901 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-421c32ed-31c8-4d50-a9f0-5b29743ccfa0 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:59:00.143366 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-421c32ed-31c8-4d50-a9f0-5b29743ccfa0 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] [instance: c3e6246d-c32a-490d-ba83-84b54822f971] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:59:00.183463 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-421c32ed-31c8-4d50-a9f0-5b29743ccfa0 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:00.185532 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-421c32ed-31c8-4d50-a9f0-5b29743ccfa0 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:00.188088 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-421c32ed-31c8-4d50-a9f0-5b29743ccfa0 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:00.192206 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-421c32ed-31c8-4d50-a9f0-5b29743ccfa0 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:00.195283 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-421c32ed-31c8-4d50-a9f0-5b29743ccfa0 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:00.197263 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-421c32ed-31c8-4d50-a9f0-5b29743ccfa0 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:00.414980 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-53af383c-9b4e-41fc-901f-4d8efd2496c1 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:59:00.415664 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-53af383c-9b4e-41fc-901f-4d8efd2496c1 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] [instance: 61d89bc7-fcfe-479b-baa1-7307a4395cc3] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:59:00.439400 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-53af383c-9b4e-41fc-901f-4d8efd2496c1 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:00.439939 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-53af383c-9b4e-41fc-901f-4d8efd2496c1 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:00.442627 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-53af383c-9b4e-41fc-901f-4d8efd2496c1 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:00.443488 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-53af383c-9b4e-41fc-901f-4d8efd2496c1 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:00.443988 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-53af383c-9b4e-41fc-901f-4d8efd2496c1 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:00.445635 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-53af383c-9b4e-41fc-901f-4d8efd2496c1 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:00.634942 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-421c32ed-31c8-4d50-a9f0-5b29743ccfa0 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d3d7458af447bdb3f03e83a2d8559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49238b8686d24ae698679e4a1957735d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:59:00.645914 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-421c32ed-31c8-4d50-a9f0-5b29743ccfa0 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] 10.222.0.18 "GET /compute/v2.1/servers/c3e6246d-c32a-490d-ba83-84b54822f971" status: 200 len: 1476 microversion: 2.1 time: 0.510934 Oct 22 20:59:00.653359 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-53af383c-9b4e-41fc-901f-4d8efd2496c1 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d49952dbca4d95a25411b65d56552b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed31e93b0e8a43f28e497f94318815ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:59:00.662573 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-53af383c-9b4e-41fc-901f-4d8efd2496c1 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] 10.222.0.18 "GET /compute/v2.1/servers/61d89bc7-fcfe-479b-baa1-7307a4395cc3" status: 200 len: 1274 microversion: 2.1 time: 0.253391 Oct 22 20:59:00.662908 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1202/2273] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:59:00 2022] GET /compute/v2.1/servers/c3e6246d-c32a-490d-ba83-84b54822f971 => generated 1476 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:59:00.665306 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1072/2274] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:59:00 2022] GET /compute/v2.1/servers/61d89bc7-fcfe-479b-baa1-7307a4395cc3 => generated 1274 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:59:00.673824 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-fd502f80-c42b-4f9b-a4b5-277bb5d8100a tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:59:00.676101 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-fd502f80-c42b-4f9b-a4b5-277bb5d8100a tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] [instance: f070b144-3a1a-4456-8e5b-02af12557c6a] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:59:00.689100 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fd502f80-c42b-4f9b-a4b5-277bb5d8100a tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:00.689621 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fd502f80-c42b-4f9b-a4b5-277bb5d8100a tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:00.690078 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fd502f80-c42b-4f9b-a4b5-277bb5d8100a tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:00.691645 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fd502f80-c42b-4f9b-a4b5-277bb5d8100a tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:00.691967 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fd502f80-c42b-4f9b-a4b5-277bb5d8100a tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:00.692413 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fd502f80-c42b-4f9b-a4b5-277bb5d8100a tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:00.810239 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-1ca8e97c-0e88-4b08-a616-5b3bb619127d tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSONUnderV235-server-601895561", "imageRef": "085e4478-6edc-4a69-8e08-f9831713eb65", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:59:00.904366 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.network.neutron [None req-1ca8e97c-0e88-4b08-a616-5b3bb619127d tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] validate_networks() for [('c5f0648c-b848-40c1-8a23-bd63535b04e6', None, None, None, None, None)] {{(pid=138744) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 20:59:01.137219 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-fd502f80-c42b-4f9b-a4b5-277bb5d8100a tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dbe89a7e11480194d3d86f82983499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8351b01e07cd43f9be973ab45e522bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:59:01.146737 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-fd502f80-c42b-4f9b-a4b5-277bb5d8100a tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] 10.222.0.18 "GET /compute/v2.1/servers/f070b144-3a1a-4456-8e5b-02af12557c6a" status: 200 len: 1478 microversion: 2.1 time: 0.482456 Oct 22 20:59:01.148235 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1203/2275] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:59:00 2022] GET /compute/v2.1/servers/f070b144-3a1a-4456-8e5b-02af12557c6a => generated 1478 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:59:01.837628 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-1ca8e97c-0e88-4b08-a616-5b3bb619127d tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Flavor limits 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 20:59:01.839022 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-1ca8e97c-0e88-4b08-a616-5b3bb619127d tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Image limits 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 20:59:01.839815 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-1ca8e97c-0e88-4b08-a616-5b3bb619127d tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Flavor pref 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 20:59:01.840468 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-1ca8e97c-0e88-4b08-a616-5b3bb619127d tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Image pref 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 20:59:01.841266 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-1ca8e97c-0e88-4b08-a616-5b3bb619127d tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 20:59:01.857407 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1ca8e97c-0e88-4b08-a616-5b3bb619127d tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:01.858440 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1ca8e97c-0e88-4b08-a616-5b3bb619127d tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:01.859846 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1ca8e97c-0e88-4b08-a616-5b3bb619127d tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:01.861039 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1ca8e97c-0e88-4b08-a616-5b3bb619127d tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:01.861737 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1ca8e97c-0e88-4b08-a616-5b3bb619127d tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:01.863284 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1ca8e97c-0e88-4b08-a616-5b3bb619127d tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:01.909471 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-1ca8e97c-0e88-4b08-a616-5b3bb619127d tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Getting quotas for project 2d79e903f8f24a348d5e771d434c70c3. Resources: {'cores', 'instances', 'ram'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 20:59:01.930432 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-1ca8e97c-0e88-4b08-a616-5b3bb619127d tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Getting quotas for user c8e36cd987f04f11b6a41325add4ccac and project 2d79e903f8f24a348d5e771d434c70c3. Resources: {'cores', 'instances', 'ram'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 20:59:01.945366 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-89009247-0f54-4360-896c-a9f56bb8f61f tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:59:01.946396 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-89009247-0f54-4360-896c-a9f56bb8f61f tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] [instance: c3e6246d-c32a-490d-ba83-84b54822f971] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:59:01.957625 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-89009247-0f54-4360-896c-a9f56bb8f61f tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:01.960648 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-89009247-0f54-4360-896c-a9f56bb8f61f tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:01.962539 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-89009247-0f54-4360-896c-a9f56bb8f61f tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:01.963489 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-89009247-0f54-4360-896c-a9f56bb8f61f tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:01.972701 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-89009247-0f54-4360-896c-a9f56bb8f61f tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:01.973372 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-89009247-0f54-4360-896c-a9f56bb8f61f tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:01.978469 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-1ca8e97c-0e88-4b08-a616-5b3bb619127d tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Going to run 1 instances... {{(pid=138744) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 20:59:01.985477 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-1ca8e97c-0e88-4b08-a616-5b3bb619127d tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] [instance: ae58d60e-a113-4a38-94b5-b72a19c353e6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='085e4478-6edc-4a69-8e08-f9831713eb65',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138744) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 20:59:02.109719 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-1ca8e97c-0e88-4b08-a616-5b3bb619127d tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.392200 Oct 22 20:59:02.111103 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1073/2276] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Oct 22 20:59:00 2022] POST /compute/v2.1/servers => generated 383 bytes in 1394 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 20:59:02.116892 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-a6123546-81fc-48cd-a689-e92b41ae0938 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:59:02.117872 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-a6123546-81fc-48cd-a689-e92b41ae0938 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] [instance: 61d89bc7-fcfe-479b-baa1-7307a4395cc3] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:59:02.125684 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a6123546-81fc-48cd-a689-e92b41ae0938 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:02.126658 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a6123546-81fc-48cd-a689-e92b41ae0938 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:02.127324 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a6123546-81fc-48cd-a689-e92b41ae0938 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:02.128417 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a6123546-81fc-48cd-a689-e92b41ae0938 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:02.128949 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a6123546-81fc-48cd-a689-e92b41ae0938 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:02.129504 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a6123546-81fc-48cd-a689-e92b41ae0938 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:02.300328 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-a6123546-81fc-48cd-a689-e92b41ae0938 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d49952dbca4d95a25411b65d56552b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed31e93b0e8a43f28e497f94318815ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:59:02.302274 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-89009247-0f54-4360-896c-a9f56bb8f61f tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d3d7458af447bdb3f03e83a2d8559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49238b8686d24ae698679e4a1957735d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:59:02.317353 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-a6123546-81fc-48cd-a689-e92b41ae0938 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] 10.222.0.18 "GET /compute/v2.1/servers/61d89bc7-fcfe-479b-baa1-7307a4395cc3" status: 200 len: 1274 microversion: 2.1 time: 0.204876 Oct 22 20:59:02.318158 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1074/2277] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:59:02 2022] GET /compute/v2.1/servers/61d89bc7-fcfe-479b-baa1-7307a4395cc3 => generated 1274 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:59:02.321008 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-89009247-0f54-4360-896c-a9f56bb8f61f tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] 10.222.0.18 "GET /compute/v2.1/servers/c3e6246d-c32a-490d-ba83-84b54822f971" status: 200 len: 1476 microversion: 2.1 time: 0.642360 Oct 22 20:59:02.348271 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1204/2278] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:59:01 2022] GET /compute/v2.1/servers/c3e6246d-c32a-490d-ba83-84b54822f971 => generated 1476 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:59:02.367064 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-91663fec-9327-4e75-985d-f68bb19a9dcc tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:59:02.370491 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-91663fec-9327-4e75-985d-f68bb19a9dcc tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] [instance: ae58d60e-a113-4a38-94b5-b72a19c353e6] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:59:02.439094 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-2a7d125b-370d-4b7f-8bbd-66e01cb41061 tempest-FloatingIPDetailsTestJSON-1867523695 tempest-FloatingIPDetailsTestJSON-1867523695-project] Action: 'create', calling method: .version_select at 0x7fd3a89edc10>, body: {"pool": null} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:59:02.484480 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-91663fec-9327-4e75-985d-f68bb19a9dcc tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e36cd987f04f11b6a41325add4ccac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d79e903f8f24a348d5e771d434c70c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:59:02.499260 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-91663fec-9327-4e75-985d-f68bb19a9dcc tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] 10.222.0.18 "GET /compute/v2.1/servers/ae58d60e-a113-4a38-94b5-b72a19c353e6" status: 200 len: 1222 microversion: 2.1 time: 0.143926 Oct 22 20:59:02.499970 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1205/2279] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:59:02 2022] GET /compute/v2.1/servers/ae58d60e-a113-4a38-94b5-b72a19c353e6 => generated 1222 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:59:02.517346 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-b7d4e449-943e-46ac-8ab1-0ab06fbe1ad0 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:59:02.517971 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-b7d4e449-943e-46ac-8ab1-0ab06fbe1ad0 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] [instance: f070b144-3a1a-4456-8e5b-02af12557c6a] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:59:02.526977 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b7d4e449-943e-46ac-8ab1-0ab06fbe1ad0 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:02.527525 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b7d4e449-943e-46ac-8ab1-0ab06fbe1ad0 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:02.528113 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b7d4e449-943e-46ac-8ab1-0ab06fbe1ad0 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:02.528677 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b7d4e449-943e-46ac-8ab1-0ab06fbe1ad0 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:02.533732 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b7d4e449-943e-46ac-8ab1-0ab06fbe1ad0 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:02.534156 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b7d4e449-943e-46ac-8ab1-0ab06fbe1ad0 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:03.429509 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-b7d4e449-943e-46ac-8ab1-0ab06fbe1ad0 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dbe89a7e11480194d3d86f82983499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8351b01e07cd43f9be973ab45e522bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:59:03.440780 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-b7d4e449-943e-46ac-8ab1-0ab06fbe1ad0 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] 10.222.0.18 "GET /compute/v2.1/servers/f070b144-3a1a-4456-8e5b-02af12557c6a" status: 200 len: 1463 microversion: 2.1 time: 0.934817 Oct 22 20:59:03.441395 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1206/2280] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:59:02 2022] GET /compute/v2.1/servers/f070b144-3a1a-4456-8e5b-02af12557c6a => generated 1463 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:59:03.471549 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-b6ee2752-02f6-4be0-bf92-bc850e9f1821 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:59:03.472408 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-b6ee2752-02f6-4be0-bf92-bc850e9f1821 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] [instance: 61d89bc7-fcfe-479b-baa1-7307a4395cc3] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:59:03.481841 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b6ee2752-02f6-4be0-bf92-bc850e9f1821 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:03.482691 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b6ee2752-02f6-4be0-bf92-bc850e9f1821 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:03.483489 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b6ee2752-02f6-4be0-bf92-bc850e9f1821 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:03.486534 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b6ee2752-02f6-4be0-bf92-bc850e9f1821 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:03.487255 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b6ee2752-02f6-4be0-bf92-bc850e9f1821 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:03.487904 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b6ee2752-02f6-4be0-bf92-bc850e9f1821 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:03.885482 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-b6ee2752-02f6-4be0-bf92-bc850e9f1821 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d49952dbca4d95a25411b65d56552b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed31e93b0e8a43f28e497f94318815ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:59:03.896366 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-b6ee2752-02f6-4be0-bf92-bc850e9f1821 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] 10.222.0.18 "GET /compute/v2.1/servers/61d89bc7-fcfe-479b-baa1-7307a4395cc3" status: 200 len: 1316 microversion: 2.1 time: 0.453771 Oct 22 20:59:03.897556 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1207/2281] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:59:03 2022] GET /compute/v2.1/servers/61d89bc7-fcfe-479b-baa1-7307a4395cc3 => generated 1316 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:59:03.904435 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-3ff424ec-4e20-4b74-9aaa-4183ccca2fde tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:59:03.905780 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-3ff424ec-4e20-4b74-9aaa-4183ccca2fde tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] [instance: c3e6246d-c32a-490d-ba83-84b54822f971] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:59:03.914083 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3ff424ec-4e20-4b74-9aaa-4183ccca2fde tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:03.914774 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3ff424ec-4e20-4b74-9aaa-4183ccca2fde tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:03.915439 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3ff424ec-4e20-4b74-9aaa-4183ccca2fde tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:03.917849 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3ff424ec-4e20-4b74-9aaa-4183ccca2fde tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:03.918566 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3ff424ec-4e20-4b74-9aaa-4183ccca2fde tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:03.919206 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3ff424ec-4e20-4b74-9aaa-4183ccca2fde tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:04.080778 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-3ff424ec-4e20-4b74-9aaa-4183ccca2fde tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d3d7458af447bdb3f03e83a2d8559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49238b8686d24ae698679e4a1957735d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:59:04.090849 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-3ff424ec-4e20-4b74-9aaa-4183ccca2fde tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] 10.222.0.18 "GET /compute/v2.1/servers/c3e6246d-c32a-490d-ba83-84b54822f971" status: 200 len: 1476 microversion: 2.1 time: 0.191948 Oct 22 20:59:04.091704 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1208/2282] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:59:03 2022] GET /compute/v2.1/servers/c3e6246d-c32a-490d-ba83-84b54822f971 => generated 1476 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:59:04.100478 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-96e2e663-90f4-4efc-a772-188131375c87 tempest-ServersAdminTestJSON-1747089598 tempest-ServersAdminTestJSON-1747089598-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:59:04.103610 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-96e2e663-90f4-4efc-a772-188131375c87 tempest-ServersAdminTestJSON-1747089598 tempest-ServersAdminTestJSON-1747089598-project-admin] [instance: f070b144-3a1a-4456-8e5b-02af12557c6a] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:59:04.110902 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-96e2e663-90f4-4efc-a772-188131375c87 tempest-ServersAdminTestJSON-1747089598 tempest-ServersAdminTestJSON-1747089598-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:04.111602 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-96e2e663-90f4-4efc-a772-188131375c87 tempest-ServersAdminTestJSON-1747089598 tempest-ServersAdminTestJSON-1747089598-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:04.112192 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-96e2e663-90f4-4efc-a772-188131375c87 tempest-ServersAdminTestJSON-1747089598 tempest-ServersAdminTestJSON-1747089598-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:04.113088 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-96e2e663-90f4-4efc-a772-188131375c87 tempest-ServersAdminTestJSON-1747089598 tempest-ServersAdminTestJSON-1747089598-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:04.113684 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-96e2e663-90f4-4efc-a772-188131375c87 tempest-ServersAdminTestJSON-1747089598 tempest-ServersAdminTestJSON-1747089598-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:04.114262 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-96e2e663-90f4-4efc-a772-188131375c87 tempest-ServersAdminTestJSON-1747089598 tempest-ServersAdminTestJSON-1747089598-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:04.206531 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-96e2e663-90f4-4efc-a772-188131375c87 tempest-ServersAdminTestJSON-1747089598 tempest-ServersAdminTestJSON-1747089598-project-admin] 10.222.0.18 "POST /compute/v2.1/servers/f070b144-3a1a-4456-8e5b-02af12557c6a/action" status: 202 len: 0 microversion: 2.1 time: 0.113465 Oct 22 20:59:04.214339 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1209/2283] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 20:59:04 2022] POST /compute/v2.1/servers/f070b144-3a1a-4456-8e5b-02af12557c6a/action => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 20:59:04.220183 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-b9dc599d-3ee0-4b7f-bf19-0682d25cdabf tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:59:04.221051 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-b9dc599d-3ee0-4b7f-bf19-0682d25cdabf tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] [instance: ae58d60e-a113-4a38-94b5-b72a19c353e6] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:59:04.232677 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b9dc599d-3ee0-4b7f-bf19-0682d25cdabf tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:04.233630 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b9dc599d-3ee0-4b7f-bf19-0682d25cdabf tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:04.234438 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b9dc599d-3ee0-4b7f-bf19-0682d25cdabf tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:04.235178 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b9dc599d-3ee0-4b7f-bf19-0682d25cdabf tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:04.235671 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b9dc599d-3ee0-4b7f-bf19-0682d25cdabf tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:04.236105 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b9dc599d-3ee0-4b7f-bf19-0682d25cdabf tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:04.384697 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-b9dc599d-3ee0-4b7f-bf19-0682d25cdabf tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e36cd987f04f11b6a41325add4ccac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d79e903f8f24a348d5e771d434c70c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:59:04.396780 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-b9dc599d-3ee0-4b7f-bf19-0682d25cdabf tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] 10.222.0.18 "GET /compute/v2.1/servers/ae58d60e-a113-4a38-94b5-b72a19c353e6" status: 200 len: 1274 microversion: 2.1 time: 0.179657 Oct 22 20:59:04.399457 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1210/2284] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:59:04 2022] GET /compute/v2.1/servers/ae58d60e-a113-4a38-94b5-b72a19c353e6 => generated 1274 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:59:04.407969 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-5a8658b1-4bbf-4589-806b-6f68de7b7c6a tempest-ServersAdminTestJSON-1747089598 tempest-ServersAdminTestJSON-1747089598-project-admin] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:59:04.408586 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-5a8658b1-4bbf-4589-806b-6f68de7b7c6a tempest-ServersAdminTestJSON-1747089598 tempest-ServersAdminTestJSON-1747089598-project-admin] [instance: f070b144-3a1a-4456-8e5b-02af12557c6a] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:59:04.428956 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5a8658b1-4bbf-4589-806b-6f68de7b7c6a tempest-ServersAdminTestJSON-1747089598 tempest-ServersAdminTestJSON-1747089598-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:04.429466 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5a8658b1-4bbf-4589-806b-6f68de7b7c6a tempest-ServersAdminTestJSON-1747089598 tempest-ServersAdminTestJSON-1747089598-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:04.430103 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5a8658b1-4bbf-4589-806b-6f68de7b7c6a tempest-ServersAdminTestJSON-1747089598 tempest-ServersAdminTestJSON-1747089598-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:04.431591 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5a8658b1-4bbf-4589-806b-6f68de7b7c6a tempest-ServersAdminTestJSON-1747089598 tempest-ServersAdminTestJSON-1747089598-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:04.434150 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5a8658b1-4bbf-4589-806b-6f68de7b7c6a tempest-ServersAdminTestJSON-1747089598 tempest-ServersAdminTestJSON-1747089598-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:04.434891 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5a8658b1-4bbf-4589-806b-6f68de7b7c6a tempest-ServersAdminTestJSON-1747089598 tempest-ServersAdminTestJSON-1747089598-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:04.527012 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5a8658b1-4bbf-4589-806b-6f68de7b7c6a tempest-ServersAdminTestJSON-1747089598 tempest-ServersAdminTestJSON-1747089598-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:04.527831 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5a8658b1-4bbf-4589-806b-6f68de7b7c6a tempest-ServersAdminTestJSON-1747089598 tempest-ServersAdminTestJSON-1747089598-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:04.528995 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5a8658b1-4bbf-4589-806b-6f68de7b7c6a tempest-ServersAdminTestJSON-1747089598 tempest-ServersAdminTestJSON-1747089598-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:04.530166 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.objects.instance [None req-5a8658b1-4bbf-4589-806b-6f68de7b7c6a tempest-ServersAdminTestJSON-1747089598 tempest-ServersAdminTestJSON-1747089598-project-admin] Lazy-loading 'fault' on Instance uuid f070b144-3a1a-4456-8e5b-02af12557c6a {{(pid=138745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 20:59:05.264601 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-5a8658b1-4bbf-4589-806b-6f68de7b7c6a tempest-ServersAdminTestJSON-1747089598 tempest-ServersAdminTestJSON-1747089598-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/f070b144-3a1a-4456-8e5b-02af12557c6a" status: 200 len: 1597 microversion: 2.1 time: 0.852603 Oct 22 20:59:05.268956 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1211/2285] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:59:04 2022] GET /compute/v2.1/servers/f070b144-3a1a-4456-8e5b-02af12557c6a => generated 1597 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:59:05.286607 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-c71095e5-47b2-4486-9765-9874ced3cffa tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:59:05.289401 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-c71095e5-47b2-4486-9765-9874ced3cffa tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] [instance: 61d89bc7-fcfe-479b-baa1-7307a4395cc3] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:59:05.307546 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c71095e5-47b2-4486-9765-9874ced3cffa tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:05.312200 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c71095e5-47b2-4486-9765-9874ced3cffa tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:05.312973 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c71095e5-47b2-4486-9765-9874ced3cffa tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:05.314846 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c71095e5-47b2-4486-9765-9874ced3cffa tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:05.315587 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c71095e5-47b2-4486-9765-9874ced3cffa tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:05.316485 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c71095e5-47b2-4486-9765-9874ced3cffa tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:05.928250 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-c71095e5-47b2-4486-9765-9874ced3cffa tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d49952dbca4d95a25411b65d56552b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed31e93b0e8a43f28e497f94318815ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:59:05.946282 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-c71095e5-47b2-4486-9765-9874ced3cffa tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] 10.222.0.18 "GET /compute/v2.1/servers/61d89bc7-fcfe-479b-baa1-7307a4395cc3" status: 200 len: 1316 microversion: 2.1 time: 0.673615 Oct 22 20:59:05.957618 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1212/2286] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:59:05 2022] GET /compute/v2.1/servers/61d89bc7-fcfe-479b-baa1-7307a4395cc3 => generated 1316 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:59:05.973931 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-99590eea-7b95-4ec0-8644-780581676dbd tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:59:05.976398 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-99590eea-7b95-4ec0-8644-780581676dbd tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] [instance: c3e6246d-c32a-490d-ba83-84b54822f971] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:59:05.986300 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-99590eea-7b95-4ec0-8644-780581676dbd tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:05.987154 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-99590eea-7b95-4ec0-8644-780581676dbd tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:05.987854 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-99590eea-7b95-4ec0-8644-780581676dbd tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:05.988877 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-99590eea-7b95-4ec0-8644-780581676dbd tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:05.990075 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-99590eea-7b95-4ec0-8644-780581676dbd tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:05.990679 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-99590eea-7b95-4ec0-8644-780581676dbd tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:06.769280 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-99590eea-7b95-4ec0-8644-780581676dbd tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d3d7458af447bdb3f03e83a2d8559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49238b8686d24ae698679e4a1957735d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:59:06.779317 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-99590eea-7b95-4ec0-8644-780581676dbd tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] 10.222.0.18 "GET /compute/v2.1/servers/c3e6246d-c32a-490d-ba83-84b54822f971" status: 200 len: 1476 microversion: 2.1 time: 0.819854 Oct 22 20:59:06.788217 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1213/2287] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:59:05 2022] GET /compute/v2.1/servers/c3e6246d-c32a-490d-ba83-84b54822f971 => generated 1476 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:59:06.809384 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-c198d5e9-b358-4e74-b062-bb49b0ec7561 tempest-ServersAdminTestJSON-1747089598 tempest-ServersAdminTestJSON-1747089598-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:59:06.824757 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-c198d5e9-b358-4e74-b062-bb49b0ec7561 tempest-ServersAdminTestJSON-1747089598 tempest-ServersAdminTestJSON-1747089598-project-admin] [instance: f070b144-3a1a-4456-8e5b-02af12557c6a] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:59:06.845112 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c198d5e9-b358-4e74-b062-bb49b0ec7561 tempest-ServersAdminTestJSON-1747089598 tempest-ServersAdminTestJSON-1747089598-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:06.845612 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c198d5e9-b358-4e74-b062-bb49b0ec7561 tempest-ServersAdminTestJSON-1747089598 tempest-ServersAdminTestJSON-1747089598-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:06.846063 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c198d5e9-b358-4e74-b062-bb49b0ec7561 tempest-ServersAdminTestJSON-1747089598 tempest-ServersAdminTestJSON-1747089598-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:06.846783 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c198d5e9-b358-4e74-b062-bb49b0ec7561 tempest-ServersAdminTestJSON-1747089598 tempest-ServersAdminTestJSON-1747089598-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:06.847240 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c198d5e9-b358-4e74-b062-bb49b0ec7561 tempest-ServersAdminTestJSON-1747089598 tempest-ServersAdminTestJSON-1747089598-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:06.847718 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c198d5e9-b358-4e74-b062-bb49b0ec7561 tempest-ServersAdminTestJSON-1747089598 tempest-ServersAdminTestJSON-1747089598-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:06.953765 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:59:07.012649 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-c198d5e9-b358-4e74-b062-bb49b0ec7561 tempest-ServersAdminTestJSON-1747089598 tempest-ServersAdminTestJSON-1747089598-project-admin] 10.222.0.18 "POST /compute/v2.1/servers/f070b144-3a1a-4456-8e5b-02af12557c6a/action" status: 202 len: 0 microversion: 2.1 time: 0.206939 Oct 22 20:59:07.013797 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1214/2288] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 20:59:06 2022] POST /compute/v2.1/servers/f070b144-3a1a-4456-8e5b-02af12557c6a/action => generated 0 bytes in 225 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 20:59:07.020128 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-982a8f43-d43c-48a2-b990-d5567b995131 tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:59:07.021157 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-982a8f43-d43c-48a2-b990-d5567b995131 tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] [instance: ae58d60e-a113-4a38-94b5-b72a19c353e6] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:59:07.039213 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-982a8f43-d43c-48a2-b990-d5567b995131 tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:07.040546 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-982a8f43-d43c-48a2-b990-d5567b995131 tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:07.041278 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-982a8f43-d43c-48a2-b990-d5567b995131 tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:07.042208 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-982a8f43-d43c-48a2-b990-d5567b995131 tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:07.043196 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-982a8f43-d43c-48a2-b990-d5567b995131 tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:07.043867 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-982a8f43-d43c-48a2-b990-d5567b995131 tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:07.216973 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-982a8f43-d43c-48a2-b990-d5567b995131 tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e36cd987f04f11b6a41325add4ccac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d79e903f8f24a348d5e771d434c70c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:59:07.230630 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-982a8f43-d43c-48a2-b990-d5567b995131 tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] 10.222.0.18 "GET /compute/v2.1/servers/ae58d60e-a113-4a38-94b5-b72a19c353e6" status: 200 len: 1280 microversion: 2.1 time: 0.215307 Oct 22 20:59:07.239682 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1215/2289] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:59:07 2022] GET /compute/v2.1/servers/ae58d60e-a113-4a38-94b5-b72a19c353e6 => generated 1280 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:59:07.255512 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-11b14c4e-279e-4ecc-821d-6d760756102a tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Action: 'create', calling method: .version_select at 0x7fd3a4118a60>, body: {"keypair": {"name": "tempest-keypair-887345857", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGJTfVPfE21vzUxSC3EUbMNvDFrPIbpLvnO9X0xqCZevxHZFBFPshSaDxYQ/tB3M1YWO9v29RYyrfgK9lDu0Po/EoM7nRPBxu0miazoZVRb2yj/RR+F8cx7+oat9yYidXw=="}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:59:07.316374 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-11b14c4e-279e-4ecc-821d-6d760756102a tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Getting quotas for project cd687d54e07d4ab4af00ad801ef4b58d. Resources: {'key_pairs'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 20:59:07.332763 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-11b14c4e-279e-4ecc-821d-6d760756102a tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Getting quotas for user 211483c6acea4f76b6c0e4bfc818e7aa and project cd687d54e07d4ab4af00ad801ef4b58d. Resources: {'key_pairs'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 20:59:07.378880 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-11b14c4e-279e-4ecc-821d-6d760756102a tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.42 time: 0.146263 Oct 22 20:59:07.386037 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1216/2290] 10.222.0.18 () {62 vars in 1200 bytes} [Sat Oct 22 20:59:07 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 154 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 22 20:59:07.485164 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-692a407b-df87-4573-b263-fee4a0cbd23c req-554c1280-fed5-436c-a1b8-a51a80939a1d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "61d89bc7-fcfe-479b-baa1-7307a4395cc3", "tag": "8b90877b-3e97-4354-ad15-7327a7aa752b"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:59:07.502431 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-692a407b-df87-4573-b263-fee4a0cbd23c req-554c1280-fed5-436c-a1b8-a51a80939a1d service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:07.506571 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-692a407b-df87-4573-b263-fee4a0cbd23c req-554c1280-fed5-436c-a1b8-a51a80939a1d service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:07.507189 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-692a407b-df87-4573-b263-fee4a0cbd23c req-554c1280-fed5-436c-a1b8-a51a80939a1d service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:07.533050 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-692a407b-df87-4573-b263-fee4a0cbd23c req-554c1280-fed5-436c-a1b8-a51a80939a1d service nova] Creating event network-changed:8b90877b-3e97-4354-ad15-7327a7aa752b for instance 61d89bc7-fcfe-479b-baa1-7307a4395cc3 on nch1-master-1 Oct 22 20:59:07.545508 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-692a407b-df87-4573-b263-fee4a0cbd23c req-554c1280-fed5-436c-a1b8-a51a80939a1d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.157951 Oct 22 20:59:07.547227 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1217/2291] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:59:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:59:07.556508 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-a0eb6f65-f74e-47ee-95ae-e064eb39dc42 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:59:07.557379 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-a0eb6f65-f74e-47ee-95ae-e064eb39dc42 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] [instance: 61d89bc7-fcfe-479b-baa1-7307a4395cc3] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:59:07.570049 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a0eb6f65-f74e-47ee-95ae-e064eb39dc42 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:07.570657 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a0eb6f65-f74e-47ee-95ae-e064eb39dc42 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:07.571113 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a0eb6f65-f74e-47ee-95ae-e064eb39dc42 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:07.572175 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a0eb6f65-f74e-47ee-95ae-e064eb39dc42 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:07.572799 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a0eb6f65-f74e-47ee-95ae-e064eb39dc42 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:07.573390 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a0eb6f65-f74e-47ee-95ae-e064eb39dc42 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:08.404869 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-a0eb6f65-f74e-47ee-95ae-e064eb39dc42 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d49952dbca4d95a25411b65d56552b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed31e93b0e8a43f28e497f94318815ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:59:08.417441 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-a0eb6f65-f74e-47ee-95ae-e064eb39dc42 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] 10.222.0.18 "GET /compute/v2.1/servers/61d89bc7-fcfe-479b-baa1-7307a4395cc3" status: 200 len: 1316 microversion: 2.1 time: 0.868061 Oct 22 20:59:08.442075 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1218/2292] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:59:07 2022] GET /compute/v2.1/servers/61d89bc7-fcfe-479b-baa1-7307a4395cc3 => generated 1316 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:59:08.462992 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-8775016a-7a7a-4e8f-94bf-15a5e57b0c47 tempest-ServersAdminTestJSON-1747089598 tempest-ServersAdminTestJSON-1747089598-project-admin] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:59:08.469201 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-8775016a-7a7a-4e8f-94bf-15a5e57b0c47 tempest-ServersAdminTestJSON-1747089598 tempest-ServersAdminTestJSON-1747089598-project-admin] [instance: f070b144-3a1a-4456-8e5b-02af12557c6a] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:59:08.480542 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8775016a-7a7a-4e8f-94bf-15a5e57b0c47 tempest-ServersAdminTestJSON-1747089598 tempest-ServersAdminTestJSON-1747089598-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:08.483186 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8775016a-7a7a-4e8f-94bf-15a5e57b0c47 tempest-ServersAdminTestJSON-1747089598 tempest-ServersAdminTestJSON-1747089598-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:08.487670 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8775016a-7a7a-4e8f-94bf-15a5e57b0c47 tempest-ServersAdminTestJSON-1747089598 tempest-ServersAdminTestJSON-1747089598-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:08.488843 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8775016a-7a7a-4e8f-94bf-15a5e57b0c47 tempest-ServersAdminTestJSON-1747089598 tempest-ServersAdminTestJSON-1747089598-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:08.489754 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8775016a-7a7a-4e8f-94bf-15a5e57b0c47 tempest-ServersAdminTestJSON-1747089598 tempest-ServersAdminTestJSON-1747089598-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:08.490531 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8775016a-7a7a-4e8f-94bf-15a5e57b0c47 tempest-ServersAdminTestJSON-1747089598 tempest-ServersAdminTestJSON-1747089598-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:08.859394 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-2a7d125b-370d-4b7f-8bbd-66e01cb41061 tempest-FloatingIPDetailsTestJSON-1867523695 tempest-FloatingIPDetailsTestJSON-1867523695-project] 10.222.0.18 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 6.539962 Oct 22 20:59:08.861317 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1075/2293] 10.222.0.18 () {60 vars in 1170 bytes} [Sat Oct 22 20:59:02 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 6542 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:59:08.869420 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-fe964f5b-49d5-4134-b45c-ec7880b770c7 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:59:08.872235 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-fe964f5b-49d5-4134-b45c-ec7880b770c7 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] [instance: c3e6246d-c32a-490d-ba83-84b54822f971] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:59:08.877205 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=6 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:59:08.892474 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fe964f5b-49d5-4134-b45c-ec7880b770c7 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:08.893218 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fe964f5b-49d5-4134-b45c-ec7880b770c7 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:08.893828 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fe964f5b-49d5-4134-b45c-ec7880b770c7 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:08.894906 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fe964f5b-49d5-4134-b45c-ec7880b770c7 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:08.895545 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fe964f5b-49d5-4134-b45c-ec7880b770c7 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:08.896133 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fe964f5b-49d5-4134-b45c-ec7880b770c7 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:09.088319 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-8775016a-7a7a-4e8f-94bf-15a5e57b0c47 tempest-ServersAdminTestJSON-1747089598 tempest-ServersAdminTestJSON-1747089598-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/f070b144-3a1a-4456-8e5b-02af12557c6a" status: 200 len: 1614 microversion: 2.1 time: 0.643491 Oct 22 20:59:09.088920 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1219/2294] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:59:08 2022] GET /compute/v2.1/servers/f070b144-3a1a-4456-8e5b-02af12557c6a => generated 1614 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:59:09.098285 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-ba692534-ff12-4a57-b24c-e94612796774 tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:59:09.101994 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-ba692534-ff12-4a57-b24c-e94612796774 tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] [instance: ae58d60e-a113-4a38-94b5-b72a19c353e6] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:59:09.130921 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ba692534-ff12-4a57-b24c-e94612796774 tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:09.131472 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ba692534-ff12-4a57-b24c-e94612796774 tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:09.131919 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ba692534-ff12-4a57-b24c-e94612796774 tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:09.132656 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ba692534-ff12-4a57-b24c-e94612796774 tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:09.133266 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ba692534-ff12-4a57-b24c-e94612796774 tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:09.133703 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ba692534-ff12-4a57-b24c-e94612796774 tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:09.582689 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-fe964f5b-49d5-4134-b45c-ec7880b770c7 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d3d7458af447bdb3f03e83a2d8559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49238b8686d24ae698679e4a1957735d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:59:09.595545 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-fe964f5b-49d5-4134-b45c-ec7880b770c7 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] 10.222.0.18 "GET /compute/v2.1/servers/c3e6246d-c32a-490d-ba83-84b54822f971" status: 200 len: 1476 microversion: 2.1 time: 0.732386 Oct 22 20:59:09.613432 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1076/2295] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:59:08 2022] GET /compute/v2.1/servers/c3e6246d-c32a-490d-ba83-84b54822f971 => generated 1476 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:59:09.618743 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-c09e1353-7072-42bb-9120-5393fb7fad6c tempest-FloatingIPDetailsTestJSON-1867523695 tempest-FloatingIPDetailsTestJSON-1867523695-project] Action: 'create', calling method: .version_select at 0x7fd3a89ed4c0>, body: {"pool": null} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:59:09.841116 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-ba692534-ff12-4a57-b24c-e94612796774 tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e36cd987f04f11b6a41325add4ccac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d79e903f8f24a348d5e771d434c70c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:59:09.852133 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-ba692534-ff12-4a57-b24c-e94612796774 tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] 10.222.0.18 "GET /compute/v2.1/servers/ae58d60e-a113-4a38-94b5-b72a19c353e6" status: 200 len: 1322 microversion: 2.1 time: 0.761892 Oct 22 20:59:09.853539 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1220/2296] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:59:09 2022] GET /compute/v2.1/servers/ae58d60e-a113-4a38-94b5-b72a19c353e6 => generated 1322 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:59:09.870203 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-3465567e-fb31-4d3e-a620-63a6bdab0f55 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:59:09.871032 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-3465567e-fb31-4d3e-a620-63a6bdab0f55 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] [instance: fd812b37-71ed-400f-ba94-050254f85f9e] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:59:09.879993 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3465567e-fb31-4d3e-a620-63a6bdab0f55 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:09.885639 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3465567e-fb31-4d3e-a620-63a6bdab0f55 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:09.886854 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3465567e-fb31-4d3e-a620-63a6bdab0f55 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:09.887872 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3465567e-fb31-4d3e-a620-63a6bdab0f55 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:09.888534 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3465567e-fb31-4d3e-a620-63a6bdab0f55 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:09.889346 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3465567e-fb31-4d3e-a620-63a6bdab0f55 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:09.947495 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-3465567e-fb31-4d3e-a620-63a6bdab0f55 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] [instance: fd812b37-71ed-400f-ba94-050254f85f9e] Going to try to terminate instance {{(pid=138745) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 20:59:10.160310 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-3465567e-fb31-4d3e-a620-63a6bdab0f55 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] 10.222.0.18 "DELETE /compute/v2.1/servers/fd812b37-71ed-400f-ba94-050254f85f9e" status: 204 len: 0 microversion: 2.1 time: 0.304651 Oct 22 20:59:10.163267 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1221/2297] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 20:59:09 2022] DELETE /compute/v2.1/servers/fd812b37-71ed-400f-ba94-050254f85f9e => generated 0 bytes in 309 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 20:59:10.173056 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-1dfa4ffc-c373-4812-b8a5-d03841fd1668 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:59:10.174461 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-1dfa4ffc-c373-4812-b8a5-d03841fd1668 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] [instance: 61d89bc7-fcfe-479b-baa1-7307a4395cc3] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:59:10.188734 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1dfa4ffc-c373-4812-b8a5-d03841fd1668 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:10.189584 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1dfa4ffc-c373-4812-b8a5-d03841fd1668 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:10.190806 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1dfa4ffc-c373-4812-b8a5-d03841fd1668 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:10.192500 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1dfa4ffc-c373-4812-b8a5-d03841fd1668 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:10.193677 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1dfa4ffc-c373-4812-b8a5-d03841fd1668 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:10.195304 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1dfa4ffc-c373-4812-b8a5-d03841fd1668 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:10.518349 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-1dfa4ffc-c373-4812-b8a5-d03841fd1668 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d49952dbca4d95a25411b65d56552b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed31e93b0e8a43f28e497f94318815ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:59:10.535389 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-1dfa4ffc-c373-4812-b8a5-d03841fd1668 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] 10.222.0.18 "GET /compute/v2.1/servers/61d89bc7-fcfe-479b-baa1-7307a4395cc3" status: 200 len: 1316 microversion: 2.1 time: 0.370278 Oct 22 20:59:10.551407 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1222/2298] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:59:10 2022] GET /compute/v2.1/servers/61d89bc7-fcfe-479b-baa1-7307a4395cc3 => generated 1316 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:59:10.558213 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-28d8db0c-b436-4623-ba28-0e5be07f8f1b tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:59:10.559017 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-28d8db0c-b436-4623-ba28-0e5be07f8f1b tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] [instance: fd812b37-71ed-400f-ba94-050254f85f9e] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:59:10.566528 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-28d8db0c-b436-4623-ba28-0e5be07f8f1b tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:10.567100 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-28d8db0c-b436-4623-ba28-0e5be07f8f1b tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:10.567615 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-28d8db0c-b436-4623-ba28-0e5be07f8f1b tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:10.568721 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-28d8db0c-b436-4623-ba28-0e5be07f8f1b tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:10.569409 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-28d8db0c-b436-4623-ba28-0e5be07f8f1b tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:10.574755 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-28d8db0c-b436-4623-ba28-0e5be07f8f1b tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:10.908661 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-28d8db0c-b436-4623-ba28-0e5be07f8f1b tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dbe89a7e11480194d3d86f82983499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8351b01e07cd43f9be973ab45e522bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:59:10.923039 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-28d8db0c-b436-4623-ba28-0e5be07f8f1b tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] 10.222.0.18 "GET /compute/v2.1/servers/fd812b37-71ed-400f-ba94-050254f85f9e" status: 200 len: 1469 microversion: 2.1 time: 0.369962 Oct 22 20:59:10.924810 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1223/2299] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:59:10 2022] GET /compute/v2.1/servers/fd812b37-71ed-400f-ba94-050254f85f9e => generated 1469 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:59:10.932186 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-dd1cb8e0-c141-4488-a5e7-631036479688 req-96166368-b0de-4f8e-9cb7-0d3d68751d17 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae58d60e-a113-4a38-94b5-b72a19c353e6", "tag": "6bbd4b8b-948d-44a4-8b7f-6968bc1dc2cf"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:59:10.945277 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-dd1cb8e0-c141-4488-a5e7-631036479688 req-96166368-b0de-4f8e-9cb7-0d3d68751d17 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:10.945969 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-dd1cb8e0-c141-4488-a5e7-631036479688 req-96166368-b0de-4f8e-9cb7-0d3d68751d17 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:10.946589 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-dd1cb8e0-c141-4488-a5e7-631036479688 req-96166368-b0de-4f8e-9cb7-0d3d68751d17 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:10.972824 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-dd1cb8e0-c141-4488-a5e7-631036479688 req-96166368-b0de-4f8e-9cb7-0d3d68751d17 service nova] Creating event network-changed:6bbd4b8b-948d-44a4-8b7f-6968bc1dc2cf for instance ae58d60e-a113-4a38-94b5-b72a19c353e6 on nch2-master-1 Oct 22 20:59:10.987842 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-dd1cb8e0-c141-4488-a5e7-631036479688 req-96166368-b0de-4f8e-9cb7-0d3d68751d17 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060120 Oct 22 20:59:10.990595 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1224/2300] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:59:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:59:11.005956 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-72aab182-2d37-441b-b12d-09976069a753 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:59:11.006920 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-72aab182-2d37-441b-b12d-09976069a753 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] [instance: c3e6246d-c32a-490d-ba83-84b54822f971] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:59:11.026280 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-72aab182-2d37-441b-b12d-09976069a753 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:11.026950 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-72aab182-2d37-441b-b12d-09976069a753 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:11.027593 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-72aab182-2d37-441b-b12d-09976069a753 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:11.028572 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-72aab182-2d37-441b-b12d-09976069a753 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:11.029098 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-72aab182-2d37-441b-b12d-09976069a753 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:11.029571 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-72aab182-2d37-441b-b12d-09976069a753 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:11.824017 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-72aab182-2d37-441b-b12d-09976069a753 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d3d7458af447bdb3f03e83a2d8559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49238b8686d24ae698679e4a1957735d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:59:11.840920 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-72aab182-2d37-441b-b12d-09976069a753 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] 10.222.0.18 "GET /compute/v2.1/servers/c3e6246d-c32a-490d-ba83-84b54822f971" status: 200 len: 1476 microversion: 2.1 time: 0.848533 Oct 22 20:59:11.842895 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1225/2301] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:59:10 2022] GET /compute/v2.1/servers/c3e6246d-c32a-490d-ba83-84b54822f971 => generated 1476 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:59:11.861923 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-a747e3a3-0032-49cc-8163-fa5b03ed419a tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:59:11.862798 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-a747e3a3-0032-49cc-8163-fa5b03ed419a tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] [instance: ae58d60e-a113-4a38-94b5-b72a19c353e6] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:59:11.871993 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a747e3a3-0032-49cc-8163-fa5b03ed419a tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:11.872725 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a747e3a3-0032-49cc-8163-fa5b03ed419a tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:11.873358 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a747e3a3-0032-49cc-8163-fa5b03ed419a tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:11.874524 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a747e3a3-0032-49cc-8163-fa5b03ed419a tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:11.875379 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a747e3a3-0032-49cc-8163-fa5b03ed419a tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:11.875980 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a747e3a3-0032-49cc-8163-fa5b03ed419a tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:11.881261 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell0:SELECT=4 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:59:11.956744 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell0:SELECT=12 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:59:12.539026 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-a747e3a3-0032-49cc-8163-fa5b03ed419a tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e36cd987f04f11b6a41325add4ccac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d79e903f8f24a348d5e771d434c70c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:59:12.552611 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-a747e3a3-0032-49cc-8163-fa5b03ed419a tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] 10.222.0.18 "GET /compute/v2.1/servers/ae58d60e-a113-4a38-94b5-b72a19c353e6" status: 200 len: 1322 microversion: 2.1 time: 0.708147 Oct 22 20:59:12.553557 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1226/2302] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:59:11 2022] GET /compute/v2.1/servers/ae58d60e-a113-4a38-94b5-b72a19c353e6 => generated 1322 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:59:12.567619 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-9454cf99-4c58-46ff-8ff0-b37224a356f1 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:59:12.568243 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-9454cf99-4c58-46ff-8ff0-b37224a356f1 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] [instance: 61d89bc7-fcfe-479b-baa1-7307a4395cc3] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:59:12.586850 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:59:12.589762 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9454cf99-4c58-46ff-8ff0-b37224a356f1 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:12.590545 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9454cf99-4c58-46ff-8ff0-b37224a356f1 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:12.591081 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9454cf99-4c58-46ff-8ff0-b37224a356f1 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:12.592119 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9454cf99-4c58-46ff-8ff0-b37224a356f1 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:12.592848 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9454cf99-4c58-46ff-8ff0-b37224a356f1 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:12.593802 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9454cf99-4c58-46ff-8ff0-b37224a356f1 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:13.036432 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-9454cf99-4c58-46ff-8ff0-b37224a356f1 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d49952dbca4d95a25411b65d56552b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed31e93b0e8a43f28e497f94318815ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:59:13.046991 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-9454cf99-4c58-46ff-8ff0-b37224a356f1 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] 10.222.0.18 "GET /compute/v2.1/servers/61d89bc7-fcfe-479b-baa1-7307a4395cc3" status: 200 len: 1316 microversion: 2.1 time: 0.492058 Oct 22 20:59:13.048360 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1227/2303] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:59:12 2022] GET /compute/v2.1/servers/61d89bc7-fcfe-479b-baa1-7307a4395cc3 => generated 1316 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:59:13.053040 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-501bc7a8-65a7-4a67-ada0-05806fec9a22 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:59:13.053758 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-501bc7a8-65a7-4a67-ada0-05806fec9a22 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] [instance: fd812b37-71ed-400f-ba94-050254f85f9e] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:59:13.060185 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-501bc7a8-65a7-4a67-ada0-05806fec9a22 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:13.061021 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-501bc7a8-65a7-4a67-ada0-05806fec9a22 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:13.061713 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-501bc7a8-65a7-4a67-ada0-05806fec9a22 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:13.062651 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-501bc7a8-65a7-4a67-ada0-05806fec9a22 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:13.063324 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-501bc7a8-65a7-4a67-ada0-05806fec9a22 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:13.064117 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-501bc7a8-65a7-4a67-ada0-05806fec9a22 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:13.107332 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-c09e1353-7072-42bb-9120-5393fb7fad6c tempest-FloatingIPDetailsTestJSON-1867523695 tempest-FloatingIPDetailsTestJSON-1867523695-project] 10.222.0.18 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 3.492606 Oct 22 20:59:13.122389 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1077/2304] 10.222.0.18 () {60 vars in 1170 bytes} [Sat Oct 22 20:59:09 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 3508 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:59:13.133826 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-ee73844c-763d-48fa-bd35-6c4ca1131e21 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1138415718", "imageRef": "085e4478-6edc-4a69-8e08-f9831713eb65", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "cac2e7ad-dc19-4eeb-ac9d-59a840667c2f"}, {"port": "b6fc5821-644a-4f87-9788-a1775a1d521d", "tag": "port-1"}, {"port": "721b179f-1381-454b-b0cc-f9d4497ccc12", "tag": "port-2"}, {"uuid": "a1f70ab9-907d-42f8-96ce-8781e0f2fb5e", "tag": "net-1"}, {"uuid": "a1f70ab9-907d-42f8-96ce-8781e0f2fb5e"}, {"uuid": "23cf14b0-2528-4160-8ab0-fbb56b03cc7d", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "23cf14b0-2528-4160-8ab0-fbb56b03cc7d", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "d1d5f32b-f8b3-4714-96ae-203dc0482f4b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "1b9bd5cf-91ea-49ac-9156-2270dc908725", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "ebb1b567-e10c-480f-8fc1-0b24f1086d7e", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--182056303"}], "key_name": "tempest-keypair-887345857", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:59:13.250708 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-501bc7a8-65a7-4a67-ada0-05806fec9a22 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dbe89a7e11480194d3d86f82983499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8351b01e07cd43f9be973ab45e522bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:59:13.261241 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-501bc7a8-65a7-4a67-ada0-05806fec9a22 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] 10.222.0.18 "GET /compute/v2.1/servers/fd812b37-71ed-400f-ba94-050254f85f9e" status: 200 len: 1427 microversion: 2.1 time: 0.211730 Oct 22 20:59:13.262002 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1228/2305] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:59:13 2022] GET /compute/v2.1/servers/fd812b37-71ed-400f-ba94-050254f85f9e => generated 1427 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:59:13.268526 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-7a14fa80-cb1a-4986-ad08-1d2b3946f6dd tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:59:13.269501 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-7a14fa80-cb1a-4986-ad08-1d2b3946f6dd tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] [instance: c3e6246d-c32a-490d-ba83-84b54822f971] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:59:13.281666 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7a14fa80-cb1a-4986-ad08-1d2b3946f6dd tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:13.283367 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7a14fa80-cb1a-4986-ad08-1d2b3946f6dd tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:13.286436 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7a14fa80-cb1a-4986-ad08-1d2b3946f6dd tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:13.287390 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7a14fa80-cb1a-4986-ad08-1d2b3946f6dd tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:13.287936 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7a14fa80-cb1a-4986-ad08-1d2b3946f6dd tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:13.288601 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7a14fa80-cb1a-4986-ad08-1d2b3946f6dd tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:13.482665 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.network.neutron [None req-ee73844c-763d-48fa-bd35-6c4ca1131e21 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] validate_networks() for [('cac2e7ad-dc19-4eeb-ac9d-59a840667c2f', None, None, None, None, None), (None, None, 'b6fc5821-644a-4f87-9788-a1775a1d521d', None, None, None), (None, None, '721b179f-1381-454b-b0cc-f9d4497ccc12', None, None, None), ('a1f70ab9-907d-42f8-96ce-8781e0f2fb5e', None, None, None, None, None), ('a1f70ab9-907d-42f8-96ce-8781e0f2fb5e', None, None, None, None, None), ('23cf14b0-2528-4160-8ab0-fbb56b03cc7d', '10.2.2.100', None, None, None, None), ('23cf14b0-2528-4160-8ab0-fbb56b03cc7d', '10.2.2.200', None, None, None, None)] {{(pid=138744) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 20:59:13.632278 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-7a14fa80-cb1a-4986-ad08-1d2b3946f6dd tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d3d7458af447bdb3f03e83a2d8559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49238b8686d24ae698679e4a1957735d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:59:13.649272 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-7a14fa80-cb1a-4986-ad08-1d2b3946f6dd tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] 10.222.0.18 "GET /compute/v2.1/servers/c3e6246d-c32a-490d-ba83-84b54822f971" status: 200 len: 1476 microversion: 2.1 time: 0.385804 Oct 22 20:59:13.650557 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1229/2306] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:59:13 2022] GET /compute/v2.1/servers/c3e6246d-c32a-490d-ba83-84b54822f971 => generated 1476 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:59:13.659314 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-28568c1e-875f-4449-86c2-9ede35eaaf1c req-121964f4-83dc-4197-99b3-120bc799d75d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61d89bc7-fcfe-479b-baa1-7307a4395cc3", "name": "network-vif-plugged", "status": "completed", "tag": "8b90877b-3e97-4354-ad15-7327a7aa752b"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:59:13.673670 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-28568c1e-875f-4449-86c2-9ede35eaaf1c req-121964f4-83dc-4197-99b3-120bc799d75d service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:13.674181 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-28568c1e-875f-4449-86c2-9ede35eaaf1c req-121964f4-83dc-4197-99b3-120bc799d75d service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:13.675139 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-28568c1e-875f-4449-86c2-9ede35eaaf1c req-121964f4-83dc-4197-99b3-120bc799d75d service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:13.694212 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-28568c1e-875f-4449-86c2-9ede35eaaf1c req-121964f4-83dc-4197-99b3-120bc799d75d service nova] Creating event network-vif-plugged:8b90877b-3e97-4354-ad15-7327a7aa752b for instance 61d89bc7-fcfe-479b-baa1-7307a4395cc3 on nch1-master-1 Oct 22 20:59:13.704114 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-28568c1e-875f-4449-86c2-9ede35eaaf1c req-121964f4-83dc-4197-99b3-120bc799d75d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045123 Oct 22 20:59:13.711158 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1230/2307] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:59:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:59:13.741126 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-db4d2cd1-aa87-4457-9a3b-68c69af23428 tempest-FloatingIPDetailsTestJSON-1867523695 tempest-FloatingIPDetailsTestJSON-1867523695-project] Action: 'create', calling method: .version_select at 0x7fd3a4118160>, body: {"pool": null} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:59:16.351164 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-db4d2cd1-aa87-4457-9a3b-68c69af23428 tempest-FloatingIPDetailsTestJSON-1867523695 tempest-FloatingIPDetailsTestJSON-1867523695-project] 10.222.0.18 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.626361 Oct 22 20:59:16.352381 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1231/2308] 10.222.0.18 () {60 vars in 1170 bytes} [Sat Oct 22 20:59:13 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2629 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:59:16.369000 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-b08b29aa-7fed-46a4-8aea-2ff5eeaca016 req-92c3784c-32ac-47c2-a830-7a9f806a7c41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd812b37-71ed-400f-ba94-050254f85f9e", "name": "network-vif-deleted", "tag": "99a319fa-6647-42c1-9395-fd51c25a466c"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:59:16.398858 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-b08b29aa-7fed-46a4-8aea-2ff5eeaca016 req-92c3784c-32ac-47c2-a830-7a9f806a7c41 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:16.399372 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-b08b29aa-7fed-46a4-8aea-2ff5eeaca016 req-92c3784c-32ac-47c2-a830-7a9f806a7c41 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:16.399829 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-b08b29aa-7fed-46a4-8aea-2ff5eeaca016 req-92c3784c-32ac-47c2-a830-7a9f806a7c41 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:16.416752 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-b08b29aa-7fed-46a4-8aea-2ff5eeaca016 req-92c3784c-32ac-47c2-a830-7a9f806a7c41 service nova] Creating event network-vif-deleted:99a319fa-6647-42c1-9395-fd51c25a466c for instance fd812b37-71ed-400f-ba94-050254f85f9e on nch2-master-1 Oct 22 20:59:16.422284 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-b08b29aa-7fed-46a4-8aea-2ff5eeaca016 req-92c3784c-32ac-47c2-a830-7a9f806a7c41 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059741 Oct 22 20:59:16.423214 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1232/2309] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:59:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:59:16.430063 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-cdbb3305-f113-491e-b83e-9a29d3aa9d15 tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:59:16.431953 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-cdbb3305-f113-491e-b83e-9a29d3aa9d15 tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] [instance: ae58d60e-a113-4a38-94b5-b72a19c353e6] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:59:16.441321 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cdbb3305-f113-491e-b83e-9a29d3aa9d15 tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:16.442196 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cdbb3305-f113-491e-b83e-9a29d3aa9d15 tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:16.442937 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cdbb3305-f113-491e-b83e-9a29d3aa9d15 tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:16.444543 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cdbb3305-f113-491e-b83e-9a29d3aa9d15 tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:16.445252 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cdbb3305-f113-491e-b83e-9a29d3aa9d15 tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:16.445828 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cdbb3305-f113-491e-b83e-9a29d3aa9d15 tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:16.470104 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:59:16.840320 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-cdbb3305-f113-491e-b83e-9a29d3aa9d15 tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e36cd987f04f11b6a41325add4ccac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d79e903f8f24a348d5e771d434c70c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:59:16.857457 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-cdbb3305-f113-491e-b83e-9a29d3aa9d15 tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] 10.222.0.18 "GET /compute/v2.1/servers/ae58d60e-a113-4a38-94b5-b72a19c353e6" status: 200 len: 1322 microversion: 2.1 time: 0.430074 Oct 22 20:59:16.859231 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1233/2310] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:59:16 2022] GET /compute/v2.1/servers/ae58d60e-a113-4a38-94b5-b72a19c353e6 => generated 1322 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:59:16.866135 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-ce5048dc-26a1-4c2c-b981-d408653dff16 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:59:16.866752 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-ce5048dc-26a1-4c2c-b981-d408653dff16 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] [instance: 61d89bc7-fcfe-479b-baa1-7307a4395cc3] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:59:16.885678 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ce5048dc-26a1-4c2c-b981-d408653dff16 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:16.886192 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ce5048dc-26a1-4c2c-b981-d408653dff16 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:16.886643 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ce5048dc-26a1-4c2c-b981-d408653dff16 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:16.887397 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ce5048dc-26a1-4c2c-b981-d408653dff16 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:16.889284 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ce5048dc-26a1-4c2c-b981-d408653dff16 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:16.889911 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ce5048dc-26a1-4c2c-b981-d408653dff16 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:17.255253 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-ce5048dc-26a1-4c2c-b981-d408653dff16 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d49952dbca4d95a25411b65d56552b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed31e93b0e8a43f28e497f94318815ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:59:17.266886 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-ce5048dc-26a1-4c2c-b981-d408653dff16 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] 10.222.0.18 "GET /compute/v2.1/servers/61d89bc7-fcfe-479b-baa1-7307a4395cc3" status: 200 len: 1504 microversion: 2.1 time: 0.406516 Oct 22 20:59:17.268561 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1234/2311] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:59:16 2022] GET /compute/v2.1/servers/61d89bc7-fcfe-479b-baa1-7307a4395cc3 => generated 1504 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:59:17.274287 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-9ae2d1de-5e51-4e3b-a5c9-6dcbbbc83768 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:59:17.274935 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-9ae2d1de-5e51-4e3b-a5c9-6dcbbbc83768 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] [instance: fd812b37-71ed-400f-ba94-050254f85f9e] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:59:17.282153 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9ae2d1de-5e51-4e3b-a5c9-6dcbbbc83768 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:17.283138 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9ae2d1de-5e51-4e3b-a5c9-6dcbbbc83768 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:17.283960 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9ae2d1de-5e51-4e3b-a5c9-6dcbbbc83768 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:17.285759 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9ae2d1de-5e51-4e3b-a5c9-6dcbbbc83768 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:17.286295 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9ae2d1de-5e51-4e3b-a5c9-6dcbbbc83768 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:17.286790 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9ae2d1de-5e51-4e3b-a5c9-6dcbbbc83768 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:17.311798 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.wsgi [None req-9ae2d1de-5e51-4e3b-a5c9-6dcbbbc83768 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] HTTP exception thrown: Instance fd812b37-71ed-400f-ba94-050254f85f9e could not be found. Oct 22 20:59:17.313938 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-9ae2d1de-5e51-4e3b-a5c9-6dcbbbc83768 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Request method failure captured: Oct 22 20:59:17.313938 ncdv-master-1 devstack@n-api.service[138745]: request: GET /compute/v2.1/servers/fd812b37-71ed-400f-ba94-050254f85f9e HTTP/1.1 Oct 22 20:59:17.313938 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 20:59:17.313938 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 20:59:17.313938 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 20:59:17.313938 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 0 Oct 22 20:59:17.313938 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 20:59:17.313938 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 20:59:17.313938 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 20:59:17.313938 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 20:59:17.313938 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVFkeCb43WeQtgp51X28RghffiPHU69OKuTacjjJieCoGY9zvHUBMakCXIpkUptlUnh9NPZ76FyJBq4xJSggLl9CrBFTTAqzkYVy7np9TorrKbA0E8UyGHTIO_6WcqkriAf39zPqVfQvV-3CUgMB4zly4miVW78IOGm6KefMgkaoycxc Oct 22 20:59:17.313938 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 20:59:17.313938 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 20:59:17.313938 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 20:59:17.313938 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 20:59:17.313938 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 20:59:17.313938 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 20:59:17.313938 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: 8351b01e07cd43f9be973ab45e522bf0 Oct 22 20:59:17.313938 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-ServersAdminTestJSON-1787327939 Oct 22 20:59:17.313938 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 20:59:17.313938 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 20:59:17.313938 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_8351b01e07cd43f9be973ab45e522bf0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8351b01e07cd43f9be973ab45e522bf0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/8351b01e07cd43f9be973ab45e522bf0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8351b01e07cd43f9be973ab45e522bf0"}]}] Oct 22 20:59:17.313938 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-ServersAdminTestJSON-1787327939 Oct 22 20:59:17.313938 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: 8351b01e07cd43f9be973ab45e522bf0 Oct 22 20:59:17.313938 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-ServersAdminTestJSON-1787327939 Oct 22 20:59:17.313938 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-ServersAdminTestJSON-1787327939-project Oct 22 20:59:17.313938 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 20:59:17.313938 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 20:59:17.313938 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: 57dbe89a7e11480194d3d86f82983499 Oct 22 20:59:17.313938 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-ServersAdminTestJSON-1787327939-project Oct 22 20:59:17.313938 ncdv-master-1 devstack@n-api.service[138745]: method: > Oct 22 20:59:17.313938 ncdv-master-1 devstack@n-api.service[138745]: exception: Instance fd812b37-71ed-400f-ba94-050254f85f9e could not be found. Oct 22 20:59:17.313938 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'id': 'fd812b37-71ed-400f-ba94-050254f85f9e'} Oct 22 20:59:17.313938 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:59:17.313938 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:59:17.313938 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 20:59:17.313938 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 20:59:17.313938 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 20:59:17.313938 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 20:59:17.313938 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 20:59:17.313938 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 20:59:17.313938 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 20:59:17.313938 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 20:59:17.313938 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd812b37-71ed-400f-ba94-050254f85f9e could not be found. Oct 22 20:59:17.313938 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:59:17.313938 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:59:17.313938 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:59:17.313938 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:59:17.313938 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:59:17.313938 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:59:17.313938 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:59:17.313938 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:59:17.313938 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:59:17.313938 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:59:17.313938 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 20:59:17.313938 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 20:59:17.313938 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 20:59:17.313938 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 20:59:17.313938 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 20:59:17.313938 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 20:59:17.313938 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd812b37-71ed-400f-ba94-050254f85f9e could not be found. Oct 22 20:59:17.313938 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:59:17.313938 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:59:17.313938 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:59:17.317977 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:59:17.317977 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:59:17.317977 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:59:17.317977 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 20:59:17.317977 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 20:59:17.317977 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd812b37-71ed-400f-ba94-050254f85f9e could not be found. Oct 22 20:59:17.317977 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:59:17.317977 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-9ae2d1de-5e51-4e3b-a5c9-6dcbbbc83768 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Returning 404 to user: Instance fd812b37-71ed-400f-ba94-050254f85f9e could not be found. {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:59:17.317977 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-9ae2d1de-5e51-4e3b-a5c9-6dcbbbc83768 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] 10.222.0.18 "GET /compute/v2.1/servers/fd812b37-71ed-400f-ba94-050254f85f9e" status: 404 len: 111 microversion: 2.1 time: 0.045577 Oct 22 20:59:17.317977 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1235/2312] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:59:17 2022] GET /compute/v2.1/servers/fd812b37-71ed-400f-ba94-050254f85f9e => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 20:59:17.324533 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-2282824a-1e59-4898-a7d4-e29bb827561c tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:59:17.324893 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-2282824a-1e59-4898-a7d4-e29bb827561c tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] [instance: c3e6246d-c32a-490d-ba83-84b54822f971] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:59:17.332291 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2282824a-1e59-4898-a7d4-e29bb827561c tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:17.333038 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2282824a-1e59-4898-a7d4-e29bb827561c tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:17.334273 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2282824a-1e59-4898-a7d4-e29bb827561c tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:17.335729 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2282824a-1e59-4898-a7d4-e29bb827561c tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:17.336349 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2282824a-1e59-4898-a7d4-e29bb827561c tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:17.336949 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2282824a-1e59-4898-a7d4-e29bb827561c tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:17.359256 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell0:SELECT=8 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:59:17.693988 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-2282824a-1e59-4898-a7d4-e29bb827561c tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d3d7458af447bdb3f03e83a2d8559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49238b8686d24ae698679e4a1957735d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:59:17.703623 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-2282824a-1e59-4898-a7d4-e29bb827561c tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] 10.222.0.18 "GET /compute/v2.1/servers/c3e6246d-c32a-490d-ba83-84b54822f971" status: 200 len: 1475 microversion: 2.1 time: 0.386617 Oct 22 20:59:17.704198 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1236/2313] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:59:17 2022] GET /compute/v2.1/servers/c3e6246d-c32a-490d-ba83-84b54822f971 => generated 1475 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:59:17.710070 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-c5b7569e-ffdb-49dd-aa69-089e6a28f643 tempest-FloatingIPDetailsTestJSON-1867523695 tempest-FloatingIPDetailsTestJSON-1867523695-project] Action: 'create', calling method: .version_select at 0x7fd3a44f78b0>, body: {"pool": null} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:59:18.579696 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-ee73844c-763d-48fa-bd35-6c4ca1131e21 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Flavor limits 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 20:59:18.580658 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-ee73844c-763d-48fa-bd35-6c4ca1131e21 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Image limits 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 20:59:18.581327 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-ee73844c-763d-48fa-bd35-6c4ca1131e21 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Flavor pref 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 20:59:18.581997 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-ee73844c-763d-48fa-bd35-6c4ca1131e21 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Image pref 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 20:59:18.582616 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-ee73844c-763d-48fa-bd35-6c4ca1131e21 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 20:59:18.591889 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ee73844c-763d-48fa-bd35-6c4ca1131e21 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:18.592567 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ee73844c-763d-48fa-bd35-6c4ca1131e21 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:18.593006 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ee73844c-763d-48fa-bd35-6c4ca1131e21 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:18.593742 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ee73844c-763d-48fa-bd35-6c4ca1131e21 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:18.594197 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ee73844c-763d-48fa-bd35-6c4ca1131e21 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:18.594744 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ee73844c-763d-48fa-bd35-6c4ca1131e21 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:18.615170 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-ee73844c-763d-48fa-bd35-6c4ca1131e21 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Getting quotas for project cd687d54e07d4ab4af00ad801ef4b58d. Resources: {'cores', 'instances', 'ram'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 20:59:18.621561 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-ee73844c-763d-48fa-bd35-6c4ca1131e21 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Getting quotas for user 211483c6acea4f76b6c0e4bfc818e7aa and project cd687d54e07d4ab4af00ad801ef4b58d. Resources: {'cores', 'instances', 'ram'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 20:59:18.800587 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-ee73844c-763d-48fa-bd35-6c4ca1131e21 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Going to run 1 instances... {{(pid=138744) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 20:59:18.803258 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-ee73844c-763d-48fa-bd35-6c4ca1131e21 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] [instance: f38f14b2-b9d7-4bed-92ba-7b95ea4b2270] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='d1d5f32b-f8b3-4714-96ae-203dc0482f4b',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='1b9bd5cf-91ea-49ac-9156-2270dc908725',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ebb1b567-e10c-480f-8fc1-0b24f1086d7e',volume_size=None,volume_type=None)] {{(pid=138744) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 20:59:19.187307 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-ee73844c-763d-48fa-bd35-6c4ca1131e21 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.42 time: 6.063466 Oct 22 20:59:19.195615 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1078/2314] 10.222.0.18 () {62 vars in 1189 bytes} [Sat Oct 22 20:59:13 2022] POST /compute/v2.1/servers => generated 405 bytes in 6072 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 22 20:59:19.201666 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-8b7c8c9a-7d64-4ad8-ab43-ca7bc73eb8c9 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1089174612"}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:59:19.202576 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-8b7c8c9a-7d64-4ad8-ab43-ca7bc73eb8c9 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] [instance: 61d89bc7-fcfe-479b-baa1-7307a4395cc3] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:59:19.227501 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8b7c8c9a-7d64-4ad8-ab43-ca7bc73eb8c9 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:19.228755 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8b7c8c9a-7d64-4ad8-ab43-ca7bc73eb8c9 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:19.229377 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8b7c8c9a-7d64-4ad8-ab43-ca7bc73eb8c9 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:19.230424 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8b7c8c9a-7d64-4ad8-ab43-ca7bc73eb8c9 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:19.232283 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8b7c8c9a-7d64-4ad8-ab43-ca7bc73eb8c9 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:19.232979 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8b7c8c9a-7d64-4ad8-ab43-ca7bc73eb8c9 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:19.563369 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.network.security_group_api [None req-8b7c8c9a-7d64-4ad8-ab43-ca7bc73eb8c9 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Adding security group 953f2c64-dadb-4488-84a3-68647ef4231a to port 8b90877b-3e97-4354-ad15-7327a7aa752b Oct 22 20:59:20.308726 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-8b7c8c9a-7d64-4ad8-ab43-ca7bc73eb8c9 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] 10.222.0.18 "POST /compute/v2.1/servers/61d89bc7-fcfe-479b-baa1-7307a4395cc3/action" status: 202 len: 0 microversion: 2.1 time: 1.111474 Oct 22 20:59:20.314294 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1079/2315] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 20:59:19 2022] POST /compute/v2.1/servers/61d89bc7-fcfe-479b-baa1-7307a4395cc3/action => generated 0 bytes in 1118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 20:59:20.320249 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-2b1400a7-034c-4b68-bf3d-17ca3f2299ed tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:59:20.320992 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-2b1400a7-034c-4b68-bf3d-17ca3f2299ed tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] [instance: 7c5c7ad1-4e7b-427e-8f66-862cc9b2f457] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:59:20.330351 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2b1400a7-034c-4b68-bf3d-17ca3f2299ed tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:20.331310 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2b1400a7-034c-4b68-bf3d-17ca3f2299ed tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:20.333185 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2b1400a7-034c-4b68-bf3d-17ca3f2299ed tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:20.334655 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2b1400a7-034c-4b68-bf3d-17ca3f2299ed tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:20.335455 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2b1400a7-034c-4b68-bf3d-17ca3f2299ed tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:20.336130 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2b1400a7-034c-4b68-bf3d-17ca3f2299ed tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:20.339674 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:SELECT=51 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:59:20.382031 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-2b1400a7-034c-4b68-bf3d-17ca3f2299ed tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] [instance: 7c5c7ad1-4e7b-427e-8f66-862cc9b2f457] Going to try to terminate instance {{(pid=138744) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 20:59:20.476311 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-c5b7569e-ffdb-49dd-aa69-089e6a28f643 tempest-FloatingIPDetailsTestJSON-1867523695 tempest-FloatingIPDetailsTestJSON-1867523695-project] 10.222.0.18 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 2.770144 Oct 22 20:59:20.485660 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1237/2316] 10.222.0.18 () {60 vars in 1170 bytes} [Sat Oct 22 20:59:17 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 2780 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:59:20.491391 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-5e70cb88-d948-4a51-9b8f-fe2d67898ec0 tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:59:20.492367 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-5e70cb88-d948-4a51-9b8f-fe2d67898ec0 tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] [instance: ae58d60e-a113-4a38-94b5-b72a19c353e6] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:59:20.502473 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5e70cb88-d948-4a51-9b8f-fe2d67898ec0 tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:20.503309 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5e70cb88-d948-4a51-9b8f-fe2d67898ec0 tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:20.504322 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5e70cb88-d948-4a51-9b8f-fe2d67898ec0 tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:20.505302 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5e70cb88-d948-4a51-9b8f-fe2d67898ec0 tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:20.506472 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5e70cb88-d948-4a51-9b8f-fe2d67898ec0 tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:20.507115 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5e70cb88-d948-4a51-9b8f-fe2d67898ec0 tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:20.526751 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-2b1400a7-034c-4b68-bf3d-17ca3f2299ed tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] 10.222.0.18 "DELETE /compute/v2.1/servers/7c5c7ad1-4e7b-427e-8f66-862cc9b2f457" status: 204 len: 0 microversion: 2.1 time: 0.210350 Oct 22 20:59:20.531410 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1080/2317] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 20:59:20 2022] DELETE /compute/v2.1/servers/7c5c7ad1-4e7b-427e-8f66-862cc9b2f457 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 20:59:20.540828 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-e088687d-2430-4404-aa84-e52bc5ac0ccc tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:59:20.547688 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-e088687d-2430-4404-aa84-e52bc5ac0ccc tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5bb8017457354ed68be65cb426965cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af194191cdc4b34a470c821a932e2fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:59:20.549332 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-e088687d-2430-4404-aa84-e52bc5ac0ccc tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] Searching by: {'deleted': False, 'project_id': '5af194191cdc4b34a470c821a932e2fd'} {{(pid=138744) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 22 20:59:20.555959 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e088687d-2430-4404-aa84-e52bc5ac0ccc tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:20.556741 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e088687d-2430-4404-aa84-e52bc5ac0ccc tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:20.557832 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e088687d-2430-4404-aa84-e52bc5ac0ccc tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:20.561842 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e088687d-2430-4404-aa84-e52bc5ac0ccc tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:20.563732 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e088687d-2430-4404-aa84-e52bc5ac0ccc tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:20.564393 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e088687d-2430-4404-aa84-e52bc5ac0ccc tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:20.599684 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.multi_cell_list [None req-e088687d-2430-4404-aa84-e52bc5ac0ccc tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=138744) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 22 20:59:20.656406 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-e088687d-2430-4404-aa84-e52bc5ac0ccc tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] 10.222.0.18 "GET /compute/v2.1/servers" status: 200 len: 334 microversion: 2.1 time: 0.122571 Oct 22 20:59:20.663452 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1081/2318] 10.222.0.18 () {58 vars in 1125 bytes} [Sat Oct 22 20:59:20 2022] GET /compute/v2.1/servers => generated 334 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:59:20.672585 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-8cb099ec-0065-494c-88d8-17f3a2971ea0 req-c04fad51-8d17-451f-bd66-6a2722982034 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae58d60e-a113-4a38-94b5-b72a19c353e6", "name": "network-vif-plugged", "status": "completed", "tag": "6bbd4b8b-948d-44a4-8b7f-6968bc1dc2cf"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:59:20.682989 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-8cb099ec-0065-494c-88d8-17f3a2971ea0 req-c04fad51-8d17-451f-bd66-6a2722982034 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:20.684115 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-8cb099ec-0065-494c-88d8-17f3a2971ea0 req-c04fad51-8d17-451f-bd66-6a2722982034 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:20.684710 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-8cb099ec-0065-494c-88d8-17f3a2971ea0 req-c04fad51-8d17-451f-bd66-6a2722982034 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:20.697356 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-8cb099ec-0065-494c-88d8-17f3a2971ea0 req-c04fad51-8d17-451f-bd66-6a2722982034 service nova] Creating event network-vif-plugged:6bbd4b8b-948d-44a4-8b7f-6968bc1dc2cf for instance ae58d60e-a113-4a38-94b5-b72a19c353e6 on nch2-master-1 Oct 22 20:59:20.697785 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-5e70cb88-d948-4a51-9b8f-fe2d67898ec0 tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e36cd987f04f11b6a41325add4ccac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d79e903f8f24a348d5e771d434c70c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:59:20.705624 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-8cb099ec-0065-494c-88d8-17f3a2971ea0 req-c04fad51-8d17-451f-bd66-6a2722982034 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036838 Oct 22 20:59:20.706413 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1082/2319] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:59:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:59:20.707284 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-5e70cb88-d948-4a51-9b8f-fe2d67898ec0 tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] 10.222.0.18 "GET /compute/v2.1/servers/ae58d60e-a113-4a38-94b5-b72a19c353e6" status: 200 len: 1322 microversion: 2.1 time: 0.220078 Oct 22 20:59:20.707978 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1238/2320] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:59:20 2022] GET /compute/v2.1/servers/ae58d60e-a113-4a38-94b5-b72a19c353e6 => generated 1322 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:59:20.712681 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-18d936d6-cdd3-4660-9344-3a6637bbded7 req-abda157b-4675-4cee-b85f-eb4a49ce3a91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3e6246d-c32a-490d-ba83-84b54822f971", "name": "network-vif-unplugged", "status": "completed", "tag": "140cd909-abde-4ea9-89c0-b130f4264b5b"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:59:20.713287 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-10fa4742-fa68-4dc9-9c7c-3eb3140e426c tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:59:20.714083 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-10fa4742-fa68-4dc9-9c7c-3eb3140e426c tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] [instance: c3e6246d-c32a-490d-ba83-84b54822f971] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:59:20.721902 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-10fa4742-fa68-4dc9-9c7c-3eb3140e426c tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:20.722851 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-10fa4742-fa68-4dc9-9c7c-3eb3140e426c tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:20.722997 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-18d936d6-cdd3-4660-9344-3a6637bbded7 req-abda157b-4675-4cee-b85f-eb4a49ce3a91 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:20.723373 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-18d936d6-cdd3-4660-9344-3a6637bbded7 req-abda157b-4675-4cee-b85f-eb4a49ce3a91 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:20.723833 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-18d936d6-cdd3-4660-9344-3a6637bbded7 req-abda157b-4675-4cee-b85f-eb4a49ce3a91 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:20.724130 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-10fa4742-fa68-4dc9-9c7c-3eb3140e426c tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:20.725124 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-10fa4742-fa68-4dc9-9c7c-3eb3140e426c tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:20.726130 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-10fa4742-fa68-4dc9-9c7c-3eb3140e426c tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:20.727003 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-10fa4742-fa68-4dc9-9c7c-3eb3140e426c tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:20.743415 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-18d936d6-cdd3-4660-9344-3a6637bbded7 req-abda157b-4675-4cee-b85f-eb4a49ce3a91 service nova] Creating event network-vif-unplugged:140cd909-abde-4ea9-89c0-b130f4264b5b for instance c3e6246d-c32a-490d-ba83-84b54822f971 on nch2-master-1 Oct 22 20:59:20.752253 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [req-18d936d6-cdd3-4660-9344-3a6637bbded7 req-abda157b-4675-4cee-b85f-eb4a49ce3a91 service nova] Instance c3e6246d-c32a-490d-ba83-84b54822f971 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=138744) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 22 20:59:20.765751 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-18d936d6-cdd3-4660-9344-3a6637bbded7 req-abda157b-4675-4cee-b85f-eb4a49ce3a91 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.058069 Oct 22 20:59:20.766662 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1083/2321] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:59:20 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:59:20.778003 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-9eec0527-ad3e-4432-b22c-c63e589ce31c tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:59:20.778003 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-9eec0527-ad3e-4432-b22c-c63e589ce31c tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] [instance: f38f14b2-b9d7-4bed-92ba-7b95ea4b2270] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:59:20.785996 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9eec0527-ad3e-4432-b22c-c63e589ce31c tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:20.786493 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9eec0527-ad3e-4432-b22c-c63e589ce31c tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:20.786934 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9eec0527-ad3e-4432-b22c-c63e589ce31c tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:20.787685 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9eec0527-ad3e-4432-b22c-c63e589ce31c tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:20.788135 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9eec0527-ad3e-4432-b22c-c63e589ce31c tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:20.788587 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9eec0527-ad3e-4432-b22c-c63e589ce31c tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:20.925588 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-9eec0527-ad3e-4432-b22c-c63e589ce31c tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211483c6acea4f76b6c0e4bfc818e7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd687d54e07d4ab4af00ad801ef4b58d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:59:20.931412 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-10fa4742-fa68-4dc9-9c7c-3eb3140e426c tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d3d7458af447bdb3f03e83a2d8559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49238b8686d24ae698679e4a1957735d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:59:20.936368 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-9eec0527-ad3e-4432-b22c-c63e589ce31c tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '211483c6acea4f76b6c0e4bfc818e7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd687d54e07d4ab4af00ad801ef4b58d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:59:20.938113 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-9eec0527-ad3e-4432-b22c-c63e589ce31c tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '211483c6acea4f76b6c0e4bfc818e7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd687d54e07d4ab4af00ad801ef4b58d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:59:20.939608 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-9eec0527-ad3e-4432-b22c-c63e589ce31c tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] 10.222.0.18 "GET /compute/v2.1/servers/f38f14b2-b9d7-4bed-92ba-7b95ea4b2270" status: 200 len: 1527 microversion: 2.42 time: 0.168591 Oct 22 20:59:20.947246 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1084/2322] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 20:59:20 2022] GET /compute/v2.1/servers/f38f14b2-b9d7-4bed-92ba-7b95ea4b2270 => generated 1527 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 20:59:20.947246 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-5e150b03-7115-40fc-aa11-af50c8285766 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-887294930"}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:59:20.947246 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-5e150b03-7115-40fc-aa11-af50c8285766 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] [instance: 61d89bc7-fcfe-479b-baa1-7307a4395cc3] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:59:20.952579 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5e150b03-7115-40fc-aa11-af50c8285766 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:20.953156 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5e150b03-7115-40fc-aa11-af50c8285766 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:20.953666 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5e150b03-7115-40fc-aa11-af50c8285766 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:20.954452 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5e150b03-7115-40fc-aa11-af50c8285766 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:20.954976 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5e150b03-7115-40fc-aa11-af50c8285766 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:20.955524 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5e150b03-7115-40fc-aa11-af50c8285766 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:20.960982 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-10fa4742-fa68-4dc9-9c7c-3eb3140e426c tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] 10.222.0.18 "GET /compute/v2.1/servers/c3e6246d-c32a-490d-ba83-84b54822f971" status: 200 len: 1473 microversion: 2.1 time: 0.251522 Oct 22 20:59:20.961695 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1239/2323] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:59:20 2022] GET /compute/v2.1/servers/c3e6246d-c32a-490d-ba83-84b54822f971 => generated 1473 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:59:20.966335 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-2a415e3c-df6b-4e8b-9c14-73015886abf1 tempest-FloatingIPDetailsTestJSON-1867523695 tempest-FloatingIPDetailsTestJSON-1867523695-project] Calling method '.version_select at 0x7fd3a4118d30>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:59:21.194682 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.network.security_group_api [None req-5e150b03-7115-40fc-aa11-af50c8285766 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Adding security group 606d7184-23fe-4852-b84a-c88ccc1b39fb to port 8b90877b-3e97-4354-ad15-7327a7aa752b Oct 22 20:59:21.206360 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-2a415e3c-df6b-4e8b-9c14-73015886abf1 tempest-FloatingIPDetailsTestJSON-1867523695 tempest-FloatingIPDetailsTestJSON-1867523695-project] 10.222.0.18 "GET /compute/v2.1/os-floating-ips/34cbdc1d-06af-4292-af60-bd332d14c6f7" status: 200 len: 141 microversion: 2.1 time: 0.243668 Oct 22 20:59:21.207014 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1240/2324] 10.222.0.18 () {58 vars in 1260 bytes} [Sat Oct 22 20:59:20 2022] GET /compute/v2.1/os-floating-ips/34cbdc1d-06af-4292-af60-bd332d14c6f7 => generated 141 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:59:21.212485 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-b0d4bb8c-db8b-4878-a004-e339fdc5b8d2 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:59:21.213171 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-b0d4bb8c-db8b-4878-a004-e339fdc5b8d2 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] [instance: 7c5c7ad1-4e7b-427e-8f66-862cc9b2f457] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:59:21.219837 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b0d4bb8c-db8b-4878-a004-e339fdc5b8d2 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:21.220697 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b0d4bb8c-db8b-4878-a004-e339fdc5b8d2 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:21.221385 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b0d4bb8c-db8b-4878-a004-e339fdc5b8d2 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:21.222381 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b0d4bb8c-db8b-4878-a004-e339fdc5b8d2 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:21.223005 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b0d4bb8c-db8b-4878-a004-e339fdc5b8d2 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:21.223640 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b0d4bb8c-db8b-4878-a004-e339fdc5b8d2 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:21.515629 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-b0d4bb8c-db8b-4878-a004-e339fdc5b8d2 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dbe89a7e11480194d3d86f82983499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8351b01e07cd43f9be973ab45e522bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:59:21.539703 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-b0d4bb8c-db8b-4878-a004-e339fdc5b8d2 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] 10.222.0.18 "GET /compute/v2.1/servers/7c5c7ad1-4e7b-427e-8f66-862cc9b2f457" status: 200 len: 1469 microversion: 2.1 time: 0.331232 Oct 22 20:59:21.541895 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1241/2325] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:59:21 2022] GET /compute/v2.1/servers/7c5c7ad1-4e7b-427e-8f66-862cc9b2f457 => generated 1469 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:59:21.549580 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-18905b78-bd0d-4f6a-8d67-caee60573c23 tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:59:21.555698 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-18905b78-bd0d-4f6a-8d67-caee60573c23 tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5bb8017457354ed68be65cb426965cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af194191cdc4b34a470c821a932e2fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:59:21.556981 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-18905b78-bd0d-4f6a-8d67-caee60573c23 tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] Searching by: {'deleted': False, 'project_id': '5af194191cdc4b34a470c821a932e2fd'} {{(pid=138745) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 22 20:59:21.564211 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-18905b78-bd0d-4f6a-8d67-caee60573c23 tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:21.565031 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-18905b78-bd0d-4f6a-8d67-caee60573c23 tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:21.565807 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-18905b78-bd0d-4f6a-8d67-caee60573c23 tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:21.566941 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-18905b78-bd0d-4f6a-8d67-caee60573c23 tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:21.567758 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-18905b78-bd0d-4f6a-8d67-caee60573c23 tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:21.568390 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-18905b78-bd0d-4f6a-8d67-caee60573c23 tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:21.600631 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.multi_cell_list [None req-18905b78-bd0d-4f6a-8d67-caee60573c23 tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=138745) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 22 20:59:21.669063 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-18905b78-bd0d-4f6a-8d67-caee60573c23 tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb8017457354ed68be65cb426965cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af194191cdc4b34a470c821a932e2fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:59:21.678090 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-18905b78-bd0d-4f6a-8d67-caee60573c23 tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:21.679145 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-18905b78-bd0d-4f6a-8d67-caee60573c23 tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:21.680312 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-18905b78-bd0d-4f6a-8d67-caee60573c23 tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:21.846128 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-5e150b03-7115-40fc-aa11-af50c8285766 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] 10.222.0.18 "POST /compute/v2.1/servers/61d89bc7-fcfe-479b-baa1-7307a4395cc3/action" status: 202 len: 0 microversion: 2.1 time: 0.904778 Oct 22 20:59:21.847325 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1085/2326] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 20:59:20 2022] POST /compute/v2.1/servers/61d89bc7-fcfe-479b-baa1-7307a4395cc3/action => generated 0 bytes in 906 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 20:59:21.855126 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-7ebf0853-669e-4ee9-9017-78d255875370 tempest-FloatingIPDetailsTestJSON-1867523695 tempest-FloatingIPDetailsTestJSON-1867523695-project] Calling method '.version_select at 0x7fd3a41fcd30>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:59:22.444072 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-18905b78-bd0d-4f6a-8d67-caee60573c23 tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] 10.222.0.18 "GET /compute/v2.1/servers/detail" status: 200 len: 1695 microversion: 2.1 time: 0.898593 Oct 22 20:59:22.453519 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1242/2327] 10.222.0.18 () {58 vars in 1146 bytes} [Sat Oct 22 20:59:21 2022] GET /compute/v2.1/servers/detail => generated 1695 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:59:22.460897 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-cefe86e3-5a83-4a40-a620-1abba26926df tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:59:22.461801 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-cefe86e3-5a83-4a40-a620-1abba26926df tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] [instance: ae58d60e-a113-4a38-94b5-b72a19c353e6] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:59:22.470504 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cefe86e3-5a83-4a40-a620-1abba26926df tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:22.470913 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cefe86e3-5a83-4a40-a620-1abba26926df tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:22.471576 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cefe86e3-5a83-4a40-a620-1abba26926df tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:22.472468 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cefe86e3-5a83-4a40-a620-1abba26926df tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:22.473064 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cefe86e3-5a83-4a40-a620-1abba26926df tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:22.473639 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cefe86e3-5a83-4a40-a620-1abba26926df tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:22.930589 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-cefe86e3-5a83-4a40-a620-1abba26926df tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e36cd987f04f11b6a41325add4ccac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d79e903f8f24a348d5e771d434c70c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:59:22.948154 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-cefe86e3-5a83-4a40-a620-1abba26926df tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] 10.222.0.18 "GET /compute/v2.1/servers/ae58d60e-a113-4a38-94b5-b72a19c353e6" status: 200 len: 1322 microversion: 2.1 time: 0.493094 Oct 22 20:59:22.948762 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1243/2328] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:59:22 2022] GET /compute/v2.1/servers/ae58d60e-a113-4a38-94b5-b72a19c353e6 => generated 1322 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:59:22.953754 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-3807d196-a37b-4af6-9ff5-5c229b94475d tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:59:22.954437 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-3807d196-a37b-4af6-9ff5-5c229b94475d tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] [instance: 61d89bc7-fcfe-479b-baa1-7307a4395cc3] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:59:22.971241 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3807d196-a37b-4af6-9ff5-5c229b94475d tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:22.971801 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3807d196-a37b-4af6-9ff5-5c229b94475d tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:22.972246 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3807d196-a37b-4af6-9ff5-5c229b94475d tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:22.972974 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3807d196-a37b-4af6-9ff5-5c229b94475d tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:22.973444 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3807d196-a37b-4af6-9ff5-5c229b94475d tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:22.973887 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3807d196-a37b-4af6-9ff5-5c229b94475d tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:23.629550 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-3807d196-a37b-4af6-9ff5-5c229b94475d tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] 10.222.0.18 "GET /compute/v2.1/servers/61d89bc7-fcfe-479b-baa1-7307a4395cc3/os-security-groups" status: 200 len: 1158 microversion: 2.1 time: 0.679090 Oct 22 20:59:23.630360 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1244/2329] 10.222.0.18 () {58 vars in 1293 bytes} [Sat Oct 22 20:59:22 2022] GET /compute/v2.1/servers/61d89bc7-fcfe-479b-baa1-7307a4395cc3/os-security-groups => generated 1158 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:59:23.650765 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-07f34945-93e2-4e0f-8326-30197a7d9dfc tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:59:23.651791 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-07f34945-93e2-4e0f-8326-30197a7d9dfc tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] [instance: f38f14b2-b9d7-4bed-92ba-7b95ea4b2270] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:59:23.660396 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-07f34945-93e2-4e0f-8326-30197a7d9dfc tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:23.661282 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-07f34945-93e2-4e0f-8326-30197a7d9dfc tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:23.662009 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-07f34945-93e2-4e0f-8326-30197a7d9dfc tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:23.663390 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-07f34945-93e2-4e0f-8326-30197a7d9dfc tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:23.664115 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-07f34945-93e2-4e0f-8326-30197a7d9dfc tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:23.665655 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-07f34945-93e2-4e0f-8326-30197a7d9dfc tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:23.810933 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-07f34945-93e2-4e0f-8326-30197a7d9dfc tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211483c6acea4f76b6c0e4bfc818e7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd687d54e07d4ab4af00ad801ef4b58d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:59:23.837957 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-07f34945-93e2-4e0f-8326-30197a7d9dfc tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '211483c6acea4f76b6c0e4bfc818e7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd687d54e07d4ab4af00ad801ef4b58d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:59:23.839723 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-07f34945-93e2-4e0f-8326-30197a7d9dfc tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '211483c6acea4f76b6c0e4bfc818e7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd687d54e07d4ab4af00ad801ef4b58d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:59:23.840973 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-07f34945-93e2-4e0f-8326-30197a7d9dfc tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] 10.222.0.18 "GET /compute/v2.1/servers/f38f14b2-b9d7-4bed-92ba-7b95ea4b2270" status: 200 len: 1575 microversion: 2.42 time: 0.208300 Oct 22 20:59:23.849626 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1245/2330] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 20:59:23 2022] GET /compute/v2.1/servers/f38f14b2-b9d7-4bed-92ba-7b95ea4b2270 => generated 1575 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 20:59:23.855015 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-5f349cfe-ed7c-46d9-8d50-0be0ba187902 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:59:23.855656 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-5f349cfe-ed7c-46d9-8d50-0be0ba187902 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] [instance: c3e6246d-c32a-490d-ba83-84b54822f971] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:59:23.872242 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5f349cfe-ed7c-46d9-8d50-0be0ba187902 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:23.873019 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5f349cfe-ed7c-46d9-8d50-0be0ba187902 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:23.873680 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5f349cfe-ed7c-46d9-8d50-0be0ba187902 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:23.874584 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5f349cfe-ed7c-46d9-8d50-0be0ba187902 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:23.875210 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5f349cfe-ed7c-46d9-8d50-0be0ba187902 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:23.875807 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5f349cfe-ed7c-46d9-8d50-0be0ba187902 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:24.286760 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-7ebf0853-669e-4ee9-9017-78d255875370 tempest-FloatingIPDetailsTestJSON-1867523695 tempest-FloatingIPDetailsTestJSON-1867523695-project] 10.222.0.18 "DELETE /compute/v2.1/os-floating-ips/34cbdc1d-06af-4292-af60-bd332d14c6f7" status: 202 len: 0 microversion: 2.1 time: 2.437723 Oct 22 20:59:24.287494 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1086/2331] 10.222.0.18 () {58 vars in 1263 bytes} [Sat Oct 22 20:59:21 2022] DELETE /compute/v2.1/os-floating-ips/34cbdc1d-06af-4292-af60-bd332d14c6f7 => generated 0 bytes in 2439 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 20:59:24.293469 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-71e4178b-f6e8-4e8b-8d9d-71d7c3bdaf24 tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:59:24.305655 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-71e4178b-f6e8-4e8b-8d9d-71d7c3bdaf24 tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] 10.222.0.18 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.016756 Oct 22 20:59:24.306911 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1087/2332] 10.222.0.18 () {58 vars in 1137 bytes} [Sat Oct 22 20:59:24 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:59:24.311950 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-94a58982-9105-4bd9-af69-f0ac3ccddf63 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:59:24.312841 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-94a58982-9105-4bd9-af69-f0ac3ccddf63 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] [instance: 7c5c7ad1-4e7b-427e-8f66-862cc9b2f457] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:59:24.320727 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-94a58982-9105-4bd9-af69-f0ac3ccddf63 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:24.321663 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-94a58982-9105-4bd9-af69-f0ac3ccddf63 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:24.322427 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-94a58982-9105-4bd9-af69-f0ac3ccddf63 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:24.323483 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-94a58982-9105-4bd9-af69-f0ac3ccddf63 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:24.327383 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-94a58982-9105-4bd9-af69-f0ac3ccddf63 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:24.328219 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-94a58982-9105-4bd9-af69-f0ac3ccddf63 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:24.339267 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-5f349cfe-ed7c-46d9-8d50-0be0ba187902 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d3d7458af447bdb3f03e83a2d8559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49238b8686d24ae698679e4a1957735d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:59:24.350773 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-5f349cfe-ed7c-46d9-8d50-0be0ba187902 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] 10.222.0.18 "GET /compute/v2.1/servers/c3e6246d-c32a-490d-ba83-84b54822f971" status: 200 len: 1470 microversion: 2.1 time: 0.499889 Oct 22 20:59:24.353275 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1246/2333] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:59:23 2022] GET /compute/v2.1/servers/c3e6246d-c32a-490d-ba83-84b54822f971 => generated 1470 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:59:24.389034 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-def3b3ab-b61d-4e36-8293-657eb15ca2ce req-9285b1c7-15e3-4e57-bc4e-e6ba79c92690 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3e6246d-c32a-490d-ba83-84b54822f971", "tag": "140cd909-abde-4ea9-89c0-b130f4264b5b"}, {"name": "network-changed", "server_uuid": "61d89bc7-fcfe-479b-baa1-7307a4395cc3", "tag": "8b90877b-3e97-4354-ad15-7327a7aa752b"}, {"name": "network-changed", "server_uuid": "61d89bc7-fcfe-479b-baa1-7307a4395cc3", "tag": "8b90877b-3e97-4354-ad15-7327a7aa752b"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:59:24.419126 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-def3b3ab-b61d-4e36-8293-657eb15ca2ce req-9285b1c7-15e3-4e57-bc4e-e6ba79c92690 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:24.419656 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-def3b3ab-b61d-4e36-8293-657eb15ca2ce req-9285b1c7-15e3-4e57-bc4e-e6ba79c92690 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:24.431638 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-94a58982-9105-4bd9-af69-f0ac3ccddf63 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:24.431638 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-94a58982-9105-4bd9-af69-f0ac3ccddf63 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:24.431638 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-94a58982-9105-4bd9-af69-f0ac3ccddf63 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:24.432057 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.objects.instance [None req-94a58982-9105-4bd9-af69-f0ac3ccddf63 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lazy-loading 'fault' on Instance uuid 7c5c7ad1-4e7b-427e-8f66-862cc9b2f457 {{(pid=138744) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 20:59:24.437339 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-def3b3ab-b61d-4e36-8293-657eb15ca2ce req-9285b1c7-15e3-4e57-bc4e-e6ba79c92690 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:24.469516 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-def3b3ab-b61d-4e36-8293-657eb15ca2ce req-9285b1c7-15e3-4e57-bc4e-e6ba79c92690 service nova] Creating event network-changed:140cd909-abde-4ea9-89c0-b130f4264b5b for instance c3e6246d-c32a-490d-ba83-84b54822f971 on nch2-master-1 Oct 22 20:59:24.470030 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-def3b3ab-b61d-4e36-8293-657eb15ca2ce req-9285b1c7-15e3-4e57-bc4e-e6ba79c92690 service nova] Creating event network-changed:8b90877b-3e97-4354-ad15-7327a7aa752b for instance 61d89bc7-fcfe-479b-baa1-7307a4395cc3 on nch1-master-1 Oct 22 20:59:24.470529 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-def3b3ab-b61d-4e36-8293-657eb15ca2ce req-9285b1c7-15e3-4e57-bc4e-e6ba79c92690 service nova] Creating event network-changed:8b90877b-3e97-4354-ad15-7327a7aa752b for instance 61d89bc7-fcfe-479b-baa1-7307a4395cc3 on nch1-master-1 Oct 22 20:59:24.479108 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [req-def3b3ab-b61d-4e36-8293-657eb15ca2ce req-9285b1c7-15e3-4e57-bc4e-e6ba79c92690 service nova] Instance c3e6246d-c32a-490d-ba83-84b54822f971 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=138745) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 22 20:59:24.537725 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-def3b3ab-b61d-4e36-8293-657eb15ca2ce req-9285b1c7-15e3-4e57-bc4e-e6ba79c92690 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 513 microversion: 2.1 time: 0.182147 Oct 22 20:59:24.539642 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1247/2334] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:59:24 2022] POST /compute/v2.1/os-server-external-events => generated 513 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:59:24.547856 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-39afe5bb-3297-4400-ba76-726927ca9a7b req-1b78c628-e4fb-4a66-bf57-3063fd6c78a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c5c7ad1-4e7b-427e-8f66-862cc9b2f457", "name": "network-vif-deleted", "tag": "058b5ead-f160-4367-a819-2697169cb3fa"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:59:24.565804 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-39afe5bb-3297-4400-ba76-726927ca9a7b req-1b78c628-e4fb-4a66-bf57-3063fd6c78a3 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:24.566711 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-39afe5bb-3297-4400-ba76-726927ca9a7b req-1b78c628-e4fb-4a66-bf57-3063fd6c78a3 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:24.567435 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-39afe5bb-3297-4400-ba76-726927ca9a7b req-1b78c628-e4fb-4a66-bf57-3063fd6c78a3 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:24.567828 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-94a58982-9105-4bd9-af69-f0ac3ccddf63 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dbe89a7e11480194d3d86f82983499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8351b01e07cd43f9be973ab45e522bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:59:24.592231 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-94a58982-9105-4bd9-af69-f0ac3ccddf63 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] 10.222.0.18 "GET /compute/v2.1/servers/7c5c7ad1-4e7b-427e-8f66-862cc9b2f457" status: 200 len: 1303 microversion: 2.1 time: 0.283493 Oct 22 20:59:24.617445 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1088/2335] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:59:24 2022] GET /compute/v2.1/servers/7c5c7ad1-4e7b-427e-8f66-862cc9b2f457 => generated 1303 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:59:24.626234 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-39afe5bb-3297-4400-ba76-726927ca9a7b req-1b78c628-e4fb-4a66-bf57-3063fd6c78a3 service nova] Creating event network-vif-deleted:058b5ead-f160-4367-a819-2697169cb3fa for instance 7c5c7ad1-4e7b-427e-8f66-862cc9b2f457 on nch2-master-1 Oct 22 20:59:24.635199 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-d6db9a85-be3c-433d-86bb-54316cc6fa59 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Action: 'create', calling method: .version_select at 0x7fd3a4051f70>, body: {"security_group": {"name": " tempest-securitygroup -1169124446 ", "description": "tempest-description-1447354459"}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:59:24.667922 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-39afe5bb-3297-4400-ba76-726927ca9a7b req-1b78c628-e4fb-4a66-bf57-3063fd6c78a3 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125947 Oct 22 20:59:24.670367 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1248/2336] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:59:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:59:24.690569 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-2c5b040e-1fb0-4e4e-b08e-3969aa590e57 tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:59:24.691397 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-2c5b040e-1fb0-4e4e-b08e-3969aa590e57 tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] [instance: ae58d60e-a113-4a38-94b5-b72a19c353e6] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:59:24.709237 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2c5b040e-1fb0-4e4e-b08e-3969aa590e57 tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:24.710677 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2c5b040e-1fb0-4e4e-b08e-3969aa590e57 tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:24.711166 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2c5b040e-1fb0-4e4e-b08e-3969aa590e57 tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:24.713828 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2c5b040e-1fb0-4e4e-b08e-3969aa590e57 tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:24.714275 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2c5b040e-1fb0-4e4e-b08e-3969aa590e57 tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:24.717820 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2c5b040e-1fb0-4e4e-b08e-3969aa590e57 tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:25.108729 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-2c5b040e-1fb0-4e4e-b08e-3969aa590e57 tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e36cd987f04f11b6a41325add4ccac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d79e903f8f24a348d5e771d434c70c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:59:25.126657 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-2c5b040e-1fb0-4e4e-b08e-3969aa590e57 tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] 10.222.0.18 "GET /compute/v2.1/servers/ae58d60e-a113-4a38-94b5-b72a19c353e6" status: 200 len: 1322 microversion: 2.1 time: 0.452419 Oct 22 20:59:25.127398 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1249/2337] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:59:24 2022] GET /compute/v2.1/servers/ae58d60e-a113-4a38-94b5-b72a19c353e6 => generated 1322 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:59:25.136392 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-9ea61b0b-1913-4170-9404-95287e96a654 tempest-FloatingIPDetailsTestJSON-1867523695 tempest-FloatingIPDetailsTestJSON-1867523695-project] Calling method '.version_select at 0x7fd3a466e5e0>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:59:25.618269 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-d6db9a85-be3c-433d-86bb-54316cc6fa59 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] 10.222.0.18 "POST /compute/v2.1/os-security-groups" status: 200 len: 224 microversion: 2.1 time: 0.999488 Oct 22 20:59:25.628870 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1089/2338] 10.222.0.18 () {60 vars in 1180 bytes} [Sat Oct 22 20:59:24 2022] POST /compute/v2.1/os-security-groups => generated 224 bytes in 1011 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:59:25.635561 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-0a33e3f6-65ec-4bfc-84c7-7c5b807cefb5 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:59:25.636489 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-0a33e3f6-65ec-4bfc-84c7-7c5b807cefb5 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] [instance: c3e6246d-c32a-490d-ba83-84b54822f971] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:59:25.649154 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0a33e3f6-65ec-4bfc-84c7-7c5b807cefb5 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:25.652150 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0a33e3f6-65ec-4bfc-84c7-7c5b807cefb5 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:25.652940 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0a33e3f6-65ec-4bfc-84c7-7c5b807cefb5 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:25.654571 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0a33e3f6-65ec-4bfc-84c7-7c5b807cefb5 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:25.657086 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0a33e3f6-65ec-4bfc-84c7-7c5b807cefb5 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:25.660275 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0a33e3f6-65ec-4bfc-84c7-7c5b807cefb5 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:25.917090 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-0a33e3f6-65ec-4bfc-84c7-7c5b807cefb5 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] 10.222.0.18 "POST /compute/v2.1/servers/c3e6246d-c32a-490d-ba83-84b54822f971/action" status: 202 len: 0 microversion: 2.1 time: 0.286468 Oct 22 20:59:25.920366 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1090/2339] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 20:59:25 2022] POST /compute/v2.1/servers/c3e6246d-c32a-490d-ba83-84b54822f971/action => generated 0 bytes in 291 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 20:59:25.957209 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-d6ba9c9f-0791-4134-88e8-a395ff028cfc tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:59:25.962458 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-d6ba9c9f-0791-4134-88e8-a395ff028cfc tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] [instance: 19465083-6d3a-485d-9101-950d9c45abaf] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:59:25.982219 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d6ba9c9f-0791-4134-88e8-a395ff028cfc tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:25.982873 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d6ba9c9f-0791-4134-88e8-a395ff028cfc tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:25.985510 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d6ba9c9f-0791-4134-88e8-a395ff028cfc tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:25.986623 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d6ba9c9f-0791-4134-88e8-a395ff028cfc tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:25.987943 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d6ba9c9f-0791-4134-88e8-a395ff028cfc tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:25.989838 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d6ba9c9f-0791-4134-88e8-a395ff028cfc tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:26.069434 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-d6ba9c9f-0791-4134-88e8-a395ff028cfc tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] [instance: 19465083-6d3a-485d-9101-950d9c45abaf] Going to try to terminate instance {{(pid=138744) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 20:59:26.224386 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-d6ba9c9f-0791-4134-88e8-a395ff028cfc tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] 10.222.0.18 "DELETE /compute/v2.1/servers/19465083-6d3a-485d-9101-950d9c45abaf" status: 204 len: 0 microversion: 2.1 time: 0.281943 Oct 22 20:59:26.226652 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1091/2340] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 20:59:25 2022] DELETE /compute/v2.1/servers/19465083-6d3a-485d-9101-950d9c45abaf => generated 0 bytes in 305 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 20:59:26.234404 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-4bc93479-8cc5-4f2a-9b37-55eb73bf809e tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:59:26.236058 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-4bc93479-8cc5-4f2a-9b37-55eb73bf809e tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] [instance: f38f14b2-b9d7-4bed-92ba-7b95ea4b2270] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:59:26.244968 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4bc93479-8cc5-4f2a-9b37-55eb73bf809e tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:26.245883 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4bc93479-8cc5-4f2a-9b37-55eb73bf809e tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:26.247037 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4bc93479-8cc5-4f2a-9b37-55eb73bf809e tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:26.248311 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4bc93479-8cc5-4f2a-9b37-55eb73bf809e tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:26.249051 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4bc93479-8cc5-4f2a-9b37-55eb73bf809e tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:26.249835 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4bc93479-8cc5-4f2a-9b37-55eb73bf809e tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:26.412088 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-9ea61b0b-1913-4170-9404-95287e96a654 tempest-FloatingIPDetailsTestJSON-1867523695 tempest-FloatingIPDetailsTestJSON-1867523695-project] 10.222.0.18 "GET /compute/v2.1/os-floating-ip-pools" status: 200 len: 43 microversion: 2.1 time: 1.283056 Oct 22 20:59:26.412572 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1250/2341] 10.222.0.18 () {58 vars in 1164 bytes} [Sat Oct 22 20:59:25 2022] GET /compute/v2.1/os-floating-ip-pools => generated 43 bytes in 1284 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 22 20:59:26.417513 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-20150a0c-64fb-4011-9353-91c0750b1e44 req-50dc7604-c16a-49ce-b38f-0f26529fef1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3e6246d-c32a-490d-ba83-84b54822f971", "name": "network-vif-plugged", "status": "completed", "tag": "140cd909-abde-4ea9-89c0-b130f4264b5b"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:59:26.446602 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-20150a0c-64fb-4011-9353-91c0750b1e44 req-50dc7604-c16a-49ce-b38f-0f26529fef1d service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:26.447123 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-20150a0c-64fb-4011-9353-91c0750b1e44 req-50dc7604-c16a-49ce-b38f-0f26529fef1d service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:26.447586 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-20150a0c-64fb-4011-9353-91c0750b1e44 req-50dc7604-c16a-49ce-b38f-0f26529fef1d service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:26.481583 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-20150a0c-64fb-4011-9353-91c0750b1e44 req-50dc7604-c16a-49ce-b38f-0f26529fef1d service nova] Creating event network-vif-plugged:140cd909-abde-4ea9-89c0-b130f4264b5b for instance c3e6246d-c32a-490d-ba83-84b54822f971 on nch2-master-1 Oct 22 20:59:26.505036 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [req-20150a0c-64fb-4011-9353-91c0750b1e44 req-50dc7604-c16a-49ce-b38f-0f26529fef1d service nova] Instance c3e6246d-c32a-490d-ba83-84b54822f971 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=138745) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 22 20:59:26.546237 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-20150a0c-64fb-4011-9353-91c0750b1e44 req-50dc7604-c16a-49ce-b38f-0f26529fef1d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132407 Oct 22 20:59:26.546868 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1251/2342] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:59:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:59:26.555619 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-5c65a0c4-f06d-4bed-9814-83d83becd8f8 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:59:26.556344 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-5c65a0c4-f06d-4bed-9814-83d83becd8f8 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] [instance: 7c5c7ad1-4e7b-427e-8f66-862cc9b2f457] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:59:26.560956 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-4bc93479-8cc5-4f2a-9b37-55eb73bf809e tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211483c6acea4f76b6c0e4bfc818e7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd687d54e07d4ab4af00ad801ef4b58d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:59:26.570195 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5c65a0c4-f06d-4bed-9814-83d83becd8f8 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:26.570670 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-4bc93479-8cc5-4f2a-9b37-55eb73bf809e tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '211483c6acea4f76b6c0e4bfc818e7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd687d54e07d4ab4af00ad801ef4b58d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:59:26.572971 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5c65a0c4-f06d-4bed-9814-83d83becd8f8 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:26.573447 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5c65a0c4-f06d-4bed-9814-83d83becd8f8 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:26.575893 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5c65a0c4-f06d-4bed-9814-83d83becd8f8 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:26.576509 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5c65a0c4-f06d-4bed-9814-83d83becd8f8 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:26.577324 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-4bc93479-8cc5-4f2a-9b37-55eb73bf809e tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '211483c6acea4f76b6c0e4bfc818e7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd687d54e07d4ab4af00ad801ef4b58d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:59:26.580139 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5c65a0c4-f06d-4bed-9814-83d83becd8f8 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:26.581383 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-4bc93479-8cc5-4f2a-9b37-55eb73bf809e tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] 10.222.0.18 "GET /compute/v2.1/servers/f38f14b2-b9d7-4bed-92ba-7b95ea4b2270" status: 200 len: 1660 microversion: 2.42 time: 0.352994 Oct 22 20:59:26.603737 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1092/2343] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 20:59:26 2022] GET /compute/v2.1/servers/f38f14b2-b9d7-4bed-92ba-7b95ea4b2270 => generated 1660 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 20:59:26.611308 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.wsgi [None req-5c65a0c4-f06d-4bed-9814-83d83becd8f8 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] HTTP exception thrown: Instance 7c5c7ad1-4e7b-427e-8f66-862cc9b2f457 could not be found. Oct 22 20:59:26.614648 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-40c6335a-8b25-4da5-b217-eb635ae7fcb5 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Calling method '.version_select at 0x7fd39f331d30>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:59:26.617273 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-5c65a0c4-f06d-4bed-9814-83d83becd8f8 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Request method failure captured: Oct 22 20:59:26.617273 ncdv-master-1 devstack@n-api.service[138745]: request: GET /compute/v2.1/servers/7c5c7ad1-4e7b-427e-8f66-862cc9b2f457 HTTP/1.1 Oct 22 20:59:26.617273 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 20:59:26.617273 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 20:59:26.617273 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 20:59:26.617273 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 0 Oct 22 20:59:26.617273 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 20:59:26.617273 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 20:59:26.617273 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 20:59:26.617273 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 20:59:26.617273 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVFkeCb43WeQtgp51X28RghffiPHU69OKuTacjjJieCoGY9zvHUBMakCXIpkUptlUnh9NPZ76FyJBq4xJSggLl9CrBFTTAqzkYVy7np9TorrKbA0E8UyGHTIO_6WcqkriAf39zPqVfQvV-3CUgMB4zly4miVW78IOGm6KefMgkaoycxc Oct 22 20:59:26.617273 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 20:59:26.617273 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 20:59:26.617273 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 20:59:26.617273 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 20:59:26.617273 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 20:59:26.617273 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 20:59:26.617273 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: 8351b01e07cd43f9be973ab45e522bf0 Oct 22 20:59:26.617273 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-ServersAdminTestJSON-1787327939 Oct 22 20:59:26.617273 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 20:59:26.617273 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 20:59:26.617273 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_8351b01e07cd43f9be973ab45e522bf0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8351b01e07cd43f9be973ab45e522bf0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/8351b01e07cd43f9be973ab45e522bf0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8351b01e07cd43f9be973ab45e522bf0"}]}] Oct 22 20:59:26.617273 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-ServersAdminTestJSON-1787327939 Oct 22 20:59:26.617273 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: 8351b01e07cd43f9be973ab45e522bf0 Oct 22 20:59:26.617273 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-ServersAdminTestJSON-1787327939 Oct 22 20:59:26.617273 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-ServersAdminTestJSON-1787327939-project Oct 22 20:59:26.617273 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 20:59:26.617273 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 20:59:26.617273 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: 57dbe89a7e11480194d3d86f82983499 Oct 22 20:59:26.617273 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-ServersAdminTestJSON-1787327939-project Oct 22 20:59:26.617273 ncdv-master-1 devstack@n-api.service[138745]: method: > Oct 22 20:59:26.617273 ncdv-master-1 devstack@n-api.service[138745]: exception: Instance 7c5c7ad1-4e7b-427e-8f66-862cc9b2f457 could not be found. Oct 22 20:59:26.617273 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'id': '7c5c7ad1-4e7b-427e-8f66-862cc9b2f457'} Oct 22 20:59:26.617273 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:59:26.617273 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:59:26.617273 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 20:59:26.617273 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 20:59:26.617273 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 20:59:26.617273 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 20:59:26.617273 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 20:59:26.617273 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 20:59:26.617273 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 20:59:26.617273 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 20:59:26.617273 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c5c7ad1-4e7b-427e-8f66-862cc9b2f457 could not be found. Oct 22 20:59:26.617273 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:59:26.617273 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:59:26.617273 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:59:26.617273 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:59:26.617273 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:59:26.617273 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:59:26.617273 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:59:26.617273 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:59:26.617273 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:59:26.617273 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:59:26.617273 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 20:59:26.617273 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 20:59:26.617273 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 20:59:26.617273 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 20:59:26.617273 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 20:59:26.617273 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 20:59:26.617273 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c5c7ad1-4e7b-427e-8f66-862cc9b2f457 could not be found. Oct 22 20:59:26.617273 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:59:26.617273 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:59:26.617273 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:59:26.622250 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:59:26.622250 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:59:26.622250 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:59:26.622250 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 20:59:26.622250 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 20:59:26.622250 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c5c7ad1-4e7b-427e-8f66-862cc9b2f457 could not be found. Oct 22 20:59:26.622250 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:59:26.622250 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-5c65a0c4-f06d-4bed-9814-83d83becd8f8 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Returning 404 to user: Instance 7c5c7ad1-4e7b-427e-8f66-862cc9b2f457 could not be found. {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:59:26.622250 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-5c65a0c4-f06d-4bed-9814-83d83becd8f8 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] 10.222.0.18 "GET /compute/v2.1/servers/7c5c7ad1-4e7b-427e-8f66-862cc9b2f457" status: 404 len: 111 microversion: 2.1 time: 0.067783 Oct 22 20:59:26.622250 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1252/2344] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:59:26 2022] GET /compute/v2.1/servers/7c5c7ad1-4e7b-427e-8f66-862cc9b2f457 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 20:59:26.631124 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-57ba96bf-c546-4e05-abf6-a5832fc5bcb4 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:59:26.651450 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-57ba96bf-c546-4e05-abf6-a5832fc5bcb4 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] [instance: c3e6246d-c32a-490d-ba83-84b54822f971] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:59:26.669397 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-57ba96bf-c546-4e05-abf6-a5832fc5bcb4 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:26.670114 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-57ba96bf-c546-4e05-abf6-a5832fc5bcb4 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:26.670603 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-57ba96bf-c546-4e05-abf6-a5832fc5bcb4 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:26.671429 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-57ba96bf-c546-4e05-abf6-a5832fc5bcb4 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:26.671908 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-57ba96bf-c546-4e05-abf6-a5832fc5bcb4 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:26.672350 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-57ba96bf-c546-4e05-abf6-a5832fc5bcb4 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:26.929874 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-40c6335a-8b25-4da5-b217-eb635ae7fcb5 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] 10.222.0.18 "GET /compute/v2.1/os-security-groups/47204768-cbb0-4674-8079-d3d8252cc4df" status: 200 len: 224 microversion: 2.1 time: 0.324910 Oct 22 20:59:26.931674 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1093/2345] 10.222.0.18 () {58 vars in 1269 bytes} [Sat Oct 22 20:59:26 2022] GET /compute/v2.1/os-security-groups/47204768-cbb0-4674-8079-d3d8252cc4df => generated 224 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:59:26.937042 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-5695b2df-473b-48f2-8953-c395cb1b390c tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:59:26.938110 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-5695b2df-473b-48f2-8953-c395cb1b390c tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] [instance: ae58d60e-a113-4a38-94b5-b72a19c353e6] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:59:26.946759 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5695b2df-473b-48f2-8953-c395cb1b390c tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:26.947806 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5695b2df-473b-48f2-8953-c395cb1b390c tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:26.948421 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5695b2df-473b-48f2-8953-c395cb1b390c tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:26.949315 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5695b2df-473b-48f2-8953-c395cb1b390c tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:26.950019 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5695b2df-473b-48f2-8953-c395cb1b390c tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:26.950608 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5695b2df-473b-48f2-8953-c395cb1b390c tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:26.999854 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-57ba96bf-c546-4e05-abf6-a5832fc5bcb4 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d3d7458af447bdb3f03e83a2d8559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49238b8686d24ae698679e4a1957735d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:59:27.008266 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-57ba96bf-c546-4e05-abf6-a5832fc5bcb4 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] 10.222.0.18 "GET /compute/v2.1/servers/c3e6246d-c32a-490d-ba83-84b54822f971" status: 200 len: 1469 microversion: 2.1 time: 0.384123 Oct 22 20:59:27.009435 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1253/2346] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:59:26 2022] GET /compute/v2.1/servers/c3e6246d-c32a-490d-ba83-84b54822f971 => generated 1469 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:59:27.014210 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-a3758f18-1952-45d5-a151-f3616bcc3b6c tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:59:27.015382 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-a3758f18-1952-45d5-a151-f3616bcc3b6c tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] [instance: 19465083-6d3a-485d-9101-950d9c45abaf] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:59:27.022023 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a3758f18-1952-45d5-a151-f3616bcc3b6c tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:27.022707 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a3758f18-1952-45d5-a151-f3616bcc3b6c tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:27.023286 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a3758f18-1952-45d5-a151-f3616bcc3b6c tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:27.024241 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a3758f18-1952-45d5-a151-f3616bcc3b6c tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:27.024876 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a3758f18-1952-45d5-a151-f3616bcc3b6c tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:27.025488 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a3758f18-1952-45d5-a151-f3616bcc3b6c tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:27.287647 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-5695b2df-473b-48f2-8953-c395cb1b390c tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e36cd987f04f11b6a41325add4ccac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d79e903f8f24a348d5e771d434c70c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:59:27.296239 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-5695b2df-473b-48f2-8953-c395cb1b390c tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] 10.222.0.18 "GET /compute/v2.1/servers/ae58d60e-a113-4a38-94b5-b72a19c353e6" status: 200 len: 1516 microversion: 2.1 time: 0.363286 Oct 22 20:59:27.296836 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1094/2347] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:59:26 2022] GET /compute/v2.1/servers/ae58d60e-a113-4a38-94b5-b72a19c353e6 => generated 1516 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:59:27.302069 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-f76e9866-7331-43b6-8e31-17178518186f tempest-FloatingIPDetailsTestJSON-1867523695 tempest-FloatingIPDetailsTestJSON-1867523695-project] Calling method '.version_select at 0x7fd3a4248040>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:59:27.330880 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-a3758f18-1952-45d5-a151-f3616bcc3b6c tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb8017457354ed68be65cb426965cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af194191cdc4b34a470c821a932e2fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:59:27.345799 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-a3758f18-1952-45d5-a151-f3616bcc3b6c tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] 10.222.0.18 "GET /compute/v2.1/servers/19465083-6d3a-485d-9101-950d9c45abaf" status: 200 len: 1698 microversion: 2.1 time: 0.334787 Oct 22 20:59:27.347151 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1254/2348] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:59:27 2022] GET /compute/v2.1/servers/19465083-6d3a-485d-9101-950d9c45abaf => generated 1698 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:59:27.353806 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-9598a866-9214-4539-997e-e98a1717ab8c tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:59:27.354458 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-9598a866-9214-4539-997e-e98a1717ab8c tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] [instance: f070b144-3a1a-4456-8e5b-02af12557c6a] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:59:27.362380 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9598a866-9214-4539-997e-e98a1717ab8c tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:27.363072 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9598a866-9214-4539-997e-e98a1717ab8c tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:27.363777 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9598a866-9214-4539-997e-e98a1717ab8c tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:27.364891 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9598a866-9214-4539-997e-e98a1717ab8c tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:27.365755 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9598a866-9214-4539-997e-e98a1717ab8c tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:27.366446 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9598a866-9214-4539-997e-e98a1717ab8c tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:27.390935 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell1:SELECT=100 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:59:27.400726 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-9598a866-9214-4539-997e-e98a1717ab8c tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] [instance: f070b144-3a1a-4456-8e5b-02af12557c6a] Going to try to terminate instance {{(pid=138745) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 20:59:27.496351 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-9598a866-9214-4539-997e-e98a1717ab8c tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] 10.222.0.18 "DELETE /compute/v2.1/servers/f070b144-3a1a-4456-8e5b-02af12557c6a" status: 204 len: 0 microversion: 2.1 time: 0.147469 Oct 22 20:59:27.497318 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1255/2349] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 20:59:27 2022] DELETE /compute/v2.1/servers/f070b144-3a1a-4456-8e5b-02af12557c6a => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 20:59:27.503873 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-de276fb5-fda9-4dba-862e-33bb007380d2 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Calling method '.version_select at 0x7fd3a4464d30>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:59:28.108827 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-f76e9866-7331-43b6-8e31-17178518186f tempest-FloatingIPDetailsTestJSON-1867523695 tempest-FloatingIPDetailsTestJSON-1867523695-project] 10.222.0.18 "GET /compute/v2.1/os-floating-ips" status: 200 len: 397 microversion: 2.1 time: 0.810389 Oct 22 20:59:28.112379 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1095/2350] 10.222.0.18 () {58 vars in 1149 bytes} [Sat Oct 22 20:59:27 2022] GET /compute/v2.1/os-floating-ips => generated 397 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:59:28.118482 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-2be55299-d3ef-4a53-b06a-0ee4a542693e tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:59:28.133387 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-2be55299-d3ef-4a53-b06a-0ee4a542693e tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] [instance: ae58d60e-a113-4a38-94b5-b72a19c353e6] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:59:28.145550 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2be55299-d3ef-4a53-b06a-0ee4a542693e tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:28.146295 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2be55299-d3ef-4a53-b06a-0ee4a542693e tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:28.147272 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2be55299-d3ef-4a53-b06a-0ee4a542693e tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:28.148212 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2be55299-d3ef-4a53-b06a-0ee4a542693e tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:28.148727 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2be55299-d3ef-4a53-b06a-0ee4a542693e tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:28.149384 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2be55299-d3ef-4a53-b06a-0ee4a542693e tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:28.185427 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.objects.instance [None req-2be55299-d3ef-4a53-b06a-0ee4a542693e tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Lazy-loading 'flavor' on Instance uuid ae58d60e-a113-4a38-94b5-b72a19c353e6 {{(pid=138744) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 20:59:28.250247 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:59:28.262989 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-de276fb5-fda9-4dba-862e-33bb007380d2 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/47204768-cbb0-4674-8079-d3d8252cc4df" status: 202 len: 0 microversion: 2.1 time: 0.763867 Oct 22 20:59:28.264322 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1256/2351] 10.222.0.18 () {58 vars in 1272 bytes} [Sat Oct 22 20:59:27 2022] DELETE /compute/v2.1/os-security-groups/47204768-cbb0-4674-8079-d3d8252cc4df => generated 0 bytes in 766 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 20:59:28.273358 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-e10364c9-8d94-4789-b663-cddeb50708cf tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:59:28.275295 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-e10364c9-8d94-4789-b663-cddeb50708cf tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] [instance: f070b144-3a1a-4456-8e5b-02af12557c6a] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:59:28.295561 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e10364c9-8d94-4789-b663-cddeb50708cf tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:28.296434 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e10364c9-8d94-4789-b663-cddeb50708cf tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:28.297102 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e10364c9-8d94-4789-b663-cddeb50708cf tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:28.298094 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e10364c9-8d94-4789-b663-cddeb50708cf tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:28.298658 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e10364c9-8d94-4789-b663-cddeb50708cf tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:28.301639 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e10364c9-8d94-4789-b663-cddeb50708cf tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:28.365723 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-2be55299-d3ef-4a53-b06a-0ee4a542693e tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] 10.222.0.18 "POST /compute/v2.1/servers/ae58d60e-a113-4a38-94b5-b72a19c353e6/action" status: 200 len: 32 microversion: 2.1 time: 0.251409 Oct 22 20:59:28.371699 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1096/2352] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 20:59:28 2022] POST /compute/v2.1/servers/ae58d60e-a113-4a38-94b5-b72a19c353e6/action => generated 32 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 22 20:59:28.378068 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-fa7483b5-7e87-4715-a53b-670681e76502 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:59:28.378920 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-fa7483b5-7e87-4715-a53b-670681e76502 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] [instance: f38f14b2-b9d7-4bed-92ba-7b95ea4b2270] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:59:28.385943 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fa7483b5-7e87-4715-a53b-670681e76502 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:28.386729 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fa7483b5-7e87-4715-a53b-670681e76502 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:28.387374 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fa7483b5-7e87-4715-a53b-670681e76502 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:28.388345 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fa7483b5-7e87-4715-a53b-670681e76502 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:28.389012 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fa7483b5-7e87-4715-a53b-670681e76502 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:28.389627 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fa7483b5-7e87-4715-a53b-670681e76502 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:28.629969 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell0:SELECT=6 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:59:28.689721 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-e10364c9-8d94-4789-b663-cddeb50708cf tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dbe89a7e11480194d3d86f82983499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8351b01e07cd43f9be973ab45e522bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:59:28.697622 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-fa7483b5-7e87-4715-a53b-670681e76502 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211483c6acea4f76b6c0e4bfc818e7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd687d54e07d4ab4af00ad801ef4b58d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:59:28.714163 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-e10364c9-8d94-4789-b663-cddeb50708cf tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] 10.222.0.18 "GET /compute/v2.1/servers/f070b144-3a1a-4456-8e5b-02af12557c6a" status: 200 len: 1469 microversion: 2.1 time: 0.448363 Oct 22 20:59:28.714978 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1257/2353] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:59:28 2022] GET /compute/v2.1/servers/f070b144-3a1a-4456-8e5b-02af12557c6a => generated 1469 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:59:28.715096 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-fa7483b5-7e87-4715-a53b-670681e76502 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '211483c6acea4f76b6c0e4bfc818e7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd687d54e07d4ab4af00ad801ef4b58d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:59:28.716506 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-fa7483b5-7e87-4715-a53b-670681e76502 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '211483c6acea4f76b6c0e4bfc818e7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd687d54e07d4ab4af00ad801ef4b58d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:59:28.718626 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-fa7483b5-7e87-4715-a53b-670681e76502 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] 10.222.0.18 "GET /compute/v2.1/servers/f38f14b2-b9d7-4bed-92ba-7b95ea4b2270" status: 200 len: 1706 microversion: 2.42 time: 0.345417 Oct 22 20:59:28.731366 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1097/2354] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 20:59:28 2022] GET /compute/v2.1/servers/f38f14b2-b9d7-4bed-92ba-7b95ea4b2270 => generated 1706 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 20:59:28.732090 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-831cec0c-1123-466d-843f-23cc63ef11ea tempest-FloatingIPDetailsTestJSON-1867523695 tempest-FloatingIPDetailsTestJSON-1867523695-project] Calling method '.version_select at 0x7fd3a4248940>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:59:28.734680 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-3731b6aa-2043-47a3-b448-7c3d6a35be54 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:59:28.741408 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-3731b6aa-2043-47a3-b448-7c3d6a35be54 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] [instance: c3e6246d-c32a-490d-ba83-84b54822f971] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:59:28.750694 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3731b6aa-2043-47a3-b448-7c3d6a35be54 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:28.751410 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3731b6aa-2043-47a3-b448-7c3d6a35be54 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:28.752354 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3731b6aa-2043-47a3-b448-7c3d6a35be54 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:28.754100 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3731b6aa-2043-47a3-b448-7c3d6a35be54 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:28.754719 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3731b6aa-2043-47a3-b448-7c3d6a35be54 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:28.755308 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3731b6aa-2043-47a3-b448-7c3d6a35be54 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:29.338747 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-3731b6aa-2043-47a3-b448-7c3d6a35be54 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d3d7458af447bdb3f03e83a2d8559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49238b8686d24ae698679e4a1957735d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:59:29.347168 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-3731b6aa-2043-47a3-b448-7c3d6a35be54 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] 10.222.0.18 "GET /compute/v2.1/servers/c3e6246d-c32a-490d-ba83-84b54822f971" status: 200 len: 1469 microversion: 2.1 time: 0.630788 Oct 22 20:59:29.357522 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1258/2355] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:59:28 2022] GET /compute/v2.1/servers/c3e6246d-c32a-490d-ba83-84b54822f971 => generated 1469 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:59:29.357522 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-8d7d40b9-21dd-4803-ae8b-8702813ea9e0 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Calling method '.version_select at 0x7fd39fc83c10>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:59:29.502103 ncdv-master-1 devstack@n-api.service[138745]: DEBUG neutronclient.v2_0.client [None req-8d7d40b9-21dd-4803-ae8b-8702813ea9e0 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 47204768-cbb0-4674-8079-d3d8252cc4df does not exist", "detail": ""}} {{(pid=138745) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 22 20:59:29.502834 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.network.security_group_api [None req-8d7d40b9-21dd-4803-ae8b-8702813ea9e0 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Neutron security group 47204768-cbb0-4674-8079-d3d8252cc4df not found {{(pid=138745) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 22 20:59:29.503508 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.wsgi [None req-8d7d40b9-21dd-4803-ae8b-8702813ea9e0 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] HTTP exception thrown: Security group 47204768-cbb0-4674-8079-d3d8252cc4df does not exist Oct 22 20:59:29.503508 ncdv-master-1 devstack@n-api.service[138745]: Neutron server returns request_ids: ['req-ea10fb49-993a-4c54-9e19-7b95355ad1f8'] Oct 22 20:59:29.505683 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-8d7d40b9-21dd-4803-ae8b-8702813ea9e0 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Request method failure captured: Oct 22 20:59:29.505683 ncdv-master-1 devstack@n-api.service[138745]: request: GET /compute/v2.1/os-security-groups/47204768-cbb0-4674-8079-d3d8252cc4df HTTP/1.1 Oct 22 20:59:29.505683 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 20:59:29.505683 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 20:59:29.505683 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 20:59:29.505683 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 0 Oct 22 20:59:29.505683 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 20:59:29.505683 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 20:59:29.505683 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 20:59:29.505683 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 20:59:29.505683 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVFmMTFo8tMXHI466ygTiy0jTs5kz8YO2nFuimSyZRJI5bXNUfHpPLWjQrXyJ7I9Xfc54HQRfYflULj68lfwBk5jrnjY79oZ1kbdK55vumR_IVvMJmaykrPjWliG3H4xf-SZHnU3invPEATeZO7VP5aTca0hd9BauSvYCW1UPdVAZZ70 Oct 22 20:59:29.505683 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 20:59:29.505683 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 20:59:29.505683 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 20:59:29.505683 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 20:59:29.505683 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 20:59:29.505683 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 20:59:29.505683 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: ed31e93b0e8a43f28e497f94318815ce Oct 22 20:59:29.505683 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-SecurityGroupsTestJSON-1604956559 Oct 22 20:59:29.505683 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 20:59:29.505683 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 20:59:29.505683 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ed31e93b0e8a43f28e497f94318815ce"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ed31e93b0e8a43f28e497f94318815ce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ed31e93b0e8a43f28e497f94318815ce"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ed31e93b0e8a43f28e497f94318815ce"}]}] Oct 22 20:59:29.505683 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-SecurityGroupsTestJSON-1604956559 Oct 22 20:59:29.505683 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: ed31e93b0e8a43f28e497f94318815ce Oct 22 20:59:29.505683 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1604956559 Oct 22 20:59:29.505683 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-SecurityGroupsTestJSON-1604956559-project Oct 22 20:59:29.505683 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 20:59:29.505683 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 20:59:29.505683 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: 46d49952dbca4d95a25411b65d56552b Oct 22 20:59:29.505683 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-SecurityGroupsTestJSON-1604956559-project Oct 22 20:59:29.505683 ncdv-master-1 devstack@n-api.service[138745]: method: Oct 22 20:59:29.505683 ncdv-master-1 devstack@n-api.service[138745]: exception: Security group 47204768-cbb0-4674-8079-d3d8252cc4df does not exist Oct 22 20:59:29.505683 ncdv-master-1 devstack@n-api.service[138745]: Neutron server returns request_ids: ['req-ea10fb49-993a-4c54-9e19-7b95355ad1f8'] Oct 22 20:59:29.505683 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'id': '47204768-cbb0-4674-8079-d3d8252cc4df'} Oct 22 20:59:29.505683 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:59:29.505683 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:59:29.505683 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 22 20:59:29.505683 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 22 20:59:29.505683 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 20:59:29.505683 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 20:59:29.505683 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 22 20:59:29.505683 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 22 20:59:29.505683 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 20:59:29.505683 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 20:59:29.505683 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 22 20:59:29.505683 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 22 20:59:29.505683 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 20:59:29.505683 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 20:59:29.505683 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 22 20:59:29.505683 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 22 20:59:29.505683 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 20:59:29.505683 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 20:59:29.505683 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 22 20:59:29.505683 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 22 20:59:29.505683 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 20:59:29.505683 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 20:59:29.505683 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 22 20:59:29.505683 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 22 20:59:29.505683 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 22 20:59:29.505683 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 22 20:59:29.505683 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 47204768-cbb0-4674-8079-d3d8252cc4df does not exist Oct 22 20:59:29.509366 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ea10fb49-993a-4c54-9e19-7b95355ad1f8'] Oct 22 20:59:29.509366 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:59:29.509366 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:59:29.509366 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:59:29.509366 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:59:29.509366 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 22 20:59:29.509366 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 22 20:59:29.509366 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 22 20:59:29.509366 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 22 20:59:29.509366 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 47204768-cbb0-4674-8079-d3d8252cc4df does not exist Oct 22 20:59:29.509366 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ea10fb49-993a-4c54-9e19-7b95355ad1f8'] Oct 22 20:59:29.509366 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:59:29.509366 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:59:29.509366 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:59:29.509366 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:59:29.509366 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:59:29.509366 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:59:29.509366 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:59:29.509366 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:59:29.509366 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 22 20:59:29.509366 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 22 20:59:29.509366 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:59:29.509366 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:59:29.509366 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 22 20:59:29.509366 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 22 20:59:29.509366 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 47204768-cbb0-4674-8079-d3d8252cc4df does not exist Oct 22 20:59:29.509366 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ea10fb49-993a-4c54-9e19-7b95355ad1f8'] Oct 22 20:59:29.509366 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:59:29.509366 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:59:29.509366 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:59:29.509366 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:59:29.509366 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:59:29.509366 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:59:29.509366 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 20:59:29.509366 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 20:59:29.509366 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 47204768-cbb0-4674-8079-d3d8252cc4df does not exist Oct 22 20:59:29.509366 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ea10fb49-993a-4c54-9e19-7b95355ad1f8'] Oct 22 20:59:29.509366 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:59:29.514392 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-8d7d40b9-21dd-4803-ae8b-8702813ea9e0 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Returning 404 to user: Security group 47204768-cbb0-4674-8079-d3d8252cc4df does not exist Oct 22 20:59:29.514392 ncdv-master-1 devstack@n-api.service[138745]: Neutron server returns request_ids: ['req-ea10fb49-993a-4c54-9e19-7b95355ad1f8'] {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:59:29.515930 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-8d7d40b9-21dd-4803-ae8b-8702813ea9e0 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] 10.222.0.18 "GET /compute/v2.1/os-security-groups/47204768-cbb0-4674-8079-d3d8252cc4df" status: 404 len: 194 microversion: 2.1 time: 0.166832 Oct 22 20:59:29.516786 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1259/2356] 10.222.0.18 () {58 vars in 1269 bytes} [Sat Oct 22 20:59:29 2022] GET /compute/v2.1/os-security-groups/47204768-cbb0-4674-8079-d3d8252cc4df => generated 194 bytes in 168 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 20:59:29.525815 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-3613cd9e-cdf6-4a03-a8e5-200180b9bbe2 tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:59:29.526423 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-3613cd9e-cdf6-4a03-a8e5-200180b9bbe2 tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] [instance: 19465083-6d3a-485d-9101-950d9c45abaf] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:59:29.580158 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3613cd9e-cdf6-4a03-a8e5-200180b9bbe2 tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:29.584369 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3613cd9e-cdf6-4a03-a8e5-200180b9bbe2 tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:29.586052 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3613cd9e-cdf6-4a03-a8e5-200180b9bbe2 tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:29.588035 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3613cd9e-cdf6-4a03-a8e5-200180b9bbe2 tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:29.588713 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3613cd9e-cdf6-4a03-a8e5-200180b9bbe2 tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:29.589164 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3613cd9e-cdf6-4a03-a8e5-200180b9bbe2 tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:30.187033 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-3613cd9e-cdf6-4a03-a8e5-200180b9bbe2 tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb8017457354ed68be65cb426965cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af194191cdc4b34a470c821a932e2fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:59:30.198906 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-3613cd9e-cdf6-4a03-a8e5-200180b9bbe2 tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] 10.222.0.18 "GET /compute/v2.1/servers/19465083-6d3a-485d-9101-950d9c45abaf" status: 200 len: 1698 microversion: 2.1 time: 0.676799 Oct 22 20:59:30.218852 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1260/2357] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:59:29 2022] GET /compute/v2.1/servers/19465083-6d3a-485d-9101-950d9c45abaf => generated 1698 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:59:30.226231 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-f9c35ddb-6889-4c32-a3e4-97150abecb67 tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:59:30.228527 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-f9c35ddb-6889-4c32-a3e4-97150abecb67 tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] [instance: ae58d60e-a113-4a38-94b5-b72a19c353e6] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:59:30.237258 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f9c35ddb-6889-4c32-a3e4-97150abecb67 tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:30.242805 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f9c35ddb-6889-4c32-a3e4-97150abecb67 tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:30.243267 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f9c35ddb-6889-4c32-a3e4-97150abecb67 tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:30.244074 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f9c35ddb-6889-4c32-a3e4-97150abecb67 tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:30.244536 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f9c35ddb-6889-4c32-a3e4-97150abecb67 tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:30.244971 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f9c35ddb-6889-4c32-a3e4-97150abecb67 tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:30.580548 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell0:SELECT=4 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:59:30.760927 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-f9c35ddb-6889-4c32-a3e4-97150abecb67 tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e36cd987f04f11b6a41325add4ccac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d79e903f8f24a348d5e771d434c70c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:59:30.770862 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-f9c35ddb-6889-4c32-a3e4-97150abecb67 tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] 10.222.0.18 "GET /compute/v2.1/servers/ae58d60e-a113-4a38-94b5-b72a19c353e6" status: 200 len: 1522 microversion: 2.1 time: 0.550537 Oct 22 20:59:30.784575 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1261/2358] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:59:30 2022] GET /compute/v2.1/servers/ae58d60e-a113-4a38-94b5-b72a19c353e6 => generated 1522 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:59:30.785026 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-ccbbce9a-820d-41e1-9bba-b4e18133256b tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Action: 'create', calling method: .version_select at 0x7fd3a41184c0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-290405083", "description": "tempest-description-593639620"}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:59:31.584209 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell0:SELECT=2 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:59:31.667755 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell0:SELECT=2 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:59:32.105917 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-831cec0c-1123-466d-843f-23cc63ef11ea tempest-FloatingIPDetailsTestJSON-1867523695 tempest-FloatingIPDetailsTestJSON-1867523695-project] 10.222.0.18 "DELETE /compute/v2.1/os-floating-ips/2e7430c0-0d6e-449d-ada3-8df1ac7bff40" status: 202 len: 0 microversion: 2.1 time: 3.385171 Oct 22 20:59:32.106880 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1098/2359] 10.222.0.18 () {58 vars in 1263 bytes} [Sat Oct 22 20:59:28 2022] DELETE /compute/v2.1/os-floating-ips/2e7430c0-0d6e-449d-ada3-8df1ac7bff40 => generated 0 bytes in 3387 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 20:59:32.112162 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-f1d6aa23-2761-47d4-9395-e69e0f53e91a tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:59:32.113061 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-f1d6aa23-2761-47d4-9395-e69e0f53e91a tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] [instance: f070b144-3a1a-4456-8e5b-02af12557c6a] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:59:32.120110 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f1d6aa23-2761-47d4-9395-e69e0f53e91a tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:32.120989 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f1d6aa23-2761-47d4-9395-e69e0f53e91a tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:32.121641 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f1d6aa23-2761-47d4-9395-e69e0f53e91a tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:32.122621 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f1d6aa23-2761-47d4-9395-e69e0f53e91a tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:32.123439 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f1d6aa23-2761-47d4-9395-e69e0f53e91a tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:32.124070 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f1d6aa23-2761-47d4-9395-e69e0f53e91a tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:32.164125 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f1d6aa23-2761-47d4-9395-e69e0f53e91a tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:32.164964 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f1d6aa23-2761-47d4-9395-e69e0f53e91a tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:32.166124 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f1d6aa23-2761-47d4-9395-e69e0f53e91a tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:32.166795 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.objects.instance [None req-f1d6aa23-2761-47d4-9395-e69e0f53e91a tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lazy-loading 'fault' on Instance uuid f070b144-3a1a-4456-8e5b-02af12557c6a {{(pid=138744) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 20:59:32.237234 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-f1d6aa23-2761-47d4-9395-e69e0f53e91a tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dbe89a7e11480194d3d86f82983499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8351b01e07cd43f9be973ab45e522bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:59:32.271121 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-f1d6aa23-2761-47d4-9395-e69e0f53e91a tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] 10.222.0.18 "GET /compute/v2.1/servers/f070b144-3a1a-4456-8e5b-02af12557c6a" status: 200 len: 1303 microversion: 2.1 time: 0.162856 Oct 22 20:59:32.272733 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1099/2360] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:59:32 2022] GET /compute/v2.1/servers/f070b144-3a1a-4456-8e5b-02af12557c6a => generated 1303 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:59:32.293927 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-87ff8d97-dfc6-4cf7-b9c7-8fcb0d1caa4f tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:59:32.294887 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-87ff8d97-dfc6-4cf7-b9c7-8fcb0d1caa4f tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] [instance: f38f14b2-b9d7-4bed-92ba-7b95ea4b2270] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:59:32.312305 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-87ff8d97-dfc6-4cf7-b9c7-8fcb0d1caa4f tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:32.313424 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-87ff8d97-dfc6-4cf7-b9c7-8fcb0d1caa4f tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:32.314841 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-87ff8d97-dfc6-4cf7-b9c7-8fcb0d1caa4f tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:32.317394 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-87ff8d97-dfc6-4cf7-b9c7-8fcb0d1caa4f tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:32.318179 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-87ff8d97-dfc6-4cf7-b9c7-8fcb0d1caa4f tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:32.321061 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-87ff8d97-dfc6-4cf7-b9c7-8fcb0d1caa4f tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:32.329693 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-ccbbce9a-820d-41e1-9bba-b4e18133256b tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] 10.222.0.18 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 1.548636 Oct 22 20:59:32.330309 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1262/2361] 10.222.0.18 () {60 vars in 1180 bytes} [Sat Oct 22 20:59:30 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 1550 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:59:32.336246 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-eeab2a51-f86c-4693-90f7-4a7968e9b0d2 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:59:32.337138 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-eeab2a51-f86c-4693-90f7-4a7968e9b0d2 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] [instance: c3e6246d-c32a-490d-ba83-84b54822f971] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:59:32.356244 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-eeab2a51-f86c-4693-90f7-4a7968e9b0d2 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:32.356960 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-eeab2a51-f86c-4693-90f7-4a7968e9b0d2 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:32.357969 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-eeab2a51-f86c-4693-90f7-4a7968e9b0d2 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:32.358919 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-eeab2a51-f86c-4693-90f7-4a7968e9b0d2 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:32.365500 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-eeab2a51-f86c-4693-90f7-4a7968e9b0d2 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:32.366130 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-eeab2a51-f86c-4693-90f7-4a7968e9b0d2 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:32.841278 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-87ff8d97-dfc6-4cf7-b9c7-8fcb0d1caa4f tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211483c6acea4f76b6c0e4bfc818e7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd687d54e07d4ab4af00ad801ef4b58d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:59:32.858441 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-87ff8d97-dfc6-4cf7-b9c7-8fcb0d1caa4f tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '211483c6acea4f76b6c0e4bfc818e7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd687d54e07d4ab4af00ad801ef4b58d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:59:32.861189 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-87ff8d97-dfc6-4cf7-b9c7-8fcb0d1caa4f tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '211483c6acea4f76b6c0e4bfc818e7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd687d54e07d4ab4af00ad801ef4b58d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:59:32.862934 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-87ff8d97-dfc6-4cf7-b9c7-8fcb0d1caa4f tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] 10.222.0.18 "GET /compute/v2.1/servers/f38f14b2-b9d7-4bed-92ba-7b95ea4b2270" status: 200 len: 1752 microversion: 2.42 time: 0.586985 Oct 22 20:59:32.864169 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1100/2362] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 20:59:32 2022] GET /compute/v2.1/servers/f38f14b2-b9d7-4bed-92ba-7b95ea4b2270 => generated 1752 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 20:59:32.881736 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-eeab2a51-f86c-4693-90f7-4a7968e9b0d2 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d3d7458af447bdb3f03e83a2d8559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49238b8686d24ae698679e4a1957735d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:59:32.887688 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-eeab2a51-f86c-4693-90f7-4a7968e9b0d2 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] 10.222.0.18 "GET /compute/v2.1/servers/c3e6246d-c32a-490d-ba83-84b54822f971" status: 200 len: 1469 microversion: 2.1 time: 0.555756 Oct 22 20:59:32.900089 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1263/2363] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:59:32 2022] GET /compute/v2.1/servers/c3e6246d-c32a-490d-ba83-84b54822f971 => generated 1469 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:59:32.906565 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-ac817de9-a89d-41c1-8467-35b7ae4c3c8f tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:59:32.907254 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-ac817de9-a89d-41c1-8467-35b7ae4c3c8f tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] [instance: 19465083-6d3a-485d-9101-950d9c45abaf] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:59:32.914998 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-c0f4dd08-514a-42fa-b6a5-0a69e00f18c8 req-cc1b07f2-3896-4f7f-90c6-11d68ce17fc1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f070b144-3a1a-4456-8e5b-02af12557c6a", "name": "network-vif-deleted", "tag": "9c49ccea-f5ad-47be-9a9c-61df2a8933d5"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:59:32.926777 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ac817de9-a89d-41c1-8467-35b7ae4c3c8f tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:32.927279 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ac817de9-a89d-41c1-8467-35b7ae4c3c8f tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:32.927998 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ac817de9-a89d-41c1-8467-35b7ae4c3c8f tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:32.928725 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ac817de9-a89d-41c1-8467-35b7ae4c3c8f tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:32.929182 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ac817de9-a89d-41c1-8467-35b7ae4c3c8f tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:32.929611 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ac817de9-a89d-41c1-8467-35b7ae4c3c8f tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:32.942827 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-c0f4dd08-514a-42fa-b6a5-0a69e00f18c8 req-cc1b07f2-3896-4f7f-90c6-11d68ce17fc1 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:32.943355 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-c0f4dd08-514a-42fa-b6a5-0a69e00f18c8 req-cc1b07f2-3896-4f7f-90c6-11d68ce17fc1 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:32.943804 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-c0f4dd08-514a-42fa-b6a5-0a69e00f18c8 req-cc1b07f2-3896-4f7f-90c6-11d68ce17fc1 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:32.970527 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-c0f4dd08-514a-42fa-b6a5-0a69e00f18c8 req-cc1b07f2-3896-4f7f-90c6-11d68ce17fc1 service nova] Creating event network-vif-deleted:9c49ccea-f5ad-47be-9a9c-61df2a8933d5 for instance f070b144-3a1a-4456-8e5b-02af12557c6a on nch2-master-1 Oct 22 20:59:32.980416 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-c0f4dd08-514a-42fa-b6a5-0a69e00f18c8 req-cc1b07f2-3896-4f7f-90c6-11d68ce17fc1 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078942 Oct 22 20:59:32.981592 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1264/2364] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:59:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:59:32.987215 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-56028cce-12fe-4baa-89b6-9d9b6f126b22 tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:59:32.988202 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-56028cce-12fe-4baa-89b6-9d9b6f126b22 tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] [instance: ae58d60e-a113-4a38-94b5-b72a19c353e6] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:59:32.996183 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-56028cce-12fe-4baa-89b6-9d9b6f126b22 tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:32.997064 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-56028cce-12fe-4baa-89b6-9d9b6f126b22 tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:32.998050 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-56028cce-12fe-4baa-89b6-9d9b6f126b22 tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:32.998995 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-56028cce-12fe-4baa-89b6-9d9b6f126b22 tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:33.009907 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-56028cce-12fe-4baa-89b6-9d9b6f126b22 tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:33.011811 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-56028cce-12fe-4baa-89b6-9d9b6f126b22 tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:33.019479 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-ac817de9-a89d-41c1-8467-35b7ae4c3c8f tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb8017457354ed68be65cb426965cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af194191cdc4b34a470c821a932e2fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:59:33.030800 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-ac817de9-a89d-41c1-8467-35b7ae4c3c8f tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] 10.222.0.18 "GET /compute/v2.1/servers/19465083-6d3a-485d-9101-950d9c45abaf" status: 200 len: 1631 microversion: 2.1 time: 0.144648 Oct 22 20:59:33.043382 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1101/2365] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:59:32 2022] GET /compute/v2.1/servers/19465083-6d3a-485d-9101-950d9c45abaf => generated 1631 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:59:33.043382 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-f5b2fe63-68b1-430f-b544-402c1bb4b505 tempest-FloatingIPDetailsTestJSON-1867523695 tempest-FloatingIPDetailsTestJSON-1867523695-project] Calling method '.version_select at 0x7fd3a40c4820>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:59:33.370118 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-56028cce-12fe-4baa-89b6-9d9b6f126b22 tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e36cd987f04f11b6a41325add4ccac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d79e903f8f24a348d5e771d434c70c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:59:33.396202 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-56028cce-12fe-4baa-89b6-9d9b6f126b22 tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] 10.222.0.18 "GET /compute/v2.1/servers/ae58d60e-a113-4a38-94b5-b72a19c353e6" status: 200 len: 1522 microversion: 2.1 time: 0.404676 Oct 22 20:59:33.397644 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1265/2366] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:59:32 2022] GET /compute/v2.1/servers/ae58d60e-a113-4a38-94b5-b72a19c353e6 => generated 1522 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:59:33.403242 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-9ff5b120-ec37-4252-883a-a39b38c43c50 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Action: 'create', calling method: .version_select at 0x7fd39febeee0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1516462887", "description": "tempest-description-1311526964"}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:59:33.878316 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-9ff5b120-ec37-4252-883a-a39b38c43c50 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] 10.222.0.18 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.479365 Oct 22 20:59:33.887313 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1266/2367] 10.222.0.18 () {60 vars in 1180 bytes} [Sat Oct 22 20:59:33 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:59:33.895682 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-82e11c51-e73d-42ce-aaf6-4ef1a9dedd81 req-8b799283-24fd-4fce-9e50-0d3c11beb6b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19465083-6d3a-485d-9101-950d9c45abaf", "name": "network-vif-deleted", "tag": "cdb0c7d2-5618-446f-9f1a-9ed8b48f5bc2"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:59:33.910524 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-82e11c51-e73d-42ce-aaf6-4ef1a9dedd81 req-8b799283-24fd-4fce-9e50-0d3c11beb6b0 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:33.911009 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-82e11c51-e73d-42ce-aaf6-4ef1a9dedd81 req-8b799283-24fd-4fce-9e50-0d3c11beb6b0 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:33.911672 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-82e11c51-e73d-42ce-aaf6-4ef1a9dedd81 req-8b799283-24fd-4fce-9e50-0d3c11beb6b0 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:33.924310 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-82e11c51-e73d-42ce-aaf6-4ef1a9dedd81 req-8b799283-24fd-4fce-9e50-0d3c11beb6b0 service nova] Creating event network-vif-deleted:cdb0c7d2-5618-446f-9f1a-9ed8b48f5bc2 for instance 19465083-6d3a-485d-9101-950d9c45abaf on nch2-master-1 Oct 22 20:59:33.931056 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-82e11c51-e73d-42ce-aaf6-4ef1a9dedd81 req-8b799283-24fd-4fce-9e50-0d3c11beb6b0 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041012 Oct 22 20:59:33.932743 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1267/2368] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:59:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:59:33.938885 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-bb2fab89-6d09-44a6-9f60-0bf198bef664 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:59:33.940648 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-bb2fab89-6d09-44a6-9f60-0bf198bef664 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] [instance: f070b144-3a1a-4456-8e5b-02af12557c6a] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:59:33.951866 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bb2fab89-6d09-44a6-9f60-0bf198bef664 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:33.952737 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bb2fab89-6d09-44a6-9f60-0bf198bef664 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:33.953453 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bb2fab89-6d09-44a6-9f60-0bf198bef664 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:33.954451 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bb2fab89-6d09-44a6-9f60-0bf198bef664 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:33.956640 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bb2fab89-6d09-44a6-9f60-0bf198bef664 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:33.957844 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bb2fab89-6d09-44a6-9f60-0bf198bef664 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:33.999567 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.wsgi [None req-bb2fab89-6d09-44a6-9f60-0bf198bef664 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] HTTP exception thrown: Instance f070b144-3a1a-4456-8e5b-02af12557c6a could not be found. Oct 22 20:59:33.999567 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-bb2fab89-6d09-44a6-9f60-0bf198bef664 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Request method failure captured: Oct 22 20:59:33.999567 ncdv-master-1 devstack@n-api.service[138745]: request: GET /compute/v2.1/servers/f070b144-3a1a-4456-8e5b-02af12557c6a HTTP/1.1 Oct 22 20:59:33.999567 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 20:59:33.999567 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 20:59:33.999567 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 20:59:33.999567 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 0 Oct 22 20:59:33.999567 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 20:59:33.999567 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 20:59:33.999567 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 20:59:33.999567 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 20:59:33.999567 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVFkeCb43WeQtgp51X28RghffiPHU69OKuTacjjJieCoGY9zvHUBMakCXIpkUptlUnh9NPZ76FyJBq4xJSggLl9CrBFTTAqzkYVy7np9TorrKbA0E8UyGHTIO_6WcqkriAf39zPqVfQvV-3CUgMB4zly4miVW78IOGm6KefMgkaoycxc Oct 22 20:59:33.999567 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 20:59:33.999567 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 20:59:33.999567 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 20:59:33.999567 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 20:59:33.999567 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 20:59:33.999567 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 20:59:33.999567 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: 8351b01e07cd43f9be973ab45e522bf0 Oct 22 20:59:33.999567 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-ServersAdminTestJSON-1787327939 Oct 22 20:59:33.999567 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 20:59:33.999567 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 20:59:33.999567 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_8351b01e07cd43f9be973ab45e522bf0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8351b01e07cd43f9be973ab45e522bf0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/8351b01e07cd43f9be973ab45e522bf0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8351b01e07cd43f9be973ab45e522bf0"}]}] Oct 22 20:59:33.999567 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-ServersAdminTestJSON-1787327939 Oct 22 20:59:33.999567 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: 8351b01e07cd43f9be973ab45e522bf0 Oct 22 20:59:33.999567 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-ServersAdminTestJSON-1787327939 Oct 22 20:59:33.999567 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-ServersAdminTestJSON-1787327939-project Oct 22 20:59:33.999567 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 20:59:33.999567 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 20:59:33.999567 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: 57dbe89a7e11480194d3d86f82983499 Oct 22 20:59:33.999567 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-ServersAdminTestJSON-1787327939-project Oct 22 20:59:33.999567 ncdv-master-1 devstack@n-api.service[138745]: method: > Oct 22 20:59:33.999567 ncdv-master-1 devstack@n-api.service[138745]: exception: Instance f070b144-3a1a-4456-8e5b-02af12557c6a could not be found. Oct 22 20:59:33.999567 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'id': 'f070b144-3a1a-4456-8e5b-02af12557c6a'} Oct 22 20:59:33.999567 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:59:33.999567 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:59:33.999567 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 20:59:33.999567 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 20:59:33.999567 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 20:59:33.999567 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 20:59:33.999567 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 20:59:33.999567 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 20:59:33.999567 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 20:59:33.999567 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 20:59:33.999567 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f070b144-3a1a-4456-8e5b-02af12557c6a could not be found. Oct 22 20:59:33.999567 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:59:33.999567 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:59:33.999567 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:59:33.999567 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:59:33.999567 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:59:33.999567 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:59:33.999567 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:59:33.999567 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:59:33.999567 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:59:33.999567 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:59:33.999567 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 20:59:33.999567 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 20:59:33.999567 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 20:59:33.999567 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 20:59:33.999567 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 20:59:33.999567 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 20:59:34.006250 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f070b144-3a1a-4456-8e5b-02af12557c6a could not be found. Oct 22 20:59:34.006250 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:59:34.006250 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:59:34.006250 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:59:34.006250 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:59:34.006250 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:59:34.006250 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:59:34.006250 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 20:59:34.006250 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 20:59:34.006250 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f070b144-3a1a-4456-8e5b-02af12557c6a could not be found. Oct 22 20:59:34.006250 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:59:34.006250 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-bb2fab89-6d09-44a6-9f60-0bf198bef664 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] Returning 404 to user: Instance f070b144-3a1a-4456-8e5b-02af12557c6a could not be found. {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:59:34.006250 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-bb2fab89-6d09-44a6-9f60-0bf198bef664 tempest-ServersAdminTestJSON-1787327939 tempest-ServersAdminTestJSON-1787327939-project] 10.222.0.18 "GET /compute/v2.1/servers/f070b144-3a1a-4456-8e5b-02af12557c6a" status: 404 len: 111 microversion: 2.1 time: 0.070634 Oct 22 20:59:34.006250 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1268/2369] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:59:33 2022] GET /compute/v2.1/servers/f070b144-3a1a-4456-8e5b-02af12557c6a => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 20:59:34.011199 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-eb7f54d6-e91e-4e82-ac47-a1d134c3ce66 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:59:34.011854 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-eb7f54d6-e91e-4e82-ac47-a1d134c3ce66 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] [instance: f38f14b2-b9d7-4bed-92ba-7b95ea4b2270] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:59:34.019858 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-eb7f54d6-e91e-4e82-ac47-a1d134c3ce66 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:34.020347 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-eb7f54d6-e91e-4e82-ac47-a1d134c3ce66 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:34.020855 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-eb7f54d6-e91e-4e82-ac47-a1d134c3ce66 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:34.021581 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-eb7f54d6-e91e-4e82-ac47-a1d134c3ce66 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:34.021920 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-eb7f54d6-e91e-4e82-ac47-a1d134c3ce66 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:34.022346 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-eb7f54d6-e91e-4e82-ac47-a1d134c3ce66 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:34.513396 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-eb7f54d6-e91e-4e82-ac47-a1d134c3ce66 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211483c6acea4f76b6c0e4bfc818e7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd687d54e07d4ab4af00ad801ef4b58d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:59:34.529919 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-eb7f54d6-e91e-4e82-ac47-a1d134c3ce66 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '211483c6acea4f76b6c0e4bfc818e7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd687d54e07d4ab4af00ad801ef4b58d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:59:34.531516 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-eb7f54d6-e91e-4e82-ac47-a1d134c3ce66 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '211483c6acea4f76b6c0e4bfc818e7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd687d54e07d4ab4af00ad801ef4b58d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:59:34.538644 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-eb7f54d6-e91e-4e82-ac47-a1d134c3ce66 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] 10.222.0.18 "GET /compute/v2.1/servers/f38f14b2-b9d7-4bed-92ba-7b95ea4b2270" status: 200 len: 1786 microversion: 2.42 time: 0.531530 Oct 22 20:59:34.539241 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1269/2370] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 20:59:34 2022] GET /compute/v2.1/servers/f38f14b2-b9d7-4bed-92ba-7b95ea4b2270 => generated 1786 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 20:59:34.562295 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-a5c31f88-8cef-470e-b0d5-dfe9b01d3aed tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Action: 'create', calling method: .version_select at 0x7fd39fc83940>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-446294297", "description": "tempest-description-1732371154"}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:59:34.681040 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-f5b2fe63-68b1-430f-b544-402c1bb4b505 tempest-FloatingIPDetailsTestJSON-1867523695 tempest-FloatingIPDetailsTestJSON-1867523695-project] 10.222.0.18 "DELETE /compute/v2.1/os-floating-ips/59d2602e-1fac-4656-8a86-142be8a1d840" status: 202 len: 0 microversion: 2.1 time: 1.648205 Oct 22 20:59:34.681778 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1102/2371] 10.222.0.18 () {58 vars in 1263 bytes} [Sat Oct 22 20:59:33 2022] DELETE /compute/v2.1/os-floating-ips/59d2602e-1fac-4656-8a86-142be8a1d840 => generated 0 bytes in 1649 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 20:59:34.687818 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-b3656c51-0b71-4ecb-b565-1969adca8a28 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:59:34.688669 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-b3656c51-0b71-4ecb-b565-1969adca8a28 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] [instance: c3e6246d-c32a-490d-ba83-84b54822f971] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:59:34.699713 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b3656c51-0b71-4ecb-b565-1969adca8a28 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:34.700216 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b3656c51-0b71-4ecb-b565-1969adca8a28 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:34.700664 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b3656c51-0b71-4ecb-b565-1969adca8a28 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:34.701482 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b3656c51-0b71-4ecb-b565-1969adca8a28 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:34.702125 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b3656c51-0b71-4ecb-b565-1969adca8a28 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:34.702559 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b3656c51-0b71-4ecb-b565-1969adca8a28 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:34.995387 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-a5c31f88-8cef-470e-b0d5-dfe9b01d3aed tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] 10.222.0.18 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.438729 Oct 22 20:59:34.996148 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1270/2372] 10.222.0.18 () {60 vars in 1180 bytes} [Sat Oct 22 20:59:34 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:59:35.001804 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-cdfa49ab-6a5e-4264-ac31-238cd5303a73 tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:59:35.002649 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-cdfa49ab-6a5e-4264-ac31-238cd5303a73 tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] [instance: 19465083-6d3a-485d-9101-950d9c45abaf] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:59:35.017615 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cdfa49ab-6a5e-4264-ac31-238cd5303a73 tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:35.022004 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cdfa49ab-6a5e-4264-ac31-238cd5303a73 tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:35.022909 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cdfa49ab-6a5e-4264-ac31-238cd5303a73 tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:35.024477 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cdfa49ab-6a5e-4264-ac31-238cd5303a73 tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:35.026368 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cdfa49ab-6a5e-4264-ac31-238cd5303a73 tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:35.031139 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-b3656c51-0b71-4ecb-b565-1969adca8a28 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d3d7458af447bdb3f03e83a2d8559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49238b8686d24ae698679e4a1957735d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:59:35.051807 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cdfa49ab-6a5e-4264-ac31-238cd5303a73 tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:35.061556 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-b3656c51-0b71-4ecb-b565-1969adca8a28 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] 10.222.0.18 "GET /compute/v2.1/servers/c3e6246d-c32a-490d-ba83-84b54822f971" status: 200 len: 1469 microversion: 2.1 time: 0.376504 Oct 22 20:59:35.065994 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1103/2373] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:59:34 2022] GET /compute/v2.1/servers/c3e6246d-c32a-490d-ba83-84b54822f971 => generated 1469 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:59:35.080972 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-24e5444c-3d9f-43f3-b8bd-c2ab990db7e3 tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:59:35.081549 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-24e5444c-3d9f-43f3-b8bd-c2ab990db7e3 tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] [instance: ae58d60e-a113-4a38-94b5-b72a19c353e6] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:59:35.105811 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-24e5444c-3d9f-43f3-b8bd-c2ab990db7e3 tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:35.106285 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-24e5444c-3d9f-43f3-b8bd-c2ab990db7e3 tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:35.108186 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-24e5444c-3d9f-43f3-b8bd-c2ab990db7e3 tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:35.109176 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-24e5444c-3d9f-43f3-b8bd-c2ab990db7e3 tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:35.110911 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-24e5444c-3d9f-43f3-b8bd-c2ab990db7e3 tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:35.111564 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-24e5444c-3d9f-43f3-b8bd-c2ab990db7e3 tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:35.128768 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cdfa49ab-6a5e-4264-ac31-238cd5303a73 tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:35.129516 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cdfa49ab-6a5e-4264-ac31-238cd5303a73 tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:35.130150 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cdfa49ab-6a5e-4264-ac31-238cd5303a73 tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:35.130778 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.objects.instance [None req-cdfa49ab-6a5e-4264-ac31-238cd5303a73 tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] Lazy-loading 'fault' on Instance uuid 19465083-6d3a-485d-9101-950d9c45abaf {{(pid=138745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 20:59:35.393530 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-cdfa49ab-6a5e-4264-ac31-238cd5303a73 tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb8017457354ed68be65cb426965cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af194191cdc4b34a470c821a932e2fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:59:35.413770 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-cdfa49ab-6a5e-4264-ac31-238cd5303a73 tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] 10.222.0.18 "GET /compute/v2.1/servers/19465083-6d3a-485d-9101-950d9c45abaf" status: 200 len: 1360 microversion: 2.1 time: 0.415592 Oct 22 20:59:35.431818 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1271/2374] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:59:34 2022] GET /compute/v2.1/servers/19465083-6d3a-485d-9101-950d9c45abaf => generated 1360 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:59:35.437872 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-c044791b-75cd-4f26-8e81-3c8f4c082749 tempest-FloatingIPDetailsTestJSON-1867523695 tempest-FloatingIPDetailsTestJSON-1867523695-project] Calling method '.version_select at 0x7fd39fc83940>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:59:35.617317 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-24e5444c-3d9f-43f3-b8bd-c2ab990db7e3 tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e36cd987f04f11b6a41325add4ccac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d79e903f8f24a348d5e771d434c70c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:59:35.630663 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-24e5444c-3d9f-43f3-b8bd-c2ab990db7e3 tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] 10.222.0.18 "GET /compute/v2.1/servers/ae58d60e-a113-4a38-94b5-b72a19c353e6" status: 200 len: 1522 microversion: 2.1 time: 0.563056 Oct 22 20:59:35.632224 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1104/2375] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:59:35 2022] GET /compute/v2.1/servers/ae58d60e-a113-4a38-94b5-b72a19c353e6 => generated 1522 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:59:35.637076 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-d07230c6-0706-451c-802d-cc3d8d7f3e20 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Calling method '.version_select at 0x7fd3a4051c10>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:59:36.359494 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-d07230c6-0706-451c-802d-cc3d8d7f3e20 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] 10.222.0.18 "GET /compute/v2.1/os-security-groups" status: 200 len: 1833 microversion: 2.1 time: 0.725837 Oct 22 20:59:36.360293 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1105/2376] 10.222.0.18 () {58 vars in 1158 bytes} [Sat Oct 22 20:59:35 2022] GET /compute/v2.1/os-security-groups => generated 1833 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:59:36.367607 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-6de4895b-aa49-41d2-8e60-6b2caa9e2fdd tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:59:36.369197 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-6de4895b-aa49-41d2-8e60-6b2caa9e2fdd tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] [instance: f38f14b2-b9d7-4bed-92ba-7b95ea4b2270] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:59:36.378881 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6de4895b-aa49-41d2-8e60-6b2caa9e2fdd tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:36.379720 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6de4895b-aa49-41d2-8e60-6b2caa9e2fdd tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:36.380406 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6de4895b-aa49-41d2-8e60-6b2caa9e2fdd tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:36.381302 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6de4895b-aa49-41d2-8e60-6b2caa9e2fdd tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:36.381865 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6de4895b-aa49-41d2-8e60-6b2caa9e2fdd tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:36.382582 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6de4895b-aa49-41d2-8e60-6b2caa9e2fdd tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:36.680700 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-6de4895b-aa49-41d2-8e60-6b2caa9e2fdd tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211483c6acea4f76b6c0e4bfc818e7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd687d54e07d4ab4af00ad801ef4b58d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:59:36.695829 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-6de4895b-aa49-41d2-8e60-6b2caa9e2fdd tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '211483c6acea4f76b6c0e4bfc818e7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd687d54e07d4ab4af00ad801ef4b58d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:59:36.697769 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-6de4895b-aa49-41d2-8e60-6b2caa9e2fdd tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '211483c6acea4f76b6c0e4bfc818e7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd687d54e07d4ab4af00ad801ef4b58d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:59:36.699622 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-6de4895b-aa49-41d2-8e60-6b2caa9e2fdd tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] 10.222.0.18 "GET /compute/v2.1/servers/f38f14b2-b9d7-4bed-92ba-7b95ea4b2270" status: 200 len: 1832 microversion: 2.42 time: 0.337094 Oct 22 20:59:36.713419 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1106/2377] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 20:59:36 2022] GET /compute/v2.1/servers/f38f14b2-b9d7-4bed-92ba-7b95ea4b2270 => generated 1832 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 20:59:36.730224 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-a8204660-656d-45c0-887d-6cc2cacbe276 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:59:36.731250 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-a8204660-656d-45c0-887d-6cc2cacbe276 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] [instance: c3e6246d-c32a-490d-ba83-84b54822f971] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:59:36.742540 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a8204660-656d-45c0-887d-6cc2cacbe276 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:36.743741 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a8204660-656d-45c0-887d-6cc2cacbe276 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:36.744435 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a8204660-656d-45c0-887d-6cc2cacbe276 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:36.746571 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a8204660-656d-45c0-887d-6cc2cacbe276 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:36.747250 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a8204660-656d-45c0-887d-6cc2cacbe276 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:36.748270 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a8204660-656d-45c0-887d-6cc2cacbe276 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:37.324023 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-c044791b-75cd-4f26-8e81-3c8f4c082749 tempest-FloatingIPDetailsTestJSON-1867523695 tempest-FloatingIPDetailsTestJSON-1867523695-project] 10.222.0.18 "DELETE /compute/v2.1/os-floating-ips/1bda61f8-d840-46f3-8436-a4e74f422196" status: 202 len: 0 microversion: 2.1 time: 1.890650 Oct 22 20:59:37.325277 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1272/2378] 10.222.0.18 () {58 vars in 1263 bytes} [Sat Oct 22 20:59:35 2022] DELETE /compute/v2.1/os-floating-ips/1bda61f8-d840-46f3-8436-a4e74f422196 => generated 0 bytes in 1893 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 20:59:37.348596 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-600b7871-5fcc-4519-82fe-4d379e25ee93 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Calling method '.version_select at 0x7fd3a44c59d0>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:59:37.457160 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-a8204660-656d-45c0-887d-6cc2cacbe276 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d3d7458af447bdb3f03e83a2d8559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49238b8686d24ae698679e4a1957735d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:59:37.470133 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-a8204660-656d-45c0-887d-6cc2cacbe276 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] 10.222.0.18 "GET /compute/v2.1/servers/c3e6246d-c32a-490d-ba83-84b54822f971" status: 200 len: 1469 microversion: 2.1 time: 0.755168 Oct 22 20:59:37.474384 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1107/2379] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:59:36 2022] GET /compute/v2.1/servers/c3e6246d-c32a-490d-ba83-84b54822f971 => generated 1469 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:59:37.485768 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-b6f5b31d-f309-4ba7-9e8a-a9f82a8eed5c tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:59:37.486957 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-b6f5b31d-f309-4ba7-9e8a-a9f82a8eed5c tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] [instance: 19465083-6d3a-485d-9101-950d9c45abaf] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:59:37.494523 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b6f5b31d-f309-4ba7-9e8a-a9f82a8eed5c tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:37.496526 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b6f5b31d-f309-4ba7-9e8a-a9f82a8eed5c tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:37.497131 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b6f5b31d-f309-4ba7-9e8a-a9f82a8eed5c tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:37.503180 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b6f5b31d-f309-4ba7-9e8a-a9f82a8eed5c tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:37.504353 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b6f5b31d-f309-4ba7-9e8a-a9f82a8eed5c tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:37.504946 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b6f5b31d-f309-4ba7-9e8a-a9f82a8eed5c tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:37.526530 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-b6f5b31d-f309-4ba7-9e8a-a9f82a8eed5c tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] HTTP exception thrown: Instance 19465083-6d3a-485d-9101-950d9c45abaf could not be found. Oct 22 20:59:37.528593 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-b6f5b31d-f309-4ba7-9e8a-a9f82a8eed5c tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] Request method failure captured: Oct 22 20:59:37.528593 ncdv-master-1 devstack@n-api.service[138744]: request: GET /compute/v2.1/servers/19465083-6d3a-485d-9101-950d9c45abaf HTTP/1.1 Oct 22 20:59:37.528593 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 20:59:37.528593 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 20:59:37.528593 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 20:59:37.528593 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 0 Oct 22 20:59:37.528593 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 20:59:37.528593 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 20:59:37.528593 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 20:59:37.528593 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 20:59:37.528593 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVFlgiugvVGX-ZemzyKpkwNJXr-0yBEbARnLzfl5hsE13j3iwBZBQfpsDD8-HfJFeoFqi2WxrRfPgeXp10ItRdCTnbsmWsNMJvW1UqJKST0MoN4VRVUWz7tvGKGDPjIjHJLb4-QKpaCfIw7bZ6_BDtUslxbJigsHzE3_xzeTLPIwk9k0 Oct 22 20:59:37.528593 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 20:59:37.528593 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 20:59:37.528593 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 20:59:37.528593 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 20:59:37.528593 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 20:59:37.528593 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 20:59:37.528593 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: 5af194191cdc4b34a470c821a932e2fd Oct 22 20:59:37.528593 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-ServersTestJSON-570436737 Oct 22 20:59:37.528593 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 20:59:37.528593 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 20:59:37.528593 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_5af194191cdc4b34a470c821a932e2fd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5af194191cdc4b34a470c821a932e2fd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/5af194191cdc4b34a470c821a932e2fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5af194191cdc4b34a470c821a932e2fd"}]}] Oct 22 20:59:37.528593 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-ServersTestJSON-570436737 Oct 22 20:59:37.528593 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: 5af194191cdc4b34a470c821a932e2fd Oct 22 20:59:37.528593 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-ServersTestJSON-570436737 Oct 22 20:59:37.528593 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-ServersTestJSON-570436737-project Oct 22 20:59:37.528593 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 20:59:37.528593 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 20:59:37.528593 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: 5bb8017457354ed68be65cb426965cb2 Oct 22 20:59:37.528593 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-ServersTestJSON-570436737-project Oct 22 20:59:37.528593 ncdv-master-1 devstack@n-api.service[138744]: method: > Oct 22 20:59:37.528593 ncdv-master-1 devstack@n-api.service[138744]: exception: Instance 19465083-6d3a-485d-9101-950d9c45abaf could not be found. Oct 22 20:59:37.528593 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': '19465083-6d3a-485d-9101-950d9c45abaf'} Oct 22 20:59:37.528593 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:59:37.528593 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:59:37.528593 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 20:59:37.528593 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 20:59:37.528593 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 20:59:37.528593 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 20:59:37.528593 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 20:59:37.528593 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 20:59:37.528593 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 20:59:37.528593 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 20:59:37.528593 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19465083-6d3a-485d-9101-950d9c45abaf could not be found. Oct 22 20:59:37.528593 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:59:37.528593 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:59:37.528593 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:59:37.528593 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:59:37.528593 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:59:37.528593 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:59:37.528593 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:59:37.528593 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:59:37.528593 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:59:37.528593 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:59:37.528593 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 20:59:37.528593 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 20:59:37.528593 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 20:59:37.528593 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 20:59:37.528593 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 20:59:37.528593 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 20:59:37.528593 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19465083-6d3a-485d-9101-950d9c45abaf could not be found. Oct 22 20:59:37.528593 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:59:37.528593 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:59:37.528593 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:59:37.528593 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:59:37.532796 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:59:37.532796 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:59:37.532796 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 20:59:37.532796 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 20:59:37.532796 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19465083-6d3a-485d-9101-950d9c45abaf could not be found. Oct 22 20:59:37.532796 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:59:37.536574 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-b6f5b31d-f309-4ba7-9e8a-a9f82a8eed5c tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] Returning 404 to user: Instance 19465083-6d3a-485d-9101-950d9c45abaf could not be found. {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:59:37.537706 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-b6f5b31d-f309-4ba7-9e8a-a9f82a8eed5c tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] 10.222.0.18 "GET /compute/v2.1/servers/19465083-6d3a-485d-9101-950d9c45abaf" status: 404 len: 111 microversion: 2.1 time: 0.062140 Oct 22 20:59:37.539076 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1108/2380] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:59:37 2022] GET /compute/v2.1/servers/19465083-6d3a-485d-9101-950d9c45abaf => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 20:59:37.548062 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-0ce42f51-a564-447a-b606-f42cd3069f56 req-e5ac32e4-0edb-40f9-be1a-fe06c913aefe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3e6246d-c32a-490d-ba83-84b54822f971", "name": "network-vif-unplugged", "status": "completed", "tag": "140cd909-abde-4ea9-89c0-b130f4264b5b"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:59:37.560045 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-0ce42f51-a564-447a-b606-f42cd3069f56 req-e5ac32e4-0edb-40f9-be1a-fe06c913aefe service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:37.561171 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-0ce42f51-a564-447a-b606-f42cd3069f56 req-e5ac32e4-0edb-40f9-be1a-fe06c913aefe service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:37.561698 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-0ce42f51-a564-447a-b606-f42cd3069f56 req-e5ac32e4-0edb-40f9-be1a-fe06c913aefe service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:37.592536 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-0ce42f51-a564-447a-b606-f42cd3069f56 req-e5ac32e4-0edb-40f9-be1a-fe06c913aefe service nova] Creating event network-vif-unplugged:140cd909-abde-4ea9-89c0-b130f4264b5b for instance c3e6246d-c32a-490d-ba83-84b54822f971 on nch1-master-1 Oct 22 20:59:37.601396 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [req-0ce42f51-a564-447a-b606-f42cd3069f56 req-e5ac32e4-0edb-40f9-be1a-fe06c913aefe service nova] Instance c3e6246d-c32a-490d-ba83-84b54822f971 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=138744) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 22 20:59:37.630273 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-0ce42f51-a564-447a-b606-f42cd3069f56 req-e5ac32e4-0edb-40f9-be1a-fe06c913aefe service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.087667 Oct 22 20:59:37.633125 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1109/2381] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:59:37 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:59:37.643852 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-272f0044-d684-4054-af67-ecd462afc068 tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:59:37.645274 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-272f0044-d684-4054-af67-ecd462afc068 tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] [instance: ae58d60e-a113-4a38-94b5-b72a19c353e6] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:59:37.654280 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-272f0044-d684-4054-af67-ecd462afc068 tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:37.655675 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-272f0044-d684-4054-af67-ecd462afc068 tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:37.656357 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-272f0044-d684-4054-af67-ecd462afc068 tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:37.662039 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-272f0044-d684-4054-af67-ecd462afc068 tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:37.662845 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-272f0044-d684-4054-af67-ecd462afc068 tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:37.663562 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-272f0044-d684-4054-af67-ecd462afc068 tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:38.098297 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-272f0044-d684-4054-af67-ecd462afc068 tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e36cd987f04f11b6a41325add4ccac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d79e903f8f24a348d5e771d434c70c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:59:38.123005 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-272f0044-d684-4054-af67-ecd462afc068 tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] 10.222.0.18 "GET /compute/v2.1/servers/ae58d60e-a113-4a38-94b5-b72a19c353e6" status: 200 len: 1522 microversion: 2.1 time: 0.486942 Oct 22 20:59:38.125380 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1110/2382] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:59:37 2022] GET /compute/v2.1/servers/ae58d60e-a113-4a38-94b5-b72a19c353e6 => generated 1522 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:59:38.130555 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-8a248ed7-1a92-4ea5-98ad-06b23b1a0eda tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] Calling method '.version_select at 0x7fd3a40c4ee0>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:59:38.170470 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-600b7871-5fcc-4519-82fe-4d379e25ee93 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/7e3d4dfe-6b84-486f-b7a1-bfe00a565aa6" status: 202 len: 0 microversion: 2.1 time: 0.842860 Oct 22 20:59:38.172413 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1273/2383] 10.222.0.18 () {58 vars in 1272 bytes} [Sat Oct 22 20:59:37 2022] DELETE /compute/v2.1/os-security-groups/7e3d4dfe-6b84-486f-b7a1-bfe00a565aa6 => generated 0 bytes in 847 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 20:59:38.198164 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-a33327a4-d5ce-4e31-ad05-ee3c3cf8ad6d tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:59:38.199077 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-a33327a4-d5ce-4e31-ad05-ee3c3cf8ad6d tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] [instance: f38f14b2-b9d7-4bed-92ba-7b95ea4b2270] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:59:38.205951 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-8a248ed7-1a92-4ea5-98ad-06b23b1a0eda tempest-ServersTestJSON-570436737 tempest-ServersTestJSON-570436737-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1358369103" status: 202 len: 0 microversion: 2.1 time: 0.079132 Oct 22 20:59:38.207970 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1111/2384] 10.222.0.18 () {58 vars in 1221 bytes} [Sat Oct 22 20:59:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1358369103 => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 20:59:38.218361 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a33327a4-d5ce-4e31-ad05-ee3c3cf8ad6d tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:38.219572 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a33327a4-d5ce-4e31-ad05-ee3c3cf8ad6d tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:38.220463 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a33327a4-d5ce-4e31-ad05-ee3c3cf8ad6d tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:38.222050 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a33327a4-d5ce-4e31-ad05-ee3c3cf8ad6d tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:38.224037 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a33327a4-d5ce-4e31-ad05-ee3c3cf8ad6d tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:38.227113 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a33327a4-d5ce-4e31-ad05-ee3c3cf8ad6d tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:38.380426 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-22096042-49c9-456f-8681-66b2d60ba6e6 tempest-FlavorsV2TestJSON-839536787 tempest-FlavorsV2TestJSON-839536787-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:59:38.395832 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-22096042-49c9-456f-8681-66b2d60ba6e6 tempest-FlavorsV2TestJSON-839536787 tempest-FlavorsV2TestJSON-839536787-project] 10.222.0.18 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.185554 Oct 22 20:59:38.396594 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1112/2385] 10.222.0.18 () {58 vars in 1137 bytes} [Sat Oct 22 20:59:38 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:59:38.401777 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-dc10c3b6-e609-4df5-81a3-98b42562dbb8 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Calling method '.version_select at 0x7fd39f26cf70>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:59:38.464983 ncdv-master-1 devstack@n-api.service[138744]: DEBUG neutronclient.v2_0.client [None req-dc10c3b6-e609-4df5-81a3-98b42562dbb8 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 7e3d4dfe-6b84-486f-b7a1-bfe00a565aa6 does not exist", "detail": ""}} {{(pid=138744) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 22 20:59:38.465614 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.network.security_group_api [None req-dc10c3b6-e609-4df5-81a3-98b42562dbb8 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Neutron security group 7e3d4dfe-6b84-486f-b7a1-bfe00a565aa6 not found {{(pid=138744) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 22 20:59:38.466167 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-dc10c3b6-e609-4df5-81a3-98b42562dbb8 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] HTTP exception thrown: Security group 7e3d4dfe-6b84-486f-b7a1-bfe00a565aa6 does not exist Oct 22 20:59:38.466167 ncdv-master-1 devstack@n-api.service[138744]: Neutron server returns request_ids: ['req-4cdb3f3f-a1d7-4f5f-abdf-7ac853134735'] Oct 22 20:59:38.468391 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-dc10c3b6-e609-4df5-81a3-98b42562dbb8 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Request method failure captured: Oct 22 20:59:38.468391 ncdv-master-1 devstack@n-api.service[138744]: request: GET /compute/v2.1/os-security-groups/7e3d4dfe-6b84-486f-b7a1-bfe00a565aa6 HTTP/1.1 Oct 22 20:59:38.468391 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 20:59:38.468391 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 20:59:38.468391 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 20:59:38.468391 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 0 Oct 22 20:59:38.468391 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 20:59:38.468391 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 20:59:38.468391 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 20:59:38.468391 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 20:59:38.468391 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVFmMTFo8tMXHI466ygTiy0jTs5kz8YO2nFuimSyZRJI5bXNUfHpPLWjQrXyJ7I9Xfc54HQRfYflULj68lfwBk5jrnjY79oZ1kbdK55vumR_IVvMJmaykrPjWliG3H4xf-SZHnU3invPEATeZO7VP5aTca0hd9BauSvYCW1UPdVAZZ70 Oct 22 20:59:38.468391 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 20:59:38.468391 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 20:59:38.468391 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 20:59:38.468391 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 20:59:38.468391 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 20:59:38.468391 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 20:59:38.468391 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: ed31e93b0e8a43f28e497f94318815ce Oct 22 20:59:38.468391 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-SecurityGroupsTestJSON-1604956559 Oct 22 20:59:38.468391 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 20:59:38.468391 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 20:59:38.468391 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ed31e93b0e8a43f28e497f94318815ce"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ed31e93b0e8a43f28e497f94318815ce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ed31e93b0e8a43f28e497f94318815ce"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ed31e93b0e8a43f28e497f94318815ce"}]}] Oct 22 20:59:38.468391 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-SecurityGroupsTestJSON-1604956559 Oct 22 20:59:38.468391 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: ed31e93b0e8a43f28e497f94318815ce Oct 22 20:59:38.468391 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1604956559 Oct 22 20:59:38.468391 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-SecurityGroupsTestJSON-1604956559-project Oct 22 20:59:38.468391 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 20:59:38.468391 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 20:59:38.468391 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: 46d49952dbca4d95a25411b65d56552b Oct 22 20:59:38.468391 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-SecurityGroupsTestJSON-1604956559-project Oct 22 20:59:38.468391 ncdv-master-1 devstack@n-api.service[138744]: method: Oct 22 20:59:38.468391 ncdv-master-1 devstack@n-api.service[138744]: exception: Security group 7e3d4dfe-6b84-486f-b7a1-bfe00a565aa6 does not exist Oct 22 20:59:38.468391 ncdv-master-1 devstack@n-api.service[138744]: Neutron server returns request_ids: ['req-4cdb3f3f-a1d7-4f5f-abdf-7ac853134735'] Oct 22 20:59:38.468391 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': '7e3d4dfe-6b84-486f-b7a1-bfe00a565aa6'} Oct 22 20:59:38.468391 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:59:38.468391 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:59:38.468391 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 22 20:59:38.468391 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 22 20:59:38.468391 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 20:59:38.468391 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 20:59:38.468391 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 22 20:59:38.468391 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 22 20:59:38.468391 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 20:59:38.468391 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 20:59:38.468391 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 22 20:59:38.468391 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 22 20:59:38.468391 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 20:59:38.468391 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 20:59:38.468391 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 22 20:59:38.468391 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 22 20:59:38.468391 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 20:59:38.468391 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 20:59:38.468391 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 22 20:59:38.468391 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 22 20:59:38.468391 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 20:59:38.468391 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 20:59:38.468391 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 22 20:59:38.468391 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 22 20:59:38.468391 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 22 20:59:38.468391 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 22 20:59:38.468391 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 7e3d4dfe-6b84-486f-b7a1-bfe00a565aa6 does not exist Oct 22 20:59:38.472920 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4cdb3f3f-a1d7-4f5f-abdf-7ac853134735'] Oct 22 20:59:38.472920 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:59:38.472920 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:59:38.472920 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:59:38.472920 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:59:38.472920 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 22 20:59:38.472920 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 22 20:59:38.472920 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 22 20:59:38.472920 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 22 20:59:38.472920 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 7e3d4dfe-6b84-486f-b7a1-bfe00a565aa6 does not exist Oct 22 20:59:38.472920 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4cdb3f3f-a1d7-4f5f-abdf-7ac853134735'] Oct 22 20:59:38.472920 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:59:38.472920 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:59:38.472920 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:59:38.472920 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:59:38.472920 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:59:38.472920 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:59:38.472920 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:59:38.472920 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:59:38.472920 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 22 20:59:38.472920 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 22 20:59:38.472920 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:59:38.472920 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:59:38.472920 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 22 20:59:38.472920 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 22 20:59:38.472920 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 7e3d4dfe-6b84-486f-b7a1-bfe00a565aa6 does not exist Oct 22 20:59:38.472920 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4cdb3f3f-a1d7-4f5f-abdf-7ac853134735'] Oct 22 20:59:38.472920 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:59:38.472920 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:59:38.472920 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:59:38.472920 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:59:38.472920 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:59:38.472920 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:59:38.472920 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 20:59:38.472920 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 20:59:38.472920 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 7e3d4dfe-6b84-486f-b7a1-bfe00a565aa6 does not exist Oct 22 20:59:38.472920 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4cdb3f3f-a1d7-4f5f-abdf-7ac853134735'] Oct 22 20:59:38.472920 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:59:38.476822 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-dc10c3b6-e609-4df5-81a3-98b42562dbb8 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Returning 404 to user: Security group 7e3d4dfe-6b84-486f-b7a1-bfe00a565aa6 does not exist Oct 22 20:59:38.476822 ncdv-master-1 devstack@n-api.service[138744]: Neutron server returns request_ids: ['req-4cdb3f3f-a1d7-4f5f-abdf-7ac853134735'] {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:59:38.477957 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-dc10c3b6-e609-4df5-81a3-98b42562dbb8 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] 10.222.0.18 "GET /compute/v2.1/os-security-groups/7e3d4dfe-6b84-486f-b7a1-bfe00a565aa6" status: 404 len: 194 microversion: 2.1 time: 0.080266 Oct 22 20:59:38.482459 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1113/2386] 10.222.0.18 () {58 vars in 1269 bytes} [Sat Oct 22 20:59:38 2022] GET /compute/v2.1/os-security-groups/7e3d4dfe-6b84-486f-b7a1-bfe00a565aa6 => generated 194 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 20:59:38.488496 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-11af3a2b-c50c-45f4-827e-1238d3361ca7 tempest-FlavorsV2TestJSON-839536787 tempest-FlavorsV2TestJSON-839536787-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:59:38.515484 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-11af3a2b-c50c-45f4-827e-1238d3361ca7 tempest-FlavorsV2TestJSON-839536787 tempest-FlavorsV2TestJSON-839536787-project] 10.222.0.18 "GET /compute/v2.1/flavors" status: 200 len: 2594 microversion: 2.1 time: 0.031182 Oct 22 20:59:38.526853 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1114/2387] 10.222.0.18 () {58 vars in 1125 bytes} [Sat Oct 22 20:59:38 2022] GET /compute/v2.1/flavors => generated 2594 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:59:38.532359 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-264d86f8-2f67-449b-92b8-8eaf8ee4ccca tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Calling method '.version_select at 0x7fd3a8b05160>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:59:38.607074 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-a33327a4-d5ce-4e31-ad05-ee3c3cf8ad6d tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211483c6acea4f76b6c0e4bfc818e7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd687d54e07d4ab4af00ad801ef4b58d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:59:38.619896 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-a33327a4-d5ce-4e31-ad05-ee3c3cf8ad6d tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '211483c6acea4f76b6c0e4bfc818e7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd687d54e07d4ab4af00ad801ef4b58d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:59:38.623860 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-a33327a4-d5ce-4e31-ad05-ee3c3cf8ad6d tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '211483c6acea4f76b6c0e4bfc818e7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd687d54e07d4ab4af00ad801ef4b58d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:59:38.634195 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-a33327a4-d5ce-4e31-ad05-ee3c3cf8ad6d tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] 10.222.0.18 "GET /compute/v2.1/servers/f38f14b2-b9d7-4bed-92ba-7b95ea4b2270" status: 200 len: 1832 microversion: 2.42 time: 0.460166 Oct 22 20:59:38.634910 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1274/2388] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 20:59:38 2022] GET /compute/v2.1/servers/f38f14b2-b9d7-4bed-92ba-7b95ea4b2270 => generated 1832 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 20:59:38.640421 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-39243f90-ade4-4ae2-b7d0-e835f17c343b tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:59:38.641099 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-39243f90-ade4-4ae2-b7d0-e835f17c343b tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] [instance: c3e6246d-c32a-490d-ba83-84b54822f971] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:59:38.655503 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-39243f90-ade4-4ae2-b7d0-e835f17c343b tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:38.655846 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-39243f90-ade4-4ae2-b7d0-e835f17c343b tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:38.656291 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-39243f90-ade4-4ae2-b7d0-e835f17c343b tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:38.657018 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-39243f90-ade4-4ae2-b7d0-e835f17c343b tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:38.657482 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-39243f90-ade4-4ae2-b7d0-e835f17c343b tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:38.657915 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-39243f90-ade4-4ae2-b7d0-e835f17c343b tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:39.057882 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-39243f90-ade4-4ae2-b7d0-e835f17c343b tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d3d7458af447bdb3f03e83a2d8559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49238b8686d24ae698679e4a1957735d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:59:39.066802 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-39243f90-ade4-4ae2-b7d0-e835f17c343b tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] 10.222.0.18 "GET /compute/v2.1/servers/c3e6246d-c32a-490d-ba83-84b54822f971" status: 200 len: 1469 microversion: 2.1 time: 0.430636 Oct 22 20:59:39.067727 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1275/2389] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:59:38 2022] GET /compute/v2.1/servers/c3e6246d-c32a-490d-ba83-84b54822f971 => generated 1469 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:59:39.072895 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-6ff88fce-a154-4c60-ad15-bd6c0809f32a tempest-FlavorsV2TestJSON-839536787 tempest-FlavorsV2TestJSON-839536787-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:59:39.081344 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-6ff88fce-a154-4c60-ad15-bd6c0809f32a tempest-FlavorsV2TestJSON-839536787 tempest-FlavorsV2TestJSON-839536787-project] 10.222.0.18 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.012362 Oct 22 20:59:39.082551 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1276/2390] 10.222.0.18 () {58 vars in 1137 bytes} [Sat Oct 22 20:59:39 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:59:39.096095 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-21b1581b-6fcb-4bd0-9fb2-552f53c1c9cd tempest-FlavorsV2TestJSON-839536787 tempest-FlavorsV2TestJSON-839536787-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:59:39.109272 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-21b1581b-6fcb-4bd0-9fb2-552f53c1c9cd tempest-FlavorsV2TestJSON-839536787 tempest-FlavorsV2TestJSON-839536787-project] 10.222.0.18 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.017346 Oct 22 20:59:39.117465 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1277/2391] 10.222.0.18 () {58 vars in 1137 bytes} [Sat Oct 22 20:59:39 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:59:39.123023 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-96add6da-739c-4faf-a933-54e3b7ba56a0 tempest-FlavorsV2TestJSON-839536787 tempest-FlavorsV2TestJSON-839536787-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:59:39.153375 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-96add6da-739c-4faf-a933-54e3b7ba56a0 tempest-FlavorsV2TestJSON-839536787 tempest-FlavorsV2TestJSON-839536787-project] 10.222.0.18 "GET /compute/v2.1/flavors/detail?minDisk=2" status: 200 len: 3209 microversion: 2.1 time: 0.034298 Oct 22 20:59:39.167168 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1278/2392] 10.222.0.18 () {58 vars in 1165 bytes} [Sat Oct 22 20:59:39 2022] GET /compute/v2.1/flavors/detail?minDisk=2 => generated 3209 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:59:39.168015 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-264d86f8-2f67-449b-92b8-8eaf8ee4ccca tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/326b3bb2-542e-4abe-8a93-43ee175deff5" status: 202 len: 0 microversion: 2.1 time: 0.639544 Oct 22 20:59:39.169156 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1115/2393] 10.222.0.18 () {58 vars in 1272 bytes} [Sat Oct 22 20:59:38 2022] DELETE /compute/v2.1/os-security-groups/326b3bb2-542e-4abe-8a93-43ee175deff5 => generated 0 bytes in 641 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 20:59:39.172729 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-0f5424d6-57c7-4363-a8b5-0db77dc947a9 tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:59:39.173557 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-0f5424d6-57c7-4363-a8b5-0db77dc947a9 tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] [instance: ae58d60e-a113-4a38-94b5-b72a19c353e6] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:59:39.174848 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-9400b954-e7d2-42e9-8807-530c055737b9 tempest-FlavorsV2TestJSON-839536787 tempest-FlavorsV2TestJSON-839536787-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:59:39.180273 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=3,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:59:39.181186 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0f5424d6-57c7-4363-a8b5-0db77dc947a9 tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:39.181881 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0f5424d6-57c7-4363-a8b5-0db77dc947a9 tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:39.182501 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0f5424d6-57c7-4363-a8b5-0db77dc947a9 tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:39.183411 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0f5424d6-57c7-4363-a8b5-0db77dc947a9 tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:39.184077 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0f5424d6-57c7-4363-a8b5-0db77dc947a9 tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:39.184659 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0f5424d6-57c7-4363-a8b5-0db77dc947a9 tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:39.193356 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-9400b954-e7d2-42e9-8807-530c055737b9 tempest-FlavorsV2TestJSON-839536787 tempest-FlavorsV2TestJSON-839536787-project] 10.222.0.18 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.022618 Oct 22 20:59:39.197690 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1116/2394] 10.222.0.18 () {58 vars in 1137 bytes} [Sat Oct 22 20:59:39 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:59:39.205082 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-4fef5a90-191a-477c-a28f-159ba8016dee tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Calling method '.version_select at 0x7fd39f26c040>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:59:39.320813 ncdv-master-1 devstack@n-api.service[138744]: DEBUG neutronclient.v2_0.client [None req-4fef5a90-191a-477c-a28f-159ba8016dee tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 326b3bb2-542e-4abe-8a93-43ee175deff5 does not exist", "detail": ""}} {{(pid=138744) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 22 20:59:39.321427 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.network.security_group_api [None req-4fef5a90-191a-477c-a28f-159ba8016dee tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Neutron security group 326b3bb2-542e-4abe-8a93-43ee175deff5 not found {{(pid=138744) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 22 20:59:39.321957 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-4fef5a90-191a-477c-a28f-159ba8016dee tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] HTTP exception thrown: Security group 326b3bb2-542e-4abe-8a93-43ee175deff5 does not exist Oct 22 20:59:39.321957 ncdv-master-1 devstack@n-api.service[138744]: Neutron server returns request_ids: ['req-2d80e72f-35c5-476b-8530-0faab0a1fd28'] Oct 22 20:59:39.324183 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-4fef5a90-191a-477c-a28f-159ba8016dee tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Request method failure captured: Oct 22 20:59:39.324183 ncdv-master-1 devstack@n-api.service[138744]: request: GET /compute/v2.1/os-security-groups/326b3bb2-542e-4abe-8a93-43ee175deff5 HTTP/1.1 Oct 22 20:59:39.324183 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 20:59:39.324183 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 20:59:39.324183 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 20:59:39.324183 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 0 Oct 22 20:59:39.324183 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 20:59:39.324183 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 20:59:39.324183 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 20:59:39.324183 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 20:59:39.324183 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVFmMTFo8tMXHI466ygTiy0jTs5kz8YO2nFuimSyZRJI5bXNUfHpPLWjQrXyJ7I9Xfc54HQRfYflULj68lfwBk5jrnjY79oZ1kbdK55vumR_IVvMJmaykrPjWliG3H4xf-SZHnU3invPEATeZO7VP5aTca0hd9BauSvYCW1UPdVAZZ70 Oct 22 20:59:39.324183 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 20:59:39.324183 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 20:59:39.324183 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 20:59:39.324183 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 20:59:39.324183 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 20:59:39.324183 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 20:59:39.324183 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: ed31e93b0e8a43f28e497f94318815ce Oct 22 20:59:39.324183 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-SecurityGroupsTestJSON-1604956559 Oct 22 20:59:39.324183 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 20:59:39.324183 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 20:59:39.324183 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ed31e93b0e8a43f28e497f94318815ce"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ed31e93b0e8a43f28e497f94318815ce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ed31e93b0e8a43f28e497f94318815ce"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ed31e93b0e8a43f28e497f94318815ce"}]}] Oct 22 20:59:39.324183 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-SecurityGroupsTestJSON-1604956559 Oct 22 20:59:39.324183 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: ed31e93b0e8a43f28e497f94318815ce Oct 22 20:59:39.324183 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1604956559 Oct 22 20:59:39.324183 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-SecurityGroupsTestJSON-1604956559-project Oct 22 20:59:39.324183 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 20:59:39.324183 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 20:59:39.324183 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: 46d49952dbca4d95a25411b65d56552b Oct 22 20:59:39.324183 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-SecurityGroupsTestJSON-1604956559-project Oct 22 20:59:39.324183 ncdv-master-1 devstack@n-api.service[138744]: method: Oct 22 20:59:39.324183 ncdv-master-1 devstack@n-api.service[138744]: exception: Security group 326b3bb2-542e-4abe-8a93-43ee175deff5 does not exist Oct 22 20:59:39.324183 ncdv-master-1 devstack@n-api.service[138744]: Neutron server returns request_ids: ['req-2d80e72f-35c5-476b-8530-0faab0a1fd28'] Oct 22 20:59:39.324183 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': '326b3bb2-542e-4abe-8a93-43ee175deff5'} Oct 22 20:59:39.324183 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:59:39.324183 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:59:39.324183 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 22 20:59:39.324183 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 22 20:59:39.324183 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 20:59:39.324183 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 20:59:39.324183 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 22 20:59:39.324183 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 22 20:59:39.324183 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 20:59:39.324183 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 20:59:39.324183 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 22 20:59:39.324183 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 22 20:59:39.324183 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 20:59:39.324183 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 20:59:39.324183 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 22 20:59:39.324183 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 22 20:59:39.324183 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 20:59:39.324183 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 20:59:39.324183 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 22 20:59:39.324183 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 22 20:59:39.324183 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 20:59:39.324183 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 20:59:39.324183 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 22 20:59:39.324183 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 22 20:59:39.324183 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 22 20:59:39.324183 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 22 20:59:39.324183 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 326b3bb2-542e-4abe-8a93-43ee175deff5 does not exist Oct 22 20:59:39.327824 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2d80e72f-35c5-476b-8530-0faab0a1fd28'] Oct 22 20:59:39.327824 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:59:39.327824 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:59:39.327824 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:59:39.327824 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:59:39.327824 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 22 20:59:39.327824 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 22 20:59:39.327824 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 22 20:59:39.327824 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 22 20:59:39.327824 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 326b3bb2-542e-4abe-8a93-43ee175deff5 does not exist Oct 22 20:59:39.327824 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2d80e72f-35c5-476b-8530-0faab0a1fd28'] Oct 22 20:59:39.327824 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:59:39.327824 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:59:39.327824 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:59:39.327824 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:59:39.327824 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:59:39.327824 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:59:39.327824 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:59:39.327824 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:59:39.327824 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 22 20:59:39.327824 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 22 20:59:39.327824 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:59:39.327824 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:59:39.327824 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 22 20:59:39.327824 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 22 20:59:39.327824 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 326b3bb2-542e-4abe-8a93-43ee175deff5 does not exist Oct 22 20:59:39.327824 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2d80e72f-35c5-476b-8530-0faab0a1fd28'] Oct 22 20:59:39.327824 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:59:39.327824 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:59:39.327824 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:59:39.327824 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:59:39.327824 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:59:39.327824 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:59:39.327824 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 20:59:39.327824 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 20:59:39.327824 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 326b3bb2-542e-4abe-8a93-43ee175deff5 does not exist Oct 22 20:59:39.327824 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2d80e72f-35c5-476b-8530-0faab0a1fd28'] Oct 22 20:59:39.327824 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:59:39.327824 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-4fef5a90-191a-477c-a28f-159ba8016dee tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Returning 404 to user: Security group 326b3bb2-542e-4abe-8a93-43ee175deff5 does not exist Oct 22 20:59:39.327824 ncdv-master-1 devstack@n-api.service[138744]: Neutron server returns request_ids: ['req-2d80e72f-35c5-476b-8530-0faab0a1fd28'] {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:59:39.327824 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-4fef5a90-191a-477c-a28f-159ba8016dee tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] 10.222.0.18 "GET /compute/v2.1/os-security-groups/326b3bb2-542e-4abe-8a93-43ee175deff5" status: 404 len: 194 microversion: 2.1 time: 0.126603 Oct 22 20:59:39.327824 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1117/2395] 10.222.0.18 () {58 vars in 1269 bytes} [Sat Oct 22 20:59:39 2022] GET /compute/v2.1/os-security-groups/326b3bb2-542e-4abe-8a93-43ee175deff5 => generated 194 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 20:59:39.342058 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-7eb857a5-831a-4dee-8694-9c38697bd4f9 tempest-FlavorsV2TestJSON-839536787 tempest-FlavorsV2TestJSON-839536787-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:59:39.393462 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-7eb857a5-831a-4dee-8694-9c38697bd4f9 tempest-FlavorsV2TestJSON-839536787 tempest-FlavorsV2TestJSON-839536787-project] 10.222.0.18 "GET /compute/v2.1/flavors/detail?minRam=1025" status: 200 len: 2145 microversion: 2.1 time: 0.065677 Oct 22 20:59:39.395901 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1118/2396] 10.222.0.18 () {58 vars in 1169 bytes} [Sat Oct 22 20:59:39 2022] GET /compute/v2.1/flavors/detail?minRam=1025 => generated 2145 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:59:39.422213 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-fe6a1b82-e4c6-4256-b078-c5691b7cfbc1 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Calling method '.version_select at 0x7fd39f2bb700>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:59:39.611563 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-0f5424d6-57c7-4363-a8b5-0db77dc947a9 tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e36cd987f04f11b6a41325add4ccac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d79e903f8f24a348d5e771d434c70c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:59:39.621200 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-0f5424d6-57c7-4363-a8b5-0db77dc947a9 tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] 10.222.0.18 "GET /compute/v2.1/servers/ae58d60e-a113-4a38-94b5-b72a19c353e6" status: 200 len: 1522 microversion: 2.1 time: 0.452672 Oct 22 20:59:39.622711 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1279/2397] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:59:39 2022] GET /compute/v2.1/servers/ae58d60e-a113-4a38-94b5-b72a19c353e6 => generated 1522 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:59:39.641727 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-e41f2683-5fea-4b68-ab16-7a54587bda09 tempest-FlavorsV2TestJSON-839536787 tempest-FlavorsV2TestJSON-839536787-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:59:39.657405 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-e41f2683-5fea-4b68-ab16-7a54587bda09 tempest-FlavorsV2TestJSON-839536787 tempest-FlavorsV2TestJSON-839536787-project] 10.222.0.18 "GET /compute/v2.1/flavors/detail?limit=1" status: 200 len: 476 microversion: 2.1 time: 0.033192 Oct 22 20:59:39.658812 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1280/2398] 10.222.0.18 () {58 vars in 1161 bytes} [Sat Oct 22 20:59:39 2022] GET /compute/v2.1/flavors/detail?limit=1 => generated 476 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:59:39.664149 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-63ebe032-2673-4a24-b1a2-1e4c35924e86 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:59:39.664835 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-63ebe032-2673-4a24-b1a2-1e4c35924e86 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] [instance: f38f14b2-b9d7-4bed-92ba-7b95ea4b2270] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:59:39.686657 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-63ebe032-2673-4a24-b1a2-1e4c35924e86 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:39.687496 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-63ebe032-2673-4a24-b1a2-1e4c35924e86 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:39.688285 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-63ebe032-2673-4a24-b1a2-1e4c35924e86 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:39.689273 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-63ebe032-2673-4a24-b1a2-1e4c35924e86 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:39.689918 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-63ebe032-2673-4a24-b1a2-1e4c35924e86 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:39.690573 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-63ebe032-2673-4a24-b1a2-1e4c35924e86 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:40.152577 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-63ebe032-2673-4a24-b1a2-1e4c35924e86 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211483c6acea4f76b6c0e4bfc818e7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd687d54e07d4ab4af00ad801ef4b58d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:59:40.173345 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-fe6a1b82-e4c6-4256-b078-c5691b7cfbc1 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/17bb2929-41c0-43e3-930a-9c480452d22b" status: 202 len: 0 microversion: 2.1 time: 0.775436 Oct 22 20:59:40.174651 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1119/2399] 10.222.0.18 () {58 vars in 1272 bytes} [Sat Oct 22 20:59:39 2022] DELETE /compute/v2.1/os-security-groups/17bb2929-41c0-43e3-930a-9c480452d22b => generated 0 bytes in 778 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 20:59:40.181335 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-697bb4ac-cb11-4fdd-b444-ac21bc671e98 tempest-FlavorsV2TestJSON-839536787 tempest-FlavorsV2TestJSON-839536787-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:59:40.198384 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-63ebe032-2673-4a24-b1a2-1e4c35924e86 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '211483c6acea4f76b6c0e4bfc818e7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd687d54e07d4ab4af00ad801ef4b58d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:59:40.205446 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-697bb4ac-cb11-4fdd-b444-ac21bc671e98 tempest-FlavorsV2TestJSON-839536787 tempest-FlavorsV2TestJSON-839536787-project] 10.222.0.18 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.024825 Oct 22 20:59:40.206215 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-63ebe032-2673-4a24-b1a2-1e4c35924e86 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '211483c6acea4f76b6c0e4bfc818e7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd687d54e07d4ab4af00ad801ef4b58d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:59:40.214085 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1120/2400] 10.222.0.18 () {58 vars in 1137 bytes} [Sat Oct 22 20:59:40 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:59:40.214205 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-63ebe032-2673-4a24-b1a2-1e4c35924e86 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] 10.222.0.18 "GET /compute/v2.1/servers/f38f14b2-b9d7-4bed-92ba-7b95ea4b2270" status: 200 len: 1853 microversion: 2.42 time: 0.549400 Oct 22 20:59:40.214205 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1281/2401] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 20:59:39 2022] GET /compute/v2.1/servers/f38f14b2-b9d7-4bed-92ba-7b95ea4b2270 => generated 1853 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 20:59:40.219326 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-493c33f0-2980-4745-a5ba-d0acb126d0c6 req-ecf5236a-8fab-4521-80d9-8fc95b54067b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3e6246d-c32a-490d-ba83-84b54822f971", "tag": "140cd909-abde-4ea9-89c0-b130f4264b5b"}, {"name": "network-changed", "server_uuid": "f38f14b2-b9d7-4bed-92ba-7b95ea4b2270", "tag": "e8b58979-b36e-4d6b-8fde-739fbeb99ab8"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:59:40.231678 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-71a98142-5696-45c2-8915-b97a96d7fc78 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:59:40.233294 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-71a98142-5696-45c2-8915-b97a96d7fc78 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] [instance: c3e6246d-c32a-490d-ba83-84b54822f971] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:59:40.249039 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-493c33f0-2980-4745-a5ba-d0acb126d0c6 req-ecf5236a-8fab-4521-80d9-8fc95b54067b service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:40.249715 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-71a98142-5696-45c2-8915-b97a96d7fc78 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:40.251929 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-71a98142-5696-45c2-8915-b97a96d7fc78 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:40.252460 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-71a98142-5696-45c2-8915-b97a96d7fc78 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:40.252975 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-493c33f0-2980-4745-a5ba-d0acb126d0c6 req-ecf5236a-8fab-4521-80d9-8fc95b54067b service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:40.253887 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-71a98142-5696-45c2-8915-b97a96d7fc78 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:40.255804 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-493c33f0-2980-4745-a5ba-d0acb126d0c6 req-ecf5236a-8fab-4521-80d9-8fc95b54067b service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:40.256372 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-71a98142-5696-45c2-8915-b97a96d7fc78 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:40.260986 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-71a98142-5696-45c2-8915-b97a96d7fc78 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:40.277089 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-493c33f0-2980-4745-a5ba-d0acb126d0c6 req-ecf5236a-8fab-4521-80d9-8fc95b54067b service nova] Creating event network-changed:140cd909-abde-4ea9-89c0-b130f4264b5b for instance c3e6246d-c32a-490d-ba83-84b54822f971 on nch1-master-1 Oct 22 20:59:40.278056 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-493c33f0-2980-4745-a5ba-d0acb126d0c6 req-ecf5236a-8fab-4521-80d9-8fc95b54067b service nova] Creating event network-changed:e8b58979-b36e-4d6b-8fde-739fbeb99ab8 for instance f38f14b2-b9d7-4bed-92ba-7b95ea4b2270 on nch2-master-1 Oct 22 20:59:40.286101 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [req-493c33f0-2980-4745-a5ba-d0acb126d0c6 req-ecf5236a-8fab-4521-80d9-8fc95b54067b service nova] Instance c3e6246d-c32a-490d-ba83-84b54822f971 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=138744) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 22 20:59:40.304395 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-493c33f0-2980-4745-a5ba-d0acb126d0c6 req-ecf5236a-8fab-4521-80d9-8fc95b54067b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.094976 Oct 22 20:59:40.305788 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1121/2402] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:59:40 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:59:40.335804 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-00730fe8-a50f-413b-81b1-e73ae5dd0608 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Calling method '.version_select at 0x7fd3a4823e50>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:59:40.467215 ncdv-master-1 devstack@n-api.service[138744]: DEBUG neutronclient.v2_0.client [None req-00730fe8-a50f-413b-81b1-e73ae5dd0608 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 17bb2929-41c0-43e3-930a-9c480452d22b does not exist", "detail": ""}} {{(pid=138744) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 22 20:59:40.468420 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.network.security_group_api [None req-00730fe8-a50f-413b-81b1-e73ae5dd0608 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Neutron security group 17bb2929-41c0-43e3-930a-9c480452d22b not found {{(pid=138744) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 22 20:59:40.469139 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-00730fe8-a50f-413b-81b1-e73ae5dd0608 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] HTTP exception thrown: Security group 17bb2929-41c0-43e3-930a-9c480452d22b does not exist Oct 22 20:59:40.469139 ncdv-master-1 devstack@n-api.service[138744]: Neutron server returns request_ids: ['req-410cfa2e-10b8-4280-a3d8-0917ce498c06'] Oct 22 20:59:40.472045 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-00730fe8-a50f-413b-81b1-e73ae5dd0608 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Request method failure captured: Oct 22 20:59:40.472045 ncdv-master-1 devstack@n-api.service[138744]: request: GET /compute/v2.1/os-security-groups/17bb2929-41c0-43e3-930a-9c480452d22b HTTP/1.1 Oct 22 20:59:40.472045 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 20:59:40.472045 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 20:59:40.472045 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 20:59:40.472045 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 0 Oct 22 20:59:40.472045 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 20:59:40.472045 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 20:59:40.472045 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 20:59:40.472045 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 20:59:40.472045 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVFmMTFo8tMXHI466ygTiy0jTs5kz8YO2nFuimSyZRJI5bXNUfHpPLWjQrXyJ7I9Xfc54HQRfYflULj68lfwBk5jrnjY79oZ1kbdK55vumR_IVvMJmaykrPjWliG3H4xf-SZHnU3invPEATeZO7VP5aTca0hd9BauSvYCW1UPdVAZZ70 Oct 22 20:59:40.472045 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 20:59:40.472045 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 20:59:40.472045 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 20:59:40.472045 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 20:59:40.472045 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 20:59:40.472045 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 20:59:40.472045 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: ed31e93b0e8a43f28e497f94318815ce Oct 22 20:59:40.472045 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-SecurityGroupsTestJSON-1604956559 Oct 22 20:59:40.472045 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 20:59:40.472045 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 20:59:40.472045 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ed31e93b0e8a43f28e497f94318815ce"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ed31e93b0e8a43f28e497f94318815ce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ed31e93b0e8a43f28e497f94318815ce"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ed31e93b0e8a43f28e497f94318815ce"}]}] Oct 22 20:59:40.472045 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-SecurityGroupsTestJSON-1604956559 Oct 22 20:59:40.472045 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: ed31e93b0e8a43f28e497f94318815ce Oct 22 20:59:40.472045 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1604956559 Oct 22 20:59:40.472045 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-SecurityGroupsTestJSON-1604956559-project Oct 22 20:59:40.472045 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 20:59:40.472045 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 20:59:40.472045 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: 46d49952dbca4d95a25411b65d56552b Oct 22 20:59:40.472045 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-SecurityGroupsTestJSON-1604956559-project Oct 22 20:59:40.472045 ncdv-master-1 devstack@n-api.service[138744]: method: Oct 22 20:59:40.472045 ncdv-master-1 devstack@n-api.service[138744]: exception: Security group 17bb2929-41c0-43e3-930a-9c480452d22b does not exist Oct 22 20:59:40.472045 ncdv-master-1 devstack@n-api.service[138744]: Neutron server returns request_ids: ['req-410cfa2e-10b8-4280-a3d8-0917ce498c06'] Oct 22 20:59:40.472045 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': '17bb2929-41c0-43e3-930a-9c480452d22b'} Oct 22 20:59:40.472045 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:59:40.472045 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:59:40.472045 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 22 20:59:40.472045 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 22 20:59:40.472045 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 20:59:40.472045 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 20:59:40.472045 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 22 20:59:40.472045 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 22 20:59:40.472045 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 20:59:40.472045 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 20:59:40.472045 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 22 20:59:40.472045 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 22 20:59:40.472045 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 20:59:40.472045 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 20:59:40.472045 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 22 20:59:40.472045 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 22 20:59:40.472045 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 20:59:40.472045 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 20:59:40.472045 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 22 20:59:40.472045 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 22 20:59:40.472045 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 20:59:40.472045 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 20:59:40.472045 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 22 20:59:40.472045 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 22 20:59:40.472045 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 22 20:59:40.472045 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 22 20:59:40.472045 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 17bb2929-41c0-43e3-930a-9c480452d22b does not exist Oct 22 20:59:40.476950 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-410cfa2e-10b8-4280-a3d8-0917ce498c06'] Oct 22 20:59:40.476950 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:59:40.476950 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:59:40.476950 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:59:40.476950 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:59:40.476950 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 22 20:59:40.476950 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 22 20:59:40.476950 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 22 20:59:40.476950 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 22 20:59:40.476950 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 17bb2929-41c0-43e3-930a-9c480452d22b does not exist Oct 22 20:59:40.476950 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-410cfa2e-10b8-4280-a3d8-0917ce498c06'] Oct 22 20:59:40.476950 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:59:40.476950 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:59:40.476950 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:59:40.476950 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:59:40.476950 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:59:40.476950 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:59:40.476950 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:59:40.476950 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:59:40.476950 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 22 20:59:40.476950 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 22 20:59:40.476950 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:59:40.476950 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:59:40.476950 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 22 20:59:40.476950 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 22 20:59:40.476950 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 17bb2929-41c0-43e3-930a-9c480452d22b does not exist Oct 22 20:59:40.476950 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-410cfa2e-10b8-4280-a3d8-0917ce498c06'] Oct 22 20:59:40.476950 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:59:40.476950 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:59:40.476950 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:59:40.476950 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:59:40.476950 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:59:40.476950 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:59:40.476950 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 20:59:40.476950 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 20:59:40.476950 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 17bb2929-41c0-43e3-930a-9c480452d22b does not exist Oct 22 20:59:40.476950 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-410cfa2e-10b8-4280-a3d8-0917ce498c06'] Oct 22 20:59:40.476950 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:59:40.481070 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-00730fe8-a50f-413b-81b1-e73ae5dd0608 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Returning 404 to user: Security group 17bb2929-41c0-43e3-930a-9c480452d22b does not exist Oct 22 20:59:40.481070 ncdv-master-1 devstack@n-api.service[138744]: Neutron server returns request_ids: ['req-410cfa2e-10b8-4280-a3d8-0917ce498c06'] {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:59:40.482433 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-00730fe8-a50f-413b-81b1-e73ae5dd0608 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] 10.222.0.18 "GET /compute/v2.1/os-security-groups/17bb2929-41c0-43e3-930a-9c480452d22b" status: 404 len: 194 microversion: 2.1 time: 0.171259 Oct 22 20:59:40.487511 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1122/2403] 10.222.0.18 () {58 vars in 1269 bytes} [Sat Oct 22 20:59:40 2022] GET /compute/v2.1/os-security-groups/17bb2929-41c0-43e3-930a-9c480452d22b => generated 194 bytes in 181 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 20:59:40.497819 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-a993a488-b118-4489-8d23-88ff6562c009 tempest-FlavorsV2TestJSON-839536787 tempest-FlavorsV2TestJSON-839536787-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:59:40.540380 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-a993a488-b118-4489-8d23-88ff6562c009 tempest-FlavorsV2TestJSON-839536787 tempest-FlavorsV2TestJSON-839536787-project] 10.222.0.18 "GET /compute/v2.1/flavors/detail?marker=452" status: 200 len: 2500 microversion: 2.1 time: 0.050441 Oct 22 20:59:40.541032 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1123/2404] 10.222.0.18 () {58 vars in 1167 bytes} [Sat Oct 22 20:59:40 2022] GET /compute/v2.1/flavors/detail?marker=452 => generated 2500 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:59:40.546310 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-4bdf229f-216a-4325-bafd-165348f43674 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Calling method '.version_select at 0x7fd39f320b80>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:59:40.787011 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-71a98142-5696-45c2-8915-b97a96d7fc78 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d3d7458af447bdb3f03e83a2d8559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49238b8686d24ae698679e4a1957735d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:59:40.801445 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-71a98142-5696-45c2-8915-b97a96d7fc78 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] 10.222.0.18 "GET /compute/v2.1/servers/c3e6246d-c32a-490d-ba83-84b54822f971" status: 200 len: 1469 microversion: 2.1 time: 0.586048 Oct 22 20:59:40.802837 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1282/2405] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:59:40 2022] GET /compute/v2.1/servers/c3e6246d-c32a-490d-ba83-84b54822f971 => generated 1469 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:59:40.809185 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-f0c0c0a3-7456-40ea-b7a5-b5cfc7ae8602 tempest-FlavorsV2TestJSON-839536787 tempest-FlavorsV2TestJSON-839536787-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:59:40.822666 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-f0c0c0a3-7456-40ea-b7a5-b5cfc7ae8602 tempest-FlavorsV2TestJSON-839536787 tempest-FlavorsV2TestJSON-839536787-project] 10.222.0.18 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.017468 Oct 22 20:59:40.835875 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1283/2406] 10.222.0.18 () {58 vars in 1137 bytes} [Sat Oct 22 20:59:40 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:59:40.839171 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:59:40.847449 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-cae06e26-8bd4-43c9-901f-223c4e10dff0 tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:59:40.849381 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-cae06e26-8bd4-43c9-901f-223c4e10dff0 tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] [instance: ae58d60e-a113-4a38-94b5-b72a19c353e6] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:59:40.867971 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cae06e26-8bd4-43c9-901f-223c4e10dff0 tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:40.868640 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cae06e26-8bd4-43c9-901f-223c4e10dff0 tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:40.869536 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cae06e26-8bd4-43c9-901f-223c4e10dff0 tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:40.870385 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cae06e26-8bd4-43c9-901f-223c4e10dff0 tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:40.871086 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cae06e26-8bd4-43c9-901f-223c4e10dff0 tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:40.871806 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cae06e26-8bd4-43c9-901f-223c4e10dff0 tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:40.883866 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:59:41.746626 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-4bdf229f-216a-4325-bafd-165348f43674 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] 10.222.0.18 "GET /compute/v2.1/os-security-groups" status: 200 len: 1158 microversion: 2.1 time: 1.203753 Oct 22 20:59:41.759987 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1124/2407] 10.222.0.18 () {58 vars in 1158 bytes} [Sat Oct 22 20:59:40 2022] GET /compute/v2.1/os-security-groups => generated 1158 bytes in 1218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:59:41.766008 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-eaf1a4ff-7942-4295-bf31-beed61650de4 tempest-FlavorsV2TestJSON-839536787 tempest-FlavorsV2TestJSON-839536787-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:59:41.782794 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-cae06e26-8bd4-43c9-901f-223c4e10dff0 tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e36cd987f04f11b6a41325add4ccac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d79e903f8f24a348d5e771d434c70c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:59:41.791670 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-cae06e26-8bd4-43c9-901f-223c4e10dff0 tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] 10.222.0.18 "GET /compute/v2.1/servers/ae58d60e-a113-4a38-94b5-b72a19c353e6" status: 200 len: 1522 microversion: 2.1 time: 0.953646 Oct 22 20:59:41.797229 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1284/2408] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:59:40 2022] GET /compute/v2.1/servers/ae58d60e-a113-4a38-94b5-b72a19c353e6 => generated 1522 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:59:41.817405 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-eaf1a4ff-7942-4295-bf31-beed61650de4 tempest-FlavorsV2TestJSON-839536787 tempest-FlavorsV2TestJSON-839536787-project] 10.222.0.18 "GET /compute/v2.1/flavors?minDisk=2" status: 200 len: 1663 microversion: 2.1 time: 0.055689 Oct 22 20:59:41.818852 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-e7696947-ec53-49db-98bd-0609ca8e11b7 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:59:41.819519 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1125/2409] 10.222.0.18 () {58 vars in 1144 bytes} [Sat Oct 22 20:59:41 2022] GET /compute/v2.1/flavors?minDisk=2 => generated 1663 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:59:41.820169 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-e7696947-ec53-49db-98bd-0609ca8e11b7 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] [instance: f38f14b2-b9d7-4bed-92ba-7b95ea4b2270] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:59:41.825472 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-9e548008-58a3-4529-82c4-1d31b40bc609 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Action: 'create', calling method: .version_select at 0x7fd39f320dc0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1144368619", "description": "tempest-description-84076916"}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:59:41.832932 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e7696947-ec53-49db-98bd-0609ca8e11b7 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:41.833769 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e7696947-ec53-49db-98bd-0609ca8e11b7 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:41.834450 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e7696947-ec53-49db-98bd-0609ca8e11b7 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:41.835474 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e7696947-ec53-49db-98bd-0609ca8e11b7 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:41.835999 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e7696947-ec53-49db-98bd-0609ca8e11b7 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:41.836499 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e7696947-ec53-49db-98bd-0609ca8e11b7 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:42.253437 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-e7696947-ec53-49db-98bd-0609ca8e11b7 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211483c6acea4f76b6c0e4bfc818e7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd687d54e07d4ab4af00ad801ef4b58d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:59:42.268904 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-e7696947-ec53-49db-98bd-0609ca8e11b7 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '211483c6acea4f76b6c0e4bfc818e7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd687d54e07d4ab4af00ad801ef4b58d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:59:42.271767 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-e7696947-ec53-49db-98bd-0609ca8e11b7 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '211483c6acea4f76b6c0e4bfc818e7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd687d54e07d4ab4af00ad801ef4b58d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:59:42.274077 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-e7696947-ec53-49db-98bd-0609ca8e11b7 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] 10.222.0.18 "GET /compute/v2.1/servers/f38f14b2-b9d7-4bed-92ba-7b95ea4b2270" status: 200 len: 1874 microversion: 2.42 time: 0.475216 Oct 22 20:59:42.303131 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1285/2410] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 20:59:41 2022] GET /compute/v2.1/servers/f38f14b2-b9d7-4bed-92ba-7b95ea4b2270 => generated 1874 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 20:59:42.311476 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-93e52397-cc26-47a1-9486-5508fb22395b tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:59:42.312329 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-93e52397-cc26-47a1-9486-5508fb22395b tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] [instance: c3e6246d-c32a-490d-ba83-84b54822f971] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:59:42.339296 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-93e52397-cc26-47a1-9486-5508fb22395b tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:42.340303 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-93e52397-cc26-47a1-9486-5508fb22395b tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:42.341794 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-93e52397-cc26-47a1-9486-5508fb22395b tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:42.344128 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-93e52397-cc26-47a1-9486-5508fb22395b tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:42.350371 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-93e52397-cc26-47a1-9486-5508fb22395b tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:42.351971 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-93e52397-cc26-47a1-9486-5508fb22395b tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:42.360976 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-9e548008-58a3-4529-82c4-1d31b40bc609 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] 10.222.0.18 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.540265 Oct 22 20:59:42.362024 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1126/2411] 10.222.0.18 () {60 vars in 1180 bytes} [Sat Oct 22 20:59:41 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:59:42.367157 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-3eb281af-e462-4bfa-b27a-fbedf5c8607b tempest-FlavorsV2TestJSON-839536787 tempest-FlavorsV2TestJSON-839536787-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:59:42.389589 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-3eb281af-e462-4bfa-b27a-fbedf5c8607b tempest-FlavorsV2TestJSON-839536787 tempest-FlavorsV2TestJSON-839536787-project] 10.222.0.18 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.026142 Oct 22 20:59:42.395369 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1127/2412] 10.222.0.18 () {58 vars in 1137 bytes} [Sat Oct 22 20:59:42 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:59:42.401838 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-db4f1454-8269-4fb5-949a-5c5032e3789a req-7b5d244a-5f2f-468d-a5c7-bdea5596393b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f38f14b2-b9d7-4bed-92ba-7b95ea4b2270", "tag": "b6fc5821-644a-4f87-9788-a1775a1d521d"}, {"name": "network-changed", "server_uuid": "f38f14b2-b9d7-4bed-92ba-7b95ea4b2270", "tag": "721b179f-1381-454b-b0cc-f9d4497ccc12"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:59:42.413094 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-db4f1454-8269-4fb5-949a-5c5032e3789a req-7b5d244a-5f2f-468d-a5c7-bdea5596393b service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:42.413582 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-db4f1454-8269-4fb5-949a-5c5032e3789a req-7b5d244a-5f2f-468d-a5c7-bdea5596393b service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:42.414021 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-db4f1454-8269-4fb5-949a-5c5032e3789a req-7b5d244a-5f2f-468d-a5c7-bdea5596393b service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:42.428535 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-db4f1454-8269-4fb5-949a-5c5032e3789a req-7b5d244a-5f2f-468d-a5c7-bdea5596393b service nova] Creating event network-changed:b6fc5821-644a-4f87-9788-a1775a1d521d for instance f38f14b2-b9d7-4bed-92ba-7b95ea4b2270 on nch2-master-1 Oct 22 20:59:42.429681 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-db4f1454-8269-4fb5-949a-5c5032e3789a req-7b5d244a-5f2f-468d-a5c7-bdea5596393b service nova] Creating event network-changed:721b179f-1381-454b-b0cc-f9d4497ccc12 for instance f38f14b2-b9d7-4bed-92ba-7b95ea4b2270 on nch2-master-1 Oct 22 20:59:42.435757 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-db4f1454-8269-4fb5-949a-5c5032e3789a req-7b5d244a-5f2f-468d-a5c7-bdea5596393b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.038293 Oct 22 20:59:42.437273 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1128/2413] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:59:42 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:59:42.443238 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-9bf76d87-c934-4422-9089-9e2e46c49601 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Action: 'create', calling method: .version_select at 0x7fd39f21f280>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1980962167", "description": "tempest-description-16387569"}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:59:42.708927 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-93e52397-cc26-47a1-9486-5508fb22395b tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d3d7458af447bdb3f03e83a2d8559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49238b8686d24ae698679e4a1957735d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:59:42.724553 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-93e52397-cc26-47a1-9486-5508fb22395b tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] 10.222.0.18 "GET /compute/v2.1/servers/c3e6246d-c32a-490d-ba83-84b54822f971" status: 200 len: 1469 microversion: 2.1 time: 0.414069 Oct 22 20:59:42.731396 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1286/2414] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:59:42 2022] GET /compute/v2.1/servers/c3e6246d-c32a-490d-ba83-84b54822f971 => generated 1469 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:59:42.731396 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-89f2c905-ee7a-48ed-8a53-6261a7b4c93d tempest-FlavorsV2TestJSON-839536787 tempest-FlavorsV2TestJSON-839536787-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:59:42.794524 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-89f2c905-ee7a-48ed-8a53-6261a7b4c93d tempest-FlavorsV2TestJSON-839536787 tempest-FlavorsV2TestJSON-839536787-project] 10.222.0.18 "GET /compute/v2.1/flavors?minRam=1025" status: 200 len: 1111 microversion: 2.1 time: 0.067125 Oct 22 20:59:42.796440 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1287/2415] 10.222.0.18 () {58 vars in 1148 bytes} [Sat Oct 22 20:59:42 2022] GET /compute/v2.1/flavors?minRam=1025 => generated 1111 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:59:42.811186 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-75cee497-86ca-4f37-9009-cff708afbcd6 tempest-FlavorsV2TestJSON-839536787 tempest-FlavorsV2TestJSON-839536787-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:59:42.832927 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-75cee497-86ca-4f37-9009-cff708afbcd6 tempest-FlavorsV2TestJSON-839536787 tempest-FlavorsV2TestJSON-839536787-project] 10.222.0.18 "GET /compute/v2.1/flavors?limit=1" status: 200 len: 299 microversion: 2.1 time: 0.026457 Oct 22 20:59:42.834192 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1288/2416] 10.222.0.18 () {58 vars in 1140 bytes} [Sat Oct 22 20:59:42 2022] GET /compute/v2.1/flavors?limit=1 => generated 299 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:59:42.841859 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-7299c4da-5ede-4cdd-81d2-acc79417cfb7 tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:59:42.842826 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-7299c4da-5ede-4cdd-81d2-acc79417cfb7 tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] [instance: ae58d60e-a113-4a38-94b5-b72a19c353e6] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:59:42.851458 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7299c4da-5ede-4cdd-81d2-acc79417cfb7 tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:42.852268 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7299c4da-5ede-4cdd-81d2-acc79417cfb7 tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:42.852869 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7299c4da-5ede-4cdd-81d2-acc79417cfb7 tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:42.853749 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7299c4da-5ede-4cdd-81d2-acc79417cfb7 tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:42.854356 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7299c4da-5ede-4cdd-81d2-acc79417cfb7 tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:42.854940 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7299c4da-5ede-4cdd-81d2-acc79417cfb7 tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:43.004957 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-9bf76d87-c934-4422-9089-9e2e46c49601 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] 10.222.0.18 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.566102 Oct 22 20:59:43.005855 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1129/2417] 10.222.0.18 () {60 vars in 1180 bytes} [Sat Oct 22 20:59:42 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:59:43.014041 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-1251b65c-b7ba-4730-bd5d-00ec91f9e8f7 tempest-FlavorsV2TestJSON-839536787 tempest-FlavorsV2TestJSON-839536787-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:59:43.029928 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-1251b65c-b7ba-4730-bd5d-00ec91f9e8f7 tempest-FlavorsV2TestJSON-839536787 tempest-FlavorsV2TestJSON-839536787-project] 10.222.0.18 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.019774 Oct 22 20:59:43.030548 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1130/2418] 10.222.0.18 () {58 vars in 1137 bytes} [Sat Oct 22 20:59:43 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:59:43.043549 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-a192411c-dba7-47b5-a1f7-0f3f95044755 tempest-FlavorsV2TestJSON-839536787 tempest-FlavorsV2TestJSON-839536787-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:59:43.089567 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-a192411c-dba7-47b5-a1f7-0f3f95044755 tempest-FlavorsV2TestJSON-839536787 tempest-FlavorsV2TestJSON-839536787-project] 10.222.0.18 "GET /compute/v2.1/flavors?marker=452" status: 200 len: 1300 microversion: 2.1 time: 0.050050 Oct 22 20:59:43.090841 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1131/2419] 10.222.0.18 () {58 vars in 1146 bytes} [Sat Oct 22 20:59:43 2022] GET /compute/v2.1/flavors?marker=452 => generated 1300 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:59:43.107139 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-cf60600b-f6ab-40f3-8963-0bb8f7b010d2 tempest-FlavorsV2TestJSON-839536787 tempest-FlavorsV2TestJSON-839536787-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:59:43.130000 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-cf60600b-f6ab-40f3-8963-0bb8f7b010d2 tempest-FlavorsV2TestJSON-839536787 tempest-FlavorsV2TestJSON-839536787-project] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.027212 Oct 22 20:59:43.131232 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1132/2420] 10.222.0.18 () {58 vars in 1146 bytes} [Sat Oct 22 20:59:43 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:59:43.153123 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-02d130d2-d0f9-4c91-be7a-215e58b98d54 tempest-FlavorsV2TestJSON-839536787 tempest-FlavorsV2TestJSON-839536787-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:59:43.166794 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-02d130d2-d0f9-4c91-be7a-215e58b98d54 tempest-FlavorsV2TestJSON-839536787 tempest-FlavorsV2TestJSON-839536787-project] 10.222.0.18 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.018320 Oct 22 20:59:43.168290 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1133/2421] 10.222.0.18 () {58 vars in 1137 bytes} [Sat Oct 22 20:59:43 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:59:43.222915 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-405227a4-8e29-4a67-8ac2-12c36b59a661 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-361785363", "imageRef": "085e4478-6edc-4a69-8e08-f9831713eb65", "flavorRef": "452", "networks": [{"uuid": "a5d4328d-f0bd-4bb4-b222-8621ca60aa66"}]}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:59:43.325570 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-7299c4da-5ede-4cdd-81d2-acc79417cfb7 tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e36cd987f04f11b6a41325add4ccac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d79e903f8f24a348d5e771d434c70c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:59:43.336198 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-7299c4da-5ede-4cdd-81d2-acc79417cfb7 tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] 10.222.0.18 "GET /compute/v2.1/servers/ae58d60e-a113-4a38-94b5-b72a19c353e6" status: 200 len: 1522 microversion: 2.1 time: 0.500574 Oct 22 20:59:43.337437 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1289/2422] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:59:42 2022] GET /compute/v2.1/servers/ae58d60e-a113-4a38-94b5-b72a19c353e6 => generated 1522 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:59:43.345111 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-011bc598-18ab-4f1f-8a76-dcd490176e11 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:59:43.346605 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-011bc598-18ab-4f1f-8a76-dcd490176e11 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] [instance: f38f14b2-b9d7-4bed-92ba-7b95ea4b2270] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:59:43.349854 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.network.neutron [None req-405227a4-8e29-4a67-8ac2-12c36b59a661 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] validate_networks() for [('a5d4328d-f0bd-4bb4-b222-8621ca60aa66', None, None, None, None, None)] {{(pid=138744) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 20:59:43.355249 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-011bc598-18ab-4f1f-8a76-dcd490176e11 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:43.356428 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-011bc598-18ab-4f1f-8a76-dcd490176e11 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:43.357318 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-011bc598-18ab-4f1f-8a76-dcd490176e11 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:43.358487 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-011bc598-18ab-4f1f-8a76-dcd490176e11 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:43.359118 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-011bc598-18ab-4f1f-8a76-dcd490176e11 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:43.359892 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-011bc598-18ab-4f1f-8a76-dcd490176e11 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:44.200502 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-011bc598-18ab-4f1f-8a76-dcd490176e11 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211483c6acea4f76b6c0e4bfc818e7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd687d54e07d4ab4af00ad801ef4b58d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:59:44.210555 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-011bc598-18ab-4f1f-8a76-dcd490176e11 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '211483c6acea4f76b6c0e4bfc818e7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd687d54e07d4ab4af00ad801ef4b58d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:59:44.212420 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-011bc598-18ab-4f1f-8a76-dcd490176e11 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '211483c6acea4f76b6c0e4bfc818e7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd687d54e07d4ab4af00ad801ef4b58d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:59:44.213869 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-011bc598-18ab-4f1f-8a76-dcd490176e11 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] 10.222.0.18 "GET /compute/v2.1/servers/f38f14b2-b9d7-4bed-92ba-7b95ea4b2270" status: 200 len: 1874 microversion: 2.42 time: 0.873816 Oct 22 20:59:44.214971 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1290/2423] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 20:59:43 2022] GET /compute/v2.1/servers/f38f14b2-b9d7-4bed-92ba-7b95ea4b2270 => generated 1874 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 20:59:44.219914 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-7562b70d-561e-4573-9ede-3f2a6ab97c2c tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:59:44.220818 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-7562b70d-561e-4573-9ede-3f2a6ab97c2c tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] [instance: c3e6246d-c32a-490d-ba83-84b54822f971] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:59:44.227649 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7562b70d-561e-4573-9ede-3f2a6ab97c2c tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:44.228453 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7562b70d-561e-4573-9ede-3f2a6ab97c2c tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:44.229117 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7562b70d-561e-4573-9ede-3f2a6ab97c2c tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:44.230081 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7562b70d-561e-4573-9ede-3f2a6ab97c2c tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:44.231030 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7562b70d-561e-4573-9ede-3f2a6ab97c2c tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:44.231725 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7562b70d-561e-4573-9ede-3f2a6ab97c2c tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:44.804292 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-7562b70d-561e-4573-9ede-3f2a6ab97c2c tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d3d7458af447bdb3f03e83a2d8559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49238b8686d24ae698679e4a1957735d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:59:44.823108 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-7562b70d-561e-4573-9ede-3f2a6ab97c2c tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] 10.222.0.18 "GET /compute/v2.1/servers/c3e6246d-c32a-490d-ba83-84b54822f971" status: 200 len: 1462 microversion: 2.1 time: 0.606694 Oct 22 20:59:44.824535 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1291/2424] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:59:44 2022] GET /compute/v2.1/servers/c3e6246d-c32a-490d-ba83-84b54822f971 => generated 1462 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:59:44.831726 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-22a82950-6f09-4f44-8a6c-5e6b261abb98 tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:59:44.832562 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-22a82950-6f09-4f44-8a6c-5e6b261abb98 tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] [instance: ae58d60e-a113-4a38-94b5-b72a19c353e6] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:59:44.857848 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-22a82950-6f09-4f44-8a6c-5e6b261abb98 tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:44.858840 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-22a82950-6f09-4f44-8a6c-5e6b261abb98 tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:44.859629 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-22a82950-6f09-4f44-8a6c-5e6b261abb98 tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:44.861486 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-22a82950-6f09-4f44-8a6c-5e6b261abb98 tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:44.862293 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-22a82950-6f09-4f44-8a6c-5e6b261abb98 tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:44.862925 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-22a82950-6f09-4f44-8a6c-5e6b261abb98 tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:45.401808 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-22a82950-6f09-4f44-8a6c-5e6b261abb98 tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e36cd987f04f11b6a41325add4ccac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d79e903f8f24a348d5e771d434c70c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:59:45.422537 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-22a82950-6f09-4f44-8a6c-5e6b261abb98 tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] 10.222.0.18 "GET /compute/v2.1/servers/ae58d60e-a113-4a38-94b5-b72a19c353e6" status: 200 len: 1522 microversion: 2.1 time: 0.594463 Oct 22 20:59:45.425728 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1292/2425] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:59:44 2022] GET /compute/v2.1/servers/ae58d60e-a113-4a38-94b5-b72a19c353e6 => generated 1522 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:59:45.601764 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-405227a4-8e29-4a67-8ac2-12c36b59a661 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Flavor limits 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 20:59:45.603509 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-405227a4-8e29-4a67-8ac2-12c36b59a661 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Image limits 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 20:59:45.604758 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-405227a4-8e29-4a67-8ac2-12c36b59a661 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Flavor pref 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 20:59:45.606138 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-405227a4-8e29-4a67-8ac2-12c36b59a661 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Image pref 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 20:59:45.607932 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-405227a4-8e29-4a67-8ac2-12c36b59a661 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 20:59:45.628847 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-405227a4-8e29-4a67-8ac2-12c36b59a661 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:45.630758 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-405227a4-8e29-4a67-8ac2-12c36b59a661 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:45.633115 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-405227a4-8e29-4a67-8ac2-12c36b59a661 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:45.634109 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-405227a4-8e29-4a67-8ac2-12c36b59a661 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:45.635284 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-405227a4-8e29-4a67-8ac2-12c36b59a661 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:45.636067 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-405227a4-8e29-4a67-8ac2-12c36b59a661 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:45.686550 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-405227a4-8e29-4a67-8ac2-12c36b59a661 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Getting quotas for project ed31e93b0e8a43f28e497f94318815ce. Resources: {'cores', 'instances', 'ram'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 20:59:45.702272 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-405227a4-8e29-4a67-8ac2-12c36b59a661 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Getting quotas for user 46d49952dbca4d95a25411b65d56552b and project ed31e93b0e8a43f28e497f94318815ce. Resources: {'cores', 'instances', 'ram'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 20:59:45.736238 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-405227a4-8e29-4a67-8ac2-12c36b59a661 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Going to run 1 instances... {{(pid=138744) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 20:59:45.744953 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-405227a4-8e29-4a67-8ac2-12c36b59a661 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] [instance: 7dde7a20-b949-4c72-ae19-83f2f0afd0d1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='085e4478-6edc-4a69-8e08-f9831713eb65',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138744) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 20:59:45.804907 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-a6a1129a-8525-41b2-88d9-6858232927ae tempest-MigrationsAdminTest-1403807426 tempest-MigrationsAdminTest-1403807426-project-admin] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:59:45.805531 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-a6a1129a-8525-41b2-88d9-6858232927ae tempest-MigrationsAdminTest-1403807426 tempest-MigrationsAdminTest-1403807426-project-admin] [instance: c3e6246d-c32a-490d-ba83-84b54822f971] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:59:45.817827 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a6a1129a-8525-41b2-88d9-6858232927ae tempest-MigrationsAdminTest-1403807426 tempest-MigrationsAdminTest-1403807426-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:45.818683 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a6a1129a-8525-41b2-88d9-6858232927ae tempest-MigrationsAdminTest-1403807426 tempest-MigrationsAdminTest-1403807426-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:45.831153 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a6a1129a-8525-41b2-88d9-6858232927ae tempest-MigrationsAdminTest-1403807426 tempest-MigrationsAdminTest-1403807426-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:45.832343 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a6a1129a-8525-41b2-88d9-6858232927ae tempest-MigrationsAdminTest-1403807426 tempest-MigrationsAdminTest-1403807426-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:45.832836 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a6a1129a-8525-41b2-88d9-6858232927ae tempest-MigrationsAdminTest-1403807426 tempest-MigrationsAdminTest-1403807426-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:45.833732 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a6a1129a-8525-41b2-88d9-6858232927ae tempest-MigrationsAdminTest-1403807426 tempest-MigrationsAdminTest-1403807426-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:45.841263 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-405227a4-8e29-4a67-8ac2-12c36b59a661 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.626167 Oct 22 20:59:45.849806 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1134/2426] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Oct 22 20:59:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 2635 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 20:59:45.855835 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-8865143a-8c9e-49df-9ad8-cc295c90f361 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:59:45.856921 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-8865143a-8c9e-49df-9ad8-cc295c90f361 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] [instance: f38f14b2-b9d7-4bed-92ba-7b95ea4b2270] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:59:45.868485 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8865143a-8c9e-49df-9ad8-cc295c90f361 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:45.870370 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8865143a-8c9e-49df-9ad8-cc295c90f361 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:45.871025 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8865143a-8c9e-49df-9ad8-cc295c90f361 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:45.872063 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8865143a-8c9e-49df-9ad8-cc295c90f361 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:45.872938 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8865143a-8c9e-49df-9ad8-cc295c90f361 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:45.873629 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8865143a-8c9e-49df-9ad8-cc295c90f361 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:46.301392 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-a6a1129a-8525-41b2-88d9-6858232927ae tempest-MigrationsAdminTest-1403807426 tempest-MigrationsAdminTest-1403807426-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/c3e6246d-c32a-490d-ba83-84b54822f971" status: 200 len: 1613 microversion: 2.1 time: 0.874338 Oct 22 20:59:46.326463 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1293/2427] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:59:45 2022] GET /compute/v2.1/servers/c3e6246d-c32a-490d-ba83-84b54822f971 => generated 1613 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:59:46.331956 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-ddbccd39-1161-4708-a929-b4cda154e99a req-9576a8e0-50f4-4f14-9061-19493be89ee5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f38f14b2-b9d7-4bed-92ba-7b95ea4b2270", "tag": "e1aa03d1-429d-47fc-a834-f0bbaa09e3c6"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:59:46.359917 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-ddbccd39-1161-4708-a929-b4cda154e99a req-9576a8e0-50f4-4f14-9061-19493be89ee5 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:46.361788 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-ddbccd39-1161-4708-a929-b4cda154e99a req-9576a8e0-50f4-4f14-9061-19493be89ee5 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:46.363255 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-ddbccd39-1161-4708-a929-b4cda154e99a req-9576a8e0-50f4-4f14-9061-19493be89ee5 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:46.395729 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-ddbccd39-1161-4708-a929-b4cda154e99a req-9576a8e0-50f4-4f14-9061-19493be89ee5 service nova] Creating event network-changed:e1aa03d1-429d-47fc-a834-f0bbaa09e3c6 for instance f38f14b2-b9d7-4bed-92ba-7b95ea4b2270 on nch2-master-1 Oct 22 20:59:46.431910 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-ddbccd39-1161-4708-a929-b4cda154e99a req-9576a8e0-50f4-4f14-9061-19493be89ee5 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087935 Oct 22 20:59:46.438152 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1294/2428] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:59:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:59:46.458833 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-5027342f-1ebd-4036-89c6-7a445da0dec6 req-9e643b5f-a863-4359-b95a-6b2a3fe409a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3e6246d-c32a-490d-ba83-84b54822f971", "name": "network-vif-plugged", "status": "completed", "tag": "140cd909-abde-4ea9-89c0-b130f4264b5b"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:59:46.482368 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-5027342f-1ebd-4036-89c6-7a445da0dec6 req-9e643b5f-a863-4359-b95a-6b2a3fe409a9 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:46.482991 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-5027342f-1ebd-4036-89c6-7a445da0dec6 req-9e643b5f-a863-4359-b95a-6b2a3fe409a9 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:46.483732 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-5027342f-1ebd-4036-89c6-7a445da0dec6 req-9e643b5f-a863-4359-b95a-6b2a3fe409a9 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:46.498860 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-5027342f-1ebd-4036-89c6-7a445da0dec6 req-9e643b5f-a863-4359-b95a-6b2a3fe409a9 service nova] Creating event network-vif-plugged:140cd909-abde-4ea9-89c0-b130f4264b5b for instance c3e6246d-c32a-490d-ba83-84b54822f971 on nch1-master-1 Oct 22 20:59:46.504867 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-5027342f-1ebd-4036-89c6-7a445da0dec6 req-9e643b5f-a863-4359-b95a-6b2a3fe409a9 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063905 Oct 22 20:59:46.505835 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1295/2429] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:59:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:59:46.512275 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-55183627-0656-43dd-b1ae-f8de81f46952 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:59:46.512980 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-55183627-0656-43dd-b1ae-f8de81f46952 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] [instance: 7dde7a20-b949-4c72-ae19-83f2f0afd0d1] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:59:46.749347 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-8865143a-8c9e-49df-9ad8-cc295c90f361 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211483c6acea4f76b6c0e4bfc818e7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd687d54e07d4ab4af00ad801ef4b58d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:59:46.751393 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-55183627-0656-43dd-b1ae-f8de81f46952 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d49952dbca4d95a25411b65d56552b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed31e93b0e8a43f28e497f94318815ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:59:46.758996 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-55183627-0656-43dd-b1ae-f8de81f46952 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] 10.222.0.18 "GET /compute/v2.1/servers/7dde7a20-b949-4c72-ae19-83f2f0afd0d1" status: 200 len: 1215 microversion: 2.1 time: 0.250955 Oct 22 20:59:46.767517 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1296/2430] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:59:46 2022] GET /compute/v2.1/servers/7dde7a20-b949-4c72-ae19-83f2f0afd0d1 => generated 1215 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:59:46.776864 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-8865143a-8c9e-49df-9ad8-cc295c90f361 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '211483c6acea4f76b6c0e4bfc818e7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd687d54e07d4ab4af00ad801ef4b58d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:59:46.780710 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-8865143a-8c9e-49df-9ad8-cc295c90f361 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '211483c6acea4f76b6c0e4bfc818e7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd687d54e07d4ab4af00ad801ef4b58d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:59:46.782507 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-104173cf-c98a-44e2-ad7a-1b4366f75d59 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:59:46.784442 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-8865143a-8c9e-49df-9ad8-cc295c90f361 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] 10.222.0.18 "GET /compute/v2.1/servers/f38f14b2-b9d7-4bed-92ba-7b95ea4b2270" status: 200 len: 1874 microversion: 2.42 time: 0.932805 Oct 22 20:59:46.785014 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1135/2431] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 20:59:45 2022] GET /compute/v2.1/servers/f38f14b2-b9d7-4bed-92ba-7b95ea4b2270 => generated 1874 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 20:59:46.791228 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-104173cf-c98a-44e2-ad7a-1b4366f75d59 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] [instance: c3e6246d-c32a-490d-ba83-84b54822f971] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:59:46.799888 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-7a84d419-dd10-422f-a33f-ac5ab801e935 tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:59:46.800546 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-7a84d419-dd10-422f-a33f-ac5ab801e935 tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] [instance: ae58d60e-a113-4a38-94b5-b72a19c353e6] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:59:46.822020 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-104173cf-c98a-44e2-ad7a-1b4366f75d59 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:46.822527 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-104173cf-c98a-44e2-ad7a-1b4366f75d59 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:46.822974 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-104173cf-c98a-44e2-ad7a-1b4366f75d59 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:46.829987 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-104173cf-c98a-44e2-ad7a-1b4366f75d59 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:46.830568 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-104173cf-c98a-44e2-ad7a-1b4366f75d59 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:46.831032 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-104173cf-c98a-44e2-ad7a-1b4366f75d59 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:46.835757 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7a84d419-dd10-422f-a33f-ac5ab801e935 tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:46.836263 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7a84d419-dd10-422f-a33f-ac5ab801e935 tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:46.836713 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7a84d419-dd10-422f-a33f-ac5ab801e935 tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:46.841930 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7a84d419-dd10-422f-a33f-ac5ab801e935 tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:46.844513 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7a84d419-dd10-422f-a33f-ac5ab801e935 tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:46.846257 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7a84d419-dd10-422f-a33f-ac5ab801e935 tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:46.900581 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-104173cf-c98a-44e2-ad7a-1b4366f75d59 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] [instance: c3e6246d-c32a-490d-ba83-84b54822f971] Going to try to terminate instance {{(pid=138745) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 20:59:47.097412 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-104173cf-c98a-44e2-ad7a-1b4366f75d59 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] 10.222.0.18 "DELETE /compute/v2.1/servers/c3e6246d-c32a-490d-ba83-84b54822f971" status: 204 len: 0 microversion: 2.1 time: 0.328378 Oct 22 20:59:47.099913 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1297/2432] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 20:59:46 2022] DELETE /compute/v2.1/servers/c3e6246d-c32a-490d-ba83-84b54822f971 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 20:59:47.113704 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-76f2092b-08ab-48c6-9be9-bbb1670f8503 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:59:47.115590 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-76f2092b-08ab-48c6-9be9-bbb1670f8503 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] [instance: c3e6246d-c32a-490d-ba83-84b54822f971] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:59:47.145496 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-76f2092b-08ab-48c6-9be9-bbb1670f8503 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:47.146008 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-76f2092b-08ab-48c6-9be9-bbb1670f8503 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:47.146447 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-76f2092b-08ab-48c6-9be9-bbb1670f8503 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:47.147189 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-76f2092b-08ab-48c6-9be9-bbb1670f8503 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:47.147686 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-76f2092b-08ab-48c6-9be9-bbb1670f8503 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:47.152860 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-76f2092b-08ab-48c6-9be9-bbb1670f8503 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:47.322382 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-7a84d419-dd10-422f-a33f-ac5ab801e935 tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e36cd987f04f11b6a41325add4ccac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d79e903f8f24a348d5e771d434c70c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:59:47.343803 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-7a84d419-dd10-422f-a33f-ac5ab801e935 tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] 10.222.0.18 "GET /compute/v2.1/servers/ae58d60e-a113-4a38-94b5-b72a19c353e6" status: 200 len: 1522 microversion: 2.1 time: 0.541858 Oct 22 20:59:47.355658 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1136/2433] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:59:46 2022] GET /compute/v2.1/servers/ae58d60e-a113-4a38-94b5-b72a19c353e6 => generated 1522 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:59:47.531056 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-76f2092b-08ab-48c6-9be9-bbb1670f8503 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d3d7458af447bdb3f03e83a2d8559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49238b8686d24ae698679e4a1957735d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:59:47.550435 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-76f2092b-08ab-48c6-9be9-bbb1670f8503 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] 10.222.0.18 "GET /compute/v2.1/servers/c3e6246d-c32a-490d-ba83-84b54822f971" status: 200 len: 1468 microversion: 2.1 time: 0.445372 Oct 22 20:59:47.551560 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1298/2434] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:59:47 2022] GET /compute/v2.1/servers/c3e6246d-c32a-490d-ba83-84b54822f971 => generated 1468 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 20:59:47.732614 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-72426f2a-9e8b-4ba8-9572-97074b34d251 tempest-FlavorsV2NegativeTest-199146979 tempest-FlavorsV2NegativeTest-199146979-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:59:47.743189 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-72426f2a-9e8b-4ba8-9572-97074b34d251 tempest-FlavorsV2NegativeTest-199146979 tempest-FlavorsV2NegativeTest-199146979-project] 10.222.0.18 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.245323 Oct 22 20:59:47.758125 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1137/2435] 10.222.0.18 () {58 vars in 1137 bytes} [Sat Oct 22 20:59:47 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 20:59:47.789404 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-b94d2cd6-08fe-4960-a1c9-0afab8e8c116 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:59:47.790121 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-b94d2cd6-08fe-4960-a1c9-0afab8e8c116 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] [instance: 7dde7a20-b949-4c72-ae19-83f2f0afd0d1] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:59:47.805243 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b94d2cd6-08fe-4960-a1c9-0afab8e8c116 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:47.805987 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b94d2cd6-08fe-4960-a1c9-0afab8e8c116 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:47.806617 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b94d2cd6-08fe-4960-a1c9-0afab8e8c116 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:47.814284 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-bb5c9fd8-95d6-4f38-a59a-8ea02335dbba tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:59:47.816082 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-bb5c9fd8-95d6-4f38-a59a-8ea02335dbba tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] [instance: f38f14b2-b9d7-4bed-92ba-7b95ea4b2270] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:59:47.821568 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b94d2cd6-08fe-4960-a1c9-0afab8e8c116 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:47.823097 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b94d2cd6-08fe-4960-a1c9-0afab8e8c116 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:47.824846 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b94d2cd6-08fe-4960-a1c9-0afab8e8c116 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:47.829965 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bb5c9fd8-95d6-4f38-a59a-8ea02335dbba tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:47.831844 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bb5c9fd8-95d6-4f38-a59a-8ea02335dbba tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:47.832447 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bb5c9fd8-95d6-4f38-a59a-8ea02335dbba tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:47.835388 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bb5c9fd8-95d6-4f38-a59a-8ea02335dbba tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:47.836093 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bb5c9fd8-95d6-4f38-a59a-8ea02335dbba tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:47.839888 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bb5c9fd8-95d6-4f38-a59a-8ea02335dbba tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:48.514417 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-b94d2cd6-08fe-4960-a1c9-0afab8e8c116 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d49952dbca4d95a25411b65d56552b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed31e93b0e8a43f28e497f94318815ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:59:48.523100 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-b94d2cd6-08fe-4960-a1c9-0afab8e8c116 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] 10.222.0.18 "GET /compute/v2.1/servers/7dde7a20-b949-4c72-ae19-83f2f0afd0d1" status: 200 len: 1211 microversion: 2.1 time: 0.742695 Oct 22 20:59:48.530344 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1299/2436] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:59:47 2022] GET /compute/v2.1/servers/7dde7a20-b949-4c72-ae19-83f2f0afd0d1 => generated 1211 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:59:48.543909 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-f63c54ec-d5f5-4f1a-8693-88632407f1fa tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:59:48.550523 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-f63c54ec-d5f5-4f1a-8693-88632407f1fa tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] [instance: ae58d60e-a113-4a38-94b5-b72a19c353e6] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:59:48.562521 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f63c54ec-d5f5-4f1a-8693-88632407f1fa tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:48.563064 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f63c54ec-d5f5-4f1a-8693-88632407f1fa tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:48.563577 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f63c54ec-d5f5-4f1a-8693-88632407f1fa tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:48.565872 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f63c54ec-d5f5-4f1a-8693-88632407f1fa tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:48.566355 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f63c54ec-d5f5-4f1a-8693-88632407f1fa tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:48.566802 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f63c54ec-d5f5-4f1a-8693-88632407f1fa tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:48.998887 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-bb5c9fd8-95d6-4f38-a59a-8ea02335dbba tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211483c6acea4f76b6c0e4bfc818e7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd687d54e07d4ab4af00ad801ef4b58d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:59:49.019530 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-bb5c9fd8-95d6-4f38-a59a-8ea02335dbba tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '211483c6acea4f76b6c0e4bfc818e7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd687d54e07d4ab4af00ad801ef4b58d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:59:49.024520 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-bb5c9fd8-95d6-4f38-a59a-8ea02335dbba tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '211483c6acea4f76b6c0e4bfc818e7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd687d54e07d4ab4af00ad801ef4b58d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:59:49.027504 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-bb5c9fd8-95d6-4f38-a59a-8ea02335dbba tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] 10.222.0.18 "GET /compute/v2.1/servers/f38f14b2-b9d7-4bed-92ba-7b95ea4b2270" status: 200 len: 1874 microversion: 2.42 time: 1.219087 Oct 22 20:59:49.030474 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1138/2437] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 20:59:47 2022] GET /compute/v2.1/servers/f38f14b2-b9d7-4bed-92ba-7b95ea4b2270 => generated 1874 bytes in 1223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 22 20:59:49.038472 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-7cd1a628-0fb5-4891-868d-aaeb2f496537 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:59:49.039085 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-7cd1a628-0fb5-4891-868d-aaeb2f496537 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] [instance: c3e6246d-c32a-490d-ba83-84b54822f971] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:59:49.052244 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7cd1a628-0fb5-4891-868d-aaeb2f496537 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:49.056244 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7cd1a628-0fb5-4891-868d-aaeb2f496537 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:49.058192 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7cd1a628-0fb5-4891-868d-aaeb2f496537 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:49.064729 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7cd1a628-0fb5-4891-868d-aaeb2f496537 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:49.068298 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7cd1a628-0fb5-4891-868d-aaeb2f496537 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:49.069052 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7cd1a628-0fb5-4891-868d-aaeb2f496537 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:49.079147 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:59:49.097093 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-f63c54ec-d5f5-4f1a-8693-88632407f1fa tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e36cd987f04f11b6a41325add4ccac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d79e903f8f24a348d5e771d434c70c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:59:49.110284 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-f63c54ec-d5f5-4f1a-8693-88632407f1fa tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] 10.222.0.18 "GET /compute/v2.1/servers/ae58d60e-a113-4a38-94b5-b72a19c353e6" status: 200 len: 1522 microversion: 2.1 time: 0.577361 Oct 22 20:59:49.114725 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1300/2438] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:59:48 2022] GET /compute/v2.1/servers/ae58d60e-a113-4a38-94b5-b72a19c353e6 => generated 1522 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:59:49.126480 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-8dd661f0-6102-4b2c-b71c-e4f176776bb2 tempest-FlavorsV2NegativeTest-199146979 tempest-FlavorsV2NegativeTest-199146979-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-926441674", "imageRef": "a7807fd2-cf12-41fc-a5c8-e14472fae78d", "flavorRef": "452"}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:59:49.221468 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.network.neutron [None req-8dd661f0-6102-4b2c-b71c-e4f176776bb2 tempest-FlavorsV2NegativeTest-199146979 tempest-FlavorsV2NegativeTest-199146979-project] validate_networks() for None {{(pid=138745) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 20:59:49.724879 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-7cd1a628-0fb5-4891-868d-aaeb2f496537 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d3d7458af447bdb3f03e83a2d8559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49238b8686d24ae698679e4a1957735d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:59:49.734574 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-7cd1a628-0fb5-4891-868d-aaeb2f496537 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] 10.222.0.18 "GET /compute/v2.1/servers/c3e6246d-c32a-490d-ba83-84b54822f971" status: 200 len: 1468 microversion: 2.1 time: 0.702552 Oct 22 20:59:49.748590 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1139/2439] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:59:49 2022] GET /compute/v2.1/servers/c3e6246d-c32a-490d-ba83-84b54822f971 => generated 1468 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:59:49.757030 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-eb1656f0-43f8-4891-969d-f73817605069 req-2a13c4b4-0a83-4aa1-9002-0fbd9514bd95 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f38f14b2-b9d7-4bed-92ba-7b95ea4b2270", "tag": "d1d48ace-de12-4f4f-9a38-db0a37b136e5"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:59:49.767500 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-eb1656f0-43f8-4891-969d-f73817605069 req-2a13c4b4-0a83-4aa1-9002-0fbd9514bd95 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:49.768635 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-eb1656f0-43f8-4891-969d-f73817605069 req-2a13c4b4-0a83-4aa1-9002-0fbd9514bd95 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:49.769257 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-eb1656f0-43f8-4891-969d-f73817605069 req-2a13c4b4-0a83-4aa1-9002-0fbd9514bd95 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:49.786292 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-eb1656f0-43f8-4891-969d-f73817605069 req-2a13c4b4-0a83-4aa1-9002-0fbd9514bd95 service nova] Creating event network-changed:d1d48ace-de12-4f4f-9a38-db0a37b136e5 for instance f38f14b2-b9d7-4bed-92ba-7b95ea4b2270 on nch2-master-1 Oct 22 20:59:49.792482 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-eb1656f0-43f8-4891-969d-f73817605069 req-2a13c4b4-0a83-4aa1-9002-0fbd9514bd95 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042166 Oct 22 20:59:49.793629 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1140/2440] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:59:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:59:49.801377 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-9702e4a6-80c2-4927-8264-40f8381425ce tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:59:49.802502 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-9702e4a6-80c2-4927-8264-40f8381425ce tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] [instance: 7dde7a20-b949-4c72-ae19-83f2f0afd0d1] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:59:49.811650 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9702e4a6-80c2-4927-8264-40f8381425ce tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:49.812638 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9702e4a6-80c2-4927-8264-40f8381425ce tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:49.814403 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9702e4a6-80c2-4927-8264-40f8381425ce tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:49.816059 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9702e4a6-80c2-4927-8264-40f8381425ce tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:49.816653 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9702e4a6-80c2-4927-8264-40f8381425ce tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:49.817088 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9702e4a6-80c2-4927-8264-40f8381425ce tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:50.038240 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-9702e4a6-80c2-4927-8264-40f8381425ce tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d49952dbca4d95a25411b65d56552b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed31e93b0e8a43f28e497f94318815ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:59:50.054511 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-9702e4a6-80c2-4927-8264-40f8381425ce tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] 10.222.0.18 "GET /compute/v2.1/servers/7dde7a20-b949-4c72-ae19-83f2f0afd0d1" status: 200 len: 1273 microversion: 2.1 time: 0.259104 Oct 22 20:59:50.055869 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1141/2441] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:59:49 2022] GET /compute/v2.1/servers/7dde7a20-b949-4c72-ae19-83f2f0afd0d1 => generated 1273 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:59:50.061808 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-ea03bade-e3d2-484d-be3e-3a95aecd4780 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:59:50.063282 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-ea03bade-e3d2-484d-be3e-3a95aecd4780 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] [instance: f38f14b2-b9d7-4bed-92ba-7b95ea4b2270] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:59:50.071997 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ea03bade-e3d2-484d-be3e-3a95aecd4780 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:50.073874 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ea03bade-e3d2-484d-be3e-3a95aecd4780 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:50.075204 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ea03bade-e3d2-484d-be3e-3a95aecd4780 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:50.076691 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ea03bade-e3d2-484d-be3e-3a95aecd4780 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:50.077459 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ea03bade-e3d2-484d-be3e-3a95aecd4780 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:50.078806 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ea03bade-e3d2-484d-be3e-3a95aecd4780 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:50.137016 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.wsgi [None req-8dd661f0-6102-4b2c-b71c-e4f176776bb2 tempest-FlavorsV2NegativeTest-199146979 tempest-FlavorsV2NegativeTest-199146979-project] HTTP exception thrown: Flavor's memory is too small for requested image. Oct 22 20:59:50.139232 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-8dd661f0-6102-4b2c-b71c-e4f176776bb2 tempest-FlavorsV2NegativeTest-199146979 tempest-FlavorsV2NegativeTest-199146979-project] Request method failure captured: Oct 22 20:59:50.139232 ncdv-master-1 devstack@n-api.service[138745]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 22 20:59:50.139232 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 20:59:50.139232 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 20:59:50.139232 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 20:59:50.139232 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 142 Oct 22 20:59:50.139232 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 20:59:50.139232 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 20:59:50.139232 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 20:59:50.139232 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 20:59:50.139232 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVFnDBnDo9iUDd1xu77xfvfYXbeM2Dg_VN9Vv_qFX3wPZEjEqQS_LArxVPVp2OLZEU0Rgzg4Ovv9W7diNTDCPYgPr04EpdfBpyo1Mc1VI5kFMFZleVRHOzA6ZkqP72APjJaJEuGr-8DPevlQGPtB0oKiiOhqaLyRYjdsm_CEPVAc3elA Oct 22 20:59:50.139232 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 20:59:50.139232 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 20:59:50.139232 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 20:59:50.139232 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 20:59:50.139232 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 20:59:50.139232 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 20:59:50.139232 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: f4c7b550b8c6438eaebbad4bff7efafc Oct 22 20:59:50.139232 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-FlavorsV2NegativeTest-199146979 Oct 22 20:59:50.139232 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 20:59:50.139232 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 20:59:50.139232 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_f4c7b550b8c6438eaebbad4bff7efafc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f4c7b550b8c6438eaebbad4bff7efafc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/f4c7b550b8c6438eaebbad4bff7efafc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f4c7b550b8c6438eaebbad4bff7efafc"}]}] Oct 22 20:59:50.139232 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-FlavorsV2NegativeTest-199146979 Oct 22 20:59:50.139232 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: f4c7b550b8c6438eaebbad4bff7efafc Oct 22 20:59:50.139232 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-FlavorsV2NegativeTest-199146979 Oct 22 20:59:50.139232 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-FlavorsV2NegativeTest-199146979-project Oct 22 20:59:50.139232 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 20:59:50.139232 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 20:59:50.139232 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: dab92eeda94545e0ba2ff7c06d0e9ec3 Oct 22 20:59:50.139232 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-FlavorsV2NegativeTest-199146979-project Oct 22 20:59:50.139232 ncdv-master-1 devstack@n-api.service[138745]: Oct 22 20:59:50.139232 ncdv-master-1 devstack@n-api.service[138745]: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-926441674", "imageRef": "a7807fd2-cf12-41fc-a5c8-e14472fae78d", "flavorRef": "452"}} Oct 22 20:59:50.139232 ncdv-master-1 devstack@n-api.service[138745]: method: > Oct 22 20:59:50.139232 ncdv-master-1 devstack@n-api.service[138745]: exception: Flavor's memory is too small for requested image. Oct 22 20:59:50.139232 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'body': {'server': {'name': 'tempest-FlavorsV2NegativeTest-server-926441674', 'imageRef': 'a7807fd2-cf12-41fc-a5c8-e14472fae78d', 'flavorRef': '452'}}} Oct 22 20:59:50.139232 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:59:50.139232 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:59:50.139232 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 22 20:59:50.139232 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 22 20:59:50.139232 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 22 20:59:50.139232 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 22 20:59:50.139232 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Oct 22 20:59:50.139232 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Oct 22 20:59:50.139232 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1019, in _checks_for_create_and_rebuild Oct 22 20:59:50.139232 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi self._validate_flavor_image(context, image_id, image, Oct 22 20:59:50.139232 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 683, in _validate_flavor_image Oct 22 20:59:50.139232 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi self._validate_flavor_image_nostatus( Oct 22 20:59:50.139232 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 751, in _validate_flavor_image_nostatus Oct 22 20:59:50.139232 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.FlavorMemoryTooSmall() Oct 22 20:59:50.139232 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.FlavorMemoryTooSmall: Flavor's memory is too small for requested image. Oct 22 20:59:50.139232 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:59:50.139232 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:59:50.139232 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:59:50.139232 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:59:50.139232 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:59:50.139232 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:59:50.139232 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:59:50.139232 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:59:50.139232 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:59:50.139232 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:59:50.139232 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 20:59:50.139232 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 20:59:50.139232 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 20:59:50.139232 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 20:59:50.143420 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 20:59:50.143420 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 20:59:50.143420 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 22 20:59:50.143420 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 868, in create Oct 22 20:59:50.143420 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 22 20:59:50.143420 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor's memory is too small for requested image. Oct 22 20:59:50.143420 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:59:50.143420 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:59:50.143420 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:59:50.143420 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:59:50.143420 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:59:50.143420 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:59:50.143420 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 20:59:50.143420 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 20:59:50.143420 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor's memory is too small for requested image. Oct 22 20:59:50.143420 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:59:50.143420 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-8dd661f0-6102-4b2c-b71c-e4f176776bb2 tempest-FlavorsV2NegativeTest-199146979 tempest-FlavorsV2NegativeTest-199146979-project] Returning 400 to user: Flavor's memory is too small for requested image. {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:59:50.143420 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-8dd661f0-6102-4b2c-b71c-e4f176776bb2 tempest-FlavorsV2NegativeTest-199146979 tempest-FlavorsV2NegativeTest-199146979-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 400 len: 93 microversion: 2.1 time: 1.024526 Oct 22 20:59:50.145474 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1301/2442] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Oct 22 20:59:49 2022] POST /compute/v2.1/servers => generated 93 bytes in 1029 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 22 20:59:50.150929 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-e69b2862-4cce-494e-8afb-ee17afe2647e tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:59:50.157474 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-e69b2862-4cce-494e-8afb-ee17afe2647e tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] [instance: ae58d60e-a113-4a38-94b5-b72a19c353e6] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:59:50.166664 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e69b2862-4cce-494e-8afb-ee17afe2647e tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:50.167291 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e69b2862-4cce-494e-8afb-ee17afe2647e tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:50.167886 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e69b2862-4cce-494e-8afb-ee17afe2647e tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:50.168681 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e69b2862-4cce-494e-8afb-ee17afe2647e tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:50.169146 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e69b2862-4cce-494e-8afb-ee17afe2647e tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:50.170390 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e69b2862-4cce-494e-8afb-ee17afe2647e tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:50.804618 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-e69b2862-4cce-494e-8afb-ee17afe2647e tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e36cd987f04f11b6a41325add4ccac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d79e903f8f24a348d5e771d434c70c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:59:50.816823 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-e69b2862-4cce-494e-8afb-ee17afe2647e tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] 10.222.0.18 "GET /compute/v2.1/servers/ae58d60e-a113-4a38-94b5-b72a19c353e6" status: 200 len: 1502 microversion: 2.1 time: 0.670589 Oct 22 20:59:50.817489 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1302/2443] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:59:50 2022] GET /compute/v2.1/servers/ae58d60e-a113-4a38-94b5-b72a19c353e6 => generated 1502 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:59:50.849047 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-98b9e239-1de1-4835-9555-09895653370a tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:59:50.849675 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-98b9e239-1de1-4835-9555-09895653370a tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] [instance: c3e6246d-c32a-490d-ba83-84b54822f971] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:59:50.865504 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-98b9e239-1de1-4835-9555-09895653370a tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:50.865931 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-98b9e239-1de1-4835-9555-09895653370a tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:50.866383 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-98b9e239-1de1-4835-9555-09895653370a tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:50.867120 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-98b9e239-1de1-4835-9555-09895653370a tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:50.867612 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-98b9e239-1de1-4835-9555-09895653370a tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:50.868049 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-98b9e239-1de1-4835-9555-09895653370a tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:51.250078 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-98b9e239-1de1-4835-9555-09895653370a tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d3d7458af447bdb3f03e83a2d8559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49238b8686d24ae698679e4a1957735d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:59:51.268502 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-98b9e239-1de1-4835-9555-09895653370a tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] 10.222.0.18 "GET /compute/v2.1/servers/c3e6246d-c32a-490d-ba83-84b54822f971" status: 200 len: 1426 microversion: 2.1 time: 0.427519 Oct 22 20:59:51.269095 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1303/2444] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:59:50 2022] GET /compute/v2.1/servers/c3e6246d-c32a-490d-ba83-84b54822f971 => generated 1426 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:59:51.278427 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-3c78aba3-d214-41e0-af50-dd001b3c029f tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Action: 'create', calling method: .version_select at 0x7fd39fdf7550>, body: {"security_group": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1403214800", "description": "tempest-description-1526428754"}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:59:51.332609 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-ea03bade-e3d2-484d-be3e-3a95aecd4780 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211483c6acea4f76b6c0e4bfc818e7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd687d54e07d4ab4af00ad801ef4b58d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:59:51.347839 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-ea03bade-e3d2-484d-be3e-3a95aecd4780 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '211483c6acea4f76b6c0e4bfc818e7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd687d54e07d4ab4af00ad801ef4b58d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:59:51.360786 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-ea03bade-e3d2-484d-be3e-3a95aecd4780 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '211483c6acea4f76b6c0e4bfc818e7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd687d54e07d4ab4af00ad801ef4b58d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:59:51.362606 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-ea03bade-e3d2-484d-be3e-3a95aecd4780 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] 10.222.0.18 "GET /compute/v2.1/servers/f38f14b2-b9d7-4bed-92ba-7b95ea4b2270" status: 200 len: 1874 microversion: 2.42 time: 1.305528 Oct 22 20:59:51.363460 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1142/2445] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 20:59:50 2022] GET /compute/v2.1/servers/f38f14b2-b9d7-4bed-92ba-7b95ea4b2270 => generated 1874 bytes in 1307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 20:59:51.369797 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-e44d0503-4b48-4d57-937f-f6ff4dcf5d8b tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:59:51.381190 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-e44d0503-4b48-4d57-937f-f6ff4dcf5d8b tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] [instance: 7dde7a20-b949-4c72-ae19-83f2f0afd0d1] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:59:51.395421 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e44d0503-4b48-4d57-937f-f6ff4dcf5d8b tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:51.396272 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e44d0503-4b48-4d57-937f-f6ff4dcf5d8b tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:51.396665 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e44d0503-4b48-4d57-937f-f6ff4dcf5d8b tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:51.397394 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e44d0503-4b48-4d57-937f-f6ff4dcf5d8b tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:51.397884 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e44d0503-4b48-4d57-937f-f6ff4dcf5d8b tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:51.398296 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e44d0503-4b48-4d57-937f-f6ff4dcf5d8b tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:51.610359 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-e44d0503-4b48-4d57-937f-f6ff4dcf5d8b tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d49952dbca4d95a25411b65d56552b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed31e93b0e8a43f28e497f94318815ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:59:51.624944 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-e44d0503-4b48-4d57-937f-f6ff4dcf5d8b tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] 10.222.0.18 "GET /compute/v2.1/servers/7dde7a20-b949-4c72-ae19-83f2f0afd0d1" status: 200 len: 1273 microversion: 2.1 time: 0.258761 Oct 22 20:59:51.626156 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1143/2446] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:59:51 2022] GET /compute/v2.1/servers/7dde7a20-b949-4c72-ae19-83f2f0afd0d1 => generated 1273 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:59:51.832860 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-51b8686c-08ea-4dbb-8dcb-ad62638e829a req-148e1577-0116-4b6d-92e2-c80841c5e3a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3e6246d-c32a-490d-ba83-84b54822f971", "name": "network-vif-deleted", "tag": "140cd909-abde-4ea9-89c0-b130f4264b5b"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:59:51.851073 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-51b8686c-08ea-4dbb-8dcb-ad62638e829a req-148e1577-0116-4b6d-92e2-c80841c5e3a9 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:51.851920 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-51b8686c-08ea-4dbb-8dcb-ad62638e829a req-148e1577-0116-4b6d-92e2-c80841c5e3a9 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:51.854189 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-51b8686c-08ea-4dbb-8dcb-ad62638e829a req-148e1577-0116-4b6d-92e2-c80841c5e3a9 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:51.880258 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-51b8686c-08ea-4dbb-8dcb-ad62638e829a req-148e1577-0116-4b6d-92e2-c80841c5e3a9 service nova] Creating event network-vif-deleted:140cd909-abde-4ea9-89c0-b130f4264b5b for instance c3e6246d-c32a-490d-ba83-84b54822f971 on nch1-master-1 Oct 22 20:59:51.892051 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-51b8686c-08ea-4dbb-8dcb-ad62638e829a req-148e1577-0116-4b6d-92e2-c80841c5e3a9 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062806 Oct 22 20:59:51.892994 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1144/2447] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:59:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 20:59:52.295842 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-f5fe0655-5e4f-4d79-bfc3-5a88028b4fe0 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:59:52.297068 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-f5fe0655-5e4f-4d79-bfc3-5a88028b4fe0 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] [instance: c3e6246d-c32a-490d-ba83-84b54822f971] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:59:52.309324 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f5fe0655-5e4f-4d79-bfc3-5a88028b4fe0 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:52.311501 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f5fe0655-5e4f-4d79-bfc3-5a88028b4fe0 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:52.316955 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f5fe0655-5e4f-4d79-bfc3-5a88028b4fe0 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:52.325082 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f5fe0655-5e4f-4d79-bfc3-5a88028b4fe0 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:52.326555 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f5fe0655-5e4f-4d79-bfc3-5a88028b4fe0 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:52.328287 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f5fe0655-5e4f-4d79-bfc3-5a88028b4fe0 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:52.349352 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-f5fe0655-5e4f-4d79-bfc3-5a88028b4fe0 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] HTTP exception thrown: Instance c3e6246d-c32a-490d-ba83-84b54822f971 could not be found. Oct 22 20:59:52.354469 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-f5fe0655-5e4f-4d79-bfc3-5a88028b4fe0 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Request method failure captured: Oct 22 20:59:52.354469 ncdv-master-1 devstack@n-api.service[138744]: request: GET /compute/v2.1/servers/c3e6246d-c32a-490d-ba83-84b54822f971 HTTP/1.1 Oct 22 20:59:52.354469 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 20:59:52.354469 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 20:59:52.354469 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 20:59:52.354469 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 0 Oct 22 20:59:52.354469 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 20:59:52.354469 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 20:59:52.354469 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 20:59:52.354469 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 20:59:52.354469 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVFhmBIyEFZ5UaXjuS-XjHeNq2NZJ6-PZgGZeaIaSAZodIQmPMubSjCIS9wmprAg5WbUhxuYoYXOd3qlNfUL_HEhVyaVH9bKA87Iahwjb-u8_gTW16ah_HU_-UGEZkL42b1zllNGPhcx4qIPpE4vl5evkvpnkDsCfCEWPisgVtTaLG3k Oct 22 20:59:52.354469 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 20:59:52.354469 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 20:59:52.354469 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 20:59:52.354469 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 20:59:52.354469 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 20:59:52.354469 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 20:59:52.354469 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: 49238b8686d24ae698679e4a1957735d Oct 22 20:59:52.354469 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-MigrationsAdminTest-1624122076 Oct 22 20:59:52.354469 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 20:59:52.354469 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 20:59:52.354469 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_49238b8686d24ae698679e4a1957735d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/49238b8686d24ae698679e4a1957735d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/49238b8686d24ae698679e4a1957735d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/49238b8686d24ae698679e4a1957735d"}]}] Oct 22 20:59:52.354469 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-MigrationsAdminTest-1624122076 Oct 22 20:59:52.354469 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: 49238b8686d24ae698679e4a1957735d Oct 22 20:59:52.354469 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-MigrationsAdminTest-1624122076 Oct 22 20:59:52.354469 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-MigrationsAdminTest-1624122076-project Oct 22 20:59:52.354469 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 20:59:52.354469 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 20:59:52.354469 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: e0d3d7458af447bdb3f03e83a2d8559f Oct 22 20:59:52.354469 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-MigrationsAdminTest-1624122076-project Oct 22 20:59:52.354469 ncdv-master-1 devstack@n-api.service[138744]: method: > Oct 22 20:59:52.354469 ncdv-master-1 devstack@n-api.service[138744]: exception: Instance c3e6246d-c32a-490d-ba83-84b54822f971 could not be found. Oct 22 20:59:52.354469 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': 'c3e6246d-c32a-490d-ba83-84b54822f971'} Oct 22 20:59:52.354469 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:59:52.354469 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:59:52.354469 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 20:59:52.354469 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 20:59:52.354469 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 20:59:52.354469 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 20:59:52.354469 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 20:59:52.354469 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 20:59:52.354469 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 20:59:52.354469 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 20:59:52.354469 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c3e6246d-c32a-490d-ba83-84b54822f971 could not be found. Oct 22 20:59:52.354469 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:59:52.354469 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:59:52.354469 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:59:52.354469 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:59:52.354469 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:59:52.354469 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:59:52.354469 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:59:52.354469 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:59:52.354469 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:59:52.354469 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:59:52.354469 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 20:59:52.354469 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 20:59:52.354469 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 20:59:52.354469 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 20:59:52.354469 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 20:59:52.354469 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 20:59:52.354469 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c3e6246d-c32a-490d-ba83-84b54822f971 could not be found. Oct 22 20:59:52.354469 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:59:52.354469 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:59:52.354469 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:59:52.358472 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:59:52.358472 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:59:52.358472 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:59:52.358472 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 20:59:52.358472 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 20:59:52.358472 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c3e6246d-c32a-490d-ba83-84b54822f971 could not be found. Oct 22 20:59:52.358472 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 20:59:52.362059 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-f5fe0655-5e4f-4d79-bfc3-5a88028b4fe0 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Returning 404 to user: Instance c3e6246d-c32a-490d-ba83-84b54822f971 could not be found. {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:59:52.363847 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-f5fe0655-5e4f-4d79-bfc3-5a88028b4fe0 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] 10.222.0.18 "GET /compute/v2.1/servers/c3e6246d-c32a-490d-ba83-84b54822f971" status: 404 len: 111 microversion: 2.1 time: 0.073526 Oct 22 20:59:52.365222 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1145/2448] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:59:52 2022] GET /compute/v2.1/servers/c3e6246d-c32a-490d-ba83-84b54822f971 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 22 20:59:52.366235 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-3c78aba3-d214-41e0-af50-dd001b3c029f tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] 10.222.0.18 "POST /compute/v2.1/os-security-groups" status: 200 len: 251 microversion: 2.1 time: 1.091630 Oct 22 20:59:52.376952 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1304/2449] 10.222.0.18 () {60 vars in 1180 bytes} [Sat Oct 22 20:59:51 2022] POST /compute/v2.1/os-security-groups => generated 251 bytes in 1103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:59:52.381517 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-337c1482-8839-4695-823c-0e806a5c944e tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:59:52.382202 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-337c1482-8839-4695-823c-0e806a5c944e tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] [instance: aee36c9d-baf4-453c-b88f-31b8f23638c2] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:59:52.396283 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-337c1482-8839-4695-823c-0e806a5c944e tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:52.399779 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-337c1482-8839-4695-823c-0e806a5c944e tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:52.400337 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-337c1482-8839-4695-823c-0e806a5c944e tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:52.400632 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-fe88c43b-bc48-4a69-be82-c5b9c12d7e59 tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1403214800"}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:59:52.401470 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-fe88c43b-bc48-4a69-be82-c5b9c12d7e59 tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] [instance: ae58d60e-a113-4a38-94b5-b72a19c353e6] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:59:52.405171 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-337c1482-8839-4695-823c-0e806a5c944e tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:52.405793 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-337c1482-8839-4695-823c-0e806a5c944e tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:52.406319 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-337c1482-8839-4695-823c-0e806a5c944e tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:52.413279 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fe88c43b-bc48-4a69-be82-c5b9c12d7e59 tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:52.415271 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fe88c43b-bc48-4a69-be82-c5b9c12d7e59 tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:52.417479 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fe88c43b-bc48-4a69-be82-c5b9c12d7e59 tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:52.418614 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fe88c43b-bc48-4a69-be82-c5b9c12d7e59 tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:52.419852 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fe88c43b-bc48-4a69-be82-c5b9c12d7e59 tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:52.420722 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fe88c43b-bc48-4a69-be82-c5b9c12d7e59 tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:52.461615 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-337c1482-8839-4695-823c-0e806a5c944e tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] [instance: aee36c9d-baf4-453c-b88f-31b8f23638c2] Going to try to terminate instance {{(pid=138744) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 20:59:52.471930 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:59:52.609056 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-337c1482-8839-4695-823c-0e806a5c944e tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] 10.222.0.18 "DELETE /compute/v2.1/servers/aee36c9d-baf4-453c-b88f-31b8f23638c2" status: 204 len: 0 microversion: 2.1 time: 0.236277 Oct 22 20:59:52.610682 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1146/2450] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 20:59:52 2022] DELETE /compute/v2.1/servers/aee36c9d-baf4-453c-b88f-31b8f23638c2 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 20:59:52.618064 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-fda4e249-e546-4ae7-a779-84c9e240b2d6 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:59:52.619916 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-fda4e249-e546-4ae7-a779-84c9e240b2d6 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] [instance: f38f14b2-b9d7-4bed-92ba-7b95ea4b2270] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:59:52.629945 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fda4e249-e546-4ae7-a779-84c9e240b2d6 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:52.630790 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fda4e249-e546-4ae7-a779-84c9e240b2d6 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:52.631523 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fda4e249-e546-4ae7-a779-84c9e240b2d6 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:52.632533 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fda4e249-e546-4ae7-a779-84c9e240b2d6 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:52.633218 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fda4e249-e546-4ae7-a779-84c9e240b2d6 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:52.633862 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fda4e249-e546-4ae7-a779-84c9e240b2d6 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:53.534524 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.network.security_group_api [None req-fe88c43b-bc48-4a69-be82-c5b9c12d7e59 tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Adding security group 7f8b6741-f931-441d-8642-1200b1e0e6c4 to port 6bbd4b8b-948d-44a4-8b7f-6968bc1dc2cf Oct 22 20:59:53.747395 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-fda4e249-e546-4ae7-a779-84c9e240b2d6 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211483c6acea4f76b6c0e4bfc818e7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd687d54e07d4ab4af00ad801ef4b58d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:59:53.759819 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-fda4e249-e546-4ae7-a779-84c9e240b2d6 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '211483c6acea4f76b6c0e4bfc818e7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd687d54e07d4ab4af00ad801ef4b58d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:59:53.761955 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-fda4e249-e546-4ae7-a779-84c9e240b2d6 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '211483c6acea4f76b6c0e4bfc818e7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd687d54e07d4ab4af00ad801ef4b58d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:59:53.763661 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-fda4e249-e546-4ae7-a779-84c9e240b2d6 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] 10.222.0.18 "GET /compute/v2.1/servers/f38f14b2-b9d7-4bed-92ba-7b95ea4b2270" status: 200 len: 1874 microversion: 2.42 time: 1.151099 Oct 22 20:59:53.764400 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1147/2451] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 20:59:52 2022] GET /compute/v2.1/servers/f38f14b2-b9d7-4bed-92ba-7b95ea4b2270 => generated 1874 bytes in 1153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 20:59:53.771668 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-23ebf108-91e3-4387-acbc-0cafd0303b7c tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:59:53.772616 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-23ebf108-91e3-4387-acbc-0cafd0303b7c tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] [instance: aee36c9d-baf4-453c-b88f-31b8f23638c2] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:59:53.779720 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-23ebf108-91e3-4387-acbc-0cafd0303b7c tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:53.781034 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-23ebf108-91e3-4387-acbc-0cafd0303b7c tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:53.781657 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-23ebf108-91e3-4387-acbc-0cafd0303b7c tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:53.782652 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-23ebf108-91e3-4387-acbc-0cafd0303b7c tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:53.783946 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-23ebf108-91e3-4387-acbc-0cafd0303b7c tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:53.784528 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-23ebf108-91e3-4387-acbc-0cafd0303b7c tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:54.305160 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-23ebf108-91e3-4387-acbc-0cafd0303b7c tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d3d7458af447bdb3f03e83a2d8559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49238b8686d24ae698679e4a1957735d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:59:54.313744 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-23ebf108-91e3-4387-acbc-0cafd0303b7c tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] 10.222.0.18 "GET /compute/v2.1/servers/aee36c9d-baf4-453c-b88f-31b8f23638c2" status: 200 len: 1534 microversion: 2.1 time: 0.547636 Oct 22 20:59:54.314340 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1148/2452] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:59:53 2022] GET /compute/v2.1/servers/aee36c9d-baf4-453c-b88f-31b8f23638c2 => generated 1534 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:59:54.329691 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-8506bd08-58ac-4ad4-aa9e-348042d8e725 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:59:54.330906 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-8506bd08-58ac-4ad4-aa9e-348042d8e725 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] [instance: 7dde7a20-b949-4c72-ae19-83f2f0afd0d1] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:59:54.344509 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8506bd08-58ac-4ad4-aa9e-348042d8e725 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:54.346451 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8506bd08-58ac-4ad4-aa9e-348042d8e725 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:54.349117 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8506bd08-58ac-4ad4-aa9e-348042d8e725 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:54.350125 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8506bd08-58ac-4ad4-aa9e-348042d8e725 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:54.351135 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8506bd08-58ac-4ad4-aa9e-348042d8e725 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:54.357131 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8506bd08-58ac-4ad4-aa9e-348042d8e725 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:54.983741 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-8506bd08-58ac-4ad4-aa9e-348042d8e725 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d49952dbca4d95a25411b65d56552b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed31e93b0e8a43f28e497f94318815ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:59:54.996071 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-8506bd08-58ac-4ad4-aa9e-348042d8e725 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] 10.222.0.18 "GET /compute/v2.1/servers/7dde7a20-b949-4c72-ae19-83f2f0afd0d1" status: 200 len: 1315 microversion: 2.1 time: 0.674723 Oct 22 20:59:54.996071 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1149/2453] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:59:54 2022] GET /compute/v2.1/servers/7dde7a20-b949-4c72-ae19-83f2f0afd0d1 => generated 1315 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:59:55.009724 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-bce2d9cd-d63e-4509-872e-50d5cf46f80a req-68af9d80-c366-49bc-95ad-e25bd60907ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f38f14b2-b9d7-4bed-92ba-7b95ea4b2270", "tag": "21b2a827-e5c7-48f8-b28e-41001a9b5db6"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:59:55.036048 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-bce2d9cd-d63e-4509-872e-50d5cf46f80a req-68af9d80-c366-49bc-95ad-e25bd60907ce service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:55.040593 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-bce2d9cd-d63e-4509-872e-50d5cf46f80a req-68af9d80-c366-49bc-95ad-e25bd60907ce service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:55.041068 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-bce2d9cd-d63e-4509-872e-50d5cf46f80a req-68af9d80-c366-49bc-95ad-e25bd60907ce service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:55.074405 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-bce2d9cd-d63e-4509-872e-50d5cf46f80a req-68af9d80-c366-49bc-95ad-e25bd60907ce service nova] Creating event network-changed:21b2a827-e5c7-48f8-b28e-41001a9b5db6 for instance f38f14b2-b9d7-4bed-92ba-7b95ea4b2270 on nch2-master-1 Oct 22 20:59:55.090054 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-bce2d9cd-d63e-4509-872e-50d5cf46f80a req-68af9d80-c366-49bc-95ad-e25bd60907ce service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089471 Oct 22 20:59:55.093808 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1150/2454] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:59:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:59:55.108691 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-6f26f07b-df78-44a8-8fcf-948875b9c3da tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:59:55.110386 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-6f26f07b-df78-44a8-8fcf-948875b9c3da tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] [instance: f38f14b2-b9d7-4bed-92ba-7b95ea4b2270] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:59:55.126065 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6f26f07b-df78-44a8-8fcf-948875b9c3da tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:55.128656 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6f26f07b-df78-44a8-8fcf-948875b9c3da tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:55.129677 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6f26f07b-df78-44a8-8fcf-948875b9c3da tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:55.132121 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6f26f07b-df78-44a8-8fcf-948875b9c3da tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:55.133636 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6f26f07b-df78-44a8-8fcf-948875b9c3da tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:55.134740 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6f26f07b-df78-44a8-8fcf-948875b9c3da tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:55.238627 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-fe88c43b-bc48-4a69-be82-c5b9c12d7e59 tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] 10.222.0.18 "POST /compute/v2.1/servers/ae58d60e-a113-4a38-94b5-b72a19c353e6/action" status: 202 len: 0 microversion: 2.1 time: 2.856122 Oct 22 20:59:55.239954 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1305/2455] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 20:59:52 2022] POST /compute/v2.1/servers/ae58d60e-a113-4a38-94b5-b72a19c353e6/action => generated 0 bytes in 2862 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 20:59:55.248177 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-270658c8-a103-4042-9a07-5e441fcc6c91 tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1403214800"}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:59:55.249144 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-270658c8-a103-4042-9a07-5e441fcc6c91 tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] [instance: ae58d60e-a113-4a38-94b5-b72a19c353e6] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:59:55.270203 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-270658c8-a103-4042-9a07-5e441fcc6c91 tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:55.270956 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-270658c8-a103-4042-9a07-5e441fcc6c91 tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:55.271876 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-270658c8-a103-4042-9a07-5e441fcc6c91 tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:55.272879 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-270658c8-a103-4042-9a07-5e441fcc6c91 tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:55.273750 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-270658c8-a103-4042-9a07-5e441fcc6c91 tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:55.274427 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-270658c8-a103-4042-9a07-5e441fcc6c91 tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:55.653417 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell0:SELECT=2 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:59:55.719189 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell0:SELECT=6 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:59:55.976186 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.network.security_group_api [None req-270658c8-a103-4042-9a07-5e441fcc6c91 tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Removing security group 7f8b6741-f931-441d-8642-1200b1e0e6c4 from port 6bbd4b8b-948d-44a4-8b7f-6968bc1dc2cf Oct 22 20:59:56.086827 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-6f26f07b-df78-44a8-8fcf-948875b9c3da tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211483c6acea4f76b6c0e4bfc818e7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd687d54e07d4ab4af00ad801ef4b58d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:59:56.130768 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-6f26f07b-df78-44a8-8fcf-948875b9c3da tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '211483c6acea4f76b6c0e4bfc818e7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd687d54e07d4ab4af00ad801ef4b58d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:59:56.136684 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-6f26f07b-df78-44a8-8fcf-948875b9c3da tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '211483c6acea4f76b6c0e4bfc818e7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd687d54e07d4ab4af00ad801ef4b58d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:59:56.142303 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-6f26f07b-df78-44a8-8fcf-948875b9c3da tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] 10.222.0.18 "GET /compute/v2.1/servers/f38f14b2-b9d7-4bed-92ba-7b95ea4b2270" status: 200 len: 1874 microversion: 2.42 time: 1.045653 Oct 22 20:59:56.144958 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1151/2456] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 20:59:55 2022] GET /compute/v2.1/servers/f38f14b2-b9d7-4bed-92ba-7b95ea4b2270 => generated 1874 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 20:59:56.165550 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-65c8c4a2-5540-42ff-9e18-436e326e5d64 req-6412da4b-cd1f-410d-a2a7-da8e0fe18b6e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae58d60e-a113-4a38-94b5-b72a19c353e6", "tag": "6bbd4b8b-948d-44a4-8b7f-6968bc1dc2cf"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:59:56.198131 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-65c8c4a2-5540-42ff-9e18-436e326e5d64 req-6412da4b-cd1f-410d-a2a7-da8e0fe18b6e service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:56.198638 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-65c8c4a2-5540-42ff-9e18-436e326e5d64 req-6412da4b-cd1f-410d-a2a7-da8e0fe18b6e service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:56.199214 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-65c8c4a2-5540-42ff-9e18-436e326e5d64 req-6412da4b-cd1f-410d-a2a7-da8e0fe18b6e service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:56.266704 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-65c8c4a2-5540-42ff-9e18-436e326e5d64 req-6412da4b-cd1f-410d-a2a7-da8e0fe18b6e service nova] Creating event network-changed:6bbd4b8b-948d-44a4-8b7f-6968bc1dc2cf for instance ae58d60e-a113-4a38-94b5-b72a19c353e6 on nch2-master-1 Oct 22 20:59:56.298599 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-65c8c4a2-5540-42ff-9e18-436e326e5d64 req-6412da4b-cd1f-410d-a2a7-da8e0fe18b6e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.136615 Oct 22 20:59:56.301019 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1152/2457] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:59:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:59:56.322306 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-d6e25dfa-6929-4228-bfe3-f15f0b4b6994 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:59:56.324446 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-d6e25dfa-6929-4228-bfe3-f15f0b4b6994 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] [instance: aee36c9d-baf4-453c-b88f-31b8f23638c2] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:59:56.351894 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d6e25dfa-6929-4228-bfe3-f15f0b4b6994 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:56.353769 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d6e25dfa-6929-4228-bfe3-f15f0b4b6994 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:56.364922 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d6e25dfa-6929-4228-bfe3-f15f0b4b6994 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:56.366225 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d6e25dfa-6929-4228-bfe3-f15f0b4b6994 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:56.372455 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d6e25dfa-6929-4228-bfe3-f15f0b4b6994 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:56.374184 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d6e25dfa-6929-4228-bfe3-f15f0b4b6994 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:56.491059 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d6e25dfa-6929-4228-bfe3-f15f0b4b6994 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:56.491615 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d6e25dfa-6929-4228-bfe3-f15f0b4b6994 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:56.492085 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d6e25dfa-6929-4228-bfe3-f15f0b4b6994 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:56.492557 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.objects.instance [None req-d6e25dfa-6929-4228-bfe3-f15f0b4b6994 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lazy-loading 'fault' on Instance uuid aee36c9d-baf4-453c-b88f-31b8f23638c2 {{(pid=138744) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 20:59:56.756316 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-d6e25dfa-6929-4228-bfe3-f15f0b4b6994 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d3d7458af447bdb3f03e83a2d8559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49238b8686d24ae698679e4a1957735d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:59:56.758748 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell0:SELECT=2 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:59:56.767682 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-d6e25dfa-6929-4228-bfe3-f15f0b4b6994 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] 10.222.0.18 "GET /compute/v2.1/servers/aee36c9d-baf4-453c-b88f-31b8f23638c2" status: 200 len: 1369 microversion: 2.1 time: 0.464092 Oct 22 20:59:56.785681 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1153/2458] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:59:56 2022] GET /compute/v2.1/servers/aee36c9d-baf4-453c-b88f-31b8f23638c2 => generated 1369 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:59:56.793310 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-42d5279f-b0a2-4985-bfe9-d300b1d61c39 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:59:56.794551 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-42d5279f-b0a2-4985-bfe9-d300b1d61c39 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] [instance: 7dde7a20-b949-4c72-ae19-83f2f0afd0d1] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:59:56.806185 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-42d5279f-b0a2-4985-bfe9-d300b1d61c39 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:56.806980 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-42d5279f-b0a2-4985-bfe9-d300b1d61c39 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:56.807720 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-42d5279f-b0a2-4985-bfe9-d300b1d61c39 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:56.808723 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-42d5279f-b0a2-4985-bfe9-d300b1d61c39 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:56.809377 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-42d5279f-b0a2-4985-bfe9-d300b1d61c39 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:56.810230 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-42d5279f-b0a2-4985-bfe9-d300b1d61c39 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:57.622824 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-42d5279f-b0a2-4985-bfe9-d300b1d61c39 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d49952dbca4d95a25411b65d56552b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed31e93b0e8a43f28e497f94318815ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:59:57.632446 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-42d5279f-b0a2-4985-bfe9-d300b1d61c39 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] 10.222.0.18 "GET /compute/v2.1/servers/7dde7a20-b949-4c72-ae19-83f2f0afd0d1" status: 200 len: 1315 microversion: 2.1 time: 0.844791 Oct 22 20:59:57.633356 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1154/2459] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:59:56 2022] GET /compute/v2.1/servers/7dde7a20-b949-4c72-ae19-83f2f0afd0d1 => generated 1315 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 20:59:57.655597 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-a9eb315f-1abb-4285-904d-cf8264a528fd tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:59:57.656567 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-a9eb315f-1abb-4285-904d-cf8264a528fd tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] [instance: f38f14b2-b9d7-4bed-92ba-7b95ea4b2270] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:59:57.664327 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a9eb315f-1abb-4285-904d-cf8264a528fd tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:57.665204 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a9eb315f-1abb-4285-904d-cf8264a528fd tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:57.666024 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a9eb315f-1abb-4285-904d-cf8264a528fd tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:57.667024 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a9eb315f-1abb-4285-904d-cf8264a528fd tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:57.667780 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a9eb315f-1abb-4285-904d-cf8264a528fd tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:57.668506 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a9eb315f-1abb-4285-904d-cf8264a528fd tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:58.284080 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-270658c8-a103-4042-9a07-5e441fcc6c91 tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] 10.222.0.18 "POST /compute/v2.1/servers/ae58d60e-a113-4a38-94b5-b72a19c353e6/action" status: 202 len: 0 microversion: 2.1 time: 3.039132 Oct 22 20:59:58.285713 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1306/2460] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 20:59:55 2022] POST /compute/v2.1/servers/ae58d60e-a113-4a38-94b5-b72a19c353e6/action => generated 0 bytes in 3042 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 22 20:59:58.291658 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-7b6acfdf-bad5-4946-9e6b-02a00a2ed3e7 req-53641b77-bde2-4e99-8fab-fd4a1406ead8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f38f14b2-b9d7-4bed-92ba-7b95ea4b2270", "tag": "0600dbf3-8593-4575-a8b3-daa0446351bb"}, {"server_uuid": "aee36c9d-baf4-453c-b88f-31b8f23638c2", "name": "network-vif-deleted", "tag": "f8ab0e3e-04fa-4f80-97a2-b20b84653be1"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:59:58.314557 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-7b6acfdf-bad5-4946-9e6b-02a00a2ed3e7 req-53641b77-bde2-4e99-8fab-fd4a1406ead8 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:58.315484 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-7b6acfdf-bad5-4946-9e6b-02a00a2ed3e7 req-53641b77-bde2-4e99-8fab-fd4a1406ead8 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:58.316082 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-7b6acfdf-bad5-4946-9e6b-02a00a2ed3e7 req-53641b77-bde2-4e99-8fab-fd4a1406ead8 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:58.367610 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-7b6acfdf-bad5-4946-9e6b-02a00a2ed3e7 req-53641b77-bde2-4e99-8fab-fd4a1406ead8 service nova] Creating event network-changed:0600dbf3-8593-4575-a8b3-daa0446351bb for instance f38f14b2-b9d7-4bed-92ba-7b95ea4b2270 on nch2-master-1 Oct 22 20:59:58.368310 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-7b6acfdf-bad5-4946-9e6b-02a00a2ed3e7 req-53641b77-bde2-4e99-8fab-fd4a1406ead8 service nova] Creating event network-vif-deleted:f8ab0e3e-04fa-4f80-97a2-b20b84653be1 for instance aee36c9d-baf4-453c-b88f-31b8f23638c2 on nch1-master-1 Oct 22 20:59:58.391555 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-7b6acfdf-bad5-4946-9e6b-02a00a2ed3e7 req-53641b77-bde2-4e99-8fab-fd4a1406ead8 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.103855 Oct 22 20:59:58.397600 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1307/2461] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:59:58 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:59:58.405127 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-95200cb5-e60a-4412-a086-f03e4d800f91 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Calling method '.version_select at 0x7fd39fd34c10>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:59:58.462197 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-95200cb5-e60a-4412-a086-f03e4d800f91 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] 10.222.0.18 "GET /compute/v2.1/images/73de2577-b5d2-45cf-8720-87f3c939c723" status: 200 len: 662 microversion: 2.1 time: 0.063021 Oct 22 20:59:58.462972 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1308/2462] 10.222.0.18 () {58 vars in 1233 bytes} [Sat Oct 22 20:59:58 2022] GET /compute/v2.1/images/73de2577-b5d2-45cf-8720-87f3c939c723 => generated 662 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:59:58.468173 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-cd1f2964-72d6-45cc-9da5-83ea31a06563 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:59:58.469110 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-cd1f2964-72d6-45cc-9da5-83ea31a06563 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] [instance: aee36c9d-baf4-453c-b88f-31b8f23638c2] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:59:58.477603 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cd1f2964-72d6-45cc-9da5-83ea31a06563 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:58.478321 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cd1f2964-72d6-45cc-9da5-83ea31a06563 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:58.478934 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cd1f2964-72d6-45cc-9da5-83ea31a06563 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:58.479834 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cd1f2964-72d6-45cc-9da5-83ea31a06563 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:58.480460 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cd1f2964-72d6-45cc-9da5-83ea31a06563 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:58.481075 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cd1f2964-72d6-45cc-9da5-83ea31a06563 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:58.496577 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.wsgi [None req-cd1f2964-72d6-45cc-9da5-83ea31a06563 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] HTTP exception thrown: Instance aee36c9d-baf4-453c-b88f-31b8f23638c2 could not be found. Oct 22 20:59:58.498791 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-cd1f2964-72d6-45cc-9da5-83ea31a06563 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Request method failure captured: Oct 22 20:59:58.498791 ncdv-master-1 devstack@n-api.service[138745]: request: GET /compute/v2.1/servers/aee36c9d-baf4-453c-b88f-31b8f23638c2 HTTP/1.1 Oct 22 20:59:58.498791 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 20:59:58.498791 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 20:59:58.498791 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 20:59:58.498791 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 0 Oct 22 20:59:58.498791 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 20:59:58.498791 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 20:59:58.498791 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 20:59:58.498791 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 20:59:58.498791 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVFhmBIyEFZ5UaXjuS-XjHeNq2NZJ6-PZgGZeaIaSAZodIQmPMubSjCIS9wmprAg5WbUhxuYoYXOd3qlNfUL_HEhVyaVH9bKA87Iahwjb-u8_gTW16ah_HU_-UGEZkL42b1zllNGPhcx4qIPpE4vl5evkvpnkDsCfCEWPisgVtTaLG3k Oct 22 20:59:58.498791 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 20:59:58.498791 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 20:59:58.498791 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 20:59:58.498791 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 20:59:58.498791 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 20:59:58.498791 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 20:59:58.498791 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: 49238b8686d24ae698679e4a1957735d Oct 22 20:59:58.498791 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-MigrationsAdminTest-1624122076 Oct 22 20:59:58.498791 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 20:59:58.498791 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 20:59:58.498791 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_49238b8686d24ae698679e4a1957735d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/49238b8686d24ae698679e4a1957735d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/49238b8686d24ae698679e4a1957735d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/49238b8686d24ae698679e4a1957735d"}]}] Oct 22 20:59:58.498791 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-MigrationsAdminTest-1624122076 Oct 22 20:59:58.498791 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: 49238b8686d24ae698679e4a1957735d Oct 22 20:59:58.498791 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-MigrationsAdminTest-1624122076 Oct 22 20:59:58.498791 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-MigrationsAdminTest-1624122076-project Oct 22 20:59:58.498791 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 20:59:58.498791 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 20:59:58.498791 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: e0d3d7458af447bdb3f03e83a2d8559f Oct 22 20:59:58.498791 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-MigrationsAdminTest-1624122076-project Oct 22 20:59:58.498791 ncdv-master-1 devstack@n-api.service[138745]: method: > Oct 22 20:59:58.498791 ncdv-master-1 devstack@n-api.service[138745]: exception: Instance aee36c9d-baf4-453c-b88f-31b8f23638c2 could not be found. Oct 22 20:59:58.498791 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'id': 'aee36c9d-baf4-453c-b88f-31b8f23638c2'} Oct 22 20:59:58.498791 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 20:59:58.498791 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:59:58.498791 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 20:59:58.498791 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 20:59:58.498791 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 20:59:58.498791 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 20:59:58.498791 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 20:59:58.498791 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 20:59:58.498791 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 20:59:58.498791 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 20:59:58.498791 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aee36c9d-baf4-453c-b88f-31b8f23638c2 could not be found. Oct 22 20:59:58.498791 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:59:58.498791 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:59:58.498791 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:59:58.498791 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:59:58.498791 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:59:58.498791 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:59:58.498791 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 20:59:58.498791 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 20:59:58.498791 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 20:59:58.498791 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 20:59:58.498791 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 20:59:58.498791 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 20:59:58.498791 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 20:59:58.498791 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 20:59:58.498791 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 20:59:58.498791 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 20:59:58.498791 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aee36c9d-baf4-453c-b88f-31b8f23638c2 could not be found. Oct 22 20:59:58.498791 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:59:58.498791 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 20:59:58.498791 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:59:58.503494 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 20:59:58.503494 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 20:59:58.503494 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 20:59:58.503494 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 20:59:58.503494 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 20:59:58.503494 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aee36c9d-baf4-453c-b88f-31b8f23638c2 could not be found. Oct 22 20:59:58.503494 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 20:59:58.505564 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-cd1f2964-72d6-45cc-9da5-83ea31a06563 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Returning 404 to user: Instance aee36c9d-baf4-453c-b88f-31b8f23638c2 could not be found. {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 20:59:58.506638 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-cd1f2964-72d6-45cc-9da5-83ea31a06563 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] 10.222.0.18 "GET /compute/v2.1/servers/aee36c9d-baf4-453c-b88f-31b8f23638c2" status: 404 len: 111 microversion: 2.1 time: 0.042485 Oct 22 20:59:58.507739 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1309/2463] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:59:58 2022] GET /compute/v2.1/servers/aee36c9d-baf4-453c-b88f-31b8f23638c2 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 20:59:58.513200 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-ec31d337-a610-4a68-a592-00c8a7e586cb tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Action: 'create', calling method: .version_select at 0x7fd3a426a3a0>, body: {"pool": null} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:59:58.544762 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-a9eb315f-1abb-4285-904d-cf8264a528fd tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211483c6acea4f76b6c0e4bfc818e7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd687d54e07d4ab4af00ad801ef4b58d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:59:58.554397 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-a9eb315f-1abb-4285-904d-cf8264a528fd tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '211483c6acea4f76b6c0e4bfc818e7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd687d54e07d4ab4af00ad801ef4b58d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:59:58.555872 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-a9eb315f-1abb-4285-904d-cf8264a528fd tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '211483c6acea4f76b6c0e4bfc818e7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd687d54e07d4ab4af00ad801ef4b58d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 20:59:58.557062 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-a9eb315f-1abb-4285-904d-cf8264a528fd tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] 10.222.0.18 "GET /compute/v2.1/servers/f38f14b2-b9d7-4bed-92ba-7b95ea4b2270" status: 200 len: 1874 microversion: 2.42 time: 0.908161 Oct 22 20:59:58.557641 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1155/2464] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 20:59:57 2022] GET /compute/v2.1/servers/f38f14b2-b9d7-4bed-92ba-7b95ea4b2270 => generated 1874 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 20:59:58.591385 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-fc9b18c0-524e-4838-a469-8482bb63e346 req-e5b6a0f1-cfb7-4c19-abf0-6d36fb144919 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7dde7a20-b949-4c72-ae19-83f2f0afd0d1", "tag": "e4d75169-7798-4abd-957f-2abc3db1143a"}, {"name": "network-changed", "server_uuid": "ae58d60e-a113-4a38-94b5-b72a19c353e6", "tag": "6bbd4b8b-948d-44a4-8b7f-6968bc1dc2cf"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 20:59:58.613882 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-fc9b18c0-524e-4838-a469-8482bb63e346 req-e5b6a0f1-cfb7-4c19-abf0-6d36fb144919 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:58.614275 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-fc9b18c0-524e-4838-a469-8482bb63e346 req-e5b6a0f1-cfb7-4c19-abf0-6d36fb144919 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:58.614719 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-fc9b18c0-524e-4838-a469-8482bb63e346 req-e5b6a0f1-cfb7-4c19-abf0-6d36fb144919 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:58.628561 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-fc9b18c0-524e-4838-a469-8482bb63e346 req-e5b6a0f1-cfb7-4c19-abf0-6d36fb144919 service nova] Creating event network-changed:e4d75169-7798-4abd-957f-2abc3db1143a for instance 7dde7a20-b949-4c72-ae19-83f2f0afd0d1 on nch1-master-1 Oct 22 20:59:58.629126 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-fc9b18c0-524e-4838-a469-8482bb63e346 req-e5b6a0f1-cfb7-4c19-abf0-6d36fb144919 service nova] Creating event network-changed:6bbd4b8b-948d-44a4-8b7f-6968bc1dc2cf for instance ae58d60e-a113-4a38-94b5-b72a19c353e6 on nch2-master-1 Oct 22 20:59:58.649582 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-fc9b18c0-524e-4838-a469-8482bb63e346 req-e5b6a0f1-cfb7-4c19-abf0-6d36fb144919 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.061942 Oct 22 20:59:58.650535 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1156/2465] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 20:59:58 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:59:58.656648 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-e98eb009-b603-4808-9244-874d5b5e3463 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Calling method '.version_select at 0x7fd39f1985e0>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:59:58.704512 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-e98eb009-b603-4808-9244-874d5b5e3463 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] 10.222.0.18 "GET /compute/v2.1/images/73de2577-b5d2-45cf-8720-87f3c939c723" status: 200 len: 662 microversion: 2.1 time: 0.052130 Oct 22 20:59:58.705676 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1157/2466] 10.222.0.18 () {58 vars in 1233 bytes} [Sat Oct 22 20:59:58 2022] GET /compute/v2.1/images/73de2577-b5d2-45cf-8720-87f3c939c723 => generated 662 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 20:59:58.710991 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-d4485fb0-228f-49c6-bea0-49af5c9fe59d tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Calling method '.version_select at 0x7fd39f198430>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:59:58.737175 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-d4485fb0-228f-49c6-bea0-49af5c9fe59d tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1223693064" status: 202 len: 0 microversion: 2.1 time: 0.030097 Oct 22 20:59:58.738032 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1158/2467] 10.222.0.18 () {58 vars in 1221 bytes} [Sat Oct 22 20:59:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1223693064 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 20:59:58.747693 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-aee51358-1d5e-4132-bb6c-a268164d84a4 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 20:59:58.748928 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-aee51358-1d5e-4132-bb6c-a268164d84a4 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] [instance: 7dde7a20-b949-4c72-ae19-83f2f0afd0d1] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 20:59:58.758244 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-aee51358-1d5e-4132-bb6c-a268164d84a4 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:58.759040 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-aee51358-1d5e-4132-bb6c-a268164d84a4 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:58.760817 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-aee51358-1d5e-4132-bb6c-a268164d84a4 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 20:59:58.761761 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-aee51358-1d5e-4132-bb6c-a268164d84a4 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 20:59:58.762581 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-aee51358-1d5e-4132-bb6c-a268164d84a4 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 20:59:58.763307 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-aee51358-1d5e-4132-bb6c-a268164d84a4 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:00.191991 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-aee51358-1d5e-4132-bb6c-a268164d84a4 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d49952dbca4d95a25411b65d56552b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed31e93b0e8a43f28e497f94318815ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:00:00.201298 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:00:00.207633 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-aee51358-1d5e-4132-bb6c-a268164d84a4 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] 10.222.0.18 "GET /compute/v2.1/servers/7dde7a20-b949-4c72-ae19-83f2f0afd0d1" status: 200 len: 1315 microversion: 2.1 time: 1.465665 Oct 22 21:00:00.208366 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1159/2468] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 20:59:58 2022] GET /compute/v2.1/servers/7dde7a20-b949-4c72-ae19-83f2f0afd0d1 => generated 1315 bytes in 1470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:00:00.219629 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-ae4a289a-f9a6-4600-8b3a-72da40337c8f tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:00:00.220614 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-ae4a289a-f9a6-4600-8b3a-72da40337c8f tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] [instance: f38f14b2-b9d7-4bed-92ba-7b95ea4b2270] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:00:00.224090 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:00:00.230642 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ae4a289a-f9a6-4600-8b3a-72da40337c8f tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:00.231979 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ae4a289a-f9a6-4600-8b3a-72da40337c8f tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:00.232777 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ae4a289a-f9a6-4600-8b3a-72da40337c8f tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:00.233726 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ae4a289a-f9a6-4600-8b3a-72da40337c8f tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:00.234605 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ae4a289a-f9a6-4600-8b3a-72da40337c8f tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:00.235249 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ae4a289a-f9a6-4600-8b3a-72da40337c8f tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:01.218385 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-ae4a289a-f9a6-4600-8b3a-72da40337c8f tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211483c6acea4f76b6c0e4bfc818e7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd687d54e07d4ab4af00ad801ef4b58d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:00:01.236073 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-ae4a289a-f9a6-4600-8b3a-72da40337c8f tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '211483c6acea4f76b6c0e4bfc818e7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd687d54e07d4ab4af00ad801ef4b58d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:00:01.238523 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-ae4a289a-f9a6-4600-8b3a-72da40337c8f tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '211483c6acea4f76b6c0e4bfc818e7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd687d54e07d4ab4af00ad801ef4b58d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:00:01.241850 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-ae4a289a-f9a6-4600-8b3a-72da40337c8f tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] 10.222.0.18 "GET /compute/v2.1/servers/f38f14b2-b9d7-4bed-92ba-7b95ea4b2270" status: 200 len: 1874 microversion: 2.42 time: 1.031707 Oct 22 21:00:01.257868 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1160/2469] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:00:00 2022] GET /compute/v2.1/servers/f38f14b2-b9d7-4bed-92ba-7b95ea4b2270 => generated 1874 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:00:01.268656 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-7054e953-5b14-489f-b207-88a8d466460a tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:00:01.270496 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-7054e953-5b14-489f-b207-88a8d466460a tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] [instance: 98f48cb1-54ed-4e82-8a25-fd004ddb5758] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:00:01.277943 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7054e953-5b14-489f-b207-88a8d466460a tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:01.278871 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7054e953-5b14-489f-b207-88a8d466460a tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:01.279428 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7054e953-5b14-489f-b207-88a8d466460a tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:01.280417 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7054e953-5b14-489f-b207-88a8d466460a tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:01.280904 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7054e953-5b14-489f-b207-88a8d466460a tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:01.281345 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7054e953-5b14-489f-b207-88a8d466460a tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:01.324911 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-7054e953-5b14-489f-b207-88a8d466460a tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] [instance: 98f48cb1-54ed-4e82-8a25-fd004ddb5758] Going to try to terminate instance {{(pid=138744) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 21:00:01.462011 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-7054e953-5b14-489f-b207-88a8d466460a tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] 10.222.0.18 "DELETE /compute/v2.1/servers/98f48cb1-54ed-4e82-8a25-fd004ddb5758" status: 204 len: 0 microversion: 2.1 time: 0.201497 Oct 22 21:00:01.463249 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1161/2470] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 21:00:01 2022] DELETE /compute/v2.1/servers/98f48cb1-54ed-4e82-8a25-fd004ddb5758 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 21:00:01.476271 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-ea165e35-4159-4d8d-86ac-3432403942ee tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Calling method '.version_select at 0x7fd39f21f1f0>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:00:01.570514 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-ea165e35-4159-4d8d-86ac-3432403942ee tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] 10.222.0.18 "GET /compute/v2.1/images/41ee8951-b671-4839-8f15-190b7f5e7484" status: 200 len: 662 microversion: 2.1 time: 0.105545 Oct 22 21:00:01.571694 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1162/2471] 10.222.0.18 () {58 vars in 1233 bytes} [Sat Oct 22 21:00:01 2022] GET /compute/v2.1/images/41ee8951-b671-4839-8f15-190b7f5e7484 => generated 662 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:00:01.581956 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-f4c2d63b-27e6-43d2-9479-35acfd719a54 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:00:01.583832 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-f4c2d63b-27e6-43d2-9479-35acfd719a54 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] [instance: 7dde7a20-b949-4c72-ae19-83f2f0afd0d1] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:00:01.603146 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f4c2d63b-27e6-43d2-9479-35acfd719a54 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:01.603870 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f4c2d63b-27e6-43d2-9479-35acfd719a54 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:01.604353 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f4c2d63b-27e6-43d2-9479-35acfd719a54 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:01.605073 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f4c2d63b-27e6-43d2-9479-35acfd719a54 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:01.605525 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f4c2d63b-27e6-43d2-9479-35acfd719a54 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:01.605944 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f4c2d63b-27e6-43d2-9479-35acfd719a54 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:02.096739 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-f4c2d63b-27e6-43d2-9479-35acfd719a54 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d49952dbca4d95a25411b65d56552b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed31e93b0e8a43f28e497f94318815ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:00:02.114193 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-f4c2d63b-27e6-43d2-9479-35acfd719a54 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] 10.222.0.18 "GET /compute/v2.1/servers/7dde7a20-b949-4c72-ae19-83f2f0afd0d1" status: 200 len: 1315 microversion: 2.1 time: 0.540546 Oct 22 21:00:02.116494 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1163/2472] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:00:01 2022] GET /compute/v2.1/servers/7dde7a20-b949-4c72-ae19-83f2f0afd0d1 => generated 1315 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:00:02.129964 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-4b3fe3ad-fd2c-4593-82bc-0b0ce4458509 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:00:02.131432 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-4b3fe3ad-fd2c-4593-82bc-0b0ce4458509 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] [instance: 98f48cb1-54ed-4e82-8a25-fd004ddb5758] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:00:02.149132 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4b3fe3ad-fd2c-4593-82bc-0b0ce4458509 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:02.150922 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4b3fe3ad-fd2c-4593-82bc-0b0ce4458509 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:02.151660 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4b3fe3ad-fd2c-4593-82bc-0b0ce4458509 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:02.152612 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4b3fe3ad-fd2c-4593-82bc-0b0ce4458509 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:02.156343 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4b3fe3ad-fd2c-4593-82bc-0b0ce4458509 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:02.157108 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4b3fe3ad-fd2c-4593-82bc-0b0ce4458509 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:03.244041 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-4b3fe3ad-fd2c-4593-82bc-0b0ce4458509 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d3d7458af447bdb3f03e83a2d8559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49238b8686d24ae698679e4a1957735d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:00:03.254805 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-4b3fe3ad-fd2c-4593-82bc-0b0ce4458509 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] 10.222.0.18 "GET /compute/v2.1/servers/98f48cb1-54ed-4e82-8a25-fd004ddb5758" status: 200 len: 1466 microversion: 2.1 time: 1.133835 Oct 22 21:00:03.265578 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1164/2473] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:00:02 2022] GET /compute/v2.1/servers/98f48cb1-54ed-4e82-8a25-fd004ddb5758 => generated 1466 bytes in 1145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:00:03.276594 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-5ab6b289-4982-4e32-9be9-9094c5b271cc tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Calling method '.version_select at 0x7fd39fe96dc0>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:00:03.364845 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-5ab6b289-4982-4e32-9be9-9094c5b271cc tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] 10.222.0.18 "GET /compute/v2.1/images/41ee8951-b671-4839-8f15-190b7f5e7484" status: 200 len: 662 microversion: 2.1 time: 0.097941 Oct 22 21:00:03.374737 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1165/2474] 10.222.0.18 () {58 vars in 1233 bytes} [Sat Oct 22 21:00:03 2022] GET /compute/v2.1/images/41ee8951-b671-4839-8f15-190b7f5e7484 => generated 662 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:00:03.387996 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-f1834ead-0618-42a8-8e46-47ecd3f9767a tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:00:03.389201 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-f1834ead-0618-42a8-8e46-47ecd3f9767a tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] [instance: f38f14b2-b9d7-4bed-92ba-7b95ea4b2270] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:00:03.398114 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f1834ead-0618-42a8-8e46-47ecd3f9767a tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:03.398940 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f1834ead-0618-42a8-8e46-47ecd3f9767a tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:03.399625 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f1834ead-0618-42a8-8e46-47ecd3f9767a tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:03.400619 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f1834ead-0618-42a8-8e46-47ecd3f9767a tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:03.401300 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f1834ead-0618-42a8-8e46-47ecd3f9767a tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:03.402032 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f1834ead-0618-42a8-8e46-47ecd3f9767a tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:04.372667 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-f1834ead-0618-42a8-8e46-47ecd3f9767a tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211483c6acea4f76b6c0e4bfc818e7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd687d54e07d4ab4af00ad801ef4b58d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:00:04.383788 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-f1834ead-0618-42a8-8e46-47ecd3f9767a tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '211483c6acea4f76b6c0e4bfc818e7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd687d54e07d4ab4af00ad801ef4b58d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:00:04.392156 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-f1834ead-0618-42a8-8e46-47ecd3f9767a tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '211483c6acea4f76b6c0e4bfc818e7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd687d54e07d4ab4af00ad801ef4b58d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:00:04.405348 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-f1834ead-0618-42a8-8e46-47ecd3f9767a tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] 10.222.0.18 "GET /compute/v2.1/servers/f38f14b2-b9d7-4bed-92ba-7b95ea4b2270" status: 200 len: 1874 microversion: 2.42 time: 1.029000 Oct 22 21:00:04.406620 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1166/2475] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:00:03 2022] GET /compute/v2.1/servers/f38f14b2-b9d7-4bed-92ba-7b95ea4b2270 => generated 1874 bytes in 1031 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:00:04.412028 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-ef2f3173-ef30-487b-83bd-231b48bbc94a tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:00:04.412882 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-ef2f3173-ef30-487b-83bd-231b48bbc94a tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] [instance: 7dde7a20-b949-4c72-ae19-83f2f0afd0d1] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:00:04.423631 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ef2f3173-ef30-487b-83bd-231b48bbc94a tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:04.426854 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ef2f3173-ef30-487b-83bd-231b48bbc94a tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:04.427619 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ef2f3173-ef30-487b-83bd-231b48bbc94a tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:04.428581 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ef2f3173-ef30-487b-83bd-231b48bbc94a tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:04.429553 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ef2f3173-ef30-487b-83bd-231b48bbc94a tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:04.435710 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ef2f3173-ef30-487b-83bd-231b48bbc94a tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:04.450895 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-ec31d337-a610-4a68-a592-00c8a7e586cb tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] 10.222.0.18 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 5.941902 Oct 22 21:00:04.451855 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1310/2476] 10.222.0.18 () {60 vars in 1170 bytes} [Sat Oct 22 20:59:58 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 5943 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:00:04.456389 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-0c19bee1-c6af-4671-9aa2-d72d01df3045 req-7c76d8de-b53e-434b-99cf-1415eb685182 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7dde7a20-b949-4c72-ae19-83f2f0afd0d1", "name": "network-vif-plugged", "status": "completed", "tag": "e4d75169-7798-4abd-957f-2abc3db1143a"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:00:04.484520 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-0c19bee1-c6af-4671-9aa2-d72d01df3045 req-7c76d8de-b53e-434b-99cf-1415eb685182 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:04.485360 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-0c19bee1-c6af-4671-9aa2-d72d01df3045 req-7c76d8de-b53e-434b-99cf-1415eb685182 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:04.485500 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-0c19bee1-c6af-4671-9aa2-d72d01df3045 req-7c76d8de-b53e-434b-99cf-1415eb685182 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:04.517134 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-0c19bee1-c6af-4671-9aa2-d72d01df3045 req-7c76d8de-b53e-434b-99cf-1415eb685182 service nova] Creating event network-vif-plugged:e4d75169-7798-4abd-957f-2abc3db1143a for instance 7dde7a20-b949-4c72-ae19-83f2f0afd0d1 on nch1-master-1 Oct 22 21:00:04.532494 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-0c19bee1-c6af-4671-9aa2-d72d01df3045 req-7c76d8de-b53e-434b-99cf-1415eb685182 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079305 Oct 22 21:00:04.533822 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1311/2477] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:00:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:00:04.539661 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-d585b3be-9b14-4c87-8c1f-3aee4cfe07e1 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:00:04.539837 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-d585b3be-9b14-4c87-8c1f-3aee4cfe07e1 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] [instance: 98f48cb1-54ed-4e82-8a25-fd004ddb5758] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:00:04.551745 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d585b3be-9b14-4c87-8c1f-3aee4cfe07e1 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:04.552208 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d585b3be-9b14-4c87-8c1f-3aee4cfe07e1 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:04.552640 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d585b3be-9b14-4c87-8c1f-3aee4cfe07e1 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:04.553355 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d585b3be-9b14-4c87-8c1f-3aee4cfe07e1 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:04.553911 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d585b3be-9b14-4c87-8c1f-3aee4cfe07e1 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:04.554348 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d585b3be-9b14-4c87-8c1f-3aee4cfe07e1 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:04.938414 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-ef2f3173-ef30-487b-83bd-231b48bbc94a tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d49952dbca4d95a25411b65d56552b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed31e93b0e8a43f28e497f94318815ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:00:04.946914 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-ef2f3173-ef30-487b-83bd-231b48bbc94a tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] 10.222.0.18 "GET /compute/v2.1/servers/7dde7a20-b949-4c72-ae19-83f2f0afd0d1" status: 200 len: 1315 microversion: 2.1 time: 0.538871 Oct 22 21:00:04.947648 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1167/2478] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:00:04 2022] GET /compute/v2.1/servers/7dde7a20-b949-4c72-ae19-83f2f0afd0d1 => generated 1315 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:00:04.968128 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-ae8f3995-146f-4bf0-a5a0-66280982492c tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.35.2.78"}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:00:04.978645 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-ae8f3995-146f-4bf0-a5a0-66280982492c tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] [instance: ae58d60e-a113-4a38-94b5-b72a19c353e6] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:00:05.007366 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ae8f3995-146f-4bf0-a5a0-66280982492c tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:05.011203 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ae8f3995-146f-4bf0-a5a0-66280982492c tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:05.011743 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ae8f3995-146f-4bf0-a5a0-66280982492c tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:05.015541 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ae8f3995-146f-4bf0-a5a0-66280982492c tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:05.016146 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ae8f3995-146f-4bf0-a5a0-66280982492c tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:05.016928 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ae8f3995-146f-4bf0-a5a0-66280982492c tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:05.065269 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ae8f3995-146f-4bf0-a5a0-66280982492c tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Acquiring lock "refresh_cache-ae58d60e-a113-4a38-94b5-b72a19c353e6" {{(pid=138744) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 22 21:00:05.066025 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ae8f3995-146f-4bf0-a5a0-66280982492c tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Acquired lock "refresh_cache-ae58d60e-a113-4a38-94b5-b72a19c353e6" {{(pid=138744) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 22 21:00:05.087734 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-d585b3be-9b14-4c87-8c1f-3aee4cfe07e1 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d3d7458af447bdb3f03e83a2d8559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49238b8686d24ae698679e4a1957735d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:00:05.101428 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-d585b3be-9b14-4c87-8c1f-3aee4cfe07e1 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] 10.222.0.18 "GET /compute/v2.1/servers/98f48cb1-54ed-4e82-8a25-fd004ddb5758" status: 200 len: 1466 microversion: 2.1 time: 0.565509 Oct 22 21:00:05.101669 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1312/2479] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:00:04 2022] GET /compute/v2.1/servers/98f48cb1-54ed-4e82-8a25-fd004ddb5758 => generated 1466 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:00:05.123284 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-59e9bd9f-5f0c-4c4e-bcbb-701f2180d265 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Calling method '.version_select at 0x7fd39fd34820>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:00:05.197215 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-59e9bd9f-5f0c-4c4e-bcbb-701f2180d265 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] 10.222.0.18 "GET /compute/v2.1/images/cab6fb6f-771e-4162-b5d7-02e27e5dfa7a" status: 200 len: 662 microversion: 2.1 time: 0.078786 Oct 22 21:00:05.198596 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1313/2480] 10.222.0.18 () {58 vars in 1233 bytes} [Sat Oct 22 21:00:05 2022] GET /compute/v2.1/images/cab6fb6f-771e-4162-b5d7-02e27e5dfa7a => generated 662 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:00:05.215382 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-7514c913-d332-4b07-ac52-51323f4a6b10 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Calling method '.version_select at 0x7fd39fd839d0>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:00:05.309749 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-7514c913-d332-4b07-ac52-51323f4a6b10 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] 10.222.0.18 "GET /compute/v2.1/images/cab6fb6f-771e-4162-b5d7-02e27e5dfa7a" status: 200 len: 662 microversion: 2.1 time: 0.100504 Oct 22 21:00:05.323779 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1314/2481] 10.222.0.18 () {58 vars in 1233 bytes} [Sat Oct 22 21:00:05 2022] GET /compute/v2.1/images/cab6fb6f-771e-4162-b5d7-02e27e5dfa7a => generated 662 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 21:00:05.438260 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-a964dfae-7056-4c61-830b-04a66063022f tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:00:05.438892 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-a964dfae-7056-4c61-830b-04a66063022f tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] [instance: f38f14b2-b9d7-4bed-92ba-7b95ea4b2270] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:00:05.462125 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a964dfae-7056-4c61-830b-04a66063022f tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:05.462833 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a964dfae-7056-4c61-830b-04a66063022f tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:05.463166 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a964dfae-7056-4c61-830b-04a66063022f tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:05.468814 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a964dfae-7056-4c61-830b-04a66063022f tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:05.469641 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a964dfae-7056-4c61-830b-04a66063022f tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:05.470286 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a964dfae-7056-4c61-830b-04a66063022f tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:06.008400 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-a964dfae-7056-4c61-830b-04a66063022f tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211483c6acea4f76b6c0e4bfc818e7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd687d54e07d4ab4af00ad801ef4b58d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:00:06.034458 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-a964dfae-7056-4c61-830b-04a66063022f tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '211483c6acea4f76b6c0e4bfc818e7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd687d54e07d4ab4af00ad801ef4b58d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:00:06.039532 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-a964dfae-7056-4c61-830b-04a66063022f tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '211483c6acea4f76b6c0e4bfc818e7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd687d54e07d4ab4af00ad801ef4b58d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:00:06.045548 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-a964dfae-7056-4c61-830b-04a66063022f tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] 10.222.0.18 "GET /compute/v2.1/servers/f38f14b2-b9d7-4bed-92ba-7b95ea4b2270" status: 200 len: 1874 microversion: 2.42 time: 0.610235 Oct 22 21:00:06.046811 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1315/2482] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:00:05 2022] GET /compute/v2.1/servers/f38f14b2-b9d7-4bed-92ba-7b95ea4b2270 => generated 1874 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:00:06.065658 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-1393bd34-b6f8-4e3a-a09f-8d6495c6f593 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-2069209219", "imageRef": "085e4478-6edc-4a69-8e08-f9831713eb65", "flavorRef": "452"}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:00:06.176310 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.network.neutron [None req-1393bd34-b6f8-4e3a-a09f-8d6495c6f593 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] validate_networks() for None {{(pid=138745) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 21:00:07.004556 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-1393bd34-b6f8-4e3a-a09f-8d6495c6f593 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Flavor limits 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 21:00:07.005809 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-1393bd34-b6f8-4e3a-a09f-8d6495c6f593 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Image limits 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 21:00:07.006610 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-1393bd34-b6f8-4e3a-a09f-8d6495c6f593 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Flavor pref 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 21:00:07.007251 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-1393bd34-b6f8-4e3a-a09f-8d6495c6f593 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Image pref 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 21:00:07.007894 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-1393bd34-b6f8-4e3a-a09f-8d6495c6f593 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 21:00:07.030670 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1393bd34-b6f8-4e3a-a09f-8d6495c6f593 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:07.031718 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1393bd34-b6f8-4e3a-a09f-8d6495c6f593 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:07.032312 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1393bd34-b6f8-4e3a-a09f-8d6495c6f593 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:07.033292 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1393bd34-b6f8-4e3a-a09f-8d6495c6f593 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:07.033902 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1393bd34-b6f8-4e3a-a09f-8d6495c6f593 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:07.034497 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1393bd34-b6f8-4e3a-a09f-8d6495c6f593 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:07.080597 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-1393bd34-b6f8-4e3a-a09f-8d6495c6f593 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Getting quotas for project b6e01f91c3a845bf8e67e3ad415d9c69. Resources: {'cores', 'instances', 'ram'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 21:00:07.087443 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-1393bd34-b6f8-4e3a-a09f-8d6495c6f593 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Getting quotas for user 2b9bfe6f6d564d4c9fb1fea439476e03 and project b6e01f91c3a845bf8e67e3ad415d9c69. Resources: {'cores', 'instances', 'ram'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 21:00:07.116805 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-1393bd34-b6f8-4e3a-a09f-8d6495c6f593 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Going to run 1 instances... {{(pid=138745) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 21:00:07.119499 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-1393bd34-b6f8-4e3a-a09f-8d6495c6f593 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] [instance: 70f4c178-630e-4050-8aad-4c60bec30bcd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='085e4478-6edc-4a69-8e08-f9831713eb65',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138745) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 21:00:07.213741 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-1393bd34-b6f8-4e3a-a09f-8d6495c6f593 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.165452 Oct 22 21:00:07.219423 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1316/2483] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Oct 22 21:00:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 1172 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 21:00:07.234906 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-beb258ee-f4b0-4e0a-98fc-827d18ad7d19 req-5bf4a047-636d-4c58-bb60-614d58b14a2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98f48cb1-54ed-4e82-8a25-fd004ddb5758", "name": "network-vif-deleted", "tag": "1d82207b-0e45-42ab-8c7f-4bf4bac8d993"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:00:07.263695 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-beb258ee-f4b0-4e0a-98fc-827d18ad7d19 req-5bf4a047-636d-4c58-bb60-614d58b14a2c service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:07.264717 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-beb258ee-f4b0-4e0a-98fc-827d18ad7d19 req-5bf4a047-636d-4c58-bb60-614d58b14a2c service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:07.265215 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-beb258ee-f4b0-4e0a-98fc-827d18ad7d19 req-5bf4a047-636d-4c58-bb60-614d58b14a2c service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:07.282212 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-beb258ee-f4b0-4e0a-98fc-827d18ad7d19 req-5bf4a047-636d-4c58-bb60-614d58b14a2c service nova] Creating event network-vif-deleted:1d82207b-0e45-42ab-8c7f-4bf4bac8d993 for instance 98f48cb1-54ed-4e82-8a25-fd004ddb5758 on nch1-master-1 Oct 22 21:00:07.289651 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-beb258ee-f4b0-4e0a-98fc-827d18ad7d19 req-5bf4a047-636d-4c58-bb60-614d58b14a2c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067992 Oct 22 21:00:07.294005 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1317/2484] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:00:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:00:07.305128 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-b389aa5e-4a9c-4665-bb91-437b52e2c19a tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:00:07.306465 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-b389aa5e-4a9c-4665-bb91-437b52e2c19a tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] [instance: 7dde7a20-b949-4c72-ae19-83f2f0afd0d1] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:00:07.319853 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b389aa5e-4a9c-4665-bb91-437b52e2c19a tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:07.320998 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b389aa5e-4a9c-4665-bb91-437b52e2c19a tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:07.321935 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b389aa5e-4a9c-4665-bb91-437b52e2c19a tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:07.330042 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b389aa5e-4a9c-4665-bb91-437b52e2c19a tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:07.331046 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b389aa5e-4a9c-4665-bb91-437b52e2c19a tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:07.331795 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b389aa5e-4a9c-4665-bb91-437b52e2c19a tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:08.267309 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-b389aa5e-4a9c-4665-bb91-437b52e2c19a tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d49952dbca4d95a25411b65d56552b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed31e93b0e8a43f28e497f94318815ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:00:08.280131 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-b389aa5e-4a9c-4665-bb91-437b52e2c19a tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] 10.222.0.18 "GET /compute/v2.1/servers/7dde7a20-b949-4c72-ae19-83f2f0afd0d1" status: 200 len: 1504 microversion: 2.1 time: 0.983818 Oct 22 21:00:08.281629 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1318/2485] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:00:07 2022] GET /compute/v2.1/servers/7dde7a20-b949-4c72-ae19-83f2f0afd0d1 => generated 1504 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:00:08.288370 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-518f8fcf-93c9-4c2e-998e-dfd3be74851c tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:00:08.289498 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-518f8fcf-93c9-4c2e-998e-dfd3be74851c tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] [instance: 98f48cb1-54ed-4e82-8a25-fd004ddb5758] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:00:08.299020 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-518f8fcf-93c9-4c2e-998e-dfd3be74851c tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:08.299850 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-518f8fcf-93c9-4c2e-998e-dfd3be74851c tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:08.300519 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-518f8fcf-93c9-4c2e-998e-dfd3be74851c tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:08.301448 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-518f8fcf-93c9-4c2e-998e-dfd3be74851c tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:08.302056 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-518f8fcf-93c9-4c2e-998e-dfd3be74851c tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:08.302686 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-518f8fcf-93c9-4c2e-998e-dfd3be74851c tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:08.333471 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.wsgi [None req-518f8fcf-93c9-4c2e-998e-dfd3be74851c tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] HTTP exception thrown: Instance 98f48cb1-54ed-4e82-8a25-fd004ddb5758 could not be found. Oct 22 21:00:08.336173 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-518f8fcf-93c9-4c2e-998e-dfd3be74851c tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Request method failure captured: Oct 22 21:00:08.336173 ncdv-master-1 devstack@n-api.service[138745]: request: GET /compute/v2.1/servers/98f48cb1-54ed-4e82-8a25-fd004ddb5758 HTTP/1.1 Oct 22 21:00:08.336173 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 21:00:08.336173 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 21:00:08.336173 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 21:00:08.336173 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 0 Oct 22 21:00:08.336173 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 21:00:08.336173 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 21:00:08.336173 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 21:00:08.336173 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 21:00:08.336173 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVFhmBIyEFZ5UaXjuS-XjHeNq2NZJ6-PZgGZeaIaSAZodIQmPMubSjCIS9wmprAg5WbUhxuYoYXOd3qlNfUL_HEhVyaVH9bKA87Iahwjb-u8_gTW16ah_HU_-UGEZkL42b1zllNGPhcx4qIPpE4vl5evkvpnkDsCfCEWPisgVtTaLG3k Oct 22 21:00:08.336173 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 21:00:08.336173 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 21:00:08.336173 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 21:00:08.336173 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 21:00:08.336173 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 21:00:08.336173 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 21:00:08.336173 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: 49238b8686d24ae698679e4a1957735d Oct 22 21:00:08.336173 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-MigrationsAdminTest-1624122076 Oct 22 21:00:08.336173 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 21:00:08.336173 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 21:00:08.336173 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_49238b8686d24ae698679e4a1957735d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/49238b8686d24ae698679e4a1957735d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/49238b8686d24ae698679e4a1957735d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/49238b8686d24ae698679e4a1957735d"}]}] Oct 22 21:00:08.336173 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-MigrationsAdminTest-1624122076 Oct 22 21:00:08.336173 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: 49238b8686d24ae698679e4a1957735d Oct 22 21:00:08.336173 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-MigrationsAdminTest-1624122076 Oct 22 21:00:08.336173 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-MigrationsAdminTest-1624122076-project Oct 22 21:00:08.336173 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 21:00:08.336173 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 21:00:08.336173 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: e0d3d7458af447bdb3f03e83a2d8559f Oct 22 21:00:08.336173 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-MigrationsAdminTest-1624122076-project Oct 22 21:00:08.336173 ncdv-master-1 devstack@n-api.service[138745]: method: > Oct 22 21:00:08.336173 ncdv-master-1 devstack@n-api.service[138745]: exception: Instance 98f48cb1-54ed-4e82-8a25-fd004ddb5758 could not be found. Oct 22 21:00:08.336173 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'id': '98f48cb1-54ed-4e82-8a25-fd004ddb5758'} Oct 22 21:00:08.336173 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:00:08.336173 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:00:08.336173 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 21:00:08.336173 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 21:00:08.336173 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 21:00:08.336173 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 21:00:08.336173 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 21:00:08.336173 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 21:00:08.336173 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 21:00:08.336173 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 21:00:08.336173 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 98f48cb1-54ed-4e82-8a25-fd004ddb5758 could not be found. Oct 22 21:00:08.336173 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:00:08.336173 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:00:08.336173 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:00:08.336173 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:00:08.336173 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:00:08.336173 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:00:08.336173 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:00:08.336173 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:00:08.336173 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:00:08.336173 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:00:08.336173 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 21:00:08.336173 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 21:00:08.336173 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 21:00:08.336173 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 21:00:08.336173 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 21:00:08.336173 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:00:08.336173 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 98f48cb1-54ed-4e82-8a25-fd004ddb5758 could not be found. Oct 22 21:00:08.336173 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:00:08.336173 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:00:08.336173 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:00:08.342562 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:00:08.342562 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:00:08.342562 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:00:08.342562 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:00:08.342562 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:00:08.342562 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 98f48cb1-54ed-4e82-8a25-fd004ddb5758 could not be found. Oct 22 21:00:08.342562 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:00:08.345293 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-518f8fcf-93c9-4c2e-998e-dfd3be74851c tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Returning 404 to user: Instance 98f48cb1-54ed-4e82-8a25-fd004ddb5758 could not be found. {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:00:08.346735 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-518f8fcf-93c9-4c2e-998e-dfd3be74851c tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] 10.222.0.18 "GET /compute/v2.1/servers/98f48cb1-54ed-4e82-8a25-fd004ddb5758" status: 404 len: 111 microversion: 2.1 time: 0.063987 Oct 22 21:00:08.347978 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1319/2486] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:00:08 2022] GET /compute/v2.1/servers/98f48cb1-54ed-4e82-8a25-fd004ddb5758 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 21:00:08.355720 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-a7bb90f9-ee95-4df9-a831-b3d84e55af1a tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:00:08.357008 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-a7bb90f9-ee95-4df9-a831-b3d84e55af1a tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] [instance: f38f14b2-b9d7-4bed-92ba-7b95ea4b2270] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:00:08.368239 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a7bb90f9-ee95-4df9-a831-b3d84e55af1a tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:08.369203 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a7bb90f9-ee95-4df9-a831-b3d84e55af1a tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:08.369875 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a7bb90f9-ee95-4df9-a831-b3d84e55af1a tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:08.370979 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a7bb90f9-ee95-4df9-a831-b3d84e55af1a tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:08.371644 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a7bb90f9-ee95-4df9-a831-b3d84e55af1a tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:08.372433 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a7bb90f9-ee95-4df9-a831-b3d84e55af1a tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:08.908915 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-a7bb90f9-ee95-4df9-a831-b3d84e55af1a tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211483c6acea4f76b6c0e4bfc818e7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd687d54e07d4ab4af00ad801ef4b58d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:00:08.922535 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-a7bb90f9-ee95-4df9-a831-b3d84e55af1a tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '211483c6acea4f76b6c0e4bfc818e7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd687d54e07d4ab4af00ad801ef4b58d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:00:08.942631 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-a7bb90f9-ee95-4df9-a831-b3d84e55af1a tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '211483c6acea4f76b6c0e4bfc818e7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd687d54e07d4ab4af00ad801ef4b58d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:00:08.943999 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-a7bb90f9-ee95-4df9-a831-b3d84e55af1a tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] 10.222.0.18 "GET /compute/v2.1/servers/f38f14b2-b9d7-4bed-92ba-7b95ea4b2270" status: 200 len: 1874 microversion: 2.42 time: 0.594716 Oct 22 21:00:08.965214 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1320/2487] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:00:08 2022] GET /compute/v2.1/servers/f38f14b2-b9d7-4bed-92ba-7b95ea4b2270 => generated 1874 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:00:08.983404 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-f4603f51-0634-442a-a8ee-459f50adb301 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-1523237011", "imageRef": "085e4478-6edc-4a69-8e08-f9831713eb65", "flavorRef": "452"}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:00:09.109554 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.network.neutron [None req-f4603f51-0634-442a-a8ee-459f50adb301 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] validate_networks() for None {{(pid=138745) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 21:00:09.137605 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.network.neutron [None req-ae8f3995-146f-4bf0-a5a0-66280982492c tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] [instance: ae58d60e-a113-4a38-94b5-b72a19c353e6] Building network info cache for instance {{(pid=138744) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 22 21:00:09.821632 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-f4603f51-0634-442a-a8ee-459f50adb301 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Flavor limits 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 21:00:09.822952 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-f4603f51-0634-442a-a8ee-459f50adb301 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Image limits 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 21:00:09.823910 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-f4603f51-0634-442a-a8ee-459f50adb301 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Flavor pref 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 21:00:09.824657 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-f4603f51-0634-442a-a8ee-459f50adb301 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Image pref 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 21:00:09.825316 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-f4603f51-0634-442a-a8ee-459f50adb301 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 21:00:09.845435 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f4603f51-0634-442a-a8ee-459f50adb301 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:09.852295 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f4603f51-0634-442a-a8ee-459f50adb301 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:09.852983 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f4603f51-0634-442a-a8ee-459f50adb301 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:09.856168 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f4603f51-0634-442a-a8ee-459f50adb301 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:09.858999 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f4603f51-0634-442a-a8ee-459f50adb301 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:09.859942 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f4603f51-0634-442a-a8ee-459f50adb301 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:09.905510 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-f4603f51-0634-442a-a8ee-459f50adb301 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Getting quotas for project b6e01f91c3a845bf8e67e3ad415d9c69. Resources: {'cores', 'instances', 'ram'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 21:00:09.917628 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-f4603f51-0634-442a-a8ee-459f50adb301 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Getting quotas for user 2b9bfe6f6d564d4c9fb1fea439476e03 and project b6e01f91c3a845bf8e67e3ad415d9c69. Resources: {'cores', 'instances', 'ram'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 21:00:09.948364 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-f4603f51-0634-442a-a8ee-459f50adb301 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Going to run 1 instances... {{(pid=138745) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 21:00:09.957425 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-f4603f51-0634-442a-a8ee-459f50adb301 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] [instance: ee6c092d-1150-415f-8a2e-58f4d3b5c238] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='085e4478-6edc-4a69-8e08-f9831713eb65',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138745) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 21:00:10.037276 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:00:10.073948 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-f4603f51-0634-442a-a8ee-459f50adb301 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.105015 Oct 22 21:00:10.082678 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1321/2488] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Oct 22 21:00:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 1117 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 21:00:10.089124 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-6c55278e-a3c1-4bf7-a71f-dd84547bde53 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1144368619"}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:00:10.095678 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-6c55278e-a3c1-4bf7-a71f-dd84547bde53 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] [instance: 7dde7a20-b949-4c72-ae19-83f2f0afd0d1] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:00:10.111989 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6c55278e-a3c1-4bf7-a71f-dd84547bde53 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:10.112592 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6c55278e-a3c1-4bf7-a71f-dd84547bde53 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:10.113153 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6c55278e-a3c1-4bf7-a71f-dd84547bde53 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:10.114755 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6c55278e-a3c1-4bf7-a71f-dd84547bde53 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:10.115217 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6c55278e-a3c1-4bf7-a71f-dd84547bde53 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:10.115677 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6c55278e-a3c1-4bf7-a71f-dd84547bde53 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:10.629233 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.network.security_group_api [None req-6c55278e-a3c1-4bf7-a71f-dd84547bde53 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Adding security group 27359005-91d1-4f2b-b9af-2f79910cd4a2 to port e4d75169-7798-4abd-957f-2abc3db1143a Oct 22 21:00:11.256779 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.network.neutron [None req-ae8f3995-146f-4bf0-a5a0-66280982492c tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] [instance: ae58d60e-a113-4a38-94b5-b72a19c353e6] Updating instance_info_cache with network_info: [{"id": "6bbd4b8b-948d-44a4-8b7f-6968bc1dc2cf", "address": "fa:16:3e:f2:b3:79", "network": {"id": "c5f0648c-b848-40c1-8a23-bd63535b04e6", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-150805152-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.2.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "2d79e903f8f24a348d5e771d434c70c3", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap6bbd4b8b-94", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=138744) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 22 21:00:11.276930 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ae8f3995-146f-4bf0-a5a0-66280982492c tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Releasing lock "refresh_cache-ae58d60e-a113-4a38-94b5-b72a19c353e6" {{(pid=138744) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 22 21:00:11.277864 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-ae8f3995-146f-4bf0-a5a0-66280982492c tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] 10.222.0.18 "POST /compute/v2.1/servers/ae58d60e-a113-4a38-94b5-b72a19c353e6/action" status: 202 len: 0 microversion: 2.1 time: 6.325382 Oct 22 21:00:11.278943 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1168/2489] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 21:00:04 2022] POST /compute/v2.1/servers/ae58d60e-a113-4a38-94b5-b72a19c353e6/action => generated 0 bytes in 6327 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 22 21:00:11.287970 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-83431efc-2a20-445b-b26b-f2313e40272c tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:00:11.311328 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-83431efc-2a20-445b-b26b-f2313e40272c tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] [instance: 40e6c6e3-3d47-4781-b8a8-aafd671d7287] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:00:11.331922 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-83431efc-2a20-445b-b26b-f2313e40272c tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:11.332949 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-83431efc-2a20-445b-b26b-f2313e40272c tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:11.334886 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-83431efc-2a20-445b-b26b-f2313e40272c tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:11.337507 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-83431efc-2a20-445b-b26b-f2313e40272c tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:11.341981 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-83431efc-2a20-445b-b26b-f2313e40272c tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:11.342882 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-83431efc-2a20-445b-b26b-f2313e40272c tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:11.415400 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-83431efc-2a20-445b-b26b-f2313e40272c tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] [instance: 40e6c6e3-3d47-4781-b8a8-aafd671d7287] Going to try to terminate instance {{(pid=138744) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 21:00:11.624254 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-83431efc-2a20-445b-b26b-f2313e40272c tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] 10.222.0.18 "DELETE /compute/v2.1/servers/40e6c6e3-3d47-4781-b8a8-aafd671d7287" status: 204 len: 0 microversion: 2.1 time: 0.337647 Oct 22 21:00:11.627320 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1169/2490] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 21:00:11 2022] DELETE /compute/v2.1/servers/40e6c6e3-3d47-4781-b8a8-aafd671d7287 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 21:00:11.655464 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-eff7cad6-5e6f-43db-9b17-c586fb8c1499 req-5968c875-33b6-45b3-903e-590cacfde947 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae58d60e-a113-4a38-94b5-b72a19c353e6", "tag": "6bbd4b8b-948d-44a4-8b7f-6968bc1dc2cf"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:00:11.695530 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-eff7cad6-5e6f-43db-9b17-c586fb8c1499 req-5968c875-33b6-45b3-903e-590cacfde947 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:11.696011 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-eff7cad6-5e6f-43db-9b17-c586fb8c1499 req-5968c875-33b6-45b3-903e-590cacfde947 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:11.697836 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-eff7cad6-5e6f-43db-9b17-c586fb8c1499 req-5968c875-33b6-45b3-903e-590cacfde947 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:11.718097 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-eff7cad6-5e6f-43db-9b17-c586fb8c1499 req-5968c875-33b6-45b3-903e-590cacfde947 service nova] Creating event network-changed:6bbd4b8b-948d-44a4-8b7f-6968bc1dc2cf for instance ae58d60e-a113-4a38-94b5-b72a19c353e6 on nch2-master-1 Oct 22 21:00:11.724514 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-eff7cad6-5e6f-43db-9b17-c586fb8c1499 req-5968c875-33b6-45b3-903e-590cacfde947 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095303 Oct 22 21:00:11.726220 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1170/2491] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:00:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:00:11.734347 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-23649165-c5b5-4d72-9a77-16914c94430e tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:00:11.737295 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-23649165-c5b5-4d72-9a77-16914c94430e tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] [instance: f38f14b2-b9d7-4bed-92ba-7b95ea4b2270] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:00:11.766180 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-23649165-c5b5-4d72-9a77-16914c94430e tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:11.766685 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-23649165-c5b5-4d72-9a77-16914c94430e tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:11.767292 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-23649165-c5b5-4d72-9a77-16914c94430e tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:11.781201 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-23649165-c5b5-4d72-9a77-16914c94430e tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:11.781701 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-23649165-c5b5-4d72-9a77-16914c94430e tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:11.782368 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-23649165-c5b5-4d72-9a77-16914c94430e tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:11.930339 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-6c55278e-a3c1-4bf7-a71f-dd84547bde53 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] 10.222.0.18 "POST /compute/v2.1/servers/7dde7a20-b949-4c72-ae19-83f2f0afd0d1/action" status: 202 len: 0 microversion: 2.1 time: 1.846065 Oct 22 21:00:11.932114 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1322/2492] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 21:00:10 2022] POST /compute/v2.1/servers/7dde7a20-b949-4c72-ae19-83f2f0afd0d1/action => generated 0 bytes in 1849 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 21:00:11.939240 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-829539ca-f445-4f48-801b-630e37f42036 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:00:11.941288 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-829539ca-f445-4f48-801b-630e37f42036 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] [instance: ee6c092d-1150-415f-8a2e-58f4d3b5c238] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:00:11.968137 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-829539ca-f445-4f48-801b-630e37f42036 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:11.975544 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-829539ca-f445-4f48-801b-630e37f42036 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:11.976713 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-829539ca-f445-4f48-801b-630e37f42036 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:11.979315 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-829539ca-f445-4f48-801b-630e37f42036 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:11.980082 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-829539ca-f445-4f48-801b-630e37f42036 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:11.980753 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-829539ca-f445-4f48-801b-630e37f42036 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:12.219652 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-829539ca-f445-4f48-801b-630e37f42036 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b9bfe6f6d564d4c9fb1fea439476e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6e01f91c3a845bf8e67e3ad415d9c69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:00:12.240036 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-829539ca-f445-4f48-801b-630e37f42036 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] 10.222.0.18 "GET /compute/v2.1/servers/ee6c092d-1150-415f-8a2e-58f4d3b5c238" status: 200 len: 1278 microversion: 2.1 time: 0.306017 Oct 22 21:00:12.240938 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1323/2493] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:00:11 2022] GET /compute/v2.1/servers/ee6c092d-1150-415f-8a2e-58f4d3b5c238 => generated 1278 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:00:12.248164 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-b527440e-d3b0-4308-b47b-d1e01340ed30 tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.35.2.78"}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:00:13.030726 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-23649165-c5b5-4d72-9a77-16914c94430e tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211483c6acea4f76b6c0e4bfc818e7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd687d54e07d4ab4af00ad801ef4b58d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:00:13.052652 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-23649165-c5b5-4d72-9a77-16914c94430e tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '211483c6acea4f76b6c0e4bfc818e7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd687d54e07d4ab4af00ad801ef4b58d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:00:13.054557 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-23649165-c5b5-4d72-9a77-16914c94430e tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '211483c6acea4f76b6c0e4bfc818e7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd687d54e07d4ab4af00ad801ef4b58d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:00:13.057483 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-23649165-c5b5-4d72-9a77-16914c94430e tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] 10.222.0.18 "GET /compute/v2.1/servers/f38f14b2-b9d7-4bed-92ba-7b95ea4b2270" status: 200 len: 1874 microversion: 2.42 time: 1.328811 Oct 22 21:00:13.058297 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1171/2494] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:00:11 2022] GET /compute/v2.1/servers/f38f14b2-b9d7-4bed-92ba-7b95ea4b2270 => generated 1874 bytes in 1331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:00:13.075493 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-b527440e-d3b0-4308-b47b-d1e01340ed30 tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] [instance: ae58d60e-a113-4a38-94b5-b72a19c353e6] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:00:13.094531 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-246b7217-3539-418b-bb8c-aa192b6721ad tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:00:13.095375 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-246b7217-3539-418b-bb8c-aa192b6721ad tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] [instance: 40e6c6e3-3d47-4781-b8a8-aafd671d7287] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:00:13.096948 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b527440e-d3b0-4308-b47b-d1e01340ed30 tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:13.102990 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-246b7217-3539-418b-bb8c-aa192b6721ad tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:13.104457 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-246b7217-3539-418b-bb8c-aa192b6721ad tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:13.105288 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-246b7217-3539-418b-bb8c-aa192b6721ad tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:13.106493 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-246b7217-3539-418b-bb8c-aa192b6721ad tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:13.106765 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b527440e-d3b0-4308-b47b-d1e01340ed30 tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:13.108185 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b527440e-d3b0-4308-b47b-d1e01340ed30 tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:13.108314 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-246b7217-3539-418b-bb8c-aa192b6721ad tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:13.108754 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-246b7217-3539-418b-bb8c-aa192b6721ad tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:13.111841 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b527440e-d3b0-4308-b47b-d1e01340ed30 tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:13.112646 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b527440e-d3b0-4308-b47b-d1e01340ed30 tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:13.113336 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b527440e-d3b0-4308-b47b-d1e01340ed30 tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:14.207440 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-246b7217-3539-418b-bb8c-aa192b6721ad tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d3d7458af447bdb3f03e83a2d8559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49238b8686d24ae698679e4a1957735d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:00:14.227230 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-246b7217-3539-418b-bb8c-aa192b6721ad tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] 10.222.0.18 "GET /compute/v2.1/servers/40e6c6e3-3d47-4781-b8a8-aafd671d7287" status: 200 len: 1469 microversion: 2.1 time: 1.146200 Oct 22 21:00:14.229357 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1172/2495] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:00:13 2022] GET /compute/v2.1/servers/40e6c6e3-3d47-4781-b8a8-aafd671d7287 => generated 1469 bytes in 1153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:00:14.238419 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-c5c99583-34da-49ea-88a1-696cfd8f5992 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Calling method '.version_select at 0x7fd39f1ea8b0>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:00:14.672225 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b527440e-d3b0-4308-b47b-d1e01340ed30 tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Acquiring lock "refresh_cache-ae58d60e-a113-4a38-94b5-b72a19c353e6" {{(pid=138745) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 22 21:00:14.672780 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b527440e-d3b0-4308-b47b-d1e01340ed30 tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Acquired lock "refresh_cache-ae58d60e-a113-4a38-94b5-b72a19c353e6" {{(pid=138745) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 22 21:00:15.177257 ncdv-master-1 devstack@n-api.service[138744]: DEBUG neutronclient.v2_0.client [None req-c5c99583-34da-49ea-88a1-696cfd8f5992 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 27359005-91d1-4f2b-b9af-2f79910cd4a2 in use.", "detail": ""}} {{(pid=138744) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 22 21:00:15.177959 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-c5c99583-34da-49ea-88a1-696cfd8f5992 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] HTTP exception thrown: Security Group 27359005-91d1-4f2b-b9af-2f79910cd4a2 in use. Oct 22 21:00:15.177959 ncdv-master-1 devstack@n-api.service[138744]: Neutron server returns request_ids: ['req-fab41f08-98af-499d-bd39-2549a7db9aaa'] Oct 22 21:00:15.179942 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-c5c99583-34da-49ea-88a1-696cfd8f5992 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Request method failure captured: Oct 22 21:00:15.179942 ncdv-master-1 devstack@n-api.service[138744]: request: DELETE /compute/v2.1/os-security-groups/27359005-91d1-4f2b-b9af-2f79910cd4a2 HTTP/1.1 Oct 22 21:00:15.179942 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 21:00:15.179942 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 21:00:15.179942 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 21:00:15.179942 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 0 Oct 22 21:00:15.179942 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 21:00:15.179942 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 21:00:15.179942 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 21:00:15.179942 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 21:00:15.179942 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVFmMTFo8tMXHI466ygTiy0jTs5kz8YO2nFuimSyZRJI5bXNUfHpPLWjQrXyJ7I9Xfc54HQRfYflULj68lfwBk5jrnjY79oZ1kbdK55vumR_IVvMJmaykrPjWliG3H4xf-SZHnU3invPEATeZO7VP5aTca0hd9BauSvYCW1UPdVAZZ70 Oct 22 21:00:15.179942 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 21:00:15.179942 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 21:00:15.179942 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 21:00:15.179942 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 21:00:15.179942 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 21:00:15.179942 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 21:00:15.179942 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: ed31e93b0e8a43f28e497f94318815ce Oct 22 21:00:15.179942 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-SecurityGroupsTestJSON-1604956559 Oct 22 21:00:15.179942 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 21:00:15.179942 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 21:00:15.179942 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ed31e93b0e8a43f28e497f94318815ce"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ed31e93b0e8a43f28e497f94318815ce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ed31e93b0e8a43f28e497f94318815ce"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ed31e93b0e8a43f28e497f94318815ce"}]}] Oct 22 21:00:15.179942 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-SecurityGroupsTestJSON-1604956559 Oct 22 21:00:15.179942 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: ed31e93b0e8a43f28e497f94318815ce Oct 22 21:00:15.179942 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1604956559 Oct 22 21:00:15.179942 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-SecurityGroupsTestJSON-1604956559-project Oct 22 21:00:15.179942 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 21:00:15.179942 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 21:00:15.179942 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: 46d49952dbca4d95a25411b65d56552b Oct 22 21:00:15.179942 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-SecurityGroupsTestJSON-1604956559-project Oct 22 21:00:15.179942 ncdv-master-1 devstack@n-api.service[138744]: method: Oct 22 21:00:15.179942 ncdv-master-1 devstack@n-api.service[138744]: exception: Security Group 27359005-91d1-4f2b-b9af-2f79910cd4a2 in use. Oct 22 21:00:15.179942 ncdv-master-1 devstack@n-api.service[138744]: Neutron server returns request_ids: ['req-fab41f08-98af-499d-bd39-2549a7db9aaa'] Oct 22 21:00:15.179942 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': '27359005-91d1-4f2b-b9af-2f79910cd4a2'} Oct 22 21:00:15.179942 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:00:15.179942 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:00:15.179942 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Oct 22 21:00:15.179942 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Oct 22 21:00:15.179942 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 21:00:15.179942 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 21:00:15.179942 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Oct 22 21:00:15.179942 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Oct 22 21:00:15.179942 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 21:00:15.179942 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 21:00:15.179942 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Oct 22 21:00:15.179942 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Oct 22 21:00:15.179942 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 21:00:15.179942 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 21:00:15.179942 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 22 21:00:15.179942 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 22 21:00:15.179942 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 21:00:15.179942 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 21:00:15.179942 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 22 21:00:15.179942 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 22 21:00:15.179942 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 21:00:15.179942 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 21:00:15.179942 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 22 21:00:15.179942 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 22 21:00:15.179942 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 22 21:00:15.179942 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 22 21:00:15.179942 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 27359005-91d1-4f2b-b9af-2f79910cd4a2 in use. Oct 22 21:00:15.185566 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fab41f08-98af-499d-bd39-2549a7db9aaa'] Oct 22 21:00:15.185566 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:00:15.185566 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:00:15.185566 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:00:15.185566 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:00:15.185566 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Oct 22 21:00:15.185566 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Oct 22 21:00:15.185566 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Oct 22 21:00:15.185566 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Oct 22 21:00:15.185566 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 27359005-91d1-4f2b-b9af-2f79910cd4a2 in use. Oct 22 21:00:15.185566 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fab41f08-98af-499d-bd39-2549a7db9aaa'] Oct 22 21:00:15.185566 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:00:15.185566 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:00:15.185566 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:00:15.185566 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:00:15.185566 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:00:15.185566 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:00:15.185566 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:00:15.185566 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:00:15.185566 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 22 21:00:15.185566 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 22 21:00:15.185566 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:00:15.185566 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:00:15.185566 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Oct 22 21:00:15.185566 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 22 21:00:15.185566 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 27359005-91d1-4f2b-b9af-2f79910cd4a2 in use. Oct 22 21:00:15.185566 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fab41f08-98af-499d-bd39-2549a7db9aaa'] Oct 22 21:00:15.185566 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:00:15.185566 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:00:15.185566 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:00:15.185566 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:00:15.185566 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:00:15.185566 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:00:15.185566 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:00:15.185566 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:00:15.185566 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 27359005-91d1-4f2b-b9af-2f79910cd4a2 in use. Oct 22 21:00:15.185566 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fab41f08-98af-499d-bd39-2549a7db9aaa'] Oct 22 21:00:15.185566 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:00:15.190755 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-c5c99583-34da-49ea-88a1-696cfd8f5992 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Returning 400 to user: Security Group 27359005-91d1-4f2b-b9af-2f79910cd4a2 in use. Oct 22 21:00:15.190755 ncdv-master-1 devstack@n-api.service[138744]: Neutron server returns request_ids: ['req-fab41f08-98af-499d-bd39-2549a7db9aaa'] {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:00:15.192031 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-c5c99583-34da-49ea-88a1-696cfd8f5992 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/27359005-91d1-4f2b-b9af-2f79910cd4a2" status: 400 len: 185 microversion: 2.1 time: 0.961110 Oct 22 21:00:15.193350 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1173/2496] 10.222.0.18 () {58 vars in 1272 bytes} [Sat Oct 22 21:00:14 2022] DELETE /compute/v2.1/os-security-groups/27359005-91d1-4f2b-b9af-2f79910cd4a2 => generated 185 bytes in 963 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 22 21:00:15.207178 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-9659f7f9-d1ec-4a19-8699-8885837fac80 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:00:15.207883 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-9659f7f9-d1ec-4a19-8699-8885837fac80 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] [instance: ee6c092d-1150-415f-8a2e-58f4d3b5c238] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:00:15.225504 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9659f7f9-d1ec-4a19-8699-8885837fac80 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:15.226651 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9659f7f9-d1ec-4a19-8699-8885837fac80 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:15.227426 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9659f7f9-d1ec-4a19-8699-8885837fac80 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:15.230222 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9659f7f9-d1ec-4a19-8699-8885837fac80 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:15.234102 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9659f7f9-d1ec-4a19-8699-8885837fac80 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:15.236141 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9659f7f9-d1ec-4a19-8699-8885837fac80 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:15.507111 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-9659f7f9-d1ec-4a19-8699-8885837fac80 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b9bfe6f6d564d4c9fb1fea439476e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6e01f91c3a845bf8e67e3ad415d9c69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:00:15.539298 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-9659f7f9-d1ec-4a19-8699-8885837fac80 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] 10.222.0.18 "GET /compute/v2.1/servers/ee6c092d-1150-415f-8a2e-58f4d3b5c238" status: 200 len: 1276 microversion: 2.1 time: 0.341670 Oct 22 21:00:15.540792 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1174/2497] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:00:15 2022] GET /compute/v2.1/servers/ee6c092d-1150-415f-8a2e-58f4d3b5c238 => generated 1276 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:00:15.558208 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-a0a7f62c-32cb-4021-8364-eb166aa6ed63 req-be57c164-d25b-48a1-a55a-c0f7befd0289 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7dde7a20-b949-4c72-ae19-83f2f0afd0d1", "tag": "e4d75169-7798-4abd-957f-2abc3db1143a"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:00:15.587887 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-a0a7f62c-32cb-4021-8364-eb166aa6ed63 req-be57c164-d25b-48a1-a55a-c0f7befd0289 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:15.590014 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-a0a7f62c-32cb-4021-8364-eb166aa6ed63 req-be57c164-d25b-48a1-a55a-c0f7befd0289 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:15.591009 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-a0a7f62c-32cb-4021-8364-eb166aa6ed63 req-be57c164-d25b-48a1-a55a-c0f7befd0289 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:15.634842 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-a0a7f62c-32cb-4021-8364-eb166aa6ed63 req-be57c164-d25b-48a1-a55a-c0f7befd0289 service nova] Creating event network-changed:e4d75169-7798-4abd-957f-2abc3db1143a for instance 7dde7a20-b949-4c72-ae19-83f2f0afd0d1 on nch1-master-1 Oct 22 21:00:15.657312 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-a0a7f62c-32cb-4021-8364-eb166aa6ed63 req-be57c164-d25b-48a1-a55a-c0f7befd0289 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113117 Oct 22 21:00:15.658203 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1175/2498] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:00:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:00:15.676203 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-cc0fc220-9f91-451f-9d81-d5ca1c7d161d tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:00:15.677682 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-cc0fc220-9f91-451f-9d81-d5ca1c7d161d tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] [instance: f38f14b2-b9d7-4bed-92ba-7b95ea4b2270] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:00:15.693257 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cc0fc220-9f91-451f-9d81-d5ca1c7d161d tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:15.696964 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cc0fc220-9f91-451f-9d81-d5ca1c7d161d tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:15.697679 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cc0fc220-9f91-451f-9d81-d5ca1c7d161d tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:15.698703 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cc0fc220-9f91-451f-9d81-d5ca1c7d161d tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:15.700451 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cc0fc220-9f91-451f-9d81-d5ca1c7d161d tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:15.701305 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cc0fc220-9f91-451f-9d81-d5ca1c7d161d tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:16.310238 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-cc0fc220-9f91-451f-9d81-d5ca1c7d161d tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211483c6acea4f76b6c0e4bfc818e7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd687d54e07d4ab4af00ad801ef4b58d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:00:16.312953 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=3,nova_cell1:INSERT=2,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:00:16.330454 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-cc0fc220-9f91-451f-9d81-d5ca1c7d161d tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '211483c6acea4f76b6c0e4bfc818e7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd687d54e07d4ab4af00ad801ef4b58d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:00:16.340703 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-cc0fc220-9f91-451f-9d81-d5ca1c7d161d tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '211483c6acea4f76b6c0e4bfc818e7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd687d54e07d4ab4af00ad801ef4b58d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:00:16.342027 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-cc0fc220-9f91-451f-9d81-d5ca1c7d161d tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] 10.222.0.18 "GET /compute/v2.1/servers/f38f14b2-b9d7-4bed-92ba-7b95ea4b2270" status: 200 len: 1874 microversion: 2.42 time: 0.679671 Oct 22 21:00:16.353507 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1176/2499] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:00:15 2022] GET /compute/v2.1/servers/f38f14b2-b9d7-4bed-92ba-7b95ea4b2270 => generated 1874 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:00:16.367012 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-440ba84a-0c10-4884-93dd-b1ca9fb961c7 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:00:16.371358 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-440ba84a-0c10-4884-93dd-b1ca9fb961c7 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] [instance: 7dde7a20-b949-4c72-ae19-83f2f0afd0d1] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:00:16.383127 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-440ba84a-0c10-4884-93dd-b1ca9fb961c7 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:16.383969 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-440ba84a-0c10-4884-93dd-b1ca9fb961c7 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:16.384614 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-440ba84a-0c10-4884-93dd-b1ca9fb961c7 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:16.385589 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-440ba84a-0c10-4884-93dd-b1ca9fb961c7 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:16.386507 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-440ba84a-0c10-4884-93dd-b1ca9fb961c7 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:16.387132 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-440ba84a-0c10-4884-93dd-b1ca9fb961c7 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:16.543156 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-440ba84a-0c10-4884-93dd-b1ca9fb961c7 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] 10.222.0.18 "POST /compute/v2.1/servers/7dde7a20-b949-4c72-ae19-83f2f0afd0d1/action" status: 202 len: 0 microversion: 2.1 time: 0.181523 Oct 22 21:00:16.546191 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1177/2500] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 21:00:16 2022] POST /compute/v2.1/servers/7dde7a20-b949-4c72-ae19-83f2f0afd0d1/action => generated 0 bytes in 192 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 21:00:16.593436 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-df5374fd-588a-4cf5-bb60-38143b67156a tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:00:16.596465 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-df5374fd-588a-4cf5-bb60-38143b67156a tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] [instance: 40e6c6e3-3d47-4781-b8a8-aafd671d7287] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:00:16.631570 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-df5374fd-588a-4cf5-bb60-38143b67156a tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:16.632625 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-df5374fd-588a-4cf5-bb60-38143b67156a tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:16.633880 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-df5374fd-588a-4cf5-bb60-38143b67156a tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:16.635019 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-df5374fd-588a-4cf5-bb60-38143b67156a tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:16.654743 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-df5374fd-588a-4cf5-bb60-38143b67156a tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:16.656561 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-df5374fd-588a-4cf5-bb60-38143b67156a tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:16.717549 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-df5374fd-588a-4cf5-bb60-38143b67156a tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:16.718378 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-df5374fd-588a-4cf5-bb60-38143b67156a tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:16.719542 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-df5374fd-588a-4cf5-bb60-38143b67156a tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:16.720327 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.objects.instance [None req-df5374fd-588a-4cf5-bb60-38143b67156a tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lazy-loading 'fault' on Instance uuid 40e6c6e3-3d47-4781-b8a8-aafd671d7287 {{(pid=138744) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 21:00:16.870033 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-df5374fd-588a-4cf5-bb60-38143b67156a tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d3d7458af447bdb3f03e83a2d8559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49238b8686d24ae698679e4a1957735d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:00:16.889230 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-df5374fd-588a-4cf5-bb60-38143b67156a tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] 10.222.0.18 "GET /compute/v2.1/servers/40e6c6e3-3d47-4781-b8a8-aafd671d7287" status: 200 len: 1303 microversion: 2.1 time: 0.329718 Oct 22 21:00:16.909077 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1178/2501] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:00:16 2022] GET /compute/v2.1/servers/40e6c6e3-3d47-4781-b8a8-aafd671d7287 => generated 1303 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:00:17.089886 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-3c23a614-b534-4dca-ae49-ab6f1c0a563c tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-330911280", "imageRef": "085e4478-6edc-4a69-8e08-f9831713eb65", "flavorRef": "452", "networks": [{"uuid": "4ddebde3-67b6-4360-8934-2682d629ac63"}]}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:00:17.215066 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.network.neutron [None req-3c23a614-b534-4dca-ae49-ab6f1c0a563c tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] validate_networks() for [('4ddebde3-67b6-4360-8934-2682d629ac63', None, None, None, None, None)] {{(pid=138744) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 21:00:18.303746 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.network.neutron [None req-b527440e-d3b0-4308-b47b-d1e01340ed30 tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] [instance: ae58d60e-a113-4a38-94b5-b72a19c353e6] Building network info cache for instance {{(pid=138745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 22 21:00:19.884690 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell0:SELECT=4 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:00:19.945209 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell0:SELECT=12 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:00:19.959529 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-3c23a614-b534-4dca-ae49-ab6f1c0a563c tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Flavor limits 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 21:00:19.960278 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-3c23a614-b534-4dca-ae49-ab6f1c0a563c tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Image limits 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 21:00:19.960620 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-3c23a614-b534-4dca-ae49-ab6f1c0a563c tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Flavor pref 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 21:00:19.961211 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-3c23a614-b534-4dca-ae49-ab6f1c0a563c tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Image pref 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 21:00:19.961785 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-3c23a614-b534-4dca-ae49-ab6f1c0a563c tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 21:00:19.994873 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3c23a614-b534-4dca-ae49-ab6f1c0a563c tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:19.998301 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3c23a614-b534-4dca-ae49-ab6f1c0a563c tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:20.002118 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3c23a614-b534-4dca-ae49-ab6f1c0a563c tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:20.003991 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3c23a614-b534-4dca-ae49-ab6f1c0a563c tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:20.005626 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3c23a614-b534-4dca-ae49-ab6f1c0a563c tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:20.007533 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3c23a614-b534-4dca-ae49-ab6f1c0a563c tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:20.029307 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-3c23a614-b534-4dca-ae49-ab6f1c0a563c tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Getting quotas for project b4cd7873d6db4e09bc9ab9a048a6b1ef. Resources: {'cores', 'instances', 'ram'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 21:00:20.037996 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-3c23a614-b534-4dca-ae49-ab6f1c0a563c tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Getting quotas for user be1b410a64e0415a96d30f5040361137 and project b4cd7873d6db4e09bc9ab9a048a6b1ef. Resources: {'cores', 'instances', 'ram'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 21:00:20.054380 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-3c23a614-b534-4dca-ae49-ab6f1c0a563c tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Going to run 1 instances... {{(pid=138744) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 21:00:20.058245 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-3c23a614-b534-4dca-ae49-ab6f1c0a563c tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] [instance: eb38dcff-5703-4735-bf8e-6a40d51d8567] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='085e4478-6edc-4a69-8e08-f9831713eb65',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138744) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 21:00:20.155729 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-3c23a614-b534-4dca-ae49-ab6f1c0a563c tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.245222 Oct 22 21:00:20.157124 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1179/2502] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Oct 22 21:00:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 3247 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 21:00:20.163142 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-c9fc4a9e-48a3-42b4-8303-352d73a4afc0 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:00:20.164152 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-c9fc4a9e-48a3-42b4-8303-352d73a4afc0 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] [instance: 7dde7a20-b949-4c72-ae19-83f2f0afd0d1] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:00:20.171731 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c9fc4a9e-48a3-42b4-8303-352d73a4afc0 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:20.172592 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c9fc4a9e-48a3-42b4-8303-352d73a4afc0 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:20.173260 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c9fc4a9e-48a3-42b4-8303-352d73a4afc0 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:20.175428 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c9fc4a9e-48a3-42b4-8303-352d73a4afc0 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:20.178525 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c9fc4a9e-48a3-42b4-8303-352d73a4afc0 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:20.179800 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c9fc4a9e-48a3-42b4-8303-352d73a4afc0 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:21.011628 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-c9fc4a9e-48a3-42b4-8303-352d73a4afc0 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d49952dbca4d95a25411b65d56552b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed31e93b0e8a43f28e497f94318815ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:00:21.026314 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-c9fc4a9e-48a3-42b4-8303-352d73a4afc0 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] 10.222.0.18 "GET /compute/v2.1/servers/7dde7a20-b949-4c72-ae19-83f2f0afd0d1" status: 200 len: 1580 microversion: 2.1 time: 0.867848 Oct 22 21:00:21.028578 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1180/2503] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:00:20 2022] GET /compute/v2.1/servers/7dde7a20-b949-4c72-ae19-83f2f0afd0d1 => generated 1580 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:00:21.038591 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-3664ff10-9d7b-4194-b947-3ea3dfc103e5 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:00:21.039217 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-3664ff10-9d7b-4194-b947-3ea3dfc103e5 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] [instance: ee6c092d-1150-415f-8a2e-58f4d3b5c238] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:00:21.058310 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3664ff10-9d7b-4194-b947-3ea3dfc103e5 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:21.058694 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3664ff10-9d7b-4194-b947-3ea3dfc103e5 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:21.059586 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3664ff10-9d7b-4194-b947-3ea3dfc103e5 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:21.065718 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3664ff10-9d7b-4194-b947-3ea3dfc103e5 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:21.066012 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3664ff10-9d7b-4194-b947-3ea3dfc103e5 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:21.066631 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3664ff10-9d7b-4194-b947-3ea3dfc103e5 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:21.455952 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.network.neutron [None req-b527440e-d3b0-4308-b47b-d1e01340ed30 tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] [instance: ae58d60e-a113-4a38-94b5-b72a19c353e6] Updating instance_info_cache with network_info: [{"id": "6bbd4b8b-948d-44a4-8b7f-6968bc1dc2cf", "address": "fa:16:3e:f2:b3:79", "network": {"id": "c5f0648c-b848-40c1-8a23-bd63535b04e6", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-150805152-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "2d79e903f8f24a348d5e771d434c70c3", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap6bbd4b8b-94", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=138745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 22 21:00:21.476100 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b527440e-d3b0-4308-b47b-d1e01340ed30 tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Releasing lock "refresh_cache-ae58d60e-a113-4a38-94b5-b72a19c353e6" {{(pid=138745) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 22 21:00:21.477481 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-b527440e-d3b0-4308-b47b-d1e01340ed30 tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] 10.222.0.18 "POST /compute/v2.1/servers/ae58d60e-a113-4a38-94b5-b72a19c353e6/action" status: 202 len: 0 microversion: 2.1 time: 9.234991 Oct 22 21:00:21.478622 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1324/2504] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 21:00:12 2022] POST /compute/v2.1/servers/ae58d60e-a113-4a38-94b5-b72a19c353e6/action => generated 0 bytes in 9237 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 22 21:00:21.563054 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-3664ff10-9d7b-4194-b947-3ea3dfc103e5 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b9bfe6f6d564d4c9fb1fea439476e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6e01f91c3a845bf8e67e3ad415d9c69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:00:21.571363 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-3664ff10-9d7b-4194-b947-3ea3dfc103e5 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] 10.222.0.18 "GET /compute/v2.1/servers/ee6c092d-1150-415f-8a2e-58f4d3b5c238" status: 200 len: 1318 microversion: 2.1 time: 0.541482 Oct 22 21:00:21.589105 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1181/2505] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:00:21 2022] GET /compute/v2.1/servers/ee6c092d-1150-415f-8a2e-58f4d3b5c238 => generated 1318 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:00:21.594863 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-d6239df9-fe2d-4a46-9413-c6a84070254a tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-565521071", "imageRef": "085e4478-6edc-4a69-8e08-f9831713eb65", "flavorRef": "452", "networks": [{"uuid": "f1ad1f3f-09bf-4698-9fe5-20142c78993a"}]}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:00:21.597378 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-a6f2c193-a270-442d-9f34-9a094464beac tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:00:21.598182 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-a6f2c193-a270-442d-9f34-9a094464beac tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] [instance: f38f14b2-b9d7-4bed-92ba-7b95ea4b2270] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:00:21.606239 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a6f2c193-a270-442d-9f34-9a094464beac tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:21.607411 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a6f2c193-a270-442d-9f34-9a094464beac tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:21.608438 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a6f2c193-a270-442d-9f34-9a094464beac tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:21.609846 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a6f2c193-a270-442d-9f34-9a094464beac tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:21.610552 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a6f2c193-a270-442d-9f34-9a094464beac tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:21.611194 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a6f2c193-a270-442d-9f34-9a094464beac tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:21.691751 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.network.neutron [None req-d6239df9-fe2d-4a46-9413-c6a84070254a tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] validate_networks() for [('f1ad1f3f-09bf-4698-9fe5-20142c78993a', None, None, None, None, None)] {{(pid=138745) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 21:00:22.279488 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-a6f2c193-a270-442d-9f34-9a094464beac tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211483c6acea4f76b6c0e4bfc818e7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd687d54e07d4ab4af00ad801ef4b58d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:00:22.301322 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-a6f2c193-a270-442d-9f34-9a094464beac tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '211483c6acea4f76b6c0e4bfc818e7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd687d54e07d4ab4af00ad801ef4b58d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:00:22.306442 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-a6f2c193-a270-442d-9f34-9a094464beac tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '211483c6acea4f76b6c0e4bfc818e7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd687d54e07d4ab4af00ad801ef4b58d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:00:22.309866 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-a6f2c193-a270-442d-9f34-9a094464beac tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] 10.222.0.18 "GET /compute/v2.1/servers/f38f14b2-b9d7-4bed-92ba-7b95ea4b2270" status: 200 len: 1874 microversion: 2.42 time: 0.715330 Oct 22 21:00:22.329879 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1182/2506] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:00:21 2022] GET /compute/v2.1/servers/f38f14b2-b9d7-4bed-92ba-7b95ea4b2270 => generated 1874 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:00:22.350199 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-e5ecbc8f-cec6-45eb-893b-5ba29428b421 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:00:22.351235 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-e5ecbc8f-cec6-45eb-893b-5ba29428b421 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] [instance: 40e6c6e3-3d47-4781-b8a8-aafd671d7287] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:00:22.364943 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e5ecbc8f-cec6-45eb-893b-5ba29428b421 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:22.365439 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e5ecbc8f-cec6-45eb-893b-5ba29428b421 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:22.372267 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e5ecbc8f-cec6-45eb-893b-5ba29428b421 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:22.373451 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e5ecbc8f-cec6-45eb-893b-5ba29428b421 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:22.380273 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e5ecbc8f-cec6-45eb-893b-5ba29428b421 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:22.380989 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e5ecbc8f-cec6-45eb-893b-5ba29428b421 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:22.424420 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-e5ecbc8f-cec6-45eb-893b-5ba29428b421 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] HTTP exception thrown: Instance 40e6c6e3-3d47-4781-b8a8-aafd671d7287 could not be found. Oct 22 21:00:22.431512 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-e5ecbc8f-cec6-45eb-893b-5ba29428b421 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Request method failure captured: Oct 22 21:00:22.431512 ncdv-master-1 devstack@n-api.service[138744]: request: GET /compute/v2.1/servers/40e6c6e3-3d47-4781-b8a8-aafd671d7287 HTTP/1.1 Oct 22 21:00:22.431512 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 21:00:22.431512 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 21:00:22.431512 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 21:00:22.431512 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 0 Oct 22 21:00:22.431512 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 21:00:22.431512 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 21:00:22.431512 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 21:00:22.431512 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 21:00:22.431512 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVFhmBIyEFZ5UaXjuS-XjHeNq2NZJ6-PZgGZeaIaSAZodIQmPMubSjCIS9wmprAg5WbUhxuYoYXOd3qlNfUL_HEhVyaVH9bKA87Iahwjb-u8_gTW16ah_HU_-UGEZkL42b1zllNGPhcx4qIPpE4vl5evkvpnkDsCfCEWPisgVtTaLG3k Oct 22 21:00:22.431512 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 21:00:22.431512 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 21:00:22.431512 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 21:00:22.431512 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 21:00:22.431512 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 21:00:22.431512 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 21:00:22.431512 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: 49238b8686d24ae698679e4a1957735d Oct 22 21:00:22.431512 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-MigrationsAdminTest-1624122076 Oct 22 21:00:22.431512 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 21:00:22.431512 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 21:00:22.431512 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_49238b8686d24ae698679e4a1957735d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/49238b8686d24ae698679e4a1957735d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/49238b8686d24ae698679e4a1957735d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/49238b8686d24ae698679e4a1957735d"}]}] Oct 22 21:00:22.431512 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-MigrationsAdminTest-1624122076 Oct 22 21:00:22.431512 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: 49238b8686d24ae698679e4a1957735d Oct 22 21:00:22.431512 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-MigrationsAdminTest-1624122076 Oct 22 21:00:22.431512 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-MigrationsAdminTest-1624122076-project Oct 22 21:00:22.431512 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 21:00:22.431512 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 21:00:22.431512 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: e0d3d7458af447bdb3f03e83a2d8559f Oct 22 21:00:22.431512 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-MigrationsAdminTest-1624122076-project Oct 22 21:00:22.431512 ncdv-master-1 devstack@n-api.service[138744]: method: > Oct 22 21:00:22.431512 ncdv-master-1 devstack@n-api.service[138744]: exception: Instance 40e6c6e3-3d47-4781-b8a8-aafd671d7287 could not be found. Oct 22 21:00:22.431512 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': '40e6c6e3-3d47-4781-b8a8-aafd671d7287'} Oct 22 21:00:22.431512 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:00:22.431512 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:00:22.431512 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 21:00:22.431512 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 21:00:22.431512 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 21:00:22.431512 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 21:00:22.431512 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 21:00:22.431512 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 21:00:22.431512 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 21:00:22.431512 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 21:00:22.431512 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 40e6c6e3-3d47-4781-b8a8-aafd671d7287 could not be found. Oct 22 21:00:22.431512 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:00:22.431512 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:00:22.431512 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:00:22.431512 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:00:22.431512 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:00:22.431512 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:00:22.431512 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:00:22.431512 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:00:22.431512 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:00:22.431512 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:00:22.431512 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 21:00:22.431512 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 21:00:22.431512 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 21:00:22.431512 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 21:00:22.431512 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 21:00:22.431512 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:00:22.431512 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 40e6c6e3-3d47-4781-b8a8-aafd671d7287 could not be found. Oct 22 21:00:22.431512 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:00:22.431512 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:00:22.431512 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:00:22.435518 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:00:22.435518 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:00:22.435518 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:00:22.435518 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:00:22.435518 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:00:22.435518 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 40e6c6e3-3d47-4781-b8a8-aafd671d7287 could not be found. Oct 22 21:00:22.435518 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:00:22.437738 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-e5ecbc8f-cec6-45eb-893b-5ba29428b421 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] Returning 404 to user: Instance 40e6c6e3-3d47-4781-b8a8-aafd671d7287 could not be found. {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:00:22.438844 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-e5ecbc8f-cec6-45eb-893b-5ba29428b421 tempest-MigrationsAdminTest-1624122076 tempest-MigrationsAdminTest-1624122076-project] 10.222.0.18 "GET /compute/v2.1/servers/40e6c6e3-3d47-4781-b8a8-aafd671d7287" status: 404 len: 111 microversion: 2.1 time: 0.105701 Oct 22 21:00:22.441148 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1183/2507] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:00:22 2022] GET /compute/v2.1/servers/40e6c6e3-3d47-4781-b8a8-aafd671d7287 => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 21:00:22.457823 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-b6ef4878-a071-48a4-a83a-8b8af7a8c2ae req-6e37bd8f-fc86-4e34-b819-88d43c96248a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40e6c6e3-3d47-4781-b8a8-aafd671d7287", "name": "network-vif-deleted", "tag": "3f86770d-1d07-4131-85b9-86ddae7d31e5"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:00:22.473180 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-b6ef4878-a071-48a4-a83a-8b8af7a8c2ae req-6e37bd8f-fc86-4e34-b819-88d43c96248a service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:22.479047 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-b6ef4878-a071-48a4-a83a-8b8af7a8c2ae req-6e37bd8f-fc86-4e34-b819-88d43c96248a service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:22.479984 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-b6ef4878-a071-48a4-a83a-8b8af7a8c2ae req-6e37bd8f-fc86-4e34-b819-88d43c96248a service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:22.499710 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-b6ef4878-a071-48a4-a83a-8b8af7a8c2ae req-6e37bd8f-fc86-4e34-b819-88d43c96248a service nova] Creating event network-vif-deleted:3f86770d-1d07-4131-85b9-86ddae7d31e5 for instance 40e6c6e3-3d47-4781-b8a8-aafd671d7287 on nch1-master-1 Oct 22 21:00:22.507938 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-b6ef4878-a071-48a4-a83a-8b8af7a8c2ae req-6e37bd8f-fc86-4e34-b819-88d43c96248a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065115 Oct 22 21:00:22.509336 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1184/2508] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:00:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:00:22.523811 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-e01d3728-cff7-451a-a7eb-3890f1952a42 req-3a0c6e58-017e-4595-918d-18d3bfd3a035 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70f4c178-630e-4050-8aad-4c60bec30bcd", "tag": "034bfe35-5a4c-4024-b8ad-3fc77f012374"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:00:22.555584 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-e01d3728-cff7-451a-a7eb-3890f1952a42 req-3a0c6e58-017e-4595-918d-18d3bfd3a035 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:22.563576 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-e01d3728-cff7-451a-a7eb-3890f1952a42 req-3a0c6e58-017e-4595-918d-18d3bfd3a035 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:22.565199 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-e01d3728-cff7-451a-a7eb-3890f1952a42 req-3a0c6e58-017e-4595-918d-18d3bfd3a035 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:22.604265 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-e01d3728-cff7-451a-a7eb-3890f1952a42 req-3a0c6e58-017e-4595-918d-18d3bfd3a035 service nova] Creating event network-changed:034bfe35-5a4c-4024-b8ad-3fc77f012374 for instance 70f4c178-630e-4050-8aad-4c60bec30bcd on nch1-master-1 Oct 22 21:00:22.620467 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-e01d3728-cff7-451a-a7eb-3890f1952a42 req-3a0c6e58-017e-4595-918d-18d3bfd3a035 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109424 Oct 22 21:00:22.622335 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1185/2509] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:00:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:00:22.645962 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-4df982ff-93bc-48ca-b132-7fc841546e70 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:00:22.648803 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-4df982ff-93bc-48ca-b132-7fc841546e70 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] [instance: eb38dcff-5703-4735-bf8e-6a40d51d8567] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:00:22.682219 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4df982ff-93bc-48ca-b132-7fc841546e70 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:22.682710 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4df982ff-93bc-48ca-b132-7fc841546e70 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:22.683152 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4df982ff-93bc-48ca-b132-7fc841546e70 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:22.683899 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4df982ff-93bc-48ca-b132-7fc841546e70 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:22.690996 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4df982ff-93bc-48ca-b132-7fc841546e70 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:22.694672 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4df982ff-93bc-48ca-b132-7fc841546e70 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:22.783088 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-d6239df9-fe2d-4a46-9413-c6a84070254a tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Flavor limits 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 21:00:22.783604 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-d6239df9-fe2d-4a46-9413-c6a84070254a tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Image limits 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 21:00:22.784220 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-d6239df9-fe2d-4a46-9413-c6a84070254a tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Flavor pref 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 21:00:22.784471 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-d6239df9-fe2d-4a46-9413-c6a84070254a tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Image pref 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 21:00:22.784885 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-d6239df9-fe2d-4a46-9413-c6a84070254a tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 21:00:22.809183 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d6239df9-fe2d-4a46-9413-c6a84070254a tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:22.810076 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d6239df9-fe2d-4a46-9413-c6a84070254a tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:22.810819 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d6239df9-fe2d-4a46-9413-c6a84070254a tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:22.811772 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d6239df9-fe2d-4a46-9413-c6a84070254a tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:22.812401 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d6239df9-fe2d-4a46-9413-c6a84070254a tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:22.813762 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d6239df9-fe2d-4a46-9413-c6a84070254a tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:22.830524 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell1:SELECT=61,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:00:22.858150 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-4df982ff-93bc-48ca-b132-7fc841546e70 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1b410a64e0415a96d30f5040361137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd7873d6db4e09bc9ab9a048a6b1ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:00:22.866190 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-d6239df9-fe2d-4a46-9413-c6a84070254a tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Getting quotas for project 66a26a2284f4424cbeaf63d504652546. Resources: {'cores', 'instances', 'ram'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 21:00:22.872414 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-4df982ff-93bc-48ca-b132-7fc841546e70 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] 10.222.0.18 "GET /compute/v2.1/servers/eb38dcff-5703-4735-bf8e-6a40d51d8567" status: 200 len: 1274 microversion: 2.1 time: 0.245728 Oct 22 21:00:22.873010 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1186/2510] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:00:22 2022] GET /compute/v2.1/servers/eb38dcff-5703-4735-bf8e-6a40d51d8567 => generated 1274 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:00:22.885386 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-0f81bc15-ef85-45fe-b3ae-6bc0aebf9b86 req-b638922c-96ad-4526-8d2c-ebf05e49f476 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f38f14b2-b9d7-4bed-92ba-7b95ea4b2270", "name": "network-vif-plugged", "status": "completed", "tag": "e1aa03d1-429d-47fc-a834-f0bbaa09e3c6"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:00:22.891172 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-d6239df9-fe2d-4a46-9413-c6a84070254a tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Getting quotas for user f0a44ff8e7c14b94b1670f030085c43d and project 66a26a2284f4424cbeaf63d504652546. Resources: {'cores', 'instances', 'ram'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 21:00:22.912284 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-0f81bc15-ef85-45fe-b3ae-6bc0aebf9b86 req-b638922c-96ad-4526-8d2c-ebf05e49f476 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:22.914380 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-0f81bc15-ef85-45fe-b3ae-6bc0aebf9b86 req-b638922c-96ad-4526-8d2c-ebf05e49f476 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:22.915102 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-0f81bc15-ef85-45fe-b3ae-6bc0aebf9b86 req-b638922c-96ad-4526-8d2c-ebf05e49f476 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:22.932202 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-d6239df9-fe2d-4a46-9413-c6a84070254a tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Going to run 1 instances... {{(pid=138745) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 21:00:22.935019 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-d6239df9-fe2d-4a46-9413-c6a84070254a tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] [instance: af11a208-be6e-4f70-85f0-4bafafb4febd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='085e4478-6edc-4a69-8e08-f9831713eb65',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138745) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 21:00:22.943277 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-0f81bc15-ef85-45fe-b3ae-6bc0aebf9b86 req-b638922c-96ad-4526-8d2c-ebf05e49f476 service nova] Creating event network-vif-plugged:e1aa03d1-429d-47fc-a834-f0bbaa09e3c6 for instance f38f14b2-b9d7-4bed-92ba-7b95ea4b2270 on nch2-master-1 Oct 22 21:00:22.957542 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-0f81bc15-ef85-45fe-b3ae-6bc0aebf9b86 req-b638922c-96ad-4526-8d2c-ebf05e49f476 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079591 Oct 22 21:00:22.958493 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1187/2511] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:00:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:00:22.964518 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-5466e4b3-2d57-487b-83a3-e797d9985368 tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Calling method '.version_select at 0x7fd39f25e700>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:00:23.004020 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-d6239df9-fe2d-4a46-9413-c6a84070254a tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.523340 Oct 22 21:00:23.007831 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1325/2512] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Oct 22 21:00:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 1528 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 21:00:23.026614 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-eec92cf8-b058-4a11-8d54-13470d79803c tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:00:23.030031 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-eec92cf8-b058-4a11-8d54-13470d79803c tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] [instance: 7dde7a20-b949-4c72-ae19-83f2f0afd0d1] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:00:23.038567 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-eec92cf8-b058-4a11-8d54-13470d79803c tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:23.039230 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-eec92cf8-b058-4a11-8d54-13470d79803c tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:23.040161 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-eec92cf8-b058-4a11-8d54-13470d79803c tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:23.041163 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-eec92cf8-b058-4a11-8d54-13470d79803c tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:23.041844 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-eec92cf8-b058-4a11-8d54-13470d79803c tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:23.042463 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-eec92cf8-b058-4a11-8d54-13470d79803c tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:23.691997 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-eec92cf8-b058-4a11-8d54-13470d79803c tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d49952dbca4d95a25411b65d56552b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed31e93b0e8a43f28e497f94318815ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:00:23.711088 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-eec92cf8-b058-4a11-8d54-13470d79803c tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] 10.222.0.18 "GET /compute/v2.1/servers/7dde7a20-b949-4c72-ae19-83f2f0afd0d1" status: 200 len: 1573 microversion: 2.1 time: 0.694271 Oct 22 21:00:23.711806 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1326/2513] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:00:23 2022] GET /compute/v2.1/servers/7dde7a20-b949-4c72-ae19-83f2f0afd0d1 => generated 1573 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:00:23.726218 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-ec632ec2-e1bd-407c-b2df-07d7deae1f53 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:00:23.728454 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-ec632ec2-e1bd-407c-b2df-07d7deae1f53 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] [instance: ee6c092d-1150-415f-8a2e-58f4d3b5c238] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:00:23.761308 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ec632ec2-e1bd-407c-b2df-07d7deae1f53 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:23.761864 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ec632ec2-e1bd-407c-b2df-07d7deae1f53 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:23.762402 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ec632ec2-e1bd-407c-b2df-07d7deae1f53 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:23.763183 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ec632ec2-e1bd-407c-b2df-07d7deae1f53 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:23.763674 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ec632ec2-e1bd-407c-b2df-07d7deae1f53 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:23.764113 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ec632ec2-e1bd-407c-b2df-07d7deae1f53 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:24.145902 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-ec632ec2-e1bd-407c-b2df-07d7deae1f53 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b9bfe6f6d564d4c9fb1fea439476e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6e01f91c3a845bf8e67e3ad415d9c69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:00:24.155055 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-ec632ec2-e1bd-407c-b2df-07d7deae1f53 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] 10.222.0.18 "GET /compute/v2.1/servers/ee6c092d-1150-415f-8a2e-58f4d3b5c238" status: 200 len: 1318 microversion: 2.1 time: 0.442151 Oct 22 21:00:24.156036 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1327/2514] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:00:23 2022] GET /compute/v2.1/servers/ee6c092d-1150-415f-8a2e-58f4d3b5c238 => generated 1318 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:00:24.160780 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-660ba0c9-eb32-43d8-b71a-2eb68eb1115a tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:00:24.161587 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-660ba0c9-eb32-43d8-b71a-2eb68eb1115a tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] [instance: af11a208-be6e-4f70-85f0-4bafafb4febd] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:00:24.168269 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-660ba0c9-eb32-43d8-b71a-2eb68eb1115a tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:24.169167 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-660ba0c9-eb32-43d8-b71a-2eb68eb1115a tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:24.169967 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-660ba0c9-eb32-43d8-b71a-2eb68eb1115a tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:24.170942 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-660ba0c9-eb32-43d8-b71a-2eb68eb1115a tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:24.171596 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-660ba0c9-eb32-43d8-b71a-2eb68eb1115a tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:24.172209 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-660ba0c9-eb32-43d8-b71a-2eb68eb1115a tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:24.276820 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-660ba0c9-eb32-43d8-b71a-2eb68eb1115a tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a44ff8e7c14b94b1670f030085c43d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a26a2284f4424cbeaf63d504652546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:00:24.296778 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-660ba0c9-eb32-43d8-b71a-2eb68eb1115a tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] 10.222.0.18 "GET /compute/v2.1/servers/af11a208-be6e-4f70-85f0-4bafafb4febd" status: 200 len: 1203 microversion: 2.1 time: 0.138783 Oct 22 21:00:24.298673 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1328/2515] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:00:24 2022] GET /compute/v2.1/servers/af11a208-be6e-4f70-85f0-4bafafb4febd => generated 1203 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:00:24.307882 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-d9fc3d3f-c6c1-4981-b15b-87b03c47243b tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:00:24.309904 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-d9fc3d3f-c6c1-4981-b15b-87b03c47243b tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] [instance: f38f14b2-b9d7-4bed-92ba-7b95ea4b2270] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:00:24.320493 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d9fc3d3f-c6c1-4981-b15b-87b03c47243b tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:24.321378 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d9fc3d3f-c6c1-4981-b15b-87b03c47243b tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:24.322779 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d9fc3d3f-c6c1-4981-b15b-87b03c47243b tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:24.324500 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d9fc3d3f-c6c1-4981-b15b-87b03c47243b tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:24.326075 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d9fc3d3f-c6c1-4981-b15b-87b03c47243b tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:24.327374 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d9fc3d3f-c6c1-4981-b15b-87b03c47243b tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:24.989846 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-d9fc3d3f-c6c1-4981-b15b-87b03c47243b tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211483c6acea4f76b6c0e4bfc818e7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd687d54e07d4ab4af00ad801ef4b58d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:00:25.004263 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-d9fc3d3f-c6c1-4981-b15b-87b03c47243b tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '211483c6acea4f76b6c0e4bfc818e7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd687d54e07d4ab4af00ad801ef4b58d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:00:25.006409 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-d9fc3d3f-c6c1-4981-b15b-87b03c47243b tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '211483c6acea4f76b6c0e4bfc818e7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd687d54e07d4ab4af00ad801ef4b58d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:00:25.008747 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-d9fc3d3f-c6c1-4981-b15b-87b03c47243b tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] 10.222.0.18 "GET /compute/v2.1/servers/f38f14b2-b9d7-4bed-92ba-7b95ea4b2270" status: 200 len: 1874 microversion: 2.42 time: 0.706899 Oct 22 21:00:25.020976 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1329/2516] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:00:24 2022] GET /compute/v2.1/servers/f38f14b2-b9d7-4bed-92ba-7b95ea4b2270 => generated 1874 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:00:25.033155 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-ae94a573-c59a-47dd-b627-bab476a22891 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1980962167"}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:00:25.033716 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-ae94a573-c59a-47dd-b627-bab476a22891 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] [instance: 7dde7a20-b949-4c72-ae19-83f2f0afd0d1] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:00:25.040679 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ae94a573-c59a-47dd-b627-bab476a22891 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:25.041489 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ae94a573-c59a-47dd-b627-bab476a22891 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:25.042109 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ae94a573-c59a-47dd-b627-bab476a22891 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:25.042844 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ae94a573-c59a-47dd-b627-bab476a22891 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:25.043816 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ae94a573-c59a-47dd-b627-bab476a22891 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:25.055496 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ae94a573-c59a-47dd-b627-bab476a22891 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:25.753673 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.network.security_group_api [None req-ae94a573-c59a-47dd-b627-bab476a22891 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Adding security group 623f979c-1a09-4ecf-8efb-7ed86490517f to port e4d75169-7798-4abd-957f-2abc3db1143a Oct 22 21:00:26.354828 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-5466e4b3-2d57-487b-83a3-e797d9985368 tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] 10.222.0.18 "DELETE /compute/v2.1/os-floating-ips/f14e87c0-0961-4d17-a89c-2233c858f2f6" status: 202 len: 0 microversion: 2.1 time: 3.394644 Oct 22 21:00:26.357164 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1188/2517] 10.222.0.18 () {58 vars in 1263 bytes} [Sat Oct 22 21:00:22 2022] DELETE /compute/v2.1/os-floating-ips/f14e87c0-0961-4d17-a89c-2233c858f2f6 => generated 0 bytes in 3398 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 21:00:26.369224 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-de9e3dc4-e9f4-4dcc-8d16-c59bf0e079ee tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:00:26.370461 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-de9e3dc4-e9f4-4dcc-8d16-c59bf0e079ee tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] [instance: eb38dcff-5703-4735-bf8e-6a40d51d8567] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:00:26.404084 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-de9e3dc4-e9f4-4dcc-8d16-c59bf0e079ee tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:26.405209 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-de9e3dc4-e9f4-4dcc-8d16-c59bf0e079ee tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:26.405938 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-de9e3dc4-e9f4-4dcc-8d16-c59bf0e079ee tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:26.408035 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-de9e3dc4-e9f4-4dcc-8d16-c59bf0e079ee tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:26.409072 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-de9e3dc4-e9f4-4dcc-8d16-c59bf0e079ee tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:26.409719 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-de9e3dc4-e9f4-4dcc-8d16-c59bf0e079ee tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:26.952026 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-de9e3dc4-e9f4-4dcc-8d16-c59bf0e079ee tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1b410a64e0415a96d30f5040361137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd7873d6db4e09bc9ab9a048a6b1ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:00:26.970952 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-de9e3dc4-e9f4-4dcc-8d16-c59bf0e079ee tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] 10.222.0.18 "GET /compute/v2.1/servers/eb38dcff-5703-4735-bf8e-6a40d51d8567" status: 200 len: 1314 microversion: 2.1 time: 0.606859 Oct 22 21:00:26.980465 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1189/2518] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:00:26 2022] GET /compute/v2.1/servers/eb38dcff-5703-4735-bf8e-6a40d51d8567 => generated 1314 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:00:26.991730 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-9b330928-0fb5-4267-87f2-c631c25d0d9b req-e324b384-2854-4663-bb30-5020c6a9fb3a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae58d60e-a113-4a38-94b5-b72a19c353e6", "tag": "6bbd4b8b-948d-44a4-8b7f-6968bc1dc2cf"}, {"name": "network-changed", "server_uuid": "ee6c092d-1150-415f-8a2e-58f4d3b5c238", "tag": "ab582bca-d4c2-4df2-a2fb-cfb59dff7776"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:00:27.004026 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-9b330928-0fb5-4267-87f2-c631c25d0d9b req-e324b384-2854-4663-bb30-5020c6a9fb3a service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:27.004839 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-9b330928-0fb5-4267-87f2-c631c25d0d9b req-e324b384-2854-4663-bb30-5020c6a9fb3a service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:27.005398 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-9b330928-0fb5-4267-87f2-c631c25d0d9b req-e324b384-2854-4663-bb30-5020c6a9fb3a service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:27.020404 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-9b330928-0fb5-4267-87f2-c631c25d0d9b req-e324b384-2854-4663-bb30-5020c6a9fb3a service nova] Creating event network-changed:6bbd4b8b-948d-44a4-8b7f-6968bc1dc2cf for instance ae58d60e-a113-4a38-94b5-b72a19c353e6 on nch2-master-1 Oct 22 21:00:27.021354 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-9b330928-0fb5-4267-87f2-c631c25d0d9b req-e324b384-2854-4663-bb30-5020c6a9fb3a service nova] Creating event network-changed:ab582bca-d4c2-4df2-a2fb-cfb59dff7776 for instance ee6c092d-1150-415f-8a2e-58f4d3b5c238 on nch2-master-1 Oct 22 21:00:27.029805 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-9b330928-0fb5-4267-87f2-c631c25d0d9b req-e324b384-2854-4663-bb30-5020c6a9fb3a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.047879 Oct 22 21:00:27.031180 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1190/2519] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:00:26 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:00:27.037341 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-6b08e5b1-e729-40df-8308-ce34d2d25fc8 req-d0843b6c-8338-4c6b-8a27-08345064436a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f38f14b2-b9d7-4bed-92ba-7b95ea4b2270", "name": "network-vif-plugged", "status": "completed", "tag": "21b2a827-e5c7-48f8-b28e-41001a9b5db6"}, {"server_uuid": "f38f14b2-b9d7-4bed-92ba-7b95ea4b2270", "name": "network-vif-plugged", "status": "completed", "tag": "d1d48ace-de12-4f4f-9a38-db0a37b136e5"}, {"server_uuid": "f38f14b2-b9d7-4bed-92ba-7b95ea4b2270", "name": "network-vif-plugged", "status": "completed", "tag": "721b179f-1381-454b-b0cc-f9d4497ccc12"}, {"server_uuid": "f38f14b2-b9d7-4bed-92ba-7b95ea4b2270", "name": "network-vif-plugged", "status": "completed", "tag": "e8b58979-b36e-4d6b-8fde-739fbeb99ab8"}, {"server_uuid": "f38f14b2-b9d7-4bed-92ba-7b95ea4b2270", "name": "network-vif-plugged", "status": "completed", "tag": "b6fc5821-644a-4f87-9788-a1775a1d521d"}, {"server_uuid": "f38f14b2-b9d7-4bed-92ba-7b95ea4b2270", "name": "network-vif-plugged", "status": "completed", "tag": "0600dbf3-8593-4575-a8b3-daa0446351bb"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:00:27.054301 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-6b08e5b1-e729-40df-8308-ce34d2d25fc8 req-d0843b6c-8338-4c6b-8a27-08345064436a service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:27.055070 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-6b08e5b1-e729-40df-8308-ce34d2d25fc8 req-d0843b6c-8338-4c6b-8a27-08345064436a service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:27.055950 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-6b08e5b1-e729-40df-8308-ce34d2d25fc8 req-d0843b6c-8338-4c6b-8a27-08345064436a service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:27.071970 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-6b08e5b1-e729-40df-8308-ce34d2d25fc8 req-d0843b6c-8338-4c6b-8a27-08345064436a service nova] Creating event network-vif-plugged:21b2a827-e5c7-48f8-b28e-41001a9b5db6 for instance f38f14b2-b9d7-4bed-92ba-7b95ea4b2270 on nch2-master-1 Oct 22 21:00:27.073119 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-6b08e5b1-e729-40df-8308-ce34d2d25fc8 req-d0843b6c-8338-4c6b-8a27-08345064436a service nova] Creating event network-vif-plugged:d1d48ace-de12-4f4f-9a38-db0a37b136e5 for instance f38f14b2-b9d7-4bed-92ba-7b95ea4b2270 on nch2-master-1 Oct 22 21:00:27.073835 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-6b08e5b1-e729-40df-8308-ce34d2d25fc8 req-d0843b6c-8338-4c6b-8a27-08345064436a service nova] Creating event network-vif-plugged:721b179f-1381-454b-b0cc-f9d4497ccc12 for instance f38f14b2-b9d7-4bed-92ba-7b95ea4b2270 on nch2-master-1 Oct 22 21:00:27.074544 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-6b08e5b1-e729-40df-8308-ce34d2d25fc8 req-d0843b6c-8338-4c6b-8a27-08345064436a service nova] Creating event network-vif-plugged:e8b58979-b36e-4d6b-8fde-739fbeb99ab8 for instance f38f14b2-b9d7-4bed-92ba-7b95ea4b2270 on nch2-master-1 Oct 22 21:00:27.075405 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-6b08e5b1-e729-40df-8308-ce34d2d25fc8 req-d0843b6c-8338-4c6b-8a27-08345064436a service nova] Creating event network-vif-plugged:b6fc5821-644a-4f87-9788-a1775a1d521d for instance f38f14b2-b9d7-4bed-92ba-7b95ea4b2270 on nch2-master-1 Oct 22 21:00:27.084456 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-6b08e5b1-e729-40df-8308-ce34d2d25fc8 req-d0843b6c-8338-4c6b-8a27-08345064436a service nova] Creating event network-vif-plugged:0600dbf3-8593-4575-a8b3-daa0446351bb for instance f38f14b2-b9d7-4bed-92ba-7b95ea4b2270 on nch2-master-1 Oct 22 21:00:27.105362 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-6b08e5b1-e729-40df-8308-ce34d2d25fc8 req-d0843b6c-8338-4c6b-8a27-08345064436a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1038 microversion: 2.1 time: 0.069993 Oct 22 21:00:27.108056 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1191/2520] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:00:27 2022] POST /compute/v2.1/os-server-external-events => generated 1038 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:00:27.120414 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-c5435f42-58fd-4928-a6fe-c19b0bdbf731 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:00:27.121786 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-c5435f42-58fd-4928-a6fe-c19b0bdbf731 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] [instance: ee6c092d-1150-415f-8a2e-58f4d3b5c238] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:00:27.136661 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c5435f42-58fd-4928-a6fe-c19b0bdbf731 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:27.137674 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c5435f42-58fd-4928-a6fe-c19b0bdbf731 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:27.138525 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c5435f42-58fd-4928-a6fe-c19b0bdbf731 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:27.139516 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c5435f42-58fd-4928-a6fe-c19b0bdbf731 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:27.140210 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c5435f42-58fd-4928-a6fe-c19b0bdbf731 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:27.141010 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c5435f42-58fd-4928-a6fe-c19b0bdbf731 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:27.163549 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-ae94a573-c59a-47dd-b627-bab476a22891 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] 10.222.0.18 "POST /compute/v2.1/servers/7dde7a20-b949-4c72-ae19-83f2f0afd0d1/action" status: 202 len: 0 microversion: 2.1 time: 2.141292 Oct 22 21:00:27.165256 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1330/2521] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 21:00:25 2022] POST /compute/v2.1/servers/7dde7a20-b949-4c72-ae19-83f2f0afd0d1/action => generated 0 bytes in 2143 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 21:00:27.173833 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-b4f0cdaa-f243-445b-be13-7ee4b70a2889 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:00:27.174834 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-b4f0cdaa-f243-445b-be13-7ee4b70a2889 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] [instance: af11a208-be6e-4f70-85f0-4bafafb4febd] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:00:27.204995 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b4f0cdaa-f243-445b-be13-7ee4b70a2889 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:27.206854 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b4f0cdaa-f243-445b-be13-7ee4b70a2889 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:27.207617 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b4f0cdaa-f243-445b-be13-7ee4b70a2889 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:27.208673 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b4f0cdaa-f243-445b-be13-7ee4b70a2889 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:27.214504 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b4f0cdaa-f243-445b-be13-7ee4b70a2889 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:27.215203 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b4f0cdaa-f243-445b-be13-7ee4b70a2889 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:28.080851 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-c5435f42-58fd-4928-a6fe-c19b0bdbf731 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b9bfe6f6d564d4c9fb1fea439476e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6e01f91c3a845bf8e67e3ad415d9c69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:00:28.089898 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-c5435f42-58fd-4928-a6fe-c19b0bdbf731 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] 10.222.0.18 "GET /compute/v2.1/servers/ee6c092d-1150-415f-8a2e-58f4d3b5c238" status: 200 len: 1318 microversion: 2.1 time: 0.979338 Oct 22 21:00:28.093726 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1192/2522] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:00:27 2022] GET /compute/v2.1/servers/ee6c092d-1150-415f-8a2e-58f4d3b5c238 => generated 1318 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:00:28.103515 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-28fe0513-830c-41c0-843a-28078046c7a6 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:00:28.109762 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-28fe0513-830c-41c0-843a-28078046c7a6 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] [instance: f38f14b2-b9d7-4bed-92ba-7b95ea4b2270] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:00:28.121811 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-28fe0513-830c-41c0-843a-28078046c7a6 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:28.122701 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-28fe0513-830c-41c0-843a-28078046c7a6 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:28.123383 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-28fe0513-830c-41c0-843a-28078046c7a6 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:28.127274 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-28fe0513-830c-41c0-843a-28078046c7a6 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:28.128062 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-28fe0513-830c-41c0-843a-28078046c7a6 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:28.128777 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-28fe0513-830c-41c0-843a-28078046c7a6 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:28.230794 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-b4f0cdaa-f243-445b-be13-7ee4b70a2889 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a44ff8e7c14b94b1670f030085c43d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a26a2284f4424cbeaf63d504652546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:00:28.249609 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-b4f0cdaa-f243-445b-be13-7ee4b70a2889 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] 10.222.0.18 "GET /compute/v2.1/servers/af11a208-be6e-4f70-85f0-4bafafb4febd" status: 200 len: 1307 microversion: 2.1 time: 1.080017 Oct 22 21:00:28.272725 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1331/2523] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:00:27 2022] GET /compute/v2.1/servers/af11a208-be6e-4f70-85f0-4bafafb4febd => generated 1307 bytes in 1107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:00:28.284925 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-f5f0044c-4047-431f-9b55-1ac03f71a3d3 tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Calling method '.version_select at 0x7fd39fbdc8b0>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:00:28.626026 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-28fe0513-830c-41c0-843a-28078046c7a6 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211483c6acea4f76b6c0e4bfc818e7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd687d54e07d4ab4af00ad801ef4b58d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:00:28.649971 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-28fe0513-830c-41c0-843a-28078046c7a6 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '211483c6acea4f76b6c0e4bfc818e7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd687d54e07d4ab4af00ad801ef4b58d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:00:28.653337 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-28fe0513-830c-41c0-843a-28078046c7a6 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '211483c6acea4f76b6c0e4bfc818e7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd687d54e07d4ab4af00ad801ef4b58d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:00:28.659314 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-28fe0513-830c-41c0-843a-28078046c7a6 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] 10.222.0.18 "GET /compute/v2.1/servers/f38f14b2-b9d7-4bed-92ba-7b95ea4b2270" status: 200 len: 1874 microversion: 2.42 time: 0.563354 Oct 22 21:00:28.660399 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1193/2524] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:00:28 2022] GET /compute/v2.1/servers/f38f14b2-b9d7-4bed-92ba-7b95ea4b2270 => generated 1874 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:00:28.666016 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-2f6729ad-a320-4c06-ba95-c158cf5ed6f5 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Calling method '.version_select at 0x7fd39f156940>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:00:28.951649 ncdv-master-1 devstack@n-api.service[138744]: DEBUG neutronclient.v2_0.client [None req-2f6729ad-a320-4c06-ba95-c158cf5ed6f5 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 623f979c-1a09-4ecf-8efb-7ed86490517f in use.", "detail": ""}} {{(pid=138744) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 22 21:00:28.951873 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-2f6729ad-a320-4c06-ba95-c158cf5ed6f5 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] HTTP exception thrown: Security Group 623f979c-1a09-4ecf-8efb-7ed86490517f in use. Oct 22 21:00:28.951873 ncdv-master-1 devstack@n-api.service[138744]: Neutron server returns request_ids: ['req-fd671e20-650a-4dbe-a836-e1b479d8ac05'] Oct 22 21:00:28.956042 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-2f6729ad-a320-4c06-ba95-c158cf5ed6f5 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Request method failure captured: Oct 22 21:00:28.956042 ncdv-master-1 devstack@n-api.service[138744]: request: DELETE /compute/v2.1/os-security-groups/623f979c-1a09-4ecf-8efb-7ed86490517f HTTP/1.1 Oct 22 21:00:28.956042 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 21:00:28.956042 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 21:00:28.956042 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 21:00:28.956042 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 0 Oct 22 21:00:28.956042 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 21:00:28.956042 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 21:00:28.956042 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 21:00:28.956042 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 21:00:28.956042 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVFmMTFo8tMXHI466ygTiy0jTs5kz8YO2nFuimSyZRJI5bXNUfHpPLWjQrXyJ7I9Xfc54HQRfYflULj68lfwBk5jrnjY79oZ1kbdK55vumR_IVvMJmaykrPjWliG3H4xf-SZHnU3invPEATeZO7VP5aTca0hd9BauSvYCW1UPdVAZZ70 Oct 22 21:00:28.956042 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 21:00:28.956042 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 21:00:28.956042 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 21:00:28.956042 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 21:00:28.956042 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 21:00:28.956042 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 21:00:28.956042 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: ed31e93b0e8a43f28e497f94318815ce Oct 22 21:00:28.956042 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-SecurityGroupsTestJSON-1604956559 Oct 22 21:00:28.956042 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 21:00:28.956042 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 21:00:28.956042 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ed31e93b0e8a43f28e497f94318815ce"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ed31e93b0e8a43f28e497f94318815ce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ed31e93b0e8a43f28e497f94318815ce"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ed31e93b0e8a43f28e497f94318815ce"}]}] Oct 22 21:00:28.956042 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-SecurityGroupsTestJSON-1604956559 Oct 22 21:00:28.956042 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: ed31e93b0e8a43f28e497f94318815ce Oct 22 21:00:28.956042 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1604956559 Oct 22 21:00:28.956042 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-SecurityGroupsTestJSON-1604956559-project Oct 22 21:00:28.956042 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 21:00:28.956042 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 21:00:28.956042 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: 46d49952dbca4d95a25411b65d56552b Oct 22 21:00:28.956042 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-SecurityGroupsTestJSON-1604956559-project Oct 22 21:00:28.956042 ncdv-master-1 devstack@n-api.service[138744]: method: Oct 22 21:00:28.956042 ncdv-master-1 devstack@n-api.service[138744]: exception: Security Group 623f979c-1a09-4ecf-8efb-7ed86490517f in use. Oct 22 21:00:28.956042 ncdv-master-1 devstack@n-api.service[138744]: Neutron server returns request_ids: ['req-fd671e20-650a-4dbe-a836-e1b479d8ac05'] Oct 22 21:00:28.956042 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': '623f979c-1a09-4ecf-8efb-7ed86490517f'} Oct 22 21:00:28.956042 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:00:28.956042 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:00:28.956042 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Oct 22 21:00:28.956042 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Oct 22 21:00:28.956042 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 21:00:28.956042 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 21:00:28.956042 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Oct 22 21:00:28.956042 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Oct 22 21:00:28.956042 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 21:00:28.956042 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 21:00:28.956042 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Oct 22 21:00:28.956042 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Oct 22 21:00:28.956042 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 21:00:28.956042 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 21:00:28.956042 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 22 21:00:28.956042 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 22 21:00:28.956042 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 21:00:28.956042 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 21:00:28.956042 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 22 21:00:28.956042 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 22 21:00:28.956042 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 21:00:28.956042 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 21:00:28.956042 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 22 21:00:28.956042 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 22 21:00:28.956042 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 22 21:00:28.956042 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 22 21:00:28.956042 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 623f979c-1a09-4ecf-8efb-7ed86490517f in use. Oct 22 21:00:28.966408 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fd671e20-650a-4dbe-a836-e1b479d8ac05'] Oct 22 21:00:28.966408 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:00:28.966408 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:00:28.966408 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:00:28.966408 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:00:28.966408 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Oct 22 21:00:28.966408 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Oct 22 21:00:28.966408 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Oct 22 21:00:28.966408 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Oct 22 21:00:28.966408 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 623f979c-1a09-4ecf-8efb-7ed86490517f in use. Oct 22 21:00:28.966408 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fd671e20-650a-4dbe-a836-e1b479d8ac05'] Oct 22 21:00:28.966408 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:00:28.966408 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:00:28.966408 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:00:28.966408 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:00:28.966408 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:00:28.966408 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:00:28.966408 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:00:28.966408 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:00:28.966408 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 22 21:00:28.966408 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 22 21:00:28.966408 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:00:28.966408 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:00:28.966408 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Oct 22 21:00:28.966408 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 22 21:00:28.966408 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 623f979c-1a09-4ecf-8efb-7ed86490517f in use. Oct 22 21:00:28.966408 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fd671e20-650a-4dbe-a836-e1b479d8ac05'] Oct 22 21:00:28.966408 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:00:28.966408 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:00:28.966408 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:00:28.966408 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:00:28.966408 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:00:28.966408 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:00:28.966408 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:00:28.966408 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:00:28.966408 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 623f979c-1a09-4ecf-8efb-7ed86490517f in use. Oct 22 21:00:28.966408 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fd671e20-650a-4dbe-a836-e1b479d8ac05'] Oct 22 21:00:28.966408 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:00:28.966408 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-2f6729ad-a320-4c06-ba95-c158cf5ed6f5 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Returning 400 to user: Security Group 623f979c-1a09-4ecf-8efb-7ed86490517f in use. Oct 22 21:00:28.966408 ncdv-master-1 devstack@n-api.service[138744]: Neutron server returns request_ids: ['req-fd671e20-650a-4dbe-a836-e1b479d8ac05'] {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:00:28.966408 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-2f6729ad-a320-4c06-ba95-c158cf5ed6f5 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/623f979c-1a09-4ecf-8efb-7ed86490517f" status: 400 len: 185 microversion: 2.1 time: 0.298996 Oct 22 21:00:28.966408 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1194/2525] 10.222.0.18 () {58 vars in 1272 bytes} [Sat Oct 22 21:00:28 2022] DELETE /compute/v2.1/os-security-groups/623f979c-1a09-4ecf-8efb-7ed86490517f => generated 185 bytes in 301 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 22 21:00:28.972896 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-712b1650-5423-40b4-ab49-cbbd3d1c3593 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:00:28.972896 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-712b1650-5423-40b4-ab49-cbbd3d1c3593 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] [instance: eb38dcff-5703-4735-bf8e-6a40d51d8567] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:00:28.982282 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-712b1650-5423-40b4-ab49-cbbd3d1c3593 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:28.982866 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-712b1650-5423-40b4-ab49-cbbd3d1c3593 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:28.983821 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-712b1650-5423-40b4-ab49-cbbd3d1c3593 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:28.985447 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-712b1650-5423-40b4-ab49-cbbd3d1c3593 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:28.986070 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-712b1650-5423-40b4-ab49-cbbd3d1c3593 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:28.986680 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-712b1650-5423-40b4-ab49-cbbd3d1c3593 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:29.021039 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-f5f0044c-4047-431f-9b55-1ac03f71a3d3 tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/7f8b6741-f931-441d-8642-1200b1e0e6c4" status: 202 len: 0 microversion: 2.1 time: 0.746494 Oct 22 21:00:29.022014 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1332/2526] 10.222.0.18 () {58 vars in 1272 bytes} [Sat Oct 22 21:00:28 2022] DELETE /compute/v2.1/os-security-groups/7f8b6741-f931-441d-8642-1200b1e0e6c4 => generated 0 bytes in 748 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 21:00:29.210199 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-ea877925-2dc8-42e0-ab85-bbd58d6acae4 tempest-ServerDiagnosticsNegativeTest-616658542 tempest-ServerDiagnosticsNegativeTest-616658542-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiagnosticsNegativeTest-server-1810110831", "imageRef": "085e4478-6edc-4a69-8e08-f9831713eb65", "flavorRef": "452"}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:00:29.283764 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.network.neutron [None req-ea877925-2dc8-42e0-ab85-bbd58d6acae4 tempest-ServerDiagnosticsNegativeTest-616658542 tempest-ServerDiagnosticsNegativeTest-616658542-project] validate_networks() for None {{(pid=138745) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 21:00:29.290752 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-712b1650-5423-40b4-ab49-cbbd3d1c3593 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1b410a64e0415a96d30f5040361137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd7873d6db4e09bc9ab9a048a6b1ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:00:29.301216 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-712b1650-5423-40b4-ab49-cbbd3d1c3593 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] 10.222.0.18 "GET /compute/v2.1/servers/eb38dcff-5703-4735-bf8e-6a40d51d8567" status: 200 len: 1314 microversion: 2.1 time: 0.337500 Oct 22 21:00:29.315489 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1195/2527] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:00:28 2022] GET /compute/v2.1/servers/eb38dcff-5703-4735-bf8e-6a40d51d8567 => generated 1314 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:00:29.323792 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-3fa93805-781d-4089-9bdf-1dd02ab75c20 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:00:29.324677 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-3fa93805-781d-4089-9bdf-1dd02ab75c20 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] [instance: 7dde7a20-b949-4c72-ae19-83f2f0afd0d1] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:00:29.333283 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3fa93805-781d-4089-9bdf-1dd02ab75c20 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:29.334034 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3fa93805-781d-4089-9bdf-1dd02ab75c20 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:29.335577 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3fa93805-781d-4089-9bdf-1dd02ab75c20 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:29.336784 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3fa93805-781d-4089-9bdf-1dd02ab75c20 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:29.337699 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3fa93805-781d-4089-9bdf-1dd02ab75c20 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:29.338141 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3fa93805-781d-4089-9bdf-1dd02ab75c20 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:29.375245 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-3fa93805-781d-4089-9bdf-1dd02ab75c20 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] [instance: 7dde7a20-b949-4c72-ae19-83f2f0afd0d1] Going to try to terminate instance {{(pid=138744) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 21:00:29.482575 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-3fa93805-781d-4089-9bdf-1dd02ab75c20 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] 10.222.0.18 "DELETE /compute/v2.1/servers/7dde7a20-b949-4c72-ae19-83f2f0afd0d1" status: 204 len: 0 microversion: 2.1 time: 0.178816 Oct 22 21:00:29.483678 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1196/2528] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 21:00:29 2022] DELETE /compute/v2.1/servers/7dde7a20-b949-4c72-ae19-83f2f0afd0d1 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 21:00:29.491758 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-f52a1c5b-f9f9-4d70-9033-3b46ff5f5740 tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:00:29.492878 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-f52a1c5b-f9f9-4d70-9033-3b46ff5f5740 tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] [instance: ae58d60e-a113-4a38-94b5-b72a19c353e6] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:00:29.500900 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f52a1c5b-f9f9-4d70-9033-3b46ff5f5740 tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:29.501619 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f52a1c5b-f9f9-4d70-9033-3b46ff5f5740 tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:29.502273 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f52a1c5b-f9f9-4d70-9033-3b46ff5f5740 tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:29.503136 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f52a1c5b-f9f9-4d70-9033-3b46ff5f5740 tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:29.503725 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f52a1c5b-f9f9-4d70-9033-3b46ff5f5740 tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:29.504252 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f52a1c5b-f9f9-4d70-9033-3b46ff5f5740 tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:29.507735 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:00:29.539119 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-f52a1c5b-f9f9-4d70-9033-3b46ff5f5740 tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] [instance: ae58d60e-a113-4a38-94b5-b72a19c353e6] Going to try to terminate instance {{(pid=138744) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 21:00:29.635511 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=3,nova_api:INSERT=3 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:00:29.676608 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-f52a1c5b-f9f9-4d70-9033-3b46ff5f5740 tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] 10.222.0.18 "DELETE /compute/v2.1/servers/ae58d60e-a113-4a38-94b5-b72a19c353e6" status: 204 len: 0 microversion: 2.1 time: 0.190876 Oct 22 21:00:29.677892 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1197/2529] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 21:00:29 2022] DELETE /compute/v2.1/servers/ae58d60e-a113-4a38-94b5-b72a19c353e6 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 21:00:29.685289 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-b3e4fd4a-0832-4000-98c5-61e0f25037e2 req-316080b2-a0d1-4b1b-a94b-be2a06692f68 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7dde7a20-b949-4c72-ae19-83f2f0afd0d1", "tag": "e4d75169-7798-4abd-957f-2abc3db1143a"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:00:29.696842 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-b3e4fd4a-0832-4000-98c5-61e0f25037e2 req-316080b2-a0d1-4b1b-a94b-be2a06692f68 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:29.697320 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-b3e4fd4a-0832-4000-98c5-61e0f25037e2 req-316080b2-a0d1-4b1b-a94b-be2a06692f68 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:29.697842 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-b3e4fd4a-0832-4000-98c5-61e0f25037e2 req-316080b2-a0d1-4b1b-a94b-be2a06692f68 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:29.710937 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-b3e4fd4a-0832-4000-98c5-61e0f25037e2 req-316080b2-a0d1-4b1b-a94b-be2a06692f68 service nova] Creating event network-changed:e4d75169-7798-4abd-957f-2abc3db1143a for instance 7dde7a20-b949-4c72-ae19-83f2f0afd0d1 on nch1-master-1 Oct 22 21:00:29.716892 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-b3e4fd4a-0832-4000-98c5-61e0f25037e2 req-316080b2-a0d1-4b1b-a94b-be2a06692f68 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037449 Oct 22 21:00:29.717865 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1198/2530] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:00:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:00:29.724529 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-7fe77cd0-4d7c-4d4a-9347-97465be4d5d0 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:00:29.725238 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-7fe77cd0-4d7c-4d4a-9347-97465be4d5d0 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] [instance: ee6c092d-1150-415f-8a2e-58f4d3b5c238] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:00:29.732299 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7fe77cd0-4d7c-4d4a-9347-97465be4d5d0 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:29.733297 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7fe77cd0-4d7c-4d4a-9347-97465be4d5d0 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:29.733743 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7fe77cd0-4d7c-4d4a-9347-97465be4d5d0 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:29.734445 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7fe77cd0-4d7c-4d4a-9347-97465be4d5d0 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:29.735071 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7fe77cd0-4d7c-4d4a-9347-97465be4d5d0 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:29.735534 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7fe77cd0-4d7c-4d4a-9347-97465be4d5d0 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:29.750691 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-ea877925-2dc8-42e0-ab85-bbd58d6acae4 tempest-ServerDiagnosticsNegativeTest-616658542 tempest-ServerDiagnosticsNegativeTest-616658542-project] Flavor limits 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 21:00:29.751206 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-ea877925-2dc8-42e0-ab85-bbd58d6acae4 tempest-ServerDiagnosticsNegativeTest-616658542 tempest-ServerDiagnosticsNegativeTest-616658542-project] Image limits 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 21:00:29.752566 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-ea877925-2dc8-42e0-ab85-bbd58d6acae4 tempest-ServerDiagnosticsNegativeTest-616658542 tempest-ServerDiagnosticsNegativeTest-616658542-project] Flavor pref 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 21:00:29.753069 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-ea877925-2dc8-42e0-ab85-bbd58d6acae4 tempest-ServerDiagnosticsNegativeTest-616658542 tempest-ServerDiagnosticsNegativeTest-616658542-project] Image pref 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 21:00:29.753570 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-ea877925-2dc8-42e0-ab85-bbd58d6acae4 tempest-ServerDiagnosticsNegativeTest-616658542 tempest-ServerDiagnosticsNegativeTest-616658542-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 21:00:29.766121 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ea877925-2dc8-42e0-ab85-bbd58d6acae4 tempest-ServerDiagnosticsNegativeTest-616658542 tempest-ServerDiagnosticsNegativeTest-616658542-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:29.766729 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ea877925-2dc8-42e0-ab85-bbd58d6acae4 tempest-ServerDiagnosticsNegativeTest-616658542 tempest-ServerDiagnosticsNegativeTest-616658542-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:29.767505 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ea877925-2dc8-42e0-ab85-bbd58d6acae4 tempest-ServerDiagnosticsNegativeTest-616658542 tempest-ServerDiagnosticsNegativeTest-616658542-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:29.769159 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ea877925-2dc8-42e0-ab85-bbd58d6acae4 tempest-ServerDiagnosticsNegativeTest-616658542 tempest-ServerDiagnosticsNegativeTest-616658542-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:29.769843 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ea877925-2dc8-42e0-ab85-bbd58d6acae4 tempest-ServerDiagnosticsNegativeTest-616658542 tempest-ServerDiagnosticsNegativeTest-616658542-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:29.770513 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ea877925-2dc8-42e0-ab85-bbd58d6acae4 tempest-ServerDiagnosticsNegativeTest-616658542 tempest-ServerDiagnosticsNegativeTest-616658542-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:29.799173 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-ea877925-2dc8-42e0-ab85-bbd58d6acae4 tempest-ServerDiagnosticsNegativeTest-616658542 tempest-ServerDiagnosticsNegativeTest-616658542-project] Getting quotas for project 18ca06233c6b4e808308cf6613eb8db5. Resources: {'cores', 'instances', 'ram'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 21:00:29.805576 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-ea877925-2dc8-42e0-ab85-bbd58d6acae4 tempest-ServerDiagnosticsNegativeTest-616658542 tempest-ServerDiagnosticsNegativeTest-616658542-project] Getting quotas for user d42dbc5f3bc042ef935dd95e123bab0b and project 18ca06233c6b4e808308cf6613eb8db5. Resources: {'cores', 'instances', 'ram'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 21:00:29.819871 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-ea877925-2dc8-42e0-ab85-bbd58d6acae4 tempest-ServerDiagnosticsNegativeTest-616658542 tempest-ServerDiagnosticsNegativeTest-616658542-project] Going to run 1 instances... {{(pid=138745) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 21:00:29.822287 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-ea877925-2dc8-42e0-ab85-bbd58d6acae4 tempest-ServerDiagnosticsNegativeTest-616658542 tempest-ServerDiagnosticsNegativeTest-616658542-project] [instance: 5e249f40-5d17-49e0-8b86-75f2b4f089c2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='085e4478-6edc-4a69-8e08-f9831713eb65',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138745) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 21:00:29.888259 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-ea877925-2dc8-42e0-ab85-bbd58d6acae4 tempest-ServerDiagnosticsNegativeTest-616658542 tempest-ServerDiagnosticsNegativeTest-616658542-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.858881 Oct 22 21:00:29.891259 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1333/2531] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Oct 22 21:00:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 868 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 21:00:29.904177 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-027d80c0-b796-451d-af31-95d6183ab94c req-074657fa-ec8f-4122-9009-fe5c898633c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af11a208-be6e-4f70-85f0-4bafafb4febd", "tag": "3d94ca32-d8de-4aba-97b8-bd0eca70cdee"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:00:29.910524 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-7fe77cd0-4d7c-4d4a-9347-97465be4d5d0 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b9bfe6f6d564d4c9fb1fea439476e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6e01f91c3a845bf8e67e3ad415d9c69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:00:29.915673 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-027d80c0-b796-451d-af31-95d6183ab94c req-074657fa-ec8f-4122-9009-fe5c898633c0 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:29.916285 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-027d80c0-b796-451d-af31-95d6183ab94c req-074657fa-ec8f-4122-9009-fe5c898633c0 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:29.916981 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-027d80c0-b796-451d-af31-95d6183ab94c req-074657fa-ec8f-4122-9009-fe5c898633c0 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:29.930954 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-027d80c0-b796-451d-af31-95d6183ab94c req-074657fa-ec8f-4122-9009-fe5c898633c0 service nova] Creating event network-changed:3d94ca32-d8de-4aba-97b8-bd0eca70cdee for instance af11a208-be6e-4f70-85f0-4bafafb4febd on nch1-master-1 Oct 22 21:00:29.938361 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-027d80c0-b796-451d-af31-95d6183ab94c req-074657fa-ec8f-4122-9009-fe5c898633c0 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043698 Oct 22 21:00:29.939085 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1334/2532] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:00:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:00:29.948039 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-78edcde0-3ebe-4b73-a196-a061d44cd92a req-e972400f-3abc-46b2-808e-1f1ad7712ab1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70f4c178-630e-4050-8aad-4c60bec30bcd", "name": "network-vif-plugged", "status": "completed", "tag": "034bfe35-5a4c-4024-b8ad-3fc77f012374"}, {"server_uuid": "ee6c092d-1150-415f-8a2e-58f4d3b5c238", "name": "network-vif-plugged", "status": "completed", "tag": "ab582bca-d4c2-4df2-a2fb-cfb59dff7776"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:00:29.955086 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-7fe77cd0-4d7c-4d4a-9347-97465be4d5d0 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] 10.222.0.18 "GET /compute/v2.1/servers/ee6c092d-1150-415f-8a2e-58f4d3b5c238" status: 200 len: 1318 microversion: 2.1 time: 0.235684 Oct 22 21:00:29.959307 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1199/2533] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:00:29 2022] GET /compute/v2.1/servers/ee6c092d-1150-415f-8a2e-58f4d3b5c238 => generated 1318 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:00:29.972040 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-c3ae0bc7-77d4-4c0c-bbbb-b524c3ff8eed tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:00:29.973448 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-c3ae0bc7-77d4-4c0c-bbbb-b524c3ff8eed tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] [instance: af11a208-be6e-4f70-85f0-4bafafb4febd] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:00:29.976227 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-78edcde0-3ebe-4b73-a196-a061d44cd92a req-e972400f-3abc-46b2-808e-1f1ad7712ab1 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:29.976837 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-78edcde0-3ebe-4b73-a196-a061d44cd92a req-e972400f-3abc-46b2-808e-1f1ad7712ab1 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:29.977661 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-78edcde0-3ebe-4b73-a196-a061d44cd92a req-e972400f-3abc-46b2-808e-1f1ad7712ab1 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:29.986608 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c3ae0bc7-77d4-4c0c-bbbb-b524c3ff8eed tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:29.988745 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c3ae0bc7-77d4-4c0c-bbbb-b524c3ff8eed tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:29.990613 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c3ae0bc7-77d4-4c0c-bbbb-b524c3ff8eed tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:29.992364 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c3ae0bc7-77d4-4c0c-bbbb-b524c3ff8eed tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:29.993411 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c3ae0bc7-77d4-4c0c-bbbb-b524c3ff8eed tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:29.993920 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-78edcde0-3ebe-4b73-a196-a061d44cd92a req-e972400f-3abc-46b2-808e-1f1ad7712ab1 service nova] Creating event network-vif-plugged:034bfe35-5a4c-4024-b8ad-3fc77f012374 for instance 70f4c178-630e-4050-8aad-4c60bec30bcd on nch1-master-1 Oct 22 21:00:29.994532 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-78edcde0-3ebe-4b73-a196-a061d44cd92a req-e972400f-3abc-46b2-808e-1f1ad7712ab1 service nova] Creating event network-vif-plugged:ab582bca-d4c2-4df2-a2fb-cfb59dff7776 for instance ee6c092d-1150-415f-8a2e-58f4d3b5c238 on nch2-master-1 Oct 22 21:00:29.995197 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c3ae0bc7-77d4-4c0c-bbbb-b524c3ff8eed tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:30.005514 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-78edcde0-3ebe-4b73-a196-a061d44cd92a req-e972400f-3abc-46b2-808e-1f1ad7712ab1 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.061956 Oct 22 21:00:30.013026 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1335/2534] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:00:29 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:00:30.018921 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-20d1267c-cc0c-475d-ad7a-0bf5cc0845b4 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:00:30.019749 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-20d1267c-cc0c-475d-ad7a-0bf5cc0845b4 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] [instance: 7dde7a20-b949-4c72-ae19-83f2f0afd0d1] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:00:30.028979 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-20d1267c-cc0c-475d-ad7a-0bf5cc0845b4 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:30.029980 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-20d1267c-cc0c-475d-ad7a-0bf5cc0845b4 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:30.030492 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-20d1267c-cc0c-475d-ad7a-0bf5cc0845b4 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:30.031212 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-20d1267c-cc0c-475d-ad7a-0bf5cc0845b4 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:30.032560 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-20d1267c-cc0c-475d-ad7a-0bf5cc0845b4 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:30.032560 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-20d1267c-cc0c-475d-ad7a-0bf5cc0845b4 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:30.035485 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell0:SELECT=2 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:00:30.046479 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell0:SELECT=6 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:00:30.231908 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-c3ae0bc7-77d4-4c0c-bbbb-b524c3ff8eed tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a44ff8e7c14b94b1670f030085c43d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a26a2284f4424cbeaf63d504652546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:00:30.241771 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-c3ae0bc7-77d4-4c0c-bbbb-b524c3ff8eed tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] 10.222.0.18 "GET /compute/v2.1/servers/af11a208-be6e-4f70-85f0-4bafafb4febd" status: 200 len: 1307 microversion: 2.1 time: 0.280614 Oct 22 21:00:30.242802 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1200/2535] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:00:29 2022] GET /compute/v2.1/servers/af11a208-be6e-4f70-85f0-4bafafb4febd => generated 1307 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:00:30.247805 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-b17bf05c-3484-4baa-9d27-1434d6385a9d tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:00:30.248415 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-b17bf05c-3484-4baa-9d27-1434d6385a9d tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] [instance: ae58d60e-a113-4a38-94b5-b72a19c353e6] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:00:30.254587 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b17bf05c-3484-4baa-9d27-1434d6385a9d tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:30.255234 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b17bf05c-3484-4baa-9d27-1434d6385a9d tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:30.255848 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b17bf05c-3484-4baa-9d27-1434d6385a9d tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:30.256987 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b17bf05c-3484-4baa-9d27-1434d6385a9d tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:30.257595 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b17bf05c-3484-4baa-9d27-1434d6385a9d tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:30.258173 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b17bf05c-3484-4baa-9d27-1434d6385a9d tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:30.284231 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-20d1267c-cc0c-475d-ad7a-0bf5cc0845b4 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d49952dbca4d95a25411b65d56552b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed31e93b0e8a43f28e497f94318815ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:00:30.293403 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-20d1267c-cc0c-475d-ad7a-0bf5cc0845b4 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] 10.222.0.18 "GET /compute/v2.1/servers/7dde7a20-b949-4c72-ae19-83f2f0afd0d1" status: 200 len: 1648 microversion: 2.1 time: 0.278997 Oct 22 21:00:30.293988 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1336/2536] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:00:30 2022] GET /compute/v2.1/servers/7dde7a20-b949-4c72-ae19-83f2f0afd0d1 => generated 1648 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:00:30.307830 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-e863d0e3-da7b-4e53-89b4-bb0ba3303016 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:00:30.308526 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-e863d0e3-da7b-4e53-89b4-bb0ba3303016 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] [instance: f38f14b2-b9d7-4bed-92ba-7b95ea4b2270] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:00:30.316001 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e863d0e3-da7b-4e53-89b4-bb0ba3303016 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:30.316750 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e863d0e3-da7b-4e53-89b4-bb0ba3303016 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:30.317190 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e863d0e3-da7b-4e53-89b4-bb0ba3303016 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:30.321093 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e863d0e3-da7b-4e53-89b4-bb0ba3303016 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:30.321965 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e863d0e3-da7b-4e53-89b4-bb0ba3303016 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:30.323606 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e863d0e3-da7b-4e53-89b4-bb0ba3303016 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:30.502842 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-b17bf05c-3484-4baa-9d27-1434d6385a9d tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e36cd987f04f11b6a41325add4ccac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d79e903f8f24a348d5e771d434c70c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:00:30.512890 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-b17bf05c-3484-4baa-9d27-1434d6385a9d tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] 10.222.0.18 "GET /compute/v2.1/servers/ae58d60e-a113-4a38-94b5-b72a19c353e6" status: 200 len: 1508 microversion: 2.1 time: 0.268929 Oct 22 21:00:30.515192 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1201/2537] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:00:30 2022] GET /compute/v2.1/servers/ae58d60e-a113-4a38-94b5-b72a19c353e6 => generated 1508 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:00:30.523157 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-beee9e42-6f6f-4ae9-abab-b660a9b3bc62 tempest-ServerDiagnosticsNegativeTest-616658542 tempest-ServerDiagnosticsNegativeTest-616658542-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:00:30.523820 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-beee9e42-6f6f-4ae9-abab-b660a9b3bc62 tempest-ServerDiagnosticsNegativeTest-616658542 tempest-ServerDiagnosticsNegativeTest-616658542-project] [instance: 5e249f40-5d17-49e0-8b86-75f2b4f089c2] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:00:30.533732 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-beee9e42-6f6f-4ae9-abab-b660a9b3bc62 tempest-ServerDiagnosticsNegativeTest-616658542 tempest-ServerDiagnosticsNegativeTest-616658542-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:30.534468 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-beee9e42-6f6f-4ae9-abab-b660a9b3bc62 tempest-ServerDiagnosticsNegativeTest-616658542 tempest-ServerDiagnosticsNegativeTest-616658542-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:30.535201 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-beee9e42-6f6f-4ae9-abab-b660a9b3bc62 tempest-ServerDiagnosticsNegativeTest-616658542 tempest-ServerDiagnosticsNegativeTest-616658542-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:30.536258 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-beee9e42-6f6f-4ae9-abab-b660a9b3bc62 tempest-ServerDiagnosticsNegativeTest-616658542 tempest-ServerDiagnosticsNegativeTest-616658542-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:30.536826 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-beee9e42-6f6f-4ae9-abab-b660a9b3bc62 tempest-ServerDiagnosticsNegativeTest-616658542 tempest-ServerDiagnosticsNegativeTest-616658542-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:30.537386 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-beee9e42-6f6f-4ae9-abab-b660a9b3bc62 tempest-ServerDiagnosticsNegativeTest-616658542 tempest-ServerDiagnosticsNegativeTest-616658542-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:30.582538 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-e863d0e3-da7b-4e53-89b4-bb0ba3303016 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211483c6acea4f76b6c0e4bfc818e7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd687d54e07d4ab4af00ad801ef4b58d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:00:30.596727 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-e863d0e3-da7b-4e53-89b4-bb0ba3303016 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '211483c6acea4f76b6c0e4bfc818e7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd687d54e07d4ab4af00ad801ef4b58d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:00:30.598598 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-e863d0e3-da7b-4e53-89b4-bb0ba3303016 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '211483c6acea4f76b6c0e4bfc818e7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd687d54e07d4ab4af00ad801ef4b58d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:00:30.600015 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-e863d0e3-da7b-4e53-89b4-bb0ba3303016 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] 10.222.0.18 "GET /compute/v2.1/servers/f38f14b2-b9d7-4bed-92ba-7b95ea4b2270" status: 200 len: 2831 microversion: 2.42 time: 0.304894 Oct 22 21:00:30.601067 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1337/2538] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:00:30 2022] GET /compute/v2.1/servers/f38f14b2-b9d7-4bed-92ba-7b95ea4b2270 => generated 2831 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:00:30.606093 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-26afd00b-d677-4557-bd57-89fc862dc220 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:00:30.607609 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-26afd00b-d677-4557-bd57-89fc862dc220 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] [instance: eb38dcff-5703-4735-bf8e-6a40d51d8567] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:00:30.614456 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-26afd00b-d677-4557-bd57-89fc862dc220 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:30.615161 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-26afd00b-d677-4557-bd57-89fc862dc220 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:30.615815 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-26afd00b-d677-4557-bd57-89fc862dc220 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:30.616696 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-26afd00b-d677-4557-bd57-89fc862dc220 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:30.617650 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-26afd00b-d677-4557-bd57-89fc862dc220 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:30.618264 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-26afd00b-d677-4557-bd57-89fc862dc220 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:30.632388 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-beee9e42-6f6f-4ae9-abab-b660a9b3bc62 tempest-ServerDiagnosticsNegativeTest-616658542 tempest-ServerDiagnosticsNegativeTest-616658542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42dbc5f3bc042ef935dd95e123bab0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ca06233c6b4e808308cf6613eb8db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:00:30.651772 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-beee9e42-6f6f-4ae9-abab-b660a9b3bc62 tempest-ServerDiagnosticsNegativeTest-616658542 tempest-ServerDiagnosticsNegativeTest-616658542-project] 10.222.0.18 "GET /compute/v2.1/servers/5e249f40-5d17-49e0-8b86-75f2b4f089c2" status: 200 len: 1227 microversion: 2.1 time: 0.135182 Oct 22 21:00:30.652372 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1202/2539] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:00:30 2022] GET /compute/v2.1/servers/5e249f40-5d17-49e0-8b86-75f2b4f089c2 => generated 1227 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:00:30.662471 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-7045c9fd-b7f1-4c9b-9273-c6a6e88f464f tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:00:30.663159 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-7045c9fd-b7f1-4c9b-9273-c6a6e88f464f tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] [instance: f38f14b2-b9d7-4bed-92ba-7b95ea4b2270] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:00:30.669498 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7045c9fd-b7f1-4c9b-9273-c6a6e88f464f tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:30.670137 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7045c9fd-b7f1-4c9b-9273-c6a6e88f464f tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:30.670675 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7045c9fd-b7f1-4c9b-9273-c6a6e88f464f tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:30.671525 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7045c9fd-b7f1-4c9b-9273-c6a6e88f464f tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:30.671984 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7045c9fd-b7f1-4c9b-9273-c6a6e88f464f tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:30.672410 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7045c9fd-b7f1-4c9b-9273-c6a6e88f464f tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:30.821730 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-7045c9fd-b7f1-4c9b-9273-c6a6e88f464f tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] 10.222.0.18 "GET /compute/v2.1/servers/f38f14b2-b9d7-4bed-92ba-7b95ea4b2270/os-interface" status: 200 len: 1830 microversion: 2.42 time: 0.167901 Oct 22 21:00:30.822356 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1203/2540] 10.222.0.18 () {60 vars in 1316 bytes} [Sat Oct 22 21:00:30 2022] GET /compute/v2.1/servers/f38f14b2-b9d7-4bed-92ba-7b95ea4b2270/os-interface => generated 1830 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:00:31.016753 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-1a782218-04a2-4c75-99cb-4306b3e1d5c6 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:00:31.019144 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-1a782218-04a2-4c75-99cb-4306b3e1d5c6 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] [instance: ee6c092d-1150-415f-8a2e-58f4d3b5c238] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:00:31.034741 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1a782218-04a2-4c75-99cb-4306b3e1d5c6 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:31.040008 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1a782218-04a2-4c75-99cb-4306b3e1d5c6 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:31.040476 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1a782218-04a2-4c75-99cb-4306b3e1d5c6 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:31.041242 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1a782218-04a2-4c75-99cb-4306b3e1d5c6 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:31.045237 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1a782218-04a2-4c75-99cb-4306b3e1d5c6 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:31.045767 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1a782218-04a2-4c75-99cb-4306b3e1d5c6 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:31.047878 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-26afd00b-d677-4557-bd57-89fc862dc220 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1b410a64e0415a96d30f5040361137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd7873d6db4e09bc9ab9a048a6b1ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:00:31.063772 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-26afd00b-d677-4557-bd57-89fc862dc220 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] 10.222.0.18 "GET /compute/v2.1/servers/eb38dcff-5703-4735-bf8e-6a40d51d8567" status: 200 len: 1314 microversion: 2.1 time: 0.461415 Oct 22 21:00:31.070852 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1338/2541] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:00:30 2022] GET /compute/v2.1/servers/eb38dcff-5703-4735-bf8e-6a40d51d8567 => generated 1314 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:00:31.267776 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-3dd971cf-f465-40ad-8d1d-b2262b642749 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:00:31.268315 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-3dd971cf-f465-40ad-8d1d-b2262b642749 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] [instance: af11a208-be6e-4f70-85f0-4bafafb4febd] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:00:31.275761 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3dd971cf-f465-40ad-8d1d-b2262b642749 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:31.276631 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3dd971cf-f465-40ad-8d1d-b2262b642749 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:31.277377 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3dd971cf-f465-40ad-8d1d-b2262b642749 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:31.278141 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3dd971cf-f465-40ad-8d1d-b2262b642749 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:31.278604 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3dd971cf-f465-40ad-8d1d-b2262b642749 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:31.279038 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3dd971cf-f465-40ad-8d1d-b2262b642749 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:31.419970 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-1a782218-04a2-4c75-99cb-4306b3e1d5c6 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b9bfe6f6d564d4c9fb1fea439476e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6e01f91c3a845bf8e67e3ad415d9c69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:00:31.429984 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-1a782218-04a2-4c75-99cb-4306b3e1d5c6 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] 10.222.0.18 "GET /compute/v2.1/servers/ee6c092d-1150-415f-8a2e-58f4d3b5c238" status: 200 len: 1318 microversion: 2.1 time: 0.449567 Oct 22 21:00:31.430564 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1204/2542] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:00:30 2022] GET /compute/v2.1/servers/ee6c092d-1150-415f-8a2e-58f4d3b5c238 => generated 1318 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:00:31.443383 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-68cc4913-c03f-4633-bdce-8016a4b2f42d tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:00:31.444820 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-68cc4913-c03f-4633-bdce-8016a4b2f42d tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] [instance: 7dde7a20-b949-4c72-ae19-83f2f0afd0d1] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:00:31.451683 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-68cc4913-c03f-4633-bdce-8016a4b2f42d tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:31.452164 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-68cc4913-c03f-4633-bdce-8016a4b2f42d tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:31.452605 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-68cc4913-c03f-4633-bdce-8016a4b2f42d tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:31.453314 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-68cc4913-c03f-4633-bdce-8016a4b2f42d tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:31.453767 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-68cc4913-c03f-4633-bdce-8016a4b2f42d tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:31.454410 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-68cc4913-c03f-4633-bdce-8016a4b2f42d tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:31.786295 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-3dd971cf-f465-40ad-8d1d-b2262b642749 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a44ff8e7c14b94b1670f030085c43d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a26a2284f4424cbeaf63d504652546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:00:31.798915 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-3dd971cf-f465-40ad-8d1d-b2262b642749 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] 10.222.0.18 "GET /compute/v2.1/servers/af11a208-be6e-4f70-85f0-4bafafb4febd" status: 200 len: 1307 microversion: 2.1 time: 0.535262 Oct 22 21:00:31.801405 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1339/2543] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:00:31 2022] GET /compute/v2.1/servers/af11a208-be6e-4f70-85f0-4bafafb4febd => generated 1307 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:00:31.809394 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-9afb492c-95ac-4f85-900c-6342b1a12e73 tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:00:31.810300 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-9afb492c-95ac-4f85-900c-6342b1a12e73 tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] [instance: ae58d60e-a113-4a38-94b5-b72a19c353e6] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:00:31.820028 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9afb492c-95ac-4f85-900c-6342b1a12e73 tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:31.821681 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9afb492c-95ac-4f85-900c-6342b1a12e73 tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:31.822461 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9afb492c-95ac-4f85-900c-6342b1a12e73 tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:31.823457 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9afb492c-95ac-4f85-900c-6342b1a12e73 tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:31.824112 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9afb492c-95ac-4f85-900c-6342b1a12e73 tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:31.825777 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9afb492c-95ac-4f85-900c-6342b1a12e73 tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:32.593993 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-68cc4913-c03f-4633-bdce-8016a4b2f42d tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d49952dbca4d95a25411b65d56552b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed31e93b0e8a43f28e497f94318815ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:00:32.602984 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-68cc4913-c03f-4633-bdce-8016a4b2f42d tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] 10.222.0.18 "GET /compute/v2.1/servers/7dde7a20-b949-4c72-ae19-83f2f0afd0d1" status: 200 len: 1648 microversion: 2.1 time: 1.170938 Oct 22 21:00:32.615373 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1205/2544] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:00:31 2022] GET /compute/v2.1/servers/7dde7a20-b949-4c72-ae19-83f2f0afd0d1 => generated 1648 bytes in 1184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:00:32.623171 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-db4c9da3-76c4-48d9-a109-dbf476d89090 tempest-ServerDiagnosticsNegativeTest-616658542 tempest-ServerDiagnosticsNegativeTest-616658542-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:00:32.624391 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-db4c9da3-76c4-48d9-a109-dbf476d89090 tempest-ServerDiagnosticsNegativeTest-616658542 tempest-ServerDiagnosticsNegativeTest-616658542-project] [instance: 5e249f40-5d17-49e0-8b86-75f2b4f089c2] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:00:32.637661 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-db4c9da3-76c4-48d9-a109-dbf476d89090 tempest-ServerDiagnosticsNegativeTest-616658542 tempest-ServerDiagnosticsNegativeTest-616658542-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:32.637661 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-db4c9da3-76c4-48d9-a109-dbf476d89090 tempest-ServerDiagnosticsNegativeTest-616658542 tempest-ServerDiagnosticsNegativeTest-616658542-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:32.637661 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-db4c9da3-76c4-48d9-a109-dbf476d89090 tempest-ServerDiagnosticsNegativeTest-616658542 tempest-ServerDiagnosticsNegativeTest-616658542-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:32.638674 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-db4c9da3-76c4-48d9-a109-dbf476d89090 tempest-ServerDiagnosticsNegativeTest-616658542 tempest-ServerDiagnosticsNegativeTest-616658542-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:32.639742 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-db4c9da3-76c4-48d9-a109-dbf476d89090 tempest-ServerDiagnosticsNegativeTest-616658542 tempest-ServerDiagnosticsNegativeTest-616658542-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:32.640144 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-db4c9da3-76c4-48d9-a109-dbf476d89090 tempest-ServerDiagnosticsNegativeTest-616658542 tempest-ServerDiagnosticsNegativeTest-616658542-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:32.803650 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-9afb492c-95ac-4f85-900c-6342b1a12e73 tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e36cd987f04f11b6a41325add4ccac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d79e903f8f24a348d5e771d434c70c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:00:32.817367 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-9afb492c-95ac-4f85-900c-6342b1a12e73 tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] 10.222.0.18 "GET /compute/v2.1/servers/ae58d60e-a113-4a38-94b5-b72a19c353e6" status: 200 len: 1508 microversion: 2.1 time: 1.014540 Oct 22 21:00:32.819620 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1340/2545] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:00:31 2022] GET /compute/v2.1/servers/ae58d60e-a113-4a38-94b5-b72a19c353e6 => generated 1508 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:00:32.835070 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-db4c9da3-76c4-48d9-a109-dbf476d89090 tempest-ServerDiagnosticsNegativeTest-616658542 tempest-ServerDiagnosticsNegativeTest-616658542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42dbc5f3bc042ef935dd95e123bab0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ca06233c6b4e808308cf6613eb8db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:00:32.842545 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-db4c9da3-76c4-48d9-a109-dbf476d89090 tempest-ServerDiagnosticsNegativeTest-616658542 tempest-ServerDiagnosticsNegativeTest-616658542-project] 10.222.0.18 "GET /compute/v2.1/servers/5e249f40-5d17-49e0-8b86-75f2b4f089c2" status: 200 len: 1275 microversion: 2.1 time: 0.225232 Oct 22 21:00:32.843693 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-b93f795f-3325-45a6-b9bc-9631646fa882 req-7aee7da5-b659-4cfb-a58e-50e705ca8860 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb38dcff-5703-4735-bf8e-6a40d51d8567", "tag": "957b60d9-87d1-4cbf-94c8-e20c540767c5"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:00:32.843995 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1206/2546] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:00:32 2022] GET /compute/v2.1/servers/5e249f40-5d17-49e0-8b86-75f2b4f089c2 => generated 1275 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:00:32.856293 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-b93f795f-3325-45a6-b9bc-9631646fa882 req-7aee7da5-b659-4cfb-a58e-50e705ca8860 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:32.857551 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-b93f795f-3325-45a6-b9bc-9631646fa882 req-7aee7da5-b659-4cfb-a58e-50e705ca8860 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:32.858156 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-b93f795f-3325-45a6-b9bc-9631646fa882 req-7aee7da5-b659-4cfb-a58e-50e705ca8860 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:32.863641 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-0d8da089-8aa7-4c7d-b798-f75f8b7c6ce2 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:00:32.864533 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-0d8da089-8aa7-4c7d-b798-f75f8b7c6ce2 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] [instance: eb38dcff-5703-4735-bf8e-6a40d51d8567] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:00:32.873923 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-b93f795f-3325-45a6-b9bc-9631646fa882 req-7aee7da5-b659-4cfb-a58e-50e705ca8860 service nova] Creating event network-changed:957b60d9-87d1-4cbf-94c8-e20c540767c5 for instance eb38dcff-5703-4735-bf8e-6a40d51d8567 on nch2-master-1 Oct 22 21:00:32.874727 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0d8da089-8aa7-4c7d-b798-f75f8b7c6ce2 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:32.875699 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0d8da089-8aa7-4c7d-b798-f75f8b7c6ce2 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:32.876359 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0d8da089-8aa7-4c7d-b798-f75f8b7c6ce2 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:32.877379 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0d8da089-8aa7-4c7d-b798-f75f8b7c6ce2 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:32.878035 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0d8da089-8aa7-4c7d-b798-f75f8b7c6ce2 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:32.878858 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0d8da089-8aa7-4c7d-b798-f75f8b7c6ce2 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:32.881349 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-b93f795f-3325-45a6-b9bc-9631646fa882 req-7aee7da5-b659-4cfb-a58e-50e705ca8860 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043444 Oct 22 21:00:32.882324 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1341/2547] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:00:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:00:32.887693 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-e3629fa1-788c-4611-8d8f-95f5e67ec998 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:00:32.888409 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-e3629fa1-788c-4611-8d8f-95f5e67ec998 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] [instance: ee6c092d-1150-415f-8a2e-58f4d3b5c238] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:00:32.895875 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e3629fa1-788c-4611-8d8f-95f5e67ec998 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:32.896451 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e3629fa1-788c-4611-8d8f-95f5e67ec998 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:32.896968 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e3629fa1-788c-4611-8d8f-95f5e67ec998 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:32.897767 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e3629fa1-788c-4611-8d8f-95f5e67ec998 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:32.898286 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e3629fa1-788c-4611-8d8f-95f5e67ec998 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:32.898786 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e3629fa1-788c-4611-8d8f-95f5e67ec998 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:33.296624 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-0d8da089-8aa7-4c7d-b798-f75f8b7c6ce2 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1b410a64e0415a96d30f5040361137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd7873d6db4e09bc9ab9a048a6b1ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:00:33.309105 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-0d8da089-8aa7-4c7d-b798-f75f8b7c6ce2 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] 10.222.0.18 "GET /compute/v2.1/servers/eb38dcff-5703-4735-bf8e-6a40d51d8567" status: 200 len: 1314 microversion: 2.1 time: 0.463820 Oct 22 21:00:33.327497 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1207/2548] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:00:32 2022] GET /compute/v2.1/servers/eb38dcff-5703-4735-bf8e-6a40d51d8567 => generated 1314 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:00:33.331781 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-e3629fa1-788c-4611-8d8f-95f5e67ec998 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b9bfe6f6d564d4c9fb1fea439476e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6e01f91c3a845bf8e67e3ad415d9c69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:00:33.334089 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-23a85af3-5100-447c-912a-31293835b04b tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:00:33.334711 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-23a85af3-5100-447c-912a-31293835b04b tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] [instance: af11a208-be6e-4f70-85f0-4bafafb4febd] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:00:33.342657 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-e3629fa1-788c-4611-8d8f-95f5e67ec998 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] 10.222.0.18 "GET /compute/v2.1/servers/ee6c092d-1150-415f-8a2e-58f4d3b5c238" status: 200 len: 1318 microversion: 2.1 time: 0.459069 Oct 22 21:00:33.344199 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1342/2549] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:00:32 2022] GET /compute/v2.1/servers/ee6c092d-1150-415f-8a2e-58f4d3b5c238 => generated 1318 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:00:33.350174 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-7f82a70c-8838-4a81-bfc2-b2724b7ada05 req-8117dc7e-42d0-452e-860a-beac2f848c32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae58d60e-a113-4a38-94b5-b72a19c353e6", "name": "network-vif-deleted", "tag": "6bbd4b8b-948d-44a4-8b7f-6968bc1dc2cf"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:00:33.358583 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-23a85af3-5100-447c-912a-31293835b04b tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:33.359105 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-23a85af3-5100-447c-912a-31293835b04b tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:33.359581 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-23a85af3-5100-447c-912a-31293835b04b tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:33.360304 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-23a85af3-5100-447c-912a-31293835b04b tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:33.362459 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-7f82a70c-8838-4a81-bfc2-b2724b7ada05 req-8117dc7e-42d0-452e-860a-beac2f848c32 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:33.363162 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-7f82a70c-8838-4a81-bfc2-b2724b7ada05 req-8117dc7e-42d0-452e-860a-beac2f848c32 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:33.364229 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-7f82a70c-8838-4a81-bfc2-b2724b7ada05 req-8117dc7e-42d0-452e-860a-beac2f848c32 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:33.366599 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-23a85af3-5100-447c-912a-31293835b04b tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:33.367177 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-23a85af3-5100-447c-912a-31293835b04b tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:33.380529 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-7f82a70c-8838-4a81-bfc2-b2724b7ada05 req-8117dc7e-42d0-452e-860a-beac2f848c32 service nova] Creating event network-vif-deleted:6bbd4b8b-948d-44a4-8b7f-6968bc1dc2cf for instance ae58d60e-a113-4a38-94b5-b72a19c353e6 on nch2-master-1 Oct 22 21:00:33.393586 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-7f82a70c-8838-4a81-bfc2-b2724b7ada05 req-8117dc7e-42d0-452e-860a-beac2f848c32 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047951 Oct 22 21:00:33.394880 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1343/2550] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:00:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:00:33.627856 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-b850f310-4118-40fc-baf6-5a795e618cf3 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:00:33.628597 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-b850f310-4118-40fc-baf6-5a795e618cf3 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] [instance: 7dde7a20-b949-4c72-ae19-83f2f0afd0d1] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:00:33.639695 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b850f310-4118-40fc-baf6-5a795e618cf3 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:33.640467 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b850f310-4118-40fc-baf6-5a795e618cf3 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:33.641282 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b850f310-4118-40fc-baf6-5a795e618cf3 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:33.642197 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b850f310-4118-40fc-baf6-5a795e618cf3 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:33.642818 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b850f310-4118-40fc-baf6-5a795e618cf3 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:33.643901 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b850f310-4118-40fc-baf6-5a795e618cf3 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:33.821654 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-23a85af3-5100-447c-912a-31293835b04b tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a44ff8e7c14b94b1670f030085c43d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a26a2284f4424cbeaf63d504652546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:00:33.822191 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-b850f310-4118-40fc-baf6-5a795e618cf3 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d49952dbca4d95a25411b65d56552b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed31e93b0e8a43f28e497f94318815ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:00:33.838331 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-b850f310-4118-40fc-baf6-5a795e618cf3 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] 10.222.0.18 "GET /compute/v2.1/servers/7dde7a20-b949-4c72-ae19-83f2f0afd0d1" status: 200 len: 1468 microversion: 2.1 time: 0.210464 Oct 22 21:00:33.838827 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1344/2551] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:00:33 2022] GET /compute/v2.1/servers/7dde7a20-b949-4c72-ae19-83f2f0afd0d1 => generated 1468 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:00:33.840155 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-23a85af3-5100-447c-912a-31293835b04b tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] 10.222.0.18 "GET /compute/v2.1/servers/af11a208-be6e-4f70-85f0-4bafafb4febd" status: 200 len: 1307 microversion: 2.1 time: 0.511049 Oct 22 21:00:33.841197 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1208/2552] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:00:33 2022] GET /compute/v2.1/servers/af11a208-be6e-4f70-85f0-4bafafb4febd => generated 1307 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:00:33.856086 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-c04a8a38-65a9-4349-98cb-ce6a8c5dcb44 tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:00:33.857019 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-c04a8a38-65a9-4349-98cb-ce6a8c5dcb44 tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] [instance: ae58d60e-a113-4a38-94b5-b72a19c353e6] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:00:33.864161 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c04a8a38-65a9-4349-98cb-ce6a8c5dcb44 tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:33.864651 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c04a8a38-65a9-4349-98cb-ce6a8c5dcb44 tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:33.865156 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c04a8a38-65a9-4349-98cb-ce6a8c5dcb44 tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:33.866061 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c04a8a38-65a9-4349-98cb-ce6a8c5dcb44 tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:33.866188 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-4f4ee307-76ee-4f97-9272-9c4a4ba5b758 tempest-ServerDiagnosticsNegativeTest-616658542 tempest-ServerDiagnosticsNegativeTest-616658542-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:00:33.866518 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c04a8a38-65a9-4349-98cb-ce6a8c5dcb44 tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:33.866678 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-4f4ee307-76ee-4f97-9272-9c4a4ba5b758 tempest-ServerDiagnosticsNegativeTest-616658542 tempest-ServerDiagnosticsNegativeTest-616658542-project] [instance: 5e249f40-5d17-49e0-8b86-75f2b4f089c2] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:00:33.866948 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c04a8a38-65a9-4349-98cb-ce6a8c5dcb44 tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:33.874059 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4f4ee307-76ee-4f97-9272-9c4a4ba5b758 tempest-ServerDiagnosticsNegativeTest-616658542 tempest-ServerDiagnosticsNegativeTest-616658542-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:33.874561 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4f4ee307-76ee-4f97-9272-9c4a4ba5b758 tempest-ServerDiagnosticsNegativeTest-616658542 tempest-ServerDiagnosticsNegativeTest-616658542-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:33.875004 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4f4ee307-76ee-4f97-9272-9c4a4ba5b758 tempest-ServerDiagnosticsNegativeTest-616658542 tempest-ServerDiagnosticsNegativeTest-616658542-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:33.875748 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4f4ee307-76ee-4f97-9272-9c4a4ba5b758 tempest-ServerDiagnosticsNegativeTest-616658542 tempest-ServerDiagnosticsNegativeTest-616658542-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:33.876207 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4f4ee307-76ee-4f97-9272-9c4a4ba5b758 tempest-ServerDiagnosticsNegativeTest-616658542 tempest-ServerDiagnosticsNegativeTest-616658542-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:33.876831 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4f4ee307-76ee-4f97-9272-9c4a4ba5b758 tempest-ServerDiagnosticsNegativeTest-616658542 tempest-ServerDiagnosticsNegativeTest-616658542-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:34.001690 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-4f4ee307-76ee-4f97-9272-9c4a4ba5b758 tempest-ServerDiagnosticsNegativeTest-616658542 tempest-ServerDiagnosticsNegativeTest-616658542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42dbc5f3bc042ef935dd95e123bab0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ca06233c6b4e808308cf6613eb8db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:00:34.008213 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-c04a8a38-65a9-4349-98cb-ce6a8c5dcb44 tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e36cd987f04f11b6a41325add4ccac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d79e903f8f24a348d5e771d434c70c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:00:34.012913 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-4f4ee307-76ee-4f97-9272-9c4a4ba5b758 tempest-ServerDiagnosticsNegativeTest-616658542 tempest-ServerDiagnosticsNegativeTest-616658542-project] 10.222.0.18 "GET /compute/v2.1/servers/5e249f40-5d17-49e0-8b86-75f2b4f089c2" status: 200 len: 1275 microversion: 2.1 time: 0.150495 Oct 22 21:00:34.020909 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-c04a8a38-65a9-4349-98cb-ce6a8c5dcb44 tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] 10.222.0.18 "GET /compute/v2.1/servers/ae58d60e-a113-4a38-94b5-b72a19c353e6" status: 200 len: 1293 microversion: 2.1 time: 0.180473 Oct 22 21:00:34.021929 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1345/2553] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:00:33 2022] GET /compute/v2.1/servers/ae58d60e-a113-4a38-94b5-b72a19c353e6 => generated 1293 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:00:34.023950 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1209/2554] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:00:33 2022] GET /compute/v2.1/servers/5e249f40-5d17-49e0-8b86-75f2b4f089c2 => generated 1275 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:00:34.344342 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-d2b7ee56-b175-4061-b426-f0c032217153 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:00:34.351486 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-d2b7ee56-b175-4061-b426-f0c032217153 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] [instance: eb38dcff-5703-4735-bf8e-6a40d51d8567] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:00:34.364209 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d2b7ee56-b175-4061-b426-f0c032217153 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:34.377543 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-2c9d1b82-1e3a-467a-8876-1f0fd5f789cf tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:00:34.378833 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-2c9d1b82-1e3a-467a-8876-1f0fd5f789cf tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] [instance: ee6c092d-1150-415f-8a2e-58f4d3b5c238] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:00:34.385394 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d2b7ee56-b175-4061-b426-f0c032217153 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:34.387630 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d2b7ee56-b175-4061-b426-f0c032217153 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:34.392139 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d2b7ee56-b175-4061-b426-f0c032217153 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:34.393712 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d2b7ee56-b175-4061-b426-f0c032217153 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:34.400760 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d2b7ee56-b175-4061-b426-f0c032217153 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:34.403626 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2c9d1b82-1e3a-467a-8876-1f0fd5f789cf tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:34.406820 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2c9d1b82-1e3a-467a-8876-1f0fd5f789cf tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:34.408951 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2c9d1b82-1e3a-467a-8876-1f0fd5f789cf tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:34.410829 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2c9d1b82-1e3a-467a-8876-1f0fd5f789cf tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:34.412532 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2c9d1b82-1e3a-467a-8876-1f0fd5f789cf tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:34.413044 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2c9d1b82-1e3a-467a-8876-1f0fd5f789cf tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:35.051566 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-2c9d1b82-1e3a-467a-8876-1f0fd5f789cf tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b9bfe6f6d564d4c9fb1fea439476e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6e01f91c3a845bf8e67e3ad415d9c69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:00:35.062274 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-2c9d1b82-1e3a-467a-8876-1f0fd5f789cf tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] 10.222.0.18 "GET /compute/v2.1/servers/ee6c092d-1150-415f-8a2e-58f4d3b5c238" status: 200 len: 1467 microversion: 2.1 time: 0.693529 Oct 22 21:00:35.064777 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1210/2555] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:00:34 2022] GET /compute/v2.1/servers/ee6c092d-1150-415f-8a2e-58f4d3b5c238 => generated 1467 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:00:35.070036 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-4d341571-9919-4dd1-8473-b2be85644c92 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:00:35.070990 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-4d341571-9919-4dd1-8473-b2be85644c92 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] [instance: 7dde7a20-b949-4c72-ae19-83f2f0afd0d1] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:00:35.079288 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4d341571-9919-4dd1-8473-b2be85644c92 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:35.081377 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4d341571-9919-4dd1-8473-b2be85644c92 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:35.082263 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4d341571-9919-4dd1-8473-b2be85644c92 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:35.083318 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4d341571-9919-4dd1-8473-b2be85644c92 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:35.084057 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4d341571-9919-4dd1-8473-b2be85644c92 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:35.085433 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4d341571-9919-4dd1-8473-b2be85644c92 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:35.122614 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-d2b7ee56-b175-4061-b426-f0c032217153 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1b410a64e0415a96d30f5040361137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd7873d6db4e09bc9ab9a048a6b1ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:00:35.137114 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-d2b7ee56-b175-4061-b426-f0c032217153 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] 10.222.0.18 "GET /compute/v2.1/servers/eb38dcff-5703-4735-bf8e-6a40d51d8567" status: 200 len: 1314 microversion: 2.1 time: 0.799911 Oct 22 21:00:35.143909 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1346/2556] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:00:34 2022] GET /compute/v2.1/servers/eb38dcff-5703-4735-bf8e-6a40d51d8567 => generated 1314 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:00:35.153688 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-4f5114c4-42cb-46ad-b030-b571e04de0a9 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:00:35.155437 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-4f5114c4-42cb-46ad-b030-b571e04de0a9 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] [instance: af11a208-be6e-4f70-85f0-4bafafb4febd] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:00:35.177414 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4d341571-9919-4dd1-8473-b2be85644c92 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:35.177971 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4d341571-9919-4dd1-8473-b2be85644c92 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:35.178423 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4d341571-9919-4dd1-8473-b2be85644c92 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:35.183187 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.objects.instance [None req-4d341571-9919-4dd1-8473-b2be85644c92 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Lazy-loading 'fault' on Instance uuid 7dde7a20-b949-4c72-ae19-83f2f0afd0d1 {{(pid=138744) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 21:00:35.203619 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4f5114c4-42cb-46ad-b030-b571e04de0a9 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:35.205984 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4f5114c4-42cb-46ad-b030-b571e04de0a9 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:35.206550 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4f5114c4-42cb-46ad-b030-b571e04de0a9 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:35.209463 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4f5114c4-42cb-46ad-b030-b571e04de0a9 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:35.214173 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4f5114c4-42cb-46ad-b030-b571e04de0a9 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:35.215543 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4f5114c4-42cb-46ad-b030-b571e04de0a9 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:35.230534 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell1:SELECT=100 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:00:35.321081 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-4d341571-9919-4dd1-8473-b2be85644c92 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d49952dbca4d95a25411b65d56552b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed31e93b0e8a43f28e497f94318815ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:00:35.337827 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-4d341571-9919-4dd1-8473-b2be85644c92 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] 10.222.0.18 "GET /compute/v2.1/servers/7dde7a20-b949-4c72-ae19-83f2f0afd0d1" status: 200 len: 1473 microversion: 2.1 time: 0.271702 Oct 22 21:00:35.340612 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1211/2557] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:00:35 2022] GET /compute/v2.1/servers/7dde7a20-b949-4c72-ae19-83f2f0afd0d1 => generated 1473 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:00:35.357731 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-b099809f-bbdd-4dc2-9bc9-28f38705df88 req-c7f57df8-9caf-4e75-8d88-7cf5424444c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7dde7a20-b949-4c72-ae19-83f2f0afd0d1", "name": "network-vif-deleted", "tag": "e4d75169-7798-4abd-957f-2abc3db1143a"}, {"name": "network-changed", "server_uuid": "f38f14b2-b9d7-4bed-92ba-7b95ea4b2270", "tag": "e8b58979-b36e-4d6b-8fde-739fbeb99ab8"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:00:35.411406 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-b099809f-bbdd-4dc2-9bc9-28f38705df88 req-c7f57df8-9caf-4e75-8d88-7cf5424444c6 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:35.415949 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-b099809f-bbdd-4dc2-9bc9-28f38705df88 req-c7f57df8-9caf-4e75-8d88-7cf5424444c6 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:35.419316 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-b099809f-bbdd-4dc2-9bc9-28f38705df88 req-c7f57df8-9caf-4e75-8d88-7cf5424444c6 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:35.450153 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-b099809f-bbdd-4dc2-9bc9-28f38705df88 req-c7f57df8-9caf-4e75-8d88-7cf5424444c6 service nova] Creating event network-vif-deleted:e4d75169-7798-4abd-957f-2abc3db1143a for instance 7dde7a20-b949-4c72-ae19-83f2f0afd0d1 on nch1-master-1 Oct 22 21:00:35.458538 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-b099809f-bbdd-4dc2-9bc9-28f38705df88 req-c7f57df8-9caf-4e75-8d88-7cf5424444c6 service nova] Creating event network-changed:e8b58979-b36e-4d6b-8fde-739fbeb99ab8 for instance f38f14b2-b9d7-4bed-92ba-7b95ea4b2270 on nch2-master-1 Oct 22 21:00:35.493914 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-b099809f-bbdd-4dc2-9bc9-28f38705df88 req-c7f57df8-9caf-4e75-8d88-7cf5424444c6 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.151664 Oct 22 21:00:35.496091 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1212/2558] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:00:35 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:00:35.517918 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-5f4f7c8a-5d64-463a-bb5d-d878e2ccd4df tempest-ServerDiagnosticsNegativeTest-616658542 tempest-ServerDiagnosticsNegativeTest-616658542-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:00:35.518641 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-5f4f7c8a-5d64-463a-bb5d-d878e2ccd4df tempest-ServerDiagnosticsNegativeTest-616658542 tempest-ServerDiagnosticsNegativeTest-616658542-project] [instance: 5e249f40-5d17-49e0-8b86-75f2b4f089c2] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:00:35.525464 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5f4f7c8a-5d64-463a-bb5d-d878e2ccd4df tempest-ServerDiagnosticsNegativeTest-616658542 tempest-ServerDiagnosticsNegativeTest-616658542-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:35.526243 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5f4f7c8a-5d64-463a-bb5d-d878e2ccd4df tempest-ServerDiagnosticsNegativeTest-616658542 tempest-ServerDiagnosticsNegativeTest-616658542-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:35.526870 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5f4f7c8a-5d64-463a-bb5d-d878e2ccd4df tempest-ServerDiagnosticsNegativeTest-616658542 tempest-ServerDiagnosticsNegativeTest-616658542-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:35.528006 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5f4f7c8a-5d64-463a-bb5d-d878e2ccd4df tempest-ServerDiagnosticsNegativeTest-616658542 tempest-ServerDiagnosticsNegativeTest-616658542-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:35.528655 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5f4f7c8a-5d64-463a-bb5d-d878e2ccd4df tempest-ServerDiagnosticsNegativeTest-616658542 tempest-ServerDiagnosticsNegativeTest-616658542-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:35.529243 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5f4f7c8a-5d64-463a-bb5d-d878e2ccd4df tempest-ServerDiagnosticsNegativeTest-616658542 tempest-ServerDiagnosticsNegativeTest-616658542-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:35.547827 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:00:35.694513 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-5f4f7c8a-5d64-463a-bb5d-d878e2ccd4df tempest-ServerDiagnosticsNegativeTest-616658542 tempest-ServerDiagnosticsNegativeTest-616658542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42dbc5f3bc042ef935dd95e123bab0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ca06233c6b4e808308cf6613eb8db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:00:35.703481 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-5f4f7c8a-5d64-463a-bb5d-d878e2ccd4df tempest-ServerDiagnosticsNegativeTest-616658542 tempest-ServerDiagnosticsNegativeTest-616658542-project] 10.222.0.18 "GET /compute/v2.1/servers/5e249f40-5d17-49e0-8b86-75f2b4f089c2" status: 200 len: 1281 microversion: 2.1 time: 0.205496 Oct 22 21:00:35.704493 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1213/2559] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:00:35 2022] GET /compute/v2.1/servers/5e249f40-5d17-49e0-8b86-75f2b4f089c2 => generated 1281 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:00:35.726712 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-308e521a-a12d-4c81-81ad-df6a57b7b9f2 tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:00:35.727985 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-308e521a-a12d-4c81-81ad-df6a57b7b9f2 tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] [instance: ae58d60e-a113-4a38-94b5-b72a19c353e6] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:00:35.734936 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-308e521a-a12d-4c81-81ad-df6a57b7b9f2 tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:35.735813 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-308e521a-a12d-4c81-81ad-df6a57b7b9f2 tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:35.736787 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-308e521a-a12d-4c81-81ad-df6a57b7b9f2 tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:35.737725 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-308e521a-a12d-4c81-81ad-df6a57b7b9f2 tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:35.738381 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-308e521a-a12d-4c81-81ad-df6a57b7b9f2 tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:35.739030 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-308e521a-a12d-4c81-81ad-df6a57b7b9f2 tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:35.756026 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-308e521a-a12d-4c81-81ad-df6a57b7b9f2 tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] HTTP exception thrown: Instance ae58d60e-a113-4a38-94b5-b72a19c353e6 could not be found. Oct 22 21:00:35.758708 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-308e521a-a12d-4c81-81ad-df6a57b7b9f2 tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Request method failure captured: Oct 22 21:00:35.758708 ncdv-master-1 devstack@n-api.service[138744]: request: GET /compute/v2.1/servers/ae58d60e-a113-4a38-94b5-b72a19c353e6 HTTP/1.1 Oct 22 21:00:35.758708 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 21:00:35.758708 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 21:00:35.758708 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 21:00:35.758708 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 0 Oct 22 21:00:35.758708 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 21:00:35.758708 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 21:00:35.758708 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 21:00:35.758708 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 21:00:35.758708 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVFmUxs702lHXMKZHKtZ4YTQEnQ1yZWEN2vZV50gQ4-xXMFULw2UpvrJeSUjh1A75_JrDLWTM4DCC8OC-S5dC9iEOlumqIcHs0CIie4sysN4JDSRUDbuwhRkz456B2Ux1fXadBUtZdK1zDlUXtOmcyqN61suRtLpAcGQhix0ncXAqCF0 Oct 22 21:00:35.758708 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 21:00:35.758708 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 21:00:35.758708 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 21:00:35.758708 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 21:00:35.758708 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 21:00:35.758708 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 21:00:35.758708 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: 2d79e903f8f24a348d5e771d434c70c3 Oct 22 21:00:35.758708 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-ServerRescueTestJSONUnderV235-181636764 Oct 22 21:00:35.758708 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 21:00:35.758708 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 21:00:35.758708 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_2d79e903f8f24a348d5e771d434c70c3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2d79e903f8f24a348d5e771d434c70c3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/2d79e903f8f24a348d5e771d434c70c3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2d79e903f8f24a348d5e771d434c70c3"}]}] Oct 22 21:00:35.758708 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-ServerRescueTestJSONUnderV235-181636764 Oct 22 21:00:35.758708 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: 2d79e903f8f24a348d5e771d434c70c3 Oct 22 21:00:35.758708 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-ServerRescueTestJSONUnderV235-181636764 Oct 22 21:00:35.758708 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-ServerRescueTestJSONUnderV235-181636764-project Oct 22 21:00:35.758708 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 21:00:35.758708 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 21:00:35.758708 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: c8e36cd987f04f11b6a41325add4ccac Oct 22 21:00:35.758708 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-ServerRescueTestJSONUnderV235-181636764-project Oct 22 21:00:35.758708 ncdv-master-1 devstack@n-api.service[138744]: method: > Oct 22 21:00:35.758708 ncdv-master-1 devstack@n-api.service[138744]: exception: Instance ae58d60e-a113-4a38-94b5-b72a19c353e6 could not be found. Oct 22 21:00:35.758708 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': 'ae58d60e-a113-4a38-94b5-b72a19c353e6'} Oct 22 21:00:35.758708 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:00:35.758708 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:00:35.758708 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 21:00:35.758708 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 21:00:35.758708 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 21:00:35.758708 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 21:00:35.758708 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 21:00:35.758708 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 21:00:35.758708 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 21:00:35.758708 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 21:00:35.758708 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ae58d60e-a113-4a38-94b5-b72a19c353e6 could not be found. Oct 22 21:00:35.758708 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:00:35.758708 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:00:35.758708 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:00:35.758708 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:00:35.758708 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:00:35.758708 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:00:35.758708 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:00:35.758708 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:00:35.758708 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:00:35.758708 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:00:35.758708 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 21:00:35.758708 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 21:00:35.758708 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 21:00:35.758708 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 21:00:35.758708 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 21:00:35.758708 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:00:35.758708 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ae58d60e-a113-4a38-94b5-b72a19c353e6 could not be found. Oct 22 21:00:35.758708 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:00:35.758708 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:00:35.764249 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:00:35.764249 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:00:35.764249 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:00:35.764249 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:00:35.764249 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:00:35.764249 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:00:35.764249 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ae58d60e-a113-4a38-94b5-b72a19c353e6 could not be found. Oct 22 21:00:35.764249 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:00:35.764249 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-308e521a-a12d-4c81-81ad-df6a57b7b9f2 tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] Returning 404 to user: Instance ae58d60e-a113-4a38-94b5-b72a19c353e6 could not be found. {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:00:35.764249 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-308e521a-a12d-4c81-81ad-df6a57b7b9f2 tempest-ServerRescueTestJSONUnderV235-181636764 tempest-ServerRescueTestJSONUnderV235-181636764-project] 10.222.0.18 "GET /compute/v2.1/servers/ae58d60e-a113-4a38-94b5-b72a19c353e6" status: 404 len: 111 microversion: 2.1 time: 0.043025 Oct 22 21:00:35.764249 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1214/2560] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:00:35 2022] GET /compute/v2.1/servers/ae58d60e-a113-4a38-94b5-b72a19c353e6 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 21:00:35.770858 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-17313c4c-e5b6-44dc-bfba-7fdf7fb0fbd1 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:00:35.771758 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-17313c4c-e5b6-44dc-bfba-7fdf7fb0fbd1 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] [instance: 70f4c178-630e-4050-8aad-4c60bec30bcd] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:00:35.778508 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-17313c4c-e5b6-44dc-bfba-7fdf7fb0fbd1 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:35.779111 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-17313c4c-e5b6-44dc-bfba-7fdf7fb0fbd1 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:35.779775 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-17313c4c-e5b6-44dc-bfba-7fdf7fb0fbd1 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:35.780743 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-17313c4c-e5b6-44dc-bfba-7fdf7fb0fbd1 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:35.781433 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-17313c4c-e5b6-44dc-bfba-7fdf7fb0fbd1 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:35.782091 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-17313c4c-e5b6-44dc-bfba-7fdf7fb0fbd1 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:35.808615 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-4f5114c4-42cb-46ad-b030-b571e04de0a9 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a44ff8e7c14b94b1670f030085c43d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a26a2284f4424cbeaf63d504652546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:00:35.823198 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-4f5114c4-42cb-46ad-b030-b571e04de0a9 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] 10.222.0.18 "GET /compute/v2.1/servers/af11a208-be6e-4f70-85f0-4bafafb4febd" status: 200 len: 1307 microversion: 2.1 time: 0.677831 Oct 22 21:00:35.823972 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1347/2561] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:00:35 2022] GET /compute/v2.1/servers/af11a208-be6e-4f70-85f0-4bafafb4febd => generated 1307 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:00:36.177331 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-834d001b-c069-432d-b4dc-37f74851a16b tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:00:36.181793 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-834d001b-c069-432d-b4dc-37f74851a16b tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] [instance: eb38dcff-5703-4735-bf8e-6a40d51d8567] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:00:36.194409 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-834d001b-c069-432d-b4dc-37f74851a16b tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:36.195168 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-834d001b-c069-432d-b4dc-37f74851a16b tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:36.195914 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-834d001b-c069-432d-b4dc-37f74851a16b tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:36.197619 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-834d001b-c069-432d-b4dc-37f74851a16b tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:36.198319 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-834d001b-c069-432d-b4dc-37f74851a16b tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:36.199014 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-834d001b-c069-432d-b4dc-37f74851a16b tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:37.122618 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-834d001b-c069-432d-b4dc-37f74851a16b tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1b410a64e0415a96d30f5040361137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd7873d6db4e09bc9ab9a048a6b1ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:00:37.125701 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-17313c4c-e5b6-44dc-bfba-7fdf7fb0fbd1 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b9bfe6f6d564d4c9fb1fea439476e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6e01f91c3a845bf8e67e3ad415d9c69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:00:37.132341 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-834d001b-c069-432d-b4dc-37f74851a16b tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] 10.222.0.18 "GET /compute/v2.1/servers/eb38dcff-5703-4735-bf8e-6a40d51d8567" status: 200 len: 1314 microversion: 2.1 time: 0.965143 Oct 22 21:00:37.151592 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1348/2562] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:00:36 2022] GET /compute/v2.1/servers/eb38dcff-5703-4735-bf8e-6a40d51d8567 => generated 1314 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:00:37.151982 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-17313c4c-e5b6-44dc-bfba-7fdf7fb0fbd1 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] 10.222.0.18 "GET /compute/v2.1/servers/70f4c178-630e-4050-8aad-4c60bec30bcd" status: 200 len: 1468 microversion: 2.1 time: 1.389543 Oct 22 21:00:37.153355 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1215/2563] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:00:35 2022] GET /compute/v2.1/servers/70f4c178-630e-4050-8aad-4c60bec30bcd => generated 1468 bytes in 1392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:00:37.158454 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-3ec079b0-a23b-447c-b0ea-2ee4eae2520e tempest-ServerDiagnosticsNegativeTest-616658542 tempest-ServerDiagnosticsNegativeTest-616658542-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:00:37.160965 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-3ec079b0-a23b-447c-b0ea-2ee4eae2520e tempest-ServerDiagnosticsNegativeTest-616658542 tempest-ServerDiagnosticsNegativeTest-616658542-project] [instance: 5e249f40-5d17-49e0-8b86-75f2b4f089c2] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:00:37.167695 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3ec079b0-a23b-447c-b0ea-2ee4eae2520e tempest-ServerDiagnosticsNegativeTest-616658542 tempest-ServerDiagnosticsNegativeTest-616658542-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:37.168503 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3ec079b0-a23b-447c-b0ea-2ee4eae2520e tempest-ServerDiagnosticsNegativeTest-616658542 tempest-ServerDiagnosticsNegativeTest-616658542-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:37.169603 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3ec079b0-a23b-447c-b0ea-2ee4eae2520e tempest-ServerDiagnosticsNegativeTest-616658542 tempest-ServerDiagnosticsNegativeTest-616658542-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:37.170573 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3ec079b0-a23b-447c-b0ea-2ee4eae2520e tempest-ServerDiagnosticsNegativeTest-616658542 tempest-ServerDiagnosticsNegativeTest-616658542-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:37.171303 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3ec079b0-a23b-447c-b0ea-2ee4eae2520e tempest-ServerDiagnosticsNegativeTest-616658542 tempest-ServerDiagnosticsNegativeTest-616658542-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:37.171963 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3ec079b0-a23b-447c-b0ea-2ee4eae2520e tempest-ServerDiagnosticsNegativeTest-616658542 tempest-ServerDiagnosticsNegativeTest-616658542-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:37.174753 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-bf578077-a8aa-4322-8a4a-ba108c082d75 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:00:37.175615 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-bf578077-a8aa-4322-8a4a-ba108c082d75 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] [instance: 7dde7a20-b949-4c72-ae19-83f2f0afd0d1] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:00:37.182541 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bf578077-a8aa-4322-8a4a-ba108c082d75 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:37.183816 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bf578077-a8aa-4322-8a4a-ba108c082d75 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:37.184440 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bf578077-a8aa-4322-8a4a-ba108c082d75 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:37.185324 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bf578077-a8aa-4322-8a4a-ba108c082d75 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:37.185921 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bf578077-a8aa-4322-8a4a-ba108c082d75 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:37.186550 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bf578077-a8aa-4322-8a4a-ba108c082d75 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:37.201709 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.wsgi [None req-bf578077-a8aa-4322-8a4a-ba108c082d75 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] HTTP exception thrown: Instance 7dde7a20-b949-4c72-ae19-83f2f0afd0d1 could not be found. Oct 22 21:00:37.203706 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-bf578077-a8aa-4322-8a4a-ba108c082d75 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Request method failure captured: Oct 22 21:00:37.203706 ncdv-master-1 devstack@n-api.service[138745]: request: GET /compute/v2.1/servers/7dde7a20-b949-4c72-ae19-83f2f0afd0d1 HTTP/1.1 Oct 22 21:00:37.203706 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 21:00:37.203706 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 21:00:37.203706 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 21:00:37.203706 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 0 Oct 22 21:00:37.203706 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 21:00:37.203706 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 21:00:37.203706 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 21:00:37.203706 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 21:00:37.203706 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVFmMTFo8tMXHI466ygTiy0jTs5kz8YO2nFuimSyZRJI5bXNUfHpPLWjQrXyJ7I9Xfc54HQRfYflULj68lfwBk5jrnjY79oZ1kbdK55vumR_IVvMJmaykrPjWliG3H4xf-SZHnU3invPEATeZO7VP5aTca0hd9BauSvYCW1UPdVAZZ70 Oct 22 21:00:37.203706 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 21:00:37.203706 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 21:00:37.203706 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 21:00:37.203706 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 21:00:37.203706 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 21:00:37.203706 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 21:00:37.203706 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: ed31e93b0e8a43f28e497f94318815ce Oct 22 21:00:37.203706 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-SecurityGroupsTestJSON-1604956559 Oct 22 21:00:37.203706 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 21:00:37.203706 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 21:00:37.203706 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ed31e93b0e8a43f28e497f94318815ce"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ed31e93b0e8a43f28e497f94318815ce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ed31e93b0e8a43f28e497f94318815ce"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ed31e93b0e8a43f28e497f94318815ce"}]}] Oct 22 21:00:37.203706 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-SecurityGroupsTestJSON-1604956559 Oct 22 21:00:37.203706 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: ed31e93b0e8a43f28e497f94318815ce Oct 22 21:00:37.203706 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1604956559 Oct 22 21:00:37.203706 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-SecurityGroupsTestJSON-1604956559-project Oct 22 21:00:37.203706 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 21:00:37.203706 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 21:00:37.203706 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: 46d49952dbca4d95a25411b65d56552b Oct 22 21:00:37.203706 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-SecurityGroupsTestJSON-1604956559-project Oct 22 21:00:37.203706 ncdv-master-1 devstack@n-api.service[138745]: method: > Oct 22 21:00:37.203706 ncdv-master-1 devstack@n-api.service[138745]: exception: Instance 7dde7a20-b949-4c72-ae19-83f2f0afd0d1 could not be found. Oct 22 21:00:37.203706 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'id': '7dde7a20-b949-4c72-ae19-83f2f0afd0d1'} Oct 22 21:00:37.203706 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:00:37.203706 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:00:37.203706 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 21:00:37.203706 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 21:00:37.203706 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 21:00:37.203706 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 21:00:37.203706 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 21:00:37.203706 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 21:00:37.203706 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 21:00:37.203706 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 21:00:37.203706 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7dde7a20-b949-4c72-ae19-83f2f0afd0d1 could not be found. Oct 22 21:00:37.203706 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:00:37.203706 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:00:37.203706 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:00:37.203706 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:00:37.203706 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:00:37.203706 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:00:37.203706 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:00:37.203706 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:00:37.203706 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:00:37.203706 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:00:37.203706 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 21:00:37.203706 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 21:00:37.203706 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 21:00:37.203706 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 21:00:37.203706 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 21:00:37.203706 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:00:37.203706 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7dde7a20-b949-4c72-ae19-83f2f0afd0d1 could not be found. Oct 22 21:00:37.203706 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:00:37.203706 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:00:37.203706 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:00:37.208382 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:00:37.208382 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:00:37.208382 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:00:37.208382 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:00:37.208382 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:00:37.208382 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7dde7a20-b949-4c72-ae19-83f2f0afd0d1 could not be found. Oct 22 21:00:37.208382 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:00:37.209577 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-bf578077-a8aa-4322-8a4a-ba108c082d75 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Returning 404 to user: Instance 7dde7a20-b949-4c72-ae19-83f2f0afd0d1 could not be found. {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:00:37.210609 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-bf578077-a8aa-4322-8a4a-ba108c082d75 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] 10.222.0.18 "GET /compute/v2.1/servers/7dde7a20-b949-4c72-ae19-83f2f0afd0d1" status: 404 len: 111 microversion: 2.1 time: 0.050560 Oct 22 21:00:37.214756 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1349/2564] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:00:37 2022] GET /compute/v2.1/servers/7dde7a20-b949-4c72-ae19-83f2f0afd0d1 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 21:00:37.219840 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-1b970a7d-68b4-4bf1-a9a6-0a9e7c9672e3 req-40db4311-7c3a-411f-95ec-0bdab7f191bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb38dcff-5703-4735-bf8e-6a40d51d8567", "name": "network-vif-plugged", "status": "completed", "tag": "957b60d9-87d1-4cbf-94c8-e20c540767c5"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:00:37.230678 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-1b970a7d-68b4-4bf1-a9a6-0a9e7c9672e3 req-40db4311-7c3a-411f-95ec-0bdab7f191bb service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:37.231204 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-1b970a7d-68b4-4bf1-a9a6-0a9e7c9672e3 req-40db4311-7c3a-411f-95ec-0bdab7f191bb service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:37.231962 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-1b970a7d-68b4-4bf1-a9a6-0a9e7c9672e3 req-40db4311-7c3a-411f-95ec-0bdab7f191bb service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:37.245079 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-1b970a7d-68b4-4bf1-a9a6-0a9e7c9672e3 req-40db4311-7c3a-411f-95ec-0bdab7f191bb service nova] Creating event network-vif-plugged:957b60d9-87d1-4cbf-94c8-e20c540767c5 for instance eb38dcff-5703-4735-bf8e-6a40d51d8567 on nch2-master-1 Oct 22 21:00:37.250412 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-1b970a7d-68b4-4bf1-a9a6-0a9e7c9672e3 req-40db4311-7c3a-411f-95ec-0bdab7f191bb service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034155 Oct 22 21:00:37.251783 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1350/2565] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:00:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:00:37.257587 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-a623f023-034a-46c2-96e5-98a42eda53d5 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:00:37.258298 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-a623f023-034a-46c2-96e5-98a42eda53d5 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] [instance: af11a208-be6e-4f70-85f0-4bafafb4febd] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:00:37.265042 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a623f023-034a-46c2-96e5-98a42eda53d5 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:37.265785 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a623f023-034a-46c2-96e5-98a42eda53d5 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:37.266448 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a623f023-034a-46c2-96e5-98a42eda53d5 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:37.267384 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a623f023-034a-46c2-96e5-98a42eda53d5 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:37.268020 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a623f023-034a-46c2-96e5-98a42eda53d5 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:37.268632 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a623f023-034a-46c2-96e5-98a42eda53d5 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:37.574072 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-3ec079b0-a23b-447c-b0ea-2ee4eae2520e tempest-ServerDiagnosticsNegativeTest-616658542 tempest-ServerDiagnosticsNegativeTest-616658542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42dbc5f3bc042ef935dd95e123bab0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ca06233c6b4e808308cf6613eb8db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:00:37.583739 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-3ec079b0-a23b-447c-b0ea-2ee4eae2520e tempest-ServerDiagnosticsNegativeTest-616658542 tempest-ServerDiagnosticsNegativeTest-616658542-project] 10.222.0.18 "GET /compute/v2.1/servers/5e249f40-5d17-49e0-8b86-75f2b4f089c2" status: 200 len: 1323 microversion: 2.1 time: 0.428910 Oct 22 21:00:37.584330 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1216/2566] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:00:37 2022] GET /compute/v2.1/servers/5e249f40-5d17-49e0-8b86-75f2b4f089c2 => generated 1323 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:00:37.590511 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-5222f775-199f-4c2a-9e94-de10ce3ba726 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1828385226"}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:00:37.593456 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-5222f775-199f-4c2a-9e94-de10ce3ba726 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] [instance: 70f4c178-630e-4050-8aad-4c60bec30bcd] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:00:37.609312 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5222f775-199f-4c2a-9e94-de10ce3ba726 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:37.610679 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5222f775-199f-4c2a-9e94-de10ce3ba726 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:37.611443 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5222f775-199f-4c2a-9e94-de10ce3ba726 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:37.611722 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5222f775-199f-4c2a-9e94-de10ce3ba726 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:37.613118 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5222f775-199f-4c2a-9e94-de10ce3ba726 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:37.614543 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5222f775-199f-4c2a-9e94-de10ce3ba726 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:37.682611 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-a623f023-034a-46c2-96e5-98a42eda53d5 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a44ff8e7c14b94b1670f030085c43d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a26a2284f4424cbeaf63d504652546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:00:37.693958 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-a623f023-034a-46c2-96e5-98a42eda53d5 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] 10.222.0.18 "GET /compute/v2.1/servers/af11a208-be6e-4f70-85f0-4bafafb4febd" status: 200 len: 1307 microversion: 2.1 time: 0.440552 Oct 22 21:00:37.694550 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1351/2567] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:00:37 2022] GET /compute/v2.1/servers/af11a208-be6e-4f70-85f0-4bafafb4febd => generated 1307 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:00:37.699034 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-83ddd491-dc2e-43e6-ade9-f89a87349558 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Calling method '.version_select at 0x7fd3a44e9430>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:00:37.879725 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-5222f775-199f-4c2a-9e94-de10ce3ba726 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] 10.222.0.18 "POST /compute/v2.1/servers/70f4c178-630e-4050-8aad-4c60bec30bcd/action" status: 202 len: 0 microversion: 2.1 time: 0.293766 Oct 22 21:00:37.881211 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1217/2568] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 21:00:37 2022] POST /compute/v2.1/servers/70f4c178-630e-4050-8aad-4c60bec30bcd/action => generated 0 bytes in 296 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 22 21:00:37.886763 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-14b13081-225e-4030-916b-9155b17f8b3d req-87df0d86-1a14-46ff-9956-d15b60b3531b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e249f40-5d17-49e0-8b86-75f2b4f089c2", "tag": "7a75caf1-7002-4fb3-a44f-b64953426958"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:00:37.900600 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-14b13081-225e-4030-916b-9155b17f8b3d req-87df0d86-1a14-46ff-9956-d15b60b3531b service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:37.902447 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-14b13081-225e-4030-916b-9155b17f8b3d req-87df0d86-1a14-46ff-9956-d15b60b3531b service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:37.903194 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-14b13081-225e-4030-916b-9155b17f8b3d req-87df0d86-1a14-46ff-9956-d15b60b3531b service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:37.931397 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-14b13081-225e-4030-916b-9155b17f8b3d req-87df0d86-1a14-46ff-9956-d15b60b3531b service nova] Creating event network-changed:7a75caf1-7002-4fb3-a44f-b64953426958 for instance 5e249f40-5d17-49e0-8b86-75f2b4f089c2 on nch1-master-1 Oct 22 21:00:37.945499 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-14b13081-225e-4030-916b-9155b17f8b3d req-87df0d86-1a14-46ff-9956-d15b60b3531b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061940 Oct 22 21:00:37.948118 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1218/2569] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:00:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:00:37.967636 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-8fd8fd02-fc98-4f3b-a19a-2536725a4fad tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Calling method '.version_select at 0x7fd39f1ea550>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:00:38.028980 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-8fd8fd02-fc98-4f3b-a19a-2536725a4fad tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] 10.222.0.18 "GET /compute/v2.1/images/8368f750-e203-4ef8-b979-ba7ef86a0df0" status: 200 len: 1455 microversion: 2.1 time: 0.077512 Oct 22 21:00:38.030105 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1219/2570] 10.222.0.18 () {58 vars in 1233 bytes} [Sat Oct 22 21:00:37 2022] GET /compute/v2.1/images/8368f750-e203-4ef8-b979-ba7ef86a0df0 => generated 1455 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:00:38.157642 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-bd07dcca-c1aa-43f4-b489-7ebb28a60da3 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:00:38.158382 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-bd07dcca-c1aa-43f4-b489-7ebb28a60da3 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] [instance: eb38dcff-5703-4735-bf8e-6a40d51d8567] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:00:38.165724 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bd07dcca-c1aa-43f4-b489-7ebb28a60da3 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:38.167112 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bd07dcca-c1aa-43f4-b489-7ebb28a60da3 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:38.167773 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bd07dcca-c1aa-43f4-b489-7ebb28a60da3 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:38.168692 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bd07dcca-c1aa-43f4-b489-7ebb28a60da3 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:38.169305 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bd07dcca-c1aa-43f4-b489-7ebb28a60da3 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:38.169922 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bd07dcca-c1aa-43f4-b489-7ebb28a60da3 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:38.430846 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-83ddd491-dc2e-43e6-ade9-f89a87349558 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/27359005-91d1-4f2b-b9af-2f79910cd4a2" status: 202 len: 0 microversion: 2.1 time: 0.735136 Oct 22 21:00:38.431430 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1352/2571] 10.222.0.18 () {58 vars in 1272 bytes} [Sat Oct 22 21:00:37 2022] DELETE /compute/v2.1/os-security-groups/27359005-91d1-4f2b-b9af-2f79910cd4a2 => generated 0 bytes in 736 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 21:00:38.439724 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-eacb0017-0a6c-419c-9eac-ca7de37dd588 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Calling method '.version_select at 0x7fd3a4799550>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:00:38.509753 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-bd07dcca-c1aa-43f4-b489-7ebb28a60da3 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1b410a64e0415a96d30f5040361137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd7873d6db4e09bc9ab9a048a6b1ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:00:38.530579 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-bd07dcca-c1aa-43f4-b489-7ebb28a60da3 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] 10.222.0.18 "GET /compute/v2.1/servers/eb38dcff-5703-4735-bf8e-6a40d51d8567" status: 200 len: 1314 microversion: 2.1 time: 0.376897 Oct 22 21:00:38.531461 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1220/2572] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:00:38 2022] GET /compute/v2.1/servers/eb38dcff-5703-4735-bf8e-6a40d51d8567 => generated 1314 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:00:38.611719 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-5f6b6b06-26f6-4e52-b218-a34ca1dd0d16 tempest-ServerDiagnosticsNegativeTest-616658542 tempest-ServerDiagnosticsNegativeTest-616658542-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:00:38.612681 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-5f6b6b06-26f6-4e52-b218-a34ca1dd0d16 tempest-ServerDiagnosticsNegativeTest-616658542 tempest-ServerDiagnosticsNegativeTest-616658542-project] [instance: 5e249f40-5d17-49e0-8b86-75f2b4f089c2] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:00:38.619970 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5f6b6b06-26f6-4e52-b218-a34ca1dd0d16 tempest-ServerDiagnosticsNegativeTest-616658542 tempest-ServerDiagnosticsNegativeTest-616658542-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:38.620490 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5f6b6b06-26f6-4e52-b218-a34ca1dd0d16 tempest-ServerDiagnosticsNegativeTest-616658542 tempest-ServerDiagnosticsNegativeTest-616658542-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:38.621132 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5f6b6b06-26f6-4e52-b218-a34ca1dd0d16 tempest-ServerDiagnosticsNegativeTest-616658542 tempest-ServerDiagnosticsNegativeTest-616658542-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:38.621953 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5f6b6b06-26f6-4e52-b218-a34ca1dd0d16 tempest-ServerDiagnosticsNegativeTest-616658542 tempest-ServerDiagnosticsNegativeTest-616658542-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:38.622339 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5f6b6b06-26f6-4e52-b218-a34ca1dd0d16 tempest-ServerDiagnosticsNegativeTest-616658542 tempest-ServerDiagnosticsNegativeTest-616658542-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:38.622824 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5f6b6b06-26f6-4e52-b218-a34ca1dd0d16 tempest-ServerDiagnosticsNegativeTest-616658542 tempest-ServerDiagnosticsNegativeTest-616658542-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:38.905638 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-eacb0017-0a6c-419c-9eac-ca7de37dd588 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/623f979c-1a09-4ecf-8efb-7ed86490517f" status: 202 len: 0 microversion: 2.1 time: 0.464518 Oct 22 21:00:38.908200 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1353/2573] 10.222.0.18 () {58 vars in 1272 bytes} [Sat Oct 22 21:00:38 2022] DELETE /compute/v2.1/os-security-groups/623f979c-1a09-4ecf-8efb-7ed86490517f => generated 0 bytes in 473 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 21:00:38.921100 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-427ba4b0-8aec-49cc-af8b-77bfd45234a7 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:00:38.922032 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-427ba4b0-8aec-49cc-af8b-77bfd45234a7 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] [instance: af11a208-be6e-4f70-85f0-4bafafb4febd] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:00:38.933515 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-5f6b6b06-26f6-4e52-b218-a34ca1dd0d16 tempest-ServerDiagnosticsNegativeTest-616658542 tempest-ServerDiagnosticsNegativeTest-616658542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42dbc5f3bc042ef935dd95e123bab0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ca06233c6b4e808308cf6613eb8db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:00:38.959268 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-5f6b6b06-26f6-4e52-b218-a34ca1dd0d16 tempest-ServerDiagnosticsNegativeTest-616658542 tempest-ServerDiagnosticsNegativeTest-616658542-project] 10.222.0.18 "GET /compute/v2.1/servers/5e249f40-5d17-49e0-8b86-75f2b4f089c2" status: 200 len: 1323 microversion: 2.1 time: 0.350687 Oct 22 21:00:38.961043 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-427ba4b0-8aec-49cc-af8b-77bfd45234a7 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:38.962117 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-427ba4b0-8aec-49cc-af8b-77bfd45234a7 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:38.962544 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1221/2574] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:00:38 2022] GET /compute/v2.1/servers/5e249f40-5d17-49e0-8b86-75f2b4f089c2 => generated 1323 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:00:38.964003 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-427ba4b0-8aec-49cc-af8b-77bfd45234a7 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:38.964896 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-427ba4b0-8aec-49cc-af8b-77bfd45234a7 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:38.965550 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-427ba4b0-8aec-49cc-af8b-77bfd45234a7 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:38.966100 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-427ba4b0-8aec-49cc-af8b-77bfd45234a7 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:38.984423 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-0b2e7095-059f-4287-b09b-112ae48897bc tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Action: 'create', calling method: .version_select at 0x7fd39f148e50>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1848721169", "description": "tempest-description-1476745583"}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:00:39.316462 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-427ba4b0-8aec-49cc-af8b-77bfd45234a7 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a44ff8e7c14b94b1670f030085c43d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a26a2284f4424cbeaf63d504652546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:00:39.325965 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-427ba4b0-8aec-49cc-af8b-77bfd45234a7 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] 10.222.0.18 "GET /compute/v2.1/servers/af11a208-be6e-4f70-85f0-4bafafb4febd" status: 200 len: 1307 microversion: 2.1 time: 0.416304 Oct 22 21:00:39.327235 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1354/2575] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:00:38 2022] GET /compute/v2.1/servers/af11a208-be6e-4f70-85f0-4bafafb4febd => generated 1307 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:00:39.332412 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-8a3bb00e-bd73-4f9b-9f03-58b35bc3f4c9 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Calling method '.version_select at 0x7fd39fd12280>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:00:39.380239 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-8a3bb00e-bd73-4f9b-9f03-58b35bc3f4c9 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] 10.222.0.18 "GET /compute/v2.1/images/8368f750-e203-4ef8-b979-ba7ef86a0df0" status: 200 len: 1455 microversion: 2.1 time: 0.051534 Oct 22 21:00:39.381140 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1355/2576] 10.222.0.18 () {58 vars in 1233 bytes} [Sat Oct 22 21:00:39 2022] GET /compute/v2.1/images/8368f750-e203-4ef8-b979-ba7ef86a0df0 => generated 1455 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:00:39.396825 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-6860e420-d8bb-43c2-97fb-db0db3fe2839 req-f936975b-0c9b-4b9d-838f-978edefa33d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af11a208-be6e-4f70-85f0-4bafafb4febd", "name": "network-vif-plugged", "status": "completed", "tag": "3d94ca32-d8de-4aba-97b8-bd0eca70cdee"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:00:39.407470 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-6860e420-d8bb-43c2-97fb-db0db3fe2839 req-f936975b-0c9b-4b9d-838f-978edefa33d0 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:39.407846 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-6860e420-d8bb-43c2-97fb-db0db3fe2839 req-f936975b-0c9b-4b9d-838f-978edefa33d0 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:39.408479 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-6860e420-d8bb-43c2-97fb-db0db3fe2839 req-f936975b-0c9b-4b9d-838f-978edefa33d0 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:39.422981 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-6860e420-d8bb-43c2-97fb-db0db3fe2839 req-f936975b-0c9b-4b9d-838f-978edefa33d0 service nova] Creating event network-vif-plugged:3d94ca32-d8de-4aba-97b8-bd0eca70cdee for instance af11a208-be6e-4f70-85f0-4bafafb4febd on nch1-master-1 Oct 22 21:00:39.428617 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-6860e420-d8bb-43c2-97fb-db0db3fe2839 req-f936975b-0c9b-4b9d-838f-978edefa33d0 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043114 Oct 22 21:00:39.429939 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1356/2577] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:00:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:00:39.507770 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-0b2e7095-059f-4287-b09b-112ae48897bc tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] 10.222.0.18 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.543353 Oct 22 21:00:39.509453 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1222/2578] 10.222.0.18 () {60 vars in 1180 bytes} [Sat Oct 22 21:00:38 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:00:39.525474 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-77f214c6-25c8-46da-bb19-f680bd302022 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Action: 'update', calling method: .version_select at 0x7fd3a4230d30>, body: {"security_group": {"name": "tempest-sg-hth-1194289420", "description": "tempest-description-hth-817823259"}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:00:39.556105 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-7d42d1a0-ca06-486d-833f-10772a4d511e tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:00:39.556717 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-7d42d1a0-ca06-486d-833f-10772a4d511e tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] [instance: eb38dcff-5703-4735-bf8e-6a40d51d8567] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:00:39.563261 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7d42d1a0-ca06-486d-833f-10772a4d511e tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:39.564021 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7d42d1a0-ca06-486d-833f-10772a4d511e tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:39.564558 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7d42d1a0-ca06-486d-833f-10772a4d511e tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:39.565490 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7d42d1a0-ca06-486d-833f-10772a4d511e tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:39.566012 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7d42d1a0-ca06-486d-833f-10772a4d511e tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:39.566668 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7d42d1a0-ca06-486d-833f-10772a4d511e tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:39.788958 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell0:SELECT=4 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:00:39.814351 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell0:SELECT=12 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:00:39.930720 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-7d42d1a0-ca06-486d-833f-10772a4d511e tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1b410a64e0415a96d30f5040361137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd7873d6db4e09bc9ab9a048a6b1ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:00:39.939395 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-7d42d1a0-ca06-486d-833f-10772a4d511e tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] 10.222.0.18 "GET /compute/v2.1/servers/eb38dcff-5703-4735-bf8e-6a40d51d8567" status: 200 len: 1501 microversion: 2.1 time: 0.387157 Oct 22 21:00:39.951559 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1223/2579] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:00:39 2022] GET /compute/v2.1/servers/eb38dcff-5703-4735-bf8e-6a40d51d8567 => generated 1501 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:00:39.962513 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-cab7079e-da40-49fb-ab67-edb86efe8a34 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:00:39.963108 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-cab7079e-da40-49fb-ab67-edb86efe8a34 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] [instance: eb38dcff-5703-4735-bf8e-6a40d51d8567] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:00:39.969399 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cab7079e-da40-49fb-ab67-edb86efe8a34 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:39.969889 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cab7079e-da40-49fb-ab67-edb86efe8a34 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:39.970335 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cab7079e-da40-49fb-ab67-edb86efe8a34 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:39.971034 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cab7079e-da40-49fb-ab67-edb86efe8a34 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:39.971609 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cab7079e-da40-49fb-ab67-edb86efe8a34 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:39.972083 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cab7079e-da40-49fb-ab67-edb86efe8a34 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:40.000069 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-77f214c6-25c8-46da-bb19-f680bd302022 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] 10.222.0.18 "PUT /compute/v2.1/os-security-groups/2e8e2edc-645a-4066-bc71-4817d9bc1cee" status: 200 len: 217 microversion: 2.1 time: 0.480447 Oct 22 21:00:40.001100 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-cab7079e-da40-49fb-ab67-edb86efe8a34 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] [instance: eb38dcff-5703-4735-bf8e-6a40d51d8567] Going to try to terminate instance {{(pid=138744) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 21:00:40.001727 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1357/2580] 10.222.0.18 () {60 vars in 1290 bytes} [Sat Oct 22 21:00:39 2022] PUT /compute/v2.1/os-security-groups/2e8e2edc-645a-4066-bc71-4817d9bc1cee => generated 217 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:00:40.008519 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-1f59639c-d66a-4c08-b795-226239ec628d tempest-ServerDiagnosticsNegativeTest-616658542 tempest-ServerDiagnosticsNegativeTest-616658542-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:00:40.009583 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-1f59639c-d66a-4c08-b795-226239ec628d tempest-ServerDiagnosticsNegativeTest-616658542 tempest-ServerDiagnosticsNegativeTest-616658542-project] [instance: 5e249f40-5d17-49e0-8b86-75f2b4f089c2] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:00:40.018688 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1f59639c-d66a-4c08-b795-226239ec628d tempest-ServerDiagnosticsNegativeTest-616658542 tempest-ServerDiagnosticsNegativeTest-616658542-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:40.019356 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1f59639c-d66a-4c08-b795-226239ec628d tempest-ServerDiagnosticsNegativeTest-616658542 tempest-ServerDiagnosticsNegativeTest-616658542-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:40.019911 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1f59639c-d66a-4c08-b795-226239ec628d tempest-ServerDiagnosticsNegativeTest-616658542 tempest-ServerDiagnosticsNegativeTest-616658542-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:40.020783 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1f59639c-d66a-4c08-b795-226239ec628d tempest-ServerDiagnosticsNegativeTest-616658542 tempest-ServerDiagnosticsNegativeTest-616658542-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:40.021353 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1f59639c-d66a-4c08-b795-226239ec628d tempest-ServerDiagnosticsNegativeTest-616658542 tempest-ServerDiagnosticsNegativeTest-616658542-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:40.021890 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1f59639c-d66a-4c08-b795-226239ec628d tempest-ServerDiagnosticsNegativeTest-616658542 tempest-ServerDiagnosticsNegativeTest-616658542-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:40.091824 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-cab7079e-da40-49fb-ab67-edb86efe8a34 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] 10.222.0.18 "DELETE /compute/v2.1/servers/eb38dcff-5703-4735-bf8e-6a40d51d8567" status: 204 len: 0 microversion: 2.1 time: 0.132844 Oct 22 21:00:40.093006 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1224/2581] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 21:00:39 2022] DELETE /compute/v2.1/servers/eb38dcff-5703-4735-bf8e-6a40d51d8567 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 21:00:40.100281 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-161b9ef4-8512-412b-bace-8fdab6931b71 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Calling method '.version_select at 0x7fd39f1eac10>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:00:40.721788 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-161b9ef4-8512-412b-bace-8fdab6931b71 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] 10.222.0.18 "GET /compute/v2.1/os-security-groups/2e8e2edc-645a-4066-bc71-4817d9bc1cee" status: 200 len: 217 microversion: 2.1 time: 0.627342 Oct 22 21:00:40.723198 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1225/2582] 10.222.0.18 () {58 vars in 1269 bytes} [Sat Oct 22 21:00:40 2022] GET /compute/v2.1/os-security-groups/2e8e2edc-645a-4066-bc71-4817d9bc1cee => generated 217 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:00:40.728346 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-0e2a44f5-b4f5-4dfb-bb45-4dcbf05cfa3c tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:00:40.729572 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-0e2a44f5-b4f5-4dfb-bb45-4dcbf05cfa3c tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] [instance: eb38dcff-5703-4735-bf8e-6a40d51d8567] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:00:40.741255 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0e2a44f5-b4f5-4dfb-bb45-4dcbf05cfa3c tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:40.742000 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0e2a44f5-b4f5-4dfb-bb45-4dcbf05cfa3c tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:40.743851 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0e2a44f5-b4f5-4dfb-bb45-4dcbf05cfa3c tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:40.745022 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0e2a44f5-b4f5-4dfb-bb45-4dcbf05cfa3c tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:40.745751 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0e2a44f5-b4f5-4dfb-bb45-4dcbf05cfa3c tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:40.746450 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0e2a44f5-b4f5-4dfb-bb45-4dcbf05cfa3c tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:40.799901 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-1f59639c-d66a-4c08-b795-226239ec628d tempest-ServerDiagnosticsNegativeTest-616658542 tempest-ServerDiagnosticsNegativeTest-616658542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42dbc5f3bc042ef935dd95e123bab0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ca06233c6b4e808308cf6613eb8db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:00:40.816012 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-1f59639c-d66a-4c08-b795-226239ec628d tempest-ServerDiagnosticsNegativeTest-616658542 tempest-ServerDiagnosticsNegativeTest-616658542-project] 10.222.0.18 "GET /compute/v2.1/servers/5e249f40-5d17-49e0-8b86-75f2b4f089c2" status: 200 len: 1323 microversion: 2.1 time: 0.812829 Oct 22 21:00:40.818171 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1358/2583] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:00:40 2022] GET /compute/v2.1/servers/5e249f40-5d17-49e0-8b86-75f2b4f089c2 => generated 1323 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:00:40.827896 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-da9834c3-a5ba-41c9-beb8-e01a8e626e67 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:00:40.833839 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-da9834c3-a5ba-41c9-beb8-e01a8e626e67 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] [instance: af11a208-be6e-4f70-85f0-4bafafb4febd] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:00:40.841391 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_api:INSERT=8,nova_api:SELECT=87 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:00:40.848470 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-da9834c3-a5ba-41c9-beb8-e01a8e626e67 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:40.849315 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-da9834c3-a5ba-41c9-beb8-e01a8e626e67 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:40.850016 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-da9834c3-a5ba-41c9-beb8-e01a8e626e67 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:40.851363 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-da9834c3-a5ba-41c9-beb8-e01a8e626e67 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:40.852045 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-da9834c3-a5ba-41c9-beb8-e01a8e626e67 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:40.852693 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-da9834c3-a5ba-41c9-beb8-e01a8e626e67 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:41.091974 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-0e2a44f5-b4f5-4dfb-bb45-4dcbf05cfa3c tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1b410a64e0415a96d30f5040361137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd7873d6db4e09bc9ab9a048a6b1ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:00:41.104414 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-da9834c3-a5ba-41c9-beb8-e01a8e626e67 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a44ff8e7c14b94b1670f030085c43d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a26a2284f4424cbeaf63d504652546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:00:41.109209 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-0e2a44f5-b4f5-4dfb-bb45-4dcbf05cfa3c tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] 10.222.0.18 "GET /compute/v2.1/servers/eb38dcff-5703-4735-bf8e-6a40d51d8567" status: 200 len: 1507 microversion: 2.1 time: 0.384869 Oct 22 21:00:41.118167 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-da9834c3-a5ba-41c9-beb8-e01a8e626e67 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] 10.222.0.18 "GET /compute/v2.1/servers/af11a208-be6e-4f70-85f0-4bafafb4febd" status: 200 len: 1307 microversion: 2.1 time: 0.297907 Oct 22 21:00:41.123706 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1226/2584] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:00:40 2022] GET /compute/v2.1/servers/eb38dcff-5703-4735-bf8e-6a40d51d8567 => generated 1507 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:00:41.130003 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1359/2585] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:00:40 2022] GET /compute/v2.1/servers/af11a208-be6e-4f70-85f0-4bafafb4febd => generated 1307 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:00:41.139076 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-6a8e5992-4a7f-46d4-899a-1ea0236002cd tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Calling method '.version_select at 0x7fd39f21f1f0>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:00:41.143292 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-c6f4e3d7-2f60-403e-8b6f-aa1161279b01 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Calling method '.version_select at 0x7fd39fd7b790>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:00:41.199227 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-6a8e5992-4a7f-46d4-899a-1ea0236002cd tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] 10.222.0.18 "GET /compute/v2.1/images/8368f750-e203-4ef8-b979-ba7ef86a0df0" status: 200 len: 1455 microversion: 2.1 time: 0.073864 Oct 22 21:00:41.200466 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1227/2586] 10.222.0.18 () {58 vars in 1233 bytes} [Sat Oct 22 21:00:41 2022] GET /compute/v2.1/images/8368f750-e203-4ef8-b979-ba7ef86a0df0 => generated 1455 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:00:41.348123 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-c6f4e3d7-2f60-403e-8b6f-aa1161279b01 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/2e8e2edc-645a-4066-bc71-4817d9bc1cee" status: 202 len: 0 microversion: 2.1 time: 0.215096 Oct 22 21:00:41.350015 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1360/2587] 10.222.0.18 () {58 vars in 1272 bytes} [Sat Oct 22 21:00:41 2022] DELETE /compute/v2.1/os-security-groups/2e8e2edc-645a-4066-bc71-4817d9bc1cee => generated 0 bytes in 218 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 21:00:41.359428 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-d8caaf8c-a165-47fe-baee-6fa325042466 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:00:41.360012 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-d8caaf8c-a165-47fe-baee-6fa325042466 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] [instance: 7dde7a20-b949-4c72-ae19-83f2f0afd0d1] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:00:41.366825 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d8caaf8c-a165-47fe-baee-6fa325042466 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:41.369216 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d8caaf8c-a165-47fe-baee-6fa325042466 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:41.369675 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d8caaf8c-a165-47fe-baee-6fa325042466 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:41.371408 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d8caaf8c-a165-47fe-baee-6fa325042466 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:41.372154 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d8caaf8c-a165-47fe-baee-6fa325042466 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:41.372784 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d8caaf8c-a165-47fe-baee-6fa325042466 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:41.393587 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-d8caaf8c-a165-47fe-baee-6fa325042466 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] HTTP exception thrown: Instance 7dde7a20-b949-4c72-ae19-83f2f0afd0d1 could not be found. Oct 22 21:00:41.398344 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-d8caaf8c-a165-47fe-baee-6fa325042466 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Request method failure captured: Oct 22 21:00:41.398344 ncdv-master-1 devstack@n-api.service[138744]: request: DELETE /compute/v2.1/servers/7dde7a20-b949-4c72-ae19-83f2f0afd0d1 HTTP/1.1 Oct 22 21:00:41.398344 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 21:00:41.398344 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 21:00:41.398344 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 21:00:41.398344 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 0 Oct 22 21:00:41.398344 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 21:00:41.398344 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 21:00:41.398344 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 21:00:41.398344 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 21:00:41.398344 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVFmMTFo8tMXHI466ygTiy0jTs5kz8YO2nFuimSyZRJI5bXNUfHpPLWjQrXyJ7I9Xfc54HQRfYflULj68lfwBk5jrnjY79oZ1kbdK55vumR_IVvMJmaykrPjWliG3H4xf-SZHnU3invPEATeZO7VP5aTca0hd9BauSvYCW1UPdVAZZ70 Oct 22 21:00:41.398344 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 21:00:41.398344 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 21:00:41.398344 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 21:00:41.398344 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 21:00:41.398344 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 21:00:41.398344 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 21:00:41.398344 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: ed31e93b0e8a43f28e497f94318815ce Oct 22 21:00:41.398344 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-SecurityGroupsTestJSON-1604956559 Oct 22 21:00:41.398344 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 21:00:41.398344 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 21:00:41.398344 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ed31e93b0e8a43f28e497f94318815ce"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ed31e93b0e8a43f28e497f94318815ce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ed31e93b0e8a43f28e497f94318815ce"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ed31e93b0e8a43f28e497f94318815ce"}]}] Oct 22 21:00:41.398344 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-SecurityGroupsTestJSON-1604956559 Oct 22 21:00:41.398344 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: ed31e93b0e8a43f28e497f94318815ce Oct 22 21:00:41.398344 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1604956559 Oct 22 21:00:41.398344 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-SecurityGroupsTestJSON-1604956559-project Oct 22 21:00:41.398344 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 21:00:41.398344 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 21:00:41.398344 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: 46d49952dbca4d95a25411b65d56552b Oct 22 21:00:41.398344 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-SecurityGroupsTestJSON-1604956559-project Oct 22 21:00:41.398344 ncdv-master-1 devstack@n-api.service[138744]: method: > Oct 22 21:00:41.398344 ncdv-master-1 devstack@n-api.service[138744]: exception: Instance 7dde7a20-b949-4c72-ae19-83f2f0afd0d1 could not be found. Oct 22 21:00:41.398344 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': '7dde7a20-b949-4c72-ae19-83f2f0afd0d1'} Oct 22 21:00:41.398344 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:00:41.398344 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:00:41.398344 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 21:00:41.398344 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 21:00:41.398344 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 21:00:41.398344 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 21:00:41.398344 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 21:00:41.398344 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 21:00:41.398344 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 21:00:41.398344 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 21:00:41.398344 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7dde7a20-b949-4c72-ae19-83f2f0afd0d1 could not be found. Oct 22 21:00:41.398344 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:00:41.398344 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:00:41.398344 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:00:41.398344 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:00:41.398344 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:00:41.398344 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:00:41.398344 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:00:41.398344 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:00:41.398344 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:00:41.398344 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:00:41.398344 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 22 21:00:41.398344 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 22 21:00:41.398344 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 22 21:00:41.398344 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 22 21:00:41.398344 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 21:00:41.398344 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 21:00:41.398344 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 21:00:41.398344 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:00:41.403317 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7dde7a20-b949-4c72-ae19-83f2f0afd0d1 could not be found. Oct 22 21:00:41.403317 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:00:41.403317 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:00:41.403317 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:00:41.403317 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:00:41.403317 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:00:41.403317 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:00:41.403317 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:00:41.403317 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:00:41.403317 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7dde7a20-b949-4c72-ae19-83f2f0afd0d1 could not be found. Oct 22 21:00:41.403317 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:00:41.403317 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-d8caaf8c-a165-47fe-baee-6fa325042466 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Returning 404 to user: Instance 7dde7a20-b949-4c72-ae19-83f2f0afd0d1 could not be found. {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:00:41.404251 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-d8caaf8c-a165-47fe-baee-6fa325042466 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] 10.222.0.18 "DELETE /compute/v2.1/servers/7dde7a20-b949-4c72-ae19-83f2f0afd0d1" status: 404 len: 111 microversion: 2.1 time: 0.048065 Oct 22 21:00:41.415556 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1228/2588] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 21:00:41 2022] DELETE /compute/v2.1/servers/7dde7a20-b949-4c72-ae19-83f2f0afd0d1 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 22 21:00:41.417224 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-a78d580e-cbc7-475c-9dd8-53e8b1ca68fe tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:00:41.418248 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-a78d580e-cbc7-475c-9dd8-53e8b1ca68fe tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] [instance: 7dde7a20-b949-4c72-ae19-83f2f0afd0d1] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:00:41.425197 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a78d580e-cbc7-475c-9dd8-53e8b1ca68fe tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:41.427363 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a78d580e-cbc7-475c-9dd8-53e8b1ca68fe tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:41.427910 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a78d580e-cbc7-475c-9dd8-53e8b1ca68fe tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:41.428879 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a78d580e-cbc7-475c-9dd8-53e8b1ca68fe tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:41.429498 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a78d580e-cbc7-475c-9dd8-53e8b1ca68fe tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:41.430067 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a78d580e-cbc7-475c-9dd8-53e8b1ca68fe tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:41.446482 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.wsgi [None req-a78d580e-cbc7-475c-9dd8-53e8b1ca68fe tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] HTTP exception thrown: Instance 7dde7a20-b949-4c72-ae19-83f2f0afd0d1 could not be found. Oct 22 21:00:41.448754 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-a78d580e-cbc7-475c-9dd8-53e8b1ca68fe tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Request method failure captured: Oct 22 21:00:41.448754 ncdv-master-1 devstack@n-api.service[138745]: request: GET /compute/v2.1/servers/7dde7a20-b949-4c72-ae19-83f2f0afd0d1 HTTP/1.1 Oct 22 21:00:41.448754 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 21:00:41.448754 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 21:00:41.448754 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 21:00:41.448754 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 0 Oct 22 21:00:41.448754 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 21:00:41.448754 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 21:00:41.448754 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 21:00:41.448754 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 21:00:41.448754 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVFmMTFo8tMXHI466ygTiy0jTs5kz8YO2nFuimSyZRJI5bXNUfHpPLWjQrXyJ7I9Xfc54HQRfYflULj68lfwBk5jrnjY79oZ1kbdK55vumR_IVvMJmaykrPjWliG3H4xf-SZHnU3invPEATeZO7VP5aTca0hd9BauSvYCW1UPdVAZZ70 Oct 22 21:00:41.448754 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 21:00:41.448754 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 21:00:41.448754 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 21:00:41.448754 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 21:00:41.448754 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 21:00:41.448754 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 21:00:41.448754 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: ed31e93b0e8a43f28e497f94318815ce Oct 22 21:00:41.448754 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-SecurityGroupsTestJSON-1604956559 Oct 22 21:00:41.448754 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 21:00:41.448754 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 21:00:41.448754 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ed31e93b0e8a43f28e497f94318815ce"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ed31e93b0e8a43f28e497f94318815ce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ed31e93b0e8a43f28e497f94318815ce"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ed31e93b0e8a43f28e497f94318815ce"}]}] Oct 22 21:00:41.448754 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-SecurityGroupsTestJSON-1604956559 Oct 22 21:00:41.448754 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: ed31e93b0e8a43f28e497f94318815ce Oct 22 21:00:41.448754 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1604956559 Oct 22 21:00:41.448754 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-SecurityGroupsTestJSON-1604956559-project Oct 22 21:00:41.448754 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 21:00:41.448754 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 21:00:41.448754 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: 46d49952dbca4d95a25411b65d56552b Oct 22 21:00:41.448754 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-SecurityGroupsTestJSON-1604956559-project Oct 22 21:00:41.448754 ncdv-master-1 devstack@n-api.service[138745]: method: > Oct 22 21:00:41.448754 ncdv-master-1 devstack@n-api.service[138745]: exception: Instance 7dde7a20-b949-4c72-ae19-83f2f0afd0d1 could not be found. Oct 22 21:00:41.448754 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'id': '7dde7a20-b949-4c72-ae19-83f2f0afd0d1'} Oct 22 21:00:41.448754 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:00:41.448754 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:00:41.448754 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 21:00:41.448754 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 21:00:41.448754 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 21:00:41.448754 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 21:00:41.448754 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 21:00:41.448754 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 21:00:41.448754 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 21:00:41.448754 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 21:00:41.448754 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7dde7a20-b949-4c72-ae19-83f2f0afd0d1 could not be found. Oct 22 21:00:41.448754 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:00:41.448754 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:00:41.448754 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:00:41.448754 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:00:41.448754 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:00:41.448754 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:00:41.448754 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:00:41.448754 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:00:41.448754 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:00:41.448754 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:00:41.448754 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 21:00:41.448754 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 21:00:41.448754 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 21:00:41.448754 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 21:00:41.448754 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 21:00:41.448754 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:00:41.448754 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7dde7a20-b949-4c72-ae19-83f2f0afd0d1 could not be found. Oct 22 21:00:41.448754 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:00:41.448754 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:00:41.448754 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:00:41.452784 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:00:41.452784 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:00:41.452784 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:00:41.452784 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:00:41.452784 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:00:41.452784 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7dde7a20-b949-4c72-ae19-83f2f0afd0d1 could not be found. Oct 22 21:00:41.452784 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:00:41.452784 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-a78d580e-cbc7-475c-9dd8-53e8b1ca68fe tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Returning 404 to user: Instance 7dde7a20-b949-4c72-ae19-83f2f0afd0d1 could not be found. {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:00:41.452784 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-a78d580e-cbc7-475c-9dd8-53e8b1ca68fe tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] 10.222.0.18 "GET /compute/v2.1/servers/7dde7a20-b949-4c72-ae19-83f2f0afd0d1" status: 404 len: 111 microversion: 2.1 time: 0.038936 Oct 22 21:00:41.452784 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1361/2589] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:00:41 2022] GET /compute/v2.1/servers/7dde7a20-b949-4c72-ae19-83f2f0afd0d1 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 21:00:41.459828 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-19150055-5ba0-4e02-956e-2d7b13f165d2 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Calling method '.version_select at 0x7fd39f148430>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:00:41.485134 ncdv-master-1 devstack@n-api.service[138744]: DEBUG neutronclient.v2_0.client [None req-19150055-5ba0-4e02-956e-2d7b13f165d2 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 623f979c-1a09-4ecf-8efb-7ed86490517f does not exist", "detail": ""}} {{(pid=138744) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 22 21:00:41.485604 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.network.security_group_api [None req-19150055-5ba0-4e02-956e-2d7b13f165d2 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Neutron security group 623f979c-1a09-4ecf-8efb-7ed86490517f not found {{(pid=138744) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 22 21:00:41.486114 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-19150055-5ba0-4e02-956e-2d7b13f165d2 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] HTTP exception thrown: Security group 623f979c-1a09-4ecf-8efb-7ed86490517f does not exist Oct 22 21:00:41.486114 ncdv-master-1 devstack@n-api.service[138744]: Neutron server returns request_ids: ['req-f8c8253d-5f73-4292-acaf-af5f2684e899'] Oct 22 21:00:41.488193 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-19150055-5ba0-4e02-956e-2d7b13f165d2 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Request method failure captured: Oct 22 21:00:41.488193 ncdv-master-1 devstack@n-api.service[138744]: request: DELETE /compute/v2.1/os-security-groups/623f979c-1a09-4ecf-8efb-7ed86490517f HTTP/1.1 Oct 22 21:00:41.488193 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 21:00:41.488193 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 21:00:41.488193 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 21:00:41.488193 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 0 Oct 22 21:00:41.488193 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 21:00:41.488193 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 21:00:41.488193 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 21:00:41.488193 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 21:00:41.488193 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVFmMTFo8tMXHI466ygTiy0jTs5kz8YO2nFuimSyZRJI5bXNUfHpPLWjQrXyJ7I9Xfc54HQRfYflULj68lfwBk5jrnjY79oZ1kbdK55vumR_IVvMJmaykrPjWliG3H4xf-SZHnU3invPEATeZO7VP5aTca0hd9BauSvYCW1UPdVAZZ70 Oct 22 21:00:41.488193 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 21:00:41.488193 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 21:00:41.488193 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 21:00:41.488193 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 21:00:41.488193 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 21:00:41.488193 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 21:00:41.488193 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: ed31e93b0e8a43f28e497f94318815ce Oct 22 21:00:41.488193 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-SecurityGroupsTestJSON-1604956559 Oct 22 21:00:41.488193 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 21:00:41.488193 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 21:00:41.488193 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ed31e93b0e8a43f28e497f94318815ce"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ed31e93b0e8a43f28e497f94318815ce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ed31e93b0e8a43f28e497f94318815ce"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ed31e93b0e8a43f28e497f94318815ce"}]}] Oct 22 21:00:41.488193 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-SecurityGroupsTestJSON-1604956559 Oct 22 21:00:41.488193 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: ed31e93b0e8a43f28e497f94318815ce Oct 22 21:00:41.488193 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1604956559 Oct 22 21:00:41.488193 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-SecurityGroupsTestJSON-1604956559-project Oct 22 21:00:41.488193 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 21:00:41.488193 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 21:00:41.488193 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: 46d49952dbca4d95a25411b65d56552b Oct 22 21:00:41.488193 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-SecurityGroupsTestJSON-1604956559-project Oct 22 21:00:41.488193 ncdv-master-1 devstack@n-api.service[138744]: method: Oct 22 21:00:41.488193 ncdv-master-1 devstack@n-api.service[138744]: exception: Security group 623f979c-1a09-4ecf-8efb-7ed86490517f does not exist Oct 22 21:00:41.488193 ncdv-master-1 devstack@n-api.service[138744]: Neutron server returns request_ids: ['req-f8c8253d-5f73-4292-acaf-af5f2684e899'] Oct 22 21:00:41.488193 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': '623f979c-1a09-4ecf-8efb-7ed86490517f'} Oct 22 21:00:41.488193 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:00:41.488193 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:00:41.488193 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 22 21:00:41.488193 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 22 21:00:41.488193 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 21:00:41.488193 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 21:00:41.488193 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 22 21:00:41.488193 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 22 21:00:41.488193 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 21:00:41.488193 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 21:00:41.488193 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 22 21:00:41.488193 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 22 21:00:41.488193 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 21:00:41.488193 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 21:00:41.488193 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 22 21:00:41.488193 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 22 21:00:41.488193 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 21:00:41.488193 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 21:00:41.488193 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 22 21:00:41.488193 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 22 21:00:41.488193 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 21:00:41.488193 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 21:00:41.488193 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 22 21:00:41.488193 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 22 21:00:41.488193 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 22 21:00:41.488193 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 22 21:00:41.488193 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 623f979c-1a09-4ecf-8efb-7ed86490517f does not exist Oct 22 21:00:41.494540 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f8c8253d-5f73-4292-acaf-af5f2684e899'] Oct 22 21:00:41.494540 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:00:41.494540 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:00:41.494540 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:00:41.494540 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:00:41.494540 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 22 21:00:41.494540 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 22 21:00:41.494540 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 22 21:00:41.494540 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 22 21:00:41.494540 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 623f979c-1a09-4ecf-8efb-7ed86490517f does not exist Oct 22 21:00:41.494540 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f8c8253d-5f73-4292-acaf-af5f2684e899'] Oct 22 21:00:41.494540 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:00:41.494540 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:00:41.494540 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:00:41.494540 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:00:41.494540 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:00:41.494540 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:00:41.494540 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:00:41.494540 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:00:41.494540 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 22 21:00:41.494540 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 22 21:00:41.494540 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:00:41.494540 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:00:41.494540 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 22 21:00:41.494540 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 22 21:00:41.494540 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 623f979c-1a09-4ecf-8efb-7ed86490517f does not exist Oct 22 21:00:41.494540 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f8c8253d-5f73-4292-acaf-af5f2684e899'] Oct 22 21:00:41.494540 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:00:41.494540 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:00:41.494540 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:00:41.494540 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:00:41.494540 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:00:41.494540 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:00:41.494540 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:00:41.494540 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:00:41.494540 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 623f979c-1a09-4ecf-8efb-7ed86490517f does not exist Oct 22 21:00:41.494540 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f8c8253d-5f73-4292-acaf-af5f2684e899'] Oct 22 21:00:41.494540 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:00:41.494540 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-19150055-5ba0-4e02-956e-2d7b13f165d2 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Returning 404 to user: Security group 623f979c-1a09-4ecf-8efb-7ed86490517f does not exist Oct 22 21:00:41.494540 ncdv-master-1 devstack@n-api.service[138744]: Neutron server returns request_ids: ['req-f8c8253d-5f73-4292-acaf-af5f2684e899'] {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:00:41.494540 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-19150055-5ba0-4e02-956e-2d7b13f165d2 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/623f979c-1a09-4ecf-8efb-7ed86490517f" status: 404 len: 194 microversion: 2.1 time: 0.034058 Oct 22 21:00:41.494540 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1229/2590] 10.222.0.18 () {58 vars in 1272 bytes} [Sat Oct 22 21:00:41 2022] DELETE /compute/v2.1/os-security-groups/623f979c-1a09-4ecf-8efb-7ed86490517f => generated 194 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 22 21:00:41.501587 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-18ba2ca1-30eb-41b4-8de9-a56390e442a4 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Calling method '.version_select at 0x7fd39fd34a60>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:00:41.529003 ncdv-master-1 devstack@n-api.service[138745]: DEBUG neutronclient.v2_0.client [None req-18ba2ca1-30eb-41b4-8de9-a56390e442a4 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 27359005-91d1-4f2b-b9af-2f79910cd4a2 does not exist", "detail": ""}} {{(pid=138745) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 22 21:00:41.529703 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.network.security_group_api [None req-18ba2ca1-30eb-41b4-8de9-a56390e442a4 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Neutron security group 27359005-91d1-4f2b-b9af-2f79910cd4a2 not found {{(pid=138745) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 22 21:00:41.530341 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.wsgi [None req-18ba2ca1-30eb-41b4-8de9-a56390e442a4 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] HTTP exception thrown: Security group 27359005-91d1-4f2b-b9af-2f79910cd4a2 does not exist Oct 22 21:00:41.530341 ncdv-master-1 devstack@n-api.service[138745]: Neutron server returns request_ids: ['req-5bfcad42-de23-4aed-957b-d8cdf035074a'] Oct 22 21:00:41.532591 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-18ba2ca1-30eb-41b4-8de9-a56390e442a4 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Request method failure captured: Oct 22 21:00:41.532591 ncdv-master-1 devstack@n-api.service[138745]: request: DELETE /compute/v2.1/os-security-groups/27359005-91d1-4f2b-b9af-2f79910cd4a2 HTTP/1.1 Oct 22 21:00:41.532591 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 21:00:41.532591 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 21:00:41.532591 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 21:00:41.532591 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 0 Oct 22 21:00:41.532591 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 21:00:41.532591 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 21:00:41.532591 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 21:00:41.532591 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 21:00:41.532591 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVFmMTFo8tMXHI466ygTiy0jTs5kz8YO2nFuimSyZRJI5bXNUfHpPLWjQrXyJ7I9Xfc54HQRfYflULj68lfwBk5jrnjY79oZ1kbdK55vumR_IVvMJmaykrPjWliG3H4xf-SZHnU3invPEATeZO7VP5aTca0hd9BauSvYCW1UPdVAZZ70 Oct 22 21:00:41.532591 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 21:00:41.532591 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 21:00:41.532591 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 21:00:41.532591 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 21:00:41.532591 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 21:00:41.532591 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 21:00:41.532591 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: ed31e93b0e8a43f28e497f94318815ce Oct 22 21:00:41.532591 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-SecurityGroupsTestJSON-1604956559 Oct 22 21:00:41.532591 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 21:00:41.532591 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 21:00:41.532591 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ed31e93b0e8a43f28e497f94318815ce"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ed31e93b0e8a43f28e497f94318815ce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ed31e93b0e8a43f28e497f94318815ce"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ed31e93b0e8a43f28e497f94318815ce"}]}] Oct 22 21:00:41.532591 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-SecurityGroupsTestJSON-1604956559 Oct 22 21:00:41.532591 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: ed31e93b0e8a43f28e497f94318815ce Oct 22 21:00:41.532591 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1604956559 Oct 22 21:00:41.532591 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-SecurityGroupsTestJSON-1604956559-project Oct 22 21:00:41.532591 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 21:00:41.532591 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 21:00:41.532591 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: 46d49952dbca4d95a25411b65d56552b Oct 22 21:00:41.532591 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-SecurityGroupsTestJSON-1604956559-project Oct 22 21:00:41.532591 ncdv-master-1 devstack@n-api.service[138745]: method: Oct 22 21:00:41.532591 ncdv-master-1 devstack@n-api.service[138745]: exception: Security group 27359005-91d1-4f2b-b9af-2f79910cd4a2 does not exist Oct 22 21:00:41.532591 ncdv-master-1 devstack@n-api.service[138745]: Neutron server returns request_ids: ['req-5bfcad42-de23-4aed-957b-d8cdf035074a'] Oct 22 21:00:41.532591 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'id': '27359005-91d1-4f2b-b9af-2f79910cd4a2'} Oct 22 21:00:41.532591 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:00:41.532591 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:00:41.532591 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 22 21:00:41.532591 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 22 21:00:41.532591 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 21:00:41.532591 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 21:00:41.532591 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 22 21:00:41.532591 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 22 21:00:41.532591 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 21:00:41.532591 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 21:00:41.532591 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 22 21:00:41.532591 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 22 21:00:41.532591 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 21:00:41.532591 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 21:00:41.532591 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 22 21:00:41.532591 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 22 21:00:41.532591 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 21:00:41.532591 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 21:00:41.532591 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 22 21:00:41.532591 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 22 21:00:41.532591 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 21:00:41.532591 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 21:00:41.532591 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 22 21:00:41.532591 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 22 21:00:41.532591 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 22 21:00:41.532591 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 22 21:00:41.532591 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 27359005-91d1-4f2b-b9af-2f79910cd4a2 does not exist Oct 22 21:00:41.536537 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5bfcad42-de23-4aed-957b-d8cdf035074a'] Oct 22 21:00:41.536537 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:00:41.536537 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:00:41.536537 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:00:41.536537 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:00:41.536537 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 22 21:00:41.536537 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 22 21:00:41.536537 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 22 21:00:41.536537 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 22 21:00:41.536537 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 27359005-91d1-4f2b-b9af-2f79910cd4a2 does not exist Oct 22 21:00:41.536537 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5bfcad42-de23-4aed-957b-d8cdf035074a'] Oct 22 21:00:41.536537 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:00:41.536537 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:00:41.536537 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:00:41.536537 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:00:41.536537 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:00:41.536537 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:00:41.536537 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:00:41.536537 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:00:41.536537 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 22 21:00:41.536537 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 22 21:00:41.536537 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:00:41.536537 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:00:41.536537 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 22 21:00:41.536537 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 22 21:00:41.536537 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 27359005-91d1-4f2b-b9af-2f79910cd4a2 does not exist Oct 22 21:00:41.536537 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5bfcad42-de23-4aed-957b-d8cdf035074a'] Oct 22 21:00:41.536537 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:00:41.536537 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:00:41.536537 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:00:41.536537 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:00:41.536537 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:00:41.536537 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:00:41.536537 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:00:41.536537 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:00:41.536537 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 27359005-91d1-4f2b-b9af-2f79910cd4a2 does not exist Oct 22 21:00:41.536537 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5bfcad42-de23-4aed-957b-d8cdf035074a'] Oct 22 21:00:41.536537 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:00:41.546227 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-18ba2ca1-30eb-41b4-8de9-a56390e442a4 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Returning 404 to user: Security group 27359005-91d1-4f2b-b9af-2f79910cd4a2 does not exist Oct 22 21:00:41.546227 ncdv-master-1 devstack@n-api.service[138745]: Neutron server returns request_ids: ['req-5bfcad42-de23-4aed-957b-d8cdf035074a'] {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:00:41.547364 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-18ba2ca1-30eb-41b4-8de9-a56390e442a4 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/27359005-91d1-4f2b-b9af-2f79910cd4a2" status: 404 len: 194 microversion: 2.1 time: 0.052059 Oct 22 21:00:41.548244 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1362/2591] 10.222.0.18 () {58 vars in 1272 bytes} [Sat Oct 22 21:00:41 2022] DELETE /compute/v2.1/os-security-groups/27359005-91d1-4f2b-b9af-2f79910cd4a2 => generated 194 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 21:00:41.556986 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-d7b96883-b89d-467e-8faf-2b40fca1f341 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Calling method '.version_select at 0x7fd39f179670>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:00:41.582284 ncdv-master-1 devstack@n-api.service[138744]: DEBUG neutronclient.v2_0.client [None req-d7b96883-b89d-467e-8faf-2b40fca1f341 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 17bb2929-41c0-43e3-930a-9c480452d22b does not exist", "detail": ""}} {{(pid=138744) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 22 21:00:41.583007 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.network.security_group_api [None req-d7b96883-b89d-467e-8faf-2b40fca1f341 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Neutron security group 17bb2929-41c0-43e3-930a-9c480452d22b not found {{(pid=138744) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 22 21:00:41.583756 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-d7b96883-b89d-467e-8faf-2b40fca1f341 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] HTTP exception thrown: Security group 17bb2929-41c0-43e3-930a-9c480452d22b does not exist Oct 22 21:00:41.583756 ncdv-master-1 devstack@n-api.service[138744]: Neutron server returns request_ids: ['req-d40da99e-fe75-4436-94f8-4bf00100d986'] Oct 22 21:00:41.585791 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-d7b96883-b89d-467e-8faf-2b40fca1f341 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Request method failure captured: Oct 22 21:00:41.585791 ncdv-master-1 devstack@n-api.service[138744]: request: DELETE /compute/v2.1/os-security-groups/17bb2929-41c0-43e3-930a-9c480452d22b HTTP/1.1 Oct 22 21:00:41.585791 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 21:00:41.585791 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 21:00:41.585791 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 21:00:41.585791 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 0 Oct 22 21:00:41.585791 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 21:00:41.585791 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 21:00:41.585791 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 21:00:41.585791 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 21:00:41.585791 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVFmMTFo8tMXHI466ygTiy0jTs5kz8YO2nFuimSyZRJI5bXNUfHpPLWjQrXyJ7I9Xfc54HQRfYflULj68lfwBk5jrnjY79oZ1kbdK55vumR_IVvMJmaykrPjWliG3H4xf-SZHnU3invPEATeZO7VP5aTca0hd9BauSvYCW1UPdVAZZ70 Oct 22 21:00:41.585791 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 21:00:41.585791 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 21:00:41.585791 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 21:00:41.585791 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 21:00:41.585791 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 21:00:41.585791 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 21:00:41.585791 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: ed31e93b0e8a43f28e497f94318815ce Oct 22 21:00:41.585791 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-SecurityGroupsTestJSON-1604956559 Oct 22 21:00:41.585791 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 21:00:41.585791 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 21:00:41.585791 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ed31e93b0e8a43f28e497f94318815ce"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ed31e93b0e8a43f28e497f94318815ce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ed31e93b0e8a43f28e497f94318815ce"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ed31e93b0e8a43f28e497f94318815ce"}]}] Oct 22 21:00:41.585791 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-SecurityGroupsTestJSON-1604956559 Oct 22 21:00:41.585791 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: ed31e93b0e8a43f28e497f94318815ce Oct 22 21:00:41.585791 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1604956559 Oct 22 21:00:41.585791 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-SecurityGroupsTestJSON-1604956559-project Oct 22 21:00:41.585791 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 21:00:41.585791 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 21:00:41.585791 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: 46d49952dbca4d95a25411b65d56552b Oct 22 21:00:41.585791 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-SecurityGroupsTestJSON-1604956559-project Oct 22 21:00:41.585791 ncdv-master-1 devstack@n-api.service[138744]: method: Oct 22 21:00:41.585791 ncdv-master-1 devstack@n-api.service[138744]: exception: Security group 17bb2929-41c0-43e3-930a-9c480452d22b does not exist Oct 22 21:00:41.585791 ncdv-master-1 devstack@n-api.service[138744]: Neutron server returns request_ids: ['req-d40da99e-fe75-4436-94f8-4bf00100d986'] Oct 22 21:00:41.585791 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': '17bb2929-41c0-43e3-930a-9c480452d22b'} Oct 22 21:00:41.585791 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:00:41.585791 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:00:41.585791 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 22 21:00:41.585791 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 22 21:00:41.585791 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 21:00:41.585791 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 21:00:41.585791 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 22 21:00:41.585791 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 22 21:00:41.585791 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 21:00:41.585791 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 21:00:41.585791 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 22 21:00:41.585791 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 22 21:00:41.585791 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 21:00:41.585791 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 21:00:41.585791 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 22 21:00:41.585791 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 22 21:00:41.585791 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 21:00:41.585791 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 21:00:41.585791 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 22 21:00:41.585791 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 22 21:00:41.585791 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 21:00:41.585791 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 21:00:41.585791 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 22 21:00:41.585791 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 22 21:00:41.585791 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 22 21:00:41.585791 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 22 21:00:41.585791 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 17bb2929-41c0-43e3-930a-9c480452d22b does not exist Oct 22 21:00:41.590052 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d40da99e-fe75-4436-94f8-4bf00100d986'] Oct 22 21:00:41.590052 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:00:41.590052 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:00:41.590052 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:00:41.590052 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:00:41.590052 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 22 21:00:41.590052 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 22 21:00:41.590052 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 22 21:00:41.590052 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 22 21:00:41.590052 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 17bb2929-41c0-43e3-930a-9c480452d22b does not exist Oct 22 21:00:41.590052 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d40da99e-fe75-4436-94f8-4bf00100d986'] Oct 22 21:00:41.590052 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:00:41.590052 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:00:41.590052 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:00:41.590052 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:00:41.590052 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:00:41.590052 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:00:41.590052 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:00:41.590052 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:00:41.590052 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 22 21:00:41.590052 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 22 21:00:41.590052 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:00:41.590052 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:00:41.590052 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 22 21:00:41.590052 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 22 21:00:41.590052 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 17bb2929-41c0-43e3-930a-9c480452d22b does not exist Oct 22 21:00:41.590052 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d40da99e-fe75-4436-94f8-4bf00100d986'] Oct 22 21:00:41.590052 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:00:41.590052 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:00:41.590052 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:00:41.590052 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:00:41.590052 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:00:41.590052 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:00:41.590052 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:00:41.590052 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:00:41.590052 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 17bb2929-41c0-43e3-930a-9c480452d22b does not exist Oct 22 21:00:41.590052 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d40da99e-fe75-4436-94f8-4bf00100d986'] Oct 22 21:00:41.590052 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:00:41.590052 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-d7b96883-b89d-467e-8faf-2b40fca1f341 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Returning 404 to user: Security group 17bb2929-41c0-43e3-930a-9c480452d22b does not exist Oct 22 21:00:41.590052 ncdv-master-1 devstack@n-api.service[138744]: Neutron server returns request_ids: ['req-d40da99e-fe75-4436-94f8-4bf00100d986'] {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:00:41.590052 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-d7b96883-b89d-467e-8faf-2b40fca1f341 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/17bb2929-41c0-43e3-930a-9c480452d22b" status: 404 len: 194 microversion: 2.1 time: 0.034376 Oct 22 21:00:41.590052 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1230/2592] 10.222.0.18 () {58 vars in 1272 bytes} [Sat Oct 22 21:00:41 2022] DELETE /compute/v2.1/os-security-groups/17bb2929-41c0-43e3-930a-9c480452d22b => generated 194 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 21:00:41.596839 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-498742f8-4ed6-4910-a9ae-f3eb4d3063a5 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Calling method '.version_select at 0x7fd3a44e9430>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:00:41.656694 ncdv-master-1 devstack@n-api.service[138745]: DEBUG neutronclient.v2_0.client [None req-498742f8-4ed6-4910-a9ae-f3eb4d3063a5 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 326b3bb2-542e-4abe-8a93-43ee175deff5 does not exist", "detail": ""}} {{(pid=138745) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 22 21:00:41.657504 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.network.security_group_api [None req-498742f8-4ed6-4910-a9ae-f3eb4d3063a5 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Neutron security group 326b3bb2-542e-4abe-8a93-43ee175deff5 not found {{(pid=138745) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 22 21:00:41.658177 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.wsgi [None req-498742f8-4ed6-4910-a9ae-f3eb4d3063a5 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] HTTP exception thrown: Security group 326b3bb2-542e-4abe-8a93-43ee175deff5 does not exist Oct 22 21:00:41.658177 ncdv-master-1 devstack@n-api.service[138745]: Neutron server returns request_ids: ['req-b71ae099-b0d0-461d-970b-cd942e64b2b6'] Oct 22 21:00:41.660488 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-498742f8-4ed6-4910-a9ae-f3eb4d3063a5 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Request method failure captured: Oct 22 21:00:41.660488 ncdv-master-1 devstack@n-api.service[138745]: request: DELETE /compute/v2.1/os-security-groups/326b3bb2-542e-4abe-8a93-43ee175deff5 HTTP/1.1 Oct 22 21:00:41.660488 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 21:00:41.660488 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 21:00:41.660488 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 21:00:41.660488 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 0 Oct 22 21:00:41.660488 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 21:00:41.660488 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 21:00:41.660488 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 21:00:41.660488 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 21:00:41.660488 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVFmMTFo8tMXHI466ygTiy0jTs5kz8YO2nFuimSyZRJI5bXNUfHpPLWjQrXyJ7I9Xfc54HQRfYflULj68lfwBk5jrnjY79oZ1kbdK55vumR_IVvMJmaykrPjWliG3H4xf-SZHnU3invPEATeZO7VP5aTca0hd9BauSvYCW1UPdVAZZ70 Oct 22 21:00:41.660488 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 21:00:41.660488 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 21:00:41.660488 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 21:00:41.660488 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 21:00:41.660488 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 21:00:41.660488 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 21:00:41.660488 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: ed31e93b0e8a43f28e497f94318815ce Oct 22 21:00:41.660488 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-SecurityGroupsTestJSON-1604956559 Oct 22 21:00:41.660488 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 21:00:41.660488 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 21:00:41.660488 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ed31e93b0e8a43f28e497f94318815ce"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ed31e93b0e8a43f28e497f94318815ce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ed31e93b0e8a43f28e497f94318815ce"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ed31e93b0e8a43f28e497f94318815ce"}]}] Oct 22 21:00:41.660488 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-SecurityGroupsTestJSON-1604956559 Oct 22 21:00:41.660488 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: ed31e93b0e8a43f28e497f94318815ce Oct 22 21:00:41.660488 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1604956559 Oct 22 21:00:41.660488 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-SecurityGroupsTestJSON-1604956559-project Oct 22 21:00:41.660488 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 21:00:41.660488 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 21:00:41.660488 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: 46d49952dbca4d95a25411b65d56552b Oct 22 21:00:41.660488 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-SecurityGroupsTestJSON-1604956559-project Oct 22 21:00:41.660488 ncdv-master-1 devstack@n-api.service[138745]: method: Oct 22 21:00:41.660488 ncdv-master-1 devstack@n-api.service[138745]: exception: Security group 326b3bb2-542e-4abe-8a93-43ee175deff5 does not exist Oct 22 21:00:41.660488 ncdv-master-1 devstack@n-api.service[138745]: Neutron server returns request_ids: ['req-b71ae099-b0d0-461d-970b-cd942e64b2b6'] Oct 22 21:00:41.660488 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'id': '326b3bb2-542e-4abe-8a93-43ee175deff5'} Oct 22 21:00:41.660488 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:00:41.660488 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:00:41.660488 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 22 21:00:41.660488 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 22 21:00:41.660488 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 21:00:41.660488 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 21:00:41.660488 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 22 21:00:41.660488 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 22 21:00:41.660488 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 21:00:41.660488 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 21:00:41.660488 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 22 21:00:41.660488 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 22 21:00:41.660488 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 21:00:41.660488 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 21:00:41.660488 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 22 21:00:41.660488 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 22 21:00:41.660488 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 21:00:41.660488 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 21:00:41.660488 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 22 21:00:41.660488 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 22 21:00:41.660488 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 21:00:41.660488 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 21:00:41.660488 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 22 21:00:41.660488 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 22 21:00:41.660488 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 22 21:00:41.660488 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 22 21:00:41.660488 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 326b3bb2-542e-4abe-8a93-43ee175deff5 does not exist Oct 22 21:00:41.664741 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b71ae099-b0d0-461d-970b-cd942e64b2b6'] Oct 22 21:00:41.664741 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:00:41.664741 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:00:41.664741 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:00:41.664741 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:00:41.664741 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 22 21:00:41.664741 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 22 21:00:41.664741 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 22 21:00:41.664741 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 22 21:00:41.664741 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 326b3bb2-542e-4abe-8a93-43ee175deff5 does not exist Oct 22 21:00:41.664741 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b71ae099-b0d0-461d-970b-cd942e64b2b6'] Oct 22 21:00:41.664741 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:00:41.664741 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:00:41.664741 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:00:41.664741 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:00:41.664741 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:00:41.664741 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:00:41.664741 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:00:41.664741 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:00:41.664741 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 22 21:00:41.664741 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 22 21:00:41.664741 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:00:41.664741 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:00:41.664741 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 22 21:00:41.664741 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 22 21:00:41.664741 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 326b3bb2-542e-4abe-8a93-43ee175deff5 does not exist Oct 22 21:00:41.664741 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b71ae099-b0d0-461d-970b-cd942e64b2b6'] Oct 22 21:00:41.664741 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:00:41.664741 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:00:41.664741 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:00:41.664741 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:00:41.664741 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:00:41.664741 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:00:41.664741 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:00:41.664741 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:00:41.664741 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 326b3bb2-542e-4abe-8a93-43ee175deff5 does not exist Oct 22 21:00:41.664741 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b71ae099-b0d0-461d-970b-cd942e64b2b6'] Oct 22 21:00:41.664741 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:00:41.669150 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-498742f8-4ed6-4910-a9ae-f3eb4d3063a5 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Returning 404 to user: Security group 326b3bb2-542e-4abe-8a93-43ee175deff5 does not exist Oct 22 21:00:41.669150 ncdv-master-1 devstack@n-api.service[138745]: Neutron server returns request_ids: ['req-b71ae099-b0d0-461d-970b-cd942e64b2b6'] {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:00:41.670047 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-498742f8-4ed6-4910-a9ae-f3eb4d3063a5 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/326b3bb2-542e-4abe-8a93-43ee175deff5" status: 404 len: 194 microversion: 2.1 time: 0.077450 Oct 22 21:00:41.670630 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1363/2593] 10.222.0.18 () {58 vars in 1272 bytes} [Sat Oct 22 21:00:41 2022] DELETE /compute/v2.1/os-security-groups/326b3bb2-542e-4abe-8a93-43ee175deff5 => generated 194 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 21:00:41.678874 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-9bcda47a-041b-4475-9624-c533ac03ffb3 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Calling method '.version_select at 0x7fd39f148c10>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:00:41.733918 ncdv-master-1 devstack@n-api.service[138744]: DEBUG neutronclient.v2_0.client [None req-9bcda47a-041b-4475-9624-c533ac03ffb3 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 7e3d4dfe-6b84-486f-b7a1-bfe00a565aa6 does not exist", "detail": ""}} {{(pid=138744) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 22 21:00:41.734577 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.network.security_group_api [None req-9bcda47a-041b-4475-9624-c533ac03ffb3 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Neutron security group 7e3d4dfe-6b84-486f-b7a1-bfe00a565aa6 not found {{(pid=138744) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 22 21:00:41.735269 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-9bcda47a-041b-4475-9624-c533ac03ffb3 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] HTTP exception thrown: Security group 7e3d4dfe-6b84-486f-b7a1-bfe00a565aa6 does not exist Oct 22 21:00:41.735269 ncdv-master-1 devstack@n-api.service[138744]: Neutron server returns request_ids: ['req-163a6820-70c2-4565-8e5e-69bacf683331'] Oct 22 21:00:41.737184 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-9bcda47a-041b-4475-9624-c533ac03ffb3 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Request method failure captured: Oct 22 21:00:41.737184 ncdv-master-1 devstack@n-api.service[138744]: request: DELETE /compute/v2.1/os-security-groups/7e3d4dfe-6b84-486f-b7a1-bfe00a565aa6 HTTP/1.1 Oct 22 21:00:41.737184 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 21:00:41.737184 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 21:00:41.737184 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 21:00:41.737184 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 0 Oct 22 21:00:41.737184 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 21:00:41.737184 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 21:00:41.737184 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 21:00:41.737184 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 21:00:41.737184 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVFmMTFo8tMXHI466ygTiy0jTs5kz8YO2nFuimSyZRJI5bXNUfHpPLWjQrXyJ7I9Xfc54HQRfYflULj68lfwBk5jrnjY79oZ1kbdK55vumR_IVvMJmaykrPjWliG3H4xf-SZHnU3invPEATeZO7VP5aTca0hd9BauSvYCW1UPdVAZZ70 Oct 22 21:00:41.737184 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 21:00:41.737184 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 21:00:41.737184 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 21:00:41.737184 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 21:00:41.737184 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 21:00:41.737184 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 21:00:41.737184 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: ed31e93b0e8a43f28e497f94318815ce Oct 22 21:00:41.737184 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-SecurityGroupsTestJSON-1604956559 Oct 22 21:00:41.737184 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 21:00:41.737184 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 21:00:41.737184 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ed31e93b0e8a43f28e497f94318815ce"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ed31e93b0e8a43f28e497f94318815ce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ed31e93b0e8a43f28e497f94318815ce"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ed31e93b0e8a43f28e497f94318815ce"}]}] Oct 22 21:00:41.737184 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-SecurityGroupsTestJSON-1604956559 Oct 22 21:00:41.737184 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: ed31e93b0e8a43f28e497f94318815ce Oct 22 21:00:41.737184 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1604956559 Oct 22 21:00:41.737184 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-SecurityGroupsTestJSON-1604956559-project Oct 22 21:00:41.737184 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 21:00:41.737184 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 21:00:41.737184 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: 46d49952dbca4d95a25411b65d56552b Oct 22 21:00:41.737184 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-SecurityGroupsTestJSON-1604956559-project Oct 22 21:00:41.737184 ncdv-master-1 devstack@n-api.service[138744]: method: Oct 22 21:00:41.737184 ncdv-master-1 devstack@n-api.service[138744]: exception: Security group 7e3d4dfe-6b84-486f-b7a1-bfe00a565aa6 does not exist Oct 22 21:00:41.737184 ncdv-master-1 devstack@n-api.service[138744]: Neutron server returns request_ids: ['req-163a6820-70c2-4565-8e5e-69bacf683331'] Oct 22 21:00:41.737184 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': '7e3d4dfe-6b84-486f-b7a1-bfe00a565aa6'} Oct 22 21:00:41.737184 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:00:41.737184 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:00:41.737184 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 22 21:00:41.737184 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 22 21:00:41.737184 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 21:00:41.737184 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 21:00:41.737184 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 22 21:00:41.737184 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 22 21:00:41.737184 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 21:00:41.737184 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 21:00:41.737184 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 22 21:00:41.737184 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 22 21:00:41.737184 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 21:00:41.737184 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 21:00:41.737184 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 22 21:00:41.737184 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 22 21:00:41.737184 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 21:00:41.737184 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 21:00:41.737184 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 22 21:00:41.737184 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 22 21:00:41.737184 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 21:00:41.737184 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 21:00:41.737184 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 22 21:00:41.737184 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 22 21:00:41.737184 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 22 21:00:41.737184 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 22 21:00:41.737184 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 7e3d4dfe-6b84-486f-b7a1-bfe00a565aa6 does not exist Oct 22 21:00:41.743591 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-163a6820-70c2-4565-8e5e-69bacf683331'] Oct 22 21:00:41.743591 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:00:41.743591 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:00:41.743591 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:00:41.743591 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:00:41.743591 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 22 21:00:41.743591 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 22 21:00:41.743591 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 22 21:00:41.743591 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 22 21:00:41.743591 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 7e3d4dfe-6b84-486f-b7a1-bfe00a565aa6 does not exist Oct 22 21:00:41.743591 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-163a6820-70c2-4565-8e5e-69bacf683331'] Oct 22 21:00:41.743591 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:00:41.743591 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:00:41.743591 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:00:41.743591 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:00:41.743591 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:00:41.743591 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:00:41.743591 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:00:41.743591 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:00:41.743591 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 22 21:00:41.743591 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 22 21:00:41.743591 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:00:41.743591 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:00:41.743591 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 22 21:00:41.743591 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 22 21:00:41.743591 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 7e3d4dfe-6b84-486f-b7a1-bfe00a565aa6 does not exist Oct 22 21:00:41.743591 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-163a6820-70c2-4565-8e5e-69bacf683331'] Oct 22 21:00:41.743591 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:00:41.743591 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:00:41.743591 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:00:41.743591 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:00:41.743591 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:00:41.743591 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:00:41.743591 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:00:41.743591 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:00:41.743591 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 7e3d4dfe-6b84-486f-b7a1-bfe00a565aa6 does not exist Oct 22 21:00:41.743591 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-163a6820-70c2-4565-8e5e-69bacf683331'] Oct 22 21:00:41.743591 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:00:41.743591 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-9bcda47a-041b-4475-9624-c533ac03ffb3 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Returning 404 to user: Security group 7e3d4dfe-6b84-486f-b7a1-bfe00a565aa6 does not exist Oct 22 21:00:41.743591 ncdv-master-1 devstack@n-api.service[138744]: Neutron server returns request_ids: ['req-163a6820-70c2-4565-8e5e-69bacf683331'] {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:00:41.743591 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-9bcda47a-041b-4475-9624-c533ac03ffb3 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/7e3d4dfe-6b84-486f-b7a1-bfe00a565aa6" status: 404 len: 194 microversion: 2.1 time: 0.063700 Oct 22 21:00:41.743591 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1231/2594] 10.222.0.18 () {58 vars in 1272 bytes} [Sat Oct 22 21:00:41 2022] DELETE /compute/v2.1/os-security-groups/7e3d4dfe-6b84-486f-b7a1-bfe00a565aa6 => generated 194 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 22 21:00:41.750471 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-a3b272fc-96d3-4a76-9eb2-5b728f60a33b tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Calling method '.version_select at 0x7fd39fd83940>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:00:41.801101 ncdv-master-1 devstack@n-api.service[138745]: DEBUG neutronclient.v2_0.client [None req-a3b272fc-96d3-4a76-9eb2-5b728f60a33b tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 47204768-cbb0-4674-8079-d3d8252cc4df does not exist", "detail": ""}} {{(pid=138745) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 22 21:00:41.802423 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.network.security_group_api [None req-a3b272fc-96d3-4a76-9eb2-5b728f60a33b tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Neutron security group 47204768-cbb0-4674-8079-d3d8252cc4df not found {{(pid=138745) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 22 21:00:41.804683 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.wsgi [None req-a3b272fc-96d3-4a76-9eb2-5b728f60a33b tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] HTTP exception thrown: Security group 47204768-cbb0-4674-8079-d3d8252cc4df does not exist Oct 22 21:00:41.804683 ncdv-master-1 devstack@n-api.service[138745]: Neutron server returns request_ids: ['req-8cf9f0c3-8ecb-4a9e-b5e8-1d335ad1c2e5'] Oct 22 21:00:41.807655 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-a3b272fc-96d3-4a76-9eb2-5b728f60a33b tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Request method failure captured: Oct 22 21:00:41.807655 ncdv-master-1 devstack@n-api.service[138745]: request: DELETE /compute/v2.1/os-security-groups/47204768-cbb0-4674-8079-d3d8252cc4df HTTP/1.1 Oct 22 21:00:41.807655 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 21:00:41.807655 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 21:00:41.807655 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 21:00:41.807655 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 0 Oct 22 21:00:41.807655 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 21:00:41.807655 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 21:00:41.807655 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 21:00:41.807655 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 21:00:41.807655 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVFmMTFo8tMXHI466ygTiy0jTs5kz8YO2nFuimSyZRJI5bXNUfHpPLWjQrXyJ7I9Xfc54HQRfYflULj68lfwBk5jrnjY79oZ1kbdK55vumR_IVvMJmaykrPjWliG3H4xf-SZHnU3invPEATeZO7VP5aTca0hd9BauSvYCW1UPdVAZZ70 Oct 22 21:00:41.807655 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 21:00:41.807655 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 21:00:41.807655 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 21:00:41.807655 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 21:00:41.807655 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 21:00:41.807655 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 21:00:41.807655 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: ed31e93b0e8a43f28e497f94318815ce Oct 22 21:00:41.807655 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-SecurityGroupsTestJSON-1604956559 Oct 22 21:00:41.807655 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 21:00:41.807655 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 21:00:41.807655 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ed31e93b0e8a43f28e497f94318815ce"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ed31e93b0e8a43f28e497f94318815ce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ed31e93b0e8a43f28e497f94318815ce"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ed31e93b0e8a43f28e497f94318815ce"}]}] Oct 22 21:00:41.807655 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-SecurityGroupsTestJSON-1604956559 Oct 22 21:00:41.807655 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: ed31e93b0e8a43f28e497f94318815ce Oct 22 21:00:41.807655 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1604956559 Oct 22 21:00:41.807655 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-SecurityGroupsTestJSON-1604956559-project Oct 22 21:00:41.807655 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 21:00:41.807655 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 21:00:41.807655 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: 46d49952dbca4d95a25411b65d56552b Oct 22 21:00:41.807655 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-SecurityGroupsTestJSON-1604956559-project Oct 22 21:00:41.807655 ncdv-master-1 devstack@n-api.service[138745]: method: Oct 22 21:00:41.807655 ncdv-master-1 devstack@n-api.service[138745]: exception: Security group 47204768-cbb0-4674-8079-d3d8252cc4df does not exist Oct 22 21:00:41.807655 ncdv-master-1 devstack@n-api.service[138745]: Neutron server returns request_ids: ['req-8cf9f0c3-8ecb-4a9e-b5e8-1d335ad1c2e5'] Oct 22 21:00:41.807655 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'id': '47204768-cbb0-4674-8079-d3d8252cc4df'} Oct 22 21:00:41.807655 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:00:41.807655 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:00:41.807655 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 22 21:00:41.807655 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 22 21:00:41.807655 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 21:00:41.807655 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 21:00:41.807655 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 22 21:00:41.807655 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 22 21:00:41.807655 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 21:00:41.807655 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 21:00:41.807655 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 22 21:00:41.807655 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 22 21:00:41.807655 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 21:00:41.807655 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 21:00:41.807655 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 22 21:00:41.807655 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 22 21:00:41.807655 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 21:00:41.807655 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 21:00:41.807655 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 22 21:00:41.807655 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 22 21:00:41.807655 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 21:00:41.807655 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 21:00:41.807655 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 22 21:00:41.807655 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 22 21:00:41.807655 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 22 21:00:41.807655 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 22 21:00:41.807655 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 47204768-cbb0-4674-8079-d3d8252cc4df does not exist Oct 22 21:00:41.814651 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8cf9f0c3-8ecb-4a9e-b5e8-1d335ad1c2e5'] Oct 22 21:00:41.814651 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:00:41.814651 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:00:41.814651 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:00:41.814651 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:00:41.814651 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 22 21:00:41.814651 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 22 21:00:41.814651 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 22 21:00:41.814651 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 22 21:00:41.814651 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 47204768-cbb0-4674-8079-d3d8252cc4df does not exist Oct 22 21:00:41.814651 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8cf9f0c3-8ecb-4a9e-b5e8-1d335ad1c2e5'] Oct 22 21:00:41.814651 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:00:41.814651 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:00:41.814651 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:00:41.814651 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:00:41.814651 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:00:41.814651 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:00:41.814651 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:00:41.814651 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:00:41.814651 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 22 21:00:41.814651 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 22 21:00:41.814651 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:00:41.814651 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:00:41.814651 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 22 21:00:41.814651 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 22 21:00:41.814651 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 47204768-cbb0-4674-8079-d3d8252cc4df does not exist Oct 22 21:00:41.814651 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8cf9f0c3-8ecb-4a9e-b5e8-1d335ad1c2e5'] Oct 22 21:00:41.814651 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:00:41.814651 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:00:41.814651 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:00:41.814651 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:00:41.814651 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:00:41.814651 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:00:41.814651 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:00:41.814651 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:00:41.814651 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 47204768-cbb0-4674-8079-d3d8252cc4df does not exist Oct 22 21:00:41.814651 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8cf9f0c3-8ecb-4a9e-b5e8-1d335ad1c2e5'] Oct 22 21:00:41.814651 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:00:41.814651 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-a3b272fc-96d3-4a76-9eb2-5b728f60a33b tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Returning 404 to user: Security group 47204768-cbb0-4674-8079-d3d8252cc4df does not exist Oct 22 21:00:41.814651 ncdv-master-1 devstack@n-api.service[138745]: Neutron server returns request_ids: ['req-8cf9f0c3-8ecb-4a9e-b5e8-1d335ad1c2e5'] {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:00:41.814651 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-a3b272fc-96d3-4a76-9eb2-5b728f60a33b tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/47204768-cbb0-4674-8079-d3d8252cc4df" status: 404 len: 194 microversion: 2.1 time: 0.065517 Oct 22 21:00:41.818444 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1364/2595] 10.222.0.18 () {58 vars in 1272 bytes} [Sat Oct 22 21:00:41 2022] DELETE /compute/v2.1/os-security-groups/47204768-cbb0-4674-8079-d3d8252cc4df => generated 194 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 21:00:41.835379 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-7d361020-f8a6-49fe-ade7-29c28f8a7c7a tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:00:41.835998 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-7d361020-f8a6-49fe-ade7-29c28f8a7c7a tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] [instance: 61d89bc7-fcfe-479b-baa1-7307a4395cc3] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:00:41.858404 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-64c67bc5-5677-460d-b653-a3fa3b9907c8 tempest-ServerDiagnosticsNegativeTest-616658542 tempest-ServerDiagnosticsNegativeTest-616658542-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:00:41.859043 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-64c67bc5-5677-460d-b653-a3fa3b9907c8 tempest-ServerDiagnosticsNegativeTest-616658542 tempest-ServerDiagnosticsNegativeTest-616658542-project] [instance: 5e249f40-5d17-49e0-8b86-75f2b4f089c2] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:00:41.874767 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7d361020-f8a6-49fe-ade7-29c28f8a7c7a tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:41.875286 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7d361020-f8a6-49fe-ade7-29c28f8a7c7a tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:41.875769 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7d361020-f8a6-49fe-ade7-29c28f8a7c7a tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:41.876500 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7d361020-f8a6-49fe-ade7-29c28f8a7c7a tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:41.876964 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7d361020-f8a6-49fe-ade7-29c28f8a7c7a tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:41.877400 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7d361020-f8a6-49fe-ade7-29c28f8a7c7a tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:41.889221 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-64c67bc5-5677-460d-b653-a3fa3b9907c8 tempest-ServerDiagnosticsNegativeTest-616658542 tempest-ServerDiagnosticsNegativeTest-616658542-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:41.891985 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-64c67bc5-5677-460d-b653-a3fa3b9907c8 tempest-ServerDiagnosticsNegativeTest-616658542 tempest-ServerDiagnosticsNegativeTest-616658542-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:41.894691 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-64c67bc5-5677-460d-b653-a3fa3b9907c8 tempest-ServerDiagnosticsNegativeTest-616658542 tempest-ServerDiagnosticsNegativeTest-616658542-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:41.901640 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-64c67bc5-5677-460d-b653-a3fa3b9907c8 tempest-ServerDiagnosticsNegativeTest-616658542 tempest-ServerDiagnosticsNegativeTest-616658542-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:41.906610 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-64c67bc5-5677-460d-b653-a3fa3b9907c8 tempest-ServerDiagnosticsNegativeTest-616658542 tempest-ServerDiagnosticsNegativeTest-616658542-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:41.908831 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-64c67bc5-5677-460d-b653-a3fa3b9907c8 tempest-ServerDiagnosticsNegativeTest-616658542 tempest-ServerDiagnosticsNegativeTest-616658542-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:41.997939 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-7d361020-f8a6-49fe-ade7-29c28f8a7c7a tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] [instance: 61d89bc7-fcfe-479b-baa1-7307a4395cc3] Going to try to terminate instance {{(pid=138744) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 21:00:42.168689 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-7d361020-f8a6-49fe-ade7-29c28f8a7c7a tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] 10.222.0.18 "DELETE /compute/v2.1/servers/61d89bc7-fcfe-479b-baa1-7307a4395cc3" status: 204 len: 0 microversion: 2.1 time: 0.341201 Oct 22 21:00:42.175095 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1232/2596] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 21:00:41 2022] DELETE /compute/v2.1/servers/61d89bc7-fcfe-479b-baa1-7307a4395cc3 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 21:00:42.182110 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-b7a39e3d-f11a-4ae1-ae68-7f636bd35938 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:00:42.183103 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-b7a39e3d-f11a-4ae1-ae68-7f636bd35938 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] [instance: eb38dcff-5703-4735-bf8e-6a40d51d8567] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:00:42.192642 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b7a39e3d-f11a-4ae1-ae68-7f636bd35938 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:42.193522 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b7a39e3d-f11a-4ae1-ae68-7f636bd35938 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:42.194469 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b7a39e3d-f11a-4ae1-ae68-7f636bd35938 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:42.195974 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b7a39e3d-f11a-4ae1-ae68-7f636bd35938 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:42.196653 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b7a39e3d-f11a-4ae1-ae68-7f636bd35938 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:42.198097 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b7a39e3d-f11a-4ae1-ae68-7f636bd35938 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:42.510178 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-64c67bc5-5677-460d-b653-a3fa3b9907c8 tempest-ServerDiagnosticsNegativeTest-616658542 tempest-ServerDiagnosticsNegativeTest-616658542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42dbc5f3bc042ef935dd95e123bab0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ca06233c6b4e808308cf6613eb8db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:00:42.553945 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-b7a39e3d-f11a-4ae1-ae68-7f636bd35938 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1b410a64e0415a96d30f5040361137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd7873d6db4e09bc9ab9a048a6b1ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:00:42.564496 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-64c67bc5-5677-460d-b653-a3fa3b9907c8 tempest-ServerDiagnosticsNegativeTest-616658542 tempest-ServerDiagnosticsNegativeTest-616658542-project] 10.222.0.18 "GET /compute/v2.1/servers/5e249f40-5d17-49e0-8b86-75f2b4f089c2" status: 200 len: 1323 microversion: 2.1 time: 0.717511 Oct 22 21:00:42.566471 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1365/2597] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:00:41 2022] GET /compute/v2.1/servers/5e249f40-5d17-49e0-8b86-75f2b4f089c2 => generated 1323 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:00:42.569819 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-b7a39e3d-f11a-4ae1-ae68-7f636bd35938 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] 10.222.0.18 "GET /compute/v2.1/servers/eb38dcff-5703-4735-bf8e-6a40d51d8567" status: 200 len: 1507 microversion: 2.1 time: 0.388704 Oct 22 21:00:42.571847 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1233/2598] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:00:42 2022] GET /compute/v2.1/servers/eb38dcff-5703-4735-bf8e-6a40d51d8567 => generated 1507 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:00:42.584493 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-d136abc2-c630-40f0-93a4-103125f7f51e tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:00:42.586602 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-d136abc2-c630-40f0-93a4-103125f7f51e tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] [instance: 61d89bc7-fcfe-479b-baa1-7307a4395cc3] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:00:42.595919 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-962cc174-872d-4460-a632-1709a755266b tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:00:42.596218 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d136abc2-c630-40f0-93a4-103125f7f51e tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:42.596791 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-962cc174-872d-4460-a632-1709a755266b tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] [instance: af11a208-be6e-4f70-85f0-4bafafb4febd] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:00:42.597222 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d136abc2-c630-40f0-93a4-103125f7f51e tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:42.598308 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d136abc2-c630-40f0-93a4-103125f7f51e tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:42.599297 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d136abc2-c630-40f0-93a4-103125f7f51e tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:42.599955 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d136abc2-c630-40f0-93a4-103125f7f51e tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:42.600542 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d136abc2-c630-40f0-93a4-103125f7f51e tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:42.611423 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-962cc174-872d-4460-a632-1709a755266b tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:42.612400 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-962cc174-872d-4460-a632-1709a755266b tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:42.613047 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-962cc174-872d-4460-a632-1709a755266b tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:42.614018 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-962cc174-872d-4460-a632-1709a755266b tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:42.614745 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-962cc174-872d-4460-a632-1709a755266b tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:42.615406 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-962cc174-872d-4460-a632-1709a755266b tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:42.642997 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:00:43.045123 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-962cc174-872d-4460-a632-1709a755266b tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a44ff8e7c14b94b1670f030085c43d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a26a2284f4424cbeaf63d504652546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:00:43.065921 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-962cc174-872d-4460-a632-1709a755266b tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] 10.222.0.18 "GET /compute/v2.1/servers/af11a208-be6e-4f70-85f0-4bafafb4febd" status: 200 len: 1307 microversion: 2.1 time: 0.497868 Oct 22 21:00:43.067206 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-d136abc2-c630-40f0-93a4-103125f7f51e tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d49952dbca4d95a25411b65d56552b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed31e93b0e8a43f28e497f94318815ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:00:43.068015 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1366/2599] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:00:42 2022] GET /compute/v2.1/servers/af11a208-be6e-4f70-85f0-4bafafb4febd => generated 1307 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:00:43.075502 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-5b34fa12-8a94-4ff9-b9cb-24b5e41a2289 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Calling method '.version_select at 0x7fd39fc94040>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:00:43.078347 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-d136abc2-c630-40f0-93a4-103125f7f51e tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] 10.222.0.18 "GET /compute/v2.1/servers/61d89bc7-fcfe-479b-baa1-7307a4395cc3" status: 200 len: 1647 microversion: 2.1 time: 0.502503 Oct 22 21:00:43.098120 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1234/2600] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:00:42 2022] GET /compute/v2.1/servers/61d89bc7-fcfe-479b-baa1-7307a4395cc3 => generated 1647 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:00:43.109001 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-9440908f-0169-4791-8ae6-049d400fa98b req-480acd5c-58f3-4cff-bb81-f81184d19262 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb38dcff-5703-4735-bf8e-6a40d51d8567", "name": "network-vif-deleted", "tag": "957b60d9-87d1-4cbf-94c8-e20c540767c5"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:00:43.130652 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-9440908f-0169-4791-8ae6-049d400fa98b req-480acd5c-58f3-4cff-bb81-f81184d19262 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:43.131062 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-9440908f-0169-4791-8ae6-049d400fa98b req-480acd5c-58f3-4cff-bb81-f81184d19262 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:43.132502 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-9440908f-0169-4791-8ae6-049d400fa98b req-480acd5c-58f3-4cff-bb81-f81184d19262 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:43.152781 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-9440908f-0169-4791-8ae6-049d400fa98b req-480acd5c-58f3-4cff-bb81-f81184d19262 service nova] Creating event network-vif-deleted:957b60d9-87d1-4cbf-94c8-e20c540767c5 for instance eb38dcff-5703-4735-bf8e-6a40d51d8567 on nch2-master-1 Oct 22 21:00:43.154905 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-5b34fa12-8a94-4ff9-b9cb-24b5e41a2289 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] 10.222.0.18 "GET /compute/v2.1/images/8368f750-e203-4ef8-b979-ba7ef86a0df0" status: 200 len: 1455 microversion: 2.1 time: 0.085500 Oct 22 21:00:43.155842 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1367/2601] 10.222.0.18 () {58 vars in 1233 bytes} [Sat Oct 22 21:00:43 2022] GET /compute/v2.1/images/8368f750-e203-4ef8-b979-ba7ef86a0df0 => generated 1455 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:00:43.165757 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-9440908f-0169-4791-8ae6-049d400fa98b req-480acd5c-58f3-4cff-bb81-f81184d19262 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066007 Oct 22 21:00:43.166868 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1235/2602] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:00:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:00:43.590567 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-d32a0ebd-3cc7-4409-b2ea-b4b5c6a98e4e tempest-ServerDiagnosticsNegativeTest-616658542 tempest-ServerDiagnosticsNegativeTest-616658542-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:00:43.591681 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-d32a0ebd-3cc7-4409-b2ea-b4b5c6a98e4e tempest-ServerDiagnosticsNegativeTest-616658542 tempest-ServerDiagnosticsNegativeTest-616658542-project] [instance: 5e249f40-5d17-49e0-8b86-75f2b4f089c2] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:00:43.607743 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d32a0ebd-3cc7-4409-b2ea-b4b5c6a98e4e tempest-ServerDiagnosticsNegativeTest-616658542 tempest-ServerDiagnosticsNegativeTest-616658542-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:43.608484 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d32a0ebd-3cc7-4409-b2ea-b4b5c6a98e4e tempest-ServerDiagnosticsNegativeTest-616658542 tempest-ServerDiagnosticsNegativeTest-616658542-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:43.609111 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d32a0ebd-3cc7-4409-b2ea-b4b5c6a98e4e tempest-ServerDiagnosticsNegativeTest-616658542 tempest-ServerDiagnosticsNegativeTest-616658542-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:43.609992 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d32a0ebd-3cc7-4409-b2ea-b4b5c6a98e4e tempest-ServerDiagnosticsNegativeTest-616658542 tempest-ServerDiagnosticsNegativeTest-616658542-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:43.610581 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-3a264952-67b7-4b92-857d-51de5f1a8a52 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:00:43.610740 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d32a0ebd-3cc7-4409-b2ea-b4b5c6a98e4e tempest-ServerDiagnosticsNegativeTest-616658542 tempest-ServerDiagnosticsNegativeTest-616658542-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:43.611308 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d32a0ebd-3cc7-4409-b2ea-b4b5c6a98e4e tempest-ServerDiagnosticsNegativeTest-616658542 tempest-ServerDiagnosticsNegativeTest-616658542-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:43.613521 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-3a264952-67b7-4b92-857d-51de5f1a8a52 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] [instance: eb38dcff-5703-4735-bf8e-6a40d51d8567] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:00:43.637066 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3a264952-67b7-4b92-857d-51de5f1a8a52 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:43.638523 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3a264952-67b7-4b92-857d-51de5f1a8a52 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:43.639087 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3a264952-67b7-4b92-857d-51de5f1a8a52 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:43.641078 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3a264952-67b7-4b92-857d-51de5f1a8a52 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:43.643778 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3a264952-67b7-4b92-857d-51de5f1a8a52 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:43.644541 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3a264952-67b7-4b92-857d-51de5f1a8a52 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:43.754441 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3a264952-67b7-4b92-857d-51de5f1a8a52 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:43.755457 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3a264952-67b7-4b92-857d-51de5f1a8a52 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:43.756137 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3a264952-67b7-4b92-857d-51de5f1a8a52 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:43.756949 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.objects.instance [None req-3a264952-67b7-4b92-857d-51de5f1a8a52 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lazy-loading 'fault' on Instance uuid eb38dcff-5703-4735-bf8e-6a40d51d8567 {{(pid=138744) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 21:00:43.978518 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-3a264952-67b7-4b92-857d-51de5f1a8a52 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1b410a64e0415a96d30f5040361137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd7873d6db4e09bc9ab9a048a6b1ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:00:43.986378 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-3a264952-67b7-4b92-857d-51de5f1a8a52 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] 10.222.0.18 "GET /compute/v2.1/servers/eb38dcff-5703-4735-bf8e-6a40d51d8567" status: 200 len: 1304 microversion: 2.1 time: 0.395906 Oct 22 21:00:43.987160 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1236/2603] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:00:43 2022] GET /compute/v2.1/servers/eb38dcff-5703-4735-bf8e-6a40d51d8567 => generated 1304 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:00:44.091908 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-a61a240d-62ba-4620-9fc3-8f658182fa3b tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:00:44.092535 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-a61a240d-62ba-4620-9fc3-8f658182fa3b tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] [instance: af11a208-be6e-4f70-85f0-4bafafb4febd] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:00:44.093752 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-d32a0ebd-3cc7-4409-b2ea-b4b5c6a98e4e tempest-ServerDiagnosticsNegativeTest-616658542 tempest-ServerDiagnosticsNegativeTest-616658542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42dbc5f3bc042ef935dd95e123bab0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ca06233c6b4e808308cf6613eb8db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:00:44.103729 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-d32a0ebd-3cc7-4409-b2ea-b4b5c6a98e4e tempest-ServerDiagnosticsNegativeTest-616658542 tempest-ServerDiagnosticsNegativeTest-616658542-project] 10.222.0.18 "GET /compute/v2.1/servers/5e249f40-5d17-49e0-8b86-75f2b4f089c2" status: 200 len: 1323 microversion: 2.1 time: 0.518794 Oct 22 21:00:44.104316 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1368/2604] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:00:43 2022] GET /compute/v2.1/servers/5e249f40-5d17-49e0-8b86-75f2b4f089c2 => generated 1323 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:00:44.106845 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a61a240d-62ba-4620-9fc3-8f658182fa3b tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:44.110157 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-4609ed48-4d49-4a96-8566-364b143e2bb7 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:00:44.111123 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a61a240d-62ba-4620-9fc3-8f658182fa3b tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:44.111370 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-4609ed48-4d49-4a96-8566-364b143e2bb7 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] [instance: 61d89bc7-fcfe-479b-baa1-7307a4395cc3] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:00:44.111738 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a61a240d-62ba-4620-9fc3-8f658182fa3b tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:44.112530 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a61a240d-62ba-4620-9fc3-8f658182fa3b tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:44.113963 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a61a240d-62ba-4620-9fc3-8f658182fa3b tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:44.115942 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a61a240d-62ba-4620-9fc3-8f658182fa3b tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:44.120499 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4609ed48-4d49-4a96-8566-364b143e2bb7 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:44.121152 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4609ed48-4d49-4a96-8566-364b143e2bb7 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:44.121697 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4609ed48-4d49-4a96-8566-364b143e2bb7 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:44.122650 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4609ed48-4d49-4a96-8566-364b143e2bb7 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:44.123244 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4609ed48-4d49-4a96-8566-364b143e2bb7 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:44.123738 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4609ed48-4d49-4a96-8566-364b143e2bb7 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:44.345909 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-a61a240d-62ba-4620-9fc3-8f658182fa3b tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a44ff8e7c14b94b1670f030085c43d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a26a2284f4424cbeaf63d504652546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:00:44.360117 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-a61a240d-62ba-4620-9fc3-8f658182fa3b tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] 10.222.0.18 "GET /compute/v2.1/servers/af11a208-be6e-4f70-85f0-4bafafb4febd" status: 200 len: 1487 microversion: 2.1 time: 0.272653 Oct 22 21:00:44.361873 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1237/2605] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:00:44 2022] GET /compute/v2.1/servers/af11a208-be6e-4f70-85f0-4bafafb4febd => generated 1487 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:00:44.367328 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-0fed438c-fcbd-4faf-b736-23ca11847c8f tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Calling method '.version_select at 0x7fd39f1365e0>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:00:44.394326 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-4609ed48-4d49-4a96-8566-364b143e2bb7 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d49952dbca4d95a25411b65d56552b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed31e93b0e8a43f28e497f94318815ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:00:44.403872 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-4609ed48-4d49-4a96-8566-364b143e2bb7 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] 10.222.0.18 "GET /compute/v2.1/servers/61d89bc7-fcfe-479b-baa1-7307a4395cc3" status: 200 len: 1647 microversion: 2.1 time: 0.298158 Oct 22 21:00:44.411489 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1369/2606] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:00:44 2022] GET /compute/v2.1/servers/61d89bc7-fcfe-479b-baa1-7307a4395cc3 => generated 1647 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:00:44.420224 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-03ee8aa9-c105-4112-a52d-ad4f28b28b92 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:00:44.420884 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-03ee8aa9-c105-4112-a52d-ad4f28b28b92 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] [instance: af11a208-be6e-4f70-85f0-4bafafb4febd] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:00:44.432105 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-0fed438c-fcbd-4faf-b736-23ca11847c8f tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] 10.222.0.18 "GET /compute/v2.1/images/8368f750-e203-4ef8-b979-ba7ef86a0df0" status: 200 len: 1455 microversion: 2.1 time: 0.068482 Oct 22 21:00:44.433944 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1238/2607] 10.222.0.18 () {58 vars in 1233 bytes} [Sat Oct 22 21:00:44 2022] GET /compute/v2.1/images/8368f750-e203-4ef8-b979-ba7ef86a0df0 => generated 1455 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:00:44.448102 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-03ee8aa9-c105-4112-a52d-ad4f28b28b92 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:44.449615 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-03ee8aa9-c105-4112-a52d-ad4f28b28b92 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:44.450321 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-03ee8aa9-c105-4112-a52d-ad4f28b28b92 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:44.451392 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-03ee8aa9-c105-4112-a52d-ad4f28b28b92 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:44.452018 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-03ee8aa9-c105-4112-a52d-ad4f28b28b92 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:44.452522 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-03ee8aa9-c105-4112-a52d-ad4f28b28b92 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:44.559745 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-03ee8aa9-c105-4112-a52d-ad4f28b28b92 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] 10.222.0.18 "POST /compute/v2.1/servers/af11a208-be6e-4f70-85f0-4bafafb4febd/action" status: 202 len: 0 microversion: 2.1 time: 0.150252 Oct 22 21:00:44.562112 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1370/2608] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 21:00:44 2022] POST /compute/v2.1/servers/af11a208-be6e-4f70-85f0-4bafafb4febd/action => generated 0 bytes in 153 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 21:00:44.572310 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-559c8f07-87c1-44ad-85b6-6977b77a0751 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:00:44.572943 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-559c8f07-87c1-44ad-85b6-6977b77a0751 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] [instance: af11a208-be6e-4f70-85f0-4bafafb4febd] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:00:44.586475 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-559c8f07-87c1-44ad-85b6-6977b77a0751 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:44.586992 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-559c8f07-87c1-44ad-85b6-6977b77a0751 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:44.587944 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-559c8f07-87c1-44ad-85b6-6977b77a0751 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:44.590109 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-559c8f07-87c1-44ad-85b6-6977b77a0751 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:44.590936 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-559c8f07-87c1-44ad-85b6-6977b77a0751 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:44.594220 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-559c8f07-87c1-44ad-85b6-6977b77a0751 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:44.812958 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-559c8f07-87c1-44ad-85b6-6977b77a0751 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a44ff8e7c14b94b1670f030085c43d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a26a2284f4424cbeaf63d504652546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:00:44.821928 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-559c8f07-87c1-44ad-85b6-6977b77a0751 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] 10.222.0.18 "GET /compute/v2.1/servers/af11a208-be6e-4f70-85f0-4bafafb4febd" status: 200 len: 1492 microversion: 2.1 time: 0.255265 Oct 22 21:00:44.822936 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1239/2609] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:00:44 2022] GET /compute/v2.1/servers/af11a208-be6e-4f70-85f0-4bafafb4febd => generated 1492 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:00:45.022442 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-0c332a21-dd4c-42b7-bb75-122219dbd005 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:00:45.023180 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-0c332a21-dd4c-42b7-bb75-122219dbd005 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] [instance: eb38dcff-5703-4735-bf8e-6a40d51d8567] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:00:45.046694 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0c332a21-dd4c-42b7-bb75-122219dbd005 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:45.049037 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0c332a21-dd4c-42b7-bb75-122219dbd005 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:45.055583 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0c332a21-dd4c-42b7-bb75-122219dbd005 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:45.056476 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0c332a21-dd4c-42b7-bb75-122219dbd005 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:45.057696 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0c332a21-dd4c-42b7-bb75-122219dbd005 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:45.057696 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0c332a21-dd4c-42b7-bb75-122219dbd005 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:45.089239 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.wsgi [None req-0c332a21-dd4c-42b7-bb75-122219dbd005 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] HTTP exception thrown: Instance eb38dcff-5703-4735-bf8e-6a40d51d8567 could not be found. Oct 22 21:00:45.101817 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-0c332a21-dd4c-42b7-bb75-122219dbd005 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Request method failure captured: Oct 22 21:00:45.101817 ncdv-master-1 devstack@n-api.service[138745]: request: GET /compute/v2.1/servers/eb38dcff-5703-4735-bf8e-6a40d51d8567 HTTP/1.1 Oct 22 21:00:45.101817 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 21:00:45.101817 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 21:00:45.101817 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 21:00:45.101817 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 0 Oct 22 21:00:45.101817 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 21:00:45.101817 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 21:00:45.101817 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 21:00:45.101817 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 21:00:45.101817 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVFnfV28M622GxgIau9tfOtpQOzUe_Zks3cnq6zOgmdqQwk77RE2xHy9F74fRKXOoFFtdLiZlk8HWakwyjiKYmRp9GaMJF70RmWqk8on_rfYCWM12-ITQGodTkqOwwxslvC1Btdt7aRnJVFyVeqFX--IHdQyw_AkPLTYKSNTzj-OnnLE Oct 22 21:00:45.101817 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 21:00:45.101817 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 21:00:45.101817 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 21:00:45.101817 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 21:00:45.101817 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 21:00:45.101817 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 21:00:45.101817 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: b4cd7873d6db4e09bc9ab9a048a6b1ef Oct 22 21:00:45.101817 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-DeleteServersTestJSON-1244431593 Oct 22 21:00:45.101817 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 21:00:45.101817 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 21:00:45.101817 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_b4cd7873d6db4e09bc9ab9a048a6b1ef"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b4cd7873d6db4e09bc9ab9a048a6b1ef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/b4cd7873d6db4e09bc9ab9a048a6b1ef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b4cd7873d6db4e09bc9ab9a048a6b1ef"}]}] Oct 22 21:00:45.101817 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-DeleteServersTestJSON-1244431593 Oct 22 21:00:45.101817 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: b4cd7873d6db4e09bc9ab9a048a6b1ef Oct 22 21:00:45.101817 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-DeleteServersTestJSON-1244431593 Oct 22 21:00:45.101817 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-DeleteServersTestJSON-1244431593-project Oct 22 21:00:45.101817 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 21:00:45.101817 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 21:00:45.101817 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: be1b410a64e0415a96d30f5040361137 Oct 22 21:00:45.101817 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-DeleteServersTestJSON-1244431593-project Oct 22 21:00:45.101817 ncdv-master-1 devstack@n-api.service[138745]: method: > Oct 22 21:00:45.101817 ncdv-master-1 devstack@n-api.service[138745]: exception: Instance eb38dcff-5703-4735-bf8e-6a40d51d8567 could not be found. Oct 22 21:00:45.101817 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'id': 'eb38dcff-5703-4735-bf8e-6a40d51d8567'} Oct 22 21:00:45.101817 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:00:45.101817 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:00:45.101817 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 21:00:45.101817 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 21:00:45.101817 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 21:00:45.101817 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 21:00:45.101817 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 21:00:45.101817 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 21:00:45.101817 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 21:00:45.101817 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 21:00:45.101817 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb38dcff-5703-4735-bf8e-6a40d51d8567 could not be found. Oct 22 21:00:45.101817 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:00:45.101817 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:00:45.101817 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:00:45.101817 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:00:45.101817 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:00:45.101817 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:00:45.101817 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:00:45.101817 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:00:45.101817 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:00:45.101817 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:00:45.101817 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 21:00:45.101817 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 21:00:45.101817 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 21:00:45.101817 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 21:00:45.101817 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 21:00:45.101817 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:00:45.101817 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb38dcff-5703-4735-bf8e-6a40d51d8567 could not be found. Oct 22 21:00:45.101817 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:00:45.101817 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:00:45.101817 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:00:45.107406 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:00:45.107406 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:00:45.107406 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:00:45.107406 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:00:45.107406 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:00:45.107406 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb38dcff-5703-4735-bf8e-6a40d51d8567 could not be found. Oct 22 21:00:45.107406 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:00:45.107406 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-0c332a21-dd4c-42b7-bb75-122219dbd005 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Returning 404 to user: Instance eb38dcff-5703-4735-bf8e-6a40d51d8567 could not be found. {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:00:45.107406 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-0c332a21-dd4c-42b7-bb75-122219dbd005 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] 10.222.0.18 "GET /compute/v2.1/servers/eb38dcff-5703-4735-bf8e-6a40d51d8567" status: 404 len: 111 microversion: 2.1 time: 0.094051 Oct 22 21:00:45.107406 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1371/2610] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:00:45 2022] GET /compute/v2.1/servers/eb38dcff-5703-4735-bf8e-6a40d51d8567 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 21:00:45.130093 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-5b97e0ea-53ae-4d17-a9f7-31dc5fc3f474 tempest-ServerDiagnosticsNegativeTest-616658542 tempest-ServerDiagnosticsNegativeTest-616658542-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:00:45.131356 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-5b97e0ea-53ae-4d17-a9f7-31dc5fc3f474 tempest-ServerDiagnosticsNegativeTest-616658542 tempest-ServerDiagnosticsNegativeTest-616658542-project] [instance: 5e249f40-5d17-49e0-8b86-75f2b4f089c2] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:00:45.168931 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5b97e0ea-53ae-4d17-a9f7-31dc5fc3f474 tempest-ServerDiagnosticsNegativeTest-616658542 tempest-ServerDiagnosticsNegativeTest-616658542-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:45.171380 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5b97e0ea-53ae-4d17-a9f7-31dc5fc3f474 tempest-ServerDiagnosticsNegativeTest-616658542 tempest-ServerDiagnosticsNegativeTest-616658542-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:45.178866 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5b97e0ea-53ae-4d17-a9f7-31dc5fc3f474 tempest-ServerDiagnosticsNegativeTest-616658542 tempest-ServerDiagnosticsNegativeTest-616658542-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:45.178866 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5b97e0ea-53ae-4d17-a9f7-31dc5fc3f474 tempest-ServerDiagnosticsNegativeTest-616658542 tempest-ServerDiagnosticsNegativeTest-616658542-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:45.180008 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5b97e0ea-53ae-4d17-a9f7-31dc5fc3f474 tempest-ServerDiagnosticsNegativeTest-616658542 tempest-ServerDiagnosticsNegativeTest-616658542-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:45.180624 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5b97e0ea-53ae-4d17-a9f7-31dc5fc3f474 tempest-ServerDiagnosticsNegativeTest-616658542 tempest-ServerDiagnosticsNegativeTest-616658542-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:45.304090 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-82cf754c-5cb9-4f4e-8f2a-833ae48ebaef tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1746064846", "imageRef": "085e4478-6edc-4a69-8e08-f9831713eb65", "flavorRef": "452", "networks": [{"uuid": "4ddebde3-67b6-4360-8934-2682d629ac63"}]}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:00:45.414470 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.network.neutron [None req-82cf754c-5cb9-4f4e-8f2a-833ae48ebaef tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] validate_networks() for [('4ddebde3-67b6-4360-8934-2682d629ac63', None, None, None, None, None)] {{(pid=138745) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 21:00:45.716465 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-5b97e0ea-53ae-4d17-a9f7-31dc5fc3f474 tempest-ServerDiagnosticsNegativeTest-616658542 tempest-ServerDiagnosticsNegativeTest-616658542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42dbc5f3bc042ef935dd95e123bab0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ca06233c6b4e808308cf6613eb8db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:00:45.724435 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-5b97e0ea-53ae-4d17-a9f7-31dc5fc3f474 tempest-ServerDiagnosticsNegativeTest-616658542 tempest-ServerDiagnosticsNegativeTest-616658542-project] 10.222.0.18 "GET /compute/v2.1/servers/5e249f40-5d17-49e0-8b86-75f2b4f089c2" status: 200 len: 1323 microversion: 2.1 time: 0.601202 Oct 22 21:00:45.727897 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1240/2611] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:00:45 2022] GET /compute/v2.1/servers/5e249f40-5d17-49e0-8b86-75f2b4f089c2 => generated 1323 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:00:45.734827 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-41b9b067-cc18-4c95-ac29-d8ec836fcba5 req-ac02e058-124a-424e-8fc7-430d09fa6ace service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61d89bc7-fcfe-479b-baa1-7307a4395cc3", "name": "network-vif-deleted", "tag": "8b90877b-3e97-4354-ad15-7327a7aa752b"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:00:45.753201 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-41b9b067-cc18-4c95-ac29-d8ec836fcba5 req-ac02e058-124a-424e-8fc7-430d09fa6ace service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:45.753689 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-41b9b067-cc18-4c95-ac29-d8ec836fcba5 req-ac02e058-124a-424e-8fc7-430d09fa6ace service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:45.754116 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-41b9b067-cc18-4c95-ac29-d8ec836fcba5 req-ac02e058-124a-424e-8fc7-430d09fa6ace service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:45.776728 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-41b9b067-cc18-4c95-ac29-d8ec836fcba5 req-ac02e058-124a-424e-8fc7-430d09fa6ace service nova] Creating event network-vif-deleted:8b90877b-3e97-4354-ad15-7327a7aa752b for instance 61d89bc7-fcfe-479b-baa1-7307a4395cc3 on nch1-master-1 Oct 22 21:00:45.788149 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-41b9b067-cc18-4c95-ac29-d8ec836fcba5 req-ac02e058-124a-424e-8fc7-430d09fa6ace service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057259 Oct 22 21:00:45.790816 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1241/2612] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:00:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:00:45.796572 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-7c99d43b-964d-46c1-a450-450264d7985f tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:00:45.797459 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-7c99d43b-964d-46c1-a450-450264d7985f tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] [instance: 61d89bc7-fcfe-479b-baa1-7307a4395cc3] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:00:45.809434 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7c99d43b-964d-46c1-a450-450264d7985f tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:45.810195 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7c99d43b-964d-46c1-a450-450264d7985f tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:45.811011 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7c99d43b-964d-46c1-a450-450264d7985f tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:45.811918 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7c99d43b-964d-46c1-a450-450264d7985f tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:45.815904 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7c99d43b-964d-46c1-a450-450264d7985f tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:45.816735 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7c99d43b-964d-46c1-a450-450264d7985f tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:45.898284 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7c99d43b-964d-46c1-a450-450264d7985f tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:45.899084 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7c99d43b-964d-46c1-a450-450264d7985f tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:45.900176 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7c99d43b-964d-46c1-a450-450264d7985f tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:45.900798 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.objects.instance [None req-7c99d43b-964d-46c1-a450-450264d7985f tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Lazy-loading 'fault' on Instance uuid 61d89bc7-fcfe-479b-baa1-7307a4395cc3 {{(pid=138744) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 21:00:46.071889 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-7c99d43b-964d-46c1-a450-450264d7985f tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d49952dbca4d95a25411b65d56552b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed31e93b0e8a43f28e497f94318815ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:00:46.081798 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-7c99d43b-964d-46c1-a450-450264d7985f tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] 10.222.0.18 "GET /compute/v2.1/servers/61d89bc7-fcfe-479b-baa1-7307a4395cc3" status: 200 len: 1306 microversion: 2.1 time: 0.289658 Oct 22 21:00:46.082651 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1242/2613] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:00:45 2022] GET /compute/v2.1/servers/61d89bc7-fcfe-479b-baa1-7307a4395cc3 => generated 1306 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:00:46.094724 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-3c0f4c5a-2e12-4b2f-baa6-0142d805542b tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Calling method '.version_select at 0x7fd39f136e50>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:00:46.150789 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-3c0f4c5a-2e12-4b2f-baa6-0142d805542b tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] 10.222.0.18 "GET /compute/v2.1/images/8368f750-e203-4ef8-b979-ba7ef86a0df0" status: 200 len: 1455 microversion: 2.1 time: 0.066920 Oct 22 21:00:46.163020 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1243/2614] 10.222.0.18 () {58 vars in 1233 bytes} [Sat Oct 22 21:00:46 2022] GET /compute/v2.1/images/8368f750-e203-4ef8-b979-ba7ef86a0df0 => generated 1455 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:00:46.171029 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-ad84d427-e3e0-464f-8faf-e2305b9d63d9 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:00:46.172281 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-ad84d427-e3e0-464f-8faf-e2305b9d63d9 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] [instance: af11a208-be6e-4f70-85f0-4bafafb4febd] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:00:46.182064 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ad84d427-e3e0-464f-8faf-e2305b9d63d9 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:46.183640 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ad84d427-e3e0-464f-8faf-e2305b9d63d9 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:46.184310 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ad84d427-e3e0-464f-8faf-e2305b9d63d9 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:46.185483 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ad84d427-e3e0-464f-8faf-e2305b9d63d9 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:46.186155 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ad84d427-e3e0-464f-8faf-e2305b9d63d9 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:46.186816 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ad84d427-e3e0-464f-8faf-e2305b9d63d9 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:46.598851 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-ad84d427-e3e0-464f-8faf-e2305b9d63d9 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a44ff8e7c14b94b1670f030085c43d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a26a2284f4424cbeaf63d504652546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:00:46.611131 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-ad84d427-e3e0-464f-8faf-e2305b9d63d9 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] 10.222.0.18 "GET /compute/v2.1/servers/af11a208-be6e-4f70-85f0-4bafafb4febd" status: 200 len: 1472 microversion: 2.1 time: 0.445205 Oct 22 21:00:46.613071 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1244/2615] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:00:46 2022] GET /compute/v2.1/servers/af11a208-be6e-4f70-85f0-4bafafb4febd => generated 1472 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:00:46.616903 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-ad84d427-e3e0-464f-8faf-e2305b9d63d9 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:00:46.620052 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-ad84d427-e3e0-464f-8faf-e2305b9d63d9 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] 10.222.0.18 "GET /compute//" status: 200 len: 377 microversion: - time: 0.003783 Oct 22 21:00:46.620663 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1245/2616] 10.222.0.18 () {56 vars in 886 bytes} [Sat Oct 22 21:00:46 2022] GET /compute/ => generated 377 bytes in 7 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 22 21:00:46.628095 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-e7a3d2d2-b11d-4d70-82b4-2ff9b5b4236e req-81087dd0-cee3-482b-bb56-e836f6bbc512 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e249f40-5d17-49e0-8b86-75f2b4f089c2", "name": "network-vif-plugged", "status": "completed", "tag": "7a75caf1-7002-4fb3-a44f-b64953426958"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:00:46.654004 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-82cf754c-5cb9-4f4e-8f2a-833ae48ebaef tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Flavor limits 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 21:00:46.654992 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-82cf754c-5cb9-4f4e-8f2a-833ae48ebaef tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Image limits 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 21:00:46.656477 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-82cf754c-5cb9-4f4e-8f2a-833ae48ebaef tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Flavor pref 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 21:00:46.656477 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-82cf754c-5cb9-4f4e-8f2a-833ae48ebaef tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Image pref 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 21:00:46.657063 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-82cf754c-5cb9-4f4e-8f2a-833ae48ebaef tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 21:00:46.659746 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:00:46.672072 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-e7a3d2d2-b11d-4d70-82b4-2ff9b5b4236e req-81087dd0-cee3-482b-bb56-e836f6bbc512 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:46.672072 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-e7a3d2d2-b11d-4d70-82b4-2ff9b5b4236e req-81087dd0-cee3-482b-bb56-e836f6bbc512 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:46.673303 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-e7a3d2d2-b11d-4d70-82b4-2ff9b5b4236e req-81087dd0-cee3-482b-bb56-e836f6bbc512 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:46.675256 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-82cf754c-5cb9-4f4e-8f2a-833ae48ebaef tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:46.675998 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-82cf754c-5cb9-4f4e-8f2a-833ae48ebaef tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:46.677002 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-82cf754c-5cb9-4f4e-8f2a-833ae48ebaef tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:46.679032 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-82cf754c-5cb9-4f4e-8f2a-833ae48ebaef tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:46.679849 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-82cf754c-5cb9-4f4e-8f2a-833ae48ebaef tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:46.680491 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-82cf754c-5cb9-4f4e-8f2a-833ae48ebaef tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:46.702924 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-e7a3d2d2-b11d-4d70-82b4-2ff9b5b4236e req-81087dd0-cee3-482b-bb56-e836f6bbc512 service nova] Creating event network-vif-plugged:7a75caf1-7002-4fb3-a44f-b64953426958 for instance 5e249f40-5d17-49e0-8b86-75f2b4f089c2 on nch1-master-1 Oct 22 21:00:46.706362 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-82cf754c-5cb9-4f4e-8f2a-833ae48ebaef tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Getting quotas for project b4cd7873d6db4e09bc9ab9a048a6b1ef. Resources: {'cores', 'instances', 'ram'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 21:00:46.714647 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-82cf754c-5cb9-4f4e-8f2a-833ae48ebaef tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Getting quotas for user be1b410a64e0415a96d30f5040361137 and project b4cd7873d6db4e09bc9ab9a048a6b1ef. Resources: {'cores', 'instances', 'ram'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 21:00:46.733544 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-82cf754c-5cb9-4f4e-8f2a-833ae48ebaef tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Going to run 1 instances... {{(pid=138745) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 21:00:46.736035 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-e7a3d2d2-b11d-4d70-82b4-2ff9b5b4236e req-81087dd0-cee3-482b-bb56-e836f6bbc512 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110848 Oct 22 21:00:46.737319 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-82cf754c-5cb9-4f4e-8f2a-833ae48ebaef tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] [instance: a3ed180f-6c68-4c19-bdb7-602dd8ffaaf2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='085e4478-6edc-4a69-8e08-f9831713eb65',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138745) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 21:00:46.739600 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1246/2617] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:00:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:00:46.760473 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-dcc959df-f190-499a-bd32-c4007c1a9906 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-337413394"}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:00:46.778317 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-dcc959df-f190-499a-bd32-c4007c1a9906 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] [instance: af11a208-be6e-4f70-85f0-4bafafb4febd] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:00:46.801378 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-dcc959df-f190-499a-bd32-c4007c1a9906 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:46.802944 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-dcc959df-f190-499a-bd32-c4007c1a9906 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:46.803849 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-dcc959df-f190-499a-bd32-c4007c1a9906 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:46.805088 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-dcc959df-f190-499a-bd32-c4007c1a9906 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:46.805820 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-dcc959df-f190-499a-bd32-c4007c1a9906 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:46.806638 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-dcc959df-f190-499a-bd32-c4007c1a9906 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:46.828386 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-82cf754c-5cb9-4f4e-8f2a-833ae48ebaef tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.526777 Oct 22 21:00:46.829394 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1372/2618] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Oct 22 21:00:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 1530 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 21:00:46.835423 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-b4403def-1118-4a7d-99e7-df42afca817a tempest-ServerDiagnosticsNegativeTest-616658542 tempest-ServerDiagnosticsNegativeTest-616658542-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:00:46.836343 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-b4403def-1118-4a7d-99e7-df42afca817a tempest-ServerDiagnosticsNegativeTest-616658542 tempest-ServerDiagnosticsNegativeTest-616658542-project] [instance: 5e249f40-5d17-49e0-8b86-75f2b4f089c2] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:00:46.851990 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b4403def-1118-4a7d-99e7-df42afca817a tempest-ServerDiagnosticsNegativeTest-616658542 tempest-ServerDiagnosticsNegativeTest-616658542-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:46.853060 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b4403def-1118-4a7d-99e7-df42afca817a tempest-ServerDiagnosticsNegativeTest-616658542 tempest-ServerDiagnosticsNegativeTest-616658542-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:46.854385 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b4403def-1118-4a7d-99e7-df42afca817a tempest-ServerDiagnosticsNegativeTest-616658542 tempest-ServerDiagnosticsNegativeTest-616658542-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:46.855762 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b4403def-1118-4a7d-99e7-df42afca817a tempest-ServerDiagnosticsNegativeTest-616658542 tempest-ServerDiagnosticsNegativeTest-616658542-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:46.856597 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b4403def-1118-4a7d-99e7-df42afca817a tempest-ServerDiagnosticsNegativeTest-616658542 tempest-ServerDiagnosticsNegativeTest-616658542-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:46.858326 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b4403def-1118-4a7d-99e7-df42afca817a tempest-ServerDiagnosticsNegativeTest-616658542 tempest-ServerDiagnosticsNegativeTest-616658542-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:47.116157 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-b4403def-1118-4a7d-99e7-df42afca817a tempest-ServerDiagnosticsNegativeTest-616658542 tempest-ServerDiagnosticsNegativeTest-616658542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42dbc5f3bc042ef935dd95e123bab0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ca06233c6b4e808308cf6613eb8db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:00:47.126651 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-b4403def-1118-4a7d-99e7-df42afca817a tempest-ServerDiagnosticsNegativeTest-616658542 tempest-ServerDiagnosticsNegativeTest-616658542-project] 10.222.0.18 "GET /compute/v2.1/servers/5e249f40-5d17-49e0-8b86-75f2b4f089c2" status: 200 len: 1323 microversion: 2.1 time: 0.296141 Oct 22 21:00:47.128303 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1373/2619] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:00:46 2022] GET /compute/v2.1/servers/5e249f40-5d17-49e0-8b86-75f2b4f089c2 => generated 1323 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:00:47.148617 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-7672c17a-5e57-4e27-8f09-0397fdbf7c5d tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:00:47.149642 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-7672c17a-5e57-4e27-8f09-0397fdbf7c5d tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] [instance: a3ed180f-6c68-4c19-bdb7-602dd8ffaaf2] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:00:47.326070 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-7672c17a-5e57-4e27-8f09-0397fdbf7c5d tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1b410a64e0415a96d30f5040361137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd7873d6db4e09bc9ab9a048a6b1ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:00:47.339159 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-7672c17a-5e57-4e27-8f09-0397fdbf7c5d tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] 10.222.0.18 "GET /compute/v2.1/servers/a3ed180f-6c68-4c19-bdb7-602dd8ffaaf2" status: 200 len: 1215 microversion: 2.1 time: 0.206576 Oct 22 21:00:47.341691 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1374/2620] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:00:47 2022] GET /compute/v2.1/servers/a3ed180f-6c68-4c19-bdb7-602dd8ffaaf2 => generated 1215 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:00:47.347525 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-f0cdce98-1321-483a-9314-033d0d26e309 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:00:47.348516 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-f0cdce98-1321-483a-9314-033d0d26e309 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] [instance: 61d89bc7-fcfe-479b-baa1-7307a4395cc3] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:00:47.358929 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f0cdce98-1321-483a-9314-033d0d26e309 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:47.359738 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f0cdce98-1321-483a-9314-033d0d26e309 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:47.360520 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f0cdce98-1321-483a-9314-033d0d26e309 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:47.361670 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f0cdce98-1321-483a-9314-033d0d26e309 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:47.362506 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f0cdce98-1321-483a-9314-033d0d26e309 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:47.364668 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f0cdce98-1321-483a-9314-033d0d26e309 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:47.400175 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-dcc959df-f190-499a-bd32-c4007c1a9906 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] 10.222.0.18 "POST /compute/v2.1/servers/af11a208-be6e-4f70-85f0-4bafafb4febd/action" status: 202 len: 0 microversion: 2.1 time: 0.656492 Oct 22 21:00:47.423572 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1247/2621] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 21:00:46 2022] POST /compute/v2.1/servers/af11a208-be6e-4f70-85f0-4bafafb4febd/action => generated 0 bytes in 682 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 22 21:00:47.445503 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.wsgi [None req-f0cdce98-1321-483a-9314-033d0d26e309 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] HTTP exception thrown: Instance 61d89bc7-fcfe-479b-baa1-7307a4395cc3 could not be found. Oct 22 21:00:47.455001 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-b43611f5-c161-491b-8daf-187af91cde0b tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Calling method '.version_select at 0x7fd39f1364c0>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:00:47.455975 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-f0cdce98-1321-483a-9314-033d0d26e309 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Request method failure captured: Oct 22 21:00:47.455975 ncdv-master-1 devstack@n-api.service[138745]: request: GET /compute/v2.1/servers/61d89bc7-fcfe-479b-baa1-7307a4395cc3 HTTP/1.1 Oct 22 21:00:47.455975 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 21:00:47.455975 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 21:00:47.455975 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 21:00:47.455975 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 0 Oct 22 21:00:47.455975 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 21:00:47.455975 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 21:00:47.455975 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 21:00:47.455975 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 21:00:47.455975 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVFmMTFo8tMXHI466ygTiy0jTs5kz8YO2nFuimSyZRJI5bXNUfHpPLWjQrXyJ7I9Xfc54HQRfYflULj68lfwBk5jrnjY79oZ1kbdK55vumR_IVvMJmaykrPjWliG3H4xf-SZHnU3invPEATeZO7VP5aTca0hd9BauSvYCW1UPdVAZZ70 Oct 22 21:00:47.455975 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 21:00:47.455975 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 21:00:47.455975 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 21:00:47.455975 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 21:00:47.455975 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 21:00:47.455975 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 21:00:47.455975 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: ed31e93b0e8a43f28e497f94318815ce Oct 22 21:00:47.455975 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-SecurityGroupsTestJSON-1604956559 Oct 22 21:00:47.455975 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 21:00:47.455975 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 21:00:47.455975 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ed31e93b0e8a43f28e497f94318815ce"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ed31e93b0e8a43f28e497f94318815ce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ed31e93b0e8a43f28e497f94318815ce"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ed31e93b0e8a43f28e497f94318815ce"}]}] Oct 22 21:00:47.455975 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-SecurityGroupsTestJSON-1604956559 Oct 22 21:00:47.455975 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: ed31e93b0e8a43f28e497f94318815ce Oct 22 21:00:47.455975 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1604956559 Oct 22 21:00:47.455975 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-SecurityGroupsTestJSON-1604956559-project Oct 22 21:00:47.455975 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 21:00:47.455975 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 21:00:47.455975 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: 46d49952dbca4d95a25411b65d56552b Oct 22 21:00:47.455975 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-SecurityGroupsTestJSON-1604956559-project Oct 22 21:00:47.455975 ncdv-master-1 devstack@n-api.service[138745]: method: > Oct 22 21:00:47.455975 ncdv-master-1 devstack@n-api.service[138745]: exception: Instance 61d89bc7-fcfe-479b-baa1-7307a4395cc3 could not be found. Oct 22 21:00:47.455975 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'id': '61d89bc7-fcfe-479b-baa1-7307a4395cc3'} Oct 22 21:00:47.455975 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:00:47.455975 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:00:47.455975 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 21:00:47.455975 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 21:00:47.455975 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 21:00:47.455975 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 21:00:47.455975 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 21:00:47.455975 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 21:00:47.455975 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 21:00:47.455975 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 21:00:47.455975 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 61d89bc7-fcfe-479b-baa1-7307a4395cc3 could not be found. Oct 22 21:00:47.455975 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:00:47.455975 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:00:47.455975 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:00:47.455975 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:00:47.455975 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:00:47.455975 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:00:47.455975 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:00:47.455975 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:00:47.455975 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:00:47.455975 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:00:47.455975 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 21:00:47.455975 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 21:00:47.455975 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 21:00:47.455975 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 21:00:47.455975 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 21:00:47.455975 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:00:47.455975 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 61d89bc7-fcfe-479b-baa1-7307a4395cc3 could not be found. Oct 22 21:00:47.455975 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:00:47.455975 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:00:47.455975 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:00:47.460330 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:00:47.460330 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:00:47.460330 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:00:47.460330 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:00:47.460330 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:00:47.460330 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 61d89bc7-fcfe-479b-baa1-7307a4395cc3 could not be found. Oct 22 21:00:47.460330 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:00:47.460330 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-f0cdce98-1321-483a-9314-033d0d26e309 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Returning 404 to user: Instance 61d89bc7-fcfe-479b-baa1-7307a4395cc3 could not be found. {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:00:47.463730 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-f0cdce98-1321-483a-9314-033d0d26e309 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] 10.222.0.18 "GET /compute/v2.1/servers/61d89bc7-fcfe-479b-baa1-7307a4395cc3" status: 404 len: 111 microversion: 2.1 time: 0.120769 Oct 22 21:00:47.466277 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1375/2622] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:00:47 2022] GET /compute/v2.1/servers/61d89bc7-fcfe-479b-baa1-7307a4395cc3 => generated 111 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 21:00:47.515281 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-0df2cc9c-359e-4d70-90e2-3376545c9b63 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Calling method '.version_select at 0x7fd39fd12160>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:00:47.541457 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-b43611f5-c161-491b-8daf-187af91cde0b tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] 10.222.0.18 "GET /compute/v2.1/images/8368f750-e203-4ef8-b979-ba7ef86a0df0" status: 200 len: 1455 microversion: 2.1 time: 0.116205 Oct 22 21:00:47.549368 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1248/2623] 10.222.0.18 () {58 vars in 1233 bytes} [Sat Oct 22 21:00:47 2022] GET /compute/v2.1/images/8368f750-e203-4ef8-b979-ba7ef86a0df0 => generated 1455 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:00:47.570456 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-ac3018e2-6efa-4d02-8844-251abd1aceff tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Calling method '.version_select at 0x7fd39f136940>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:00:47.619003 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-0df2cc9c-359e-4d70-90e2-3376545c9b63 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] 10.222.0.18 "GET /compute/v2.1/images/45d0a13c-b73b-4f91-b353-a22f0963a598" status: 200 len: 1413 microversion: 2.1 time: 0.150641 Oct 22 21:00:47.620373 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1376/2624] 10.222.0.18 () {58 vars in 1233 bytes} [Sat Oct 22 21:00:47 2022] GET /compute/v2.1/images/45d0a13c-b73b-4f91-b353-a22f0963a598 => generated 1413 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:00:48.157465 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-4b124251-3966-4879-a27e-b3166d864d1e tempest-ServerDiagnosticsNegativeTest-616658542 tempest-ServerDiagnosticsNegativeTest-616658542-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:00:48.159176 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-4b124251-3966-4879-a27e-b3166d864d1e tempest-ServerDiagnosticsNegativeTest-616658542 tempest-ServerDiagnosticsNegativeTest-616658542-project] [instance: 5e249f40-5d17-49e0-8b86-75f2b4f089c2] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:00:48.178366 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4b124251-3966-4879-a27e-b3166d864d1e tempest-ServerDiagnosticsNegativeTest-616658542 tempest-ServerDiagnosticsNegativeTest-616658542-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:48.179073 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4b124251-3966-4879-a27e-b3166d864d1e tempest-ServerDiagnosticsNegativeTest-616658542 tempest-ServerDiagnosticsNegativeTest-616658542-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:48.179708 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4b124251-3966-4879-a27e-b3166d864d1e tempest-ServerDiagnosticsNegativeTest-616658542 tempest-ServerDiagnosticsNegativeTest-616658542-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:48.180593 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4b124251-3966-4879-a27e-b3166d864d1e tempest-ServerDiagnosticsNegativeTest-616658542 tempest-ServerDiagnosticsNegativeTest-616658542-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:48.181294 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4b124251-3966-4879-a27e-b3166d864d1e tempest-ServerDiagnosticsNegativeTest-616658542 tempest-ServerDiagnosticsNegativeTest-616658542-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:48.181938 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4b124251-3966-4879-a27e-b3166d864d1e tempest-ServerDiagnosticsNegativeTest-616658542 tempest-ServerDiagnosticsNegativeTest-616658542-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:48.360833 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-ac3018e2-6efa-4d02-8844-251abd1aceff tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/606d7184-23fe-4852-b84a-c88ccc1b39fb" status: 202 len: 0 microversion: 2.1 time: 0.816388 Oct 22 21:00:48.363316 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1249/2625] 10.222.0.18 () {58 vars in 1272 bytes} [Sat Oct 22 21:00:47 2022] DELETE /compute/v2.1/os-security-groups/606d7184-23fe-4852-b84a-c88ccc1b39fb => generated 0 bytes in 819 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 21:00:48.368259 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-890f0cd7-23fe-4de3-ba6d-a6ab787792b0 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:00:48.369329 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-890f0cd7-23fe-4de3-ba6d-a6ab787792b0 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] [instance: a3ed180f-6c68-4c19-bdb7-602dd8ffaaf2] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:00:48.385502 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-890f0cd7-23fe-4de3-ba6d-a6ab787792b0 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:48.386381 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-890f0cd7-23fe-4de3-ba6d-a6ab787792b0 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:48.387116 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-890f0cd7-23fe-4de3-ba6d-a6ab787792b0 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:48.390700 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-890f0cd7-23fe-4de3-ba6d-a6ab787792b0 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:48.391495 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-890f0cd7-23fe-4de3-ba6d-a6ab787792b0 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:48.392142 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-890f0cd7-23fe-4de3-ba6d-a6ab787792b0 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:48.551174 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-4b124251-3966-4879-a27e-b3166d864d1e tempest-ServerDiagnosticsNegativeTest-616658542 tempest-ServerDiagnosticsNegativeTest-616658542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42dbc5f3bc042ef935dd95e123bab0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ca06233c6b4e808308cf6613eb8db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:00:48.560025 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-4b124251-3966-4879-a27e-b3166d864d1e tempest-ServerDiagnosticsNegativeTest-616658542 tempest-ServerDiagnosticsNegativeTest-616658542-project] 10.222.0.18 "GET /compute/v2.1/servers/5e249f40-5d17-49e0-8b86-75f2b4f089c2" status: 200 len: 1323 microversion: 2.1 time: 0.407866 Oct 22 21:00:48.571508 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1377/2626] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:00:48 2022] GET /compute/v2.1/servers/5e249f40-5d17-49e0-8b86-75f2b4f089c2 => generated 1323 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:00:48.571827 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-890f0cd7-23fe-4de3-ba6d-a6ab787792b0 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1b410a64e0415a96d30f5040361137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd7873d6db4e09bc9ab9a048a6b1ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:00:48.583121 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-0e07558e-93c7-4d2f-8428-1821566536f4 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] Calling method '.version_select at 0x7fd39fb9b940>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:00:48.588730 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-890f0cd7-23fe-4de3-ba6d-a6ab787792b0 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] 10.222.0.18 "GET /compute/v2.1/servers/a3ed180f-6c68-4c19-bdb7-602dd8ffaaf2" status: 200 len: 1267 microversion: 2.1 time: 0.224075 Oct 22 21:00:48.589333 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1250/2627] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:00:48 2022] GET /compute/v2.1/servers/a3ed180f-6c68-4c19-bdb7-602dd8ffaaf2 => generated 1267 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:00:48.621346 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-d6522daf-9ee5-4d42-9bf5-3904d3e3c4a6 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Calling method '.version_select at 0x7fd39f136700>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:00:48.705112 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-d6522daf-9ee5-4d42-9bf5-3904d3e3c4a6 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] 10.222.0.18 "GET /compute/v2.1/images/8368f750-e203-4ef8-b979-ba7ef86a0df0" status: 200 len: 1455 microversion: 2.1 time: 0.097952 Oct 22 21:00:48.705751 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1251/2628] 10.222.0.18 () {58 vars in 1233 bytes} [Sat Oct 22 21:00:48 2022] GET /compute/v2.1/images/8368f750-e203-4ef8-b979-ba7ef86a0df0 => generated 1455 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:00:48.711942 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-cf07297b-5a9e-4c48-97cf-68c48ffd281c tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Calling method '.version_select at 0x7fd39f13d940>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:00:48.817707 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-cf07297b-5a9e-4c48-97cf-68c48ffd281c tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] 10.222.0.18 "GET /compute/v2.1/images/45d0a13c-b73b-4f91-b353-a22f0963a598" status: 200 len: 1413 microversion: 2.1 time: 0.110971 Oct 22 21:00:48.827628 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1252/2629] 10.222.0.18 () {58 vars in 1233 bytes} [Sat Oct 22 21:00:48 2022] GET /compute/v2.1/images/45d0a13c-b73b-4f91-b353-a22f0963a598 => generated 1413 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:00:48.904751 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-ea05fcae-ea16-4353-8114-c65c53265818 req-1c57c5f6-14ba-4b5a-957b-5702a7f27ff4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70f4c178-630e-4050-8aad-4c60bec30bcd", "name": "network-vif-plugged", "status": "completed", "tag": "034bfe35-5a4c-4024-b8ad-3fc77f012374"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:00:48.933423 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-ea05fcae-ea16-4353-8114-c65c53265818 req-1c57c5f6-14ba-4b5a-957b-5702a7f27ff4 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:48.935454 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-ea05fcae-ea16-4353-8114-c65c53265818 req-1c57c5f6-14ba-4b5a-957b-5702a7f27ff4 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:48.936279 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-ea05fcae-ea16-4353-8114-c65c53265818 req-1c57c5f6-14ba-4b5a-957b-5702a7f27ff4 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:48.957457 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-ea05fcae-ea16-4353-8114-c65c53265818 req-1c57c5f6-14ba-4b5a-957b-5702a7f27ff4 service nova] Creating event network-vif-plugged:034bfe35-5a4c-4024-b8ad-3fc77f012374 for instance 70f4c178-630e-4050-8aad-4c60bec30bcd on nch1-master-1 Oct 22 21:00:48.964041 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-ea05fcae-ea16-4353-8114-c65c53265818 req-1c57c5f6-14ba-4b5a-957b-5702a7f27ff4 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063195 Oct 22 21:00:48.965742 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1253/2630] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:00:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 21:00:49.282075 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-0e07558e-93c7-4d2f-8428-1821566536f4 tempest-SecurityGroupsTestJSON-1604956559 tempest-SecurityGroupsTestJSON-1604956559-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/953f2c64-dadb-4488-84a3-68647ef4231a" status: 202 len: 0 microversion: 2.1 time: 0.714548 Oct 22 21:00:49.287422 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1378/2631] 10.222.0.18 () {58 vars in 1272 bytes} [Sat Oct 22 21:00:48 2022] DELETE /compute/v2.1/os-security-groups/953f2c64-dadb-4488-84a3-68647ef4231a => generated 0 bytes in 722 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 21:00:49.587938 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-a9649d59-8ed7-4ffb-9cd4-4ff50df5c3d2 tempest-ServerDiagnosticsNegativeTest-616658542 tempest-ServerDiagnosticsNegativeTest-616658542-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:00:49.589389 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-a9649d59-8ed7-4ffb-9cd4-4ff50df5c3d2 tempest-ServerDiagnosticsNegativeTest-616658542 tempest-ServerDiagnosticsNegativeTest-616658542-project] [instance: 5e249f40-5d17-49e0-8b86-75f2b4f089c2] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:00:49.613717 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a9649d59-8ed7-4ffb-9cd4-4ff50df5c3d2 tempest-ServerDiagnosticsNegativeTest-616658542 tempest-ServerDiagnosticsNegativeTest-616658542-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:49.614775 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a9649d59-8ed7-4ffb-9cd4-4ff50df5c3d2 tempest-ServerDiagnosticsNegativeTest-616658542 tempest-ServerDiagnosticsNegativeTest-616658542-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:49.616065 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a9649d59-8ed7-4ffb-9cd4-4ff50df5c3d2 tempest-ServerDiagnosticsNegativeTest-616658542 tempest-ServerDiagnosticsNegativeTest-616658542-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:49.620478 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a9649d59-8ed7-4ffb-9cd4-4ff50df5c3d2 tempest-ServerDiagnosticsNegativeTest-616658542 tempest-ServerDiagnosticsNegativeTest-616658542-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:49.622482 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a9649d59-8ed7-4ffb-9cd4-4ff50df5c3d2 tempest-ServerDiagnosticsNegativeTest-616658542 tempest-ServerDiagnosticsNegativeTest-616658542-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:49.622643 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-dbd0538e-5bb8-4444-ba74-e9195d0e2a5c tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:00:49.623385 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-dbd0538e-5bb8-4444-ba74-e9195d0e2a5c tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] [instance: a3ed180f-6c68-4c19-bdb7-602dd8ffaaf2] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:00:49.626582 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a9649d59-8ed7-4ffb-9cd4-4ff50df5c3d2 tempest-ServerDiagnosticsNegativeTest-616658542 tempest-ServerDiagnosticsNegativeTest-616658542-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:49.651546 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-dbd0538e-5bb8-4444-ba74-e9195d0e2a5c tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:49.653674 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-dbd0538e-5bb8-4444-ba74-e9195d0e2a5c tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:49.654370 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-dbd0538e-5bb8-4444-ba74-e9195d0e2a5c tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:49.659910 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-dbd0538e-5bb8-4444-ba74-e9195d0e2a5c tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:49.660914 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-dbd0538e-5bb8-4444-ba74-e9195d0e2a5c tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:49.661580 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-dbd0538e-5bb8-4444-ba74-e9195d0e2a5c tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:49.693713 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:00:50.835687 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-dbd0538e-5bb8-4444-ba74-e9195d0e2a5c tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1b410a64e0415a96d30f5040361137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd7873d6db4e09bc9ab9a048a6b1ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:00:50.849302 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-dbd0538e-5bb8-4444-ba74-e9195d0e2a5c tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] 10.222.0.18 "GET /compute/v2.1/servers/a3ed180f-6c68-4c19-bdb7-602dd8ffaaf2" status: 200 len: 1273 microversion: 2.1 time: 1.234732 Oct 22 21:00:50.850337 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1379/2632] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:00:49 2022] GET /compute/v2.1/servers/a3ed180f-6c68-4c19-bdb7-602dd8ffaaf2 => generated 1273 bytes in 1236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:00:50.862403 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-90f6e66d-d512-405f-8610-cd507917bbcf tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Calling method '.version_select at 0x7fd3a482a160>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:00:51.058557 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-90f6e66d-d512-405f-8610-cd507917bbcf tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] 10.222.0.18 "GET /compute/v2.1/images/8368f750-e203-4ef8-b979-ba7ef86a0df0" status: 200 len: 1455 microversion: 2.1 time: 0.206614 Oct 22 21:00:51.059215 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1380/2633] 10.222.0.18 () {58 vars in 1233 bytes} [Sat Oct 22 21:00:50 2022] GET /compute/v2.1/images/8368f750-e203-4ef8-b979-ba7ef86a0df0 => generated 1455 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:00:51.071712 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-32303e0b-dfdc-4e82-ab1b-7e66254780c5 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Calling method '.version_select at 0x7fd39fd7c700>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:00:51.209896 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-32303e0b-dfdc-4e82-ab1b-7e66254780c5 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] 10.222.0.18 "GET /compute/v2.1/images/45d0a13c-b73b-4f91-b353-a22f0963a598" status: 200 len: 1413 microversion: 2.1 time: 0.141019 Oct 22 21:00:51.213132 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1381/2634] 10.222.0.18 () {58 vars in 1233 bytes} [Sat Oct 22 21:00:51 2022] GET /compute/v2.1/images/45d0a13c-b73b-4f91-b353-a22f0963a598 => generated 1413 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:00:51.323914 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-a9649d59-8ed7-4ffb-9cd4-4ff50df5c3d2 tempest-ServerDiagnosticsNegativeTest-616658542 tempest-ServerDiagnosticsNegativeTest-616658542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42dbc5f3bc042ef935dd95e123bab0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ca06233c6b4e808308cf6613eb8db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:00:51.332926 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-a9649d59-8ed7-4ffb-9cd4-4ff50df5c3d2 tempest-ServerDiagnosticsNegativeTest-616658542 tempest-ServerDiagnosticsNegativeTest-616658542-project] 10.222.0.18 "GET /compute/v2.1/servers/5e249f40-5d17-49e0-8b86-75f2b4f089c2" status: 200 len: 1472 microversion: 2.1 time: 1.750378 Oct 22 21:00:51.333523 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1254/2635] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:00:49 2022] GET /compute/v2.1/servers/5e249f40-5d17-49e0-8b86-75f2b4f089c2 => generated 1472 bytes in 1752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:00:51.356902 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-70dc9e93-50b6-4f2a-a4a2-3d485e5b25fa tempest-ServerDiagnosticsNegativeTest-616658542 tempest-ServerDiagnosticsNegativeTest-616658542-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:00:51.357410 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-70dc9e93-50b6-4f2a-a4a2-3d485e5b25fa tempest-ServerDiagnosticsNegativeTest-616658542 tempest-ServerDiagnosticsNegativeTest-616658542-project] [instance: 5e249f40-5d17-49e0-8b86-75f2b4f089c2] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:00:51.376173 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-70dc9e93-50b6-4f2a-a4a2-3d485e5b25fa tempest-ServerDiagnosticsNegativeTest-616658542 tempest-ServerDiagnosticsNegativeTest-616658542-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:51.376671 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-70dc9e93-50b6-4f2a-a4a2-3d485e5b25fa tempest-ServerDiagnosticsNegativeTest-616658542 tempest-ServerDiagnosticsNegativeTest-616658542-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:51.377111 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-70dc9e93-50b6-4f2a-a4a2-3d485e5b25fa tempest-ServerDiagnosticsNegativeTest-616658542 tempest-ServerDiagnosticsNegativeTest-616658542-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:51.377999 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-70dc9e93-50b6-4f2a-a4a2-3d485e5b25fa tempest-ServerDiagnosticsNegativeTest-616658542 tempest-ServerDiagnosticsNegativeTest-616658542-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:51.388663 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-70dc9e93-50b6-4f2a-a4a2-3d485e5b25fa tempest-ServerDiagnosticsNegativeTest-616658542 tempest-ServerDiagnosticsNegativeTest-616658542-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:51.390154 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-70dc9e93-50b6-4f2a-a4a2-3d485e5b25fa tempest-ServerDiagnosticsNegativeTest-616658542 tempest-ServerDiagnosticsNegativeTest-616658542-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:51.462884 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-70dc9e93-50b6-4f2a-a4a2-3d485e5b25fa tempest-ServerDiagnosticsNegativeTest-616658542 tempest-ServerDiagnosticsNegativeTest-616658542-project] Policy check for os_compute_api:os-server-diagnostics failed with credentials {'is_admin': False, 'user_id': 'd42dbc5f3bc042ef935dd95e123bab0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ca06233c6b4e808308cf6613eb8db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:00:51.474848 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-70dc9e93-50b6-4f2a-a4a2-3d485e5b25fa tempest-ServerDiagnosticsNegativeTest-616658542 tempest-ServerDiagnosticsNegativeTest-616658542-project] Request method failure captured: Oct 22 21:00:51.474848 ncdv-master-1 devstack@n-api.service[138745]: request: GET /compute/v2.1/servers/5e249f40-5d17-49e0-8b86-75f2b4f089c2/diagnostics HTTP/1.1 Oct 22 21:00:51.474848 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 21:00:51.474848 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 21:00:51.474848 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 21:00:51.474848 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 0 Oct 22 21:00:51.474848 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 21:00:51.474848 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 21:00:51.474848 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 21:00:51.474848 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 21:00:51.474848 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVFnrfxMdCLPpKTknu-4TyiXXKhYjDgrhyjyVCFJyMwxQ-x6b-v0C-rJ7Ky37PJ0Q2VLP2Xnhun_duL6wcXoHYoji6nJaMC5hVhxN-YRT0nn32mlQuBPpJhcq9jm72_GUrhdEYn10eF1wUfnuRECgGNu1kK2hPYH_tj1XFb4Mg77BXLk Oct 22 21:00:51.474848 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 21:00:51.474848 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 21:00:51.474848 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 21:00:51.474848 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 21:00:51.474848 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 21:00:51.474848 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 21:00:51.474848 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: 18ca06233c6b4e808308cf6613eb8db5 Oct 22 21:00:51.474848 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-616658542 Oct 22 21:00:51.474848 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 21:00:51.474848 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 21:00:51.474848 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_18ca06233c6b4e808308cf6613eb8db5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/18ca06233c6b4e808308cf6613eb8db5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/18ca06233c6b4e808308cf6613eb8db5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/18ca06233c6b4e808308cf6613eb8db5"}]}] Oct 22 21:00:51.474848 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-616658542 Oct 22 21:00:51.474848 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: 18ca06233c6b4e808308cf6613eb8db5 Oct 22 21:00:51.474848 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-616658542 Oct 22 21:00:51.474848 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-ServerDiagnosticsNegativeTest-616658542-project Oct 22 21:00:51.474848 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 21:00:51.474848 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 21:00:51.474848 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: d42dbc5f3bc042ef935dd95e123bab0b Oct 22 21:00:51.474848 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-616658542-project Oct 22 21:00:51.474848 ncdv-master-1 devstack@n-api.service[138745]: method: > Oct 22 21:00:51.474848 ncdv-master-1 devstack@n-api.service[138745]: exception: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Oct 22 21:00:51.474848 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'server_id': '5e249f40-5d17-49e0-8b86-75f2b4f089c2'} Oct 22 21:00:51.474848 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:00:51.474848 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:00:51.474848 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:00:51.474848 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:00:51.474848 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:00:51.474848 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:00:51.474848 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:00:51.474848 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:00:51.474848 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_diagnostics.py", line 38, in index Oct 22 21:00:51.474848 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi context.can(sd_policies.BASE_POLICY_NAME, Oct 22 21:00:51.474848 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 22 21:00:51.474848 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 22 21:00:51.474848 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 22 21:00:51.474848 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 22 21:00:51.474848 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 22 21:00:51.474848 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 22 21:00:51.474848 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 22 21:00:51.474848 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise self.value Oct 22 21:00:51.474848 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 22 21:00:51.474848 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 22 21:00:51.474848 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 22 21:00:51.474848 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 22 21:00:51.474848 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 22 21:00:51.474848 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 22 21:00:51.474848 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Oct 22 21:00:51.474848 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:00:51.474848 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:00:51.474848 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:00:51.474848 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:00:51.481381 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:00:51.481381 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:00:51.481381 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 22 21:00:51.481381 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 22 21:00:51.481381 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Oct 22 21:00:51.481381 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:00:51.481381 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-70dc9e93-50b6-4f2a-a4a2-3d485e5b25fa tempest-ServerDiagnosticsNegativeTest-616658542 tempest-ServerDiagnosticsNegativeTest-616658542-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:00:51.481381 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-70dc9e93-50b6-4f2a-a4a2-3d485e5b25fa tempest-ServerDiagnosticsNegativeTest-616658542 tempest-ServerDiagnosticsNegativeTest-616658542-project] 10.222.0.18 "GET /compute/v2.1/servers/5e249f40-5d17-49e0-8b86-75f2b4f089c2/diagnostics" status: 403 len: 117 microversion: 2.1 time: 0.124167 Oct 22 21:00:51.481381 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1382/2636] 10.222.0.18 () {58 vars in 1272 bytes} [Sat Oct 22 21:00:51 2022] GET /compute/v2.1/servers/5e249f40-5d17-49e0-8b86-75f2b4f089c2/diagnostics => generated 117 bytes in 125 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 22 21:00:51.496734 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-5f9260bc-5099-4c45-b345-59b2e09ed8c0 tempest-ServerDiagnosticsNegativeTest-616658542 tempest-ServerDiagnosticsNegativeTest-616658542-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:00:51.497485 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-5f9260bc-5099-4c45-b345-59b2e09ed8c0 tempest-ServerDiagnosticsNegativeTest-616658542 tempest-ServerDiagnosticsNegativeTest-616658542-project] [instance: 5e249f40-5d17-49e0-8b86-75f2b4f089c2] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:00:51.519768 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5f9260bc-5099-4c45-b345-59b2e09ed8c0 tempest-ServerDiagnosticsNegativeTest-616658542 tempest-ServerDiagnosticsNegativeTest-616658542-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:51.520645 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5f9260bc-5099-4c45-b345-59b2e09ed8c0 tempest-ServerDiagnosticsNegativeTest-616658542 tempest-ServerDiagnosticsNegativeTest-616658542-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:51.521305 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5f9260bc-5099-4c45-b345-59b2e09ed8c0 tempest-ServerDiagnosticsNegativeTest-616658542 tempest-ServerDiagnosticsNegativeTest-616658542-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:51.539799 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5f9260bc-5099-4c45-b345-59b2e09ed8c0 tempest-ServerDiagnosticsNegativeTest-616658542 tempest-ServerDiagnosticsNegativeTest-616658542-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:51.559154 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5f9260bc-5099-4c45-b345-59b2e09ed8c0 tempest-ServerDiagnosticsNegativeTest-616658542 tempest-ServerDiagnosticsNegativeTest-616658542-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:51.565564 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5f9260bc-5099-4c45-b345-59b2e09ed8c0 tempest-ServerDiagnosticsNegativeTest-616658542 tempest-ServerDiagnosticsNegativeTest-616658542-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:51.877445 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-f62d2fa2-8508-4a5a-8c97-ee19d5ddc75b tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:00:51.878222 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-f62d2fa2-8508-4a5a-8c97-ee19d5ddc75b tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] [instance: a3ed180f-6c68-4c19-bdb7-602dd8ffaaf2] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:00:51.897822 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f62d2fa2-8508-4a5a-8c97-ee19d5ddc75b tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:51.898076 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f62d2fa2-8508-4a5a-8c97-ee19d5ddc75b tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:51.904572 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f62d2fa2-8508-4a5a-8c97-ee19d5ddc75b tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:51.909120 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f62d2fa2-8508-4a5a-8c97-ee19d5ddc75b tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:51.912012 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f62d2fa2-8508-4a5a-8c97-ee19d5ddc75b tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:51.915719 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f62d2fa2-8508-4a5a-8c97-ee19d5ddc75b tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:52.313378 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-5f9260bc-5099-4c45-b345-59b2e09ed8c0 tempest-ServerDiagnosticsNegativeTest-616658542 tempest-ServerDiagnosticsNegativeTest-616658542-project] [instance: 5e249f40-5d17-49e0-8b86-75f2b4f089c2] Going to try to terminate instance {{(pid=138744) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 21:00:52.505130 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-5f9260bc-5099-4c45-b345-59b2e09ed8c0 tempest-ServerDiagnosticsNegativeTest-616658542 tempest-ServerDiagnosticsNegativeTest-616658542-project] 10.222.0.18 "DELETE /compute/v2.1/servers/5e249f40-5d17-49e0-8b86-75f2b4f089c2" status: 204 len: 0 microversion: 2.1 time: 1.014715 Oct 22 21:00:52.512592 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1255/2637] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 21:00:51 2022] DELETE /compute/v2.1/servers/5e249f40-5d17-49e0-8b86-75f2b4f089c2 => generated 0 bytes in 1024 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 21:00:52.525356 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-94da34d1-0648-4ecd-96e2-579d417b6588 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Calling method '.version_select at 0x7fd39f148d30>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:00:52.653120 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-94da34d1-0648-4ecd-96e2-579d417b6588 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] 10.222.0.18 "GET /compute/v2.1/images/8368f750-e203-4ef8-b979-ba7ef86a0df0" status: 200 len: 1455 microversion: 2.1 time: 0.138713 Oct 22 21:00:52.655122 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1256/2638] 10.222.0.18 () {58 vars in 1233 bytes} [Sat Oct 22 21:00:52 2022] GET /compute/v2.1/images/8368f750-e203-4ef8-b979-ba7ef86a0df0 => generated 1455 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:00:52.671290 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-d807776e-a541-4149-8686-a27a29917414 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Calling method '.version_select at 0x7fd39f148ca0>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:00:52.838934 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-d807776e-a541-4149-8686-a27a29917414 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] 10.222.0.18 "GET /compute/v2.1/images/45d0a13c-b73b-4f91-b353-a22f0963a598" status: 200 len: 1413 microversion: 2.1 time: 0.179862 Oct 22 21:00:52.849042 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1257/2639] 10.222.0.18 () {58 vars in 1233 bytes} [Sat Oct 22 21:00:52 2022] GET /compute/v2.1/images/45d0a13c-b73b-4f91-b353-a22f0963a598 => generated 1413 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:00:52.855952 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-b4cbacba-4ac1-4734-a841-eff78afa562f tempest-ServerDiagnosticsNegativeTest-616658542 tempest-ServerDiagnosticsNegativeTest-616658542-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:00:52.857889 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-b4cbacba-4ac1-4734-a841-eff78afa562f tempest-ServerDiagnosticsNegativeTest-616658542 tempest-ServerDiagnosticsNegativeTest-616658542-project] [instance: 5e249f40-5d17-49e0-8b86-75f2b4f089c2] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:00:52.869860 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b4cbacba-4ac1-4734-a841-eff78afa562f tempest-ServerDiagnosticsNegativeTest-616658542 tempest-ServerDiagnosticsNegativeTest-616658542-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:52.870571 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b4cbacba-4ac1-4734-a841-eff78afa562f tempest-ServerDiagnosticsNegativeTest-616658542 tempest-ServerDiagnosticsNegativeTest-616658542-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:52.871317 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b4cbacba-4ac1-4734-a841-eff78afa562f tempest-ServerDiagnosticsNegativeTest-616658542 tempest-ServerDiagnosticsNegativeTest-616658542-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:52.873786 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b4cbacba-4ac1-4734-a841-eff78afa562f tempest-ServerDiagnosticsNegativeTest-616658542 tempest-ServerDiagnosticsNegativeTest-616658542-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:52.875442 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b4cbacba-4ac1-4734-a841-eff78afa562f tempest-ServerDiagnosticsNegativeTest-616658542 tempest-ServerDiagnosticsNegativeTest-616658542-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:52.876369 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b4cbacba-4ac1-4734-a841-eff78afa562f tempest-ServerDiagnosticsNegativeTest-616658542 tempest-ServerDiagnosticsNegativeTest-616658542-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:52.933157 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-f62d2fa2-8508-4a5a-8c97-ee19d5ddc75b tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1b410a64e0415a96d30f5040361137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd7873d6db4e09bc9ab9a048a6b1ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:00:52.948065 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-f62d2fa2-8508-4a5a-8c97-ee19d5ddc75b tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] 10.222.0.18 "GET /compute/v2.1/servers/a3ed180f-6c68-4c19-bdb7-602dd8ffaaf2" status: 200 len: 1315 microversion: 2.1 time: 1.074864 Oct 22 21:00:52.952151 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1383/2640] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:00:51 2022] GET /compute/v2.1/servers/a3ed180f-6c68-4c19-bdb7-602dd8ffaaf2 => generated 1315 bytes in 1080 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:00:53.670883 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-4c41d72d-2fd0-4c7a-aa4d-9f4022830dcd tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Calling method '.version_select at 0x7fd3a482a160>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:00:53.697678 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-b4cbacba-4ac1-4734-a841-eff78afa562f tempest-ServerDiagnosticsNegativeTest-616658542 tempest-ServerDiagnosticsNegativeTest-616658542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42dbc5f3bc042ef935dd95e123bab0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ca06233c6b4e808308cf6613eb8db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:00:53.716124 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-b4cbacba-4ac1-4734-a841-eff78afa562f tempest-ServerDiagnosticsNegativeTest-616658542 tempest-ServerDiagnosticsNegativeTest-616658542-project] 10.222.0.18 "GET /compute/v2.1/servers/5e249f40-5d17-49e0-8b86-75f2b4f089c2" status: 200 len: 1478 microversion: 2.1 time: 0.865383 Oct 22 21:00:53.716779 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1258/2641] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:00:52 2022] GET /compute/v2.1/servers/5e249f40-5d17-49e0-8b86-75f2b4f089c2 => generated 1478 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:00:53.807896 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-4c41d72d-2fd0-4c7a-aa4d-9f4022830dcd tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] 10.222.0.18 "GET /compute/v2.1/images/8368f750-e203-4ef8-b979-ba7ef86a0df0" status: 200 len: 1455 microversion: 2.1 time: 0.141593 Oct 22 21:00:53.809589 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1384/2642] 10.222.0.18 () {58 vars in 1233 bytes} [Sat Oct 22 21:00:53 2022] GET /compute/v2.1/images/8368f750-e203-4ef8-b979-ba7ef86a0df0 => generated 1455 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:00:53.856570 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-a4e8b7a9-db24-4b6d-97cf-d4ca70b84504 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Calling method '.version_select at 0x7fd39f198ca0>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:00:53.979662 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-a9465e36-a4c3-461c-9b81-9511d7b5052b tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:00:53.981307 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-a9465e36-a4c3-461c-9b81-9511d7b5052b tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] [instance: a3ed180f-6c68-4c19-bdb7-602dd8ffaaf2] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:00:53.994425 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a9465e36-a4c3-461c-9b81-9511d7b5052b tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:54.004667 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a9465e36-a4c3-461c-9b81-9511d7b5052b tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:54.005371 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a9465e36-a4c3-461c-9b81-9511d7b5052b tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:54.021460 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-a4e8b7a9-db24-4b6d-97cf-d4ca70b84504 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] 10.222.0.18 "GET /compute/v2.1/images/45d0a13c-b73b-4f91-b353-a22f0963a598" status: 200 len: 1413 microversion: 2.1 time: 0.169561 Oct 22 21:00:54.027934 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1259/2643] 10.222.0.18 () {58 vars in 1233 bytes} [Sat Oct 22 21:00:53 2022] GET /compute/v2.1/images/45d0a13c-b73b-4f91-b353-a22f0963a598 => generated 1413 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:00:54.029737 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a9465e36-a4c3-461c-9b81-9511d7b5052b tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:54.031381 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a9465e36-a4c3-461c-9b81-9511d7b5052b tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:54.033982 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a9465e36-a4c3-461c-9b81-9511d7b5052b tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:54.356417 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-33eadf53-2f9d-4d39-ac4e-606b108aa390 req-830e5892-af2c-4993-b3a8-0318bcba1dbb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af11a208-be6e-4f70-85f0-4bafafb4febd", "name": "network-vif-plugged", "status": "completed", "tag": "3d94ca32-d8de-4aba-97b8-bd0eca70cdee"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:00:54.385645 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-33eadf53-2f9d-4d39-ac4e-606b108aa390 req-830e5892-af2c-4993-b3a8-0318bcba1dbb service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:54.391866 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-33eadf53-2f9d-4d39-ac4e-606b108aa390 req-830e5892-af2c-4993-b3a8-0318bcba1dbb service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:54.394981 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-33eadf53-2f9d-4d39-ac4e-606b108aa390 req-830e5892-af2c-4993-b3a8-0318bcba1dbb service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:54.410600 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:00:54.442673 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-33eadf53-2f9d-4d39-ac4e-606b108aa390 req-830e5892-af2c-4993-b3a8-0318bcba1dbb service nova] Creating event network-vif-plugged:3d94ca32-d8de-4aba-97b8-bd0eca70cdee for instance af11a208-be6e-4f70-85f0-4bafafb4febd on nch1-master-1 Oct 22 21:00:54.459816 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-33eadf53-2f9d-4d39-ac4e-606b108aa390 req-830e5892-af2c-4993-b3a8-0318bcba1dbb service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111393 Oct 22 21:00:54.463859 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1260/2644] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:00:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 21:00:54.648967 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-a9465e36-a4c3-461c-9b81-9511d7b5052b tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1b410a64e0415a96d30f5040361137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd7873d6db4e09bc9ab9a048a6b1ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:00:54.666462 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-a9465e36-a4c3-461c-9b81-9511d7b5052b tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] 10.222.0.18 "GET /compute/v2.1/servers/a3ed180f-6c68-4c19-bdb7-602dd8ffaaf2" status: 200 len: 1315 microversion: 2.1 time: 0.692042 Oct 22 21:00:54.667753 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1385/2645] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:00:53 2022] GET /compute/v2.1/servers/a3ed180f-6c68-4c19-bdb7-602dd8ffaaf2 => generated 1315 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:00:54.748428 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-327e9c05-46a5-423e-ad64-6f309cc5b8be tempest-ServerDiagnosticsNegativeTest-616658542 tempest-ServerDiagnosticsNegativeTest-616658542-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:00:54.749403 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-327e9c05-46a5-423e-ad64-6f309cc5b8be tempest-ServerDiagnosticsNegativeTest-616658542 tempest-ServerDiagnosticsNegativeTest-616658542-project] [instance: 5e249f40-5d17-49e0-8b86-75f2b4f089c2] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:00:54.759615 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-327e9c05-46a5-423e-ad64-6f309cc5b8be tempest-ServerDiagnosticsNegativeTest-616658542 tempest-ServerDiagnosticsNegativeTest-616658542-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:54.760491 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-327e9c05-46a5-423e-ad64-6f309cc5b8be tempest-ServerDiagnosticsNegativeTest-616658542 tempest-ServerDiagnosticsNegativeTest-616658542-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:54.761138 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-327e9c05-46a5-423e-ad64-6f309cc5b8be tempest-ServerDiagnosticsNegativeTest-616658542 tempest-ServerDiagnosticsNegativeTest-616658542-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:54.762238 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-327e9c05-46a5-423e-ad64-6f309cc5b8be tempest-ServerDiagnosticsNegativeTest-616658542 tempest-ServerDiagnosticsNegativeTest-616658542-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:54.762864 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-327e9c05-46a5-423e-ad64-6f309cc5b8be tempest-ServerDiagnosticsNegativeTest-616658542 tempest-ServerDiagnosticsNegativeTest-616658542-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:54.764212 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-327e9c05-46a5-423e-ad64-6f309cc5b8be tempest-ServerDiagnosticsNegativeTest-616658542 tempest-ServerDiagnosticsNegativeTest-616658542-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:54.827189 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-e664bfc9-4698-46e3-98e2-6589a8f3a9a5 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Calling method '.version_select at 0x7fd39fb9b790>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:00:54.900903 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-e664bfc9-4698-46e3-98e2-6589a8f3a9a5 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] 10.222.0.18 "GET /compute/v2.1/images/8368f750-e203-4ef8-b979-ba7ef86a0df0" status: 200 len: 1455 microversion: 2.1 time: 0.081041 Oct 22 21:00:54.901482 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1386/2646] 10.222.0.18 () {58 vars in 1233 bytes} [Sat Oct 22 21:00:54 2022] GET /compute/v2.1/images/8368f750-e203-4ef8-b979-ba7ef86a0df0 => generated 1455 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:00:55.044895 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-983114c3-10f2-4b53-ba42-74875600702d tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Calling method '.version_select at 0x7fd39fd7c4c0>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:00:55.342244 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-983114c3-10f2-4b53-ba42-74875600702d tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] 10.222.0.18 "GET /compute/v2.1/images/45d0a13c-b73b-4f91-b353-a22f0963a598" status: 200 len: 1413 microversion: 2.1 time: 0.295390 Oct 22 21:00:55.342844 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1387/2647] 10.222.0.18 () {58 vars in 1233 bytes} [Sat Oct 22 21:00:55 2022] GET /compute/v2.1/images/45d0a13c-b73b-4f91-b353-a22f0963a598 => generated 1413 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:00:55.533346 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-327e9c05-46a5-423e-ad64-6f309cc5b8be tempest-ServerDiagnosticsNegativeTest-616658542 tempest-ServerDiagnosticsNegativeTest-616658542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42dbc5f3bc042ef935dd95e123bab0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ca06233c6b4e808308cf6613eb8db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:00:55.542891 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-327e9c05-46a5-423e-ad64-6f309cc5b8be tempest-ServerDiagnosticsNegativeTest-616658542 tempest-ServerDiagnosticsNegativeTest-616658542-project] 10.222.0.18 "GET /compute/v2.1/servers/5e249f40-5d17-49e0-8b86-75f2b4f089c2" status: 200 len: 1478 microversion: 2.1 time: 0.802557 Oct 22 21:00:55.561280 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1261/2648] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:00:54 2022] GET /compute/v2.1/servers/5e249f40-5d17-49e0-8b86-75f2b4f089c2 => generated 1478 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:00:55.689953 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-e4529eef-6c03-453f-9639-440844bb34e9 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:00:55.690927 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-e4529eef-6c03-453f-9639-440844bb34e9 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] [instance: a3ed180f-6c68-4c19-bdb7-602dd8ffaaf2] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:00:55.704667 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e4529eef-6c03-453f-9639-440844bb34e9 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:55.705413 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e4529eef-6c03-453f-9639-440844bb34e9 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:55.707314 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e4529eef-6c03-453f-9639-440844bb34e9 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:55.716811 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e4529eef-6c03-453f-9639-440844bb34e9 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:00:55.717565 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e4529eef-6c03-453f-9639-440844bb34e9 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:00:55.718230 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e4529eef-6c03-453f-9639-440844bb34e9 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:00:55.916700 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-f8bcbbac-9ae0-4881-899e-411154feffe8 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Calling method '.version_select at 0x7fd39f1eadc0>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:00:56.695837 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell0:SELECT=2 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:00:56.737910 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-e4529eef-6c03-453f-9639-440844bb34e9 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1b410a64e0415a96d30f5040361137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd7873d6db4e09bc9ab9a048a6b1ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:00:56.760707 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-e4529eef-6c03-453f-9639-440844bb34e9 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] 10.222.0.18 "GET /compute/v2.1/servers/a3ed180f-6c68-4c19-bdb7-602dd8ffaaf2" status: 200 len: 1315 microversion: 2.1 time: 1.067599 Oct 22 21:00:56.761740 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1388/2649] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:00:55 2022] GET /compute/v2.1/servers/a3ed180f-6c68-4c19-bdb7-602dd8ffaaf2 => generated 1315 bytes in 1076 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:00:56.780422 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-c3dcf099-3a61-45e6-b279-b6803b35ccc1 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Calling method '.version_select at 0x7fd39fb9b3a0>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:00:57.336664 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell0:SELECT=8 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:01:04.759502 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:01:05.538534 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:SELECT=7 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:01:05.703913 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=3 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:01:06.748800 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell1:SELECT=25 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:01:08.773557 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-f8bcbbac-9ae0-4881-899e-411154feffe8 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] 10.222.0.18 "GET /compute/v2.1/images/8368f750-e203-4ef8-b979-ba7ef86a0df0" status: 200 len: 1464 microversion: 2.1 time: 12.860514 Oct 22 21:01:08.782875 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-c3dcf099-3a61-45e6-b279-b6803b35ccc1 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] 10.222.0.18 "GET /compute/v2.1/images/45d0a13c-b73b-4f91-b353-a22f0963a598" status: 200 len: 1413 microversion: 2.1 time: 12.019603 Oct 22 21:01:08.791833 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1262/2650] 10.222.0.18 () {58 vars in 1233 bytes} [Sat Oct 22 21:00:55 2022] GET /compute/v2.1/images/8368f750-e203-4ef8-b979-ba7ef86a0df0 => generated 1464 bytes in 12871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:01:08.792050 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1389/2651] 10.222.0.18 () {58 vars in 1233 bytes} [Sat Oct 22 21:00:56 2022] GET /compute/v2.1/images/45d0a13c-b73b-4f91-b353-a22f0963a598 => generated 1413 bytes in 12021 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:01:08.792171 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-03cada4c-674c-4d80-a3b0-61a6298c51c3 req-167fb213-207d-415f-975d-0ffa3c0e1e56 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3ed180f-6c68-4c19-bdb7-602dd8ffaaf2", "tag": "dff23b77-ab17-434d-a284-5b6ea50faa86"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:01:08.796470 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-c72a8951-18b3-4f3f-98a3-df4c7b679a3a tempest-ServerDiagnosticsNegativeTest-616658542 tempest-ServerDiagnosticsNegativeTest-616658542-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:01:08.798421 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-c72a8951-18b3-4f3f-98a3-df4c7b679a3a tempest-ServerDiagnosticsNegativeTest-616658542 tempest-ServerDiagnosticsNegativeTest-616658542-project] [instance: 5e249f40-5d17-49e0-8b86-75f2b4f089c2] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:01:08.819482 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-03cada4c-674c-4d80-a3b0-61a6298c51c3 req-167fb213-207d-415f-975d-0ffa3c0e1e56 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:01:08.820109 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-03cada4c-674c-4d80-a3b0-61a6298c51c3 req-167fb213-207d-415f-975d-0ffa3c0e1e56 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:01:08.820637 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-03cada4c-674c-4d80-a3b0-61a6298c51c3 req-167fb213-207d-415f-975d-0ffa3c0e1e56 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:01:08.823056 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c72a8951-18b3-4f3f-98a3-df4c7b679a3a tempest-ServerDiagnosticsNegativeTest-616658542 tempest-ServerDiagnosticsNegativeTest-616658542-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:01:08.825437 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c72a8951-18b3-4f3f-98a3-df4c7b679a3a tempest-ServerDiagnosticsNegativeTest-616658542 tempest-ServerDiagnosticsNegativeTest-616658542-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:01:08.827266 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c72a8951-18b3-4f3f-98a3-df4c7b679a3a tempest-ServerDiagnosticsNegativeTest-616658542 tempest-ServerDiagnosticsNegativeTest-616658542-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:01:08.829408 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c72a8951-18b3-4f3f-98a3-df4c7b679a3a tempest-ServerDiagnosticsNegativeTest-616658542 tempest-ServerDiagnosticsNegativeTest-616658542-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:01:08.830444 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c72a8951-18b3-4f3f-98a3-df4c7b679a3a tempest-ServerDiagnosticsNegativeTest-616658542 tempest-ServerDiagnosticsNegativeTest-616658542-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:01:08.832316 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c72a8951-18b3-4f3f-98a3-df4c7b679a3a tempest-ServerDiagnosticsNegativeTest-616658542 tempest-ServerDiagnosticsNegativeTest-616658542-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:01:08.847816 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-03cada4c-674c-4d80-a3b0-61a6298c51c3 req-167fb213-207d-415f-975d-0ffa3c0e1e56 service nova] Creating event network-changed:dff23b77-ab17-434d-a284-5b6ea50faa86 for instance a3ed180f-6c68-4c19-bdb7-602dd8ffaaf2 on nch2-master-1 Oct 22 21:01:08.859559 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.wsgi [None req-c72a8951-18b3-4f3f-98a3-df4c7b679a3a tempest-ServerDiagnosticsNegativeTest-616658542 tempest-ServerDiagnosticsNegativeTest-616658542-project] HTTP exception thrown: Instance 5e249f40-5d17-49e0-8b86-75f2b4f089c2 could not be found. Oct 22 21:01:08.862539 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-c72a8951-18b3-4f3f-98a3-df4c7b679a3a tempest-ServerDiagnosticsNegativeTest-616658542 tempest-ServerDiagnosticsNegativeTest-616658542-project] Request method failure captured: Oct 22 21:01:08.862539 ncdv-master-1 devstack@n-api.service[138745]: request: GET /compute/v2.1/servers/5e249f40-5d17-49e0-8b86-75f2b4f089c2 HTTP/1.1 Oct 22 21:01:08.862539 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 21:01:08.862539 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 21:01:08.862539 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 21:01:08.862539 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 0 Oct 22 21:01:08.862539 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 21:01:08.862539 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 21:01:08.862539 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 21:01:08.862539 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 21:01:08.862539 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVFnrfxMdCLPpKTknu-4TyiXXKhYjDgrhyjyVCFJyMwxQ-x6b-v0C-rJ7Ky37PJ0Q2VLP2Xnhun_duL6wcXoHYoji6nJaMC5hVhxN-YRT0nn32mlQuBPpJhcq9jm72_GUrhdEYn10eF1wUfnuRECgGNu1kK2hPYH_tj1XFb4Mg77BXLk Oct 22 21:01:08.862539 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 21:01:08.862539 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 21:01:08.862539 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 21:01:08.862539 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 21:01:08.862539 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 21:01:08.862539 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 21:01:08.862539 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: 18ca06233c6b4e808308cf6613eb8db5 Oct 22 21:01:08.862539 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-616658542 Oct 22 21:01:08.862539 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 21:01:08.862539 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 21:01:08.862539 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_18ca06233c6b4e808308cf6613eb8db5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/18ca06233c6b4e808308cf6613eb8db5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/18ca06233c6b4e808308cf6613eb8db5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/18ca06233c6b4e808308cf6613eb8db5"}]}] Oct 22 21:01:08.862539 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-616658542 Oct 22 21:01:08.862539 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: 18ca06233c6b4e808308cf6613eb8db5 Oct 22 21:01:08.862539 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-616658542 Oct 22 21:01:08.862539 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-ServerDiagnosticsNegativeTest-616658542-project Oct 22 21:01:08.862539 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 21:01:08.862539 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 21:01:08.862539 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: d42dbc5f3bc042ef935dd95e123bab0b Oct 22 21:01:08.862539 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-616658542-project Oct 22 21:01:08.862539 ncdv-master-1 devstack@n-api.service[138745]: method: > Oct 22 21:01:08.862539 ncdv-master-1 devstack@n-api.service[138745]: exception: Instance 5e249f40-5d17-49e0-8b86-75f2b4f089c2 could not be found. Oct 22 21:01:08.862539 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'id': '5e249f40-5d17-49e0-8b86-75f2b4f089c2'} Oct 22 21:01:08.862539 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:01:08.862539 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:01:08.862539 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 21:01:08.862539 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 21:01:08.862539 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 21:01:08.862539 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 21:01:08.862539 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 21:01:08.862539 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 21:01:08.862539 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 21:01:08.862539 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 21:01:08.862539 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5e249f40-5d17-49e0-8b86-75f2b4f089c2 could not be found. Oct 22 21:01:08.862539 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:01:08.862539 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:01:08.862539 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:01:08.862539 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:01:08.862539 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:01:08.862539 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:01:08.862539 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:01:08.862539 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:01:08.862539 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:01:08.862539 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:01:08.862539 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 21:01:08.862539 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 21:01:08.862539 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 21:01:08.862539 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 21:01:08.862539 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 21:01:08.862539 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:01:08.862539 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e249f40-5d17-49e0-8b86-75f2b4f089c2 could not be found. Oct 22 21:01:08.862539 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:01:08.862539 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:01:08.867777 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:01:08.867777 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:01:08.867777 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:01:08.867777 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:01:08.867777 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:01:08.867777 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:01:08.867777 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e249f40-5d17-49e0-8b86-75f2b4f089c2 could not be found. Oct 22 21:01:08.867777 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:01:08.869373 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-03cada4c-674c-4d80-a3b0-61a6298c51c3 req-167fb213-207d-415f-975d-0ffa3c0e1e56 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081336 Oct 22 21:01:08.870267 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-c72a8951-18b3-4f3f-98a3-df4c7b679a3a tempest-ServerDiagnosticsNegativeTest-616658542 tempest-ServerDiagnosticsNegativeTest-616658542-project] Returning 404 to user: Instance 5e249f40-5d17-49e0-8b86-75f2b4f089c2 could not be found. {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:01:08.872302 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-c72a8951-18b3-4f3f-98a3-df4c7b679a3a tempest-ServerDiagnosticsNegativeTest-616658542 tempest-ServerDiagnosticsNegativeTest-616658542-project] 10.222.0.18 "GET /compute/v2.1/servers/5e249f40-5d17-49e0-8b86-75f2b4f089c2" status: 404 len: 111 microversion: 2.1 time: 0.087323 Oct 22 21:01:08.873431 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1390/2653] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:01:08 2022] GET /compute/v2.1/servers/5e249f40-5d17-49e0-8b86-75f2b4f089c2 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 21:01:08.877607 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1263/2652] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:01:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:01:08.880653 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-964431d1-da5d-4209-b997-f3f4ec066270 req-755ba351-0c17-49f6-87b5-4c550c251660 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e249f40-5d17-49e0-8b86-75f2b4f089c2", "name": "network-vif-deleted", "tag": "7a75caf1-7002-4fb3-a44f-b64953426958"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:01:08.894307 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-6b3148be-363d-4ee6-bd28-63910f0726c9 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:01:08.899714 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-964431d1-da5d-4209-b997-f3f4ec066270 req-755ba351-0c17-49f6-87b5-4c550c251660 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:01:08.900473 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-964431d1-da5d-4209-b997-f3f4ec066270 req-755ba351-0c17-49f6-87b5-4c550c251660 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:01:08.903213 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-6b3148be-363d-4ee6-bd28-63910f0726c9 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] [instance: a3ed180f-6c68-4c19-bdb7-602dd8ffaaf2] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:01:08.903838 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-964431d1-da5d-4209-b997-f3f4ec066270 req-755ba351-0c17-49f6-87b5-4c550c251660 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:01:08.928840 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-964431d1-da5d-4209-b997-f3f4ec066270 req-755ba351-0c17-49f6-87b5-4c550c251660 service nova] Creating event network-vif-deleted:7a75caf1-7002-4fb3-a44f-b64953426958 for instance 5e249f40-5d17-49e0-8b86-75f2b4f089c2 on nch1-master-1 Oct 22 21:01:08.931415 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6b3148be-363d-4ee6-bd28-63910f0726c9 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:01:08.936670 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-964431d1-da5d-4209-b997-f3f4ec066270 req-755ba351-0c17-49f6-87b5-4c550c251660 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061371 Oct 22 21:01:08.938047 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6b3148be-363d-4ee6-bd28-63910f0726c9 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:01:08.938590 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6b3148be-363d-4ee6-bd28-63910f0726c9 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:01:08.939766 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6b3148be-363d-4ee6-bd28-63910f0726c9 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:01:08.939938 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6b3148be-363d-4ee6-bd28-63910f0726c9 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:01:08.940476 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6b3148be-363d-4ee6-bd28-63910f0726c9 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:01:08.943482 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1391/2654] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:01:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:01:08.951322 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-a900d1aa-270b-41b0-b282-5e5a7d974042 req-e700ec5d-97fc-4583-8eff-e0ff0ced25e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3ed180f-6c68-4c19-bdb7-602dd8ffaaf2", "name": "network-vif-plugged", "status": "completed", "tag": "dff23b77-ab17-434d-a284-5b6ea50faa86"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:01:08.967321 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-a900d1aa-270b-41b0-b282-5e5a7d974042 req-e700ec5d-97fc-4583-8eff-e0ff0ced25e5 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:01:08.968316 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-a900d1aa-270b-41b0-b282-5e5a7d974042 req-e700ec5d-97fc-4583-8eff-e0ff0ced25e5 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:01:08.968907 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-a900d1aa-270b-41b0-b282-5e5a7d974042 req-e700ec5d-97fc-4583-8eff-e0ff0ced25e5 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:01:09.004903 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-a900d1aa-270b-41b0-b282-5e5a7d974042 req-e700ec5d-97fc-4583-8eff-e0ff0ced25e5 service nova] Creating event network-vif-plugged:dff23b77-ab17-434d-a284-5b6ea50faa86 for instance a3ed180f-6c68-4c19-bdb7-602dd8ffaaf2 on nch2-master-1 Oct 22 21:01:09.020370 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-a900d1aa-270b-41b0-b282-5e5a7d974042 req-e700ec5d-97fc-4583-8eff-e0ff0ced25e5 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072968 Oct 22 21:01:09.023096 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1392/2655] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:01:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:01:09.665557 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-5507f586-758e-4d59-a9a4-674fad024bdc tempest-MultipleCreateNegativeTestJSON-1425246118 tempest-MultipleCreateNegativeTestJSON-1425246118-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1816534690", "imageRef": "085e4478-6edc-4a69-8e08-f9831713eb65", "flavorRef": "452", "min_count": 3, "max_count": 2}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:01:09.671162 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.wsgi [None req-5507f586-758e-4d59-a9a4-674fad024bdc tempest-MultipleCreateNegativeTestJSON-1425246118 tempest-MultipleCreateNegativeTestJSON-1425246118-project] HTTP exception thrown: min_count must be <= max_count Oct 22 21:01:09.674138 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-5507f586-758e-4d59-a9a4-674fad024bdc tempest-MultipleCreateNegativeTestJSON-1425246118 tempest-MultipleCreateNegativeTestJSON-1425246118-project] Request method failure captured: Oct 22 21:01:09.674138 ncdv-master-1 devstack@n-api.service[138745]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 22 21:01:09.674138 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 21:01:09.674138 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 21:01:09.674138 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 21:01:09.674138 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 184 Oct 22 21:01:09.674138 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 21:01:09.674138 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 21:01:09.674138 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 21:01:09.674138 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 21:01:09.674138 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVFoSJIFlIDKEKIBf_Vk9oXkksOA3CiM63m3dXoJwDAFmx0ahaQQOhYPlp9hFsAzCTIRXtbPPJN03I0z0mgQ8t7ZsPXg4_KMdILr34f8y3UxxGePzbmaOWIaIXi_-zfNgcEytuqXC-ed0jr5ZGulfawRtRC-v9siXF1GNlvphG-O92kM Oct 22 21:01:09.674138 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 21:01:09.674138 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 21:01:09.674138 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 21:01:09.674138 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 21:01:09.674138 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 21:01:09.674138 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 21:01:09.674138 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: b4324d82370146318e0e74f9aa3de76d Oct 22 21:01:09.674138 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1425246118 Oct 22 21:01:09.674138 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 21:01:09.674138 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 21:01:09.674138 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_b4324d82370146318e0e74f9aa3de76d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b4324d82370146318e0e74f9aa3de76d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/b4324d82370146318e0e74f9aa3de76d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b4324d82370146318e0e74f9aa3de76d"}]}] Oct 22 21:01:09.674138 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1425246118 Oct 22 21:01:09.674138 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: b4324d82370146318e0e74f9aa3de76d Oct 22 21:01:09.674138 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1425246118 Oct 22 21:01:09.674138 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-MultipleCreateNegativeTestJSON-1425246118-project Oct 22 21:01:09.674138 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 21:01:09.674138 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 21:01:09.674138 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: 22df7b7377cc46849d69e890511fcd2d Oct 22 21:01:09.674138 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1425246118-project Oct 22 21:01:09.674138 ncdv-master-1 devstack@n-api.service[138745]: Oct 22 21:01:09.674138 ncdv-master-1 devstack@n-api.service[138745]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1816534690", "imageRef": "085e4478-6edc-4a69-8e08-f9831713eb65", "flavorRef": "452", "min_count": 3, "max_count": 2}} Oct 22 21:01:09.674138 ncdv-master-1 devstack@n-api.service[138745]: method: > Oct 22 21:01:09.674138 ncdv-master-1 devstack@n-api.service[138745]: exception: min_count must be <= max_count Oct 22 21:01:09.674138 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1816534690', 'imageRef': '085e4478-6edc-4a69-8e08-f9831713eb65', 'flavorRef': '452', 'min_count': 3, 'max_count': 2}}} Oct 22 21:01:09.674138 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:01:09.674138 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:01:09.674138 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:01:09.674138 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:01:09.674138 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:01:09.674138 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:01:09.674138 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:01:09.674138 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:01:09.674138 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 21:01:09.674138 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 21:01:09.674138 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 21:01:09.674138 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 21:01:09.674138 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 21:01:09.674138 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 21:01:09.674138 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 22 21:01:09.674138 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 726, in create Oct 22 21:01:09.674138 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 22 21:01:09.674138 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: min_count must be <= max_count Oct 22 21:01:09.674138 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:01:09.674138 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:01:09.674138 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:01:09.674138 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:01:09.674138 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:01:09.674138 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:01:09.674138 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:01:09.674138 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:01:09.674138 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: min_count must be <= max_count Oct 22 21:01:09.674138 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:01:09.680164 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-5507f586-758e-4d59-a9a4-674fad024bdc tempest-MultipleCreateNegativeTestJSON-1425246118 tempest-MultipleCreateNegativeTestJSON-1425246118-project] Returning 400 to user: min_count must be <= max_count {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:01:09.685349 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-5507f586-758e-4d59-a9a4-674fad024bdc tempest-MultipleCreateNegativeTestJSON-1425246118 tempest-MultipleCreateNegativeTestJSON-1425246118-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 400 len: 74 microversion: 2.1 time: 0.658823 Oct 22 21:01:09.686514 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1393/2656] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Oct 22 21:01:09 2022] POST /compute/v2.1/servers => generated 74 bytes in 663 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 22 21:01:09.706530 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-f145328c-7371-4dfb-918f-1e08a4f6a50f tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Calling method '.version_select at 0x7fd39fbfe280>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:01:09.812065 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-f145328c-7371-4dfb-918f-1e08a4f6a50f tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] 10.222.0.18 "GET /compute/v2.1/images/8368f750-e203-4ef8-b979-ba7ef86a0df0" status: 200 len: 1464 microversion: 2.1 time: 0.124290 Oct 22 21:01:09.813363 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1394/2657] 10.222.0.18 () {58 vars in 1233 bytes} [Sat Oct 22 21:01:09 2022] GET /compute/v2.1/images/8368f750-e203-4ef8-b979-ba7ef86a0df0 => generated 1464 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:01:09.835502 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-77f4fcef-3cd1-4c2c-8866-dd1fdef135dd tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Calling method '.version_select at 0x7fd39fd7b700>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:01:09.938320 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-77f4fcef-3cd1-4c2c-8866-dd1fdef135dd tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] 10.222.0.18 "GET /compute/v2.1/images/45d0a13c-b73b-4f91-b353-a22f0963a598" status: 200 len: 1413 microversion: 2.1 time: 0.122030 Oct 22 21:01:09.939326 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1395/2658] 10.222.0.18 () {58 vars in 1233 bytes} [Sat Oct 22 21:01:09 2022] GET /compute/v2.1/images/45d0a13c-b73b-4f91-b353-a22f0963a598 => generated 1413 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:01:09.957734 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-62630d51-643c-45ed-9862-4704afc7ca79 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:01:09.958043 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-62630d51-643c-45ed-9862-4704afc7ca79 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] [instance: 70f4c178-630e-4050-8aad-4c60bec30bcd] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:01:09.972889 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-62630d51-643c-45ed-9862-4704afc7ca79 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:01:09.986007 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-62630d51-643c-45ed-9862-4704afc7ca79 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:01:09.986665 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-62630d51-643c-45ed-9862-4704afc7ca79 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:01:09.995198 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-62630d51-643c-45ed-9862-4704afc7ca79 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:01:09.996054 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-62630d51-643c-45ed-9862-4704afc7ca79 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:01:09.996562 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-62630d51-643c-45ed-9862-4704afc7ca79 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:01:10.072860 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-6b3148be-363d-4ee6-bd28-63910f0726c9 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1b410a64e0415a96d30f5040361137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd7873d6db4e09bc9ab9a048a6b1ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:01:10.090146 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-6b3148be-363d-4ee6-bd28-63910f0726c9 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] 10.222.0.18 "GET /compute/v2.1/servers/a3ed180f-6c68-4c19-bdb7-602dd8ffaaf2" status: 200 len: 1315 microversion: 2.1 time: 1.208747 Oct 22 21:01:10.093505 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1264/2659] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:01:08 2022] GET /compute/v2.1/servers/a3ed180f-6c68-4c19-bdb7-602dd8ffaaf2 => generated 1315 bytes in 1215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:01:10.099969 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-fa111c59-2168-48a7-b785-1d50316db0f6 tempest-MultipleCreateNegativeTestJSON-1425246118 tempest-MultipleCreateNegativeTestJSON-1425246118-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-327337270", "imageRef": "085e4478-6edc-4a69-8e08-f9831713eb65", "flavorRef": "452", "max_count": 0}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:01:10.108239 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-fa111c59-2168-48a7-b785-1d50316db0f6 tempest-MultipleCreateNegativeTestJSON-1425246118 tempest-MultipleCreateNegativeTestJSON-1425246118-project] Request method failure captured: Oct 22 21:01:10.108239 ncdv-master-1 devstack@n-api.service[138744]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 22 21:01:10.108239 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 21:01:10.108239 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 21:01:10.108239 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 21:01:10.108239 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 167 Oct 22 21:01:10.108239 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 21:01:10.108239 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 21:01:10.108239 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 21:01:10.108239 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 21:01:10.108239 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVFoSJIFlIDKEKIBf_Vk9oXkksOA3CiM63m3dXoJwDAFmx0ahaQQOhYPlp9hFsAzCTIRXtbPPJN03I0z0mgQ8t7ZsPXg4_KMdILr34f8y3UxxGePzbmaOWIaIXi_-zfNgcEytuqXC-ed0jr5ZGulfawRtRC-v9siXF1GNlvphG-O92kM Oct 22 21:01:10.108239 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 21:01:10.108239 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 21:01:10.108239 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 21:01:10.108239 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 21:01:10.108239 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 21:01:10.108239 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 21:01:10.108239 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: b4324d82370146318e0e74f9aa3de76d Oct 22 21:01:10.108239 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1425246118 Oct 22 21:01:10.108239 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 21:01:10.108239 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 21:01:10.108239 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_b4324d82370146318e0e74f9aa3de76d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b4324d82370146318e0e74f9aa3de76d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/b4324d82370146318e0e74f9aa3de76d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b4324d82370146318e0e74f9aa3de76d"}]}] Oct 22 21:01:10.108239 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1425246118 Oct 22 21:01:10.108239 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: b4324d82370146318e0e74f9aa3de76d Oct 22 21:01:10.108239 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1425246118 Oct 22 21:01:10.108239 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-MultipleCreateNegativeTestJSON-1425246118-project Oct 22 21:01:10.108239 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 21:01:10.108239 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 21:01:10.108239 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: 22df7b7377cc46849d69e890511fcd2d Oct 22 21:01:10.108239 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1425246118-project Oct 22 21:01:10.108239 ncdv-master-1 devstack@n-api.service[138744]: Oct 22 21:01:10.108239 ncdv-master-1 devstack@n-api.service[138744]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-327337270", "imageRef": "085e4478-6edc-4a69-8e08-f9831713eb65", "flavorRef": "452", "max_count": 0}} Oct 22 21:01:10.108239 ncdv-master-1 devstack@n-api.service[138744]: method: > Oct 22 21:01:10.108239 ncdv-master-1 devstack@n-api.service[138744]: exception: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Oct 22 21:01:10.108239 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-327337270', 'imageRef': '085e4478-6edc-4a69-8e08-f9831713eb65', 'flavorRef': '452', 'max_count': 0}}} Oct 22 21:01:10.108239 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:01:10.108239 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:01:10.108239 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 22 21:01:10.108239 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 22 21:01:10.108239 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 22 21:01:10.108239 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise error Oct 22 21:01:10.108239 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 22 21:01:10.108239 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:01:10.108239 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['max_count']: Oct 22 21:01:10.108239 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 22 21:01:10.108239 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 22 21:01:10.108239 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 22 21:01:10.108239 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 22 21:01:10.108239 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:01:10.108239 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 22 21:01:10.108239 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi 0 Oct 22 21:01:10.108239 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:01:10.108239 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:01:10.108239 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:01:10.108239 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:01:10.108239 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:01:10.108239 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:01:10.108239 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:01:10.108239 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:01:10.108239 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:01:10.108239 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:01:10.108239 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 21:01:10.108239 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 21:01:10.108239 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 22 21:01:10.108239 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 22 21:01:10.113013 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 22 21:01:10.113013 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 22 21:01:10.113013 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 22 21:01:10.113013 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 22 21:01:10.113013 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Oct 22 21:01:10.113013 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:01:10.113013 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:01:10.113013 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:01:10.113013 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:01:10.113013 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:01:10.113013 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:01:10.113013 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 22 21:01:10.113013 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 22 21:01:10.113013 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Oct 22 21:01:10.113013 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:01:10.120201 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-fa111c59-2168-48a7-b785-1d50316db0f6 tempest-MultipleCreateNegativeTestJSON-1425246118 tempest-MultipleCreateNegativeTestJSON-1425246118-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:01:10.123038 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-fa111c59-2168-48a7-b785-1d50316db0f6 tempest-MultipleCreateNegativeTestJSON-1425246118 tempest-MultipleCreateNegativeTestJSON-1425246118-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.028207 Oct 22 21:01:10.128098 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1265/2660] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Oct 22 21:01:10 2022] POST /compute/v2.1/servers => generated 130 bytes in 34 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 22 21:01:10.191764 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-42d403b9-855d-4e20-981f-378e33359588 tempest-MultipleCreateNegativeTestJSON-1425246118 tempest-MultipleCreateNegativeTestJSON-1425246118-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-662203589", "imageRef": "085e4478-6edc-4a69-8e08-f9831713eb65", "flavorRef": "452", "max_count": 2.5}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:01:10.195943 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-42d403b9-855d-4e20-981f-378e33359588 tempest-MultipleCreateNegativeTestJSON-1425246118 tempest-MultipleCreateNegativeTestJSON-1425246118-project] Request method failure captured: Oct 22 21:01:10.195943 ncdv-master-1 devstack@n-api.service[138744]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 22 21:01:10.195943 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 21:01:10.195943 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 21:01:10.195943 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 21:01:10.195943 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 169 Oct 22 21:01:10.195943 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 21:01:10.195943 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 21:01:10.195943 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 21:01:10.195943 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 21:01:10.195943 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVFoSJIFlIDKEKIBf_Vk9oXkksOA3CiM63m3dXoJwDAFmx0ahaQQOhYPlp9hFsAzCTIRXtbPPJN03I0z0mgQ8t7ZsPXg4_KMdILr34f8y3UxxGePzbmaOWIaIXi_-zfNgcEytuqXC-ed0jr5ZGulfawRtRC-v9siXF1GNlvphG-O92kM Oct 22 21:01:10.195943 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 21:01:10.195943 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 21:01:10.195943 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 21:01:10.195943 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 21:01:10.195943 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 21:01:10.195943 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 21:01:10.195943 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: b4324d82370146318e0e74f9aa3de76d Oct 22 21:01:10.195943 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1425246118 Oct 22 21:01:10.195943 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 21:01:10.195943 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 21:01:10.195943 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_b4324d82370146318e0e74f9aa3de76d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b4324d82370146318e0e74f9aa3de76d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/b4324d82370146318e0e74f9aa3de76d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b4324d82370146318e0e74f9aa3de76d"}]}] Oct 22 21:01:10.195943 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1425246118 Oct 22 21:01:10.195943 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: b4324d82370146318e0e74f9aa3de76d Oct 22 21:01:10.195943 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1425246118 Oct 22 21:01:10.195943 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-MultipleCreateNegativeTestJSON-1425246118-project Oct 22 21:01:10.195943 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 21:01:10.195943 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 21:01:10.195943 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: 22df7b7377cc46849d69e890511fcd2d Oct 22 21:01:10.195943 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1425246118-project Oct 22 21:01:10.195943 ncdv-master-1 devstack@n-api.service[138744]: Oct 22 21:01:10.195943 ncdv-master-1 devstack@n-api.service[138744]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-662203589", "imageRef": "085e4478-6edc-4a69-8e08-f9831713eb65", "flavorRef": "452", "max_count": 2.5}} Oct 22 21:01:10.195943 ncdv-master-1 devstack@n-api.service[138744]: method: > Oct 22 21:01:10.195943 ncdv-master-1 devstack@n-api.service[138744]: exception: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 22 21:01:10.195943 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-662203589', 'imageRef': '085e4478-6edc-4a69-8e08-f9831713eb65', 'flavorRef': '452', 'max_count': 2.5}}} Oct 22 21:01:10.195943 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:01:10.195943 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:01:10.195943 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 22 21:01:10.195943 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 22 21:01:10.195943 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 22 21:01:10.195943 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise error Oct 22 21:01:10.195943 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Oct 22 21:01:10.195943 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:01:10.195943 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['max_count']: Oct 22 21:01:10.195943 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 22 21:01:10.195943 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 22 21:01:10.195943 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 22 21:01:10.195943 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 22 21:01:10.195943 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:01:10.195943 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 22 21:01:10.195943 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi 2.5 Oct 22 21:01:10.195943 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:01:10.195943 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:01:10.195943 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:01:10.195943 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:01:10.195943 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:01:10.195943 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:01:10.195943 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:01:10.195943 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:01:10.195943 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:01:10.195943 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:01:10.195943 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 21:01:10.195943 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 21:01:10.195943 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 22 21:01:10.195943 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 22 21:01:10.213246 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 22 21:01:10.213246 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 22 21:01:10.213246 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 22 21:01:10.213246 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 22 21:01:10.213246 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 22 21:01:10.213246 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:01:10.213246 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:01:10.213246 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:01:10.213246 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:01:10.213246 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:01:10.213246 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:01:10.213246 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 22 21:01:10.213246 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 22 21:01:10.213246 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 22 21:01:10.213246 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:01:10.213246 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-42d403b9-855d-4e20-981f-378e33359588 tempest-MultipleCreateNegativeTestJSON-1425246118 tempest-MultipleCreateNegativeTestJSON-1425246118-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:01:10.213246 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-42d403b9-855d-4e20-981f-378e33359588 tempest-MultipleCreateNegativeTestJSON-1425246118 tempest-MultipleCreateNegativeTestJSON-1425246118-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.011067 Oct 22 21:01:10.213246 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1266/2661] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Oct 22 21:01:10 2022] POST /compute/v2.1/servers => generated 139 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 22 21:01:10.288145 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-a32305f4-b9bf-40ce-a7c9-49531bbe7789 tempest-MultipleCreateNegativeTestJSON-1425246118 tempest-MultipleCreateNegativeTestJSON-1425246118-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-759413569", "imageRef": "085e4478-6edc-4a69-8e08-f9831713eb65", "flavorRef": "452", "min_count": 0}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:01:10.297275 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-a32305f4-b9bf-40ce-a7c9-49531bbe7789 tempest-MultipleCreateNegativeTestJSON-1425246118 tempest-MultipleCreateNegativeTestJSON-1425246118-project] Request method failure captured: Oct 22 21:01:10.297275 ncdv-master-1 devstack@n-api.service[138744]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 22 21:01:10.297275 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 21:01:10.297275 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 21:01:10.297275 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 21:01:10.297275 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 167 Oct 22 21:01:10.297275 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 21:01:10.297275 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 21:01:10.297275 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 21:01:10.297275 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 21:01:10.297275 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVFoSJIFlIDKEKIBf_Vk9oXkksOA3CiM63m3dXoJwDAFmx0ahaQQOhYPlp9hFsAzCTIRXtbPPJN03I0z0mgQ8t7ZsPXg4_KMdILr34f8y3UxxGePzbmaOWIaIXi_-zfNgcEytuqXC-ed0jr5ZGulfawRtRC-v9siXF1GNlvphG-O92kM Oct 22 21:01:10.297275 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 21:01:10.297275 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 21:01:10.297275 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 21:01:10.297275 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 21:01:10.297275 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 21:01:10.297275 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 21:01:10.297275 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: b4324d82370146318e0e74f9aa3de76d Oct 22 21:01:10.297275 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1425246118 Oct 22 21:01:10.297275 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 21:01:10.297275 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 21:01:10.297275 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_b4324d82370146318e0e74f9aa3de76d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b4324d82370146318e0e74f9aa3de76d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/b4324d82370146318e0e74f9aa3de76d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b4324d82370146318e0e74f9aa3de76d"}]}] Oct 22 21:01:10.297275 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1425246118 Oct 22 21:01:10.297275 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: b4324d82370146318e0e74f9aa3de76d Oct 22 21:01:10.297275 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1425246118 Oct 22 21:01:10.297275 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-MultipleCreateNegativeTestJSON-1425246118-project Oct 22 21:01:10.297275 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 21:01:10.297275 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 21:01:10.297275 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: 22df7b7377cc46849d69e890511fcd2d Oct 22 21:01:10.297275 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1425246118-project Oct 22 21:01:10.297275 ncdv-master-1 devstack@n-api.service[138744]: Oct 22 21:01:10.297275 ncdv-master-1 devstack@n-api.service[138744]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-759413569", "imageRef": "085e4478-6edc-4a69-8e08-f9831713eb65", "flavorRef": "452", "min_count": 0}} Oct 22 21:01:10.297275 ncdv-master-1 devstack@n-api.service[138744]: method: > Oct 22 21:01:10.297275 ncdv-master-1 devstack@n-api.service[138744]: exception: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Oct 22 21:01:10.297275 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-759413569', 'imageRef': '085e4478-6edc-4a69-8e08-f9831713eb65', 'flavorRef': '452', 'min_count': 0}}} Oct 22 21:01:10.297275 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:01:10.297275 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:01:10.297275 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 22 21:01:10.297275 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 22 21:01:10.297275 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 22 21:01:10.297275 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise error Oct 22 21:01:10.297275 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 22 21:01:10.297275 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:01:10.297275 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['min_count']: Oct 22 21:01:10.297275 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 22 21:01:10.297275 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 22 21:01:10.297275 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 22 21:01:10.297275 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 22 21:01:10.297275 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:01:10.297275 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 22 21:01:10.297275 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi 0 Oct 22 21:01:10.297275 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:01:10.297275 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:01:10.297275 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:01:10.297275 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:01:10.297275 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:01:10.297275 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:01:10.297275 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:01:10.297275 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:01:10.297275 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:01:10.297275 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:01:10.297275 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 21:01:10.297275 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 21:01:10.297275 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 22 21:01:10.297275 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 22 21:01:10.315407 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 22 21:01:10.315407 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 22 21:01:10.315407 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 22 21:01:10.315407 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 22 21:01:10.315407 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Oct 22 21:01:10.315407 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:01:10.315407 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:01:10.315407 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:01:10.315407 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:01:10.315407 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:01:10.315407 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:01:10.315407 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 22 21:01:10.315407 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 22 21:01:10.315407 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Oct 22 21:01:10.315407 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:01:10.315407 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-a32305f4-b9bf-40ce-a7c9-49531bbe7789 tempest-MultipleCreateNegativeTestJSON-1425246118 tempest-MultipleCreateNegativeTestJSON-1425246118-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:01:10.315407 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-a32305f4-b9bf-40ce-a7c9-49531bbe7789 tempest-MultipleCreateNegativeTestJSON-1425246118 tempest-MultipleCreateNegativeTestJSON-1425246118-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.017465 Oct 22 21:01:10.315407 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1267/2662] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Oct 22 21:01:10 2022] POST /compute/v2.1/servers => generated 130 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 22 21:01:10.402569 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-9f8f6bb6-e090-47f1-890e-613b819d7f53 tempest-MultipleCreateNegativeTestJSON-1425246118 tempest-MultipleCreateNegativeTestJSON-1425246118-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-2021045528", "imageRef": "085e4478-6edc-4a69-8e08-f9831713eb65", "flavorRef": "452", "min_count": 2.5}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:01:10.408158 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-9f8f6bb6-e090-47f1-890e-613b819d7f53 tempest-MultipleCreateNegativeTestJSON-1425246118 tempest-MultipleCreateNegativeTestJSON-1425246118-project] Request method failure captured: Oct 22 21:01:10.408158 ncdv-master-1 devstack@n-api.service[138744]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 22 21:01:10.408158 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 21:01:10.408158 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 21:01:10.408158 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 21:01:10.408158 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 170 Oct 22 21:01:10.408158 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 21:01:10.408158 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 21:01:10.408158 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 21:01:10.408158 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 21:01:10.408158 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVFoSJIFlIDKEKIBf_Vk9oXkksOA3CiM63m3dXoJwDAFmx0ahaQQOhYPlp9hFsAzCTIRXtbPPJN03I0z0mgQ8t7ZsPXg4_KMdILr34f8y3UxxGePzbmaOWIaIXi_-zfNgcEytuqXC-ed0jr5ZGulfawRtRC-v9siXF1GNlvphG-O92kM Oct 22 21:01:10.408158 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 21:01:10.408158 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 21:01:10.408158 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 21:01:10.408158 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 21:01:10.408158 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 21:01:10.408158 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 21:01:10.408158 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: b4324d82370146318e0e74f9aa3de76d Oct 22 21:01:10.408158 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1425246118 Oct 22 21:01:10.408158 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 21:01:10.408158 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 21:01:10.408158 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_b4324d82370146318e0e74f9aa3de76d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b4324d82370146318e0e74f9aa3de76d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/b4324d82370146318e0e74f9aa3de76d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b4324d82370146318e0e74f9aa3de76d"}]}] Oct 22 21:01:10.408158 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1425246118 Oct 22 21:01:10.408158 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: b4324d82370146318e0e74f9aa3de76d Oct 22 21:01:10.408158 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1425246118 Oct 22 21:01:10.408158 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-MultipleCreateNegativeTestJSON-1425246118-project Oct 22 21:01:10.408158 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 21:01:10.408158 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 21:01:10.408158 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: 22df7b7377cc46849d69e890511fcd2d Oct 22 21:01:10.408158 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1425246118-project Oct 22 21:01:10.408158 ncdv-master-1 devstack@n-api.service[138744]: Oct 22 21:01:10.408158 ncdv-master-1 devstack@n-api.service[138744]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-2021045528", "imageRef": "085e4478-6edc-4a69-8e08-f9831713eb65", "flavorRef": "452", "min_count": 2.5}} Oct 22 21:01:10.408158 ncdv-master-1 devstack@n-api.service[138744]: method: > Oct 22 21:01:10.408158 ncdv-master-1 devstack@n-api.service[138744]: exception: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 22 21:01:10.408158 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-2021045528', 'imageRef': '085e4478-6edc-4a69-8e08-f9831713eb65', 'flavorRef': '452', 'min_count': 2.5}}} Oct 22 21:01:10.408158 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:01:10.408158 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:01:10.408158 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 22 21:01:10.408158 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 22 21:01:10.408158 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 22 21:01:10.408158 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise error Oct 22 21:01:10.408158 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Oct 22 21:01:10.408158 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:01:10.408158 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['min_count']: Oct 22 21:01:10.408158 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 22 21:01:10.408158 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 22 21:01:10.408158 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 22 21:01:10.408158 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 22 21:01:10.408158 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:01:10.408158 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 22 21:01:10.408158 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi 2.5 Oct 22 21:01:10.408158 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:01:10.408158 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:01:10.408158 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:01:10.408158 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:01:10.408158 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:01:10.408158 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:01:10.408158 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:01:10.408158 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:01:10.408158 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:01:10.408158 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:01:10.408158 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 21:01:10.408158 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 21:01:10.408158 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 22 21:01:10.408158 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 22 21:01:10.413484 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 22 21:01:10.413484 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 22 21:01:10.413484 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 22 21:01:10.413484 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 22 21:01:10.413484 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 22 21:01:10.413484 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:01:10.413484 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:01:10.413484 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:01:10.413484 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:01:10.413484 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:01:10.413484 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:01:10.413484 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 22 21:01:10.413484 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 22 21:01:10.413484 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 22 21:01:10.413484 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:01:10.416482 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-9f8f6bb6-e090-47f1-890e-613b819d7f53 tempest-MultipleCreateNegativeTestJSON-1425246118 tempest-MultipleCreateNegativeTestJSON-1425246118-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:01:10.418553 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-9f8f6bb6-e090-47f1-890e-613b819d7f53 tempest-MultipleCreateNegativeTestJSON-1425246118 tempest-MultipleCreateNegativeTestJSON-1425246118-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.021342 Oct 22 21:01:10.423132 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1268/2663] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Oct 22 21:01:10 2022] POST /compute/v2.1/servers => generated 139 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 22 21:01:10.665538 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-62630d51-643c-45ed-9862-4704afc7ca79 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b9bfe6f6d564d4c9fb1fea439476e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6e01f91c3a845bf8e67e3ad415d9c69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:01:10.684199 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-62630d51-643c-45ed-9862-4704afc7ca79 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] 10.222.0.18 "GET /compute/v2.1/servers/70f4c178-630e-4050-8aad-4c60bec30bcd" status: 200 len: 1468 microversion: 2.1 time: 0.742605 Oct 22 21:01:10.708977 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1396/2664] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:01:09 2022] GET /compute/v2.1/servers/70f4c178-630e-4050-8aad-4c60bec30bcd => generated 1468 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:01:10.711495 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-20f43658-1d62-4c1e-959e-11e59c9d592e tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-203479742"}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:01:10.716221 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-20f43658-1d62-4c1e-959e-11e59c9d592e tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] [instance: ee6c092d-1150-415f-8a2e-58f4d3b5c238] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:01:10.723677 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-20f43658-1d62-4c1e-959e-11e59c9d592e tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:01:10.724732 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-20f43658-1d62-4c1e-959e-11e59c9d592e tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:01:10.725460 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-20f43658-1d62-4c1e-959e-11e59c9d592e tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:01:10.726788 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-20f43658-1d62-4c1e-959e-11e59c9d592e tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:01:10.728269 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-20f43658-1d62-4c1e-959e-11e59c9d592e tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:01:10.729384 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-20f43658-1d62-4c1e-959e-11e59c9d592e tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:01:10.956136 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-ab9fea22-014c-42ea-9619-04f31962071c tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Calling method '.version_select at 0x7fd39fc941f0>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:01:11.321173 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-ab9fea22-014c-42ea-9619-04f31962071c tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] 10.222.0.18 "GET /compute/v2.1/images/45d0a13c-b73b-4f91-b353-a22f0963a598" status: 200 len: 1413 microversion: 2.1 time: 0.370232 Oct 22 21:01:11.330325 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1397/2665] 10.222.0.18 () {58 vars in 1233 bytes} [Sat Oct 22 21:01:10 2022] GET /compute/v2.1/images/45d0a13c-b73b-4f91-b353-a22f0963a598 => generated 1413 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:01:11.340545 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-f64d48e0-ad9e-41ce-aca6-241a01203e30 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:01:11.344889 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-f64d48e0-ad9e-41ce-aca6-241a01203e30 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] [instance: a3ed180f-6c68-4c19-bdb7-602dd8ffaaf2] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:01:11.385180 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-20f43658-1d62-4c1e-959e-11e59c9d592e tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] 10.222.0.18 "POST /compute/v2.1/servers/ee6c092d-1150-415f-8a2e-58f4d3b5c238/action" status: 202 len: 0 microversion: 2.1 time: 0.677477 Oct 22 21:01:11.390621 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f64d48e0-ad9e-41ce-aca6-241a01203e30 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:01:11.393948 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f64d48e0-ad9e-41ce-aca6-241a01203e30 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:01:11.394693 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f64d48e0-ad9e-41ce-aca6-241a01203e30 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:01:11.395937 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1269/2666] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 21:01:10 2022] POST /compute/v2.1/servers/ee6c092d-1150-415f-8a2e-58f4d3b5c238/action => generated 0 bytes in 690 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Oct 22 21:01:11.401139 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f64d48e0-ad9e-41ce-aca6-241a01203e30 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:01:11.402794 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f64d48e0-ad9e-41ce-aca6-241a01203e30 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:01:11.405211 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f64d48e0-ad9e-41ce-aca6-241a01203e30 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:01:11.415383 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-8b267345-6427-4b3f-aca8-ee11d29f6770 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Calling method '.version_select at 0x7fd39f148160>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:01:11.511170 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-8b267345-6427-4b3f-aca8-ee11d29f6770 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] 10.222.0.18 "GET /compute/v2.1/images/e8a48405-7084-4515-a1fe-96c425df5e47" status: 200 len: 1454 microversion: 2.1 time: 0.112025 Oct 22 21:01:11.523161 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1270/2667] 10.222.0.18 () {58 vars in 1233 bytes} [Sat Oct 22 21:01:11 2022] GET /compute/v2.1/images/e8a48405-7084-4515-a1fe-96c425df5e47 => generated 1454 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:01:11.940377 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-f64d48e0-ad9e-41ce-aca6-241a01203e30 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1b410a64e0415a96d30f5040361137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd7873d6db4e09bc9ab9a048a6b1ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:01:11.957193 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-f64d48e0-ad9e-41ce-aca6-241a01203e30 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] 10.222.0.18 "GET /compute/v2.1/servers/a3ed180f-6c68-4c19-bdb7-602dd8ffaaf2" status: 200 len: 1502 microversion: 2.1 time: 0.633536 Oct 22 21:01:11.957869 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1398/2668] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:01:11 2022] GET /compute/v2.1/servers/a3ed180f-6c68-4c19-bdb7-602dd8ffaaf2 => generated 1502 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:01:12.341723 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-1235c54b-f86b-41df-838e-ea91cf285486 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Calling method '.version_select at 0x7fd39f13dee0>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:01:12.447538 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-1235c54b-f86b-41df-838e-ea91cf285486 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] 10.222.0.18 "GET /compute/v2.1/images/45d0a13c-b73b-4f91-b353-a22f0963a598" status: 200 len: 1413 microversion: 2.1 time: 0.112669 Oct 22 21:01:12.470340 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1271/2669] 10.222.0.18 () {58 vars in 1233 bytes} [Sat Oct 22 21:01:12 2022] GET /compute/v2.1/images/45d0a13c-b73b-4f91-b353-a22f0963a598 => generated 1413 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:01:12.528753 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-e7785d73-e3a9-4a18-ad3d-cb487eb74da7 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Calling method '.version_select at 0x7fd39f05da60>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:01:12.617735 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-e7785d73-e3a9-4a18-ad3d-cb487eb74da7 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] 10.222.0.18 "GET /compute/v2.1/images/e8a48405-7084-4515-a1fe-96c425df5e47" status: 200 len: 1454 microversion: 2.1 time: 0.092805 Oct 22 21:01:12.619588 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1399/2670] 10.222.0.18 () {58 vars in 1233 bytes} [Sat Oct 22 21:01:12 2022] GET /compute/v2.1/images/e8a48405-7084-4515-a1fe-96c425df5e47 => generated 1454 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:01:13.468992 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-b28d75f5-a396-40c5-bc6d-c52dd9d9edf4 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Calling method '.version_select at 0x7fd39f148dc0>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:01:13.551211 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-b28d75f5-a396-40c5-bc6d-c52dd9d9edf4 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] 10.222.0.18 "GET /compute/v2.1/images/45d0a13c-b73b-4f91-b353-a22f0963a598" status: 200 len: 1413 microversion: 2.1 time: 0.088191 Oct 22 21:01:13.565578 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1272/2671] 10.222.0.18 () {58 vars in 1233 bytes} [Sat Oct 22 21:01:13 2022] GET /compute/v2.1/images/45d0a13c-b73b-4f91-b353-a22f0963a598 => generated 1413 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:01:13.635941 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-5837fa5b-6ed1-4c22-bc3b-e614d1aaa324 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Calling method '.version_select at 0x7fd39f06f700>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:01:13.728986 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-5837fa5b-6ed1-4c22-bc3b-e614d1aaa324 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] 10.222.0.18 "GET /compute/v2.1/images/e8a48405-7084-4515-a1fe-96c425df5e47" status: 200 len: 1454 microversion: 2.1 time: 0.096989 Oct 22 21:01:13.738027 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1400/2672] 10.222.0.18 () {58 vars in 1233 bytes} [Sat Oct 22 21:01:13 2022] GET /compute/v2.1/images/e8a48405-7084-4515-a1fe-96c425df5e47 => generated 1454 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:01:13.820578 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-a2cc0de8-5a04-4872-9d88-57eae01ac169 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5d2013d8-0420-4b76-9785-fd5fa05ccf6e"}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:01:13.823214 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-a2cc0de8-5a04-4872-9d88-57eae01ac169 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] [instance: a3ed180f-6c68-4c19-bdb7-602dd8ffaaf2] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:01:13.859586 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a2cc0de8-5a04-4872-9d88-57eae01ac169 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:01:13.860162 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a2cc0de8-5a04-4872-9d88-57eae01ac169 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:01:13.860612 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a2cc0de8-5a04-4872-9d88-57eae01ac169 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:01:13.861373 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a2cc0de8-5a04-4872-9d88-57eae01ac169 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:01:13.861838 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a2cc0de8-5a04-4872-9d88-57eae01ac169 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:01:13.862264 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a2cc0de8-5a04-4872-9d88-57eae01ac169 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:01:14.427670 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-a2cc0de8-5a04-4872-9d88-57eae01ac169 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] 10.222.0.18 "POST /compute/v2.1/servers/a3ed180f-6c68-4c19-bdb7-602dd8ffaaf2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.611103 Oct 22 21:01:14.447382 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1273/2673] 10.222.0.18 () {60 vars in 1323 bytes} [Sat Oct 22 21:01:13 2022] POST /compute/v2.1/servers/a3ed180f-6c68-4c19-bdb7-602dd8ffaaf2/os-volume_attachments => generated 194 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:01:14.572934 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-dd037853-85d4-499b-b647-885104051474 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Calling method '.version_select at 0x7fd3a4230310>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:01:14.671620 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-dd037853-85d4-499b-b647-885104051474 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] 10.222.0.18 "GET /compute/v2.1/images/45d0a13c-b73b-4f91-b353-a22f0963a598" status: 200 len: 1413 microversion: 2.1 time: 0.102791 Oct 22 21:01:14.673244 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1401/2674] 10.222.0.18 () {58 vars in 1233 bytes} [Sat Oct 22 21:01:14 2022] GET /compute/v2.1/images/45d0a13c-b73b-4f91-b353-a22f0963a598 => generated 1413 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:01:14.750862 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-5d0702aa-441a-4959-9661-ad9f1c79178b tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Calling method '.version_select at 0x7fd39f2bb0d0>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:01:14.871682 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-5d0702aa-441a-4959-9661-ad9f1c79178b tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] 10.222.0.18 "GET /compute/v2.1/images/e8a48405-7084-4515-a1fe-96c425df5e47" status: 200 len: 1454 microversion: 2.1 time: 0.127359 Oct 22 21:01:14.885558 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1274/2675] 10.222.0.18 () {58 vars in 1233 bytes} [Sat Oct 22 21:01:14 2022] GET /compute/v2.1/images/e8a48405-7084-4515-a1fe-96c425df5e47 => generated 1454 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:01:15.286380 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-a3b6a31c-a1ca-48f6-ba05-582c9085baaf req-ab7723e3-8c5f-430f-a425-00be5fcffb3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70f4c178-630e-4050-8aad-4c60bec30bcd", "name": "network-vif-unplugged", "status": "completed", "tag": "034bfe35-5a4c-4024-b8ad-3fc77f012374"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:01:15.312143 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-a3b6a31c-a1ca-48f6-ba05-582c9085baaf req-ab7723e3-8c5f-430f-a425-00be5fcffb3a service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:01:15.316004 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-a3b6a31c-a1ca-48f6-ba05-582c9085baaf req-ab7723e3-8c5f-430f-a425-00be5fcffb3a service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:01:15.316794 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-a3b6a31c-a1ca-48f6-ba05-582c9085baaf req-ab7723e3-8c5f-430f-a425-00be5fcffb3a service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:01:15.347044 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-a3b6a31c-a1ca-48f6-ba05-582c9085baaf req-ab7723e3-8c5f-430f-a425-00be5fcffb3a service nova] Creating event network-vif-unplugged:034bfe35-5a4c-4024-b8ad-3fc77f012374 for instance 70f4c178-630e-4050-8aad-4c60bec30bcd on nch1-master-1 Oct 22 21:01:15.361924 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-a3b6a31c-a1ca-48f6-ba05-582c9085baaf req-ab7723e3-8c5f-430f-a425-00be5fcffb3a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.079353 Oct 22 21:01:15.367082 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1402/2676] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:01:15 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:01:15.690300 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-0c83f484-4098-4a4c-b75c-1f3b0ad1783c tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Calling method '.version_select at 0x7fd39f331d30>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:01:15.867861 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-0c83f484-4098-4a4c-b75c-1f3b0ad1783c tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] 10.222.0.18 "GET /compute/v2.1/images/45d0a13c-b73b-4f91-b353-a22f0963a598" status: 200 len: 1413 microversion: 2.1 time: 0.180032 Oct 22 21:01:15.869457 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1275/2677] 10.222.0.18 () {58 vars in 1233 bytes} [Sat Oct 22 21:01:15 2022] GET /compute/v2.1/images/45d0a13c-b73b-4f91-b353-a22f0963a598 => generated 1413 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:01:15.892007 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-ec091db1-fe1a-4ac5-85f1-38de8e5c7e9c tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Calling method '.version_select at 0x7fd39f06f790>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:01:16.168345 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-ec091db1-fe1a-4ac5-85f1-38de8e5c7e9c tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] 10.222.0.18 "GET /compute/v2.1/images/e8a48405-7084-4515-a1fe-96c425df5e47" status: 200 len: 1454 microversion: 2.1 time: 0.281348 Oct 22 21:01:16.170899 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1403/2678] 10.222.0.18 () {58 vars in 1233 bytes} [Sat Oct 22 21:01:15 2022] GET /compute/v2.1/images/e8a48405-7084-4515-a1fe-96c425df5e47 => generated 1454 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:01:16.916596 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-500c224f-07a0-4bb9-af85-07d2fd2cad1b tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Calling method '.version_select at 0x7fd39f1ea160>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:01:17.185879 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-fdd36153-dd54-412e-837c-ce6821380b75 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Calling method '.version_select at 0x7fd39f06f5e0>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:01:19.551492 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-500c224f-07a0-4bb9-af85-07d2fd2cad1b tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] 10.222.0.18 "GET /compute/v2.1/images/45d0a13c-b73b-4f91-b353-a22f0963a598" status: 200 len: 1422 microversion: 2.1 time: 2.646833 Oct 22 21:01:19.561440 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1276/2679] 10.222.0.18 () {58 vars in 1233 bytes} [Sat Oct 22 21:01:16 2022] GET /compute/v2.1/images/45d0a13c-b73b-4f91-b353-a22f0963a598 => generated 1422 bytes in 2648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:01:19.580232 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-fdd36153-dd54-412e-837c-ce6821380b75 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] 10.222.0.18 "GET /compute/v2.1/images/e8a48405-7084-4515-a1fe-96c425df5e47" status: 200 len: 1454 microversion: 2.1 time: 2.398069 Oct 22 21:01:19.582059 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1404/2680] 10.222.0.18 () {58 vars in 1233 bytes} [Sat Oct 22 21:01:17 2022] GET /compute/v2.1/images/e8a48405-7084-4515-a1fe-96c425df5e47 => generated 1454 bytes in 2402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:01:19.607012 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-f7230630-ce3b-4543-ac75-304de1d01111 req-c22ca638-f2cf-47e7-b6d7-5e25e24f2ddb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee6c092d-1150-415f-8a2e-58f4d3b5c238", "name": "network-vif-plugged", "status": "completed", "tag": "ab582bca-d4c2-4df2-a2fb-cfb59dff7776"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:01:19.628092 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-f7230630-ce3b-4543-ac75-304de1d01111 req-c22ca638-f2cf-47e7-b6d7-5e25e24f2ddb service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:01:19.628761 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-f7230630-ce3b-4543-ac75-304de1d01111 req-c22ca638-f2cf-47e7-b6d7-5e25e24f2ddb service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:01:19.635124 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-f7230630-ce3b-4543-ac75-304de1d01111 req-c22ca638-f2cf-47e7-b6d7-5e25e24f2ddb service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:01:19.679733 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-f7230630-ce3b-4543-ac75-304de1d01111 req-c22ca638-f2cf-47e7-b6d7-5e25e24f2ddb service nova] Creating event network-vif-plugged:ab582bca-d4c2-4df2-a2fb-cfb59dff7776 for instance ee6c092d-1150-415f-8a2e-58f4d3b5c238 on nch2-master-1 Oct 22 21:01:19.695675 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-f7230630-ce3b-4543-ac75-304de1d01111 req-c22ca638-f2cf-47e7-b6d7-5e25e24f2ddb service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098178 Oct 22 21:01:19.698999 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1405/2681] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:01:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:01:19.713403 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-2479f51b-3cd6-4342-a21e-8d28d1f7282e tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Calling method '.version_select at 0x7fd39fb9b820>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:01:19.816393 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-ec92f0ed-52a3-493b-b741-15e13b082aa5 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-UnshelveToHostMultiNodesTest-server-1148636766", "imageRef": "085e4478-6edc-4a69-8e08-f9831713eb65", "flavorRef": "452", "networks": "none"}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:01:19.848232 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-2479f51b-3cd6-4342-a21e-8d28d1f7282e tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] 10.222.0.18 "GET /compute/v2.1/images/45d0a13c-b73b-4f91-b353-a22f0963a598" status: 200 len: 1422 microversion: 2.1 time: 0.146100 Oct 22 21:01:19.849088 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1406/2682] 10.222.0.18 () {58 vars in 1233 bytes} [Sat Oct 22 21:01:19 2022] GET /compute/v2.1/images/45d0a13c-b73b-4f91-b353-a22f0963a598 => generated 1422 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:01:19.866903 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-4fe24263-4e86-4245-bd30-65ed367b14b4 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Calling method '.version_select at 0x7fd39fc28550>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:01:20.883979 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-4fe24263-4e86-4245-bd30-65ed367b14b4 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] 10.222.0.18 "DELETE /compute/v2.1/images/45d0a13c-b73b-4f91-b353-a22f0963a598" status: 204 len: 0 microversion: 2.1 time: 1.023016 Oct 22 21:01:20.890101 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1407/2683] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:01:19 2022] DELETE /compute/v2.1/images/45d0a13c-b73b-4f91-b353-a22f0963a598 => generated 0 bytes in 1025 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 21:01:20.900814 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-129c3579-8ca9-422c-9ed6-b24be026d947 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:01:20.901906 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-129c3579-8ca9-422c-9ed6-b24be026d947 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] [instance: a3ed180f-6c68-4c19-bdb7-602dd8ffaaf2] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:01:20.914725 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-129c3579-8ca9-422c-9ed6-b24be026d947 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:01:20.915607 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-129c3579-8ca9-422c-9ed6-b24be026d947 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:01:20.916405 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-129c3579-8ca9-422c-9ed6-b24be026d947 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:01:20.919889 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-129c3579-8ca9-422c-9ed6-b24be026d947 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:01:20.921496 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-129c3579-8ca9-422c-9ed6-b24be026d947 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:01:20.922164 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-129c3579-8ca9-422c-9ed6-b24be026d947 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:01:20.977329 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-129c3579-8ca9-422c-9ed6-b24be026d947 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] [instance: a3ed180f-6c68-4c19-bdb7-602dd8ffaaf2] Going to try to terminate instance {{(pid=138745) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 21:01:20.992582 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-ec92f0ed-52a3-493b-b741-15e13b082aa5 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Flavor limits 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 21:01:20.993229 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-ec92f0ed-52a3-493b-b741-15e13b082aa5 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Image limits 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 21:01:20.994131 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-ec92f0ed-52a3-493b-b741-15e13b082aa5 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Flavor pref 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 21:01:20.994666 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-ec92f0ed-52a3-493b-b741-15e13b082aa5 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Image pref 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 21:01:20.995392 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-ec92f0ed-52a3-493b-b741-15e13b082aa5 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 21:01:21.026793 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ec92f0ed-52a3-493b-b741-15e13b082aa5 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:01:21.035316 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ec92f0ed-52a3-493b-b741-15e13b082aa5 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:01:21.036169 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ec92f0ed-52a3-493b-b741-15e13b082aa5 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:01:21.037213 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ec92f0ed-52a3-493b-b741-15e13b082aa5 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:01:21.039979 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ec92f0ed-52a3-493b-b741-15e13b082aa5 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:01:21.046195 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ec92f0ed-52a3-493b-b741-15e13b082aa5 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:01:21.093416 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-ec92f0ed-52a3-493b-b741-15e13b082aa5 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Getting quotas for project a24fe30b11dc4daf8dcbaaa72eedc48b. Resources: {'cores', 'instances', 'ram'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 21:01:21.111945 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-ec92f0ed-52a3-493b-b741-15e13b082aa5 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Getting quotas for user 2246e084910f408db12c0139a2cecc50 and project a24fe30b11dc4daf8dcbaaa72eedc48b. Resources: {'cores', 'instances', 'ram'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 21:01:21.142146 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-ec92f0ed-52a3-493b-b741-15e13b082aa5 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Going to run 1 instances... {{(pid=138744) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 21:01:21.149910 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-ec92f0ed-52a3-493b-b741-15e13b082aa5 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] [instance: 2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='085e4478-6edc-4a69-8e08-f9831713eb65',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138744) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 21:01:21.192338 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-129c3579-8ca9-422c-9ed6-b24be026d947 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] 10.222.0.18 "DELETE /compute/v2.1/servers/a3ed180f-6c68-4c19-bdb7-602dd8ffaaf2" status: 204 len: 0 microversion: 2.1 time: 0.300119 Oct 22 21:01:21.196252 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1408/2684] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 21:01:20 2022] DELETE /compute/v2.1/servers/a3ed180f-6c68-4c19-bdb7-602dd8ffaaf2 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 21:01:21.203938 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-0cc99f6f-9b6f-4205-a40c-df4e1bd8ca98 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Calling method '.version_select at 0x7fd39fbdc670>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:01:21.275120 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-ec92f0ed-52a3-493b-b741-15e13b082aa5 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.91 time: 1.720384 Oct 22 21:01:21.280959 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1277/2685] 10.222.0.18 () {62 vars in 1188 bytes} [Sat Oct 22 21:01:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 1728 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 22 21:01:21.291904 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-90ed983e-1e41-4158-93fc-533eb1562cd9 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:01:21.297295 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-90ed983e-1e41-4158-93fc-533eb1562cd9 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] [instance: af11a208-be6e-4f70-85f0-4bafafb4febd] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:01:21.300116 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-0cc99f6f-9b6f-4205-a40c-df4e1bd8ca98 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] 10.222.0.18 "GET /compute/v2.1/images/e8a48405-7084-4515-a1fe-96c425df5e47" status: 200 len: 1454 microversion: 2.1 time: 0.098465 Oct 22 21:01:21.303879 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1409/2686] 10.222.0.18 () {58 vars in 1233 bytes} [Sat Oct 22 21:01:21 2022] GET /compute/v2.1/images/e8a48405-7084-4515-a1fe-96c425df5e47 => generated 1454 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:01:21.324219 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-90ed983e-1e41-4158-93fc-533eb1562cd9 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:01:21.325250 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-90ed983e-1e41-4158-93fc-533eb1562cd9 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:01:21.325946 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-90ed983e-1e41-4158-93fc-533eb1562cd9 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:01:21.326960 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-90ed983e-1e41-4158-93fc-533eb1562cd9 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:01:21.327738 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-90ed983e-1e41-4158-93fc-533eb1562cd9 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:01:21.332101 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-d6e01634-1582-4f3e-bd60-45c7baf4c1b1 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:01:21.332236 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-90ed983e-1e41-4158-93fc-533eb1562cd9 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:01:21.332857 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-d6e01634-1582-4f3e-bd60-45c7baf4c1b1 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] [instance: a3ed180f-6c68-4c19-bdb7-602dd8ffaaf2] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:01:21.367879 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d6e01634-1582-4f3e-bd60-45c7baf4c1b1 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:01:21.368405 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d6e01634-1582-4f3e-bd60-45c7baf4c1b1 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:01:21.376950 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d6e01634-1582-4f3e-bd60-45c7baf4c1b1 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:01:21.380037 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d6e01634-1582-4f3e-bd60-45c7baf4c1b1 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:01:21.381418 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-90ed983e-1e41-4158-93fc-533eb1562cd9 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] [instance: af11a208-be6e-4f70-85f0-4bafafb4febd] Going to try to terminate instance {{(pid=138744) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 21:01:21.387096 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d6e01634-1582-4f3e-bd60-45c7baf4c1b1 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:01:21.387756 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d6e01634-1582-4f3e-bd60-45c7baf4c1b1 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:01:21.530160 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-90ed983e-1e41-4158-93fc-533eb1562cd9 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] 10.222.0.18 "DELETE /compute/v2.1/servers/af11a208-be6e-4f70-85f0-4bafafb4febd" status: 204 len: 0 microversion: 2.1 time: 0.246857 Oct 22 21:01:21.547397 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1278/2687] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 21:01:21 2022] DELETE /compute/v2.1/servers/af11a208-be6e-4f70-85f0-4bafafb4febd => generated 0 bytes in 249 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 21:01:21.547397 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-9bc7e1b7-fde7-4d23-b03d-d8d344cfd5c6 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:01:21.547397 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-9bc7e1b7-fde7-4d23-b03d-d8d344cfd5c6 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] [instance: 2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:01:22.266775 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-9bc7e1b7-fde7-4d23-b03d-d8d344cfd5c6 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:01:22.288206 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-9bc7e1b7-fde7-4d23-b03d-d8d344cfd5c6 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:01:22.289995 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-9bc7e1b7-fde7-4d23-b03d-d8d344cfd5c6 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:01:22.303640 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-9bc7e1b7-fde7-4d23-b03d-d8d344cfd5c6 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] 10.222.0.18 "GET /compute/v2.1/servers/2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac" status: 200 len: 1454 microversion: 2.91 time: 0.767442 Oct 22 21:01:22.319624 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1279/2688] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:01:21 2022] GET /compute/v2.1/servers/2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac => generated 1454 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:01:22.333525 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-731548cc-5a1f-4827-b63d-e345d150db0e tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1311587240", "imageRef": "085e4478-6edc-4a69-8e08-f9831713eb65", "flavorRef": "452", "networks": [{"uuid": "f1ad1f3f-09bf-4698-9fe5-20142c78993a"}]}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:01:22.522351 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.network.neutron [None req-731548cc-5a1f-4827-b63d-e345d150db0e tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] validate_networks() for [('f1ad1f3f-09bf-4698-9fe5-20142c78993a', None, None, None, None, None)] {{(pid=138744) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 21:01:22.607430 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-d6e01634-1582-4f3e-bd60-45c7baf4c1b1 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1b410a64e0415a96d30f5040361137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd7873d6db4e09bc9ab9a048a6b1ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:01:22.629843 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-d6e01634-1582-4f3e-bd60-45c7baf4c1b1 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] 10.222.0.18 "GET /compute/v2.1/servers/a3ed180f-6c68-4c19-bdb7-602dd8ffaaf2" status: 200 len: 1554 microversion: 2.1 time: 1.323777 Oct 22 21:01:22.630620 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1410/2689] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:01:21 2022] GET /compute/v2.1/servers/a3ed180f-6c68-4c19-bdb7-602dd8ffaaf2 => generated 1554 bytes in 1326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:01:22.636026 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-09d1d630-08cc-4907-bed6-279c8cb2ecce tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Calling method '.version_select at 0x7fd39febeee0>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:01:22.728376 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-09d1d630-08cc-4907-bed6-279c8cb2ecce tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] 10.222.0.18 "GET /compute/v2.1/images/e8a48405-7084-4515-a1fe-96c425df5e47" status: 200 len: 1454 microversion: 2.1 time: 0.096333 Oct 22 21:01:22.732498 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1411/2690] 10.222.0.18 () {58 vars in 1233 bytes} [Sat Oct 22 21:01:22 2022] GET /compute/v2.1/images/e8a48405-7084-4515-a1fe-96c425df5e47 => generated 1454 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:01:23.334199 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-9f5f1e1f-b0c6-4281-b547-175132a78afe tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:01:23.334832 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-9f5f1e1f-b0c6-4281-b547-175132a78afe tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] [instance: 2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:01:23.353603 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9f5f1e1f-b0c6-4281-b547-175132a78afe tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:01:23.354471 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9f5f1e1f-b0c6-4281-b547-175132a78afe tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:01:23.355048 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9f5f1e1f-b0c6-4281-b547-175132a78afe tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:01:23.355948 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9f5f1e1f-b0c6-4281-b547-175132a78afe tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:01:23.356424 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9f5f1e1f-b0c6-4281-b547-175132a78afe tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:01:23.357500 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9f5f1e1f-b0c6-4281-b547-175132a78afe tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:01:23.619529 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-9f5f1e1f-b0c6-4281-b547-175132a78afe tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:01:23.636781 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-9f5f1e1f-b0c6-4281-b547-175132a78afe tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:01:23.638587 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-9f5f1e1f-b0c6-4281-b547-175132a78afe tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:01:23.653925 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-9f5f1e1f-b0c6-4281-b547-175132a78afe tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] 10.222.0.18 "GET /compute/v2.1/servers/2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac" status: 200 len: 1506 microversion: 2.91 time: 0.323655 Oct 22 21:01:23.658574 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1412/2691] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:01:23 2022] GET /compute/v2.1/servers/2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac => generated 1506 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 22 21:01:23.671869 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-934006f3-89d0-4537-b491-a1e4a81d0290 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:01:23.672807 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-934006f3-89d0-4537-b491-a1e4a81d0290 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] [instance: a3ed180f-6c68-4c19-bdb7-602dd8ffaaf2] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:01:23.692921 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-934006f3-89d0-4537-b491-a1e4a81d0290 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:01:23.693725 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-934006f3-89d0-4537-b491-a1e4a81d0290 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:01:23.699874 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-934006f3-89d0-4537-b491-a1e4a81d0290 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:01:23.700900 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-934006f3-89d0-4537-b491-a1e4a81d0290 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:01:23.701569 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-934006f3-89d0-4537-b491-a1e4a81d0290 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:01:23.703211 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-934006f3-89d0-4537-b491-a1e4a81d0290 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:01:24.338316 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-934006f3-89d0-4537-b491-a1e4a81d0290 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1b410a64e0415a96d30f5040361137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd7873d6db4e09bc9ab9a048a6b1ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:01:24.351507 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-934006f3-89d0-4537-b491-a1e4a81d0290 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] 10.222.0.18 "GET /compute/v2.1/servers/a3ed180f-6c68-4c19-bdb7-602dd8ffaaf2" status: 200 len: 1554 microversion: 2.1 time: 0.691169 Oct 22 21:01:24.353968 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1413/2692] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:01:23 2022] GET /compute/v2.1/servers/a3ed180f-6c68-4c19-bdb7-602dd8ffaaf2 => generated 1554 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:01:24.375989 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-df26e89f-3fd2-4175-9e9f-4f146e4cab95 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Calling method '.version_select at 0x7fd39fda5550>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:01:24.463075 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-df26e89f-3fd2-4175-9e9f-4f146e4cab95 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] 10.222.0.18 "GET /compute/v2.1/images/e8a48405-7084-4515-a1fe-96c425df5e47" status: 200 len: 1454 microversion: 2.1 time: 0.092754 Oct 22 21:01:24.464255 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1414/2693] 10.222.0.18 () {58 vars in 1233 bytes} [Sat Oct 22 21:01:24 2022] GET /compute/v2.1/images/e8a48405-7084-4515-a1fe-96c425df5e47 => generated 1454 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:01:24.568028 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-c5277e90-7797-4347-ac40-635b7fea4c05 req-96f6d5e8-699d-47b8-8f94-ca12751af6f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af11a208-be6e-4f70-85f0-4bafafb4febd", "name": "network-vif-unplugged", "status": "completed", "tag": "3d94ca32-d8de-4aba-97b8-bd0eca70cdee"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:01:24.589980 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-c5277e90-7797-4347-ac40-635b7fea4c05 req-96f6d5e8-699d-47b8-8f94-ca12751af6f9 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:01:24.590464 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-c5277e90-7797-4347-ac40-635b7fea4c05 req-96f6d5e8-699d-47b8-8f94-ca12751af6f9 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:01:24.590907 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-c5277e90-7797-4347-ac40-635b7fea4c05 req-96f6d5e8-699d-47b8-8f94-ca12751af6f9 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:01:24.615261 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-731548cc-5a1f-4827-b63d-e345d150db0e tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Flavor limits 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 21:01:24.615869 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-731548cc-5a1f-4827-b63d-e345d150db0e tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Image limits 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 21:01:24.616310 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-731548cc-5a1f-4827-b63d-e345d150db0e tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Flavor pref 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 21:01:24.616725 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-731548cc-5a1f-4827-b63d-e345d150db0e tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Image pref 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 21:01:24.617148 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-731548cc-5a1f-4827-b63d-e345d150db0e tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 21:01:24.641940 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-731548cc-5a1f-4827-b63d-e345d150db0e tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:01:24.643141 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-731548cc-5a1f-4827-b63d-e345d150db0e tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:01:24.645599 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-c5277e90-7797-4347-ac40-635b7fea4c05 req-96f6d5e8-699d-47b8-8f94-ca12751af6f9 service nova] Creating event network-vif-unplugged:3d94ca32-d8de-4aba-97b8-bd0eca70cdee for instance af11a208-be6e-4f70-85f0-4bafafb4febd on nch1-master-1 Oct 22 21:01:24.646745 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-731548cc-5a1f-4827-b63d-e345d150db0e tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:01:24.647801 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-731548cc-5a1f-4827-b63d-e345d150db0e tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:01:24.652838 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-731548cc-5a1f-4827-b63d-e345d150db0e tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:01:24.657299 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-731548cc-5a1f-4827-b63d-e345d150db0e tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:01:24.664030 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-c5277e90-7797-4347-ac40-635b7fea4c05 req-96f6d5e8-699d-47b8-8f94-ca12751af6f9 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.099677 Oct 22 21:01:24.677417 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1415/2694] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:01:24 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 21:01:24.690980 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-259b1d60-e420-47b3-ae29-5cb2a1396924 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:01:24.696682 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-259b1d60-e420-47b3-ae29-5cb2a1396924 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] [instance: 2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:01:24.708653 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-731548cc-5a1f-4827-b63d-e345d150db0e tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Getting quotas for project 66a26a2284f4424cbeaf63d504652546. Resources: {'cores', 'instances', 'ram'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 21:01:24.716462 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-259b1d60-e420-47b3-ae29-5cb2a1396924 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:01:24.716999 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-259b1d60-e420-47b3-ae29-5cb2a1396924 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:01:24.717451 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-259b1d60-e420-47b3-ae29-5cb2a1396924 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:01:24.724790 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-731548cc-5a1f-4827-b63d-e345d150db0e tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Getting quotas for user f0a44ff8e7c14b94b1670f030085c43d and project 66a26a2284f4424cbeaf63d504652546. Resources: {'cores', 'instances', 'ram'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 21:01:24.727966 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-259b1d60-e420-47b3-ae29-5cb2a1396924 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:01:24.728794 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-259b1d60-e420-47b3-ae29-5cb2a1396924 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:01:24.731713 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-259b1d60-e420-47b3-ae29-5cb2a1396924 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:01:24.755312 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-731548cc-5a1f-4827-b63d-e345d150db0e tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Going to run 1 instances... {{(pid=138744) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 21:01:24.760884 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-731548cc-5a1f-4827-b63d-e345d150db0e tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] [instance: 9c2729a5-e874-43e7-a372-514906975851] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='085e4478-6edc-4a69-8e08-f9831713eb65',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138744) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 21:01:24.912624 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-259b1d60-e420-47b3-ae29-5cb2a1396924 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:01:24.929170 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-259b1d60-e420-47b3-ae29-5cb2a1396924 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:01:24.931013 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-259b1d60-e420-47b3-ae29-5cb2a1396924 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:01:24.949830 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-731548cc-5a1f-4827-b63d-e345d150db0e tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.629925 Oct 22 21:01:24.952393 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-259b1d60-e420-47b3-ae29-5cb2a1396924 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] 10.222.0.18 "GET /compute/v2.1/servers/2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac" status: 200 len: 1512 microversion: 2.91 time: 0.265728 Oct 22 21:01:24.953068 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1280/2695] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Oct 22 21:01:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 2635 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 21:01:24.960153 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1416/2696] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:01:24 2022] GET /compute/v2.1/servers/2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac => generated 1512 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:01:24.973870 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-97d85f01-7d6c-4f54-bccf-7feaab860836 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:01:24.977149 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-97d85f01-7d6c-4f54-bccf-7feaab860836 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] [instance: 9c2729a5-e874-43e7-a372-514906975851] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:01:25.181492 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-97d85f01-7d6c-4f54-bccf-7feaab860836 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a44ff8e7c14b94b1670f030085c43d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a26a2284f4424cbeaf63d504652546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:01:25.238552 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-97d85f01-7d6c-4f54-bccf-7feaab860836 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] 10.222.0.18 "GET /compute/v2.1/servers/9c2729a5-e874-43e7-a372-514906975851" status: 200 len: 1208 microversion: 2.1 time: 0.276712 Oct 22 21:01:25.239789 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1281/2697] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:01:24 2022] GET /compute/v2.1/servers/9c2729a5-e874-43e7-a372-514906975851 => generated 1208 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:01:25.384862 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-6b72b4e7-4e72-4a2d-bd41-aaf297f1b98c tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:01:25.385896 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-6b72b4e7-4e72-4a2d-bd41-aaf297f1b98c tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] [instance: a3ed180f-6c68-4c19-bdb7-602dd8ffaaf2] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:01:25.400816 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6b72b4e7-4e72-4a2d-bd41-aaf297f1b98c tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:01:25.401609 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6b72b4e7-4e72-4a2d-bd41-aaf297f1b98c tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:01:25.418665 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6b72b4e7-4e72-4a2d-bd41-aaf297f1b98c tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:01:25.419929 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6b72b4e7-4e72-4a2d-bd41-aaf297f1b98c tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:01:25.420657 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6b72b4e7-4e72-4a2d-bd41-aaf297f1b98c tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:01:25.421295 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6b72b4e7-4e72-4a2d-bd41-aaf297f1b98c tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:01:25.482716 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-fe20b54d-689e-4fd2-a9c0-af39166f3aec tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Calling method '.version_select at 0x7fd39f13d040>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:01:25.801241 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-fe20b54d-689e-4fd2-a9c0-af39166f3aec tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] 10.222.0.18 "GET /compute/v2.1/images/e8a48405-7084-4515-a1fe-96c425df5e47" status: 200 len: 1454 microversion: 2.1 time: 0.323661 Oct 22 21:01:25.829546 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1282/2698] 10.222.0.18 () {58 vars in 1233 bytes} [Sat Oct 22 21:01:25 2022] GET /compute/v2.1/images/e8a48405-7084-4515-a1fe-96c425df5e47 => generated 1454 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:01:25.848795 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-b4c2fc14-5611-4a3f-aa72-69bbc33b69bd req-308034b1-c20a-409f-8703-a294e75bf9a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af11a208-be6e-4f70-85f0-4bafafb4febd", "name": "network-vif-deleted", "tag": "3d94ca32-d8de-4aba-97b8-bd0eca70cdee"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:01:25.875410 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-b4c2fc14-5611-4a3f-aa72-69bbc33b69bd req-308034b1-c20a-409f-8703-a294e75bf9a9 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:01:25.876081 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-b4c2fc14-5611-4a3f-aa72-69bbc33b69bd req-308034b1-c20a-409f-8703-a294e75bf9a9 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:01:25.876650 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-b4c2fc14-5611-4a3f-aa72-69bbc33b69bd req-308034b1-c20a-409f-8703-a294e75bf9a9 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:01:25.894300 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-b4c2fc14-5611-4a3f-aa72-69bbc33b69bd req-308034b1-c20a-409f-8703-a294e75bf9a9 service nova] Creating event network-vif-deleted:3d94ca32-d8de-4aba-97b8-bd0eca70cdee for instance af11a208-be6e-4f70-85f0-4bafafb4febd on nch1-master-1 Oct 22 21:01:25.901245 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-b4c2fc14-5611-4a3f-aa72-69bbc33b69bd req-308034b1-c20a-409f-8703-a294e75bf9a9 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069565 Oct 22 21:01:25.902988 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1283/2699] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:01:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:01:25.997923 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-0b346d68-90b9-47e2-976e-d8b6c6353b03 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:01:25.998772 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-0b346d68-90b9-47e2-976e-d8b6c6353b03 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] [instance: 2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:01:26.074803 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0b346d68-90b9-47e2-976e-d8b6c6353b03 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:01:26.082051 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0b346d68-90b9-47e2-976e-d8b6c6353b03 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:01:26.091588 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0b346d68-90b9-47e2-976e-d8b6c6353b03 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:01:26.096621 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0b346d68-90b9-47e2-976e-d8b6c6353b03 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:01:26.107699 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0b346d68-90b9-47e2-976e-d8b6c6353b03 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:01:26.109769 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0b346d68-90b9-47e2-976e-d8b6c6353b03 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:01:26.579796 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-0b346d68-90b9-47e2-976e-d8b6c6353b03 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:01:26.599038 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-0b346d68-90b9-47e2-976e-d8b6c6353b03 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:01:26.607367 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-0b346d68-90b9-47e2-976e-d8b6c6353b03 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:01:26.631198 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-0b346d68-90b9-47e2-976e-d8b6c6353b03 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] 10.222.0.18 "GET /compute/v2.1/servers/2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac" status: 200 len: 1512 microversion: 2.91 time: 0.643870 Oct 22 21:01:26.670041 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1284/2700] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:01:25 2022] GET /compute/v2.1/servers/2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac => generated 1512 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:01:26.681738 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-dbebc8fd-659e-45f9-bf2f-aaae5301953e tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:01:26.701825 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-6b72b4e7-4e72-4a2d-bd41-aaf297f1b98c tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1b410a64e0415a96d30f5040361137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd7873d6db4e09bc9ab9a048a6b1ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:01:26.702639 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-dbebc8fd-659e-45f9-bf2f-aaae5301953e tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] [instance: 9c2729a5-e874-43e7-a372-514906975851] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:01:26.724263 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-dbebc8fd-659e-45f9-bf2f-aaae5301953e tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:01:26.726991 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-dbebc8fd-659e-45f9-bf2f-aaae5301953e tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:01:26.728006 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-dbebc8fd-659e-45f9-bf2f-aaae5301953e tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:01:26.739593 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-dbebc8fd-659e-45f9-bf2f-aaae5301953e tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:01:26.740585 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-dbebc8fd-659e-45f9-bf2f-aaae5301953e tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:01:26.743143 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-6b72b4e7-4e72-4a2d-bd41-aaf297f1b98c tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] 10.222.0.18 "GET /compute/v2.1/servers/a3ed180f-6c68-4c19-bdb7-602dd8ffaaf2" status: 200 len: 1512 microversion: 2.1 time: 1.359206 Oct 22 21:01:26.743934 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-dbebc8fd-659e-45f9-bf2f-aaae5301953e tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:01:26.762246 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1417/2701] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:01:25 2022] GET /compute/v2.1/servers/a3ed180f-6c68-4c19-bdb7-602dd8ffaaf2 => generated 1512 bytes in 1383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:01:26.833265 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-9ddbbdcb-74ef-4b32-a37c-f050c67883ac tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Calling method '.version_select at 0x7fd39fd83940>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:01:27.000002 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-9ddbbdcb-74ef-4b32-a37c-f050c67883ac tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] 10.222.0.18 "GET /compute/v2.1/images/e8a48405-7084-4515-a1fe-96c425df5e47" status: 200 len: 1454 microversion: 2.1 time: 0.174067 Oct 22 21:01:27.002606 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1418/2702] 10.222.0.18 () {58 vars in 1233 bytes} [Sat Oct 22 21:01:26 2022] GET /compute/v2.1/images/e8a48405-7084-4515-a1fe-96c425df5e47 => generated 1454 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:01:27.104170 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-dbebc8fd-659e-45f9-bf2f-aaae5301953e tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a44ff8e7c14b94b1670f030085c43d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a26a2284f4424cbeaf63d504652546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:01:27.113956 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-dbebc8fd-659e-45f9-bf2f-aaae5301953e tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] 10.222.0.18 "GET /compute/v2.1/servers/9c2729a5-e874-43e7-a372-514906975851" status: 200 len: 1212 microversion: 2.1 time: 0.442222 Oct 22 21:01:27.118863 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1285/2703] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:01:26 2022] GET /compute/v2.1/servers/9c2729a5-e874-43e7-a372-514906975851 => generated 1212 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:01:27.685769 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-85caf20c-d236-4f41-80ef-8de5a8f640af tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:01:27.689217 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-85caf20c-d236-4f41-80ef-8de5a8f640af tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] [instance: 2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:01:27.718035 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-85caf20c-d236-4f41-80ef-8de5a8f640af tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:01:27.722242 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-85caf20c-d236-4f41-80ef-8de5a8f640af tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:01:27.724068 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-85caf20c-d236-4f41-80ef-8de5a8f640af tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:01:27.727217 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-85caf20c-d236-4f41-80ef-8de5a8f640af tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:01:27.729951 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-85caf20c-d236-4f41-80ef-8de5a8f640af tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:01:27.730952 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-85caf20c-d236-4f41-80ef-8de5a8f640af tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:01:27.789654 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-60af352d-e9bf-46f9-b0e6-03c09ee08ba7 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:01:27.790283 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-60af352d-e9bf-46f9-b0e6-03c09ee08ba7 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] [instance: a3ed180f-6c68-4c19-bdb7-602dd8ffaaf2] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:01:27.807615 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-60af352d-e9bf-46f9-b0e6-03c09ee08ba7 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:01:27.816709 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-60af352d-e9bf-46f9-b0e6-03c09ee08ba7 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:01:27.829960 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-60af352d-e9bf-46f9-b0e6-03c09ee08ba7 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:01:27.830871 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-60af352d-e9bf-46f9-b0e6-03c09ee08ba7 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:01:27.831472 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-60af352d-e9bf-46f9-b0e6-03c09ee08ba7 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:01:27.836575 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-60af352d-e9bf-46f9-b0e6-03c09ee08ba7 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:01:28.051654 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-85caf20c-d236-4f41-80ef-8de5a8f640af tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:01:28.075900 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-85caf20c-d236-4f41-80ef-8de5a8f640af tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:01:28.077613 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-85caf20c-d236-4f41-80ef-8de5a8f640af tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:01:28.097822 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-60af352d-e9bf-46f9-b0e6-03c09ee08ba7 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1b410a64e0415a96d30f5040361137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd7873d6db4e09bc9ab9a048a6b1ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:01:28.118198 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-85caf20c-d236-4f41-80ef-8de5a8f640af tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] 10.222.0.18 "GET /compute/v2.1/servers/2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac" status: 200 len: 1533 microversion: 2.91 time: 0.443712 Oct 22 21:01:28.121743 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-60af352d-e9bf-46f9-b0e6-03c09ee08ba7 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] 10.222.0.18 "GET /compute/v2.1/servers/a3ed180f-6c68-4c19-bdb7-602dd8ffaaf2" status: 200 len: 1346 microversion: 2.1 time: 0.325444 Oct 22 21:01:28.123558 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1419/2704] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:01:27 2022] GET /compute/v2.1/servers/2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac => generated 1533 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:01:28.127988 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1286/2705] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:01:27 2022] GET /compute/v2.1/servers/a3ed180f-6c68-4c19-bdb7-602dd8ffaaf2 => generated 1346 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:01:28.146428 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-5b9fb7f7-7362-4b0b-975c-632f8e64e404 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Calling method '.version_select at 0x7fd39fd7c4c0>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:01:28.150200 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-40bdba97-4737-490e-88a9-10285bafa000 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:01:28.150838 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-40bdba97-4737-490e-88a9-10285bafa000 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] [instance: 9c2729a5-e874-43e7-a372-514906975851] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:01:28.197731 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-40bdba97-4737-490e-88a9-10285bafa000 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:01:28.212798 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-40bdba97-4737-490e-88a9-10285bafa000 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:01:28.214293 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-40bdba97-4737-490e-88a9-10285bafa000 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:01:28.217062 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-40bdba97-4737-490e-88a9-10285bafa000 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:01:28.217756 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-40bdba97-4737-490e-88a9-10285bafa000 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:01:28.222888 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-40bdba97-4737-490e-88a9-10285bafa000 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:01:28.303417 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-5b9fb7f7-7362-4b0b-975c-632f8e64e404 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] 10.222.0.18 "GET /compute/v2.1/images/e8a48405-7084-4515-a1fe-96c425df5e47" status: 200 len: 1454 microversion: 2.1 time: 0.175846 Oct 22 21:01:28.304641 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1420/2706] 10.222.0.18 () {58 vars in 1233 bytes} [Sat Oct 22 21:01:28 2022] GET /compute/v2.1/images/e8a48405-7084-4515-a1fe-96c425df5e47 => generated 1454 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:01:28.575155 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-13faa8b2-f4fb-4444-941c-aedb67ee8736 tempest-UnshelveToHostMultiNodesTest-2069914657 tempest-UnshelveToHostMultiNodesTest-2069914657-project-admin] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:01:28.581125 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-13faa8b2-f4fb-4444-941c-aedb67ee8736 tempest-UnshelveToHostMultiNodesTest-2069914657 tempest-UnshelveToHostMultiNodesTest-2069914657-project-admin] [instance: 2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:01:28.595633 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-13faa8b2-f4fb-4444-941c-aedb67ee8736 tempest-UnshelveToHostMultiNodesTest-2069914657 tempest-UnshelveToHostMultiNodesTest-2069914657-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:01:28.596356 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-13faa8b2-f4fb-4444-941c-aedb67ee8736 tempest-UnshelveToHostMultiNodesTest-2069914657 tempest-UnshelveToHostMultiNodesTest-2069914657-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:01:28.596838 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-13faa8b2-f4fb-4444-941c-aedb67ee8736 tempest-UnshelveToHostMultiNodesTest-2069914657 tempest-UnshelveToHostMultiNodesTest-2069914657-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:01:28.598845 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-13faa8b2-f4fb-4444-941c-aedb67ee8736 tempest-UnshelveToHostMultiNodesTest-2069914657 tempest-UnshelveToHostMultiNodesTest-2069914657-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:01:28.599611 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-13faa8b2-f4fb-4444-941c-aedb67ee8736 tempest-UnshelveToHostMultiNodesTest-2069914657 tempest-UnshelveToHostMultiNodesTest-2069914657-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:01:28.602188 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-13faa8b2-f4fb-4444-941c-aedb67ee8736 tempest-UnshelveToHostMultiNodesTest-2069914657 tempest-UnshelveToHostMultiNodesTest-2069914657-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:01:28.815147 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-40bdba97-4737-490e-88a9-10285bafa000 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a44ff8e7c14b94b1670f030085c43d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a26a2284f4424cbeaf63d504652546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:01:28.828743 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-40bdba97-4737-490e-88a9-10285bafa000 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] 10.222.0.18 "GET /compute/v2.1/servers/9c2729a5-e874-43e7-a372-514906975851" status: 200 len: 1260 microversion: 2.1 time: 0.686551 Oct 22 21:01:28.846315 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1287/2707] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:01:28 2022] GET /compute/v2.1/servers/9c2729a5-e874-43e7-a372-514906975851 => generated 1260 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:01:28.856554 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-48885d75-71b6-4b6a-900a-3bdac01cef0f req-9884b15c-974b-4189-b38d-d1b2b4f81860 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3ed180f-6c68-4c19-bdb7-602dd8ffaaf2", "name": "network-vif-deleted", "tag": "dff23b77-ab17-434d-a284-5b6ea50faa86"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:01:28.870920 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-48885d75-71b6-4b6a-900a-3bdac01cef0f req-9884b15c-974b-4189-b38d-d1b2b4f81860 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:01:28.872655 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-48885d75-71b6-4b6a-900a-3bdac01cef0f req-9884b15c-974b-4189-b38d-d1b2b4f81860 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:01:28.873639 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-48885d75-71b6-4b6a-900a-3bdac01cef0f req-9884b15c-974b-4189-b38d-d1b2b4f81860 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:01:28.894792 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-48885d75-71b6-4b6a-900a-3bdac01cef0f req-9884b15c-974b-4189-b38d-d1b2b4f81860 service nova] Creating event network-vif-deleted:dff23b77-ab17-434d-a284-5b6ea50faa86 for instance a3ed180f-6c68-4c19-bdb7-602dd8ffaaf2 on nch2-master-1 Oct 22 21:01:28.906845 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-48885d75-71b6-4b6a-900a-3bdac01cef0f req-9884b15c-974b-4189-b38d-d1b2b4f81860 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058811 Oct 22 21:01:28.911168 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1288/2708] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:01:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:01:29.152881 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-290cec39-4be7-4def-8400-153906e253e2 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:01:29.154321 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-290cec39-4be7-4def-8400-153906e253e2 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] [instance: a3ed180f-6c68-4c19-bdb7-602dd8ffaaf2] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:01:29.174562 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-290cec39-4be7-4def-8400-153906e253e2 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:01:29.175088 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-290cec39-4be7-4def-8400-153906e253e2 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:01:29.175599 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-290cec39-4be7-4def-8400-153906e253e2 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:01:29.181464 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-290cec39-4be7-4def-8400-153906e253e2 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:01:29.183656 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-290cec39-4be7-4def-8400-153906e253e2 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:01:29.184922 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-290cec39-4be7-4def-8400-153906e253e2 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:01:29.244549 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.objects.instance [None req-13faa8b2-f4fb-4444-941c-aedb67ee8736 tempest-UnshelveToHostMultiNodesTest-2069914657 tempest-UnshelveToHostMultiNodesTest-2069914657-project-admin] Lazy-loading 'services' on Instance uuid 2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac {{(pid=138745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 21:01:29.292338 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-290cec39-4be7-4def-8400-153906e253e2 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:01:29.293350 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-290cec39-4be7-4def-8400-153906e253e2 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:01:29.295817 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-290cec39-4be7-4def-8400-153906e253e2 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:01:29.295817 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.objects.instance [None req-290cec39-4be7-4def-8400-153906e253e2 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lazy-loading 'fault' on Instance uuid a3ed180f-6c68-4c19-bdb7-602dd8ffaaf2 {{(pid=138744) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 21:01:29.311488 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-13faa8b2-f4fb-4444-941c-aedb67ee8736 tempest-UnshelveToHostMultiNodesTest-2069914657 tempest-UnshelveToHostMultiNodesTest-2069914657-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac" status: 200 len: 1938 microversion: 2.91 time: 1.005545 Oct 22 21:01:29.316775 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1421/2709] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:01:28 2022] GET /compute/v2.1/servers/2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac => generated 1938 bytes in 1011 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:01:29.330952 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-a586e609-7893-4a6c-ba6d-b58c386fac7d tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Calling method '.version_select at 0x7fd3a466e5e0>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:01:29.417046 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-290cec39-4be7-4def-8400-153906e253e2 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1b410a64e0415a96d30f5040361137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd7873d6db4e09bc9ab9a048a6b1ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:01:29.432201 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-290cec39-4be7-4def-8400-153906e253e2 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] 10.222.0.18 "GET /compute/v2.1/servers/a3ed180f-6c68-4c19-bdb7-602dd8ffaaf2" status: 200 len: 1305 microversion: 2.1 time: 0.282776 Oct 22 21:01:29.445308 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1289/2710] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:01:29 2022] GET /compute/v2.1/servers/a3ed180f-6c68-4c19-bdb7-602dd8ffaaf2 => generated 1305 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:01:29.447367 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-a2e26b4d-f569-4ee9-94fd-f5713bbaeae5 tempest-UnshelveToHostMultiNodesTest-2069914657 tempest-UnshelveToHostMultiNodesTest-2069914657-project-admin] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:01:29.453408 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-a2e26b4d-f569-4ee9-94fd-f5713bbaeae5 tempest-UnshelveToHostMultiNodesTest-2069914657 tempest-UnshelveToHostMultiNodesTest-2069914657-project-admin] [instance: 2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:01:29.468523 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a2e26b4d-f569-4ee9-94fd-f5713bbaeae5 tempest-UnshelveToHostMultiNodesTest-2069914657 tempest-UnshelveToHostMultiNodesTest-2069914657-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:01:29.470844 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a2e26b4d-f569-4ee9-94fd-f5713bbaeae5 tempest-UnshelveToHostMultiNodesTest-2069914657 tempest-UnshelveToHostMultiNodesTest-2069914657-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:01:29.471977 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a2e26b4d-f569-4ee9-94fd-f5713bbaeae5 tempest-UnshelveToHostMultiNodesTest-2069914657 tempest-UnshelveToHostMultiNodesTest-2069914657-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:01:29.474118 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a2e26b4d-f569-4ee9-94fd-f5713bbaeae5 tempest-UnshelveToHostMultiNodesTest-2069914657 tempest-UnshelveToHostMultiNodesTest-2069914657-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:01:29.475589 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a2e26b4d-f569-4ee9-94fd-f5713bbaeae5 tempest-UnshelveToHostMultiNodesTest-2069914657 tempest-UnshelveToHostMultiNodesTest-2069914657-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:01:29.477598 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a2e26b4d-f569-4ee9-94fd-f5713bbaeae5 tempest-UnshelveToHostMultiNodesTest-2069914657 tempest-UnshelveToHostMultiNodesTest-2069914657-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:01:29.488836 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-a586e609-7893-4a6c-ba6d-b58c386fac7d tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] 10.222.0.18 "GET /compute/v2.1/images/e8a48405-7084-4515-a1fe-96c425df5e47" status: 200 len: 1454 microversion: 2.1 time: 0.169221 Oct 22 21:01:29.490367 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1422/2711] 10.222.0.18 () {58 vars in 1233 bytes} [Sat Oct 22 21:01:29 2022] GET /compute/v2.1/images/e8a48405-7084-4515-a1fe-96c425df5e47 => generated 1454 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:01:29.882181 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-ed40f42e-889a-4bdd-abf6-4955140d9a85 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:01:29.885074 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-ed40f42e-889a-4bdd-abf6-4955140d9a85 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] [instance: 9c2729a5-e874-43e7-a372-514906975851] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:01:29.908108 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ed40f42e-889a-4bdd-abf6-4955140d9a85 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:01:29.910220 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ed40f42e-889a-4bdd-abf6-4955140d9a85 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:01:29.922962 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ed40f42e-889a-4bdd-abf6-4955140d9a85 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:01:29.923845 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.objects.instance [None req-a2e26b4d-f569-4ee9-94fd-f5713bbaeae5 tempest-UnshelveToHostMultiNodesTest-2069914657 tempest-UnshelveToHostMultiNodesTest-2069914657-project-admin] Lazy-loading 'services' on Instance uuid 2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac {{(pid=138744) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 21:01:29.926016 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ed40f42e-889a-4bdd-abf6-4955140d9a85 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:01:29.930200 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ed40f42e-889a-4bdd-abf6-4955140d9a85 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:01:29.930938 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ed40f42e-889a-4bdd-abf6-4955140d9a85 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:01:29.932388 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:01:29.974048 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-a2e26b4d-f569-4ee9-94fd-f5713bbaeae5 tempest-UnshelveToHostMultiNodesTest-2069914657 tempest-UnshelveToHostMultiNodesTest-2069914657-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac" status: 200 len: 1938 microversion: 2.91 time: 0.538132 Oct 22 21:01:29.978933 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1290/2712] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:01:29 2022] GET /compute/v2.1/servers/2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac => generated 1938 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:01:30.008085 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-df0cf630-eb91-4075-9d4d-88065ddf6181 tempest-UnshelveToHostMultiNodesTest-2069914657 tempest-UnshelveToHostMultiNodesTest-2069914657-project-admin] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:01:30.019380 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-df0cf630-eb91-4075-9d4d-88065ddf6181 tempest-UnshelveToHostMultiNodesTest-2069914657 tempest-UnshelveToHostMultiNodesTest-2069914657-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:01:30.020013 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-df0cf630-eb91-4075-9d4d-88065ddf6181 tempest-UnshelveToHostMultiNodesTest-2069914657 tempest-UnshelveToHostMultiNodesTest-2069914657-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:01:30.020461 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-df0cf630-eb91-4075-9d4d-88065ddf6181 tempest-UnshelveToHostMultiNodesTest-2069914657 tempest-UnshelveToHostMultiNodesTest-2069914657-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:01:30.021271 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-df0cf630-eb91-4075-9d4d-88065ddf6181 tempest-UnshelveToHostMultiNodesTest-2069914657 tempest-UnshelveToHostMultiNodesTest-2069914657-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:01:30.021739 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-df0cf630-eb91-4075-9d4d-88065ddf6181 tempest-UnshelveToHostMultiNodesTest-2069914657 tempest-UnshelveToHostMultiNodesTest-2069914657-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:01:30.033043 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-df0cf630-eb91-4075-9d4d-88065ddf6181 tempest-UnshelveToHostMultiNodesTest-2069914657 tempest-UnshelveToHostMultiNodesTest-2069914657-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:01:30.164611 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-ed40f42e-889a-4bdd-abf6-4955140d9a85 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a44ff8e7c14b94b1670f030085c43d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a26a2284f4424cbeaf63d504652546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:01:30.179824 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-ed40f42e-889a-4bdd-abf6-4955140d9a85 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] 10.222.0.18 "GET /compute/v2.1/servers/9c2729a5-e874-43e7-a372-514906975851" status: 200 len: 1266 microversion: 2.1 time: 0.321600 Oct 22 21:01:30.180426 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1423/2713] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:01:29 2022] GET /compute/v2.1/servers/9c2729a5-e874-43e7-a372-514906975851 => generated 1266 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:01:30.182337 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-df0cf630-eb91-4075-9d4d-88065ddf6181 tempest-UnshelveToHostMultiNodesTest-2069914657 tempest-UnshelveToHostMultiNodesTest-2069914657-project-admin] 10.222.0.18 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 498 microversion: 2.91 time: 0.179092 Oct 22 21:01:30.189797 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1291/2714] 10.222.0.18 () {60 vars in 1217 bytes} [Sat Oct 22 21:01:30 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 498 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 22 21:01:30.202687 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-2d01b2d2-d4aa-4076-85a1-1f0bd1c7f278 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:01:30.203234 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-2d01b2d2-d4aa-4076-85a1-1f0bd1c7f278 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] [instance: 2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:01:30.211195 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2d01b2d2-d4aa-4076-85a1-1f0bd1c7f278 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:01:30.211991 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2d01b2d2-d4aa-4076-85a1-1f0bd1c7f278 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:01:30.213089 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2d01b2d2-d4aa-4076-85a1-1f0bd1c7f278 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:01:30.214573 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2d01b2d2-d4aa-4076-85a1-1f0bd1c7f278 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:01:30.215385 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2d01b2d2-d4aa-4076-85a1-1f0bd1c7f278 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:01:30.216072 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2d01b2d2-d4aa-4076-85a1-1f0bd1c7f278 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:01:30.261383 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.objects.instance [None req-2d01b2d2-d4aa-4076-85a1-1f0bd1c7f278 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lazy-loading 'flavor' on Instance uuid 2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac {{(pid=138745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 21:01:30.382483 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:01:30.468517 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-81add4ad-af95-4d52-be77-a226cf23c162 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:01:30.469167 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-81add4ad-af95-4d52-be77-a226cf23c162 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] [instance: a3ed180f-6c68-4c19-bdb7-602dd8ffaaf2] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:01:30.499185 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-81add4ad-af95-4d52-be77-a226cf23c162 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:01:30.500944 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-81add4ad-af95-4d52-be77-a226cf23c162 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:01:30.500944 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-81add4ad-af95-4d52-be77-a226cf23c162 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:01:30.510265 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-81add4ad-af95-4d52-be77-a226cf23c162 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:01:30.512982 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-81add4ad-af95-4d52-be77-a226cf23c162 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:01:30.514342 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-81add4ad-af95-4d52-be77-a226cf23c162 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:01:30.536118 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-81add4ad-af95-4d52-be77-a226cf23c162 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] HTTP exception thrown: Instance a3ed180f-6c68-4c19-bdb7-602dd8ffaaf2 could not be found. Oct 22 21:01:30.537942 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-81add4ad-af95-4d52-be77-a226cf23c162 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Request method failure captured: Oct 22 21:01:30.537942 ncdv-master-1 devstack@n-api.service[138744]: request: GET /compute/v2.1/servers/a3ed180f-6c68-4c19-bdb7-602dd8ffaaf2 HTTP/1.1 Oct 22 21:01:30.537942 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 21:01:30.537942 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 21:01:30.537942 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 21:01:30.537942 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 0 Oct 22 21:01:30.537942 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 21:01:30.537942 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 21:01:30.537942 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 21:01:30.537942 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 21:01:30.537942 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVFnfV28M622GxgIau9tfOtpQOzUe_Zks3cnq6zOgmdqQwk77RE2xHy9F74fRKXOoFFtdLiZlk8HWakwyjiKYmRp9GaMJF70RmWqk8on_rfYCWM12-ITQGodTkqOwwxslvC1Btdt7aRnJVFyVeqFX--IHdQyw_AkPLTYKSNTzj-OnnLE Oct 22 21:01:30.537942 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 21:01:30.537942 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 21:01:30.537942 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 21:01:30.537942 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 21:01:30.537942 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 21:01:30.537942 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 21:01:30.537942 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: b4cd7873d6db4e09bc9ab9a048a6b1ef Oct 22 21:01:30.537942 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-DeleteServersTestJSON-1244431593 Oct 22 21:01:30.537942 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 21:01:30.537942 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 21:01:30.537942 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_b4cd7873d6db4e09bc9ab9a048a6b1ef"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b4cd7873d6db4e09bc9ab9a048a6b1ef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/b4cd7873d6db4e09bc9ab9a048a6b1ef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b4cd7873d6db4e09bc9ab9a048a6b1ef"}]}] Oct 22 21:01:30.537942 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-DeleteServersTestJSON-1244431593 Oct 22 21:01:30.537942 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: b4cd7873d6db4e09bc9ab9a048a6b1ef Oct 22 21:01:30.537942 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-DeleteServersTestJSON-1244431593 Oct 22 21:01:30.537942 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-DeleteServersTestJSON-1244431593-project Oct 22 21:01:30.537942 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 21:01:30.537942 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 21:01:30.537942 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: be1b410a64e0415a96d30f5040361137 Oct 22 21:01:30.537942 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-DeleteServersTestJSON-1244431593-project Oct 22 21:01:30.537942 ncdv-master-1 devstack@n-api.service[138744]: method: > Oct 22 21:01:30.537942 ncdv-master-1 devstack@n-api.service[138744]: exception: Instance a3ed180f-6c68-4c19-bdb7-602dd8ffaaf2 could not be found. Oct 22 21:01:30.537942 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': 'a3ed180f-6c68-4c19-bdb7-602dd8ffaaf2'} Oct 22 21:01:30.537942 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:01:30.537942 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:01:30.537942 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 21:01:30.537942 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 21:01:30.537942 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 21:01:30.537942 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 21:01:30.537942 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 21:01:30.537942 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 21:01:30.537942 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 21:01:30.537942 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 21:01:30.537942 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a3ed180f-6c68-4c19-bdb7-602dd8ffaaf2 could not be found. Oct 22 21:01:30.537942 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:01:30.537942 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:01:30.537942 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:01:30.537942 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:01:30.537942 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:01:30.537942 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:01:30.537942 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:01:30.537942 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:01:30.537942 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:01:30.537942 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:01:30.537942 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 21:01:30.537942 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 21:01:30.537942 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 21:01:30.537942 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 21:01:30.537942 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 21:01:30.537942 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:01:30.537942 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a3ed180f-6c68-4c19-bdb7-602dd8ffaaf2 could not be found. Oct 22 21:01:30.537942 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:01:30.537942 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:01:30.537942 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:01:30.543627 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:01:30.543627 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:01:30.543627 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:01:30.543627 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:01:30.543627 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:01:30.543627 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a3ed180f-6c68-4c19-bdb7-602dd8ffaaf2 could not be found. Oct 22 21:01:30.543627 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:01:30.544618 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-81add4ad-af95-4d52-be77-a226cf23c162 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Returning 404 to user: Instance a3ed180f-6c68-4c19-bdb7-602dd8ffaaf2 could not be found. {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:01:30.545222 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-81add4ad-af95-4d52-be77-a226cf23c162 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] 10.222.0.18 "GET /compute/v2.1/servers/a3ed180f-6c68-4c19-bdb7-602dd8ffaaf2" status: 404 len: 111 microversion: 2.1 time: 0.084351 Oct 22 21:01:30.549781 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1292/2715] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:01:30 2022] GET /compute/v2.1/servers/a3ed180f-6c68-4c19-bdb7-602dd8ffaaf2 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 22 21:01:30.556188 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-b8c09fc2-3b7e-4651-b3b0-654cf5db439b tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Calling method '.version_select at 0x7fd39f331820>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:01:30.809608 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-2d01b2d2-d4aa-4076-85a1-1f0bd1c7f278 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] 10.222.0.18 "POST /compute/v2.1/servers/2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac/action" status: 202 len: 0 microversion: 2.91 time: 0.612044 Oct 22 21:01:30.810531 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1424/2716] 10.222.0.18 () {62 vars in 1319 bytes} [Sat Oct 22 21:01:30 2022] POST /compute/v2.1/servers/2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac/action => generated 0 bytes in 614 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 22 21:01:30.841349 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-0d0f3e38-f071-4b78-a8e5-1ecbb881b5db tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:01:30.848000 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-0d0f3e38-f071-4b78-a8e5-1ecbb881b5db tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] [instance: 2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:01:30.870614 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0d0f3e38-f071-4b78-a8e5-1ecbb881b5db tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:01:30.878314 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0d0f3e38-f071-4b78-a8e5-1ecbb881b5db tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:01:30.879357 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0d0f3e38-f071-4b78-a8e5-1ecbb881b5db tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:01:30.883475 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0d0f3e38-f071-4b78-a8e5-1ecbb881b5db tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:01:30.883976 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0d0f3e38-f071-4b78-a8e5-1ecbb881b5db tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:01:30.886398 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0d0f3e38-f071-4b78-a8e5-1ecbb881b5db tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:01:30.917507 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-b8c09fc2-3b7e-4651-b3b0-654cf5db439b tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] 10.222.0.18 "GET /compute/v2.1/images/e8a48405-7084-4515-a1fe-96c425df5e47" status: 200 len: 1454 microversion: 2.1 time: 0.366304 Oct 22 21:01:30.918438 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1293/2717] 10.222.0.18 () {58 vars in 1233 bytes} [Sat Oct 22 21:01:30 2022] GET /compute/v2.1/images/e8a48405-7084-4515-a1fe-96c425df5e47 => generated 1454 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:01:30.952035 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-b0c7a028-f70f-4139-9f38-3baa7ea8ce19 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:01:30.955014 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-b0c7a028-f70f-4139-9f38-3baa7ea8ce19 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] [instance: a3ed180f-6c68-4c19-bdb7-602dd8ffaaf2] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:01:30.977844 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b0c7a028-f70f-4139-9f38-3baa7ea8ce19 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:01:30.988164 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b0c7a028-f70f-4139-9f38-3baa7ea8ce19 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:01:30.989066 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b0c7a028-f70f-4139-9f38-3baa7ea8ce19 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:01:30.991613 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b0c7a028-f70f-4139-9f38-3baa7ea8ce19 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:01:30.998030 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b0c7a028-f70f-4139-9f38-3baa7ea8ce19 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:01:30.998759 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b0c7a028-f70f-4139-9f38-3baa7ea8ce19 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:01:31.023440 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-b0c7a028-f70f-4139-9f38-3baa7ea8ce19 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] HTTP exception thrown: Instance a3ed180f-6c68-4c19-bdb7-602dd8ffaaf2 could not be found. Oct 22 21:01:31.028669 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-b0c7a028-f70f-4139-9f38-3baa7ea8ce19 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Request method failure captured: Oct 22 21:01:31.028669 ncdv-master-1 devstack@n-api.service[138744]: request: GET /compute/v2.1/servers/a3ed180f-6c68-4c19-bdb7-602dd8ffaaf2/os-volume_attachments HTTP/1.1 Oct 22 21:01:31.028669 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 21:01:31.028669 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 21:01:31.028669 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 21:01:31.028669 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 0 Oct 22 21:01:31.028669 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 21:01:31.028669 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 21:01:31.028669 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 21:01:31.028669 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 21:01:31.028669 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVFnfV28M622GxgIau9tfOtpQOzUe_Zks3cnq6zOgmdqQwk77RE2xHy9F74fRKXOoFFtdLiZlk8HWakwyjiKYmRp9GaMJF70RmWqk8on_rfYCWM12-ITQGodTkqOwwxslvC1Btdt7aRnJVFyVeqFX--IHdQyw_AkPLTYKSNTzj-OnnLE Oct 22 21:01:31.028669 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 21:01:31.028669 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 21:01:31.028669 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 21:01:31.028669 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 21:01:31.028669 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 21:01:31.028669 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 21:01:31.028669 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: b4cd7873d6db4e09bc9ab9a048a6b1ef Oct 22 21:01:31.028669 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-DeleteServersTestJSON-1244431593 Oct 22 21:01:31.028669 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 21:01:31.028669 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 21:01:31.028669 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_b4cd7873d6db4e09bc9ab9a048a6b1ef"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b4cd7873d6db4e09bc9ab9a048a6b1ef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/b4cd7873d6db4e09bc9ab9a048a6b1ef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b4cd7873d6db4e09bc9ab9a048a6b1ef"}]}] Oct 22 21:01:31.028669 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-DeleteServersTestJSON-1244431593 Oct 22 21:01:31.028669 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: b4cd7873d6db4e09bc9ab9a048a6b1ef Oct 22 21:01:31.028669 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-DeleteServersTestJSON-1244431593 Oct 22 21:01:31.028669 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-DeleteServersTestJSON-1244431593-project Oct 22 21:01:31.028669 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 21:01:31.028669 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 21:01:31.028669 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: be1b410a64e0415a96d30f5040361137 Oct 22 21:01:31.028669 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-DeleteServersTestJSON-1244431593-project Oct 22 21:01:31.028669 ncdv-master-1 devstack@n-api.service[138744]: method: > Oct 22 21:01:31.028669 ncdv-master-1 devstack@n-api.service[138744]: exception: Instance a3ed180f-6c68-4c19-bdb7-602dd8ffaaf2 could not be found. Oct 22 21:01:31.028669 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'server_id': 'a3ed180f-6c68-4c19-bdb7-602dd8ffaaf2'} Oct 22 21:01:31.028669 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:01:31.028669 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:01:31.028669 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 21:01:31.028669 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 21:01:31.028669 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 21:01:31.028669 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 21:01:31.028669 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 21:01:31.028669 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 21:01:31.028669 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 21:01:31.028669 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 21:01:31.028669 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a3ed180f-6c68-4c19-bdb7-602dd8ffaaf2 could not be found. Oct 22 21:01:31.028669 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:01:31.028669 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:01:31.028669 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:01:31.028669 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:01:31.028669 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:01:31.028669 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:01:31.028669 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:01:31.028669 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:01:31.028669 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:01:31.028669 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:01:31.028669 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 22 21:01:31.028669 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 21:01:31.028669 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 22 21:01:31.028669 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 21:01:31.028669 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Oct 22 21:01:31.028669 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Oct 22 21:01:31.028669 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 21:01:31.028669 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:01:31.032867 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a3ed180f-6c68-4c19-bdb7-602dd8ffaaf2 could not be found. Oct 22 21:01:31.032867 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:01:31.032867 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:01:31.032867 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:01:31.032867 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:01:31.032867 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:01:31.032867 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:01:31.032867 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:01:31.032867 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:01:31.032867 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a3ed180f-6c68-4c19-bdb7-602dd8ffaaf2 could not be found. Oct 22 21:01:31.032867 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:01:31.042171 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-b0c7a028-f70f-4139-9f38-3baa7ea8ce19 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Returning 404 to user: Instance a3ed180f-6c68-4c19-bdb7-602dd8ffaaf2 could not be found. {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:01:31.043812 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-b0c7a028-f70f-4139-9f38-3baa7ea8ce19 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] 10.222.0.18 "GET /compute/v2.1/servers/a3ed180f-6c68-4c19-bdb7-602dd8ffaaf2/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.116030 Oct 22 21:01:31.044975 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1294/2718] 10.222.0.18 () {58 vars in 1302 bytes} [Sat Oct 22 21:01:30 2022] GET /compute/v2.1/servers/a3ed180f-6c68-4c19-bdb7-602dd8ffaaf2/os-volume_attachments => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 21:01:31.206124 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-2c807a5c-8767-4677-b61e-23417378d712 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:01:31.206833 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-2c807a5c-8767-4677-b61e-23417378d712 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] [instance: 9c2729a5-e874-43e7-a372-514906975851] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:01:31.219215 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2c807a5c-8767-4677-b61e-23417378d712 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:01:31.219760 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2c807a5c-8767-4677-b61e-23417378d712 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:01:31.220211 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2c807a5c-8767-4677-b61e-23417378d712 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:01:31.220938 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2c807a5c-8767-4677-b61e-23417378d712 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:01:31.227697 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2c807a5c-8767-4677-b61e-23417378d712 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:01:31.228191 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2c807a5c-8767-4677-b61e-23417378d712 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:01:31.664073 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-0d0f3e38-f071-4b78-a8e5-1ecbb881b5db tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:01:31.673237 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-0d0f3e38-f071-4b78-a8e5-1ecbb881b5db tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:01:31.674700 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-0d0f3e38-f071-4b78-a8e5-1ecbb881b5db tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:01:31.702230 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-0d0f3e38-f071-4b78-a8e5-1ecbb881b5db tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] 10.222.0.18 "GET /compute/v2.1/servers/2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac" status: 200 len: 1539 microversion: 2.91 time: 0.880388 Oct 22 21:01:31.707156 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1425/2719] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:01:30 2022] GET /compute/v2.1/servers/2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac => generated 1539 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:01:31.721127 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-644f7d2a-d94c-4cd3-bbc5-08ec49157532 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-434351329", "imageRef": "085e4478-6edc-4a69-8e08-f9831713eb65", "flavorRef": "452", "networks": [{"uuid": "4ddebde3-67b6-4360-8934-2682d629ac63"}]}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:01:31.830708 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.network.neutron [None req-644f7d2a-d94c-4cd3-bbc5-08ec49157532 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] validate_networks() for [('4ddebde3-67b6-4360-8934-2682d629ac63', None, None, None, None, None)] {{(pid=138745) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 21:01:32.851309 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-2c807a5c-8767-4677-b61e-23417378d712 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a44ff8e7c14b94b1670f030085c43d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a26a2284f4424cbeaf63d504652546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:01:32.870505 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-2c807a5c-8767-4677-b61e-23417378d712 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] 10.222.0.18 "GET /compute/v2.1/servers/9c2729a5-e874-43e7-a372-514906975851" status: 200 len: 1308 microversion: 2.1 time: 1.668021 Oct 22 21:01:32.874186 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1295/2720] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:01:31 2022] GET /compute/v2.1/servers/9c2729a5-e874-43e7-a372-514906975851 => generated 1308 bytes in 1673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:01:32.883845 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-add37670-f619-42bf-b6c4-e8865bca0f09 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Calling method '.version_select at 0x7fd39f13d430>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:01:32.951858 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-add37670-f619-42bf-b6c4-e8865bca0f09 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] 10.222.0.18 "GET /compute/v2.1/images/e8a48405-7084-4515-a1fe-96c425df5e47" status: 200 len: 1454 microversion: 2.1 time: 0.076415 Oct 22 21:01:32.957725 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1296/2721] 10.222.0.18 () {58 vars in 1233 bytes} [Sat Oct 22 21:01:32 2022] GET /compute/v2.1/images/e8a48405-7084-4515-a1fe-96c425df5e47 => generated 1454 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:01:32.972912 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-3006c3a8-be2c-4776-a845-8f95a9c6ad98 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:01:32.974137 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-3006c3a8-be2c-4776-a845-8f95a9c6ad98 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] [instance: 2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:01:32.984040 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3006c3a8-be2c-4776-a845-8f95a9c6ad98 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:01:32.984904 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3006c3a8-be2c-4776-a845-8f95a9c6ad98 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:01:32.986230 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3006c3a8-be2c-4776-a845-8f95a9c6ad98 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:01:32.988820 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3006c3a8-be2c-4776-a845-8f95a9c6ad98 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:01:32.989570 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3006c3a8-be2c-4776-a845-8f95a9c6ad98 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:01:32.990383 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3006c3a8-be2c-4776-a845-8f95a9c6ad98 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:01:33.139775 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-3006c3a8-be2c-4776-a845-8f95a9c6ad98 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:01:33.153892 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-3006c3a8-be2c-4776-a845-8f95a9c6ad98 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:01:33.155774 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-3006c3a8-be2c-4776-a845-8f95a9c6ad98 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:01:33.165422 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-3006c3a8-be2c-4776-a845-8f95a9c6ad98 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] 10.222.0.18 "GET /compute/v2.1/servers/2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac" status: 200 len: 1539 microversion: 2.91 time: 0.206156 Oct 22 21:01:33.167295 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1297/2722] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:01:32 2022] GET /compute/v2.1/servers/2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac => generated 1539 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:01:33.173585 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-ff1361ee-2d7b-4edc-9a6b-0935e9d9db35 req-d5adc4a2-fcce-4780-94b8-7740e14d822b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c2729a5-e874-43e7-a372-514906975851", "tag": "7e49313e-bdb0-486a-bc1c-7bf140752a97"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:01:33.209784 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-ff1361ee-2d7b-4edc-9a6b-0935e9d9db35 req-d5adc4a2-fcce-4780-94b8-7740e14d822b service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:01:33.210616 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-ff1361ee-2d7b-4edc-9a6b-0935e9d9db35 req-d5adc4a2-fcce-4780-94b8-7740e14d822b service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:01:33.211459 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-ff1361ee-2d7b-4edc-9a6b-0935e9d9db35 req-d5adc4a2-fcce-4780-94b8-7740e14d822b service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:01:33.228474 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-ff1361ee-2d7b-4edc-9a6b-0935e9d9db35 req-d5adc4a2-fcce-4780-94b8-7740e14d822b service nova] Creating event network-changed:7e49313e-bdb0-486a-bc1c-7bf140752a97 for instance 9c2729a5-e874-43e7-a372-514906975851 on nch2-master-1 Oct 22 21:01:33.241316 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-ff1361ee-2d7b-4edc-9a6b-0935e9d9db35 req-d5adc4a2-fcce-4780-94b8-7740e14d822b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072407 Oct 22 21:01:33.243114 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1298/2723] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:01:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:01:33.913892 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-21766c1b-d005-4c47-9431-8ed60416a00e tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:01:33.915292 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-21766c1b-d005-4c47-9431-8ed60416a00e tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] [instance: 9c2729a5-e874-43e7-a372-514906975851] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:01:33.926587 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-21766c1b-d005-4c47-9431-8ed60416a00e tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:01:33.927095 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-21766c1b-d005-4c47-9431-8ed60416a00e tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:01:33.937760 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-21766c1b-d005-4c47-9431-8ed60416a00e tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:01:33.938957 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-21766c1b-d005-4c47-9431-8ed60416a00e tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:01:33.942439 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-21766c1b-d005-4c47-9431-8ed60416a00e tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:01:33.945195 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-21766c1b-d005-4c47-9431-8ed60416a00e tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:01:34.893092 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-21766c1b-d005-4c47-9431-8ed60416a00e tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a44ff8e7c14b94b1670f030085c43d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a26a2284f4424cbeaf63d504652546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:01:34.908194 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-21766c1b-d005-4c47-9431-8ed60416a00e tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] 10.222.0.18 "GET /compute/v2.1/servers/9c2729a5-e874-43e7-a372-514906975851" status: 200 len: 1308 microversion: 2.1 time: 1.011331 Oct 22 21:01:34.908780 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1299/2724] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:01:33 2022] GET /compute/v2.1/servers/9c2729a5-e874-43e7-a372-514906975851 => generated 1308 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:01:34.930829 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-b26708cf-7e40-4092-860e-6c387cfe597e tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Calling method '.version_select at 0x7fd39f3315e0>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:01:34.994193 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-b26708cf-7e40-4092-860e-6c387cfe597e tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] 10.222.0.18 "GET /compute/v2.1/images/e8a48405-7084-4515-a1fe-96c425df5e47" status: 200 len: 1454 microversion: 2.1 time: 0.069262 Oct 22 21:01:35.006816 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1300/2725] 10.222.0.18 () {58 vars in 1233 bytes} [Sat Oct 22 21:01:34 2022] GET /compute/v2.1/images/e8a48405-7084-4515-a1fe-96c425df5e47 => generated 1454 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:01:35.012376 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-ef3f3780-e760-4ec1-80c5-730d2720aebc tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:01:35.017041 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-ef3f3780-e760-4ec1-80c5-730d2720aebc tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] [instance: 2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:01:35.022051 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-644f7d2a-d94c-4cd3-bbc5-08ec49157532 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Flavor limits 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 21:01:35.023549 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-644f7d2a-d94c-4cd3-bbc5-08ec49157532 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Image limits 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 21:01:35.024327 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-644f7d2a-d94c-4cd3-bbc5-08ec49157532 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Flavor pref 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 21:01:35.025174 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-644f7d2a-d94c-4cd3-bbc5-08ec49157532 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Image pref 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 21:01:35.025739 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-644f7d2a-d94c-4cd3-bbc5-08ec49157532 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 21:01:35.028881 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:01:35.032067 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ef3f3780-e760-4ec1-80c5-730d2720aebc tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:01:35.032743 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ef3f3780-e760-4ec1-80c5-730d2720aebc tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:01:35.033549 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ef3f3780-e760-4ec1-80c5-730d2720aebc tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:01:35.035194 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ef3f3780-e760-4ec1-80c5-730d2720aebc tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:01:35.037222 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ef3f3780-e760-4ec1-80c5-730d2720aebc tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:01:35.037988 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ef3f3780-e760-4ec1-80c5-730d2720aebc tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:01:35.043828 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-644f7d2a-d94c-4cd3-bbc5-08ec49157532 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:01:35.044547 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-644f7d2a-d94c-4cd3-bbc5-08ec49157532 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:01:35.045532 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-644f7d2a-d94c-4cd3-bbc5-08ec49157532 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:01:35.047133 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-644f7d2a-d94c-4cd3-bbc5-08ec49157532 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:01:35.047794 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-644f7d2a-d94c-4cd3-bbc5-08ec49157532 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:01:35.048844 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-644f7d2a-d94c-4cd3-bbc5-08ec49157532 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:01:35.095192 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-644f7d2a-d94c-4cd3-bbc5-08ec49157532 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Getting quotas for project b4cd7873d6db4e09bc9ab9a048a6b1ef. Resources: {'cores', 'instances', 'ram'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 21:01:35.105679 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-644f7d2a-d94c-4cd3-bbc5-08ec49157532 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Getting quotas for user be1b410a64e0415a96d30f5040361137 and project b4cd7873d6db4e09bc9ab9a048a6b1ef. Resources: {'cores', 'instances', 'ram'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 21:01:35.135165 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-644f7d2a-d94c-4cd3-bbc5-08ec49157532 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Going to run 1 instances... {{(pid=138745) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 21:01:35.141533 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-644f7d2a-d94c-4cd3-bbc5-08ec49157532 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] [instance: c7e8da33-14d7-49fa-a960-c6d9f529d202] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='085e4478-6edc-4a69-8e08-f9831713eb65',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138745) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 21:01:35.224517 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell0:SELECT=16 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:01:35.269176 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-644f7d2a-d94c-4cd3-bbc5-08ec49157532 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.557087 Oct 22 21:01:35.269896 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1426/2726] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Oct 22 21:01:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 3562 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 21:01:35.287557 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-a746d8a2-af36-4a93-842d-4f4cce5814e4 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:01:35.289225 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-a746d8a2-af36-4a93-842d-4f4cce5814e4 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] [instance: c7e8da33-14d7-49fa-a960-c6d9f529d202] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:01:35.409988 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-ef3f3780-e760-4ec1-80c5-730d2720aebc tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:01:35.425372 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-ef3f3780-e760-4ec1-80c5-730d2720aebc tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:01:35.431762 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-ef3f3780-e760-4ec1-80c5-730d2720aebc tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:01:35.448195 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-ef3f3780-e760-4ec1-80c5-730d2720aebc tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] 10.222.0.18 "GET /compute/v2.1/servers/2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac" status: 200 len: 1539 microversion: 2.91 time: 0.436922 Oct 22 21:01:35.450073 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1301/2727] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:01:35 2022] GET /compute/v2.1/servers/2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac => generated 1539 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:01:35.551151 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-a746d8a2-af36-4a93-842d-4f4cce5814e4 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1b410a64e0415a96d30f5040361137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd7873d6db4e09bc9ab9a048a6b1ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:01:35.568171 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-a746d8a2-af36-4a93-842d-4f4cce5814e4 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] 10.222.0.18 "GET /compute/v2.1/servers/c7e8da33-14d7-49fa-a960-c6d9f529d202" status: 200 len: 1214 microversion: 2.1 time: 0.289826 Oct 22 21:01:35.585556 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1427/2728] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:01:35 2022] GET /compute/v2.1/servers/c7e8da33-14d7-49fa-a960-c6d9f529d202 => generated 1214 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:01:35.590991 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-bc7b67ae-6563-4770-b69e-c3fed9f2228c tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:01:35.591546 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-bc7b67ae-6563-4770-b69e-c3fed9f2228c tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] [instance: c7e8da33-14d7-49fa-a960-c6d9f529d202] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:01:35.622816 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-bc7b67ae-6563-4770-b69e-c3fed9f2228c tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] [instance: c7e8da33-14d7-49fa-a960-c6d9f529d202] Going to try to terminate instance {{(pid=138744) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 21:01:35.849819 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-bc7b67ae-6563-4770-b69e-c3fed9f2228c tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] 10.222.0.18 "DELETE /compute/v2.1/servers/c7e8da33-14d7-49fa-a960-c6d9f529d202" status: 204 len: 0 microversion: 2.1 time: 0.262873 Oct 22 21:01:35.854927 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1302/2729] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 21:01:35 2022] DELETE /compute/v2.1/servers/c7e8da33-14d7-49fa-a960-c6d9f529d202 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 21:01:35.861805 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-4c43449e-a91e-45b5-b73e-fadd49f6fac7 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:01:35.862520 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-4c43449e-a91e-45b5-b73e-fadd49f6fac7 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] [instance: c7e8da33-14d7-49fa-a960-c6d9f529d202] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:01:35.891779 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:01:35.929001 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.wsgi [None req-4c43449e-a91e-45b5-b73e-fadd49f6fac7 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] HTTP exception thrown: Instance c7e8da33-14d7-49fa-a960-c6d9f529d202 could not be found. Oct 22 21:01:35.937329 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-e62c0aca-8e16-4eff-89f8-35c64b4a501b tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:01:35.938683 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-e62c0aca-8e16-4eff-89f8-35c64b4a501b tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] [instance: 9c2729a5-e874-43e7-a372-514906975851] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:01:35.943798 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-4c43449e-a91e-45b5-b73e-fadd49f6fac7 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Request method failure captured: Oct 22 21:01:35.943798 ncdv-master-1 devstack@n-api.service[138745]: request: GET /compute/v2.1/servers/c7e8da33-14d7-49fa-a960-c6d9f529d202 HTTP/1.1 Oct 22 21:01:35.943798 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 21:01:35.943798 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 21:01:35.943798 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 21:01:35.943798 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 0 Oct 22 21:01:35.943798 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 21:01:35.943798 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 21:01:35.943798 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 21:01:35.943798 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 21:01:35.943798 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVFnfV28M622GxgIau9tfOtpQOzUe_Zks3cnq6zOgmdqQwk77RE2xHy9F74fRKXOoFFtdLiZlk8HWakwyjiKYmRp9GaMJF70RmWqk8on_rfYCWM12-ITQGodTkqOwwxslvC1Btdt7aRnJVFyVeqFX--IHdQyw_AkPLTYKSNTzj-OnnLE Oct 22 21:01:35.943798 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 21:01:35.943798 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 21:01:35.943798 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 21:01:35.943798 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 21:01:35.943798 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 21:01:35.943798 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 21:01:35.943798 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: b4cd7873d6db4e09bc9ab9a048a6b1ef Oct 22 21:01:35.943798 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-DeleteServersTestJSON-1244431593 Oct 22 21:01:35.943798 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 21:01:35.943798 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 21:01:35.943798 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_b4cd7873d6db4e09bc9ab9a048a6b1ef"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b4cd7873d6db4e09bc9ab9a048a6b1ef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/b4cd7873d6db4e09bc9ab9a048a6b1ef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b4cd7873d6db4e09bc9ab9a048a6b1ef"}]}] Oct 22 21:01:35.943798 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-DeleteServersTestJSON-1244431593 Oct 22 21:01:35.943798 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: b4cd7873d6db4e09bc9ab9a048a6b1ef Oct 22 21:01:35.943798 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-DeleteServersTestJSON-1244431593 Oct 22 21:01:35.943798 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-DeleteServersTestJSON-1244431593-project Oct 22 21:01:35.943798 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 21:01:35.943798 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 21:01:35.943798 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: be1b410a64e0415a96d30f5040361137 Oct 22 21:01:35.943798 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-DeleteServersTestJSON-1244431593-project Oct 22 21:01:35.943798 ncdv-master-1 devstack@n-api.service[138745]: method: > Oct 22 21:01:35.943798 ncdv-master-1 devstack@n-api.service[138745]: exception: Instance c7e8da33-14d7-49fa-a960-c6d9f529d202 could not be found. Oct 22 21:01:35.943798 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'id': 'c7e8da33-14d7-49fa-a960-c6d9f529d202'} Oct 22 21:01:35.943798 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:01:35.943798 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:01:35.943798 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2932, in _get_instance Oct 22 21:01:35.943798 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi build_req = objects.BuildRequest.get_by_instance_uuid( Oct 22 21:01:35.943798 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 22 21:01:35.943798 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 22 21:01:35.943798 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/build_request.py", line 177, in get_by_instance_uuid Oct 22 21:01:35.943798 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi db_req = cls._get_by_instance_uuid_from_db(context, instance_uuid) Oct 22 21:01:35.943798 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 22 21:01:35.943798 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 22 21:01:35.943798 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/build_request.py", line 172, in _get_by_instance_uuid_from_db Oct 22 21:01:35.943798 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.BuildRequestNotFound(uuid=instance_uuid) Oct 22 21:01:35.943798 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.BuildRequestNotFound: BuildRequest not found for instance c7e8da33-14d7-49fa-a960-c6d9f529d202 Oct 22 21:01:35.943798 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:01:35.943798 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:01:35.943798 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:01:35.943798 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:01:35.943798 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 21:01:35.943798 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 21:01:35.943798 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 21:01:35.943798 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 21:01:35.943798 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2944, in _get_instance Oct 22 21:01:35.943798 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 22 21:01:35.943798 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c7e8da33-14d7-49fa-a960-c6d9f529d202 could not be found. Oct 22 21:01:35.943798 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:01:35.943798 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:01:35.943798 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:01:35.943798 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:01:35.943798 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:01:35.943798 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:01:35.952383 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:01:35.952383 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:01:35.952383 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:01:35.952383 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:01:35.952383 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 21:01:35.952383 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 21:01:35.952383 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 21:01:35.952383 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 21:01:35.952383 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 21:01:35.952383 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:01:35.952383 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c7e8da33-14d7-49fa-a960-c6d9f529d202 could not be found. Oct 22 21:01:35.952383 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:01:35.952383 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:01:35.952383 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:01:35.952383 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:01:35.952383 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:01:35.952383 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:01:35.952383 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:01:35.952383 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:01:35.952383 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c7e8da33-14d7-49fa-a960-c6d9f529d202 could not be found. Oct 22 21:01:35.952383 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:01:35.952383 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-4c43449e-a91e-45b5-b73e-fadd49f6fac7 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Returning 404 to user: Instance c7e8da33-14d7-49fa-a960-c6d9f529d202 could not be found. {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:01:35.952383 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-4c43449e-a91e-45b5-b73e-fadd49f6fac7 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] 10.222.0.18 "GET /compute/v2.1/servers/c7e8da33-14d7-49fa-a960-c6d9f529d202" status: 404 len: 111 microversion: 2.1 time: 0.088494 Oct 22 21:01:35.952383 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1428/2730] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:01:35 2022] GET /compute/v2.1/servers/c7e8da33-14d7-49fa-a960-c6d9f529d202 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 21:01:35.961418 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e62c0aca-8e16-4eff-89f8-35c64b4a501b tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:01:35.962343 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e62c0aca-8e16-4eff-89f8-35c64b4a501b tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:01:35.963653 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e62c0aca-8e16-4eff-89f8-35c64b4a501b tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:01:35.965737 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e62c0aca-8e16-4eff-89f8-35c64b4a501b tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:01:35.966477 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e62c0aca-8e16-4eff-89f8-35c64b4a501b tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:01:35.967129 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e62c0aca-8e16-4eff-89f8-35c64b4a501b tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:01:36.013865 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-c35497c6-964c-4747-88f3-5a00bc7f5c30 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Calling method '.version_select at 0x7fd39fd7cc10>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:01:36.110096 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-c35497c6-964c-4747-88f3-5a00bc7f5c30 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] 10.222.0.18 "GET /compute/v2.1/images/e8a48405-7084-4515-a1fe-96c425df5e47" status: 200 len: 1454 microversion: 2.1 time: 0.102948 Oct 22 21:01:36.112428 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1429/2731] 10.222.0.18 () {58 vars in 1233 bytes} [Sat Oct 22 21:01:36 2022] GET /compute/v2.1/images/e8a48405-7084-4515-a1fe-96c425df5e47 => generated 1454 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:01:36.128726 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-786d0da0-e1ba-4797-bbbe-4763f7bed747 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1407367740", "imageRef": "085e4478-6edc-4a69-8e08-f9831713eb65", "flavorRef": "452", "networks": [{"uuid": "4ddebde3-67b6-4360-8934-2682d629ac63"}]}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:01:36.250147 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.network.neutron [None req-786d0da0-e1ba-4797-bbbe-4763f7bed747 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] validate_networks() for [('4ddebde3-67b6-4360-8934-2682d629ac63', None, None, None, None, None)] {{(pid=138745) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 21:01:36.616101 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-e62c0aca-8e16-4eff-89f8-35c64b4a501b tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a44ff8e7c14b94b1670f030085c43d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a26a2284f4424cbeaf63d504652546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:01:36.626005 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-e62c0aca-8e16-4eff-89f8-35c64b4a501b tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] 10.222.0.18 "GET /compute/v2.1/servers/9c2729a5-e874-43e7-a372-514906975851" status: 200 len: 1308 microversion: 2.1 time: 0.693110 Oct 22 21:01:36.649594 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1303/2732] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:01:35 2022] GET /compute/v2.1/servers/9c2729a5-e874-43e7-a372-514906975851 => generated 1308 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:01:36.667955 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-70a4a7a3-d996-466c-a925-7e56ba06b0bf tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:01:36.672224 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-70a4a7a3-d996-466c-a925-7e56ba06b0bf tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] [instance: 2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:01:36.691593 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-70a4a7a3-d996-466c-a925-7e56ba06b0bf tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:01:36.694480 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-70a4a7a3-d996-466c-a925-7e56ba06b0bf tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:01:36.695383 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-70a4a7a3-d996-466c-a925-7e56ba06b0bf tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:01:36.699623 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-70a4a7a3-d996-466c-a925-7e56ba06b0bf tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:01:36.700562 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-70a4a7a3-d996-466c-a925-7e56ba06b0bf tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:01:36.704834 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-70a4a7a3-d996-466c-a925-7e56ba06b0bf tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:01:36.894512 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-70a4a7a3-d996-466c-a925-7e56ba06b0bf tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:01:36.912365 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-70a4a7a3-d996-466c-a925-7e56ba06b0bf tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:01:36.916884 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-70a4a7a3-d996-466c-a925-7e56ba06b0bf tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:01:36.931283 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-70a4a7a3-d996-466c-a925-7e56ba06b0bf tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] 10.222.0.18 "GET /compute/v2.1/servers/2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac" status: 200 len: 1539 microversion: 2.91 time: 0.280412 Oct 22 21:01:36.934789 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1304/2733] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:01:36 2022] GET /compute/v2.1/servers/2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac => generated 1539 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:01:37.037736 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-024769c2-7a90-4b3b-9ae5-25c193ae6e1d tempest-ServerAddressesNegativeTestJSON-2002096545 tempest-ServerAddressesNegativeTestJSON-2002096545-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesNegativeTestJSON-server-1800967126", "imageRef": "085e4478-6edc-4a69-8e08-f9831713eb65", "flavorRef": "452", "networks": [{"uuid": "5f49e043-10ac-4de4-97b2-afa24a1b58c7"}]}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:01:37.152990 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.network.neutron [None req-024769c2-7a90-4b3b-9ae5-25c193ae6e1d tempest-ServerAddressesNegativeTestJSON-2002096545 tempest-ServerAddressesNegativeTestJSON-2002096545-project] validate_networks() for [('5f49e043-10ac-4de4-97b2-afa24a1b58c7', None, None, None, None, None)] {{(pid=138744) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 21:01:37.484262 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-786d0da0-e1ba-4797-bbbe-4763f7bed747 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Flavor limits 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 21:01:37.485243 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-786d0da0-e1ba-4797-bbbe-4763f7bed747 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Image limits 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 21:01:37.486584 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-786d0da0-e1ba-4797-bbbe-4763f7bed747 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Flavor pref 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 21:01:37.487211 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-786d0da0-e1ba-4797-bbbe-4763f7bed747 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Image pref 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 21:01:37.487819 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-786d0da0-e1ba-4797-bbbe-4763f7bed747 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 21:01:37.515597 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-786d0da0-e1ba-4797-bbbe-4763f7bed747 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:01:37.516455 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-786d0da0-e1ba-4797-bbbe-4763f7bed747 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:01:37.517144 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-786d0da0-e1ba-4797-bbbe-4763f7bed747 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:01:37.519035 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-786d0da0-e1ba-4797-bbbe-4763f7bed747 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:01:37.519802 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-786d0da0-e1ba-4797-bbbe-4763f7bed747 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:01:37.520471 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-786d0da0-e1ba-4797-bbbe-4763f7bed747 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:01:37.548803 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-786d0da0-e1ba-4797-bbbe-4763f7bed747 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Getting quotas for project b4cd7873d6db4e09bc9ab9a048a6b1ef. Resources: {'cores', 'instances', 'ram'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 21:01:37.563712 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-786d0da0-e1ba-4797-bbbe-4763f7bed747 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Getting quotas for user be1b410a64e0415a96d30f5040361137 and project b4cd7873d6db4e09bc9ab9a048a6b1ef. Resources: {'cores', 'instances', 'ram'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 21:01:37.595687 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-786d0da0-e1ba-4797-bbbe-4763f7bed747 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Going to run 1 instances... {{(pid=138745) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 21:01:37.598477 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-786d0da0-e1ba-4797-bbbe-4763f7bed747 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] [instance: 321b545b-7228-4a30-bd7b-dcd827a0c747] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='085e4478-6edc-4a69-8e08-f9831713eb65',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138745) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 21:01:37.714836 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-786d0da0-e1ba-4797-bbbe-4763f7bed747 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.598723 Oct 22 21:01:37.719927 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1430/2734] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Oct 22 21:01:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 1604 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 21:01:37.736022 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-c8818f4d-e50a-47b3-b400-b23617667a06 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Calling method '.version_select at 0x7fd39fd7baf0>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:01:37.811556 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-c8818f4d-e50a-47b3-b400-b23617667a06 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] 10.222.0.18 "GET /compute/v2.1/images/e8a48405-7084-4515-a1fe-96c425df5e47" status: 200 len: 1454 microversion: 2.1 time: 0.087675 Oct 22 21:01:37.812722 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1431/2735] 10.222.0.18 () {58 vars in 1233 bytes} [Sat Oct 22 21:01:37 2022] GET /compute/v2.1/images/e8a48405-7084-4515-a1fe-96c425df5e47 => generated 1454 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:01:37.821039 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-c563d7b2-9d4f-47ed-bfc8-507215c94f37 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:01:37.822092 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-c563d7b2-9d4f-47ed-bfc8-507215c94f37 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] [instance: 9c2729a5-e874-43e7-a372-514906975851] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:01:37.831289 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c563d7b2-9d4f-47ed-bfc8-507215c94f37 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:01:37.832204 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c563d7b2-9d4f-47ed-bfc8-507215c94f37 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:01:37.832883 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c563d7b2-9d4f-47ed-bfc8-507215c94f37 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:01:37.833966 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c563d7b2-9d4f-47ed-bfc8-507215c94f37 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:01:37.834674 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c563d7b2-9d4f-47ed-bfc8-507215c94f37 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:01:37.835654 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c563d7b2-9d4f-47ed-bfc8-507215c94f37 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:01:39.347318 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-024769c2-7a90-4b3b-9ae5-25c193ae6e1d tempest-ServerAddressesNegativeTestJSON-2002096545 tempest-ServerAddressesNegativeTestJSON-2002096545-project] Flavor limits 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 21:01:39.348417 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-024769c2-7a90-4b3b-9ae5-25c193ae6e1d tempest-ServerAddressesNegativeTestJSON-2002096545 tempest-ServerAddressesNegativeTestJSON-2002096545-project] Image limits 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 21:01:39.349339 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-024769c2-7a90-4b3b-9ae5-25c193ae6e1d tempest-ServerAddressesNegativeTestJSON-2002096545 tempest-ServerAddressesNegativeTestJSON-2002096545-project] Flavor pref 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 21:01:39.349955 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-024769c2-7a90-4b3b-9ae5-25c193ae6e1d tempest-ServerAddressesNegativeTestJSON-2002096545 tempest-ServerAddressesNegativeTestJSON-2002096545-project] Image pref 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 21:01:39.350078 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-c563d7b2-9d4f-47ed-bfc8-507215c94f37 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a44ff8e7c14b94b1670f030085c43d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a26a2284f4424cbeaf63d504652546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:01:39.351882 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-024769c2-7a90-4b3b-9ae5-25c193ae6e1d tempest-ServerAddressesNegativeTestJSON-2002096545 tempest-ServerAddressesNegativeTestJSON-2002096545-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 21:01:39.362581 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-c563d7b2-9d4f-47ed-bfc8-507215c94f37 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] 10.222.0.18 "GET /compute/v2.1/servers/9c2729a5-e874-43e7-a372-514906975851" status: 200 len: 1308 microversion: 2.1 time: 1.548230 Oct 22 21:01:39.364108 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1432/2736] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:01:37 2022] GET /compute/v2.1/servers/9c2729a5-e874-43e7-a372-514906975851 => generated 1308 bytes in 1550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:01:39.371262 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-a7c2b213-a1b4-4233-97b9-f0ac07131103 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:01:39.372391 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-a7c2b213-a1b4-4233-97b9-f0ac07131103 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] [instance: 321b545b-7228-4a30-bd7b-dcd827a0c747] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:01:39.379334 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-024769c2-7a90-4b3b-9ae5-25c193ae6e1d tempest-ServerAddressesNegativeTestJSON-2002096545 tempest-ServerAddressesNegativeTestJSON-2002096545-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:01:39.379933 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a7c2b213-a1b4-4233-97b9-f0ac07131103 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:01:39.380658 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a7c2b213-a1b4-4233-97b9-f0ac07131103 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:01:39.381925 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a7c2b213-a1b4-4233-97b9-f0ac07131103 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:01:39.382840 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a7c2b213-a1b4-4233-97b9-f0ac07131103 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:01:39.384828 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a7c2b213-a1b4-4233-97b9-f0ac07131103 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:01:39.385750 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a7c2b213-a1b4-4233-97b9-f0ac07131103 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:01:39.391910 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-024769c2-7a90-4b3b-9ae5-25c193ae6e1d tempest-ServerAddressesNegativeTestJSON-2002096545 tempest-ServerAddressesNegativeTestJSON-2002096545-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:01:39.392493 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-024769c2-7a90-4b3b-9ae5-25c193ae6e1d tempest-ServerAddressesNegativeTestJSON-2002096545 tempest-ServerAddressesNegativeTestJSON-2002096545-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:01:39.399539 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-024769c2-7a90-4b3b-9ae5-25c193ae6e1d tempest-ServerAddressesNegativeTestJSON-2002096545 tempest-ServerAddressesNegativeTestJSON-2002096545-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:01:39.400141 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-024769c2-7a90-4b3b-9ae5-25c193ae6e1d tempest-ServerAddressesNegativeTestJSON-2002096545 tempest-ServerAddressesNegativeTestJSON-2002096545-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:01:39.400603 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-024769c2-7a90-4b3b-9ae5-25c193ae6e1d tempest-ServerAddressesNegativeTestJSON-2002096545 tempest-ServerAddressesNegativeTestJSON-2002096545-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:01:39.461527 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-024769c2-7a90-4b3b-9ae5-25c193ae6e1d tempest-ServerAddressesNegativeTestJSON-2002096545 tempest-ServerAddressesNegativeTestJSON-2002096545-project] Getting quotas for project 40e6cd40d3b74efcac7bd16343591315. Resources: {'cores', 'instances', 'ram'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 21:01:39.482775 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-024769c2-7a90-4b3b-9ae5-25c193ae6e1d tempest-ServerAddressesNegativeTestJSON-2002096545 tempest-ServerAddressesNegativeTestJSON-2002096545-project] Getting quotas for user 03056f5218a647eead4192537f66a504 and project 40e6cd40d3b74efcac7bd16343591315. Resources: {'cores', 'instances', 'ram'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 21:01:39.521401 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-a7c2b213-a1b4-4233-97b9-f0ac07131103 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1b410a64e0415a96d30f5040361137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd7873d6db4e09bc9ab9a048a6b1ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:01:39.521620 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-024769c2-7a90-4b3b-9ae5-25c193ae6e1d tempest-ServerAddressesNegativeTestJSON-2002096545 tempest-ServerAddressesNegativeTestJSON-2002096545-project] Going to run 1 instances... {{(pid=138744) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 21:01:39.537109 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-a7c2b213-a1b4-4233-97b9-f0ac07131103 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] 10.222.0.18 "GET /compute/v2.1/servers/321b545b-7228-4a30-bd7b-dcd827a0c747" status: 200 len: 1267 microversion: 2.1 time: 0.171642 Oct 22 21:01:39.554646 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-024769c2-7a90-4b3b-9ae5-25c193ae6e1d tempest-ServerAddressesNegativeTestJSON-2002096545 tempest-ServerAddressesNegativeTestJSON-2002096545-project] [instance: 5756e075-671a-41ca-b637-52fa8187643c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='085e4478-6edc-4a69-8e08-f9831713eb65',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138744) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 21:01:39.576040 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1433/2737] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:01:39 2022] GET /compute/v2.1/servers/321b545b-7228-4a30-bd7b-dcd827a0c747 => generated 1267 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:01:39.581871 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-8a15c8be-7882-4ec9-b808-2a8ba4da73d6 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:01:39.589331 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-8a15c8be-7882-4ec9-b808-2a8ba4da73d6 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] [instance: 2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:01:39.622805 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8a15c8be-7882-4ec9-b808-2a8ba4da73d6 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:01:39.624424 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8a15c8be-7882-4ec9-b808-2a8ba4da73d6 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:01:39.629578 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8a15c8be-7882-4ec9-b808-2a8ba4da73d6 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:01:39.665833 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8a15c8be-7882-4ec9-b808-2a8ba4da73d6 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:01:39.668200 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8a15c8be-7882-4ec9-b808-2a8ba4da73d6 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:01:39.669017 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8a15c8be-7882-4ec9-b808-2a8ba4da73d6 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:01:39.681432 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-024769c2-7a90-4b3b-9ae5-25c193ae6e1d tempest-ServerAddressesNegativeTestJSON-2002096545 tempest-ServerAddressesNegativeTestJSON-2002096545-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.745240 Oct 22 21:01:39.682517 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1305/2738] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Oct 22 21:01:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 2747 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 21:01:39.696787 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-69956fdd-c38e-4f50-a811-6d2c67d0af5c tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Calling method '.version_select at 0x7fd39f135700>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:01:39.851399 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-69956fdd-c38e-4f50-a811-6d2c67d0af5c tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] 10.222.0.18 "GET /compute/v2.1/images/e8a48405-7084-4515-a1fe-96c425df5e47" status: 200 len: 1454 microversion: 2.1 time: 0.166330 Oct 22 21:01:39.852476 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1306/2739] 10.222.0.18 () {58 vars in 1233 bytes} [Sat Oct 22 21:01:39 2022] GET /compute/v2.1/images/e8a48405-7084-4515-a1fe-96c425df5e47 => generated 1454 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:01:39.860941 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-5b38a90d-6bee-4450-8a61-a1a948e7ee62 tempest-ServerAddressesNegativeTestJSON-2002096545 tempest-ServerAddressesNegativeTestJSON-2002096545-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:01:39.862490 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-5b38a90d-6bee-4450-8a61-a1a948e7ee62 tempest-ServerAddressesNegativeTestJSON-2002096545 tempest-ServerAddressesNegativeTestJSON-2002096545-project] [instance: 5756e075-671a-41ca-b637-52fa8187643c] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:01:40.114193 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-8a15c8be-7882-4ec9-b808-2a8ba4da73d6 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:01:40.138393 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-8a15c8be-7882-4ec9-b808-2a8ba4da73d6 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:01:40.152652 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-8a15c8be-7882-4ec9-b808-2a8ba4da73d6 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:01:40.188420 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-8a15c8be-7882-4ec9-b808-2a8ba4da73d6 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] 10.222.0.18 "GET /compute/v2.1/servers/2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac" status: 200 len: 1539 microversion: 2.91 time: 0.608968 Oct 22 21:01:40.189663 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1434/2740] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:01:39 2022] GET /compute/v2.1/servers/2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac => generated 1539 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:01:40.315190 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-5b38a90d-6bee-4450-8a61-a1a948e7ee62 tempest-ServerAddressesNegativeTestJSON-2002096545 tempest-ServerAddressesNegativeTestJSON-2002096545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03056f5218a647eead4192537f66a504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40e6cd40d3b74efcac7bd16343591315', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:01:40.329326 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-5b38a90d-6bee-4450-8a61-a1a948e7ee62 tempest-ServerAddressesNegativeTestJSON-2002096545 tempest-ServerAddressesNegativeTestJSON-2002096545-project] 10.222.0.18 "GET /compute/v2.1/servers/5756e075-671a-41ca-b637-52fa8187643c" status: 200 len: 1225 microversion: 2.1 time: 0.475532 Oct 22 21:01:40.339044 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1307/2741] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:01:39 2022] GET /compute/v2.1/servers/5756e075-671a-41ca-b637-52fa8187643c => generated 1225 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:01:40.390133 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-bceaa74a-7baa-44ab-9391-b2ae80ddc03b tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:01:40.390763 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-bceaa74a-7baa-44ab-9391-b2ae80ddc03b tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] [instance: 9c2729a5-e874-43e7-a372-514906975851] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:01:40.410006 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bceaa74a-7baa-44ab-9391-b2ae80ddc03b tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:01:40.410879 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bceaa74a-7baa-44ab-9391-b2ae80ddc03b tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:01:40.412060 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bceaa74a-7baa-44ab-9391-b2ae80ddc03b tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:01:40.415658 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bceaa74a-7baa-44ab-9391-b2ae80ddc03b tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:01:40.417451 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bceaa74a-7baa-44ab-9391-b2ae80ddc03b tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:01:40.418422 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bceaa74a-7baa-44ab-9391-b2ae80ddc03b tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:01:40.564629 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-4f9e1b29-9dc5-4d8f-b299-824183143ce5 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:01:40.565298 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-4f9e1b29-9dc5-4d8f-b299-824183143ce5 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] [instance: 321b545b-7228-4a30-bd7b-dcd827a0c747] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:01:40.575730 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4f9e1b29-9dc5-4d8f-b299-824183143ce5 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:01:40.576485 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4f9e1b29-9dc5-4d8f-b299-824183143ce5 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:01:40.577115 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4f9e1b29-9dc5-4d8f-b299-824183143ce5 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:01:40.578690 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4f9e1b29-9dc5-4d8f-b299-824183143ce5 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:01:40.579464 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4f9e1b29-9dc5-4d8f-b299-824183143ce5 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:01:40.580248 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4f9e1b29-9dc5-4d8f-b299-824183143ce5 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:01:40.886385 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-bceaa74a-7baa-44ab-9391-b2ae80ddc03b tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a44ff8e7c14b94b1670f030085c43d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a26a2284f4424cbeaf63d504652546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:01:40.900451 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-bceaa74a-7baa-44ab-9391-b2ae80ddc03b tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] 10.222.0.18 "GET /compute/v2.1/servers/9c2729a5-e874-43e7-a372-514906975851" status: 200 len: 1308 microversion: 2.1 time: 0.517440 Oct 22 21:01:40.905057 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-4f9e1b29-9dc5-4d8f-b299-824183143ce5 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1b410a64e0415a96d30f5040361137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd7873d6db4e09bc9ab9a048a6b1ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:01:40.933216 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1435/2742] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:01:40 2022] GET /compute/v2.1/servers/9c2729a5-e874-43e7-a372-514906975851 => generated 1308 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:01:40.941033 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-b5fda30a-048a-49fb-a6ef-dec3789a34a4 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Calling method '.version_select at 0x7fd39f06fd30>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:01:40.943840 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-4f9e1b29-9dc5-4d8f-b299-824183143ce5 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] 10.222.0.18 "GET /compute/v2.1/servers/321b545b-7228-4a30-bd7b-dcd827a0c747" status: 200 len: 1273 microversion: 2.1 time: 0.382546 Oct 22 21:01:40.950346 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1308/2743] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:01:40 2022] GET /compute/v2.1/servers/321b545b-7228-4a30-bd7b-dcd827a0c747 => generated 1273 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:01:41.040075 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-b5fda30a-048a-49fb-a6ef-dec3789a34a4 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] 10.222.0.18 "GET /compute/v2.1/images/e8a48405-7084-4515-a1fe-96c425df5e47" status: 200 len: 1454 microversion: 2.1 time: 0.104849 Oct 22 21:01:41.050343 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1436/2744] 10.222.0.18 () {58 vars in 1233 bytes} [Sat Oct 22 21:01:40 2022] GET /compute/v2.1/images/e8a48405-7084-4515-a1fe-96c425df5e47 => generated 1454 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:01:41.217485 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-cfd69ae7-eadd-4247-bf85-e0798f92dbc6 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:01:41.217997 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-cfd69ae7-eadd-4247-bf85-e0798f92dbc6 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] [instance: 2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:01:41.248625 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cfd69ae7-eadd-4247-bf85-e0798f92dbc6 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:01:41.249235 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cfd69ae7-eadd-4247-bf85-e0798f92dbc6 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:01:41.249524 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cfd69ae7-eadd-4247-bf85-e0798f92dbc6 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:01:41.255297 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cfd69ae7-eadd-4247-bf85-e0798f92dbc6 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:01:41.256506 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cfd69ae7-eadd-4247-bf85-e0798f92dbc6 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:01:41.257284 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cfd69ae7-eadd-4247-bf85-e0798f92dbc6 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:01:41.355404 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-ad320e6a-2d60-4f06-a42e-8842a2369a3c tempest-ServerAddressesNegativeTestJSON-2002096545 tempest-ServerAddressesNegativeTestJSON-2002096545-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:01:41.356039 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-ad320e6a-2d60-4f06-a42e-8842a2369a3c tempest-ServerAddressesNegativeTestJSON-2002096545 tempest-ServerAddressesNegativeTestJSON-2002096545-project] [instance: 5756e075-671a-41ca-b637-52fa8187643c] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:01:41.379248 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ad320e6a-2d60-4f06-a42e-8842a2369a3c tempest-ServerAddressesNegativeTestJSON-2002096545 tempest-ServerAddressesNegativeTestJSON-2002096545-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:01:41.379892 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ad320e6a-2d60-4f06-a42e-8842a2369a3c tempest-ServerAddressesNegativeTestJSON-2002096545 tempest-ServerAddressesNegativeTestJSON-2002096545-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:01:41.380353 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ad320e6a-2d60-4f06-a42e-8842a2369a3c tempest-ServerAddressesNegativeTestJSON-2002096545 tempest-ServerAddressesNegativeTestJSON-2002096545-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:01:41.381190 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ad320e6a-2d60-4f06-a42e-8842a2369a3c tempest-ServerAddressesNegativeTestJSON-2002096545 tempest-ServerAddressesNegativeTestJSON-2002096545-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:01:41.381754 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ad320e6a-2d60-4f06-a42e-8842a2369a3c tempest-ServerAddressesNegativeTestJSON-2002096545 tempest-ServerAddressesNegativeTestJSON-2002096545-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:01:41.388491 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ad320e6a-2d60-4f06-a42e-8842a2369a3c tempest-ServerAddressesNegativeTestJSON-2002096545 tempest-ServerAddressesNegativeTestJSON-2002096545-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:01:41.602041 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-cfd69ae7-eadd-4247-bf85-e0798f92dbc6 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:01:41.606962 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-ad320e6a-2d60-4f06-a42e-8842a2369a3c tempest-ServerAddressesNegativeTestJSON-2002096545 tempest-ServerAddressesNegativeTestJSON-2002096545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03056f5218a647eead4192537f66a504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40e6cd40d3b74efcac7bd16343591315', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:01:41.622523 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-cfd69ae7-eadd-4247-bf85-e0798f92dbc6 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:01:41.623926 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-ad320e6a-2d60-4f06-a42e-8842a2369a3c tempest-ServerAddressesNegativeTestJSON-2002096545 tempest-ServerAddressesNegativeTestJSON-2002096545-project] 10.222.0.18 "GET /compute/v2.1/servers/5756e075-671a-41ca-b637-52fa8187643c" status: 200 len: 1229 microversion: 2.1 time: 0.271335 Oct 22 21:01:41.624323 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-cfd69ae7-eadd-4247-bf85-e0798f92dbc6 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:01:41.626888 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1437/2745] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:01:41 2022] GET /compute/v2.1/servers/5756e075-671a-41ca-b637-52fa8187643c => generated 1229 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:01:41.656425 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-cfd69ae7-eadd-4247-bf85-e0798f92dbc6 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] 10.222.0.18 "GET /compute/v2.1/servers/2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac" status: 200 len: 1539 microversion: 2.91 time: 0.443526 Oct 22 21:01:41.661053 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1309/2746] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:01:41 2022] GET /compute/v2.1/servers/2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac => generated 1539 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:01:41.687144 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-9aab0ad7-c349-4147-a109-983a5ee9e339 req-07fd024d-a386-4400-a471-6f6530a66e6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c2729a5-e874-43e7-a372-514906975851", "name": "network-vif-plugged", "status": "completed", "tag": "7e49313e-bdb0-486a-bc1c-7bf140752a97"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:01:41.714064 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-9aab0ad7-c349-4147-a109-983a5ee9e339 req-07fd024d-a386-4400-a471-6f6530a66e6d service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:01:41.715649 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-9aab0ad7-c349-4147-a109-983a5ee9e339 req-07fd024d-a386-4400-a471-6f6530a66e6d service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:01:41.716619 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-9aab0ad7-c349-4147-a109-983a5ee9e339 req-07fd024d-a386-4400-a471-6f6530a66e6d service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:01:41.752894 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-9aab0ad7-c349-4147-a109-983a5ee9e339 req-07fd024d-a386-4400-a471-6f6530a66e6d service nova] Creating event network-vif-plugged:7e49313e-bdb0-486a-bc1c-7bf140752a97 for instance 9c2729a5-e874-43e7-a372-514906975851 on nch2-master-1 Oct 22 21:01:41.764825 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-9aab0ad7-c349-4147-a109-983a5ee9e339 req-07fd024d-a386-4400-a471-6f6530a66e6d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133827 Oct 22 21:01:41.768918 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1438/2747] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:01:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:01:41.941249 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-47b26f2c-4689-4b27-a6ae-a128e8002030 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:01:41.942236 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-47b26f2c-4689-4b27-a6ae-a128e8002030 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] [instance: 9c2729a5-e874-43e7-a372-514906975851] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:01:41.953899 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-47b26f2c-4689-4b27-a6ae-a128e8002030 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:01:41.956759 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-47b26f2c-4689-4b27-a6ae-a128e8002030 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:01:41.957467 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-47b26f2c-4689-4b27-a6ae-a128e8002030 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:01:41.958358 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-47b26f2c-4689-4b27-a6ae-a128e8002030 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:01:41.959305 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-47b26f2c-4689-4b27-a6ae-a128e8002030 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:01:41.960223 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-47b26f2c-4689-4b27-a6ae-a128e8002030 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:01:41.985730 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-4213cc02-0462-4dd9-a039-8018aa12c879 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:01:41.990270 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-4213cc02-0462-4dd9-a039-8018aa12c879 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] [instance: 321b545b-7228-4a30-bd7b-dcd827a0c747] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:01:42.015976 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4213cc02-0462-4dd9-a039-8018aa12c879 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:01:42.019994 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4213cc02-0462-4dd9-a039-8018aa12c879 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:01:42.021929 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4213cc02-0462-4dd9-a039-8018aa12c879 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:01:42.026727 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4213cc02-0462-4dd9-a039-8018aa12c879 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:01:42.034112 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4213cc02-0462-4dd9-a039-8018aa12c879 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:01:42.036605 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4213cc02-0462-4dd9-a039-8018aa12c879 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:01:42.470831 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-4213cc02-0462-4dd9-a039-8018aa12c879 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1b410a64e0415a96d30f5040361137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd7873d6db4e09bc9ab9a048a6b1ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:01:42.504878 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-4213cc02-0462-4dd9-a039-8018aa12c879 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] 10.222.0.18 "GET /compute/v2.1/servers/321b545b-7228-4a30-bd7b-dcd827a0c747" status: 200 len: 1273 microversion: 2.1 time: 0.526728 Oct 22 21:01:42.508515 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1439/2748] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:01:41 2022] GET /compute/v2.1/servers/321b545b-7228-4a30-bd7b-dcd827a0c747 => generated 1273 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:01:42.522367 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-a35ead45-2ad1-47e6-b11f-163d48875b58 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Calling method '.version_select at 0x7fd39fbfe9d0>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:01:42.668867 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-a35ead45-2ad1-47e6-b11f-163d48875b58 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] 10.222.0.18 "GET /compute/v2.1/images/e8a48405-7084-4515-a1fe-96c425df5e47" status: 200 len: 1454 microversion: 2.1 time: 0.158276 Oct 22 21:01:42.679748 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1440/2749] 10.222.0.18 () {58 vars in 1233 bytes} [Sat Oct 22 21:01:42 2022] GET /compute/v2.1/images/e8a48405-7084-4515-a1fe-96c425df5e47 => generated 1454 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:01:42.708536 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-9e30d021-3cf9-49d6-879b-9625c6998eca tempest-ServerAddressesNegativeTestJSON-2002096545 tempest-ServerAddressesNegativeTestJSON-2002096545-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:01:42.708536 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-9e30d021-3cf9-49d6-879b-9625c6998eca tempest-ServerAddressesNegativeTestJSON-2002096545 tempest-ServerAddressesNegativeTestJSON-2002096545-project] [instance: 5756e075-671a-41ca-b637-52fa8187643c] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:01:42.733110 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9e30d021-3cf9-49d6-879b-9625c6998eca tempest-ServerAddressesNegativeTestJSON-2002096545 tempest-ServerAddressesNegativeTestJSON-2002096545-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:01:42.733878 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9e30d021-3cf9-49d6-879b-9625c6998eca tempest-ServerAddressesNegativeTestJSON-2002096545 tempest-ServerAddressesNegativeTestJSON-2002096545-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:01:42.734509 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9e30d021-3cf9-49d6-879b-9625c6998eca tempest-ServerAddressesNegativeTestJSON-2002096545 tempest-ServerAddressesNegativeTestJSON-2002096545-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:01:42.736153 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9e30d021-3cf9-49d6-879b-9625c6998eca tempest-ServerAddressesNegativeTestJSON-2002096545 tempest-ServerAddressesNegativeTestJSON-2002096545-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:01:42.736808 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9e30d021-3cf9-49d6-879b-9625c6998eca tempest-ServerAddressesNegativeTestJSON-2002096545 tempest-ServerAddressesNegativeTestJSON-2002096545-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:01:42.737399 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9e30d021-3cf9-49d6-879b-9625c6998eca tempest-ServerAddressesNegativeTestJSON-2002096545 tempest-ServerAddressesNegativeTestJSON-2002096545-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:01:43.023275 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-9e30d021-3cf9-49d6-879b-9625c6998eca tempest-ServerAddressesNegativeTestJSON-2002096545 tempest-ServerAddressesNegativeTestJSON-2002096545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03056f5218a647eead4192537f66a504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40e6cd40d3b74efcac7bd16343591315', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:01:43.036099 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-9e30d021-3cf9-49d6-879b-9625c6998eca tempest-ServerAddressesNegativeTestJSON-2002096545 tempest-ServerAddressesNegativeTestJSON-2002096545-project] 10.222.0.18 "GET /compute/v2.1/servers/5756e075-671a-41ca-b637-52fa8187643c" status: 200 len: 1295 microversion: 2.1 time: 0.350574 Oct 22 21:01:43.036699 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1441/2750] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:01:42 2022] GET /compute/v2.1/servers/5756e075-671a-41ca-b637-52fa8187643c => generated 1295 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:01:43.068995 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-4c859059-f6fd-49ea-98e6-38414545c02f tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:01:43.069639 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-4c859059-f6fd-49ea-98e6-38414545c02f tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] [instance: 2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:01:43.080272 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4c859059-f6fd-49ea-98e6-38414545c02f tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:01:43.080789 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4c859059-f6fd-49ea-98e6-38414545c02f tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:01:43.081235 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4c859059-f6fd-49ea-98e6-38414545c02f tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:01:43.081976 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4c859059-f6fd-49ea-98e6-38414545c02f tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:01:43.082520 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4c859059-f6fd-49ea-98e6-38414545c02f tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:01:43.097562 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4c859059-f6fd-49ea-98e6-38414545c02f tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:01:43.193646 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-47b26f2c-4689-4b27-a6ae-a128e8002030 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a44ff8e7c14b94b1670f030085c43d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a26a2284f4424cbeaf63d504652546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:01:43.221953 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-47b26f2c-4689-4b27-a6ae-a128e8002030 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] 10.222.0.18 "GET /compute/v2.1/servers/9c2729a5-e874-43e7-a372-514906975851" status: 200 len: 1308 microversion: 2.1 time: 1.284876 Oct 22 21:01:43.228523 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1310/2751] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:01:41 2022] GET /compute/v2.1/servers/9c2729a5-e874-43e7-a372-514906975851 => generated 1308 bytes in 1294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:01:43.321346 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-4c859059-f6fd-49ea-98e6-38414545c02f tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:01:43.337319 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-4c859059-f6fd-49ea-98e6-38414545c02f tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:01:43.338822 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-4c859059-f6fd-49ea-98e6-38414545c02f tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:01:43.376970 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-4c859059-f6fd-49ea-98e6-38414545c02f tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] 10.222.0.18 "GET /compute/v2.1/servers/2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac" status: 200 len: 1539 microversion: 2.91 time: 0.318690 Oct 22 21:01:43.380721 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1442/2752] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:01:43 2022] GET /compute/v2.1/servers/2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac => generated 1539 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:01:43.539432 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-1282b4e8-9950-4f2f-b7e2-4de75eab07b9 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:01:43.542251 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-1282b4e8-9950-4f2f-b7e2-4de75eab07b9 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] [instance: 321b545b-7228-4a30-bd7b-dcd827a0c747] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:01:43.575329 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1282b4e8-9950-4f2f-b7e2-4de75eab07b9 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:01:43.576502 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1282b4e8-9950-4f2f-b7e2-4de75eab07b9 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:01:43.581174 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1282b4e8-9950-4f2f-b7e2-4de75eab07b9 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:01:43.582647 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1282b4e8-9950-4f2f-b7e2-4de75eab07b9 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:01:43.589970 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1282b4e8-9950-4f2f-b7e2-4de75eab07b9 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:01:43.591429 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1282b4e8-9950-4f2f-b7e2-4de75eab07b9 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:01:43.686295 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-e90d1dfe-5e2d-4661-ba36-b5f9ea67f08e tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Calling method '.version_select at 0x7fd39f05d550>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:01:43.765180 ncdv-master-1 devstack@n-api.service[138745]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 22 21:01:43.765650 ncdv-master-1 devstack@n-api.service[138745]: Sat Oct 22 21:01:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/images/e8a48405-7084-4515-a1fe-96c425df5e47 (ip 10.222.0.18) !!! Oct 22 21:01:43.804438 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-e90d1dfe-5e2d-4661-ba36-b5f9ea67f08e tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] 10.222.0.18 "GET /compute/v2.1/images/e8a48405-7084-4515-a1fe-96c425df5e47" status: 200 len: 1454 microversion: 2.1 time: 0.122261 Oct 22 21:01:43.805597 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1443/2753] 10.222.0.18 () {58 vars in 1233 bytes} [Sat Oct 22 21:01:43 2022] GET /compute/v2.1/images/e8a48405-7084-4515-a1fe-96c425df5e47 => generated 1454 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:01:44.080028 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-3cd64c0d-a343-48d9-86a0-9a51e64f3e89 tempest-ServerAddressesNegativeTestJSON-2002096545 tempest-ServerAddressesNegativeTestJSON-2002096545-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:01:44.083071 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-3cd64c0d-a343-48d9-86a0-9a51e64f3e89 tempest-ServerAddressesNegativeTestJSON-2002096545 tempest-ServerAddressesNegativeTestJSON-2002096545-project] [instance: 5756e075-671a-41ca-b637-52fa8187643c] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:01:44.114695 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3cd64c0d-a343-48d9-86a0-9a51e64f3e89 tempest-ServerAddressesNegativeTestJSON-2002096545 tempest-ServerAddressesNegativeTestJSON-2002096545-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:01:44.121785 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3cd64c0d-a343-48d9-86a0-9a51e64f3e89 tempest-ServerAddressesNegativeTestJSON-2002096545 tempest-ServerAddressesNegativeTestJSON-2002096545-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:01:44.124509 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3cd64c0d-a343-48d9-86a0-9a51e64f3e89 tempest-ServerAddressesNegativeTestJSON-2002096545 tempest-ServerAddressesNegativeTestJSON-2002096545-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:01:44.125985 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3cd64c0d-a343-48d9-86a0-9a51e64f3e89 tempest-ServerAddressesNegativeTestJSON-2002096545 tempest-ServerAddressesNegativeTestJSON-2002096545-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:01:44.129158 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3cd64c0d-a343-48d9-86a0-9a51e64f3e89 tempest-ServerAddressesNegativeTestJSON-2002096545 tempest-ServerAddressesNegativeTestJSON-2002096545-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:01:44.131192 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3cd64c0d-a343-48d9-86a0-9a51e64f3e89 tempest-ServerAddressesNegativeTestJSON-2002096545 tempest-ServerAddressesNegativeTestJSON-2002096545-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:01:44.274127 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-1282b4e8-9950-4f2f-b7e2-4de75eab07b9 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1b410a64e0415a96d30f5040361137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd7873d6db4e09bc9ab9a048a6b1ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:01:44.291941 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-1282b4e8-9950-4f2f-b7e2-4de75eab07b9 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] 10.222.0.18 "GET /compute/v2.1/servers/321b545b-7228-4a30-bd7b-dcd827a0c747" status: 200 len: 1315 microversion: 2.1 time: 0.760215 Oct 22 21:01:44.313354 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1311/2754] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:01:43 2022] GET /compute/v2.1/servers/321b545b-7228-4a30-bd7b-dcd827a0c747 => generated 1315 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:01:44.346941 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-4707b048-0271-47f6-a54f-5f4e96aa6ae4 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:01:44.354339 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-4707b048-0271-47f6-a54f-5f4e96aa6ae4 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] [instance: 9c2729a5-e874-43e7-a372-514906975851] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:01:44.377228 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4707b048-0271-47f6-a54f-5f4e96aa6ae4 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:01:44.377742 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4707b048-0271-47f6-a54f-5f4e96aa6ae4 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:01:44.378215 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4707b048-0271-47f6-a54f-5f4e96aa6ae4 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:01:44.385535 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4707b048-0271-47f6-a54f-5f4e96aa6ae4 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:01:44.386305 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4707b048-0271-47f6-a54f-5f4e96aa6ae4 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:01:44.388146 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4707b048-0271-47f6-a54f-5f4e96aa6ae4 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:01:44.490371 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-3cd64c0d-a343-48d9-86a0-9a51e64f3e89 tempest-ServerAddressesNegativeTestJSON-2002096545 tempest-ServerAddressesNegativeTestJSON-2002096545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03056f5218a647eead4192537f66a504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40e6cd40d3b74efcac7bd16343591315', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:01:44.526194 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-3cd64c0d-a343-48d9-86a0-9a51e64f3e89 tempest-ServerAddressesNegativeTestJSON-2002096545 tempest-ServerAddressesNegativeTestJSON-2002096545-project] 10.222.0.18 "GET /compute/v2.1/servers/5756e075-671a-41ca-b637-52fa8187643c" status: 200 len: 1283 microversion: 2.1 time: 0.450582 Oct 22 21:01:44.540588 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1444/2755] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:01:44 2022] GET /compute/v2.1/servers/5756e075-671a-41ca-b637-52fa8187643c => generated 1283 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:01:44.564910 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-998cb1af-83d2-4895-b195-4848664346ab tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:01:44.571291 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-998cb1af-83d2-4895-b195-4848664346ab tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] [instance: 2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:01:44.587102 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-998cb1af-83d2-4895-b195-4848664346ab tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:01:44.590531 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-998cb1af-83d2-4895-b195-4848664346ab tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:01:44.591220 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-998cb1af-83d2-4895-b195-4848664346ab tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:01:44.593393 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-998cb1af-83d2-4895-b195-4848664346ab tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:01:44.595900 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-998cb1af-83d2-4895-b195-4848664346ab tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:01:44.597890 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-998cb1af-83d2-4895-b195-4848664346ab tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:01:44.970268 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-998cb1af-83d2-4895-b195-4848664346ab tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:01:44.989974 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-998cb1af-83d2-4895-b195-4848664346ab tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:01:44.997464 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-998cb1af-83d2-4895-b195-4848664346ab tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:01:45.014039 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-998cb1af-83d2-4895-b195-4848664346ab tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] 10.222.0.18 "GET /compute/v2.1/servers/2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac" status: 200 len: 1539 microversion: 2.91 time: 0.470960 Oct 22 21:01:45.017802 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1445/2756] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:01:44 2022] GET /compute/v2.1/servers/2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac => generated 1539 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:01:45.038359 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-21ec993a-549a-44f9-8c45-48791d5b9592 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Calling method '.version_select at 0x7fd39f072ee0>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:01:45.091960 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-4707b048-0271-47f6-a54f-5f4e96aa6ae4 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a44ff8e7c14b94b1670f030085c43d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a26a2284f4424cbeaf63d504652546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:01:45.123055 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-4707b048-0271-47f6-a54f-5f4e96aa6ae4 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] 10.222.0.18 "GET /compute/v2.1/servers/9c2729a5-e874-43e7-a372-514906975851" status: 200 len: 1489 microversion: 2.1 time: 0.791475 Oct 22 21:01:45.126117 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1312/2757] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:01:44 2022] GET /compute/v2.1/servers/9c2729a5-e874-43e7-a372-514906975851 => generated 1489 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:01:45.160667 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-28f76a96-edba-47ea-8bcc-5aedc0729d30 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:01:45.180879 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-28f76a96-edba-47ea-8bcc-5aedc0729d30 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:01:45.189686 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-21ec993a-549a-44f9-8c45-48791d5b9592 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] 10.222.0.18 "GET /compute/v2.1/images/e8a48405-7084-4515-a1fe-96c425df5e47" status: 200 len: 1454 microversion: 2.1 time: 0.170460 Oct 22 21:01:45.190153 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-28f76a96-edba-47ea-8bcc-5aedc0729d30 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:01:45.191073 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-28f76a96-edba-47ea-8bcc-5aedc0729d30 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:01:45.204110 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1446/2758] 10.222.0.18 () {58 vars in 1233 bytes} [Sat Oct 22 21:01:45 2022] GET /compute/v2.1/images/e8a48405-7084-4515-a1fe-96c425df5e47 => generated 1454 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:01:45.321717 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-eb1eaba0-1669-4a2e-86b7-2731753643ee tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:01:45.322492 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-eb1eaba0-1669-4a2e-86b7-2731753643ee tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] [instance: 321b545b-7228-4a30-bd7b-dcd827a0c747] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:01:45.339979 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-eb1eaba0-1669-4a2e-86b7-2731753643ee tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:01:45.340778 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-eb1eaba0-1669-4a2e-86b7-2731753643ee tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:01:45.341634 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-eb1eaba0-1669-4a2e-86b7-2731753643ee tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:01:45.343303 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-eb1eaba0-1669-4a2e-86b7-2731753643ee tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:01:45.348834 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-eb1eaba0-1669-4a2e-86b7-2731753643ee tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:01:45.349503 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-eb1eaba0-1669-4a2e-86b7-2731753643ee tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:01:45.420904 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-28f76a96-edba-47ea-8bcc-5aedc0729d30 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] [instance: 9c2729a5-e874-43e7-a372-514906975851] Going to try to stop instance {{(pid=138744) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 22 21:01:45.611509 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-28f76a96-edba-47ea-8bcc-5aedc0729d30 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] 10.222.0.18 "POST /compute/v2.1/servers/9c2729a5-e874-43e7-a372-514906975851/action" status: 202 len: 0 microversion: 2.1 time: 0.457413 Oct 22 21:01:45.613404 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1313/2759] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 21:01:45 2022] POST /compute/v2.1/servers/9c2729a5-e874-43e7-a372-514906975851/action => generated 0 bytes in 461 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 22 21:01:45.629067 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-f9eece65-6b05-4f1d-aeae-10ae20aaf58e tempest-ServerAddressesNegativeTestJSON-2002096545 tempest-ServerAddressesNegativeTestJSON-2002096545-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:01:45.629809 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-f9eece65-6b05-4f1d-aeae-10ae20aaf58e tempest-ServerAddressesNegativeTestJSON-2002096545 tempest-ServerAddressesNegativeTestJSON-2002096545-project] [instance: 5756e075-671a-41ca-b637-52fa8187643c] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:01:45.657618 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f9eece65-6b05-4f1d-aeae-10ae20aaf58e tempest-ServerAddressesNegativeTestJSON-2002096545 tempest-ServerAddressesNegativeTestJSON-2002096545-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:01:45.662519 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f9eece65-6b05-4f1d-aeae-10ae20aaf58e tempest-ServerAddressesNegativeTestJSON-2002096545 tempest-ServerAddressesNegativeTestJSON-2002096545-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:01:45.663025 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f9eece65-6b05-4f1d-aeae-10ae20aaf58e tempest-ServerAddressesNegativeTestJSON-2002096545 tempest-ServerAddressesNegativeTestJSON-2002096545-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:01:45.667313 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f9eece65-6b05-4f1d-aeae-10ae20aaf58e tempest-ServerAddressesNegativeTestJSON-2002096545 tempest-ServerAddressesNegativeTestJSON-2002096545-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:01:45.671444 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f9eece65-6b05-4f1d-aeae-10ae20aaf58e tempest-ServerAddressesNegativeTestJSON-2002096545 tempest-ServerAddressesNegativeTestJSON-2002096545-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:01:45.673670 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f9eece65-6b05-4f1d-aeae-10ae20aaf58e tempest-ServerAddressesNegativeTestJSON-2002096545 tempest-ServerAddressesNegativeTestJSON-2002096545-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:01:46.094103 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-eb1eaba0-1669-4a2e-86b7-2731753643ee tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1b410a64e0415a96d30f5040361137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd7873d6db4e09bc9ab9a048a6b1ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:01:46.116904 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-eb1eaba0-1669-4a2e-86b7-2731753643ee tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] 10.222.0.18 "GET /compute/v2.1/servers/321b545b-7228-4a30-bd7b-dcd827a0c747" status: 200 len: 1315 microversion: 2.1 time: 0.798598 Oct 22 21:01:46.117561 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1447/2760] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:01:45 2022] GET /compute/v2.1/servers/321b545b-7228-4a30-bd7b-dcd827a0c747 => generated 1315 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:01:46.121642 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-f9eece65-6b05-4f1d-aeae-10ae20aaf58e tempest-ServerAddressesNegativeTestJSON-2002096545 tempest-ServerAddressesNegativeTestJSON-2002096545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03056f5218a647eead4192537f66a504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40e6cd40d3b74efcac7bd16343591315', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:01:46.136768 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-f9eece65-6b05-4f1d-aeae-10ae20aaf58e tempest-ServerAddressesNegativeTestJSON-2002096545 tempest-ServerAddressesNegativeTestJSON-2002096545-project] 10.222.0.18 "GET /compute/v2.1/servers/5756e075-671a-41ca-b637-52fa8187643c" status: 200 len: 1283 microversion: 2.1 time: 0.517724 Oct 22 21:01:46.139263 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1314/2761] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:01:45 2022] GET /compute/v2.1/servers/5756e075-671a-41ca-b637-52fa8187643c => generated 1283 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:01:46.143710 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-89246b07-5eba-46ab-90f8-cda0bd718cf2 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:01:46.148882 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-89246b07-5eba-46ab-90f8-cda0bd718cf2 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] [instance: 9c2729a5-e874-43e7-a372-514906975851] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:01:46.161939 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-ac657828-41be-4924-a830-09007ae8139b tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:01:46.175678 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-ac657828-41be-4924-a830-09007ae8139b tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] [instance: 2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:01:46.189203 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-89246b07-5eba-46ab-90f8-cda0bd718cf2 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:01:46.191590 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-89246b07-5eba-46ab-90f8-cda0bd718cf2 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:01:46.195823 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-89246b07-5eba-46ab-90f8-cda0bd718cf2 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:01:46.196746 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-89246b07-5eba-46ab-90f8-cda0bd718cf2 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:01:46.197976 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-89246b07-5eba-46ab-90f8-cda0bd718cf2 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:01:46.202975 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-89246b07-5eba-46ab-90f8-cda0bd718cf2 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:01:46.213083 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ac657828-41be-4924-a830-09007ae8139b tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:01:46.216332 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ac657828-41be-4924-a830-09007ae8139b tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:01:46.217931 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ac657828-41be-4924-a830-09007ae8139b tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:01:46.219882 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ac657828-41be-4924-a830-09007ae8139b tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:01:46.221578 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ac657828-41be-4924-a830-09007ae8139b tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:01:46.222434 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ac657828-41be-4924-a830-09007ae8139b tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:01:46.413629 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-ac657828-41be-4924-a830-09007ae8139b tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:01:46.421075 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:01:46.433012 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-ac657828-41be-4924-a830-09007ae8139b tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:01:46.434605 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-ac657828-41be-4924-a830-09007ae8139b tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:01:46.458866 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-ac657828-41be-4924-a830-09007ae8139b tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] 10.222.0.18 "GET /compute/v2.1/servers/2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac" status: 200 len: 1539 microversion: 2.91 time: 0.310080 Oct 22 21:01:46.460204 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1315/2762] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:01:46 2022] GET /compute/v2.1/servers/2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac => generated 1539 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:01:46.473662 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-dcc3fbfb-73c0-46c7-91d4-02dc173267fb tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Calling method '.version_select at 0x7fd39f331af0>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:01:46.577156 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-dcc3fbfb-73c0-46c7-91d4-02dc173267fb tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] 10.222.0.18 "GET /compute/v2.1/images/e8a48405-7084-4515-a1fe-96c425df5e47" status: 200 len: 1454 microversion: 2.1 time: 0.115644 Oct 22 21:01:46.577751 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1316/2763] 10.222.0.18 () {58 vars in 1233 bytes} [Sat Oct 22 21:01:46 2022] GET /compute/v2.1/images/e8a48405-7084-4515-a1fe-96c425df5e47 => generated 1454 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:01:46.610420 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-89246b07-5eba-46ab-90f8-cda0bd718cf2 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a44ff8e7c14b94b1670f030085c43d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a26a2284f4424cbeaf63d504652546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:01:46.627309 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-89246b07-5eba-46ab-90f8-cda0bd718cf2 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] 10.222.0.18 "GET /compute/v2.1/servers/9c2729a5-e874-43e7-a372-514906975851" status: 200 len: 1499 microversion: 2.1 time: 0.496509 Oct 22 21:01:46.629845 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1448/2764] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:01:46 2022] GET /compute/v2.1/servers/9c2729a5-e874-43e7-a372-514906975851 => generated 1499 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:01:46.919352 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-8ad14f79-bd7f-4c2d-b7a7-127faa53949f req-efccc6e2-43ec-453f-b543-fcaa3c779559 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "321b545b-7228-4a30-bd7b-dcd827a0c747", "tag": "3c32aabf-b19e-478d-8bdc-01ceb7dddb88"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:01:46.944968 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-8ad14f79-bd7f-4c2d-b7a7-127faa53949f req-efccc6e2-43ec-453f-b543-fcaa3c779559 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:01:46.945567 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-8ad14f79-bd7f-4c2d-b7a7-127faa53949f req-efccc6e2-43ec-453f-b543-fcaa3c779559 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:01:46.949867 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-8ad14f79-bd7f-4c2d-b7a7-127faa53949f req-efccc6e2-43ec-453f-b543-fcaa3c779559 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:01:46.981454 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-8ad14f79-bd7f-4c2d-b7a7-127faa53949f req-efccc6e2-43ec-453f-b543-fcaa3c779559 service nova] Creating event network-changed:3c32aabf-b19e-478d-8bdc-01ceb7dddb88 for instance 321b545b-7228-4a30-bd7b-dcd827a0c747 on nch1-master-1 Oct 22 21:01:46.992726 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-8ad14f79-bd7f-4c2d-b7a7-127faa53949f req-efccc6e2-43ec-453f-b543-fcaa3c779559 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075139 Oct 22 21:01:46.995803 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1317/2765] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:01:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:01:47.146465 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-107ab1d1-835c-492a-9f85-63b6c515ed08 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:01:47.147166 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-107ab1d1-835c-492a-9f85-63b6c515ed08 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] [instance: 321b545b-7228-4a30-bd7b-dcd827a0c747] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:01:47.163364 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-107ab1d1-835c-492a-9f85-63b6c515ed08 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:01:47.164478 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-107ab1d1-835c-492a-9f85-63b6c515ed08 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:01:47.165687 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-107ab1d1-835c-492a-9f85-63b6c515ed08 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:01:47.165900 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-85431766-025a-4269-8ba0-8e720258f45e tempest-ServerAddressesNegativeTestJSON-2002096545 tempest-ServerAddressesNegativeTestJSON-2002096545-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:01:47.166726 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-85431766-025a-4269-8ba0-8e720258f45e tempest-ServerAddressesNegativeTestJSON-2002096545 tempest-ServerAddressesNegativeTestJSON-2002096545-project] [instance: 5756e075-671a-41ca-b637-52fa8187643c] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:01:47.167988 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-107ab1d1-835c-492a-9f85-63b6c515ed08 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:01:47.168854 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-107ab1d1-835c-492a-9f85-63b6c515ed08 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:01:47.169598 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-107ab1d1-835c-492a-9f85-63b6c515ed08 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:01:47.175220 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-85431766-025a-4269-8ba0-8e720258f45e tempest-ServerAddressesNegativeTestJSON-2002096545 tempest-ServerAddressesNegativeTestJSON-2002096545-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:01:47.175754 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-85431766-025a-4269-8ba0-8e720258f45e tempest-ServerAddressesNegativeTestJSON-2002096545 tempest-ServerAddressesNegativeTestJSON-2002096545-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:01:47.176279 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-85431766-025a-4269-8ba0-8e720258f45e tempest-ServerAddressesNegativeTestJSON-2002096545 tempest-ServerAddressesNegativeTestJSON-2002096545-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:01:47.188458 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-85431766-025a-4269-8ba0-8e720258f45e tempest-ServerAddressesNegativeTestJSON-2002096545 tempest-ServerAddressesNegativeTestJSON-2002096545-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:01:47.194789 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-85431766-025a-4269-8ba0-8e720258f45e tempest-ServerAddressesNegativeTestJSON-2002096545 tempest-ServerAddressesNegativeTestJSON-2002096545-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:01:47.195601 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-85431766-025a-4269-8ba0-8e720258f45e tempest-ServerAddressesNegativeTestJSON-2002096545 tempest-ServerAddressesNegativeTestJSON-2002096545-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:01:47.533741 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell0:SELECT=4 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:01:47.580348 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell0:SELECT=14 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:01:47.963629 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-85431766-025a-4269-8ba0-8e720258f45e tempest-ServerAddressesNegativeTestJSON-2002096545 tempest-ServerAddressesNegativeTestJSON-2002096545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03056f5218a647eead4192537f66a504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40e6cd40d3b74efcac7bd16343591315', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:01:47.984253 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-107ab1d1-835c-492a-9f85-63b6c515ed08 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1b410a64e0415a96d30f5040361137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd7873d6db4e09bc9ab9a048a6b1ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:01:47.986061 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-85431766-025a-4269-8ba0-8e720258f45e tempest-ServerAddressesNegativeTestJSON-2002096545 tempest-ServerAddressesNegativeTestJSON-2002096545-project] 10.222.0.18 "GET /compute/v2.1/servers/5756e075-671a-41ca-b637-52fa8187643c" status: 200 len: 1325 microversion: 2.1 time: 0.824353 Oct 22 21:01:47.986667 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1318/2766] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:01:47 2022] GET /compute/v2.1/servers/5756e075-671a-41ca-b637-52fa8187643c => generated 1325 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:01:47.996489 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-bc72e6bf-90d0-4709-8d94-5427cec61a00 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:01:47.997120 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-bc72e6bf-90d0-4709-8d94-5427cec61a00 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] [instance: 2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:01:47.999709 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-107ab1d1-835c-492a-9f85-63b6c515ed08 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] 10.222.0.18 "GET /compute/v2.1/servers/321b545b-7228-4a30-bd7b-dcd827a0c747" status: 200 len: 1315 microversion: 2.1 time: 0.857238 Oct 22 21:01:48.011550 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1449/2767] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:01:47 2022] GET /compute/v2.1/servers/321b545b-7228-4a30-bd7b-dcd827a0c747 => generated 1315 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:01:48.011804 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bc72e6bf-90d0-4709-8d94-5427cec61a00 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:01:48.011804 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bc72e6bf-90d0-4709-8d94-5427cec61a00 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:01:48.011804 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bc72e6bf-90d0-4709-8d94-5427cec61a00 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:01:48.015537 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-e8293e36-5e2e-4035-b2c0-7cb54d9ff3f6 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Calling method '.version_select at 0x7fd39effc0d0>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:01:48.015902 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bc72e6bf-90d0-4709-8d94-5427cec61a00 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:01:48.016455 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bc72e6bf-90d0-4709-8d94-5427cec61a00 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:01:48.017233 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bc72e6bf-90d0-4709-8d94-5427cec61a00 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:01:48.104166 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-e8293e36-5e2e-4035-b2c0-7cb54d9ff3f6 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] 10.222.0.18 "GET /compute/v2.1/images/e8a48405-7084-4515-a1fe-96c425df5e47" status: 200 len: 1463 microversion: 2.1 time: 0.099301 Oct 22 21:01:48.104773 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1450/2768] 10.222.0.18 () {58 vars in 1233 bytes} [Sat Oct 22 21:01:48 2022] GET /compute/v2.1/images/e8a48405-7084-4515-a1fe-96c425df5e47 => generated 1463 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:01:48.113805 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-ea32f39e-8c76-448a-9f11-f721c9200371 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:01:48.114430 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-ea32f39e-8c76-448a-9f11-f721c9200371 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] [instance: 9c2729a5-e874-43e7-a372-514906975851] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:01:48.135201 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ea32f39e-8c76-448a-9f11-f721c9200371 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:01:48.135763 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ea32f39e-8c76-448a-9f11-f721c9200371 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:01:48.136209 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ea32f39e-8c76-448a-9f11-f721c9200371 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:01:48.139857 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ea32f39e-8c76-448a-9f11-f721c9200371 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:01:48.144260 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ea32f39e-8c76-448a-9f11-f721c9200371 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:01:48.145933 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ea32f39e-8c76-448a-9f11-f721c9200371 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:01:48.208447 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:01:48.228386 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-bc72e6bf-90d0-4709-8d94-5427cec61a00 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:01:48.243020 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-bc72e6bf-90d0-4709-8d94-5427cec61a00 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:01:48.244508 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-bc72e6bf-90d0-4709-8d94-5427cec61a00 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:01:48.257834 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-bc72e6bf-90d0-4709-8d94-5427cec61a00 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] 10.222.0.18 "GET /compute/v2.1/servers/2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac" status: 200 len: 1539 microversion: 2.91 time: 0.269843 Oct 22 21:01:48.276019 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1319/2769] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:01:47 2022] GET /compute/v2.1/servers/2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac => generated 1539 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:01:48.292195 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-a5936832-cbd6-4674-8a67-56ba73050968 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Calling method '.version_select at 0x7fd39f12cee0>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:01:48.389984 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-a5936832-cbd6-4674-8a67-56ba73050968 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] 10.222.0.18 "GET /compute/v2.1/images/e8a48405-7084-4515-a1fe-96c425df5e47" status: 200 len: 1463 microversion: 2.1 time: 0.109906 Oct 22 21:01:48.396600 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1320/2770] 10.222.0.18 () {58 vars in 1233 bytes} [Sat Oct 22 21:01:48 2022] GET /compute/v2.1/images/e8a48405-7084-4515-a1fe-96c425df5e47 => generated 1463 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:01:48.413407 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-e861c9d0-767c-4bc1-bc97-591cbec4d550 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:01:48.416039 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-e861c9d0-767c-4bc1-bc97-591cbec4d550 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] [instance: ee6c092d-1150-415f-8a2e-58f4d3b5c238] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:01:48.426614 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e861c9d0-767c-4bc1-bc97-591cbec4d550 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:01:48.428524 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e861c9d0-767c-4bc1-bc97-591cbec4d550 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:01:48.429269 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e861c9d0-767c-4bc1-bc97-591cbec4d550 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:01:48.430171 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e861c9d0-767c-4bc1-bc97-591cbec4d550 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:01:48.430795 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e861c9d0-767c-4bc1-bc97-591cbec4d550 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:01:48.431411 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e861c9d0-767c-4bc1-bc97-591cbec4d550 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:01:48.552354 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-ea32f39e-8c76-448a-9f11-f721c9200371 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a44ff8e7c14b94b1670f030085c43d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a26a2284f4424cbeaf63d504652546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:01:48.566516 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-ea32f39e-8c76-448a-9f11-f721c9200371 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] 10.222.0.18 "GET /compute/v2.1/servers/9c2729a5-e874-43e7-a372-514906975851" status: 200 len: 1499 microversion: 2.1 time: 0.459300 Oct 22 21:01:48.567444 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1451/2771] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:01:48 2022] GET /compute/v2.1/servers/9c2729a5-e874-43e7-a372-514906975851 => generated 1499 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:01:48.688647 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-e861c9d0-767c-4bc1-bc97-591cbec4d550 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b9bfe6f6d564d4c9fb1fea439476e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6e01f91c3a845bf8e67e3ad415d9c69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:01:48.699066 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-e861c9d0-767c-4bc1-bc97-591cbec4d550 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] 10.222.0.18 "GET /compute/v2.1/servers/ee6c092d-1150-415f-8a2e-58f4d3b5c238" status: 200 len: 1467 microversion: 2.1 time: 0.295450 Oct 22 21:01:48.699992 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1321/2772] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:01:48 2022] GET /compute/v2.1/servers/ee6c092d-1150-415f-8a2e-58f4d3b5c238 => generated 1467 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:01:48.727509 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-dff48cda-2b19-451c-a340-5dab9db032c8 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-119226694"}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:01:48.730989 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-dff48cda-2b19-451c-a340-5dab9db032c8 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] [instance: 70f4c178-630e-4050-8aad-4c60bec30bcd] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:01:48.738445 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-dff48cda-2b19-451c-a340-5dab9db032c8 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:01:48.739046 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-dff48cda-2b19-451c-a340-5dab9db032c8 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:01:48.740245 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-dff48cda-2b19-451c-a340-5dab9db032c8 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:01:48.741027 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-dff48cda-2b19-451c-a340-5dab9db032c8 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:01:48.742086 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-dff48cda-2b19-451c-a340-5dab9db032c8 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:01:48.742597 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-dff48cda-2b19-451c-a340-5dab9db032c8 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:01:48.929174 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-0e95f460-d9a4-4f83-a38c-78ce533d65af req-14f30409-0743-45ae-b889-e031ad97b874 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5756e075-671a-41ca-b637-52fa8187643c", "tag": "fea30c27-88ad-44fd-adf1-003e7ad336b1"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:01:48.949404 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-0e95f460-d9a4-4f83-a38c-78ce533d65af req-14f30409-0743-45ae-b889-e031ad97b874 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:01:48.950833 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-0e95f460-d9a4-4f83-a38c-78ce533d65af req-14f30409-0743-45ae-b889-e031ad97b874 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:01:48.951681 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-0e95f460-d9a4-4f83-a38c-78ce533d65af req-14f30409-0743-45ae-b889-e031ad97b874 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:01:48.971782 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-0e95f460-d9a4-4f83-a38c-78ce533d65af req-14f30409-0743-45ae-b889-e031ad97b874 service nova] Creating event network-changed:fea30c27-88ad-44fd-adf1-003e7ad336b1 for instance 5756e075-671a-41ca-b637-52fa8187643c on nch1-master-1 Oct 22 21:01:48.981286 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-0e95f460-d9a4-4f83-a38c-78ce533d65af req-14f30409-0743-45ae-b889-e031ad97b874 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059479 Oct 22 21:01:48.984085 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1322/2773] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:01:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 21:01:49.019846 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-145db9d6-e82a-432f-97b5-d93709cc1e80 tempest-ServerAddressesNegativeTestJSON-2002096545 tempest-ServerAddressesNegativeTestJSON-2002096545-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:01:49.019846 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-145db9d6-e82a-432f-97b5-d93709cc1e80 tempest-ServerAddressesNegativeTestJSON-2002096545 tempest-ServerAddressesNegativeTestJSON-2002096545-project] [instance: 5756e075-671a-41ca-b637-52fa8187643c] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:01:49.028407 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-145db9d6-e82a-432f-97b5-d93709cc1e80 tempest-ServerAddressesNegativeTestJSON-2002096545 tempest-ServerAddressesNegativeTestJSON-2002096545-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:01:49.029026 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-145db9d6-e82a-432f-97b5-d93709cc1e80 tempest-ServerAddressesNegativeTestJSON-2002096545 tempest-ServerAddressesNegativeTestJSON-2002096545-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:01:49.029547 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-145db9d6-e82a-432f-97b5-d93709cc1e80 tempest-ServerAddressesNegativeTestJSON-2002096545 tempest-ServerAddressesNegativeTestJSON-2002096545-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:01:49.030405 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-145db9d6-e82a-432f-97b5-d93709cc1e80 tempest-ServerAddressesNegativeTestJSON-2002096545 tempest-ServerAddressesNegativeTestJSON-2002096545-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:01:49.031032 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-145db9d6-e82a-432f-97b5-d93709cc1e80 tempest-ServerAddressesNegativeTestJSON-2002096545 tempest-ServerAddressesNegativeTestJSON-2002096545-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:01:49.031591 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-145db9d6-e82a-432f-97b5-d93709cc1e80 tempest-ServerAddressesNegativeTestJSON-2002096545 tempest-ServerAddressesNegativeTestJSON-2002096545-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:01:49.073722 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-dff48cda-2b19-451c-a340-5dab9db032c8 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] 10.222.0.18 "POST /compute/v2.1/servers/70f4c178-630e-4050-8aad-4c60bec30bcd/action" status: 202 len: 0 microversion: 2.1 time: 0.351244 Oct 22 21:01:49.074777 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1452/2774] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 21:01:48 2022] POST /compute/v2.1/servers/70f4c178-630e-4050-8aad-4c60bec30bcd/action => generated 0 bytes in 354 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 22 21:01:49.082345 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-3a0bd074-bbf3-483d-9273-4d48c1ae4744 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:01:49.083510 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-3a0bd074-bbf3-483d-9273-4d48c1ae4744 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] [instance: 321b545b-7228-4a30-bd7b-dcd827a0c747] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:01:49.090408 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3a0bd074-bbf3-483d-9273-4d48c1ae4744 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:01:49.091128 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3a0bd074-bbf3-483d-9273-4d48c1ae4744 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:01:49.091641 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3a0bd074-bbf3-483d-9273-4d48c1ae4744 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:01:49.092715 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3a0bd074-bbf3-483d-9273-4d48c1ae4744 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:01:49.093316 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3a0bd074-bbf3-483d-9273-4d48c1ae4744 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:01:49.093718 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3a0bd074-bbf3-483d-9273-4d48c1ae4744 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:01:49.386180 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-145db9d6-e82a-432f-97b5-d93709cc1e80 tempest-ServerAddressesNegativeTestJSON-2002096545 tempest-ServerAddressesNegativeTestJSON-2002096545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03056f5218a647eead4192537f66a504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40e6cd40d3b74efcac7bd16343591315', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:01:49.394286 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-145db9d6-e82a-432f-97b5-d93709cc1e80 tempest-ServerAddressesNegativeTestJSON-2002096545 tempest-ServerAddressesNegativeTestJSON-2002096545-project] 10.222.0.18 "GET /compute/v2.1/servers/5756e075-671a-41ca-b637-52fa8187643c" status: 200 len: 1325 microversion: 2.1 time: 0.380885 Oct 22 21:01:49.394868 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1323/2775] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:01:49 2022] GET /compute/v2.1/servers/5756e075-671a-41ca-b637-52fa8187643c => generated 1325 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:01:49.399319 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-2bee5706-0382-44ba-9755-c317529bbff3 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Calling method '.version_select at 0x7fd39f12cee0>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:01:49.437514 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell0:SELECT=8 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:01:49.448697 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-2bee5706-0382-44ba-9755-c317529bbff3 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] 10.222.0.18 "GET /compute/v2.1/images/79f95f30-3a63-4549-bbef-2ac330a78b61" status: 200 len: 1454 microversion: 2.1 time: 0.052734 Oct 22 21:01:49.449352 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1324/2776] 10.222.0.18 () {58 vars in 1233 bytes} [Sat Oct 22 21:01:49 2022] GET /compute/v2.1/images/79f95f30-3a63-4549-bbef-2ac330a78b61 => generated 1454 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:01:49.454072 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-e7c33c8a-7be4-4c8a-a7a6-13d169e3f4f0 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:01:49.454694 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-e7c33c8a-7be4-4c8a-a7a6-13d169e3f4f0 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] [instance: 2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:01:49.462155 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e7c33c8a-7be4-4c8a-a7a6-13d169e3f4f0 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:01:49.462653 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e7c33c8a-7be4-4c8a-a7a6-13d169e3f4f0 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:01:49.463099 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e7c33c8a-7be4-4c8a-a7a6-13d169e3f4f0 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:01:49.464052 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e7c33c8a-7be4-4c8a-a7a6-13d169e3f4f0 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:01:49.464349 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-3a0bd074-bbf3-483d-9273-4d48c1ae4744 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1b410a64e0415a96d30f5040361137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd7873d6db4e09bc9ab9a048a6b1ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:01:49.464810 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e7c33c8a-7be4-4c8a-a7a6-13d169e3f4f0 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:01:49.464920 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e7c33c8a-7be4-4c8a-a7a6-13d169e3f4f0 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:01:49.490869 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-3a0bd074-bbf3-483d-9273-4d48c1ae4744 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] 10.222.0.18 "GET /compute/v2.1/servers/321b545b-7228-4a30-bd7b-dcd827a0c747" status: 200 len: 1315 microversion: 2.1 time: 0.414279 Oct 22 21:01:49.491823 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1453/2777] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:01:49 2022] GET /compute/v2.1/servers/321b545b-7228-4a30-bd7b-dcd827a0c747 => generated 1315 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:01:49.575742 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-e7c33c8a-7be4-4c8a-a7a6-13d169e3f4f0 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:01:49.585651 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-e7c33c8a-7be4-4c8a-a7a6-13d169e3f4f0 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:01:49.588271 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-e7c33c8a-7be4-4c8a-a7a6-13d169e3f4f0 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:01:49.591988 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-833e17e4-3ae2-4941-930a-82bad9df8bd3 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:01:49.592685 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-833e17e4-3ae2-4941-930a-82bad9df8bd3 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] [instance: 9c2729a5-e874-43e7-a372-514906975851] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:01:49.595923 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-e7c33c8a-7be4-4c8a-a7a6-13d169e3f4f0 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] 10.222.0.18 "GET /compute/v2.1/servers/2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac" status: 200 len: 1539 microversion: 2.91 time: 0.145454 Oct 22 21:01:49.597730 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1325/2778] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:01:49 2022] GET /compute/v2.1/servers/2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac => generated 1539 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:01:49.604965 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-833e17e4-3ae2-4941-930a-82bad9df8bd3 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:01:49.606228 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-833e17e4-3ae2-4941-930a-82bad9df8bd3 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:01:49.606228 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-833e17e4-3ae2-4941-930a-82bad9df8bd3 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:01:49.611403 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-833e17e4-3ae2-4941-930a-82bad9df8bd3 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:01:49.611403 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-833e17e4-3ae2-4941-930a-82bad9df8bd3 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:01:49.611830 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-833e17e4-3ae2-4941-930a-82bad9df8bd3 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:01:49.823156 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-833e17e4-3ae2-4941-930a-82bad9df8bd3 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a44ff8e7c14b94b1670f030085c43d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a26a2284f4424cbeaf63d504652546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:01:49.837005 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-833e17e4-3ae2-4941-930a-82bad9df8bd3 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] 10.222.0.18 "GET /compute/v2.1/servers/9c2729a5-e874-43e7-a372-514906975851" status: 200 len: 1499 microversion: 2.1 time: 0.249688 Oct 22 21:01:49.838565 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1454/2779] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:01:49 2022] GET /compute/v2.1/servers/9c2729a5-e874-43e7-a372-514906975851 => generated 1499 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:01:50.418858 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-bfb293e3-9f3c-49c5-9e0e-accd12aa9f2f tempest-ServerAddressesNegativeTestJSON-2002096545 tempest-ServerAddressesNegativeTestJSON-2002096545-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:01:50.419465 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-bfb293e3-9f3c-49c5-9e0e-accd12aa9f2f tempest-ServerAddressesNegativeTestJSON-2002096545 tempest-ServerAddressesNegativeTestJSON-2002096545-project] [instance: 5756e075-671a-41ca-b637-52fa8187643c] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:01:50.423605 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell0:SELECT=10 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:01:50.427505 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bfb293e3-9f3c-49c5-9e0e-accd12aa9f2f tempest-ServerAddressesNegativeTestJSON-2002096545 tempest-ServerAddressesNegativeTestJSON-2002096545-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:01:50.428225 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bfb293e3-9f3c-49c5-9e0e-accd12aa9f2f tempest-ServerAddressesNegativeTestJSON-2002096545 tempest-ServerAddressesNegativeTestJSON-2002096545-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:01:50.429284 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bfb293e3-9f3c-49c5-9e0e-accd12aa9f2f tempest-ServerAddressesNegativeTestJSON-2002096545 tempest-ServerAddressesNegativeTestJSON-2002096545-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:01:50.430302 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bfb293e3-9f3c-49c5-9e0e-accd12aa9f2f tempest-ServerAddressesNegativeTestJSON-2002096545 tempest-ServerAddressesNegativeTestJSON-2002096545-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:01:50.430862 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bfb293e3-9f3c-49c5-9e0e-accd12aa9f2f tempest-ServerAddressesNegativeTestJSON-2002096545 tempest-ServerAddressesNegativeTestJSON-2002096545-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:01:50.431253 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bfb293e3-9f3c-49c5-9e0e-accd12aa9f2f tempest-ServerAddressesNegativeTestJSON-2002096545 tempest-ServerAddressesNegativeTestJSON-2002096545-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:01:50.466986 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-c9d85146-f64a-41ee-b3e6-39edfaea9a85 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Calling method '.version_select at 0x7fd39fd830d0>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:01:50.543780 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-c9d85146-f64a-41ee-b3e6-39edfaea9a85 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] 10.222.0.18 "GET /compute/v2.1/images/79f95f30-3a63-4549-bbef-2ac330a78b61" status: 200 len: 1454 microversion: 2.1 time: 0.081648 Oct 22 21:01:50.552120 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1455/2780] 10.222.0.18 () {58 vars in 1233 bytes} [Sat Oct 22 21:01:50 2022] GET /compute/v2.1/images/79f95f30-3a63-4549-bbef-2ac330a78b61 => generated 1454 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:01:50.560224 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-0e2f6abb-24a7-48bd-a5fb-5d588a892fbb tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:01:50.560928 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-0e2f6abb-24a7-48bd-a5fb-5d588a892fbb tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] [instance: 321b545b-7228-4a30-bd7b-dcd827a0c747] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:01:50.568857 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0e2f6abb-24a7-48bd-a5fb-5d588a892fbb tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:01:50.570138 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0e2f6abb-24a7-48bd-a5fb-5d588a892fbb tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:01:50.570938 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0e2f6abb-24a7-48bd-a5fb-5d588a892fbb tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:01:50.571774 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0e2f6abb-24a7-48bd-a5fb-5d588a892fbb tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:01:50.572384 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0e2f6abb-24a7-48bd-a5fb-5d588a892fbb tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:01:50.573341 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0e2f6abb-24a7-48bd-a5fb-5d588a892fbb tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:01:50.615393 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-bfb293e3-9f3c-49c5-9e0e-accd12aa9f2f tempest-ServerAddressesNegativeTestJSON-2002096545 tempest-ServerAddressesNegativeTestJSON-2002096545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03056f5218a647eead4192537f66a504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40e6cd40d3b74efcac7bd16343591315', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:01:50.628520 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-bfb293e3-9f3c-49c5-9e0e-accd12aa9f2f tempest-ServerAddressesNegativeTestJSON-2002096545 tempest-ServerAddressesNegativeTestJSON-2002096545-project] 10.222.0.18 "GET /compute/v2.1/servers/5756e075-671a-41ca-b637-52fa8187643c" status: 200 len: 1325 microversion: 2.1 time: 0.213356 Oct 22 21:01:50.629388 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1326/2781] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:01:50 2022] GET /compute/v2.1/servers/5756e075-671a-41ca-b637-52fa8187643c => generated 1325 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:01:50.635950 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-eb8c850c-f42f-4fd6-914c-45e992832c92 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:01:50.636892 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-eb8c850c-f42f-4fd6-914c-45e992832c92 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] [instance: 2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:01:50.647095 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-eb8c850c-f42f-4fd6-914c-45e992832c92 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:01:50.647998 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-eb8c850c-f42f-4fd6-914c-45e992832c92 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:01:50.649380 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-eb8c850c-f42f-4fd6-914c-45e992832c92 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:01:50.650673 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-eb8c850c-f42f-4fd6-914c-45e992832c92 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:01:50.651845 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-eb8c850c-f42f-4fd6-914c-45e992832c92 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:01:50.653452 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-eb8c850c-f42f-4fd6-914c-45e992832c92 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:01:50.774229 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-eb8c850c-f42f-4fd6-914c-45e992832c92 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:01:50.791323 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-eb8c850c-f42f-4fd6-914c-45e992832c92 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:01:50.794154 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-eb8c850c-f42f-4fd6-914c-45e992832c92 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:01:50.802684 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-eb8c850c-f42f-4fd6-914c-45e992832c92 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] 10.222.0.18 "GET /compute/v2.1/servers/2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac" status: 200 len: 1539 microversion: 2.91 time: 0.171537 Oct 22 21:01:50.804277 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1327/2782] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:01:50 2022] GET /compute/v2.1/servers/2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac => generated 1539 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:01:50.840229 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-239b26f2-8808-4785-8a96-7ee7cf6fc776 req-247480ef-44d3-4560-a478-a4caa3889b7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee6c092d-1150-415f-8a2e-58f4d3b5c238", "name": "network-vif-unplugged", "status": "completed", "tag": "ab582bca-d4c2-4df2-a2fb-cfb59dff7776"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:01:50.866599 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-239b26f2-8808-4785-8a96-7ee7cf6fc776 req-247480ef-44d3-4560-a478-a4caa3889b7d service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:01:50.867502 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-239b26f2-8808-4785-8a96-7ee7cf6fc776 req-247480ef-44d3-4560-a478-a4caa3889b7d service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:01:50.868164 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-239b26f2-8808-4785-8a96-7ee7cf6fc776 req-247480ef-44d3-4560-a478-a4caa3889b7d service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:01:50.884815 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-0e2f6abb-24a7-48bd-a5fb-5d588a892fbb tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1b410a64e0415a96d30f5040361137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd7873d6db4e09bc9ab9a048a6b1ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:01:50.887443 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-239b26f2-8808-4785-8a96-7ee7cf6fc776 req-247480ef-44d3-4560-a478-a4caa3889b7d service nova] Creating event network-vif-unplugged:ab582bca-d4c2-4df2-a2fb-cfb59dff7776 for instance ee6c092d-1150-415f-8a2e-58f4d3b5c238 on nch2-master-1 Oct 22 21:01:50.895507 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-239b26f2-8808-4785-8a96-7ee7cf6fc776 req-247480ef-44d3-4560-a478-a4caa3889b7d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.060448 Oct 22 21:01:50.896309 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1328/2783] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:01:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 21:01:50.897487 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-0e2f6abb-24a7-48bd-a5fb-5d588a892fbb tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] 10.222.0.18 "GET /compute/v2.1/servers/321b545b-7228-4a30-bd7b-dcd827a0c747" status: 200 len: 1315 microversion: 2.1 time: 0.343463 Oct 22 21:01:50.898662 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1456/2784] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:01:50 2022] GET /compute/v2.1/servers/321b545b-7228-4a30-bd7b-dcd827a0c747 => generated 1315 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:01:50.908192 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-44eb697e-3cae-4d4a-8285-75b1e90e4aeb tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:01:50.909919 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-44eb697e-3cae-4d4a-8285-75b1e90e4aeb tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] [instance: 9c2729a5-e874-43e7-a372-514906975851] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:01:50.919723 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-44eb697e-3cae-4d4a-8285-75b1e90e4aeb tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:01:50.920527 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-44eb697e-3cae-4d4a-8285-75b1e90e4aeb tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:01:50.921194 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-44eb697e-3cae-4d4a-8285-75b1e90e4aeb tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:01:50.922110 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-44eb697e-3cae-4d4a-8285-75b1e90e4aeb tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:01:50.922794 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-44eb697e-3cae-4d4a-8285-75b1e90e4aeb tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:01:50.923519 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-44eb697e-3cae-4d4a-8285-75b1e90e4aeb tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:01:51.085724 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-44eb697e-3cae-4d4a-8285-75b1e90e4aeb tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a44ff8e7c14b94b1670f030085c43d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a26a2284f4424cbeaf63d504652546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:01:51.094952 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-44eb697e-3cae-4d4a-8285-75b1e90e4aeb tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] 10.222.0.18 "GET /compute/v2.1/servers/9c2729a5-e874-43e7-a372-514906975851" status: 200 len: 1499 microversion: 2.1 time: 0.197241 Oct 22 21:01:51.096165 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1329/2785] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:01:50 2022] GET /compute/v2.1/servers/9c2729a5-e874-43e7-a372-514906975851 => generated 1499 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:01:51.560296 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-19c27ed8-30e6-43ae-8130-5caa59899363 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Calling method '.version_select at 0x7fd39effcca0>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:01:51.608296 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-19c27ed8-30e6-43ae-8130-5caa59899363 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] 10.222.0.18 "GET /compute/v2.1/images/79f95f30-3a63-4549-bbef-2ac330a78b61" status: 200 len: 1454 microversion: 2.1 time: 0.052345 Oct 22 21:01:51.608876 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1457/2786] 10.222.0.18 () {58 vars in 1233 bytes} [Sat Oct 22 21:01:51 2022] GET /compute/v2.1/images/79f95f30-3a63-4549-bbef-2ac330a78b61 => generated 1454 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:01:51.659700 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-218e7e2a-2dc4-4859-8fce-77c9dbfe3d09 tempest-ServerAddressesNegativeTestJSON-2002096545 tempest-ServerAddressesNegativeTestJSON-2002096545-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:01:51.660361 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-218e7e2a-2dc4-4859-8fce-77c9dbfe3d09 tempest-ServerAddressesNegativeTestJSON-2002096545 tempest-ServerAddressesNegativeTestJSON-2002096545-project] [instance: 5756e075-671a-41ca-b637-52fa8187643c] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:01:51.669722 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-218e7e2a-2dc4-4859-8fce-77c9dbfe3d09 tempest-ServerAddressesNegativeTestJSON-2002096545 tempest-ServerAddressesNegativeTestJSON-2002096545-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:01:51.670629 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-218e7e2a-2dc4-4859-8fce-77c9dbfe3d09 tempest-ServerAddressesNegativeTestJSON-2002096545 tempest-ServerAddressesNegativeTestJSON-2002096545-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:01:51.671389 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-218e7e2a-2dc4-4859-8fce-77c9dbfe3d09 tempest-ServerAddressesNegativeTestJSON-2002096545 tempest-ServerAddressesNegativeTestJSON-2002096545-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:01:51.672897 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-218e7e2a-2dc4-4859-8fce-77c9dbfe3d09 tempest-ServerAddressesNegativeTestJSON-2002096545 tempest-ServerAddressesNegativeTestJSON-2002096545-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:01:51.673566 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-218e7e2a-2dc4-4859-8fce-77c9dbfe3d09 tempest-ServerAddressesNegativeTestJSON-2002096545 tempest-ServerAddressesNegativeTestJSON-2002096545-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:01:51.674296 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-218e7e2a-2dc4-4859-8fce-77c9dbfe3d09 tempest-ServerAddressesNegativeTestJSON-2002096545 tempest-ServerAddressesNegativeTestJSON-2002096545-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:01:51.833625 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-fbe17426-7a42-4a28-b419-7afaf9ebe399 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:01:51.834494 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-fbe17426-7a42-4a28-b419-7afaf9ebe399 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] [instance: 2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:01:51.846994 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fbe17426-7a42-4a28-b419-7afaf9ebe399 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:01:51.847594 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fbe17426-7a42-4a28-b419-7afaf9ebe399 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:01:51.848248 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fbe17426-7a42-4a28-b419-7afaf9ebe399 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:01:51.849579 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fbe17426-7a42-4a28-b419-7afaf9ebe399 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:01:51.850490 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fbe17426-7a42-4a28-b419-7afaf9ebe399 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:01:51.851453 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fbe17426-7a42-4a28-b419-7afaf9ebe399 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:01:51.958047 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-fbe17426-7a42-4a28-b419-7afaf9ebe399 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:01:51.963646 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-218e7e2a-2dc4-4859-8fce-77c9dbfe3d09 tempest-ServerAddressesNegativeTestJSON-2002096545 tempest-ServerAddressesNegativeTestJSON-2002096545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03056f5218a647eead4192537f66a504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40e6cd40d3b74efcac7bd16343591315', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:01:51.974121 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-218e7e2a-2dc4-4859-8fce-77c9dbfe3d09 tempest-ServerAddressesNegativeTestJSON-2002096545 tempest-ServerAddressesNegativeTestJSON-2002096545-project] 10.222.0.18 "GET /compute/v2.1/servers/5756e075-671a-41ca-b637-52fa8187643c" status: 200 len: 1325 microversion: 2.1 time: 0.318465 Oct 22 21:01:51.975294 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1330/2787] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:01:51 2022] GET /compute/v2.1/servers/5756e075-671a-41ca-b637-52fa8187643c => generated 1325 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:01:51.980023 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-fbe17426-7a42-4a28-b419-7afaf9ebe399 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:01:51.981348 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-c606fe9f-5778-47bd-9412-635373b339bd tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:01:51.982014 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-fbe17426-7a42-4a28-b419-7afaf9ebe399 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:01:51.982317 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-c606fe9f-5778-47bd-9412-635373b339bd tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] [instance: 321b545b-7228-4a30-bd7b-dcd827a0c747] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:01:51.989107 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c606fe9f-5778-47bd-9412-635373b339bd tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:01:51.989549 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-fbe17426-7a42-4a28-b419-7afaf9ebe399 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] 10.222.0.18 "GET /compute/v2.1/servers/2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac" status: 200 len: 1539 microversion: 2.91 time: 0.159745 Oct 22 21:01:51.990036 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c606fe9f-5778-47bd-9412-635373b339bd tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:01:51.991017 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c606fe9f-5778-47bd-9412-635373b339bd tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:01:51.991432 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1458/2788] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:01:51 2022] GET /compute/v2.1/servers/2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac => generated 1539 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:01:51.992118 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c606fe9f-5778-47bd-9412-635373b339bd tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:01:51.992585 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c606fe9f-5778-47bd-9412-635373b339bd tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:01:51.993013 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c606fe9f-5778-47bd-9412-635373b339bd tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:01:52.118560 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-66891330-1aee-4c25-a6e0-3733d428756f tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:01:52.119639 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-66891330-1aee-4c25-a6e0-3733d428756f tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] [instance: 9c2729a5-e874-43e7-a372-514906975851] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:01:52.167896 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-66891330-1aee-4c25-a6e0-3733d428756f tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:01:52.168416 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-66891330-1aee-4c25-a6e0-3733d428756f tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:01:52.168873 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-66891330-1aee-4c25-a6e0-3733d428756f tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:01:52.169603 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-66891330-1aee-4c25-a6e0-3733d428756f tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:01:52.170061 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-66891330-1aee-4c25-a6e0-3733d428756f tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:01:52.170496 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-66891330-1aee-4c25-a6e0-3733d428756f tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:01:52.279223 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-c606fe9f-5778-47bd-9412-635373b339bd tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1b410a64e0415a96d30f5040361137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd7873d6db4e09bc9ab9a048a6b1ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:01:52.288002 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-c606fe9f-5778-47bd-9412-635373b339bd tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] 10.222.0.18 "GET /compute/v2.1/servers/321b545b-7228-4a30-bd7b-dcd827a0c747" status: 200 len: 1315 microversion: 2.1 time: 0.310951 Oct 22 21:01:52.291753 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1331/2789] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:01:51 2022] GET /compute/v2.1/servers/321b545b-7228-4a30-bd7b-dcd827a0c747 => generated 1315 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:01:52.406540 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-66891330-1aee-4c25-a6e0-3733d428756f tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a44ff8e7c14b94b1670f030085c43d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a26a2284f4424cbeaf63d504652546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:01:52.415255 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-66891330-1aee-4c25-a6e0-3733d428756f tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] 10.222.0.18 "GET /compute/v2.1/servers/9c2729a5-e874-43e7-a372-514906975851" status: 200 len: 1499 microversion: 2.1 time: 0.300905 Oct 22 21:01:52.416001 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1459/2790] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:01:52 2022] GET /compute/v2.1/servers/9c2729a5-e874-43e7-a372-514906975851 => generated 1499 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:01:52.623693 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-deaa5189-f1b4-46c9-941a-faf9418cf307 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Calling method '.version_select at 0x7fd39f25e790>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:01:52.668717 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-deaa5189-f1b4-46c9-941a-faf9418cf307 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] 10.222.0.18 "GET /compute/v2.1/images/79f95f30-3a63-4549-bbef-2ac330a78b61" status: 200 len: 1454 microversion: 2.1 time: 0.049087 Oct 22 21:01:52.678484 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1332/2791] 10.222.0.18 () {58 vars in 1233 bytes} [Sat Oct 22 21:01:52 2022] GET /compute/v2.1/images/79f95f30-3a63-4549-bbef-2ac330a78b61 => generated 1454 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:01:53.018895 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-8f69884a-cb8d-4641-a5d1-f42212bc8195 tempest-ServerAddressesNegativeTestJSON-2002096545 tempest-ServerAddressesNegativeTestJSON-2002096545-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:01:53.020402 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-8f69884a-cb8d-4641-a5d1-f42212bc8195 tempest-ServerAddressesNegativeTestJSON-2002096545 tempest-ServerAddressesNegativeTestJSON-2002096545-project] [instance: 5756e075-671a-41ca-b637-52fa8187643c] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:01:53.023299 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-74b37365-bd35-4665-b0a8-30f34e2cc7db tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:01:53.023957 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-74b37365-bd35-4665-b0a8-30f34e2cc7db tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] [instance: 2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:01:53.028646 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8f69884a-cb8d-4641-a5d1-f42212bc8195 tempest-ServerAddressesNegativeTestJSON-2002096545 tempest-ServerAddressesNegativeTestJSON-2002096545-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:01:53.029489 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8f69884a-cb8d-4641-a5d1-f42212bc8195 tempest-ServerAddressesNegativeTestJSON-2002096545 tempest-ServerAddressesNegativeTestJSON-2002096545-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:01:53.030138 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8f69884a-cb8d-4641-a5d1-f42212bc8195 tempest-ServerAddressesNegativeTestJSON-2002096545 tempest-ServerAddressesNegativeTestJSON-2002096545-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:01:53.031066 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8f69884a-cb8d-4641-a5d1-f42212bc8195 tempest-ServerAddressesNegativeTestJSON-2002096545 tempest-ServerAddressesNegativeTestJSON-2002096545-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:01:53.031744 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8f69884a-cb8d-4641-a5d1-f42212bc8195 tempest-ServerAddressesNegativeTestJSON-2002096545 tempest-ServerAddressesNegativeTestJSON-2002096545-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:01:53.032412 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8f69884a-cb8d-4641-a5d1-f42212bc8195 tempest-ServerAddressesNegativeTestJSON-2002096545 tempest-ServerAddressesNegativeTestJSON-2002096545-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:01:53.041645 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-74b37365-bd35-4665-b0a8-30f34e2cc7db tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:01:53.042162 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-74b37365-bd35-4665-b0a8-30f34e2cc7db tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:01:53.042617 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-74b37365-bd35-4665-b0a8-30f34e2cc7db tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:01:53.043373 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-74b37365-bd35-4665-b0a8-30f34e2cc7db tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:01:53.043852 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-74b37365-bd35-4665-b0a8-30f34e2cc7db tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:01:53.044286 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-74b37365-bd35-4665-b0a8-30f34e2cc7db tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:01:53.167041 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-74b37365-bd35-4665-b0a8-30f34e2cc7db tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:01:53.186640 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-74b37365-bd35-4665-b0a8-30f34e2cc7db tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:01:53.190040 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-74b37365-bd35-4665-b0a8-30f34e2cc7db tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:01:53.198889 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:01:53.203981 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-74b37365-bd35-4665-b0a8-30f34e2cc7db tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] 10.222.0.18 "GET /compute/v2.1/servers/2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac" status: 200 len: 1539 microversion: 2.91 time: 0.185759 Oct 22 21:01:53.204938 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1333/2792] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:01:53 2022] GET /compute/v2.1/servers/2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac => generated 1539 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:01:53.235429 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-8f69884a-cb8d-4641-a5d1-f42212bc8195 tempest-ServerAddressesNegativeTestJSON-2002096545 tempest-ServerAddressesNegativeTestJSON-2002096545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03056f5218a647eead4192537f66a504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40e6cd40d3b74efcac7bd16343591315', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:01:53.245440 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-8f69884a-cb8d-4641-a5d1-f42212bc8195 tempest-ServerAddressesNegativeTestJSON-2002096545 tempest-ServerAddressesNegativeTestJSON-2002096545-project] 10.222.0.18 "GET /compute/v2.1/servers/5756e075-671a-41ca-b637-52fa8187643c" status: 200 len: 1325 microversion: 2.1 time: 0.231230 Oct 22 21:01:53.246684 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1460/2793] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:01:53 2022] GET /compute/v2.1/servers/5756e075-671a-41ca-b637-52fa8187643c => generated 1325 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:01:53.316470 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-6a1d7de0-fd04-43fa-b6da-de278fd4f01e tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:01:53.317103 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-6a1d7de0-fd04-43fa-b6da-de278fd4f01e tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] [instance: 321b545b-7228-4a30-bd7b-dcd827a0c747] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:01:53.323857 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6a1d7de0-fd04-43fa-b6da-de278fd4f01e tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:01:53.324752 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6a1d7de0-fd04-43fa-b6da-de278fd4f01e tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:01:53.325467 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6a1d7de0-fd04-43fa-b6da-de278fd4f01e tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:01:53.326400 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6a1d7de0-fd04-43fa-b6da-de278fd4f01e tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:01:53.326921 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6a1d7de0-fd04-43fa-b6da-de278fd4f01e tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:01:53.327376 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6a1d7de0-fd04-43fa-b6da-de278fd4f01e tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:01:53.439671 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-872fdc7f-57b6-465c-a0f4-dd04cb5293d3 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:01:53.440563 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-872fdc7f-57b6-465c-a0f4-dd04cb5293d3 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] [instance: 9c2729a5-e874-43e7-a372-514906975851] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:01:53.447657 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-872fdc7f-57b6-465c-a0f4-dd04cb5293d3 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:01:53.448326 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-872fdc7f-57b6-465c-a0f4-dd04cb5293d3 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:01:53.449130 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-872fdc7f-57b6-465c-a0f4-dd04cb5293d3 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:01:53.450367 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-872fdc7f-57b6-465c-a0f4-dd04cb5293d3 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:01:53.450983 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-872fdc7f-57b6-465c-a0f4-dd04cb5293d3 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:01:53.451599 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-872fdc7f-57b6-465c-a0f4-dd04cb5293d3 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:01:53.495215 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-6a1d7de0-fd04-43fa-b6da-de278fd4f01e tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1b410a64e0415a96d30f5040361137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd7873d6db4e09bc9ab9a048a6b1ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:01:53.514840 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-6a1d7de0-fd04-43fa-b6da-de278fd4f01e tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] 10.222.0.18 "GET /compute/v2.1/servers/321b545b-7228-4a30-bd7b-dcd827a0c747" status: 200 len: 1315 microversion: 2.1 time: 0.204046 Oct 22 21:01:53.536031 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1334/2794] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:01:53 2022] GET /compute/v2.1/servers/321b545b-7228-4a30-bd7b-dcd827a0c747 => generated 1315 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:01:53.635771 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-872fdc7f-57b6-465c-a0f4-dd04cb5293d3 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a44ff8e7c14b94b1670f030085c43d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a26a2284f4424cbeaf63d504652546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:01:53.652295 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-872fdc7f-57b6-465c-a0f4-dd04cb5293d3 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] 10.222.0.18 "GET /compute/v2.1/servers/9c2729a5-e874-43e7-a372-514906975851" status: 200 len: 1499 microversion: 2.1 time: 0.216441 Oct 22 21:01:53.661046 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1461/2795] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:01:53 2022] GET /compute/v2.1/servers/9c2729a5-e874-43e7-a372-514906975851 => generated 1499 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:01:53.686439 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-0388e034-8c34-4553-aff1-5950a58ce614 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Calling method '.version_select at 0x7fd39fe6a160>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:01:53.734605 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-0388e034-8c34-4553-aff1-5950a58ce614 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] 10.222.0.18 "GET /compute/v2.1/images/79f95f30-3a63-4549-bbef-2ac330a78b61" status: 200 len: 1454 microversion: 2.1 time: 0.052142 Oct 22 21:01:53.735742 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1335/2796] 10.222.0.18 () {58 vars in 1233 bytes} [Sat Oct 22 21:01:53 2022] GET /compute/v2.1/images/79f95f30-3a63-4549-bbef-2ac330a78b61 => generated 1454 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:01:54.233020 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-249d2e9f-1562-4545-87ce-bf0e49f290a5 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:01:54.233639 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-249d2e9f-1562-4545-87ce-bf0e49f290a5 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] [instance: 2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:01:54.240680 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-249d2e9f-1562-4545-87ce-bf0e49f290a5 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:01:54.241172 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-249d2e9f-1562-4545-87ce-bf0e49f290a5 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:01:54.241617 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-249d2e9f-1562-4545-87ce-bf0e49f290a5 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:01:54.242329 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-249d2e9f-1562-4545-87ce-bf0e49f290a5 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:01:54.242791 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-249d2e9f-1562-4545-87ce-bf0e49f290a5 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:01:54.243225 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-249d2e9f-1562-4545-87ce-bf0e49f290a5 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:01:54.270929 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-b0a4fe29-cb50-4bd8-b6bb-3dac5d51fe43 tempest-ServerAddressesNegativeTestJSON-2002096545 tempest-ServerAddressesNegativeTestJSON-2002096545-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:01:54.271579 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-b0a4fe29-cb50-4bd8-b6bb-3dac5d51fe43 tempest-ServerAddressesNegativeTestJSON-2002096545 tempest-ServerAddressesNegativeTestJSON-2002096545-project] [instance: 5756e075-671a-41ca-b637-52fa8187643c] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:01:54.280310 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b0a4fe29-cb50-4bd8-b6bb-3dac5d51fe43 tempest-ServerAddressesNegativeTestJSON-2002096545 tempest-ServerAddressesNegativeTestJSON-2002096545-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:01:54.280815 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b0a4fe29-cb50-4bd8-b6bb-3dac5d51fe43 tempest-ServerAddressesNegativeTestJSON-2002096545 tempest-ServerAddressesNegativeTestJSON-2002096545-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:01:54.281234 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b0a4fe29-cb50-4bd8-b6bb-3dac5d51fe43 tempest-ServerAddressesNegativeTestJSON-2002096545 tempest-ServerAddressesNegativeTestJSON-2002096545-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:01:54.282153 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b0a4fe29-cb50-4bd8-b6bb-3dac5d51fe43 tempest-ServerAddressesNegativeTestJSON-2002096545 tempest-ServerAddressesNegativeTestJSON-2002096545-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:01:54.282612 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b0a4fe29-cb50-4bd8-b6bb-3dac5d51fe43 tempest-ServerAddressesNegativeTestJSON-2002096545 tempest-ServerAddressesNegativeTestJSON-2002096545-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:01:54.283045 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b0a4fe29-cb50-4bd8-b6bb-3dac5d51fe43 tempest-ServerAddressesNegativeTestJSON-2002096545 tempest-ServerAddressesNegativeTestJSON-2002096545-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:01:54.318106 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-249d2e9f-1562-4545-87ce-bf0e49f290a5 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:01:54.329299 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-249d2e9f-1562-4545-87ce-bf0e49f290a5 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:01:54.330876 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-249d2e9f-1562-4545-87ce-bf0e49f290a5 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:01:54.338094 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-249d2e9f-1562-4545-87ce-bf0e49f290a5 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] 10.222.0.18 "GET /compute/v2.1/servers/2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac" status: 200 len: 1539 microversion: 2.91 time: 0.109058 Oct 22 21:01:54.339230 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1462/2797] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:01:54 2022] GET /compute/v2.1/servers/2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac => generated 1539 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:01:54.460300 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-b0a4fe29-cb50-4bd8-b6bb-3dac5d51fe43 tempest-ServerAddressesNegativeTestJSON-2002096545 tempest-ServerAddressesNegativeTestJSON-2002096545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03056f5218a647eead4192537f66a504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40e6cd40d3b74efcac7bd16343591315', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:01:54.472411 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-b0a4fe29-cb50-4bd8-b6bb-3dac5d51fe43 tempest-ServerAddressesNegativeTestJSON-2002096545 tempest-ServerAddressesNegativeTestJSON-2002096545-project] 10.222.0.18 "GET /compute/v2.1/servers/5756e075-671a-41ca-b637-52fa8187643c" status: 200 len: 1325 microversion: 2.1 time: 0.206845 Oct 22 21:01:54.473476 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1336/2798] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:01:54 2022] GET /compute/v2.1/servers/5756e075-671a-41ca-b637-52fa8187643c => generated 1325 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:01:54.542615 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-3d8e763f-7231-4cda-aaaf-3c192f71366e tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:01:54.543744 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-3d8e763f-7231-4cda-aaaf-3c192f71366e tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] [instance: 321b545b-7228-4a30-bd7b-dcd827a0c747] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:01:54.551263 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3d8e763f-7231-4cda-aaaf-3c192f71366e tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:01:54.552123 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3d8e763f-7231-4cda-aaaf-3c192f71366e tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:01:54.552763 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3d8e763f-7231-4cda-aaaf-3c192f71366e tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:01:54.553856 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3d8e763f-7231-4cda-aaaf-3c192f71366e tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:01:54.554412 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3d8e763f-7231-4cda-aaaf-3c192f71366e tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:01:54.554943 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3d8e763f-7231-4cda-aaaf-3c192f71366e tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:01:54.675995 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-a48d33e7-c953-40a7-92bf-232f91e3f55a tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:01:54.677341 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-a48d33e7-c953-40a7-92bf-232f91e3f55a tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] [instance: 9c2729a5-e874-43e7-a372-514906975851] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:01:54.684095 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a48d33e7-c953-40a7-92bf-232f91e3f55a tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:01:54.685001 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a48d33e7-c953-40a7-92bf-232f91e3f55a tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:01:54.685684 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a48d33e7-c953-40a7-92bf-232f91e3f55a tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:01:54.686799 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a48d33e7-c953-40a7-92bf-232f91e3f55a tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:01:54.687961 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a48d33e7-c953-40a7-92bf-232f91e3f55a tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:01:54.688929 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a48d33e7-c953-40a7-92bf-232f91e3f55a tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:01:54.761939 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-3d8e763f-7231-4cda-aaaf-3c192f71366e tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1b410a64e0415a96d30f5040361137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd7873d6db4e09bc9ab9a048a6b1ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:01:54.778262 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-3d8e763f-7231-4cda-aaaf-3c192f71366e tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] 10.222.0.18 "GET /compute/v2.1/servers/321b545b-7228-4a30-bd7b-dcd827a0c747" status: 200 len: 1315 microversion: 2.1 time: 0.240536 Oct 22 21:01:54.780503 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1463/2799] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:01:54 2022] GET /compute/v2.1/servers/321b545b-7228-4a30-bd7b-dcd827a0c747 => generated 1315 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:01:54.786840 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-862792a7-e646-4f58-bce0-11cd4c7f6087 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Calling method '.version_select at 0x7fd39efdad30>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:01:54.886528 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-862792a7-e646-4f58-bce0-11cd4c7f6087 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] 10.222.0.18 "GET /compute/v2.1/images/79f95f30-3a63-4549-bbef-2ac330a78b61" status: 200 len: 1454 microversion: 2.1 time: 0.104642 Oct 22 21:01:54.887164 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1464/2800] 10.222.0.18 () {58 vars in 1233 bytes} [Sat Oct 22 21:01:54 2022] GET /compute/v2.1/images/79f95f30-3a63-4549-bbef-2ac330a78b61 => generated 1454 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:01:54.919007 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-a48d33e7-c953-40a7-92bf-232f91e3f55a tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a44ff8e7c14b94b1670f030085c43d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a26a2284f4424cbeaf63d504652546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:01:54.930011 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-a48d33e7-c953-40a7-92bf-232f91e3f55a tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] 10.222.0.18 "GET /compute/v2.1/servers/9c2729a5-e874-43e7-a372-514906975851" status: 200 len: 1499 microversion: 2.1 time: 0.257864 Oct 22 21:01:54.931717 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1337/2801] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:01:54 2022] GET /compute/v2.1/servers/9c2729a5-e874-43e7-a372-514906975851 => generated 1499 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:01:55.003918 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-70f95876-7bdd-409c-9c8a-ca0d563a76ff req-f2e39645-15b0-405f-8ec4-2545ee465775 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "321b545b-7228-4a30-bd7b-dcd827a0c747", "name": "network-vif-plugged", "status": "completed", "tag": "3c32aabf-b19e-478d-8bdc-01ceb7dddb88"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:01:55.028994 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-70f95876-7bdd-409c-9c8a-ca0d563a76ff req-f2e39645-15b0-405f-8ec4-2545ee465775 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:01:55.030049 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-70f95876-7bdd-409c-9c8a-ca0d563a76ff req-f2e39645-15b0-405f-8ec4-2545ee465775 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:01:55.030816 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-70f95876-7bdd-409c-9c8a-ca0d563a76ff req-f2e39645-15b0-405f-8ec4-2545ee465775 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:01:55.048726 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-70f95876-7bdd-409c-9c8a-ca0d563a76ff req-f2e39645-15b0-405f-8ec4-2545ee465775 service nova] Creating event network-vif-plugged:3c32aabf-b19e-478d-8bdc-01ceb7dddb88 for instance 321b545b-7228-4a30-bd7b-dcd827a0c747 on nch1-master-1 Oct 22 21:01:55.055694 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-70f95876-7bdd-409c-9c8a-ca0d563a76ff req-f2e39645-15b0-405f-8ec4-2545ee465775 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058456 Oct 22 21:01:55.056804 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1465/2802] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:01:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:01:55.372229 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-520ef27b-aee4-4c04-a4a0-fa2894b035f5 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:01:55.372860 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-520ef27b-aee4-4c04-a4a0-fa2894b035f5 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] [instance: 2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:01:55.388155 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-520ef27b-aee4-4c04-a4a0-fa2894b035f5 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:01:55.388670 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-520ef27b-aee4-4c04-a4a0-fa2894b035f5 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:01:55.389586 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-520ef27b-aee4-4c04-a4a0-fa2894b035f5 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:01:55.390379 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-520ef27b-aee4-4c04-a4a0-fa2894b035f5 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:01:55.390842 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-520ef27b-aee4-4c04-a4a0-fa2894b035f5 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:01:55.391307 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-520ef27b-aee4-4c04-a4a0-fa2894b035f5 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:01:55.502573 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-bcacf1a4-d85a-4b9c-8ebc-7a9562e68026 tempest-ServerAddressesNegativeTestJSON-2002096545 tempest-ServerAddressesNegativeTestJSON-2002096545-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:01:55.503830 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-bcacf1a4-d85a-4b9c-8ebc-7a9562e68026 tempest-ServerAddressesNegativeTestJSON-2002096545 tempest-ServerAddressesNegativeTestJSON-2002096545-project] [instance: 5756e075-671a-41ca-b637-52fa8187643c] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:01:55.531317 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bcacf1a4-d85a-4b9c-8ebc-7a9562e68026 tempest-ServerAddressesNegativeTestJSON-2002096545 tempest-ServerAddressesNegativeTestJSON-2002096545-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:01:55.534054 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bcacf1a4-d85a-4b9c-8ebc-7a9562e68026 tempest-ServerAddressesNegativeTestJSON-2002096545 tempest-ServerAddressesNegativeTestJSON-2002096545-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:01:55.534781 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bcacf1a4-d85a-4b9c-8ebc-7a9562e68026 tempest-ServerAddressesNegativeTestJSON-2002096545 tempest-ServerAddressesNegativeTestJSON-2002096545-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:01:55.537382 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bcacf1a4-d85a-4b9c-8ebc-7a9562e68026 tempest-ServerAddressesNegativeTestJSON-2002096545 tempest-ServerAddressesNegativeTestJSON-2002096545-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:01:55.539520 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bcacf1a4-d85a-4b9c-8ebc-7a9562e68026 tempest-ServerAddressesNegativeTestJSON-2002096545 tempest-ServerAddressesNegativeTestJSON-2002096545-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:01:55.540284 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bcacf1a4-d85a-4b9c-8ebc-7a9562e68026 tempest-ServerAddressesNegativeTestJSON-2002096545 tempest-ServerAddressesNegativeTestJSON-2002096545-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:01:55.550468 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-520ef27b-aee4-4c04-a4a0-fa2894b035f5 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:01:55.572053 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-520ef27b-aee4-4c04-a4a0-fa2894b035f5 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:01:55.576503 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-520ef27b-aee4-4c04-a4a0-fa2894b035f5 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:01:55.593933 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-520ef27b-aee4-4c04-a4a0-fa2894b035f5 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] 10.222.0.18 "GET /compute/v2.1/servers/2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac" status: 200 len: 1539 microversion: 2.91 time: 0.227943 Oct 22 21:01:55.594908 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1338/2803] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:01:55 2022] GET /compute/v2.1/servers/2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac => generated 1539 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:01:55.811397 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-f60c6ac1-8eb8-4454-bba2-fc0f1c19d1e1 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:01:55.814607 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-f60c6ac1-8eb8-4454-bba2-fc0f1c19d1e1 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] [instance: 321b545b-7228-4a30-bd7b-dcd827a0c747] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:01:55.831482 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f60c6ac1-8eb8-4454-bba2-fc0f1c19d1e1 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:01:55.832903 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f60c6ac1-8eb8-4454-bba2-fc0f1c19d1e1 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:01:55.833547 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f60c6ac1-8eb8-4454-bba2-fc0f1c19d1e1 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:01:55.834291 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f60c6ac1-8eb8-4454-bba2-fc0f1c19d1e1 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:01:55.835081 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f60c6ac1-8eb8-4454-bba2-fc0f1c19d1e1 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:01:55.835762 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f60c6ac1-8eb8-4454-bba2-fc0f1c19d1e1 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:01:55.864509 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:SELECT=100 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:01:55.871234 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-bcacf1a4-d85a-4b9c-8ebc-7a9562e68026 tempest-ServerAddressesNegativeTestJSON-2002096545 tempest-ServerAddressesNegativeTestJSON-2002096545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03056f5218a647eead4192537f66a504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40e6cd40d3b74efcac7bd16343591315', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:01:55.883042 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-bcacf1a4-d85a-4b9c-8ebc-7a9562e68026 tempest-ServerAddressesNegativeTestJSON-2002096545 tempest-ServerAddressesNegativeTestJSON-2002096545-project] 10.222.0.18 "GET /compute/v2.1/servers/5756e075-671a-41ca-b637-52fa8187643c" status: 200 len: 1325 microversion: 2.1 time: 0.388630 Oct 22 21:01:55.883959 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1466/2804] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:01:55 2022] GET /compute/v2.1/servers/5756e075-671a-41ca-b637-52fa8187643c => generated 1325 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:01:55.902865 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-10f3fba2-0f49-4382-ba5c-34a6f1cccd3d tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Calling method '.version_select at 0x7fd39effc4c0>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:01:55.971020 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-10f3fba2-0f49-4382-ba5c-34a6f1cccd3d tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] 10.222.0.18 "GET /compute/v2.1/images/79f95f30-3a63-4549-bbef-2ac330a78b61" status: 200 len: 1454 microversion: 2.1 time: 0.072051 Oct 22 21:01:55.971660 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1467/2805] 10.222.0.18 () {58 vars in 1233 bytes} [Sat Oct 22 21:01:55 2022] GET /compute/v2.1/images/79f95f30-3a63-4549-bbef-2ac330a78b61 => generated 1454 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:01:55.986197 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-72310a53-e40d-4f4b-b3bd-3193558d791a tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:01:55.987395 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-72310a53-e40d-4f4b-b3bd-3193558d791a tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] [instance: 9c2729a5-e874-43e7-a372-514906975851] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:01:56.019673 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-72310a53-e40d-4f4b-b3bd-3193558d791a tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:01:56.020506 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-72310a53-e40d-4f4b-b3bd-3193558d791a tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:01:56.023854 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-72310a53-e40d-4f4b-b3bd-3193558d791a tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:01:56.024828 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-72310a53-e40d-4f4b-b3bd-3193558d791a tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:01:56.025460 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-72310a53-e40d-4f4b-b3bd-3193558d791a tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:01:56.027519 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-72310a53-e40d-4f4b-b3bd-3193558d791a tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:01:56.559659 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-f60c6ac1-8eb8-4454-bba2-fc0f1c19d1e1 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1b410a64e0415a96d30f5040361137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd7873d6db4e09bc9ab9a048a6b1ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:01:56.580572 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-f60c6ac1-8eb8-4454-bba2-fc0f1c19d1e1 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] 10.222.0.18 "GET /compute/v2.1/servers/321b545b-7228-4a30-bd7b-dcd827a0c747" status: 200 len: 1315 microversion: 2.1 time: 0.777004 Oct 22 21:01:56.582633 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1339/2806] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:01:55 2022] GET /compute/v2.1/servers/321b545b-7228-4a30-bd7b-dcd827a0c747 => generated 1315 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:01:56.627762 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-489d43a8-6fc3-4079-8ab8-9a91be772282 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:01:56.629271 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-489d43a8-6fc3-4079-8ab8-9a91be772282 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] [instance: 2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:01:56.654189 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-489d43a8-6fc3-4079-8ab8-9a91be772282 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:01:56.654920 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-489d43a8-6fc3-4079-8ab8-9a91be772282 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:01:56.655983 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-489d43a8-6fc3-4079-8ab8-9a91be772282 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:01:56.657261 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-489d43a8-6fc3-4079-8ab8-9a91be772282 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:01:56.657787 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-489d43a8-6fc3-4079-8ab8-9a91be772282 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:01:56.658233 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-489d43a8-6fc3-4079-8ab8-9a91be772282 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:01:56.769029 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-72310a53-e40d-4f4b-b3bd-3193558d791a tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a44ff8e7c14b94b1670f030085c43d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a26a2284f4424cbeaf63d504652546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:01:56.777744 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-489d43a8-6fc3-4079-8ab8-9a91be772282 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:01:56.782402 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-72310a53-e40d-4f4b-b3bd-3193558d791a tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] 10.222.0.18 "GET /compute/v2.1/servers/9c2729a5-e874-43e7-a372-514906975851" status: 200 len: 1499 microversion: 2.1 time: 0.809078 Oct 22 21:01:56.783818 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1468/2807] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:01:55 2022] GET /compute/v2.1/servers/9c2729a5-e874-43e7-a372-514906975851 => generated 1499 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:01:56.803653 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-489d43a8-6fc3-4079-8ab8-9a91be772282 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:01:56.805743 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-489d43a8-6fc3-4079-8ab8-9a91be772282 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:01:56.814365 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-489d43a8-6fc3-4079-8ab8-9a91be772282 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] 10.222.0.18 "GET /compute/v2.1/servers/2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac" status: 200 len: 1560 microversion: 2.91 time: 0.191089 Oct 22 21:01:56.821560 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1340/2808] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:01:56 2022] GET /compute/v2.1/servers/2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac => generated 1560 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:01:56.906745 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-aa6e3172-ab4f-4723-bde1-9838d03298f7 tempest-ServerAddressesNegativeTestJSON-2002096545 tempest-ServerAddressesNegativeTestJSON-2002096545-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:01:56.907257 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-aa6e3172-ab4f-4723-bde1-9838d03298f7 tempest-ServerAddressesNegativeTestJSON-2002096545 tempest-ServerAddressesNegativeTestJSON-2002096545-project] [instance: 5756e075-671a-41ca-b637-52fa8187643c] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:01:56.913468 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-aa6e3172-ab4f-4723-bde1-9838d03298f7 tempest-ServerAddressesNegativeTestJSON-2002096545 tempest-ServerAddressesNegativeTestJSON-2002096545-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:01:56.913962 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-aa6e3172-ab4f-4723-bde1-9838d03298f7 tempest-ServerAddressesNegativeTestJSON-2002096545 tempest-ServerAddressesNegativeTestJSON-2002096545-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:01:56.914600 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-aa6e3172-ab4f-4723-bde1-9838d03298f7 tempest-ServerAddressesNegativeTestJSON-2002096545 tempest-ServerAddressesNegativeTestJSON-2002096545-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:01:56.915371 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-aa6e3172-ab4f-4723-bde1-9838d03298f7 tempest-ServerAddressesNegativeTestJSON-2002096545 tempest-ServerAddressesNegativeTestJSON-2002096545-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:01:56.915996 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-aa6e3172-ab4f-4723-bde1-9838d03298f7 tempest-ServerAddressesNegativeTestJSON-2002096545 tempest-ServerAddressesNegativeTestJSON-2002096545-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:01:56.916631 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-aa6e3172-ab4f-4723-bde1-9838d03298f7 tempest-ServerAddressesNegativeTestJSON-2002096545 tempest-ServerAddressesNegativeTestJSON-2002096545-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:01:56.987584 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-b401bd51-a4c8-45df-96de-c476378cfeb8 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Calling method '.version_select at 0x7fd39f148b80>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:01:57.038343 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-b401bd51-a4c8-45df-96de-c476378cfeb8 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] 10.222.0.18 "GET /compute/v2.1/images/79f95f30-3a63-4549-bbef-2ac330a78b61" status: 200 len: 1454 microversion: 2.1 time: 0.054731 Oct 22 21:01:57.039580 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1341/2809] 10.222.0.18 () {58 vars in 1233 bytes} [Sat Oct 22 21:01:56 2022] GET /compute/v2.1/images/79f95f30-3a63-4549-bbef-2ac330a78b61 => generated 1454 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:01:57.083968 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-d4b8c426-21b9-445d-92e1-b10e47203e10 req-732c7aa7-9c47-4c3d-a228-a497906d6de4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70f4c178-630e-4050-8aad-4c60bec30bcd", "name": "network-vif-plugged", "status": "completed", "tag": "034bfe35-5a4c-4024-b8ad-3fc77f012374"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:01:57.099326 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-d4b8c426-21b9-445d-92e1-b10e47203e10 req-732c7aa7-9c47-4c3d-a228-a497906d6de4 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:01:57.099887 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-d4b8c426-21b9-445d-92e1-b10e47203e10 req-732c7aa7-9c47-4c3d-a228-a497906d6de4 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:01:57.100906 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-d4b8c426-21b9-445d-92e1-b10e47203e10 req-732c7aa7-9c47-4c3d-a228-a497906d6de4 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:01:57.115652 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-d4b8c426-21b9-445d-92e1-b10e47203e10 req-732c7aa7-9c47-4c3d-a228-a497906d6de4 service nova] Creating event network-vif-plugged:034bfe35-5a4c-4024-b8ad-3fc77f012374 for instance 70f4c178-630e-4050-8aad-4c60bec30bcd on nch1-master-1 Oct 22 21:01:57.123718 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-d4b8c426-21b9-445d-92e1-b10e47203e10 req-732c7aa7-9c47-4c3d-a228-a497906d6de4 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050537 Oct 22 21:01:57.127569 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1342/2810] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:01:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:01:57.294676 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-aa6e3172-ab4f-4723-bde1-9838d03298f7 tempest-ServerAddressesNegativeTestJSON-2002096545 tempest-ServerAddressesNegativeTestJSON-2002096545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03056f5218a647eead4192537f66a504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40e6cd40d3b74efcac7bd16343591315', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:01:57.303946 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-aa6e3172-ab4f-4723-bde1-9838d03298f7 tempest-ServerAddressesNegativeTestJSON-2002096545 tempest-ServerAddressesNegativeTestJSON-2002096545-project] 10.222.0.18 "GET /compute/v2.1/servers/5756e075-671a-41ca-b637-52fa8187643c" status: 200 len: 1325 microversion: 2.1 time: 0.401228 Oct 22 21:01:57.304539 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1469/2811] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:01:56 2022] GET /compute/v2.1/servers/5756e075-671a-41ca-b637-52fa8187643c => generated 1325 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:01:57.610078 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-b26be195-f384-4f43-af67-ad48628f9e4e tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:01:57.610802 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-b26be195-f384-4f43-af67-ad48628f9e4e tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] [instance: 321b545b-7228-4a30-bd7b-dcd827a0c747] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:01:57.618804 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b26be195-f384-4f43-af67-ad48628f9e4e tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:01:57.619297 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b26be195-f384-4f43-af67-ad48628f9e4e tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:01:57.621178 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b26be195-f384-4f43-af67-ad48628f9e4e tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:01:57.623946 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b26be195-f384-4f43-af67-ad48628f9e4e tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:01:57.624882 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b26be195-f384-4f43-af67-ad48628f9e4e tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:01:57.625399 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b26be195-f384-4f43-af67-ad48628f9e4e tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:01:57.810422 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-5b68d2f5-4dc9-46d7-bcff-a1d96f048376 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:01:57.811285 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-5b68d2f5-4dc9-46d7-bcff-a1d96f048376 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] [instance: 9c2729a5-e874-43e7-a372-514906975851] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:01:57.839247 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5b68d2f5-4dc9-46d7-bcff-a1d96f048376 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:01:57.839797 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5b68d2f5-4dc9-46d7-bcff-a1d96f048376 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:01:57.840255 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5b68d2f5-4dc9-46d7-bcff-a1d96f048376 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:01:57.841000 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5b68d2f5-4dc9-46d7-bcff-a1d96f048376 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:01:57.843631 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5b68d2f5-4dc9-46d7-bcff-a1d96f048376 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:01:57.844111 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5b68d2f5-4dc9-46d7-bcff-a1d96f048376 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:01:58.116737 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-b26be195-f384-4f43-af67-ad48628f9e4e tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1b410a64e0415a96d30f5040361137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd7873d6db4e09bc9ab9a048a6b1ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:01:58.127104 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-b26be195-f384-4f43-af67-ad48628f9e4e tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] 10.222.0.18 "GET /compute/v2.1/servers/321b545b-7228-4a30-bd7b-dcd827a0c747" status: 200 len: 1503 microversion: 2.1 time: 0.524094 Oct 22 21:01:58.140845 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1343/2812] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:01:57 2022] GET /compute/v2.1/servers/321b545b-7228-4a30-bd7b-dcd827a0c747 => generated 1503 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:01:58.154142 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-aa9b2aaf-d329-4c7a-b422-760be9fc6810 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:01:58.157665 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-aa9b2aaf-d329-4c7a-b422-760be9fc6810 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] [instance: 2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:01:58.161835 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-aa9b2aaf-d329-4c7a-b422-760be9fc6810 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:01:58.162550 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-aa9b2aaf-d329-4c7a-b422-760be9fc6810 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:01:58.163183 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-aa9b2aaf-d329-4c7a-b422-760be9fc6810 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:01:58.164108 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-aa9b2aaf-d329-4c7a-b422-760be9fc6810 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:01:58.164725 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-aa9b2aaf-d329-4c7a-b422-760be9fc6810 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:01:58.165308 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-aa9b2aaf-d329-4c7a-b422-760be9fc6810 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:01:58.378421 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-aa9b2aaf-d329-4c7a-b422-760be9fc6810 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:01:58.395526 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-aa9b2aaf-d329-4c7a-b422-760be9fc6810 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:01:58.400196 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-aa9b2aaf-d329-4c7a-b422-760be9fc6810 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:01:58.408920 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-aa9b2aaf-d329-4c7a-b422-760be9fc6810 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] 10.222.0.18 "GET /compute/v2.1/servers/2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac" status: 200 len: 1560 microversion: 2.91 time: 0.259893 Oct 22 21:01:58.424237 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1344/2813] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:01:58 2022] GET /compute/v2.1/servers/2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac => generated 1560 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:01:58.430398 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-fddb3e77-ed2b-4a57-a262-5f5ed72c0285 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Calling method '.version_select at 0x7fd3a4066310>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:01:58.485705 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-5b68d2f5-4dc9-46d7-bcff-a1d96f048376 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a44ff8e7c14b94b1670f030085c43d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a26a2284f4424cbeaf63d504652546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:01:58.513686 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-5b68d2f5-4dc9-46d7-bcff-a1d96f048376 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] 10.222.0.18 "GET /compute/v2.1/servers/9c2729a5-e874-43e7-a372-514906975851" status: 200 len: 1499 microversion: 2.1 time: 0.709529 Oct 22 21:01:58.522084 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1470/2814] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:01:57 2022] GET /compute/v2.1/servers/9c2729a5-e874-43e7-a372-514906975851 => generated 1499 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:01:58.538937 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-832a45dd-2f2f-4681-8cae-980a264ffd8c tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:01:58.540047 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-832a45dd-2f2f-4681-8cae-980a264ffd8c tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] [instance: 321b545b-7228-4a30-bd7b-dcd827a0c747] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:01:58.566945 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-832a45dd-2f2f-4681-8cae-980a264ffd8c tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:01:58.567464 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-832a45dd-2f2f-4681-8cae-980a264ffd8c tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:01:58.567935 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-832a45dd-2f2f-4681-8cae-980a264ffd8c tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:01:58.568747 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-832a45dd-2f2f-4681-8cae-980a264ffd8c tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:01:58.569190 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-832a45dd-2f2f-4681-8cae-980a264ffd8c tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:01:58.569619 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-832a45dd-2f2f-4681-8cae-980a264ffd8c tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:01:58.573095 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-fddb3e77-ed2b-4a57-a262-5f5ed72c0285 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] 10.222.0.18 "GET /compute/v2.1/images/79f95f30-3a63-4549-bbef-2ac330a78b61" status: 200 len: 1454 microversion: 2.1 time: 0.156590 Oct 22 21:01:58.575543 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1345/2815] 10.222.0.18 () {58 vars in 1233 bytes} [Sat Oct 22 21:01:58 2022] GET /compute/v2.1/images/79f95f30-3a63-4549-bbef-2ac330a78b61 => generated 1454 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:01:58.591873 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-0b99e659-d6f0-4435-9ca7-8ca9b4e1ad32 tempest-ServerAddressesNegativeTestJSON-2002096545 tempest-ServerAddressesNegativeTestJSON-2002096545-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:01:58.592774 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-0b99e659-d6f0-4435-9ca7-8ca9b4e1ad32 tempest-ServerAddressesNegativeTestJSON-2002096545 tempest-ServerAddressesNegativeTestJSON-2002096545-project] [instance: 5756e075-671a-41ca-b637-52fa8187643c] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:01:58.596965 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:01:58.610557 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0b99e659-d6f0-4435-9ca7-8ca9b4e1ad32 tempest-ServerAddressesNegativeTestJSON-2002096545 tempest-ServerAddressesNegativeTestJSON-2002096545-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:01:58.611065 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0b99e659-d6f0-4435-9ca7-8ca9b4e1ad32 tempest-ServerAddressesNegativeTestJSON-2002096545 tempest-ServerAddressesNegativeTestJSON-2002096545-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:01:58.622038 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0b99e659-d6f0-4435-9ca7-8ca9b4e1ad32 tempest-ServerAddressesNegativeTestJSON-2002096545 tempest-ServerAddressesNegativeTestJSON-2002096545-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:01:58.623592 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0b99e659-d6f0-4435-9ca7-8ca9b4e1ad32 tempest-ServerAddressesNegativeTestJSON-2002096545 tempest-ServerAddressesNegativeTestJSON-2002096545-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:01:58.624244 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0b99e659-d6f0-4435-9ca7-8ca9b4e1ad32 tempest-ServerAddressesNegativeTestJSON-2002096545 tempest-ServerAddressesNegativeTestJSON-2002096545-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:01:58.624878 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0b99e659-d6f0-4435-9ca7-8ca9b4e1ad32 tempest-ServerAddressesNegativeTestJSON-2002096545 tempest-ServerAddressesNegativeTestJSON-2002096545-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:01:58.781818 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-832a45dd-2f2f-4681-8cae-980a264ffd8c tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] 10.222.0.18 "POST /compute/v2.1/servers/321b545b-7228-4a30-bd7b-dcd827a0c747/action" status: 202 len: 0 microversion: 2.1 time: 0.256939 Oct 22 21:01:58.787379 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1471/2816] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 21:01:58 2022] POST /compute/v2.1/servers/321b545b-7228-4a30-bd7b-dcd827a0c747/action => generated 0 bytes in 260 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 21:01:58.813772 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-457981c8-29cc-4d9f-96a9-99ef17630f40 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:01:58.814682 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-457981c8-29cc-4d9f-96a9-99ef17630f40 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] [instance: 321b545b-7228-4a30-bd7b-dcd827a0c747] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:01:58.837405 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-457981c8-29cc-4d9f-96a9-99ef17630f40 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:01:58.837645 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-457981c8-29cc-4d9f-96a9-99ef17630f40 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:01:58.838171 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-457981c8-29cc-4d9f-96a9-99ef17630f40 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:01:58.839061 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-457981c8-29cc-4d9f-96a9-99ef17630f40 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:01:58.839562 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-457981c8-29cc-4d9f-96a9-99ef17630f40 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:01:58.840237 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-457981c8-29cc-4d9f-96a9-99ef17630f40 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:01:59.236467 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-0b99e659-d6f0-4435-9ca7-8ca9b4e1ad32 tempest-ServerAddressesNegativeTestJSON-2002096545 tempest-ServerAddressesNegativeTestJSON-2002096545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03056f5218a647eead4192537f66a504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40e6cd40d3b74efcac7bd16343591315', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:01:59.253695 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-0b99e659-d6f0-4435-9ca7-8ca9b4e1ad32 tempest-ServerAddressesNegativeTestJSON-2002096545 tempest-ServerAddressesNegativeTestJSON-2002096545-project] 10.222.0.18 "GET /compute/v2.1/servers/5756e075-671a-41ca-b637-52fa8187643c" status: 200 len: 1325 microversion: 2.1 time: 0.674307 Oct 22 21:01:59.273132 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1346/2817] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:01:58 2022] GET /compute/v2.1/servers/5756e075-671a-41ca-b637-52fa8187643c => generated 1325 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:01:59.383871 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-457981c8-29cc-4d9f-96a9-99ef17630f40 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1b410a64e0415a96d30f5040361137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd7873d6db4e09bc9ab9a048a6b1ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:01:59.388281 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-8e027470-e673-44c5-9e8c-73ffa3c2c338 req-9fe5843c-fb62-4ba2-9cdc-7cd6677c0e1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5756e075-671a-41ca-b637-52fa8187643c", "name": "network-vif-plugged", "status": "completed", "tag": "fea30c27-88ad-44fd-adf1-003e7ad336b1"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:01:59.392799 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-457981c8-29cc-4d9f-96a9-99ef17630f40 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] 10.222.0.18 "GET /compute/v2.1/servers/321b545b-7228-4a30-bd7b-dcd827a0c747" status: 200 len: 1508 microversion: 2.1 time: 0.595857 Oct 22 21:01:59.393391 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1472/2818] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:01:58 2022] GET /compute/v2.1/servers/321b545b-7228-4a30-bd7b-dcd827a0c747 => generated 1508 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:01:59.407540 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-8e027470-e673-44c5-9e8c-73ffa3c2c338 req-9fe5843c-fb62-4ba2-9cdc-7cd6677c0e1d service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:01:59.408365 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-8e027470-e673-44c5-9e8c-73ffa3c2c338 req-9fe5843c-fb62-4ba2-9cdc-7cd6677c0e1d service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:01:59.409168 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-8e027470-e673-44c5-9e8c-73ffa3c2c338 req-9fe5843c-fb62-4ba2-9cdc-7cd6677c0e1d service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:01:59.442803 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-6ce07dee-816b-4af7-b630-8e5b3d3c947f tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:01:59.443311 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-8e027470-e673-44c5-9e8c-73ffa3c2c338 req-9fe5843c-fb62-4ba2-9cdc-7cd6677c0e1d service nova] Creating event network-vif-plugged:fea30c27-88ad-44fd-adf1-003e7ad336b1 for instance 5756e075-671a-41ca-b637-52fa8187643c on nch1-master-1 Oct 22 21:01:59.443593 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-6ce07dee-816b-4af7-b630-8e5b3d3c947f tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] [instance: 2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:01:59.450705 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-8e027470-e673-44c5-9e8c-73ffa3c2c338 req-9fe5843c-fb62-4ba2-9cdc-7cd6677c0e1d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067504 Oct 22 21:01:59.452231 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1347/2819] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:01:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:01:59.461736 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6ce07dee-816b-4af7-b630-8e5b3d3c947f tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:01:59.462246 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6ce07dee-816b-4af7-b630-8e5b3d3c947f tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:01:59.462791 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6ce07dee-816b-4af7-b630-8e5b3d3c947f tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:01:59.463631 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6ce07dee-816b-4af7-b630-8e5b3d3c947f tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:01:59.468745 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6ce07dee-816b-4af7-b630-8e5b3d3c947f tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:01:59.469215 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6ce07dee-816b-4af7-b630-8e5b3d3c947f tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:01:59.558110 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-7d1ca459-8c8c-4355-be68-7b2cab9cf295 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:01:59.558885 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-7d1ca459-8c8c-4355-be68-7b2cab9cf295 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] [instance: 9c2729a5-e874-43e7-a372-514906975851] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:01:59.578935 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7d1ca459-8c8c-4355-be68-7b2cab9cf295 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:01:59.581580 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7d1ca459-8c8c-4355-be68-7b2cab9cf295 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:01:59.582348 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7d1ca459-8c8c-4355-be68-7b2cab9cf295 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:01:59.586922 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7d1ca459-8c8c-4355-be68-7b2cab9cf295 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:01:59.587713 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7d1ca459-8c8c-4355-be68-7b2cab9cf295 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:01:59.590393 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7d1ca459-8c8c-4355-be68-7b2cab9cf295 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:02:00.112087 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-6ce07dee-816b-4af7-b630-8e5b3d3c947f tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:02:00.143484 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-6ce07dee-816b-4af7-b630-8e5b3d3c947f tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:02:00.146728 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-6ce07dee-816b-4af7-b630-8e5b3d3c947f tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:02:00.166565 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-6ce07dee-816b-4af7-b630-8e5b3d3c947f tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] 10.222.0.18 "GET /compute/v2.1/servers/2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac" status: 200 len: 1555 microversion: 2.91 time: 0.727718 Oct 22 21:02:00.167285 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1473/2820] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:01:59 2022] GET /compute/v2.1/servers/2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac => generated 1555 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 22 21:02:00.184618 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-9605ece8-18d7-4599-a713-750bcc33ebe1 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Calling method '.version_select at 0x7fd39fda50d0>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:02:00.423178 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-7d1ca459-8c8c-4355-be68-7b2cab9cf295 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a44ff8e7c14b94b1670f030085c43d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a26a2284f4424cbeaf63d504652546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:02:00.453906 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-7d1ca459-8c8c-4355-be68-7b2cab9cf295 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] 10.222.0.18 "GET /compute/v2.1/servers/9c2729a5-e874-43e7-a372-514906975851" status: 200 len: 1499 microversion: 2.1 time: 0.911140 Oct 22 21:02:00.466282 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1348/2821] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:01:59 2022] GET /compute/v2.1/servers/9c2729a5-e874-43e7-a372-514906975851 => generated 1499 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:02:00.485446 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-4d195dcb-1424-429f-9b9a-9b86745754ca tempest-ServerAddressesNegativeTestJSON-2002096545 tempest-ServerAddressesNegativeTestJSON-2002096545-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:02:00.486205 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-4d195dcb-1424-429f-9b9a-9b86745754ca tempest-ServerAddressesNegativeTestJSON-2002096545 tempest-ServerAddressesNegativeTestJSON-2002096545-project] [instance: 5756e075-671a-41ca-b637-52fa8187643c] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:02:00.495868 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4d195dcb-1424-429f-9b9a-9b86745754ca tempest-ServerAddressesNegativeTestJSON-2002096545 tempest-ServerAddressesNegativeTestJSON-2002096545-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:02:00.496900 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4d195dcb-1424-429f-9b9a-9b86745754ca tempest-ServerAddressesNegativeTestJSON-2002096545 tempest-ServerAddressesNegativeTestJSON-2002096545-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:02:00.497741 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4d195dcb-1424-429f-9b9a-9b86745754ca tempest-ServerAddressesNegativeTestJSON-2002096545 tempest-ServerAddressesNegativeTestJSON-2002096545-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:02:00.499614 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4d195dcb-1424-429f-9b9a-9b86745754ca tempest-ServerAddressesNegativeTestJSON-2002096545 tempest-ServerAddressesNegativeTestJSON-2002096545-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:02:00.500371 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4d195dcb-1424-429f-9b9a-9b86745754ca tempest-ServerAddressesNegativeTestJSON-2002096545 tempest-ServerAddressesNegativeTestJSON-2002096545-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:02:00.501066 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4d195dcb-1424-429f-9b9a-9b86745754ca tempest-ServerAddressesNegativeTestJSON-2002096545 tempest-ServerAddressesNegativeTestJSON-2002096545-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:02:01.356498 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-4d195dcb-1424-429f-9b9a-9b86745754ca tempest-ServerAddressesNegativeTestJSON-2002096545 tempest-ServerAddressesNegativeTestJSON-2002096545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03056f5218a647eead4192537f66a504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40e6cd40d3b74efcac7bd16343591315', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:02:01.382791 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-4d195dcb-1424-429f-9b9a-9b86745754ca tempest-ServerAddressesNegativeTestJSON-2002096545 tempest-ServerAddressesNegativeTestJSON-2002096545-project] 10.222.0.18 "GET /compute/v2.1/servers/5756e075-671a-41ca-b637-52fa8187643c" status: 200 len: 1325 microversion: 2.1 time: 0.911510 Oct 22 21:02:01.420101 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1349/2822] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:02:00 2022] GET /compute/v2.1/servers/5756e075-671a-41ca-b637-52fa8187643c => generated 1325 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:02:01.453494 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-1e7f06bb-c9a8-49c0-9efb-9c48377feabb tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:02:01.454823 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-1e7f06bb-c9a8-49c0-9efb-9c48377feabb tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] [instance: 321b545b-7228-4a30-bd7b-dcd827a0c747] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:02:01.479264 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1e7f06bb-c9a8-49c0-9efb-9c48377feabb tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:02:01.480304 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1e7f06bb-c9a8-49c0-9efb-9c48377feabb tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:02:01.480982 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1e7f06bb-c9a8-49c0-9efb-9c48377feabb tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:02:01.481938 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1e7f06bb-c9a8-49c0-9efb-9c48377feabb tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:02:01.482610 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1e7f06bb-c9a8-49c0-9efb-9c48377feabb tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:02:01.483265 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1e7f06bb-c9a8-49c0-9efb-9c48377feabb tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:02:01.931532 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-1e7f06bb-c9a8-49c0-9efb-9c48377feabb tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1b410a64e0415a96d30f5040361137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd7873d6db4e09bc9ab9a048a6b1ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:02:01.945340 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-1e7f06bb-c9a8-49c0-9efb-9c48377feabb tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] 10.222.0.18 "GET /compute/v2.1/servers/321b545b-7228-4a30-bd7b-dcd827a0c747" status: 200 len: 1488 microversion: 2.1 time: 0.515386 Oct 22 21:02:01.971251 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1350/2823] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:02:01 2022] GET /compute/v2.1/servers/321b545b-7228-4a30-bd7b-dcd827a0c747 => generated 1488 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:02:02.001298 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-45ffba20-9c5a-4808-8122-f8dd14079950 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:02:02.002283 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-45ffba20-9c5a-4808-8122-f8dd14079950 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] [instance: 2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:02:02.019015 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-45ffba20-9c5a-4808-8122-f8dd14079950 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:02:02.019932 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-45ffba20-9c5a-4808-8122-f8dd14079950 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:02:02.020573 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-45ffba20-9c5a-4808-8122-f8dd14079950 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:02:02.021515 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-45ffba20-9c5a-4808-8122-f8dd14079950 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:02:02.022146 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-45ffba20-9c5a-4808-8122-f8dd14079950 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:02:02.022756 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-45ffba20-9c5a-4808-8122-f8dd14079950 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:02:02.199219 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-45ffba20-9c5a-4808-8122-f8dd14079950 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:02:02.227833 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-45ffba20-9c5a-4808-8122-f8dd14079950 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:02:02.230431 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-45ffba20-9c5a-4808-8122-f8dd14079950 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:02:02.265192 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-45ffba20-9c5a-4808-8122-f8dd14079950 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] 10.222.0.18 "GET /compute/v2.1/servers/2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac" status: 200 len: 1555 microversion: 2.91 time: 0.293067 Oct 22 21:02:02.266092 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1351/2824] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:02:01 2022] GET /compute/v2.1/servers/2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac => generated 1555 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:02:02.283008 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-0c6e892c-50bd-42f1-a3a0-2adcb6e5fd39 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:02:02.294942 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-0c6e892c-50bd-42f1-a3a0-2adcb6e5fd39 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] [instance: 9c2729a5-e874-43e7-a372-514906975851] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:02:02.311189 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0c6e892c-50bd-42f1-a3a0-2adcb6e5fd39 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:02:02.318139 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0c6e892c-50bd-42f1-a3a0-2adcb6e5fd39 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:02:02.320509 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0c6e892c-50bd-42f1-a3a0-2adcb6e5fd39 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:02:02.325690 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0c6e892c-50bd-42f1-a3a0-2adcb6e5fd39 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:02:02.328083 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0c6e892c-50bd-42f1-a3a0-2adcb6e5fd39 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:02:02.336057 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0c6e892c-50bd-42f1-a3a0-2adcb6e5fd39 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:02:02.687628 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-0c6e892c-50bd-42f1-a3a0-2adcb6e5fd39 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a44ff8e7c14b94b1670f030085c43d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a26a2284f4424cbeaf63d504652546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:02:02.697035 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-0c6e892c-50bd-42f1-a3a0-2adcb6e5fd39 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] 10.222.0.18 "GET /compute/v2.1/servers/9c2729a5-e874-43e7-a372-514906975851" status: 200 len: 1499 microversion: 2.1 time: 0.424487 Oct 22 21:02:02.713000 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1352/2825] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:02:02 2022] GET /compute/v2.1/servers/9c2729a5-e874-43e7-a372-514906975851 => generated 1499 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:02:02.765260 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-770add02-8d6f-4807-91eb-0a8599371f8d tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:02:02.767712 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-770add02-8d6f-4807-91eb-0a8599371f8d tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] [instance: 321b545b-7228-4a30-bd7b-dcd827a0c747] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:02:02.780334 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-770add02-8d6f-4807-91eb-0a8599371f8d tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:02:02.781091 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-770add02-8d6f-4807-91eb-0a8599371f8d tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:02:02.784234 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-770add02-8d6f-4807-91eb-0a8599371f8d tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:02:02.787696 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-770add02-8d6f-4807-91eb-0a8599371f8d tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:02:02.788556 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-770add02-8d6f-4807-91eb-0a8599371f8d tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:02:02.789665 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-770add02-8d6f-4807-91eb-0a8599371f8d tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:02:02.825133 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-770add02-8d6f-4807-91eb-0a8599371f8d tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] [instance: 321b545b-7228-4a30-bd7b-dcd827a0c747] Going to try to terminate instance {{(pid=138744) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 21:02:02.968349 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-770add02-8d6f-4807-91eb-0a8599371f8d tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] 10.222.0.18 "DELETE /compute/v2.1/servers/321b545b-7228-4a30-bd7b-dcd827a0c747" status: 204 len: 0 microversion: 2.1 time: 0.227156 Oct 22 21:02:02.972918 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1353/2826] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 21:02:02 2022] DELETE /compute/v2.1/servers/321b545b-7228-4a30-bd7b-dcd827a0c747 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 21:02:02.983628 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-41b95e76-99e9-4259-9ec8-7f0a9ee48012 tempest-ServerAddressesNegativeTestJSON-2002096545 tempest-ServerAddressesNegativeTestJSON-2002096545-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:02:02.984866 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-41b95e76-99e9-4259-9ec8-7f0a9ee48012 tempest-ServerAddressesNegativeTestJSON-2002096545 tempest-ServerAddressesNegativeTestJSON-2002096545-project] [instance: 5756e075-671a-41ca-b637-52fa8187643c] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:02:02.993322 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-41b95e76-99e9-4259-9ec8-7f0a9ee48012 tempest-ServerAddressesNegativeTestJSON-2002096545 tempest-ServerAddressesNegativeTestJSON-2002096545-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:02:02.994122 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-41b95e76-99e9-4259-9ec8-7f0a9ee48012 tempest-ServerAddressesNegativeTestJSON-2002096545 tempest-ServerAddressesNegativeTestJSON-2002096545-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:02:02.994984 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-41b95e76-99e9-4259-9ec8-7f0a9ee48012 tempest-ServerAddressesNegativeTestJSON-2002096545 tempest-ServerAddressesNegativeTestJSON-2002096545-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:02:02.996241 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-41b95e76-99e9-4259-9ec8-7f0a9ee48012 tempest-ServerAddressesNegativeTestJSON-2002096545 tempest-ServerAddressesNegativeTestJSON-2002096545-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:02:02.996915 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-41b95e76-99e9-4259-9ec8-7f0a9ee48012 tempest-ServerAddressesNegativeTestJSON-2002096545 tempest-ServerAddressesNegativeTestJSON-2002096545-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:02:02.997499 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-41b95e76-99e9-4259-9ec8-7f0a9ee48012 tempest-ServerAddressesNegativeTestJSON-2002096545 tempest-ServerAddressesNegativeTestJSON-2002096545-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:02:03.701874 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-41b95e76-99e9-4259-9ec8-7f0a9ee48012 tempest-ServerAddressesNegativeTestJSON-2002096545 tempest-ServerAddressesNegativeTestJSON-2002096545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03056f5218a647eead4192537f66a504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40e6cd40d3b74efcac7bd16343591315', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:02:03.726805 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-41b95e76-99e9-4259-9ec8-7f0a9ee48012 tempest-ServerAddressesNegativeTestJSON-2002096545 tempest-ServerAddressesNegativeTestJSON-2002096545-project] 10.222.0.18 "GET /compute/v2.1/servers/5756e075-671a-41ca-b637-52fa8187643c" status: 200 len: 1521 microversion: 2.1 time: 0.748490 Oct 22 21:02:03.731196 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1354/2827] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:02:02 2022] GET /compute/v2.1/servers/5756e075-671a-41ca-b637-52fa8187643c => generated 1521 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:02:03.731196 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-52845e4a-eec4-4321-8203-3e3f455a687d tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:02:03.731196 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-52845e4a-eec4-4321-8203-3e3f455a687d tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] [instance: f38f14b2-b9d7-4bed-92ba-7b95ea4b2270] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:02:03.780301 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-52845e4a-eec4-4321-8203-3e3f455a687d tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:02:03.780806 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-52845e4a-eec4-4321-8203-3e3f455a687d tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:02:03.781253 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-52845e4a-eec4-4321-8203-3e3f455a687d tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:02:03.782117 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-52845e4a-eec4-4321-8203-3e3f455a687d tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:02:03.782578 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-52845e4a-eec4-4321-8203-3e3f455a687d tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:02:03.783103 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-52845e4a-eec4-4321-8203-3e3f455a687d tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:02:04.674965 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-52845e4a-eec4-4321-8203-3e3f455a687d tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211483c6acea4f76b6c0e4bfc818e7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd687d54e07d4ab4af00ad801ef4b58d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:02:04.689491 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-52845e4a-eec4-4321-8203-3e3f455a687d tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '211483c6acea4f76b6c0e4bfc818e7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd687d54e07d4ab4af00ad801ef4b58d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:02:04.691674 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-52845e4a-eec4-4321-8203-3e3f455a687d tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '211483c6acea4f76b6c0e4bfc818e7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd687d54e07d4ab4af00ad801ef4b58d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:02:04.693304 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-52845e4a-eec4-4321-8203-3e3f455a687d tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] 10.222.0.18 "GET /compute/v2.1/servers/f38f14b2-b9d7-4bed-92ba-7b95ea4b2270" status: 200 len: 2950 microversion: 2.42 time: 0.959435 Oct 22 21:02:04.694383 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1355/2828] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:02:03 2022] GET /compute/v2.1/servers/f38f14b2-b9d7-4bed-92ba-7b95ea4b2270 => generated 2950 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:02:04.729881 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-95123099-cab0-4cc2-8973-33e919aa00d4 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:02:04.734371 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-95123099-cab0-4cc2-8973-33e919aa00d4 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] [instance: 321b545b-7228-4a30-bd7b-dcd827a0c747] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:02:04.744216 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-95123099-cab0-4cc2-8973-33e919aa00d4 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:02:04.746397 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-95123099-cab0-4cc2-8973-33e919aa00d4 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:02:04.747589 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-95123099-cab0-4cc2-8973-33e919aa00d4 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:02:04.748651 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-95123099-cab0-4cc2-8973-33e919aa00d4 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:02:04.749358 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-95123099-cab0-4cc2-8973-33e919aa00d4 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:02:04.750074 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-95123099-cab0-4cc2-8973-33e919aa00d4 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:02:05.099131 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-95123099-cab0-4cc2-8973-33e919aa00d4 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1b410a64e0415a96d30f5040361137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd7873d6db4e09bc9ab9a048a6b1ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:02:05.143215 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-95123099-cab0-4cc2-8973-33e919aa00d4 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] 10.222.0.18 "GET /compute/v2.1/servers/321b545b-7228-4a30-bd7b-dcd827a0c747" status: 200 len: 1494 microversion: 2.1 time: 0.427049 Oct 22 21:02:05.145614 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1356/2829] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:02:04 2022] GET /compute/v2.1/servers/321b545b-7228-4a30-bd7b-dcd827a0c747 => generated 1494 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:02:05.175413 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-e3f4844d-ed90-4186-912c-31804daee4ec tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:02:05.175997 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-e3f4844d-ed90-4186-912c-31804daee4ec tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] [instance: 2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:02:05.186924 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e3f4844d-ed90-4186-912c-31804daee4ec tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:02:05.195417 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e3f4844d-ed90-4186-912c-31804daee4ec tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:02:05.196291 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e3f4844d-ed90-4186-912c-31804daee4ec tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:02:05.197732 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e3f4844d-ed90-4186-912c-31804daee4ec tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:02:05.198446 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e3f4844d-ed90-4186-912c-31804daee4ec tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:02:05.199070 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e3f4844d-ed90-4186-912c-31804daee4ec tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:02:05.458017 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-e3f4844d-ed90-4186-912c-31804daee4ec tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:02:05.462684 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:02:05.479384 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-e3f4844d-ed90-4186-912c-31804daee4ec tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:02:05.482672 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-e3f4844d-ed90-4186-912c-31804daee4ec tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:02:05.498464 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-e3f4844d-ed90-4186-912c-31804daee4ec tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] 10.222.0.18 "GET /compute/v2.1/servers/2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac" status: 200 len: 1555 microversion: 2.91 time: 0.337238 Oct 22 21:02:05.500051 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1357/2830] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:02:05 2022] GET /compute/v2.1/servers/2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac => generated 1555 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:02:05.509464 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-6bea1aba-738b-447d-b908-25d598d2cb38 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:02:05.515616 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-6bea1aba-738b-447d-b908-25d598d2cb38 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] [instance: 9c2729a5-e874-43e7-a372-514906975851] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:02:05.536794 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6bea1aba-738b-447d-b908-25d598d2cb38 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:02:05.537705 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6bea1aba-738b-447d-b908-25d598d2cb38 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:02:05.538521 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6bea1aba-738b-447d-b908-25d598d2cb38 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:02:05.541721 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6bea1aba-738b-447d-b908-25d598d2cb38 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:02:05.543438 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6bea1aba-738b-447d-b908-25d598d2cb38 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:02:05.544211 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6bea1aba-738b-447d-b908-25d598d2cb38 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:02:06.355991 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-6bea1aba-738b-447d-b908-25d598d2cb38 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a44ff8e7c14b94b1670f030085c43d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a26a2284f4424cbeaf63d504652546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:02:06.370915 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-6bea1aba-738b-447d-b908-25d598d2cb38 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] 10.222.0.18 "GET /compute/v2.1/servers/9c2729a5-e874-43e7-a372-514906975851" status: 200 len: 1499 microversion: 2.1 time: 0.867419 Oct 22 21:02:06.384655 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1358/2831] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:02:05 2022] GET /compute/v2.1/servers/9c2729a5-e874-43e7-a372-514906975851 => generated 1499 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:02:06.401628 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-d707a5d4-98a4-47f0-adda-3d9b97afedca tempest-ServerAddressesNegativeTestJSON-2002096545 tempest-ServerAddressesNegativeTestJSON-2002096545-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:02:06.406414 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-d707a5d4-98a4-47f0-adda-3d9b97afedca tempest-ServerAddressesNegativeTestJSON-2002096545 tempest-ServerAddressesNegativeTestJSON-2002096545-project] [instance: 5756e075-671a-41ca-b637-52fa8187643c] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:02:06.429609 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d707a5d4-98a4-47f0-adda-3d9b97afedca tempest-ServerAddressesNegativeTestJSON-2002096545 tempest-ServerAddressesNegativeTestJSON-2002096545-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:02:06.430482 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d707a5d4-98a4-47f0-adda-3d9b97afedca tempest-ServerAddressesNegativeTestJSON-2002096545 tempest-ServerAddressesNegativeTestJSON-2002096545-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:02:06.431125 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d707a5d4-98a4-47f0-adda-3d9b97afedca tempest-ServerAddressesNegativeTestJSON-2002096545 tempest-ServerAddressesNegativeTestJSON-2002096545-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:02:06.435323 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d707a5d4-98a4-47f0-adda-3d9b97afedca tempest-ServerAddressesNegativeTestJSON-2002096545 tempest-ServerAddressesNegativeTestJSON-2002096545-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:02:06.436133 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d707a5d4-98a4-47f0-adda-3d9b97afedca tempest-ServerAddressesNegativeTestJSON-2002096545 tempest-ServerAddressesNegativeTestJSON-2002096545-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:02:06.436750 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d707a5d4-98a4-47f0-adda-3d9b97afedca tempest-ServerAddressesNegativeTestJSON-2002096545 tempest-ServerAddressesNegativeTestJSON-2002096545-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:02:06.527276 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-d707a5d4-98a4-47f0-adda-3d9b97afedca tempest-ServerAddressesNegativeTestJSON-2002096545 tempest-ServerAddressesNegativeTestJSON-2002096545-project] HTTP exception thrown: Instance is not a member of specified network Oct 22 21:02:06.557049 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-d707a5d4-98a4-47f0-adda-3d9b97afedca tempest-ServerAddressesNegativeTestJSON-2002096545 tempest-ServerAddressesNegativeTestJSON-2002096545-project] Request method failure captured: Oct 22 21:02:06.557049 ncdv-master-1 devstack@n-api.service[138744]: request: GET /compute/v2.1/servers/5756e075-671a-41ca-b637-52fa8187643c/ips/invalid HTTP/1.1 Oct 22 21:02:06.557049 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 21:02:06.557049 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 21:02:06.557049 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 21:02:06.557049 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 0 Oct 22 21:02:06.557049 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 21:02:06.557049 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 21:02:06.557049 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 21:02:06.557049 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 21:02:06.557049 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVFowcUO6brhAVymhQm4FWl6Xut2IJcI21E9TP5E0LpDmUNSngWLHeOGZl0YCqkY-Q2h9-JYSM4mcOuAQKWkyJvwjlnuh2k5MzDdcvtkJ4k1Grw88ut7PQhKwd2pHQvhETQ2lSD8q0PAkC4v784TGd0mJDD2HX7hfbB3mzk3UB38TdVA Oct 22 21:02:06.557049 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 21:02:06.557049 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 21:02:06.557049 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 21:02:06.557049 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 21:02:06.557049 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 21:02:06.557049 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 21:02:06.557049 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: 40e6cd40d3b74efcac7bd16343591315 Oct 22 21:02:06.557049 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-2002096545 Oct 22 21:02:06.557049 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 21:02:06.557049 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 21:02:06.557049 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_40e6cd40d3b74efcac7bd16343591315"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/40e6cd40d3b74efcac7bd16343591315"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/40e6cd40d3b74efcac7bd16343591315"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/40e6cd40d3b74efcac7bd16343591315"}]}] Oct 22 21:02:06.557049 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-2002096545 Oct 22 21:02:06.557049 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: 40e6cd40d3b74efcac7bd16343591315 Oct 22 21:02:06.557049 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-2002096545 Oct 22 21:02:06.557049 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-ServerAddressesNegativeTestJSON-2002096545-project Oct 22 21:02:06.557049 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 21:02:06.557049 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 21:02:06.557049 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: 03056f5218a647eead4192537f66a504 Oct 22 21:02:06.557049 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-2002096545-project Oct 22 21:02:06.557049 ncdv-master-1 devstack@n-api.service[138744]: method: > Oct 22 21:02:06.557049 ncdv-master-1 devstack@n-api.service[138744]: exception: Instance is not a member of specified network Oct 22 21:02:06.557049 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'server_id': '5756e075-671a-41ca-b637-52fa8187643c', 'id': 'invalid'} Oct 22 21:02:06.557049 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:02:06.557049 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:02:06.557049 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:02:06.557049 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:02:06.557049 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:02:06.557049 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:02:06.557049 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:02:06.557049 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:02:06.557049 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 52, in show Oct 22 21:02:06.557049 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 22 21:02:06.557049 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance is not a member of specified network Oct 22 21:02:06.557049 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:02:06.557049 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:02:06.557049 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:02:06.557049 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:02:06.557049 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:02:06.557049 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:02:06.557049 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:02:06.557049 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:02:06.557049 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance is not a member of specified network Oct 22 21:02:06.557049 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:02:06.562786 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-d707a5d4-98a4-47f0-adda-3d9b97afedca tempest-ServerAddressesNegativeTestJSON-2002096545 tempest-ServerAddressesNegativeTestJSON-2002096545-project] Returning 404 to user: Instance is not a member of specified network {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:02:06.563924 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-d707a5d4-98a4-47f0-adda-3d9b97afedca tempest-ServerAddressesNegativeTestJSON-2002096545 tempest-ServerAddressesNegativeTestJSON-2002096545-project] 10.222.0.18 "GET /compute/v2.1/servers/5756e075-671a-41ca-b637-52fa8187643c/ips/invalid" status: 404 len: 91 microversion: 2.1 time: 0.178084 Oct 22 21:02:06.564691 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1359/2832] 10.222.0.18 () {58 vars in 1272 bytes} [Sat Oct 22 21:02:06 2022] GET /compute/v2.1/servers/5756e075-671a-41ca-b637-52fa8187643c/ips/invalid => generated 91 bytes in 179 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 22 21:02:06.613242 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-ee8533dd-c4b1-4323-9687-798b47d99eb8 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:02:06.614038 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-ee8533dd-c4b1-4323-9687-798b47d99eb8 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] [instance: f38f14b2-b9d7-4bed-92ba-7b95ea4b2270] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:02:06.661152 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ee8533dd-c4b1-4323-9687-798b47d99eb8 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:02:06.666417 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ee8533dd-c4b1-4323-9687-798b47d99eb8 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:02:06.667032 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ee8533dd-c4b1-4323-9687-798b47d99eb8 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:02:06.670689 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ee8533dd-c4b1-4323-9687-798b47d99eb8 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:02:06.671036 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ee8533dd-c4b1-4323-9687-798b47d99eb8 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:02:06.675014 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ee8533dd-c4b1-4323-9687-798b47d99eb8 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:02:07.213728 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-ee8533dd-c4b1-4323-9687-798b47d99eb8 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] 10.222.0.18 "GET /compute/v2.1/servers/f38f14b2-b9d7-4bed-92ba-7b95ea4b2270/os-interface" status: 200 len: 1830 microversion: 2.42 time: 0.647723 Oct 22 21:02:07.214630 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1360/2833] 10.222.0.18 () {60 vars in 1316 bytes} [Sat Oct 22 21:02:06 2022] GET /compute/v2.1/servers/f38f14b2-b9d7-4bed-92ba-7b95ea4b2270/os-interface => generated 1830 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:02:07.219724 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-03279ba8-dd4f-4440-8a7c-0a76220540e9 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:02:07.222430 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-03279ba8-dd4f-4440-8a7c-0a76220540e9 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] [instance: 321b545b-7228-4a30-bd7b-dcd827a0c747] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:02:07.243466 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-03279ba8-dd4f-4440-8a7c-0a76220540e9 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:02:07.246831 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-03279ba8-dd4f-4440-8a7c-0a76220540e9 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:02:07.247646 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-03279ba8-dd4f-4440-8a7c-0a76220540e9 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:02:07.248602 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-03279ba8-dd4f-4440-8a7c-0a76220540e9 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:02:07.259662 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-03279ba8-dd4f-4440-8a7c-0a76220540e9 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:02:07.260465 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-03279ba8-dd4f-4440-8a7c-0a76220540e9 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:02:07.379934 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-03279ba8-dd4f-4440-8a7c-0a76220540e9 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:02:07.380820 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-03279ba8-dd4f-4440-8a7c-0a76220540e9 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:02:07.389884 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-03279ba8-dd4f-4440-8a7c-0a76220540e9 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:02:07.390416 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.objects.instance [None req-03279ba8-dd4f-4440-8a7c-0a76220540e9 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lazy-loading 'fault' on Instance uuid 321b545b-7228-4a30-bd7b-dcd827a0c747 {{(pid=138744) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 21:02:07.579910 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-03279ba8-dd4f-4440-8a7c-0a76220540e9 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1b410a64e0415a96d30f5040361137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd7873d6db4e09bc9ab9a048a6b1ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:02:07.609168 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-03279ba8-dd4f-4440-8a7c-0a76220540e9 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] 10.222.0.18 "GET /compute/v2.1/servers/321b545b-7228-4a30-bd7b-dcd827a0c747" status: 200 len: 1305 microversion: 2.1 time: 0.389979 Oct 22 21:02:07.609951 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1361/2834] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:02:07 2022] GET /compute/v2.1/servers/321b545b-7228-4a30-bd7b-dcd827a0c747 => generated 1305 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:02:07.636458 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-e768c2cb-8f69-44c0-91a8-f5948f60a660 req-4c39a5b7-9b4e-4a9d-9e72-8c1ae2bcf960 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "321b545b-7228-4a30-bd7b-dcd827a0c747", "name": "network-vif-deleted", "tag": "3c32aabf-b19e-478d-8bdc-01ceb7dddb88"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:02:07.686308 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-e768c2cb-8f69-44c0-91a8-f5948f60a660 req-4c39a5b7-9b4e-4a9d-9e72-8c1ae2bcf960 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:02:07.687145 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-e768c2cb-8f69-44c0-91a8-f5948f60a660 req-4c39a5b7-9b4e-4a9d-9e72-8c1ae2bcf960 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:02:07.687915 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-e768c2cb-8f69-44c0-91a8-f5948f60a660 req-4c39a5b7-9b4e-4a9d-9e72-8c1ae2bcf960 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:02:07.790065 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-e768c2cb-8f69-44c0-91a8-f5948f60a660 req-4c39a5b7-9b4e-4a9d-9e72-8c1ae2bcf960 service nova] Creating event network-vif-deleted:3c32aabf-b19e-478d-8bdc-01ceb7dddb88 for instance 321b545b-7228-4a30-bd7b-dcd827a0c747 on nch1-master-1 Oct 22 21:02:07.812313 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-e768c2cb-8f69-44c0-91a8-f5948f60a660 req-4c39a5b7-9b4e-4a9d-9e72-8c1ae2bcf960 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.194942 Oct 22 21:02:07.815774 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1362/2835] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:02:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:02:07.833642 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-8aa6b8f8-367e-461b-991a-6f22f6f839df tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:02:07.834400 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-8aa6b8f8-367e-461b-991a-6f22f6f839df tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] [instance: 2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:02:07.855425 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8aa6b8f8-367e-461b-991a-6f22f6f839df tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:02:07.855937 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8aa6b8f8-367e-461b-991a-6f22f6f839df tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:02:07.856386 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8aa6b8f8-367e-461b-991a-6f22f6f839df tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:02:07.857109 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8aa6b8f8-367e-461b-991a-6f22f6f839df tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:02:07.864553 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8aa6b8f8-367e-461b-991a-6f22f6f839df tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:02:07.866192 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8aa6b8f8-367e-461b-991a-6f22f6f839df tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:02:08.158945 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-8aa6b8f8-367e-461b-991a-6f22f6f839df tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:02:08.179779 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-8aa6b8f8-367e-461b-991a-6f22f6f839df tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:02:08.182027 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-8aa6b8f8-367e-461b-991a-6f22f6f839df tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:02:08.193833 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-8aa6b8f8-367e-461b-991a-6f22f6f839df tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] 10.222.0.18 "GET /compute/v2.1/servers/2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac" status: 200 len: 1555 microversion: 2.91 time: 0.376612 Oct 22 21:02:08.196238 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1363/2836] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:02:07 2022] GET /compute/v2.1/servers/2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac => generated 1555 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:02:08.209867 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-b3d7061b-390f-4962-be3e-7293721d98d8 tempest-ServerAddressesNegativeTestJSON-2002096545 tempest-ServerAddressesNegativeTestJSON-2002096545-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:02:08.211183 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-b3d7061b-390f-4962-be3e-7293721d98d8 tempest-ServerAddressesNegativeTestJSON-2002096545 tempest-ServerAddressesNegativeTestJSON-2002096545-project] Failed to fetch instance by id 999 {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 22 21:02:08.212034 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-b3d7061b-390f-4962-be3e-7293721d98d8 tempest-ServerAddressesNegativeTestJSON-2002096545 tempest-ServerAddressesNegativeTestJSON-2002096545-project] HTTP exception thrown: Instance 999 could not be found. Oct 22 21:02:08.214832 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-b3d7061b-390f-4962-be3e-7293721d98d8 tempest-ServerAddressesNegativeTestJSON-2002096545 tempest-ServerAddressesNegativeTestJSON-2002096545-project] Request method failure captured: Oct 22 21:02:08.214832 ncdv-master-1 devstack@n-api.service[138744]: request: GET /compute/v2.1/servers/999/ips HTTP/1.1 Oct 22 21:02:08.214832 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 21:02:08.214832 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 21:02:08.214832 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 21:02:08.214832 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 0 Oct 22 21:02:08.214832 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 21:02:08.214832 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 21:02:08.214832 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 21:02:08.214832 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 21:02:08.214832 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVFowcUO6brhAVymhQm4FWl6Xut2IJcI21E9TP5E0LpDmUNSngWLHeOGZl0YCqkY-Q2h9-JYSM4mcOuAQKWkyJvwjlnuh2k5MzDdcvtkJ4k1Grw88ut7PQhKwd2pHQvhETQ2lSD8q0PAkC4v784TGd0mJDD2HX7hfbB3mzk3UB38TdVA Oct 22 21:02:08.214832 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 21:02:08.214832 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 21:02:08.214832 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 21:02:08.214832 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 21:02:08.214832 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 21:02:08.214832 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 21:02:08.214832 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: 40e6cd40d3b74efcac7bd16343591315 Oct 22 21:02:08.214832 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-2002096545 Oct 22 21:02:08.214832 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 21:02:08.214832 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 21:02:08.214832 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_40e6cd40d3b74efcac7bd16343591315"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/40e6cd40d3b74efcac7bd16343591315"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/40e6cd40d3b74efcac7bd16343591315"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/40e6cd40d3b74efcac7bd16343591315"}]}] Oct 22 21:02:08.214832 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-2002096545 Oct 22 21:02:08.214832 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: 40e6cd40d3b74efcac7bd16343591315 Oct 22 21:02:08.214832 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-2002096545 Oct 22 21:02:08.214832 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-ServerAddressesNegativeTestJSON-2002096545-project Oct 22 21:02:08.214832 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 21:02:08.214832 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 21:02:08.214832 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: 03056f5218a647eead4192537f66a504 Oct 22 21:02:08.214832 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-2002096545-project Oct 22 21:02:08.214832 ncdv-master-1 devstack@n-api.service[138744]: method: > Oct 22 21:02:08.214832 ncdv-master-1 devstack@n-api.service[138744]: exception: Instance 999 could not be found. Oct 22 21:02:08.214832 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'server_id': '999'} Oct 22 21:02:08.214832 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:02:08.214832 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:02:08.214832 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 21:02:08.214832 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 21:02:08.214832 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 22 21:02:08.214832 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 22 21:02:08.214832 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Oct 22 21:02:08.214832 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:02:08.214832 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:02:08.214832 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:02:08.214832 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:02:08.214832 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:02:08.214832 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:02:08.214832 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:02:08.214832 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:02:08.214832 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:02:08.214832 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:02:08.214832 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 37, in index Oct 22 21:02:08.214832 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self._compute_api, context, server_id) Oct 22 21:02:08.214832 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 21:02:08.214832 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:02:08.214832 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Oct 22 21:02:08.214832 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:02:08.214832 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:02:08.214832 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:02:08.214832 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:02:08.214832 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:02:08.214832 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:02:08.214832 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:02:08.214832 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:02:08.214832 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Oct 22 21:02:08.214832 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:02:08.228246 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-b3d7061b-390f-4962-be3e-7293721d98d8 tempest-ServerAddressesNegativeTestJSON-2002096545 tempest-ServerAddressesNegativeTestJSON-2002096545-project] Returning 404 to user: Instance 999 could not be found. {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:02:08.230896 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-b3d7061b-390f-4962-be3e-7293721d98d8 tempest-ServerAddressesNegativeTestJSON-2002096545 tempest-ServerAddressesNegativeTestJSON-2002096545-project] 10.222.0.18 "GET /compute/v2.1/servers/999/ips" status: 404 len: 78 microversion: 2.1 time: 0.031963 Oct 22 21:02:08.231762 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1364/2837] 10.222.0.18 () {58 vars in 1149 bytes} [Sat Oct 22 21:02:08 2022] GET /compute/v2.1/servers/999/ips => generated 78 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 22 21:02:08.247998 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-c5f17295-3aea-4587-8f95-d3d8e21eb4fa tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:02:08.249133 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-c5f17295-3aea-4587-8f95-d3d8e21eb4fa tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] [instance: 9c2729a5-e874-43e7-a372-514906975851] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:02:08.258978 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c5f17295-3aea-4587-8f95-d3d8e21eb4fa tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:02:08.259947 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c5f17295-3aea-4587-8f95-d3d8e21eb4fa tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:02:08.260930 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c5f17295-3aea-4587-8f95-d3d8e21eb4fa tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:02:08.261939 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c5f17295-3aea-4587-8f95-d3d8e21eb4fa tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:02:08.262829 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c5f17295-3aea-4587-8f95-d3d8e21eb4fa tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:02:08.263531 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c5f17295-3aea-4587-8f95-d3d8e21eb4fa tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:02:08.702671 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-c5f17295-3aea-4587-8f95-d3d8e21eb4fa tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a44ff8e7c14b94b1670f030085c43d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a26a2284f4424cbeaf63d504652546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:02:08.718787 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-c5f17295-3aea-4587-8f95-d3d8e21eb4fa tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] 10.222.0.18 "GET /compute/v2.1/servers/9c2729a5-e874-43e7-a372-514906975851" status: 200 len: 1499 microversion: 2.1 time: 0.480783 Oct 22 21:02:08.719752 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1365/2838] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:02:08 2022] GET /compute/v2.1/servers/9c2729a5-e874-43e7-a372-514906975851 => generated 1499 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:02:08.745818 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-51adaa48-92e4-4e38-98b2-829ba30f0d69 tempest-ServerAddressesNegativeTestJSON-2002096545 tempest-ServerAddressesNegativeTestJSON-2002096545-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:02:08.747727 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-51adaa48-92e4-4e38-98b2-829ba30f0d69 tempest-ServerAddressesNegativeTestJSON-2002096545 tempest-ServerAddressesNegativeTestJSON-2002096545-project] [instance: 5756e075-671a-41ca-b637-52fa8187643c] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:02:08.762312 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-51adaa48-92e4-4e38-98b2-829ba30f0d69 tempest-ServerAddressesNegativeTestJSON-2002096545 tempest-ServerAddressesNegativeTestJSON-2002096545-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:02:08.763775 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-51adaa48-92e4-4e38-98b2-829ba30f0d69 tempest-ServerAddressesNegativeTestJSON-2002096545 tempest-ServerAddressesNegativeTestJSON-2002096545-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:02:08.766339 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-51adaa48-92e4-4e38-98b2-829ba30f0d69 tempest-ServerAddressesNegativeTestJSON-2002096545 tempest-ServerAddressesNegativeTestJSON-2002096545-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:02:08.767479 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-51adaa48-92e4-4e38-98b2-829ba30f0d69 tempest-ServerAddressesNegativeTestJSON-2002096545 tempest-ServerAddressesNegativeTestJSON-2002096545-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:02:08.768188 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-51adaa48-92e4-4e38-98b2-829ba30f0d69 tempest-ServerAddressesNegativeTestJSON-2002096545 tempest-ServerAddressesNegativeTestJSON-2002096545-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:02:08.770004 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-51adaa48-92e4-4e38-98b2-829ba30f0d69 tempest-ServerAddressesNegativeTestJSON-2002096545 tempest-ServerAddressesNegativeTestJSON-2002096545-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:02:08.844084 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-51adaa48-92e4-4e38-98b2-829ba30f0d69 tempest-ServerAddressesNegativeTestJSON-2002096545 tempest-ServerAddressesNegativeTestJSON-2002096545-project] [instance: 5756e075-671a-41ca-b637-52fa8187643c] Going to try to terminate instance {{(pid=138744) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 21:02:09.029728 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-51adaa48-92e4-4e38-98b2-829ba30f0d69 tempest-ServerAddressesNegativeTestJSON-2002096545 tempest-ServerAddressesNegativeTestJSON-2002096545-project] 10.222.0.18 "DELETE /compute/v2.1/servers/5756e075-671a-41ca-b637-52fa8187643c" status: 204 len: 0 microversion: 2.1 time: 0.296179 Oct 22 21:02:09.030890 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1366/2839] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 21:02:08 2022] DELETE /compute/v2.1/servers/5756e075-671a-41ca-b637-52fa8187643c => generated 0 bytes in 311 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 21:02:09.040828 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-b3646b37-316c-4d19-8690-133e564de10d tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:02:09.041932 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-b3646b37-316c-4d19-8690-133e564de10d tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] [instance: 321b545b-7228-4a30-bd7b-dcd827a0c747] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:02:09.067017 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b3646b37-316c-4d19-8690-133e564de10d tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:02:09.067986 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b3646b37-316c-4d19-8690-133e564de10d tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:02:09.068688 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b3646b37-316c-4d19-8690-133e564de10d tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:02:09.069632 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b3646b37-316c-4d19-8690-133e564de10d tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:02:09.070461 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b3646b37-316c-4d19-8690-133e564de10d tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:02:09.071406 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b3646b37-316c-4d19-8690-133e564de10d tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:02:09.113216 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-b3646b37-316c-4d19-8690-133e564de10d tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] HTTP exception thrown: Instance 321b545b-7228-4a30-bd7b-dcd827a0c747 could not be found. Oct 22 21:02:09.115333 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-b3646b37-316c-4d19-8690-133e564de10d tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Request method failure captured: Oct 22 21:02:09.115333 ncdv-master-1 devstack@n-api.service[138744]: request: GET /compute/v2.1/servers/321b545b-7228-4a30-bd7b-dcd827a0c747 HTTP/1.1 Oct 22 21:02:09.115333 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 21:02:09.115333 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 21:02:09.115333 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 21:02:09.115333 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 0 Oct 22 21:02:09.115333 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 21:02:09.115333 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 21:02:09.115333 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 21:02:09.115333 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 21:02:09.115333 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVFnfV28M622GxgIau9tfOtpQOzUe_Zks3cnq6zOgmdqQwk77RE2xHy9F74fRKXOoFFtdLiZlk8HWakwyjiKYmRp9GaMJF70RmWqk8on_rfYCWM12-ITQGodTkqOwwxslvC1Btdt7aRnJVFyVeqFX--IHdQyw_AkPLTYKSNTzj-OnnLE Oct 22 21:02:09.115333 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 21:02:09.115333 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 21:02:09.115333 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 21:02:09.115333 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 21:02:09.115333 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 21:02:09.115333 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 21:02:09.115333 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: b4cd7873d6db4e09bc9ab9a048a6b1ef Oct 22 21:02:09.115333 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-DeleteServersTestJSON-1244431593 Oct 22 21:02:09.115333 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 21:02:09.115333 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 21:02:09.115333 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_b4cd7873d6db4e09bc9ab9a048a6b1ef"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b4cd7873d6db4e09bc9ab9a048a6b1ef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/b4cd7873d6db4e09bc9ab9a048a6b1ef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b4cd7873d6db4e09bc9ab9a048a6b1ef"}]}] Oct 22 21:02:09.115333 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-DeleteServersTestJSON-1244431593 Oct 22 21:02:09.115333 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: b4cd7873d6db4e09bc9ab9a048a6b1ef Oct 22 21:02:09.115333 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-DeleteServersTestJSON-1244431593 Oct 22 21:02:09.115333 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-DeleteServersTestJSON-1244431593-project Oct 22 21:02:09.115333 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 21:02:09.115333 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 21:02:09.115333 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: be1b410a64e0415a96d30f5040361137 Oct 22 21:02:09.115333 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-DeleteServersTestJSON-1244431593-project Oct 22 21:02:09.115333 ncdv-master-1 devstack@n-api.service[138744]: method: > Oct 22 21:02:09.115333 ncdv-master-1 devstack@n-api.service[138744]: exception: Instance 321b545b-7228-4a30-bd7b-dcd827a0c747 could not be found. Oct 22 21:02:09.115333 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': '321b545b-7228-4a30-bd7b-dcd827a0c747'} Oct 22 21:02:09.115333 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:02:09.115333 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:02:09.115333 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 21:02:09.115333 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 21:02:09.115333 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 21:02:09.115333 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 21:02:09.115333 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 21:02:09.115333 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 21:02:09.115333 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 21:02:09.115333 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 21:02:09.115333 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 321b545b-7228-4a30-bd7b-dcd827a0c747 could not be found. Oct 22 21:02:09.115333 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:02:09.115333 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:02:09.115333 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:02:09.115333 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:02:09.115333 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:02:09.115333 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:02:09.115333 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:02:09.115333 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:02:09.115333 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:02:09.115333 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:02:09.115333 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 21:02:09.115333 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 21:02:09.115333 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 21:02:09.115333 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 21:02:09.115333 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 21:02:09.115333 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:02:09.115333 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 321b545b-7228-4a30-bd7b-dcd827a0c747 could not be found. Oct 22 21:02:09.115333 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:02:09.115333 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:02:09.115333 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:02:09.124969 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:02:09.124969 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:02:09.124969 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:02:09.124969 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:02:09.124969 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:02:09.124969 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 321b545b-7228-4a30-bd7b-dcd827a0c747 could not be found. Oct 22 21:02:09.124969 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:02:09.129400 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-b3646b37-316c-4d19-8690-133e564de10d tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Returning 404 to user: Instance 321b545b-7228-4a30-bd7b-dcd827a0c747 could not be found. {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:02:09.131561 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-b3646b37-316c-4d19-8690-133e564de10d tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] 10.222.0.18 "GET /compute/v2.1/servers/321b545b-7228-4a30-bd7b-dcd827a0c747" status: 404 len: 111 microversion: 2.1 time: 0.099005 Oct 22 21:02:09.133001 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1367/2840] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:02:09 2022] GET /compute/v2.1/servers/321b545b-7228-4a30-bd7b-dcd827a0c747 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 21:02:09.141107 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-fc4cbac0-7203-4f26-909e-b2254834111e tempest-ServerAddressesNegativeTestJSON-2002096545 tempest-ServerAddressesNegativeTestJSON-2002096545-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:02:09.142429 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-fc4cbac0-7203-4f26-909e-b2254834111e tempest-ServerAddressesNegativeTestJSON-2002096545 tempest-ServerAddressesNegativeTestJSON-2002096545-project] [instance: 5756e075-671a-41ca-b637-52fa8187643c] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:02:09.159299 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fc4cbac0-7203-4f26-909e-b2254834111e tempest-ServerAddressesNegativeTestJSON-2002096545 tempest-ServerAddressesNegativeTestJSON-2002096545-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:02:09.160294 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fc4cbac0-7203-4f26-909e-b2254834111e tempest-ServerAddressesNegativeTestJSON-2002096545 tempest-ServerAddressesNegativeTestJSON-2002096545-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:02:09.160991 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fc4cbac0-7203-4f26-909e-b2254834111e tempest-ServerAddressesNegativeTestJSON-2002096545 tempest-ServerAddressesNegativeTestJSON-2002096545-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:02:09.162012 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fc4cbac0-7203-4f26-909e-b2254834111e tempest-ServerAddressesNegativeTestJSON-2002096545 tempest-ServerAddressesNegativeTestJSON-2002096545-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:02:09.163072 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fc4cbac0-7203-4f26-909e-b2254834111e tempest-ServerAddressesNegativeTestJSON-2002096545 tempest-ServerAddressesNegativeTestJSON-2002096545-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:02:09.163894 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fc4cbac0-7203-4f26-909e-b2254834111e tempest-ServerAddressesNegativeTestJSON-2002096545 tempest-ServerAddressesNegativeTestJSON-2002096545-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:02:10.128682 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell1:SELECT=20,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:02:10.166475 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:02:10.207612 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-fc4cbac0-7203-4f26-909e-b2254834111e tempest-ServerAddressesNegativeTestJSON-2002096545 tempest-ServerAddressesNegativeTestJSON-2002096545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03056f5218a647eead4192537f66a504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40e6cd40d3b74efcac7bd16343591315', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:02:10.233853 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-fc4cbac0-7203-4f26-909e-b2254834111e tempest-ServerAddressesNegativeTestJSON-2002096545 tempest-ServerAddressesNegativeTestJSON-2002096545-project] 10.222.0.18 "GET /compute/v2.1/servers/5756e075-671a-41ca-b637-52fa8187643c" status: 200 len: 1527 microversion: 2.1 time: 1.095839 Oct 22 21:02:10.236289 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1368/2841] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:02:09 2022] GET /compute/v2.1/servers/5756e075-671a-41ca-b637-52fa8187643c => generated 1527 bytes in 1103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:02:10.250771 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-e8625e4f-0f9f-486a-90bf-df8539eca670 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:02:10.251813 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-e8625e4f-0f9f-486a-90bf-df8539eca670 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] [instance: 2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:02:10.268585 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e8625e4f-0f9f-486a-90bf-df8539eca670 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:02:10.277628 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e8625e4f-0f9f-486a-90bf-df8539eca670 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:02:10.280934 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e8625e4f-0f9f-486a-90bf-df8539eca670 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:02:10.284149 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e8625e4f-0f9f-486a-90bf-df8539eca670 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:02:10.291649 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e8625e4f-0f9f-486a-90bf-df8539eca670 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:02:10.294829 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e8625e4f-0f9f-486a-90bf-df8539eca670 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:02:10.522800 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-e8625e4f-0f9f-486a-90bf-df8539eca670 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:02:10.543792 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-e8625e4f-0f9f-486a-90bf-df8539eca670 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:02:10.549807 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-e8625e4f-0f9f-486a-90bf-df8539eca670 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:02:10.567088 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-e8625e4f-0f9f-486a-90bf-df8539eca670 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] 10.222.0.18 "GET /compute/v2.1/servers/2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac" status: 200 len: 1555 microversion: 2.91 time: 0.329232 Oct 22 21:02:10.569117 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1369/2842] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:02:10 2022] GET /compute/v2.1/servers/2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac => generated 1555 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:02:10.581268 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-8f23a887-765c-47f9-84e8-3f97bf566cc3 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1207243758", "imageRef": "085e4478-6edc-4a69-8e08-f9831713eb65", "flavorRef": "452", "networks": [{"uuid": "4ddebde3-67b6-4360-8934-2682d629ac63"}]}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:02:18.897332 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.network.neutron [None req-8f23a887-765c-47f9-84e8-3f97bf566cc3 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] validate_networks() for [('4ddebde3-67b6-4360-8934-2682d629ac63', None, None, None, None, None)] {{(pid=138744) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 21:02:18.912857 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-9605ece8-18d7-4599-a713-750bcc33ebe1 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] 10.222.0.18 "GET /compute/v2.1/images/79f95f30-3a63-4549-bbef-2ac330a78b61" status: 200 len: 1454 microversion: 2.1 time: 18.740667 Oct 22 21:02:18.925994 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1474/2843] 10.222.0.18 () {58 vars in 1233 bytes} [Sat Oct 22 21:02:00 2022] GET /compute/v2.1/images/79f95f30-3a63-4549-bbef-2ac330a78b61 => generated 1454 bytes in 18758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:02:18.936926 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-b9c12355-a718-40bb-b83b-dbf52627994a tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:02:18.943226 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-b9c12355-a718-40bb-b83b-dbf52627994a tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] [instance: 9c2729a5-e874-43e7-a372-514906975851] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:02:18.952815 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b9c12355-a718-40bb-b83b-dbf52627994a tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:02:18.953313 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b9c12355-a718-40bb-b83b-dbf52627994a tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:02:18.953749 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b9c12355-a718-40bb-b83b-dbf52627994a tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:02:18.955273 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b9c12355-a718-40bb-b83b-dbf52627994a tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:02:18.955973 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b9c12355-a718-40bb-b83b-dbf52627994a tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:02:18.956567 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b9c12355-a718-40bb-b83b-dbf52627994a tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:02:20.060444 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-b9c12355-a718-40bb-b83b-dbf52627994a tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a44ff8e7c14b94b1670f030085c43d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a26a2284f4424cbeaf63d504652546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:02:20.078976 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-b9c12355-a718-40bb-b83b-dbf52627994a tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] 10.222.0.18 "GET /compute/v2.1/servers/9c2729a5-e874-43e7-a372-514906975851" status: 200 len: 1476 microversion: 2.1 time: 1.150895 Oct 22 21:02:20.081779 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1475/2844] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:02:18 2022] GET /compute/v2.1/servers/9c2729a5-e874-43e7-a372-514906975851 => generated 1476 bytes in 1153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:02:20.096979 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-46bb414e-604d-41ac-a53b-e902d7ab4fdf tempest-ServerAddressesNegativeTestJSON-2002096545 tempest-ServerAddressesNegativeTestJSON-2002096545-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:02:20.098608 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-46bb414e-604d-41ac-a53b-e902d7ab4fdf tempest-ServerAddressesNegativeTestJSON-2002096545 tempest-ServerAddressesNegativeTestJSON-2002096545-project] [instance: 5756e075-671a-41ca-b637-52fa8187643c] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:02:20.113216 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-46bb414e-604d-41ac-a53b-e902d7ab4fdf tempest-ServerAddressesNegativeTestJSON-2002096545 tempest-ServerAddressesNegativeTestJSON-2002096545-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:02:20.115893 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-46bb414e-604d-41ac-a53b-e902d7ab4fdf tempest-ServerAddressesNegativeTestJSON-2002096545 tempest-ServerAddressesNegativeTestJSON-2002096545-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:02:20.117179 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-46bb414e-604d-41ac-a53b-e902d7ab4fdf tempest-ServerAddressesNegativeTestJSON-2002096545 tempest-ServerAddressesNegativeTestJSON-2002096545-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:02:20.122738 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-46bb414e-604d-41ac-a53b-e902d7ab4fdf tempest-ServerAddressesNegativeTestJSON-2002096545 tempest-ServerAddressesNegativeTestJSON-2002096545-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:02:20.123495 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-46bb414e-604d-41ac-a53b-e902d7ab4fdf tempest-ServerAddressesNegativeTestJSON-2002096545 tempest-ServerAddressesNegativeTestJSON-2002096545-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:02:20.128655 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-46bb414e-604d-41ac-a53b-e902d7ab4fdf tempest-ServerAddressesNegativeTestJSON-2002096545 tempest-ServerAddressesNegativeTestJSON-2002096545-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:02:20.167843 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.wsgi [None req-46bb414e-604d-41ac-a53b-e902d7ab4fdf tempest-ServerAddressesNegativeTestJSON-2002096545 tempest-ServerAddressesNegativeTestJSON-2002096545-project] HTTP exception thrown: Instance 5756e075-671a-41ca-b637-52fa8187643c could not be found. Oct 22 21:02:20.172909 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-46bb414e-604d-41ac-a53b-e902d7ab4fdf tempest-ServerAddressesNegativeTestJSON-2002096545 tempest-ServerAddressesNegativeTestJSON-2002096545-project] Request method failure captured: Oct 22 21:02:20.172909 ncdv-master-1 devstack@n-api.service[138745]: request: GET /compute/v2.1/servers/5756e075-671a-41ca-b637-52fa8187643c HTTP/1.1 Oct 22 21:02:20.172909 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 21:02:20.172909 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 21:02:20.172909 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 21:02:20.172909 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 0 Oct 22 21:02:20.172909 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 21:02:20.172909 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 21:02:20.172909 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 21:02:20.172909 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 21:02:20.172909 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVFowcUO6brhAVymhQm4FWl6Xut2IJcI21E9TP5E0LpDmUNSngWLHeOGZl0YCqkY-Q2h9-JYSM4mcOuAQKWkyJvwjlnuh2k5MzDdcvtkJ4k1Grw88ut7PQhKwd2pHQvhETQ2lSD8q0PAkC4v784TGd0mJDD2HX7hfbB3mzk3UB38TdVA Oct 22 21:02:20.172909 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 21:02:20.172909 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 21:02:20.172909 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 21:02:20.172909 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 21:02:20.172909 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 21:02:20.172909 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 21:02:20.172909 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: 40e6cd40d3b74efcac7bd16343591315 Oct 22 21:02:20.172909 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-2002096545 Oct 22 21:02:20.172909 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 21:02:20.172909 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 21:02:20.172909 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_40e6cd40d3b74efcac7bd16343591315"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/40e6cd40d3b74efcac7bd16343591315"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/40e6cd40d3b74efcac7bd16343591315"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/40e6cd40d3b74efcac7bd16343591315"}]}] Oct 22 21:02:20.172909 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-2002096545 Oct 22 21:02:20.172909 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: 40e6cd40d3b74efcac7bd16343591315 Oct 22 21:02:20.172909 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-2002096545 Oct 22 21:02:20.172909 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-ServerAddressesNegativeTestJSON-2002096545-project Oct 22 21:02:20.172909 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 21:02:20.172909 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 21:02:20.172909 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: 03056f5218a647eead4192537f66a504 Oct 22 21:02:20.172909 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-2002096545-project Oct 22 21:02:20.172909 ncdv-master-1 devstack@n-api.service[138745]: method: > Oct 22 21:02:20.172909 ncdv-master-1 devstack@n-api.service[138745]: exception: Instance 5756e075-671a-41ca-b637-52fa8187643c could not be found. Oct 22 21:02:20.172909 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'id': '5756e075-671a-41ca-b637-52fa8187643c'} Oct 22 21:02:20.172909 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:02:20.172909 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:02:20.172909 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 21:02:20.172909 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 21:02:20.172909 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 21:02:20.172909 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 21:02:20.172909 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 21:02:20.172909 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 21:02:20.172909 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 21:02:20.172909 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 21:02:20.172909 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5756e075-671a-41ca-b637-52fa8187643c could not be found. Oct 22 21:02:20.172909 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:02:20.172909 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:02:20.172909 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:02:20.172909 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:02:20.172909 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:02:20.172909 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:02:20.172909 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:02:20.172909 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:02:20.172909 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:02:20.172909 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:02:20.172909 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 21:02:20.172909 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 21:02:20.172909 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 21:02:20.172909 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 21:02:20.172909 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 21:02:20.172909 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:02:20.172909 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5756e075-671a-41ca-b637-52fa8187643c could not be found. Oct 22 21:02:20.172909 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:02:20.172909 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:02:20.177247 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:02:20.177247 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:02:20.177247 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:02:20.177247 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:02:20.177247 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:02:20.177247 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:02:20.177247 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5756e075-671a-41ca-b637-52fa8187643c could not be found. Oct 22 21:02:20.177247 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:02:20.178879 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-46bb414e-604d-41ac-a53b-e902d7ab4fdf tempest-ServerAddressesNegativeTestJSON-2002096545 tempest-ServerAddressesNegativeTestJSON-2002096545-project] Returning 404 to user: Instance 5756e075-671a-41ca-b637-52fa8187643c could not be found. {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:02:20.180144 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-46bb414e-604d-41ac-a53b-e902d7ab4fdf tempest-ServerAddressesNegativeTestJSON-2002096545 tempest-ServerAddressesNegativeTestJSON-2002096545-project] 10.222.0.18 "GET /compute/v2.1/servers/5756e075-671a-41ca-b637-52fa8187643c" status: 404 len: 111 microversion: 2.1 time: 0.097012 Oct 22 21:02:20.181872 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1476/2845] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:02:20 2022] GET /compute/v2.1/servers/5756e075-671a-41ca-b637-52fa8187643c => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 21:02:20.197285 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-176a46d4-45c3-4cec-b685-6db027ed36de tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:02:20.202767 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-176a46d4-45c3-4cec-b685-6db027ed36de tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] [instance: 2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:02:20.216730 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-176a46d4-45c3-4cec-b685-6db027ed36de tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:02:20.218635 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-176a46d4-45c3-4cec-b685-6db027ed36de tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:02:20.219509 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-176a46d4-45c3-4cec-b685-6db027ed36de tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:02:20.221297 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-176a46d4-45c3-4cec-b685-6db027ed36de tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:02:20.222974 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-176a46d4-45c3-4cec-b685-6db027ed36de tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:02:20.229804 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-176a46d4-45c3-4cec-b685-6db027ed36de tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:02:20.429599 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-176a46d4-45c3-4cec-b685-6db027ed36de tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:02:20.448113 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-176a46d4-45c3-4cec-b685-6db027ed36de tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:02:20.449583 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-176a46d4-45c3-4cec-b685-6db027ed36de tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:02:20.459297 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-176a46d4-45c3-4cec-b685-6db027ed36de tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] 10.222.0.18 "GET /compute/v2.1/servers/2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac" status: 200 len: 1537 microversion: 2.91 time: 0.275595 Oct 22 21:02:20.467793 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1477/2846] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:02:20 2022] GET /compute/v2.1/servers/2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac => generated 1537 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:02:20.468865 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-64e45ebb-662a-46f1-947d-f84f58dc6248 req-8cc319db-48eb-4905-a529-7db2e3b15092 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5756e075-671a-41ca-b637-52fa8187643c", "name": "network-vif-deleted", "tag": "fea30c27-88ad-44fd-adf1-003e7ad336b1"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:02:20.489082 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-64e45ebb-662a-46f1-947d-f84f58dc6248 req-8cc319db-48eb-4905-a529-7db2e3b15092 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:02:20.491320 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-64e45ebb-662a-46f1-947d-f84f58dc6248 req-8cc319db-48eb-4905-a529-7db2e3b15092 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:02:20.493348 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-64e45ebb-662a-46f1-947d-f84f58dc6248 req-8cc319db-48eb-4905-a529-7db2e3b15092 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:02:20.521874 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-64e45ebb-662a-46f1-947d-f84f58dc6248 req-8cc319db-48eb-4905-a529-7db2e3b15092 service nova] Creating event network-vif-deleted:fea30c27-88ad-44fd-adf1-003e7ad336b1 for instance 5756e075-671a-41ca-b637-52fa8187643c on nch1-master-1 Oct 22 21:02:20.529147 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-64e45ebb-662a-46f1-947d-f84f58dc6248 req-8cc319db-48eb-4905-a529-7db2e3b15092 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066895 Oct 22 21:02:20.533659 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:02:20.535625 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1478/2847] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:02:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:02:20.561788 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-6cb70402-f51a-40f7-b533-d732f6ebbf32 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Calling method '.version_select at 0x7fd39fda5a60>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:02:20.627081 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-6cb70402-f51a-40f7-b533-d732f6ebbf32 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] 10.222.0.18 "GET /compute/v2.1/images/79f95f30-3a63-4549-bbef-2ac330a78b61" status: 200 len: 1454 microversion: 2.1 time: 0.089847 Oct 22 21:02:20.628427 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1479/2848] 10.222.0.18 () {58 vars in 1233 bytes} [Sat Oct 22 21:02:20 2022] GET /compute/v2.1/images/79f95f30-3a63-4549-bbef-2ac330a78b61 => generated 1454 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:02:20.637370 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-d2af2806-5449-4375-8eb1-d513a607e1df tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1653186912"}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:02:20.652604 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-d2af2806-5449-4375-8eb1-d513a607e1df tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] [instance: 9c2729a5-e874-43e7-a372-514906975851] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:02:20.656203 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:02:20.671267 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d2af2806-5449-4375-8eb1-d513a607e1df tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:02:20.672078 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d2af2806-5449-4375-8eb1-d513a607e1df tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:02:20.672840 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d2af2806-5449-4375-8eb1-d513a607e1df tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:02:20.673880 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d2af2806-5449-4375-8eb1-d513a607e1df tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:02:20.675404 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d2af2806-5449-4375-8eb1-d513a607e1df tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:02:20.676060 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d2af2806-5449-4375-8eb1-d513a607e1df tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:02:21.039135 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-d2af2806-5449-4375-8eb1-d513a607e1df tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] 10.222.0.18 "POST /compute/v2.1/servers/9c2729a5-e874-43e7-a372-514906975851/action" status: 202 len: 0 microversion: 2.1 time: 0.408965 Oct 22 21:02:21.043641 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1480/2849] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 21:02:20 2022] POST /compute/v2.1/servers/9c2729a5-e874-43e7-a372-514906975851/action => generated 0 bytes in 413 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 22 21:02:21.053472 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-5ce24c36-b656-4afb-a011-0484cb7a42ea tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Calling method '.version_select at 0x7fd39ef8dca0>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:02:21.108653 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-5ce24c36-b656-4afb-a011-0484cb7a42ea tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] 10.222.0.18 "GET /compute/v2.1/images/d25d21a0-06e4-472c-b2a0-81a203d39ec0" status: 200 len: 1414 microversion: 2.1 time: 0.061091 Oct 22 21:02:21.109639 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1481/2850] 10.222.0.18 () {58 vars in 1233 bytes} [Sat Oct 22 21:02:21 2022] GET /compute/v2.1/images/d25d21a0-06e4-472c-b2a0-81a203d39ec0 => generated 1414 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:02:21.139899 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-8f23a887-765c-47f9-84e8-3f97bf566cc3 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Flavor limits 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 21:02:21.140583 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-8f23a887-765c-47f9-84e8-3f97bf566cc3 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Image limits 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 21:02:21.141445 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-8f23a887-765c-47f9-84e8-3f97bf566cc3 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Flavor pref 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 21:02:21.142137 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-8f23a887-765c-47f9-84e8-3f97bf566cc3 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Image pref 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 21:02:21.142738 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-8f23a887-765c-47f9-84e8-3f97bf566cc3 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 21:02:21.155902 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8f23a887-765c-47f9-84e8-3f97bf566cc3 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:02:21.158406 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8f23a887-765c-47f9-84e8-3f97bf566cc3 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:02:21.159053 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8f23a887-765c-47f9-84e8-3f97bf566cc3 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:02:21.161265 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8f23a887-765c-47f9-84e8-3f97bf566cc3 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:02:21.162203 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8f23a887-765c-47f9-84e8-3f97bf566cc3 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:02:21.162826 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8f23a887-765c-47f9-84e8-3f97bf566cc3 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:02:21.194489 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-8f23a887-765c-47f9-84e8-3f97bf566cc3 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Getting quotas for project b4cd7873d6db4e09bc9ab9a048a6b1ef. Resources: {'cores', 'instances', 'ram'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 21:02:21.202577 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-8f23a887-765c-47f9-84e8-3f97bf566cc3 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Getting quotas for user be1b410a64e0415a96d30f5040361137 and project b4cd7873d6db4e09bc9ab9a048a6b1ef. Resources: {'cores', 'instances', 'ram'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 21:02:21.227793 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-8f23a887-765c-47f9-84e8-3f97bf566cc3 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Going to run 1 instances... {{(pid=138744) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 21:02:21.231086 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-8f23a887-765c-47f9-84e8-3f97bf566cc3 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] [instance: a99614d8-f2f7-4ce1-87e8-47f3af03d9f8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='085e4478-6edc-4a69-8e08-f9831713eb65',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138744) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 21:02:21.364425 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-8f23a887-765c-47f9-84e8-3f97bf566cc3 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 10.792342 Oct 22 21:02:21.367686 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1370/2851] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Oct 22 21:02:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 10797 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 21:02:21.379204 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-dd438d27-1a22-46ef-986d-eb6a26a6b981 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:02:21.379986 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-dd438d27-1a22-46ef-986d-eb6a26a6b981 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] [instance: a99614d8-f2f7-4ce1-87e8-47f3af03d9f8] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:02:21.490819 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-03b628a3-898c-436c-8a8f-e939474fde54 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:02:21.491913 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-03b628a3-898c-436c-8a8f-e939474fde54 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] [instance: 2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:02:21.502056 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-03b628a3-898c-436c-8a8f-e939474fde54 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:02:21.502739 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-03b628a3-898c-436c-8a8f-e939474fde54 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:02:21.503555 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-03b628a3-898c-436c-8a8f-e939474fde54 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:02:21.504519 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-03b628a3-898c-436c-8a8f-e939474fde54 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:02:21.505213 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-03b628a3-898c-436c-8a8f-e939474fde54 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:02:21.505811 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-03b628a3-898c-436c-8a8f-e939474fde54 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:02:21.527707 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-dd438d27-1a22-46ef-986d-eb6a26a6b981 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1b410a64e0415a96d30f5040361137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd7873d6db4e09bc9ab9a048a6b1ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:02:21.546888 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-dd438d27-1a22-46ef-986d-eb6a26a6b981 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] 10.222.0.18 "GET /compute/v2.1/servers/a99614d8-f2f7-4ce1-87e8-47f3af03d9f8" status: 200 len: 1215 microversion: 2.1 time: 0.163080 Oct 22 21:02:21.551562 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1482/2852] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:02:21 2022] GET /compute/v2.1/servers/a99614d8-f2f7-4ce1-87e8-47f3af03d9f8 => generated 1215 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:02:21.647522 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-ecb46ec9-ef5d-4379-9776-45967882577b tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Calling method '.version_select at 0x7fd39f05d550>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:02:21.727684 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-03b628a3-898c-436c-8a8f-e939474fde54 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:02:21.737494 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-ecb46ec9-ef5d-4379-9776-45967882577b tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] 10.222.0.18 "GET /compute/v2.1/images/79f95f30-3a63-4549-bbef-2ac330a78b61" status: 200 len: 1463 microversion: 2.1 time: 0.096785 Oct 22 21:02:21.740516 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1483/2853] 10.222.0.18 () {58 vars in 1233 bytes} [Sat Oct 22 21:02:21 2022] GET /compute/v2.1/images/79f95f30-3a63-4549-bbef-2ac330a78b61 => generated 1463 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:02:21.757571 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-928adbc4-bd6f-446a-9768-49428d8d6915 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Calling method '.version_select at 0x7fd39efa2820>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:02:21.785684 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-03b628a3-898c-436c-8a8f-e939474fde54 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:02:21.788887 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-03b628a3-898c-436c-8a8f-e939474fde54 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:02:21.815567 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-03b628a3-898c-436c-8a8f-e939474fde54 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] 10.222.0.18 "GET /compute/v2.1/servers/2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac" status: 200 len: 1537 microversion: 2.91 time: 0.328829 Oct 22 21:02:21.816164 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1371/2854] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:02:21 2022] GET /compute/v2.1/servers/2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac => generated 1537 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:02:21.874257 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-928adbc4-bd6f-446a-9768-49428d8d6915 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] 10.222.0.18 "GET /compute/v2.1/images/79f95f30-3a63-4549-bbef-2ac330a78b61" status: 200 len: 1463 microversion: 2.1 time: 0.121299 Oct 22 21:02:21.884930 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1484/2855] 10.222.0.18 () {58 vars in 1233 bytes} [Sat Oct 22 21:02:21 2022] GET /compute/v2.1/images/79f95f30-3a63-4549-bbef-2ac330a78b61 => generated 1463 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:02:21.889985 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-77d2f2b7-4648-4ef7-a8ac-ea8aa81a2000 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:02:21.890690 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-77d2f2b7-4648-4ef7-a8ac-ea8aa81a2000 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] [instance: 70f4c178-630e-4050-8aad-4c60bec30bcd] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:02:21.896857 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-77d2f2b7-4648-4ef7-a8ac-ea8aa81a2000 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:02:21.897436 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-77d2f2b7-4648-4ef7-a8ac-ea8aa81a2000 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:02:21.897982 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-77d2f2b7-4648-4ef7-a8ac-ea8aa81a2000 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:02:21.898940 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-77d2f2b7-4648-4ef7-a8ac-ea8aa81a2000 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:02:21.899557 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-77d2f2b7-4648-4ef7-a8ac-ea8aa81a2000 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:02:21.900180 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-77d2f2b7-4648-4ef7-a8ac-ea8aa81a2000 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:02:22.125073 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-dee2ffcc-e505-4ac8-b2ca-54b4cf091639 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Calling method '.version_select at 0x7fd39effc4c0>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:02:22.217242 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-dee2ffcc-e505-4ac8-b2ca-54b4cf091639 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] 10.222.0.18 "GET /compute/v2.1/images/d25d21a0-06e4-472c-b2a0-81a203d39ec0" status: 200 len: 1414 microversion: 2.1 time: 0.096588 Oct 22 21:02:22.218295 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1485/2856] 10.222.0.18 () {58 vars in 1233 bytes} [Sat Oct 22 21:02:22 2022] GET /compute/v2.1/images/d25d21a0-06e4-472c-b2a0-81a203d39ec0 => generated 1414 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:02:22.323250 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-77d2f2b7-4648-4ef7-a8ac-ea8aa81a2000 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b9bfe6f6d564d4c9fb1fea439476e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6e01f91c3a845bf8e67e3ad415d9c69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:02:22.334925 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-77d2f2b7-4648-4ef7-a8ac-ea8aa81a2000 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] 10.222.0.18 "GET /compute/v2.1/servers/70f4c178-630e-4050-8aad-4c60bec30bcd" status: 200 len: 1481 microversion: 2.1 time: 0.449043 Oct 22 21:02:22.340670 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1372/2857] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:02:21 2022] GET /compute/v2.1/servers/70f4c178-630e-4050-8aad-4c60bec30bcd => generated 1481 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:02:22.574558 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-b81cb747-4db9-4350-9959-68a46dfd99b0 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:02:22.575767 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-b81cb747-4db9-4350-9959-68a46dfd99b0 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] [instance: a99614d8-f2f7-4ce1-87e8-47f3af03d9f8] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:02:22.589249 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b81cb747-4db9-4350-9959-68a46dfd99b0 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:02:22.590354 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b81cb747-4db9-4350-9959-68a46dfd99b0 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:02:22.591022 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b81cb747-4db9-4350-9959-68a46dfd99b0 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:02:22.591850 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b81cb747-4db9-4350-9959-68a46dfd99b0 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:02:22.592503 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b81cb747-4db9-4350-9959-68a46dfd99b0 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:02:22.593431 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b81cb747-4db9-4350-9959-68a46dfd99b0 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:02:22.845159 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-03306657-d3d6-4b99-8beb-530af5e87585 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:02:22.846042 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-03306657-d3d6-4b99-8beb-530af5e87585 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] [instance: 2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:02:22.853099 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-03306657-d3d6-4b99-8beb-530af5e87585 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:02:22.853950 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-03306657-d3d6-4b99-8beb-530af5e87585 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:02:22.854504 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-03306657-d3d6-4b99-8beb-530af5e87585 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:02:22.855520 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-03306657-d3d6-4b99-8beb-530af5e87585 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:02:22.856288 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-03306657-d3d6-4b99-8beb-530af5e87585 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:02:22.856859 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-03306657-d3d6-4b99-8beb-530af5e87585 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:02:23.008368 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-03306657-d3d6-4b99-8beb-530af5e87585 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:02:23.020486 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-03306657-d3d6-4b99-8beb-530af5e87585 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:02:23.022248 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-03306657-d3d6-4b99-8beb-530af5e87585 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:02:23.029203 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-03306657-d3d6-4b99-8beb-530af5e87585 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] 10.222.0.18 "GET /compute/v2.1/servers/2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac" status: 200 len: 1540 microversion: 2.91 time: 0.187914 Oct 22 21:02:23.047637 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1373/2858] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:02:22 2022] GET /compute/v2.1/servers/2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac => generated 1540 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:02:23.059202 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-1507cb5c-9f7c-4991-9dd4-62a8b41efa30 tempest-UnshelveToHostMultiNodesTest-2069914657 tempest-UnshelveToHostMultiNodesTest-2069914657-project-admin] Action: 'action', calling method: >, body: {"unshelve": {"host": "nch2-master-1"}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:02:23.062267 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-1507cb5c-9f7c-4991-9dd4-62a8b41efa30 tempest-UnshelveToHostMultiNodesTest-2069914657 tempest-UnshelveToHostMultiNodesTest-2069914657-project-admin] [instance: 2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:02:23.069566 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1507cb5c-9f7c-4991-9dd4-62a8b41efa30 tempest-UnshelveToHostMultiNodesTest-2069914657 tempest-UnshelveToHostMultiNodesTest-2069914657-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:02:23.070320 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1507cb5c-9f7c-4991-9dd4-62a8b41efa30 tempest-UnshelveToHostMultiNodesTest-2069914657 tempest-UnshelveToHostMultiNodesTest-2069914657-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:02:23.070815 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-b81cb747-4db9-4350-9959-68a46dfd99b0 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1b410a64e0415a96d30f5040361137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd7873d6db4e09bc9ab9a048a6b1ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:02:23.071165 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1507cb5c-9f7c-4991-9dd4-62a8b41efa30 tempest-UnshelveToHostMultiNodesTest-2069914657 tempest-UnshelveToHostMultiNodesTest-2069914657-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:02:23.072141 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1507cb5c-9f7c-4991-9dd4-62a8b41efa30 tempest-UnshelveToHostMultiNodesTest-2069914657 tempest-UnshelveToHostMultiNodesTest-2069914657-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:02:23.072758 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1507cb5c-9f7c-4991-9dd4-62a8b41efa30 tempest-UnshelveToHostMultiNodesTest-2069914657 tempest-UnshelveToHostMultiNodesTest-2069914657-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:02:23.073399 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1507cb5c-9f7c-4991-9dd4-62a8b41efa30 tempest-UnshelveToHostMultiNodesTest-2069914657 tempest-UnshelveToHostMultiNodesTest-2069914657-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:02:23.090283 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-b81cb747-4db9-4350-9959-68a46dfd99b0 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] 10.222.0.18 "GET /compute/v2.1/servers/a99614d8-f2f7-4ce1-87e8-47f3af03d9f8" status: 200 len: 1267 microversion: 2.1 time: 0.520639 Oct 22 21:02:23.090881 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1486/2859] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:02:22 2022] GET /compute/v2.1/servers/a99614d8-f2f7-4ce1-87e8-47f3af03d9f8 => generated 1267 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:02:23.207138 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-1507cb5c-9f7c-4991-9dd4-62a8b41efa30 tempest-UnshelveToHostMultiNodesTest-2069914657 tempest-UnshelveToHostMultiNodesTest-2069914657-project-admin] [instance: 2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "nch2-master-1". {{(pid=138744) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 22 21:02:23.235489 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-d119d19f-9bdf-40db-b7ab-8e290260b5db tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Calling method '.version_select at 0x7fd39f06f430>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:02:23.324856 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-d119d19f-9bdf-40db-b7ab-8e290260b5db tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] 10.222.0.18 "GET /compute/v2.1/images/d25d21a0-06e4-472c-b2a0-81a203d39ec0" status: 200 len: 1414 microversion: 2.1 time: 0.094145 Oct 22 21:02:23.325758 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1487/2860] 10.222.0.18 () {58 vars in 1233 bytes} [Sat Oct 22 21:02:23 2022] GET /compute/v2.1/images/d25d21a0-06e4-472c-b2a0-81a203d39ec0 => generated 1414 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:02:23.362657 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-8b0be3b5-4d03-4cfc-be8e-b157394cb9d6 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:02:23.362930 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-8b0be3b5-4d03-4cfc-be8e-b157394cb9d6 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] [instance: 70f4c178-630e-4050-8aad-4c60bec30bcd] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:02:23.373315 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8b0be3b5-4d03-4cfc-be8e-b157394cb9d6 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:02:23.374098 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8b0be3b5-4d03-4cfc-be8e-b157394cb9d6 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:02:23.374700 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8b0be3b5-4d03-4cfc-be8e-b157394cb9d6 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:02:23.378806 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-1507cb5c-9f7c-4991-9dd4-62a8b41efa30 tempest-UnshelveToHostMultiNodesTest-2069914657 tempest-UnshelveToHostMultiNodesTest-2069914657-project-admin] 10.222.0.18 "POST /compute/v2.1/servers/2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac/action" status: 202 len: 0 microversion: 2.91 time: 0.324226 Oct 22 21:02:23.379881 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1374/2861] 10.222.0.18 () {62 vars in 1319 bytes} [Sat Oct 22 21:02:23 2022] POST /compute/v2.1/servers/2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac/action => generated 0 bytes in 326 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 22 21:02:23.390800 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8b0be3b5-4d03-4cfc-be8e-b157394cb9d6 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:02:23.391303 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8b0be3b5-4d03-4cfc-be8e-b157394cb9d6 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:02:23.391783 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8b0be3b5-4d03-4cfc-be8e-b157394cb9d6 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:02:23.392394 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-41176aa4-a854-4d57-abee-acc9096c84e0 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:02:23.393345 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-41176aa4-a854-4d57-abee-acc9096c84e0 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] [instance: 2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:02:23.404839 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-41176aa4-a854-4d57-abee-acc9096c84e0 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:02:23.405914 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-41176aa4-a854-4d57-abee-acc9096c84e0 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:02:23.406659 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-41176aa4-a854-4d57-abee-acc9096c84e0 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:02:23.407768 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-41176aa4-a854-4d57-abee-acc9096c84e0 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:02:23.408593 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-41176aa4-a854-4d57-abee-acc9096c84e0 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:02:23.409272 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-41176aa4-a854-4d57-abee-acc9096c84e0 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:02:23.700189 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-41176aa4-a854-4d57-abee-acc9096c84e0 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:02:23.711480 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-41176aa4-a854-4d57-abee-acc9096c84e0 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:02:23.713619 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-41176aa4-a854-4d57-abee-acc9096c84e0 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:02:23.721589 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-41176aa4-a854-4d57-abee-acc9096c84e0 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] 10.222.0.18 "GET /compute/v2.1/servers/2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac" status: 200 len: 1488 microversion: 2.91 time: 0.337664 Oct 22 21:02:23.722648 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1375/2862] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:02:23 2022] GET /compute/v2.1/servers/2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac => generated 1488 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 22 21:02:24.054220 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-8b0be3b5-4d03-4cfc-be8e-b157394cb9d6 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b9bfe6f6d564d4c9fb1fea439476e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6e01f91c3a845bf8e67e3ad415d9c69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:02:24.062939 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-8b0be3b5-4d03-4cfc-be8e-b157394cb9d6 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] 10.222.0.18 "GET /compute/v2.1/servers/70f4c178-630e-4050-8aad-4c60bec30bcd" status: 200 len: 1468 microversion: 2.1 time: 0.704471 Oct 22 21:02:24.063399 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1488/2863] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:02:23 2022] GET /compute/v2.1/servers/70f4c178-630e-4050-8aad-4c60bec30bcd => generated 1468 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:02:24.098250 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-b37b3eb7-4309-495d-aebb-353c4cf28a67 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Calling method '.version_select at 0x7fd3a4066310>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:02:24.116849 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-854858bb-3ab6-4f09-95bf-4a30e0be46e2 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:02:24.118270 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-854858bb-3ab6-4f09-95bf-4a30e0be46e2 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] [instance: a99614d8-f2f7-4ce1-87e8-47f3af03d9f8] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:02:24.137083 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-854858bb-3ab6-4f09-95bf-4a30e0be46e2 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:02:24.137593 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-854858bb-3ab6-4f09-95bf-4a30e0be46e2 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:02:24.138040 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-854858bb-3ab6-4f09-95bf-4a30e0be46e2 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:02:24.138784 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-854858bb-3ab6-4f09-95bf-4a30e0be46e2 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:02:24.139410 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-854858bb-3ab6-4f09-95bf-4a30e0be46e2 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:02:24.139671 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-854858bb-3ab6-4f09-95bf-4a30e0be46e2 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:02:24.313983 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-b37b3eb7-4309-495d-aebb-353c4cf28a67 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] 10.222.0.18 "GET /compute/v2.1/images?changes-since=2022-10-22T21%3A00%3A03Z" status: 200 len: 1902 microversion: 2.1 time: 0.229607 Oct 22 21:02:24.314711 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1376/2864] 10.222.0.18 () {58 vars in 1199 bytes} [Sat Oct 22 21:02:24 2022] GET /compute/v2.1/images?changes-since=2022-10-22T21%3A00%3A03Z => generated 1902 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:02:24.346264 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-818284b7-4f00-47cc-ab7a-8c0274efbf1d tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Calling method '.version_select at 0x7fd3a4248ee0>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:02:24.499910 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-818284b7-4f00-47cc-ab7a-8c0274efbf1d tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] 10.222.0.18 "GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-2043328844" status: 200 len: 485 microversion: 2.1 time: 0.162516 Oct 22 21:02:24.500921 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1377/2865] 10.222.0.18 () {58 vars in 1231 bytes} [Sat Oct 22 21:02:24 2022] GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-2043328844 => generated 485 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:02:24.520242 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-4a17db1b-4da8-4701-a2e1-93ee694fa173 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Calling method '.version_select at 0x7fd39fe960d0>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:02:24.620420 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-854858bb-3ab6-4f09-95bf-4a30e0be46e2 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1b410a64e0415a96d30f5040361137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd7873d6db4e09bc9ab9a048a6b1ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:02:24.632483 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-854858bb-3ab6-4f09-95bf-4a30e0be46e2 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] 10.222.0.18 "GET /compute/v2.1/servers/a99614d8-f2f7-4ce1-87e8-47f3af03d9f8" status: 200 len: 1315 microversion: 2.1 time: 0.523115 Oct 22 21:02:24.633086 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1489/2866] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:02:24 2022] GET /compute/v2.1/servers/a99614d8-f2f7-4ce1-87e8-47f3af03d9f8 => generated 1315 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:02:24.655045 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-4a17db1b-4da8-4701-a2e1-93ee694fa173 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] 10.222.0.18 "GET /compute/v2.1/images/d25d21a0-06e4-472c-b2a0-81a203d39ec0" status: 200 len: 1414 microversion: 2.1 time: 0.151059 Oct 22 21:02:24.657398 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1378/2867] 10.222.0.18 () {58 vars in 1233 bytes} [Sat Oct 22 21:02:24 2022] GET /compute/v2.1/images/d25d21a0-06e4-472c-b2a0-81a203d39ec0 => generated 1414 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:02:24.658120 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-cec20d72-403e-4b56-91e5-3b8e292f4120 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Calling method '.version_select at 0x7fd39f072940>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:02:24.754259 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-057d2f1e-071a-4e9e-b2ae-5b82da615abb tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:02:24.754880 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-057d2f1e-071a-4e9e-b2ae-5b82da615abb tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] [instance: 2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:02:24.769253 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-057d2f1e-071a-4e9e-b2ae-5b82da615abb tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:02:24.771166 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-057d2f1e-071a-4e9e-b2ae-5b82da615abb tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:02:24.771866 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-057d2f1e-071a-4e9e-b2ae-5b82da615abb tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:02:24.773147 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-057d2f1e-071a-4e9e-b2ae-5b82da615abb tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:02:24.775462 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-057d2f1e-071a-4e9e-b2ae-5b82da615abb tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:02:24.777675 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-057d2f1e-071a-4e9e-b2ae-5b82da615abb tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:02:24.844327 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-cec20d72-403e-4b56-91e5-3b8e292f4120 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] 10.222.0.18 "GET /compute/v2.1/images?server=70f4c178-630e-4050-8aad-4c60bec30bcd" status: 200 len: 957 microversion: 2.1 time: 0.203963 Oct 22 21:02:24.847909 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1490/2868] 10.222.0.18 () {58 vars in 1209 bytes} [Sat Oct 22 21:02:24 2022] GET /compute/v2.1/images?server=70f4c178-630e-4050-8aad-4c60bec30bcd => generated 957 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:02:24.863700 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-fc4e472f-cf1b-493e-96b0-3a0458c34d06 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Calling method '.version_select at 0x7fd39f06f0d0>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:02:24.945445 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-fc4e472f-cf1b-493e-96b0-3a0458c34d06 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] 10.222.0.18 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.18%2Fcompute%2Fv2.1%2Fservers%2Fee6c092d-1150-415f-8a2e-58f4d3b5c238" status: 200 len: 484 microversion: 2.1 time: 0.086510 Oct 22 21:02:24.949445 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1491/2869] 10.222.0.18 () {58 vars in 1317 bytes} [Sat Oct 22 21:02:24 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.18%2Fcompute%2Fv2.1%2Fservers%2Fee6c092d-1150-415f-8a2e-58f4d3b5c238 => generated 484 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:02:24.972562 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-7e1c4b61-078f-4cca-83c7-df9afd66c679 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Calling method '.version_select at 0x7fd3a4519040>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:02:25.076227 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-7e1c4b61-078f-4cca-83c7-df9afd66c679 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] 10.222.0.18 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.18%2Fcompute%2Fservers%2Fee6c092d-1150-415f-8a2e-58f4d3b5c238" status: 200 len: 484 microversion: 2.1 time: 0.119351 Oct 22 21:02:25.076903 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1492/2870] 10.222.0.18 () {58 vars in 1303 bytes} [Sat Oct 22 21:02:24 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.18%2Fcompute%2Fservers%2Fee6c092d-1150-415f-8a2e-58f4d3b5c238 => generated 484 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 21:02:25.090382 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-cee67fcc-07a6-40fa-bc78-ca1713cb91db tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Calling method '.version_select at 0x7fd39f072790>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:02:25.187286 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-057d2f1e-071a-4e9e-b2ae-5b82da615abb tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:02:25.209339 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-057d2f1e-071a-4e9e-b2ae-5b82da615abb tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:02:25.211176 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-057d2f1e-071a-4e9e-b2ae-5b82da615abb tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:02:25.221980 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-057d2f1e-071a-4e9e-b2ae-5b82da615abb tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] 10.222.0.18 "GET /compute/v2.1/servers/2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac" status: 200 len: 1488 microversion: 2.91 time: 0.472065 Oct 22 21:02:25.223237 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1379/2871] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:02:24 2022] GET /compute/v2.1/servers/2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac => generated 1488 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 22 21:02:25.294121 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-cee67fcc-07a6-40fa-bc78-ca1713cb91db tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] 10.222.0.18 "GET /compute/v2.1/images?status=ACTIVE" status: 200 len: 3281 microversion: 2.1 time: 0.207863 Oct 22 21:02:25.296152 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1493/2872] 10.222.0.18 () {58 vars in 1149 bytes} [Sat Oct 22 21:02:25 2022] GET /compute/v2.1/images?status=ACTIVE => generated 3281 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:02:25.314475 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-ece1169e-83ba-43eb-b55c-a5f03b10f202 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Calling method '.version_select at 0x7fd3a4248550>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:02:25.643863 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-ece1169e-83ba-43eb-b55c-a5f03b10f202 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] 10.222.0.18 "GET /compute/v2.1/images?type=snapshot" status: 200 len: 1429 microversion: 2.1 time: 0.323447 Oct 22 21:02:25.646223 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1380/2873] 10.222.0.18 () {58 vars in 1149 bytes} [Sat Oct 22 21:02:25 2022] GET /compute/v2.1/images?type=snapshot => generated 1429 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:02:25.665658 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-d89e203c-4187-49d7-ad96-bc641996fd78 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:02:25.666382 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-493b066c-ef32-49db-91c5-529a0020eac1 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Calling method '.version_select at 0x7fd3a41e35e0>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:02:25.667607 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-d89e203c-4187-49d7-ad96-bc641996fd78 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] [instance: a99614d8-f2f7-4ce1-87e8-47f3af03d9f8] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:02:25.678792 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d89e203c-4187-49d7-ad96-bc641996fd78 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:02:25.679216 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d89e203c-4187-49d7-ad96-bc641996fd78 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:02:25.683816 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d89e203c-4187-49d7-ad96-bc641996fd78 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:02:25.684860 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d89e203c-4187-49d7-ad96-bc641996fd78 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:02:25.685937 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d89e203c-4187-49d7-ad96-bc641996fd78 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:02:25.686538 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d89e203c-4187-49d7-ad96-bc641996fd78 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:02:25.773785 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-493b066c-ef32-49db-91c5-529a0020eac1 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] 10.222.0.18 "GET /compute/v2.1/images?limit=1" status: 200 len: 621 microversion: 2.1 time: 0.113481 Oct 22 21:02:25.783486 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1381/2874] 10.222.0.18 () {58 vars in 1137 bytes} [Sat Oct 22 21:02:25 2022] GET /compute/v2.1/images?limit=1 => generated 621 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 21:02:25.790352 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-198d964b-9ee1-43ef-8126-e571e9563ccd tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Calling method '.version_select at 0x7fd39f26c4c0>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:02:25.860026 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-198d964b-9ee1-43ef-8126-e571e9563ccd tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] 10.222.0.18 "GET /compute/v2.1/images/d25d21a0-06e4-472c-b2a0-81a203d39ec0" status: 200 len: 1414 microversion: 2.1 time: 0.081011 Oct 22 21:02:25.860640 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1382/2875] 10.222.0.18 () {58 vars in 1233 bytes} [Sat Oct 22 21:02:25 2022] GET /compute/v2.1/images/d25d21a0-06e4-472c-b2a0-81a203d39ec0 => generated 1414 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:02:25.874973 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-390010d0-c372-4a74-8566-b8114195f0ec tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Calling method '.version_select at 0x7fd3a41e3310>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:02:26.065325 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-390010d0-c372-4a74-8566-b8114195f0ec tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] 10.222.0.18 "GET /compute/v2.1/images/detail?changes-since=2022-10-22T20%3A59%3A56Z" status: 200 len: 6334 microversion: 2.1 time: 0.202566 Oct 22 21:02:26.068750 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1383/2876] 10.222.0.18 () {58 vars in 1220 bytes} [Sat Oct 22 21:02:25 2022] GET /compute/v2.1/images/detail?changes-since=2022-10-22T20%3A59%3A56Z => generated 6334 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:02:26.104192 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-0dbc4c96-03db-42b4-9d42-15a764c65219 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Calling method '.version_select at 0x7fd3a4370940>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:02:26.187814 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-0dbc4c96-03db-42b4-9d42-15a764c65219 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] 10.222.0.18 "GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-2043328844" status: 200 len: 665 microversion: 2.1 time: 0.098945 Oct 22 21:02:26.188491 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1384/2877] 10.222.0.18 () {58 vars in 1252 bytes} [Sat Oct 22 21:02:26 2022] GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-2043328844 => generated 665 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:02:26.210543 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-3186cb7c-0e2b-40a5-ab30-a5e6e50f2def tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Calling method '.version_select at 0x7fd3a41e3dc0>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:02:26.310860 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-3186cb7c-0e2b-40a5-ab30-a5e6e50f2def tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] 10.222.0.18 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.18%2Fcompute%2Fv2.1%2Fservers%2Fee6c092d-1150-415f-8a2e-58f4d3b5c238" status: 200 len: 1466 microversion: 2.1 time: 0.107506 Oct 22 21:02:26.313835 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1385/2878] 10.222.0.18 () {58 vars in 1338 bytes} [Sat Oct 22 21:02:26 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.18%2Fcompute%2Fv2.1%2Fservers%2Fee6c092d-1150-415f-8a2e-58f4d3b5c238 => generated 1466 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:02:26.339491 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-8d7d6dff-3c92-451e-9d23-b3ef5c0f7efa tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:02:26.340714 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-8d7d6dff-3c92-451e-9d23-b3ef5c0f7efa tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] [instance: 2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:02:26.357857 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8d7d6dff-3c92-451e-9d23-b3ef5c0f7efa tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:02:26.358616 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8d7d6dff-3c92-451e-9d23-b3ef5c0f7efa tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:02:26.359719 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8d7d6dff-3c92-451e-9d23-b3ef5c0f7efa tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:02:26.361578 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8d7d6dff-3c92-451e-9d23-b3ef5c0f7efa tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:02:26.362485 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8d7d6dff-3c92-451e-9d23-b3ef5c0f7efa tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:02:26.363080 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8d7d6dff-3c92-451e-9d23-b3ef5c0f7efa tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:02:26.614535 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-8d7d6dff-3c92-451e-9d23-b3ef5c0f7efa tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:02:26.628303 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-8d7d6dff-3c92-451e-9d23-b3ef5c0f7efa tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:02:26.634034 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-8d7d6dff-3c92-451e-9d23-b3ef5c0f7efa tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:02:26.649933 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-8d7d6dff-3c92-451e-9d23-b3ef5c0f7efa tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] 10.222.0.18 "GET /compute/v2.1/servers/2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac" status: 200 len: 1546 microversion: 2.91 time: 0.323950 Oct 22 21:02:26.651456 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1386/2879] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:02:26 2022] GET /compute/v2.1/servers/2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac => generated 1546 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:02:26.652174 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-d89e203c-4187-49d7-ad96-bc641996fd78 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1b410a64e0415a96d30f5040361137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd7873d6db4e09bc9ab9a048a6b1ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:02:26.665107 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-d89e203c-4187-49d7-ad96-bc641996fd78 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] 10.222.0.18 "GET /compute/v2.1/servers/a99614d8-f2f7-4ce1-87e8-47f3af03d9f8" status: 200 len: 1315 microversion: 2.1 time: 1.004956 Oct 22 21:02:26.665953 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-4096f9a5-bc06-4db3-8422-fce70f5a2ce0 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Calling method '.version_select at 0x7fd3a415df70>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:02:26.678185 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1494/2880] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:02:25 2022] GET /compute/v2.1/servers/a99614d8-f2f7-4ce1-87e8-47f3af03d9f8 => generated 1315 bytes in 1019 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:02:26.783124 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-4096f9a5-bc06-4db3-8422-fce70f5a2ce0 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] 10.222.0.18 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.18%2Fcompute%2Fservers%2Fee6c092d-1150-415f-8a2e-58f4d3b5c238" status: 200 len: 1466 microversion: 2.1 time: 0.129544 Oct 22 21:02:26.783744 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1387/2881] 10.222.0.18 () {58 vars in 1324 bytes} [Sat Oct 22 21:02:26 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.18%2Fcompute%2Fservers%2Fee6c092d-1150-415f-8a2e-58f4d3b5c238 => generated 1466 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:02:26.800766 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-01609b3e-9ec3-4ade-b276-2f37f32122cc tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Calling method '.version_select at 0x7fd39efa29d0>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:02:26.813721 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-96e845c8-e953-41cc-be0f-3e0025764ae5 req-6978c63a-8f23-4a0a-b7e3-91577dc96858 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70f4c178-630e-4050-8aad-4c60bec30bcd", "name": "network-vif-unplugged", "status": "completed", "tag": "034bfe35-5a4c-4024-b8ad-3fc77f012374"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:02:26.874709 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-96e845c8-e953-41cc-be0f-3e0025764ae5 req-6978c63a-8f23-4a0a-b7e3-91577dc96858 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:02:26.878605 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-96e845c8-e953-41cc-be0f-3e0025764ae5 req-6978c63a-8f23-4a0a-b7e3-91577dc96858 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:02:26.881557 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-96e845c8-e953-41cc-be0f-3e0025764ae5 req-6978c63a-8f23-4a0a-b7e3-91577dc96858 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:02:26.939227 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-96e845c8-e953-41cc-be0f-3e0025764ae5 req-6978c63a-8f23-4a0a-b7e3-91577dc96858 service nova] Creating event network-vif-unplugged:034bfe35-5a4c-4024-b8ad-3fc77f012374 for instance 70f4c178-630e-4050-8aad-4c60bec30bcd on nch1-master-1 Oct 22 21:02:26.979050 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-96e845c8-e953-41cc-be0f-3e0025764ae5 req-6978c63a-8f23-4a0a-b7e3-91577dc96858 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.162643 Oct 22 21:02:26.986998 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1388/2882] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:02:26 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:02:27.004814 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-01609b3e-9ec3-4ade-b276-2f37f32122cc tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] 10.222.0.18 "GET /compute/v2.1/images/detail?status=ACTIVE" status: 200 len: 7109 microversion: 2.1 time: 0.208597 Oct 22 21:02:27.005782 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-f4adf76f-8c30-4c87-a8b4-51e8ffa25944 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Calling method '.version_select at 0x7fd3a41e3dc0>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:02:27.011921 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1495/2883] 10.222.0.18 () {58 vars in 1170 bytes} [Sat Oct 22 21:02:26 2022] GET /compute/v2.1/images/detail?status=ACTIVE => generated 7109 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:02:27.034021 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-971d8f17-a63c-4813-b22c-dd8e8cc78126 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Calling method '.version_select at 0x7fd39efb4a60>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:02:27.344272 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-f4adf76f-8c30-4c87-a8b4-51e8ffa25944 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] 10.222.0.18 "GET /compute/v2.1/images/d25d21a0-06e4-472c-b2a0-81a203d39ec0" status: 200 len: 1414 microversion: 2.1 time: 0.346989 Oct 22 21:02:27.347747 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1389/2884] 10.222.0.18 () {58 vars in 1233 bytes} [Sat Oct 22 21:02:26 2022] GET /compute/v2.1/images/d25d21a0-06e4-472c-b2a0-81a203d39ec0 => generated 1414 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:02:27.371387 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-971d8f17-a63c-4813-b22c-dd8e8cc78126 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] 10.222.0.18 "GET /compute/v2.1/images/detail?type=snapshot" status: 200 len: 4375 microversion: 2.1 time: 0.337674 Oct 22 21:02:27.372211 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1496/2885] 10.222.0.18 () {58 vars in 1170 bytes} [Sat Oct 22 21:02:27 2022] GET /compute/v2.1/images/detail?type=snapshot => generated 4375 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:02:27.409862 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-d91bbd9b-0a2f-4fd5-a78f-9e6769b238af tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Calling method '.version_select at 0x7fd3a41fc430>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:02:27.689625 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-d4288a12-6d44-4a61-9443-c08df859c8b0 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:02:27.690554 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-d4288a12-6d44-4a61-9443-c08df859c8b0 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] [instance: 2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:02:27.707207 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d4288a12-6d44-4a61-9443-c08df859c8b0 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:02:27.709301 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d4288a12-6d44-4a61-9443-c08df859c8b0 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:02:27.710626 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d4288a12-6d44-4a61-9443-c08df859c8b0 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:02:27.712568 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d4288a12-6d44-4a61-9443-c08df859c8b0 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:02:27.715905 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d4288a12-6d44-4a61-9443-c08df859c8b0 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:02:27.717468 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d4288a12-6d44-4a61-9443-c08df859c8b0 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:02:28.362619 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-d4288a12-6d44-4a61-9443-c08df859c8b0 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:02:28.375499 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-d4288a12-6d44-4a61-9443-c08df859c8b0 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:02:28.377065 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-d4288a12-6d44-4a61-9443-c08df859c8b0 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:02:28.383712 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-d4288a12-6d44-4a61-9443-c08df859c8b0 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] 10.222.0.18 "GET /compute/v2.1/servers/2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac" status: 200 len: 1546 microversion: 2.91 time: 0.704276 Oct 22 21:02:28.396904 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1497/2886] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:02:27 2022] GET /compute/v2.1/servers/2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac => generated 1546 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 22 21:02:28.396904 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-6846b6c2-ce46-4db8-ba39-fc83ed5e5a2b tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:02:28.396904 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-6846b6c2-ce46-4db8-ba39-fc83ed5e5a2b tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] [instance: a99614d8-f2f7-4ce1-87e8-47f3af03d9f8] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:02:28.398702 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6846b6c2-ce46-4db8-ba39-fc83ed5e5a2b tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:02:28.399317 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6846b6c2-ce46-4db8-ba39-fc83ed5e5a2b tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:02:28.400161 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6846b6c2-ce46-4db8-ba39-fc83ed5e5a2b tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:02:28.402961 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6846b6c2-ce46-4db8-ba39-fc83ed5e5a2b tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:02:28.403618 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6846b6c2-ce46-4db8-ba39-fc83ed5e5a2b tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:02:28.404558 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6846b6c2-ce46-4db8-ba39-fc83ed5e5a2b tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:02:29.172639 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-6846b6c2-ce46-4db8-ba39-fc83ed5e5a2b tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1b410a64e0415a96d30f5040361137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd7873d6db4e09bc9ab9a048a6b1ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:02:29.187778 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-6846b6c2-ce46-4db8-ba39-fc83ed5e5a2b tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] 10.222.0.18 "GET /compute/v2.1/servers/a99614d8-f2f7-4ce1-87e8-47f3af03d9f8" status: 200 len: 1315 microversion: 2.1 time: 0.797573 Oct 22 21:02:29.193943 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1498/2887] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:02:28 2022] GET /compute/v2.1/servers/a99614d8-f2f7-4ce1-87e8-47f3af03d9f8 => generated 1315 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:02:29.209437 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-4cf1b73e-ec89-4a86-a961-e152162f60f0 req-cf302b1d-3e55-434c-a092-d91b4827d5c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a99614d8-f2f7-4ce1-87e8-47f3af03d9f8", "tag": "de29f75a-6453-4e65-9533-8bc1ec9252f5"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:02:29.267333 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-4cf1b73e-ec89-4a86-a961-e152162f60f0 req-cf302b1d-3e55-434c-a092-d91b4827d5c4 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:02:29.274676 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-4cf1b73e-ec89-4a86-a961-e152162f60f0 req-cf302b1d-3e55-434c-a092-d91b4827d5c4 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:02:29.277457 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-4cf1b73e-ec89-4a86-a961-e152162f60f0 req-cf302b1d-3e55-434c-a092-d91b4827d5c4 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:02:29.319610 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-4cf1b73e-ec89-4a86-a961-e152162f60f0 req-cf302b1d-3e55-434c-a092-d91b4827d5c4 service nova] Creating event network-changed:de29f75a-6453-4e65-9533-8bc1ec9252f5 for instance a99614d8-f2f7-4ce1-87e8-47f3af03d9f8 on nch1-master-1 Oct 22 21:02:29.335198 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-4cf1b73e-ec89-4a86-a961-e152162f60f0 req-cf302b1d-3e55-434c-a092-d91b4827d5c4 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.138034 Oct 22 21:02:29.337607 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1499/2888] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:02:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:02:29.352848 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-70fea1de-ecfb-471e-b30c-a93a98d9162e tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Calling method '.version_select at 0x7fd39efb49d0>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:02:31.184061 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell0:SELECT=2 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:02:31.217600 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell0:SELECT=6 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:02:31.535356 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell0:SELECT=2 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:02:36.852640 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:02:36.937658 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:02:39.261731 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_api:SELECT=32 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:02:39.290503 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:02:45.767085 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-d91bbd9b-0a2f-4fd5-a78f-9e6769b238af tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] 10.222.0.18 "GET /compute/v2.1/images/085e4478-6edc-4a69-8e08-f9831713eb65" status: 200 len: 784 microversion: 2.1 time: 18.378476 Oct 22 21:02:45.767903 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1390/2889] 10.222.0.18 () {58 vars in 1233 bytes} [Sat Oct 22 21:02:27 2022] GET /compute/v2.1/images/085e4478-6edc-4a69-8e08-f9831713eb65 => generated 784 bytes in 18381 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:02:45.782014 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-70fea1de-ecfb-471e-b30c-a93a98d9162e tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] 10.222.0.18 "GET /compute/v2.1/images/d25d21a0-06e4-472c-b2a0-81a203d39ec0" status: 200 len: 1423 microversion: 2.1 time: 16.441215 Oct 22 21:02:45.796021 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1500/2890] 10.222.0.18 () {58 vars in 1233 bytes} [Sat Oct 22 21:02:29 2022] GET /compute/v2.1/images/d25d21a0-06e4-472c-b2a0-81a203d39ec0 => generated 1423 bytes in 16446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:02:45.798343 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-93fc1a8e-bb40-483c-bf8e-af72b3be9489 req-5a4d4254-a600-4ac5-a590-0a75fb1f93a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c2729a5-e874-43e7-a372-514906975851", "name": "network-vif-plugged", "status": "completed", "tag": "7e49313e-bdb0-486a-bc1c-7bf140752a97"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:02:45.811718 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-db0e1d26-7f45-4a7e-bd34-d33afb77f32b tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:02:45.812933 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-db0e1d26-7f45-4a7e-bd34-d33afb77f32b tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] [instance: 2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:02:45.835638 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-93fc1a8e-bb40-483c-bf8e-af72b3be9489 req-5a4d4254-a600-4ac5-a590-0a75fb1f93a3 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:02:45.837210 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-db0e1d26-7f45-4a7e-bd34-d33afb77f32b tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:02:45.837978 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-db0e1d26-7f45-4a7e-bd34-d33afb77f32b tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:02:45.838558 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-93fc1a8e-bb40-483c-bf8e-af72b3be9489 req-5a4d4254-a600-4ac5-a590-0a75fb1f93a3 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:02:45.839125 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-db0e1d26-7f45-4a7e-bd34-d33afb77f32b tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:02:45.839736 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-93fc1a8e-bb40-483c-bf8e-af72b3be9489 req-5a4d4254-a600-4ac5-a590-0a75fb1f93a3 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:02:45.840586 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-db0e1d26-7f45-4a7e-bd34-d33afb77f32b tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:02:45.842188 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-db0e1d26-7f45-4a7e-bd34-d33afb77f32b tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:02:45.844434 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-db0e1d26-7f45-4a7e-bd34-d33afb77f32b tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:02:45.893096 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-93fc1a8e-bb40-483c-bf8e-af72b3be9489 req-5a4d4254-a600-4ac5-a590-0a75fb1f93a3 service nova] Creating event network-vif-plugged:7e49313e-bdb0-486a-bc1c-7bf140752a97 for instance 9c2729a5-e874-43e7-a372-514906975851 on nch2-master-1 Oct 22 21:02:45.902534 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-93fc1a8e-bb40-483c-bf8e-af72b3be9489 req-5a4d4254-a600-4ac5-a590-0a75fb1f93a3 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133119 Oct 22 21:02:45.907555 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1391/2891] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:02:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:02:45.928282 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-a681f8d5-08b1-4809-996a-212433170dd8 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:02:45.929458 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-a681f8d5-08b1-4809-996a-212433170dd8 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] [instance: a99614d8-f2f7-4ce1-87e8-47f3af03d9f8] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:02:45.952353 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a681f8d5-08b1-4809-996a-212433170dd8 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:02:45.953212 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a681f8d5-08b1-4809-996a-212433170dd8 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:02:45.953916 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a681f8d5-08b1-4809-996a-212433170dd8 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:02:45.954882 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a681f8d5-08b1-4809-996a-212433170dd8 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:02:45.955622 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a681f8d5-08b1-4809-996a-212433170dd8 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:02:45.960630 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a681f8d5-08b1-4809-996a-212433170dd8 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:02:46.159320 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-db0e1d26-7f45-4a7e-bd34-d33afb77f32b tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:02:46.201844 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-db0e1d26-7f45-4a7e-bd34-d33afb77f32b tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:02:46.208702 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-db0e1d26-7f45-4a7e-bd34-d33afb77f32b tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:02:46.243368 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-db0e1d26-7f45-4a7e-bd34-d33afb77f32b tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] 10.222.0.18 "GET /compute/v2.1/servers/2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac" status: 200 len: 1546 microversion: 2.91 time: 0.450616 Oct 22 21:02:46.249087 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1501/2892] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:02:45 2022] GET /compute/v2.1/servers/2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac => generated 1546 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:02:46.268869 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-c9aa0252-05f2-4aa9-aa50-d5e3a80f65f3 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Calling method '.version_select at 0x7fd39efb6790>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:02:46.484066 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-a681f8d5-08b1-4809-996a-212433170dd8 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1b410a64e0415a96d30f5040361137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd7873d6db4e09bc9ab9a048a6b1ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:02:46.500548 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-a681f8d5-08b1-4809-996a-212433170dd8 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] 10.222.0.18 "GET /compute/v2.1/servers/a99614d8-f2f7-4ce1-87e8-47f3af03d9f8" status: 200 len: 1315 microversion: 2.1 time: 0.587650 Oct 22 21:02:46.504381 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-c9aa0252-05f2-4aa9-aa50-d5e3a80f65f3 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] 10.222.0.18 "GET /compute/v2.1/images/detail?limit=1" status: 200 len: 1610 microversion: 2.1 time: 0.252814 Oct 22 21:02:46.507985 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1502/2893] 10.222.0.18 () {58 vars in 1158 bytes} [Sat Oct 22 21:02:46 2022] GET /compute/v2.1/images/detail?limit=1 => generated 1610 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:02:46.520704 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1392/2894] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:02:45 2022] GET /compute/v2.1/servers/a99614d8-f2f7-4ce1-87e8-47f3af03d9f8 => generated 1315 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:02:46.522737 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-fe9cef71-d436-4ba0-a334-51d1d5eeceb7 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Calling method '.version_select at 0x7fd39efb4160>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:02:46.541926 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-23c822b1-fe86-41a6-b2cb-522f88c49905 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Calling method '.version_select at 0x7fd3a44a7430>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:02:47.084912 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-fe9cef71-d436-4ba0-a334-51d1d5eeceb7 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] 10.222.0.18 "GET /compute/v2.1/images/d25d21a0-06e4-472c-b2a0-81a203d39ec0" status: 200 len: 1423 microversion: 2.1 time: 0.574791 Oct 22 21:02:47.095888 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1503/2895] 10.222.0.18 () {58 vars in 1233 bytes} [Sat Oct 22 21:02:46 2022] GET /compute/v2.1/images/d25d21a0-06e4-472c-b2a0-81a203d39ec0 => generated 1423 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:02:47.343043 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-3636af1d-6b72-4720-b848-b961f5e9c799 tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Action: 'create', calling method: .version_select at 0x7fd39effcee0>, body: {"server_group": {"name": "tempest-ServerGroupTestJSON-Server-Group-374262479", "policies": ["affinity"]}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:02:47.374610 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-3636af1d-6b72-4720-b848-b961f5e9c799 tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Getting quotas for project 1dfacd9c525f486eaa04d19dbe2dc423. Resources: {'server_groups'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 21:02:47.381650 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-3636af1d-6b72-4720-b848-b961f5e9c799 tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Getting quotas for user 3adb02392d074b7eb08c94bbf1904547 and project 1dfacd9c525f486eaa04d19dbe2dc423. Resources: {'server_groups'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 21:02:47.438185 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-3636af1d-6b72-4720-b848-b961f5e9c799 tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Getting quotas for project 1dfacd9c525f486eaa04d19dbe2dc423. Resources: {'server_groups'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 21:02:47.451106 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-3636af1d-6b72-4720-b848-b961f5e9c799 tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Getting quotas for user 3adb02392d074b7eb08c94bbf1904547 and project 1dfacd9c525f486eaa04d19dbe2dc423. Resources: {'server_groups'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 21:02:47.476610 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-3636af1d-6b72-4720-b848-b961f5e9c799 tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] 10.222.0.18 "POST /compute/v2.1/os-server-groups" status: 200 len: 183 microversion: 2.1 time: 0.378620 Oct 22 21:02:47.477423 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1504/2896] 10.222.0.18 () {60 vars in 1174 bytes} [Sat Oct 22 21:02:47 2022] POST /compute/v2.1/os-server-groups => generated 183 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:02:47.485215 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-887ac956-2c41-49d0-99d3-5ae99cc52cfa tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Calling method '.version_select at 0x7fd39efb65e0>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:02:47.735293 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-23c822b1-fe86-41a6-b2cb-522f88c49905 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] 10.222.0.18 "DELETE /compute/v2.1/images/79f95f30-3a63-4549-bbef-2ac330a78b61" status: 204 len: 0 microversion: 2.1 time: 1.204520 Oct 22 21:02:47.736990 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1393/2897] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:02:46 2022] DELETE /compute/v2.1/images/79f95f30-3a63-4549-bbef-2ac330a78b61 => generated 0 bytes in 1215 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 21:02:47.747420 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-aa5f7f6f-c8bf-4ccf-8f86-87571e2cc04f tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:02:47.748394 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-aa5f7f6f-c8bf-4ccf-8f86-87571e2cc04f tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] [instance: 2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:02:47.763533 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-aa5f7f6f-c8bf-4ccf-8f86-87571e2cc04f tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:02:47.764272 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-aa5f7f6f-c8bf-4ccf-8f86-87571e2cc04f tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:02:47.765127 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-aa5f7f6f-c8bf-4ccf-8f86-87571e2cc04f tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:02:47.765870 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-aa5f7f6f-c8bf-4ccf-8f86-87571e2cc04f tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:02:47.766472 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-aa5f7f6f-c8bf-4ccf-8f86-87571e2cc04f tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:02:47.767104 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-aa5f7f6f-c8bf-4ccf-8f86-87571e2cc04f tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:02:48.011647 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-aa5f7f6f-c8bf-4ccf-8f86-87571e2cc04f tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:02:48.035882 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-aa5f7f6f-c8bf-4ccf-8f86-87571e2cc04f tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:02:48.039466 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-aa5f7f6f-c8bf-4ccf-8f86-87571e2cc04f tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:02:48.059814 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-aa5f7f6f-c8bf-4ccf-8f86-87571e2cc04f tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] 10.222.0.18 "GET /compute/v2.1/servers/2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac" status: 200 len: 1546 microversion: 2.91 time: 0.320457 Oct 22 21:02:48.061192 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1394/2898] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:02:47 2022] GET /compute/v2.1/servers/2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac => generated 1546 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:02:48.078694 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-b2af4a5d-91f5-491d-ace4-4ef4735f0e56 tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Action: 'create', calling method: .version_select at 0x7fd3a4483700>, body: {"server_group": {"name": "tempest-server-group-1510133501", "policies": ["affinity"]}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:02:48.151372 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-b2af4a5d-91f5-491d-ace4-4ef4735f0e56 tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Getting quotas for project 1dfacd9c525f486eaa04d19dbe2dc423. Resources: {'server_groups'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 21:02:48.183264 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-b2af4a5d-91f5-491d-ace4-4ef4735f0e56 tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Getting quotas for user 3adb02392d074b7eb08c94bbf1904547 and project 1dfacd9c525f486eaa04d19dbe2dc423. Resources: {'server_groups'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 21:02:48.293470 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-b2af4a5d-91f5-491d-ace4-4ef4735f0e56 tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Getting quotas for project 1dfacd9c525f486eaa04d19dbe2dc423. Resources: {'server_groups'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 21:02:48.306713 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-b2af4a5d-91f5-491d-ace4-4ef4735f0e56 tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Getting quotas for user 3adb02392d074b7eb08c94bbf1904547 and project 1dfacd9c525f486eaa04d19dbe2dc423. Resources: {'server_groups'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 21:02:48.317548 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-887ac956-2c41-49d0-99d3-5ae99cc52cfa tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] 10.222.0.18 "DELETE /compute/v2.1/images/d25d21a0-06e4-472c-b2a0-81a203d39ec0" status: 204 len: 0 microversion: 2.1 time: 0.837707 Oct 22 21:02:48.323832 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-b2af4a5d-91f5-491d-ace4-4ef4735f0e56 tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] 10.222.0.18 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.260462 Oct 22 21:02:48.325957 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1505/2899] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:02:47 2022] DELETE /compute/v2.1/images/d25d21a0-06e4-472c-b2a0-81a203d39ec0 => generated 0 bytes in 841 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 21:02:48.327626 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1395/2900] 10.222.0.18 () {60 vars in 1173 bytes} [Sat Oct 22 21:02:48 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:02:48.333062 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-554febea-df96-402f-82f9-81ec854df282 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Calling method '.version_select at 0x7fd39fee3430>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:02:48.345424 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-66a1dee1-1d85-4de2-b842-93606e9509d0 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:02:48.347950 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-66a1dee1-1d85-4de2-b842-93606e9509d0 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] [instance: a99614d8-f2f7-4ce1-87e8-47f3af03d9f8] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:02:48.361035 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-66a1dee1-1d85-4de2-b842-93606e9509d0 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:02:48.361900 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-66a1dee1-1d85-4de2-b842-93606e9509d0 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:02:48.362672 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-66a1dee1-1d85-4de2-b842-93606e9509d0 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:02:48.372346 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-66a1dee1-1d85-4de2-b842-93606e9509d0 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:02:48.373600 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-66a1dee1-1d85-4de2-b842-93606e9509d0 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:02:48.374862 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-66a1dee1-1d85-4de2-b842-93606e9509d0 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:02:48.672543 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-66a1dee1-1d85-4de2-b842-93606e9509d0 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1b410a64e0415a96d30f5040361137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd7873d6db4e09bc9ab9a048a6b1ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:02:48.692320 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-66a1dee1-1d85-4de2-b842-93606e9509d0 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] 10.222.0.18 "GET /compute/v2.1/servers/a99614d8-f2f7-4ce1-87e8-47f3af03d9f8" status: 200 len: 1315 microversion: 2.1 time: 0.364737 Oct 22 21:02:48.693245 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1506/2901] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:02:48 2022] GET /compute/v2.1/servers/a99614d8-f2f7-4ce1-87e8-47f3af03d9f8 => generated 1315 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:02:48.699575 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-5e0024d4-4627-4bbf-8b5b-b21374de00ff req-257f7664-aef8-4d6a-8a38-444486416133 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a99614d8-f2f7-4ce1-87e8-47f3af03d9f8", "name": "network-vif-plugged", "status": "completed", "tag": "de29f75a-6453-4e65-9533-8bc1ec9252f5"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:02:48.710879 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-5e0024d4-4627-4bbf-8b5b-b21374de00ff req-257f7664-aef8-4d6a-8a38-444486416133 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:02:48.711609 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-5e0024d4-4627-4bbf-8b5b-b21374de00ff req-257f7664-aef8-4d6a-8a38-444486416133 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:02:48.713756 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-5e0024d4-4627-4bbf-8b5b-b21374de00ff req-257f7664-aef8-4d6a-8a38-444486416133 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:02:48.748246 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-5e0024d4-4627-4bbf-8b5b-b21374de00ff req-257f7664-aef8-4d6a-8a38-444486416133 service nova] Creating event network-vif-plugged:de29f75a-6453-4e65-9533-8bc1ec9252f5 for instance a99614d8-f2f7-4ce1-87e8-47f3af03d9f8 on nch1-master-1 Oct 22 21:02:48.758624 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-5e0024d4-4627-4bbf-8b5b-b21374de00ff req-257f7664-aef8-4d6a-8a38-444486416133 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059244 Oct 22 21:02:48.759327 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1507/2902] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:02:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:02:48.785409 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-b0e4a080-5b05-415b-a169-c6d4505e557e tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:02:48.790484 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-b0e4a080-5b05-415b-a169-c6d4505e557e tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] [instance: 9c2729a5-e874-43e7-a372-514906975851] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:02:48.815060 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b0e4a080-5b05-415b-a169-c6d4505e557e tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:02:48.818608 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b0e4a080-5b05-415b-a169-c6d4505e557e tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:02:48.819591 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b0e4a080-5b05-415b-a169-c6d4505e557e tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:02:48.820548 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b0e4a080-5b05-415b-a169-c6d4505e557e tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:02:48.821294 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b0e4a080-5b05-415b-a169-c6d4505e557e tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:02:48.822009 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b0e4a080-5b05-415b-a169-c6d4505e557e tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:02:48.868381 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-b0e4a080-5b05-415b-a169-c6d4505e557e tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] [instance: 9c2729a5-e874-43e7-a372-514906975851] Going to try to terminate instance {{(pid=138745) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 21:02:49.049193 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-b0e4a080-5b05-415b-a169-c6d4505e557e tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] 10.222.0.18 "DELETE /compute/v2.1/servers/9c2729a5-e874-43e7-a372-514906975851" status: 204 len: 0 microversion: 2.1 time: 0.287652 Oct 22 21:02:49.049508 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1508/2903] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 21:02:48 2022] DELETE /compute/v2.1/servers/9c2729a5-e874-43e7-a372-514906975851 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 21:02:49.054954 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-6af5aa44-9ee4-404b-a19e-e9a270267555 tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Action: 'create', calling method: .version_select at 0x7fd39efc4a60>, body: {"server_group": {"name": "tempest-server-group-1510133501", "policies": ["affinity"]}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:02:49.110844 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-6af5aa44-9ee4-404b-a19e-e9a270267555 tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Getting quotas for project 1dfacd9c525f486eaa04d19dbe2dc423. Resources: {'server_groups'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 21:02:49.131289 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-6af5aa44-9ee4-404b-a19e-e9a270267555 tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Getting quotas for user 3adb02392d074b7eb08c94bbf1904547 and project 1dfacd9c525f486eaa04d19dbe2dc423. Resources: {'server_groups'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 21:02:49.242416 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-6af5aa44-9ee4-404b-a19e-e9a270267555 tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Getting quotas for project 1dfacd9c525f486eaa04d19dbe2dc423. Resources: {'server_groups'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 21:02:49.250022 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-6af5aa44-9ee4-404b-a19e-e9a270267555 tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Getting quotas for user 3adb02392d074b7eb08c94bbf1904547 and project 1dfacd9c525f486eaa04d19dbe2dc423. Resources: {'server_groups'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 21:02:49.269931 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-6af5aa44-9ee4-404b-a19e-e9a270267555 tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] 10.222.0.18 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.219166 Oct 22 21:02:49.271139 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1509/2904] 10.222.0.18 () {60 vars in 1173 bytes} [Sat Oct 22 21:02:49 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:02:49.277360 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-8aa168f2-3195-4005-bcc4-f501dc911e1d tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:02:49.278403 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-8aa168f2-3195-4005-bcc4-f501dc911e1d tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] [instance: 2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:02:49.288256 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8aa168f2-3195-4005-bcc4-f501dc911e1d tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:02:49.289076 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8aa168f2-3195-4005-bcc4-f501dc911e1d tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:02:49.289754 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8aa168f2-3195-4005-bcc4-f501dc911e1d tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:02:49.291798 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8aa168f2-3195-4005-bcc4-f501dc911e1d tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:02:49.291798 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8aa168f2-3195-4005-bcc4-f501dc911e1d tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:02:49.292324 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8aa168f2-3195-4005-bcc4-f501dc911e1d tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:02:49.326589 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-554febea-df96-402f-82f9-81ec854df282 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] 10.222.0.18 "DELETE /compute/v2.1/images/e8a48405-7084-4515-a1fe-96c425df5e47" status: 204 len: 0 microversion: 2.1 time: 0.997801 Oct 22 21:02:49.328412 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1396/2905] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:02:48 2022] DELETE /compute/v2.1/images/e8a48405-7084-4515-a1fe-96c425df5e47 => generated 0 bytes in 1000 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 21:02:49.333780 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-06c34fe5-819a-48e2-8706-99695b02e2c6 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-567246957", "imageRef": "085e4478-6edc-4a69-8e08-f9831713eb65", "flavorRef": "452", "networks": [{"uuid": "f1ad1f3f-09bf-4698-9fe5-20142c78993a"}]}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:02:49.437963 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-8aa168f2-3195-4005-bcc4-f501dc911e1d tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:02:49.441116 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.network.neutron [None req-06c34fe5-819a-48e2-8706-99695b02e2c6 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] validate_networks() for [('f1ad1f3f-09bf-4698-9fe5-20142c78993a', None, None, None, None, None)] {{(pid=138744) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 21:02:49.448611 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-8aa168f2-3195-4005-bcc4-f501dc911e1d tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:02:49.450898 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-8aa168f2-3195-4005-bcc4-f501dc911e1d tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:02:49.457620 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-8aa168f2-3195-4005-bcc4-f501dc911e1d tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] 10.222.0.18 "GET /compute/v2.1/servers/2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac" status: 200 len: 1546 microversion: 2.91 time: 0.185169 Oct 22 21:02:49.458720 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1510/2906] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:02:49 2022] GET /compute/v2.1/servers/2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac => generated 1546 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:02:49.478451 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-64219c7b-5478-448f-b9dc-b86e62629066 tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:02:49.509611 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-64219c7b-5478-448f-b9dc-b86e62629066 tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] 10.222.0.18 "DELETE /compute/v2.1/os-server-groups/d8cb79a2-cbfb-42ab-a662-ed3f893cb818" status: 204 len: 0 microversion: 2.1 time: 0.049630 Oct 22 21:02:49.510517 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1511/2907] 10.222.0.18 () {58 vars in 1266 bytes} [Sat Oct 22 21:02:49 2022] DELETE /compute/v2.1/os-server-groups/d8cb79a2-cbfb-42ab-a662-ed3f893cb818 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 21:02:49.516719 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-24806833-1645-4598-a3ae-710b37704b91 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Calling method '.version_select at 0x7fd39efb9ee0>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:02:49.972301 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-06c34fe5-819a-48e2-8706-99695b02e2c6 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Flavor limits 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 21:02:49.972641 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-06c34fe5-819a-48e2-8706-99695b02e2c6 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Image limits 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 21:02:49.973125 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-06c34fe5-819a-48e2-8706-99695b02e2c6 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Flavor pref 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 21:02:49.973546 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-06c34fe5-819a-48e2-8706-99695b02e2c6 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Image pref 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 21:02:49.974517 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-06c34fe5-819a-48e2-8706-99695b02e2c6 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 21:02:49.986906 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-06c34fe5-819a-48e2-8706-99695b02e2c6 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:02:49.987693 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-06c34fe5-819a-48e2-8706-99695b02e2c6 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:02:49.989144 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-06c34fe5-819a-48e2-8706-99695b02e2c6 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:02:49.989952 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-06c34fe5-819a-48e2-8706-99695b02e2c6 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:02:49.990649 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-06c34fe5-819a-48e2-8706-99695b02e2c6 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:02:49.991811 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-06c34fe5-819a-48e2-8706-99695b02e2c6 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:02:50.045186 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-06c34fe5-819a-48e2-8706-99695b02e2c6 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Getting quotas for project 66a26a2284f4424cbeaf63d504652546. Resources: {'cores', 'instances', 'ram'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 21:02:50.053672 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-06c34fe5-819a-48e2-8706-99695b02e2c6 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Getting quotas for user f0a44ff8e7c14b94b1670f030085c43d and project 66a26a2284f4424cbeaf63d504652546. Resources: {'cores', 'instances', 'ram'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 21:02:50.075825 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-06c34fe5-819a-48e2-8706-99695b02e2c6 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Going to run 1 instances... {{(pid=138744) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 21:02:50.079168 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-06c34fe5-819a-48e2-8706-99695b02e2c6 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] [instance: 524c2c11-4a65-4360-93e4-e25349cb6416] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='085e4478-6edc-4a69-8e08-f9831713eb65',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138744) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 21:02:50.154473 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-06c34fe5-819a-48e2-8706-99695b02e2c6 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.824374 Oct 22 21:02:50.155996 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1397/2908] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Oct 22 21:02:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 826 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 21:02:50.163232 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-173a1be5-e23c-4e87-9d15-0b79c0c7230d tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:02:50.214339 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-24806833-1645-4598-a3ae-710b37704b91 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] 10.222.0.18 "DELETE /compute/v2.1/images/8368f750-e203-4ef8-b979-ba7ef86a0df0" status: 204 len: 0 microversion: 2.1 time: 0.702247 Oct 22 21:02:50.215270 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1512/2909] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:02:49 2022] DELETE /compute/v2.1/images/8368f750-e203-4ef8-b979-ba7ef86a0df0 => generated 0 bytes in 704 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 21:02:50.218733 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-173a1be5-e23c-4e87-9d15-0b79c0c7230d tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] 10.222.0.18 "GET /compute/v2.1/os-server-groups" status: 200 len: 334 microversion: 2.1 time: 0.061090 Oct 22 21:02:50.220503 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1398/2910] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Oct 22 21:02:50 2022] GET /compute/v2.1/os-server-groups => generated 334 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:02:50.222259 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-43feee55-21c0-4657-9510-13acf4d98b56 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:02:50.223751 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-43feee55-21c0-4657-9510-13acf4d98b56 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] [instance: a99614d8-f2f7-4ce1-87e8-47f3af03d9f8] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:02:50.229062 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-a5ee0ecf-654c-48e3-b416-afd03fc9a839 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:02:50.229938 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-a5ee0ecf-654c-48e3-b416-afd03fc9a839 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] [instance: 524c2c11-4a65-4360-93e4-e25349cb6416] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:02:50.236184 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-43feee55-21c0-4657-9510-13acf4d98b56 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:02:50.237123 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-43feee55-21c0-4657-9510-13acf4d98b56 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:02:50.238620 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-43feee55-21c0-4657-9510-13acf4d98b56 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:02:50.239663 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-43feee55-21c0-4657-9510-13acf4d98b56 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:02:50.240291 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-43feee55-21c0-4657-9510-13acf4d98b56 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:02:50.240957 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-43feee55-21c0-4657-9510-13acf4d98b56 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:02:50.414781 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-a5ee0ecf-654c-48e3-b416-afd03fc9a839 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a44ff8e7c14b94b1670f030085c43d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a26a2284f4424cbeaf63d504652546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:02:50.422824 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-a5ee0ecf-654c-48e3-b416-afd03fc9a839 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] 10.222.0.18 "GET /compute/v2.1/servers/524c2c11-4a65-4360-93e4-e25349cb6416" status: 200 len: 1207 microversion: 2.1 time: 0.200822 Oct 22 21:02:50.432318 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1399/2911] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:02:50 2022] GET /compute/v2.1/servers/524c2c11-4a65-4360-93e4-e25349cb6416 => generated 1207 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:02:50.441506 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-48d9459c-2fe7-4818-a0a7-e0ea0eb728fa tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:02:50.442041 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-48d9459c-2fe7-4818-a0a7-e0ea0eb728fa tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] [instance: ee6c092d-1150-415f-8a2e-58f4d3b5c238] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:02:50.475021 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-48d9459c-2fe7-4818-a0a7-e0ea0eb728fa tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:02:50.476212 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-48d9459c-2fe7-4818-a0a7-e0ea0eb728fa tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:02:50.477875 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-48d9459c-2fe7-4818-a0a7-e0ea0eb728fa tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:02:50.482950 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-48d9459c-2fe7-4818-a0a7-e0ea0eb728fa tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:02:50.484904 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-48d9459c-2fe7-4818-a0a7-e0ea0eb728fa tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:02:50.487612 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-48d9459c-2fe7-4818-a0a7-e0ea0eb728fa tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:02:50.531836 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-43feee55-21c0-4657-9510-13acf4d98b56 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1b410a64e0415a96d30f5040361137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd7873d6db4e09bc9ab9a048a6b1ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:02:50.547526 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-43feee55-21c0-4657-9510-13acf4d98b56 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] 10.222.0.18 "GET /compute/v2.1/servers/a99614d8-f2f7-4ce1-87e8-47f3af03d9f8" status: 200 len: 1315 microversion: 2.1 time: 0.330382 Oct 22 21:02:50.548408 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-48d9459c-2fe7-4818-a0a7-e0ea0eb728fa tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] [instance: ee6c092d-1150-415f-8a2e-58f4d3b5c238] Going to try to terminate instance {{(pid=138744) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 21:02:50.548970 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1513/2912] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:02:50 2022] GET /compute/v2.1/servers/a99614d8-f2f7-4ce1-87e8-47f3af03d9f8 => generated 1315 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:02:50.562047 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-8f677534-b86e-40af-af17-81557e8b5098 tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:02:50.653964 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-8f677534-b86e-40af-af17-81557e8b5098 tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] 10.222.0.18 "DELETE /compute/v2.1/os-server-groups/d10f3144-a8a1-4453-9481-880f392239b4" status: 204 len: 0 microversion: 2.1 time: 0.103234 Oct 22 21:02:50.655378 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1514/2913] 10.222.0.18 () {58 vars in 1266 bytes} [Sat Oct 22 21:02:50 2022] DELETE /compute/v2.1/os-server-groups/d10f3144-a8a1-4453-9481-880f392239b4 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 21:02:50.690896 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-48d9459c-2fe7-4818-a0a7-e0ea0eb728fa tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] 10.222.0.18 "DELETE /compute/v2.1/servers/ee6c092d-1150-415f-8a2e-58f4d3b5c238" status: 204 len: 0 microversion: 2.1 time: 0.256718 Oct 22 21:02:50.692034 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1400/2914] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 21:02:50 2022] DELETE /compute/v2.1/servers/ee6c092d-1150-415f-8a2e-58f4d3b5c238 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 21:02:50.698296 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-be6af051-5cb3-449d-a9e3-f02784174560 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:02:50.698923 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-be6af051-5cb3-449d-a9e3-f02784174560 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] [instance: 2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:02:50.699610 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-637e2b5e-16ac-44f9-9547-cc30ec5eefee tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:02:50.715625 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-637e2b5e-16ac-44f9-9547-cc30ec5eefee tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] 10.222.0.18 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.021431 Oct 22 21:02:50.716932 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1401/2915] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Oct 22 21:02:50 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:02:50.724462 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-ad6ca602-1908-4842-8a61-d45667113ff7 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:02:50.727167 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-ad6ca602-1908-4842-8a61-d45667113ff7 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] [instance: ee6c092d-1150-415f-8a2e-58f4d3b5c238] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:02:50.730536 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-be6af051-5cb3-449d-a9e3-f02784174560 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:02:50.739263 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-be6af051-5cb3-449d-a9e3-f02784174560 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:02:50.740132 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-be6af051-5cb3-449d-a9e3-f02784174560 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:02:50.742489 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-be6af051-5cb3-449d-a9e3-f02784174560 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:02:50.743195 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-be6af051-5cb3-449d-a9e3-f02784174560 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:02:50.746744 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-be6af051-5cb3-449d-a9e3-f02784174560 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:02:50.751600 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ad6ca602-1908-4842-8a61-d45667113ff7 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:02:50.752130 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ad6ca602-1908-4842-8a61-d45667113ff7 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:02:50.752757 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ad6ca602-1908-4842-8a61-d45667113ff7 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:02:50.753395 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ad6ca602-1908-4842-8a61-d45667113ff7 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:02:50.753857 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ad6ca602-1908-4842-8a61-d45667113ff7 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:02:50.754292 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ad6ca602-1908-4842-8a61-d45667113ff7 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:02:50.933601 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-be6af051-5cb3-449d-a9e3-f02784174560 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:02:50.944317 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-be6af051-5cb3-449d-a9e3-f02784174560 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:02:50.946135 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-be6af051-5cb3-449d-a9e3-f02784174560 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:02:50.952319 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-be6af051-5cb3-449d-a9e3-f02784174560 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] 10.222.0.18 "GET /compute/v2.1/servers/2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac" status: 200 len: 1546 microversion: 2.91 time: 0.295535 Oct 22 21:02:50.954834 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1515/2916] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:02:50 2022] GET /compute/v2.1/servers/2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac => generated 1546 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:02:50.978953 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-f60acf9e-92dd-4751-bb97-c9bfafca3a29 tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Action: 'create', calling method: .version_select at 0x7fd39efb9ca0>, body: {"server_group": {"name": "tempest-server-group-412670072", "policies": ["affinity"]}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:02:51.004702 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=4,nova_api:UPDATE=1,nova_api:DELETE=6 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:02:51.023125 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-f60acf9e-92dd-4751-bb97-c9bfafca3a29 tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Getting quotas for project 1dfacd9c525f486eaa04d19dbe2dc423. Resources: {'server_groups'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 21:02:51.052149 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-f60acf9e-92dd-4751-bb97-c9bfafca3a29 tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Getting quotas for user 3adb02392d074b7eb08c94bbf1904547 and project 1dfacd9c525f486eaa04d19dbe2dc423. Resources: {'server_groups'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 21:02:51.112537 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-ad6ca602-1908-4842-8a61-d45667113ff7 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b9bfe6f6d564d4c9fb1fea439476e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6e01f91c3a845bf8e67e3ad415d9c69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:02:51.126509 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-ad6ca602-1908-4842-8a61-d45667113ff7 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] 10.222.0.18 "GET /compute/v2.1/servers/ee6c092d-1150-415f-8a2e-58f4d3b5c238" status: 200 len: 1473 microversion: 2.1 time: 0.406052 Oct 22 21:02:51.134633 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-f60acf9e-92dd-4751-bb97-c9bfafca3a29 tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Getting quotas for project 1dfacd9c525f486eaa04d19dbe2dc423. Resources: {'server_groups'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 21:02:51.140100 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1402/2917] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:02:50 2022] GET /compute/v2.1/servers/ee6c092d-1150-415f-8a2e-58f4d3b5c238 => generated 1473 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:02:51.146233 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-f60acf9e-92dd-4751-bb97-c9bfafca3a29 tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Getting quotas for user 3adb02392d074b7eb08c94bbf1904547 and project 1dfacd9c525f486eaa04d19dbe2dc423. Resources: {'server_groups'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 21:02:51.165325 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-8b77241b-3286-4552-ad9a-5d542b77f506 req-91b2ff04-ba9d-47de-bc8a-bda905acae9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c2729a5-e874-43e7-a372-514906975851", "name": "network-vif-unplugged", "status": "completed", "tag": "7e49313e-bdb0-486a-bc1c-7bf140752a97"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:02:51.174544 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-f60acf9e-92dd-4751-bb97-c9bfafca3a29 tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] 10.222.0.18 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.217741 Oct 22 21:02:51.178040 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-8b77241b-3286-4552-ad9a-5d542b77f506 req-91b2ff04-ba9d-47de-bc8a-bda905acae9c service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:02:51.178834 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-8b77241b-3286-4552-ad9a-5d542b77f506 req-91b2ff04-ba9d-47de-bc8a-bda905acae9c service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:02:51.179583 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-8b77241b-3286-4552-ad9a-5d542b77f506 req-91b2ff04-ba9d-47de-bc8a-bda905acae9c service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:02:51.181810 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1516/2918] 10.222.0.18 () {60 vars in 1173 bytes} [Sat Oct 22 21:02:50 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:02:51.188177 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-73827c05-e975-4092-9764-53e9dc1597f9 tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:02:51.198983 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-8b77241b-3286-4552-ad9a-5d542b77f506 req-91b2ff04-ba9d-47de-bc8a-bda905acae9c service nova] Creating event network-vif-unplugged:7e49313e-bdb0-486a-bc1c-7bf140752a97 for instance 9c2729a5-e874-43e7-a372-514906975851 on nch2-master-1 Oct 22 21:02:51.206286 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-8b77241b-3286-4552-ad9a-5d542b77f506 req-91b2ff04-ba9d-47de-bc8a-bda905acae9c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.057226 Oct 22 21:02:51.209578 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1403/2919] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:02:51 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:02:51.236882 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-73827c05-e975-4092-9764-53e9dc1597f9 tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] 10.222.0.18 "DELETE /compute/v2.1/os-server-groups/1c137e61-d13b-43b0-aca0-6b4b3b6a9572" status: 204 len: 0 microversion: 2.1 time: 0.053803 Oct 22 21:02:51.237493 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1517/2920] 10.222.0.18 () {58 vars in 1266 bytes} [Sat Oct 22 21:02:51 2022] DELETE /compute/v2.1/os-server-groups/1c137e61-d13b-43b0-aca0-6b4b3b6a9572 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 21:02:51.247106 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-6f3ca2d2-8327-45cf-8e22-966b09a75124 tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:02:51.260733 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-6f3ca2d2-8327-45cf-8e22-966b09a75124 tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] 10.222.0.18 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.018483 Oct 22 21:02:51.270948 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1404/2921] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Oct 22 21:02:51 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:02:51.275978 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-1c21bb56-358b-4ccb-9680-9dea59a4eeb0 tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Action: 'create', calling method: .version_select at 0x7fd39efa2940>, body: {"server_group": {"name": "tempest-server-group-1123402185", "policies": ["anti-affinity"]}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:02:51.300014 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-1c21bb56-358b-4ccb-9680-9dea59a4eeb0 tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Getting quotas for project 1dfacd9c525f486eaa04d19dbe2dc423. Resources: {'server_groups'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 21:02:51.307558 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-1c21bb56-358b-4ccb-9680-9dea59a4eeb0 tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Getting quotas for user 3adb02392d074b7eb08c94bbf1904547 and project 1dfacd9c525f486eaa04d19dbe2dc423. Resources: {'server_groups'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 21:02:51.359615 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-1c21bb56-358b-4ccb-9680-9dea59a4eeb0 tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Getting quotas for project 1dfacd9c525f486eaa04d19dbe2dc423. Resources: {'server_groups'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 21:02:51.366377 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-1c21bb56-358b-4ccb-9680-9dea59a4eeb0 tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Getting quotas for user 3adb02392d074b7eb08c94bbf1904547 and project 1dfacd9c525f486eaa04d19dbe2dc423. Resources: {'server_groups'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 21:02:51.387174 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-1c21bb56-358b-4ccb-9680-9dea59a4eeb0 tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] 10.222.0.18 "POST /compute/v2.1/os-server-groups" status: 200 len: 169 microversion: 2.1 time: 0.115917 Oct 22 21:02:51.388337 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1518/2922] 10.222.0.18 () {60 vars in 1173 bytes} [Sat Oct 22 21:02:51 2022] POST /compute/v2.1/os-server-groups => generated 169 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:02:51.399175 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-9af49af1-f847-4af4-9617-79838ee894ee tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:02:51.444100 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-9af49af1-f847-4af4-9617-79838ee894ee tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] 10.222.0.18 "DELETE /compute/v2.1/os-server-groups/f68085b3-f314-4d98-9b8a-433370eb9a3b" status: 204 len: 0 microversion: 2.1 time: 0.048988 Oct 22 21:02:51.448000 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-abf4955a-735a-4af5-8e85-303cdd26411d tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:02:51.449796 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1405/2923] 10.222.0.18 () {58 vars in 1266 bytes} [Sat Oct 22 21:02:51 2022] DELETE /compute/v2.1/os-server-groups/f68085b3-f314-4d98-9b8a-433370eb9a3b => generated 0 bytes in 51 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 22 21:02:51.452956 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-abf4955a-735a-4af5-8e85-303cdd26411d tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] [instance: 524c2c11-4a65-4360-93e4-e25349cb6416] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:02:51.455861 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-87e3bc9a-da10-42eb-b3bd-832fa9d66e8b tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:02:51.476142 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-abf4955a-735a-4af5-8e85-303cdd26411d tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:02:51.477857 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-87e3bc9a-da10-42eb-b3bd-832fa9d66e8b tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] 10.222.0.18 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.026500 Oct 22 21:02:51.479587 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1406/2924] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Oct 22 21:02:51 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:02:51.491448 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-abf4955a-735a-4af5-8e85-303cdd26411d tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:02:51.491448 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-abf4955a-735a-4af5-8e85-303cdd26411d tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:02:51.491448 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-abf4955a-735a-4af5-8e85-303cdd26411d tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:02:51.491448 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-abf4955a-735a-4af5-8e85-303cdd26411d tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:02:51.491448 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-abf4955a-735a-4af5-8e85-303cdd26411d tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:02:51.563603 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-85f26d40-b421-42c2-af31-69c6f99a1337 tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerGroupTestJSON-server-69712215", "imageRef": "085e4478-6edc-4a69-8e08-f9831713eb65", "flavorRef": "452", "networks": [{"uuid": "b0156283-3987-444d-8d8e-f7524ed7ade6"}]}, "os:scheduler_hints": {"group": "153f2eec-8150-44c3-879c-11c66f5f1da1"}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:02:51.580898 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-abf4955a-735a-4af5-8e85-303cdd26411d tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a44ff8e7c14b94b1670f030085c43d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a26a2284f4424cbeaf63d504652546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:02:51.589434 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-abf4955a-735a-4af5-8e85-303cdd26411d tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] 10.222.0.18 "GET /compute/v2.1/servers/524c2c11-4a65-4360-93e4-e25349cb6416" status: 200 len: 1211 microversion: 2.1 time: 0.145990 Oct 22 21:02:51.590229 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1519/2925] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:02:51 2022] GET /compute/v2.1/servers/524c2c11-4a65-4360-93e4-e25349cb6416 => generated 1211 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:02:51.595209 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-fd3666e9-f183-4685-882e-7858c124da15 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:02:51.596246 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-fd3666e9-f183-4685-882e-7858c124da15 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] [instance: a99614d8-f2f7-4ce1-87e8-47f3af03d9f8] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:02:51.603759 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fd3666e9-f183-4685-882e-7858c124da15 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:02:51.604857 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fd3666e9-f183-4685-882e-7858c124da15 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:02:51.605609 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fd3666e9-f183-4685-882e-7858c124da15 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:02:51.606674 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fd3666e9-f183-4685-882e-7858c124da15 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:02:51.607381 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fd3666e9-f183-4685-882e-7858c124da15 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:02:51.608054 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fd3666e9-f183-4685-882e-7858c124da15 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:02:51.640742 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.network.neutron [None req-85f26d40-b421-42c2-af31-69c6f99a1337 tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] validate_networks() for [('b0156283-3987-444d-8d8e-f7524ed7ade6', None, None, None, None, None)] {{(pid=138744) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 21:02:51.844891 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-fd3666e9-f183-4685-882e-7858c124da15 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1b410a64e0415a96d30f5040361137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd7873d6db4e09bc9ab9a048a6b1ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:02:51.854290 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-fd3666e9-f183-4685-882e-7858c124da15 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] 10.222.0.18 "GET /compute/v2.1/servers/a99614d8-f2f7-4ce1-87e8-47f3af03d9f8" status: 200 len: 1503 microversion: 2.1 time: 0.262634 Oct 22 21:02:51.855871 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1520/2926] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:02:51 2022] GET /compute/v2.1/servers/a99614d8-f2f7-4ce1-87e8-47f3af03d9f8 => generated 1503 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:02:51.878824 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-65d1d2ef-d517-4d22-9b60-2bd38ec13406 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:02:51.879620 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-65d1d2ef-d517-4d22-9b60-2bd38ec13406 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] [instance: a99614d8-f2f7-4ce1-87e8-47f3af03d9f8] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:02:51.886096 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-65d1d2ef-d517-4d22-9b60-2bd38ec13406 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:02:51.886821 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-65d1d2ef-d517-4d22-9b60-2bd38ec13406 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:02:51.887442 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-65d1d2ef-d517-4d22-9b60-2bd38ec13406 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:02:51.888456 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-65d1d2ef-d517-4d22-9b60-2bd38ec13406 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:02:51.889540 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-65d1d2ef-d517-4d22-9b60-2bd38ec13406 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:02:51.890126 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-65d1d2ef-d517-4d22-9b60-2bd38ec13406 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:02:51.919246 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.objects.instance [None req-65d1d2ef-d517-4d22-9b60-2bd38ec13406 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lazy-loading 'flavor' on Instance uuid a99614d8-f2f7-4ce1-87e8-47f3af03d9f8 {{(pid=138745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 21:02:52.168376 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-65d1d2ef-d517-4d22-9b60-2bd38ec13406 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] 10.222.0.18 "POST /compute/v2.1/servers/a99614d8-f2f7-4ce1-87e8-47f3af03d9f8/action" status: 202 len: 0 microversion: 2.1 time: 0.292132 Oct 22 21:02:52.173844 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1521/2927] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 21:02:51 2022] POST /compute/v2.1/servers/a99614d8-f2f7-4ce1-87e8-47f3af03d9f8/action => generated 0 bytes in 300 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 22 21:02:52.186955 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-85f26d40-b421-42c2-af31-69c6f99a1337 tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Flavor limits 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 21:02:52.187429 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-85f26d40-b421-42c2-af31-69c6f99a1337 tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Image limits 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 21:02:52.188523 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-85f26d40-b421-42c2-af31-69c6f99a1337 tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Flavor pref 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 21:02:52.188675 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-a7ee678b-7008-49c0-a71d-3f6a65946691 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:02:52.189253 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-85f26d40-b421-42c2-af31-69c6f99a1337 tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Image pref 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 21:02:52.189846 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-85f26d40-b421-42c2-af31-69c6f99a1337 tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 21:02:52.190329 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-a7ee678b-7008-49c0-a71d-3f6a65946691 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] [instance: 2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:02:52.209343 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-85f26d40-b421-42c2-af31-69c6f99a1337 tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:02:52.209856 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-85f26d40-b421-42c2-af31-69c6f99a1337 tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:02:52.210306 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-85f26d40-b421-42c2-af31-69c6f99a1337 tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:02:52.211129 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-85f26d40-b421-42c2-af31-69c6f99a1337 tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:02:52.211556 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-85f26d40-b421-42c2-af31-69c6f99a1337 tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:02:52.212104 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-85f26d40-b421-42c2-af31-69c6f99a1337 tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:02:52.219186 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a7ee678b-7008-49c0-a71d-3f6a65946691 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:02:52.223669 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a7ee678b-7008-49c0-a71d-3f6a65946691 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:02:52.224262 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a7ee678b-7008-49c0-a71d-3f6a65946691 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:02:52.225089 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a7ee678b-7008-49c0-a71d-3f6a65946691 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:02:52.226199 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a7ee678b-7008-49c0-a71d-3f6a65946691 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:02:52.227357 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a7ee678b-7008-49c0-a71d-3f6a65946691 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:02:52.234850 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-85f26d40-b421-42c2-af31-69c6f99a1337 tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Getting quotas for project 1dfacd9c525f486eaa04d19dbe2dc423. Resources: {'cores', 'instances', 'ram'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 21:02:52.251855 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-85f26d40-b421-42c2-af31-69c6f99a1337 tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Getting quotas for user 3adb02392d074b7eb08c94bbf1904547 and project 1dfacd9c525f486eaa04d19dbe2dc423. Resources: {'cores', 'instances', 'ram'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 21:02:52.306526 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-85f26d40-b421-42c2-af31-69c6f99a1337 tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Going to run 1 instances... {{(pid=138744) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 21:02:52.310089 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-85f26d40-b421-42c2-af31-69c6f99a1337 tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] [instance: 4850d7fd-598e-4c80-8388-bd124c104ef3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='085e4478-6edc-4a69-8e08-f9831713eb65',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138744) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 21:02:52.337258 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=6,nova_api:UPDATE=1,nova_api:DELETE=3 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:02:52.361427 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-a7ee678b-7008-49c0-a71d-3f6a65946691 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:02:52.366276 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-85f26d40-b421-42c2-af31-69c6f99a1337 tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=138744) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Oct 22 21:02:52.380396 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-a7ee678b-7008-49c0-a71d-3f6a65946691 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:02:52.383220 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-a7ee678b-7008-49c0-a71d-3f6a65946691 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:02:52.392964 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-85f26d40-b421-42c2-af31-69c6f99a1337 tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Getting quotas for project 1dfacd9c525f486eaa04d19dbe2dc423. Resources: {'server_group_members'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 21:02:52.400675 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-85f26d40-b421-42c2-af31-69c6f99a1337 tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Getting quotas for user 3adb02392d074b7eb08c94bbf1904547 and project 1dfacd9c525f486eaa04d19dbe2dc423. Resources: {'server_group_members'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 21:02:52.411626 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-a7ee678b-7008-49c0-a71d-3f6a65946691 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] 10.222.0.18 "GET /compute/v2.1/servers/2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac" status: 200 len: 1546 microversion: 2.91 time: 0.235120 Oct 22 21:02:52.414495 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1522/2928] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:02:52 2022] GET /compute/v2.1/servers/2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac => generated 1546 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:02:52.423272 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-38671530-a4c7-432d-9072-84087c48fd51 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:02:52.423939 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-38671530-a4c7-432d-9072-84087c48fd51 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] [instance: ee6c092d-1150-415f-8a2e-58f4d3b5c238] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:02:52.444580 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-38671530-a4c7-432d-9072-84087c48fd51 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:02:52.445275 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-38671530-a4c7-432d-9072-84087c48fd51 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:02:52.445737 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-38671530-a4c7-432d-9072-84087c48fd51 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:02:52.448707 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-38671530-a4c7-432d-9072-84087c48fd51 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:02:52.449260 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-38671530-a4c7-432d-9072-84087c48fd51 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:02:52.449717 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-38671530-a4c7-432d-9072-84087c48fd51 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:02:52.479021 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-85f26d40-b421-42c2-af31-69c6f99a1337 tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Getting quotas for project 1dfacd9c525f486eaa04d19dbe2dc423. Resources: {'server_group_members'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 21:02:52.487597 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-85f26d40-b421-42c2-af31-69c6f99a1337 tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Getting quotas for user 3adb02392d074b7eb08c94bbf1904547 and project 1dfacd9c525f486eaa04d19dbe2dc423. Resources: {'server_group_members'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 21:02:52.532397 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-85f26d40-b421-42c2-af31-69c6f99a1337 tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.972911 Oct 22 21:02:52.535781 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1407/2929] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Oct 22 21:02:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 978 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 21:02:52.548220 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-c3f81b1a-d159-4d9b-9214-b1a5e6a7c0da tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:02:52.551403 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-c3f81b1a-d159-4d9b-9214-b1a5e6a7c0da tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] [instance: a99614d8-f2f7-4ce1-87e8-47f3af03d9f8] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:02:52.567491 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c3f81b1a-d159-4d9b-9214-b1a5e6a7c0da tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:02:52.576368 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c3f81b1a-d159-4d9b-9214-b1a5e6a7c0da tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:02:52.578086 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c3f81b1a-d159-4d9b-9214-b1a5e6a7c0da tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:02:52.579050 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c3f81b1a-d159-4d9b-9214-b1a5e6a7c0da tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:02:52.579736 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c3f81b1a-d159-4d9b-9214-b1a5e6a7c0da tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:02:52.580424 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c3f81b1a-d159-4d9b-9214-b1a5e6a7c0da tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:02:52.827606 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-38671530-a4c7-432d-9072-84087c48fd51 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b9bfe6f6d564d4c9fb1fea439476e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6e01f91c3a845bf8e67e3ad415d9c69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:02:52.846740 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-38671530-a4c7-432d-9072-84087c48fd51 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] 10.222.0.18 "GET /compute/v2.1/servers/ee6c092d-1150-415f-8a2e-58f4d3b5c238" status: 200 len: 1473 microversion: 2.1 time: 0.430868 Oct 22 21:02:52.870268 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1523/2930] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:02:52 2022] GET /compute/v2.1/servers/ee6c092d-1150-415f-8a2e-58f4d3b5c238 => generated 1473 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:02:52.875195 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-08a971a0-00d0-446f-a10c-41f726606371 tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:02:52.890860 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-08a971a0-00d0-446f-a10c-41f726606371 tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] [instance: 4850d7fd-598e-4c80-8388-bd124c104ef3] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:02:53.160947 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-08a971a0-00d0-446f-a10c-41f726606371 tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3adb02392d074b7eb08c94bbf1904547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dfacd9c525f486eaa04d19dbe2dc423', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:02:53.171330 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-08a971a0-00d0-446f-a10c-41f726606371 tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] 10.222.0.18 "GET /compute/v2.1/servers/4850d7fd-598e-4c80-8388-bd124c104ef3" status: 200 len: 1211 microversion: 2.1 time: 0.299813 Oct 22 21:02:53.179745 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1524/2931] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:02:52 2022] GET /compute/v2.1/servers/4850d7fd-598e-4c80-8388-bd124c104ef3 => generated 1211 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:02:53.194462 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-1f1de4d7-c4cc-4085-9ace-34bf2a0707b8 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:02:53.195081 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-1f1de4d7-c4cc-4085-9ace-34bf2a0707b8 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] [instance: 524c2c11-4a65-4360-93e4-e25349cb6416] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:02:53.237497 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1f1de4d7-c4cc-4085-9ace-34bf2a0707b8 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:02:53.239453 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1f1de4d7-c4cc-4085-9ace-34bf2a0707b8 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:02:53.240797 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1f1de4d7-c4cc-4085-9ace-34bf2a0707b8 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:02:53.241775 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1f1de4d7-c4cc-4085-9ace-34bf2a0707b8 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:02:53.242398 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1f1de4d7-c4cc-4085-9ace-34bf2a0707b8 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:02:53.244394 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1f1de4d7-c4cc-4085-9ace-34bf2a0707b8 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:02:53.541813 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-1f1de4d7-c4cc-4085-9ace-34bf2a0707b8 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a44ff8e7c14b94b1670f030085c43d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a26a2284f4424cbeaf63d504652546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:02:53.551210 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-1f1de4d7-c4cc-4085-9ace-34bf2a0707b8 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] 10.222.0.18 "GET /compute/v2.1/servers/524c2c11-4a65-4360-93e4-e25349cb6416" status: 200 len: 1259 microversion: 2.1 time: 0.370259 Oct 22 21:02:53.559030 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1525/2932] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:02:53 2022] GET /compute/v2.1/servers/524c2c11-4a65-4360-93e4-e25349cb6416 => generated 1259 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:02:53.576454 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-edfa34fc-9683-43ee-b281-78353dfddeed tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:02:53.578426 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-edfa34fc-9683-43ee-b281-78353dfddeed tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] [instance: 2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:02:53.599691 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-edfa34fc-9683-43ee-b281-78353dfddeed tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:02:53.605146 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-edfa34fc-9683-43ee-b281-78353dfddeed tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:02:53.606198 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-edfa34fc-9683-43ee-b281-78353dfddeed tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:02:53.609272 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-edfa34fc-9683-43ee-b281-78353dfddeed tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:02:53.610071 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-edfa34fc-9683-43ee-b281-78353dfddeed tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:02:53.612510 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-edfa34fc-9683-43ee-b281-78353dfddeed tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:02:53.672188 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:02:53.736299 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-c3f81b1a-d159-4d9b-9214-b1a5e6a7c0da tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1b410a64e0415a96d30f5040361137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd7873d6db4e09bc9ab9a048a6b1ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:02:53.751160 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-c3f81b1a-d159-4d9b-9214-b1a5e6a7c0da tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] 10.222.0.18 "GET /compute/v2.1/servers/a99614d8-f2f7-4ce1-87e8-47f3af03d9f8" status: 200 len: 1509 microversion: 2.1 time: 1.213769 Oct 22 21:02:53.769896 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1408/2933] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:02:52 2022] GET /compute/v2.1/servers/a99614d8-f2f7-4ce1-87e8-47f3af03d9f8 => generated 1509 bytes in 1233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:02:53.812479 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-edfa34fc-9683-43ee-b281-78353dfddeed tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:02:53.844350 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-edfa34fc-9683-43ee-b281-78353dfddeed tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:02:53.850344 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-edfa34fc-9683-43ee-b281-78353dfddeed tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:02:53.883389 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-edfa34fc-9683-43ee-b281-78353dfddeed tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] 10.222.0.18 "GET /compute/v2.1/servers/2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac" status: 200 len: 1546 microversion: 2.91 time: 0.309610 Oct 22 21:02:53.885121 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-1dec0f13-2693-484a-965e-7aa23407ba30 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:02:53.885641 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1526/2934] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:02:53 2022] GET /compute/v2.1/servers/2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac => generated 1546 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:02:53.905431 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-1dec0f13-2693-484a-965e-7aa23407ba30 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] [instance: ee6c092d-1150-415f-8a2e-58f4d3b5c238] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:02:53.919924 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1dec0f13-2693-484a-965e-7aa23407ba30 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:02:53.920699 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1dec0f13-2693-484a-965e-7aa23407ba30 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:02:53.921404 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1dec0f13-2693-484a-965e-7aa23407ba30 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:02:53.922395 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1dec0f13-2693-484a-965e-7aa23407ba30 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:02:53.923038 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1dec0f13-2693-484a-965e-7aa23407ba30 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:02:53.923841 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1dec0f13-2693-484a-965e-7aa23407ba30 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:02:54.211289 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-70f9c3f4-7d11-4880-b5ad-962f70914bd8 tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:02:54.212603 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-70f9c3f4-7d11-4880-b5ad-962f70914bd8 tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] [instance: 4850d7fd-598e-4c80-8388-bd124c104ef3] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:02:54.226455 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-70f9c3f4-7d11-4880-b5ad-962f70914bd8 tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:02:54.228338 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-70f9c3f4-7d11-4880-b5ad-962f70914bd8 tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:02:54.231549 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-70f9c3f4-7d11-4880-b5ad-962f70914bd8 tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:02:54.233973 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-70f9c3f4-7d11-4880-b5ad-962f70914bd8 tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:02:54.236913 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-70f9c3f4-7d11-4880-b5ad-962f70914bd8 tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:02:54.237651 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-70f9c3f4-7d11-4880-b5ad-962f70914bd8 tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:02:54.293580 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-1dec0f13-2693-484a-965e-7aa23407ba30 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b9bfe6f6d564d4c9fb1fea439476e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6e01f91c3a845bf8e67e3ad415d9c69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:02:54.311912 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-1dec0f13-2693-484a-965e-7aa23407ba30 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] 10.222.0.18 "GET /compute/v2.1/servers/ee6c092d-1150-415f-8a2e-58f4d3b5c238" status: 200 len: 1473 microversion: 2.1 time: 0.426102 Oct 22 21:02:54.316170 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1409/2935] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:02:53 2022] GET /compute/v2.1/servers/ee6c092d-1150-415f-8a2e-58f4d3b5c238 => generated 1473 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:02:54.356204 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-7dce22b5-c2dd-43e3-92da-af046da828e8 req-aadcd1e9-64bd-40aa-a736-a7e8a0bbe1e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee6c092d-1150-415f-8a2e-58f4d3b5c238", "name": "network-vif-deleted", "tag": "ab582bca-d4c2-4df2-a2fb-cfb59dff7776"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:02:54.389431 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-7dce22b5-c2dd-43e3-92da-af046da828e8 req-aadcd1e9-64bd-40aa-a736-a7e8a0bbe1e0 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:02:54.389944 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-7dce22b5-c2dd-43e3-92da-af046da828e8 req-aadcd1e9-64bd-40aa-a736-a7e8a0bbe1e0 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:02:54.390393 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-7dce22b5-c2dd-43e3-92da-af046da828e8 req-aadcd1e9-64bd-40aa-a736-a7e8a0bbe1e0 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:02:54.432267 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-7dce22b5-c2dd-43e3-92da-af046da828e8 req-aadcd1e9-64bd-40aa-a736-a7e8a0bbe1e0 service nova] Creating event network-vif-deleted:ab582bca-d4c2-4df2-a2fb-cfb59dff7776 for instance ee6c092d-1150-415f-8a2e-58f4d3b5c238 on nch2-master-1 Oct 22 21:02:54.445193 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-7dce22b5-c2dd-43e3-92da-af046da828e8 req-aadcd1e9-64bd-40aa-a736-a7e8a0bbe1e0 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093976 Oct 22 21:02:54.449914 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1410/2936] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:02:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:02:54.476049 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-70f9c3f4-7d11-4880-b5ad-962f70914bd8 tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3adb02392d074b7eb08c94bbf1904547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dfacd9c525f486eaa04d19dbe2dc423', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:02:54.490295 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-70f9c3f4-7d11-4880-b5ad-962f70914bd8 tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] 10.222.0.18 "GET /compute/v2.1/servers/4850d7fd-598e-4c80-8388-bd124c104ef3" status: 200 len: 1207 microversion: 2.1 time: 0.283083 Oct 22 21:02:54.506317 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1527/2937] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:02:54 2022] GET /compute/v2.1/servers/4850d7fd-598e-4c80-8388-bd124c104ef3 => generated 1207 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:02:54.586905 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-2f26af78-f3b8-47d8-93e9-5594a95cc637 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:02:54.588445 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-2f26af78-f3b8-47d8-93e9-5594a95cc637 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] [instance: 524c2c11-4a65-4360-93e4-e25349cb6416] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:02:54.620386 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2f26af78-f3b8-47d8-93e9-5594a95cc637 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:02:54.635172 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2f26af78-f3b8-47d8-93e9-5594a95cc637 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:02:54.635815 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2f26af78-f3b8-47d8-93e9-5594a95cc637 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:02:54.640984 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2f26af78-f3b8-47d8-93e9-5594a95cc637 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:02:54.641489 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2f26af78-f3b8-47d8-93e9-5594a95cc637 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:02:54.641940 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2f26af78-f3b8-47d8-93e9-5594a95cc637 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:02:54.777683 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-5c7fab47-a010-40ae-b519-1c2ac34a80db tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:02:54.778311 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-5c7fab47-a010-40ae-b519-1c2ac34a80db tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] [instance: a99614d8-f2f7-4ce1-87e8-47f3af03d9f8] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:02:54.793249 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5c7fab47-a010-40ae-b519-1c2ac34a80db tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:02:54.795125 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5c7fab47-a010-40ae-b519-1c2ac34a80db tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:02:54.795653 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5c7fab47-a010-40ae-b519-1c2ac34a80db tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:02:54.796718 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5c7fab47-a010-40ae-b519-1c2ac34a80db tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:02:54.798742 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5c7fab47-a010-40ae-b519-1c2ac34a80db tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:02:54.800174 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5c7fab47-a010-40ae-b519-1c2ac34a80db tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:02:54.940212 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-2f26af78-f3b8-47d8-93e9-5594a95cc637 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a44ff8e7c14b94b1670f030085c43d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a26a2284f4424cbeaf63d504652546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:02:54.950461 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-2f26af78-f3b8-47d8-93e9-5594a95cc637 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] 10.222.0.18 "GET /compute/v2.1/servers/524c2c11-4a65-4360-93e4-e25349cb6416" status: 200 len: 1265 microversion: 2.1 time: 0.368289 Oct 22 21:02:54.955693 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1411/2938] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:02:54 2022] GET /compute/v2.1/servers/524c2c11-4a65-4360-93e4-e25349cb6416 => generated 1265 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:02:54.964253 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-c1f2055e-d243-4a0d-b260-1b8e808d21f3 req-f7cbf971-63e9-4305-8730-498e58f86af3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c2729a5-e874-43e7-a372-514906975851", "name": "network-vif-deleted", "tag": "7e49313e-bdb0-486a-bc1c-7bf140752a97"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:02:54.980756 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-c1f2055e-d243-4a0d-b260-1b8e808d21f3 req-f7cbf971-63e9-4305-8730-498e58f86af3 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:02:54.981564 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-c1f2055e-d243-4a0d-b260-1b8e808d21f3 req-f7cbf971-63e9-4305-8730-498e58f86af3 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:02:54.983122 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-c1f2055e-d243-4a0d-b260-1b8e808d21f3 req-f7cbf971-63e9-4305-8730-498e58f86af3 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:02:55.023882 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-c1f2055e-d243-4a0d-b260-1b8e808d21f3 req-f7cbf971-63e9-4305-8730-498e58f86af3 service nova] Creating event network-vif-deleted:7e49313e-bdb0-486a-bc1c-7bf140752a97 for instance 9c2729a5-e874-43e7-a372-514906975851 on nch2-master-1 Oct 22 21:02:55.030583 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-c1f2055e-d243-4a0d-b260-1b8e808d21f3 req-f7cbf971-63e9-4305-8730-498e58f86af3 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072678 Oct 22 21:02:55.034761 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1412/2939] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:02:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:02:55.050309 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-ce56751e-410b-401a-a9c5-822541cc9d01 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:02:55.053840 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-ce56751e-410b-401a-a9c5-822541cc9d01 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] [instance: 2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:02:55.071828 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ce56751e-410b-401a-a9c5-822541cc9d01 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:02:55.073705 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ce56751e-410b-401a-a9c5-822541cc9d01 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:02:55.076155 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ce56751e-410b-401a-a9c5-822541cc9d01 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:02:55.078014 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ce56751e-410b-401a-a9c5-822541cc9d01 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:02:55.079294 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ce56751e-410b-401a-a9c5-822541cc9d01 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:02:55.080322 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ce56751e-410b-401a-a9c5-822541cc9d01 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:02:55.261532 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-ce56751e-410b-401a-a9c5-822541cc9d01 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:02:55.284872 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-ce56751e-410b-401a-a9c5-822541cc9d01 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:02:55.287696 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-ce56751e-410b-401a-a9c5-822541cc9d01 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:02:55.300924 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-ce56751e-410b-401a-a9c5-822541cc9d01 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] 10.222.0.18 "GET /compute/v2.1/servers/2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac" status: 200 len: 1533 microversion: 2.91 time: 0.259832 Oct 22 21:02:55.316639 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1413/2940] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:02:55 2022] GET /compute/v2.1/servers/2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac => generated 1533 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:02:55.349025 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-653dc857-7266-49ca-acec-9948114c4939 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:02:55.349642 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-653dc857-7266-49ca-acec-9948114c4939 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] [instance: ee6c092d-1150-415f-8a2e-58f4d3b5c238] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:02:55.360548 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-653dc857-7266-49ca-acec-9948114c4939 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:02:55.361893 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-653dc857-7266-49ca-acec-9948114c4939 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:02:55.362627 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-653dc857-7266-49ca-acec-9948114c4939 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:02:55.363717 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-653dc857-7266-49ca-acec-9948114c4939 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:02:55.364409 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-653dc857-7266-49ca-acec-9948114c4939 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:02:55.365105 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-653dc857-7266-49ca-acec-9948114c4939 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:02:55.410001 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-653dc857-7266-49ca-acec-9948114c4939 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:02:55.411120 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-653dc857-7266-49ca-acec-9948114c4939 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:02:55.412420 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-653dc857-7266-49ca-acec-9948114c4939 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:02:55.413355 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.objects.instance [None req-653dc857-7266-49ca-acec-9948114c4939 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Lazy-loading 'fault' on Instance uuid ee6c092d-1150-415f-8a2e-58f4d3b5c238 {{(pid=138744) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 21:02:55.451245 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-5c7fab47-a010-40ae-b519-1c2ac34a80db tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1b410a64e0415a96d30f5040361137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd7873d6db4e09bc9ab9a048a6b1ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:02:55.463767 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-5c7fab47-a010-40ae-b519-1c2ac34a80db tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] 10.222.0.18 "GET /compute/v2.1/servers/a99614d8-f2f7-4ce1-87e8-47f3af03d9f8" status: 200 len: 1509 microversion: 2.1 time: 0.690237 Oct 22 21:02:55.469556 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1528/2941] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:02:54 2022] GET /compute/v2.1/servers/a99614d8-f2f7-4ce1-87e8-47f3af03d9f8 => generated 1509 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:02:55.482860 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-097e727e-3cc9-4862-98bb-d562ec45d7c5 tempest-UnshelveToHostMultiNodesTest-2069914657 tempest-UnshelveToHostMultiNodesTest-2069914657-project-admin] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:02:55.483524 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-097e727e-3cc9-4862-98bb-d562ec45d7c5 tempest-UnshelveToHostMultiNodesTest-2069914657 tempest-UnshelveToHostMultiNodesTest-2069914657-project-admin] [instance: 2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:02:55.496997 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-097e727e-3cc9-4862-98bb-d562ec45d7c5 tempest-UnshelveToHostMultiNodesTest-2069914657 tempest-UnshelveToHostMultiNodesTest-2069914657-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:02:55.497648 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-097e727e-3cc9-4862-98bb-d562ec45d7c5 tempest-UnshelveToHostMultiNodesTest-2069914657 tempest-UnshelveToHostMultiNodesTest-2069914657-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:02:55.498157 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-097e727e-3cc9-4862-98bb-d562ec45d7c5 tempest-UnshelveToHostMultiNodesTest-2069914657 tempest-UnshelveToHostMultiNodesTest-2069914657-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:02:55.498817 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-097e727e-3cc9-4862-98bb-d562ec45d7c5 tempest-UnshelveToHostMultiNodesTest-2069914657 tempest-UnshelveToHostMultiNodesTest-2069914657-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:02:55.499280 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-097e727e-3cc9-4862-98bb-d562ec45d7c5 tempest-UnshelveToHostMultiNodesTest-2069914657 tempest-UnshelveToHostMultiNodesTest-2069914657-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:02:55.499740 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-097e727e-3cc9-4862-98bb-d562ec45d7c5 tempest-UnshelveToHostMultiNodesTest-2069914657 tempest-UnshelveToHostMultiNodesTest-2069914657-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:02:55.557980 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-653dc857-7266-49ca-acec-9948114c4939 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b9bfe6f6d564d4c9fb1fea439476e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6e01f91c3a845bf8e67e3ad415d9c69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:02:55.567752 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-653dc857-7266-49ca-acec-9948114c4939 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] 10.222.0.18 "GET /compute/v2.1/servers/ee6c092d-1150-415f-8a2e-58f4d3b5c238" status: 200 len: 1308 microversion: 2.1 time: 0.232181 Oct 22 21:02:55.571434 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1414/2942] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:02:55 2022] GET /compute/v2.1/servers/ee6c092d-1150-415f-8a2e-58f4d3b5c238 => generated 1308 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:02:55.592931 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-65d03d32-3cec-479e-ada9-874749dbc9a7 tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:02:55.593816 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-65d03d32-3cec-479e-ada9-874749dbc9a7 tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] [instance: 4850d7fd-598e-4c80-8388-bd124c104ef3] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:02:55.600186 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-65d03d32-3cec-479e-ada9-874749dbc9a7 tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:02:55.601174 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-65d03d32-3cec-479e-ada9-874749dbc9a7 tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:02:55.602083 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-65d03d32-3cec-479e-ada9-874749dbc9a7 tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:02:55.605331 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-65d03d32-3cec-479e-ada9-874749dbc9a7 tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:02:55.605910 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-65d03d32-3cec-479e-ada9-874749dbc9a7 tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:02:55.606446 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-65d03d32-3cec-479e-ada9-874749dbc9a7 tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:02:55.681456 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.objects.instance [None req-097e727e-3cc9-4862-98bb-d562ec45d7c5 tempest-UnshelveToHostMultiNodesTest-2069914657 tempest-UnshelveToHostMultiNodesTest-2069914657-project-admin] Lazy-loading 'services' on Instance uuid 2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac {{(pid=138745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 21:02:55.707368 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-097e727e-3cc9-4862-98bb-d562ec45d7c5 tempest-UnshelveToHostMultiNodesTest-2069914657 tempest-UnshelveToHostMultiNodesTest-2069914657-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac" status: 200 len: 1938 microversion: 2.91 time: 0.235950 Oct 22 21:02:55.708057 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1529/2943] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:02:55 2022] GET /compute/v2.1/servers/2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac => generated 1938 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:02:55.749362 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-aafe9723-7641-4241-b9ab-cbe45b7c1d7d tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:02:55.750054 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-aafe9723-7641-4241-b9ab-cbe45b7c1d7d tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] [instance: 2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:02:55.757795 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-aafe9723-7641-4241-b9ab-cbe45b7c1d7d tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:02:55.760180 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-aafe9723-7641-4241-b9ab-cbe45b7c1d7d tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:02:55.760658 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-aafe9723-7641-4241-b9ab-cbe45b7c1d7d tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:02:55.761476 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-aafe9723-7641-4241-b9ab-cbe45b7c1d7d tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:02:55.762235 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-aafe9723-7641-4241-b9ab-cbe45b7c1d7d tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:02:55.762890 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-aafe9723-7641-4241-b9ab-cbe45b7c1d7d tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:02:55.767814 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-65d03d32-3cec-479e-ada9-874749dbc9a7 tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3adb02392d074b7eb08c94bbf1904547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dfacd9c525f486eaa04d19dbe2dc423', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:02:55.782911 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-65d03d32-3cec-479e-ada9-874749dbc9a7 tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] 10.222.0.18 "GET /compute/v2.1/servers/4850d7fd-598e-4c80-8388-bd124c104ef3" status: 200 len: 1269 microversion: 2.1 time: 0.212799 Oct 22 21:02:55.795918 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1415/2944] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:02:55 2022] GET /compute/v2.1/servers/4850d7fd-598e-4c80-8388-bd124c104ef3 => generated 1269 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:02:55.834916 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.objects.instance [None req-aafe9723-7641-4241-b9ab-cbe45b7c1d7d tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lazy-loading 'flavor' on Instance uuid 2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac {{(pid=138745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 21:02:55.980072 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-1c6b5192-21d2-4fb9-a3c6-70b62676f124 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:02:55.981120 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-1c6b5192-21d2-4fb9-a3c6-70b62676f124 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] [instance: 524c2c11-4a65-4360-93e4-e25349cb6416] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:02:55.996283 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1c6b5192-21d2-4fb9-a3c6-70b62676f124 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:02:55.999032 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1c6b5192-21d2-4fb9-a3c6-70b62676f124 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:02:55.999885 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1c6b5192-21d2-4fb9-a3c6-70b62676f124 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:02:56.001083 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1c6b5192-21d2-4fb9-a3c6-70b62676f124 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:02:56.001767 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1c6b5192-21d2-4fb9-a3c6-70b62676f124 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:02:56.003310 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1c6b5192-21d2-4fb9-a3c6-70b62676f124 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:02:56.420156 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-aafe9723-7641-4241-b9ab-cbe45b7c1d7d tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] 10.222.0.18 "POST /compute/v2.1/servers/2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac/action" status: 202 len: 0 microversion: 2.91 time: 0.676240 Oct 22 21:02:56.421615 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1530/2945] 10.222.0.18 () {62 vars in 1319 bytes} [Sat Oct 22 21:02:55 2022] POST /compute/v2.1/servers/2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac/action => generated 0 bytes in 679 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 22 21:02:56.436339 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-a8d5dc04-1092-4e3d-87f1-dce6ea84f812 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:02:56.437052 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-a8d5dc04-1092-4e3d-87f1-dce6ea84f812 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] [instance: 2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:02:56.453839 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a8d5dc04-1092-4e3d-87f1-dce6ea84f812 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:02:56.455089 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a8d5dc04-1092-4e3d-87f1-dce6ea84f812 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:02:56.459988 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a8d5dc04-1092-4e3d-87f1-dce6ea84f812 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:02:56.460979 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a8d5dc04-1092-4e3d-87f1-dce6ea84f812 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:02:56.461603 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a8d5dc04-1092-4e3d-87f1-dce6ea84f812 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:02:56.462417 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a8d5dc04-1092-4e3d-87f1-dce6ea84f812 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:02:56.658518 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-a8d5dc04-1092-4e3d-87f1-dce6ea84f812 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:02:56.661977 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-1c6b5192-21d2-4fb9-a3c6-70b62676f124 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a44ff8e7c14b94b1670f030085c43d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a26a2284f4424cbeaf63d504652546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:02:56.670120 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-a8d5dc04-1092-4e3d-87f1-dce6ea84f812 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:02:56.672172 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-a8d5dc04-1092-4e3d-87f1-dce6ea84f812 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:02:56.681098 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-1c6b5192-21d2-4fb9-a3c6-70b62676f124 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] 10.222.0.18 "GET /compute/v2.1/servers/524c2c11-4a65-4360-93e4-e25349cb6416" status: 200 len: 1265 microversion: 2.1 time: 0.706354 Oct 22 21:02:56.681649 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-a8d5dc04-1092-4e3d-87f1-dce6ea84f812 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] 10.222.0.18 "GET /compute/v2.1/servers/2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac" status: 200 len: 1539 microversion: 2.91 time: 0.254994 Oct 22 21:02:56.682528 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1416/2946] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:02:55 2022] GET /compute/v2.1/servers/524c2c11-4a65-4360-93e4-e25349cb6416 => generated 1265 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:02:56.683312 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1531/2947] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:02:56 2022] GET /compute/v2.1/servers/2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac => generated 1539 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:02:56.693904 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-7a5f21e9-7558-439f-923b-8f7e3f2cb0b9 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:02:56.694826 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-7a5f21e9-7558-439f-923b-8f7e3f2cb0b9 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] [instance: ee6c092d-1150-415f-8a2e-58f4d3b5c238] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:02:56.713599 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-5b9d9470-553c-4318-8761-d937f1677199 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:02:56.714423 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-5b9d9470-553c-4318-8761-d937f1677199 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] [instance: a99614d8-f2f7-4ce1-87e8-47f3af03d9f8] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:02:56.722551 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5b9d9470-553c-4318-8761-d937f1677199 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:02:56.724260 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5b9d9470-553c-4318-8761-d937f1677199 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:02:56.725135 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7a5f21e9-7558-439f-923b-8f7e3f2cb0b9 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:02:56.727841 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5b9d9470-553c-4318-8761-d937f1677199 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:02:56.728156 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7a5f21e9-7558-439f-923b-8f7e3f2cb0b9 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:02:56.729868 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5b9d9470-553c-4318-8761-d937f1677199 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:02:56.730424 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7a5f21e9-7558-439f-923b-8f7e3f2cb0b9 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:02:56.731147 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5b9d9470-553c-4318-8761-d937f1677199 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:02:56.732257 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5b9d9470-553c-4318-8761-d937f1677199 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:02:56.732907 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7a5f21e9-7558-439f-923b-8f7e3f2cb0b9 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:02:56.733623 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7a5f21e9-7558-439f-923b-8f7e3f2cb0b9 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:02:56.735859 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7a5f21e9-7558-439f-923b-8f7e3f2cb0b9 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:02:56.761265 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.wsgi [None req-7a5f21e9-7558-439f-923b-8f7e3f2cb0b9 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] HTTP exception thrown: Instance ee6c092d-1150-415f-8a2e-58f4d3b5c238 could not be found. Oct 22 21:02:56.763400 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-7a5f21e9-7558-439f-923b-8f7e3f2cb0b9 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Request method failure captured: Oct 22 21:02:56.763400 ncdv-master-1 devstack@n-api.service[138745]: request: GET /compute/v2.1/servers/ee6c092d-1150-415f-8a2e-58f4d3b5c238 HTTP/1.1 Oct 22 21:02:56.763400 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 21:02:56.763400 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 21:02:56.763400 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 21:02:56.763400 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 0 Oct 22 21:02:56.763400 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 21:02:56.763400 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 21:02:56.763400 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 21:02:56.763400 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 21:02:56.763400 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVFnLripxmgYKOgyouzkbnFb_NXWQVyhatEIvrxwqFnKbm-zaPGbZNkZRVzrg42W70xYbfT9z7_wyFCZb71J5QL_RzYux1JL4k2JE4KNlTX63lKgcRBcC_a-lrN4tpEl6uJVI4kG-IwzIuZ3OQfINta61A4woEp1e9TUFfa4jNFHjpAw Oct 22 21:02:56.763400 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 21:02:56.763400 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 21:02:56.763400 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 21:02:56.763400 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 21:02:56.763400 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 21:02:56.763400 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 21:02:56.763400 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: b6e01f91c3a845bf8e67e3ad415d9c69 Oct 22 21:02:56.763400 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-ListImageFiltersTestJSON-1345601845 Oct 22 21:02:56.763400 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 21:02:56.763400 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 21:02:56.763400 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_b6e01f91c3a845bf8e67e3ad415d9c69"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b6e01f91c3a845bf8e67e3ad415d9c69"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/b6e01f91c3a845bf8e67e3ad415d9c69"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b6e01f91c3a845bf8e67e3ad415d9c69"}]}] Oct 22 21:02:56.763400 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-ListImageFiltersTestJSON-1345601845 Oct 22 21:02:56.763400 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: b6e01f91c3a845bf8e67e3ad415d9c69 Oct 22 21:02:56.763400 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-1345601845 Oct 22 21:02:56.763400 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-ListImageFiltersTestJSON-1345601845-project Oct 22 21:02:56.763400 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 21:02:56.763400 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 21:02:56.763400 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: 2b9bfe6f6d564d4c9fb1fea439476e03 Oct 22 21:02:56.763400 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-ListImageFiltersTestJSON-1345601845-project Oct 22 21:02:56.763400 ncdv-master-1 devstack@n-api.service[138745]: method: > Oct 22 21:02:56.763400 ncdv-master-1 devstack@n-api.service[138745]: exception: Instance ee6c092d-1150-415f-8a2e-58f4d3b5c238 could not be found. Oct 22 21:02:56.763400 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'id': 'ee6c092d-1150-415f-8a2e-58f4d3b5c238'} Oct 22 21:02:56.763400 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:02:56.763400 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:02:56.763400 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 21:02:56.763400 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 21:02:56.763400 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 21:02:56.763400 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 21:02:56.763400 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 21:02:56.763400 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 21:02:56.763400 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 21:02:56.763400 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 21:02:56.763400 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee6c092d-1150-415f-8a2e-58f4d3b5c238 could not be found. Oct 22 21:02:56.763400 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:02:56.763400 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:02:56.763400 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:02:56.763400 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:02:56.763400 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:02:56.763400 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:02:56.763400 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:02:56.763400 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:02:56.763400 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:02:56.763400 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:02:56.763400 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 21:02:56.763400 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 21:02:56.763400 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 21:02:56.763400 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 21:02:56.763400 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 21:02:56.763400 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:02:56.763400 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee6c092d-1150-415f-8a2e-58f4d3b5c238 could not be found. Oct 22 21:02:56.763400 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:02:56.763400 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:02:56.763400 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:02:56.769325 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:02:56.769325 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:02:56.769325 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:02:56.769325 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:02:56.769325 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:02:56.769325 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee6c092d-1150-415f-8a2e-58f4d3b5c238 could not be found. Oct 22 21:02:56.769325 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:02:56.769325 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-7a5f21e9-7558-439f-923b-8f7e3f2cb0b9 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Returning 404 to user: Instance ee6c092d-1150-415f-8a2e-58f4d3b5c238 could not be found. {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:02:56.769325 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-7a5f21e9-7558-439f-923b-8f7e3f2cb0b9 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] 10.222.0.18 "GET /compute/v2.1/servers/ee6c092d-1150-415f-8a2e-58f4d3b5c238" status: 404 len: 111 microversion: 2.1 time: 0.083990 Oct 22 21:02:56.773648 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1532/2948] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:02:56 2022] GET /compute/v2.1/servers/ee6c092d-1150-415f-8a2e-58f4d3b5c238 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 21:02:56.779200 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-aa322ff0-5998-4167-9451-31ac923e17ca tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:02:56.779850 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-aa322ff0-5998-4167-9451-31ac923e17ca tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] [instance: 70f4c178-630e-4050-8aad-4c60bec30bcd] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:02:56.786163 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-aa322ff0-5998-4167-9451-31ac923e17ca tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:02:56.786654 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-aa322ff0-5998-4167-9451-31ac923e17ca tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:02:56.788392 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-aa322ff0-5998-4167-9451-31ac923e17ca tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:02:56.788890 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-aa322ff0-5998-4167-9451-31ac923e17ca tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:02:56.789361 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-aa322ff0-5998-4167-9451-31ac923e17ca tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:02:56.790243 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-aa322ff0-5998-4167-9451-31ac923e17ca tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:02:56.822933 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-aa322ff0-5998-4167-9451-31ac923e17ca tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] [instance: 70f4c178-630e-4050-8aad-4c60bec30bcd] Going to try to terminate instance {{(pid=138745) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 21:02:56.905590 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=4,nova_api:DELETE=3 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:02:56.939931 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-aa322ff0-5998-4167-9451-31ac923e17ca tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] 10.222.0.18 "DELETE /compute/v2.1/servers/70f4c178-630e-4050-8aad-4c60bec30bcd" status: 204 len: 0 microversion: 2.1 time: 0.164376 Oct 22 21:02:56.941787 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1533/2949] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 21:02:56 2022] DELETE /compute/v2.1/servers/70f4c178-630e-4050-8aad-4c60bec30bcd => generated 0 bytes in 167 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 21:02:56.948176 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-1e8de2cd-a248-42e0-b390-8e974ea53fd9 tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:02:56.949387 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-1e8de2cd-a248-42e0-b390-8e974ea53fd9 tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] [instance: 4850d7fd-598e-4c80-8388-bd124c104ef3] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:02:56.959086 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1e8de2cd-a248-42e0-b390-8e974ea53fd9 tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:02:56.959914 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1e8de2cd-a248-42e0-b390-8e974ea53fd9 tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:02:56.960694 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1e8de2cd-a248-42e0-b390-8e974ea53fd9 tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:02:56.961997 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1e8de2cd-a248-42e0-b390-8e974ea53fd9 tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:02:56.963266 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1e8de2cd-a248-42e0-b390-8e974ea53fd9 tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:02:56.964237 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1e8de2cd-a248-42e0-b390-8e974ea53fd9 tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:02:57.044187 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-5b9d9470-553c-4318-8761-d937f1677199 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1b410a64e0415a96d30f5040361137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd7873d6db4e09bc9ab9a048a6b1ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:02:57.060976 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-5b9d9470-553c-4318-8761-d937f1677199 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] 10.222.0.18 "GET /compute/v2.1/servers/a99614d8-f2f7-4ce1-87e8-47f3af03d9f8" status: 200 len: 1509 microversion: 2.1 time: 0.363914 Oct 22 21:02:57.062212 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1417/2950] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:02:56 2022] GET /compute/v2.1/servers/a99614d8-f2f7-4ce1-87e8-47f3af03d9f8 => generated 1509 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:02:57.068055 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-86842a1b-3123-4445-977c-f36428903f48 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:02:57.069640 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-86842a1b-3123-4445-977c-f36428903f48 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] [instance: 70f4c178-630e-4050-8aad-4c60bec30bcd] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:02:57.080328 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-86842a1b-3123-4445-977c-f36428903f48 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:02:57.080914 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-86842a1b-3123-4445-977c-f36428903f48 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:02:57.081488 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-86842a1b-3123-4445-977c-f36428903f48 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:02:57.082490 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-86842a1b-3123-4445-977c-f36428903f48 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:02:57.083033 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-86842a1b-3123-4445-977c-f36428903f48 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:02:57.083848 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-86842a1b-3123-4445-977c-f36428903f48 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:02:57.109414 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-1e8de2cd-a248-42e0-b390-8e974ea53fd9 tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3adb02392d074b7eb08c94bbf1904547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dfacd9c525f486eaa04d19dbe2dc423', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:02:57.119936 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-1e8de2cd-a248-42e0-b390-8e974ea53fd9 tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] 10.222.0.18 "GET /compute/v2.1/servers/4850d7fd-598e-4c80-8388-bd124c104ef3" status: 200 len: 1269 microversion: 2.1 time: 0.176048 Oct 22 21:02:57.124147 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1534/2951] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:02:56 2022] GET /compute/v2.1/servers/4850d7fd-598e-4c80-8388-bd124c104ef3 => generated 1269 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:02:57.128436 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:02:57.528949 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-86842a1b-3123-4445-977c-f36428903f48 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b9bfe6f6d564d4c9fb1fea439476e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6e01f91c3a845bf8e67e3ad415d9c69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:02:57.537854 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-86842a1b-3123-4445-977c-f36428903f48 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] 10.222.0.18 "GET /compute/v2.1/servers/70f4c178-630e-4050-8aad-4c60bec30bcd" status: 200 len: 1474 microversion: 2.1 time: 0.474381 Oct 22 21:02:57.538837 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1418/2952] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:02:57 2022] GET /compute/v2.1/servers/70f4c178-630e-4050-8aad-4c60bec30bcd => generated 1474 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:02:57.706842 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-d8651dcc-a6ac-410e-a589-6e2a7c183a0a tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:02:57.707557 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-d8651dcc-a6ac-410e-a589-6e2a7c183a0a tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] [instance: 524c2c11-4a65-4360-93e4-e25349cb6416] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:02:57.715491 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-9143b4ab-b3ac-43b4-9eac-e4eba724b01c tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:02:57.716442 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-9143b4ab-b3ac-43b4-9eac-e4eba724b01c tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] [instance: 2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:02:57.717778 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d8651dcc-a6ac-410e-a589-6e2a7c183a0a tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:02:57.718286 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d8651dcc-a6ac-410e-a589-6e2a7c183a0a tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:02:57.723027 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d8651dcc-a6ac-410e-a589-6e2a7c183a0a tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:02:57.724341 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d8651dcc-a6ac-410e-a589-6e2a7c183a0a tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:02:57.725158 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d8651dcc-a6ac-410e-a589-6e2a7c183a0a tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:02:57.726509 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d8651dcc-a6ac-410e-a589-6e2a7c183a0a tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:02:57.733744 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9143b4ab-b3ac-43b4-9eac-e4eba724b01c tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:02:57.736005 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9143b4ab-b3ac-43b4-9eac-e4eba724b01c tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:02:57.736726 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9143b4ab-b3ac-43b4-9eac-e4eba724b01c tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:02:57.738178 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9143b4ab-b3ac-43b4-9eac-e4eba724b01c tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:02:57.740139 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9143b4ab-b3ac-43b4-9eac-e4eba724b01c tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:02:57.742544 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9143b4ab-b3ac-43b4-9eac-e4eba724b01c tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:02:57.944401 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-9143b4ab-b3ac-43b4-9eac-e4eba724b01c tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:02:57.968613 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-9143b4ab-b3ac-43b4-9eac-e4eba724b01c tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:02:57.977019 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-9143b4ab-b3ac-43b4-9eac-e4eba724b01c tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:02:57.998634 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-9143b4ab-b3ac-43b4-9eac-e4eba724b01c tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] 10.222.0.18 "GET /compute/v2.1/servers/2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac" status: 200 len: 1539 microversion: 2.91 time: 0.289663 Oct 22 21:02:58.016552 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1419/2953] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:02:57 2022] GET /compute/v2.1/servers/2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac => generated 1539 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:02:58.086219 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-a2adb5f7-f6de-4891-aff6-a431df2abc95 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:02:58.089194 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-a2adb5f7-f6de-4891-aff6-a431df2abc95 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] [instance: a99614d8-f2f7-4ce1-87e8-47f3af03d9f8] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:02:58.096686 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a2adb5f7-f6de-4891-aff6-a431df2abc95 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:02:58.097199 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a2adb5f7-f6de-4891-aff6-a431df2abc95 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:02:58.098732 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a2adb5f7-f6de-4891-aff6-a431df2abc95 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:02:58.100049 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a2adb5f7-f6de-4891-aff6-a431df2abc95 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:02:58.101160 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a2adb5f7-f6de-4891-aff6-a431df2abc95 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:02:58.101799 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a2adb5f7-f6de-4891-aff6-a431df2abc95 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:02:58.180770 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-d8651dcc-a6ac-410e-a589-6e2a7c183a0a tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a44ff8e7c14b94b1670f030085c43d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a26a2284f4424cbeaf63d504652546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:02:58.190445 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-d8651dcc-a6ac-410e-a589-6e2a7c183a0a tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] 10.222.0.18 "GET /compute/v2.1/servers/524c2c11-4a65-4360-93e4-e25349cb6416" status: 200 len: 1307 microversion: 2.1 time: 0.489160 Oct 22 21:02:58.191022 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1535/2954] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:02:57 2022] GET /compute/v2.1/servers/524c2c11-4a65-4360-93e4-e25349cb6416 => generated 1307 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:02:58.203382 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-1b604436-8703-4303-9840-88b066c97581 tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:02:58.205668 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-1b604436-8703-4303-9840-88b066c97581 tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] [instance: 4850d7fd-598e-4c80-8388-bd124c104ef3] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:02:58.221233 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1b604436-8703-4303-9840-88b066c97581 tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:02:58.221739 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1b604436-8703-4303-9840-88b066c97581 tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:02:58.222182 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1b604436-8703-4303-9840-88b066c97581 tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:02:58.224583 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1b604436-8703-4303-9840-88b066c97581 tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:02:58.225248 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1b604436-8703-4303-9840-88b066c97581 tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:02:58.226143 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1b604436-8703-4303-9840-88b066c97581 tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:02:58.692991 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-a2adb5f7-f6de-4891-aff6-a431df2abc95 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1b410a64e0415a96d30f5040361137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd7873d6db4e09bc9ab9a048a6b1ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:02:58.702361 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-a2adb5f7-f6de-4891-aff6-a431df2abc95 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] 10.222.0.18 "GET /compute/v2.1/servers/a99614d8-f2f7-4ce1-87e8-47f3af03d9f8" status: 200 len: 1509 microversion: 2.1 time: 0.621163 Oct 22 21:02:58.703257 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1420/2955] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:02:58 2022] GET /compute/v2.1/servers/a99614d8-f2f7-4ce1-87e8-47f3af03d9f8 => generated 1509 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:02:58.710489 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-9eb7d9b0-a2d8-48ba-8501-5b02bb222ed9 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:02:58.711294 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-9eb7d9b0-a2d8-48ba-8501-5b02bb222ed9 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] [instance: 70f4c178-630e-4050-8aad-4c60bec30bcd] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:02:58.718567 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9eb7d9b0-a2d8-48ba-8501-5b02bb222ed9 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:02:58.719678 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9eb7d9b0-a2d8-48ba-8501-5b02bb222ed9 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:02:58.720421 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9eb7d9b0-a2d8-48ba-8501-5b02bb222ed9 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:02:58.721386 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9eb7d9b0-a2d8-48ba-8501-5b02bb222ed9 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:02:58.722059 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9eb7d9b0-a2d8-48ba-8501-5b02bb222ed9 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:02:58.722739 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9eb7d9b0-a2d8-48ba-8501-5b02bb222ed9 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:02:58.747918 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-1b604436-8703-4303-9840-88b066c97581 tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3adb02392d074b7eb08c94bbf1904547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dfacd9c525f486eaa04d19dbe2dc423', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:02:58.759957 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-1b604436-8703-4303-9840-88b066c97581 tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] 10.222.0.18 "GET /compute/v2.1/servers/4850d7fd-598e-4c80-8388-bd124c104ef3" status: 200 len: 1311 microversion: 2.1 time: 0.560713 Oct 22 21:02:58.760880 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1536/2956] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:02:58 2022] GET /compute/v2.1/servers/4850d7fd-598e-4c80-8388-bd124c104ef3 => generated 1311 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:02:59.027746 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-9eb7d9b0-a2d8-48ba-8501-5b02bb222ed9 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b9bfe6f6d564d4c9fb1fea439476e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6e01f91c3a845bf8e67e3ad415d9c69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:02:59.031257 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-66ba83d1-4a0e-4944-8139-3eb08e561261 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:02:59.032196 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-66ba83d1-4a0e-4944-8139-3eb08e561261 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] [instance: 2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:02:59.040716 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-9eb7d9b0-a2d8-48ba-8501-5b02bb222ed9 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] 10.222.0.18 "GET /compute/v2.1/servers/70f4c178-630e-4050-8aad-4c60bec30bcd" status: 200 len: 1474 microversion: 2.1 time: 0.335536 Oct 22 21:02:59.048075 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-66ba83d1-4a0e-4944-8139-3eb08e561261 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:02:59.050153 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-66ba83d1-4a0e-4944-8139-3eb08e561261 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:02:59.051194 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-66ba83d1-4a0e-4944-8139-3eb08e561261 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:02:59.052569 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-66ba83d1-4a0e-4944-8139-3eb08e561261 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:02:59.053501 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-66ba83d1-4a0e-4944-8139-3eb08e561261 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:02:59.054449 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-66ba83d1-4a0e-4944-8139-3eb08e561261 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:02:59.058001 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1421/2957] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:02:58 2022] GET /compute/v2.1/servers/70f4c178-630e-4050-8aad-4c60bec30bcd => generated 1474 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:02:59.186017 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-66ba83d1-4a0e-4944-8139-3eb08e561261 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:02:59.195644 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-66ba83d1-4a0e-4944-8139-3eb08e561261 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:02:59.198150 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-66ba83d1-4a0e-4944-8139-3eb08e561261 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:02:59.204214 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-66ba83d1-4a0e-4944-8139-3eb08e561261 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] 10.222.0.18 "GET /compute/v2.1/servers/2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac" status: 200 len: 1539 microversion: 2.91 time: 0.179334 Oct 22 21:02:59.205463 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1537/2958] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:02:59 2022] GET /compute/v2.1/servers/2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac => generated 1539 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 22 21:02:59.236780 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-639a8f70-10dc-403c-ae00-558cda29ba5e tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:02:59.238242 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-639a8f70-10dc-403c-ae00-558cda29ba5e tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] [instance: 524c2c11-4a65-4360-93e4-e25349cb6416] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:02:59.271075 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-639a8f70-10dc-403c-ae00-558cda29ba5e tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:02:59.271631 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-639a8f70-10dc-403c-ae00-558cda29ba5e tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:02:59.272090 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-639a8f70-10dc-403c-ae00-558cda29ba5e tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:02:59.274702 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-639a8f70-10dc-403c-ae00-558cda29ba5e tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:02:59.275639 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-639a8f70-10dc-403c-ae00-558cda29ba5e tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:02:59.276929 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-639a8f70-10dc-403c-ae00-558cda29ba5e tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:02:59.423750 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-c3f8bb8c-92d8-48e0-b0a8-11224b406474 req-ddd7fbe0-0bab-4012-8b0c-bda246e6e2c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "524c2c11-4a65-4360-93e4-e25349cb6416", "tag": "7e016b42-09b0-4f7f-9ce3-9e528785b3cd"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:02:59.444627 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-c3f8bb8c-92d8-48e0-b0a8-11224b406474 req-ddd7fbe0-0bab-4012-8b0c-bda246e6e2c7 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:02:59.445377 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-c3f8bb8c-92d8-48e0-b0a8-11224b406474 req-ddd7fbe0-0bab-4012-8b0c-bda246e6e2c7 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:02:59.446014 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-c3f8bb8c-92d8-48e0-b0a8-11224b406474 req-ddd7fbe0-0bab-4012-8b0c-bda246e6e2c7 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:02:59.499681 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-c3f8bb8c-92d8-48e0-b0a8-11224b406474 req-ddd7fbe0-0bab-4012-8b0c-bda246e6e2c7 service nova] Creating event network-changed:7e016b42-09b0-4f7f-9ce3-9e528785b3cd for instance 524c2c11-4a65-4360-93e4-e25349cb6416 on nch2-master-1 Oct 22 21:02:59.526621 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-c3f8bb8c-92d8-48e0-b0a8-11224b406474 req-ddd7fbe0-0bab-4012-8b0c-bda246e6e2c7 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106389 Oct 22 21:02:59.528079 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1538/2959] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:02:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 21:02:59.559265 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-84c3f111-51b2-4771-9503-4348a9152632 req-c63628f7-abef-4ed2-8297-25865c911e99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70f4c178-630e-4050-8aad-4c60bec30bcd", "name": "network-vif-deleted", "tag": "034bfe35-5a4c-4024-b8ad-3fc77f012374"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:02:59.570657 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-84c3f111-51b2-4771-9503-4348a9152632 req-c63628f7-abef-4ed2-8297-25865c911e99 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:02:59.571428 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-84c3f111-51b2-4771-9503-4348a9152632 req-c63628f7-abef-4ed2-8297-25865c911e99 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:02:59.571872 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-84c3f111-51b2-4771-9503-4348a9152632 req-c63628f7-abef-4ed2-8297-25865c911e99 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:02:59.584430 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-84c3f111-51b2-4771-9503-4348a9152632 req-c63628f7-abef-4ed2-8297-25865c911e99 service nova] Creating event network-vif-deleted:034bfe35-5a4c-4024-b8ad-3fc77f012374 for instance 70f4c178-630e-4050-8aad-4c60bec30bcd on nch1-master-1 Oct 22 21:02:59.589774 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-84c3f111-51b2-4771-9503-4348a9152632 req-c63628f7-abef-4ed2-8297-25865c911e99 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034573 Oct 22 21:02:59.590477 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1539/2960] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:02:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 21:02:59.669004 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-639a8f70-10dc-403c-ae00-558cda29ba5e tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a44ff8e7c14b94b1670f030085c43d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a26a2284f4424cbeaf63d504652546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:02:59.683142 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-639a8f70-10dc-403c-ae00-558cda29ba5e tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] 10.222.0.18 "GET /compute/v2.1/servers/524c2c11-4a65-4360-93e4-e25349cb6416" status: 200 len: 1307 microversion: 2.1 time: 0.457748 Oct 22 21:02:59.683993 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1422/2961] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:02:59 2022] GET /compute/v2.1/servers/524c2c11-4a65-4360-93e4-e25349cb6416 => generated 1307 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:02:59.731117 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-bc75273f-5ac9-40be-9c33-ecf7f8a96f47 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:02:59.731953 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-bc75273f-5ac9-40be-9c33-ecf7f8a96f47 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] [instance: a99614d8-f2f7-4ce1-87e8-47f3af03d9f8] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:02:59.741320 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bc75273f-5ac9-40be-9c33-ecf7f8a96f47 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:02:59.748358 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bc75273f-5ac9-40be-9c33-ecf7f8a96f47 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:02:59.748943 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bc75273f-5ac9-40be-9c33-ecf7f8a96f47 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:02:59.749736 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bc75273f-5ac9-40be-9c33-ecf7f8a96f47 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:02:59.750157 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bc75273f-5ac9-40be-9c33-ecf7f8a96f47 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:02:59.750594 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bc75273f-5ac9-40be-9c33-ecf7f8a96f47 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:02:59.782625 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-98a775e1-509a-4ebd-90d0-6dcedd9f3792 tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:02:59.783250 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-98a775e1-509a-4ebd-90d0-6dcedd9f3792 tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] [instance: 4850d7fd-598e-4c80-8388-bd124c104ef3] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:02:59.791535 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-98a775e1-509a-4ebd-90d0-6dcedd9f3792 tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:02:59.792544 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-98a775e1-509a-4ebd-90d0-6dcedd9f3792 tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:02:59.799362 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-98a775e1-509a-4ebd-90d0-6dcedd9f3792 tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:02:59.800519 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-98a775e1-509a-4ebd-90d0-6dcedd9f3792 tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:02:59.801659 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-98a775e1-509a-4ebd-90d0-6dcedd9f3792 tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:02:59.802337 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-98a775e1-509a-4ebd-90d0-6dcedd9f3792 tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:03:00.302970 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-98a775e1-509a-4ebd-90d0-6dcedd9f3792 tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3adb02392d074b7eb08c94bbf1904547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dfacd9c525f486eaa04d19dbe2dc423', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:03:00.311261 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-98a775e1-509a-4ebd-90d0-6dcedd9f3792 tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] 10.222.0.18 "GET /compute/v2.1/servers/4850d7fd-598e-4c80-8388-bd124c104ef3" status: 200 len: 1311 microversion: 2.1 time: 0.532470 Oct 22 21:03:00.312028 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1423/2962] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:02:59 2022] GET /compute/v2.1/servers/4850d7fd-598e-4c80-8388-bd124c104ef3 => generated 1311 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:03:00.317555 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-bc75273f-5ac9-40be-9c33-ecf7f8a96f47 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1b410a64e0415a96d30f5040361137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd7873d6db4e09bc9ab9a048a6b1ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:03:00.318713 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-b98370c5-3ab6-4dab-b5a0-5e5207b9a4fb tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:03:00.319538 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-b98370c5-3ab6-4dab-b5a0-5e5207b9a4fb tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] [instance: 70f4c178-630e-4050-8aad-4c60bec30bcd] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:03:00.330115 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b98370c5-3ab6-4dab-b5a0-5e5207b9a4fb tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:03:00.330619 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b98370c5-3ab6-4dab-b5a0-5e5207b9a4fb tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:03:00.331018 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-bc75273f-5ac9-40be-9c33-ecf7f8a96f47 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] 10.222.0.18 "GET /compute/v2.1/servers/a99614d8-f2f7-4ce1-87e8-47f3af03d9f8" status: 200 len: 1509 microversion: 2.1 time: 0.603806 Oct 22 21:03:00.331285 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b98370c5-3ab6-4dab-b5a0-5e5207b9a4fb tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:03:00.332096 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b98370c5-3ab6-4dab-b5a0-5e5207b9a4fb tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:03:00.332754 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b98370c5-3ab6-4dab-b5a0-5e5207b9a4fb tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:03:00.333432 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b98370c5-3ab6-4dab-b5a0-5e5207b9a4fb tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:03:00.336330 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1540/2963] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:02:59 2022] GET /compute/v2.1/servers/a99614d8-f2f7-4ce1-87e8-47f3af03d9f8 => generated 1509 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:03:00.344109 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-d43b9566-a305-440c-8415-3bd6712400aa tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:03:00.345424 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-d43b9566-a305-440c-8415-3bd6712400aa tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] [instance: 2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:03:00.356021 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d43b9566-a305-440c-8415-3bd6712400aa tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:03:00.357190 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d43b9566-a305-440c-8415-3bd6712400aa tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:03:00.357907 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d43b9566-a305-440c-8415-3bd6712400aa tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:03:00.359765 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d43b9566-a305-440c-8415-3bd6712400aa tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:03:00.360500 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d43b9566-a305-440c-8415-3bd6712400aa tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:03:00.361158 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d43b9566-a305-440c-8415-3bd6712400aa tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:03:00.380458 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-b98370c5-3ab6-4dab-b5a0-5e5207b9a4fb tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] HTTP exception thrown: Instance 70f4c178-630e-4050-8aad-4c60bec30bcd could not be found. Oct 22 21:03:00.382165 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-b98370c5-3ab6-4dab-b5a0-5e5207b9a4fb tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Request method failure captured: Oct 22 21:03:00.382165 ncdv-master-1 devstack@n-api.service[138744]: request: GET /compute/v2.1/servers/70f4c178-630e-4050-8aad-4c60bec30bcd HTTP/1.1 Oct 22 21:03:00.382165 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 21:03:00.382165 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 21:03:00.382165 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 21:03:00.382165 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 0 Oct 22 21:03:00.382165 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 21:03:00.382165 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 21:03:00.382165 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 21:03:00.382165 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 21:03:00.382165 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVFnLripxmgYKOgyouzkbnFb_NXWQVyhatEIvrxwqFnKbm-zaPGbZNkZRVzrg42W70xYbfT9z7_wyFCZb71J5QL_RzYux1JL4k2JE4KNlTX63lKgcRBcC_a-lrN4tpEl6uJVI4kG-IwzIuZ3OQfINta61A4woEp1e9TUFfa4jNFHjpAw Oct 22 21:03:00.382165 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 21:03:00.382165 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 21:03:00.382165 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 21:03:00.382165 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 21:03:00.382165 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 21:03:00.382165 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 21:03:00.382165 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: b6e01f91c3a845bf8e67e3ad415d9c69 Oct 22 21:03:00.382165 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-ListImageFiltersTestJSON-1345601845 Oct 22 21:03:00.382165 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 21:03:00.382165 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 21:03:00.382165 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_b6e01f91c3a845bf8e67e3ad415d9c69"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b6e01f91c3a845bf8e67e3ad415d9c69"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/b6e01f91c3a845bf8e67e3ad415d9c69"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b6e01f91c3a845bf8e67e3ad415d9c69"}]}] Oct 22 21:03:00.382165 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-ListImageFiltersTestJSON-1345601845 Oct 22 21:03:00.382165 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: b6e01f91c3a845bf8e67e3ad415d9c69 Oct 22 21:03:00.382165 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-1345601845 Oct 22 21:03:00.382165 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-ListImageFiltersTestJSON-1345601845-project Oct 22 21:03:00.382165 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 21:03:00.382165 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 21:03:00.382165 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: 2b9bfe6f6d564d4c9fb1fea439476e03 Oct 22 21:03:00.382165 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-ListImageFiltersTestJSON-1345601845-project Oct 22 21:03:00.382165 ncdv-master-1 devstack@n-api.service[138744]: method: > Oct 22 21:03:00.382165 ncdv-master-1 devstack@n-api.service[138744]: exception: Instance 70f4c178-630e-4050-8aad-4c60bec30bcd could not be found. Oct 22 21:03:00.382165 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': '70f4c178-630e-4050-8aad-4c60bec30bcd'} Oct 22 21:03:00.382165 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:03:00.382165 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:03:00.382165 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 21:03:00.382165 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 21:03:00.382165 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 21:03:00.382165 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 21:03:00.382165 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 21:03:00.382165 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 21:03:00.382165 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 21:03:00.382165 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 21:03:00.382165 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 70f4c178-630e-4050-8aad-4c60bec30bcd could not be found. Oct 22 21:03:00.382165 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:03:00.382165 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:03:00.382165 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:03:00.382165 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:03:00.382165 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:03:00.382165 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:03:00.382165 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:03:00.382165 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:03:00.382165 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:03:00.382165 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:03:00.382165 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 21:03:00.382165 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 21:03:00.382165 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 21:03:00.382165 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 21:03:00.382165 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 21:03:00.382165 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:03:00.382165 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 70f4c178-630e-4050-8aad-4c60bec30bcd could not be found. Oct 22 21:03:00.382165 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:03:00.382165 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:03:00.382165 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:03:00.386834 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:03:00.386834 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:03:00.386834 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:03:00.386834 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:03:00.386834 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:03:00.386834 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 70f4c178-630e-4050-8aad-4c60bec30bcd could not be found. Oct 22 21:03:00.386834 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:03:00.386834 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-b98370c5-3ab6-4dab-b5a0-5e5207b9a4fb tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Returning 404 to user: Instance 70f4c178-630e-4050-8aad-4c60bec30bcd could not be found. {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:03:00.389722 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-b98370c5-3ab6-4dab-b5a0-5e5207b9a4fb tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] 10.222.0.18 "GET /compute/v2.1/servers/70f4c178-630e-4050-8aad-4c60bec30bcd" status: 404 len: 111 microversion: 2.1 time: 0.070199 Oct 22 21:03:00.391768 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1424/2964] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:03:00 2022] GET /compute/v2.1/servers/70f4c178-630e-4050-8aad-4c60bec30bcd => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 21:03:00.402122 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-734c94c9-39d7-4523-a7e1-2ca4d47a4b60 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Calling method '.version_select at 0x7fd39fee3af0>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:03:00.407412 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:03:00.542736 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-d43b9566-a305-440c-8415-3bd6712400aa tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:03:00.560387 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-d43b9566-a305-440c-8415-3bd6712400aa tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:03:00.562151 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-d43b9566-a305-440c-8415-3bd6712400aa tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:03:00.570203 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-d43b9566-a305-440c-8415-3bd6712400aa tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] 10.222.0.18 "GET /compute/v2.1/servers/2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac" status: 200 len: 1539 microversion: 2.91 time: 0.232543 Oct 22 21:03:00.571584 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1541/2965] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:03:00 2022] GET /compute/v2.1/servers/2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac => generated 1539 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:03:00.710141 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-d62f5597-2a65-43e9-af90-0d204697d8c1 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:03:00.711321 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-d62f5597-2a65-43e9-af90-0d204697d8c1 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] [instance: 524c2c11-4a65-4360-93e4-e25349cb6416] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:03:00.733877 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d62f5597-2a65-43e9-af90-0d204697d8c1 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:03:00.734897 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d62f5597-2a65-43e9-af90-0d204697d8c1 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:03:00.735597 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d62f5597-2a65-43e9-af90-0d204697d8c1 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:03:00.736681 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d62f5597-2a65-43e9-af90-0d204697d8c1 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:03:00.737776 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d62f5597-2a65-43e9-af90-0d204697d8c1 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:03:00.738435 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d62f5597-2a65-43e9-af90-0d204697d8c1 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:03:00.928911 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-734c94c9-39d7-4523-a7e1-2ca4d47a4b60 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] 10.222.0.18 "DELETE /compute/v2.1/images/cab6fb6f-771e-4162-b5d7-02e27e5dfa7a" status: 204 len: 0 microversion: 2.1 time: 0.533981 Oct 22 21:03:00.929827 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1425/2966] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:03:00 2022] DELETE /compute/v2.1/images/cab6fb6f-771e-4162-b5d7-02e27e5dfa7a => generated 0 bytes in 536 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 21:03:00.940631 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-3817d38a-33b9-4114-8b5c-1a5ef0ff4897 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Calling method '.version_select at 0x7fd3a43b9af0>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:03:01.099841 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-d62f5597-2a65-43e9-af90-0d204697d8c1 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a44ff8e7c14b94b1670f030085c43d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a26a2284f4424cbeaf63d504652546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:03:01.109351 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-d62f5597-2a65-43e9-af90-0d204697d8c1 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] 10.222.0.18 "GET /compute/v2.1/servers/524c2c11-4a65-4360-93e4-e25349cb6416" status: 200 len: 1307 microversion: 2.1 time: 0.406912 Oct 22 21:03:01.110239 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1542/2967] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:03:00 2022] GET /compute/v2.1/servers/524c2c11-4a65-4360-93e4-e25349cb6416 => generated 1307 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:03:01.227790 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-3817d38a-33b9-4114-8b5c-1a5ef0ff4897 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] 10.222.0.18 "DELETE /compute/v2.1/images/41ee8951-b671-4839-8f15-190b7f5e7484" status: 204 len: 0 microversion: 2.1 time: 0.292571 Oct 22 21:03:01.228557 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1426/2968] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:03:00 2022] DELETE /compute/v2.1/images/41ee8951-b671-4839-8f15-190b7f5e7484 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 22 21:03:01.241309 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-7b595054-e30f-452d-a64a-080162419b17 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] Calling method '.version_select at 0x7fd39efb45e0>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:03:01.337398 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-25214286-8c0c-4001-a96c-5005367c05c9 tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:03:01.338018 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-25214286-8c0c-4001-a96c-5005367c05c9 tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] [instance: 4850d7fd-598e-4c80-8388-bd124c104ef3] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:03:01.345431 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-25214286-8c0c-4001-a96c-5005367c05c9 tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:03:01.345932 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-25214286-8c0c-4001-a96c-5005367c05c9 tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:03:01.346379 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-25214286-8c0c-4001-a96c-5005367c05c9 tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:03:01.347126 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-25214286-8c0c-4001-a96c-5005367c05c9 tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:03:01.347596 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-25214286-8c0c-4001-a96c-5005367c05c9 tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:03:01.348029 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-25214286-8c0c-4001-a96c-5005367c05c9 tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:03:01.514516 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-25214286-8c0c-4001-a96c-5005367c05c9 tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3adb02392d074b7eb08c94bbf1904547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dfacd9c525f486eaa04d19dbe2dc423', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:03:01.524826 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-7b595054-e30f-452d-a64a-080162419b17 tempest-ListImageFiltersTestJSON-1345601845 tempest-ListImageFiltersTestJSON-1345601845-project] 10.222.0.18 "DELETE /compute/v2.1/images/73de2577-b5d2-45cf-8720-87f3c939c723" status: 204 len: 0 microversion: 2.1 time: 0.291497 Oct 22 21:03:01.525483 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-25214286-8c0c-4001-a96c-5005367c05c9 tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] 10.222.0.18 "GET /compute/v2.1/servers/4850d7fd-598e-4c80-8388-bd124c104ef3" status: 200 len: 1311 microversion: 2.1 time: 0.192157 Oct 22 21:03:01.525729 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1543/2969] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:03:01 2022] DELETE /compute/v2.1/images/73de2577-b5d2-45cf-8720-87f3c939c723 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 21:03:01.530167 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1427/2970] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:03:01 2022] GET /compute/v2.1/servers/4850d7fd-598e-4c80-8388-bd124c104ef3 => generated 1311 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:03:01.531779 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-60fe8578-db0e-4756-b9a6-813b5abad6b7 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:03:01.533018 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-60fe8578-db0e-4756-b9a6-813b5abad6b7 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] [instance: a99614d8-f2f7-4ce1-87e8-47f3af03d9f8] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:03:01.540098 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-60fe8578-db0e-4756-b9a6-813b5abad6b7 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:03:01.540978 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-60fe8578-db0e-4756-b9a6-813b5abad6b7 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:03:01.541653 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-60fe8578-db0e-4756-b9a6-813b5abad6b7 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:03:01.542572 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-60fe8578-db0e-4756-b9a6-813b5abad6b7 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:03:01.543944 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-60fe8578-db0e-4756-b9a6-813b5abad6b7 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:03:01.544740 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-60fe8578-db0e-4756-b9a6-813b5abad6b7 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:03:01.566838 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-bf70d281-4684-4f94-a7c0-3e01bbfea229 req-5fc9173d-53b9-4ada-9ecb-500e2d57a22f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4850d7fd-598e-4c80-8388-bd124c104ef3", "tag": "b5dcf1be-5514-4e11-8fd2-2f7f68001e19"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:03:01.581218 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-bf70d281-4684-4f94-a7c0-3e01bbfea229 req-5fc9173d-53b9-4ada-9ecb-500e2d57a22f service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:03:01.581788 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-bf70d281-4684-4f94-a7c0-3e01bbfea229 req-5fc9173d-53b9-4ada-9ecb-500e2d57a22f service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:03:01.582321 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-bf70d281-4684-4f94-a7c0-3e01bbfea229 req-5fc9173d-53b9-4ada-9ecb-500e2d57a22f service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:03:01.597994 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-bf70d281-4684-4f94-a7c0-3e01bbfea229 req-5fc9173d-53b9-4ada-9ecb-500e2d57a22f service nova] Creating event network-changed:b5dcf1be-5514-4e11-8fd2-2f7f68001e19 for instance 4850d7fd-598e-4c80-8388-bd124c104ef3 on nch2-master-1 Oct 22 21:03:01.604762 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-bf70d281-4684-4f94-a7c0-3e01bbfea229 req-5fc9173d-53b9-4ada-9ecb-500e2d57a22f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044377 Oct 22 21:03:01.606179 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1428/2971] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:03:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 21:03:01.613414 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-12685564-d0d4-4e6f-b026-adeceafd966d tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:03:01.614300 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-12685564-d0d4-4e6f-b026-adeceafd966d tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] [instance: 2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:03:01.621521 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-12685564-d0d4-4e6f-b026-adeceafd966d tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:03:01.622257 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-12685564-d0d4-4e6f-b026-adeceafd966d tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:03:01.622711 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-12685564-d0d4-4e6f-b026-adeceafd966d tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:03:01.623454 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-12685564-d0d4-4e6f-b026-adeceafd966d tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:03:01.624375 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-12685564-d0d4-4e6f-b026-adeceafd966d tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:03:01.624825 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-12685564-d0d4-4e6f-b026-adeceafd966d tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:03:01.726051 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-12685564-d0d4-4e6f-b026-adeceafd966d tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:03:01.737583 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-12685564-d0d4-4e6f-b026-adeceafd966d tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:03:01.740430 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-12685564-d0d4-4e6f-b026-adeceafd966d tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:03:01.751770 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-12685564-d0d4-4e6f-b026-adeceafd966d tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] 10.222.0.18 "GET /compute/v2.1/servers/2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac" status: 200 len: 1539 microversion: 2.91 time: 0.142810 Oct 22 21:03:01.753443 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1429/2972] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:03:01 2022] GET /compute/v2.1/servers/2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac => generated 1539 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:03:01.759103 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-60fe8578-db0e-4756-b9a6-813b5abad6b7 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1b410a64e0415a96d30f5040361137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd7873d6db4e09bc9ab9a048a6b1ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:03:01.769867 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-60fe8578-db0e-4756-b9a6-813b5abad6b7 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] 10.222.0.18 "GET /compute/v2.1/servers/a99614d8-f2f7-4ce1-87e8-47f3af03d9f8" status: 200 len: 1509 microversion: 2.1 time: 0.241517 Oct 22 21:03:01.772452 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1544/2973] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:03:01 2022] GET /compute/v2.1/servers/a99614d8-f2f7-4ce1-87e8-47f3af03d9f8 => generated 1509 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:03:02.137158 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-acef16a8-22a6-4eac-9901-2d1ff5d38f54 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:03:02.137983 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-acef16a8-22a6-4eac-9901-2d1ff5d38f54 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] [instance: 524c2c11-4a65-4360-93e4-e25349cb6416] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:03:02.147449 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-acef16a8-22a6-4eac-9901-2d1ff5d38f54 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:03:02.148246 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-acef16a8-22a6-4eac-9901-2d1ff5d38f54 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:03:02.148840 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-acef16a8-22a6-4eac-9901-2d1ff5d38f54 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:03:02.150220 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-acef16a8-22a6-4eac-9901-2d1ff5d38f54 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:03:02.150829 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-acef16a8-22a6-4eac-9901-2d1ff5d38f54 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:03:02.151749 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-acef16a8-22a6-4eac-9901-2d1ff5d38f54 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:03:02.226465 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell0:SELECT=4 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:03:02.351766 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-acef16a8-22a6-4eac-9901-2d1ff5d38f54 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a44ff8e7c14b94b1670f030085c43d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a26a2284f4424cbeaf63d504652546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:03:02.360294 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-acef16a8-22a6-4eac-9901-2d1ff5d38f54 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] 10.222.0.18 "GET /compute/v2.1/servers/524c2c11-4a65-4360-93e4-e25349cb6416" status: 200 len: 1307 microversion: 2.1 time: 0.229867 Oct 22 21:03:02.360959 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1430/2974] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:03:02 2022] GET /compute/v2.1/servers/524c2c11-4a65-4360-93e4-e25349cb6416 => generated 1307 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:03:02.555845 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-21b4b141-2ecb-4eff-8855-a5ae61973444 tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:03:02.562729 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-21b4b141-2ecb-4eff-8855-a5ae61973444 tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] [instance: 4850d7fd-598e-4c80-8388-bd124c104ef3] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:03:02.574976 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-21b4b141-2ecb-4eff-8855-a5ae61973444 tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:03:02.575960 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-21b4b141-2ecb-4eff-8855-a5ae61973444 tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:03:02.576436 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-21b4b141-2ecb-4eff-8855-a5ae61973444 tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:03:02.577150 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-21b4b141-2ecb-4eff-8855-a5ae61973444 tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:03:02.577633 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-21b4b141-2ecb-4eff-8855-a5ae61973444 tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:03:02.578082 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-21b4b141-2ecb-4eff-8855-a5ae61973444 tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:03:02.784954 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-e20ce746-3fbc-42b9-851a-66ba7c306a6d tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:03:02.785716 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-e20ce746-3fbc-42b9-851a-66ba7c306a6d tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] [instance: 2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:03:02.788868 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-21b4b141-2ecb-4eff-8855-a5ae61973444 tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3adb02392d074b7eb08c94bbf1904547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dfacd9c525f486eaa04d19dbe2dc423', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:03:02.794066 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell0:SELECT=30 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:03:02.796274 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e20ce746-3fbc-42b9-851a-66ba7c306a6d tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:03:02.797349 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e20ce746-3fbc-42b9-851a-66ba7c306a6d tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:03:02.798581 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-21b4b141-2ecb-4eff-8855-a5ae61973444 tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] 10.222.0.18 "GET /compute/v2.1/servers/4850d7fd-598e-4c80-8388-bd124c104ef3" status: 200 len: 1311 microversion: 2.1 time: 0.247298 Oct 22 21:03:02.799218 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1545/2975] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:03:02 2022] GET /compute/v2.1/servers/4850d7fd-598e-4c80-8388-bd124c104ef3 => generated 1311 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:03:02.800172 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e20ce746-3fbc-42b9-851a-66ba7c306a6d tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:03:02.801133 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e20ce746-3fbc-42b9-851a-66ba7c306a6d tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:03:02.801788 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e20ce746-3fbc-42b9-851a-66ba7c306a6d tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:03:02.802413 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e20ce746-3fbc-42b9-851a-66ba7c306a6d tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:03:02.805314 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-9a0f80b1-8d61-493c-8fbc-ee1e44d91aa1 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:03:02.805932 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-9a0f80b1-8d61-493c-8fbc-ee1e44d91aa1 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] [instance: a99614d8-f2f7-4ce1-87e8-47f3af03d9f8] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:03:02.812933 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9a0f80b1-8d61-493c-8fbc-ee1e44d91aa1 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:03:02.814018 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9a0f80b1-8d61-493c-8fbc-ee1e44d91aa1 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:03:02.814640 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9a0f80b1-8d61-493c-8fbc-ee1e44d91aa1 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:03:02.815383 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9a0f80b1-8d61-493c-8fbc-ee1e44d91aa1 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:03:02.815837 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9a0f80b1-8d61-493c-8fbc-ee1e44d91aa1 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:03:02.816426 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9a0f80b1-8d61-493c-8fbc-ee1e44d91aa1 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:03:02.912818 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-e20ce746-3fbc-42b9-851a-66ba7c306a6d tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:03:02.922492 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-e20ce746-3fbc-42b9-851a-66ba7c306a6d tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:03:02.924479 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-e20ce746-3fbc-42b9-851a-66ba7c306a6d tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:03:02.930823 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-e20ce746-3fbc-42b9-851a-66ba7c306a6d tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] 10.222.0.18 "GET /compute/v2.1/servers/2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac" status: 200 len: 1539 microversion: 2.91 time: 0.149727 Oct 22 21:03:02.932046 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1431/2976] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:03:02 2022] GET /compute/v2.1/servers/2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac => generated 1539 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:03:03.011046 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-9a0f80b1-8d61-493c-8fbc-ee1e44d91aa1 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1b410a64e0415a96d30f5040361137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd7873d6db4e09bc9ab9a048a6b1ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:03:03.024184 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-9a0f80b1-8d61-493c-8fbc-ee1e44d91aa1 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] 10.222.0.18 "GET /compute/v2.1/servers/a99614d8-f2f7-4ce1-87e8-47f3af03d9f8" status: 200 len: 1509 microversion: 2.1 time: 0.223807 Oct 22 21:03:03.024808 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1546/2977] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:03:02 2022] GET /compute/v2.1/servers/a99614d8-f2f7-4ce1-87e8-47f3af03d9f8 => generated 1509 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:03:03.385443 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-431f8190-e6fa-40e6-afae-db92c46f32cb tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:03:03.386123 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-431f8190-e6fa-40e6-afae-db92c46f32cb tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] [instance: 524c2c11-4a65-4360-93e4-e25349cb6416] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:03:03.399108 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-431f8190-e6fa-40e6-afae-db92c46f32cb tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:03:03.400321 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-431f8190-e6fa-40e6-afae-db92c46f32cb tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:03:03.401573 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-431f8190-e6fa-40e6-afae-db92c46f32cb tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:03:03.402322 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-431f8190-e6fa-40e6-afae-db92c46f32cb tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:03:03.402785 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-431f8190-e6fa-40e6-afae-db92c46f32cb tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:03:03.404302 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-431f8190-e6fa-40e6-afae-db92c46f32cb tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:03:03.515631 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell0:SELECT=34 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:03:03.710761 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-ae2099fe-7cf3-47cc-9282-3d955d5986c7 tempest-ListImagesTestJSON-2094002205 tempest-ListImagesTestJSON-2094002205-project] Calling method '.version_select at 0x7fd39efb6ee0>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:03:03.773744 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-ae2099fe-7cf3-47cc-9282-3d955d5986c7 tempest-ListImagesTestJSON-2094002205 tempest-ListImagesTestJSON-2094002205-project] 10.222.0.18 "GET /compute/v2.1/images/085e4478-6edc-4a69-8e08-f9831713eb65" status: 200 len: 784 microversion: 2.1 time: 0.262958 Oct 22 21:03:03.775090 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1547/2978] 10.222.0.18 () {58 vars in 1233 bytes} [Sat Oct 22 21:03:03 2022] GET /compute/v2.1/images/085e4478-6edc-4a69-8e08-f9831713eb65 => generated 784 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 21:03:03.790930 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-49232c5d-5011-4c28-a50e-7a11b8b5d42d tempest-ListImagesTestJSON-2094002205 tempest-ListImagesTestJSON-2094002205-project] Calling method '.version_select at 0x7fd39ef02430>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:03:03.836918 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-431f8190-e6fa-40e6-afae-db92c46f32cb tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a44ff8e7c14b94b1670f030085c43d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a26a2284f4424cbeaf63d504652546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:03:03.841682 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-49232c5d-5011-4c28-a50e-7a11b8b5d42d tempest-ListImagesTestJSON-2094002205 tempest-ListImagesTestJSON-2094002205-project] 10.222.0.18 "GET /compute/v2.1/images" status: 200 len: 445 microversion: 2.1 time: 0.055556 Oct 22 21:03:03.842625 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1548/2979] 10.222.0.18 () {58 vars in 1122 bytes} [Sat Oct 22 21:03:03 2022] GET /compute/v2.1/images => generated 445 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:03:03.848260 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-cf77a878-50cc-4ee0-a6f5-c70d1b31dfcf tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:03:03.849096 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-cf77a878-50cc-4ee0-a6f5-c70d1b31dfcf tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] [instance: 4850d7fd-598e-4c80-8388-bd124c104ef3] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:03:03.854453 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-431f8190-e6fa-40e6-afae-db92c46f32cb tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] 10.222.0.18 "GET /compute/v2.1/servers/524c2c11-4a65-4360-93e4-e25349cb6416" status: 200 len: 1307 microversion: 2.1 time: 0.474573 Oct 22 21:03:03.855831 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1432/2980] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:03:03 2022] GET /compute/v2.1/servers/524c2c11-4a65-4360-93e4-e25349cb6416 => generated 1307 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:03:03.856579 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cf77a878-50cc-4ee0-a6f5-c70d1b31dfcf tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:03:03.857079 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cf77a878-50cc-4ee0-a6f5-c70d1b31dfcf tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:03:03.857603 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cf77a878-50cc-4ee0-a6f5-c70d1b31dfcf tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:03:03.858250 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cf77a878-50cc-4ee0-a6f5-c70d1b31dfcf tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:03:03.858707 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cf77a878-50cc-4ee0-a6f5-c70d1b31dfcf tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:03:03.859139 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cf77a878-50cc-4ee0-a6f5-c70d1b31dfcf tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:03:03.862094 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-d30b8374-2cf8-4f39-bad4-1c0155a257eb tempest-ListImagesTestJSON-2094002205 tempest-ListImagesTestJSON-2094002205-project] Calling method '.version_select at 0x7fd3a8bbdaf0>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:03:03.923529 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-d30b8374-2cf8-4f39-bad4-1c0155a257eb tempest-ListImagesTestJSON-2094002205 tempest-ListImagesTestJSON-2094002205-project] 10.222.0.18 "GET /compute/v2.1/images/detail" status: 200 len: 787 microversion: 2.1 time: 0.065655 Oct 22 21:03:03.924275 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1433/2981] 10.222.0.18 () {58 vars in 1143 bytes} [Sat Oct 22 21:03:03 2022] GET /compute/v2.1/images/detail => generated 787 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:03:03.959001 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-c1178b0b-c0ef-42d0-ba94-1f250ff9f37c tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:03:03.961008 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-c1178b0b-c0ef-42d0-ba94-1f250ff9f37c tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] [instance: 2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:03:03.978598 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c1178b0b-c0ef-42d0-ba94-1f250ff9f37c tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:03:03.980212 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c1178b0b-c0ef-42d0-ba94-1f250ff9f37c tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:03:03.980921 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c1178b0b-c0ef-42d0-ba94-1f250ff9f37c tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:03:03.982870 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c1178b0b-c0ef-42d0-ba94-1f250ff9f37c tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:03:03.984054 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c1178b0b-c0ef-42d0-ba94-1f250ff9f37c tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:03:03.985571 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c1178b0b-c0ef-42d0-ba94-1f250ff9f37c tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:03:04.155717 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-cf77a878-50cc-4ee0-a6f5-c70d1b31dfcf tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3adb02392d074b7eb08c94bbf1904547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dfacd9c525f486eaa04d19dbe2dc423', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:03:04.164546 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-cf77a878-50cc-4ee0-a6f5-c70d1b31dfcf tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] 10.222.0.18 "GET /compute/v2.1/servers/4850d7fd-598e-4c80-8388-bd124c104ef3" status: 200 len: 1311 microversion: 2.1 time: 0.320699 Oct 22 21:03:04.165184 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1549/2982] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:03:03 2022] GET /compute/v2.1/servers/4850d7fd-598e-4c80-8388-bd124c104ef3 => generated 1311 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:03:04.172530 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-9a9aa6b4-c269-4f53-97e3-73dcb57cc05c tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:03:04.174018 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-9a9aa6b4-c269-4f53-97e3-73dcb57cc05c tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] [instance: a99614d8-f2f7-4ce1-87e8-47f3af03d9f8] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:03:04.180868 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-c1178b0b-c0ef-42d0-ba94-1f250ff9f37c tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:03:04.182137 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9a9aa6b4-c269-4f53-97e3-73dcb57cc05c tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:03:04.182802 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9a9aa6b4-c269-4f53-97e3-73dcb57cc05c tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:03:04.183584 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9a9aa6b4-c269-4f53-97e3-73dcb57cc05c tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:03:04.184462 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9a9aa6b4-c269-4f53-97e3-73dcb57cc05c tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:03:04.185198 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9a9aa6b4-c269-4f53-97e3-73dcb57cc05c tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:03:04.191558 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9a9aa6b4-c269-4f53-97e3-73dcb57cc05c tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:03:04.202159 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-c1178b0b-c0ef-42d0-ba94-1f250ff9f37c tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:03:04.205698 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-c1178b0b-c0ef-42d0-ba94-1f250ff9f37c tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:03:04.214779 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-c1178b0b-c0ef-42d0-ba94-1f250ff9f37c tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] 10.222.0.18 "GET /compute/v2.1/servers/2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac" status: 200 len: 1539 microversion: 2.91 time: 0.260119 Oct 22 21:03:04.218118 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1434/2983] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:03:03 2022] GET /compute/v2.1/servers/2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac => generated 1539 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 22 21:03:04.445603 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-9a9aa6b4-c269-4f53-97e3-73dcb57cc05c tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1b410a64e0415a96d30f5040361137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd7873d6db4e09bc9ab9a048a6b1ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:03:04.455305 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-9a9aa6b4-c269-4f53-97e3-73dcb57cc05c tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] 10.222.0.18 "GET /compute/v2.1/servers/a99614d8-f2f7-4ce1-87e8-47f3af03d9f8" status: 200 len: 1509 microversion: 2.1 time: 0.287458 Oct 22 21:03:04.456103 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1550/2984] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:03:04 2022] GET /compute/v2.1/servers/a99614d8-f2f7-4ce1-87e8-47f3af03d9f8 => generated 1509 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:03:04.882851 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-55658ea8-44f8-4465-a536-5fcc1d5c0482 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:03:04.882851 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-55658ea8-44f8-4465-a536-5fcc1d5c0482 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] [instance: 524c2c11-4a65-4360-93e4-e25349cb6416] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:03:04.889802 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-55658ea8-44f8-4465-a536-5fcc1d5c0482 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:03:04.890287 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-55658ea8-44f8-4465-a536-5fcc1d5c0482 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:03:04.890727 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-55658ea8-44f8-4465-a536-5fcc1d5c0482 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:03:04.891458 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-55658ea8-44f8-4465-a536-5fcc1d5c0482 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:03:04.891911 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-55658ea8-44f8-4465-a536-5fcc1d5c0482 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:03:04.892340 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-55658ea8-44f8-4465-a536-5fcc1d5c0482 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:03:05.055837 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-55658ea8-44f8-4465-a536-5fcc1d5c0482 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a44ff8e7c14b94b1670f030085c43d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a26a2284f4424cbeaf63d504652546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:03:05.066251 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-55658ea8-44f8-4465-a536-5fcc1d5c0482 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] 10.222.0.18 "GET /compute/v2.1/servers/524c2c11-4a65-4360-93e4-e25349cb6416" status: 200 len: 1307 microversion: 2.1 time: 0.187910 Oct 22 21:03:05.066882 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1435/2985] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:03:04 2022] GET /compute/v2.1/servers/524c2c11-4a65-4360-93e4-e25349cb6416 => generated 1307 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:03:05.194805 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-ce77eac0-8fb3-40fd-a0ed-637669dab919 tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:03:05.195378 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-ce77eac0-8fb3-40fd-a0ed-637669dab919 tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] [instance: 4850d7fd-598e-4c80-8388-bd124c104ef3] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:03:05.206338 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ce77eac0-8fb3-40fd-a0ed-637669dab919 tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:03:05.207047 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ce77eac0-8fb3-40fd-a0ed-637669dab919 tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:03:05.207854 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ce77eac0-8fb3-40fd-a0ed-637669dab919 tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:03:05.209671 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ce77eac0-8fb3-40fd-a0ed-637669dab919 tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:03:05.210428 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ce77eac0-8fb3-40fd-a0ed-637669dab919 tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:03:05.211148 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ce77eac0-8fb3-40fd-a0ed-637669dab919 tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:03:05.248982 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-89a5ec6d-1c03-44c9-92d7-8abff5115b40 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:03:05.249729 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-89a5ec6d-1c03-44c9-92d7-8abff5115b40 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] [instance: 2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:03:05.258901 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-89a5ec6d-1c03-44c9-92d7-8abff5115b40 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:03:05.260724 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-89a5ec6d-1c03-44c9-92d7-8abff5115b40 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:03:05.261777 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-89a5ec6d-1c03-44c9-92d7-8abff5115b40 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:03:05.262953 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-89a5ec6d-1c03-44c9-92d7-8abff5115b40 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:03:05.263612 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-89a5ec6d-1c03-44c9-92d7-8abff5115b40 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:03:05.264383 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-89a5ec6d-1c03-44c9-92d7-8abff5115b40 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:03:05.415735 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-89a5ec6d-1c03-44c9-92d7-8abff5115b40 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:03:05.431440 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-89a5ec6d-1c03-44c9-92d7-8abff5115b40 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:03:05.434809 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-89a5ec6d-1c03-44c9-92d7-8abff5115b40 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:03:05.451585 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-89a5ec6d-1c03-44c9-92d7-8abff5115b40 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] 10.222.0.18 "GET /compute/v2.1/servers/2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac" status: 200 len: 1539 microversion: 2.91 time: 0.205971 Oct 22 21:03:05.457168 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1436/2986] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:03:05 2022] GET /compute/v2.1/servers/2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac => generated 1539 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 22 21:03:05.489863 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-871694e6-391a-4745-9a7b-c228c9ba652b tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:03:05.492153 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-871694e6-391a-4745-9a7b-c228c9ba652b tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] [instance: a99614d8-f2f7-4ce1-87e8-47f3af03d9f8] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:03:05.515300 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-871694e6-391a-4745-9a7b-c228c9ba652b tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:03:05.516099 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-871694e6-391a-4745-9a7b-c228c9ba652b tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:03:05.521614 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-871694e6-391a-4745-9a7b-c228c9ba652b tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:03:05.524641 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-871694e6-391a-4745-9a7b-c228c9ba652b tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:03:05.526806 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-871694e6-391a-4745-9a7b-c228c9ba652b tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:03:05.528569 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-871694e6-391a-4745-9a7b-c228c9ba652b tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:03:05.534707 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-ce77eac0-8fb3-40fd-a0ed-637669dab919 tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3adb02392d074b7eb08c94bbf1904547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dfacd9c525f486eaa04d19dbe2dc423', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:03:05.554201 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-ce77eac0-8fb3-40fd-a0ed-637669dab919 tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] 10.222.0.18 "GET /compute/v2.1/servers/4850d7fd-598e-4c80-8388-bd124c104ef3" status: 200 len: 1311 microversion: 2.1 time: 0.363315 Oct 22 21:03:05.556190 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1551/2987] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:03:05 2022] GET /compute/v2.1/servers/4850d7fd-598e-4c80-8388-bd124c104ef3 => generated 1311 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:03:05.739777 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-871694e6-391a-4745-9a7b-c228c9ba652b tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1b410a64e0415a96d30f5040361137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd7873d6db4e09bc9ab9a048a6b1ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:03:05.747805 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-871694e6-391a-4745-9a7b-c228c9ba652b tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] 10.222.0.18 "GET /compute/v2.1/servers/a99614d8-f2f7-4ce1-87e8-47f3af03d9f8" status: 200 len: 1509 microversion: 2.1 time: 0.271355 Oct 22 21:03:05.748737 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1437/2988] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:03:05 2022] GET /compute/v2.1/servers/a99614d8-f2f7-4ce1-87e8-47f3af03d9f8 => generated 1509 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:03:06.091196 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-9450c0c5-8ab8-4ca8-98a8-a056208b32a0 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:03:06.091945 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-9450c0c5-8ab8-4ca8-98a8-a056208b32a0 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] [instance: 524c2c11-4a65-4360-93e4-e25349cb6416] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:03:06.098823 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9450c0c5-8ab8-4ca8-98a8-a056208b32a0 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:03:06.099309 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9450c0c5-8ab8-4ca8-98a8-a056208b32a0 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:03:06.099437 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-527feff2-13cb-484e-9f16-bc21a1f4cfcc tempest-KeyPairsV22TestJSON-554313478 tempest-KeyPairsV22TestJSON-554313478-project] Action: 'create', calling method: .version_select at 0x7fd39ef67430>, body: {"keypair": {"name": "tempest-keypair-2041000270", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCWmv0+NKpDRORKB0WLy3FS0OcuPeXHHp1pkG0PhPXhTUBsjLEmOOhw3WgVyAty71lYaJZZHs46p5EbIizWtgIL/UscVyzd1faO0e9vnAatNUBAjmdjg4cSFii9UXTWlFQ=="}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:03:06.099889 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9450c0c5-8ab8-4ca8-98a8-a056208b32a0 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:03:06.101113 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9450c0c5-8ab8-4ca8-98a8-a056208b32a0 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:03:06.101583 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9450c0c5-8ab8-4ca8-98a8-a056208b32a0 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:03:06.101996 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9450c0c5-8ab8-4ca8-98a8-a056208b32a0 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:03:06.125092 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-527feff2-13cb-484e-9f16-bc21a1f4cfcc tempest-KeyPairsV22TestJSON-554313478 tempest-KeyPairsV22TestJSON-554313478-project] Getting quotas for project c1c1a7b5f02846a5bf0ba619e29b0179. Resources: {'key_pairs'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 21:03:06.134580 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-527feff2-13cb-484e-9f16-bc21a1f4cfcc tempest-KeyPairsV22TestJSON-554313478 tempest-KeyPairsV22TestJSON-554313478-project] Getting quotas for user 298584f950924847986de298357627bf and project c1c1a7b5f02846a5bf0ba619e29b0179. Resources: {'key_pairs'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 21:03:06.167159 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-527feff2-13cb-484e-9f16-bc21a1f4cfcc tempest-KeyPairsV22TestJSON-554313478 tempest-KeyPairsV22TestJSON-554313478-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.200562 Oct 22 21:03:06.167815 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1552/2989] 10.222.0.18 () {62 vars in 1199 bytes} [Sat Oct 22 21:03:05 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 202 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 22 21:03:06.179516 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-2b01c4d8-ea15-47c3-b3a0-2ed1e044f6ec tempest-KeyPairsV22TestJSON-554313478 tempest-KeyPairsV22TestJSON-554313478-project] Calling method '.version_select at 0x7fd39ef6f5e0>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:03:06.190124 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-2b01c4d8-ea15-47c3-b3a0-2ed1e044f6ec tempest-KeyPairsV22TestJSON-554313478 tempest-KeyPairsV22TestJSON-554313478-project] 10.222.0.18 "GET /compute/v2.1/os-keypairs/tempest-keypair-2041000270" status: 200 len: 513 microversion: 2.2 time: 0.015067 Oct 22 21:03:06.191208 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1553/2990] 10.222.0.18 () {60 vars in 1258 bytes} [Sat Oct 22 21:03:06 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-2041000270 => generated 513 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 21:03:06.204250 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-cf044da3-3e36-4e05-8d14-138ccc3239b4 tempest-KeyPairsV22TestJSON-554313478 tempest-KeyPairsV22TestJSON-554313478-project] Calling method '.version_select at 0x7fd39efb9b80>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:03:06.237957 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-cf044da3-3e36-4e05-8d14-138ccc3239b4 tempest-KeyPairsV22TestJSON-554313478 tempest-KeyPairsV22TestJSON-554313478-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2041000270" status: 204 len: 0 microversion: 2.2 time: 0.038452 Oct 22 21:03:06.238554 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1554/2991] 10.222.0.18 () {60 vars in 1261 bytes} [Sat Oct 22 21:03:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2041000270 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 21:03:06.252788 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-5081b425-0c7d-4ef3-8ac8-0103c6f2caf3 tempest-KeyPairsV22TestJSON-554313478 tempest-KeyPairsV22TestJSON-554313478-project] Action: 'create', calling method: .version_select at 0x7fd39efa2c10>, body: {"keypair": {"name": "tempest-keypair-272817732", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLAkPP935M/W07frHOIAbMwsynSIgGAMZAwhtlJA3K3GenZUJa1xx/rzdea3gmhtZmU6MluWO8ngt8C2DFG38m4GqKADPGNSCiMS/zQUnsRJsaa1/Vo7GOGKeIhGzepdJg=="}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:03:06.269968 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-5081b425-0c7d-4ef3-8ac8-0103c6f2caf3 tempest-KeyPairsV22TestJSON-554313478 tempest-KeyPairsV22TestJSON-554313478-project] Getting quotas for project c1c1a7b5f02846a5bf0ba619e29b0179. Resources: {'key_pairs'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 21:03:06.277166 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-5081b425-0c7d-4ef3-8ac8-0103c6f2caf3 tempest-KeyPairsV22TestJSON-554313478 tempest-KeyPairsV22TestJSON-554313478-project] Getting quotas for user 298584f950924847986de298357627bf and project c1c1a7b5f02846a5bf0ba619e29b0179. Resources: {'key_pairs'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 21:03:06.294339 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-9450c0c5-8ab8-4ca8-98a8-a056208b32a0 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a44ff8e7c14b94b1670f030085c43d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a26a2284f4424cbeaf63d504652546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:03:06.303066 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-9450c0c5-8ab8-4ca8-98a8-a056208b32a0 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] 10.222.0.18 "GET /compute/v2.1/servers/524c2c11-4a65-4360-93e4-e25349cb6416" status: 200 len: 1307 microversion: 2.1 time: 0.215685 Oct 22 21:03:06.304026 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1438/2992] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:03:06 2022] GET /compute/v2.1/servers/524c2c11-4a65-4360-93e4-e25349cb6416 => generated 1307 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:03:06.320606 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-5081b425-0c7d-4ef3-8ac8-0103c6f2caf3 tempest-KeyPairsV22TestJSON-554313478 tempest-KeyPairsV22TestJSON-554313478-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.071298 Oct 22 21:03:06.321507 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1555/2993] 10.222.0.18 () {62 vars in 1199 bytes} [Sat Oct 22 21:03:06 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 73 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 22 21:03:06.334607 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-097eb3f1-fe3e-4c5a-a8e7-61746c97de8f tempest-KeyPairsV22TestJSON-554313478 tempest-KeyPairsV22TestJSON-554313478-project] Calling method '.version_select at 0x7fd3a8b88700>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:03:06.348930 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_api:INSERT=3,nova_api:SELECT=97 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:03:06.360320 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-097eb3f1-fe3e-4c5a-a8e7-61746c97de8f tempest-KeyPairsV22TestJSON-554313478 tempest-KeyPairsV22TestJSON-554313478-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-272817732" status: 204 len: 0 microversion: 2.2 time: 0.030891 Oct 22 21:03:06.361047 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1439/2994] 10.222.0.18 () {60 vars in 1258 bytes} [Sat Oct 22 21:03:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-272817732 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 21:03:06.370544 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-0c4e63c0-826f-453c-b5e4-e9c8388db4cc tempest-KeyPairsV22TestJSON-554313478 tempest-KeyPairsV22TestJSON-554313478-project] Action: 'create', calling method: .version_select at 0x7fd39ef67ca0>, body: {"keypair": {"name": "tempest-keypair-1827509806", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:03:06.386538 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-0c4e63c0-826f-453c-b5e4-e9c8388db4cc tempest-KeyPairsV22TestJSON-554313478 tempest-KeyPairsV22TestJSON-554313478-project] Getting quotas for project c1c1a7b5f02846a5bf0ba619e29b0179. Resources: {'key_pairs'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 21:03:06.392659 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-0c4e63c0-826f-453c-b5e4-e9c8388db4cc tempest-KeyPairsV22TestJSON-554313478 tempest-KeyPairsV22TestJSON-554313478-project] Getting quotas for user 298584f950924847986de298357627bf and project c1c1a7b5f02846a5bf0ba619e29b0179. Resources: {'key_pairs'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 21:03:06.419375 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-0c4e63c0-826f-453c-b5e4-e9c8388db4cc tempest-KeyPairsV22TestJSON-554313478 tempest-KeyPairsV22TestJSON-554313478-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 201 len: 589 microversion: 2.2 time: 0.053052 Oct 22 21:03:06.425680 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1556/2995] 10.222.0.18 () {62 vars in 1199 bytes} [Sat Oct 22 21:03:06 2022] POST /compute/v2.1/os-keypairs => generated 589 bytes in 58 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 22 21:03:06.432607 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-f034ef57-9a03-4639-a069-490e6b9b13f9 tempest-KeyPairsV22TestJSON-554313478 tempest-KeyPairsV22TestJSON-554313478-project] Calling method '.version_select at 0x7fd3a8ba5dc0>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:03:06.457454 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-f034ef57-9a03-4639-a069-490e6b9b13f9 tempest-KeyPairsV22TestJSON-554313478 tempest-KeyPairsV22TestJSON-554313478-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1827509806" status: 204 len: 0 microversion: 2.2 time: 0.030216 Oct 22 21:03:06.458058 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1440/2996] 10.222.0.18 () {60 vars in 1261 bytes} [Sat Oct 22 21:03:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1827509806 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 21:03:06.470339 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-60e0cbc0-9fa7-4b23-b2d8-6a2b12a9974e tempest-KeyPairsV22TestJSON-554313478 tempest-KeyPairsV22TestJSON-554313478-project] Action: 'create', calling method: .version_select at 0x7fd39efaedc0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1269485289", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMkrCP8bMKyEZUOawW08LuEhkY1DPoFaRpcBYIXz26Rmn4sVTfo2+LO7KopZI7nIe2Zcbnvy53YwKGaN9c6/xb0F/u90tx1UR9wrdovKsKPC3thqQi6T7XcfSGPZ4WnIwA=="}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:03:06.488289 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-60e0cbc0-9fa7-4b23-b2d8-6a2b12a9974e tempest-KeyPairsV22TestJSON-554313478 tempest-KeyPairsV22TestJSON-554313478-project] Getting quotas for project c1c1a7b5f02846a5bf0ba619e29b0179. Resources: {'key_pairs'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 21:03:06.494714 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-198d2f5e-4047-480f-9569-386af39ba1c9 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:03:06.495327 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-198d2f5e-4047-480f-9569-386af39ba1c9 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] [instance: 2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:03:06.495581 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-60e0cbc0-9fa7-4b23-b2d8-6a2b12a9974e tempest-KeyPairsV22TestJSON-554313478 tempest-KeyPairsV22TestJSON-554313478-project] Getting quotas for user 298584f950924847986de298357627bf and project c1c1a7b5f02846a5bf0ba619e29b0179. Resources: {'key_pairs'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 21:03:06.505109 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-198d2f5e-4047-480f-9569-386af39ba1c9 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:03:06.505685 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-198d2f5e-4047-480f-9569-386af39ba1c9 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:03:06.506198 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-198d2f5e-4047-480f-9569-386af39ba1c9 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:03:06.507086 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-198d2f5e-4047-480f-9569-386af39ba1c9 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:03:06.507594 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-198d2f5e-4047-480f-9569-386af39ba1c9 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:03:06.508473 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-198d2f5e-4047-480f-9569-386af39ba1c9 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:03:06.526125 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-60e0cbc0-9fa7-4b23-b2d8-6a2b12a9974e tempest-KeyPairsV22TestJSON-554313478 tempest-KeyPairsV22TestJSON-554313478-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.059745 Oct 22 21:03:06.526969 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1557/2997] 10.222.0.18 () {62 vars in 1199 bytes} [Sat Oct 22 21:03:06 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 61 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 22 21:03:06.533209 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:SELECT=100 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:03:06.542291 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-eb8aa06c-d3af-4209-b8f7-df3c71e66a9e tempest-KeyPairsV22TestJSON-554313478 tempest-KeyPairsV22TestJSON-554313478-project] Action: 'create', calling method: .version_select at 0x7fd39ef6f280>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-322594533", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCDlv52uC/IJ7+fnLuzT/D1bjCxkV/G0OMzIl5OOJ3mqeP4RaMyvQqASINVvtrhD34MsHA/E9sT0dTvsN9hoEgWCFdzDadZ10V1PhTWjTgTAdl21nHU/NN/+NnLErZYPqQ=="}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:03:06.567138 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-eb8aa06c-d3af-4209-b8f7-df3c71e66a9e tempest-KeyPairsV22TestJSON-554313478 tempest-KeyPairsV22TestJSON-554313478-project] Getting quotas for project c1c1a7b5f02846a5bf0ba619e29b0179. Resources: {'key_pairs'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 21:03:06.573463 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-eb8aa06c-d3af-4209-b8f7-df3c71e66a9e tempest-KeyPairsV22TestJSON-554313478 tempest-KeyPairsV22TestJSON-554313478-project] Getting quotas for user 298584f950924847986de298357627bf and project c1c1a7b5f02846a5bf0ba619e29b0179. Resources: {'key_pairs'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 21:03:06.576289 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:03:06.582854 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-198d2f5e-4047-480f-9569-386af39ba1c9 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:03:06.592364 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-198d2f5e-4047-480f-9569-386af39ba1c9 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:03:06.594051 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-198d2f5e-4047-480f-9569-386af39ba1c9 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:03:06.600244 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-198d2f5e-4047-480f-9569-386af39ba1c9 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] 10.222.0.18 "GET /compute/v2.1/servers/2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac" status: 200 len: 1539 microversion: 2.91 time: 0.112015 Oct 22 21:03:06.615367 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1441/2998] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:03:06 2022] GET /compute/v2.1/servers/2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac => generated 1539 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:03:06.615562 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-eb8aa06c-d3af-4209-b8f7-df3c71e66a9e tempest-KeyPairsV22TestJSON-554313478 tempest-KeyPairsV22TestJSON-554313478-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.070870 Oct 22 21:03:06.615562 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1558/2999] 10.222.0.18 () {62 vars in 1199 bytes} [Sat Oct 22 21:03:06 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 73 msecs (HTTP/1.1 201) 9 headers in 362 bytes (2 switches on core 0) Oct 22 21:03:06.616070 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-3609447a-6ff8-4f6d-bd3f-27926faded0b tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:03:06.616799 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-3609447a-6ff8-4f6d-bd3f-27926faded0b tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] [instance: 4850d7fd-598e-4c80-8388-bd124c104ef3] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:03:06.626387 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-fdb43a9a-e1e9-4456-88fb-a773be2e9834 tempest-KeyPairsV22TestJSON-554313478 tempest-KeyPairsV22TestJSON-554313478-project] Action: 'create', calling method: .version_select at 0x7fd39ef024c0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-575379856", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEaA3aBnnFBf/tpxUAzAJd5EGeWSUh0syj6XGSdfzAaSZBVOL/YPrPPB5eatZnPXpo4iPDtSI9y4H7aqgzkS7Sg0XKf4+dbmYWHN0ReD9PG7hSf2NxaFYQtLBm3aelQTvA=="}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:03:06.635694 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3609447a-6ff8-4f6d-bd3f-27926faded0b tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:03:06.636211 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3609447a-6ff8-4f6d-bd3f-27926faded0b tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:03:06.636656 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3609447a-6ff8-4f6d-bd3f-27926faded0b tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:03:06.637663 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3609447a-6ff8-4f6d-bd3f-27926faded0b tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:03:06.638303 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3609447a-6ff8-4f6d-bd3f-27926faded0b tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:03:06.638746 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3609447a-6ff8-4f6d-bd3f-27926faded0b tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:03:06.649216 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-fdb43a9a-e1e9-4456-88fb-a773be2e9834 tempest-KeyPairsV22TestJSON-554313478 tempest-KeyPairsV22TestJSON-554313478-project] Getting quotas for project c1c1a7b5f02846a5bf0ba619e29b0179. Resources: {'key_pairs'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 21:03:06.654419 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-fdb43a9a-e1e9-4456-88fb-a773be2e9834 tempest-KeyPairsV22TestJSON-554313478 tempest-KeyPairsV22TestJSON-554313478-project] Getting quotas for user 298584f950924847986de298357627bf and project c1c1a7b5f02846a5bf0ba619e29b0179. Resources: {'key_pairs'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 21:03:06.682203 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-fdb43a9a-e1e9-4456-88fb-a773be2e9834 tempest-KeyPairsV22TestJSON-554313478 tempest-KeyPairsV22TestJSON-554313478-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.061399 Oct 22 21:03:06.683222 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1559/3000] 10.222.0.18 () {62 vars in 1199 bytes} [Sat Oct 22 21:03:06 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 63 msecs (HTTP/1.1 201) 9 headers in 362 bytes (2 switches on core 0) Oct 22 21:03:06.694632 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-01038397-cc25-4c79-8faa-951a1c9510b1 tempest-KeyPairsV22TestJSON-554313478 tempest-KeyPairsV22TestJSON-554313478-project] Calling method '.version_select at 0x7fd39ef6f160>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:03:06.699833 ncdv-master-1 devstack@n-api.service[138745]: WARNING oslo_db.sqlalchemy.utils [None req-01038397-cc25-4c79-8faa-951a1c9510b1 tempest-KeyPairsV22TestJSON-554313478 tempest-KeyPairsV22TestJSON-554313478-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 22 21:03:06.706341 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-01038397-cc25-4c79-8faa-951a1c9510b1 tempest-KeyPairsV22TestJSON-554313478 tempest-KeyPairsV22TestJSON-554313478-project] 10.222.0.18 "GET /compute/v2.1/os-keypairs" status: 200 len: 1140 microversion: 2.2 time: 0.015683 Oct 22 21:03:06.707468 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1560/3001] 10.222.0.18 () {60 vars in 1177 bytes} [Sat Oct 22 21:03:06 2022] GET /compute/v2.1/os-keypairs => generated 1140 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:03:06.719452 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-b84ae26f-cfce-45fc-a4a0-257871568d0a tempest-KeyPairsV22TestJSON-554313478 tempest-KeyPairsV22TestJSON-554313478-project] Calling method '.version_select at 0x7fd39efc4310>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:03:06.748507 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-b84ae26f-cfce-45fc-a4a0-257871568d0a tempest-KeyPairsV22TestJSON-554313478 tempest-KeyPairsV22TestJSON-554313478-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-575379856" status: 204 len: 0 microversion: 2.2 time: 0.034197 Oct 22 21:03:06.749952 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1561/3002] 10.222.0.18 () {60 vars in 1318 bytes} [Sat Oct 22 21:03:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-575379856 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 22 21:03:06.759134 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-d674dcdf-4f0a-4636-9879-ac4884f211dd tempest-KeyPairsV22TestJSON-554313478 tempest-KeyPairsV22TestJSON-554313478-project] Calling method '.version_select at 0x7fd39ef665e0>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:03:06.785269 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-d674dcdf-4f0a-4636-9879-ac4884f211dd tempest-KeyPairsV22TestJSON-554313478 tempest-KeyPairsV22TestJSON-554313478-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-322594533" status: 204 len: 0 microversion: 2.2 time: 0.029800 Oct 22 21:03:06.786064 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1562/3003] 10.222.0.18 () {60 vars in 1318 bytes} [Sat Oct 22 21:03:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-322594533 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 22 21:03:06.790461 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-bffd2843-2562-4e66-a0aa-55c3e0bf84a5 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:03:06.791124 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-bffd2843-2562-4e66-a0aa-55c3e0bf84a5 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] [instance: a99614d8-f2f7-4ce1-87e8-47f3af03d9f8] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:03:06.797700 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bffd2843-2562-4e66-a0aa-55c3e0bf84a5 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:03:06.798174 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bffd2843-2562-4e66-a0aa-55c3e0bf84a5 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:03:06.798645 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bffd2843-2562-4e66-a0aa-55c3e0bf84a5 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:03:06.799376 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bffd2843-2562-4e66-a0aa-55c3e0bf84a5 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:03:06.799805 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-3609447a-6ff8-4f6d-bd3f-27926faded0b tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3adb02392d074b7eb08c94bbf1904547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dfacd9c525f486eaa04d19dbe2dc423', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:03:06.799977 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bffd2843-2562-4e66-a0aa-55c3e0bf84a5 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:03:06.800263 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bffd2843-2562-4e66-a0aa-55c3e0bf84a5 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:03:06.808508 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-3609447a-6ff8-4f6d-bd3f-27926faded0b tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] 10.222.0.18 "GET /compute/v2.1/servers/4850d7fd-598e-4c80-8388-bd124c104ef3" status: 200 len: 1311 microversion: 2.1 time: 0.196311 Oct 22 21:03:06.809100 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1442/3004] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:03:06 2022] GET /compute/v2.1/servers/4850d7fd-598e-4c80-8388-bd124c104ef3 => generated 1311 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:03:06.813895 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-48c954e0-10ea-438f-bba6-69cba91d1740 tempest-KeyPairsV22TestJSON-554313478 tempest-KeyPairsV22TestJSON-554313478-project] Calling method '.version_select at 0x7fd3a89e4820>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:03:06.835584 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-48c954e0-10ea-438f-bba6-69cba91d1740 tempest-KeyPairsV22TestJSON-554313478 tempest-KeyPairsV22TestJSON-554313478-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1269485289" status: 204 len: 0 microversion: 2.2 time: 0.025172 Oct 22 21:03:06.839678 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1443/3005] 10.222.0.18 () {60 vars in 1321 bytes} [Sat Oct 22 21:03:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1269485289 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 21:03:06.848943 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-911b1ceb-afe6-42cc-a0b8-9e63602ac806 tempest-KeyPairsV22TestJSON-554313478 tempest-KeyPairsV22TestJSON-554313478-project] Action: 'create', calling method: .version_select at 0x7fd3a43b90d0>, body: {"keypair": {"name": "tempest-keypair-320608238", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD2wA5uPjr6rT+HqM0PSi+mQFpAPH9hTkc8/xr9fyPvKCPnw0ZwxircWe+tOkfaxIJonW4dU+gNEfA4/1h00JCsSwAPGFRarCirbe3vheBVSMFX251NUaMKzYdBf5ruAbg=="}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:03:06.868140 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-911b1ceb-afe6-42cc-a0b8-9e63602ac806 tempest-KeyPairsV22TestJSON-554313478 tempest-KeyPairsV22TestJSON-554313478-project] Getting quotas for project c1c1a7b5f02846a5bf0ba619e29b0179. Resources: {'key_pairs'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 21:03:06.885476 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-911b1ceb-afe6-42cc-a0b8-9e63602ac806 tempest-KeyPairsV22TestJSON-554313478 tempest-KeyPairsV22TestJSON-554313478-project] Getting quotas for user 298584f950924847986de298357627bf and project c1c1a7b5f02846a5bf0ba619e29b0179. Resources: {'key_pairs'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 21:03:06.918802 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-911b1ceb-afe6-42cc-a0b8-9e63602ac806 tempest-KeyPairsV22TestJSON-554313478 tempest-KeyPairsV22TestJSON-554313478-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.074219 Oct 22 21:03:06.919434 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1444/3006] 10.222.0.18 () {62 vars in 1199 bytes} [Sat Oct 22 21:03:06 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 76 msecs (HTTP/1.1 201) 9 headers in 362 bytes (2 switches on core 0) Oct 22 21:03:06.933027 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-5911f788-0cbc-434d-bea5-19e956c5b414 tempest-KeyPairsV22TestJSON-554313478 tempest-KeyPairsV22TestJSON-554313478-project] Calling method '.version_select at 0x7fd3a41e34c0>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:03:06.942573 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-5911f788-0cbc-434d-bea5-19e956c5b414 tempest-KeyPairsV22TestJSON-554313478 tempest-KeyPairsV22TestJSON-554313478-project] 10.222.0.18 "GET /compute/v2.1/os-keypairs/tempest-keypair-320608238" status: 200 len: 512 microversion: 2.2 time: 0.014930 Oct 22 21:03:06.942753 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1445/3007] 10.222.0.18 () {60 vars in 1255 bytes} [Sat Oct 22 21:03:06 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-320608238 => generated 512 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 21:03:06.956139 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-5bc6112a-e607-4408-ace9-e569026671fa tempest-KeyPairsV22TestJSON-554313478 tempest-KeyPairsV22TestJSON-554313478-project] Calling method '.version_select at 0x7fd3a8ba5940>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:03:06.962964 ncdv-master-1 devstack@n-api.service[138744]: WARNING oslo_db.sqlalchemy.utils [None req-5bc6112a-e607-4408-ace9-e569026671fa tempest-KeyPairsV22TestJSON-554313478 tempest-KeyPairsV22TestJSON-554313478-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 22 21:03:06.969404 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-5bc6112a-e607-4408-ace9-e569026671fa tempest-KeyPairsV22TestJSON-554313478 tempest-KeyPairsV22TestJSON-554313478-project] 10.222.0.18 "GET /compute/v2.1/os-keypairs" status: 200 len: 369 microversion: 2.2 time: 0.018635 Oct 22 21:03:06.969979 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1446/3008] 10.222.0.18 () {60 vars in 1177 bytes} [Sat Oct 22 21:03:06 2022] GET /compute/v2.1/os-keypairs => generated 369 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 21:03:06.979321 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-bffd2843-2562-4e66-a0aa-55c3e0bf84a5 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1b410a64e0415a96d30f5040361137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd7873d6db4e09bc9ab9a048a6b1ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:03:06.982475 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-9d603780-5b42-42f4-b175-157054120cc2 tempest-KeyPairsV22TestJSON-554313478 tempest-KeyPairsV22TestJSON-554313478-project] Calling method '.version_select at 0x7fd3a43b9820>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:03:06.987744 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-bffd2843-2562-4e66-a0aa-55c3e0bf84a5 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] 10.222.0.18 "GET /compute/v2.1/servers/a99614d8-f2f7-4ce1-87e8-47f3af03d9f8" status: 200 len: 1509 microversion: 2.1 time: 0.201023 Oct 22 21:03:06.988325 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1563/3009] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:03:06 2022] GET /compute/v2.1/servers/a99614d8-f2f7-4ce1-87e8-47f3af03d9f8 => generated 1509 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:03:07.010360 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-9d603780-5b42-42f4-b175-157054120cc2 tempest-KeyPairsV22TestJSON-554313478 tempest-KeyPairsV22TestJSON-554313478-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-320608238" status: 204 len: 0 microversion: 2.2 time: 0.032437 Oct 22 21:03:07.010948 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1447/3010] 10.222.0.18 () {60 vars in 1258 bytes} [Sat Oct 22 21:03:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-320608238 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 21:03:07.020669 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-d086ab15-9645-42b6-84db-4148a562e905 tempest-KeyPairsV22TestJSON-554313478 tempest-KeyPairsV22TestJSON-554313478-project] Action: 'create', calling method: .version_select at 0x7fd39ef67310>, body: {"keypair": {"name": "tempest-keypair-581919125", "type": "x509"}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:03:07.036570 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-d086ab15-9645-42b6-84db-4148a562e905 tempest-KeyPairsV22TestJSON-554313478 tempest-KeyPairsV22TestJSON-554313478-project] Getting quotas for project c1c1a7b5f02846a5bf0ba619e29b0179. Resources: {'key_pairs'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 21:03:07.042236 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-d086ab15-9645-42b6-84db-4148a562e905 tempest-KeyPairsV22TestJSON-554313478 tempest-KeyPairsV22TestJSON-554313478-project] Getting quotas for user 298584f950924847986de298357627bf and project c1c1a7b5f02846a5bf0ba619e29b0179. Resources: {'key_pairs'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 21:03:07.061583 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.processutils [None req-d086ab15-9645-42b6-84db-4148a562e905 tempest-KeyPairsV22TestJSON-554313478 tempest-KeyPairsV22TestJSON-554313478-project] Running cmd (subprocess): openssl req -x509 -nodes -days 3650 -config /tmp/tmp6_fk1vsr/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmp6_fk1vsr/temp.key -subj /CN=298584f950924847986de298357627bf -extensions v3_req_client {{(pid=138745) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Oct 22 21:03:07.327737 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-52ed30c2-2bc4-4cb7-9d03-76a6fb630b45 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:03:07.328489 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-52ed30c2-2bc4-4cb7-9d03-76a6fb630b45 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] [instance: 524c2c11-4a65-4360-93e4-e25349cb6416] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:03:07.335561 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-52ed30c2-2bc4-4cb7-9d03-76a6fb630b45 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:03:07.336264 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-52ed30c2-2bc4-4cb7-9d03-76a6fb630b45 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:03:07.337138 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-52ed30c2-2bc4-4cb7-9d03-76a6fb630b45 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:03:07.338680 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-52ed30c2-2bc4-4cb7-9d03-76a6fb630b45 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:03:07.339459 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-52ed30c2-2bc4-4cb7-9d03-76a6fb630b45 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:03:07.340045 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-52ed30c2-2bc4-4cb7-9d03-76a6fb630b45 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:03:07.449173 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.processutils [None req-d086ab15-9645-42b6-84db-4148a562e905 tempest-KeyPairsV22TestJSON-554313478 tempest-KeyPairsV22TestJSON-554313478-project] CMD "openssl req -x509 -nodes -days 3650 -config /tmp/tmp6_fk1vsr/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmp6_fk1vsr/temp.key -subj /CN=298584f950924847986de298357627bf -extensions v3_req_client" returned: 0 in 0.387s {{(pid=138745) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Oct 22 21:03:07.451317 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.processutils [None req-d086ab15-9645-42b6-84db-4148a562e905 tempest-KeyPairsV22TestJSON-554313478 tempest-KeyPairsV22TestJSON-554313478-project] Running cmd (subprocess): openssl pkcs12 -export -inkey /tmp/tmp6_fk1vsr/temp.key -password pass: {{(pid=138745) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Oct 22 21:03:07.488522 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.processutils [None req-d086ab15-9645-42b6-84db-4148a562e905 tempest-KeyPairsV22TestJSON-554313478 tempest-KeyPairsV22TestJSON-554313478-project] CMD "openssl pkcs12 -export -inkey /tmp/tmp6_fk1vsr/temp.key -password pass:" returned: 0 in 0.036s {{(pid=138745) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Oct 22 21:03:07.509221 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-52ed30c2-2bc4-4cb7-9d03-76a6fb630b45 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a44ff8e7c14b94b1670f030085c43d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a26a2284f4424cbeaf63d504652546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:03:07.519603 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-52ed30c2-2bc4-4cb7-9d03-76a6fb630b45 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] 10.222.0.18 "GET /compute/v2.1/servers/524c2c11-4a65-4360-93e4-e25349cb6416" status: 200 len: 1307 microversion: 2.1 time: 0.195847 Oct 22 21:03:07.520947 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1448/3011] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:03:07 2022] GET /compute/v2.1/servers/524c2c11-4a65-4360-93e4-e25349cb6416 => generated 1307 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:03:07.551493 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-d086ab15-9645-42b6-84db-4148a562e905 tempest-KeyPairsV22TestJSON-554313478 tempest-KeyPairsV22TestJSON-554313478-project] Getting quotas for project c1c1a7b5f02846a5bf0ba619e29b0179. Resources: {'key_pairs'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 21:03:07.557493 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-d086ab15-9645-42b6-84db-4148a562e905 tempest-KeyPairsV22TestJSON-554313478 tempest-KeyPairsV22TestJSON-554313478-project] Getting quotas for user 298584f950924847986de298357627bf and project c1c1a7b5f02846a5bf0ba619e29b0179. Resources: {'key_pairs'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 21:03:07.575452 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-d086ab15-9645-42b6-84db-4148a562e905 tempest-KeyPairsV22TestJSON-554313478 tempest-KeyPairsV22TestJSON-554313478-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 201 len: 4692 microversion: 2.2 time: 0.558573 Oct 22 21:03:07.582154 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1564/3012] 10.222.0.18 () {62 vars in 1198 bytes} [Sat Oct 22 21:03:07 2022] POST /compute/v2.1/os-keypairs => generated 4692 bytes in 566 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Oct 22 21:03:07.587120 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-f3adce5b-3a03-40e8-bd29-1265b8b87c92 tempest-KeyPairsV22TestJSON-554313478 tempest-KeyPairsV22TestJSON-554313478-project] Calling method '.version_select at 0x7fd3a43443a0>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:03:07.596618 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-f3adce5b-3a03-40e8-bd29-1265b8b87c92 tempest-KeyPairsV22TestJSON-554313478 tempest-KeyPairsV22TestJSON-554313478-project] 10.222.0.18 "GET /compute/v2.1/os-keypairs/tempest-keypair-581919125" status: 200 len: 1533 microversion: 2.2 time: 0.013700 Oct 22 21:03:07.597103 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1449/3013] 10.222.0.18 () {60 vars in 1255 bytes} [Sat Oct 22 21:03:07 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-581919125 => generated 1533 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:03:07.610586 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-891bd871-0603-4873-a8c4-c41eabcde704 tempest-KeyPairsV22TestJSON-554313478 tempest-KeyPairsV22TestJSON-554313478-project] Calling method '.version_select at 0x7fd39ef66040>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:03:07.614973 ncdv-master-1 devstack@n-api.service[138745]: WARNING oslo_db.sqlalchemy.utils [None req-891bd871-0603-4873-a8c4-c41eabcde704 tempest-KeyPairsV22TestJSON-554313478 tempest-KeyPairsV22TestJSON-554313478-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 22 21:03:07.620648 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-891bd871-0603-4873-a8c4-c41eabcde704 tempest-KeyPairsV22TestJSON-554313478 tempest-KeyPairsV22TestJSON-554313478-project] 10.222.0.18 "GET /compute/v2.1/os-keypairs" status: 200 len: 1390 microversion: 2.2 time: 0.015059 Oct 22 21:03:07.621230 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1565/3014] 10.222.0.18 () {60 vars in 1177 bytes} [Sat Oct 22 21:03:07 2022] GET /compute/v2.1/os-keypairs => generated 1390 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:03:07.632050 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-0029b6d7-e670-44b0-a10f-3d34e39ce57e tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:03:07.632926 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-0029b6d7-e670-44b0-a10f-3d34e39ce57e tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] [instance: 2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:03:07.635324 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-a52e5acc-589e-466f-b6bf-63e2b64251d3 tempest-KeyPairsV22TestJSON-554313478 tempest-KeyPairsV22TestJSON-554313478-project] Calling method '.version_select at 0x7fd39ef67430>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:03:07.647456 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0029b6d7-e670-44b0-a10f-3d34e39ce57e tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:03:07.648318 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0029b6d7-e670-44b0-a10f-3d34e39ce57e tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:03:07.650242 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0029b6d7-e670-44b0-a10f-3d34e39ce57e tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:03:07.651847 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0029b6d7-e670-44b0-a10f-3d34e39ce57e tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:03:07.654759 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0029b6d7-e670-44b0-a10f-3d34e39ce57e tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:03:07.655279 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0029b6d7-e670-44b0-a10f-3d34e39ce57e tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:03:07.663071 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-a52e5acc-589e-466f-b6bf-63e2b64251d3 tempest-KeyPairsV22TestJSON-554313478 tempest-KeyPairsV22TestJSON-554313478-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-581919125" status: 204 len: 0 microversion: 2.2 time: 0.032588 Oct 22 21:03:07.664330 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1566/3015] 10.222.0.18 () {60 vars in 1258 bytes} [Sat Oct 22 21:03:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-581919125 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 21:03:07.731700 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-0029b6d7-e670-44b0-a10f-3d34e39ce57e tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:03:07.740888 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-0029b6d7-e670-44b0-a10f-3d34e39ce57e tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:03:07.742789 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-0029b6d7-e670-44b0-a10f-3d34e39ce57e tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:03:07.748680 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-0029b6d7-e670-44b0-a10f-3d34e39ce57e tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] 10.222.0.18 "GET /compute/v2.1/servers/2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac" status: 200 len: 1539 microversion: 2.91 time: 0.122460 Oct 22 21:03:07.762919 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1450/3016] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:03:07 2022] GET /compute/v2.1/servers/2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac => generated 1539 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 22 21:03:07.831537 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-524e8653-bd80-4459-8dd2-da7e4163c86d tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:03:07.832245 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-524e8653-bd80-4459-8dd2-da7e4163c86d tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] [instance: 4850d7fd-598e-4c80-8388-bd124c104ef3] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:03:07.849029 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-524e8653-bd80-4459-8dd2-da7e4163c86d tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:03:07.850014 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-524e8653-bd80-4459-8dd2-da7e4163c86d tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:03:07.851324 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-524e8653-bd80-4459-8dd2-da7e4163c86d tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:03:07.852496 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-524e8653-bd80-4459-8dd2-da7e4163c86d tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:03:07.853375 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-524e8653-bd80-4459-8dd2-da7e4163c86d tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:03:07.853972 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-524e8653-bd80-4459-8dd2-da7e4163c86d tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:03:08.011446 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-9f62a8cd-2bf4-4809-99e4-c7c2bdf78d99 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:03:08.012078 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-9f62a8cd-2bf4-4809-99e4-c7c2bdf78d99 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] [instance: a99614d8-f2f7-4ce1-87e8-47f3af03d9f8] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:03:08.026276 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9f62a8cd-2bf4-4809-99e4-c7c2bdf78d99 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:03:08.026978 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9f62a8cd-2bf4-4809-99e4-c7c2bdf78d99 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:03:08.027826 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9f62a8cd-2bf4-4809-99e4-c7c2bdf78d99 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:03:08.028716 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9f62a8cd-2bf4-4809-99e4-c7c2bdf78d99 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:03:08.029314 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9f62a8cd-2bf4-4809-99e4-c7c2bdf78d99 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:03:08.030162 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9f62a8cd-2bf4-4809-99e4-c7c2bdf78d99 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:03:08.059569 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-524e8653-bd80-4459-8dd2-da7e4163c86d tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3adb02392d074b7eb08c94bbf1904547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dfacd9c525f486eaa04d19dbe2dc423', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:03:08.070882 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-524e8653-bd80-4459-8dd2-da7e4163c86d tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] 10.222.0.18 "GET /compute/v2.1/servers/4850d7fd-598e-4c80-8388-bd124c104ef3" status: 200 len: 1311 microversion: 2.1 time: 0.243320 Oct 22 21:03:08.078511 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1567/3017] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:03:07 2022] GET /compute/v2.1/servers/4850d7fd-598e-4c80-8388-bd124c104ef3 => generated 1311 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:03:08.101590 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-99c43afa-bf1d-472c-b27c-24e68d9739bd req-5df3c9ad-8c23-4044-bdc2-291b149b8247 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4850d7fd-598e-4c80-8388-bd124c104ef3", "name": "network-vif-plugged", "status": "completed", "tag": "b5dcf1be-5514-4e11-8fd2-2f7f68001e19"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:03:08.124149 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-99c43afa-bf1d-472c-b27c-24e68d9739bd req-5df3c9ad-8c23-4044-bdc2-291b149b8247 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:03:08.124149 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-99c43afa-bf1d-472c-b27c-24e68d9739bd req-5df3c9ad-8c23-4044-bdc2-291b149b8247 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:03:08.124149 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-99c43afa-bf1d-472c-b27c-24e68d9739bd req-5df3c9ad-8c23-4044-bdc2-291b149b8247 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:03:08.153152 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-99c43afa-bf1d-472c-b27c-24e68d9739bd req-5df3c9ad-8c23-4044-bdc2-291b149b8247 service nova] Creating event network-vif-plugged:b5dcf1be-5514-4e11-8fd2-2f7f68001e19 for instance 4850d7fd-598e-4c80-8388-bd124c104ef3 on nch2-master-1 Oct 22 21:03:08.162570 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-99c43afa-bf1d-472c-b27c-24e68d9739bd req-5df3c9ad-8c23-4044-bdc2-291b149b8247 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070408 Oct 22 21:03:08.163994 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1568/3018] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:03:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:03:08.291296 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-9f62a8cd-2bf4-4809-99e4-c7c2bdf78d99 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1b410a64e0415a96d30f5040361137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd7873d6db4e09bc9ab9a048a6b1ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:03:08.306205 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-9f62a8cd-2bf4-4809-99e4-c7c2bdf78d99 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] 10.222.0.18 "GET /compute/v2.1/servers/a99614d8-f2f7-4ce1-87e8-47f3af03d9f8" status: 200 len: 1509 microversion: 2.1 time: 0.296904 Oct 22 21:03:08.307253 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1451/3019] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:03:08 2022] GET /compute/v2.1/servers/a99614d8-f2f7-4ce1-87e8-47f3af03d9f8 => generated 1509 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:03:08.546264 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-b3e2248f-1cf7-4e2b-b2cf-e10f3f3585c7 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:03:08.547754 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-b3e2248f-1cf7-4e2b-b2cf-e10f3f3585c7 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] [instance: 524c2c11-4a65-4360-93e4-e25349cb6416] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:03:08.556582 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b3e2248f-1cf7-4e2b-b2cf-e10f3f3585c7 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:03:08.557373 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b3e2248f-1cf7-4e2b-b2cf-e10f3f3585c7 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:03:08.558017 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b3e2248f-1cf7-4e2b-b2cf-e10f3f3585c7 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:03:08.558955 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b3e2248f-1cf7-4e2b-b2cf-e10f3f3585c7 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:03:08.559692 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b3e2248f-1cf7-4e2b-b2cf-e10f3f3585c7 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:03:08.560347 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b3e2248f-1cf7-4e2b-b2cf-e10f3f3585c7 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:03:08.736490 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-b3e2248f-1cf7-4e2b-b2cf-e10f3f3585c7 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a44ff8e7c14b94b1670f030085c43d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a26a2284f4424cbeaf63d504652546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:03:08.744378 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-b3e2248f-1cf7-4e2b-b2cf-e10f3f3585c7 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] 10.222.0.18 "GET /compute/v2.1/servers/524c2c11-4a65-4360-93e4-e25349cb6416" status: 200 len: 1307 microversion: 2.1 time: 0.203817 Oct 22 21:03:08.748238 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1569/3020] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:03:08 2022] GET /compute/v2.1/servers/524c2c11-4a65-4360-93e4-e25349cb6416 => generated 1307 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:03:08.779030 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-046b5e26-8d80-48a1-95df-82b598084a0a tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:03:08.779863 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-046b5e26-8d80-48a1-95df-82b598084a0a tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] [instance: 2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:03:08.789357 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-046b5e26-8d80-48a1-95df-82b598084a0a tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:03:08.790223 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-046b5e26-8d80-48a1-95df-82b598084a0a tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:03:08.790887 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-046b5e26-8d80-48a1-95df-82b598084a0a tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:03:08.791972 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-046b5e26-8d80-48a1-95df-82b598084a0a tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:03:08.792653 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-046b5e26-8d80-48a1-95df-82b598084a0a tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:03:08.793277 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-046b5e26-8d80-48a1-95df-82b598084a0a tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:03:08.878335 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-046b5e26-8d80-48a1-95df-82b598084a0a tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:03:08.890897 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-046b5e26-8d80-48a1-95df-82b598084a0a tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:03:08.892952 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-046b5e26-8d80-48a1-95df-82b598084a0a tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:03:08.902541 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-046b5e26-8d80-48a1-95df-82b598084a0a tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] 10.222.0.18 "GET /compute/v2.1/servers/2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac" status: 200 len: 1539 microversion: 2.91 time: 0.129430 Oct 22 21:03:08.903859 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1452/3021] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:03:08 2022] GET /compute/v2.1/servers/2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac => generated 1539 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:03:09.104445 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-9da20a1f-d06e-4b63-92cd-bc585d87de30 tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:03:09.105813 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-9da20a1f-d06e-4b63-92cd-bc585d87de30 tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] [instance: 4850d7fd-598e-4c80-8388-bd124c104ef3] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:03:09.127953 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9da20a1f-d06e-4b63-92cd-bc585d87de30 tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:03:09.128666 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9da20a1f-d06e-4b63-92cd-bc585d87de30 tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:03:09.129371 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9da20a1f-d06e-4b63-92cd-bc585d87de30 tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:03:09.142144 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9da20a1f-d06e-4b63-92cd-bc585d87de30 tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:03:09.142685 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9da20a1f-d06e-4b63-92cd-bc585d87de30 tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:03:09.143181 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9da20a1f-d06e-4b63-92cd-bc585d87de30 tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:03:09.309970 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-9da20a1f-d06e-4b63-92cd-bc585d87de30 tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3adb02392d074b7eb08c94bbf1904547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dfacd9c525f486eaa04d19dbe2dc423', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:03:09.320590 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-9da20a1f-d06e-4b63-92cd-bc585d87de30 tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] 10.222.0.18 "GET /compute/v2.1/servers/4850d7fd-598e-4c80-8388-bd124c104ef3" status: 200 len: 1311 microversion: 2.1 time: 0.223252 Oct 22 21:03:09.322435 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1570/3022] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:03:09 2022] GET /compute/v2.1/servers/4850d7fd-598e-4c80-8388-bd124c104ef3 => generated 1311 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:03:09.333392 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-871fbdef-ac76-4921-b021-b821faf5ec4f tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:03:09.334048 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-871fbdef-ac76-4921-b021-b821faf5ec4f tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] [instance: a99614d8-f2f7-4ce1-87e8-47f3af03d9f8] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:03:09.341738 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-871fbdef-ac76-4921-b021-b821faf5ec4f tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:03:09.342528 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-871fbdef-ac76-4921-b021-b821faf5ec4f tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:03:09.343260 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-871fbdef-ac76-4921-b021-b821faf5ec4f tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:03:09.344117 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-871fbdef-ac76-4921-b021-b821faf5ec4f tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:03:09.344744 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-871fbdef-ac76-4921-b021-b821faf5ec4f tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:03:09.345299 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-871fbdef-ac76-4921-b021-b821faf5ec4f tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:03:09.531030 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-871fbdef-ac76-4921-b021-b821faf5ec4f tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1b410a64e0415a96d30f5040361137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd7873d6db4e09bc9ab9a048a6b1ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:03:09.544088 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-871fbdef-ac76-4921-b021-b821faf5ec4f tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] 10.222.0.18 "GET /compute/v2.1/servers/a99614d8-f2f7-4ce1-87e8-47f3af03d9f8" status: 200 len: 1509 microversion: 2.1 time: 0.214708 Oct 22 21:03:09.546523 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1453/3023] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:03:09 2022] GET /compute/v2.1/servers/a99614d8-f2f7-4ce1-87e8-47f3af03d9f8 => generated 1509 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:03:09.767118 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-843292b0-453b-4896-81d1-8a14e7d6cb32 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:03:09.773115 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-843292b0-453b-4896-81d1-8a14e7d6cb32 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] [instance: 524c2c11-4a65-4360-93e4-e25349cb6416] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:03:09.785520 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-843292b0-453b-4896-81d1-8a14e7d6cb32 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:03:09.786302 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-843292b0-453b-4896-81d1-8a14e7d6cb32 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:03:09.786919 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-843292b0-453b-4896-81d1-8a14e7d6cb32 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:03:09.787856 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-843292b0-453b-4896-81d1-8a14e7d6cb32 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:03:09.788759 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-843292b0-453b-4896-81d1-8a14e7d6cb32 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:03:09.789911 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-843292b0-453b-4896-81d1-8a14e7d6cb32 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:03:09.934068 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-27cb40ea-b1b4-4463-a058-cd4d868b6080 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:03:09.934068 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-27cb40ea-b1b4-4463-a058-cd4d868b6080 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] [instance: 2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:03:09.944500 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-27cb40ea-b1b4-4463-a058-cd4d868b6080 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:03:09.944996 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-27cb40ea-b1b4-4463-a058-cd4d868b6080 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:03:09.946004 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-27cb40ea-b1b4-4463-a058-cd4d868b6080 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:03:09.947000 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-27cb40ea-b1b4-4463-a058-cd4d868b6080 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:03:09.947657 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-27cb40ea-b1b4-4463-a058-cd4d868b6080 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:03:09.948256 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-27cb40ea-b1b4-4463-a058-cd4d868b6080 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:03:09.966887 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-843292b0-453b-4896-81d1-8a14e7d6cb32 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a44ff8e7c14b94b1670f030085c43d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a26a2284f4424cbeaf63d504652546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:03:09.992634 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-843292b0-453b-4896-81d1-8a14e7d6cb32 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] 10.222.0.18 "GET /compute/v2.1/servers/524c2c11-4a65-4360-93e4-e25349cb6416" status: 200 len: 1307 microversion: 2.1 time: 0.224399 Oct 22 21:03:09.997718 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1571/3024] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:03:09 2022] GET /compute/v2.1/servers/524c2c11-4a65-4360-93e4-e25349cb6416 => generated 1307 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:03:10.050024 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-27cb40ea-b1b4-4463-a058-cd4d868b6080 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:03:10.058589 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-27cb40ea-b1b4-4463-a058-cd4d868b6080 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:03:10.060079 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-27cb40ea-b1b4-4463-a058-cd4d868b6080 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:03:10.065217 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-27cb40ea-b1b4-4463-a058-cd4d868b6080 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] 10.222.0.18 "GET /compute/v2.1/servers/2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac" status: 200 len: 1539 microversion: 2.91 time: 0.137871 Oct 22 21:03:10.074478 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1454/3025] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:03:09 2022] GET /compute/v2.1/servers/2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac => generated 1539 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 22 21:03:10.185512 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-3a056a22-bc42-494d-ad63-9170133d5200 req-60730795-6a0f-4010-b034-f1579c7c29b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "524c2c11-4a65-4360-93e4-e25349cb6416", "name": "network-vif-plugged", "status": "completed", "tag": "7e016b42-09b0-4f7f-9ce3-9e528785b3cd"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:03:10.197015 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-3a056a22-bc42-494d-ad63-9170133d5200 req-60730795-6a0f-4010-b034-f1579c7c29b2 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:03:10.197788 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-3a056a22-bc42-494d-ad63-9170133d5200 req-60730795-6a0f-4010-b034-f1579c7c29b2 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:03:10.198406 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-3a056a22-bc42-494d-ad63-9170133d5200 req-60730795-6a0f-4010-b034-f1579c7c29b2 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:03:10.219279 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-3a056a22-bc42-494d-ad63-9170133d5200 req-60730795-6a0f-4010-b034-f1579c7c29b2 service nova] Creating event network-vif-plugged:7e016b42-09b0-4f7f-9ce3-9e528785b3cd for instance 524c2c11-4a65-4360-93e4-e25349cb6416 on nch2-master-1 Oct 22 21:03:10.225007 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-3a056a22-bc42-494d-ad63-9170133d5200 req-60730795-6a0f-4010-b034-f1579c7c29b2 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043792 Oct 22 21:03:10.226567 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1572/3026] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:03:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:03:10.346498 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-e3860f6a-5da5-427d-8f4a-a666e1e29ab7 tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:03:10.347459 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-e3860f6a-5da5-427d-8f4a-a666e1e29ab7 tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] [instance: 4850d7fd-598e-4c80-8388-bd124c104ef3] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:03:10.356593 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e3860f6a-5da5-427d-8f4a-a666e1e29ab7 tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:03:10.357122 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e3860f6a-5da5-427d-8f4a-a666e1e29ab7 tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:03:10.357550 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e3860f6a-5da5-427d-8f4a-a666e1e29ab7 tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:03:10.364890 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e3860f6a-5da5-427d-8f4a-a666e1e29ab7 tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:03:10.365398 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e3860f6a-5da5-427d-8f4a-a666e1e29ab7 tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:03:10.365851 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e3860f6a-5da5-427d-8f4a-a666e1e29ab7 tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:03:10.579779 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-58044e36-fdc6-4e69-bfbb-81b2983e0978 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:03:10.580736 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-58044e36-fdc6-4e69-bfbb-81b2983e0978 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] [instance: a99614d8-f2f7-4ce1-87e8-47f3af03d9f8] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:03:10.589716 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-58044e36-fdc6-4e69-bfbb-81b2983e0978 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:03:10.590543 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-58044e36-fdc6-4e69-bfbb-81b2983e0978 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:03:10.591188 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-58044e36-fdc6-4e69-bfbb-81b2983e0978 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:03:10.592134 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-58044e36-fdc6-4e69-bfbb-81b2983e0978 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:03:10.593058 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-58044e36-fdc6-4e69-bfbb-81b2983e0978 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:03:10.593657 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-58044e36-fdc6-4e69-bfbb-81b2983e0978 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:03:10.668259 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-e3860f6a-5da5-427d-8f4a-a666e1e29ab7 tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3adb02392d074b7eb08c94bbf1904547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dfacd9c525f486eaa04d19dbe2dc423', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:03:10.680852 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-e3860f6a-5da5-427d-8f4a-a666e1e29ab7 tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] 10.222.0.18 "GET /compute/v2.1/servers/4850d7fd-598e-4c80-8388-bd124c104ef3" status: 200 len: 1496 microversion: 2.1 time: 0.338167 Oct 22 21:03:10.687559 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1455/3027] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:03:10 2022] GET /compute/v2.1/servers/4850d7fd-598e-4c80-8388-bd124c104ef3 => generated 1496 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:03:10.705110 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-45fe5276-0b0f-40bc-809d-cd6138131428 tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:03:10.736169 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.compute.server_groups [None req-45fe5276-0b0f-40bc-809d-cd6138131428 tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Querying cell 5972cb63-1ab7-4825-b0ae-86c7acab764c(cell1) for 1 instances {{(pid=138744) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 22 21:03:10.737236 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-45fe5276-0b0f-40bc-809d-cd6138131428 tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:03:10.737805 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-45fe5276-0b0f-40bc-809d-cd6138131428 tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:03:10.738317 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-45fe5276-0b0f-40bc-809d-cd6138131428 tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:03:10.776436 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-45fe5276-0b0f-40bc-809d-cd6138131428 tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] 10.222.0.18 "GET /compute/v2.1/os-server-groups/153f2eec-8150-44c3-879c-11c66f5f1da1" status: 200 len: 221 microversion: 2.1 time: 0.075050 Oct 22 21:03:10.777446 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1456/3028] 10.222.0.18 () {58 vars in 1263 bytes} [Sat Oct 22 21:03:10 2022] GET /compute/v2.1/os-server-groups/153f2eec-8150-44c3-879c-11c66f5f1da1 => generated 221 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 21:03:10.788044 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-56a381ef-02e0-4368-8165-8d55f39ef511 tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:03:10.788782 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-56a381ef-02e0-4368-8165-8d55f39ef511 tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] [instance: 4850d7fd-598e-4c80-8388-bd124c104ef3] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:03:10.809350 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-56a381ef-02e0-4368-8165-8d55f39ef511 tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:03:10.810209 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-56a381ef-02e0-4368-8165-8d55f39ef511 tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:03:10.810668 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-56a381ef-02e0-4368-8165-8d55f39ef511 tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:03:10.811428 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-56a381ef-02e0-4368-8165-8d55f39ef511 tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:03:10.812062 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-56a381ef-02e0-4368-8165-8d55f39ef511 tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:03:10.813098 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-56a381ef-02e0-4368-8165-8d55f39ef511 tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:03:10.850130 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-56a381ef-02e0-4368-8165-8d55f39ef511 tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] [instance: 4850d7fd-598e-4c80-8388-bd124c104ef3] Going to try to terminate instance {{(pid=138744) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 21:03:10.962096 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-56a381ef-02e0-4368-8165-8d55f39ef511 tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] 10.222.0.18 "DELETE /compute/v2.1/servers/4850d7fd-598e-4c80-8388-bd124c104ef3" status: 204 len: 0 microversion: 2.1 time: 0.176915 Oct 22 21:03:10.962857 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-58044e36-fdc6-4e69-bfbb-81b2983e0978 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1b410a64e0415a96d30f5040361137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd7873d6db4e09bc9ab9a048a6b1ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:03:10.964699 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1457/3029] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 21:03:10 2022] DELETE /compute/v2.1/servers/4850d7fd-598e-4c80-8388-bd124c104ef3 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 22 21:03:10.975244 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-6790fe93-e5a7-4649-ba4b-d9a14af61bcf tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:03:10.978268 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-6790fe93-e5a7-4649-ba4b-d9a14af61bcf tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] [instance: 4850d7fd-598e-4c80-8388-bd124c104ef3] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:03:10.979275 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-58044e36-fdc6-4e69-bfbb-81b2983e0978 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] 10.222.0.18 "GET /compute/v2.1/servers/a99614d8-f2f7-4ce1-87e8-47f3af03d9f8" status: 200 len: 1509 microversion: 2.1 time: 0.413496 Oct 22 21:03:10.980236 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1573/3030] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:03:10 2022] GET /compute/v2.1/servers/a99614d8-f2f7-4ce1-87e8-47f3af03d9f8 => generated 1509 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:03:10.986616 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6790fe93-e5a7-4649-ba4b-d9a14af61bcf tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:03:10.987365 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6790fe93-e5a7-4649-ba4b-d9a14af61bcf tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:03:10.987980 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6790fe93-e5a7-4649-ba4b-d9a14af61bcf tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:03:10.989056 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6790fe93-e5a7-4649-ba4b-d9a14af61bcf tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:03:10.989685 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6790fe93-e5a7-4649-ba4b-d9a14af61bcf tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:03:10.990280 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6790fe93-e5a7-4649-ba4b-d9a14af61bcf tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:03:11.022720 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-2f1c031b-aaed-4456-beb5-b6e64f7a154a tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:03:11.023582 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-2f1c031b-aaed-4456-beb5-b6e64f7a154a tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] [instance: 524c2c11-4a65-4360-93e4-e25349cb6416] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:03:11.030675 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2f1c031b-aaed-4456-beb5-b6e64f7a154a tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:03:11.031608 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2f1c031b-aaed-4456-beb5-b6e64f7a154a tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:03:11.032286 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2f1c031b-aaed-4456-beb5-b6e64f7a154a tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:03:11.033426 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2f1c031b-aaed-4456-beb5-b6e64f7a154a tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:03:11.034137 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2f1c031b-aaed-4456-beb5-b6e64f7a154a tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:03:11.034787 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2f1c031b-aaed-4456-beb5-b6e64f7a154a tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:03:11.624220 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-6790fe93-e5a7-4649-ba4b-d9a14af61bcf tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3adb02392d074b7eb08c94bbf1904547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dfacd9c525f486eaa04d19dbe2dc423', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:03:11.631079 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-2f1c031b-aaed-4456-beb5-b6e64f7a154a tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a44ff8e7c14b94b1670f030085c43d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a26a2284f4424cbeaf63d504652546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:03:11.644892 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-6790fe93-e5a7-4649-ba4b-d9a14af61bcf tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] 10.222.0.18 "GET /compute/v2.1/servers/4850d7fd-598e-4c80-8388-bd124c104ef3" status: 200 len: 1502 microversion: 2.1 time: 0.675184 Oct 22 21:03:11.648509 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1458/3031] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:03:10 2022] GET /compute/v2.1/servers/4850d7fd-598e-4c80-8388-bd124c104ef3 => generated 1502 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:03:11.657639 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-ddd793f3-2f94-4ade-b887-35072d94c2a5 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:03:11.658667 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-ddd793f3-2f94-4ade-b887-35072d94c2a5 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] [instance: 2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:03:11.667164 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ddd793f3-2f94-4ade-b887-35072d94c2a5 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:03:11.669022 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ddd793f3-2f94-4ade-b887-35072d94c2a5 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:03:11.669181 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-2f1c031b-aaed-4456-beb5-b6e64f7a154a tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] 10.222.0.18 "GET /compute/v2.1/servers/524c2c11-4a65-4360-93e4-e25349cb6416" status: 200 len: 1307 microversion: 2.1 time: 0.652225 Oct 22 21:03:11.669847 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ddd793f3-2f94-4ade-b887-35072d94c2a5 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:03:11.670389 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1574/3032] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:03:11 2022] GET /compute/v2.1/servers/524c2c11-4a65-4360-93e4-e25349cb6416 => generated 1307 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:03:11.671224 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ddd793f3-2f94-4ade-b887-35072d94c2a5 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:03:11.671730 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ddd793f3-2f94-4ade-b887-35072d94c2a5 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:03:11.672173 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ddd793f3-2f94-4ade-b887-35072d94c2a5 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:03:11.772160 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-ddd793f3-2f94-4ade-b887-35072d94c2a5 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:03:11.789675 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-ddd793f3-2f94-4ade-b887-35072d94c2a5 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:03:11.797218 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-ddd793f3-2f94-4ade-b887-35072d94c2a5 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:03:11.813408 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-ddd793f3-2f94-4ade-b887-35072d94c2a5 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] 10.222.0.18 "GET /compute/v2.1/servers/2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac" status: 200 len: 1539 microversion: 2.91 time: 0.160977 Oct 22 21:03:11.816730 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1459/3033] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:03:11 2022] GET /compute/v2.1/servers/2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac => generated 1539 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:03:12.003591 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-cf76cb5e-b501-407a-9be5-638b9c0dfdfe tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:03:12.005037 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-cf76cb5e-b501-407a-9be5-638b9c0dfdfe tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] [instance: a99614d8-f2f7-4ce1-87e8-47f3af03d9f8] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:03:12.019683 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cf76cb5e-b501-407a-9be5-638b9c0dfdfe tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:03:12.020719 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cf76cb5e-b501-407a-9be5-638b9c0dfdfe tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:03:12.021208 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cf76cb5e-b501-407a-9be5-638b9c0dfdfe tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:03:12.021973 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cf76cb5e-b501-407a-9be5-638b9c0dfdfe tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:03:12.022497 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cf76cb5e-b501-407a-9be5-638b9c0dfdfe tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:03:12.022867 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cf76cb5e-b501-407a-9be5-638b9c0dfdfe tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:03:12.363031 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-cf76cb5e-b501-407a-9be5-638b9c0dfdfe tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1b410a64e0415a96d30f5040361137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd7873d6db4e09bc9ab9a048a6b1ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:03:12.372111 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-cf76cb5e-b501-407a-9be5-638b9c0dfdfe tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] 10.222.0.18 "GET /compute/v2.1/servers/a99614d8-f2f7-4ce1-87e8-47f3af03d9f8" status: 200 len: 1509 microversion: 2.1 time: 0.373708 Oct 22 21:03:12.372730 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1575/3034] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:03:11 2022] GET /compute/v2.1/servers/a99614d8-f2f7-4ce1-87e8-47f3af03d9f8 => generated 1509 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:03:12.672243 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-d6454963-4009-4165-804c-14392844d9d6 tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:03:12.672918 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-d6454963-4009-4165-804c-14392844d9d6 tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] [instance: 4850d7fd-598e-4c80-8388-bd124c104ef3] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:03:12.682619 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d6454963-4009-4165-804c-14392844d9d6 tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:03:12.683508 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d6454963-4009-4165-804c-14392844d9d6 tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:03:12.684264 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d6454963-4009-4165-804c-14392844d9d6 tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:03:12.701009 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-bca63e64-c3d8-4463-a16b-d4b64375e848 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:03:12.701771 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-bca63e64-c3d8-4463-a16b-d4b64375e848 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] [instance: 524c2c11-4a65-4360-93e4-e25349cb6416] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:03:12.709326 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bca63e64-c3d8-4463-a16b-d4b64375e848 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:03:12.710334 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bca63e64-c3d8-4463-a16b-d4b64375e848 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:03:12.710469 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d6454963-4009-4165-804c-14392844d9d6 tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:03:12.710949 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d6454963-4009-4165-804c-14392844d9d6 tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:03:12.711302 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bca63e64-c3d8-4463-a16b-d4b64375e848 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:03:12.711540 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d6454963-4009-4165-804c-14392844d9d6 tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:03:12.712629 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bca63e64-c3d8-4463-a16b-d4b64375e848 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:03:12.713497 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bca63e64-c3d8-4463-a16b-d4b64375e848 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:03:12.714095 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bca63e64-c3d8-4463-a16b-d4b64375e848 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:03:12.720123 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell1:SELECT=100 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:03:13.229562 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-bca63e64-c3d8-4463-a16b-d4b64375e848 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a44ff8e7c14b94b1670f030085c43d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a26a2284f4424cbeaf63d504652546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:03:13.235332 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-bca63e64-c3d8-4463-a16b-d4b64375e848 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] 10.222.0.18 "GET /compute/v2.1/servers/524c2c11-4a65-4360-93e4-e25349cb6416" status: 200 len: 1487 microversion: 2.1 time: 0.546699 Oct 22 21:03:13.237267 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1576/3035] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:03:12 2022] GET /compute/v2.1/servers/524c2c11-4a65-4360-93e4-e25349cb6416 => generated 1487 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:03:13.248944 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-0ca59411-a877-4ed4-9214-e3cf2dfb0cce tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:03:13.250694 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-0ca59411-a877-4ed4-9214-e3cf2dfb0cce tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] [instance: 2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:03:13.259027 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-d6454963-4009-4165-804c-14392844d9d6 tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3adb02392d074b7eb08c94bbf1904547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dfacd9c525f486eaa04d19dbe2dc423', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:03:13.259905 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0ca59411-a877-4ed4-9214-e3cf2dfb0cce tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:03:13.260868 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0ca59411-a877-4ed4-9214-e3cf2dfb0cce tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:03:13.261664 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0ca59411-a877-4ed4-9214-e3cf2dfb0cce tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:03:13.262707 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0ca59411-a877-4ed4-9214-e3cf2dfb0cce tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:03:13.263206 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0ca59411-a877-4ed4-9214-e3cf2dfb0cce tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:03:13.263844 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0ca59411-a877-4ed4-9214-e3cf2dfb0cce tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:03:13.272997 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-d6454963-4009-4165-804c-14392844d9d6 tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] 10.222.0.18 "GET /compute/v2.1/servers/4850d7fd-598e-4c80-8388-bd124c104ef3" status: 200 len: 1502 microversion: 2.1 time: 0.605633 Oct 22 21:03:13.274012 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1460/3036] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:03:12 2022] GET /compute/v2.1/servers/4850d7fd-598e-4c80-8388-bd124c104ef3 => generated 1502 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:03:13.311200 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-96a314f1-00de-4323-8cd5-09611efd1b54 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:03:13.313671 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-96a314f1-00de-4323-8cd5-09611efd1b54 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] [instance: 524c2c11-4a65-4360-93e4-e25349cb6416] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:03:13.335801 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-96a314f1-00de-4323-8cd5-09611efd1b54 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:03:13.336814 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-96a314f1-00de-4323-8cd5-09611efd1b54 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:03:13.338766 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-96a314f1-00de-4323-8cd5-09611efd1b54 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:03:13.339977 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-96a314f1-00de-4323-8cd5-09611efd1b54 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:03:13.340967 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-96a314f1-00de-4323-8cd5-09611efd1b54 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:03:13.341604 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-96a314f1-00de-4323-8cd5-09611efd1b54 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:03:13.374797 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.objects.instance [None req-96a314f1-00de-4323-8cd5-09611efd1b54 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lazy-loading 'flavor' on Instance uuid 524c2c11-4a65-4360-93e4-e25349cb6416 {{(pid=138744) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 21:03:13.417201 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-0ca59411-a877-4ed4-9214-e3cf2dfb0cce tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:03:13.430135 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-0ca59411-a877-4ed4-9214-e3cf2dfb0cce tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:03:13.431944 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-0ca59411-a877-4ed4-9214-e3cf2dfb0cce tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:03:13.436415 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:03:13.439633 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-0ca59411-a877-4ed4-9214-e3cf2dfb0cce tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] 10.222.0.18 "GET /compute/v2.1/servers/2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac" status: 200 len: 1560 microversion: 2.91 time: 0.199859 Oct 22 21:03:13.440382 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1577/3037] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:03:13 2022] GET /compute/v2.1/servers/2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac => generated 1560 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:03:13.450850 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-5b613e8a-4853-46e1-99d8-3c2b64cb54ee tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:03:13.452532 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-5b613e8a-4853-46e1-99d8-3c2b64cb54ee tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] [instance: a99614d8-f2f7-4ce1-87e8-47f3af03d9f8] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:03:13.466124 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5b613e8a-4853-46e1-99d8-3c2b64cb54ee tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:03:13.466673 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5b613e8a-4853-46e1-99d8-3c2b64cb54ee tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:03:13.469577 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5b613e8a-4853-46e1-99d8-3c2b64cb54ee tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:03:13.470401 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5b613e8a-4853-46e1-99d8-3c2b64cb54ee tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:03:13.470918 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5b613e8a-4853-46e1-99d8-3c2b64cb54ee tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:03:13.472572 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5b613e8a-4853-46e1-99d8-3c2b64cb54ee tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:03:13.525960 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-96a314f1-00de-4323-8cd5-09611efd1b54 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] 10.222.0.18 "POST /compute/v2.1/servers/524c2c11-4a65-4360-93e4-e25349cb6416/action" status: 202 len: 0 microversion: 2.1 time: 0.225870 Oct 22 21:03:13.530234 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1461/3038] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 21:03:13 2022] POST /compute/v2.1/servers/524c2c11-4a65-4360-93e4-e25349cb6416/action => generated 0 bytes in 256 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 21:03:13.546025 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-b3159770-6c77-48b0-8b9e-8e5c5f2b57b3 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:03:13.548332 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-b3159770-6c77-48b0-8b9e-8e5c5f2b57b3 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] [instance: 524c2c11-4a65-4360-93e4-e25349cb6416] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:03:13.568941 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b3159770-6c77-48b0-8b9e-8e5c5f2b57b3 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:03:13.570460 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b3159770-6c77-48b0-8b9e-8e5c5f2b57b3 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:03:13.572804 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b3159770-6c77-48b0-8b9e-8e5c5f2b57b3 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:03:13.574424 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b3159770-6c77-48b0-8b9e-8e5c5f2b57b3 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:03:13.575070 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b3159770-6c77-48b0-8b9e-8e5c5f2b57b3 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:03:13.576697 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b3159770-6c77-48b0-8b9e-8e5c5f2b57b3 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:03:14.000503 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-5b613e8a-4853-46e1-99d8-3c2b64cb54ee tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1b410a64e0415a96d30f5040361137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd7873d6db4e09bc9ab9a048a6b1ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:03:14.014756 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-5b613e8a-4853-46e1-99d8-3c2b64cb54ee tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] 10.222.0.18 "GET /compute/v2.1/servers/a99614d8-f2f7-4ce1-87e8-47f3af03d9f8" status: 200 len: 1509 microversion: 2.1 time: 0.569322 Oct 22 21:03:14.030664 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1578/3039] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:03:13 2022] GET /compute/v2.1/servers/a99614d8-f2f7-4ce1-87e8-47f3af03d9f8 => generated 1509 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:03:14.031183 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-b3159770-6c77-48b0-8b9e-8e5c5f2b57b3 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a44ff8e7c14b94b1670f030085c43d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a26a2284f4424cbeaf63d504652546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:03:14.037807 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-b3159770-6c77-48b0-8b9e-8e5c5f2b57b3 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] 10.222.0.18 "GET /compute/v2.1/servers/524c2c11-4a65-4360-93e4-e25349cb6416" status: 200 len: 1495 microversion: 2.1 time: 0.502573 Oct 22 21:03:14.052794 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1462/3040] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:03:13 2022] GET /compute/v2.1/servers/524c2c11-4a65-4360-93e4-e25349cb6416 => generated 1495 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:03:14.305587 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-140276cf-b254-4766-925a-5086c5b43f8d tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:03:14.307382 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-140276cf-b254-4766-925a-5086c5b43f8d tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] [instance: 4850d7fd-598e-4c80-8388-bd124c104ef3] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:03:14.317531 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-140276cf-b254-4766-925a-5086c5b43f8d tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:03:14.318441 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-140276cf-b254-4766-925a-5086c5b43f8d tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:03:14.319115 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-140276cf-b254-4766-925a-5086c5b43f8d tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:03:14.320591 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-140276cf-b254-4766-925a-5086c5b43f8d tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:03:14.323575 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-140276cf-b254-4766-925a-5086c5b43f8d tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:03:14.325017 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-140276cf-b254-4766-925a-5086c5b43f8d tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:03:14.472659 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-315dcb37-f979-4016-94bd-412eaba098eb tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:03:14.473580 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-315dcb37-f979-4016-94bd-412eaba098eb tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] [instance: 2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:03:14.486533 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-315dcb37-f979-4016-94bd-412eaba098eb tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:03:14.488105 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-315dcb37-f979-4016-94bd-412eaba098eb tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:03:14.489844 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-315dcb37-f979-4016-94bd-412eaba098eb tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:03:14.490694 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-315dcb37-f979-4016-94bd-412eaba098eb tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:03:14.491871 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-315dcb37-f979-4016-94bd-412eaba098eb tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:03:14.493402 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-315dcb37-f979-4016-94bd-412eaba098eb tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:03:14.551619 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-140276cf-b254-4766-925a-5086c5b43f8d tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3adb02392d074b7eb08c94bbf1904547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dfacd9c525f486eaa04d19dbe2dc423', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:03:14.573582 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-140276cf-b254-4766-925a-5086c5b43f8d tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] 10.222.0.18 "GET /compute/v2.1/servers/4850d7fd-598e-4c80-8388-bd124c104ef3" status: 200 len: 1460 microversion: 2.1 time: 0.272794 Oct 22 21:03:14.576059 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1579/3041] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:03:14 2022] GET /compute/v2.1/servers/4850d7fd-598e-4c80-8388-bd124c104ef3 => generated 1460 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:03:14.592102 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-b412f183-5406-43b2-a7a1-db01c4fd8ed6 req-0470c9c7-3896-4a00-be3a-9796216a7e53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4850d7fd-598e-4c80-8388-bd124c104ef3", "name": "network-vif-deleted", "tag": "b5dcf1be-5514-4e11-8fd2-2f7f68001e19"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:03:14.622030 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-b412f183-5406-43b2-a7a1-db01c4fd8ed6 req-0470c9c7-3896-4a00-be3a-9796216a7e53 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:03:14.622860 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-b412f183-5406-43b2-a7a1-db01c4fd8ed6 req-0470c9c7-3896-4a00-be3a-9796216a7e53 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:03:14.624123 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-b412f183-5406-43b2-a7a1-db01c4fd8ed6 req-0470c9c7-3896-4a00-be3a-9796216a7e53 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:03:14.673902 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-b412f183-5406-43b2-a7a1-db01c4fd8ed6 req-0470c9c7-3896-4a00-be3a-9796216a7e53 service nova] Creating event network-vif-deleted:b5dcf1be-5514-4e11-8fd2-2f7f68001e19 for instance 4850d7fd-598e-4c80-8388-bd124c104ef3 on nch2-master-1 Oct 22 21:03:14.685820 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-b412f183-5406-43b2-a7a1-db01c4fd8ed6 req-0470c9c7-3896-4a00-be3a-9796216a7e53 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105656 Oct 22 21:03:14.686556 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1580/3042] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:03:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:03:14.794556 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-315dcb37-f979-4016-94bd-412eaba098eb tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:03:14.811178 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-315dcb37-f979-4016-94bd-412eaba098eb tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:03:14.820518 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-315dcb37-f979-4016-94bd-412eaba098eb tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:03:14.831567 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-315dcb37-f979-4016-94bd-412eaba098eb tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] 10.222.0.18 "GET /compute/v2.1/servers/2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac" status: 200 len: 1555 microversion: 2.91 time: 0.363723 Oct 22 21:03:14.833177 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1463/3043] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:03:14 2022] GET /compute/v2.1/servers/2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac => generated 1555 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 22 21:03:15.039586 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-75c7e274-caa9-4060-9dc3-4e8c8164d285 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:03:15.040641 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-75c7e274-caa9-4060-9dc3-4e8c8164d285 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] [instance: a99614d8-f2f7-4ce1-87e8-47f3af03d9f8] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:03:15.066225 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-2fbc68ce-b0f5-468a-97fc-0057c1898c1a tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:03:15.067730 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-2fbc68ce-b0f5-468a-97fc-0057c1898c1a tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] [instance: 524c2c11-4a65-4360-93e4-e25349cb6416] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:03:15.070034 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-75c7e274-caa9-4060-9dc3-4e8c8164d285 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:03:15.070477 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-75c7e274-caa9-4060-9dc3-4e8c8164d285 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:03:15.071098 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-75c7e274-caa9-4060-9dc3-4e8c8164d285 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:03:15.072087 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-75c7e274-caa9-4060-9dc3-4e8c8164d285 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:03:15.072553 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-75c7e274-caa9-4060-9dc3-4e8c8164d285 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:03:15.072979 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-75c7e274-caa9-4060-9dc3-4e8c8164d285 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:03:15.089137 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2fbc68ce-b0f5-468a-97fc-0057c1898c1a tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:03:15.092856 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2fbc68ce-b0f5-468a-97fc-0057c1898c1a tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:03:15.095645 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2fbc68ce-b0f5-468a-97fc-0057c1898c1a tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:03:15.099985 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2fbc68ce-b0f5-468a-97fc-0057c1898c1a tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:03:15.100840 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2fbc68ce-b0f5-468a-97fc-0057c1898c1a tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:03:15.101272 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2fbc68ce-b0f5-468a-97fc-0057c1898c1a tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:03:15.643527 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-75c7e274-caa9-4060-9dc3-4e8c8164d285 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1b410a64e0415a96d30f5040361137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd7873d6db4e09bc9ab9a048a6b1ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:03:15.663282 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-75c7e274-caa9-4060-9dc3-4e8c8164d285 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] 10.222.0.18 "GET /compute/v2.1/servers/a99614d8-f2f7-4ce1-87e8-47f3af03d9f8" status: 200 len: 1509 microversion: 2.1 time: 0.628879 Oct 22 21:03:15.666085 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1581/3044] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:03:15 2022] GET /compute/v2.1/servers/a99614d8-f2f7-4ce1-87e8-47f3af03d9f8 => generated 1509 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:03:15.678150 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-8ee4e123-0e6f-4c66-9ec4-0fd0cf4667ed tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:03:15.679048 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-8ee4e123-0e6f-4c66-9ec4-0fd0cf4667ed tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] [instance: 4850d7fd-598e-4c80-8388-bd124c104ef3] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:03:15.697461 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8ee4e123-0e6f-4c66-9ec4-0fd0cf4667ed tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:03:15.698726 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8ee4e123-0e6f-4c66-9ec4-0fd0cf4667ed tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:03:15.700364 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8ee4e123-0e6f-4c66-9ec4-0fd0cf4667ed tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:03:15.701167 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8ee4e123-0e6f-4c66-9ec4-0fd0cf4667ed tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:03:15.701636 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8ee4e123-0e6f-4c66-9ec4-0fd0cf4667ed tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:03:15.702115 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8ee4e123-0e6f-4c66-9ec4-0fd0cf4667ed tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:03:15.739709 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.wsgi [None req-8ee4e123-0e6f-4c66-9ec4-0fd0cf4667ed tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] HTTP exception thrown: Instance 4850d7fd-598e-4c80-8388-bd124c104ef3 could not be found. Oct 22 21:03:15.743969 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-8ee4e123-0e6f-4c66-9ec4-0fd0cf4667ed tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Request method failure captured: Oct 22 21:03:15.743969 ncdv-master-1 devstack@n-api.service[138745]: request: GET /compute/v2.1/servers/4850d7fd-598e-4c80-8388-bd124c104ef3 HTTP/1.1 Oct 22 21:03:15.743969 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 21:03:15.743969 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 21:03:15.743969 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 21:03:15.743969 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 0 Oct 22 21:03:15.743969 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 21:03:15.743969 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 21:03:15.743969 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 21:03:15.743969 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 21:03:15.743969 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVFp25Ob3nw0LlX1zk2kv3p40qnKsRkvmmyqkG1Ts2xAzzirEULB7D_fx7Q1jpQhfeLvy8ZuelifqE_lGZD6s7rmRDMH1BnOWeJkLmIRmOe4DHpZ_id8rruG1yVPtRGP3uD0ViawCa7n-S5otlM-Rd16ltCvTHZZvHnnjV-O1B0lBbCE Oct 22 21:03:15.743969 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 21:03:15.743969 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 21:03:15.743969 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 21:03:15.743969 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 21:03:15.743969 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 21:03:15.743969 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 21:03:15.743969 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: 1dfacd9c525f486eaa04d19dbe2dc423 Oct 22 21:03:15.743969 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-ServerGroupTestJSON-1405628578 Oct 22 21:03:15.743969 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 21:03:15.743969 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 21:03:15.743969 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_1dfacd9c525f486eaa04d19dbe2dc423"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1dfacd9c525f486eaa04d19dbe2dc423"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/1dfacd9c525f486eaa04d19dbe2dc423"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1dfacd9c525f486eaa04d19dbe2dc423"}]}] Oct 22 21:03:15.743969 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-ServerGroupTestJSON-1405628578 Oct 22 21:03:15.743969 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: 1dfacd9c525f486eaa04d19dbe2dc423 Oct 22 21:03:15.743969 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-ServerGroupTestJSON-1405628578 Oct 22 21:03:15.743969 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-ServerGroupTestJSON-1405628578-project Oct 22 21:03:15.743969 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 21:03:15.743969 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 21:03:15.743969 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: 3adb02392d074b7eb08c94bbf1904547 Oct 22 21:03:15.743969 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-ServerGroupTestJSON-1405628578-project Oct 22 21:03:15.743969 ncdv-master-1 devstack@n-api.service[138745]: method: > Oct 22 21:03:15.743969 ncdv-master-1 devstack@n-api.service[138745]: exception: Instance 4850d7fd-598e-4c80-8388-bd124c104ef3 could not be found. Oct 22 21:03:15.743969 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'id': '4850d7fd-598e-4c80-8388-bd124c104ef3'} Oct 22 21:03:15.743969 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:03:15.743969 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:03:15.743969 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 21:03:15.743969 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 21:03:15.743969 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 21:03:15.743969 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 21:03:15.743969 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 21:03:15.743969 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 21:03:15.743969 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 21:03:15.743969 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 21:03:15.743969 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4850d7fd-598e-4c80-8388-bd124c104ef3 could not be found. Oct 22 21:03:15.743969 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:03:15.743969 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:03:15.743969 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:03:15.743969 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:03:15.743969 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:03:15.743969 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:03:15.743969 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:03:15.743969 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:03:15.743969 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:03:15.743969 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:03:15.743969 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 21:03:15.743969 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 21:03:15.743969 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 21:03:15.743969 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 21:03:15.743969 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 21:03:15.743969 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:03:15.743969 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4850d7fd-598e-4c80-8388-bd124c104ef3 could not be found. Oct 22 21:03:15.743969 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:03:15.743969 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:03:15.743969 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:03:15.749885 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:03:15.749885 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:03:15.749885 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:03:15.749885 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:03:15.749885 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:03:15.749885 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4850d7fd-598e-4c80-8388-bd124c104ef3 could not be found. Oct 22 21:03:15.749885 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:03:15.754039 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-8ee4e123-0e6f-4c66-9ec4-0fd0cf4667ed tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Returning 404 to user: Instance 4850d7fd-598e-4c80-8388-bd124c104ef3 could not be found. {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:03:15.765344 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-8ee4e123-0e6f-4c66-9ec4-0fd0cf4667ed tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] 10.222.0.18 "GET /compute/v2.1/servers/4850d7fd-598e-4c80-8388-bd124c104ef3" status: 404 len: 111 microversion: 2.1 time: 0.086342 Oct 22 21:03:15.766525 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1582/3045] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:03:15 2022] GET /compute/v2.1/servers/4850d7fd-598e-4c80-8388-bd124c104ef3 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 21:03:15.785527 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-af9a3b2a-d1c9-4618-86fa-7bd3bb7b6410 tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:03:15.813237 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-2fbc68ce-b0f5-468a-97fc-0057c1898c1a tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a44ff8e7c14b94b1670f030085c43d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a26a2284f4424cbeaf63d504652546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:03:15.836676 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-2fbc68ce-b0f5-468a-97fc-0057c1898c1a tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] 10.222.0.18 "GET /compute/v2.1/servers/524c2c11-4a65-4360-93e4-e25349cb6416" status: 200 len: 1478 microversion: 2.1 time: 0.767662 Oct 22 21:03:15.839690 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1464/3046] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:03:15 2022] GET /compute/v2.1/servers/524c2c11-4a65-4360-93e4-e25349cb6416 => generated 1478 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:03:15.865057 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.compute.server_groups [None req-af9a3b2a-d1c9-4618-86fa-7bd3bb7b6410 tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Querying cell 5972cb63-1ab7-4825-b0ae-86c7acab764c(cell1) for 1 instances {{(pid=138745) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 22 21:03:15.868388 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-af9a3b2a-d1c9-4618-86fa-7bd3bb7b6410 tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:03:15.869025 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-af9a3b2a-d1c9-4618-86fa-7bd3bb7b6410 tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:03:15.869660 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-af9a3b2a-d1c9-4618-86fa-7bd3bb7b6410 tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:03:15.875976 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-a6384a6d-afbf-42f5-96f6-85d391a21b82 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:03:15.876764 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-a6384a6d-afbf-42f5-96f6-85d391a21b82 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] [instance: 2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:03:15.894042 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-af9a3b2a-d1c9-4618-86fa-7bd3bb7b6410 tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] 10.222.0.18 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.118226 Oct 22 21:03:15.895058 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1583/3047] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Oct 22 21:03:15 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:03:15.901534 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-8d0fc5eb-b3b5-447e-bc4b-5c6d16f5a13a tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-944849941"}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:03:15.904367 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-8d0fc5eb-b3b5-447e-bc4b-5c6d16f5a13a tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] [instance: 524c2c11-4a65-4360-93e4-e25349cb6416] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:03:15.914157 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8d0fc5eb-b3b5-447e-bc4b-5c6d16f5a13a tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:03:15.915729 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8d0fc5eb-b3b5-447e-bc4b-5c6d16f5a13a tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:03:15.916426 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8d0fc5eb-b3b5-447e-bc4b-5c6d16f5a13a tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:03:15.917697 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8d0fc5eb-b3b5-447e-bc4b-5c6d16f5a13a tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:03:15.918325 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8d0fc5eb-b3b5-447e-bc4b-5c6d16f5a13a tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:03:15.918909 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8d0fc5eb-b3b5-447e-bc4b-5c6d16f5a13a tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:03:15.920144 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a6384a6d-afbf-42f5-96f6-85d391a21b82 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:03:15.926635 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a6384a6d-afbf-42f5-96f6-85d391a21b82 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:03:15.927628 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a6384a6d-afbf-42f5-96f6-85d391a21b82 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:03:15.931571 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a6384a6d-afbf-42f5-96f6-85d391a21b82 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:03:15.933426 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a6384a6d-afbf-42f5-96f6-85d391a21b82 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:03:15.939659 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a6384a6d-afbf-42f5-96f6-85d391a21b82 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:03:16.091533 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-a6384a6d-afbf-42f5-96f6-85d391a21b82 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:03:16.110302 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-a6384a6d-afbf-42f5-96f6-85d391a21b82 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:03:16.113918 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-a6384a6d-afbf-42f5-96f6-85d391a21b82 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:03:16.133043 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-a6384a6d-afbf-42f5-96f6-85d391a21b82 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] 10.222.0.18 "GET /compute/v2.1/servers/2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac" status: 200 len: 1555 microversion: 2.91 time: 0.269696 Oct 22 21:03:16.135451 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1465/3048] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:03:15 2022] GET /compute/v2.1/servers/2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac => generated 1555 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:03:16.154557 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-5edbc7fa-111a-44b5-ad48-9fb0509d61dc tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:03:16.207117 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.compute.server_groups [None req-5edbc7fa-111a-44b5-ad48-9fb0509d61dc tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Querying cell 5972cb63-1ab7-4825-b0ae-86c7acab764c(cell1) for 1 instances {{(pid=138744) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 22 21:03:16.209656 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5edbc7fa-111a-44b5-ad48-9fb0509d61dc tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:03:16.210729 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5edbc7fa-111a-44b5-ad48-9fb0509d61dc tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:03:16.211018 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5edbc7fa-111a-44b5-ad48-9fb0509d61dc tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:03:16.228121 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-5edbc7fa-111a-44b5-ad48-9fb0509d61dc tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] 10.222.0.18 "GET /compute/v2.1/os-server-groups/153f2eec-8150-44c3-879c-11c66f5f1da1" status: 200 len: 183 microversion: 2.1 time: 0.090425 Oct 22 21:03:16.229014 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1466/3049] 10.222.0.18 () {58 vars in 1263 bytes} [Sat Oct 22 21:03:16 2022] GET /compute/v2.1/os-server-groups/153f2eec-8150-44c3-879c-11c66f5f1da1 => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:03:16.246470 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-2a05d1b3-27be-49e7-925c-3dcb2d499f1d tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:03:16.247548 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-2a05d1b3-27be-49e7-925c-3dcb2d499f1d tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] [instance: 4850d7fd-598e-4c80-8388-bd124c104ef3] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:03:16.265884 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2a05d1b3-27be-49e7-925c-3dcb2d499f1d tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:03:16.268053 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2a05d1b3-27be-49e7-925c-3dcb2d499f1d tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:03:16.269197 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2a05d1b3-27be-49e7-925c-3dcb2d499f1d tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:03:16.271856 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2a05d1b3-27be-49e7-925c-3dcb2d499f1d tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:03:16.272567 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2a05d1b3-27be-49e7-925c-3dcb2d499f1d tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:03:16.274122 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2a05d1b3-27be-49e7-925c-3dcb2d499f1d tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:03:16.310223 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-2a05d1b3-27be-49e7-925c-3dcb2d499f1d tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] HTTP exception thrown: Instance 4850d7fd-598e-4c80-8388-bd124c104ef3 could not be found. Oct 22 21:03:16.315929 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-2a05d1b3-27be-49e7-925c-3dcb2d499f1d tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Request method failure captured: Oct 22 21:03:16.315929 ncdv-master-1 devstack@n-api.service[138744]: request: DELETE /compute/v2.1/servers/4850d7fd-598e-4c80-8388-bd124c104ef3 HTTP/1.1 Oct 22 21:03:16.315929 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 21:03:16.315929 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 21:03:16.315929 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 21:03:16.315929 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 0 Oct 22 21:03:16.315929 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 21:03:16.315929 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 21:03:16.315929 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 21:03:16.315929 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 21:03:16.315929 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVFp25Ob3nw0LlX1zk2kv3p40qnKsRkvmmyqkG1Ts2xAzzirEULB7D_fx7Q1jpQhfeLvy8ZuelifqE_lGZD6s7rmRDMH1BnOWeJkLmIRmOe4DHpZ_id8rruG1yVPtRGP3uD0ViawCa7n-S5otlM-Rd16ltCvTHZZvHnnjV-O1B0lBbCE Oct 22 21:03:16.315929 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 21:03:16.315929 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 21:03:16.315929 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 21:03:16.315929 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 21:03:16.315929 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 21:03:16.315929 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 21:03:16.315929 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: 1dfacd9c525f486eaa04d19dbe2dc423 Oct 22 21:03:16.315929 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-ServerGroupTestJSON-1405628578 Oct 22 21:03:16.315929 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 21:03:16.315929 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 21:03:16.315929 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_1dfacd9c525f486eaa04d19dbe2dc423"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1dfacd9c525f486eaa04d19dbe2dc423"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/1dfacd9c525f486eaa04d19dbe2dc423"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1dfacd9c525f486eaa04d19dbe2dc423"}]}] Oct 22 21:03:16.315929 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-ServerGroupTestJSON-1405628578 Oct 22 21:03:16.315929 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: 1dfacd9c525f486eaa04d19dbe2dc423 Oct 22 21:03:16.315929 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-ServerGroupTestJSON-1405628578 Oct 22 21:03:16.315929 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-ServerGroupTestJSON-1405628578-project Oct 22 21:03:16.315929 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 21:03:16.315929 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 21:03:16.315929 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: 3adb02392d074b7eb08c94bbf1904547 Oct 22 21:03:16.315929 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-ServerGroupTestJSON-1405628578-project Oct 22 21:03:16.315929 ncdv-master-1 devstack@n-api.service[138744]: method: > Oct 22 21:03:16.315929 ncdv-master-1 devstack@n-api.service[138744]: exception: Instance 4850d7fd-598e-4c80-8388-bd124c104ef3 could not be found. Oct 22 21:03:16.315929 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': '4850d7fd-598e-4c80-8388-bd124c104ef3'} Oct 22 21:03:16.315929 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:03:16.315929 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:03:16.315929 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 21:03:16.315929 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 21:03:16.315929 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 21:03:16.315929 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 21:03:16.315929 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 21:03:16.315929 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 21:03:16.315929 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 21:03:16.315929 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 21:03:16.315929 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4850d7fd-598e-4c80-8388-bd124c104ef3 could not be found. Oct 22 21:03:16.315929 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:03:16.315929 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:03:16.315929 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:03:16.315929 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:03:16.315929 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:03:16.315929 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:03:16.315929 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:03:16.315929 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:03:16.315929 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:03:16.315929 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:03:16.315929 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 22 21:03:16.315929 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 22 21:03:16.315929 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 22 21:03:16.315929 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 22 21:03:16.315929 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 21:03:16.315929 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 21:03:16.315929 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 21:03:16.315929 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:03:16.321747 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4850d7fd-598e-4c80-8388-bd124c104ef3 could not be found. Oct 22 21:03:16.321747 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:03:16.321747 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:03:16.321747 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:03:16.321747 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:03:16.321747 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:03:16.321747 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:03:16.321747 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:03:16.321747 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:03:16.321747 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4850d7fd-598e-4c80-8388-bd124c104ef3 could not be found. Oct 22 21:03:16.321747 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:03:16.326253 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-2a05d1b3-27be-49e7-925c-3dcb2d499f1d tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Returning 404 to user: Instance 4850d7fd-598e-4c80-8388-bd124c104ef3 could not be found. {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:03:16.327451 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-2a05d1b3-27be-49e7-925c-3dcb2d499f1d tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] 10.222.0.18 "DELETE /compute/v2.1/servers/4850d7fd-598e-4c80-8388-bd124c104ef3" status: 404 len: 111 microversion: 2.1 time: 0.090801 Oct 22 21:03:16.328531 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1467/3050] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 21:03:16 2022] DELETE /compute/v2.1/servers/4850d7fd-598e-4c80-8388-bd124c104ef3 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 21:03:16.338568 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-e20c59d4-3d9d-4cd3-ba76-e692115294ad tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:03:16.339465 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-e20c59d4-3d9d-4cd3-ba76-e692115294ad tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] [instance: 4850d7fd-598e-4c80-8388-bd124c104ef3] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:03:16.349188 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e20c59d4-3d9d-4cd3-ba76-e692115294ad tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:03:16.349941 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e20c59d4-3d9d-4cd3-ba76-e692115294ad tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:03:16.351165 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e20c59d4-3d9d-4cd3-ba76-e692115294ad tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:03:16.352192 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e20c59d4-3d9d-4cd3-ba76-e692115294ad tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:03:16.352888 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e20c59d4-3d9d-4cd3-ba76-e692115294ad tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:03:16.353633 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e20c59d4-3d9d-4cd3-ba76-e692115294ad tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:03:16.375005 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-e20c59d4-3d9d-4cd3-ba76-e692115294ad tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] HTTP exception thrown: Instance 4850d7fd-598e-4c80-8388-bd124c104ef3 could not be found. Oct 22 21:03:16.379166 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-e20c59d4-3d9d-4cd3-ba76-e692115294ad tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Request method failure captured: Oct 22 21:03:16.379166 ncdv-master-1 devstack@n-api.service[138744]: request: GET /compute/v2.1/servers/4850d7fd-598e-4c80-8388-bd124c104ef3 HTTP/1.1 Oct 22 21:03:16.379166 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 21:03:16.379166 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 21:03:16.379166 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 21:03:16.379166 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 0 Oct 22 21:03:16.379166 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 21:03:16.379166 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 21:03:16.379166 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 21:03:16.379166 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 21:03:16.379166 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVFp25Ob3nw0LlX1zk2kv3p40qnKsRkvmmyqkG1Ts2xAzzirEULB7D_fx7Q1jpQhfeLvy8ZuelifqE_lGZD6s7rmRDMH1BnOWeJkLmIRmOe4DHpZ_id8rruG1yVPtRGP3uD0ViawCa7n-S5otlM-Rd16ltCvTHZZvHnnjV-O1B0lBbCE Oct 22 21:03:16.379166 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 21:03:16.379166 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 21:03:16.379166 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 21:03:16.379166 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 21:03:16.379166 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 21:03:16.379166 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 21:03:16.379166 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: 1dfacd9c525f486eaa04d19dbe2dc423 Oct 22 21:03:16.379166 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-ServerGroupTestJSON-1405628578 Oct 22 21:03:16.379166 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 21:03:16.379166 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 21:03:16.379166 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_1dfacd9c525f486eaa04d19dbe2dc423"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1dfacd9c525f486eaa04d19dbe2dc423"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/1dfacd9c525f486eaa04d19dbe2dc423"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1dfacd9c525f486eaa04d19dbe2dc423"}]}] Oct 22 21:03:16.379166 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-ServerGroupTestJSON-1405628578 Oct 22 21:03:16.379166 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: 1dfacd9c525f486eaa04d19dbe2dc423 Oct 22 21:03:16.379166 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-ServerGroupTestJSON-1405628578 Oct 22 21:03:16.379166 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-ServerGroupTestJSON-1405628578-project Oct 22 21:03:16.379166 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 21:03:16.379166 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 21:03:16.379166 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: 3adb02392d074b7eb08c94bbf1904547 Oct 22 21:03:16.379166 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-ServerGroupTestJSON-1405628578-project Oct 22 21:03:16.379166 ncdv-master-1 devstack@n-api.service[138744]: method: > Oct 22 21:03:16.379166 ncdv-master-1 devstack@n-api.service[138744]: exception: Instance 4850d7fd-598e-4c80-8388-bd124c104ef3 could not be found. Oct 22 21:03:16.379166 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': '4850d7fd-598e-4c80-8388-bd124c104ef3'} Oct 22 21:03:16.379166 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:03:16.379166 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:03:16.379166 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 21:03:16.379166 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 21:03:16.379166 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 21:03:16.379166 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 21:03:16.379166 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 21:03:16.379166 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 21:03:16.379166 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 21:03:16.379166 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 21:03:16.379166 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4850d7fd-598e-4c80-8388-bd124c104ef3 could not be found. Oct 22 21:03:16.379166 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:03:16.379166 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:03:16.379166 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:03:16.379166 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:03:16.379166 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:03:16.379166 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:03:16.379166 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:03:16.379166 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:03:16.379166 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:03:16.379166 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:03:16.379166 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 21:03:16.379166 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 21:03:16.379166 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 21:03:16.379166 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 21:03:16.379166 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 21:03:16.379166 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:03:16.379166 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4850d7fd-598e-4c80-8388-bd124c104ef3 could not be found. Oct 22 21:03:16.379166 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:03:16.379166 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:03:16.379166 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:03:16.385196 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:03:16.385196 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:03:16.385196 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:03:16.385196 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:03:16.385196 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:03:16.385196 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4850d7fd-598e-4c80-8388-bd124c104ef3 could not be found. Oct 22 21:03:16.385196 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:03:16.387843 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-e20c59d4-3d9d-4cd3-ba76-e692115294ad tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Returning 404 to user: Instance 4850d7fd-598e-4c80-8388-bd124c104ef3 could not be found. {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:03:16.389165 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-e20c59d4-3d9d-4cd3-ba76-e692115294ad tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] 10.222.0.18 "GET /compute/v2.1/servers/4850d7fd-598e-4c80-8388-bd124c104ef3" status: 404 len: 111 microversion: 2.1 time: 0.056669 Oct 22 21:03:16.395052 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1468/3051] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:03:16 2022] GET /compute/v2.1/servers/4850d7fd-598e-4c80-8388-bd124c104ef3 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 21:03:16.401814 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-f79dacdd-aef9-4dff-9371-21f7a8b2c612 tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:03:16.409400 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_api:DELETE=4,nova_api:SELECT=94,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:03:16.410693 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-f79dacdd-aef9-4dff-9371-21f7a8b2c612 tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] HTTP exception thrown: Instance group f68085b3-f314-4d98-9b8a-433370eb9a3b could not be found. Oct 22 21:03:16.435910 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-f79dacdd-aef9-4dff-9371-21f7a8b2c612 tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Request method failure captured: Oct 22 21:03:16.435910 ncdv-master-1 devstack@n-api.service[138744]: request: DELETE /compute/v2.1/os-server-groups/f68085b3-f314-4d98-9b8a-433370eb9a3b HTTP/1.1 Oct 22 21:03:16.435910 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 21:03:16.435910 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 21:03:16.435910 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 21:03:16.435910 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 0 Oct 22 21:03:16.435910 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 21:03:16.435910 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 21:03:16.435910 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 21:03:16.435910 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 21:03:16.435910 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVFp25Ob3nw0LlX1zk2kv3p40qnKsRkvmmyqkG1Ts2xAzzirEULB7D_fx7Q1jpQhfeLvy8ZuelifqE_lGZD6s7rmRDMH1BnOWeJkLmIRmOe4DHpZ_id8rruG1yVPtRGP3uD0ViawCa7n-S5otlM-Rd16ltCvTHZZvHnnjV-O1B0lBbCE Oct 22 21:03:16.435910 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 21:03:16.435910 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 21:03:16.435910 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 21:03:16.435910 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 21:03:16.435910 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 21:03:16.435910 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 21:03:16.435910 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: 1dfacd9c525f486eaa04d19dbe2dc423 Oct 22 21:03:16.435910 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-ServerGroupTestJSON-1405628578 Oct 22 21:03:16.435910 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 21:03:16.435910 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 21:03:16.435910 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_1dfacd9c525f486eaa04d19dbe2dc423"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1dfacd9c525f486eaa04d19dbe2dc423"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/1dfacd9c525f486eaa04d19dbe2dc423"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1dfacd9c525f486eaa04d19dbe2dc423"}]}] Oct 22 21:03:16.435910 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-ServerGroupTestJSON-1405628578 Oct 22 21:03:16.435910 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: 1dfacd9c525f486eaa04d19dbe2dc423 Oct 22 21:03:16.435910 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-ServerGroupTestJSON-1405628578 Oct 22 21:03:16.435910 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-ServerGroupTestJSON-1405628578-project Oct 22 21:03:16.435910 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 21:03:16.435910 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 21:03:16.435910 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: 3adb02392d074b7eb08c94bbf1904547 Oct 22 21:03:16.435910 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-ServerGroupTestJSON-1405628578-project Oct 22 21:03:16.435910 ncdv-master-1 devstack@n-api.service[138744]: method: > Oct 22 21:03:16.435910 ncdv-master-1 devstack@n-api.service[138744]: exception: Instance group f68085b3-f314-4d98-9b8a-433370eb9a3b could not be found. Oct 22 21:03:16.435910 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': 'f68085b3-f314-4d98-9b8a-433370eb9a3b'} Oct 22 21:03:16.435910 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:03:16.435910 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:03:16.435910 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 22 21:03:16.435910 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 22 21:03:16.435910 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 22 21:03:16.435910 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 22 21:03:16.435910 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 22 21:03:16.435910 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 22 21:03:16.435910 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 22 21:03:16.435910 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 22 21:03:16.435910 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 22 21:03:16.435910 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 22 21:03:16.435910 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group f68085b3-f314-4d98-9b8a-433370eb9a3b could not be found. Oct 22 21:03:16.435910 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:03:16.435910 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:03:16.435910 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:03:16.435910 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:03:16.435910 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:03:16.435910 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:03:16.435910 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:03:16.435910 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:03:16.435910 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:03:16.435910 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:03:16.435910 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 22 21:03:16.435910 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:03:16.435910 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group f68085b3-f314-4d98-9b8a-433370eb9a3b could not be found. Oct 22 21:03:16.435910 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:03:16.435910 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:03:16.435910 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:03:16.435910 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:03:16.441936 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:03:16.441936 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:03:16.441936 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:03:16.441936 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:03:16.441936 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group f68085b3-f314-4d98-9b8a-433370eb9a3b could not be found. Oct 22 21:03:16.441936 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:03:16.446236 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-f79dacdd-aef9-4dff-9371-21f7a8b2c612 tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Returning 404 to user: Instance group f68085b3-f314-4d98-9b8a-433370eb9a3b could not be found. {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:03:16.451369 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-f79dacdd-aef9-4dff-9371-21f7a8b2c612 tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] 10.222.0.18 "DELETE /compute/v2.1/os-server-groups/f68085b3-f314-4d98-9b8a-433370eb9a3b" status: 404 len: 117 microversion: 2.1 time: 0.051049 Oct 22 21:03:16.452391 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1469/3052] 10.222.0.18 () {58 vars in 1266 bytes} [Sat Oct 22 21:03:16 2022] DELETE /compute/v2.1/os-server-groups/f68085b3-f314-4d98-9b8a-433370eb9a3b => generated 117 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 21:03:16.482316 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-c9628ff9-9b1d-4b6b-a309-cd5ecf21da5b tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:03:16.516389 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-c9628ff9-9b1d-4b6b-a309-cd5ecf21da5b tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] HTTP exception thrown: Instance group 1c137e61-d13b-43b0-aca0-6b4b3b6a9572 could not be found. Oct 22 21:03:16.522798 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-c9628ff9-9b1d-4b6b-a309-cd5ecf21da5b tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Request method failure captured: Oct 22 21:03:16.522798 ncdv-master-1 devstack@n-api.service[138744]: request: DELETE /compute/v2.1/os-server-groups/1c137e61-d13b-43b0-aca0-6b4b3b6a9572 HTTP/1.1 Oct 22 21:03:16.522798 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 21:03:16.522798 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 21:03:16.522798 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 21:03:16.522798 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 0 Oct 22 21:03:16.522798 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 21:03:16.522798 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 21:03:16.522798 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 21:03:16.522798 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 21:03:16.522798 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVFp25Ob3nw0LlX1zk2kv3p40qnKsRkvmmyqkG1Ts2xAzzirEULB7D_fx7Q1jpQhfeLvy8ZuelifqE_lGZD6s7rmRDMH1BnOWeJkLmIRmOe4DHpZ_id8rruG1yVPtRGP3uD0ViawCa7n-S5otlM-Rd16ltCvTHZZvHnnjV-O1B0lBbCE Oct 22 21:03:16.522798 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 21:03:16.522798 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 21:03:16.522798 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 21:03:16.522798 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 21:03:16.522798 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 21:03:16.522798 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 21:03:16.522798 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: 1dfacd9c525f486eaa04d19dbe2dc423 Oct 22 21:03:16.522798 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-ServerGroupTestJSON-1405628578 Oct 22 21:03:16.522798 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 21:03:16.522798 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 21:03:16.522798 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_1dfacd9c525f486eaa04d19dbe2dc423"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1dfacd9c525f486eaa04d19dbe2dc423"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/1dfacd9c525f486eaa04d19dbe2dc423"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1dfacd9c525f486eaa04d19dbe2dc423"}]}] Oct 22 21:03:16.522798 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-ServerGroupTestJSON-1405628578 Oct 22 21:03:16.522798 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: 1dfacd9c525f486eaa04d19dbe2dc423 Oct 22 21:03:16.522798 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-ServerGroupTestJSON-1405628578 Oct 22 21:03:16.522798 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-ServerGroupTestJSON-1405628578-project Oct 22 21:03:16.522798 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 21:03:16.522798 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 21:03:16.522798 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: 3adb02392d074b7eb08c94bbf1904547 Oct 22 21:03:16.522798 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-ServerGroupTestJSON-1405628578-project Oct 22 21:03:16.522798 ncdv-master-1 devstack@n-api.service[138744]: method: > Oct 22 21:03:16.522798 ncdv-master-1 devstack@n-api.service[138744]: exception: Instance group 1c137e61-d13b-43b0-aca0-6b4b3b6a9572 could not be found. Oct 22 21:03:16.522798 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': '1c137e61-d13b-43b0-aca0-6b4b3b6a9572'} Oct 22 21:03:16.522798 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:03:16.522798 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:03:16.522798 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 22 21:03:16.522798 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 22 21:03:16.522798 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 22 21:03:16.522798 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 22 21:03:16.522798 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 22 21:03:16.522798 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 22 21:03:16.522798 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 22 21:03:16.522798 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 22 21:03:16.522798 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 22 21:03:16.522798 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 22 21:03:16.522798 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 1c137e61-d13b-43b0-aca0-6b4b3b6a9572 could not be found. Oct 22 21:03:16.522798 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:03:16.522798 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:03:16.522798 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:03:16.522798 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:03:16.522798 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:03:16.522798 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:03:16.522798 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:03:16.522798 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:03:16.522798 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:03:16.522798 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:03:16.522798 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 22 21:03:16.522798 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:03:16.522798 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 1c137e61-d13b-43b0-aca0-6b4b3b6a9572 could not be found. Oct 22 21:03:16.522798 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:03:16.522798 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:03:16.522798 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:03:16.522798 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:03:16.528297 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:03:16.528297 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:03:16.528297 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:03:16.528297 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:03:16.528297 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 1c137e61-d13b-43b0-aca0-6b4b3b6a9572 could not be found. Oct 22 21:03:16.528297 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:03:16.530949 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-c9628ff9-9b1d-4b6b-a309-cd5ecf21da5b tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Returning 404 to user: Instance group 1c137e61-d13b-43b0-aca0-6b4b3b6a9572 could not be found. {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:03:16.532120 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-c9628ff9-9b1d-4b6b-a309-cd5ecf21da5b tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] 10.222.0.18 "DELETE /compute/v2.1/os-server-groups/1c137e61-d13b-43b0-aca0-6b4b3b6a9572" status: 404 len: 117 microversion: 2.1 time: 0.072157 Oct 22 21:03:16.535361 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1470/3053] 10.222.0.18 () {58 vars in 1266 bytes} [Sat Oct 22 21:03:16 2022] DELETE /compute/v2.1/os-server-groups/1c137e61-d13b-43b0-aca0-6b4b3b6a9572 => generated 117 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 21:03:16.547640 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-f1f4b144-01a8-49c2-a41b-60d5399acaec tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:03:16.574869 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-f1f4b144-01a8-49c2-a41b-60d5399acaec tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] HTTP exception thrown: Instance group d10f3144-a8a1-4453-9481-880f392239b4 could not be found. Oct 22 21:03:16.576482 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-f1f4b144-01a8-49c2-a41b-60d5399acaec tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Request method failure captured: Oct 22 21:03:16.576482 ncdv-master-1 devstack@n-api.service[138744]: request: DELETE /compute/v2.1/os-server-groups/d10f3144-a8a1-4453-9481-880f392239b4 HTTP/1.1 Oct 22 21:03:16.576482 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 21:03:16.576482 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 21:03:16.576482 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 21:03:16.576482 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 0 Oct 22 21:03:16.576482 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 21:03:16.576482 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 21:03:16.576482 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 21:03:16.576482 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 21:03:16.576482 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVFp25Ob3nw0LlX1zk2kv3p40qnKsRkvmmyqkG1Ts2xAzzirEULB7D_fx7Q1jpQhfeLvy8ZuelifqE_lGZD6s7rmRDMH1BnOWeJkLmIRmOe4DHpZ_id8rruG1yVPtRGP3uD0ViawCa7n-S5otlM-Rd16ltCvTHZZvHnnjV-O1B0lBbCE Oct 22 21:03:16.576482 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 21:03:16.576482 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 21:03:16.576482 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 21:03:16.576482 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 21:03:16.576482 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 21:03:16.576482 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 21:03:16.576482 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: 1dfacd9c525f486eaa04d19dbe2dc423 Oct 22 21:03:16.576482 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-ServerGroupTestJSON-1405628578 Oct 22 21:03:16.576482 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 21:03:16.576482 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 21:03:16.576482 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_1dfacd9c525f486eaa04d19dbe2dc423"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1dfacd9c525f486eaa04d19dbe2dc423"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/1dfacd9c525f486eaa04d19dbe2dc423"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1dfacd9c525f486eaa04d19dbe2dc423"}]}] Oct 22 21:03:16.576482 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-ServerGroupTestJSON-1405628578 Oct 22 21:03:16.576482 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: 1dfacd9c525f486eaa04d19dbe2dc423 Oct 22 21:03:16.576482 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-ServerGroupTestJSON-1405628578 Oct 22 21:03:16.576482 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-ServerGroupTestJSON-1405628578-project Oct 22 21:03:16.576482 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 21:03:16.576482 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 21:03:16.576482 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: 3adb02392d074b7eb08c94bbf1904547 Oct 22 21:03:16.576482 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-ServerGroupTestJSON-1405628578-project Oct 22 21:03:16.576482 ncdv-master-1 devstack@n-api.service[138744]: method: > Oct 22 21:03:16.576482 ncdv-master-1 devstack@n-api.service[138744]: exception: Instance group d10f3144-a8a1-4453-9481-880f392239b4 could not be found. Oct 22 21:03:16.576482 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': 'd10f3144-a8a1-4453-9481-880f392239b4'} Oct 22 21:03:16.576482 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:03:16.576482 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:03:16.576482 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 22 21:03:16.576482 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 22 21:03:16.576482 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 22 21:03:16.576482 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 22 21:03:16.576482 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 22 21:03:16.576482 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 22 21:03:16.576482 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 22 21:03:16.576482 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 22 21:03:16.576482 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 22 21:03:16.576482 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 22 21:03:16.576482 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group d10f3144-a8a1-4453-9481-880f392239b4 could not be found. Oct 22 21:03:16.576482 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:03:16.576482 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:03:16.576482 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:03:16.576482 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:03:16.576482 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:03:16.576482 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:03:16.576482 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:03:16.576482 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:03:16.576482 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:03:16.576482 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:03:16.576482 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 22 21:03:16.576482 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:03:16.576482 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group d10f3144-a8a1-4453-9481-880f392239b4 could not be found. Oct 22 21:03:16.576482 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:03:16.576482 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:03:16.576482 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:03:16.576482 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:03:16.581949 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:03:16.581949 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:03:16.581949 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:03:16.581949 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:03:16.581949 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group d10f3144-a8a1-4453-9481-880f392239b4 could not be found. Oct 22 21:03:16.581949 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:03:16.581949 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-f1f4b144-01a8-49c2-a41b-60d5399acaec tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Returning 404 to user: Instance group d10f3144-a8a1-4453-9481-880f392239b4 could not be found. {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:03:16.584490 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-f1f4b144-01a8-49c2-a41b-60d5399acaec tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] 10.222.0.18 "DELETE /compute/v2.1/os-server-groups/d10f3144-a8a1-4453-9481-880f392239b4" status: 404 len: 117 microversion: 2.1 time: 0.043694 Oct 22 21:03:16.585912 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1471/3054] 10.222.0.18 () {58 vars in 1266 bytes} [Sat Oct 22 21:03:16 2022] DELETE /compute/v2.1/os-server-groups/d10f3144-a8a1-4453-9481-880f392239b4 => generated 117 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 22 21:03:16.602409 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-e529908a-7d8f-44a9-8f48-b9fac5c2b629 tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:03:16.617593 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-8d0fc5eb-b3b5-447e-bc4b-5c6d16f5a13a tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] 10.222.0.18 "POST /compute/v2.1/servers/524c2c11-4a65-4360-93e4-e25349cb6416/action" status: 202 len: 0 microversion: 2.1 time: 0.718460 Oct 22 21:03:16.629870 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-e529908a-7d8f-44a9-8f48-b9fac5c2b629 tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] HTTP exception thrown: Instance group d8cb79a2-cbfb-42ab-a662-ed3f893cb818 could not be found. Oct 22 21:03:16.636921 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1584/3055] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 21:03:15 2022] POST /compute/v2.1/servers/524c2c11-4a65-4360-93e4-e25349cb6416/action => generated 0 bytes in 732 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 22 21:03:16.655605 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-e529908a-7d8f-44a9-8f48-b9fac5c2b629 tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Request method failure captured: Oct 22 21:03:16.655605 ncdv-master-1 devstack@n-api.service[138744]: request: DELETE /compute/v2.1/os-server-groups/d8cb79a2-cbfb-42ab-a662-ed3f893cb818 HTTP/1.1 Oct 22 21:03:16.655605 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 21:03:16.655605 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 21:03:16.655605 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 21:03:16.655605 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 0 Oct 22 21:03:16.655605 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 21:03:16.655605 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 21:03:16.655605 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 21:03:16.655605 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 21:03:16.655605 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVFp25Ob3nw0LlX1zk2kv3p40qnKsRkvmmyqkG1Ts2xAzzirEULB7D_fx7Q1jpQhfeLvy8ZuelifqE_lGZD6s7rmRDMH1BnOWeJkLmIRmOe4DHpZ_id8rruG1yVPtRGP3uD0ViawCa7n-S5otlM-Rd16ltCvTHZZvHnnjV-O1B0lBbCE Oct 22 21:03:16.655605 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 21:03:16.655605 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 21:03:16.655605 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 21:03:16.655605 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 21:03:16.655605 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 21:03:16.655605 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 21:03:16.655605 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: 1dfacd9c525f486eaa04d19dbe2dc423 Oct 22 21:03:16.655605 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-ServerGroupTestJSON-1405628578 Oct 22 21:03:16.655605 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 21:03:16.655605 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 21:03:16.655605 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_1dfacd9c525f486eaa04d19dbe2dc423"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1dfacd9c525f486eaa04d19dbe2dc423"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/1dfacd9c525f486eaa04d19dbe2dc423"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1dfacd9c525f486eaa04d19dbe2dc423"}]}] Oct 22 21:03:16.655605 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-ServerGroupTestJSON-1405628578 Oct 22 21:03:16.655605 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: 1dfacd9c525f486eaa04d19dbe2dc423 Oct 22 21:03:16.655605 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-ServerGroupTestJSON-1405628578 Oct 22 21:03:16.655605 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-ServerGroupTestJSON-1405628578-project Oct 22 21:03:16.655605 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 21:03:16.655605 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 21:03:16.655605 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: 3adb02392d074b7eb08c94bbf1904547 Oct 22 21:03:16.655605 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-ServerGroupTestJSON-1405628578-project Oct 22 21:03:16.655605 ncdv-master-1 devstack@n-api.service[138744]: method: > Oct 22 21:03:16.655605 ncdv-master-1 devstack@n-api.service[138744]: exception: Instance group d8cb79a2-cbfb-42ab-a662-ed3f893cb818 could not be found. Oct 22 21:03:16.655605 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': 'd8cb79a2-cbfb-42ab-a662-ed3f893cb818'} Oct 22 21:03:16.655605 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:03:16.655605 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:03:16.655605 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 22 21:03:16.655605 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 22 21:03:16.655605 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 22 21:03:16.655605 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 22 21:03:16.655605 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 22 21:03:16.655605 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 22 21:03:16.655605 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 22 21:03:16.655605 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 22 21:03:16.655605 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 22 21:03:16.655605 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 22 21:03:16.655605 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group d8cb79a2-cbfb-42ab-a662-ed3f893cb818 could not be found. Oct 22 21:03:16.655605 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:03:16.655605 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:03:16.655605 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:03:16.655605 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:03:16.655605 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:03:16.655605 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:03:16.655605 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:03:16.655605 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:03:16.655605 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:03:16.655605 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:03:16.655605 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 22 21:03:16.655605 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:03:16.655605 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group d8cb79a2-cbfb-42ab-a662-ed3f893cb818 could not be found. Oct 22 21:03:16.655605 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:03:16.655605 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:03:16.655605 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:03:16.655605 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:03:16.661594 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:03:16.661594 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:03:16.661594 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:03:16.661594 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:03:16.661594 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group d8cb79a2-cbfb-42ab-a662-ed3f893cb818 could not be found. Oct 22 21:03:16.661594 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:03:16.661594 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-e529908a-7d8f-44a9-8f48-b9fac5c2b629 tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Returning 404 to user: Instance group d8cb79a2-cbfb-42ab-a662-ed3f893cb818 could not be found. {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:03:16.661594 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-e529908a-7d8f-44a9-8f48-b9fac5c2b629 tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] 10.222.0.18 "DELETE /compute/v2.1/os-server-groups/d8cb79a2-cbfb-42ab-a662-ed3f893cb818" status: 404 len: 117 microversion: 2.1 time: 0.065450 Oct 22 21:03:16.661594 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1472/3056] 10.222.0.18 () {58 vars in 1266 bytes} [Sat Oct 22 21:03:16 2022] DELETE /compute/v2.1/os-server-groups/d8cb79a2-cbfb-42ab-a662-ed3f893cb818 => generated 117 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 21:03:16.663085 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-2a47f6de-0fd2-4167-9542-3cb1a20d44c0 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Calling method '.version_select at 0x7fd39efb65e0>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:03:16.670764 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-f65750aa-cb70-41f5-a359-cdf3af0d0701 tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:03:16.734208 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-f65750aa-cb70-41f5-a359-cdf3af0d0701 tempest-ServerGroupTestJSON-1405628578 tempest-ServerGroupTestJSON-1405628578-project] 10.222.0.18 "DELETE /compute/v2.1/os-server-groups/153f2eec-8150-44c3-879c-11c66f5f1da1" status: 204 len: 0 microversion: 2.1 time: 0.070696 Oct 22 21:03:16.734891 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1473/3057] 10.222.0.18 () {58 vars in 1266 bytes} [Sat Oct 22 21:03:16 2022] DELETE /compute/v2.1/os-server-groups/153f2eec-8150-44c3-879c-11c66f5f1da1 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 21:03:16.742501 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-956e666e-344a-426f-a58f-2b7f8a0d6c49 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:03:16.745639 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-956e666e-344a-426f-a58f-2b7f8a0d6c49 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] [instance: a99614d8-f2f7-4ce1-87e8-47f3af03d9f8] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:03:16.760361 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-956e666e-344a-426f-a58f-2b7f8a0d6c49 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:03:16.765156 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-956e666e-344a-426f-a58f-2b7f8a0d6c49 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:03:16.765934 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-956e666e-344a-426f-a58f-2b7f8a0d6c49 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:03:16.767903 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-956e666e-344a-426f-a58f-2b7f8a0d6c49 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:03:16.768554 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-956e666e-344a-426f-a58f-2b7f8a0d6c49 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:03:16.769153 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-956e666e-344a-426f-a58f-2b7f8a0d6c49 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:03:16.821924 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-2a47f6de-0fd2-4167-9542-3cb1a20d44c0 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] 10.222.0.18 "GET /compute/v2.1/images/a721137b-509e-48d8-8ac4-4f5f10aaa459" status: 200 len: 1439 microversion: 2.1 time: 0.179582 Oct 22 21:03:16.836831 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1585/3058] 10.222.0.18 () {58 vars in 1233 bytes} [Sat Oct 22 21:03:16 2022] GET /compute/v2.1/images/a721137b-509e-48d8-8ac4-4f5f10aaa459 => generated 1439 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:03:16.895074 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell0:SELECT=4 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:03:17.174665 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-d99a857a-491b-4b70-a03d-0f6664bb7e17 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:03:17.176610 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-d99a857a-491b-4b70-a03d-0f6664bb7e17 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] [instance: 2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:03:17.203093 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d99a857a-491b-4b70-a03d-0f6664bb7e17 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:03:17.209910 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d99a857a-491b-4b70-a03d-0f6664bb7e17 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:03:17.211916 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d99a857a-491b-4b70-a03d-0f6664bb7e17 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:03:17.223497 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d99a857a-491b-4b70-a03d-0f6664bb7e17 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:03:17.229860 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d99a857a-491b-4b70-a03d-0f6664bb7e17 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:03:17.232165 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d99a857a-491b-4b70-a03d-0f6664bb7e17 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:03:17.567446 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell0:SELECT=32 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:03:17.859146 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-d99a857a-491b-4b70-a03d-0f6664bb7e17 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:03:17.864119 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-956e666e-344a-426f-a58f-2b7f8a0d6c49 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1b410a64e0415a96d30f5040361137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd7873d6db4e09bc9ab9a048a6b1ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:03:17.879055 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-d99a857a-491b-4b70-a03d-0f6664bb7e17 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:03:17.880320 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-956e666e-344a-426f-a58f-2b7f8a0d6c49 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] 10.222.0.18 "GET /compute/v2.1/servers/a99614d8-f2f7-4ce1-87e8-47f3af03d9f8" status: 200 len: 1509 microversion: 2.1 time: 1.144108 Oct 22 21:03:17.882204 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1474/3059] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:03:16 2022] GET /compute/v2.1/servers/a99614d8-f2f7-4ce1-87e8-47f3af03d9f8 => generated 1509 bytes in 1146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:03:17.890720 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-d99a857a-491b-4b70-a03d-0f6664bb7e17 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:03:17.895015 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-3aea5987-0cf3-43c4-af7d-988cb08ab657 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Calling method '.version_select at 0x7fd39fee3550>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:03:17.903070 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:DELETE=3 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:03:17.907849 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-d99a857a-491b-4b70-a03d-0f6664bb7e17 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] 10.222.0.18 "GET /compute/v2.1/servers/2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac" status: 200 len: 1555 microversion: 2.91 time: 0.745693 Oct 22 21:03:17.909314 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1586/3060] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:03:17 2022] GET /compute/v2.1/servers/2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac => generated 1555 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:03:18.014059 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-3aea5987-0cf3-43c4-af7d-988cb08ab657 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] 10.222.0.18 "GET /compute/v2.1/images/a721137b-509e-48d8-8ac4-4f5f10aaa459" status: 200 len: 1439 microversion: 2.1 time: 0.122925 Oct 22 21:03:18.015647 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1475/3061] 10.222.0.18 () {58 vars in 1233 bytes} [Sat Oct 22 21:03:17 2022] GET /compute/v2.1/images/a721137b-509e-48d8-8ac4-4f5f10aaa459 => generated 1439 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:03:18.920716 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-d0b5f24a-d14b-42e0-ba21-58f5c873adb9 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:03:18.921530 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-d0b5f24a-d14b-42e0-ba21-58f5c873adb9 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] [instance: a99614d8-f2f7-4ce1-87e8-47f3af03d9f8] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:03:18.943924 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-b86db1bf-c3b5-4ff3-a487-c4263a7e116c tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:03:18.945248 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-b86db1bf-c3b5-4ff3-a487-c4263a7e116c tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] [instance: 2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:03:18.947610 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d0b5f24a-d14b-42e0-ba21-58f5c873adb9 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:03:18.949726 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d0b5f24a-d14b-42e0-ba21-58f5c873adb9 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:03:18.952158 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d0b5f24a-d14b-42e0-ba21-58f5c873adb9 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:03:18.953521 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d0b5f24a-d14b-42e0-ba21-58f5c873adb9 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:03:18.957385 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d0b5f24a-d14b-42e0-ba21-58f5c873adb9 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:03:18.959586 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d0b5f24a-d14b-42e0-ba21-58f5c873adb9 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:03:18.965124 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b86db1bf-c3b5-4ff3-a487-c4263a7e116c tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:03:18.967402 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b86db1bf-c3b5-4ff3-a487-c4263a7e116c tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:03:18.969292 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b86db1bf-c3b5-4ff3-a487-c4263a7e116c tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:03:18.971304 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b86db1bf-c3b5-4ff3-a487-c4263a7e116c tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:03:18.973903 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b86db1bf-c3b5-4ff3-a487-c4263a7e116c tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:03:18.974646 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b86db1bf-c3b5-4ff3-a487-c4263a7e116c tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:03:19.362645 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-b86db1bf-c3b5-4ff3-a487-c4263a7e116c tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:03:19.387855 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-b86db1bf-c3b5-4ff3-a487-c4263a7e116c tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:03:19.392792 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-b86db1bf-c3b5-4ff3-a487-c4263a7e116c tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:03:19.415188 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-b86db1bf-c3b5-4ff3-a487-c4263a7e116c tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] 10.222.0.18 "GET /compute/v2.1/servers/2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac" status: 200 len: 1555 microversion: 2.91 time: 0.476484 Oct 22 21:03:19.417914 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1476/3062] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:03:18 2022] GET /compute/v2.1/servers/2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac => generated 1555 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 22 21:03:19.446758 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-65f5d95d-a365-4edd-8015-bb803845c2b9 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Calling method '.version_select at 0x7fd3a41e3430>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:03:19.531503 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-65f5d95d-a365-4edd-8015-bb803845c2b9 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] 10.222.0.18 "GET /compute/v2.1/images/a721137b-509e-48d8-8ac4-4f5f10aaa459" status: 200 len: 1439 microversion: 2.1 time: 0.102630 Oct 22 21:03:19.543861 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1477/3063] 10.222.0.18 () {58 vars in 1233 bytes} [Sat Oct 22 21:03:19 2022] GET /compute/v2.1/images/a721137b-509e-48d8-8ac4-4f5f10aaa459 => generated 1439 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:03:19.958155 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-d0b5f24a-d14b-42e0-ba21-58f5c873adb9 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1b410a64e0415a96d30f5040361137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd7873d6db4e09bc9ab9a048a6b1ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:03:19.969436 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-d0b5f24a-d14b-42e0-ba21-58f5c873adb9 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] 10.222.0.18 "GET /compute/v2.1/servers/a99614d8-f2f7-4ce1-87e8-47f3af03d9f8" status: 200 len: 1530 microversion: 2.1 time: 1.064717 Oct 22 21:03:19.973067 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1587/3064] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:03:18 2022] GET /compute/v2.1/servers/a99614d8-f2f7-4ce1-87e8-47f3af03d9f8 => generated 1530 bytes in 1069 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:03:20.451395 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-c203ac0c-ae2e-4640-8df2-5b48f5c050db tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:03:20.452077 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-c203ac0c-ae2e-4640-8df2-5b48f5c050db tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] [instance: 2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:03:20.474772 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c203ac0c-ae2e-4640-8df2-5b48f5c050db tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:03:20.475301 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c203ac0c-ae2e-4640-8df2-5b48f5c050db tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:03:20.476093 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c203ac0c-ae2e-4640-8df2-5b48f5c050db tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:03:20.476965 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c203ac0c-ae2e-4640-8df2-5b48f5c050db tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:03:20.487196 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c203ac0c-ae2e-4640-8df2-5b48f5c050db tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:03:20.488027 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c203ac0c-ae2e-4640-8df2-5b48f5c050db tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:03:20.552187 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-57655740-bcc4-4554-9f73-ffdbba3a7e39 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Calling method '.version_select at 0x7fd39efa2310>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:03:20.792193 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-c203ac0c-ae2e-4640-8df2-5b48f5c050db tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:03:20.832342 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-c203ac0c-ae2e-4640-8df2-5b48f5c050db tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:03:20.842388 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-c203ac0c-ae2e-4640-8df2-5b48f5c050db tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:03:20.866682 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-c203ac0c-ae2e-4640-8df2-5b48f5c050db tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] 10.222.0.18 "GET /compute/v2.1/servers/2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac" status: 200 len: 1555 microversion: 2.91 time: 0.418311 Oct 22 21:03:20.869405 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1478/3065] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:03:20 2022] GET /compute/v2.1/servers/2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac => generated 1555 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:03:21.010479 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-e6e52792-5cf1-4e0a-87fb-675ffba36836 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:03:21.011753 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-e6e52792-5cf1-4e0a-87fb-675ffba36836 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] [instance: a99614d8-f2f7-4ce1-87e8-47f3af03d9f8] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:03:21.059414 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e6e52792-5cf1-4e0a-87fb-675ffba36836 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:03:21.063161 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e6e52792-5cf1-4e0a-87fb-675ffba36836 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:03:21.071128 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e6e52792-5cf1-4e0a-87fb-675ffba36836 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:03:21.074725 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e6e52792-5cf1-4e0a-87fb-675ffba36836 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:03:21.086683 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e6e52792-5cf1-4e0a-87fb-675ffba36836 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:03:21.088888 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e6e52792-5cf1-4e0a-87fb-675ffba36836 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:03:22.013180 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-e6e52792-5cf1-4e0a-87fb-675ffba36836 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1b410a64e0415a96d30f5040361137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd7873d6db4e09bc9ab9a048a6b1ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:03:22.025448 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-e6e52792-5cf1-4e0a-87fb-675ffba36836 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] 10.222.0.18 "GET /compute/v2.1/servers/a99614d8-f2f7-4ce1-87e8-47f3af03d9f8" status: 200 len: 1530 microversion: 2.1 time: 1.028451 Oct 22 21:03:22.034065 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1479/3066] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:03:20 2022] GET /compute/v2.1/servers/a99614d8-f2f7-4ce1-87e8-47f3af03d9f8 => generated 1530 bytes in 1038 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:03:22.056978 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-8f14e6bf-f7b7-46a9-8884-06806d152bc5 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:03:22.063015 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-8f14e6bf-f7b7-46a9-8884-06806d152bc5 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] [instance: 2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:03:22.101585 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8f14e6bf-f7b7-46a9-8884-06806d152bc5 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:03:22.104769 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8f14e6bf-f7b7-46a9-8884-06806d152bc5 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:03:22.106654 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8f14e6bf-f7b7-46a9-8884-06806d152bc5 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:03:22.112477 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8f14e6bf-f7b7-46a9-8884-06806d152bc5 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:03:22.114231 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8f14e6bf-f7b7-46a9-8884-06806d152bc5 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:03:22.114932 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8f14e6bf-f7b7-46a9-8884-06806d152bc5 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:03:22.604657 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-8f14e6bf-f7b7-46a9-8884-06806d152bc5 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:03:22.614436 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-8f14e6bf-f7b7-46a9-8884-06806d152bc5 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:03:22.636900 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-8f14e6bf-f7b7-46a9-8884-06806d152bc5 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:03:22.716294 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-8f14e6bf-f7b7-46a9-8884-06806d152bc5 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] 10.222.0.18 "GET /compute/v2.1/servers/2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac" status: 200 len: 1555 microversion: 2.91 time: 0.670048 Oct 22 21:03:22.719064 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1480/3067] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:03:22 2022] GET /compute/v2.1/servers/2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac => generated 1555 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:03:23.063215 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-d474ed3e-cc6f-4c3a-a95d-5d2d36d66fcf tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:03:23.064560 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-d474ed3e-cc6f-4c3a-a95d-5d2d36d66fcf tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] [instance: a99614d8-f2f7-4ce1-87e8-47f3af03d9f8] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:03:23.084240 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d474ed3e-cc6f-4c3a-a95d-5d2d36d66fcf tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:03:23.097560 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d474ed3e-cc6f-4c3a-a95d-5d2d36d66fcf tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:03:23.098383 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d474ed3e-cc6f-4c3a-a95d-5d2d36d66fcf tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:03:23.099405 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d474ed3e-cc6f-4c3a-a95d-5d2d36d66fcf tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:03:23.113809 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d474ed3e-cc6f-4c3a-a95d-5d2d36d66fcf tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:03:23.118375 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d474ed3e-cc6f-4c3a-a95d-5d2d36d66fcf tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:03:24.672755 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-d474ed3e-cc6f-4c3a-a95d-5d2d36d66fcf tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1b410a64e0415a96d30f5040361137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd7873d6db4e09bc9ab9a048a6b1ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:03:24.699240 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-d474ed3e-cc6f-4c3a-a95d-5d2d36d66fcf tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] 10.222.0.18 "GET /compute/v2.1/servers/a99614d8-f2f7-4ce1-87e8-47f3af03d9f8" status: 200 len: 1530 microversion: 2.1 time: 1.637671 Oct 22 21:03:24.718348 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1481/3068] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:03:23 2022] GET /compute/v2.1/servers/a99614d8-f2f7-4ce1-87e8-47f3af03d9f8 => generated 1530 bytes in 1660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:03:25.556778 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-1a8040d7-76a0-4298-8e78-29d31bbe906d tempest-SecurityGroupRulesNegativeTestJSON-1780227540 tempest-SecurityGroupRulesNegativeTestJSON-1780227540-project] Action: 'create', calling method: .version_select at 0x7fd39f626b80>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-402931402", "description": "tempest-description-1170260307"}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:03:26.728309 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-1a8040d7-76a0-4298-8e78-29d31bbe906d tempest-SecurityGroupRulesNegativeTestJSON-1780227540 tempest-SecurityGroupRulesNegativeTestJSON-1780227540-project] 10.222.0.18 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 2.008702 Oct 22 21:03:26.730115 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1482/3069] 10.222.0.18 () {60 vars in 1180 bytes} [Sat Oct 22 21:03:24 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 2011 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:03:26.748028 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-414885d8-a67e-4dd1-8b62-dffeb651548e tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:03:26.748952 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-414885d8-a67e-4dd1-8b62-dffeb651548e tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] [instance: 2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:03:26.768760 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-414885d8-a67e-4dd1-8b62-dffeb651548e tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:03:26.769509 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-414885d8-a67e-4dd1-8b62-dffeb651548e tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:03:26.771888 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-414885d8-a67e-4dd1-8b62-dffeb651548e tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:03:26.774282 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-414885d8-a67e-4dd1-8b62-dffeb651548e tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:03:26.776232 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-414885d8-a67e-4dd1-8b62-dffeb651548e tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:03:26.783413 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-414885d8-a67e-4dd1-8b62-dffeb651548e tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:03:27.146797 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-414885d8-a67e-4dd1-8b62-dffeb651548e tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:03:27.156021 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-414885d8-a67e-4dd1-8b62-dffeb651548e tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:03:27.169383 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-414885d8-a67e-4dd1-8b62-dffeb651548e tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:03:27.175869 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-414885d8-a67e-4dd1-8b62-dffeb651548e tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] 10.222.0.18 "GET /compute/v2.1/servers/2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac" status: 200 len: 1555 microversion: 2.91 time: 0.432789 Oct 22 21:03:27.176663 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1483/3070] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:03:26 2022] GET /compute/v2.1/servers/2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac => generated 1555 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:03:27.194059 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-c3be7728-d414-43d3-ab72-7f9642fba856 req-449dec76-37df-4eab-83ee-2161e2fc1339 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "524c2c11-4a65-4360-93e4-e25349cb6416", "name": "network-vif-plugged", "status": "completed", "tag": "7e016b42-09b0-4f7f-9ce3-9e528785b3cd"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:03:27.217076 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-c3be7728-d414-43d3-ab72-7f9642fba856 req-449dec76-37df-4eab-83ee-2161e2fc1339 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:03:27.217890 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-c3be7728-d414-43d3-ab72-7f9642fba856 req-449dec76-37df-4eab-83ee-2161e2fc1339 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:03:27.218502 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-c3be7728-d414-43d3-ab72-7f9642fba856 req-449dec76-37df-4eab-83ee-2161e2fc1339 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:03:27.239640 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-c3be7728-d414-43d3-ab72-7f9642fba856 req-449dec76-37df-4eab-83ee-2161e2fc1339 service nova] Creating event network-vif-plugged:7e016b42-09b0-4f7f-9ce3-9e528785b3cd for instance 524c2c11-4a65-4360-93e4-e25349cb6416 on nch2-master-1 Oct 22 21:03:27.249598 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-c3be7728-d414-43d3-ab72-7f9642fba856 req-449dec76-37df-4eab-83ee-2161e2fc1339 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071452 Oct 22 21:03:27.250850 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1484/3071] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:03:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:03:27.266026 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-ae016d7c-ebd4-43fb-a003-305c1bfa565c tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:03:27.275233 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-ae016d7c-ebd4-43fb-a003-305c1bfa565c tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] [instance: a99614d8-f2f7-4ce1-87e8-47f3af03d9f8] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:03:27.295382 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ae016d7c-ebd4-43fb-a003-305c1bfa565c tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:03:27.297191 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ae016d7c-ebd4-43fb-a003-305c1bfa565c tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:03:27.297900 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ae016d7c-ebd4-43fb-a003-305c1bfa565c tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:03:27.306927 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ae016d7c-ebd4-43fb-a003-305c1bfa565c tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:03:27.308005 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ae016d7c-ebd4-43fb-a003-305c1bfa565c tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:03:27.308655 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ae016d7c-ebd4-43fb-a003-305c1bfa565c tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:03:27.655051 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-ae016d7c-ebd4-43fb-a003-305c1bfa565c tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1b410a64e0415a96d30f5040361137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd7873d6db4e09bc9ab9a048a6b1ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:03:27.668040 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-ae016d7c-ebd4-43fb-a003-305c1bfa565c tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] 10.222.0.18 "GET /compute/v2.1/servers/a99614d8-f2f7-4ce1-87e8-47f3af03d9f8" status: 200 len: 1525 microversion: 2.1 time: 0.415708 Oct 22 21:03:27.679664 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1485/3072] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:03:27 2022] GET /compute/v2.1/servers/a99614d8-f2f7-4ce1-87e8-47f3af03d9f8 => generated 1525 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:03:27.691407 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-cb276d4a-adaf-498d-9414-f93af33ff50d tempest-SecurityGroupRulesNegativeTestJSON-1780227540 tempest-SecurityGroupRulesNegativeTestJSON-1780227540-project] Action: 'create', calling method: .version_select at 0x7fd3a4823f70>, body: {"security_group_rule": {"parent_group_id": "e8ebe1ba-de37-484a-8e8f-1dd8b5fc0fec", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:03:28.421890 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-cb276d4a-adaf-498d-9414-f93af33ff50d tempest-SecurityGroupRulesNegativeTestJSON-1780227540 tempest-SecurityGroupRulesNegativeTestJSON-1780227540-project] 10.222.0.18 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.740764 Oct 22 21:03:28.423207 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1486/3073] 10.222.0.18 () {60 vars in 1195 bytes} [Sat Oct 22 21:03:27 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:03:28.428112 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-aa7c604f-c32b-4cde-8c91-bbe1922fd3d9 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:03:28.429012 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-aa7c604f-c32b-4cde-8c91-bbe1922fd3d9 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] [instance: 2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:03:28.435696 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-aa7c604f-c32b-4cde-8c91-bbe1922fd3d9 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:03:28.436426 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-aa7c604f-c32b-4cde-8c91-bbe1922fd3d9 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:03:28.437050 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-aa7c604f-c32b-4cde-8c91-bbe1922fd3d9 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:03:28.437925 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-aa7c604f-c32b-4cde-8c91-bbe1922fd3d9 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:03:28.438547 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-aa7c604f-c32b-4cde-8c91-bbe1922fd3d9 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:03:28.439204 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-aa7c604f-c32b-4cde-8c91-bbe1922fd3d9 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:03:28.671003 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-aa7c604f-c32b-4cde-8c91-bbe1922fd3d9 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:03:28.683081 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-aa7c604f-c32b-4cde-8c91-bbe1922fd3d9 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:03:28.692744 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-aa7c604f-c32b-4cde-8c91-bbe1922fd3d9 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:03:28.720535 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-aa7c604f-c32b-4cde-8c91-bbe1922fd3d9 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] 10.222.0.18 "GET /compute/v2.1/servers/2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac" status: 200 len: 1555 microversion: 2.91 time: 0.295928 Oct 22 21:03:28.724392 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1487/3074] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:03:28 2022] GET /compute/v2.1/servers/2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac => generated 1555 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:03:28.733533 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-4144a127-b707-42c2-b486-0178c5f23582 tempest-SecurityGroupRulesNegativeTestJSON-1780227540 tempest-SecurityGroupRulesNegativeTestJSON-1780227540-project] Action: 'create', calling method: .version_select at 0x7fd39f6b1a60>, body: {"security_group_rule": {"parent_group_id": "e8ebe1ba-de37-484a-8e8f-1dd8b5fc0fec", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:03:29.005523 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-4144a127-b707-42c2-b486-0178c5f23582 tempest-SecurityGroupRulesNegativeTestJSON-1780227540 tempest-SecurityGroupRulesNegativeTestJSON-1780227540-project] HTTP exception thrown: This rule already exists in group e8ebe1ba-de37-484a-8e8f-1dd8b5fc0fec Oct 22 21:03:29.007700 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-4144a127-b707-42c2-b486-0178c5f23582 tempest-SecurityGroupRulesNegativeTestJSON-1780227540 tempest-SecurityGroupRulesNegativeTestJSON-1780227540-project] Request method failure captured: Oct 22 21:03:29.007700 ncdv-master-1 devstack@n-api.service[138744]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 22 21:03:29.007700 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 21:03:29.007700 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 21:03:29.007700 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 21:03:29.007700 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 138 Oct 22 21:03:29.007700 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 21:03:29.007700 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 21:03:29.007700 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 21:03:29.007700 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 21:03:29.007700 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVFqbu_R5ZZt7r1Qx2myjj93ExuOnZLi52tG3A3oDhEfqPoewi_qJEJWs_7tWU4KxappJ2YMyXl2Dz4PGLzxXBHaoG5OSi5eMGeB0pf6rIEyfwD2izL-PPnTkecuttFuGDwiYd54H3A0USh1GunXi2C-jYxbjBal94AHEDvWQm5wmpEQ Oct 22 21:03:29.007700 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 21:03:29.007700 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 21:03:29.007700 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 21:03:29.007700 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 21:03:29.007700 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 21:03:29.007700 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 21:03:29.007700 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: c969cfe1b19a4140bf43bf8e15bf38a3 Oct 22 21:03:29.007700 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1780227540 Oct 22 21:03:29.007700 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 21:03:29.007700 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 21:03:29.007700 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_c969cfe1b19a4140bf43bf8e15bf38a3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c969cfe1b19a4140bf43bf8e15bf38a3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/c969cfe1b19a4140bf43bf8e15bf38a3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c969cfe1b19a4140bf43bf8e15bf38a3"}]}] Oct 22 21:03:29.007700 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1780227540 Oct 22 21:03:29.007700 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: c969cfe1b19a4140bf43bf8e15bf38a3 Oct 22 21:03:29.007700 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1780227540 Oct 22 21:03:29.007700 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1780227540-project Oct 22 21:03:29.007700 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 21:03:29.007700 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 21:03:29.007700 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: 6f3f378c7a9542ffbd20bf470d838ce6 Oct 22 21:03:29.007700 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1780227540-project Oct 22 21:03:29.007700 ncdv-master-1 devstack@n-api.service[138744]: Oct 22 21:03:29.007700 ncdv-master-1 devstack@n-api.service[138744]: {"security_group_rule": {"parent_group_id": "e8ebe1ba-de37-484a-8e8f-1dd8b5fc0fec", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Oct 22 21:03:29.007700 ncdv-master-1 devstack@n-api.service[138744]: method: Oct 22 21:03:29.007700 ncdv-master-1 devstack@n-api.service[138744]: exception: This rule already exists in group e8ebe1ba-de37-484a-8e8f-1dd8b5fc0fec Oct 22 21:03:29.007700 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'e8ebe1ba-de37-484a-8e8f-1dd8b5fc0fec', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Oct 22 21:03:29.007700 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:03:29.007700 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:03:29.007700 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 324, in create Oct 22 21:03:29.007700 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi security_group_api.create_security_group_rule( Oct 22 21:03:29.007700 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 186, in create_security_group_rule Oct 22 21:03:29.007700 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Oct 22 21:03:29.007700 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: This rule already exists in group e8ebe1ba-de37-484a-8e8f-1dd8b5fc0fec Oct 22 21:03:29.007700 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:03:29.007700 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:03:29.007700 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:03:29.007700 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:03:29.007700 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:03:29.007700 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:03:29.007700 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:03:29.007700 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:03:29.007700 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 22 21:03:29.007700 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 22 21:03:29.007700 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:03:29.007700 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:03:29.007700 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 327, in create Oct 22 21:03:29.007700 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 22 21:03:29.007700 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: This rule already exists in group e8ebe1ba-de37-484a-8e8f-1dd8b5fc0fec Oct 22 21:03:29.007700 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:03:29.007700 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:03:29.007700 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:03:29.007700 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:03:29.007700 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:03:29.007700 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:03:29.013226 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:03:29.013226 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:03:29.013226 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: This rule already exists in group e8ebe1ba-de37-484a-8e8f-1dd8b5fc0fec Oct 22 21:03:29.013226 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:03:29.014594 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-4144a127-b707-42c2-b486-0178c5f23582 tempest-SecurityGroupRulesNegativeTestJSON-1780227540 tempest-SecurityGroupRulesNegativeTestJSON-1780227540-project] Returning 400 to user: This rule already exists in group e8ebe1ba-de37-484a-8e8f-1dd8b5fc0fec {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:03:29.015714 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-4144a127-b707-42c2-b486-0178c5f23582 tempest-SecurityGroupRulesNegativeTestJSON-1780227540 tempest-SecurityGroupRulesNegativeTestJSON-1780227540-project] 10.222.0.18 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 114 microversion: 2.1 time: 0.290220 Oct 22 21:03:29.016846 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1488/3075] 10.222.0.18 () {60 vars in 1195 bytes} [Sat Oct 22 21:03:28 2022] POST /compute/v2.1/os-security-group-rules => generated 114 bytes in 292 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 22 21:03:29.027360 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-a2defec1-85a3-4a19-a01e-a282f780df25 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:03:29.033674 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-a2defec1-85a3-4a19-a01e-a282f780df25 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] [instance: a99614d8-f2f7-4ce1-87e8-47f3af03d9f8] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:03:29.059282 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a2defec1-85a3-4a19-a01e-a282f780df25 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:03:29.066231 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a2defec1-85a3-4a19-a01e-a282f780df25 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:03:29.066920 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a2defec1-85a3-4a19-a01e-a282f780df25 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:03:29.068584 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a2defec1-85a3-4a19-a01e-a282f780df25 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:03:29.071604 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a2defec1-85a3-4a19-a01e-a282f780df25 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:03:29.072283 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a2defec1-85a3-4a19-a01e-a282f780df25 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:03:29.139295 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_api:SELECT=2 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:03:29.528663 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-a2defec1-85a3-4a19-a01e-a282f780df25 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1b410a64e0415a96d30f5040361137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd7873d6db4e09bc9ab9a048a6b1ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:03:29.553667 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-a2defec1-85a3-4a19-a01e-a282f780df25 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] 10.222.0.18 "GET /compute/v2.1/servers/a99614d8-f2f7-4ce1-87e8-47f3af03d9f8" status: 200 len: 1525 microversion: 2.1 time: 0.535480 Oct 22 21:03:29.554740 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1489/3076] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:03:29 2022] GET /compute/v2.1/servers/a99614d8-f2f7-4ce1-87e8-47f3af03d9f8 => generated 1525 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:03:29.560411 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-2c6bf448-ced5-4039-96cf-d236d74a1570 tempest-SecurityGroupRulesNegativeTestJSON-1780227540 tempest-SecurityGroupRulesNegativeTestJSON-1780227540-project] Calling method '.version_select at 0x7fd3a8b26ee0>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:03:29.963114 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:03:30.144953 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-2c6bf448-ced5-4039-96cf-d236d74a1570 tempest-SecurityGroupRulesNegativeTestJSON-1780227540 tempest-SecurityGroupRulesNegativeTestJSON-1780227540-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-group-rules/ad87fd54-bb8d-43a6-8654-ecd58802f121" status: 202 len: 0 microversion: 2.1 time: 0.588495 Oct 22 21:03:30.146749 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1490/3077] 10.222.0.18 () {58 vars in 1287 bytes} [Sat Oct 22 21:03:29 2022] DELETE /compute/v2.1/os-security-group-rules/ad87fd54-bb8d-43a6-8654-ecd58802f121 => generated 0 bytes in 590 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 21:03:30.155970 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-bc70540b-dfdf-47fe-b4ea-70a26a61a584 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:03:30.156797 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-bc70540b-dfdf-47fe-b4ea-70a26a61a584 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] [instance: 2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:03:30.173101 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bc70540b-dfdf-47fe-b4ea-70a26a61a584 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:03:30.178936 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bc70540b-dfdf-47fe-b4ea-70a26a61a584 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:03:30.180583 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bc70540b-dfdf-47fe-b4ea-70a26a61a584 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:03:30.182562 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bc70540b-dfdf-47fe-b4ea-70a26a61a584 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:03:30.186614 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bc70540b-dfdf-47fe-b4ea-70a26a61a584 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:03:30.192504 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bc70540b-dfdf-47fe-b4ea-70a26a61a584 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:03:30.290442 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:03:30.434679 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-bc70540b-dfdf-47fe-b4ea-70a26a61a584 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:03:30.463446 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-bc70540b-dfdf-47fe-b4ea-70a26a61a584 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:03:30.472876 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-bc70540b-dfdf-47fe-b4ea-70a26a61a584 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:03:30.492809 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-bc70540b-dfdf-47fe-b4ea-70a26a61a584 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] 10.222.0.18 "GET /compute/v2.1/servers/2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac" status: 200 len: 1555 microversion: 2.91 time: 0.341267 Oct 22 21:03:30.503392 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1491/3078] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:03:30 2022] GET /compute/v2.1/servers/2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac => generated 1555 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:03:30.505679 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-5576205e-a6f4-4788-8089-5e146d4275c8 req-ce31c118-b140-417d-bfb8-a540a9cfdec0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a99614d8-f2f7-4ce1-87e8-47f3af03d9f8", "name": "network-vif-plugged", "status": "completed", "tag": "de29f75a-6453-4e65-9533-8bc1ec9252f5"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:03:30.528797 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-5576205e-a6f4-4788-8089-5e146d4275c8 req-ce31c118-b140-417d-bfb8-a540a9cfdec0 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:03:30.529465 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-5576205e-a6f4-4788-8089-5e146d4275c8 req-ce31c118-b140-417d-bfb8-a540a9cfdec0 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:03:30.529838 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-5576205e-a6f4-4788-8089-5e146d4275c8 req-ce31c118-b140-417d-bfb8-a540a9cfdec0 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:03:30.559320 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-5576205e-a6f4-4788-8089-5e146d4275c8 req-ce31c118-b140-417d-bfb8-a540a9cfdec0 service nova] Creating event network-vif-plugged:de29f75a-6453-4e65-9533-8bc1ec9252f5 for instance a99614d8-f2f7-4ce1-87e8-47f3af03d9f8 on nch1-master-1 Oct 22 21:03:30.578859 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-5576205e-a6f4-4788-8089-5e146d4275c8 req-ce31c118-b140-417d-bfb8-a540a9cfdec0 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078581 Oct 22 21:03:30.580295 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1492/3079] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:03:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:03:30.614491 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-7c63bda4-0ff1-42a9-909c-5d72b09b390d tempest-SecurityGroupRulesNegativeTestJSON-1780227540 tempest-SecurityGroupRulesNegativeTestJSON-1780227540-project] Action: 'create', calling method: .version_select at 0x7fd3a43b9160>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1527134238", "description": "tempest-description-2050289119"}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:03:31.114517 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-7c63bda4-0ff1-42a9-909c-5d72b09b390d tempest-SecurityGroupRulesNegativeTestJSON-1780227540 tempest-SecurityGroupRulesNegativeTestJSON-1780227540-project] 10.222.0.18 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 0.531096 Oct 22 21:03:31.115703 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1493/3080] 10.222.0.18 () {60 vars in 1180 bytes} [Sat Oct 22 21:03:30 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:03:31.121104 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-8bf80ab6-f946-47d2-8c71-644684f3715a tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:03:31.122099 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-8bf80ab6-f946-47d2-8c71-644684f3715a tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] [instance: a99614d8-f2f7-4ce1-87e8-47f3af03d9f8] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:03:31.153214 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8bf80ab6-f946-47d2-8c71-644684f3715a tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:03:31.153734 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8bf80ab6-f946-47d2-8c71-644684f3715a tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:03:31.154193 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8bf80ab6-f946-47d2-8c71-644684f3715a tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:03:31.154929 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8bf80ab6-f946-47d2-8c71-644684f3715a tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:03:31.155533 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8bf80ab6-f946-47d2-8c71-644684f3715a tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:03:31.155875 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8bf80ab6-f946-47d2-8c71-644684f3715a tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:03:31.699215 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-8bf80ab6-f946-47d2-8c71-644684f3715a tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1b410a64e0415a96d30f5040361137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd7873d6db4e09bc9ab9a048a6b1ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:03:31.709919 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-8bf80ab6-f946-47d2-8c71-644684f3715a tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] 10.222.0.18 "GET /compute/v2.1/servers/a99614d8-f2f7-4ce1-87e8-47f3af03d9f8" status: 200 len: 1525 microversion: 2.1 time: 0.592800 Oct 22 21:03:31.714832 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1494/3081] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:03:31 2022] GET /compute/v2.1/servers/a99614d8-f2f7-4ce1-87e8-47f3af03d9f8 => generated 1525 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:03:31.729238 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-dba83e00-f274-431b-a773-8ea1d9409077 tempest-SecurityGroupRulesNegativeTestJSON-1780227540 tempest-SecurityGroupRulesNegativeTestJSON-1780227540-project] Action: 'create', calling method: .version_select at 0x7fd3a4248dc0>, body: {"security_group_rule": {"parent_group_id": "fd4cd22b-1e00-4925-9f53-08476c502017", "ip_protocol": "tcp", "from_port": 929272391, "to_port": 22}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:03:31.837308 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-dba83e00-f274-431b-a773-8ea1d9409077 tempest-SecurityGroupRulesNegativeTestJSON-1780227540 tempest-SecurityGroupRulesNegativeTestJSON-1780227540-project] HTTP exception thrown: Invalid port range 929272391:22. Former value cannot be greater than the later Oct 22 21:03:31.841023 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-dba83e00-f274-431b-a773-8ea1d9409077 tempest-SecurityGroupRulesNegativeTestJSON-1780227540 tempest-SecurityGroupRulesNegativeTestJSON-1780227540-project] Request method failure captured: Oct 22 21:03:31.841023 ncdv-master-1 devstack@n-api.service[138744]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 22 21:03:31.841023 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 21:03:31.841023 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 21:03:31.841023 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 21:03:31.841023 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 145 Oct 22 21:03:31.841023 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 21:03:31.841023 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 21:03:31.841023 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 21:03:31.841023 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 21:03:31.841023 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVFqbu_R5ZZt7r1Qx2myjj93ExuOnZLi52tG3A3oDhEfqPoewi_qJEJWs_7tWU4KxappJ2YMyXl2Dz4PGLzxXBHaoG5OSi5eMGeB0pf6rIEyfwD2izL-PPnTkecuttFuGDwiYd54H3A0USh1GunXi2C-jYxbjBal94AHEDvWQm5wmpEQ Oct 22 21:03:31.841023 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 21:03:31.841023 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 21:03:31.841023 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 21:03:31.841023 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 21:03:31.841023 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 21:03:31.841023 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 21:03:31.841023 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: c969cfe1b19a4140bf43bf8e15bf38a3 Oct 22 21:03:31.841023 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1780227540 Oct 22 21:03:31.841023 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 21:03:31.841023 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 21:03:31.841023 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_c969cfe1b19a4140bf43bf8e15bf38a3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c969cfe1b19a4140bf43bf8e15bf38a3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/c969cfe1b19a4140bf43bf8e15bf38a3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c969cfe1b19a4140bf43bf8e15bf38a3"}]}] Oct 22 21:03:31.841023 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1780227540 Oct 22 21:03:31.841023 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: c969cfe1b19a4140bf43bf8e15bf38a3 Oct 22 21:03:31.841023 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1780227540 Oct 22 21:03:31.841023 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1780227540-project Oct 22 21:03:31.841023 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 21:03:31.841023 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 21:03:31.841023 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: 6f3f378c7a9542ffbd20bf470d838ce6 Oct 22 21:03:31.841023 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1780227540-project Oct 22 21:03:31.841023 ncdv-master-1 devstack@n-api.service[138744]: Oct 22 21:03:31.841023 ncdv-master-1 devstack@n-api.service[138744]: {"security_group_rule": {"parent_group_id": "fd4cd22b-1e00-4925-9f53-08476c502017", "ip_protocol": "tcp", "from_port": 929272391, "to_port": 22}} Oct 22 21:03:31.841023 ncdv-master-1 devstack@n-api.service[138744]: method: Oct 22 21:03:31.841023 ncdv-master-1 devstack@n-api.service[138744]: exception: Invalid port range 929272391:22. Former value cannot be greater than the later Oct 22 21:03:31.841023 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'fd4cd22b-1e00-4925-9f53-08476c502017', 'ip_protocol': 'tcp', 'from_port': 929272391, 'to_port': 22}}} Oct 22 21:03:31.841023 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:03:31.841023 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:03:31.841023 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 22 21:03:31.841023 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 22 21:03:31.841023 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 22 21:03:31.841023 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 22 21:03:31.841023 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 22 21:03:31.841023 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 22 21:03:31.841023 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Oct 22 21:03:31.841023 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Oct 22 21:03:31.841023 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 929272391:22. Former value cannot be greater than the later Oct 22 21:03:31.841023 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:03:31.841023 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:03:31.841023 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:03:31.841023 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:03:31.841023 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:03:31.841023 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:03:31.841023 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:03:31.841023 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:03:31.841023 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 22 21:03:31.841023 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 22 21:03:31.841023 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:03:31.841023 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:03:31.841023 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 22 21:03:31.841023 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 22 21:03:31.841023 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 929272391:22. Former value cannot be greater than the later Oct 22 21:03:31.841023 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:03:31.845402 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:03:31.845402 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:03:31.845402 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:03:31.845402 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:03:31.845402 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:03:31.845402 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:03:31.845402 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:03:31.845402 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 929272391:22. Former value cannot be greater than the later Oct 22 21:03:31.845402 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:03:31.848097 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-dba83e00-f274-431b-a773-8ea1d9409077 tempest-SecurityGroupRulesNegativeTestJSON-1780227540 tempest-SecurityGroupRulesNegativeTestJSON-1780227540-project] Returning 400 to user: Invalid port range 929272391:22. Former value cannot be greater than the later {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:03:31.849227 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-dba83e00-f274-431b-a773-8ea1d9409077 tempest-SecurityGroupRulesNegativeTestJSON-1780227540 tempest-SecurityGroupRulesNegativeTestJSON-1780227540-project] 10.222.0.18 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 122 microversion: 2.1 time: 0.133139 Oct 22 21:03:31.850036 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1495/3082] 10.222.0.18 () {60 vars in 1195 bytes} [Sat Oct 22 21:03:31 2022] POST /compute/v2.1/os-security-group-rules => generated 122 bytes in 134 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 22 21:03:31.861996 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-00404640-2e4c-496b-9bcf-d3d2a18d5e54 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:03:31.863913 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-00404640-2e4c-496b-9bcf-d3d2a18d5e54 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] [instance: 2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:03:31.882629 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-00404640-2e4c-496b-9bcf-d3d2a18d5e54 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:03:31.889322 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-00404640-2e4c-496b-9bcf-d3d2a18d5e54 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:03:31.889933 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-00404640-2e4c-496b-9bcf-d3d2a18d5e54 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:03:31.890811 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-00404640-2e4c-496b-9bcf-d3d2a18d5e54 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:03:31.891463 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-00404640-2e4c-496b-9bcf-d3d2a18d5e54 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:03:31.892024 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-00404640-2e4c-496b-9bcf-d3d2a18d5e54 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:03:32.036593 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-00404640-2e4c-496b-9bcf-d3d2a18d5e54 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:03:32.046840 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-00404640-2e4c-496b-9bcf-d3d2a18d5e54 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:03:32.048886 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-00404640-2e4c-496b-9bcf-d3d2a18d5e54 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:03:32.060719 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-00404640-2e4c-496b-9bcf-d3d2a18d5e54 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] 10.222.0.18 "GET /compute/v2.1/servers/2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac" status: 200 len: 1555 microversion: 2.91 time: 0.207742 Oct 22 21:03:32.064973 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1496/3083] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:03:31 2022] GET /compute/v2.1/servers/2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac => generated 1555 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:03:32.084133 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-bcf78c68-b20c-4c36-a28a-abd878939ec5 tempest-SecurityGroupRulesNegativeTestJSON-1780227540 tempest-SecurityGroupRulesNegativeTestJSON-1780227540-project] Action: 'create', calling method: .version_select at 0x7fd3a8ae59d0>, body: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-1675952417", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:03:32.086821 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-bcf78c68-b20c-4c36-a28a-abd878939ec5 tempest-SecurityGroupRulesNegativeTestJSON-1780227540 tempest-SecurityGroupRulesNegativeTestJSON-1780227540-project] HTTP exception thrown: Security group id should be uuid Oct 22 21:03:32.088638 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-bcf78c68-b20c-4c36-a28a-abd878939ec5 tempest-SecurityGroupRulesNegativeTestJSON-1780227540 tempest-SecurityGroupRulesNegativeTestJSON-1780227540-project] Request method failure captured: Oct 22 21:03:32.088638 ncdv-master-1 devstack@n-api.service[138744]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 22 21:03:32.088638 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 21:03:32.088638 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 21:03:32.088638 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 21:03:32.088638 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 131 Oct 22 21:03:32.088638 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 21:03:32.088638 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 21:03:32.088638 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 21:03:32.088638 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 21:03:32.088638 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVFqbu_R5ZZt7r1Qx2myjj93ExuOnZLi52tG3A3oDhEfqPoewi_qJEJWs_7tWU4KxappJ2YMyXl2Dz4PGLzxXBHaoG5OSi5eMGeB0pf6rIEyfwD2izL-PPnTkecuttFuGDwiYd54H3A0USh1GunXi2C-jYxbjBal94AHEDvWQm5wmpEQ Oct 22 21:03:32.088638 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 21:03:32.088638 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 21:03:32.088638 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 21:03:32.088638 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 21:03:32.088638 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 21:03:32.088638 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 21:03:32.088638 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: c969cfe1b19a4140bf43bf8e15bf38a3 Oct 22 21:03:32.088638 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1780227540 Oct 22 21:03:32.088638 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 21:03:32.088638 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 21:03:32.088638 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_c969cfe1b19a4140bf43bf8e15bf38a3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c969cfe1b19a4140bf43bf8e15bf38a3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/c969cfe1b19a4140bf43bf8e15bf38a3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c969cfe1b19a4140bf43bf8e15bf38a3"}]}] Oct 22 21:03:32.088638 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1780227540 Oct 22 21:03:32.088638 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: c969cfe1b19a4140bf43bf8e15bf38a3 Oct 22 21:03:32.088638 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1780227540 Oct 22 21:03:32.088638 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1780227540-project Oct 22 21:03:32.088638 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 21:03:32.088638 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 21:03:32.088638 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: 6f3f378c7a9542ffbd20bf470d838ce6 Oct 22 21:03:32.088638 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1780227540-project Oct 22 21:03:32.088638 ncdv-master-1 devstack@n-api.service[138744]: Oct 22 21:03:32.088638 ncdv-master-1 devstack@n-api.service[138744]: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-1675952417", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Oct 22 21:03:32.088638 ncdv-master-1 devstack@n-api.service[138744]: method: Oct 22 21:03:32.088638 ncdv-master-1 devstack@n-api.service[138744]: exception: Security group id should be uuid Oct 22 21:03:32.088638 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'tempest-non_int_id-1675952417', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Oct 22 21:03:32.088638 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:03:32.088638 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:03:32.088638 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 285, in create Oct 22 21:03:32.088638 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi parent_group_id = security_group_api.validate_id( Oct 22 21:03:32.088638 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 51, in validate_id Oct 22 21:03:32.088638 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Oct 22 21:03:32.088638 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security group id should be uuid Oct 22 21:03:32.088638 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:03:32.088638 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:03:32.088638 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:03:32.088638 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:03:32.088638 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:03:32.088638 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:03:32.088638 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:03:32.088638 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:03:32.088638 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 22 21:03:32.088638 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 22 21:03:32.088638 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:03:32.088638 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:03:32.088638 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 22 21:03:32.088638 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 22 21:03:32.088638 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security group id should be uuid Oct 22 21:03:32.088638 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:03:32.088638 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:03:32.088638 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:03:32.088638 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:03:32.088638 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:03:32.088638 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:03:32.088638 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:03:32.088638 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:03:32.093614 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group id should be uuid Oct 22 21:03:32.093614 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:03:32.095908 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-bcf78c68-b20c-4c36-a28a-abd878939ec5 tempest-SecurityGroupRulesNegativeTestJSON-1780227540 tempest-SecurityGroupRulesNegativeTestJSON-1780227540-project] Returning 400 to user: Security group id should be uuid {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:03:32.097051 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-bcf78c68-b20c-4c36-a28a-abd878939ec5 tempest-SecurityGroupRulesNegativeTestJSON-1780227540 tempest-SecurityGroupRulesNegativeTestJSON-1780227540-project] 10.222.0.18 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 76 microversion: 2.1 time: 0.030522 Oct 22 21:03:32.097906 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1497/3084] 10.222.0.18 () {60 vars in 1195 bytes} [Sat Oct 22 21:03:32 2022] POST /compute/v2.1/os-security-group-rules => generated 76 bytes in 32 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 22 21:03:32.110557 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-55d6dbcd-6497-4739-89f3-4e44db46c9d9 tempest-SecurityGroupRulesNegativeTestJSON-1780227540 tempest-SecurityGroupRulesNegativeTestJSON-1780227540-project] Action: 'create', calling method: .version_select at 0x7fd39fee3af0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1026344045", "description": "tempest-description-608097645"}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:03:32.533046 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-55d6dbcd-6497-4739-89f3-4e44db46c9d9 tempest-SecurityGroupRulesNegativeTestJSON-1780227540 tempest-SecurityGroupRulesNegativeTestJSON-1780227540-project] 10.222.0.18 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.426350 Oct 22 21:03:32.536556 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1498/3085] 10.222.0.18 () {60 vars in 1180 bytes} [Sat Oct 22 21:03:32 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:03:32.556102 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-8b431cf8-ed8b-4cb0-b198-d51c141706e2 tempest-SecurityGroupRulesNegativeTestJSON-1780227540 tempest-SecurityGroupRulesNegativeTestJSON-1780227540-project] Action: 'create', calling method: .version_select at 0x7fd39f67d550>, body: {"security_group_rule": {"parent_group_id": "56682e70-fc08-4f76-8714-42c97305f6c6", "ip_protocol": "tempest-999-1598223364", "from_port": 22, "to_port": 22}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:03:32.774300 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-8b431cf8-ed8b-4cb0-b198-d51c141706e2 tempest-SecurityGroupRulesNegativeTestJSON-1780227540 tempest-SecurityGroupRulesNegativeTestJSON-1780227540-project] HTTP exception thrown: Invalid IP protocol tempest-999-1598223364. Oct 22 21:03:32.777568 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-8b431cf8-ed8b-4cb0-b198-d51c141706e2 tempest-SecurityGroupRulesNegativeTestJSON-1780227540 tempest-SecurityGroupRulesNegativeTestJSON-1780227540-project] Request method failure captured: Oct 22 21:03:32.777568 ncdv-master-1 devstack@n-api.service[138744]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 22 21:03:32.777568 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 21:03:32.777568 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 21:03:32.777568 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 21:03:32.777568 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 157 Oct 22 21:03:32.777568 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 21:03:32.777568 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 21:03:32.777568 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 21:03:32.777568 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 21:03:32.777568 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVFqbu_R5ZZt7r1Qx2myjj93ExuOnZLi52tG3A3oDhEfqPoewi_qJEJWs_7tWU4KxappJ2YMyXl2Dz4PGLzxXBHaoG5OSi5eMGeB0pf6rIEyfwD2izL-PPnTkecuttFuGDwiYd54H3A0USh1GunXi2C-jYxbjBal94AHEDvWQm5wmpEQ Oct 22 21:03:32.777568 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 21:03:32.777568 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 21:03:32.777568 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 21:03:32.777568 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 21:03:32.777568 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 21:03:32.777568 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 21:03:32.777568 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: c969cfe1b19a4140bf43bf8e15bf38a3 Oct 22 21:03:32.777568 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1780227540 Oct 22 21:03:32.777568 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 21:03:32.777568 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 21:03:32.777568 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_c969cfe1b19a4140bf43bf8e15bf38a3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c969cfe1b19a4140bf43bf8e15bf38a3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/c969cfe1b19a4140bf43bf8e15bf38a3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c969cfe1b19a4140bf43bf8e15bf38a3"}]}] Oct 22 21:03:32.777568 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1780227540 Oct 22 21:03:32.777568 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: c969cfe1b19a4140bf43bf8e15bf38a3 Oct 22 21:03:32.777568 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1780227540 Oct 22 21:03:32.777568 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1780227540-project Oct 22 21:03:32.777568 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 21:03:32.777568 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 21:03:32.777568 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: 6f3f378c7a9542ffbd20bf470d838ce6 Oct 22 21:03:32.777568 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1780227540-project Oct 22 21:03:32.777568 ncdv-master-1 devstack@n-api.service[138744]: Oct 22 21:03:32.777568 ncdv-master-1 devstack@n-api.service[138744]: {"security_group_rule": {"parent_group_id": "56682e70-fc08-4f76-8714-42c97305f6c6", "ip_protocol": "tempest-999-1598223364", "from_port": 22, "to_port": 22}} Oct 22 21:03:32.777568 ncdv-master-1 devstack@n-api.service[138744]: method: Oct 22 21:03:32.777568 ncdv-master-1 devstack@n-api.service[138744]: exception: Invalid IP protocol tempest-999-1598223364. Oct 22 21:03:32.777568 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'body': {'security_group_rule': {'parent_group_id': '56682e70-fc08-4f76-8714-42c97305f6c6', 'ip_protocol': 'tempest-999-1598223364', 'from_port': 22, 'to_port': 22}}} Oct 22 21:03:32.777568 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:03:32.777568 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:03:32.777568 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 22 21:03:32.777568 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 22 21:03:32.777568 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 22 21:03:32.777568 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 22 21:03:32.777568 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 22 21:03:32.777568 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 22 21:03:32.777568 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 144, in _new_ingress_rule Oct 22 21:03:32.777568 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.InvalidIpProtocol(protocol=ip_protocol) Oct 22 21:03:32.777568 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.InvalidIpProtocol: Invalid IP protocol tempest-999-1598223364. Oct 22 21:03:32.777568 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:03:32.777568 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:03:32.777568 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:03:32.777568 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:03:32.777568 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:03:32.777568 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:03:32.777568 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:03:32.777568 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:03:32.777568 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 22 21:03:32.777568 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 22 21:03:32.777568 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:03:32.777568 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:03:32.777568 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 22 21:03:32.777568 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 22 21:03:32.777568 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid IP protocol tempest-999-1598223364. Oct 22 21:03:32.777568 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:03:32.777568 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:03:32.783397 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:03:32.783397 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:03:32.783397 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:03:32.783397 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:03:32.783397 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:03:32.783397 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:03:32.783397 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid IP protocol tempest-999-1598223364. Oct 22 21:03:32.783397 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:03:32.785218 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-8b431cf8-ed8b-4cb0-b198-d51c141706e2 tempest-SecurityGroupRulesNegativeTestJSON-1780227540 tempest-SecurityGroupRulesNegativeTestJSON-1780227540-project] Returning 400 to user: Invalid IP protocol tempest-999-1598223364. {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:03:32.786383 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-8b431cf8-ed8b-4cb0-b198-d51c141706e2 tempest-SecurityGroupRulesNegativeTestJSON-1780227540 tempest-SecurityGroupRulesNegativeTestJSON-1780227540-project] 10.222.0.18 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 87 microversion: 2.1 time: 0.239770 Oct 22 21:03:32.793896 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1499/3086] 10.222.0.18 () {60 vars in 1195 bytes} [Sat Oct 22 21:03:32 2022] POST /compute/v2.1/os-security-group-rules => generated 87 bytes in 248 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Oct 22 21:03:32.803310 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-670e32ed-abfd-4a1e-91df-58930739877c tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:03:32.806495 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-670e32ed-abfd-4a1e-91df-58930739877c tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] [instance: a99614d8-f2f7-4ce1-87e8-47f3af03d9f8] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:03:32.846733 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-670e32ed-abfd-4a1e-91df-58930739877c tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:03:32.847233 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-670e32ed-abfd-4a1e-91df-58930739877c tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:03:32.859319 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-670e32ed-abfd-4a1e-91df-58930739877c tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:03:32.861081 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-670e32ed-abfd-4a1e-91df-58930739877c tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:03:32.863249 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-670e32ed-abfd-4a1e-91df-58930739877c tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:03:32.863760 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-670e32ed-abfd-4a1e-91df-58930739877c tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:03:33.256404 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-670e32ed-abfd-4a1e-91df-58930739877c tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1b410a64e0415a96d30f5040361137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd7873d6db4e09bc9ab9a048a6b1ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:03:33.268033 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-670e32ed-abfd-4a1e-91df-58930739877c tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] 10.222.0.18 "GET /compute/v2.1/servers/a99614d8-f2f7-4ce1-87e8-47f3af03d9f8" status: 200 len: 1525 microversion: 2.1 time: 0.472456 Oct 22 21:03:33.269256 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1500/3087] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:03:32 2022] GET /compute/v2.1/servers/a99614d8-f2f7-4ce1-87e8-47f3af03d9f8 => generated 1525 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:03:33.288545 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-3ab47acd-40b2-4a9e-8744-c9a66ecf5ca1 tempest-SecurityGroupRulesNegativeTestJSON-1780227540 tempest-SecurityGroupRulesNegativeTestJSON-1780227540-project] Action: 'create', calling method: .version_select at 0x7fd3a4483310>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-764958949", "description": "tempest-description-1799053561"}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:03:33.815835 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-3ab47acd-40b2-4a9e-8744-c9a66ecf5ca1 tempest-SecurityGroupRulesNegativeTestJSON-1780227540 tempest-SecurityGroupRulesNegativeTestJSON-1780227540-project] 10.222.0.18 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.545213 Oct 22 21:03:33.818109 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1501/3088] 10.222.0.18 () {60 vars in 1180 bytes} [Sat Oct 22 21:03:33 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:03:33.826005 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-355470b0-9b07-47f3-b27e-5909545138b4 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:03:33.828711 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-355470b0-9b07-47f3-b27e-5909545138b4 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] [instance: 2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:03:33.841144 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-355470b0-9b07-47f3-b27e-5909545138b4 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:03:33.844073 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-355470b0-9b07-47f3-b27e-5909545138b4 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:03:33.846175 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-355470b0-9b07-47f3-b27e-5909545138b4 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:03:33.848570 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-355470b0-9b07-47f3-b27e-5909545138b4 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:03:33.851748 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-355470b0-9b07-47f3-b27e-5909545138b4 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:03:33.854094 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-355470b0-9b07-47f3-b27e-5909545138b4 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:03:33.970458 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-355470b0-9b07-47f3-b27e-5909545138b4 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:03:33.985060 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-355470b0-9b07-47f3-b27e-5909545138b4 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:03:33.989167 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-355470b0-9b07-47f3-b27e-5909545138b4 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:03:34.012470 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-355470b0-9b07-47f3-b27e-5909545138b4 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] 10.222.0.18 "GET /compute/v2.1/servers/2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac" status: 200 len: 1555 microversion: 2.91 time: 0.190352 Oct 22 21:03:34.014177 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1502/3089] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:03:33 2022] GET /compute/v2.1/servers/2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac => generated 1555 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:03:34.029391 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-942c4345-2909-4c02-9a2d-465f7c6ffd12 tempest-SecurityGroupRulesNegativeTestJSON-1780227540 tempest-SecurityGroupRulesNegativeTestJSON-1780227540-project] Action: 'create', calling method: .version_select at 0x7fd3a415d430>, body: {"security_group_rule": {"parent_group_id": "dda0db75-16fc-4801-8fd4-c8c9a9bc9c6b", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:03:34.157832 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-942c4345-2909-4c02-9a2d-465f7c6ffd12 tempest-SecurityGroupRulesNegativeTestJSON-1780227540 tempest-SecurityGroupRulesNegativeTestJSON-1780227540-project] HTTP exception thrown: Invalid port range 22:21. Former value cannot be greater than the later Oct 22 21:03:34.160277 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-942c4345-2909-4c02-9a2d-465f7c6ffd12 tempest-SecurityGroupRulesNegativeTestJSON-1780227540 tempest-SecurityGroupRulesNegativeTestJSON-1780227540-project] Request method failure captured: Oct 22 21:03:34.160277 ncdv-master-1 devstack@n-api.service[138744]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 22 21:03:34.160277 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 21:03:34.160277 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 21:03:34.160277 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 21:03:34.160277 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 138 Oct 22 21:03:34.160277 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 21:03:34.160277 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 21:03:34.160277 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 21:03:34.160277 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 21:03:34.160277 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVFqbu_R5ZZt7r1Qx2myjj93ExuOnZLi52tG3A3oDhEfqPoewi_qJEJWs_7tWU4KxappJ2YMyXl2Dz4PGLzxXBHaoG5OSi5eMGeB0pf6rIEyfwD2izL-PPnTkecuttFuGDwiYd54H3A0USh1GunXi2C-jYxbjBal94AHEDvWQm5wmpEQ Oct 22 21:03:34.160277 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 21:03:34.160277 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 21:03:34.160277 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 21:03:34.160277 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 21:03:34.160277 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 21:03:34.160277 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 21:03:34.160277 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: c969cfe1b19a4140bf43bf8e15bf38a3 Oct 22 21:03:34.160277 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1780227540 Oct 22 21:03:34.160277 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 21:03:34.160277 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 21:03:34.160277 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_c969cfe1b19a4140bf43bf8e15bf38a3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c969cfe1b19a4140bf43bf8e15bf38a3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/c969cfe1b19a4140bf43bf8e15bf38a3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c969cfe1b19a4140bf43bf8e15bf38a3"}]}] Oct 22 21:03:34.160277 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1780227540 Oct 22 21:03:34.160277 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: c969cfe1b19a4140bf43bf8e15bf38a3 Oct 22 21:03:34.160277 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1780227540 Oct 22 21:03:34.160277 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1780227540-project Oct 22 21:03:34.160277 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 21:03:34.160277 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 21:03:34.160277 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: 6f3f378c7a9542ffbd20bf470d838ce6 Oct 22 21:03:34.160277 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1780227540-project Oct 22 21:03:34.160277 ncdv-master-1 devstack@n-api.service[138744]: Oct 22 21:03:34.160277 ncdv-master-1 devstack@n-api.service[138744]: {"security_group_rule": {"parent_group_id": "dda0db75-16fc-4801-8fd4-c8c9a9bc9c6b", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} Oct 22 21:03:34.160277 ncdv-master-1 devstack@n-api.service[138744]: method: Oct 22 21:03:34.160277 ncdv-master-1 devstack@n-api.service[138744]: exception: Invalid port range 22:21. Former value cannot be greater than the later Oct 22 21:03:34.160277 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'dda0db75-16fc-4801-8fd4-c8c9a9bc9c6b', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 21}}} Oct 22 21:03:34.160277 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:03:34.160277 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:03:34.160277 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 22 21:03:34.160277 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 22 21:03:34.160277 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 22 21:03:34.160277 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 22 21:03:34.160277 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 22 21:03:34.160277 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 22 21:03:34.160277 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Oct 22 21:03:34.160277 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Oct 22 21:03:34.160277 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:21. Former value cannot be greater than the later Oct 22 21:03:34.160277 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:03:34.160277 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:03:34.160277 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:03:34.160277 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:03:34.160277 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:03:34.160277 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:03:34.160277 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:03:34.160277 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:03:34.160277 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 22 21:03:34.160277 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 22 21:03:34.160277 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:03:34.160277 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:03:34.160277 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 22 21:03:34.160277 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 22 21:03:34.160277 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:21. Former value cannot be greater than the later Oct 22 21:03:34.160277 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:03:34.166549 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:03:34.166549 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:03:34.166549 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:03:34.166549 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:03:34.166549 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:03:34.166549 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:03:34.166549 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:03:34.166549 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:21. Former value cannot be greater than the later Oct 22 21:03:34.166549 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:03:34.166549 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-942c4345-2909-4c02-9a2d-465f7c6ffd12 tempest-SecurityGroupRulesNegativeTestJSON-1780227540 tempest-SecurityGroupRulesNegativeTestJSON-1780227540-project] Returning 400 to user: Invalid port range 22:21. Former value cannot be greater than the later {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:03:34.168001 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-942c4345-2909-4c02-9a2d-465f7c6ffd12 tempest-SecurityGroupRulesNegativeTestJSON-1780227540 tempest-SecurityGroupRulesNegativeTestJSON-1780227540-project] 10.222.0.18 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 115 microversion: 2.1 time: 0.146693 Oct 22 21:03:34.169526 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1503/3090] 10.222.0.18 () {60 vars in 1195 bytes} [Sat Oct 22 21:03:34 2022] POST /compute/v2.1/os-security-group-rules => generated 115 bytes in 154 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 22 21:03:34.186248 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-83918f6e-bf92-4755-beba-4ef148d746d5 tempest-SecurityGroupRulesNegativeTestJSON-1780227540 tempest-SecurityGroupRulesNegativeTestJSON-1780227540-project] Action: 'create', calling method: .version_select at 0x7fd3a41e33a0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-961736998", "description": "tempest-description-648244658"}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:03:34.829055 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-83918f6e-bf92-4755-beba-4ef148d746d5 tempest-SecurityGroupRulesNegativeTestJSON-1780227540 tempest-SecurityGroupRulesNegativeTestJSON-1780227540-project] 10.222.0.18 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 0.653592 Oct 22 21:03:34.831868 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1504/3091] 10.222.0.18 () {60 vars in 1180 bytes} [Sat Oct 22 21:03:34 2022] POST /compute/v2.1/os-security-groups => generated 254 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:03:34.842254 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-b06935e8-ebab-4924-ad26-d561ac2686a8 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:03:34.843361 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-b06935e8-ebab-4924-ad26-d561ac2686a8 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] [instance: a99614d8-f2f7-4ce1-87e8-47f3af03d9f8] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:03:34.885758 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b06935e8-ebab-4924-ad26-d561ac2686a8 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:03:34.886391 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b06935e8-ebab-4924-ad26-d561ac2686a8 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:03:34.886874 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b06935e8-ebab-4924-ad26-d561ac2686a8 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:03:34.887669 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b06935e8-ebab-4924-ad26-d561ac2686a8 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:03:34.891270 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b06935e8-ebab-4924-ad26-d561ac2686a8 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:03:34.891851 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b06935e8-ebab-4924-ad26-d561ac2686a8 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:03:35.280365 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-b06935e8-ebab-4924-ad26-d561ac2686a8 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1b410a64e0415a96d30f5040361137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd7873d6db4e09bc9ab9a048a6b1ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:03:35.294117 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-b06935e8-ebab-4924-ad26-d561ac2686a8 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] 10.222.0.18 "GET /compute/v2.1/servers/a99614d8-f2f7-4ce1-87e8-47f3af03d9f8" status: 200 len: 1525 microversion: 2.1 time: 0.460696 Oct 22 21:03:35.294730 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1505/3092] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:03:34 2022] GET /compute/v2.1/servers/a99614d8-f2f7-4ce1-87e8-47f3af03d9f8 => generated 1525 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:03:35.355278 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-2859e555-fad6-4de2-b6c5-abb9e02e477a tempest-SecurityGroupRulesNegativeTestJSON-1780227540 tempest-SecurityGroupRulesNegativeTestJSON-1780227540-project] Action: 'create', calling method: .version_select at 0x7fd3a8b26f70>, body: {"security_group_rule": {"parent_group_id": "e44cad16-e59f-4752-b9c7-8e9708a3c69e", "ip_protocol": "tcp", "from_port": 22, "to_port": 627674972}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:03:35.545210 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-2859e555-fad6-4de2-b6c5-abb9e02e477a tempest-SecurityGroupRulesNegativeTestJSON-1780227540 tempest-SecurityGroupRulesNegativeTestJSON-1780227540-project] HTTP exception thrown: Invalid port range 22:627674972. Valid TCP ports should be between 1-65535 Oct 22 21:03:35.547186 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-2859e555-fad6-4de2-b6c5-abb9e02e477a tempest-SecurityGroupRulesNegativeTestJSON-1780227540 tempest-SecurityGroupRulesNegativeTestJSON-1780227540-project] Request method failure captured: Oct 22 21:03:35.547186 ncdv-master-1 devstack@n-api.service[138744]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 22 21:03:35.547186 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 21:03:35.547186 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 21:03:35.547186 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 21:03:35.547186 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 145 Oct 22 21:03:35.547186 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 21:03:35.547186 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 21:03:35.547186 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 21:03:35.547186 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 21:03:35.547186 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVFqbu_R5ZZt7r1Qx2myjj93ExuOnZLi52tG3A3oDhEfqPoewi_qJEJWs_7tWU4KxappJ2YMyXl2Dz4PGLzxXBHaoG5OSi5eMGeB0pf6rIEyfwD2izL-PPnTkecuttFuGDwiYd54H3A0USh1GunXi2C-jYxbjBal94AHEDvWQm5wmpEQ Oct 22 21:03:35.547186 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 21:03:35.547186 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 21:03:35.547186 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 21:03:35.547186 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 21:03:35.547186 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 21:03:35.547186 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 21:03:35.547186 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: c969cfe1b19a4140bf43bf8e15bf38a3 Oct 22 21:03:35.547186 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1780227540 Oct 22 21:03:35.547186 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 21:03:35.547186 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 21:03:35.547186 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_c969cfe1b19a4140bf43bf8e15bf38a3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c969cfe1b19a4140bf43bf8e15bf38a3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/c969cfe1b19a4140bf43bf8e15bf38a3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c969cfe1b19a4140bf43bf8e15bf38a3"}]}] Oct 22 21:03:35.547186 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1780227540 Oct 22 21:03:35.547186 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: c969cfe1b19a4140bf43bf8e15bf38a3 Oct 22 21:03:35.547186 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1780227540 Oct 22 21:03:35.547186 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1780227540-project Oct 22 21:03:35.547186 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 21:03:35.547186 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 21:03:35.547186 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: 6f3f378c7a9542ffbd20bf470d838ce6 Oct 22 21:03:35.547186 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1780227540-project Oct 22 21:03:35.547186 ncdv-master-1 devstack@n-api.service[138744]: Oct 22 21:03:35.547186 ncdv-master-1 devstack@n-api.service[138744]: {"security_group_rule": {"parent_group_id": "e44cad16-e59f-4752-b9c7-8e9708a3c69e", "ip_protocol": "tcp", "from_port": 22, "to_port": 627674972}} Oct 22 21:03:35.547186 ncdv-master-1 devstack@n-api.service[138744]: method: Oct 22 21:03:35.547186 ncdv-master-1 devstack@n-api.service[138744]: exception: Invalid port range 22:627674972. Valid TCP ports should be between 1-65535 Oct 22 21:03:35.547186 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'e44cad16-e59f-4752-b9c7-8e9708a3c69e', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 627674972}}} Oct 22 21:03:35.547186 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:03:35.547186 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:03:35.547186 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 22 21:03:35.547186 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 22 21:03:35.547186 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 22 21:03:35.547186 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 22 21:03:35.547186 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 22 21:03:35.547186 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 22 21:03:35.547186 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 157, in _new_ingress_rule Oct 22 21:03:35.547186 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Oct 22 21:03:35.547186 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:627674972. Valid TCP ports should be between 1-65535 Oct 22 21:03:35.547186 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:03:35.547186 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:03:35.547186 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:03:35.547186 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:03:35.547186 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:03:35.547186 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:03:35.547186 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:03:35.547186 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:03:35.547186 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 22 21:03:35.547186 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 22 21:03:35.547186 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:03:35.547186 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:03:35.547186 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 22 21:03:35.547186 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 22 21:03:35.547186 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:627674972. Valid TCP ports should be between 1-65535 Oct 22 21:03:35.547186 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:03:35.552307 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:03:35.552307 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:03:35.552307 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:03:35.552307 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:03:35.552307 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:03:35.552307 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:03:35.552307 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:03:35.552307 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:627674972. Valid TCP ports should be between 1-65535 Oct 22 21:03:35.552307 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:03:35.552307 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-2859e555-fad6-4de2-b6c5-abb9e02e477a tempest-SecurityGroupRulesNegativeTestJSON-1780227540 tempest-SecurityGroupRulesNegativeTestJSON-1780227540-project] Returning 400 to user: Invalid port range 22:627674972. Valid TCP ports should be between 1-65535 {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:03:35.556053 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-2859e555-fad6-4de2-b6c5-abb9e02e477a tempest-SecurityGroupRulesNegativeTestJSON-1780227540 tempest-SecurityGroupRulesNegativeTestJSON-1780227540-project] 10.222.0.18 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 118 microversion: 2.1 time: 0.252523 Oct 22 21:03:35.558060 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1506/3093] 10.222.0.18 () {60 vars in 1195 bytes} [Sat Oct 22 21:03:35 2022] POST /compute/v2.1/os-security-group-rules => generated 118 bytes in 258 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 22 21:03:35.575581 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-74e0ea52-5f37-41ec-8e10-8fcf2c19cc61 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:03:35.577048 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-74e0ea52-5f37-41ec-8e10-8fcf2c19cc61 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] [instance: 2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:03:35.593733 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-74e0ea52-5f37-41ec-8e10-8fcf2c19cc61 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:03:35.596124 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-74e0ea52-5f37-41ec-8e10-8fcf2c19cc61 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:03:35.597097 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-74e0ea52-5f37-41ec-8e10-8fcf2c19cc61 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:03:35.598063 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-74e0ea52-5f37-41ec-8e10-8fcf2c19cc61 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:03:35.598833 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-74e0ea52-5f37-41ec-8e10-8fcf2c19cc61 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:03:35.599555 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-74e0ea52-5f37-41ec-8e10-8fcf2c19cc61 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:03:35.747246 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-74e0ea52-5f37-41ec-8e10-8fcf2c19cc61 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:03:35.778408 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-74e0ea52-5f37-41ec-8e10-8fcf2c19cc61 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:03:35.782835 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-74e0ea52-5f37-41ec-8e10-8fcf2c19cc61 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:03:35.797077 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-74e0ea52-5f37-41ec-8e10-8fcf2c19cc61 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] 10.222.0.18 "GET /compute/v2.1/servers/2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac" status: 200 len: 1555 microversion: 2.91 time: 0.234808 Oct 22 21:03:35.812854 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1507/3094] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:03:35 2022] GET /compute/v2.1/servers/2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac => generated 1555 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:03:35.838558 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-70caab65-01ab-4c0a-a0c4-655ae9c32162 tempest-SecurityGroupRulesNegativeTestJSON-1780227540 tempest-SecurityGroupRulesNegativeTestJSON-1780227540-project] Action: 'create', calling method: .version_select at 0x7fd3a43b9820>, body: {"security_group_rule": {"parent_group_id": "653e6fb0-21db-45db-930a-3f2ede830027", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:03:35.961512 ncdv-master-1 devstack@n-api.service[138744]: DEBUG neutronclient.v2_0.client [None req-70caab65-01ab-4c0a-a0c4-655ae9c32162 tempest-SecurityGroupRulesNegativeTestJSON-1780227540 tempest-SecurityGroupRulesNegativeTestJSON-1780227540-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 653e6fb0-21db-45db-930a-3f2ede830027 does not exist", "detail": ""}} {{(pid=138744) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 22 21:03:35.962552 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.network.security_group_api [None req-70caab65-01ab-4c0a-a0c4-655ae9c32162 tempest-SecurityGroupRulesNegativeTestJSON-1780227540 tempest-SecurityGroupRulesNegativeTestJSON-1780227540-project] Neutron security group 653e6fb0-21db-45db-930a-3f2ede830027 not found {{(pid=138744) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 22 21:03:35.963287 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-70caab65-01ab-4c0a-a0c4-655ae9c32162 tempest-SecurityGroupRulesNegativeTestJSON-1780227540 tempest-SecurityGroupRulesNegativeTestJSON-1780227540-project] HTTP exception thrown: Security group 653e6fb0-21db-45db-930a-3f2ede830027 does not exist Oct 22 21:03:35.963287 ncdv-master-1 devstack@n-api.service[138744]: Neutron server returns request_ids: ['req-8c93382e-d784-432c-b82e-d09803284457'] Oct 22 21:03:35.966483 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-70caab65-01ab-4c0a-a0c4-655ae9c32162 tempest-SecurityGroupRulesNegativeTestJSON-1780227540 tempest-SecurityGroupRulesNegativeTestJSON-1780227540-project] Request method failure captured: Oct 22 21:03:35.966483 ncdv-master-1 devstack@n-api.service[138744]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 22 21:03:35.966483 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 21:03:35.966483 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 21:03:35.966483 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 21:03:35.966483 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 138 Oct 22 21:03:35.966483 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 21:03:35.966483 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 21:03:35.966483 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 21:03:35.966483 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 21:03:35.966483 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVFqbu_R5ZZt7r1Qx2myjj93ExuOnZLi52tG3A3oDhEfqPoewi_qJEJWs_7tWU4KxappJ2YMyXl2Dz4PGLzxXBHaoG5OSi5eMGeB0pf6rIEyfwD2izL-PPnTkecuttFuGDwiYd54H3A0USh1GunXi2C-jYxbjBal94AHEDvWQm5wmpEQ Oct 22 21:03:35.966483 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 21:03:35.966483 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 21:03:35.966483 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 21:03:35.966483 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 21:03:35.966483 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 21:03:35.966483 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 21:03:35.966483 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: c969cfe1b19a4140bf43bf8e15bf38a3 Oct 22 21:03:35.966483 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1780227540 Oct 22 21:03:35.966483 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 21:03:35.966483 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 21:03:35.966483 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_c969cfe1b19a4140bf43bf8e15bf38a3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c969cfe1b19a4140bf43bf8e15bf38a3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/c969cfe1b19a4140bf43bf8e15bf38a3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c969cfe1b19a4140bf43bf8e15bf38a3"}]}] Oct 22 21:03:35.966483 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1780227540 Oct 22 21:03:35.966483 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: c969cfe1b19a4140bf43bf8e15bf38a3 Oct 22 21:03:35.966483 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1780227540 Oct 22 21:03:35.966483 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1780227540-project Oct 22 21:03:35.966483 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 21:03:35.966483 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 21:03:35.966483 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: 6f3f378c7a9542ffbd20bf470d838ce6 Oct 22 21:03:35.966483 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1780227540-project Oct 22 21:03:35.966483 ncdv-master-1 devstack@n-api.service[138744]: Oct 22 21:03:35.966483 ncdv-master-1 devstack@n-api.service[138744]: {"security_group_rule": {"parent_group_id": "653e6fb0-21db-45db-930a-3f2ede830027", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Oct 22 21:03:35.966483 ncdv-master-1 devstack@n-api.service[138744]: method: Oct 22 21:03:35.966483 ncdv-master-1 devstack@n-api.service[138744]: exception: Security group 653e6fb0-21db-45db-930a-3f2ede830027 does not exist Oct 22 21:03:35.966483 ncdv-master-1 devstack@n-api.service[138744]: Neutron server returns request_ids: ['req-8c93382e-d784-432c-b82e-d09803284457'] Oct 22 21:03:35.966483 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'body': {'security_group_rule': {'parent_group_id': '653e6fb0-21db-45db-930a-3f2ede830027', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Oct 22 21:03:35.966483 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:03:35.966483 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:03:35.966483 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 22 21:03:35.966483 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 22 21:03:35.966483 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 21:03:35.966483 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 21:03:35.966483 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 22 21:03:35.966483 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 22 21:03:35.966483 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 21:03:35.966483 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 21:03:35.966483 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 22 21:03:35.966483 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 22 21:03:35.966483 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 21:03:35.966483 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 21:03:35.966483 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 22 21:03:35.966483 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 22 21:03:35.966483 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 21:03:35.966483 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 21:03:35.966483 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 22 21:03:35.966483 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 22 21:03:35.966483 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 21:03:35.966483 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 21:03:35.966483 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 22 21:03:35.966483 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 22 21:03:35.966483 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 22 21:03:35.973156 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 22 21:03:35.973156 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 653e6fb0-21db-45db-930a-3f2ede830027 does not exist Oct 22 21:03:35.973156 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8c93382e-d784-432c-b82e-d09803284457'] Oct 22 21:03:35.973156 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:03:35.973156 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:03:35.973156 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:03:35.973156 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:03:35.973156 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 287, in create Oct 22 21:03:35.973156 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get( Oct 22 21:03:35.973156 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 22 21:03:35.973156 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 22 21:03:35.973156 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 653e6fb0-21db-45db-930a-3f2ede830027 does not exist Oct 22 21:03:35.973156 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8c93382e-d784-432c-b82e-d09803284457'] Oct 22 21:03:35.973156 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:03:35.973156 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:03:35.973156 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:03:35.973156 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:03:35.973156 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:03:35.973156 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:03:35.973156 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:03:35.973156 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:03:35.973156 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 22 21:03:35.973156 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 22 21:03:35.973156 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:03:35.973156 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:03:35.973156 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 303, in create Oct 22 21:03:35.973156 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 22 21:03:35.973156 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 653e6fb0-21db-45db-930a-3f2ede830027 does not exist Oct 22 21:03:35.973156 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8c93382e-d784-432c-b82e-d09803284457'] Oct 22 21:03:35.973156 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:03:35.973156 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:03:35.973156 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:03:35.973156 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:03:35.973156 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:03:35.973156 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:03:35.973156 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:03:35.973156 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:03:35.973156 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 653e6fb0-21db-45db-930a-3f2ede830027 does not exist Oct 22 21:03:35.973156 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8c93382e-d784-432c-b82e-d09803284457'] Oct 22 21:03:35.973156 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:03:35.973156 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-70caab65-01ab-4c0a-a0c4-655ae9c32162 tempest-SecurityGroupRulesNegativeTestJSON-1780227540 tempest-SecurityGroupRulesNegativeTestJSON-1780227540-project] Returning 404 to user: Security group 653e6fb0-21db-45db-930a-3f2ede830027 does not exist Oct 22 21:03:35.973156 ncdv-master-1 devstack@n-api.service[138744]: Neutron server returns request_ids: ['req-8c93382e-d784-432c-b82e-d09803284457'] {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:03:35.981439 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-70caab65-01ab-4c0a-a0c4-655ae9c32162 tempest-SecurityGroupRulesNegativeTestJSON-1780227540 tempest-SecurityGroupRulesNegativeTestJSON-1780227540-project] 10.222.0.18 "POST /compute/v2.1/os-security-group-rules" status: 404 len: 194 microversion: 2.1 time: 0.166628 Oct 22 21:03:35.984448 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1508/3095] 10.222.0.18 () {60 vars in 1195 bytes} [Sat Oct 22 21:03:35 2022] POST /compute/v2.1/os-security-group-rules => generated 194 bytes in 170 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 21:03:35.994485 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-f0827e36-eef2-40b8-8464-558a18e1512d tempest-SecurityGroupRulesNegativeTestJSON-1780227540 tempest-SecurityGroupRulesNegativeTestJSON-1780227540-project] Calling method '.version_select at 0x7fd39f88f550>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:03:36.106107 ncdv-master-1 devstack@n-api.service[138744]: DEBUG neutronclient.v2_0.client [None req-f0827e36-eef2-40b8-8464-558a18e1512d tempest-SecurityGroupRulesNegativeTestJSON-1780227540 tempest-SecurityGroupRulesNegativeTestJSON-1780227540-project] Error message: {"NeutronError": {"type": "SecurityGroupRuleNotFound", "message": "Security group rule 45a24b4b-1775-4b38-8759-9e32c4ebff5f does not exist", "detail": ""}} {{(pid=138744) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 22 21:03:36.107934 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.network.security_group_api [None req-f0827e36-eef2-40b8-8464-558a18e1512d tempest-SecurityGroupRulesNegativeTestJSON-1780227540 tempest-SecurityGroupRulesNegativeTestJSON-1780227540-project] Neutron security group rule 45a24b4b-1775-4b38-8759-9e32c4ebff5f not found {{(pid=138744) get_rule /opt/stack/nova/nova/network/security_group_api.py:463}} Oct 22 21:03:36.108617 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-f0827e36-eef2-40b8-8464-558a18e1512d tempest-SecurityGroupRulesNegativeTestJSON-1780227540 tempest-SecurityGroupRulesNegativeTestJSON-1780227540-project] HTTP exception thrown: Security group rule 45a24b4b-1775-4b38-8759-9e32c4ebff5f does not exist Oct 22 21:03:36.108617 ncdv-master-1 devstack@n-api.service[138744]: Neutron server returns request_ids: ['req-2a4a7eee-e66b-4c8a-a3cf-18e1afbf9dae'] Oct 22 21:03:36.110866 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-f0827e36-eef2-40b8-8464-558a18e1512d tempest-SecurityGroupRulesNegativeTestJSON-1780227540 tempest-SecurityGroupRulesNegativeTestJSON-1780227540-project] Request method failure captured: Oct 22 21:03:36.110866 ncdv-master-1 devstack@n-api.service[138744]: request: DELETE /compute/v2.1/os-security-group-rules/45a24b4b-1775-4b38-8759-9e32c4ebff5f HTTP/1.1 Oct 22 21:03:36.110866 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 21:03:36.110866 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 21:03:36.110866 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 21:03:36.110866 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 0 Oct 22 21:03:36.110866 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 21:03:36.110866 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 21:03:36.110866 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 21:03:36.110866 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 21:03:36.110866 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVFqbu_R5ZZt7r1Qx2myjj93ExuOnZLi52tG3A3oDhEfqPoewi_qJEJWs_7tWU4KxappJ2YMyXl2Dz4PGLzxXBHaoG5OSi5eMGeB0pf6rIEyfwD2izL-PPnTkecuttFuGDwiYd54H3A0USh1GunXi2C-jYxbjBal94AHEDvWQm5wmpEQ Oct 22 21:03:36.110866 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 21:03:36.110866 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 21:03:36.110866 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 21:03:36.110866 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 21:03:36.110866 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 21:03:36.110866 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 21:03:36.110866 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: c969cfe1b19a4140bf43bf8e15bf38a3 Oct 22 21:03:36.110866 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1780227540 Oct 22 21:03:36.110866 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 21:03:36.110866 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 21:03:36.110866 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_c969cfe1b19a4140bf43bf8e15bf38a3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c969cfe1b19a4140bf43bf8e15bf38a3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/c969cfe1b19a4140bf43bf8e15bf38a3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c969cfe1b19a4140bf43bf8e15bf38a3"}]}] Oct 22 21:03:36.110866 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1780227540 Oct 22 21:03:36.110866 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: c969cfe1b19a4140bf43bf8e15bf38a3 Oct 22 21:03:36.110866 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1780227540 Oct 22 21:03:36.110866 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1780227540-project Oct 22 21:03:36.110866 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 21:03:36.110866 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 21:03:36.110866 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: 6f3f378c7a9542ffbd20bf470d838ce6 Oct 22 21:03:36.110866 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1780227540-project Oct 22 21:03:36.110866 ncdv-master-1 devstack@n-api.service[138744]: method: Oct 22 21:03:36.110866 ncdv-master-1 devstack@n-api.service[138744]: exception: Security group rule 45a24b4b-1775-4b38-8759-9e32c4ebff5f does not exist Oct 22 21:03:36.110866 ncdv-master-1 devstack@n-api.service[138744]: Neutron server returns request_ids: ['req-2a4a7eee-e66b-4c8a-a3cf-18e1afbf9dae'] Oct 22 21:03:36.110866 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': '45a24b4b-1775-4b38-8759-9e32c4ebff5f'} Oct 22 21:03:36.110866 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:03:36.110866 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:03:36.110866 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 459, in get_rule Oct 22 21:03:36.110866 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi rule = neutron.show_security_group_rule( Oct 22 21:03:36.110866 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 21:03:36.110866 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 21:03:36.110866 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1092, in show_security_group_rule Oct 22 21:03:36.110866 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_rule_path % (security_group_rule), Oct 22 21:03:36.110866 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 21:03:36.110866 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 21:03:36.110866 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 22 21:03:36.110866 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 22 21:03:36.110866 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 21:03:36.110866 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 21:03:36.110866 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 22 21:03:36.110866 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 22 21:03:36.110866 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 21:03:36.110866 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 21:03:36.110866 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 22 21:03:36.110866 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 22 21:03:36.110866 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 21:03:36.110866 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 21:03:36.110866 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 22 21:03:36.110866 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 22 21:03:36.110866 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 22 21:03:36.110866 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 22 21:03:36.114955 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group rule 45a24b4b-1775-4b38-8759-9e32c4ebff5f does not exist Oct 22 21:03:36.114955 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2a4a7eee-e66b-4c8a-a3cf-18e1afbf9dae'] Oct 22 21:03:36.114955 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:03:36.114955 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:03:36.114955 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:03:36.114955 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:03:36.114955 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 359, in delete Oct 22 21:03:36.114955 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi rule = security_group_api.get_rule(context, id) Oct 22 21:03:36.114955 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 464, in get_rule Oct 22 21:03:36.114955 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 22 21:03:36.114955 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group rule 45a24b4b-1775-4b38-8759-9e32c4ebff5f does not exist Oct 22 21:03:36.114955 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2a4a7eee-e66b-4c8a-a3cf-18e1afbf9dae'] Oct 22 21:03:36.114955 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:03:36.114955 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:03:36.114955 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:03:36.114955 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:03:36.114955 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:03:36.114955 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:03:36.114955 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:03:36.114955 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:03:36.114955 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 22 21:03:36.114955 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 22 21:03:36.114955 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:03:36.114955 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:03:36.114955 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 365, in delete Oct 22 21:03:36.114955 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 22 21:03:36.114955 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group rule 45a24b4b-1775-4b38-8759-9e32c4ebff5f does not exist Oct 22 21:03:36.114955 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2a4a7eee-e66b-4c8a-a3cf-18e1afbf9dae'] Oct 22 21:03:36.114955 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:03:36.114955 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:03:36.114955 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:03:36.114955 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:03:36.114955 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:03:36.114955 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:03:36.114955 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:03:36.114955 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:03:36.114955 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group rule 45a24b4b-1775-4b38-8759-9e32c4ebff5f does not exist Oct 22 21:03:36.114955 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2a4a7eee-e66b-4c8a-a3cf-18e1afbf9dae'] Oct 22 21:03:36.114955 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:03:36.114955 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-f0827e36-eef2-40b8-8464-558a18e1512d tempest-SecurityGroupRulesNegativeTestJSON-1780227540 tempest-SecurityGroupRulesNegativeTestJSON-1780227540-project] Returning 404 to user: Security group rule 45a24b4b-1775-4b38-8759-9e32c4ebff5f does not exist Oct 22 21:03:36.114955 ncdv-master-1 devstack@n-api.service[138744]: Neutron server returns request_ids: ['req-2a4a7eee-e66b-4c8a-a3cf-18e1afbf9dae'] {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:03:36.118375 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-f0827e36-eef2-40b8-8464-558a18e1512d tempest-SecurityGroupRulesNegativeTestJSON-1780227540 tempest-SecurityGroupRulesNegativeTestJSON-1780227540-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-group-rules/45a24b4b-1775-4b38-8759-9e32c4ebff5f" status: 404 len: 199 microversion: 2.1 time: 0.124499 Oct 22 21:03:36.123646 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1509/3096] 10.222.0.18 () {58 vars in 1287 bytes} [Sat Oct 22 21:03:35 2022] DELETE /compute/v2.1/os-security-group-rules/45a24b4b-1775-4b38-8759-9e32c4ebff5f => generated 199 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 22 21:03:36.143018 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-6fd89165-eb20-42a4-a282-72c0bfa14827 tempest-SecurityGroupRulesNegativeTestJSON-1780227540 tempest-SecurityGroupRulesNegativeTestJSON-1780227540-project] Calling method '.version_select at 0x7fd3a4823940>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:03:36.620487 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-6fd89165-eb20-42a4-a282-72c0bfa14827 tempest-SecurityGroupRulesNegativeTestJSON-1780227540 tempest-SecurityGroupRulesNegativeTestJSON-1780227540-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/e44cad16-e59f-4752-b9c7-8e9708a3c69e" status: 202 len: 0 microversion: 2.1 time: 0.495568 Oct 22 21:03:36.621250 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1510/3097] 10.222.0.18 () {58 vars in 1272 bytes} [Sat Oct 22 21:03:36 2022] DELETE /compute/v2.1/os-security-groups/e44cad16-e59f-4752-b9c7-8e9708a3c69e => generated 0 bytes in 497 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 21:03:36.627085 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-c13542c8-6028-431e-95eb-4497549180bb tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:03:36.628022 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-c13542c8-6028-431e-95eb-4497549180bb tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] [instance: a99614d8-f2f7-4ce1-87e8-47f3af03d9f8] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:03:36.644115 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c13542c8-6028-431e-95eb-4497549180bb tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:03:36.649870 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c13542c8-6028-431e-95eb-4497549180bb tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:03:36.653619 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c13542c8-6028-431e-95eb-4497549180bb tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:03:36.656092 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c13542c8-6028-431e-95eb-4497549180bb tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:03:36.660265 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c13542c8-6028-431e-95eb-4497549180bb tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:03:36.660970 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c13542c8-6028-431e-95eb-4497549180bb tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:03:37.094369 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-c13542c8-6028-431e-95eb-4497549180bb tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1b410a64e0415a96d30f5040361137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd7873d6db4e09bc9ab9a048a6b1ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:03:37.109787 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-c13542c8-6028-431e-95eb-4497549180bb tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] 10.222.0.18 "GET /compute/v2.1/servers/a99614d8-f2f7-4ce1-87e8-47f3af03d9f8" status: 200 len: 1525 microversion: 2.1 time: 0.486823 Oct 22 21:03:37.110634 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1511/3098] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:03:36 2022] GET /compute/v2.1/servers/a99614d8-f2f7-4ce1-87e8-47f3af03d9f8 => generated 1525 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:03:37.129501 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-4c1c4dd7-f31a-44e6-8fd3-3c1a7c86b824 tempest-SecurityGroupRulesNegativeTestJSON-1780227540 tempest-SecurityGroupRulesNegativeTestJSON-1780227540-project] Calling method '.version_select at 0x7fd3a8b26ee0>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:03:37.834557 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-4c1c4dd7-f31a-44e6-8fd3-3c1a7c86b824 tempest-SecurityGroupRulesNegativeTestJSON-1780227540 tempest-SecurityGroupRulesNegativeTestJSON-1780227540-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/dda0db75-16fc-4801-8fd4-c8c9a9bc9c6b" status: 202 len: 0 microversion: 2.1 time: 0.715278 Oct 22 21:03:37.835939 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1512/3099] 10.222.0.18 () {58 vars in 1272 bytes} [Sat Oct 22 21:03:37 2022] DELETE /compute/v2.1/os-security-groups/dda0db75-16fc-4801-8fd4-c8c9a9bc9c6b => generated 0 bytes in 725 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 21:03:37.841968 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-f46083be-0389-45c9-93fc-0336842ac26a tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:03:37.842874 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-f46083be-0389-45c9-93fc-0336842ac26a tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] [instance: 2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:03:37.865163 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f46083be-0389-45c9-93fc-0336842ac26a tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:03:37.866316 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f46083be-0389-45c9-93fc-0336842ac26a tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:03:37.867065 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f46083be-0389-45c9-93fc-0336842ac26a tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:03:37.872966 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f46083be-0389-45c9-93fc-0336842ac26a tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:03:37.875638 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f46083be-0389-45c9-93fc-0336842ac26a tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:03:37.876947 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f46083be-0389-45c9-93fc-0336842ac26a tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:03:38.032226 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-f46083be-0389-45c9-93fc-0336842ac26a tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:03:38.050887 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-f46083be-0389-45c9-93fc-0336842ac26a tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:03:38.057374 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-f46083be-0389-45c9-93fc-0336842ac26a tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:03:38.076200 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-f46083be-0389-45c9-93fc-0336842ac26a tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] 10.222.0.18 "GET /compute/v2.1/servers/2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac" status: 200 len: 1555 microversion: 2.91 time: 0.238692 Oct 22 21:03:38.077281 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1513/3100] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:03:37 2022] GET /compute/v2.1/servers/2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac => generated 1555 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:03:38.097177 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-588ef69d-1e9c-47c3-934a-4f4e47f5b78a tempest-SecurityGroupRulesNegativeTestJSON-1780227540 tempest-SecurityGroupRulesNegativeTestJSON-1780227540-project] Calling method '.version_select at 0x7fd39f6b1940>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:03:38.984316 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-588ef69d-1e9c-47c3-934a-4f4e47f5b78a tempest-SecurityGroupRulesNegativeTestJSON-1780227540 tempest-SecurityGroupRulesNegativeTestJSON-1780227540-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/56682e70-fc08-4f76-8714-42c97305f6c6" status: 202 len: 0 microversion: 2.1 time: 0.904170 Oct 22 21:03:38.990916 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1514/3101] 10.222.0.18 () {58 vars in 1272 bytes} [Sat Oct 22 21:03:38 2022] DELETE /compute/v2.1/os-security-groups/56682e70-fc08-4f76-8714-42c97305f6c6 => generated 0 bytes in 913 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 21:03:38.999635 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-b8796914-1466-4463-aa42-b55f4c58dd28 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:03:39.003684 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-b8796914-1466-4463-aa42-b55f4c58dd28 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] [instance: a99614d8-f2f7-4ce1-87e8-47f3af03d9f8] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:03:39.094122 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b8796914-1466-4463-aa42-b55f4c58dd28 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:03:39.094122 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b8796914-1466-4463-aa42-b55f4c58dd28 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:03:39.094122 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b8796914-1466-4463-aa42-b55f4c58dd28 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:03:39.096996 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b8796914-1466-4463-aa42-b55f4c58dd28 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:03:39.122728 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b8796914-1466-4463-aa42-b55f4c58dd28 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:03:39.129562 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b8796914-1466-4463-aa42-b55f4c58dd28 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:03:40.045310 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-b8796914-1466-4463-aa42-b55f4c58dd28 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1b410a64e0415a96d30f5040361137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd7873d6db4e09bc9ab9a048a6b1ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:03:40.054097 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-b8796914-1466-4463-aa42-b55f4c58dd28 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] 10.222.0.18 "GET /compute/v2.1/servers/a99614d8-f2f7-4ce1-87e8-47f3af03d9f8" status: 200 len: 1525 microversion: 2.1 time: 1.061617 Oct 22 21:03:40.054963 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1515/3102] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:03:38 2022] GET /compute/v2.1/servers/a99614d8-f2f7-4ce1-87e8-47f3af03d9f8 => generated 1525 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:03:40.060323 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-ae062a96-63eb-4b5c-9614-d999029f6e89 tempest-SecurityGroupRulesNegativeTestJSON-1780227540 tempest-SecurityGroupRulesNegativeTestJSON-1780227540-project] Calling method '.version_select at 0x7fd39f8b2ca0>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:03:40.448754 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-ae062a96-63eb-4b5c-9614-d999029f6e89 tempest-SecurityGroupRulesNegativeTestJSON-1780227540 tempest-SecurityGroupRulesNegativeTestJSON-1780227540-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/fd4cd22b-1e00-4925-9f53-08476c502017" status: 202 len: 0 microversion: 2.1 time: 0.392295 Oct 22 21:03:40.449696 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1516/3103] 10.222.0.18 () {58 vars in 1272 bytes} [Sat Oct 22 21:03:40 2022] DELETE /compute/v2.1/os-security-groups/fd4cd22b-1e00-4925-9f53-08476c502017 => generated 0 bytes in 394 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 21:03:40.457172 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-8a303096-3b90-490c-864a-610c4e908e51 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:03:40.459291 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-8a303096-3b90-490c-864a-610c4e908e51 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] [instance: 2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:03:40.476106 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8a303096-3b90-490c-864a-610c4e908e51 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:03:40.477178 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8a303096-3b90-490c-864a-610c4e908e51 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:03:40.478629 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8a303096-3b90-490c-864a-610c4e908e51 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:03:40.479738 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8a303096-3b90-490c-864a-610c4e908e51 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:03:40.480477 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8a303096-3b90-490c-864a-610c4e908e51 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:03:40.482314 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8a303096-3b90-490c-864a-610c4e908e51 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:03:40.704260 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-8a303096-3b90-490c-864a-610c4e908e51 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:03:40.721002 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-8a303096-3b90-490c-864a-610c4e908e51 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:03:40.734480 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-8a303096-3b90-490c-864a-610c4e908e51 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:03:40.760706 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-8a303096-3b90-490c-864a-610c4e908e51 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] 10.222.0.18 "GET /compute/v2.1/servers/2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac" status: 200 len: 1555 microversion: 2.91 time: 0.306679 Oct 22 21:03:40.778964 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1517/3104] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:03:40 2022] GET /compute/v2.1/servers/2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac => generated 1555 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:03:40.807873 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-7ffc00f6-4cec-44cb-a05c-d2d25d587ceb tempest-SecurityGroupRulesNegativeTestJSON-1780227540 tempest-SecurityGroupRulesNegativeTestJSON-1780227540-project] Calling method '.version_select at 0x7fd3a8b5b1f0>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:03:41.105861 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-7ffc00f6-4cec-44cb-a05c-d2d25d587ceb tempest-SecurityGroupRulesNegativeTestJSON-1780227540 tempest-SecurityGroupRulesNegativeTestJSON-1780227540-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/e8ebe1ba-de37-484a-8e8f-1dd8b5fc0fec" status: 202 len: 0 microversion: 2.1 time: 0.325386 Oct 22 21:03:41.106809 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1518/3105] 10.222.0.18 () {58 vars in 1272 bytes} [Sat Oct 22 21:03:40 2022] DELETE /compute/v2.1/os-security-groups/e8ebe1ba-de37-484a-8e8f-1dd8b5fc0fec => generated 0 bytes in 327 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 21:03:41.123542 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-f01a942b-f712-42a2-ab79-efdf0274dad6 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:03:41.124635 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-f01a942b-f712-42a2-ab79-efdf0274dad6 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] [instance: a99614d8-f2f7-4ce1-87e8-47f3af03d9f8] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:03:41.148220 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f01a942b-f712-42a2-ab79-efdf0274dad6 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:03:41.151661 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f01a942b-f712-42a2-ab79-efdf0274dad6 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:03:41.152451 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f01a942b-f712-42a2-ab79-efdf0274dad6 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:03:41.154166 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f01a942b-f712-42a2-ab79-efdf0274dad6 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:03:41.157940 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f01a942b-f712-42a2-ab79-efdf0274dad6 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:03:41.160541 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f01a942b-f712-42a2-ab79-efdf0274dad6 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:03:41.187870 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-57655740-bcc4-4554-9f73-ffdbba3a7e39 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] 10.222.0.18 "GET /compute/v2.1/images/a721137b-509e-48d8-8ac4-4f5f10aaa459" status: 200 len: 1439 microversion: 2.1 time: 20.641125 Oct 22 21:03:41.188440 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1588/3106] 10.222.0.18 () {58 vars in 1233 bytes} [Sat Oct 22 21:03:20 2022] GET /compute/v2.1/images/a721137b-509e-48d8-8ac4-4f5f10aaa459 => generated 1439 bytes in 20643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:03:41.547651 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-f01a942b-f712-42a2-ab79-efdf0274dad6 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1b410a64e0415a96d30f5040361137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd7873d6db4e09bc9ab9a048a6b1ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:03:41.563670 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-f01a942b-f712-42a2-ab79-efdf0274dad6 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] 10.222.0.18 "GET /compute/v2.1/servers/a99614d8-f2f7-4ce1-87e8-47f3af03d9f8" status: 200 len: 1525 microversion: 2.1 time: 0.455481 Oct 22 21:03:41.581047 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1519/3107] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:03:41 2022] GET /compute/v2.1/servers/a99614d8-f2f7-4ce1-87e8-47f3af03d9f8 => generated 1525 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:03:41.795509 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-57ed3d94-950f-4444-be77-6ce52080cea6 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:03:41.796402 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-57ed3d94-950f-4444-be77-6ce52080cea6 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] [instance: 2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:03:41.810329 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-57ed3d94-950f-4444-be77-6ce52080cea6 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:03:41.810818 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-57ed3d94-950f-4444-be77-6ce52080cea6 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:03:41.811264 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-57ed3d94-950f-4444-be77-6ce52080cea6 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:03:41.814809 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-57ed3d94-950f-4444-be77-6ce52080cea6 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:03:41.817095 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-57ed3d94-950f-4444-be77-6ce52080cea6 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:03:41.828991 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-57ed3d94-950f-4444-be77-6ce52080cea6 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:03:42.028352 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-57ed3d94-950f-4444-be77-6ce52080cea6 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:03:42.050705 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-57ed3d94-950f-4444-be77-6ce52080cea6 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:03:42.058235 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-57ed3d94-950f-4444-be77-6ce52080cea6 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:03:42.077060 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-57ed3d94-950f-4444-be77-6ce52080cea6 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] 10.222.0.18 "GET /compute/v2.1/servers/2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac" status: 200 len: 1537 microversion: 2.91 time: 0.286237 Oct 22 21:03:42.095993 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1589/3108] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:03:41 2022] GET /compute/v2.1/servers/2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac => generated 1537 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:03:42.205614 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-c394ed60-694a-4b81-8494-89a66539a4cb tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Calling method '.version_select at 0x7fd39f8b2670>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:03:42.595626 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-bc1bad51-2d05-4b65-bc36-dcb9013dccc3 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:03:42.596237 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-bc1bad51-2d05-4b65-bc36-dcb9013dccc3 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] [instance: a99614d8-f2f7-4ce1-87e8-47f3af03d9f8] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:03:42.605202 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bc1bad51-2d05-4b65-bc36-dcb9013dccc3 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:03:42.605888 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bc1bad51-2d05-4b65-bc36-dcb9013dccc3 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:03:42.606504 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bc1bad51-2d05-4b65-bc36-dcb9013dccc3 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:03:42.608055 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bc1bad51-2d05-4b65-bc36-dcb9013dccc3 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:03:42.608699 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bc1bad51-2d05-4b65-bc36-dcb9013dccc3 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:03:42.609309 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bc1bad51-2d05-4b65-bc36-dcb9013dccc3 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:03:42.985822 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-bc1bad51-2d05-4b65-bc36-dcb9013dccc3 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1b410a64e0415a96d30f5040361137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd7873d6db4e09bc9ab9a048a6b1ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:03:42.998381 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-bc1bad51-2d05-4b65-bc36-dcb9013dccc3 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] 10.222.0.18 "GET /compute/v2.1/servers/a99614d8-f2f7-4ce1-87e8-47f3af03d9f8" status: 200 len: 1525 microversion: 2.1 time: 0.408712 Oct 22 21:03:43.000608 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1590/3109] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:03:42 2022] GET /compute/v2.1/servers/a99614d8-f2f7-4ce1-87e8-47f3af03d9f8 => generated 1525 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:03:43.109141 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-19d1dafb-1a60-4f8d-8bd8-f294526418f5 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:03:43.110092 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-19d1dafb-1a60-4f8d-8bd8-f294526418f5 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] [instance: 2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:03:43.125068 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-19d1dafb-1a60-4f8d-8bd8-f294526418f5 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:03:43.131989 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-19d1dafb-1a60-4f8d-8bd8-f294526418f5 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:03:43.134173 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-19d1dafb-1a60-4f8d-8bd8-f294526418f5 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:03:43.138296 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-19d1dafb-1a60-4f8d-8bd8-f294526418f5 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:03:43.139260 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-19d1dafb-1a60-4f8d-8bd8-f294526418f5 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:03:43.141645 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-19d1dafb-1a60-4f8d-8bd8-f294526418f5 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:03:43.357093 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-19d1dafb-1a60-4f8d-8bd8-f294526418f5 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:03:43.373635 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-19d1dafb-1a60-4f8d-8bd8-f294526418f5 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:03:43.379273 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-19d1dafb-1a60-4f8d-8bd8-f294526418f5 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:03:43.393782 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-19d1dafb-1a60-4f8d-8bd8-f294526418f5 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] 10.222.0.18 "GET /compute/v2.1/servers/2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac" status: 200 len: 1537 microversion: 2.91 time: 0.289251 Oct 22 21:03:43.395762 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1591/3110] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:03:43 2022] GET /compute/v2.1/servers/2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac => generated 1537 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 22 21:03:44.028338 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-356b6fa8-73da-4a81-ab93-cf81889a8f05 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:03:44.029174 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-356b6fa8-73da-4a81-ab93-cf81889a8f05 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] [instance: a99614d8-f2f7-4ce1-87e8-47f3af03d9f8] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:03:44.046901 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-356b6fa8-73da-4a81-ab93-cf81889a8f05 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:03:44.047456 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-356b6fa8-73da-4a81-ab93-cf81889a8f05 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:03:44.047895 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-356b6fa8-73da-4a81-ab93-cf81889a8f05 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:03:44.048629 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-356b6fa8-73da-4a81-ab93-cf81889a8f05 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:03:44.054416 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-356b6fa8-73da-4a81-ab93-cf81889a8f05 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:03:44.054956 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-356b6fa8-73da-4a81-ab93-cf81889a8f05 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:03:44.156966 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-c394ed60-694a-4b81-8494-89a66539a4cb tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] 10.222.0.18 "GET /compute/v2.1/images/a721137b-509e-48d8-8ac4-4f5f10aaa459" status: 200 len: 1448 microversion: 2.1 time: 1.954148 Oct 22 21:03:44.169096 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1520/3111] 10.222.0.18 () {58 vars in 1233 bytes} [Sat Oct 22 21:03:42 2022] GET /compute/v2.1/images/a721137b-509e-48d8-8ac4-4f5f10aaa459 => generated 1448 bytes in 1969 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:03:44.179811 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-0786cad0-418d-4f55-b6ea-45bd0c0cc091 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Calling method '.version_select at 0x7fd3a8c095e0>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:03:44.328139 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-0786cad0-418d-4f55-b6ea-45bd0c0cc091 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] 10.222.0.18 "GET /compute/v2.1/images/a721137b-509e-48d8-8ac4-4f5f10aaa459" status: 200 len: 1448 microversion: 2.1 time: 0.157388 Oct 22 21:03:44.329986 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1521/3112] 10.222.0.18 () {58 vars in 1233 bytes} [Sat Oct 22 21:03:44 2022] GET /compute/v2.1/images/a721137b-509e-48d8-8ac4-4f5f10aaa459 => generated 1448 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:03:44.354802 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-02ab8ed2-13cf-420f-97f8-8e3370d9781c tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Calling method '.version_select at 0x7fd39f320280>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:03:44.885628 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-356b6fa8-73da-4a81-ab93-cf81889a8f05 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1b410a64e0415a96d30f5040361137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd7873d6db4e09bc9ab9a048a6b1ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:03:44.894850 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-356b6fa8-73da-4a81-ab93-cf81889a8f05 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] 10.222.0.18 "GET /compute/v2.1/servers/a99614d8-f2f7-4ce1-87e8-47f3af03d9f8" status: 200 len: 1525 microversion: 2.1 time: 0.870693 Oct 22 21:03:44.899909 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1592/3113] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:03:44 2022] GET /compute/v2.1/servers/a99614d8-f2f7-4ce1-87e8-47f3af03d9f8 => generated 1525 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:03:44.916336 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-fb55b7d4-1e48-46ce-9468-0ffd4a9fc6b6 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:03:44.917412 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-fb55b7d4-1e48-46ce-9468-0ffd4a9fc6b6 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] [instance: 2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:03:44.931223 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fb55b7d4-1e48-46ce-9468-0ffd4a9fc6b6 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:03:44.933179 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fb55b7d4-1e48-46ce-9468-0ffd4a9fc6b6 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:03:44.937892 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fb55b7d4-1e48-46ce-9468-0ffd4a9fc6b6 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:03:44.938933 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fb55b7d4-1e48-46ce-9468-0ffd4a9fc6b6 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:03:44.939627 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fb55b7d4-1e48-46ce-9468-0ffd4a9fc6b6 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:03:44.940234 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fb55b7d4-1e48-46ce-9468-0ffd4a9fc6b6 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:03:45.245531 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-fb55b7d4-1e48-46ce-9468-0ffd4a9fc6b6 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:03:45.258799 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-fb55b7d4-1e48-46ce-9468-0ffd4a9fc6b6 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:03:45.260468 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-fb55b7d4-1e48-46ce-9468-0ffd4a9fc6b6 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:03:45.275471 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-fb55b7d4-1e48-46ce-9468-0ffd4a9fc6b6 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] 10.222.0.18 "GET /compute/v2.1/servers/2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac" status: 200 len: 1540 microversion: 2.91 time: 0.373126 Oct 22 21:03:45.276092 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1593/3114] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:03:44 2022] GET /compute/v2.1/servers/2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac => generated 1540 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:03:45.316306 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-68f5de54-9289-4b50-b2ce-70590cec4fba tempest-UnshelveToHostMultiNodesTest-2069914657 tempest-UnshelveToHostMultiNodesTest-2069914657-project-admin] Action: 'action', calling method: >, body: {"unshelve": {"host": "nch1-master-1"}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:03:45.319632 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-68f5de54-9289-4b50-b2ce-70590cec4fba tempest-UnshelveToHostMultiNodesTest-2069914657 tempest-UnshelveToHostMultiNodesTest-2069914657-project-admin] [instance: 2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:03:45.333314 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-68f5de54-9289-4b50-b2ce-70590cec4fba tempest-UnshelveToHostMultiNodesTest-2069914657 tempest-UnshelveToHostMultiNodesTest-2069914657-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:03:45.333818 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-68f5de54-9289-4b50-b2ce-70590cec4fba tempest-UnshelveToHostMultiNodesTest-2069914657 tempest-UnshelveToHostMultiNodesTest-2069914657-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:03:45.337852 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-68f5de54-9289-4b50-b2ce-70590cec4fba tempest-UnshelveToHostMultiNodesTest-2069914657 tempest-UnshelveToHostMultiNodesTest-2069914657-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:03:45.338823 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-68f5de54-9289-4b50-b2ce-70590cec4fba tempest-UnshelveToHostMultiNodesTest-2069914657 tempest-UnshelveToHostMultiNodesTest-2069914657-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:03:45.341688 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-68f5de54-9289-4b50-b2ce-70590cec4fba tempest-UnshelveToHostMultiNodesTest-2069914657 tempest-UnshelveToHostMultiNodesTest-2069914657-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:03:45.343407 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-68f5de54-9289-4b50-b2ce-70590cec4fba tempest-UnshelveToHostMultiNodesTest-2069914657 tempest-UnshelveToHostMultiNodesTest-2069914657-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:03:45.671160 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-68f5de54-9289-4b50-b2ce-70590cec4fba tempest-UnshelveToHostMultiNodesTest-2069914657 tempest-UnshelveToHostMultiNodesTest-2069914657-project-admin] [instance: 2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "nch1-master-1". {{(pid=138745) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 22 21:03:45.798878 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-02ab8ed2-13cf-420f-97f8-8e3370d9781c tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] 10.222.0.18 "DELETE /compute/v2.1/images/a721137b-509e-48d8-8ac4-4f5f10aaa459" status: 204 len: 0 microversion: 2.1 time: 1.453008 Oct 22 21:03:45.803432 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1522/3115] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:03:44 2022] DELETE /compute/v2.1/images/a721137b-509e-48d8-8ac4-4f5f10aaa459 => generated 0 bytes in 1460 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 21:03:45.812317 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-13bf1ede-ffbd-4e88-b998-7cb054be370b tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:03:45.813135 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-13bf1ede-ffbd-4e88-b998-7cb054be370b tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] [instance: 524c2c11-4a65-4360-93e4-e25349cb6416] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:03:45.833576 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-13bf1ede-ffbd-4e88-b998-7cb054be370b tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:03:45.834099 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-13bf1ede-ffbd-4e88-b998-7cb054be370b tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:03:45.834553 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-13bf1ede-ffbd-4e88-b998-7cb054be370b tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:03:45.842491 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-13bf1ede-ffbd-4e88-b998-7cb054be370b tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:03:45.845952 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-13bf1ede-ffbd-4e88-b998-7cb054be370b tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:03:45.848142 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-13bf1ede-ffbd-4e88-b998-7cb054be370b tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:03:45.946860 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-68f5de54-9289-4b50-b2ce-70590cec4fba tempest-UnshelveToHostMultiNodesTest-2069914657 tempest-UnshelveToHostMultiNodesTest-2069914657-project-admin] 10.222.0.18 "POST /compute/v2.1/servers/2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac/action" status: 202 len: 0 microversion: 2.91 time: 0.634720 Oct 22 21:03:45.952300 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1594/3116] 10.222.0.18 () {62 vars in 1319 bytes} [Sat Oct 22 21:03:45 2022] POST /compute/v2.1/servers/2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac/action => generated 0 bytes in 641 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 22 21:03:45.958545 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-13bf1ede-ffbd-4e88-b998-7cb054be370b tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] [instance: 524c2c11-4a65-4360-93e4-e25349cb6416] Going to try to terminate instance {{(pid=138744) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 21:03:45.969378 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-0117b137-a59f-4105-b94f-81c2ca6b7cd4 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:03:45.971755 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-0117b137-a59f-4105-b94f-81c2ca6b7cd4 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] [instance: a99614d8-f2f7-4ce1-87e8-47f3af03d9f8] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:03:45.999879 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0117b137-a59f-4105-b94f-81c2ca6b7cd4 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:03:46.000358 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0117b137-a59f-4105-b94f-81c2ca6b7cd4 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:03:46.000832 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0117b137-a59f-4105-b94f-81c2ca6b7cd4 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:03:46.006319 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0117b137-a59f-4105-b94f-81c2ca6b7cd4 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:03:46.007147 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0117b137-a59f-4105-b94f-81c2ca6b7cd4 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:03:46.008932 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0117b137-a59f-4105-b94f-81c2ca6b7cd4 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:03:46.247976 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-13bf1ede-ffbd-4e88-b998-7cb054be370b tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] 10.222.0.18 "DELETE /compute/v2.1/servers/524c2c11-4a65-4360-93e4-e25349cb6416" status: 204 len: 0 microversion: 2.1 time: 0.439595 Oct 22 21:03:46.249078 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1523/3117] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 21:03:45 2022] DELETE /compute/v2.1/servers/524c2c11-4a65-4360-93e4-e25349cb6416 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 22 21:03:46.265481 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-a3dcaed1-8833-4256-9f18-ceceb7223ab2 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:03:46.266915 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-a3dcaed1-8833-4256-9f18-ceceb7223ab2 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] [instance: 2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:03:46.274857 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a3dcaed1-8833-4256-9f18-ceceb7223ab2 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:03:46.275643 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a3dcaed1-8833-4256-9f18-ceceb7223ab2 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:03:46.276270 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a3dcaed1-8833-4256-9f18-ceceb7223ab2 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:03:46.281019 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a3dcaed1-8833-4256-9f18-ceceb7223ab2 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:03:46.282674 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a3dcaed1-8833-4256-9f18-ceceb7223ab2 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:03:46.283309 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a3dcaed1-8833-4256-9f18-ceceb7223ab2 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:03:46.589142 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-a3dcaed1-8833-4256-9f18-ceceb7223ab2 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:03:46.606764 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-a3dcaed1-8833-4256-9f18-ceceb7223ab2 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:03:46.608388 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-a3dcaed1-8833-4256-9f18-ceceb7223ab2 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:03:46.650363 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_api:SELECT=92,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:03:46.667021 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-a3dcaed1-8833-4256-9f18-ceceb7223ab2 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] 10.222.0.18 "GET /compute/v2.1/servers/2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac" status: 200 len: 1488 microversion: 2.91 time: 0.416374 Oct 22 21:03:46.670821 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1524/3118] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:03:46 2022] GET /compute/v2.1/servers/2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac => generated 1488 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:03:46.807047 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-ab8caa82-370b-43a8-be50-405cd7db6387 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-1671528294", "imageRef": "085e4478-6edc-4a69-8e08-f9831713eb65", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:03:46.817351 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-0117b137-a59f-4105-b94f-81c2ca6b7cd4 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1b410a64e0415a96d30f5040361137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd7873d6db4e09bc9ab9a048a6b1ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:03:46.830594 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-0117b137-a59f-4105-b94f-81c2ca6b7cd4 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] 10.222.0.18 "GET /compute/v2.1/servers/a99614d8-f2f7-4ce1-87e8-47f3af03d9f8" status: 200 len: 1525 microversion: 2.1 time: 0.874949 Oct 22 21:03:46.843025 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1595/3119] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:03:45 2022] GET /compute/v2.1/servers/a99614d8-f2f7-4ce1-87e8-47f3af03d9f8 => generated 1525 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:03:46.856801 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-70fb076d-8855-46ac-9db9-d34f2bc923a8 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1064537111", "imageRef": "085e4478-6edc-4a69-8e08-f9831713eb65", "flavorRef": "452", "networks": [{"uuid": "f1ad1f3f-09bf-4698-9fe5-20142c78993a"}]}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:03:46.974248 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.network.neutron [None req-ab8caa82-370b-43a8-be50-405cd7db6387 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] validate_networks() for [('e38d9a19-7a78-47d2-978a-657e003fdabb', None, None, None, None, None)] {{(pid=138744) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 21:03:47.004333 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.network.neutron [None req-70fb076d-8855-46ac-9db9-d34f2bc923a8 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] validate_networks() for [('f1ad1f3f-09bf-4698-9fe5-20142c78993a', None, None, None, None, None)] {{(pid=138745) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 21:03:48.452485 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-70fb076d-8855-46ac-9db9-d34f2bc923a8 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Flavor limits 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 21:03:48.453151 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-70fb076d-8855-46ac-9db9-d34f2bc923a8 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Image limits 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 21:03:48.453763 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-70fb076d-8855-46ac-9db9-d34f2bc923a8 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Flavor pref 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 21:03:48.454271 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-70fb076d-8855-46ac-9db9-d34f2bc923a8 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Image pref 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 21:03:48.454928 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-70fb076d-8855-46ac-9db9-d34f2bc923a8 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 21:03:48.492909 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-70fb076d-8855-46ac-9db9-d34f2bc923a8 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:03:48.493408 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-70fb076d-8855-46ac-9db9-d34f2bc923a8 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:03:48.497427 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-70fb076d-8855-46ac-9db9-d34f2bc923a8 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:03:48.498427 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-70fb076d-8855-46ac-9db9-d34f2bc923a8 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:03:48.502851 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-70fb076d-8855-46ac-9db9-d34f2bc923a8 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:03:48.503313 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-70fb076d-8855-46ac-9db9-d34f2bc923a8 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:03:48.575760 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-70fb076d-8855-46ac-9db9-d34f2bc923a8 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Getting quotas for project 66a26a2284f4424cbeaf63d504652546. Resources: {'cores', 'instances', 'ram'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 21:03:48.595555 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-70fb076d-8855-46ac-9db9-d34f2bc923a8 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Getting quotas for user f0a44ff8e7c14b94b1670f030085c43d and project 66a26a2284f4424cbeaf63d504652546. Resources: {'cores', 'instances', 'ram'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 21:03:48.656974 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-70fb076d-8855-46ac-9db9-d34f2bc923a8 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Going to run 1 instances... {{(pid=138745) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 21:03:48.665051 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-70fb076d-8855-46ac-9db9-d34f2bc923a8 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] [instance: 9bfb71b4-0081-493a-8ed5-1c80169b12d0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='085e4478-6edc-4a69-8e08-f9831713eb65',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138745) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 21:03:48.842933 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-70fb076d-8855-46ac-9db9-d34f2bc923a8 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.998283 Oct 22 21:03:48.862677 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1596/3120] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Oct 22 21:03:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 2019 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 21:03:48.903333 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-ba310985-c588-42ee-9df8-dac7a4cfec43 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:03:48.906108 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-ba310985-c588-42ee-9df8-dac7a4cfec43 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] [instance: 2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:03:48.931648 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ba310985-c588-42ee-9df8-dac7a4cfec43 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:03:48.936689 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ba310985-c588-42ee-9df8-dac7a4cfec43 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:03:48.937525 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ba310985-c588-42ee-9df8-dac7a4cfec43 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:03:48.939255 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ba310985-c588-42ee-9df8-dac7a4cfec43 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:03:48.940758 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ba310985-c588-42ee-9df8-dac7a4cfec43 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:03:48.942486 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ba310985-c588-42ee-9df8-dac7a4cfec43 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:03:49.601609 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-ba310985-c588-42ee-9df8-dac7a4cfec43 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:03:49.626586 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-ba310985-c588-42ee-9df8-dac7a4cfec43 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:03:49.630068 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-ba310985-c588-42ee-9df8-dac7a4cfec43 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:03:49.675463 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-ba310985-c588-42ee-9df8-dac7a4cfec43 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] 10.222.0.18 "GET /compute/v2.1/servers/2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac" status: 200 len: 1546 microversion: 2.91 time: 0.810755 Oct 22 21:03:49.679025 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1597/3121] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:03:48 2022] GET /compute/v2.1/servers/2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac => generated 1546 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:03:49.696661 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-120bc449-9bce-4e6f-b6ab-6f35a0e0ae16 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:03:49.697666 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-120bc449-9bce-4e6f-b6ab-6f35a0e0ae16 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] [instance: a99614d8-f2f7-4ce1-87e8-47f3af03d9f8] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:03:49.719890 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-120bc449-9bce-4e6f-b6ab-6f35a0e0ae16 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:03:49.720398 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-120bc449-9bce-4e6f-b6ab-6f35a0e0ae16 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:03:49.720846 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-120bc449-9bce-4e6f-b6ab-6f35a0e0ae16 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:03:49.724603 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-120bc449-9bce-4e6f-b6ab-6f35a0e0ae16 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:03:49.726225 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-120bc449-9bce-4e6f-b6ab-6f35a0e0ae16 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:03:49.727179 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-120bc449-9bce-4e6f-b6ab-6f35a0e0ae16 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:03:50.566587 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-120bc449-9bce-4e6f-b6ab-6f35a0e0ae16 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1b410a64e0415a96d30f5040361137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd7873d6db4e09bc9ab9a048a6b1ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:03:50.584255 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-120bc449-9bce-4e6f-b6ab-6f35a0e0ae16 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] 10.222.0.18 "GET /compute/v2.1/servers/a99614d8-f2f7-4ce1-87e8-47f3af03d9f8" status: 200 len: 1525 microversion: 2.1 time: 0.902160 Oct 22 21:03:50.612843 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1598/3122] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:03:49 2022] GET /compute/v2.1/servers/a99614d8-f2f7-4ce1-87e8-47f3af03d9f8 => generated 1525 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:03:50.672871 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-896a7e59-e129-4a73-9c01-b11b826f5dee tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:03:50.674386 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-896a7e59-e129-4a73-9c01-b11b826f5dee tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] [instance: 9bfb71b4-0081-493a-8ed5-1c80169b12d0] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:03:50.674632 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-ab8caa82-370b-43a8-be50-405cd7db6387 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Flavor limits 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 21:03:50.675801 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-ab8caa82-370b-43a8-be50-405cd7db6387 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Image limits 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 21:03:50.676847 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-ab8caa82-370b-43a8-be50-405cd7db6387 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Flavor pref 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 21:03:50.678493 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-ab8caa82-370b-43a8-be50-405cd7db6387 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Image pref 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 21:03:50.679369 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-ab8caa82-370b-43a8-be50-405cd7db6387 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 21:03:50.694065 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ab8caa82-370b-43a8-be50-405cd7db6387 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:03:50.694973 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ab8caa82-370b-43a8-be50-405cd7db6387 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:03:50.695744 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ab8caa82-370b-43a8-be50-405cd7db6387 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:03:50.697313 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ab8caa82-370b-43a8-be50-405cd7db6387 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:03:50.698594 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ab8caa82-370b-43a8-be50-405cd7db6387 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:03:50.699281 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ab8caa82-370b-43a8-be50-405cd7db6387 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:03:50.705653 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-896a7e59-e129-4a73-9c01-b11b826f5dee tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:03:50.708096 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-896a7e59-e129-4a73-9c01-b11b826f5dee tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:03:50.710529 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-896a7e59-e129-4a73-9c01-b11b826f5dee tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:03:50.712897 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-896a7e59-e129-4a73-9c01-b11b826f5dee tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:03:50.714971 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-896a7e59-e129-4a73-9c01-b11b826f5dee tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:03:50.717296 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-896a7e59-e129-4a73-9c01-b11b826f5dee tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:03:50.741708 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-ab8caa82-370b-43a8-be50-405cd7db6387 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Getting quotas for project b54f56cfbc814cccb533c65966f35a93. Resources: {'cores', 'instances', 'ram'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 21:03:50.754518 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-ab8caa82-370b-43a8-be50-405cd7db6387 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Getting quotas for user 879c85830a9f42088a4ebdf1e3cfb39b and project b54f56cfbc814cccb533c65966f35a93. Resources: {'cores', 'instances', 'ram'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 21:03:50.805466 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-ab8caa82-370b-43a8-be50-405cd7db6387 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Going to run 1 instances... {{(pid=138744) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 21:03:50.810145 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-ab8caa82-370b-43a8-be50-405cd7db6387 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] [instance: 87b07efc-fa80-40ad-8077-333547ee7301] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='085e4478-6edc-4a69-8e08-f9831713eb65',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138744) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 21:03:50.952284 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-ab8caa82-370b-43a8-be50-405cd7db6387 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.279861 Oct 22 21:03:50.967143 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1525/3123] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Oct 22 21:03:46 2022] POST /compute/v2.1/servers => generated 383 bytes in 4293 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 21:03:50.993911 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-5275a8a5-1054-4ff4-b016-5bba9d54092d req-243c7fda-41b2-4426-9dec-eaa081d1d878 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "524c2c11-4a65-4360-93e4-e25349cb6416", "name": "network-vif-unplugged", "status": "completed", "tag": "7e016b42-09b0-4f7f-9ce3-9e528785b3cd"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:03:51.033498 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-5275a8a5-1054-4ff4-b016-5bba9d54092d req-243c7fda-41b2-4426-9dec-eaa081d1d878 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:03:51.033993 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-5275a8a5-1054-4ff4-b016-5bba9d54092d req-243c7fda-41b2-4426-9dec-eaa081d1d878 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:03:51.040465 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-5275a8a5-1054-4ff4-b016-5bba9d54092d req-243c7fda-41b2-4426-9dec-eaa081d1d878 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:03:51.099504 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-5275a8a5-1054-4ff4-b016-5bba9d54092d req-243c7fda-41b2-4426-9dec-eaa081d1d878 service nova] Creating event network-vif-unplugged:7e016b42-09b0-4f7f-9ce3-9e528785b3cd for instance 524c2c11-4a65-4360-93e4-e25349cb6416 on nch2-master-1 Oct 22 21:03:51.124875 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-5275a8a5-1054-4ff4-b016-5bba9d54092d req-243c7fda-41b2-4426-9dec-eaa081d1d878 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.148959 Oct 22 21:03:51.132056 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1526/3124] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:03:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:03:51.173572 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-9cd33d7f-9d0a-4978-b858-8c1e062818b4 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:03:51.177204 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-9cd33d7f-9d0a-4978-b858-8c1e062818b4 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] [instance: 2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:03:51.212204 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9cd33d7f-9d0a-4978-b858-8c1e062818b4 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:03:51.212724 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9cd33d7f-9d0a-4978-b858-8c1e062818b4 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:03:51.213174 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9cd33d7f-9d0a-4978-b858-8c1e062818b4 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:03:51.220106 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9cd33d7f-9d0a-4978-b858-8c1e062818b4 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:03:51.232748 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9cd33d7f-9d0a-4978-b858-8c1e062818b4 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:03:51.233664 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9cd33d7f-9d0a-4978-b858-8c1e062818b4 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:03:51.380499 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:03:51.741920 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-896a7e59-e129-4a73-9c01-b11b826f5dee tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a44ff8e7c14b94b1670f030085c43d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a26a2284f4424cbeaf63d504652546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:03:51.790157 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-896a7e59-e129-4a73-9c01-b11b826f5dee tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] 10.222.0.18 "GET /compute/v2.1/servers/9bfb71b4-0081-493a-8ed5-1c80169b12d0" status: 200 len: 1212 microversion: 2.1 time: 1.163661 Oct 22 21:03:51.790875 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1599/3125] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:03:50 2022] GET /compute/v2.1/servers/9bfb71b4-0081-493a-8ed5-1c80169b12d0 => generated 1212 bytes in 1178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:03:51.830535 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-d8d4d983-9b1b-40cb-8599-779ed2015ed5 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:03:51.845696 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-d8d4d983-9b1b-40cb-8599-779ed2015ed5 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] [instance: 87b07efc-fa80-40ad-8077-333547ee7301] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:03:51.955882 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-9cd33d7f-9d0a-4978-b858-8c1e062818b4 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:03:51.991258 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-9cd33d7f-9d0a-4978-b858-8c1e062818b4 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:03:51.993543 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-9cd33d7f-9d0a-4978-b858-8c1e062818b4 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:03:52.019902 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-9cd33d7f-9d0a-4978-b858-8c1e062818b4 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] 10.222.0.18 "GET /compute/v2.1/servers/2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac" status: 200 len: 1546 microversion: 2.91 time: 0.878799 Oct 22 21:03:52.025369 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1527/3126] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:03:51 2022] GET /compute/v2.1/servers/2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac => generated 1546 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:03:52.048285 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-fa1e68e1-8a8b-4cde-8fab-54487439f249 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:03:52.050099 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-fa1e68e1-8a8b-4cde-8fab-54487439f249 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] [instance: a99614d8-f2f7-4ce1-87e8-47f3af03d9f8] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:03:52.074824 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fa1e68e1-8a8b-4cde-8fab-54487439f249 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:03:52.075743 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fa1e68e1-8a8b-4cde-8fab-54487439f249 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:03:52.077202 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fa1e68e1-8a8b-4cde-8fab-54487439f249 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:03:52.083715 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fa1e68e1-8a8b-4cde-8fab-54487439f249 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:03:52.089897 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fa1e68e1-8a8b-4cde-8fab-54487439f249 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:03:52.091853 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fa1e68e1-8a8b-4cde-8fab-54487439f249 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:03:52.873585 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-d8d4d983-9b1b-40cb-8599-779ed2015ed5 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879c85830a9f42088a4ebdf1e3cfb39b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b54f56cfbc814cccb533c65966f35a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:03:52.891990 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-d8d4d983-9b1b-40cb-8599-779ed2015ed5 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] 10.222.0.18 "GET /compute/v2.1/servers/87b07efc-fa80-40ad-8077-333547ee7301" status: 200 len: 1214 microversion: 2.1 time: 1.085576 Oct 22 21:03:52.898607 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1600/3127] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:03:51 2022] GET /compute/v2.1/servers/87b07efc-fa80-40ad-8077-333547ee7301 => generated 1214 bytes in 1097 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:03:52.916843 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-c951ec5c-84ae-4ec9-b70c-b5e54d6e2f7c tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:03:52.919757 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-c951ec5c-84ae-4ec9-b70c-b5e54d6e2f7c tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] [instance: 9bfb71b4-0081-493a-8ed5-1c80169b12d0] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:03:52.934420 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c951ec5c-84ae-4ec9-b70c-b5e54d6e2f7c tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:03:52.937782 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c951ec5c-84ae-4ec9-b70c-b5e54d6e2f7c tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:03:52.938792 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c951ec5c-84ae-4ec9-b70c-b5e54d6e2f7c tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:03:52.940153 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c951ec5c-84ae-4ec9-b70c-b5e54d6e2f7c tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:03:52.942026 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c951ec5c-84ae-4ec9-b70c-b5e54d6e2f7c tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:03:52.943868 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c951ec5c-84ae-4ec9-b70c-b5e54d6e2f7c tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:03:54.761846 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-c951ec5c-84ae-4ec9-b70c-b5e54d6e2f7c tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a44ff8e7c14b94b1670f030085c43d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a26a2284f4424cbeaf63d504652546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:03:54.777035 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-c951ec5c-84ae-4ec9-b70c-b5e54d6e2f7c tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] 10.222.0.18 "GET /compute/v2.1/servers/9bfb71b4-0081-493a-8ed5-1c80169b12d0" status: 200 len: 1266 microversion: 2.1 time: 1.871920 Oct 22 21:03:54.778045 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1601/3128] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:03:52 2022] GET /compute/v2.1/servers/9bfb71b4-0081-493a-8ed5-1c80169b12d0 => generated 1266 bytes in 1879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:03:54.792377 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-7460ade0-5b81-41a9-ab3b-226410829cd1 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:03:54.797903 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-7460ade0-5b81-41a9-ab3b-226410829cd1 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] [instance: 2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:03:54.819507 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7460ade0-5b81-41a9-ab3b-226410829cd1 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:03:54.820027 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7460ade0-5b81-41a9-ab3b-226410829cd1 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:03:54.820713 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7460ade0-5b81-41a9-ab3b-226410829cd1 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:03:54.821515 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7460ade0-5b81-41a9-ab3b-226410829cd1 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:03:54.822047 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7460ade0-5b81-41a9-ab3b-226410829cd1 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:03:54.822418 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7460ade0-5b81-41a9-ab3b-226410829cd1 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:03:55.253504 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-7460ade0-5b81-41a9-ab3b-226410829cd1 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:03:55.262615 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-7460ade0-5b81-41a9-ab3b-226410829cd1 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:03:55.282018 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-7460ade0-5b81-41a9-ab3b-226410829cd1 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:03:55.313579 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-7460ade0-5b81-41a9-ab3b-226410829cd1 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] 10.222.0.18 "GET /compute/v2.1/servers/2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac" status: 200 len: 1546 microversion: 2.91 time: 0.534246 Oct 22 21:03:55.314203 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1602/3129] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:03:54 2022] GET /compute/v2.1/servers/2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac => generated 1546 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:03:55.339881 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-eb770d65-86f7-4196-be6c-0f4b23efafc8 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:03:55.340662 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-eb770d65-86f7-4196-be6c-0f4b23efafc8 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] [instance: 87b07efc-fa80-40ad-8077-333547ee7301] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:03:55.367098 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-eb770d65-86f7-4196-be6c-0f4b23efafc8 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:03:55.367765 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-eb770d65-86f7-4196-be6c-0f4b23efafc8 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:03:55.368137 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-eb770d65-86f7-4196-be6c-0f4b23efafc8 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:03:55.368877 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-eb770d65-86f7-4196-be6c-0f4b23efafc8 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:03:55.369346 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-eb770d65-86f7-4196-be6c-0f4b23efafc8 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:03:55.369794 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-eb770d65-86f7-4196-be6c-0f4b23efafc8 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:03:55.877659 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-fa1e68e1-8a8b-4cde-8fab-54487439f249 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1b410a64e0415a96d30f5040361137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd7873d6db4e09bc9ab9a048a6b1ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:03:55.902590 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-fa1e68e1-8a8b-4cde-8fab-54487439f249 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] 10.222.0.18 "GET /compute/v2.1/servers/a99614d8-f2f7-4ce1-87e8-47f3af03d9f8" status: 200 len: 1525 microversion: 2.1 time: 3.872820 Oct 22 21:03:55.903214 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1528/3130] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:03:52 2022] GET /compute/v2.1/servers/a99614d8-f2f7-4ce1-87e8-47f3af03d9f8 => generated 1525 bytes in 3877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:03:56.104070 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-eb770d65-86f7-4196-be6c-0f4b23efafc8 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879c85830a9f42088a4ebdf1e3cfb39b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b54f56cfbc814cccb533c65966f35a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:03:56.130499 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-eb770d65-86f7-4196-be6c-0f4b23efafc8 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] 10.222.0.18 "GET /compute/v2.1/servers/87b07efc-fa80-40ad-8077-333547ee7301" status: 200 len: 1272 microversion: 2.1 time: 0.815080 Oct 22 21:03:56.152045 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1603/3131] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:03:55 2022] GET /compute/v2.1/servers/87b07efc-fa80-40ad-8077-333547ee7301 => generated 1272 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:03:56.159246 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-7f491f7a-65a7-49d4-8724-d0b3843f9b1e tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:03:56.160692 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-7f491f7a-65a7-49d4-8724-d0b3843f9b1e tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] [instance: 9bfb71b4-0081-493a-8ed5-1c80169b12d0] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:03:56.168462 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7f491f7a-65a7-49d4-8724-d0b3843f9b1e tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:03:56.169492 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7f491f7a-65a7-49d4-8724-d0b3843f9b1e tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:03:56.170162 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7f491f7a-65a7-49d4-8724-d0b3843f9b1e tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:03:56.171137 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7f491f7a-65a7-49d4-8724-d0b3843f9b1e tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:03:56.172035 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7f491f7a-65a7-49d4-8724-d0b3843f9b1e tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:03:56.172711 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7f491f7a-65a7-49d4-8724-d0b3843f9b1e tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:03:56.670904 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-7f491f7a-65a7-49d4-8724-d0b3843f9b1e tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a44ff8e7c14b94b1670f030085c43d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a26a2284f4424cbeaf63d504652546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:03:56.692728 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-7f491f7a-65a7-49d4-8724-d0b3843f9b1e tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] 10.222.0.18 "GET /compute/v2.1/servers/9bfb71b4-0081-493a-8ed5-1c80169b12d0" status: 200 len: 1308 microversion: 2.1 time: 0.538905 Oct 22 21:03:56.707409 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1604/3132] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:03:56 2022] GET /compute/v2.1/servers/9bfb71b4-0081-493a-8ed5-1c80169b12d0 => generated 1308 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:03:56.721046 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-13d327d2-be05-4056-90d6-e0cfd47ef269 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:03:56.724148 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-13d327d2-be05-4056-90d6-e0cfd47ef269 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] [instance: 2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:03:56.751633 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-13d327d2-be05-4056-90d6-e0cfd47ef269 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:03:56.757574 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-13d327d2-be05-4056-90d6-e0cfd47ef269 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:03:56.758290 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-13d327d2-be05-4056-90d6-e0cfd47ef269 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:03:56.760896 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-9dfc7e5d-92a4-4a0d-bdf7-4778952ec289 req-358890f4-1f00-4f85-a781-9695b057bf12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "524c2c11-4a65-4360-93e4-e25349cb6416", "name": "network-vif-deleted", "tag": "7e016b42-09b0-4f7f-9ce3-9e528785b3cd"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:03:56.761405 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-13d327d2-be05-4056-90d6-e0cfd47ef269 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:03:56.765533 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-13d327d2-be05-4056-90d6-e0cfd47ef269 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:03:56.766575 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-13d327d2-be05-4056-90d6-e0cfd47ef269 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:03:56.793092 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-9dfc7e5d-92a4-4a0d-bdf7-4778952ec289 req-358890f4-1f00-4f85-a781-9695b057bf12 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:03:56.793598 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-9dfc7e5d-92a4-4a0d-bdf7-4778952ec289 req-358890f4-1f00-4f85-a781-9695b057bf12 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:03:56.804986 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-9dfc7e5d-92a4-4a0d-bdf7-4778952ec289 req-358890f4-1f00-4f85-a781-9695b057bf12 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:03:56.919714 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-9dfc7e5d-92a4-4a0d-bdf7-4778952ec289 req-358890f4-1f00-4f85-a781-9695b057bf12 service nova] Creating event network-vif-deleted:7e016b42-09b0-4f7f-9ce3-9e528785b3cd for instance 524c2c11-4a65-4360-93e4-e25349cb6416 on nch2-master-1 Oct 22 21:03:56.958644 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-9dfc7e5d-92a4-4a0d-bdf7-4778952ec289 req-358890f4-1f00-4f85-a781-9695b057bf12 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 1.054090 Oct 22 21:03:56.962430 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1529/3133] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:03:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 1059 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:03:56.983620 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-1f1da0c6-ab29-4e0a-8463-bad4e855f8fc tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:03:56.985083 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-1f1da0c6-ab29-4e0a-8463-bad4e855f8fc tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] [instance: a99614d8-f2f7-4ce1-87e8-47f3af03d9f8] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:03:57.006455 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1f1da0c6-ab29-4e0a-8463-bad4e855f8fc tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:03:57.006973 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1f1da0c6-ab29-4e0a-8463-bad4e855f8fc tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:03:57.007486 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1f1da0c6-ab29-4e0a-8463-bad4e855f8fc tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:03:57.008267 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1f1da0c6-ab29-4e0a-8463-bad4e855f8fc tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:03:57.008728 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1f1da0c6-ab29-4e0a-8463-bad4e855f8fc tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:03:57.009165 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1f1da0c6-ab29-4e0a-8463-bad4e855f8fc tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:03:57.120899 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-13d327d2-be05-4056-90d6-e0cfd47ef269 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:03:57.129980 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:03:57.151926 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-13d327d2-be05-4056-90d6-e0cfd47ef269 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:03:57.154629 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-13d327d2-be05-4056-90d6-e0cfd47ef269 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:03:57.181682 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-13d327d2-be05-4056-90d6-e0cfd47ef269 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] 10.222.0.18 "GET /compute/v2.1/servers/2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac" status: 200 len: 1546 microversion: 2.91 time: 0.485713 Oct 22 21:03:57.188791 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1605/3134] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:03:56 2022] GET /compute/v2.1/servers/2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac => generated 1546 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:03:57.195652 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-53a1b37c-55c6-4ab6-a878-647bbe1355f2 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:03:57.204299 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-53a1b37c-55c6-4ab6-a878-647bbe1355f2 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] [instance: 87b07efc-fa80-40ad-8077-333547ee7301] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:03:57.243871 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-53a1b37c-55c6-4ab6-a878-647bbe1355f2 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:03:57.244807 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-53a1b37c-55c6-4ab6-a878-647bbe1355f2 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:03:57.246973 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-53a1b37c-55c6-4ab6-a878-647bbe1355f2 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:03:57.248332 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-53a1b37c-55c6-4ab6-a878-647bbe1355f2 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:03:57.251372 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-53a1b37c-55c6-4ab6-a878-647bbe1355f2 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:03:57.252089 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-53a1b37c-55c6-4ab6-a878-647bbe1355f2 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:03:57.985849 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-53a1b37c-55c6-4ab6-a878-647bbe1355f2 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879c85830a9f42088a4ebdf1e3cfb39b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b54f56cfbc814cccb533c65966f35a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:03:57.996881 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-53a1b37c-55c6-4ab6-a878-647bbe1355f2 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] 10.222.0.18 "GET /compute/v2.1/servers/87b07efc-fa80-40ad-8077-333547ee7301" status: 200 len: 1272 microversion: 2.1 time: 0.805733 Oct 22 21:03:57.997484 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1606/3135] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:03:57 2022] GET /compute/v2.1/servers/87b07efc-fa80-40ad-8077-333547ee7301 => generated 1272 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:03:58.024772 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-cc12b107-87e1-4acb-a5f7-715e2c870a3e tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:03:58.028042 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-cc12b107-87e1-4acb-a5f7-715e2c870a3e tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] [instance: 9bfb71b4-0081-493a-8ed5-1c80169b12d0] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:03:58.052775 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cc12b107-87e1-4acb-a5f7-715e2c870a3e tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:03:58.053275 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cc12b107-87e1-4acb-a5f7-715e2c870a3e tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:03:58.060089 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cc12b107-87e1-4acb-a5f7-715e2c870a3e tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:03:58.060870 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cc12b107-87e1-4acb-a5f7-715e2c870a3e tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:03:58.061344 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cc12b107-87e1-4acb-a5f7-715e2c870a3e tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:03:58.061772 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cc12b107-87e1-4acb-a5f7-715e2c870a3e tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:03:58.184095 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-1f1da0c6-ab29-4e0a-8463-bad4e855f8fc tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1b410a64e0415a96d30f5040361137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd7873d6db4e09bc9ab9a048a6b1ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:03:58.217216 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-1f1da0c6-ab29-4e0a-8463-bad4e855f8fc tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] 10.222.0.18 "GET /compute/v2.1/servers/a99614d8-f2f7-4ce1-87e8-47f3af03d9f8" status: 200 len: 1525 microversion: 2.1 time: 1.244399 Oct 22 21:03:58.221576 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1530/3136] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:03:56 2022] GET /compute/v2.1/servers/a99614d8-f2f7-4ce1-87e8-47f3af03d9f8 => generated 1525 bytes in 1258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:03:58.236006 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-2bff04f9-0c72-492c-a923-c61abf7cb8d8 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:03:58.237101 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-2bff04f9-0c72-492c-a923-c61abf7cb8d8 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] [instance: 2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:03:58.248881 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2bff04f9-0c72-492c-a923-c61abf7cb8d8 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:03:58.250005 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2bff04f9-0c72-492c-a923-c61abf7cb8d8 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:03:58.250995 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2bff04f9-0c72-492c-a923-c61abf7cb8d8 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:03:58.252855 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2bff04f9-0c72-492c-a923-c61abf7cb8d8 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:03:58.253961 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2bff04f9-0c72-492c-a923-c61abf7cb8d8 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:03:58.254662 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2bff04f9-0c72-492c-a923-c61abf7cb8d8 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:03:58.547128 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell0:SELECT=2 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:03:58.749303 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-2bff04f9-0c72-492c-a923-c61abf7cb8d8 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:03:58.785163 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-2bff04f9-0c72-492c-a923-c61abf7cb8d8 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:03:58.796749 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-2bff04f9-0c72-492c-a923-c61abf7cb8d8 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:03:58.832322 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-2bff04f9-0c72-492c-a923-c61abf7cb8d8 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] 10.222.0.18 "GET /compute/v2.1/servers/2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac" status: 200 len: 1546 microversion: 2.91 time: 0.607981 Oct 22 21:03:58.859373 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1531/3137] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:03:58 2022] GET /compute/v2.1/servers/2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac => generated 1546 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:03:58.893941 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-8adb2867-d002-41cc-b613-737c007b9a53 req-b6651b4b-649b-4ea3-ab44-64310a1027e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9bfb71b4-0081-493a-8ed5-1c80169b12d0", "tag": "a0cc9777-4dd3-4860-b673-6758803806be"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:03:58.969978 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-8adb2867-d002-41cc-b613-737c007b9a53 req-b6651b4b-649b-4ea3-ab44-64310a1027e1 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:03:58.973993 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-8adb2867-d002-41cc-b613-737c007b9a53 req-b6651b4b-649b-4ea3-ab44-64310a1027e1 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:03:58.978989 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-8adb2867-d002-41cc-b613-737c007b9a53 req-b6651b4b-649b-4ea3-ab44-64310a1027e1 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:03:59.045012 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-8adb2867-d002-41cc-b613-737c007b9a53 req-b6651b4b-649b-4ea3-ab44-64310a1027e1 service nova] Creating event network-changed:a0cc9777-4dd3-4860-b673-6758803806be for instance 9bfb71b4-0081-493a-8ed5-1c80169b12d0 on nch1-master-1 Oct 22 21:03:59.068195 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-8adb2867-d002-41cc-b613-737c007b9a53 req-b6651b4b-649b-4ea3-ab44-64310a1027e1 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.197271 Oct 22 21:03:59.072104 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1532/3138] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:03:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:03:59.097720 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-950b1dc8-b659-45c7-af8c-ea758075d3e7 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:03:59.100157 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-950b1dc8-b659-45c7-af8c-ea758075d3e7 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] [instance: 87b07efc-fa80-40ad-8077-333547ee7301] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:03:59.152967 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-950b1dc8-b659-45c7-af8c-ea758075d3e7 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:03:59.155994 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-950b1dc8-b659-45c7-af8c-ea758075d3e7 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:03:59.157932 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-950b1dc8-b659-45c7-af8c-ea758075d3e7 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:03:59.159262 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-950b1dc8-b659-45c7-af8c-ea758075d3e7 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:03:59.166669 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-950b1dc8-b659-45c7-af8c-ea758075d3e7 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:03:59.167166 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-950b1dc8-b659-45c7-af8c-ea758075d3e7 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:03:59.929759 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-cc12b107-87e1-4acb-a5f7-715e2c870a3e tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a44ff8e7c14b94b1670f030085c43d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a26a2284f4424cbeaf63d504652546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:03:59.947942 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-cc12b107-87e1-4acb-a5f7-715e2c870a3e tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] 10.222.0.18 "GET /compute/v2.1/servers/9bfb71b4-0081-493a-8ed5-1c80169b12d0" status: 200 len: 1308 microversion: 2.1 time: 1.949297 Oct 22 21:03:59.949145 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1607/3139] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:03:57 2022] GET /compute/v2.1/servers/9bfb71b4-0081-493a-8ed5-1c80169b12d0 => generated 1308 bytes in 1951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:03:59.968326 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-3b7c1b11-7936-47ad-ae92-5df02a4cb518 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:03:59.975989 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-3b7c1b11-7936-47ad-ae92-5df02a4cb518 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] [instance: a99614d8-f2f7-4ce1-87e8-47f3af03d9f8] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:03:59.986664 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-950b1dc8-b659-45c7-af8c-ea758075d3e7 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879c85830a9f42088a4ebdf1e3cfb39b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b54f56cfbc814cccb533c65966f35a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:04:00.000628 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-950b1dc8-b659-45c7-af8c-ea758075d3e7 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] 10.222.0.18 "GET /compute/v2.1/servers/87b07efc-fa80-40ad-8077-333547ee7301" status: 200 len: 1272 microversion: 2.1 time: 0.918829 Oct 22 21:04:00.000871 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3b7c1b11-7936-47ad-ae92-5df02a4cb518 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:00.001166 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3b7c1b11-7936-47ad-ae92-5df02a4cb518 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:00.001795 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3b7c1b11-7936-47ad-ae92-5df02a4cb518 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:00.003710 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1533/3140] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:03:59 2022] GET /compute/v2.1/servers/87b07efc-fa80-40ad-8077-333547ee7301 => generated 1272 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:04:00.020501 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3b7c1b11-7936-47ad-ae92-5df02a4cb518 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:00.020751 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-3403aeaa-1530-4a9a-8e84-3997871aeb6c tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:04:00.021302 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-3403aeaa-1530-4a9a-8e84-3997871aeb6c tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] [instance: 2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:04:00.024395 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3b7c1b11-7936-47ad-ae92-5df02a4cb518 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:00.025296 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3b7c1b11-7936-47ad-ae92-5df02a4cb518 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:00.035209 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3403aeaa-1530-4a9a-8e84-3997871aeb6c tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:00.039281 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3403aeaa-1530-4a9a-8e84-3997871aeb6c tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:00.040124 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3403aeaa-1530-4a9a-8e84-3997871aeb6c tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:00.041091 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3403aeaa-1530-4a9a-8e84-3997871aeb6c tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:00.041746 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3403aeaa-1530-4a9a-8e84-3997871aeb6c tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:00.045273 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3403aeaa-1530-4a9a-8e84-3997871aeb6c tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:00.242140 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-3403aeaa-1530-4a9a-8e84-3997871aeb6c tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:04:00.263295 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-3403aeaa-1530-4a9a-8e84-3997871aeb6c tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:04:00.306712 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-3403aeaa-1530-4a9a-8e84-3997871aeb6c tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:04:00.306712 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-3403aeaa-1530-4a9a-8e84-3997871aeb6c tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] 10.222.0.18 "GET /compute/v2.1/servers/2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac" status: 200 len: 1546 microversion: 2.91 time: 0.263921 Oct 22 21:04:00.306712 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1534/3141] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:04:00 2022] GET /compute/v2.1/servers/2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac => generated 1546 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:04:00.513010 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-3b7c1b11-7936-47ad-ae92-5df02a4cb518 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1b410a64e0415a96d30f5040361137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd7873d6db4e09bc9ab9a048a6b1ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:04:00.525529 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-3b7c1b11-7936-47ad-ae92-5df02a4cb518 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] 10.222.0.18 "GET /compute/v2.1/servers/a99614d8-f2f7-4ce1-87e8-47f3af03d9f8" status: 200 len: 1525 microversion: 2.1 time: 0.573288 Oct 22 21:04:00.527490 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1608/3142] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:03:59 2022] GET /compute/v2.1/servers/a99614d8-f2f7-4ce1-87e8-47f3af03d9f8 => generated 1525 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:04:00.979087 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-6f5e65b5-1871-4896-8732-f61399554dbf tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:04:00.980207 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-6f5e65b5-1871-4896-8732-f61399554dbf tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] [instance: 9bfb71b4-0081-493a-8ed5-1c80169b12d0] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:04:00.983596 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell0:SELECT=2 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:04:00.985835 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell0:SELECT=6 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:04:01.007553 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6f5e65b5-1871-4896-8732-f61399554dbf tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:01.009745 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6f5e65b5-1871-4896-8732-f61399554dbf tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:01.010526 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6f5e65b5-1871-4896-8732-f61399554dbf tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:01.013298 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6f5e65b5-1871-4896-8732-f61399554dbf tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:01.014195 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6f5e65b5-1871-4896-8732-f61399554dbf tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:01.014957 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6f5e65b5-1871-4896-8732-f61399554dbf tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:01.030247 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-5627836f-6793-4d4e-a789-7620a060f7c6 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:04:01.031613 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-5627836f-6793-4d4e-a789-7620a060f7c6 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] [instance: 87b07efc-fa80-40ad-8077-333547ee7301] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:04:01.053549 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5627836f-6793-4d4e-a789-7620a060f7c6 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:01.054257 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5627836f-6793-4d4e-a789-7620a060f7c6 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:01.054996 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5627836f-6793-4d4e-a789-7620a060f7c6 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:01.059907 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5627836f-6793-4d4e-a789-7620a060f7c6 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:01.062757 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5627836f-6793-4d4e-a789-7620a060f7c6 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:01.063635 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5627836f-6793-4d4e-a789-7620a060f7c6 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:01.535634 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-5627836f-6793-4d4e-a789-7620a060f7c6 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879c85830a9f42088a4ebdf1e3cfb39b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b54f56cfbc814cccb533c65966f35a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:04:01.551321 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-6f5e65b5-1871-4896-8732-f61399554dbf tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a44ff8e7c14b94b1670f030085c43d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a26a2284f4424cbeaf63d504652546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:04:01.560650 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-6f5e65b5-1871-4896-8732-f61399554dbf tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] 10.222.0.18 "GET /compute/v2.1/servers/9bfb71b4-0081-493a-8ed5-1c80169b12d0" status: 200 len: 1308 microversion: 2.1 time: 0.587256 Oct 22 21:04:01.570595 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1535/3143] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:04:00 2022] GET /compute/v2.1/servers/9bfb71b4-0081-493a-8ed5-1c80169b12d0 => generated 1308 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:04:01.582417 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-63627826-3c6f-411c-b3c1-930c06767db6 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:04:01.584175 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-63627826-3c6f-411c-b3c1-930c06767db6 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] [instance: 2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:04:01.596025 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-5627836f-6793-4d4e-a789-7620a060f7c6 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] 10.222.0.18 "GET /compute/v2.1/servers/87b07efc-fa80-40ad-8077-333547ee7301" status: 200 len: 1314 microversion: 2.1 time: 0.571032 Oct 22 21:04:01.599496 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-63627826-3c6f-411c-b3c1-930c06767db6 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:01.600080 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-63627826-3c6f-411c-b3c1-930c06767db6 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:01.603396 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1609/3144] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:04:01 2022] GET /compute/v2.1/servers/87b07efc-fa80-40ad-8077-333547ee7301 => generated 1314 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:04:01.604597 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-63627826-3c6f-411c-b3c1-930c06767db6 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:01.605927 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-63627826-3c6f-411c-b3c1-930c06767db6 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:01.608077 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-63627826-3c6f-411c-b3c1-930c06767db6 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:01.608879 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-63627826-3c6f-411c-b3c1-930c06767db6 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:01.620939 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-6565874b-e125-4fb4-a144-7f946e87974b tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:04:01.621558 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-6565874b-e125-4fb4-a144-7f946e87974b tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] [instance: a99614d8-f2f7-4ce1-87e8-47f3af03d9f8] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:04:01.659006 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6565874b-e125-4fb4-a144-7f946e87974b tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:01.659745 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6565874b-e125-4fb4-a144-7f946e87974b tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:01.660412 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6565874b-e125-4fb4-a144-7f946e87974b tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:01.661299 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6565874b-e125-4fb4-a144-7f946e87974b tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:01.661931 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6565874b-e125-4fb4-a144-7f946e87974b tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:01.664453 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6565874b-e125-4fb4-a144-7f946e87974b tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:01.817749 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-63627826-3c6f-411c-b3c1-930c06767db6 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:04:01.828305 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-63627826-3c6f-411c-b3c1-930c06767db6 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:04:01.829753 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-63627826-3c6f-411c-b3c1-930c06767db6 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:04:01.844128 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-63627826-3c6f-411c-b3c1-930c06767db6 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] 10.222.0.18 "GET /compute/v2.1/servers/2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac" status: 200 len: 1546 microversion: 2.91 time: 0.272031 Oct 22 21:04:01.844733 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1536/3145] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:04:01 2022] GET /compute/v2.1/servers/2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac => generated 1546 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:04:02.175173 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-6565874b-e125-4fb4-a144-7f946e87974b tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1b410a64e0415a96d30f5040361137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd7873d6db4e09bc9ab9a048a6b1ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:04:02.191548 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-6565874b-e125-4fb4-a144-7f946e87974b tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] 10.222.0.18 "GET /compute/v2.1/servers/a99614d8-f2f7-4ce1-87e8-47f3af03d9f8" status: 200 len: 1525 microversion: 2.1 time: 0.584707 Oct 22 21:04:02.224385 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1610/3146] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:04:01 2022] GET /compute/v2.1/servers/a99614d8-f2f7-4ce1-87e8-47f3af03d9f8 => generated 1525 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:04:02.593898 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-ffb5b7b0-f7a8-438c-a0bb-13adc5905d46 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:04:02.594876 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-ffb5b7b0-f7a8-438c-a0bb-13adc5905d46 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] [instance: 9bfb71b4-0081-493a-8ed5-1c80169b12d0] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:04:02.613570 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ffb5b7b0-f7a8-438c-a0bb-13adc5905d46 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:02.630156 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-d4d8cf88-daf5-4e08-8a0e-31f6c69b715a tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:04:02.631492 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-d4d8cf88-daf5-4e08-8a0e-31f6c69b715a tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] [instance: 87b07efc-fa80-40ad-8077-333547ee7301] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:04:02.644140 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ffb5b7b0-f7a8-438c-a0bb-13adc5905d46 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.030s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:02.652272 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ffb5b7b0-f7a8-438c-a0bb-13adc5905d46 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:02.661488 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d4d8cf88-daf5-4e08-8a0e-31f6c69b715a tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:02.662103 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ffb5b7b0-f7a8-438c-a0bb-13adc5905d46 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:02.662877 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ffb5b7b0-f7a8-438c-a0bb-13adc5905d46 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:02.663677 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ffb5b7b0-f7a8-438c-a0bb-13adc5905d46 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:02.664466 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d4d8cf88-daf5-4e08-8a0e-31f6c69b715a tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:02.667697 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d4d8cf88-daf5-4e08-8a0e-31f6c69b715a tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:02.669171 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d4d8cf88-daf5-4e08-8a0e-31f6c69b715a tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:02.669753 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d4d8cf88-daf5-4e08-8a0e-31f6c69b715a tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:02.673764 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d4d8cf88-daf5-4e08-8a0e-31f6c69b715a tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:02.886270 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell0:SELECT=8 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:04:03.905419 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-ffb5b7b0-f7a8-438c-a0bb-13adc5905d46 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a44ff8e7c14b94b1670f030085c43d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a26a2284f4424cbeaf63d504652546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:04:03.914187 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-ffb5b7b0-f7a8-438c-a0bb-13adc5905d46 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] 10.222.0.18 "GET /compute/v2.1/servers/9bfb71b4-0081-493a-8ed5-1c80169b12d0" status: 200 len: 1308 microversion: 2.1 time: 1.324005 Oct 22 21:04:03.914846 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1537/3147] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:04:02 2022] GET /compute/v2.1/servers/9bfb71b4-0081-493a-8ed5-1c80169b12d0 => generated 1308 bytes in 1326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:04:03.943369 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-0a11659e-d7ea-429f-ae4b-723cbbf5dadb tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:04:03.945447 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-0a11659e-d7ea-429f-ae4b-723cbbf5dadb tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] [instance: 2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:04:03.962913 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0a11659e-d7ea-429f-ae4b-723cbbf5dadb tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:03.965525 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0a11659e-d7ea-429f-ae4b-723cbbf5dadb tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:03.966201 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0a11659e-d7ea-429f-ae4b-723cbbf5dadb tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:03.968232 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0a11659e-d7ea-429f-ae4b-723cbbf5dadb tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:03.971504 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0a11659e-d7ea-429f-ae4b-723cbbf5dadb tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:03.972256 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0a11659e-d7ea-429f-ae4b-723cbbf5dadb tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:04.018814 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-d4d8cf88-daf5-4e08-8a0e-31f6c69b715a tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879c85830a9f42088a4ebdf1e3cfb39b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b54f56cfbc814cccb533c65966f35a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:04:04.057958 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-d4d8cf88-daf5-4e08-8a0e-31f6c69b715a tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] 10.222.0.18 "GET /compute/v2.1/servers/87b07efc-fa80-40ad-8077-333547ee7301" status: 200 len: 1314 microversion: 2.1 time: 1.432084 Oct 22 21:04:04.058556 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1611/3148] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:04:02 2022] GET /compute/v2.1/servers/87b07efc-fa80-40ad-8077-333547ee7301 => generated 1314 bytes in 1434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:04:04.087549 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-23192d19-08b4-4f9b-8941-4fc68a522a78 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:04:04.088487 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-23192d19-08b4-4f9b-8941-4fc68a522a78 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] [instance: a99614d8-f2f7-4ce1-87e8-47f3af03d9f8] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:04:04.096443 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-23192d19-08b4-4f9b-8941-4fc68a522a78 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:04.097737 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-23192d19-08b4-4f9b-8941-4fc68a522a78 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:04.098805 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-23192d19-08b4-4f9b-8941-4fc68a522a78 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:04.100849 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-23192d19-08b4-4f9b-8941-4fc68a522a78 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:04.101946 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-23192d19-08b4-4f9b-8941-4fc68a522a78 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:04.102857 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-23192d19-08b4-4f9b-8941-4fc68a522a78 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:04.316448 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-0a11659e-d7ea-429f-ae4b-723cbbf5dadb tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:04:04.330921 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-0a11659e-d7ea-429f-ae4b-723cbbf5dadb tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:04:04.332634 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-0a11659e-d7ea-429f-ae4b-723cbbf5dadb tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:04:04.354301 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-0a11659e-d7ea-429f-ae4b-723cbbf5dadb tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] 10.222.0.18 "GET /compute/v2.1/servers/2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac" status: 200 len: 1546 microversion: 2.91 time: 0.438279 Oct 22 21:04:04.369987 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1538/3149] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:04:03 2022] GET /compute/v2.1/servers/2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac => generated 1546 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:04:04.838096 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-23192d19-08b4-4f9b-8941-4fc68a522a78 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1b410a64e0415a96d30f5040361137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd7873d6db4e09bc9ab9a048a6b1ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:04:04.847282 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-23192d19-08b4-4f9b-8941-4fc68a522a78 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] 10.222.0.18 "GET /compute/v2.1/servers/a99614d8-f2f7-4ce1-87e8-47f3af03d9f8" status: 200 len: 1525 microversion: 2.1 time: 0.773664 Oct 22 21:04:04.896042 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1612/3150] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:04:04 2022] GET /compute/v2.1/servers/a99614d8-f2f7-4ce1-87e8-47f3af03d9f8 => generated 1525 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:04:04.938624 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-acafba96-fb33-4e73-ac97-d7cf32be0bb7 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:04:04.939247 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-acafba96-fb33-4e73-ac97-d7cf32be0bb7 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] [instance: 9bfb71b4-0081-493a-8ed5-1c80169b12d0] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:04:04.957738 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-acafba96-fb33-4e73-ac97-d7cf32be0bb7 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:04.958277 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-acafba96-fb33-4e73-ac97-d7cf32be0bb7 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:04.963881 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-acafba96-fb33-4e73-ac97-d7cf32be0bb7 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:04.966428 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-acafba96-fb33-4e73-ac97-d7cf32be0bb7 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:04.966938 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-acafba96-fb33-4e73-ac97-d7cf32be0bb7 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:04.969016 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-acafba96-fb33-4e73-ac97-d7cf32be0bb7 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:05.099028 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-9156077f-ff2c-4b22-ae65-54a6917e06d6 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:04:05.099978 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-9156077f-ff2c-4b22-ae65-54a6917e06d6 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] [instance: 87b07efc-fa80-40ad-8077-333547ee7301] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:04:05.134492 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9156077f-ff2c-4b22-ae65-54a6917e06d6 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:05.138122 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9156077f-ff2c-4b22-ae65-54a6917e06d6 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:05.138620 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9156077f-ff2c-4b22-ae65-54a6917e06d6 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:05.144056 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9156077f-ff2c-4b22-ae65-54a6917e06d6 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:05.146124 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9156077f-ff2c-4b22-ae65-54a6917e06d6 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:05.146842 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9156077f-ff2c-4b22-ae65-54a6917e06d6 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:06.031023 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-acafba96-fb33-4e73-ac97-d7cf32be0bb7 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a44ff8e7c14b94b1670f030085c43d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a26a2284f4424cbeaf63d504652546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:04:06.054216 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-acafba96-fb33-4e73-ac97-d7cf32be0bb7 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] 10.222.0.18 "GET /compute/v2.1/servers/9bfb71b4-0081-493a-8ed5-1c80169b12d0" status: 200 len: 1308 microversion: 2.1 time: 1.118388 Oct 22 21:04:06.059903 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1539/3151] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:04:04 2022] GET /compute/v2.1/servers/9bfb71b4-0081-493a-8ed5-1c80169b12d0 => generated 1308 bytes in 1126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:04:06.069795 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-d9f0ba48-a35e-4ac3-8e86-eaa0203b2930 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:04:06.072011 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-d9f0ba48-a35e-4ac3-8e86-eaa0203b2930 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] [instance: 2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:04:06.099975 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d9f0ba48-a35e-4ac3-8e86-eaa0203b2930 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:06.103763 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d9f0ba48-a35e-4ac3-8e86-eaa0203b2930 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:06.106205 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d9f0ba48-a35e-4ac3-8e86-eaa0203b2930 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:06.107899 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d9f0ba48-a35e-4ac3-8e86-eaa0203b2930 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:06.110809 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d9f0ba48-a35e-4ac3-8e86-eaa0203b2930 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:06.113890 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d9f0ba48-a35e-4ac3-8e86-eaa0203b2930 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:06.815087 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-d9f0ba48-a35e-4ac3-8e86-eaa0203b2930 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:04:06.837404 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-d9f0ba48-a35e-4ac3-8e86-eaa0203b2930 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:04:06.846360 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-d9f0ba48-a35e-4ac3-8e86-eaa0203b2930 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:04:06.875542 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-d9f0ba48-a35e-4ac3-8e86-eaa0203b2930 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] 10.222.0.18 "GET /compute/v2.1/servers/2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac" status: 200 len: 1546 microversion: 2.91 time: 0.807563 Oct 22 21:04:06.877499 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1540/3152] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:04:06 2022] GET /compute/v2.1/servers/2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac => generated 1546 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:04:06.908113 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-7c51ef3f-9149-4d1c-94dd-1f0771bec8c5 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:04:06.909972 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-7c51ef3f-9149-4d1c-94dd-1f0771bec8c5 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] [instance: a99614d8-f2f7-4ce1-87e8-47f3af03d9f8] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:04:06.925651 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7c51ef3f-9149-4d1c-94dd-1f0771bec8c5 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:06.928010 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7c51ef3f-9149-4d1c-94dd-1f0771bec8c5 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:06.929433 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7c51ef3f-9149-4d1c-94dd-1f0771bec8c5 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:06.930528 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7c51ef3f-9149-4d1c-94dd-1f0771bec8c5 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:06.934081 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7c51ef3f-9149-4d1c-94dd-1f0771bec8c5 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:06.934986 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7c51ef3f-9149-4d1c-94dd-1f0771bec8c5 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:07.415882 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-9156077f-ff2c-4b22-ae65-54a6917e06d6 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879c85830a9f42088a4ebdf1e3cfb39b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b54f56cfbc814cccb533c65966f35a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:04:07.439443 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-9156077f-ff2c-4b22-ae65-54a6917e06d6 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] 10.222.0.18 "GET /compute/v2.1/servers/87b07efc-fa80-40ad-8077-333547ee7301" status: 200 len: 1314 microversion: 2.1 time: 2.348888 Oct 22 21:04:07.461605 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1613/3153] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:04:05 2022] GET /compute/v2.1/servers/87b07efc-fa80-40ad-8077-333547ee7301 => generated 1314 bytes in 2375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:04:07.473678 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-01d948e0-4bda-4e33-acbf-98b896d520bc tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:04:07.479309 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-01d948e0-4bda-4e33-acbf-98b896d520bc tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] [instance: 9bfb71b4-0081-493a-8ed5-1c80169b12d0] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:04:07.495698 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-01d948e0-4bda-4e33-acbf-98b896d520bc tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:07.501247 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-01d948e0-4bda-4e33-acbf-98b896d520bc tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:07.501988 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-01d948e0-4bda-4e33-acbf-98b896d520bc tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:07.502915 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-01d948e0-4bda-4e33-acbf-98b896d520bc tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:07.503670 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-01d948e0-4bda-4e33-acbf-98b896d520bc tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:07.509256 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-01d948e0-4bda-4e33-acbf-98b896d520bc tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:07.534430 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-7c51ef3f-9149-4d1c-94dd-1f0771bec8c5 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1b410a64e0415a96d30f5040361137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd7873d6db4e09bc9ab9a048a6b1ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:04:07.546952 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-7c51ef3f-9149-4d1c-94dd-1f0771bec8c5 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] 10.222.0.18 "GET /compute/v2.1/servers/a99614d8-f2f7-4ce1-87e8-47f3af03d9f8" status: 200 len: 1525 microversion: 2.1 time: 0.663206 Oct 22 21:04:07.550945 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1541/3154] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:04:06 2022] GET /compute/v2.1/servers/a99614d8-f2f7-4ce1-87e8-47f3af03d9f8 => generated 1525 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:04:07.580020 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-c41a01d0-1203-4444-9942-f17868237560 req-01579f9a-4482-4a9f-8bdc-4e16f5c815dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87b07efc-fa80-40ad-8077-333547ee7301", "tag": "be99f629-dd9f-41b9-b449-1b1bf0ed4322"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:04:07.608315 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-c41a01d0-1203-4444-9942-f17868237560 req-01579f9a-4482-4a9f-8bdc-4e16f5c815dd service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:07.627298 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-c41a01d0-1203-4444-9942-f17868237560 req-01579f9a-4482-4a9f-8bdc-4e16f5c815dd service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:07.629589 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-c41a01d0-1203-4444-9942-f17868237560 req-01579f9a-4482-4a9f-8bdc-4e16f5c815dd service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:07.681229 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-c41a01d0-1203-4444-9942-f17868237560 req-01579f9a-4482-4a9f-8bdc-4e16f5c815dd service nova] Creating event network-changed:be99f629-dd9f-41b9-b449-1b1bf0ed4322 for instance 87b07efc-fa80-40ad-8077-333547ee7301 on nch2-master-1 Oct 22 21:04:07.703929 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-c41a01d0-1203-4444-9942-f17868237560 req-01579f9a-4482-4a9f-8bdc-4e16f5c815dd service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.151031 Oct 22 21:04:07.710273 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1542/3155] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:04:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:04:07.915073 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-1addb5b2-712d-40e6-9284-e172def18bcd tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:04:07.916597 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-1addb5b2-712d-40e6-9284-e172def18bcd tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] [instance: 2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:04:07.947209 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1addb5b2-712d-40e6-9284-e172def18bcd tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:07.947784 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1addb5b2-712d-40e6-9284-e172def18bcd tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:07.948611 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1addb5b2-712d-40e6-9284-e172def18bcd tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:07.952273 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1addb5b2-712d-40e6-9284-e172def18bcd tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:07.953067 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1addb5b2-712d-40e6-9284-e172def18bcd tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:07.953902 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1addb5b2-712d-40e6-9284-e172def18bcd tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:08.395393 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-1addb5b2-712d-40e6-9284-e172def18bcd tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:04:08.414080 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-1addb5b2-712d-40e6-9284-e172def18bcd tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:04:08.422694 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-1addb5b2-712d-40e6-9284-e172def18bcd tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:04:08.451845 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-1addb5b2-712d-40e6-9284-e172def18bcd tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] 10.222.0.18 "GET /compute/v2.1/servers/2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac" status: 200 len: 1546 microversion: 2.91 time: 0.539171 Oct 22 21:04:08.480964 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1543/3156] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:04:07 2022] GET /compute/v2.1/servers/2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac => generated 1546 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:04:08.494912 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-5c9aada4-79ab-4161-9780-14dd09b55286 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:04:08.496123 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-5c9aada4-79ab-4161-9780-14dd09b55286 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] [instance: 87b07efc-fa80-40ad-8077-333547ee7301] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:04:08.521504 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5c9aada4-79ab-4161-9780-14dd09b55286 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:08.524080 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5c9aada4-79ab-4161-9780-14dd09b55286 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:08.525969 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5c9aada4-79ab-4161-9780-14dd09b55286 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:08.527916 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5c9aada4-79ab-4161-9780-14dd09b55286 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:08.529257 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5c9aada4-79ab-4161-9780-14dd09b55286 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:08.530606 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5c9aada4-79ab-4161-9780-14dd09b55286 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:08.679715 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-01d948e0-4bda-4e33-acbf-98b896d520bc tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a44ff8e7c14b94b1670f030085c43d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a26a2284f4424cbeaf63d504652546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:04:08.690116 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-01d948e0-4bda-4e33-acbf-98b896d520bc tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] 10.222.0.18 "GET /compute/v2.1/servers/9bfb71b4-0081-493a-8ed5-1c80169b12d0" status: 200 len: 1308 microversion: 2.1 time: 1.226851 Oct 22 21:04:08.699661 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1614/3157] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:04:07 2022] GET /compute/v2.1/servers/9bfb71b4-0081-493a-8ed5-1c80169b12d0 => generated 1308 bytes in 1237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:04:08.708595 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-e963c69d-7096-4571-8879-746087d91952 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:04:08.723915 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-e963c69d-7096-4571-8879-746087d91952 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] [instance: a99614d8-f2f7-4ce1-87e8-47f3af03d9f8] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:04:08.744792 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e963c69d-7096-4571-8879-746087d91952 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:08.745521 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e963c69d-7096-4571-8879-746087d91952 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:08.746150 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e963c69d-7096-4571-8879-746087d91952 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:08.750080 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e963c69d-7096-4571-8879-746087d91952 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:08.762073 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e963c69d-7096-4571-8879-746087d91952 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:08.762863 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e963c69d-7096-4571-8879-746087d91952 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:10.199897 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-5c9aada4-79ab-4161-9780-14dd09b55286 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879c85830a9f42088a4ebdf1e3cfb39b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b54f56cfbc814cccb533c65966f35a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:04:10.215985 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-5c9aada4-79ab-4161-9780-14dd09b55286 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] 10.222.0.18 "GET /compute/v2.1/servers/87b07efc-fa80-40ad-8077-333547ee7301" status: 200 len: 1314 microversion: 2.1 time: 1.733530 Oct 22 21:04:10.216974 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1544/3158] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:04:08 2022] GET /compute/v2.1/servers/87b07efc-fa80-40ad-8077-333547ee7301 => generated 1314 bytes in 1735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:04:10.226807 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-7021a3bd-9298-4f7f-bbb5-427319af3040 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:04:10.229428 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-7021a3bd-9298-4f7f-bbb5-427319af3040 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] [instance: 2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:04:10.244612 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7021a3bd-9298-4f7f-bbb5-427319af3040 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:10.246051 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7021a3bd-9298-4f7f-bbb5-427319af3040 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:10.248364 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7021a3bd-9298-4f7f-bbb5-427319af3040 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:10.250622 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7021a3bd-9298-4f7f-bbb5-427319af3040 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:10.251289 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7021a3bd-9298-4f7f-bbb5-427319af3040 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:10.252572 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7021a3bd-9298-4f7f-bbb5-427319af3040 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:10.717605 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-e963c69d-7096-4571-8879-746087d91952 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1b410a64e0415a96d30f5040361137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd7873d6db4e09bc9ab9a048a6b1ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:04:10.728247 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-e963c69d-7096-4571-8879-746087d91952 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] 10.222.0.18 "GET /compute/v2.1/servers/a99614d8-f2f7-4ce1-87e8-47f3af03d9f8" status: 200 len: 1525 microversion: 2.1 time: 2.023489 Oct 22 21:04:10.729480 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1615/3159] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:04:08 2022] GET /compute/v2.1/servers/a99614d8-f2f7-4ce1-87e8-47f3af03d9f8 => generated 1525 bytes in 2029 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:04:10.738221 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-7021a3bd-9298-4f7f-bbb5-427319af3040 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:04:10.749865 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-7021a3bd-9298-4f7f-bbb5-427319af3040 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:04:10.751686 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-bc6bbf07-acbc-42c1-9c22-63ea0c04a03c tempest-VolumesNegativeTest-1146767104 tempest-VolumesNegativeTest-1146767104-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-350502366", "imageRef": "085e4478-6edc-4a69-8e08-f9831713eb65", "flavorRef": "452"}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:04:10.765671 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-7021a3bd-9298-4f7f-bbb5-427319af3040 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:04:10.792735 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-7021a3bd-9298-4f7f-bbb5-427319af3040 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] 10.222.0.18 "GET /compute/v2.1/servers/2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac" status: 200 len: 1546 microversion: 2.91 time: 0.574349 Oct 22 21:04:10.799007 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1545/3160] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:04:10 2022] GET /compute/v2.1/servers/2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac => generated 1546 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:04:10.817700 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=3 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:04:10.819615 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-b349fdf7-88c1-4efb-b307-4c21b7291857 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:04:10.829417 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-b349fdf7-88c1-4efb-b307-4c21b7291857 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] [instance: 9bfb71b4-0081-493a-8ed5-1c80169b12d0] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:04:10.864611 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b349fdf7-88c1-4efb-b307-4c21b7291857 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:10.870086 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b349fdf7-88c1-4efb-b307-4c21b7291857 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:10.872459 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b349fdf7-88c1-4efb-b307-4c21b7291857 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:10.873530 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b349fdf7-88c1-4efb-b307-4c21b7291857 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:10.877285 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b349fdf7-88c1-4efb-b307-4c21b7291857 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:10.878559 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b349fdf7-88c1-4efb-b307-4c21b7291857 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:10.927617 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.network.neutron [None req-bc6bbf07-acbc-42c1-9c22-63ea0c04a03c tempest-VolumesNegativeTest-1146767104 tempest-VolumesNegativeTest-1146767104-project] validate_networks() for None {{(pid=138745) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 21:04:10.950748 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:SELECT=100 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:04:11.560663 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-b349fdf7-88c1-4efb-b307-4c21b7291857 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a44ff8e7c14b94b1670f030085c43d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a26a2284f4424cbeaf63d504652546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:04:11.570923 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-b349fdf7-88c1-4efb-b307-4c21b7291857 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] 10.222.0.18 "GET /compute/v2.1/servers/9bfb71b4-0081-493a-8ed5-1c80169b12d0" status: 200 len: 1308 microversion: 2.1 time: 0.764707 Oct 22 21:04:11.572455 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1546/3161] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:04:10 2022] GET /compute/v2.1/servers/9bfb71b4-0081-493a-8ed5-1c80169b12d0 => generated 1308 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:04:11.705417 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-bc6bbf07-acbc-42c1-9c22-63ea0c04a03c tempest-VolumesNegativeTest-1146767104 tempest-VolumesNegativeTest-1146767104-project] Flavor limits 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 21:04:11.705856 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-bc6bbf07-acbc-42c1-9c22-63ea0c04a03c tempest-VolumesNegativeTest-1146767104 tempest-VolumesNegativeTest-1146767104-project] Image limits 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 21:04:11.706923 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-bc6bbf07-acbc-42c1-9c22-63ea0c04a03c tempest-VolumesNegativeTest-1146767104 tempest-VolumesNegativeTest-1146767104-project] Flavor pref 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 21:04:11.707577 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-bc6bbf07-acbc-42c1-9c22-63ea0c04a03c tempest-VolumesNegativeTest-1146767104 tempest-VolumesNegativeTest-1146767104-project] Image pref 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 21:04:11.708020 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-bc6bbf07-acbc-42c1-9c22-63ea0c04a03c tempest-VolumesNegativeTest-1146767104 tempest-VolumesNegativeTest-1146767104-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 21:04:11.721709 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bc6bbf07-acbc-42c1-9c22-63ea0c04a03c tempest-VolumesNegativeTest-1146767104 tempest-VolumesNegativeTest-1146767104-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:11.726836 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bc6bbf07-acbc-42c1-9c22-63ea0c04a03c tempest-VolumesNegativeTest-1146767104 tempest-VolumesNegativeTest-1146767104-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:11.729216 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bc6bbf07-acbc-42c1-9c22-63ea0c04a03c tempest-VolumesNegativeTest-1146767104 tempest-VolumesNegativeTest-1146767104-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:11.730283 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bc6bbf07-acbc-42c1-9c22-63ea0c04a03c tempest-VolumesNegativeTest-1146767104 tempest-VolumesNegativeTest-1146767104-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:11.730945 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bc6bbf07-acbc-42c1-9c22-63ea0c04a03c tempest-VolumesNegativeTest-1146767104 tempest-VolumesNegativeTest-1146767104-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:11.735259 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bc6bbf07-acbc-42c1-9c22-63ea0c04a03c tempest-VolumesNegativeTest-1146767104 tempest-VolumesNegativeTest-1146767104-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:11.750283 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-4fe5655c-721b-4636-bfc1-bda3f24604fd req-1961abf0-070e-4f58-ab76-f760c26fff8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9bfb71b4-0081-493a-8ed5-1c80169b12d0", "name": "network-vif-plugged", "status": "completed", "tag": "a0cc9777-4dd3-4860-b673-6758803806be"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:04:11.761995 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-4fe5655c-721b-4636-bfc1-bda3f24604fd req-1961abf0-070e-4f58-ab76-f760c26fff8a service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:11.762859 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-4fe5655c-721b-4636-bfc1-bda3f24604fd req-1961abf0-070e-4f58-ab76-f760c26fff8a service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:11.763637 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-4fe5655c-721b-4636-bfc1-bda3f24604fd req-1961abf0-070e-4f58-ab76-f760c26fff8a service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:11.777091 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-4fe5655c-721b-4636-bfc1-bda3f24604fd req-1961abf0-070e-4f58-ab76-f760c26fff8a service nova] Creating event network-vif-plugged:a0cc9777-4dd3-4860-b673-6758803806be for instance 9bfb71b4-0081-493a-8ed5-1c80169b12d0 on nch1-master-1 Oct 22 21:04:11.777351 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-bc6bbf07-acbc-42c1-9c22-63ea0c04a03c tempest-VolumesNegativeTest-1146767104 tempest-VolumesNegativeTest-1146767104-project] Getting quotas for project bba7e19328594eae9e7d6a7c6e9c2147. Resources: {'cores', 'instances', 'ram'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 21:04:11.783227 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-4fe5655c-721b-4636-bfc1-bda3f24604fd req-1961abf0-070e-4f58-ab76-f760c26fff8a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.208408 Oct 22 21:04:11.784827 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1547/3162] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:04:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:04:11.785440 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-bc6bbf07-acbc-42c1-9c22-63ea0c04a03c tempest-VolumesNegativeTest-1146767104 tempest-VolumesNegativeTest-1146767104-project] Getting quotas for user 89246f6315ac429c94630afb36be5253 and project bba7e19328594eae9e7d6a7c6e9c2147. Resources: {'cores', 'instances', 'ram'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 21:04:11.792457 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-1dbb63ae-7963-4be8-8703-978050bafc31 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:04:11.794134 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-1dbb63ae-7963-4be8-8703-978050bafc31 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] [instance: 87b07efc-fa80-40ad-8077-333547ee7301] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:04:11.816666 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1dbb63ae-7963-4be8-8703-978050bafc31 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:11.817157 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1dbb63ae-7963-4be8-8703-978050bafc31 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:11.817565 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-bc6bbf07-acbc-42c1-9c22-63ea0c04a03c tempest-VolumesNegativeTest-1146767104 tempest-VolumesNegativeTest-1146767104-project] Going to run 1 instances... {{(pid=138745) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 21:04:11.818942 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1dbb63ae-7963-4be8-8703-978050bafc31 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:11.819891 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-bc6bbf07-acbc-42c1-9c22-63ea0c04a03c tempest-VolumesNegativeTest-1146767104 tempest-VolumesNegativeTest-1146767104-project] [instance: ead6584e-26a9-4923-b58e-305731b6f73b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='085e4478-6edc-4a69-8e08-f9831713eb65',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138745) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 21:04:11.820118 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1dbb63ae-7963-4be8-8703-978050bafc31 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:11.821014 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1dbb63ae-7963-4be8-8703-978050bafc31 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:11.821466 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1dbb63ae-7963-4be8-8703-978050bafc31 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:11.905824 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-bc6bbf07-acbc-42c1-9c22-63ea0c04a03c tempest-VolumesNegativeTest-1146767104 tempest-VolumesNegativeTest-1146767104-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.174887 Oct 22 21:04:11.912356 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1616/3163] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Oct 22 21:04:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 1176 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 21:04:11.912356 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-40d62946-c4b5-46b7-bf85-39ca97b93700 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:04:11.912356 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-40d62946-c4b5-46b7-bf85-39ca97b93700 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] [instance: a99614d8-f2f7-4ce1-87e8-47f3af03d9f8] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:04:11.919799 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-40d62946-c4b5-46b7-bf85-39ca97b93700 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:11.920301 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-40d62946-c4b5-46b7-bf85-39ca97b93700 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:11.920744 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-40d62946-c4b5-46b7-bf85-39ca97b93700 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:11.921613 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-40d62946-c4b5-46b7-bf85-39ca97b93700 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:11.922078 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-40d62946-c4b5-46b7-bf85-39ca97b93700 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:11.922511 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-40d62946-c4b5-46b7-bf85-39ca97b93700 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:12.977197 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-1dbb63ae-7963-4be8-8703-978050bafc31 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879c85830a9f42088a4ebdf1e3cfb39b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b54f56cfbc814cccb533c65966f35a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:04:13.012620 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-1dbb63ae-7963-4be8-8703-978050bafc31 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] 10.222.0.18 "GET /compute/v2.1/servers/87b07efc-fa80-40ad-8077-333547ee7301" status: 200 len: 1314 microversion: 2.1 time: 1.224232 Oct 22 21:04:13.015758 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1548/3164] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:04:11 2022] GET /compute/v2.1/servers/87b07efc-fa80-40ad-8077-333547ee7301 => generated 1314 bytes in 1230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:04:13.023810 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-7e20ae82-1d89-4ee9-9de7-524d9b09aefb tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:04:13.024822 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-7e20ae82-1d89-4ee9-9de7-524d9b09aefb tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] [instance: 2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:04:13.036860 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7e20ae82-1d89-4ee9-9de7-524d9b09aefb tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:13.037556 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7e20ae82-1d89-4ee9-9de7-524d9b09aefb tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:13.038464 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7e20ae82-1d89-4ee9-9de7-524d9b09aefb tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:13.040059 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7e20ae82-1d89-4ee9-9de7-524d9b09aefb tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:13.049156 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7e20ae82-1d89-4ee9-9de7-524d9b09aefb tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:13.050500 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7e20ae82-1d89-4ee9-9de7-524d9b09aefb tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:13.115013 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-40d62946-c4b5-46b7-bf85-39ca97b93700 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1b410a64e0415a96d30f5040361137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd7873d6db4e09bc9ab9a048a6b1ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:04:13.129090 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-40d62946-c4b5-46b7-bf85-39ca97b93700 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] 10.222.0.18 "GET /compute/v2.1/servers/a99614d8-f2f7-4ce1-87e8-47f3af03d9f8" status: 200 len: 1507 microversion: 2.1 time: 1.220932 Oct 22 21:04:13.133707 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1617/3165] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:04:11 2022] GET /compute/v2.1/servers/a99614d8-f2f7-4ce1-87e8-47f3af03d9f8 => generated 1507 bytes in 1224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:04:13.159375 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-2919a421-8f0b-4ad2-8cc7-2fc741312f5c tempest-VolumesNegativeTest-1146767104 tempest-VolumesNegativeTest-1146767104-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:04:13.182484 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-2919a421-8f0b-4ad2-8cc7-2fc741312f5c tempest-VolumesNegativeTest-1146767104 tempest-VolumesNegativeTest-1146767104-project] [instance: ead6584e-26a9-4923-b58e-305731b6f73b] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:04:13.201259 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2919a421-8f0b-4ad2-8cc7-2fc741312f5c tempest-VolumesNegativeTest-1146767104 tempest-VolumesNegativeTest-1146767104-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:13.201758 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2919a421-8f0b-4ad2-8cc7-2fc741312f5c tempest-VolumesNegativeTest-1146767104 tempest-VolumesNegativeTest-1146767104-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:13.202203 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2919a421-8f0b-4ad2-8cc7-2fc741312f5c tempest-VolumesNegativeTest-1146767104 tempest-VolumesNegativeTest-1146767104-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:13.213817 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2919a421-8f0b-4ad2-8cc7-2fc741312f5c tempest-VolumesNegativeTest-1146767104 tempest-VolumesNegativeTest-1146767104-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:13.214340 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2919a421-8f0b-4ad2-8cc7-2fc741312f5c tempest-VolumesNegativeTest-1146767104 tempest-VolumesNegativeTest-1146767104-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:13.214798 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2919a421-8f0b-4ad2-8cc7-2fc741312f5c tempest-VolumesNegativeTest-1146767104 tempest-VolumesNegativeTest-1146767104-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:13.356976 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-2919a421-8f0b-4ad2-8cc7-2fc741312f5c tempest-VolumesNegativeTest-1146767104 tempest-VolumesNegativeTest-1146767104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89246f6315ac429c94630afb36be5253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba7e19328594eae9e7d6a7c6e9c2147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:04:13.369745 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-2919a421-8f0b-4ad2-8cc7-2fc741312f5c tempest-VolumesNegativeTest-1146767104 tempest-VolumesNegativeTest-1146767104-project] 10.222.0.18 "GET /compute/v2.1/servers/ead6584e-26a9-4923-b58e-305731b6f73b" status: 200 len: 1218 microversion: 2.1 time: 0.234487 Oct 22 21:04:13.370362 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1618/3166] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:04:13 2022] GET /compute/v2.1/servers/ead6584e-26a9-4923-b58e-305731b6f73b => generated 1218 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:04:13.427476 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-7e20ae82-1d89-4ee9-9de7-524d9b09aefb tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:04:13.450688 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-7e20ae82-1d89-4ee9-9de7-524d9b09aefb tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:04:13.455792 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-7e20ae82-1d89-4ee9-9de7-524d9b09aefb tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:04:13.469526 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-7e20ae82-1d89-4ee9-9de7-524d9b09aefb tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] 10.222.0.18 "GET /compute/v2.1/servers/2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac" status: 200 len: 1546 microversion: 2.91 time: 0.451650 Oct 22 21:04:13.470173 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1549/3167] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:04:13 2022] GET /compute/v2.1/servers/2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac => generated 1546 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:04:13.489974 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-1c493a45-30b9-4bc0-b28f-8da46fdd6779 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:04:13.490608 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-1c493a45-30b9-4bc0-b28f-8da46fdd6779 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] [instance: 9bfb71b4-0081-493a-8ed5-1c80169b12d0] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:04:13.519862 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1c493a45-30b9-4bc0-b28f-8da46fdd6779 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:13.521763 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1c493a45-30b9-4bc0-b28f-8da46fdd6779 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:13.523324 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1c493a45-30b9-4bc0-b28f-8da46fdd6779 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:13.526859 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1c493a45-30b9-4bc0-b28f-8da46fdd6779 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:13.529551 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1c493a45-30b9-4bc0-b28f-8da46fdd6779 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:13.530268 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1c493a45-30b9-4bc0-b28f-8da46fdd6779 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:13.716482 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-43f32f0a-4005-439c-854e-daaf26b23e14 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:04:13.717084 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-43f32f0a-4005-439c-854e-daaf26b23e14 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] [instance: f38f14b2-b9d7-4bed-92ba-7b95ea4b2270] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:04:13.750002 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-43f32f0a-4005-439c-854e-daaf26b23e14 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:13.750548 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-43f32f0a-4005-439c-854e-daaf26b23e14 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:13.751044 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-43f32f0a-4005-439c-854e-daaf26b23e14 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:13.751953 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-43f32f0a-4005-439c-854e-daaf26b23e14 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:13.752481 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-43f32f0a-4005-439c-854e-daaf26b23e14 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:13.752988 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-43f32f0a-4005-439c-854e-daaf26b23e14 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:13.821361 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-43f32f0a-4005-439c-854e-daaf26b23e14 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] [instance: f38f14b2-b9d7-4bed-92ba-7b95ea4b2270] Going to try to terminate instance {{(pid=138745) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 21:04:14.049263 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-43f32f0a-4005-439c-854e-daaf26b23e14 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] 10.222.0.18 "DELETE /compute/v2.1/servers/f38f14b2-b9d7-4bed-92ba-7b95ea4b2270" status: 204 len: 0 microversion: 2.42 time: 0.677487 Oct 22 21:04:14.050284 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1619/3168] 10.222.0.18 () {60 vars in 1280 bytes} [Sat Oct 22 21:04:13 2022] DELETE /compute/v2.1/servers/f38f14b2-b9d7-4bed-92ba-7b95ea4b2270 => generated 0 bytes in 679 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 22 21:04:14.056203 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-2d136d95-81d9-4664-b6e3-71843bf0b0d7 req-b5fb7c55-6e8d-49bf-8949-8e7c419141d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a99614d8-f2f7-4ce1-87e8-47f3af03d9f8", "name": "network-vif-unplugged", "status": "completed", "tag": "de29f75a-6453-4e65-9533-8bc1ec9252f5"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:04:14.085340 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-2d136d95-81d9-4664-b6e3-71843bf0b0d7 req-b5fb7c55-6e8d-49bf-8949-8e7c419141d2 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:14.085809 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-2d136d95-81d9-4664-b6e3-71843bf0b0d7 req-b5fb7c55-6e8d-49bf-8949-8e7c419141d2 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:14.086247 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-2d136d95-81d9-4664-b6e3-71843bf0b0d7 req-b5fb7c55-6e8d-49bf-8949-8e7c419141d2 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:14.115764 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.compute.server_external_events [req-2d136d95-81d9-4664-b6e3-71843bf0b0d7 req-b5fb7c55-6e8d-49bf-8949-8e7c419141d2 service nova] Unable to find a host for instance a99614d8-f2f7-4ce1-87e8-47f3af03d9f8. Dropping event network-vif-unplugged {{(pid=138745) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 22 21:04:14.116892 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-2d136d95-81d9-4664-b6e3-71843bf0b0d7 req-b5fb7c55-6e8d-49bf-8949-8e7c419141d2 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.065280 Oct 22 21:04:14.117543 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1620/3169] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:04:14 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 67 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 22 21:04:14.124321 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-ec7a97cf-bc70-4e2f-9dfd-8b5783f93788 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:04:14.134260 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-ec7a97cf-bc70-4e2f-9dfd-8b5783f93788 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] [instance: 87b07efc-fa80-40ad-8077-333547ee7301] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:04:14.150518 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ec7a97cf-bc70-4e2f-9dfd-8b5783f93788 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:14.151272 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ec7a97cf-bc70-4e2f-9dfd-8b5783f93788 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:14.151922 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ec7a97cf-bc70-4e2f-9dfd-8b5783f93788 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:14.152882 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ec7a97cf-bc70-4e2f-9dfd-8b5783f93788 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:14.153682 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ec7a97cf-bc70-4e2f-9dfd-8b5783f93788 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:14.154281 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ec7a97cf-bc70-4e2f-9dfd-8b5783f93788 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:14.299791 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-1c493a45-30b9-4bc0-b28f-8da46fdd6779 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a44ff8e7c14b94b1670f030085c43d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a26a2284f4424cbeaf63d504652546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:04:14.311735 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-1c493a45-30b9-4bc0-b28f-8da46fdd6779 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] 10.222.0.18 "GET /compute/v2.1/servers/9bfb71b4-0081-493a-8ed5-1c80169b12d0" status: 200 len: 1308 microversion: 2.1 time: 0.833054 Oct 22 21:04:14.328040 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1550/3170] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:04:13 2022] GET /compute/v2.1/servers/9bfb71b4-0081-493a-8ed5-1c80169b12d0 => generated 1308 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:04:14.336052 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-6d976c86-20b6-4854-bce7-3e1ae3ed790a tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:04:14.336611 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-6d976c86-20b6-4854-bce7-3e1ae3ed790a tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] [instance: f38f14b2-b9d7-4bed-92ba-7b95ea4b2270] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:04:14.343187 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6d976c86-20b6-4854-bce7-3e1ae3ed790a tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:14.343974 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6d976c86-20b6-4854-bce7-3e1ae3ed790a tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:14.344587 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6d976c86-20b6-4854-bce7-3e1ae3ed790a tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:14.345485 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6d976c86-20b6-4854-bce7-3e1ae3ed790a tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:14.346099 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6d976c86-20b6-4854-bce7-3e1ae3ed790a tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:14.346688 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6d976c86-20b6-4854-bce7-3e1ae3ed790a tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:15.269644 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-ec7a97cf-bc70-4e2f-9dfd-8b5783f93788 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879c85830a9f42088a4ebdf1e3cfb39b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b54f56cfbc814cccb533c65966f35a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:04:15.283597 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-ec7a97cf-bc70-4e2f-9dfd-8b5783f93788 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] 10.222.0.18 "GET /compute/v2.1/servers/87b07efc-fa80-40ad-8077-333547ee7301" status: 200 len: 1314 microversion: 2.1 time: 1.157298 Oct 22 21:04:15.284324 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1621/3171] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:04:14 2022] GET /compute/v2.1/servers/87b07efc-fa80-40ad-8077-333547ee7301 => generated 1314 bytes in 1164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:04:15.292111 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-9e8a8f66-3888-40c3-9150-296717ae9842 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:04:15.292722 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-9e8a8f66-3888-40c3-9150-296717ae9842 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] [instance: a99614d8-f2f7-4ce1-87e8-47f3af03d9f8] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:04:15.309138 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9e8a8f66-3888-40c3-9150-296717ae9842 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:15.309843 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9e8a8f66-3888-40c3-9150-296717ae9842 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:15.310440 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9e8a8f66-3888-40c3-9150-296717ae9842 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:15.311323 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9e8a8f66-3888-40c3-9150-296717ae9842 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:15.312061 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9e8a8f66-3888-40c3-9150-296717ae9842 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:15.312644 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9e8a8f66-3888-40c3-9150-296717ae9842 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:15.318677 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:04:15.558829 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-6d976c86-20b6-4854-bce7-3e1ae3ed790a tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211483c6acea4f76b6c0e4bfc818e7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd687d54e07d4ab4af00ad801ef4b58d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:04:15.571698 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-6d976c86-20b6-4854-bce7-3e1ae3ed790a tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '211483c6acea4f76b6c0e4bfc818e7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd687d54e07d4ab4af00ad801ef4b58d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:04:15.573189 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-6d976c86-20b6-4854-bce7-3e1ae3ed790a tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '211483c6acea4f76b6c0e4bfc818e7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd687d54e07d4ab4af00ad801ef4b58d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:04:15.574753 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-6d976c86-20b6-4854-bce7-3e1ae3ed790a tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] 10.222.0.18 "GET /compute/v2.1/servers/f38f14b2-b9d7-4bed-92ba-7b95ea4b2270" status: 200 len: 2956 microversion: 2.42 time: 1.245574 Oct 22 21:04:15.575531 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1551/3172] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:04:14 2022] GET /compute/v2.1/servers/f38f14b2-b9d7-4bed-92ba-7b95ea4b2270 => generated 2956 bytes in 1247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:04:15.580240 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-834c08fd-0a77-4472-a61c-35e8fb05b9bb tempest-VolumesNegativeTest-1146767104 tempest-VolumesNegativeTest-1146767104-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:04:15.581463 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-834c08fd-0a77-4472-a61c-35e8fb05b9bb tempest-VolumesNegativeTest-1146767104 tempest-VolumesNegativeTest-1146767104-project] [instance: ead6584e-26a9-4923-b58e-305731b6f73b] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:04:15.589873 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-834c08fd-0a77-4472-a61c-35e8fb05b9bb tempest-VolumesNegativeTest-1146767104 tempest-VolumesNegativeTest-1146767104-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:15.590574 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-834c08fd-0a77-4472-a61c-35e8fb05b9bb tempest-VolumesNegativeTest-1146767104 tempest-VolumesNegativeTest-1146767104-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:15.591196 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-834c08fd-0a77-4472-a61c-35e8fb05b9bb tempest-VolumesNegativeTest-1146767104 tempest-VolumesNegativeTest-1146767104-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:15.592120 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-834c08fd-0a77-4472-a61c-35e8fb05b9bb tempest-VolumesNegativeTest-1146767104 tempest-VolumesNegativeTest-1146767104-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:15.592731 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-834c08fd-0a77-4472-a61c-35e8fb05b9bb tempest-VolumesNegativeTest-1146767104 tempest-VolumesNegativeTest-1146767104-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:15.593326 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-834c08fd-0a77-4472-a61c-35e8fb05b9bb tempest-VolumesNegativeTest-1146767104 tempest-VolumesNegativeTest-1146767104-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:15.672146 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-834c08fd-0a77-4472-a61c-35e8fb05b9bb tempest-VolumesNegativeTest-1146767104 tempest-VolumesNegativeTest-1146767104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89246f6315ac429c94630afb36be5253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba7e19328594eae9e7d6a7c6e9c2147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:04:15.681889 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-834c08fd-0a77-4472-a61c-35e8fb05b9bb tempest-VolumesNegativeTest-1146767104 tempest-VolumesNegativeTest-1146767104-project] 10.222.0.18 "GET /compute/v2.1/servers/ead6584e-26a9-4923-b58e-305731b6f73b" status: 200 len: 1274 microversion: 2.1 time: 0.105044 Oct 22 21:04:15.695851 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1552/3173] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:04:15 2022] GET /compute/v2.1/servers/ead6584e-26a9-4923-b58e-305731b6f73b => generated 1274 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:04:15.702481 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-9e8a8f66-3888-40c3-9150-296717ae9842 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1b410a64e0415a96d30f5040361137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd7873d6db4e09bc9ab9a048a6b1ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:04:15.703081 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-aa62a51c-2766-45f6-9616-07a1ef3f4cfd tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:04:15.704577 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-aa62a51c-2766-45f6-9616-07a1ef3f4cfd tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] [instance: 2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:04:15.712104 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-aa62a51c-2766-45f6-9616-07a1ef3f4cfd tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:15.712852 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-aa62a51c-2766-45f6-9616-07a1ef3f4cfd tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:15.713465 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-aa62a51c-2766-45f6-9616-07a1ef3f4cfd tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:15.714393 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-aa62a51c-2766-45f6-9616-07a1ef3f4cfd tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:15.714629 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-9e8a8f66-3888-40c3-9150-296717ae9842 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] 10.222.0.18 "GET /compute/v2.1/servers/a99614d8-f2f7-4ce1-87e8-47f3af03d9f8" status: 200 len: 1450 microversion: 2.1 time: 0.429202 Oct 22 21:04:15.715189 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-aa62a51c-2766-45f6-9616-07a1ef3f4cfd tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:15.727515 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1622/3174] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:04:15 2022] GET /compute/v2.1/servers/a99614d8-f2f7-4ce1-87e8-47f3af03d9f8 => generated 1450 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:04:15.727515 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-71a260a3-cfd7-4c93-a227-692d5925abc7 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:04:15.727515 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-71a260a3-cfd7-4c93-a227-692d5925abc7 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] [instance: 9bfb71b4-0081-493a-8ed5-1c80169b12d0] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:04:15.729304 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-aa62a51c-2766-45f6-9616-07a1ef3f4cfd tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:15.743039 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-71a260a3-cfd7-4c93-a227-692d5925abc7 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:15.743871 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-71a260a3-cfd7-4c93-a227-692d5925abc7 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:15.744559 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-71a260a3-cfd7-4c93-a227-692d5925abc7 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:15.745458 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-71a260a3-cfd7-4c93-a227-692d5925abc7 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:15.746073 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-71a260a3-cfd7-4c93-a227-692d5925abc7 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:15.746661 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-71a260a3-cfd7-4c93-a227-692d5925abc7 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:15.870575 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-aa62a51c-2766-45f6-9616-07a1ef3f4cfd tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:04:15.881414 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-aa62a51c-2766-45f6-9616-07a1ef3f4cfd tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:04:15.884026 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-aa62a51c-2766-45f6-9616-07a1ef3f4cfd tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:04:15.890543 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-aa62a51c-2766-45f6-9616-07a1ef3f4cfd tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] 10.222.0.18 "GET /compute/v2.1/servers/2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac" status: 200 len: 1546 microversion: 2.91 time: 0.193199 Oct 22 21:04:15.892160 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1553/3175] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:04:15 2022] GET /compute/v2.1/servers/2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac => generated 1546 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:04:15.898391 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-b68032ea-eed8-4aa7-b1af-95ef19347466 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:04:15.899158 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-b68032ea-eed8-4aa7-b1af-95ef19347466 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] [instance: a99614d8-f2f7-4ce1-87e8-47f3af03d9f8] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:04:15.906721 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b68032ea-eed8-4aa7-b1af-95ef19347466 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:15.907587 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b68032ea-eed8-4aa7-b1af-95ef19347466 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:15.908315 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b68032ea-eed8-4aa7-b1af-95ef19347466 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:15.910491 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b68032ea-eed8-4aa7-b1af-95ef19347466 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:15.911513 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b68032ea-eed8-4aa7-b1af-95ef19347466 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:15.912184 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b68032ea-eed8-4aa7-b1af-95ef19347466 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:15.950609 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-b68032ea-eed8-4aa7-b1af-95ef19347466 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] [instance: a99614d8-f2f7-4ce1-87e8-47f3af03d9f8] Going to try to terminate instance {{(pid=138744) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 21:04:15.959899 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.compute.api [None req-b68032ea-eed8-4aa7-b1af-95ef19347466 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] [instance: a99614d8-f2f7-4ce1-87e8-47f3af03d9f8] Working on deleting snapshot 2cc61fc7-86aa-4aa5-bf42-6262e4adedc4 from shelved instance... Oct 22 21:04:16.076377 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-71a260a3-cfd7-4c93-a227-692d5925abc7 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a44ff8e7c14b94b1670f030085c43d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a26a2284f4424cbeaf63d504652546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:04:16.094107 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-71a260a3-cfd7-4c93-a227-692d5925abc7 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] 10.222.0.18 "GET /compute/v2.1/servers/9bfb71b4-0081-493a-8ed5-1c80169b12d0" status: 200 len: 1308 microversion: 2.1 time: 0.376568 Oct 22 21:04:16.094107 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1623/3176] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:04:15 2022] GET /compute/v2.1/servers/9bfb71b4-0081-493a-8ed5-1c80169b12d0 => generated 1308 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:04:16.311247 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-6e87b63f-9496-44f1-bec4-bff4bfbe070c tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:04:16.312010 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-6e87b63f-9496-44f1-bec4-bff4bfbe070c tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] [instance: 87b07efc-fa80-40ad-8077-333547ee7301] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:04:16.327677 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6e87b63f-9496-44f1-bec4-bff4bfbe070c tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:16.329177 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6e87b63f-9496-44f1-bec4-bff4bfbe070c tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:16.330229 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6e87b63f-9496-44f1-bec4-bff4bfbe070c tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:16.331681 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6e87b63f-9496-44f1-bec4-bff4bfbe070c tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:16.332470 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6e87b63f-9496-44f1-bec4-bff4bfbe070c tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:16.333412 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6e87b63f-9496-44f1-bec4-bff4bfbe070c tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:16.871874 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-6e87b63f-9496-44f1-bec4-bff4bfbe070c tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879c85830a9f42088a4ebdf1e3cfb39b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b54f56cfbc814cccb533c65966f35a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:04:16.881516 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-6e87b63f-9496-44f1-bec4-bff4bfbe070c tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] 10.222.0.18 "GET /compute/v2.1/servers/87b07efc-fa80-40ad-8077-333547ee7301" status: 200 len: 1314 microversion: 2.1 time: 0.575972 Oct 22 21:04:16.884266 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1624/3177] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:04:16 2022] GET /compute/v2.1/servers/87b07efc-fa80-40ad-8077-333547ee7301 => generated 1314 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:04:16.894350 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-e2c10d3c-132f-43d9-a4f3-335febe9d2c7 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:04:16.895273 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-e2c10d3c-132f-43d9-a4f3-335febe9d2c7 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] [instance: f38f14b2-b9d7-4bed-92ba-7b95ea4b2270] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:04:16.909440 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e2c10d3c-132f-43d9-a4f3-335febe9d2c7 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:16.910238 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e2c10d3c-132f-43d9-a4f3-335febe9d2c7 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:16.911124 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e2c10d3c-132f-43d9-a4f3-335febe9d2c7 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:16.912817 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e2c10d3c-132f-43d9-a4f3-335febe9d2c7 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:16.913737 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e2c10d3c-132f-43d9-a4f3-335febe9d2c7 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:16.914651 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e2c10d3c-132f-43d9-a4f3-335febe9d2c7 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:16.975117 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=3 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:04:16.978204 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-b68032ea-eed8-4aa7-b1af-95ef19347466 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] [instance: a99614d8-f2f7-4ce1-87e8-47f3af03d9f8] Doing local delete in cell 5972cb63-1ab7-4825-b0ae-86c7acab764c(cell1) {{(pid=138744) _delete /opt/stack/nova/nova/compute/api.py:2546}} Oct 22 21:04:16.979305 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b68032ea-eed8-4aa7-b1af-95ef19347466 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:16.981168 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b68032ea-eed8-4aa7-b1af-95ef19347466 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:16.981629 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b68032ea-eed8-4aa7-b1af-95ef19347466 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:16.982067 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.compute.api [None req-b68032ea-eed8-4aa7-b1af-95ef19347466 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] [instance: a99614d8-f2f7-4ce1-87e8-47f3af03d9f8] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Oct 22 21:04:16.986317 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.network.neutron [None req-b68032ea-eed8-4aa7-b1af-95ef19347466 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] [instance: a99614d8-f2f7-4ce1-87e8-47f3af03d9f8] deallocate_for_instance() {{(pid=138744) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1780}} Oct 22 21:04:17.574849 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-e2c10d3c-132f-43d9-a4f3-335febe9d2c7 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211483c6acea4f76b6c0e4bfc818e7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd687d54e07d4ab4af00ad801ef4b58d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:04:17.589291 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-e2c10d3c-132f-43d9-a4f3-335febe9d2c7 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '211483c6acea4f76b6c0e4bfc818e7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd687d54e07d4ab4af00ad801ef4b58d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:04:17.592785 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-e2c10d3c-132f-43d9-a4f3-335febe9d2c7 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '211483c6acea4f76b6c0e4bfc818e7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd687d54e07d4ab4af00ad801ef4b58d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:04:17.594136 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-e2c10d3c-132f-43d9-a4f3-335febe9d2c7 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] 10.222.0.18 "GET /compute/v2.1/servers/f38f14b2-b9d7-4bed-92ba-7b95ea4b2270" status: 200 len: 2956 microversion: 2.42 time: 0.708626 Oct 22 21:04:17.594797 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1625/3178] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:04:16 2022] GET /compute/v2.1/servers/f38f14b2-b9d7-4bed-92ba-7b95ea4b2270 => generated 2956 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:04:17.602030 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-c48eba5a-86ca-42f6-95b3-d62fc5132adc tempest-VolumesNegativeTest-1146767104 tempest-VolumesNegativeTest-1146767104-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:04:17.603118 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-c48eba5a-86ca-42f6-95b3-d62fc5132adc tempest-VolumesNegativeTest-1146767104 tempest-VolumesNegativeTest-1146767104-project] [instance: ead6584e-26a9-4923-b58e-305731b6f73b] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:04:17.611934 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c48eba5a-86ca-42f6-95b3-d62fc5132adc tempest-VolumesNegativeTest-1146767104 tempest-VolumesNegativeTest-1146767104-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:17.612802 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c48eba5a-86ca-42f6-95b3-d62fc5132adc tempest-VolumesNegativeTest-1146767104 tempest-VolumesNegativeTest-1146767104-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:17.613435 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c48eba5a-86ca-42f6-95b3-d62fc5132adc tempest-VolumesNegativeTest-1146767104 tempest-VolumesNegativeTest-1146767104-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:17.614406 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c48eba5a-86ca-42f6-95b3-d62fc5132adc tempest-VolumesNegativeTest-1146767104 tempest-VolumesNegativeTest-1146767104-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:17.615047 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c48eba5a-86ca-42f6-95b3-d62fc5132adc tempest-VolumesNegativeTest-1146767104 tempest-VolumesNegativeTest-1146767104-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:17.616048 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c48eba5a-86ca-42f6-95b3-d62fc5132adc tempest-VolumesNegativeTest-1146767104 tempest-VolumesNegativeTest-1146767104-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:17.887097 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-c48eba5a-86ca-42f6-95b3-d62fc5132adc tempest-VolumesNegativeTest-1146767104 tempest-VolumesNegativeTest-1146767104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89246f6315ac429c94630afb36be5253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba7e19328594eae9e7d6a7c6e9c2147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:04:17.896337 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-c48eba5a-86ca-42f6-95b3-d62fc5132adc tempest-VolumesNegativeTest-1146767104 tempest-VolumesNegativeTest-1146767104-project] 10.222.0.18 "GET /compute/v2.1/servers/ead6584e-26a9-4923-b58e-305731b6f73b" status: 200 len: 1272 microversion: 2.1 time: 0.299590 Oct 22 21:04:17.897495 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1626/3179] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:04:17 2022] GET /compute/v2.1/servers/ead6584e-26a9-4923-b58e-305731b6f73b => generated 1272 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:04:17.912178 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-f76a0b8f-9e1a-4f41-ad0b-03f83d4331fa tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:04:17.913576 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-f76a0b8f-9e1a-4f41-ad0b-03f83d4331fa tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] [instance: 2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:04:17.924694 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f76a0b8f-9e1a-4f41-ad0b-03f83d4331fa tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:17.925362 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f76a0b8f-9e1a-4f41-ad0b-03f83d4331fa tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:17.925914 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f76a0b8f-9e1a-4f41-ad0b-03f83d4331fa tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:17.926738 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f76a0b8f-9e1a-4f41-ad0b-03f83d4331fa tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:17.927301 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f76a0b8f-9e1a-4f41-ad0b-03f83d4331fa tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:17.927950 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f76a0b8f-9e1a-4f41-ad0b-03f83d4331fa tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:18.159019 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-f76a0b8f-9e1a-4f41-ad0b-03f83d4331fa tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:04:18.174318 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-f76a0b8f-9e1a-4f41-ad0b-03f83d4331fa tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:04:18.177009 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-f76a0b8f-9e1a-4f41-ad0b-03f83d4331fa tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:04:18.184562 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-f76a0b8f-9e1a-4f41-ad0b-03f83d4331fa tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] 10.222.0.18 "GET /compute/v2.1/servers/2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac" status: 200 len: 1546 microversion: 2.91 time: 0.285444 Oct 22 21:04:18.185281 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1627/3180] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:04:17 2022] GET /compute/v2.1/servers/2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac => generated 1546 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:04:18.190464 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-303d1565-43ee-4127-899f-247c50689781 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:04:18.191209 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-303d1565-43ee-4127-899f-247c50689781 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] [instance: 9bfb71b4-0081-493a-8ed5-1c80169b12d0] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:04:18.197603 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-303d1565-43ee-4127-899f-247c50689781 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:18.198347 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-303d1565-43ee-4127-899f-247c50689781 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:18.198785 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-303d1565-43ee-4127-899f-247c50689781 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:18.199610 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-303d1565-43ee-4127-899f-247c50689781 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:18.200241 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-303d1565-43ee-4127-899f-247c50689781 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:18.200993 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-303d1565-43ee-4127-899f-247c50689781 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:19.199041 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-303d1565-43ee-4127-899f-247c50689781 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a44ff8e7c14b94b1670f030085c43d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a26a2284f4424cbeaf63d504652546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:04:19.212849 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-303d1565-43ee-4127-899f-247c50689781 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] 10.222.0.18 "GET /compute/v2.1/servers/9bfb71b4-0081-493a-8ed5-1c80169b12d0" status: 200 len: 1489 microversion: 2.1 time: 1.025818 Oct 22 21:04:19.213531 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1628/3181] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:04:18 2022] GET /compute/v2.1/servers/9bfb71b4-0081-493a-8ed5-1c80169b12d0 => generated 1489 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:04:19.220056 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-acc9dec9-f0c8-4e8c-a93a-1fd6fa7c239b req-093a6508-e280-4cc1-9c86-24d6fe6adae4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87b07efc-fa80-40ad-8077-333547ee7301", "name": "network-vif-plugged", "status": "completed", "tag": "be99f629-dd9f-41b9-b449-1b1bf0ed4322"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:04:19.240500 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-acc9dec9-f0c8-4e8c-a93a-1fd6fa7c239b req-093a6508-e280-4cc1-9c86-24d6fe6adae4 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:19.241592 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-acc9dec9-f0c8-4e8c-a93a-1fd6fa7c239b req-093a6508-e280-4cc1-9c86-24d6fe6adae4 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:19.242193 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-acc9dec9-f0c8-4e8c-a93a-1fd6fa7c239b req-093a6508-e280-4cc1-9c86-24d6fe6adae4 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:19.264223 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-acc9dec9-f0c8-4e8c-a93a-1fd6fa7c239b req-093a6508-e280-4cc1-9c86-24d6fe6adae4 service nova] Creating event network-vif-plugged:be99f629-dd9f-41b9-b449-1b1bf0ed4322 for instance 87b07efc-fa80-40ad-8077-333547ee7301 on nch2-master-1 Oct 22 21:04:19.273622 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-acc9dec9-f0c8-4e8c-a93a-1fd6fa7c239b req-093a6508-e280-4cc1-9c86-24d6fe6adae4 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058293 Oct 22 21:04:19.274872 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1629/3182] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:04:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:04:19.288636 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-bd871bea-90dc-4577-99e7-1eb8f3d40dfa tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:04:19.289651 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-bd871bea-90dc-4577-99e7-1eb8f3d40dfa tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] [instance: 87b07efc-fa80-40ad-8077-333547ee7301] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:04:19.315558 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bd871bea-90dc-4577-99e7-1eb8f3d40dfa tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:19.316127 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bd871bea-90dc-4577-99e7-1eb8f3d40dfa tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:19.317098 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bd871bea-90dc-4577-99e7-1eb8f3d40dfa tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:19.318027 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bd871bea-90dc-4577-99e7-1eb8f3d40dfa tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:19.318823 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bd871bea-90dc-4577-99e7-1eb8f3d40dfa tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:19.319626 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bd871bea-90dc-4577-99e7-1eb8f3d40dfa tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:19.942048 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-bd871bea-90dc-4577-99e7-1eb8f3d40dfa tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879c85830a9f42088a4ebdf1e3cfb39b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b54f56cfbc814cccb533c65966f35a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:04:19.956190 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.network.neutron [None req-b68032ea-eed8-4aa7-b1af-95ef19347466 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] [instance: a99614d8-f2f7-4ce1-87e8-47f3af03d9f8] Updating instance_info_cache with network_info: [] {{(pid=138744) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 22 21:04:19.962291 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-bd871bea-90dc-4577-99e7-1eb8f3d40dfa tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] 10.222.0.18 "GET /compute/v2.1/servers/87b07efc-fa80-40ad-8077-333547ee7301" status: 200 len: 1314 microversion: 2.1 time: 0.684613 Oct 22 21:04:19.966700 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1630/3183] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:04:19 2022] GET /compute/v2.1/servers/87b07efc-fa80-40ad-8077-333547ee7301 => generated 1314 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:04:19.978159 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-39728618-d78b-46f4-aed3-e86e7cd4eda1 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:04:19.979693 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-39728618-d78b-46f4-aed3-e86e7cd4eda1 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] [instance: f38f14b2-b9d7-4bed-92ba-7b95ea4b2270] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:04:20.012633 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-39728618-d78b-46f4-aed3-e86e7cd4eda1 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:20.013811 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-39728618-d78b-46f4-aed3-e86e7cd4eda1 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:20.014966 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-39728618-d78b-46f4-aed3-e86e7cd4eda1 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:20.016004 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-39728618-d78b-46f4-aed3-e86e7cd4eda1 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:20.016467 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-39728618-d78b-46f4-aed3-e86e7cd4eda1 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:20.016895 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-39728618-d78b-46f4-aed3-e86e7cd4eda1 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:20.481688 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-b68032ea-eed8-4aa7-b1af-95ef19347466 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] 10.222.0.18 "DELETE /compute/v2.1/servers/a99614d8-f2f7-4ce1-87e8-47f3af03d9f8" status: 204 len: 0 microversion: 2.1 time: 4.588006 Oct 22 21:04:20.485642 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1554/3184] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 21:04:15 2022] DELETE /compute/v2.1/servers/a99614d8-f2f7-4ce1-87e8-47f3af03d9f8 => generated 0 bytes in 4589 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 21:04:20.490128 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-03a01a50-46cf-463d-aa88-7da62adcde16 tempest-VolumesNegativeTest-1146767104 tempest-VolumesNegativeTest-1146767104-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:04:20.490758 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-03a01a50-46cf-463d-aa88-7da62adcde16 tempest-VolumesNegativeTest-1146767104 tempest-VolumesNegativeTest-1146767104-project] [instance: ead6584e-26a9-4923-b58e-305731b6f73b] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:04:20.500001 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-03a01a50-46cf-463d-aa88-7da62adcde16 tempest-VolumesNegativeTest-1146767104 tempest-VolumesNegativeTest-1146767104-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:20.500509 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-03a01a50-46cf-463d-aa88-7da62adcde16 tempest-VolumesNegativeTest-1146767104 tempest-VolumesNegativeTest-1146767104-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:20.500959 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-03a01a50-46cf-463d-aa88-7da62adcde16 tempest-VolumesNegativeTest-1146767104 tempest-VolumesNegativeTest-1146767104-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:20.501685 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-03a01a50-46cf-463d-aa88-7da62adcde16 tempest-VolumesNegativeTest-1146767104 tempest-VolumesNegativeTest-1146767104-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:20.502807 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-03a01a50-46cf-463d-aa88-7da62adcde16 tempest-VolumesNegativeTest-1146767104 tempest-VolumesNegativeTest-1146767104-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:20.503251 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-03a01a50-46cf-463d-aa88-7da62adcde16 tempest-VolumesNegativeTest-1146767104 tempest-VolumesNegativeTest-1146767104-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:20.685916 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-39728618-d78b-46f4-aed3-e86e7cd4eda1 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211483c6acea4f76b6c0e4bfc818e7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd687d54e07d4ab4af00ad801ef4b58d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:04:20.697850 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-39728618-d78b-46f4-aed3-e86e7cd4eda1 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '211483c6acea4f76b6c0e4bfc818e7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd687d54e07d4ab4af00ad801ef4b58d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:04:20.701015 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-39728618-d78b-46f4-aed3-e86e7cd4eda1 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '211483c6acea4f76b6c0e4bfc818e7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd687d54e07d4ab4af00ad801ef4b58d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:04:20.702486 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-39728618-d78b-46f4-aed3-e86e7cd4eda1 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] 10.222.0.18 "GET /compute/v2.1/servers/f38f14b2-b9d7-4bed-92ba-7b95ea4b2270" status: 200 len: 2956 microversion: 2.42 time: 0.734346 Oct 22 21:04:20.703394 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1631/3185] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:04:19 2022] GET /compute/v2.1/servers/f38f14b2-b9d7-4bed-92ba-7b95ea4b2270 => generated 2956 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:04:20.709236 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-c2084eb7-aa11-45b2-8a21-cd088962c170 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:04:20.710740 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-c2084eb7-aa11-45b2-8a21-cd088962c170 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] [instance: 2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:04:20.724750 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c2084eb7-aa11-45b2-8a21-cd088962c170 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:20.726072 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c2084eb7-aa11-45b2-8a21-cd088962c170 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:20.727902 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c2084eb7-aa11-45b2-8a21-cd088962c170 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:20.729465 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c2084eb7-aa11-45b2-8a21-cd088962c170 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:20.731729 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c2084eb7-aa11-45b2-8a21-cd088962c170 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:20.732352 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c2084eb7-aa11-45b2-8a21-cd088962c170 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:21.273733 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-c2084eb7-aa11-45b2-8a21-cd088962c170 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:04:21.286569 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-c2084eb7-aa11-45b2-8a21-cd088962c170 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:04:21.289412 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-c2084eb7-aa11-45b2-8a21-cd088962c170 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:04:21.297934 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-c2084eb7-aa11-45b2-8a21-cd088962c170 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] 10.222.0.18 "GET /compute/v2.1/servers/2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac" status: 200 len: 1546 microversion: 2.91 time: 0.593268 Oct 22 21:04:21.314681 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1632/3186] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:04:20 2022] GET /compute/v2.1/servers/2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac => generated 1546 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:04:21.331284 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-3c7a1c63-3650-404b-8f28-fd95a5a5a7d0 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-2015919257"}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:04:21.335014 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-3c7a1c63-3650-404b-8f28-fd95a5a5a7d0 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] [instance: 9bfb71b4-0081-493a-8ed5-1c80169b12d0] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:04:21.335182 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-03a01a50-46cf-463d-aa88-7da62adcde16 tempest-VolumesNegativeTest-1146767104 tempest-VolumesNegativeTest-1146767104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89246f6315ac429c94630afb36be5253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba7e19328594eae9e7d6a7c6e9c2147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:04:21.342971 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3c7a1c63-3650-404b-8f28-fd95a5a5a7d0 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:21.343807 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3c7a1c63-3650-404b-8f28-fd95a5a5a7d0 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:21.344407 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3c7a1c63-3650-404b-8f28-fd95a5a5a7d0 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:21.344564 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-03a01a50-46cf-463d-aa88-7da62adcde16 tempest-VolumesNegativeTest-1146767104 tempest-VolumesNegativeTest-1146767104-project] 10.222.0.18 "GET /compute/v2.1/servers/ead6584e-26a9-4923-b58e-305731b6f73b" status: 200 len: 1314 microversion: 2.1 time: 0.860534 Oct 22 21:04:21.355691 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1555/3187] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:04:20 2022] GET /compute/v2.1/servers/ead6584e-26a9-4923-b58e-305731b6f73b => generated 1314 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:04:21.358314 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3c7a1c63-3650-404b-8f28-fd95a5a5a7d0 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:21.359170 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3c7a1c63-3650-404b-8f28-fd95a5a5a7d0 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:21.360105 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3c7a1c63-3650-404b-8f28-fd95a5a5a7d0 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:21.362693 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-45e3ada0-d799-464a-ba5d-3293d628b35f req-56a243c3-eb96-47e9-ba11-5f38d5d0a371 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a99614d8-f2f7-4ce1-87e8-47f3af03d9f8", "name": "network-vif-deleted", "tag": "de29f75a-6453-4e65-9533-8bc1ec9252f5"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:04:21.388165 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-45e3ada0-d799-464a-ba5d-3293d628b35f req-56a243c3-eb96-47e9-ba11-5f38d5d0a371 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:21.388649 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-45e3ada0-d799-464a-ba5d-3293d628b35f req-56a243c3-eb96-47e9-ba11-5f38d5d0a371 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:21.389281 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-45e3ada0-d799-464a-ba5d-3293d628b35f req-56a243c3-eb96-47e9-ba11-5f38d5d0a371 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:21.425983 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.compute.server_external_events [req-45e3ada0-d799-464a-ba5d-3293d628b35f req-56a243c3-eb96-47e9-ba11-5f38d5d0a371 service nova] Unable to find a host for instance a99614d8-f2f7-4ce1-87e8-47f3af03d9f8. Dropping event network-vif-deleted {{(pid=138744) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 22 21:04:21.428224 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-45e3ada0-d799-464a-ba5d-3293d628b35f req-56a243c3-eb96-47e9-ba11-5f38d5d0a371 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.077158 Oct 22 21:04:21.429765 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1556/3188] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:04:21 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 80 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 22 21:04:21.441055 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-e03cb536-832b-4e6c-8bfc-c5c5fd1d98b1 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:04:21.442054 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-e03cb536-832b-4e6c-8bfc-c5c5fd1d98b1 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] [instance: a99614d8-f2f7-4ce1-87e8-47f3af03d9f8] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:04:21.466438 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e03cb536-832b-4e6c-8bfc-c5c5fd1d98b1 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:21.471886 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e03cb536-832b-4e6c-8bfc-c5c5fd1d98b1 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:21.472462 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e03cb536-832b-4e6c-8bfc-c5c5fd1d98b1 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:21.474260 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e03cb536-832b-4e6c-8bfc-c5c5fd1d98b1 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:21.475278 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e03cb536-832b-4e6c-8bfc-c5c5fd1d98b1 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:21.476260 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e03cb536-832b-4e6c-8bfc-c5c5fd1d98b1 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:21.502560 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-e03cb536-832b-4e6c-8bfc-c5c5fd1d98b1 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] HTTP exception thrown: Instance a99614d8-f2f7-4ce1-87e8-47f3af03d9f8 could not be found. Oct 22 21:04:21.504992 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-e03cb536-832b-4e6c-8bfc-c5c5fd1d98b1 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Request method failure captured: Oct 22 21:04:21.504992 ncdv-master-1 devstack@n-api.service[138744]: request: GET /compute/v2.1/servers/a99614d8-f2f7-4ce1-87e8-47f3af03d9f8 HTTP/1.1 Oct 22 21:04:21.504992 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 21:04:21.504992 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 21:04:21.504992 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 21:04:21.504992 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 0 Oct 22 21:04:21.504992 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 21:04:21.504992 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 21:04:21.504992 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 21:04:21.504992 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 21:04:21.504992 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVFnfV28M622GxgIau9tfOtpQOzUe_Zks3cnq6zOgmdqQwk77RE2xHy9F74fRKXOoFFtdLiZlk8HWakwyjiKYmRp9GaMJF70RmWqk8on_rfYCWM12-ITQGodTkqOwwxslvC1Btdt7aRnJVFyVeqFX--IHdQyw_AkPLTYKSNTzj-OnnLE Oct 22 21:04:21.504992 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 21:04:21.504992 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 21:04:21.504992 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 21:04:21.504992 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 21:04:21.504992 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 21:04:21.504992 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 21:04:21.504992 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: b4cd7873d6db4e09bc9ab9a048a6b1ef Oct 22 21:04:21.504992 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-DeleteServersTestJSON-1244431593 Oct 22 21:04:21.504992 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 21:04:21.504992 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 21:04:21.504992 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_b4cd7873d6db4e09bc9ab9a048a6b1ef"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b4cd7873d6db4e09bc9ab9a048a6b1ef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/b4cd7873d6db4e09bc9ab9a048a6b1ef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b4cd7873d6db4e09bc9ab9a048a6b1ef"}]}] Oct 22 21:04:21.504992 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-DeleteServersTestJSON-1244431593 Oct 22 21:04:21.504992 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: b4cd7873d6db4e09bc9ab9a048a6b1ef Oct 22 21:04:21.504992 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-DeleteServersTestJSON-1244431593 Oct 22 21:04:21.504992 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-DeleteServersTestJSON-1244431593-project Oct 22 21:04:21.504992 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 21:04:21.504992 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 21:04:21.504992 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: be1b410a64e0415a96d30f5040361137 Oct 22 21:04:21.504992 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-DeleteServersTestJSON-1244431593-project Oct 22 21:04:21.504992 ncdv-master-1 devstack@n-api.service[138744]: method: > Oct 22 21:04:21.504992 ncdv-master-1 devstack@n-api.service[138744]: exception: Instance a99614d8-f2f7-4ce1-87e8-47f3af03d9f8 could not be found. Oct 22 21:04:21.504992 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': 'a99614d8-f2f7-4ce1-87e8-47f3af03d9f8'} Oct 22 21:04:21.504992 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:04:21.504992 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:04:21.504992 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 21:04:21.504992 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 21:04:21.504992 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 21:04:21.504992 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 21:04:21.504992 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 21:04:21.504992 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 21:04:21.504992 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 21:04:21.504992 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 21:04:21.504992 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a99614d8-f2f7-4ce1-87e8-47f3af03d9f8 could not be found. Oct 22 21:04:21.504992 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:04:21.504992 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:04:21.504992 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:04:21.504992 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:04:21.504992 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:04:21.504992 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:04:21.504992 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:04:21.504992 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:04:21.504992 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:04:21.504992 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:04:21.504992 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 21:04:21.504992 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 21:04:21.504992 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 21:04:21.504992 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 21:04:21.504992 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 21:04:21.504992 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:04:21.504992 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a99614d8-f2f7-4ce1-87e8-47f3af03d9f8 could not be found. Oct 22 21:04:21.504992 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:04:21.504992 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:04:21.504992 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:04:21.510705 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:04:21.510705 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:04:21.510705 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:04:21.510705 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:04:21.510705 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:04:21.510705 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a99614d8-f2f7-4ce1-87e8-47f3af03d9f8 could not be found. Oct 22 21:04:21.510705 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:04:21.512038 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-e03cb536-832b-4e6c-8bfc-c5c5fd1d98b1 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Returning 404 to user: Instance a99614d8-f2f7-4ce1-87e8-47f3af03d9f8 could not be found. {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:04:21.513086 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-e03cb536-832b-4e6c-8bfc-c5c5fd1d98b1 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] 10.222.0.18 "GET /compute/v2.1/servers/a99614d8-f2f7-4ce1-87e8-47f3af03d9f8" status: 404 len: 111 microversion: 2.1 time: 0.082142 Oct 22 21:04:21.514297 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1557/3189] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:04:21 2022] GET /compute/v2.1/servers/a99614d8-f2f7-4ce1-87e8-47f3af03d9f8 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 21:04:21.519251 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-5e1a9f85-a93f-4c9f-a21a-f8b9e2d1ce84 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:04:21.520144 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-5e1a9f85-a93f-4c9f-a21a-f8b9e2d1ce84 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] [instance: 87b07efc-fa80-40ad-8077-333547ee7301] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:04:21.527111 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5e1a9f85-a93f-4c9f-a21a-f8b9e2d1ce84 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:21.528121 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5e1a9f85-a93f-4c9f-a21a-f8b9e2d1ce84 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:21.529352 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5e1a9f85-a93f-4c9f-a21a-f8b9e2d1ce84 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:21.530275 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5e1a9f85-a93f-4c9f-a21a-f8b9e2d1ce84 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:21.530904 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5e1a9f85-a93f-4c9f-a21a-f8b9e2d1ce84 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:21.531561 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5e1a9f85-a93f-4c9f-a21a-f8b9e2d1ce84 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:21.570764 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=16,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:04:21.759625 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell0:SELECT=2 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:04:21.769664 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-3c7a1c63-3650-404b-8f28-fd95a5a5a7d0 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] 10.222.0.18 "POST /compute/v2.1/servers/9bfb71b4-0081-493a-8ed5-1c80169b12d0/action" status: 202 len: 0 microversion: 2.1 time: 0.453265 Oct 22 21:04:21.770763 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1633/3190] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 21:04:21 2022] POST /compute/v2.1/servers/9bfb71b4-0081-493a-8ed5-1c80169b12d0/action => generated 0 bytes in 455 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 22 21:04:21.777478 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-6da90f32-cf01-47ca-8456-a535cd6e19c7 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-34234120", "imageRef": "085e4478-6edc-4a69-8e08-f9831713eb65", "flavorRef": "452", "networks": [{"uuid": "4ddebde3-67b6-4360-8934-2682d629ac63"}]}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:04:21.806893 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell0:SELECT=6 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:04:21.848654 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.network.neutron [None req-6da90f32-cf01-47ca-8456-a535cd6e19c7 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] validate_networks() for [('4ddebde3-67b6-4360-8934-2682d629ac63', None, None, None, None, None)] {{(pid=138745) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 21:04:22.439108 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-5e1a9f85-a93f-4c9f-a21a-f8b9e2d1ce84 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879c85830a9f42088a4ebdf1e3cfb39b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b54f56cfbc814cccb533c65966f35a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:04:22.450919 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-5e1a9f85-a93f-4c9f-a21a-f8b9e2d1ce84 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] 10.222.0.18 "GET /compute/v2.1/servers/87b07efc-fa80-40ad-8077-333547ee7301" status: 200 len: 1499 microversion: 2.1 time: 0.935272 Oct 22 21:04:22.454516 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1558/3191] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:04:21 2022] GET /compute/v2.1/servers/87b07efc-fa80-40ad-8077-333547ee7301 => generated 1499 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:04:22.460886 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-890be586-450f-4d7d-99a6-6e129059823e tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:04:22.461472 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-890be586-450f-4d7d-99a6-6e129059823e tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] [instance: f38f14b2-b9d7-4bed-92ba-7b95ea4b2270] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:04:22.487949 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-890be586-450f-4d7d-99a6-6e129059823e tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:22.493825 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-890be586-450f-4d7d-99a6-6e129059823e tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:22.494564 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-890be586-450f-4d7d-99a6-6e129059823e tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:22.496059 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-890be586-450f-4d7d-99a6-6e129059823e tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:22.496695 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-890be586-450f-4d7d-99a6-6e129059823e tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:22.497603 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-890be586-450f-4d7d-99a6-6e129059823e tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:23.074888 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-890be586-450f-4d7d-99a6-6e129059823e tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211483c6acea4f76b6c0e4bfc818e7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd687d54e07d4ab4af00ad801ef4b58d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:04:23.099079 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-890be586-450f-4d7d-99a6-6e129059823e tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '211483c6acea4f76b6c0e4bfc818e7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd687d54e07d4ab4af00ad801ef4b58d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:04:23.102356 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-890be586-450f-4d7d-99a6-6e129059823e tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '211483c6acea4f76b6c0e4bfc818e7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd687d54e07d4ab4af00ad801ef4b58d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:04:23.103919 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-890be586-450f-4d7d-99a6-6e129059823e tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] 10.222.0.18 "GET /compute/v2.1/servers/f38f14b2-b9d7-4bed-92ba-7b95ea4b2270" status: 200 len: 2935 microversion: 2.42 time: 0.648218 Oct 22 21:04:23.125264 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1559/3192] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:04:22 2022] GET /compute/v2.1/servers/f38f14b2-b9d7-4bed-92ba-7b95ea4b2270 => generated 2935 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:04:23.130550 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-3c8fd3bc-b922-4fc5-a370-65b90b690d34 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Calling method '.version_select at 0x7fd39f030790>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:04:23.204507 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-3c8fd3bc-b922-4fc5-a370-65b90b690d34 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] 10.222.0.18 "GET /compute/v2.1/images/fefdb332-d8c8-4dbc-8b2b-6d54994dca11" status: 200 len: 1414 microversion: 2.1 time: 0.077739 Oct 22 21:04:23.213202 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1560/3193] 10.222.0.18 () {58 vars in 1233 bytes} [Sat Oct 22 21:04:23 2022] GET /compute/v2.1/images/fefdb332-d8c8-4dbc-8b2b-6d54994dca11 => generated 1414 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:04:23.218401 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-57008f60-852d-4862-94b7-e938700074c3 req-941d9b21-1865-4eed-a1be-60f6194ba018 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f38f14b2-b9d7-4bed-92ba-7b95ea4b2270", "name": "network-vif-unplugged", "status": "completed", "tag": "e1aa03d1-429d-47fc-a834-f0bbaa09e3c6"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:04:23.229591 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-57008f60-852d-4862-94b7-e938700074c3 req-941d9b21-1865-4eed-a1be-60f6194ba018 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:23.230596 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-57008f60-852d-4862-94b7-e938700074c3 req-941d9b21-1865-4eed-a1be-60f6194ba018 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:23.231299 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-57008f60-852d-4862-94b7-e938700074c3 req-941d9b21-1865-4eed-a1be-60f6194ba018 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:23.243579 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-57008f60-852d-4862-94b7-e938700074c3 req-941d9b21-1865-4eed-a1be-60f6194ba018 service nova] Creating event network-vif-unplugged:e1aa03d1-429d-47fc-a834-f0bbaa09e3c6 for instance f38f14b2-b9d7-4bed-92ba-7b95ea4b2270 on nch2-master-1 Oct 22 21:04:23.250078 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-57008f60-852d-4862-94b7-e938700074c3 req-941d9b21-1865-4eed-a1be-60f6194ba018 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034728 Oct 22 21:04:23.251788 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1561/3194] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:04:23 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:04:23.258393 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-03668d14-85ba-4440-9bd1-a824d9825734 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:04:23.259386 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-03668d14-85ba-4440-9bd1-a824d9825734 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] [instance: 2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:04:23.267164 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-03668d14-85ba-4440-9bd1-a824d9825734 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:23.268221 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-03668d14-85ba-4440-9bd1-a824d9825734 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:23.268873 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-03668d14-85ba-4440-9bd1-a824d9825734 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:23.269806 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-03668d14-85ba-4440-9bd1-a824d9825734 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:23.270432 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-03668d14-85ba-4440-9bd1-a824d9825734 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:23.271040 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-03668d14-85ba-4440-9bd1-a824d9825734 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:23.390547 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-03668d14-85ba-4440-9bd1-a824d9825734 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:04:23.399373 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-03668d14-85ba-4440-9bd1-a824d9825734 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:04:23.401220 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-03668d14-85ba-4440-9bd1-a824d9825734 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:04:23.407563 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-03668d14-85ba-4440-9bd1-a824d9825734 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] 10.222.0.18 "GET /compute/v2.1/servers/2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac" status: 200 len: 1533 microversion: 2.91 time: 0.154044 Oct 22 21:04:23.408433 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1562/3195] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:04:23 2022] GET /compute/v2.1/servers/2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac => generated 1533 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:04:23.415973 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-4a960ac3-b9bb-42f6-b438-69b54896a173 tempest-VolumesNegativeTest-1146767104 tempest-VolumesNegativeTest-1146767104-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:04:23.416864 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-4a960ac3-b9bb-42f6-b438-69b54896a173 tempest-VolumesNegativeTest-1146767104 tempest-VolumesNegativeTest-1146767104-project] [instance: ead6584e-26a9-4923-b58e-305731b6f73b] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:04:23.423229 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4a960ac3-b9bb-42f6-b438-69b54896a173 tempest-VolumesNegativeTest-1146767104 tempest-VolumesNegativeTest-1146767104-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:23.424065 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4a960ac3-b9bb-42f6-b438-69b54896a173 tempest-VolumesNegativeTest-1146767104 tempest-VolumesNegativeTest-1146767104-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:23.424685 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4a960ac3-b9bb-42f6-b438-69b54896a173 tempest-VolumesNegativeTest-1146767104 tempest-VolumesNegativeTest-1146767104-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:23.425729 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4a960ac3-b9bb-42f6-b438-69b54896a173 tempest-VolumesNegativeTest-1146767104 tempest-VolumesNegativeTest-1146767104-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:23.426355 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4a960ac3-b9bb-42f6-b438-69b54896a173 tempest-VolumesNegativeTest-1146767104 tempest-VolumesNegativeTest-1146767104-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:23.426949 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4a960ac3-b9bb-42f6-b438-69b54896a173 tempest-VolumesNegativeTest-1146767104 tempest-VolumesNegativeTest-1146767104-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:23.712894 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-6da90f32-cf01-47ca-8456-a535cd6e19c7 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Flavor limits 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 21:04:23.713417 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-6da90f32-cf01-47ca-8456-a535cd6e19c7 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Image limits 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 21:04:23.713955 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-6da90f32-cf01-47ca-8456-a535cd6e19c7 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Flavor pref 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 21:04:23.714734 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-6da90f32-cf01-47ca-8456-a535cd6e19c7 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Image pref 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 21:04:23.715710 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-6da90f32-cf01-47ca-8456-a535cd6e19c7 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 21:04:23.734879 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6da90f32-cf01-47ca-8456-a535cd6e19c7 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:23.737895 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6da90f32-cf01-47ca-8456-a535cd6e19c7 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:23.738567 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6da90f32-cf01-47ca-8456-a535cd6e19c7 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:23.739950 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6da90f32-cf01-47ca-8456-a535cd6e19c7 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:23.741842 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6da90f32-cf01-47ca-8456-a535cd6e19c7 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:23.748763 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6da90f32-cf01-47ca-8456-a535cd6e19c7 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:23.796031 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-6da90f32-cf01-47ca-8456-a535cd6e19c7 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Getting quotas for project b4cd7873d6db4e09bc9ab9a048a6b1ef. Resources: {'cores', 'instances', 'ram'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 21:04:23.816022 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-6da90f32-cf01-47ca-8456-a535cd6e19c7 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Getting quotas for user be1b410a64e0415a96d30f5040361137 and project b4cd7873d6db4e09bc9ab9a048a6b1ef. Resources: {'cores', 'instances', 'ram'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 21:04:23.863249 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-6da90f32-cf01-47ca-8456-a535cd6e19c7 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Going to run 1 instances... {{(pid=138745) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 21:04:23.869598 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-4a960ac3-b9bb-42f6-b438-69b54896a173 tempest-VolumesNegativeTest-1146767104 tempest-VolumesNegativeTest-1146767104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89246f6315ac429c94630afb36be5253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba7e19328594eae9e7d6a7c6e9c2147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:04:23.881997 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-6da90f32-cf01-47ca-8456-a535cd6e19c7 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] [instance: 931293d3-cb3a-4fd1-a684-eb740f010845] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='085e4478-6edc-4a69-8e08-f9831713eb65',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138745) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 21:04:23.884977 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-4a960ac3-b9bb-42f6-b438-69b54896a173 tempest-VolumesNegativeTest-1146767104 tempest-VolumesNegativeTest-1146767104-project] 10.222.0.18 "GET /compute/v2.1/servers/ead6584e-26a9-4923-b58e-305731b6f73b" status: 200 len: 1314 microversion: 2.1 time: 0.470986 Oct 22 21:04:23.885624 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1563/3196] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:04:23 2022] GET /compute/v2.1/servers/ead6584e-26a9-4923-b58e-305731b6f73b => generated 1314 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:04:23.900026 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-602103de-58a0-4f36-96b7-1dac5906d304 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:04:23.919782 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-602103de-58a0-4f36-96b7-1dac5906d304 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] [instance: 87b07efc-fa80-40ad-8077-333547ee7301] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:04:23.939229 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-602103de-58a0-4f36-96b7-1dac5906d304 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:23.940086 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-602103de-58a0-4f36-96b7-1dac5906d304 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:23.940829 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-602103de-58a0-4f36-96b7-1dac5906d304 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:23.946820 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-602103de-58a0-4f36-96b7-1dac5906d304 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:23.949060 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-602103de-58a0-4f36-96b7-1dac5906d304 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:23.951199 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-602103de-58a0-4f36-96b7-1dac5906d304 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:24.024498 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.objects.instance [None req-602103de-58a0-4f36-96b7-1dac5906d304 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lazy-loading 'flavor' on Instance uuid 87b07efc-fa80-40ad-8077-333547ee7301 {{(pid=138744) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 21:04:24.048938 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-6da90f32-cf01-47ca-8456-a535cd6e19c7 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.276461 Oct 22 21:04:24.050243 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1634/3197] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Oct 22 21:04:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 2279 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 21:04:24.297024 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-602103de-58a0-4f36-96b7-1dac5906d304 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] 10.222.0.18 "POST /compute/v2.1/servers/87b07efc-fa80-40ad-8077-333547ee7301/action" status: 200 len: 32 microversion: 2.1 time: 0.408651 Oct 22 21:04:24.310978 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1564/3198] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 21:04:23 2022] POST /compute/v2.1/servers/87b07efc-fa80-40ad-8077-333547ee7301/action => generated 32 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 22 21:04:24.342469 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-bcb41240-a424-426f-8c6e-718b00cf05b5 tempest-UnshelveToHostMultiNodesTest-2069914657 tempest-UnshelveToHostMultiNodesTest-2069914657-project-admin] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:04:24.344330 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-bcb41240-a424-426f-8c6e-718b00cf05b5 tempest-UnshelveToHostMultiNodesTest-2069914657 tempest-UnshelveToHostMultiNodesTest-2069914657-project-admin] [instance: 2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:04:24.372477 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-fec69bb8-901a-44f6-96ac-3845a2912006 tempest-ServerAddressesTestJSON-849573313 tempest-ServerAddressesTestJSON-849573313-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesTestJSON-server-785937729", "imageRef": "085e4478-6edc-4a69-8e08-f9831713eb65", "flavorRef": "452", "networks": [{"uuid": "7c32c0e9-5683-4d6d-86dc-57562e2f2f1e"}]}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:04:24.384836 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bcb41240-a424-426f-8c6e-718b00cf05b5 tempest-UnshelveToHostMultiNodesTest-2069914657 tempest-UnshelveToHostMultiNodesTest-2069914657-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:24.386014 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bcb41240-a424-426f-8c6e-718b00cf05b5 tempest-UnshelveToHostMultiNodesTest-2069914657 tempest-UnshelveToHostMultiNodesTest-2069914657-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:24.390644 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bcb41240-a424-426f-8c6e-718b00cf05b5 tempest-UnshelveToHostMultiNodesTest-2069914657 tempest-UnshelveToHostMultiNodesTest-2069914657-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:24.395366 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bcb41240-a424-426f-8c6e-718b00cf05b5 tempest-UnshelveToHostMultiNodesTest-2069914657 tempest-UnshelveToHostMultiNodesTest-2069914657-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:24.398267 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bcb41240-a424-426f-8c6e-718b00cf05b5 tempest-UnshelveToHostMultiNodesTest-2069914657 tempest-UnshelveToHostMultiNodesTest-2069914657-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:24.400617 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bcb41240-a424-426f-8c6e-718b00cf05b5 tempest-UnshelveToHostMultiNodesTest-2069914657 tempest-UnshelveToHostMultiNodesTest-2069914657-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:24.510353 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.network.neutron [None req-fec69bb8-901a-44f6-96ac-3845a2912006 tempest-ServerAddressesTestJSON-849573313 tempest-ServerAddressesTestJSON-849573313-project] validate_networks() for [('7c32c0e9-5683-4d6d-86dc-57562e2f2f1e', None, None, None, None, None)] {{(pid=138745) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 21:04:24.967988 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.objects.instance [None req-bcb41240-a424-426f-8c6e-718b00cf05b5 tempest-UnshelveToHostMultiNodesTest-2069914657 tempest-UnshelveToHostMultiNodesTest-2069914657-project-admin] Lazy-loading 'services' on Instance uuid 2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac {{(pid=138744) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 21:04:25.020694 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-bcb41240-a424-426f-8c6e-718b00cf05b5 tempest-UnshelveToHostMultiNodesTest-2069914657 tempest-UnshelveToHostMultiNodesTest-2069914657-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac" status: 200 len: 1938 microversion: 2.91 time: 0.700502 Oct 22 21:04:25.026754 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1565/3199] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:04:24 2022] GET /compute/v2.1/servers/2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac => generated 1938 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:04:25.035829 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-5b1fc837-0933-476c-9536-dc0d5bc36d22 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:04:25.036474 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-5b1fc837-0933-476c-9536-dc0d5bc36d22 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] [instance: 931293d3-cb3a-4fd1-a684-eb740f010845] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:04:25.305365 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-5b1fc837-0933-476c-9536-dc0d5bc36d22 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1b410a64e0415a96d30f5040361137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd7873d6db4e09bc9ab9a048a6b1ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:04:25.314674 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-5b1fc837-0933-476c-9536-dc0d5bc36d22 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] 10.222.0.18 "GET /compute/v2.1/servers/931293d3-cb3a-4fd1-a684-eb740f010845" status: 200 len: 1213 microversion: 2.1 time: 0.286541 Oct 22 21:04:25.316246 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1566/3200] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:04:25 2022] GET /compute/v2.1/servers/931293d3-cb3a-4fd1-a684-eb740f010845 => generated 1213 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:04:25.324373 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-b0ebed2a-b449-43fd-8737-c30f8f5a76f0 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:04:25.325567 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-b0ebed2a-b449-43fd-8737-c30f8f5a76f0 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] [instance: f38f14b2-b9d7-4bed-92ba-7b95ea4b2270] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:04:25.343326 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b0ebed2a-b449-43fd-8737-c30f8f5a76f0 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:25.348556 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b0ebed2a-b449-43fd-8737-c30f8f5a76f0 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:25.349363 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b0ebed2a-b449-43fd-8737-c30f8f5a76f0 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:25.350836 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b0ebed2a-b449-43fd-8737-c30f8f5a76f0 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:25.351510 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b0ebed2a-b449-43fd-8737-c30f8f5a76f0 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:25.351949 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b0ebed2a-b449-43fd-8737-c30f8f5a76f0 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:25.887936 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-fec69bb8-901a-44f6-96ac-3845a2912006 tempest-ServerAddressesTestJSON-849573313 tempest-ServerAddressesTestJSON-849573313-project] Flavor limits 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 21:04:25.890100 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-fec69bb8-901a-44f6-96ac-3845a2912006 tempest-ServerAddressesTestJSON-849573313 tempest-ServerAddressesTestJSON-849573313-project] Image limits 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 21:04:25.890750 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-fec69bb8-901a-44f6-96ac-3845a2912006 tempest-ServerAddressesTestJSON-849573313 tempest-ServerAddressesTestJSON-849573313-project] Flavor pref 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 21:04:25.891381 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-fec69bb8-901a-44f6-96ac-3845a2912006 tempest-ServerAddressesTestJSON-849573313 tempest-ServerAddressesTestJSON-849573313-project] Image pref 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 21:04:25.891984 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-fec69bb8-901a-44f6-96ac-3845a2912006 tempest-ServerAddressesTestJSON-849573313 tempest-ServerAddressesTestJSON-849573313-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 21:04:25.918880 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-b0ebed2a-b449-43fd-8737-c30f8f5a76f0 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211483c6acea4f76b6c0e4bfc818e7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd687d54e07d4ab4af00ad801ef4b58d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:04:25.919411 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fec69bb8-901a-44f6-96ac-3845a2912006 tempest-ServerAddressesTestJSON-849573313 tempest-ServerAddressesTestJSON-849573313-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:25.920494 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fec69bb8-901a-44f6-96ac-3845a2912006 tempest-ServerAddressesTestJSON-849573313 tempest-ServerAddressesTestJSON-849573313-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:25.920929 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fec69bb8-901a-44f6-96ac-3845a2912006 tempest-ServerAddressesTestJSON-849573313 tempest-ServerAddressesTestJSON-849573313-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:25.921676 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fec69bb8-901a-44f6-96ac-3845a2912006 tempest-ServerAddressesTestJSON-849573313 tempest-ServerAddressesTestJSON-849573313-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:25.922128 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fec69bb8-901a-44f6-96ac-3845a2912006 tempest-ServerAddressesTestJSON-849573313 tempest-ServerAddressesTestJSON-849573313-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:25.922766 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fec69bb8-901a-44f6-96ac-3845a2912006 tempest-ServerAddressesTestJSON-849573313 tempest-ServerAddressesTestJSON-849573313-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:25.937058 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-b0ebed2a-b449-43fd-8737-c30f8f5a76f0 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '211483c6acea4f76b6c0e4bfc818e7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd687d54e07d4ab4af00ad801ef4b58d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:04:25.938506 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-b0ebed2a-b449-43fd-8737-c30f8f5a76f0 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '211483c6acea4f76b6c0e4bfc818e7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd687d54e07d4ab4af00ad801ef4b58d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:04:25.947266 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-fec69bb8-901a-44f6-96ac-3845a2912006 tempest-ServerAddressesTestJSON-849573313 tempest-ServerAddressesTestJSON-849573313-project] Getting quotas for project 62cda3990bbe4c36a7240c9df581ff62. Resources: {'cores', 'instances', 'ram'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 21:04:25.948200 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-b0ebed2a-b449-43fd-8737-c30f8f5a76f0 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] 10.222.0.18 "GET /compute/v2.1/servers/f38f14b2-b9d7-4bed-92ba-7b95ea4b2270" status: 200 len: 2914 microversion: 2.42 time: 0.630073 Oct 22 21:04:25.950738 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1567/3201] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:04:25 2022] GET /compute/v2.1/servers/f38f14b2-b9d7-4bed-92ba-7b95ea4b2270 => generated 2914 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:04:25.962871 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-fec69bb8-901a-44f6-96ac-3845a2912006 tempest-ServerAddressesTestJSON-849573313 tempest-ServerAddressesTestJSON-849573313-project] Getting quotas for user 703cd05e0f824241bed1565a3a6a7ff3 and project 62cda3990bbe4c36a7240c9df581ff62. Resources: {'cores', 'instances', 'ram'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 21:04:25.970008 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-0ecbad79-8979-484e-8918-d1e54331b4c8 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Calling method '.version_select at 0x7fd39f320dc0>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:04:25.994755 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-fec69bb8-901a-44f6-96ac-3845a2912006 tempest-ServerAddressesTestJSON-849573313 tempest-ServerAddressesTestJSON-849573313-project] Going to run 1 instances... {{(pid=138745) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 21:04:26.001311 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-fec69bb8-901a-44f6-96ac-3845a2912006 tempest-ServerAddressesTestJSON-849573313 tempest-ServerAddressesTestJSON-849573313-project] [instance: 492fde48-2dc2-448f-8d33-fdac96a6bb33] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='085e4478-6edc-4a69-8e08-f9831713eb65',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138745) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 21:04:26.041855 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-0ecbad79-8979-484e-8918-d1e54331b4c8 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] 10.222.0.18 "GET /compute/v2.1/images/fefdb332-d8c8-4dbc-8b2b-6d54994dca11" status: 200 len: 1414 microversion: 2.1 time: 0.085425 Oct 22 21:04:26.043240 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1568/3202] 10.222.0.18 () {58 vars in 1233 bytes} [Sat Oct 22 21:04:25 2022] GET /compute/v2.1/images/fefdb332-d8c8-4dbc-8b2b-6d54994dca11 => generated 1414 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:04:26.068085 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-2d4ebb14-7ca0-48fa-9252-b7b4313a1e02 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:04:26.070166 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-2d4ebb14-7ca0-48fa-9252-b7b4313a1e02 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] [instance: 87b07efc-fa80-40ad-8077-333547ee7301] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:04:26.078399 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2d4ebb14-7ca0-48fa-9252-b7b4313a1e02 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:26.079855 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2d4ebb14-7ca0-48fa-9252-b7b4313a1e02 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:26.080551 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2d4ebb14-7ca0-48fa-9252-b7b4313a1e02 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:26.081703 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2d4ebb14-7ca0-48fa-9252-b7b4313a1e02 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:26.082420 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2d4ebb14-7ca0-48fa-9252-b7b4313a1e02 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:26.083081 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2d4ebb14-7ca0-48fa-9252-b7b4313a1e02 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:26.094747 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-fec69bb8-901a-44f6-96ac-3845a2912006 tempest-ServerAddressesTestJSON-849573313 tempest-ServerAddressesTestJSON-849573313-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.043181 Oct 22 21:04:26.095437 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1635/3203] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Oct 22 21:04:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 2044 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 21:04:26.110194 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-2272d642-db11-4541-8ee0-232cfc841d7d tempest-VolumesNegativeTest-1146767104 tempest-VolumesNegativeTest-1146767104-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:04:26.113482 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-2272d642-db11-4541-8ee0-232cfc841d7d tempest-VolumesNegativeTest-1146767104 tempest-VolumesNegativeTest-1146767104-project] [instance: ead6584e-26a9-4923-b58e-305731b6f73b] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:04:26.129912 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2272d642-db11-4541-8ee0-232cfc841d7d tempest-VolumesNegativeTest-1146767104 tempest-VolumesNegativeTest-1146767104-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:26.130534 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2272d642-db11-4541-8ee0-232cfc841d7d tempest-VolumesNegativeTest-1146767104 tempest-VolumesNegativeTest-1146767104-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:26.131032 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2272d642-db11-4541-8ee0-232cfc841d7d tempest-VolumesNegativeTest-1146767104 tempest-VolumesNegativeTest-1146767104-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:26.132092 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2272d642-db11-4541-8ee0-232cfc841d7d tempest-VolumesNegativeTest-1146767104 tempest-VolumesNegativeTest-1146767104-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:26.133041 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2272d642-db11-4541-8ee0-232cfc841d7d tempest-VolumesNegativeTest-1146767104 tempest-VolumesNegativeTest-1146767104-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:26.133495 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2272d642-db11-4541-8ee0-232cfc841d7d tempest-VolumesNegativeTest-1146767104 tempest-VolumesNegativeTest-1146767104-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:27.050562 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-2272d642-db11-4541-8ee0-232cfc841d7d tempest-VolumesNegativeTest-1146767104 tempest-VolumesNegativeTest-1146767104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89246f6315ac429c94630afb36be5253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba7e19328594eae9e7d6a7c6e9c2147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:04:27.060067 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-2272d642-db11-4541-8ee0-232cfc841d7d tempest-VolumesNegativeTest-1146767104 tempest-VolumesNegativeTest-1146767104-project] 10.222.0.18 "GET /compute/v2.1/servers/ead6584e-26a9-4923-b58e-305731b6f73b" status: 200 len: 1314 microversion: 2.1 time: 0.958539 Oct 22 21:04:27.070806 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-2d4ebb14-7ca0-48fa-9252-b7b4313a1e02 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879c85830a9f42088a4ebdf1e3cfb39b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b54f56cfbc814cccb533c65966f35a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:04:27.087476 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-2d4ebb14-7ca0-48fa-9252-b7b4313a1e02 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] 10.222.0.18 "GET /compute/v2.1/servers/87b07efc-fa80-40ad-8077-333547ee7301" status: 200 len: 1505 microversion: 2.1 time: 1.032398 Oct 22 21:04:27.087476 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1569/3204] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:04:26 2022] GET /compute/v2.1/servers/87b07efc-fa80-40ad-8077-333547ee7301 => generated 1505 bytes in 1034 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:04:27.087722 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1636/3205] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:04:26 2022] GET /compute/v2.1/servers/ead6584e-26a9-4923-b58e-305731b6f73b => generated 1314 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:04:27.104333 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-659c63f9-de7d-449e-8b03-628bd1c97a97 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:04:27.104854 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-659c63f9-de7d-449e-8b03-628bd1c97a97 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] [instance: 2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:04:27.113314 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-880c4209-6df8-43d2-bc4d-615ca31db314 req-851455f1-d62c-4e58-ba62-1d77c98af841 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f38f14b2-b9d7-4bed-92ba-7b95ea4b2270", "name": "network-vif-unplugged", "status": "completed", "tag": "21b2a827-e5c7-48f8-b28e-41001a9b5db6"}, {"server_uuid": "f38f14b2-b9d7-4bed-92ba-7b95ea4b2270", "name": "network-vif-unplugged", "status": "completed", "tag": "d1d48ace-de12-4f4f-9a38-db0a37b136e5"}, {"server_uuid": "f38f14b2-b9d7-4bed-92ba-7b95ea4b2270", "name": "network-vif-unplugged", "status": "completed", "tag": "e8b58979-b36e-4d6b-8fde-739fbeb99ab8"}, {"server_uuid": "f38f14b2-b9d7-4bed-92ba-7b95ea4b2270", "name": "network-vif-unplugged", "status": "completed", "tag": "0600dbf3-8593-4575-a8b3-daa0446351bb"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:04:27.146223 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-659c63f9-de7d-449e-8b03-628bd1c97a97 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:27.146746 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-880c4209-6df8-43d2-bc4d-615ca31db314 req-851455f1-d62c-4e58-ba62-1d77c98af841 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:27.146896 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-659c63f9-de7d-449e-8b03-628bd1c97a97 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:27.147328 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-880c4209-6df8-43d2-bc4d-615ca31db314 req-851455f1-d62c-4e58-ba62-1d77c98af841 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:27.147537 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-659c63f9-de7d-449e-8b03-628bd1c97a97 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:27.147788 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-880c4209-6df8-43d2-bc4d-615ca31db314 req-851455f1-d62c-4e58-ba62-1d77c98af841 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:27.148354 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-659c63f9-de7d-449e-8b03-628bd1c97a97 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:27.148817 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-659c63f9-de7d-449e-8b03-628bd1c97a97 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:27.149246 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-659c63f9-de7d-449e-8b03-628bd1c97a97 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:27.189368 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-880c4209-6df8-43d2-bc4d-615ca31db314 req-851455f1-d62c-4e58-ba62-1d77c98af841 service nova] Creating event network-vif-unplugged:21b2a827-e5c7-48f8-b28e-41001a9b5db6 for instance f38f14b2-b9d7-4bed-92ba-7b95ea4b2270 on nch2-master-1 Oct 22 21:04:27.189886 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-880c4209-6df8-43d2-bc4d-615ca31db314 req-851455f1-d62c-4e58-ba62-1d77c98af841 service nova] Creating event network-vif-unplugged:d1d48ace-de12-4f4f-9a38-db0a37b136e5 for instance f38f14b2-b9d7-4bed-92ba-7b95ea4b2270 on nch2-master-1 Oct 22 21:04:27.190388 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-880c4209-6df8-43d2-bc4d-615ca31db314 req-851455f1-d62c-4e58-ba62-1d77c98af841 service nova] Creating event network-vif-unplugged:e8b58979-b36e-4d6b-8fde-739fbeb99ab8 for instance f38f14b2-b9d7-4bed-92ba-7b95ea4b2270 on nch2-master-1 Oct 22 21:04:27.190894 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-880c4209-6df8-43d2-bc4d-615ca31db314 req-851455f1-d62c-4e58-ba62-1d77c98af841 service nova] Creating event network-vif-unplugged:0600dbf3-8593-4575-a8b3-daa0446351bb for instance f38f14b2-b9d7-4bed-92ba-7b95ea4b2270 on nch2-master-1 Oct 22 21:04:27.224694 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-880c4209-6df8-43d2-bc4d-615ca31db314 req-851455f1-d62c-4e58-ba62-1d77c98af841 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 704 microversion: 2.1 time: 0.137221 Oct 22 21:04:27.226389 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1637/3206] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:04:27 2022] POST /compute/v2.1/os-server-external-events => generated 704 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:04:27.231923 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-9344dca9-189e-44bc-bb78-71bfe13f1a20 tempest-ServerAddressesTestJSON-849573313 tempest-ServerAddressesTestJSON-849573313-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:04:27.238298 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-9344dca9-189e-44bc-bb78-71bfe13f1a20 tempest-ServerAddressesTestJSON-849573313 tempest-ServerAddressesTestJSON-849573313-project] [instance: 492fde48-2dc2-448f-8d33-fdac96a6bb33] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:04:27.247793 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-659c63f9-de7d-449e-8b03-628bd1c97a97 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] [instance: 2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac] Going to try to terminate instance {{(pid=138744) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 21:04:27.456979 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-659c63f9-de7d-449e-8b03-628bd1c97a97 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] 10.222.0.18 "DELETE /compute/v2.1/servers/2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac" status: 204 len: 0 microversion: 2.91 time: 0.366841 Oct 22 21:04:27.461125 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1570/3207] 10.222.0.18 () {60 vars in 1280 bytes} [Sat Oct 22 21:04:27 2022] DELETE /compute/v2.1/servers/2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac => generated 0 bytes in 372 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 22 21:04:27.463631 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-6c39d079-4472-4c12-9ce5-7c986c75da5a req-f5d99f77-2d8f-46a1-a78c-5a36ba70a7ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ead6584e-26a9-4923-b58e-305731b6f73b", "tag": "441f86b3-888a-4eb4-92f9-c281400ace7f"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:04:27.485565 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-6c39d079-4472-4c12-9ce5-7c986c75da5a req-f5d99f77-2d8f-46a1-a78c-5a36ba70a7ed service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:27.485991 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-6c39d079-4472-4c12-9ce5-7c986c75da5a req-f5d99f77-2d8f-46a1-a78c-5a36ba70a7ed service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:27.498565 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-6c39d079-4472-4c12-9ce5-7c986c75da5a req-f5d99f77-2d8f-46a1-a78c-5a36ba70a7ed service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:27.525721 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-6c39d079-4472-4c12-9ce5-7c986c75da5a req-f5d99f77-2d8f-46a1-a78c-5a36ba70a7ed service nova] Creating event network-changed:441f86b3-888a-4eb4-92f9-c281400ace7f for instance ead6584e-26a9-4923-b58e-305731b6f73b on nch2-master-1 Oct 22 21:04:27.531701 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-6c39d079-4472-4c12-9ce5-7c986c75da5a req-f5d99f77-2d8f-46a1-a78c-5a36ba70a7ed service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072187 Oct 22 21:04:27.533009 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1571/3208] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:04:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:04:27.538879 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-66fdeb5c-8e6f-481e-b341-d9eb9d1fa273 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:04:27.540550 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-66fdeb5c-8e6f-481e-b341-d9eb9d1fa273 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] [instance: 931293d3-cb3a-4fd1-a684-eb740f010845] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:04:27.556164 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-66fdeb5c-8e6f-481e-b341-d9eb9d1fa273 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:27.557029 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-66fdeb5c-8e6f-481e-b341-d9eb9d1fa273 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:27.557858 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-66fdeb5c-8e6f-481e-b341-d9eb9d1fa273 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:27.558784 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-66fdeb5c-8e6f-481e-b341-d9eb9d1fa273 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:27.561616 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-66fdeb5c-8e6f-481e-b341-d9eb9d1fa273 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:27.562328 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-66fdeb5c-8e6f-481e-b341-d9eb9d1fa273 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:28.582858 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-66fdeb5c-8e6f-481e-b341-d9eb9d1fa273 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1b410a64e0415a96d30f5040361137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd7873d6db4e09bc9ab9a048a6b1ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:04:28.601566 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-66fdeb5c-8e6f-481e-b341-d9eb9d1fa273 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] 10.222.0.18 "GET /compute/v2.1/servers/931293d3-cb3a-4fd1-a684-eb740f010845" status: 200 len: 1271 microversion: 2.1 time: 1.066954 Oct 22 21:04:28.602393 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1572/3209] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:04:27 2022] GET /compute/v2.1/servers/931293d3-cb3a-4fd1-a684-eb740f010845 => generated 1271 bytes in 1069 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:04:28.608567 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-f50d71d1-9c5e-4461-af5e-21b84ba86d26 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:04:28.609450 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-f50d71d1-9c5e-4461-af5e-21b84ba86d26 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] [instance: f38f14b2-b9d7-4bed-92ba-7b95ea4b2270] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:04:28.612624 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-9344dca9-189e-44bc-bb78-71bfe13f1a20 tempest-ServerAddressesTestJSON-849573313 tempest-ServerAddressesTestJSON-849573313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703cd05e0f824241bed1565a3a6a7ff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62cda3990bbe4c36a7240c9df581ff62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:04:28.617845 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f50d71d1-9c5e-4461-af5e-21b84ba86d26 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:28.618615 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f50d71d1-9c5e-4461-af5e-21b84ba86d26 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:28.619135 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f50d71d1-9c5e-4461-af5e-21b84ba86d26 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:28.620704 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f50d71d1-9c5e-4461-af5e-21b84ba86d26 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:28.621821 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f50d71d1-9c5e-4461-af5e-21b84ba86d26 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:28.622606 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f50d71d1-9c5e-4461-af5e-21b84ba86d26 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:28.663503 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-9344dca9-189e-44bc-bb78-71bfe13f1a20 tempest-ServerAddressesTestJSON-849573313 tempest-ServerAddressesTestJSON-849573313-project] 10.222.0.18 "GET /compute/v2.1/servers/492fde48-2dc2-448f-8d33-fdac96a6bb33" status: 200 len: 1216 microversion: 2.1 time: 1.434825 Oct 22 21:04:28.665328 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1638/3210] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:04:27 2022] GET /compute/v2.1/servers/492fde48-2dc2-448f-8d33-fdac96a6bb33 => generated 1216 bytes in 1438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:04:28.671234 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-945aff73-a10e-41b4-bcd8-920c4f044254 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Calling method '.version_select at 0x7fd39eed2820>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:04:28.757606 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-945aff73-a10e-41b4-bcd8-920c4f044254 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] 10.222.0.18 "GET /compute/v2.1/images/fefdb332-d8c8-4dbc-8b2b-6d54994dca11" status: 200 len: 1414 microversion: 2.1 time: 0.090750 Oct 22 21:04:28.758632 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1639/3211] 10.222.0.18 () {58 vars in 1233 bytes} [Sat Oct 22 21:04:28 2022] GET /compute/v2.1/images/fefdb332-d8c8-4dbc-8b2b-6d54994dca11 => generated 1414 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:04:28.763462 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-04c09667-4c79-49d2-9502-ed37ae64c25b tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:04:28.764490 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-04c09667-4c79-49d2-9502-ed37ae64c25b tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] [instance: 2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:04:28.766666 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=9,nova_api:UPDATE=1 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:04:28.774085 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-04c09667-4c79-49d2-9502-ed37ae64c25b tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:28.774582 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-04c09667-4c79-49d2-9502-ed37ae64c25b tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:28.775020 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-04c09667-4c79-49d2-9502-ed37ae64c25b tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:28.775871 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-04c09667-4c79-49d2-9502-ed37ae64c25b tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:28.776327 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-04c09667-4c79-49d2-9502-ed37ae64c25b tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:28.776771 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-04c09667-4c79-49d2-9502-ed37ae64c25b tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:28.932173 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-04c09667-4c79-49d2-9502-ed37ae64c25b tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:04:28.948609 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-04c09667-4c79-49d2-9502-ed37ae64c25b tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:04:28.961116 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-04c09667-4c79-49d2-9502-ed37ae64c25b tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:04:28.967951 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-04c09667-4c79-49d2-9502-ed37ae64c25b tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] 10.222.0.18 "GET /compute/v2.1/servers/2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac" status: 200 len: 1539 microversion: 2.91 time: 0.208087 Oct 22 21:04:28.968954 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1640/3212] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:04:28 2022] GET /compute/v2.1/servers/2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac => generated 1539 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:04:28.974212 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-5522ceff-1957-42e1-baf2-80b447a6dfda tempest-VolumesNegativeTest-1146767104 tempest-VolumesNegativeTest-1146767104-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:04:28.975051 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-5522ceff-1957-42e1-baf2-80b447a6dfda tempest-VolumesNegativeTest-1146767104 tempest-VolumesNegativeTest-1146767104-project] [instance: ead6584e-26a9-4923-b58e-305731b6f73b] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:04:28.982488 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5522ceff-1957-42e1-baf2-80b447a6dfda tempest-VolumesNegativeTest-1146767104 tempest-VolumesNegativeTest-1146767104-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:28.983593 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5522ceff-1957-42e1-baf2-80b447a6dfda tempest-VolumesNegativeTest-1146767104 tempest-VolumesNegativeTest-1146767104-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:28.984881 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5522ceff-1957-42e1-baf2-80b447a6dfda tempest-VolumesNegativeTest-1146767104 tempest-VolumesNegativeTest-1146767104-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:28.985980 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5522ceff-1957-42e1-baf2-80b447a6dfda tempest-VolumesNegativeTest-1146767104 tempest-VolumesNegativeTest-1146767104-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:28.986616 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5522ceff-1957-42e1-baf2-80b447a6dfda tempest-VolumesNegativeTest-1146767104 tempest-VolumesNegativeTest-1146767104-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:28.987287 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5522ceff-1957-42e1-baf2-80b447a6dfda tempest-VolumesNegativeTest-1146767104 tempest-VolumesNegativeTest-1146767104-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:29.466242 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-f50d71d1-9c5e-4461-af5e-21b84ba86d26 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211483c6acea4f76b6c0e4bfc818e7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd687d54e07d4ab4af00ad801ef4b58d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:04:29.483903 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-f50d71d1-9c5e-4461-af5e-21b84ba86d26 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '211483c6acea4f76b6c0e4bfc818e7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd687d54e07d4ab4af00ad801ef4b58d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:04:29.487095 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-f50d71d1-9c5e-4461-af5e-21b84ba86d26 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '211483c6acea4f76b6c0e4bfc818e7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd687d54e07d4ab4af00ad801ef4b58d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:04:29.492411 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-f50d71d1-9c5e-4461-af5e-21b84ba86d26 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] 10.222.0.18 "GET /compute/v2.1/servers/f38f14b2-b9d7-4bed-92ba-7b95ea4b2270" status: 200 len: 2868 microversion: 2.42 time: 0.888371 Oct 22 21:04:29.494667 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1573/3213] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:04:28 2022] GET /compute/v2.1/servers/f38f14b2-b9d7-4bed-92ba-7b95ea4b2270 => generated 2868 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:04:29.512895 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-894062dd-97b8-4308-a5f1-7a1f8b07daf4 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:04:29.513647 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-894062dd-97b8-4308-a5f1-7a1f8b07daf4 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] [instance: 87b07efc-fa80-40ad-8077-333547ee7301] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:04:29.522974 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-894062dd-97b8-4308-a5f1-7a1f8b07daf4 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:29.522974 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-894062dd-97b8-4308-a5f1-7a1f8b07daf4 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:29.546912 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-894062dd-97b8-4308-a5f1-7a1f8b07daf4 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:29.553338 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-894062dd-97b8-4308-a5f1-7a1f8b07daf4 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:29.555192 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-894062dd-97b8-4308-a5f1-7a1f8b07daf4 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:29.557588 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-894062dd-97b8-4308-a5f1-7a1f8b07daf4 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:29.634170 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-5522ceff-1957-42e1-baf2-80b447a6dfda tempest-VolumesNegativeTest-1146767104 tempest-VolumesNegativeTest-1146767104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89246f6315ac429c94630afb36be5253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba7e19328594eae9e7d6a7c6e9c2147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:04:29.651685 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-5522ceff-1957-42e1-baf2-80b447a6dfda tempest-VolumesNegativeTest-1146767104 tempest-VolumesNegativeTest-1146767104-project] 10.222.0.18 "GET /compute/v2.1/servers/ead6584e-26a9-4923-b58e-305731b6f73b" status: 200 len: 1314 microversion: 2.1 time: 0.673273 Oct 22 21:04:29.653008 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1641/3214] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:04:28 2022] GET /compute/v2.1/servers/ead6584e-26a9-4923-b58e-305731b6f73b => generated 1314 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:04:29.658163 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-c4ae1966-5bb7-4ed0-970c-0697177de1b1 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:04:29.659027 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-c4ae1966-5bb7-4ed0-970c-0697177de1b1 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] [instance: 931293d3-cb3a-4fd1-a684-eb740f010845] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:04:29.682586 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c4ae1966-5bb7-4ed0-970c-0697177de1b1 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:29.683169 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c4ae1966-5bb7-4ed0-970c-0697177de1b1 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:29.683651 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c4ae1966-5bb7-4ed0-970c-0697177de1b1 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:29.684391 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c4ae1966-5bb7-4ed0-970c-0697177de1b1 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:29.684854 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c4ae1966-5bb7-4ed0-970c-0697177de1b1 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:29.685290 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c4ae1966-5bb7-4ed0-970c-0697177de1b1 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:29.739452 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:04:29.864986 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-c4ae1966-5bb7-4ed0-970c-0697177de1b1 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1b410a64e0415a96d30f5040361137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd7873d6db4e09bc9ab9a048a6b1ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:04:29.879010 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-c4ae1966-5bb7-4ed0-970c-0697177de1b1 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] 10.222.0.18 "GET /compute/v2.1/servers/931293d3-cb3a-4fd1-a684-eb740f010845" status: 200 len: 1271 microversion: 2.1 time: 0.218871 Oct 22 21:04:29.879987 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1642/3215] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:04:29 2022] GET /compute/v2.1/servers/931293d3-cb3a-4fd1-a684-eb740f010845 => generated 1271 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:04:29.885076 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-647aa485-9e72-42e5-8cac-4be4d6fce89a tempest-ServerAddressesTestJSON-849573313 tempest-ServerAddressesTestJSON-849573313-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:04:29.896383 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-647aa485-9e72-42e5-8cac-4be4d6fce89a tempest-ServerAddressesTestJSON-849573313 tempest-ServerAddressesTestJSON-849573313-project] [instance: 492fde48-2dc2-448f-8d33-fdac96a6bb33] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:04:29.903965 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-647aa485-9e72-42e5-8cac-4be4d6fce89a tempest-ServerAddressesTestJSON-849573313 tempest-ServerAddressesTestJSON-849573313-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:29.904920 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-647aa485-9e72-42e5-8cac-4be4d6fce89a tempest-ServerAddressesTestJSON-849573313 tempest-ServerAddressesTestJSON-849573313-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:29.906559 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-647aa485-9e72-42e5-8cac-4be4d6fce89a tempest-ServerAddressesTestJSON-849573313 tempest-ServerAddressesTestJSON-849573313-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:29.908814 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-647aa485-9e72-42e5-8cac-4be4d6fce89a tempest-ServerAddressesTestJSON-849573313 tempest-ServerAddressesTestJSON-849573313-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:29.909437 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-647aa485-9e72-42e5-8cac-4be4d6fce89a tempest-ServerAddressesTestJSON-849573313 tempest-ServerAddressesTestJSON-849573313-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:29.911261 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-647aa485-9e72-42e5-8cac-4be4d6fce89a tempest-ServerAddressesTestJSON-849573313 tempest-ServerAddressesTestJSON-849573313-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:30.351472 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-647aa485-9e72-42e5-8cac-4be4d6fce89a tempest-ServerAddressesTestJSON-849573313 tempest-ServerAddressesTestJSON-849573313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703cd05e0f824241bed1565a3a6a7ff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62cda3990bbe4c36a7240c9df581ff62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:04:30.386982 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-647aa485-9e72-42e5-8cac-4be4d6fce89a tempest-ServerAddressesTestJSON-849573313 tempest-ServerAddressesTestJSON-849573313-project] 10.222.0.18 "GET /compute/v2.1/servers/492fde48-2dc2-448f-8d33-fdac96a6bb33" status: 200 len: 1286 microversion: 2.1 time: 0.503361 Oct 22 21:04:30.387905 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1643/3216] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:04:29 2022] GET /compute/v2.1/servers/492fde48-2dc2-448f-8d33-fdac96a6bb33 => generated 1286 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:04:30.431603 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-9ec02177-7785-403b-8522-eabf9870aba3 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Calling method '.version_select at 0x7fd39eeeb4c0>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:04:30.502305 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-9ec02177-7785-403b-8522-eabf9870aba3 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] 10.222.0.18 "GET /compute/v2.1/images/fefdb332-d8c8-4dbc-8b2b-6d54994dca11" status: 200 len: 1414 microversion: 2.1 time: 0.098855 Oct 22 21:04:30.503851 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1644/3217] 10.222.0.18 () {58 vars in 1233 bytes} [Sat Oct 22 21:04:30 2022] GET /compute/v2.1/images/fefdb332-d8c8-4dbc-8b2b-6d54994dca11 => generated 1414 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:04:30.513593 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-7656b5a1-d0b6-4b67-b1c9-e017d593aa15 req-27389593-ec3b-4b14-9d5d-c46fadb81609 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f38f14b2-b9d7-4bed-92ba-7b95ea4b2270", "name": "network-vif-deleted", "tag": "21b2a827-e5c7-48f8-b28e-41001a9b5db6"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:04:30.530715 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-7656b5a1-d0b6-4b67-b1c9-e017d593aa15 req-27389593-ec3b-4b14-9d5d-c46fadb81609 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:30.531319 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-7656b5a1-d0b6-4b67-b1c9-e017d593aa15 req-27389593-ec3b-4b14-9d5d-c46fadb81609 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:30.531970 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-7656b5a1-d0b6-4b67-b1c9-e017d593aa15 req-27389593-ec3b-4b14-9d5d-c46fadb81609 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:30.562807 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-7656b5a1-d0b6-4b67-b1c9-e017d593aa15 req-27389593-ec3b-4b14-9d5d-c46fadb81609 service nova] Creating event network-vif-deleted:21b2a827-e5c7-48f8-b28e-41001a9b5db6 for instance f38f14b2-b9d7-4bed-92ba-7b95ea4b2270 on nch2-master-1 Oct 22 21:04:30.584224 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-7656b5a1-d0b6-4b67-b1c9-e017d593aa15 req-27389593-ec3b-4b14-9d5d-c46fadb81609 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074149 Oct 22 21:04:30.589806 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1645/3218] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:04:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:04:30.609831 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-a5930758-20d5-4cc8-b747-c867c79f4bf4 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:04:30.611500 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-a5930758-20d5-4cc8-b747-c867c79f4bf4 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] [instance: 2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:04:30.629330 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a5930758-20d5-4cc8-b747-c867c79f4bf4 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:30.631897 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a5930758-20d5-4cc8-b747-c867c79f4bf4 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:30.634654 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a5930758-20d5-4cc8-b747-c867c79f4bf4 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:30.635746 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a5930758-20d5-4cc8-b747-c867c79f4bf4 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:30.638782 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a5930758-20d5-4cc8-b747-c867c79f4bf4 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:30.639371 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a5930758-20d5-4cc8-b747-c867c79f4bf4 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:30.780634 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-894062dd-97b8-4308-a5f1-7a1f8b07daf4 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879c85830a9f42088a4ebdf1e3cfb39b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b54f56cfbc814cccb533c65966f35a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:04:30.818768 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-894062dd-97b8-4308-a5f1-7a1f8b07daf4 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] 10.222.0.18 "GET /compute/v2.1/servers/87b07efc-fa80-40ad-8077-333547ee7301" status: 200 len: 1505 microversion: 2.1 time: 1.320780 Oct 22 21:04:30.831927 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1574/3219] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:04:29 2022] GET /compute/v2.1/servers/87b07efc-fa80-40ad-8077-333547ee7301 => generated 1505 bytes in 1337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:04:30.832736 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-a5930758-20d5-4cc8-b747-c867c79f4bf4 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:04:30.845970 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-a5930758-20d5-4cc8-b747-c867c79f4bf4 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:04:30.855119 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-a5930758-20d5-4cc8-b747-c867c79f4bf4 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2246e084910f408db12c0139a2cecc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24fe30b11dc4daf8dcbaaa72eedc48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:04:30.858707 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-a5930758-20d5-4cc8-b747-c867c79f4bf4 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] 10.222.0.18 "GET /compute/v2.1/servers/2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac" status: 200 len: 1539 microversion: 2.91 time: 0.265510 Oct 22 21:04:30.859315 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1646/3220] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:04:30 2022] GET /compute/v2.1/servers/2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac => generated 1539 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:04:30.870624 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-e866ece1-4300-46da-a473-b87fce9c8713 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:04:30.871242 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-e866ece1-4300-46da-a473-b87fce9c8713 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] [instance: f38f14b2-b9d7-4bed-92ba-7b95ea4b2270] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:04:30.886184 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e866ece1-4300-46da-a473-b87fce9c8713 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:30.886653 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e866ece1-4300-46da-a473-b87fce9c8713 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:30.891704 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e866ece1-4300-46da-a473-b87fce9c8713 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:30.892735 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e866ece1-4300-46da-a473-b87fce9c8713 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:30.893375 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e866ece1-4300-46da-a473-b87fce9c8713 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:30.894155 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e866ece1-4300-46da-a473-b87fce9c8713 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:30.894290 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-1e1c7076-5a4c-4e15-a79e-db4923853e6e req-05c29246-4b75-4197-81ba-fb22a240d227 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9bfb71b4-0081-493a-8ed5-1c80169b12d0", "name": "network-vif-plugged", "status": "completed", "tag": "a0cc9777-4dd3-4860-b673-6758803806be"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:04:30.932527 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-1e1c7076-5a4c-4e15-a79e-db4923853e6e req-05c29246-4b75-4197-81ba-fb22a240d227 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:30.936908 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-1e1c7076-5a4c-4e15-a79e-db4923853e6e req-05c29246-4b75-4197-81ba-fb22a240d227 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:30.940374 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-1e1c7076-5a4c-4e15-a79e-db4923853e6e req-05c29246-4b75-4197-81ba-fb22a240d227 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:30.966173 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-1e1c7076-5a4c-4e15-a79e-db4923853e6e req-05c29246-4b75-4197-81ba-fb22a240d227 service nova] Creating event network-vif-plugged:a0cc9777-4dd3-4860-b673-6758803806be for instance 9bfb71b4-0081-493a-8ed5-1c80169b12d0 on nch1-master-1 Oct 22 21:04:30.973790 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-1e1c7076-5a4c-4e15-a79e-db4923853e6e req-05c29246-4b75-4197-81ba-fb22a240d227 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.140435 Oct 22 21:04:30.976396 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1575/3221] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:04:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:04:30.989459 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-9d29c7cd-665a-4a66-bd03-a58031ef3c12 tempest-VolumesNegativeTest-1146767104 tempest-VolumesNegativeTest-1146767104-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:04:30.990402 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-9d29c7cd-665a-4a66-bd03-a58031ef3c12 tempest-VolumesNegativeTest-1146767104 tempest-VolumesNegativeTest-1146767104-project] [instance: ead6584e-26a9-4923-b58e-305731b6f73b] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:04:31.011235 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9d29c7cd-665a-4a66-bd03-a58031ef3c12 tempest-VolumesNegativeTest-1146767104 tempest-VolumesNegativeTest-1146767104-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:31.011793 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9d29c7cd-665a-4a66-bd03-a58031ef3c12 tempest-VolumesNegativeTest-1146767104 tempest-VolumesNegativeTest-1146767104-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:31.012983 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9d29c7cd-665a-4a66-bd03-a58031ef3c12 tempest-VolumesNegativeTest-1146767104 tempest-VolumesNegativeTest-1146767104-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:31.014244 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9d29c7cd-665a-4a66-bd03-a58031ef3c12 tempest-VolumesNegativeTest-1146767104 tempest-VolumesNegativeTest-1146767104-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:31.015911 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9d29c7cd-665a-4a66-bd03-a58031ef3c12 tempest-VolumesNegativeTest-1146767104 tempest-VolumesNegativeTest-1146767104-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:31.019972 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9d29c7cd-665a-4a66-bd03-a58031ef3c12 tempest-VolumesNegativeTest-1146767104 tempest-VolumesNegativeTest-1146767104-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:31.029870 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:04:31.910613 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-e866ece1-4300-46da-a473-b87fce9c8713 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211483c6acea4f76b6c0e4bfc818e7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd687d54e07d4ab4af00ad801ef4b58d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:04:31.923049 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-e866ece1-4300-46da-a473-b87fce9c8713 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '211483c6acea4f76b6c0e4bfc818e7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd687d54e07d4ab4af00ad801ef4b58d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:04:31.929636 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-e866ece1-4300-46da-a473-b87fce9c8713 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '211483c6acea4f76b6c0e4bfc818e7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd687d54e07d4ab4af00ad801ef4b58d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:04:31.935869 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-e866ece1-4300-46da-a473-b87fce9c8713 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] 10.222.0.18 "GET /compute/v2.1/servers/f38f14b2-b9d7-4bed-92ba-7b95ea4b2270" status: 200 len: 2708 microversion: 2.42 time: 1.075444 Oct 22 21:04:31.939084 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1647/3222] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:04:30 2022] GET /compute/v2.1/servers/f38f14b2-b9d7-4bed-92ba-7b95ea4b2270 => generated 2708 bytes in 1079 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:04:31.950310 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-6b7320be-9cde-4379-a47e-14f76f57654e tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:04:31.951395 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-6b7320be-9cde-4379-a47e-14f76f57654e tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] [instance: 931293d3-cb3a-4fd1-a684-eb740f010845] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:04:31.964187 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6b7320be-9cde-4379-a47e-14f76f57654e tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:31.965076 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6b7320be-9cde-4379-a47e-14f76f57654e tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:31.965789 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6b7320be-9cde-4379-a47e-14f76f57654e tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:31.966771 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6b7320be-9cde-4379-a47e-14f76f57654e tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:31.972208 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6b7320be-9cde-4379-a47e-14f76f57654e tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:31.973034 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6b7320be-9cde-4379-a47e-14f76f57654e tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:32.104335 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-9d29c7cd-665a-4a66-bd03-a58031ef3c12 tempest-VolumesNegativeTest-1146767104 tempest-VolumesNegativeTest-1146767104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89246f6315ac429c94630afb36be5253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba7e19328594eae9e7d6a7c6e9c2147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:04:32.114592 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-9d29c7cd-665a-4a66-bd03-a58031ef3c12 tempest-VolumesNegativeTest-1146767104 tempest-VolumesNegativeTest-1146767104-project] 10.222.0.18 "GET /compute/v2.1/servers/ead6584e-26a9-4923-b58e-305731b6f73b" status: 200 len: 1314 microversion: 2.1 time: 1.135700 Oct 22 21:04:32.125231 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1576/3223] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:04:30 2022] GET /compute/v2.1/servers/ead6584e-26a9-4923-b58e-305731b6f73b => generated 1314 bytes in 1147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:04:32.130513 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-cc4a8371-0d17-4133-ba21-151ac196b9f9 tempest-ServerAddressesTestJSON-849573313 tempest-ServerAddressesTestJSON-849573313-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:04:32.139954 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-cc4a8371-0d17-4133-ba21-151ac196b9f9 tempest-ServerAddressesTestJSON-849573313 tempest-ServerAddressesTestJSON-849573313-project] [instance: 492fde48-2dc2-448f-8d33-fdac96a6bb33] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:04:32.170053 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cc4a8371-0d17-4133-ba21-151ac196b9f9 tempest-ServerAddressesTestJSON-849573313 tempest-ServerAddressesTestJSON-849573313-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:32.170597 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cc4a8371-0d17-4133-ba21-151ac196b9f9 tempest-ServerAddressesTestJSON-849573313 tempest-ServerAddressesTestJSON-849573313-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:32.175303 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cc4a8371-0d17-4133-ba21-151ac196b9f9 tempest-ServerAddressesTestJSON-849573313 tempest-ServerAddressesTestJSON-849573313-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:32.180579 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cc4a8371-0d17-4133-ba21-151ac196b9f9 tempest-ServerAddressesTestJSON-849573313 tempest-ServerAddressesTestJSON-849573313-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:32.182967 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cc4a8371-0d17-4133-ba21-151ac196b9f9 tempest-ServerAddressesTestJSON-849573313 tempest-ServerAddressesTestJSON-849573313-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:32.194004 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cc4a8371-0d17-4133-ba21-151ac196b9f9 tempest-ServerAddressesTestJSON-849573313 tempest-ServerAddressesTestJSON-849573313-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:32.963109 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-cc4a8371-0d17-4133-ba21-151ac196b9f9 tempest-ServerAddressesTestJSON-849573313 tempest-ServerAddressesTestJSON-849573313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703cd05e0f824241bed1565a3a6a7ff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62cda3990bbe4c36a7240c9df581ff62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:04:32.973277 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-cc4a8371-0d17-4133-ba21-151ac196b9f9 tempest-ServerAddressesTestJSON-849573313 tempest-ServerAddressesTestJSON-849573313-project] 10.222.0.18 "GET /compute/v2.1/servers/492fde48-2dc2-448f-8d33-fdac96a6bb33" status: 200 len: 1316 microversion: 2.1 time: 0.846497 Oct 22 21:04:32.983689 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1577/3224] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:04:32 2022] GET /compute/v2.1/servers/492fde48-2dc2-448f-8d33-fdac96a6bb33 => generated 1316 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:04:32.988696 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-798a5220-9500-47aa-81d7-497b82495dbe tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Calling method '.version_select at 0x7fd39f02f9d0>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:04:33.083946 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-798a5220-9500-47aa-81d7-497b82495dbe tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] 10.222.0.18 "GET /compute/v2.1/images/fefdb332-d8c8-4dbc-8b2b-6d54994dca11" status: 200 len: 1414 microversion: 2.1 time: 0.099039 Oct 22 21:04:33.090844 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1578/3225] 10.222.0.18 () {58 vars in 1233 bytes} [Sat Oct 22 21:04:32 2022] GET /compute/v2.1/images/fefdb332-d8c8-4dbc-8b2b-6d54994dca11 => generated 1414 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:04:33.098419 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-1fc72409-5748-49bd-b67b-c5365a0a5565 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:04:33.099296 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-1fc72409-5748-49bd-b67b-c5365a0a5565 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] [instance: 87b07efc-fa80-40ad-8077-333547ee7301] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:04:33.106948 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1fc72409-5748-49bd-b67b-c5365a0a5565 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:33.108356 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1fc72409-5748-49bd-b67b-c5365a0a5565 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:33.109061 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1fc72409-5748-49bd-b67b-c5365a0a5565 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:33.110042 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1fc72409-5748-49bd-b67b-c5365a0a5565 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:33.110764 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1fc72409-5748-49bd-b67b-c5365a0a5565 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:33.111488 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1fc72409-5748-49bd-b67b-c5365a0a5565 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:33.360796 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-6b7320be-9cde-4379-a47e-14f76f57654e tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1b410a64e0415a96d30f5040361137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd7873d6db4e09bc9ab9a048a6b1ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:04:33.383982 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-6b7320be-9cde-4379-a47e-14f76f57654e tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] 10.222.0.18 "GET /compute/v2.1/servers/931293d3-cb3a-4fd1-a684-eb740f010845" status: 200 len: 1313 microversion: 2.1 time: 1.441848 Oct 22 21:04:33.403812 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1648/3226] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:04:31 2022] GET /compute/v2.1/servers/931293d3-cb3a-4fd1-a684-eb740f010845 => generated 1313 bytes in 1464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:04:33.412583 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-d6ee8f70-0e49-4c89-b19e-0a193323f9c8 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:04:33.420113 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-d6ee8f70-0e49-4c89-b19e-0a193323f9c8 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] [instance: 2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:04:33.431472 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d6ee8f70-0e49-4c89-b19e-0a193323f9c8 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:33.438651 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d6ee8f70-0e49-4c89-b19e-0a193323f9c8 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:33.439579 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d6ee8f70-0e49-4c89-b19e-0a193323f9c8 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:33.440817 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d6ee8f70-0e49-4c89-b19e-0a193323f9c8 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:33.441424 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d6ee8f70-0e49-4c89-b19e-0a193323f9c8 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:33.442113 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d6ee8f70-0e49-4c89-b19e-0a193323f9c8 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:33.473140 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.wsgi [None req-d6ee8f70-0e49-4c89-b19e-0a193323f9c8 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] HTTP exception thrown: Instance 2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac could not be found. Oct 22 21:04:33.478615 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-d6ee8f70-0e49-4c89-b19e-0a193323f9c8 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Request method failure captured: Oct 22 21:04:33.478615 ncdv-master-1 devstack@n-api.service[138745]: request: GET /compute/v2.1/servers/2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac HTTP/1.1 Oct 22 21:04:33.478615 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 21:04:33.478615 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 21:04:33.478615 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 21:04:33.478615 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 0 Oct 22 21:04:33.478615 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 21:04:33.478615 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 21:04:33.478615 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 21:04:33.478615 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 21:04:33.478615 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVFobhhKDN14jFOOiPDIWpvtTxV4cA94FWunIycc2USyVorMjnLUhnNQK5vImtNDqlt_Usr9YCnH-j2YwEb2cf4_hfJ_DIm8w0PGFHtOOY-FWae4WMEhZRJ3XIl29RTM3L-LXV7B3VfAZBYT_YVo_NYG-FOlsVCgHRoervSEcL1qZZ7Q Oct 22 21:04:33.478615 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 21:04:33.478615 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 21:04:33.478615 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 21:04:33.478615 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 21:04:33.478615 ncdv-master-1 devstack@n-api.service[138745]: X-Openstack-Nova-Api-Version: 2.91 Oct 22 21:04:33.478615 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 21:04:33.478615 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 21:04:33.478615 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: a24fe30b11dc4daf8dcbaaa72eedc48b Oct 22 21:04:33.478615 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-UnshelveToHostMultiNodesTest-238345321 Oct 22 21:04:33.478615 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 21:04:33.478615 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 21:04:33.478615 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_a24fe30b11dc4daf8dcbaaa72eedc48b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a24fe30b11dc4daf8dcbaaa72eedc48b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/a24fe30b11dc4daf8dcbaaa72eedc48b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a24fe30b11dc4daf8dcbaaa72eedc48b"}]}] Oct 22 21:04:33.478615 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-UnshelveToHostMultiNodesTest-238345321 Oct 22 21:04:33.478615 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: a24fe30b11dc4daf8dcbaaa72eedc48b Oct 22 21:04:33.478615 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-UnshelveToHostMultiNodesTest-238345321 Oct 22 21:04:33.478615 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-UnshelveToHostMultiNodesTest-238345321-project Oct 22 21:04:33.478615 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 21:04:33.478615 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 21:04:33.478615 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: 2246e084910f408db12c0139a2cecc50 Oct 22 21:04:33.478615 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-UnshelveToHostMultiNodesTest-238345321-project Oct 22 21:04:33.478615 ncdv-master-1 devstack@n-api.service[138745]: method: > Oct 22 21:04:33.478615 ncdv-master-1 devstack@n-api.service[138745]: exception: Instance 2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac could not be found. Oct 22 21:04:33.478615 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'id': '2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac'} Oct 22 21:04:33.478615 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:04:33.478615 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:04:33.478615 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 21:04:33.478615 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 21:04:33.478615 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 21:04:33.478615 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 21:04:33.478615 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 21:04:33.478615 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 21:04:33.478615 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 21:04:33.478615 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 21:04:33.478615 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac could not be found. Oct 22 21:04:33.478615 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:04:33.478615 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:04:33.478615 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:04:33.478615 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:04:33.478615 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:04:33.478615 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:04:33.478615 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:04:33.478615 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:04:33.478615 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:04:33.478615 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:04:33.478615 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 21:04:33.478615 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 21:04:33.478615 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 21:04:33.478615 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 21:04:33.478615 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 21:04:33.478615 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:04:33.478615 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac could not be found. Oct 22 21:04:33.478615 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:04:33.478615 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:04:33.484187 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:04:33.484187 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:04:33.484187 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:04:33.484187 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:04:33.484187 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:04:33.484187 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:04:33.484187 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac could not be found. Oct 22 21:04:33.484187 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:04:33.488751 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-d6ee8f70-0e49-4c89-b19e-0a193323f9c8 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] Returning 404 to user: Instance 2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac could not be found. {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:04:33.492512 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-d6ee8f70-0e49-4c89-b19e-0a193323f9c8 tempest-UnshelveToHostMultiNodesTest-238345321 tempest-UnshelveToHostMultiNodesTest-238345321-project] 10.222.0.18 "GET /compute/v2.1/servers/2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac" status: 404 len: 111 microversion: 2.91 time: 0.086877 Oct 22 21:04:33.493693 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1649/3227] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:04:33 2022] GET /compute/v2.1/servers/2d035172-81ba-4f7a-9dcd-4b7e16a0b8ac => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 22 21:04:33.507875 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-72e527b1-f8ad-4d0c-9cbb-041e9eda382d req-e4cec16e-9f91-4561-9bdf-224ffebe9c91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f38f14b2-b9d7-4bed-92ba-7b95ea4b2270", "name": "network-vif-deleted", "tag": "e1aa03d1-429d-47fc-a834-f0bbaa09e3c6"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:04:33.535369 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-72e527b1-f8ad-4d0c-9cbb-041e9eda382d req-e4cec16e-9f91-4561-9bdf-224ffebe9c91 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:33.540706 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-72e527b1-f8ad-4d0c-9cbb-041e9eda382d req-e4cec16e-9f91-4561-9bdf-224ffebe9c91 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:33.541408 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-72e527b1-f8ad-4d0c-9cbb-041e9eda382d req-e4cec16e-9f91-4561-9bdf-224ffebe9c91 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:33.580554 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-72e527b1-f8ad-4d0c-9cbb-041e9eda382d req-e4cec16e-9f91-4561-9bdf-224ffebe9c91 service nova] Creating event network-vif-deleted:e1aa03d1-429d-47fc-a834-f0bbaa09e3c6 for instance f38f14b2-b9d7-4bed-92ba-7b95ea4b2270 on nch2-master-1 Oct 22 21:04:33.599689 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-72e527b1-f8ad-4d0c-9cbb-041e9eda382d req-e4cec16e-9f91-4561-9bdf-224ffebe9c91 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102577 Oct 22 21:04:33.603447 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1650/3228] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:04:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:04:33.619716 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-a2dffc77-4f3c-4c4d-ab8c-212e6cfa8276 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:04:33.623302 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-a2dffc77-4f3c-4c4d-ab8c-212e6cfa8276 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] [instance: f38f14b2-b9d7-4bed-92ba-7b95ea4b2270] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:04:33.647447 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a2dffc77-4f3c-4c4d-ab8c-212e6cfa8276 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:33.648942 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a2dffc77-4f3c-4c4d-ab8c-212e6cfa8276 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:33.655015 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a2dffc77-4f3c-4c4d-ab8c-212e6cfa8276 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:33.656039 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a2dffc77-4f3c-4c4d-ab8c-212e6cfa8276 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:33.657813 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a2dffc77-4f3c-4c4d-ab8c-212e6cfa8276 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:33.660261 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a2dffc77-4f3c-4c4d-ab8c-212e6cfa8276 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:34.323286 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-1fc72409-5748-49bd-b67b-c5365a0a5565 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879c85830a9f42088a4ebdf1e3cfb39b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b54f56cfbc814cccb533c65966f35a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:04:34.338742 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-1fc72409-5748-49bd-b67b-c5365a0a5565 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] 10.222.0.18 "GET /compute/v2.1/servers/87b07efc-fa80-40ad-8077-333547ee7301" status: 200 len: 1505 microversion: 2.1 time: 1.242557 Oct 22 21:04:34.343808 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1579/3229] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:04:33 2022] GET /compute/v2.1/servers/87b07efc-fa80-40ad-8077-333547ee7301 => generated 1505 bytes in 1252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:04:34.352345 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-7e3f96f1-8662-4f51-864a-61cb0964b57f tempest-VolumesNegativeTest-1146767104 tempest-VolumesNegativeTest-1146767104-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:04:34.357076 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-7e3f96f1-8662-4f51-864a-61cb0964b57f tempest-VolumesNegativeTest-1146767104 tempest-VolumesNegativeTest-1146767104-project] [instance: ead6584e-26a9-4923-b58e-305731b6f73b] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:04:34.374029 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7e3f96f1-8662-4f51-864a-61cb0964b57f tempest-VolumesNegativeTest-1146767104 tempest-VolumesNegativeTest-1146767104-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:34.374927 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7e3f96f1-8662-4f51-864a-61cb0964b57f tempest-VolumesNegativeTest-1146767104 tempest-VolumesNegativeTest-1146767104-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:34.375681 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7e3f96f1-8662-4f51-864a-61cb0964b57f tempest-VolumesNegativeTest-1146767104 tempest-VolumesNegativeTest-1146767104-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:34.377552 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7e3f96f1-8662-4f51-864a-61cb0964b57f tempest-VolumesNegativeTest-1146767104 tempest-VolumesNegativeTest-1146767104-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:34.379798 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7e3f96f1-8662-4f51-864a-61cb0964b57f tempest-VolumesNegativeTest-1146767104 tempest-VolumesNegativeTest-1146767104-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:34.380606 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7e3f96f1-8662-4f51-864a-61cb0964b57f tempest-VolumesNegativeTest-1146767104 tempest-VolumesNegativeTest-1146767104-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:34.756064 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-a2dffc77-4f3c-4c4d-ab8c-212e6cfa8276 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211483c6acea4f76b6c0e4bfc818e7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd687d54e07d4ab4af00ad801ef4b58d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:04:34.772518 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-a2dffc77-4f3c-4c4d-ab8c-212e6cfa8276 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '211483c6acea4f76b6c0e4bfc818e7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd687d54e07d4ab4af00ad801ef4b58d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:04:34.777787 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-a2dffc77-4f3c-4c4d-ab8c-212e6cfa8276 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '211483c6acea4f76b6c0e4bfc818e7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd687d54e07d4ab4af00ad801ef4b58d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:04:34.787859 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-a2dffc77-4f3c-4c4d-ab8c-212e6cfa8276 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] 10.222.0.18 "GET /compute/v2.1/servers/f38f14b2-b9d7-4bed-92ba-7b95ea4b2270" status: 200 len: 2594 microversion: 2.42 time: 1.171404 Oct 22 21:04:34.789044 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1651/3230] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:04:33 2022] GET /compute/v2.1/servers/f38f14b2-b9d7-4bed-92ba-7b95ea4b2270 => generated 2594 bytes in 1185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:04:34.801637 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-690128e6-3d17-44ca-87d8-dbbcf61115fe tempest-ServerAddressesTestJSON-849573313 tempest-ServerAddressesTestJSON-849573313-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:04:34.802522 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-690128e6-3d17-44ca-87d8-dbbcf61115fe tempest-ServerAddressesTestJSON-849573313 tempest-ServerAddressesTestJSON-849573313-project] [instance: 492fde48-2dc2-448f-8d33-fdac96a6bb33] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:04:34.816551 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-690128e6-3d17-44ca-87d8-dbbcf61115fe tempest-ServerAddressesTestJSON-849573313 tempest-ServerAddressesTestJSON-849573313-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:34.817965 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-690128e6-3d17-44ca-87d8-dbbcf61115fe tempest-ServerAddressesTestJSON-849573313 tempest-ServerAddressesTestJSON-849573313-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:34.818665 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-690128e6-3d17-44ca-87d8-dbbcf61115fe tempest-ServerAddressesTestJSON-849573313 tempest-ServerAddressesTestJSON-849573313-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:34.821286 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-690128e6-3d17-44ca-87d8-dbbcf61115fe tempest-ServerAddressesTestJSON-849573313 tempest-ServerAddressesTestJSON-849573313-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:34.821928 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-690128e6-3d17-44ca-87d8-dbbcf61115fe tempest-ServerAddressesTestJSON-849573313 tempest-ServerAddressesTestJSON-849573313-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:34.822527 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-690128e6-3d17-44ca-87d8-dbbcf61115fe tempest-ServerAddressesTestJSON-849573313 tempest-ServerAddressesTestJSON-849573313-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:34.995857 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-7e3f96f1-8662-4f51-864a-61cb0964b57f tempest-VolumesNegativeTest-1146767104 tempest-VolumesNegativeTest-1146767104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89246f6315ac429c94630afb36be5253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba7e19328594eae9e7d6a7c6e9c2147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:04:35.008663 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-7e3f96f1-8662-4f51-864a-61cb0964b57f tempest-VolumesNegativeTest-1146767104 tempest-VolumesNegativeTest-1146767104-project] 10.222.0.18 "GET /compute/v2.1/servers/ead6584e-26a9-4923-b58e-305731b6f73b" status: 200 len: 1314 microversion: 2.1 time: 0.663387 Oct 22 21:04:35.016531 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1580/3231] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:04:34 2022] GET /compute/v2.1/servers/ead6584e-26a9-4923-b58e-305731b6f73b => generated 1314 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:04:35.312195 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell0:SELECT=2 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:04:35.330239 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-f6809a35-6a71-430c-8194-20d0263a4570 req-02dd3b2d-1915-4c2f-a237-f7efd2e6955d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "492fde48-2dc2-448f-8d33-fdac96a6bb33", "tag": "1d6f49d3-65fb-4151-aee6-cd415fd5f899"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:04:35.344741 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-f6809a35-6a71-430c-8194-20d0263a4570 req-02dd3b2d-1915-4c2f-a237-f7efd2e6955d service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:35.348310 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-f6809a35-6a71-430c-8194-20d0263a4570 req-02dd3b2d-1915-4c2f-a237-f7efd2e6955d service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:35.348891 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-f6809a35-6a71-430c-8194-20d0263a4570 req-02dd3b2d-1915-4c2f-a237-f7efd2e6955d service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:35.422032 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-f6809a35-6a71-430c-8194-20d0263a4570 req-02dd3b2d-1915-4c2f-a237-f7efd2e6955d service nova] Creating event network-changed:1d6f49d3-65fb-4151-aee6-cd415fd5f899 for instance 492fde48-2dc2-448f-8d33-fdac96a6bb33 on nch1-master-1 Oct 22 21:04:35.433655 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-f6809a35-6a71-430c-8194-20d0263a4570 req-02dd3b2d-1915-4c2f-a237-f7efd2e6955d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.415601 Oct 22 21:04:35.435452 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1581/3232] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:04:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:04:35.444455 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-99b4a899-fb67-4495-85b0-a3deec76b591 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Calling method '.version_select at 0x7fd39f02f1f0>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:04:35.566185 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-99b4a899-fb67-4495-85b0-a3deec76b591 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] 10.222.0.18 "GET /compute/v2.1/images/fefdb332-d8c8-4dbc-8b2b-6d54994dca11" status: 200 len: 1414 microversion: 2.1 time: 0.128979 Oct 22 21:04:35.566966 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1582/3233] 10.222.0.18 () {58 vars in 1233 bytes} [Sat Oct 22 21:04:35 2022] GET /compute/v2.1/images/fefdb332-d8c8-4dbc-8b2b-6d54994dca11 => generated 1414 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:04:35.580703 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-af7a2f14-eb8e-4c9a-80b9-32e3af7efa9c tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:04:35.582436 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-af7a2f14-eb8e-4c9a-80b9-32e3af7efa9c tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] [instance: 931293d3-cb3a-4fd1-a684-eb740f010845] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:04:35.601400 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-af7a2f14-eb8e-4c9a-80b9-32e3af7efa9c tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:35.604996 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-af7a2f14-eb8e-4c9a-80b9-32e3af7efa9c tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:35.608496 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-af7a2f14-eb8e-4c9a-80b9-32e3af7efa9c tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:35.609753 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-af7a2f14-eb8e-4c9a-80b9-32e3af7efa9c tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:35.611761 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-af7a2f14-eb8e-4c9a-80b9-32e3af7efa9c tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:35.614426 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-af7a2f14-eb8e-4c9a-80b9-32e3af7efa9c tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:35.936955 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell0:SELECT=4 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:04:36.053356 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-690128e6-3d17-44ca-87d8-dbbcf61115fe tempest-ServerAddressesTestJSON-849573313 tempest-ServerAddressesTestJSON-849573313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703cd05e0f824241bed1565a3a6a7ff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62cda3990bbe4c36a7240c9df581ff62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:04:36.067825 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-690128e6-3d17-44ca-87d8-dbbcf61115fe tempest-ServerAddressesTestJSON-849573313 tempest-ServerAddressesTestJSON-849573313-project] 10.222.0.18 "GET /compute/v2.1/servers/492fde48-2dc2-448f-8d33-fdac96a6bb33" status: 200 len: 1316 microversion: 2.1 time: 1.277430 Oct 22 21:04:36.085850 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1652/3234] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:04:34 2022] GET /compute/v2.1/servers/492fde48-2dc2-448f-8d33-fdac96a6bb33 => generated 1316 bytes in 1296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:04:36.095299 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-eee374ac-6e74-4198-bf49-5fb6a3b967ce tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:04:36.096209 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-eee374ac-6e74-4198-bf49-5fb6a3b967ce tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] [instance: 87b07efc-fa80-40ad-8077-333547ee7301] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:04:36.107238 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-eee374ac-6e74-4198-bf49-5fb6a3b967ce tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:36.108309 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-eee374ac-6e74-4198-bf49-5fb6a3b967ce tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:36.108934 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-eee374ac-6e74-4198-bf49-5fb6a3b967ce tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:36.117179 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-eee374ac-6e74-4198-bf49-5fb6a3b967ce tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:36.119644 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-eee374ac-6e74-4198-bf49-5fb6a3b967ce tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:36.120592 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-eee374ac-6e74-4198-bf49-5fb6a3b967ce tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:36.637032 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-af7a2f14-eb8e-4c9a-80b9-32e3af7efa9c tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1b410a64e0415a96d30f5040361137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd7873d6db4e09bc9ab9a048a6b1ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:04:36.653970 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-af7a2f14-eb8e-4c9a-80b9-32e3af7efa9c tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] 10.222.0.18 "GET /compute/v2.1/servers/931293d3-cb3a-4fd1-a684-eb740f010845" status: 200 len: 1313 microversion: 2.1 time: 1.084757 Oct 22 21:04:36.654632 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1583/3235] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:04:35 2022] GET /compute/v2.1/servers/931293d3-cb3a-4fd1-a684-eb740f010845 => generated 1313 bytes in 1086 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:04:36.664883 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-fd8c991f-02fc-4f2d-97a9-a5a3b512c940 req-795515f9-8942-4437-b1b7-8c74fc1a4d16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f38f14b2-b9d7-4bed-92ba-7b95ea4b2270", "name": "network-vif-deleted", "tag": "0600dbf3-8593-4575-a8b3-daa0446351bb"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:04:36.687861 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-fd8c991f-02fc-4f2d-97a9-a5a3b512c940 req-795515f9-8942-4437-b1b7-8c74fc1a4d16 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:36.693362 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-fd8c991f-02fc-4f2d-97a9-a5a3b512c940 req-795515f9-8942-4437-b1b7-8c74fc1a4d16 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:36.694133 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-fd8c991f-02fc-4f2d-97a9-a5a3b512c940 req-795515f9-8942-4437-b1b7-8c74fc1a4d16 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:36.720094 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-fd8c991f-02fc-4f2d-97a9-a5a3b512c940 req-795515f9-8942-4437-b1b7-8c74fc1a4d16 service nova] Creating event network-vif-deleted:0600dbf3-8593-4575-a8b3-daa0446351bb for instance f38f14b2-b9d7-4bed-92ba-7b95ea4b2270 on nch2-master-1 Oct 22 21:04:36.733921 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-fd8c991f-02fc-4f2d-97a9-a5a3b512c940 req-795515f9-8942-4437-b1b7-8c74fc1a4d16 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076745 Oct 22 21:04:36.735616 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1584/3236] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:04:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:04:36.762194 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-5c6d2f5f-4c28-45a0-8969-68c41f8c9833 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:04:36.765102 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-5c6d2f5f-4c28-45a0-8969-68c41f8c9833 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] [instance: f38f14b2-b9d7-4bed-92ba-7b95ea4b2270] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:04:36.780211 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5c6d2f5f-4c28-45a0-8969-68c41f8c9833 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:36.780721 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5c6d2f5f-4c28-45a0-8969-68c41f8c9833 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:36.781556 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5c6d2f5f-4c28-45a0-8969-68c41f8c9833 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:36.782686 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5c6d2f5f-4c28-45a0-8969-68c41f8c9833 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:36.783318 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5c6d2f5f-4c28-45a0-8969-68c41f8c9833 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:36.783940 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5c6d2f5f-4c28-45a0-8969-68c41f8c9833 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:37.187580 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-eee374ac-6e74-4198-bf49-5fb6a3b967ce tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879c85830a9f42088a4ebdf1e3cfb39b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b54f56cfbc814cccb533c65966f35a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:04:37.201046 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-eee374ac-6e74-4198-bf49-5fb6a3b967ce tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] 10.222.0.18 "GET /compute/v2.1/servers/87b07efc-fa80-40ad-8077-333547ee7301" status: 200 len: 1505 microversion: 2.1 time: 1.113686 Oct 22 21:04:37.211500 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1653/3237] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:04:36 2022] GET /compute/v2.1/servers/87b07efc-fa80-40ad-8077-333547ee7301 => generated 1505 bytes in 1117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:04:37.214020 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-31807137-870f-4f18-ac14-386a1b8a0a14 tempest-VolumesNegativeTest-1146767104 tempest-VolumesNegativeTest-1146767104-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:04:37.219305 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-31807137-870f-4f18-ac14-386a1b8a0a14 tempest-VolumesNegativeTest-1146767104 tempest-VolumesNegativeTest-1146767104-project] [instance: ead6584e-26a9-4923-b58e-305731b6f73b] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:04:37.229886 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-31807137-870f-4f18-ac14-386a1b8a0a14 tempest-VolumesNegativeTest-1146767104 tempest-VolumesNegativeTest-1146767104-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:37.232707 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-31807137-870f-4f18-ac14-386a1b8a0a14 tempest-VolumesNegativeTest-1146767104 tempest-VolumesNegativeTest-1146767104-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:37.233297 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-31807137-870f-4f18-ac14-386a1b8a0a14 tempest-VolumesNegativeTest-1146767104 tempest-VolumesNegativeTest-1146767104-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:37.235485 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-31807137-870f-4f18-ac14-386a1b8a0a14 tempest-VolumesNegativeTest-1146767104 tempest-VolumesNegativeTest-1146767104-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:37.236040 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-31807137-870f-4f18-ac14-386a1b8a0a14 tempest-VolumesNegativeTest-1146767104 tempest-VolumesNegativeTest-1146767104-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:37.239857 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-31807137-870f-4f18-ac14-386a1b8a0a14 tempest-VolumesNegativeTest-1146767104 tempest-VolumesNegativeTest-1146767104-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:37.536688 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-5c6d2f5f-4c28-45a0-8969-68c41f8c9833 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211483c6acea4f76b6c0e4bfc818e7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd687d54e07d4ab4af00ad801ef4b58d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:04:37.569114 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-5c6d2f5f-4c28-45a0-8969-68c41f8c9833 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '211483c6acea4f76b6c0e4bfc818e7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd687d54e07d4ab4af00ad801ef4b58d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:04:37.579505 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-5c6d2f5f-4c28-45a0-8969-68c41f8c9833 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '211483c6acea4f76b6c0e4bfc818e7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd687d54e07d4ab4af00ad801ef4b58d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:04:37.588264 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-5c6d2f5f-4c28-45a0-8969-68c41f8c9833 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] 10.222.0.18 "GET /compute/v2.1/servers/f38f14b2-b9d7-4bed-92ba-7b95ea4b2270" status: 200 len: 2391 microversion: 2.42 time: 0.847198 Oct 22 21:04:37.588948 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1585/3238] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:04:36 2022] GET /compute/v2.1/servers/f38f14b2-b9d7-4bed-92ba-7b95ea4b2270 => generated 2391 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:04:37.612701 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-d4cf3dc6-6fc1-4ebc-9aed-aecdf2fc932f tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Calling method '.version_select at 0x7fd39f030a60>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:04:37.698075 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-d4cf3dc6-6fc1-4ebc-9aed-aecdf2fc932f tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] 10.222.0.18 "GET /compute/v2.1/images/fefdb332-d8c8-4dbc-8b2b-6d54994dca11" status: 200 len: 1414 microversion: 2.1 time: 0.104664 Oct 22 21:04:37.707725 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1586/3239] 10.222.0.18 () {58 vars in 1233 bytes} [Sat Oct 22 21:04:37 2022] GET /compute/v2.1/images/fefdb332-d8c8-4dbc-8b2b-6d54994dca11 => generated 1414 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:04:37.719036 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-3b3f6fee-6472-4162-9604-5f6f13ca32ba tempest-ServerAddressesTestJSON-849573313 tempest-ServerAddressesTestJSON-849573313-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:04:37.719694 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-3b3f6fee-6472-4162-9604-5f6f13ca32ba tempest-ServerAddressesTestJSON-849573313 tempest-ServerAddressesTestJSON-849573313-project] [instance: 492fde48-2dc2-448f-8d33-fdac96a6bb33] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:04:37.743818 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3b3f6fee-6472-4162-9604-5f6f13ca32ba tempest-ServerAddressesTestJSON-849573313 tempest-ServerAddressesTestJSON-849573313-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:37.744335 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3b3f6fee-6472-4162-9604-5f6f13ca32ba tempest-ServerAddressesTestJSON-849573313 tempest-ServerAddressesTestJSON-849573313-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:37.744789 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3b3f6fee-6472-4162-9604-5f6f13ca32ba tempest-ServerAddressesTestJSON-849573313 tempest-ServerAddressesTestJSON-849573313-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:37.745510 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3b3f6fee-6472-4162-9604-5f6f13ca32ba tempest-ServerAddressesTestJSON-849573313 tempest-ServerAddressesTestJSON-849573313-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:37.745791 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-31807137-870f-4f18-ac14-386a1b8a0a14 tempest-VolumesNegativeTest-1146767104 tempest-VolumesNegativeTest-1146767104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89246f6315ac429c94630afb36be5253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba7e19328594eae9e7d6a7c6e9c2147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:04:37.753336 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3b3f6fee-6472-4162-9604-5f6f13ca32ba tempest-ServerAddressesTestJSON-849573313 tempest-ServerAddressesTestJSON-849573313-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:37.755844 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-31807137-870f-4f18-ac14-386a1b8a0a14 tempest-VolumesNegativeTest-1146767104 tempest-VolumesNegativeTest-1146767104-project] 10.222.0.18 "GET /compute/v2.1/servers/ead6584e-26a9-4923-b58e-305731b6f73b" status: 200 len: 1314 microversion: 2.1 time: 0.551192 Oct 22 21:04:37.767412 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3b3f6fee-6472-4162-9604-5f6f13ca32ba tempest-ServerAddressesTestJSON-849573313 tempest-ServerAddressesTestJSON-849573313-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:37.767679 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1654/3240] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:04:37 2022] GET /compute/v2.1/servers/ead6584e-26a9-4923-b58e-305731b6f73b => generated 1314 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:04:37.767679 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-aac827a9-6bed-499e-b2b2-96f1f872dc5b tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:04:37.767679 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-aac827a9-6bed-499e-b2b2-96f1f872dc5b tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] [instance: 931293d3-cb3a-4fd1-a684-eb740f010845] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:04:37.783140 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-aac827a9-6bed-499e-b2b2-96f1f872dc5b tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:37.783899 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-aac827a9-6bed-499e-b2b2-96f1f872dc5b tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:37.785685 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-aac827a9-6bed-499e-b2b2-96f1f872dc5b tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:37.786455 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-aac827a9-6bed-499e-b2b2-96f1f872dc5b tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:37.786928 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-aac827a9-6bed-499e-b2b2-96f1f872dc5b tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:37.787483 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-aac827a9-6bed-499e-b2b2-96f1f872dc5b tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:38.242598 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-aac827a9-6bed-499e-b2b2-96f1f872dc5b tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1b410a64e0415a96d30f5040361137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd7873d6db4e09bc9ab9a048a6b1ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:04:38.256781 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-aac827a9-6bed-499e-b2b2-96f1f872dc5b tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] 10.222.0.18 "GET /compute/v2.1/servers/931293d3-cb3a-4fd1-a684-eb740f010845" status: 200 len: 1313 microversion: 2.1 time: 0.495739 Oct 22 21:04:38.272182 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1655/3241] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:04:37 2022] GET /compute/v2.1/servers/931293d3-cb3a-4fd1-a684-eb740f010845 => generated 1313 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:04:38.277456 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-8c43b438-b3dc-407a-a6fb-0000f5da8c30 req-61db081d-5f92-4fe9-8b31-bf8aff249c6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ead6584e-26a9-4923-b58e-305731b6f73b", "name": "network-vif-plugged", "status": "completed", "tag": "441f86b3-888a-4eb4-92f9-c281400ace7f"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:04:38.293217 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-3b3f6fee-6472-4162-9604-5f6f13ca32ba tempest-ServerAddressesTestJSON-849573313 tempest-ServerAddressesTestJSON-849573313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703cd05e0f824241bed1565a3a6a7ff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62cda3990bbe4c36a7240c9df581ff62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:04:38.304627 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-8c43b438-b3dc-407a-a6fb-0000f5da8c30 req-61db081d-5f92-4fe9-8b31-bf8aff249c6f service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:38.305520 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-8c43b438-b3dc-407a-a6fb-0000f5da8c30 req-61db081d-5f92-4fe9-8b31-bf8aff249c6f service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:38.306195 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-8c43b438-b3dc-407a-a6fb-0000f5da8c30 req-61db081d-5f92-4fe9-8b31-bf8aff249c6f service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:38.308138 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-3b3f6fee-6472-4162-9604-5f6f13ca32ba tempest-ServerAddressesTestJSON-849573313 tempest-ServerAddressesTestJSON-849573313-project] 10.222.0.18 "GET /compute/v2.1/servers/492fde48-2dc2-448f-8d33-fdac96a6bb33" status: 200 len: 1316 microversion: 2.1 time: 0.599185 Oct 22 21:04:38.309271 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1587/3242] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:04:37 2022] GET /compute/v2.1/servers/492fde48-2dc2-448f-8d33-fdac96a6bb33 => generated 1316 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:04:38.328008 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-8082c4e5-ad7e-45be-a5be-540fa129feb6 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:04:38.328967 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-8082c4e5-ad7e-45be-a5be-540fa129feb6 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] [instance: 87b07efc-fa80-40ad-8077-333547ee7301] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:04:38.338594 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8082c4e5-ad7e-45be-a5be-540fa129feb6 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:38.341756 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8082c4e5-ad7e-45be-a5be-540fa129feb6 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:38.342386 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8082c4e5-ad7e-45be-a5be-540fa129feb6 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:38.343325 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8082c4e5-ad7e-45be-a5be-540fa129feb6 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:38.344529 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8082c4e5-ad7e-45be-a5be-540fa129feb6 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:38.346827 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8082c4e5-ad7e-45be-a5be-540fa129feb6 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:38.356842 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-8c43b438-b3dc-407a-a6fb-0000f5da8c30 req-61db081d-5f92-4fe9-8b31-bf8aff249c6f service nova] Creating event network-vif-plugged:441f86b3-888a-4eb4-92f9-c281400ace7f for instance ead6584e-26a9-4923-b58e-305731b6f73b on nch2-master-1 Oct 22 21:04:38.369173 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-8c43b438-b3dc-407a-a6fb-0000f5da8c30 req-61db081d-5f92-4fe9-8b31-bf8aff249c6f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107727 Oct 22 21:04:38.373767 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1656/3243] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:04:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:04:38.619451 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-f0a165df-e44c-4fa6-afed-4f52d4c7c8c7 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:04:38.620492 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-f0a165df-e44c-4fa6-afed-4f52d4c7c8c7 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] [instance: f38f14b2-b9d7-4bed-92ba-7b95ea4b2270] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:04:38.632827 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell0:SELECT=14 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:04:38.637488 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f0a165df-e44c-4fa6-afed-4f52d4c7c8c7 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:38.638002 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f0a165df-e44c-4fa6-afed-4f52d4c7c8c7 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:38.639430 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f0a165df-e44c-4fa6-afed-4f52d4c7c8c7 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:38.642602 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f0a165df-e44c-4fa6-afed-4f52d4c7c8c7 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:38.643215 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f0a165df-e44c-4fa6-afed-4f52d4c7c8c7 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:38.643939 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f0a165df-e44c-4fa6-afed-4f52d4c7c8c7 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:40.309935 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-8082c4e5-ad7e-45be-a5be-540fa129feb6 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879c85830a9f42088a4ebdf1e3cfb39b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b54f56cfbc814cccb533c65966f35a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:04:40.334854 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-8082c4e5-ad7e-45be-a5be-540fa129feb6 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] 10.222.0.18 "GET /compute/v2.1/servers/87b07efc-fa80-40ad-8077-333547ee7301" status: 200 len: 1505 microversion: 2.1 time: 2.023274 Oct 22 21:04:40.338900 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1588/3244] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:04:38 2022] GET /compute/v2.1/servers/87b07efc-fa80-40ad-8077-333547ee7301 => generated 1505 bytes in 2029 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:04:40.364943 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-5108bf27-9c53-47b6-a56a-7c389df5339f tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Calling method '.version_select at 0x7fd39eff7160>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:04:40.490430 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-5108bf27-9c53-47b6-a56a-7c389df5339f tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] 10.222.0.18 "GET /compute/v2.1/images/fefdb332-d8c8-4dbc-8b2b-6d54994dca11" status: 200 len: 1414 microversion: 2.1 time: 0.142329 Oct 22 21:04:40.491709 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1589/3245] 10.222.0.18 () {58 vars in 1233 bytes} [Sat Oct 22 21:04:40 2022] GET /compute/v2.1/images/fefdb332-d8c8-4dbc-8b2b-6d54994dca11 => generated 1414 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:04:40.503113 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-fa0eac03-34b6-4a97-b524-17d38924f3ab tempest-VolumesNegativeTest-1146767104 tempest-VolumesNegativeTest-1146767104-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:04:40.503781 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-fa0eac03-34b6-4a97-b524-17d38924f3ab tempest-VolumesNegativeTest-1146767104 tempest-VolumesNegativeTest-1146767104-project] [instance: ead6584e-26a9-4923-b58e-305731b6f73b] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:04:40.527628 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fa0eac03-34b6-4a97-b524-17d38924f3ab tempest-VolumesNegativeTest-1146767104 tempest-VolumesNegativeTest-1146767104-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:40.528123 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fa0eac03-34b6-4a97-b524-17d38924f3ab tempest-VolumesNegativeTest-1146767104 tempest-VolumesNegativeTest-1146767104-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:40.528563 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fa0eac03-34b6-4a97-b524-17d38924f3ab tempest-VolumesNegativeTest-1146767104 tempest-VolumesNegativeTest-1146767104-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:40.529291 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fa0eac03-34b6-4a97-b524-17d38924f3ab tempest-VolumesNegativeTest-1146767104 tempest-VolumesNegativeTest-1146767104-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:40.551748 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fa0eac03-34b6-4a97-b524-17d38924f3ab tempest-VolumesNegativeTest-1146767104 tempest-VolumesNegativeTest-1146767104-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:40.552297 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fa0eac03-34b6-4a97-b524-17d38924f3ab tempest-VolumesNegativeTest-1146767104 tempest-VolumesNegativeTest-1146767104-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:40.931111 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-f0a165df-e44c-4fa6-afed-4f52d4c7c8c7 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211483c6acea4f76b6c0e4bfc818e7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd687d54e07d4ab4af00ad801ef4b58d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:04:40.952709 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-f0a165df-e44c-4fa6-afed-4f52d4c7c8c7 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '211483c6acea4f76b6c0e4bfc818e7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd687d54e07d4ab4af00ad801ef4b58d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:04:40.954643 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-f0a165df-e44c-4fa6-afed-4f52d4c7c8c7 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '211483c6acea4f76b6c0e4bfc818e7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd687d54e07d4ab4af00ad801ef4b58d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:04:40.964702 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-f0a165df-e44c-4fa6-afed-4f52d4c7c8c7 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] 10.222.0.18 "GET /compute/v2.1/servers/f38f14b2-b9d7-4bed-92ba-7b95ea4b2270" status: 200 len: 2345 microversion: 2.42 time: 2.350044 Oct 22 21:04:40.968608 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1657/3246] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:04:38 2022] GET /compute/v2.1/servers/f38f14b2-b9d7-4bed-92ba-7b95ea4b2270 => generated 2345 bytes in 2355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:04:40.982046 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-57c1b6d4-b29d-48b6-9025-fdb70f4b6c07 req-c14f5e34-5636-41cd-bada-fbe47c1d27a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "931293d3-cb3a-4fd1-a684-eb740f010845", "tag": "cbfb6cca-3060-4248-8fe5-5bd4144394eb"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:04:41.005039 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-57c1b6d4-b29d-48b6-9025-fdb70f4b6c07 req-c14f5e34-5636-41cd-bada-fbe47c1d27a8 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:41.005522 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-57c1b6d4-b29d-48b6-9025-fdb70f4b6c07 req-c14f5e34-5636-41cd-bada-fbe47c1d27a8 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:41.005877 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-57c1b6d4-b29d-48b6-9025-fdb70f4b6c07 req-c14f5e34-5636-41cd-bada-fbe47c1d27a8 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:41.025050 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-57c1b6d4-b29d-48b6-9025-fdb70f4b6c07 req-c14f5e34-5636-41cd-bada-fbe47c1d27a8 service nova] Creating event network-changed:cbfb6cca-3060-4248-8fe5-5bd4144394eb for instance 931293d3-cb3a-4fd1-a684-eb740f010845 on nch1-master-1 Oct 22 21:04:41.046432 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-57c1b6d4-b29d-48b6-9025-fdb70f4b6c07 req-c14f5e34-5636-41cd-bada-fbe47c1d27a8 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075794 Oct 22 21:04:41.047565 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1658/3247] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:04:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:04:41.052755 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-4e58bf8b-02a8-4ea0-a7a3-4f3971c25f79 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:04:41.053511 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-4e58bf8b-02a8-4ea0-a7a3-4f3971c25f79 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] [instance: 931293d3-cb3a-4fd1-a684-eb740f010845] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:04:41.071096 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4e58bf8b-02a8-4ea0-a7a3-4f3971c25f79 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:41.071720 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4e58bf8b-02a8-4ea0-a7a3-4f3971c25f79 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:41.072440 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4e58bf8b-02a8-4ea0-a7a3-4f3971c25f79 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:41.073463 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4e58bf8b-02a8-4ea0-a7a3-4f3971c25f79 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:41.074089 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4e58bf8b-02a8-4ea0-a7a3-4f3971c25f79 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:41.074892 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4e58bf8b-02a8-4ea0-a7a3-4f3971c25f79 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:41.430880 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-fa0eac03-34b6-4a97-b524-17d38924f3ab tempest-VolumesNegativeTest-1146767104 tempest-VolumesNegativeTest-1146767104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89246f6315ac429c94630afb36be5253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba7e19328594eae9e7d6a7c6e9c2147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:04:41.445956 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-fa0eac03-34b6-4a97-b524-17d38924f3ab tempest-VolumesNegativeTest-1146767104 tempest-VolumesNegativeTest-1146767104-project] 10.222.0.18 "GET /compute/v2.1/servers/ead6584e-26a9-4923-b58e-305731b6f73b" status: 200 len: 1314 microversion: 2.1 time: 0.952701 Oct 22 21:04:41.446577 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1590/3248] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:04:40 2022] GET /compute/v2.1/servers/ead6584e-26a9-4923-b58e-305731b6f73b => generated 1314 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:04:41.470804 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-325c19be-00a6-462e-8d5e-8024ebc0f19b tempest-ServerAddressesTestJSON-849573313 tempest-ServerAddressesTestJSON-849573313-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:04:41.471552 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-325c19be-00a6-462e-8d5e-8024ebc0f19b tempest-ServerAddressesTestJSON-849573313 tempest-ServerAddressesTestJSON-849573313-project] [instance: 492fde48-2dc2-448f-8d33-fdac96a6bb33] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:04:41.495263 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-325c19be-00a6-462e-8d5e-8024ebc0f19b tempest-ServerAddressesTestJSON-849573313 tempest-ServerAddressesTestJSON-849573313-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:41.499566 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-325c19be-00a6-462e-8d5e-8024ebc0f19b tempest-ServerAddressesTestJSON-849573313 tempest-ServerAddressesTestJSON-849573313-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:41.500039 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-325c19be-00a6-462e-8d5e-8024ebc0f19b tempest-ServerAddressesTestJSON-849573313 tempest-ServerAddressesTestJSON-849573313-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:41.501858 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-325c19be-00a6-462e-8d5e-8024ebc0f19b tempest-ServerAddressesTestJSON-849573313 tempest-ServerAddressesTestJSON-849573313-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:41.502359 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-325c19be-00a6-462e-8d5e-8024ebc0f19b tempest-ServerAddressesTestJSON-849573313 tempest-ServerAddressesTestJSON-849573313-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:41.502883 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-325c19be-00a6-462e-8d5e-8024ebc0f19b tempest-ServerAddressesTestJSON-849573313 tempest-ServerAddressesTestJSON-849573313-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:42.042994 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-325c19be-00a6-462e-8d5e-8024ebc0f19b tempest-ServerAddressesTestJSON-849573313 tempest-ServerAddressesTestJSON-849573313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703cd05e0f824241bed1565a3a6a7ff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62cda3990bbe4c36a7240c9df581ff62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:04:42.055549 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-4e58bf8b-02a8-4ea0-a7a3-4f3971c25f79 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1b410a64e0415a96d30f5040361137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd7873d6db4e09bc9ab9a048a6b1ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:04:42.084734 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-4e58bf8b-02a8-4ea0-a7a3-4f3971c25f79 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] 10.222.0.18 "GET /compute/v2.1/servers/931293d3-cb3a-4fd1-a684-eb740f010845" status: 200 len: 1313 microversion: 2.1 time: 1.035802 Oct 22 21:04:42.086753 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-325c19be-00a6-462e-8d5e-8024ebc0f19b tempest-ServerAddressesTestJSON-849573313 tempest-ServerAddressesTestJSON-849573313-project] 10.222.0.18 "GET /compute/v2.1/servers/492fde48-2dc2-448f-8d33-fdac96a6bb33" status: 200 len: 1316 microversion: 2.1 time: 0.635647 Oct 22 21:04:42.105952 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1659/3249] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:04:41 2022] GET /compute/v2.1/servers/931293d3-cb3a-4fd1-a684-eb740f010845 => generated 1313 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:04:42.107200 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1591/3250] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:04:41 2022] GET /compute/v2.1/servers/492fde48-2dc2-448f-8d33-fdac96a6bb33 => generated 1316 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:04:42.123560 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-e8388e14-b5fa-42f2-a61c-1b0302a3c0cc tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:04:42.125457 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-e8388e14-b5fa-42f2-a61c-1b0302a3c0cc tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] [instance: 87b07efc-fa80-40ad-8077-333547ee7301] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:04:42.131938 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-fd6d2670-0d5f-4e83-a10c-ca751bf7daa4 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Calling method '.version_select at 0x7fd3a8a061f0>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:04:42.153223 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e8388e14-b5fa-42f2-a61c-1b0302a3c0cc tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:42.157649 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e8388e14-b5fa-42f2-a61c-1b0302a3c0cc tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:42.161460 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e8388e14-b5fa-42f2-a61c-1b0302a3c0cc tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:42.163052 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e8388e14-b5fa-42f2-a61c-1b0302a3c0cc tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:42.167425 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e8388e14-b5fa-42f2-a61c-1b0302a3c0cc tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:42.168489 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e8388e14-b5fa-42f2-a61c-1b0302a3c0cc tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:42.243775 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-fd6d2670-0d5f-4e83-a10c-ca751bf7daa4 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] 10.222.0.18 "GET /compute/v2.1/images/fefdb332-d8c8-4dbc-8b2b-6d54994dca11" status: 200 len: 1414 microversion: 2.1 time: 0.134923 Oct 22 21:04:42.246890 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1592/3251] 10.222.0.18 () {58 vars in 1233 bytes} [Sat Oct 22 21:04:42 2022] GET /compute/v2.1/images/fefdb332-d8c8-4dbc-8b2b-6d54994dca11 => generated 1414 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:04:42.270942 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-c5c48fa1-e4d6-437b-8747-8fd80c831944 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:04:42.272070 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-c5c48fa1-e4d6-437b-8747-8fd80c831944 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] [instance: f38f14b2-b9d7-4bed-92ba-7b95ea4b2270] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:04:42.309945 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c5c48fa1-e4d6-437b-8747-8fd80c831944 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:42.310715 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c5c48fa1-e4d6-437b-8747-8fd80c831944 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:42.313016 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c5c48fa1-e4d6-437b-8747-8fd80c831944 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:42.314149 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c5c48fa1-e4d6-437b-8747-8fd80c831944 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:42.317689 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c5c48fa1-e4d6-437b-8747-8fd80c831944 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:42.320312 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c5c48fa1-e4d6-437b-8747-8fd80c831944 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:42.737423 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-e8388e14-b5fa-42f2-a61c-1b0302a3c0cc tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879c85830a9f42088a4ebdf1e3cfb39b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b54f56cfbc814cccb533c65966f35a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:04:42.754281 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-e8388e14-b5fa-42f2-a61c-1b0302a3c0cc tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] 10.222.0.18 "GET /compute/v2.1/servers/87b07efc-fa80-40ad-8077-333547ee7301" status: 200 len: 1505 microversion: 2.1 time: 0.646825 Oct 22 21:04:42.755189 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1660/3252] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:04:42 2022] GET /compute/v2.1/servers/87b07efc-fa80-40ad-8077-333547ee7301 => generated 1505 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:04:42.760497 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-a3ca84ca-c31c-4cd1-a68b-a0a4a42e4bd4 tempest-VolumesNegativeTest-1146767104 tempest-VolumesNegativeTest-1146767104-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:04:42.764821 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-a3ca84ca-c31c-4cd1-a68b-a0a4a42e4bd4 tempest-VolumesNegativeTest-1146767104 tempest-VolumesNegativeTest-1146767104-project] [instance: ead6584e-26a9-4923-b58e-305731b6f73b] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:04:42.780303 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a3ca84ca-c31c-4cd1-a68b-a0a4a42e4bd4 tempest-VolumesNegativeTest-1146767104 tempest-VolumesNegativeTest-1146767104-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:42.780696 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a3ca84ca-c31c-4cd1-a68b-a0a4a42e4bd4 tempest-VolumesNegativeTest-1146767104 tempest-VolumesNegativeTest-1146767104-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:42.781264 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a3ca84ca-c31c-4cd1-a68b-a0a4a42e4bd4 tempest-VolumesNegativeTest-1146767104 tempest-VolumesNegativeTest-1146767104-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:42.788372 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a3ca84ca-c31c-4cd1-a68b-a0a4a42e4bd4 tempest-VolumesNegativeTest-1146767104 tempest-VolumesNegativeTest-1146767104-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:42.789043 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a3ca84ca-c31c-4cd1-a68b-a0a4a42e4bd4 tempest-VolumesNegativeTest-1146767104 tempest-VolumesNegativeTest-1146767104-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:42.789621 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a3ca84ca-c31c-4cd1-a68b-a0a4a42e4bd4 tempest-VolumesNegativeTest-1146767104 tempest-VolumesNegativeTest-1146767104-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:42.854506 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-c5c48fa1-e4d6-437b-8747-8fd80c831944 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211483c6acea4f76b6c0e4bfc818e7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd687d54e07d4ab4af00ad801ef4b58d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:04:42.878907 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-c5c48fa1-e4d6-437b-8747-8fd80c831944 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '211483c6acea4f76b6c0e4bfc818e7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd687d54e07d4ab4af00ad801ef4b58d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:04:42.885246 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-c5c48fa1-e4d6-437b-8747-8fd80c831944 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '211483c6acea4f76b6c0e4bfc818e7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd687d54e07d4ab4af00ad801ef4b58d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:04:42.889734 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-c5c48fa1-e4d6-437b-8747-8fd80c831944 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] 10.222.0.18 "GET /compute/v2.1/servers/f38f14b2-b9d7-4bed-92ba-7b95ea4b2270" status: 200 len: 2345 microversion: 2.42 time: 0.641340 Oct 22 21:04:42.893577 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1593/3253] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:04:42 2022] GET /compute/v2.1/servers/f38f14b2-b9d7-4bed-92ba-7b95ea4b2270 => generated 2345 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:04:43.159048 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-a3ca84ca-c31c-4cd1-a68b-a0a4a42e4bd4 tempest-VolumesNegativeTest-1146767104 tempest-VolumesNegativeTest-1146767104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89246f6315ac429c94630afb36be5253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba7e19328594eae9e7d6a7c6e9c2147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:04:43.161374 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-575396b8-760f-4c8f-bff7-b1c8136d5177 tempest-ServicesAdminNegativeTestJSON-1458692344 tempest-ServicesAdminNegativeTestJSON-1458692344-project-admin] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:04:43.166103 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-575396b8-760f-4c8f-bff7-b1c8136d5177 tempest-ServicesAdminNegativeTestJSON-1458692344 tempest-ServicesAdminNegativeTestJSON-1458692344-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:43.169565 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-575396b8-760f-4c8f-bff7-b1c8136d5177 tempest-ServicesAdminNegativeTestJSON-1458692344 tempest-ServicesAdminNegativeTestJSON-1458692344-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:43.170146 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-575396b8-760f-4c8f-bff7-b1c8136d5177 tempest-ServicesAdminNegativeTestJSON-1458692344 tempest-ServicesAdminNegativeTestJSON-1458692344-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:43.171199 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-575396b8-760f-4c8f-bff7-b1c8136d5177 tempest-ServicesAdminNegativeTestJSON-1458692344 tempest-ServicesAdminNegativeTestJSON-1458692344-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:43.173325 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-575396b8-760f-4c8f-bff7-b1c8136d5177 tempest-ServicesAdminNegativeTestJSON-1458692344 tempest-ServicesAdminNegativeTestJSON-1458692344-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:43.174149 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-575396b8-760f-4c8f-bff7-b1c8136d5177 tempest-ServicesAdminNegativeTestJSON-1458692344 tempest-ServicesAdminNegativeTestJSON-1458692344-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:43.179682 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-a3ca84ca-c31c-4cd1-a68b-a0a4a42e4bd4 tempest-VolumesNegativeTest-1146767104 tempest-VolumesNegativeTest-1146767104-project] 10.222.0.18 "GET /compute/v2.1/servers/ead6584e-26a9-4923-b58e-305731b6f73b" status: 200 len: 1464 microversion: 2.1 time: 0.421026 Oct 22 21:04:43.180152 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1661/3254] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:04:42 2022] GET /compute/v2.1/servers/ead6584e-26a9-4923-b58e-305731b6f73b => generated 1464 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:04:43.196736 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-1eaedd98-de56-4a03-a725-ff4fb2913b6f req-b32c9c60-fdec-4bdf-9b07-1910b7c0234d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f38f14b2-b9d7-4bed-92ba-7b95ea4b2270", "name": "network-vif-deleted", "tag": "e8b58979-b36e-4d6b-8fde-739fbeb99ab8"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:04:43.227990 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-1eaedd98-de56-4a03-a725-ff4fb2913b6f req-b32c9c60-fdec-4bdf-9b07-1910b7c0234d service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:43.231249 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-1eaedd98-de56-4a03-a725-ff4fb2913b6f req-b32c9c60-fdec-4bdf-9b07-1910b7c0234d service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:43.231829 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-1eaedd98-de56-4a03-a725-ff4fb2913b6f req-b32c9c60-fdec-4bdf-9b07-1910b7c0234d service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:43.264792 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-575396b8-760f-4c8f-bff7-b1c8136d5177 tempest-ServicesAdminNegativeTestJSON-1458692344 tempest-ServicesAdminNegativeTestJSON-1458692344-project-admin] 10.222.0.18 "GET /compute/v2.1/os-services" status: 200 len: 947 microversion: 2.1 time: 0.369180 Oct 22 21:04:43.265651 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1594/3255] 10.222.0.18 () {58 vars in 1137 bytes} [Sat Oct 22 21:04:42 2022] GET /compute/v2.1/os-services => generated 947 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:04:43.271203 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-08edaa91-df66-46b3-8e6b-99239b4563e8 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:04:43.272253 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-08edaa91-df66-46b3-8e6b-99239b4563e8 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] [instance: 931293d3-cb3a-4fd1-a684-eb740f010845] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:04:43.273795 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-1eaedd98-de56-4a03-a725-ff4fb2913b6f req-b32c9c60-fdec-4bdf-9b07-1910b7c0234d service nova] Creating event network-vif-deleted:e8b58979-b36e-4d6b-8fde-739fbeb99ab8 for instance f38f14b2-b9d7-4bed-92ba-7b95ea4b2270 on nch2-master-1 Oct 22 21:04:43.279701 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-1eaedd98-de56-4a03-a725-ff4fb2913b6f req-b32c9c60-fdec-4bdf-9b07-1910b7c0234d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098261 Oct 22 21:04:43.281227 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1662/3256] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:04:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:04:43.281398 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-08edaa91-df66-46b3-8e6b-99239b4563e8 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:43.281919 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-08edaa91-df66-46b3-8e6b-99239b4563e8 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:43.282369 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-08edaa91-df66-46b3-8e6b-99239b4563e8 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:43.283087 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-08edaa91-df66-46b3-8e6b-99239b4563e8 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:43.283564 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-08edaa91-df66-46b3-8e6b-99239b4563e8 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:43.284173 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-08edaa91-df66-46b3-8e6b-99239b4563e8 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:43.291653 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-0e280995-767a-41fd-8fb0-154d2cbe907f tempest-ServerAddressesTestJSON-849573313 tempest-ServerAddressesTestJSON-849573313-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:04:43.301871 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-0e280995-767a-41fd-8fb0-154d2cbe907f tempest-ServerAddressesTestJSON-849573313 tempest-ServerAddressesTestJSON-849573313-project] [instance: 492fde48-2dc2-448f-8d33-fdac96a6bb33] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:04:43.316669 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0e280995-767a-41fd-8fb0-154d2cbe907f tempest-ServerAddressesTestJSON-849573313 tempest-ServerAddressesTestJSON-849573313-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:43.317449 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0e280995-767a-41fd-8fb0-154d2cbe907f tempest-ServerAddressesTestJSON-849573313 tempest-ServerAddressesTestJSON-849573313-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:43.319040 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0e280995-767a-41fd-8fb0-154d2cbe907f tempest-ServerAddressesTestJSON-849573313 tempest-ServerAddressesTestJSON-849573313-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:43.327820 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0e280995-767a-41fd-8fb0-154d2cbe907f tempest-ServerAddressesTestJSON-849573313 tempest-ServerAddressesTestJSON-849573313-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:43.330139 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0e280995-767a-41fd-8fb0-154d2cbe907f tempest-ServerAddressesTestJSON-849573313 tempest-ServerAddressesTestJSON-849573313-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:43.331741 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0e280995-767a-41fd-8fb0-154d2cbe907f tempest-ServerAddressesTestJSON-849573313 tempest-ServerAddressesTestJSON-849573313-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:43.677371 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-08edaa91-df66-46b3-8e6b-99239b4563e8 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1b410a64e0415a96d30f5040361137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd7873d6db4e09bc9ab9a048a6b1ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:04:43.689855 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-08edaa91-df66-46b3-8e6b-99239b4563e8 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] 10.222.0.18 "GET /compute/v2.1/servers/931293d3-cb3a-4fd1-a684-eb740f010845" status: 200 len: 1313 microversion: 2.1 time: 0.422972 Oct 22 21:04:43.694654 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1595/3257] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:04:43 2022] GET /compute/v2.1/servers/931293d3-cb3a-4fd1-a684-eb740f010845 => generated 1313 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:04:43.706517 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-187e580f-1fbc-401c-901d-3369c6e78dda tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Calling method '.version_select at 0x7fd39f00caf0>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:04:43.780147 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-0e280995-767a-41fd-8fb0-154d2cbe907f tempest-ServerAddressesTestJSON-849573313 tempest-ServerAddressesTestJSON-849573313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703cd05e0f824241bed1565a3a6a7ff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62cda3990bbe4c36a7240c9df581ff62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:04:43.786681 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell1:SELECT=100 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:04:43.806019 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-0e280995-767a-41fd-8fb0-154d2cbe907f tempest-ServerAddressesTestJSON-849573313 tempest-ServerAddressesTestJSON-849573313-project] 10.222.0.18 "GET /compute/v2.1/servers/492fde48-2dc2-448f-8d33-fdac96a6bb33" status: 200 len: 1316 microversion: 2.1 time: 0.522558 Oct 22 21:04:43.819730 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1663/3258] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:04:43 2022] GET /compute/v2.1/servers/492fde48-2dc2-448f-8d33-fdac96a6bb33 => generated 1316 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:04:43.820054 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-187e580f-1fbc-401c-901d-3369c6e78dda tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] 10.222.0.18 "GET /compute/v2.1/images/fefdb332-d8c8-4dbc-8b2b-6d54994dca11" status: 200 len: 1414 microversion: 2.1 time: 0.116887 Oct 22 21:04:43.820054 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1596/3259] 10.222.0.18 () {58 vars in 1233 bytes} [Sat Oct 22 21:04:43 2022] GET /compute/v2.1/images/fefdb332-d8c8-4dbc-8b2b-6d54994dca11 => generated 1414 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:04:43.820397 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-edb96603-b00e-41a0-ad37-876a11ede2ea tempest-VolumesNegativeTest-1146767104 tempest-VolumesNegativeTest-1146767104-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:04:43.826950 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-1dfc081f-126b-4ca9-905d-94fdec811db9 tempest-ServicesAdminNegativeTestJSON-1458692344 tempest-ServicesAdminNegativeTestJSON-1458692344-project-admin] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:04:43.827259 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-edb96603-b00e-41a0-ad37-876a11ede2ea tempest-VolumesNegativeTest-1146767104 tempest-VolumesNegativeTest-1146767104-project] [instance: ead6584e-26a9-4923-b58e-305731b6f73b] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:04:43.835496 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1dfc081f-126b-4ca9-905d-94fdec811db9 tempest-ServicesAdminNegativeTestJSON-1458692344 tempest-ServicesAdminNegativeTestJSON-1458692344-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:43.836008 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1dfc081f-126b-4ca9-905d-94fdec811db9 tempest-ServicesAdminNegativeTestJSON-1458692344 tempest-ServicesAdminNegativeTestJSON-1458692344-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:43.836465 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1dfc081f-126b-4ca9-905d-94fdec811db9 tempest-ServicesAdminNegativeTestJSON-1458692344 tempest-ServicesAdminNegativeTestJSON-1458692344-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:43.837237 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1dfc081f-126b-4ca9-905d-94fdec811db9 tempest-ServicesAdminNegativeTestJSON-1458692344 tempest-ServicesAdminNegativeTestJSON-1458692344-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:43.843694 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1dfc081f-126b-4ca9-905d-94fdec811db9 tempest-ServicesAdminNegativeTestJSON-1458692344 tempest-ServicesAdminNegativeTestJSON-1458692344-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:43.844441 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1dfc081f-126b-4ca9-905d-94fdec811db9 tempest-ServicesAdminNegativeTestJSON-1458692344 tempest-ServicesAdminNegativeTestJSON-1458692344-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:43.866114 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-edb96603-b00e-41a0-ad37-876a11ede2ea tempest-VolumesNegativeTest-1146767104 tempest-VolumesNegativeTest-1146767104-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:43.866614 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-edb96603-b00e-41a0-ad37-876a11ede2ea tempest-VolumesNegativeTest-1146767104 tempest-VolumesNegativeTest-1146767104-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:43.873178 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-edb96603-b00e-41a0-ad37-876a11ede2ea tempest-VolumesNegativeTest-1146767104 tempest-VolumesNegativeTest-1146767104-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:43.876303 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-edb96603-b00e-41a0-ad37-876a11ede2ea tempest-VolumesNegativeTest-1146767104 tempest-VolumesNegativeTest-1146767104-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:43.877000 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-edb96603-b00e-41a0-ad37-876a11ede2ea tempest-VolumesNegativeTest-1146767104 tempest-VolumesNegativeTest-1146767104-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:43.877857 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-edb96603-b00e-41a0-ad37-876a11ede2ea tempest-VolumesNegativeTest-1146767104 tempest-VolumesNegativeTest-1146767104-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:43.901306 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-1dfc081f-126b-4ca9-905d-94fdec811db9 tempest-ServicesAdminNegativeTestJSON-1458692344 tempest-ServicesAdminNegativeTestJSON-1458692344-project-admin] 10.222.0.18 "GET /compute/v2.1/os-services" status: 200 len: 947 microversion: 2.1 time: 0.080221 Oct 22 21:04:43.902957 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1597/3260] 10.222.0.18 () {58 vars in 1170 bytes} [Sat Oct 22 21:04:43 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 947 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:04:43.910861 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-5d8f34a4-1627-4e78-b7ac-ba93946e8fa2 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:04:43.912040 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-5d8f34a4-1627-4e78-b7ac-ba93946e8fa2 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] [instance: 87b07efc-fa80-40ad-8077-333547ee7301] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:04:43.936356 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5d8f34a4-1627-4e78-b7ac-ba93946e8fa2 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:43.938431 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5d8f34a4-1627-4e78-b7ac-ba93946e8fa2 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:43.939020 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5d8f34a4-1627-4e78-b7ac-ba93946e8fa2 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:43.942601 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5d8f34a4-1627-4e78-b7ac-ba93946e8fa2 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:43.943300 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5d8f34a4-1627-4e78-b7ac-ba93946e8fa2 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:43.947994 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5d8f34a4-1627-4e78-b7ac-ba93946e8fa2 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:43.980754 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-edb96603-b00e-41a0-ad37-876a11ede2ea tempest-VolumesNegativeTest-1146767104 tempest-VolumesNegativeTest-1146767104-project] [instance: ead6584e-26a9-4923-b58e-305731b6f73b] Going to try to terminate instance {{(pid=138745) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 21:04:44.269847 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-edb96603-b00e-41a0-ad37-876a11ede2ea tempest-VolumesNegativeTest-1146767104 tempest-VolumesNegativeTest-1146767104-project] 10.222.0.18 "DELETE /compute/v2.1/servers/ead6584e-26a9-4923-b58e-305731b6f73b" status: 204 len: 0 microversion: 2.1 time: 0.454922 Oct 22 21:04:44.275495 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1664/3261] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 21:04:43 2022] DELETE /compute/v2.1/servers/ead6584e-26a9-4923-b58e-305731b6f73b => generated 0 bytes in 463 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 21:04:44.303306 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-3fd4d7ea-a665-49b8-926f-16afd4f3fe82 tempest-ServicesAdminNegativeTestJSON-1458692344 tempest-ServicesAdminNegativeTestJSON-1458692344-project-admin] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:04:44.313665 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3fd4d7ea-a665-49b8-926f-16afd4f3fe82 tempest-ServicesAdminNegativeTestJSON-1458692344 tempest-ServicesAdminNegativeTestJSON-1458692344-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:44.321277 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3fd4d7ea-a665-49b8-926f-16afd4f3fe82 tempest-ServicesAdminNegativeTestJSON-1458692344 tempest-ServicesAdminNegativeTestJSON-1458692344-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:44.323058 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3fd4d7ea-a665-49b8-926f-16afd4f3fe82 tempest-ServicesAdminNegativeTestJSON-1458692344 tempest-ServicesAdminNegativeTestJSON-1458692344-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:44.324002 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3fd4d7ea-a665-49b8-926f-16afd4f3fe82 tempest-ServicesAdminNegativeTestJSON-1458692344 tempest-ServicesAdminNegativeTestJSON-1458692344-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:44.326780 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3fd4d7ea-a665-49b8-926f-16afd4f3fe82 tempest-ServicesAdminNegativeTestJSON-1458692344 tempest-ServicesAdminNegativeTestJSON-1458692344-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:44.327294 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3fd4d7ea-a665-49b8-926f-16afd4f3fe82 tempest-ServicesAdminNegativeTestJSON-1458692344 tempest-ServicesAdminNegativeTestJSON-1458692344-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:44.392739 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-3fd4d7ea-a665-49b8-926f-16afd4f3fe82 tempest-ServicesAdminNegativeTestJSON-1458692344 tempest-ServicesAdminNegativeTestJSON-1458692344-project-admin] 10.222.0.18 "GET /compute/v2.1/os-services" status: 200 len: 947 microversion: 2.1 time: 0.112066 Oct 22 21:04:44.403279 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1665/3262] 10.222.0.18 () {58 vars in 1137 bytes} [Sat Oct 22 21:04:44 2022] GET /compute/v2.1/os-services => generated 947 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:04:44.405232 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-5d8f34a4-1627-4e78-b7ac-ba93946e8fa2 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879c85830a9f42088a4ebdf1e3cfb39b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b54f56cfbc814cccb533c65966f35a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:04:44.410450 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-51e9965d-b624-497b-b2e8-e850f683ce08 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:04:44.411625 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-51e9965d-b624-497b-b2e8-e850f683ce08 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] [instance: f38f14b2-b9d7-4bed-92ba-7b95ea4b2270] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:04:44.418158 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-5d8f34a4-1627-4e78-b7ac-ba93946e8fa2 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] 10.222.0.18 "GET /compute/v2.1/servers/87b07efc-fa80-40ad-8077-333547ee7301" status: 200 len: 1505 microversion: 2.1 time: 0.512321 Oct 22 21:04:44.423707 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1598/3263] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:04:43 2022] GET /compute/v2.1/servers/87b07efc-fa80-40ad-8077-333547ee7301 => generated 1505 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:04:44.428850 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-51e9965d-b624-497b-b2e8-e850f683ce08 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:44.429367 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-51e9965d-b624-497b-b2e8-e850f683ce08 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:44.429921 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-51e9965d-b624-497b-b2e8-e850f683ce08 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:44.430529 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-51e9965d-b624-497b-b2e8-e850f683ce08 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:44.430991 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-51e9965d-b624-497b-b2e8-e850f683ce08 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:44.438490 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-51e9965d-b624-497b-b2e8-e850f683ce08 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:44.440231 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-a2797864-e001-4cc0-a37f-971f4c1ce656 tempest-VolumesNegativeTest-1146767104 tempest-VolumesNegativeTest-1146767104-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:04:44.441792 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-a2797864-e001-4cc0-a37f-971f4c1ce656 tempest-VolumesNegativeTest-1146767104 tempest-VolumesNegativeTest-1146767104-project] [instance: ead6584e-26a9-4923-b58e-305731b6f73b] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:04:44.461299 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a2797864-e001-4cc0-a37f-971f4c1ce656 tempest-VolumesNegativeTest-1146767104 tempest-VolumesNegativeTest-1146767104-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:44.464432 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a2797864-e001-4cc0-a37f-971f4c1ce656 tempest-VolumesNegativeTest-1146767104 tempest-VolumesNegativeTest-1146767104-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:44.464884 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a2797864-e001-4cc0-a37f-971f4c1ce656 tempest-VolumesNegativeTest-1146767104 tempest-VolumesNegativeTest-1146767104-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:44.465647 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a2797864-e001-4cc0-a37f-971f4c1ce656 tempest-VolumesNegativeTest-1146767104 tempest-VolumesNegativeTest-1146767104-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:44.469090 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a2797864-e001-4cc0-a37f-971f4c1ce656 tempest-VolumesNegativeTest-1146767104 tempest-VolumesNegativeTest-1146767104-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:44.469585 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a2797864-e001-4cc0-a37f-971f4c1ce656 tempest-VolumesNegativeTest-1146767104 tempest-VolumesNegativeTest-1146767104-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:44.534025 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-51e9965d-b624-497b-b2e8-e850f683ce08 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211483c6acea4f76b6c0e4bfc818e7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd687d54e07d4ab4af00ad801ef4b58d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:04:44.548387 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-51e9965d-b624-497b-b2e8-e850f683ce08 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '211483c6acea4f76b6c0e4bfc818e7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd687d54e07d4ab4af00ad801ef4b58d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:04:44.551287 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-51e9965d-b624-497b-b2e8-e850f683ce08 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '211483c6acea4f76b6c0e4bfc818e7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd687d54e07d4ab4af00ad801ef4b58d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:04:44.552975 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-51e9965d-b624-497b-b2e8-e850f683ce08 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] 10.222.0.18 "GET /compute/v2.1/servers/f38f14b2-b9d7-4bed-92ba-7b95ea4b2270" status: 200 len: 1604 microversion: 2.42 time: 0.148008 Oct 22 21:04:44.554296 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1666/3264] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:04:44 2022] GET /compute/v2.1/servers/f38f14b2-b9d7-4bed-92ba-7b95ea4b2270 => generated 1604 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:04:44.560511 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-e01b1c58-efab-4a70-b417-eb3ad6da9806 req-83b51580-5024-4d97-922c-050a3b1ffb52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "492fde48-2dc2-448f-8d33-fdac96a6bb33", "name": "network-vif-plugged", "status": "completed", "tag": "1d6f49d3-65fb-4151-aee6-cd415fd5f899"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:04:44.572978 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-e01b1c58-efab-4a70-b417-eb3ad6da9806 req-83b51580-5024-4d97-922c-050a3b1ffb52 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:44.573620 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-e01b1c58-efab-4a70-b417-eb3ad6da9806 req-83b51580-5024-4d97-922c-050a3b1ffb52 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:44.574169 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-e01b1c58-efab-4a70-b417-eb3ad6da9806 req-83b51580-5024-4d97-922c-050a3b1ffb52 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:44.589183 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-e01b1c58-efab-4a70-b417-eb3ad6da9806 req-83b51580-5024-4d97-922c-050a3b1ffb52 service nova] Creating event network-vif-plugged:1d6f49d3-65fb-4151-aee6-cd415fd5f899 for instance 492fde48-2dc2-448f-8d33-fdac96a6bb33 on nch1-master-1 Oct 22 21:04:44.596218 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-e01b1c58-efab-4a70-b417-eb3ad6da9806 req-83b51580-5024-4d97-922c-050a3b1ffb52 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039757 Oct 22 21:04:44.597841 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1667/3265] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:04:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:04:44.604547 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-7e6bbebb-04d6-4252-acef-d055d7c80d1d tempest-ServicesAdminNegativeTestJSON-1458692344 tempest-ServicesAdminNegativeTestJSON-1458692344-project-admin] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:04:44.624397 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7e6bbebb-04d6-4252-acef-d055d7c80d1d tempest-ServicesAdminNegativeTestJSON-1458692344 tempest-ServicesAdminNegativeTestJSON-1458692344-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:44.625366 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7e6bbebb-04d6-4252-acef-d055d7c80d1d tempest-ServicesAdminNegativeTestJSON-1458692344 tempest-ServicesAdminNegativeTestJSON-1458692344-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:44.626847 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7e6bbebb-04d6-4252-acef-d055d7c80d1d tempest-ServicesAdminNegativeTestJSON-1458692344 tempest-ServicesAdminNegativeTestJSON-1458692344-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:44.628271 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7e6bbebb-04d6-4252-acef-d055d7c80d1d tempest-ServicesAdminNegativeTestJSON-1458692344 tempest-ServicesAdminNegativeTestJSON-1458692344-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:44.629354 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7e6bbebb-04d6-4252-acef-d055d7c80d1d tempest-ServicesAdminNegativeTestJSON-1458692344 tempest-ServicesAdminNegativeTestJSON-1458692344-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:44.630807 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7e6bbebb-04d6-4252-acef-d055d7c80d1d tempest-ServicesAdminNegativeTestJSON-1458692344 tempest-ServicesAdminNegativeTestJSON-1458692344-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:44.703946 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-7e6bbebb-04d6-4252-acef-d055d7c80d1d tempest-ServicesAdminNegativeTestJSON-1458692344 tempest-ServicesAdminNegativeTestJSON-1458692344-project-admin] 10.222.0.18 "GET /compute/v2.1/os-services?host=ncdv-master-1&binary=xxx" status: 200 len: 16 microversion: 2.1 time: 0.104582 Oct 22 21:04:44.705278 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1668/3266] 10.222.0.18 () {58 vars in 1196 bytes} [Sat Oct 22 21:04:44 2022] GET /compute/v2.1/os-services?host=ncdv-master-1&binary=xxx => generated 16 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 22 21:04:44.723773 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-8eb432b7-1d69-4d1f-9f6a-46feea812bd1 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:04:44.728543 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-8eb432b7-1d69-4d1f-9f6a-46feea812bd1 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] [instance: 931293d3-cb3a-4fd1-a684-eb740f010845] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:04:44.739593 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8eb432b7-1d69-4d1f-9f6a-46feea812bd1 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:44.743390 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8eb432b7-1d69-4d1f-9f6a-46feea812bd1 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:44.745735 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8eb432b7-1d69-4d1f-9f6a-46feea812bd1 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:44.746886 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8eb432b7-1d69-4d1f-9f6a-46feea812bd1 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:44.747625 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8eb432b7-1d69-4d1f-9f6a-46feea812bd1 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:44.748492 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8eb432b7-1d69-4d1f-9f6a-46feea812bd1 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:44.804532 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-a2797864-e001-4cc0-a37f-971f4c1ce656 tempest-VolumesNegativeTest-1146767104 tempest-VolumesNegativeTest-1146767104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89246f6315ac429c94630afb36be5253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba7e19328594eae9e7d6a7c6e9c2147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:04:44.812969 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-a2797864-e001-4cc0-a37f-971f4c1ce656 tempest-VolumesNegativeTest-1146767104 tempest-VolumesNegativeTest-1146767104-project] 10.222.0.18 "GET /compute/v2.1/servers/ead6584e-26a9-4923-b58e-305731b6f73b" status: 200 len: 1470 microversion: 2.1 time: 0.387842 Oct 22 21:04:44.825211 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1599/3267] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:04:44 2022] GET /compute/v2.1/servers/ead6584e-26a9-4923-b58e-305731b6f73b => generated 1470 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:04:44.833076 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-6e091f29-95fc-4b85-a865-768d2a0a230f tempest-ServicesAdminNegativeTestJSON-1458692344 tempest-ServicesAdminNegativeTestJSON-1458692344-project-admin] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:04:44.849073 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6e091f29-95fc-4b85-a865-768d2a0a230f tempest-ServicesAdminNegativeTestJSON-1458692344 tempest-ServicesAdminNegativeTestJSON-1458692344-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:44.849574 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6e091f29-95fc-4b85-a865-768d2a0a230f tempest-ServicesAdminNegativeTestJSON-1458692344 tempest-ServicesAdminNegativeTestJSON-1458692344-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:44.850091 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6e091f29-95fc-4b85-a865-768d2a0a230f tempest-ServicesAdminNegativeTestJSON-1458692344 tempest-ServicesAdminNegativeTestJSON-1458692344-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:44.851189 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6e091f29-95fc-4b85-a865-768d2a0a230f tempest-ServicesAdminNegativeTestJSON-1458692344 tempest-ServicesAdminNegativeTestJSON-1458692344-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:44.851687 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6e091f29-95fc-4b85-a865-768d2a0a230f tempest-ServicesAdminNegativeTestJSON-1458692344 tempest-ServicesAdminNegativeTestJSON-1458692344-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:44.852118 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6e091f29-95fc-4b85-a865-768d2a0a230f tempest-ServicesAdminNegativeTestJSON-1458692344 tempest-ServicesAdminNegativeTestJSON-1458692344-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:44.937523 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:04:44.956983 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-6e091f29-95fc-4b85-a865-768d2a0a230f tempest-ServicesAdminNegativeTestJSON-1458692344 tempest-ServicesAdminNegativeTestJSON-1458692344-project-admin] 10.222.0.18 "GET /compute/v2.1/os-services" status: 200 len: 947 microversion: 2.1 time: 0.130147 Oct 22 21:04:44.972611 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1600/3268] 10.222.0.18 () {58 vars in 1137 bytes} [Sat Oct 22 21:04:44 2022] GET /compute/v2.1/os-services => generated 947 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:04:44.993897 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-75e03162-6bdc-4d69-ad62-1498afb1103a tempest-ServerAddressesTestJSON-849573313 tempest-ServerAddressesTestJSON-849573313-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:04:44.998868 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-75e03162-6bdc-4d69-ad62-1498afb1103a tempest-ServerAddressesTestJSON-849573313 tempest-ServerAddressesTestJSON-849573313-project] [instance: 492fde48-2dc2-448f-8d33-fdac96a6bb33] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:04:45.024611 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-75e03162-6bdc-4d69-ad62-1498afb1103a tempest-ServerAddressesTestJSON-849573313 tempest-ServerAddressesTestJSON-849573313-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:45.026334 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-75e03162-6bdc-4d69-ad62-1498afb1103a tempest-ServerAddressesTestJSON-849573313 tempest-ServerAddressesTestJSON-849573313-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:45.027024 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-75e03162-6bdc-4d69-ad62-1498afb1103a tempest-ServerAddressesTestJSON-849573313 tempest-ServerAddressesTestJSON-849573313-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:45.030807 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-75e03162-6bdc-4d69-ad62-1498afb1103a tempest-ServerAddressesTestJSON-849573313 tempest-ServerAddressesTestJSON-849573313-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:45.031588 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-75e03162-6bdc-4d69-ad62-1498afb1103a tempest-ServerAddressesTestJSON-849573313 tempest-ServerAddressesTestJSON-849573313-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:45.033373 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-75e03162-6bdc-4d69-ad62-1498afb1103a tempest-ServerAddressesTestJSON-849573313 tempest-ServerAddressesTestJSON-849573313-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:45.288784 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-8eb432b7-1d69-4d1f-9f6a-46feea812bd1 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1b410a64e0415a96d30f5040361137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd7873d6db4e09bc9ab9a048a6b1ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:04:45.298646 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-8eb432b7-1d69-4d1f-9f6a-46feea812bd1 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] 10.222.0.18 "GET /compute/v2.1/servers/931293d3-cb3a-4fd1-a684-eb740f010845" status: 200 len: 1313 microversion: 2.1 time: 0.579572 Oct 22 21:04:45.299815 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1669/3269] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:04:44 2022] GET /compute/v2.1/servers/931293d3-cb3a-4fd1-a684-eb740f010845 => generated 1313 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:04:45.306525 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-27a7e4f0-c4aa-42a6-b602-0419eba43b00 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Calling method '.version_select at 0x7fd39ee5e310>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:04:45.382756 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-27a7e4f0-c4aa-42a6-b602-0419eba43b00 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] 10.222.0.18 "GET /compute/v2.1/images/fefdb332-d8c8-4dbc-8b2b-6d54994dca11" status: 200 len: 1414 microversion: 2.1 time: 0.081247 Oct 22 21:04:45.383679 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1670/3270] 10.222.0.18 () {58 vars in 1233 bytes} [Sat Oct 22 21:04:45 2022] GET /compute/v2.1/images/fefdb332-d8c8-4dbc-8b2b-6d54994dca11 => generated 1414 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:04:45.392010 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-a25352b0-b3d9-430e-869b-976f3838ae9f tempest-ServicesAdminNegativeTestJSON-1458692344 tempest-ServicesAdminNegativeTestJSON-1458692344-project-admin] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:04:45.410767 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a25352b0-b3d9-430e-869b-976f3838ae9f tempest-ServicesAdminNegativeTestJSON-1458692344 tempest-ServicesAdminNegativeTestJSON-1458692344-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:45.411612 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a25352b0-b3d9-430e-869b-976f3838ae9f tempest-ServicesAdminNegativeTestJSON-1458692344 tempest-ServicesAdminNegativeTestJSON-1458692344-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:45.411775 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a25352b0-b3d9-430e-869b-976f3838ae9f tempest-ServicesAdminNegativeTestJSON-1458692344 tempest-ServicesAdminNegativeTestJSON-1458692344-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:45.412677 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a25352b0-b3d9-430e-869b-976f3838ae9f tempest-ServicesAdminNegativeTestJSON-1458692344 tempest-ServicesAdminNegativeTestJSON-1458692344-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:45.417711 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-75e03162-6bdc-4d69-ad62-1498afb1103a tempest-ServerAddressesTestJSON-849573313 tempest-ServerAddressesTestJSON-849573313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703cd05e0f824241bed1565a3a6a7ff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62cda3990bbe4c36a7240c9df581ff62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:04:45.418711 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a25352b0-b3d9-430e-869b-976f3838ae9f tempest-ServicesAdminNegativeTestJSON-1458692344 tempest-ServicesAdminNegativeTestJSON-1458692344-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:45.419189 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a25352b0-b3d9-430e-869b-976f3838ae9f tempest-ServicesAdminNegativeTestJSON-1458692344 tempest-ServicesAdminNegativeTestJSON-1458692344-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:45.429156 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-75e03162-6bdc-4d69-ad62-1498afb1103a tempest-ServerAddressesTestJSON-849573313 tempest-ServerAddressesTestJSON-849573313-project] 10.222.0.18 "GET /compute/v2.1/servers/492fde48-2dc2-448f-8d33-fdac96a6bb33" status: 200 len: 1316 microversion: 2.1 time: 0.452788 Oct 22 21:04:45.430982 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1601/3271] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:04:44 2022] GET /compute/v2.1/servers/492fde48-2dc2-448f-8d33-fdac96a6bb33 => generated 1316 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:04:45.457677 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-34519d9d-b875-48f5-9ede-ac6091916d7c req-6373ac43-5935-460b-9912-1c1d8f71edcc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f38f14b2-b9d7-4bed-92ba-7b95ea4b2270", "name": "network-vif-deleted", "tag": "d1d48ace-de12-4f4f-9a38-db0a37b136e5"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:04:45.472656 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-34519d9d-b875-48f5-9ede-ac6091916d7c req-6373ac43-5935-460b-9912-1c1d8f71edcc service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:45.473538 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-34519d9d-b875-48f5-9ede-ac6091916d7c req-6373ac43-5935-460b-9912-1c1d8f71edcc service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:45.474828 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-34519d9d-b875-48f5-9ede-ac6091916d7c req-6373ac43-5935-460b-9912-1c1d8f71edcc service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:45.481183 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:SELECT=100 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:04:45.490937 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-34519d9d-b875-48f5-9ede-ac6091916d7c req-6373ac43-5935-460b-9912-1c1d8f71edcc service nova] Creating event network-vif-deleted:d1d48ace-de12-4f4f-9a38-db0a37b136e5 for instance f38f14b2-b9d7-4bed-92ba-7b95ea4b2270 on nch2-master-1 Oct 22 21:04:45.496897 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-34519d9d-b875-48f5-9ede-ac6091916d7c req-6373ac43-5935-460b-9912-1c1d8f71edcc service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064474 Oct 22 21:04:45.497737 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1602/3272] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:04:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:04:45.505313 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-3f60a1f3-06a6-4b9e-8a61-dd2506461264 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:04:45.506223 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-a25352b0-b3d9-430e-869b-976f3838ae9f tempest-ServicesAdminNegativeTestJSON-1458692344 tempest-ServicesAdminNegativeTestJSON-1458692344-project-admin] 10.222.0.18 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.1 time: 0.120727 Oct 22 21:04:45.506488 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-3f60a1f3-06a6-4b9e-8a61-dd2506461264 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] [instance: 87b07efc-fa80-40ad-8077-333547ee7301] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:04:45.507156 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1671/3273] 10.222.0.18 () {58 vars in 1198 bytes} [Sat Oct 22 21:04:45 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 22 21:04:45.513659 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3f60a1f3-06a6-4b9e-8a61-dd2506461264 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:45.515184 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3f60a1f3-06a6-4b9e-8a61-dd2506461264 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:45.515862 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3f60a1f3-06a6-4b9e-8a61-dd2506461264 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:45.516966 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3f60a1f3-06a6-4b9e-8a61-dd2506461264 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:45.517609 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3f60a1f3-06a6-4b9e-8a61-dd2506461264 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:45.518243 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3f60a1f3-06a6-4b9e-8a61-dd2506461264 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:45.805247 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-65d9df52-4a4e-4248-a57f-09a2230bc72f tempest-ServicesAdminNegativeTestJSON-1782298663 tempest-ServicesAdminNegativeTestJSON-1782298663-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:04:45.808871 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-65d9df52-4a4e-4248-a57f-09a2230bc72f tempest-ServicesAdminNegativeTestJSON-1782298663 tempest-ServicesAdminNegativeTestJSON-1782298663-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '5857cc5748fb4cd292537f7ffbcfccc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '383997cc08ca47939e22253b23761c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:04:45.818807 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-65d9df52-4a4e-4248-a57f-09a2230bc72f tempest-ServicesAdminNegativeTestJSON-1782298663 tempest-ServicesAdminNegativeTestJSON-1782298663-project] Request method failure captured: Oct 22 21:04:45.818807 ncdv-master-1 devstack@n-api.service[138745]: request: GET /compute/v2.1/os-services HTTP/1.1 Oct 22 21:04:45.818807 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 21:04:45.818807 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 21:04:45.818807 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 21:04:45.818807 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 0 Oct 22 21:04:45.818807 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 21:04:45.818807 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 21:04:45.818807 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 21:04:45.818807 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 21:04:45.818807 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVFroGDmq0-zVbuh3hvNszuRo-nLXh6SGq8OgvwZ6BY1ICi11DRJEkUUK6gTh_ovXR8QrsWrGh6tBtDk8JKvfCOJUUoaFdBeS5HU1o6HvhHWlW7_ds08emsVCGgu5tPZ-dnvgAYtxebmpk3QA1dQ0FCAGxQggESpG5Rpj4ZsAX3t_FII Oct 22 21:04:45.818807 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 21:04:45.818807 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 21:04:45.818807 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 21:04:45.818807 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 21:04:45.818807 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 21:04:45.818807 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 21:04:45.818807 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: 383997cc08ca47939e22253b23761c8d Oct 22 21:04:45.818807 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-ServicesAdminNegativeTestJSON-1782298663 Oct 22 21:04:45.818807 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 21:04:45.818807 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 21:04:45.818807 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_383997cc08ca47939e22253b23761c8d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/383997cc08ca47939e22253b23761c8d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/383997cc08ca47939e22253b23761c8d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/383997cc08ca47939e22253b23761c8d"}]}] Oct 22 21:04:45.818807 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-ServicesAdminNegativeTestJSON-1782298663 Oct 22 21:04:45.818807 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: 383997cc08ca47939e22253b23761c8d Oct 22 21:04:45.818807 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-ServicesAdminNegativeTestJSON-1782298663 Oct 22 21:04:45.818807 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-ServicesAdminNegativeTestJSON-1782298663-project Oct 22 21:04:45.818807 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 21:04:45.818807 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 21:04:45.818807 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: 5857cc5748fb4cd292537f7ffbcfccc5 Oct 22 21:04:45.818807 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-ServicesAdminNegativeTestJSON-1782298663-project Oct 22 21:04:45.818807 ncdv-master-1 devstack@n-api.service[138745]: method: > Oct 22 21:04:45.818807 ncdv-master-1 devstack@n-api.service[138745]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 22 21:04:45.818807 ncdv-master-1 devstack@n-api.service[138745]: action_args: {} Oct 22 21:04:45.818807 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:04:45.818807 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:04:45.818807 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:04:45.818807 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:04:45.818807 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:04:45.818807 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:04:45.818807 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 22 21:04:45.818807 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 21:04:45.818807 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 22 21:04:45.818807 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 21:04:45.818807 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:04:45.818807 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:04:45.818807 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Oct 22 21:04:45.818807 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Oct 22 21:04:45.818807 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 22 21:04:45.818807 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 22 21:04:45.818807 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 22 21:04:45.818807 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 22 21:04:45.818807 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 22 21:04:45.818807 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 22 21:04:45.818807 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 22 21:04:45.818807 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise self.value Oct 22 21:04:45.818807 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 22 21:04:45.818807 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 22 21:04:45.818807 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 22 21:04:45.818807 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 22 21:04:45.818807 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 22 21:04:45.818807 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 22 21:04:45.818807 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 22 21:04:45.818807 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:04:45.824525 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:04:45.824525 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:04:45.824525 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:04:45.824525 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:04:45.824525 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:04:45.824525 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 22 21:04:45.824525 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 22 21:04:45.824525 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 22 21:04:45.824525 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:04:45.826089 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-65d9df52-4a4e-4248-a57f-09a2230bc72f tempest-ServicesAdminNegativeTestJSON-1782298663 tempest-ServicesAdminNegativeTestJSON-1782298663-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:04:45.828624 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-65d9df52-4a4e-4248-a57f-09a2230bc72f tempest-ServicesAdminNegativeTestJSON-1782298663 tempest-ServicesAdminNegativeTestJSON-1782298663-project] 10.222.0.18 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.1 time: 0.311588 Oct 22 21:04:45.829881 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1672/3274] 10.222.0.18 () {58 vars in 1137 bytes} [Sat Oct 22 21:04:45 2022] GET /compute/v2.1/os-services => generated 112 bytes in 314 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 22 21:04:45.834737 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-7a2fc352-2f1b-4049-b2e5-f4930cc77f9e tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:04:45.835597 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-7a2fc352-2f1b-4049-b2e5-f4930cc77f9e tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] [instance: f38f14b2-b9d7-4bed-92ba-7b95ea4b2270] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:04:45.846015 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7a2fc352-2f1b-4049-b2e5-f4930cc77f9e tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:45.846839 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7a2fc352-2f1b-4049-b2e5-f4930cc77f9e tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:45.847481 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7a2fc352-2f1b-4049-b2e5-f4930cc77f9e tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:45.848363 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7a2fc352-2f1b-4049-b2e5-f4930cc77f9e tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:45.849004 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7a2fc352-2f1b-4049-b2e5-f4930cc77f9e tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:45.849615 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7a2fc352-2f1b-4049-b2e5-f4930cc77f9e tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:45.888469 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-3f60a1f3-06a6-4b9e-8a61-dd2506461264 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879c85830a9f42088a4ebdf1e3cfb39b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b54f56cfbc814cccb533c65966f35a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:04:45.890072 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7a2fc352-2f1b-4049-b2e5-f4930cc77f9e tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:45.890729 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7a2fc352-2f1b-4049-b2e5-f4930cc77f9e tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:45.891372 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7a2fc352-2f1b-4049-b2e5-f4930cc77f9e tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:45.891996 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.objects.instance [None req-7a2fc352-2f1b-4049-b2e5-f4930cc77f9e tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Lazy-loading 'fault' on Instance uuid f38f14b2-b9d7-4bed-92ba-7b95ea4b2270 {{(pid=138745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 21:04:45.901277 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-3f60a1f3-06a6-4b9e-8a61-dd2506461264 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] 10.222.0.18 "GET /compute/v2.1/servers/87b07efc-fa80-40ad-8077-333547ee7301" status: 200 len: 1505 microversion: 2.1 time: 0.401946 Oct 22 21:04:45.916858 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1603/3275] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:04:45 2022] GET /compute/v2.1/servers/87b07efc-fa80-40ad-8077-333547ee7301 => generated 1505 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:04:45.929270 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-e7e474fd-2ce7-43d6-b531-cb1bfb726c37 tempest-VolumesNegativeTest-1146767104 tempest-VolumesNegativeTest-1146767104-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:04:45.936325 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-e7e474fd-2ce7-43d6-b531-cb1bfb726c37 tempest-VolumesNegativeTest-1146767104 tempest-VolumesNegativeTest-1146767104-project] [instance: ead6584e-26a9-4923-b58e-305731b6f73b] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:04:45.948059 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e7e474fd-2ce7-43d6-b531-cb1bfb726c37 tempest-VolumesNegativeTest-1146767104 tempest-VolumesNegativeTest-1146767104-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:45.949473 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e7e474fd-2ce7-43d6-b531-cb1bfb726c37 tempest-VolumesNegativeTest-1146767104 tempest-VolumesNegativeTest-1146767104-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:45.950119 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e7e474fd-2ce7-43d6-b531-cb1bfb726c37 tempest-VolumesNegativeTest-1146767104 tempest-VolumesNegativeTest-1146767104-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:45.951068 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e7e474fd-2ce7-43d6-b531-cb1bfb726c37 tempest-VolumesNegativeTest-1146767104 tempest-VolumesNegativeTest-1146767104-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:45.951752 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e7e474fd-2ce7-43d6-b531-cb1bfb726c37 tempest-VolumesNegativeTest-1146767104 tempest-VolumesNegativeTest-1146767104-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:45.956129 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e7e474fd-2ce7-43d6-b531-cb1bfb726c37 tempest-VolumesNegativeTest-1146767104 tempest-VolumesNegativeTest-1146767104-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:46.123366 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-7a2fc352-2f1b-4049-b2e5-f4930cc77f9e tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211483c6acea4f76b6c0e4bfc818e7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd687d54e07d4ab4af00ad801ef4b58d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:04:46.137075 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-7a2fc352-2f1b-4049-b2e5-f4930cc77f9e tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '211483c6acea4f76b6c0e4bfc818e7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd687d54e07d4ab4af00ad801ef4b58d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:04:46.142608 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-7a2fc352-2f1b-4049-b2e5-f4930cc77f9e tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '211483c6acea4f76b6c0e4bfc818e7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd687d54e07d4ab4af00ad801ef4b58d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:04:46.148773 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-7a2fc352-2f1b-4049-b2e5-f4930cc77f9e tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] 10.222.0.18 "GET /compute/v2.1/servers/f38f14b2-b9d7-4bed-92ba-7b95ea4b2270" status: 200 len: 1609 microversion: 2.42 time: 0.317687 Oct 22 21:04:46.149694 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1673/3276] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:04:45 2022] GET /compute/v2.1/servers/f38f14b2-b9d7-4bed-92ba-7b95ea4b2270 => generated 1609 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:04:46.329566 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-d41dc10c-0b3a-4152-9ee6-fb143ec23423 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:04:46.330962 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-d41dc10c-0b3a-4152-9ee6-fb143ec23423 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] [instance: 931293d3-cb3a-4fd1-a684-eb740f010845] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:04:46.351715 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d41dc10c-0b3a-4152-9ee6-fb143ec23423 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:46.352237 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d41dc10c-0b3a-4152-9ee6-fb143ec23423 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:46.352793 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d41dc10c-0b3a-4152-9ee6-fb143ec23423 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:46.353438 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d41dc10c-0b3a-4152-9ee6-fb143ec23423 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:46.356450 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d41dc10c-0b3a-4152-9ee6-fb143ec23423 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:46.357624 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d41dc10c-0b3a-4152-9ee6-fb143ec23423 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:46.395439 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-e7e474fd-2ce7-43d6-b531-cb1bfb726c37 tempest-VolumesNegativeTest-1146767104 tempest-VolumesNegativeTest-1146767104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89246f6315ac429c94630afb36be5253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba7e19328594eae9e7d6a7c6e9c2147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:04:46.411626 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-e7e474fd-2ce7-43d6-b531-cb1bfb726c37 tempest-VolumesNegativeTest-1146767104 tempest-VolumesNegativeTest-1146767104-project] 10.222.0.18 "GET /compute/v2.1/servers/ead6584e-26a9-4923-b58e-305731b6f73b" status: 200 len: 1470 microversion: 2.1 time: 0.489646 Oct 22 21:04:46.413165 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1604/3277] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:04:45 2022] GET /compute/v2.1/servers/ead6584e-26a9-4923-b58e-305731b6f73b => generated 1470 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:04:46.424844 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-e0daa2cd-1423-4357-bcb7-31d8d994e094 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Calling method '.version_select at 0x7fd39efea430>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:04:46.558540 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-e0daa2cd-1423-4357-bcb7-31d8d994e094 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] 10.222.0.18 "GET /compute/v2.1/images/fefdb332-d8c8-4dbc-8b2b-6d54994dca11" status: 200 len: 1414 microversion: 2.1 time: 0.143289 Oct 22 21:04:46.560302 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1605/3278] 10.222.0.18 () {58 vars in 1233 bytes} [Sat Oct 22 21:04:46 2022] GET /compute/v2.1/images/fefdb332-d8c8-4dbc-8b2b-6d54994dca11 => generated 1414 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:04:46.581736 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-167c052b-aad6-48fb-a385-01ad84ad918c tempest-ServerAddressesTestJSON-849573313 tempest-ServerAddressesTestJSON-849573313-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:04:46.585950 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-167c052b-aad6-48fb-a385-01ad84ad918c tempest-ServerAddressesTestJSON-849573313 tempest-ServerAddressesTestJSON-849573313-project] [instance: 492fde48-2dc2-448f-8d33-fdac96a6bb33] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:04:46.620908 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-167c052b-aad6-48fb-a385-01ad84ad918c tempest-ServerAddressesTestJSON-849573313 tempest-ServerAddressesTestJSON-849573313-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:46.625168 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-167c052b-aad6-48fb-a385-01ad84ad918c tempest-ServerAddressesTestJSON-849573313 tempest-ServerAddressesTestJSON-849573313-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:46.626001 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-167c052b-aad6-48fb-a385-01ad84ad918c tempest-ServerAddressesTestJSON-849573313 tempest-ServerAddressesTestJSON-849573313-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:46.630558 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-167c052b-aad6-48fb-a385-01ad84ad918c tempest-ServerAddressesTestJSON-849573313 tempest-ServerAddressesTestJSON-849573313-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:46.633084 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-167c052b-aad6-48fb-a385-01ad84ad918c tempest-ServerAddressesTestJSON-849573313 tempest-ServerAddressesTestJSON-849573313-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:46.634304 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-167c052b-aad6-48fb-a385-01ad84ad918c tempest-ServerAddressesTestJSON-849573313 tempest-ServerAddressesTestJSON-849573313-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:47.418079 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-d41dc10c-0b3a-4152-9ee6-fb143ec23423 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1b410a64e0415a96d30f5040361137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd7873d6db4e09bc9ab9a048a6b1ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:04:47.433512 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-d41dc10c-0b3a-4152-9ee6-fb143ec23423 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] 10.222.0.18 "GET /compute/v2.1/servers/931293d3-cb3a-4fd1-a684-eb740f010845" status: 200 len: 1313 microversion: 2.1 time: 1.114266 Oct 22 21:04:47.434305 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1674/3279] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:04:46 2022] GET /compute/v2.1/servers/931293d3-cb3a-4fd1-a684-eb740f010845 => generated 1313 bytes in 1116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:04:47.439328 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-44ac4cc9-9ec4-4c41-a481-84b91ae8315d tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:04:47.466090 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-44ac4cc9-9ec4-4c41-a481-84b91ae8315d tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] [instance: 87b07efc-fa80-40ad-8077-333547ee7301] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:04:47.492702 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-44ac4cc9-9ec4-4c41-a481-84b91ae8315d tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:47.493385 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-44ac4cc9-9ec4-4c41-a481-84b91ae8315d tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:47.493842 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-44ac4cc9-9ec4-4c41-a481-84b91ae8315d tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:47.494585 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-44ac4cc9-9ec4-4c41-a481-84b91ae8315d tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:47.495053 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-44ac4cc9-9ec4-4c41-a481-84b91ae8315d tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:47.495520 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-44ac4cc9-9ec4-4c41-a481-84b91ae8315d tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:47.638887 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-167c052b-aad6-48fb-a385-01ad84ad918c tempest-ServerAddressesTestJSON-849573313 tempest-ServerAddressesTestJSON-849573313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703cd05e0f824241bed1565a3a6a7ff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62cda3990bbe4c36a7240c9df581ff62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:04:47.653053 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-167c052b-aad6-48fb-a385-01ad84ad918c tempest-ServerAddressesTestJSON-849573313 tempest-ServerAddressesTestJSON-849573313-project] 10.222.0.18 "GET /compute/v2.1/servers/492fde48-2dc2-448f-8d33-fdac96a6bb33" status: 200 len: 1506 microversion: 2.1 time: 1.088385 Oct 22 21:04:47.654401 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1606/3280] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:04:46 2022] GET /compute/v2.1/servers/492fde48-2dc2-448f-8d33-fdac96a6bb33 => generated 1506 bytes in 1093 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:04:47.660732 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-71b8179a-0ac5-4b86-bdce-d29ed96682d5 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:04:47.667814 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-71b8179a-0ac5-4b86-bdce-d29ed96682d5 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] [instance: f38f14b2-b9d7-4bed-92ba-7b95ea4b2270] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:04:47.677378 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-71b8179a-0ac5-4b86-bdce-d29ed96682d5 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:47.678462 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-71b8179a-0ac5-4b86-bdce-d29ed96682d5 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:47.679433 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-71b8179a-0ac5-4b86-bdce-d29ed96682d5 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:47.680424 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-71b8179a-0ac5-4b86-bdce-d29ed96682d5 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:47.681913 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-71b8179a-0ac5-4b86-bdce-d29ed96682d5 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:47.682782 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-71b8179a-0ac5-4b86-bdce-d29ed96682d5 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:47.705030 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-71b8179a-0ac5-4b86-bdce-d29ed96682d5 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] HTTP exception thrown: Instance f38f14b2-b9d7-4bed-92ba-7b95ea4b2270 could not be found. Oct 22 21:04:47.707630 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-71b8179a-0ac5-4b86-bdce-d29ed96682d5 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Request method failure captured: Oct 22 21:04:47.707630 ncdv-master-1 devstack@n-api.service[138744]: request: GET /compute/v2.1/servers/f38f14b2-b9d7-4bed-92ba-7b95ea4b2270 HTTP/1.1 Oct 22 21:04:47.707630 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 21:04:47.707630 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 21:04:47.707630 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 21:04:47.707630 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 0 Oct 22 21:04:47.707630 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 21:04:47.707630 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 21:04:47.707630 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 21:04:47.707630 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 21:04:47.707630 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVFl1NsovoM-5upBofUoR1wJz3y3f7BN7i-ip8UquaFKR-Bwws5RaDaETkBhtKzdndp6MYRY8ukCbKnzwdM4Y6qNUxVfwFedn3ei1b7cigm0kIz6-neoAFZeBAi_YJs2sNYg8tIoGL0NhI8dAoKTuweu7Sty9RZOuF7Ns4bg1i0YJsIk Oct 22 21:04:47.707630 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 21:04:47.707630 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 21:04:47.707630 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 21:04:47.707630 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 21:04:47.707630 ncdv-master-1 devstack@n-api.service[138744]: X-Openstack-Nova-Api-Version: 2.42 Oct 22 21:04:47.707630 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 21:04:47.707630 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 21:04:47.707630 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: cd687d54e07d4ab4af00ad801ef4b58d Oct 22 21:04:47.707630 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1175888917 Oct 22 21:04:47.707630 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 21:04:47.707630 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 21:04:47.707630 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_cd687d54e07d4ab4af00ad801ef4b58d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/cd687d54e07d4ab4af00ad801ef4b58d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/cd687d54e07d4ab4af00ad801ef4b58d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/cd687d54e07d4ab4af00ad801ef4b58d"}]}] Oct 22 21:04:47.707630 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1175888917 Oct 22 21:04:47.707630 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: cd687d54e07d4ab4af00ad801ef4b58d Oct 22 21:04:47.707630 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1175888917 Oct 22 21:04:47.707630 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-TaggedBootDevicesTest_v242-1175888917-project Oct 22 21:04:47.707630 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 21:04:47.707630 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 21:04:47.707630 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: 211483c6acea4f76b6c0e4bfc818e7aa Oct 22 21:04:47.707630 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1175888917-project Oct 22 21:04:47.707630 ncdv-master-1 devstack@n-api.service[138744]: method: > Oct 22 21:04:47.707630 ncdv-master-1 devstack@n-api.service[138744]: exception: Instance f38f14b2-b9d7-4bed-92ba-7b95ea4b2270 could not be found. Oct 22 21:04:47.707630 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': 'f38f14b2-b9d7-4bed-92ba-7b95ea4b2270'} Oct 22 21:04:47.707630 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:04:47.707630 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:04:47.707630 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 21:04:47.707630 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 21:04:47.707630 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 21:04:47.707630 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 21:04:47.707630 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 21:04:47.707630 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 21:04:47.707630 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 21:04:47.707630 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 21:04:47.707630 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f38f14b2-b9d7-4bed-92ba-7b95ea4b2270 could not be found. Oct 22 21:04:47.707630 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:04:47.707630 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:04:47.707630 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:04:47.707630 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:04:47.707630 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:04:47.707630 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:04:47.707630 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:04:47.707630 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:04:47.707630 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:04:47.707630 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:04:47.707630 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 21:04:47.707630 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 21:04:47.707630 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 21:04:47.707630 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 21:04:47.707630 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 21:04:47.707630 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:04:47.707630 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f38f14b2-b9d7-4bed-92ba-7b95ea4b2270 could not be found. Oct 22 21:04:47.707630 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:04:47.707630 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:04:47.713289 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:04:47.713289 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:04:47.713289 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:04:47.713289 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:04:47.713289 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:04:47.713289 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:04:47.713289 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f38f14b2-b9d7-4bed-92ba-7b95ea4b2270 could not be found. Oct 22 21:04:47.713289 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:04:47.713289 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-71b8179a-0ac5-4b86-bdce-d29ed96682d5 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Returning 404 to user: Instance f38f14b2-b9d7-4bed-92ba-7b95ea4b2270 could not be found. {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:04:47.718943 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-71b8179a-0ac5-4b86-bdce-d29ed96682d5 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] 10.222.0.18 "GET /compute/v2.1/servers/f38f14b2-b9d7-4bed-92ba-7b95ea4b2270" status: 404 len: 111 microversion: 2.42 time: 0.062320 Oct 22 21:04:47.720124 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1607/3281] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:04:47 2022] GET /compute/v2.1/servers/f38f14b2-b9d7-4bed-92ba-7b95ea4b2270 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 22 21:04:47.729878 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-756e1519-2f36-4ee6-8996-2a1f299a4081 tempest-VolumesNegativeTest-1146767104 tempest-VolumesNegativeTest-1146767104-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:04:47.730772 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-756e1519-2f36-4ee6-8996-2a1f299a4081 tempest-VolumesNegativeTest-1146767104 tempest-VolumesNegativeTest-1146767104-project] [instance: ead6584e-26a9-4923-b58e-305731b6f73b] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:04:47.738286 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-756e1519-2f36-4ee6-8996-2a1f299a4081 tempest-VolumesNegativeTest-1146767104 tempest-VolumesNegativeTest-1146767104-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:47.739418 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-756e1519-2f36-4ee6-8996-2a1f299a4081 tempest-VolumesNegativeTest-1146767104 tempest-VolumesNegativeTest-1146767104-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:47.739932 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-756e1519-2f36-4ee6-8996-2a1f299a4081 tempest-VolumesNegativeTest-1146767104 tempest-VolumesNegativeTest-1146767104-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:47.742143 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-756e1519-2f36-4ee6-8996-2a1f299a4081 tempest-VolumesNegativeTest-1146767104 tempest-VolumesNegativeTest-1146767104-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:47.742985 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-756e1519-2f36-4ee6-8996-2a1f299a4081 tempest-VolumesNegativeTest-1146767104 tempest-VolumesNegativeTest-1146767104-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:47.743958 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-756e1519-2f36-4ee6-8996-2a1f299a4081 tempest-VolumesNegativeTest-1146767104 tempest-VolumesNegativeTest-1146767104-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:47.809287 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-756e1519-2f36-4ee6-8996-2a1f299a4081 tempest-VolumesNegativeTest-1146767104 tempest-VolumesNegativeTest-1146767104-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:47.809683 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-756e1519-2f36-4ee6-8996-2a1f299a4081 tempest-VolumesNegativeTest-1146767104 tempest-VolumesNegativeTest-1146767104-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:47.810123 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-756e1519-2f36-4ee6-8996-2a1f299a4081 tempest-VolumesNegativeTest-1146767104 tempest-VolumesNegativeTest-1146767104-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:47.810593 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.objects.instance [None req-756e1519-2f36-4ee6-8996-2a1f299a4081 tempest-VolumesNegativeTest-1146767104 tempest-VolumesNegativeTest-1146767104-project] Lazy-loading 'fault' on Instance uuid ead6584e-26a9-4923-b58e-305731b6f73b {{(pid=138744) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 21:04:48.013918 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-756e1519-2f36-4ee6-8996-2a1f299a4081 tempest-VolumesNegativeTest-1146767104 tempest-VolumesNegativeTest-1146767104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89246f6315ac429c94630afb36be5253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba7e19328594eae9e7d6a7c6e9c2147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:04:48.034330 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-756e1519-2f36-4ee6-8996-2a1f299a4081 tempest-VolumesNegativeTest-1146767104 tempest-VolumesNegativeTest-1146767104-project] 10.222.0.18 "GET /compute/v2.1/servers/ead6584e-26a9-4923-b58e-305731b6f73b" status: 200 len: 1304 microversion: 2.1 time: 0.312908 Oct 22 21:04:48.043714 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1608/3282] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:04:47 2022] GET /compute/v2.1/servers/ead6584e-26a9-4923-b58e-305731b6f73b => generated 1304 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:04:48.056926 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-e639d7c6-354b-475f-8b37-220013019a48 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Calling method '.version_select at 0x7fd39eff8ee0>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:04:48.099877 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-44ac4cc9-9ec4-4c41-a481-84b91ae8315d tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879c85830a9f42088a4ebdf1e3cfb39b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b54f56cfbc814cccb533c65966f35a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:04:48.123044 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-44ac4cc9-9ec4-4c41-a481-84b91ae8315d tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] 10.222.0.18 "GET /compute/v2.1/servers/87b07efc-fa80-40ad-8077-333547ee7301" status: 200 len: 1505 microversion: 2.1 time: 0.687358 Oct 22 21:04:48.124119 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1675/3283] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:04:47 2022] GET /compute/v2.1/servers/87b07efc-fa80-40ad-8077-333547ee7301 => generated 1505 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:04:48.125642 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-e639d7c6-354b-475f-8b37-220013019a48 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] 10.222.0.18 "GET /compute/v2.1/images/fefdb332-d8c8-4dbc-8b2b-6d54994dca11" status: 200 len: 1414 microversion: 2.1 time: 0.080499 Oct 22 21:04:48.133016 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-e8e1df3e-43ae-4d8f-ba4d-0bc18221d042 req-69f98b3b-a83a-4faa-878c-0565bfbe37ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ead6584e-26a9-4923-b58e-305731b6f73b", "name": "network-vif-deleted", "tag": "441f86b3-888a-4eb4-92f9-c281400ace7f"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:04:48.135285 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1609/3284] 10.222.0.18 () {58 vars in 1233 bytes} [Sat Oct 22 21:04:48 2022] GET /compute/v2.1/images/fefdb332-d8c8-4dbc-8b2b-6d54994dca11 => generated 1414 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:04:48.140218 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-cbd409c0-590b-4386-828b-08b77173124c tempest-ServerAddressesTestJSON-849573313 tempest-ServerAddressesTestJSON-849573313-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:04:48.140715 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-cbd409c0-590b-4386-828b-08b77173124c tempest-ServerAddressesTestJSON-849573313 tempest-ServerAddressesTestJSON-849573313-project] [instance: 492fde48-2dc2-448f-8d33-fdac96a6bb33] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:04:48.149808 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-e8e1df3e-43ae-4d8f-ba4d-0bc18221d042 req-69f98b3b-a83a-4faa-878c-0565bfbe37ea service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:48.151747 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-e8e1df3e-43ae-4d8f-ba4d-0bc18221d042 req-69f98b3b-a83a-4faa-878c-0565bfbe37ea service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:48.153013 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cbd409c0-590b-4386-828b-08b77173124c tempest-ServerAddressesTestJSON-849573313 tempest-ServerAddressesTestJSON-849573313-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:48.153562 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-e8e1df3e-43ae-4d8f-ba4d-0bc18221d042 req-69f98b3b-a83a-4faa-878c-0565bfbe37ea service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:48.153953 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cbd409c0-590b-4386-828b-08b77173124c tempest-ServerAddressesTestJSON-849573313 tempest-ServerAddressesTestJSON-849573313-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:48.156328 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cbd409c0-590b-4386-828b-08b77173124c tempest-ServerAddressesTestJSON-849573313 tempest-ServerAddressesTestJSON-849573313-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:48.157311 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cbd409c0-590b-4386-828b-08b77173124c tempest-ServerAddressesTestJSON-849573313 tempest-ServerAddressesTestJSON-849573313-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:48.157952 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cbd409c0-590b-4386-828b-08b77173124c tempest-ServerAddressesTestJSON-849573313 tempest-ServerAddressesTestJSON-849573313-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:48.158550 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cbd409c0-590b-4386-828b-08b77173124c tempest-ServerAddressesTestJSON-849573313 tempest-ServerAddressesTestJSON-849573313-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:48.174625 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-e8e1df3e-43ae-4d8f-ba4d-0bc18221d042 req-69f98b3b-a83a-4faa-878c-0565bfbe37ea service nova] Creating event network-vif-deleted:441f86b3-888a-4eb4-92f9-c281400ace7f for instance ead6584e-26a9-4923-b58e-305731b6f73b on nch2-master-1 Oct 22 21:04:48.181553 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-e8e1df3e-43ae-4d8f-ba4d-0bc18221d042 req-69f98b3b-a83a-4faa-878c-0565bfbe37ea service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055305 Oct 22 21:04:48.183844 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1676/3285] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:04:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:04:48.197510 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-d69a03b2-3b22-4f0b-ae56-117096441a78 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Calling method '.version_select at 0x7fd39ee489d0>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:04:48.226086 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-cbd409c0-590b-4386-828b-08b77173124c tempest-ServerAddressesTestJSON-849573313 tempest-ServerAddressesTestJSON-849573313-project] 10.222.0.18 "GET /compute/v2.1/servers/492fde48-2dc2-448f-8d33-fdac96a6bb33/ips" status: 200 len: 110 microversion: 2.1 time: 0.089231 Oct 22 21:04:48.226648 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1610/3286] 10.222.0.18 () {58 vars in 1248 bytes} [Sat Oct 22 21:04:48 2022] GET /compute/v2.1/servers/492fde48-2dc2-448f-8d33-fdac96a6bb33/ips => generated 110 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:04:48.240464 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-59b95a0c-07ca-45e8-92ab-2ff067272da7 tempest-ServerAddressesTestJSON-849573313 tempest-ServerAddressesTestJSON-849573313-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:04:48.241265 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-59b95a0c-07ca-45e8-92ab-2ff067272da7 tempest-ServerAddressesTestJSON-849573313 tempest-ServerAddressesTestJSON-849573313-project] [instance: 492fde48-2dc2-448f-8d33-fdac96a6bb33] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:04:48.248687 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-d69a03b2-3b22-4f0b-ae56-117096441a78 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-887345857" status: 204 len: 0 microversion: 2.42 time: 0.062526 Oct 22 21:04:48.249794 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1677/3287] 10.222.0.18 () {60 vars in 1259 bytes} [Sat Oct 22 21:04:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-887345857 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 22 21:04:48.253812 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-59b95a0c-07ca-45e8-92ab-2ff067272da7 tempest-ServerAddressesTestJSON-849573313 tempest-ServerAddressesTestJSON-849573313-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:48.254572 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-59b95a0c-07ca-45e8-92ab-2ff067272da7 tempest-ServerAddressesTestJSON-849573313 tempest-ServerAddressesTestJSON-849573313-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:48.255245 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-59b95a0c-07ca-45e8-92ab-2ff067272da7 tempest-ServerAddressesTestJSON-849573313 tempest-ServerAddressesTestJSON-849573313-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:48.257134 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-59b95a0c-07ca-45e8-92ab-2ff067272da7 tempest-ServerAddressesTestJSON-849573313 tempest-ServerAddressesTestJSON-849573313-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:48.261338 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-59b95a0c-07ca-45e8-92ab-2ff067272da7 tempest-ServerAddressesTestJSON-849573313 tempest-ServerAddressesTestJSON-849573313-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:48.262404 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-59b95a0c-07ca-45e8-92ab-2ff067272da7 tempest-ServerAddressesTestJSON-849573313 tempest-ServerAddressesTestJSON-849573313-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:48.333407 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-59b95a0c-07ca-45e8-92ab-2ff067272da7 tempest-ServerAddressesTestJSON-849573313 tempest-ServerAddressesTestJSON-849573313-project] 10.222.0.18 "GET /compute/v2.1/servers/492fde48-2dc2-448f-8d33-fdac96a6bb33/ips" status: 200 len: 110 microversion: 2.1 time: 0.097798 Oct 22 21:04:48.334017 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1611/3288] 10.222.0.18 () {58 vars in 1248 bytes} [Sat Oct 22 21:04:48 2022] GET /compute/v2.1/servers/492fde48-2dc2-448f-8d33-fdac96a6bb33/ips => generated 110 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 21:04:48.348100 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-60af933d-a129-444d-90f2-c71246c13b79 tempest-ServerAddressesTestJSON-849573313 tempest-ServerAddressesTestJSON-849573313-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:04:48.348877 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-60af933d-a129-444d-90f2-c71246c13b79 tempest-ServerAddressesTestJSON-849573313 tempest-ServerAddressesTestJSON-849573313-project] [instance: 492fde48-2dc2-448f-8d33-fdac96a6bb33] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:04:48.362633 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-60af933d-a129-444d-90f2-c71246c13b79 tempest-ServerAddressesTestJSON-849573313 tempest-ServerAddressesTestJSON-849573313-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:48.364831 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-60af933d-a129-444d-90f2-c71246c13b79 tempest-ServerAddressesTestJSON-849573313 tempest-ServerAddressesTestJSON-849573313-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:48.366199 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-60af933d-a129-444d-90f2-c71246c13b79 tempest-ServerAddressesTestJSON-849573313 tempest-ServerAddressesTestJSON-849573313-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:48.368196 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-60af933d-a129-444d-90f2-c71246c13b79 tempest-ServerAddressesTestJSON-849573313 tempest-ServerAddressesTestJSON-849573313-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:48.369031 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-60af933d-a129-444d-90f2-c71246c13b79 tempest-ServerAddressesTestJSON-849573313 tempest-ServerAddressesTestJSON-849573313-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:48.369710 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-60af933d-a129-444d-90f2-c71246c13b79 tempest-ServerAddressesTestJSON-849573313 tempest-ServerAddressesTestJSON-849573313-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:48.464260 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-1ad71b3b-bf95-471d-9695-b96695a5858d tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:04:48.464895 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-1ad71b3b-bf95-471d-9695-b96695a5858d tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] [instance: 931293d3-cb3a-4fd1-a684-eb740f010845] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:04:48.486565 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-60af933d-a129-444d-90f2-c71246c13b79 tempest-ServerAddressesTestJSON-849573313 tempest-ServerAddressesTestJSON-849573313-project] 10.222.0.18 "GET /compute/v2.1/servers/492fde48-2dc2-448f-8d33-fdac96a6bb33/ips/tempest-ServerAddressesTestJSON-1063694398-network" status: 200 len: 95 microversion: 2.1 time: 0.144253 Oct 22 21:04:48.488258 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1ad71b3b-bf95-471d-9695-b96695a5858d tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:48.488764 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1ad71b3b-bf95-471d-9695-b96695a5858d tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:48.489218 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1ad71b3b-bf95-471d-9695-b96695a5858d tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:48.489936 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1ad71b3b-bf95-471d-9695-b96695a5858d tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:48.494826 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1678/3289] 10.222.0.18 () {58 vars in 1401 bytes} [Sat Oct 22 21:04:48 2022] GET /compute/v2.1/servers/492fde48-2dc2-448f-8d33-fdac96a6bb33/ips/tempest-ServerAddressesTestJSON-1063694398-network => generated 95 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 22 21:04:48.507194 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1ad71b3b-bf95-471d-9695-b96695a5858d tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:48.509189 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-bfc47e26-eac8-4f04-86a0-838f9436ef26 tempest-ServerAddressesTestJSON-849573313 tempest-ServerAddressesTestJSON-849573313-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:04:48.509384 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1ad71b3b-bf95-471d-9695-b96695a5858d tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:48.511308 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-bfc47e26-eac8-4f04-86a0-838f9436ef26 tempest-ServerAddressesTestJSON-849573313 tempest-ServerAddressesTestJSON-849573313-project] [instance: 492fde48-2dc2-448f-8d33-fdac96a6bb33] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:04:48.567558 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bfc47e26-eac8-4f04-86a0-838f9436ef26 tempest-ServerAddressesTestJSON-849573313 tempest-ServerAddressesTestJSON-849573313-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:48.569850 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bfc47e26-eac8-4f04-86a0-838f9436ef26 tempest-ServerAddressesTestJSON-849573313 tempest-ServerAddressesTestJSON-849573313-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:48.573696 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bfc47e26-eac8-4f04-86a0-838f9436ef26 tempest-ServerAddressesTestJSON-849573313 tempest-ServerAddressesTestJSON-849573313-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:48.582194 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bfc47e26-eac8-4f04-86a0-838f9436ef26 tempest-ServerAddressesTestJSON-849573313 tempest-ServerAddressesTestJSON-849573313-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:48.585297 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bfc47e26-eac8-4f04-86a0-838f9436ef26 tempest-ServerAddressesTestJSON-849573313 tempest-ServerAddressesTestJSON-849573313-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:48.587331 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bfc47e26-eac8-4f04-86a0-838f9436ef26 tempest-ServerAddressesTestJSON-849573313 tempest-ServerAddressesTestJSON-849573313-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:48.699970 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-bfc47e26-eac8-4f04-86a0-838f9436ef26 tempest-ServerAddressesTestJSON-849573313 tempest-ServerAddressesTestJSON-849573313-project] [instance: 492fde48-2dc2-448f-8d33-fdac96a6bb33] Going to try to terminate instance {{(pid=138745) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 21:04:48.886946 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-bfc47e26-eac8-4f04-86a0-838f9436ef26 tempest-ServerAddressesTestJSON-849573313 tempest-ServerAddressesTestJSON-849573313-project] 10.222.0.18 "DELETE /compute/v2.1/servers/492fde48-2dc2-448f-8d33-fdac96a6bb33" status: 204 len: 0 microversion: 2.1 time: 0.388583 Oct 22 21:04:48.887969 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1679/3290] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 21:04:48 2022] DELETE /compute/v2.1/servers/492fde48-2dc2-448f-8d33-fdac96a6bb33 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 21:04:48.903783 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-5d2bd3d9-8a37-49e6-b4d4-8ac5f23abd8d tempest-ServerAddressesTestJSON-849573313 tempest-ServerAddressesTestJSON-849573313-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:04:48.904833 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-5d2bd3d9-8a37-49e6-b4d4-8ac5f23abd8d tempest-ServerAddressesTestJSON-849573313 tempest-ServerAddressesTestJSON-849573313-project] [instance: 492fde48-2dc2-448f-8d33-fdac96a6bb33] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:04:48.907132 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:04:48.915380 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-1ad71b3b-bf95-471d-9695-b96695a5858d tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1b410a64e0415a96d30f5040361137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd7873d6db4e09bc9ab9a048a6b1ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:04:48.916619 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5d2bd3d9-8a37-49e6-b4d4-8ac5f23abd8d tempest-ServerAddressesTestJSON-849573313 tempest-ServerAddressesTestJSON-849573313-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:48.918082 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5d2bd3d9-8a37-49e6-b4d4-8ac5f23abd8d tempest-ServerAddressesTestJSON-849573313 tempest-ServerAddressesTestJSON-849573313-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:48.919035 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5d2bd3d9-8a37-49e6-b4d4-8ac5f23abd8d tempest-ServerAddressesTestJSON-849573313 tempest-ServerAddressesTestJSON-849573313-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:48.920031 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5d2bd3d9-8a37-49e6-b4d4-8ac5f23abd8d tempest-ServerAddressesTestJSON-849573313 tempest-ServerAddressesTestJSON-849573313-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:48.920872 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5d2bd3d9-8a37-49e6-b4d4-8ac5f23abd8d tempest-ServerAddressesTestJSON-849573313 tempest-ServerAddressesTestJSON-849573313-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:48.921487 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5d2bd3d9-8a37-49e6-b4d4-8ac5f23abd8d tempest-ServerAddressesTestJSON-849573313 tempest-ServerAddressesTestJSON-849573313-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:48.929211 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-1ad71b3b-bf95-471d-9695-b96695a5858d tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] 10.222.0.18 "GET /compute/v2.1/servers/931293d3-cb3a-4fd1-a684-eb740f010845" status: 200 len: 1313 microversion: 2.1 time: 0.473118 Oct 22 21:04:48.940141 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1612/3291] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:04:48 2022] GET /compute/v2.1/servers/931293d3-cb3a-4fd1-a684-eb740f010845 => generated 1313 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:04:49.060077 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-436b6ef3-970d-46d7-81ec-83a92a95f323 tempest-VolumesNegativeTest-1146767104 tempest-VolumesNegativeTest-1146767104-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:04:49.060745 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-436b6ef3-970d-46d7-81ec-83a92a95f323 tempest-VolumesNegativeTest-1146767104 tempest-VolumesNegativeTest-1146767104-project] [instance: ead6584e-26a9-4923-b58e-305731b6f73b] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:04:49.075976 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-436b6ef3-970d-46d7-81ec-83a92a95f323 tempest-VolumesNegativeTest-1146767104 tempest-VolumesNegativeTest-1146767104-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:49.080192 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-436b6ef3-970d-46d7-81ec-83a92a95f323 tempest-VolumesNegativeTest-1146767104 tempest-VolumesNegativeTest-1146767104-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:49.080810 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-436b6ef3-970d-46d7-81ec-83a92a95f323 tempest-VolumesNegativeTest-1146767104 tempest-VolumesNegativeTest-1146767104-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:49.081560 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-436b6ef3-970d-46d7-81ec-83a92a95f323 tempest-VolumesNegativeTest-1146767104 tempest-VolumesNegativeTest-1146767104-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:49.082166 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-436b6ef3-970d-46d7-81ec-83a92a95f323 tempest-VolumesNegativeTest-1146767104 tempest-VolumesNegativeTest-1146767104-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:49.082595 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-436b6ef3-970d-46d7-81ec-83a92a95f323 tempest-VolumesNegativeTest-1146767104 tempest-VolumesNegativeTest-1146767104-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:49.122853 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-436b6ef3-970d-46d7-81ec-83a92a95f323 tempest-VolumesNegativeTest-1146767104 tempest-VolumesNegativeTest-1146767104-project] HTTP exception thrown: Instance ead6584e-26a9-4923-b58e-305731b6f73b could not be found. Oct 22 21:04:49.124840 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-436b6ef3-970d-46d7-81ec-83a92a95f323 tempest-VolumesNegativeTest-1146767104 tempest-VolumesNegativeTest-1146767104-project] Request method failure captured: Oct 22 21:04:49.124840 ncdv-master-1 devstack@n-api.service[138744]: request: GET /compute/v2.1/servers/ead6584e-26a9-4923-b58e-305731b6f73b HTTP/1.1 Oct 22 21:04:49.124840 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 21:04:49.124840 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 21:04:49.124840 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 21:04:49.124840 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 0 Oct 22 21:04:49.124840 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 21:04:49.124840 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 21:04:49.124840 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 21:04:49.124840 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 21:04:49.124840 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVFrGdsFjBsPqMsHx85m39QbvNKbrrkHM09v33KXiRmt8sq_3rBgD-LyRCqGRzM7Z_cKpYDNmEyrm7F1Q-_Fpb_NCGIuqX7JygWU1o8y2eUcNdqfTnEb7myG5OzF_BQ6ku_yMNpyF_FM1cvS9Pl9W64j9nbNaTIwvGvkiOvagQRUZGwU Oct 22 21:04:49.124840 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 21:04:49.124840 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 21:04:49.124840 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 21:04:49.124840 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 21:04:49.124840 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 21:04:49.124840 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 21:04:49.124840 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: bba7e19328594eae9e7d6a7c6e9c2147 Oct 22 21:04:49.124840 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-VolumesNegativeTest-1146767104 Oct 22 21:04:49.124840 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 21:04:49.124840 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 21:04:49.124840 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_bba7e19328594eae9e7d6a7c6e9c2147"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/bba7e19328594eae9e7d6a7c6e9c2147"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/bba7e19328594eae9e7d6a7c6e9c2147"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/bba7e19328594eae9e7d6a7c6e9c2147"}]}] Oct 22 21:04:49.124840 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-VolumesNegativeTest-1146767104 Oct 22 21:04:49.124840 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: bba7e19328594eae9e7d6a7c6e9c2147 Oct 22 21:04:49.124840 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-VolumesNegativeTest-1146767104 Oct 22 21:04:49.124840 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-VolumesNegativeTest-1146767104-project Oct 22 21:04:49.124840 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 21:04:49.124840 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 21:04:49.124840 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: 89246f6315ac429c94630afb36be5253 Oct 22 21:04:49.124840 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-VolumesNegativeTest-1146767104-project Oct 22 21:04:49.124840 ncdv-master-1 devstack@n-api.service[138744]: method: > Oct 22 21:04:49.124840 ncdv-master-1 devstack@n-api.service[138744]: exception: Instance ead6584e-26a9-4923-b58e-305731b6f73b could not be found. Oct 22 21:04:49.124840 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': 'ead6584e-26a9-4923-b58e-305731b6f73b'} Oct 22 21:04:49.124840 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:04:49.124840 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:04:49.124840 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 21:04:49.124840 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 21:04:49.124840 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 21:04:49.124840 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 21:04:49.124840 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 21:04:49.124840 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 21:04:49.124840 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 21:04:49.124840 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 21:04:49.124840 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ead6584e-26a9-4923-b58e-305731b6f73b could not be found. Oct 22 21:04:49.124840 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:04:49.124840 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:04:49.124840 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:04:49.124840 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:04:49.124840 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:04:49.124840 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:04:49.124840 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:04:49.124840 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:04:49.124840 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:04:49.124840 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:04:49.124840 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 21:04:49.124840 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 21:04:49.124840 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 21:04:49.124840 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 21:04:49.124840 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 21:04:49.124840 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:04:49.124840 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ead6584e-26a9-4923-b58e-305731b6f73b could not be found. Oct 22 21:04:49.124840 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:04:49.124840 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:04:49.124840 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:04:49.129298 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:04:49.129298 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:04:49.129298 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:04:49.129298 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:04:49.129298 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:04:49.129298 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ead6584e-26a9-4923-b58e-305731b6f73b could not be found. Oct 22 21:04:49.129298 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:04:49.131515 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-436b6ef3-970d-46d7-81ec-83a92a95f323 tempest-VolumesNegativeTest-1146767104 tempest-VolumesNegativeTest-1146767104-project] Returning 404 to user: Instance ead6584e-26a9-4923-b58e-305731b6f73b could not be found. {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:04:49.132545 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-436b6ef3-970d-46d7-81ec-83a92a95f323 tempest-VolumesNegativeTest-1146767104 tempest-VolumesNegativeTest-1146767104-project] 10.222.0.18 "GET /compute/v2.1/servers/ead6584e-26a9-4923-b58e-305731b6f73b" status: 404 len: 111 microversion: 2.1 time: 0.076899 Oct 22 21:04:49.135915 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1613/3292] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:04:49 2022] GET /compute/v2.1/servers/ead6584e-26a9-4923-b58e-305731b6f73b => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 22 21:04:49.167097 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-655d2f13-9d7e-492b-a391-c6d13d667b8e req-ef80f6dc-bb75-4064-8574-902a346da666 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "931293d3-cb3a-4fd1-a684-eb740f010845", "name": "network-vif-plugged", "status": "completed", "tag": "cbfb6cca-3060-4248-8fe5-5bd4144394eb"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:04:49.189558 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-5d2bd3d9-8a37-49e6-b4d4-8ac5f23abd8d tempest-ServerAddressesTestJSON-849573313 tempest-ServerAddressesTestJSON-849573313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703cd05e0f824241bed1565a3a6a7ff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62cda3990bbe4c36a7240c9df581ff62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:04:49.192899 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-655d2f13-9d7e-492b-a391-c6d13d667b8e req-ef80f6dc-bb75-4064-8574-902a346da666 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:49.194214 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-655d2f13-9d7e-492b-a391-c6d13d667b8e req-ef80f6dc-bb75-4064-8574-902a346da666 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:49.196212 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-655d2f13-9d7e-492b-a391-c6d13d667b8e req-ef80f6dc-bb75-4064-8574-902a346da666 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:49.204534 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-5d2bd3d9-8a37-49e6-b4d4-8ac5f23abd8d tempest-ServerAddressesTestJSON-849573313 tempest-ServerAddressesTestJSON-849573313-project] 10.222.0.18 "GET /compute/v2.1/servers/492fde48-2dc2-448f-8d33-fdac96a6bb33" status: 200 len: 1512 microversion: 2.1 time: 0.310578 Oct 22 21:04:49.208075 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1680/3293] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:04:48 2022] GET /compute/v2.1/servers/492fde48-2dc2-448f-8d33-fdac96a6bb33 => generated 1512 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:04:49.236532 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-6526d9ca-c5f6-4977-80ff-0703df88bfbc tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Calling method '.version_select at 0x7fd39eeebee0>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:04:49.239257 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-655d2f13-9d7e-492b-a391-c6d13d667b8e req-ef80f6dc-bb75-4064-8574-902a346da666 service nova] Creating event network-vif-plugged:cbfb6cca-3060-4248-8fe5-5bd4144394eb for instance 931293d3-cb3a-4fd1-a684-eb740f010845 on nch1-master-1 Oct 22 21:04:49.252472 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-655d2f13-9d7e-492b-a391-c6d13d667b8e req-ef80f6dc-bb75-4064-8574-902a346da666 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108610 Oct 22 21:04:49.253143 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1614/3294] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:04:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:04:49.270946 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-ff38c2f4-8bf6-4ab5-83f0-f01900feb4fa tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:04:49.271765 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-ff38c2f4-8bf6-4ab5-83f0-f01900feb4fa tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] [instance: 87b07efc-fa80-40ad-8077-333547ee7301] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:04:49.303909 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ff38c2f4-8bf6-4ab5-83f0-f01900feb4fa tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:49.308653 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ff38c2f4-8bf6-4ab5-83f0-f01900feb4fa tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:49.313379 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ff38c2f4-8bf6-4ab5-83f0-f01900feb4fa tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:49.315653 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ff38c2f4-8bf6-4ab5-83f0-f01900feb4fa tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:49.322814 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ff38c2f4-8bf6-4ab5-83f0-f01900feb4fa tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:49.323353 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ff38c2f4-8bf6-4ab5-83f0-f01900feb4fa tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:49.905130 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-ff38c2f4-8bf6-4ab5-83f0-f01900feb4fa tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879c85830a9f42088a4ebdf1e3cfb39b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b54f56cfbc814cccb533c65966f35a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:04:49.920194 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-ff38c2f4-8bf6-4ab5-83f0-f01900feb4fa tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] 10.222.0.18 "GET /compute/v2.1/servers/87b07efc-fa80-40ad-8077-333547ee7301" status: 200 len: 1505 microversion: 2.1 time: 0.662476 Oct 22 21:04:49.928790 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1615/3295] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:04:49 2022] GET /compute/v2.1/servers/87b07efc-fa80-40ad-8077-333547ee7301 => generated 1505 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:04:49.955711 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-cbcd9a9a-88e4-4c02-87f3-5e906adfc944 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:04:49.960975 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-cbcd9a9a-88e4-4c02-87f3-5e906adfc944 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] [instance: 931293d3-cb3a-4fd1-a684-eb740f010845] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:04:49.974308 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cbcd9a9a-88e4-4c02-87f3-5e906adfc944 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:49.978849 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cbcd9a9a-88e4-4c02-87f3-5e906adfc944 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:49.979493 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cbcd9a9a-88e4-4c02-87f3-5e906adfc944 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:49.980331 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cbcd9a9a-88e4-4c02-87f3-5e906adfc944 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:49.980816 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cbcd9a9a-88e4-4c02-87f3-5e906adfc944 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:49.981322 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cbcd9a9a-88e4-4c02-87f3-5e906adfc944 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:50.223006 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-6526d9ca-c5f6-4977-80ff-0703df88bfbc tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] 10.222.0.18 "GET /compute/v2.1/images/fefdb332-d8c8-4dbc-8b2b-6d54994dca11" status: 200 len: 1414 microversion: 2.1 time: 0.994815 Oct 22 21:04:50.223677 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1681/3296] 10.222.0.18 () {58 vars in 1233 bytes} [Sat Oct 22 21:04:49 2022] GET /compute/v2.1/images/fefdb332-d8c8-4dbc-8b2b-6d54994dca11 => generated 1414 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:04:50.236076 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-595fbc69-ea5e-4fd9-883a-88c0edfbb6db tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1121400046", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "f9a02f5e-9789-4559-a823-7403b3207f03", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "7fc34993-7108-4fcb-8386-9f829c6044b7"}]}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:04:50.266861 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-cbcd9a9a-88e4-4c02-87f3-5e906adfc944 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1b410a64e0415a96d30f5040361137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd7873d6db4e09bc9ab9a048a6b1ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:04:50.290594 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-cbcd9a9a-88e4-4c02-87f3-5e906adfc944 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] 10.222.0.18 "GET /compute/v2.1/servers/931293d3-cb3a-4fd1-a684-eb740f010845" status: 200 len: 1313 microversion: 2.1 time: 0.340243 Oct 22 21:04:50.294022 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1616/3297] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:04:49 2022] GET /compute/v2.1/servers/931293d3-cb3a-4fd1-a684-eb740f010845 => generated 1313 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:04:50.309480 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-6fa33e68-42aa-4da9-9051-07d4700e246c tempest-ServerAddressesTestJSON-849573313 tempest-ServerAddressesTestJSON-849573313-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:04:50.311181 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-6fa33e68-42aa-4da9-9051-07d4700e246c tempest-ServerAddressesTestJSON-849573313 tempest-ServerAddressesTestJSON-849573313-project] [instance: 492fde48-2dc2-448f-8d33-fdac96a6bb33] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:04:50.330881 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6fa33e68-42aa-4da9-9051-07d4700e246c tempest-ServerAddressesTestJSON-849573313 tempest-ServerAddressesTestJSON-849573313-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:50.331547 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6fa33e68-42aa-4da9-9051-07d4700e246c tempest-ServerAddressesTestJSON-849573313 tempest-ServerAddressesTestJSON-849573313-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:50.332242 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6fa33e68-42aa-4da9-9051-07d4700e246c tempest-ServerAddressesTestJSON-849573313 tempest-ServerAddressesTestJSON-849573313-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:50.333196 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6fa33e68-42aa-4da9-9051-07d4700e246c tempest-ServerAddressesTestJSON-849573313 tempest-ServerAddressesTestJSON-849573313-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:50.334188 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6fa33e68-42aa-4da9-9051-07d4700e246c tempest-ServerAddressesTestJSON-849573313 tempest-ServerAddressesTestJSON-849573313-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:50.334897 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6fa33e68-42aa-4da9-9051-07d4700e246c tempest-ServerAddressesTestJSON-849573313 tempest-ServerAddressesTestJSON-849573313-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:50.446487 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.network.neutron [None req-595fbc69-ea5e-4fd9-883a-88c0edfbb6db tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] validate_networks() for [('7fc34993-7108-4fcb-8386-9f829c6044b7', None, None, None, None, None)] {{(pid=138745) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 21:04:51.279708 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-6fa33e68-42aa-4da9-9051-07d4700e246c tempest-ServerAddressesTestJSON-849573313 tempest-ServerAddressesTestJSON-849573313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703cd05e0f824241bed1565a3a6a7ff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62cda3990bbe4c36a7240c9df581ff62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:04:51.302558 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-6fa33e68-42aa-4da9-9051-07d4700e246c tempest-ServerAddressesTestJSON-849573313 tempest-ServerAddressesTestJSON-849573313-project] 10.222.0.18 "GET /compute/v2.1/servers/492fde48-2dc2-448f-8d33-fdac96a6bb33" status: 200 len: 1512 microversion: 2.1 time: 1.006000 Oct 22 21:04:51.303432 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1617/3298] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:04:50 2022] GET /compute/v2.1/servers/492fde48-2dc2-448f-8d33-fdac96a6bb33 => generated 1512 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:04:51.325719 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-cd2c0851-28a6-4f7b-8a12-b8841a2ace5a tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:04:51.326349 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-cd2c0851-28a6-4f7b-8a12-b8841a2ace5a tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] [instance: 87b07efc-fa80-40ad-8077-333547ee7301] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:04:51.337934 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cd2c0851-28a6-4f7b-8a12-b8841a2ace5a tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:51.340457 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cd2c0851-28a6-4f7b-8a12-b8841a2ace5a tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:51.342229 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cd2c0851-28a6-4f7b-8a12-b8841a2ace5a tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:51.343383 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cd2c0851-28a6-4f7b-8a12-b8841a2ace5a tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:51.345848 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cd2c0851-28a6-4f7b-8a12-b8841a2ace5a tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:51.346481 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cd2c0851-28a6-4f7b-8a12-b8841a2ace5a tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:51.765997 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-cd2c0851-28a6-4f7b-8a12-b8841a2ace5a tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879c85830a9f42088a4ebdf1e3cfb39b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b54f56cfbc814cccb533c65966f35a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:04:51.779918 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-cd2c0851-28a6-4f7b-8a12-b8841a2ace5a tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] 10.222.0.18 "GET /compute/v2.1/servers/87b07efc-fa80-40ad-8077-333547ee7301" status: 200 len: 1505 microversion: 2.1 time: 0.466492 Oct 22 21:04:51.782384 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1618/3299] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:04:51 2022] GET /compute/v2.1/servers/87b07efc-fa80-40ad-8077-333547ee7301 => generated 1505 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:04:51.811862 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-5af869c3-2a52-4d98-ae8e-22e4d788922a tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Calling method '.version_select at 0x7fd39ef86820>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:04:52.296943 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-595fbc69-ea5e-4fd9-883a-88c0edfbb6db tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Flavor limits 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 21:04:52.297562 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-595fbc69-ea5e-4fd9-883a-88c0edfbb6db tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Image limits 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 21:04:52.297832 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-595fbc69-ea5e-4fd9-883a-88c0edfbb6db tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Flavor pref 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 21:04:52.298247 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-595fbc69-ea5e-4fd9-883a-88c0edfbb6db tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Image pref 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 21:04:52.298868 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-595fbc69-ea5e-4fd9-883a-88c0edfbb6db tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 21:04:52.318012 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-595fbc69-ea5e-4fd9-883a-88c0edfbb6db tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:52.320099 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-595fbc69-ea5e-4fd9-883a-88c0edfbb6db tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:52.320894 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-595fbc69-ea5e-4fd9-883a-88c0edfbb6db tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:52.323887 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-595fbc69-ea5e-4fd9-883a-88c0edfbb6db tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:52.324468 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-595fbc69-ea5e-4fd9-883a-88c0edfbb6db tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:52.326683 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-595fbc69-ea5e-4fd9-883a-88c0edfbb6db tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:52.378523 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-5af869c3-2a52-4d98-ae8e-22e4d788922a tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] 10.222.0.18 "GET /compute/v2.1/images/fefdb332-d8c8-4dbc-8b2b-6d54994dca11" status: 200 len: 1414 microversion: 2.1 time: 0.594192 Oct 22 21:04:52.379082 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-595fbc69-ea5e-4fd9-883a-88c0edfbb6db tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Getting quotas for project 82a42c3ecf474883ac652fcc8c01c9f2. Resources: {'cores', 'instances', 'ram'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 21:04:52.381513 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1619/3300] 10.222.0.18 () {58 vars in 1233 bytes} [Sat Oct 22 21:04:51 2022] GET /compute/v2.1/images/fefdb332-d8c8-4dbc-8b2b-6d54994dca11 => generated 1414 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:04:52.394978 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-595fbc69-ea5e-4fd9-883a-88c0edfbb6db tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Getting quotas for user 7e3820b31a424c3a9216a6ef91fcb285 and project 82a42c3ecf474883ac652fcc8c01c9f2. Resources: {'cores', 'instances', 'ram'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 21:04:52.395154 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-9b0efa40-e141-43c9-95ab-a2291156520b tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:04:52.395793 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-9b0efa40-e141-43c9-95ab-a2291156520b tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] [instance: 931293d3-cb3a-4fd1-a684-eb740f010845] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:04:52.421614 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9b0efa40-e141-43c9-95ab-a2291156520b tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:52.423450 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9b0efa40-e141-43c9-95ab-a2291156520b tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:52.424260 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9b0efa40-e141-43c9-95ab-a2291156520b tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:52.425580 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9b0efa40-e141-43c9-95ab-a2291156520b tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:52.426537 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9b0efa40-e141-43c9-95ab-a2291156520b tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:52.426685 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-595fbc69-ea5e-4fd9-883a-88c0edfbb6db tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Going to run 1 instances... {{(pid=138745) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 21:04:52.428198 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9b0efa40-e141-43c9-95ab-a2291156520b tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:52.435962 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-595fbc69-ea5e-4fd9-883a-88c0edfbb6db tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] [instance: ebd7be2f-44d6-4f75-b112-0d6af4731f65] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='f9a02f5e-9789-4559-a823-7403b3207f03',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138745) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 21:04:52.624018 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-595fbc69-ea5e-4fd9-883a-88c0edfbb6db tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.399279 Oct 22 21:04:52.626674 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1682/3301] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Oct 22 21:04:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 2401 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 21:04:52.639425 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-8779815e-0c2d-4ced-ae90-76fe138b6707 tempest-ServerAddressesTestJSON-849573313 tempest-ServerAddressesTestJSON-849573313-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:04:52.640762 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-8779815e-0c2d-4ced-ae90-76fe138b6707 tempest-ServerAddressesTestJSON-849573313 tempest-ServerAddressesTestJSON-849573313-project] [instance: 492fde48-2dc2-448f-8d33-fdac96a6bb33] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:04:52.656697 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8779815e-0c2d-4ced-ae90-76fe138b6707 tempest-ServerAddressesTestJSON-849573313 tempest-ServerAddressesTestJSON-849573313-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:52.662585 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8779815e-0c2d-4ced-ae90-76fe138b6707 tempest-ServerAddressesTestJSON-849573313 tempest-ServerAddressesTestJSON-849573313-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:52.663238 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8779815e-0c2d-4ced-ae90-76fe138b6707 tempest-ServerAddressesTestJSON-849573313 tempest-ServerAddressesTestJSON-849573313-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:52.665086 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8779815e-0c2d-4ced-ae90-76fe138b6707 tempest-ServerAddressesTestJSON-849573313 tempest-ServerAddressesTestJSON-849573313-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:52.666763 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8779815e-0c2d-4ced-ae90-76fe138b6707 tempest-ServerAddressesTestJSON-849573313 tempest-ServerAddressesTestJSON-849573313-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:52.667511 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8779815e-0c2d-4ced-ae90-76fe138b6707 tempest-ServerAddressesTestJSON-849573313 tempest-ServerAddressesTestJSON-849573313-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:52.906347 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-8779815e-0c2d-4ced-ae90-76fe138b6707 tempest-ServerAddressesTestJSON-849573313 tempest-ServerAddressesTestJSON-849573313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703cd05e0f824241bed1565a3a6a7ff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62cda3990bbe4c36a7240c9df581ff62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:04:52.923494 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-8779815e-0c2d-4ced-ae90-76fe138b6707 tempest-ServerAddressesTestJSON-849573313 tempest-ServerAddressesTestJSON-849573313-project] 10.222.0.18 "GET /compute/v2.1/servers/492fde48-2dc2-448f-8d33-fdac96a6bb33" status: 200 len: 1470 microversion: 2.1 time: 0.286768 Oct 22 21:04:52.926327 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1683/3302] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:04:52 2022] GET /compute/v2.1/servers/492fde48-2dc2-448f-8d33-fdac96a6bb33 => generated 1470 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:04:52.946519 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-edbe5363-0076-477e-8e46-fa105e74a6d6 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:04:52.952065 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-edbe5363-0076-477e-8e46-fa105e74a6d6 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] [instance: ebd7be2f-44d6-4f75-b112-0d6af4731f65] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:04:53.226947 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-edbe5363-0076-477e-8e46-fa105e74a6d6 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3820b31a424c3a9216a6ef91fcb285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a42c3ecf474883ac652fcc8c01c9f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:04:53.242313 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-edbe5363-0076-477e-8e46-fa105e74a6d6 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] 10.222.0.18 "GET /compute/v2.1/servers/ebd7be2f-44d6-4f75-b112-0d6af4731f65" status: 200 len: 1057 microversion: 2.1 time: 0.307830 Oct 22 21:04:53.257208 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1684/3303] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:04:52 2022] GET /compute/v2.1/servers/ebd7be2f-44d6-4f75-b112-0d6af4731f65 => generated 1057 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:04:53.257208 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-86b16ac2-7680-4d22-8393-31940afb30d6 req-df176989-cdfa-4b01-9dd9-fd7635ed65ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "492fde48-2dc2-448f-8d33-fdac96a6bb33", "name": "network-vif-deleted", "tag": "1d6f49d3-65fb-4151-aee6-cd415fd5f899"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:04:53.300176 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-86b16ac2-7680-4d22-8393-31940afb30d6 req-df176989-cdfa-4b01-9dd9-fd7635ed65ea service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:53.303606 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-86b16ac2-7680-4d22-8393-31940afb30d6 req-df176989-cdfa-4b01-9dd9-fd7635ed65ea service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:53.306808 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-86b16ac2-7680-4d22-8393-31940afb30d6 req-df176989-cdfa-4b01-9dd9-fd7635ed65ea service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:53.345742 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-86b16ac2-7680-4d22-8393-31940afb30d6 req-df176989-cdfa-4b01-9dd9-fd7635ed65ea service nova] Creating event network-vif-deleted:1d6f49d3-65fb-4151-aee6-cd415fd5f899 for instance 492fde48-2dc2-448f-8d33-fdac96a6bb33 on nch1-master-1 Oct 22 21:04:53.368075 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-86b16ac2-7680-4d22-8393-31940afb30d6 req-df176989-cdfa-4b01-9dd9-fd7635ed65ea service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110372 Oct 22 21:04:53.372187 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1685/3304] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:04:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:04:53.385698 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-e9f13f77-8754-46f3-8991-270a9fbb6231 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:04:53.394200 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-e9f13f77-8754-46f3-8991-270a9fbb6231 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] [instance: 87b07efc-fa80-40ad-8077-333547ee7301] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:04:53.415179 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e9f13f77-8754-46f3-8991-270a9fbb6231 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:53.417534 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e9f13f77-8754-46f3-8991-270a9fbb6231 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:53.418510 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e9f13f77-8754-46f3-8991-270a9fbb6231 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:53.420246 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e9f13f77-8754-46f3-8991-270a9fbb6231 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:53.421199 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e9f13f77-8754-46f3-8991-270a9fbb6231 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:53.423293 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e9f13f77-8754-46f3-8991-270a9fbb6231 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:53.489747 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-9b0efa40-e141-43c9-95ab-a2291156520b tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1b410a64e0415a96d30f5040361137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd7873d6db4e09bc9ab9a048a6b1ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:04:53.509620 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-9b0efa40-e141-43c9-95ab-a2291156520b tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] 10.222.0.18 "GET /compute/v2.1/servers/931293d3-cb3a-4fd1-a684-eb740f010845" status: 200 len: 1500 microversion: 2.1 time: 1.125484 Oct 22 21:04:53.525524 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1620/3305] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:04:52 2022] GET /compute/v2.1/servers/931293d3-cb3a-4fd1-a684-eb740f010845 => generated 1500 bytes in 1139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:04:53.531447 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-25791bf8-9957-4115-839b-a7476e16fb94 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Calling method '.version_select at 0x7fd39efd0820>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:04:53.661645 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-25791bf8-9957-4115-839b-a7476e16fb94 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] 10.222.0.18 "GET /compute/v2.1/images/fefdb332-d8c8-4dbc-8b2b-6d54994dca11" status: 200 len: 1414 microversion: 2.1 time: 0.133005 Oct 22 21:04:53.662511 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1621/3306] 10.222.0.18 () {58 vars in 1233 bytes} [Sat Oct 22 21:04:53 2022] GET /compute/v2.1/images/fefdb332-d8c8-4dbc-8b2b-6d54994dca11 => generated 1414 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:04:53.679192 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-1df06732-6979-4e76-a61b-8d5ea70408c7 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:04:53.704294 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1df06732-6979-4e76-a61b-8d5ea70408c7 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:53.706842 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1df06732-6979-4e76-a61b-8d5ea70408c7 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:53.707397 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1df06732-6979-4e76-a61b-8d5ea70408c7 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:53.805432 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-1df06732-6979-4e76-a61b-8d5ea70408c7 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] [instance: 931293d3-cb3a-4fd1-a684-eb740f010845] Going to try to stop instance {{(pid=138744) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 22 21:04:53.946326 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-1df06732-6979-4e76-a61b-8d5ea70408c7 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] 10.222.0.18 "POST /compute/v2.1/servers/931293d3-cb3a-4fd1-a684-eb740f010845/action" status: 202 len: 0 microversion: 2.1 time: 0.280774 Oct 22 21:04:53.947469 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1622/3307] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 21:04:53 2022] POST /compute/v2.1/servers/931293d3-cb3a-4fd1-a684-eb740f010845/action => generated 0 bytes in 283 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 21:04:53.957243 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-27a90fc3-3b5e-4060-ad0d-8150870f7888 tempest-ServerAddressesTestJSON-849573313 tempest-ServerAddressesTestJSON-849573313-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:04:53.958215 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-27a90fc3-3b5e-4060-ad0d-8150870f7888 tempest-ServerAddressesTestJSON-849573313 tempest-ServerAddressesTestJSON-849573313-project] [instance: 492fde48-2dc2-448f-8d33-fdac96a6bb33] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:04:53.975220 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-27a90fc3-3b5e-4060-ad0d-8150870f7888 tempest-ServerAddressesTestJSON-849573313 tempest-ServerAddressesTestJSON-849573313-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:53.976529 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-27a90fc3-3b5e-4060-ad0d-8150870f7888 tempest-ServerAddressesTestJSON-849573313 tempest-ServerAddressesTestJSON-849573313-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:53.978513 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-27a90fc3-3b5e-4060-ad0d-8150870f7888 tempest-ServerAddressesTestJSON-849573313 tempest-ServerAddressesTestJSON-849573313-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:53.982128 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-27a90fc3-3b5e-4060-ad0d-8150870f7888 tempest-ServerAddressesTestJSON-849573313 tempest-ServerAddressesTestJSON-849573313-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:53.984564 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-27a90fc3-3b5e-4060-ad0d-8150870f7888 tempest-ServerAddressesTestJSON-849573313 tempest-ServerAddressesTestJSON-849573313-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:53.985272 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-27a90fc3-3b5e-4060-ad0d-8150870f7888 tempest-ServerAddressesTestJSON-849573313 tempest-ServerAddressesTestJSON-849573313-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:54.064146 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-27a90fc3-3b5e-4060-ad0d-8150870f7888 tempest-ServerAddressesTestJSON-849573313 tempest-ServerAddressesTestJSON-849573313-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:54.066960 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-27a90fc3-3b5e-4060-ad0d-8150870f7888 tempest-ServerAddressesTestJSON-849573313 tempest-ServerAddressesTestJSON-849573313-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:54.069364 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-27a90fc3-3b5e-4060-ad0d-8150870f7888 tempest-ServerAddressesTestJSON-849573313 tempest-ServerAddressesTestJSON-849573313-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:54.071264 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.objects.instance [None req-27a90fc3-3b5e-4060-ad0d-8150870f7888 tempest-ServerAddressesTestJSON-849573313 tempest-ServerAddressesTestJSON-849573313-project] Lazy-loading 'fault' on Instance uuid 492fde48-2dc2-448f-8d33-fdac96a6bb33 {{(pid=138744) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 21:04:54.260105 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-27a90fc3-3b5e-4060-ad0d-8150870f7888 tempest-ServerAddressesTestJSON-849573313 tempest-ServerAddressesTestJSON-849573313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703cd05e0f824241bed1565a3a6a7ff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62cda3990bbe4c36a7240c9df581ff62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:04:54.267971 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-27a90fc3-3b5e-4060-ad0d-8150870f7888 tempest-ServerAddressesTestJSON-849573313 tempest-ServerAddressesTestJSON-849573313-project] 10.222.0.18 "GET /compute/v2.1/servers/492fde48-2dc2-448f-8d33-fdac96a6bb33" status: 200 len: 1306 microversion: 2.1 time: 0.318768 Oct 22 21:04:54.272738 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1623/3308] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:04:53 2022] GET /compute/v2.1/servers/492fde48-2dc2-448f-8d33-fdac96a6bb33 => generated 1306 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:04:54.326081 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-2a860f3d-fce9-49de-acc6-048658993f5f tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:04:54.328761 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-2a860f3d-fce9-49de-acc6-048658993f5f tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] [instance: 931293d3-cb3a-4fd1-a684-eb740f010845] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:04:54.344750 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2a860f3d-fce9-49de-acc6-048658993f5f tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:54.346421 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2a860f3d-fce9-49de-acc6-048658993f5f tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:54.348827 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2a860f3d-fce9-49de-acc6-048658993f5f tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:54.349990 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2a860f3d-fce9-49de-acc6-048658993f5f tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:54.357877 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2a860f3d-fce9-49de-acc6-048658993f5f tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:54.360140 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2a860f3d-fce9-49de-acc6-048658993f5f tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:54.418730 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-e9f13f77-8754-46f3-8991-270a9fbb6231 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879c85830a9f42088a4ebdf1e3cfb39b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b54f56cfbc814cccb533c65966f35a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:04:54.427512 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:04:54.428575 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:04:54.436662 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-e9f13f77-8754-46f3-8991-270a9fbb6231 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] 10.222.0.18 "GET /compute/v2.1/servers/87b07efc-fa80-40ad-8077-333547ee7301" status: 200 len: 1505 microversion: 2.1 time: 1.060753 Oct 22 21:04:54.438568 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1686/3309] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:04:53 2022] GET /compute/v2.1/servers/87b07efc-fa80-40ad-8077-333547ee7301 => generated 1505 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:04:54.478390 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-e71beb3f-dbbe-4654-a3c5-1a25896a7822 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:04:54.479435 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-e71beb3f-dbbe-4654-a3c5-1a25896a7822 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] [instance: ebd7be2f-44d6-4f75-b112-0d6af4731f65] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:04:54.496767 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e71beb3f-dbbe-4654-a3c5-1a25896a7822 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:54.501029 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e71beb3f-dbbe-4654-a3c5-1a25896a7822 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:54.501879 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e71beb3f-dbbe-4654-a3c5-1a25896a7822 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:54.503249 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e71beb3f-dbbe-4654-a3c5-1a25896a7822 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:54.504094 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e71beb3f-dbbe-4654-a3c5-1a25896a7822 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:54.513261 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e71beb3f-dbbe-4654-a3c5-1a25896a7822 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:54.685317 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-e71beb3f-dbbe-4654-a3c5-1a25896a7822 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3820b31a424c3a9216a6ef91fcb285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a42c3ecf474883ac652fcc8c01c9f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:04:54.697818 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-e71beb3f-dbbe-4654-a3c5-1a25896a7822 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] 10.222.0.18 "GET /compute/v2.1/servers/ebd7be2f-44d6-4f75-b112-0d6af4731f65" status: 200 len: 1109 microversion: 2.1 time: 0.241095 Oct 22 21:04:54.698401 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1687/3310] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:04:54 2022] GET /compute/v2.1/servers/ebd7be2f-44d6-4f75-b112-0d6af4731f65 => generated 1109 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:04:54.708373 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-c7cb68d9-ff10-4fd7-a2ed-1fb62d142d7b tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Calling method '.version_select at 0x7fd39ee40f70>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:04:54.829235 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-c7cb68d9-ff10-4fd7-a2ed-1fb62d142d7b tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] 10.222.0.18 "GET /compute/v2.1/images/fefdb332-d8c8-4dbc-8b2b-6d54994dca11" status: 200 len: 1414 microversion: 2.1 time: 0.124606 Oct 22 21:04:54.837828 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1688/3311] 10.222.0.18 () {58 vars in 1233 bytes} [Sat Oct 22 21:04:54 2022] GET /compute/v2.1/images/fefdb332-d8c8-4dbc-8b2b-6d54994dca11 => generated 1414 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:04:54.874642 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell0:SELECT=6 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:04:54.886546 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-2a860f3d-fce9-49de-acc6-048658993f5f tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1b410a64e0415a96d30f5040361137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd7873d6db4e09bc9ab9a048a6b1ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:04:54.902416 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-2a860f3d-fce9-49de-acc6-048658993f5f tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] 10.222.0.18 "GET /compute/v2.1/servers/931293d3-cb3a-4fd1-a684-eb740f010845" status: 200 len: 1510 microversion: 2.1 time: 0.602824 Oct 22 21:04:54.918665 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1624/3312] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:04:54 2022] GET /compute/v2.1/servers/931293d3-cb3a-4fd1-a684-eb740f010845 => generated 1510 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:04:55.300465 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-89180d38-3255-4b36-b3da-5d5a5f99d807 tempest-ServerAddressesTestJSON-849573313 tempest-ServerAddressesTestJSON-849573313-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:04:55.301163 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-89180d38-3255-4b36-b3da-5d5a5f99d807 tempest-ServerAddressesTestJSON-849573313 tempest-ServerAddressesTestJSON-849573313-project] [instance: 492fde48-2dc2-448f-8d33-fdac96a6bb33] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:04:55.317864 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-89180d38-3255-4b36-b3da-5d5a5f99d807 tempest-ServerAddressesTestJSON-849573313 tempest-ServerAddressesTestJSON-849573313-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:55.318874 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-89180d38-3255-4b36-b3da-5d5a5f99d807 tempest-ServerAddressesTestJSON-849573313 tempest-ServerAddressesTestJSON-849573313-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:55.324002 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-89180d38-3255-4b36-b3da-5d5a5f99d807 tempest-ServerAddressesTestJSON-849573313 tempest-ServerAddressesTestJSON-849573313-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:55.324577 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-89180d38-3255-4b36-b3da-5d5a5f99d807 tempest-ServerAddressesTestJSON-849573313 tempest-ServerAddressesTestJSON-849573313-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:55.325842 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-89180d38-3255-4b36-b3da-5d5a5f99d807 tempest-ServerAddressesTestJSON-849573313 tempest-ServerAddressesTestJSON-849573313-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:55.326610 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-89180d38-3255-4b36-b3da-5d5a5f99d807 tempest-ServerAddressesTestJSON-849573313 tempest-ServerAddressesTestJSON-849573313-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:55.366039 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.wsgi [None req-89180d38-3255-4b36-b3da-5d5a5f99d807 tempest-ServerAddressesTestJSON-849573313 tempest-ServerAddressesTestJSON-849573313-project] HTTP exception thrown: Instance 492fde48-2dc2-448f-8d33-fdac96a6bb33 could not be found. Oct 22 21:04:55.378135 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-89180d38-3255-4b36-b3da-5d5a5f99d807 tempest-ServerAddressesTestJSON-849573313 tempest-ServerAddressesTestJSON-849573313-project] Request method failure captured: Oct 22 21:04:55.378135 ncdv-master-1 devstack@n-api.service[138745]: request: GET /compute/v2.1/servers/492fde48-2dc2-448f-8d33-fdac96a6bb33 HTTP/1.1 Oct 22 21:04:55.378135 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 21:04:55.378135 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 21:04:55.378135 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 21:04:55.378135 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 0 Oct 22 21:04:55.378135 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 21:04:55.378135 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 21:04:55.378135 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 21:04:55.378135 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 21:04:55.378135 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVFrWuGl_bI1ggVVpzyXikcu0Yvqjkjmtxqb4wWEzz7S27XIHoC4NvqxnYsDVp7fCNH6YyNznhtNV3Mltn6GQl6dJ09eTFwB9Nt1ZRcscXqPTLpD0r_uZgJ4dg6JE0IXtlWwYZryUzRtvILfBWQ1uTHht9Zp3U4Jjv-wkfRmkb5LaC7c Oct 22 21:04:55.378135 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 21:04:55.378135 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 21:04:55.378135 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 21:04:55.378135 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 21:04:55.378135 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 21:04:55.378135 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 21:04:55.378135 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: 62cda3990bbe4c36a7240c9df581ff62 Oct 22 21:04:55.378135 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-ServerAddressesTestJSON-849573313 Oct 22 21:04:55.378135 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 21:04:55.378135 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 21:04:55.378135 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_62cda3990bbe4c36a7240c9df581ff62"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/62cda3990bbe4c36a7240c9df581ff62"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/62cda3990bbe4c36a7240c9df581ff62"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/62cda3990bbe4c36a7240c9df581ff62"}]}] Oct 22 21:04:55.378135 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-ServerAddressesTestJSON-849573313 Oct 22 21:04:55.378135 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: 62cda3990bbe4c36a7240c9df581ff62 Oct 22 21:04:55.378135 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-ServerAddressesTestJSON-849573313 Oct 22 21:04:55.378135 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-ServerAddressesTestJSON-849573313-project Oct 22 21:04:55.378135 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 21:04:55.378135 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 21:04:55.378135 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: 703cd05e0f824241bed1565a3a6a7ff3 Oct 22 21:04:55.378135 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-ServerAddressesTestJSON-849573313-project Oct 22 21:04:55.378135 ncdv-master-1 devstack@n-api.service[138745]: method: > Oct 22 21:04:55.378135 ncdv-master-1 devstack@n-api.service[138745]: exception: Instance 492fde48-2dc2-448f-8d33-fdac96a6bb33 could not be found. Oct 22 21:04:55.378135 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'id': '492fde48-2dc2-448f-8d33-fdac96a6bb33'} Oct 22 21:04:55.378135 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:04:55.378135 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:04:55.378135 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 21:04:55.378135 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 21:04:55.378135 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 21:04:55.378135 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 21:04:55.378135 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 21:04:55.378135 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 21:04:55.378135 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 21:04:55.378135 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 21:04:55.378135 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 492fde48-2dc2-448f-8d33-fdac96a6bb33 could not be found. Oct 22 21:04:55.378135 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:04:55.378135 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:04:55.378135 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:04:55.378135 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:04:55.378135 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:04:55.378135 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:04:55.378135 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:04:55.378135 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:04:55.378135 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:04:55.378135 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:04:55.378135 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 21:04:55.378135 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 21:04:55.378135 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 21:04:55.378135 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 21:04:55.378135 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 21:04:55.378135 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:04:55.378135 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 492fde48-2dc2-448f-8d33-fdac96a6bb33 could not be found. Oct 22 21:04:55.378135 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:04:55.378135 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:04:55.378135 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:04:55.383840 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:04:55.383840 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:04:55.383840 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:04:55.383840 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:04:55.383840 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:04:55.383840 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 492fde48-2dc2-448f-8d33-fdac96a6bb33 could not be found. Oct 22 21:04:55.383840 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:04:55.383840 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-89180d38-3255-4b36-b3da-5d5a5f99d807 tempest-ServerAddressesTestJSON-849573313 tempest-ServerAddressesTestJSON-849573313-project] Returning 404 to user: Instance 492fde48-2dc2-448f-8d33-fdac96a6bb33 could not be found. {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:04:55.383840 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-89180d38-3255-4b36-b3da-5d5a5f99d807 tempest-ServerAddressesTestJSON-849573313 tempest-ServerAddressesTestJSON-849573313-project] 10.222.0.18 "GET /compute/v2.1/servers/492fde48-2dc2-448f-8d33-fdac96a6bb33" status: 404 len: 111 microversion: 2.1 time: 0.088687 Oct 22 21:04:55.388714 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1689/3313] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:04:55 2022] GET /compute/v2.1/servers/492fde48-2dc2-448f-8d33-fdac96a6bb33 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 21:04:55.482719 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-017bc433-b73f-4f68-88c1-7f16a14c739f tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:04:55.483419 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-017bc433-b73f-4f68-88c1-7f16a14c739f tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] [instance: 87b07efc-fa80-40ad-8077-333547ee7301] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:04:55.519708 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-017bc433-b73f-4f68-88c1-7f16a14c739f tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:55.520460 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-017bc433-b73f-4f68-88c1-7f16a14c739f tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:55.521123 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-017bc433-b73f-4f68-88c1-7f16a14c739f tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:55.522152 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-017bc433-b73f-4f68-88c1-7f16a14c739f tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:55.522914 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-017bc433-b73f-4f68-88c1-7f16a14c739f tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:55.523592 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-017bc433-b73f-4f68-88c1-7f16a14c739f tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:55.721977 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-915e76fd-be9f-4908-953d-76c912c9780c tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:04:55.723268 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-915e76fd-be9f-4908-953d-76c912c9780c tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] [instance: ebd7be2f-44d6-4f75-b112-0d6af4731f65] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:04:55.746812 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-915e76fd-be9f-4908-953d-76c912c9780c tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:55.747354 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-915e76fd-be9f-4908-953d-76c912c9780c tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:55.747808 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-915e76fd-be9f-4908-953d-76c912c9780c tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:55.748541 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-915e76fd-be9f-4908-953d-76c912c9780c tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:55.749004 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-915e76fd-be9f-4908-953d-76c912c9780c tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:55.749445 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-915e76fd-be9f-4908-953d-76c912c9780c tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:56.207293 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-915e76fd-be9f-4908-953d-76c912c9780c tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3820b31a424c3a9216a6ef91fcb285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a42c3ecf474883ac652fcc8c01c9f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:04:56.216475 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-915e76fd-be9f-4908-953d-76c912c9780c tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] 10.222.0.18 "GET /compute/v2.1/servers/ebd7be2f-44d6-4f75-b112-0d6af4731f65" status: 200 len: 1117 microversion: 2.1 time: 0.498937 Oct 22 21:04:56.228853 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1690/3314] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:04:55 2022] GET /compute/v2.1/servers/ebd7be2f-44d6-4f75-b112-0d6af4731f65 => generated 1117 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:04:56.249961 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-a30f1819-f118-4532-97d0-11c5db2cb6a2 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Calling method '.version_select at 0x7fd39eed3550>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:04:56.336322 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-a30f1819-f118-4532-97d0-11c5db2cb6a2 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] 10.222.0.18 "GET /compute/v2.1/images/fefdb332-d8c8-4dbc-8b2b-6d54994dca11" status: 200 len: 1414 microversion: 2.1 time: 0.105276 Oct 22 21:04:56.337162 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1691/3315] 10.222.0.18 () {58 vars in 1233 bytes} [Sat Oct 22 21:04:56 2022] GET /compute/v2.1/images/fefdb332-d8c8-4dbc-8b2b-6d54994dca11 => generated 1414 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:04:56.343753 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-c55c592a-9837-466f-bdcd-479ef7381c33 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:04:56.352180 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-c55c592a-9837-466f-bdcd-479ef7381c33 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] [instance: 931293d3-cb3a-4fd1-a684-eb740f010845] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:04:56.365878 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c55c592a-9837-466f-bdcd-479ef7381c33 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:56.366469 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c55c592a-9837-466f-bdcd-479ef7381c33 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:56.371087 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c55c592a-9837-466f-bdcd-479ef7381c33 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:56.371971 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c55c592a-9837-466f-bdcd-479ef7381c33 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:56.372692 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c55c592a-9837-466f-bdcd-479ef7381c33 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:56.373350 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c55c592a-9837-466f-bdcd-479ef7381c33 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:57.285443 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-017bc433-b73f-4f68-88c1-7f16a14c739f tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879c85830a9f42088a4ebdf1e3cfb39b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b54f56cfbc814cccb533c65966f35a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:04:57.308747 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-017bc433-b73f-4f68-88c1-7f16a14c739f tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] 10.222.0.18 "GET /compute/v2.1/servers/87b07efc-fa80-40ad-8077-333547ee7301" status: 200 len: 1485 microversion: 2.1 time: 1.846324 Oct 22 21:04:57.309911 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1625/3316] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:04:55 2022] GET /compute/v2.1/servers/87b07efc-fa80-40ad-8077-333547ee7301 => generated 1485 bytes in 1849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:04:57.327912 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-eb690161-56be-43cc-903b-e471aa438e6f tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:04:57.328834 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-eb690161-56be-43cc-903b-e471aa438e6f tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] [instance: ebd7be2f-44d6-4f75-b112-0d6af4731f65] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:04:57.344516 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-eb690161-56be-43cc-903b-e471aa438e6f tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:57.345257 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-eb690161-56be-43cc-903b-e471aa438e6f tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:57.345870 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-eb690161-56be-43cc-903b-e471aa438e6f tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:57.347191 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-eb690161-56be-43cc-903b-e471aa438e6f tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:57.348176 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-eb690161-56be-43cc-903b-e471aa438e6f tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:57.348835 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-eb690161-56be-43cc-903b-e471aa438e6f tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:57.363831 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-c55c592a-9837-466f-bdcd-479ef7381c33 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1b410a64e0415a96d30f5040361137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd7873d6db4e09bc9ab9a048a6b1ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:04:57.380547 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-c55c592a-9837-466f-bdcd-479ef7381c33 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] 10.222.0.18 "GET /compute/v2.1/servers/931293d3-cb3a-4fd1-a684-eb740f010845" status: 200 len: 1510 microversion: 2.1 time: 1.041787 Oct 22 21:04:57.381351 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1692/3317] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:04:56 2022] GET /compute/v2.1/servers/931293d3-cb3a-4fd1-a684-eb740f010845 => generated 1510 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:04:57.402358 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-4e495c0c-da4a-4db9-9a1d-0d2268eecdd4 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Calling method '.version_select at 0x7fd39eed3820>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:04:57.520589 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-4e495c0c-da4a-4db9-9a1d-0d2268eecdd4 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] 10.222.0.18 "GET /compute/v2.1/images/fefdb332-d8c8-4dbc-8b2b-6d54994dca11" status: 200 len: 1414 microversion: 2.1 time: 0.133701 Oct 22 21:04:57.526092 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1693/3318] 10.222.0.18 () {58 vars in 1233 bytes} [Sat Oct 22 21:04:57 2022] GET /compute/v2.1/images/fefdb332-d8c8-4dbc-8b2b-6d54994dca11 => generated 1414 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:04:57.560308 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-e97d8d76-c2f1-411c-bf58-3642be1c236d tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:04:57.566605 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-e97d8d76-c2f1-411c-bf58-3642be1c236d tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] [instance: f38f14b2-b9d7-4bed-92ba-7b95ea4b2270] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:04:57.585683 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e97d8d76-c2f1-411c-bf58-3642be1c236d tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:57.589439 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e97d8d76-c2f1-411c-bf58-3642be1c236d tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:57.591635 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e97d8d76-c2f1-411c-bf58-3642be1c236d tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:57.595715 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e97d8d76-c2f1-411c-bf58-3642be1c236d tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:57.596440 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e97d8d76-c2f1-411c-bf58-3642be1c236d tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:57.597058 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e97d8d76-c2f1-411c-bf58-3642be1c236d tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:57.661432 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.wsgi [None req-e97d8d76-c2f1-411c-bf58-3642be1c236d tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] HTTP exception thrown: Instance f38f14b2-b9d7-4bed-92ba-7b95ea4b2270 could not be found. Oct 22 21:04:57.668619 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-e97d8d76-c2f1-411c-bf58-3642be1c236d tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Request method failure captured: Oct 22 21:04:57.668619 ncdv-master-1 devstack@n-api.service[138745]: request: DELETE /compute/v2.1/servers/f38f14b2-b9d7-4bed-92ba-7b95ea4b2270 HTTP/1.1 Oct 22 21:04:57.668619 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 21:04:57.668619 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 21:04:57.668619 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 21:04:57.668619 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 0 Oct 22 21:04:57.668619 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 21:04:57.668619 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 21:04:57.668619 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 21:04:57.668619 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 21:04:57.668619 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVFl1NsovoM-5upBofUoR1wJz3y3f7BN7i-ip8UquaFKR-Bwws5RaDaETkBhtKzdndp6MYRY8ukCbKnzwdM4Y6qNUxVfwFedn3ei1b7cigm0kIz6-neoAFZeBAi_YJs2sNYg8tIoGL0NhI8dAoKTuweu7Sty9RZOuF7Ns4bg1i0YJsIk Oct 22 21:04:57.668619 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 21:04:57.668619 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 21:04:57.668619 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 21:04:57.668619 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 21:04:57.668619 ncdv-master-1 devstack@n-api.service[138745]: X-Openstack-Nova-Api-Version: 2.42 Oct 22 21:04:57.668619 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 21:04:57.668619 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 21:04:57.668619 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: cd687d54e07d4ab4af00ad801ef4b58d Oct 22 21:04:57.668619 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1175888917 Oct 22 21:04:57.668619 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 21:04:57.668619 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 21:04:57.668619 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_cd687d54e07d4ab4af00ad801ef4b58d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/cd687d54e07d4ab4af00ad801ef4b58d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/cd687d54e07d4ab4af00ad801ef4b58d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/cd687d54e07d4ab4af00ad801ef4b58d"}]}] Oct 22 21:04:57.668619 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1175888917 Oct 22 21:04:57.668619 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: cd687d54e07d4ab4af00ad801ef4b58d Oct 22 21:04:57.668619 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1175888917 Oct 22 21:04:57.668619 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-TaggedBootDevicesTest_v242-1175888917-project Oct 22 21:04:57.668619 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 21:04:57.668619 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 21:04:57.668619 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: 211483c6acea4f76b6c0e4bfc818e7aa Oct 22 21:04:57.668619 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1175888917-project Oct 22 21:04:57.668619 ncdv-master-1 devstack@n-api.service[138745]: method: > Oct 22 21:04:57.668619 ncdv-master-1 devstack@n-api.service[138745]: exception: Instance f38f14b2-b9d7-4bed-92ba-7b95ea4b2270 could not be found. Oct 22 21:04:57.668619 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'id': 'f38f14b2-b9d7-4bed-92ba-7b95ea4b2270'} Oct 22 21:04:57.668619 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:04:57.668619 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:04:57.668619 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 21:04:57.668619 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 21:04:57.668619 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 21:04:57.668619 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 21:04:57.668619 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 21:04:57.668619 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 21:04:57.668619 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 21:04:57.668619 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 21:04:57.668619 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f38f14b2-b9d7-4bed-92ba-7b95ea4b2270 could not be found. Oct 22 21:04:57.668619 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:04:57.668619 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:04:57.668619 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:04:57.668619 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:04:57.668619 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:04:57.668619 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:04:57.668619 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:04:57.668619 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:04:57.668619 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:04:57.668619 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:04:57.668619 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 22 21:04:57.668619 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 22 21:04:57.668619 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 22 21:04:57.668619 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 22 21:04:57.668619 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 21:04:57.668619 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 21:04:57.668619 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 21:04:57.668619 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:04:57.675087 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f38f14b2-b9d7-4bed-92ba-7b95ea4b2270 could not be found. Oct 22 21:04:57.675087 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:04:57.675087 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:04:57.675087 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:04:57.675087 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:04:57.675087 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:04:57.675087 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:04:57.675087 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:04:57.675087 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:04:57.675087 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f38f14b2-b9d7-4bed-92ba-7b95ea4b2270 could not be found. Oct 22 21:04:57.675087 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:04:57.675087 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-e97d8d76-c2f1-411c-bf58-3642be1c236d tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Returning 404 to user: Instance f38f14b2-b9d7-4bed-92ba-7b95ea4b2270 could not be found. {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:04:57.675087 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-e97d8d76-c2f1-411c-bf58-3642be1c236d tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] 10.222.0.18 "DELETE /compute/v2.1/servers/f38f14b2-b9d7-4bed-92ba-7b95ea4b2270" status: 404 len: 111 microversion: 2.42 time: 0.125125 Oct 22 21:04:57.680169 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1694/3319] 10.222.0.18 () {60 vars in 1280 bytes} [Sat Oct 22 21:04:57 2022] DELETE /compute/v2.1/servers/f38f14b2-b9d7-4bed-92ba-7b95ea4b2270 => generated 111 bytes in 153 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 22 21:04:57.700627 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-30123863-5bea-4cf7-924a-2db576ffea37 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-459903389", "imageRef": "085e4478-6edc-4a69-8e08-f9831713eb65", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:04:57.834602 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.network.neutron [None req-30123863-5bea-4cf7-924a-2db576ffea37 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] validate_networks() for [('e38d9a19-7a78-47d2-978a-657e003fdabb', None, None, None, None, None)] {{(pid=138745) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 21:04:58.029986 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-eb690161-56be-43cc-903b-e471aa438e6f tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3820b31a424c3a9216a6ef91fcb285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a42c3ecf474883ac652fcc8c01c9f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:04:58.046403 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-eb690161-56be-43cc-903b-e471aa438e6f tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] 10.222.0.18 "GET /compute/v2.1/servers/ebd7be2f-44d6-4f75-b112-0d6af4731f65" status: 200 len: 1127 microversion: 2.1 time: 0.734248 Oct 22 21:04:58.055476 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1626/3320] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:04:57 2022] GET /compute/v2.1/servers/ebd7be2f-44d6-4f75-b112-0d6af4731f65 => generated 1127 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:04:58.055476 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-6ff118bb-4650-4744-adbb-27e36d2ffb07 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:04:58.059653 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-6ff118bb-4650-4744-adbb-27e36d2ffb07 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] [instance: f38f14b2-b9d7-4bed-92ba-7b95ea4b2270] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:04:58.078960 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6ff118bb-4650-4744-adbb-27e36d2ffb07 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:58.079829 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6ff118bb-4650-4744-adbb-27e36d2ffb07 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:58.081558 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6ff118bb-4650-4744-adbb-27e36d2ffb07 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:58.089175 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6ff118bb-4650-4744-adbb-27e36d2ffb07 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:58.089993 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6ff118bb-4650-4744-adbb-27e36d2ffb07 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:58.090678 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6ff118bb-4650-4744-adbb-27e36d2ffb07 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:58.126887 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-6ff118bb-4650-4744-adbb-27e36d2ffb07 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] HTTP exception thrown: Instance f38f14b2-b9d7-4bed-92ba-7b95ea4b2270 could not be found. Oct 22 21:04:58.139141 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-6ff118bb-4650-4744-adbb-27e36d2ffb07 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Request method failure captured: Oct 22 21:04:58.139141 ncdv-master-1 devstack@n-api.service[138744]: request: GET /compute/v2.1/servers/f38f14b2-b9d7-4bed-92ba-7b95ea4b2270 HTTP/1.1 Oct 22 21:04:58.139141 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 21:04:58.139141 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 21:04:58.139141 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 21:04:58.139141 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 0 Oct 22 21:04:58.139141 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 21:04:58.139141 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 21:04:58.139141 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 21:04:58.139141 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 21:04:58.139141 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVFl1NsovoM-5upBofUoR1wJz3y3f7BN7i-ip8UquaFKR-Bwws5RaDaETkBhtKzdndp6MYRY8ukCbKnzwdM4Y6qNUxVfwFedn3ei1b7cigm0kIz6-neoAFZeBAi_YJs2sNYg8tIoGL0NhI8dAoKTuweu7Sty9RZOuF7Ns4bg1i0YJsIk Oct 22 21:04:58.139141 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 21:04:58.139141 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 21:04:58.139141 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 21:04:58.139141 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 21:04:58.139141 ncdv-master-1 devstack@n-api.service[138744]: X-Openstack-Nova-Api-Version: 2.42 Oct 22 21:04:58.139141 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 21:04:58.139141 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 21:04:58.139141 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: cd687d54e07d4ab4af00ad801ef4b58d Oct 22 21:04:58.139141 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1175888917 Oct 22 21:04:58.139141 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 21:04:58.139141 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 21:04:58.139141 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_cd687d54e07d4ab4af00ad801ef4b58d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/cd687d54e07d4ab4af00ad801ef4b58d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/cd687d54e07d4ab4af00ad801ef4b58d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/cd687d54e07d4ab4af00ad801ef4b58d"}]}] Oct 22 21:04:58.139141 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1175888917 Oct 22 21:04:58.139141 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: cd687d54e07d4ab4af00ad801ef4b58d Oct 22 21:04:58.139141 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1175888917 Oct 22 21:04:58.139141 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-TaggedBootDevicesTest_v242-1175888917-project Oct 22 21:04:58.139141 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 21:04:58.139141 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 21:04:58.139141 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: 211483c6acea4f76b6c0e4bfc818e7aa Oct 22 21:04:58.139141 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1175888917-project Oct 22 21:04:58.139141 ncdv-master-1 devstack@n-api.service[138744]: method: > Oct 22 21:04:58.139141 ncdv-master-1 devstack@n-api.service[138744]: exception: Instance f38f14b2-b9d7-4bed-92ba-7b95ea4b2270 could not be found. Oct 22 21:04:58.139141 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': 'f38f14b2-b9d7-4bed-92ba-7b95ea4b2270'} Oct 22 21:04:58.139141 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:04:58.139141 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:04:58.139141 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 21:04:58.139141 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 21:04:58.139141 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 21:04:58.139141 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 21:04:58.139141 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 21:04:58.139141 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 21:04:58.139141 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 21:04:58.139141 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 21:04:58.139141 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f38f14b2-b9d7-4bed-92ba-7b95ea4b2270 could not be found. Oct 22 21:04:58.139141 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:04:58.139141 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:04:58.139141 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:04:58.139141 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:04:58.139141 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:04:58.139141 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:04:58.139141 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:04:58.139141 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:04:58.139141 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:04:58.139141 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:04:58.139141 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 21:04:58.139141 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 21:04:58.139141 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 21:04:58.139141 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 21:04:58.139141 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 21:04:58.139141 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:04:58.139141 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f38f14b2-b9d7-4bed-92ba-7b95ea4b2270 could not be found. Oct 22 21:04:58.139141 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:04:58.139141 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:04:58.144565 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:04:58.144565 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:04:58.144565 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:04:58.144565 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:04:58.144565 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:04:58.144565 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:04:58.144565 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f38f14b2-b9d7-4bed-92ba-7b95ea4b2270 could not be found. Oct 22 21:04:58.144565 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:04:58.148135 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-6ff118bb-4650-4744-adbb-27e36d2ffb07 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] Returning 404 to user: Instance f38f14b2-b9d7-4bed-92ba-7b95ea4b2270 could not be found. {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:04:58.149253 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-6ff118bb-4650-4744-adbb-27e36d2ffb07 tempest-TaggedBootDevicesTest_v242-1175888917 tempest-TaggedBootDevicesTest_v242-1175888917-project] 10.222.0.18 "GET /compute/v2.1/servers/f38f14b2-b9d7-4bed-92ba-7b95ea4b2270" status: 404 len: 111 microversion: 2.42 time: 0.100789 Oct 22 21:04:58.153515 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1627/3321] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:04:58 2022] GET /compute/v2.1/servers/f38f14b2-b9d7-4bed-92ba-7b95ea4b2270 => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 22 21:04:58.406762 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-858d49c9-20a0-4cdd-9993-50c7f3070609 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:04:58.407493 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-858d49c9-20a0-4cdd-9993-50c7f3070609 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] [instance: 931293d3-cb3a-4fd1-a684-eb740f010845] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:04:58.414533 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-858d49c9-20a0-4cdd-9993-50c7f3070609 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:58.422156 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-858d49c9-20a0-4cdd-9993-50c7f3070609 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:58.422608 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-858d49c9-20a0-4cdd-9993-50c7f3070609 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:58.423379 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-858d49c9-20a0-4cdd-9993-50c7f3070609 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:58.423868 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-858d49c9-20a0-4cdd-9993-50c7f3070609 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:58.424317 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-858d49c9-20a0-4cdd-9993-50c7f3070609 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:59.113432 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-858d49c9-20a0-4cdd-9993-50c7f3070609 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1b410a64e0415a96d30f5040361137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd7873d6db4e09bc9ab9a048a6b1ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:04:59.131517 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-858d49c9-20a0-4cdd-9993-50c7f3070609 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] 10.222.0.18 "GET /compute/v2.1/servers/931293d3-cb3a-4fd1-a684-eb740f010845" status: 200 len: 1510 microversion: 2.1 time: 0.727288 Oct 22 21:04:59.132190 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1628/3322] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:04:58 2022] GET /compute/v2.1/servers/931293d3-cb3a-4fd1-a684-eb740f010845 => generated 1510 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:04:59.161173 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-d1ec02dc-8fab-4830-aa97-25a1aa1e019e tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Calling method '.version_select at 0x7fd39f02f160>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:04:59.257703 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-d1ec02dc-8fab-4830-aa97-25a1aa1e019e tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] 10.222.0.18 "GET /compute/v2.1/images/fefdb332-d8c8-4dbc-8b2b-6d54994dca11" status: 200 len: 1423 microversion: 2.1 time: 0.105009 Oct 22 21:04:59.260040 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1629/3323] 10.222.0.18 () {58 vars in 1233 bytes} [Sat Oct 22 21:04:59 2022] GET /compute/v2.1/images/fefdb332-d8c8-4dbc-8b2b-6d54994dca11 => generated 1423 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:04:59.274145 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-380cbff3-463b-402a-95ed-c66b4021a26d tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:04:59.276277 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-380cbff3-463b-402a-95ed-c66b4021a26d tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] [instance: ebd7be2f-44d6-4f75-b112-0d6af4731f65] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:04:59.296537 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-380cbff3-463b-402a-95ed-c66b4021a26d tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:59.297910 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-380cbff3-463b-402a-95ed-c66b4021a26d tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:59.301215 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-380cbff3-463b-402a-95ed-c66b4021a26d tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:04:59.302359 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-380cbff3-463b-402a-95ed-c66b4021a26d tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:04:59.306823 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-380cbff3-463b-402a-95ed-c66b4021a26d tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:04:59.307655 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-380cbff3-463b-402a-95ed-c66b4021a26d tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:00.414446 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-380cbff3-463b-402a-95ed-c66b4021a26d tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3820b31a424c3a9216a6ef91fcb285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a42c3ecf474883ac652fcc8c01c9f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:05:00.422936 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-30123863-5bea-4cf7-924a-2db576ffea37 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Flavor limits 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 21:05:00.424099 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-30123863-5bea-4cf7-924a-2db576ffea37 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Image limits 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 21:05:00.424948 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-30123863-5bea-4cf7-924a-2db576ffea37 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Flavor pref 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 21:05:00.425720 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-30123863-5bea-4cf7-924a-2db576ffea37 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Image pref 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 21:05:00.426418 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-30123863-5bea-4cf7-924a-2db576ffea37 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 21:05:00.457525 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-380cbff3-463b-402a-95ed-c66b4021a26d tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] 10.222.0.18 "GET /compute/v2.1/servers/ebd7be2f-44d6-4f75-b112-0d6af4731f65" status: 200 len: 1169 microversion: 2.1 time: 1.185341 Oct 22 21:05:00.485667 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1630/3324] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:04:59 2022] GET /compute/v2.1/servers/ebd7be2f-44d6-4f75-b112-0d6af4731f65 => generated 1169 bytes in 1224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:05:00.495269 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-30123863-5bea-4cf7-924a-2db576ffea37 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:00.500052 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-30123863-5bea-4cf7-924a-2db576ffea37 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.032s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:00.500519 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-30123863-5bea-4cf7-924a-2db576ffea37 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:00.504340 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-30123863-5bea-4cf7-924a-2db576ffea37 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:00.504838 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-30123863-5bea-4cf7-924a-2db576ffea37 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:00.505273 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-30123863-5bea-4cf7-924a-2db576ffea37 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:00.508902 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-80550692-2855-4e84-b1b4-dee0fee558c5 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Calling method '.version_select at 0x7fd39f02f280>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:05:00.565730 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-30123863-5bea-4cf7-924a-2db576ffea37 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Getting quotas for project b54f56cfbc814cccb533c65966f35a93. Resources: {'cores', 'instances', 'ram'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 21:05:00.581015 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-30123863-5bea-4cf7-924a-2db576ffea37 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Getting quotas for user 879c85830a9f42088a4ebdf1e3cfb39b and project b54f56cfbc814cccb533c65966f35a93. Resources: {'cores', 'instances', 'ram'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 21:05:00.620216 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-30123863-5bea-4cf7-924a-2db576ffea37 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Going to run 1 instances... {{(pid=138745) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 21:05:00.625520 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-80550692-2855-4e84-b1b4-dee0fee558c5 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] 10.222.0.18 "GET /compute/v2.1/images/fefdb332-d8c8-4dbc-8b2b-6d54994dca11" status: 200 len: 1423 microversion: 2.1 time: 0.132895 Oct 22 21:05:00.626449 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1631/3325] 10.222.0.18 () {58 vars in 1233 bytes} [Sat Oct 22 21:05:00 2022] GET /compute/v2.1/images/fefdb332-d8c8-4dbc-8b2b-6d54994dca11 => generated 1423 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:05:00.627001 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-30123863-5bea-4cf7-924a-2db576ffea37 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] [instance: 3fdb6d35-9428-4253-ad00-932310ecdf5d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='085e4478-6edc-4a69-8e08-f9831713eb65',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138745) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 21:05:00.632547 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-d88a399c-a689-4c64-90cb-313d18c17e53 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:05:00.633479 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-d88a399c-a689-4c64-90cb-313d18c17e53 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] [instance: 931293d3-cb3a-4fd1-a684-eb740f010845] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:05:00.659778 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d88a399c-a689-4c64-90cb-313d18c17e53 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:00.660498 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d88a399c-a689-4c64-90cb-313d18c17e53 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:00.661908 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d88a399c-a689-4c64-90cb-313d18c17e53 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:00.663702 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d88a399c-a689-4c64-90cb-313d18c17e53 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:00.664367 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d88a399c-a689-4c64-90cb-313d18c17e53 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:00.664974 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d88a399c-a689-4c64-90cb-313d18c17e53 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:00.750196 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-30123863-5bea-4cf7-924a-2db576ffea37 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.064178 Oct 22 21:05:00.752385 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1695/3326] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Oct 22 21:04:57 2022] POST /compute/v2.1/servers => generated 383 bytes in 3071 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 21:05:00.766987 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-343febd9-0c8a-4610-8d48-b7ea9b631dd5 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:05:00.773696 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-343febd9-0c8a-4610-8d48-b7ea9b631dd5 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] [instance: 3fdb6d35-9428-4253-ad00-932310ecdf5d] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:05:01.226747 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-343febd9-0c8a-4610-8d48-b7ea9b631dd5 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879c85830a9f42088a4ebdf1e3cfb39b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b54f56cfbc814cccb533c65966f35a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:05:01.267403 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-343febd9-0c8a-4610-8d48-b7ea9b631dd5 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] 10.222.0.18 "GET /compute/v2.1/servers/3fdb6d35-9428-4253-ad00-932310ecdf5d" status: 200 len: 1213 microversion: 2.1 time: 0.502095 Oct 22 21:05:01.270632 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1696/3327] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:05:00 2022] GET /compute/v2.1/servers/3fdb6d35-9428-4253-ad00-932310ecdf5d => generated 1213 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:05:01.311301 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-266f9a23-2895-41d6-bbab-ebbba1254707 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1858773838", "imageRef": "fefdb332-d8c8-4dbc-8b2b-6d54994dca11", "flavorRef": "452", "networks": [{"uuid": "f1ad1f3f-09bf-4698-9fe5-20142c78993a"}]}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:05:01.473814 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.network.neutron [None req-266f9a23-2895-41d6-bbab-ebbba1254707 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] validate_networks() for [('f1ad1f3f-09bf-4698-9fe5-20142c78993a', None, None, None, None, None)] {{(pid=138745) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 21:05:01.964997 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-d88a399c-a689-4c64-90cb-313d18c17e53 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1b410a64e0415a96d30f5040361137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd7873d6db4e09bc9ab9a048a6b1ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:05:01.983989 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-d88a399c-a689-4c64-90cb-313d18c17e53 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] 10.222.0.18 "GET /compute/v2.1/servers/931293d3-cb3a-4fd1-a684-eb740f010845" status: 200 len: 1510 microversion: 2.1 time: 1.354915 Oct 22 21:05:01.986944 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1632/3328] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:05:00 2022] GET /compute/v2.1/servers/931293d3-cb3a-4fd1-a684-eb740f010845 => generated 1510 bytes in 1360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:05:02.008738 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-cc96a97d-4595-443e-af7d-8b0b3f85e728 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:05:02.012695 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-cc96a97d-4595-443e-af7d-8b0b3f85e728 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] [instance: ebd7be2f-44d6-4f75-b112-0d6af4731f65] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:05:02.029721 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cc96a97d-4595-443e-af7d-8b0b3f85e728 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:02.032349 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cc96a97d-4595-443e-af7d-8b0b3f85e728 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:02.033059 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cc96a97d-4595-443e-af7d-8b0b3f85e728 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:02.036174 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cc96a97d-4595-443e-af7d-8b0b3f85e728 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:02.036902 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cc96a97d-4595-443e-af7d-8b0b3f85e728 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:02.038432 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cc96a97d-4595-443e-af7d-8b0b3f85e728 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:02.709371 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-cc96a97d-4595-443e-af7d-8b0b3f85e728 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3820b31a424c3a9216a6ef91fcb285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a42c3ecf474883ac652fcc8c01c9f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:05:02.732411 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-cc96a97d-4595-443e-af7d-8b0b3f85e728 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] 10.222.0.18 "GET /compute/v2.1/servers/ebd7be2f-44d6-4f75-b112-0d6af4731f65" status: 200 len: 1169 microversion: 2.1 time: 0.739774 Oct 22 21:05:02.737515 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1633/3329] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:05:01 2022] GET /compute/v2.1/servers/ebd7be2f-44d6-4f75-b112-0d6af4731f65 => generated 1169 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:05:02.757470 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-6d661447-194d-4425-aa9d-6a07ad82123a tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:05:02.758108 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-6d661447-194d-4425-aa9d-6a07ad82123a tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] [instance: 3fdb6d35-9428-4253-ad00-932310ecdf5d] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:05:02.781829 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6d661447-194d-4425-aa9d-6a07ad82123a tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:02.782647 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6d661447-194d-4425-aa9d-6a07ad82123a tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:02.784072 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6d661447-194d-4425-aa9d-6a07ad82123a tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:02.789772 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6d661447-194d-4425-aa9d-6a07ad82123a tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:02.790733 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6d661447-194d-4425-aa9d-6a07ad82123a tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:02.791321 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6d661447-194d-4425-aa9d-6a07ad82123a tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:03.306092 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-6d661447-194d-4425-aa9d-6a07ad82123a tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879c85830a9f42088a4ebdf1e3cfb39b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b54f56cfbc814cccb533c65966f35a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:05:03.326023 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-6d661447-194d-4425-aa9d-6a07ad82123a tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] 10.222.0.18 "GET /compute/v2.1/servers/3fdb6d35-9428-4253-ad00-932310ecdf5d" status: 200 len: 1265 microversion: 2.1 time: 0.584280 Oct 22 21:05:03.346130 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1634/3330] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:05:02 2022] GET /compute/v2.1/servers/3fdb6d35-9428-4253-ad00-932310ecdf5d => generated 1265 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:05:03.358082 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-f7f370ec-419f-4d55-9560-4e97f2f82046 req-be482288-a85f-45fd-8867-e644fb795323 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9bfb71b4-0081-493a-8ed5-1c80169b12d0", "name": "network-vif-unplugged", "status": "completed", "tag": "a0cc9777-4dd3-4860-b673-6758803806be"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:05:03.386827 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-f7f370ec-419f-4d55-9560-4e97f2f82046 req-be482288-a85f-45fd-8867-e644fb795323 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:03.389524 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-f7f370ec-419f-4d55-9560-4e97f2f82046 req-be482288-a85f-45fd-8867-e644fb795323 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:03.390320 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-f7f370ec-419f-4d55-9560-4e97f2f82046 req-be482288-a85f-45fd-8867-e644fb795323 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:03.427577 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-f7f370ec-419f-4d55-9560-4e97f2f82046 req-be482288-a85f-45fd-8867-e644fb795323 service nova] Creating event network-vif-unplugged:a0cc9777-4dd3-4860-b673-6758803806be for instance 9bfb71b4-0081-493a-8ed5-1c80169b12d0 on nch1-master-1 Oct 22 21:05:03.440529 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-f7f370ec-419f-4d55-9560-4e97f2f82046 req-be482288-a85f-45fd-8867-e644fb795323 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.092016 Oct 22 21:05:03.444068 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1635/3331] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:05:03 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:05:03.458795 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-db2c5590-6bea-4bce-a936-ae2c1644d197 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:05:03.461377 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-db2c5590-6bea-4bce-a936-ae2c1644d197 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] [instance: 931293d3-cb3a-4fd1-a684-eb740f010845] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:05:03.479839 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-db2c5590-6bea-4bce-a936-ae2c1644d197 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:03.480240 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-db2c5590-6bea-4bce-a936-ae2c1644d197 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:03.481205 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-db2c5590-6bea-4bce-a936-ae2c1644d197 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:03.482250 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-db2c5590-6bea-4bce-a936-ae2c1644d197 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:03.482946 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-db2c5590-6bea-4bce-a936-ae2c1644d197 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:03.483698 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-db2c5590-6bea-4bce-a936-ae2c1644d197 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:03.772931 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-266f9a23-2895-41d6-bbab-ebbba1254707 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Flavor limits 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 21:05:03.773500 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-266f9a23-2895-41d6-bbab-ebbba1254707 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Image limits 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 21:05:03.774054 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-266f9a23-2895-41d6-bbab-ebbba1254707 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Flavor pref 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 21:05:03.774569 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-266f9a23-2895-41d6-bbab-ebbba1254707 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Image pref 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 21:05:03.775206 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-266f9a23-2895-41d6-bbab-ebbba1254707 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 21:05:03.786592 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-266f9a23-2895-41d6-bbab-ebbba1254707 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:03.787119 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-266f9a23-2895-41d6-bbab-ebbba1254707 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:03.789505 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-266f9a23-2895-41d6-bbab-ebbba1254707 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:03.790466 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-266f9a23-2895-41d6-bbab-ebbba1254707 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:03.790937 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-266f9a23-2895-41d6-bbab-ebbba1254707 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:03.791553 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-266f9a23-2895-41d6-bbab-ebbba1254707 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:03.836747 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-266f9a23-2895-41d6-bbab-ebbba1254707 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Getting quotas for project 66a26a2284f4424cbeaf63d504652546. Resources: {'cores', 'instances', 'ram'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 21:05:03.860138 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-266f9a23-2895-41d6-bbab-ebbba1254707 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Getting quotas for user f0a44ff8e7c14b94b1670f030085c43d and project 66a26a2284f4424cbeaf63d504652546. Resources: {'cores', 'instances', 'ram'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 21:05:03.877755 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-266f9a23-2895-41d6-bbab-ebbba1254707 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Going to run 1 instances... {{(pid=138745) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 21:05:03.880491 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-266f9a23-2895-41d6-bbab-ebbba1254707 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] [instance: 844f3fc3-ad5d-4dda-b642-ce9c1d417820] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fefdb332-d8c8-4dbc-8b2b-6d54994dca11',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138745) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 21:05:03.938755 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-266f9a23-2895-41d6-bbab-ebbba1254707 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.648300 Oct 22 21:05:03.940181 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1697/3332] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Oct 22 21:05:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 2651 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 21:05:03.945116 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-26e3485e-e09e-4f86-9ed2-7c744c464793 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:05:03.946490 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-26e3485e-e09e-4f86-9ed2-7c744c464793 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] [instance: ebd7be2f-44d6-4f75-b112-0d6af4731f65] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:05:03.953824 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-26e3485e-e09e-4f86-9ed2-7c744c464793 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:03.954445 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-26e3485e-e09e-4f86-9ed2-7c744c464793 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:03.955001 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-26e3485e-e09e-4f86-9ed2-7c744c464793 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:03.956027 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-26e3485e-e09e-4f86-9ed2-7c744c464793 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:03.956589 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-26e3485e-e09e-4f86-9ed2-7c744c464793 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:03.957249 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-26e3485e-e09e-4f86-9ed2-7c744c464793 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:05.145335 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-db2c5590-6bea-4bce-a936-ae2c1644d197 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1b410a64e0415a96d30f5040361137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd7873d6db4e09bc9ab9a048a6b1ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:05:05.157806 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-db2c5590-6bea-4bce-a936-ae2c1644d197 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] 10.222.0.18 "GET /compute/v2.1/servers/931293d3-cb3a-4fd1-a684-eb740f010845" status: 200 len: 1510 microversion: 2.1 time: 1.711998 Oct 22 21:05:05.172528 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1636/3333] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:05:03 2022] GET /compute/v2.1/servers/931293d3-cb3a-4fd1-a684-eb740f010845 => generated 1510 bytes in 1727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:05:05.182835 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-2a7556af-17ff-4946-8d78-b22b675b7944 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:05:05.184524 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-2a7556af-17ff-4946-8d78-b22b675b7944 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] [instance: 844f3fc3-ad5d-4dda-b642-ce9c1d417820] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:05:05.194647 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2a7556af-17ff-4946-8d78-b22b675b7944 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:05.196006 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-26e3485e-e09e-4f86-9ed2-7c744c464793 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3820b31a424c3a9216a6ef91fcb285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a42c3ecf474883ac652fcc8c01c9f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:05:05.197481 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2a7556af-17ff-4946-8d78-b22b675b7944 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:05.198463 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2a7556af-17ff-4946-8d78-b22b675b7944 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:05.199978 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2a7556af-17ff-4946-8d78-b22b675b7944 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:05.201022 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2a7556af-17ff-4946-8d78-b22b675b7944 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:05.202833 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2a7556af-17ff-4946-8d78-b22b675b7944 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:05.226755 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-26e3485e-e09e-4f86-9ed2-7c744c464793 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] 10.222.0.18 "GET /compute/v2.1/servers/ebd7be2f-44d6-4f75-b112-0d6af4731f65" status: 200 len: 1203 microversion: 2.1 time: 1.285208 Oct 22 21:05:05.240263 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1698/3334] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:05:03 2022] GET /compute/v2.1/servers/ebd7be2f-44d6-4f75-b112-0d6af4731f65 => generated 1203 bytes in 1291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:05:05.250243 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-f31187d8-5a2f-4614-b219-2f2d7f3408ee tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:05:05.250243 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-f31187d8-5a2f-4614-b219-2f2d7f3408ee tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] [instance: 3fdb6d35-9428-4253-ad00-932310ecdf5d] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:05:05.262511 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f31187d8-5a2f-4614-b219-2f2d7f3408ee tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:05.264265 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f31187d8-5a2f-4614-b219-2f2d7f3408ee tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:05.264906 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f31187d8-5a2f-4614-b219-2f2d7f3408ee tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:05.265880 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f31187d8-5a2f-4614-b219-2f2d7f3408ee tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:05.266549 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f31187d8-5a2f-4614-b219-2f2d7f3408ee tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:05.267291 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f31187d8-5a2f-4614-b219-2f2d7f3408ee tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:05.424969 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-2a7556af-17ff-4946-8d78-b22b675b7944 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a44ff8e7c14b94b1670f030085c43d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a26a2284f4424cbeaf63d504652546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:05:05.464666 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-2a7556af-17ff-4946-8d78-b22b675b7944 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] 10.222.0.18 "GET /compute/v2.1/servers/844f3fc3-ad5d-4dda-b642-ce9c1d417820" status: 200 len: 1204 microversion: 2.1 time: 0.287060 Oct 22 21:05:05.468420 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1637/3335] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:05:05 2022] GET /compute/v2.1/servers/844f3fc3-ad5d-4dda-b642-ce9c1d417820 => generated 1204 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:05:05.470656 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-f31187d8-5a2f-4614-b219-2f2d7f3408ee tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879c85830a9f42088a4ebdf1e3cfb39b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b54f56cfbc814cccb533c65966f35a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:05:05.495596 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-f31187d8-5a2f-4614-b219-2f2d7f3408ee tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] 10.222.0.18 "GET /compute/v2.1/servers/3fdb6d35-9428-4253-ad00-932310ecdf5d" status: 200 len: 1271 microversion: 2.1 time: 0.262179 Oct 22 21:05:05.496405 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1699/3336] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:05:05 2022] GET /compute/v2.1/servers/3fdb6d35-9428-4253-ad00-932310ecdf5d => generated 1271 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:05:05.800734 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-0d8a6f2e-8e09-4a85-8157-f810a2e57b5c tempest-FloatingIPsNegativeTestJSON-749893498 tempest-FloatingIPsNegativeTestJSON-749893498-project] Calling method '.version_select at 0x7fd39efb7310>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:05:05.975011 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-0d8a6f2e-8e09-4a85-8157-f810a2e57b5c tempest-FloatingIPsNegativeTestJSON-749893498 tempest-FloatingIPsNegativeTestJSON-749893498-project] 10.222.0.18 "GET /compute/v2.1/os-floating-ips" status: 200 len: 20 microversion: 2.1 time: 0.502967 Oct 22 21:05:05.991768 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1638/3337] 10.222.0.18 () {58 vars in 1149 bytes} [Sat Oct 22 21:05:05 2022] GET /compute/v2.1/os-floating-ips => generated 20 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 22 21:05:05.992193 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-5d5fdc9b-6ff1-45b6-8f04-b9a422de36c1 tempest-FloatingIPsNegativeTestJSON-749893498 tempest-FloatingIPsNegativeTestJSON-749893498-project] Action: 'create', calling method: .version_select at 0x7fd39ee25040>, body: {"pool": "non_exist_pool"} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:05:06.070007 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-e877e5af-45d5-4482-8ba8-1b0593337b3b req-06ecaf99-cc67-4dab-9024-37b6bc9e93a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ebd7be2f-44d6-4f75-b112-0d6af4731f65", "tag": "6aece53a-c728-48a5-ae9d-a3aacbe74768"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:05:06.092501 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-e877e5af-45d5-4482-8ba8-1b0593337b3b req-06ecaf99-cc67-4dab-9024-37b6bc9e93a0 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:06.093348 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-e877e5af-45d5-4482-8ba8-1b0593337b3b req-06ecaf99-cc67-4dab-9024-37b6bc9e93a0 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:06.093977 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-e877e5af-45d5-4482-8ba8-1b0593337b3b req-06ecaf99-cc67-4dab-9024-37b6bc9e93a0 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:06.119494 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-e877e5af-45d5-4482-8ba8-1b0593337b3b req-06ecaf99-cc67-4dab-9024-37b6bc9e93a0 service nova] Creating event network-changed:6aece53a-c728-48a5-ae9d-a3aacbe74768 for instance ebd7be2f-44d6-4f75-b112-0d6af4731f65 on nch2-master-1 Oct 22 21:05:06.130963 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-e877e5af-45d5-4482-8ba8-1b0593337b3b req-06ecaf99-cc67-4dab-9024-37b6bc9e93a0 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065472 Oct 22 21:05:06.134686 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1639/3338] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:05:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 21:05:06.164128 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.wsgi [None req-5d5fdc9b-6ff1-45b6-8f04-b9a422de36c1 tempest-FloatingIPsNegativeTestJSON-749893498 tempest-FloatingIPsNegativeTestJSON-749893498-project] HTTP exception thrown: Floating IP pool not found. Oct 22 21:05:06.166304 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-5d5fdc9b-6ff1-45b6-8f04-b9a422de36c1 tempest-FloatingIPsNegativeTestJSON-749893498 tempest-FloatingIPsNegativeTestJSON-749893498-project] Request method failure captured: Oct 22 21:05:06.166304 ncdv-master-1 devstack@n-api.service[138745]: request: POST /compute/v2.1/os-floating-ips HTTP/1.1 Oct 22 21:05:06.166304 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 21:05:06.166304 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 21:05:06.166304 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 21:05:06.166304 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 26 Oct 22 21:05:06.166304 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 21:05:06.166304 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 21:05:06.166304 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 21:05:06.166304 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 21:05:06.166304 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVFsA6ltX5fHreid5KaFmOg7vhJGovEUMfQzlmrR8Ol3_1oqz5a0CQGKCkG1XyZWmaiSAWjeOa1LGctna3akh5IfsHmWt2SlHbG8shfSi61zBs97_QU3l6x6kN3ov4ez8E2qQQN7wmjr_eyENa05tuI_8ON2uNGlmkAVd2ubj34Hl3CU Oct 22 21:05:06.166304 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 21:05:06.166304 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 21:05:06.166304 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 21:05:06.166304 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 21:05:06.166304 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 21:05:06.166304 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 21:05:06.166304 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: 382885d2096a4891af78b6281d23316d Oct 22 21:05:06.166304 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-749893498 Oct 22 21:05:06.166304 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 21:05:06.166304 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 21:05:06.166304 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_382885d2096a4891af78b6281d23316d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/382885d2096a4891af78b6281d23316d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/382885d2096a4891af78b6281d23316d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/382885d2096a4891af78b6281d23316d"}]}] Oct 22 21:05:06.166304 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-749893498 Oct 22 21:05:06.166304 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: 382885d2096a4891af78b6281d23316d Oct 22 21:05:06.166304 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-749893498 Oct 22 21:05:06.166304 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-FloatingIPsNegativeTestJSON-749893498-project Oct 22 21:05:06.166304 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 21:05:06.166304 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 21:05:06.166304 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: 0c84faedc2f7443e80bc757887000d2d Oct 22 21:05:06.166304 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-749893498-project Oct 22 21:05:06.166304 ncdv-master-1 devstack@n-api.service[138745]: Oct 22 21:05:06.166304 ncdv-master-1 devstack@n-api.service[138745]: {"pool": "non_exist_pool"} Oct 22 21:05:06.166304 ncdv-master-1 devstack@n-api.service[138745]: method: Oct 22 21:05:06.166304 ncdv-master-1 devstack@n-api.service[138745]: exception: Floating IP pool not found. Oct 22 21:05:06.166304 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'body': {'pool': 'non_exist_pool'}} Oct 22 21:05:06.166304 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:05:06.166304 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:05:06.166304 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 127, in create Oct 22 21:05:06.166304 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi address = self.network_api.allocate_floating_ip(context, pool) Oct 22 21:05:06.166304 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2972, in allocate_floating_ip Oct 22 21:05:06.166304 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi pool_id = self._get_floating_ip_pool_id_by_name_or_id(client, pool) Oct 22 21:05:06.166304 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2962, in _get_floating_ip_pool_id_by_name_or_id Oct 22 21:05:06.166304 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpPoolNotFound() Oct 22 21:05:06.166304 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpPoolNotFound: Floating IP pool not found. Oct 22 21:05:06.166304 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:05:06.166304 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:05:06.166304 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:05:06.166304 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:05:06.166304 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:05:06.166304 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:05:06.166304 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:05:06.166304 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:05:06.166304 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 22 21:05:06.166304 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 22 21:05:06.166304 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:05:06.166304 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:05:06.166304 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 142, in create Oct 22 21:05:06.166304 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:05:06.166304 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP pool not found. Oct 22 21:05:06.166304 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:05:06.166304 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:05:06.166304 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:05:06.166304 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:05:06.166304 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:05:06.166304 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:05:06.166304 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:05:06.166304 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:05:06.172250 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP pool not found. Oct 22 21:05:06.172250 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:05:06.174083 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-5d5fdc9b-6ff1-45b6-8f04-b9a422de36c1 tempest-FloatingIPsNegativeTestJSON-749893498 tempest-FloatingIPsNegativeTestJSON-749893498-project] Returning 404 to user: Floating IP pool not found. {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:05:06.176957 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-5d5fdc9b-6ff1-45b6-8f04-b9a422de36c1 tempest-FloatingIPsNegativeTestJSON-749893498 tempest-FloatingIPsNegativeTestJSON-749893498-project] 10.222.0.18 "POST /compute/v2.1/os-floating-ips" status: 404 len: 73 microversion: 2.1 time: 0.189802 Oct 22 21:05:06.182584 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1700/3339] 10.222.0.18 () {60 vars in 1170 bytes} [Sat Oct 22 21:05:05 2022] POST /compute/v2.1/os-floating-ips => generated 73 bytes in 197 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 22 21:05:06.187626 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-49ecedf6-d75a-4f9d-af86-ea834c9ac460 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:05:06.188382 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-49ecedf6-d75a-4f9d-af86-ea834c9ac460 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] [instance: 931293d3-cb3a-4fd1-a684-eb740f010845] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:05:06.193039 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-2f55c298-9a70-46d2-aeb2-9eda0adf1e88 tempest-FloatingIPsNegativeTestJSON-749893498 tempest-FloatingIPsNegativeTestJSON-749893498-project] Calling method '.version_select at 0x7fd39ee16b80>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:05:06.203827 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-49ecedf6-d75a-4f9d-af86-ea834c9ac460 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:06.204383 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-49ecedf6-d75a-4f9d-af86-ea834c9ac460 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:06.205995 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-49ecedf6-d75a-4f9d-af86-ea834c9ac460 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:06.206765 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-49ecedf6-d75a-4f9d-af86-ea834c9ac460 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:06.207237 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-49ecedf6-d75a-4f9d-af86-ea834c9ac460 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:06.207701 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-49ecedf6-d75a-4f9d-af86-ea834c9ac460 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:06.826633 ncdv-master-1 devstack@n-api.service[138745]: DEBUG neutronclient.v2_0.client [None req-2f55c298-9a70-46d2-aeb2-9eda0adf1e88 tempest-FloatingIPsNegativeTestJSON-749893498 tempest-FloatingIPsNegativeTestJSON-749893498-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP f6733070-557e-4260-b1e9-b2c2fc976c30 could not be found", "detail": ""}} {{(pid=138745) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 22 21:05:06.828078 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.wsgi [None req-2f55c298-9a70-46d2-aeb2-9eda0adf1e88 tempest-FloatingIPsNegativeTestJSON-749893498 tempest-FloatingIPsNegativeTestJSON-749893498-project] HTTP exception thrown: Floating IP not found for ID f6733070-557e-4260-b1e9-b2c2fc976c30 Oct 22 21:05:06.832687 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-2f55c298-9a70-46d2-aeb2-9eda0adf1e88 tempest-FloatingIPsNegativeTestJSON-749893498 tempest-FloatingIPsNegativeTestJSON-749893498-project] Request method failure captured: Oct 22 21:05:06.832687 ncdv-master-1 devstack@n-api.service[138745]: request: DELETE /compute/v2.1/os-floating-ips/f6733070-557e-4260-b1e9-b2c2fc976c30 HTTP/1.1 Oct 22 21:05:06.832687 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 21:05:06.832687 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 21:05:06.832687 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 21:05:06.832687 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 0 Oct 22 21:05:06.832687 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 21:05:06.832687 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 21:05:06.832687 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 21:05:06.832687 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 21:05:06.832687 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVFsA6ltX5fHreid5KaFmOg7vhJGovEUMfQzlmrR8Ol3_1oqz5a0CQGKCkG1XyZWmaiSAWjeOa1LGctna3akh5IfsHmWt2SlHbG8shfSi61zBs97_QU3l6x6kN3ov4ez8E2qQQN7wmjr_eyENa05tuI_8ON2uNGlmkAVd2ubj34Hl3CU Oct 22 21:05:06.832687 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 21:05:06.832687 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 21:05:06.832687 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 21:05:06.832687 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 21:05:06.832687 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 21:05:06.832687 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 21:05:06.832687 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: 382885d2096a4891af78b6281d23316d Oct 22 21:05:06.832687 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-749893498 Oct 22 21:05:06.832687 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 21:05:06.832687 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 21:05:06.832687 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_382885d2096a4891af78b6281d23316d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/382885d2096a4891af78b6281d23316d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/382885d2096a4891af78b6281d23316d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/382885d2096a4891af78b6281d23316d"}]}] Oct 22 21:05:06.832687 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-749893498 Oct 22 21:05:06.832687 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: 382885d2096a4891af78b6281d23316d Oct 22 21:05:06.832687 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-749893498 Oct 22 21:05:06.832687 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-FloatingIPsNegativeTestJSON-749893498-project Oct 22 21:05:06.832687 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 21:05:06.832687 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 21:05:06.832687 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: 0c84faedc2f7443e80bc757887000d2d Oct 22 21:05:06.832687 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-749893498-project Oct 22 21:05:06.832687 ncdv-master-1 devstack@n-api.service[138745]: method: Oct 22 21:05:06.832687 ncdv-master-1 devstack@n-api.service[138745]: exception: Floating IP not found for ID f6733070-557e-4260-b1e9-b2c2fc976c30 Oct 22 21:05:06.832687 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'id': 'f6733070-557e-4260-b1e9-b2c2fc976c30'} Oct 22 21:05:06.832687 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:05:06.832687 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:05:06.832687 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 22 21:05:06.832687 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 22 21:05:06.832687 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 21:05:06.832687 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 21:05:06.832687 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 22 21:05:06.832687 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 22 21:05:06.832687 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 21:05:06.832687 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 21:05:06.832687 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 22 21:05:06.832687 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 22 21:05:06.832687 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 21:05:06.832687 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 21:05:06.832687 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 22 21:05:06.832687 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 22 21:05:06.832687 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 21:05:06.832687 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 21:05:06.832687 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 22 21:05:06.832687 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 22 21:05:06.832687 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 21:05:06.832687 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 21:05:06.832687 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 22 21:05:06.832687 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 22 21:05:06.832687 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 22 21:05:06.832687 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 22 21:05:06.832687 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP f6733070-557e-4260-b1e9-b2c2fc976c30 could not be found Oct 22 21:05:06.832687 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4eeec2dc-09ff-49d0-82ad-5423d3d994a6'] Oct 22 21:05:06.838222 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:05:06.838222 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:05:06.838222 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:05:06.838222 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:05:06.838222 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Oct 22 21:05:06.838222 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 22 21:05:06.838222 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 22 21:05:06.838222 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 22 21:05:06.838222 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID f6733070-557e-4260-b1e9-b2c2fc976c30. Oct 22 21:05:06.838222 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:05:06.838222 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:05:06.838222 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:05:06.838222 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:05:06.838222 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:05:06.838222 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:05:06.838222 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:05:06.838222 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:05:06.838222 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 22 21:05:06.838222 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 22 21:05:06.838222 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:05:06.838222 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:05:06.838222 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Oct 22 21:05:06.838222 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 22 21:05:06.838222 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID f6733070-557e-4260-b1e9-b2c2fc976c30 Oct 22 21:05:06.838222 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:05:06.838222 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:05:06.838222 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:05:06.838222 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:05:06.838222 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:05:06.838222 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:05:06.838222 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:05:06.838222 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:05:06.838222 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID f6733070-557e-4260-b1e9-b2c2fc976c30 Oct 22 21:05:06.838222 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:05:06.846832 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-2f55c298-9a70-46d2-aeb2-9eda0adf1e88 tempest-FloatingIPsNegativeTestJSON-749893498 tempest-FloatingIPsNegativeTestJSON-749893498-project] Returning 404 to user: Floating IP not found for ID f6733070-557e-4260-b1e9-b2c2fc976c30 {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:05:06.846832 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-2f55c298-9a70-46d2-aeb2-9eda0adf1e88 tempest-FloatingIPsNegativeTestJSON-749893498 tempest-FloatingIPsNegativeTestJSON-749893498-project] 10.222.0.18 "DELETE /compute/v2.1/os-floating-ips/f6733070-557e-4260-b1e9-b2c2fc976c30" status: 404 len: 111 microversion: 2.1 time: 0.662228 Oct 22 21:05:06.848303 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1701/3340] 10.222.0.18 () {58 vars in 1263 bytes} [Sat Oct 22 21:05:06 2022] DELETE /compute/v2.1/os-floating-ips/f6733070-557e-4260-b1e9-b2c2fc976c30 => generated 111 bytes in 665 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 21:05:06.860411 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-2b30cfcc-1fee-44d2-a613-b09b11afa391 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:05:06.862035 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-2b30cfcc-1fee-44d2-a613-b09b11afa391 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] [instance: ebd7be2f-44d6-4f75-b112-0d6af4731f65] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:05:06.880705 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2b30cfcc-1fee-44d2-a613-b09b11afa391 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:06.884177 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2b30cfcc-1fee-44d2-a613-b09b11afa391 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:06.884789 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2b30cfcc-1fee-44d2-a613-b09b11afa391 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:06.885688 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2b30cfcc-1fee-44d2-a613-b09b11afa391 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:06.888094 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2b30cfcc-1fee-44d2-a613-b09b11afa391 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:06.888852 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2b30cfcc-1fee-44d2-a613-b09b11afa391 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:07.737522 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-49ecedf6-d75a-4f9d-af86-ea834c9ac460 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1b410a64e0415a96d30f5040361137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd7873d6db4e09bc9ab9a048a6b1ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:05:07.748903 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-49ecedf6-d75a-4f9d-af86-ea834c9ac460 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] 10.222.0.18 "GET /compute/v2.1/servers/931293d3-cb3a-4fd1-a684-eb740f010845" status: 200 len: 1510 microversion: 2.1 time: 1.565654 Oct 22 21:05:07.752646 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1640/3341] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:05:06 2022] GET /compute/v2.1/servers/931293d3-cb3a-4fd1-a684-eb740f010845 => generated 1510 bytes in 1570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:05:07.768103 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-997c533c-0b49-49da-8772-3ba897483210 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:05:07.769241 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-997c533c-0b49-49da-8772-3ba897483210 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] [instance: 844f3fc3-ad5d-4dda-b642-ce9c1d417820] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:05:07.780453 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-997c533c-0b49-49da-8772-3ba897483210 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:07.780957 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-997c533c-0b49-49da-8772-3ba897483210 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:07.781402 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-997c533c-0b49-49da-8772-3ba897483210 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:07.782123 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-997c533c-0b49-49da-8772-3ba897483210 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:07.782580 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-997c533c-0b49-49da-8772-3ba897483210 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:07.785851 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-997c533c-0b49-49da-8772-3ba897483210 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:08.239274 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-2b30cfcc-1fee-44d2-a613-b09b11afa391 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3820b31a424c3a9216a6ef91fcb285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a42c3ecf474883ac652fcc8c01c9f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:05:08.254105 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-2b30cfcc-1fee-44d2-a613-b09b11afa391 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] 10.222.0.18 "GET /compute/v2.1/servers/ebd7be2f-44d6-4f75-b112-0d6af4731f65" status: 200 len: 1203 microversion: 2.1 time: 1.404205 Oct 22 21:05:08.254982 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1702/3342] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:05:06 2022] GET /compute/v2.1/servers/ebd7be2f-44d6-4f75-b112-0d6af4731f65 => generated 1203 bytes in 1406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:05:08.285542 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-95bb4e4b-7f9c-4a7e-b348-2baf9c543187 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:05:08.291811 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-95bb4e4b-7f9c-4a7e-b348-2baf9c543187 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] [instance: 3fdb6d35-9428-4253-ad00-932310ecdf5d] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:05:08.319998 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-95bb4e4b-7f9c-4a7e-b348-2baf9c543187 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:08.328260 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-95bb4e4b-7f9c-4a7e-b348-2baf9c543187 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:08.328782 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-95bb4e4b-7f9c-4a7e-b348-2baf9c543187 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:08.329496 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-95bb4e4b-7f9c-4a7e-b348-2baf9c543187 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:08.332469 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-95bb4e4b-7f9c-4a7e-b348-2baf9c543187 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:08.333481 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-95bb4e4b-7f9c-4a7e-b348-2baf9c543187 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:08.761528 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-997c533c-0b49-49da-8772-3ba897483210 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a44ff8e7c14b94b1670f030085c43d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a26a2284f4424cbeaf63d504652546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:05:08.787453 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-95bb4e4b-7f9c-4a7e-b348-2baf9c543187 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879c85830a9f42088a4ebdf1e3cfb39b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b54f56cfbc814cccb533c65966f35a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:05:08.794300 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-997c533c-0b49-49da-8772-3ba897483210 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] 10.222.0.18 "GET /compute/v2.1/servers/844f3fc3-ad5d-4dda-b642-ce9c1d417820" status: 200 len: 1308 microversion: 2.1 time: 1.024658 Oct 22 21:05:08.797857 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1641/3343] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:05:07 2022] GET /compute/v2.1/servers/844f3fc3-ad5d-4dda-b642-ce9c1d417820 => generated 1308 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:05:08.811788 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-95bb4e4b-7f9c-4a7e-b348-2baf9c543187 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] 10.222.0.18 "GET /compute/v2.1/servers/3fdb6d35-9428-4253-ad00-932310ecdf5d" status: 200 len: 1271 microversion: 2.1 time: 0.550534 Oct 22 21:05:08.816000 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-53fcf8bb-5f67-48a9-a288-ec3c88634c4a tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:05:08.816631 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-53fcf8bb-5f67-48a9-a288-ec3c88634c4a tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] [instance: 931293d3-cb3a-4fd1-a684-eb740f010845] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:05:08.826489 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1703/3344] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:05:08 2022] GET /compute/v2.1/servers/3fdb6d35-9428-4253-ad00-932310ecdf5d => generated 1271 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:05:08.856182 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-53fcf8bb-5f67-48a9-a288-ec3c88634c4a tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:08.857632 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-53fcf8bb-5f67-48a9-a288-ec3c88634c4a tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:08.859956 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-53fcf8bb-5f67-48a9-a288-ec3c88634c4a tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:08.862949 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-53fcf8bb-5f67-48a9-a288-ec3c88634c4a tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:08.863481 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-53fcf8bb-5f67-48a9-a288-ec3c88634c4a tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:08.863931 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-53fcf8bb-5f67-48a9-a288-ec3c88634c4a tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:09.287694 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-0cae8791-cd95-4cb8-88c2-c25bdd9f08c8 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:05:09.288489 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-0cae8791-cd95-4cb8-88c2-c25bdd9f08c8 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] [instance: ebd7be2f-44d6-4f75-b112-0d6af4731f65] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:05:09.312918 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0cae8791-cd95-4cb8-88c2-c25bdd9f08c8 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:09.313715 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0cae8791-cd95-4cb8-88c2-c25bdd9f08c8 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:09.315733 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0cae8791-cd95-4cb8-88c2-c25bdd9f08c8 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:09.316608 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0cae8791-cd95-4cb8-88c2-c25bdd9f08c8 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:09.323256 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0cae8791-cd95-4cb8-88c2-c25bdd9f08c8 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:09.324230 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0cae8791-cd95-4cb8-88c2-c25bdd9f08c8 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:09.764056 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-53fcf8bb-5f67-48a9-a288-ec3c88634c4a tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1b410a64e0415a96d30f5040361137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd7873d6db4e09bc9ab9a048a6b1ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:05:09.777566 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-53fcf8bb-5f67-48a9-a288-ec3c88634c4a tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] 10.222.0.18 "GET /compute/v2.1/servers/931293d3-cb3a-4fd1-a684-eb740f010845" status: 200 len: 1510 microversion: 2.1 time: 0.978240 Oct 22 21:05:09.778432 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1642/3345] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:05:08 2022] GET /compute/v2.1/servers/931293d3-cb3a-4fd1-a684-eb740f010845 => generated 1510 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:05:09.829266 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-a37f6c90-c492-4866-9860-2f3b5285c1e6 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:05:09.829937 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-a37f6c90-c492-4866-9860-2f3b5285c1e6 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] [instance: 844f3fc3-ad5d-4dda-b642-ce9c1d417820] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:05:09.844581 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a37f6c90-c492-4866-9860-2f3b5285c1e6 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:09.845367 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a37f6c90-c492-4866-9860-2f3b5285c1e6 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:09.846043 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a37f6c90-c492-4866-9860-2f3b5285c1e6 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:09.846931 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a37f6c90-c492-4866-9860-2f3b5285c1e6 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:09.847882 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a37f6c90-c492-4866-9860-2f3b5285c1e6 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:09.849871 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a37f6c90-c492-4866-9860-2f3b5285c1e6 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:10.102564 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-0cae8791-cd95-4cb8-88c2-c25bdd9f08c8 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3820b31a424c3a9216a6ef91fcb285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a42c3ecf474883ac652fcc8c01c9f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:05:10.124414 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-0cae8791-cd95-4cb8-88c2-c25bdd9f08c8 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] 10.222.0.18 "GET /compute/v2.1/servers/ebd7be2f-44d6-4f75-b112-0d6af4731f65" status: 200 len: 1203 microversion: 2.1 time: 0.845249 Oct 22 21:05:10.139702 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1704/3346] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:05:09 2022] GET /compute/v2.1/servers/ebd7be2f-44d6-4f75-b112-0d6af4731f65 => generated 1203 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:05:10.160919 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-9bcd0fe6-f77f-4833-9fe5-741cc5f61a31 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:05:10.167281 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-9bcd0fe6-f77f-4833-9fe5-741cc5f61a31 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] [instance: 3fdb6d35-9428-4253-ad00-932310ecdf5d] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:05:10.182258 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9bcd0fe6-f77f-4833-9fe5-741cc5f61a31 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:10.182552 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9bcd0fe6-f77f-4833-9fe5-741cc5f61a31 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:10.183054 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9bcd0fe6-f77f-4833-9fe5-741cc5f61a31 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:10.183842 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9bcd0fe6-f77f-4833-9fe5-741cc5f61a31 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:10.184316 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9bcd0fe6-f77f-4833-9fe5-741cc5f61a31 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:10.184803 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9bcd0fe6-f77f-4833-9fe5-741cc5f61a31 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:12.306459 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-a37f6c90-c492-4866-9860-2f3b5285c1e6 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a44ff8e7c14b94b1670f030085c43d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a26a2284f4424cbeaf63d504652546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:05:12.314917 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-a37f6c90-c492-4866-9860-2f3b5285c1e6 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] 10.222.0.18 "GET /compute/v2.1/servers/844f3fc3-ad5d-4dda-b642-ce9c1d417820" status: 200 len: 1308 microversion: 2.1 time: 2.490474 Oct 22 21:05:12.318466 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1643/3347] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:05:09 2022] GET /compute/v2.1/servers/844f3fc3-ad5d-4dda-b642-ce9c1d417820 => generated 1308 bytes in 2495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:05:12.337985 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-1897d05e-75cf-4323-bd51-123ab0646bdd tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:05:12.345340 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-1897d05e-75cf-4323-bd51-123ab0646bdd tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] [instance: 931293d3-cb3a-4fd1-a684-eb740f010845] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:05:12.365599 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1897d05e-75cf-4323-bd51-123ab0646bdd tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:12.366177 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1897d05e-75cf-4323-bd51-123ab0646bdd tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:12.366692 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1897d05e-75cf-4323-bd51-123ab0646bdd tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:12.367563 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1897d05e-75cf-4323-bd51-123ab0646bdd tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:12.368108 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1897d05e-75cf-4323-bd51-123ab0646bdd tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:12.368731 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1897d05e-75cf-4323-bd51-123ab0646bdd tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:12.403294 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-9bcd0fe6-f77f-4833-9fe5-741cc5f61a31 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879c85830a9f42088a4ebdf1e3cfb39b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b54f56cfbc814cccb533c65966f35a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:05:12.434858 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-9bcd0fe6-f77f-4833-9fe5-741cc5f61a31 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] 10.222.0.18 "GET /compute/v2.1/servers/3fdb6d35-9428-4253-ad00-932310ecdf5d" status: 200 len: 1313 microversion: 2.1 time: 2.293226 Oct 22 21:05:12.442346 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1705/3348] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:05:10 2022] GET /compute/v2.1/servers/3fdb6d35-9428-4253-ad00-932310ecdf5d => generated 1313 bytes in 2301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:05:12.453459 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-3881624d-8dba-4379-a872-deaadf1140c8 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:05:12.458578 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-3881624d-8dba-4379-a872-deaadf1140c8 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] [instance: ebd7be2f-44d6-4f75-b112-0d6af4731f65] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:05:12.482190 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3881624d-8dba-4379-a872-deaadf1140c8 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:12.496639 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3881624d-8dba-4379-a872-deaadf1140c8 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:12.497922 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3881624d-8dba-4379-a872-deaadf1140c8 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:12.499411 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3881624d-8dba-4379-a872-deaadf1140c8 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:12.500612 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3881624d-8dba-4379-a872-deaadf1140c8 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:12.501431 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3881624d-8dba-4379-a872-deaadf1140c8 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:13.761068 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-1897d05e-75cf-4323-bd51-123ab0646bdd tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1b410a64e0415a96d30f5040361137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd7873d6db4e09bc9ab9a048a6b1ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:05:13.779800 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-1897d05e-75cf-4323-bd51-123ab0646bdd tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] 10.222.0.18 "GET /compute/v2.1/servers/931293d3-cb3a-4fd1-a684-eb740f010845" status: 200 len: 1510 microversion: 2.1 time: 1.457584 Oct 22 21:05:13.780564 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1644/3349] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:05:12 2022] GET /compute/v2.1/servers/931293d3-cb3a-4fd1-a684-eb740f010845 => generated 1510 bytes in 1459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:05:13.799758 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-d5fe51e9-5333-431f-b960-855d0aaeba33 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:05:13.808533 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-d5fe51e9-5333-431f-b960-855d0aaeba33 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] [instance: 844f3fc3-ad5d-4dda-b642-ce9c1d417820] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:05:13.815588 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell0:SELECT=12 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:05:13.831019 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d5fe51e9-5333-431f-b960-855d0aaeba33 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:13.831326 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-3881624d-8dba-4379-a872-deaadf1140c8 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3820b31a424c3a9216a6ef91fcb285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a42c3ecf474883ac652fcc8c01c9f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:05:13.831542 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d5fe51e9-5333-431f-b960-855d0aaeba33 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:13.836060 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d5fe51e9-5333-431f-b960-855d0aaeba33 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:13.837084 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d5fe51e9-5333-431f-b960-855d0aaeba33 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:13.837731 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d5fe51e9-5333-431f-b960-855d0aaeba33 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:13.838326 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d5fe51e9-5333-431f-b960-855d0aaeba33 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:13.845966 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-3881624d-8dba-4379-a872-deaadf1140c8 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] 10.222.0.18 "GET /compute/v2.1/servers/ebd7be2f-44d6-4f75-b112-0d6af4731f65" status: 200 len: 1203 microversion: 2.1 time: 1.401923 Oct 22 21:05:13.848956 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1706/3350] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:05:12 2022] GET /compute/v2.1/servers/ebd7be2f-44d6-4f75-b112-0d6af4731f65 => generated 1203 bytes in 1406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:05:13.870585 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-a6e9b2c4-37e3-4bd3-890b-8100e44a5f92 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:05:13.871961 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-a6e9b2c4-37e3-4bd3-890b-8100e44a5f92 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] [instance: 3fdb6d35-9428-4253-ad00-932310ecdf5d] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:05:13.882033 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell0:SELECT=22 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:05:13.907098 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a6e9b2c4-37e3-4bd3-890b-8100e44a5f92 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:13.907878 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a6e9b2c4-37e3-4bd3-890b-8100e44a5f92 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:13.908551 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a6e9b2c4-37e3-4bd3-890b-8100e44a5f92 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:13.909617 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a6e9b2c4-37e3-4bd3-890b-8100e44a5f92 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:13.910330 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a6e9b2c4-37e3-4bd3-890b-8100e44a5f92 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:13.917853 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a6e9b2c4-37e3-4bd3-890b-8100e44a5f92 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:14.758394 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-a6e9b2c4-37e3-4bd3-890b-8100e44a5f92 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879c85830a9f42088a4ebdf1e3cfb39b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b54f56cfbc814cccb533c65966f35a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:05:14.778534 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-a6e9b2c4-37e3-4bd3-890b-8100e44a5f92 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] 10.222.0.18 "GET /compute/v2.1/servers/3fdb6d35-9428-4253-ad00-932310ecdf5d" status: 200 len: 1313 microversion: 2.1 time: 0.927790 Oct 22 21:05:14.780115 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1707/3351] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:05:13 2022] GET /compute/v2.1/servers/3fdb6d35-9428-4253-ad00-932310ecdf5d => generated 1313 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:05:14.808885 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-595805bb-8e7a-4d12-b939-a37759555ee6 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:05:14.809841 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-595805bb-8e7a-4d12-b939-a37759555ee6 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] [instance: 931293d3-cb3a-4fd1-a684-eb740f010845] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:05:14.834931 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-595805bb-8e7a-4d12-b939-a37759555ee6 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:14.836225 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-595805bb-8e7a-4d12-b939-a37759555ee6 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:14.836831 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-595805bb-8e7a-4d12-b939-a37759555ee6 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:14.837922 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-595805bb-8e7a-4d12-b939-a37759555ee6 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:14.838533 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-595805bb-8e7a-4d12-b939-a37759555ee6 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:14.840369 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-595805bb-8e7a-4d12-b939-a37759555ee6 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:15.393386 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-d5fe51e9-5333-431f-b960-855d0aaeba33 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a44ff8e7c14b94b1670f030085c43d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a26a2284f4424cbeaf63d504652546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:05:15.415105 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-d5fe51e9-5333-431f-b960-855d0aaeba33 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] 10.222.0.18 "GET /compute/v2.1/servers/844f3fc3-ad5d-4dda-b642-ce9c1d417820" status: 200 len: 1308 microversion: 2.1 time: 1.626259 Oct 22 21:05:15.417418 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1645/3352] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:05:13 2022] GET /compute/v2.1/servers/844f3fc3-ad5d-4dda-b642-ce9c1d417820 => generated 1308 bytes in 1629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:05:15.428482 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-0df3fb1a-174f-4195-bc16-75b697220827 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:05:15.429570 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-0df3fb1a-174f-4195-bc16-75b697220827 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] [instance: ebd7be2f-44d6-4f75-b112-0d6af4731f65] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:05:15.445231 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_api:SELECT=82 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:05:15.450011 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0df3fb1a-174f-4195-bc16-75b697220827 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:15.450915 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0df3fb1a-174f-4195-bc16-75b697220827 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:15.451924 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0df3fb1a-174f-4195-bc16-75b697220827 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:15.454764 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0df3fb1a-174f-4195-bc16-75b697220827 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:15.455975 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0df3fb1a-174f-4195-bc16-75b697220827 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:15.460394 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0df3fb1a-174f-4195-bc16-75b697220827 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:15.490190 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:SELECT=100 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:05:17.007070 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-595805bb-8e7a-4d12-b939-a37759555ee6 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1b410a64e0415a96d30f5040361137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd7873d6db4e09bc9ab9a048a6b1ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:05:17.030751 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-595805bb-8e7a-4d12-b939-a37759555ee6 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] 10.222.0.18 "GET /compute/v2.1/servers/931293d3-cb3a-4fd1-a684-eb740f010845" status: 200 len: 1510 microversion: 2.1 time: 2.222498 Oct 22 21:05:17.037752 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1708/3353] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:05:14 2022] GET /compute/v2.1/servers/931293d3-cb3a-4fd1-a684-eb740f010845 => generated 1510 bytes in 2234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:05:17.054430 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-e6a9e2db-5cab-4865-ac0e-95a409cd1b85 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:05:17.055439 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-e6a9e2db-5cab-4865-ac0e-95a409cd1b85 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] [instance: 3fdb6d35-9428-4253-ad00-932310ecdf5d] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:05:17.071316 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e6a9e2db-5cab-4865-ac0e-95a409cd1b85 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:17.073314 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e6a9e2db-5cab-4865-ac0e-95a409cd1b85 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:17.074724 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e6a9e2db-5cab-4865-ac0e-95a409cd1b85 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:17.075823 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e6a9e2db-5cab-4865-ac0e-95a409cd1b85 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:17.077458 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e6a9e2db-5cab-4865-ac0e-95a409cd1b85 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:17.086312 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e6a9e2db-5cab-4865-ac0e-95a409cd1b85 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:18.239818 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-e6a9e2db-5cab-4865-ac0e-95a409cd1b85 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879c85830a9f42088a4ebdf1e3cfb39b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b54f56cfbc814cccb533c65966f35a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:05:18.256670 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-e6a9e2db-5cab-4865-ac0e-95a409cd1b85 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] 10.222.0.18 "GET /compute/v2.1/servers/3fdb6d35-9428-4253-ad00-932310ecdf5d" status: 200 len: 1313 microversion: 2.1 time: 1.215104 Oct 22 21:05:18.256670 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1709/3354] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:05:17 2022] GET /compute/v2.1/servers/3fdb6d35-9428-4253-ad00-932310ecdf5d => generated 1313 bytes in 1218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:05:18.277937 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-32862f00-2bed-461f-9613-872300f7a48f req-9e7c5b50-0f4a-4a8e-abb4-77721f0e365b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3fdb6d35-9428-4253-ad00-932310ecdf5d", "tag": "50c60f5d-e9d4-4a3b-95fc-83e6b2ec07bb"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:05:18.310101 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-32862f00-2bed-461f-9613-872300f7a48f req-9e7c5b50-0f4a-4a8e-abb4-77721f0e365b service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:18.311016 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-32862f00-2bed-461f-9613-872300f7a48f req-9e7c5b50-0f4a-4a8e-abb4-77721f0e365b service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:18.315510 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-32862f00-2bed-461f-9613-872300f7a48f req-9e7c5b50-0f4a-4a8e-abb4-77721f0e365b service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:18.392078 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-32862f00-2bed-461f-9613-872300f7a48f req-9e7c5b50-0f4a-4a8e-abb4-77721f0e365b service nova] Creating event network-changed:50c60f5d-e9d4-4a3b-95fc-83e6b2ec07bb for instance 3fdb6d35-9428-4253-ad00-932310ecdf5d on nch1-master-1 Oct 22 21:05:18.405383 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-32862f00-2bed-461f-9613-872300f7a48f req-9e7c5b50-0f4a-4a8e-abb4-77721f0e365b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.140476 Oct 22 21:05:18.412003 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1710/3355] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:05:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:05:18.419453 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-5dcc21c9-4656-48e1-b07d-c7f930f595ed tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:05:18.419453 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-5dcc21c9-4656-48e1-b07d-c7f930f595ed tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] [instance: 844f3fc3-ad5d-4dda-b642-ce9c1d417820] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:05:18.454371 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5dcc21c9-4656-48e1-b07d-c7f930f595ed tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:18.454371 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5dcc21c9-4656-48e1-b07d-c7f930f595ed tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:18.454731 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5dcc21c9-4656-48e1-b07d-c7f930f595ed tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:18.455360 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5dcc21c9-4656-48e1-b07d-c7f930f595ed tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:18.455814 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5dcc21c9-4656-48e1-b07d-c7f930f595ed tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:18.469348 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5dcc21c9-4656-48e1-b07d-c7f930f595ed tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:19.168340 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-0df3fb1a-174f-4195-bc16-75b697220827 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3820b31a424c3a9216a6ef91fcb285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a42c3ecf474883ac652fcc8c01c9f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:05:19.181080 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-0df3fb1a-174f-4195-bc16-75b697220827 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] 10.222.0.18 "GET /compute/v2.1/servers/ebd7be2f-44d6-4f75-b112-0d6af4731f65" status: 200 len: 1203 microversion: 2.1 time: 3.762186 Oct 22 21:05:19.181693 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1646/3356] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:05:15 2022] GET /compute/v2.1/servers/ebd7be2f-44d6-4f75-b112-0d6af4731f65 => generated 1203 bytes in 3763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:05:19.936586 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-ad830e5a-45fe-4bfa-9ae6-b5f804d90259 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:05:19.937532 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-ad830e5a-45fe-4bfa-9ae6-b5f804d90259 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] [instance: 931293d3-cb3a-4fd1-a684-eb740f010845] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:05:20.009359 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ad830e5a-45fe-4bfa-9ae6-b5f804d90259 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:20.010913 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ad830e5a-45fe-4bfa-9ae6-b5f804d90259 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:20.016025 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ad830e5a-45fe-4bfa-9ae6-b5f804d90259 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:20.019732 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ad830e5a-45fe-4bfa-9ae6-b5f804d90259 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:20.025569 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ad830e5a-45fe-4bfa-9ae6-b5f804d90259 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:20.028300 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ad830e5a-45fe-4bfa-9ae6-b5f804d90259 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:20.966723 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-ad830e5a-45fe-4bfa-9ae6-b5f804d90259 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1b410a64e0415a96d30f5040361137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd7873d6db4e09bc9ab9a048a6b1ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:05:20.993427 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-ad830e5a-45fe-4bfa-9ae6-b5f804d90259 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] 10.222.0.18 "GET /compute/v2.1/servers/931293d3-cb3a-4fd1-a684-eb740f010845" status: 200 len: 1487 microversion: 2.1 time: 1.786238 Oct 22 21:05:20.994415 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1647/3357] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:05:19 2022] GET /compute/v2.1/servers/931293d3-cb3a-4fd1-a684-eb740f010845 => generated 1487 bytes in 1812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:05:20.999505 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-fbce40ae-db95-40a7-b99a-23dcf34f17d6 req-31b27aea-0a30-4fb2-85bb-334d5d6753af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ebd7be2f-44d6-4f75-b112-0d6af4731f65", "name": "network-vif-plugged", "status": "completed", "tag": "6aece53a-c728-48a5-ae9d-a3aacbe74768"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:05:21.029965 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-fbce40ae-db95-40a7-b99a-23dcf34f17d6 req-31b27aea-0a30-4fb2-85bb-334d5d6753af service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:21.030591 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-fbce40ae-db95-40a7-b99a-23dcf34f17d6 req-31b27aea-0a30-4fb2-85bb-334d5d6753af service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:21.031153 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-fbce40ae-db95-40a7-b99a-23dcf34f17d6 req-31b27aea-0a30-4fb2-85bb-334d5d6753af service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:21.082625 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-fbce40ae-db95-40a7-b99a-23dcf34f17d6 req-31b27aea-0a30-4fb2-85bb-334d5d6753af service nova] Creating event network-vif-plugged:6aece53a-c728-48a5-ae9d-a3aacbe74768 for instance ebd7be2f-44d6-4f75-b112-0d6af4731f65 on nch2-master-1 Oct 22 21:05:21.111237 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-fbce40ae-db95-40a7-b99a-23dcf34f17d6 req-31b27aea-0a30-4fb2-85bb-334d5d6753af service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101785 Oct 22 21:05:21.112854 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1648/3358] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:05:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:05:21.131046 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-bf050b5c-ea36-4f17-99d9-28ff0495a5de tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:05:21.132084 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-5dcc21c9-4656-48e1-b07d-c7f930f595ed tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a44ff8e7c14b94b1670f030085c43d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a26a2284f4424cbeaf63d504652546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:05:21.132708 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-bf050b5c-ea36-4f17-99d9-28ff0495a5de tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] [instance: 3fdb6d35-9428-4253-ad00-932310ecdf5d] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:05:21.143096 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-5dcc21c9-4656-48e1-b07d-c7f930f595ed tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] 10.222.0.18 "GET /compute/v2.1/servers/844f3fc3-ad5d-4dda-b642-ce9c1d417820" status: 200 len: 1308 microversion: 2.1 time: 2.729141 Oct 22 21:05:21.143721 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bf050b5c-ea36-4f17-99d9-28ff0495a5de tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:21.156987 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bf050b5c-ea36-4f17-99d9-28ff0495a5de tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:21.161233 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bf050b5c-ea36-4f17-99d9-28ff0495a5de tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:21.162893 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bf050b5c-ea36-4f17-99d9-28ff0495a5de tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:21.163047 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1711/3359] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:05:18 2022] GET /compute/v2.1/servers/844f3fc3-ad5d-4dda-b642-ce9c1d417820 => generated 1308 bytes in 2750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:05:21.163838 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bf050b5c-ea36-4f17-99d9-28ff0495a5de tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:21.164517 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bf050b5c-ea36-4f17-99d9-28ff0495a5de tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:21.173813 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-90e9c946-1ea0-471e-9855-97f7c2a379c3 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:05:21.174453 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-90e9c946-1ea0-471e-9855-97f7c2a379c3 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] [instance: ebd7be2f-44d6-4f75-b112-0d6af4731f65] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:05:21.193683 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=9 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:05:21.200259 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-90e9c946-1ea0-471e-9855-97f7c2a379c3 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:21.201672 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-90e9c946-1ea0-471e-9855-97f7c2a379c3 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:21.202855 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-90e9c946-1ea0-471e-9855-97f7c2a379c3 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:21.205551 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-90e9c946-1ea0-471e-9855-97f7c2a379c3 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:21.206514 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-90e9c946-1ea0-471e-9855-97f7c2a379c3 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:21.210598 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-90e9c946-1ea0-471e-9855-97f7c2a379c3 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:21.843601 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-bf050b5c-ea36-4f17-99d9-28ff0495a5de tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879c85830a9f42088a4ebdf1e3cfb39b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b54f56cfbc814cccb533c65966f35a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:05:21.859705 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-bf050b5c-ea36-4f17-99d9-28ff0495a5de tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] 10.222.0.18 "GET /compute/v2.1/servers/3fdb6d35-9428-4253-ad00-932310ecdf5d" status: 200 len: 1313 microversion: 2.1 time: 0.745232 Oct 22 21:05:21.861483 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1649/3360] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:05:21 2022] GET /compute/v2.1/servers/3fdb6d35-9428-4253-ad00-932310ecdf5d => generated 1313 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:05:21.882668 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-fb61ce00-c1eb-49ca-9bda-0868bcb268b3 req-da1b8296-dd69-4180-ba1d-9861350081be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "844f3fc3-ad5d-4dda-b642-ce9c1d417820", "tag": "abb44346-87c2-41c9-96f6-3db9abdcf36e"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:05:21.934915 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-fb61ce00-c1eb-49ca-9bda-0868bcb268b3 req-da1b8296-dd69-4180-ba1d-9861350081be service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:21.935672 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-fb61ce00-c1eb-49ca-9bda-0868bcb268b3 req-da1b8296-dd69-4180-ba1d-9861350081be service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:21.936411 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-fb61ce00-c1eb-49ca-9bda-0868bcb268b3 req-da1b8296-dd69-4180-ba1d-9861350081be service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:21.974998 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-fb61ce00-c1eb-49ca-9bda-0868bcb268b3 req-da1b8296-dd69-4180-ba1d-9861350081be service nova] Creating event network-changed:abb44346-87c2-41c9-96f6-3db9abdcf36e for instance 844f3fc3-ad5d-4dda-b642-ce9c1d417820 on nch2-master-1 Oct 22 21:05:21.978630 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-90e9c946-1ea0-471e-9855-97f7c2a379c3 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3820b31a424c3a9216a6ef91fcb285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a42c3ecf474883ac652fcc8c01c9f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:05:21.985297 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell1:SELECT=100 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:05:21.992576 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-90e9c946-1ea0-471e-9855-97f7c2a379c3 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] 10.222.0.18 "GET /compute/v2.1/servers/ebd7be2f-44d6-4f75-b112-0d6af4731f65" status: 200 len: 1203 microversion: 2.1 time: 0.828114 Oct 22 21:05:22.007193 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-fb61ce00-c1eb-49ca-9bda-0868bcb268b3 req-da1b8296-dd69-4180-ba1d-9861350081be service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.140918 Oct 22 21:05:22.015570 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1650/3361] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:05:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:05:22.021450 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1712/3362] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:05:21 2022] GET /compute/v2.1/servers/ebd7be2f-44d6-4f75-b112-0d6af4731f65 => generated 1203 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:05:22.026207 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-d62b4933-734b-4d81-b275-81663cb7c213 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:05:22.040883 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-d62b4933-734b-4d81-b275-81663cb7c213 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] [instance: 931293d3-cb3a-4fd1-a684-eb740f010845] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:05:22.071151 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d62b4933-734b-4d81-b275-81663cb7c213 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:22.072482 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d62b4933-734b-4d81-b275-81663cb7c213 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:22.074130 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d62b4933-734b-4d81-b275-81663cb7c213 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:22.075705 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d62b4933-734b-4d81-b275-81663cb7c213 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:22.076503 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d62b4933-734b-4d81-b275-81663cb7c213 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:22.078802 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d62b4933-734b-4d81-b275-81663cb7c213 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:22.209373 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-d62b4933-734b-4d81-b275-81663cb7c213 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] [instance: 931293d3-cb3a-4fd1-a684-eb740f010845] Going to try to terminate instance {{(pid=138744) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 21:05:22.493157 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-d62b4933-734b-4d81-b275-81663cb7c213 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] 10.222.0.18 "DELETE /compute/v2.1/servers/931293d3-cb3a-4fd1-a684-eb740f010845" status: 204 len: 0 microversion: 2.1 time: 0.475122 Oct 22 21:05:22.494118 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1651/3363] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 21:05:22 2022] DELETE /compute/v2.1/servers/931293d3-cb3a-4fd1-a684-eb740f010845 => generated 0 bytes in 477 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 21:05:22.502807 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-e0464469-c577-4303-a5d5-636f45fc6118 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:05:22.504569 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-e0464469-c577-4303-a5d5-636f45fc6118 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] [instance: 931293d3-cb3a-4fd1-a684-eb740f010845] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:05:22.532029 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e0464469-c577-4303-a5d5-636f45fc6118 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:22.532624 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e0464469-c577-4303-a5d5-636f45fc6118 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:22.538106 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e0464469-c577-4303-a5d5-636f45fc6118 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:22.538932 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e0464469-c577-4303-a5d5-636f45fc6118 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:22.539456 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e0464469-c577-4303-a5d5-636f45fc6118 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:22.545473 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e0464469-c577-4303-a5d5-636f45fc6118 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:22.679795 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-cabcae95-1424-4aee-94c9-ac9e1c0bd2a7 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:05:22.680433 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-cabcae95-1424-4aee-94c9-ac9e1c0bd2a7 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] [instance: 844f3fc3-ad5d-4dda-b642-ce9c1d417820] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:05:22.688939 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cabcae95-1424-4aee-94c9-ac9e1c0bd2a7 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:22.689595 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cabcae95-1424-4aee-94c9-ac9e1c0bd2a7 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:22.690052 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cabcae95-1424-4aee-94c9-ac9e1c0bd2a7 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:22.690772 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cabcae95-1424-4aee-94c9-ac9e1c0bd2a7 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:22.691234 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cabcae95-1424-4aee-94c9-ac9e1c0bd2a7 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:22.691695 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cabcae95-1424-4aee-94c9-ac9e1c0bd2a7 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:23.055081 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-e0464469-c577-4303-a5d5-636f45fc6118 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1b410a64e0415a96d30f5040361137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd7873d6db4e09bc9ab9a048a6b1ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:05:23.072307 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-e0464469-c577-4303-a5d5-636f45fc6118 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] 10.222.0.18 "GET /compute/v2.1/servers/931293d3-cb3a-4fd1-a684-eb740f010845" status: 200 len: 1493 microversion: 2.1 time: 0.573425 Oct 22 21:05:23.075495 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1652/3364] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:05:22 2022] GET /compute/v2.1/servers/931293d3-cb3a-4fd1-a684-eb740f010845 => generated 1493 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:05:23.081239 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-a0cfe2c1-1c6d-4901-9bb4-187c4f3c638b tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:05:23.083171 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-a0cfe2c1-1c6d-4901-9bb4-187c4f3c638b tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] [instance: 3fdb6d35-9428-4253-ad00-932310ecdf5d] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:05:23.101260 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a0cfe2c1-1c6d-4901-9bb4-187c4f3c638b tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:23.101931 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a0cfe2c1-1c6d-4901-9bb4-187c4f3c638b tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:23.102646 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a0cfe2c1-1c6d-4901-9bb4-187c4f3c638b tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:23.104226 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a0cfe2c1-1c6d-4901-9bb4-187c4f3c638b tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:23.105078 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a0cfe2c1-1c6d-4901-9bb4-187c4f3c638b tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:23.105954 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a0cfe2c1-1c6d-4901-9bb4-187c4f3c638b tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:23.203807 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-cabcae95-1424-4aee-94c9-ac9e1c0bd2a7 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a44ff8e7c14b94b1670f030085c43d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a26a2284f4424cbeaf63d504652546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:05:23.232750 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-cabcae95-1424-4aee-94c9-ac9e1c0bd2a7 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] 10.222.0.18 "GET /compute/v2.1/servers/844f3fc3-ad5d-4dda-b642-ce9c1d417820" status: 200 len: 1308 microversion: 2.1 time: 1.062511 Oct 22 21:05:23.247914 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1713/3365] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:05:22 2022] GET /compute/v2.1/servers/844f3fc3-ad5d-4dda-b642-ce9c1d417820 => generated 1308 bytes in 1083 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:05:23.255037 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-94731e33-9493-4f11-b985-f4061eecc22e tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:05:23.261715 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-94731e33-9493-4f11-b985-f4061eecc22e tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] [instance: ebd7be2f-44d6-4f75-b112-0d6af4731f65] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:05:23.270187 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-94731e33-9493-4f11-b985-f4061eecc22e tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:23.271697 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-94731e33-9493-4f11-b985-f4061eecc22e tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:23.272800 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-94731e33-9493-4f11-b985-f4061eecc22e tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:23.274025 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-94731e33-9493-4f11-b985-f4061eecc22e tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:23.274658 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-94731e33-9493-4f11-b985-f4061eecc22e tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:23.275250 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-94731e33-9493-4f11-b985-f4061eecc22e tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:23.761833 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-a0cfe2c1-1c6d-4901-9bb4-187c4f3c638b tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879c85830a9f42088a4ebdf1e3cfb39b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b54f56cfbc814cccb533c65966f35a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:05:23.770310 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-a0cfe2c1-1c6d-4901-9bb4-187c4f3c638b tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] 10.222.0.18 "GET /compute/v2.1/servers/3fdb6d35-9428-4253-ad00-932310ecdf5d" status: 200 len: 1313 microversion: 2.1 time: 0.693402 Oct 22 21:05:23.771050 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1653/3366] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:05:23 2022] GET /compute/v2.1/servers/3fdb6d35-9428-4253-ad00-932310ecdf5d => generated 1313 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:05:23.825560 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-94731e33-9493-4f11-b985-f4061eecc22e tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3820b31a424c3a9216a6ef91fcb285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a42c3ecf474883ac652fcc8c01c9f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:05:23.841689 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-94731e33-9493-4f11-b985-f4061eecc22e tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] 10.222.0.18 "GET /compute/v2.1/servers/ebd7be2f-44d6-4f75-b112-0d6af4731f65" status: 200 len: 1391 microversion: 2.1 time: 0.589079 Oct 22 21:05:23.843387 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1714/3367] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:05:23 2022] GET /compute/v2.1/servers/ebd7be2f-44d6-4f75-b112-0d6af4731f65 => generated 1391 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:05:23.875497 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-4055ff94-09ce-4f84-a75f-50d611237bd7 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:05:23.876472 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-4055ff94-09ce-4f84-a75f-50d611237bd7 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] [instance: ebd7be2f-44d6-4f75-b112-0d6af4731f65] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:05:23.884690 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4055ff94-09ce-4f84-a75f-50d611237bd7 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:23.886008 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4055ff94-09ce-4f84-a75f-50d611237bd7 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:23.886699 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4055ff94-09ce-4f84-a75f-50d611237bd7 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:23.887658 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4055ff94-09ce-4f84-a75f-50d611237bd7 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:23.888307 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4055ff94-09ce-4f84-a75f-50d611237bd7 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:23.889104 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4055ff94-09ce-4f84-a75f-50d611237bd7 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:24.100886 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-15f65904-ad4a-4c3b-955e-087d8173e3c0 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:05:24.101664 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-15f65904-ad4a-4c3b-955e-087d8173e3c0 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] [instance: 931293d3-cb3a-4fd1-a684-eb740f010845] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:05:24.109488 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-15f65904-ad4a-4c3b-955e-087d8173e3c0 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:24.110030 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-15f65904-ad4a-4c3b-955e-087d8173e3c0 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:24.110728 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-15f65904-ad4a-4c3b-955e-087d8173e3c0 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:24.111727 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-15f65904-ad4a-4c3b-955e-087d8173e3c0 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:24.116556 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-15f65904-ad4a-4c3b-955e-087d8173e3c0 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:24.117676 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-15f65904-ad4a-4c3b-955e-087d8173e3c0 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:24.338717 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-4055ff94-09ce-4f84-a75f-50d611237bd7 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3820b31a424c3a9216a6ef91fcb285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a42c3ecf474883ac652fcc8c01c9f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:05:24.352359 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-4055ff94-09ce-4f84-a75f-50d611237bd7 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] 10.222.0.18 "GET /compute/v2.1/servers/ebd7be2f-44d6-4f75-b112-0d6af4731f65" status: 200 len: 1391 microversion: 2.1 time: 0.487243 Oct 22 21:05:24.356164 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1654/3368] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:05:23 2022] GET /compute/v2.1/servers/ebd7be2f-44d6-4f75-b112-0d6af4731f65 => generated 1391 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:05:24.367211 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-2fbcbaeb-152e-48af-a398-ba79cda054c6 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:05:24.369321 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-2fbcbaeb-152e-48af-a398-ba79cda054c6 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] [instance: 844f3fc3-ad5d-4dda-b642-ce9c1d417820] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:05:24.390208 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2fbcbaeb-152e-48af-a398-ba79cda054c6 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:24.390824 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2fbcbaeb-152e-48af-a398-ba79cda054c6 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:24.391434 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2fbcbaeb-152e-48af-a398-ba79cda054c6 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:24.394584 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2fbcbaeb-152e-48af-a398-ba79cda054c6 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:24.395380 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2fbcbaeb-152e-48af-a398-ba79cda054c6 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:24.397233 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2fbcbaeb-152e-48af-a398-ba79cda054c6 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:25.014058 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-15f65904-ad4a-4c3b-955e-087d8173e3c0 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1b410a64e0415a96d30f5040361137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd7873d6db4e09bc9ab9a048a6b1ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:05:25.024205 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-15f65904-ad4a-4c3b-955e-087d8173e3c0 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] 10.222.0.18 "GET /compute/v2.1/servers/931293d3-cb3a-4fd1-a684-eb740f010845" status: 200 len: 1493 microversion: 2.1 time: 0.928134 Oct 22 21:05:25.039911 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1715/3369] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:05:24 2022] GET /compute/v2.1/servers/931293d3-cb3a-4fd1-a684-eb740f010845 => generated 1493 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:05:25.057476 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-a94ec38a-8c4e-45d8-b7bf-c378145dcd51 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:05:25.058059 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-a94ec38a-8c4e-45d8-b7bf-c378145dcd51 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] [instance: ebd7be2f-44d6-4f75-b112-0d6af4731f65] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:05:25.073735 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a94ec38a-8c4e-45d8-b7bf-c378145dcd51 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:25.074530 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a94ec38a-8c4e-45d8-b7bf-c378145dcd51 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:25.074956 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a94ec38a-8c4e-45d8-b7bf-c378145dcd51 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:25.075815 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a94ec38a-8c4e-45d8-b7bf-c378145dcd51 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:25.076222 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a94ec38a-8c4e-45d8-b7bf-c378145dcd51 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:25.076714 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a94ec38a-8c4e-45d8-b7bf-c378145dcd51 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:25.157658 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-2fbcbaeb-152e-48af-a398-ba79cda054c6 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a44ff8e7c14b94b1670f030085c43d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a26a2284f4424cbeaf63d504652546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:05:25.187859 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-2fbcbaeb-152e-48af-a398-ba79cda054c6 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] 10.222.0.18 "GET /compute/v2.1/servers/844f3fc3-ad5d-4dda-b642-ce9c1d417820" status: 200 len: 1308 microversion: 2.1 time: 0.830192 Oct 22 21:05:25.188831 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1655/3370] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:05:24 2022] GET /compute/v2.1/servers/844f3fc3-ad5d-4dda-b642-ce9c1d417820 => generated 1308 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:05:25.204479 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-b521d85a-4a64-4785-8544-a33edc88ae49 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:05:25.205385 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-b521d85a-4a64-4785-8544-a33edc88ae49 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] [instance: 3fdb6d35-9428-4253-ad00-932310ecdf5d] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:05:25.222593 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b521d85a-4a64-4785-8544-a33edc88ae49 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:25.224092 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b521d85a-4a64-4785-8544-a33edc88ae49 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:25.224788 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b521d85a-4a64-4785-8544-a33edc88ae49 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:25.226052 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b521d85a-4a64-4785-8544-a33edc88ae49 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:25.226686 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b521d85a-4a64-4785-8544-a33edc88ae49 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:25.239844 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b521d85a-4a64-4785-8544-a33edc88ae49 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:27.372286 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-b521d85a-4a64-4785-8544-a33edc88ae49 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879c85830a9f42088a4ebdf1e3cfb39b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b54f56cfbc814cccb533c65966f35a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:05:27.387804 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-b521d85a-4a64-4785-8544-a33edc88ae49 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] 10.222.0.18 "GET /compute/v2.1/servers/3fdb6d35-9428-4253-ad00-932310ecdf5d" status: 200 len: 1313 microversion: 2.1 time: 2.194271 Oct 22 21:05:27.391326 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1656/3371] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:05:25 2022] GET /compute/v2.1/servers/3fdb6d35-9428-4253-ad00-932310ecdf5d => generated 1313 bytes in 2199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:05:27.392691 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-a94ec38a-8c4e-45d8-b7bf-c378145dcd51 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3820b31a424c3a9216a6ef91fcb285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a42c3ecf474883ac652fcc8c01c9f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:05:27.407244 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-9ac46fd9-a1f0-477a-a23a-0d724f32fc3c tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:05:27.408342 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-9ac46fd9-a1f0-477a-a23a-0d724f32fc3c tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] [instance: 931293d3-cb3a-4fd1-a684-eb740f010845] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:05:27.430518 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9ac46fd9-a1f0-477a-a23a-0d724f32fc3c tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:27.431828 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9ac46fd9-a1f0-477a-a23a-0d724f32fc3c tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:27.435853 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9ac46fd9-a1f0-477a-a23a-0d724f32fc3c tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:27.438427 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-a94ec38a-8c4e-45d8-b7bf-c378145dcd51 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] 10.222.0.18 "GET /compute/v2.1/servers/ebd7be2f-44d6-4f75-b112-0d6af4731f65" status: 200 len: 1391 microversion: 2.1 time: 2.395472 Oct 22 21:05:27.438824 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9ac46fd9-a1f0-477a-a23a-0d724f32fc3c tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:27.439505 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9ac46fd9-a1f0-477a-a23a-0d724f32fc3c tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:27.441887 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9ac46fd9-a1f0-477a-a23a-0d724f32fc3c tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:27.443520 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1716/3372] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:05:25 2022] GET /compute/v2.1/servers/ebd7be2f-44d6-4f75-b112-0d6af4731f65 => generated 1391 bytes in 2403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:05:27.483849 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-bb87a502-c704-4958-85ed-0fef1d4eb8a1 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:05:27.485288 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-bb87a502-c704-4958-85ed-0fef1d4eb8a1 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] [instance: 844f3fc3-ad5d-4dda-b642-ce9c1d417820] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:05:27.524097 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bb87a502-c704-4958-85ed-0fef1d4eb8a1 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:27.527786 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bb87a502-c704-4958-85ed-0fef1d4eb8a1 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:27.532033 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bb87a502-c704-4958-85ed-0fef1d4eb8a1 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:27.535267 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bb87a502-c704-4958-85ed-0fef1d4eb8a1 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:27.538528 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bb87a502-c704-4958-85ed-0fef1d4eb8a1 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:27.540125 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bb87a502-c704-4958-85ed-0fef1d4eb8a1 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:27.545642 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9ac46fd9-a1f0-477a-a23a-0d724f32fc3c tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:27.547131 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9ac46fd9-a1f0-477a-a23a-0d724f32fc3c tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:27.547886 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9ac46fd9-a1f0-477a-a23a-0d724f32fc3c tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:27.548580 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.objects.instance [None req-9ac46fd9-a1f0-477a-a23a-0d724f32fc3c tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lazy-loading 'fault' on Instance uuid 931293d3-cb3a-4fd1-a684-eb740f010845 {{(pid=138744) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 21:05:27.841621 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-9ac46fd9-a1f0-477a-a23a-0d724f32fc3c tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1b410a64e0415a96d30f5040361137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd7873d6db4e09bc9ab9a048a6b1ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:05:27.857833 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-9ac46fd9-a1f0-477a-a23a-0d724f32fc3c tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] 10.222.0.18 "GET /compute/v2.1/servers/931293d3-cb3a-4fd1-a684-eb740f010845" status: 200 len: 1303 microversion: 2.1 time: 0.463345 Oct 22 21:05:27.862588 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1657/3373] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:05:27 2022] GET /compute/v2.1/servers/931293d3-cb3a-4fd1-a684-eb740f010845 => generated 1303 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:05:27.877542 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-a9ac565d-8f36-46b8-9ffe-d04e9799335d req-8a9e4f48-c8ff-44dd-99bc-f323b1e3617e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "931293d3-cb3a-4fd1-a684-eb740f010845", "name": "network-vif-deleted", "tag": "cbfb6cca-3060-4248-8fe5-5bd4144394eb"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:05:27.916382 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-a9ac565d-8f36-46b8-9ffe-d04e9799335d req-8a9e4f48-c8ff-44dd-99bc-f323b1e3617e service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:27.916917 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-a9ac565d-8f36-46b8-9ffe-d04e9799335d req-8a9e4f48-c8ff-44dd-99bc-f323b1e3617e service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:27.917361 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-a9ac565d-8f36-46b8-9ffe-d04e9799335d req-8a9e4f48-c8ff-44dd-99bc-f323b1e3617e service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:27.940659 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-a9ac565d-8f36-46b8-9ffe-d04e9799335d req-8a9e4f48-c8ff-44dd-99bc-f323b1e3617e service nova] Creating event network-vif-deleted:cbfb6cca-3060-4248-8fe5-5bd4144394eb for instance 931293d3-cb3a-4fd1-a684-eb740f010845 on nch1-master-1 Oct 22 21:05:27.972278 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-a9ac565d-8f36-46b8-9ffe-d04e9799335d req-8a9e4f48-c8ff-44dd-99bc-f323b1e3617e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107678 Oct 22 21:05:27.973770 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1658/3374] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:05:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:05:27.984126 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-89b1a746-9dab-458b-bac7-49512924504e tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:05:27.992678 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-89b1a746-9dab-458b-bac7-49512924504e tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] [instance: ebd7be2f-44d6-4f75-b112-0d6af4731f65] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:05:28.051480 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-89b1a746-9dab-458b-bac7-49512924504e tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:28.066389 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-89b1a746-9dab-458b-bac7-49512924504e tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:28.067250 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-89b1a746-9dab-458b-bac7-49512924504e tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:28.073266 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-89b1a746-9dab-458b-bac7-49512924504e tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:28.074042 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-89b1a746-9dab-458b-bac7-49512924504e tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:28.079600 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-89b1a746-9dab-458b-bac7-49512924504e tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:28.132815 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-89b1a746-9dab-458b-bac7-49512924504e tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] [instance: ebd7be2f-44d6-4f75-b112-0d6af4731f65] Going to try to terminate instance {{(pid=138744) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 21:05:28.407387 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-89b1a746-9dab-458b-bac7-49512924504e tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] 10.222.0.18 "DELETE /compute/v2.1/servers/ebd7be2f-44d6-4f75-b112-0d6af4731f65" status: 204 len: 0 microversion: 2.1 time: 0.427002 Oct 22 21:05:28.411977 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1659/3375] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 21:05:27 2022] DELETE /compute/v2.1/servers/ebd7be2f-44d6-4f75-b112-0d6af4731f65 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 21:05:28.435166 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-a387caa4-e294-4c7d-8988-fb437023a78e tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:05:28.436569 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-a387caa4-e294-4c7d-8988-fb437023a78e tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] [instance: 3fdb6d35-9428-4253-ad00-932310ecdf5d] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:05:28.450856 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a387caa4-e294-4c7d-8988-fb437023a78e tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:28.451480 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a387caa4-e294-4c7d-8988-fb437023a78e tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:28.451844 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a387caa4-e294-4c7d-8988-fb437023a78e tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:28.457175 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a387caa4-e294-4c7d-8988-fb437023a78e tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:28.457946 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a387caa4-e294-4c7d-8988-fb437023a78e tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:28.458583 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a387caa4-e294-4c7d-8988-fb437023a78e tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:29.400884 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-bb87a502-c704-4958-85ed-0fef1d4eb8a1 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a44ff8e7c14b94b1670f030085c43d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a26a2284f4424cbeaf63d504652546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:05:29.410339 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-bb87a502-c704-4958-85ed-0fef1d4eb8a1 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] 10.222.0.18 "GET /compute/v2.1/servers/844f3fc3-ad5d-4dda-b642-ce9c1d417820" status: 200 len: 1308 microversion: 2.1 time: 1.964208 Oct 22 21:05:29.417497 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1717/3376] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:05:27 2022] GET /compute/v2.1/servers/844f3fc3-ad5d-4dda-b642-ce9c1d417820 => generated 1308 bytes in 1973 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:05:29.422754 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-dd167e12-15c6-4f54-b370-dc4e97220a52 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:05:29.428321 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-dd167e12-15c6-4f54-b370-dc4e97220a52 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] [instance: ebd7be2f-44d6-4f75-b112-0d6af4731f65] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:05:29.441567 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-dd167e12-15c6-4f54-b370-dc4e97220a52 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:29.442230 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-dd167e12-15c6-4f54-b370-dc4e97220a52 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:29.443209 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-dd167e12-15c6-4f54-b370-dc4e97220a52 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:29.444212 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-dd167e12-15c6-4f54-b370-dc4e97220a52 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:29.444850 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-dd167e12-15c6-4f54-b370-dc4e97220a52 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:29.445449 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-dd167e12-15c6-4f54-b370-dc4e97220a52 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:29.572146 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-a387caa4-e294-4c7d-8988-fb437023a78e tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879c85830a9f42088a4ebdf1e3cfb39b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b54f56cfbc814cccb533c65966f35a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:05:29.616483 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-a387caa4-e294-4c7d-8988-fb437023a78e tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] 10.222.0.18 "GET /compute/v2.1/servers/3fdb6d35-9428-4253-ad00-932310ecdf5d" status: 200 len: 1313 microversion: 2.1 time: 1.195767 Oct 22 21:05:29.622111 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1660/3377] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:05:28 2022] GET /compute/v2.1/servers/3fdb6d35-9428-4253-ad00-932310ecdf5d => generated 1313 bytes in 1207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:05:29.655364 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-5a4c405c-67a4-44c4-a64c-8237a2c16b3c tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:05:29.656068 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-5a4c405c-67a4-44c4-a64c-8237a2c16b3c tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] [instance: 931293d3-cb3a-4fd1-a684-eb740f010845] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:05:29.690482 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5a4c405c-67a4-44c4-a64c-8237a2c16b3c tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:29.693482 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5a4c405c-67a4-44c4-a64c-8237a2c16b3c tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:29.694492 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5a4c405c-67a4-44c4-a64c-8237a2c16b3c tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:29.696340 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5a4c405c-67a4-44c4-a64c-8237a2c16b3c tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:29.697507 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5a4c405c-67a4-44c4-a64c-8237a2c16b3c tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:29.700349 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5a4c405c-67a4-44c4-a64c-8237a2c16b3c tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:29.717180 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:05:29.754721 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-5a4c405c-67a4-44c4-a64c-8237a2c16b3c tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] HTTP exception thrown: Instance 931293d3-cb3a-4fd1-a684-eb740f010845 could not be found. Oct 22 21:05:29.757340 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-5a4c405c-67a4-44c4-a64c-8237a2c16b3c tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Request method failure captured: Oct 22 21:05:29.757340 ncdv-master-1 devstack@n-api.service[138744]: request: GET /compute/v2.1/servers/931293d3-cb3a-4fd1-a684-eb740f010845 HTTP/1.1 Oct 22 21:05:29.757340 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 21:05:29.757340 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 21:05:29.757340 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 21:05:29.757340 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 0 Oct 22 21:05:29.757340 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 21:05:29.757340 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 21:05:29.757340 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 21:05:29.757340 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 21:05:29.757340 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVFnfV28M622GxgIau9tfOtpQOzUe_Zks3cnq6zOgmdqQwk77RE2xHy9F74fRKXOoFFtdLiZlk8HWakwyjiKYmRp9GaMJF70RmWqk8on_rfYCWM12-ITQGodTkqOwwxslvC1Btdt7aRnJVFyVeqFX--IHdQyw_AkPLTYKSNTzj-OnnLE Oct 22 21:05:29.757340 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 21:05:29.757340 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 21:05:29.757340 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 21:05:29.757340 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 21:05:29.757340 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 21:05:29.757340 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 21:05:29.757340 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: b4cd7873d6db4e09bc9ab9a048a6b1ef Oct 22 21:05:29.757340 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-DeleteServersTestJSON-1244431593 Oct 22 21:05:29.757340 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 21:05:29.757340 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 21:05:29.757340 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_b4cd7873d6db4e09bc9ab9a048a6b1ef"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b4cd7873d6db4e09bc9ab9a048a6b1ef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/b4cd7873d6db4e09bc9ab9a048a6b1ef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b4cd7873d6db4e09bc9ab9a048a6b1ef"}]}] Oct 22 21:05:29.757340 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-DeleteServersTestJSON-1244431593 Oct 22 21:05:29.757340 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: b4cd7873d6db4e09bc9ab9a048a6b1ef Oct 22 21:05:29.757340 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-DeleteServersTestJSON-1244431593 Oct 22 21:05:29.757340 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-DeleteServersTestJSON-1244431593-project Oct 22 21:05:29.757340 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 21:05:29.757340 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 21:05:29.757340 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: be1b410a64e0415a96d30f5040361137 Oct 22 21:05:29.757340 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-DeleteServersTestJSON-1244431593-project Oct 22 21:05:29.757340 ncdv-master-1 devstack@n-api.service[138744]: method: > Oct 22 21:05:29.757340 ncdv-master-1 devstack@n-api.service[138744]: exception: Instance 931293d3-cb3a-4fd1-a684-eb740f010845 could not be found. Oct 22 21:05:29.757340 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': '931293d3-cb3a-4fd1-a684-eb740f010845'} Oct 22 21:05:29.757340 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:05:29.757340 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:05:29.757340 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 21:05:29.757340 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 21:05:29.757340 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 21:05:29.757340 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 21:05:29.757340 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 21:05:29.757340 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 21:05:29.757340 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 21:05:29.757340 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 21:05:29.757340 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 931293d3-cb3a-4fd1-a684-eb740f010845 could not be found. Oct 22 21:05:29.757340 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:05:29.757340 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:05:29.757340 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:05:29.757340 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:05:29.757340 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:05:29.757340 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:05:29.757340 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:05:29.757340 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:05:29.757340 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:05:29.757340 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:05:29.757340 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 21:05:29.757340 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 21:05:29.757340 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 21:05:29.757340 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 21:05:29.757340 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 21:05:29.757340 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:05:29.757340 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 931293d3-cb3a-4fd1-a684-eb740f010845 could not be found. Oct 22 21:05:29.757340 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:05:29.757340 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:05:29.757340 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:05:29.762285 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:05:29.762285 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:05:29.762285 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:05:29.762285 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:05:29.762285 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:05:29.762285 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 931293d3-cb3a-4fd1-a684-eb740f010845 could not be found. Oct 22 21:05:29.762285 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:05:29.765478 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-5a4c405c-67a4-44c4-a64c-8237a2c16b3c tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Returning 404 to user: Instance 931293d3-cb3a-4fd1-a684-eb740f010845 could not be found. {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:05:29.766948 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-5a4c405c-67a4-44c4-a64c-8237a2c16b3c tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] 10.222.0.18 "GET /compute/v2.1/servers/931293d3-cb3a-4fd1-a684-eb740f010845" status: 404 len: 111 microversion: 2.1 time: 0.134423 Oct 22 21:05:29.771847 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1661/3378] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:05:29 2022] GET /compute/v2.1/servers/931293d3-cb3a-4fd1-a684-eb740f010845 => generated 111 bytes in 149 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 21:05:29.780404 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-7e43a5e8-97b5-4312-a2da-98bd4dcfa27b req-758a455e-251a-4186-a22a-aaefe38a4569 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3fdb6d35-9428-4253-ad00-932310ecdf5d", "name": "network-vif-plugged", "status": "completed", "tag": "50c60f5d-e9d4-4a3b-95fc-83e6b2ec07bb"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:05:29.807259 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-7e43a5e8-97b5-4312-a2da-98bd4dcfa27b req-758a455e-251a-4186-a22a-aaefe38a4569 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:29.808182 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-7e43a5e8-97b5-4312-a2da-98bd4dcfa27b req-758a455e-251a-4186-a22a-aaefe38a4569 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:29.808886 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-7e43a5e8-97b5-4312-a2da-98bd4dcfa27b req-758a455e-251a-4186-a22a-aaefe38a4569 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:29.827065 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-7e43a5e8-97b5-4312-a2da-98bd4dcfa27b req-758a455e-251a-4186-a22a-aaefe38a4569 service nova] Creating event network-vif-plugged:50c60f5d-e9d4-4a3b-95fc-83e6b2ec07bb for instance 3fdb6d35-9428-4253-ad00-932310ecdf5d on nch1-master-1 Oct 22 21:05:29.834259 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-7e43a5e8-97b5-4312-a2da-98bd4dcfa27b req-758a455e-251a-4186-a22a-aaefe38a4569 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060699 Oct 22 21:05:29.836838 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1662/3379] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:05:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:05:30.223311 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-dd167e12-15c6-4f54-b370-dc4e97220a52 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3820b31a424c3a9216a6ef91fcb285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a42c3ecf474883ac652fcc8c01c9f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:05:30.236954 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-dd167e12-15c6-4f54-b370-dc4e97220a52 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] 10.222.0.18 "GET /compute/v2.1/servers/ebd7be2f-44d6-4f75-b112-0d6af4731f65" status: 200 len: 1397 microversion: 2.1 time: 0.817370 Oct 22 21:05:30.257123 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1718/3380] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:05:29 2022] GET /compute/v2.1/servers/ebd7be2f-44d6-4f75-b112-0d6af4731f65 => generated 1397 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:05:30.266623 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-2d7adbeb-934a-4d4e-8a81-a0c8ac5f3dd2 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1544472825", "imageRef": "085e4478-6edc-4a69-8e08-f9831713eb65", "flavorRef": "452", "networks": [{"uuid": "4ddebde3-67b6-4360-8934-2682d629ac63"}]}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:05:30.403650 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.network.neutron [None req-2d7adbeb-934a-4d4e-8a81-a0c8ac5f3dd2 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] validate_networks() for [('4ddebde3-67b6-4360-8934-2682d629ac63', None, None, None, None, None)] {{(pid=138745) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 21:05:30.917622 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-f45f006d-34ef-4137-bd8b-dc1b9c5c3393 tempest-AbsoluteLimitsTestJSON-59028455 tempest-AbsoluteLimitsTestJSON-59028455-project] Calling method '.version_select at 0x7fd39f02f4c0>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:05:30.946583 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f45f006d-34ef-4137-bd8b-dc1b9c5c3393 tempest-AbsoluteLimitsTestJSON-59028455 tempest-AbsoluteLimitsTestJSON-59028455-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:30.947455 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f45f006d-34ef-4137-bd8b-dc1b9c5c3393 tempest-AbsoluteLimitsTestJSON-59028455 tempest-AbsoluteLimitsTestJSON-59028455-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:30.948077 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f45f006d-34ef-4137-bd8b-dc1b9c5c3393 tempest-AbsoluteLimitsTestJSON-59028455 tempest-AbsoluteLimitsTestJSON-59028455-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:30.950992 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f45f006d-34ef-4137-bd8b-dc1b9c5c3393 tempest-AbsoluteLimitsTestJSON-59028455 tempest-AbsoluteLimitsTestJSON-59028455-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:30.951866 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f45f006d-34ef-4137-bd8b-dc1b9c5c3393 tempest-AbsoluteLimitsTestJSON-59028455 tempest-AbsoluteLimitsTestJSON-59028455-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:30.957716 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f45f006d-34ef-4137-bd8b-dc1b9c5c3393 tempest-AbsoluteLimitsTestJSON-59028455 tempest-AbsoluteLimitsTestJSON-59028455-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:31.009716 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-f45f006d-34ef-4137-bd8b-dc1b9c5c3393 tempest-AbsoluteLimitsTestJSON-59028455 tempest-AbsoluteLimitsTestJSON-59028455-project] 10.222.0.18 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 1.170475 Oct 22 21:05:31.029898 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1663/3381] 10.222.0.18 () {58 vars in 1122 bytes} [Sat Oct 22 21:05:29 2022] GET /compute/v2.1/limits => generated 511 bytes in 1191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:05:31.034373 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-b4e9d362-b88a-4e7a-a3f8-3e96ede314f3 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:05:31.035055 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-b4e9d362-b88a-4e7a-a3f8-3e96ede314f3 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] [instance: 844f3fc3-ad5d-4dda-b642-ce9c1d417820] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:05:31.056347 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b4e9d362-b88a-4e7a-a3f8-3e96ede314f3 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:31.057076 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b4e9d362-b88a-4e7a-a3f8-3e96ede314f3 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:31.061288 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b4e9d362-b88a-4e7a-a3f8-3e96ede314f3 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:31.062329 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b4e9d362-b88a-4e7a-a3f8-3e96ede314f3 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:31.062962 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b4e9d362-b88a-4e7a-a3f8-3e96ede314f3 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:31.063599 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b4e9d362-b88a-4e7a-a3f8-3e96ede314f3 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:31.758170 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-b4e9d362-b88a-4e7a-a3f8-3e96ede314f3 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a44ff8e7c14b94b1670f030085c43d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a26a2284f4424cbeaf63d504652546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:05:31.775435 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-b4e9d362-b88a-4e7a-a3f8-3e96ede314f3 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] 10.222.0.18 "GET /compute/v2.1/servers/844f3fc3-ad5d-4dda-b642-ce9c1d417820" status: 200 len: 1308 microversion: 2.1 time: 0.744901 Oct 22 21:05:31.776129 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1664/3382] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:05:31 2022] GET /compute/v2.1/servers/844f3fc3-ad5d-4dda-b642-ce9c1d417820 => generated 1308 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:05:31.796323 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-04c955ab-8215-45aa-be71-a66158f1e47e tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:05:31.797287 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-04c955ab-8215-45aa-be71-a66158f1e47e tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] [instance: 3fdb6d35-9428-4253-ad00-932310ecdf5d] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:05:31.805124 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-04c955ab-8215-45aa-be71-a66158f1e47e tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:31.805912 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-04c955ab-8215-45aa-be71-a66158f1e47e tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:31.806939 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-04c955ab-8215-45aa-be71-a66158f1e47e tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:31.808007 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-04c955ab-8215-45aa-be71-a66158f1e47e tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:31.808640 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-04c955ab-8215-45aa-be71-a66158f1e47e tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:31.809237 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-04c955ab-8215-45aa-be71-a66158f1e47e tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:32.506330 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-04c955ab-8215-45aa-be71-a66158f1e47e tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879c85830a9f42088a4ebdf1e3cfb39b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b54f56cfbc814cccb533c65966f35a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:05:32.517856 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-04c955ab-8215-45aa-be71-a66158f1e47e tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] 10.222.0.18 "GET /compute/v2.1/servers/3fdb6d35-9428-4253-ad00-932310ecdf5d" status: 200 len: 1498 microversion: 2.1 time: 0.725576 Oct 22 21:05:32.518768 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1665/3383] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:05:31 2022] GET /compute/v2.1/servers/3fdb6d35-9428-4253-ad00-932310ecdf5d => generated 1498 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:05:32.535131 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-c8a6b7fd-506f-43e6-9f93-1450ab543496 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:05:32.535804 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-c8a6b7fd-506f-43e6-9f93-1450ab543496 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] [instance: ebd7be2f-44d6-4f75-b112-0d6af4731f65] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:05:32.542236 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c8a6b7fd-506f-43e6-9f93-1450ab543496 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:32.542755 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c8a6b7fd-506f-43e6-9f93-1450ab543496 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:32.543168 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c8a6b7fd-506f-43e6-9f93-1450ab543496 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:32.550121 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c8a6b7fd-506f-43e6-9f93-1450ab543496 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:32.550785 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c8a6b7fd-506f-43e6-9f93-1450ab543496 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:32.551503 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c8a6b7fd-506f-43e6-9f93-1450ab543496 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:33.029677 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-2d7adbeb-934a-4d4e-8a81-a0c8ac5f3dd2 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Flavor limits 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 21:05:33.030598 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-2d7adbeb-934a-4d4e-8a81-a0c8ac5f3dd2 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Image limits 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 21:05:33.031296 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-2d7adbeb-934a-4d4e-8a81-a0c8ac5f3dd2 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Flavor pref 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 21:05:33.032198 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-2d7adbeb-934a-4d4e-8a81-a0c8ac5f3dd2 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Image pref 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 21:05:33.032824 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-2d7adbeb-934a-4d4e-8a81-a0c8ac5f3dd2 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 21:05:33.050651 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2d7adbeb-934a-4d4e-8a81-a0c8ac5f3dd2 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:33.054603 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2d7adbeb-934a-4d4e-8a81-a0c8ac5f3dd2 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:33.056117 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2d7adbeb-934a-4d4e-8a81-a0c8ac5f3dd2 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:33.057667 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2d7adbeb-934a-4d4e-8a81-a0c8ac5f3dd2 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:33.064127 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2d7adbeb-934a-4d4e-8a81-a0c8ac5f3dd2 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:33.064571 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2d7adbeb-934a-4d4e-8a81-a0c8ac5f3dd2 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:33.120637 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-2d7adbeb-934a-4d4e-8a81-a0c8ac5f3dd2 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Getting quotas for project b4cd7873d6db4e09bc9ab9a048a6b1ef. Resources: {'cores', 'instances', 'ram'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 21:05:33.134991 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-c8a6b7fd-506f-43e6-9f93-1450ab543496 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3820b31a424c3a9216a6ef91fcb285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a42c3ecf474883ac652fcc8c01c9f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:05:33.143635 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-2d7adbeb-934a-4d4e-8a81-a0c8ac5f3dd2 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Getting quotas for user be1b410a64e0415a96d30f5040361137 and project b4cd7873d6db4e09bc9ab9a048a6b1ef. Resources: {'cores', 'instances', 'ram'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 21:05:33.151840 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-c8a6b7fd-506f-43e6-9f93-1450ab543496 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] 10.222.0.18 "GET /compute/v2.1/servers/ebd7be2f-44d6-4f75-b112-0d6af4731f65" status: 200 len: 1397 microversion: 2.1 time: 0.630808 Oct 22 21:05:33.155400 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1666/3384] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:05:32 2022] GET /compute/v2.1/servers/ebd7be2f-44d6-4f75-b112-0d6af4731f65 => generated 1397 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:05:33.177127 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-fbe2f807-d807-4fa3-8796-6cf1c8b24d03 req-7a5ba4e3-2502-497e-9330-55941f2d5029 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "844f3fc3-ad5d-4dda-b642-ce9c1d417820", "name": "network-vif-plugged", "status": "completed", "tag": "abb44346-87c2-41c9-96f6-3db9abdcf36e"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:05:33.206453 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-fbe2f807-d807-4fa3-8796-6cf1c8b24d03 req-7a5ba4e3-2502-497e-9330-55941f2d5029 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:33.207183 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-fbe2f807-d807-4fa3-8796-6cf1c8b24d03 req-7a5ba4e3-2502-497e-9330-55941f2d5029 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:33.209060 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-fbe2f807-d807-4fa3-8796-6cf1c8b24d03 req-7a5ba4e3-2502-497e-9330-55941f2d5029 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:33.211015 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-2d7adbeb-934a-4d4e-8a81-a0c8ac5f3dd2 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Going to run 1 instances... {{(pid=138745) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 21:05:33.216988 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-2d7adbeb-934a-4d4e-8a81-a0c8ac5f3dd2 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] [instance: 23f77d1a-18db-4152-a25a-d02ac1726b08] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='085e4478-6edc-4a69-8e08-f9831713eb65',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138745) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 21:05:33.230366 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-fbe2f807-d807-4fa3-8796-6cf1c8b24d03 req-7a5ba4e3-2502-497e-9330-55941f2d5029 service nova] Creating event network-vif-plugged:abb44346-87c2-41c9-96f6-3db9abdcf36e for instance 844f3fc3-ad5d-4dda-b642-ce9c1d417820 on nch2-master-1 Oct 22 21:05:33.238475 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-fbe2f807-d807-4fa3-8796-6cf1c8b24d03 req-7a5ba4e3-2502-497e-9330-55941f2d5029 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077314 Oct 22 21:05:33.240193 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1667/3385] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:05:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:05:33.280226 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-40a2697a-4cd2-4329-9416-fa695b656152 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:05:33.288626 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-40a2697a-4cd2-4329-9416-fa695b656152 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] [instance: 3fdb6d35-9428-4253-ad00-932310ecdf5d] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:05:33.312772 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-40a2697a-4cd2-4329-9416-fa695b656152 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:33.313598 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-40a2697a-4cd2-4329-9416-fa695b656152 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:33.317158 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-40a2697a-4cd2-4329-9416-fa695b656152 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:33.318511 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-40a2697a-4cd2-4329-9416-fa695b656152 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:33.319472 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-40a2697a-4cd2-4329-9416-fa695b656152 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:33.322195 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-40a2697a-4cd2-4329-9416-fa695b656152 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:33.376979 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.objects.instance [None req-40a2697a-4cd2-4329-9416-fa695b656152 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lazy-loading 'flavor' on Instance uuid 3fdb6d35-9428-4253-ad00-932310ecdf5d {{(pid=138744) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 21:05:33.421211 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-2d7adbeb-934a-4d4e-8a81-a0c8ac5f3dd2 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.159736 Oct 22 21:05:33.422250 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1719/3386] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Oct 22 21:05:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 3164 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 21:05:33.427204 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-6a6fab1a-4246-4185-991e-55fb4cc4c2b4 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:05:33.428213 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-6a6fab1a-4246-4185-991e-55fb4cc4c2b4 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] [instance: 844f3fc3-ad5d-4dda-b642-ce9c1d417820] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:05:33.457312 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6a6fab1a-4246-4185-991e-55fb4cc4c2b4 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:33.458261 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6a6fab1a-4246-4185-991e-55fb4cc4c2b4 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:33.467248 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6a6fab1a-4246-4185-991e-55fb4cc4c2b4 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:33.470928 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6a6fab1a-4246-4185-991e-55fb4cc4c2b4 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:33.471849 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6a6fab1a-4246-4185-991e-55fb4cc4c2b4 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:33.472526 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6a6fab1a-4246-4185-991e-55fb4cc4c2b4 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:33.586074 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-40a2697a-4cd2-4329-9416-fa695b656152 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] 10.222.0.18 "POST /compute/v2.1/servers/3fdb6d35-9428-4253-ad00-932310ecdf5d/action" status: 200 len: 32 microversion: 2.1 time: 0.342872 Oct 22 21:05:33.599811 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1668/3387] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 21:05:33 2022] POST /compute/v2.1/servers/3fdb6d35-9428-4253-ad00-932310ecdf5d/action => generated 32 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 22 21:05:33.611682 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-c57688bb-53cb-4c4e-9fa1-d611a996072e req-d31b5e3b-1782-4ce0-bb89-871aa31c20b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ebd7be2f-44d6-4f75-b112-0d6af4731f65", "name": "network-vif-deleted", "tag": "6aece53a-c728-48a5-ae9d-a3aacbe74768"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:05:33.673938 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-c57688bb-53cb-4c4e-9fa1-d611a996072e req-d31b5e3b-1782-4ce0-bb89-871aa31c20b5 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:33.674535 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-c57688bb-53cb-4c4e-9fa1-d611a996072e req-d31b5e3b-1782-4ce0-bb89-871aa31c20b5 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:33.675270 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-c57688bb-53cb-4c4e-9fa1-d611a996072e req-d31b5e3b-1782-4ce0-bb89-871aa31c20b5 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:33.710610 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-c57688bb-53cb-4c4e-9fa1-d611a996072e req-d31b5e3b-1782-4ce0-bb89-871aa31c20b5 service nova] Creating event network-vif-deleted:6aece53a-c728-48a5-ae9d-a3aacbe74768 for instance ebd7be2f-44d6-4f75-b112-0d6af4731f65 on nch2-master-1 Oct 22 21:05:33.721811 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-c57688bb-53cb-4c4e-9fa1-d611a996072e req-d31b5e3b-1782-4ce0-bb89-871aa31c20b5 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118516 Oct 22 21:05:33.726026 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1669/3388] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:05:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:05:33.735284 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-b7e8579b-afb5-4190-97ab-e92529ef8671 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:05:33.736818 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-b7e8579b-afb5-4190-97ab-e92529ef8671 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] [instance: 23f77d1a-18db-4152-a25a-d02ac1726b08] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:05:33.860581 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-6a6fab1a-4246-4185-991e-55fb4cc4c2b4 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a44ff8e7c14b94b1670f030085c43d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a26a2284f4424cbeaf63d504652546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:05:33.872432 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-b7e8579b-afb5-4190-97ab-e92529ef8671 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1b410a64e0415a96d30f5040361137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd7873d6db4e09bc9ab9a048a6b1ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:05:33.873711 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-6a6fab1a-4246-4185-991e-55fb4cc4c2b4 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] 10.222.0.18 "GET /compute/v2.1/servers/844f3fc3-ad5d-4dda-b642-ce9c1d417820" status: 200 len: 1308 microversion: 2.1 time: 0.450354 Oct 22 21:05:33.874323 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1720/3389] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:05:33 2022] GET /compute/v2.1/servers/844f3fc3-ad5d-4dda-b642-ce9c1d417820 => generated 1308 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:05:33.886847 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-b7e8579b-afb5-4190-97ab-e92529ef8671 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] 10.222.0.18 "GET /compute/v2.1/servers/23f77d1a-18db-4152-a25a-d02ac1726b08" status: 200 len: 1215 microversion: 2.1 time: 0.158902 Oct 22 21:05:33.889992 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1670/3390] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:05:33 2022] GET /compute/v2.1/servers/23f77d1a-18db-4152-a25a-d02ac1726b08 => generated 1215 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:05:33.899086 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-675548ef-5b02-4f60-8aae-0ec163d837fb tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:05:33.899750 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-675548ef-5b02-4f60-8aae-0ec163d837fb tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] [instance: 3fdb6d35-9428-4253-ad00-932310ecdf5d] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:05:33.925254 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-675548ef-5b02-4f60-8aae-0ec163d837fb tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:33.925770 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-675548ef-5b02-4f60-8aae-0ec163d837fb tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:33.926210 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-675548ef-5b02-4f60-8aae-0ec163d837fb tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:33.926999 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-675548ef-5b02-4f60-8aae-0ec163d837fb tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:33.931792 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-675548ef-5b02-4f60-8aae-0ec163d837fb tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:33.932336 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-675548ef-5b02-4f60-8aae-0ec163d837fb tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:34.187525 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-349d67f9-3dff-447c-8dfb-241020e1ada5 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:05:34.188612 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-349d67f9-3dff-447c-8dfb-241020e1ada5 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] [instance: ebd7be2f-44d6-4f75-b112-0d6af4731f65] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:05:34.206185 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-349d67f9-3dff-447c-8dfb-241020e1ada5 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:34.206862 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-349d67f9-3dff-447c-8dfb-241020e1ada5 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:34.207384 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-349d67f9-3dff-447c-8dfb-241020e1ada5 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:34.210821 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-349d67f9-3dff-447c-8dfb-241020e1ada5 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:34.212344 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-349d67f9-3dff-447c-8dfb-241020e1ada5 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:34.216815 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-349d67f9-3dff-447c-8dfb-241020e1ada5 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:34.312768 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-349d67f9-3dff-447c-8dfb-241020e1ada5 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:34.313273 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-349d67f9-3dff-447c-8dfb-241020e1ada5 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:34.313734 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-349d67f9-3dff-447c-8dfb-241020e1ada5 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:34.314408 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.objects.instance [None req-349d67f9-3dff-447c-8dfb-241020e1ada5 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lazy-loading 'fault' on Instance uuid ebd7be2f-44d6-4f75-b112-0d6af4731f65 {{(pid=138744) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 21:05:34.371852 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-675548ef-5b02-4f60-8aae-0ec163d837fb tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879c85830a9f42088a4ebdf1e3cfb39b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b54f56cfbc814cccb533c65966f35a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:05:34.384237 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-675548ef-5b02-4f60-8aae-0ec163d837fb tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] 10.222.0.18 "GET /compute/v2.1/servers/3fdb6d35-9428-4253-ad00-932310ecdf5d" status: 200 len: 1504 microversion: 2.1 time: 0.508484 Oct 22 21:05:34.401307 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1721/3391] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:05:33 2022] GET /compute/v2.1/servers/3fdb6d35-9428-4253-ad00-932310ecdf5d => generated 1504 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:05:34.438573 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-349d67f9-3dff-447c-8dfb-241020e1ada5 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3820b31a424c3a9216a6ef91fcb285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a42c3ecf474883ac652fcc8c01c9f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:05:34.454478 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-349d67f9-3dff-447c-8dfb-241020e1ada5 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] 10.222.0.18 "GET /compute/v2.1/servers/ebd7be2f-44d6-4f75-b112-0d6af4731f65" status: 200 len: 1193 microversion: 2.1 time: 0.274774 Oct 22 21:05:34.481063 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1671/3392] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:05:34 2022] GET /compute/v2.1/servers/ebd7be2f-44d6-4f75-b112-0d6af4731f65 => generated 1193 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:05:34.705528 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-2900d833-077c-4982-b330-5e30ed02cb9a tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-845196271", "imageRef": "085e4478-6edc-4a69-8e08-f9831713eb65", "flavorRef": "452", "networks": [{"uuid": "08ab6518-0e32-4b2c-895b-b18714e0cf40"}]}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:05:34.797663 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.network.neutron [None req-2900d833-077c-4982-b330-5e30ed02cb9a tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] validate_networks() for [('08ab6518-0e32-4b2c-895b-b18714e0cf40', None, None, None, None, None)] {{(pid=138745) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 21:05:34.900722 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-4d40630b-8840-4435-9c2a-832bca7b6e7a tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:05:34.901682 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-4d40630b-8840-4435-9c2a-832bca7b6e7a tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] [instance: 844f3fc3-ad5d-4dda-b642-ce9c1d417820] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:05:34.939021 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4d40630b-8840-4435-9c2a-832bca7b6e7a tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:34.943688 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4d40630b-8840-4435-9c2a-832bca7b6e7a tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:34.944489 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4d40630b-8840-4435-9c2a-832bca7b6e7a tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:34.950470 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4d40630b-8840-4435-9c2a-832bca7b6e7a tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:34.952061 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4d40630b-8840-4435-9c2a-832bca7b6e7a tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:34.954284 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4d40630b-8840-4435-9c2a-832bca7b6e7a tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:35.574678 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-4d40630b-8840-4435-9c2a-832bca7b6e7a tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a44ff8e7c14b94b1670f030085c43d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a26a2284f4424cbeaf63d504652546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:05:35.591826 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-4d40630b-8840-4435-9c2a-832bca7b6e7a tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] 10.222.0.18 "GET /compute/v2.1/servers/844f3fc3-ad5d-4dda-b642-ce9c1d417820" status: 200 len: 1308 microversion: 2.1 time: 0.697342 Oct 22 21:05:35.592585 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1672/3393] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:05:34 2022] GET /compute/v2.1/servers/844f3fc3-ad5d-4dda-b642-ce9c1d417820 => generated 1308 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:05:35.615912 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-c565c54a-6f62-43d7-b268-901bbf2d44d1 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:05:35.616890 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-c565c54a-6f62-43d7-b268-901bbf2d44d1 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] [instance: 23f77d1a-18db-4152-a25a-d02ac1726b08] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:05:35.630179 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c565c54a-6f62-43d7-b268-901bbf2d44d1 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:35.630685 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c565c54a-6f62-43d7-b268-901bbf2d44d1 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:35.635839 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c565c54a-6f62-43d7-b268-901bbf2d44d1 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:35.636726 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c565c54a-6f62-43d7-b268-901bbf2d44d1 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:35.637217 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c565c54a-6f62-43d7-b268-901bbf2d44d1 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:35.637664 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c565c54a-6f62-43d7-b268-901bbf2d44d1 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:35.812797 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-c565c54a-6f62-43d7-b268-901bbf2d44d1 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1b410a64e0415a96d30f5040361137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd7873d6db4e09bc9ab9a048a6b1ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:05:35.828975 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-c565c54a-6f62-43d7-b268-901bbf2d44d1 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] 10.222.0.18 "GET /compute/v2.1/servers/23f77d1a-18db-4152-a25a-d02ac1726b08" status: 200 len: 1273 microversion: 2.1 time: 0.234813 Oct 22 21:05:35.829670 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1673/3394] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:05:35 2022] GET /compute/v2.1/servers/23f77d1a-18db-4152-a25a-d02ac1726b08 => generated 1273 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:05:35.835933 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-e42138a7-33ba-4ca1-b081-e8a53e4f26c2 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:05:35.837052 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-e42138a7-33ba-4ca1-b081-e8a53e4f26c2 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] [instance: 3fdb6d35-9428-4253-ad00-932310ecdf5d] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:05:35.843638 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e42138a7-33ba-4ca1-b081-e8a53e4f26c2 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:35.845043 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e42138a7-33ba-4ca1-b081-e8a53e4f26c2 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:35.845759 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e42138a7-33ba-4ca1-b081-e8a53e4f26c2 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:35.847004 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e42138a7-33ba-4ca1-b081-e8a53e4f26c2 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:35.847601 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e42138a7-33ba-4ca1-b081-e8a53e4f26c2 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:35.848289 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e42138a7-33ba-4ca1-b081-e8a53e4f26c2 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:36.742618 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-2900d833-077c-4982-b330-5e30ed02cb9a tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Flavor limits 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 21:05:36.743781 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-2900d833-077c-4982-b330-5e30ed02cb9a tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Image limits 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 21:05:36.745240 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-2900d833-077c-4982-b330-5e30ed02cb9a tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Flavor pref 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 21:05:36.745986 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-2900d833-077c-4982-b330-5e30ed02cb9a tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Image pref 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 21:05:36.746645 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-2900d833-077c-4982-b330-5e30ed02cb9a tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 21:05:36.769732 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2900d833-077c-4982-b330-5e30ed02cb9a tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:36.770882 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2900d833-077c-4982-b330-5e30ed02cb9a tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:36.773291 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2900d833-077c-4982-b330-5e30ed02cb9a tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:36.776524 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2900d833-077c-4982-b330-5e30ed02cb9a tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:36.777921 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2900d833-077c-4982-b330-5e30ed02cb9a tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:36.779113 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2900d833-077c-4982-b330-5e30ed02cb9a tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:36.821034 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-2900d833-077c-4982-b330-5e30ed02cb9a tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Getting quotas for project 21349e14fb39496c9996d5af817b7f73. Resources: {'cores', 'instances', 'ram'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 21:05:36.827152 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-2900d833-077c-4982-b330-5e30ed02cb9a tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Getting quotas for user 7102f7b674934e19b3d4a001b563d0d5 and project 21349e14fb39496c9996d5af817b7f73. Resources: {'cores', 'instances', 'ram'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 21:05:36.841318 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-2900d833-077c-4982-b330-5e30ed02cb9a tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Going to run 1 instances... {{(pid=138745) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 21:05:36.843900 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-2900d833-077c-4982-b330-5e30ed02cb9a tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] [instance: 37978245-38aa-4524-8c69-126c4b180b00] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='085e4478-6edc-4a69-8e08-f9831713eb65',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138745) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 21:05:36.846146 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-e42138a7-33ba-4ca1-b081-e8a53e4f26c2 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879c85830a9f42088a4ebdf1e3cfb39b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b54f56cfbc814cccb533c65966f35a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:05:36.854569 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-e42138a7-33ba-4ca1-b081-e8a53e4f26c2 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] 10.222.0.18 "GET /compute/v2.1/servers/3fdb6d35-9428-4253-ad00-932310ecdf5d" status: 200 len: 1504 microversion: 2.1 time: 1.023380 Oct 22 21:05:36.859812 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1674/3395] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:05:35 2022] GET /compute/v2.1/servers/3fdb6d35-9428-4253-ad00-932310ecdf5d => generated 1504 bytes in 1029 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:05:36.865128 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-1709d05b-d3bf-407d-9ebd-ee67eed55d85 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:05:36.871628 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-1709d05b-d3bf-407d-9ebd-ee67eed55d85 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] [instance: ebd7be2f-44d6-4f75-b112-0d6af4731f65] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:05:36.886896 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1709d05b-d3bf-407d-9ebd-ee67eed55d85 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:36.888492 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1709d05b-d3bf-407d-9ebd-ee67eed55d85 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:36.891232 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1709d05b-d3bf-407d-9ebd-ee67eed55d85 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:36.892193 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1709d05b-d3bf-407d-9ebd-ee67eed55d85 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:36.894067 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1709d05b-d3bf-407d-9ebd-ee67eed55d85 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:36.894712 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1709d05b-d3bf-407d-9ebd-ee67eed55d85 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:36.914116 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-2900d833-077c-4982-b330-5e30ed02cb9a tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.213526 Oct 22 21:05:36.925142 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-1709d05b-d3bf-407d-9ebd-ee67eed55d85 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] HTTP exception thrown: Instance ebd7be2f-44d6-4f75-b112-0d6af4731f65 could not be found. Oct 22 21:05:36.926562 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1722/3396] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Oct 22 21:05:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 2227 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 22 21:05:36.927542 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-1709d05b-d3bf-407d-9ebd-ee67eed55d85 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Request method failure captured: Oct 22 21:05:36.927542 ncdv-master-1 devstack@n-api.service[138744]: request: GET /compute/v2.1/servers/ebd7be2f-44d6-4f75-b112-0d6af4731f65 HTTP/1.1 Oct 22 21:05:36.927542 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 21:05:36.927542 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 21:05:36.927542 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 21:05:36.927542 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 0 Oct 22 21:05:36.927542 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 21:05:36.927542 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 21:05:36.927542 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 21:05:36.927542 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 21:05:36.927542 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVFrcKw86EUEeUngnG9DZUJvE3lmhBNDPmC4isrFt9sa-3M5uM6HCkY-mE9Fr6XyLPpjJ3yZx9ru813oA85o16iJwDuF8Nlz1bpd8p9u41wsyi0Zep7ygHQQJ9tgdQV6IQKIEN7AplmICrhSHFCRaS0cX6FN1kXuVbLH1K6CsNjHq7jM Oct 22 21:05:36.927542 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 21:05:36.927542 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 21:05:36.927542 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 21:05:36.927542 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 21:05:36.927542 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 21:05:36.927542 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 21:05:36.927542 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: 82a42c3ecf474883ac652fcc8c01c9f2 Oct 22 21:05:36.927542 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-TestVolumeBootPattern-1443368191 Oct 22 21:05:36.927542 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 21:05:36.927542 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 21:05:36.927542 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_82a42c3ecf474883ac652fcc8c01c9f2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/82a42c3ecf474883ac652fcc8c01c9f2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/82a42c3ecf474883ac652fcc8c01c9f2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/82a42c3ecf474883ac652fcc8c01c9f2"}]}] Oct 22 21:05:36.927542 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-TestVolumeBootPattern-1443368191 Oct 22 21:05:36.927542 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: 82a42c3ecf474883ac652fcc8c01c9f2 Oct 22 21:05:36.927542 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-TestVolumeBootPattern-1443368191 Oct 22 21:05:36.927542 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-TestVolumeBootPattern-1443368191-project Oct 22 21:05:36.927542 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 21:05:36.927542 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 21:05:36.927542 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: 7e3820b31a424c3a9216a6ef91fcb285 Oct 22 21:05:36.927542 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-TestVolumeBootPattern-1443368191-project Oct 22 21:05:36.927542 ncdv-master-1 devstack@n-api.service[138744]: method: > Oct 22 21:05:36.927542 ncdv-master-1 devstack@n-api.service[138744]: exception: Instance ebd7be2f-44d6-4f75-b112-0d6af4731f65 could not be found. Oct 22 21:05:36.927542 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': 'ebd7be2f-44d6-4f75-b112-0d6af4731f65'} Oct 22 21:05:36.927542 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:05:36.927542 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:05:36.927542 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 21:05:36.927542 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 21:05:36.927542 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 21:05:36.927542 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 21:05:36.927542 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 21:05:36.927542 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 21:05:36.927542 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 21:05:36.927542 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 21:05:36.927542 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ebd7be2f-44d6-4f75-b112-0d6af4731f65 could not be found. Oct 22 21:05:36.927542 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:05:36.927542 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:05:36.927542 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:05:36.927542 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:05:36.927542 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:05:36.927542 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:05:36.927542 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:05:36.927542 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:05:36.927542 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:05:36.927542 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:05:36.927542 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 21:05:36.927542 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 21:05:36.927542 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 21:05:36.927542 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 21:05:36.927542 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 21:05:36.927542 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:05:36.927542 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ebd7be2f-44d6-4f75-b112-0d6af4731f65 could not be found. Oct 22 21:05:36.927542 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:05:36.927542 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:05:36.927542 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:05:36.933085 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:05:36.933085 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:05:36.933085 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:05:36.933085 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:05:36.933085 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:05:36.933085 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ebd7be2f-44d6-4f75-b112-0d6af4731f65 could not be found. Oct 22 21:05:36.933085 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:05:36.933085 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-1709d05b-d3bf-407d-9ebd-ee67eed55d85 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Returning 404 to user: Instance ebd7be2f-44d6-4f75-b112-0d6af4731f65 could not be found. {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:05:36.933085 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-1709d05b-d3bf-407d-9ebd-ee67eed55d85 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] 10.222.0.18 "GET /compute/v2.1/servers/ebd7be2f-44d6-4f75-b112-0d6af4731f65" status: 404 len: 111 microversion: 2.1 time: 0.068280 Oct 22 21:05:36.933085 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1675/3397] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:05:36 2022] GET /compute/v2.1/servers/ebd7be2f-44d6-4f75-b112-0d6af4731f65 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 21:05:36.941036 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-513b79a2-9198-4e36-85bf-d4b97a43ff06 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:05:36.941978 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-513b79a2-9198-4e36-85bf-d4b97a43ff06 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] [instance: 23f77d1a-18db-4152-a25a-d02ac1726b08] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:05:36.949366 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-513b79a2-9198-4e36-85bf-d4b97a43ff06 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:36.950191 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-513b79a2-9198-4e36-85bf-d4b97a43ff06 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:36.950828 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-513b79a2-9198-4e36-85bf-d4b97a43ff06 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:36.952021 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-513b79a2-9198-4e36-85bf-d4b97a43ff06 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:36.952640 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-513b79a2-9198-4e36-85bf-d4b97a43ff06 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:36.953220 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-513b79a2-9198-4e36-85bf-d4b97a43ff06 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:36.961957 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-de748774-3d09-4fe7-90e6-ec4729b4136a tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:05:36.965295 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-de748774-3d09-4fe7-90e6-ec4729b4136a tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] [instance: 844f3fc3-ad5d-4dda-b642-ce9c1d417820] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:05:36.986786 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-de748774-3d09-4fe7-90e6-ec4729b4136a tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:36.989333 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-de748774-3d09-4fe7-90e6-ec4729b4136a tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:36.989797 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-de748774-3d09-4fe7-90e6-ec4729b4136a tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:36.992722 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-de748774-3d09-4fe7-90e6-ec4729b4136a tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:36.993323 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-de748774-3d09-4fe7-90e6-ec4729b4136a tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:36.993650 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-de748774-3d09-4fe7-90e6-ec4729b4136a tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:37.206629 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-513b79a2-9198-4e36-85bf-d4b97a43ff06 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1b410a64e0415a96d30f5040361137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd7873d6db4e09bc9ab9a048a6b1ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:05:37.214738 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-513b79a2-9198-4e36-85bf-d4b97a43ff06 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] 10.222.0.18 "GET /compute/v2.1/servers/23f77d1a-18db-4152-a25a-d02ac1726b08" status: 200 len: 1273 microversion: 2.1 time: 0.278014 Oct 22 21:05:37.230658 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1676/3398] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:05:36 2022] GET /compute/v2.1/servers/23f77d1a-18db-4152-a25a-d02ac1726b08 => generated 1273 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:05:37.235866 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-d2770e4b-ac42-4fbc-989e-a8951e104a89 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:05:37.236744 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-d2770e4b-ac42-4fbc-989e-a8951e104a89 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] [instance: 37978245-38aa-4524-8c69-126c4b180b00] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:05:37.359998 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-d2770e4b-ac42-4fbc-989e-a8951e104a89 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7102f7b674934e19b3d4a001b563d0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21349e14fb39496c9996d5af817b7f73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:05:37.369504 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-d2770e4b-ac42-4fbc-989e-a8951e104a89 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] 10.222.0.18 "GET /compute/v2.1/servers/37978245-38aa-4524-8c69-126c4b180b00" status: 200 len: 1218 microversion: 2.1 time: 0.137617 Oct 22 21:05:37.370101 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1677/3399] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:05:37 2022] GET /compute/v2.1/servers/37978245-38aa-4524-8c69-126c4b180b00 => generated 1218 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:05:37.388111 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-d1f83df3-1f6c-46ce-917f-bff72fde004e tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:05:37.389115 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-d1f83df3-1f6c-46ce-917f-bff72fde004e tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] [instance: ebd7be2f-44d6-4f75-b112-0d6af4731f65] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:05:37.408691 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d1f83df3-1f6c-46ce-917f-bff72fde004e tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:37.409198 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d1f83df3-1f6c-46ce-917f-bff72fde004e tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:37.411446 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d1f83df3-1f6c-46ce-917f-bff72fde004e tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:37.413690 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d1f83df3-1f6c-46ce-917f-bff72fde004e tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:37.414182 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d1f83df3-1f6c-46ce-917f-bff72fde004e tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:37.415677 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d1f83df3-1f6c-46ce-917f-bff72fde004e tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:37.422261 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-de748774-3d09-4fe7-90e6-ec4729b4136a tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a44ff8e7c14b94b1670f030085c43d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a26a2284f4424cbeaf63d504652546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:05:37.435061 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-de748774-3d09-4fe7-90e6-ec4729b4136a tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] 10.222.0.18 "GET /compute/v2.1/servers/844f3fc3-ad5d-4dda-b642-ce9c1d417820" status: 200 len: 1488 microversion: 2.1 time: 0.507037 Oct 22 21:05:37.435663 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1723/3400] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:05:36 2022] GET /compute/v2.1/servers/844f3fc3-ad5d-4dda-b642-ce9c1d417820 => generated 1488 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:05:37.439557 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-d1f83df3-1f6c-46ce-917f-bff72fde004e tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] HTTP exception thrown: Instance ebd7be2f-44d6-4f75-b112-0d6af4731f65 could not be found. Oct 22 21:05:37.441554 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-d1f83df3-1f6c-46ce-917f-bff72fde004e tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Request method failure captured: Oct 22 21:05:37.441554 ncdv-master-1 devstack@n-api.service[138744]: request: DELETE /compute/v2.1/servers/ebd7be2f-44d6-4f75-b112-0d6af4731f65 HTTP/1.1 Oct 22 21:05:37.441554 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 21:05:37.441554 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 21:05:37.441554 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 21:05:37.441554 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 0 Oct 22 21:05:37.441554 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 21:05:37.441554 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 21:05:37.441554 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 21:05:37.441554 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 21:05:37.441554 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVFrcKw86EUEeUngnG9DZUJvE3lmhBNDPmC4isrFt9sa-3M5uM6HCkY-mE9Fr6XyLPpjJ3yZx9ru813oA85o16iJwDuF8Nlz1bpd8p9u41wsyi0Zep7ygHQQJ9tgdQV6IQKIEN7AplmICrhSHFCRaS0cX6FN1kXuVbLH1K6CsNjHq7jM Oct 22 21:05:37.441554 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 21:05:37.441554 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 21:05:37.441554 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 21:05:37.441554 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 21:05:37.441554 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 21:05:37.441554 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 21:05:37.441554 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: 82a42c3ecf474883ac652fcc8c01c9f2 Oct 22 21:05:37.441554 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-TestVolumeBootPattern-1443368191 Oct 22 21:05:37.441554 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 21:05:37.441554 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 21:05:37.441554 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_82a42c3ecf474883ac652fcc8c01c9f2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/82a42c3ecf474883ac652fcc8c01c9f2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/82a42c3ecf474883ac652fcc8c01c9f2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/82a42c3ecf474883ac652fcc8c01c9f2"}]}] Oct 22 21:05:37.441554 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-TestVolumeBootPattern-1443368191 Oct 22 21:05:37.441554 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: 82a42c3ecf474883ac652fcc8c01c9f2 Oct 22 21:05:37.441554 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-TestVolumeBootPattern-1443368191 Oct 22 21:05:37.441554 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-TestVolumeBootPattern-1443368191-project Oct 22 21:05:37.441554 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 21:05:37.441554 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 21:05:37.441554 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: 7e3820b31a424c3a9216a6ef91fcb285 Oct 22 21:05:37.441554 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-TestVolumeBootPattern-1443368191-project Oct 22 21:05:37.441554 ncdv-master-1 devstack@n-api.service[138744]: method: > Oct 22 21:05:37.441554 ncdv-master-1 devstack@n-api.service[138744]: exception: Instance ebd7be2f-44d6-4f75-b112-0d6af4731f65 could not be found. Oct 22 21:05:37.441554 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': 'ebd7be2f-44d6-4f75-b112-0d6af4731f65'} Oct 22 21:05:37.441554 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:05:37.441554 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:05:37.441554 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 21:05:37.441554 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 21:05:37.441554 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 21:05:37.441554 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 21:05:37.441554 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 21:05:37.441554 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 21:05:37.441554 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 21:05:37.441554 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 21:05:37.441554 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ebd7be2f-44d6-4f75-b112-0d6af4731f65 could not be found. Oct 22 21:05:37.441554 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:05:37.441554 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:05:37.441554 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:05:37.441554 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:05:37.441554 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:05:37.441554 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:05:37.441554 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:05:37.441554 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:05:37.441554 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:05:37.441554 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:05:37.441554 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 22 21:05:37.441554 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 22 21:05:37.441554 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 22 21:05:37.441554 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 22 21:05:37.441554 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 21:05:37.441554 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 21:05:37.441554 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 21:05:37.441554 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:05:37.446831 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ebd7be2f-44d6-4f75-b112-0d6af4731f65 could not be found. Oct 22 21:05:37.446831 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:05:37.446831 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:05:37.446831 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:05:37.446831 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:05:37.446831 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:05:37.446831 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:05:37.446831 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:05:37.446831 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:05:37.446831 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ebd7be2f-44d6-4f75-b112-0d6af4731f65 could not be found. Oct 22 21:05:37.446831 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:05:37.449448 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-d1f83df3-1f6c-46ce-917f-bff72fde004e tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Returning 404 to user: Instance ebd7be2f-44d6-4f75-b112-0d6af4731f65 could not be found. {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:05:37.450659 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-d1f83df3-1f6c-46ce-917f-bff72fde004e tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] 10.222.0.18 "DELETE /compute/v2.1/servers/ebd7be2f-44d6-4f75-b112-0d6af4731f65" status: 404 len: 111 microversion: 2.1 time: 0.079481 Oct 22 21:05:37.454886 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1678/3401] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 21:05:37 2022] DELETE /compute/v2.1/servers/ebd7be2f-44d6-4f75-b112-0d6af4731f65 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 21:05:37.462714 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-b55a122f-49bd-482c-98f3-a1c9a78132b6 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:05:37.468255 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-b55a122f-49bd-482c-98f3-a1c9a78132b6 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] [instance: ebd7be2f-44d6-4f75-b112-0d6af4731f65] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:05:37.478609 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b55a122f-49bd-482c-98f3-a1c9a78132b6 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:37.479553 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b55a122f-49bd-482c-98f3-a1c9a78132b6 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:37.480174 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b55a122f-49bd-482c-98f3-a1c9a78132b6 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:37.481219 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b55a122f-49bd-482c-98f3-a1c9a78132b6 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:37.481851 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b55a122f-49bd-482c-98f3-a1c9a78132b6 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:37.482450 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b55a122f-49bd-482c-98f3-a1c9a78132b6 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:37.499708 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-b55a122f-49bd-482c-98f3-a1c9a78132b6 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] HTTP exception thrown: Instance ebd7be2f-44d6-4f75-b112-0d6af4731f65 could not be found. Oct 22 21:05:37.501761 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-b55a122f-49bd-482c-98f3-a1c9a78132b6 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Request method failure captured: Oct 22 21:05:37.501761 ncdv-master-1 devstack@n-api.service[138744]: request: GET /compute/v2.1/servers/ebd7be2f-44d6-4f75-b112-0d6af4731f65 HTTP/1.1 Oct 22 21:05:37.501761 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 21:05:37.501761 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 21:05:37.501761 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 21:05:37.501761 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 0 Oct 22 21:05:37.501761 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 21:05:37.501761 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 21:05:37.501761 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 21:05:37.501761 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 21:05:37.501761 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVFrcKw86EUEeUngnG9DZUJvE3lmhBNDPmC4isrFt9sa-3M5uM6HCkY-mE9Fr6XyLPpjJ3yZx9ru813oA85o16iJwDuF8Nlz1bpd8p9u41wsyi0Zep7ygHQQJ9tgdQV6IQKIEN7AplmICrhSHFCRaS0cX6FN1kXuVbLH1K6CsNjHq7jM Oct 22 21:05:37.501761 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 21:05:37.501761 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 21:05:37.501761 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 21:05:37.501761 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 21:05:37.501761 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 21:05:37.501761 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 21:05:37.501761 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: 82a42c3ecf474883ac652fcc8c01c9f2 Oct 22 21:05:37.501761 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-TestVolumeBootPattern-1443368191 Oct 22 21:05:37.501761 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 21:05:37.501761 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 21:05:37.501761 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_82a42c3ecf474883ac652fcc8c01c9f2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/82a42c3ecf474883ac652fcc8c01c9f2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/82a42c3ecf474883ac652fcc8c01c9f2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/82a42c3ecf474883ac652fcc8c01c9f2"}]}] Oct 22 21:05:37.501761 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-TestVolumeBootPattern-1443368191 Oct 22 21:05:37.501761 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: 82a42c3ecf474883ac652fcc8c01c9f2 Oct 22 21:05:37.501761 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-TestVolumeBootPattern-1443368191 Oct 22 21:05:37.501761 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-TestVolumeBootPattern-1443368191-project Oct 22 21:05:37.501761 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 21:05:37.501761 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 21:05:37.501761 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: 7e3820b31a424c3a9216a6ef91fcb285 Oct 22 21:05:37.501761 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-TestVolumeBootPattern-1443368191-project Oct 22 21:05:37.501761 ncdv-master-1 devstack@n-api.service[138744]: method: > Oct 22 21:05:37.501761 ncdv-master-1 devstack@n-api.service[138744]: exception: Instance ebd7be2f-44d6-4f75-b112-0d6af4731f65 could not be found. Oct 22 21:05:37.501761 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': 'ebd7be2f-44d6-4f75-b112-0d6af4731f65'} Oct 22 21:05:37.501761 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:05:37.501761 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:05:37.501761 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 21:05:37.501761 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 21:05:37.501761 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 21:05:37.501761 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 21:05:37.501761 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 21:05:37.501761 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 21:05:37.501761 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 21:05:37.501761 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 21:05:37.501761 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ebd7be2f-44d6-4f75-b112-0d6af4731f65 could not be found. Oct 22 21:05:37.501761 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:05:37.501761 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:05:37.501761 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:05:37.501761 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:05:37.501761 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:05:37.501761 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:05:37.501761 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:05:37.501761 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:05:37.501761 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:05:37.501761 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:05:37.501761 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 21:05:37.501761 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 21:05:37.501761 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 21:05:37.501761 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 21:05:37.501761 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 21:05:37.501761 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:05:37.501761 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ebd7be2f-44d6-4f75-b112-0d6af4731f65 could not be found. Oct 22 21:05:37.501761 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:05:37.501761 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:05:37.501761 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:05:37.507147 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:05:37.507147 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:05:37.507147 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:05:37.507147 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:05:37.507147 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:05:37.507147 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ebd7be2f-44d6-4f75-b112-0d6af4731f65 could not be found. Oct 22 21:05:37.507147 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:05:37.508592 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-b55a122f-49bd-482c-98f3-a1c9a78132b6 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Returning 404 to user: Instance ebd7be2f-44d6-4f75-b112-0d6af4731f65 could not be found. {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:05:37.509884 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-b55a122f-49bd-482c-98f3-a1c9a78132b6 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] 10.222.0.18 "GET /compute/v2.1/servers/ebd7be2f-44d6-4f75-b112-0d6af4731f65" status: 404 len: 111 microversion: 2.1 time: 0.053651 Oct 22 21:05:37.514935 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1679/3402] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:05:37 2022] GET /compute/v2.1/servers/ebd7be2f-44d6-4f75-b112-0d6af4731f65 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 21:05:37.521368 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-6251410d-70cc-4e1f-9c0e-f806d0209c28 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:05:37.522654 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-6251410d-70cc-4e1f-9c0e-f806d0209c28 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] [instance: 844f3fc3-ad5d-4dda-b642-ce9c1d417820] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:05:37.531405 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6251410d-70cc-4e1f-9c0e-f806d0209c28 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:37.532258 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6251410d-70cc-4e1f-9c0e-f806d0209c28 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:37.532899 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6251410d-70cc-4e1f-9c0e-f806d0209c28 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:37.533943 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6251410d-70cc-4e1f-9c0e-f806d0209c28 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:37.539122 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6251410d-70cc-4e1f-9c0e-f806d0209c28 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:37.544997 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6251410d-70cc-4e1f-9c0e-f806d0209c28 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:37.580362 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-6251410d-70cc-4e1f-9c0e-f806d0209c28 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] [instance: 844f3fc3-ad5d-4dda-b642-ce9c1d417820] Going to try to terminate instance {{(pid=138744) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 21:05:37.716943 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-6251410d-70cc-4e1f-9c0e-f806d0209c28 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] 10.222.0.18 "DELETE /compute/v2.1/servers/844f3fc3-ad5d-4dda-b642-ce9c1d417820" status: 204 len: 0 microversion: 2.1 time: 0.199968 Oct 22 21:05:37.717993 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1680/3403] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 21:05:37 2022] DELETE /compute/v2.1/servers/844f3fc3-ad5d-4dda-b642-ce9c1d417820 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 21:05:37.733006 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-57d86825-ddd2-408f-b128-c45605f8b651 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:05:37.736527 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-57d86825-ddd2-408f-b128-c45605f8b651 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] [instance: 844f3fc3-ad5d-4dda-b642-ce9c1d417820] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:05:37.749022 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:05:37.754057 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-57d86825-ddd2-408f-b128-c45605f8b651 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:37.754732 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-57d86825-ddd2-408f-b128-c45605f8b651 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:37.766519 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-57d86825-ddd2-408f-b128-c45605f8b651 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:37.769359 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-57d86825-ddd2-408f-b128-c45605f8b651 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:37.769769 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-57d86825-ddd2-408f-b128-c45605f8b651 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:37.770228 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-57d86825-ddd2-408f-b128-c45605f8b651 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:37.846752 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:05:37.857874 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-8e848c42-98a8-4db8-9066-057860c8d21d tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerTagsTestJSON-server-1267999176", "imageRef": "085e4478-6edc-4a69-8e08-f9831713eb65", "flavorRef": "452", "networks": [{"uuid": "5336de6d-f93a-49cf-8752-bc38a803ad9e"}]}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:05:37.955610 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.network.neutron [None req-8e848c42-98a8-4db8-9066-057860c8d21d tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] validate_networks() for [('5336de6d-f93a-49cf-8752-bc38a803ad9e', None, None, None, None, None)] {{(pid=138745) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 21:05:38.408494 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-57d86825-ddd2-408f-b128-c45605f8b651 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a44ff8e7c14b94b1670f030085c43d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a26a2284f4424cbeaf63d504652546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:05:38.424207 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-57d86825-ddd2-408f-b128-c45605f8b651 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] 10.222.0.18 "GET /compute/v2.1/servers/844f3fc3-ad5d-4dda-b642-ce9c1d417820" status: 200 len: 1494 microversion: 2.1 time: 0.701444 Oct 22 21:05:38.424805 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1681/3404] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:05:37 2022] GET /compute/v2.1/servers/844f3fc3-ad5d-4dda-b642-ce9c1d417820 => generated 1494 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:05:38.453145 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-9aa23aa4-0fbe-44d3-9f7c-d820372f2b22 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:05:38.453781 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-9aa23aa4-0fbe-44d3-9f7c-d820372f2b22 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] [instance: 3fdb6d35-9428-4253-ad00-932310ecdf5d] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:05:38.482425 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9aa23aa4-0fbe-44d3-9f7c-d820372f2b22 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:38.483286 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9aa23aa4-0fbe-44d3-9f7c-d820372f2b22 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:38.483981 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9aa23aa4-0fbe-44d3-9f7c-d820372f2b22 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:38.485691 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9aa23aa4-0fbe-44d3-9f7c-d820372f2b22 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:38.486460 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9aa23aa4-0fbe-44d3-9f7c-d820372f2b22 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:38.487452 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9aa23aa4-0fbe-44d3-9f7c-d820372f2b22 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:39.273632 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-9aa23aa4-0fbe-44d3-9f7c-d820372f2b22 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879c85830a9f42088a4ebdf1e3cfb39b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b54f56cfbc814cccb533c65966f35a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:05:39.288556 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-9aa23aa4-0fbe-44d3-9f7c-d820372f2b22 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] 10.222.0.18 "GET /compute/v2.1/servers/3fdb6d35-9428-4253-ad00-932310ecdf5d" status: 200 len: 1504 microversion: 2.1 time: 0.851791 Oct 22 21:05:39.289449 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1682/3405] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:05:38 2022] GET /compute/v2.1/servers/3fdb6d35-9428-4253-ad00-932310ecdf5d => generated 1504 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:05:39.296606 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-d54cc8d6-fb84-4221-9290-6648f0e781b1 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:05:39.297568 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-d54cc8d6-fb84-4221-9290-6648f0e781b1 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] [instance: 23f77d1a-18db-4152-a25a-d02ac1726b08] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:05:39.304622 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d54cc8d6-fb84-4221-9290-6648f0e781b1 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:39.305394 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d54cc8d6-fb84-4221-9290-6648f0e781b1 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:39.306155 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d54cc8d6-fb84-4221-9290-6648f0e781b1 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:39.307088 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d54cc8d6-fb84-4221-9290-6648f0e781b1 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:39.307759 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d54cc8d6-fb84-4221-9290-6648f0e781b1 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:39.308514 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d54cc8d6-fb84-4221-9290-6648f0e781b1 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:39.404198 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-8e848c42-98a8-4db8-9066-057860c8d21d tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Flavor limits 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 21:05:39.405181 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-8e848c42-98a8-4db8-9066-057860c8d21d tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Image limits 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 21:05:39.405720 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-8e848c42-98a8-4db8-9066-057860c8d21d tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Flavor pref 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 21:05:39.406150 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-8e848c42-98a8-4db8-9066-057860c8d21d tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Image pref 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 21:05:39.406550 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-8e848c42-98a8-4db8-9066-057860c8d21d tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 21:05:39.422573 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8e848c42-98a8-4db8-9066-057860c8d21d tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:39.423240 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8e848c42-98a8-4db8-9066-057860c8d21d tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:39.424235 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8e848c42-98a8-4db8-9066-057860c8d21d tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:39.425188 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8e848c42-98a8-4db8-9066-057860c8d21d tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:39.425852 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8e848c42-98a8-4db8-9066-057860c8d21d tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:39.426632 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8e848c42-98a8-4db8-9066-057860c8d21d tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:39.459503 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-8e848c42-98a8-4db8-9066-057860c8d21d tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Getting quotas for project 6cac03b202c142deb478e3328397d402. Resources: {'cores', 'instances', 'ram'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 21:05:39.468223 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-8e848c42-98a8-4db8-9066-057860c8d21d tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Getting quotas for user 90ed2d6013024c278551a2c9cd961f44 and project 6cac03b202c142deb478e3328397d402. Resources: {'cores', 'instances', 'ram'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 21:05:39.486737 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-8e848c42-98a8-4db8-9066-057860c8d21d tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Going to run 1 instances... {{(pid=138745) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 21:05:39.492121 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-8e848c42-98a8-4db8-9066-057860c8d21d tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] [instance: 6b3e8fcb-7327-45f4-815d-c7b43ed4db97] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='085e4478-6edc-4a69-8e08-f9831713eb65',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138745) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 21:05:39.595499 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-8e848c42-98a8-4db8-9066-057860c8d21d tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.26 time: 2.139668 Oct 22 21:05:39.599984 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1724/3406] 10.222.0.18 () {62 vars in 1188 bytes} [Sat Oct 22 21:05:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 2164 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 22 21:05:39.610966 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-09e5125b-7590-4d5e-a6d1-9202ac7dae10 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:05:39.611628 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-09e5125b-7590-4d5e-a6d1-9202ac7dae10 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] [instance: 37978245-38aa-4524-8c69-126c4b180b00] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:05:39.621723 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-09e5125b-7590-4d5e-a6d1-9202ac7dae10 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:39.622234 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-09e5125b-7590-4d5e-a6d1-9202ac7dae10 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:39.622682 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-09e5125b-7590-4d5e-a6d1-9202ac7dae10 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:39.623424 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-09e5125b-7590-4d5e-a6d1-9202ac7dae10 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:39.623890 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-09e5125b-7590-4d5e-a6d1-9202ac7dae10 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:39.624326 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-09e5125b-7590-4d5e-a6d1-9202ac7dae10 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:40.044904 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-09e5125b-7590-4d5e-a6d1-9202ac7dae10 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7102f7b674934e19b3d4a001b563d0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21349e14fb39496c9996d5af817b7f73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:05:40.059702 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-09e5125b-7590-4d5e-a6d1-9202ac7dae10 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] 10.222.0.18 "GET /compute/v2.1/servers/37978245-38aa-4524-8c69-126c4b180b00" status: 200 len: 1270 microversion: 2.1 time: 0.456609 Oct 22 21:05:40.060962 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1725/3407] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:05:39 2022] GET /compute/v2.1/servers/37978245-38aa-4524-8c69-126c4b180b00 => generated 1270 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:05:40.068654 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-ef9c4178-9f8a-45f3-aff5-cc5a3f54cda9 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:05:40.070879 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-ef9c4178-9f8a-45f3-aff5-cc5a3f54cda9 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] [instance: 844f3fc3-ad5d-4dda-b642-ce9c1d417820] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:05:40.081922 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ef9c4178-9f8a-45f3-aff5-cc5a3f54cda9 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:40.088661 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ef9c4178-9f8a-45f3-aff5-cc5a3f54cda9 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:40.089439 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ef9c4178-9f8a-45f3-aff5-cc5a3f54cda9 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:40.090350 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ef9c4178-9f8a-45f3-aff5-cc5a3f54cda9 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:40.091579 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ef9c4178-9f8a-45f3-aff5-cc5a3f54cda9 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:40.092163 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ef9c4178-9f8a-45f3-aff5-cc5a3f54cda9 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:40.812020 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-d54cc8d6-fb84-4221-9290-6648f0e781b1 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1b410a64e0415a96d30f5040361137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd7873d6db4e09bc9ab9a048a6b1ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:05:40.838736 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-d54cc8d6-fb84-4221-9290-6648f0e781b1 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] 10.222.0.18 "GET /compute/v2.1/servers/23f77d1a-18db-4152-a25a-d02ac1726b08" status: 200 len: 1315 microversion: 2.1 time: 1.547848 Oct 22 21:05:40.844314 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1683/3408] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:05:39 2022] GET /compute/v2.1/servers/23f77d1a-18db-4152-a25a-d02ac1726b08 => generated 1315 bytes in 1554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:05:40.858257 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-78885eed-5e09-430a-b872-063a10fee963 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:05:40.859094 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-78885eed-5e09-430a-b872-063a10fee963 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] [instance: 6b3e8fcb-7327-45f4-815d-c7b43ed4db97] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:05:40.878190 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-78885eed-5e09-430a-b872-063a10fee963 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:40.879546 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-78885eed-5e09-430a-b872-063a10fee963 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:40.888163 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-78885eed-5e09-430a-b872-063a10fee963 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:40.891468 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-78885eed-5e09-430a-b872-063a10fee963 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:40.894013 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-78885eed-5e09-430a-b872-063a10fee963 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:40.894659 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-78885eed-5e09-430a-b872-063a10fee963 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:40.993086 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell0:SELECT=2 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:05:41.204214 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-78885eed-5e09-430a-b872-063a10fee963 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90ed2d6013024c278551a2c9cd961f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac03b202c142deb478e3328397d402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:05:41.223470 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-78885eed-5e09-430a-b872-063a10fee963 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90ed2d6013024c278551a2c9cd961f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac03b202c142deb478e3328397d402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:05:41.226348 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-78885eed-5e09-430a-b872-063a10fee963 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90ed2d6013024c278551a2c9cd961f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac03b202c142deb478e3328397d402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:05:41.227602 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-78885eed-5e09-430a-b872-063a10fee963 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] 10.222.0.18 "GET /compute/v2.1/servers/6b3e8fcb-7327-45f4-815d-c7b43ed4db97" status: 200 len: 1314 microversion: 2.26 time: 0.381941 Oct 22 21:05:41.228602 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1684/3409] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:05:40 2022] GET /compute/v2.1/servers/6b3e8fcb-7327-45f4-815d-c7b43ed4db97 => generated 1314 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:05:41.234527 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-8d7e4b4d-9008-4441-91c6-8f77981f73b7 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:05:41.235332 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-8d7e4b4d-9008-4441-91c6-8f77981f73b7 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] [instance: 3fdb6d35-9428-4253-ad00-932310ecdf5d] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:05:41.243068 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8d7e4b4d-9008-4441-91c6-8f77981f73b7 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:41.243860 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8d7e4b4d-9008-4441-91c6-8f77981f73b7 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:41.244453 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8d7e4b4d-9008-4441-91c6-8f77981f73b7 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:41.245161 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8d7e4b4d-9008-4441-91c6-8f77981f73b7 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:41.245748 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8d7e4b4d-9008-4441-91c6-8f77981f73b7 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:41.246310 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8d7e4b4d-9008-4441-91c6-8f77981f73b7 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:42.075030 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-ef9c4178-9f8a-45f3-aff5-cc5a3f54cda9 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a44ff8e7c14b94b1670f030085c43d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a26a2284f4424cbeaf63d504652546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:05:42.086485 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-ef9c4178-9f8a-45f3-aff5-cc5a3f54cda9 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] 10.222.0.18 "GET /compute/v2.1/servers/844f3fc3-ad5d-4dda-b642-ce9c1d417820" status: 200 len: 1494 microversion: 2.1 time: 2.021564 Oct 22 21:05:42.088148 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1726/3410] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:05:40 2022] GET /compute/v2.1/servers/844f3fc3-ad5d-4dda-b642-ce9c1d417820 => generated 1494 bytes in 2026 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:05:42.106556 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-cc02a8b6-b708-48b8-a388-99e36cc34b66 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:05:42.107179 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-cc02a8b6-b708-48b8-a388-99e36cc34b66 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] [instance: 37978245-38aa-4524-8c69-126c4b180b00] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:05:42.119163 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cc02a8b6-b708-48b8-a388-99e36cc34b66 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:42.119713 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cc02a8b6-b708-48b8-a388-99e36cc34b66 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:42.120159 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cc02a8b6-b708-48b8-a388-99e36cc34b66 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:42.122747 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cc02a8b6-b708-48b8-a388-99e36cc34b66 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:42.123228 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cc02a8b6-b708-48b8-a388-99e36cc34b66 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:42.123702 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cc02a8b6-b708-48b8-a388-99e36cc34b66 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:42.268102 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-cc02a8b6-b708-48b8-a388-99e36cc34b66 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7102f7b674934e19b3d4a001b563d0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21349e14fb39496c9996d5af817b7f73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:05:42.280215 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-cc02a8b6-b708-48b8-a388-99e36cc34b66 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] 10.222.0.18 "GET /compute/v2.1/servers/37978245-38aa-4524-8c69-126c4b180b00" status: 200 len: 1276 microversion: 2.1 time: 0.190007 Oct 22 21:05:42.280852 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1727/3411] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:05:42 2022] GET /compute/v2.1/servers/37978245-38aa-4524-8c69-126c4b180b00 => generated 1276 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:05:42.312688 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-a06fb5ae-fa90-48c7-837b-ff3c35491eac tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:05:42.321880 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-a06fb5ae-fa90-48c7-837b-ff3c35491eac tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] [instance: 23f77d1a-18db-4152-a25a-d02ac1726b08] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:05:42.340136 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a06fb5ae-fa90-48c7-837b-ff3c35491eac tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:42.341288 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a06fb5ae-fa90-48c7-837b-ff3c35491eac tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:42.341932 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a06fb5ae-fa90-48c7-837b-ff3c35491eac tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:42.356797 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a06fb5ae-fa90-48c7-837b-ff3c35491eac tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:42.357813 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a06fb5ae-fa90-48c7-837b-ff3c35491eac tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:42.358655 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a06fb5ae-fa90-48c7-837b-ff3c35491eac tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:42.491056 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-8d7e4b4d-9008-4441-91c6-8f77981f73b7 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879c85830a9f42088a4ebdf1e3cfb39b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b54f56cfbc814cccb533c65966f35a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:05:42.509118 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-8d7e4b4d-9008-4441-91c6-8f77981f73b7 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] 10.222.0.18 "GET /compute/v2.1/servers/3fdb6d35-9428-4253-ad00-932310ecdf5d" status: 200 len: 1504 microversion: 2.1 time: 1.279251 Oct 22 21:05:42.512780 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1685/3412] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:05:41 2022] GET /compute/v2.1/servers/3fdb6d35-9428-4253-ad00-932310ecdf5d => generated 1504 bytes in 1284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:05:42.530001 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-91f302a1-77e0-4878-b872-37c1a99f06e0 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:05:42.531226 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-91f302a1-77e0-4878-b872-37c1a99f06e0 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] [instance: 6b3e8fcb-7327-45f4-815d-c7b43ed4db97] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:05:42.539542 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-91f302a1-77e0-4878-b872-37c1a99f06e0 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:42.540122 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-91f302a1-77e0-4878-b872-37c1a99f06e0 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:42.542675 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-91f302a1-77e0-4878-b872-37c1a99f06e0 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:42.544894 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-91f302a1-77e0-4878-b872-37c1a99f06e0 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:42.547063 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-91f302a1-77e0-4878-b872-37c1a99f06e0 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:42.547625 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-91f302a1-77e0-4878-b872-37c1a99f06e0 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:42.728304 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-91f302a1-77e0-4878-b872-37c1a99f06e0 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90ed2d6013024c278551a2c9cd961f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac03b202c142deb478e3328397d402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:05:42.737569 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-91f302a1-77e0-4878-b872-37c1a99f06e0 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90ed2d6013024c278551a2c9cd961f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac03b202c142deb478e3328397d402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:05:42.738953 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-91f302a1-77e0-4878-b872-37c1a99f06e0 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90ed2d6013024c278551a2c9cd961f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac03b202c142deb478e3328397d402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:05:42.747497 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-91f302a1-77e0-4878-b872-37c1a99f06e0 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] 10.222.0.18 "GET /compute/v2.1/servers/6b3e8fcb-7327-45f4-815d-c7b43ed4db97" status: 200 len: 1320 microversion: 2.26 time: 0.232934 Oct 22 21:05:42.751421 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1686/3413] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:05:42 2022] GET /compute/v2.1/servers/6b3e8fcb-7327-45f4-815d-c7b43ed4db97 => generated 1320 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:05:43.114383 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-20b3024e-55c4-43c0-9d76-53b91be7ab98 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:05:43.115455 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-20b3024e-55c4-43c0-9d76-53b91be7ab98 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] [instance: 844f3fc3-ad5d-4dda-b642-ce9c1d417820] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:05:43.120353 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-a06fb5ae-fa90-48c7-837b-ff3c35491eac tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1b410a64e0415a96d30f5040361137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd7873d6db4e09bc9ab9a048a6b1ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:05:43.125576 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-20b3024e-55c4-43c0-9d76-53b91be7ab98 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:43.126072 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-20b3024e-55c4-43c0-9d76-53b91be7ab98 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:43.126518 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-20b3024e-55c4-43c0-9d76-53b91be7ab98 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:43.127240 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-20b3024e-55c4-43c0-9d76-53b91be7ab98 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:43.127738 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-20b3024e-55c4-43c0-9d76-53b91be7ab98 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:43.128171 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-20b3024e-55c4-43c0-9d76-53b91be7ab98 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:43.139499 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-a06fb5ae-fa90-48c7-837b-ff3c35491eac tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] 10.222.0.18 "GET /compute/v2.1/servers/23f77d1a-18db-4152-a25a-d02ac1726b08" status: 200 len: 1315 microversion: 2.1 time: 0.834953 Oct 22 21:05:43.142458 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1728/3414] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:05:42 2022] GET /compute/v2.1/servers/23f77d1a-18db-4152-a25a-d02ac1726b08 => generated 1315 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:05:43.312243 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-caa56e9c-89f4-4fa1-abfa-800f0bacfcb4 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:05:43.313977 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-caa56e9c-89f4-4fa1-abfa-800f0bacfcb4 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] [instance: 37978245-38aa-4524-8c69-126c4b180b00] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:05:43.332611 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-caa56e9c-89f4-4fa1-abfa-800f0bacfcb4 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:43.334852 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-caa56e9c-89f4-4fa1-abfa-800f0bacfcb4 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:43.335595 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-caa56e9c-89f4-4fa1-abfa-800f0bacfcb4 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:43.344937 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-caa56e9c-89f4-4fa1-abfa-800f0bacfcb4 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:43.346824 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-caa56e9c-89f4-4fa1-abfa-800f0bacfcb4 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:43.348014 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-caa56e9c-89f4-4fa1-abfa-800f0bacfcb4 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:43.458300 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-20b3024e-55c4-43c0-9d76-53b91be7ab98 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a44ff8e7c14b94b1670f030085c43d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a26a2284f4424cbeaf63d504652546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:05:43.478598 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-20b3024e-55c4-43c0-9d76-53b91be7ab98 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] 10.222.0.18 "GET /compute/v2.1/servers/844f3fc3-ad5d-4dda-b642-ce9c1d417820" status: 200 len: 1452 microversion: 2.1 time: 0.368062 Oct 22 21:05:43.494939 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1687/3415] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:05:43 2022] GET /compute/v2.1/servers/844f3fc3-ad5d-4dda-b642-ce9c1d417820 => generated 1452 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:05:43.534824 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-876478a1-77cc-4792-a445-ee27cfe00e71 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:05:43.540375 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-876478a1-77cc-4792-a445-ee27cfe00e71 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] [instance: 3fdb6d35-9428-4253-ad00-932310ecdf5d] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:05:43.565561 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-876478a1-77cc-4792-a445-ee27cfe00e71 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:43.566060 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-876478a1-77cc-4792-a445-ee27cfe00e71 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:43.566506 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-876478a1-77cc-4792-a445-ee27cfe00e71 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:43.567537 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-876478a1-77cc-4792-a445-ee27cfe00e71 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:43.568025 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-876478a1-77cc-4792-a445-ee27cfe00e71 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:43.572815 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-876478a1-77cc-4792-a445-ee27cfe00e71 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:43.635758 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-caa56e9c-89f4-4fa1-abfa-800f0bacfcb4 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7102f7b674934e19b3d4a001b563d0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21349e14fb39496c9996d5af817b7f73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:05:43.677865 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-caa56e9c-89f4-4fa1-abfa-800f0bacfcb4 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] 10.222.0.18 "GET /compute/v2.1/servers/37978245-38aa-4524-8c69-126c4b180b00" status: 200 len: 1276 microversion: 2.1 time: 0.364516 Oct 22 21:05:43.681454 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1729/3416] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:05:43 2022] GET /compute/v2.1/servers/37978245-38aa-4524-8c69-126c4b180b00 => generated 1276 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:05:43.695731 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-31bb8606-148c-4f27-b907-6a826c0d3699 req-0067b5e8-a3fa-490c-ad2c-0dd04da6b349 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "844f3fc3-ad5d-4dda-b642-ce9c1d417820", "name": "network-vif-deleted", "tag": "abb44346-87c2-41c9-96f6-3db9abdcf36e"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:05:43.712347 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-31bb8606-148c-4f27-b907-6a826c0d3699 req-0067b5e8-a3fa-490c-ad2c-0dd04da6b349 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:43.713793 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-31bb8606-148c-4f27-b907-6a826c0d3699 req-0067b5e8-a3fa-490c-ad2c-0dd04da6b349 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:43.715309 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-31bb8606-148c-4f27-b907-6a826c0d3699 req-0067b5e8-a3fa-490c-ad2c-0dd04da6b349 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:43.748812 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-31bb8606-148c-4f27-b907-6a826c0d3699 req-0067b5e8-a3fa-490c-ad2c-0dd04da6b349 service nova] Creating event network-vif-deleted:abb44346-87c2-41c9-96f6-3db9abdcf36e for instance 844f3fc3-ad5d-4dda-b642-ce9c1d417820 on nch2-master-1 Oct 22 21:05:43.774453 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-31bb8606-148c-4f27-b907-6a826c0d3699 req-0067b5e8-a3fa-490c-ad2c-0dd04da6b349 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088543 Oct 22 21:05:43.776415 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1730/3417] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:05:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:05:43.793078 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-537a382b-05ed-4582-a43f-d17f7fd410ef tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:05:43.800616 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-537a382b-05ed-4582-a43f-d17f7fd410ef tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] [instance: 6b3e8fcb-7327-45f4-815d-c7b43ed4db97] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:05:43.827586 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-537a382b-05ed-4582-a43f-d17f7fd410ef tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:43.829609 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-537a382b-05ed-4582-a43f-d17f7fd410ef tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:43.830080 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-537a382b-05ed-4582-a43f-d17f7fd410ef tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:43.835401 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-537a382b-05ed-4582-a43f-d17f7fd410ef tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:43.836019 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-537a382b-05ed-4582-a43f-d17f7fd410ef tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:43.836480 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-537a382b-05ed-4582-a43f-d17f7fd410ef tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:44.152553 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-537a382b-05ed-4582-a43f-d17f7fd410ef tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90ed2d6013024c278551a2c9cd961f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac03b202c142deb478e3328397d402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:05:44.176168 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-537a382b-05ed-4582-a43f-d17f7fd410ef tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90ed2d6013024c278551a2c9cd961f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac03b202c142deb478e3328397d402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:05:44.178544 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-537a382b-05ed-4582-a43f-d17f7fd410ef tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90ed2d6013024c278551a2c9cd961f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac03b202c142deb478e3328397d402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:05:44.184441 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-537a382b-05ed-4582-a43f-d17f7fd410ef tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] 10.222.0.18 "GET /compute/v2.1/servers/6b3e8fcb-7327-45f4-815d-c7b43ed4db97" status: 200 len: 1320 microversion: 2.26 time: 0.402605 Oct 22 21:05:44.185828 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1731/3418] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:05:43 2022] GET /compute/v2.1/servers/6b3e8fcb-7327-45f4-815d-c7b43ed4db97 => generated 1320 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:05:44.199315 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-9cd3b6c1-1da9-40bc-9df9-a64b1ea3b4c7 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:05:44.200302 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-9cd3b6c1-1da9-40bc-9df9-a64b1ea3b4c7 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] [instance: 23f77d1a-18db-4152-a25a-d02ac1726b08] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:05:44.225944 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9cd3b6c1-1da9-40bc-9df9-a64b1ea3b4c7 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:44.227047 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9cd3b6c1-1da9-40bc-9df9-a64b1ea3b4c7 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:44.228272 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9cd3b6c1-1da9-40bc-9df9-a64b1ea3b4c7 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:44.229549 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9cd3b6c1-1da9-40bc-9df9-a64b1ea3b4c7 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:44.230043 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9cd3b6c1-1da9-40bc-9df9-a64b1ea3b4c7 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:44.232941 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9cd3b6c1-1da9-40bc-9df9-a64b1ea3b4c7 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:44.258328 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell1:SELECT=100 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:05:45.392901 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-876478a1-77cc-4792-a445-ee27cfe00e71 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879c85830a9f42088a4ebdf1e3cfb39b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b54f56cfbc814cccb533c65966f35a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:05:45.421077 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-876478a1-77cc-4792-a445-ee27cfe00e71 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] 10.222.0.18 "GET /compute/v2.1/servers/3fdb6d35-9428-4253-ad00-932310ecdf5d" status: 200 len: 1504 microversion: 2.1 time: 1.890618 Oct 22 21:05:45.423176 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1688/3419] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:05:43 2022] GET /compute/v2.1/servers/3fdb6d35-9428-4253-ad00-932310ecdf5d => generated 1504 bytes in 1893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:05:45.430079 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-9257b5fe-bf2a-43ec-adde-58879507d5dd tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-758730919", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "12b295a8-421c-425d-b63f-f8315c51d5e6", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "7fc34993-7108-4fcb-8386-9f829c6044b7"}]}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:05:45.553907 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.network.neutron [None req-9257b5fe-bf2a-43ec-adde-58879507d5dd tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] validate_networks() for [('7fc34993-7108-4fcb-8386-9f829c6044b7', None, None, None, None, None)] {{(pid=138744) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 21:05:46.389717 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-9cd3b6c1-1da9-40bc-9df9-a64b1ea3b4c7 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1b410a64e0415a96d30f5040361137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd7873d6db4e09bc9ab9a048a6b1ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:05:46.399472 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-9cd3b6c1-1da9-40bc-9df9-a64b1ea3b4c7 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] 10.222.0.18 "GET /compute/v2.1/servers/23f77d1a-18db-4152-a25a-d02ac1726b08" status: 200 len: 1315 microversion: 2.1 time: 2.212275 Oct 22 21:05:46.400062 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1732/3420] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:05:44 2022] GET /compute/v2.1/servers/23f77d1a-18db-4152-a25a-d02ac1726b08 => generated 1315 bytes in 2214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:05:46.405790 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-e343b4d6-b634-4a73-8644-40c987d0f419 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:05:46.406405 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-e343b4d6-b634-4a73-8644-40c987d0f419 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] [instance: 844f3fc3-ad5d-4dda-b642-ce9c1d417820] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:05:46.413520 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e343b4d6-b634-4a73-8644-40c987d0f419 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:46.414257 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e343b4d6-b634-4a73-8644-40c987d0f419 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:46.414699 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e343b4d6-b634-4a73-8644-40c987d0f419 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:46.415587 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e343b4d6-b634-4a73-8644-40c987d0f419 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:46.416182 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e343b4d6-b634-4a73-8644-40c987d0f419 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:46.416753 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e343b4d6-b634-4a73-8644-40c987d0f419 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:46.433549 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.wsgi [None req-e343b4d6-b634-4a73-8644-40c987d0f419 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] HTTP exception thrown: Instance 844f3fc3-ad5d-4dda-b642-ce9c1d417820 could not be found. Oct 22 21:05:46.435230 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-e343b4d6-b634-4a73-8644-40c987d0f419 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Request method failure captured: Oct 22 21:05:46.435230 ncdv-master-1 devstack@n-api.service[138745]: request: GET /compute/v2.1/servers/844f3fc3-ad5d-4dda-b642-ce9c1d417820 HTTP/1.1 Oct 22 21:05:46.435230 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 21:05:46.435230 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 21:05:46.435230 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 21:05:46.435230 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 0 Oct 22 21:05:46.435230 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 21:05:46.435230 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 21:05:46.435230 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 21:05:46.435230 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 21:05:46.435230 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVFng3hwvwMj6qrKBKP-NtPsacHNJudvI6PbLTlDqKVlCNAf4Mqq0nvy7Chi-hCExXK3RI9ZbTr7OISCYx9SEUXfBLJqVoAZKtsaVbmoggH2NuFL9WL2K0RSTEHzGZGsrQHqgFF8j5Iii8ybpULxjQ0-J_wT0C7d5Pfa14Sa-3-zfpKo Oct 22 21:05:46.435230 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 21:05:46.435230 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 21:05:46.435230 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 21:05:46.435230 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 21:05:46.435230 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 21:05:46.435230 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 21:05:46.435230 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: 66a26a2284f4424cbeaf63d504652546 Oct 22 21:05:46.435230 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-ImagesTestJSON-2101376766 Oct 22 21:05:46.435230 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 21:05:46.435230 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 21:05:46.435230 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_66a26a2284f4424cbeaf63d504652546"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/66a26a2284f4424cbeaf63d504652546"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/66a26a2284f4424cbeaf63d504652546"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/66a26a2284f4424cbeaf63d504652546"}]}] Oct 22 21:05:46.435230 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-ImagesTestJSON-2101376766 Oct 22 21:05:46.435230 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: 66a26a2284f4424cbeaf63d504652546 Oct 22 21:05:46.435230 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-ImagesTestJSON-2101376766 Oct 22 21:05:46.435230 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-ImagesTestJSON-2101376766-project Oct 22 21:05:46.435230 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 21:05:46.435230 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 21:05:46.435230 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: f0a44ff8e7c14b94b1670f030085c43d Oct 22 21:05:46.435230 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-ImagesTestJSON-2101376766-project Oct 22 21:05:46.435230 ncdv-master-1 devstack@n-api.service[138745]: method: > Oct 22 21:05:46.435230 ncdv-master-1 devstack@n-api.service[138745]: exception: Instance 844f3fc3-ad5d-4dda-b642-ce9c1d417820 could not be found. Oct 22 21:05:46.435230 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'id': '844f3fc3-ad5d-4dda-b642-ce9c1d417820'} Oct 22 21:05:46.435230 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:05:46.435230 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:05:46.435230 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 21:05:46.435230 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 21:05:46.435230 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 21:05:46.435230 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 21:05:46.435230 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 21:05:46.435230 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 21:05:46.435230 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 21:05:46.435230 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 21:05:46.435230 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 844f3fc3-ad5d-4dda-b642-ce9c1d417820 could not be found. Oct 22 21:05:46.435230 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:05:46.435230 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:05:46.435230 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:05:46.435230 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:05:46.435230 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:05:46.435230 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:05:46.435230 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:05:46.435230 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:05:46.435230 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:05:46.435230 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:05:46.435230 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 21:05:46.435230 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 21:05:46.435230 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 21:05:46.435230 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 21:05:46.435230 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 21:05:46.435230 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:05:46.435230 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 844f3fc3-ad5d-4dda-b642-ce9c1d417820 could not be found. Oct 22 21:05:46.435230 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:05:46.435230 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:05:46.435230 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:05:46.435230 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:05:46.438434 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:05:46.438434 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:05:46.438434 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:05:46.438434 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:05:46.438434 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 844f3fc3-ad5d-4dda-b642-ce9c1d417820 could not be found. Oct 22 21:05:46.438434 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:05:46.438434 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-e343b4d6-b634-4a73-8644-40c987d0f419 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Returning 404 to user: Instance 844f3fc3-ad5d-4dda-b642-ce9c1d417820 could not be found. {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:05:46.438434 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-e343b4d6-b634-4a73-8644-40c987d0f419 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] 10.222.0.18 "GET /compute/v2.1/servers/844f3fc3-ad5d-4dda-b642-ce9c1d417820" status: 404 len: 111 microversion: 2.1 time: 0.035676 Oct 22 21:05:46.438434 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1733/3421] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:05:46 2022] GET /compute/v2.1/servers/844f3fc3-ad5d-4dda-b642-ce9c1d417820 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 21:05:46.445074 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-c59dead9-f4d7-41d5-8ac4-ab61bec5d5ed tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:05:46.445950 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-c59dead9-f4d7-41d5-8ac4-ab61bec5d5ed tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] [instance: 37978245-38aa-4524-8c69-126c4b180b00] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:05:46.453645 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c59dead9-f4d7-41d5-8ac4-ab61bec5d5ed tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:46.455052 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c59dead9-f4d7-41d5-8ac4-ab61bec5d5ed tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:46.456194 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c59dead9-f4d7-41d5-8ac4-ab61bec5d5ed tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:46.457181 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c59dead9-f4d7-41d5-8ac4-ab61bec5d5ed tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:46.458436 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c59dead9-f4d7-41d5-8ac4-ab61bec5d5ed tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:46.459075 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c59dead9-f4d7-41d5-8ac4-ab61bec5d5ed tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:47.015883 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-c59dead9-f4d7-41d5-8ac4-ab61bec5d5ed tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7102f7b674934e19b3d4a001b563d0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21349e14fb39496c9996d5af817b7f73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:05:47.026012 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-c59dead9-f4d7-41d5-8ac4-ab61bec5d5ed tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] 10.222.0.18 "GET /compute/v2.1/servers/37978245-38aa-4524-8c69-126c4b180b00" status: 200 len: 1318 microversion: 2.1 time: 0.587533 Oct 22 21:05:47.026787 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1734/3422] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:05:46 2022] GET /compute/v2.1/servers/37978245-38aa-4524-8c69-126c4b180b00 => generated 1318 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:05:47.043596 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-af0bc7b0-62d2-4397-8980-cd148725c8e5 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:05:47.044493 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-af0bc7b0-62d2-4397-8980-cd148725c8e5 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] [instance: 6b3e8fcb-7327-45f4-815d-c7b43ed4db97] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:05:47.059001 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-af0bc7b0-62d2-4397-8980-cd148725c8e5 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:47.059809 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-af0bc7b0-62d2-4397-8980-cd148725c8e5 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:47.060401 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-af0bc7b0-62d2-4397-8980-cd148725c8e5 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:47.061270 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-af0bc7b0-62d2-4397-8980-cd148725c8e5 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:47.061879 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-af0bc7b0-62d2-4397-8980-cd148725c8e5 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:47.062461 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-af0bc7b0-62d2-4397-8980-cd148725c8e5 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:47.365243 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell0:SELECT=6 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:05:47.709724 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-af0bc7b0-62d2-4397-8980-cd148725c8e5 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90ed2d6013024c278551a2c9cd961f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac03b202c142deb478e3328397d402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:05:47.720301 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-af0bc7b0-62d2-4397-8980-cd148725c8e5 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90ed2d6013024c278551a2c9cd961f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac03b202c142deb478e3328397d402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:05:47.722743 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-af0bc7b0-62d2-4397-8980-cd148725c8e5 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90ed2d6013024c278551a2c9cd961f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac03b202c142deb478e3328397d402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:05:47.730253 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-af0bc7b0-62d2-4397-8980-cd148725c8e5 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] 10.222.0.18 "GET /compute/v2.1/servers/6b3e8fcb-7327-45f4-815d-c7b43ed4db97" status: 200 len: 1362 microversion: 2.26 time: 0.701439 Oct 22 21:05:47.730764 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-9257b5fe-bf2a-43ec-adde-58879507d5dd tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Flavor limits 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 21:05:47.731687 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1735/3423] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:05:47 2022] GET /compute/v2.1/servers/6b3e8fcb-7327-45f4-815d-c7b43ed4db97 => generated 1362 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:05:47.732114 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-9257b5fe-bf2a-43ec-adde-58879507d5dd tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Image limits 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 21:05:47.732975 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-9257b5fe-bf2a-43ec-adde-58879507d5dd tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Flavor pref 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 21:05:47.733444 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-9257b5fe-bf2a-43ec-adde-58879507d5dd tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Image pref 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 21:05:47.733832 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-9257b5fe-bf2a-43ec-adde-58879507d5dd tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 21:05:47.748157 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9257b5fe-bf2a-43ec-adde-58879507d5dd tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:47.748829 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9257b5fe-bf2a-43ec-adde-58879507d5dd tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:47.749677 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9257b5fe-bf2a-43ec-adde-58879507d5dd tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:47.750677 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9257b5fe-bf2a-43ec-adde-58879507d5dd tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:47.751308 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9257b5fe-bf2a-43ec-adde-58879507d5dd tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:47.751900 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9257b5fe-bf2a-43ec-adde-58879507d5dd tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:47.791689 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-9257b5fe-bf2a-43ec-adde-58879507d5dd tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Getting quotas for project 82a42c3ecf474883ac652fcc8c01c9f2. Resources: {'cores', 'instances', 'ram'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 21:05:47.798609 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-9257b5fe-bf2a-43ec-adde-58879507d5dd tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Getting quotas for user 7e3820b31a424c3a9216a6ef91fcb285 and project 82a42c3ecf474883ac652fcc8c01c9f2. Resources: {'cores', 'instances', 'ram'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 21:05:47.800381 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-61cbce9b-c58c-4864-9e02-bee914a0ce3a tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1980301694", "imageRef": "085e4478-6edc-4a69-8e08-f9831713eb65", "flavorRef": "452", "networks": [{"uuid": "6186ef52-c98a-4139-af26-395c1bdf67cf"}]}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:05:47.875211 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.network.neutron [None req-61cbce9b-c58c-4864-9e02-bee914a0ce3a tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] validate_networks() for [('6186ef52-c98a-4139-af26-395c1bdf67cf', None, None, None, None, None)] {{(pid=138745) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 21:05:47.884547 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-9257b5fe-bf2a-43ec-adde-58879507d5dd tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Going to run 1 instances... {{(pid=138744) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 21:05:47.886704 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-9257b5fe-bf2a-43ec-adde-58879507d5dd tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] [instance: 079f3144-b2dd-45f2-a22d-11cd315a31ed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='12b295a8-421c-425d-b63f-f8315c51d5e6',volume_size=None,volume_type=None)] {{(pid=138744) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 21:05:48.038062 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-9257b5fe-bf2a-43ec-adde-58879507d5dd tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.613467 Oct 22 21:05:48.038725 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1689/3424] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Oct 22 21:05:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 2615 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 21:05:48.043501 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-eb902405-b65d-4291-a2ab-a0b1247b79fc req-9378fd6a-8dde-48de-bc33-2728eda1bc57 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "23f77d1a-18db-4152-a25a-d02ac1726b08", "tag": "28fa3d1c-0002-432e-b75f-b946acccd7de"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:05:48.055582 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-eb902405-b65d-4291-a2ab-a0b1247b79fc req-9378fd6a-8dde-48de-bc33-2728eda1bc57 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:48.056108 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-eb902405-b65d-4291-a2ab-a0b1247b79fc req-9378fd6a-8dde-48de-bc33-2728eda1bc57 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:48.056558 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-eb902405-b65d-4291-a2ab-a0b1247b79fc req-9378fd6a-8dde-48de-bc33-2728eda1bc57 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:48.070213 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-eb902405-b65d-4291-a2ab-a0b1247b79fc req-9378fd6a-8dde-48de-bc33-2728eda1bc57 service nova] Creating event network-changed:28fa3d1c-0002-432e-b75f-b946acccd7de for instance 23f77d1a-18db-4152-a25a-d02ac1726b08 on nch1-master-1 Oct 22 21:05:48.077435 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-eb902405-b65d-4291-a2ab-a0b1247b79fc req-9378fd6a-8dde-48de-bc33-2728eda1bc57 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036845 Oct 22 21:05:48.078063 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1690/3425] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:05:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:05:48.083478 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-224f8652-46d8-41a3-9624-275e13bed714 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Calling method '.version_select at 0x7fd39ef5cdc0>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:05:49.144554 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-61cbce9b-c58c-4864-9e02-bee914a0ce3a tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Flavor limits 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 21:05:49.145027 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-61cbce9b-c58c-4864-9e02-bee914a0ce3a tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Image limits 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 21:05:49.145482 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-61cbce9b-c58c-4864-9e02-bee914a0ce3a tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Flavor pref 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 21:05:49.146257 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-61cbce9b-c58c-4864-9e02-bee914a0ce3a tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Image pref 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 21:05:49.146731 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-61cbce9b-c58c-4864-9e02-bee914a0ce3a tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 21:05:49.170069 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-61cbce9b-c58c-4864-9e02-bee914a0ce3a tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:49.174254 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-61cbce9b-c58c-4864-9e02-bee914a0ce3a tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:49.174945 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-61cbce9b-c58c-4864-9e02-bee914a0ce3a tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:49.177288 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-61cbce9b-c58c-4864-9e02-bee914a0ce3a tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:49.182742 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-61cbce9b-c58c-4864-9e02-bee914a0ce3a tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:49.183812 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-61cbce9b-c58c-4864-9e02-bee914a0ce3a tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:49.266140 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-61cbce9b-c58c-4864-9e02-bee914a0ce3a tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Getting quotas for project 48c774a85b2c41c98486cf91b1253363. Resources: {'cores', 'instances', 'ram'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 21:05:49.288218 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-61cbce9b-c58c-4864-9e02-bee914a0ce3a tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Getting quotas for user bcdfeb6c1cda4810b9fa70fdfd9a66c8 and project 48c774a85b2c41c98486cf91b1253363. Resources: {'cores', 'instances', 'ram'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 21:05:49.290953 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-224f8652-46d8-41a3-9624-275e13bed714 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] 10.222.0.18 "DELETE /compute/v2.1/images/fefdb332-d8c8-4dbc-8b2b-6d54994dca11" status: 204 len: 0 microversion: 2.1 time: 1.211268 Oct 22 21:05:49.294775 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1691/3426] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:05:48 2022] DELETE /compute/v2.1/images/fefdb332-d8c8-4dbc-8b2b-6d54994dca11 => generated 0 bytes in 1213 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 21:05:49.297984 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-45d98a73-0364-44b4-8e10-3016ca3e4258 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:05:49.298745 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-45d98a73-0364-44b4-8e10-3016ca3e4258 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] [instance: 3fdb6d35-9428-4253-ad00-932310ecdf5d] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:05:49.325046 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:05:49.326720 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-45d98a73-0364-44b4-8e10-3016ca3e4258 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:49.327838 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-45d98a73-0364-44b4-8e10-3016ca3e4258 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:49.329276 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-61cbce9b-c58c-4864-9e02-bee914a0ce3a tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Going to run 1 instances... {{(pid=138745) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 21:05:49.330613 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-45d98a73-0364-44b4-8e10-3016ca3e4258 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:49.332535 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-61cbce9b-c58c-4864-9e02-bee914a0ce3a tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] [instance: e09b7865-0b24-4e50-a66a-342dd2e6e5e3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='085e4478-6edc-4a69-8e08-f9831713eb65',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138745) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 21:05:49.336283 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-45d98a73-0364-44b4-8e10-3016ca3e4258 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:49.336793 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-45d98a73-0364-44b4-8e10-3016ca3e4258 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:49.339352 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-45d98a73-0364-44b4-8e10-3016ca3e4258 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:49.418263 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-61cbce9b-c58c-4864-9e02-bee914a0ce3a tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.684890 Oct 22 21:05:49.419711 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1736/3427] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Oct 22 21:05:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 1687 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 21:05:49.448210 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-7b4e3af0-527f-46f4-bdcf-1781c3b7398b req-4857a42a-4dd4-4930-a127-90feda6fd53b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b3e8fcb-7327-45f4-815d-c7b43ed4db97", "tag": "d3b8f44f-8ce6-4fdb-ae8c-dbc9b73422f1"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:05:49.966454 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-7b4e3af0-527f-46f4-bdcf-1781c3b7398b req-4857a42a-4dd4-4930-a127-90feda6fd53b service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:49.967300 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-7b4e3af0-527f-46f4-bdcf-1781c3b7398b req-4857a42a-4dd4-4930-a127-90feda6fd53b service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:49.967892 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-7b4e3af0-527f-46f4-bdcf-1781c3b7398b req-4857a42a-4dd4-4930-a127-90feda6fd53b service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:49.982617 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-45d98a73-0364-44b4-8e10-3016ca3e4258 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879c85830a9f42088a4ebdf1e3cfb39b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b54f56cfbc814cccb533c65966f35a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:05:50.002881 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-45d98a73-0364-44b4-8e10-3016ca3e4258 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] 10.222.0.18 "GET /compute/v2.1/servers/3fdb6d35-9428-4253-ad00-932310ecdf5d" status: 200 len: 1504 microversion: 2.1 time: 0.709528 Oct 22 21:05:50.025701 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1692/3428] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:05:49 2022] GET /compute/v2.1/servers/3fdb6d35-9428-4253-ad00-932310ecdf5d => generated 1504 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:05:50.030351 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-7b4e3af0-527f-46f4-bdcf-1781c3b7398b req-4857a42a-4dd4-4930-a127-90feda6fd53b service nova] Creating event network-changed:d3b8f44f-8ce6-4fdb-ae8c-dbc9b73422f1 for instance 6b3e8fcb-7327-45f4-815d-c7b43ed4db97 on nch1-master-1 Oct 22 21:05:50.041686 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-482f50c7-27b3-42e1-a2f6-af48c4be0518 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:05:50.046996 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-7b4e3af0-527f-46f4-bdcf-1781c3b7398b req-4857a42a-4dd4-4930-a127-90feda6fd53b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.625844 Oct 22 21:05:50.055872 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1737/3429] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:05:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:05:50.064987 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-482f50c7-27b3-42e1-a2f6-af48c4be0518 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] [instance: 23f77d1a-18db-4152-a25a-d02ac1726b08] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:05:50.075740 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-5447fd56-c164-49b0-b34a-1ffdb0c228c3 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:05:50.076586 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-5447fd56-c164-49b0-b34a-1ffdb0c228c3 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] [instance: 37978245-38aa-4524-8c69-126c4b180b00] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:05:50.094924 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-482f50c7-27b3-42e1-a2f6-af48c4be0518 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:50.095537 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-482f50c7-27b3-42e1-a2f6-af48c4be0518 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:50.095993 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-482f50c7-27b3-42e1-a2f6-af48c4be0518 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:50.096748 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-482f50c7-27b3-42e1-a2f6-af48c4be0518 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:50.097287 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-482f50c7-27b3-42e1-a2f6-af48c4be0518 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:50.097798 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-482f50c7-27b3-42e1-a2f6-af48c4be0518 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:50.106530 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5447fd56-c164-49b0-b34a-1ffdb0c228c3 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:50.107069 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5447fd56-c164-49b0-b34a-1ffdb0c228c3 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:50.109215 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5447fd56-c164-49b0-b34a-1ffdb0c228c3 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:50.112026 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5447fd56-c164-49b0-b34a-1ffdb0c228c3 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:50.112026 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5447fd56-c164-49b0-b34a-1ffdb0c228c3 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:50.112026 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5447fd56-c164-49b0-b34a-1ffdb0c228c3 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:51.035841 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-482f50c7-27b3-42e1-a2f6-af48c4be0518 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1b410a64e0415a96d30f5040361137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd7873d6db4e09bc9ab9a048a6b1ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:05:51.049623 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-482f50c7-27b3-42e1-a2f6-af48c4be0518 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] 10.222.0.18 "GET /compute/v2.1/servers/23f77d1a-18db-4152-a25a-d02ac1726b08" status: 200 len: 1315 microversion: 2.1 time: 1.022583 Oct 22 21:05:51.051051 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1693/3430] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:05:50 2022] GET /compute/v2.1/servers/23f77d1a-18db-4152-a25a-d02ac1726b08 => generated 1315 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:05:51.061921 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-0c8da37a-a598-457f-8288-efbc02c11c9c tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:05:51.065739 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-0c8da37a-a598-457f-8288-efbc02c11c9c tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] [instance: 079f3144-b2dd-45f2-a22d-11cd315a31ed] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:05:51.083128 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0c8da37a-a598-457f-8288-efbc02c11c9c tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:51.084078 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0c8da37a-a598-457f-8288-efbc02c11c9c tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:51.084748 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0c8da37a-a598-457f-8288-efbc02c11c9c tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:51.085675 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0c8da37a-a598-457f-8288-efbc02c11c9c tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:51.086353 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0c8da37a-a598-457f-8288-efbc02c11c9c tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:51.086981 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0c8da37a-a598-457f-8288-efbc02c11c9c tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:51.347881 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-5447fd56-c164-49b0-b34a-1ffdb0c228c3 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7102f7b674934e19b3d4a001b563d0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21349e14fb39496c9996d5af817b7f73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:05:51.357949 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-5447fd56-c164-49b0-b34a-1ffdb0c228c3 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] 10.222.0.18 "GET /compute/v2.1/servers/37978245-38aa-4524-8c69-126c4b180b00" status: 200 len: 1318 microversion: 2.1 time: 1.300630 Oct 22 21:05:51.363326 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1738/3431] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:05:50 2022] GET /compute/v2.1/servers/37978245-38aa-4524-8c69-126c4b180b00 => generated 1318 bytes in 1307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:05:51.383100 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-e1ac0fea-a448-4b8c-a53a-b7bf5732f4a0 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:05:51.383963 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-e1ac0fea-a448-4b8c-a53a-b7bf5732f4a0 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] [instance: 6b3e8fcb-7327-45f4-815d-c7b43ed4db97] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:05:51.397467 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e1ac0fea-a448-4b8c-a53a-b7bf5732f4a0 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:51.402350 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e1ac0fea-a448-4b8c-a53a-b7bf5732f4a0 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:51.403077 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e1ac0fea-a448-4b8c-a53a-b7bf5732f4a0 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:51.404065 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e1ac0fea-a448-4b8c-a53a-b7bf5732f4a0 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:51.404780 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e1ac0fea-a448-4b8c-a53a-b7bf5732f4a0 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:51.405398 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e1ac0fea-a448-4b8c-a53a-b7bf5732f4a0 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:51.459822 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-0c8da37a-a598-457f-8288-efbc02c11c9c tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3820b31a424c3a9216a6ef91fcb285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a42c3ecf474883ac652fcc8c01c9f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:05:51.482371 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-0c8da37a-a598-457f-8288-efbc02c11c9c tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] 10.222.0.18 "GET /compute/v2.1/servers/079f3144-b2dd-45f2-a22d-11cd315a31ed" status: 200 len: 1186 microversion: 2.1 time: 0.428557 Oct 22 21:05:51.484465 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1694/3432] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:05:51 2022] GET /compute/v2.1/servers/079f3144-b2dd-45f2-a22d-11cd315a31ed => generated 1186 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:05:51.506169 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-b723e4ef-0e32-4f3c-92c8-47313baf094d tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:05:51.508397 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-b723e4ef-0e32-4f3c-92c8-47313baf094d tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] [instance: 9bfb71b4-0081-493a-8ed5-1c80169b12d0] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:05:51.538422 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b723e4ef-0e32-4f3c-92c8-47313baf094d tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:51.546121 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b723e4ef-0e32-4f3c-92c8-47313baf094d tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:51.547017 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b723e4ef-0e32-4f3c-92c8-47313baf094d tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:51.548108 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b723e4ef-0e32-4f3c-92c8-47313baf094d tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:51.550413 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b723e4ef-0e32-4f3c-92c8-47313baf094d tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:51.553408 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b723e4ef-0e32-4f3c-92c8-47313baf094d tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:51.675421 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-b723e4ef-0e32-4f3c-92c8-47313baf094d tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] [instance: 9bfb71b4-0081-493a-8ed5-1c80169b12d0] Going to try to terminate instance {{(pid=138744) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 21:05:51.903551 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-b723e4ef-0e32-4f3c-92c8-47313baf094d tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] 10.222.0.18 "DELETE /compute/v2.1/servers/9bfb71b4-0081-493a-8ed5-1c80169b12d0" status: 204 len: 0 microversion: 2.1 time: 0.416460 Oct 22 21:05:51.908064 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1695/3433] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 21:05:51 2022] DELETE /compute/v2.1/servers/9bfb71b4-0081-493a-8ed5-1c80169b12d0 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 21:05:51.924410 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-2b3bff77-25e3-41fb-a0d9-52a86ce1935e tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:05:51.926021 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-2b3bff77-25e3-41fb-a0d9-52a86ce1935e tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] [instance: e09b7865-0b24-4e50-a66a-342dd2e6e5e3] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:05:51.950187 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2b3bff77-25e3-41fb-a0d9-52a86ce1935e tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:51.951059 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2b3bff77-25e3-41fb-a0d9-52a86ce1935e tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:51.951694 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2b3bff77-25e3-41fb-a0d9-52a86ce1935e tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:51.954227 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2b3bff77-25e3-41fb-a0d9-52a86ce1935e tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:51.956735 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2b3bff77-25e3-41fb-a0d9-52a86ce1935e tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:51.957344 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2b3bff77-25e3-41fb-a0d9-52a86ce1935e tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:52.123469 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-e1ac0fea-a448-4b8c-a53a-b7bf5732f4a0 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90ed2d6013024c278551a2c9cd961f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac03b202c142deb478e3328397d402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:05:52.153614 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-e1ac0fea-a448-4b8c-a53a-b7bf5732f4a0 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90ed2d6013024c278551a2c9cd961f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac03b202c142deb478e3328397d402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:05:52.163966 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-e1ac0fea-a448-4b8c-a53a-b7bf5732f4a0 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90ed2d6013024c278551a2c9cd961f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac03b202c142deb478e3328397d402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:05:52.164916 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-2b3bff77-25e3-41fb-a0d9-52a86ce1935e tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcdfeb6c1cda4810b9fa70fdfd9a66c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c774a85b2c41c98486cf91b1253363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:05:52.170069 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-e1ac0fea-a448-4b8c-a53a-b7bf5732f4a0 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] 10.222.0.18 "GET /compute/v2.1/servers/6b3e8fcb-7327-45f4-815d-c7b43ed4db97" status: 200 len: 1362 microversion: 2.26 time: 0.802864 Oct 22 21:05:52.171907 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1739/3434] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:05:51 2022] GET /compute/v2.1/servers/6b3e8fcb-7327-45f4-815d-c7b43ed4db97 => generated 1362 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:05:52.186841 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-325a48f8-99d0-41b6-95ee-fcfe50df6e66 req-3da988a4-2a91-4cb9-b18e-237847c7cbf0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37978245-38aa-4524-8c69-126c4b180b00", "tag": "2d24c6c5-c497-4768-afd7-c2a804f98609"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:05:52.198536 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-2b3bff77-25e3-41fb-a0d9-52a86ce1935e tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] 10.222.0.18 "GET /compute/v2.1/servers/e09b7865-0b24-4e50-a66a-342dd2e6e5e3" status: 200 len: 1278 microversion: 2.1 time: 0.284008 Oct 22 21:05:52.199698 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1696/3435] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:05:51 2022] GET /compute/v2.1/servers/e09b7865-0b24-4e50-a66a-342dd2e6e5e3 => generated 1278 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:05:52.202879 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-325a48f8-99d0-41b6-95ee-fcfe50df6e66 req-3da988a4-2a91-4cb9-b18e-237847c7cbf0 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:52.203842 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-325a48f8-99d0-41b6-95ee-fcfe50df6e66 req-3da988a4-2a91-4cb9-b18e-237847c7cbf0 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:52.204544 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-325a48f8-99d0-41b6-95ee-fcfe50df6e66 req-3da988a4-2a91-4cb9-b18e-237847c7cbf0 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:52.220610 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-325a48f8-99d0-41b6-95ee-fcfe50df6e66 req-3da988a4-2a91-4cb9-b18e-237847c7cbf0 service nova] Creating event network-changed:2d24c6c5-c497-4768-afd7-c2a804f98609 for instance 37978245-38aa-4524-8c69-126c4b180b00 on nch2-master-1 Oct 22 21:05:52.228778 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-325a48f8-99d0-41b6-95ee-fcfe50df6e66 req-3da988a4-2a91-4cb9-b18e-237847c7cbf0 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053468 Oct 22 21:05:52.230911 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1740/3436] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:05:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:05:52.232958 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-a2e60b32-63ea-4f5f-8a70-be20825933f6 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:05:52.233594 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-a2e60b32-63ea-4f5f-8a70-be20825933f6 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] [instance: 3fdb6d35-9428-4253-ad00-932310ecdf5d] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:05:52.238409 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-4eb087c5-53c6-4186-94bd-a08a8e2b9a2e tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:05:52.239901 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-4eb087c5-53c6-4186-94bd-a08a8e2b9a2e tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] [instance: 23f77d1a-18db-4152-a25a-d02ac1726b08] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:05:52.249041 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a2e60b32-63ea-4f5f-8a70-be20825933f6 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:52.249542 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a2e60b32-63ea-4f5f-8a70-be20825933f6 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:52.250807 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4eb087c5-53c6-4186-94bd-a08a8e2b9a2e tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:52.251317 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4eb087c5-53c6-4186-94bd-a08a8e2b9a2e tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:52.251826 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4eb087c5-53c6-4186-94bd-a08a8e2b9a2e tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:52.252546 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4eb087c5-53c6-4186-94bd-a08a8e2b9a2e tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:52.253012 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4eb087c5-53c6-4186-94bd-a08a8e2b9a2e tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:52.253252 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a2e60b32-63ea-4f5f-8a70-be20825933f6 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:52.253644 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4eb087c5-53c6-4186-94bd-a08a8e2b9a2e tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:52.254760 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a2e60b32-63ea-4f5f-8a70-be20825933f6 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:52.256536 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a2e60b32-63ea-4f5f-8a70-be20825933f6 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:52.258267 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a2e60b32-63ea-4f5f-8a70-be20825933f6 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:52.793835 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-a2e60b32-63ea-4f5f-8a70-be20825933f6 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879c85830a9f42088a4ebdf1e3cfb39b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b54f56cfbc814cccb533c65966f35a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:05:52.808110 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-a2e60b32-63ea-4f5f-8a70-be20825933f6 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] 10.222.0.18 "GET /compute/v2.1/servers/3fdb6d35-9428-4253-ad00-932310ecdf5d" status: 200 len: 1504 microversion: 2.1 time: 0.594689 Oct 22 21:05:52.808782 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1697/3437] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:05:52 2022] GET /compute/v2.1/servers/3fdb6d35-9428-4253-ad00-932310ecdf5d => generated 1504 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:05:52.826006 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-ccbbc68b-c2f9-4d8a-b3ca-7591a3ffc4f1 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1901031138", "imageRef": "085e4478-6edc-4a69-8e08-f9831713eb65", "flavorRef": "452", "networks": [{"uuid": "f1ad1f3f-09bf-4698-9fe5-20142c78993a"}]}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:05:52.981961 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.network.neutron [None req-ccbbc68b-c2f9-4d8a-b3ca-7591a3ffc4f1 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] validate_networks() for [('f1ad1f3f-09bf-4698-9fe5-20142c78993a', None, None, None, None, None)] {{(pid=138744) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 21:05:53.013579 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-4eb087c5-53c6-4186-94bd-a08a8e2b9a2e tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1b410a64e0415a96d30f5040361137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd7873d6db4e09bc9ab9a048a6b1ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:05:53.043252 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-4eb087c5-53c6-4186-94bd-a08a8e2b9a2e tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] 10.222.0.18 "GET /compute/v2.1/servers/23f77d1a-18db-4152-a25a-d02ac1726b08" status: 200 len: 1315 microversion: 2.1 time: 0.808388 Oct 22 21:05:53.043919 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1741/3438] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:05:52 2022] GET /compute/v2.1/servers/23f77d1a-18db-4152-a25a-d02ac1726b08 => generated 1315 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:05:53.189467 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-032ef8d6-ee17-4893-9698-bed73ec91541 tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsNegativeTestJSON-server-1735991152", "imageRef": "085e4478-6edc-4a69-8e08-f9831713eb65", "flavorRef": "452", "networks": [{"uuid": "e20ae68c-b2f7-4dc1-b83d-93b58cf759b9"}]}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:05:53.297888 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.network.neutron [None req-032ef8d6-ee17-4893-9698-bed73ec91541 tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] validate_networks() for [('e20ae68c-b2f7-4dc1-b83d-93b58cf759b9', None, None, None, None, None)] {{(pid=138745) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 21:05:55.126627 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-032ef8d6-ee17-4893-9698-bed73ec91541 tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] Flavor limits 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 21:05:55.127767 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-032ef8d6-ee17-4893-9698-bed73ec91541 tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] Image limits 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 21:05:55.128257 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-032ef8d6-ee17-4893-9698-bed73ec91541 tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] Flavor pref 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 21:05:55.128670 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-032ef8d6-ee17-4893-9698-bed73ec91541 tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] Image pref 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 21:05:55.129396 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-032ef8d6-ee17-4893-9698-bed73ec91541 tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 21:05:55.139963 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell0:SELECT=25 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:05:55.148033 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-032ef8d6-ee17-4893-9698-bed73ec91541 tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:55.150158 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-032ef8d6-ee17-4893-9698-bed73ec91541 tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:55.150903 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-032ef8d6-ee17-4893-9698-bed73ec91541 tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:55.152396 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-032ef8d6-ee17-4893-9698-bed73ec91541 tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:55.152883 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-032ef8d6-ee17-4893-9698-bed73ec91541 tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:55.153570 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-032ef8d6-ee17-4893-9698-bed73ec91541 tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:55.172203 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell0:SELECT=9 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:05:55.188727 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-032ef8d6-ee17-4893-9698-bed73ec91541 tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] Getting quotas for project 0af4c5251e7348c0ae5fc62468243a81. Resources: {'cores', 'instances', 'ram'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 21:05:55.195284 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-032ef8d6-ee17-4893-9698-bed73ec91541 tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] Getting quotas for user de9c0914dd6943bfa313ac456524cbba and project 0af4c5251e7348c0ae5fc62468243a81. Resources: {'cores', 'instances', 'ram'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 21:05:55.210159 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-032ef8d6-ee17-4893-9698-bed73ec91541 tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] Going to run 1 instances... {{(pid=138745) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 21:05:55.212590 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-032ef8d6-ee17-4893-9698-bed73ec91541 tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] [instance: e24e9888-adfe-455c-b53e-da3bf5729d69] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='085e4478-6edc-4a69-8e08-f9831713eb65',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138745) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 21:05:55.273532 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-032ef8d6-ee17-4893-9698-bed73ec91541 tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.228441 Oct 22 21:05:55.274773 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1742/3439] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Oct 22 21:05:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 2230 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 21:05:55.282696 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-1314841d-e21a-4c40-ac55-e7a372cf6497 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:05:55.283876 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-1314841d-e21a-4c40-ac55-e7a372cf6497 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] [instance: 37978245-38aa-4524-8c69-126c4b180b00] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:05:55.291011 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1314841d-e21a-4c40-ac55-e7a372cf6497 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:55.291551 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1314841d-e21a-4c40-ac55-e7a372cf6497 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:55.292000 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1314841d-e21a-4c40-ac55-e7a372cf6497 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:55.292721 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1314841d-e21a-4c40-ac55-e7a372cf6497 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:55.293182 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1314841d-e21a-4c40-ac55-e7a372cf6497 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:55.293616 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1314841d-e21a-4c40-ac55-e7a372cf6497 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:55.378422 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-ccbbc68b-c2f9-4d8a-b3ca-7591a3ffc4f1 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Flavor limits 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 21:05:55.379132 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-ccbbc68b-c2f9-4d8a-b3ca-7591a3ffc4f1 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Image limits 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 21:05:55.382024 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-ccbbc68b-c2f9-4d8a-b3ca-7591a3ffc4f1 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Flavor pref 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 21:05:55.382926 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-ccbbc68b-c2f9-4d8a-b3ca-7591a3ffc4f1 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Image pref 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 21:05:55.383660 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-ccbbc68b-c2f9-4d8a-b3ca-7591a3ffc4f1 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 21:05:55.405038 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ccbbc68b-c2f9-4d8a-b3ca-7591a3ffc4f1 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:55.405546 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ccbbc68b-c2f9-4d8a-b3ca-7591a3ffc4f1 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:55.405996 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ccbbc68b-c2f9-4d8a-b3ca-7591a3ffc4f1 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:55.407468 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ccbbc68b-c2f9-4d8a-b3ca-7591a3ffc4f1 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:55.407941 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ccbbc68b-c2f9-4d8a-b3ca-7591a3ffc4f1 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:55.408470 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ccbbc68b-c2f9-4d8a-b3ca-7591a3ffc4f1 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:55.467864 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-ccbbc68b-c2f9-4d8a-b3ca-7591a3ffc4f1 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Getting quotas for project 66a26a2284f4424cbeaf63d504652546. Resources: {'cores', 'instances', 'ram'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 21:05:55.474545 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-ccbbc68b-c2f9-4d8a-b3ca-7591a3ffc4f1 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Getting quotas for user f0a44ff8e7c14b94b1670f030085c43d and project 66a26a2284f4424cbeaf63d504652546. Resources: {'cores', 'instances', 'ram'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 21:05:55.500356 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-ccbbc68b-c2f9-4d8a-b3ca-7591a3ffc4f1 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Going to run 1 instances... {{(pid=138744) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 21:05:55.503320 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-ccbbc68b-c2f9-4d8a-b3ca-7591a3ffc4f1 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] [instance: a26fa9bd-fad2-40a2-910e-2208fb769dcb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='085e4478-6edc-4a69-8e08-f9831713eb65',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138744) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 21:05:55.596989 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-ccbbc68b-c2f9-4d8a-b3ca-7591a3ffc4f1 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.778330 Oct 22 21:05:55.597714 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1698/3440] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Oct 22 21:05:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 2780 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 21:05:55.609361 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-fe924f7d-8d7d-4925-8358-ecac7ef984ba tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:05:55.610351 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-fe924f7d-8d7d-4925-8358-ecac7ef984ba tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] [instance: 079f3144-b2dd-45f2-a22d-11cd315a31ed] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:05:55.617082 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fe924f7d-8d7d-4925-8358-ecac7ef984ba tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:55.618633 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fe924f7d-8d7d-4925-8358-ecac7ef984ba tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:55.619283 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fe924f7d-8d7d-4925-8358-ecac7ef984ba tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:55.620296 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fe924f7d-8d7d-4925-8358-ecac7ef984ba tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:55.620974 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fe924f7d-8d7d-4925-8358-ecac7ef984ba tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:55.621606 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fe924f7d-8d7d-4925-8358-ecac7ef984ba tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:55.652232 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:05:55.798973 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-1314841d-e21a-4c40-ac55-e7a372cf6497 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7102f7b674934e19b3d4a001b563d0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21349e14fb39496c9996d5af817b7f73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:05:55.820560 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-1314841d-e21a-4c40-ac55-e7a372cf6497 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] 10.222.0.18 "GET /compute/v2.1/servers/37978245-38aa-4524-8c69-126c4b180b00" status: 200 len: 1318 microversion: 2.1 time: 0.544411 Oct 22 21:05:55.821180 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1743/3441] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:05:55 2022] GET /compute/v2.1/servers/37978245-38aa-4524-8c69-126c4b180b00 => generated 1318 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:05:55.826803 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-5fda7aff-f210-40ed-93ea-4e45eec6f2d4 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:05:55.827462 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-5fda7aff-f210-40ed-93ea-4e45eec6f2d4 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] [instance: 6b3e8fcb-7327-45f4-815d-c7b43ed4db97] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:05:55.845640 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5fda7aff-f210-40ed-93ea-4e45eec6f2d4 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:55.846631 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5fda7aff-f210-40ed-93ea-4e45eec6f2d4 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:55.847391 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5fda7aff-f210-40ed-93ea-4e45eec6f2d4 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:55.848970 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5fda7aff-f210-40ed-93ea-4e45eec6f2d4 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:55.850165 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5fda7aff-f210-40ed-93ea-4e45eec6f2d4 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:55.851235 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5fda7aff-f210-40ed-93ea-4e45eec6f2d4 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:56.111773 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-fe924f7d-8d7d-4925-8358-ecac7ef984ba tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3820b31a424c3a9216a6ef91fcb285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a42c3ecf474883ac652fcc8c01c9f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:05:56.121957 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-fe924f7d-8d7d-4925-8358-ecac7ef984ba tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] 10.222.0.18 "GET /compute/v2.1/servers/079f3144-b2dd-45f2-a22d-11cd315a31ed" status: 200 len: 1216 microversion: 2.1 time: 0.523032 Oct 22 21:05:56.127532 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1699/3442] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:05:55 2022] GET /compute/v2.1/servers/079f3144-b2dd-45f2-a22d-11cd315a31ed => generated 1216 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:05:56.132792 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-6b069793-6e5c-4546-871c-7eb4208c71b7 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:05:56.140260 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-6b069793-6e5c-4546-871c-7eb4208c71b7 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] [instance: e09b7865-0b24-4e50-a66a-342dd2e6e5e3] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:05:56.159059 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6b069793-6e5c-4546-871c-7eb4208c71b7 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:56.159820 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6b069793-6e5c-4546-871c-7eb4208c71b7 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:56.160267 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6b069793-6e5c-4546-871c-7eb4208c71b7 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:56.161031 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6b069793-6e5c-4546-871c-7eb4208c71b7 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:56.161607 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6b069793-6e5c-4546-871c-7eb4208c71b7 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:56.162025 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6b069793-6e5c-4546-871c-7eb4208c71b7 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:56.345496 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-6b069793-6e5c-4546-871c-7eb4208c71b7 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcdfeb6c1cda4810b9fa70fdfd9a66c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c774a85b2c41c98486cf91b1253363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:05:56.360317 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-6b069793-6e5c-4546-871c-7eb4208c71b7 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] 10.222.0.18 "GET /compute/v2.1/servers/e09b7865-0b24-4e50-a66a-342dd2e6e5e3" status: 200 len: 1276 microversion: 2.1 time: 0.230982 Oct 22 21:05:56.360926 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1700/3443] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:05:56 2022] GET /compute/v2.1/servers/e09b7865-0b24-4e50-a66a-342dd2e6e5e3 => generated 1276 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:05:56.365834 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-2e09bdac-11ec-4019-a370-1d2e55b9f5fb tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:05:56.366446 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-2e09bdac-11ec-4019-a370-1d2e55b9f5fb tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] [instance: 3fdb6d35-9428-4253-ad00-932310ecdf5d] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:05:56.380555 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2e09bdac-11ec-4019-a370-1d2e55b9f5fb tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:56.392084 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2e09bdac-11ec-4019-a370-1d2e55b9f5fb tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:56.392408 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-5fda7aff-f210-40ed-93ea-4e45eec6f2d4 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90ed2d6013024c278551a2c9cd961f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac03b202c142deb478e3328397d402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:05:56.392889 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2e09bdac-11ec-4019-a370-1d2e55b9f5fb tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:56.393330 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2e09bdac-11ec-4019-a370-1d2e55b9f5fb tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:56.393802 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2e09bdac-11ec-4019-a370-1d2e55b9f5fb tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:56.394399 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2e09bdac-11ec-4019-a370-1d2e55b9f5fb tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:56.408647 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-5fda7aff-f210-40ed-93ea-4e45eec6f2d4 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90ed2d6013024c278551a2c9cd961f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac03b202c142deb478e3328397d402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:05:56.410374 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-5fda7aff-f210-40ed-93ea-4e45eec6f2d4 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90ed2d6013024c278551a2c9cd961f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac03b202c142deb478e3328397d402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:05:56.426520 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-5fda7aff-f210-40ed-93ea-4e45eec6f2d4 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] 10.222.0.18 "GET /compute/v2.1/servers/6b3e8fcb-7327-45f4-815d-c7b43ed4db97" status: 200 len: 1362 microversion: 2.26 time: 0.592358 Oct 22 21:05:56.431032 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1744/3444] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:05:55 2022] GET /compute/v2.1/servers/6b3e8fcb-7327-45f4-815d-c7b43ed4db97 => generated 1362 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:05:56.451438 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-153610eb-5f83-4854-8120-4757d5de67c2 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:05:56.452110 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-153610eb-5f83-4854-8120-4757d5de67c2 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] [instance: 23f77d1a-18db-4152-a25a-d02ac1726b08] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:05:56.464142 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-153610eb-5f83-4854-8120-4757d5de67c2 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:56.464819 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-153610eb-5f83-4854-8120-4757d5de67c2 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:56.465350 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-153610eb-5f83-4854-8120-4757d5de67c2 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:56.466354 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-153610eb-5f83-4854-8120-4757d5de67c2 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:56.467050 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-153610eb-5f83-4854-8120-4757d5de67c2 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:56.467759 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-153610eb-5f83-4854-8120-4757d5de67c2 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:56.898537 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-2e09bdac-11ec-4019-a370-1d2e55b9f5fb tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879c85830a9f42088a4ebdf1e3cfb39b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b54f56cfbc814cccb533c65966f35a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:05:56.910217 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-2e09bdac-11ec-4019-a370-1d2e55b9f5fb tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] 10.222.0.18 "GET /compute/v2.1/servers/3fdb6d35-9428-4253-ad00-932310ecdf5d" status: 200 len: 1504 microversion: 2.1 time: 0.548008 Oct 22 21:05:56.926868 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1701/3445] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:05:56 2022] GET /compute/v2.1/servers/3fdb6d35-9428-4253-ad00-932310ecdf5d => generated 1504 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:05:56.948502 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-153610eb-5f83-4854-8120-4757d5de67c2 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1b410a64e0415a96d30f5040361137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd7873d6db4e09bc9ab9a048a6b1ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:05:56.949033 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-27ad3d83-276f-4910-947b-49067e0b8a02 req-a6456460-6e5e-412c-877a-87501740fb86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9bfb71b4-0081-493a-8ed5-1c80169b12d0", "name": "network-vif-deleted", "tag": "a0cc9777-4dd3-4860-b673-6758803806be"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:05:56.966777 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-153610eb-5f83-4854-8120-4757d5de67c2 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] 10.222.0.18 "GET /compute/v2.1/servers/23f77d1a-18db-4152-a25a-d02ac1726b08" status: 200 len: 1315 microversion: 2.1 time: 0.533576 Oct 22 21:05:56.977944 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-27ad3d83-276f-4910-947b-49067e0b8a02 req-a6456460-6e5e-412c-877a-87501740fb86 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:56.979616 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-27ad3d83-276f-4910-947b-49067e0b8a02 req-a6456460-6e5e-412c-877a-87501740fb86 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:56.980472 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-27ad3d83-276f-4910-947b-49067e0b8a02 req-a6456460-6e5e-412c-877a-87501740fb86 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:56.980788 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1745/3446] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:05:56 2022] GET /compute/v2.1/servers/23f77d1a-18db-4152-a25a-d02ac1726b08 => generated 1315 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:05:56.986003 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-e2b3bdea-a833-480e-ad1d-a863aab2b604 req-1c8d0b10-1db1-405a-8c16-4d040a98cfad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23f77d1a-18db-4152-a25a-d02ac1726b08", "name": "network-vif-plugged", "status": "completed", "tag": "28fa3d1c-0002-432e-b75f-b946acccd7de"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:05:56.995258 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-27ad3d83-276f-4910-947b-49067e0b8a02 req-a6456460-6e5e-412c-877a-87501740fb86 service nova] Creating event network-vif-deleted:a0cc9777-4dd3-4860-b673-6758803806be for instance 9bfb71b4-0081-493a-8ed5-1c80169b12d0 on nch1-master-1 Oct 22 21:05:57.000892 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-27ad3d83-276f-4910-947b-49067e0b8a02 req-a6456460-6e5e-412c-877a-87501740fb86 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072286 Oct 22 21:05:57.007096 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1702/3447] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:05:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:05:57.011053 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-e2b3bdea-a833-480e-ad1d-a863aab2b604 req-1c8d0b10-1db1-405a-8c16-4d040a98cfad service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:57.011571 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-e2b3bdea-a833-480e-ad1d-a863aab2b604 req-1c8d0b10-1db1-405a-8c16-4d040a98cfad service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:57.012011 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-e2b3bdea-a833-480e-ad1d-a863aab2b604 req-1c8d0b10-1db1-405a-8c16-4d040a98cfad service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:57.025149 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-96d7a659-76f7-474b-bbdc-5f81527fbcde tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:05:57.026297 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-96d7a659-76f7-474b-bbdc-5f81527fbcde tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] [instance: e24e9888-adfe-455c-b53e-da3bf5729d69] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:05:57.038660 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-e2b3bdea-a833-480e-ad1d-a863aab2b604 req-1c8d0b10-1db1-405a-8c16-4d040a98cfad service nova] Creating event network-vif-plugged:28fa3d1c-0002-432e-b75f-b946acccd7de for instance 23f77d1a-18db-4152-a25a-d02ac1726b08 on nch1-master-1 Oct 22 21:05:57.041365 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-96d7a659-76f7-474b-bbdc-5f81527fbcde tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:57.043364 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-96d7a659-76f7-474b-bbdc-5f81527fbcde tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:57.044060 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-96d7a659-76f7-474b-bbdc-5f81527fbcde tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:57.045657 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-96d7a659-76f7-474b-bbdc-5f81527fbcde tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:57.046315 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-96d7a659-76f7-474b-bbdc-5f81527fbcde tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:57.046878 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-96d7a659-76f7-474b-bbdc-5f81527fbcde tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:57.060543 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-e2b3bdea-a833-480e-ad1d-a863aab2b604 req-1c8d0b10-1db1-405a-8c16-4d040a98cfad service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078035 Oct 22 21:05:57.061908 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1746/3448] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:05:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:05:57.084811 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-12b38d65-b62a-4a0a-8fc3-a8eb697696bc tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:05:57.086514 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-12b38d65-b62a-4a0a-8fc3-a8eb697696bc tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] [instance: a26fa9bd-fad2-40a2-910e-2208fb769dcb] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:05:57.105307 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-12b38d65-b62a-4a0a-8fc3-a8eb697696bc tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:57.106175 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-12b38d65-b62a-4a0a-8fc3-a8eb697696bc tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:57.106973 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-12b38d65-b62a-4a0a-8fc3-a8eb697696bc tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:57.108036 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-12b38d65-b62a-4a0a-8fc3-a8eb697696bc tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:57.108757 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-12b38d65-b62a-4a0a-8fc3-a8eb697696bc tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:57.110144 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-12b38d65-b62a-4a0a-8fc3-a8eb697696bc tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:57.285007 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-96d7a659-76f7-474b-bbdc-5f81527fbcde tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de9c0914dd6943bfa313ac456524cbba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af4c5251e7348c0ae5fc62468243a81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:05:57.297455 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-96d7a659-76f7-474b-bbdc-5f81527fbcde tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] 10.222.0.18 "GET /compute/v2.1/servers/e24e9888-adfe-455c-b53e-da3bf5729d69" status: 200 len: 1277 microversion: 2.1 time: 0.281043 Oct 22 21:05:57.300950 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-12b38d65-b62a-4a0a-8fc3-a8eb697696bc tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a44ff8e7c14b94b1670f030085c43d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a26a2284f4424cbeaf63d504652546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:05:57.310802 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1703/3449] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:05:57 2022] GET /compute/v2.1/servers/e24e9888-adfe-455c-b53e-da3bf5729d69 => generated 1277 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:05:57.316084 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-12b38d65-b62a-4a0a-8fc3-a8eb697696bc tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] 10.222.0.18 "GET /compute/v2.1/servers/a26fa9bd-fad2-40a2-910e-2208fb769dcb" status: 200 len: 1260 microversion: 2.1 time: 0.250773 Oct 22 21:05:57.318094 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1747/3450] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:05:57 2022] GET /compute/v2.1/servers/a26fa9bd-fad2-40a2-910e-2208fb769dcb => generated 1260 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:05:57.331511 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-6ef47e0c-9f6a-4ddc-a1de-796076635469 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:05:57.331511 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-6ef47e0c-9f6a-4ddc-a1de-796076635469 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] [instance: 37978245-38aa-4524-8c69-126c4b180b00] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:05:57.340314 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6ef47e0c-9f6a-4ddc-a1de-796076635469 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:57.340936 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6ef47e0c-9f6a-4ddc-a1de-796076635469 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:57.341567 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6ef47e0c-9f6a-4ddc-a1de-796076635469 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:57.343130 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-aa1fd00f-2f99-47f1-8914-9059a346f475 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:05:57.343933 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-aa1fd00f-2f99-47f1-8914-9059a346f475 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] [instance: 079f3144-b2dd-45f2-a22d-11cd315a31ed] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:05:57.344791 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6ef47e0c-9f6a-4ddc-a1de-796076635469 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:57.345412 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6ef47e0c-9f6a-4ddc-a1de-796076635469 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:57.345965 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6ef47e0c-9f6a-4ddc-a1de-796076635469 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:57.356426 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-aa1fd00f-2f99-47f1-8914-9059a346f475 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:57.357087 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-aa1fd00f-2f99-47f1-8914-9059a346f475 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:57.357534 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-aa1fd00f-2f99-47f1-8914-9059a346f475 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:57.358445 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-aa1fd00f-2f99-47f1-8914-9059a346f475 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:57.358996 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-aa1fd00f-2f99-47f1-8914-9059a346f475 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:57.359587 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-aa1fd00f-2f99-47f1-8914-9059a346f475 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:57.803149 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-aa1fd00f-2f99-47f1-8914-9059a346f475 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3820b31a424c3a9216a6ef91fcb285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a42c3ecf474883ac652fcc8c01c9f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:05:57.812282 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-aa1fd00f-2f99-47f1-8914-9059a346f475 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] 10.222.0.18 "GET /compute/v2.1/servers/079f3144-b2dd-45f2-a22d-11cd315a31ed" status: 200 len: 1216 microversion: 2.1 time: 0.477929 Oct 22 21:05:57.813397 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1748/3451] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:05:57 2022] GET /compute/v2.1/servers/079f3144-b2dd-45f2-a22d-11cd315a31ed => generated 1216 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:05:57.818157 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-a10a5771-b410-43c1-b70e-060717d18e1d tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:05:57.818959 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-a10a5771-b410-43c1-b70e-060717d18e1d tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] [instance: e09b7865-0b24-4e50-a66a-342dd2e6e5e3] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:05:57.825399 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a10a5771-b410-43c1-b70e-060717d18e1d tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:57.826049 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a10a5771-b410-43c1-b70e-060717d18e1d tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:57.826623 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a10a5771-b410-43c1-b70e-060717d18e1d tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:57.827538 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a10a5771-b410-43c1-b70e-060717d18e1d tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:57.828131 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a10a5771-b410-43c1-b70e-060717d18e1d tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:57.828691 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a10a5771-b410-43c1-b70e-060717d18e1d tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:57.857092 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-6ef47e0c-9f6a-4ddc-a1de-796076635469 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7102f7b674934e19b3d4a001b563d0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21349e14fb39496c9996d5af817b7f73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:05:57.878372 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-6ef47e0c-9f6a-4ddc-a1de-796076635469 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] 10.222.0.18 "GET /compute/v2.1/servers/37978245-38aa-4524-8c69-126c4b180b00" status: 200 len: 1318 microversion: 2.1 time: 0.565656 Oct 22 21:05:57.880082 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1704/3452] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:05:57 2022] GET /compute/v2.1/servers/37978245-38aa-4524-8c69-126c4b180b00 => generated 1318 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:05:57.888498 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-e4fb7bd3-06d0-4aa7-86a5-37e788b7de24 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:05:57.892232 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-e4fb7bd3-06d0-4aa7-86a5-37e788b7de24 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] [instance: 6b3e8fcb-7327-45f4-815d-c7b43ed4db97] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:05:57.903102 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e4fb7bd3-06d0-4aa7-86a5-37e788b7de24 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:57.903629 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e4fb7bd3-06d0-4aa7-86a5-37e788b7de24 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:57.904240 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e4fb7bd3-06d0-4aa7-86a5-37e788b7de24 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:57.905111 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e4fb7bd3-06d0-4aa7-86a5-37e788b7de24 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:57.905603 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e4fb7bd3-06d0-4aa7-86a5-37e788b7de24 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:57.906037 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e4fb7bd3-06d0-4aa7-86a5-37e788b7de24 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:58.306562 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-a10a5771-b410-43c1-b70e-060717d18e1d tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcdfeb6c1cda4810b9fa70fdfd9a66c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c774a85b2c41c98486cf91b1253363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:05:58.319932 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-a10a5771-b410-43c1-b70e-060717d18e1d tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] 10.222.0.18 "GET /compute/v2.1/servers/e09b7865-0b24-4e50-a66a-342dd2e6e5e3" status: 200 len: 1318 microversion: 2.1 time: 0.505219 Oct 22 21:05:58.321526 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1749/3453] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:05:57 2022] GET /compute/v2.1/servers/e09b7865-0b24-4e50-a66a-342dd2e6e5e3 => generated 1318 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:05:58.328561 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-64b72a0e-f462-4103-a996-78f0385bc05a req-f38effae-e584-4eae-b175-ae6e0567ab1a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "079f3144-b2dd-45f2-a22d-11cd315a31ed", "tag": "1466d21d-d248-44a7-abb0-91471f031e6a"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:05:58.354529 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-64b72a0e-f462-4103-a996-78f0385bc05a req-f38effae-e584-4eae-b175-ae6e0567ab1a service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:58.356399 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-64b72a0e-f462-4103-a996-78f0385bc05a req-f38effae-e584-4eae-b175-ae6e0567ab1a service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:58.356988 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-64b72a0e-f462-4103-a996-78f0385bc05a req-f38effae-e584-4eae-b175-ae6e0567ab1a service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:58.397879 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-64b72a0e-f462-4103-a996-78f0385bc05a req-f38effae-e584-4eae-b175-ae6e0567ab1a service nova] Creating event network-changed:1466d21d-d248-44a7-abb0-91471f031e6a for instance 079f3144-b2dd-45f2-a22d-11cd315a31ed on nch2-master-1 Oct 22 21:05:58.408239 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-64b72a0e-f462-4103-a996-78f0385bc05a req-f38effae-e584-4eae-b175-ae6e0567ab1a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084346 Oct 22 21:05:58.409534 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1750/3454] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:05:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:05:58.421923 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-29cc0ba0-f6db-43cf-a4b1-01b43e0cf280 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:05:58.425346 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-29cc0ba0-f6db-43cf-a4b1-01b43e0cf280 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] [instance: 3fdb6d35-9428-4253-ad00-932310ecdf5d] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:05:58.436776 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-29cc0ba0-f6db-43cf-a4b1-01b43e0cf280 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:58.437856 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-29cc0ba0-f6db-43cf-a4b1-01b43e0cf280 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:58.438513 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-29cc0ba0-f6db-43cf-a4b1-01b43e0cf280 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:58.439488 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-29cc0ba0-f6db-43cf-a4b1-01b43e0cf280 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:58.440154 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-29cc0ba0-f6db-43cf-a4b1-01b43e0cf280 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:58.442086 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-29cc0ba0-f6db-43cf-a4b1-01b43e0cf280 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:58.784660 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-e4fb7bd3-06d0-4aa7-86a5-37e788b7de24 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90ed2d6013024c278551a2c9cd961f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac03b202c142deb478e3328397d402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:05:58.797508 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-e4fb7bd3-06d0-4aa7-86a5-37e788b7de24 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90ed2d6013024c278551a2c9cd961f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac03b202c142deb478e3328397d402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:05:58.799153 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-e4fb7bd3-06d0-4aa7-86a5-37e788b7de24 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90ed2d6013024c278551a2c9cd961f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac03b202c142deb478e3328397d402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:05:58.800576 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-e4fb7bd3-06d0-4aa7-86a5-37e788b7de24 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] 10.222.0.18 "GET /compute/v2.1/servers/6b3e8fcb-7327-45f4-815d-c7b43ed4db97" status: 200 len: 1362 microversion: 2.26 time: 0.919329 Oct 22 21:05:58.801679 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1705/3455] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:05:57 2022] GET /compute/v2.1/servers/6b3e8fcb-7327-45f4-815d-c7b43ed4db97 => generated 1362 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:05:58.821648 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-0b43afc7-dc40-4d6b-b608-7ee8d0b450a1 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:05:58.822979 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-0b43afc7-dc40-4d6b-b608-7ee8d0b450a1 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] [instance: 23f77d1a-18db-4152-a25a-d02ac1726b08] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:05:58.846923 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0b43afc7-dc40-4d6b-b608-7ee8d0b450a1 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:58.853260 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0b43afc7-dc40-4d6b-b608-7ee8d0b450a1 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:58.853742 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0b43afc7-dc40-4d6b-b608-7ee8d0b450a1 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:58.875637 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0b43afc7-dc40-4d6b-b608-7ee8d0b450a1 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:58.876272 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0b43afc7-dc40-4d6b-b608-7ee8d0b450a1 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:58.876608 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0b43afc7-dc40-4d6b-b608-7ee8d0b450a1 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:59.232980 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-29cc0ba0-f6db-43cf-a4b1-01b43e0cf280 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879c85830a9f42088a4ebdf1e3cfb39b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b54f56cfbc814cccb533c65966f35a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:05:59.249317 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-29cc0ba0-f6db-43cf-a4b1-01b43e0cf280 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] 10.222.0.18 "GET /compute/v2.1/servers/3fdb6d35-9428-4253-ad00-932310ecdf5d" status: 200 len: 1504 microversion: 2.1 time: 0.835743 Oct 22 21:05:59.250684 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1751/3456] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:05:58 2022] GET /compute/v2.1/servers/3fdb6d35-9428-4253-ad00-932310ecdf5d => generated 1504 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:05:59.259128 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-13a7c51e-1729-4e04-a57b-1183bd3c3428 tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:05:59.260116 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-13a7c51e-1729-4e04-a57b-1183bd3c3428 tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] [instance: e24e9888-adfe-455c-b53e-da3bf5729d69] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:05:59.270830 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-13a7c51e-1729-4e04-a57b-1183bd3c3428 tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:59.271654 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-13a7c51e-1729-4e04-a57b-1183bd3c3428 tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:59.272301 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-13a7c51e-1729-4e04-a57b-1183bd3c3428 tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:59.273252 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-13a7c51e-1729-4e04-a57b-1183bd3c3428 tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:59.273901 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-13a7c51e-1729-4e04-a57b-1183bd3c3428 tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:59.274558 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-13a7c51e-1729-4e04-a57b-1183bd3c3428 tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:59.387163 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-13a7c51e-1729-4e04-a57b-1183bd3c3428 tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de9c0914dd6943bfa313ac456524cbba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af4c5251e7348c0ae5fc62468243a81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:05:59.388959 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-0b43afc7-dc40-4d6b-b608-7ee8d0b450a1 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1b410a64e0415a96d30f5040361137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd7873d6db4e09bc9ab9a048a6b1ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:05:59.399783 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-0b43afc7-dc40-4d6b-b608-7ee8d0b450a1 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] 10.222.0.18 "GET /compute/v2.1/servers/23f77d1a-18db-4152-a25a-d02ac1726b08" status: 200 len: 1502 microversion: 2.1 time: 0.596535 Oct 22 21:05:59.403944 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-13a7c51e-1729-4e04-a57b-1183bd3c3428 tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] 10.222.0.18 "GET /compute/v2.1/servers/e24e9888-adfe-455c-b53e-da3bf5729d69" status: 200 len: 1283 microversion: 2.1 time: 0.150792 Oct 22 21:05:59.405791 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1752/3457] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:05:59 2022] GET /compute/v2.1/servers/e24e9888-adfe-455c-b53e-da3bf5729d69 => generated 1283 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:05:59.414763 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-773f24c4-710d-4f8d-ab25-d0cb9e7bf115 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:05:59.416292 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-773f24c4-710d-4f8d-ab25-d0cb9e7bf115 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] [instance: a26fa9bd-fad2-40a2-910e-2208fb769dcb] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:05:59.418540 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1706/3458] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:05:58 2022] GET /compute/v2.1/servers/23f77d1a-18db-4152-a25a-d02ac1726b08 => generated 1502 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:05:59.424363 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-773f24c4-710d-4f8d-ab25-d0cb9e7bf115 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:59.425165 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-773f24c4-710d-4f8d-ab25-d0cb9e7bf115 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:59.425813 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-773f24c4-710d-4f8d-ab25-d0cb9e7bf115 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:59.426221 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-079a22da-90c5-4fab-a8e5-160e77b8abf8 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:05:59.426858 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-079a22da-90c5-4fab-a8e5-160e77b8abf8 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] [instance: 079f3144-b2dd-45f2-a22d-11cd315a31ed] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:05:59.427934 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-773f24c4-710d-4f8d-ab25-d0cb9e7bf115 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:59.428901 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-773f24c4-710d-4f8d-ab25-d0cb9e7bf115 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:59.429452 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-773f24c4-710d-4f8d-ab25-d0cb9e7bf115 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:59.434037 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-079a22da-90c5-4fab-a8e5-160e77b8abf8 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:59.434799 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-079a22da-90c5-4fab-a8e5-160e77b8abf8 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:59.435640 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-079a22da-90c5-4fab-a8e5-160e77b8abf8 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:59.438446 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-079a22da-90c5-4fab-a8e5-160e77b8abf8 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:59.439118 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-079a22da-90c5-4fab-a8e5-160e77b8abf8 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:59.439782 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-079a22da-90c5-4fab-a8e5-160e77b8abf8 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:59.461241 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell1:SELECT=100 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:05:59.949467 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-773f24c4-710d-4f8d-ab25-d0cb9e7bf115 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a44ff8e7c14b94b1670f030085c43d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a26a2284f4424cbeaf63d504652546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:05:59.965408 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-773f24c4-710d-4f8d-ab25-d0cb9e7bf115 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] 10.222.0.18 "GET /compute/v2.1/servers/a26fa9bd-fad2-40a2-910e-2208fb769dcb" status: 200 len: 1308 microversion: 2.1 time: 0.557652 Oct 22 21:05:59.966014 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1753/3459] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:05:59 2022] GET /compute/v2.1/servers/a26fa9bd-fad2-40a2-910e-2208fb769dcb => generated 1308 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:05:59.971009 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-d34b641f-2d19-4ea0-9221-b6f9dcd11db0 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:05:59.984400 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-d34b641f-2d19-4ea0-9221-b6f9dcd11db0 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] [instance: 37978245-38aa-4524-8c69-126c4b180b00] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:05:59.993107 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d34b641f-2d19-4ea0-9221-b6f9dcd11db0 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:59.993852 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d34b641f-2d19-4ea0-9221-b6f9dcd11db0 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:59.994443 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d34b641f-2d19-4ea0-9221-b6f9dcd11db0 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:05:59.995328 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d34b641f-2d19-4ea0-9221-b6f9dcd11db0 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:05:59.996012 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d34b641f-2d19-4ea0-9221-b6f9dcd11db0 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:05:59.999607 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d34b641f-2d19-4ea0-9221-b6f9dcd11db0 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:00.060012 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-079a22da-90c5-4fab-a8e5-160e77b8abf8 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3820b31a424c3a9216a6ef91fcb285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a42c3ecf474883ac652fcc8c01c9f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:06:00.070362 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-079a22da-90c5-4fab-a8e5-160e77b8abf8 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] 10.222.0.18 "GET /compute/v2.1/servers/079f3144-b2dd-45f2-a22d-11cd315a31ed" status: 200 len: 1216 microversion: 2.1 time: 0.650495 Oct 22 21:06:00.072251 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1707/3460] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:05:59 2022] GET /compute/v2.1/servers/079f3144-b2dd-45f2-a22d-11cd315a31ed => generated 1216 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:06:00.078713 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-edae749e-4215-4080-a29f-745bf03ad6ca req-ad1a6142-d130-4365-a4db-851c7812d09b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b3e8fcb-7327-45f4-815d-c7b43ed4db97", "name": "network-vif-plugged", "status": "completed", "tag": "d3b8f44f-8ce6-4fdb-ae8c-dbc9b73422f1"}, {"server_uuid": "37978245-38aa-4524-8c69-126c4b180b00", "name": "network-vif-plugged", "status": "completed", "tag": "2d24c6c5-c497-4768-afd7-c2a804f98609"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:06:00.102105 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-edae749e-4215-4080-a29f-745bf03ad6ca req-ad1a6142-d130-4365-a4db-851c7812d09b service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:00.102871 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-edae749e-4215-4080-a29f-745bf03ad6ca req-ad1a6142-d130-4365-a4db-851c7812d09b service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:00.103750 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-edae749e-4215-4080-a29f-745bf03ad6ca req-ad1a6142-d130-4365-a4db-851c7812d09b service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:00.121968 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-edae749e-4215-4080-a29f-745bf03ad6ca req-ad1a6142-d130-4365-a4db-851c7812d09b service nova] Creating event network-vif-plugged:d3b8f44f-8ce6-4fdb-ae8c-dbc9b73422f1 for instance 6b3e8fcb-7327-45f4-815d-c7b43ed4db97 on nch1-master-1 Oct 22 21:06:00.122721 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-edae749e-4215-4080-a29f-745bf03ad6ca req-ad1a6142-d130-4365-a4db-851c7812d09b service nova] Creating event network-vif-plugged:2d24c6c5-c497-4768-afd7-c2a804f98609 for instance 37978245-38aa-4524-8c69-126c4b180b00 on nch2-master-1 Oct 22 21:06:00.133484 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-edae749e-4215-4080-a29f-745bf03ad6ca req-ad1a6142-d130-4365-a4db-851c7812d09b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.059787 Oct 22 21:06:00.135511 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1708/3461] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:06:00 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:06:00.143240 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-537e8897-498c-41fb-9d7f-c9ef79bae7d0 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:00.144220 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-537e8897-498c-41fb-9d7f-c9ef79bae7d0 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] [instance: e09b7865-0b24-4e50-a66a-342dd2e6e5e3] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:06:00.152618 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-537e8897-498c-41fb-9d7f-c9ef79bae7d0 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:00.153534 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-537e8897-498c-41fb-9d7f-c9ef79bae7d0 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:00.153534 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-537e8897-498c-41fb-9d7f-c9ef79bae7d0 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:00.154251 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-537e8897-498c-41fb-9d7f-c9ef79bae7d0 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:00.154737 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-537e8897-498c-41fb-9d7f-c9ef79bae7d0 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:00.155124 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-537e8897-498c-41fb-9d7f-c9ef79bae7d0 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:00.504606 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-d34b641f-2d19-4ea0-9221-b6f9dcd11db0 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7102f7b674934e19b3d4a001b563d0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21349e14fb39496c9996d5af817b7f73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:06:00.519743 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-d34b641f-2d19-4ea0-9221-b6f9dcd11db0 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] 10.222.0.18 "GET /compute/v2.1/servers/37978245-38aa-4524-8c69-126c4b180b00" status: 200 len: 1318 microversion: 2.1 time: 0.552418 Oct 22 21:06:00.522120 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1754/3462] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:05:59 2022] GET /compute/v2.1/servers/37978245-38aa-4524-8c69-126c4b180b00 => generated 1318 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:06:00.534339 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-b619e7de-7b76-4354-8c5b-9798d98fcf1b tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:06:00.536278 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-b619e7de-7b76-4354-8c5b-9798d98fcf1b tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] [instance: 23f77d1a-18db-4152-a25a-d02ac1726b08] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:06:00.544481 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b619e7de-7b76-4354-8c5b-9798d98fcf1b tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:00.545535 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b619e7de-7b76-4354-8c5b-9798d98fcf1b tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:00.546193 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b619e7de-7b76-4354-8c5b-9798d98fcf1b tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:00.547273 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b619e7de-7b76-4354-8c5b-9798d98fcf1b tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:00.548094 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b619e7de-7b76-4354-8c5b-9798d98fcf1b tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:00.548919 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b619e7de-7b76-4354-8c5b-9798d98fcf1b tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:00.578202 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.objects.instance [None req-b619e7de-7b76-4354-8c5b-9798d98fcf1b tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lazy-loading 'flavor' on Instance uuid 23f77d1a-18db-4152-a25a-d02ac1726b08 {{(pid=138745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 21:06:00.622916 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-537e8897-498c-41fb-9d7f-c9ef79bae7d0 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcdfeb6c1cda4810b9fa70fdfd9a66c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c774a85b2c41c98486cf91b1253363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:06:00.634502 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-537e8897-498c-41fb-9d7f-c9ef79bae7d0 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] 10.222.0.18 "GET /compute/v2.1/servers/e09b7865-0b24-4e50-a66a-342dd2e6e5e3" status: 200 len: 1318 microversion: 2.1 time: 0.497212 Oct 22 21:06:00.635124 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1709/3463] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:06:00 2022] GET /compute/v2.1/servers/e09b7865-0b24-4e50-a66a-342dd2e6e5e3 => generated 1318 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:06:00.656609 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-f1a36f2b-97b5-492b-a1f2-9cf7e41d1434 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:00.657475 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-f1a36f2b-97b5-492b-a1f2-9cf7e41d1434 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] [instance: 6b3e8fcb-7327-45f4-815d-c7b43ed4db97] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:06:00.665083 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f1a36f2b-97b5-492b-a1f2-9cf7e41d1434 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:00.667681 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f1a36f2b-97b5-492b-a1f2-9cf7e41d1434 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:00.669832 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f1a36f2b-97b5-492b-a1f2-9cf7e41d1434 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:00.672033 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f1a36f2b-97b5-492b-a1f2-9cf7e41d1434 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:00.672630 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f1a36f2b-97b5-492b-a1f2-9cf7e41d1434 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:00.675132 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f1a36f2b-97b5-492b-a1f2-9cf7e41d1434 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:00.675985 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-b619e7de-7b76-4354-8c5b-9798d98fcf1b tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] 10.222.0.18 "POST /compute/v2.1/servers/23f77d1a-18db-4152-a25a-d02ac1726b08/action" status: 202 len: 0 microversion: 2.1 time: 0.151503 Oct 22 21:06:00.677032 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1755/3464] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 21:06:00 2022] POST /compute/v2.1/servers/23f77d1a-18db-4152-a25a-d02ac1726b08/action => generated 0 bytes in 154 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 21:06:00.684989 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-c46dad1c-5f86-4c70-8145-2f4c97c3ab41 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:00.685990 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-c46dad1c-5f86-4c70-8145-2f4c97c3ab41 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] [instance: 3fdb6d35-9428-4253-ad00-932310ecdf5d] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:06:00.694721 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c46dad1c-5f86-4c70-8145-2f4c97c3ab41 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:00.695598 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c46dad1c-5f86-4c70-8145-2f4c97c3ab41 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:00.696328 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c46dad1c-5f86-4c70-8145-2f4c97c3ab41 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:00.697067 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c46dad1c-5f86-4c70-8145-2f4c97c3ab41 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:00.697753 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c46dad1c-5f86-4c70-8145-2f4c97c3ab41 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:00.698417 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c46dad1c-5f86-4c70-8145-2f4c97c3ab41 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:01.074446 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-c46dad1c-5f86-4c70-8145-2f4c97c3ab41 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879c85830a9f42088a4ebdf1e3cfb39b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b54f56cfbc814cccb533c65966f35a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:06:01.088500 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-c46dad1c-5f86-4c70-8145-2f4c97c3ab41 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] 10.222.0.18 "GET /compute/v2.1/servers/3fdb6d35-9428-4253-ad00-932310ecdf5d" status: 200 len: 1504 microversion: 2.1 time: 0.409328 Oct 22 21:06:01.105689 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-f1a36f2b-97b5-492b-a1f2-9cf7e41d1434 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90ed2d6013024c278551a2c9cd961f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac03b202c142deb478e3328397d402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:06:01.108263 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1756/3465] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:06:00 2022] GET /compute/v2.1/servers/3fdb6d35-9428-4253-ad00-932310ecdf5d => generated 1504 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:06:01.114213 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-f1a36f2b-97b5-492b-a1f2-9cf7e41d1434 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90ed2d6013024c278551a2c9cd961f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac03b202c142deb478e3328397d402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:06:01.115726 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-f1a36f2b-97b5-492b-a1f2-9cf7e41d1434 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90ed2d6013024c278551a2c9cd961f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac03b202c142deb478e3328397d402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:06:01.117171 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-f1a36f2b-97b5-492b-a1f2-9cf7e41d1434 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] 10.222.0.18 "GET /compute/v2.1/servers/6b3e8fcb-7327-45f4-815d-c7b43ed4db97" status: 200 len: 1362 microversion: 2.26 time: 0.478496 Oct 22 21:06:01.117743 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1710/3466] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:06:00 2022] GET /compute/v2.1/servers/6b3e8fcb-7327-45f4-815d-c7b43ed4db97 => generated 1362 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:06:01.123064 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-dabdde3a-d204-449a-8d05-a2589f39ca4b tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:01.124220 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-dabdde3a-d204-449a-8d05-a2589f39ca4b tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] [instance: 23f77d1a-18db-4152-a25a-d02ac1726b08] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:06:01.133740 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-dabdde3a-d204-449a-8d05-a2589f39ca4b tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:01.134460 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-dabdde3a-d204-449a-8d05-a2589f39ca4b tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:01.135086 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-dabdde3a-d204-449a-8d05-a2589f39ca4b tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:01.136062 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-dabdde3a-d204-449a-8d05-a2589f39ca4b tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:01.136720 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-dabdde3a-d204-449a-8d05-a2589f39ca4b tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:01.137304 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-dabdde3a-d204-449a-8d05-a2589f39ca4b tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:01.140055 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-caed085b-afba-42dc-bb8f-f026dedd9910 tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:01.140702 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-caed085b-afba-42dc-bb8f-f026dedd9910 tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] [instance: e24e9888-adfe-455c-b53e-da3bf5729d69] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:06:01.147321 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-caed085b-afba-42dc-bb8f-f026dedd9910 tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:01.149367 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-caed085b-afba-42dc-bb8f-f026dedd9910 tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:01.149836 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-caed085b-afba-42dc-bb8f-f026dedd9910 tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:01.150588 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-caed085b-afba-42dc-bb8f-f026dedd9910 tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:01.151057 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-caed085b-afba-42dc-bb8f-f026dedd9910 tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:01.151530 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-caed085b-afba-42dc-bb8f-f026dedd9910 tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:01.448750 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-dabdde3a-d204-449a-8d05-a2589f39ca4b tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1b410a64e0415a96d30f5040361137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd7873d6db4e09bc9ab9a048a6b1ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:06:01.457218 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-dabdde3a-d204-449a-8d05-a2589f39ca4b tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] 10.222.0.18 "GET /compute/v2.1/servers/23f77d1a-18db-4152-a25a-d02ac1726b08" status: 200 len: 1510 microversion: 2.1 time: 0.337976 Oct 22 21:06:01.457919 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1711/3467] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:06:01 2022] GET /compute/v2.1/servers/23f77d1a-18db-4152-a25a-d02ac1726b08 => generated 1510 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:06:01.462530 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-05eaf504-2205-4bf5-8621-4e2846431242 req-d9bcec5e-ef7a-4ab3-974d-88aac1942c3b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e09b7865-0b24-4e50-a66a-342dd2e6e5e3", "tag": "4f8d8606-76d6-4351-9698-cdf245ae67e4"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:06:01.472818 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-05eaf504-2205-4bf5-8621-4e2846431242 req-d9bcec5e-ef7a-4ab3-974d-88aac1942c3b service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:01.473741 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-05eaf504-2205-4bf5-8621-4e2846431242 req-d9bcec5e-ef7a-4ab3-974d-88aac1942c3b service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:01.474154 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-05eaf504-2205-4bf5-8621-4e2846431242 req-d9bcec5e-ef7a-4ab3-974d-88aac1942c3b service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:01.486711 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-05eaf504-2205-4bf5-8621-4e2846431242 req-d9bcec5e-ef7a-4ab3-974d-88aac1942c3b service nova] Creating event network-changed:4f8d8606-76d6-4351-9698-cdf245ae67e4 for instance e09b7865-0b24-4e50-a66a-342dd2e6e5e3 on nch2-master-1 Oct 22 21:06:01.491995 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-05eaf504-2205-4bf5-8621-4e2846431242 req-d9bcec5e-ef7a-4ab3-974d-88aac1942c3b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032854 Oct 22 21:06:01.492840 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1712/3468] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:06:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:06:01.497845 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-e9be701b-d814-48f3-831a-9878ad35ddf7 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:01.498535 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-e9be701b-d814-48f3-831a-9878ad35ddf7 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] [instance: a26fa9bd-fad2-40a2-910e-2208fb769dcb] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:06:01.505009 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e9be701b-d814-48f3-831a-9878ad35ddf7 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:01.505491 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e9be701b-d814-48f3-831a-9878ad35ddf7 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:01.505923 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e9be701b-d814-48f3-831a-9878ad35ddf7 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:01.506608 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e9be701b-d814-48f3-831a-9878ad35ddf7 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:01.507057 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e9be701b-d814-48f3-831a-9878ad35ddf7 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:01.507511 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e9be701b-d814-48f3-831a-9878ad35ddf7 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:01.516044 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-caed085b-afba-42dc-bb8f-f026dedd9910 tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de9c0914dd6943bfa313ac456524cbba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af4c5251e7348c0ae5fc62468243a81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:06:01.525725 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-caed085b-afba-42dc-bb8f-f026dedd9910 tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] 10.222.0.18 "GET /compute/v2.1/servers/e24e9888-adfe-455c-b53e-da3bf5729d69" status: 200 len: 1325 microversion: 2.1 time: 0.412991 Oct 22 21:06:01.526313 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1757/3469] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:06:01 2022] GET /compute/v2.1/servers/e24e9888-adfe-455c-b53e-da3bf5729d69 => generated 1325 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:06:01.544437 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-b3e82ffa-c353-4b2f-adf1-ff4914bdd328 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:01.545421 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-b3e82ffa-c353-4b2f-adf1-ff4914bdd328 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] [instance: 079f3144-b2dd-45f2-a22d-11cd315a31ed] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:06:01.552563 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b3e82ffa-c353-4b2f-adf1-ff4914bdd328 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:01.553381 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b3e82ffa-c353-4b2f-adf1-ff4914bdd328 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:01.554061 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b3e82ffa-c353-4b2f-adf1-ff4914bdd328 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:01.554968 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b3e82ffa-c353-4b2f-adf1-ff4914bdd328 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:01.555634 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b3e82ffa-c353-4b2f-adf1-ff4914bdd328 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:01.556247 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b3e82ffa-c353-4b2f-adf1-ff4914bdd328 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:01.834026 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-e9be701b-d814-48f3-831a-9878ad35ddf7 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a44ff8e7c14b94b1670f030085c43d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a26a2284f4424cbeaf63d504652546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:06:01.842161 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-e9be701b-d814-48f3-831a-9878ad35ddf7 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] 10.222.0.18 "GET /compute/v2.1/servers/a26fa9bd-fad2-40a2-910e-2208fb769dcb" status: 200 len: 1308 microversion: 2.1 time: 0.348138 Oct 22 21:06:01.842733 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1713/3470] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:06:01 2022] GET /compute/v2.1/servers/a26fa9bd-fad2-40a2-910e-2208fb769dcb => generated 1308 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:06:01.847099 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-3ace0fac-2107-48ee-858e-a94878468423 req-ed6e530b-da58-42e4-8ab7-245e51368728 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a26fa9bd-fad2-40a2-910e-2208fb769dcb", "tag": "d2dc36e2-25aa-4eae-ac3a-801900c71b45"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:06:01.857336 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-3ace0fac-2107-48ee-858e-a94878468423 req-ed6e530b-da58-42e4-8ab7-245e51368728 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:01.857828 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-3ace0fac-2107-48ee-858e-a94878468423 req-ed6e530b-da58-42e4-8ab7-245e51368728 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:01.858242 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-3ace0fac-2107-48ee-858e-a94878468423 req-ed6e530b-da58-42e4-8ab7-245e51368728 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:01.869730 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-3ace0fac-2107-48ee-858e-a94878468423 req-ed6e530b-da58-42e4-8ab7-245e51368728 service nova] Creating event network-changed:d2dc36e2-25aa-4eae-ac3a-801900c71b45 for instance a26fa9bd-fad2-40a2-910e-2208fb769dcb on nch1-master-1 Oct 22 21:06:01.874628 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-3ace0fac-2107-48ee-858e-a94878468423 req-ed6e530b-da58-42e4-8ab7-245e51368728 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030774 Oct 22 21:06:01.875225 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1714/3471] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:06:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:06:01.880398 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-7af4e497-b7cf-400f-ac55-7ae77ef005c4 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:01.881323 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-7af4e497-b7cf-400f-ac55-7ae77ef005c4 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] [instance: 37978245-38aa-4524-8c69-126c4b180b00] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:06:01.883370 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:06:01.886778 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-b3e82ffa-c353-4b2f-adf1-ff4914bdd328 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3820b31a424c3a9216a6ef91fcb285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a42c3ecf474883ac652fcc8c01c9f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:06:01.889390 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7af4e497-b7cf-400f-ac55-7ae77ef005c4 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:01.889901 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7af4e497-b7cf-400f-ac55-7ae77ef005c4 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:01.890531 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7af4e497-b7cf-400f-ac55-7ae77ef005c4 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:01.891242 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7af4e497-b7cf-400f-ac55-7ae77ef005c4 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:01.892352 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7af4e497-b7cf-400f-ac55-7ae77ef005c4 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:01.892787 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7af4e497-b7cf-400f-ac55-7ae77ef005c4 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:01.897470 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-b3e82ffa-c353-4b2f-adf1-ff4914bdd328 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] 10.222.0.18 "GET /compute/v2.1/servers/079f3144-b2dd-45f2-a22d-11cd315a31ed" status: 200 len: 1216 microversion: 2.1 time: 0.356678 Oct 22 21:06:01.898397 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1758/3472] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:06:01 2022] GET /compute/v2.1/servers/079f3144-b2dd-45f2-a22d-11cd315a31ed => generated 1216 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:06:01.903375 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-2468217d-bb1f-4304-9eb9-3756757ebe44 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:01.903983 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-2468217d-bb1f-4304-9eb9-3756757ebe44 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] [instance: e09b7865-0b24-4e50-a66a-342dd2e6e5e3] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:06:01.909930 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2468217d-bb1f-4304-9eb9-3756757ebe44 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:01.910612 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2468217d-bb1f-4304-9eb9-3756757ebe44 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:01.911050 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2468217d-bb1f-4304-9eb9-3756757ebe44 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:01.911881 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2468217d-bb1f-4304-9eb9-3756757ebe44 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:01.912340 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2468217d-bb1f-4304-9eb9-3756757ebe44 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:01.912892 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2468217d-bb1f-4304-9eb9-3756757ebe44 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:02.657004 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-7af4e497-b7cf-400f-ac55-7ae77ef005c4 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7102f7b674934e19b3d4a001b563d0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21349e14fb39496c9996d5af817b7f73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:06:02.665907 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-2468217d-bb1f-4304-9eb9-3756757ebe44 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcdfeb6c1cda4810b9fa70fdfd9a66c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c774a85b2c41c98486cf91b1253363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:06:02.667117 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-7af4e497-b7cf-400f-ac55-7ae77ef005c4 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] 10.222.0.18 "GET /compute/v2.1/servers/37978245-38aa-4524-8c69-126c4b180b00" status: 200 len: 1318 microversion: 2.1 time: 0.790691 Oct 22 21:06:02.675576 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-2468217d-bb1f-4304-9eb9-3756757ebe44 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] 10.222.0.18 "GET /compute/v2.1/servers/e09b7865-0b24-4e50-a66a-342dd2e6e5e3" status: 200 len: 1318 microversion: 2.1 time: 0.775882 Oct 22 21:06:02.676699 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1759/3473] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:06:01 2022] GET /compute/v2.1/servers/e09b7865-0b24-4e50-a66a-342dd2e6e5e3 => generated 1318 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:06:02.679674 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1715/3474] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:06:01 2022] GET /compute/v2.1/servers/37978245-38aa-4524-8c69-126c4b180b00 => generated 1318 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:06:02.682058 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-a5d739fd-aaf7-4159-94f6-8c5f16563266 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:02.682905 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-a5d739fd-aaf7-4159-94f6-8c5f16563266 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] [instance: 3fdb6d35-9428-4253-ad00-932310ecdf5d] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:06:02.687259 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-9f524226-6e18-483a-845c-0521e9061195 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:02.687865 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-9f524226-6e18-483a-845c-0521e9061195 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] [instance: 6b3e8fcb-7327-45f4-815d-c7b43ed4db97] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:06:02.689115 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a5d739fd-aaf7-4159-94f6-8c5f16563266 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:02.689620 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a5d739fd-aaf7-4159-94f6-8c5f16563266 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:02.690371 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a5d739fd-aaf7-4159-94f6-8c5f16563266 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:02.691368 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a5d739fd-aaf7-4159-94f6-8c5f16563266 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:02.692122 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a5d739fd-aaf7-4159-94f6-8c5f16563266 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:02.692725 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a5d739fd-aaf7-4159-94f6-8c5f16563266 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:02.695083 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9f524226-6e18-483a-845c-0521e9061195 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:02.695831 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9f524226-6e18-483a-845c-0521e9061195 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:02.696335 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9f524226-6e18-483a-845c-0521e9061195 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:02.697145 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9f524226-6e18-483a-845c-0521e9061195 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:02.697654 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9f524226-6e18-483a-845c-0521e9061195 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:02.698107 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9f524226-6e18-483a-845c-0521e9061195 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:02.983814 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-9f524226-6e18-483a-845c-0521e9061195 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90ed2d6013024c278551a2c9cd961f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac03b202c142deb478e3328397d402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:06:02.994569 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-9f524226-6e18-483a-845c-0521e9061195 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90ed2d6013024c278551a2c9cd961f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac03b202c142deb478e3328397d402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:06:02.996253 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-9f524226-6e18-483a-845c-0521e9061195 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90ed2d6013024c278551a2c9cd961f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac03b202c142deb478e3328397d402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:06:02.997426 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-9f524226-6e18-483a-845c-0521e9061195 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] 10.222.0.18 "GET /compute/v2.1/servers/6b3e8fcb-7327-45f4-815d-c7b43ed4db97" status: 200 len: 1362 microversion: 2.26 time: 0.316721 Oct 22 21:06:03.007373 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1716/3475] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:06:02 2022] GET /compute/v2.1/servers/6b3e8fcb-7327-45f4-815d-c7b43ed4db97 => generated 1362 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:06:03.007373 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-9b4c9577-e0a3-4a11-8d62-ee6bbfd9fa5b tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:03.007373 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-9b4c9577-e0a3-4a11-8d62-ee6bbfd9fa5b tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] [instance: 23f77d1a-18db-4152-a25a-d02ac1726b08] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:06:03.016128 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9b4c9577-e0a3-4a11-8d62-ee6bbfd9fa5b tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:03.016128 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9b4c9577-e0a3-4a11-8d62-ee6bbfd9fa5b tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:03.016128 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9b4c9577-e0a3-4a11-8d62-ee6bbfd9fa5b tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:03.016128 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9b4c9577-e0a3-4a11-8d62-ee6bbfd9fa5b tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:03.016128 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9b4c9577-e0a3-4a11-8d62-ee6bbfd9fa5b tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:03.016128 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9b4c9577-e0a3-4a11-8d62-ee6bbfd9fa5b tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:03.025345 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-a5d739fd-aaf7-4159-94f6-8c5f16563266 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879c85830a9f42088a4ebdf1e3cfb39b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b54f56cfbc814cccb533c65966f35a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:06:03.034470 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-a5d739fd-aaf7-4159-94f6-8c5f16563266 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] 10.222.0.18 "GET /compute/v2.1/servers/3fdb6d35-9428-4253-ad00-932310ecdf5d" status: 200 len: 1504 microversion: 2.1 time: 0.356438 Oct 22 21:06:03.048588 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1760/3476] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:06:02 2022] GET /compute/v2.1/servers/3fdb6d35-9428-4253-ad00-932310ecdf5d => generated 1504 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:06:03.057318 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-796344a5-88f6-4753-ba95-4bfc27f56cd2 tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:03.058363 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-796344a5-88f6-4753-ba95-4bfc27f56cd2 tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] [instance: e24e9888-adfe-455c-b53e-da3bf5729d69] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:06:03.065747 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-796344a5-88f6-4753-ba95-4bfc27f56cd2 tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:03.066510 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-796344a5-88f6-4753-ba95-4bfc27f56cd2 tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:03.067298 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-796344a5-88f6-4753-ba95-4bfc27f56cd2 tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:03.068296 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-796344a5-88f6-4753-ba95-4bfc27f56cd2 tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:03.068906 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-796344a5-88f6-4753-ba95-4bfc27f56cd2 tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:03.069488 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-796344a5-88f6-4753-ba95-4bfc27f56cd2 tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:03.294524 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-9b4c9577-e0a3-4a11-8d62-ee6bbfd9fa5b tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1b410a64e0415a96d30f5040361137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd7873d6db4e09bc9ab9a048a6b1ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:06:03.297685 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-796344a5-88f6-4753-ba95-4bfc27f56cd2 tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de9c0914dd6943bfa313ac456524cbba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af4c5251e7348c0ae5fc62468243a81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:06:03.303266 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-9b4c9577-e0a3-4a11-8d62-ee6bbfd9fa5b tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] 10.222.0.18 "GET /compute/v2.1/servers/23f77d1a-18db-4152-a25a-d02ac1726b08" status: 200 len: 1493 microversion: 2.1 time: 0.304060 Oct 22 21:06:03.304015 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1717/3477] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:06:02 2022] GET /compute/v2.1/servers/23f77d1a-18db-4152-a25a-d02ac1726b08 => generated 1493 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:06:03.307496 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-796344a5-88f6-4753-ba95-4bfc27f56cd2 tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] 10.222.0.18 "GET /compute/v2.1/servers/e24e9888-adfe-455c-b53e-da3bf5729d69" status: 200 len: 1325 microversion: 2.1 time: 0.257281 Oct 22 21:06:03.308244 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1761/3478] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:06:03 2022] GET /compute/v2.1/servers/e24e9888-adfe-455c-b53e-da3bf5729d69 => generated 1325 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:06:03.308618 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-854514d7-2e0b-41d1-b92d-a7c6763b21c7 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:03.309275 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-854514d7-2e0b-41d1-b92d-a7c6763b21c7 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] [instance: a26fa9bd-fad2-40a2-910e-2208fb769dcb] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:06:03.319111 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-31f1364c-b312-408f-a4ee-9bdbe80ce94b tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:03.319741 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-31f1364c-b312-408f-a4ee-9bdbe80ce94b tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] [instance: 079f3144-b2dd-45f2-a22d-11cd315a31ed] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:06:03.320920 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-854514d7-2e0b-41d1-b92d-a7c6763b21c7 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:03.321581 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-854514d7-2e0b-41d1-b92d-a7c6763b21c7 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:03.322150 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-854514d7-2e0b-41d1-b92d-a7c6763b21c7 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:03.322876 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-854514d7-2e0b-41d1-b92d-a7c6763b21c7 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:03.323383 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-854514d7-2e0b-41d1-b92d-a7c6763b21c7 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:03.323823 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-854514d7-2e0b-41d1-b92d-a7c6763b21c7 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:03.325946 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-31f1364c-b312-408f-a4ee-9bdbe80ce94b tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:03.326449 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-31f1364c-b312-408f-a4ee-9bdbe80ce94b tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:03.326874 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-31f1364c-b312-408f-a4ee-9bdbe80ce94b tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:03.327628 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-31f1364c-b312-408f-a4ee-9bdbe80ce94b tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:03.328080 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-31f1364c-b312-408f-a4ee-9bdbe80ce94b tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:03.328505 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-31f1364c-b312-408f-a4ee-9bdbe80ce94b tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:03.344295 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:SELECT=100 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:06:03.770257 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-854514d7-2e0b-41d1-b92d-a7c6763b21c7 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a44ff8e7c14b94b1670f030085c43d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a26a2284f4424cbeaf63d504652546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:06:03.779041 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-854514d7-2e0b-41d1-b92d-a7c6763b21c7 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] 10.222.0.18 "GET /compute/v2.1/servers/a26fa9bd-fad2-40a2-910e-2208fb769dcb" status: 200 len: 1308 microversion: 2.1 time: 0.473992 Oct 22 21:06:03.794496 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1718/3479] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:06:03 2022] GET /compute/v2.1/servers/a26fa9bd-fad2-40a2-910e-2208fb769dcb => generated 1308 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:06:03.794824 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-31f1364c-b312-408f-a4ee-9bdbe80ce94b tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3820b31a424c3a9216a6ef91fcb285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a42c3ecf474883ac652fcc8c01c9f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:06:03.795275 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-e3ebe1db-6982-4bdd-bbac-332664de92a9 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:03.795275 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-e3ebe1db-6982-4bdd-bbac-332664de92a9 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] [instance: 23f77d1a-18db-4152-a25a-d02ac1726b08] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:06:03.795275 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e3ebe1db-6982-4bdd-bbac-332664de92a9 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:03.795624 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-31f1364c-b312-408f-a4ee-9bdbe80ce94b tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] 10.222.0.18 "GET /compute/v2.1/servers/079f3144-b2dd-45f2-a22d-11cd315a31ed" status: 200 len: 1216 microversion: 2.1 time: 0.479226 Oct 22 21:06:03.798760 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1762/3480] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:06:03 2022] GET /compute/v2.1/servers/079f3144-b2dd-45f2-a22d-11cd315a31ed => generated 1216 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:06:03.803639 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e3ebe1db-6982-4bdd-bbac-332664de92a9 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:03.804210 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e3ebe1db-6982-4bdd-bbac-332664de92a9 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:03.804438 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-646a6ac4-53d1-4cc3-8048-b65987c739db req-5b9ff444-8f94-46c3-adae-53ef0e5826a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e24e9888-adfe-455c-b53e-da3bf5729d69", "tag": "989e73aa-86fa-483e-8dc2-c5ec459b5837"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:06:03.804991 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e3ebe1db-6982-4bdd-bbac-332664de92a9 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:03.805476 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e3ebe1db-6982-4bdd-bbac-332664de92a9 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:03.805913 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e3ebe1db-6982-4bdd-bbac-332664de92a9 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:03.816120 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-646a6ac4-53d1-4cc3-8048-b65987c739db req-5b9ff444-8f94-46c3-adae-53ef0e5826a9 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:03.816631 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-646a6ac4-53d1-4cc3-8048-b65987c739db req-5b9ff444-8f94-46c3-adae-53ef0e5826a9 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:03.817188 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-646a6ac4-53d1-4cc3-8048-b65987c739db req-5b9ff444-8f94-46c3-adae-53ef0e5826a9 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:03.830242 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-646a6ac4-53d1-4cc3-8048-b65987c739db req-5b9ff444-8f94-46c3-adae-53ef0e5826a9 service nova] Creating event network-changed:989e73aa-86fa-483e-8dc2-c5ec459b5837 for instance e24e9888-adfe-455c-b53e-da3bf5729d69 on nch1-master-1 Oct 22 21:06:03.833123 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-e3ebe1db-6982-4bdd-bbac-332664de92a9 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] [instance: 23f77d1a-18db-4152-a25a-d02ac1726b08] Going to try to terminate instance {{(pid=138744) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 21:06:03.835835 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-646a6ac4-53d1-4cc3-8048-b65987c739db req-5b9ff444-8f94-46c3-adae-53ef0e5826a9 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035511 Oct 22 21:06:03.836958 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1763/3481] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:06:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:06:03.843730 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-0d92a14a-e616-4677-8ea5-512e712b8ac6 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:03.844561 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-0d92a14a-e616-4677-8ea5-512e712b8ac6 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] [instance: 37978245-38aa-4524-8c69-126c4b180b00] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:06:03.851782 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0d92a14a-e616-4677-8ea5-512e712b8ac6 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:03.852283 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0d92a14a-e616-4677-8ea5-512e712b8ac6 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:03.852738 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0d92a14a-e616-4677-8ea5-512e712b8ac6 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:03.853459 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0d92a14a-e616-4677-8ea5-512e712b8ac6 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:03.853924 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0d92a14a-e616-4677-8ea5-512e712b8ac6 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:03.854361 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0d92a14a-e616-4677-8ea5-512e712b8ac6 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:03.925924 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-e3ebe1db-6982-4bdd-bbac-332664de92a9 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] 10.222.0.18 "DELETE /compute/v2.1/servers/23f77d1a-18db-4152-a25a-d02ac1726b08" status: 204 len: 0 microversion: 2.1 time: 0.144973 Oct 22 21:06:03.927434 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1719/3482] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 21:06:03 2022] DELETE /compute/v2.1/servers/23f77d1a-18db-4152-a25a-d02ac1726b08 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 21:06:03.935776 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-d8c92db9-d79e-4237-9018-e62546a0d732 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:03.936492 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-d8c92db9-d79e-4237-9018-e62546a0d732 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] [instance: e09b7865-0b24-4e50-a66a-342dd2e6e5e3] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:06:03.942890 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d8c92db9-d79e-4237-9018-e62546a0d732 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:03.943407 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d8c92db9-d79e-4237-9018-e62546a0d732 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:03.943852 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d8c92db9-d79e-4237-9018-e62546a0d732 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:03.944560 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d8c92db9-d79e-4237-9018-e62546a0d732 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:03.945005 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d8c92db9-d79e-4237-9018-e62546a0d732 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:03.945429 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d8c92db9-d79e-4237-9018-e62546a0d732 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:04.201168 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-0d92a14a-e616-4677-8ea5-512e712b8ac6 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7102f7b674934e19b3d4a001b563d0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21349e14fb39496c9996d5af817b7f73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:06:04.209803 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-0d92a14a-e616-4677-8ea5-512e712b8ac6 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] 10.222.0.18 "GET /compute/v2.1/servers/37978245-38aa-4524-8c69-126c4b180b00" status: 200 len: 1507 microversion: 2.1 time: 0.371654 Oct 22 21:06:04.210376 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1764/3483] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:06:03 2022] GET /compute/v2.1/servers/37978245-38aa-4524-8c69-126c4b180b00 => generated 1507 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:06:04.228108 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-f3cf9deb-eb34-4d4f-9ec7-ecb5ec66c048 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:04.228108 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-f3cf9deb-eb34-4d4f-9ec7-ecb5ec66c048 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] [instance: 23f77d1a-18db-4152-a25a-d02ac1726b08] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:06:04.228108 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f3cf9deb-eb34-4d4f-9ec7-ecb5ec66c048 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:04.228108 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f3cf9deb-eb34-4d4f-9ec7-ecb5ec66c048 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:04.228108 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f3cf9deb-eb34-4d4f-9ec7-ecb5ec66c048 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:04.228108 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f3cf9deb-eb34-4d4f-9ec7-ecb5ec66c048 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:04.228108 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f3cf9deb-eb34-4d4f-9ec7-ecb5ec66c048 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:04.228108 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f3cf9deb-eb34-4d4f-9ec7-ecb5ec66c048 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:04.229020 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-d8c92db9-d79e-4237-9018-e62546a0d732 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcdfeb6c1cda4810b9fa70fdfd9a66c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c774a85b2c41c98486cf91b1253363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:06:04.237304 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-d8c92db9-d79e-4237-9018-e62546a0d732 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] 10.222.0.18 "GET /compute/v2.1/servers/e09b7865-0b24-4e50-a66a-342dd2e6e5e3" status: 200 len: 1318 microversion: 2.1 time: 0.307984 Oct 22 21:06:04.238396 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1720/3484] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:06:03 2022] GET /compute/v2.1/servers/e09b7865-0b24-4e50-a66a-342dd2e6e5e3 => generated 1318 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:06:04.244004 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-8de2ae79-ba6b-4c0d-b85b-c321673ff920 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:04.244938 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-8de2ae79-ba6b-4c0d-b85b-c321673ff920 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] [instance: 6b3e8fcb-7327-45f4-815d-c7b43ed4db97] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:06:04.251627 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8de2ae79-ba6b-4c0d-b85b-c321673ff920 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:04.252523 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8de2ae79-ba6b-4c0d-b85b-c321673ff920 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:04.253064 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8de2ae79-ba6b-4c0d-b85b-c321673ff920 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:04.253981 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8de2ae79-ba6b-4c0d-b85b-c321673ff920 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:04.254957 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8de2ae79-ba6b-4c0d-b85b-c321673ff920 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:04.255743 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8de2ae79-ba6b-4c0d-b85b-c321673ff920 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:04.510092 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-f3cf9deb-eb34-4d4f-9ec7-ecb5ec66c048 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1b410a64e0415a96d30f5040361137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd7873d6db4e09bc9ab9a048a6b1ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:06:04.521626 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-f3cf9deb-eb34-4d4f-9ec7-ecb5ec66c048 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] 10.222.0.18 "GET /compute/v2.1/servers/23f77d1a-18db-4152-a25a-d02ac1726b08" status: 200 len: 1499 microversion: 2.1 time: 0.309719 Oct 22 21:06:04.523260 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1765/3485] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:06:04 2022] GET /compute/v2.1/servers/23f77d1a-18db-4152-a25a-d02ac1726b08 => generated 1499 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:06:04.530831 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-85a693e0-77f4-4371-af73-96a774b025f9 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:04.531845 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-85a693e0-77f4-4371-af73-96a774b025f9 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] [instance: 3fdb6d35-9428-4253-ad00-932310ecdf5d] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:06:04.541084 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-85a693e0-77f4-4371-af73-96a774b025f9 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:04.541404 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-85a693e0-77f4-4371-af73-96a774b025f9 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:04.542044 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-85a693e0-77f4-4371-af73-96a774b025f9 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:04.542939 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-85a693e0-77f4-4371-af73-96a774b025f9 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:04.543612 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-85a693e0-77f4-4371-af73-96a774b025f9 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:04.544410 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-85a693e0-77f4-4371-af73-96a774b025f9 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:04.559504 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-8de2ae79-ba6b-4c0d-b85b-c321673ff920 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90ed2d6013024c278551a2c9cd961f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac03b202c142deb478e3328397d402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:06:04.570017 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-8de2ae79-ba6b-4c0d-b85b-c321673ff920 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90ed2d6013024c278551a2c9cd961f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac03b202c142deb478e3328397d402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:06:04.578556 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-8de2ae79-ba6b-4c0d-b85b-c321673ff920 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90ed2d6013024c278551a2c9cd961f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac03b202c142deb478e3328397d402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:06:04.579828 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-8de2ae79-ba6b-4c0d-b85b-c321673ff920 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] 10.222.0.18 "GET /compute/v2.1/servers/6b3e8fcb-7327-45f4-815d-c7b43ed4db97" status: 200 len: 1546 microversion: 2.26 time: 0.340247 Oct 22 21:06:04.580730 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1721/3486] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:06:04 2022] GET /compute/v2.1/servers/6b3e8fcb-7327-45f4-815d-c7b43ed4db97 => generated 1546 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:06:04.585353 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-c52522c5-5dd4-40a1-933c-f8b002e9d6b5 tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:04.586120 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-c52522c5-5dd4-40a1-933c-f8b002e9d6b5 tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] [instance: e24e9888-adfe-455c-b53e-da3bf5729d69] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:06:04.592709 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c52522c5-5dd4-40a1-933c-f8b002e9d6b5 tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:04.593400 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c52522c5-5dd4-40a1-933c-f8b002e9d6b5 tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:04.594133 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c52522c5-5dd4-40a1-933c-f8b002e9d6b5 tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:04.594963 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c52522c5-5dd4-40a1-933c-f8b002e9d6b5 tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:04.595571 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c52522c5-5dd4-40a1-933c-f8b002e9d6b5 tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:04.596146 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c52522c5-5dd4-40a1-933c-f8b002e9d6b5 tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:04.763408 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-85a693e0-77f4-4371-af73-96a774b025f9 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879c85830a9f42088a4ebdf1e3cfb39b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b54f56cfbc814cccb533c65966f35a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:06:04.771570 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-85a693e0-77f4-4371-af73-96a774b025f9 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] 10.222.0.18 "GET /compute/v2.1/servers/3fdb6d35-9428-4253-ad00-932310ecdf5d" status: 200 len: 1504 microversion: 2.1 time: 0.245543 Oct 22 21:06:04.772517 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1766/3487] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:06:04 2022] GET /compute/v2.1/servers/3fdb6d35-9428-4253-ad00-932310ecdf5d => generated 1504 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:06:04.777544 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-6221986d-0028-4a1b-a8cd-d0f70bfdabcf tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Calling method '.version_select at 0x7fd39ef77160>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:04.786436 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-c52522c5-5dd4-40a1-933c-f8b002e9d6b5 tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de9c0914dd6943bfa313ac456524cbba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af4c5251e7348c0ae5fc62468243a81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:06:04.797888 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6221986d-0028-4a1b-a8cd-d0f70bfdabcf tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:04.798361 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6221986d-0028-4a1b-a8cd-d0f70bfdabcf tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:04.798738 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6221986d-0028-4a1b-a8cd-d0f70bfdabcf tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:04.801300 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-6221986d-0028-4a1b-a8cd-d0f70bfdabcf tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] [instance: 6b3e8fcb-7327-45f4-815d-c7b43ed4db97] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:06:04.802218 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-c52522c5-5dd4-40a1-933c-f8b002e9d6b5 tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] 10.222.0.18 "GET /compute/v2.1/servers/e24e9888-adfe-455c-b53e-da3bf5729d69" status: 200 len: 1325 microversion: 2.1 time: 0.220104 Oct 22 21:06:04.803316 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1722/3488] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:06:04 2022] GET /compute/v2.1/servers/e24e9888-adfe-455c-b53e-da3bf5729d69 => generated 1325 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:06:04.807705 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6221986d-0028-4a1b-a8cd-d0f70bfdabcf tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:04.808216 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6221986d-0028-4a1b-a8cd-d0f70bfdabcf tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:04.808640 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6221986d-0028-4a1b-a8cd-d0f70bfdabcf tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:04.809602 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6221986d-0028-4a1b-a8cd-d0f70bfdabcf tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:04.809784 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-e119aeaa-8f43-4c4f-98be-e4409be0e8f1 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:04.810408 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6221986d-0028-4a1b-a8cd-d0f70bfdabcf tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:04.810573 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-e119aeaa-8f43-4c4f-98be-e4409be0e8f1 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] [instance: a26fa9bd-fad2-40a2-910e-2208fb769dcb] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:06:04.811884 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6221986d-0028-4a1b-a8cd-d0f70bfdabcf tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:04.818970 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e119aeaa-8f43-4c4f-98be-e4409be0e8f1 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:04.819704 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e119aeaa-8f43-4c4f-98be-e4409be0e8f1 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:04.820184 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e119aeaa-8f43-4c4f-98be-e4409be0e8f1 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:04.820987 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e119aeaa-8f43-4c4f-98be-e4409be0e8f1 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:04.821438 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e119aeaa-8f43-4c4f-98be-e4409be0e8f1 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:04.821942 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e119aeaa-8f43-4c4f-98be-e4409be0e8f1 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:04.842545 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6221986d-0028-4a1b-a8cd-d0f70bfdabcf tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:04.843267 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6221986d-0028-4a1b-a8cd-d0f70bfdabcf tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:04.843738 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6221986d-0028-4a1b-a8cd-d0f70bfdabcf tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:04.858150 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6221986d-0028-4a1b-a8cd-d0f70bfdabcf tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:04.858630 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6221986d-0028-4a1b-a8cd-d0f70bfdabcf tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:04.859065 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6221986d-0028-4a1b-a8cd-d0f70bfdabcf tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:04.889512 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=2,nova_cell1:INSERT=2,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:06:04.894763 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.objects.instance [None req-6221986d-0028-4a1b-a8cd-d0f70bfdabcf tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Lazy-loading 'flavor' on Instance uuid 6b3e8fcb-7327-45f4-815d-c7b43ed4db97 {{(pid=138745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 21:06:04.913400 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-6221986d-0028-4a1b-a8cd-d0f70bfdabcf tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] 10.222.0.18 "PUT /compute/v2.1/servers/6b3e8fcb-7327-45f4-815d-c7b43ed4db97/tags/tempest-tag-510509331" status: 201 len: 0 microversion: 2.26 time: 0.139408 Oct 22 21:06:04.914295 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1767/3489] 10.222.0.18 () {62 vars in 1377 bytes} [Sat Oct 22 21:06:04 2022] PUT /compute/v2.1/servers/6b3e8fcb-7327-45f4-815d-c7b43ed4db97/tags/tempest-tag-510509331 => generated 0 bytes in 141 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Oct 22 21:06:04.919300 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-c426423f-b2e0-4ead-99f7-b2854770aa62 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:04.919956 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-c426423f-b2e0-4ead-99f7-b2854770aa62 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] [instance: 079f3144-b2dd-45f2-a22d-11cd315a31ed] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:06:04.928184 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c426423f-b2e0-4ead-99f7-b2854770aa62 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:04.928671 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c426423f-b2e0-4ead-99f7-b2854770aa62 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:04.929133 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c426423f-b2e0-4ead-99f7-b2854770aa62 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:04.929969 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c426423f-b2e0-4ead-99f7-b2854770aa62 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:04.930286 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c426423f-b2e0-4ead-99f7-b2854770aa62 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:04.930720 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c426423f-b2e0-4ead-99f7-b2854770aa62 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:04.968634 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-e119aeaa-8f43-4c4f-98be-e4409be0e8f1 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a44ff8e7c14b94b1670f030085c43d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a26a2284f4424cbeaf63d504652546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:06:04.979574 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-e119aeaa-8f43-4c4f-98be-e4409be0e8f1 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] 10.222.0.18 "GET /compute/v2.1/servers/a26fa9bd-fad2-40a2-910e-2208fb769dcb" status: 200 len: 1308 microversion: 2.1 time: 0.173092 Oct 22 21:06:04.980620 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1723/3490] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:06:04 2022] GET /compute/v2.1/servers/a26fa9bd-fad2-40a2-910e-2208fb769dcb => generated 1308 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:06:04.993903 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-71d50ab7-6e66-475e-9e9b-34faf9909d07 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Calling method '.version_select at 0x7fd39ef1c700>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:05.003733 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-71d50ab7-6e66-475e-9e9b-34faf9909d07 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:05.004309 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-71d50ab7-6e66-475e-9e9b-34faf9909d07 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:05.005065 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-71d50ab7-6e66-475e-9e9b-34faf9909d07 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:05.021208 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-71d50ab7-6e66-475e-9e9b-34faf9909d07 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] 10.222.0.18 "GET /compute/v2.1/servers/6b3e8fcb-7327-45f4-815d-c7b43ed4db97/tags/tempest-tag-510509331" status: 204 len: 0 microversion: 2.26 time: 0.039317 Oct 22 21:06:05.022079 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1724/3491] 10.222.0.18 () {60 vars in 1358 bytes} [Sat Oct 22 21:06:04 2022] GET /compute/v2.1/servers/6b3e8fcb-7327-45f4-815d-c7b43ed4db97/tags/tempest-tag-510509331 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 22 21:06:05.030515 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-306ba292-1d99-4603-b61b-94d0bb3337ba tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Calling method '.version_select at 0x7fd39efb7f70>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:05.038340 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-306ba292-1d99-4603-b61b-94d0bb3337ba tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:05.039028 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-306ba292-1d99-4603-b61b-94d0bb3337ba tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:05.039709 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-306ba292-1d99-4603-b61b-94d0bb3337ba tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:05.040413 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-306ba292-1d99-4603-b61b-94d0bb3337ba tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] [instance: 6b3e8fcb-7327-45f4-815d-c7b43ed4db97] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:06:05.046446 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-306ba292-1d99-4603-b61b-94d0bb3337ba tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:05.046968 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-306ba292-1d99-4603-b61b-94d0bb3337ba tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:05.047440 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-306ba292-1d99-4603-b61b-94d0bb3337ba tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:05.048188 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-306ba292-1d99-4603-b61b-94d0bb3337ba tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:05.048592 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-306ba292-1d99-4603-b61b-94d0bb3337ba tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:05.049190 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-306ba292-1d99-4603-b61b-94d0bb3337ba tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:05.072687 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-306ba292-1d99-4603-b61b-94d0bb3337ba tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:05.073176 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-306ba292-1d99-4603-b61b-94d0bb3337ba tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:05.073620 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-306ba292-1d99-4603-b61b-94d0bb3337ba tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:05.087730 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-c426423f-b2e0-4ead-99f7-b2854770aa62 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3820b31a424c3a9216a6ef91fcb285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a42c3ecf474883ac652fcc8c01c9f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:06:05.090061 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.objects.instance [None req-306ba292-1d99-4603-b61b-94d0bb3337ba tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Lazy-loading 'flavor' on Instance uuid 6b3e8fcb-7327-45f4-815d-c7b43ed4db97 {{(pid=138744) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 21:06:05.096433 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-c426423f-b2e0-4ead-99f7-b2854770aa62 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] 10.222.0.18 "GET /compute/v2.1/servers/079f3144-b2dd-45f2-a22d-11cd315a31ed" status: 200 len: 1216 microversion: 2.1 time: 0.180889 Oct 22 21:06:05.097351 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1768/3492] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:06:04 2022] GET /compute/v2.1/servers/079f3144-b2dd-45f2-a22d-11cd315a31ed => generated 1216 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:06:05.114974 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-306ba292-1d99-4603-b61b-94d0bb3337ba tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] 10.222.0.18 "DELETE /compute/v2.1/servers/6b3e8fcb-7327-45f4-815d-c7b43ed4db97/tags" status: 204 len: 0 microversion: 2.26 time: 0.088281 Oct 22 21:06:05.115744 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1725/3493] 10.222.0.18 () {60 vars in 1295 bytes} [Sat Oct 22 21:06:05 2022] DELETE /compute/v2.1/servers/6b3e8fcb-7327-45f4-815d-c7b43ed4db97/tags => generated 0 bytes in 90 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 22 21:06:05.125173 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-4279956c-75c5-4ba5-82ba-f02c90f740f0 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Calling method '.version_select at 0x7fd39ee69430>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:05.133184 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4279956c-75c5-4ba5-82ba-f02c90f740f0 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:05.133672 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4279956c-75c5-4ba5-82ba-f02c90f740f0 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:05.134108 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4279956c-75c5-4ba5-82ba-f02c90f740f0 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:05.142975 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-4279956c-75c5-4ba5-82ba-f02c90f740f0 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] 10.222.0.18 "GET /compute/v2.1/servers/6b3e8fcb-7327-45f4-815d-c7b43ed4db97/tags" status: 200 len: 12 microversion: 2.26 time: 0.022032 Oct 22 21:06:05.143602 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1769/3494] 10.222.0.18 () {60 vars in 1292 bytes} [Sat Oct 22 21:06:05 2022] GET /compute/v2.1/servers/6b3e8fcb-7327-45f4-815d-c7b43ed4db97/tags => generated 12 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:06:05.154729 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-b00099d5-5ba6-4d9b-ad75-fb5a58984cf4 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Calling method '.version_select at 0x7fd39efbca60>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:05.164756 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b00099d5-5ba6-4d9b-ad75-fb5a58984cf4 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:05.165244 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b00099d5-5ba6-4d9b-ad75-fb5a58984cf4 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:05.165669 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b00099d5-5ba6-4d9b-ad75-fb5a58984cf4 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:05.166144 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-b00099d5-5ba6-4d9b-ad75-fb5a58984cf4 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] [instance: 6b3e8fcb-7327-45f4-815d-c7b43ed4db97] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:06:05.171151 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b00099d5-5ba6-4d9b-ad75-fb5a58984cf4 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:05.171660 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b00099d5-5ba6-4d9b-ad75-fb5a58984cf4 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:05.172090 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b00099d5-5ba6-4d9b-ad75-fb5a58984cf4 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:05.172752 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b00099d5-5ba6-4d9b-ad75-fb5a58984cf4 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:05.173202 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b00099d5-5ba6-4d9b-ad75-fb5a58984cf4 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:05.173626 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b00099d5-5ba6-4d9b-ad75-fb5a58984cf4 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:05.200434 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b00099d5-5ba6-4d9b-ad75-fb5a58984cf4 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:05.200942 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b00099d5-5ba6-4d9b-ad75-fb5a58984cf4 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:05.201374 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b00099d5-5ba6-4d9b-ad75-fb5a58984cf4 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:05.211020 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b00099d5-5ba6-4d9b-ad75-fb5a58984cf4 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:05.211523 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b00099d5-5ba6-4d9b-ad75-fb5a58984cf4 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:05.211953 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b00099d5-5ba6-4d9b-ad75-fb5a58984cf4 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:05.237770 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.objects.instance [None req-b00099d5-5ba6-4d9b-ad75-fb5a58984cf4 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Lazy-loading 'flavor' on Instance uuid 6b3e8fcb-7327-45f4-815d-c7b43ed4db97 {{(pid=138744) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 21:06:05.253539 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-b00099d5-5ba6-4d9b-ad75-fb5a58984cf4 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] 10.222.0.18 "PUT /compute/v2.1/servers/6b3e8fcb-7327-45f4-815d-c7b43ed4db97/tags/tempest-tag-1526890115" status: 201 len: 0 microversion: 2.26 time: 0.103345 Oct 22 21:06:05.254291 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1726/3495] 10.222.0.18 () {62 vars in 1380 bytes} [Sat Oct 22 21:06:05 2022] PUT /compute/v2.1/servers/6b3e8fcb-7327-45f4-815d-c7b43ed4db97/tags/tempest-tag-1526890115 => generated 0 bytes in 105 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Oct 22 21:06:05.261037 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-e454ff79-7283-44db-a2a1-49f8ffba9057 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:05.261728 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-e454ff79-7283-44db-a2a1-49f8ffba9057 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] [instance: e09b7865-0b24-4e50-a66a-342dd2e6e5e3] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:06:05.263727 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell0:SELECT=1 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:06:05.263908 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-81431b6b-fef3-43be-a5a7-f787a450c40d tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Calling method '.version_select at 0x7fd39efbcdc0>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:05.264816 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell0:SELECT=5 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:06:05.270716 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e454ff79-7283-44db-a2a1-49f8ffba9057 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:05.271199 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e454ff79-7283-44db-a2a1-49f8ffba9057 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:05.271669 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e454ff79-7283-44db-a2a1-49f8ffba9057 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:05.271969 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-81431b6b-fef3-43be-a5a7-f787a450c40d tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:05.272439 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e454ff79-7283-44db-a2a1-49f8ffba9057 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:05.272548 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-81431b6b-fef3-43be-a5a7-f787a450c40d tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:05.272862 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e454ff79-7283-44db-a2a1-49f8ffba9057 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:05.272957 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-81431b6b-fef3-43be-a5a7-f787a450c40d tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:05.273289 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e454ff79-7283-44db-a2a1-49f8ffba9057 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:05.282303 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-81431b6b-fef3-43be-a5a7-f787a450c40d tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] 10.222.0.18 "GET /compute/v2.1/servers/6b3e8fcb-7327-45f4-815d-c7b43ed4db97/tags" status: 200 len: 36 microversion: 2.26 time: 0.022315 Oct 22 21:06:05.283244 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1727/3496] 10.222.0.18 () {60 vars in 1292 bytes} [Sat Oct 22 21:06:05 2022] GET /compute/v2.1/servers/6b3e8fcb-7327-45f4-815d-c7b43ed4db97/tags => generated 36 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:06:05.293301 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-a845fdba-075a-498a-aeb1-552642abe642 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Calling method '.version_select at 0x7fd39ef3a160>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:05.300772 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a845fdba-075a-498a-aeb1-552642abe642 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:05.301301 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a845fdba-075a-498a-aeb1-552642abe642 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:05.301734 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a845fdba-075a-498a-aeb1-552642abe642 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:05.302201 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-a845fdba-075a-498a-aeb1-552642abe642 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] [instance: 6b3e8fcb-7327-45f4-815d-c7b43ed4db97] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:06:05.307725 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a845fdba-075a-498a-aeb1-552642abe642 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:05.308196 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a845fdba-075a-498a-aeb1-552642abe642 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:05.308630 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a845fdba-075a-498a-aeb1-552642abe642 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:05.309297 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a845fdba-075a-498a-aeb1-552642abe642 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:05.309747 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a845fdba-075a-498a-aeb1-552642abe642 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:05.310170 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a845fdba-075a-498a-aeb1-552642abe642 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:05.333122 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a845fdba-075a-498a-aeb1-552642abe642 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:05.333598 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a845fdba-075a-498a-aeb1-552642abe642 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:05.334026 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a845fdba-075a-498a-aeb1-552642abe642 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:05.358440 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.objects.instance [None req-a845fdba-075a-498a-aeb1-552642abe642 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Lazy-loading 'flavor' on Instance uuid 6b3e8fcb-7327-45f4-815d-c7b43ed4db97 {{(pid=138744) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 21:06:05.374783 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-a845fdba-075a-498a-aeb1-552642abe642 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] 10.222.0.18 "DELETE /compute/v2.1/servers/6b3e8fcb-7327-45f4-815d-c7b43ed4db97/tags/tempest-tag-1526890115" status: 204 len: 0 microversion: 2.26 time: 0.085176 Oct 22 21:06:05.375604 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1728/3497] 10.222.0.18 () {60 vars in 1364 bytes} [Sat Oct 22 21:06:05 2022] DELETE /compute/v2.1/servers/6b3e8fcb-7327-45f4-815d-c7b43ed4db97/tags/tempest-tag-1526890115 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 22 21:06:05.384040 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-8ade19df-e30c-4ab0-8ba1-243abe99f164 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Calling method '.version_select at 0x7fd39efbcdc0>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:05.392170 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8ade19df-e30c-4ab0-8ba1-243abe99f164 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:05.392673 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8ade19df-e30c-4ab0-8ba1-243abe99f164 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:05.393119 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8ade19df-e30c-4ab0-8ba1-243abe99f164 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:05.402898 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-8ade19df-e30c-4ab0-8ba1-243abe99f164 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] 10.222.0.18 "GET /compute/v2.1/servers/6b3e8fcb-7327-45f4-815d-c7b43ed4db97/tags" status: 200 len: 12 microversion: 2.26 time: 0.022907 Oct 22 21:06:05.403538 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1729/3498] 10.222.0.18 () {60 vars in 1292 bytes} [Sat Oct 22 21:06:05 2022] GET /compute/v2.1/servers/6b3e8fcb-7327-45f4-815d-c7b43ed4db97/tags => generated 12 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:06:05.410146 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-e454ff79-7283-44db-a2a1-49f8ffba9057 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcdfeb6c1cda4810b9fa70fdfd9a66c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c774a85b2c41c98486cf91b1253363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:06:05.413934 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-82cbcd67-a701-4f1a-b9c3-7f392514c5d7 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Calling method '.version_select at 0x7fd39ef2daf0>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:05.418497 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-e454ff79-7283-44db-a2a1-49f8ffba9057 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] 10.222.0.18 "GET /compute/v2.1/servers/e09b7865-0b24-4e50-a66a-342dd2e6e5e3" status: 200 len: 1318 microversion: 2.1 time: 0.161310 Oct 22 21:06:05.419062 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1770/3499] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:06:05 2022] GET /compute/v2.1/servers/e09b7865-0b24-4e50-a66a-342dd2e6e5e3 => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:06:05.421393 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-82cbcd67-a701-4f1a-b9c3-7f392514c5d7 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:05.421877 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-82cbcd67-a701-4f1a-b9c3-7f392514c5d7 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:05.422319 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-82cbcd67-a701-4f1a-b9c3-7f392514c5d7 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:05.422793 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-82cbcd67-a701-4f1a-b9c3-7f392514c5d7 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] [instance: 6b3e8fcb-7327-45f4-815d-c7b43ed4db97] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:06:05.428517 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-82cbcd67-a701-4f1a-b9c3-7f392514c5d7 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:05.428994 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-82cbcd67-a701-4f1a-b9c3-7f392514c5d7 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:05.429435 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-82cbcd67-a701-4f1a-b9c3-7f392514c5d7 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:05.430118 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-82cbcd67-a701-4f1a-b9c3-7f392514c5d7 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:05.430573 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-82cbcd67-a701-4f1a-b9c3-7f392514c5d7 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:05.431004 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-82cbcd67-a701-4f1a-b9c3-7f392514c5d7 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:05.444847 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell0:SELECT=4 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:06:05.453775 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-82cbcd67-a701-4f1a-b9c3-7f392514c5d7 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:05.454267 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-82cbcd67-a701-4f1a-b9c3-7f392514c5d7 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:05.454706 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-82cbcd67-a701-4f1a-b9c3-7f392514c5d7 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:05.465603 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.objects.instance [None req-82cbcd67-a701-4f1a-b9c3-7f392514c5d7 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Lazy-loading 'flavor' on Instance uuid 6b3e8fcb-7327-45f4-815d-c7b43ed4db97 {{(pid=138744) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 21:06:05.481373 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-82cbcd67-a701-4f1a-b9c3-7f392514c5d7 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] 10.222.0.18 "DELETE /compute/v2.1/servers/6b3e8fcb-7327-45f4-815d-c7b43ed4db97/tags" status: 204 len: 0 microversion: 2.26 time: 0.071582 Oct 22 21:06:05.481985 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1730/3500] 10.222.0.18 () {60 vars in 1295 bytes} [Sat Oct 22 21:06:05 2022] DELETE /compute/v2.1/servers/6b3e8fcb-7327-45f4-815d-c7b43ed4db97/tags => generated 0 bytes in 73 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 22 21:06:05.491630 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-c44e46f2-9e59-4787-aeea-3cb0651b65f3 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Calling method '.version_select at 0x7fd39eeebf70>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:05.501318 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c44e46f2-9e59-4787-aeea-3cb0651b65f3 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:05.501813 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c44e46f2-9e59-4787-aeea-3cb0651b65f3 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:05.502264 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c44e46f2-9e59-4787-aeea-3cb0651b65f3 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:05.502747 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-c44e46f2-9e59-4787-aeea-3cb0651b65f3 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] [instance: 6b3e8fcb-7327-45f4-815d-c7b43ed4db97] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:06:05.508399 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c44e46f2-9e59-4787-aeea-3cb0651b65f3 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:05.508877 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c44e46f2-9e59-4787-aeea-3cb0651b65f3 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:05.509324 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c44e46f2-9e59-4787-aeea-3cb0651b65f3 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:05.510049 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c44e46f2-9e59-4787-aeea-3cb0651b65f3 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:05.510504 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c44e46f2-9e59-4787-aeea-3cb0651b65f3 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:05.510942 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c44e46f2-9e59-4787-aeea-3cb0651b65f3 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:05.538417 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c44e46f2-9e59-4787-aeea-3cb0651b65f3 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:05.538916 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c44e46f2-9e59-4787-aeea-3cb0651b65f3 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:05.539457 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c44e46f2-9e59-4787-aeea-3cb0651b65f3 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:05.542001 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell0:SELECT=12 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:06:05.546451 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-bdad9a37-5ffd-458a-8a20-60e23f65d40c tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:05.547071 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-bdad9a37-5ffd-458a-8a20-60e23f65d40c tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] [instance: 23f77d1a-18db-4152-a25a-d02ac1726b08] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:06:05.548846 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c44e46f2-9e59-4787-aeea-3cb0651b65f3 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:05.549342 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c44e46f2-9e59-4787-aeea-3cb0651b65f3 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:05.550184 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c44e46f2-9e59-4787-aeea-3cb0651b65f3 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:05.553913 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bdad9a37-5ffd-458a-8a20-60e23f65d40c tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:05.554347 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bdad9a37-5ffd-458a-8a20-60e23f65d40c tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:05.554824 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bdad9a37-5ffd-458a-8a20-60e23f65d40c tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:05.555563 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bdad9a37-5ffd-458a-8a20-60e23f65d40c tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:05.556022 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bdad9a37-5ffd-458a-8a20-60e23f65d40c tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:05.556475 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bdad9a37-5ffd-458a-8a20-60e23f65d40c tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:05.561009 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=1,nova_cell1:INSERT=2,nova_cell1:DELETE=3,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:06:05.577283 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.objects.instance [None req-c44e46f2-9e59-4787-aeea-3cb0651b65f3 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Lazy-loading 'flavor' on Instance uuid 6b3e8fcb-7327-45f4-815d-c7b43ed4db97 {{(pid=138745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 21:06:05.593783 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-c44e46f2-9e59-4787-aeea-3cb0651b65f3 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] 10.222.0.18 "PUT /compute/v2.1/servers/6b3e8fcb-7327-45f4-815d-c7b43ed4db97/tags/tempest-tag-1787148756" status: 201 len: 0 microversion: 2.26 time: 0.106228 Oct 22 21:06:05.594638 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1771/3501] 10.222.0.18 () {62 vars in 1380 bytes} [Sat Oct 22 21:06:05 2022] PUT /compute/v2.1/servers/6b3e8fcb-7327-45f4-815d-c7b43ed4db97/tags/tempest-tag-1787148756 => generated 0 bytes in 108 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Oct 22 21:06:05.605021 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-42534988-2061-45bc-997b-c8a74e0e0b9c tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Calling method '.version_select at 0x7fd39fda5b80>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:05.614594 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-42534988-2061-45bc-997b-c8a74e0e0b9c tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:05.615073 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-42534988-2061-45bc-997b-c8a74e0e0b9c tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:05.615538 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-42534988-2061-45bc-997b-c8a74e0e0b9c tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:05.616012 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-42534988-2061-45bc-997b-c8a74e0e0b9c tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] [instance: 6b3e8fcb-7327-45f4-815d-c7b43ed4db97] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:06:05.621605 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-42534988-2061-45bc-997b-c8a74e0e0b9c tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:05.622070 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-42534988-2061-45bc-997b-c8a74e0e0b9c tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:05.622505 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-42534988-2061-45bc-997b-c8a74e0e0b9c tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:05.623192 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-42534988-2061-45bc-997b-c8a74e0e0b9c tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:05.623701 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-42534988-2061-45bc-997b-c8a74e0e0b9c tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:05.624118 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-42534988-2061-45bc-997b-c8a74e0e0b9c tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:05.651547 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-42534988-2061-45bc-997b-c8a74e0e0b9c tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:05.651547 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-42534988-2061-45bc-997b-c8a74e0e0b9c tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:05.651798 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-42534988-2061-45bc-997b-c8a74e0e0b9c tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:05.661452 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-42534988-2061-45bc-997b-c8a74e0e0b9c tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:05.661977 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-42534988-2061-45bc-997b-c8a74e0e0b9c tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:05.662422 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-42534988-2061-45bc-997b-c8a74e0e0b9c tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:05.687656 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.objects.instance [None req-42534988-2061-45bc-997b-c8a74e0e0b9c tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Lazy-loading 'flavor' on Instance uuid 6b3e8fcb-7327-45f4-815d-c7b43ed4db97 {{(pid=138745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 21:06:05.697471 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-bdad9a37-5ffd-458a-8a20-60e23f65d40c tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1b410a64e0415a96d30f5040361137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd7873d6db4e09bc9ab9a048a6b1ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:06:05.703392 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-42534988-2061-45bc-997b-c8a74e0e0b9c tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] 10.222.0.18 "PUT /compute/v2.1/servers/6b3e8fcb-7327-45f4-815d-c7b43ed4db97/tags/tempest-tag-438765225" status: 201 len: 0 microversion: 2.26 time: 0.102707 Oct 22 21:06:05.704216 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1772/3502] 10.222.0.18 () {62 vars in 1377 bytes} [Sat Oct 22 21:06:05 2022] PUT /compute/v2.1/servers/6b3e8fcb-7327-45f4-815d-c7b43ed4db97/tags/tempest-tag-438765225 => generated 0 bytes in 104 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Oct 22 21:06:05.710417 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-bdad9a37-5ffd-458a-8a20-60e23f65d40c tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] 10.222.0.18 "GET /compute/v2.1/servers/23f77d1a-18db-4152-a25a-d02ac1726b08" status: 200 len: 1499 microversion: 2.1 time: 0.169002 Oct 22 21:06:05.711029 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1731/3503] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:06:05 2022] GET /compute/v2.1/servers/23f77d1a-18db-4152-a25a-d02ac1726b08 => generated 1499 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:06:05.713699 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-dccf71ec-8ed1-444b-a62f-a85b6d86f2e7 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Calling method '.version_select at 0x7fd39eee4ca0>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:05.721832 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-dccf71ec-8ed1-444b-a62f-a85b6d86f2e7 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:05.722313 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-dccf71ec-8ed1-444b-a62f-a85b6d86f2e7 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:05.722748 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-dccf71ec-8ed1-444b-a62f-a85b6d86f2e7 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:05.723633 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-dccf71ec-8ed1-444b-a62f-a85b6d86f2e7 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] [instance: 6b3e8fcb-7327-45f4-815d-c7b43ed4db97] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:06:05.725150 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:06:05.731390 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-dccf71ec-8ed1-444b-a62f-a85b6d86f2e7 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:05.732062 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-dccf71ec-8ed1-444b-a62f-a85b6d86f2e7 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:05.732500 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-dccf71ec-8ed1-444b-a62f-a85b6d86f2e7 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:05.733186 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-dccf71ec-8ed1-444b-a62f-a85b6d86f2e7 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:05.733642 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-dccf71ec-8ed1-444b-a62f-a85b6d86f2e7 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:05.734067 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-dccf71ec-8ed1-444b-a62f-a85b6d86f2e7 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:05.758555 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-dccf71ec-8ed1-444b-a62f-a85b6d86f2e7 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:05.759076 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-dccf71ec-8ed1-444b-a62f-a85b6d86f2e7 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:05.759545 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-dccf71ec-8ed1-444b-a62f-a85b6d86f2e7 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:05.776073 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.objects.instance [None req-dccf71ec-8ed1-444b-a62f-a85b6d86f2e7 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Lazy-loading 'flavor' on Instance uuid 6b3e8fcb-7327-45f4-815d-c7b43ed4db97 {{(pid=138745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 21:06:05.795719 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-c3f0e8ea-da1d-478b-b222-2a214a8c69fa tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:05.796339 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-c3f0e8ea-da1d-478b-b222-2a214a8c69fa tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] [instance: 3fdb6d35-9428-4253-ad00-932310ecdf5d] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:06:05.799503 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-dccf71ec-8ed1-444b-a62f-a85b6d86f2e7 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] 10.222.0.18 "DELETE /compute/v2.1/servers/6b3e8fcb-7327-45f4-815d-c7b43ed4db97/tags" status: 204 len: 0 microversion: 2.26 time: 0.089995 Oct 22 21:06:05.800118 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1773/3504] 10.222.0.18 () {60 vars in 1295 bytes} [Sat Oct 22 21:06:05 2022] DELETE /compute/v2.1/servers/6b3e8fcb-7327-45f4-815d-c7b43ed4db97/tags => generated 0 bytes in 91 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 22 21:06:05.803064 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c3f0e8ea-da1d-478b-b222-2a214a8c69fa tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:05.803611 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c3f0e8ea-da1d-478b-b222-2a214a8c69fa tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:05.804101 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c3f0e8ea-da1d-478b-b222-2a214a8c69fa tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:05.804757 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c3f0e8ea-da1d-478b-b222-2a214a8c69fa tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:05.805214 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c3f0e8ea-da1d-478b-b222-2a214a8c69fa tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:05.805641 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c3f0e8ea-da1d-478b-b222-2a214a8c69fa tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:05.808307 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-693527be-49fe-45d2-b587-78260b8d6908 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Calling method '.version_select at 0x7fd39ef02550>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:05.815904 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-693527be-49fe-45d2-b587-78260b8d6908 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:05.816390 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-693527be-49fe-45d2-b587-78260b8d6908 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:05.817131 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-693527be-49fe-45d2-b587-78260b8d6908 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:05.826460 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-693527be-49fe-45d2-b587-78260b8d6908 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] 10.222.0.18 "GET /compute/v2.1/servers/6b3e8fcb-7327-45f4-815d-c7b43ed4db97/tags" status: 200 len: 12 microversion: 2.26 time: 0.021899 Oct 22 21:06:05.832263 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1774/3505] 10.222.0.18 () {60 vars in 1292 bytes} [Sat Oct 22 21:06:05 2022] GET /compute/v2.1/servers/6b3e8fcb-7327-45f4-815d-c7b43ed4db97/tags => generated 12 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:06:05.832263 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-2e4a6d51-3c1b-4fbb-b81c-a8791f727177 tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:05.832475 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-2e4a6d51-3c1b-4fbb-b81c-a8791f727177 tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] [instance: e24e9888-adfe-455c-b53e-da3bf5729d69] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:06:05.838211 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2e4a6d51-3c1b-4fbb-b81c-a8791f727177 tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:05.838697 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2e4a6d51-3c1b-4fbb-b81c-a8791f727177 tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:05.839138 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2e4a6d51-3c1b-4fbb-b81c-a8791f727177 tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:05.839867 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2e4a6d51-3c1b-4fbb-b81c-a8791f727177 tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:05.840325 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2e4a6d51-3c1b-4fbb-b81c-a8791f727177 tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:05.840749 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2e4a6d51-3c1b-4fbb-b81c-a8791f727177 tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:06.041689 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-c3f0e8ea-da1d-478b-b222-2a214a8c69fa tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879c85830a9f42088a4ebdf1e3cfb39b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b54f56cfbc814cccb533c65966f35a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:06:06.053266 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-c3f0e8ea-da1d-478b-b222-2a214a8c69fa tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] 10.222.0.18 "GET /compute/v2.1/servers/3fdb6d35-9428-4253-ad00-932310ecdf5d" status: 200 len: 1504 microversion: 2.1 time: 0.261160 Oct 22 21:06:06.053957 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1732/3506] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:06:05 2022] GET /compute/v2.1/servers/3fdb6d35-9428-4253-ad00-932310ecdf5d => generated 1504 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:06:06.059923 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-59d02302-017f-41a4-a6f3-c18aa8722ccb tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Calling method '.version_select at 0x7fd39ef29700>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:06.067952 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-2e4a6d51-3c1b-4fbb-b81c-a8791f727177 tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de9c0914dd6943bfa313ac456524cbba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af4c5251e7348c0ae5fc62468243a81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:06:06.071952 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-59d02302-017f-41a4-a6f3-c18aa8722ccb tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:06.072496 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-59d02302-017f-41a4-a6f3-c18aa8722ccb tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:06.072897 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-59d02302-017f-41a4-a6f3-c18aa8722ccb tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:06.073681 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-59d02302-017f-41a4-a6f3-c18aa8722ccb tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] [instance: 6b3e8fcb-7327-45f4-815d-c7b43ed4db97] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:06:06.073967 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-2e4a6d51-3c1b-4fbb-b81c-a8791f727177 tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] 10.222.0.18 "GET /compute/v2.1/servers/e24e9888-adfe-455c-b53e-da3bf5729d69" status: 200 len: 1325 microversion: 2.1 time: 0.245710 Oct 22 21:06:06.074785 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1775/3507] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:06:05 2022] GET /compute/v2.1/servers/e24e9888-adfe-455c-b53e-da3bf5729d69 => generated 1325 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:06:06.087896 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-59d02302-017f-41a4-a6f3-c18aa8722ccb tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:06.087896 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-59d02302-017f-41a4-a6f3-c18aa8722ccb tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:06.087896 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-59d02302-017f-41a4-a6f3-c18aa8722ccb tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:06.087896 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-59d02302-017f-41a4-a6f3-c18aa8722ccb tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:06.087896 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-59d02302-017f-41a4-a6f3-c18aa8722ccb tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:06.087896 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-59d02302-017f-41a4-a6f3-c18aa8722ccb tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:06.096924 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-af51b437-a925-4d18-a5bf-227d232859e5 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:06.098214 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-af51b437-a925-4d18-a5bf-227d232859e5 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] [instance: a26fa9bd-fad2-40a2-910e-2208fb769dcb] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:06:06.107978 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-af51b437-a925-4d18-a5bf-227d232859e5 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:06.108151 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-af51b437-a925-4d18-a5bf-227d232859e5 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:06.108790 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-af51b437-a925-4d18-a5bf-227d232859e5 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:06.109515 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-af51b437-a925-4d18-a5bf-227d232859e5 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:06.109971 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-af51b437-a925-4d18-a5bf-227d232859e5 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:06.110653 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-af51b437-a925-4d18-a5bf-227d232859e5 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:06.122763 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-59d02302-017f-41a4-a6f3-c18aa8722ccb tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:06.123257 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-59d02302-017f-41a4-a6f3-c18aa8722ccb tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:06.123726 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-59d02302-017f-41a4-a6f3-c18aa8722ccb tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:06.141976 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.objects.instance [None req-59d02302-017f-41a4-a6f3-c18aa8722ccb tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Lazy-loading 'flavor' on Instance uuid 6b3e8fcb-7327-45f4-815d-c7b43ed4db97 {{(pid=138744) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 21:06:06.172250 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-59d02302-017f-41a4-a6f3-c18aa8722ccb tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] 10.222.0.18 "DELETE /compute/v2.1/servers/6b3e8fcb-7327-45f4-815d-c7b43ed4db97/tags" status: 204 len: 0 microversion: 2.26 time: 0.117006 Oct 22 21:06:06.173311 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1733/3508] 10.222.0.18 () {60 vars in 1295 bytes} [Sat Oct 22 21:06:06 2022] DELETE /compute/v2.1/servers/6b3e8fcb-7327-45f4-815d-c7b43ed4db97/tags => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 22 21:06:06.182179 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-90fc5a87-e404-48d8-a8c3-5cc9074677b6 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:06.183085 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-90fc5a87-e404-48d8-a8c3-5cc9074677b6 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] [instance: 079f3144-b2dd-45f2-a22d-11cd315a31ed] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:06:06.190214 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-90fc5a87-e404-48d8-a8c3-5cc9074677b6 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:06.191322 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-90fc5a87-e404-48d8-a8c3-5cc9074677b6 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:06.192052 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-90fc5a87-e404-48d8-a8c3-5cc9074677b6 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:06.192877 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-90fc5a87-e404-48d8-a8c3-5cc9074677b6 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:06.193360 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-90fc5a87-e404-48d8-a8c3-5cc9074677b6 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:06.193803 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-90fc5a87-e404-48d8-a8c3-5cc9074677b6 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:06.357780 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-af51b437-a925-4d18-a5bf-227d232859e5 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a44ff8e7c14b94b1670f030085c43d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a26a2284f4424cbeaf63d504652546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:06:06.370144 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-af51b437-a925-4d18-a5bf-227d232859e5 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] 10.222.0.18 "GET /compute/v2.1/servers/a26fa9bd-fad2-40a2-910e-2208fb769dcb" status: 200 len: 1308 microversion: 2.1 time: 0.277020 Oct 22 21:06:06.383506 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1776/3509] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:06:06 2022] GET /compute/v2.1/servers/a26fa9bd-fad2-40a2-910e-2208fb769dcb => generated 1308 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:06:06.383506 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-52d28bbe-0ecb-4dc7-858b-e703dbf15904 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Calling method '.version_select at 0x7fd39ee69e50>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:06.394046 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-52d28bbe-0ecb-4dc7-858b-e703dbf15904 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:06.395012 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-52d28bbe-0ecb-4dc7-858b-e703dbf15904 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:06.395794 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-52d28bbe-0ecb-4dc7-858b-e703dbf15904 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:06.396470 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-52d28bbe-0ecb-4dc7-858b-e703dbf15904 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] [instance: 6b3e8fcb-7327-45f4-815d-c7b43ed4db97] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:06:06.405145 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-52d28bbe-0ecb-4dc7-858b-e703dbf15904 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:06.406787 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-52d28bbe-0ecb-4dc7-858b-e703dbf15904 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:06.407640 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-52d28bbe-0ecb-4dc7-858b-e703dbf15904 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:06.408645 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-52d28bbe-0ecb-4dc7-858b-e703dbf15904 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:06.408977 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-52d28bbe-0ecb-4dc7-858b-e703dbf15904 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:06.410251 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-52d28bbe-0ecb-4dc7-858b-e703dbf15904 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:06.450477 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-52d28bbe-0ecb-4dc7-858b-e703dbf15904 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:06.451118 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-52d28bbe-0ecb-4dc7-858b-e703dbf15904 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:06.451590 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-52d28bbe-0ecb-4dc7-858b-e703dbf15904 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:06.459446 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-90fc5a87-e404-48d8-a8c3-5cc9074677b6 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3820b31a424c3a9216a6ef91fcb285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a42c3ecf474883ac652fcc8c01c9f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:06:06.462428 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-52d28bbe-0ecb-4dc7-858b-e703dbf15904 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:06.463026 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-52d28bbe-0ecb-4dc7-858b-e703dbf15904 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:06.463928 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-52d28bbe-0ecb-4dc7-858b-e703dbf15904 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:06.471290 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-90fc5a87-e404-48d8-a8c3-5cc9074677b6 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] 10.222.0.18 "GET /compute/v2.1/servers/079f3144-b2dd-45f2-a22d-11cd315a31ed" status: 200 len: 1216 microversion: 2.1 time: 0.296146 Oct 22 21:06:06.475691 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1734/3510] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:06:06 2022] GET /compute/v2.1/servers/079f3144-b2dd-45f2-a22d-11cd315a31ed => generated 1216 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:06:06.481143 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-090f6b8d-d9a0-4a69-a895-c5edef3a35ed req-f35c9334-f296-4bb3-8a5e-4500f77e6f1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "079f3144-b2dd-45f2-a22d-11cd315a31ed", "name": "network-vif-plugged", "status": "completed", "tag": "1466d21d-d248-44a7-abb0-91471f031e6a"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:06:06.500381 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.objects.instance [None req-52d28bbe-0ecb-4dc7-858b-e703dbf15904 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Lazy-loading 'flavor' on Instance uuid 6b3e8fcb-7327-45f4-815d-c7b43ed4db97 {{(pid=138745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 21:06:06.502975 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-090f6b8d-d9a0-4a69-a895-c5edef3a35ed req-f35c9334-f296-4bb3-8a5e-4500f77e6f1e service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:06.503541 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-090f6b8d-d9a0-4a69-a895-c5edef3a35ed req-f35c9334-f296-4bb3-8a5e-4500f77e6f1e service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:06.504040 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-090f6b8d-d9a0-4a69-a895-c5edef3a35ed req-f35c9334-f296-4bb3-8a5e-4500f77e6f1e service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:06.517404 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-090f6b8d-d9a0-4a69-a895-c5edef3a35ed req-f35c9334-f296-4bb3-8a5e-4500f77e6f1e service nova] Creating event network-vif-plugged:1466d21d-d248-44a7-abb0-91471f031e6a for instance 079f3144-b2dd-45f2-a22d-11cd315a31ed on nch2-master-1 Oct 22 21:06:06.519801 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-52d28bbe-0ecb-4dc7-858b-e703dbf15904 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] 10.222.0.18 "PUT /compute/v2.1/servers/6b3e8fcb-7327-45f4-815d-c7b43ed4db97/tags/tempest-tag-478189207" status: 201 len: 0 microversion: 2.26 time: 0.147769 Oct 22 21:06:06.525844 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-090f6b8d-d9a0-4a69-a895-c5edef3a35ed req-f35c9334-f296-4bb3-8a5e-4500f77e6f1e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052390 Oct 22 21:06:06.526168 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1777/3511] 10.222.0.18 () {62 vars in 1377 bytes} [Sat Oct 22 21:06:06 2022] PUT /compute/v2.1/servers/6b3e8fcb-7327-45f4-815d-c7b43ed4db97/tags/tempest-tag-478189207 => generated 0 bytes in 155 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Oct 22 21:06:06.527171 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1735/3512] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:06:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:06:06.534647 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-cac6e815-c86d-43da-89b0-3e56105b40c9 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:06.534647 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-cac6e815-c86d-43da-89b0-3e56105b40c9 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] [instance: e09b7865-0b24-4e50-a66a-342dd2e6e5e3] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:06:06.534884 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-5a5c8418-f10e-46f1-ad85-64dc7a99ce35 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Calling method '.version_select at 0x7fd39eed5550>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:06.539539 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cac6e815-c86d-43da-89b0-3e56105b40c9 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:06.540045 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cac6e815-c86d-43da-89b0-3e56105b40c9 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:06.540975 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cac6e815-c86d-43da-89b0-3e56105b40c9 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:06.541694 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cac6e815-c86d-43da-89b0-3e56105b40c9 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:06.542239 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cac6e815-c86d-43da-89b0-3e56105b40c9 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:06.542566 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cac6e815-c86d-43da-89b0-3e56105b40c9 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:06.548817 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5a5c8418-f10e-46f1-ad85-64dc7a99ce35 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:06.549407 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5a5c8418-f10e-46f1-ad85-64dc7a99ce35 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:06.549860 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5a5c8418-f10e-46f1-ad85-64dc7a99ce35 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:06.550471 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-5a5c8418-f10e-46f1-ad85-64dc7a99ce35 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] [instance: 6b3e8fcb-7327-45f4-815d-c7b43ed4db97] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:06:06.567194 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5a5c8418-f10e-46f1-ad85-64dc7a99ce35 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:06.568048 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5a5c8418-f10e-46f1-ad85-64dc7a99ce35 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:06.568785 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5a5c8418-f10e-46f1-ad85-64dc7a99ce35 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:06.569688 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5a5c8418-f10e-46f1-ad85-64dc7a99ce35 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:06.570918 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5a5c8418-f10e-46f1-ad85-64dc7a99ce35 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:06.570918 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5a5c8418-f10e-46f1-ad85-64dc7a99ce35 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:06.611735 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5a5c8418-f10e-46f1-ad85-64dc7a99ce35 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:06.612890 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5a5c8418-f10e-46f1-ad85-64dc7a99ce35 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:06.613598 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5a5c8418-f10e-46f1-ad85-64dc7a99ce35 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:06.624132 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5a5c8418-f10e-46f1-ad85-64dc7a99ce35 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:06.624863 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5a5c8418-f10e-46f1-ad85-64dc7a99ce35 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:06.625657 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5a5c8418-f10e-46f1-ad85-64dc7a99ce35 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:06.656661 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.objects.instance [None req-5a5c8418-f10e-46f1-ad85-64dc7a99ce35 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Lazy-loading 'flavor' on Instance uuid 6b3e8fcb-7327-45f4-815d-c7b43ed4db97 {{(pid=138744) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 21:06:06.673983 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-5a5c8418-f10e-46f1-ad85-64dc7a99ce35 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] 10.222.0.18 "PUT /compute/v2.1/servers/6b3e8fcb-7327-45f4-815d-c7b43ed4db97/tags/tempest-tag-385608780" status: 201 len: 0 microversion: 2.26 time: 0.145577 Oct 22 21:06:06.674643 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1736/3513] 10.222.0.18 () {62 vars in 1377 bytes} [Sat Oct 22 21:06:06 2022] PUT /compute/v2.1/servers/6b3e8fcb-7327-45f4-815d-c7b43ed4db97/tags/tempest-tag-385608780 => generated 0 bytes in 147 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Oct 22 21:06:06.685289 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-abb8dacd-0ab5-4df6-86d3-695d8c48fb74 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Action: 'update_all', calling method: .version_select at 0x7fd39ef2d700>, body: {"tags": ["tempest-tag-1647800797", "tempest-tag-1899696861"]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:06:06.697486 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-abb8dacd-0ab5-4df6-86d3-695d8c48fb74 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:06.698136 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-abb8dacd-0ab5-4df6-86d3-695d8c48fb74 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:06.698583 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-abb8dacd-0ab5-4df6-86d3-695d8c48fb74 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:06.699242 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-abb8dacd-0ab5-4df6-86d3-695d8c48fb74 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] [instance: 6b3e8fcb-7327-45f4-815d-c7b43ed4db97] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:06:06.707015 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-abb8dacd-0ab5-4df6-86d3-695d8c48fb74 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:06.708954 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-abb8dacd-0ab5-4df6-86d3-695d8c48fb74 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:06.709586 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-abb8dacd-0ab5-4df6-86d3-695d8c48fb74 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:06.710674 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-abb8dacd-0ab5-4df6-86d3-695d8c48fb74 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:06.711141 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-abb8dacd-0ab5-4df6-86d3-695d8c48fb74 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:06.711765 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-abb8dacd-0ab5-4df6-86d3-695d8c48fb74 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:06.748317 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-abb8dacd-0ab5-4df6-86d3-695d8c48fb74 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:06.748967 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-abb8dacd-0ab5-4df6-86d3-695d8c48fb74 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:06.750256 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-abb8dacd-0ab5-4df6-86d3-695d8c48fb74 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:06.774956 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.objects.instance [None req-abb8dacd-0ab5-4df6-86d3-695d8c48fb74 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Lazy-loading 'flavor' on Instance uuid 6b3e8fcb-7327-45f4-815d-c7b43ed4db97 {{(pid=138744) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 21:06:06.781713 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-cac6e815-c86d-43da-89b0-3e56105b40c9 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcdfeb6c1cda4810b9fa70fdfd9a66c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c774a85b2c41c98486cf91b1253363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:06:06.790889 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-abb8dacd-0ab5-4df6-86d3-695d8c48fb74 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] 10.222.0.18 "PUT /compute/v2.1/servers/6b3e8fcb-7327-45f4-815d-c7b43ed4db97/tags" status: 200 len: 62 microversion: 2.26 time: 0.109762 Oct 22 21:06:06.796561 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1737/3514] 10.222.0.18 () {62 vars in 1312 bytes} [Sat Oct 22 21:06:06 2022] PUT /compute/v2.1/servers/6b3e8fcb-7327-45f4-815d-c7b43ed4db97/tags => generated 62 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:06:06.797143 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-cac6e815-c86d-43da-89b0-3e56105b40c9 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] 10.222.0.18 "GET /compute/v2.1/servers/e09b7865-0b24-4e50-a66a-342dd2e6e5e3" status: 200 len: 1318 microversion: 2.1 time: 0.265448 Oct 22 21:06:06.797143 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1778/3515] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:06:06 2022] GET /compute/v2.1/servers/e09b7865-0b24-4e50-a66a-342dd2e6e5e3 => generated 1318 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:06:06.797321 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-ac76f88a-b0fd-4146-8ce9-756c37ad50c8 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:06.797321 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-ac76f88a-b0fd-4146-8ce9-756c37ad50c8 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] [instance: 23f77d1a-18db-4152-a25a-d02ac1726b08] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:06:06.803458 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ac76f88a-b0fd-4146-8ce9-756c37ad50c8 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:06.803975 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ac76f88a-b0fd-4146-8ce9-756c37ad50c8 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:06.804354 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ac76f88a-b0fd-4146-8ce9-756c37ad50c8 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:06.805059 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ac76f88a-b0fd-4146-8ce9-756c37ad50c8 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:06.805514 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ac76f88a-b0fd-4146-8ce9-756c37ad50c8 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:06.805944 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ac76f88a-b0fd-4146-8ce9-756c37ad50c8 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:06.816116 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-1d31c947-989d-4f22-97ee-cf0033c1f7c1 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Calling method '.version_select at 0x7fd39ef775e0>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:06.825557 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1d31c947-989d-4f22-97ee-cf0033c1f7c1 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:06.826049 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1d31c947-989d-4f22-97ee-cf0033c1f7c1 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:06.826546 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1d31c947-989d-4f22-97ee-cf0033c1f7c1 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:06.836025 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell1:SELECT=90,nova_cell1:SAVEPOINT=3,nova_cell1:INSERT=3,nova_cell1:RELEASE=3,nova_cell1:DELETE=1 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:06:06.838030 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-1d31c947-989d-4f22-97ee-cf0033c1f7c1 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] 10.222.0.18 "GET /compute/v2.1/servers/6b3e8fcb-7327-45f4-815d-c7b43ed4db97/tags" status: 200 len: 62 microversion: 2.26 time: 0.026235 Oct 22 21:06:06.839128 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1779/3516] 10.222.0.18 () {60 vars in 1292 bytes} [Sat Oct 22 21:06:06 2022] GET /compute/v2.1/servers/6b3e8fcb-7327-45f4-815d-c7b43ed4db97/tags => generated 62 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:06:06.861618 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-23bcb982-57a6-43da-8706-3e567580718a tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Calling method '.version_select at 0x7fd39fc28820>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:06.874147 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-23bcb982-57a6-43da-8706-3e567580718a tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:06.874663 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-23bcb982-57a6-43da-8706-3e567580718a tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:06.875111 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-23bcb982-57a6-43da-8706-3e567580718a tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:06.875782 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-23bcb982-57a6-43da-8706-3e567580718a tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] [instance: 6b3e8fcb-7327-45f4-815d-c7b43ed4db97] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:06:06.883134 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-23bcb982-57a6-43da-8706-3e567580718a tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:06.883649 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-23bcb982-57a6-43da-8706-3e567580718a tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:06.884287 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-23bcb982-57a6-43da-8706-3e567580718a tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:06.885200 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-23bcb982-57a6-43da-8706-3e567580718a tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:06.885665 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-23bcb982-57a6-43da-8706-3e567580718a tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:06.886104 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-23bcb982-57a6-43da-8706-3e567580718a tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:06.912081 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-23bcb982-57a6-43da-8706-3e567580718a tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:06.912580 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-23bcb982-57a6-43da-8706-3e567580718a tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:06.913023 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-23bcb982-57a6-43da-8706-3e567580718a tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:06.930735 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.objects.instance [None req-23bcb982-57a6-43da-8706-3e567580718a tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Lazy-loading 'flavor' on Instance uuid 6b3e8fcb-7327-45f4-815d-c7b43ed4db97 {{(pid=138745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 21:06:06.948774 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-23bcb982-57a6-43da-8706-3e567580718a tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] 10.222.0.18 "DELETE /compute/v2.1/servers/6b3e8fcb-7327-45f4-815d-c7b43ed4db97/tags" status: 204 len: 0 microversion: 2.26 time: 0.091836 Oct 22 21:06:06.949826 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1780/3517] 10.222.0.18 () {60 vars in 1295 bytes} [Sat Oct 22 21:06:06 2022] DELETE /compute/v2.1/servers/6b3e8fcb-7327-45f4-815d-c7b43ed4db97/tags => generated 0 bytes in 94 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 22 21:06:06.955178 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-98f2a362-de93-437a-a4dd-e7e6db5d5e43 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6d8909c5-5b5d-4a3a-9a9e-3e90bbd551b8", "device": "/dev/sdb"}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:06:06.959695 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-98f2a362-de93-437a-a4dd-e7e6db5d5e43 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] [instance: 37978245-38aa-4524-8c69-126c4b180b00] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:06:06.968923 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-98f2a362-de93-437a-a4dd-e7e6db5d5e43 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:06.969713 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-98f2a362-de93-437a-a4dd-e7e6db5d5e43 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:06.970307 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-98f2a362-de93-437a-a4dd-e7e6db5d5e43 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:06.971188 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-98f2a362-de93-437a-a4dd-e7e6db5d5e43 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:06.971824 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-98f2a362-de93-437a-a4dd-e7e6db5d5e43 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:06.972402 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-98f2a362-de93-437a-a4dd-e7e6db5d5e43 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:07.024363 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-ac76f88a-b0fd-4146-8ce9-756c37ad50c8 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1b410a64e0415a96d30f5040361137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd7873d6db4e09bc9ab9a048a6b1ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:06:07.048537 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-ac76f88a-b0fd-4146-8ce9-756c37ad50c8 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] 10.222.0.18 "GET /compute/v2.1/servers/23f77d1a-18db-4152-a25a-d02ac1726b08" status: 200 len: 1499 microversion: 2.1 time: 0.250128 Oct 22 21:06:07.050454 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1738/3518] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:06:06 2022] GET /compute/v2.1/servers/23f77d1a-18db-4152-a25a-d02ac1726b08 => generated 1499 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:06:07.057064 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-56117386-e0f0-4ba6-86a7-22680f1acd24 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:07.057825 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-56117386-e0f0-4ba6-86a7-22680f1acd24 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] [instance: 6b3e8fcb-7327-45f4-815d-c7b43ed4db97] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:06:07.076481 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-56117386-e0f0-4ba6-86a7-22680f1acd24 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:07.078769 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-56117386-e0f0-4ba6-86a7-22680f1acd24 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:07.079396 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-56117386-e0f0-4ba6-86a7-22680f1acd24 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:07.081693 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-56117386-e0f0-4ba6-86a7-22680f1acd24 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:07.083494 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-56117386-e0f0-4ba6-86a7-22680f1acd24 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:07.084963 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-56117386-e0f0-4ba6-86a7-22680f1acd24 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:07.135131 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-56117386-e0f0-4ba6-86a7-22680f1acd24 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] [instance: 6b3e8fcb-7327-45f4-815d-c7b43ed4db97] Going to try to terminate instance {{(pid=138744) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 21:06:07.256574 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-56117386-e0f0-4ba6-86a7-22680f1acd24 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] 10.222.0.18 "DELETE /compute/v2.1/servers/6b3e8fcb-7327-45f4-815d-c7b43ed4db97" status: 204 len: 0 microversion: 2.26 time: 0.203994 Oct 22 21:06:07.263428 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1739/3519] 10.222.0.18 () {60 vars in 1280 bytes} [Sat Oct 22 21:06:07 2022] DELETE /compute/v2.1/servers/6b3e8fcb-7327-45f4-815d-c7b43ed4db97 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 22 21:06:07.276517 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-ed792fc1-1fd6-4928-afb7-59abdbbaba2b tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:07.278111 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-ed792fc1-1fd6-4928-afb7-59abdbbaba2b tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] [instance: 3fdb6d35-9428-4253-ad00-932310ecdf5d] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:06:07.285969 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ed792fc1-1fd6-4928-afb7-59abdbbaba2b tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:07.286465 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ed792fc1-1fd6-4928-afb7-59abdbbaba2b tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:07.286906 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ed792fc1-1fd6-4928-afb7-59abdbbaba2b tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:07.287636 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ed792fc1-1fd6-4928-afb7-59abdbbaba2b tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:07.288090 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ed792fc1-1fd6-4928-afb7-59abdbbaba2b tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:07.288550 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ed792fc1-1fd6-4928-afb7-59abdbbaba2b tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:07.319024 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-98f2a362-de93-437a-a4dd-e7e6db5d5e43 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] 10.222.0.18 "POST /compute/v2.1/servers/37978245-38aa-4524-8c69-126c4b180b00/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.367449 Oct 22 21:06:07.319669 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1781/3520] 10.222.0.18 () {60 vars in 1323 bytes} [Sat Oct 22 21:06:06 2022] POST /compute/v2.1/servers/37978245-38aa-4524-8c69-126c4b180b00/os-volume_attachments => generated 194 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:06:07.324972 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-52246d05-3616-45cd-a690-3d4227501cbb tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:07.325771 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-52246d05-3616-45cd-a690-3d4227501cbb tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] [instance: e24e9888-adfe-455c-b53e-da3bf5729d69] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:06:07.333249 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-52246d05-3616-45cd-a690-3d4227501cbb tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:07.333836 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-52246d05-3616-45cd-a690-3d4227501cbb tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:07.334188 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-52246d05-3616-45cd-a690-3d4227501cbb tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:07.334911 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-52246d05-3616-45cd-a690-3d4227501cbb tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:07.335435 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-52246d05-3616-45cd-a690-3d4227501cbb tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:07.335875 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-52246d05-3616-45cd-a690-3d4227501cbb tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:07.502475 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-ed792fc1-1fd6-4928-afb7-59abdbbaba2b tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879c85830a9f42088a4ebdf1e3cfb39b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b54f56cfbc814cccb533c65966f35a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:06:07.513191 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-ed792fc1-1fd6-4928-afb7-59abdbbaba2b tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] 10.222.0.18 "GET /compute/v2.1/servers/3fdb6d35-9428-4253-ad00-932310ecdf5d" status: 200 len: 1484 microversion: 2.1 time: 0.247741 Oct 22 21:06:07.514301 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1740/3521] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:06:07 2022] GET /compute/v2.1/servers/3fdb6d35-9428-4253-ad00-932310ecdf5d => generated 1484 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:06:07.519226 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-2ded7bd3-dfb7-4aba-87d2-3646b72dd2c3 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:07.520253 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-2ded7bd3-dfb7-4aba-87d2-3646b72dd2c3 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] [instance: 6b3e8fcb-7327-45f4-815d-c7b43ed4db97] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:06:07.528246 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2ded7bd3-dfb7-4aba-87d2-3646b72dd2c3 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:07.529247 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2ded7bd3-dfb7-4aba-87d2-3646b72dd2c3 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:07.529729 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2ded7bd3-dfb7-4aba-87d2-3646b72dd2c3 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:07.530621 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2ded7bd3-dfb7-4aba-87d2-3646b72dd2c3 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:07.531134 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2ded7bd3-dfb7-4aba-87d2-3646b72dd2c3 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:07.531554 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2ded7bd3-dfb7-4aba-87d2-3646b72dd2c3 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:07.549515 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-52246d05-3616-45cd-a690-3d4227501cbb tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de9c0914dd6943bfa313ac456524cbba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af4c5251e7348c0ae5fc62468243a81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:06:07.557644 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-52246d05-3616-45cd-a690-3d4227501cbb tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] 10.222.0.18 "GET /compute/v2.1/servers/e24e9888-adfe-455c-b53e-da3bf5729d69" status: 200 len: 1325 microversion: 2.1 time: 0.236803 Oct 22 21:06:07.558484 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1782/3522] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:06:07 2022] GET /compute/v2.1/servers/e24e9888-adfe-455c-b53e-da3bf5729d69 => generated 1325 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:06:07.563622 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-010f5325-8c10-41d5-8112-bc01b5340f2d tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:07.564265 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-010f5325-8c10-41d5-8112-bc01b5340f2d tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] [instance: a26fa9bd-fad2-40a2-910e-2208fb769dcb] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:06:07.573483 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-010f5325-8c10-41d5-8112-bc01b5340f2d tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:07.573976 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-010f5325-8c10-41d5-8112-bc01b5340f2d tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:07.574472 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-010f5325-8c10-41d5-8112-bc01b5340f2d tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:07.575190 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-010f5325-8c10-41d5-8112-bc01b5340f2d tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:07.575689 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-010f5325-8c10-41d5-8112-bc01b5340f2d tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:07.576180 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-010f5325-8c10-41d5-8112-bc01b5340f2d tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:07.733339 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-2ded7bd3-dfb7-4aba-87d2-3646b72dd2c3 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90ed2d6013024c278551a2c9cd961f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac03b202c142deb478e3328397d402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:06:07.742471 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-2ded7bd3-dfb7-4aba-87d2-3646b72dd2c3 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90ed2d6013024c278551a2c9cd961f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac03b202c142deb478e3328397d402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:06:07.743984 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-2ded7bd3-dfb7-4aba-87d2-3646b72dd2c3 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90ed2d6013024c278551a2c9cd961f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac03b202c142deb478e3328397d402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:06:07.745392 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-2ded7bd3-dfb7-4aba-87d2-3646b72dd2c3 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] 10.222.0.18 "GET /compute/v2.1/servers/6b3e8fcb-7327-45f4-815d-c7b43ed4db97" status: 200 len: 1552 microversion: 2.26 time: 0.230313 Oct 22 21:06:07.746149 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1741/3523] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:06:07 2022] GET /compute/v2.1/servers/6b3e8fcb-7327-45f4-815d-c7b43ed4db97 => generated 1552 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:06:07.750438 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-c49a7ae2-2479-4561-99fa-e461ee59047e tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:07.751042 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-c49a7ae2-2479-4561-99fa-e461ee59047e tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] [instance: 079f3144-b2dd-45f2-a22d-11cd315a31ed] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:06:07.759110 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-010f5325-8c10-41d5-8112-bc01b5340f2d tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a44ff8e7c14b94b1670f030085c43d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a26a2284f4424cbeaf63d504652546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:06:07.765427 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c49a7ae2-2479-4561-99fa-e461ee59047e tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:07.765932 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c49a7ae2-2479-4561-99fa-e461ee59047e tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:07.766495 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c49a7ae2-2479-4561-99fa-e461ee59047e tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:07.767217 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c49a7ae2-2479-4561-99fa-e461ee59047e tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:07.767450 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-010f5325-8c10-41d5-8112-bc01b5340f2d tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] 10.222.0.18 "GET /compute/v2.1/servers/a26fa9bd-fad2-40a2-910e-2208fb769dcb" status: 200 len: 1308 microversion: 2.1 time: 0.207884 Oct 22 21:06:07.767705 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c49a7ae2-2479-4561-99fa-e461ee59047e tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:07.768136 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c49a7ae2-2479-4561-99fa-e461ee59047e tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:07.779830 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1783/3524] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:06:07 2022] GET /compute/v2.1/servers/a26fa9bd-fad2-40a2-910e-2208fb769dcb => generated 1308 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:06:07.785494 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-af0c84bf-22f8-4b27-a480-1fb8a094a4ed tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:06:07.786218 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-af0c84bf-22f8-4b27-a480-1fb8a094a4ed tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] [instance: 3fdb6d35-9428-4253-ad00-932310ecdf5d] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:06:07.792958 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-af0c84bf-22f8-4b27-a480-1fb8a094a4ed tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:07.793460 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-af0c84bf-22f8-4b27-a480-1fb8a094a4ed tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:07.793877 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-af0c84bf-22f8-4b27-a480-1fb8a094a4ed tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:07.794756 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-af0c84bf-22f8-4b27-a480-1fb8a094a4ed tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:07.795225 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-af0c84bf-22f8-4b27-a480-1fb8a094a4ed tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:07.795683 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-af0c84bf-22f8-4b27-a480-1fb8a094a4ed tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:07.875887 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-af0c84bf-22f8-4b27-a480-1fb8a094a4ed tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] 10.222.0.18 "POST /compute/v2.1/servers/3fdb6d35-9428-4253-ad00-932310ecdf5d/action" status: 202 len: 0 microversion: 2.1 time: 0.094250 Oct 22 21:06:07.880622 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1784/3525] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 21:06:07 2022] POST /compute/v2.1/servers/3fdb6d35-9428-4253-ad00-932310ecdf5d/action => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 21:06:07.883739 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-bb83b53b-f192-4176-9a48-ddb0648d01dd tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:07.884455 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-bb83b53b-f192-4176-9a48-ddb0648d01dd tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] [instance: e09b7865-0b24-4e50-a66a-342dd2e6e5e3] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:06:07.890865 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bb83b53b-f192-4176-9a48-ddb0648d01dd tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:07.891853 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bb83b53b-f192-4176-9a48-ddb0648d01dd tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:07.891962 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bb83b53b-f192-4176-9a48-ddb0648d01dd tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:07.892671 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bb83b53b-f192-4176-9a48-ddb0648d01dd tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:07.893131 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bb83b53b-f192-4176-9a48-ddb0648d01dd tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:07.894040 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bb83b53b-f192-4176-9a48-ddb0648d01dd tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:07.912643 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-c49a7ae2-2479-4561-99fa-e461ee59047e tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3820b31a424c3a9216a6ef91fcb285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a42c3ecf474883ac652fcc8c01c9f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:06:07.921794 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-c49a7ae2-2479-4561-99fa-e461ee59047e tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] 10.222.0.18 "GET /compute/v2.1/servers/079f3144-b2dd-45f2-a22d-11cd315a31ed" status: 200 len: 1216 microversion: 2.1 time: 0.174654 Oct 22 21:06:07.937742 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1742/3526] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:06:07 2022] GET /compute/v2.1/servers/079f3144-b2dd-45f2-a22d-11cd315a31ed => generated 1216 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:06:07.937742 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-1ca3b370-fbaf-49ab-ac39-83f4b7b2af64 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:07.937742 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-1ca3b370-fbaf-49ab-ac39-83f4b7b2af64 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] [instance: 3fdb6d35-9428-4253-ad00-932310ecdf5d] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:06:07.946089 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1ca3b370-fbaf-49ab-ac39-83f4b7b2af64 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:07.946770 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1ca3b370-fbaf-49ab-ac39-83f4b7b2af64 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:07.947251 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1ca3b370-fbaf-49ab-ac39-83f4b7b2af64 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:07.948088 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1ca3b370-fbaf-49ab-ac39-83f4b7b2af64 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:07.948764 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1ca3b370-fbaf-49ab-ac39-83f4b7b2af64 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:07.949277 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1ca3b370-fbaf-49ab-ac39-83f4b7b2af64 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:07.991905 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:SELECT=92,nova_cell1:DELETE=2,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=3,nova_cell1:RELEASE=1,nova_cell1:UPDATE=1 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:06:08.122950 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-bb83b53b-f192-4176-9a48-ddb0648d01dd tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcdfeb6c1cda4810b9fa70fdfd9a66c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c774a85b2c41c98486cf91b1253363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:06:08.143955 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-bb83b53b-f192-4176-9a48-ddb0648d01dd tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] 10.222.0.18 "GET /compute/v2.1/servers/e09b7865-0b24-4e50-a66a-342dd2e6e5e3" status: 200 len: 1318 microversion: 2.1 time: 0.264907 Oct 22 21:06:08.154293 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1785/3527] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:06:07 2022] GET /compute/v2.1/servers/e09b7865-0b24-4e50-a66a-342dd2e6e5e3 => generated 1318 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:06:08.160446 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-626700df-e01e-4443-b0d8-3ebf4def24f6 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:08.161613 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-626700df-e01e-4443-b0d8-3ebf4def24f6 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] [instance: 23f77d1a-18db-4152-a25a-d02ac1726b08] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:06:08.170315 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-626700df-e01e-4443-b0d8-3ebf4def24f6 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:08.171220 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-626700df-e01e-4443-b0d8-3ebf4def24f6 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:08.171849 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-626700df-e01e-4443-b0d8-3ebf4def24f6 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:08.176540 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-1ca3b370-fbaf-49ab-ac39-83f4b7b2af64 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879c85830a9f42088a4ebdf1e3cfb39b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b54f56cfbc814cccb533c65966f35a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:06:08.185986 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-626700df-e01e-4443-b0d8-3ebf4def24f6 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:08.186839 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-626700df-e01e-4443-b0d8-3ebf4def24f6 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:08.187296 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-626700df-e01e-4443-b0d8-3ebf4def24f6 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:08.187677 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-1ca3b370-fbaf-49ab-ac39-83f4b7b2af64 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] 10.222.0.18 "GET /compute/v2.1/servers/3fdb6d35-9428-4253-ad00-932310ecdf5d" status: 200 len: 1492 microversion: 2.1 time: 0.254315 Oct 22 21:06:08.188269 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1743/3528] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:06:07 2022] GET /compute/v2.1/servers/3fdb6d35-9428-4253-ad00-932310ecdf5d => generated 1492 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:06:08.330264 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-626700df-e01e-4443-b0d8-3ebf4def24f6 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1b410a64e0415a96d30f5040361137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd7873d6db4e09bc9ab9a048a6b1ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:06:08.338554 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-626700df-e01e-4443-b0d8-3ebf4def24f6 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] 10.222.0.18 "GET /compute/v2.1/servers/23f77d1a-18db-4152-a25a-d02ac1726b08" status: 200 len: 1499 microversion: 2.1 time: 0.184571 Oct 22 21:06:08.339118 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1786/3529] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:06:08 2022] GET /compute/v2.1/servers/23f77d1a-18db-4152-a25a-d02ac1726b08 => generated 1499 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:06:08.548664 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-14c27d2d-9e3a-4655-ad33-9a77a30c0158 req-2396af80-9532-4c7b-a8c2-d3ef44153c11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e09b7865-0b24-4e50-a66a-342dd2e6e5e3", "name": "network-vif-plugged", "status": "completed", "tag": "4f8d8606-76d6-4351-9698-cdf245ae67e4"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:06:08.559003 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-14c27d2d-9e3a-4655-ad33-9a77a30c0158 req-2396af80-9532-4c7b-a8c2-d3ef44153c11 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:08.559508 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-14c27d2d-9e3a-4655-ad33-9a77a30c0158 req-2396af80-9532-4c7b-a8c2-d3ef44153c11 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:08.559945 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-14c27d2d-9e3a-4655-ad33-9a77a30c0158 req-2396af80-9532-4c7b-a8c2-d3ef44153c11 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:08.571472 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-14c27d2d-9e3a-4655-ad33-9a77a30c0158 req-2396af80-9532-4c7b-a8c2-d3ef44153c11 service nova] Creating event network-vif-plugged:4f8d8606-76d6-4351-9698-cdf245ae67e4 for instance e09b7865-0b24-4e50-a66a-342dd2e6e5e3 on nch2-master-1 Oct 22 21:06:08.576933 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-14c27d2d-9e3a-4655-ad33-9a77a30c0158 req-2396af80-9532-4c7b-a8c2-d3ef44153c11 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031931 Oct 22 21:06:08.577992 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1744/3530] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:06:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:06:08.582018 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-f9a34f60-95b4-4653-8afa-0d4f54d84175 tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:08.582689 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-f9a34f60-95b4-4653-8afa-0d4f54d84175 tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] [instance: e24e9888-adfe-455c-b53e-da3bf5729d69] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:06:08.589284 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f9a34f60-95b4-4653-8afa-0d4f54d84175 tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:08.589760 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f9a34f60-95b4-4653-8afa-0d4f54d84175 tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:08.590232 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f9a34f60-95b4-4653-8afa-0d4f54d84175 tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:08.590921 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f9a34f60-95b4-4653-8afa-0d4f54d84175 tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:08.591477 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f9a34f60-95b4-4653-8afa-0d4f54d84175 tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:08.591951 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f9a34f60-95b4-4653-8afa-0d4f54d84175 tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:08.772318 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-1c1424f8-6d90-4449-bb74-9436fb60f6e8 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:08.773033 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-1c1424f8-6d90-4449-bb74-9436fb60f6e8 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] [instance: 6b3e8fcb-7327-45f4-815d-c7b43ed4db97] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:06:08.783050 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1c1424f8-6d90-4449-bb74-9436fb60f6e8 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:08.785041 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1c1424f8-6d90-4449-bb74-9436fb60f6e8 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:08.785041 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1c1424f8-6d90-4449-bb74-9436fb60f6e8 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:08.785041 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1c1424f8-6d90-4449-bb74-9436fb60f6e8 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:08.791588 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1c1424f8-6d90-4449-bb74-9436fb60f6e8 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:08.792123 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1c1424f8-6d90-4449-bb74-9436fb60f6e8 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:08.797669 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-f9a34f60-95b4-4653-8afa-0d4f54d84175 tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de9c0914dd6943bfa313ac456524cbba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af4c5251e7348c0ae5fc62468243a81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:06:08.808248 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-f9a34f60-95b4-4653-8afa-0d4f54d84175 tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] 10.222.0.18 "GET /compute/v2.1/servers/e24e9888-adfe-455c-b53e-da3bf5729d69" status: 200 len: 1325 microversion: 2.1 time: 0.230095 Oct 22 21:06:08.808850 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1787/3531] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:06:08 2022] GET /compute/v2.1/servers/e24e9888-adfe-455c-b53e-da3bf5729d69 => generated 1325 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:06:08.814272 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-fe5150a3-9269-4a72-bdba-eea5e34a7a4e tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:08.814893 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-fe5150a3-9269-4a72-bdba-eea5e34a7a4e tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] [instance: a26fa9bd-fad2-40a2-910e-2208fb769dcb] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:06:08.823658 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fe5150a3-9269-4a72-bdba-eea5e34a7a4e tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:08.824530 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fe5150a3-9269-4a72-bdba-eea5e34a7a4e tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:08.825040 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fe5150a3-9269-4a72-bdba-eea5e34a7a4e tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:08.826036 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fe5150a3-9269-4a72-bdba-eea5e34a7a4e tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:08.826726 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fe5150a3-9269-4a72-bdba-eea5e34a7a4e tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:08.827024 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fe5150a3-9269-4a72-bdba-eea5e34a7a4e tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:08.987927 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-1c1424f8-6d90-4449-bb74-9436fb60f6e8 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90ed2d6013024c278551a2c9cd961f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac03b202c142deb478e3328397d402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:06:08.996797 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-1c1424f8-6d90-4449-bb74-9436fb60f6e8 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90ed2d6013024c278551a2c9cd961f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac03b202c142deb478e3328397d402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:06:08.998229 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-1c1424f8-6d90-4449-bb74-9436fb60f6e8 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90ed2d6013024c278551a2c9cd961f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac03b202c142deb478e3328397d402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:06:08.999435 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-1c1424f8-6d90-4449-bb74-9436fb60f6e8 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] 10.222.0.18 "GET /compute/v2.1/servers/6b3e8fcb-7327-45f4-815d-c7b43ed4db97" status: 200 len: 1552 microversion: 2.26 time: 0.231451 Oct 22 21:06:09.000152 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1745/3532] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:06:08 2022] GET /compute/v2.1/servers/6b3e8fcb-7327-45f4-815d-c7b43ed4db97 => generated 1552 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 22 21:06:09.004760 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-f100d07d-131a-4f76-a9d8-a1d6789278ca tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:09.005362 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-f100d07d-131a-4f76-a9d8-a1d6789278ca tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] [instance: 079f3144-b2dd-45f2-a22d-11cd315a31ed] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:06:09.011562 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f100d07d-131a-4f76-a9d8-a1d6789278ca tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:09.012227 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f100d07d-131a-4f76-a9d8-a1d6789278ca tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:09.012824 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f100d07d-131a-4f76-a9d8-a1d6789278ca tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:09.013666 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f100d07d-131a-4f76-a9d8-a1d6789278ca tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:09.014579 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f100d07d-131a-4f76-a9d8-a1d6789278ca tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:09.015139 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f100d07d-131a-4f76-a9d8-a1d6789278ca tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:09.023860 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-fe5150a3-9269-4a72-bdba-eea5e34a7a4e tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a44ff8e7c14b94b1670f030085c43d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a26a2284f4424cbeaf63d504652546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:06:09.031671 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-fe5150a3-9269-4a72-bdba-eea5e34a7a4e tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] 10.222.0.18 "GET /compute/v2.1/servers/a26fa9bd-fad2-40a2-910e-2208fb769dcb" status: 200 len: 1308 microversion: 2.1 time: 0.221764 Oct 22 21:06:09.032237 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1788/3533] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:06:08 2022] GET /compute/v2.1/servers/a26fa9bd-fad2-40a2-910e-2208fb769dcb => generated 1308 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:06:09.148271 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-f100d07d-131a-4f76-a9d8-a1d6789278ca tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3820b31a424c3a9216a6ef91fcb285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a42c3ecf474883ac652fcc8c01c9f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:06:09.156558 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-f100d07d-131a-4f76-a9d8-a1d6789278ca tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] 10.222.0.18 "GET /compute/v2.1/servers/079f3144-b2dd-45f2-a22d-11cd315a31ed" status: 200 len: 1404 microversion: 2.1 time: 0.155268 Oct 22 21:06:09.157099 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1746/3534] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:06:09 2022] GET /compute/v2.1/servers/079f3144-b2dd-45f2-a22d-11cd315a31ed => generated 1404 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:06:09.172837 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-0f2cefc3-4586-45c9-8651-96c22e2725ad tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:09.173557 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-0f2cefc3-4586-45c9-8651-96c22e2725ad tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] [instance: e09b7865-0b24-4e50-a66a-342dd2e6e5e3] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:06:09.180747 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0f2cefc3-4586-45c9-8651-96c22e2725ad tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:09.181241 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0f2cefc3-4586-45c9-8651-96c22e2725ad tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:09.181680 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0f2cefc3-4586-45c9-8651-96c22e2725ad tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:09.182385 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0f2cefc3-4586-45c9-8651-96c22e2725ad tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:09.182873 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0f2cefc3-4586-45c9-8651-96c22e2725ad tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:09.183300 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0f2cefc3-4586-45c9-8651-96c22e2725ad tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:09.184740 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-9cfa82e6-999c-4afb-a85b-a719de5b1c12 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:09.185391 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-9cfa82e6-999c-4afb-a85b-a719de5b1c12 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] [instance: 079f3144-b2dd-45f2-a22d-11cd315a31ed] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:06:09.192084 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9cfa82e6-999c-4afb-a85b-a719de5b1c12 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:09.192583 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9cfa82e6-999c-4afb-a85b-a719de5b1c12 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:09.193053 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9cfa82e6-999c-4afb-a85b-a719de5b1c12 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:09.193884 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9cfa82e6-999c-4afb-a85b-a719de5b1c12 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:09.194347 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9cfa82e6-999c-4afb-a85b-a719de5b1c12 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:09.194773 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9cfa82e6-999c-4afb-a85b-a719de5b1c12 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:09.694601 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-0f2cefc3-4586-45c9-8651-96c22e2725ad tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcdfeb6c1cda4810b9fa70fdfd9a66c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c774a85b2c41c98486cf91b1253363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:06:09.698984 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-9cfa82e6-999c-4afb-a85b-a719de5b1c12 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3820b31a424c3a9216a6ef91fcb285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a42c3ecf474883ac652fcc8c01c9f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:06:09.702715 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-0f2cefc3-4586-45c9-8651-96c22e2725ad tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] 10.222.0.18 "GET /compute/v2.1/servers/e09b7865-0b24-4e50-a66a-342dd2e6e5e3" status: 200 len: 1318 microversion: 2.1 time: 0.536127 Oct 22 21:06:09.703320 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1789/3535] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:06:09 2022] GET /compute/v2.1/servers/e09b7865-0b24-4e50-a66a-342dd2e6e5e3 => generated 1318 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:06:09.707620 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-9cfa82e6-999c-4afb-a85b-a719de5b1c12 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] 10.222.0.18 "GET /compute/v2.1/servers/079f3144-b2dd-45f2-a22d-11cd315a31ed" status: 200 len: 1404 microversion: 2.1 time: 0.526780 Oct 22 21:06:09.708146 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-1052013f-ee87-437f-b4d1-7c731cfea8a7 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:09.708777 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-1052013f-ee87-437f-b4d1-7c731cfea8a7 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] [instance: 3fdb6d35-9428-4253-ad00-932310ecdf5d] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:06:09.714906 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1052013f-ee87-437f-b4d1-7c731cfea8a7 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:09.715412 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1052013f-ee87-437f-b4d1-7c731cfea8a7 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:09.715594 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1747/3536] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:06:09 2022] GET /compute/v2.1/servers/079f3144-b2dd-45f2-a22d-11cd315a31ed => generated 1404 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:06:09.715862 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1052013f-ee87-437f-b4d1-7c731cfea8a7 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:09.716570 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1052013f-ee87-437f-b4d1-7c731cfea8a7 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:09.717032 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1052013f-ee87-437f-b4d1-7c731cfea8a7 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:09.717465 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1052013f-ee87-437f-b4d1-7c731cfea8a7 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:09.721795 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-4401a9d5-9c67-4873-816c-11bb1832b447 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:09.722789 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-4401a9d5-9c67-4873-816c-11bb1832b447 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] [instance: 23f77d1a-18db-4152-a25a-d02ac1726b08] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:06:09.729699 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4401a9d5-9c67-4873-816c-11bb1832b447 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:09.730193 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4401a9d5-9c67-4873-816c-11bb1832b447 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:09.730656 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4401a9d5-9c67-4873-816c-11bb1832b447 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:09.731422 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4401a9d5-9c67-4873-816c-11bb1832b447 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:09.731848 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4401a9d5-9c67-4873-816c-11bb1832b447 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:09.732278 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4401a9d5-9c67-4873-816c-11bb1832b447 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:09.919546 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-1052013f-ee87-437f-b4d1-7c731cfea8a7 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879c85830a9f42088a4ebdf1e3cfb39b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b54f56cfbc814cccb533c65966f35a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:06:09.922336 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-4401a9d5-9c67-4873-816c-11bb1832b447 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1b410a64e0415a96d30f5040361137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd7873d6db4e09bc9ab9a048a6b1ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:06:09.929434 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-1052013f-ee87-437f-b4d1-7c731cfea8a7 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] 10.222.0.18 "GET /compute/v2.1/servers/3fdb6d35-9428-4253-ad00-932310ecdf5d" status: 200 len: 1492 microversion: 2.1 time: 0.224957 Oct 22 21:06:09.930090 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1790/3537] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:06:09 2022] GET /compute/v2.1/servers/3fdb6d35-9428-4253-ad00-932310ecdf5d => generated 1492 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:06:09.933115 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-4401a9d5-9c67-4873-816c-11bb1832b447 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] 10.222.0.18 "GET /compute/v2.1/servers/23f77d1a-18db-4152-a25a-d02ac1726b08" status: 200 len: 1499 microversion: 2.1 time: 0.215590 Oct 22 21:06:09.935063 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-3104e477-1385-48ad-be79-967af7ffb96f tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-1984125068"}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:06:09.939620 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-3104e477-1385-48ad-be79-967af7ffb96f tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] [instance: 079f3144-b2dd-45f2-a22d-11cd315a31ed] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:06:09.944101 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1748/3538] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:06:09 2022] GET /compute/v2.1/servers/23f77d1a-18db-4152-a25a-d02ac1726b08 => generated 1499 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:06:09.947209 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3104e477-1385-48ad-be79-967af7ffb96f tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:09.947981 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3104e477-1385-48ad-be79-967af7ffb96f tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:09.948474 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3104e477-1385-48ad-be79-967af7ffb96f tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:09.949478 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3104e477-1385-48ad-be79-967af7ffb96f tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:09.949997 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3104e477-1385-48ad-be79-967af7ffb96f tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:09.950594 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3104e477-1385-48ad-be79-967af7ffb96f tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:09.956217 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-5a32bea5-690c-4389-9299-769ba33c2826 tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:09.956832 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-5a32bea5-690c-4389-9299-769ba33c2826 tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] [instance: e24e9888-adfe-455c-b53e-da3bf5729d69] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:06:09.963328 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5a32bea5-690c-4389-9299-769ba33c2826 tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:09.964320 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5a32bea5-690c-4389-9299-769ba33c2826 tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:09.964457 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5a32bea5-690c-4389-9299-769ba33c2826 tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:09.965122 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5a32bea5-690c-4389-9299-769ba33c2826 tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:09.965577 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5a32bea5-690c-4389-9299-769ba33c2826 tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:09.965999 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5a32bea5-690c-4389-9299-769ba33c2826 tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:10.057923 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.compute.api [None req-3104e477-1385-48ad-be79-967af7ffb96f tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] [instance: 079f3144-b2dd-45f2-a22d-11cd315a31ed] Attempting to quiesce instance before volume snapshot. Oct 22 21:06:10.109649 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-5a32bea5-690c-4389-9299-769ba33c2826 tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de9c0914dd6943bfa313ac456524cbba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af4c5251e7348c0ae5fc62468243a81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:06:10.117970 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-5a32bea5-690c-4389-9299-769ba33c2826 tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] 10.222.0.18 "GET /compute/v2.1/servers/e24e9888-adfe-455c-b53e-da3bf5729d69" status: 200 len: 1325 microversion: 2.1 time: 0.171073 Oct 22 21:06:10.118518 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1749/3539] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:06:09 2022] GET /compute/v2.1/servers/e24e9888-adfe-455c-b53e-da3bf5729d69 => generated 1325 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:06:10.123089 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-816a92bf-7ef0-4ea9-a05a-4909e38e17e7 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:10.123766 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-816a92bf-7ef0-4ea9-a05a-4909e38e17e7 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] [instance: 6b3e8fcb-7327-45f4-815d-c7b43ed4db97] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:06:10.129774 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-816a92bf-7ef0-4ea9-a05a-4909e38e17e7 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:10.130257 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-816a92bf-7ef0-4ea9-a05a-4909e38e17e7 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:10.130698 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-816a92bf-7ef0-4ea9-a05a-4909e38e17e7 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:10.131411 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-816a92bf-7ef0-4ea9-a05a-4909e38e17e7 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:10.131867 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-816a92bf-7ef0-4ea9-a05a-4909e38e17e7 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:10.132296 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-816a92bf-7ef0-4ea9-a05a-4909e38e17e7 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:10.274244 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-816a92bf-7ef0-4ea9-a05a-4909e38e17e7 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90ed2d6013024c278551a2c9cd961f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac03b202c142deb478e3328397d402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:06:10.283090 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-816a92bf-7ef0-4ea9-a05a-4909e38e17e7 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90ed2d6013024c278551a2c9cd961f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac03b202c142deb478e3328397d402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:06:10.284572 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-816a92bf-7ef0-4ea9-a05a-4909e38e17e7 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90ed2d6013024c278551a2c9cd961f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac03b202c142deb478e3328397d402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:06:10.285848 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-816a92bf-7ef0-4ea9-a05a-4909e38e17e7 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] 10.222.0.18 "GET /compute/v2.1/servers/6b3e8fcb-7327-45f4-815d-c7b43ed4db97" status: 200 len: 1552 microversion: 2.26 time: 0.166369 Oct 22 21:06:10.286414 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1750/3540] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:06:10 2022] GET /compute/v2.1/servers/6b3e8fcb-7327-45f4-815d-c7b43ed4db97 => generated 1552 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:06:10.290805 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-90ba34f9-d606-47cb-ad73-61e4bc443c77 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:10.291430 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-90ba34f9-d606-47cb-ad73-61e4bc443c77 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] [instance: a26fa9bd-fad2-40a2-910e-2208fb769dcb] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:06:10.297287 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-90ba34f9-d606-47cb-ad73-61e4bc443c77 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:10.297985 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-90ba34f9-d606-47cb-ad73-61e4bc443c77 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:10.298181 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-90ba34f9-d606-47cb-ad73-61e4bc443c77 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:10.298909 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-90ba34f9-d606-47cb-ad73-61e4bc443c77 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:10.299381 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-90ba34f9-d606-47cb-ad73-61e4bc443c77 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:10.299846 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-90ba34f9-d606-47cb-ad73-61e4bc443c77 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:10.435139 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.compute.api [None req-3104e477-1385-48ad-be79-967af7ffb96f tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] [instance: 079f3144-b2dd-45f2-a22d-11cd315a31ed] Skipping quiescing instance because the operation is not supported by the underlying compute driver. Oct 22 21:06:10.438368 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-90ba34f9-d606-47cb-ad73-61e4bc443c77 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a44ff8e7c14b94b1670f030085c43d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a26a2284f4424cbeaf63d504652546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:06:10.446988 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-90ba34f9-d606-47cb-ad73-61e4bc443c77 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] 10.222.0.18 "GET /compute/v2.1/servers/a26fa9bd-fad2-40a2-910e-2208fb769dcb" status: 200 len: 1308 microversion: 2.1 time: 0.159411 Oct 22 21:06:10.447696 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1751/3541] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:06:10 2022] GET /compute/v2.1/servers/a26fa9bd-fad2-40a2-910e-2208fb769dcb => generated 1308 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:06:10.519189 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-3104e477-1385-48ad-be79-967af7ffb96f tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] [instance: 079f3144-b2dd-45f2-a22d-11cd315a31ed] Creating snapshot from volume 12b295a8-421c-425d-b63f-f8315c51d5e6. {{(pid=138745) snapshot_instance /opt/stack/nova/nova/compute/api.py:3509}} Oct 22 21:06:10.599009 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-ce9ca8b7-0164-4688-9ea8-1491fe0de77b req-b45e638b-9095-467c-9ea0-d7c6dc623e88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a26fa9bd-fad2-40a2-910e-2208fb769dcb", "name": "network-vif-plugged", "status": "completed", "tag": "d2dc36e2-25aa-4eae-ac3a-801900c71b45"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:06:10.611945 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:06:10.618513 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-ce9ca8b7-0164-4688-9ea8-1491fe0de77b req-b45e638b-9095-467c-9ea0-d7c6dc623e88 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:10.619383 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-ce9ca8b7-0164-4688-9ea8-1491fe0de77b req-b45e638b-9095-467c-9ea0-d7c6dc623e88 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:10.619689 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-ce9ca8b7-0164-4688-9ea8-1491fe0de77b req-b45e638b-9095-467c-9ea0-d7c6dc623e88 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:10.659311 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-ce9ca8b7-0164-4688-9ea8-1491fe0de77b req-b45e638b-9095-467c-9ea0-d7c6dc623e88 service nova] Creating event network-vif-plugged:d2dc36e2-25aa-4eae-ac3a-801900c71b45 for instance a26fa9bd-fad2-40a2-910e-2208fb769dcb on nch1-master-1 Oct 22 21:06:10.665982 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-ce9ca8b7-0164-4688-9ea8-1491fe0de77b req-b45e638b-9095-467c-9ea0-d7c6dc623e88 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076741 Oct 22 21:06:10.666588 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1752/3542] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:06:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:06:10.728654 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-c0e60b12-53b7-4a2e-8e3b-e21da1d21eca tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:10.728654 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-c0e60b12-53b7-4a2e-8e3b-e21da1d21eca tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] [instance: e09b7865-0b24-4e50-a66a-342dd2e6e5e3] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:06:10.746982 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c0e60b12-53b7-4a2e-8e3b-e21da1d21eca tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:10.749101 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c0e60b12-53b7-4a2e-8e3b-e21da1d21eca tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:10.749656 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c0e60b12-53b7-4a2e-8e3b-e21da1d21eca tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:10.751259 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c0e60b12-53b7-4a2e-8e3b-e21da1d21eca tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:10.751943 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c0e60b12-53b7-4a2e-8e3b-e21da1d21eca tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:10.752448 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c0e60b12-53b7-4a2e-8e3b-e21da1d21eca tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:10.811473 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell1:SELECT=91,nova_cell1:DELETE=1,nova_cell1:UPDATE=4,nova_cell1:INSERT=4 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:06:11.394979 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-c0e60b12-53b7-4a2e-8e3b-e21da1d21eca tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcdfeb6c1cda4810b9fa70fdfd9a66c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c774a85b2c41c98486cf91b1253363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:06:11.405348 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-c0e60b12-53b7-4a2e-8e3b-e21da1d21eca tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] 10.222.0.18 "GET /compute/v2.1/servers/e09b7865-0b24-4e50-a66a-342dd2e6e5e3" status: 200 len: 1508 microversion: 2.1 time: 0.683350 Oct 22 21:06:11.420798 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1753/3543] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:06:10 2022] GET /compute/v2.1/servers/e09b7865-0b24-4e50-a66a-342dd2e6e5e3 => generated 1508 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:06:11.430389 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-37047458-db5d-4491-8a5c-ec9e1d213850 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:11.431219 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-37047458-db5d-4491-8a5c-ec9e1d213850 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] [instance: 3fdb6d35-9428-4253-ad00-932310ecdf5d] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:06:11.437500 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-37047458-db5d-4491-8a5c-ec9e1d213850 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:11.438311 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-37047458-db5d-4491-8a5c-ec9e1d213850 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:11.438917 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-37047458-db5d-4491-8a5c-ec9e1d213850 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:11.439866 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-37047458-db5d-4491-8a5c-ec9e1d213850 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:11.440597 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-37047458-db5d-4491-8a5c-ec9e1d213850 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:11.441165 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-37047458-db5d-4491-8a5c-ec9e1d213850 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:11.652042 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-3104e477-1385-48ad-be79-967af7ffb96f tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] 10.222.0.18 "POST /compute/v2.1/servers/079f3144-b2dd-45f2-a22d-11cd315a31ed/action" status: 202 len: 0 microversion: 2.1 time: 1.720823 Oct 22 21:06:11.654079 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1791/3544] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 21:06:09 2022] POST /compute/v2.1/servers/079f3144-b2dd-45f2-a22d-11cd315a31ed/action => generated 0 bytes in 1723 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 22 21:06:11.664904 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-38d4f161-4558-4852-864d-75982b3e5a56 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:11.665867 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-38d4f161-4558-4852-864d-75982b3e5a56 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] [instance: 23f77d1a-18db-4152-a25a-d02ac1726b08] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:06:11.673595 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-38d4f161-4558-4852-864d-75982b3e5a56 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:11.674660 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-38d4f161-4558-4852-864d-75982b3e5a56 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:11.675576 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-38d4f161-4558-4852-864d-75982b3e5a56 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:11.676659 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-38d4f161-4558-4852-864d-75982b3e5a56 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:11.677333 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-38d4f161-4558-4852-864d-75982b3e5a56 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:11.677978 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-38d4f161-4558-4852-864d-75982b3e5a56 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:11.726844 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-37047458-db5d-4491-8a5c-ec9e1d213850 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879c85830a9f42088a4ebdf1e3cfb39b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b54f56cfbc814cccb533c65966f35a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:06:11.741444 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-37047458-db5d-4491-8a5c-ec9e1d213850 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] 10.222.0.18 "GET /compute/v2.1/servers/3fdb6d35-9428-4253-ad00-932310ecdf5d" status: 200 len: 1492 microversion: 2.1 time: 0.318912 Oct 22 21:06:11.742082 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1754/3545] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:06:11 2022] GET /compute/v2.1/servers/3fdb6d35-9428-4253-ad00-932310ecdf5d => generated 1492 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:06:11.749045 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-d31b5eb1-cec1-4c2f-80ae-ccde67047e73 tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:11.750682 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-d31b5eb1-cec1-4c2f-80ae-ccde67047e73 tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] [instance: e24e9888-adfe-455c-b53e-da3bf5729d69] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:06:11.761249 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d31b5eb1-cec1-4c2f-80ae-ccde67047e73 tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:11.762248 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d31b5eb1-cec1-4c2f-80ae-ccde67047e73 tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:11.762775 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d31b5eb1-cec1-4c2f-80ae-ccde67047e73 tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:11.767222 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d31b5eb1-cec1-4c2f-80ae-ccde67047e73 tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:11.767222 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d31b5eb1-cec1-4c2f-80ae-ccde67047e73 tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:11.767222 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d31b5eb1-cec1-4c2f-80ae-ccde67047e73 tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:11.863180 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-38d4f161-4558-4852-864d-75982b3e5a56 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1b410a64e0415a96d30f5040361137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd7873d6db4e09bc9ab9a048a6b1ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:06:11.872688 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-38d4f161-4558-4852-864d-75982b3e5a56 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] 10.222.0.18 "GET /compute/v2.1/servers/23f77d1a-18db-4152-a25a-d02ac1726b08" status: 200 len: 1457 microversion: 2.1 time: 0.216693 Oct 22 21:06:11.873824 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1792/3546] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:06:11 2022] GET /compute/v2.1/servers/23f77d1a-18db-4152-a25a-d02ac1726b08 => generated 1457 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:06:11.880988 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-439edf50-5c2f-45c1-b40f-6645d31ce6dc tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:11.882222 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-439edf50-5c2f-45c1-b40f-6645d31ce6dc tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] [instance: 6b3e8fcb-7327-45f4-815d-c7b43ed4db97] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:06:11.889226 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-439edf50-5c2f-45c1-b40f-6645d31ce6dc tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:11.889888 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-439edf50-5c2f-45c1-b40f-6645d31ce6dc tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:11.890467 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-439edf50-5c2f-45c1-b40f-6645d31ce6dc tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:11.891317 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-439edf50-5c2f-45c1-b40f-6645d31ce6dc tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:11.891892 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-439edf50-5c2f-45c1-b40f-6645d31ce6dc tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:11.892409 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-439edf50-5c2f-45c1-b40f-6645d31ce6dc tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:12.268311 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-d31b5eb1-cec1-4c2f-80ae-ccde67047e73 tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de9c0914dd6943bfa313ac456524cbba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af4c5251e7348c0ae5fc62468243a81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:06:12.279299 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-439edf50-5c2f-45c1-b40f-6645d31ce6dc tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90ed2d6013024c278551a2c9cd961f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac03b202c142deb478e3328397d402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:06:12.287908 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-d31b5eb1-cec1-4c2f-80ae-ccde67047e73 tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] 10.222.0.18 "GET /compute/v2.1/servers/e24e9888-adfe-455c-b53e-da3bf5729d69" status: 200 len: 1325 microversion: 2.1 time: 0.541577 Oct 22 21:06:12.290260 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1755/3547] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:06:11 2022] GET /compute/v2.1/servers/e24e9888-adfe-455c-b53e-da3bf5729d69 => generated 1325 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:06:12.292428 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-439edf50-5c2f-45c1-b40f-6645d31ce6dc tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90ed2d6013024c278551a2c9cd961f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac03b202c142deb478e3328397d402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:06:12.303945 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-439edf50-5c2f-45c1-b40f-6645d31ce6dc tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90ed2d6013024c278551a2c9cd961f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac03b202c142deb478e3328397d402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:06:12.305504 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-439edf50-5c2f-45c1-b40f-6645d31ce6dc tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] 10.222.0.18 "GET /compute/v2.1/servers/6b3e8fcb-7327-45f4-815d-c7b43ed4db97" status: 200 len: 1552 microversion: 2.26 time: 0.430560 Oct 22 21:06:12.306257 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1793/3548] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:06:11 2022] GET /compute/v2.1/servers/6b3e8fcb-7327-45f4-815d-c7b43ed4db97 => generated 1552 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:06:12.311147 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-d7f8109c-73b1-4fe4-93e4-8a474353b703 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:12.312008 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-d7f8109c-73b1-4fe4-93e4-8a474353b703 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] [instance: a26fa9bd-fad2-40a2-910e-2208fb769dcb] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:06:12.326077 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-84ad74f2-8037-4795-90de-326ef2e42af8 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:12.327761 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-84ad74f2-8037-4795-90de-326ef2e42af8 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] [instance: e09b7865-0b24-4e50-a66a-342dd2e6e5e3] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:06:12.334867 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-84ad74f2-8037-4795-90de-326ef2e42af8 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:12.335636 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-84ad74f2-8037-4795-90de-326ef2e42af8 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:12.336312 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-84ad74f2-8037-4795-90de-326ef2e42af8 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:12.337249 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-84ad74f2-8037-4795-90de-326ef2e42af8 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:12.337908 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-84ad74f2-8037-4795-90de-326ef2e42af8 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:12.338544 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-84ad74f2-8037-4795-90de-326ef2e42af8 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:12.341669 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d7f8109c-73b1-4fe4-93e4-8a474353b703 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:12.342560 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d7f8109c-73b1-4fe4-93e4-8a474353b703 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:12.350952 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d7f8109c-73b1-4fe4-93e4-8a474353b703 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:12.352245 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d7f8109c-73b1-4fe4-93e4-8a474353b703 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:12.352968 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d7f8109c-73b1-4fe4-93e4-8a474353b703 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:12.353594 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d7f8109c-73b1-4fe4-93e4-8a474353b703 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:12.675224 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-84ad74f2-8037-4795-90de-326ef2e42af8 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcdfeb6c1cda4810b9fa70fdfd9a66c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c774a85b2c41c98486cf91b1253363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:06:12.680541 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-d7f8109c-73b1-4fe4-93e4-8a474353b703 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a44ff8e7c14b94b1670f030085c43d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a26a2284f4424cbeaf63d504652546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:06:12.688239 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-84ad74f2-8037-4795-90de-326ef2e42af8 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] 10.222.0.18 "GET /compute/v2.1/servers/e09b7865-0b24-4e50-a66a-342dd2e6e5e3" status: 200 len: 1508 microversion: 2.1 time: 0.390549 Oct 22 21:06:12.691581 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-d7f8109c-73b1-4fe4-93e4-8a474353b703 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] 10.222.0.18 "GET /compute/v2.1/servers/a26fa9bd-fad2-40a2-910e-2208fb769dcb" status: 200 len: 1308 microversion: 2.1 time: 0.383829 Oct 22 21:06:12.692054 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1794/3549] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:06:12 2022] GET /compute/v2.1/servers/a26fa9bd-fad2-40a2-910e-2208fb769dcb => generated 1308 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:06:12.703439 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1756/3550] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:06:12 2022] GET /compute/v2.1/servers/e09b7865-0b24-4e50-a66a-342dd2e6e5e3 => generated 1508 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:06:12.703439 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-bd1998cc-f7d0-4eac-876b-a20656d53776 req-b6aaa8d9-fbbd-42bb-863b-ebc800a94acf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b3e8fcb-7327-45f4-815d-c7b43ed4db97", "name": "network-vif-deleted", "tag": "d3b8f44f-8ce6-4fdb-ae8c-dbc9b73422f1"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:06:12.710924 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-65c540e2-cd4b-40b3-831b-aae68cbf5c68 req-f4b45b99-b8c8-4b36-b5b8-5838f4092b22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23f77d1a-18db-4152-a25a-d02ac1726b08", "name": "network-vif-deleted", "tag": "28fa3d1c-0002-432e-b75f-b946acccd7de"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:06:12.718874 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-bd1998cc-f7d0-4eac-876b-a20656d53776 req-b6aaa8d9-fbbd-42bb-863b-ebc800a94acf service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:12.719605 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-bd1998cc-f7d0-4eac-876b-a20656d53776 req-b6aaa8d9-fbbd-42bb-863b-ebc800a94acf service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:12.720114 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-bd1998cc-f7d0-4eac-876b-a20656d53776 req-b6aaa8d9-fbbd-42bb-863b-ebc800a94acf service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:12.721551 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-65c540e2-cd4b-40b3-831b-aae68cbf5c68 req-f4b45b99-b8c8-4b36-b5b8-5838f4092b22 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:12.722193 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-65c540e2-cd4b-40b3-831b-aae68cbf5c68 req-f4b45b99-b8c8-4b36-b5b8-5838f4092b22 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:12.722684 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-65c540e2-cd4b-40b3-831b-aae68cbf5c68 req-f4b45b99-b8c8-4b36-b5b8-5838f4092b22 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:12.734035 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-bd1998cc-f7d0-4eac-876b-a20656d53776 req-b6aaa8d9-fbbd-42bb-863b-ebc800a94acf service nova] Creating event network-vif-deleted:d3b8f44f-8ce6-4fdb-ae8c-dbc9b73422f1 for instance 6b3e8fcb-7327-45f4-815d-c7b43ed4db97 on nch1-master-1 Oct 22 21:06:12.739777 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-65c540e2-cd4b-40b3-831b-aae68cbf5c68 req-f4b45b99-b8c8-4b36-b5b8-5838f4092b22 service nova] Creating event network-vif-deleted:28fa3d1c-0002-432e-b75f-b946acccd7de for instance 23f77d1a-18db-4152-a25a-d02ac1726b08 on nch1-master-1 Oct 22 21:06:12.745334 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-bd1998cc-f7d0-4eac-876b-a20656d53776 req-b6aaa8d9-fbbd-42bb-863b-ebc800a94acf service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048619 Oct 22 21:06:12.745711 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-65c540e2-cd4b-40b3-831b-aae68cbf5c68 req-f4b45b99-b8c8-4b36-b5b8-5838f4092b22 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039389 Oct 22 21:06:12.746005 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1757/3551] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:06:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:06:12.749552 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1795/3552] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:06:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:06:12.754221 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-84ab3c48-d4a0-49fe-b462-0d1f8ec4e1f5 req-8ade44d9-27c4-4229-847c-f0a59a2a21c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23f77d1a-18db-4152-a25a-d02ac1726b08", "name": "network-vif-unplugged", "status": "completed", "tag": "28fa3d1c-0002-432e-b75f-b946acccd7de"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:06:12.756533 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-bdf105dd-3a69-423c-9dd7-118bb7cd4e3b tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "085e4478-6edc-4a69-8e08-f9831713eb65", "OS-DCF:diskConfig": "AUTO"}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:06:12.761538 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-bdf105dd-3a69-423c-9dd7-118bb7cd4e3b tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] [instance: e09b7865-0b24-4e50-a66a-342dd2e6e5e3] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:06:12.766406 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-84ab3c48-d4a0-49fe-b462-0d1f8ec4e1f5 req-8ade44d9-27c4-4229-847c-f0a59a2a21c5 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:12.766903 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-84ab3c48-d4a0-49fe-b462-0d1f8ec4e1f5 req-8ade44d9-27c4-4229-847c-f0a59a2a21c5 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:12.767494 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-84ab3c48-d4a0-49fe-b462-0d1f8ec4e1f5 req-8ade44d9-27c4-4229-847c-f0a59a2a21c5 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:12.768529 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bdf105dd-3a69-423c-9dd7-118bb7cd4e3b tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:12.769081 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bdf105dd-3a69-423c-9dd7-118bb7cd4e3b tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:12.769737 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bdf105dd-3a69-423c-9dd7-118bb7cd4e3b tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:12.770644 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bdf105dd-3a69-423c-9dd7-118bb7cd4e3b tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:12.771117 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bdf105dd-3a69-423c-9dd7-118bb7cd4e3b tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:12.772409 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bdf105dd-3a69-423c-9dd7-118bb7cd4e3b tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:12.779595 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-84ab3c48-d4a0-49fe-b462-0d1f8ec4e1f5 req-8ade44d9-27c4-4229-847c-f0a59a2a21c5 service nova] Creating event network-vif-unplugged:28fa3d1c-0002-432e-b75f-b946acccd7de for instance 23f77d1a-18db-4152-a25a-d02ac1726b08 on nch1-master-1 Oct 22 21:06:12.784706 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-84ab3c48-d4a0-49fe-b462-0d1f8ec4e1f5 req-8ade44d9-27c4-4229-847c-f0a59a2a21c5 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037392 Oct 22 21:06:12.785825 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1758/3553] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:06:12 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:06:12.791103 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-9e739ac5-5514-4f5e-a4b4-fa2ce3c0ed7d tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:12.792047 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-9e739ac5-5514-4f5e-a4b4-fa2ce3c0ed7d tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] [instance: 3fdb6d35-9428-4253-ad00-932310ecdf5d] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:06:12.798668 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9e739ac5-5514-4f5e-a4b4-fa2ce3c0ed7d tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:12.799805 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9e739ac5-5514-4f5e-a4b4-fa2ce3c0ed7d tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:12.800260 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9e739ac5-5514-4f5e-a4b4-fa2ce3c0ed7d tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:12.801055 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9e739ac5-5514-4f5e-a4b4-fa2ce3c0ed7d tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:12.801672 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9e739ac5-5514-4f5e-a4b4-fa2ce3c0ed7d tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:12.802255 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9e739ac5-5514-4f5e-a4b4-fa2ce3c0ed7d tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:12.880970 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-bdf105dd-3a69-423c-9dd7-118bb7cd4e3b tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Flavor limits 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 21:06:12.881647 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-bdf105dd-3a69-423c-9dd7-118bb7cd4e3b tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Image limits 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 21:06:12.882284 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-bdf105dd-3a69-423c-9dd7-118bb7cd4e3b tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Flavor pref 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 21:06:12.882955 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-bdf105dd-3a69-423c-9dd7-118bb7cd4e3b tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Image pref 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 21:06:12.883517 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-bdf105dd-3a69-423c-9dd7-118bb7cd4e3b tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 21:06:12.952876 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-bdf105dd-3a69-423c-9dd7-118bb7cd4e3b tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] [instance: e09b7865-0b24-4e50-a66a-342dd2e6e5e3] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:06:12.960161 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bdf105dd-3a69-423c-9dd7-118bb7cd4e3b tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:12.960945 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bdf105dd-3a69-423c-9dd7-118bb7cd4e3b tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:12.961489 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bdf105dd-3a69-423c-9dd7-118bb7cd4e3b tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:12.962420 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bdf105dd-3a69-423c-9dd7-118bb7cd4e3b tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:12.962990 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bdf105dd-3a69-423c-9dd7-118bb7cd4e3b tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:12.963588 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bdf105dd-3a69-423c-9dd7-118bb7cd4e3b tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:12.997901 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-bdf105dd-3a69-423c-9dd7-118bb7cd4e3b tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] 10.222.0.18 "POST /compute/v2.1/servers/e09b7865-0b24-4e50-a66a-342dd2e6e5e3/action" status: 202 len: 1110 microversion: 2.1 time: 0.246312 Oct 22 21:06:12.999247 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1796/3554] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 21:06:12 2022] POST /compute/v2.1/servers/e09b7865-0b24-4e50-a66a-342dd2e6e5e3/action => generated 1110 bytes in 249 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 22 21:06:13.009084 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-eab0a399-b5f5-4645-acaf-50f159341288 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:13.009773 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-eab0a399-b5f5-4645-acaf-50f159341288 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] [instance: 23f77d1a-18db-4152-a25a-d02ac1726b08] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:06:13.020272 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-eab0a399-b5f5-4645-acaf-50f159341288 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:13.021427 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-eab0a399-b5f5-4645-acaf-50f159341288 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:13.021989 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-eab0a399-b5f5-4645-acaf-50f159341288 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:13.023605 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-eab0a399-b5f5-4645-acaf-50f159341288 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:13.023748 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-9e739ac5-5514-4f5e-a4b4-fa2ce3c0ed7d tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879c85830a9f42088a4ebdf1e3cfb39b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b54f56cfbc814cccb533c65966f35a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:06:13.024327 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-eab0a399-b5f5-4645-acaf-50f159341288 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:13.024986 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-eab0a399-b5f5-4645-acaf-50f159341288 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:13.033871 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-9e739ac5-5514-4f5e-a4b4-fa2ce3c0ed7d tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] 10.222.0.18 "GET /compute/v2.1/servers/3fdb6d35-9428-4253-ad00-932310ecdf5d" status: 200 len: 1492 microversion: 2.1 time: 0.246593 Oct 22 21:06:13.034474 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1759/3555] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:06:12 2022] GET /compute/v2.1/servers/3fdb6d35-9428-4253-ad00-932310ecdf5d => generated 1492 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:06:13.039359 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-aa20c0ec-21a1-4963-a7ee-1158cc02b78a tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-1421116197", "imageRef": "7143ab36-ff46-4a91-9851-f975a5f7d417", "flavorRef": "452", "networks": [{"uuid": "7fc34993-7108-4fcb-8386-9f829c6044b7"}]}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:06:13.094158 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-eab0a399-b5f5-4645-acaf-50f159341288 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:13.094941 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-eab0a399-b5f5-4645-acaf-50f159341288 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:13.095421 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-eab0a399-b5f5-4645-acaf-50f159341288 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:13.096039 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.objects.instance [None req-eab0a399-b5f5-4645-acaf-50f159341288 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lazy-loading 'fault' on Instance uuid 23f77d1a-18db-4152-a25a-d02ac1726b08 {{(pid=138745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 21:06:13.144341 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.network.neutron [None req-aa20c0ec-21a1-4963-a7ee-1158cc02b78a tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] validate_networks() for [('7fc34993-7108-4fcb-8386-9f829c6044b7', None, None, None, None, None)] {{(pid=138744) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 21:06:13.147513 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-eab0a399-b5f5-4645-acaf-50f159341288 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1b410a64e0415a96d30f5040361137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd7873d6db4e09bc9ab9a048a6b1ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:06:13.160549 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-eab0a399-b5f5-4645-acaf-50f159341288 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] 10.222.0.18 "GET /compute/v2.1/servers/23f77d1a-18db-4152-a25a-d02ac1726b08" status: 200 len: 1305 microversion: 2.1 time: 0.155632 Oct 22 21:06:13.161570 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1797/3556] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:06:12 2022] GET /compute/v2.1/servers/23f77d1a-18db-4152-a25a-d02ac1726b08 => generated 1305 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:06:13.166887 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-28ad92cc-69b4-4bea-aedc-cc4ccea7d36a tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:13.168795 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-28ad92cc-69b4-4bea-aedc-cc4ccea7d36a tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] [instance: e09b7865-0b24-4e50-a66a-342dd2e6e5e3] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:06:13.179414 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-28ad92cc-69b4-4bea-aedc-cc4ccea7d36a tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:13.180083 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-28ad92cc-69b4-4bea-aedc-cc4ccea7d36a tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:13.180608 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-28ad92cc-69b4-4bea-aedc-cc4ccea7d36a tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:13.181597 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-28ad92cc-69b4-4bea-aedc-cc4ccea7d36a tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:13.182276 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-28ad92cc-69b4-4bea-aedc-cc4ccea7d36a tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:13.182797 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-28ad92cc-69b4-4bea-aedc-cc4ccea7d36a tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:13.443136 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-28ad92cc-69b4-4bea-aedc-cc4ccea7d36a tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcdfeb6c1cda4810b9fa70fdfd9a66c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c774a85b2c41c98486cf91b1253363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:06:13.451772 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-28ad92cc-69b4-4bea-aedc-cc4ccea7d36a tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] 10.222.0.18 "GET /compute/v2.1/servers/e09b7865-0b24-4e50-a66a-342dd2e6e5e3" status: 200 len: 1515 microversion: 2.1 time: 0.288792 Oct 22 21:06:13.452361 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1798/3557] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:06:13 2022] GET /compute/v2.1/servers/e09b7865-0b24-4e50-a66a-342dd2e6e5e3 => generated 1515 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:06:13.463905 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-9b16ae78-50c6-49d7-953a-b5a2d5ebb8ed tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:13.464982 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-9b16ae78-50c6-49d7-953a-b5a2d5ebb8ed tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] [instance: e24e9888-adfe-455c-b53e-da3bf5729d69] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:06:13.473057 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9b16ae78-50c6-49d7-953a-b5a2d5ebb8ed tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:13.473843 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9b16ae78-50c6-49d7-953a-b5a2d5ebb8ed tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:13.475749 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9b16ae78-50c6-49d7-953a-b5a2d5ebb8ed tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:13.476790 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9b16ae78-50c6-49d7-953a-b5a2d5ebb8ed tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:13.477412 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9b16ae78-50c6-49d7-953a-b5a2d5ebb8ed tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:13.478019 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9b16ae78-50c6-49d7-953a-b5a2d5ebb8ed tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:13.717032 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-9b16ae78-50c6-49d7-953a-b5a2d5ebb8ed tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de9c0914dd6943bfa313ac456524cbba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af4c5251e7348c0ae5fc62468243a81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:06:13.725681 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-9b16ae78-50c6-49d7-953a-b5a2d5ebb8ed tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] 10.222.0.18 "GET /compute/v2.1/servers/e24e9888-adfe-455c-b53e-da3bf5729d69" status: 200 len: 1325 microversion: 2.1 time: 0.271947 Oct 22 21:06:13.726275 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1799/3558] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:06:13 2022] GET /compute/v2.1/servers/e24e9888-adfe-455c-b53e-da3bf5729d69 => generated 1325 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:06:13.730854 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-f00bbefd-8d8c-48c6-b2a8-4b8797ab2020 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:13.731521 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-f00bbefd-8d8c-48c6-b2a8-4b8797ab2020 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] [instance: 6b3e8fcb-7327-45f4-815d-c7b43ed4db97] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:06:13.737648 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f00bbefd-8d8c-48c6-b2a8-4b8797ab2020 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:13.738493 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f00bbefd-8d8c-48c6-b2a8-4b8797ab2020 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:13.738625 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f00bbefd-8d8c-48c6-b2a8-4b8797ab2020 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:13.739513 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f00bbefd-8d8c-48c6-b2a8-4b8797ab2020 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:13.739998 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f00bbefd-8d8c-48c6-b2a8-4b8797ab2020 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:13.740450 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f00bbefd-8d8c-48c6-b2a8-4b8797ab2020 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:13.746498 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-aa20c0ec-21a1-4963-a7ee-1158cc02b78a tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Flavor limits 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 21:06:13.746971 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-aa20c0ec-21a1-4963-a7ee-1158cc02b78a tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Image limits 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 21:06:13.747491 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-aa20c0ec-21a1-4963-a7ee-1158cc02b78a tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Flavor pref 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 21:06:13.747913 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-aa20c0ec-21a1-4963-a7ee-1158cc02b78a tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Image pref 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 21:06:13.748332 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-aa20c0ec-21a1-4963-a7ee-1158cc02b78a tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 21:06:13.757970 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-aa20c0ec-21a1-4963-a7ee-1158cc02b78a tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:13.758468 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-aa20c0ec-21a1-4963-a7ee-1158cc02b78a tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:13.758928 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-aa20c0ec-21a1-4963-a7ee-1158cc02b78a tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:13.759717 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-aa20c0ec-21a1-4963-a7ee-1158cc02b78a tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:13.760177 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-aa20c0ec-21a1-4963-a7ee-1158cc02b78a tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:13.760802 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-aa20c0ec-21a1-4963-a7ee-1158cc02b78a tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:13.773952 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f00bbefd-8d8c-48c6-b2a8-4b8797ab2020 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:13.774495 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f00bbefd-8d8c-48c6-b2a8-4b8797ab2020 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:13.774945 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f00bbefd-8d8c-48c6-b2a8-4b8797ab2020 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:13.775439 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.objects.instance [None req-f00bbefd-8d8c-48c6-b2a8-4b8797ab2020 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Lazy-loading 'fault' on Instance uuid 6b3e8fcb-7327-45f4-815d-c7b43ed4db97 {{(pid=138745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 21:06:13.778913 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-aa20c0ec-21a1-4963-a7ee-1158cc02b78a tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Getting quotas for project 82a42c3ecf474883ac652fcc8c01c9f2. Resources: {'cores', 'instances', 'ram'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 21:06:13.784816 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-aa20c0ec-21a1-4963-a7ee-1158cc02b78a tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Getting quotas for user 7e3820b31a424c3a9216a6ef91fcb285 and project 82a42c3ecf474883ac652fcc8c01c9f2. Resources: {'cores', 'instances', 'ram'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 21:06:13.799137 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-aa20c0ec-21a1-4963-a7ee-1158cc02b78a tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Going to run 1 instances... {{(pid=138744) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 21:06:13.801939 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-aa20c0ec-21a1-4963-a7ee-1158cc02b78a tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] [instance: 64318452-365b-4b80-b53b-9367dd8bc826] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/sda',device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='0486457a-c86d-44d6-b9f8-ec655e378924',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=138744) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 21:06:13.817573 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-f00bbefd-8d8c-48c6-b2a8-4b8797ab2020 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90ed2d6013024c278551a2c9cd961f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac03b202c142deb478e3328397d402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:06:13.825845 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-f00bbefd-8d8c-48c6-b2a8-4b8797ab2020 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90ed2d6013024c278551a2c9cd961f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac03b202c142deb478e3328397d402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:06:13.827470 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-f00bbefd-8d8c-48c6-b2a8-4b8797ab2020 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90ed2d6013024c278551a2c9cd961f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac03b202c142deb478e3328397d402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:06:13.828697 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-f00bbefd-8d8c-48c6-b2a8-4b8797ab2020 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] 10.222.0.18 "GET /compute/v2.1/servers/6b3e8fcb-7327-45f4-815d-c7b43ed4db97" status: 200 len: 1352 microversion: 2.26 time: 0.101501 Oct 22 21:06:13.829296 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1800/3559] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:06:13 2022] GET /compute/v2.1/servers/6b3e8fcb-7327-45f4-815d-c7b43ed4db97 => generated 1352 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:06:13.833936 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-81d9d9c4-4d94-453c-8f6d-224cd9234f6a tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:13.834561 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-81d9d9c4-4d94-453c-8f6d-224cd9234f6a tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] [instance: a26fa9bd-fad2-40a2-910e-2208fb769dcb] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:06:13.840748 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-81d9d9c4-4d94-453c-8f6d-224cd9234f6a tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:13.841252 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-81d9d9c4-4d94-453c-8f6d-224cd9234f6a tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:13.841709 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-81d9d9c4-4d94-453c-8f6d-224cd9234f6a tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:13.842425 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-81d9d9c4-4d94-453c-8f6d-224cd9234f6a tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:13.842901 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-81d9d9c4-4d94-453c-8f6d-224cd9234f6a tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:13.843378 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-81d9d9c4-4d94-453c-8f6d-224cd9234f6a tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:13.881531 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-aa20c0ec-21a1-4963-a7ee-1158cc02b78a tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.845894 Oct 22 21:06:13.882321 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1760/3560] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Oct 22 21:06:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 847 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 21:06:13.893377 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-7f9e295a-bf3e-40ae-8134-7b255beb524f tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:13.893989 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-7f9e295a-bf3e-40ae-8134-7b255beb524f tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] [instance: 64318452-365b-4b80-b53b-9367dd8bc826] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:06:13.968841 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-7f9e295a-bf3e-40ae-8134-7b255beb524f tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3820b31a424c3a9216a6ef91fcb285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a42c3ecf474883ac652fcc8c01c9f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:06:13.977111 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-7f9e295a-bf3e-40ae-8134-7b255beb524f tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] 10.222.0.18 "GET /compute/v2.1/servers/64318452-365b-4b80-b53b-9367dd8bc826" status: 200 len: 1230 microversion: 2.1 time: 0.087620 Oct 22 21:06:13.978006 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1761/3561] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:06:13 2022] GET /compute/v2.1/servers/64318452-365b-4b80-b53b-9367dd8bc826 => generated 1230 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:06:13.999237 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-81d9d9c4-4d94-453c-8f6d-224cd9234f6a tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a44ff8e7c14b94b1670f030085c43d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a26a2284f4424cbeaf63d504652546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:06:14.007527 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-81d9d9c4-4d94-453c-8f6d-224cd9234f6a tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] 10.222.0.18 "GET /compute/v2.1/servers/a26fa9bd-fad2-40a2-910e-2208fb769dcb" status: 200 len: 1489 microversion: 2.1 time: 0.177190 Oct 22 21:06:14.008134 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1801/3562] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:06:13 2022] GET /compute/v2.1/servers/a26fa9bd-fad2-40a2-910e-2208fb769dcb => generated 1489 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:06:14.030894 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-470ff9bb-1f8e-45ed-8d13-01ebbab85436 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-2009242815"}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:06:14.033307 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-470ff9bb-1f8e-45ed-8d13-01ebbab85436 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] [instance: a26fa9bd-fad2-40a2-910e-2208fb769dcb] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:06:14.040235 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-470ff9bb-1f8e-45ed-8d13-01ebbab85436 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:14.040608 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-470ff9bb-1f8e-45ed-8d13-01ebbab85436 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:14.041009 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-470ff9bb-1f8e-45ed-8d13-01ebbab85436 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:14.041715 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-470ff9bb-1f8e-45ed-8d13-01ebbab85436 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:14.042121 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-470ff9bb-1f8e-45ed-8d13-01ebbab85436 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:14.042557 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-470ff9bb-1f8e-45ed-8d13-01ebbab85436 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:14.063642 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-0318f526-84df-4a66-8646-de3c27a5fa91 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:14.064486 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-0318f526-84df-4a66-8646-de3c27a5fa91 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] [instance: 3fdb6d35-9428-4253-ad00-932310ecdf5d] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:06:14.071087 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0318f526-84df-4a66-8646-de3c27a5fa91 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:14.071710 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0318f526-84df-4a66-8646-de3c27a5fa91 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:14.072284 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0318f526-84df-4a66-8646-de3c27a5fa91 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:14.073276 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0318f526-84df-4a66-8646-de3c27a5fa91 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:14.073993 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0318f526-84df-4a66-8646-de3c27a5fa91 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:14.074500 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0318f526-84df-4a66-8646-de3c27a5fa91 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:14.230660 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-0318f526-84df-4a66-8646-de3c27a5fa91 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879c85830a9f42088a4ebdf1e3cfb39b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b54f56cfbc814cccb533c65966f35a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:06:14.240157 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-0318f526-84df-4a66-8646-de3c27a5fa91 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] 10.222.0.18 "GET /compute/v2.1/servers/3fdb6d35-9428-4253-ad00-932310ecdf5d" status: 200 len: 1492 microversion: 2.1 time: 0.182181 Oct 22 21:06:14.252665 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1802/3563] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:06:14 2022] GET /compute/v2.1/servers/3fdb6d35-9428-4253-ad00-932310ecdf5d => generated 1492 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:06:14.260105 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-a9dc21b8-7015-41b7-9fa9-be3930872612 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:14.260973 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-a9dc21b8-7015-41b7-9fa9-be3930872612 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] [instance: 23f77d1a-18db-4152-a25a-d02ac1726b08] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:06:14.270223 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a9dc21b8-7015-41b7-9fa9-be3930872612 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:14.270951 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a9dc21b8-7015-41b7-9fa9-be3930872612 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:14.271481 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a9dc21b8-7015-41b7-9fa9-be3930872612 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:14.272226 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a9dc21b8-7015-41b7-9fa9-be3930872612 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:14.272694 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a9dc21b8-7015-41b7-9fa9-be3930872612 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:14.273525 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a9dc21b8-7015-41b7-9fa9-be3930872612 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:14.311632 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a9dc21b8-7015-41b7-9fa9-be3930872612 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:14.312367 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a9dc21b8-7015-41b7-9fa9-be3930872612 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:14.312999 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a9dc21b8-7015-41b7-9fa9-be3930872612 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:14.313576 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.objects.instance [None req-a9dc21b8-7015-41b7-9fa9-be3930872612 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lazy-loading 'fault' on Instance uuid 23f77d1a-18db-4152-a25a-d02ac1726b08 {{(pid=138745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 21:06:14.319922 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-470ff9bb-1f8e-45ed-8d13-01ebbab85436 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] 10.222.0.18 "POST /compute/v2.1/servers/a26fa9bd-fad2-40a2-910e-2208fb769dcb/action" status: 202 len: 0 microversion: 2.1 time: 0.292740 Oct 22 21:06:14.320808 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1762/3564] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 21:06:14 2022] POST /compute/v2.1/servers/a26fa9bd-fad2-40a2-910e-2208fb769dcb/action => generated 0 bytes in 295 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 22 21:06:14.333856 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-9949db44-3498-4a45-aaf6-962febd4048a tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Calling method '.version_select at 0x7fd39ee899d0>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:14.364431 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-a9dc21b8-7015-41b7-9fa9-be3930872612 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1b410a64e0415a96d30f5040361137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd7873d6db4e09bc9ab9a048a6b1ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:06:14.375919 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-a9dc21b8-7015-41b7-9fa9-be3930872612 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] 10.222.0.18 "GET /compute/v2.1/servers/23f77d1a-18db-4152-a25a-d02ac1726b08" status: 200 len: 1305 microversion: 2.1 time: 0.121717 Oct 22 21:06:14.377159 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1803/3565] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:06:14 2022] GET /compute/v2.1/servers/23f77d1a-18db-4152-a25a-d02ac1726b08 => generated 1305 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:06:14.407925 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-9949db44-3498-4a45-aaf6-962febd4048a tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] 10.222.0.18 "GET /compute/v2.1/images/0fe29600-d695-41c1-9223-9e0d242e0c54" status: 200 len: 1414 microversion: 2.1 time: 0.079366 Oct 22 21:06:14.408654 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1763/3566] 10.222.0.18 () {58 vars in 1233 bytes} [Sat Oct 22 21:06:14 2022] GET /compute/v2.1/images/0fe29600-d695-41c1-9223-9e0d242e0c54 => generated 1414 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:06:14.423263 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-5ac80495-d603-4300-a781-04bb8a486a6f tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Calling method '.version_select at 0x7fd39fd34820>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:14.474026 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-5eac6ef0-d425-4f99-9b90-275164ed57ec tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:14.474777 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-5eac6ef0-d425-4f99-9b90-275164ed57ec tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] [instance: e09b7865-0b24-4e50-a66a-342dd2e6e5e3] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:06:14.475268 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-5ac80495-d603-4300-a781-04bb8a486a6f tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] 10.222.0.18 "GET /compute/v2.1/images/0fe29600-d695-41c1-9223-9e0d242e0c54" status: 200 len: 1414 microversion: 2.1 time: 0.056706 Oct 22 21:06:14.476426 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1804/3567] 10.222.0.18 () {58 vars in 1233 bytes} [Sat Oct 22 21:06:14 2022] GET /compute/v2.1/images/0fe29600-d695-41c1-9223-9e0d242e0c54 => generated 1414 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:06:14.490134 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5eac6ef0-d425-4f99-9b90-275164ed57ec tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:14.490624 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5eac6ef0-d425-4f99-9b90-275164ed57ec tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:14.491080 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5eac6ef0-d425-4f99-9b90-275164ed57ec tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:14.491601 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-19c5d9bd-bf50-405c-b39a-dd8d3076143e tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Calling method '.version_select at 0x7fd3a417b4c0>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:14.491973 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5eac6ef0-d425-4f99-9b90-275164ed57ec tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:14.492378 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5eac6ef0-d425-4f99-9b90-275164ed57ec tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:14.494959 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5eac6ef0-d425-4f99-9b90-275164ed57ec tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:14.502360 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:06:14.753262 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-19c5d9bd-bf50-405c-b39a-dd8d3076143e tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] 10.222.0.18 "DELETE /compute/v2.1/images/0fe29600-d695-41c1-9223-9e0d242e0c54" status: 204 len: 0 microversion: 2.1 time: 0.266669 Oct 22 21:06:14.754011 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1805/3568] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:06:14 2022] DELETE /compute/v2.1/images/0fe29600-d695-41c1-9223-9e0d242e0c54 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 22 21:06:14.759327 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-6553b2b0-cc1c-4f5c-ab43-35ea654ecb8a tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:14.760235 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-6553b2b0-cc1c-4f5c-ab43-35ea654ecb8a tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] [instance: e24e9888-adfe-455c-b53e-da3bf5729d69] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:06:14.779393 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6553b2b0-cc1c-4f5c-ab43-35ea654ecb8a tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:14.780037 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6553b2b0-cc1c-4f5c-ab43-35ea654ecb8a tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:14.780584 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6553b2b0-cc1c-4f5c-ab43-35ea654ecb8a tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:14.781422 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6553b2b0-cc1c-4f5c-ab43-35ea654ecb8a tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:14.781990 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6553b2b0-cc1c-4f5c-ab43-35ea654ecb8a tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:14.782547 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6553b2b0-cc1c-4f5c-ab43-35ea654ecb8a tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:14.801043 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-5eac6ef0-d425-4f99-9b90-275164ed57ec tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcdfeb6c1cda4810b9fa70fdfd9a66c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c774a85b2c41c98486cf91b1253363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:06:14.817494 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-5eac6ef0-d425-4f99-9b90-275164ed57ec tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] 10.222.0.18 "GET /compute/v2.1/servers/e09b7865-0b24-4e50-a66a-342dd2e6e5e3" status: 200 len: 1515 microversion: 2.1 time: 0.347090 Oct 22 21:06:14.820952 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1764/3569] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:06:14 2022] GET /compute/v2.1/servers/e09b7865-0b24-4e50-a66a-342dd2e6e5e3 => generated 1515 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:06:14.844902 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-d8d3bbfe-18ed-44ad-bfa1-eabee1fe9e3c tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Calling method '.version_select at 0x7fd39ee899d0>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:14.888170 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-d8d3bbfe-18ed-44ad-bfa1-eabee1fe9e3c tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] HTTP exception thrown: Image not found. Oct 22 21:06:14.891951 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-d8d3bbfe-18ed-44ad-bfa1-eabee1fe9e3c tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Request method failure captured: Oct 22 21:06:14.891951 ncdv-master-1 devstack@n-api.service[138744]: request: GET /compute/v2.1/images/0fe29600-d695-41c1-9223-9e0d242e0c54 HTTP/1.1 Oct 22 21:06:14.891951 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 21:06:14.891951 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 21:06:14.891951 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 21:06:14.891951 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 0 Oct 22 21:06:14.891951 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 21:06:14.891951 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 21:06:14.891951 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 21:06:14.891951 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 21:06:14.891951 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVFng3hwvwMj6qrKBKP-NtPsacHNJudvI6PbLTlDqKVlCNAf4Mqq0nvy7Chi-hCExXK3RI9ZbTr7OISCYx9SEUXfBLJqVoAZKtsaVbmoggH2NuFL9WL2K0RSTEHzGZGsrQHqgFF8j5Iii8ybpULxjQ0-J_wT0C7d5Pfa14Sa-3-zfpKo Oct 22 21:06:14.891951 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 21:06:14.891951 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 21:06:14.891951 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 21:06:14.891951 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 21:06:14.891951 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 21:06:14.891951 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 21:06:14.891951 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: 66a26a2284f4424cbeaf63d504652546 Oct 22 21:06:14.891951 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-ImagesTestJSON-2101376766 Oct 22 21:06:14.891951 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 21:06:14.891951 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 21:06:14.891951 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_66a26a2284f4424cbeaf63d504652546"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/66a26a2284f4424cbeaf63d504652546"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/66a26a2284f4424cbeaf63d504652546"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/66a26a2284f4424cbeaf63d504652546"}]}] Oct 22 21:06:14.891951 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-ImagesTestJSON-2101376766 Oct 22 21:06:14.891951 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: 66a26a2284f4424cbeaf63d504652546 Oct 22 21:06:14.891951 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-ImagesTestJSON-2101376766 Oct 22 21:06:14.891951 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-ImagesTestJSON-2101376766-project Oct 22 21:06:14.891951 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 21:06:14.891951 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 21:06:14.891951 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: f0a44ff8e7c14b94b1670f030085c43d Oct 22 21:06:14.891951 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-ImagesTestJSON-2101376766-project Oct 22 21:06:14.891951 ncdv-master-1 devstack@n-api.service[138744]: method: Oct 22 21:06:14.891951 ncdv-master-1 devstack@n-api.service[138744]: exception: Image not found. Oct 22 21:06:14.891951 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': '0fe29600-d695-41c1-9223-9e0d242e0c54'} Oct 22 21:06:14.891951 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:06:14.891951 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:06:14.891951 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 22 21:06:14.891951 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 22 21:06:14.891951 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 22 21:06:14.891951 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 22 21:06:14.891951 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 22 21:06:14.891951 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 22 21:06:14.891951 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 22 21:06:14.891951 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 22 21:06:14.891951 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 22 21:06:14.891951 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 22 21:06:14.891951 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 22 21:06:14.891951 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 22 21:06:14.891951 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 22 21:06:14.891951 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 22 21:06:14.891951 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 22 21:06:14.891951 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 22 21:06:14.891951 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 0fe29600-d695-41c1-9223-9e0d242e0c54 Oct 22 21:06:14.891951 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:06:14.891951 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:06:14.891951 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:06:14.891951 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:06:14.891951 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 22 21:06:14.891951 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 22 21:06:14.891951 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 22 21:06:14.891951 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 22 21:06:14.891951 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 22 21:06:14.891951 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 22 21:06:14.891951 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 22 21:06:14.891951 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 22 21:06:14.895397 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 22 21:06:14.895397 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 22 21:06:14.895397 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 22 21:06:14.895397 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 22 21:06:14.895397 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 22 21:06:14.895397 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 22 21:06:14.895397 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 22 21:06:14.895397 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 22 21:06:14.895397 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 22 21:06:14.895397 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 22 21:06:14.895397 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 22 21:06:14.895397 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 22 21:06:14.895397 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 22 21:06:14.895397 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 22 21:06:14.895397 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 22 21:06:14.895397 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 22 21:06:14.895397 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 0fe29600-d695-41c1-9223-9e0d242e0c54 could not be found. Oct 22 21:06:14.895397 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:06:14.895397 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:06:14.895397 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:06:14.895397 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:06:14.895397 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:06:14.895397 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:06:14.895397 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:06:14.895397 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:06:14.895397 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 22 21:06:14.895397 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 22 21:06:14.895397 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:06:14.895397 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:06:14.895397 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 22 21:06:14.895397 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 22 21:06:14.895397 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 22 21:06:14.895397 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:06:14.895397 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:06:14.895397 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:06:14.895397 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:06:14.895397 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:06:14.895397 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:06:14.895397 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:06:14.895397 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:06:14.895397 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 22 21:06:14.895397 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:06:14.895397 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-d8d3bbfe-18ed-44ad-bfa1-eabee1fe9e3c tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Returning 404 to user: Image not found. {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:06:14.895397 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-d8d3bbfe-18ed-44ad-bfa1-eabee1fe9e3c tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] 10.222.0.18 "GET /compute/v2.1/images/0fe29600-d695-41c1-9223-9e0d242e0c54" status: 404 len: 62 microversion: 2.1 time: 0.071299 Oct 22 21:06:14.895397 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1765/3570] 10.222.0.18 () {58 vars in 1233 bytes} [Sat Oct 22 21:06:14 2022] GET /compute/v2.1/images/0fe29600-d695-41c1-9223-9e0d242e0c54 => generated 62 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 22 21:06:14.906238 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-f9999e96-9c02-40f0-ba83-acc18a3543b4 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:14.906805 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-f9999e96-9c02-40f0-ba83-acc18a3543b4 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] [instance: 6b3e8fcb-7327-45f4-815d-c7b43ed4db97] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:06:14.931760 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f9999e96-9c02-40f0-ba83-acc18a3543b4 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:14.932560 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f9999e96-9c02-40f0-ba83-acc18a3543b4 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:14.933297 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f9999e96-9c02-40f0-ba83-acc18a3543b4 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:14.934269 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f9999e96-9c02-40f0-ba83-acc18a3543b4 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:14.934872 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f9999e96-9c02-40f0-ba83-acc18a3543b4 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:14.935958 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f9999e96-9c02-40f0-ba83-acc18a3543b4 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:14.993603 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-6553b2b0-cc1c-4f5c-ab43-35ea654ecb8a tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de9c0914dd6943bfa313ac456524cbba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af4c5251e7348c0ae5fc62468243a81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:06:15.004963 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-6553b2b0-cc1c-4f5c-ab43-35ea654ecb8a tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] 10.222.0.18 "GET /compute/v2.1/servers/e24e9888-adfe-455c-b53e-da3bf5729d69" status: 200 len: 1325 microversion: 2.1 time: 0.249577 Oct 22 21:06:15.021511 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1806/3571] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:06:14 2022] GET /compute/v2.1/servers/e24e9888-adfe-455c-b53e-da3bf5729d69 => generated 1325 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:06:15.028444 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-94b3cce6-df42-46d2-928a-5ac8d21e9c89 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:15.029583 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-94b3cce6-df42-46d2-928a-5ac8d21e9c89 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] [instance: a26fa9bd-fad2-40a2-910e-2208fb769dcb] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:06:15.041477 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f9999e96-9c02-40f0-ba83-acc18a3543b4 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:15.044424 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f9999e96-9c02-40f0-ba83-acc18a3543b4 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:15.045403 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f9999e96-9c02-40f0-ba83-acc18a3543b4 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:15.045777 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-94b3cce6-df42-46d2-928a-5ac8d21e9c89 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:15.046409 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.objects.instance [None req-f9999e96-9c02-40f0-ba83-acc18a3543b4 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Lazy-loading 'fault' on Instance uuid 6b3e8fcb-7327-45f4-815d-c7b43ed4db97 {{(pid=138744) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 21:06:15.047144 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-94b3cce6-df42-46d2-928a-5ac8d21e9c89 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:15.048260 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-94b3cce6-df42-46d2-928a-5ac8d21e9c89 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:15.050917 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-94b3cce6-df42-46d2-928a-5ac8d21e9c89 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:15.054060 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-94b3cce6-df42-46d2-928a-5ac8d21e9c89 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:15.054861 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-94b3cce6-df42-46d2-928a-5ac8d21e9c89 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:15.092667 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:06:15.107704 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-f9999e96-9c02-40f0-ba83-acc18a3543b4 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90ed2d6013024c278551a2c9cd961f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac03b202c142deb478e3328397d402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:06:15.117588 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-f9999e96-9c02-40f0-ba83-acc18a3543b4 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90ed2d6013024c278551a2c9cd961f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac03b202c142deb478e3328397d402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:06:15.119645 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-f9999e96-9c02-40f0-ba83-acc18a3543b4 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90ed2d6013024c278551a2c9cd961f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac03b202c142deb478e3328397d402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:06:15.121197 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-f9999e96-9c02-40f0-ba83-acc18a3543b4 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] 10.222.0.18 "GET /compute/v2.1/servers/6b3e8fcb-7327-45f4-815d-c7b43ed4db97" status: 200 len: 1352 microversion: 2.26 time: 0.225556 Oct 22 21:06:15.122112 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1766/3572] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:06:14 2022] GET /compute/v2.1/servers/6b3e8fcb-7327-45f4-815d-c7b43ed4db97 => generated 1352 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:06:15.132019 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-a428cc48-9cf6-4f96-aa62-3d72da841e32 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:15.132853 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-a428cc48-9cf6-4f96-aa62-3d72da841e32 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] [instance: 64318452-365b-4b80-b53b-9367dd8bc826] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:06:15.140735 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a428cc48-9cf6-4f96-aa62-3d72da841e32 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:15.141421 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a428cc48-9cf6-4f96-aa62-3d72da841e32 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:15.142014 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a428cc48-9cf6-4f96-aa62-3d72da841e32 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:15.143624 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a428cc48-9cf6-4f96-aa62-3d72da841e32 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:15.144086 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a428cc48-9cf6-4f96-aa62-3d72da841e32 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:15.144736 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a428cc48-9cf6-4f96-aa62-3d72da841e32 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:15.231607 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-a428cc48-9cf6-4f96-aa62-3d72da841e32 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3820b31a424c3a9216a6ef91fcb285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a42c3ecf474883ac652fcc8c01c9f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:06:15.241668 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-a428cc48-9cf6-4f96-aa62-3d72da841e32 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] 10.222.0.18 "GET /compute/v2.1/servers/64318452-365b-4b80-b53b-9367dd8bc826" status: 200 len: 1282 microversion: 2.1 time: 0.116796 Oct 22 21:06:15.242684 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1767/3573] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:06:15 2022] GET /compute/v2.1/servers/64318452-365b-4b80-b53b-9367dd8bc826 => generated 1282 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:06:15.248136 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-48722a43-6826-48c5-9624-ae3fc261441d req-b8beafef-ef6a-4a38-8975-65124a05963a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e24e9888-adfe-455c-b53e-da3bf5729d69", "name": "network-vif-plugged", "status": "completed", "tag": "989e73aa-86fa-483e-8dc2-c5ec459b5837"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:06:15.259239 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-48722a43-6826-48c5-9624-ae3fc261441d req-b8beafef-ef6a-4a38-8975-65124a05963a service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:15.259796 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-48722a43-6826-48c5-9624-ae3fc261441d req-b8beafef-ef6a-4a38-8975-65124a05963a service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:15.260243 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-48722a43-6826-48c5-9624-ae3fc261441d req-b8beafef-ef6a-4a38-8975-65124a05963a service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:15.271948 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-94b3cce6-df42-46d2-928a-5ac8d21e9c89 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a44ff8e7c14b94b1670f030085c43d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a26a2284f4424cbeaf63d504652546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:06:15.276071 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-48722a43-6826-48c5-9624-ae3fc261441d req-b8beafef-ef6a-4a38-8975-65124a05963a service nova] Creating event network-vif-plugged:989e73aa-86fa-483e-8dc2-c5ec459b5837 for instance e24e9888-adfe-455c-b53e-da3bf5729d69 on nch1-master-1 Oct 22 21:06:15.282082 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-48722a43-6826-48c5-9624-ae3fc261441d req-b8beafef-ef6a-4a38-8975-65124a05963a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037959 Oct 22 21:06:15.282917 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1768/3574] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:06:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:06:15.285290 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-94b3cce6-df42-46d2-928a-5ac8d21e9c89 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] 10.222.0.18 "GET /compute/v2.1/servers/a26fa9bd-fad2-40a2-910e-2208fb769dcb" status: 200 len: 1501 microversion: 2.1 time: 0.261996 Oct 22 21:06:15.286846 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1807/3575] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:06:15 2022] GET /compute/v2.1/servers/a26fa9bd-fad2-40a2-910e-2208fb769dcb => generated 1501 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:06:15.288893 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-733f692e-88cd-4432-b733-10ccdf46b527 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:15.289606 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-733f692e-88cd-4432-b733-10ccdf46b527 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] [instance: 3fdb6d35-9428-4253-ad00-932310ecdf5d] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:06:15.295930 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-733f692e-88cd-4432-b733-10ccdf46b527 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:15.296601 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-733f692e-88cd-4432-b733-10ccdf46b527 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:15.297045 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-733f692e-88cd-4432-b733-10ccdf46b527 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:15.297922 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-733f692e-88cd-4432-b733-10ccdf46b527 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:15.298390 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-733f692e-88cd-4432-b733-10ccdf46b527 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:15.298906 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-733f692e-88cd-4432-b733-10ccdf46b527 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:15.400532 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-480bb801-5eae-478e-9b1e-0abe95b95d22 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:15.401173 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-480bb801-5eae-478e-9b1e-0abe95b95d22 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] [instance: 23f77d1a-18db-4152-a25a-d02ac1726b08] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:06:15.409052 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-480bb801-5eae-478e-9b1e-0abe95b95d22 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:15.412319 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-480bb801-5eae-478e-9b1e-0abe95b95d22 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:15.414052 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-480bb801-5eae-478e-9b1e-0abe95b95d22 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:15.415490 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-480bb801-5eae-478e-9b1e-0abe95b95d22 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:15.416901 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-480bb801-5eae-478e-9b1e-0abe95b95d22 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:15.417597 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-480bb801-5eae-478e-9b1e-0abe95b95d22 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:15.442671 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.wsgi [None req-480bb801-5eae-478e-9b1e-0abe95b95d22 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] HTTP exception thrown: Instance 23f77d1a-18db-4152-a25a-d02ac1726b08 could not be found. Oct 22 21:06:15.445582 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-480bb801-5eae-478e-9b1e-0abe95b95d22 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Request method failure captured: Oct 22 21:06:15.445582 ncdv-master-1 devstack@n-api.service[138745]: request: GET /compute/v2.1/servers/23f77d1a-18db-4152-a25a-d02ac1726b08 HTTP/1.1 Oct 22 21:06:15.445582 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 21:06:15.445582 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 21:06:15.445582 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 21:06:15.445582 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 0 Oct 22 21:06:15.445582 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 21:06:15.445582 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 21:06:15.445582 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 21:06:15.445582 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 21:06:15.445582 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVFnfV28M622GxgIau9tfOtpQOzUe_Zks3cnq6zOgmdqQwk77RE2xHy9F74fRKXOoFFtdLiZlk8HWakwyjiKYmRp9GaMJF70RmWqk8on_rfYCWM12-ITQGodTkqOwwxslvC1Btdt7aRnJVFyVeqFX--IHdQyw_AkPLTYKSNTzj-OnnLE Oct 22 21:06:15.445582 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 21:06:15.445582 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 21:06:15.445582 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 21:06:15.445582 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 21:06:15.445582 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 21:06:15.445582 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 21:06:15.445582 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: b4cd7873d6db4e09bc9ab9a048a6b1ef Oct 22 21:06:15.445582 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-DeleteServersTestJSON-1244431593 Oct 22 21:06:15.445582 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 21:06:15.445582 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 21:06:15.445582 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_b4cd7873d6db4e09bc9ab9a048a6b1ef"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b4cd7873d6db4e09bc9ab9a048a6b1ef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/b4cd7873d6db4e09bc9ab9a048a6b1ef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b4cd7873d6db4e09bc9ab9a048a6b1ef"}]}] Oct 22 21:06:15.445582 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-DeleteServersTestJSON-1244431593 Oct 22 21:06:15.445582 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: b4cd7873d6db4e09bc9ab9a048a6b1ef Oct 22 21:06:15.445582 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-DeleteServersTestJSON-1244431593 Oct 22 21:06:15.445582 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-DeleteServersTestJSON-1244431593-project Oct 22 21:06:15.445582 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 21:06:15.445582 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 21:06:15.445582 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: be1b410a64e0415a96d30f5040361137 Oct 22 21:06:15.445582 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-DeleteServersTestJSON-1244431593-project Oct 22 21:06:15.445582 ncdv-master-1 devstack@n-api.service[138745]: method: > Oct 22 21:06:15.445582 ncdv-master-1 devstack@n-api.service[138745]: exception: Instance 23f77d1a-18db-4152-a25a-d02ac1726b08 could not be found. Oct 22 21:06:15.445582 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'id': '23f77d1a-18db-4152-a25a-d02ac1726b08'} Oct 22 21:06:15.445582 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:06:15.445582 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:06:15.445582 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 21:06:15.445582 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 21:06:15.445582 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 21:06:15.445582 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 21:06:15.445582 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 21:06:15.445582 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 21:06:15.445582 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 21:06:15.445582 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 21:06:15.445582 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 23f77d1a-18db-4152-a25a-d02ac1726b08 could not be found. Oct 22 21:06:15.445582 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:06:15.445582 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:06:15.445582 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:06:15.445582 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:06:15.445582 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:06:15.445582 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:06:15.445582 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:06:15.445582 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:06:15.445582 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:06:15.445582 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:06:15.445582 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 21:06:15.445582 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 21:06:15.445582 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 21:06:15.445582 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 21:06:15.445582 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 21:06:15.445582 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:06:15.445582 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 23f77d1a-18db-4152-a25a-d02ac1726b08 could not be found. Oct 22 21:06:15.445582 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:06:15.445582 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:06:15.445582 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:06:15.449638 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:06:15.449638 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:06:15.449638 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:06:15.449638 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:06:15.449638 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:06:15.449638 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 23f77d1a-18db-4152-a25a-d02ac1726b08 could not be found. Oct 22 21:06:15.449638 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:06:15.449638 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-480bb801-5eae-478e-9b1e-0abe95b95d22 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Returning 404 to user: Instance 23f77d1a-18db-4152-a25a-d02ac1726b08 could not be found. {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:06:15.449638 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-480bb801-5eae-478e-9b1e-0abe95b95d22 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] 10.222.0.18 "GET /compute/v2.1/servers/23f77d1a-18db-4152-a25a-d02ac1726b08" status: 404 len: 111 microversion: 2.1 time: 0.051306 Oct 22 21:06:15.450999 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1808/3576] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:06:15 2022] GET /compute/v2.1/servers/23f77d1a-18db-4152-a25a-d02ac1726b08 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 21:06:15.463155 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-aab5acc7-bb67-4982-a1da-888f56377953 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:15.463646 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-aab5acc7-bb67-4982-a1da-888f56377953 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] [instance: 23f77d1a-18db-4152-a25a-d02ac1726b08] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:06:15.471642 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-aab5acc7-bb67-4982-a1da-888f56377953 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:15.472157 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-aab5acc7-bb67-4982-a1da-888f56377953 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:15.472675 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-aab5acc7-bb67-4982-a1da-888f56377953 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:15.473400 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-aab5acc7-bb67-4982-a1da-888f56377953 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:15.473877 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-aab5acc7-bb67-4982-a1da-888f56377953 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:15.474328 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-aab5acc7-bb67-4982-a1da-888f56377953 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:15.493078 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.wsgi [None req-aab5acc7-bb67-4982-a1da-888f56377953 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] HTTP exception thrown: Instance 23f77d1a-18db-4152-a25a-d02ac1726b08 could not be found. Oct 22 21:06:15.495479 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-aab5acc7-bb67-4982-a1da-888f56377953 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Request method failure captured: Oct 22 21:06:15.495479 ncdv-master-1 devstack@n-api.service[138745]: request: DELETE /compute/v2.1/servers/23f77d1a-18db-4152-a25a-d02ac1726b08 HTTP/1.1 Oct 22 21:06:15.495479 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 21:06:15.495479 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 21:06:15.495479 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 21:06:15.495479 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 0 Oct 22 21:06:15.495479 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 21:06:15.495479 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 21:06:15.495479 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 21:06:15.495479 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 21:06:15.495479 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVFnfV28M622GxgIau9tfOtpQOzUe_Zks3cnq6zOgmdqQwk77RE2xHy9F74fRKXOoFFtdLiZlk8HWakwyjiKYmRp9GaMJF70RmWqk8on_rfYCWM12-ITQGodTkqOwwxslvC1Btdt7aRnJVFyVeqFX--IHdQyw_AkPLTYKSNTzj-OnnLE Oct 22 21:06:15.495479 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 21:06:15.495479 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 21:06:15.495479 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 21:06:15.495479 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 21:06:15.495479 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 21:06:15.495479 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 21:06:15.495479 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: b4cd7873d6db4e09bc9ab9a048a6b1ef Oct 22 21:06:15.495479 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-DeleteServersTestJSON-1244431593 Oct 22 21:06:15.495479 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 21:06:15.495479 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 21:06:15.495479 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_b4cd7873d6db4e09bc9ab9a048a6b1ef"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b4cd7873d6db4e09bc9ab9a048a6b1ef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/b4cd7873d6db4e09bc9ab9a048a6b1ef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b4cd7873d6db4e09bc9ab9a048a6b1ef"}]}] Oct 22 21:06:15.495479 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-DeleteServersTestJSON-1244431593 Oct 22 21:06:15.495479 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: b4cd7873d6db4e09bc9ab9a048a6b1ef Oct 22 21:06:15.495479 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-DeleteServersTestJSON-1244431593 Oct 22 21:06:15.495479 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-DeleteServersTestJSON-1244431593-project Oct 22 21:06:15.495479 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 21:06:15.495479 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 21:06:15.495479 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: be1b410a64e0415a96d30f5040361137 Oct 22 21:06:15.495479 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-DeleteServersTestJSON-1244431593-project Oct 22 21:06:15.495479 ncdv-master-1 devstack@n-api.service[138745]: method: > Oct 22 21:06:15.495479 ncdv-master-1 devstack@n-api.service[138745]: exception: Instance 23f77d1a-18db-4152-a25a-d02ac1726b08 could not be found. Oct 22 21:06:15.495479 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'id': '23f77d1a-18db-4152-a25a-d02ac1726b08'} Oct 22 21:06:15.495479 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:06:15.495479 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:06:15.495479 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 21:06:15.495479 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 21:06:15.495479 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 21:06:15.495479 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 21:06:15.495479 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 21:06:15.495479 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 21:06:15.495479 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 21:06:15.495479 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 21:06:15.495479 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 23f77d1a-18db-4152-a25a-d02ac1726b08 could not be found. Oct 22 21:06:15.495479 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:06:15.495479 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:06:15.495479 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:06:15.495479 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:06:15.495479 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:06:15.495479 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:06:15.495479 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:06:15.495479 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:06:15.495479 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:06:15.495479 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:06:15.495479 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 22 21:06:15.495479 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 22 21:06:15.495479 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 22 21:06:15.495479 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 22 21:06:15.495479 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 21:06:15.495479 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 21:06:15.495479 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 21:06:15.495479 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:06:15.499499 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 23f77d1a-18db-4152-a25a-d02ac1726b08 could not be found. Oct 22 21:06:15.499499 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:06:15.499499 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:06:15.499499 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:06:15.499499 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:06:15.499499 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:06:15.499499 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:06:15.499499 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:06:15.499499 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:06:15.499499 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 23f77d1a-18db-4152-a25a-d02ac1726b08 could not be found. Oct 22 21:06:15.499499 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:06:15.501402 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-aab5acc7-bb67-4982-a1da-888f56377953 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Returning 404 to user: Instance 23f77d1a-18db-4152-a25a-d02ac1726b08 could not be found. {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:06:15.502299 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-aab5acc7-bb67-4982-a1da-888f56377953 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] 10.222.0.18 "DELETE /compute/v2.1/servers/23f77d1a-18db-4152-a25a-d02ac1726b08" status: 404 len: 111 microversion: 2.1 time: 0.045555 Oct 22 21:06:15.502879 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1809/3577] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 21:06:15 2022] DELETE /compute/v2.1/servers/23f77d1a-18db-4152-a25a-d02ac1726b08 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 21:06:15.511480 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-462eda3e-a203-47f0-bb4d-41afd5b8e3db tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:15.512127 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-462eda3e-a203-47f0-bb4d-41afd5b8e3db tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] [instance: 23f77d1a-18db-4152-a25a-d02ac1726b08] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:06:15.518455 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-462eda3e-a203-47f0-bb4d-41afd5b8e3db tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:15.518956 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-462eda3e-a203-47f0-bb4d-41afd5b8e3db tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:15.519424 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-462eda3e-a203-47f0-bb4d-41afd5b8e3db tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:15.520414 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-462eda3e-a203-47f0-bb4d-41afd5b8e3db tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:15.521097 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-462eda3e-a203-47f0-bb4d-41afd5b8e3db tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:15.523674 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-462eda3e-a203-47f0-bb4d-41afd5b8e3db tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:15.544650 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.wsgi [None req-462eda3e-a203-47f0-bb4d-41afd5b8e3db tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] HTTP exception thrown: Instance 23f77d1a-18db-4152-a25a-d02ac1726b08 could not be found. Oct 22 21:06:15.546395 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-462eda3e-a203-47f0-bb4d-41afd5b8e3db tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Request method failure captured: Oct 22 21:06:15.546395 ncdv-master-1 devstack@n-api.service[138745]: request: GET /compute/v2.1/servers/23f77d1a-18db-4152-a25a-d02ac1726b08 HTTP/1.1 Oct 22 21:06:15.546395 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 21:06:15.546395 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 21:06:15.546395 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 21:06:15.546395 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 0 Oct 22 21:06:15.546395 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 21:06:15.546395 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 21:06:15.546395 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 21:06:15.546395 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 21:06:15.546395 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVFnfV28M622GxgIau9tfOtpQOzUe_Zks3cnq6zOgmdqQwk77RE2xHy9F74fRKXOoFFtdLiZlk8HWakwyjiKYmRp9GaMJF70RmWqk8on_rfYCWM12-ITQGodTkqOwwxslvC1Btdt7aRnJVFyVeqFX--IHdQyw_AkPLTYKSNTzj-OnnLE Oct 22 21:06:15.546395 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 21:06:15.546395 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 21:06:15.546395 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 21:06:15.546395 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 21:06:15.546395 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 21:06:15.546395 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 21:06:15.546395 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: b4cd7873d6db4e09bc9ab9a048a6b1ef Oct 22 21:06:15.546395 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-DeleteServersTestJSON-1244431593 Oct 22 21:06:15.546395 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 21:06:15.546395 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 21:06:15.546395 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_b4cd7873d6db4e09bc9ab9a048a6b1ef"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b4cd7873d6db4e09bc9ab9a048a6b1ef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/b4cd7873d6db4e09bc9ab9a048a6b1ef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b4cd7873d6db4e09bc9ab9a048a6b1ef"}]}] Oct 22 21:06:15.546395 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-DeleteServersTestJSON-1244431593 Oct 22 21:06:15.546395 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: b4cd7873d6db4e09bc9ab9a048a6b1ef Oct 22 21:06:15.546395 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-DeleteServersTestJSON-1244431593 Oct 22 21:06:15.546395 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-DeleteServersTestJSON-1244431593-project Oct 22 21:06:15.546395 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 21:06:15.546395 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 21:06:15.546395 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: be1b410a64e0415a96d30f5040361137 Oct 22 21:06:15.546395 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-DeleteServersTestJSON-1244431593-project Oct 22 21:06:15.546395 ncdv-master-1 devstack@n-api.service[138745]: method: > Oct 22 21:06:15.546395 ncdv-master-1 devstack@n-api.service[138745]: exception: Instance 23f77d1a-18db-4152-a25a-d02ac1726b08 could not be found. Oct 22 21:06:15.546395 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'id': '23f77d1a-18db-4152-a25a-d02ac1726b08'} Oct 22 21:06:15.546395 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:06:15.546395 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:06:15.546395 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 21:06:15.546395 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 21:06:15.546395 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 21:06:15.546395 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 21:06:15.546395 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 21:06:15.546395 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 21:06:15.546395 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 21:06:15.546395 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 21:06:15.546395 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 23f77d1a-18db-4152-a25a-d02ac1726b08 could not be found. Oct 22 21:06:15.546395 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:06:15.546395 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:06:15.546395 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:06:15.546395 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:06:15.546395 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:06:15.546395 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:06:15.546395 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:06:15.546395 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:06:15.546395 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:06:15.546395 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:06:15.546395 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 21:06:15.546395 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 21:06:15.546395 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 21:06:15.546395 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 21:06:15.546395 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 21:06:15.546395 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:06:15.546395 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 23f77d1a-18db-4152-a25a-d02ac1726b08 could not be found. Oct 22 21:06:15.546395 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:06:15.546395 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:06:15.546395 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:06:15.551549 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:06:15.551549 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:06:15.551549 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:06:15.551549 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:06:15.551549 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:06:15.551549 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 23f77d1a-18db-4152-a25a-d02ac1726b08 could not be found. Oct 22 21:06:15.551549 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:06:15.551549 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-462eda3e-a203-47f0-bb4d-41afd5b8e3db tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Returning 404 to user: Instance 23f77d1a-18db-4152-a25a-d02ac1726b08 could not be found. {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:06:15.552765 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-462eda3e-a203-47f0-bb4d-41afd5b8e3db tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] 10.222.0.18 "GET /compute/v2.1/servers/23f77d1a-18db-4152-a25a-d02ac1726b08" status: 404 len: 111 microversion: 2.1 time: 0.045404 Oct 22 21:06:15.553764 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1810/3578] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:06:15 2022] GET /compute/v2.1/servers/23f77d1a-18db-4152-a25a-d02ac1726b08 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 22 21:06:15.562033 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-f8c2132e-86eb-454b-aa26-79a04cb9345e tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:15.562896 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-f8c2132e-86eb-454b-aa26-79a04cb9345e tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] [instance: 931293d3-cb3a-4fd1-a684-eb740f010845] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:06:15.571215 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f8c2132e-86eb-454b-aa26-79a04cb9345e tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:15.571876 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f8c2132e-86eb-454b-aa26-79a04cb9345e tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:15.572372 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f8c2132e-86eb-454b-aa26-79a04cb9345e tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:15.573829 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f8c2132e-86eb-454b-aa26-79a04cb9345e tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:15.573829 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f8c2132e-86eb-454b-aa26-79a04cb9345e tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:15.574364 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f8c2132e-86eb-454b-aa26-79a04cb9345e tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:15.585554 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-733f692e-88cd-4432-b733-10ccdf46b527 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879c85830a9f42088a4ebdf1e3cfb39b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b54f56cfbc814cccb533c65966f35a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:06:15.594145 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-733f692e-88cd-4432-b733-10ccdf46b527 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] 10.222.0.18 "GET /compute/v2.1/servers/3fdb6d35-9428-4253-ad00-932310ecdf5d" status: 200 len: 1498 microversion: 2.1 time: 0.310127 Oct 22 21:06:15.598799 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.wsgi [None req-f8c2132e-86eb-454b-aa26-79a04cb9345e tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] HTTP exception thrown: Instance 931293d3-cb3a-4fd1-a684-eb740f010845 could not be found. Oct 22 21:06:15.600841 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-f8c2132e-86eb-454b-aa26-79a04cb9345e tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Request method failure captured: Oct 22 21:06:15.600841 ncdv-master-1 devstack@n-api.service[138745]: request: DELETE /compute/v2.1/servers/931293d3-cb3a-4fd1-a684-eb740f010845 HTTP/1.1 Oct 22 21:06:15.600841 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 21:06:15.600841 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 21:06:15.600841 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 21:06:15.600841 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 0 Oct 22 21:06:15.600841 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 21:06:15.600841 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 21:06:15.600841 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 21:06:15.600841 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 21:06:15.600841 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVFnfV28M622GxgIau9tfOtpQOzUe_Zks3cnq6zOgmdqQwk77RE2xHy9F74fRKXOoFFtdLiZlk8HWakwyjiKYmRp9GaMJF70RmWqk8on_rfYCWM12-ITQGodTkqOwwxslvC1Btdt7aRnJVFyVeqFX--IHdQyw_AkPLTYKSNTzj-OnnLE Oct 22 21:06:15.600841 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 21:06:15.600841 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 21:06:15.600841 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 21:06:15.600841 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 21:06:15.600841 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 21:06:15.600841 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 21:06:15.600841 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: b4cd7873d6db4e09bc9ab9a048a6b1ef Oct 22 21:06:15.600841 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-DeleteServersTestJSON-1244431593 Oct 22 21:06:15.600841 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 21:06:15.600841 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 21:06:15.600841 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_b4cd7873d6db4e09bc9ab9a048a6b1ef"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b4cd7873d6db4e09bc9ab9a048a6b1ef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/b4cd7873d6db4e09bc9ab9a048a6b1ef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b4cd7873d6db4e09bc9ab9a048a6b1ef"}]}] Oct 22 21:06:15.600841 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-DeleteServersTestJSON-1244431593 Oct 22 21:06:15.600841 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: b4cd7873d6db4e09bc9ab9a048a6b1ef Oct 22 21:06:15.600841 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-DeleteServersTestJSON-1244431593 Oct 22 21:06:15.600841 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-DeleteServersTestJSON-1244431593-project Oct 22 21:06:15.600841 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 21:06:15.600841 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 21:06:15.600841 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: be1b410a64e0415a96d30f5040361137 Oct 22 21:06:15.600841 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-DeleteServersTestJSON-1244431593-project Oct 22 21:06:15.600841 ncdv-master-1 devstack@n-api.service[138745]: method: > Oct 22 21:06:15.600841 ncdv-master-1 devstack@n-api.service[138745]: exception: Instance 931293d3-cb3a-4fd1-a684-eb740f010845 could not be found. Oct 22 21:06:15.600841 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'id': '931293d3-cb3a-4fd1-a684-eb740f010845'} Oct 22 21:06:15.600841 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:06:15.600841 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:06:15.600841 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 21:06:15.600841 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 21:06:15.600841 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 21:06:15.600841 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 21:06:15.600841 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 21:06:15.600841 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 21:06:15.600841 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 21:06:15.600841 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 21:06:15.600841 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 931293d3-cb3a-4fd1-a684-eb740f010845 could not be found. Oct 22 21:06:15.600841 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:06:15.600841 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:06:15.600841 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:06:15.600841 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:06:15.600841 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:06:15.600841 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:06:15.600841 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:06:15.600841 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:06:15.600841 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:06:15.600841 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:06:15.600841 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 22 21:06:15.600841 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 22 21:06:15.600841 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 22 21:06:15.600841 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 22 21:06:15.600841 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 21:06:15.600841 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 21:06:15.600841 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 21:06:15.600841 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:06:15.604970 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 931293d3-cb3a-4fd1-a684-eb740f010845 could not be found. Oct 22 21:06:15.604970 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:06:15.604970 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:06:15.604970 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:06:15.604970 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:06:15.604970 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:06:15.604970 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:06:15.604970 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:06:15.604970 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:06:15.604970 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 931293d3-cb3a-4fd1-a684-eb740f010845 could not be found. Oct 22 21:06:15.604970 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:06:15.604970 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-f8c2132e-86eb-454b-aa26-79a04cb9345e tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Returning 404 to user: Instance 931293d3-cb3a-4fd1-a684-eb740f010845 could not be found. {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:06:15.604970 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-f8c2132e-86eb-454b-aa26-79a04cb9345e tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] 10.222.0.18 "DELETE /compute/v2.1/servers/931293d3-cb3a-4fd1-a684-eb740f010845" status: 404 len: 111 microversion: 2.1 time: 0.045430 Oct 22 21:06:15.605802 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1769/3579] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:06:15 2022] GET /compute/v2.1/servers/3fdb6d35-9428-4253-ad00-932310ecdf5d => generated 1498 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:06:15.607779 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1811/3580] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 21:06:15 2022] DELETE /compute/v2.1/servers/931293d3-cb3a-4fd1-a684-eb740f010845 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 21:06:15.621122 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-aa2c70af-28c8-474d-af4b-e4d91498489e tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:15.621780 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-aa2c70af-28c8-474d-af4b-e4d91498489e tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] [instance: 931293d3-cb3a-4fd1-a684-eb740f010845] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:06:15.622353 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-d386d57e-3d14-4084-9dc2-62306fd30f7e tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:15.622874 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-d386d57e-3d14-4084-9dc2-62306fd30f7e tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] [instance: 3fdb6d35-9428-4253-ad00-932310ecdf5d] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:06:15.628345 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-aa2c70af-28c8-474d-af4b-e4d91498489e tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:15.628876 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-aa2c70af-28c8-474d-af4b-e4d91498489e tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:15.629573 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-aa2c70af-28c8-474d-af4b-e4d91498489e tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:15.630305 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-aa2c70af-28c8-474d-af4b-e4d91498489e tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:15.630750 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-aa2c70af-28c8-474d-af4b-e4d91498489e tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:15.631181 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-aa2c70af-28c8-474d-af4b-e4d91498489e tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:15.632787 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d386d57e-3d14-4084-9dc2-62306fd30f7e tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:15.635963 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d386d57e-3d14-4084-9dc2-62306fd30f7e tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:15.642242 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d386d57e-3d14-4084-9dc2-62306fd30f7e tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:15.643721 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d386d57e-3d14-4084-9dc2-62306fd30f7e tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:15.644435 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d386d57e-3d14-4084-9dc2-62306fd30f7e tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:15.646434 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d386d57e-3d14-4084-9dc2-62306fd30f7e tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:15.662133 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-aa2c70af-28c8-474d-af4b-e4d91498489e tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] HTTP exception thrown: Instance 931293d3-cb3a-4fd1-a684-eb740f010845 could not be found. Oct 22 21:06:15.664014 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-aa2c70af-28c8-474d-af4b-e4d91498489e tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Request method failure captured: Oct 22 21:06:15.664014 ncdv-master-1 devstack@n-api.service[138744]: request: GET /compute/v2.1/servers/931293d3-cb3a-4fd1-a684-eb740f010845 HTTP/1.1 Oct 22 21:06:15.664014 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 21:06:15.664014 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 21:06:15.664014 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 21:06:15.664014 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 0 Oct 22 21:06:15.664014 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 21:06:15.664014 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 21:06:15.664014 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 21:06:15.664014 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 21:06:15.664014 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVFnfV28M622GxgIau9tfOtpQOzUe_Zks3cnq6zOgmdqQwk77RE2xHy9F74fRKXOoFFtdLiZlk8HWakwyjiKYmRp9GaMJF70RmWqk8on_rfYCWM12-ITQGodTkqOwwxslvC1Btdt7aRnJVFyVeqFX--IHdQyw_AkPLTYKSNTzj-OnnLE Oct 22 21:06:15.664014 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 21:06:15.664014 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 21:06:15.664014 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 21:06:15.664014 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 21:06:15.664014 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 21:06:15.664014 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 21:06:15.664014 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: b4cd7873d6db4e09bc9ab9a048a6b1ef Oct 22 21:06:15.664014 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-DeleteServersTestJSON-1244431593 Oct 22 21:06:15.664014 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 21:06:15.664014 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 21:06:15.664014 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_b4cd7873d6db4e09bc9ab9a048a6b1ef"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b4cd7873d6db4e09bc9ab9a048a6b1ef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/b4cd7873d6db4e09bc9ab9a048a6b1ef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b4cd7873d6db4e09bc9ab9a048a6b1ef"}]}] Oct 22 21:06:15.664014 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-DeleteServersTestJSON-1244431593 Oct 22 21:06:15.664014 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: b4cd7873d6db4e09bc9ab9a048a6b1ef Oct 22 21:06:15.664014 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-DeleteServersTestJSON-1244431593 Oct 22 21:06:15.664014 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-DeleteServersTestJSON-1244431593-project Oct 22 21:06:15.664014 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 21:06:15.664014 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 21:06:15.664014 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: be1b410a64e0415a96d30f5040361137 Oct 22 21:06:15.664014 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-DeleteServersTestJSON-1244431593-project Oct 22 21:06:15.664014 ncdv-master-1 devstack@n-api.service[138744]: method: > Oct 22 21:06:15.664014 ncdv-master-1 devstack@n-api.service[138744]: exception: Instance 931293d3-cb3a-4fd1-a684-eb740f010845 could not be found. Oct 22 21:06:15.664014 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': '931293d3-cb3a-4fd1-a684-eb740f010845'} Oct 22 21:06:15.664014 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:06:15.664014 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:06:15.664014 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 21:06:15.664014 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 21:06:15.664014 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 21:06:15.664014 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 21:06:15.664014 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 21:06:15.664014 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 21:06:15.664014 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 21:06:15.664014 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 21:06:15.664014 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 931293d3-cb3a-4fd1-a684-eb740f010845 could not be found. Oct 22 21:06:15.664014 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:06:15.664014 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:06:15.664014 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:06:15.664014 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:06:15.664014 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:06:15.664014 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:06:15.664014 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:06:15.664014 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:06:15.664014 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:06:15.664014 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:06:15.664014 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 21:06:15.664014 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 21:06:15.664014 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 21:06:15.664014 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 21:06:15.664014 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 21:06:15.664014 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:06:15.664014 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 931293d3-cb3a-4fd1-a684-eb740f010845 could not be found. Oct 22 21:06:15.664014 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:06:15.664014 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:06:15.664014 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:06:15.667305 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:06:15.667305 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:06:15.667305 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:06:15.667305 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:06:15.667305 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:06:15.667305 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 931293d3-cb3a-4fd1-a684-eb740f010845 could not be found. Oct 22 21:06:15.667305 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:06:15.669061 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-aa2c70af-28c8-474d-af4b-e4d91498489e tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Returning 404 to user: Instance 931293d3-cb3a-4fd1-a684-eb740f010845 could not be found. {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:06:15.670398 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-aa2c70af-28c8-474d-af4b-e4d91498489e tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] 10.222.0.18 "GET /compute/v2.1/servers/931293d3-cb3a-4fd1-a684-eb740f010845" status: 404 len: 111 microversion: 2.1 time: 0.059690 Oct 22 21:06:15.671537 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1770/3581] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:06:15 2022] GET /compute/v2.1/servers/931293d3-cb3a-4fd1-a684-eb740f010845 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 21:06:15.682121 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-d386d57e-3d14-4084-9dc2-62306fd30f7e tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] [instance: 3fdb6d35-9428-4253-ad00-932310ecdf5d] Going to try to terminate instance {{(pid=138745) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 21:06:15.686842 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-5a16d120-6d83-4811-8c90-b28964b5d345 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:15.687503 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-5a16d120-6d83-4811-8c90-b28964b5d345 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] [instance: a99614d8-f2f7-4ce1-87e8-47f3af03d9f8] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:06:15.704640 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5a16d120-6d83-4811-8c90-b28964b5d345 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:15.705210 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5a16d120-6d83-4811-8c90-b28964b5d345 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:15.705650 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5a16d120-6d83-4811-8c90-b28964b5d345 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:15.706391 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5a16d120-6d83-4811-8c90-b28964b5d345 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:15.707757 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5a16d120-6d83-4811-8c90-b28964b5d345 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:15.707757 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5a16d120-6d83-4811-8c90-b28964b5d345 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:15.725896 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-5a16d120-6d83-4811-8c90-b28964b5d345 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] HTTP exception thrown: Instance a99614d8-f2f7-4ce1-87e8-47f3af03d9f8 could not be found. Oct 22 21:06:15.728491 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-5a16d120-6d83-4811-8c90-b28964b5d345 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Request method failure captured: Oct 22 21:06:15.728491 ncdv-master-1 devstack@n-api.service[138744]: request: DELETE /compute/v2.1/servers/a99614d8-f2f7-4ce1-87e8-47f3af03d9f8 HTTP/1.1 Oct 22 21:06:15.728491 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 21:06:15.728491 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 21:06:15.728491 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 21:06:15.728491 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 0 Oct 22 21:06:15.728491 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 21:06:15.728491 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 21:06:15.728491 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 21:06:15.728491 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 21:06:15.728491 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVFnfV28M622GxgIau9tfOtpQOzUe_Zks3cnq6zOgmdqQwk77RE2xHy9F74fRKXOoFFtdLiZlk8HWakwyjiKYmRp9GaMJF70RmWqk8on_rfYCWM12-ITQGodTkqOwwxslvC1Btdt7aRnJVFyVeqFX--IHdQyw_AkPLTYKSNTzj-OnnLE Oct 22 21:06:15.728491 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 21:06:15.728491 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 21:06:15.728491 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 21:06:15.728491 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 21:06:15.728491 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 21:06:15.728491 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 21:06:15.728491 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: b4cd7873d6db4e09bc9ab9a048a6b1ef Oct 22 21:06:15.728491 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-DeleteServersTestJSON-1244431593 Oct 22 21:06:15.728491 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 21:06:15.728491 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 21:06:15.728491 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_b4cd7873d6db4e09bc9ab9a048a6b1ef"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b4cd7873d6db4e09bc9ab9a048a6b1ef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/b4cd7873d6db4e09bc9ab9a048a6b1ef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b4cd7873d6db4e09bc9ab9a048a6b1ef"}]}] Oct 22 21:06:15.728491 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-DeleteServersTestJSON-1244431593 Oct 22 21:06:15.728491 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: b4cd7873d6db4e09bc9ab9a048a6b1ef Oct 22 21:06:15.728491 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-DeleteServersTestJSON-1244431593 Oct 22 21:06:15.728491 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-DeleteServersTestJSON-1244431593-project Oct 22 21:06:15.728491 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 21:06:15.728491 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 21:06:15.728491 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: be1b410a64e0415a96d30f5040361137 Oct 22 21:06:15.728491 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-DeleteServersTestJSON-1244431593-project Oct 22 21:06:15.728491 ncdv-master-1 devstack@n-api.service[138744]: method: > Oct 22 21:06:15.728491 ncdv-master-1 devstack@n-api.service[138744]: exception: Instance a99614d8-f2f7-4ce1-87e8-47f3af03d9f8 could not be found. Oct 22 21:06:15.728491 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': 'a99614d8-f2f7-4ce1-87e8-47f3af03d9f8'} Oct 22 21:06:15.728491 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:06:15.728491 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:06:15.728491 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 21:06:15.728491 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 21:06:15.728491 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 21:06:15.728491 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 21:06:15.728491 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 21:06:15.728491 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 21:06:15.728491 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 21:06:15.728491 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 21:06:15.728491 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a99614d8-f2f7-4ce1-87e8-47f3af03d9f8 could not be found. Oct 22 21:06:15.728491 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:06:15.728491 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:06:15.728491 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:06:15.728491 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:06:15.728491 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:06:15.728491 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:06:15.728491 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:06:15.728491 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:06:15.728491 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:06:15.728491 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:06:15.728491 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 22 21:06:15.728491 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 22 21:06:15.728491 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 22 21:06:15.728491 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 22 21:06:15.728491 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 21:06:15.728491 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 21:06:15.728491 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 21:06:15.728491 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:06:15.731841 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a99614d8-f2f7-4ce1-87e8-47f3af03d9f8 could not be found. Oct 22 21:06:15.731841 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:06:15.731841 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:06:15.731841 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:06:15.731841 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:06:15.731841 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:06:15.731841 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:06:15.731841 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:06:15.731841 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:06:15.731841 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a99614d8-f2f7-4ce1-87e8-47f3af03d9f8 could not be found. Oct 22 21:06:15.731841 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:06:15.734111 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-5a16d120-6d83-4811-8c90-b28964b5d345 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Returning 404 to user: Instance a99614d8-f2f7-4ce1-87e8-47f3af03d9f8 could not be found. {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:06:15.735148 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-5a16d120-6d83-4811-8c90-b28964b5d345 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] 10.222.0.18 "DELETE /compute/v2.1/servers/a99614d8-f2f7-4ce1-87e8-47f3af03d9f8" status: 404 len: 111 microversion: 2.1 time: 0.058937 Oct 22 21:06:15.736199 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1771/3582] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 21:06:15 2022] DELETE /compute/v2.1/servers/a99614d8-f2f7-4ce1-87e8-47f3af03d9f8 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 21:06:15.744943 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-d6637e9f-83ea-4323-b70f-99f8df2b1538 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:15.745591 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-d6637e9f-83ea-4323-b70f-99f8df2b1538 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] [instance: a99614d8-f2f7-4ce1-87e8-47f3af03d9f8] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:06:15.752251 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d6637e9f-83ea-4323-b70f-99f8df2b1538 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:15.754435 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d6637e9f-83ea-4323-b70f-99f8df2b1538 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:15.754964 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d6637e9f-83ea-4323-b70f-99f8df2b1538 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:15.755784 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d6637e9f-83ea-4323-b70f-99f8df2b1538 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:15.756314 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d6637e9f-83ea-4323-b70f-99f8df2b1538 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:15.757035 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d6637e9f-83ea-4323-b70f-99f8df2b1538 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:15.778847 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-d6637e9f-83ea-4323-b70f-99f8df2b1538 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] HTTP exception thrown: Instance a99614d8-f2f7-4ce1-87e8-47f3af03d9f8 could not be found. Oct 22 21:06:15.780457 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-d6637e9f-83ea-4323-b70f-99f8df2b1538 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Request method failure captured: Oct 22 21:06:15.780457 ncdv-master-1 devstack@n-api.service[138744]: request: GET /compute/v2.1/servers/a99614d8-f2f7-4ce1-87e8-47f3af03d9f8 HTTP/1.1 Oct 22 21:06:15.780457 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 21:06:15.780457 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 21:06:15.780457 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 21:06:15.780457 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 0 Oct 22 21:06:15.780457 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 21:06:15.780457 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 21:06:15.780457 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 21:06:15.780457 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 21:06:15.780457 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVFnfV28M622GxgIau9tfOtpQOzUe_Zks3cnq6zOgmdqQwk77RE2xHy9F74fRKXOoFFtdLiZlk8HWakwyjiKYmRp9GaMJF70RmWqk8on_rfYCWM12-ITQGodTkqOwwxslvC1Btdt7aRnJVFyVeqFX--IHdQyw_AkPLTYKSNTzj-OnnLE Oct 22 21:06:15.780457 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 21:06:15.780457 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 21:06:15.780457 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 21:06:15.780457 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 21:06:15.780457 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 21:06:15.780457 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 21:06:15.780457 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: b4cd7873d6db4e09bc9ab9a048a6b1ef Oct 22 21:06:15.780457 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-DeleteServersTestJSON-1244431593 Oct 22 21:06:15.780457 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 21:06:15.780457 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 21:06:15.780457 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_b4cd7873d6db4e09bc9ab9a048a6b1ef"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b4cd7873d6db4e09bc9ab9a048a6b1ef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/b4cd7873d6db4e09bc9ab9a048a6b1ef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b4cd7873d6db4e09bc9ab9a048a6b1ef"}]}] Oct 22 21:06:15.780457 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-DeleteServersTestJSON-1244431593 Oct 22 21:06:15.780457 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: b4cd7873d6db4e09bc9ab9a048a6b1ef Oct 22 21:06:15.780457 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-DeleteServersTestJSON-1244431593 Oct 22 21:06:15.780457 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-DeleteServersTestJSON-1244431593-project Oct 22 21:06:15.780457 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 21:06:15.780457 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 21:06:15.780457 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: be1b410a64e0415a96d30f5040361137 Oct 22 21:06:15.780457 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-DeleteServersTestJSON-1244431593-project Oct 22 21:06:15.780457 ncdv-master-1 devstack@n-api.service[138744]: method: > Oct 22 21:06:15.780457 ncdv-master-1 devstack@n-api.service[138744]: exception: Instance a99614d8-f2f7-4ce1-87e8-47f3af03d9f8 could not be found. Oct 22 21:06:15.780457 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': 'a99614d8-f2f7-4ce1-87e8-47f3af03d9f8'} Oct 22 21:06:15.780457 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:06:15.780457 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:06:15.780457 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 21:06:15.780457 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 21:06:15.780457 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 21:06:15.780457 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 21:06:15.780457 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 21:06:15.780457 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 21:06:15.780457 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 21:06:15.780457 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 21:06:15.780457 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a99614d8-f2f7-4ce1-87e8-47f3af03d9f8 could not be found. Oct 22 21:06:15.780457 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:06:15.780457 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:06:15.780457 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:06:15.780457 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:06:15.780457 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:06:15.780457 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:06:15.780457 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:06:15.780457 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:06:15.780457 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:06:15.780457 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:06:15.780457 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 21:06:15.780457 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 21:06:15.780457 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 21:06:15.780457 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 21:06:15.780457 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 21:06:15.780457 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:06:15.780457 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a99614d8-f2f7-4ce1-87e8-47f3af03d9f8 could not be found. Oct 22 21:06:15.780457 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:06:15.780457 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:06:15.780457 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:06:15.783829 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:06:15.783829 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:06:15.783829 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:06:15.783829 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:06:15.783829 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:06:15.783829 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a99614d8-f2f7-4ce1-87e8-47f3af03d9f8 could not be found. Oct 22 21:06:15.783829 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:06:15.783829 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-d6637e9f-83ea-4323-b70f-99f8df2b1538 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Returning 404 to user: Instance a99614d8-f2f7-4ce1-87e8-47f3af03d9f8 could not be found. {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:06:15.784255 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-d6637e9f-83ea-4323-b70f-99f8df2b1538 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] 10.222.0.18 "GET /compute/v2.1/servers/a99614d8-f2f7-4ce1-87e8-47f3af03d9f8" status: 404 len: 111 microversion: 2.1 time: 0.044042 Oct 22 21:06:15.786888 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1772/3583] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:06:15 2022] GET /compute/v2.1/servers/a99614d8-f2f7-4ce1-87e8-47f3af03d9f8 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 22 21:06:15.793732 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-2df33344-e14a-4679-8c36-c2a540e8baf7 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:15.794260 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-2df33344-e14a-4679-8c36-c2a540e8baf7 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] [instance: 321b545b-7228-4a30-bd7b-dcd827a0c747] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:06:15.814065 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2df33344-e14a-4679-8c36-c2a540e8baf7 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:15.814694 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2df33344-e14a-4679-8c36-c2a540e8baf7 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:15.815912 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2df33344-e14a-4679-8c36-c2a540e8baf7 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:15.816695 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2df33344-e14a-4679-8c36-c2a540e8baf7 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:15.817397 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2df33344-e14a-4679-8c36-c2a540e8baf7 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:15.818255 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2df33344-e14a-4679-8c36-c2a540e8baf7 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:15.828369 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-d386d57e-3d14-4084-9dc2-62306fd30f7e tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] 10.222.0.18 "DELETE /compute/v2.1/servers/3fdb6d35-9428-4253-ad00-932310ecdf5d" status: 204 len: 0 microversion: 2.1 time: 0.208792 Oct 22 21:06:15.830780 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1812/3584] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 21:06:15 2022] DELETE /compute/v2.1/servers/3fdb6d35-9428-4253-ad00-932310ecdf5d => generated 0 bytes in 213 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 22 21:06:15.843114 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-2df33344-e14a-4679-8c36-c2a540e8baf7 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] HTTP exception thrown: Instance 321b545b-7228-4a30-bd7b-dcd827a0c747 could not be found. Oct 22 21:06:15.845038 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-2df33344-e14a-4679-8c36-c2a540e8baf7 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Request method failure captured: Oct 22 21:06:15.845038 ncdv-master-1 devstack@n-api.service[138744]: request: DELETE /compute/v2.1/servers/321b545b-7228-4a30-bd7b-dcd827a0c747 HTTP/1.1 Oct 22 21:06:15.845038 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 21:06:15.845038 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 21:06:15.845038 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 21:06:15.845038 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 0 Oct 22 21:06:15.845038 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 21:06:15.845038 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 21:06:15.845038 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 21:06:15.845038 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 21:06:15.845038 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVFnfV28M622GxgIau9tfOtpQOzUe_Zks3cnq6zOgmdqQwk77RE2xHy9F74fRKXOoFFtdLiZlk8HWakwyjiKYmRp9GaMJF70RmWqk8on_rfYCWM12-ITQGodTkqOwwxslvC1Btdt7aRnJVFyVeqFX--IHdQyw_AkPLTYKSNTzj-OnnLE Oct 22 21:06:15.845038 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 21:06:15.845038 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 21:06:15.845038 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 21:06:15.845038 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 21:06:15.845038 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 21:06:15.845038 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 21:06:15.845038 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: b4cd7873d6db4e09bc9ab9a048a6b1ef Oct 22 21:06:15.845038 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-DeleteServersTestJSON-1244431593 Oct 22 21:06:15.845038 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 21:06:15.845038 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 21:06:15.845038 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_b4cd7873d6db4e09bc9ab9a048a6b1ef"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b4cd7873d6db4e09bc9ab9a048a6b1ef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/b4cd7873d6db4e09bc9ab9a048a6b1ef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b4cd7873d6db4e09bc9ab9a048a6b1ef"}]}] Oct 22 21:06:15.845038 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-DeleteServersTestJSON-1244431593 Oct 22 21:06:15.845038 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: b4cd7873d6db4e09bc9ab9a048a6b1ef Oct 22 21:06:15.845038 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-DeleteServersTestJSON-1244431593 Oct 22 21:06:15.845038 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-DeleteServersTestJSON-1244431593-project Oct 22 21:06:15.845038 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 21:06:15.845038 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 21:06:15.845038 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: be1b410a64e0415a96d30f5040361137 Oct 22 21:06:15.845038 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-DeleteServersTestJSON-1244431593-project Oct 22 21:06:15.845038 ncdv-master-1 devstack@n-api.service[138744]: method: > Oct 22 21:06:15.845038 ncdv-master-1 devstack@n-api.service[138744]: exception: Instance 321b545b-7228-4a30-bd7b-dcd827a0c747 could not be found. Oct 22 21:06:15.845038 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': '321b545b-7228-4a30-bd7b-dcd827a0c747'} Oct 22 21:06:15.845038 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:06:15.845038 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:06:15.845038 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 21:06:15.845038 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 21:06:15.845038 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 21:06:15.845038 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 21:06:15.845038 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 21:06:15.845038 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 21:06:15.845038 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 21:06:15.845038 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 21:06:15.845038 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 321b545b-7228-4a30-bd7b-dcd827a0c747 could not be found. Oct 22 21:06:15.845038 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:06:15.845038 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:06:15.845038 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:06:15.845038 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:06:15.845038 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:06:15.845038 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:06:15.845038 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:06:15.845038 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:06:15.845038 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:06:15.845038 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:06:15.845038 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 22 21:06:15.845038 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 22 21:06:15.845038 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 22 21:06:15.845038 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 22 21:06:15.845038 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 21:06:15.845038 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 21:06:15.845038 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 21:06:15.845038 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:06:15.848340 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 321b545b-7228-4a30-bd7b-dcd827a0c747 could not be found. Oct 22 21:06:15.848340 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:06:15.848340 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:06:15.848340 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:06:15.848340 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:06:15.848340 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:06:15.848340 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:06:15.848340 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:06:15.848340 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:06:15.848340 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 321b545b-7228-4a30-bd7b-dcd827a0c747 could not be found. Oct 22 21:06:15.848340 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:06:15.849014 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-e64d26f7-b10e-42f1-bd8f-e8367c7492fd tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:15.849014 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-e64d26f7-b10e-42f1-bd8f-e8367c7492fd tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] [instance: 3fdb6d35-9428-4253-ad00-932310ecdf5d] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:06:15.850732 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-2df33344-e14a-4679-8c36-c2a540e8baf7 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Returning 404 to user: Instance 321b545b-7228-4a30-bd7b-dcd827a0c747 could not be found. {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:06:15.851662 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-2df33344-e14a-4679-8c36-c2a540e8baf7 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] 10.222.0.18 "DELETE /compute/v2.1/servers/321b545b-7228-4a30-bd7b-dcd827a0c747" status: 404 len: 111 microversion: 2.1 time: 0.061984 Oct 22 21:06:15.852432 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1773/3585] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 21:06:15 2022] DELETE /compute/v2.1/servers/321b545b-7228-4a30-bd7b-dcd827a0c747 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 21:06:15.857856 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-dfea9bb2-0f1b-42e1-8b33-4f0461a7df5a tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:15.859930 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-dfea9bb2-0f1b-42e1-8b33-4f0461a7df5a tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] [instance: e09b7865-0b24-4e50-a66a-342dd2e6e5e3] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:06:15.863397 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e64d26f7-b10e-42f1-bd8f-e8367c7492fd tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:15.864040 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e64d26f7-b10e-42f1-bd8f-e8367c7492fd tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:15.864787 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e64d26f7-b10e-42f1-bd8f-e8367c7492fd tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:15.865851 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e64d26f7-b10e-42f1-bd8f-e8367c7492fd tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:15.867757 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-dfea9bb2-0f1b-42e1-8b33-4f0461a7df5a tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:15.868320 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e64d26f7-b10e-42f1-bd8f-e8367c7492fd tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:15.868560 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-dfea9bb2-0f1b-42e1-8b33-4f0461a7df5a tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:15.869152 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-dfea9bb2-0f1b-42e1-8b33-4f0461a7df5a tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:15.869420 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e64d26f7-b10e-42f1-bd8f-e8367c7492fd tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:15.870517 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-dfea9bb2-0f1b-42e1-8b33-4f0461a7df5a tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:15.871117 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-dfea9bb2-0f1b-42e1-8b33-4f0461a7df5a tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:15.871859 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-dfea9bb2-0f1b-42e1-8b33-4f0461a7df5a tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:16.228462 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-dfea9bb2-0f1b-42e1-8b33-4f0461a7df5a tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcdfeb6c1cda4810b9fa70fdfd9a66c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c774a85b2c41c98486cf91b1253363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:06:16.243576 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-dfea9bb2-0f1b-42e1-8b33-4f0461a7df5a tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] 10.222.0.18 "GET /compute/v2.1/servers/e09b7865-0b24-4e50-a66a-342dd2e6e5e3" status: 200 len: 1515 microversion: 2.1 time: 0.389155 Oct 22 21:06:16.244844 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1774/3586] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:06:15 2022] GET /compute/v2.1/servers/e09b7865-0b24-4e50-a66a-342dd2e6e5e3 => generated 1515 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:06:16.261286 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-e64d26f7-b10e-42f1-bd8f-e8367c7492fd tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879c85830a9f42088a4ebdf1e3cfb39b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b54f56cfbc814cccb533c65966f35a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:06:16.268689 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-2260eb50-1aa9-4755-adb0-640f9599a919 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:16.270286 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-2260eb50-1aa9-4755-adb0-640f9599a919 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] [instance: 321b545b-7228-4a30-bd7b-dcd827a0c747] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:06:16.278469 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2260eb50-1aa9-4755-adb0-640f9599a919 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:16.279041 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-e64d26f7-b10e-42f1-bd8f-e8367c7492fd tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] 10.222.0.18 "GET /compute/v2.1/servers/3fdb6d35-9428-4253-ad00-932310ecdf5d" status: 200 len: 1504 microversion: 2.1 time: 0.443395 Oct 22 21:06:16.279273 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2260eb50-1aa9-4755-adb0-640f9599a919 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:16.279953 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2260eb50-1aa9-4755-adb0-640f9599a919 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:16.280688 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2260eb50-1aa9-4755-adb0-640f9599a919 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:16.281133 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2260eb50-1aa9-4755-adb0-640f9599a919 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:16.281566 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2260eb50-1aa9-4755-adb0-640f9599a919 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:16.282095 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1813/3587] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:06:15 2022] GET /compute/v2.1/servers/3fdb6d35-9428-4253-ad00-932310ecdf5d => generated 1504 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:06:16.292511 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-50e06704-c0e8-4a38-8fcc-8434fef5120c tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:16.294011 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-50e06704-c0e8-4a38-8fcc-8434fef5120c tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] [instance: e24e9888-adfe-455c-b53e-da3bf5729d69] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:06:16.301493 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-50e06704-c0e8-4a38-8fcc-8434fef5120c tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:16.302098 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-50e06704-c0e8-4a38-8fcc-8434fef5120c tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:16.302628 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-50e06704-c0e8-4a38-8fcc-8434fef5120c tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:16.304211 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-50e06704-c0e8-4a38-8fcc-8434fef5120c tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:16.304793 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-50e06704-c0e8-4a38-8fcc-8434fef5120c tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:16.305262 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-50e06704-c0e8-4a38-8fcc-8434fef5120c tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:16.311307 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-2260eb50-1aa9-4755-adb0-640f9599a919 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] HTTP exception thrown: Instance 321b545b-7228-4a30-bd7b-dcd827a0c747 could not be found. Oct 22 21:06:16.313775 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-2260eb50-1aa9-4755-adb0-640f9599a919 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Request method failure captured: Oct 22 21:06:16.313775 ncdv-master-1 devstack@n-api.service[138744]: request: GET /compute/v2.1/servers/321b545b-7228-4a30-bd7b-dcd827a0c747 HTTP/1.1 Oct 22 21:06:16.313775 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 21:06:16.313775 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 21:06:16.313775 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 21:06:16.313775 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 0 Oct 22 21:06:16.313775 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 21:06:16.313775 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 21:06:16.313775 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 21:06:16.313775 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 21:06:16.313775 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVFnfV28M622GxgIau9tfOtpQOzUe_Zks3cnq6zOgmdqQwk77RE2xHy9F74fRKXOoFFtdLiZlk8HWakwyjiKYmRp9GaMJF70RmWqk8on_rfYCWM12-ITQGodTkqOwwxslvC1Btdt7aRnJVFyVeqFX--IHdQyw_AkPLTYKSNTzj-OnnLE Oct 22 21:06:16.313775 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 21:06:16.313775 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 21:06:16.313775 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 21:06:16.313775 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 21:06:16.313775 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 21:06:16.313775 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 21:06:16.313775 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: b4cd7873d6db4e09bc9ab9a048a6b1ef Oct 22 21:06:16.313775 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-DeleteServersTestJSON-1244431593 Oct 22 21:06:16.313775 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 21:06:16.313775 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 21:06:16.313775 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_b4cd7873d6db4e09bc9ab9a048a6b1ef"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b4cd7873d6db4e09bc9ab9a048a6b1ef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/b4cd7873d6db4e09bc9ab9a048a6b1ef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b4cd7873d6db4e09bc9ab9a048a6b1ef"}]}] Oct 22 21:06:16.313775 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-DeleteServersTestJSON-1244431593 Oct 22 21:06:16.313775 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: b4cd7873d6db4e09bc9ab9a048a6b1ef Oct 22 21:06:16.313775 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-DeleteServersTestJSON-1244431593 Oct 22 21:06:16.313775 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-DeleteServersTestJSON-1244431593-project Oct 22 21:06:16.313775 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 21:06:16.313775 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 21:06:16.313775 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: be1b410a64e0415a96d30f5040361137 Oct 22 21:06:16.313775 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-DeleteServersTestJSON-1244431593-project Oct 22 21:06:16.313775 ncdv-master-1 devstack@n-api.service[138744]: method: > Oct 22 21:06:16.313775 ncdv-master-1 devstack@n-api.service[138744]: exception: Instance 321b545b-7228-4a30-bd7b-dcd827a0c747 could not be found. Oct 22 21:06:16.313775 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': '321b545b-7228-4a30-bd7b-dcd827a0c747'} Oct 22 21:06:16.313775 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:06:16.313775 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:06:16.313775 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 21:06:16.313775 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 21:06:16.313775 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 21:06:16.313775 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 21:06:16.313775 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 21:06:16.313775 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 21:06:16.313775 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 21:06:16.313775 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 21:06:16.313775 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 321b545b-7228-4a30-bd7b-dcd827a0c747 could not be found. Oct 22 21:06:16.313775 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:06:16.313775 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:06:16.313775 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:06:16.313775 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:06:16.313775 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:06:16.313775 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:06:16.313775 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:06:16.313775 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:06:16.313775 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:06:16.313775 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:06:16.313775 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 21:06:16.313775 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 21:06:16.313775 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 21:06:16.313775 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 21:06:16.313775 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 21:06:16.313775 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:06:16.313775 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 321b545b-7228-4a30-bd7b-dcd827a0c747 could not be found. Oct 22 21:06:16.313775 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:06:16.313775 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:06:16.313775 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:06:16.321536 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:06:16.321536 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:06:16.321536 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:06:16.321536 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:06:16.321536 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:06:16.321536 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 321b545b-7228-4a30-bd7b-dcd827a0c747 could not be found. Oct 22 21:06:16.321536 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:06:16.321536 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-2260eb50-1aa9-4755-adb0-640f9599a919 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Returning 404 to user: Instance 321b545b-7228-4a30-bd7b-dcd827a0c747 could not be found. {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:06:16.321536 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-2260eb50-1aa9-4755-adb0-640f9599a919 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] 10.222.0.18 "GET /compute/v2.1/servers/321b545b-7228-4a30-bd7b-dcd827a0c747" status: 404 len: 111 microversion: 2.1 time: 0.051388 Oct 22 21:06:16.321536 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1775/3588] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:06:16 2022] GET /compute/v2.1/servers/321b545b-7228-4a30-bd7b-dcd827a0c747 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 21:06:16.332898 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-a14dafc0-eef6-4947-93d0-ca7818a40dc3 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:16.333526 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-a14dafc0-eef6-4947-93d0-ca7818a40dc3 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] [instance: 6b3e8fcb-7327-45f4-815d-c7b43ed4db97] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:06:16.339941 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a14dafc0-eef6-4947-93d0-ca7818a40dc3 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:16.340424 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a14dafc0-eef6-4947-93d0-ca7818a40dc3 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:16.340861 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a14dafc0-eef6-4947-93d0-ca7818a40dc3 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:16.341860 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a14dafc0-eef6-4947-93d0-ca7818a40dc3 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:16.342317 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a14dafc0-eef6-4947-93d0-ca7818a40dc3 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:16.342745 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a14dafc0-eef6-4947-93d0-ca7818a40dc3 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:16.357786 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-a14dafc0-eef6-4947-93d0-ca7818a40dc3 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] HTTP exception thrown: Instance 6b3e8fcb-7327-45f4-815d-c7b43ed4db97 could not be found. Oct 22 21:06:16.359374 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-a14dafc0-eef6-4947-93d0-ca7818a40dc3 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Request method failure captured: Oct 22 21:06:16.359374 ncdv-master-1 devstack@n-api.service[138744]: request: GET /compute/v2.1/servers/6b3e8fcb-7327-45f4-815d-c7b43ed4db97 HTTP/1.1 Oct 22 21:06:16.359374 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 21:06:16.359374 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 21:06:16.359374 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 21:06:16.359374 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 0 Oct 22 21:06:16.359374 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 21:06:16.359374 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 21:06:16.359374 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 21:06:16.359374 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 21:06:16.359374 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVFshB2FaXjU-nH9IJhtxGR0K15vo1GfunA5aVUh6spJhkoSRwqjvXVwjvbtbGA2XnsSRowBwQYLUhDuWIRcono1a70dg0ItN57HKM82-k2BfG7MVHMupgxarbFxedDGUGUy19Nt0tC_M-YhTRLu21DbvQ2GTBSQGKKFLPsOi0lEUluc Oct 22 21:06:16.359374 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 21:06:16.359374 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 21:06:16.359374 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 21:06:16.359374 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 21:06:16.359374 ncdv-master-1 devstack@n-api.service[138744]: X-Openstack-Nova-Api-Version: 2.26 Oct 22 21:06:16.359374 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 21:06:16.359374 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 21:06:16.359374 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: 6cac03b202c142deb478e3328397d402 Oct 22 21:06:16.359374 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-ServerTagsTestJSON-1816993422 Oct 22 21:06:16.359374 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 21:06:16.359374 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 21:06:16.359374 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_6cac03b202c142deb478e3328397d402"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6cac03b202c142deb478e3328397d402"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/6cac03b202c142deb478e3328397d402"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6cac03b202c142deb478e3328397d402"}]}] Oct 22 21:06:16.359374 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-ServerTagsTestJSON-1816993422 Oct 22 21:06:16.359374 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: 6cac03b202c142deb478e3328397d402 Oct 22 21:06:16.359374 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-ServerTagsTestJSON-1816993422 Oct 22 21:06:16.359374 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-ServerTagsTestJSON-1816993422-project Oct 22 21:06:16.359374 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 21:06:16.359374 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 21:06:16.359374 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: 90ed2d6013024c278551a2c9cd961f44 Oct 22 21:06:16.359374 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-ServerTagsTestJSON-1816993422-project Oct 22 21:06:16.359374 ncdv-master-1 devstack@n-api.service[138744]: method: > Oct 22 21:06:16.359374 ncdv-master-1 devstack@n-api.service[138744]: exception: Instance 6b3e8fcb-7327-45f4-815d-c7b43ed4db97 could not be found. Oct 22 21:06:16.359374 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': '6b3e8fcb-7327-45f4-815d-c7b43ed4db97'} Oct 22 21:06:16.359374 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:06:16.359374 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:06:16.359374 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 21:06:16.359374 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 21:06:16.359374 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 21:06:16.359374 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 21:06:16.359374 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 21:06:16.359374 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 21:06:16.359374 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 21:06:16.359374 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 21:06:16.359374 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6b3e8fcb-7327-45f4-815d-c7b43ed4db97 could not be found. Oct 22 21:06:16.359374 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:06:16.359374 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:06:16.359374 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:06:16.359374 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:06:16.359374 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:06:16.359374 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:06:16.359374 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:06:16.359374 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:06:16.359374 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:06:16.359374 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:06:16.359374 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 21:06:16.359374 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 21:06:16.359374 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 21:06:16.359374 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 21:06:16.359374 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 21:06:16.359374 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:06:16.359374 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6b3e8fcb-7327-45f4-815d-c7b43ed4db97 could not be found. Oct 22 21:06:16.359374 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:06:16.359374 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:06:16.359374 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:06:16.362787 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:06:16.362787 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:06:16.362787 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:06:16.362787 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:06:16.362787 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:06:16.362787 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6b3e8fcb-7327-45f4-815d-c7b43ed4db97 could not be found. Oct 22 21:06:16.362787 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:06:16.362787 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-a14dafc0-eef6-4947-93d0-ca7818a40dc3 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] Returning 404 to user: Instance 6b3e8fcb-7327-45f4-815d-c7b43ed4db97 could not be found. {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:06:16.362787 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-a14dafc0-eef6-4947-93d0-ca7818a40dc3 tempest-ServerTagsTestJSON-1816993422 tempest-ServerTagsTestJSON-1816993422-project] 10.222.0.18 "GET /compute/v2.1/servers/6b3e8fcb-7327-45f4-815d-c7b43ed4db97" status: 404 len: 111 microversion: 2.26 time: 0.043337 Oct 22 21:06:16.365109 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1776/3589] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:06:16 2022] GET /compute/v2.1/servers/6b3e8fcb-7327-45f4-815d-c7b43ed4db97 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 22 21:06:16.369704 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-8ece0220-587d-4151-8ff6-d5d9ca436b4f tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:16.370380 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-8ece0220-587d-4151-8ff6-d5d9ca436b4f tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] [instance: 64318452-365b-4b80-b53b-9367dd8bc826] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:06:16.376493 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8ece0220-587d-4151-8ff6-d5d9ca436b4f tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:16.376981 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8ece0220-587d-4151-8ff6-d5d9ca436b4f tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:16.377417 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8ece0220-587d-4151-8ff6-d5d9ca436b4f tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:16.378113 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8ece0220-587d-4151-8ff6-d5d9ca436b4f tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:16.378566 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8ece0220-587d-4151-8ff6-d5d9ca436b4f tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:16.379061 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8ece0220-587d-4151-8ff6-d5d9ca436b4f tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:16.806234 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-8ece0220-587d-4151-8ff6-d5d9ca436b4f tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3820b31a424c3a9216a6ef91fcb285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a42c3ecf474883ac652fcc8c01c9f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:06:16.815031 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-8ece0220-587d-4151-8ff6-d5d9ca436b4f tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] 10.222.0.18 "GET /compute/v2.1/servers/64318452-365b-4b80-b53b-9367dd8bc826" status: 200 len: 1300 microversion: 2.1 time: 0.448991 Oct 22 21:06:16.832586 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1777/3590] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:06:16 2022] GET /compute/v2.1/servers/64318452-365b-4b80-b53b-9367dd8bc826 => generated 1300 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:06:16.837871 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-de621e77-6f68-4de1-a660-47b10a4ad061 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:16.838790 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-de621e77-6f68-4de1-a660-47b10a4ad061 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] [instance: a26fa9bd-fad2-40a2-910e-2208fb769dcb] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:06:16.845092 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-de621e77-6f68-4de1-a660-47b10a4ad061 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:16.845819 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-de621e77-6f68-4de1-a660-47b10a4ad061 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:16.846331 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-de621e77-6f68-4de1-a660-47b10a4ad061 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:16.847105 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-de621e77-6f68-4de1-a660-47b10a4ad061 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:16.847780 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-de621e77-6f68-4de1-a660-47b10a4ad061 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:16.848375 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-de621e77-6f68-4de1-a660-47b10a4ad061 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:16.932728 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-50e06704-c0e8-4a38-8fcc-8434fef5120c tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de9c0914dd6943bfa313ac456524cbba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af4c5251e7348c0ae5fc62468243a81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:06:16.941139 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-50e06704-c0e8-4a38-8fcc-8434fef5120c tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] 10.222.0.18 "GET /compute/v2.1/servers/e24e9888-adfe-455c-b53e-da3bf5729d69" status: 200 len: 1325 microversion: 2.1 time: 0.657396 Oct 22 21:06:16.942209 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1814/3591] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:06:16 2022] GET /compute/v2.1/servers/e24e9888-adfe-455c-b53e-da3bf5729d69 => generated 1325 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:06:16.947810 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-fb4a8eaa-6fe7-4bd5-84eb-2b48816c4f57 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:16.948366 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-fb4a8eaa-6fe7-4bd5-84eb-2b48816c4f57 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] [instance: c7e8da33-14d7-49fa-a960-c6d9f529d202] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:06:16.951631 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:06:16.955211 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.wsgi [None req-fb4a8eaa-6fe7-4bd5-84eb-2b48816c4f57 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] HTTP exception thrown: Instance c7e8da33-14d7-49fa-a960-c6d9f529d202 could not be found. Oct 22 21:06:16.957632 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-fb4a8eaa-6fe7-4bd5-84eb-2b48816c4f57 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Request method failure captured: Oct 22 21:06:16.957632 ncdv-master-1 devstack@n-api.service[138745]: request: DELETE /compute/v2.1/servers/c7e8da33-14d7-49fa-a960-c6d9f529d202 HTTP/1.1 Oct 22 21:06:16.957632 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 21:06:16.957632 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 21:06:16.957632 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 21:06:16.957632 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 0 Oct 22 21:06:16.957632 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 21:06:16.957632 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 21:06:16.957632 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 21:06:16.957632 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 21:06:16.957632 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVFnfV28M622GxgIau9tfOtpQOzUe_Zks3cnq6zOgmdqQwk77RE2xHy9F74fRKXOoFFtdLiZlk8HWakwyjiKYmRp9GaMJF70RmWqk8on_rfYCWM12-ITQGodTkqOwwxslvC1Btdt7aRnJVFyVeqFX--IHdQyw_AkPLTYKSNTzj-OnnLE Oct 22 21:06:16.957632 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 21:06:16.957632 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 21:06:16.957632 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 21:06:16.957632 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 21:06:16.957632 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 21:06:16.957632 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 21:06:16.957632 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: b4cd7873d6db4e09bc9ab9a048a6b1ef Oct 22 21:06:16.957632 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-DeleteServersTestJSON-1244431593 Oct 22 21:06:16.957632 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 21:06:16.957632 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 21:06:16.957632 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_b4cd7873d6db4e09bc9ab9a048a6b1ef"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b4cd7873d6db4e09bc9ab9a048a6b1ef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/b4cd7873d6db4e09bc9ab9a048a6b1ef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b4cd7873d6db4e09bc9ab9a048a6b1ef"}]}] Oct 22 21:06:16.957632 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-DeleteServersTestJSON-1244431593 Oct 22 21:06:16.957632 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: b4cd7873d6db4e09bc9ab9a048a6b1ef Oct 22 21:06:16.957632 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-DeleteServersTestJSON-1244431593 Oct 22 21:06:16.957632 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-DeleteServersTestJSON-1244431593-project Oct 22 21:06:16.957632 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 21:06:16.957632 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 21:06:16.957632 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: be1b410a64e0415a96d30f5040361137 Oct 22 21:06:16.957632 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-DeleteServersTestJSON-1244431593-project Oct 22 21:06:16.957632 ncdv-master-1 devstack@n-api.service[138745]: method: > Oct 22 21:06:16.957632 ncdv-master-1 devstack@n-api.service[138745]: exception: Instance c7e8da33-14d7-49fa-a960-c6d9f529d202 could not be found. Oct 22 21:06:16.957632 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'id': 'c7e8da33-14d7-49fa-a960-c6d9f529d202'} Oct 22 21:06:16.957632 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:06:16.957632 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:06:16.957632 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 21:06:16.957632 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 21:06:16.957632 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 21:06:16.957632 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 21:06:16.957632 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 22 21:06:16.957632 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 22 21:06:16.957632 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c7e8da33-14d7-49fa-a960-c6d9f529d202 could not be found. Oct 22 21:06:16.957632 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:06:16.957632 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:06:16.957632 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:06:16.957632 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:06:16.957632 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:06:16.957632 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:06:16.957632 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:06:16.957632 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:06:16.957632 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:06:16.957632 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:06:16.957632 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 22 21:06:16.957632 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 22 21:06:16.957632 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 22 21:06:16.957632 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 22 21:06:16.957632 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 21:06:16.957632 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 21:06:16.957632 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 21:06:16.957632 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:06:16.957632 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c7e8da33-14d7-49fa-a960-c6d9f529d202 could not be found. Oct 22 21:06:16.957632 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:06:16.957632 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:06:16.961478 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:06:16.961478 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:06:16.961478 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:06:16.961478 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:06:16.961478 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:06:16.961478 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:06:16.961478 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c7e8da33-14d7-49fa-a960-c6d9f529d202 could not be found. Oct 22 21:06:16.961478 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:06:16.961478 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-fb4a8eaa-6fe7-4bd5-84eb-2b48816c4f57 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Returning 404 to user: Instance c7e8da33-14d7-49fa-a960-c6d9f529d202 could not be found. {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:06:16.961478 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-fb4a8eaa-6fe7-4bd5-84eb-2b48816c4f57 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] 10.222.0.18 "DELETE /compute/v2.1/servers/c7e8da33-14d7-49fa-a960-c6d9f529d202" status: 404 len: 111 microversion: 2.1 time: 0.015992 Oct 22 21:06:16.961478 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1815/3592] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 21:06:16 2022] DELETE /compute/v2.1/servers/c7e8da33-14d7-49fa-a960-c6d9f529d202 => generated 111 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 21:06:16.968955 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-b70c185d-56a7-4ceb-b6e2-38c0f17e500e tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:16.969561 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-b70c185d-56a7-4ceb-b6e2-38c0f17e500e tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] [instance: c7e8da33-14d7-49fa-a960-c6d9f529d202] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:06:16.979555 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.wsgi [None req-b70c185d-56a7-4ceb-b6e2-38c0f17e500e tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] HTTP exception thrown: Instance c7e8da33-14d7-49fa-a960-c6d9f529d202 could not be found. Oct 22 21:06:16.981280 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-b70c185d-56a7-4ceb-b6e2-38c0f17e500e tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Request method failure captured: Oct 22 21:06:16.981280 ncdv-master-1 devstack@n-api.service[138745]: request: GET /compute/v2.1/servers/c7e8da33-14d7-49fa-a960-c6d9f529d202 HTTP/1.1 Oct 22 21:06:16.981280 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 21:06:16.981280 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 21:06:16.981280 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 21:06:16.981280 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 0 Oct 22 21:06:16.981280 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 21:06:16.981280 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 21:06:16.981280 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 21:06:16.981280 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 21:06:16.981280 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVFnfV28M622GxgIau9tfOtpQOzUe_Zks3cnq6zOgmdqQwk77RE2xHy9F74fRKXOoFFtdLiZlk8HWakwyjiKYmRp9GaMJF70RmWqk8on_rfYCWM12-ITQGodTkqOwwxslvC1Btdt7aRnJVFyVeqFX--IHdQyw_AkPLTYKSNTzj-OnnLE Oct 22 21:06:16.981280 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 21:06:16.981280 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 21:06:16.981280 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 21:06:16.981280 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 21:06:16.981280 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 21:06:16.981280 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 21:06:16.981280 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: b4cd7873d6db4e09bc9ab9a048a6b1ef Oct 22 21:06:16.981280 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-DeleteServersTestJSON-1244431593 Oct 22 21:06:16.981280 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 21:06:16.981280 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 21:06:16.981280 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_b4cd7873d6db4e09bc9ab9a048a6b1ef"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b4cd7873d6db4e09bc9ab9a048a6b1ef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/b4cd7873d6db4e09bc9ab9a048a6b1ef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b4cd7873d6db4e09bc9ab9a048a6b1ef"}]}] Oct 22 21:06:16.981280 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-DeleteServersTestJSON-1244431593 Oct 22 21:06:16.981280 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: b4cd7873d6db4e09bc9ab9a048a6b1ef Oct 22 21:06:16.981280 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-DeleteServersTestJSON-1244431593 Oct 22 21:06:16.981280 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-DeleteServersTestJSON-1244431593-project Oct 22 21:06:16.981280 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 21:06:16.981280 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 21:06:16.981280 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: be1b410a64e0415a96d30f5040361137 Oct 22 21:06:16.981280 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-DeleteServersTestJSON-1244431593-project Oct 22 21:06:16.981280 ncdv-master-1 devstack@n-api.service[138745]: method: > Oct 22 21:06:16.981280 ncdv-master-1 devstack@n-api.service[138745]: exception: Instance c7e8da33-14d7-49fa-a960-c6d9f529d202 could not be found. Oct 22 21:06:16.981280 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'id': 'c7e8da33-14d7-49fa-a960-c6d9f529d202'} Oct 22 21:06:16.981280 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:06:16.981280 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:06:16.981280 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 21:06:16.981280 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 21:06:16.981280 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 21:06:16.981280 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 21:06:16.981280 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 22 21:06:16.981280 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 22 21:06:16.981280 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c7e8da33-14d7-49fa-a960-c6d9f529d202 could not be found. Oct 22 21:06:16.981280 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:06:16.981280 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:06:16.981280 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:06:16.981280 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:06:16.981280 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:06:16.981280 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:06:16.981280 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:06:16.981280 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:06:16.981280 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:06:16.981280 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:06:16.981280 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 21:06:16.981280 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 21:06:16.981280 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 21:06:16.981280 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 21:06:16.981280 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 21:06:16.981280 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:06:16.981280 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c7e8da33-14d7-49fa-a960-c6d9f529d202 could not be found. Oct 22 21:06:16.981280 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:06:16.981280 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:06:16.981280 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:06:16.981280 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:06:16.981280 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:06:16.984827 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:06:16.984827 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:06:16.984827 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:06:16.984827 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c7e8da33-14d7-49fa-a960-c6d9f529d202 could not be found. Oct 22 21:06:16.984827 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:06:16.984827 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-b70c185d-56a7-4ceb-b6e2-38c0f17e500e tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Returning 404 to user: Instance c7e8da33-14d7-49fa-a960-c6d9f529d202 could not be found. {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:06:16.984827 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-b70c185d-56a7-4ceb-b6e2-38c0f17e500e tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] 10.222.0.18 "GET /compute/v2.1/servers/c7e8da33-14d7-49fa-a960-c6d9f529d202" status: 404 len: 111 microversion: 2.1 time: 0.019022 Oct 22 21:06:16.984827 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1816/3593] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:06:16 2022] GET /compute/v2.1/servers/c7e8da33-14d7-49fa-a960-c6d9f529d202 => generated 111 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 21:06:17.097801 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-de621e77-6f68-4de1-a660-47b10a4ad061 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a44ff8e7c14b94b1670f030085c43d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a26a2284f4424cbeaf63d504652546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:06:17.111104 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-de621e77-6f68-4de1-a660-47b10a4ad061 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] 10.222.0.18 "GET /compute/v2.1/servers/a26fa9bd-fad2-40a2-910e-2208fb769dcb" status: 200 len: 1501 microversion: 2.1 time: 0.276990 Oct 22 21:06:17.125785 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1778/3594] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:06:16 2022] GET /compute/v2.1/servers/a26fa9bd-fad2-40a2-910e-2208fb769dcb => generated 1501 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:06:17.269681 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-5f5250bd-50db-43ce-b66d-e997d0811d4a tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:17.270320 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-5f5250bd-50db-43ce-b66d-e997d0811d4a tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] [instance: e09b7865-0b24-4e50-a66a-342dd2e6e5e3] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:06:17.283260 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5f5250bd-50db-43ce-b66d-e997d0811d4a tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:17.286663 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5f5250bd-50db-43ce-b66d-e997d0811d4a tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:17.287448 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5f5250bd-50db-43ce-b66d-e997d0811d4a tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:17.288567 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5f5250bd-50db-43ce-b66d-e997d0811d4a tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:17.289585 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5f5250bd-50db-43ce-b66d-e997d0811d4a tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:17.291223 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5f5250bd-50db-43ce-b66d-e997d0811d4a tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:17.304925 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-f2cc154c-7a1d-4dc6-905d-ee764eb7cfc2 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:17.305627 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-f2cc154c-7a1d-4dc6-905d-ee764eb7cfc2 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] [instance: 3fdb6d35-9428-4253-ad00-932310ecdf5d] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:06:17.316140 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f2cc154c-7a1d-4dc6-905d-ee764eb7cfc2 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:17.316964 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f2cc154c-7a1d-4dc6-905d-ee764eb7cfc2 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:17.317601 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f2cc154c-7a1d-4dc6-905d-ee764eb7cfc2 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:17.320750 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f2cc154c-7a1d-4dc6-905d-ee764eb7cfc2 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:17.321544 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f2cc154c-7a1d-4dc6-905d-ee764eb7cfc2 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:17.322231 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f2cc154c-7a1d-4dc6-905d-ee764eb7cfc2 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:17.659963 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-5f5250bd-50db-43ce-b66d-e997d0811d4a tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcdfeb6c1cda4810b9fa70fdfd9a66c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c774a85b2c41c98486cf91b1253363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:06:17.674137 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-5f5250bd-50db-43ce-b66d-e997d0811d4a tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] 10.222.0.18 "GET /compute/v2.1/servers/e09b7865-0b24-4e50-a66a-342dd2e6e5e3" status: 200 len: 1515 microversion: 2.1 time: 0.408442 Oct 22 21:06:17.687911 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1817/3595] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:06:17 2022] GET /compute/v2.1/servers/e09b7865-0b24-4e50-a66a-342dd2e6e5e3 => generated 1515 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:06:17.730178 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-f2cc154c-7a1d-4dc6-905d-ee764eb7cfc2 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879c85830a9f42088a4ebdf1e3cfb39b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b54f56cfbc814cccb533c65966f35a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:06:17.742719 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-f2cc154c-7a1d-4dc6-905d-ee764eb7cfc2 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] 10.222.0.18 "GET /compute/v2.1/servers/3fdb6d35-9428-4253-ad00-932310ecdf5d" status: 200 len: 1504 microversion: 2.1 time: 0.442106 Oct 22 21:06:17.743368 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1779/3596] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:06:17 2022] GET /compute/v2.1/servers/3fdb6d35-9428-4253-ad00-932310ecdf5d => generated 1504 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:06:17.848178 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-2ca8a414-b0bf-4412-a45e-f38ee170037c tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:17.849273 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-2ca8a414-b0bf-4412-a45e-f38ee170037c tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] [instance: 64318452-365b-4b80-b53b-9367dd8bc826] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:06:17.861896 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2ca8a414-b0bf-4412-a45e-f38ee170037c tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:17.862420 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2ca8a414-b0bf-4412-a45e-f38ee170037c tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:17.862870 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2ca8a414-b0bf-4412-a45e-f38ee170037c tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:17.864289 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2ca8a414-b0bf-4412-a45e-f38ee170037c tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:17.865035 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2ca8a414-b0bf-4412-a45e-f38ee170037c tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:17.865638 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2ca8a414-b0bf-4412-a45e-f38ee170037c tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:17.967712 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-e32c2a3b-3ce4-46f3-bdd0-0f32651edc5c tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:17.968993 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-e32c2a3b-3ce4-46f3-bdd0-0f32651edc5c tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] [instance: e24e9888-adfe-455c-b53e-da3bf5729d69] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:06:17.977611 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e32c2a3b-3ce4-46f3-bdd0-0f32651edc5c tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:17.978394 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e32c2a3b-3ce4-46f3-bdd0-0f32651edc5c tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:17.978993 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e32c2a3b-3ce4-46f3-bdd0-0f32651edc5c tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:17.979894 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e32c2a3b-3ce4-46f3-bdd0-0f32651edc5c tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:17.982212 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e32c2a3b-3ce4-46f3-bdd0-0f32651edc5c tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:17.982886 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e32c2a3b-3ce4-46f3-bdd0-0f32651edc5c tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:18.283762 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-2ca8a414-b0bf-4412-a45e-f38ee170037c tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3820b31a424c3a9216a6ef91fcb285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a42c3ecf474883ac652fcc8c01c9f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:06:18.292671 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-2ca8a414-b0bf-4412-a45e-f38ee170037c tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] 10.222.0.18 "GET /compute/v2.1/servers/64318452-365b-4b80-b53b-9367dd8bc826" status: 200 len: 1342 microversion: 2.1 time: 0.458147 Oct 22 21:06:18.293822 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1818/3597] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:06:17 2022] GET /compute/v2.1/servers/64318452-365b-4b80-b53b-9367dd8bc826 => generated 1342 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:06:18.299559 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-00e33a55-5d44-4847-a4c0-ecf706fa9d06 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:18.300408 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-00e33a55-5d44-4847-a4c0-ecf706fa9d06 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] [instance: a26fa9bd-fad2-40a2-910e-2208fb769dcb] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:06:18.309450 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-00e33a55-5d44-4847-a4c0-ecf706fa9d06 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:18.310435 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-00e33a55-5d44-4847-a4c0-ecf706fa9d06 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:18.311115 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-00e33a55-5d44-4847-a4c0-ecf706fa9d06 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:18.312446 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-00e33a55-5d44-4847-a4c0-ecf706fa9d06 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:18.313151 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-00e33a55-5d44-4847-a4c0-ecf706fa9d06 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:18.314065 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-00e33a55-5d44-4847-a4c0-ecf706fa9d06 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:18.337247 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-e32c2a3b-3ce4-46f3-bdd0-0f32651edc5c tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de9c0914dd6943bfa313ac456524cbba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af4c5251e7348c0ae5fc62468243a81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:06:18.347463 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-e32c2a3b-3ce4-46f3-bdd0-0f32651edc5c tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] 10.222.0.18 "GET /compute/v2.1/servers/e24e9888-adfe-455c-b53e-da3bf5729d69" status: 200 len: 1325 microversion: 2.1 time: 0.383723 Oct 22 21:06:18.348129 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1780/3598] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:06:17 2022] GET /compute/v2.1/servers/e24e9888-adfe-455c-b53e-da3bf5729d69 => generated 1325 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:06:18.363210 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-b328b7d9-f66a-4e50-914b-d5495e4a66cb tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:18.364090 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-b328b7d9-f66a-4e50-914b-d5495e4a66cb tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] [instance: a3ed180f-6c68-4c19-bdb7-602dd8ffaaf2] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:06:18.375801 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b328b7d9-f66a-4e50-914b-d5495e4a66cb tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:18.376304 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b328b7d9-f66a-4e50-914b-d5495e4a66cb tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:18.376900 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b328b7d9-f66a-4e50-914b-d5495e4a66cb tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:18.377625 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b328b7d9-f66a-4e50-914b-d5495e4a66cb tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:18.378633 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b328b7d9-f66a-4e50-914b-d5495e4a66cb tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:18.379477 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b328b7d9-f66a-4e50-914b-d5495e4a66cb tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:18.397627 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-b328b7d9-f66a-4e50-914b-d5495e4a66cb tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] HTTP exception thrown: Instance a3ed180f-6c68-4c19-bdb7-602dd8ffaaf2 could not be found. Oct 22 21:06:18.399482 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-b328b7d9-f66a-4e50-914b-d5495e4a66cb tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Request method failure captured: Oct 22 21:06:18.399482 ncdv-master-1 devstack@n-api.service[138744]: request: DELETE /compute/v2.1/servers/a3ed180f-6c68-4c19-bdb7-602dd8ffaaf2 HTTP/1.1 Oct 22 21:06:18.399482 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 21:06:18.399482 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 21:06:18.399482 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 21:06:18.399482 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 0 Oct 22 21:06:18.399482 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 21:06:18.399482 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 21:06:18.399482 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 21:06:18.399482 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 21:06:18.399482 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVFnfV28M622GxgIau9tfOtpQOzUe_Zks3cnq6zOgmdqQwk77RE2xHy9F74fRKXOoFFtdLiZlk8HWakwyjiKYmRp9GaMJF70RmWqk8on_rfYCWM12-ITQGodTkqOwwxslvC1Btdt7aRnJVFyVeqFX--IHdQyw_AkPLTYKSNTzj-OnnLE Oct 22 21:06:18.399482 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 21:06:18.399482 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 21:06:18.399482 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 21:06:18.399482 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 21:06:18.399482 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 21:06:18.399482 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 21:06:18.399482 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: b4cd7873d6db4e09bc9ab9a048a6b1ef Oct 22 21:06:18.399482 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-DeleteServersTestJSON-1244431593 Oct 22 21:06:18.399482 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 21:06:18.399482 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 21:06:18.399482 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_b4cd7873d6db4e09bc9ab9a048a6b1ef"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b4cd7873d6db4e09bc9ab9a048a6b1ef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/b4cd7873d6db4e09bc9ab9a048a6b1ef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b4cd7873d6db4e09bc9ab9a048a6b1ef"}]}] Oct 22 21:06:18.399482 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-DeleteServersTestJSON-1244431593 Oct 22 21:06:18.399482 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: b4cd7873d6db4e09bc9ab9a048a6b1ef Oct 22 21:06:18.399482 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-DeleteServersTestJSON-1244431593 Oct 22 21:06:18.399482 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-DeleteServersTestJSON-1244431593-project Oct 22 21:06:18.399482 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 21:06:18.399482 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 21:06:18.399482 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: be1b410a64e0415a96d30f5040361137 Oct 22 21:06:18.399482 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-DeleteServersTestJSON-1244431593-project Oct 22 21:06:18.399482 ncdv-master-1 devstack@n-api.service[138744]: method: > Oct 22 21:06:18.399482 ncdv-master-1 devstack@n-api.service[138744]: exception: Instance a3ed180f-6c68-4c19-bdb7-602dd8ffaaf2 could not be found. Oct 22 21:06:18.399482 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': 'a3ed180f-6c68-4c19-bdb7-602dd8ffaaf2'} Oct 22 21:06:18.399482 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:06:18.399482 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:06:18.399482 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 21:06:18.399482 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 21:06:18.399482 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 21:06:18.399482 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 21:06:18.399482 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 21:06:18.399482 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 21:06:18.399482 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 21:06:18.399482 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 21:06:18.399482 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a3ed180f-6c68-4c19-bdb7-602dd8ffaaf2 could not be found. Oct 22 21:06:18.399482 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:06:18.399482 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:06:18.399482 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:06:18.399482 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:06:18.399482 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:06:18.399482 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:06:18.399482 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:06:18.399482 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:06:18.399482 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:06:18.399482 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:06:18.399482 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 22 21:06:18.399482 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 22 21:06:18.399482 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 22 21:06:18.399482 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 22 21:06:18.399482 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 21:06:18.399482 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 21:06:18.399482 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 21:06:18.399482 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:06:18.403321 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a3ed180f-6c68-4c19-bdb7-602dd8ffaaf2 could not be found. Oct 22 21:06:18.403321 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:06:18.403321 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:06:18.403321 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:06:18.403321 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:06:18.403321 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:06:18.403321 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:06:18.403321 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:06:18.403321 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:06:18.403321 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a3ed180f-6c68-4c19-bdb7-602dd8ffaaf2 could not be found. Oct 22 21:06:18.403321 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:06:18.404769 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-b328b7d9-f66a-4e50-914b-d5495e4a66cb tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Returning 404 to user: Instance a3ed180f-6c68-4c19-bdb7-602dd8ffaaf2 could not be found. {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:06:18.405793 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-b328b7d9-f66a-4e50-914b-d5495e4a66cb tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] 10.222.0.18 "DELETE /compute/v2.1/servers/a3ed180f-6c68-4c19-bdb7-602dd8ffaaf2" status: 404 len: 111 microversion: 2.1 time: 0.056356 Oct 22 21:06:18.411232 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1781/3599] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 21:06:18 2022] DELETE /compute/v2.1/servers/a3ed180f-6c68-4c19-bdb7-602dd8ffaaf2 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 21:06:18.418735 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-127686a0-54c0-4a40-8b06-f251af309c53 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:18.419542 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-127686a0-54c0-4a40-8b06-f251af309c53 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] [instance: a3ed180f-6c68-4c19-bdb7-602dd8ffaaf2] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:06:18.432079 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-127686a0-54c0-4a40-8b06-f251af309c53 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:18.432835 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-127686a0-54c0-4a40-8b06-f251af309c53 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:18.433181 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-127686a0-54c0-4a40-8b06-f251af309c53 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:18.434121 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-127686a0-54c0-4a40-8b06-f251af309c53 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:18.434962 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-127686a0-54c0-4a40-8b06-f251af309c53 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:18.435488 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-127686a0-54c0-4a40-8b06-f251af309c53 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:18.461047 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-127686a0-54c0-4a40-8b06-f251af309c53 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] HTTP exception thrown: Instance a3ed180f-6c68-4c19-bdb7-602dd8ffaaf2 could not be found. Oct 22 21:06:18.462650 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-127686a0-54c0-4a40-8b06-f251af309c53 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Request method failure captured: Oct 22 21:06:18.462650 ncdv-master-1 devstack@n-api.service[138744]: request: GET /compute/v2.1/servers/a3ed180f-6c68-4c19-bdb7-602dd8ffaaf2 HTTP/1.1 Oct 22 21:06:18.462650 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 21:06:18.462650 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 21:06:18.462650 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 21:06:18.462650 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 0 Oct 22 21:06:18.462650 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 21:06:18.462650 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 21:06:18.462650 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 21:06:18.462650 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 21:06:18.462650 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVFnfV28M622GxgIau9tfOtpQOzUe_Zks3cnq6zOgmdqQwk77RE2xHy9F74fRKXOoFFtdLiZlk8HWakwyjiKYmRp9GaMJF70RmWqk8on_rfYCWM12-ITQGodTkqOwwxslvC1Btdt7aRnJVFyVeqFX--IHdQyw_AkPLTYKSNTzj-OnnLE Oct 22 21:06:18.462650 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 21:06:18.462650 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 21:06:18.462650 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 21:06:18.462650 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 21:06:18.462650 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 21:06:18.462650 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 21:06:18.462650 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: b4cd7873d6db4e09bc9ab9a048a6b1ef Oct 22 21:06:18.462650 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-DeleteServersTestJSON-1244431593 Oct 22 21:06:18.462650 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 21:06:18.462650 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 21:06:18.462650 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_b4cd7873d6db4e09bc9ab9a048a6b1ef"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b4cd7873d6db4e09bc9ab9a048a6b1ef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/b4cd7873d6db4e09bc9ab9a048a6b1ef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b4cd7873d6db4e09bc9ab9a048a6b1ef"}]}] Oct 22 21:06:18.462650 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-DeleteServersTestJSON-1244431593 Oct 22 21:06:18.462650 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: b4cd7873d6db4e09bc9ab9a048a6b1ef Oct 22 21:06:18.462650 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-DeleteServersTestJSON-1244431593 Oct 22 21:06:18.462650 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-DeleteServersTestJSON-1244431593-project Oct 22 21:06:18.462650 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 21:06:18.462650 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 21:06:18.462650 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: be1b410a64e0415a96d30f5040361137 Oct 22 21:06:18.462650 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-DeleteServersTestJSON-1244431593-project Oct 22 21:06:18.462650 ncdv-master-1 devstack@n-api.service[138744]: method: > Oct 22 21:06:18.462650 ncdv-master-1 devstack@n-api.service[138744]: exception: Instance a3ed180f-6c68-4c19-bdb7-602dd8ffaaf2 could not be found. Oct 22 21:06:18.462650 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': 'a3ed180f-6c68-4c19-bdb7-602dd8ffaaf2'} Oct 22 21:06:18.462650 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:06:18.462650 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:06:18.462650 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 21:06:18.462650 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 21:06:18.462650 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 21:06:18.462650 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 21:06:18.462650 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 21:06:18.462650 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 21:06:18.462650 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 21:06:18.462650 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 21:06:18.462650 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a3ed180f-6c68-4c19-bdb7-602dd8ffaaf2 could not be found. Oct 22 21:06:18.462650 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:06:18.462650 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:06:18.462650 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:06:18.462650 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:06:18.462650 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:06:18.462650 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:06:18.462650 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:06:18.462650 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:06:18.462650 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:06:18.462650 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:06:18.462650 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 21:06:18.462650 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 21:06:18.462650 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 21:06:18.462650 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 21:06:18.462650 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 21:06:18.462650 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:06:18.462650 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a3ed180f-6c68-4c19-bdb7-602dd8ffaaf2 could not be found. Oct 22 21:06:18.462650 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:06:18.462650 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:06:18.462650 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:06:18.466679 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:06:18.466679 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:06:18.466679 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:06:18.466679 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:06:18.466679 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:06:18.466679 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a3ed180f-6c68-4c19-bdb7-602dd8ffaaf2 could not be found. Oct 22 21:06:18.466679 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:06:18.466679 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-127686a0-54c0-4a40-8b06-f251af309c53 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Returning 404 to user: Instance a3ed180f-6c68-4c19-bdb7-602dd8ffaaf2 could not be found. {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:06:18.466679 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-127686a0-54c0-4a40-8b06-f251af309c53 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] 10.222.0.18 "GET /compute/v2.1/servers/a3ed180f-6c68-4c19-bdb7-602dd8ffaaf2" status: 404 len: 111 microversion: 2.1 time: 0.052612 Oct 22 21:06:18.470334 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1782/3600] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:06:18 2022] GET /compute/v2.1/servers/a3ed180f-6c68-4c19-bdb7-602dd8ffaaf2 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 21:06:18.476218 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-e17b8343-68d8-486c-87b5-5b0226a6ef95 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:18.477504 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-e17b8343-68d8-486c-87b5-5b0226a6ef95 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] [instance: eb38dcff-5703-4735-bf8e-6a40d51d8567] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:06:18.483910 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e17b8343-68d8-486c-87b5-5b0226a6ef95 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:18.484636 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e17b8343-68d8-486c-87b5-5b0226a6ef95 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:18.485248 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e17b8343-68d8-486c-87b5-5b0226a6ef95 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:18.486365 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e17b8343-68d8-486c-87b5-5b0226a6ef95 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:18.486994 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e17b8343-68d8-486c-87b5-5b0226a6ef95 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:18.487626 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e17b8343-68d8-486c-87b5-5b0226a6ef95 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:18.505248 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-e17b8343-68d8-486c-87b5-5b0226a6ef95 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] HTTP exception thrown: Instance eb38dcff-5703-4735-bf8e-6a40d51d8567 could not be found. Oct 22 21:06:18.508021 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-e17b8343-68d8-486c-87b5-5b0226a6ef95 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Request method failure captured: Oct 22 21:06:18.508021 ncdv-master-1 devstack@n-api.service[138744]: request: DELETE /compute/v2.1/servers/eb38dcff-5703-4735-bf8e-6a40d51d8567 HTTP/1.1 Oct 22 21:06:18.508021 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 21:06:18.508021 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 21:06:18.508021 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 21:06:18.508021 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 0 Oct 22 21:06:18.508021 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 21:06:18.508021 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 21:06:18.508021 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 21:06:18.508021 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 21:06:18.508021 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVFnfV28M622GxgIau9tfOtpQOzUe_Zks3cnq6zOgmdqQwk77RE2xHy9F74fRKXOoFFtdLiZlk8HWakwyjiKYmRp9GaMJF70RmWqk8on_rfYCWM12-ITQGodTkqOwwxslvC1Btdt7aRnJVFyVeqFX--IHdQyw_AkPLTYKSNTzj-OnnLE Oct 22 21:06:18.508021 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 21:06:18.508021 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 21:06:18.508021 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 21:06:18.508021 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 21:06:18.508021 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 21:06:18.508021 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 21:06:18.508021 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: b4cd7873d6db4e09bc9ab9a048a6b1ef Oct 22 21:06:18.508021 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-DeleteServersTestJSON-1244431593 Oct 22 21:06:18.508021 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 21:06:18.508021 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 21:06:18.508021 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_b4cd7873d6db4e09bc9ab9a048a6b1ef"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b4cd7873d6db4e09bc9ab9a048a6b1ef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/b4cd7873d6db4e09bc9ab9a048a6b1ef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b4cd7873d6db4e09bc9ab9a048a6b1ef"}]}] Oct 22 21:06:18.508021 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-DeleteServersTestJSON-1244431593 Oct 22 21:06:18.508021 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: b4cd7873d6db4e09bc9ab9a048a6b1ef Oct 22 21:06:18.508021 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-DeleteServersTestJSON-1244431593 Oct 22 21:06:18.508021 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-DeleteServersTestJSON-1244431593-project Oct 22 21:06:18.508021 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 21:06:18.508021 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 21:06:18.508021 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: be1b410a64e0415a96d30f5040361137 Oct 22 21:06:18.508021 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-DeleteServersTestJSON-1244431593-project Oct 22 21:06:18.508021 ncdv-master-1 devstack@n-api.service[138744]: method: > Oct 22 21:06:18.508021 ncdv-master-1 devstack@n-api.service[138744]: exception: Instance eb38dcff-5703-4735-bf8e-6a40d51d8567 could not be found. Oct 22 21:06:18.508021 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': 'eb38dcff-5703-4735-bf8e-6a40d51d8567'} Oct 22 21:06:18.508021 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:06:18.508021 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:06:18.508021 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 21:06:18.508021 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 21:06:18.508021 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 21:06:18.508021 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 21:06:18.508021 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 21:06:18.508021 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 21:06:18.508021 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 21:06:18.508021 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 21:06:18.508021 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb38dcff-5703-4735-bf8e-6a40d51d8567 could not be found. Oct 22 21:06:18.508021 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:06:18.508021 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:06:18.508021 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:06:18.508021 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:06:18.508021 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:06:18.508021 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:06:18.508021 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:06:18.508021 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:06:18.508021 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:06:18.508021 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:06:18.508021 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 22 21:06:18.508021 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 22 21:06:18.508021 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 22 21:06:18.508021 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 22 21:06:18.508021 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 21:06:18.508021 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 21:06:18.508021 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 21:06:18.508021 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:06:18.511632 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb38dcff-5703-4735-bf8e-6a40d51d8567 could not be found. Oct 22 21:06:18.511632 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:06:18.511632 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:06:18.511632 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:06:18.511632 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:06:18.511632 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:06:18.511632 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:06:18.511632 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:06:18.511632 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:06:18.511632 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb38dcff-5703-4735-bf8e-6a40d51d8567 could not be found. Oct 22 21:06:18.511632 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:06:18.514474 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-e17b8343-68d8-486c-87b5-5b0226a6ef95 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Returning 404 to user: Instance eb38dcff-5703-4735-bf8e-6a40d51d8567 could not be found. {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:06:18.515593 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-e17b8343-68d8-486c-87b5-5b0226a6ef95 tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] 10.222.0.18 "DELETE /compute/v2.1/servers/eb38dcff-5703-4735-bf8e-6a40d51d8567" status: 404 len: 111 microversion: 2.1 time: 0.044039 Oct 22 21:06:18.516394 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1783/3601] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 21:06:18 2022] DELETE /compute/v2.1/servers/eb38dcff-5703-4735-bf8e-6a40d51d8567 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 21:06:18.525756 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-63f3b538-9ddc-48c2-b11b-7e67684cd39e tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:18.526886 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-63f3b538-9ddc-48c2-b11b-7e67684cd39e tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] [instance: eb38dcff-5703-4735-bf8e-6a40d51d8567] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:06:18.533445 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-00e33a55-5d44-4847-a4c0-ecf706fa9d06 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a44ff8e7c14b94b1670f030085c43d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a26a2284f4424cbeaf63d504652546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:06:18.535313 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-63f3b538-9ddc-48c2-b11b-7e67684cd39e tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:18.536137 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-63f3b538-9ddc-48c2-b11b-7e67684cd39e tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:18.536677 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-63f3b538-9ddc-48c2-b11b-7e67684cd39e tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:18.537637 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-63f3b538-9ddc-48c2-b11b-7e67684cd39e tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:18.538183 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-63f3b538-9ddc-48c2-b11b-7e67684cd39e tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:18.538673 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-63f3b538-9ddc-48c2-b11b-7e67684cd39e tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:18.549640 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-00e33a55-5d44-4847-a4c0-ecf706fa9d06 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] 10.222.0.18 "GET /compute/v2.1/servers/a26fa9bd-fad2-40a2-910e-2208fb769dcb" status: 200 len: 1501 microversion: 2.1 time: 0.253409 Oct 22 21:06:18.552023 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1819/3602] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:06:18 2022] GET /compute/v2.1/servers/a26fa9bd-fad2-40a2-910e-2208fb769dcb => generated 1501 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:06:18.571178 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-63f3b538-9ddc-48c2-b11b-7e67684cd39e tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] HTTP exception thrown: Instance eb38dcff-5703-4735-bf8e-6a40d51d8567 could not be found. Oct 22 21:06:18.572846 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-63f3b538-9ddc-48c2-b11b-7e67684cd39e tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Request method failure captured: Oct 22 21:06:18.572846 ncdv-master-1 devstack@n-api.service[138744]: request: GET /compute/v2.1/servers/eb38dcff-5703-4735-bf8e-6a40d51d8567 HTTP/1.1 Oct 22 21:06:18.572846 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 21:06:18.572846 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 21:06:18.572846 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 21:06:18.572846 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 0 Oct 22 21:06:18.572846 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 21:06:18.572846 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 21:06:18.572846 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 21:06:18.572846 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 21:06:18.572846 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVFnfV28M622GxgIau9tfOtpQOzUe_Zks3cnq6zOgmdqQwk77RE2xHy9F74fRKXOoFFtdLiZlk8HWakwyjiKYmRp9GaMJF70RmWqk8on_rfYCWM12-ITQGodTkqOwwxslvC1Btdt7aRnJVFyVeqFX--IHdQyw_AkPLTYKSNTzj-OnnLE Oct 22 21:06:18.572846 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 21:06:18.572846 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 21:06:18.572846 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 21:06:18.572846 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 21:06:18.572846 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 21:06:18.572846 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 21:06:18.572846 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: b4cd7873d6db4e09bc9ab9a048a6b1ef Oct 22 21:06:18.572846 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-DeleteServersTestJSON-1244431593 Oct 22 21:06:18.572846 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 21:06:18.572846 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 21:06:18.572846 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_b4cd7873d6db4e09bc9ab9a048a6b1ef"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b4cd7873d6db4e09bc9ab9a048a6b1ef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/b4cd7873d6db4e09bc9ab9a048a6b1ef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b4cd7873d6db4e09bc9ab9a048a6b1ef"}]}] Oct 22 21:06:18.572846 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-DeleteServersTestJSON-1244431593 Oct 22 21:06:18.572846 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: b4cd7873d6db4e09bc9ab9a048a6b1ef Oct 22 21:06:18.572846 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-DeleteServersTestJSON-1244431593 Oct 22 21:06:18.572846 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-DeleteServersTestJSON-1244431593-project Oct 22 21:06:18.572846 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 21:06:18.572846 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 21:06:18.572846 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: be1b410a64e0415a96d30f5040361137 Oct 22 21:06:18.572846 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-DeleteServersTestJSON-1244431593-project Oct 22 21:06:18.572846 ncdv-master-1 devstack@n-api.service[138744]: method: > Oct 22 21:06:18.572846 ncdv-master-1 devstack@n-api.service[138744]: exception: Instance eb38dcff-5703-4735-bf8e-6a40d51d8567 could not be found. Oct 22 21:06:18.572846 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': 'eb38dcff-5703-4735-bf8e-6a40d51d8567'} Oct 22 21:06:18.572846 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:06:18.572846 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:06:18.572846 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 21:06:18.572846 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 21:06:18.572846 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 21:06:18.572846 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 21:06:18.572846 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 21:06:18.572846 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 21:06:18.572846 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 21:06:18.572846 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 21:06:18.572846 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb38dcff-5703-4735-bf8e-6a40d51d8567 could not be found. Oct 22 21:06:18.572846 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:06:18.572846 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:06:18.572846 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:06:18.572846 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:06:18.572846 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:06:18.572846 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:06:18.572846 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:06:18.572846 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:06:18.572846 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:06:18.572846 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:06:18.572846 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 21:06:18.572846 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 21:06:18.572846 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 21:06:18.572846 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 21:06:18.572846 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 21:06:18.572846 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:06:18.572846 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb38dcff-5703-4735-bf8e-6a40d51d8567 could not be found. Oct 22 21:06:18.572846 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:06:18.572846 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:06:18.572846 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:06:18.577219 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:06:18.577219 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:06:18.577219 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:06:18.577219 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:06:18.577219 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:06:18.577219 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb38dcff-5703-4735-bf8e-6a40d51d8567 could not be found. Oct 22 21:06:18.577219 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:06:18.577219 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-63f3b538-9ddc-48c2-b11b-7e67684cd39e tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] Returning 404 to user: Instance eb38dcff-5703-4735-bf8e-6a40d51d8567 could not be found. {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:06:18.577219 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-63f3b538-9ddc-48c2-b11b-7e67684cd39e tempest-DeleteServersTestJSON-1244431593 tempest-DeleteServersTestJSON-1244431593-project] 10.222.0.18 "GET /compute/v2.1/servers/eb38dcff-5703-4735-bf8e-6a40d51d8567" status: 404 len: 111 microversion: 2.1 time: 0.053907 Oct 22 21:06:18.578322 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1784/3603] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:06:18 2022] GET /compute/v2.1/servers/eb38dcff-5703-4735-bf8e-6a40d51d8567 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 21:06:18.701874 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-2a767f11-a124-490a-8b99-50fbe47c5bd2 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:18.702512 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-2a767f11-a124-490a-8b99-50fbe47c5bd2 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] [instance: e09b7865-0b24-4e50-a66a-342dd2e6e5e3] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:06:18.717090 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2a767f11-a124-490a-8b99-50fbe47c5bd2 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:18.717623 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2a767f11-a124-490a-8b99-50fbe47c5bd2 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:18.718093 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2a767f11-a124-490a-8b99-50fbe47c5bd2 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:18.718853 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2a767f11-a124-490a-8b99-50fbe47c5bd2 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:18.719334 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2a767f11-a124-490a-8b99-50fbe47c5bd2 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:18.719815 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2a767f11-a124-490a-8b99-50fbe47c5bd2 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:18.766109 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-3406d634-1e08-48dd-814a-9b367326a4d2 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:18.766788 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-3406d634-1e08-48dd-814a-9b367326a4d2 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] [instance: 3fdb6d35-9428-4253-ad00-932310ecdf5d] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:06:18.776442 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3406d634-1e08-48dd-814a-9b367326a4d2 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:18.777186 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3406d634-1e08-48dd-814a-9b367326a4d2 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:18.777773 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3406d634-1e08-48dd-814a-9b367326a4d2 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:18.778633 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3406d634-1e08-48dd-814a-9b367326a4d2 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:18.779230 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3406d634-1e08-48dd-814a-9b367326a4d2 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:18.779869 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3406d634-1e08-48dd-814a-9b367326a4d2 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:19.378574 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-2a767f11-a124-490a-8b99-50fbe47c5bd2 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcdfeb6c1cda4810b9fa70fdfd9a66c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c774a85b2c41c98486cf91b1253363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:06:19.391533 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-2a767f11-a124-490a-8b99-50fbe47c5bd2 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] 10.222.0.18 "GET /compute/v2.1/servers/e09b7865-0b24-4e50-a66a-342dd2e6e5e3" status: 200 len: 1515 microversion: 2.1 time: 0.693565 Oct 22 21:06:19.395213 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1820/3604] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:06:18 2022] GET /compute/v2.1/servers/e09b7865-0b24-4e50-a66a-342dd2e6e5e3 => generated 1515 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:06:19.411720 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-eb7b62d7-7899-4ea5-a19b-e740a8a9d0f8 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:19.413136 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-eb7b62d7-7899-4ea5-a19b-e740a8a9d0f8 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] [instance: 64318452-365b-4b80-b53b-9367dd8bc826] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:06:19.427738 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-eb7b62d7-7899-4ea5-a19b-e740a8a9d0f8 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:19.429437 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-eb7b62d7-7899-4ea5-a19b-e740a8a9d0f8 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:19.432713 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-eb7b62d7-7899-4ea5-a19b-e740a8a9d0f8 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:19.433835 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-eb7b62d7-7899-4ea5-a19b-e740a8a9d0f8 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:19.434611 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-eb7b62d7-7899-4ea5-a19b-e740a8a9d0f8 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:19.436321 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-eb7b62d7-7899-4ea5-a19b-e740a8a9d0f8 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:19.624374 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-3406d634-1e08-48dd-814a-9b367326a4d2 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879c85830a9f42088a4ebdf1e3cfb39b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b54f56cfbc814cccb533c65966f35a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:06:19.638127 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-3406d634-1e08-48dd-814a-9b367326a4d2 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] 10.222.0.18 "GET /compute/v2.1/servers/3fdb6d35-9428-4253-ad00-932310ecdf5d" status: 200 len: 1504 microversion: 2.1 time: 0.875768 Oct 22 21:06:19.640622 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1785/3605] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:06:18 2022] GET /compute/v2.1/servers/3fdb6d35-9428-4253-ad00-932310ecdf5d => generated 1504 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:06:19.660988 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-91885934-4c70-4168-bb3c-f4343e6f9dda tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:19.662283 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-91885934-4c70-4168-bb3c-f4343e6f9dda tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] [instance: e24e9888-adfe-455c-b53e-da3bf5729d69] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:06:19.676807 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-91885934-4c70-4168-bb3c-f4343e6f9dda tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:19.680631 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-91885934-4c70-4168-bb3c-f4343e6f9dda tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:19.681472 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-91885934-4c70-4168-bb3c-f4343e6f9dda tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:19.682955 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-91885934-4c70-4168-bb3c-f4343e6f9dda tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:19.686745 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-91885934-4c70-4168-bb3c-f4343e6f9dda tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:19.687367 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-91885934-4c70-4168-bb3c-f4343e6f9dda tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:20.271717 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-91885934-4c70-4168-bb3c-f4343e6f9dda tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de9c0914dd6943bfa313ac456524cbba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af4c5251e7348c0ae5fc62468243a81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:06:20.288016 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-91885934-4c70-4168-bb3c-f4343e6f9dda tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] 10.222.0.18 "GET /compute/v2.1/servers/e24e9888-adfe-455c-b53e-da3bf5729d69" status: 200 len: 1325 microversion: 2.1 time: 0.644552 Oct 22 21:06:20.288924 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1786/3606] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:06:19 2022] GET /compute/v2.1/servers/e24e9888-adfe-455c-b53e-da3bf5729d69 => generated 1325 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:06:20.299505 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-9f00b86e-6b9e-4179-bc1d-686d1368c124 req-a1f90153-0c4f-4fd4-aa19-5dae7a1d5cc6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64318452-365b-4b80-b53b-9367dd8bc826", "tag": "1427b023-b32b-4457-b8e8-a5d2fe4301fa"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:06:20.323687 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-9f00b86e-6b9e-4179-bc1d-686d1368c124 req-a1f90153-0c4f-4fd4-aa19-5dae7a1d5cc6 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:20.324079 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-9f00b86e-6b9e-4179-bc1d-686d1368c124 req-a1f90153-0c4f-4fd4-aa19-5dae7a1d5cc6 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:20.324516 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-9f00b86e-6b9e-4179-bc1d-686d1368c124 req-a1f90153-0c4f-4fd4-aa19-5dae7a1d5cc6 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:20.349461 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-9f00b86e-6b9e-4179-bc1d-686d1368c124 req-a1f90153-0c4f-4fd4-aa19-5dae7a1d5cc6 service nova] Creating event network-changed:1427b023-b32b-4457-b8e8-a5d2fe4301fa for instance 64318452-365b-4b80-b53b-9367dd8bc826 on nch2-master-1 Oct 22 21:06:20.362164 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-9f00b86e-6b9e-4179-bc1d-686d1368c124 req-a1f90153-0c4f-4fd4-aa19-5dae7a1d5cc6 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071766 Oct 22 21:06:20.363218 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1787/3607] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:06:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:06:20.368616 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-f7cd8b9a-ebf8-4c33-a298-43381576638f tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:20.369304 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-f7cd8b9a-ebf8-4c33-a298-43381576638f tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] [instance: a26fa9bd-fad2-40a2-910e-2208fb769dcb] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:06:20.391557 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f7cd8b9a-ebf8-4c33-a298-43381576638f tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:20.392390 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f7cd8b9a-ebf8-4c33-a298-43381576638f tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:20.393111 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f7cd8b9a-ebf8-4c33-a298-43381576638f tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:20.394113 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f7cd8b9a-ebf8-4c33-a298-43381576638f tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:20.395631 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f7cd8b9a-ebf8-4c33-a298-43381576638f tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:20.397124 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f7cd8b9a-ebf8-4c33-a298-43381576638f tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:20.474191 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-eb7b62d7-7899-4ea5-a19b-e740a8a9d0f8 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3820b31a424c3a9216a6ef91fcb285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a42c3ecf474883ac652fcc8c01c9f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:06:20.489038 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-eb7b62d7-7899-4ea5-a19b-e740a8a9d0f8 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] 10.222.0.18 "GET /compute/v2.1/servers/64318452-365b-4b80-b53b-9367dd8bc826" status: 200 len: 1342 microversion: 2.1 time: 1.090951 Oct 22 21:06:20.489725 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1821/3608] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:06:19 2022] GET /compute/v2.1/servers/64318452-365b-4b80-b53b-9367dd8bc826 => generated 1342 bytes in 1094 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:06:20.502099 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-69a02c13-4414-45df-8bea-15b907643f72 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:20.503931 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-69a02c13-4414-45df-8bea-15b907643f72 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] [instance: e09b7865-0b24-4e50-a66a-342dd2e6e5e3] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:06:20.525523 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-69a02c13-4414-45df-8bea-15b907643f72 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:20.526197 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-69a02c13-4414-45df-8bea-15b907643f72 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:20.526674 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-69a02c13-4414-45df-8bea-15b907643f72 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:20.531689 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-69a02c13-4414-45df-8bea-15b907643f72 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:20.532615 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-69a02c13-4414-45df-8bea-15b907643f72 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:20.533319 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-69a02c13-4414-45df-8bea-15b907643f72 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:20.918974 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-f7cd8b9a-ebf8-4c33-a298-43381576638f tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a44ff8e7c14b94b1670f030085c43d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a26a2284f4424cbeaf63d504652546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:06:20.930331 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-f7cd8b9a-ebf8-4c33-a298-43381576638f tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] 10.222.0.18 "GET /compute/v2.1/servers/a26fa9bd-fad2-40a2-910e-2208fb769dcb" status: 200 len: 1507 microversion: 2.1 time: 0.565639 Oct 22 21:06:20.939960 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1788/3609] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:06:20 2022] GET /compute/v2.1/servers/a26fa9bd-fad2-40a2-910e-2208fb769dcb => generated 1507 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:06:20.944921 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-1024db2f-7aa2-4d75-8ec1-6628bf2b1c7f tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:20.946605 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-1024db2f-7aa2-4d75-8ec1-6628bf2b1c7f tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] [instance: 3fdb6d35-9428-4253-ad00-932310ecdf5d] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:06:20.973555 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1024db2f-7aa2-4d75-8ec1-6628bf2b1c7f tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:20.974280 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1024db2f-7aa2-4d75-8ec1-6628bf2b1c7f tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:20.974904 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1024db2f-7aa2-4d75-8ec1-6628bf2b1c7f tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:20.976209 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1024db2f-7aa2-4d75-8ec1-6628bf2b1c7f tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:20.978057 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1024db2f-7aa2-4d75-8ec1-6628bf2b1c7f tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:20.979169 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1024db2f-7aa2-4d75-8ec1-6628bf2b1c7f tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:21.008806 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:SELECT=100 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:06:21.331447 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-69a02c13-4414-45df-8bea-15b907643f72 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcdfeb6c1cda4810b9fa70fdfd9a66c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c774a85b2c41c98486cf91b1253363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:06:21.343566 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-69a02c13-4414-45df-8bea-15b907643f72 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] 10.222.0.18 "GET /compute/v2.1/servers/e09b7865-0b24-4e50-a66a-342dd2e6e5e3" status: 200 len: 1515 microversion: 2.1 time: 0.852686 Oct 22 21:06:21.344842 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1822/3610] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:06:20 2022] GET /compute/v2.1/servers/e09b7865-0b24-4e50-a66a-342dd2e6e5e3 => generated 1515 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:06:21.350927 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-d951abbd-7eea-4149-8bcc-44945bc204a0 req-e4c62a72-7740-455f-ae96-1d513eac767a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a26fa9bd-fad2-40a2-910e-2208fb769dcb", "name": "network-vif-plugged", "status": "completed", "tag": "d2dc36e2-25aa-4eae-ac3a-801900c71b45"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:06:21.363855 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-d951abbd-7eea-4149-8bcc-44945bc204a0 req-e4c62a72-7740-455f-ae96-1d513eac767a service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:21.364662 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-d951abbd-7eea-4149-8bcc-44945bc204a0 req-e4c62a72-7740-455f-ae96-1d513eac767a service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:21.366235 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-d951abbd-7eea-4149-8bcc-44945bc204a0 req-e4c62a72-7740-455f-ae96-1d513eac767a service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:21.383411 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-d951abbd-7eea-4149-8bcc-44945bc204a0 req-e4c62a72-7740-455f-ae96-1d513eac767a service nova] Creating event network-vif-plugged:d2dc36e2-25aa-4eae-ac3a-801900c71b45 for instance a26fa9bd-fad2-40a2-910e-2208fb769dcb on nch1-master-1 Oct 22 21:06:21.390007 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-d951abbd-7eea-4149-8bcc-44945bc204a0 req-e4c62a72-7740-455f-ae96-1d513eac767a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043713 Oct 22 21:06:21.390871 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1823/3611] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:06:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:06:21.398221 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-877cb444-6237-42e3-af70-6666cd22822a tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:21.399510 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-877cb444-6237-42e3-af70-6666cd22822a tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] [instance: e24e9888-adfe-455c-b53e-da3bf5729d69] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:06:21.407133 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-877cb444-6237-42e3-af70-6666cd22822a tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:21.416021 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-877cb444-6237-42e3-af70-6666cd22822a tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:21.417110 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-877cb444-6237-42e3-af70-6666cd22822a tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:21.418257 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-877cb444-6237-42e3-af70-6666cd22822a tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:21.418908 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-877cb444-6237-42e3-af70-6666cd22822a tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:21.419566 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-877cb444-6237-42e3-af70-6666cd22822a tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:22.071047 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-1024db2f-7aa2-4d75-8ec1-6628bf2b1c7f tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879c85830a9f42088a4ebdf1e3cfb39b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b54f56cfbc814cccb533c65966f35a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:06:22.084500 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-1024db2f-7aa2-4d75-8ec1-6628bf2b1c7f tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] 10.222.0.18 "GET /compute/v2.1/servers/3fdb6d35-9428-4253-ad00-932310ecdf5d" status: 200 len: 1504 microversion: 2.1 time: 1.142664 Oct 22 21:06:22.088041 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1789/3612] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:06:20 2022] GET /compute/v2.1/servers/3fdb6d35-9428-4253-ad00-932310ecdf5d => generated 1504 bytes in 1147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:06:22.104199 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-490b80c8-5f9b-4874-9e8d-55ac9d08b462 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:22.107313 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-490b80c8-5f9b-4874-9e8d-55ac9d08b462 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] [instance: 64318452-365b-4b80-b53b-9367dd8bc826] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:06:22.118309 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-490b80c8-5f9b-4874-9e8d-55ac9d08b462 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:22.122642 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-490b80c8-5f9b-4874-9e8d-55ac9d08b462 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:22.127725 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-490b80c8-5f9b-4874-9e8d-55ac9d08b462 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:22.128769 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-490b80c8-5f9b-4874-9e8d-55ac9d08b462 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:22.129917 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-490b80c8-5f9b-4874-9e8d-55ac9d08b462 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:22.131587 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-490b80c8-5f9b-4874-9e8d-55ac9d08b462 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:22.251565 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-877cb444-6237-42e3-af70-6666cd22822a tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de9c0914dd6943bfa313ac456524cbba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af4c5251e7348c0ae5fc62468243a81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:06:22.267997 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-877cb444-6237-42e3-af70-6666cd22822a tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] 10.222.0.18 "GET /compute/v2.1/servers/e24e9888-adfe-455c-b53e-da3bf5729d69" status: 200 len: 1522 microversion: 2.1 time: 0.875388 Oct 22 21:06:22.279841 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1824/3613] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:06:21 2022] GET /compute/v2.1/servers/e24e9888-adfe-455c-b53e-da3bf5729d69 => generated 1522 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:06:22.279841 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-b3b3f321-a726-401b-9f49-8e53166f9ec0 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:22.280352 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-b3b3f321-a726-401b-9f49-8e53166f9ec0 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] [instance: a26fa9bd-fad2-40a2-910e-2208fb769dcb] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:06:22.296156 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b3b3f321-a726-401b-9f49-8e53166f9ec0 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:22.296673 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b3b3f321-a726-401b-9f49-8e53166f9ec0 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:22.297134 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b3b3f321-a726-401b-9f49-8e53166f9ec0 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:22.297879 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b3b3f321-a726-401b-9f49-8e53166f9ec0 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:22.298353 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b3b3f321-a726-401b-9f49-8e53166f9ec0 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:22.298791 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b3b3f321-a726-401b-9f49-8e53166f9ec0 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:22.943325 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-490b80c8-5f9b-4874-9e8d-55ac9d08b462 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3820b31a424c3a9216a6ef91fcb285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a42c3ecf474883ac652fcc8c01c9f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:06:22.955901 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-490b80c8-5f9b-4874-9e8d-55ac9d08b462 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] 10.222.0.18 "GET /compute/v2.1/servers/64318452-365b-4b80-b53b-9367dd8bc826" status: 200 len: 1376 microversion: 2.1 time: 0.866363 Oct 22 21:06:22.974934 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1790/3614] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:06:22 2022] GET /compute/v2.1/servers/64318452-365b-4b80-b53b-9367dd8bc826 => generated 1376 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:06:22.989265 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-87fe0c76-bab8-449e-9b48-f1a019562397 tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:22.990196 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-87fe0c76-bab8-449e-9b48-f1a019562397 tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] [instance: e24e9888-adfe-455c-b53e-da3bf5729d69] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:06:23.002173 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-87fe0c76-bab8-449e-9b48-f1a019562397 tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:23.002939 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-87fe0c76-bab8-449e-9b48-f1a019562397 tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:23.003771 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-87fe0c76-bab8-449e-9b48-f1a019562397 tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:23.004958 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-87fe0c76-bab8-449e-9b48-f1a019562397 tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:23.006031 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-87fe0c76-bab8-449e-9b48-f1a019562397 tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:23.006611 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-87fe0c76-bab8-449e-9b48-f1a019562397 tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:23.019138 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-b3b3f321-a726-401b-9f49-8e53166f9ec0 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a44ff8e7c14b94b1670f030085c43d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a26a2284f4424cbeaf63d504652546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:06:23.036509 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-b3b3f321-a726-401b-9f49-8e53166f9ec0 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] 10.222.0.18 "GET /compute/v2.1/servers/a26fa9bd-fad2-40a2-910e-2208fb769dcb" status: 200 len: 1507 microversion: 2.1 time: 0.762038 Oct 22 21:06:23.037314 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1825/3615] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:06:22 2022] GET /compute/v2.1/servers/a26fa9bd-fad2-40a2-910e-2208fb769dcb => generated 1507 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:06:23.057175 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-e95927e4-323f-4855-bcc2-482abb446dbd tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:23.059362 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-87fe0c76-bab8-449e-9b48-f1a019562397 tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] HTTP exception thrown: Action 999 not found Oct 22 21:06:23.059510 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-e95927e4-323f-4855-bcc2-482abb446dbd tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] [instance: e09b7865-0b24-4e50-a66a-342dd2e6e5e3] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:06:23.068232 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-87fe0c76-bab8-449e-9b48-f1a019562397 tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] Request method failure captured: Oct 22 21:06:23.068232 ncdv-master-1 devstack@n-api.service[138744]: request: GET /compute/v2.1/servers/e24e9888-adfe-455c-b53e-da3bf5729d69/os-instance-actions/999 HTTP/1.1 Oct 22 21:06:23.068232 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 21:06:23.068232 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 21:06:23.068232 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 21:06:23.068232 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 0 Oct 22 21:06:23.068232 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 21:06:23.068232 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 21:06:23.068232 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 21:06:23.068232 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 21:06:23.068232 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVFsvUIUYzArxAJ4ip2fcWFLuhkh-h9Av8hhEI8lvft0O-HAgwp4h_vAuA8SxaYyvc4PR2Icby8aBJmo8hHz2FGW0Jny_-Jj70jx9IOPdcw8gMgLI0a3hVBM5ZRg6vaHGrFTBtSHeg11EM5tsNrGZ1KF1ggyB0jpPIDEOLwqqf7avblg Oct 22 21:06:23.068232 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 21:06:23.068232 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 21:06:23.068232 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 21:06:23.068232 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 21:06:23.068232 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 21:06:23.068232 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 21:06:23.068232 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: 0af4c5251e7348c0ae5fc62468243a81 Oct 22 21:06:23.068232 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-496210032 Oct 22 21:06:23.068232 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 21:06:23.068232 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 21:06:23.068232 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_0af4c5251e7348c0ae5fc62468243a81"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0af4c5251e7348c0ae5fc62468243a81"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/0af4c5251e7348c0ae5fc62468243a81"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0af4c5251e7348c0ae5fc62468243a81"}]}] Oct 22 21:06:23.068232 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-496210032 Oct 22 21:06:23.068232 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: 0af4c5251e7348c0ae5fc62468243a81 Oct 22 21:06:23.068232 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-496210032 Oct 22 21:06:23.068232 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-InstanceActionsNegativeTestJSON-496210032-project Oct 22 21:06:23.068232 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 21:06:23.068232 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 21:06:23.068232 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: de9c0914dd6943bfa313ac456524cbba Oct 22 21:06:23.068232 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-496210032-project Oct 22 21:06:23.068232 ncdv-master-1 devstack@n-api.service[138744]: method: > Oct 22 21:06:23.068232 ncdv-master-1 devstack@n-api.service[138744]: exception: Action 999 not found Oct 22 21:06:23.068232 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'server_id': 'e24e9888-adfe-455c-b53e-da3bf5729d69', 'id': '999'} Oct 22 21:06:23.068232 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:06:23.068232 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:06:23.068232 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:06:23.068232 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:06:23.068232 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:06:23.068232 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:06:23.068232 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:06:23.068232 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:06:23.068232 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 152, in show Oct 22 21:06:23.068232 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 22 21:06:23.068232 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Action 999 not found Oct 22 21:06:23.068232 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:06:23.068232 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:06:23.068232 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:06:23.068232 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:06:23.068232 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:06:23.068232 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:06:23.068232 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:06:23.068232 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:06:23.068232 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Action 999 not found Oct 22 21:06:23.068232 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:06:23.078285 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-87fe0c76-bab8-449e-9b48-f1a019562397 tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] Returning 404 to user: Action 999 not found {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:06:23.078285 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-87fe0c76-bab8-449e-9b48-f1a019562397 tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] 10.222.0.18 "GET /compute/v2.1/servers/e24e9888-adfe-455c-b53e-da3bf5729d69/os-instance-actions/999" status: 404 len: 66 microversion: 2.1 time: 0.091859 Oct 22 21:06:23.078285 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1791/3616] 10.222.0.18 () {58 vars in 1308 bytes} [Sat Oct 22 21:06:22 2022] GET /compute/v2.1/servers/e24e9888-adfe-455c-b53e-da3bf5729d69/os-instance-actions/999 => generated 66 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 22 21:06:23.078285 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-a37f64ae-7c0f-46aa-b48e-79050d592b0d req-030bc823-efbd-47f3-8678-4092bc753816 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3fdb6d35-9428-4253-ad00-932310ecdf5d", "name": "network-vif-deleted", "tag": "50c60f5d-e9d4-4a3b-95fc-83e6b2ec07bb"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:06:23.079089 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e95927e4-323f-4855-bcc2-482abb446dbd tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:23.079666 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e95927e4-323f-4855-bcc2-482abb446dbd tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:23.083597 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e95927e4-323f-4855-bcc2-482abb446dbd tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:23.084797 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e95927e4-323f-4855-bcc2-482abb446dbd tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:23.085628 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e95927e4-323f-4855-bcc2-482abb446dbd tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:23.086299 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e95927e4-323f-4855-bcc2-482abb446dbd tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:23.102039 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-a37f64ae-7c0f-46aa-b48e-79050d592b0d req-030bc823-efbd-47f3-8678-4092bc753816 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:23.102522 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-a37f64ae-7c0f-46aa-b48e-79050d592b0d req-030bc823-efbd-47f3-8678-4092bc753816 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:23.103089 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-a37f64ae-7c0f-46aa-b48e-79050d592b0d req-030bc823-efbd-47f3-8678-4092bc753816 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:23.116181 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-a37f64ae-7c0f-46aa-b48e-79050d592b0d req-030bc823-efbd-47f3-8678-4092bc753816 service nova] Creating event network-vif-deleted:50c60f5d-e9d4-4a3b-95fc-83e6b2ec07bb for instance 3fdb6d35-9428-4253-ad00-932310ecdf5d on nch1-master-1 Oct 22 21:06:23.121374 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-a37f64ae-7c0f-46aa-b48e-79050d592b0d req-030bc823-efbd-47f3-8678-4092bc753816 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049582 Oct 22 21:06:23.122473 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1792/3617] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:06:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:06:23.128043 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-02dce1d0-8ccf-4a89-8923-1cae7a7d3e15 tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] Calling method '.version_select at 0x7fd39ee64af0>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:23.128875 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-02dce1d0-8ccf-4a89-8923-1cae7a7d3e15 tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] [instance: 4692dec1-0f0e-4ac8-b2d5-e8dc0d8b6a42] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:06:23.135040 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-02dce1d0-8ccf-4a89-8923-1cae7a7d3e15 tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] HTTP exception thrown: Instance 4692dec1-0f0e-4ac8-b2d5-e8dc0d8b6a42 could not be found. Oct 22 21:06:23.137156 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-02dce1d0-8ccf-4a89-8923-1cae7a7d3e15 tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] Request method failure captured: Oct 22 21:06:23.137156 ncdv-master-1 devstack@n-api.service[138744]: request: GET /compute/v2.1/servers/4692dec1-0f0e-4ac8-b2d5-e8dc0d8b6a42/os-instance-actions HTTP/1.1 Oct 22 21:06:23.137156 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 21:06:23.137156 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 21:06:23.137156 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 21:06:23.137156 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 0 Oct 22 21:06:23.137156 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 21:06:23.137156 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 21:06:23.137156 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 21:06:23.137156 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 21:06:23.137156 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVFsvUIUYzArxAJ4ip2fcWFLuhkh-h9Av8hhEI8lvft0O-HAgwp4h_vAuA8SxaYyvc4PR2Icby8aBJmo8hHz2FGW0Jny_-Jj70jx9IOPdcw8gMgLI0a3hVBM5ZRg6vaHGrFTBtSHeg11EM5tsNrGZ1KF1ggyB0jpPIDEOLwqqf7avblg Oct 22 21:06:23.137156 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 21:06:23.137156 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 21:06:23.137156 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 21:06:23.137156 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 21:06:23.137156 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 21:06:23.137156 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 21:06:23.137156 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: 0af4c5251e7348c0ae5fc62468243a81 Oct 22 21:06:23.137156 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-496210032 Oct 22 21:06:23.137156 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 21:06:23.137156 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 21:06:23.137156 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_0af4c5251e7348c0ae5fc62468243a81"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0af4c5251e7348c0ae5fc62468243a81"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/0af4c5251e7348c0ae5fc62468243a81"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0af4c5251e7348c0ae5fc62468243a81"}]}] Oct 22 21:06:23.137156 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-496210032 Oct 22 21:06:23.137156 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: 0af4c5251e7348c0ae5fc62468243a81 Oct 22 21:06:23.137156 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-496210032 Oct 22 21:06:23.137156 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-InstanceActionsNegativeTestJSON-496210032-project Oct 22 21:06:23.137156 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 21:06:23.137156 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 21:06:23.137156 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: de9c0914dd6943bfa313ac456524cbba Oct 22 21:06:23.137156 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-496210032-project Oct 22 21:06:23.137156 ncdv-master-1 devstack@n-api.service[138744]: method: Oct 22 21:06:23.137156 ncdv-master-1 devstack@n-api.service[138744]: exception: Instance 4692dec1-0f0e-4ac8-b2d5-e8dc0d8b6a42 could not be found. Oct 22 21:06:23.137156 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'server_id': '4692dec1-0f0e-4ac8-b2d5-e8dc0d8b6a42'} Oct 22 21:06:23.137156 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:06:23.137156 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:06:23.137156 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 21:06:23.137156 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 21:06:23.137156 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 21:06:23.137156 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 21:06:23.137156 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 22 21:06:23.137156 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 22 21:06:23.137156 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4692dec1-0f0e-4ac8-b2d5-e8dc0d8b6a42 could not be found. Oct 22 21:06:23.137156 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:06:23.137156 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:06:23.137156 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:06:23.137156 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:06:23.137156 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:06:23.137156 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:06:23.137156 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:06:23.137156 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:06:23.137156 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 22 21:06:23.137156 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 22 21:06:23.137156 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:06:23.137156 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:06:23.137156 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 89, in index Oct 22 21:06:23.137156 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(req, context, server_id) Oct 22 21:06:23.137156 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 22 21:06:23.137156 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 22 21:06:23.137156 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 77, in _get_instance Oct 22 21:06:23.137156 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return common.get_instance(self.compute_api, context, server_id) Oct 22 21:06:23.137156 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 21:06:23.137156 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:06:23.141694 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4692dec1-0f0e-4ac8-b2d5-e8dc0d8b6a42 could not be found. Oct 22 21:06:23.141694 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:06:23.141694 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:06:23.141694 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:06:23.141694 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:06:23.141694 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:06:23.141694 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:06:23.141694 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:06:23.141694 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:06:23.141694 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4692dec1-0f0e-4ac8-b2d5-e8dc0d8b6a42 could not be found. Oct 22 21:06:23.141694 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:06:23.143250 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-02dce1d0-8ccf-4a89-8923-1cae7a7d3e15 tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] Returning 404 to user: Instance 4692dec1-0f0e-4ac8-b2d5-e8dc0d8b6a42 could not be found. {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:06:23.149605 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-02dce1d0-8ccf-4a89-8923-1cae7a7d3e15 tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] 10.222.0.18 "GET /compute/v2.1/servers/4692dec1-0f0e-4ac8-b2d5-e8dc0d8b6a42/os-instance-actions" status: 404 len: 111 microversion: 2.1 time: 0.025807 Oct 22 21:06:23.150620 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1793/3618] 10.222.0.18 () {58 vars in 1296 bytes} [Sat Oct 22 21:06:23 2022] GET /compute/v2.1/servers/4692dec1-0f0e-4ac8-b2d5-e8dc0d8b6a42/os-instance-actions => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 21:06:23.161451 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-f9c5c158-0432-4c8c-a995-2596b4111dbd tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:23.162107 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-f9c5c158-0432-4c8c-a995-2596b4111dbd tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] [instance: 3fdb6d35-9428-4253-ad00-932310ecdf5d] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:06:23.174298 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f9c5c158-0432-4c8c-a995-2596b4111dbd tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:23.174971 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f9c5c158-0432-4c8c-a995-2596b4111dbd tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:23.175635 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f9c5c158-0432-4c8c-a995-2596b4111dbd tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:23.176809 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f9c5c158-0432-4c8c-a995-2596b4111dbd tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:23.177491 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f9c5c158-0432-4c8c-a995-2596b4111dbd tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:23.178202 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f9c5c158-0432-4c8c-a995-2596b4111dbd tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:23.233287 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:06:23.246001 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f9c5c158-0432-4c8c-a995-2596b4111dbd tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:23.249091 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f9c5c158-0432-4c8c-a995-2596b4111dbd tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:23.249632 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f9c5c158-0432-4c8c-a995-2596b4111dbd tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:23.250342 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.objects.instance [None req-f9c5c158-0432-4c8c-a995-2596b4111dbd tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lazy-loading 'fault' on Instance uuid 3fdb6d35-9428-4253-ad00-932310ecdf5d {{(pid=138744) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 21:06:23.332168 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-f9c5c158-0432-4c8c-a995-2596b4111dbd tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879c85830a9f42088a4ebdf1e3cfb39b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b54f56cfbc814cccb533c65966f35a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:06:23.340744 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-f9c5c158-0432-4c8c-a995-2596b4111dbd tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] 10.222.0.18 "GET /compute/v2.1/servers/3fdb6d35-9428-4253-ad00-932310ecdf5d" status: 200 len: 1303 microversion: 2.1 time: 0.188787 Oct 22 21:06:23.341325 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1794/3619] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:06:23 2022] GET /compute/v2.1/servers/3fdb6d35-9428-4253-ad00-932310ecdf5d => generated 1303 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:06:23.346021 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-16439cce-04bf-4431-9453-eb44c4cde28e tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:23.346670 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-16439cce-04bf-4431-9453-eb44c4cde28e tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] [instance: e24e9888-adfe-455c-b53e-da3bf5729d69] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:06:23.354237 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-16439cce-04bf-4431-9453-eb44c4cde28e tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:23.354954 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-16439cce-04bf-4431-9453-eb44c4cde28e tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:23.355580 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-16439cce-04bf-4431-9453-eb44c4cde28e tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:23.356445 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-16439cce-04bf-4431-9453-eb44c4cde28e tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:23.356897 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-16439cce-04bf-4431-9453-eb44c4cde28e tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:23.357371 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-16439cce-04bf-4431-9453-eb44c4cde28e tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:23.385220 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-16439cce-04bf-4431-9453-eb44c4cde28e tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] [instance: e24e9888-adfe-455c-b53e-da3bf5729d69] Going to try to terminate instance {{(pid=138744) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 21:06:23.519980 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-e95927e4-323f-4855-bcc2-482abb446dbd tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcdfeb6c1cda4810b9fa70fdfd9a66c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c774a85b2c41c98486cf91b1253363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:06:23.526081 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-16439cce-04bf-4431-9453-eb44c4cde28e tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] 10.222.0.18 "DELETE /compute/v2.1/servers/e24e9888-adfe-455c-b53e-da3bf5729d69" status: 204 len: 0 microversion: 2.1 time: 0.182977 Oct 22 21:06:23.526725 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1795/3620] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 21:06:23 2022] DELETE /compute/v2.1/servers/e24e9888-adfe-455c-b53e-da3bf5729d69 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 21:06:23.538769 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-e95927e4-323f-4855-bcc2-482abb446dbd tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] 10.222.0.18 "GET /compute/v2.1/servers/e09b7865-0b24-4e50-a66a-342dd2e6e5e3" status: 200 len: 1515 microversion: 2.1 time: 0.496461 Oct 22 21:06:23.543058 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-0d3de931-e283-4a93-9454-bbe924b897ff tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:23.544159 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-0d3de931-e283-4a93-9454-bbe924b897ff tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] [instance: e24e9888-adfe-455c-b53e-da3bf5729d69] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:06:23.563163 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1826/3621] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:06:23 2022] GET /compute/v2.1/servers/e09b7865-0b24-4e50-a66a-342dd2e6e5e3 => generated 1515 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:06:23.574644 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0d3de931-e283-4a93-9454-bbe924b897ff tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:23.580040 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0d3de931-e283-4a93-9454-bbe924b897ff tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:23.583143 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0d3de931-e283-4a93-9454-bbe924b897ff tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:23.583947 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0d3de931-e283-4a93-9454-bbe924b897ff tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:23.584509 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0d3de931-e283-4a93-9454-bbe924b897ff tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:23.588073 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0d3de931-e283-4a93-9454-bbe924b897ff tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:23.767785 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell0:SELECT=2 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:06:23.973181 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell0:SELECT=8 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:06:23.983193 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-4f8378c5-c950-40fd-8c13-14ca57d383b6 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:23.984615 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-4f8378c5-c950-40fd-8c13-14ca57d383b6 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] [instance: 64318452-365b-4b80-b53b-9367dd8bc826] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:06:23.991860 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4f8378c5-c950-40fd-8c13-14ca57d383b6 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:23.992356 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4f8378c5-c950-40fd-8c13-14ca57d383b6 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:23.992964 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4f8378c5-c950-40fd-8c13-14ca57d383b6 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:23.993830 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4f8378c5-c950-40fd-8c13-14ca57d383b6 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:23.994482 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4f8378c5-c950-40fd-8c13-14ca57d383b6 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:23.994889 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4f8378c5-c950-40fd-8c13-14ca57d383b6 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:24.036989 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-0d3de931-e283-4a93-9454-bbe924b897ff tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de9c0914dd6943bfa313ac456524cbba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af4c5251e7348c0ae5fc62468243a81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:06:24.051314 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-0d3de931-e283-4a93-9454-bbe924b897ff tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] 10.222.0.18 "GET /compute/v2.1/servers/e24e9888-adfe-455c-b53e-da3bf5729d69" status: 200 len: 1528 microversion: 2.1 time: 0.519160 Oct 22 21:06:24.066210 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1796/3622] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:06:23 2022] GET /compute/v2.1/servers/e24e9888-adfe-455c-b53e-da3bf5729d69 => generated 1528 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:06:24.072900 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-bff8d2ea-db41-4b3c-b914-15f2c0eb2ffc tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:24.073979 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-bff8d2ea-db41-4b3c-b914-15f2c0eb2ffc tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] [instance: a26fa9bd-fad2-40a2-910e-2208fb769dcb] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:06:24.080862 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bff8d2ea-db41-4b3c-b914-15f2c0eb2ffc tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:24.081556 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bff8d2ea-db41-4b3c-b914-15f2c0eb2ffc tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:24.081866 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bff8d2ea-db41-4b3c-b914-15f2c0eb2ffc tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:24.082614 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bff8d2ea-db41-4b3c-b914-15f2c0eb2ffc tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:24.083148 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bff8d2ea-db41-4b3c-b914-15f2c0eb2ffc tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:24.083607 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bff8d2ea-db41-4b3c-b914-15f2c0eb2ffc tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:24.412754 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-4f8378c5-c950-40fd-8c13-14ca57d383b6 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3820b31a424c3a9216a6ef91fcb285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a42c3ecf474883ac652fcc8c01c9f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:06:24.423144 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-bff8d2ea-db41-4b3c-b914-15f2c0eb2ffc tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a44ff8e7c14b94b1670f030085c43d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a26a2284f4424cbeaf63d504652546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:06:24.423928 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:06:24.427749 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-4f8378c5-c950-40fd-8c13-14ca57d383b6 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] 10.222.0.18 "GET /compute/v2.1/servers/64318452-365b-4b80-b53b-9367dd8bc826" status: 200 len: 1376 microversion: 2.1 time: 0.448482 Oct 22 21:06:24.428680 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1827/3623] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:06:23 2022] GET /compute/v2.1/servers/64318452-365b-4b80-b53b-9367dd8bc826 => generated 1376 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:06:24.431727 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-bff8d2ea-db41-4b3c-b914-15f2c0eb2ffc tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] 10.222.0.18 "GET /compute/v2.1/servers/a26fa9bd-fad2-40a2-910e-2208fb769dcb" status: 200 len: 1507 microversion: 2.1 time: 0.372010 Oct 22 21:06:24.432300 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1797/3624] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:06:24 2022] GET /compute/v2.1/servers/a26fa9bd-fad2-40a2-910e-2208fb769dcb => generated 1507 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:06:24.441307 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-c1a4902a-2984-4bd1-b9bb-885081f238c5 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:24.442422 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-c1a4902a-2984-4bd1-b9bb-885081f238c5 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] [instance: 3fdb6d35-9428-4253-ad00-932310ecdf5d] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:06:24.449342 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c1a4902a-2984-4bd1-b9bb-885081f238c5 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:24.451312 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c1a4902a-2984-4bd1-b9bb-885081f238c5 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:24.452018 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c1a4902a-2984-4bd1-b9bb-885081f238c5 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:24.452934 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c1a4902a-2984-4bd1-b9bb-885081f238c5 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:24.453577 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c1a4902a-2984-4bd1-b9bb-885081f238c5 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:24.454171 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c1a4902a-2984-4bd1-b9bb-885081f238c5 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:24.475890 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.wsgi [None req-c1a4902a-2984-4bd1-b9bb-885081f238c5 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] HTTP exception thrown: Instance 3fdb6d35-9428-4253-ad00-932310ecdf5d could not be found. Oct 22 21:06:24.478123 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-c1a4902a-2984-4bd1-b9bb-885081f238c5 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Request method failure captured: Oct 22 21:06:24.478123 ncdv-master-1 devstack@n-api.service[138745]: request: GET /compute/v2.1/servers/3fdb6d35-9428-4253-ad00-932310ecdf5d HTTP/1.1 Oct 22 21:06:24.478123 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 21:06:24.478123 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 21:06:24.478123 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 21:06:24.478123 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 0 Oct 22 21:06:24.478123 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 21:06:24.478123 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 21:06:24.478123 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 21:06:24.478123 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 21:06:24.478123 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVFqx_9-VvpsFGnkexMjdtUkafNppeKBePbITA5VpFRE9bI_4rajpdkpz74Cwdg9A1Rgg09iXej3F9cOvEML2VtUqB5QnXNdVA3eusDsChduLaQJCAn3h7XnZkaspwcHRirleWzU8FOBCrXX8rGF2fSl5O4LYaoDdzy0kgx3lK4c0ALk Oct 22 21:06:24.478123 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 21:06:24.478123 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 21:06:24.478123 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 21:06:24.478123 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 21:06:24.478123 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 21:06:24.478123 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 21:06:24.478123 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: b54f56cfbc814cccb533c65966f35a93 Oct 22 21:06:24.478123 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-ServerRescueTestJSON-1453097790 Oct 22 21:06:24.478123 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 21:06:24.478123 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 21:06:24.478123 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_b54f56cfbc814cccb533c65966f35a93"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b54f56cfbc814cccb533c65966f35a93"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/b54f56cfbc814cccb533c65966f35a93"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b54f56cfbc814cccb533c65966f35a93"}]}] Oct 22 21:06:24.478123 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-ServerRescueTestJSON-1453097790 Oct 22 21:06:24.478123 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: b54f56cfbc814cccb533c65966f35a93 Oct 22 21:06:24.478123 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-ServerRescueTestJSON-1453097790 Oct 22 21:06:24.478123 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-ServerRescueTestJSON-1453097790-project Oct 22 21:06:24.478123 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 21:06:24.478123 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 21:06:24.478123 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: 879c85830a9f42088a4ebdf1e3cfb39b Oct 22 21:06:24.478123 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-ServerRescueTestJSON-1453097790-project Oct 22 21:06:24.478123 ncdv-master-1 devstack@n-api.service[138745]: method: > Oct 22 21:06:24.478123 ncdv-master-1 devstack@n-api.service[138745]: exception: Instance 3fdb6d35-9428-4253-ad00-932310ecdf5d could not be found. Oct 22 21:06:24.478123 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'id': '3fdb6d35-9428-4253-ad00-932310ecdf5d'} Oct 22 21:06:24.478123 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:06:24.478123 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:06:24.478123 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 21:06:24.478123 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 21:06:24.478123 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 21:06:24.478123 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 21:06:24.478123 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 21:06:24.478123 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 21:06:24.478123 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 21:06:24.478123 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 21:06:24.478123 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3fdb6d35-9428-4253-ad00-932310ecdf5d could not be found. Oct 22 21:06:24.478123 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:06:24.478123 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:06:24.478123 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:06:24.478123 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:06:24.478123 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:06:24.478123 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:06:24.478123 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:06:24.478123 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:06:24.478123 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:06:24.478123 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:06:24.478123 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 21:06:24.478123 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 21:06:24.478123 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 21:06:24.478123 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 21:06:24.478123 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 21:06:24.478123 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:06:24.478123 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3fdb6d35-9428-4253-ad00-932310ecdf5d could not be found. Oct 22 21:06:24.478123 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:06:24.478123 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:06:24.478123 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:06:24.482362 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:06:24.482362 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:06:24.482362 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:06:24.482362 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:06:24.482362 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:06:24.482362 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3fdb6d35-9428-4253-ad00-932310ecdf5d could not be found. Oct 22 21:06:24.482362 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:06:24.482362 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-c1a4902a-2984-4bd1-b9bb-885081f238c5 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Returning 404 to user: Instance 3fdb6d35-9428-4253-ad00-932310ecdf5d could not be found. {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:06:24.482362 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-c1a4902a-2984-4bd1-b9bb-885081f238c5 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] 10.222.0.18 "GET /compute/v2.1/servers/3fdb6d35-9428-4253-ad00-932310ecdf5d" status: 404 len: 111 microversion: 2.1 time: 0.049648 Oct 22 21:06:24.482362 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1828/3625] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:06:24 2022] GET /compute/v2.1/servers/3fdb6d35-9428-4253-ad00-932310ecdf5d => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 21:06:24.491769 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-e3768f3e-1208-4055-a2ab-d6078cf4b0fc tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:24.492365 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-e3768f3e-1208-4055-a2ab-d6078cf4b0fc tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] [instance: 87b07efc-fa80-40ad-8077-333547ee7301] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:06:24.499470 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e3768f3e-1208-4055-a2ab-d6078cf4b0fc tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:24.500214 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e3768f3e-1208-4055-a2ab-d6078cf4b0fc tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:24.500953 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e3768f3e-1208-4055-a2ab-d6078cf4b0fc tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:24.501981 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e3768f3e-1208-4055-a2ab-d6078cf4b0fc tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:24.502818 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e3768f3e-1208-4055-a2ab-d6078cf4b0fc tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:24.503451 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e3768f3e-1208-4055-a2ab-d6078cf4b0fc tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:24.538738 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-e3768f3e-1208-4055-a2ab-d6078cf4b0fc tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] [instance: 87b07efc-fa80-40ad-8077-333547ee7301] Going to try to terminate instance {{(pid=138744) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 21:06:24.587143 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-ceb0b609-5a66-4c65-8f82-c3e913218592 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:24.589027 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-ceb0b609-5a66-4c65-8f82-c3e913218592 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] [instance: e09b7865-0b24-4e50-a66a-342dd2e6e5e3] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:06:24.598644 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ceb0b609-5a66-4c65-8f82-c3e913218592 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:24.599965 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ceb0b609-5a66-4c65-8f82-c3e913218592 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:24.600976 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ceb0b609-5a66-4c65-8f82-c3e913218592 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:24.602039 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ceb0b609-5a66-4c65-8f82-c3e913218592 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:24.602675 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ceb0b609-5a66-4c65-8f82-c3e913218592 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:24.603485 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ceb0b609-5a66-4c65-8f82-c3e913218592 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:24.687073 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-e3768f3e-1208-4055-a2ab-d6078cf4b0fc tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] 10.222.0.18 "DELETE /compute/v2.1/servers/87b07efc-fa80-40ad-8077-333547ee7301" status: 204 len: 0 microversion: 2.1 time: 0.198097 Oct 22 21:06:24.688819 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1798/3626] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 21:06:24 2022] DELETE /compute/v2.1/servers/87b07efc-fa80-40ad-8077-333547ee7301 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 21:06:24.702085 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-561c011f-d63a-418d-9aa2-0d807f84d183 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:24.702956 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-561c011f-d63a-418d-9aa2-0d807f84d183 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] [instance: 87b07efc-fa80-40ad-8077-333547ee7301] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:06:24.709509 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-561c011f-d63a-418d-9aa2-0d807f84d183 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:24.709994 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-561c011f-d63a-418d-9aa2-0d807f84d183 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:24.710432 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-561c011f-d63a-418d-9aa2-0d807f84d183 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:24.711317 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-561c011f-d63a-418d-9aa2-0d807f84d183 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:24.711815 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-561c011f-d63a-418d-9aa2-0d807f84d183 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:24.712295 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-561c011f-d63a-418d-9aa2-0d807f84d183 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:24.996998 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-ceb0b609-5a66-4c65-8f82-c3e913218592 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcdfeb6c1cda4810b9fa70fdfd9a66c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c774a85b2c41c98486cf91b1253363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:06:25.010764 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-ceb0b609-5a66-4c65-8f82-c3e913218592 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] 10.222.0.18 "GET /compute/v2.1/servers/e09b7865-0b24-4e50-a66a-342dd2e6e5e3" status: 200 len: 1515 microversion: 2.1 time: 0.428651 Oct 22 21:06:25.012586 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1829/3627] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:06:24 2022] GET /compute/v2.1/servers/e09b7865-0b24-4e50-a66a-342dd2e6e5e3 => generated 1515 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:06:25.038230 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-561c011f-d63a-418d-9aa2-0d807f84d183 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879c85830a9f42088a4ebdf1e3cfb39b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b54f56cfbc814cccb533c65966f35a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:06:25.048052 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-561c011f-d63a-418d-9aa2-0d807f84d183 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] 10.222.0.18 "GET /compute/v2.1/servers/87b07efc-fa80-40ad-8077-333547ee7301" status: 200 len: 1491 microversion: 2.1 time: 0.352536 Oct 22 21:06:25.049285 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1799/3628] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:06:24 2022] GET /compute/v2.1/servers/87b07efc-fa80-40ad-8077-333547ee7301 => generated 1491 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:06:25.075849 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-d84a1873-5f42-4045-a111-fe0fc71ba695 tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:25.076489 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-d84a1873-5f42-4045-a111-fe0fc71ba695 tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] [instance: e24e9888-adfe-455c-b53e-da3bf5729d69] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:06:25.083882 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d84a1873-5f42-4045-a111-fe0fc71ba695 tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:25.084577 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d84a1873-5f42-4045-a111-fe0fc71ba695 tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:25.085244 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d84a1873-5f42-4045-a111-fe0fc71ba695 tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:25.085979 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d84a1873-5f42-4045-a111-fe0fc71ba695 tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:25.086446 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d84a1873-5f42-4045-a111-fe0fc71ba695 tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:25.086887 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d84a1873-5f42-4045-a111-fe0fc71ba695 tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:25.332790 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-d84a1873-5f42-4045-a111-fe0fc71ba695 tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de9c0914dd6943bfa313ac456524cbba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af4c5251e7348c0ae5fc62468243a81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:06:25.341766 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-d84a1873-5f42-4045-a111-fe0fc71ba695 tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] 10.222.0.18 "GET /compute/v2.1/servers/e24e9888-adfe-455c-b53e-da3bf5729d69" status: 200 len: 1528 microversion: 2.1 time: 0.270870 Oct 22 21:06:25.342456 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1830/3629] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:06:25 2022] GET /compute/v2.1/servers/e24e9888-adfe-455c-b53e-da3bf5729d69 => generated 1528 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:06:25.450239 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-b2f0afac-478d-4e68-b15c-2561b5045fc3 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:25.450881 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-b2f0afac-478d-4e68-b15c-2561b5045fc3 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] [instance: 64318452-365b-4b80-b53b-9367dd8bc826] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:06:25.461889 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-9d851bf6-d019-4e84-88a3-9c6b5bb729e9 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:25.462964 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-9d851bf6-d019-4e84-88a3-9c6b5bb729e9 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] [instance: a26fa9bd-fad2-40a2-910e-2208fb769dcb] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:06:25.468218 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b2f0afac-478d-4e68-b15c-2561b5045fc3 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:25.470498 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b2f0afac-478d-4e68-b15c-2561b5045fc3 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:25.471175 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b2f0afac-478d-4e68-b15c-2561b5045fc3 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:25.472082 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b2f0afac-478d-4e68-b15c-2561b5045fc3 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:25.472817 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b2f0afac-478d-4e68-b15c-2561b5045fc3 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:25.473399 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b2f0afac-478d-4e68-b15c-2561b5045fc3 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:25.473759 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9d851bf6-d019-4e84-88a3-9c6b5bb729e9 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:25.474336 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9d851bf6-d019-4e84-88a3-9c6b5bb729e9 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:25.474761 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9d851bf6-d019-4e84-88a3-9c6b5bb729e9 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:25.476143 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9d851bf6-d019-4e84-88a3-9c6b5bb729e9 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:25.476553 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9d851bf6-d019-4e84-88a3-9c6b5bb729e9 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:25.477079 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9d851bf6-d019-4e84-88a3-9c6b5bb729e9 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:25.771302 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-b2f0afac-478d-4e68-b15c-2561b5045fc3 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3820b31a424c3a9216a6ef91fcb285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a42c3ecf474883ac652fcc8c01c9f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:06:25.783453 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-b2f0afac-478d-4e68-b15c-2561b5045fc3 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] 10.222.0.18 "GET /compute/v2.1/servers/64318452-365b-4b80-b53b-9367dd8bc826" status: 200 len: 1376 microversion: 2.1 time: 0.337138 Oct 22 21:06:25.785608 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1800/3630] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:06:25 2022] GET /compute/v2.1/servers/64318452-365b-4b80-b53b-9367dd8bc826 => generated 1376 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:06:25.794020 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-9d851bf6-d019-4e84-88a3-9c6b5bb729e9 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a44ff8e7c14b94b1670f030085c43d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a26a2284f4424cbeaf63d504652546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:06:25.805500 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-9d851bf6-d019-4e84-88a3-9c6b5bb729e9 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] 10.222.0.18 "GET /compute/v2.1/servers/a26fa9bd-fad2-40a2-910e-2208fb769dcb" status: 200 len: 1489 microversion: 2.1 time: 0.349629 Oct 22 21:06:25.824838 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1831/3631] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:06:25 2022] GET /compute/v2.1/servers/a26fa9bd-fad2-40a2-910e-2208fb769dcb => generated 1489 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:06:25.833995 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-9a8b7fdf-2fb6-4673-bdee-3c729846f52b tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:25.836936 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-9a8b7fdf-2fb6-4673-bdee-3c729846f52b tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] [instance: a26fa9bd-fad2-40a2-910e-2208fb769dcb] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:06:25.846675 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9a8b7fdf-2fb6-4673-bdee-3c729846f52b tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:25.847545 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9a8b7fdf-2fb6-4673-bdee-3c729846f52b tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:25.851697 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9a8b7fdf-2fb6-4673-bdee-3c729846f52b tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:25.852527 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9a8b7fdf-2fb6-4673-bdee-3c729846f52b tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:25.852982 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9a8b7fdf-2fb6-4673-bdee-3c729846f52b tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:25.853502 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9a8b7fdf-2fb6-4673-bdee-3c729846f52b tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:25.893923 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-9a8b7fdf-2fb6-4673-bdee-3c729846f52b tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] [instance: a26fa9bd-fad2-40a2-910e-2208fb769dcb] Going to try to terminate instance {{(pid=138744) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 21:06:25.907929 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-24f3f4f1-c535-4a23-841b-bc08361eebd4 req-ff46fe4e-d321-4db6-8819-646daf64b122 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e24e9888-adfe-455c-b53e-da3bf5729d69", "name": "network-vif-deleted", "tag": "989e73aa-86fa-483e-8dc2-c5ec459b5837"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:06:25.926044 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-24f3f4f1-c535-4a23-841b-bc08361eebd4 req-ff46fe4e-d321-4db6-8819-646daf64b122 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:25.926602 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-24f3f4f1-c535-4a23-841b-bc08361eebd4 req-ff46fe4e-d321-4db6-8819-646daf64b122 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:25.927092 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-24f3f4f1-c535-4a23-841b-bc08361eebd4 req-ff46fe4e-d321-4db6-8819-646daf64b122 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:25.946996 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-24f3f4f1-c535-4a23-841b-bc08361eebd4 req-ff46fe4e-d321-4db6-8819-646daf64b122 service nova] Creating event network-vif-deleted:989e73aa-86fa-483e-8dc2-c5ec459b5837 for instance e24e9888-adfe-455c-b53e-da3bf5729d69 on nch1-master-1 Oct 22 21:06:25.971506 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-24f3f4f1-c535-4a23-841b-bc08361eebd4 req-ff46fe4e-d321-4db6-8819-646daf64b122 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066274 Oct 22 21:06:25.977166 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1832/3632] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:06:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 21:06:26.039040 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-dec01929-bbba-4997-847c-94fa83e6f4cd tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:26.039958 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-dec01929-bbba-4997-847c-94fa83e6f4cd tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] [instance: e09b7865-0b24-4e50-a66a-342dd2e6e5e3] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:06:26.058078 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-dec01929-bbba-4997-847c-94fa83e6f4cd tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:26.059007 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-dec01929-bbba-4997-847c-94fa83e6f4cd tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:26.060487 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-dec01929-bbba-4997-847c-94fa83e6f4cd tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:26.063742 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-dec01929-bbba-4997-847c-94fa83e6f4cd tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:26.065299 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-dec01929-bbba-4997-847c-94fa83e6f4cd tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:26.068386 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-9a8b7fdf-2fb6-4673-bdee-3c729846f52b tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] 10.222.0.18 "DELETE /compute/v2.1/servers/a26fa9bd-fad2-40a2-910e-2208fb769dcb" status: 204 len: 0 microversion: 2.1 time: 0.239536 Oct 22 21:06:26.068386 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1801/3633] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 21:06:25 2022] DELETE /compute/v2.1/servers/a26fa9bd-fad2-40a2-910e-2208fb769dcb => generated 0 bytes in 242 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 21:06:26.068778 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-dec01929-bbba-4997-847c-94fa83e6f4cd tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:26.076574 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-58e1b461-024c-4543-868a-7f50be970ba2 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:26.077655 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-58e1b461-024c-4543-868a-7f50be970ba2 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] [instance: 87b07efc-fa80-40ad-8077-333547ee7301] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:06:26.093997 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-58e1b461-024c-4543-868a-7f50be970ba2 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:26.095560 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-58e1b461-024c-4543-868a-7f50be970ba2 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:26.096179 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-58e1b461-024c-4543-868a-7f50be970ba2 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:26.097072 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-58e1b461-024c-4543-868a-7f50be970ba2 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:26.098156 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-58e1b461-024c-4543-868a-7f50be970ba2 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:26.098812 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-58e1b461-024c-4543-868a-7f50be970ba2 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:26.146056 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:06:26.371506 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-58e1b461-024c-4543-868a-7f50be970ba2 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879c85830a9f42088a4ebdf1e3cfb39b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b54f56cfbc814cccb533c65966f35a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:06:26.380360 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-58e1b461-024c-4543-868a-7f50be970ba2 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] 10.222.0.18 "GET /compute/v2.1/servers/87b07efc-fa80-40ad-8077-333547ee7301" status: 200 len: 1491 microversion: 2.1 time: 0.308539 Oct 22 21:06:26.385213 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1802/3634] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:06:26 2022] GET /compute/v2.1/servers/87b07efc-fa80-40ad-8077-333547ee7301 => generated 1491 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:06:26.389603 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-dec01929-bbba-4997-847c-94fa83e6f4cd tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcdfeb6c1cda4810b9fa70fdfd9a66c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c774a85b2c41c98486cf91b1253363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:06:26.390528 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-b1892d45-c332-4859-a94b-f9f99d615a94 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Calling method '.version_select at 0x7fd39ee600d0>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:26.414025 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-dec01929-bbba-4997-847c-94fa83e6f4cd tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] 10.222.0.18 "GET /compute/v2.1/servers/e09b7865-0b24-4e50-a66a-342dd2e6e5e3" status: 200 len: 1515 microversion: 2.1 time: 0.382355 Oct 22 21:06:26.414272 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-b1892d45-c332-4859-a94b-f9f99d615a94 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] HTTP exception thrown: Image not found. Oct 22 21:06:26.415014 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1833/3635] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:06:26 2022] GET /compute/v2.1/servers/e09b7865-0b24-4e50-a66a-342dd2e6e5e3 => generated 1515 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:06:26.416796 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-b1892d45-c332-4859-a94b-f9f99d615a94 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Request method failure captured: Oct 22 21:06:26.416796 ncdv-master-1 devstack@n-api.service[138744]: request: DELETE /compute/v2.1/images/0fe29600-d695-41c1-9223-9e0d242e0c54 HTTP/1.1 Oct 22 21:06:26.416796 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 21:06:26.416796 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 21:06:26.416796 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 21:06:26.416796 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 0 Oct 22 21:06:26.416796 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 21:06:26.416796 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 21:06:26.416796 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 21:06:26.416796 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 21:06:26.416796 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVFng3hwvwMj6qrKBKP-NtPsacHNJudvI6PbLTlDqKVlCNAf4Mqq0nvy7Chi-hCExXK3RI9ZbTr7OISCYx9SEUXfBLJqVoAZKtsaVbmoggH2NuFL9WL2K0RSTEHzGZGsrQHqgFF8j5Iii8ybpULxjQ0-J_wT0C7d5Pfa14Sa-3-zfpKo Oct 22 21:06:26.416796 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 21:06:26.416796 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 21:06:26.416796 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 21:06:26.416796 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 21:06:26.416796 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 21:06:26.416796 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 21:06:26.416796 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: 66a26a2284f4424cbeaf63d504652546 Oct 22 21:06:26.416796 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-ImagesTestJSON-2101376766 Oct 22 21:06:26.416796 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 21:06:26.416796 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 21:06:26.416796 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_66a26a2284f4424cbeaf63d504652546"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/66a26a2284f4424cbeaf63d504652546"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/66a26a2284f4424cbeaf63d504652546"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/66a26a2284f4424cbeaf63d504652546"}]}] Oct 22 21:06:26.416796 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-ImagesTestJSON-2101376766 Oct 22 21:06:26.416796 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: 66a26a2284f4424cbeaf63d504652546 Oct 22 21:06:26.416796 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-ImagesTestJSON-2101376766 Oct 22 21:06:26.416796 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-ImagesTestJSON-2101376766-project Oct 22 21:06:26.416796 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 21:06:26.416796 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 21:06:26.416796 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: f0a44ff8e7c14b94b1670f030085c43d Oct 22 21:06:26.416796 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-ImagesTestJSON-2101376766-project Oct 22 21:06:26.416796 ncdv-master-1 devstack@n-api.service[138744]: method: Oct 22 21:06:26.416796 ncdv-master-1 devstack@n-api.service[138744]: exception: Image not found. Oct 22 21:06:26.416796 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': '0fe29600-d695-41c1-9223-9e0d242e0c54'} Oct 22 21:06:26.416796 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:06:26.416796 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:06:26.416796 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 22 21:06:26.416796 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 22 21:06:26.416796 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 22 21:06:26.416796 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 22 21:06:26.416796 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 22 21:06:26.416796 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 22 21:06:26.416796 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 22 21:06:26.416796 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 22 21:06:26.416796 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 22 21:06:26.416796 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 22 21:06:26.416796 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 22 21:06:26.416796 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 22 21:06:26.416796 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 22 21:06:26.416796 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 22 21:06:26.416796 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 0fe29600-d695-41c1-9223-9e0d242e0c54 to delete Oct 22 21:06:26.416796 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:06:26.416796 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:06:26.416796 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:06:26.416796 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:06:26.416796 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 22 21:06:26.416796 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 22 21:06:26.416796 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 22 21:06:26.416796 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 22 21:06:26.416796 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 22 21:06:26.416796 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 22 21:06:26.416796 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 0fe29600-d695-41c1-9223-9e0d242e0c54 could not be found. Oct 22 21:06:26.416796 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:06:26.416796 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:06:26.416796 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:06:26.416796 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:06:26.420755 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:06:26.420755 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:06:26.420755 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:06:26.420755 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:06:26.420755 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 22 21:06:26.420755 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 22 21:06:26.420755 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:06:26.420755 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:06:26.420755 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 22 21:06:26.420755 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 22 21:06:26.420755 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 22 21:06:26.420755 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:06:26.420755 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:06:26.420755 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:06:26.420755 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:06:26.420755 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:06:26.420755 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:06:26.420755 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:06:26.420755 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:06:26.420755 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 22 21:06:26.420755 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:06:26.420755 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-b1892d45-c332-4859-a94b-f9f99d615a94 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Returning 404 to user: Image not found. {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:06:26.420755 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-b1892d45-c332-4859-a94b-f9f99d615a94 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] 10.222.0.18 "DELETE /compute/v2.1/images/0fe29600-d695-41c1-9223-9e0d242e0c54" status: 404 len: 62 microversion: 2.1 time: 0.031901 Oct 22 21:06:26.420755 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1803/3636] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:06:26 2022] DELETE /compute/v2.1/images/0fe29600-d695-41c1-9223-9e0d242e0c54 => generated 62 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 22 21:06:26.426434 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-90f69b37-d796-41d0-9557-992f962768dd tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:26.427257 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-90f69b37-d796-41d0-9557-992f962768dd tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] [instance: a26fa9bd-fad2-40a2-910e-2208fb769dcb] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:06:26.436716 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-e13ae58c-4fca-46dd-96f9-0e62cc8ffad1 tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:26.437153 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-90f69b37-d796-41d0-9557-992f962768dd tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:26.437823 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-90f69b37-d796-41d0-9557-992f962768dd tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:26.438276 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-90f69b37-d796-41d0-9557-992f962768dd tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:26.439276 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-e13ae58c-4fca-46dd-96f9-0e62cc8ffad1 tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] [instance: e24e9888-adfe-455c-b53e-da3bf5729d69] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:06:26.439417 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-90f69b37-d796-41d0-9557-992f962768dd tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:26.439780 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-90f69b37-d796-41d0-9557-992f962768dd tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:26.440217 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-90f69b37-d796-41d0-9557-992f962768dd tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:26.452975 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e13ae58c-4fca-46dd-96f9-0e62cc8ffad1 tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:26.454128 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e13ae58c-4fca-46dd-96f9-0e62cc8ffad1 tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:26.454590 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e13ae58c-4fca-46dd-96f9-0e62cc8ffad1 tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:26.455578 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e13ae58c-4fca-46dd-96f9-0e62cc8ffad1 tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:26.456244 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e13ae58c-4fca-46dd-96f9-0e62cc8ffad1 tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:26.456904 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e13ae58c-4fca-46dd-96f9-0e62cc8ffad1 tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:26.468341 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-90f69b37-d796-41d0-9557-992f962768dd tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] [instance: a26fa9bd-fad2-40a2-910e-2208fb769dcb] Going to try to terminate instance {{(pid=138744) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 21:06:26.501091 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e13ae58c-4fca-46dd-96f9-0e62cc8ffad1 tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:26.501842 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e13ae58c-4fca-46dd-96f9-0e62cc8ffad1 tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:26.502614 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e13ae58c-4fca-46dd-96f9-0e62cc8ffad1 tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:26.503639 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.objects.instance [None req-e13ae58c-4fca-46dd-96f9-0e62cc8ffad1 tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] Lazy-loading 'fault' on Instance uuid e24e9888-adfe-455c-b53e-da3bf5729d69 {{(pid=138745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 21:06:26.526835 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.compute.api [None req-90f69b37-d796-41d0-9557-992f962768dd tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] [instance: a26fa9bd-fad2-40a2-910e-2208fb769dcb] Instance is already in deleting state, ignoring this request Oct 22 21:06:26.527743 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-90f69b37-d796-41d0-9557-992f962768dd tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] 10.222.0.18 "DELETE /compute/v2.1/servers/a26fa9bd-fad2-40a2-910e-2208fb769dcb" status: 204 len: 0 microversion: 2.1 time: 0.105018 Oct 22 21:06:26.528598 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1804/3637] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 21:06:26 2022] DELETE /compute/v2.1/servers/a26fa9bd-fad2-40a2-910e-2208fb769dcb => generated 0 bytes in 106 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 21:06:26.538698 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-4bb8ad7b-dd92-4ded-887e-8500dce53ad7 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:26.539504 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-4bb8ad7b-dd92-4ded-887e-8500dce53ad7 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] [instance: a26fa9bd-fad2-40a2-910e-2208fb769dcb] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:06:26.546184 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4bb8ad7b-dd92-4ded-887e-8500dce53ad7 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:26.546899 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4bb8ad7b-dd92-4ded-887e-8500dce53ad7 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:26.547376 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4bb8ad7b-dd92-4ded-887e-8500dce53ad7 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:26.548083 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4bb8ad7b-dd92-4ded-887e-8500dce53ad7 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:26.548545 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4bb8ad7b-dd92-4ded-887e-8500dce53ad7 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:26.548981 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4bb8ad7b-dd92-4ded-887e-8500dce53ad7 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:26.560620 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-e13ae58c-4fca-46dd-96f9-0e62cc8ffad1 tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de9c0914dd6943bfa313ac456524cbba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af4c5251e7348c0ae5fc62468243a81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:06:26.576305 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-e13ae58c-4fca-46dd-96f9-0e62cc8ffad1 tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] 10.222.0.18 "GET /compute/v2.1/servers/e24e9888-adfe-455c-b53e-da3bf5729d69" status: 200 len: 1315 microversion: 2.1 time: 0.147187 Oct 22 21:06:26.577704 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1834/3638] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:06:26 2022] GET /compute/v2.1/servers/e24e9888-adfe-455c-b53e-da3bf5729d69 => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:06:26.728441 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-4bb8ad7b-dd92-4ded-887e-8500dce53ad7 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a44ff8e7c14b94b1670f030085c43d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a26a2284f4424cbeaf63d504652546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:06:26.741251 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-4bb8ad7b-dd92-4ded-887e-8500dce53ad7 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] 10.222.0.18 "GET /compute/v2.1/servers/a26fa9bd-fad2-40a2-910e-2208fb769dcb" status: 200 len: 1495 microversion: 2.1 time: 0.207292 Oct 22 21:06:26.749660 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1805/3639] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:06:26 2022] GET /compute/v2.1/servers/a26fa9bd-fad2-40a2-910e-2208fb769dcb => generated 1495 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:06:26.808748 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-426c753e-91f6-4ae1-a3d6-d3af15fe1931 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:26.809391 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-426c753e-91f6-4ae1-a3d6-d3af15fe1931 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] [instance: 64318452-365b-4b80-b53b-9367dd8bc826] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:06:26.817569 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-426c753e-91f6-4ae1-a3d6-d3af15fe1931 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:26.818096 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-426c753e-91f6-4ae1-a3d6-d3af15fe1931 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:26.818564 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-426c753e-91f6-4ae1-a3d6-d3af15fe1931 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:26.819310 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-426c753e-91f6-4ae1-a3d6-d3af15fe1931 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:26.819975 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-426c753e-91f6-4ae1-a3d6-d3af15fe1931 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:26.820433 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-426c753e-91f6-4ae1-a3d6-d3af15fe1931 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:26.988492 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-426c753e-91f6-4ae1-a3d6-d3af15fe1931 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3820b31a424c3a9216a6ef91fcb285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a42c3ecf474883ac652fcc8c01c9f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:06:26.996856 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-426c753e-91f6-4ae1-a3d6-d3af15fe1931 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] 10.222.0.18 "GET /compute/v2.1/servers/64318452-365b-4b80-b53b-9367dd8bc826" status: 200 len: 1376 microversion: 2.1 time: 0.194093 Oct 22 21:06:26.997872 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1835/3640] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:06:26 2022] GET /compute/v2.1/servers/64318452-365b-4b80-b53b-9367dd8bc826 => generated 1376 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:06:27.409644 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-b0e6d64c-ee0e-4528-9c07-02e171d95c59 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:27.410962 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-b0e6d64c-ee0e-4528-9c07-02e171d95c59 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] [instance: 87b07efc-fa80-40ad-8077-333547ee7301] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:06:27.421430 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b0e6d64c-ee0e-4528-9c07-02e171d95c59 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:27.421912 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b0e6d64c-ee0e-4528-9c07-02e171d95c59 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:27.422360 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b0e6d64c-ee0e-4528-9c07-02e171d95c59 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:27.427466 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b0e6d64c-ee0e-4528-9c07-02e171d95c59 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:27.428306 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b0e6d64c-ee0e-4528-9c07-02e171d95c59 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:27.428771 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b0e6d64c-ee0e-4528-9c07-02e171d95c59 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:27.444720 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-95493ef9-4d1d-45f7-8a21-99b4cb499156 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:27.447687 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-95493ef9-4d1d-45f7-8a21-99b4cb499156 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] [instance: e09b7865-0b24-4e50-a66a-342dd2e6e5e3] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:06:27.476525 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-95493ef9-4d1d-45f7-8a21-99b4cb499156 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:27.477429 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-95493ef9-4d1d-45f7-8a21-99b4cb499156 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:27.478242 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-95493ef9-4d1d-45f7-8a21-99b4cb499156 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:27.479617 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-95493ef9-4d1d-45f7-8a21-99b4cb499156 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:27.480333 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-95493ef9-4d1d-45f7-8a21-99b4cb499156 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:27.481962 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-95493ef9-4d1d-45f7-8a21-99b4cb499156 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:28.082529 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-b0e6d64c-ee0e-4528-9c07-02e171d95c59 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879c85830a9f42088a4ebdf1e3cfb39b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b54f56cfbc814cccb533c65966f35a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:06:28.091126 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-b0e6d64c-ee0e-4528-9c07-02e171d95c59 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] 10.222.0.18 "GET /compute/v2.1/servers/87b07efc-fa80-40ad-8077-333547ee7301" status: 200 len: 1491 microversion: 2.1 time: 0.685255 Oct 22 21:06:28.120029 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1806/3641] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:06:27 2022] GET /compute/v2.1/servers/87b07efc-fa80-40ad-8077-333547ee7301 => generated 1491 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:06:28.126410 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-d0691350-2350-4ffe-b3f0-f122e642218f tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:28.128893 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-d0691350-2350-4ffe-b3f0-f122e642218f tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] [instance: e24e9888-adfe-455c-b53e-da3bf5729d69] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:06:28.141534 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d0691350-2350-4ffe-b3f0-f122e642218f tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:28.142033 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d0691350-2350-4ffe-b3f0-f122e642218f tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:28.142479 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d0691350-2350-4ffe-b3f0-f122e642218f tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:28.150804 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d0691350-2350-4ffe-b3f0-f122e642218f tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:28.151314 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d0691350-2350-4ffe-b3f0-f122e642218f tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:28.153992 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d0691350-2350-4ffe-b3f0-f122e642218f tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:28.224574 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-95493ef9-4d1d-45f7-8a21-99b4cb499156 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcdfeb6c1cda4810b9fa70fdfd9a66c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c774a85b2c41c98486cf91b1253363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:06:28.240973 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-95493ef9-4d1d-45f7-8a21-99b4cb499156 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] 10.222.0.18 "GET /compute/v2.1/servers/e09b7865-0b24-4e50-a66a-342dd2e6e5e3" status: 200 len: 1515 microversion: 2.1 time: 0.801087 Oct 22 21:06:28.242564 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1836/3642] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:06:27 2022] GET /compute/v2.1/servers/e09b7865-0b24-4e50-a66a-342dd2e6e5e3 => generated 1515 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:06:28.270934 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-2479a398-ebde-44e8-a96b-6615221b1cda tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:28.271684 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-2479a398-ebde-44e8-a96b-6615221b1cda tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] [instance: a26fa9bd-fad2-40a2-910e-2208fb769dcb] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:06:28.281380 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d0691350-2350-4ffe-b3f0-f122e642218f tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:28.282371 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d0691350-2350-4ffe-b3f0-f122e642218f tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:28.283950 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d0691350-2350-4ffe-b3f0-f122e642218f tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:28.285811 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.objects.instance [None req-d0691350-2350-4ffe-b3f0-f122e642218f tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] Lazy-loading 'fault' on Instance uuid e24e9888-adfe-455c-b53e-da3bf5729d69 {{(pid=138744) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 21:06:28.300861 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2479a398-ebde-44e8-a96b-6615221b1cda tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:28.303605 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2479a398-ebde-44e8-a96b-6615221b1cda tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:28.304246 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2479a398-ebde-44e8-a96b-6615221b1cda tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:28.306461 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2479a398-ebde-44e8-a96b-6615221b1cda tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:28.307102 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2479a398-ebde-44e8-a96b-6615221b1cda tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:28.308653 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2479a398-ebde-44e8-a96b-6615221b1cda tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:28.395282 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-d0691350-2350-4ffe-b3f0-f122e642218f tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de9c0914dd6943bfa313ac456524cbba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af4c5251e7348c0ae5fc62468243a81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:06:28.411062 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-d0691350-2350-4ffe-b3f0-f122e642218f tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] 10.222.0.18 "GET /compute/v2.1/servers/e24e9888-adfe-455c-b53e-da3bf5729d69" status: 200 len: 1315 microversion: 2.1 time: 0.286184 Oct 22 21:06:28.413166 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1807/3643] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:06:28 2022] GET /compute/v2.1/servers/e24e9888-adfe-455c-b53e-da3bf5729d69 => generated 1315 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:06:28.420736 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-0e496d49-22bc-4739-9cef-8d15b9564936 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:28.421633 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-0e496d49-22bc-4739-9cef-8d15b9564936 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] [instance: 64318452-365b-4b80-b53b-9367dd8bc826] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:06:28.433037 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0e496d49-22bc-4739-9cef-8d15b9564936 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:28.435658 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0e496d49-22bc-4739-9cef-8d15b9564936 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:28.436783 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0e496d49-22bc-4739-9cef-8d15b9564936 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:28.437845 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0e496d49-22bc-4739-9cef-8d15b9564936 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:28.438454 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0e496d49-22bc-4739-9cef-8d15b9564936 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:28.442569 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0e496d49-22bc-4739-9cef-8d15b9564936 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:29.007024 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-2479a398-ebde-44e8-a96b-6615221b1cda tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a44ff8e7c14b94b1670f030085c43d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a26a2284f4424cbeaf63d504652546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:06:29.028329 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-2479a398-ebde-44e8-a96b-6615221b1cda tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] 10.222.0.18 "GET /compute/v2.1/servers/a26fa9bd-fad2-40a2-910e-2208fb769dcb" status: 200 len: 1495 microversion: 2.1 time: 0.763971 Oct 22 21:06:29.032309 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1837/3644] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:06:28 2022] GET /compute/v2.1/servers/a26fa9bd-fad2-40a2-910e-2208fb769dcb => generated 1495 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:06:29.052346 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-ed9d8c81-b783-4eea-8daf-77a33876006c req-1381dc7b-2797-4ab1-a147-0498ef2829e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64318452-365b-4b80-b53b-9367dd8bc826", "name": "network-vif-plugged", "status": "completed", "tag": "1427b023-b32b-4457-b8e8-a5d2fe4301fa"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:06:29.069111 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-ed9d8c81-b783-4eea-8daf-77a33876006c req-1381dc7b-2797-4ab1-a147-0498ef2829e4 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:29.073481 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-ed9d8c81-b783-4eea-8daf-77a33876006c req-1381dc7b-2797-4ab1-a147-0498ef2829e4 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:29.074454 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-ed9d8c81-b783-4eea-8daf-77a33876006c req-1381dc7b-2797-4ab1-a147-0498ef2829e4 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:29.092275 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-ed9d8c81-b783-4eea-8daf-77a33876006c req-1381dc7b-2797-4ab1-a147-0498ef2829e4 service nova] Creating event network-vif-plugged:1427b023-b32b-4457-b8e8-a5d2fe4301fa for instance 64318452-365b-4b80-b53b-9367dd8bc826 on nch2-master-1 Oct 22 21:06:29.101203 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-ed9d8c81-b783-4eea-8daf-77a33876006c req-1381dc7b-2797-4ab1-a147-0498ef2829e4 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066027 Oct 22 21:06:29.134511 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1838/3645] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:06:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:06:29.151380 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-d063391c-582f-48b4-b2f3-7768f53a35fc tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:29.158838 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-0e496d49-22bc-4739-9cef-8d15b9564936 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3820b31a424c3a9216a6ef91fcb285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a42c3ecf474883ac652fcc8c01c9f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:06:29.168139 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-d063391c-582f-48b4-b2f3-7768f53a35fc tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] [instance: 87b07efc-fa80-40ad-8077-333547ee7301] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:06:29.171951 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-0e496d49-22bc-4739-9cef-8d15b9564936 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] 10.222.0.18 "GET /compute/v2.1/servers/64318452-365b-4b80-b53b-9367dd8bc826" status: 200 len: 1376 microversion: 2.1 time: 0.755562 Oct 22 21:06:29.177886 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1808/3646] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:06:28 2022] GET /compute/v2.1/servers/64318452-365b-4b80-b53b-9367dd8bc826 => generated 1376 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:06:29.205364 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d063391c-582f-48b4-b2f3-7768f53a35fc tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:29.206819 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d063391c-582f-48b4-b2f3-7768f53a35fc tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:29.207609 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d063391c-582f-48b4-b2f3-7768f53a35fc tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:29.209219 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d063391c-582f-48b4-b2f3-7768f53a35fc tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:29.211566 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d063391c-582f-48b4-b2f3-7768f53a35fc tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:29.215779 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d063391c-582f-48b4-b2f3-7768f53a35fc tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:29.268478 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-bf290fc7-ca6f-424a-b05a-641f6dfbe5a4 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:29.269910 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-bf290fc7-ca6f-424a-b05a-641f6dfbe5a4 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] [instance: e09b7865-0b24-4e50-a66a-342dd2e6e5e3] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:06:29.281250 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bf290fc7-ca6f-424a-b05a-641f6dfbe5a4 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:29.288488 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bf290fc7-ca6f-424a-b05a-641f6dfbe5a4 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:29.293209 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bf290fc7-ca6f-424a-b05a-641f6dfbe5a4 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:29.294231 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bf290fc7-ca6f-424a-b05a-641f6dfbe5a4 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:29.299492 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bf290fc7-ca6f-424a-b05a-641f6dfbe5a4 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:29.300226 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bf290fc7-ca6f-424a-b05a-641f6dfbe5a4 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:29.657895 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-d063391c-582f-48b4-b2f3-7768f53a35fc tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879c85830a9f42088a4ebdf1e3cfb39b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b54f56cfbc814cccb533c65966f35a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:06:29.671032 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-d063391c-582f-48b4-b2f3-7768f53a35fc tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] 10.222.0.18 "GET /compute/v2.1/servers/87b07efc-fa80-40ad-8077-333547ee7301" status: 200 len: 1449 microversion: 2.1 time: 0.534789 Oct 22 21:06:29.689192 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1839/3647] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:06:29 2022] GET /compute/v2.1/servers/87b07efc-fa80-40ad-8077-333547ee7301 => generated 1449 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:06:29.713136 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-3e93b85e-8035-4558-acc4-d87546a6dc95 tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:29.714267 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-3e93b85e-8035-4558-acc4-d87546a6dc95 tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] [instance: e24e9888-adfe-455c-b53e-da3bf5729d69] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:06:29.735196 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3e93b85e-8035-4558-acc4-d87546a6dc95 tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:29.735998 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3e93b85e-8035-4558-acc4-d87546a6dc95 tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:29.739004 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3e93b85e-8035-4558-acc4-d87546a6dc95 tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:29.739953 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3e93b85e-8035-4558-acc4-d87546a6dc95 tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:29.741200 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3e93b85e-8035-4558-acc4-d87546a6dc95 tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:29.741909 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3e93b85e-8035-4558-acc4-d87546a6dc95 tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:29.779077 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.wsgi [None req-3e93b85e-8035-4558-acc4-d87546a6dc95 tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] HTTP exception thrown: Instance e24e9888-adfe-455c-b53e-da3bf5729d69 could not be found. Oct 22 21:06:29.785050 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-3e93b85e-8035-4558-acc4-d87546a6dc95 tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] Request method failure captured: Oct 22 21:06:29.785050 ncdv-master-1 devstack@n-api.service[138745]: request: GET /compute/v2.1/servers/e24e9888-adfe-455c-b53e-da3bf5729d69 HTTP/1.1 Oct 22 21:06:29.785050 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 21:06:29.785050 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 21:06:29.785050 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 21:06:29.785050 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 0 Oct 22 21:06:29.785050 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 21:06:29.785050 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 21:06:29.785050 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 21:06:29.785050 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 21:06:29.785050 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVFsvUIUYzArxAJ4ip2fcWFLuhkh-h9Av8hhEI8lvft0O-HAgwp4h_vAuA8SxaYyvc4PR2Icby8aBJmo8hHz2FGW0Jny_-Jj70jx9IOPdcw8gMgLI0a3hVBM5ZRg6vaHGrFTBtSHeg11EM5tsNrGZ1KF1ggyB0jpPIDEOLwqqf7avblg Oct 22 21:06:29.785050 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 21:06:29.785050 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 21:06:29.785050 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 21:06:29.785050 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 21:06:29.785050 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 21:06:29.785050 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 21:06:29.785050 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: 0af4c5251e7348c0ae5fc62468243a81 Oct 22 21:06:29.785050 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-496210032 Oct 22 21:06:29.785050 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 21:06:29.785050 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 21:06:29.785050 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_0af4c5251e7348c0ae5fc62468243a81"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0af4c5251e7348c0ae5fc62468243a81"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/0af4c5251e7348c0ae5fc62468243a81"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0af4c5251e7348c0ae5fc62468243a81"}]}] Oct 22 21:06:29.785050 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-496210032 Oct 22 21:06:29.785050 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: 0af4c5251e7348c0ae5fc62468243a81 Oct 22 21:06:29.785050 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-496210032 Oct 22 21:06:29.785050 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-InstanceActionsNegativeTestJSON-496210032-project Oct 22 21:06:29.785050 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 21:06:29.785050 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 21:06:29.785050 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: de9c0914dd6943bfa313ac456524cbba Oct 22 21:06:29.785050 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-496210032-project Oct 22 21:06:29.785050 ncdv-master-1 devstack@n-api.service[138745]: method: > Oct 22 21:06:29.785050 ncdv-master-1 devstack@n-api.service[138745]: exception: Instance e24e9888-adfe-455c-b53e-da3bf5729d69 could not be found. Oct 22 21:06:29.785050 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'id': 'e24e9888-adfe-455c-b53e-da3bf5729d69'} Oct 22 21:06:29.785050 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:06:29.785050 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:06:29.785050 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 21:06:29.785050 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 21:06:29.785050 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 21:06:29.785050 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 21:06:29.785050 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 21:06:29.785050 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 21:06:29.785050 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 21:06:29.785050 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 21:06:29.785050 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e24e9888-adfe-455c-b53e-da3bf5729d69 could not be found. Oct 22 21:06:29.785050 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:06:29.785050 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:06:29.785050 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:06:29.785050 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:06:29.785050 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:06:29.785050 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:06:29.785050 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:06:29.785050 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:06:29.785050 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:06:29.785050 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:06:29.785050 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 21:06:29.785050 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 21:06:29.785050 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 21:06:29.785050 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 21:06:29.785050 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 21:06:29.785050 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:06:29.785050 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e24e9888-adfe-455c-b53e-da3bf5729d69 could not be found. Oct 22 21:06:29.785050 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:06:29.785050 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:06:29.790132 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:06:29.790132 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:06:29.790132 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:06:29.790132 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:06:29.790132 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:06:29.790132 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:06:29.790132 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e24e9888-adfe-455c-b53e-da3bf5729d69 could not be found. Oct 22 21:06:29.790132 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:06:29.793334 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-3e93b85e-8035-4558-acc4-d87546a6dc95 tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] Returning 404 to user: Instance e24e9888-adfe-455c-b53e-da3bf5729d69 could not be found. {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:06:29.799855 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-3e93b85e-8035-4558-acc4-d87546a6dc95 tempest-InstanceActionsNegativeTestJSON-496210032 tempest-InstanceActionsNegativeTestJSON-496210032-project] 10.222.0.18 "GET /compute/v2.1/servers/e24e9888-adfe-455c-b53e-da3bf5729d69" status: 404 len: 111 microversion: 2.1 time: 0.104640 Oct 22 21:06:29.801198 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1840/3648] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:06:29 2022] GET /compute/v2.1/servers/e24e9888-adfe-455c-b53e-da3bf5729d69 => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 21:06:29.844849 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-6825ae7d-2f9b-4569-aff4-0ae2510eaba5 req-e5922b89-77a5-40c1-b7b8-8954fa99d40b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87b07efc-fa80-40ad-8077-333547ee7301", "name": "network-vif-deleted", "tag": "be99f629-dd9f-41b9-b449-1b1bf0ed4322"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:06:29.865593 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-6825ae7d-2f9b-4569-aff4-0ae2510eaba5 req-e5922b89-77a5-40c1-b7b8-8954fa99d40b service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:29.870434 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-6825ae7d-2f9b-4569-aff4-0ae2510eaba5 req-e5922b89-77a5-40c1-b7b8-8954fa99d40b service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:29.871134 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-6825ae7d-2f9b-4569-aff4-0ae2510eaba5 req-e5922b89-77a5-40c1-b7b8-8954fa99d40b service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:29.888447 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-6825ae7d-2f9b-4569-aff4-0ae2510eaba5 req-e5922b89-77a5-40c1-b7b8-8954fa99d40b service nova] Creating event network-vif-deleted:be99f629-dd9f-41b9-b449-1b1bf0ed4322 for instance 87b07efc-fa80-40ad-8077-333547ee7301 on nch2-master-1 Oct 22 21:06:29.917409 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-6825ae7d-2f9b-4569-aff4-0ae2510eaba5 req-e5922b89-77a5-40c1-b7b8-8954fa99d40b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076161 Oct 22 21:06:29.918455 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1841/3649] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:06:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 21:06:30.051943 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-bf290fc7-ca6f-424a-b05a-641f6dfbe5a4 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcdfeb6c1cda4810b9fa70fdfd9a66c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c774a85b2c41c98486cf91b1253363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:06:30.060863 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-f9c2a662-abae-4c60-8636-b9d2b1b9c735 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:30.061662 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-f9c2a662-abae-4c60-8636-b9d2b1b9c735 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] [instance: a26fa9bd-fad2-40a2-910e-2208fb769dcb] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:06:30.074048 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f9c2a662-abae-4c60-8636-b9d2b1b9c735 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:30.074826 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f9c2a662-abae-4c60-8636-b9d2b1b9c735 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:30.075581 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f9c2a662-abae-4c60-8636-b9d2b1b9c735 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:30.076594 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f9c2a662-abae-4c60-8636-b9d2b1b9c735 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:30.077597 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f9c2a662-abae-4c60-8636-b9d2b1b9c735 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:30.078436 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f9c2a662-abae-4c60-8636-b9d2b1b9c735 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:30.082009 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-bf290fc7-ca6f-424a-b05a-641f6dfbe5a4 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] 10.222.0.18 "GET /compute/v2.1/servers/e09b7865-0b24-4e50-a66a-342dd2e6e5e3" status: 200 len: 1515 microversion: 2.1 time: 0.817702 Oct 22 21:06:30.083689 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1809/3650] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:06:29 2022] GET /compute/v2.1/servers/e09b7865-0b24-4e50-a66a-342dd2e6e5e3 => generated 1515 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:06:30.196524 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-f9c2a662-abae-4c60-8636-b9d2b1b9c735 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a44ff8e7c14b94b1670f030085c43d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a26a2284f4424cbeaf63d504652546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:06:30.207539 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-f7e79b12-0a2b-4208-8e0d-c1e130b487b5 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:30.208287 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-f9c2a662-abae-4c60-8636-b9d2b1b9c735 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] 10.222.0.18 "GET /compute/v2.1/servers/a26fa9bd-fad2-40a2-910e-2208fb769dcb" status: 200 len: 1293 microversion: 2.1 time: 0.153134 Oct 22 21:06:30.208399 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-f7e79b12-0a2b-4208-8e0d-c1e130b487b5 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] [instance: 64318452-365b-4b80-b53b-9367dd8bc826] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:06:30.218008 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f7e79b12-0a2b-4208-8e0d-c1e130b487b5 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:30.218504 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f7e79b12-0a2b-4208-8e0d-c1e130b487b5 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:30.218935 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f7e79b12-0a2b-4208-8e0d-c1e130b487b5 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:30.225660 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f7e79b12-0a2b-4208-8e0d-c1e130b487b5 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:30.226383 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f7e79b12-0a2b-4208-8e0d-c1e130b487b5 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:30.227962 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f7e79b12-0a2b-4208-8e0d-c1e130b487b5 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:30.230344 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1842/3651] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:06:30 2022] GET /compute/v2.1/servers/a26fa9bd-fad2-40a2-910e-2208fb769dcb => generated 1293 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:06:30.447482 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-f7e79b12-0a2b-4208-8e0d-c1e130b487b5 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3820b31a424c3a9216a6ef91fcb285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a42c3ecf474883ac652fcc8c01c9f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:06:30.456381 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-f7e79b12-0a2b-4208-8e0d-c1e130b487b5 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] 10.222.0.18 "GET /compute/v2.1/servers/64318452-365b-4b80-b53b-9367dd8bc826" status: 200 len: 1376 microversion: 2.1 time: 0.253597 Oct 22 21:06:30.457166 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1810/3652] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:06:30 2022] GET /compute/v2.1/servers/64318452-365b-4b80-b53b-9367dd8bc826 => generated 1376 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:06:30.703213 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-c72fa5dd-d7e7-488a-8699-b1cdebb22b0e tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:30.704201 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-c72fa5dd-d7e7-488a-8699-b1cdebb22b0e tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] [instance: 87b07efc-fa80-40ad-8077-333547ee7301] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:06:30.713557 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c72fa5dd-d7e7-488a-8699-b1cdebb22b0e tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:30.714087 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c72fa5dd-d7e7-488a-8699-b1cdebb22b0e tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:30.714549 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c72fa5dd-d7e7-488a-8699-b1cdebb22b0e tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:30.715291 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c72fa5dd-d7e7-488a-8699-b1cdebb22b0e tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:30.715815 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c72fa5dd-d7e7-488a-8699-b1cdebb22b0e tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:30.716270 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c72fa5dd-d7e7-488a-8699-b1cdebb22b0e tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:30.768125 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c72fa5dd-d7e7-488a-8699-b1cdebb22b0e tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:30.769796 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c72fa5dd-d7e7-488a-8699-b1cdebb22b0e tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:30.771585 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c72fa5dd-d7e7-488a-8699-b1cdebb22b0e tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:30.772348 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.objects.instance [None req-c72fa5dd-d7e7-488a-8699-b1cdebb22b0e tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lazy-loading 'fault' on Instance uuid 87b07efc-fa80-40ad-8077-333547ee7301 {{(pid=138745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 21:06:30.839544 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-c72fa5dd-d7e7-488a-8699-b1cdebb22b0e tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879c85830a9f42088a4ebdf1e3cfb39b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b54f56cfbc814cccb533c65966f35a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:06:30.851468 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-c72fa5dd-d7e7-488a-8699-b1cdebb22b0e tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] 10.222.0.18 "GET /compute/v2.1/servers/87b07efc-fa80-40ad-8077-333547ee7301" status: 200 len: 1304 microversion: 2.1 time: 0.152143 Oct 22 21:06:30.853894 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1843/3653] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:06:30 2022] GET /compute/v2.1/servers/87b07efc-fa80-40ad-8077-333547ee7301 => generated 1304 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:06:31.114713 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-7f6692c2-ea53-48cc-a8fe-f18c9a6094a6 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:31.115738 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-7f6692c2-ea53-48cc-a8fe-f18c9a6094a6 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] [instance: e09b7865-0b24-4e50-a66a-342dd2e6e5e3] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:06:31.130820 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7f6692c2-ea53-48cc-a8fe-f18c9a6094a6 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:31.131437 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7f6692c2-ea53-48cc-a8fe-f18c9a6094a6 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:31.131781 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7f6692c2-ea53-48cc-a8fe-f18c9a6094a6 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:31.133569 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7f6692c2-ea53-48cc-a8fe-f18c9a6094a6 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:31.135647 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7f6692c2-ea53-48cc-a8fe-f18c9a6094a6 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:31.136108 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7f6692c2-ea53-48cc-a8fe-f18c9a6094a6 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:31.236709 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-4d1640eb-3612-4ade-8c21-5836db77b2b7 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:31.237754 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-4d1640eb-3612-4ade-8c21-5836db77b2b7 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] [instance: a26fa9bd-fad2-40a2-910e-2208fb769dcb] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:06:31.259391 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4d1640eb-3612-4ade-8c21-5836db77b2b7 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:31.262008 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4d1640eb-3612-4ade-8c21-5836db77b2b7 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:31.262711 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4d1640eb-3612-4ade-8c21-5836db77b2b7 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:31.263853 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4d1640eb-3612-4ade-8c21-5836db77b2b7 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:31.266496 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4d1640eb-3612-4ade-8c21-5836db77b2b7 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:31.270256 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4d1640eb-3612-4ade-8c21-5836db77b2b7 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:31.303593 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-7f6692c2-ea53-48cc-a8fe-f18c9a6094a6 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcdfeb6c1cda4810b9fa70fdfd9a66c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c774a85b2c41c98486cf91b1253363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:06:31.316229 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-7f6692c2-ea53-48cc-a8fe-f18c9a6094a6 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] 10.222.0.18 "GET /compute/v2.1/servers/e09b7865-0b24-4e50-a66a-342dd2e6e5e3" status: 200 len: 1515 microversion: 2.1 time: 0.207527 Oct 22 21:06:31.317591 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1811/3654] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:06:31 2022] GET /compute/v2.1/servers/e09b7865-0b24-4e50-a66a-342dd2e6e5e3 => generated 1515 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:06:31.318352 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.wsgi [None req-4d1640eb-3612-4ade-8c21-5836db77b2b7 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] HTTP exception thrown: Instance a26fa9bd-fad2-40a2-910e-2208fb769dcb could not be found. Oct 22 21:06:31.331027 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-4d1640eb-3612-4ade-8c21-5836db77b2b7 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Request method failure captured: Oct 22 21:06:31.331027 ncdv-master-1 devstack@n-api.service[138745]: request: GET /compute/v2.1/servers/a26fa9bd-fad2-40a2-910e-2208fb769dcb HTTP/1.1 Oct 22 21:06:31.331027 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 21:06:31.331027 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 21:06:31.331027 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 21:06:31.331027 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 0 Oct 22 21:06:31.331027 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 21:06:31.331027 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 21:06:31.331027 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 21:06:31.331027 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 21:06:31.331027 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVFng3hwvwMj6qrKBKP-NtPsacHNJudvI6PbLTlDqKVlCNAf4Mqq0nvy7Chi-hCExXK3RI9ZbTr7OISCYx9SEUXfBLJqVoAZKtsaVbmoggH2NuFL9WL2K0RSTEHzGZGsrQHqgFF8j5Iii8ybpULxjQ0-J_wT0C7d5Pfa14Sa-3-zfpKo Oct 22 21:06:31.331027 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 21:06:31.331027 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 21:06:31.331027 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 21:06:31.331027 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 21:06:31.331027 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 21:06:31.331027 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 21:06:31.331027 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: 66a26a2284f4424cbeaf63d504652546 Oct 22 21:06:31.331027 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-ImagesTestJSON-2101376766 Oct 22 21:06:31.331027 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 21:06:31.331027 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 21:06:31.331027 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_66a26a2284f4424cbeaf63d504652546"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/66a26a2284f4424cbeaf63d504652546"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/66a26a2284f4424cbeaf63d504652546"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/66a26a2284f4424cbeaf63d504652546"}]}] Oct 22 21:06:31.331027 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-ImagesTestJSON-2101376766 Oct 22 21:06:31.331027 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: 66a26a2284f4424cbeaf63d504652546 Oct 22 21:06:31.331027 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-ImagesTestJSON-2101376766 Oct 22 21:06:31.331027 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-ImagesTestJSON-2101376766-project Oct 22 21:06:31.331027 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 21:06:31.331027 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 21:06:31.331027 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: f0a44ff8e7c14b94b1670f030085c43d Oct 22 21:06:31.331027 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-ImagesTestJSON-2101376766-project Oct 22 21:06:31.331027 ncdv-master-1 devstack@n-api.service[138745]: method: > Oct 22 21:06:31.331027 ncdv-master-1 devstack@n-api.service[138745]: exception: Instance a26fa9bd-fad2-40a2-910e-2208fb769dcb could not be found. Oct 22 21:06:31.331027 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'id': 'a26fa9bd-fad2-40a2-910e-2208fb769dcb'} Oct 22 21:06:31.331027 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:06:31.331027 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:06:31.331027 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 21:06:31.331027 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 21:06:31.331027 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 21:06:31.331027 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 21:06:31.331027 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 21:06:31.331027 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 21:06:31.331027 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 21:06:31.331027 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 21:06:31.331027 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a26fa9bd-fad2-40a2-910e-2208fb769dcb could not be found. Oct 22 21:06:31.331027 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:06:31.331027 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:06:31.331027 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:06:31.331027 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:06:31.331027 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:06:31.331027 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:06:31.331027 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:06:31.331027 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:06:31.331027 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:06:31.331027 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:06:31.331027 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 21:06:31.331027 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 21:06:31.331027 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 21:06:31.331027 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 21:06:31.331027 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 21:06:31.331027 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:06:31.331027 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a26fa9bd-fad2-40a2-910e-2208fb769dcb could not be found. Oct 22 21:06:31.331027 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:06:31.331027 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:06:31.331027 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:06:31.331027 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:06:31.334776 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:06:31.334776 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:06:31.334776 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:06:31.334776 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:06:31.334776 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a26fa9bd-fad2-40a2-910e-2208fb769dcb could not be found. Oct 22 21:06:31.334776 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:06:31.334776 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-4d1640eb-3612-4ade-8c21-5836db77b2b7 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Returning 404 to user: Instance a26fa9bd-fad2-40a2-910e-2208fb769dcb could not be found. {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:06:31.334776 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-4d1640eb-3612-4ade-8c21-5836db77b2b7 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] 10.222.0.18 "GET /compute/v2.1/servers/a26fa9bd-fad2-40a2-910e-2208fb769dcb" status: 404 len: 111 microversion: 2.1 time: 0.101991 Oct 22 21:06:31.334776 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1844/3655] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:06:31 2022] GET /compute/v2.1/servers/a26fa9bd-fad2-40a2-910e-2208fb769dcb => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 21:06:31.342701 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-ed598738-447f-4cab-91bf-0ca7d2fc0b33 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:31.343581 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-ed598738-447f-4cab-91bf-0ca7d2fc0b33 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] [instance: 844f3fc3-ad5d-4dda-b642-ce9c1d417820] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:06:31.351301 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ed598738-447f-4cab-91bf-0ca7d2fc0b33 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:31.352111 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ed598738-447f-4cab-91bf-0ca7d2fc0b33 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:31.352728 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ed598738-447f-4cab-91bf-0ca7d2fc0b33 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:31.353604 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ed598738-447f-4cab-91bf-0ca7d2fc0b33 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:31.354343 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ed598738-447f-4cab-91bf-0ca7d2fc0b33 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:31.354984 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ed598738-447f-4cab-91bf-0ca7d2fc0b33 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:31.373127 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-ed598738-447f-4cab-91bf-0ca7d2fc0b33 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] HTTP exception thrown: Instance 844f3fc3-ad5d-4dda-b642-ce9c1d417820 could not be found. Oct 22 21:06:31.374965 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-ed598738-447f-4cab-91bf-0ca7d2fc0b33 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Request method failure captured: Oct 22 21:06:31.374965 ncdv-master-1 devstack@n-api.service[138744]: request: DELETE /compute/v2.1/servers/844f3fc3-ad5d-4dda-b642-ce9c1d417820 HTTP/1.1 Oct 22 21:06:31.374965 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 21:06:31.374965 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 21:06:31.374965 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 21:06:31.374965 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 0 Oct 22 21:06:31.374965 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 21:06:31.374965 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 21:06:31.374965 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 21:06:31.374965 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 21:06:31.374965 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVFng3hwvwMj6qrKBKP-NtPsacHNJudvI6PbLTlDqKVlCNAf4Mqq0nvy7Chi-hCExXK3RI9ZbTr7OISCYx9SEUXfBLJqVoAZKtsaVbmoggH2NuFL9WL2K0RSTEHzGZGsrQHqgFF8j5Iii8ybpULxjQ0-J_wT0C7d5Pfa14Sa-3-zfpKo Oct 22 21:06:31.374965 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 21:06:31.374965 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 21:06:31.374965 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 21:06:31.374965 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 21:06:31.374965 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 21:06:31.374965 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 21:06:31.374965 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: 66a26a2284f4424cbeaf63d504652546 Oct 22 21:06:31.374965 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-ImagesTestJSON-2101376766 Oct 22 21:06:31.374965 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 21:06:31.374965 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 21:06:31.374965 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_66a26a2284f4424cbeaf63d504652546"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/66a26a2284f4424cbeaf63d504652546"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/66a26a2284f4424cbeaf63d504652546"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/66a26a2284f4424cbeaf63d504652546"}]}] Oct 22 21:06:31.374965 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-ImagesTestJSON-2101376766 Oct 22 21:06:31.374965 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: 66a26a2284f4424cbeaf63d504652546 Oct 22 21:06:31.374965 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-ImagesTestJSON-2101376766 Oct 22 21:06:31.374965 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-ImagesTestJSON-2101376766-project Oct 22 21:06:31.374965 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 21:06:31.374965 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 21:06:31.374965 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: f0a44ff8e7c14b94b1670f030085c43d Oct 22 21:06:31.374965 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-ImagesTestJSON-2101376766-project Oct 22 21:06:31.374965 ncdv-master-1 devstack@n-api.service[138744]: method: > Oct 22 21:06:31.374965 ncdv-master-1 devstack@n-api.service[138744]: exception: Instance 844f3fc3-ad5d-4dda-b642-ce9c1d417820 could not be found. Oct 22 21:06:31.374965 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': '844f3fc3-ad5d-4dda-b642-ce9c1d417820'} Oct 22 21:06:31.374965 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:06:31.374965 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:06:31.374965 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 21:06:31.374965 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 21:06:31.374965 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 21:06:31.374965 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 21:06:31.374965 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 21:06:31.374965 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 21:06:31.374965 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 21:06:31.374965 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 21:06:31.374965 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 844f3fc3-ad5d-4dda-b642-ce9c1d417820 could not be found. Oct 22 21:06:31.374965 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:06:31.374965 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:06:31.374965 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:06:31.374965 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:06:31.374965 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:06:31.374965 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:06:31.374965 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:06:31.374965 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:06:31.374965 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:06:31.374965 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:06:31.374965 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 22 21:06:31.374965 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 22 21:06:31.374965 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 22 21:06:31.374965 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 22 21:06:31.374965 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 21:06:31.374965 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 21:06:31.374965 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 21:06:31.374965 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:06:31.374965 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 844f3fc3-ad5d-4dda-b642-ce9c1d417820 could not be found. Oct 22 21:06:31.381439 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:06:31.381439 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:06:31.381439 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:06:31.381439 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:06:31.381439 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:06:31.381439 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:06:31.381439 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:06:31.381439 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:06:31.381439 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 844f3fc3-ad5d-4dda-b642-ce9c1d417820 could not be found. Oct 22 21:06:31.381439 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:06:31.381439 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-ed598738-447f-4cab-91bf-0ca7d2fc0b33 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Returning 404 to user: Instance 844f3fc3-ad5d-4dda-b642-ce9c1d417820 could not be found. {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:06:31.381439 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-ed598738-447f-4cab-91bf-0ca7d2fc0b33 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] 10.222.0.18 "DELETE /compute/v2.1/servers/844f3fc3-ad5d-4dda-b642-ce9c1d417820" status: 404 len: 111 microversion: 2.1 time: 0.038480 Oct 22 21:06:31.381439 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1812/3656] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 21:06:31 2022] DELETE /compute/v2.1/servers/844f3fc3-ad5d-4dda-b642-ce9c1d417820 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 21:06:31.386444 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-f78ec664-a9d5-4963-b6cc-0ede4058c545 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:31.386790 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-f78ec664-a9d5-4963-b6cc-0ede4058c545 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] [instance: 844f3fc3-ad5d-4dda-b642-ce9c1d417820] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:06:31.398340 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f78ec664-a9d5-4963-b6cc-0ede4058c545 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:31.398863 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f78ec664-a9d5-4963-b6cc-0ede4058c545 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:31.399517 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f78ec664-a9d5-4963-b6cc-0ede4058c545 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:31.402437 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f78ec664-a9d5-4963-b6cc-0ede4058c545 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:31.402976 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f78ec664-a9d5-4963-b6cc-0ede4058c545 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:31.403464 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f78ec664-a9d5-4963-b6cc-0ede4058c545 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:31.431334 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.wsgi [None req-f78ec664-a9d5-4963-b6cc-0ede4058c545 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] HTTP exception thrown: Instance 844f3fc3-ad5d-4dda-b642-ce9c1d417820 could not be found. Oct 22 21:06:31.433394 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-f78ec664-a9d5-4963-b6cc-0ede4058c545 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Request method failure captured: Oct 22 21:06:31.433394 ncdv-master-1 devstack@n-api.service[138745]: request: GET /compute/v2.1/servers/844f3fc3-ad5d-4dda-b642-ce9c1d417820 HTTP/1.1 Oct 22 21:06:31.433394 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 21:06:31.433394 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 21:06:31.433394 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 21:06:31.433394 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 0 Oct 22 21:06:31.433394 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 21:06:31.433394 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 21:06:31.433394 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 21:06:31.433394 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 21:06:31.433394 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVFng3hwvwMj6qrKBKP-NtPsacHNJudvI6PbLTlDqKVlCNAf4Mqq0nvy7Chi-hCExXK3RI9ZbTr7OISCYx9SEUXfBLJqVoAZKtsaVbmoggH2NuFL9WL2K0RSTEHzGZGsrQHqgFF8j5Iii8ybpULxjQ0-J_wT0C7d5Pfa14Sa-3-zfpKo Oct 22 21:06:31.433394 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 21:06:31.433394 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 21:06:31.433394 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 21:06:31.433394 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 21:06:31.433394 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 21:06:31.433394 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 21:06:31.433394 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: 66a26a2284f4424cbeaf63d504652546 Oct 22 21:06:31.433394 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-ImagesTestJSON-2101376766 Oct 22 21:06:31.433394 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 21:06:31.433394 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 21:06:31.433394 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_66a26a2284f4424cbeaf63d504652546"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/66a26a2284f4424cbeaf63d504652546"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/66a26a2284f4424cbeaf63d504652546"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/66a26a2284f4424cbeaf63d504652546"}]}] Oct 22 21:06:31.433394 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-ImagesTestJSON-2101376766 Oct 22 21:06:31.433394 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: 66a26a2284f4424cbeaf63d504652546 Oct 22 21:06:31.433394 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-ImagesTestJSON-2101376766 Oct 22 21:06:31.433394 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-ImagesTestJSON-2101376766-project Oct 22 21:06:31.433394 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 21:06:31.433394 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 21:06:31.433394 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: f0a44ff8e7c14b94b1670f030085c43d Oct 22 21:06:31.433394 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-ImagesTestJSON-2101376766-project Oct 22 21:06:31.433394 ncdv-master-1 devstack@n-api.service[138745]: method: > Oct 22 21:06:31.433394 ncdv-master-1 devstack@n-api.service[138745]: exception: Instance 844f3fc3-ad5d-4dda-b642-ce9c1d417820 could not be found. Oct 22 21:06:31.433394 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'id': '844f3fc3-ad5d-4dda-b642-ce9c1d417820'} Oct 22 21:06:31.433394 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:06:31.433394 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:06:31.433394 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 21:06:31.433394 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 21:06:31.433394 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 21:06:31.433394 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 21:06:31.433394 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 21:06:31.433394 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 21:06:31.433394 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 21:06:31.433394 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 21:06:31.433394 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 844f3fc3-ad5d-4dda-b642-ce9c1d417820 could not be found. Oct 22 21:06:31.433394 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:06:31.433394 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:06:31.433394 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:06:31.433394 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:06:31.433394 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:06:31.433394 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:06:31.433394 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:06:31.433394 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:06:31.433394 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:06:31.433394 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:06:31.433394 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 21:06:31.433394 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 21:06:31.433394 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 21:06:31.433394 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 21:06:31.433394 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 21:06:31.433394 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:06:31.433394 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 844f3fc3-ad5d-4dda-b642-ce9c1d417820 could not be found. Oct 22 21:06:31.433394 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:06:31.433394 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:06:31.433394 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:06:31.433394 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:06:31.437727 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:06:31.437727 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:06:31.437727 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:06:31.437727 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:06:31.437727 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 844f3fc3-ad5d-4dda-b642-ce9c1d417820 could not be found. Oct 22 21:06:31.437727 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:06:31.439098 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-f78ec664-a9d5-4963-b6cc-0ede4058c545 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Returning 404 to user: Instance 844f3fc3-ad5d-4dda-b642-ce9c1d417820 could not be found. {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:06:31.440246 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-f78ec664-a9d5-4963-b6cc-0ede4058c545 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] 10.222.0.18 "GET /compute/v2.1/servers/844f3fc3-ad5d-4dda-b642-ce9c1d417820" status: 404 len: 111 microversion: 2.1 time: 0.058224 Oct 22 21:06:31.441702 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1845/3657] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:06:31 2022] GET /compute/v2.1/servers/844f3fc3-ad5d-4dda-b642-ce9c1d417820 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 21:06:31.451157 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-abdc7e64-ea1f-4347-874c-ad032a3e34a3 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Calling method '.version_select at 0x7fd39ee0d4c0>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:31.485379 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-abdc7e64-ea1f-4347-874c-ad032a3e34a3 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] HTTP exception thrown: Image not found. Oct 22 21:06:31.487317 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-abdc7e64-ea1f-4347-874c-ad032a3e34a3 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Request method failure captured: Oct 22 21:06:31.487317 ncdv-master-1 devstack@n-api.service[138744]: request: DELETE /compute/v2.1/images/fefdb332-d8c8-4dbc-8b2b-6d54994dca11 HTTP/1.1 Oct 22 21:06:31.487317 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 21:06:31.487317 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 21:06:31.487317 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 21:06:31.487317 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 0 Oct 22 21:06:31.487317 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 21:06:31.487317 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 21:06:31.487317 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 21:06:31.487317 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 21:06:31.487317 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVFng3hwvwMj6qrKBKP-NtPsacHNJudvI6PbLTlDqKVlCNAf4Mqq0nvy7Chi-hCExXK3RI9ZbTr7OISCYx9SEUXfBLJqVoAZKtsaVbmoggH2NuFL9WL2K0RSTEHzGZGsrQHqgFF8j5Iii8ybpULxjQ0-J_wT0C7d5Pfa14Sa-3-zfpKo Oct 22 21:06:31.487317 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 21:06:31.487317 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 21:06:31.487317 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 21:06:31.487317 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 21:06:31.487317 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 21:06:31.487317 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 21:06:31.487317 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: 66a26a2284f4424cbeaf63d504652546 Oct 22 21:06:31.487317 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-ImagesTestJSON-2101376766 Oct 22 21:06:31.487317 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 21:06:31.487317 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 21:06:31.487317 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_66a26a2284f4424cbeaf63d504652546"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/66a26a2284f4424cbeaf63d504652546"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/66a26a2284f4424cbeaf63d504652546"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/66a26a2284f4424cbeaf63d504652546"}]}] Oct 22 21:06:31.487317 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-ImagesTestJSON-2101376766 Oct 22 21:06:31.487317 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: 66a26a2284f4424cbeaf63d504652546 Oct 22 21:06:31.487317 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-ImagesTestJSON-2101376766 Oct 22 21:06:31.487317 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-ImagesTestJSON-2101376766-project Oct 22 21:06:31.487317 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 21:06:31.487317 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 21:06:31.487317 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: f0a44ff8e7c14b94b1670f030085c43d Oct 22 21:06:31.487317 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-ImagesTestJSON-2101376766-project Oct 22 21:06:31.487317 ncdv-master-1 devstack@n-api.service[138744]: method: Oct 22 21:06:31.487317 ncdv-master-1 devstack@n-api.service[138744]: exception: Image not found. Oct 22 21:06:31.487317 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': 'fefdb332-d8c8-4dbc-8b2b-6d54994dca11'} Oct 22 21:06:31.487317 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:06:31.487317 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:06:31.487317 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 22 21:06:31.487317 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 22 21:06:31.487317 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 22 21:06:31.487317 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 22 21:06:31.487317 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 22 21:06:31.487317 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 22 21:06:31.487317 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 22 21:06:31.487317 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 22 21:06:31.487317 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 22 21:06:31.487317 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 22 21:06:31.487317 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 22 21:06:31.487317 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 22 21:06:31.487317 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 22 21:06:31.487317 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 22 21:06:31.487317 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image fefdb332-d8c8-4dbc-8b2b-6d54994dca11 to delete Oct 22 21:06:31.487317 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:06:31.487317 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:06:31.487317 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:06:31.487317 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:06:31.487317 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 22 21:06:31.487317 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 22 21:06:31.487317 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 22 21:06:31.487317 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 22 21:06:31.487317 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 22 21:06:31.487317 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 22 21:06:31.487317 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image fefdb332-d8c8-4dbc-8b2b-6d54994dca11 could not be found. Oct 22 21:06:31.487317 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:06:31.487317 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:06:31.487317 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:06:31.487317 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:06:31.497225 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:06:31.497225 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:06:31.497225 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:06:31.497225 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:06:31.497225 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 22 21:06:31.497225 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 22 21:06:31.497225 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:06:31.497225 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:06:31.497225 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 22 21:06:31.497225 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 22 21:06:31.497225 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 22 21:06:31.497225 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:06:31.497225 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:06:31.497225 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:06:31.497225 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:06:31.497225 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:06:31.497225 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:06:31.497225 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:06:31.497225 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:06:31.497225 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 22 21:06:31.497225 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:06:31.497225 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-abdc7e64-ea1f-4347-874c-ad032a3e34a3 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Returning 404 to user: Image not found. {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:06:31.497225 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-abdc7e64-ea1f-4347-874c-ad032a3e34a3 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] 10.222.0.18 "DELETE /compute/v2.1/images/fefdb332-d8c8-4dbc-8b2b-6d54994dca11" status: 404 len: 62 microversion: 2.1 time: 0.042968 Oct 22 21:06:31.500197 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-4966f3b4-8291-44e6-afd8-f73ef280a427 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:31.500450 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1813/3658] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:06:31 2022] DELETE /compute/v2.1/images/fefdb332-d8c8-4dbc-8b2b-6d54994dca11 => generated 62 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 22 21:06:31.501076 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-4966f3b4-8291-44e6-afd8-f73ef280a427 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] [instance: 64318452-365b-4b80-b53b-9367dd8bc826] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:06:31.501693 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-eee32506-450a-4535-aff9-c52df7db4132 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:31.501920 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4966f3b4-8291-44e6-afd8-f73ef280a427 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:31.502124 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4966f3b4-8291-44e6-afd8-f73ef280a427 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:31.502301 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-eee32506-450a-4535-aff9-c52df7db4132 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] [instance: 9bfb71b4-0081-493a-8ed5-1c80169b12d0] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:06:31.504212 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4966f3b4-8291-44e6-afd8-f73ef280a427 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:31.504212 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4966f3b4-8291-44e6-afd8-f73ef280a427 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:31.504212 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4966f3b4-8291-44e6-afd8-f73ef280a427 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:31.504693 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4966f3b4-8291-44e6-afd8-f73ef280a427 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:31.523129 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-eee32506-450a-4535-aff9-c52df7db4132 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:31.539199 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-eee32506-450a-4535-aff9-c52df7db4132 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:31.540054 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-eee32506-450a-4535-aff9-c52df7db4132 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:31.543073 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-eee32506-450a-4535-aff9-c52df7db4132 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:31.546434 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-eee32506-450a-4535-aff9-c52df7db4132 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:31.549872 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-eee32506-450a-4535-aff9-c52df7db4132 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:31.580752 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-eee32506-450a-4535-aff9-c52df7db4132 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] HTTP exception thrown: Instance 9bfb71b4-0081-493a-8ed5-1c80169b12d0 could not be found. Oct 22 21:06:31.583867 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-eee32506-450a-4535-aff9-c52df7db4132 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Request method failure captured: Oct 22 21:06:31.583867 ncdv-master-1 devstack@n-api.service[138744]: request: DELETE /compute/v2.1/servers/9bfb71b4-0081-493a-8ed5-1c80169b12d0 HTTP/1.1 Oct 22 21:06:31.583867 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 21:06:31.583867 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 21:06:31.583867 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 21:06:31.583867 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 0 Oct 22 21:06:31.583867 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 21:06:31.583867 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 21:06:31.583867 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 21:06:31.583867 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 21:06:31.583867 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVFng3hwvwMj6qrKBKP-NtPsacHNJudvI6PbLTlDqKVlCNAf4Mqq0nvy7Chi-hCExXK3RI9ZbTr7OISCYx9SEUXfBLJqVoAZKtsaVbmoggH2NuFL9WL2K0RSTEHzGZGsrQHqgFF8j5Iii8ybpULxjQ0-J_wT0C7d5Pfa14Sa-3-zfpKo Oct 22 21:06:31.583867 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 21:06:31.583867 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 21:06:31.583867 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 21:06:31.583867 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 21:06:31.583867 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 21:06:31.583867 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 21:06:31.583867 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: 66a26a2284f4424cbeaf63d504652546 Oct 22 21:06:31.583867 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-ImagesTestJSON-2101376766 Oct 22 21:06:31.583867 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 21:06:31.583867 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 21:06:31.583867 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_66a26a2284f4424cbeaf63d504652546"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/66a26a2284f4424cbeaf63d504652546"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/66a26a2284f4424cbeaf63d504652546"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/66a26a2284f4424cbeaf63d504652546"}]}] Oct 22 21:06:31.583867 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-ImagesTestJSON-2101376766 Oct 22 21:06:31.583867 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: 66a26a2284f4424cbeaf63d504652546 Oct 22 21:06:31.583867 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-ImagesTestJSON-2101376766 Oct 22 21:06:31.583867 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-ImagesTestJSON-2101376766-project Oct 22 21:06:31.583867 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 21:06:31.583867 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 21:06:31.583867 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: f0a44ff8e7c14b94b1670f030085c43d Oct 22 21:06:31.583867 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-ImagesTestJSON-2101376766-project Oct 22 21:06:31.583867 ncdv-master-1 devstack@n-api.service[138744]: method: > Oct 22 21:06:31.583867 ncdv-master-1 devstack@n-api.service[138744]: exception: Instance 9bfb71b4-0081-493a-8ed5-1c80169b12d0 could not be found. Oct 22 21:06:31.583867 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': '9bfb71b4-0081-493a-8ed5-1c80169b12d0'} Oct 22 21:06:31.583867 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:06:31.583867 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:06:31.583867 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 21:06:31.583867 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 21:06:31.583867 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 21:06:31.583867 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 21:06:31.583867 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 21:06:31.583867 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 21:06:31.583867 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 21:06:31.583867 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 21:06:31.583867 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9bfb71b4-0081-493a-8ed5-1c80169b12d0 could not be found. Oct 22 21:06:31.583867 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:06:31.583867 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:06:31.583867 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:06:31.583867 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:06:31.583867 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:06:31.583867 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:06:31.583867 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:06:31.583867 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:06:31.583867 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:06:31.583867 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:06:31.583867 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 22 21:06:31.583867 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 22 21:06:31.583867 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 22 21:06:31.583867 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 22 21:06:31.583867 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 21:06:31.583867 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 21:06:31.583867 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 21:06:31.583867 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:06:31.583867 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9bfb71b4-0081-493a-8ed5-1c80169b12d0 could not be found. Oct 22 21:06:31.587274 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:06:31.587274 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:06:31.587274 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:06:31.587274 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:06:31.587274 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:06:31.587274 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:06:31.587274 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:06:31.587274 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:06:31.587274 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9bfb71b4-0081-493a-8ed5-1c80169b12d0 could not be found. Oct 22 21:06:31.587274 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:06:31.589419 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-eee32506-450a-4535-aff9-c52df7db4132 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Returning 404 to user: Instance 9bfb71b4-0081-493a-8ed5-1c80169b12d0 could not be found. {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:06:31.590908 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-eee32506-450a-4535-aff9-c52df7db4132 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] 10.222.0.18 "DELETE /compute/v2.1/servers/9bfb71b4-0081-493a-8ed5-1c80169b12d0" status: 404 len: 111 microversion: 2.1 time: 0.096084 Oct 22 21:06:31.592479 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1814/3659] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 21:06:31 2022] DELETE /compute/v2.1/servers/9bfb71b4-0081-493a-8ed5-1c80169b12d0 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 22 21:06:31.602483 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-7b99f46d-f3e8-4019-8625-5085c1a26a83 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:31.603316 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-7b99f46d-f3e8-4019-8625-5085c1a26a83 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] [instance: 9bfb71b4-0081-493a-8ed5-1c80169b12d0] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:06:31.612481 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7b99f46d-f3e8-4019-8625-5085c1a26a83 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:31.613445 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7b99f46d-f3e8-4019-8625-5085c1a26a83 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:31.614053 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7b99f46d-f3e8-4019-8625-5085c1a26a83 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:31.615059 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7b99f46d-f3e8-4019-8625-5085c1a26a83 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:31.615657 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7b99f46d-f3e8-4019-8625-5085c1a26a83 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:31.616441 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7b99f46d-f3e8-4019-8625-5085c1a26a83 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:31.634386 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-7b99f46d-f3e8-4019-8625-5085c1a26a83 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] HTTP exception thrown: Instance 9bfb71b4-0081-493a-8ed5-1c80169b12d0 could not be found. Oct 22 21:06:31.636143 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-7b99f46d-f3e8-4019-8625-5085c1a26a83 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Request method failure captured: Oct 22 21:06:31.636143 ncdv-master-1 devstack@n-api.service[138744]: request: GET /compute/v2.1/servers/9bfb71b4-0081-493a-8ed5-1c80169b12d0 HTTP/1.1 Oct 22 21:06:31.636143 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 21:06:31.636143 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 21:06:31.636143 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 21:06:31.636143 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 0 Oct 22 21:06:31.636143 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 21:06:31.636143 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 21:06:31.636143 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 21:06:31.636143 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 21:06:31.636143 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVFng3hwvwMj6qrKBKP-NtPsacHNJudvI6PbLTlDqKVlCNAf4Mqq0nvy7Chi-hCExXK3RI9ZbTr7OISCYx9SEUXfBLJqVoAZKtsaVbmoggH2NuFL9WL2K0RSTEHzGZGsrQHqgFF8j5Iii8ybpULxjQ0-J_wT0C7d5Pfa14Sa-3-zfpKo Oct 22 21:06:31.636143 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 21:06:31.636143 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 21:06:31.636143 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 21:06:31.636143 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 21:06:31.636143 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 21:06:31.636143 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 21:06:31.636143 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: 66a26a2284f4424cbeaf63d504652546 Oct 22 21:06:31.636143 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-ImagesTestJSON-2101376766 Oct 22 21:06:31.636143 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 21:06:31.636143 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 21:06:31.636143 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_66a26a2284f4424cbeaf63d504652546"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/66a26a2284f4424cbeaf63d504652546"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/66a26a2284f4424cbeaf63d504652546"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/66a26a2284f4424cbeaf63d504652546"}]}] Oct 22 21:06:31.636143 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-ImagesTestJSON-2101376766 Oct 22 21:06:31.636143 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: 66a26a2284f4424cbeaf63d504652546 Oct 22 21:06:31.636143 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-ImagesTestJSON-2101376766 Oct 22 21:06:31.636143 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-ImagesTestJSON-2101376766-project Oct 22 21:06:31.636143 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 21:06:31.636143 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 21:06:31.636143 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: f0a44ff8e7c14b94b1670f030085c43d Oct 22 21:06:31.636143 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-ImagesTestJSON-2101376766-project Oct 22 21:06:31.636143 ncdv-master-1 devstack@n-api.service[138744]: method: > Oct 22 21:06:31.636143 ncdv-master-1 devstack@n-api.service[138744]: exception: Instance 9bfb71b4-0081-493a-8ed5-1c80169b12d0 could not be found. Oct 22 21:06:31.636143 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': '9bfb71b4-0081-493a-8ed5-1c80169b12d0'} Oct 22 21:06:31.636143 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:06:31.636143 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:06:31.636143 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 21:06:31.636143 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 21:06:31.636143 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 21:06:31.636143 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 21:06:31.636143 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 21:06:31.636143 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 21:06:31.636143 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 21:06:31.636143 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 21:06:31.636143 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9bfb71b4-0081-493a-8ed5-1c80169b12d0 could not be found. Oct 22 21:06:31.636143 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:06:31.636143 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:06:31.636143 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:06:31.636143 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:06:31.636143 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:06:31.636143 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:06:31.636143 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:06:31.636143 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:06:31.636143 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:06:31.636143 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:06:31.636143 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 21:06:31.636143 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 21:06:31.636143 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 21:06:31.636143 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 21:06:31.636143 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 21:06:31.636143 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:06:31.636143 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9bfb71b4-0081-493a-8ed5-1c80169b12d0 could not be found. Oct 22 21:06:31.636143 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:06:31.636143 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:06:31.636143 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:06:31.636143 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:06:31.641123 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:06:31.641123 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:06:31.641123 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:06:31.641123 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:06:31.641123 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9bfb71b4-0081-493a-8ed5-1c80169b12d0 could not be found. Oct 22 21:06:31.641123 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:06:31.641123 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-7b99f46d-f3e8-4019-8625-5085c1a26a83 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Returning 404 to user: Instance 9bfb71b4-0081-493a-8ed5-1c80169b12d0 could not be found. {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:06:31.641123 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-7b99f46d-f3e8-4019-8625-5085c1a26a83 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] 10.222.0.18 "GET /compute/v2.1/servers/9bfb71b4-0081-493a-8ed5-1c80169b12d0" status: 404 len: 111 microversion: 2.1 time: 0.040780 Oct 22 21:06:31.641123 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1815/3660] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:06:31 2022] GET /compute/v2.1/servers/9bfb71b4-0081-493a-8ed5-1c80169b12d0 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 21:06:31.650207 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-65d6b0f0-b5aa-4fa9-8bb7-ddd6d60c7562 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Calling method '.version_select at 0x7fd39ef2d700>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:31.677135 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-65d6b0f0-b5aa-4fa9-8bb7-ddd6d60c7562 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] HTTP exception thrown: Image not found. Oct 22 21:06:31.680718 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-65d6b0f0-b5aa-4fa9-8bb7-ddd6d60c7562 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Request method failure captured: Oct 22 21:06:31.680718 ncdv-master-1 devstack@n-api.service[138744]: request: DELETE /compute/v2.1/images/a721137b-509e-48d8-8ac4-4f5f10aaa459 HTTP/1.1 Oct 22 21:06:31.680718 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 21:06:31.680718 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 21:06:31.680718 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 21:06:31.680718 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 0 Oct 22 21:06:31.680718 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 21:06:31.680718 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 21:06:31.680718 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 21:06:31.680718 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 21:06:31.680718 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVFng3hwvwMj6qrKBKP-NtPsacHNJudvI6PbLTlDqKVlCNAf4Mqq0nvy7Chi-hCExXK3RI9ZbTr7OISCYx9SEUXfBLJqVoAZKtsaVbmoggH2NuFL9WL2K0RSTEHzGZGsrQHqgFF8j5Iii8ybpULxjQ0-J_wT0C7d5Pfa14Sa-3-zfpKo Oct 22 21:06:31.680718 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 21:06:31.680718 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 21:06:31.680718 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 21:06:31.680718 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 21:06:31.680718 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 21:06:31.680718 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 21:06:31.680718 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: 66a26a2284f4424cbeaf63d504652546 Oct 22 21:06:31.680718 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-ImagesTestJSON-2101376766 Oct 22 21:06:31.680718 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 21:06:31.680718 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 21:06:31.680718 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_66a26a2284f4424cbeaf63d504652546"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/66a26a2284f4424cbeaf63d504652546"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/66a26a2284f4424cbeaf63d504652546"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/66a26a2284f4424cbeaf63d504652546"}]}] Oct 22 21:06:31.680718 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-ImagesTestJSON-2101376766 Oct 22 21:06:31.680718 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: 66a26a2284f4424cbeaf63d504652546 Oct 22 21:06:31.680718 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-ImagesTestJSON-2101376766 Oct 22 21:06:31.680718 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-ImagesTestJSON-2101376766-project Oct 22 21:06:31.680718 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 21:06:31.680718 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 21:06:31.680718 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: f0a44ff8e7c14b94b1670f030085c43d Oct 22 21:06:31.680718 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-ImagesTestJSON-2101376766-project Oct 22 21:06:31.680718 ncdv-master-1 devstack@n-api.service[138744]: method: Oct 22 21:06:31.680718 ncdv-master-1 devstack@n-api.service[138744]: exception: Image not found. Oct 22 21:06:31.680718 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': 'a721137b-509e-48d8-8ac4-4f5f10aaa459'} Oct 22 21:06:31.680718 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:06:31.680718 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:06:31.680718 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 22 21:06:31.680718 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 22 21:06:31.680718 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 22 21:06:31.680718 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 22 21:06:31.680718 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 22 21:06:31.680718 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 22 21:06:31.680718 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 22 21:06:31.680718 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 22 21:06:31.680718 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 22 21:06:31.680718 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 22 21:06:31.680718 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 22 21:06:31.680718 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 22 21:06:31.680718 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 22 21:06:31.680718 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 22 21:06:31.680718 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image a721137b-509e-48d8-8ac4-4f5f10aaa459 to delete Oct 22 21:06:31.680718 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:06:31.680718 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:06:31.680718 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:06:31.680718 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:06:31.680718 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 22 21:06:31.680718 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 22 21:06:31.680718 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 22 21:06:31.680718 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 22 21:06:31.680718 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 22 21:06:31.680718 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 22 21:06:31.680718 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image a721137b-509e-48d8-8ac4-4f5f10aaa459 could not be found. Oct 22 21:06:31.680718 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:06:31.680718 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:06:31.680718 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:06:31.680718 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:06:31.684336 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:06:31.684336 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:06:31.684336 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:06:31.684336 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:06:31.684336 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 22 21:06:31.684336 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 22 21:06:31.684336 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:06:31.684336 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:06:31.684336 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 22 21:06:31.684336 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 22 21:06:31.684336 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 22 21:06:31.684336 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:06:31.684336 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:06:31.684336 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:06:31.684336 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:06:31.684336 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:06:31.684336 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:06:31.684336 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:06:31.684336 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:06:31.684336 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 22 21:06:31.684336 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:06:31.688855 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-65d6b0f0-b5aa-4fa9-8bb7-ddd6d60c7562 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Returning 404 to user: Image not found. {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:06:31.689933 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-65d6b0f0-b5aa-4fa9-8bb7-ddd6d60c7562 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] 10.222.0.18 "DELETE /compute/v2.1/images/a721137b-509e-48d8-8ac4-4f5f10aaa459" status: 404 len: 62 microversion: 2.1 time: 0.045213 Oct 22 21:06:31.691013 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1816/3661] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:06:31 2022] DELETE /compute/v2.1/images/a721137b-509e-48d8-8ac4-4f5f10aaa459 => generated 62 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 22 21:06:31.699967 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-faa1edf4-ca25-446e-ba28-c8afebbdef3a tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:31.700988 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-faa1edf4-ca25-446e-ba28-c8afebbdef3a tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] [instance: 524c2c11-4a65-4360-93e4-e25349cb6416] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:06:31.713402 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-faa1edf4-ca25-446e-ba28-c8afebbdef3a tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:31.714374 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-faa1edf4-ca25-446e-ba28-c8afebbdef3a tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:31.715174 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-faa1edf4-ca25-446e-ba28-c8afebbdef3a tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:31.716229 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-faa1edf4-ca25-446e-ba28-c8afebbdef3a tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:31.717170 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-faa1edf4-ca25-446e-ba28-c8afebbdef3a tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:31.718131 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-faa1edf4-ca25-446e-ba28-c8afebbdef3a tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:31.735554 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-faa1edf4-ca25-446e-ba28-c8afebbdef3a tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] HTTP exception thrown: Instance 524c2c11-4a65-4360-93e4-e25349cb6416 could not be found. Oct 22 21:06:31.738620 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-faa1edf4-ca25-446e-ba28-c8afebbdef3a tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Request method failure captured: Oct 22 21:06:31.738620 ncdv-master-1 devstack@n-api.service[138744]: request: DELETE /compute/v2.1/servers/524c2c11-4a65-4360-93e4-e25349cb6416 HTTP/1.1 Oct 22 21:06:31.738620 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 21:06:31.738620 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 21:06:31.738620 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 21:06:31.738620 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 0 Oct 22 21:06:31.738620 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 21:06:31.738620 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 21:06:31.738620 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 21:06:31.738620 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 21:06:31.738620 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVFng3hwvwMj6qrKBKP-NtPsacHNJudvI6PbLTlDqKVlCNAf4Mqq0nvy7Chi-hCExXK3RI9ZbTr7OISCYx9SEUXfBLJqVoAZKtsaVbmoggH2NuFL9WL2K0RSTEHzGZGsrQHqgFF8j5Iii8ybpULxjQ0-J_wT0C7d5Pfa14Sa-3-zfpKo Oct 22 21:06:31.738620 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 21:06:31.738620 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 21:06:31.738620 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 21:06:31.738620 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 21:06:31.738620 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 21:06:31.738620 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 21:06:31.738620 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: 66a26a2284f4424cbeaf63d504652546 Oct 22 21:06:31.738620 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-ImagesTestJSON-2101376766 Oct 22 21:06:31.738620 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 21:06:31.738620 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 21:06:31.738620 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_66a26a2284f4424cbeaf63d504652546"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/66a26a2284f4424cbeaf63d504652546"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/66a26a2284f4424cbeaf63d504652546"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/66a26a2284f4424cbeaf63d504652546"}]}] Oct 22 21:06:31.738620 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-ImagesTestJSON-2101376766 Oct 22 21:06:31.738620 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: 66a26a2284f4424cbeaf63d504652546 Oct 22 21:06:31.738620 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-ImagesTestJSON-2101376766 Oct 22 21:06:31.738620 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-ImagesTestJSON-2101376766-project Oct 22 21:06:31.738620 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 21:06:31.738620 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 21:06:31.738620 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: f0a44ff8e7c14b94b1670f030085c43d Oct 22 21:06:31.738620 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-ImagesTestJSON-2101376766-project Oct 22 21:06:31.738620 ncdv-master-1 devstack@n-api.service[138744]: method: > Oct 22 21:06:31.738620 ncdv-master-1 devstack@n-api.service[138744]: exception: Instance 524c2c11-4a65-4360-93e4-e25349cb6416 could not be found. Oct 22 21:06:31.738620 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': '524c2c11-4a65-4360-93e4-e25349cb6416'} Oct 22 21:06:31.738620 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:06:31.738620 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:06:31.738620 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 21:06:31.738620 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 21:06:31.738620 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 21:06:31.738620 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 21:06:31.738620 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 21:06:31.738620 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 21:06:31.738620 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 21:06:31.738620 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 21:06:31.738620 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 524c2c11-4a65-4360-93e4-e25349cb6416 could not be found. Oct 22 21:06:31.738620 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:06:31.738620 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:06:31.738620 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:06:31.738620 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:06:31.738620 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:06:31.738620 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:06:31.738620 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:06:31.738620 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:06:31.738620 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:06:31.738620 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:06:31.738620 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 22 21:06:31.738620 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 22 21:06:31.738620 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 22 21:06:31.738620 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 22 21:06:31.738620 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 21:06:31.738620 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 21:06:31.738620 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 21:06:31.738620 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:06:31.738620 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 524c2c11-4a65-4360-93e4-e25349cb6416 could not be found. Oct 22 21:06:31.742815 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:06:31.742815 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:06:31.742815 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:06:31.742815 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:06:31.742815 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:06:31.742815 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:06:31.742815 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:06:31.742815 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:06:31.742815 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 524c2c11-4a65-4360-93e4-e25349cb6416 could not be found. Oct 22 21:06:31.742815 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:06:31.742815 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-faa1edf4-ca25-446e-ba28-c8afebbdef3a tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Returning 404 to user: Instance 524c2c11-4a65-4360-93e4-e25349cb6416 could not be found. {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:06:31.742815 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-faa1edf4-ca25-446e-ba28-c8afebbdef3a tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] 10.222.0.18 "DELETE /compute/v2.1/servers/524c2c11-4a65-4360-93e4-e25349cb6416" status: 404 len: 111 microversion: 2.1 time: 0.046124 Oct 22 21:06:31.742815 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1817/3662] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 21:06:31 2022] DELETE /compute/v2.1/servers/524c2c11-4a65-4360-93e4-e25349cb6416 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 21:06:31.750101 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-4cf10675-a195-4217-a44c-7c9a07322a20 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:31.751059 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-4cf10675-a195-4217-a44c-7c9a07322a20 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] [instance: 524c2c11-4a65-4360-93e4-e25349cb6416] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:06:31.760977 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4cf10675-a195-4217-a44c-7c9a07322a20 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:31.761849 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4cf10675-a195-4217-a44c-7c9a07322a20 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:31.762490 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4cf10675-a195-4217-a44c-7c9a07322a20 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:31.763483 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4cf10675-a195-4217-a44c-7c9a07322a20 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:31.764210 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4cf10675-a195-4217-a44c-7c9a07322a20 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:31.764842 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4cf10675-a195-4217-a44c-7c9a07322a20 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:31.789972 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-4cf10675-a195-4217-a44c-7c9a07322a20 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] HTTP exception thrown: Instance 524c2c11-4a65-4360-93e4-e25349cb6416 could not be found. Oct 22 21:06:31.792042 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-4cf10675-a195-4217-a44c-7c9a07322a20 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Request method failure captured: Oct 22 21:06:31.792042 ncdv-master-1 devstack@n-api.service[138744]: request: GET /compute/v2.1/servers/524c2c11-4a65-4360-93e4-e25349cb6416 HTTP/1.1 Oct 22 21:06:31.792042 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 21:06:31.792042 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 21:06:31.792042 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 21:06:31.792042 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 0 Oct 22 21:06:31.792042 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 21:06:31.792042 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 21:06:31.792042 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 21:06:31.792042 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 21:06:31.792042 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVFng3hwvwMj6qrKBKP-NtPsacHNJudvI6PbLTlDqKVlCNAf4Mqq0nvy7Chi-hCExXK3RI9ZbTr7OISCYx9SEUXfBLJqVoAZKtsaVbmoggH2NuFL9WL2K0RSTEHzGZGsrQHqgFF8j5Iii8ybpULxjQ0-J_wT0C7d5Pfa14Sa-3-zfpKo Oct 22 21:06:31.792042 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 21:06:31.792042 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 21:06:31.792042 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 21:06:31.792042 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 21:06:31.792042 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 21:06:31.792042 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 21:06:31.792042 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: 66a26a2284f4424cbeaf63d504652546 Oct 22 21:06:31.792042 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-ImagesTestJSON-2101376766 Oct 22 21:06:31.792042 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 21:06:31.792042 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 21:06:31.792042 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_66a26a2284f4424cbeaf63d504652546"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/66a26a2284f4424cbeaf63d504652546"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/66a26a2284f4424cbeaf63d504652546"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/66a26a2284f4424cbeaf63d504652546"}]}] Oct 22 21:06:31.792042 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-ImagesTestJSON-2101376766 Oct 22 21:06:31.792042 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: 66a26a2284f4424cbeaf63d504652546 Oct 22 21:06:31.792042 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-ImagesTestJSON-2101376766 Oct 22 21:06:31.792042 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-ImagesTestJSON-2101376766-project Oct 22 21:06:31.792042 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 21:06:31.792042 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 21:06:31.792042 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: f0a44ff8e7c14b94b1670f030085c43d Oct 22 21:06:31.792042 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-ImagesTestJSON-2101376766-project Oct 22 21:06:31.792042 ncdv-master-1 devstack@n-api.service[138744]: method: > Oct 22 21:06:31.792042 ncdv-master-1 devstack@n-api.service[138744]: exception: Instance 524c2c11-4a65-4360-93e4-e25349cb6416 could not be found. Oct 22 21:06:31.792042 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': '524c2c11-4a65-4360-93e4-e25349cb6416'} Oct 22 21:06:31.792042 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:06:31.792042 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:06:31.792042 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 21:06:31.792042 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 21:06:31.792042 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 21:06:31.792042 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 21:06:31.792042 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 21:06:31.792042 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 21:06:31.792042 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 21:06:31.792042 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 21:06:31.792042 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 524c2c11-4a65-4360-93e4-e25349cb6416 could not be found. Oct 22 21:06:31.792042 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:06:31.792042 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:06:31.792042 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:06:31.792042 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:06:31.792042 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:06:31.792042 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:06:31.792042 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:06:31.792042 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:06:31.792042 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:06:31.792042 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:06:31.792042 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 21:06:31.792042 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 21:06:31.792042 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 21:06:31.792042 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 21:06:31.792042 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 21:06:31.792042 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:06:31.792042 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 524c2c11-4a65-4360-93e4-e25349cb6416 could not be found. Oct 22 21:06:31.792042 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:06:31.792042 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:06:31.792042 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:06:31.792042 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:06:31.795492 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:06:31.795492 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:06:31.795492 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:06:31.795492 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:06:31.795492 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 524c2c11-4a65-4360-93e4-e25349cb6416 could not be found. Oct 22 21:06:31.795492 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:06:31.797326 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-4cf10675-a195-4217-a44c-7c9a07322a20 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Returning 404 to user: Instance 524c2c11-4a65-4360-93e4-e25349cb6416 could not be found. {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:06:31.798636 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-4cf10675-a195-4217-a44c-7c9a07322a20 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] 10.222.0.18 "GET /compute/v2.1/servers/524c2c11-4a65-4360-93e4-e25349cb6416" status: 404 len: 111 microversion: 2.1 time: 0.052893 Oct 22 21:06:31.800141 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1818/3663] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:06:31 2022] GET /compute/v2.1/servers/524c2c11-4a65-4360-93e4-e25349cb6416 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 22 21:06:31.809943 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-4dd60bfc-8c5f-4b12-a8f7-7d92aebb3803 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Calling method '.version_select at 0x7fd39ee89af0>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:31.833095 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-4dd60bfc-8c5f-4b12-a8f7-7d92aebb3803 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] HTTP exception thrown: Image not found. Oct 22 21:06:31.834901 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-4dd60bfc-8c5f-4b12-a8f7-7d92aebb3803 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Request method failure captured: Oct 22 21:06:31.834901 ncdv-master-1 devstack@n-api.service[138744]: request: DELETE /compute/v2.1/images/d25d21a0-06e4-472c-b2a0-81a203d39ec0 HTTP/1.1 Oct 22 21:06:31.834901 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 21:06:31.834901 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 21:06:31.834901 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 21:06:31.834901 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 0 Oct 22 21:06:31.834901 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 21:06:31.834901 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 21:06:31.834901 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 21:06:31.834901 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 21:06:31.834901 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVFng3hwvwMj6qrKBKP-NtPsacHNJudvI6PbLTlDqKVlCNAf4Mqq0nvy7Chi-hCExXK3RI9ZbTr7OISCYx9SEUXfBLJqVoAZKtsaVbmoggH2NuFL9WL2K0RSTEHzGZGsrQHqgFF8j5Iii8ybpULxjQ0-J_wT0C7d5Pfa14Sa-3-zfpKo Oct 22 21:06:31.834901 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 21:06:31.834901 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 21:06:31.834901 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 21:06:31.834901 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 21:06:31.834901 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 21:06:31.834901 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 21:06:31.834901 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: 66a26a2284f4424cbeaf63d504652546 Oct 22 21:06:31.834901 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-ImagesTestJSON-2101376766 Oct 22 21:06:31.834901 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 21:06:31.834901 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 21:06:31.834901 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_66a26a2284f4424cbeaf63d504652546"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/66a26a2284f4424cbeaf63d504652546"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/66a26a2284f4424cbeaf63d504652546"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/66a26a2284f4424cbeaf63d504652546"}]}] Oct 22 21:06:31.834901 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-ImagesTestJSON-2101376766 Oct 22 21:06:31.834901 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: 66a26a2284f4424cbeaf63d504652546 Oct 22 21:06:31.834901 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-ImagesTestJSON-2101376766 Oct 22 21:06:31.834901 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-ImagesTestJSON-2101376766-project Oct 22 21:06:31.834901 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 21:06:31.834901 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 21:06:31.834901 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: f0a44ff8e7c14b94b1670f030085c43d Oct 22 21:06:31.834901 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-ImagesTestJSON-2101376766-project Oct 22 21:06:31.834901 ncdv-master-1 devstack@n-api.service[138744]: method: Oct 22 21:06:31.834901 ncdv-master-1 devstack@n-api.service[138744]: exception: Image not found. Oct 22 21:06:31.834901 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': 'd25d21a0-06e4-472c-b2a0-81a203d39ec0'} Oct 22 21:06:31.834901 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:06:31.834901 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:06:31.834901 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 22 21:06:31.834901 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 22 21:06:31.834901 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 22 21:06:31.834901 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 22 21:06:31.834901 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 22 21:06:31.834901 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 22 21:06:31.834901 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 22 21:06:31.834901 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 22 21:06:31.834901 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 22 21:06:31.834901 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 22 21:06:31.834901 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 22 21:06:31.834901 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 22 21:06:31.834901 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 22 21:06:31.834901 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 22 21:06:31.834901 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image d25d21a0-06e4-472c-b2a0-81a203d39ec0 to delete Oct 22 21:06:31.834901 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:06:31.834901 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:06:31.834901 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:06:31.834901 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:06:31.834901 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 22 21:06:31.834901 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 22 21:06:31.834901 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 22 21:06:31.834901 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 22 21:06:31.834901 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 22 21:06:31.834901 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 22 21:06:31.834901 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image d25d21a0-06e4-472c-b2a0-81a203d39ec0 could not be found. Oct 22 21:06:31.834901 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:06:31.834901 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:06:31.834901 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:06:31.834901 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:06:31.840456 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:06:31.840456 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:06:31.840456 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:06:31.840456 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:06:31.840456 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 22 21:06:31.840456 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 22 21:06:31.840456 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:06:31.840456 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:06:31.840456 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 22 21:06:31.840456 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 22 21:06:31.840456 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 22 21:06:31.840456 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:06:31.840456 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:06:31.840456 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:06:31.840456 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:06:31.840456 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:06:31.840456 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:06:31.840456 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:06:31.840456 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:06:31.840456 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 22 21:06:31.840456 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:06:31.840456 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-4dd60bfc-8c5f-4b12-a8f7-7d92aebb3803 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Returning 404 to user: Image not found. {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:06:31.840456 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-4dd60bfc-8c5f-4b12-a8f7-7d92aebb3803 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] 10.222.0.18 "DELETE /compute/v2.1/images/d25d21a0-06e4-472c-b2a0-81a203d39ec0" status: 404 len: 62 microversion: 2.1 time: 0.032431 Oct 22 21:06:31.840456 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1819/3664] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:06:31 2022] DELETE /compute/v2.1/images/d25d21a0-06e4-472c-b2a0-81a203d39ec0 => generated 62 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 22 21:06:31.852188 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-c2b379c6-94f2-4c5f-b2d6-2da16d8f6420 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:31.852787 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-c2b379c6-94f2-4c5f-b2d6-2da16d8f6420 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] [instance: 9c2729a5-e874-43e7-a372-514906975851] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:06:31.860390 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c2b379c6-94f2-4c5f-b2d6-2da16d8f6420 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:31.861111 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c2b379c6-94f2-4c5f-b2d6-2da16d8f6420 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:31.861630 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c2b379c6-94f2-4c5f-b2d6-2da16d8f6420 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:31.862432 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c2b379c6-94f2-4c5f-b2d6-2da16d8f6420 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:31.863084 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c2b379c6-94f2-4c5f-b2d6-2da16d8f6420 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:31.863628 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c2b379c6-94f2-4c5f-b2d6-2da16d8f6420 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:31.883940 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-c2b379c6-94f2-4c5f-b2d6-2da16d8f6420 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] HTTP exception thrown: Instance 9c2729a5-e874-43e7-a372-514906975851 could not be found. Oct 22 21:06:31.887307 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-c2b379c6-94f2-4c5f-b2d6-2da16d8f6420 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Request method failure captured: Oct 22 21:06:31.887307 ncdv-master-1 devstack@n-api.service[138744]: request: DELETE /compute/v2.1/servers/9c2729a5-e874-43e7-a372-514906975851 HTTP/1.1 Oct 22 21:06:31.887307 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 21:06:31.887307 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 21:06:31.887307 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 21:06:31.887307 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 0 Oct 22 21:06:31.887307 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 21:06:31.887307 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 21:06:31.887307 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 21:06:31.887307 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 21:06:31.887307 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVFng3hwvwMj6qrKBKP-NtPsacHNJudvI6PbLTlDqKVlCNAf4Mqq0nvy7Chi-hCExXK3RI9ZbTr7OISCYx9SEUXfBLJqVoAZKtsaVbmoggH2NuFL9WL2K0RSTEHzGZGsrQHqgFF8j5Iii8ybpULxjQ0-J_wT0C7d5Pfa14Sa-3-zfpKo Oct 22 21:06:31.887307 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 21:06:31.887307 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 21:06:31.887307 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 21:06:31.887307 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 21:06:31.887307 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 21:06:31.887307 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 21:06:31.887307 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: 66a26a2284f4424cbeaf63d504652546 Oct 22 21:06:31.887307 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-ImagesTestJSON-2101376766 Oct 22 21:06:31.887307 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 21:06:31.887307 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 21:06:31.887307 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_66a26a2284f4424cbeaf63d504652546"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/66a26a2284f4424cbeaf63d504652546"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/66a26a2284f4424cbeaf63d504652546"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/66a26a2284f4424cbeaf63d504652546"}]}] Oct 22 21:06:31.887307 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-ImagesTestJSON-2101376766 Oct 22 21:06:31.887307 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: 66a26a2284f4424cbeaf63d504652546 Oct 22 21:06:31.887307 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-ImagesTestJSON-2101376766 Oct 22 21:06:31.887307 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-ImagesTestJSON-2101376766-project Oct 22 21:06:31.887307 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 21:06:31.887307 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 21:06:31.887307 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: f0a44ff8e7c14b94b1670f030085c43d Oct 22 21:06:31.887307 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-ImagesTestJSON-2101376766-project Oct 22 21:06:31.887307 ncdv-master-1 devstack@n-api.service[138744]: method: > Oct 22 21:06:31.887307 ncdv-master-1 devstack@n-api.service[138744]: exception: Instance 9c2729a5-e874-43e7-a372-514906975851 could not be found. Oct 22 21:06:31.887307 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': '9c2729a5-e874-43e7-a372-514906975851'} Oct 22 21:06:31.887307 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:06:31.887307 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:06:31.887307 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 21:06:31.887307 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 21:06:31.887307 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 21:06:31.887307 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 21:06:31.887307 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 21:06:31.887307 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 21:06:31.887307 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 21:06:31.887307 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 21:06:31.887307 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c2729a5-e874-43e7-a372-514906975851 could not be found. Oct 22 21:06:31.887307 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:06:31.887307 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:06:31.887307 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:06:31.887307 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:06:31.887307 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:06:31.887307 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:06:31.887307 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:06:31.887307 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:06:31.887307 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:06:31.887307 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:06:31.887307 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 22 21:06:31.887307 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 22 21:06:31.887307 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 22 21:06:31.887307 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 22 21:06:31.887307 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 21:06:31.887307 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 21:06:31.887307 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 21:06:31.887307 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:06:31.887307 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c2729a5-e874-43e7-a372-514906975851 could not be found. Oct 22 21:06:31.890844 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:06:31.890844 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:06:31.890844 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:06:31.890844 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:06:31.890844 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:06:31.890844 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:06:31.890844 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:06:31.890844 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:06:31.890844 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c2729a5-e874-43e7-a372-514906975851 could not be found. Oct 22 21:06:31.890844 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:06:31.890844 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-c2b379c6-94f2-4c5f-b2d6-2da16d8f6420 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Returning 404 to user: Instance 9c2729a5-e874-43e7-a372-514906975851 could not be found. {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:06:31.893072 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-c2b379c6-94f2-4c5f-b2d6-2da16d8f6420 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] 10.222.0.18 "DELETE /compute/v2.1/servers/9c2729a5-e874-43e7-a372-514906975851" status: 404 len: 111 microversion: 2.1 time: 0.048697 Oct 22 21:06:31.894516 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1820/3665] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 21:06:31 2022] DELETE /compute/v2.1/servers/9c2729a5-e874-43e7-a372-514906975851 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 21:06:31.900701 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-1c752a9e-72fd-497a-9e5a-d3e686f4eaf0 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:31.901509 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-1c752a9e-72fd-497a-9e5a-d3e686f4eaf0 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] [instance: 87b07efc-fa80-40ad-8077-333547ee7301] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:06:31.908438 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1c752a9e-72fd-497a-9e5a-d3e686f4eaf0 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:31.908977 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1c752a9e-72fd-497a-9e5a-d3e686f4eaf0 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:31.909477 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1c752a9e-72fd-497a-9e5a-d3e686f4eaf0 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:31.910558 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1c752a9e-72fd-497a-9e5a-d3e686f4eaf0 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:31.911328 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1c752a9e-72fd-497a-9e5a-d3e686f4eaf0 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:31.912161 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1c752a9e-72fd-497a-9e5a-d3e686f4eaf0 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:31.931607 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-1c752a9e-72fd-497a-9e5a-d3e686f4eaf0 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] HTTP exception thrown: Instance 87b07efc-fa80-40ad-8077-333547ee7301 could not be found. Oct 22 21:06:31.933456 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-1c752a9e-72fd-497a-9e5a-d3e686f4eaf0 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Request method failure captured: Oct 22 21:06:31.933456 ncdv-master-1 devstack@n-api.service[138744]: request: GET /compute/v2.1/servers/87b07efc-fa80-40ad-8077-333547ee7301 HTTP/1.1 Oct 22 21:06:31.933456 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 21:06:31.933456 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 21:06:31.933456 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 21:06:31.933456 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 0 Oct 22 21:06:31.933456 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 21:06:31.933456 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 21:06:31.933456 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 21:06:31.933456 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 21:06:31.933456 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVFqx_9-VvpsFGnkexMjdtUkafNppeKBePbITA5VpFRE9bI_4rajpdkpz74Cwdg9A1Rgg09iXej3F9cOvEML2VtUqB5QnXNdVA3eusDsChduLaQJCAn3h7XnZkaspwcHRirleWzU8FOBCrXX8rGF2fSl5O4LYaoDdzy0kgx3lK4c0ALk Oct 22 21:06:31.933456 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 21:06:31.933456 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 21:06:31.933456 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 21:06:31.933456 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 21:06:31.933456 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 21:06:31.933456 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 21:06:31.933456 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: b54f56cfbc814cccb533c65966f35a93 Oct 22 21:06:31.933456 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-ServerRescueTestJSON-1453097790 Oct 22 21:06:31.933456 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 21:06:31.933456 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 21:06:31.933456 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_b54f56cfbc814cccb533c65966f35a93"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b54f56cfbc814cccb533c65966f35a93"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/b54f56cfbc814cccb533c65966f35a93"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b54f56cfbc814cccb533c65966f35a93"}]}] Oct 22 21:06:31.933456 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-ServerRescueTestJSON-1453097790 Oct 22 21:06:31.933456 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: b54f56cfbc814cccb533c65966f35a93 Oct 22 21:06:31.933456 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-ServerRescueTestJSON-1453097790 Oct 22 21:06:31.933456 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-ServerRescueTestJSON-1453097790-project Oct 22 21:06:31.933456 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 21:06:31.933456 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 21:06:31.933456 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: 879c85830a9f42088a4ebdf1e3cfb39b Oct 22 21:06:31.933456 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-ServerRescueTestJSON-1453097790-project Oct 22 21:06:31.933456 ncdv-master-1 devstack@n-api.service[138744]: method: > Oct 22 21:06:31.933456 ncdv-master-1 devstack@n-api.service[138744]: exception: Instance 87b07efc-fa80-40ad-8077-333547ee7301 could not be found. Oct 22 21:06:31.933456 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': '87b07efc-fa80-40ad-8077-333547ee7301'} Oct 22 21:06:31.933456 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:06:31.933456 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:06:31.933456 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 21:06:31.933456 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 21:06:31.933456 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 21:06:31.933456 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 21:06:31.933456 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 21:06:31.933456 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 21:06:31.933456 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 21:06:31.933456 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 21:06:31.933456 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 87b07efc-fa80-40ad-8077-333547ee7301 could not be found. Oct 22 21:06:31.933456 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:06:31.933456 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:06:31.933456 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:06:31.933456 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:06:31.933456 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:06:31.933456 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:06:31.933456 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:06:31.933456 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:06:31.933456 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:06:31.933456 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:06:31.933456 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 21:06:31.933456 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 21:06:31.933456 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 21:06:31.933456 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 21:06:31.933456 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 21:06:31.933456 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:06:31.933456 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87b07efc-fa80-40ad-8077-333547ee7301 could not be found. Oct 22 21:06:31.933456 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:06:31.933456 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:06:31.933456 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:06:31.937802 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:06:31.937802 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:06:31.937802 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:06:31.937802 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:06:31.937802 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:06:31.937802 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87b07efc-fa80-40ad-8077-333547ee7301 could not be found. Oct 22 21:06:31.937802 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:06:31.937802 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-1c752a9e-72fd-497a-9e5a-d3e686f4eaf0 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] Returning 404 to user: Instance 87b07efc-fa80-40ad-8077-333547ee7301 could not be found. {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:06:31.938718 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-1c752a9e-72fd-497a-9e5a-d3e686f4eaf0 tempest-ServerRescueTestJSON-1453097790 tempest-ServerRescueTestJSON-1453097790-project] 10.222.0.18 "GET /compute/v2.1/servers/87b07efc-fa80-40ad-8077-333547ee7301" status: 404 len: 111 microversion: 2.1 time: 0.042154 Oct 22 21:06:31.943504 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1821/3666] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:06:31 2022] GET /compute/v2.1/servers/87b07efc-fa80-40ad-8077-333547ee7301 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 21:06:31.950216 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-6aa8875f-080a-4683-b660-deb7b15838bc tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:31.951050 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-6aa8875f-080a-4683-b660-deb7b15838bc tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] [instance: 9c2729a5-e874-43e7-a372-514906975851] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:06:31.958904 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6aa8875f-080a-4683-b660-deb7b15838bc tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:31.959571 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6aa8875f-080a-4683-b660-deb7b15838bc tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:31.960137 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6aa8875f-080a-4683-b660-deb7b15838bc tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:31.961182 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6aa8875f-080a-4683-b660-deb7b15838bc tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:31.961740 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6aa8875f-080a-4683-b660-deb7b15838bc tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:31.962244 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6aa8875f-080a-4683-b660-deb7b15838bc tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:31.979030 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-6aa8875f-080a-4683-b660-deb7b15838bc tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] HTTP exception thrown: Instance 9c2729a5-e874-43e7-a372-514906975851 could not be found. Oct 22 21:06:31.980873 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-6aa8875f-080a-4683-b660-deb7b15838bc tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Request method failure captured: Oct 22 21:06:31.980873 ncdv-master-1 devstack@n-api.service[138744]: request: GET /compute/v2.1/servers/9c2729a5-e874-43e7-a372-514906975851 HTTP/1.1 Oct 22 21:06:31.980873 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 21:06:31.980873 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 21:06:31.980873 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 21:06:31.980873 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 0 Oct 22 21:06:31.980873 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 21:06:31.980873 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 21:06:31.980873 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 21:06:31.980873 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 21:06:31.980873 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVFng3hwvwMj6qrKBKP-NtPsacHNJudvI6PbLTlDqKVlCNAf4Mqq0nvy7Chi-hCExXK3RI9ZbTr7OISCYx9SEUXfBLJqVoAZKtsaVbmoggH2NuFL9WL2K0RSTEHzGZGsrQHqgFF8j5Iii8ybpULxjQ0-J_wT0C7d5Pfa14Sa-3-zfpKo Oct 22 21:06:31.980873 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 21:06:31.980873 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 21:06:31.980873 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 21:06:31.980873 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 21:06:31.980873 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 21:06:31.980873 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 21:06:31.980873 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: 66a26a2284f4424cbeaf63d504652546 Oct 22 21:06:31.980873 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-ImagesTestJSON-2101376766 Oct 22 21:06:31.980873 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 21:06:31.980873 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 21:06:31.980873 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_66a26a2284f4424cbeaf63d504652546"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/66a26a2284f4424cbeaf63d504652546"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/66a26a2284f4424cbeaf63d504652546"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/66a26a2284f4424cbeaf63d504652546"}]}] Oct 22 21:06:31.980873 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-ImagesTestJSON-2101376766 Oct 22 21:06:31.980873 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: 66a26a2284f4424cbeaf63d504652546 Oct 22 21:06:31.980873 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-ImagesTestJSON-2101376766 Oct 22 21:06:31.980873 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-ImagesTestJSON-2101376766-project Oct 22 21:06:31.980873 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 21:06:31.980873 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 21:06:31.980873 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: f0a44ff8e7c14b94b1670f030085c43d Oct 22 21:06:31.980873 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-ImagesTestJSON-2101376766-project Oct 22 21:06:31.980873 ncdv-master-1 devstack@n-api.service[138744]: method: > Oct 22 21:06:31.980873 ncdv-master-1 devstack@n-api.service[138744]: exception: Instance 9c2729a5-e874-43e7-a372-514906975851 could not be found. Oct 22 21:06:31.980873 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': '9c2729a5-e874-43e7-a372-514906975851'} Oct 22 21:06:31.980873 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:06:31.980873 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:06:31.980873 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 21:06:31.980873 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 21:06:31.980873 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 21:06:31.980873 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 21:06:31.980873 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 21:06:31.980873 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 21:06:31.980873 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 21:06:31.980873 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 21:06:31.980873 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c2729a5-e874-43e7-a372-514906975851 could not be found. Oct 22 21:06:31.980873 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:06:31.980873 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:06:31.980873 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:06:31.980873 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:06:31.980873 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:06:31.980873 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:06:31.980873 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:06:31.980873 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:06:31.980873 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:06:31.980873 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:06:31.980873 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 21:06:31.980873 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 21:06:31.980873 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 21:06:31.980873 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 21:06:31.980873 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 21:06:31.980873 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:06:31.980873 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c2729a5-e874-43e7-a372-514906975851 could not be found. Oct 22 21:06:31.980873 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:06:31.980873 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:06:31.980873 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:06:31.980873 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:06:31.988346 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:06:31.988346 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:06:31.988346 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:06:31.988346 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:06:31.988346 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c2729a5-e874-43e7-a372-514906975851 could not be found. Oct 22 21:06:31.988346 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:06:31.988346 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-6aa8875f-080a-4683-b660-deb7b15838bc tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Returning 404 to user: Instance 9c2729a5-e874-43e7-a372-514906975851 could not be found. {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:06:31.988346 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-6aa8875f-080a-4683-b660-deb7b15838bc tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] 10.222.0.18 "GET /compute/v2.1/servers/9c2729a5-e874-43e7-a372-514906975851" status: 404 len: 111 microversion: 2.1 time: 0.037621 Oct 22 21:06:31.988346 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1822/3667] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:06:31 2022] GET /compute/v2.1/servers/9c2729a5-e874-43e7-a372-514906975851 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 21:06:31.990830 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-fbf33cf8-554e-41c2-b0b0-7b3d612387e1 req-15efe2b0-6c9a-4eeb-a102-b5137efb9c04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a26fa9bd-fad2-40a2-910e-2208fb769dcb", "name": "network-vif-deleted", "tag": "d2dc36e2-25aa-4eae-ac3a-801900c71b45"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:06:32.003495 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-fbf33cf8-554e-41c2-b0b0-7b3d612387e1 req-15efe2b0-6c9a-4eeb-a102-b5137efb9c04 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:32.005400 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-fbf33cf8-554e-41c2-b0b0-7b3d612387e1 req-15efe2b0-6c9a-4eeb-a102-b5137efb9c04 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:32.006119 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-fbf33cf8-554e-41c2-b0b0-7b3d612387e1 req-15efe2b0-6c9a-4eeb-a102-b5137efb9c04 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:32.022845 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-fbf33cf8-554e-41c2-b0b0-7b3d612387e1 req-15efe2b0-6c9a-4eeb-a102-b5137efb9c04 service nova] Creating event network-vif-deleted:d2dc36e2-25aa-4eae-ac3a-801900c71b45 for instance a26fa9bd-fad2-40a2-910e-2208fb769dcb on nch1-master-1 Oct 22 21:06:32.033836 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-fbf33cf8-554e-41c2-b0b0-7b3d612387e1 req-15efe2b0-6c9a-4eeb-a102-b5137efb9c04 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049706 Oct 22 21:06:32.034915 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1823/3668] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:06:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:06:32.041065 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-6b0dd188-ca99-4d36-b963-322fed4f5596 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Calling method '.version_select at 0x7fd39eef0ee0>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:32.074654 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-6b0dd188-ca99-4d36-b963-322fed4f5596 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] HTTP exception thrown: Image not found. Oct 22 21:06:32.077965 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-6b0dd188-ca99-4d36-b963-322fed4f5596 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Request method failure captured: Oct 22 21:06:32.077965 ncdv-master-1 devstack@n-api.service[138744]: request: DELETE /compute/v2.1/images/45d0a13c-b73b-4f91-b353-a22f0963a598 HTTP/1.1 Oct 22 21:06:32.077965 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 21:06:32.077965 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 21:06:32.077965 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 21:06:32.077965 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 0 Oct 22 21:06:32.077965 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 21:06:32.077965 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 21:06:32.077965 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 21:06:32.077965 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 21:06:32.077965 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVFng3hwvwMj6qrKBKP-NtPsacHNJudvI6PbLTlDqKVlCNAf4Mqq0nvy7Chi-hCExXK3RI9ZbTr7OISCYx9SEUXfBLJqVoAZKtsaVbmoggH2NuFL9WL2K0RSTEHzGZGsrQHqgFF8j5Iii8ybpULxjQ0-J_wT0C7d5Pfa14Sa-3-zfpKo Oct 22 21:06:32.077965 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 21:06:32.077965 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 21:06:32.077965 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 21:06:32.077965 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 21:06:32.077965 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 21:06:32.077965 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 21:06:32.077965 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: 66a26a2284f4424cbeaf63d504652546 Oct 22 21:06:32.077965 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-ImagesTestJSON-2101376766 Oct 22 21:06:32.077965 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 21:06:32.077965 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 21:06:32.077965 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_66a26a2284f4424cbeaf63d504652546"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/66a26a2284f4424cbeaf63d504652546"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/66a26a2284f4424cbeaf63d504652546"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/66a26a2284f4424cbeaf63d504652546"}]}] Oct 22 21:06:32.077965 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-ImagesTestJSON-2101376766 Oct 22 21:06:32.077965 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: 66a26a2284f4424cbeaf63d504652546 Oct 22 21:06:32.077965 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-ImagesTestJSON-2101376766 Oct 22 21:06:32.077965 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-ImagesTestJSON-2101376766-project Oct 22 21:06:32.077965 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 21:06:32.077965 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 21:06:32.077965 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: f0a44ff8e7c14b94b1670f030085c43d Oct 22 21:06:32.077965 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-ImagesTestJSON-2101376766-project Oct 22 21:06:32.077965 ncdv-master-1 devstack@n-api.service[138744]: method: Oct 22 21:06:32.077965 ncdv-master-1 devstack@n-api.service[138744]: exception: Image not found. Oct 22 21:06:32.077965 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': '45d0a13c-b73b-4f91-b353-a22f0963a598'} Oct 22 21:06:32.077965 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:06:32.077965 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:06:32.077965 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 22 21:06:32.077965 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 22 21:06:32.077965 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 22 21:06:32.077965 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 22 21:06:32.077965 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 22 21:06:32.077965 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 22 21:06:32.077965 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 22 21:06:32.077965 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 22 21:06:32.077965 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 22 21:06:32.077965 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 22 21:06:32.077965 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 22 21:06:32.077965 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 22 21:06:32.077965 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 22 21:06:32.077965 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 22 21:06:32.077965 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 45d0a13c-b73b-4f91-b353-a22f0963a598 to delete Oct 22 21:06:32.077965 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:06:32.077965 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:06:32.077965 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:06:32.077965 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:06:32.077965 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 22 21:06:32.077965 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 22 21:06:32.077965 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 22 21:06:32.077965 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 22 21:06:32.077965 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 22 21:06:32.077965 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 22 21:06:32.077965 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 45d0a13c-b73b-4f91-b353-a22f0963a598 could not be found. Oct 22 21:06:32.077965 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:06:32.077965 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:06:32.077965 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:06:32.077965 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:06:32.082525 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:06:32.082525 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:06:32.082525 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:06:32.082525 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:06:32.082525 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 22 21:06:32.082525 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 22 21:06:32.082525 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:06:32.082525 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:06:32.082525 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 22 21:06:32.082525 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 22 21:06:32.082525 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 22 21:06:32.082525 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:06:32.082525 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:06:32.082525 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:06:32.082525 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:06:32.082525 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:06:32.082525 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:06:32.082525 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:06:32.082525 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:06:32.082525 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 22 21:06:32.082525 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:06:32.085195 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-4966f3b4-8291-44e6-afd8-f73ef280a427 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3820b31a424c3a9216a6ef91fcb285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a42c3ecf474883ac652fcc8c01c9f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:06:32.085722 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-6b0dd188-ca99-4d36-b963-322fed4f5596 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Returning 404 to user: Image not found. {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:06:32.085722 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-6b0dd188-ca99-4d36-b963-322fed4f5596 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] 10.222.0.18 "DELETE /compute/v2.1/images/45d0a13c-b73b-4f91-b353-a22f0963a598" status: 404 len: 62 microversion: 2.1 time: 0.043187 Oct 22 21:06:32.085722 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1824/3669] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:06:32 2022] DELETE /compute/v2.1/images/45d0a13c-b73b-4f91-b353-a22f0963a598 => generated 62 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 22 21:06:32.089028 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-4966f3b4-8291-44e6-afd8-f73ef280a427 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] 10.222.0.18 "GET /compute/v2.1/servers/64318452-365b-4b80-b53b-9367dd8bc826" status: 200 len: 1564 microversion: 2.1 time: 0.603338 Oct 22 21:06:32.089909 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1846/3670] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:06:31 2022] GET /compute/v2.1/servers/64318452-365b-4b80-b53b-9367dd8bc826 => generated 1564 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:06:32.092615 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-d8a2df8f-2b5b-4ee7-ad4e-899600b9943b tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:32.093570 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-d8a2df8f-2b5b-4ee7-ad4e-899600b9943b tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] [instance: af11a208-be6e-4f70-85f0-4bafafb4febd] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:06:32.102824 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d8a2df8f-2b5b-4ee7-ad4e-899600b9943b tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:32.103732 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d8a2df8f-2b5b-4ee7-ad4e-899600b9943b tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:32.104486 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d8a2df8f-2b5b-4ee7-ad4e-899600b9943b tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:32.105385 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d8a2df8f-2b5b-4ee7-ad4e-899600b9943b tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:32.106010 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d8a2df8f-2b5b-4ee7-ad4e-899600b9943b tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:32.107242 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d8a2df8f-2b5b-4ee7-ad4e-899600b9943b tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:32.114986 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-9303e5cc-75cb-4c94-b546-5b0ddb0acd8a tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:32.115577 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-9303e5cc-75cb-4c94-b546-5b0ddb0acd8a tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] [instance: 64318452-365b-4b80-b53b-9367dd8bc826] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:06:32.123513 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9303e5cc-75cb-4c94-b546-5b0ddb0acd8a tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:32.124037 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9303e5cc-75cb-4c94-b546-5b0ddb0acd8a tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:32.124503 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9303e5cc-75cb-4c94-b546-5b0ddb0acd8a tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:32.125247 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9303e5cc-75cb-4c94-b546-5b0ddb0acd8a tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:32.125726 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9303e5cc-75cb-4c94-b546-5b0ddb0acd8a tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:32.126306 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9303e5cc-75cb-4c94-b546-5b0ddb0acd8a tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:32.127841 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-d8a2df8f-2b5b-4ee7-ad4e-899600b9943b tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] HTTP exception thrown: Instance af11a208-be6e-4f70-85f0-4bafafb4febd could not be found. Oct 22 21:06:32.130039 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-d8a2df8f-2b5b-4ee7-ad4e-899600b9943b tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Request method failure captured: Oct 22 21:06:32.130039 ncdv-master-1 devstack@n-api.service[138744]: request: DELETE /compute/v2.1/servers/af11a208-be6e-4f70-85f0-4bafafb4febd HTTP/1.1 Oct 22 21:06:32.130039 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 21:06:32.130039 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 21:06:32.130039 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 21:06:32.130039 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 0 Oct 22 21:06:32.130039 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 21:06:32.130039 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 21:06:32.130039 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 21:06:32.130039 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 21:06:32.130039 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVFng3hwvwMj6qrKBKP-NtPsacHNJudvI6PbLTlDqKVlCNAf4Mqq0nvy7Chi-hCExXK3RI9ZbTr7OISCYx9SEUXfBLJqVoAZKtsaVbmoggH2NuFL9WL2K0RSTEHzGZGsrQHqgFF8j5Iii8ybpULxjQ0-J_wT0C7d5Pfa14Sa-3-zfpKo Oct 22 21:06:32.130039 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 21:06:32.130039 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 21:06:32.130039 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 21:06:32.130039 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 21:06:32.130039 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 21:06:32.130039 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 21:06:32.130039 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: 66a26a2284f4424cbeaf63d504652546 Oct 22 21:06:32.130039 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-ImagesTestJSON-2101376766 Oct 22 21:06:32.130039 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 21:06:32.130039 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 21:06:32.130039 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_66a26a2284f4424cbeaf63d504652546"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/66a26a2284f4424cbeaf63d504652546"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/66a26a2284f4424cbeaf63d504652546"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/66a26a2284f4424cbeaf63d504652546"}]}] Oct 22 21:06:32.130039 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-ImagesTestJSON-2101376766 Oct 22 21:06:32.130039 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: 66a26a2284f4424cbeaf63d504652546 Oct 22 21:06:32.130039 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-ImagesTestJSON-2101376766 Oct 22 21:06:32.130039 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-ImagesTestJSON-2101376766-project Oct 22 21:06:32.130039 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 21:06:32.130039 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 21:06:32.130039 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: f0a44ff8e7c14b94b1670f030085c43d Oct 22 21:06:32.130039 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-ImagesTestJSON-2101376766-project Oct 22 21:06:32.130039 ncdv-master-1 devstack@n-api.service[138744]: method: > Oct 22 21:06:32.130039 ncdv-master-1 devstack@n-api.service[138744]: exception: Instance af11a208-be6e-4f70-85f0-4bafafb4febd could not be found. Oct 22 21:06:32.130039 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': 'af11a208-be6e-4f70-85f0-4bafafb4febd'} Oct 22 21:06:32.130039 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:06:32.130039 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:06:32.130039 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 21:06:32.130039 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 21:06:32.130039 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 21:06:32.130039 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 21:06:32.130039 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 21:06:32.130039 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 21:06:32.130039 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 21:06:32.130039 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 21:06:32.130039 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af11a208-be6e-4f70-85f0-4bafafb4febd could not be found. Oct 22 21:06:32.130039 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:06:32.130039 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:06:32.130039 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:06:32.130039 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:06:32.130039 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:06:32.130039 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:06:32.130039 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:06:32.130039 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:06:32.130039 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:06:32.130039 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:06:32.130039 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 22 21:06:32.130039 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 22 21:06:32.130039 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 22 21:06:32.130039 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 22 21:06:32.130039 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 21:06:32.130039 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 21:06:32.130039 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 21:06:32.130039 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:06:32.130039 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af11a208-be6e-4f70-85f0-4bafafb4febd could not be found. Oct 22 21:06:32.133918 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:06:32.133918 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:06:32.133918 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:06:32.133918 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:06:32.133918 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:06:32.133918 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:06:32.133918 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:06:32.133918 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:06:32.133918 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af11a208-be6e-4f70-85f0-4bafafb4febd could not be found. Oct 22 21:06:32.133918 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:06:32.134998 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-d8a2df8f-2b5b-4ee7-ad4e-899600b9943b tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Returning 404 to user: Instance af11a208-be6e-4f70-85f0-4bafafb4febd could not be found. {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:06:32.135946 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-d8a2df8f-2b5b-4ee7-ad4e-899600b9943b tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] 10.222.0.18 "DELETE /compute/v2.1/servers/af11a208-be6e-4f70-85f0-4bafafb4febd" status: 404 len: 111 microversion: 2.1 time: 0.049877 Oct 22 21:06:32.137153 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1825/3671] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 21:06:32 2022] DELETE /compute/v2.1/servers/af11a208-be6e-4f70-85f0-4bafafb4febd => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 21:06:32.149991 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-8bd914f0-e835-427e-a544-22ab8d7e94b8 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:32.150619 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-8bd914f0-e835-427e-a544-22ab8d7e94b8 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] [instance: af11a208-be6e-4f70-85f0-4bafafb4febd] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:06:32.158166 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8bd914f0-e835-427e-a544-22ab8d7e94b8 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:32.158660 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8bd914f0-e835-427e-a544-22ab8d7e94b8 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:32.159433 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8bd914f0-e835-427e-a544-22ab8d7e94b8 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:32.160206 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8bd914f0-e835-427e-a544-22ab8d7e94b8 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:32.161187 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8bd914f0-e835-427e-a544-22ab8d7e94b8 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:32.161643 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8bd914f0-e835-427e-a544-22ab8d7e94b8 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:32.179156 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-8bd914f0-e835-427e-a544-22ab8d7e94b8 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] HTTP exception thrown: Instance af11a208-be6e-4f70-85f0-4bafafb4febd could not be found. Oct 22 21:06:32.180787 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-8bd914f0-e835-427e-a544-22ab8d7e94b8 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Request method failure captured: Oct 22 21:06:32.180787 ncdv-master-1 devstack@n-api.service[138744]: request: GET /compute/v2.1/servers/af11a208-be6e-4f70-85f0-4bafafb4febd HTTP/1.1 Oct 22 21:06:32.180787 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 21:06:32.180787 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 21:06:32.180787 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 21:06:32.180787 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 0 Oct 22 21:06:32.180787 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 21:06:32.180787 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 21:06:32.180787 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 21:06:32.180787 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 21:06:32.180787 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVFng3hwvwMj6qrKBKP-NtPsacHNJudvI6PbLTlDqKVlCNAf4Mqq0nvy7Chi-hCExXK3RI9ZbTr7OISCYx9SEUXfBLJqVoAZKtsaVbmoggH2NuFL9WL2K0RSTEHzGZGsrQHqgFF8j5Iii8ybpULxjQ0-J_wT0C7d5Pfa14Sa-3-zfpKo Oct 22 21:06:32.180787 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 21:06:32.180787 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 21:06:32.180787 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 21:06:32.180787 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 21:06:32.180787 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 21:06:32.180787 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 21:06:32.180787 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: 66a26a2284f4424cbeaf63d504652546 Oct 22 21:06:32.180787 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-ImagesTestJSON-2101376766 Oct 22 21:06:32.180787 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 21:06:32.180787 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 21:06:32.180787 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_66a26a2284f4424cbeaf63d504652546"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/66a26a2284f4424cbeaf63d504652546"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/66a26a2284f4424cbeaf63d504652546"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/66a26a2284f4424cbeaf63d504652546"}]}] Oct 22 21:06:32.180787 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-ImagesTestJSON-2101376766 Oct 22 21:06:32.180787 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: 66a26a2284f4424cbeaf63d504652546 Oct 22 21:06:32.180787 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-ImagesTestJSON-2101376766 Oct 22 21:06:32.180787 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-ImagesTestJSON-2101376766-project Oct 22 21:06:32.180787 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 21:06:32.180787 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 21:06:32.180787 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: f0a44ff8e7c14b94b1670f030085c43d Oct 22 21:06:32.180787 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-ImagesTestJSON-2101376766-project Oct 22 21:06:32.180787 ncdv-master-1 devstack@n-api.service[138744]: method: > Oct 22 21:06:32.180787 ncdv-master-1 devstack@n-api.service[138744]: exception: Instance af11a208-be6e-4f70-85f0-4bafafb4febd could not be found. Oct 22 21:06:32.180787 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': 'af11a208-be6e-4f70-85f0-4bafafb4febd'} Oct 22 21:06:32.180787 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:06:32.180787 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:06:32.180787 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 21:06:32.180787 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 21:06:32.180787 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 21:06:32.180787 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 21:06:32.180787 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 21:06:32.180787 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 21:06:32.180787 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 21:06:32.180787 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 21:06:32.180787 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af11a208-be6e-4f70-85f0-4bafafb4febd could not be found. Oct 22 21:06:32.180787 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:06:32.180787 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:06:32.180787 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:06:32.180787 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:06:32.180787 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:06:32.180787 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:06:32.180787 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:06:32.180787 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:06:32.180787 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:06:32.180787 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:06:32.180787 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 21:06:32.180787 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 21:06:32.180787 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 21:06:32.180787 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 21:06:32.180787 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 21:06:32.180787 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:06:32.180787 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af11a208-be6e-4f70-85f0-4bafafb4febd could not be found. Oct 22 21:06:32.180787 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:06:32.180787 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:06:32.180787 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:06:32.180787 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:06:32.185033 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:06:32.185033 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:06:32.185033 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:06:32.185033 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:06:32.185033 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af11a208-be6e-4f70-85f0-4bafafb4febd could not be found. Oct 22 21:06:32.185033 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:06:32.185033 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-8bd914f0-e835-427e-a544-22ab8d7e94b8 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] Returning 404 to user: Instance af11a208-be6e-4f70-85f0-4bafafb4febd could not be found. {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:06:32.185033 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-8bd914f0-e835-427e-a544-22ab8d7e94b8 tempest-ImagesTestJSON-2101376766 tempest-ImagesTestJSON-2101376766-project] 10.222.0.18 "GET /compute/v2.1/servers/af11a208-be6e-4f70-85f0-4bafafb4febd" status: 404 len: 111 microversion: 2.1 time: 0.041197 Oct 22 21:06:32.186502 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1826/3672] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:06:32 2022] GET /compute/v2.1/servers/af11a208-be6e-4f70-85f0-4bafafb4febd => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 21:06:32.343291 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-700e939e-239d-4629-9fff-b38b07e0d2ee tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:32.345906 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-700e939e-239d-4629-9fff-b38b07e0d2ee tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] [instance: e09b7865-0b24-4e50-a66a-342dd2e6e5e3] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:06:32.354486 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-700e939e-239d-4629-9fff-b38b07e0d2ee tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:32.355745 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-700e939e-239d-4629-9fff-b38b07e0d2ee tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:32.356425 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-700e939e-239d-4629-9fff-b38b07e0d2ee tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:32.357382 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-700e939e-239d-4629-9fff-b38b07e0d2ee tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:32.358063 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-700e939e-239d-4629-9fff-b38b07e0d2ee tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:32.358794 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-700e939e-239d-4629-9fff-b38b07e0d2ee tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:32.470020 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-9303e5cc-75cb-4c94-b546-5b0ddb0acd8a tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3820b31a424c3a9216a6ef91fcb285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a42c3ecf474883ac652fcc8c01c9f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:06:32.491979 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-9303e5cc-75cb-4c94-b546-5b0ddb0acd8a tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] 10.222.0.18 "GET /compute/v2.1/servers/64318452-365b-4b80-b53b-9367dd8bc826" status: 200 len: 1564 microversion: 2.1 time: 0.378839 Oct 22 21:06:32.493205 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1847/3673] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:06:32 2022] GET /compute/v2.1/servers/64318452-365b-4b80-b53b-9367dd8bc826 => generated 1564 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:06:32.683635 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-925381c9-5be2-4815-9536-5a6cc3521c83 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:32.684274 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-925381c9-5be2-4815-9536-5a6cc3521c83 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] [instance: 64318452-365b-4b80-b53b-9367dd8bc826] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:06:32.699417 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-925381c9-5be2-4815-9536-5a6cc3521c83 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:32.700793 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-925381c9-5be2-4815-9536-5a6cc3521c83 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:32.702785 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-925381c9-5be2-4815-9536-5a6cc3521c83 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:32.704983 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-925381c9-5be2-4815-9536-5a6cc3521c83 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:32.707670 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-925381c9-5be2-4815-9536-5a6cc3521c83 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:32.710398 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-925381c9-5be2-4815-9536-5a6cc3521c83 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:32.735230 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-700e939e-239d-4629-9fff-b38b07e0d2ee tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcdfeb6c1cda4810b9fa70fdfd9a66c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c774a85b2c41c98486cf91b1253363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:06:32.745527 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-700e939e-239d-4629-9fff-b38b07e0d2ee tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] 10.222.0.18 "GET /compute/v2.1/servers/e09b7865-0b24-4e50-a66a-342dd2e6e5e3" status: 200 len: 1515 microversion: 2.1 time: 0.407004 Oct 22 21:06:32.748494 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1827/3674] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:06:32 2022] GET /compute/v2.1/servers/e09b7865-0b24-4e50-a66a-342dd2e6e5e3 => generated 1515 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:06:32.763261 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell1:SELECT=100 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:06:32.792309 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-925381c9-5be2-4815-9536-5a6cc3521c83 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] [instance: 64318452-365b-4b80-b53b-9367dd8bc826] Going to try to terminate instance {{(pid=138745) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 21:06:32.954539 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-925381c9-5be2-4815-9536-5a6cc3521c83 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] 10.222.0.18 "DELETE /compute/v2.1/servers/64318452-365b-4b80-b53b-9367dd8bc826" status: 204 len: 0 microversion: 2.1 time: 0.276442 Oct 22 21:06:32.956951 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1848/3675] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 21:06:32 2022] DELETE /compute/v2.1/servers/64318452-365b-4b80-b53b-9367dd8bc826 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 21:06:32.965927 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-229cfb77-9917-4b36-a349-4daea0c842cd tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:32.966967 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-229cfb77-9917-4b36-a349-4daea0c842cd tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] [instance: 64318452-365b-4b80-b53b-9367dd8bc826] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:06:32.977735 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-229cfb77-9917-4b36-a349-4daea0c842cd tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:32.978845 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-229cfb77-9917-4b36-a349-4daea0c842cd tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:32.979592 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-229cfb77-9917-4b36-a349-4daea0c842cd tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:32.980529 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-229cfb77-9917-4b36-a349-4daea0c842cd tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:32.980990 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-229cfb77-9917-4b36-a349-4daea0c842cd tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:32.981625 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-229cfb77-9917-4b36-a349-4daea0c842cd tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:33.324622 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-229cfb77-9917-4b36-a349-4daea0c842cd tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3820b31a424c3a9216a6ef91fcb285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a42c3ecf474883ac652fcc8c01c9f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:06:33.336536 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-229cfb77-9917-4b36-a349-4daea0c842cd tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] 10.222.0.18 "GET /compute/v2.1/servers/64318452-365b-4b80-b53b-9367dd8bc826" status: 200 len: 1570 microversion: 2.1 time: 0.375084 Oct 22 21:06:33.337201 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1828/3676] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:06:32 2022] GET /compute/v2.1/servers/64318452-365b-4b80-b53b-9367dd8bc826 => generated 1570 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:06:33.777730 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-8eb9dbf9-a112-40b6-a384-fce0bf44c0b2 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:33.779543 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-8eb9dbf9-a112-40b6-a384-fce0bf44c0b2 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] [instance: e09b7865-0b24-4e50-a66a-342dd2e6e5e3] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:06:33.797148 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8eb9dbf9-a112-40b6-a384-fce0bf44c0b2 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:33.801390 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8eb9dbf9-a112-40b6-a384-fce0bf44c0b2 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:33.802089 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8eb9dbf9-a112-40b6-a384-fce0bf44c0b2 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:33.806047 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8eb9dbf9-a112-40b6-a384-fce0bf44c0b2 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:33.806730 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8eb9dbf9-a112-40b6-a384-fce0bf44c0b2 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:33.807361 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8eb9dbf9-a112-40b6-a384-fce0bf44c0b2 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:34.305182 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-8eb9dbf9-a112-40b6-a384-fce0bf44c0b2 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcdfeb6c1cda4810b9fa70fdfd9a66c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c774a85b2c41c98486cf91b1253363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:06:34.324903 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-8eb9dbf9-a112-40b6-a384-fce0bf44c0b2 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] 10.222.0.18 "GET /compute/v2.1/servers/e09b7865-0b24-4e50-a66a-342dd2e6e5e3" status: 200 len: 1515 microversion: 2.1 time: 0.547972 Oct 22 21:06:34.325913 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1849/3677] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:06:33 2022] GET /compute/v2.1/servers/e09b7865-0b24-4e50-a66a-342dd2e6e5e3 => generated 1515 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:06:34.362215 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-fc6ff215-835a-47a1-887d-07cd6cda6901 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:34.363751 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-fc6ff215-835a-47a1-887d-07cd6cda6901 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] [instance: 64318452-365b-4b80-b53b-9367dd8bc826] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:06:34.371848 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fc6ff215-835a-47a1-887d-07cd6cda6901 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:34.372601 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fc6ff215-835a-47a1-887d-07cd6cda6901 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:34.373193 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fc6ff215-835a-47a1-887d-07cd6cda6901 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:34.374115 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fc6ff215-835a-47a1-887d-07cd6cda6901 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:34.374723 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fc6ff215-835a-47a1-887d-07cd6cda6901 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:34.375306 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fc6ff215-835a-47a1-887d-07cd6cda6901 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:34.616753 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-fc6ff215-835a-47a1-887d-07cd6cda6901 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3820b31a424c3a9216a6ef91fcb285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a42c3ecf474883ac652fcc8c01c9f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:06:34.625793 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:06:34.657481 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-fc6ff215-835a-47a1-887d-07cd6cda6901 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] 10.222.0.18 "GET /compute/v2.1/servers/64318452-365b-4b80-b53b-9367dd8bc826" status: 200 len: 1570 microversion: 2.1 time: 0.297247 Oct 22 21:06:34.662757 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1829/3678] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:06:34 2022] GET /compute/v2.1/servers/64318452-365b-4b80-b53b-9367dd8bc826 => generated 1570 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:06:35.356414 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-13527a5f-2e7a-41b2-adfd-57b7d4385c5c tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:35.358426 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-13527a5f-2e7a-41b2-adfd-57b7d4385c5c tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] [instance: e09b7865-0b24-4e50-a66a-342dd2e6e5e3] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:06:35.376672 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-13527a5f-2e7a-41b2-adfd-57b7d4385c5c tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:35.377461 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-13527a5f-2e7a-41b2-adfd-57b7d4385c5c tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:35.378523 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-13527a5f-2e7a-41b2-adfd-57b7d4385c5c tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:35.379641 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-13527a5f-2e7a-41b2-adfd-57b7d4385c5c tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:35.381158 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-13527a5f-2e7a-41b2-adfd-57b7d4385c5c tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:35.381778 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-13527a5f-2e7a-41b2-adfd-57b7d4385c5c tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:35.688081 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-2092090e-36ae-4e80-acb7-61d69de7b1e9 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:35.689985 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-2092090e-36ae-4e80-acb7-61d69de7b1e9 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] [instance: 64318452-365b-4b80-b53b-9367dd8bc826] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:06:35.708688 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2092090e-36ae-4e80-acb7-61d69de7b1e9 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:35.719207 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2092090e-36ae-4e80-acb7-61d69de7b1e9 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:35.721163 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2092090e-36ae-4e80-acb7-61d69de7b1e9 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:35.723862 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2092090e-36ae-4e80-acb7-61d69de7b1e9 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:35.730409 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2092090e-36ae-4e80-acb7-61d69de7b1e9 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:35.731145 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2092090e-36ae-4e80-acb7-61d69de7b1e9 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:36.784127 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-13527a5f-2e7a-41b2-adfd-57b7d4385c5c tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcdfeb6c1cda4810b9fa70fdfd9a66c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c774a85b2c41c98486cf91b1253363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:06:36.810988 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-13527a5f-2e7a-41b2-adfd-57b7d4385c5c tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] 10.222.0.18 "GET /compute/v2.1/servers/e09b7865-0b24-4e50-a66a-342dd2e6e5e3" status: 200 len: 1515 microversion: 2.1 time: 1.454389 Oct 22 21:06:36.815159 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1850/3679] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:06:35 2022] GET /compute/v2.1/servers/e09b7865-0b24-4e50-a66a-342dd2e6e5e3 => generated 1515 bytes in 1465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:06:37.138406 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-2092090e-36ae-4e80-acb7-61d69de7b1e9 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3820b31a424c3a9216a6ef91fcb285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a42c3ecf474883ac652fcc8c01c9f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:06:37.166306 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-2092090e-36ae-4e80-acb7-61d69de7b1e9 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] 10.222.0.18 "GET /compute/v2.1/servers/64318452-365b-4b80-b53b-9367dd8bc826" status: 200 len: 1570 microversion: 2.1 time: 1.483415 Oct 22 21:06:37.169222 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1830/3680] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:06:35 2022] GET /compute/v2.1/servers/64318452-365b-4b80-b53b-9367dd8bc826 => generated 1570 bytes in 1487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:06:37.602858 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-1272199f-c891-4f9f-9ad1-f7e634f907eb req-3a10383c-3ff5-42bf-907c-736baaa3ade9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64318452-365b-4b80-b53b-9367dd8bc826", "name": "network-vif-deleted", "tag": "1427b023-b32b-4457-b8e8-a5d2fe4301fa"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:06:37.646591 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-1272199f-c891-4f9f-9ad1-f7e634f907eb req-3a10383c-3ff5-42bf-907c-736baaa3ade9 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:37.647380 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-1272199f-c891-4f9f-9ad1-f7e634f907eb req-3a10383c-3ff5-42bf-907c-736baaa3ade9 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:37.649557 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-1272199f-c891-4f9f-9ad1-f7e634f907eb req-3a10383c-3ff5-42bf-907c-736baaa3ade9 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:37.682533 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-1272199f-c891-4f9f-9ad1-f7e634f907eb req-3a10383c-3ff5-42bf-907c-736baaa3ade9 service nova] Creating event network-vif-deleted:1427b023-b32b-4457-b8e8-a5d2fe4301fa for instance 64318452-365b-4b80-b53b-9367dd8bc826 on nch2-master-1 Oct 22 21:06:37.703302 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-1272199f-c891-4f9f-9ad1-f7e634f907eb req-3a10383c-3ff5-42bf-907c-736baaa3ade9 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103206 Oct 22 21:06:37.709596 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1851/3681] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:06:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:06:37.845630 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-89c7a57c-7735-4320-af30-0f9ce04a2342 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:37.846290 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-89c7a57c-7735-4320-af30-0f9ce04a2342 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] [instance: e09b7865-0b24-4e50-a66a-342dd2e6e5e3] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:06:37.864373 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-89c7a57c-7735-4320-af30-0f9ce04a2342 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:37.864876 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-89c7a57c-7735-4320-af30-0f9ce04a2342 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:37.869941 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-89c7a57c-7735-4320-af30-0f9ce04a2342 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:37.871958 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-89c7a57c-7735-4320-af30-0f9ce04a2342 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:37.873639 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-89c7a57c-7735-4320-af30-0f9ce04a2342 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:37.874267 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-89c7a57c-7735-4320-af30-0f9ce04a2342 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:38.194711 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-2a17fb70-6552-4990-96a6-d4d74b0a9e86 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:38.197677 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-2a17fb70-6552-4990-96a6-d4d74b0a9e86 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] [instance: 64318452-365b-4b80-b53b-9367dd8bc826] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:06:38.214494 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2a17fb70-6552-4990-96a6-d4d74b0a9e86 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:38.220454 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2a17fb70-6552-4990-96a6-d4d74b0a9e86 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:38.222674 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2a17fb70-6552-4990-96a6-d4d74b0a9e86 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:38.225756 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2a17fb70-6552-4990-96a6-d4d74b0a9e86 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:38.228293 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2a17fb70-6552-4990-96a6-d4d74b0a9e86 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:38.230007 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2a17fb70-6552-4990-96a6-d4d74b0a9e86 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:38.342334 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2a17fb70-6552-4990-96a6-d4d74b0a9e86 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:38.350891 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2a17fb70-6552-4990-96a6-d4d74b0a9e86 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:38.358417 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2a17fb70-6552-4990-96a6-d4d74b0a9e86 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:38.359078 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.objects.instance [None req-2a17fb70-6552-4990-96a6-d4d74b0a9e86 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lazy-loading 'fault' on Instance uuid 64318452-365b-4b80-b53b-9367dd8bc826 {{(pid=138745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 21:06:38.459649 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-89c7a57c-7735-4320-af30-0f9ce04a2342 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcdfeb6c1cda4810b9fa70fdfd9a66c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c774a85b2c41c98486cf91b1253363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:06:38.472344 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-89c7a57c-7735-4320-af30-0f9ce04a2342 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] 10.222.0.18 "GET /compute/v2.1/servers/e09b7865-0b24-4e50-a66a-342dd2e6e5e3" status: 200 len: 1515 microversion: 2.1 time: 0.633124 Oct 22 21:06:38.476070 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1831/3682] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:06:37 2022] GET /compute/v2.1/servers/e09b7865-0b24-4e50-a66a-342dd2e6e5e3 => generated 1515 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:06:38.523782 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-2a17fb70-6552-4990-96a6-d4d74b0a9e86 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3820b31a424c3a9216a6ef91fcb285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a42c3ecf474883ac652fcc8c01c9f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:06:38.537271 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-2a17fb70-6552-4990-96a6-d4d74b0a9e86 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] 10.222.0.18 "GET /compute/v2.1/servers/64318452-365b-4b80-b53b-9367dd8bc826" status: 200 len: 1366 microversion: 2.1 time: 0.344634 Oct 22 21:06:38.538211 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1852/3683] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:06:38 2022] GET /compute/v2.1/servers/64318452-365b-4b80-b53b-9367dd8bc826 => generated 1366 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:06:39.505026 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-11084831-adaf-4f17-a092-6f15db49fc7b tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:39.506271 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-11084831-adaf-4f17-a092-6f15db49fc7b tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] [instance: e09b7865-0b24-4e50-a66a-342dd2e6e5e3] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:06:39.524669 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-11084831-adaf-4f17-a092-6f15db49fc7b tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:39.525220 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-11084831-adaf-4f17-a092-6f15db49fc7b tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:39.525676 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-11084831-adaf-4f17-a092-6f15db49fc7b tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:39.527216 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-11084831-adaf-4f17-a092-6f15db49fc7b tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:39.527907 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-11084831-adaf-4f17-a092-6f15db49fc7b tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:39.531762 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-11084831-adaf-4f17-a092-6f15db49fc7b tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:39.566168 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-06622f7a-5a7c-4d16-bbcf-d5a606d10dd5 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:39.567389 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-06622f7a-5a7c-4d16-bbcf-d5a606d10dd5 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] [instance: 64318452-365b-4b80-b53b-9367dd8bc826] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:06:39.581042 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-06622f7a-5a7c-4d16-bbcf-d5a606d10dd5 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:39.586041 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-06622f7a-5a7c-4d16-bbcf-d5a606d10dd5 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:39.586859 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-06622f7a-5a7c-4d16-bbcf-d5a606d10dd5 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:39.602138 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-06622f7a-5a7c-4d16-bbcf-d5a606d10dd5 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:39.606727 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-06622f7a-5a7c-4d16-bbcf-d5a606d10dd5 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:39.607470 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-06622f7a-5a7c-4d16-bbcf-d5a606d10dd5 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:39.631261 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.wsgi [None req-06622f7a-5a7c-4d16-bbcf-d5a606d10dd5 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] HTTP exception thrown: Instance 64318452-365b-4b80-b53b-9367dd8bc826 could not be found. Oct 22 21:06:39.633413 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-06622f7a-5a7c-4d16-bbcf-d5a606d10dd5 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Request method failure captured: Oct 22 21:06:39.633413 ncdv-master-1 devstack@n-api.service[138745]: request: GET /compute/v2.1/servers/64318452-365b-4b80-b53b-9367dd8bc826 HTTP/1.1 Oct 22 21:06:39.633413 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 21:06:39.633413 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 21:06:39.633413 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 21:06:39.633413 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 0 Oct 22 21:06:39.633413 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 21:06:39.633413 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 21:06:39.633413 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 21:06:39.633413 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 21:06:39.633413 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVFrcKw86EUEeUngnG9DZUJvE3lmhBNDPmC4isrFt9sa-3M5uM6HCkY-mE9Fr6XyLPpjJ3yZx9ru813oA85o16iJwDuF8Nlz1bpd8p9u41wsyi0Zep7ygHQQJ9tgdQV6IQKIEN7AplmICrhSHFCRaS0cX6FN1kXuVbLH1K6CsNjHq7jM Oct 22 21:06:39.633413 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 21:06:39.633413 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 21:06:39.633413 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 21:06:39.633413 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 21:06:39.633413 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 21:06:39.633413 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 21:06:39.633413 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: 82a42c3ecf474883ac652fcc8c01c9f2 Oct 22 21:06:39.633413 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-TestVolumeBootPattern-1443368191 Oct 22 21:06:39.633413 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 21:06:39.633413 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 21:06:39.633413 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_82a42c3ecf474883ac652fcc8c01c9f2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/82a42c3ecf474883ac652fcc8c01c9f2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/82a42c3ecf474883ac652fcc8c01c9f2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/82a42c3ecf474883ac652fcc8c01c9f2"}]}] Oct 22 21:06:39.633413 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-TestVolumeBootPattern-1443368191 Oct 22 21:06:39.633413 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: 82a42c3ecf474883ac652fcc8c01c9f2 Oct 22 21:06:39.633413 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-TestVolumeBootPattern-1443368191 Oct 22 21:06:39.633413 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-TestVolumeBootPattern-1443368191-project Oct 22 21:06:39.633413 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 21:06:39.633413 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 21:06:39.633413 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: 7e3820b31a424c3a9216a6ef91fcb285 Oct 22 21:06:39.633413 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-TestVolumeBootPattern-1443368191-project Oct 22 21:06:39.633413 ncdv-master-1 devstack@n-api.service[138745]: method: > Oct 22 21:06:39.633413 ncdv-master-1 devstack@n-api.service[138745]: exception: Instance 64318452-365b-4b80-b53b-9367dd8bc826 could not be found. Oct 22 21:06:39.633413 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'id': '64318452-365b-4b80-b53b-9367dd8bc826'} Oct 22 21:06:39.633413 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:06:39.633413 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:06:39.633413 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 21:06:39.633413 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 21:06:39.633413 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 21:06:39.633413 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 21:06:39.633413 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 21:06:39.633413 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 21:06:39.633413 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 21:06:39.633413 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 21:06:39.633413 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64318452-365b-4b80-b53b-9367dd8bc826 could not be found. Oct 22 21:06:39.633413 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:06:39.633413 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:06:39.633413 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:06:39.633413 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:06:39.633413 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:06:39.633413 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:06:39.633413 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:06:39.633413 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:06:39.633413 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:06:39.633413 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:06:39.633413 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 21:06:39.633413 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 21:06:39.633413 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 21:06:39.633413 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 21:06:39.633413 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 21:06:39.633413 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:06:39.633413 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64318452-365b-4b80-b53b-9367dd8bc826 could not be found. Oct 22 21:06:39.633413 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:06:39.633413 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:06:39.633413 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:06:39.637132 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:06:39.637132 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:06:39.637132 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:06:39.637132 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:06:39.637132 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:06:39.637132 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64318452-365b-4b80-b53b-9367dd8bc826 could not be found. Oct 22 21:06:39.637132 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:06:39.638480 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-06622f7a-5a7c-4d16-bbcf-d5a606d10dd5 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Returning 404 to user: Instance 64318452-365b-4b80-b53b-9367dd8bc826 could not be found. {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:06:39.639560 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-06622f7a-5a7c-4d16-bbcf-d5a606d10dd5 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] 10.222.0.18 "GET /compute/v2.1/servers/64318452-365b-4b80-b53b-9367dd8bc826" status: 404 len: 111 microversion: 2.1 time: 0.078186 Oct 22 21:06:39.640696 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1853/3684] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:06:39 2022] GET /compute/v2.1/servers/64318452-365b-4b80-b53b-9367dd8bc826 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 21:06:40.964565 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-11084831-adaf-4f17-a092-6f15db49fc7b tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcdfeb6c1cda4810b9fa70fdfd9a66c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c774a85b2c41c98486cf91b1253363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:06:40.985311 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-11084831-adaf-4f17-a092-6f15db49fc7b tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] 10.222.0.18 "GET /compute/v2.1/servers/e09b7865-0b24-4e50-a66a-342dd2e6e5e3" status: 200 len: 1515 microversion: 2.1 time: 1.473840 Oct 22 21:06:41.016163 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1832/3685] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:06:39 2022] GET /compute/v2.1/servers/e09b7865-0b24-4e50-a66a-342dd2e6e5e3 => generated 1515 bytes in 1515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:06:41.511943 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-3f507eec-4eaa-4023-bfa0-8e02e1579345 tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsTestJSON-server-469572455", "imageRef": "085e4478-6edc-4a69-8e08-f9831713eb65", "flavorRef": "452", "networks": [{"uuid": "e66e177b-24bd-4b5a-8e69-2475185b93c8"}]}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:06:41.681535 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.network.neutron [None req-3f507eec-4eaa-4023-bfa0-8e02e1579345 tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] validate_networks() for [('e66e177b-24bd-4b5a-8e69-2475185b93c8', None, None, None, None, None)] {{(pid=138745) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 21:06:42.017729 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-be1eab07-032f-41f7-826c-bdef5b020774 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:42.018575 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-be1eab07-032f-41f7-826c-bdef5b020774 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] [instance: e09b7865-0b24-4e50-a66a-342dd2e6e5e3] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:06:42.038448 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-be1eab07-032f-41f7-826c-bdef5b020774 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:42.040999 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-be1eab07-032f-41f7-826c-bdef5b020774 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:42.043610 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-be1eab07-032f-41f7-826c-bdef5b020774 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:42.048414 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-be1eab07-032f-41f7-826c-bdef5b020774 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:42.049515 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-be1eab07-032f-41f7-826c-bdef5b020774 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:42.050274 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-be1eab07-032f-41f7-826c-bdef5b020774 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:43.198949 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-be1eab07-032f-41f7-826c-bdef5b020774 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcdfeb6c1cda4810b9fa70fdfd9a66c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c774a85b2c41c98486cf91b1253363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:06:43.215195 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-be1eab07-032f-41f7-826c-bdef5b020774 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] 10.222.0.18 "GET /compute/v2.1/servers/e09b7865-0b24-4e50-a66a-342dd2e6e5e3" status: 200 len: 1515 microversion: 2.1 time: 1.202619 Oct 22 21:06:43.216670 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1833/3686] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:06:42 2022] GET /compute/v2.1/servers/e09b7865-0b24-4e50-a66a-342dd2e6e5e3 => generated 1515 bytes in 1205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:06:43.839841 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-3f507eec-4eaa-4023-bfa0-8e02e1579345 tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] Flavor limits 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 21:06:43.840401 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-3f507eec-4eaa-4023-bfa0-8e02e1579345 tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] Image limits 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 21:06:43.840813 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-3f507eec-4eaa-4023-bfa0-8e02e1579345 tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] Flavor pref 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 21:06:43.841341 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-3f507eec-4eaa-4023-bfa0-8e02e1579345 tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] Image pref 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 21:06:43.841729 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-3f507eec-4eaa-4023-bfa0-8e02e1579345 tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 21:06:43.858750 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3f507eec-4eaa-4023-bfa0-8e02e1579345 tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:43.859269 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3f507eec-4eaa-4023-bfa0-8e02e1579345 tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:43.859789 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3f507eec-4eaa-4023-bfa0-8e02e1579345 tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:43.860548 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3f507eec-4eaa-4023-bfa0-8e02e1579345 tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:43.875281 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3f507eec-4eaa-4023-bfa0-8e02e1579345 tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:43.875445 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3f507eec-4eaa-4023-bfa0-8e02e1579345 tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:43.932718 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-3f507eec-4eaa-4023-bfa0-8e02e1579345 tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] Getting quotas for project 89207cb6faa54e83845ed541f10f5aea. Resources: {'cores', 'instances', 'ram'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 21:06:43.949233 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-3f507eec-4eaa-4023-bfa0-8e02e1579345 tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] Getting quotas for user 141118d4043d4e558a78318c162a3ba2 and project 89207cb6faa54e83845ed541f10f5aea. Resources: {'cores', 'instances', 'ram'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 21:06:43.972273 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:06:43.986612 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-3f507eec-4eaa-4023-bfa0-8e02e1579345 tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] Going to run 1 instances... {{(pid=138745) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 21:06:44.000818 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-3f507eec-4eaa-4023-bfa0-8e02e1579345 tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] [instance: d1acfa52-4610-41e8-839a-a5770d77aca4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='085e4478-6edc-4a69-8e08-f9831713eb65',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138745) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 21:06:44.086094 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-3f507eec-4eaa-4023-bfa0-8e02e1579345 tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.345616 Oct 22 21:06:44.088328 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1854/3687] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Oct 22 21:06:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 3351 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 21:06:44.103333 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-769ff72d-c080-49e6-906e-009eddad3b30 tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:44.104275 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-769ff72d-c080-49e6-906e-009eddad3b30 tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] [instance: d1acfa52-4610-41e8-839a-a5770d77aca4] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:06:44.245535 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-5b97aed5-1e66-4e78-adfb-6fa68bd2c358 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:44.246962 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-5b97aed5-1e66-4e78-adfb-6fa68bd2c358 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] [instance: e09b7865-0b24-4e50-a66a-342dd2e6e5e3] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:06:44.263281 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5b97aed5-1e66-4e78-adfb-6fa68bd2c358 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:44.263996 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5b97aed5-1e66-4e78-adfb-6fa68bd2c358 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:44.266153 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5b97aed5-1e66-4e78-adfb-6fa68bd2c358 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:44.268394 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5b97aed5-1e66-4e78-adfb-6fa68bd2c358 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:44.270378 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5b97aed5-1e66-4e78-adfb-6fa68bd2c358 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:44.272890 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5b97aed5-1e66-4e78-adfb-6fa68bd2c358 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:44.314743 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-769ff72d-c080-49e6-906e-009eddad3b30 tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141118d4043d4e558a78318c162a3ba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89207cb6faa54e83845ed541f10f5aea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:06:44.329975 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-769ff72d-c080-49e6-906e-009eddad3b30 tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] 10.222.0.18 "GET /compute/v2.1/servers/d1acfa52-4610-41e8-839a-a5770d77aca4" status: 200 len: 1216 microversion: 2.1 time: 0.233324 Oct 22 21:06:44.331982 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1834/3688] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:06:44 2022] GET /compute/v2.1/servers/d1acfa52-4610-41e8-839a-a5770d77aca4 => generated 1216 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:06:44.654247 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-5b97aed5-1e66-4e78-adfb-6fa68bd2c358 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcdfeb6c1cda4810b9fa70fdfd9a66c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c774a85b2c41c98486cf91b1253363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:06:44.668533 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-5b97aed5-1e66-4e78-adfb-6fa68bd2c358 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] 10.222.0.18 "GET /compute/v2.1/servers/e09b7865-0b24-4e50-a66a-342dd2e6e5e3" status: 200 len: 1515 microversion: 2.1 time: 0.428385 Oct 22 21:06:44.669462 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1855/3689] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:06:44 2022] GET /compute/v2.1/servers/e09b7865-0b24-4e50-a66a-342dd2e6e5e3 => generated 1515 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:06:45.371003 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-3843f524-28f0-470d-b54c-e4475f222466 tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:45.378697 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-3843f524-28f0-470d-b54c-e4475f222466 tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] [instance: d1acfa52-4610-41e8-839a-a5770d77aca4] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:06:45.420067 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3843f524-28f0-470d-b54c-e4475f222466 tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:45.424842 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3843f524-28f0-470d-b54c-e4475f222466 tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:45.426502 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3843f524-28f0-470d-b54c-e4475f222466 tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:45.427641 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3843f524-28f0-470d-b54c-e4475f222466 tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:45.429058 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3843f524-28f0-470d-b54c-e4475f222466 tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:45.431114 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3843f524-28f0-470d-b54c-e4475f222466 tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:45.603055 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-3843f524-28f0-470d-b54c-e4475f222466 tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141118d4043d4e558a78318c162a3ba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89207cb6faa54e83845ed541f10f5aea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:06:45.615209 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-3843f524-28f0-470d-b54c-e4475f222466 tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] 10.222.0.18 "GET /compute/v2.1/servers/d1acfa52-4610-41e8-839a-a5770d77aca4" status: 200 len: 1212 microversion: 2.1 time: 0.260909 Oct 22 21:06:45.619614 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1835/3690] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:06:45 2022] GET /compute/v2.1/servers/d1acfa52-4610-41e8-839a-a5770d77aca4 => generated 1212 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:06:45.697825 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-b6189a38-b0bb-4840-82b9-01acdb013efb tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:45.698492 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-b6189a38-b0bb-4840-82b9-01acdb013efb tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] [instance: e09b7865-0b24-4e50-a66a-342dd2e6e5e3] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:06:45.708407 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b6189a38-b0bb-4840-82b9-01acdb013efb tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:45.713643 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b6189a38-b0bb-4840-82b9-01acdb013efb tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:45.715096 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b6189a38-b0bb-4840-82b9-01acdb013efb tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:45.718597 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b6189a38-b0bb-4840-82b9-01acdb013efb tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:45.719374 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b6189a38-b0bb-4840-82b9-01acdb013efb tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:45.720056 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b6189a38-b0bb-4840-82b9-01acdb013efb tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:45.918863 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-b6189a38-b0bb-4840-82b9-01acdb013efb tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcdfeb6c1cda4810b9fa70fdfd9a66c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c774a85b2c41c98486cf91b1253363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:06:45.928334 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-b6189a38-b0bb-4840-82b9-01acdb013efb tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] 10.222.0.18 "GET /compute/v2.1/servers/e09b7865-0b24-4e50-a66a-342dd2e6e5e3" status: 200 len: 1515 microversion: 2.1 time: 0.234802 Oct 22 21:06:45.929555 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1856/3691] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:06:45 2022] GET /compute/v2.1/servers/e09b7865-0b24-4e50-a66a-342dd2e6e5e3 => generated 1515 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:06:46.645338 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-5d02cc72-b820-4cef-a571-fcefb2b313bc tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:46.645944 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-5d02cc72-b820-4cef-a571-fcefb2b313bc tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] [instance: d1acfa52-4610-41e8-839a-a5770d77aca4] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:06:46.657684 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5d02cc72-b820-4cef-a571-fcefb2b313bc tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:46.658223 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5d02cc72-b820-4cef-a571-fcefb2b313bc tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:46.658699 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5d02cc72-b820-4cef-a571-fcefb2b313bc tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:46.665187 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5d02cc72-b820-4cef-a571-fcefb2b313bc tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:46.665943 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5d02cc72-b820-4cef-a571-fcefb2b313bc tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:46.666725 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5d02cc72-b820-4cef-a571-fcefb2b313bc tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:46.777322 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-5d02cc72-b820-4cef-a571-fcefb2b313bc tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141118d4043d4e558a78318c162a3ba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89207cb6faa54e83845ed541f10f5aea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:06:46.797512 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-5d02cc72-b820-4cef-a571-fcefb2b313bc tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] 10.222.0.18 "GET /compute/v2.1/servers/d1acfa52-4610-41e8-839a-a5770d77aca4" status: 200 len: 1274 microversion: 2.1 time: 0.158749 Oct 22 21:06:46.798092 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1836/3692] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:06:46 2022] GET /compute/v2.1/servers/d1acfa52-4610-41e8-839a-a5770d77aca4 => generated 1274 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:06:46.954117 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-a6e5d470-6e57-4adf-8a94-a7076e401487 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:46.954923 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-a6e5d470-6e57-4adf-8a94-a7076e401487 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] [instance: e09b7865-0b24-4e50-a66a-342dd2e6e5e3] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:06:46.968500 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a6e5d470-6e57-4adf-8a94-a7076e401487 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:46.969023 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a6e5d470-6e57-4adf-8a94-a7076e401487 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:46.970007 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a6e5d470-6e57-4adf-8a94-a7076e401487 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:46.970761 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a6e5d470-6e57-4adf-8a94-a7076e401487 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:46.971241 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a6e5d470-6e57-4adf-8a94-a7076e401487 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:46.973885 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a6e5d470-6e57-4adf-8a94-a7076e401487 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:47.311407 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-a6e5d470-6e57-4adf-8a94-a7076e401487 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcdfeb6c1cda4810b9fa70fdfd9a66c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c774a85b2c41c98486cf91b1253363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:06:47.324657 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-a6e5d470-6e57-4adf-8a94-a7076e401487 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] 10.222.0.18 "GET /compute/v2.1/servers/e09b7865-0b24-4e50-a66a-342dd2e6e5e3" status: 200 len: 1521 microversion: 2.1 time: 0.375514 Oct 22 21:06:47.326925 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1857/3693] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:06:46 2022] GET /compute/v2.1/servers/e09b7865-0b24-4e50-a66a-342dd2e6e5e3 => generated 1521 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:06:47.829095 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-936fa34e-ea3a-481c-a686-86ec98d91022 tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:47.830716 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-936fa34e-ea3a-481c-a686-86ec98d91022 tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] [instance: d1acfa52-4610-41e8-839a-a5770d77aca4] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:06:47.841200 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-936fa34e-ea3a-481c-a686-86ec98d91022 tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:47.841958 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-936fa34e-ea3a-481c-a686-86ec98d91022 tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:47.842553 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-936fa34e-ea3a-481c-a686-86ec98d91022 tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:47.843797 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-936fa34e-ea3a-481c-a686-86ec98d91022 tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:47.844415 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-936fa34e-ea3a-481c-a686-86ec98d91022 tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:47.845926 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-936fa34e-ea3a-481c-a686-86ec98d91022 tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:48.166381 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-936fa34e-ea3a-481c-a686-86ec98d91022 tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141118d4043d4e558a78318c162a3ba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89207cb6faa54e83845ed541f10f5aea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:06:48.181554 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-936fa34e-ea3a-481c-a686-86ec98d91022 tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] 10.222.0.18 "GET /compute/v2.1/servers/d1acfa52-4610-41e8-839a-a5770d77aca4" status: 200 len: 1316 microversion: 2.1 time: 0.360320 Oct 22 21:06:48.185680 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1837/3694] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:06:47 2022] GET /compute/v2.1/servers/d1acfa52-4610-41e8-839a-a5770d77aca4 => generated 1316 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:06:48.355149 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-897044ce-1823-4a9a-80bb-a7221bb547a4 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:48.356014 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-897044ce-1823-4a9a-80bb-a7221bb547a4 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] [instance: e09b7865-0b24-4e50-a66a-342dd2e6e5e3] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:06:48.370149 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-897044ce-1823-4a9a-80bb-a7221bb547a4 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:48.370699 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-897044ce-1823-4a9a-80bb-a7221bb547a4 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:48.372384 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-897044ce-1823-4a9a-80bb-a7221bb547a4 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:48.372871 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-897044ce-1823-4a9a-80bb-a7221bb547a4 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:48.375643 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-897044ce-1823-4a9a-80bb-a7221bb547a4 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:48.376111 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-897044ce-1823-4a9a-80bb-a7221bb547a4 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:48.430563 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-3d2c666f-9d36-417a-89bd-ce66bedcae71 req-a99c44b9-4e9b-4d7c-b43b-5932e63c64c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d1acfa52-4610-41e8-839a-a5770d77aca4", "tag": "eab682d3-5531-43f4-b218-824382953c04"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:06:48.443998 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:06:48.447464 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-3d2c666f-9d36-417a-89bd-ce66bedcae71 req-a99c44b9-4e9b-4d7c-b43b-5932e63c64c9 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:48.448382 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-3d2c666f-9d36-417a-89bd-ce66bedcae71 req-a99c44b9-4e9b-4d7c-b43b-5932e63c64c9 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:48.451040 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-3d2c666f-9d36-417a-89bd-ce66bedcae71 req-a99c44b9-4e9b-4d7c-b43b-5932e63c64c9 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:48.474688 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-3d2c666f-9d36-417a-89bd-ce66bedcae71 req-a99c44b9-4e9b-4d7c-b43b-5932e63c64c9 service nova] Creating event network-changed:eab682d3-5531-43f4-b218-824382953c04 for instance d1acfa52-4610-41e8-839a-a5770d77aca4 on nch1-master-1 Oct 22 21:06:48.481652 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-3d2c666f-9d36-417a-89bd-ce66bedcae71 req-a99c44b9-4e9b-4d7c-b43b-5932e63c64c9 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058253 Oct 22 21:06:48.483743 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1838/3695] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:06:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 21:06:48.776334 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-897044ce-1823-4a9a-80bb-a7221bb547a4 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcdfeb6c1cda4810b9fa70fdfd9a66c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c774a85b2c41c98486cf91b1253363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:06:48.790304 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-897044ce-1823-4a9a-80bb-a7221bb547a4 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] 10.222.0.18 "GET /compute/v2.1/servers/e09b7865-0b24-4e50-a66a-342dd2e6e5e3" status: 200 len: 1521 microversion: 2.1 time: 0.439149 Oct 22 21:06:48.790304 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1858/3696] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:06:48 2022] GET /compute/v2.1/servers/e09b7865-0b24-4e50-a66a-342dd2e6e5e3 => generated 1521 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:06:49.155834 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-72d35a20-9c23-4845-ae2b-fd21243e7bbf tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-1362390073", "imageRef": "085e4478-6edc-4a69-8e08-f9831713eb65", "flavorRef": "452", "networks": "none"}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:06:49.213055 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-57bab056-79c0-4141-b112-a4955fe13860 tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:49.214173 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-57bab056-79c0-4141-b112-a4955fe13860 tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] [instance: d1acfa52-4610-41e8-839a-a5770d77aca4] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:06:49.229694 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-57bab056-79c0-4141-b112-a4955fe13860 tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:49.230213 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-57bab056-79c0-4141-b112-a4955fe13860 tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:49.230666 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-57bab056-79c0-4141-b112-a4955fe13860 tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:49.231419 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-57bab056-79c0-4141-b112-a4955fe13860 tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:49.231893 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-57bab056-79c0-4141-b112-a4955fe13860 tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:49.232340 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-57bab056-79c0-4141-b112-a4955fe13860 tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:49.243174 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-72d35a20-9c23-4845-ae2b-fd21243e7bbf tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Flavor limits 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 21:06:49.244618 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-72d35a20-9c23-4845-ae2b-fd21243e7bbf tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Image limits 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 21:06:49.245260 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-72d35a20-9c23-4845-ae2b-fd21243e7bbf tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Flavor pref 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 21:06:49.246927 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-72d35a20-9c23-4845-ae2b-fd21243e7bbf tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Image pref 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 21:06:49.247528 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-72d35a20-9c23-4845-ae2b-fd21243e7bbf tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 21:06:49.273475 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-72d35a20-9c23-4845-ae2b-fd21243e7bbf tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:49.278699 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-72d35a20-9c23-4845-ae2b-fd21243e7bbf tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:49.281280 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-72d35a20-9c23-4845-ae2b-fd21243e7bbf tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:49.283943 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-72d35a20-9c23-4845-ae2b-fd21243e7bbf tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:49.287637 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-72d35a20-9c23-4845-ae2b-fd21243e7bbf tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:49.289024 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-72d35a20-9c23-4845-ae2b-fd21243e7bbf tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:49.339990 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-72d35a20-9c23-4845-ae2b-fd21243e7bbf tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Getting quotas for project 2a73c458655e4b1db78801a8316fbdab. Resources: {'cores', 'instances', 'ram'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 21:06:49.345680 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-72d35a20-9c23-4845-ae2b-fd21243e7bbf tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Getting quotas for user cdebcd750fac45c183f21cf78ca939d9 and project 2a73c458655e4b1db78801a8316fbdab. Resources: {'cores', 'instances', 'ram'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 21:06:49.359489 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-72d35a20-9c23-4845-ae2b-fd21243e7bbf tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Going to run 1 instances... {{(pid=138744) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 21:06:49.363315 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-72d35a20-9c23-4845-ae2b-fd21243e7bbf tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] [instance: 7b2e6379-2f50-4138-b7b0-c064eda95b42] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='085e4478-6edc-4a69-8e08-f9831713eb65',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138744) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 21:06:49.436232 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-72d35a20-9c23-4845-ae2b-fd21243e7bbf tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.542512 Oct 22 21:06:49.437675 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1839/3697] 10.222.0.18 () {62 vars in 1188 bytes} [Sat Oct 22 21:06:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 545 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 22 21:06:49.449774 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-300118b7-e89e-4eb6-9f04-f5812873f427 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:49.450806 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-300118b7-e89e-4eb6-9f04-f5812873f427 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] [instance: 7b2e6379-2f50-4138-b7b0-c064eda95b42] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:06:49.578875 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-300118b7-e89e-4eb6-9f04-f5812873f427 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebcd750fac45c183f21cf78ca939d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a73c458655e4b1db78801a8316fbdab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:06:49.595969 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-300118b7-e89e-4eb6-9f04-f5812873f427 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdebcd750fac45c183f21cf78ca939d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a73c458655e4b1db78801a8316fbdab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:06:49.598316 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-300118b7-e89e-4eb6-9f04-f5812873f427 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdebcd750fac45c183f21cf78ca939d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a73c458655e4b1db78801a8316fbdab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:06:49.601332 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-300118b7-e89e-4eb6-9f04-f5812873f427 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] 10.222.0.18 "GET /compute/v2.1/servers/7b2e6379-2f50-4138-b7b0-c064eda95b42" status: 200 len: 1278 microversion: 2.47 time: 0.156327 Oct 22 21:06:49.606650 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1840/3698] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:06:49 2022] GET /compute/v2.1/servers/7b2e6379-2f50-4138-b7b0-c064eda95b42 => generated 1278 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:06:49.812639 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-0b57f4e9-29f8-43ce-8f67-428b7849fe49 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:49.813270 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-0b57f4e9-29f8-43ce-8f67-428b7849fe49 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] [instance: e09b7865-0b24-4e50-a66a-342dd2e6e5e3] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:06:49.823386 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0b57f4e9-29f8-43ce-8f67-428b7849fe49 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:49.823386 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0b57f4e9-29f8-43ce-8f67-428b7849fe49 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:49.823386 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0b57f4e9-29f8-43ce-8f67-428b7849fe49 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:49.823386 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0b57f4e9-29f8-43ce-8f67-428b7849fe49 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:49.823386 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0b57f4e9-29f8-43ce-8f67-428b7849fe49 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:49.823829 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0b57f4e9-29f8-43ce-8f67-428b7849fe49 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:49.885817 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-57bab056-79c0-4141-b112-a4955fe13860 tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141118d4043d4e558a78318c162a3ba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89207cb6faa54e83845ed541f10f5aea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:06:49.906085 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-57bab056-79c0-4141-b112-a4955fe13860 tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] 10.222.0.18 "GET /compute/v2.1/servers/d1acfa52-4610-41e8-839a-a5770d77aca4" status: 200 len: 1316 microversion: 2.1 time: 0.697235 Oct 22 21:06:49.906704 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1859/3699] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:06:49 2022] GET /compute/v2.1/servers/d1acfa52-4610-41e8-839a-a5770d77aca4 => generated 1316 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:06:49.924019 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-6fd9a3f2-9269-4c08-bb9e-4bbeb20ffc1a tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-510158707", "imageRef": "085e4478-6edc-4a69-8e08-f9831713eb65", "flavorRef": "452", "networks": "none"}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:06:50.046450 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-6fd9a3f2-9269-4c08-bb9e-4bbeb20ffc1a tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Flavor limits 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 21:06:50.047142 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-6fd9a3f2-9269-4c08-bb9e-4bbeb20ffc1a tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Image limits 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 21:06:50.047986 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-6fd9a3f2-9269-4c08-bb9e-4bbeb20ffc1a tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Flavor pref 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 21:06:50.049066 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-6fd9a3f2-9269-4c08-bb9e-4bbeb20ffc1a tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Image pref 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 21:06:50.050473 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-6fd9a3f2-9269-4c08-bb9e-4bbeb20ffc1a tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 21:06:50.075252 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6fd9a3f2-9269-4c08-bb9e-4bbeb20ffc1a tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:50.075820 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6fd9a3f2-9269-4c08-bb9e-4bbeb20ffc1a tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:50.076408 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6fd9a3f2-9269-4c08-bb9e-4bbeb20ffc1a tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:50.077166 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6fd9a3f2-9269-4c08-bb9e-4bbeb20ffc1a tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:50.078575 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6fd9a3f2-9269-4c08-bb9e-4bbeb20ffc1a tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:50.079175 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6fd9a3f2-9269-4c08-bb9e-4bbeb20ffc1a tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:50.115292 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-6fd9a3f2-9269-4c08-bb9e-4bbeb20ffc1a tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Getting quotas for project 2a73c458655e4b1db78801a8316fbdab. Resources: {'cores', 'instances', 'ram'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 21:06:50.123058 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-6fd9a3f2-9269-4c08-bb9e-4bbeb20ffc1a tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Getting quotas for user cdebcd750fac45c183f21cf78ca939d9 and project 2a73c458655e4b1db78801a8316fbdab. Resources: {'cores', 'instances', 'ram'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 21:06:50.149921 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-6fd9a3f2-9269-4c08-bb9e-4bbeb20ffc1a tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Going to run 1 instances... {{(pid=138745) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 21:06:50.154929 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-6fd9a3f2-9269-4c08-bb9e-4bbeb20ffc1a tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] [instance: b1b68e60-81b4-4d1e-8bb8-ab8b94d918a8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='085e4478-6edc-4a69-8e08-f9831713eb65',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138745) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 21:06:50.268371 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-6fd9a3f2-9269-4c08-bb9e-4bbeb20ffc1a tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.357508 Oct 22 21:06:50.278564 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1860/3700] 10.222.0.18 () {62 vars in 1188 bytes} [Sat Oct 22 21:06:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 371 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 22 21:06:50.286159 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-8c5da55c-2f4e-4008-9a68-877c093e6c6e tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:06:50.291151 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-8c5da55c-2f4e-4008-9a68-877c093e6c6e tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] [instance: b1b68e60-81b4-4d1e-8bb8-ab8b94d918a8] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:06:50.385436 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-8c5da55c-2f4e-4008-9a68-877c093e6c6e tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] 10.222.0.18 "PUT /compute/v2.1/servers/b1b68e60-81b4-4d1e-8bb8-ab8b94d918a8" status: 200 len: 991 microversion: 2.47 time: 0.104807 Oct 22 21:06:50.386548 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1861/3701] 10.222.0.18 () {62 vars in 1297 bytes} [Sat Oct 22 21:06:50 2022] PUT /compute/v2.1/servers/b1b68e60-81b4-4d1e-8bb8-ab8b94d918a8 => generated 991 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 22 21:06:50.418743 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-1707c557-d97a-4640-8751-3d8b1be68697 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:50.419870 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-1707c557-d97a-4640-8751-3d8b1be68697 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] [instance: b1b68e60-81b4-4d1e-8bb8-ab8b94d918a8] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:06:51.083223 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-0b57f4e9-29f8-43ce-8f67-428b7849fe49 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcdfeb6c1cda4810b9fa70fdfd9a66c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c774a85b2c41c98486cf91b1253363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:06:51.098159 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-0b57f4e9-29f8-43ce-8f67-428b7849fe49 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] 10.222.0.18 "GET /compute/v2.1/servers/e09b7865-0b24-4e50-a66a-342dd2e6e5e3" status: 200 len: 1521 microversion: 2.1 time: 1.289021 Oct 22 21:06:51.106253 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1841/3702] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:06:49 2022] GET /compute/v2.1/servers/e09b7865-0b24-4e50-a66a-342dd2e6e5e3 => generated 1521 bytes in 1298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:06:51.111406 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-be43789e-482d-49bb-8514-22a5c8e8d1d3 tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:51.112018 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-be43789e-482d-49bb-8514-22a5c8e8d1d3 tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] [instance: d1acfa52-4610-41e8-839a-a5770d77aca4] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:06:51.126778 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-1707c557-d97a-4640-8751-3d8b1be68697 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebcd750fac45c183f21cf78ca939d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a73c458655e4b1db78801a8316fbdab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:06:51.133403 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-be43789e-482d-49bb-8514-22a5c8e8d1d3 tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:51.134424 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-be43789e-482d-49bb-8514-22a5c8e8d1d3 tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:51.135024 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-be43789e-482d-49bb-8514-22a5c8e8d1d3 tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:51.136179 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-be43789e-482d-49bb-8514-22a5c8e8d1d3 tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:51.136853 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-be43789e-482d-49bb-8514-22a5c8e8d1d3 tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:51.137451 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-be43789e-482d-49bb-8514-22a5c8e8d1d3 tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:51.146948 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-1707c557-d97a-4640-8751-3d8b1be68697 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdebcd750fac45c183f21cf78ca939d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a73c458655e4b1db78801a8316fbdab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:06:51.152249 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-1707c557-d97a-4640-8751-3d8b1be68697 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdebcd750fac45c183f21cf78ca939d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a73c458655e4b1db78801a8316fbdab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:06:51.153875 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-1707c557-d97a-4640-8751-3d8b1be68697 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] 10.222.0.18 "GET /compute/v2.1/servers/b1b68e60-81b4-4d1e-8bb8-ab8b94d918a8" status: 200 len: 1277 microversion: 2.47 time: 0.747102 Oct 22 21:06:51.154683 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1862/3703] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:06:50 2022] GET /compute/v2.1/servers/b1b68e60-81b4-4d1e-8bb8-ab8b94d918a8 => generated 1277 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 22 21:06:51.184938 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-9b628822-0878-4357-9111-d5a932fae5c6 req-6de48de2-ef0b-478f-bb13-efc0bfb0ccbb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e09b7865-0b24-4e50-a66a-342dd2e6e5e3", "name": "network-vif-plugged", "status": "completed", "tag": "4f8d8606-76d6-4351-9698-cdf245ae67e4"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:06:51.199109 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-9b628822-0878-4357-9111-d5a932fae5c6 req-6de48de2-ef0b-478f-bb13-efc0bfb0ccbb service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:51.199883 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-9b628822-0878-4357-9111-d5a932fae5c6 req-6de48de2-ef0b-478f-bb13-efc0bfb0ccbb service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:51.200531 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-9b628822-0878-4357-9111-d5a932fae5c6 req-6de48de2-ef0b-478f-bb13-efc0bfb0ccbb service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:51.219926 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-9b628822-0878-4357-9111-d5a932fae5c6 req-6de48de2-ef0b-478f-bb13-efc0bfb0ccbb service nova] Creating event network-vif-plugged:4f8d8606-76d6-4351-9698-cdf245ae67e4 for instance e09b7865-0b24-4e50-a66a-342dd2e6e5e3 on nch2-master-1 Oct 22 21:06:51.230143 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-9b628822-0878-4357-9111-d5a932fae5c6 req-6de48de2-ef0b-478f-bb13-efc0bfb0ccbb service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056571 Oct 22 21:06:51.232079 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1863/3704] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:06:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:06:51.900404 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-be43789e-482d-49bb-8514-22a5c8e8d1d3 tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141118d4043d4e558a78318c162a3ba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89207cb6faa54e83845ed541f10f5aea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:06:51.921038 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-be43789e-482d-49bb-8514-22a5c8e8d1d3 tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] 10.222.0.18 "GET /compute/v2.1/servers/d1acfa52-4610-41e8-839a-a5770d77aca4" status: 200 len: 1316 microversion: 2.1 time: 0.813573 Oct 22 21:06:51.923505 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1842/3705] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:06:51 2022] GET /compute/v2.1/servers/d1acfa52-4610-41e8-839a-a5770d77aca4 => generated 1316 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:06:52.153691 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-49959924-1a28-4016-9699-977bcbabd627 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:52.159436 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-49959924-1a28-4016-9699-977bcbabd627 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] [instance: e09b7865-0b24-4e50-a66a-342dd2e6e5e3] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:06:52.193398 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-0cfc8656-4a3e-489a-8918-3b5669def03b tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:52.194881 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-0cfc8656-4a3e-489a-8918-3b5669def03b tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] [instance: b1b68e60-81b4-4d1e-8bb8-ab8b94d918a8] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:06:52.211016 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-49959924-1a28-4016-9699-977bcbabd627 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:52.217473 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-49959924-1a28-4016-9699-977bcbabd627 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:52.221280 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-49959924-1a28-4016-9699-977bcbabd627 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:52.223499 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0cfc8656-4a3e-489a-8918-3b5669def03b tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:52.224522 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-49959924-1a28-4016-9699-977bcbabd627 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:52.225713 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0cfc8656-4a3e-489a-8918-3b5669def03b tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:52.227692 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-49959924-1a28-4016-9699-977bcbabd627 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:52.228983 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-49959924-1a28-4016-9699-977bcbabd627 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:52.229381 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0cfc8656-4a3e-489a-8918-3b5669def03b tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:52.235682 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0cfc8656-4a3e-489a-8918-3b5669def03b tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:52.239144 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0cfc8656-4a3e-489a-8918-3b5669def03b tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:52.241266 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0cfc8656-4a3e-489a-8918-3b5669def03b tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:52.748297 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-0cfc8656-4a3e-489a-8918-3b5669def03b tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebcd750fac45c183f21cf78ca939d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a73c458655e4b1db78801a8316fbdab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:06:52.773559 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-0cfc8656-4a3e-489a-8918-3b5669def03b tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdebcd750fac45c183f21cf78ca939d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a73c458655e4b1db78801a8316fbdab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:06:52.775212 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-0cfc8656-4a3e-489a-8918-3b5669def03b tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdebcd750fac45c183f21cf78ca939d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a73c458655e4b1db78801a8316fbdab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:06:52.789565 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-0cfc8656-4a3e-489a-8918-3b5669def03b tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] 10.222.0.18 "GET /compute/v2.1/servers/b1b68e60-81b4-4d1e-8bb8-ab8b94d918a8" status: 200 len: 1281 microversion: 2.47 time: 0.599008 Oct 22 21:06:52.790326 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1843/3706] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:06:52 2022] GET /compute/v2.1/servers/b1b68e60-81b4-4d1e-8bb8-ab8b94d918a8 => generated 1281 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:06:52.955011 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-94ee45d5-bd71-4b97-b5b9-d7a21efea789 tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:52.955824 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-94ee45d5-bd71-4b97-b5b9-d7a21efea789 tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] [instance: d1acfa52-4610-41e8-839a-a5770d77aca4] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:06:52.973144 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-94ee45d5-bd71-4b97-b5b9-d7a21efea789 tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:52.973864 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-94ee45d5-bd71-4b97-b5b9-d7a21efea789 tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:52.976238 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-94ee45d5-bd71-4b97-b5b9-d7a21efea789 tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:52.978317 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-94ee45d5-bd71-4b97-b5b9-d7a21efea789 tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:52.979806 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-94ee45d5-bd71-4b97-b5b9-d7a21efea789 tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:52.983275 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-94ee45d5-bd71-4b97-b5b9-d7a21efea789 tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:53.162826 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-49959924-1a28-4016-9699-977bcbabd627 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcdfeb6c1cda4810b9fa70fdfd9a66c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c774a85b2c41c98486cf91b1253363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:06:53.176644 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-49959924-1a28-4016-9699-977bcbabd627 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] 10.222.0.18 "GET /compute/v2.1/servers/e09b7865-0b24-4e50-a66a-342dd2e6e5e3" status: 200 len: 1521 microversion: 2.1 time: 1.040751 Oct 22 21:06:53.178636 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1864/3707] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:06:52 2022] GET /compute/v2.1/servers/e09b7865-0b24-4e50-a66a-342dd2e6e5e3 => generated 1521 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:06:53.821396 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-6194ccac-78e5-468f-a8e6-b61cbb0c57cb tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:53.823878 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-6194ccac-78e5-468f-a8e6-b61cbb0c57cb tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] [instance: b1b68e60-81b4-4d1e-8bb8-ab8b94d918a8] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:06:53.847299 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6194ccac-78e5-468f-a8e6-b61cbb0c57cb tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:53.848274 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6194ccac-78e5-468f-a8e6-b61cbb0c57cb tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:53.848925 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6194ccac-78e5-468f-a8e6-b61cbb0c57cb tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:53.850233 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6194ccac-78e5-468f-a8e6-b61cbb0c57cb tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:53.851235 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6194ccac-78e5-468f-a8e6-b61cbb0c57cb tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:53.851920 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6194ccac-78e5-468f-a8e6-b61cbb0c57cb tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:54.089234 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-6194ccac-78e5-468f-a8e6-b61cbb0c57cb tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebcd750fac45c183f21cf78ca939d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a73c458655e4b1db78801a8316fbdab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:06:54.107223 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-6194ccac-78e5-468f-a8e6-b61cbb0c57cb tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdebcd750fac45c183f21cf78ca939d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a73c458655e4b1db78801a8316fbdab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:06:54.111890 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-6194ccac-78e5-468f-a8e6-b61cbb0c57cb tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdebcd750fac45c183f21cf78ca939d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a73c458655e4b1db78801a8316fbdab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:06:54.113475 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-6194ccac-78e5-468f-a8e6-b61cbb0c57cb tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] 10.222.0.18 "GET /compute/v2.1/servers/b1b68e60-81b4-4d1e-8bb8-ab8b94d918a8" status: 200 len: 1335 microversion: 2.47 time: 0.296430 Oct 22 21:06:54.114077 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1865/3708] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:06:53 2022] GET /compute/v2.1/servers/b1b68e60-81b4-4d1e-8bb8-ab8b94d918a8 => generated 1335 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 22 21:06:54.206550 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-4f8a54f5-3106-4bdc-9925-8ba6cc9ae12a tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:54.208668 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-4f8a54f5-3106-4bdc-9925-8ba6cc9ae12a tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] [instance: e09b7865-0b24-4e50-a66a-342dd2e6e5e3] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:06:54.228070 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4f8a54f5-3106-4bdc-9925-8ba6cc9ae12a tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:54.229012 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4f8a54f5-3106-4bdc-9925-8ba6cc9ae12a tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:54.229654 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4f8a54f5-3106-4bdc-9925-8ba6cc9ae12a tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:54.232350 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4f8a54f5-3106-4bdc-9925-8ba6cc9ae12a tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:54.233981 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4f8a54f5-3106-4bdc-9925-8ba6cc9ae12a tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:54.235785 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4f8a54f5-3106-4bdc-9925-8ba6cc9ae12a tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:54.296269 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-94ee45d5-bd71-4b97-b5b9-d7a21efea789 tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141118d4043d4e558a78318c162a3ba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89207cb6faa54e83845ed541f10f5aea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:06:54.327833 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-94ee45d5-bd71-4b97-b5b9-d7a21efea789 tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] 10.222.0.18 "GET /compute/v2.1/servers/d1acfa52-4610-41e8-839a-a5770d77aca4" status: 200 len: 1316 microversion: 2.1 time: 1.383640 Oct 22 21:06:54.329227 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1844/3709] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:06:52 2022] GET /compute/v2.1/servers/d1acfa52-4610-41e8-839a-a5770d77aca4 => generated 1316 bytes in 1387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:06:54.610534 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-4f8a54f5-3106-4bdc-9925-8ba6cc9ae12a tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcdfeb6c1cda4810b9fa70fdfd9a66c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c774a85b2c41c98486cf91b1253363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:06:54.623996 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-4f8a54f5-3106-4bdc-9925-8ba6cc9ae12a tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] 10.222.0.18 "GET /compute/v2.1/servers/e09b7865-0b24-4e50-a66a-342dd2e6e5e3" status: 200 len: 1506 microversion: 2.1 time: 0.424183 Oct 22 21:06:54.632624 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1866/3710] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:06:54 2022] GET /compute/v2.1/servers/e09b7865-0b24-4e50-a66a-342dd2e6e5e3 => generated 1506 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:06:54.671019 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-91690b53-3959-41fb-b11e-0acc19ff6fca tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:54.671696 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-91690b53-3959-41fb-b11e-0acc19ff6fca tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] [instance: e09b7865-0b24-4e50-a66a-342dd2e6e5e3] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:06:54.698424 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-91690b53-3959-41fb-b11e-0acc19ff6fca tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:54.698922 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-91690b53-3959-41fb-b11e-0acc19ff6fca tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:54.699384 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-91690b53-3959-41fb-b11e-0acc19ff6fca tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:54.700111 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-91690b53-3959-41fb-b11e-0acc19ff6fca tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:54.700564 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-91690b53-3959-41fb-b11e-0acc19ff6fca tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:54.709420 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-91690b53-3959-41fb-b11e-0acc19ff6fca tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:55.039769 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-91690b53-3959-41fb-b11e-0acc19ff6fca tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcdfeb6c1cda4810b9fa70fdfd9a66c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c774a85b2c41c98486cf91b1253363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:06:55.061512 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-91690b53-3959-41fb-b11e-0acc19ff6fca tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] 10.222.0.18 "GET /compute/v2.1/servers/e09b7865-0b24-4e50-a66a-342dd2e6e5e3" status: 200 len: 1506 microversion: 2.1 time: 0.411932 Oct 22 21:06:55.082999 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1845/3711] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:06:54 2022] GET /compute/v2.1/servers/e09b7865-0b24-4e50-a66a-342dd2e6e5e3 => generated 1506 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:06:55.093265 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-b2e6ebed-2d09-4568-9768-8c8d6605bb05 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:55.094167 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-b2e6ebed-2d09-4568-9768-8c8d6605bb05 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] [instance: e09b7865-0b24-4e50-a66a-342dd2e6e5e3] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:06:55.106602 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b2e6ebed-2d09-4568-9768-8c8d6605bb05 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:55.107385 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b2e6ebed-2d09-4568-9768-8c8d6605bb05 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:55.108004 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b2e6ebed-2d09-4568-9768-8c8d6605bb05 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:55.108976 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b2e6ebed-2d09-4568-9768-8c8d6605bb05 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:55.109606 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b2e6ebed-2d09-4568-9768-8c8d6605bb05 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:55.113991 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b2e6ebed-2d09-4568-9768-8c8d6605bb05 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:55.147709 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-79fe2c62-f1ec-4812-9f79-a5e5a2be3c89 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:55.148338 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-79fe2c62-f1ec-4812-9f79-a5e5a2be3c89 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] [instance: b1b68e60-81b4-4d1e-8bb8-ab8b94d918a8] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:06:55.160856 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-79fe2c62-f1ec-4812-9f79-a5e5a2be3c89 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:55.161822 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-79fe2c62-f1ec-4812-9f79-a5e5a2be3c89 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:55.163593 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-79fe2c62-f1ec-4812-9f79-a5e5a2be3c89 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:55.164523 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-79fe2c62-f1ec-4812-9f79-a5e5a2be3c89 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:55.168576 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-b2e6ebed-2d09-4568-9768-8c8d6605bb05 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] [instance: e09b7865-0b24-4e50-a66a-342dd2e6e5e3] Going to try to terminate instance {{(pid=138745) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 21:06:55.168767 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-79fe2c62-f1ec-4812-9f79-a5e5a2be3c89 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:55.169347 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-79fe2c62-f1ec-4812-9f79-a5e5a2be3c89 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:55.240037 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:06:55.315866 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-79fe2c62-f1ec-4812-9f79-a5e5a2be3c89 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebcd750fac45c183f21cf78ca939d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a73c458655e4b1db78801a8316fbdab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:06:55.331169 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-79fe2c62-f1ec-4812-9f79-a5e5a2be3c89 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdebcd750fac45c183f21cf78ca939d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a73c458655e4b1db78801a8316fbdab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:06:55.333292 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-79fe2c62-f1ec-4812-9f79-a5e5a2be3c89 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdebcd750fac45c183f21cf78ca939d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a73c458655e4b1db78801a8316fbdab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:06:55.338389 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-79fe2c62-f1ec-4812-9f79-a5e5a2be3c89 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] 10.222.0.18 "GET /compute/v2.1/servers/b1b68e60-81b4-4d1e-8bb8-ab8b94d918a8" status: 200 len: 1335 microversion: 2.47 time: 0.194844 Oct 22 21:06:55.339617 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1846/3712] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:06:55 2022] GET /compute/v2.1/servers/b1b68e60-81b4-4d1e-8bb8-ab8b94d918a8 => generated 1335 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:06:55.363357 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-92170d68-3ada-44bc-b300-f6731d541a6f tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:55.364433 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-92170d68-3ada-44bc-b300-f6731d541a6f tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] [instance: d1acfa52-4610-41e8-839a-a5770d77aca4] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:06:55.379820 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-92170d68-3ada-44bc-b300-f6731d541a6f tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:55.380634 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-92170d68-3ada-44bc-b300-f6731d541a6f tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:55.380828 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-b2e6ebed-2d09-4568-9768-8c8d6605bb05 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] 10.222.0.18 "DELETE /compute/v2.1/servers/e09b7865-0b24-4e50-a66a-342dd2e6e5e3" status: 204 len: 0 microversion: 2.1 time: 0.291371 Oct 22 21:06:55.381369 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-92170d68-3ada-44bc-b300-f6731d541a6f tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:55.381802 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1867/3713] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 21:06:55 2022] DELETE /compute/v2.1/servers/e09b7865-0b24-4e50-a66a-342dd2e6e5e3 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 21:06:55.385941 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-92170d68-3ada-44bc-b300-f6731d541a6f tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:55.386541 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-92170d68-3ada-44bc-b300-f6731d541a6f tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:55.387106 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-92170d68-3ada-44bc-b300-f6731d541a6f tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:55.641985 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-1649d74f-1079-4317-9518-9c5a41e7070b tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-2115477821", "imageRef": "085e4478-6edc-4a69-8e08-f9831713eb65", "flavorRef": "452", "networks": [{"uuid": "6186ef52-c98a-4139-af26-395c1bdf67cf"}]}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:06:55.737826 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.network.neutron [None req-1649d74f-1079-4317-9518-9c5a41e7070b tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] validate_networks() for [('6186ef52-c98a-4139-af26-395c1bdf67cf', None, None, None, None, None)] {{(pid=138745) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 21:06:56.138635 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-92170d68-3ada-44bc-b300-f6731d541a6f tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141118d4043d4e558a78318c162a3ba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89207cb6faa54e83845ed541f10f5aea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:06:56.151778 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-92170d68-3ada-44bc-b300-f6731d541a6f tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] 10.222.0.18 "GET /compute/v2.1/servers/d1acfa52-4610-41e8-839a-a5770d77aca4" status: 200 len: 1316 microversion: 2.1 time: 0.791187 Oct 22 21:06:56.171281 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1847/3714] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:06:55 2022] GET /compute/v2.1/servers/d1acfa52-4610-41e8-839a-a5770d77aca4 => generated 1316 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:06:56.383820 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-3261b7d2-a1d9-497b-920e-eb69f3b60663 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:56.385570 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-3261b7d2-a1d9-497b-920e-eb69f3b60663 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] [instance: b1b68e60-81b4-4d1e-8bb8-ab8b94d918a8] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:06:56.404723 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3261b7d2-a1d9-497b-920e-eb69f3b60663 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:56.408366 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3261b7d2-a1d9-497b-920e-eb69f3b60663 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:56.410255 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3261b7d2-a1d9-497b-920e-eb69f3b60663 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:56.415016 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3261b7d2-a1d9-497b-920e-eb69f3b60663 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:56.416236 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3261b7d2-a1d9-497b-920e-eb69f3b60663 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:56.418361 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3261b7d2-a1d9-497b-920e-eb69f3b60663 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:56.601101 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-3261b7d2-a1d9-497b-920e-eb69f3b60663 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebcd750fac45c183f21cf78ca939d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a73c458655e4b1db78801a8316fbdab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:06:56.622043 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-3261b7d2-a1d9-497b-920e-eb69f3b60663 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdebcd750fac45c183f21cf78ca939d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a73c458655e4b1db78801a8316fbdab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:06:56.628416 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-3261b7d2-a1d9-497b-920e-eb69f3b60663 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdebcd750fac45c183f21cf78ca939d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a73c458655e4b1db78801a8316fbdab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:06:56.633156 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-3261b7d2-a1d9-497b-920e-eb69f3b60663 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] 10.222.0.18 "GET /compute/v2.1/servers/b1b68e60-81b4-4d1e-8bb8-ab8b94d918a8" status: 200 len: 1335 microversion: 2.47 time: 0.262167 Oct 22 21:06:56.650159 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1848/3715] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:06:56 2022] GET /compute/v2.1/servers/b1b68e60-81b4-4d1e-8bb8-ab8b94d918a8 => generated 1335 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:06:57.183276 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-67f6a97f-14c6-467f-909e-3bc9cb453ff5 tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:57.186078 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-67f6a97f-14c6-467f-909e-3bc9cb453ff5 tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] [instance: d1acfa52-4610-41e8-839a-a5770d77aca4] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:06:57.202386 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-67f6a97f-14c6-467f-909e-3bc9cb453ff5 tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:57.203058 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-67f6a97f-14c6-467f-909e-3bc9cb453ff5 tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:57.204785 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-67f6a97f-14c6-467f-909e-3bc9cb453ff5 tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:57.206205 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-67f6a97f-14c6-467f-909e-3bc9cb453ff5 tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:57.208974 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-67f6a97f-14c6-467f-909e-3bc9cb453ff5 tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:57.209743 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-67f6a97f-14c6-467f-909e-3bc9cb453ff5 tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:57.641387 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-1649d74f-1079-4317-9518-9c5a41e7070b tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Flavor limits 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 21:06:57.642029 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-1649d74f-1079-4317-9518-9c5a41e7070b tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Image limits 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 21:06:57.642311 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-1649d74f-1079-4317-9518-9c5a41e7070b tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Flavor pref 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 21:06:57.642747 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-1649d74f-1079-4317-9518-9c5a41e7070b tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Image pref 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 21:06:57.643190 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-1649d74f-1079-4317-9518-9c5a41e7070b tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 21:06:57.665600 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1649d74f-1079-4317-9518-9c5a41e7070b tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:57.666214 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1649d74f-1079-4317-9518-9c5a41e7070b tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:57.666575 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1649d74f-1079-4317-9518-9c5a41e7070b tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:57.667363 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1649d74f-1079-4317-9518-9c5a41e7070b tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:57.668067 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1649d74f-1079-4317-9518-9c5a41e7070b tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:57.668706 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1649d74f-1079-4317-9518-9c5a41e7070b tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:57.698787 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-1649d74f-1079-4317-9518-9c5a41e7070b tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Getting quotas for project 48c774a85b2c41c98486cf91b1253363. Resources: {'cores', 'instances', 'ram'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 21:06:57.706744 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-1649d74f-1079-4317-9518-9c5a41e7070b tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Getting quotas for user bcdfeb6c1cda4810b9fa70fdfd9a66c8 and project 48c774a85b2c41c98486cf91b1253363. Resources: {'cores', 'instances', 'ram'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 21:06:57.730026 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-1649d74f-1079-4317-9518-9c5a41e7070b tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Going to run 1 instances... {{(pid=138745) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 21:06:57.734887 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-1649d74f-1079-4317-9518-9c5a41e7070b tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] [instance: b769064b-9ef9-47b7-9cfd-5d3b8a24a7a1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='085e4478-6edc-4a69-8e08-f9831713eb65',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138745) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 21:06:57.824814 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-1649d74f-1079-4317-9518-9c5a41e7070b tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.186811 Oct 22 21:06:57.838160 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1868/3716] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Oct 22 21:06:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 2201 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 22 21:06:57.846924 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-2cba99b3-c1c6-4248-9aef-0eb77588dc45 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:57.847964 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-2cba99b3-c1c6-4248-9aef-0eb77588dc45 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] [instance: b1b68e60-81b4-4d1e-8bb8-ab8b94d918a8] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:06:57.857915 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2cba99b3-c1c6-4248-9aef-0eb77588dc45 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:57.858580 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2cba99b3-c1c6-4248-9aef-0eb77588dc45 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:57.859130 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2cba99b3-c1c6-4248-9aef-0eb77588dc45 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:57.860017 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2cba99b3-c1c6-4248-9aef-0eb77588dc45 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:57.860782 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2cba99b3-c1c6-4248-9aef-0eb77588dc45 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:57.862130 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2cba99b3-c1c6-4248-9aef-0eb77588dc45 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:58.069342 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-67f6a97f-14c6-467f-909e-3bc9cb453ff5 tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141118d4043d4e558a78318c162a3ba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89207cb6faa54e83845ed541f10f5aea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:06:58.073412 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:SELECT=100 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:06:58.079622 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-67f6a97f-14c6-467f-909e-3bc9cb453ff5 tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] 10.222.0.18 "GET /compute/v2.1/servers/d1acfa52-4610-41e8-839a-a5770d77aca4" status: 200 len: 1316 microversion: 2.1 time: 0.901435 Oct 22 21:06:58.080204 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1849/3717] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:06:57 2022] GET /compute/v2.1/servers/d1acfa52-4610-41e8-839a-a5770d77aca4 => generated 1316 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:06:58.192023 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-2cba99b3-c1c6-4248-9aef-0eb77588dc45 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebcd750fac45c183f21cf78ca939d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a73c458655e4b1db78801a8316fbdab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:06:58.209566 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-2cba99b3-c1c6-4248-9aef-0eb77588dc45 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdebcd750fac45c183f21cf78ca939d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a73c458655e4b1db78801a8316fbdab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:06:58.218165 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-2cba99b3-c1c6-4248-9aef-0eb77588dc45 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdebcd750fac45c183f21cf78ca939d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a73c458655e4b1db78801a8316fbdab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:06:58.227058 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-2cba99b3-c1c6-4248-9aef-0eb77588dc45 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] 10.222.0.18 "GET /compute/v2.1/servers/b1b68e60-81b4-4d1e-8bb8-ab8b94d918a8" status: 200 len: 1335 microversion: 2.47 time: 0.379705 Oct 22 21:06:58.241236 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1869/3718] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:06:57 2022] GET /compute/v2.1/servers/b1b68e60-81b4-4d1e-8bb8-ab8b94d918a8 => generated 1335 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:06:58.266703 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-ab787cf3-7581-412d-a394-96f9890bb2d9 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:58.267719 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-ab787cf3-7581-412d-a394-96f9890bb2d9 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] [instance: b769064b-9ef9-47b7-9cfd-5d3b8a24a7a1] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:06:58.334268 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-5079190f-0aaa-436b-8b89-9c3b8357c279 tempest-SecurityGroupRulesTestJSON-411899809 tempest-SecurityGroupRulesTestJSON-411899809-project] Action: 'create', calling method: .version_select at 0x7fd39ee22ca0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1450992787", "description": "tempest-description-2077229570"}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:06:58.412710 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-ab787cf3-7581-412d-a394-96f9890bb2d9 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcdfeb6c1cda4810b9fa70fdfd9a66c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c774a85b2c41c98486cf91b1253363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:06:58.423016 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-ab787cf3-7581-412d-a394-96f9890bb2d9 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] 10.222.0.18 "GET /compute/v2.1/servers/b769064b-9ef9-47b7-9cfd-5d3b8a24a7a1" status: 200 len: 1218 microversion: 2.1 time: 0.180146 Oct 22 21:06:58.425809 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1870/3719] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:06:58 2022] GET /compute/v2.1/servers/b769064b-9ef9-47b7-9cfd-5d3b8a24a7a1 => generated 1218 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:06:58.445196 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-dad40e62-2414-47e8-ab72-a3442dc217f5 req-80794700-fc24-45d6-a269-948770545dba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1acfa52-4610-41e8-839a-a5770d77aca4", "name": "network-vif-plugged", "status": "completed", "tag": "eab682d3-5531-43f4-b218-824382953c04"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:06:58.473712 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-dad40e62-2414-47e8-ab72-a3442dc217f5 req-80794700-fc24-45d6-a269-948770545dba service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:58.474667 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-dad40e62-2414-47e8-ab72-a3442dc217f5 req-80794700-fc24-45d6-a269-948770545dba service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:58.488296 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-dad40e62-2414-47e8-ab72-a3442dc217f5 req-80794700-fc24-45d6-a269-948770545dba service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:58.522688 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-dad40e62-2414-47e8-ab72-a3442dc217f5 req-80794700-fc24-45d6-a269-948770545dba service nova] Creating event network-vif-plugged:eab682d3-5531-43f4-b218-824382953c04 for instance d1acfa52-4610-41e8-839a-a5770d77aca4 on nch1-master-1 Oct 22 21:06:58.530653 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-dad40e62-2414-47e8-ab72-a3442dc217f5 req-80794700-fc24-45d6-a269-948770545dba service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103082 Oct 22 21:06:58.532058 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1871/3720] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:06:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:06:59.088375 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-5079190f-0aaa-436b-8b89-9c3b8357c279 tempest-SecurityGroupRulesTestJSON-411899809 tempest-SecurityGroupRulesTestJSON-411899809-project] 10.222.0.18 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.994597 Oct 22 21:06:59.089563 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1850/3721] 10.222.0.18 () {60 vars in 1180 bytes} [Sat Oct 22 21:06:58 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:06:59.113574 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-60b510f5-2f8d-43f4-bd28-77f4460e610f tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:59.116243 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-60b510f5-2f8d-43f4-bd28-77f4460e610f tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] [instance: d1acfa52-4610-41e8-839a-a5770d77aca4] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:06:59.119003 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-9be1eaf2-1c5b-4e0e-98e8-1f66f6d1f8c3 tempest-SecurityGroupRulesTestJSON-411899809 tempest-SecurityGroupRulesTestJSON-411899809-project] Action: 'create', calling method: .version_select at 0x7fd3a4968940>, body: {"security_group_rule": {"parent_group_id": "c6927d41-9018-49cf-87e3-9789898c9721", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:06:59.131642 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-60b510f5-2f8d-43f4-bd28-77f4460e610f tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:59.134861 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-60b510f5-2f8d-43f4-bd28-77f4460e610f tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:59.135449 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-60b510f5-2f8d-43f4-bd28-77f4460e610f tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:59.138655 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-60b510f5-2f8d-43f4-bd28-77f4460e610f tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:59.139557 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-60b510f5-2f8d-43f4-bd28-77f4460e610f tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:59.140016 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-60b510f5-2f8d-43f4-bd28-77f4460e610f tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:59.316271 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell0:SELECT=2 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:06:59.585078 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell0:SELECT=10 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:06:59.887778 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-60b510f5-2f8d-43f4-bd28-77f4460e610f tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141118d4043d4e558a78318c162a3ba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89207cb6faa54e83845ed541f10f5aea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:06:59.904419 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-60b510f5-2f8d-43f4-bd28-77f4460e610f tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] 10.222.0.18 "GET /compute/v2.1/servers/d1acfa52-4610-41e8-839a-a5770d77aca4" status: 200 len: 1316 microversion: 2.1 time: 0.801595 Oct 22 21:06:59.919590 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1851/3722] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:06:59 2022] GET /compute/v2.1/servers/d1acfa52-4610-41e8-839a-a5770d77aca4 => generated 1316 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:06:59.934876 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-9b3caeb0-65a1-400b-afe4-89fb429f521d tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:06:59.935876 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-9b3caeb0-65a1-400b-afe4-89fb429f521d tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] [instance: b1b68e60-81b4-4d1e-8bb8-ab8b94d918a8] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:06:59.949675 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9b3caeb0-65a1-400b-afe4-89fb429f521d tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:59.953048 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9b3caeb0-65a1-400b-afe4-89fb429f521d tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:59.955120 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9b3caeb0-65a1-400b-afe4-89fb429f521d tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:06:59.956224 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9b3caeb0-65a1-400b-afe4-89fb429f521d tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:06:59.956936 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9b3caeb0-65a1-400b-afe4-89fb429f521d tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:06:59.957549 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9b3caeb0-65a1-400b-afe4-89fb429f521d tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:00.345744 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-9b3caeb0-65a1-400b-afe4-89fb429f521d tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebcd750fac45c183f21cf78ca939d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a73c458655e4b1db78801a8316fbdab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:07:00.363725 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-9b3caeb0-65a1-400b-afe4-89fb429f521d tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdebcd750fac45c183f21cf78ca939d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a73c458655e4b1db78801a8316fbdab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:07:00.365643 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-9b3caeb0-65a1-400b-afe4-89fb429f521d tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdebcd750fac45c183f21cf78ca939d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a73c458655e4b1db78801a8316fbdab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:07:00.368675 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-9b3caeb0-65a1-400b-afe4-89fb429f521d tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] 10.222.0.18 "GET /compute/v2.1/servers/b1b68e60-81b4-4d1e-8bb8-ab8b94d918a8" status: 200 len: 1356 microversion: 2.47 time: 0.447559 Oct 22 21:07:00.381143 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1852/3723] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:06:59 2022] GET /compute/v2.1/servers/b1b68e60-81b4-4d1e-8bb8-ab8b94d918a8 => generated 1356 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:07:00.387713 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-40870c40-22e7-45c2-bf9f-2dd2a9d9adc9 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:07:00.389037 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-40870c40-22e7-45c2-bf9f-2dd2a9d9adc9 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] [instance: b769064b-9ef9-47b7-9cfd-5d3b8a24a7a1] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:07:00.407441 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-40870c40-22e7-45c2-bf9f-2dd2a9d9adc9 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:00.409389 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-40870c40-22e7-45c2-bf9f-2dd2a9d9adc9 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:00.410772 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-40870c40-22e7-45c2-bf9f-2dd2a9d9adc9 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:00.412619 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-40870c40-22e7-45c2-bf9f-2dd2a9d9adc9 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:00.413259 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-40870c40-22e7-45c2-bf9f-2dd2a9d9adc9 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:00.413933 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-40870c40-22e7-45c2-bf9f-2dd2a9d9adc9 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:00.625464 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-40870c40-22e7-45c2-bf9f-2dd2a9d9adc9 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcdfeb6c1cda4810b9fa70fdfd9a66c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c774a85b2c41c98486cf91b1253363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:07:00.636896 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-40870c40-22e7-45c2-bf9f-2dd2a9d9adc9 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] 10.222.0.18 "GET /compute/v2.1/servers/b769064b-9ef9-47b7-9cfd-5d3b8a24a7a1" status: 200 len: 1276 microversion: 2.1 time: 0.252202 Oct 22 21:07:00.637975 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1853/3724] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:07:00 2022] GET /compute/v2.1/servers/b769064b-9ef9-47b7-9cfd-5d3b8a24a7a1 => generated 1276 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:07:00.646354 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-7407453c-dd1f-4ea0-99fd-ea24cdd9b13d req-a6428278-636b-4b8b-b8ae-8d51e7792cc6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e09b7865-0b24-4e50-a66a-342dd2e6e5e3", "name": "network-vif-deleted", "tag": "4f8d8606-76d6-4351-9698-cdf245ae67e4"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:07:00.659923 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-7407453c-dd1f-4ea0-99fd-ea24cdd9b13d req-a6428278-636b-4b8b-b8ae-8d51e7792cc6 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:00.660483 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-7407453c-dd1f-4ea0-99fd-ea24cdd9b13d req-a6428278-636b-4b8b-b8ae-8d51e7792cc6 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:00.661109 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-7407453c-dd1f-4ea0-99fd-ea24cdd9b13d req-a6428278-636b-4b8b-b8ae-8d51e7792cc6 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:00.677364 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-7407453c-dd1f-4ea0-99fd-ea24cdd9b13d req-a6428278-636b-4b8b-b8ae-8d51e7792cc6 service nova] Creating event network-vif-deleted:4f8d8606-76d6-4351-9698-cdf245ae67e4 for instance e09b7865-0b24-4e50-a66a-342dd2e6e5e3 on nch2-master-1 Oct 22 21:07:00.686388 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-7407453c-dd1f-4ea0-99fd-ea24cdd9b13d req-a6428278-636b-4b8b-b8ae-8d51e7792cc6 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046914 Oct 22 21:07:00.687015 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1854/3725] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:07:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:07:00.718072 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-dc6b42ea-a68c-4981-84d0-199f39ab815e tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "085e4478-6edc-4a69-8e08-f9831713eb65"}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:07:00.723005 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-dc6b42ea-a68c-4981-84d0-199f39ab815e tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] [instance: b1b68e60-81b4-4d1e-8bb8-ab8b94d918a8] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:07:00.732929 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-dc6b42ea-a68c-4981-84d0-199f39ab815e tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:00.734848 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-dc6b42ea-a68c-4981-84d0-199f39ab815e tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:00.744828 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-dc6b42ea-a68c-4981-84d0-199f39ab815e tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:00.746287 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-dc6b42ea-a68c-4981-84d0-199f39ab815e tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:00.746766 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-dc6b42ea-a68c-4981-84d0-199f39ab815e tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:00.747518 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-dc6b42ea-a68c-4981-84d0-199f39ab815e tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:00.797983 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-9be1eaf2-1c5b-4e0e-98e8-1f66f6d1f8c3 tempest-SecurityGroupRulesTestJSON-411899809 tempest-SecurityGroupRulesTestJSON-411899809-project] 10.222.0.18 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 1.698186 Oct 22 21:07:00.799019 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1872/3726] 10.222.0.18 () {60 vars in 1195 bytes} [Sat Oct 22 21:06:59 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 1700 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:07:00.815492 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-c03790fb-596e-4d2b-b363-483607bb922c tempest-SecurityGroupRulesTestJSON-411899809 tempest-SecurityGroupRulesTestJSON-411899809-project] Action: 'create', calling method: .version_select at 0x7fd39fe47dc0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1622021542", "description": "tempest-description-1590886060"}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:07:00.949032 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-dc6b42ea-a68c-4981-84d0-199f39ab815e tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Flavor limits 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 21:07:00.949969 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-dc6b42ea-a68c-4981-84d0-199f39ab815e tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Image limits 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 21:07:00.951089 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-dc6b42ea-a68c-4981-84d0-199f39ab815e tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Flavor pref 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 21:07:00.951826 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-dc6b42ea-a68c-4981-84d0-199f39ab815e tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Image pref 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 21:07:00.952389 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-dc6b42ea-a68c-4981-84d0-199f39ab815e tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 21:07:01.098505 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-dc6b42ea-a68c-4981-84d0-199f39ab815e tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] [instance: b1b68e60-81b4-4d1e-8bb8-ab8b94d918a8] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:07:01.106713 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-dc6b42ea-a68c-4981-84d0-199f39ab815e tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:01.107218 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-dc6b42ea-a68c-4981-84d0-199f39ab815e tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:01.107725 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-dc6b42ea-a68c-4981-84d0-199f39ab815e tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:01.108523 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-dc6b42ea-a68c-4981-84d0-199f39ab815e tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:01.108988 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-dc6b42ea-a68c-4981-84d0-199f39ab815e tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:01.109428 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-dc6b42ea-a68c-4981-84d0-199f39ab815e tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:01.159166 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-dc6b42ea-a68c-4981-84d0-199f39ab815e tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] 10.222.0.18 "POST /compute/v2.1/servers/b1b68e60-81b4-4d1e-8bb8-ab8b94d918a8/action" status: 202 len: 1078 microversion: 2.47 time: 0.470657 Oct 22 21:07:01.177157 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1855/3727] 10.222.0.18 () {62 vars in 1319 bytes} [Sat Oct 22 21:07:00 2022] POST /compute/v2.1/servers/b1b68e60-81b4-4d1e-8bb8-ab8b94d918a8/action => generated 1078 bytes in 489 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 22 21:07:01.183895 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-f4e05693-d6d8-46c1-aaca-7d6e69c7f310 tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:07:01.184806 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-f4e05693-d6d8-46c1-aaca-7d6e69c7f310 tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] [instance: d1acfa52-4610-41e8-839a-a5770d77aca4] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:07:01.194628 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f4e05693-d6d8-46c1-aaca-7d6e69c7f310 tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:01.196092 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f4e05693-d6d8-46c1-aaca-7d6e69c7f310 tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:01.197265 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f4e05693-d6d8-46c1-aaca-7d6e69c7f310 tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:01.198675 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f4e05693-d6d8-46c1-aaca-7d6e69c7f310 tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:01.199531 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f4e05693-d6d8-46c1-aaca-7d6e69c7f310 tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:01.200938 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f4e05693-d6d8-46c1-aaca-7d6e69c7f310 tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:01.697941 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-c03790fb-596e-4d2b-b363-483607bb922c tempest-SecurityGroupRulesTestJSON-411899809 tempest-SecurityGroupRulesTestJSON-411899809-project] 10.222.0.18 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.889322 Oct 22 21:07:01.698595 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1873/3728] 10.222.0.18 () {60 vars in 1180 bytes} [Sat Oct 22 21:07:00 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:07:01.705024 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-01728f3b-11d6-4e40-8e1e-af7570577786 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:07:01.705796 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-01728f3b-11d6-4e40-8e1e-af7570577786 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] [instance: b1b68e60-81b4-4d1e-8bb8-ab8b94d918a8] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:07:01.718435 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-01728f3b-11d6-4e40-8e1e-af7570577786 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:01.720869 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-01728f3b-11d6-4e40-8e1e-af7570577786 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:01.722021 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-01728f3b-11d6-4e40-8e1e-af7570577786 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:01.723163 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-01728f3b-11d6-4e40-8e1e-af7570577786 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:01.724006 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-01728f3b-11d6-4e40-8e1e-af7570577786 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:01.724867 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-01728f3b-11d6-4e40-8e1e-af7570577786 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:01.930755 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-01728f3b-11d6-4e40-8e1e-af7570577786 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebcd750fac45c183f21cf78ca939d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a73c458655e4b1db78801a8316fbdab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:07:01.939905 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-01728f3b-11d6-4e40-8e1e-af7570577786 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdebcd750fac45c183f21cf78ca939d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a73c458655e4b1db78801a8316fbdab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:07:01.941707 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-01728f3b-11d6-4e40-8e1e-af7570577786 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdebcd750fac45c183f21cf78ca939d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a73c458655e4b1db78801a8316fbdab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:07:01.942835 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-01728f3b-11d6-4e40-8e1e-af7570577786 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] 10.222.0.18 "GET /compute/v2.1/servers/b1b68e60-81b4-4d1e-8bb8-ab8b94d918a8" status: 200 len: 1365 microversion: 2.47 time: 0.242158 Oct 22 21:07:01.943428 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1874/3729] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:07:01 2022] GET /compute/v2.1/servers/b1b68e60-81b4-4d1e-8bb8-ab8b94d918a8 => generated 1365 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:07:01.969205 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-97d4bcbe-195d-41f7-87a9-fe1f25ee8dde tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:07:01.970541 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-97d4bcbe-195d-41f7-87a9-fe1f25ee8dde tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] [instance: b769064b-9ef9-47b7-9cfd-5d3b8a24a7a1] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:07:01.978053 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-97d4bcbe-195d-41f7-87a9-fe1f25ee8dde tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:01.978787 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-97d4bcbe-195d-41f7-87a9-fe1f25ee8dde tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:01.979625 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-97d4bcbe-195d-41f7-87a9-fe1f25ee8dde tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:01.980444 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-97d4bcbe-195d-41f7-87a9-fe1f25ee8dde tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:01.981060 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-97d4bcbe-195d-41f7-87a9-fe1f25ee8dde tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:01.981775 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-97d4bcbe-195d-41f7-87a9-fe1f25ee8dde tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:02.104133 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-f4e05693-d6d8-46c1-aaca-7d6e69c7f310 tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141118d4043d4e558a78318c162a3ba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89207cb6faa54e83845ed541f10f5aea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:07:02.122212 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-f4e05693-d6d8-46c1-aaca-7d6e69c7f310 tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] 10.222.0.18 "GET /compute/v2.1/servers/d1acfa52-4610-41e8-839a-a5770d77aca4" status: 200 len: 1316 microversion: 2.1 time: 0.943469 Oct 22 21:07:02.123329 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1856/3730] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:07:01 2022] GET /compute/v2.1/servers/d1acfa52-4610-41e8-839a-a5770d77aca4 => generated 1316 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:07:02.130043 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-2527df8a-8a77-4bbb-a196-a76932898280 tempest-SecurityGroupRulesTestJSON-411899809 tempest-SecurityGroupRulesTestJSON-411899809-project] Action: 'create', calling method: .version_select at 0x7fd39ee0db80>, body: {"security_group_rule": {"parent_group_id": "8ab409f8-13bb-449d-987b-6cd5f5f2695d", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "10.2.3.124/24"}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:07:02.167606 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-97d4bcbe-195d-41f7-87a9-fe1f25ee8dde tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcdfeb6c1cda4810b9fa70fdfd9a66c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c774a85b2c41c98486cf91b1253363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:07:02.186344 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-97d4bcbe-195d-41f7-87a9-fe1f25ee8dde tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] 10.222.0.18 "GET /compute/v2.1/servers/b769064b-9ef9-47b7-9cfd-5d3b8a24a7a1" status: 200 len: 1276 microversion: 2.1 time: 0.228132 Oct 22 21:07:02.187326 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1875/3731] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:07:01 2022] GET /compute/v2.1/servers/b769064b-9ef9-47b7-9cfd-5d3b8a24a7a1 => generated 1276 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:07:02.973206 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-b74e77c2-21e9-4d45-85bd-39ff8b7c0b7e tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:07:02.973927 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-b74e77c2-21e9-4d45-85bd-39ff8b7c0b7e tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] [instance: b1b68e60-81b4-4d1e-8bb8-ab8b94d918a8] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:07:02.981757 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b74e77c2-21e9-4d45-85bd-39ff8b7c0b7e tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:02.982451 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b74e77c2-21e9-4d45-85bd-39ff8b7c0b7e tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:02.984000 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b74e77c2-21e9-4d45-85bd-39ff8b7c0b7e tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:02.985193 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b74e77c2-21e9-4d45-85bd-39ff8b7c0b7e tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:02.985732 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b74e77c2-21e9-4d45-85bd-39ff8b7c0b7e tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:02.986162 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b74e77c2-21e9-4d45-85bd-39ff8b7c0b7e tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:03.110013 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-b74e77c2-21e9-4d45-85bd-39ff8b7c0b7e tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebcd750fac45c183f21cf78ca939d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a73c458655e4b1db78801a8316fbdab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:07:03.130971 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-b74e77c2-21e9-4d45-85bd-39ff8b7c0b7e tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdebcd750fac45c183f21cf78ca939d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a73c458655e4b1db78801a8316fbdab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:07:03.132935 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-b74e77c2-21e9-4d45-85bd-39ff8b7c0b7e tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdebcd750fac45c183f21cf78ca939d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a73c458655e4b1db78801a8316fbdab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:07:03.134681 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-b74e77c2-21e9-4d45-85bd-39ff8b7c0b7e tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] 10.222.0.18 "GET /compute/v2.1/servers/b1b68e60-81b4-4d1e-8bb8-ab8b94d918a8" status: 200 len: 1365 microversion: 2.47 time: 0.165529 Oct 22 21:07:03.135332 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1876/3732] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:07:02 2022] GET /compute/v2.1/servers/b1b68e60-81b4-4d1e-8bb8-ab8b94d918a8 => generated 1365 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 22 21:07:03.149813 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-ae4ca996-e086-4849-afbb-1d3bc526f4fc tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:07:03.150762 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-ae4ca996-e086-4849-afbb-1d3bc526f4fc tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] [instance: d1acfa52-4610-41e8-839a-a5770d77aca4] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:07:03.166445 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ae4ca996-e086-4849-afbb-1d3bc526f4fc tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:03.167012 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ae4ca996-e086-4849-afbb-1d3bc526f4fc tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:03.167531 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ae4ca996-e086-4849-afbb-1d3bc526f4fc tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:03.168868 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ae4ca996-e086-4849-afbb-1d3bc526f4fc tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:03.169383 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ae4ca996-e086-4849-afbb-1d3bc526f4fc tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:03.169997 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ae4ca996-e086-4849-afbb-1d3bc526f4fc tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:03.184581 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-2527df8a-8a77-4bbb-a196-a76932898280 tempest-SecurityGroupRulesTestJSON-411899809 tempest-SecurityGroupRulesTestJSON-411899809-project] 10.222.0.18 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 236 microversion: 2.1 time: 1.059594 Oct 22 21:07:03.187011 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1857/3733] 10.222.0.18 () {60 vars in 1195 bytes} [Sat Oct 22 21:07:02 2022] POST /compute/v2.1/os-security-group-rules => generated 236 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:07:03.205736 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-c7a4715d-bf70-42ed-9c27-f41ba3fe8908 tempest-SecurityGroupRulesTestJSON-411899809 tempest-SecurityGroupRulesTestJSON-411899809-project] Action: 'create', calling method: .version_select at 0x7fd39eed53a0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1863951975", "description": "tempest-description-426143212"}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:07:03.716489 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-ae4ca996-e086-4849-afbb-1d3bc526f4fc tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141118d4043d4e558a78318c162a3ba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89207cb6faa54e83845ed541f10f5aea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:07:03.731328 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-ae4ca996-e086-4849-afbb-1d3bc526f4fc tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] 10.222.0.18 "GET /compute/v2.1/servers/d1acfa52-4610-41e8-839a-a5770d77aca4" status: 200 len: 1505 microversion: 2.1 time: 0.586163 Oct 22 21:07:03.733254 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1877/3734] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:07:03 2022] GET /compute/v2.1/servers/d1acfa52-4610-41e8-839a-a5770d77aca4 => generated 1505 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:07:03.746091 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-a908761a-27e2-4784-a950-835a034c28de tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:07:03.747823 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-a908761a-27e2-4784-a950-835a034c28de tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] [instance: b769064b-9ef9-47b7-9cfd-5d3b8a24a7a1] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:07:03.765809 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a908761a-27e2-4784-a950-835a034c28de tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:03.766336 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a908761a-27e2-4784-a950-835a034c28de tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:03.766789 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a908761a-27e2-4784-a950-835a034c28de tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:03.772827 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a908761a-27e2-4784-a950-835a034c28de tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:03.773338 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a908761a-27e2-4784-a950-835a034c28de tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:03.776445 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a908761a-27e2-4784-a950-835a034c28de tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:03.934060 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-c7a4715d-bf70-42ed-9c27-f41ba3fe8908 tempest-SecurityGroupRulesTestJSON-411899809 tempest-SecurityGroupRulesTestJSON-411899809-project] 10.222.0.18 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.734508 Oct 22 21:07:03.934586 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1858/3735] 10.222.0.18 () {60 vars in 1180 bytes} [Sat Oct 22 21:07:03 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:07:04.175775 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-a908761a-27e2-4784-a950-835a034c28de tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcdfeb6c1cda4810b9fa70fdfd9a66c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c774a85b2c41c98486cf91b1253363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:07:04.218371 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-a908761a-27e2-4784-a950-835a034c28de tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] 10.222.0.18 "GET /compute/v2.1/servers/b769064b-9ef9-47b7-9cfd-5d3b8a24a7a1" status: 200 len: 1318 microversion: 2.1 time: 0.479500 Oct 22 21:07:04.235620 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1878/3736] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:07:03 2022] GET /compute/v2.1/servers/b769064b-9ef9-47b7-9cfd-5d3b8a24a7a1 => generated 1318 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:07:04.242996 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-5eb9047e-933a-409c-aafe-86ab0057d6fb tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:07:04.243812 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-5eb9047e-933a-409c-aafe-86ab0057d6fb tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] [instance: d1acfa52-4610-41e8-839a-a5770d77aca4] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:07:04.254994 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5eb9047e-933a-409c-aafe-86ab0057d6fb tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:04.256664 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-596fe159-c7a8-4d3d-8668-1d02b9c78a87 tempest-ServerGroup264TestJSON-828747038 tempest-ServerGroup264TestJSON-828747038-project] Action: 'create', calling method: .version_select at 0x7fd39eeb0940>, body: {"server_group": {"name": "server-group", "policy": "affinity"}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:07:04.257864 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5eb9047e-933a-409c-aafe-86ab0057d6fb tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:04.259968 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5eb9047e-933a-409c-aafe-86ab0057d6fb tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:04.260907 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5eb9047e-933a-409c-aafe-86ab0057d6fb tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:04.267013 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5eb9047e-933a-409c-aafe-86ab0057d6fb tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:04.267759 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5eb9047e-933a-409c-aafe-86ab0057d6fb tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:04.294228 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-596fe159-c7a8-4d3d-8668-1d02b9c78a87 tempest-ServerGroup264TestJSON-828747038 tempest-ServerGroup264TestJSON-828747038-project] Getting quotas for project 6e1f7c8cc3aa4d5cb036c8ce83ed6a4a. Resources: {'server_groups'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 21:07:04.307129 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-596fe159-c7a8-4d3d-8668-1d02b9c78a87 tempest-ServerGroup264TestJSON-828747038 tempest-ServerGroup264TestJSON-828747038-project] Getting quotas for user 301f301e07b647618dd71503e174350f and project 6e1f7c8cc3aa4d5cb036c8ce83ed6a4a. Resources: {'server_groups'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 21:07:04.361484 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-5eb9047e-933a-409c-aafe-86ab0057d6fb tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] Policy check for os_compute_api:os-instance-actions:events failed with credentials {'is_admin': False, 'user_id': '141118d4043d4e558a78318c162a3ba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89207cb6faa54e83845ed541f10f5aea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:07:04.366213 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-5eb9047e-933a-409c-aafe-86ab0057d6fb tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] 10.222.0.18 "GET /compute/v2.1/servers/d1acfa52-4610-41e8-839a-a5770d77aca4/os-instance-actions/req-3f507eec-4eaa-4023-bfa0-8e02e1579345" status: 200 len: 313 microversion: 2.1 time: 0.127507 Oct 22 21:07:04.369121 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1879/3737] 10.222.0.18 () {58 vars in 1419 bytes} [Sat Oct 22 21:07:04 2022] GET /compute/v2.1/servers/d1acfa52-4610-41e8-839a-a5770d77aca4/os-instance-actions/req-3f507eec-4eaa-4023-bfa0-8e02e1579345 => generated 313 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:07:04.377439 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-ba828947-7968-4f9a-a76a-44584bd44a57 tempest-SecurityGroupRulesTestJSON-411899809 tempest-SecurityGroupRulesTestJSON-411899809-project] Action: 'create', calling method: .version_select at 0x7fd3a435a4c0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1777969151", "description": "tempest-description-1869486429"}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:07:04.395893 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-596fe159-c7a8-4d3d-8668-1d02b9c78a87 tempest-ServerGroup264TestJSON-828747038 tempest-ServerGroup264TestJSON-828747038-project] Getting quotas for project 6e1f7c8cc3aa4d5cb036c8ce83ed6a4a. Resources: {'server_groups'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 21:07:04.405018 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-596fe159-c7a8-4d3d-8668-1d02b9c78a87 tempest-ServerGroup264TestJSON-828747038 tempest-ServerGroup264TestJSON-828747038-project] Getting quotas for user 301f301e07b647618dd71503e174350f and project 6e1f7c8cc3aa4d5cb036c8ce83ed6a4a. Resources: {'server_groups'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 21:07:04.428600 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-596fe159-c7a8-4d3d-8668-1d02b9c78a87 tempest-ServerGroup264TestJSON-828747038 tempest-ServerGroup264TestJSON-828747038-project] 10.222.0.18 "POST /compute/v2.1/os-server-groups" status: 200 len: 235 microversion: 2.64 time: 0.492800 Oct 22 21:07:04.429274 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1859/3738] 10.222.0.18 () {62 vars in 1214 bytes} [Sat Oct 22 21:07:03 2022] POST /compute/v2.1/os-server-groups => generated 235 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 22 21:07:04.444395 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-860b39d0-7a32-41ec-b526-23c3b6e7a5cf tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:07:04.445366 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-860b39d0-7a32-41ec-b526-23c3b6e7a5cf tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] [instance: b1b68e60-81b4-4d1e-8bb8-ab8b94d918a8] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:07:04.454313 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-860b39d0-7a32-41ec-b526-23c3b6e7a5cf tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:04.455015 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-860b39d0-7a32-41ec-b526-23c3b6e7a5cf tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:04.455637 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-860b39d0-7a32-41ec-b526-23c3b6e7a5cf tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:04.457077 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-860b39d0-7a32-41ec-b526-23c3b6e7a5cf tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:04.457712 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-860b39d0-7a32-41ec-b526-23c3b6e7a5cf tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:04.458508 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-860b39d0-7a32-41ec-b526-23c3b6e7a5cf tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:04.552750 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-860b39d0-7a32-41ec-b526-23c3b6e7a5cf tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebcd750fac45c183f21cf78ca939d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a73c458655e4b1db78801a8316fbdab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:07:04.570727 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-860b39d0-7a32-41ec-b526-23c3b6e7a5cf tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdebcd750fac45c183f21cf78ca939d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a73c458655e4b1db78801a8316fbdab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:07:04.572959 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-860b39d0-7a32-41ec-b526-23c3b6e7a5cf tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdebcd750fac45c183f21cf78ca939d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a73c458655e4b1db78801a8316fbdab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:07:04.575428 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-860b39d0-7a32-41ec-b526-23c3b6e7a5cf tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] 10.222.0.18 "GET /compute/v2.1/servers/b1b68e60-81b4-4d1e-8bb8-ab8b94d918a8" status: 200 len: 1365 microversion: 2.47 time: 0.135884 Oct 22 21:07:04.576757 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1860/3739] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:07:04 2022] GET /compute/v2.1/servers/b1b68e60-81b4-4d1e-8bb8-ab8b94d918a8 => generated 1365 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:07:04.584409 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-ea1d9973-2dea-46a4-9450-530dbc2c145c tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:07:04.588608 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-ea1d9973-2dea-46a4-9450-530dbc2c145c tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] [instance: d1acfa52-4610-41e8-839a-a5770d77aca4] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:07:04.598078 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ea1d9973-2dea-46a4-9450-530dbc2c145c tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:04.598953 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ea1d9973-2dea-46a4-9450-530dbc2c145c tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:04.599633 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ea1d9973-2dea-46a4-9450-530dbc2c145c tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:04.602947 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ea1d9973-2dea-46a4-9450-530dbc2c145c tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:04.604253 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ea1d9973-2dea-46a4-9450-530dbc2c145c tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:04.606191 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ea1d9973-2dea-46a4-9450-530dbc2c145c tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:04.763468 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-ea1d9973-2dea-46a4-9450-530dbc2c145c tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] 10.222.0.18 "POST /compute/v2.1/servers/d1acfa52-4610-41e8-839a-a5770d77aca4/action" status: 202 len: 0 microversion: 2.1 time: 0.182523 Oct 22 21:07:04.764701 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1861/3740] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 21:07:04 2022] POST /compute/v2.1/servers/d1acfa52-4610-41e8-839a-a5770d77aca4/action => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 21:07:04.772683 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-f0f70ecb-f4fd-42f4-b31a-e9e501beb356 tempest-ServerGroup264TestJSON-828747038 tempest-ServerGroup264TestJSON-828747038-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:07:04.789190 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-f0f70ecb-f4fd-42f4-b31a-e9e501beb356 tempest-ServerGroup264TestJSON-828747038 tempest-ServerGroup264TestJSON-828747038-project] 10.222.0.18 "GET /compute/v2.1/os-server-groups" status: 200 len: 238 microversion: 2.64 time: 0.022874 Oct 22 21:07:04.790652 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1862/3741] 10.222.0.18 () {60 vars in 1193 bytes} [Sat Oct 22 21:07:04 2022] GET /compute/v2.1/os-server-groups => generated 238 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 22 21:07:04.802475 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-3578cdd6-e790-43b9-ac80-53d326fd33f7 tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:07:04.809342 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-3578cdd6-e790-43b9-ac80-53d326fd33f7 tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] [instance: d1acfa52-4610-41e8-839a-a5770d77aca4] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:07:04.825221 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3578cdd6-e790-43b9-ac80-53d326fd33f7 tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:04.827306 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3578cdd6-e790-43b9-ac80-53d326fd33f7 tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:04.832213 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3578cdd6-e790-43b9-ac80-53d326fd33f7 tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:04.833123 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3578cdd6-e790-43b9-ac80-53d326fd33f7 tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:04.833898 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3578cdd6-e790-43b9-ac80-53d326fd33f7 tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:04.834439 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3578cdd6-e790-43b9-ac80-53d326fd33f7 tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:05.074751 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-ba828947-7968-4f9a-a76a-44584bd44a57 tempest-SecurityGroupRulesTestJSON-411899809 tempest-SecurityGroupRulesTestJSON-411899809-project] 10.222.0.18 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.704082 Oct 22 21:07:05.075564 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1880/3742] 10.222.0.18 () {60 vars in 1180 bytes} [Sat Oct 22 21:07:04 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:07:05.089711 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-c93e598f-e456-4317-8f50-e9e662cce3ae tempest-ServerGroup264TestJSON-828747038 tempest-ServerGroup264TestJSON-828747038-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:07:05.119533 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-c93e598f-e456-4317-8f50-e9e662cce3ae tempest-ServerGroup264TestJSON-828747038 tempest-ServerGroup264TestJSON-828747038-project] 10.222.0.18 "GET /compute/v2.1/os-server-groups/0147376e-2107-4f5d-9e6c-c1af80d4f86b" status: 200 len: 235 microversion: 2.64 time: 0.039866 Oct 22 21:07:05.120806 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1881/3743] 10.222.0.18 () {60 vars in 1304 bytes} [Sat Oct 22 21:07:05 2022] GET /compute/v2.1/os-server-groups/0147376e-2107-4f5d-9e6c-c1af80d4f86b => generated 235 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 22 21:07:05.129950 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-dbed4a96-3860-4901-ae5f-c9f0b3c6aa5c tempest-SecurityGroupRulesTestJSON-411899809 tempest-SecurityGroupRulesTestJSON-411899809-project] Action: 'create', calling method: .version_select at 0x7fd3a477d670>, body: {"security_group_rule": {"parent_group_id": "3ad7aff0-42c7-4cd7-9531-6b8b2e99dec0", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "288ad399-8f16-4edb-b51e-6a13ff996e24"}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:07:05.423552 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-3578cdd6-e790-43b9-ac80-53d326fd33f7 tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141118d4043d4e558a78318c162a3ba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89207cb6faa54e83845ed541f10f5aea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:07:05.438332 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-3578cdd6-e790-43b9-ac80-53d326fd33f7 tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] 10.222.0.18 "GET /compute/v2.1/servers/d1acfa52-4610-41e8-839a-a5770d77aca4" status: 200 len: 1507 microversion: 2.1 time: 0.646166 Oct 22 21:07:05.438889 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1863/3744] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:07:04 2022] GET /compute/v2.1/servers/d1acfa52-4610-41e8-839a-a5770d77aca4 => generated 1507 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:07:05.457801 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-5104c18c-9b51-4bed-b384-7cccd25c1473 tempest-ServerGroup264TestJSON-828747038 tempest-ServerGroup264TestJSON-828747038-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:07:05.532793 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-5104c18c-9b51-4bed-b384-7cccd25c1473 tempest-ServerGroup264TestJSON-828747038 tempest-ServerGroup264TestJSON-828747038-project] 10.222.0.18 "DELETE /compute/v2.1/os-server-groups/0147376e-2107-4f5d-9e6c-c1af80d4f86b" status: 204 len: 0 microversion: 2.64 time: 0.088352 Oct 22 21:07:05.535131 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1864/3745] 10.222.0.18 () {60 vars in 1307 bytes} [Sat Oct 22 21:07:05 2022] DELETE /compute/v2.1/os-server-groups/0147376e-2107-4f5d-9e6c-c1af80d4f86b => generated 0 bytes in 96 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 22 21:07:05.546116 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-7468536d-abe4-4db0-ba14-099252921adb tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:07:05.546938 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-7468536d-abe4-4db0-ba14-099252921adb tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] [instance: b769064b-9ef9-47b7-9cfd-5d3b8a24a7a1] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:07:05.557763 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=5,nova_api:DELETE=3 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:07:05.560716 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7468536d-abe4-4db0-ba14-099252921adb tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:05.561812 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7468536d-abe4-4db0-ba14-099252921adb tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:05.562164 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7468536d-abe4-4db0-ba14-099252921adb tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:05.563891 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7468536d-abe4-4db0-ba14-099252921adb tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:05.564728 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7468536d-abe4-4db0-ba14-099252921adb tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:05.566490 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7468536d-abe4-4db0-ba14-099252921adb tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:06.047276 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-7468536d-abe4-4db0-ba14-099252921adb tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcdfeb6c1cda4810b9fa70fdfd9a66c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c774a85b2c41c98486cf91b1253363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:07:06.060994 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-7468536d-abe4-4db0-ba14-099252921adb tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] 10.222.0.18 "GET /compute/v2.1/servers/b769064b-9ef9-47b7-9cfd-5d3b8a24a7a1" status: 200 len: 1318 microversion: 2.1 time: 0.524332 Oct 22 21:07:06.073725 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1865/3746] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:07:05 2022] GET /compute/v2.1/servers/b769064b-9ef9-47b7-9cfd-5d3b8a24a7a1 => generated 1318 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:07:06.086761 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-5512c107-7a71-424b-a6fb-2ed82e0b160f req-986b35ce-a4c7-4c4b-98a2-9e51182908a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b769064b-9ef9-47b7-9cfd-5d3b8a24a7a1", "tag": "ebfc42ff-9ece-4ea7-acbe-047586917889"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:07:06.098765 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-5512c107-7a71-424b-a6fb-2ed82e0b160f req-986b35ce-a4c7-4c4b-98a2-9e51182908a5 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:06.100645 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-5512c107-7a71-424b-a6fb-2ed82e0b160f req-986b35ce-a4c7-4c4b-98a2-9e51182908a5 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:06.103641 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-5512c107-7a71-424b-a6fb-2ed82e0b160f req-986b35ce-a4c7-4c4b-98a2-9e51182908a5 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:06.123524 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-5512c107-7a71-424b-a6fb-2ed82e0b160f req-986b35ce-a4c7-4c4b-98a2-9e51182908a5 service nova] Creating event network-changed:ebfc42ff-9ece-4ea7-acbe-047586917889 for instance b769064b-9ef9-47b7-9cfd-5d3b8a24a7a1 on nch2-master-1 Oct 22 21:07:06.131720 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-5512c107-7a71-424b-a6fb-2ed82e0b160f req-986b35ce-a4c7-4c4b-98a2-9e51182908a5 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056184 Oct 22 21:07:06.132798 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1866/3747] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:07:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:07:06.139146 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-6f8d1322-4791-449c-ad25-c5719f132292 tempest-ServerGroup264TestJSON-828747038 tempest-ServerGroup264TestJSON-828747038-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:07:06.156970 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-6f8d1322-4791-449c-ad25-c5719f132292 tempest-ServerGroup264TestJSON-828747038 tempest-ServerGroup264TestJSON-828747038-project] HTTP exception thrown: Instance group 0147376e-2107-4f5d-9e6c-c1af80d4f86b could not be found. Oct 22 21:07:06.160969 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-6f8d1322-4791-449c-ad25-c5719f132292 tempest-ServerGroup264TestJSON-828747038 tempest-ServerGroup264TestJSON-828747038-project] Request method failure captured: Oct 22 21:07:06.160969 ncdv-master-1 devstack@n-api.service[138744]: request: DELETE /compute/v2.1/os-server-groups/0147376e-2107-4f5d-9e6c-c1af80d4f86b HTTP/1.1 Oct 22 21:07:06.160969 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 21:07:06.160969 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 21:07:06.160969 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 21:07:06.160969 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 0 Oct 22 21:07:06.160969 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 21:07:06.160969 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 21:07:06.160969 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 21:07:06.160969 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 21:07:06.160969 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVFt3zbsePRjgpd1gQXKmkB20I4EuuWR7lO46l4shd0MgyfQEYthJ8tZVaACfcjY3vticMskjaSQxvD6roV_bIbTFwyfRTeYACH7Ada27hw6ZKkTbYj9-d_OVCiSWkWa7pGpE6YvRlM048XvjhQ8R4JPsMTLSklXcLj0qz-BSYWm8BlU Oct 22 21:07:06.160969 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 21:07:06.160969 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 21:07:06.160969 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 21:07:06.160969 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 21:07:06.160969 ncdv-master-1 devstack@n-api.service[138744]: X-Openstack-Nova-Api-Version: 2.64 Oct 22 21:07:06.160969 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 21:07:06.160969 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 21:07:06.160969 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: 6e1f7c8cc3aa4d5cb036c8ce83ed6a4a Oct 22 21:07:06.160969 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-ServerGroup264TestJSON-828747038 Oct 22 21:07:06.160969 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 21:07:06.160969 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 21:07:06.160969 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_6e1f7c8cc3aa4d5cb036c8ce83ed6a4a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6e1f7c8cc3aa4d5cb036c8ce83ed6a4a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/6e1f7c8cc3aa4d5cb036c8ce83ed6a4a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6e1f7c8cc3aa4d5cb036c8ce83ed6a4a"}]}] Oct 22 21:07:06.160969 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-ServerGroup264TestJSON-828747038 Oct 22 21:07:06.160969 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: 6e1f7c8cc3aa4d5cb036c8ce83ed6a4a Oct 22 21:07:06.160969 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-ServerGroup264TestJSON-828747038 Oct 22 21:07:06.160969 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-ServerGroup264TestJSON-828747038-project Oct 22 21:07:06.160969 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 21:07:06.160969 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 21:07:06.160969 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: 301f301e07b647618dd71503e174350f Oct 22 21:07:06.160969 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-ServerGroup264TestJSON-828747038-project Oct 22 21:07:06.160969 ncdv-master-1 devstack@n-api.service[138744]: method: > Oct 22 21:07:06.160969 ncdv-master-1 devstack@n-api.service[138744]: exception: Instance group 0147376e-2107-4f5d-9e6c-c1af80d4f86b could not be found. Oct 22 21:07:06.160969 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': '0147376e-2107-4f5d-9e6c-c1af80d4f86b'} Oct 22 21:07:06.160969 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:07:06.160969 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:07:06.160969 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 22 21:07:06.160969 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 22 21:07:06.160969 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 22 21:07:06.160969 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 22 21:07:06.160969 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 22 21:07:06.160969 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 22 21:07:06.160969 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 22 21:07:06.160969 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 22 21:07:06.160969 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 22 21:07:06.160969 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 22 21:07:06.160969 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 0147376e-2107-4f5d-9e6c-c1af80d4f86b could not be found. Oct 22 21:07:06.160969 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:07:06.160969 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:07:06.160969 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:07:06.160969 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:07:06.160969 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:07:06.160969 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:07:06.160969 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:07:06.160969 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:07:06.160969 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:07:06.160969 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:07:06.160969 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 22 21:07:06.160969 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:07:06.160969 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 0147376e-2107-4f5d-9e6c-c1af80d4f86b could not be found. Oct 22 21:07:06.160969 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:07:06.160969 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:07:06.160969 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:07:06.160969 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:07:06.164793 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:07:06.164793 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:07:06.164793 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:07:06.164793 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:07:06.164793 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 0147376e-2107-4f5d-9e6c-c1af80d4f86b could not be found. Oct 22 21:07:06.164793 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:07:06.169003 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-6f8d1322-4791-449c-ad25-c5719f132292 tempest-ServerGroup264TestJSON-828747038 tempest-ServerGroup264TestJSON-828747038-project] Returning 404 to user: Instance group 0147376e-2107-4f5d-9e6c-c1af80d4f86b could not be found. {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:07:06.178853 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-6f8d1322-4791-449c-ad25-c5719f132292 tempest-ServerGroup264TestJSON-828747038 tempest-ServerGroup264TestJSON-828747038-project] 10.222.0.18 "DELETE /compute/v2.1/os-server-groups/0147376e-2107-4f5d-9e6c-c1af80d4f86b" status: 404 len: 117 microversion: 2.64 time: 0.044495 Oct 22 21:07:06.182526 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1867/3748] 10.222.0.18 () {60 vars in 1307 bytes} [Sat Oct 22 21:07:06 2022] DELETE /compute/v2.1/os-server-groups/0147376e-2107-4f5d-9e6c-c1af80d4f86b => generated 117 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 22 21:07:06.209409 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-c820706c-18e8-438b-8d13-7cf7f8f5cbba tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:07:06.210249 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-c820706c-18e8-438b-8d13-7cf7f8f5cbba tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] [instance: b1b68e60-81b4-4d1e-8bb8-ab8b94d918a8] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:07:06.222811 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c820706c-18e8-438b-8d13-7cf7f8f5cbba tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:06.228677 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c820706c-18e8-438b-8d13-7cf7f8f5cbba tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:06.230788 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c820706c-18e8-438b-8d13-7cf7f8f5cbba tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:06.231729 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c820706c-18e8-438b-8d13-7cf7f8f5cbba tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:06.234264 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c820706c-18e8-438b-8d13-7cf7f8f5cbba tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:06.235414 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c820706c-18e8-438b-8d13-7cf7f8f5cbba tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:06.391789 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-c820706c-18e8-438b-8d13-7cf7f8f5cbba tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebcd750fac45c183f21cf78ca939d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a73c458655e4b1db78801a8316fbdab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:07:06.418708 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-c820706c-18e8-438b-8d13-7cf7f8f5cbba tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdebcd750fac45c183f21cf78ca939d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a73c458655e4b1db78801a8316fbdab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:07:06.420951 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-c820706c-18e8-438b-8d13-7cf7f8f5cbba tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdebcd750fac45c183f21cf78ca939d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a73c458655e4b1db78801a8316fbdab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:07:06.422583 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-c820706c-18e8-438b-8d13-7cf7f8f5cbba tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] 10.222.0.18 "GET /compute/v2.1/servers/b1b68e60-81b4-4d1e-8bb8-ab8b94d918a8" status: 200 len: 1365 microversion: 2.47 time: 0.225784 Oct 22 21:07:06.424337 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1868/3749] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:07:06 2022] GET /compute/v2.1/servers/b1b68e60-81b4-4d1e-8bb8-ab8b94d918a8 => generated 1365 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:07:06.444816 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-dbed4a96-3860-4901-ae5f-c9f0b3c6aa5c tempest-SecurityGroupRulesTestJSON-411899809 tempest-SecurityGroupRulesTestJSON-411899809-project] 10.222.0.18 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 1.320505 Oct 22 21:07:06.453751 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1882/3750] 10.222.0.18 () {60 vars in 1195 bytes} [Sat Oct 22 21:07:05 2022] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 1332 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:07:06.463952 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-fd0ce08a-e288-45fb-bdec-5b359dc81474 tempest-SecurityGroupRulesTestJSON-411899809 tempest-SecurityGroupRulesTestJSON-411899809-project] Action: 'create', calling method: .version_select at 0x7fd39ee891f0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-123031590", "description": "tempest-description-181339346"}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:07:06.467183 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-c9c4863c-c4bd-4b07-af20-292ac2523e43 tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:07:06.468575 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-c9c4863c-c4bd-4b07-af20-292ac2523e43 tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] [instance: d1acfa52-4610-41e8-839a-a5770d77aca4] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:07:06.485471 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c9c4863c-c4bd-4b07-af20-292ac2523e43 tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:06.486016 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c9c4863c-c4bd-4b07-af20-292ac2523e43 tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:06.486479 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c9c4863c-c4bd-4b07-af20-292ac2523e43 tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:06.487440 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c9c4863c-c4bd-4b07-af20-292ac2523e43 tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:06.492673 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c9c4863c-c4bd-4b07-af20-292ac2523e43 tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:06.493757 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c9c4863c-c4bd-4b07-af20-292ac2523e43 tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:07.007836 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-c9c4863c-c4bd-4b07-af20-292ac2523e43 tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141118d4043d4e558a78318c162a3ba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89207cb6faa54e83845ed541f10f5aea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:07:07.021263 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-c9c4863c-c4bd-4b07-af20-292ac2523e43 tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] 10.222.0.18 "GET /compute/v2.1/servers/d1acfa52-4610-41e8-839a-a5770d77aca4" status: 200 len: 1512 microversion: 2.1 time: 0.561736 Oct 22 21:07:07.022948 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1883/3751] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:07:06 2022] GET /compute/v2.1/servers/d1acfa52-4610-41e8-839a-a5770d77aca4 => generated 1512 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:07:07.091986 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-5ef1a036-ab40-4839-bea3-0518b904de46 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:07:07.093324 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-5ef1a036-ab40-4839-bea3-0518b904de46 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] [instance: b769064b-9ef9-47b7-9cfd-5d3b8a24a7a1] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:07:07.098800 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=9,nova_api:UPDATE=1 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:07:07.103655 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5ef1a036-ab40-4839-bea3-0518b904de46 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:07.104426 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5ef1a036-ab40-4839-bea3-0518b904de46 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:07.105105 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5ef1a036-ab40-4839-bea3-0518b904de46 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:07.106024 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5ef1a036-ab40-4839-bea3-0518b904de46 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:07.106898 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5ef1a036-ab40-4839-bea3-0518b904de46 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:07.107830 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5ef1a036-ab40-4839-bea3-0518b904de46 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:07.175631 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-fd0ce08a-e288-45fb-bdec-5b359dc81474 tempest-SecurityGroupRulesTestJSON-411899809 tempest-SecurityGroupRulesTestJSON-411899809-project] 10.222.0.18 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 0.717160 Oct 22 21:07:07.186085 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1869/3752] 10.222.0.18 () {60 vars in 1180 bytes} [Sat Oct 22 21:07:06 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 21:07:07.193035 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-baf7503b-fff1-4949-b6fe-0a2a8f320137 tempest-SecurityGroupRulesTestJSON-411899809 tempest-SecurityGroupRulesTestJSON-411899809-project] Action: 'create', calling method: .version_select at 0x7fd39ee0d550>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1612389343", "description": "tempest-description-1488894833"}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:07:07.454806 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-5ef1a036-ab40-4839-bea3-0518b904de46 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcdfeb6c1cda4810b9fa70fdfd9a66c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c774a85b2c41c98486cf91b1253363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:07:07.465801 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-5ef1a036-ab40-4839-bea3-0518b904de46 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] 10.222.0.18 "GET /compute/v2.1/servers/b769064b-9ef9-47b7-9cfd-5d3b8a24a7a1" status: 200 len: 1318 microversion: 2.1 time: 0.379731 Oct 22 21:07:07.466606 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1884/3753] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:07:07 2022] GET /compute/v2.1/servers/b769064b-9ef9-47b7-9cfd-5d3b8a24a7a1 => generated 1318 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:07:07.473994 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-49ed7bc5-e7f6-4c21-b608-84b9ca0884e0 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:07:07.476908 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-49ed7bc5-e7f6-4c21-b608-84b9ca0884e0 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] [instance: b1b68e60-81b4-4d1e-8bb8-ab8b94d918a8] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:07:07.487397 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-49ed7bc5-e7f6-4c21-b608-84b9ca0884e0 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:07.488602 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-49ed7bc5-e7f6-4c21-b608-84b9ca0884e0 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:07.489434 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-49ed7bc5-e7f6-4c21-b608-84b9ca0884e0 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:07.490491 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-49ed7bc5-e7f6-4c21-b608-84b9ca0884e0 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:07.491212 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-49ed7bc5-e7f6-4c21-b608-84b9ca0884e0 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:07.491778 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-49ed7bc5-e7f6-4c21-b608-84b9ca0884e0 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:07.589752 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-baf7503b-fff1-4949-b6fe-0a2a8f320137 tempest-SecurityGroupRulesTestJSON-411899809 tempest-SecurityGroupRulesTestJSON-411899809-project] 10.222.0.18 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.399971 Oct 22 21:07:07.592449 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1870/3754] 10.222.0.18 () {60 vars in 1180 bytes} [Sat Oct 22 21:07:07 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:07:07.593403 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-49ed7bc5-e7f6-4c21-b608-84b9ca0884e0 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebcd750fac45c183f21cf78ca939d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a73c458655e4b1db78801a8316fbdab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:07:07.605325 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-49ed7bc5-e7f6-4c21-b608-84b9ca0884e0 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdebcd750fac45c183f21cf78ca939d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a73c458655e4b1db78801a8316fbdab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:07:07.607698 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-49ed7bc5-e7f6-4c21-b608-84b9ca0884e0 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdebcd750fac45c183f21cf78ca939d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a73c458655e4b1db78801a8316fbdab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:07:07.609503 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-49ed7bc5-e7f6-4c21-b608-84b9ca0884e0 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] 10.222.0.18 "GET /compute/v2.1/servers/b1b68e60-81b4-4d1e-8bb8-ab8b94d918a8" status: 200 len: 1365 microversion: 2.47 time: 0.141468 Oct 22 21:07:07.612632 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-8add055d-4b25-43f1-b00c-ac7de7c0699f tempest-SecurityGroupRulesTestJSON-411899809 tempest-SecurityGroupRulesTestJSON-411899809-project] Action: 'create', calling method: .version_select at 0x7fd39ee31700>, body: {"security_group_rule": {"parent_group_id": "f4df8a5d-aa3f-4765-9eba-530dce7dca93", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "27f9b0a5-3581-4682-a1ce-5224dd981ae3"}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:07:07.616096 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1885/3755] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:07:07 2022] GET /compute/v2.1/servers/b1b68e60-81b4-4d1e-8bb8-ab8b94d918a8 => generated 1365 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:07:08.047216 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-afb014d4-9ea1-4382-a441-a2277cc1526c tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:07:08.047892 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-afb014d4-9ea1-4382-a441-a2277cc1526c tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] [instance: d1acfa52-4610-41e8-839a-a5770d77aca4] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:07:08.050220 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell0:SELECT=6 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:07:08.077227 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-afb014d4-9ea1-4382-a441-a2277cc1526c tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:08.077227 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-afb014d4-9ea1-4382-a441-a2277cc1526c tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:08.077227 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-afb014d4-9ea1-4382-a441-a2277cc1526c tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:08.082108 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-afb014d4-9ea1-4382-a441-a2277cc1526c tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:08.083651 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-afb014d4-9ea1-4382-a441-a2277cc1526c tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:08.084911 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-afb014d4-9ea1-4382-a441-a2277cc1526c tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:08.155552 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-8add055d-4b25-43f1-b00c-ac7de7c0699f tempest-SecurityGroupRulesTestJSON-411899809 tempest-SecurityGroupRulesTestJSON-411899809-project] 10.222.0.18 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 0.553493 Oct 22 21:07:08.163650 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1871/3756] 10.222.0.18 () {60 vars in 1195 bytes} [Sat Oct 22 21:07:07 2022] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:07:08.169135 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-68b59c47-2cd6-4390-b9f1-4544b00531c7 tempest-SecurityGroupRulesTestJSON-411899809 tempest-SecurityGroupRulesTestJSON-411899809-project] Calling method '.version_select at 0x7fd39eed50d0>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:07:08.417527 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell0:SELECT=22 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:07:08.666288 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-afb014d4-9ea1-4382-a441-a2277cc1526c tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141118d4043d4e558a78318c162a3ba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89207cb6faa54e83845ed541f10f5aea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:07:08.693815 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-afb014d4-9ea1-4382-a441-a2277cc1526c tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] 10.222.0.18 "GET /compute/v2.1/servers/d1acfa52-4610-41e8-839a-a5770d77aca4" status: 200 len: 1505 microversion: 2.1 time: 0.650562 Oct 22 21:07:08.704004 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1886/3757] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:07:08 2022] GET /compute/v2.1/servers/d1acfa52-4610-41e8-839a-a5770d77aca4 => generated 1505 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:07:08.727705 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-837ef73a-706f-4e69-8f62-0aee7be14265 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:07:08.729895 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-837ef73a-706f-4e69-8f62-0aee7be14265 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] [instance: b769064b-9ef9-47b7-9cfd-5d3b8a24a7a1] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:07:08.745025 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-837ef73a-706f-4e69-8f62-0aee7be14265 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:08.749488 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-837ef73a-706f-4e69-8f62-0aee7be14265 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:08.750243 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-837ef73a-706f-4e69-8f62-0aee7be14265 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:08.751255 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-837ef73a-706f-4e69-8f62-0aee7be14265 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:08.753560 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-837ef73a-706f-4e69-8f62-0aee7be14265 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:08.757631 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-837ef73a-706f-4e69-8f62-0aee7be14265 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:09.169914 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-837ef73a-706f-4e69-8f62-0aee7be14265 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcdfeb6c1cda4810b9fa70fdfd9a66c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c774a85b2c41c98486cf91b1253363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:07:09.183080 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-837ef73a-706f-4e69-8f62-0aee7be14265 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] 10.222.0.18 "GET /compute/v2.1/servers/b769064b-9ef9-47b7-9cfd-5d3b8a24a7a1" status: 200 len: 1318 microversion: 2.1 time: 0.473987 Oct 22 21:07:09.186446 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1887/3758] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:07:08 2022] GET /compute/v2.1/servers/b769064b-9ef9-47b7-9cfd-5d3b8a24a7a1 => generated 1318 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:07:09.201046 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-1567a25f-7356-468b-b01d-996d6d2fb434 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:07:09.202063 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-1567a25f-7356-468b-b01d-996d6d2fb434 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] [instance: b1b68e60-81b4-4d1e-8bb8-ab8b94d918a8] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:07:09.221609 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1567a25f-7356-468b-b01d-996d6d2fb434 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:09.223931 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1567a25f-7356-468b-b01d-996d6d2fb434 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:09.224570 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1567a25f-7356-468b-b01d-996d6d2fb434 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:09.225942 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1567a25f-7356-468b-b01d-996d6d2fb434 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:09.228104 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1567a25f-7356-468b-b01d-996d6d2fb434 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:09.229522 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1567a25f-7356-468b-b01d-996d6d2fb434 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:09.293310 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-68b59c47-2cd6-4390-b9f1-4544b00531c7 tempest-SecurityGroupRulesTestJSON-411899809 tempest-SecurityGroupRulesTestJSON-411899809-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/27f9b0a5-3581-4682-a1ce-5224dd981ae3" status: 202 len: 0 microversion: 2.1 time: 1.127277 Oct 22 21:07:09.293988 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1872/3759] 10.222.0.18 () {58 vars in 1272 bytes} [Sat Oct 22 21:07:08 2022] DELETE /compute/v2.1/os-security-groups/27f9b0a5-3581-4682-a1ce-5224dd981ae3 => generated 0 bytes in 1130 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 21:07:09.304445 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-91a25894-926f-4eb4-8978-53e02af1842d tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] Calling method '.version_select at 0x7fd39eed59d0>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:07:09.305955 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-91a25894-926f-4eb4-8978-53e02af1842d tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] [instance: d1acfa52-4610-41e8-839a-a5770d77aca4] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:07:09.340259 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-91a25894-926f-4eb4-8978-53e02af1842d tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:09.341766 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-91a25894-926f-4eb4-8978-53e02af1842d tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:09.343218 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-91a25894-926f-4eb4-8978-53e02af1842d tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:09.344328 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-91a25894-926f-4eb4-8978-53e02af1842d tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:09.345097 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-91a25894-926f-4eb4-8978-53e02af1842d tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:09.345640 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-91a25894-926f-4eb4-8978-53e02af1842d tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:09.406228 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-91a25894-926f-4eb4-8978-53e02af1842d tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] 10.222.0.18 "GET /compute/v2.1/servers/d1acfa52-4610-41e8-839a-a5770d77aca4/os-instance-actions" status: 200 len: 611 microversion: 2.1 time: 0.110360 Oct 22 21:07:09.406812 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1873/3760] 10.222.0.18 () {58 vars in 1296 bytes} [Sat Oct 22 21:07:09 2022] GET /compute/v2.1/servers/d1acfa52-4610-41e8-839a-a5770d77aca4/os-instance-actions => generated 611 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:07:09.420499 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-56b44518-75a6-4f73-8ccc-a014b49ac945 tempest-SecurityGroupRulesTestJSON-411899809 tempest-SecurityGroupRulesTestJSON-411899809-project] Calling method '.version_select at 0x7fd39ef1c430>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:07:09.424016 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-1567a25f-7356-468b-b01d-996d6d2fb434 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebcd750fac45c183f21cf78ca939d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a73c458655e4b1db78801a8316fbdab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:07:09.434788 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-1567a25f-7356-468b-b01d-996d6d2fb434 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdebcd750fac45c183f21cf78ca939d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a73c458655e4b1db78801a8316fbdab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:07:09.437491 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-1567a25f-7356-468b-b01d-996d6d2fb434 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdebcd750fac45c183f21cf78ca939d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a73c458655e4b1db78801a8316fbdab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:07:09.455863 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-1567a25f-7356-468b-b01d-996d6d2fb434 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] 10.222.0.18 "GET /compute/v2.1/servers/b1b68e60-81b4-4d1e-8bb8-ab8b94d918a8" status: 200 len: 1365 microversion: 2.47 time: 0.265027 Oct 22 21:07:09.457221 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1888/3761] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:07:09 2022] GET /compute/v2.1/servers/b1b68e60-81b4-4d1e-8bb8-ab8b94d918a8 => generated 1365 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:07:09.466918 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-2bc754ea-efc1-46ef-a7ad-42af0cc5b58b tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:07:09.467795 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-2bc754ea-efc1-46ef-a7ad-42af0cc5b58b tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] [instance: d1acfa52-4610-41e8-839a-a5770d77aca4] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:07:09.479675 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2bc754ea-efc1-46ef-a7ad-42af0cc5b58b tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:09.480190 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2bc754ea-efc1-46ef-a7ad-42af0cc5b58b tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:09.480651 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2bc754ea-efc1-46ef-a7ad-42af0cc5b58b tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:09.481382 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2bc754ea-efc1-46ef-a7ad-42af0cc5b58b tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:09.481854 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2bc754ea-efc1-46ef-a7ad-42af0cc5b58b tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:09.482298 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2bc754ea-efc1-46ef-a7ad-42af0cc5b58b tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:09.517860 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-2bc754ea-efc1-46ef-a7ad-42af0cc5b58b tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] [instance: d1acfa52-4610-41e8-839a-a5770d77aca4] Going to try to terminate instance {{(pid=138745) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 21:07:09.558238 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-56b44518-75a6-4f73-8ccc-a014b49ac945 tempest-SecurityGroupRulesTestJSON-411899809 tempest-SecurityGroupRulesTestJSON-411899809-project] 10.222.0.18 "GET /compute/v2.1/os-security-groups/f4df8a5d-aa3f-4765-9eba-530dce7dca93" status: 200 len: 246 microversion: 2.1 time: 0.141587 Oct 22 21:07:09.559080 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1874/3762] 10.222.0.18 () {58 vars in 1269 bytes} [Sat Oct 22 21:07:09 2022] GET /compute/v2.1/os-security-groups/f4df8a5d-aa3f-4765-9eba-530dce7dca93 => generated 246 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:07:09.574421 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-eebda966-3653-4a20-b6f3-8b20340e75ba tempest-SecurityGroupRulesTestJSON-411899809 tempest-SecurityGroupRulesTestJSON-411899809-project] Action: 'create', calling method: .version_select at 0x7fd39ef3af70>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1555528077", "description": "tempest-description-490362073"}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:07:09.602912 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=97,nova_cell1:INSERT=1 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:07:09.696084 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-2bc754ea-efc1-46ef-a7ad-42af0cc5b58b tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] 10.222.0.18 "DELETE /compute/v2.1/servers/d1acfa52-4610-41e8-839a-a5770d77aca4" status: 204 len: 0 microversion: 2.1 time: 0.234992 Oct 22 21:07:09.697354 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1889/3763] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 21:07:09 2022] DELETE /compute/v2.1/servers/d1acfa52-4610-41e8-839a-a5770d77aca4 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 21:07:09.714511 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-0511f35e-3683-49ed-835c-cb1d6c3acbfb tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:07:09.715988 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-0511f35e-3683-49ed-835c-cb1d6c3acbfb tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] [instance: d1acfa52-4610-41e8-839a-a5770d77aca4] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:07:09.723710 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0511f35e-3683-49ed-835c-cb1d6c3acbfb tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:09.724316 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0511f35e-3683-49ed-835c-cb1d6c3acbfb tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:09.725133 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0511f35e-3683-49ed-835c-cb1d6c3acbfb tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:09.728416 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0511f35e-3683-49ed-835c-cb1d6c3acbfb tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:09.729111 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0511f35e-3683-49ed-835c-cb1d6c3acbfb tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:09.729792 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0511f35e-3683-49ed-835c-cb1d6c3acbfb tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:10.002233 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-eebda966-3653-4a20-b6f3-8b20340e75ba tempest-SecurityGroupRulesTestJSON-411899809 tempest-SecurityGroupRulesTestJSON-411899809-project] 10.222.0.18 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.432244 Oct 22 21:07:10.003747 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1875/3764] 10.222.0.18 () {60 vars in 1180 bytes} [Sat Oct 22 21:07:09 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 21:07:10.017822 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-9be3c3dd-55c0-46ea-8f94-efda2226d757 tempest-SecurityGroupRulesTestJSON-411899809 tempest-SecurityGroupRulesTestJSON-411899809-project] Action: 'create', calling method: .version_select at 0x7fd39ef76160>, body: {"security_group_rule": {"parent_group_id": "13a84ce9-a7d0-4f06-b9ef-568692d7d58b", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:07:10.168703 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-0511f35e-3683-49ed-835c-cb1d6c3acbfb tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141118d4043d4e558a78318c162a3ba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89207cb6faa54e83845ed541f10f5aea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:07:10.202413 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-0511f35e-3683-49ed-835c-cb1d6c3acbfb tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] 10.222.0.18 "GET /compute/v2.1/servers/d1acfa52-4610-41e8-839a-a5770d77aca4" status: 200 len: 1511 microversion: 2.1 time: 0.498807 Oct 22 21:07:10.203211 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1890/3765] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:07:09 2022] GET /compute/v2.1/servers/d1acfa52-4610-41e8-839a-a5770d77aca4 => generated 1511 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:07:10.225659 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-4bc79b3b-559a-48d4-bafe-32ac22f923ff tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:07:10.226569 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-4bc79b3b-559a-48d4-bafe-32ac22f923ff tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] [instance: b769064b-9ef9-47b7-9cfd-5d3b8a24a7a1] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:07:10.235756 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4bc79b3b-559a-48d4-bafe-32ac22f923ff tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:10.240481 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4bc79b3b-559a-48d4-bafe-32ac22f923ff tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:10.255017 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4bc79b3b-559a-48d4-bafe-32ac22f923ff tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:10.256017 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4bc79b3b-559a-48d4-bafe-32ac22f923ff tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:10.258592 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4bc79b3b-559a-48d4-bafe-32ac22f923ff tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:10.259219 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4bc79b3b-559a-48d4-bafe-32ac22f923ff tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:10.590855 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-4bc79b3b-559a-48d4-bafe-32ac22f923ff tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcdfeb6c1cda4810b9fa70fdfd9a66c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c774a85b2c41c98486cf91b1253363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:07:10.604850 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-4bc79b3b-559a-48d4-bafe-32ac22f923ff tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] 10.222.0.18 "GET /compute/v2.1/servers/b769064b-9ef9-47b7-9cfd-5d3b8a24a7a1" status: 200 len: 1318 microversion: 2.1 time: 0.397810 Oct 22 21:07:10.605796 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1891/3766] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:07:10 2022] GET /compute/v2.1/servers/b769064b-9ef9-47b7-9cfd-5d3b8a24a7a1 => generated 1318 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:07:10.615735 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-9be3c3dd-55c0-46ea-8f94-efda2226d757 tempest-SecurityGroupRulesTestJSON-411899809 tempest-SecurityGroupRulesTestJSON-411899809-project] 10.222.0.18 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.600729 Oct 22 21:07:10.615735 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1876/3767] 10.222.0.18 () {60 vars in 1195 bytes} [Sat Oct 22 21:07:10 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 21:07:10.630463 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-d2732404-f8d8-4875-b0e9-0fa164be331f tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:07:10.631245 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-d2732404-f8d8-4875-b0e9-0fa164be331f tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] [instance: 079f3144-b2dd-45f2-a22d-11cd315a31ed] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:07:10.640228 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d2732404-f8d8-4875-b0e9-0fa164be331f tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:10.641078 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d2732404-f8d8-4875-b0e9-0fa164be331f tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:10.641726 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d2732404-f8d8-4875-b0e9-0fa164be331f tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:10.642700 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d2732404-f8d8-4875-b0e9-0fa164be331f tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:10.643632 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d2732404-f8d8-4875-b0e9-0fa164be331f tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:10.644325 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d2732404-f8d8-4875-b0e9-0fa164be331f tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:10.651527 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-c99788ee-593a-4ce8-91e6-b8ff63d22079 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:07:10.652728 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-c99788ee-593a-4ce8-91e6-b8ff63d22079 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] [instance: b1b68e60-81b4-4d1e-8bb8-ab8b94d918a8] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:07:10.677695 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-d2732404-f8d8-4875-b0e9-0fa164be331f tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] [instance: 079f3144-b2dd-45f2-a22d-11cd315a31ed] Going to try to terminate instance {{(pid=138744) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 21:07:10.678193 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c99788ee-593a-4ce8-91e6-b8ff63d22079 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:10.678703 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c99788ee-593a-4ce8-91e6-b8ff63d22079 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:10.679154 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c99788ee-593a-4ce8-91e6-b8ff63d22079 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:10.679912 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c99788ee-593a-4ce8-91e6-b8ff63d22079 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:10.680377 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c99788ee-593a-4ce8-91e6-b8ff63d22079 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:10.680855 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c99788ee-593a-4ce8-91e6-b8ff63d22079 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:10.747203 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:07:10.795853 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-c99788ee-593a-4ce8-91e6-b8ff63d22079 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebcd750fac45c183f21cf78ca939d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a73c458655e4b1db78801a8316fbdab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:07:10.807653 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-c99788ee-593a-4ce8-91e6-b8ff63d22079 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdebcd750fac45c183f21cf78ca939d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a73c458655e4b1db78801a8316fbdab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:07:10.809218 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-c99788ee-593a-4ce8-91e6-b8ff63d22079 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdebcd750fac45c183f21cf78ca939d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a73c458655e4b1db78801a8316fbdab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:07:10.810692 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-c99788ee-593a-4ce8-91e6-b8ff63d22079 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] 10.222.0.18 "GET /compute/v2.1/servers/b1b68e60-81b4-4d1e-8bb8-ab8b94d918a8" status: 200 len: 1365 microversion: 2.47 time: 0.203256 Oct 22 21:07:10.811319 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1892/3768] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:07:10 2022] GET /compute/v2.1/servers/b1b68e60-81b4-4d1e-8bb8-ab8b94d918a8 => generated 1365 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:07:10.829874 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-d2732404-f8d8-4875-b0e9-0fa164be331f tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] 10.222.0.18 "DELETE /compute/v2.1/servers/079f3144-b2dd-45f2-a22d-11cd315a31ed" status: 204 len: 0 microversion: 2.1 time: 0.201756 Oct 22 21:07:10.832130 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1877/3769] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 21:07:10 2022] DELETE /compute/v2.1/servers/079f3144-b2dd-45f2-a22d-11cd315a31ed => generated 0 bytes in 207 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 21:07:10.835115 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-35173863-9407-4214-9901-cce7a01ca62d tempest-SecurityGroupRulesTestJSON-411899809 tempest-SecurityGroupRulesTestJSON-411899809-project] Action: 'create', calling method: .version_select at 0x7fd3a4ae2280>, body: {"security_group_rule": {"parent_group_id": "13a84ce9-a7d0-4f06-b9ef-568692d7d58b", "ip_protocol": "icmp", "from_port": -1, "to_port": -1}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:07:10.849871 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-d64ff4c2-ad22-4058-990f-01af9ba72760 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:07:10.851131 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-d64ff4c2-ad22-4058-990f-01af9ba72760 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] [instance: 079f3144-b2dd-45f2-a22d-11cd315a31ed] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:07:10.859819 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d64ff4c2-ad22-4058-990f-01af9ba72760 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:10.860928 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d64ff4c2-ad22-4058-990f-01af9ba72760 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:10.861638 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d64ff4c2-ad22-4058-990f-01af9ba72760 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:10.862839 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d64ff4c2-ad22-4058-990f-01af9ba72760 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:10.863911 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d64ff4c2-ad22-4058-990f-01af9ba72760 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:10.864558 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d64ff4c2-ad22-4058-990f-01af9ba72760 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:11.108823 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-d64ff4c2-ad22-4058-990f-01af9ba72760 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3820b31a424c3a9216a6ef91fcb285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a42c3ecf474883ac652fcc8c01c9f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:07:11.119737 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-d64ff4c2-ad22-4058-990f-01af9ba72760 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] 10.222.0.18 "GET /compute/v2.1/servers/079f3144-b2dd-45f2-a22d-11cd315a31ed" status: 200 len: 1410 microversion: 2.1 time: 0.282278 Oct 22 21:07:11.132406 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1878/3770] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:07:10 2022] GET /compute/v2.1/servers/079f3144-b2dd-45f2-a22d-11cd315a31ed => generated 1410 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:07:11.231643 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-919d2299-f6b5-46ac-8ab3-83f84a11ea7c tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:07:11.232275 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-919d2299-f6b5-46ac-8ab3-83f84a11ea7c tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] [instance: d1acfa52-4610-41e8-839a-a5770d77aca4] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:07:11.245683 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-919d2299-f6b5-46ac-8ab3-83f84a11ea7c tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:11.246183 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-919d2299-f6b5-46ac-8ab3-83f84a11ea7c tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:11.246701 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-919d2299-f6b5-46ac-8ab3-83f84a11ea7c tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:11.247518 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-919d2299-f6b5-46ac-8ab3-83f84a11ea7c tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:11.247990 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-919d2299-f6b5-46ac-8ab3-83f84a11ea7c tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:11.248427 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-919d2299-f6b5-46ac-8ab3-83f84a11ea7c tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:11.255774 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-35173863-9407-4214-9901-cce7a01ca62d tempest-SecurityGroupRulesTestJSON-411899809 tempest-SecurityGroupRulesTestJSON-411899809-project] 10.222.0.18 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 0.432456 Oct 22 21:07:11.256901 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1893/3771] 10.222.0.18 () {60 vars in 1195 bytes} [Sat Oct 22 21:07:10 2022] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:07:11.277188 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-41581bf3-6def-44c6-82c3-720c4d9295d2 tempest-SecurityGroupRulesTestJSON-411899809 tempest-SecurityGroupRulesTestJSON-411899809-project] Calling method '.version_select at 0x7fd3a44a4e50>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:07:11.344181 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-41581bf3-6def-44c6-82c3-720c4d9295d2 tempest-SecurityGroupRulesTestJSON-411899809 tempest-SecurityGroupRulesTestJSON-411899809-project] 10.222.0.18 "GET /compute/v2.1/os-security-groups/13a84ce9-a7d0-4f06-b9ef-568692d7d58b" status: 200 len: 664 microversion: 2.1 time: 0.077576 Oct 22 21:07:11.345517 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1894/3772] 10.222.0.18 () {58 vars in 1269 bytes} [Sat Oct 22 21:07:11 2022] GET /compute/v2.1/os-security-groups/13a84ce9-a7d0-4f06-b9ef-568692d7d58b => generated 664 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:07:11.372620 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-2c08490d-d8fd-4331-999c-7aa39f06631f tempest-SecurityGroupRulesTestJSON-411899809 tempest-SecurityGroupRulesTestJSON-411899809-project] Calling method '.version_select at 0x7fd3a47868b0>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:07:11.543827 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-919d2299-f6b5-46ac-8ab3-83f84a11ea7c tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141118d4043d4e558a78318c162a3ba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89207cb6faa54e83845ed541f10f5aea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:07:11.556290 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-919d2299-f6b5-46ac-8ab3-83f84a11ea7c tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] 10.222.0.18 "GET /compute/v2.1/servers/d1acfa52-4610-41e8-839a-a5770d77aca4" status: 200 len: 1511 microversion: 2.1 time: 0.328218 Oct 22 21:07:11.559997 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1879/3773] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:07:11 2022] GET /compute/v2.1/servers/d1acfa52-4610-41e8-839a-a5770d77aca4 => generated 1511 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:07:11.629819 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-d125ac86-7754-4768-9219-9e94082a12dd tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:07:11.631221 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-d125ac86-7754-4768-9219-9e94082a12dd tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] [instance: b769064b-9ef9-47b7-9cfd-5d3b8a24a7a1] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:07:11.654108 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d125ac86-7754-4768-9219-9e94082a12dd tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:11.654884 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d125ac86-7754-4768-9219-9e94082a12dd tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:11.655580 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d125ac86-7754-4768-9219-9e94082a12dd tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:11.656453 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d125ac86-7754-4768-9219-9e94082a12dd tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:11.657144 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d125ac86-7754-4768-9219-9e94082a12dd tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:11.658061 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d125ac86-7754-4768-9219-9e94082a12dd tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:11.697659 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-2c08490d-d8fd-4331-999c-7aa39f06631f tempest-SecurityGroupRulesTestJSON-411899809 tempest-SecurityGroupRulesTestJSON-411899809-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-group-rules/9c980db9-3c39-4b62-a675-b38f3b03d47f" status: 202 len: 0 microversion: 2.1 time: 0.340719 Oct 22 21:07:11.704923 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1895/3774] 10.222.0.18 () {58 vars in 1287 bytes} [Sat Oct 22 21:07:11 2022] DELETE /compute/v2.1/os-security-group-rules/9c980db9-3c39-4b62-a675-b38f3b03d47f => generated 0 bytes in 349 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 21:07:11.712703 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-b85cd703-753a-4064-a4cc-43314de43042 tempest-SecurityGroupRulesTestJSON-411899809 tempest-SecurityGroupRulesTestJSON-411899809-project] Calling method '.version_select at 0x7fd3a477d670>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:07:12.013681 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-d125ac86-7754-4768-9219-9e94082a12dd tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcdfeb6c1cda4810b9fa70fdfd9a66c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c774a85b2c41c98486cf91b1253363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:07:12.030268 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-d125ac86-7754-4768-9219-9e94082a12dd tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] 10.222.0.18 "GET /compute/v2.1/servers/b769064b-9ef9-47b7-9cfd-5d3b8a24a7a1" status: 200 len: 1318 microversion: 2.1 time: 0.405052 Oct 22 21:07:12.030847 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1880/3775] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:07:11 2022] GET /compute/v2.1/servers/b769064b-9ef9-47b7-9cfd-5d3b8a24a7a1 => generated 1318 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:07:12.041125 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-5a3b2422-eddd-4e5e-94c3-1ea2d7ed14b5 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:07:12.043010 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-5a3b2422-eddd-4e5e-94c3-1ea2d7ed14b5 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] [instance: b1b68e60-81b4-4d1e-8bb8-ab8b94d918a8] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:07:12.056884 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5a3b2422-eddd-4e5e-94c3-1ea2d7ed14b5 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:12.057388 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5a3b2422-eddd-4e5e-94c3-1ea2d7ed14b5 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:12.059877 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5a3b2422-eddd-4e5e-94c3-1ea2d7ed14b5 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:12.061985 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5a3b2422-eddd-4e5e-94c3-1ea2d7ed14b5 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:12.063699 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5a3b2422-eddd-4e5e-94c3-1ea2d7ed14b5 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:12.064925 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5a3b2422-eddd-4e5e-94c3-1ea2d7ed14b5 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:12.183489 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-5a3b2422-eddd-4e5e-94c3-1ea2d7ed14b5 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebcd750fac45c183f21cf78ca939d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a73c458655e4b1db78801a8316fbdab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:07:12.200539 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-5a3b2422-eddd-4e5e-94c3-1ea2d7ed14b5 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdebcd750fac45c183f21cf78ca939d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a73c458655e4b1db78801a8316fbdab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:07:12.206724 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-5a3b2422-eddd-4e5e-94c3-1ea2d7ed14b5 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdebcd750fac45c183f21cf78ca939d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a73c458655e4b1db78801a8316fbdab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:07:12.208243 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-5a3b2422-eddd-4e5e-94c3-1ea2d7ed14b5 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] 10.222.0.18 "GET /compute/v2.1/servers/b1b68e60-81b4-4d1e-8bb8-ab8b94d918a8" status: 200 len: 1365 microversion: 2.47 time: 0.176123 Oct 22 21:07:12.223948 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1881/3776] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:07:12 2022] GET /compute/v2.1/servers/b1b68e60-81b4-4d1e-8bb8-ab8b94d918a8 => generated 1365 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:07:12.235796 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-2f759aee-daa0-49b8-935a-1dd37682deec tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:07:12.236686 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-2f759aee-daa0-49b8-935a-1dd37682deec tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] [instance: 079f3144-b2dd-45f2-a22d-11cd315a31ed] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:07:12.243693 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2f759aee-daa0-49b8-935a-1dd37682deec tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:12.244944 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2f759aee-daa0-49b8-935a-1dd37682deec tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:12.245545 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2f759aee-daa0-49b8-935a-1dd37682deec tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:12.246422 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2f759aee-daa0-49b8-935a-1dd37682deec tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:12.247032 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2f759aee-daa0-49b8-935a-1dd37682deec tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:12.247641 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2f759aee-daa0-49b8-935a-1dd37682deec tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:12.296710 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-b85cd703-753a-4064-a4cc-43314de43042 tempest-SecurityGroupRulesTestJSON-411899809 tempest-SecurityGroupRulesTestJSON-411899809-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/13a84ce9-a7d0-4f06-b9ef-568692d7d58b" status: 202 len: 0 microversion: 2.1 time: 0.589824 Oct 22 21:07:12.297834 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1896/3777] 10.222.0.18 () {58 vars in 1272 bytes} [Sat Oct 22 21:07:11 2022] DELETE /compute/v2.1/os-security-groups/13a84ce9-a7d0-4f06-b9ef-568692d7d58b => generated 0 bytes in 592 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 21:07:12.308381 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-77642ce3-a6ac-44d3-b202-3e5ce685629a tempest-SecurityGroupRulesTestJSON-411899809 tempest-SecurityGroupRulesTestJSON-411899809-project] Calling method '.version_select at 0x7fd3a477d550>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:07:12.393540 ncdv-master-1 devstack@n-api.service[138745]: DEBUG neutronclient.v2_0.client [None req-77642ce3-a6ac-44d3-b202-3e5ce685629a tempest-SecurityGroupRulesTestJSON-411899809 tempest-SecurityGroupRulesTestJSON-411899809-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 27f9b0a5-3581-4682-a1ce-5224dd981ae3 does not exist", "detail": ""}} {{(pid=138745) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 22 21:07:12.394635 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.network.security_group_api [None req-77642ce3-a6ac-44d3-b202-3e5ce685629a tempest-SecurityGroupRulesTestJSON-411899809 tempest-SecurityGroupRulesTestJSON-411899809-project] Neutron security group 27f9b0a5-3581-4682-a1ce-5224dd981ae3 not found {{(pid=138745) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 22 21:07:12.396222 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.wsgi [None req-77642ce3-a6ac-44d3-b202-3e5ce685629a tempest-SecurityGroupRulesTestJSON-411899809 tempest-SecurityGroupRulesTestJSON-411899809-project] HTTP exception thrown: Security group 27f9b0a5-3581-4682-a1ce-5224dd981ae3 does not exist Oct 22 21:07:12.396222 ncdv-master-1 devstack@n-api.service[138745]: Neutron server returns request_ids: ['req-30cdd9bc-c866-47b3-af6c-3e9192f79064'] Oct 22 21:07:12.399520 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-77642ce3-a6ac-44d3-b202-3e5ce685629a tempest-SecurityGroupRulesTestJSON-411899809 tempest-SecurityGroupRulesTestJSON-411899809-project] Request method failure captured: Oct 22 21:07:12.399520 ncdv-master-1 devstack@n-api.service[138745]: request: DELETE /compute/v2.1/os-security-groups/27f9b0a5-3581-4682-a1ce-5224dd981ae3 HTTP/1.1 Oct 22 21:07:12.399520 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 21:07:12.399520 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 21:07:12.399520 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 21:07:12.399520 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 0 Oct 22 21:07:12.399520 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 21:07:12.399520 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 21:07:12.399520 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 21:07:12.399520 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 21:07:12.399520 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVFtxsUAoU1kKHE4TSXWAfUAwW492tjfpF8hbLzBynCiJWm5gmikkdWihbAp5Zr8qvBikf_Qe5j4Q5O1fV9xH1Hv3U-Xmc-nac3yaT9KmcxOwE2sQHQTiAflC6xb_r-CGM-J_H7j_TYy1P6brM4nCGskLbXLgqiTdrQXk0bLMUBxafJo Oct 22 21:07:12.399520 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 21:07:12.399520 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 21:07:12.399520 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 21:07:12.399520 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 21:07:12.399520 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 21:07:12.399520 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 21:07:12.399520 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: 329e3f7a9813495dbcb522c5581d01d4 Oct 22 21:07:12.399520 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-SecurityGroupRulesTestJSON-411899809 Oct 22 21:07:12.399520 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 21:07:12.399520 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 21:07:12.399520 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_329e3f7a9813495dbcb522c5581d01d4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/329e3f7a9813495dbcb522c5581d01d4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/329e3f7a9813495dbcb522c5581d01d4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/329e3f7a9813495dbcb522c5581d01d4"}]}] Oct 22 21:07:12.399520 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-SecurityGroupRulesTestJSON-411899809 Oct 22 21:07:12.399520 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: 329e3f7a9813495dbcb522c5581d01d4 Oct 22 21:07:12.399520 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-SecurityGroupRulesTestJSON-411899809 Oct 22 21:07:12.399520 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-SecurityGroupRulesTestJSON-411899809-project Oct 22 21:07:12.399520 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 21:07:12.399520 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 21:07:12.399520 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: c45aa1c5b66f4494926c292363d967ad Oct 22 21:07:12.399520 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-SecurityGroupRulesTestJSON-411899809-project Oct 22 21:07:12.399520 ncdv-master-1 devstack@n-api.service[138745]: method: Oct 22 21:07:12.399520 ncdv-master-1 devstack@n-api.service[138745]: exception: Security group 27f9b0a5-3581-4682-a1ce-5224dd981ae3 does not exist Oct 22 21:07:12.399520 ncdv-master-1 devstack@n-api.service[138745]: Neutron server returns request_ids: ['req-30cdd9bc-c866-47b3-af6c-3e9192f79064'] Oct 22 21:07:12.399520 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'id': '27f9b0a5-3581-4682-a1ce-5224dd981ae3'} Oct 22 21:07:12.399520 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:07:12.399520 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:07:12.399520 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 22 21:07:12.399520 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 22 21:07:12.399520 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 21:07:12.399520 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 21:07:12.399520 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 22 21:07:12.399520 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 22 21:07:12.399520 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 21:07:12.399520 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 21:07:12.399520 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 22 21:07:12.399520 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 22 21:07:12.399520 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 21:07:12.399520 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 21:07:12.399520 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 22 21:07:12.399520 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 22 21:07:12.399520 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 21:07:12.399520 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 21:07:12.399520 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 22 21:07:12.399520 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 22 21:07:12.399520 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 21:07:12.399520 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 21:07:12.399520 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 22 21:07:12.399520 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 22 21:07:12.399520 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 22 21:07:12.399520 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 22 21:07:12.399520 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 27f9b0a5-3581-4682-a1ce-5224dd981ae3 does not exist Oct 22 21:07:12.402873 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-30cdd9bc-c866-47b3-af6c-3e9192f79064'] Oct 22 21:07:12.402873 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:07:12.402873 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:07:12.402873 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:07:12.402873 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:07:12.402873 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 22 21:07:12.402873 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 22 21:07:12.402873 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 22 21:07:12.402873 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 22 21:07:12.402873 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 27f9b0a5-3581-4682-a1ce-5224dd981ae3 does not exist Oct 22 21:07:12.402873 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-30cdd9bc-c866-47b3-af6c-3e9192f79064'] Oct 22 21:07:12.402873 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:07:12.402873 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:07:12.402873 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:07:12.402873 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:07:12.402873 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:07:12.402873 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:07:12.402873 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:07:12.402873 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:07:12.402873 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 22 21:07:12.402873 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 22 21:07:12.402873 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:07:12.402873 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:07:12.402873 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 22 21:07:12.402873 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 22 21:07:12.402873 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 27f9b0a5-3581-4682-a1ce-5224dd981ae3 does not exist Oct 22 21:07:12.402873 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-30cdd9bc-c866-47b3-af6c-3e9192f79064'] Oct 22 21:07:12.402873 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:07:12.402873 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:07:12.402873 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:07:12.402873 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:07:12.402873 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:07:12.402873 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:07:12.402873 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:07:12.402873 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:07:12.402873 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 27f9b0a5-3581-4682-a1ce-5224dd981ae3 does not exist Oct 22 21:07:12.402873 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-30cdd9bc-c866-47b3-af6c-3e9192f79064'] Oct 22 21:07:12.402873 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:07:12.408294 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-77642ce3-a6ac-44d3-b202-3e5ce685629a tempest-SecurityGroupRulesTestJSON-411899809 tempest-SecurityGroupRulesTestJSON-411899809-project] Returning 404 to user: Security group 27f9b0a5-3581-4682-a1ce-5224dd981ae3 does not exist Oct 22 21:07:12.408294 ncdv-master-1 devstack@n-api.service[138745]: Neutron server returns request_ids: ['req-30cdd9bc-c866-47b3-af6c-3e9192f79064'] {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:07:12.409657 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-77642ce3-a6ac-44d3-b202-3e5ce685629a tempest-SecurityGroupRulesTestJSON-411899809 tempest-SecurityGroupRulesTestJSON-411899809-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/27f9b0a5-3581-4682-a1ce-5224dd981ae3" status: 404 len: 194 microversion: 2.1 time: 0.106936 Oct 22 21:07:12.410749 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1897/3778] 10.222.0.18 () {58 vars in 1272 bytes} [Sat Oct 22 21:07:12 2022] DELETE /compute/v2.1/os-security-groups/27f9b0a5-3581-4682-a1ce-5224dd981ae3 => generated 194 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 22 21:07:12.418552 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-abd64be3-4059-4179-a45b-540338d7f66b tempest-SecurityGroupRulesTestJSON-411899809 tempest-SecurityGroupRulesTestJSON-411899809-project] Calling method '.version_select at 0x7fd39fe47670>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:07:12.645793 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-2f759aee-daa0-49b8-935a-1dd37682deec tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3820b31a424c3a9216a6ef91fcb285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a42c3ecf474883ac652fcc8c01c9f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:07:12.656421 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-2f759aee-daa0-49b8-935a-1dd37682deec tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] 10.222.0.18 "GET /compute/v2.1/servers/079f3144-b2dd-45f2-a22d-11cd315a31ed" status: 200 len: 1410 microversion: 2.1 time: 0.428726 Oct 22 21:07:12.657014 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1882/3779] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:07:12 2022] GET /compute/v2.1/servers/079f3144-b2dd-45f2-a22d-11cd315a31ed => generated 1410 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:07:12.674098 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-1f1bed42-635c-4cf6-b47c-955827bcf053 tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:07:12.674777 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-1f1bed42-635c-4cf6-b47c-955827bcf053 tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] [instance: d1acfa52-4610-41e8-839a-a5770d77aca4] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:07:12.714288 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1f1bed42-635c-4cf6-b47c-955827bcf053 tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:12.714986 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1f1bed42-635c-4cf6-b47c-955827bcf053 tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:12.715597 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1f1bed42-635c-4cf6-b47c-955827bcf053 tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:12.716483 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1f1bed42-635c-4cf6-b47c-955827bcf053 tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:12.717084 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1f1bed42-635c-4cf6-b47c-955827bcf053 tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:12.717664 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1f1bed42-635c-4cf6-b47c-955827bcf053 tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:12.896567 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-1f1bed42-635c-4cf6-b47c-955827bcf053 tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141118d4043d4e558a78318c162a3ba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89207cb6faa54e83845ed541f10f5aea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:07:12.913003 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-1f1bed42-635c-4cf6-b47c-955827bcf053 tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] 10.222.0.18 "GET /compute/v2.1/servers/d1acfa52-4610-41e8-839a-a5770d77aca4" status: 200 len: 1301 microversion: 2.1 time: 0.249373 Oct 22 21:07:12.915871 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1883/3780] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:07:12 2022] GET /compute/v2.1/servers/d1acfa52-4610-41e8-839a-a5770d77aca4 => generated 1301 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:07:12.928877 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-f7634489-d898-4902-9d39-d0fd46cd94da req-9f4a04af-943b-4be1-b651-fee873defa81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1acfa52-4610-41e8-839a-a5770d77aca4", "name": "network-vif-deleted", "tag": "eab682d3-5531-43f4-b218-824382953c04"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:07:12.941753 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-f7634489-d898-4902-9d39-d0fd46cd94da req-9f4a04af-943b-4be1-b651-fee873defa81 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:12.942238 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-f7634489-d898-4902-9d39-d0fd46cd94da req-9f4a04af-943b-4be1-b651-fee873defa81 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:12.942837 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-f7634489-d898-4902-9d39-d0fd46cd94da req-9f4a04af-943b-4be1-b651-fee873defa81 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:12.957040 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-f7634489-d898-4902-9d39-d0fd46cd94da req-9f4a04af-943b-4be1-b651-fee873defa81 service nova] Creating event network-vif-deleted:eab682d3-5531-43f4-b218-824382953c04 for instance d1acfa52-4610-41e8-839a-a5770d77aca4 on nch1-master-1 Oct 22 21:07:12.965236 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-f7634489-d898-4902-9d39-d0fd46cd94da req-9f4a04af-943b-4be1-b651-fee873defa81 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046642 Oct 22 21:07:12.966957 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1884/3781] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:07:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:07:12.974944 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-60c9c595-07f7-43b3-9bbd-a642bc04cbca req-f5d4ab23-15a4-4ef4-ade7-05007fb87957 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b769064b-9ef9-47b7-9cfd-5d3b8a24a7a1", "name": "network-vif-plugged", "status": "completed", "tag": "ebfc42ff-9ece-4ea7-acbe-047586917889"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:07:12.984500 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-60c9c595-07f7-43b3-9bbd-a642bc04cbca req-f5d4ab23-15a4-4ef4-ade7-05007fb87957 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:12.984983 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-60c9c595-07f7-43b3-9bbd-a642bc04cbca req-f5d4ab23-15a4-4ef4-ade7-05007fb87957 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:12.985419 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-60c9c595-07f7-43b3-9bbd-a642bc04cbca req-f5d4ab23-15a4-4ef4-ade7-05007fb87957 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:12.998054 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-60c9c595-07f7-43b3-9bbd-a642bc04cbca req-f5d4ab23-15a4-4ef4-ade7-05007fb87957 service nova] Creating event network-vif-plugged:ebfc42ff-9ece-4ea7-acbe-047586917889 for instance b769064b-9ef9-47b7-9cfd-5d3b8a24a7a1 on nch2-master-1 Oct 22 21:07:13.004142 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-60c9c595-07f7-43b3-9bbd-a642bc04cbca req-f5d4ab23-15a4-4ef4-ade7-05007fb87957 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035267 Oct 22 21:07:13.005154 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1885/3782] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:07:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:07:13.066228 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-dc8417e9-8126-487a-8b0b-02115e51f735 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:07:13.067541 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-dc8417e9-8126-487a-8b0b-02115e51f735 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] [instance: b769064b-9ef9-47b7-9cfd-5d3b8a24a7a1] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:07:13.089589 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-dc8417e9-8126-487a-8b0b-02115e51f735 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:13.090442 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-dc8417e9-8126-487a-8b0b-02115e51f735 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:13.091696 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-dc8417e9-8126-487a-8b0b-02115e51f735 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:13.093176 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-dc8417e9-8126-487a-8b0b-02115e51f735 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:13.094899 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-dc8417e9-8126-487a-8b0b-02115e51f735 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:13.095597 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-dc8417e9-8126-487a-8b0b-02115e51f735 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:13.754702 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-dc8417e9-8126-487a-8b0b-02115e51f735 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcdfeb6c1cda4810b9fa70fdfd9a66c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c774a85b2c41c98486cf91b1253363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:07:13.762504 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-abd64be3-4059-4179-a45b-540338d7f66b tempest-SecurityGroupRulesTestJSON-411899809 tempest-SecurityGroupRulesTestJSON-411899809-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/f4df8a5d-aa3f-4765-9eba-530dce7dca93" status: 202 len: 0 microversion: 2.1 time: 1.346584 Oct 22 21:07:13.763652 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1898/3783] 10.222.0.18 () {58 vars in 1272 bytes} [Sat Oct 22 21:07:12 2022] DELETE /compute/v2.1/os-security-groups/f4df8a5d-aa3f-4765-9eba-530dce7dca93 => generated 0 bytes in 1349 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 21:07:13.764054 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-dc8417e9-8126-487a-8b0b-02115e51f735 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] 10.222.0.18 "GET /compute/v2.1/servers/b769064b-9ef9-47b7-9cfd-5d3b8a24a7a1" status: 200 len: 1318 microversion: 2.1 time: 0.710554 Oct 22 21:07:13.764631 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1886/3784] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:07:13 2022] GET /compute/v2.1/servers/b769064b-9ef9-47b7-9cfd-5d3b8a24a7a1 => generated 1318 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:07:13.771513 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-c0e11420-9e85-48f4-829c-a9c92a54b2d1 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:07:13.771944 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-bb1fa9a6-0936-47ac-af88-61e825cda1ea tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:07:13.772605 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-bb1fa9a6-0936-47ac-af88-61e825cda1ea tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] [instance: 079f3144-b2dd-45f2-a22d-11cd315a31ed] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:07:13.773227 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-c0e11420-9e85-48f4-829c-a9c92a54b2d1 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] [instance: b1b68e60-81b4-4d1e-8bb8-ab8b94d918a8] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:07:13.784423 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c0e11420-9e85-48f4-829c-a9c92a54b2d1 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:13.786312 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c0e11420-9e85-48f4-829c-a9c92a54b2d1 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:13.787400 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c0e11420-9e85-48f4-829c-a9c92a54b2d1 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:13.789061 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c0e11420-9e85-48f4-829c-a9c92a54b2d1 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:13.789363 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bb1fa9a6-0936-47ac-af88-61e825cda1ea tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:13.790228 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c0e11420-9e85-48f4-829c-a9c92a54b2d1 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:13.791116 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c0e11420-9e85-48f4-829c-a9c92a54b2d1 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:13.792873 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bb1fa9a6-0936-47ac-af88-61e825cda1ea tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:13.796559 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bb1fa9a6-0936-47ac-af88-61e825cda1ea tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:13.799071 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bb1fa9a6-0936-47ac-af88-61e825cda1ea tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:13.799787 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bb1fa9a6-0936-47ac-af88-61e825cda1ea tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:13.800382 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bb1fa9a6-0936-47ac-af88-61e825cda1ea tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:13.948110 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-c0e11420-9e85-48f4-829c-a9c92a54b2d1 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebcd750fac45c183f21cf78ca939d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a73c458655e4b1db78801a8316fbdab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:07:13.959799 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-c0e11420-9e85-48f4-829c-a9c92a54b2d1 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdebcd750fac45c183f21cf78ca939d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a73c458655e4b1db78801a8316fbdab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:07:13.961760 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-c0e11420-9e85-48f4-829c-a9c92a54b2d1 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdebcd750fac45c183f21cf78ca939d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a73c458655e4b1db78801a8316fbdab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:07:13.963193 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-c0e11420-9e85-48f4-829c-a9c92a54b2d1 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] 10.222.0.18 "GET /compute/v2.1/servers/b1b68e60-81b4-4d1e-8bb8-ab8b94d918a8" status: 200 len: 1365 microversion: 2.47 time: 0.197435 Oct 22 21:07:13.963933 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1899/3785] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:07:13 2022] GET /compute/v2.1/servers/b1b68e60-81b4-4d1e-8bb8-ab8b94d918a8 => generated 1365 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:07:13.970301 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-63e34e12-7dae-4afd-abf4-e1f7531ce448 tempest-SecurityGroupRulesTestJSON-411899809 tempest-SecurityGroupRulesTestJSON-411899809-project] Calling method '.version_select at 0x7fd3a44e91f0>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:07:14.081188 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-bb1fa9a6-0936-47ac-af88-61e825cda1ea tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3820b31a424c3a9216a6ef91fcb285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a42c3ecf474883ac652fcc8c01c9f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:07:14.092977 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-bb1fa9a6-0936-47ac-af88-61e825cda1ea tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] 10.222.0.18 "GET /compute/v2.1/servers/079f3144-b2dd-45f2-a22d-11cd315a31ed" status: 200 len: 1410 microversion: 2.1 time: 0.326886 Oct 22 21:07:14.095115 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1887/3786] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:07:13 2022] GET /compute/v2.1/servers/079f3144-b2dd-45f2-a22d-11cd315a31ed => generated 1410 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:07:14.102736 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-6bb18ca3-bc88-415c-b5fe-ac71681a0030 tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:07:14.103427 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-6bb18ca3-bc88-415c-b5fe-ac71681a0030 tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] [instance: d1acfa52-4610-41e8-839a-a5770d77aca4] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:07:14.110359 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6bb18ca3-bc88-415c-b5fe-ac71681a0030 tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:14.110819 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6bb18ca3-bc88-415c-b5fe-ac71681a0030 tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:14.111313 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6bb18ca3-bc88-415c-b5fe-ac71681a0030 tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:14.112422 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6bb18ca3-bc88-415c-b5fe-ac71681a0030 tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:14.113270 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6bb18ca3-bc88-415c-b5fe-ac71681a0030 tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:14.113839 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6bb18ca3-bc88-415c-b5fe-ac71681a0030 tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:14.163978 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-6bb18ca3-bc88-415c-b5fe-ac71681a0030 tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] HTTP exception thrown: Instance d1acfa52-4610-41e8-839a-a5770d77aca4 could not be found. Oct 22 21:07:14.168962 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-6bb18ca3-bc88-415c-b5fe-ac71681a0030 tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] Request method failure captured: Oct 22 21:07:14.168962 ncdv-master-1 devstack@n-api.service[138744]: request: GET /compute/v2.1/servers/d1acfa52-4610-41e8-839a-a5770d77aca4 HTTP/1.1 Oct 22 21:07:14.168962 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 21:07:14.168962 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 21:07:14.168962 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 21:07:14.168962 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 0 Oct 22 21:07:14.168962 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 21:07:14.168962 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 21:07:14.168962 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 21:07:14.168962 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 21:07:14.168962 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVFtgjJzverltNwvtFMkwysvVm-Lrp3oTSp3HoQQw2KrffRSEVbOQr0_V10lBLyo8DI2dn0TUN4MT4FO4Dcl6Q7IdmsAWl8erGfmEa64MprkVnOZyhhCfPpOMNwdGKzQGo10c2Zykfzxl76WGvqOoUb0ZUlBvb60klrP2pm5pe_qykWo Oct 22 21:07:14.168962 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 21:07:14.168962 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 21:07:14.168962 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 21:07:14.168962 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 21:07:14.168962 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 21:07:14.168962 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 21:07:14.168962 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: 89207cb6faa54e83845ed541f10f5aea Oct 22 21:07:14.168962 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-InstanceActionsTestJSON-1131350965 Oct 22 21:07:14.168962 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 21:07:14.168962 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 21:07:14.168962 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_89207cb6faa54e83845ed541f10f5aea"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/89207cb6faa54e83845ed541f10f5aea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/89207cb6faa54e83845ed541f10f5aea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/89207cb6faa54e83845ed541f10f5aea"}]}] Oct 22 21:07:14.168962 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-InstanceActionsTestJSON-1131350965 Oct 22 21:07:14.168962 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: 89207cb6faa54e83845ed541f10f5aea Oct 22 21:07:14.168962 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-InstanceActionsTestJSON-1131350965 Oct 22 21:07:14.168962 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-InstanceActionsTestJSON-1131350965-project Oct 22 21:07:14.168962 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 21:07:14.168962 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 21:07:14.168962 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: 141118d4043d4e558a78318c162a3ba2 Oct 22 21:07:14.168962 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-InstanceActionsTestJSON-1131350965-project Oct 22 21:07:14.168962 ncdv-master-1 devstack@n-api.service[138744]: method: > Oct 22 21:07:14.168962 ncdv-master-1 devstack@n-api.service[138744]: exception: Instance d1acfa52-4610-41e8-839a-a5770d77aca4 could not be found. Oct 22 21:07:14.168962 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': 'd1acfa52-4610-41e8-839a-a5770d77aca4'} Oct 22 21:07:14.168962 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:07:14.168962 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:07:14.168962 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 21:07:14.168962 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 21:07:14.168962 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 21:07:14.168962 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 21:07:14.168962 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 21:07:14.168962 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 21:07:14.168962 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 21:07:14.168962 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 21:07:14.168962 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d1acfa52-4610-41e8-839a-a5770d77aca4 could not be found. Oct 22 21:07:14.168962 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:07:14.168962 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:07:14.168962 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:07:14.168962 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:07:14.168962 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:07:14.168962 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:07:14.168962 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:07:14.168962 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:07:14.168962 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:07:14.168962 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:07:14.168962 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 21:07:14.168962 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 21:07:14.168962 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 21:07:14.168962 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 21:07:14.168962 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 21:07:14.168962 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:07:14.168962 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d1acfa52-4610-41e8-839a-a5770d77aca4 could not be found. Oct 22 21:07:14.168962 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:07:14.168962 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:07:14.168962 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:07:14.172834 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:07:14.172834 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:07:14.172834 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:07:14.172834 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:07:14.172834 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:07:14.172834 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d1acfa52-4610-41e8-839a-a5770d77aca4 could not be found. Oct 22 21:07:14.172834 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:07:14.172834 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-6bb18ca3-bc88-415c-b5fe-ac71681a0030 tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] Returning 404 to user: Instance d1acfa52-4610-41e8-839a-a5770d77aca4 could not be found. {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:07:14.176733 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-6bb18ca3-bc88-415c-b5fe-ac71681a0030 tempest-InstanceActionsTestJSON-1131350965 tempest-InstanceActionsTestJSON-1131350965-project] 10.222.0.18 "GET /compute/v2.1/servers/d1acfa52-4610-41e8-839a-a5770d77aca4" status: 404 len: 111 microversion: 2.1 time: 0.075436 Oct 22 21:07:14.178277 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1888/3787] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:07:14 2022] GET /compute/v2.1/servers/d1acfa52-4610-41e8-839a-a5770d77aca4 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 21:07:14.258414 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-051fc6d2-bc23-4ca1-bad6-9f20d4d55ce2 req-487abaf7-f6aa-4e7d-85f8-396bee41d46d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "079f3144-b2dd-45f2-a22d-11cd315a31ed", "name": "network-vif-deleted", "tag": "1466d21d-d248-44a7-abb0-91471f031e6a"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:07:14.281058 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-051fc6d2-bc23-4ca1-bad6-9f20d4d55ce2 req-487abaf7-f6aa-4e7d-85f8-396bee41d46d service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:14.281546 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-051fc6d2-bc23-4ca1-bad6-9f20d4d55ce2 req-487abaf7-f6aa-4e7d-85f8-396bee41d46d service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:14.282183 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-051fc6d2-bc23-4ca1-bad6-9f20d4d55ce2 req-487abaf7-f6aa-4e7d-85f8-396bee41d46d service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:14.302747 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-051fc6d2-bc23-4ca1-bad6-9f20d4d55ce2 req-487abaf7-f6aa-4e7d-85f8-396bee41d46d service nova] Creating event network-vif-deleted:1466d21d-d248-44a7-abb0-91471f031e6a for instance 079f3144-b2dd-45f2-a22d-11cd315a31ed on nch2-master-1 Oct 22 21:07:14.309720 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-051fc6d2-bc23-4ca1-bad6-9f20d4d55ce2 req-487abaf7-f6aa-4e7d-85f8-396bee41d46d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059328 Oct 22 21:07:14.311288 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1889/3788] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:07:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 21:07:14.404321 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-63e34e12-7dae-4afd-abf4-e1f7531ce448 tempest-SecurityGroupRulesTestJSON-411899809 tempest-SecurityGroupRulesTestJSON-411899809-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/288ad399-8f16-4edb-b51e-6a13ff996e24" status: 202 len: 0 microversion: 2.1 time: 0.438634 Oct 22 21:07:14.405384 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1900/3789] 10.222.0.18 () {58 vars in 1272 bytes} [Sat Oct 22 21:07:13 2022] DELETE /compute/v2.1/os-security-groups/288ad399-8f16-4edb-b51e-6a13ff996e24 => generated 0 bytes in 441 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 21:07:14.415861 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-b2935739-bfdb-4983-81f7-1ad8a31ac976 tempest-SecurityGroupRulesTestJSON-411899809 tempest-SecurityGroupRulesTestJSON-411899809-project] Calling method '.version_select at 0x7fd39ee89f70>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:07:14.426609 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell0:SELECT=8 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:07:14.750972 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-b2935739-bfdb-4983-81f7-1ad8a31ac976 tempest-SecurityGroupRulesTestJSON-411899809 tempest-SecurityGroupRulesTestJSON-411899809-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/3ad7aff0-42c7-4cd7-9531-6b8b2e99dec0" status: 202 len: 0 microversion: 2.1 time: 0.340513 Oct 22 21:07:14.751715 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1890/3790] 10.222.0.18 () {58 vars in 1272 bytes} [Sat Oct 22 21:07:14 2022] DELETE /compute/v2.1/os-security-groups/3ad7aff0-42c7-4cd7-9531-6b8b2e99dec0 => generated 0 bytes in 343 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 21:07:14.768403 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-106f86ef-131c-4888-8c94-e46f450981e6 tempest-SecurityGroupRulesTestJSON-411899809 tempest-SecurityGroupRulesTestJSON-411899809-project] Calling method '.version_select at 0x7fd3a482aee0>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:07:14.794998 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-5bd85caf-31c9-4bc6-9de2-1092ea146362 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:07:14.796452 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-5bd85caf-31c9-4bc6-9de2-1092ea146362 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] [instance: b769064b-9ef9-47b7-9cfd-5d3b8a24a7a1] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:07:14.818180 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5bd85caf-31c9-4bc6-9de2-1092ea146362 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:14.823228 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5bd85caf-31c9-4bc6-9de2-1092ea146362 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:14.824144 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5bd85caf-31c9-4bc6-9de2-1092ea146362 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:14.825115 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5bd85caf-31c9-4bc6-9de2-1092ea146362 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:14.829736 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5bd85caf-31c9-4bc6-9de2-1092ea146362 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:14.830789 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5bd85caf-31c9-4bc6-9de2-1092ea146362 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:15.157918 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-5bd85caf-31c9-4bc6-9de2-1092ea146362 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcdfeb6c1cda4810b9fa70fdfd9a66c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c774a85b2c41c98486cf91b1253363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:07:15.168298 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-5bd85caf-31c9-4bc6-9de2-1092ea146362 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] 10.222.0.18 "GET /compute/v2.1/servers/b769064b-9ef9-47b7-9cfd-5d3b8a24a7a1" status: 200 len: 1318 microversion: 2.1 time: 0.378578 Oct 22 21:07:15.174635 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1891/3791] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:07:14 2022] GET /compute/v2.1/servers/b769064b-9ef9-47b7-9cfd-5d3b8a24a7a1 => generated 1318 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:07:15.180258 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-8c2bb599-c5bd-4b08-94d5-b40cda786098 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:07:15.180886 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-8c2bb599-c5bd-4b08-94d5-b40cda786098 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] [instance: b1b68e60-81b4-4d1e-8bb8-ab8b94d918a8] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:07:15.196848 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8c2bb599-c5bd-4b08-94d5-b40cda786098 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:15.197645 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8c2bb599-c5bd-4b08-94d5-b40cda786098 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:15.200090 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8c2bb599-c5bd-4b08-94d5-b40cda786098 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:15.203694 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8c2bb599-c5bd-4b08-94d5-b40cda786098 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:15.204248 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8c2bb599-c5bd-4b08-94d5-b40cda786098 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:15.204689 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8c2bb599-c5bd-4b08-94d5-b40cda786098 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:15.359394 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-8c2bb599-c5bd-4b08-94d5-b40cda786098 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebcd750fac45c183f21cf78ca939d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a73c458655e4b1db78801a8316fbdab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:07:15.371421 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-8c2bb599-c5bd-4b08-94d5-b40cda786098 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdebcd750fac45c183f21cf78ca939d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a73c458655e4b1db78801a8316fbdab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:07:15.373590 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-8c2bb599-c5bd-4b08-94d5-b40cda786098 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdebcd750fac45c183f21cf78ca939d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a73c458655e4b1db78801a8316fbdab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:07:15.373793 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-106f86ef-131c-4888-8c94-e46f450981e6 tempest-SecurityGroupRulesTestJSON-411899809 tempest-SecurityGroupRulesTestJSON-411899809-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/8ab409f8-13bb-449d-987b-6cd5f5f2695d" status: 202 len: 0 microversion: 2.1 time: 0.616683 Oct 22 21:07:15.375246 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-8c2bb599-c5bd-4b08-94d5-b40cda786098 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] 10.222.0.18 "GET /compute/v2.1/servers/b1b68e60-81b4-4d1e-8bb8-ab8b94d918a8" status: 200 len: 1365 microversion: 2.47 time: 0.198889 Oct 22 21:07:15.375422 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1901/3792] 10.222.0.18 () {58 vars in 1272 bytes} [Sat Oct 22 21:07:14 2022] DELETE /compute/v2.1/os-security-groups/8ab409f8-13bb-449d-987b-6cd5f5f2695d => generated 0 bytes in 619 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 21:07:15.376566 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1892/3793] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:07:15 2022] GET /compute/v2.1/servers/b1b68e60-81b4-4d1e-8bb8-ab8b94d918a8 => generated 1365 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:07:15.384735 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-2d49ae07-1f60-4718-bc3b-7cbe6c01c51e tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:07:15.385374 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-2d49ae07-1f60-4718-bc3b-7cbe6c01c51e tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] [instance: 079f3144-b2dd-45f2-a22d-11cd315a31ed] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:07:15.390706 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-46402d8a-27a5-462b-9fe6-489a57d4bbf7 tempest-SecurityGroupRulesTestJSON-411899809 tempest-SecurityGroupRulesTestJSON-411899809-project] Calling method '.version_select at 0x7fd39ef9f310>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:07:15.397361 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2d49ae07-1f60-4718-bc3b-7cbe6c01c51e tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:15.398801 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2d49ae07-1f60-4718-bc3b-7cbe6c01c51e tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:15.399675 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2d49ae07-1f60-4718-bc3b-7cbe6c01c51e tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:15.400976 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2d49ae07-1f60-4718-bc3b-7cbe6c01c51e tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:15.401807 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2d49ae07-1f60-4718-bc3b-7cbe6c01c51e tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:15.402476 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2d49ae07-1f60-4718-bc3b-7cbe6c01c51e tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:15.451928 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2d49ae07-1f60-4718-bc3b-7cbe6c01c51e tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:15.453010 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2d49ae07-1f60-4718-bc3b-7cbe6c01c51e tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:15.453778 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2d49ae07-1f60-4718-bc3b-7cbe6c01c51e tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:15.454697 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.objects.instance [None req-2d49ae07-1f60-4718-bc3b-7cbe6c01c51e tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lazy-loading 'fault' on Instance uuid 079f3144-b2dd-45f2-a22d-11cd315a31ed {{(pid=138745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 21:07:15.537311 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-2d49ae07-1f60-4718-bc3b-7cbe6c01c51e tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3820b31a424c3a9216a6ef91fcb285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a42c3ecf474883ac652fcc8c01c9f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:07:15.550559 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-2d49ae07-1f60-4718-bc3b-7cbe6c01c51e tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] 10.222.0.18 "GET /compute/v2.1/servers/079f3144-b2dd-45f2-a22d-11cd315a31ed" status: 200 len: 1206 microversion: 2.1 time: 0.172736 Oct 22 21:07:15.551909 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1902/3794] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:07:15 2022] GET /compute/v2.1/servers/079f3144-b2dd-45f2-a22d-11cd315a31ed => generated 1206 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:07:15.805302 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-46402d8a-27a5-462b-9fe6-489a57d4bbf7 tempest-SecurityGroupRulesTestJSON-411899809 tempest-SecurityGroupRulesTestJSON-411899809-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/c6927d41-9018-49cf-87e3-9789898c9721" status: 202 len: 0 microversion: 2.1 time: 0.423523 Oct 22 21:07:15.806039 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1893/3795] 10.222.0.18 () {58 vars in 1272 bytes} [Sat Oct 22 21:07:15 2022] DELETE /compute/v2.1/os-security-groups/c6927d41-9018-49cf-87e3-9789898c9721 => generated 0 bytes in 425 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 21:07:16.198103 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-a89f9efe-7fd2-4c7a-bfca-01c94ca31c57 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:07:16.198847 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-a89f9efe-7fd2-4c7a-bfca-01c94ca31c57 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] [instance: b769064b-9ef9-47b7-9cfd-5d3b8a24a7a1] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:07:16.209708 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a89f9efe-7fd2-4c7a-bfca-01c94ca31c57 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:16.217910 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a89f9efe-7fd2-4c7a-bfca-01c94ca31c57 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:16.218698 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a89f9efe-7fd2-4c7a-bfca-01c94ca31c57 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:16.219923 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a89f9efe-7fd2-4c7a-bfca-01c94ca31c57 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:16.220674 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a89f9efe-7fd2-4c7a-bfca-01c94ca31c57 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:16.221506 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a89f9efe-7fd2-4c7a-bfca-01c94ca31c57 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:16.404724 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-64f67006-b492-4107-9310-181097f42dd4 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:07:16.405471 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-64f67006-b492-4107-9310-181097f42dd4 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] [instance: b1b68e60-81b4-4d1e-8bb8-ab8b94d918a8] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:07:16.419482 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-64f67006-b492-4107-9310-181097f42dd4 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:16.420427 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-64f67006-b492-4107-9310-181097f42dd4 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:16.421352 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-64f67006-b492-4107-9310-181097f42dd4 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:16.422911 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-64f67006-b492-4107-9310-181097f42dd4 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:16.425540 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-64f67006-b492-4107-9310-181097f42dd4 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:16.426292 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-64f67006-b492-4107-9310-181097f42dd4 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:16.527248 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-a89f9efe-7fd2-4c7a-bfca-01c94ca31c57 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcdfeb6c1cda4810b9fa70fdfd9a66c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c774a85b2c41c98486cf91b1253363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:07:16.542467 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-a89f9efe-7fd2-4c7a-bfca-01c94ca31c57 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] 10.222.0.18 "GET /compute/v2.1/servers/b769064b-9ef9-47b7-9cfd-5d3b8a24a7a1" status: 200 len: 1508 microversion: 2.1 time: 0.349225 Oct 22 21:07:16.548464 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1903/3796] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:07:16 2022] GET /compute/v2.1/servers/b769064b-9ef9-47b7-9cfd-5d3b8a24a7a1 => generated 1508 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:07:16.574637 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-64f67006-b492-4107-9310-181097f42dd4 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebcd750fac45c183f21cf78ca939d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a73c458655e4b1db78801a8316fbdab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:07:16.575685 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-95856940-3b4e-4fc3-9438-73fcee18aec7 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:07:16.576334 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-95856940-3b4e-4fc3-9438-73fcee18aec7 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] [instance: b769064b-9ef9-47b7-9cfd-5d3b8a24a7a1] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:07:16.591202 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-95856940-3b4e-4fc3-9438-73fcee18aec7 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:16.592066 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-95856940-3b4e-4fc3-9438-73fcee18aec7 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:16.592875 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-95856940-3b4e-4fc3-9438-73fcee18aec7 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:16.593996 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-95856940-3b4e-4fc3-9438-73fcee18aec7 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:16.595658 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-95856940-3b4e-4fc3-9438-73fcee18aec7 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:16.596152 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-95856940-3b4e-4fc3-9438-73fcee18aec7 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:16.599783 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-64f67006-b492-4107-9310-181097f42dd4 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdebcd750fac45c183f21cf78ca939d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a73c458655e4b1db78801a8316fbdab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:07:16.604942 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-64f67006-b492-4107-9310-181097f42dd4 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdebcd750fac45c183f21cf78ca939d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a73c458655e4b1db78801a8316fbdab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:07:16.609562 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-64f67006-b492-4107-9310-181097f42dd4 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] 10.222.0.18 "GET /compute/v2.1/servers/b1b68e60-81b4-4d1e-8bb8-ab8b94d918a8" status: 200 len: 1365 microversion: 2.47 time: 0.207710 Oct 22 21:07:16.611256 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1894/3797] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:07:16 2022] GET /compute/v2.1/servers/b1b68e60-81b4-4d1e-8bb8-ab8b94d918a8 => generated 1365 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:07:16.624114 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-94614f40-e3db-4751-9ebc-c363c8a9f7b5 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:07:16.624970 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-94614f40-e3db-4751-9ebc-c363c8a9f7b5 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] [instance: 079f3144-b2dd-45f2-a22d-11cd315a31ed] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:07:16.639250 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-94614f40-e3db-4751-9ebc-c363c8a9f7b5 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:16.644819 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-94614f40-e3db-4751-9ebc-c363c8a9f7b5 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:16.647021 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-94614f40-e3db-4751-9ebc-c363c8a9f7b5 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:16.649014 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-94614f40-e3db-4751-9ebc-c363c8a9f7b5 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:16.649655 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-94614f40-e3db-4751-9ebc-c363c8a9f7b5 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:16.650322 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-94614f40-e3db-4751-9ebc-c363c8a9f7b5 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:16.670314 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-94614f40-e3db-4751-9ebc-c363c8a9f7b5 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] HTTP exception thrown: Instance 079f3144-b2dd-45f2-a22d-11cd315a31ed could not be found. Oct 22 21:07:16.672696 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-94614f40-e3db-4751-9ebc-c363c8a9f7b5 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Request method failure captured: Oct 22 21:07:16.672696 ncdv-master-1 devstack@n-api.service[138744]: request: GET /compute/v2.1/servers/079f3144-b2dd-45f2-a22d-11cd315a31ed HTTP/1.1 Oct 22 21:07:16.672696 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 21:07:16.672696 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 21:07:16.672696 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 21:07:16.672696 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 0 Oct 22 21:07:16.672696 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 21:07:16.672696 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 21:07:16.672696 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 21:07:16.672696 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 21:07:16.672696 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVFrcKw86EUEeUngnG9DZUJvE3lmhBNDPmC4isrFt9sa-3M5uM6HCkY-mE9Fr6XyLPpjJ3yZx9ru813oA85o16iJwDuF8Nlz1bpd8p9u41wsyi0Zep7ygHQQJ9tgdQV6IQKIEN7AplmICrhSHFCRaS0cX6FN1kXuVbLH1K6CsNjHq7jM Oct 22 21:07:16.672696 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 21:07:16.672696 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 21:07:16.672696 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 21:07:16.672696 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 21:07:16.672696 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 21:07:16.672696 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 21:07:16.672696 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: 82a42c3ecf474883ac652fcc8c01c9f2 Oct 22 21:07:16.672696 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-TestVolumeBootPattern-1443368191 Oct 22 21:07:16.672696 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 21:07:16.672696 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 21:07:16.672696 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_82a42c3ecf474883ac652fcc8c01c9f2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/82a42c3ecf474883ac652fcc8c01c9f2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/82a42c3ecf474883ac652fcc8c01c9f2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/82a42c3ecf474883ac652fcc8c01c9f2"}]}] Oct 22 21:07:16.672696 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-TestVolumeBootPattern-1443368191 Oct 22 21:07:16.672696 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: 82a42c3ecf474883ac652fcc8c01c9f2 Oct 22 21:07:16.672696 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-TestVolumeBootPattern-1443368191 Oct 22 21:07:16.672696 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-TestVolumeBootPattern-1443368191-project Oct 22 21:07:16.672696 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 21:07:16.672696 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 21:07:16.672696 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: 7e3820b31a424c3a9216a6ef91fcb285 Oct 22 21:07:16.672696 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-TestVolumeBootPattern-1443368191-project Oct 22 21:07:16.672696 ncdv-master-1 devstack@n-api.service[138744]: method: > Oct 22 21:07:16.672696 ncdv-master-1 devstack@n-api.service[138744]: exception: Instance 079f3144-b2dd-45f2-a22d-11cd315a31ed could not be found. Oct 22 21:07:16.672696 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': '079f3144-b2dd-45f2-a22d-11cd315a31ed'} Oct 22 21:07:16.672696 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:07:16.672696 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:07:16.672696 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 21:07:16.672696 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 21:07:16.672696 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 21:07:16.672696 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 21:07:16.672696 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 21:07:16.672696 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 21:07:16.672696 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 21:07:16.672696 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 21:07:16.672696 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 079f3144-b2dd-45f2-a22d-11cd315a31ed could not be found. Oct 22 21:07:16.672696 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:07:16.672696 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:07:16.672696 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:07:16.672696 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:07:16.672696 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:07:16.672696 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:07:16.672696 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:07:16.672696 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:07:16.672696 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:07:16.672696 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:07:16.672696 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 21:07:16.672696 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 21:07:16.672696 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 21:07:16.672696 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 21:07:16.672696 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 21:07:16.672696 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:07:16.672696 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 079f3144-b2dd-45f2-a22d-11cd315a31ed could not be found. Oct 22 21:07:16.672696 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:07:16.672696 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:07:16.672696 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:07:16.677666 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:07:16.677666 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:07:16.677666 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:07:16.677666 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:07:16.677666 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:07:16.677666 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 079f3144-b2dd-45f2-a22d-11cd315a31ed could not be found. Oct 22 21:07:16.677666 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:07:16.679212 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-94614f40-e3db-4751-9ebc-c363c8a9f7b5 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Returning 404 to user: Instance 079f3144-b2dd-45f2-a22d-11cd315a31ed could not be found. {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:07:16.680298 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-94614f40-e3db-4751-9ebc-c363c8a9f7b5 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] 10.222.0.18 "GET /compute/v2.1/servers/079f3144-b2dd-45f2-a22d-11cd315a31ed" status: 404 len: 111 microversion: 2.1 time: 0.066831 Oct 22 21:07:16.681065 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1895/3798] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:07:16 2022] GET /compute/v2.1/servers/079f3144-b2dd-45f2-a22d-11cd315a31ed => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 21:07:17.129327 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-95856940-3b4e-4fc3-9438-73fcee18aec7 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcdfeb6c1cda4810b9fa70fdfd9a66c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c774a85b2c41c98486cf91b1253363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:07:17.141595 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-95856940-3b4e-4fc3-9438-73fcee18aec7 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] 10.222.0.18 "GET /compute/v2.1/servers/b769064b-9ef9-47b7-9cfd-5d3b8a24a7a1" status: 200 len: 1508 microversion: 2.1 time: 0.574848 Oct 22 21:07:17.155372 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1904/3799] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:07:16 2022] GET /compute/v2.1/servers/b769064b-9ef9-47b7-9cfd-5d3b8a24a7a1 => generated 1508 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:07:17.171251 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-5f928e1f-b4f3-4668-a076-51dd6e5bde90 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:07:17.174169 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-5f928e1f-b4f3-4668-a076-51dd6e5bde90 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] [instance: b769064b-9ef9-47b7-9cfd-5d3b8a24a7a1] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:07:17.187507 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-b402200b-261b-448e-b8ce-f544442f2cbb tempest-ComputeTenantNetworksTest-1934371473 tempest-ComputeTenantNetworksTest-1934371473-project] Calling method '.version_select at 0x7fd39ee0d670>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:07:17.203772 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5f928e1f-b4f3-4668-a076-51dd6e5bde90 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:17.204438 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5f928e1f-b4f3-4668-a076-51dd6e5bde90 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:17.204753 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5f928e1f-b4f3-4668-a076-51dd6e5bde90 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:17.205540 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5f928e1f-b4f3-4668-a076-51dd6e5bde90 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:17.207238 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5f928e1f-b4f3-4668-a076-51dd6e5bde90 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:17.207744 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5f928e1f-b4f3-4668-a076-51dd6e5bde90 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:17.387783 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-5f928e1f-b4f3-4668-a076-51dd6e5bde90 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] 10.222.0.18 "PUT /compute/v2.1/servers/b769064b-9ef9-47b7-9cfd-5d3b8a24a7a1" status: 200 len: 1080 microversion: 2.1 time: 0.220459 Oct 22 21:07:17.392418 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1905/3800] 10.222.0.18 () {60 vars in 1256 bytes} [Sat Oct 22 21:07:17 2022] PUT /compute/v2.1/servers/b769064b-9ef9-47b7-9cfd-5d3b8a24a7a1 => generated 1080 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:07:17.416761 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-629fc846-eece-4b3b-894e-b1b3635d9614 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:07:17.417700 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-629fc846-eece-4b3b-894e-b1b3635d9614 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] [instance: b769064b-9ef9-47b7-9cfd-5d3b8a24a7a1] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:07:17.428802 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-629fc846-eece-4b3b-894e-b1b3635d9614 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:17.434954 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-629fc846-eece-4b3b-894e-b1b3635d9614 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:17.434954 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-629fc846-eece-4b3b-894e-b1b3635d9614 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:17.434954 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-629fc846-eece-4b3b-894e-b1b3635d9614 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:17.435185 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-629fc846-eece-4b3b-894e-b1b3635d9614 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:17.444206 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-629fc846-eece-4b3b-894e-b1b3635d9614 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:17.802568 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-b402200b-261b-448e-b8ce-f544442f2cbb tempest-ComputeTenantNetworksTest-1934371473 tempest-ComputeTenantNetworksTest-1934371473-project] 10.222.0.18 "GET /compute/v2.1/os-tenant-networks" status: 200 len: 309 microversion: 2.1 time: 0.849671 Oct 22 21:07:17.803223 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1896/3801] 10.222.0.18 () {58 vars in 1158 bytes} [Sat Oct 22 21:07:16 2022] GET /compute/v2.1/os-tenant-networks => generated 309 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:07:17.809885 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-ae77c024-1c8e-4925-a262-ce72419032d0 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:07:17.810719 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-ae77c024-1c8e-4925-a262-ce72419032d0 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] [instance: b1b68e60-81b4-4d1e-8bb8-ab8b94d918a8] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:07:17.826331 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ae77c024-1c8e-4925-a262-ce72419032d0 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:17.826850 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ae77c024-1c8e-4925-a262-ce72419032d0 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:17.827310 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ae77c024-1c8e-4925-a262-ce72419032d0 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:17.831288 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ae77c024-1c8e-4925-a262-ce72419032d0 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:17.831858 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ae77c024-1c8e-4925-a262-ce72419032d0 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:17.832314 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ae77c024-1c8e-4925-a262-ce72419032d0 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:17.869141 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-629fc846-eece-4b3b-894e-b1b3635d9614 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcdfeb6c1cda4810b9fa70fdfd9a66c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c774a85b2c41c98486cf91b1253363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:07:17.879307 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-629fc846-eece-4b3b-894e-b1b3635d9614 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] 10.222.0.18 "GET /compute/v2.1/servers/b769064b-9ef9-47b7-9cfd-5d3b8a24a7a1" status: 200 len: 1506 microversion: 2.1 time: 0.467883 Oct 22 21:07:17.880855 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1906/3802] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:07:17 2022] GET /compute/v2.1/servers/b769064b-9ef9-47b7-9cfd-5d3b8a24a7a1 => generated 1506 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:07:17.898885 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-7ffb4f56-c712-449c-985d-32fccd8dcc7d tempest-ComputeTenantNetworksTest-1934371473 tempest-ComputeTenantNetworksTest-1934371473-project] Calling method '.version_select at 0x7fd3a4dfa8b0>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:07:18.001910 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-ae77c024-1c8e-4925-a262-ce72419032d0 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebcd750fac45c183f21cf78ca939d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a73c458655e4b1db78801a8316fbdab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:07:18.034792 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-ae77c024-1c8e-4925-a262-ce72419032d0 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdebcd750fac45c183f21cf78ca939d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a73c458655e4b1db78801a8316fbdab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:07:18.038671 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-ae77c024-1c8e-4925-a262-ce72419032d0 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdebcd750fac45c183f21cf78ca939d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a73c458655e4b1db78801a8316fbdab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:07:18.053834 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-ae77c024-1c8e-4925-a262-ce72419032d0 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] 10.222.0.18 "GET /compute/v2.1/servers/b1b68e60-81b4-4d1e-8bb8-ab8b94d918a8" status: 200 len: 1365 microversion: 2.47 time: 0.244482 Oct 22 21:07:18.054439 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1897/3803] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:07:17 2022] GET /compute/v2.1/servers/b1b68e60-81b4-4d1e-8bb8-ab8b94d918a8 => generated 1365 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:07:18.067737 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-1c5998fe-1d88-4fd6-867b-a141bed3a51c tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:07:18.067737 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-1c5998fe-1d88-4fd6-867b-a141bed3a51c tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] [instance: 64318452-365b-4b80-b53b-9367dd8bc826] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:07:18.084378 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1c5998fe-1d88-4fd6-867b-a141bed3a51c tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:18.084893 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1c5998fe-1d88-4fd6-867b-a141bed3a51c tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:18.085344 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1c5998fe-1d88-4fd6-867b-a141bed3a51c tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:18.086070 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1c5998fe-1d88-4fd6-867b-a141bed3a51c tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:18.090219 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1c5998fe-1d88-4fd6-867b-a141bed3a51c tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:18.101319 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1c5998fe-1d88-4fd6-867b-a141bed3a51c tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:18.115661 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-7ffb4f56-c712-449c-985d-32fccd8dcc7d tempest-ComputeTenantNetworksTest-1934371473 tempest-ComputeTenantNetworksTest-1934371473-project] 10.222.0.18 "GET /compute/v2.1/os-tenant-networks/ac800f97-fd3c-4224-bf23-f09bfb1eb5ef" status: 200 len: 140 microversion: 2.1 time: 0.233180 Oct 22 21:07:18.116580 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1907/3804] 10.222.0.18 () {58 vars in 1269 bytes} [Sat Oct 22 21:07:17 2022] GET /compute/v2.1/os-tenant-networks/ac800f97-fd3c-4224-bf23-f09bfb1eb5ef => generated 140 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:07:18.123745 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-719edd6a-f026-4f77-8970-e9bb1d2185b2 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:07:18.124390 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-719edd6a-f026-4f77-8970-e9bb1d2185b2 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] [instance: b769064b-9ef9-47b7-9cfd-5d3b8a24a7a1] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:07:18.140457 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-719edd6a-f026-4f77-8970-e9bb1d2185b2 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:18.144120 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-719edd6a-f026-4f77-8970-e9bb1d2185b2 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:18.145382 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-1c5998fe-1d88-4fd6-867b-a141bed3a51c tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] HTTP exception thrown: Instance 64318452-365b-4b80-b53b-9367dd8bc826 could not be found. Oct 22 21:07:18.146046 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-719edd6a-f026-4f77-8970-e9bb1d2185b2 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:18.149027 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-719edd6a-f026-4f77-8970-e9bb1d2185b2 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:18.149727 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-719edd6a-f026-4f77-8970-e9bb1d2185b2 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:18.150883 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-719edd6a-f026-4f77-8970-e9bb1d2185b2 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:18.154460 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-1c5998fe-1d88-4fd6-867b-a141bed3a51c tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Request method failure captured: Oct 22 21:07:18.154460 ncdv-master-1 devstack@n-api.service[138744]: request: DELETE /compute/v2.1/servers/64318452-365b-4b80-b53b-9367dd8bc826 HTTP/1.1 Oct 22 21:07:18.154460 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 21:07:18.154460 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 21:07:18.154460 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 21:07:18.154460 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 0 Oct 22 21:07:18.154460 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 21:07:18.154460 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 21:07:18.154460 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 21:07:18.154460 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 21:07:18.154460 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVFrcKw86EUEeUngnG9DZUJvE3lmhBNDPmC4isrFt9sa-3M5uM6HCkY-mE9Fr6XyLPpjJ3yZx9ru813oA85o16iJwDuF8Nlz1bpd8p9u41wsyi0Zep7ygHQQJ9tgdQV6IQKIEN7AplmICrhSHFCRaS0cX6FN1kXuVbLH1K6CsNjHq7jM Oct 22 21:07:18.154460 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 21:07:18.154460 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 21:07:18.154460 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 21:07:18.154460 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 21:07:18.154460 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 21:07:18.154460 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 21:07:18.154460 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: 82a42c3ecf474883ac652fcc8c01c9f2 Oct 22 21:07:18.154460 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-TestVolumeBootPattern-1443368191 Oct 22 21:07:18.154460 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 21:07:18.154460 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 21:07:18.154460 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_82a42c3ecf474883ac652fcc8c01c9f2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/82a42c3ecf474883ac652fcc8c01c9f2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/82a42c3ecf474883ac652fcc8c01c9f2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/82a42c3ecf474883ac652fcc8c01c9f2"}]}] Oct 22 21:07:18.154460 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-TestVolumeBootPattern-1443368191 Oct 22 21:07:18.154460 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: 82a42c3ecf474883ac652fcc8c01c9f2 Oct 22 21:07:18.154460 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-TestVolumeBootPattern-1443368191 Oct 22 21:07:18.154460 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-TestVolumeBootPattern-1443368191-project Oct 22 21:07:18.154460 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 21:07:18.154460 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 21:07:18.154460 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: 7e3820b31a424c3a9216a6ef91fcb285 Oct 22 21:07:18.154460 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-TestVolumeBootPattern-1443368191-project Oct 22 21:07:18.154460 ncdv-master-1 devstack@n-api.service[138744]: method: > Oct 22 21:07:18.154460 ncdv-master-1 devstack@n-api.service[138744]: exception: Instance 64318452-365b-4b80-b53b-9367dd8bc826 could not be found. Oct 22 21:07:18.154460 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': '64318452-365b-4b80-b53b-9367dd8bc826'} Oct 22 21:07:18.154460 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:07:18.154460 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:07:18.154460 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 21:07:18.154460 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 21:07:18.154460 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 21:07:18.154460 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 21:07:18.154460 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 21:07:18.154460 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 21:07:18.154460 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 21:07:18.154460 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 21:07:18.154460 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64318452-365b-4b80-b53b-9367dd8bc826 could not be found. Oct 22 21:07:18.154460 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:07:18.154460 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:07:18.154460 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:07:18.154460 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:07:18.154460 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:07:18.154460 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:07:18.154460 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:07:18.154460 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:07:18.154460 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:07:18.154460 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:07:18.154460 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 22 21:07:18.154460 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 22 21:07:18.154460 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 22 21:07:18.154460 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 22 21:07:18.154460 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 21:07:18.154460 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 21:07:18.154460 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 21:07:18.154460 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:07:18.158497 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64318452-365b-4b80-b53b-9367dd8bc826 could not be found. Oct 22 21:07:18.158497 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:07:18.158497 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:07:18.158497 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:07:18.158497 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:07:18.158497 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:07:18.158497 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:07:18.158497 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:07:18.158497 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:07:18.158497 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64318452-365b-4b80-b53b-9367dd8bc826 could not be found. Oct 22 21:07:18.158497 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:07:18.164180 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-1c5998fe-1d88-4fd6-867b-a141bed3a51c tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Returning 404 to user: Instance 64318452-365b-4b80-b53b-9367dd8bc826 could not be found. {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:07:18.165343 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-1c5998fe-1d88-4fd6-867b-a141bed3a51c tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] 10.222.0.18 "DELETE /compute/v2.1/servers/64318452-365b-4b80-b53b-9367dd8bc826" status: 404 len: 111 microversion: 2.1 time: 0.104940 Oct 22 21:07:18.167725 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1898/3805] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 21:07:18 2022] DELETE /compute/v2.1/servers/64318452-365b-4b80-b53b-9367dd8bc826 => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 21:07:18.180412 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-53a527c8-bede-4f57-9d20-1ef4eed9dc00 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:07:18.181650 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-53a527c8-bede-4f57-9d20-1ef4eed9dc00 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] [instance: 64318452-365b-4b80-b53b-9367dd8bc826] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:07:18.197261 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-53a527c8-bede-4f57-9d20-1ef4eed9dc00 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:18.197945 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-53a527c8-bede-4f57-9d20-1ef4eed9dc00 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:18.198195 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-53a527c8-bede-4f57-9d20-1ef4eed9dc00 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:18.204952 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-53a527c8-bede-4f57-9d20-1ef4eed9dc00 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:18.207040 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-53a527c8-bede-4f57-9d20-1ef4eed9dc00 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:18.207645 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-53a527c8-bede-4f57-9d20-1ef4eed9dc00 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:18.259605 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-53a527c8-bede-4f57-9d20-1ef4eed9dc00 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] HTTP exception thrown: Instance 64318452-365b-4b80-b53b-9367dd8bc826 could not be found. Oct 22 21:07:18.265298 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-53a527c8-bede-4f57-9d20-1ef4eed9dc00 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Request method failure captured: Oct 22 21:07:18.265298 ncdv-master-1 devstack@n-api.service[138744]: request: GET /compute/v2.1/servers/64318452-365b-4b80-b53b-9367dd8bc826 HTTP/1.1 Oct 22 21:07:18.265298 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 21:07:18.265298 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 21:07:18.265298 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 21:07:18.265298 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 0 Oct 22 21:07:18.265298 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 21:07:18.265298 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 21:07:18.265298 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 21:07:18.265298 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 21:07:18.265298 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVFrcKw86EUEeUngnG9DZUJvE3lmhBNDPmC4isrFt9sa-3M5uM6HCkY-mE9Fr6XyLPpjJ3yZx9ru813oA85o16iJwDuF8Nlz1bpd8p9u41wsyi0Zep7ygHQQJ9tgdQV6IQKIEN7AplmICrhSHFCRaS0cX6FN1kXuVbLH1K6CsNjHq7jM Oct 22 21:07:18.265298 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 21:07:18.265298 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 21:07:18.265298 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 21:07:18.265298 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 21:07:18.265298 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 21:07:18.265298 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 21:07:18.265298 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: 82a42c3ecf474883ac652fcc8c01c9f2 Oct 22 21:07:18.265298 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-TestVolumeBootPattern-1443368191 Oct 22 21:07:18.265298 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 21:07:18.265298 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 21:07:18.265298 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_82a42c3ecf474883ac652fcc8c01c9f2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/82a42c3ecf474883ac652fcc8c01c9f2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/82a42c3ecf474883ac652fcc8c01c9f2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/82a42c3ecf474883ac652fcc8c01c9f2"}]}] Oct 22 21:07:18.265298 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-TestVolumeBootPattern-1443368191 Oct 22 21:07:18.265298 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: 82a42c3ecf474883ac652fcc8c01c9f2 Oct 22 21:07:18.265298 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-TestVolumeBootPattern-1443368191 Oct 22 21:07:18.265298 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-TestVolumeBootPattern-1443368191-project Oct 22 21:07:18.265298 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 21:07:18.265298 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 21:07:18.265298 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: 7e3820b31a424c3a9216a6ef91fcb285 Oct 22 21:07:18.265298 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-TestVolumeBootPattern-1443368191-project Oct 22 21:07:18.265298 ncdv-master-1 devstack@n-api.service[138744]: method: > Oct 22 21:07:18.265298 ncdv-master-1 devstack@n-api.service[138744]: exception: Instance 64318452-365b-4b80-b53b-9367dd8bc826 could not be found. Oct 22 21:07:18.265298 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': '64318452-365b-4b80-b53b-9367dd8bc826'} Oct 22 21:07:18.265298 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:07:18.265298 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:07:18.265298 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 21:07:18.265298 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 21:07:18.265298 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 21:07:18.265298 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 21:07:18.265298 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 21:07:18.265298 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 21:07:18.265298 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 21:07:18.265298 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 21:07:18.265298 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64318452-365b-4b80-b53b-9367dd8bc826 could not be found. Oct 22 21:07:18.265298 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:07:18.265298 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:07:18.265298 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:07:18.265298 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:07:18.265298 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:07:18.265298 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:07:18.265298 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:07:18.265298 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:07:18.265298 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:07:18.265298 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:07:18.265298 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 21:07:18.265298 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 21:07:18.265298 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 21:07:18.265298 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 21:07:18.265298 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 21:07:18.265298 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:07:18.265298 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64318452-365b-4b80-b53b-9367dd8bc826 could not be found. Oct 22 21:07:18.265298 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:07:18.265298 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:07:18.265298 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:07:18.269624 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:07:18.269624 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:07:18.269624 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:07:18.269624 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:07:18.269624 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:07:18.269624 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64318452-365b-4b80-b53b-9367dd8bc826 could not be found. Oct 22 21:07:18.269624 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:07:18.273394 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-53a527c8-bede-4f57-9d20-1ef4eed9dc00 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Returning 404 to user: Instance 64318452-365b-4b80-b53b-9367dd8bc826 could not be found. {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:07:18.279438 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-53a527c8-bede-4f57-9d20-1ef4eed9dc00 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] 10.222.0.18 "GET /compute/v2.1/servers/64318452-365b-4b80-b53b-9367dd8bc826" status: 404 len: 111 microversion: 2.1 time: 0.108305 Oct 22 21:07:18.280368 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1899/3806] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:07:18 2022] GET /compute/v2.1/servers/64318452-365b-4b80-b53b-9367dd8bc826 => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 21:07:18.514500 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-719edd6a-f026-4f77-8970-e9bb1d2185b2 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcdfeb6c1cda4810b9fa70fdfd9a66c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c774a85b2c41c98486cf91b1253363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:07:18.530310 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-719edd6a-f026-4f77-8970-e9bb1d2185b2 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] 10.222.0.18 "GET /compute/v2.1/servers/b769064b-9ef9-47b7-9cfd-5d3b8a24a7a1" status: 200 len: 1506 microversion: 2.1 time: 0.411720 Oct 22 21:07:18.532163 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1908/3807] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:07:18 2022] GET /compute/v2.1/servers/b769064b-9ef9-47b7-9cfd-5d3b8a24a7a1 => generated 1506 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:07:18.564417 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-ab6b8c13-096e-42e0-893b-471285d194c4 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "085e4478-6edc-4a69-8e08-f9831713eb65", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:07:18.573871 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-ab6b8c13-096e-42e0-893b-471285d194c4 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] [instance: b769064b-9ef9-47b7-9cfd-5d3b8a24a7a1] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:07:18.603131 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ab6b8c13-096e-42e0-893b-471285d194c4 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:18.603677 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ab6b8c13-096e-42e0-893b-471285d194c4 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:18.604875 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ab6b8c13-096e-42e0-893b-471285d194c4 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:18.604970 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ab6b8c13-096e-42e0-893b-471285d194c4 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:18.609243 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ab6b8c13-096e-42e0-893b-471285d194c4 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:18.609997 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ab6b8c13-096e-42e0-893b-471285d194c4 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:19.084089 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-f27cd781-f043-4c72-aca4-68269619515f tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:07:19.084939 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-f27cd781-f043-4c72-aca4-68269619515f tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] [instance: b1b68e60-81b4-4d1e-8bb8-ab8b94d918a8] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:07:19.095737 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f27cd781-f043-4c72-aca4-68269619515f tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:19.096687 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f27cd781-f043-4c72-aca4-68269619515f tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:19.109982 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f27cd781-f043-4c72-aca4-68269619515f tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:19.113183 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-ab6b8c13-096e-42e0-893b-471285d194c4 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Flavor limits 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 21:07:19.114063 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-ab6b8c13-096e-42e0-893b-471285d194c4 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Image limits 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 21:07:19.114740 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-ab6b8c13-096e-42e0-893b-471285d194c4 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Flavor pref 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 21:07:19.115307 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-ab6b8c13-096e-42e0-893b-471285d194c4 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Image pref 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 21:07:19.115476 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f27cd781-f043-4c72-aca4-68269619515f tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:19.116545 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-ab6b8c13-096e-42e0-893b-471285d194c4 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 21:07:19.117145 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f27cd781-f043-4c72-aca4-68269619515f tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:19.117961 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f27cd781-f043-4c72-aca4-68269619515f tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:19.161470 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:07:19.214576 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-ab6b8c13-096e-42e0-893b-471285d194c4 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] [instance: b769064b-9ef9-47b7-9cfd-5d3b8a24a7a1] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:07:19.222504 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ab6b8c13-096e-42e0-893b-471285d194c4 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:19.223224 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ab6b8c13-096e-42e0-893b-471285d194c4 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:19.223883 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ab6b8c13-096e-42e0-893b-471285d194c4 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:19.225012 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ab6b8c13-096e-42e0-893b-471285d194c4 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:19.226004 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ab6b8c13-096e-42e0-893b-471285d194c4 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:19.226621 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ab6b8c13-096e-42e0-893b-471285d194c4 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:19.267838 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-ab6b8c13-096e-42e0-893b-471285d194c4 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] 10.222.0.18 "POST /compute/v2.1/servers/b769064b-9ef9-47b7-9cfd-5d3b8a24a7a1/action" status: 202 len: 1112 microversion: 2.1 time: 0.715174 Oct 22 21:07:19.270375 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1900/3808] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 21:07:18 2022] POST /compute/v2.1/servers/b769064b-9ef9-47b7-9cfd-5d3b8a24a7a1/action => generated 1112 bytes in 718 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 22 21:07:19.275577 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-e91241f2-2811-4856-baee-cdcc4676223e tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:07:19.276564 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-e91241f2-2811-4856-baee-cdcc4676223e tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] [instance: 079f3144-b2dd-45f2-a22d-11cd315a31ed] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:07:19.283901 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e91241f2-2811-4856-baee-cdcc4676223e tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:19.284682 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e91241f2-2811-4856-baee-cdcc4676223e tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:19.285315 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e91241f2-2811-4856-baee-cdcc4676223e tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:19.286617 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e91241f2-2811-4856-baee-cdcc4676223e tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:19.287276 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e91241f2-2811-4856-baee-cdcc4676223e tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:19.287938 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e91241f2-2811-4856-baee-cdcc4676223e tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:19.306100 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-e91241f2-2811-4856-baee-cdcc4676223e tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] HTTP exception thrown: Instance 079f3144-b2dd-45f2-a22d-11cd315a31ed could not be found. Oct 22 21:07:19.308211 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-e91241f2-2811-4856-baee-cdcc4676223e tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Request method failure captured: Oct 22 21:07:19.308211 ncdv-master-1 devstack@n-api.service[138744]: request: DELETE /compute/v2.1/servers/079f3144-b2dd-45f2-a22d-11cd315a31ed HTTP/1.1 Oct 22 21:07:19.308211 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 21:07:19.308211 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 21:07:19.308211 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 21:07:19.308211 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 0 Oct 22 21:07:19.308211 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 21:07:19.308211 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 21:07:19.308211 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 21:07:19.308211 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 21:07:19.308211 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVFrcKw86EUEeUngnG9DZUJvE3lmhBNDPmC4isrFt9sa-3M5uM6HCkY-mE9Fr6XyLPpjJ3yZx9ru813oA85o16iJwDuF8Nlz1bpd8p9u41wsyi0Zep7ygHQQJ9tgdQV6IQKIEN7AplmICrhSHFCRaS0cX6FN1kXuVbLH1K6CsNjHq7jM Oct 22 21:07:19.308211 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 21:07:19.308211 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 21:07:19.308211 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 21:07:19.308211 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 21:07:19.308211 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 21:07:19.308211 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 21:07:19.308211 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: 82a42c3ecf474883ac652fcc8c01c9f2 Oct 22 21:07:19.308211 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-TestVolumeBootPattern-1443368191 Oct 22 21:07:19.308211 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 21:07:19.308211 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 21:07:19.308211 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_82a42c3ecf474883ac652fcc8c01c9f2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/82a42c3ecf474883ac652fcc8c01c9f2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/82a42c3ecf474883ac652fcc8c01c9f2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/82a42c3ecf474883ac652fcc8c01c9f2"}]}] Oct 22 21:07:19.308211 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-TestVolumeBootPattern-1443368191 Oct 22 21:07:19.308211 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: 82a42c3ecf474883ac652fcc8c01c9f2 Oct 22 21:07:19.308211 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-TestVolumeBootPattern-1443368191 Oct 22 21:07:19.308211 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-TestVolumeBootPattern-1443368191-project Oct 22 21:07:19.308211 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 21:07:19.308211 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 21:07:19.308211 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: 7e3820b31a424c3a9216a6ef91fcb285 Oct 22 21:07:19.308211 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-TestVolumeBootPattern-1443368191-project Oct 22 21:07:19.308211 ncdv-master-1 devstack@n-api.service[138744]: method: > Oct 22 21:07:19.308211 ncdv-master-1 devstack@n-api.service[138744]: exception: Instance 079f3144-b2dd-45f2-a22d-11cd315a31ed could not be found. Oct 22 21:07:19.308211 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': '079f3144-b2dd-45f2-a22d-11cd315a31ed'} Oct 22 21:07:19.308211 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:07:19.308211 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:07:19.308211 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 21:07:19.308211 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 21:07:19.308211 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 21:07:19.308211 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 21:07:19.308211 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 21:07:19.308211 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 21:07:19.308211 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 21:07:19.308211 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 21:07:19.308211 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 079f3144-b2dd-45f2-a22d-11cd315a31ed could not be found. Oct 22 21:07:19.308211 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:07:19.308211 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:07:19.308211 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:07:19.308211 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:07:19.308211 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:07:19.308211 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:07:19.308211 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:07:19.308211 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:07:19.308211 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:07:19.308211 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:07:19.308211 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 22 21:07:19.308211 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 22 21:07:19.308211 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 22 21:07:19.308211 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 22 21:07:19.308211 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 21:07:19.308211 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 21:07:19.308211 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 21:07:19.308211 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:07:19.312580 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 079f3144-b2dd-45f2-a22d-11cd315a31ed could not be found. Oct 22 21:07:19.312580 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:07:19.312580 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:07:19.312580 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:07:19.312580 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:07:19.312580 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:07:19.312580 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:07:19.312580 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:07:19.312580 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:07:19.312580 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 079f3144-b2dd-45f2-a22d-11cd315a31ed could not be found. Oct 22 21:07:19.312580 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:07:19.315816 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-e91241f2-2811-4856-baee-cdcc4676223e tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Returning 404 to user: Instance 079f3144-b2dd-45f2-a22d-11cd315a31ed could not be found. {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:07:19.317202 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-e91241f2-2811-4856-baee-cdcc4676223e tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] 10.222.0.18 "DELETE /compute/v2.1/servers/079f3144-b2dd-45f2-a22d-11cd315a31ed" status: 404 len: 111 microversion: 2.1 time: 0.045578 Oct 22 21:07:19.318720 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1901/3809] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 21:07:19 2022] DELETE /compute/v2.1/servers/079f3144-b2dd-45f2-a22d-11cd315a31ed => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 21:07:19.324287 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-2cf523b3-da78-4940-b6c7-79de46a4d75e tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:07:19.325104 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-2cf523b3-da78-4940-b6c7-79de46a4d75e tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] [instance: b769064b-9ef9-47b7-9cfd-5d3b8a24a7a1] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:07:19.332986 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2cf523b3-da78-4940-b6c7-79de46a4d75e tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:19.333755 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2cf523b3-da78-4940-b6c7-79de46a4d75e tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:19.334351 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2cf523b3-da78-4940-b6c7-79de46a4d75e tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:19.335224 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2cf523b3-da78-4940-b6c7-79de46a4d75e tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:19.335862 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2cf523b3-da78-4940-b6c7-79de46a4d75e tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:19.336442 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2cf523b3-da78-4940-b6c7-79de46a4d75e tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:19.574349 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-f27cd781-f043-4c72-aca4-68269619515f tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebcd750fac45c183f21cf78ca939d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a73c458655e4b1db78801a8316fbdab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:07:19.602669 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-f27cd781-f043-4c72-aca4-68269619515f tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdebcd750fac45c183f21cf78ca939d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a73c458655e4b1db78801a8316fbdab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:07:19.609096 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-f27cd781-f043-4c72-aca4-68269619515f tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdebcd750fac45c183f21cf78ca939d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a73c458655e4b1db78801a8316fbdab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:07:19.611257 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-f27cd781-f043-4c72-aca4-68269619515f tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] 10.222.0.18 "GET /compute/v2.1/servers/b1b68e60-81b4-4d1e-8bb8-ab8b94d918a8" status: 200 len: 1365 microversion: 2.47 time: 0.531365 Oct 22 21:07:19.631376 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1909/3810] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:07:19 2022] GET /compute/v2.1/servers/b1b68e60-81b4-4d1e-8bb8-ab8b94d918a8 => generated 1365 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 22 21:07:19.655519 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-8fe9618f-576f-43cf-811d-5fa57771080c tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:07:19.656411 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-8fe9618f-576f-43cf-811d-5fa57771080c tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] [instance: 079f3144-b2dd-45f2-a22d-11cd315a31ed] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:07:19.681278 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8fe9618f-576f-43cf-811d-5fa57771080c tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:19.690645 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8fe9618f-576f-43cf-811d-5fa57771080c tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:19.691531 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8fe9618f-576f-43cf-811d-5fa57771080c tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:19.696153 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8fe9618f-576f-43cf-811d-5fa57771080c tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:19.698589 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8fe9618f-576f-43cf-811d-5fa57771080c tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:19.699222 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8fe9618f-576f-43cf-811d-5fa57771080c tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:19.741907 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.wsgi [None req-8fe9618f-576f-43cf-811d-5fa57771080c tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] HTTP exception thrown: Instance 079f3144-b2dd-45f2-a22d-11cd315a31ed could not be found. Oct 22 21:07:19.743631 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-8fe9618f-576f-43cf-811d-5fa57771080c tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Request method failure captured: Oct 22 21:07:19.743631 ncdv-master-1 devstack@n-api.service[138745]: request: GET /compute/v2.1/servers/079f3144-b2dd-45f2-a22d-11cd315a31ed HTTP/1.1 Oct 22 21:07:19.743631 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 21:07:19.743631 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 21:07:19.743631 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 21:07:19.743631 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 0 Oct 22 21:07:19.743631 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 21:07:19.743631 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 21:07:19.743631 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 21:07:19.743631 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 21:07:19.743631 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVFrcKw86EUEeUngnG9DZUJvE3lmhBNDPmC4isrFt9sa-3M5uM6HCkY-mE9Fr6XyLPpjJ3yZx9ru813oA85o16iJwDuF8Nlz1bpd8p9u41wsyi0Zep7ygHQQJ9tgdQV6IQKIEN7AplmICrhSHFCRaS0cX6FN1kXuVbLH1K6CsNjHq7jM Oct 22 21:07:19.743631 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 21:07:19.743631 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 21:07:19.743631 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 21:07:19.743631 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 21:07:19.743631 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 21:07:19.743631 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 21:07:19.743631 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: 82a42c3ecf474883ac652fcc8c01c9f2 Oct 22 21:07:19.743631 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-TestVolumeBootPattern-1443368191 Oct 22 21:07:19.743631 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 21:07:19.743631 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 21:07:19.743631 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_82a42c3ecf474883ac652fcc8c01c9f2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/82a42c3ecf474883ac652fcc8c01c9f2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/82a42c3ecf474883ac652fcc8c01c9f2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/82a42c3ecf474883ac652fcc8c01c9f2"}]}] Oct 22 21:07:19.743631 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-TestVolumeBootPattern-1443368191 Oct 22 21:07:19.743631 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: 82a42c3ecf474883ac652fcc8c01c9f2 Oct 22 21:07:19.743631 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-TestVolumeBootPattern-1443368191 Oct 22 21:07:19.743631 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-TestVolumeBootPattern-1443368191-project Oct 22 21:07:19.743631 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 21:07:19.743631 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 21:07:19.743631 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: 7e3820b31a424c3a9216a6ef91fcb285 Oct 22 21:07:19.743631 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-TestVolumeBootPattern-1443368191-project Oct 22 21:07:19.743631 ncdv-master-1 devstack@n-api.service[138745]: method: > Oct 22 21:07:19.743631 ncdv-master-1 devstack@n-api.service[138745]: exception: Instance 079f3144-b2dd-45f2-a22d-11cd315a31ed could not be found. Oct 22 21:07:19.743631 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'id': '079f3144-b2dd-45f2-a22d-11cd315a31ed'} Oct 22 21:07:19.743631 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:07:19.743631 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:07:19.743631 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 21:07:19.743631 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 21:07:19.743631 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 21:07:19.743631 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 21:07:19.743631 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 21:07:19.743631 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 21:07:19.743631 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 21:07:19.743631 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 21:07:19.743631 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 079f3144-b2dd-45f2-a22d-11cd315a31ed could not be found. Oct 22 21:07:19.743631 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:07:19.743631 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:07:19.743631 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:07:19.743631 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:07:19.743631 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:07:19.743631 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:07:19.743631 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:07:19.743631 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:07:19.743631 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:07:19.743631 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:07:19.743631 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 21:07:19.743631 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 21:07:19.743631 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 21:07:19.743631 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 21:07:19.743631 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 21:07:19.743631 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:07:19.743631 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 079f3144-b2dd-45f2-a22d-11cd315a31ed could not be found. Oct 22 21:07:19.743631 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:07:19.743631 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:07:19.743631 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:07:19.747911 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:07:19.747911 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:07:19.747911 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:07:19.747911 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:07:19.747911 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:07:19.747911 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 079f3144-b2dd-45f2-a22d-11cd315a31ed could not be found. Oct 22 21:07:19.747911 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:07:19.747911 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-8fe9618f-576f-43cf-811d-5fa57771080c tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Returning 404 to user: Instance 079f3144-b2dd-45f2-a22d-11cd315a31ed could not be found. {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:07:19.747911 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-8fe9618f-576f-43cf-811d-5fa57771080c tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] 10.222.0.18 "GET /compute/v2.1/servers/079f3144-b2dd-45f2-a22d-11cd315a31ed" status: 404 len: 111 microversion: 2.1 time: 0.124245 Oct 22 21:07:19.753250 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1910/3811] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:07:19 2022] GET /compute/v2.1/servers/079f3144-b2dd-45f2-a22d-11cd315a31ed => generated 111 bytes in 129 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 21:07:19.853069 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-2cf523b3-da78-4940-b6c7-79de46a4d75e tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcdfeb6c1cda4810b9fa70fdfd9a66c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c774a85b2c41c98486cf91b1253363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:07:19.884294 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-2cf523b3-da78-4940-b6c7-79de46a4d75e tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] 10.222.0.18 "GET /compute/v2.1/servers/b769064b-9ef9-47b7-9cfd-5d3b8a24a7a1" status: 200 len: 1517 microversion: 2.1 time: 0.564106 Oct 22 21:07:19.884988 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1902/3812] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:07:19 2022] GET /compute/v2.1/servers/b769064b-9ef9-47b7-9cfd-5d3b8a24a7a1 => generated 1517 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:07:19.905816 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-32baf78c-f66d-4ab6-9d1c-da246cd646d3 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Action: 'create', calling method: .version_select at 0x7fd3a42363a0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-615719538", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLrBqHWB107VRTXn6NTbPYTl6K41taxocqu/nWG29m1jXxocaTEKt/xZL42ZKK6snOmS6uZQODU7goXNRE7Zil7Jvxlq2UbWVC66En6HxBvyB0XbLsqvmEi0s156lfgjDw=="}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:07:19.945584 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-32baf78c-f66d-4ab6-9d1c-da246cd646d3 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Getting quotas for project 82a42c3ecf474883ac652fcc8c01c9f2. Resources: {'key_pairs'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 21:07:19.951871 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-32baf78c-f66d-4ab6-9d1c-da246cd646d3 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Getting quotas for user 7e3820b31a424c3a9216a6ef91fcb285 and project 82a42c3ecf474883ac652fcc8c01c9f2. Resources: {'key_pairs'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 21:07:20.004570 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-32baf78c-f66d-4ab6-9d1c-da246cd646d3 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.113717 Oct 22 21:07:20.005595 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1911/3813] 10.222.0.18 () {60 vars in 1159 bytes} [Sat Oct 22 21:07:19 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:07:20.656796 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-702dd2e0-a162-485d-95c3-14306e5d08f1 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:07:20.657419 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-702dd2e0-a162-485d-95c3-14306e5d08f1 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] [instance: b1b68e60-81b4-4d1e-8bb8-ab8b94d918a8] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:07:20.667975 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-702dd2e0-a162-485d-95c3-14306e5d08f1 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:20.668535 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-702dd2e0-a162-485d-95c3-14306e5d08f1 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:20.670288 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-702dd2e0-a162-485d-95c3-14306e5d08f1 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:20.671044 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-702dd2e0-a162-485d-95c3-14306e5d08f1 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:20.671540 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-702dd2e0-a162-485d-95c3-14306e5d08f1 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:20.671974 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-702dd2e0-a162-485d-95c3-14306e5d08f1 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:20.873728 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-702dd2e0-a162-485d-95c3-14306e5d08f1 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebcd750fac45c183f21cf78ca939d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a73c458655e4b1db78801a8316fbdab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:07:20.899423 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-702dd2e0-a162-485d-95c3-14306e5d08f1 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdebcd750fac45c183f21cf78ca939d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a73c458655e4b1db78801a8316fbdab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:07:20.901382 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-702dd2e0-a162-485d-95c3-14306e5d08f1 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdebcd750fac45c183f21cf78ca939d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a73c458655e4b1db78801a8316fbdab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:07:20.913902 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-9c668506-2a85-4f0a-a695-a9ba40fb24b2 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:07:20.913902 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-9c668506-2a85-4f0a-a695-a9ba40fb24b2 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] [instance: b769064b-9ef9-47b7-9cfd-5d3b8a24a7a1] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:07:20.916396 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-702dd2e0-a162-485d-95c3-14306e5d08f1 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] 10.222.0.18 "GET /compute/v2.1/servers/b1b68e60-81b4-4d1e-8bb8-ab8b94d918a8" status: 200 len: 1365 microversion: 2.47 time: 0.273352 Oct 22 21:07:20.922276 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1903/3814] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:07:20 2022] GET /compute/v2.1/servers/b1b68e60-81b4-4d1e-8bb8-ab8b94d918a8 => generated 1365 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 22 21:07:20.927719 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9c668506-2a85-4f0a-a695-a9ba40fb24b2 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:20.932929 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9c668506-2a85-4f0a-a695-a9ba40fb24b2 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:20.933659 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9c668506-2a85-4f0a-a695-a9ba40fb24b2 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:20.935072 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9c668506-2a85-4f0a-a695-a9ba40fb24b2 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:20.935778 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9c668506-2a85-4f0a-a695-a9ba40fb24b2 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:20.936488 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9c668506-2a85-4f0a-a695-a9ba40fb24b2 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:21.353797 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-9c668506-2a85-4f0a-a695-a9ba40fb24b2 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcdfeb6c1cda4810b9fa70fdfd9a66c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c774a85b2c41c98486cf91b1253363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:07:21.369086 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-9c668506-2a85-4f0a-a695-a9ba40fb24b2 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] 10.222.0.18 "GET /compute/v2.1/servers/b769064b-9ef9-47b7-9cfd-5d3b8a24a7a1" status: 200 len: 1517 microversion: 2.1 time: 0.460845 Oct 22 21:07:21.372043 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1912/3815] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:07:20 2022] GET /compute/v2.1/servers/b769064b-9ef9-47b7-9cfd-5d3b8a24a7a1 => generated 1517 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:07:21.950820 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-83f64d11-52e7-4f49-b333-9531765c08c2 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:07:21.953006 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-83f64d11-52e7-4f49-b333-9531765c08c2 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] [instance: b1b68e60-81b4-4d1e-8bb8-ab8b94d918a8] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:07:21.980576 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-83f64d11-52e7-4f49-b333-9531765c08c2 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:21.982918 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-83f64d11-52e7-4f49-b333-9531765c08c2 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:21.985857 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-83f64d11-52e7-4f49-b333-9531765c08c2 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:21.986966 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-83f64d11-52e7-4f49-b333-9531765c08c2 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:21.990099 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-83f64d11-52e7-4f49-b333-9531765c08c2 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:21.990798 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-83f64d11-52e7-4f49-b333-9531765c08c2 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:22.153527 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-83f64d11-52e7-4f49-b333-9531765c08c2 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebcd750fac45c183f21cf78ca939d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a73c458655e4b1db78801a8316fbdab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:07:22.167826 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-83f64d11-52e7-4f49-b333-9531765c08c2 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdebcd750fac45c183f21cf78ca939d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a73c458655e4b1db78801a8316fbdab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:07:22.169650 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-83f64d11-52e7-4f49-b333-9531765c08c2 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdebcd750fac45c183f21cf78ca939d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a73c458655e4b1db78801a8316fbdab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:07:22.175272 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-83f64d11-52e7-4f49-b333-9531765c08c2 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] 10.222.0.18 "GET /compute/v2.1/servers/b1b68e60-81b4-4d1e-8bb8-ab8b94d918a8" status: 200 len: 1365 microversion: 2.47 time: 0.228539 Oct 22 21:07:22.176881 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1904/3816] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:07:21 2022] GET /compute/v2.1/servers/b1b68e60-81b4-4d1e-8bb8-ab8b94d918a8 => generated 1365 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 22 21:07:22.395882 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-44f70894-ddf2-454d-8e6f-0ce1743461b5 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:07:22.396667 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-44f70894-ddf2-454d-8e6f-0ce1743461b5 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] [instance: b769064b-9ef9-47b7-9cfd-5d3b8a24a7a1] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:07:22.408890 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-44f70894-ddf2-454d-8e6f-0ce1743461b5 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:22.409287 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-44f70894-ddf2-454d-8e6f-0ce1743461b5 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:22.412176 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-44f70894-ddf2-454d-8e6f-0ce1743461b5 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:22.413269 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-44f70894-ddf2-454d-8e6f-0ce1743461b5 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:22.413995 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-44f70894-ddf2-454d-8e6f-0ce1743461b5 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:22.414667 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-44f70894-ddf2-454d-8e6f-0ce1743461b5 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:22.700498 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-44f70894-ddf2-454d-8e6f-0ce1743461b5 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcdfeb6c1cda4810b9fa70fdfd9a66c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c774a85b2c41c98486cf91b1253363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:07:22.709093 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-44f70894-ddf2-454d-8e6f-0ce1743461b5 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] 10.222.0.18 "GET /compute/v2.1/servers/b769064b-9ef9-47b7-9cfd-5d3b8a24a7a1" status: 200 len: 1517 microversion: 2.1 time: 0.317645 Oct 22 21:07:22.712009 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1913/3817] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:07:22 2022] GET /compute/v2.1/servers/b769064b-9ef9-47b7-9cfd-5d3b8a24a7a1 => generated 1517 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:07:23.204537 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-28b41b90-11de-4519-86c2-8bd342596a12 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:07:23.205179 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-28b41b90-11de-4519-86c2-8bd342596a12 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] [instance: b1b68e60-81b4-4d1e-8bb8-ab8b94d918a8] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:07:23.215016 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-28b41b90-11de-4519-86c2-8bd342596a12 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:23.215592 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-28b41b90-11de-4519-86c2-8bd342596a12 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:23.216053 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-28b41b90-11de-4519-86c2-8bd342596a12 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:23.216833 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-28b41b90-11de-4519-86c2-8bd342596a12 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:23.217303 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-28b41b90-11de-4519-86c2-8bd342596a12 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:23.217744 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-28b41b90-11de-4519-86c2-8bd342596a12 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:23.477726 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-28b41b90-11de-4519-86c2-8bd342596a12 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebcd750fac45c183f21cf78ca939d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a73c458655e4b1db78801a8316fbdab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:07:23.495038 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-28b41b90-11de-4519-86c2-8bd342596a12 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdebcd750fac45c183f21cf78ca939d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a73c458655e4b1db78801a8316fbdab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:07:23.506569 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-28b41b90-11de-4519-86c2-8bd342596a12 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdebcd750fac45c183f21cf78ca939d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a73c458655e4b1db78801a8316fbdab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:07:23.508649 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-28b41b90-11de-4519-86c2-8bd342596a12 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] 10.222.0.18 "GET /compute/v2.1/servers/b1b68e60-81b4-4d1e-8bb8-ab8b94d918a8" status: 200 len: 1365 microversion: 2.47 time: 0.311348 Oct 22 21:07:23.510370 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1905/3818] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:07:23 2022] GET /compute/v2.1/servers/b1b68e60-81b4-4d1e-8bb8-ab8b94d918a8 => generated 1365 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:07:23.737920 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-dd625cf1-4714-4f76-af7c-247f19de434e tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:07:23.737920 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-dd625cf1-4714-4f76-af7c-247f19de434e tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] [instance: b769064b-9ef9-47b7-9cfd-5d3b8a24a7a1] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:07:23.748613 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-dd625cf1-4714-4f76-af7c-247f19de434e tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:23.749296 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-dd625cf1-4714-4f76-af7c-247f19de434e tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:23.751724 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-dd625cf1-4714-4f76-af7c-247f19de434e tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:23.752826 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-dd625cf1-4714-4f76-af7c-247f19de434e tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:23.753463 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-dd625cf1-4714-4f76-af7c-247f19de434e tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:23.758396 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-dd625cf1-4714-4f76-af7c-247f19de434e tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:24.266928 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-dd625cf1-4714-4f76-af7c-247f19de434e tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcdfeb6c1cda4810b9fa70fdfd9a66c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c774a85b2c41c98486cf91b1253363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:07:24.282307 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-dd625cf1-4714-4f76-af7c-247f19de434e tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] 10.222.0.18 "GET /compute/v2.1/servers/b769064b-9ef9-47b7-9cfd-5d3b8a24a7a1" status: 200 len: 1517 microversion: 2.1 time: 0.551983 Oct 22 21:07:24.282923 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1914/3819] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:07:23 2022] GET /compute/v2.1/servers/b769064b-9ef9-47b7-9cfd-5d3b8a24a7a1 => generated 1517 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:07:24.540320 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-1c0af320-3a08-4f60-b108-4ee12650e7e6 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:07:24.540938 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-1c0af320-3a08-4f60-b108-4ee12650e7e6 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] [instance: b1b68e60-81b4-4d1e-8bb8-ab8b94d918a8] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:07:24.552543 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1c0af320-3a08-4f60-b108-4ee12650e7e6 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:24.556759 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1c0af320-3a08-4f60-b108-4ee12650e7e6 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:24.558871 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1c0af320-3a08-4f60-b108-4ee12650e7e6 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:24.560743 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1c0af320-3a08-4f60-b108-4ee12650e7e6 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:24.563291 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1c0af320-3a08-4f60-b108-4ee12650e7e6 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:24.563930 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1c0af320-3a08-4f60-b108-4ee12650e7e6 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:24.781487 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-1c0af320-3a08-4f60-b108-4ee12650e7e6 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebcd750fac45c183f21cf78ca939d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a73c458655e4b1db78801a8316fbdab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:07:24.796498 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-1c0af320-3a08-4f60-b108-4ee12650e7e6 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdebcd750fac45c183f21cf78ca939d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a73c458655e4b1db78801a8316fbdab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:07:24.800410 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-1c0af320-3a08-4f60-b108-4ee12650e7e6 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdebcd750fac45c183f21cf78ca939d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a73c458655e4b1db78801a8316fbdab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:07:24.805229 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-1c0af320-3a08-4f60-b108-4ee12650e7e6 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] 10.222.0.18 "GET /compute/v2.1/servers/b1b68e60-81b4-4d1e-8bb8-ab8b94d918a8" status: 200 len: 1365 microversion: 2.47 time: 0.270514 Oct 22 21:07:24.808640 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1906/3820] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:07:24 2022] GET /compute/v2.1/servers/b1b68e60-81b4-4d1e-8bb8-ab8b94d918a8 => generated 1365 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:07:25.306813 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-ee5b7f30-6e7b-42bf-a346-182eec7617cb tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:07:25.307477 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-ee5b7f30-6e7b-42bf-a346-182eec7617cb tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] [instance: b769064b-9ef9-47b7-9cfd-5d3b8a24a7a1] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:07:25.320322 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ee5b7f30-6e7b-42bf-a346-182eec7617cb tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:25.320841 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ee5b7f30-6e7b-42bf-a346-182eec7617cb tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:25.321298 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ee5b7f30-6e7b-42bf-a346-182eec7617cb tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:25.326384 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ee5b7f30-6e7b-42bf-a346-182eec7617cb tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:25.327096 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ee5b7f30-6e7b-42bf-a346-182eec7617cb tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:25.327750 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ee5b7f30-6e7b-42bf-a346-182eec7617cb tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:25.372358 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1,nova_cell1:UPDATE=1 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:07:25.672686 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-ee5b7f30-6e7b-42bf-a346-182eec7617cb tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcdfeb6c1cda4810b9fa70fdfd9a66c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c774a85b2c41c98486cf91b1253363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:07:25.689609 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-ee5b7f30-6e7b-42bf-a346-182eec7617cb tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] 10.222.0.18 "GET /compute/v2.1/servers/b769064b-9ef9-47b7-9cfd-5d3b8a24a7a1" status: 200 len: 1517 microversion: 2.1 time: 0.386865 Oct 22 21:07:25.690759 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1915/3821] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:07:25 2022] GET /compute/v2.1/servers/b769064b-9ef9-47b7-9cfd-5d3b8a24a7a1 => generated 1517 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:07:25.838268 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-2562dd7a-0d51-4dc3-a658-0c9d381b1cea tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:07:25.839928 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-2562dd7a-0d51-4dc3-a658-0c9d381b1cea tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] [instance: b1b68e60-81b4-4d1e-8bb8-ab8b94d918a8] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:07:25.848613 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2562dd7a-0d51-4dc3-a658-0c9d381b1cea tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:25.849354 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2562dd7a-0d51-4dc3-a658-0c9d381b1cea tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:25.849985 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2562dd7a-0d51-4dc3-a658-0c9d381b1cea tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:25.851215 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2562dd7a-0d51-4dc3-a658-0c9d381b1cea tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:25.851873 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2562dd7a-0d51-4dc3-a658-0c9d381b1cea tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:25.852487 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2562dd7a-0d51-4dc3-a658-0c9d381b1cea tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:26.259719 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-2562dd7a-0d51-4dc3-a658-0c9d381b1cea tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebcd750fac45c183f21cf78ca939d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a73c458655e4b1db78801a8316fbdab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:07:26.270384 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-2562dd7a-0d51-4dc3-a658-0c9d381b1cea tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdebcd750fac45c183f21cf78ca939d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a73c458655e4b1db78801a8316fbdab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:07:26.277444 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-6b10b298-9d7d-448c-9f4d-257ff0943f6c tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1483427528", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-615719538", "security_groups": [{"name": "tempest-secgroup-smoke-335632321"}], "block_device_mapping_v2": [{"uuid": "636027aa-4bd0-4937-b625-4929d9464061", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "7fc34993-7108-4fcb-8386-9f829c6044b7"}]}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:07:26.285809 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-2562dd7a-0d51-4dc3-a658-0c9d381b1cea tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdebcd750fac45c183f21cf78ca939d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a73c458655e4b1db78801a8316fbdab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:07:26.296887 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-2562dd7a-0d51-4dc3-a658-0c9d381b1cea tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] 10.222.0.18 "GET /compute/v2.1/servers/b1b68e60-81b4-4d1e-8bb8-ab8b94d918a8" status: 200 len: 1365 microversion: 2.47 time: 0.463128 Oct 22 21:07:26.297491 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1907/3822] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:07:25 2022] GET /compute/v2.1/servers/b1b68e60-81b4-4d1e-8bb8-ab8b94d918a8 => generated 1365 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:07:26.657611 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.network.neutron [None req-6b10b298-9d7d-448c-9f4d-257ff0943f6c tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] validate_networks() for [('7fc34993-7108-4fcb-8386-9f829c6044b7', None, None, None, None, None)] {{(pid=138745) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 21:07:26.716878 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-b7774cd0-2373-4ba4-a8d7-16b0bc225a14 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:07:26.717894 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-b7774cd0-2373-4ba4-a8d7-16b0bc225a14 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] [instance: b769064b-9ef9-47b7-9cfd-5d3b8a24a7a1] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:07:26.728852 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b7774cd0-2373-4ba4-a8d7-16b0bc225a14 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:26.729759 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b7774cd0-2373-4ba4-a8d7-16b0bc225a14 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:26.730408 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b7774cd0-2373-4ba4-a8d7-16b0bc225a14 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:26.739843 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b7774cd0-2373-4ba4-a8d7-16b0bc225a14 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:26.740684 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b7774cd0-2373-4ba4-a8d7-16b0bc225a14 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:26.741336 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b7774cd0-2373-4ba4-a8d7-16b0bc225a14 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:27.192433 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-b7774cd0-2373-4ba4-a8d7-16b0bc225a14 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcdfeb6c1cda4810b9fa70fdfd9a66c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c774a85b2c41c98486cf91b1253363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:07:27.208407 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-b7774cd0-2373-4ba4-a8d7-16b0bc225a14 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] 10.222.0.18 "GET /compute/v2.1/servers/b769064b-9ef9-47b7-9cfd-5d3b8a24a7a1" status: 200 len: 1517 microversion: 2.1 time: 0.496269 Oct 22 21:07:27.209301 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1908/3823] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:07:26 2022] GET /compute/v2.1/servers/b769064b-9ef9-47b7-9cfd-5d3b8a24a7a1 => generated 1517 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:07:27.324915 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-cfac0ad0-5a23-430c-9f10-76b42cea66db tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:07:27.326132 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-cfac0ad0-5a23-430c-9f10-76b42cea66db tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] [instance: b1b68e60-81b4-4d1e-8bb8-ab8b94d918a8] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:07:27.339161 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cfac0ad0-5a23-430c-9f10-76b42cea66db tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:27.345449 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cfac0ad0-5a23-430c-9f10-76b42cea66db tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:27.355875 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cfac0ad0-5a23-430c-9f10-76b42cea66db tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:27.356476 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cfac0ad0-5a23-430c-9f10-76b42cea66db tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:27.356952 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cfac0ad0-5a23-430c-9f10-76b42cea66db tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:27.357401 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cfac0ad0-5a23-430c-9f10-76b42cea66db tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:27.627056 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-cfac0ad0-5a23-430c-9f10-76b42cea66db tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebcd750fac45c183f21cf78ca939d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a73c458655e4b1db78801a8316fbdab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:07:27.648839 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-cfac0ad0-5a23-430c-9f10-76b42cea66db tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdebcd750fac45c183f21cf78ca939d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a73c458655e4b1db78801a8316fbdab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:07:27.651260 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-cfac0ad0-5a23-430c-9f10-76b42cea66db tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdebcd750fac45c183f21cf78ca939d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a73c458655e4b1db78801a8316fbdab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:07:27.662584 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-cfac0ad0-5a23-430c-9f10-76b42cea66db tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] 10.222.0.18 "GET /compute/v2.1/servers/b1b68e60-81b4-4d1e-8bb8-ab8b94d918a8" status: 200 len: 1365 microversion: 2.47 time: 0.341526 Oct 22 21:07:27.664492 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1909/3824] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:07:27 2022] GET /compute/v2.1/servers/b1b68e60-81b4-4d1e-8bb8-ab8b94d918a8 => generated 1365 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:07:28.061244 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-6b10b298-9d7d-448c-9f4d-257ff0943f6c tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Flavor limits 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 21:07:28.062498 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-6b10b298-9d7d-448c-9f4d-257ff0943f6c tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Image limits 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 21:07:28.063039 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-6b10b298-9d7d-448c-9f4d-257ff0943f6c tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Flavor pref 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 21:07:28.063507 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-6b10b298-9d7d-448c-9f4d-257ff0943f6c tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Image pref 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 21:07:28.064055 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-6b10b298-9d7d-448c-9f4d-257ff0943f6c tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 21:07:28.083053 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6b10b298-9d7d-448c-9f4d-257ff0943f6c tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:28.087915 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6b10b298-9d7d-448c-9f4d-257ff0943f6c tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:28.088647 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6b10b298-9d7d-448c-9f4d-257ff0943f6c tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:28.089813 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6b10b298-9d7d-448c-9f4d-257ff0943f6c tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:28.094218 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6b10b298-9d7d-448c-9f4d-257ff0943f6c tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:28.095524 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6b10b298-9d7d-448c-9f4d-257ff0943f6c tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:28.153400 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-6b10b298-9d7d-448c-9f4d-257ff0943f6c tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Getting quotas for project 82a42c3ecf474883ac652fcc8c01c9f2. Resources: {'cores', 'instances', 'ram'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 21:07:28.175648 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-6b10b298-9d7d-448c-9f4d-257ff0943f6c tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Getting quotas for user 7e3820b31a424c3a9216a6ef91fcb285 and project 82a42c3ecf474883ac652fcc8c01c9f2. Resources: {'cores', 'instances', 'ram'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 21:07:28.234161 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-e8161d04-7055-4d0c-a57d-6dbd1238effd tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:07:28.235051 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-e8161d04-7055-4d0c-a57d-6dbd1238effd tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] [instance: b769064b-9ef9-47b7-9cfd-5d3b8a24a7a1] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:07:28.249102 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e8161d04-7055-4d0c-a57d-6dbd1238effd tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:28.249573 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e8161d04-7055-4d0c-a57d-6dbd1238effd tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:28.249998 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e8161d04-7055-4d0c-a57d-6dbd1238effd tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:28.250797 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e8161d04-7055-4d0c-a57d-6dbd1238effd tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:28.251398 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e8161d04-7055-4d0c-a57d-6dbd1238effd tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:28.252033 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e8161d04-7055-4d0c-a57d-6dbd1238effd tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:28.321046 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-6b10b298-9d7d-448c-9f4d-257ff0943f6c tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Going to run 1 instances... {{(pid=138745) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 21:07:28.323543 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-6b10b298-9d7d-448c-9f4d-257ff0943f6c tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] [instance: 1324c851-90ff-47f4-b4e6-8acc8b829c5e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='636027aa-4bd0-4937-b625-4929d9464061',volume_size=None,volume_type=None)] {{(pid=138745) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 21:07:28.620645 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-6b10b298-9d7d-448c-9f4d-257ff0943f6c tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.347038 Oct 22 21:07:28.631488 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1916/3825] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Oct 22 21:07:26 2022] POST /compute/v2.1/servers => generated 405 bytes in 2351 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 22 21:07:28.644300 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-404b48dc-df7a-4ae7-8c09-020ef00f563d tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:07:28.647657 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-404b48dc-df7a-4ae7-8c09-020ef00f563d tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] [instance: 1324c851-90ff-47f4-b4e6-8acc8b829c5e] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:07:29.154257 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-404b48dc-df7a-4ae7-8c09-020ef00f563d tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3820b31a424c3a9216a6ef91fcb285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a42c3ecf474883ac652fcc8c01c9f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:07:29.171557 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-404b48dc-df7a-4ae7-8c09-020ef00f563d tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] 10.222.0.18 "GET /compute/v2.1/servers/1324c851-90ff-47f4-b4e6-8acc8b829c5e" status: 200 len: 1094 microversion: 2.1 time: 0.538129 Oct 22 21:07:29.178881 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1917/3826] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:07:28 2022] GET /compute/v2.1/servers/1324c851-90ff-47f4-b4e6-8acc8b829c5e => generated 1094 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:07:29.196876 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-897f3fc9-25d6-4fc7-8110-bb68fc745eba tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:07:29.198799 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-897f3fc9-25d6-4fc7-8110-bb68fc745eba tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] [instance: b1b68e60-81b4-4d1e-8bb8-ab8b94d918a8] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:07:29.210536 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-897f3fc9-25d6-4fc7-8110-bb68fc745eba tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:29.211825 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-897f3fc9-25d6-4fc7-8110-bb68fc745eba tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:29.212538 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-897f3fc9-25d6-4fc7-8110-bb68fc745eba tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:29.214877 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-897f3fc9-25d6-4fc7-8110-bb68fc745eba tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:29.217859 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-897f3fc9-25d6-4fc7-8110-bb68fc745eba tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:29.218905 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-897f3fc9-25d6-4fc7-8110-bb68fc745eba tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:29.481564 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-897f3fc9-25d6-4fc7-8110-bb68fc745eba tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebcd750fac45c183f21cf78ca939d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a73c458655e4b1db78801a8316fbdab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:07:29.501586 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-897f3fc9-25d6-4fc7-8110-bb68fc745eba tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdebcd750fac45c183f21cf78ca939d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a73c458655e4b1db78801a8316fbdab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:07:29.507462 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-897f3fc9-25d6-4fc7-8110-bb68fc745eba tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdebcd750fac45c183f21cf78ca939d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a73c458655e4b1db78801a8316fbdab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:07:29.512303 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-897f3fc9-25d6-4fc7-8110-bb68fc745eba tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] 10.222.0.18 "GET /compute/v2.1/servers/b1b68e60-81b4-4d1e-8bb8-ab8b94d918a8" status: 200 len: 1365 microversion: 2.47 time: 0.328339 Oct 22 21:07:29.528868 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1918/3827] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:07:29 2022] GET /compute/v2.1/servers/b1b68e60-81b4-4d1e-8bb8-ab8b94d918a8 => generated 1365 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:07:29.727510 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-e8161d04-7055-4d0c-a57d-6dbd1238effd tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcdfeb6c1cda4810b9fa70fdfd9a66c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c774a85b2c41c98486cf91b1253363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:07:29.757018 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-e8161d04-7055-4d0c-a57d-6dbd1238effd tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] 10.222.0.18 "GET /compute/v2.1/servers/b769064b-9ef9-47b7-9cfd-5d3b8a24a7a1" status: 200 len: 1517 microversion: 2.1 time: 1.526638 Oct 22 21:07:29.758601 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1910/3828] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:07:28 2022] GET /compute/v2.1/servers/b769064b-9ef9-47b7-9cfd-5d3b8a24a7a1 => generated 1517 bytes in 1529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:07:30.204792 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-1bfc9892-fd42-4391-8f75-c80d979ec989 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:07:30.208060 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-1bfc9892-fd42-4391-8f75-c80d979ec989 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] [instance: 1324c851-90ff-47f4-b4e6-8acc8b829c5e] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:07:30.234361 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1bfc9892-fd42-4391-8f75-c80d979ec989 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:30.234967 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1bfc9892-fd42-4391-8f75-c80d979ec989 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:30.235686 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1bfc9892-fd42-4391-8f75-c80d979ec989 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:30.236669 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1bfc9892-fd42-4391-8f75-c80d979ec989 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:30.237334 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1bfc9892-fd42-4391-8f75-c80d979ec989 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:30.237967 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1bfc9892-fd42-4391-8f75-c80d979ec989 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:30.546537 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-d205f653-89fd-4a4c-ba73-de9d92d49a71 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:07:30.547647 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-d205f653-89fd-4a4c-ba73-de9d92d49a71 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] [instance: b1b68e60-81b4-4d1e-8bb8-ab8b94d918a8] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:07:30.565744 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d205f653-89fd-4a4c-ba73-de9d92d49a71 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:30.568090 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d205f653-89fd-4a4c-ba73-de9d92d49a71 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:30.575195 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d205f653-89fd-4a4c-ba73-de9d92d49a71 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:30.576733 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d205f653-89fd-4a4c-ba73-de9d92d49a71 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:30.577958 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d205f653-89fd-4a4c-ba73-de9d92d49a71 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:30.578537 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d205f653-89fd-4a4c-ba73-de9d92d49a71 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:30.945667 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-d205f653-89fd-4a4c-ba73-de9d92d49a71 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebcd750fac45c183f21cf78ca939d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a73c458655e4b1db78801a8316fbdab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:07:30.958986 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-d205f653-89fd-4a4c-ba73-de9d92d49a71 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdebcd750fac45c183f21cf78ca939d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a73c458655e4b1db78801a8316fbdab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:07:30.964928 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-d205f653-89fd-4a4c-ba73-de9d92d49a71 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdebcd750fac45c183f21cf78ca939d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a73c458655e4b1db78801a8316fbdab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:07:30.966195 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-d205f653-89fd-4a4c-ba73-de9d92d49a71 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] 10.222.0.18 "GET /compute/v2.1/servers/b1b68e60-81b4-4d1e-8bb8-ab8b94d918a8" status: 200 len: 1365 microversion: 2.47 time: 0.424377 Oct 22 21:07:30.966812 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1911/3829] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:07:30 2022] GET /compute/v2.1/servers/b1b68e60-81b4-4d1e-8bb8-ab8b94d918a8 => generated 1365 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 22 21:07:30.998913 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-4e1cb1e7-320f-4c34-96d2-8cf701b605ac tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:07:31.004259 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-4e1cb1e7-320f-4c34-96d2-8cf701b605ac tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] [instance: b769064b-9ef9-47b7-9cfd-5d3b8a24a7a1] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:07:31.017951 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4e1cb1e7-320f-4c34-96d2-8cf701b605ac tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:31.025895 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4e1cb1e7-320f-4c34-96d2-8cf701b605ac tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:31.031266 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4e1cb1e7-320f-4c34-96d2-8cf701b605ac tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:31.036444 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4e1cb1e7-320f-4c34-96d2-8cf701b605ac tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:31.037143 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4e1cb1e7-320f-4c34-96d2-8cf701b605ac tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:31.037764 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4e1cb1e7-320f-4c34-96d2-8cf701b605ac tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:31.395687 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-1bfc9892-fd42-4391-8f75-c80d979ec989 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3820b31a424c3a9216a6ef91fcb285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a42c3ecf474883ac652fcc8c01c9f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:07:31.419896 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-1bfc9892-fd42-4391-8f75-c80d979ec989 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] 10.222.0.18 "GET /compute/v2.1/servers/1324c851-90ff-47f4-b4e6-8acc8b829c5e" status: 200 len: 1192 microversion: 2.1 time: 1.220206 Oct 22 21:07:31.423665 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1919/3830] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:07:30 2022] GET /compute/v2.1/servers/1324c851-90ff-47f4-b4e6-8acc8b829c5e => generated 1192 bytes in 1225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:07:32.001202 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-ecb81d9e-c356-4461-8938-9b0c3236c4c3 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:07:32.003556 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-ecb81d9e-c356-4461-8938-9b0c3236c4c3 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] [instance: b1b68e60-81b4-4d1e-8bb8-ab8b94d918a8] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:07:32.049466 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ecb81d9e-c356-4461-8938-9b0c3236c4c3 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:32.057644 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ecb81d9e-c356-4461-8938-9b0c3236c4c3 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:32.061499 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ecb81d9e-c356-4461-8938-9b0c3236c4c3 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:32.063733 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ecb81d9e-c356-4461-8938-9b0c3236c4c3 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:32.064247 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ecb81d9e-c356-4461-8938-9b0c3236c4c3 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:32.066114 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ecb81d9e-c356-4461-8938-9b0c3236c4c3 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:32.444033 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-ecb81d9e-c356-4461-8938-9b0c3236c4c3 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebcd750fac45c183f21cf78ca939d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a73c458655e4b1db78801a8316fbdab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:07:32.462321 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-ecb81d9e-c356-4461-8938-9b0c3236c4c3 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdebcd750fac45c183f21cf78ca939d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a73c458655e4b1db78801a8316fbdab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:07:32.465073 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-ecb81d9e-c356-4461-8938-9b0c3236c4c3 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdebcd750fac45c183f21cf78ca939d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a73c458655e4b1db78801a8316fbdab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:07:32.472501 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-ecb81d9e-c356-4461-8938-9b0c3236c4c3 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] 10.222.0.18 "GET /compute/v2.1/servers/b1b68e60-81b4-4d1e-8bb8-ab8b94d918a8" status: 200 len: 1365 microversion: 2.47 time: 0.476275 Oct 22 21:07:32.496658 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-4e1cb1e7-320f-4c34-96d2-8cf701b605ac tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcdfeb6c1cda4810b9fa70fdfd9a66c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c774a85b2c41c98486cf91b1253363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:07:32.508563 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1920/3831] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:07:31 2022] GET /compute/v2.1/servers/b1b68e60-81b4-4d1e-8bb8-ab8b94d918a8 => generated 1365 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 22 21:07:32.511953 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-4e1cb1e7-320f-4c34-96d2-8cf701b605ac tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] 10.222.0.18 "GET /compute/v2.1/servers/b769064b-9ef9-47b7-9cfd-5d3b8a24a7a1" status: 200 len: 1517 microversion: 2.1 time: 1.543996 Oct 22 21:07:32.515885 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1912/3832] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:07:30 2022] GET /compute/v2.1/servers/b769064b-9ef9-47b7-9cfd-5d3b8a24a7a1 => generated 1517 bytes in 1549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:07:32.523153 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-80bfade6-f96b-4c6d-8456-835ef91df732 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:07:32.524937 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-80bfade6-f96b-4c6d-8456-835ef91df732 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] [instance: 1324c851-90ff-47f4-b4e6-8acc8b829c5e] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:07:32.538586 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-80bfade6-f96b-4c6d-8456-835ef91df732 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:32.544974 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-80bfade6-f96b-4c6d-8456-835ef91df732 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:32.545454 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-80bfade6-f96b-4c6d-8456-835ef91df732 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:32.548494 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-80bfade6-f96b-4c6d-8456-835ef91df732 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:32.549056 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-80bfade6-f96b-4c6d-8456-835ef91df732 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:32.549519 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-80bfade6-f96b-4c6d-8456-835ef91df732 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:32.805072 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-80bfade6-f96b-4c6d-8456-835ef91df732 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3820b31a424c3a9216a6ef91fcb285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a42c3ecf474883ac652fcc8c01c9f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:07:32.820783 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-80bfade6-f96b-4c6d-8456-835ef91df732 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] 10.222.0.18 "GET /compute/v2.1/servers/1324c851-90ff-47f4-b4e6-8acc8b829c5e" status: 200 len: 1210 microversion: 2.1 time: 0.310314 Oct 22 21:07:32.822755 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1921/3833] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:07:32 2022] GET /compute/v2.1/servers/1324c851-90ff-47f4-b4e6-8acc8b829c5e => generated 1210 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:07:33.026656 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-e5dc2703-91e5-4453-84f9-1c7b61325ec3 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Action: 'create', calling method: .version_select at 0x7fd39f01caf0>, body: {"keypair": {"name": "tempest-keypair-141956617", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIyL0QIFAm1dBCrLDIFwS/C1/XUIb4Fm0ihLTT8ObLVDjeEu9UegQY0TlKVxmshiK3mrk9A/rnOntJ5Ye7ZpMQthD2iASN0Zs5O9Kg867h69UzuiGwCVE4hGRNYziV9XDA=="}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:07:33.087682 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-e5dc2703-91e5-4453-84f9-1c7b61325ec3 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Getting quotas for project 755501ba3e344f1aaf7ef80924bb57d7. Resources: {'key_pairs'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 21:07:33.117554 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-e5dc2703-91e5-4453-84f9-1c7b61325ec3 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Getting quotas for user ba0d0bdfb04240209e4efa92f47cbb94 and project 755501ba3e344f1aaf7ef80924bb57d7. Resources: {'key_pairs'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 21:07:33.193331 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-e5dc2703-91e5-4453-84f9-1c7b61325ec3 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.449952 Oct 22 21:07:33.203374 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1913/3834] 10.222.0.18 () {60 vars in 1159 bytes} [Sat Oct 22 21:07:32 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:07:33.504657 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-2c25111f-33b9-4e8f-8f5f-fa8cf13eca68 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:07:33.506003 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-2c25111f-33b9-4e8f-8f5f-fa8cf13eca68 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] [instance: b1b68e60-81b4-4d1e-8bb8-ab8b94d918a8] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:07:33.514149 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2c25111f-33b9-4e8f-8f5f-fa8cf13eca68 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:33.514973 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2c25111f-33b9-4e8f-8f5f-fa8cf13eca68 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:33.516380 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2c25111f-33b9-4e8f-8f5f-fa8cf13eca68 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:33.517294 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2c25111f-33b9-4e8f-8f5f-fa8cf13eca68 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:33.518016 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2c25111f-33b9-4e8f-8f5f-fa8cf13eca68 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:33.518975 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2c25111f-33b9-4e8f-8f5f-fa8cf13eca68 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:33.544780 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-1d1999c0-eea1-4a36-b33d-64f5e3006e25 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:07:33.546385 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-1d1999c0-eea1-4a36-b33d-64f5e3006e25 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] [instance: b769064b-9ef9-47b7-9cfd-5d3b8a24a7a1] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:07:33.559204 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1d1999c0-eea1-4a36-b33d-64f5e3006e25 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:33.561774 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1d1999c0-eea1-4a36-b33d-64f5e3006e25 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:33.563918 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1d1999c0-eea1-4a36-b33d-64f5e3006e25 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:33.567735 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1d1999c0-eea1-4a36-b33d-64f5e3006e25 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:33.570107 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1d1999c0-eea1-4a36-b33d-64f5e3006e25 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:33.571923 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1d1999c0-eea1-4a36-b33d-64f5e3006e25 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:33.701903 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-2c25111f-33b9-4e8f-8f5f-fa8cf13eca68 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebcd750fac45c183f21cf78ca939d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a73c458655e4b1db78801a8316fbdab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:07:33.715876 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-2c25111f-33b9-4e8f-8f5f-fa8cf13eca68 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdebcd750fac45c183f21cf78ca939d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a73c458655e4b1db78801a8316fbdab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:07:33.717731 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-2c25111f-33b9-4e8f-8f5f-fa8cf13eca68 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdebcd750fac45c183f21cf78ca939d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a73c458655e4b1db78801a8316fbdab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:07:33.719909 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-2c25111f-33b9-4e8f-8f5f-fa8cf13eca68 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] 10.222.0.18 "GET /compute/v2.1/servers/b1b68e60-81b4-4d1e-8bb8-ab8b94d918a8" status: 200 len: 1371 microversion: 2.47 time: 0.219723 Oct 22 21:07:33.733791 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1922/3835] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:07:33 2022] GET /compute/v2.1/servers/b1b68e60-81b4-4d1e-8bb8-ab8b94d918a8 => generated 1371 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:07:33.850174 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-612ba78f-4d1b-4586-a9a9-3c3b30bde4f4 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:07:33.851171 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-612ba78f-4d1b-4586-a9a9-3c3b30bde4f4 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] [instance: 1324c851-90ff-47f4-b4e6-8acc8b829c5e] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:07:33.868168 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-612ba78f-4d1b-4586-a9a9-3c3b30bde4f4 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:33.871812 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-612ba78f-4d1b-4586-a9a9-3c3b30bde4f4 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:33.873309 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-612ba78f-4d1b-4586-a9a9-3c3b30bde4f4 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:33.874543 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-612ba78f-4d1b-4586-a9a9-3c3b30bde4f4 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:33.875650 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-612ba78f-4d1b-4586-a9a9-3c3b30bde4f4 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:33.876360 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-612ba78f-4d1b-4586-a9a9-3c3b30bde4f4 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:34.105521 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-612ba78f-4d1b-4586-a9a9-3c3b30bde4f4 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3820b31a424c3a9216a6ef91fcb285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a42c3ecf474883ac652fcc8c01c9f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:07:34.119588 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-612ba78f-4d1b-4586-a9a9-3c3b30bde4f4 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] 10.222.0.18 "GET /compute/v2.1/servers/1324c851-90ff-47f4-b4e6-8acc8b829c5e" status: 200 len: 1210 microversion: 2.1 time: 0.273262 Oct 22 21:07:34.121751 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1923/3836] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:07:33 2022] GET /compute/v2.1/servers/1324c851-90ff-47f4-b4e6-8acc8b829c5e => generated 1210 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:07:34.251210 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-1d1999c0-eea1-4a36-b33d-64f5e3006e25 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcdfeb6c1cda4810b9fa70fdfd9a66c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c774a85b2c41c98486cf91b1253363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:07:34.263442 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-1d1999c0-eea1-4a36-b33d-64f5e3006e25 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] 10.222.0.18 "GET /compute/v2.1/servers/b769064b-9ef9-47b7-9cfd-5d3b8a24a7a1" status: 200 len: 1517 microversion: 2.1 time: 0.723810 Oct 22 21:07:34.273758 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1914/3837] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:07:33 2022] GET /compute/v2.1/servers/b769064b-9ef9-47b7-9cfd-5d3b8a24a7a1 => generated 1517 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:07:34.750749 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-3a1ddb70-ecce-491d-a6f2-6eff445a9eba tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:07:34.751531 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-3a1ddb70-ecce-491d-a6f2-6eff445a9eba tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] [instance: b1b68e60-81b4-4d1e-8bb8-ab8b94d918a8] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:07:34.764809 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3a1ddb70-ecce-491d-a6f2-6eff445a9eba tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:34.765337 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3a1ddb70-ecce-491d-a6f2-6eff445a9eba tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:34.765842 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3a1ddb70-ecce-491d-a6f2-6eff445a9eba tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:34.766599 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3a1ddb70-ecce-491d-a6f2-6eff445a9eba tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:34.767080 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3a1ddb70-ecce-491d-a6f2-6eff445a9eba tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:34.767608 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3a1ddb70-ecce-491d-a6f2-6eff445a9eba tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:35.152846 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-0a5a896c-9c23-4fc6-af61-1159c82f9a90 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:07:35.153481 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-0a5a896c-9c23-4fc6-af61-1159c82f9a90 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] [instance: 1324c851-90ff-47f4-b4e6-8acc8b829c5e] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:07:35.157310 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:07:35.174202 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0a5a896c-9c23-4fc6-af61-1159c82f9a90 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:35.174954 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0a5a896c-9c23-4fc6-af61-1159c82f9a90 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:35.175443 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0a5a896c-9c23-4fc6-af61-1159c82f9a90 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:35.176186 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0a5a896c-9c23-4fc6-af61-1159c82f9a90 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:35.176839 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0a5a896c-9c23-4fc6-af61-1159c82f9a90 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:35.177807 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0a5a896c-9c23-4fc6-af61-1159c82f9a90 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:35.430760 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-3a1ddb70-ecce-491d-a6f2-6eff445a9eba tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebcd750fac45c183f21cf78ca939d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a73c458655e4b1db78801a8316fbdab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:07:35.449045 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-3a1ddb70-ecce-491d-a6f2-6eff445a9eba tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdebcd750fac45c183f21cf78ca939d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a73c458655e4b1db78801a8316fbdab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:07:35.450522 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-3a1ddb70-ecce-491d-a6f2-6eff445a9eba tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdebcd750fac45c183f21cf78ca939d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a73c458655e4b1db78801a8316fbdab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:07:35.451821 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-3a1ddb70-ecce-491d-a6f2-6eff445a9eba tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] 10.222.0.18 "GET /compute/v2.1/servers/b1b68e60-81b4-4d1e-8bb8-ab8b94d918a8" status: 200 len: 1371 microversion: 2.47 time: 0.705020 Oct 22 21:07:35.452390 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1924/3838] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:07:34 2022] GET /compute/v2.1/servers/b1b68e60-81b4-4d1e-8bb8-ab8b94d918a8 => generated 1371 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:07:35.474266 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-c65a3f5c-8d22-4014-be2f-06ae60183a87 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:07:35.476506 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-c65a3f5c-8d22-4014-be2f-06ae60183a87 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] [instance: b769064b-9ef9-47b7-9cfd-5d3b8a24a7a1] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:07:35.497423 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:07:35.513181 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c65a3f5c-8d22-4014-be2f-06ae60183a87 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:35.513715 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c65a3f5c-8d22-4014-be2f-06ae60183a87 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:35.514179 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c65a3f5c-8d22-4014-be2f-06ae60183a87 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:35.514925 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c65a3f5c-8d22-4014-be2f-06ae60183a87 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:35.532061 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c65a3f5c-8d22-4014-be2f-06ae60183a87 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:35.532810 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c65a3f5c-8d22-4014-be2f-06ae60183a87 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:35.666661 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-0a5a896c-9c23-4fc6-af61-1159c82f9a90 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3820b31a424c3a9216a6ef91fcb285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a42c3ecf474883ac652fcc8c01c9f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:07:35.680610 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-0a5a896c-9c23-4fc6-af61-1159c82f9a90 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] 10.222.0.18 "GET /compute/v2.1/servers/1324c851-90ff-47f4-b4e6-8acc8b829c5e" status: 200 len: 1265 microversion: 2.1 time: 0.531537 Oct 22 21:07:35.682148 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1915/3839] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:07:35 2022] GET /compute/v2.1/servers/1324c851-90ff-47f4-b4e6-8acc8b829c5e => generated 1265 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:07:35.992777 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-c65a3f5c-8d22-4014-be2f-06ae60183a87 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcdfeb6c1cda4810b9fa70fdfd9a66c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c774a85b2c41c98486cf91b1253363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:07:36.004094 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-c65a3f5c-8d22-4014-be2f-06ae60183a87 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] 10.222.0.18 "GET /compute/v2.1/servers/b769064b-9ef9-47b7-9cfd-5d3b8a24a7a1" status: 200 len: 1517 microversion: 2.1 time: 0.550607 Oct 22 21:07:36.004981 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1925/3840] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:07:35 2022] GET /compute/v2.1/servers/b769064b-9ef9-47b7-9cfd-5d3b8a24a7a1 => generated 1517 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:07:36.479994 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-95a6fda6-c2ad-4900-9fd9-e13e675b806b tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:07:36.481260 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-95a6fda6-c2ad-4900-9fd9-e13e675b806b tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] [instance: b1b68e60-81b4-4d1e-8bb8-ab8b94d918a8] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:07:36.498090 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-95a6fda6-c2ad-4900-9fd9-e13e675b806b tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:36.501636 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-95a6fda6-c2ad-4900-9fd9-e13e675b806b tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:36.503408 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-95a6fda6-c2ad-4900-9fd9-e13e675b806b tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:36.504921 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-95a6fda6-c2ad-4900-9fd9-e13e675b806b tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:36.506985 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-95a6fda6-c2ad-4900-9fd9-e13e675b806b tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:36.507689 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-95a6fda6-c2ad-4900-9fd9-e13e675b806b tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:36.714377 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-076f63f8-6ebf-4f51-98a1-7204de1f77de tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:07:36.717259 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-076f63f8-6ebf-4f51-98a1-7204de1f77de tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] [instance: 1324c851-90ff-47f4-b4e6-8acc8b829c5e] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:07:36.745868 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-076f63f8-6ebf-4f51-98a1-7204de1f77de tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:36.747031 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-076f63f8-6ebf-4f51-98a1-7204de1f77de tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:36.747836 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-076f63f8-6ebf-4f51-98a1-7204de1f77de tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:36.749000 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-076f63f8-6ebf-4f51-98a1-7204de1f77de tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:36.749705 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-076f63f8-6ebf-4f51-98a1-7204de1f77de tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:36.750684 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-076f63f8-6ebf-4f51-98a1-7204de1f77de tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:36.829867 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-95a6fda6-c2ad-4900-9fd9-e13e675b806b tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebcd750fac45c183f21cf78ca939d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a73c458655e4b1db78801a8316fbdab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:07:36.843435 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-95a6fda6-c2ad-4900-9fd9-e13e675b806b tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdebcd750fac45c183f21cf78ca939d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a73c458655e4b1db78801a8316fbdab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:07:36.848007 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-95a6fda6-c2ad-4900-9fd9-e13e675b806b tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdebcd750fac45c183f21cf78ca939d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a73c458655e4b1db78801a8316fbdab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:07:36.854575 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-95a6fda6-c2ad-4900-9fd9-e13e675b806b tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] 10.222.0.18 "GET /compute/v2.1/servers/b1b68e60-81b4-4d1e-8bb8-ab8b94d918a8" status: 200 len: 1371 microversion: 2.47 time: 0.378734 Oct 22 21:07:36.856925 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1916/3841] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:07:36 2022] GET /compute/v2.1/servers/b1b68e60-81b4-4d1e-8bb8-ab8b94d918a8 => generated 1371 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:07:37.036194 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-e0031a0b-4f2b-4794-884a-65f98ad9216f tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:07:37.037006 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-e0031a0b-4f2b-4794-884a-65f98ad9216f tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] [instance: b769064b-9ef9-47b7-9cfd-5d3b8a24a7a1] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:07:37.053105 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e0031a0b-4f2b-4794-884a-65f98ad9216f tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:37.053993 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e0031a0b-4f2b-4794-884a-65f98ad9216f tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:37.054703 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e0031a0b-4f2b-4794-884a-65f98ad9216f tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:37.055737 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e0031a0b-4f2b-4794-884a-65f98ad9216f tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:37.056445 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e0031a0b-4f2b-4794-884a-65f98ad9216f tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:37.057097 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e0031a0b-4f2b-4794-884a-65f98ad9216f tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:38.126531 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell0:SELECT=2 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:07:38.373760 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-076f63f8-6ebf-4f51-98a1-7204de1f77de tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3820b31a424c3a9216a6ef91fcb285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a42c3ecf474883ac652fcc8c01c9f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:07:38.385677 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-e0031a0b-4f2b-4794-884a-65f98ad9216f tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcdfeb6c1cda4810b9fa70fdfd9a66c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c774a85b2c41c98486cf91b1253363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:07:38.396328 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:07:38.401826 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-e0031a0b-4f2b-4794-884a-65f98ad9216f tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] 10.222.0.18 "GET /compute/v2.1/servers/b769064b-9ef9-47b7-9cfd-5d3b8a24a7a1" status: 200 len: 1517 microversion: 2.1 time: 1.368635 Oct 22 21:07:38.402609 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-076f63f8-6ebf-4f51-98a1-7204de1f77de tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] 10.222.0.18 "GET /compute/v2.1/servers/1324c851-90ff-47f4-b4e6-8acc8b829c5e" status: 200 len: 1265 microversion: 2.1 time: 1.699938 Oct 22 21:07:38.402784 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1917/3842] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:07:37 2022] GET /compute/v2.1/servers/b769064b-9ef9-47b7-9cfd-5d3b8a24a7a1 => generated 1517 bytes in 1372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:07:38.403864 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1926/3843] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:07:36 2022] GET /compute/v2.1/servers/1324c851-90ff-47f4-b4e6-8acc8b829c5e => generated 1265 bytes in 1702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:07:38.422932 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-29db5ef1-643a-45e0-8a59-a1a147c11a57 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-557610622", "imageRef": "085e4478-6edc-4a69-8e08-f9831713eb65", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ca9349bd-3a50-4a00-9835-d7bef81d5673"}], "security_groups": [{"name": "tempest-securitygroup--895214488"}], "key_name": "tempest-keypair-141956617", "user_data": "}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:07:38.429176 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-7ffd054a-f05d-42a2-8afb-0992e54459b9 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:07:38.430109 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-7ffd054a-f05d-42a2-8afb-0992e54459b9 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] [instance: b1b68e60-81b4-4d1e-8bb8-ab8b94d918a8] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:07:38.478005 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7ffd054a-f05d-42a2-8afb-0992e54459b9 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:38.478659 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7ffd054a-f05d-42a2-8afb-0992e54459b9 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:38.479133 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7ffd054a-f05d-42a2-8afb-0992e54459b9 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:38.480422 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7ffd054a-f05d-42a2-8afb-0992e54459b9 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:38.481285 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7ffd054a-f05d-42a2-8afb-0992e54459b9 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:38.481990 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7ffd054a-f05d-42a2-8afb-0992e54459b9 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:38.847304 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-7ffd054a-f05d-42a2-8afb-0992e54459b9 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebcd750fac45c183f21cf78ca939d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a73c458655e4b1db78801a8316fbdab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:07:38.859198 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-7ffd054a-f05d-42a2-8afb-0992e54459b9 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdebcd750fac45c183f21cf78ca939d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a73c458655e4b1db78801a8316fbdab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:07:38.862080 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-7ffd054a-f05d-42a2-8afb-0992e54459b9 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdebcd750fac45c183f21cf78ca939d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a73c458655e4b1db78801a8316fbdab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:07:38.865113 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-7ffd054a-f05d-42a2-8afb-0992e54459b9 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] 10.222.0.18 "GET /compute/v2.1/servers/b1b68e60-81b4-4d1e-8bb8-ab8b94d918a8" status: 200 len: 1356 microversion: 2.47 time: 0.455214 Oct 22 21:07:38.868523 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1918/3844] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:07:38 2022] GET /compute/v2.1/servers/b1b68e60-81b4-4d1e-8bb8-ab8b94d918a8 => generated 1356 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:07:38.901617 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-d51f0cdd-d873-48b1-9c59-624f130384a8 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:07:38.907184 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-d51f0cdd-d873-48b1-9c59-624f130384a8 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'cdebcd750fac45c183f21cf78ca939d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a73c458655e4b1db78801a8316fbdab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:07:38.908343 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-d51f0cdd-d873-48b1-9c59-624f130384a8 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Searching by: {'deleted': False, 'project_id': '2a73c458655e4b1db78801a8316fbdab'} {{(pid=138744) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 22 21:07:38.914273 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d51f0cdd-d873-48b1-9c59-624f130384a8 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:38.915391 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d51f0cdd-d873-48b1-9c59-624f130384a8 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:38.916486 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d51f0cdd-d873-48b1-9c59-624f130384a8 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:38.917447 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d51f0cdd-d873-48b1-9c59-624f130384a8 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:38.918194 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d51f0cdd-d873-48b1-9c59-624f130384a8 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:38.918778 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d51f0cdd-d873-48b1-9c59-624f130384a8 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:39.114696 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.network.neutron [None req-29db5ef1-643a-45e0-8a59-a1a147c11a57 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] validate_networks() for [('ca9349bd-3a50-4a00-9835-d7bef81d5673', None, None, None, None, None)] {{(pid=138745) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 21:07:39.162650 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell0:SELECT=12 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:07:39.186069 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.multi_cell_list [None req-d51f0cdd-d873-48b1-9c59-624f130384a8 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=138744) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 22 21:07:39.328728 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-d51f0cdd-d873-48b1-9c59-624f130384a8 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebcd750fac45c183f21cf78ca939d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a73c458655e4b1db78801a8316fbdab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:07:39.341234 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d51f0cdd-d873-48b1-9c59-624f130384a8 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:39.341714 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d51f0cdd-d873-48b1-9c59-624f130384a8 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:39.342584 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d51f0cdd-d873-48b1-9c59-624f130384a8 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:39.363812 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-d51f0cdd-d873-48b1-9c59-624f130384a8 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdebcd750fac45c183f21cf78ca939d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a73c458655e4b1db78801a8316fbdab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:07:39.365602 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-d51f0cdd-d873-48b1-9c59-624f130384a8 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdebcd750fac45c183f21cf78ca939d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a73c458655e4b1db78801a8316fbdab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:07:39.508292 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-d51f0cdd-d873-48b1-9c59-624f130384a8 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] 10.222.0.18 "GET /compute/v2.1/servers/detail" status: 200 len: 2706 microversion: 2.47 time: 0.610583 Oct 22 21:07:39.519432 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1919/3845] 10.222.0.18 () {60 vars in 1187 bytes} [Sat Oct 22 21:07:38 2022] GET /compute/v2.1/servers/detail => generated 2706 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 22 21:07:39.545742 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-7886c5ca-4ea6-4982-87fe-81c2f9cf9d03 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:07:39.546979 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-7886c5ca-4ea6-4982-87fe-81c2f9cf9d03 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] [instance: b769064b-9ef9-47b7-9cfd-5d3b8a24a7a1] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:07:39.555182 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7886c5ca-4ea6-4982-87fe-81c2f9cf9d03 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:39.555941 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7886c5ca-4ea6-4982-87fe-81c2f9cf9d03 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:39.556597 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7886c5ca-4ea6-4982-87fe-81c2f9cf9d03 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:39.557980 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7886c5ca-4ea6-4982-87fe-81c2f9cf9d03 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:39.558637 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7886c5ca-4ea6-4982-87fe-81c2f9cf9d03 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:39.559671 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7886c5ca-4ea6-4982-87fe-81c2f9cf9d03 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:40.602540 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-7886c5ca-4ea6-4982-87fe-81c2f9cf9d03 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcdfeb6c1cda4810b9fa70fdfd9a66c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c774a85b2c41c98486cf91b1253363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:07:40.624446 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-7886c5ca-4ea6-4982-87fe-81c2f9cf9d03 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] 10.222.0.18 "GET /compute/v2.1/servers/b769064b-9ef9-47b7-9cfd-5d3b8a24a7a1" status: 200 len: 1517 microversion: 2.1 time: 1.102512 Oct 22 21:07:40.625867 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1920/3846] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:07:39 2022] GET /compute/v2.1/servers/b769064b-9ef9-47b7-9cfd-5d3b8a24a7a1 => generated 1517 bytes in 1105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:07:40.636600 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-ae05e59a-ec7a-41e1-9d9d-b65d66fb34e6 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:07:40.652743 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-ae05e59a-ec7a-41e1-9d9d-b65d66fb34e6 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] [instance: 1324c851-90ff-47f4-b4e6-8acc8b829c5e] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:07:40.663033 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ae05e59a-ec7a-41e1-9d9d-b65d66fb34e6 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:40.664828 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ae05e59a-ec7a-41e1-9d9d-b65d66fb34e6 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:40.665465 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ae05e59a-ec7a-41e1-9d9d-b65d66fb34e6 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:40.666350 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ae05e59a-ec7a-41e1-9d9d-b65d66fb34e6 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:40.666958 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ae05e59a-ec7a-41e1-9d9d-b65d66fb34e6 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:40.667709 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ae05e59a-ec7a-41e1-9d9d-b65d66fb34e6 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:41.241670 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-ae05e59a-ec7a-41e1-9d9d-b65d66fb34e6 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3820b31a424c3a9216a6ef91fcb285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a42c3ecf474883ac652fcc8c01c9f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:07:41.253984 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-29db5ef1-643a-45e0-8a59-a1a147c11a57 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Flavor limits 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 21:07:41.254511 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-29db5ef1-643a-45e0-8a59-a1a147c11a57 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Image limits 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 21:07:41.255181 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-29db5ef1-643a-45e0-8a59-a1a147c11a57 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Flavor pref 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 21:07:41.255653 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-29db5ef1-643a-45e0-8a59-a1a147c11a57 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Image pref 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 21:07:41.256098 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-29db5ef1-643a-45e0-8a59-a1a147c11a57 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 21:07:41.256921 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-ae05e59a-ec7a-41e1-9d9d-b65d66fb34e6 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] 10.222.0.18 "GET /compute/v2.1/servers/1324c851-90ff-47f4-b4e6-8acc8b829c5e" status: 200 len: 1265 microversion: 2.1 time: 0.627849 Oct 22 21:07:41.273327 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1921/3847] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:07:40 2022] GET /compute/v2.1/servers/1324c851-90ff-47f4-b4e6-8acc8b829c5e => generated 1265 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:07:41.274227 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-29db5ef1-643a-45e0-8a59-a1a147c11a57 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:41.274753 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-29db5ef1-643a-45e0-8a59-a1a147c11a57 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:41.275397 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-29db5ef1-643a-45e0-8a59-a1a147c11a57 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:41.278084 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-29db5ef1-643a-45e0-8a59-a1a147c11a57 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:41.278841 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-29db5ef1-643a-45e0-8a59-a1a147c11a57 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:41.280138 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-29db5ef1-643a-45e0-8a59-a1a147c11a57 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:41.284784 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-bfe0f9ab-d7d0-4fac-83ef-0fd31eb7c17f tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:07:41.285427 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-bfe0f9ab-d7d0-4fac-83ef-0fd31eb7c17f tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] [instance: b1b68e60-81b4-4d1e-8bb8-ab8b94d918a8] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:07:41.298498 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bfe0f9ab-d7d0-4fac-83ef-0fd31eb7c17f tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:41.299565 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bfe0f9ab-d7d0-4fac-83ef-0fd31eb7c17f tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:41.300242 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bfe0f9ab-d7d0-4fac-83ef-0fd31eb7c17f tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:41.303706 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bfe0f9ab-d7d0-4fac-83ef-0fd31eb7c17f tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:41.304467 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bfe0f9ab-d7d0-4fac-83ef-0fd31eb7c17f tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:41.305154 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bfe0f9ab-d7d0-4fac-83ef-0fd31eb7c17f tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:41.345117 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-bfe0f9ab-d7d0-4fac-83ef-0fd31eb7c17f tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] [instance: b1b68e60-81b4-4d1e-8bb8-ab8b94d918a8] Going to try to terminate instance {{(pid=138744) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 21:07:41.353651 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-29db5ef1-643a-45e0-8a59-a1a147c11a57 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Getting quotas for project 755501ba3e344f1aaf7ef80924bb57d7. Resources: {'cores', 'instances', 'ram'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 21:07:41.372665 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-29db5ef1-643a-45e0-8a59-a1a147c11a57 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Getting quotas for user ba0d0bdfb04240209e4efa92f47cbb94 and project 755501ba3e344f1aaf7ef80924bb57d7. Resources: {'cores', 'instances', 'ram'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 21:07:41.418670 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-29db5ef1-643a-45e0-8a59-a1a147c11a57 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Going to run 1 instances... {{(pid=138745) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 21:07:41.421152 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-29db5ef1-643a-45e0-8a59-a1a147c11a57 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] [instance: ad302c49-addb-464c-a15f-fa01577f90c4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='085e4478-6edc-4a69-8e08-f9831713eb65',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138745) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 21:07:41.505894 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-bfe0f9ab-d7d0-4fac-83ef-0fd31eb7c17f tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] 10.222.0.18 "DELETE /compute/v2.1/servers/b1b68e60-81b4-4d1e-8bb8-ab8b94d918a8" status: 204 len: 0 microversion: 2.47 time: 0.230482 Oct 22 21:07:41.509455 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1922/3848] 10.222.0.18 () {60 vars in 1280 bytes} [Sat Oct 22 21:07:41 2022] DELETE /compute/v2.1/servers/b1b68e60-81b4-4d1e-8bb8-ab8b94d918a8 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 22 21:07:41.517822 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-b4cf3d11-565f-45e3-8ee7-9b7d4d189efa req-72291197-bd4d-4142-9b63-e9f3bee7b29a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1324c851-90ff-47f4-b4e6-8acc8b829c5e", "tag": "1113aabe-4c05-4eae-bc2b-f7bdc1f1d7ce"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:07:41.539208 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-b4cf3d11-565f-45e3-8ee7-9b7d4d189efa req-72291197-bd4d-4142-9b63-e9f3bee7b29a service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:41.545155 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-b4cf3d11-565f-45e3-8ee7-9b7d4d189efa req-72291197-bd4d-4142-9b63-e9f3bee7b29a service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:41.545753 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-b4cf3d11-565f-45e3-8ee7-9b7d4d189efa req-72291197-bd4d-4142-9b63-e9f3bee7b29a service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:41.555265 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-29db5ef1-643a-45e0-8a59-a1a147c11a57 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 3.147562 Oct 22 21:07:41.556013 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1927/3849] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Oct 22 21:07:38 2022] POST /compute/v2.1/servers => generated 401 bytes in 3151 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 21:07:41.571443 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-0cd48151-3b20-4ecf-8e58-328520135373 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:07:41.573134 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-0cd48151-3b20-4ecf-8e58-328520135373 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] [instance: b1b68e60-81b4-4d1e-8bb8-ab8b94d918a8] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:07:41.583103 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0cd48151-3b20-4ecf-8e58-328520135373 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:41.584677 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0cd48151-3b20-4ecf-8e58-328520135373 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:41.585335 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0cd48151-3b20-4ecf-8e58-328520135373 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:41.587068 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0cd48151-3b20-4ecf-8e58-328520135373 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:41.588168 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0cd48151-3b20-4ecf-8e58-328520135373 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:41.588874 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0cd48151-3b20-4ecf-8e58-328520135373 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:41.598238 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-b4cf3d11-565f-45e3-8ee7-9b7d4d189efa req-72291197-bd4d-4142-9b63-e9f3bee7b29a service nova] Creating event network-changed:1113aabe-4c05-4eae-bc2b-f7bdc1f1d7ce for instance 1324c851-90ff-47f4-b4e6-8acc8b829c5e on nch2-master-1 Oct 22 21:07:41.610455 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-b4cf3d11-565f-45e3-8ee7-9b7d4d189efa req-72291197-bd4d-4142-9b63-e9f3bee7b29a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099225 Oct 22 21:07:41.613230 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1923/3850] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:07:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:07:41.628020 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-1cc40c19-37c1-45e4-858d-f113a00f5af4 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:07:41.629353 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-1cc40c19-37c1-45e4-858d-f113a00f5af4 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] [instance: ad302c49-addb-464c-a15f-fa01577f90c4] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:07:41.989219 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-1cc40c19-37c1-45e4-858d-f113a00f5af4 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0d0bdfb04240209e4efa92f47cbb94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755501ba3e344f1aaf7ef80924bb57d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:07:42.000616 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-0cd48151-3b20-4ecf-8e58-328520135373 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebcd750fac45c183f21cf78ca939d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a73c458655e4b1db78801a8316fbdab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:07:42.001151 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-1cc40c19-37c1-45e4-858d-f113a00f5af4 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] 10.222.0.18 "GET /compute/v2.1/servers/ad302c49-addb-464c-a15f-fa01577f90c4" status: 200 len: 1236 microversion: 2.1 time: 0.376146 Oct 22 21:07:42.001771 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1924/3851] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:07:41 2022] GET /compute/v2.1/servers/ad302c49-addb-464c-a15f-fa01577f90c4 => generated 1236 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:07:42.021946 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-b998c9f6-f55a-4255-8494-3020cb1132a8 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:07:42.023185 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-b998c9f6-f55a-4255-8494-3020cb1132a8 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] [instance: b769064b-9ef9-47b7-9cfd-5d3b8a24a7a1] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:07:42.031537 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-0cd48151-3b20-4ecf-8e58-328520135373 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdebcd750fac45c183f21cf78ca939d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a73c458655e4b1db78801a8316fbdab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:07:42.033602 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-0cd48151-3b20-4ecf-8e58-328520135373 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdebcd750fac45c183f21cf78ca939d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a73c458655e4b1db78801a8316fbdab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:07:42.035239 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-0cd48151-3b20-4ecf-8e58-328520135373 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] 10.222.0.18 "GET /compute/v2.1/servers/b1b68e60-81b4-4d1e-8bb8-ab8b94d918a8" status: 200 len: 1362 microversion: 2.47 time: 0.478239 Oct 22 21:07:42.036058 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1928/3852] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:07:41 2022] GET /compute/v2.1/servers/b1b68e60-81b4-4d1e-8bb8-ab8b94d918a8 => generated 1362 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:07:42.051726 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b998c9f6-f55a-4255-8494-3020cb1132a8 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:42.051726 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b998c9f6-f55a-4255-8494-3020cb1132a8 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:42.051726 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b998c9f6-f55a-4255-8494-3020cb1132a8 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:42.051726 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b998c9f6-f55a-4255-8494-3020cb1132a8 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:42.051726 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b998c9f6-f55a-4255-8494-3020cb1132a8 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:42.051726 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b998c9f6-f55a-4255-8494-3020cb1132a8 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:42.285901 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-5b9589f8-9352-447f-a1a4-3586e8c812dd tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:07:42.287079 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-5b9589f8-9352-447f-a1a4-3586e8c812dd tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] [instance: 1324c851-90ff-47f4-b4e6-8acc8b829c5e] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:07:42.294131 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5b9589f8-9352-447f-a1a4-3586e8c812dd tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:42.294875 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5b9589f8-9352-447f-a1a4-3586e8c812dd tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:42.295602 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5b9589f8-9352-447f-a1a4-3586e8c812dd tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:42.296977 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5b9589f8-9352-447f-a1a4-3586e8c812dd tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:42.297782 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5b9589f8-9352-447f-a1a4-3586e8c812dd tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:42.298237 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5b9589f8-9352-447f-a1a4-3586e8c812dd tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:42.616630 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-b998c9f6-f55a-4255-8494-3020cb1132a8 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcdfeb6c1cda4810b9fa70fdfd9a66c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c774a85b2c41c98486cf91b1253363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:07:42.626135 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-b998c9f6-f55a-4255-8494-3020cb1132a8 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] 10.222.0.18 "GET /compute/v2.1/servers/b769064b-9ef9-47b7-9cfd-5d3b8a24a7a1" status: 200 len: 1517 microversion: 2.1 time: 0.621876 Oct 22 21:07:42.627510 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1925/3853] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:07:42 2022] GET /compute/v2.1/servers/b769064b-9ef9-47b7-9cfd-5d3b8a24a7a1 => generated 1517 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:07:42.832819 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-5b9589f8-9352-447f-a1a4-3586e8c812dd tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3820b31a424c3a9216a6ef91fcb285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a42c3ecf474883ac652fcc8c01c9f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:07:42.841549 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-5b9589f8-9352-447f-a1a4-3586e8c812dd tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] 10.222.0.18 "GET /compute/v2.1/servers/1324c851-90ff-47f4-b4e6-8acc8b829c5e" status: 200 len: 1265 microversion: 2.1 time: 0.559907 Oct 22 21:07:42.842646 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1929/3854] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:07:42 2022] GET /compute/v2.1/servers/1324c851-90ff-47f4-b4e6-8acc8b829c5e => generated 1265 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:07:43.035459 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-189eb279-9f71-483d-b56f-ef4831620811 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:07:43.036602 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-189eb279-9f71-483d-b56f-ef4831620811 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] [instance: ad302c49-addb-464c-a15f-fa01577f90c4] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:07:43.044197 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-189eb279-9f71-483d-b56f-ef4831620811 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:43.044907 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-189eb279-9f71-483d-b56f-ef4831620811 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:43.045551 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-189eb279-9f71-483d-b56f-ef4831620811 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:43.046464 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-189eb279-9f71-483d-b56f-ef4831620811 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:43.047075 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-189eb279-9f71-483d-b56f-ef4831620811 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:43.047823 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-189eb279-9f71-483d-b56f-ef4831620811 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:43.063725 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-28d6f3a8-2e0c-4054-9ff7-bd750016c536 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:07:43.065336 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-28d6f3a8-2e0c-4054-9ff7-bd750016c536 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] [instance: b1b68e60-81b4-4d1e-8bb8-ab8b94d918a8] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:07:43.077986 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-28d6f3a8-2e0c-4054-9ff7-bd750016c536 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:43.080293 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-28d6f3a8-2e0c-4054-9ff7-bd750016c536 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:43.080789 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-28d6f3a8-2e0c-4054-9ff7-bd750016c536 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:43.081579 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-28d6f3a8-2e0c-4054-9ff7-bd750016c536 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:43.082075 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-28d6f3a8-2e0c-4054-9ff7-bd750016c536 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:43.082526 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-28d6f3a8-2e0c-4054-9ff7-bd750016c536 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:43.685751 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-28d6f3a8-2e0c-4054-9ff7-bd750016c536 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebcd750fac45c183f21cf78ca939d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a73c458655e4b1db78801a8316fbdab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:07:43.696450 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-28d6f3a8-2e0c-4054-9ff7-bd750016c536 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdebcd750fac45c183f21cf78ca939d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a73c458655e4b1db78801a8316fbdab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:07:43.698267 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-28d6f3a8-2e0c-4054-9ff7-bd750016c536 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdebcd750fac45c183f21cf78ca939d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a73c458655e4b1db78801a8316fbdab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:07:43.699601 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-28d6f3a8-2e0c-4054-9ff7-bd750016c536 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] 10.222.0.18 "GET /compute/v2.1/servers/b1b68e60-81b4-4d1e-8bb8-ab8b94d918a8" status: 200 len: 1362 microversion: 2.47 time: 0.640278 Oct 22 21:07:43.700335 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1930/3855] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:07:43 2022] GET /compute/v2.1/servers/b1b68e60-81b4-4d1e-8bb8-ab8b94d918a8 => generated 1362 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:07:43.707856 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-b7e8f482-872e-4abf-9714-2bcc1fefcc8d tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:07:43.708568 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-b7e8f482-872e-4abf-9714-2bcc1fefcc8d tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] [instance: b769064b-9ef9-47b7-9cfd-5d3b8a24a7a1] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:07:43.714857 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b7e8f482-872e-4abf-9714-2bcc1fefcc8d tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:43.715708 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b7e8f482-872e-4abf-9714-2bcc1fefcc8d tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:43.716360 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b7e8f482-872e-4abf-9714-2bcc1fefcc8d tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:43.717523 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b7e8f482-872e-4abf-9714-2bcc1fefcc8d tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:43.718203 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b7e8f482-872e-4abf-9714-2bcc1fefcc8d tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:43.718732 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b7e8f482-872e-4abf-9714-2bcc1fefcc8d tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:43.730791 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-189eb279-9f71-483d-b56f-ef4831620811 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0d0bdfb04240209e4efa92f47cbb94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755501ba3e344f1aaf7ef80924bb57d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:07:43.752868 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-189eb279-9f71-483d-b56f-ef4831620811 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] 10.222.0.18 "GET /compute/v2.1/servers/ad302c49-addb-464c-a15f-fa01577f90c4" status: 200 len: 1240 microversion: 2.1 time: 0.728808 Oct 22 21:07:43.753730 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1926/3856] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:07:43 2022] GET /compute/v2.1/servers/ad302c49-addb-464c-a15f-fa01577f90c4 => generated 1240 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:07:43.867026 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-a12ee658-e4b4-4f3f-bbd2-2ee022d1ea85 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:07:43.868144 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-a12ee658-e4b4-4f3f-bbd2-2ee022d1ea85 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] [instance: 1324c851-90ff-47f4-b4e6-8acc8b829c5e] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:07:43.889005 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a12ee658-e4b4-4f3f-bbd2-2ee022d1ea85 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:43.889772 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a12ee658-e4b4-4f3f-bbd2-2ee022d1ea85 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:43.895525 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a12ee658-e4b4-4f3f-bbd2-2ee022d1ea85 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:43.896519 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a12ee658-e4b4-4f3f-bbd2-2ee022d1ea85 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:43.897354 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a12ee658-e4b4-4f3f-bbd2-2ee022d1ea85 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:43.900535 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a12ee658-e4b4-4f3f-bbd2-2ee022d1ea85 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:44.227270 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-b7e8f482-872e-4abf-9714-2bcc1fefcc8d tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcdfeb6c1cda4810b9fa70fdfd9a66c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c774a85b2c41c98486cf91b1253363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:07:44.237847 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-b7e8f482-872e-4abf-9714-2bcc1fefcc8d tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] 10.222.0.18 "GET /compute/v2.1/servers/b769064b-9ef9-47b7-9cfd-5d3b8a24a7a1" status: 200 len: 1517 microversion: 2.1 time: 0.536135 Oct 22 21:07:44.238859 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1931/3857] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:07:43 2022] GET /compute/v2.1/servers/b769064b-9ef9-47b7-9cfd-5d3b8a24a7a1 => generated 1517 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:07:44.444930 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-a12ee658-e4b4-4f3f-bbd2-2ee022d1ea85 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3820b31a424c3a9216a6ef91fcb285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a42c3ecf474883ac652fcc8c01c9f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:07:44.454612 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-a12ee658-e4b4-4f3f-bbd2-2ee022d1ea85 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] 10.222.0.18 "GET /compute/v2.1/servers/1324c851-90ff-47f4-b4e6-8acc8b829c5e" status: 200 len: 1265 microversion: 2.1 time: 0.593163 Oct 22 21:07:44.456416 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1927/3858] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:07:43 2022] GET /compute/v2.1/servers/1324c851-90ff-47f4-b4e6-8acc8b829c5e => generated 1265 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:07:44.727662 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-99b090af-c86d-49d9-973c-aa5ce1db1321 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:07:44.728948 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-99b090af-c86d-49d9-973c-aa5ce1db1321 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] [instance: b1b68e60-81b4-4d1e-8bb8-ab8b94d918a8] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:07:44.748934 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-99b090af-c86d-49d9-973c-aa5ce1db1321 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:44.750751 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-99b090af-c86d-49d9-973c-aa5ce1db1321 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:44.753780 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-99b090af-c86d-49d9-973c-aa5ce1db1321 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:44.755767 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-99b090af-c86d-49d9-973c-aa5ce1db1321 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:44.756267 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-99b090af-c86d-49d9-973c-aa5ce1db1321 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:44.756723 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-99b090af-c86d-49d9-973c-aa5ce1db1321 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:44.777706 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-82c76dfc-9e28-4411-81c6-758a8c18d173 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:07:44.778335 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-82c76dfc-9e28-4411-81c6-758a8c18d173 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] [instance: ad302c49-addb-464c-a15f-fa01577f90c4] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:07:44.779105 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.wsgi [None req-99b090af-c86d-49d9-973c-aa5ce1db1321 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] HTTP exception thrown: Instance b1b68e60-81b4-4d1e-8bb8-ab8b94d918a8 could not be found. Oct 22 21:07:44.781184 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-99b090af-c86d-49d9-973c-aa5ce1db1321 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Request method failure captured: Oct 22 21:07:44.781184 ncdv-master-1 devstack@n-api.service[138745]: request: GET /compute/v2.1/servers/b1b68e60-81b4-4d1e-8bb8-ab8b94d918a8 HTTP/1.1 Oct 22 21:07:44.781184 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 21:07:44.781184 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 21:07:44.781184 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 21:07:44.781184 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 0 Oct 22 21:07:44.781184 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 21:07:44.781184 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 21:07:44.781184 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 21:07:44.781184 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 21:07:44.781184 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVFtoT5QBMNC7xI4NN0wGPLrlbrvdThS2TovRHTxdl4Z_aqmzmR0PhhuElJEBQt5Hc5_glSwb8dm54-KpLANEqfwXUCFEf_bZBUPsumBhqpJvUM3ZU0LXQo1fCcLKKQ7Sbqh7loYrFMyBuZaehE1uLwm4Ibo6o7dfdNxZJ2CXT5Zuycc Oct 22 21:07:44.781184 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 21:07:44.781184 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 21:07:44.781184 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 21:07:44.781184 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 21:07:44.781184 ncdv-master-1 devstack@n-api.service[138745]: X-Openstack-Nova-Api-Version: 2.47 Oct 22 21:07:44.781184 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 21:07:44.781184 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 21:07:44.781184 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: 2a73c458655e4b1db78801a8316fbdab Oct 22 21:07:44.781184 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-ServerShowV247Test-488912206 Oct 22 21:07:44.781184 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 21:07:44.781184 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 21:07:44.781184 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_2a73c458655e4b1db78801a8316fbdab"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2a73c458655e4b1db78801a8316fbdab"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/2a73c458655e4b1db78801a8316fbdab"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2a73c458655e4b1db78801a8316fbdab"}]}] Oct 22 21:07:44.781184 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-ServerShowV247Test-488912206 Oct 22 21:07:44.781184 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: 2a73c458655e4b1db78801a8316fbdab Oct 22 21:07:44.781184 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-ServerShowV247Test-488912206 Oct 22 21:07:44.781184 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-ServerShowV247Test-488912206-project Oct 22 21:07:44.781184 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 21:07:44.781184 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 21:07:44.781184 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: cdebcd750fac45c183f21cf78ca939d9 Oct 22 21:07:44.781184 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-ServerShowV247Test-488912206-project Oct 22 21:07:44.781184 ncdv-master-1 devstack@n-api.service[138745]: method: > Oct 22 21:07:44.781184 ncdv-master-1 devstack@n-api.service[138745]: exception: Instance b1b68e60-81b4-4d1e-8bb8-ab8b94d918a8 could not be found. Oct 22 21:07:44.781184 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'id': 'b1b68e60-81b4-4d1e-8bb8-ab8b94d918a8'} Oct 22 21:07:44.781184 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:07:44.781184 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:07:44.781184 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 21:07:44.781184 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 21:07:44.781184 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 21:07:44.781184 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 21:07:44.781184 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 21:07:44.781184 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 21:07:44.781184 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 21:07:44.781184 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 21:07:44.781184 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b1b68e60-81b4-4d1e-8bb8-ab8b94d918a8 could not be found. Oct 22 21:07:44.781184 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:07:44.781184 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:07:44.781184 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:07:44.781184 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:07:44.781184 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:07:44.781184 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:07:44.781184 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:07:44.781184 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:07:44.781184 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:07:44.781184 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:07:44.781184 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 21:07:44.781184 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 21:07:44.781184 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 21:07:44.781184 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 21:07:44.781184 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 21:07:44.781184 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:07:44.781184 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b1b68e60-81b4-4d1e-8bb8-ab8b94d918a8 could not be found. Oct 22 21:07:44.781184 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:07:44.781184 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:07:44.781184 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:07:44.785120 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:07:44.785120 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:07:44.785120 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:07:44.785120 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:07:44.785120 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:07:44.785120 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b1b68e60-81b4-4d1e-8bb8-ab8b94d918a8 could not be found. Oct 22 21:07:44.785120 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:07:44.786222 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-82c76dfc-9e28-4411-81c6-758a8c18d173 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:44.788403 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-99b090af-c86d-49d9-973c-aa5ce1db1321 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Returning 404 to user: Instance b1b68e60-81b4-4d1e-8bb8-ab8b94d918a8 could not be found. {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:07:44.789540 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-99b090af-c86d-49d9-973c-aa5ce1db1321 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] 10.222.0.18 "GET /compute/v2.1/servers/b1b68e60-81b4-4d1e-8bb8-ab8b94d918a8" status: 404 len: 111 microversion: 2.47 time: 0.068443 Oct 22 21:07:44.790643 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1932/3859] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:07:44 2022] GET /compute/v2.1/servers/b1b68e60-81b4-4d1e-8bb8-ab8b94d918a8 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 22 21:07:44.792096 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-82c76dfc-9e28-4411-81c6-758a8c18d173 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:44.799617 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-82c76dfc-9e28-4411-81c6-758a8c18d173 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:44.801237 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-82c76dfc-9e28-4411-81c6-758a8c18d173 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:44.802135 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-82c76dfc-9e28-4411-81c6-758a8c18d173 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:44.804984 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-82c76dfc-9e28-4411-81c6-758a8c18d173 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:44.817070 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-6acf2cf5-c3d2-4392-9d4b-3a672b0742b4 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:07:44.819026 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-6acf2cf5-c3d2-4392-9d4b-3a672b0742b4 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] [instance: 7b2e6379-2f50-4138-b7b0-c064eda95b42] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:07:44.841182 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6acf2cf5-c3d2-4392-9d4b-3a672b0742b4 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:44.843731 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6acf2cf5-c3d2-4392-9d4b-3a672b0742b4 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:44.849176 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6acf2cf5-c3d2-4392-9d4b-3a672b0742b4 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:44.852255 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6acf2cf5-c3d2-4392-9d4b-3a672b0742b4 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:44.856774 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6acf2cf5-c3d2-4392-9d4b-3a672b0742b4 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:44.864708 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6acf2cf5-c3d2-4392-9d4b-3a672b0742b4 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:44.939553 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-6acf2cf5-c3d2-4392-9d4b-3a672b0742b4 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] [instance: 7b2e6379-2f50-4138-b7b0-c064eda95b42] Going to try to terminate instance {{(pid=138745) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 21:07:45.054674 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-82c76dfc-9e28-4411-81c6-758a8c18d173 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0d0bdfb04240209e4efa92f47cbb94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755501ba3e344f1aaf7ef80924bb57d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:07:45.071898 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-82c76dfc-9e28-4411-81c6-758a8c18d173 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] 10.222.0.18 "GET /compute/v2.1/servers/ad302c49-addb-464c-a15f-fa01577f90c4" status: 200 len: 1294 microversion: 2.1 time: 0.296771 Oct 22 21:07:45.094448 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1928/3860] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:07:44 2022] GET /compute/v2.1/servers/ad302c49-addb-464c-a15f-fa01577f90c4 => generated 1294 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:07:45.106596 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:07:45.191554 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-6acf2cf5-c3d2-4392-9d4b-3a672b0742b4 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] 10.222.0.18 "DELETE /compute/v2.1/servers/7b2e6379-2f50-4138-b7b0-c064eda95b42" status: 204 len: 0 microversion: 2.47 time: 0.393186 Oct 22 21:07:45.192632 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1933/3861] 10.222.0.18 () {60 vars in 1280 bytes} [Sat Oct 22 21:07:44 2022] DELETE /compute/v2.1/servers/7b2e6379-2f50-4138-b7b0-c064eda95b42 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 22 21:07:45.210490 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-bdf66d54-f478-4fb3-abc2-8157f9eb4668 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:07:45.211722 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-bdf66d54-f478-4fb3-abc2-8157f9eb4668 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] [instance: 7b2e6379-2f50-4138-b7b0-c064eda95b42] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:07:45.218435 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bdf66d54-f478-4fb3-abc2-8157f9eb4668 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:45.219274 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bdf66d54-f478-4fb3-abc2-8157f9eb4668 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:45.219965 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bdf66d54-f478-4fb3-abc2-8157f9eb4668 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:45.221188 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bdf66d54-f478-4fb3-abc2-8157f9eb4668 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:45.222008 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bdf66d54-f478-4fb3-abc2-8157f9eb4668 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:45.222613 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bdf66d54-f478-4fb3-abc2-8157f9eb4668 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:45.466250 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-bdf66d54-f478-4fb3-abc2-8157f9eb4668 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebcd750fac45c183f21cf78ca939d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a73c458655e4b1db78801a8316fbdab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:07:45.483968 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-bdf66d54-f478-4fb3-abc2-8157f9eb4668 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdebcd750fac45c183f21cf78ca939d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a73c458655e4b1db78801a8316fbdab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:07:45.492619 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-bdf66d54-f478-4fb3-abc2-8157f9eb4668 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdebcd750fac45c183f21cf78ca939d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a73c458655e4b1db78801a8316fbdab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:07:45.496566 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-bdf66d54-f478-4fb3-abc2-8157f9eb4668 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] 10.222.0.18 "GET /compute/v2.1/servers/7b2e6379-2f50-4138-b7b0-c064eda95b42" status: 200 len: 1363 microversion: 2.47 time: 0.294011 Oct 22 21:07:45.497965 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1934/3862] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:07:45 2022] GET /compute/v2.1/servers/7b2e6379-2f50-4138-b7b0-c064eda95b42 => generated 1363 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:07:45.499679 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-8ea6a778-8b75-4c17-9ace-3141cb7291b2 tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] Action: 'create', calling method: .version_select at 0x7fd39ef9f3a0>, body: {"keypair": {"name": "tempest-keypair-1863563561", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIq1QPVxfHx/0Pv3os4jvYON3IF9oGbfORWlWVWZCQHJWCrD06871RWp7NsS7Dvkk1BXiXB+92h4e9X61az6Ez8VtKaXybCmXhZHLNynBE59N1xHRLRtkswYPi/welQ0GQ=="}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:07:45.536316 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-8ea6a778-8b75-4c17-9ace-3141cb7291b2 tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] Getting quotas for project 0cf63c122a5e4685a891957e1b58b9e4. Resources: {'key_pairs'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 21:07:45.561639 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-8ea6a778-8b75-4c17-9ace-3141cb7291b2 tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] Getting quotas for user 98584920f7f948d6995412c700128be1 and project 0cf63c122a5e4685a891957e1b58b9e4. Resources: {'key_pairs'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 21:07:45.676986 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-8ea6a778-8b75-4c17-9ace-3141cb7291b2 tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.578356 Oct 22 21:07:45.677828 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1929/3863] 10.222.0.18 () {60 vars in 1159 bytes} [Sat Oct 22 21:07:45 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:07:45.691743 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-330c7da4-45cb-46a0-9750-5746601544ec tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:07:45.694226 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-330c7da4-45cb-46a0-9750-5746601544ec tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] [instance: b769064b-9ef9-47b7-9cfd-5d3b8a24a7a1] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:07:45.713001 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-cc1486ab-3c08-4945-9939-85d618aac8e1 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Action: 'create', calling method: .version_select at 0x7fd39fcf0790>, body: {"keypair": {"name": "tempest-keypair-632076854", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKm4MVzhJwPIL3+eV3/jQyeCo11zXkp8t0PmCL+YufSneq3Ak77Dk0WcdUFZVsJXvQJiQ0uwsmzmLtiC0C++J9aqSowOjRQFEXHu/2wIA9pL08bmPvLbP7MLsHwxs+gNiA=="}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:07:45.715563 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-330c7da4-45cb-46a0-9750-5746601544ec tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:45.716272 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-330c7da4-45cb-46a0-9750-5746601544ec tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:45.716894 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-330c7da4-45cb-46a0-9750-5746601544ec tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:45.718498 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-330c7da4-45cb-46a0-9750-5746601544ec tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:45.722014 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-330c7da4-45cb-46a0-9750-5746601544ec tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:45.723998 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-330c7da4-45cb-46a0-9750-5746601544ec tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:45.762240 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-cc1486ab-3c08-4945-9939-85d618aac8e1 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Getting quotas for project f7f28cafad8942518b882192687b8b77. Resources: {'key_pairs'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 21:07:45.788241 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-cc1486ab-3c08-4945-9939-85d618aac8e1 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Getting quotas for user eb24324c9c174645a3e9bc8bb913afe9 and project f7f28cafad8942518b882192687b8b77. Resources: {'key_pairs'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 21:07:45.854270 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-cc1486ab-3c08-4945-9939-85d618aac8e1 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.354054 Oct 22 21:07:45.855640 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1935/3864] 10.222.0.18 () {62 vars in 1200 bytes} [Sat Oct 22 21:07:45 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 356 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 22 21:07:45.874326 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-2138da3a-8b69-410b-8231-cb02fd3b71de tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:07:45.879043 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-2138da3a-8b69-410b-8231-cb02fd3b71de tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] [instance: 1324c851-90ff-47f4-b4e6-8acc8b829c5e] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:07:45.895588 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2138da3a-8b69-410b-8231-cb02fd3b71de tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:45.896747 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2138da3a-8b69-410b-8231-cb02fd3b71de tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:45.897478 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2138da3a-8b69-410b-8231-cb02fd3b71de tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:45.898459 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2138da3a-8b69-410b-8231-cb02fd3b71de tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:45.899389 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2138da3a-8b69-410b-8231-cb02fd3b71de tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:45.900171 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2138da3a-8b69-410b-8231-cb02fd3b71de tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:46.305527 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-330c7da4-45cb-46a0-9750-5746601544ec tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcdfeb6c1cda4810b9fa70fdfd9a66c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c774a85b2c41c98486cf91b1253363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:07:46.323495 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-330c7da4-45cb-46a0-9750-5746601544ec tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] 10.222.0.18 "GET /compute/v2.1/servers/b769064b-9ef9-47b7-9cfd-5d3b8a24a7a1" status: 200 len: 1517 microversion: 2.1 time: 0.641573 Oct 22 21:07:46.324023 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1930/3865] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:07:45 2022] GET /compute/v2.1/servers/b769064b-9ef9-47b7-9cfd-5d3b8a24a7a1 => generated 1517 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:07:46.349400 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-71762d54-849a-4a87-8420-45c97f5fafab tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:07:46.350697 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-71762d54-849a-4a87-8420-45c97f5fafab tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] [instance: ad302c49-addb-464c-a15f-fa01577f90c4] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:07:46.358727 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-71762d54-849a-4a87-8420-45c97f5fafab tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:46.360534 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-71762d54-849a-4a87-8420-45c97f5fafab tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:46.361418 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-71762d54-849a-4a87-8420-45c97f5fafab tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:46.362657 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-71762d54-849a-4a87-8420-45c97f5fafab tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:46.363981 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-71762d54-849a-4a87-8420-45c97f5fafab tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:46.364642 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-71762d54-849a-4a87-8420-45c97f5fafab tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:46.498853 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-2138da3a-8b69-410b-8231-cb02fd3b71de tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3820b31a424c3a9216a6ef91fcb285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a42c3ecf474883ac652fcc8c01c9f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:07:46.517904 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-2138da3a-8b69-410b-8231-cb02fd3b71de tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] 10.222.0.18 "GET /compute/v2.1/servers/1324c851-90ff-47f4-b4e6-8acc8b829c5e" status: 200 len: 1265 microversion: 2.1 time: 0.656909 Oct 22 21:07:46.534038 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1936/3866] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:07:45 2022] GET /compute/v2.1/servers/1324c851-90ff-47f4-b4e6-8acc8b829c5e => generated 1265 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:07:46.547548 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-b3973336-38db-46eb-ac1b-b25cc6d000b8 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:07:46.548898 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-b3973336-38db-46eb-ac1b-b25cc6d000b8 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] [instance: 7b2e6379-2f50-4138-b7b0-c064eda95b42] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:07:46.558722 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b3973336-38db-46eb-ac1b-b25cc6d000b8 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:46.559764 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b3973336-38db-46eb-ac1b-b25cc6d000b8 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:46.560639 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b3973336-38db-46eb-ac1b-b25cc6d000b8 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:46.562113 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b3973336-38db-46eb-ac1b-b25cc6d000b8 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:46.562793 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b3973336-38db-46eb-ac1b-b25cc6d000b8 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:46.563739 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b3973336-38db-46eb-ac1b-b25cc6d000b8 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:46.760394 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-b3973336-38db-46eb-ac1b-b25cc6d000b8 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebcd750fac45c183f21cf78ca939d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a73c458655e4b1db78801a8316fbdab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:07:46.774478 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-b3973336-38db-46eb-ac1b-b25cc6d000b8 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdebcd750fac45c183f21cf78ca939d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a73c458655e4b1db78801a8316fbdab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:07:46.776083 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-b3973336-38db-46eb-ac1b-b25cc6d000b8 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdebcd750fac45c183f21cf78ca939d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a73c458655e4b1db78801a8316fbdab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:07:46.781719 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-b3973336-38db-46eb-ac1b-b25cc6d000b8 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] 10.222.0.18 "GET /compute/v2.1/servers/7b2e6379-2f50-4138-b7b0-c064eda95b42" status: 200 len: 1363 microversion: 2.47 time: 0.236709 Oct 22 21:07:46.782336 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1937/3867] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:07:46 2022] GET /compute/v2.1/servers/7b2e6379-2f50-4138-b7b0-c064eda95b42 => generated 1363 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:07:46.833230 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-71762d54-849a-4a87-8420-45c97f5fafab tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0d0bdfb04240209e4efa92f47cbb94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755501ba3e344f1aaf7ef80924bb57d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:07:46.846109 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-71762d54-849a-4a87-8420-45c97f5fafab tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] 10.222.0.18 "GET /compute/v2.1/servers/ad302c49-addb-464c-a15f-fa01577f90c4" status: 200 len: 1361 microversion: 2.1 time: 0.507564 Oct 22 21:07:46.847584 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1931/3868] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:07:46 2022] GET /compute/v2.1/servers/ad302c49-addb-464c-a15f-fa01577f90c4 => generated 1361 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:07:47.358414 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-e417c130-f1c1-4c95-a6d2-14e8b3246594 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:07:47.360622 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-e417c130-f1c1-4c95-a6d2-14e8b3246594 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] [instance: b769064b-9ef9-47b7-9cfd-5d3b8a24a7a1] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:07:47.413247 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e417c130-f1c1-4c95-a6d2-14e8b3246594 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:47.416229 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e417c130-f1c1-4c95-a6d2-14e8b3246594 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:47.417857 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e417c130-f1c1-4c95-a6d2-14e8b3246594 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:47.421155 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e417c130-f1c1-4c95-a6d2-14e8b3246594 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:47.422478 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e417c130-f1c1-4c95-a6d2-14e8b3246594 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:47.423156 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e417c130-f1c1-4c95-a6d2-14e8b3246594 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:47.547725 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-22d01997-2441-41b7-8a96-3ce3d2bf68ff tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:07:47.549410 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-22d01997-2441-41b7-8a96-3ce3d2bf68ff tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] [instance: 1324c851-90ff-47f4-b4e6-8acc8b829c5e] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:07:47.568052 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-22d01997-2441-41b7-8a96-3ce3d2bf68ff tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:47.574210 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-22d01997-2441-41b7-8a96-3ce3d2bf68ff tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:47.574961 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-22d01997-2441-41b7-8a96-3ce3d2bf68ff tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:47.576647 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-22d01997-2441-41b7-8a96-3ce3d2bf68ff tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:47.577300 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-22d01997-2441-41b7-8a96-3ce3d2bf68ff tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:47.577995 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-22d01997-2441-41b7-8a96-3ce3d2bf68ff tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:48.052503 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-e417c130-f1c1-4c95-a6d2-14e8b3246594 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcdfeb6c1cda4810b9fa70fdfd9a66c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c774a85b2c41c98486cf91b1253363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:07:48.064747 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-e417c130-f1c1-4c95-a6d2-14e8b3246594 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] 10.222.0.18 "GET /compute/v2.1/servers/b769064b-9ef9-47b7-9cfd-5d3b8a24a7a1" status: 200 len: 1523 microversion: 2.1 time: 0.717144 Oct 22 21:07:48.065684 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1938/3869] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:07:47 2022] GET /compute/v2.1/servers/b769064b-9ef9-47b7-9cfd-5d3b8a24a7a1 => generated 1523 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:07:48.085324 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-c84e5be9-8e99-4685-9e75-b3265d8ee5fd tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:07:48.085975 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-c84e5be9-8e99-4685-9e75-b3265d8ee5fd tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] [instance: 7b2e6379-2f50-4138-b7b0-c064eda95b42] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:07:48.093929 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c84e5be9-8e99-4685-9e75-b3265d8ee5fd tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:48.094455 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c84e5be9-8e99-4685-9e75-b3265d8ee5fd tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:48.095102 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c84e5be9-8e99-4685-9e75-b3265d8ee5fd tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:48.096132 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c84e5be9-8e99-4685-9e75-b3265d8ee5fd tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:48.096760 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c84e5be9-8e99-4685-9e75-b3265d8ee5fd tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:48.097373 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c84e5be9-8e99-4685-9e75-b3265d8ee5fd tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:48.193006 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c84e5be9-8e99-4685-9e75-b3265d8ee5fd tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:48.194876 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c84e5be9-8e99-4685-9e75-b3265d8ee5fd tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:48.195531 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c84e5be9-8e99-4685-9e75-b3265d8ee5fd tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:48.196273 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.objects.instance [None req-c84e5be9-8e99-4685-9e75-b3265d8ee5fd tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Lazy-loading 'fault' on Instance uuid 7b2e6379-2f50-4138-b7b0-c064eda95b42 {{(pid=138745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 21:07:48.268165 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-22d01997-2441-41b7-8a96-3ce3d2bf68ff tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3820b31a424c3a9216a6ef91fcb285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a42c3ecf474883ac652fcc8c01c9f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:07:48.279204 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-22d01997-2441-41b7-8a96-3ce3d2bf68ff tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] 10.222.0.18 "GET /compute/v2.1/servers/1324c851-90ff-47f4-b4e6-8acc8b829c5e" status: 200 len: 1265 microversion: 2.1 time: 0.736206 Oct 22 21:07:48.280094 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1932/3870] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:07:47 2022] GET /compute/v2.1/servers/1324c851-90ff-47f4-b4e6-8acc8b829c5e => generated 1265 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:07:48.302705 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-861053e6-7827-4603-b945-adfebe677d09 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:07:48.303693 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-861053e6-7827-4603-b945-adfebe677d09 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] [instance: ad302c49-addb-464c-a15f-fa01577f90c4] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:07:48.310608 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-861053e6-7827-4603-b945-adfebe677d09 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:48.311410 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-861053e6-7827-4603-b945-adfebe677d09 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:48.312025 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-861053e6-7827-4603-b945-adfebe677d09 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:48.312918 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-861053e6-7827-4603-b945-adfebe677d09 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:48.313555 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-861053e6-7827-4603-b945-adfebe677d09 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:48.314489 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-861053e6-7827-4603-b945-adfebe677d09 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:48.399393 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-c84e5be9-8e99-4685-9e75-b3265d8ee5fd tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebcd750fac45c183f21cf78ca939d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a73c458655e4b1db78801a8316fbdab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:07:48.416148 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-c84e5be9-8e99-4685-9e75-b3265d8ee5fd tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdebcd750fac45c183f21cf78ca939d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a73c458655e4b1db78801a8316fbdab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:07:48.417876 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-c84e5be9-8e99-4685-9e75-b3265d8ee5fd tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdebcd750fac45c183f21cf78ca939d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a73c458655e4b1db78801a8316fbdab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:07:48.422391 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-c84e5be9-8e99-4685-9e75-b3265d8ee5fd tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] 10.222.0.18 "GET /compute/v2.1/servers/7b2e6379-2f50-4138-b7b0-c064eda95b42" status: 200 len: 1368 microversion: 2.47 time: 0.355602 Oct 22 21:07:48.436122 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1939/3871] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:07:48 2022] GET /compute/v2.1/servers/7b2e6379-2f50-4138-b7b0-c064eda95b42 => generated 1368 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:07:48.449461 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-53ee5d73-ffc6-4845-b4a8-344b2b36fb20 req-379c8d6a-112c-4b12-a22d-9df43cef0539 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad302c49-addb-464c-a15f-fa01577f90c4", "tag": "f6f36de6-f297-4ad8-a5a7-45c041622a1f"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:07:48.463609 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-53ee5d73-ffc6-4845-b4a8-344b2b36fb20 req-379c8d6a-112c-4b12-a22d-9df43cef0539 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:48.468113 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-53ee5d73-ffc6-4845-b4a8-344b2b36fb20 req-379c8d6a-112c-4b12-a22d-9df43cef0539 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:48.468829 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-53ee5d73-ffc6-4845-b4a8-344b2b36fb20 req-379c8d6a-112c-4b12-a22d-9df43cef0539 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:48.489928 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-53ee5d73-ffc6-4845-b4a8-344b2b36fb20 req-379c8d6a-112c-4b12-a22d-9df43cef0539 service nova] Creating event network-changed:f6f36de6-f297-4ad8-a5a7-45c041622a1f for instance ad302c49-addb-464c-a15f-fa01577f90c4 on nch1-master-1 Oct 22 21:07:48.505217 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-53ee5d73-ffc6-4845-b4a8-344b2b36fb20 req-379c8d6a-112c-4b12-a22d-9df43cef0539 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065243 Oct 22 21:07:48.507506 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1940/3872] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:07:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:07:48.515967 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-23b295e9-f6a6-4e29-a353-4ce15e4d6505 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:07:48.519656 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-23b295e9-f6a6-4e29-a353-4ce15e4d6505 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] [instance: 37978245-38aa-4524-8c69-126c4b180b00] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:07:48.534785 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-23b295e9-f6a6-4e29-a353-4ce15e4d6505 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:48.536464 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-23b295e9-f6a6-4e29-a353-4ce15e4d6505 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:48.537324 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-23b295e9-f6a6-4e29-a353-4ce15e4d6505 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:48.541015 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-23b295e9-f6a6-4e29-a353-4ce15e4d6505 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:48.542001 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-23b295e9-f6a6-4e29-a353-4ce15e4d6505 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:48.542809 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-23b295e9-f6a6-4e29-a353-4ce15e4d6505 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:48.723017 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-861053e6-7827-4603-b945-adfebe677d09 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0d0bdfb04240209e4efa92f47cbb94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755501ba3e344f1aaf7ef80924bb57d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:07:48.739291 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-861053e6-7827-4603-b945-adfebe677d09 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] 10.222.0.18 "GET /compute/v2.1/servers/ad302c49-addb-464c-a15f-fa01577f90c4" status: 200 len: 1361 microversion: 2.1 time: 0.442278 Oct 22 21:07:48.743665 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1933/3873] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:07:48 2022] GET /compute/v2.1/servers/ad302c49-addb-464c-a15f-fa01577f90c4 => generated 1361 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:07:48.745921 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.objects.instance [None req-23b295e9-f6a6-4e29-a353-4ce15e4d6505 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Lazy-loading 'services' on Instance uuid 37978245-38aa-4524-8c69-126c4b180b00 {{(pid=138745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 21:07:48.957274 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-23b295e9-f6a6-4e29-a353-4ce15e4d6505 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] 10.222.0.18 "DELETE /compute/v2.1/servers/37978245-38aa-4524-8c69-126c4b180b00/os-volume_attachments/6d8909c5-5b5d-4a3a-9a9e-3e90bbd551b8" status: 202 len: 0 microversion: 2.1 time: 0.447812 Oct 22 21:07:48.962867 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1941/3874] 10.222.0.18 () {58 vars in 1416 bytes} [Sat Oct 22 21:07:48 2022] DELETE /compute/v2.1/servers/37978245-38aa-4524-8c69-126c4b180b00/os-volume_attachments/6d8909c5-5b5d-4a3a-9a9e-3e90bbd551b8 => generated 0 bytes in 454 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 21:07:49.094547 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-33d4f090-3023-4189-83e9-7c808fdd00ac tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:07:49.095262 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-33d4f090-3023-4189-83e9-7c808fdd00ac tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] [instance: b769064b-9ef9-47b7-9cfd-5d3b8a24a7a1] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:07:49.112640 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell0:SELECT=2 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:07:49.114826 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-33d4f090-3023-4189-83e9-7c808fdd00ac tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:49.115566 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-33d4f090-3023-4189-83e9-7c808fdd00ac tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:49.124426 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-33d4f090-3023-4189-83e9-7c808fdd00ac tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:49.124917 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-33d4f090-3023-4189-83e9-7c808fdd00ac tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:49.125509 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-33d4f090-3023-4189-83e9-7c808fdd00ac tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:49.125836 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-33d4f090-3023-4189-83e9-7c808fdd00ac tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:49.306943 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-7a1164c6-f008-4961-af6f-e6da23533ff5 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:07:49.308296 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-7a1164c6-f008-4961-af6f-e6da23533ff5 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] [instance: 1324c851-90ff-47f4-b4e6-8acc8b829c5e] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:07:49.325587 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7a1164c6-f008-4961-af6f-e6da23533ff5 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:49.326348 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7a1164c6-f008-4961-af6f-e6da23533ff5 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:49.326968 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7a1164c6-f008-4961-af6f-e6da23533ff5 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:49.327926 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7a1164c6-f008-4961-af6f-e6da23533ff5 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:49.328578 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7a1164c6-f008-4961-af6f-e6da23533ff5 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:49.329192 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7a1164c6-f008-4961-af6f-e6da23533ff5 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:50.109346 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-7a1164c6-f008-4961-af6f-e6da23533ff5 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3820b31a424c3a9216a6ef91fcb285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a42c3ecf474883ac652fcc8c01c9f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:07:50.125070 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-7a1164c6-f008-4961-af6f-e6da23533ff5 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] 10.222.0.18 "GET /compute/v2.1/servers/1324c851-90ff-47f4-b4e6-8acc8b829c5e" status: 200 len: 1265 microversion: 2.1 time: 0.820936 Oct 22 21:07:50.140667 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1942/3875] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:07:49 2022] GET /compute/v2.1/servers/1324c851-90ff-47f4-b4e6-8acc8b829c5e => generated 1265 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:07:50.140667 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-693cd2f4-5050-40cb-a7ef-271215258231 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:07:50.140667 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-693cd2f4-5050-40cb-a7ef-271215258231 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] [instance: 7b2e6379-2f50-4138-b7b0-c064eda95b42] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:07:50.147683 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-33d4f090-3023-4189-83e9-7c808fdd00ac tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcdfeb6c1cda4810b9fa70fdfd9a66c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c774a85b2c41c98486cf91b1253363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:07:50.159884 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:07:50.165171 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-33d4f090-3023-4189-83e9-7c808fdd00ac tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] 10.222.0.18 "GET /compute/v2.1/servers/b769064b-9ef9-47b7-9cfd-5d3b8a24a7a1" status: 200 len: 1523 microversion: 2.1 time: 1.076973 Oct 22 21:07:50.168928 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1934/3876] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:07:49 2022] GET /compute/v2.1/servers/b769064b-9ef9-47b7-9cfd-5d3b8a24a7a1 => generated 1523 bytes in 1081 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:07:50.175766 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-dc9601a5-bb7d-40b2-a635-3da5adb96684 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:07:50.176640 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-dc9601a5-bb7d-40b2-a635-3da5adb96684 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] [instance: ad302c49-addb-464c-a15f-fa01577f90c4] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:07:50.184192 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-dc9601a5-bb7d-40b2-a635-3da5adb96684 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:50.186107 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-dc9601a5-bb7d-40b2-a635-3da5adb96684 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:50.188103 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-dc9601a5-bb7d-40b2-a635-3da5adb96684 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:50.189180 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-dc9601a5-bb7d-40b2-a635-3da5adb96684 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:50.193939 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-dc9601a5-bb7d-40b2-a635-3da5adb96684 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:50.194681 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-dc9601a5-bb7d-40b2-a635-3da5adb96684 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:50.197929 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-693cd2f4-5050-40cb-a7ef-271215258231 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:50.198510 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-693cd2f4-5050-40cb-a7ef-271215258231 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:50.198947 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-693cd2f4-5050-40cb-a7ef-271215258231 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:50.204234 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-693cd2f4-5050-40cb-a7ef-271215258231 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:50.207244 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-693cd2f4-5050-40cb-a7ef-271215258231 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:50.209139 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-693cd2f4-5050-40cb-a7ef-271215258231 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:50.245941 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.wsgi [None req-693cd2f4-5050-40cb-a7ef-271215258231 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] HTTP exception thrown: Instance 7b2e6379-2f50-4138-b7b0-c064eda95b42 could not be found. Oct 22 21:07:50.249515 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-693cd2f4-5050-40cb-a7ef-271215258231 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Request method failure captured: Oct 22 21:07:50.249515 ncdv-master-1 devstack@n-api.service[138745]: request: GET /compute/v2.1/servers/7b2e6379-2f50-4138-b7b0-c064eda95b42 HTTP/1.1 Oct 22 21:07:50.249515 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 21:07:50.249515 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 21:07:50.249515 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 21:07:50.249515 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 0 Oct 22 21:07:50.249515 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 21:07:50.249515 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 21:07:50.249515 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 21:07:50.249515 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 21:07:50.249515 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVFtoT5QBMNC7xI4NN0wGPLrlbrvdThS2TovRHTxdl4Z_aqmzmR0PhhuElJEBQt5Hc5_glSwb8dm54-KpLANEqfwXUCFEf_bZBUPsumBhqpJvUM3ZU0LXQo1fCcLKKQ7Sbqh7loYrFMyBuZaehE1uLwm4Ibo6o7dfdNxZJ2CXT5Zuycc Oct 22 21:07:50.249515 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 21:07:50.249515 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 21:07:50.249515 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 21:07:50.249515 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 21:07:50.249515 ncdv-master-1 devstack@n-api.service[138745]: X-Openstack-Nova-Api-Version: 2.47 Oct 22 21:07:50.249515 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 21:07:50.249515 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 21:07:50.249515 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: 2a73c458655e4b1db78801a8316fbdab Oct 22 21:07:50.249515 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-ServerShowV247Test-488912206 Oct 22 21:07:50.249515 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 21:07:50.249515 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 21:07:50.249515 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_2a73c458655e4b1db78801a8316fbdab"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2a73c458655e4b1db78801a8316fbdab"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/2a73c458655e4b1db78801a8316fbdab"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2a73c458655e4b1db78801a8316fbdab"}]}] Oct 22 21:07:50.249515 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-ServerShowV247Test-488912206 Oct 22 21:07:50.249515 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: 2a73c458655e4b1db78801a8316fbdab Oct 22 21:07:50.249515 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-ServerShowV247Test-488912206 Oct 22 21:07:50.249515 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-ServerShowV247Test-488912206-project Oct 22 21:07:50.249515 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 21:07:50.249515 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 21:07:50.249515 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: cdebcd750fac45c183f21cf78ca939d9 Oct 22 21:07:50.249515 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-ServerShowV247Test-488912206-project Oct 22 21:07:50.249515 ncdv-master-1 devstack@n-api.service[138745]: method: > Oct 22 21:07:50.249515 ncdv-master-1 devstack@n-api.service[138745]: exception: Instance 7b2e6379-2f50-4138-b7b0-c064eda95b42 could not be found. Oct 22 21:07:50.249515 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'id': '7b2e6379-2f50-4138-b7b0-c064eda95b42'} Oct 22 21:07:50.249515 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:07:50.249515 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:07:50.249515 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 21:07:50.249515 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 21:07:50.249515 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 21:07:50.249515 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 21:07:50.249515 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 21:07:50.249515 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 21:07:50.249515 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 21:07:50.249515 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 21:07:50.249515 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b2e6379-2f50-4138-b7b0-c064eda95b42 could not be found. Oct 22 21:07:50.249515 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:07:50.249515 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:07:50.249515 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:07:50.249515 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:07:50.249515 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:07:50.249515 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:07:50.249515 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:07:50.249515 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:07:50.249515 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:07:50.249515 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:07:50.249515 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 21:07:50.249515 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 21:07:50.249515 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 21:07:50.249515 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 21:07:50.249515 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 21:07:50.249515 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:07:50.249515 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b2e6379-2f50-4138-b7b0-c064eda95b42 could not be found. Oct 22 21:07:50.249515 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:07:50.249515 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:07:50.249515 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:07:50.257360 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:07:50.257360 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:07:50.257360 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:07:50.257360 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:07:50.257360 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:07:50.257360 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b2e6379-2f50-4138-b7b0-c064eda95b42 could not be found. Oct 22 21:07:50.257360 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:07:50.261308 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-693cd2f4-5050-40cb-a7ef-271215258231 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] Returning 404 to user: Instance 7b2e6379-2f50-4138-b7b0-c064eda95b42 could not be found. {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:07:50.262255 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-693cd2f4-5050-40cb-a7ef-271215258231 tempest-ServerShowV247Test-488912206 tempest-ServerShowV247Test-488912206-project] 10.222.0.18 "GET /compute/v2.1/servers/7b2e6379-2f50-4138-b7b0-c064eda95b42" status: 404 len: 111 microversion: 2.47 time: 0.133250 Oct 22 21:07:50.265981 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1943/3877] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:07:50 2022] GET /compute/v2.1/servers/7b2e6379-2f50-4138-b7b0-c064eda95b42 => generated 111 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 22 21:07:50.278892 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-7d478b67-8c9c-44f6-839f-0532e5eafa26 tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestManualDisk-server-1422309602", "imageRef": "085e4478-6edc-4a69-8e08-f9831713eb65", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "d467190b-3da3-4cb5-bda7-1d220c06622c"}], "security_groups": [{"name": "tempest-securitygroup--1168319408"}], "key_name": "tempest-keypair-1863563561", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:07:50.597632 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.network.neutron [None req-7d478b67-8c9c-44f6-839f-0532e5eafa26 tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] validate_networks() for [('d467190b-3da3-4cb5-bda7-1d220c06622c', None, None, None, None, None)] {{(pid=138745) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 21:07:50.616070 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-dc9601a5-bb7d-40b2-a635-3da5adb96684 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0d0bdfb04240209e4efa92f47cbb94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755501ba3e344f1aaf7ef80924bb57d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:07:50.626572 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-dc9601a5-bb7d-40b2-a635-3da5adb96684 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] 10.222.0.18 "GET /compute/v2.1/servers/ad302c49-addb-464c-a15f-fa01577f90c4" status: 200 len: 1361 microversion: 2.1 time: 0.456200 Oct 22 21:07:50.628428 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1935/3878] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:07:50 2022] GET /compute/v2.1/servers/ad302c49-addb-464c-a15f-fa01577f90c4 => generated 1361 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:07:50.637637 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-b54274be-f426-4c37-916d-16e9098f14cf tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:07:50.640606 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-b54274be-f426-4c37-916d-16e9098f14cf tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] [instance: 37978245-38aa-4524-8c69-126c4b180b00] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:07:50.659143 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b54274be-f426-4c37-916d-16e9098f14cf tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:50.660111 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b54274be-f426-4c37-916d-16e9098f14cf tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:50.660926 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b54274be-f426-4c37-916d-16e9098f14cf tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:50.662252 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b54274be-f426-4c37-916d-16e9098f14cf tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:50.662749 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b54274be-f426-4c37-916d-16e9098f14cf tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:50.663204 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b54274be-f426-4c37-916d-16e9098f14cf tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:50.721266 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-b54274be-f426-4c37-916d-16e9098f14cf tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] [instance: 37978245-38aa-4524-8c69-126c4b180b00] Going to try to terminate instance {{(pid=138744) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 21:07:50.915056 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-b54274be-f426-4c37-916d-16e9098f14cf tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] 10.222.0.18 "DELETE /compute/v2.1/servers/37978245-38aa-4524-8c69-126c4b180b00" status: 204 len: 0 microversion: 2.1 time: 0.284762 Oct 22 21:07:50.918446 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1936/3879] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 21:07:50 2022] DELETE /compute/v2.1/servers/37978245-38aa-4524-8c69-126c4b180b00 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 21:07:50.933244 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-79feedf6-a413-49e2-9289-c69af0276933 req-a5428eaa-5a4f-43c3-b431-e726d34caded service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b769064b-9ef9-47b7-9cfd-5d3b8a24a7a1", "name": "network-vif-plugged", "status": "completed", "tag": "ebfc42ff-9ece-4ea7-acbe-047586917889"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:07:50.949287 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-79feedf6-a413-49e2-9289-c69af0276933 req-a5428eaa-5a4f-43c3-b431-e726d34caded service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:50.950826 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-79feedf6-a413-49e2-9289-c69af0276933 req-a5428eaa-5a4f-43c3-b431-e726d34caded service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:50.951642 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-79feedf6-a413-49e2-9289-c69af0276933 req-a5428eaa-5a4f-43c3-b431-e726d34caded service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:50.977042 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-79feedf6-a413-49e2-9289-c69af0276933 req-a5428eaa-5a4f-43c3-b431-e726d34caded service nova] Creating event network-vif-plugged:ebfc42ff-9ece-4ea7-acbe-047586917889 for instance b769064b-9ef9-47b7-9cfd-5d3b8a24a7a1 on nch2-master-1 Oct 22 21:07:50.985307 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-79feedf6-a413-49e2-9289-c69af0276933 req-a5428eaa-5a4f-43c3-b431-e726d34caded service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064775 Oct 22 21:07:50.988794 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1937/3880] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:07:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:07:51.009441 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-7ce09042-a419-4a23-9a55-aaa7f928183d tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:07:51.010323 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-7ce09042-a419-4a23-9a55-aaa7f928183d tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] [instance: 37978245-38aa-4524-8c69-126c4b180b00] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:07:51.021117 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7ce09042-a419-4a23-9a55-aaa7f928183d tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:51.021726 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7ce09042-a419-4a23-9a55-aaa7f928183d tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:51.022269 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7ce09042-a419-4a23-9a55-aaa7f928183d tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:51.024856 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7ce09042-a419-4a23-9a55-aaa7f928183d tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:51.025558 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7ce09042-a419-4a23-9a55-aaa7f928183d tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:51.026004 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7ce09042-a419-4a23-9a55-aaa7f928183d tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:51.317460 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell0:SELECT=2 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:07:51.484260 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-7ce09042-a419-4a23-9a55-aaa7f928183d tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7102f7b674934e19b3d4a001b563d0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21349e14fb39496c9996d5af817b7f73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:07:51.493293 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-7ce09042-a419-4a23-9a55-aaa7f928183d tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] 10.222.0.18 "GET /compute/v2.1/servers/37978245-38aa-4524-8c69-126c4b180b00" status: 200 len: 1513 microversion: 2.1 time: 0.500050 Oct 22 21:07:51.499589 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1938/3881] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:07:50 2022] GET /compute/v2.1/servers/37978245-38aa-4524-8c69-126c4b180b00 => generated 1513 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:07:51.506497 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-e6fa0a98-21c0-425b-8cc6-f6d597327741 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-982596763", "imageRef": "085e4478-6edc-4a69-8e08-f9831713eb65", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b0b78097-ffa0-4066-b6da-bef483f12519"}], "security_groups": [{"name": "tempest-securitygroup--1748477324"}], "key_name": "tempest-keypair-632076854", "user_data": "}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:07:51.561606 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-7d478b67-8c9c-44f6-839f-0532e5eafa26 tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] Getting quotas for project 0cf63c122a5e4685a891957e1b58b9e4. Resources: dict_keys(['metadata_items']) {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 21:07:51.568471 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-7d478b67-8c9c-44f6-839f-0532e5eafa26 tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] Getting quotas for user 98584920f7f948d6995412c700128be1 and project 0cf63c122a5e4685a891957e1b58b9e4. Resources: dict_keys(['metadata_items']) {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 21:07:51.588994 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-7d478b67-8c9c-44f6-839f-0532e5eafa26 tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] Flavor limits 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 21:07:51.589552 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-7d478b67-8c9c-44f6-839f-0532e5eafa26 tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] Image limits 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 21:07:51.590142 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-7d478b67-8c9c-44f6-839f-0532e5eafa26 tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] Flavor pref 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 21:07:51.590647 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-7d478b67-8c9c-44f6-839f-0532e5eafa26 tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] Image pref 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 21:07:51.591154 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-7d478b67-8c9c-44f6-839f-0532e5eafa26 tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 21:07:51.602375 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7d478b67-8c9c-44f6-839f-0532e5eafa26 tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:51.603041 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7d478b67-8c9c-44f6-839f-0532e5eafa26 tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:51.603321 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7d478b67-8c9c-44f6-839f-0532e5eafa26 tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:51.604134 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7d478b67-8c9c-44f6-839f-0532e5eafa26 tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:51.604632 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7d478b67-8c9c-44f6-839f-0532e5eafa26 tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:51.605399 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7d478b67-8c9c-44f6-839f-0532e5eafa26 tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:51.642148 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-7d478b67-8c9c-44f6-839f-0532e5eafa26 tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] Getting quotas for project 0cf63c122a5e4685a891957e1b58b9e4. Resources: {'cores', 'instances', 'ram'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 21:07:51.653197 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-7d478b67-8c9c-44f6-839f-0532e5eafa26 tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] Getting quotas for user 98584920f7f948d6995412c700128be1 and project 0cf63c122a5e4685a891957e1b58b9e4. Resources: {'cores', 'instances', 'ram'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 21:07:51.659793 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.network.neutron [None req-e6fa0a98-21c0-425b-8cc6-f6d597327741 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] validate_networks() for [('b0b78097-ffa0-4066-b6da-bef483f12519', None, None, None, None, None)] {{(pid=138744) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 21:07:51.667744 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-7d478b67-8c9c-44f6-839f-0532e5eafa26 tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] Going to run 1 instances... {{(pid=138745) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 21:07:51.670286 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-7d478b67-8c9c-44f6-839f-0532e5eafa26 tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] [instance: e1523193-327c-4659-8fc4-7329cbffd32f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='085e4478-6edc-4a69-8e08-f9831713eb65',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138745) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 21:07:51.726215 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-7d478b67-8c9c-44f6-839f-0532e5eafa26 tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.451693 Oct 22 21:07:51.727681 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1944/3882] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Oct 22 21:07:50 2022] POST /compute/v2.1/servers => generated 409 bytes in 1454 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 21:07:51.739099 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-47959ed3-f50a-441a-9168-2a45fba50a15 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:07:51.740405 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-47959ed3-f50a-441a-9168-2a45fba50a15 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] [instance: 1324c851-90ff-47f4-b4e6-8acc8b829c5e] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:07:51.747503 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-47959ed3-f50a-441a-9168-2a45fba50a15 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:51.748322 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-47959ed3-f50a-441a-9168-2a45fba50a15 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:51.748961 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-47959ed3-f50a-441a-9168-2a45fba50a15 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:51.750275 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-47959ed3-f50a-441a-9168-2a45fba50a15 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:51.751014 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-47959ed3-f50a-441a-9168-2a45fba50a15 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:51.751711 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-47959ed3-f50a-441a-9168-2a45fba50a15 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:52.085018 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-47959ed3-f50a-441a-9168-2a45fba50a15 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3820b31a424c3a9216a6ef91fcb285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a42c3ecf474883ac652fcc8c01c9f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:07:52.102394 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-47959ed3-f50a-441a-9168-2a45fba50a15 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] 10.222.0.18 "GET /compute/v2.1/servers/1324c851-90ff-47f4-b4e6-8acc8b829c5e" status: 200 len: 1265 microversion: 2.1 time: 0.373286 Oct 22 21:07:52.125315 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1945/3883] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:07:51 2022] GET /compute/v2.1/servers/1324c851-90ff-47f4-b4e6-8acc8b829c5e => generated 1265 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:07:52.134538 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-ea1936c8-2a2b-48a8-a4d1-f8f37812c249 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:07:52.135372 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-ea1936c8-2a2b-48a8-a4d1-f8f37812c249 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] [instance: b769064b-9ef9-47b7-9cfd-5d3b8a24a7a1] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:07:52.138503 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:07:52.151923 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ea1936c8-2a2b-48a8-a4d1-f8f37812c249 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:52.153399 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ea1936c8-2a2b-48a8-a4d1-f8f37812c249 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:52.154039 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ea1936c8-2a2b-48a8-a4d1-f8f37812c249 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:52.154822 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ea1936c8-2a2b-48a8-a4d1-f8f37812c249 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:52.155332 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ea1936c8-2a2b-48a8-a4d1-f8f37812c249 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:52.155823 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ea1936c8-2a2b-48a8-a4d1-f8f37812c249 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:52.309197 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-e6fa0a98-21c0-425b-8cc6-f6d597327741 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Flavor limits 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 21:07:52.309621 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-e6fa0a98-21c0-425b-8cc6-f6d597327741 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Image limits 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 21:07:52.310270 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-e6fa0a98-21c0-425b-8cc6-f6d597327741 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Flavor pref 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 21:07:52.310862 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-e6fa0a98-21c0-425b-8cc6-f6d597327741 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Image pref 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 21:07:52.311458 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-e6fa0a98-21c0-425b-8cc6-f6d597327741 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 21:07:52.322341 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e6fa0a98-21c0-425b-8cc6-f6d597327741 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:52.323814 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e6fa0a98-21c0-425b-8cc6-f6d597327741 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:52.324548 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e6fa0a98-21c0-425b-8cc6-f6d597327741 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:52.325539 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e6fa0a98-21c0-425b-8cc6-f6d597327741 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:52.326258 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e6fa0a98-21c0-425b-8cc6-f6d597327741 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:52.327003 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e6fa0a98-21c0-425b-8cc6-f6d597327741 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:52.403688 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-e6fa0a98-21c0-425b-8cc6-f6d597327741 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Getting quotas for project f7f28cafad8942518b882192687b8b77. Resources: {'cores', 'instances', 'ram'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 21:07:52.418882 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-e6fa0a98-21c0-425b-8cc6-f6d597327741 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Getting quotas for user eb24324c9c174645a3e9bc8bb913afe9 and project f7f28cafad8942518b882192687b8b77. Resources: {'cores', 'instances', 'ram'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 21:07:52.477164 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-e6fa0a98-21c0-425b-8cc6-f6d597327741 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Going to run 1 instances... {{(pid=138744) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 21:07:52.482183 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-e6fa0a98-21c0-425b-8cc6-f6d597327741 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] [instance: cc7f1980-ecea-437f-ac71-0cdb6ec626b9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='085e4478-6edc-4a69-8e08-f9831713eb65',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138744) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 21:07:52.500120 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-ea1936c8-2a2b-48a8-a4d1-f8f37812c249 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcdfeb6c1cda4810b9fa70fdfd9a66c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c774a85b2c41c98486cf91b1253363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:07:52.545658 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-ea1936c8-2a2b-48a8-a4d1-f8f37812c249 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] 10.222.0.18 "GET /compute/v2.1/servers/b769064b-9ef9-47b7-9cfd-5d3b8a24a7a1" status: 200 len: 1523 microversion: 2.1 time: 0.418073 Oct 22 21:07:52.549385 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1946/3884] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:07:52 2022] GET /compute/v2.1/servers/b769064b-9ef9-47b7-9cfd-5d3b8a24a7a1 => generated 1523 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:07:52.610314 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-45f1a096-9828-4258-9eae-e7c967ea764a tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:07:52.612466 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-45f1a096-9828-4258-9eae-e7c967ea764a tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] [instance: ad302c49-addb-464c-a15f-fa01577f90c4] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:07:52.639248 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-e6fa0a98-21c0-425b-8cc6-f6d597327741 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.143769 Oct 22 21:07:52.640889 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1939/3885] 10.222.0.18 () {62 vars in 1188 bytes} [Sat Oct 22 21:07:51 2022] POST /compute/v2.1/servers => generated 402 bytes in 1146 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 22 21:07:52.658998 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-13522baf-ba1e-4588-a577-e4231ba9b28f tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:07:52.660952 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-45f1a096-9828-4258-9eae-e7c967ea764a tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:52.661136 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-13522baf-ba1e-4588-a577-e4231ba9b28f tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] [instance: e1523193-327c-4659-8fc4-7329cbffd32f] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:07:52.663103 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-45f1a096-9828-4258-9eae-e7c967ea764a tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:52.665084 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-45f1a096-9828-4258-9eae-e7c967ea764a tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:52.666294 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-45f1a096-9828-4258-9eae-e7c967ea764a tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:52.674452 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-13522baf-ba1e-4588-a577-e4231ba9b28f tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:52.676492 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-13522baf-ba1e-4588-a577-e4231ba9b28f tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:52.677109 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-13522baf-ba1e-4588-a577-e4231ba9b28f tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:52.679143 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-13522baf-ba1e-4588-a577-e4231ba9b28f tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:52.680103 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-13522baf-ba1e-4588-a577-e4231ba9b28f tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:52.680826 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-13522baf-ba1e-4588-a577-e4231ba9b28f tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:52.691984 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-45f1a096-9828-4258-9eae-e7c967ea764a tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:52.692639 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-45f1a096-9828-4258-9eae-e7c967ea764a tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:52.924232 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-13522baf-ba1e-4588-a577-e4231ba9b28f tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98584920f7f948d6995412c700128be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf63c122a5e4685a891957e1b58b9e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:07:52.943208 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-13522baf-ba1e-4588-a577-e4231ba9b28f tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] 10.222.0.18 "GET /compute/v2.1/servers/e1523193-327c-4659-8fc4-7329cbffd32f" status: 200 len: 1274 microversion: 2.1 time: 0.291450 Oct 22 21:07:52.959392 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1940/3886] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:07:52 2022] GET /compute/v2.1/servers/e1523193-327c-4659-8fc4-7329cbffd32f => generated 1274 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:07:52.972388 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-8013fd9f-a148-4f25-8591-e244b57f8e56 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:07:52.974103 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-8013fd9f-a148-4f25-8591-e244b57f8e56 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] [instance: 37978245-38aa-4524-8c69-126c4b180b00] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:07:53.000189 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8013fd9f-a148-4f25-8591-e244b57f8e56 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:53.000857 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8013fd9f-a148-4f25-8591-e244b57f8e56 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:53.002125 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8013fd9f-a148-4f25-8591-e244b57f8e56 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:53.003236 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8013fd9f-a148-4f25-8591-e244b57f8e56 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:53.004018 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8013fd9f-a148-4f25-8591-e244b57f8e56 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:53.004675 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8013fd9f-a148-4f25-8591-e244b57f8e56 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:53.311001 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-45f1a096-9828-4258-9eae-e7c967ea764a tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0d0bdfb04240209e4efa92f47cbb94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755501ba3e344f1aaf7ef80924bb57d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:07:53.323478 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-45f1a096-9828-4258-9eae-e7c967ea764a tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] 10.222.0.18 "GET /compute/v2.1/servers/ad302c49-addb-464c-a15f-fa01577f90c4" status: 200 len: 1361 microversion: 2.1 time: 0.770625 Oct 22 21:07:53.327043 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1947/3887] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:07:52 2022] GET /compute/v2.1/servers/ad302c49-addb-464c-a15f-fa01577f90c4 => generated 1361 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:07:53.336825 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-c6c89c4a-ee5e-43c5-8bbe-1657a32acd35 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:07:53.337476 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-c6c89c4a-ee5e-43c5-8bbe-1657a32acd35 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] [instance: cc7f1980-ecea-437f-ac71-0cdb6ec626b9] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:07:53.445615 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-8013fd9f-a148-4f25-8591-e244b57f8e56 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7102f7b674934e19b3d4a001b563d0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21349e14fb39496c9996d5af817b7f73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:07:53.457014 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-8013fd9f-a148-4f25-8591-e244b57f8e56 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] 10.222.0.18 "GET /compute/v2.1/servers/37978245-38aa-4524-8c69-126c4b180b00" status: 200 len: 1513 microversion: 2.1 time: 0.506711 Oct 22 21:07:53.460083 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1941/3888] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:07:52 2022] GET /compute/v2.1/servers/37978245-38aa-4524-8c69-126c4b180b00 => generated 1513 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:07:53.469162 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-c6c89c4a-ee5e-43c5-8bbe-1657a32acd35 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:07:53.477985 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-c6c89c4a-ee5e-43c5-8bbe-1657a32acd35 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:07:53.480182 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-391da2c1-30ba-4df9-a05a-4178a99988f9 req-a06d6c7f-39d6-4f52-b006-0923a156ca72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1324c851-90ff-47f4-b4e6-8acc8b829c5e", "name": "network-vif-plugged", "status": "completed", "tag": "1113aabe-4c05-4eae-bc2b-f7bdc1f1d7ce"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:07:53.489307 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-c6c89c4a-ee5e-43c5-8bbe-1657a32acd35 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:07:53.490990 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-c6c89c4a-ee5e-43c5-8bbe-1657a32acd35 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] 10.222.0.18 "GET /compute/v2.1/servers/cc7f1980-ecea-437f-ac71-0cdb6ec626b9" status: 200 len: 1280 microversion: 2.20 time: 0.162190 Oct 22 21:07:53.491087 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1948/3889] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:07:53 2022] GET /compute/v2.1/servers/cc7f1980-ecea-437f-ac71-0cdb6ec626b9 => generated 1280 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:07:53.518503 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-135b109f-fbf4-4511-9068-0305c5e743ee tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:07:53.519223 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-135b109f-fbf4-4511-9068-0305c5e743ee tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] [instance: 1324c851-90ff-47f4-b4e6-8acc8b829c5e] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:07:53.535609 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-391da2c1-30ba-4df9-a05a-4178a99988f9 req-a06d6c7f-39d6-4f52-b006-0923a156ca72 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:53.536109 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-391da2c1-30ba-4df9-a05a-4178a99988f9 req-a06d6c7f-39d6-4f52-b006-0923a156ca72 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:53.536559 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-391da2c1-30ba-4df9-a05a-4178a99988f9 req-a06d6c7f-39d6-4f52-b006-0923a156ca72 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:53.552995 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-135b109f-fbf4-4511-9068-0305c5e743ee tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:53.553516 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-135b109f-fbf4-4511-9068-0305c5e743ee tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:53.554086 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-135b109f-fbf4-4511-9068-0305c5e743ee tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:53.554699 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-135b109f-fbf4-4511-9068-0305c5e743ee tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:53.555173 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-135b109f-fbf4-4511-9068-0305c5e743ee tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:53.555649 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-135b109f-fbf4-4511-9068-0305c5e743ee tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:53.577921 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-391da2c1-30ba-4df9-a05a-4178a99988f9 req-a06d6c7f-39d6-4f52-b006-0923a156ca72 service nova] Creating event network-vif-plugged:1113aabe-4c05-4eae-bc2b-f7bdc1f1d7ce for instance 1324c851-90ff-47f4-b4e6-8acc8b829c5e on nch2-master-1 Oct 22 21:07:53.591210 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-391da2c1-30ba-4df9-a05a-4178a99988f9 req-a06d6c7f-39d6-4f52-b006-0923a156ca72 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129676 Oct 22 21:07:53.594756 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1942/3890] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:07:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:07:53.604708 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-b2d3b142-a643-4de3-baec-9128e70783b4 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:07:53.609601 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-b2d3b142-a643-4de3-baec-9128e70783b4 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] [instance: b769064b-9ef9-47b7-9cfd-5d3b8a24a7a1] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:07:53.625424 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b2d3b142-a643-4de3-baec-9128e70783b4 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:53.627169 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b2d3b142-a643-4de3-baec-9128e70783b4 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:53.632016 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b2d3b142-a643-4de3-baec-9128e70783b4 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:53.633085 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b2d3b142-a643-4de3-baec-9128e70783b4 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:53.633785 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b2d3b142-a643-4de3-baec-9128e70783b4 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:53.634471 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b2d3b142-a643-4de3-baec-9128e70783b4 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:54.115472 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-b2d3b142-a643-4de3-baec-9128e70783b4 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcdfeb6c1cda4810b9fa70fdfd9a66c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c774a85b2c41c98486cf91b1253363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:07:54.135067 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-b2d3b142-a643-4de3-baec-9128e70783b4 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] 10.222.0.18 "GET /compute/v2.1/servers/b769064b-9ef9-47b7-9cfd-5d3b8a24a7a1" status: 200 len: 1523 microversion: 2.1 time: 0.538630 Oct 22 21:07:54.162916 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1943/3891] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:07:53 2022] GET /compute/v2.1/servers/b769064b-9ef9-47b7-9cfd-5d3b8a24a7a1 => generated 1523 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:07:54.174753 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-3f1199bc-4b41-4af6-a813-51f05c1a648f tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:07:54.177567 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-3f1199bc-4b41-4af6-a813-51f05c1a648f tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] [instance: e1523193-327c-4659-8fc4-7329cbffd32f] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:07:54.185070 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:INSERT=4 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:07:54.205512 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3f1199bc-4b41-4af6-a813-51f05c1a648f tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:54.211855 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3f1199bc-4b41-4af6-a813-51f05c1a648f tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:54.213183 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3f1199bc-4b41-4af6-a813-51f05c1a648f tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:54.219791 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3f1199bc-4b41-4af6-a813-51f05c1a648f tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:54.221823 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3f1199bc-4b41-4af6-a813-51f05c1a648f tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:54.226113 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3f1199bc-4b41-4af6-a813-51f05c1a648f tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:54.264594 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-135b109f-fbf4-4511-9068-0305c5e743ee tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3820b31a424c3a9216a6ef91fcb285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a42c3ecf474883ac652fcc8c01c9f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:07:54.279714 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-135b109f-fbf4-4511-9068-0305c5e743ee tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] 10.222.0.18 "GET /compute/v2.1/servers/1324c851-90ff-47f4-b4e6-8acc8b829c5e" status: 200 len: 1265 microversion: 2.1 time: 0.765219 Oct 22 21:07:54.280315 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1949/3892] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:07:53 2022] GET /compute/v2.1/servers/1324c851-90ff-47f4-b4e6-8acc8b829c5e => generated 1265 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:07:54.349290 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-050ed456-b26e-4423-963d-54d3c0073b75 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:07:54.350638 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-050ed456-b26e-4423-963d-54d3c0073b75 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] [instance: ad302c49-addb-464c-a15f-fa01577f90c4] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:07:54.360822 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-050ed456-b26e-4423-963d-54d3c0073b75 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:54.362681 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-050ed456-b26e-4423-963d-54d3c0073b75 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:54.363275 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-050ed456-b26e-4423-963d-54d3c0073b75 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:54.364290 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-050ed456-b26e-4423-963d-54d3c0073b75 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:54.364844 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-050ed456-b26e-4423-963d-54d3c0073b75 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:54.365366 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-050ed456-b26e-4423-963d-54d3c0073b75 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:54.410922 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-3f1199bc-4b41-4af6-a813-51f05c1a648f tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98584920f7f948d6995412c700128be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf63c122a5e4685a891957e1b58b9e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:07:54.422719 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-3f1199bc-4b41-4af6-a813-51f05c1a648f tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] 10.222.0.18 "GET /compute/v2.1/servers/e1523193-327c-4659-8fc4-7329cbffd32f" status: 200 len: 1336 microversion: 2.1 time: 0.257542 Oct 22 21:07:54.432637 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1944/3893] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:07:54 2022] GET /compute/v2.1/servers/e1523193-327c-4659-8fc4-7329cbffd32f => generated 1336 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:07:54.621139 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-7f47a7a7-67ea-43f7-90e8-b6d95aa6b613 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV254Test-server-1261348795", "imageRef": "085e4478-6edc-4a69-8e08-f9831713eb65", "flavorRef": "452", "networks": "none"}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:07:54.724552 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-7f47a7a7-67ea-43f7-90e8-b6d95aa6b613 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Flavor limits 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 21:07:54.725815 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-7f47a7a7-67ea-43f7-90e8-b6d95aa6b613 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Image limits 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 21:07:54.726586 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-7f47a7a7-67ea-43f7-90e8-b6d95aa6b613 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Flavor pref 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 21:07:54.728072 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-7f47a7a7-67ea-43f7-90e8-b6d95aa6b613 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Image pref 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 21:07:54.729966 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-7f47a7a7-67ea-43f7-90e8-b6d95aa6b613 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 21:07:54.741502 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell0:SELECT=19 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:07:54.745255 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7f47a7a7-67ea-43f7-90e8-b6d95aa6b613 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:54.746141 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7f47a7a7-67ea-43f7-90e8-b6d95aa6b613 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:54.747131 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7f47a7a7-67ea-43f7-90e8-b6d95aa6b613 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:54.748180 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7f47a7a7-67ea-43f7-90e8-b6d95aa6b613 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:54.749539 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7f47a7a7-67ea-43f7-90e8-b6d95aa6b613 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:54.750457 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7f47a7a7-67ea-43f7-90e8-b6d95aa6b613 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:54.755095 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-050ed456-b26e-4423-963d-54d3c0073b75 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0d0bdfb04240209e4efa92f47cbb94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755501ba3e344f1aaf7ef80924bb57d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:07:54.766434 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-050ed456-b26e-4423-963d-54d3c0073b75 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] 10.222.0.18 "GET /compute/v2.1/servers/ad302c49-addb-464c-a15f-fa01577f90c4" status: 200 len: 1361 microversion: 2.1 time: 0.421292 Oct 22 21:07:54.785371 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-7f47a7a7-67ea-43f7-90e8-b6d95aa6b613 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Getting quotas for project 3385ef21cec84f6aa5ffa88bfdfd8646. Resources: {'cores', 'instances', 'ram'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 21:07:54.785544 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1950/3894] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:07:54 2022] GET /compute/v2.1/servers/ad302c49-addb-464c-a15f-fa01577f90c4 => generated 1361 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:07:54.791200 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-7f47a7a7-67ea-43f7-90e8-b6d95aa6b613 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Getting quotas for user 2fab7ad5c77a437e9b7ca01c806ddd01 and project 3385ef21cec84f6aa5ffa88bfdfd8646. Resources: {'cores', 'instances', 'ram'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 21:07:54.792965 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-9c0efb90-5710-4dd2-9b84-5565a1bb2282 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:07:54.794428 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-9c0efb90-5710-4dd2-9b84-5565a1bb2282 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] [instance: 37978245-38aa-4524-8c69-126c4b180b00] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:07:54.802718 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9c0efb90-5710-4dd2-9b84-5565a1bb2282 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:54.803659 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9c0efb90-5710-4dd2-9b84-5565a1bb2282 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:54.804323 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9c0efb90-5710-4dd2-9b84-5565a1bb2282 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:54.805263 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9c0efb90-5710-4dd2-9b84-5565a1bb2282 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:54.806042 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9c0efb90-5710-4dd2-9b84-5565a1bb2282 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:54.806898 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9c0efb90-5710-4dd2-9b84-5565a1bb2282 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:54.810132 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-7f47a7a7-67ea-43f7-90e8-b6d95aa6b613 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Going to run 1 instances... {{(pid=138744) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 21:07:54.813250 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-7f47a7a7-67ea-43f7-90e8-b6d95aa6b613 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] [instance: 5aa948d4-5141-4a18-8778-e8801a5bb9f5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='085e4478-6edc-4a69-8e08-f9831713eb65',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138744) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 21:07:54.911394 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-7f47a7a7-67ea-43f7-90e8-b6d95aa6b613 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.54 time: 0.477664 Oct 22 21:07:54.912655 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1945/3895] 10.222.0.18 () {62 vars in 1188 bytes} [Sat Oct 22 21:07:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 479 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 22 21:07:54.920193 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-9985f95e-5cfd-4878-8b79-ff73ec19cef2 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:07:54.920829 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-9985f95e-5cfd-4878-8b79-ff73ec19cef2 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] [instance: cc7f1980-ecea-437f-ac71-0cdb6ec626b9] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:07:54.929499 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9985f95e-5cfd-4878-8b79-ff73ec19cef2 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:54.929499 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9985f95e-5cfd-4878-8b79-ff73ec19cef2 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:54.930697 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9985f95e-5cfd-4878-8b79-ff73ec19cef2 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:54.932211 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9985f95e-5cfd-4878-8b79-ff73ec19cef2 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:54.932532 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9985f95e-5cfd-4878-8b79-ff73ec19cef2 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:54.932998 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9985f95e-5cfd-4878-8b79-ff73ec19cef2 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:55.058777 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-9c0efb90-5710-4dd2-9b84-5565a1bb2282 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7102f7b674934e19b3d4a001b563d0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21349e14fb39496c9996d5af817b7f73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:07:55.074097 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-9c0efb90-5710-4dd2-9b84-5565a1bb2282 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] 10.222.0.18 "GET /compute/v2.1/servers/37978245-38aa-4524-8c69-126c4b180b00" status: 200 len: 1471 microversion: 2.1 time: 0.287067 Oct 22 21:07:55.076981 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1951/3896] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:07:54 2022] GET /compute/v2.1/servers/37978245-38aa-4524-8c69-126c4b180b00 => generated 1471 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:07:55.083821 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-3f87b987-11dc-4e89-830e-ab7abfe006c9 req-b4140d5e-08d9-409c-b6e3-05ffcedd0858 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37978245-38aa-4524-8c69-126c4b180b00", "name": "network-vif-deleted", "tag": "2d24c6c5-c497-4768-afd7-c2a804f98609"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:07:55.095979 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-3f87b987-11dc-4e89-830e-ab7abfe006c9 req-b4140d5e-08d9-409c-b6e3-05ffcedd0858 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:55.097048 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-3f87b987-11dc-4e89-830e-ab7abfe006c9 req-b4140d5e-08d9-409c-b6e3-05ffcedd0858 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:55.097812 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-3f87b987-11dc-4e89-830e-ab7abfe006c9 req-b4140d5e-08d9-409c-b6e3-05ffcedd0858 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:55.111555 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-3f87b987-11dc-4e89-830e-ab7abfe006c9 req-b4140d5e-08d9-409c-b6e3-05ffcedd0858 service nova] Creating event network-vif-deleted:2d24c6c5-c497-4768-afd7-c2a804f98609 for instance 37978245-38aa-4524-8c69-126c4b180b00 on nch2-master-1 Oct 22 21:07:55.120675 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-3f87b987-11dc-4e89-830e-ab7abfe006c9 req-b4140d5e-08d9-409c-b6e3-05ffcedd0858 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042035 Oct 22 21:07:55.121467 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1952/3897] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:07:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:07:55.121918 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-9985f95e-5cfd-4878-8b79-ff73ec19cef2 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:07:55.134889 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-9985f95e-5cfd-4878-8b79-ff73ec19cef2 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:07:55.135689 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-1f91b853-5215-4d90-9fb4-a57c14d61f34 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:07:55.136647 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-1f91b853-5215-4d90-9fb4-a57c14d61f34 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] [instance: 5aa948d4-5141-4a18-8778-e8801a5bb9f5] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:07:55.136863 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-9985f95e-5cfd-4878-8b79-ff73ec19cef2 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:07:55.137988 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-9985f95e-5cfd-4878-8b79-ff73ec19cef2 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] 10.222.0.18 "GET /compute/v2.1/servers/cc7f1980-ecea-437f-ac71-0cdb6ec626b9" status: 200 len: 1350 microversion: 2.20 time: 0.225223 Oct 22 21:07:55.153624 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1946/3898] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:07:54 2022] GET /compute/v2.1/servers/cc7f1980-ecea-437f-ac71-0cdb6ec626b9 => generated 1350 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:07:55.165653 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-ac131074-b5de-489e-9c74-89d1dbc726d3 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:07:55.166344 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-ac131074-b5de-489e-9c74-89d1dbc726d3 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] [instance: b769064b-9ef9-47b7-9cfd-5d3b8a24a7a1] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:07:55.177234 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ac131074-b5de-489e-9c74-89d1dbc726d3 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:55.177757 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ac131074-b5de-489e-9c74-89d1dbc726d3 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:55.180363 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ac131074-b5de-489e-9c74-89d1dbc726d3 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:55.181249 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ac131074-b5de-489e-9c74-89d1dbc726d3 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:55.181720 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ac131074-b5de-489e-9c74-89d1dbc726d3 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:55.182255 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ac131074-b5de-489e-9c74-89d1dbc726d3 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:55.325814 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-1f91b853-5215-4d90-9fb4-a57c14d61f34 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fab7ad5c77a437e9b7ca01c806ddd01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3385ef21cec84f6aa5ffa88bfdfd8646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:07:55.335361 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-1f91b853-5215-4d90-9fb4-a57c14d61f34 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fab7ad5c77a437e9b7ca01c806ddd01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3385ef21cec84f6aa5ffa88bfdfd8646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:07:55.340855 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-1f91b853-5215-4d90-9fb4-a57c14d61f34 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fab7ad5c77a437e9b7ca01c806ddd01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3385ef21cec84f6aa5ffa88bfdfd8646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:07:55.345061 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-1f91b853-5215-4d90-9fb4-a57c14d61f34 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] 10.222.0.18 "GET /compute/v2.1/servers/5aa948d4-5141-4a18-8778-e8801a5bb9f5" status: 200 len: 1278 microversion: 2.54 time: 0.222551 Oct 22 21:07:55.346116 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1953/3899] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:07:55 2022] GET /compute/v2.1/servers/5aa948d4-5141-4a18-8778-e8801a5bb9f5 => generated 1278 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:07:55.354957 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-84fb0753-9b42-490d-b56c-409ffb6c2b2d tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:07:55.360067 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-84fb0753-9b42-490d-b56c-409ffb6c2b2d tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] [instance: 1324c851-90ff-47f4-b4e6-8acc8b829c5e] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:07:55.390425 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-84fb0753-9b42-490d-b56c-409ffb6c2b2d tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:55.390986 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-84fb0753-9b42-490d-b56c-409ffb6c2b2d tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:55.391499 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-84fb0753-9b42-490d-b56c-409ffb6c2b2d tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:55.393219 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-84fb0753-9b42-490d-b56c-409ffb6c2b2d tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:55.393883 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-84fb0753-9b42-490d-b56c-409ffb6c2b2d tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:55.394555 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-84fb0753-9b42-490d-b56c-409ffb6c2b2d tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:55.710337 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-ac131074-b5de-489e-9c74-89d1dbc726d3 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcdfeb6c1cda4810b9fa70fdfd9a66c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c774a85b2c41c98486cf91b1253363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:07:55.727716 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-ac131074-b5de-489e-9c74-89d1dbc726d3 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] 10.222.0.18 "GET /compute/v2.1/servers/b769064b-9ef9-47b7-9cfd-5d3b8a24a7a1" status: 200 len: 1508 microversion: 2.1 time: 0.572357 Oct 22 21:07:55.743958 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1947/3900] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:07:55 2022] GET /compute/v2.1/servers/b769064b-9ef9-47b7-9cfd-5d3b8a24a7a1 => generated 1508 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:07:55.752234 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-f3263d3a-ad28-498b-b00d-cf58119384ca tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:07:55.752867 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-f3263d3a-ad28-498b-b00d-cf58119384ca tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] [instance: e1523193-327c-4659-8fc4-7329cbffd32f] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:07:55.775219 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f3263d3a-ad28-498b-b00d-cf58119384ca tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:55.783710 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f3263d3a-ad28-498b-b00d-cf58119384ca tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:55.784566 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f3263d3a-ad28-498b-b00d-cf58119384ca tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:55.785619 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f3263d3a-ad28-498b-b00d-cf58119384ca tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:55.786575 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f3263d3a-ad28-498b-b00d-cf58119384ca tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:55.786575 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f3263d3a-ad28-498b-b00d-cf58119384ca tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:55.811941 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-84fb0753-9b42-490d-b56c-409ffb6c2b2d tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3820b31a424c3a9216a6ef91fcb285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a42c3ecf474883ac652fcc8c01c9f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:07:55.831240 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:07:55.852446 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-84fb0753-9b42-490d-b56c-409ffb6c2b2d tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] 10.222.0.18 "GET /compute/v2.1/servers/1324c851-90ff-47f4-b4e6-8acc8b829c5e" status: 200 len: 1265 microversion: 2.1 time: 0.503010 Oct 22 21:07:55.888866 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1954/3901] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:07:55 2022] GET /compute/v2.1/servers/1324c851-90ff-47f4-b4e6-8acc8b829c5e => generated 1265 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:07:55.905811 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-a323d416-96e6-448f-8c88-23407498ab0a req-a9fe2e73-387f-4200-a096-6de5090cd69c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad302c49-addb-464c-a15f-fa01577f90c4", "name": "network-vif-plugged", "status": "completed", "tag": "f6f36de6-f297-4ad8-a5a7-45c041622a1f"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:07:55.944745 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-a323d416-96e6-448f-8c88-23407498ab0a req-a9fe2e73-387f-4200-a096-6de5090cd69c service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:55.947849 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-a323d416-96e6-448f-8c88-23407498ab0a req-a9fe2e73-387f-4200-a096-6de5090cd69c service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:55.949571 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-a323d416-96e6-448f-8c88-23407498ab0a req-a9fe2e73-387f-4200-a096-6de5090cd69c service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:55.974817 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-a323d416-96e6-448f-8c88-23407498ab0a req-a9fe2e73-387f-4200-a096-6de5090cd69c service nova] Creating event network-vif-plugged:f6f36de6-f297-4ad8-a5a7-45c041622a1f for instance ad302c49-addb-464c-a15f-fa01577f90c4 on nch1-master-1 Oct 22 21:07:55.997858 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-a323d416-96e6-448f-8c88-23407498ab0a req-a9fe2e73-387f-4200-a096-6de5090cd69c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107215 Oct 22 21:07:55.998696 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1955/3902] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:07:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:07:56.021336 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-ddf0f967-4677-4a4d-b837-c4f94a903988 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:07:56.022374 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-ddf0f967-4677-4a4d-b837-c4f94a903988 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] [instance: b769064b-9ef9-47b7-9cfd-5d3b8a24a7a1] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:07:56.062598 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ddf0f967-4677-4a4d-b837-c4f94a903988 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:56.065588 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ddf0f967-4677-4a4d-b837-c4f94a903988 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:56.066491 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ddf0f967-4677-4a4d-b837-c4f94a903988 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:56.068433 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ddf0f967-4677-4a4d-b837-c4f94a903988 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:56.070205 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ddf0f967-4677-4a4d-b837-c4f94a903988 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:56.070663 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ddf0f967-4677-4a4d-b837-c4f94a903988 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:56.305333 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-f3263d3a-ad28-498b-b00d-cf58119384ca tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98584920f7f948d6995412c700128be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf63c122a5e4685a891957e1b58b9e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:07:56.317376 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-f3263d3a-ad28-498b-b00d-cf58119384ca tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] 10.222.0.18 "GET /compute/v2.1/servers/e1523193-327c-4659-8fc4-7329cbffd32f" status: 200 len: 1404 microversion: 2.1 time: 0.572126 Oct 22 21:07:56.318797 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1948/3903] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:07:55 2022] GET /compute/v2.1/servers/e1523193-327c-4659-8fc4-7329cbffd32f => generated 1404 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:07:56.336102 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-2ba3e013-2b23-4e0a-a9e9-4f7076f9d41d tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:07:56.344779 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-2ba3e013-2b23-4e0a-a9e9-4f7076f9d41d tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] [instance: ad302c49-addb-464c-a15f-fa01577f90c4] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:07:56.352464 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2ba3e013-2b23-4e0a-a9e9-4f7076f9d41d tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:56.352998 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2ba3e013-2b23-4e0a-a9e9-4f7076f9d41d tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:56.353420 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2ba3e013-2b23-4e0a-a9e9-4f7076f9d41d tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:56.354150 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2ba3e013-2b23-4e0a-a9e9-4f7076f9d41d tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:56.355009 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2ba3e013-2b23-4e0a-a9e9-4f7076f9d41d tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:56.355141 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2ba3e013-2b23-4e0a-a9e9-4f7076f9d41d tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:56.538873 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-ddf0f967-4677-4a4d-b837-c4f94a903988 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcdfeb6c1cda4810b9fa70fdfd9a66c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c774a85b2c41c98486cf91b1253363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:07:56.547385 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-ddf0f967-4677-4a4d-b837-c4f94a903988 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] 10.222.0.18 "GET /compute/v2.1/servers/b769064b-9ef9-47b7-9cfd-5d3b8a24a7a1" status: 200 len: 1508 microversion: 2.1 time: 0.545744 Oct 22 21:07:56.558947 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1956/3904] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:07:55 2022] GET /compute/v2.1/servers/b769064b-9ef9-47b7-9cfd-5d3b8a24a7a1 => generated 1508 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:07:56.567535 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-db8b6547-1efe-44b8-adeb-7d3eed0e42d2 req-0c754d1d-d28a-497c-966d-0b6d0f5153ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1523193-327c-4659-8fc4-7329cbffd32f", "tag": "043fc3dc-4aa8-48d0-bf01-30cbd832a23b"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:07:56.582606 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-db8b6547-1efe-44b8-adeb-7d3eed0e42d2 req-0c754d1d-d28a-497c-966d-0b6d0f5153ee service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:56.583098 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-db8b6547-1efe-44b8-adeb-7d3eed0e42d2 req-0c754d1d-d28a-497c-966d-0b6d0f5153ee service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:56.583585 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-db8b6547-1efe-44b8-adeb-7d3eed0e42d2 req-0c754d1d-d28a-497c-966d-0b6d0f5153ee service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:56.595982 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-db8b6547-1efe-44b8-adeb-7d3eed0e42d2 req-0c754d1d-d28a-497c-966d-0b6d0f5153ee service nova] Creating event network-changed:043fc3dc-4aa8-48d0-bf01-30cbd832a23b for instance e1523193-327c-4659-8fc4-7329cbffd32f on nch1-master-1 Oct 22 21:07:56.604351 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-db8b6547-1efe-44b8-adeb-7d3eed0e42d2 req-0c754d1d-d28a-497c-966d-0b6d0f5153ee service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054461 Oct 22 21:07:56.605214 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1957/3905] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:07:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:07:56.610212 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-d9ed86d0-4301-4e1e-b946-98e38aea2812 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:07:56.611087 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-d9ed86d0-4301-4e1e-b946-98e38aea2812 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] [instance: 37978245-38aa-4524-8c69-126c4b180b00] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:07:56.618173 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d9ed86d0-4301-4e1e-b946-98e38aea2812 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:56.619067 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d9ed86d0-4301-4e1e-b946-98e38aea2812 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:56.619709 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d9ed86d0-4301-4e1e-b946-98e38aea2812 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:56.620684 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d9ed86d0-4301-4e1e-b946-98e38aea2812 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:56.621215 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d9ed86d0-4301-4e1e-b946-98e38aea2812 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:56.621612 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d9ed86d0-4301-4e1e-b946-98e38aea2812 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:56.640697 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.wsgi [None req-d9ed86d0-4301-4e1e-b946-98e38aea2812 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] HTTP exception thrown: Instance 37978245-38aa-4524-8c69-126c4b180b00 could not be found. Oct 22 21:07:56.647906 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-d9ed86d0-4301-4e1e-b946-98e38aea2812 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Request method failure captured: Oct 22 21:07:56.647906 ncdv-master-1 devstack@n-api.service[138745]: request: GET /compute/v2.1/servers/37978245-38aa-4524-8c69-126c4b180b00 HTTP/1.1 Oct 22 21:07:56.647906 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 21:07:56.647906 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 21:07:56.647906 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 21:07:56.647906 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 0 Oct 22 21:07:56.647906 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 21:07:56.647906 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 21:07:56.647906 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 21:07:56.647906 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 21:07:56.647906 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVFsB6TabuGcXkx6rbRnR5vPLgUL0IP99Y-OKdK7kecvQghDVQMlOl_oNeon_Gk_fyfUdoa5iH7X1fu9w56l3kglCtcySb0caG3xy09PyRA-tBz4wf48NqwbilUB0NjukOnr7Pa2cMo1tsGYe61uylJ1NWyL7cKtfzD0hYbTOULY8f7Q Oct 22 21:07:56.647906 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 21:07:56.647906 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 21:07:56.647906 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 21:07:56.647906 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 21:07:56.647906 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 21:07:56.647906 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 21:07:56.647906 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: 21349e14fb39496c9996d5af817b7f73 Oct 22 21:07:56.647906 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1543447304 Oct 22 21:07:56.647906 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 21:07:56.647906 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 21:07:56.647906 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_21349e14fb39496c9996d5af817b7f73"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/21349e14fb39496c9996d5af817b7f73"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/21349e14fb39496c9996d5af817b7f73"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/21349e14fb39496c9996d5af817b7f73"}]}] Oct 22 21:07:56.647906 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-VolumesSnapshotTestJSON-1543447304 Oct 22 21:07:56.647906 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: 21349e14fb39496c9996d5af817b7f73 Oct 22 21:07:56.647906 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1543447304 Oct 22 21:07:56.647906 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-VolumesSnapshotTestJSON-1543447304-project Oct 22 21:07:56.647906 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 21:07:56.647906 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 21:07:56.647906 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: 7102f7b674934e19b3d4a001b563d0d5 Oct 22 21:07:56.647906 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-VolumesSnapshotTestJSON-1543447304-project Oct 22 21:07:56.647906 ncdv-master-1 devstack@n-api.service[138745]: method: > Oct 22 21:07:56.647906 ncdv-master-1 devstack@n-api.service[138745]: exception: Instance 37978245-38aa-4524-8c69-126c4b180b00 could not be found. Oct 22 21:07:56.647906 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'id': '37978245-38aa-4524-8c69-126c4b180b00'} Oct 22 21:07:56.647906 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:07:56.647906 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:07:56.647906 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 21:07:56.647906 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 21:07:56.647906 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 21:07:56.647906 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 21:07:56.647906 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 21:07:56.647906 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 21:07:56.647906 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 21:07:56.647906 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 21:07:56.647906 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 37978245-38aa-4524-8c69-126c4b180b00 could not be found. Oct 22 21:07:56.647906 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:07:56.647906 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:07:56.647906 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:07:56.647906 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:07:56.647906 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:07:56.647906 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:07:56.647906 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:07:56.647906 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:07:56.647906 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:07:56.647906 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:07:56.647906 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 21:07:56.647906 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 21:07:56.647906 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 21:07:56.647906 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 21:07:56.647906 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 21:07:56.647906 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:07:56.647906 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37978245-38aa-4524-8c69-126c4b180b00 could not be found. Oct 22 21:07:56.647906 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:07:56.647906 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:07:56.647906 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:07:56.652850 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:07:56.652850 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:07:56.652850 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:07:56.652850 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:07:56.652850 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:07:56.652850 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37978245-38aa-4524-8c69-126c4b180b00 could not be found. Oct 22 21:07:56.652850 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:07:56.652850 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-d9ed86d0-4301-4e1e-b946-98e38aea2812 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Returning 404 to user: Instance 37978245-38aa-4524-8c69-126c4b180b00 could not be found. {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:07:56.652850 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-d9ed86d0-4301-4e1e-b946-98e38aea2812 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] 10.222.0.18 "GET /compute/v2.1/servers/37978245-38aa-4524-8c69-126c4b180b00" status: 404 len: 111 microversion: 2.1 time: 0.046476 Oct 22 21:07:56.655055 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1958/3906] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:07:56 2022] GET /compute/v2.1/servers/37978245-38aa-4524-8c69-126c4b180b00 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 21:07:56.658003 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-131ccc29-af59-48e7-8f2c-25a079e94964 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:07:56.659009 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-131ccc29-af59-48e7-8f2c-25a079e94964 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] [instance: cc7f1980-ecea-437f-ac71-0cdb6ec626b9] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:07:56.666317 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-131ccc29-af59-48e7-8f2c-25a079e94964 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:56.667104 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-131ccc29-af59-48e7-8f2c-25a079e94964 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:56.667750 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-131ccc29-af59-48e7-8f2c-25a079e94964 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:56.668669 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-131ccc29-af59-48e7-8f2c-25a079e94964 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:56.669301 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-131ccc29-af59-48e7-8f2c-25a079e94964 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:56.669905 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-131ccc29-af59-48e7-8f2c-25a079e94964 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:57.117279 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-2ba3e013-2b23-4e0a-a9e9-4f7076f9d41d tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0d0bdfb04240209e4efa92f47cbb94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755501ba3e344f1aaf7ef80924bb57d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:07:57.122306 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-131ccc29-af59-48e7-8f2c-25a079e94964 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:07:57.128693 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-2ba3e013-2b23-4e0a-a9e9-4f7076f9d41d tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] 10.222.0.18 "GET /compute/v2.1/servers/ad302c49-addb-464c-a15f-fa01577f90c4" status: 200 len: 1361 microversion: 2.1 time: 0.807485 Oct 22 21:07:57.129930 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1949/3907] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:07:56 2022] GET /compute/v2.1/servers/ad302c49-addb-464c-a15f-fa01577f90c4 => generated 1361 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:07:57.140690 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-131ccc29-af59-48e7-8f2c-25a079e94964 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:07:57.143388 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-131ccc29-af59-48e7-8f2c-25a079e94964 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:07:57.148533 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-131ccc29-af59-48e7-8f2c-25a079e94964 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] 10.222.0.18 "GET /compute/v2.1/servers/cc7f1980-ecea-437f-ac71-0cdb6ec626b9" status: 200 len: 1338 microversion: 2.20 time: 0.494295 Oct 22 21:07:57.151096 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-5701548d-1613-4820-8c1d-baf228a56735 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:07:57.152383 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-5701548d-1613-4820-8c1d-baf228a56735 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] [instance: 5aa948d4-5141-4a18-8778-e8801a5bb9f5] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:07:57.155362 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1959/3908] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:07:56 2022] GET /compute/v2.1/servers/cc7f1980-ecea-437f-ac71-0cdb6ec626b9 => generated 1338 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:07:57.161134 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5701548d-1613-4820-8c1d-baf228a56735 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:57.161718 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5701548d-1613-4820-8c1d-baf228a56735 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:57.162669 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5701548d-1613-4820-8c1d-baf228a56735 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:57.163732 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5701548d-1613-4820-8c1d-baf228a56735 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:57.164483 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5701548d-1613-4820-8c1d-baf228a56735 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:57.165071 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5701548d-1613-4820-8c1d-baf228a56735 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:57.166992 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-ba29c7bf-bee3-431b-b725-da0698ffb317 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:07:57.167844 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-ba29c7bf-bee3-431b-b725-da0698ffb317 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] [instance: b769064b-9ef9-47b7-9cfd-5d3b8a24a7a1] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:07:57.176436 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ba29c7bf-bee3-431b-b725-da0698ffb317 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:57.177171 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ba29c7bf-bee3-431b-b725-da0698ffb317 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:57.177622 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ba29c7bf-bee3-431b-b725-da0698ffb317 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:57.178411 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ba29c7bf-bee3-431b-b725-da0698ffb317 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:57.178867 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ba29c7bf-bee3-431b-b725-da0698ffb317 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:57.179511 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ba29c7bf-bee3-431b-b725-da0698ffb317 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:57.210881 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-ba29c7bf-bee3-431b-b725-da0698ffb317 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] [instance: b769064b-9ef9-47b7-9cfd-5d3b8a24a7a1] Going to try to terminate instance {{(pid=138745) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 21:07:57.278293 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-5701548d-1613-4820-8c1d-baf228a56735 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fab7ad5c77a437e9b7ca01c806ddd01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3385ef21cec84f6aa5ffa88bfdfd8646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:07:57.308328 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-5701548d-1613-4820-8c1d-baf228a56735 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fab7ad5c77a437e9b7ca01c806ddd01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3385ef21cec84f6aa5ffa88bfdfd8646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:07:57.310788 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-5701548d-1613-4820-8c1d-baf228a56735 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fab7ad5c77a437e9b7ca01c806ddd01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3385ef21cec84f6aa5ffa88bfdfd8646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:07:57.312803 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-5701548d-1613-4820-8c1d-baf228a56735 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] 10.222.0.18 "GET /compute/v2.1/servers/5aa948d4-5141-4a18-8778-e8801a5bb9f5" status: 200 len: 1336 microversion: 2.54 time: 0.178959 Oct 22 21:07:57.314196 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1950/3909] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:07:57 2022] GET /compute/v2.1/servers/5aa948d4-5141-4a18-8778-e8801a5bb9f5 => generated 1336 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:07:57.320664 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-ba29c7bf-bee3-431b-b725-da0698ffb317 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] 10.222.0.18 "DELETE /compute/v2.1/servers/b769064b-9ef9-47b7-9cfd-5d3b8a24a7a1" status: 204 len: 0 microversion: 2.1 time: 0.161486 Oct 22 21:07:57.321270 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1960/3910] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 21:07:57 2022] DELETE /compute/v2.1/servers/b769064b-9ef9-47b7-9cfd-5d3b8a24a7a1 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 21:07:57.326418 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-2b8479c3-f49b-4280-9c69-992caeb32192 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:07:57.335111 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-2b8479c3-f49b-4280-9c69-992caeb32192 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] [instance: 1324c851-90ff-47f4-b4e6-8acc8b829c5e] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:07:57.344612 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2b8479c3-f49b-4280-9c69-992caeb32192 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:57.348176 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2b8479c3-f49b-4280-9c69-992caeb32192 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:57.349309 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2b8479c3-f49b-4280-9c69-992caeb32192 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:57.355304 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-5585f1aa-b6e8-439b-920b-96315c3f4b99 tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:07:57.356522 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-5585f1aa-b6e8-439b-920b-96315c3f4b99 tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] [instance: e1523193-327c-4659-8fc4-7329cbffd32f] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:07:57.363052 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2b8479c3-f49b-4280-9c69-992caeb32192 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:57.363542 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2b8479c3-f49b-4280-9c69-992caeb32192 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:57.363884 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2b8479c3-f49b-4280-9c69-992caeb32192 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:57.365335 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5585f1aa-b6e8-439b-920b-96315c3f4b99 tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:57.366132 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5585f1aa-b6e8-439b-920b-96315c3f4b99 tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:57.366872 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5585f1aa-b6e8-439b-920b-96315c3f4b99 tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:57.367925 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5585f1aa-b6e8-439b-920b-96315c3f4b99 tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:57.368676 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5585f1aa-b6e8-439b-920b-96315c3f4b99 tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:57.369309 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5585f1aa-b6e8-439b-920b-96315c3f4b99 tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:57.632285 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-5585f1aa-b6e8-439b-920b-96315c3f4b99 tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98584920f7f948d6995412c700128be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf63c122a5e4685a891957e1b58b9e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:07:57.637815 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-2b8479c3-f49b-4280-9c69-992caeb32192 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3820b31a424c3a9216a6ef91fcb285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a42c3ecf474883ac652fcc8c01c9f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:07:57.643187 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-5585f1aa-b6e8-439b-920b-96315c3f4b99 tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] 10.222.0.18 "GET /compute/v2.1/servers/e1523193-327c-4659-8fc4-7329cbffd32f" status: 200 len: 1404 microversion: 2.1 time: 0.296189 Oct 22 21:07:57.650156 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-2b8479c3-f49b-4280-9c69-992caeb32192 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] 10.222.0.18 "GET /compute/v2.1/servers/1324c851-90ff-47f4-b4e6-8acc8b829c5e" status: 200 len: 1452 microversion: 2.1 time: 0.333483 Oct 22 21:07:57.660446 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1961/3911] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:07:57 2022] GET /compute/v2.1/servers/e1523193-327c-4659-8fc4-7329cbffd32f => generated 1404 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:07:57.663951 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1951/3912] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:07:57 2022] GET /compute/v2.1/servers/1324c851-90ff-47f4-b4e6-8acc8b829c5e => generated 1452 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:07:57.668734 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-022952bd-a03a-449c-a918-e6c2c4d370e5 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-301189899", "imageRef": "085e4478-6edc-4a69-8e08-f9831713eb65", "flavorRef": "452", "networks": [{"uuid": "6186ef52-c98a-4139-af26-395c1bdf67cf"}]}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:07:57.676817 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-5c4b2d33-80c2-4967-ac46-a988761c72a8 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:07:57.677123 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-5c4b2d33-80c2-4967-ac46-a988761c72a8 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] [instance: 1324c851-90ff-47f4-b4e6-8acc8b829c5e] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:07:57.686944 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5c4b2d33-80c2-4967-ac46-a988761c72a8 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:57.687528 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5c4b2d33-80c2-4967-ac46-a988761c72a8 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:57.687989 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5c4b2d33-80c2-4967-ac46-a988761c72a8 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:57.688713 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5c4b2d33-80c2-4967-ac46-a988761c72a8 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:57.689381 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5c4b2d33-80c2-4967-ac46-a988761c72a8 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:57.690106 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5c4b2d33-80c2-4967-ac46-a988761c72a8 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:57.723861 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:07:57.741711 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.network.neutron [None req-022952bd-a03a-449c-a918-e6c2c4d370e5 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] validate_networks() for [('6186ef52-c98a-4139-af26-395c1bdf67cf', None, None, None, None, None)] {{(pid=138745) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 21:07:57.934132 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-5c4b2d33-80c2-4967-ac46-a988761c72a8 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3820b31a424c3a9216a6ef91fcb285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a42c3ecf474883ac652fcc8c01c9f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:07:57.943229 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-5c4b2d33-80c2-4967-ac46-a988761c72a8 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] 10.222.0.18 "GET /compute/v2.1/servers/1324c851-90ff-47f4-b4e6-8acc8b829c5e" status: 200 len: 1452 microversion: 2.1 time: 0.272251 Oct 22 21:07:57.944169 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1952/3913] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:07:57 2022] GET /compute/v2.1/servers/1324c851-90ff-47f4-b4e6-8acc8b829c5e => generated 1452 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:07:58.152959 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-1f5314c1-68ef-4ad5-9c13-d183d9f8224c tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:07:58.153785 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-1f5314c1-68ef-4ad5-9c13-d183d9f8224c tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] [instance: ad302c49-addb-464c-a15f-fa01577f90c4] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:07:58.168138 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1f5314c1-68ef-4ad5-9c13-d183d9f8224c tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:58.169228 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1f5314c1-68ef-4ad5-9c13-d183d9f8224c tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:58.171398 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1f5314c1-68ef-4ad5-9c13-d183d9f8224c tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:58.174283 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1f5314c1-68ef-4ad5-9c13-d183d9f8224c tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:58.176125 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1f5314c1-68ef-4ad5-9c13-d183d9f8224c tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:58.176690 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1f5314c1-68ef-4ad5-9c13-d183d9f8224c tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:58.290480 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-022952bd-a03a-449c-a918-e6c2c4d370e5 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Flavor limits 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 21:07:58.290924 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-022952bd-a03a-449c-a918-e6c2c4d370e5 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Image limits 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 21:07:58.291447 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-022952bd-a03a-449c-a918-e6c2c4d370e5 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Flavor pref 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 21:07:58.291879 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-022952bd-a03a-449c-a918-e6c2c4d370e5 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Image pref 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 21:07:58.292309 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-022952bd-a03a-449c-a918-e6c2c4d370e5 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 21:07:58.305416 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-022952bd-a03a-449c-a918-e6c2c4d370e5 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:58.305920 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-022952bd-a03a-449c-a918-e6c2c4d370e5 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:58.306382 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-022952bd-a03a-449c-a918-e6c2c4d370e5 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:58.307138 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-022952bd-a03a-449c-a918-e6c2c4d370e5 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:58.307682 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-022952bd-a03a-449c-a918-e6c2c4d370e5 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:58.308124 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-022952bd-a03a-449c-a918-e6c2c4d370e5 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:58.333210 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-022952bd-a03a-449c-a918-e6c2c4d370e5 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Getting quotas for project 48c774a85b2c41c98486cf91b1253363. Resources: {'cores', 'instances', 'ram'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 21:07:58.339964 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-022952bd-a03a-449c-a918-e6c2c4d370e5 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Getting quotas for user bcdfeb6c1cda4810b9fa70fdfd9a66c8 and project 48c774a85b2c41c98486cf91b1253363. Resources: {'cores', 'instances', 'ram'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 21:07:58.355265 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-022952bd-a03a-449c-a918-e6c2c4d370e5 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Going to run 1 instances... {{(pid=138745) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 21:07:58.358012 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-022952bd-a03a-449c-a918-e6c2c4d370e5 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] [instance: 5e25931a-04e4-4e25-8aea-012b106aa2c1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='085e4478-6edc-4a69-8e08-f9831713eb65',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138745) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 21:07:58.368263 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-1f5314c1-68ef-4ad5-9c13-d183d9f8224c tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0d0bdfb04240209e4efa92f47cbb94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755501ba3e344f1aaf7ef80924bb57d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:07:58.377000 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-1f5314c1-68ef-4ad5-9c13-d183d9f8224c tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] 10.222.0.18 "GET /compute/v2.1/servers/ad302c49-addb-464c-a15f-fa01577f90c4" status: 200 len: 1361 microversion: 2.1 time: 0.228361 Oct 22 21:07:58.377989 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1953/3914] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:07:58 2022] GET /compute/v2.1/servers/ad302c49-addb-464c-a15f-fa01577f90c4 => generated 1361 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:07:58.383036 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-3b8c58b1-fb50-4538-bfdd-4fe0379bccb0 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:07:58.383745 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-3b8c58b1-fb50-4538-bfdd-4fe0379bccb0 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] [instance: cc7f1980-ecea-437f-ac71-0cdb6ec626b9] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:07:58.393160 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3b8c58b1-fb50-4538-bfdd-4fe0379bccb0 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:58.394859 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3b8c58b1-fb50-4538-bfdd-4fe0379bccb0 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:58.395285 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3b8c58b1-fb50-4538-bfdd-4fe0379bccb0 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:58.397474 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3b8c58b1-fb50-4538-bfdd-4fe0379bccb0 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:58.397955 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3b8c58b1-fb50-4538-bfdd-4fe0379bccb0 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:58.398399 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3b8c58b1-fb50-4538-bfdd-4fe0379bccb0 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:58.419221 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-022952bd-a03a-449c-a918-e6c2c4d370e5 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.754122 Oct 22 21:07:58.420473 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1962/3915] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Oct 22 21:07:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 759 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 21:07:58.426302 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-990c705c-93d7-4826-bc3f-37c34e8ebbcc tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:07:58.427139 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-990c705c-93d7-4826-bc3f-37c34e8ebbcc tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] [instance: 5aa948d4-5141-4a18-8778-e8801a5bb9f5] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:07:58.435705 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-990c705c-93d7-4826-bc3f-37c34e8ebbcc tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:58.436610 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-990c705c-93d7-4826-bc3f-37c34e8ebbcc tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:58.437715 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-990c705c-93d7-4826-bc3f-37c34e8ebbcc tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:58.438818 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-990c705c-93d7-4826-bc3f-37c34e8ebbcc tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:58.439537 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-990c705c-93d7-4826-bc3f-37c34e8ebbcc tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:58.440859 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-990c705c-93d7-4826-bc3f-37c34e8ebbcc tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:58.552596 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-990c705c-93d7-4826-bc3f-37c34e8ebbcc tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fab7ad5c77a437e9b7ca01c806ddd01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3385ef21cec84f6aa5ffa88bfdfd8646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:07:58.566485 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-990c705c-93d7-4826-bc3f-37c34e8ebbcc tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fab7ad5c77a437e9b7ca01c806ddd01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3385ef21cec84f6aa5ffa88bfdfd8646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:07:58.577599 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-990c705c-93d7-4826-bc3f-37c34e8ebbcc tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fab7ad5c77a437e9b7ca01c806ddd01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3385ef21cec84f6aa5ffa88bfdfd8646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:07:58.578842 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-990c705c-93d7-4826-bc3f-37c34e8ebbcc tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] 10.222.0.18 "GET /compute/v2.1/servers/5aa948d4-5141-4a18-8778-e8801a5bb9f5" status: 200 len: 1336 microversion: 2.54 time: 0.157226 Oct 22 21:07:58.579512 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1963/3916] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:07:58 2022] GET /compute/v2.1/servers/5aa948d4-5141-4a18-8778-e8801a5bb9f5 => generated 1336 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:07:58.586742 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-2a422b1d-0c51-4592-b134-c7718ac9bec9 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:07:58.587635 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-2a422b1d-0c51-4592-b134-c7718ac9bec9 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] [instance: 5e25931a-04e4-4e25-8aea-012b106aa2c1] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:07:58.617348 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-3b8c58b1-fb50-4538-bfdd-4fe0379bccb0 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:07:58.630082 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-3b8c58b1-fb50-4538-bfdd-4fe0379bccb0 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:07:58.631811 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-3b8c58b1-fb50-4538-bfdd-4fe0379bccb0 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:07:58.641307 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-3b8c58b1-fb50-4538-bfdd-4fe0379bccb0 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] 10.222.0.18 "GET /compute/v2.1/servers/cc7f1980-ecea-437f-ac71-0cdb6ec626b9" status: 200 len: 1406 microversion: 2.20 time: 0.262148 Oct 22 21:07:58.641914 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1954/3917] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:07:58 2022] GET /compute/v2.1/servers/cc7f1980-ecea-437f-ac71-0cdb6ec626b9 => generated 1406 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:07:58.667658 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-3a9cecfb-7655-417b-a077-a90e78353999 tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:07:58.669297 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-3a9cecfb-7655-417b-a077-a90e78353999 tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] [instance: e1523193-327c-4659-8fc4-7329cbffd32f] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:07:58.673854 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-2a422b1d-0c51-4592-b134-c7718ac9bec9 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcdfeb6c1cda4810b9fa70fdfd9a66c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c774a85b2c41c98486cf91b1253363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:07:58.682672 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3a9cecfb-7655-417b-a077-a90e78353999 tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:58.683173 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3a9cecfb-7655-417b-a077-a90e78353999 tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:58.683647 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3a9cecfb-7655-417b-a077-a90e78353999 tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:58.687249 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3a9cecfb-7655-417b-a077-a90e78353999 tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:58.689991 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3a9cecfb-7655-417b-a077-a90e78353999 tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:58.690539 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3a9cecfb-7655-417b-a077-a90e78353999 tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:58.693099 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-2a422b1d-0c51-4592-b134-c7718ac9bec9 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] 10.222.0.18 "GET /compute/v2.1/servers/5e25931a-04e4-4e25-8aea-012b106aa2c1" status: 200 len: 1217 microversion: 2.1 time: 0.108749 Oct 22 21:07:58.709172 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1964/3918] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:07:58 2022] GET /compute/v2.1/servers/5e25931a-04e4-4e25-8aea-012b106aa2c1 => generated 1217 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:07:58.854130 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-3a9cecfb-7655-417b-a077-a90e78353999 tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98584920f7f948d6995412c700128be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf63c122a5e4685a891957e1b58b9e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:07:58.864276 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-3a9cecfb-7655-417b-a077-a90e78353999 tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] 10.222.0.18 "GET /compute/v2.1/servers/e1523193-327c-4659-8fc4-7329cbffd32f" status: 200 len: 1404 microversion: 2.1 time: 0.201229 Oct 22 21:07:58.864961 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1955/3919] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:07:58 2022] GET /compute/v2.1/servers/e1523193-327c-4659-8fc4-7329cbffd32f => generated 1404 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:07:59.404527 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-3dcf2573-00a1-4ce8-b5a8-7ef92d0c206c tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:07:59.406195 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-3dcf2573-00a1-4ce8-b5a8-7ef92d0c206c tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] [instance: ad302c49-addb-464c-a15f-fa01577f90c4] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:07:59.416284 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3dcf2573-00a1-4ce8-b5a8-7ef92d0c206c tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:59.417105 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3dcf2573-00a1-4ce8-b5a8-7ef92d0c206c tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:59.418243 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3dcf2573-00a1-4ce8-b5a8-7ef92d0c206c tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:59.419970 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3dcf2573-00a1-4ce8-b5a8-7ef92d0c206c tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:59.421900 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3dcf2573-00a1-4ce8-b5a8-7ef92d0c206c tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:59.423784 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3dcf2573-00a1-4ce8-b5a8-7ef92d0c206c tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:59.617776 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-fcdcb10e-666d-473e-a305-59eda7ea6357 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:07:59.620259 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-fcdcb10e-666d-473e-a305-59eda7ea6357 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] [instance: 5aa948d4-5141-4a18-8778-e8801a5bb9f5] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:07:59.627544 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-3dcf2573-00a1-4ce8-b5a8-7ef92d0c206c tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0d0bdfb04240209e4efa92f47cbb94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755501ba3e344f1aaf7ef80924bb57d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:07:59.629787 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fcdcb10e-666d-473e-a305-59eda7ea6357 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:59.630436 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fcdcb10e-666d-473e-a305-59eda7ea6357 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:59.631376 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fcdcb10e-666d-473e-a305-59eda7ea6357 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:59.633492 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fcdcb10e-666d-473e-a305-59eda7ea6357 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:59.634475 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fcdcb10e-666d-473e-a305-59eda7ea6357 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:59.635076 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fcdcb10e-666d-473e-a305-59eda7ea6357 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:59.657083 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-3dcf2573-00a1-4ce8-b5a8-7ef92d0c206c tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] 10.222.0.18 "GET /compute/v2.1/servers/ad302c49-addb-464c-a15f-fa01577f90c4" status: 200 len: 1547 microversion: 2.1 time: 0.259228 Oct 22 21:07:59.671830 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1965/3920] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:07:59 2022] GET /compute/v2.1/servers/ad302c49-addb-464c-a15f-fa01577f90c4 => generated 1547 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:07:59.681045 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-b5d0e2aa-a5f7-41b9-8b1d-f583d3298ead tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:07:59.683232 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-b5d0e2aa-a5f7-41b9-8b1d-f583d3298ead tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] [instance: cc7f1980-ecea-437f-ac71-0cdb6ec626b9] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:07:59.691001 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b5d0e2aa-a5f7-41b9-8b1d-f583d3298ead tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:59.691854 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b5d0e2aa-a5f7-41b9-8b1d-f583d3298ead tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:59.692501 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b5d0e2aa-a5f7-41b9-8b1d-f583d3298ead tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:59.693382 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b5d0e2aa-a5f7-41b9-8b1d-f583d3298ead tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:59.693989 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b5d0e2aa-a5f7-41b9-8b1d-f583d3298ead tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:59.694580 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b5d0e2aa-a5f7-41b9-8b1d-f583d3298ead tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:59.806301 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-fcdcb10e-666d-473e-a305-59eda7ea6357 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fab7ad5c77a437e9b7ca01c806ddd01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3385ef21cec84f6aa5ffa88bfdfd8646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:07:59.816975 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-fcdcb10e-666d-473e-a305-59eda7ea6357 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fab7ad5c77a437e9b7ca01c806ddd01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3385ef21cec84f6aa5ffa88bfdfd8646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:07:59.828601 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-fcdcb10e-666d-473e-a305-59eda7ea6357 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fab7ad5c77a437e9b7ca01c806ddd01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3385ef21cec84f6aa5ffa88bfdfd8646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:07:59.830718 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-fcdcb10e-666d-473e-a305-59eda7ea6357 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] 10.222.0.18 "GET /compute/v2.1/servers/5aa948d4-5141-4a18-8778-e8801a5bb9f5" status: 200 len: 1336 microversion: 2.54 time: 0.223520 Oct 22 21:07:59.835328 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1956/3921] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:07:59 2022] GET /compute/v2.1/servers/5aa948d4-5141-4a18-8778-e8801a5bb9f5 => generated 1336 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 22 21:07:59.843370 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-53247dbb-e416-4374-a822-34daaff6d33b tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:07:59.843880 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-53247dbb-e416-4374-a822-34daaff6d33b tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] [instance: ad302c49-addb-464c-a15f-fa01577f90c4] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:07:59.861022 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-53247dbb-e416-4374-a822-34daaff6d33b tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:59.861536 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-53247dbb-e416-4374-a822-34daaff6d33b tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:59.862298 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-53247dbb-e416-4374-a822-34daaff6d33b tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:07:59.863089 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-53247dbb-e416-4374-a822-34daaff6d33b tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:07:59.863600 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-53247dbb-e416-4374-a822-34daaff6d33b tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:07:59.864314 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-53247dbb-e416-4374-a822-34daaff6d33b tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:00.065844 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-b5d0e2aa-a5f7-41b9-8b1d-f583d3298ead tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:08:00.075396 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-b5d0e2aa-a5f7-41b9-8b1d-f583d3298ead tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:08:00.077749 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-b5d0e2aa-a5f7-41b9-8b1d-f583d3298ead tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:08:00.078994 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-b5d0e2aa-a5f7-41b9-8b1d-f583d3298ead tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] 10.222.0.18 "GET /compute/v2.1/servers/cc7f1980-ecea-437f-ac71-0cdb6ec626b9" status: 200 len: 1406 microversion: 2.20 time: 0.405834 Oct 22 21:08:00.079696 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1966/3922] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:07:59 2022] GET /compute/v2.1/servers/cc7f1980-ecea-437f-ac71-0cdb6ec626b9 => generated 1406 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:08:00.085363 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-e164c300-021d-469e-9274-a9589e153483 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:08:00.085974 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-e164c300-021d-469e-9274-a9589e153483 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] [instance: 5e25931a-04e4-4e25-8aea-012b106aa2c1] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:08:00.092599 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e164c300-021d-469e-9274-a9589e153483 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:00.093257 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e164c300-021d-469e-9274-a9589e153483 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:00.094045 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e164c300-021d-469e-9274-a9589e153483 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:00.094926 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e164c300-021d-469e-9274-a9589e153483 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:00.095685 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e164c300-021d-469e-9274-a9589e153483 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:00.096275 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e164c300-021d-469e-9274-a9589e153483 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:00.097038 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-53247dbb-e416-4374-a822-34daaff6d33b tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] 10.222.0.18 "GET /compute/v2.1/servers/ad302c49-addb-464c-a15f-fa01577f90c4/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.259639 Oct 22 21:08:00.098121 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1957/3923] 10.222.0.18 () {58 vars in 1275 bytes} [Sat Oct 22 21:07:59 2022] GET /compute/v2.1/servers/ad302c49-addb-464c-a15f-fa01577f90c4/os-interface => generated 284 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:08:00.103294 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-0c0f04ad-b278-44b7-a053-efddbfb06f7f tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:08:00.104183 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-0c0f04ad-b278-44b7-a053-efddbfb06f7f tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] [instance: e1523193-327c-4659-8fc4-7329cbffd32f] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:08:00.112704 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0c0f04ad-b278-44b7-a053-efddbfb06f7f tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:00.113400 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0c0f04ad-b278-44b7-a053-efddbfb06f7f tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:00.114669 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0c0f04ad-b278-44b7-a053-efddbfb06f7f tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:00.115616 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0c0f04ad-b278-44b7-a053-efddbfb06f7f tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:00.116235 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0c0f04ad-b278-44b7-a053-efddbfb06f7f tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:00.116826 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0c0f04ad-b278-44b7-a053-efddbfb06f7f tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:00.391821 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-e164c300-021d-469e-9274-a9589e153483 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcdfeb6c1cda4810b9fa70fdfd9a66c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c774a85b2c41c98486cf91b1253363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:08:00.404442 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-e164c300-021d-469e-9274-a9589e153483 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] 10.222.0.18 "GET /compute/v2.1/servers/5e25931a-04e4-4e25-8aea-012b106aa2c1" status: 200 len: 1269 microversion: 2.1 time: 0.323262 Oct 22 21:08:00.406617 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1967/3924] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:08:00 2022] GET /compute/v2.1/servers/5e25931a-04e4-4e25-8aea-012b106aa2c1 => generated 1269 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:08:00.859832 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-3b7f0fbc-1d10-49aa-b097-1da4858af725 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:08:00.861667 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-3b7f0fbc-1d10-49aa-b097-1da4858af725 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] [instance: 5aa948d4-5141-4a18-8778-e8801a5bb9f5] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:08:00.868976 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3b7f0fbc-1d10-49aa-b097-1da4858af725 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:00.869457 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3b7f0fbc-1d10-49aa-b097-1da4858af725 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:00.870088 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3b7f0fbc-1d10-49aa-b097-1da4858af725 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:00.870796 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3b7f0fbc-1d10-49aa-b097-1da4858af725 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:00.871467 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3b7f0fbc-1d10-49aa-b097-1da4858af725 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:00.871908 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3b7f0fbc-1d10-49aa-b097-1da4858af725 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:00.989775 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-0c0f04ad-b278-44b7-a053-efddbfb06f7f tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98584920f7f948d6995412c700128be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf63c122a5e4685a891957e1b58b9e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:08:00.999916 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-0c0f04ad-b278-44b7-a053-efddbfb06f7f tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] 10.222.0.18 "GET /compute/v2.1/servers/e1523193-327c-4659-8fc4-7329cbffd32f" status: 200 len: 1404 microversion: 2.1 time: 0.900281 Oct 22 21:08:01.000874 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1958/3925] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:08:00 2022] GET /compute/v2.1/servers/e1523193-327c-4659-8fc4-7329cbffd32f => generated 1404 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:08:01.041836 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-3b7f0fbc-1d10-49aa-b097-1da4858af725 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fab7ad5c77a437e9b7ca01c806ddd01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3385ef21cec84f6aa5ffa88bfdfd8646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:08:01.051969 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-3b7f0fbc-1d10-49aa-b097-1da4858af725 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fab7ad5c77a437e9b7ca01c806ddd01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3385ef21cec84f6aa5ffa88bfdfd8646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:08:01.053482 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-3b7f0fbc-1d10-49aa-b097-1da4858af725 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fab7ad5c77a437e9b7ca01c806ddd01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3385ef21cec84f6aa5ffa88bfdfd8646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:08:01.055664 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-3b7f0fbc-1d10-49aa-b097-1da4858af725 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] 10.222.0.18 "GET /compute/v2.1/servers/5aa948d4-5141-4a18-8778-e8801a5bb9f5" status: 200 len: 1357 microversion: 2.54 time: 0.198854 Oct 22 21:08:01.056912 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1968/3926] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:08:00 2022] GET /compute/v2.1/servers/5aa948d4-5141-4a18-8778-e8801a5bb9f5 => generated 1357 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:08:01.086703 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-745d08eb-2be1-4fd5-9c75-e3a647d98ac6 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Action: 'create', calling method: .version_select at 0x7fd39efeac10>, body: {"keypair": {"name": "tempest-ServerShowV254Test-keypair-919355600", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG3e10SOAoKtHozAPk3BjQFQluFRXdXdWVYX8xeoFbRK48g55FJvMLl/kw9H1RvmRwS18X0OURZBR+ss7evCGY2TIc1tmUZEmcoZ9sCbNZWZ58I1W3QqrfBi/jDuixm2nQ=="}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:08:01.112086 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-f531a459-19b0-4ee0-8e67-24b384c2a50b tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:08:01.113134 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-f531a459-19b0-4ee0-8e67-24b384c2a50b tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] [instance: cc7f1980-ecea-437f-ac71-0cdb6ec626b9] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:08:01.115647 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-745d08eb-2be1-4fd5-9c75-e3a647d98ac6 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Getting quotas for project 3385ef21cec84f6aa5ffa88bfdfd8646. Resources: {'key_pairs'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 21:08:01.122001 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f531a459-19b0-4ee0-8e67-24b384c2a50b tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:01.122881 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f531a459-19b0-4ee0-8e67-24b384c2a50b tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:01.124011 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f531a459-19b0-4ee0-8e67-24b384c2a50b tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:01.124540 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-745d08eb-2be1-4fd5-9c75-e3a647d98ac6 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Getting quotas for user 2fab7ad5c77a437e9b7ca01c806ddd01 and project 3385ef21cec84f6aa5ffa88bfdfd8646. Resources: {'key_pairs'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 21:08:01.125237 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f531a459-19b0-4ee0-8e67-24b384c2a50b tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:01.126006 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f531a459-19b0-4ee0-8e67-24b384c2a50b tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:01.126960 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f531a459-19b0-4ee0-8e67-24b384c2a50b tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:01.201282 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-745d08eb-2be1-4fd5-9c75-e3a647d98ac6 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 201 len: 419 microversion: 2.54 time: 0.119132 Oct 22 21:08:01.203524 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1959/3927] 10.222.0.18 () {62 vars in 1200 bytes} [Sat Oct 22 21:08:01 2022] POST /compute/v2.1/os-keypairs => generated 419 bytes in 123 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 22 21:08:01.218305 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-cac0e328-bc52-44e7-80f1-293e3704cae8 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Action: 'action', calling method: >, body: {"rebuild": {"key_name": "tempest-ServerShowV254Test-keypair-919355600", "imageRef": "085e4478-6edc-4a69-8e08-f9831713eb65"}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:08:01.222369 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-cac0e328-bc52-44e7-80f1-293e3704cae8 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] [instance: 5aa948d4-5141-4a18-8778-e8801a5bb9f5] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:08:01.230464 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cac0e328-bc52-44e7-80f1-293e3704cae8 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:01.231043 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cac0e328-bc52-44e7-80f1-293e3704cae8 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:01.231635 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cac0e328-bc52-44e7-80f1-293e3704cae8 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:01.232659 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cac0e328-bc52-44e7-80f1-293e3704cae8 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:01.233241 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cac0e328-bc52-44e7-80f1-293e3704cae8 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:01.233790 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cac0e328-bc52-44e7-80f1-293e3704cae8 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:01.362019 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-cac0e328-bc52-44e7-80f1-293e3704cae8 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Flavor limits 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 21:08:01.362846 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-cac0e328-bc52-44e7-80f1-293e3704cae8 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Image limits 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 21:08:01.363925 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-cac0e328-bc52-44e7-80f1-293e3704cae8 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Flavor pref 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 21:08:01.364651 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-cac0e328-bc52-44e7-80f1-293e3704cae8 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Image pref 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 21:08:01.365397 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-cac0e328-bc52-44e7-80f1-293e3704cae8 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 21:08:01.539209 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-cac0e328-bc52-44e7-80f1-293e3704cae8 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] [instance: 5aa948d4-5141-4a18-8778-e8801a5bb9f5] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:08:01.555717 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cac0e328-bc52-44e7-80f1-293e3704cae8 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:01.557058 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cac0e328-bc52-44e7-80f1-293e3704cae8 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:01.558678 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cac0e328-bc52-44e7-80f1-293e3704cae8 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:01.564269 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cac0e328-bc52-44e7-80f1-293e3704cae8 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:01.565664 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cac0e328-bc52-44e7-80f1-293e3704cae8 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:01.566616 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cac0e328-bc52-44e7-80f1-293e3704cae8 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:01.642674 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-cac0e328-bc52-44e7-80f1-293e3704cae8 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] 10.222.0.18 "POST /compute/v2.1/servers/5aa948d4-5141-4a18-8778-e8801a5bb9f5/action" status: 202 len: 1139 microversion: 2.54 time: 0.428997 Oct 22 21:08:01.644119 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1960/3928] 10.222.0.18 () {62 vars in 1320 bytes} [Sat Oct 22 21:08:01 2022] POST /compute/v2.1/servers/5aa948d4-5141-4a18-8778-e8801a5bb9f5/action => generated 1139 bytes in 435 msecs (HTTP/1.1 202) 10 headers in 454 bytes (2 switches on core 0) Oct 22 21:08:01.656120 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-e78d0a20-82b1-480b-acb7-a346cf4b5ec1 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:08:01.660025 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-e78d0a20-82b1-480b-acb7-a346cf4b5ec1 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] [instance: 5e25931a-04e4-4e25-8aea-012b106aa2c1] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:08:01.675595 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e78d0a20-82b1-480b-acb7-a346cf4b5ec1 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:01.676482 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e78d0a20-82b1-480b-acb7-a346cf4b5ec1 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:01.684578 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e78d0a20-82b1-480b-acb7-a346cf4b5ec1 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:01.685955 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e78d0a20-82b1-480b-acb7-a346cf4b5ec1 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:01.686571 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e78d0a20-82b1-480b-acb7-a346cf4b5ec1 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:01.687660 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e78d0a20-82b1-480b-acb7-a346cf4b5ec1 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:01.890436 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-e78d0a20-82b1-480b-acb7-a346cf4b5ec1 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcdfeb6c1cda4810b9fa70fdfd9a66c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c774a85b2c41c98486cf91b1253363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:08:01.911645 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-e78d0a20-82b1-480b-acb7-a346cf4b5ec1 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] 10.222.0.18 "GET /compute/v2.1/servers/5e25931a-04e4-4e25-8aea-012b106aa2c1" status: 200 len: 1275 microversion: 2.1 time: 0.260832 Oct 22 21:08:01.929712 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1961/3929] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:08:01 2022] GET /compute/v2.1/servers/5e25931a-04e4-4e25-8aea-012b106aa2c1 => generated 1275 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:08:01.937820 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-8bfa8ad2-644c-4318-80d3-2f0802c806c6 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:08:01.939759 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-8bfa8ad2-644c-4318-80d3-2f0802c806c6 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] [instance: 5aa948d4-5141-4a18-8778-e8801a5bb9f5] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:08:01.948890 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8bfa8ad2-644c-4318-80d3-2f0802c806c6 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:01.949394 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8bfa8ad2-644c-4318-80d3-2f0802c806c6 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:01.950064 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8bfa8ad2-644c-4318-80d3-2f0802c806c6 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:01.951223 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8bfa8ad2-644c-4318-80d3-2f0802c806c6 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:01.951223 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8bfa8ad2-644c-4318-80d3-2f0802c806c6 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:01.951734 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8bfa8ad2-644c-4318-80d3-2f0802c806c6 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:02.142438 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-8bfa8ad2-644c-4318-80d3-2f0802c806c6 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fab7ad5c77a437e9b7ca01c806ddd01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3385ef21cec84f6aa5ffa88bfdfd8646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:08:02.162093 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-8bfa8ad2-644c-4318-80d3-2f0802c806c6 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fab7ad5c77a437e9b7ca01c806ddd01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3385ef21cec84f6aa5ffa88bfdfd8646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:08:02.164746 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-8bfa8ad2-644c-4318-80d3-2f0802c806c6 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fab7ad5c77a437e9b7ca01c806ddd01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3385ef21cec84f6aa5ffa88bfdfd8646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:08:02.167631 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-8bfa8ad2-644c-4318-80d3-2f0802c806c6 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] 10.222.0.18 "GET /compute/v2.1/servers/5aa948d4-5141-4a18-8778-e8801a5bb9f5" status: 200 len: 1408 microversion: 2.54 time: 0.235434 Oct 22 21:08:02.167631 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1962/3930] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:08:01 2022] GET /compute/v2.1/servers/5aa948d4-5141-4a18-8778-e8801a5bb9f5 => generated 1408 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:08:02.184873 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-15cd69b8-bb3a-41c1-b1fc-bfb194f036a8 tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:08:02.185744 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-15cd69b8-bb3a-41c1-b1fc-bfb194f036a8 tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] [instance: e1523193-327c-4659-8fc4-7329cbffd32f] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:08:02.196138 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-15cd69b8-bb3a-41c1-b1fc-bfb194f036a8 tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:02.196958 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-15cd69b8-bb3a-41c1-b1fc-bfb194f036a8 tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:02.197913 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-15cd69b8-bb3a-41c1-b1fc-bfb194f036a8 tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:02.199783 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-15cd69b8-bb3a-41c1-b1fc-bfb194f036a8 tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:02.201364 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-15cd69b8-bb3a-41c1-b1fc-bfb194f036a8 tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:02.202380 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-15cd69b8-bb3a-41c1-b1fc-bfb194f036a8 tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:02.315911 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-f531a459-19b0-4ee0-8e67-24b384c2a50b tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:08:02.331966 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-f531a459-19b0-4ee0-8e67-24b384c2a50b tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:08:02.333870 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-f531a459-19b0-4ee0-8e67-24b384c2a50b tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:08:02.352110 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-f531a459-19b0-4ee0-8e67-24b384c2a50b tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] 10.222.0.18 "GET /compute/v2.1/servers/cc7f1980-ecea-437f-ac71-0cdb6ec626b9" status: 200 len: 1406 microversion: 2.20 time: 1.242122 Oct 22 21:08:02.362928 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1969/3931] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:08:01 2022] GET /compute/v2.1/servers/cc7f1980-ecea-437f-ac71-0cdb6ec626b9 => generated 1406 bytes in 1261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:08:02.378498 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-fc9714b3-0f3f-442b-a939-1c3907f2935f req-886030e4-e560-405d-8379-d0de97d58549 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1324c851-90ff-47f4-b4e6-8acc8b829c5e", "tag": "1113aabe-4c05-4eae-bc2b-f7bdc1f1d7ce"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:08:02.406114 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-fc9714b3-0f3f-442b-a939-1c3907f2935f req-886030e4-e560-405d-8379-d0de97d58549 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:02.406926 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-fc9714b3-0f3f-442b-a939-1c3907f2935f req-886030e4-e560-405d-8379-d0de97d58549 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:02.407634 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-fc9714b3-0f3f-442b-a939-1c3907f2935f req-886030e4-e560-405d-8379-d0de97d58549 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:02.442273 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-fc9714b3-0f3f-442b-a939-1c3907f2935f req-886030e4-e560-405d-8379-d0de97d58549 service nova] Creating event network-changed:1113aabe-4c05-4eae-bc2b-f7bdc1f1d7ce for instance 1324c851-90ff-47f4-b4e6-8acc8b829c5e on nch2-master-1 Oct 22 21:08:02.457575 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-fc9714b3-0f3f-442b-a939-1c3907f2935f req-886030e4-e560-405d-8379-d0de97d58549 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093019 Oct 22 21:08:02.458513 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1970/3932] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:08:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:08:02.715429 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-5e710acd-84fc-40f5-bcad-3c3678ce0467 req-d07ecc2b-e2a9-4356-a7df-3edce54945c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc7f1980-ecea-437f-ac71-0cdb6ec626b9", "tag": "96502a52-b9c6-4c85-9f2b-97330250e894"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:08:02.735618 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-5e710acd-84fc-40f5-bcad-3c3678ce0467 req-d07ecc2b-e2a9-4356-a7df-3edce54945c0 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:02.736465 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-5e710acd-84fc-40f5-bcad-3c3678ce0467 req-d07ecc2b-e2a9-4356-a7df-3edce54945c0 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:02.737110 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-5e710acd-84fc-40f5-bcad-3c3678ce0467 req-d07ecc2b-e2a9-4356-a7df-3edce54945c0 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:02.764395 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-5e710acd-84fc-40f5-bcad-3c3678ce0467 req-d07ecc2b-e2a9-4356-a7df-3edce54945c0 service nova] Creating event network-changed:96502a52-b9c6-4c85-9f2b-97330250e894 for instance cc7f1980-ecea-437f-ac71-0cdb6ec626b9 on nch1-master-1 Oct 22 21:08:02.773826 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-5e710acd-84fc-40f5-bcad-3c3678ce0467 req-d07ecc2b-e2a9-4356-a7df-3edce54945c0 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062419 Oct 22 21:08:02.775023 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1971/3933] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:08:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 21:08:02.836067 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-e1dd55c1-8477-4e79-9a51-3e4c5138dc9d tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-173441775", "imageRef": "085e4478-6edc-4a69-8e08-f9831713eb65", "flavorRef": "452", "networks": [{"uuid": "08ab6518-0e32-4b2c-895b-b18714e0cf40"}]}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:08:02.905878 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.network.neutron [None req-e1dd55c1-8477-4e79-9a51-3e4c5138dc9d tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] validate_networks() for [('08ab6518-0e32-4b2c-895b-b18714e0cf40', None, None, None, None, None)] {{(pid=138745) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 21:08:03.151222 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-15cd69b8-bb3a-41c1-b1fc-bfb194f036a8 tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98584920f7f948d6995412c700128be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf63c122a5e4685a891957e1b58b9e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:08:03.168306 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-15cd69b8-bb3a-41c1-b1fc-bfb194f036a8 tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] 10.222.0.18 "GET /compute/v2.1/servers/e1523193-327c-4659-8fc4-7329cbffd32f" status: 200 len: 1404 microversion: 2.1 time: 0.999286 Oct 22 21:08:03.168931 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1963/3934] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:08:02 2022] GET /compute/v2.1/servers/e1523193-327c-4659-8fc4-7329cbffd32f => generated 1404 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:08:03.190492 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-3727efaf-6e40-484f-b8a6-4e5501046c75 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:08:03.191144 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-3727efaf-6e40-484f-b8a6-4e5501046c75 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] [instance: 5e25931a-04e4-4e25-8aea-012b106aa2c1] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:08:03.206006 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3727efaf-6e40-484f-b8a6-4e5501046c75 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:03.206649 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3727efaf-6e40-484f-b8a6-4e5501046c75 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:03.206950 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3727efaf-6e40-484f-b8a6-4e5501046c75 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:03.207696 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3727efaf-6e40-484f-b8a6-4e5501046c75 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:03.208157 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3727efaf-6e40-484f-b8a6-4e5501046c75 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:03.208591 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3727efaf-6e40-484f-b8a6-4e5501046c75 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:03.490868 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-3727efaf-6e40-484f-b8a6-4e5501046c75 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcdfeb6c1cda4810b9fa70fdfd9a66c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c774a85b2c41c98486cf91b1253363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:08:03.504419 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-3727efaf-6e40-484f-b8a6-4e5501046c75 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] 10.222.0.18 "GET /compute/v2.1/servers/5e25931a-04e4-4e25-8aea-012b106aa2c1" status: 200 len: 1275 microversion: 2.1 time: 0.319672 Oct 22 21:08:03.505803 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1964/3935] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:08:03 2022] GET /compute/v2.1/servers/5e25931a-04e4-4e25-8aea-012b106aa2c1 => generated 1275 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:08:03.515748 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-dfb29eee-8f43-4536-a52d-a19205a263ab tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:08:03.516771 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-dfb29eee-8f43-4536-a52d-a19205a263ab tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] [instance: 5aa948d4-5141-4a18-8778-e8801a5bb9f5] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:08:03.537450 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-dfb29eee-8f43-4536-a52d-a19205a263ab tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:03.537947 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-dfb29eee-8f43-4536-a52d-a19205a263ab tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:03.538400 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-dfb29eee-8f43-4536-a52d-a19205a263ab tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:03.545959 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-dfb29eee-8f43-4536-a52d-a19205a263ab tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:03.546759 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-dfb29eee-8f43-4536-a52d-a19205a263ab tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:03.547218 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-dfb29eee-8f43-4536-a52d-a19205a263ab tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:03.843367 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-dfb29eee-8f43-4536-a52d-a19205a263ab tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fab7ad5c77a437e9b7ca01c806ddd01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3385ef21cec84f6aa5ffa88bfdfd8646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:08:03.853006 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-dfb29eee-8f43-4536-a52d-a19205a263ab tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fab7ad5c77a437e9b7ca01c806ddd01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3385ef21cec84f6aa5ffa88bfdfd8646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:08:03.862128 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-dfb29eee-8f43-4536-a52d-a19205a263ab tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fab7ad5c77a437e9b7ca01c806ddd01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3385ef21cec84f6aa5ffa88bfdfd8646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:08:03.870082 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-dfb29eee-8f43-4536-a52d-a19205a263ab tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] 10.222.0.18 "GET /compute/v2.1/servers/5aa948d4-5141-4a18-8778-e8801a5bb9f5" status: 200 len: 1408 microversion: 2.54 time: 0.362893 Oct 22 21:08:03.883615 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1965/3936] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:08:03 2022] GET /compute/v2.1/servers/5aa948d4-5141-4a18-8778-e8801a5bb9f5 => generated 1408 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:08:03.883615 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-5847ab9a-582c-43bb-9453-dd1db9b38967 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:08:03.883615 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-5847ab9a-582c-43bb-9453-dd1db9b38967 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] [instance: cc7f1980-ecea-437f-ac71-0cdb6ec626b9] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:08:03.901506 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5847ab9a-582c-43bb-9453-dd1db9b38967 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:03.904906 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5847ab9a-582c-43bb-9453-dd1db9b38967 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:03.904906 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5847ab9a-582c-43bb-9453-dd1db9b38967 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:03.917256 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5847ab9a-582c-43bb-9453-dd1db9b38967 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:03.917882 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5847ab9a-582c-43bb-9453-dd1db9b38967 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:03.919582 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5847ab9a-582c-43bb-9453-dd1db9b38967 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:04.769410 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell0:SELECT=4 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:08:04.897557 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-5847ab9a-582c-43bb-9453-dd1db9b38967 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:08:04.906884 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-5847ab9a-582c-43bb-9453-dd1db9b38967 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:08:04.908511 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-5847ab9a-582c-43bb-9453-dd1db9b38967 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:08:04.909649 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-5847ab9a-582c-43bb-9453-dd1db9b38967 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] 10.222.0.18 "GET /compute/v2.1/servers/cc7f1980-ecea-437f-ac71-0cdb6ec626b9" status: 200 len: 1406 microversion: 2.20 time: 1.037234 Oct 22 21:08:04.910445 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1966/3937] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:08:03 2022] GET /compute/v2.1/servers/cc7f1980-ecea-437f-ac71-0cdb6ec626b9 => generated 1406 bytes in 1039 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:08:04.924575 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-77d122d1-09ee-481b-91f6-a4eb83481487 req-abdf386e-5537-49b3-a8b1-c6200f0369d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1523193-327c-4659-8fc4-7329cbffd32f", "name": "network-vif-plugged", "status": "completed", "tag": "043fc3dc-4aa8-48d0-bf01-30cbd832a23b"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:08:04.936737 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-77d122d1-09ee-481b-91f6-a4eb83481487 req-abdf386e-5537-49b3-a8b1-c6200f0369d7 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:04.937483 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-77d122d1-09ee-481b-91f6-a4eb83481487 req-abdf386e-5537-49b3-a8b1-c6200f0369d7 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:04.938026 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-77d122d1-09ee-481b-91f6-a4eb83481487 req-abdf386e-5537-49b3-a8b1-c6200f0369d7 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:04.951785 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-77d122d1-09ee-481b-91f6-a4eb83481487 req-abdf386e-5537-49b3-a8b1-c6200f0369d7 service nova] Creating event network-vif-plugged:043fc3dc-4aa8-48d0-bf01-30cbd832a23b for instance e1523193-327c-4659-8fc4-7329cbffd32f on nch1-master-1 Oct 22 21:08:04.957881 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-77d122d1-09ee-481b-91f6-a4eb83481487 req-abdf386e-5537-49b3-a8b1-c6200f0369d7 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046059 Oct 22 21:08:04.958621 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1967/3938] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:08:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:08:04.964571 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-2611771a-a2b8-406d-86e1-59f52fc9dd99 tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:08:04.965384 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-2611771a-a2b8-406d-86e1-59f52fc9dd99 tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] [instance: e1523193-327c-4659-8fc4-7329cbffd32f] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:08:04.983572 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2611771a-a2b8-406d-86e1-59f52fc9dd99 tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:04.984517 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2611771a-a2b8-406d-86e1-59f52fc9dd99 tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:04.984757 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2611771a-a2b8-406d-86e1-59f52fc9dd99 tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:04.985820 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2611771a-a2b8-406d-86e1-59f52fc9dd99 tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:04.986630 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2611771a-a2b8-406d-86e1-59f52fc9dd99 tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:04.987185 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2611771a-a2b8-406d-86e1-59f52fc9dd99 tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:05.285914 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-e1dd55c1-8477-4e79-9a51-3e4c5138dc9d tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Flavor limits 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 21:08:05.286468 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-e1dd55c1-8477-4e79-9a51-3e4c5138dc9d tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Image limits 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 21:08:05.287058 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-e1dd55c1-8477-4e79-9a51-3e4c5138dc9d tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Flavor pref 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 21:08:05.287606 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-e1dd55c1-8477-4e79-9a51-3e4c5138dc9d tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Image pref 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 21:08:05.288132 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-e1dd55c1-8477-4e79-9a51-3e4c5138dc9d tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 21:08:05.308444 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e1dd55c1-8477-4e79-9a51-3e4c5138dc9d tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:05.309649 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e1dd55c1-8477-4e79-9a51-3e4c5138dc9d tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:05.310215 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e1dd55c1-8477-4e79-9a51-3e4c5138dc9d tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:05.311082 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e1dd55c1-8477-4e79-9a51-3e4c5138dc9d tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:05.311684 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e1dd55c1-8477-4e79-9a51-3e4c5138dc9d tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:05.312229 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e1dd55c1-8477-4e79-9a51-3e4c5138dc9d tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:05.375287 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-e1dd55c1-8477-4e79-9a51-3e4c5138dc9d tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Getting quotas for project 21349e14fb39496c9996d5af817b7f73. Resources: {'cores', 'instances', 'ram'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 21:08:05.392699 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-e1dd55c1-8477-4e79-9a51-3e4c5138dc9d tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Getting quotas for user 7102f7b674934e19b3d4a001b563d0d5 and project 21349e14fb39496c9996d5af817b7f73. Resources: {'cores', 'instances', 'ram'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 21:08:05.429090 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-e1dd55c1-8477-4e79-9a51-3e4c5138dc9d tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Going to run 1 instances... {{(pid=138745) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 21:08:05.436150 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-e1dd55c1-8477-4e79-9a51-3e4c5138dc9d tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] [instance: df925c6f-4463-44d7-b951-29dbb9c34ac0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='085e4478-6edc-4a69-8e08-f9831713eb65',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138745) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 21:08:05.539296 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-e1dd55c1-8477-4e79-9a51-3e4c5138dc9d tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.712613 Oct 22 21:08:05.542643 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1972/3939] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Oct 22 21:08:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 2717 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 21:08:05.552920 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-457987f5-f2ef-416d-8e0e-160bac2fdaef tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:08:05.555381 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-457987f5-f2ef-416d-8e0e-160bac2fdaef tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] [instance: 5e25931a-04e4-4e25-8aea-012b106aa2c1] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:08:05.568876 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-457987f5-f2ef-416d-8e0e-160bac2fdaef tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:05.572109 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-457987f5-f2ef-416d-8e0e-160bac2fdaef tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:05.572807 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-457987f5-f2ef-416d-8e0e-160bac2fdaef tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:05.576455 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-457987f5-f2ef-416d-8e0e-160bac2fdaef tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:05.577258 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-457987f5-f2ef-416d-8e0e-160bac2fdaef tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:05.579914 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-457987f5-f2ef-416d-8e0e-160bac2fdaef tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:05.772322 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-2611771a-a2b8-406d-86e1-59f52fc9dd99 tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98584920f7f948d6995412c700128be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf63c122a5e4685a891957e1b58b9e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:08:05.779023 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:08:05.782009 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-2611771a-a2b8-406d-86e1-59f52fc9dd99 tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] 10.222.0.18 "GET /compute/v2.1/servers/e1523193-327c-4659-8fc4-7329cbffd32f" status: 200 len: 1404 microversion: 2.1 time: 0.822199 Oct 22 21:08:05.787129 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1968/3940] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:08:04 2022] GET /compute/v2.1/servers/e1523193-327c-4659-8fc4-7329cbffd32f => generated 1404 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:08:05.792216 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-49a670b5-042f-4161-8263-8378e3612fbe req-d5765769-c8bf-4540-9518-6fbddfbf3172 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b769064b-9ef9-47b7-9cfd-5d3b8a24a7a1", "name": "network-vif-deleted", "tag": "ebfc42ff-9ece-4ea7-acbe-047586917889"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:08:05.830550 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-49a670b5-042f-4161-8263-8378e3612fbe req-d5765769-c8bf-4540-9518-6fbddfbf3172 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:05.831494 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-49a670b5-042f-4161-8263-8378e3612fbe req-d5765769-c8bf-4540-9518-6fbddfbf3172 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:05.832164 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-49a670b5-042f-4161-8263-8378e3612fbe req-d5765769-c8bf-4540-9518-6fbddfbf3172 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:05.854188 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-49a670b5-042f-4161-8263-8378e3612fbe req-d5765769-c8bf-4540-9518-6fbddfbf3172 service nova] Creating event network-vif-deleted:ebfc42ff-9ece-4ea7-acbe-047586917889 for instance b769064b-9ef9-47b7-9cfd-5d3b8a24a7a1 on nch2-master-1 Oct 22 21:08:05.869226 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-49a670b5-042f-4161-8263-8378e3612fbe req-d5765769-c8bf-4540-9518-6fbddfbf3172 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080458 Oct 22 21:08:05.871047 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1969/3941] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:08:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:08:05.886797 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-c8c250bd-bb20-43b3-a0d4-325ed60ca884 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:08:05.887938 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-c8c250bd-bb20-43b3-a0d4-325ed60ca884 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] [instance: 5aa948d4-5141-4a18-8778-e8801a5bb9f5] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:08:05.908370 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c8c250bd-bb20-43b3-a0d4-325ed60ca884 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:05.909173 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c8c250bd-bb20-43b3-a0d4-325ed60ca884 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:05.909913 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c8c250bd-bb20-43b3-a0d4-325ed60ca884 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:05.910644 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c8c250bd-bb20-43b3-a0d4-325ed60ca884 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:05.911102 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c8c250bd-bb20-43b3-a0d4-325ed60ca884 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:05.911742 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c8c250bd-bb20-43b3-a0d4-325ed60ca884 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:06.083946 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-c8c250bd-bb20-43b3-a0d4-325ed60ca884 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fab7ad5c77a437e9b7ca01c806ddd01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3385ef21cec84f6aa5ffa88bfdfd8646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:08:06.097586 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-c8c250bd-bb20-43b3-a0d4-325ed60ca884 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fab7ad5c77a437e9b7ca01c806ddd01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3385ef21cec84f6aa5ffa88bfdfd8646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:08:06.102685 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-c8c250bd-bb20-43b3-a0d4-325ed60ca884 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fab7ad5c77a437e9b7ca01c806ddd01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3385ef21cec84f6aa5ffa88bfdfd8646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:08:06.103649 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-457987f5-f2ef-416d-8e0e-160bac2fdaef tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcdfeb6c1cda4810b9fa70fdfd9a66c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c774a85b2c41c98486cf91b1253363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:08:06.104786 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-c8c250bd-bb20-43b3-a0d4-325ed60ca884 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] 10.222.0.18 "GET /compute/v2.1/servers/5aa948d4-5141-4a18-8778-e8801a5bb9f5" status: 200 len: 1408 microversion: 2.54 time: 0.232212 Oct 22 21:08:06.105721 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1970/3942] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:08:05 2022] GET /compute/v2.1/servers/5aa948d4-5141-4a18-8778-e8801a5bb9f5 => generated 1408 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:08:06.110869 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-1e0940f4-99d9-434b-9eb3-d1893ccfd32c tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:08:06.111784 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-1e0940f4-99d9-434b-9eb3-d1893ccfd32c tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] [instance: df925c6f-4463-44d7-b951-29dbb9c34ac0] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:08:06.144412 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-457987f5-f2ef-416d-8e0e-160bac2fdaef tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] 10.222.0.18 "GET /compute/v2.1/servers/5e25931a-04e4-4e25-8aea-012b106aa2c1" status: 200 len: 1317 microversion: 2.1 time: 0.600217 Oct 22 21:08:06.151670 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1973/3943] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:08:05 2022] GET /compute/v2.1/servers/5e25931a-04e4-4e25-8aea-012b106aa2c1 => generated 1317 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:08:06.158771 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-8fc877ed-4a54-4bec-b7fe-e40100f2067d tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:08:06.159438 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-8fc877ed-4a54-4bec-b7fe-e40100f2067d tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] [instance: cc7f1980-ecea-437f-ac71-0cdb6ec626b9] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:08:06.177411 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8fc877ed-4a54-4bec-b7fe-e40100f2067d tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:06.177659 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-1e0940f4-99d9-434b-9eb3-d1893ccfd32c tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7102f7b674934e19b3d4a001b563d0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21349e14fb39496c9996d5af817b7f73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:08:06.177936 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8fc877ed-4a54-4bec-b7fe-e40100f2067d tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:06.178395 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8fc877ed-4a54-4bec-b7fe-e40100f2067d tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:06.179646 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8fc877ed-4a54-4bec-b7fe-e40100f2067d tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:06.182823 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8fc877ed-4a54-4bec-b7fe-e40100f2067d tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:06.184062 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8fc877ed-4a54-4bec-b7fe-e40100f2067d tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:06.189479 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-1e0940f4-99d9-434b-9eb3-d1893ccfd32c tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] 10.222.0.18 "GET /compute/v2.1/servers/df925c6f-4463-44d7-b951-29dbb9c34ac0" status: 200 len: 1218 microversion: 2.1 time: 0.082174 Oct 22 21:08:06.190220 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1971/3944] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:08:06 2022] GET /compute/v2.1/servers/df925c6f-4463-44d7-b951-29dbb9c34ac0 => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:08:06.417362 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-8fc877ed-4a54-4bec-b7fe-e40100f2067d tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:08:06.433224 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-8fc877ed-4a54-4bec-b7fe-e40100f2067d tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:08:06.442393 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-8fc877ed-4a54-4bec-b7fe-e40100f2067d tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:08:06.443750 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-8fc877ed-4a54-4bec-b7fe-e40100f2067d tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] 10.222.0.18 "GET /compute/v2.1/servers/cc7f1980-ecea-437f-ac71-0cdb6ec626b9" status: 200 len: 1406 microversion: 2.20 time: 0.290946 Oct 22 21:08:06.447948 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1974/3945] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:08:06 2022] GET /compute/v2.1/servers/cc7f1980-ecea-437f-ac71-0cdb6ec626b9 => generated 1406 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:08:06.816229 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-bf0b5fe5-fd63-4f2a-8b0b-9e89a37d5208 tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:08:06.817029 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-bf0b5fe5-fd63-4f2a-8b0b-9e89a37d5208 tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] [instance: e1523193-327c-4659-8fc4-7329cbffd32f] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:08:06.825688 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bf0b5fe5-fd63-4f2a-8b0b-9e89a37d5208 tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:06.826656 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bf0b5fe5-fd63-4f2a-8b0b-9e89a37d5208 tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:06.827732 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bf0b5fe5-fd63-4f2a-8b0b-9e89a37d5208 tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:06.828828 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bf0b5fe5-fd63-4f2a-8b0b-9e89a37d5208 tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:06.829713 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bf0b5fe5-fd63-4f2a-8b0b-9e89a37d5208 tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:06.830411 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bf0b5fe5-fd63-4f2a-8b0b-9e89a37d5208 tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:07.058548 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-bf0b5fe5-fd63-4f2a-8b0b-9e89a37d5208 tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98584920f7f948d6995412c700128be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf63c122a5e4685a891957e1b58b9e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:08:07.068062 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-bf0b5fe5-fd63-4f2a-8b0b-9e89a37d5208 tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] 10.222.0.18 "GET /compute/v2.1/servers/e1523193-327c-4659-8fc4-7329cbffd32f" status: 200 len: 1404 microversion: 2.1 time: 0.258603 Oct 22 21:08:07.068796 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1972/3946] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:08:06 2022] GET /compute/v2.1/servers/e1523193-327c-4659-8fc4-7329cbffd32f => generated 1404 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:08:07.133829 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-fe2d3fb0-bc4a-4d23-817f-96f6db032b20 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:08:07.134486 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-fe2d3fb0-bc4a-4d23-817f-96f6db032b20 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] [instance: 5aa948d4-5141-4a18-8778-e8801a5bb9f5] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:08:07.141884 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fe2d3fb0-bc4a-4d23-817f-96f6db032b20 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:07.142771 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fe2d3fb0-bc4a-4d23-817f-96f6db032b20 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:07.143465 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fe2d3fb0-bc4a-4d23-817f-96f6db032b20 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:07.144279 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fe2d3fb0-bc4a-4d23-817f-96f6db032b20 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:07.144875 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fe2d3fb0-bc4a-4d23-817f-96f6db032b20 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:07.145182 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fe2d3fb0-bc4a-4d23-817f-96f6db032b20 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:07.171925 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:08:07.184717 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-b32f798d-db3c-462b-bdc4-b6ba8b4a62bd tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:08:07.185538 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-b32f798d-db3c-462b-bdc4-b6ba8b4a62bd tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] [instance: 5e25931a-04e4-4e25-8aea-012b106aa2c1] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:08:07.201766 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b32f798d-db3c-462b-bdc4-b6ba8b4a62bd tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:07.203228 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b32f798d-db3c-462b-bdc4-b6ba8b4a62bd tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:07.207904 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b32f798d-db3c-462b-bdc4-b6ba8b4a62bd tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:07.209302 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b32f798d-db3c-462b-bdc4-b6ba8b4a62bd tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:07.209982 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b32f798d-db3c-462b-bdc4-b6ba8b4a62bd tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:07.210427 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b32f798d-db3c-462b-bdc4-b6ba8b4a62bd tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:07.240574 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-fe2d3fb0-bc4a-4d23-817f-96f6db032b20 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fab7ad5c77a437e9b7ca01c806ddd01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3385ef21cec84f6aa5ffa88bfdfd8646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:08:07.254111 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-fe2d3fb0-bc4a-4d23-817f-96f6db032b20 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fab7ad5c77a437e9b7ca01c806ddd01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3385ef21cec84f6aa5ffa88bfdfd8646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:08:07.257095 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-fe2d3fb0-bc4a-4d23-817f-96f6db032b20 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fab7ad5c77a437e9b7ca01c806ddd01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3385ef21cec84f6aa5ffa88bfdfd8646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:08:07.258336 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-fe2d3fb0-bc4a-4d23-817f-96f6db032b20 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] 10.222.0.18 "GET /compute/v2.1/servers/5aa948d4-5141-4a18-8778-e8801a5bb9f5" status: 200 len: 1408 microversion: 2.54 time: 0.128454 Oct 22 21:08:07.259181 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1975/3947] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:08:07 2022] GET /compute/v2.1/servers/5aa948d4-5141-4a18-8778-e8801a5bb9f5 => generated 1408 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:08:07.264581 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-88e55660-566f-4d51-94dc-50637069d08b tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:08:07.265778 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-88e55660-566f-4d51-94dc-50637069d08b tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] [instance: df925c6f-4463-44d7-b951-29dbb9c34ac0] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:08:07.268575 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:08:07.274881 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-88e55660-566f-4d51-94dc-50637069d08b tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:07.275832 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-88e55660-566f-4d51-94dc-50637069d08b tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:07.276534 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-88e55660-566f-4d51-94dc-50637069d08b tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:07.277479 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-88e55660-566f-4d51-94dc-50637069d08b tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:07.278169 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-88e55660-566f-4d51-94dc-50637069d08b tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:07.278818 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-88e55660-566f-4d51-94dc-50637069d08b tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:07.442415 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-88e55660-566f-4d51-94dc-50637069d08b tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7102f7b674934e19b3d4a001b563d0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21349e14fb39496c9996d5af817b7f73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:08:07.453372 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-88e55660-566f-4d51-94dc-50637069d08b tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] 10.222.0.18 "GET /compute/v2.1/servers/df925c6f-4463-44d7-b951-29dbb9c34ac0" status: 200 len: 1278 microversion: 2.1 time: 0.192716 Oct 22 21:08:07.464046 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1976/3948] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:08:07 2022] GET /compute/v2.1/servers/df925c6f-4463-44d7-b951-29dbb9c34ac0 => generated 1278 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:08:07.478166 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-37f61028-0194-4610-8a65-f60bd2f9761b tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:08:07.479554 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-37f61028-0194-4610-8a65-f60bd2f9761b tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] [instance: cc7f1980-ecea-437f-ac71-0cdb6ec626b9] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:08:07.487571 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-37f61028-0194-4610-8a65-f60bd2f9761b tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:07.488434 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-37f61028-0194-4610-8a65-f60bd2f9761b tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:07.489101 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-37f61028-0194-4610-8a65-f60bd2f9761b tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:07.490048 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-37f61028-0194-4610-8a65-f60bd2f9761b tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:07.490760 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-37f61028-0194-4610-8a65-f60bd2f9761b tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:07.491452 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-37f61028-0194-4610-8a65-f60bd2f9761b tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:07.570742 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-b32f798d-db3c-462b-bdc4-b6ba8b4a62bd tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcdfeb6c1cda4810b9fa70fdfd9a66c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c774a85b2c41c98486cf91b1253363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:08:07.580870 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-b32f798d-db3c-462b-bdc4-b6ba8b4a62bd tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] 10.222.0.18 "GET /compute/v2.1/servers/5e25931a-04e4-4e25-8aea-012b106aa2c1" status: 200 len: 1317 microversion: 2.1 time: 0.410172 Oct 22 21:08:07.581833 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1973/3949] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:08:07 2022] GET /compute/v2.1/servers/5e25931a-04e4-4e25-8aea-012b106aa2c1 => generated 1317 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:08:07.776895 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-37f61028-0194-4610-8a65-f60bd2f9761b tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:08:07.788579 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-37f61028-0194-4610-8a65-f60bd2f9761b tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:08:07.790332 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-37f61028-0194-4610-8a65-f60bd2f9761b tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:08:07.791680 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-37f61028-0194-4610-8a65-f60bd2f9761b tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] 10.222.0.18 "GET /compute/v2.1/servers/cc7f1980-ecea-437f-ac71-0cdb6ec626b9" status: 200 len: 1406 microversion: 2.20 time: 0.318333 Oct 22 21:08:07.792748 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1977/3950] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:08:07 2022] GET /compute/v2.1/servers/cc7f1980-ecea-437f-ac71-0cdb6ec626b9 => generated 1406 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:08:07.912294 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-c0371191-90ec-46c6-ac62-59db616a1770 req-c1052187-6140-41cb-9e34-aa9af574abb8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad302c49-addb-464c-a15f-fa01577f90c4", "tag": "f6f36de6-f297-4ad8-a5a7-45c041622a1f"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:08:07.928841 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-c0371191-90ec-46c6-ac62-59db616a1770 req-c1052187-6140-41cb-9e34-aa9af574abb8 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:07.929694 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-c0371191-90ec-46c6-ac62-59db616a1770 req-c1052187-6140-41cb-9e34-aa9af574abb8 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:07.931864 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-c0371191-90ec-46c6-ac62-59db616a1770 req-c1052187-6140-41cb-9e34-aa9af574abb8 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:07.949354 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-c0371191-90ec-46c6-ac62-59db616a1770 req-c1052187-6140-41cb-9e34-aa9af574abb8 service nova] Creating event network-changed:f6f36de6-f297-4ad8-a5a7-45c041622a1f for instance ad302c49-addb-464c-a15f-fa01577f90c4 on nch1-master-1 Oct 22 21:08:07.955261 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-c0371191-90ec-46c6-ac62-59db616a1770 req-c1052187-6140-41cb-9e34-aa9af574abb8 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046680 Oct 22 21:08:07.956239 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1974/3951] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:08:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 21:08:08.095092 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-bf256502-fb71-4d07-bd47-dface180460b tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:08:08.097352 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-bf256502-fb71-4d07-bd47-dface180460b tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] [instance: e1523193-327c-4659-8fc4-7329cbffd32f] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:08:08.109835 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bf256502-fb71-4d07-bd47-dface180460b tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:08.112673 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bf256502-fb71-4d07-bd47-dface180460b tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:08.113440 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bf256502-fb71-4d07-bd47-dface180460b tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:08.115247 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bf256502-fb71-4d07-bd47-dface180460b tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:08.116720 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bf256502-fb71-4d07-bd47-dface180460b tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:08.118402 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bf256502-fb71-4d07-bd47-dface180460b tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:08.299827 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-bb1ea709-7d28-46ee-ad23-0549dd1d763e tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:08:08.301494 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-bb1ea709-7d28-46ee-ad23-0549dd1d763e tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] [instance: 5aa948d4-5141-4a18-8778-e8801a5bb9f5] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:08:08.309847 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bb1ea709-7d28-46ee-ad23-0549dd1d763e tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:08.310342 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bb1ea709-7d28-46ee-ad23-0549dd1d763e tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:08.310920 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bb1ea709-7d28-46ee-ad23-0549dd1d763e tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:08.312036 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bb1ea709-7d28-46ee-ad23-0549dd1d763e tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:08.312619 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bb1ea709-7d28-46ee-ad23-0549dd1d763e tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:08.313408 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bb1ea709-7d28-46ee-ad23-0549dd1d763e tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:08.565530 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-bb1ea709-7d28-46ee-ad23-0549dd1d763e tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fab7ad5c77a437e9b7ca01c806ddd01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3385ef21cec84f6aa5ffa88bfdfd8646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:08:08.577331 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-bb1ea709-7d28-46ee-ad23-0549dd1d763e tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fab7ad5c77a437e9b7ca01c806ddd01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3385ef21cec84f6aa5ffa88bfdfd8646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:08:08.580191 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-bb1ea709-7d28-46ee-ad23-0549dd1d763e tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fab7ad5c77a437e9b7ca01c806ddd01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3385ef21cec84f6aa5ffa88bfdfd8646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:08:08.582266 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-bb1ea709-7d28-46ee-ad23-0549dd1d763e tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] 10.222.0.18 "GET /compute/v2.1/servers/5aa948d4-5141-4a18-8778-e8801a5bb9f5" status: 200 len: 1408 microversion: 2.54 time: 0.295292 Oct 22 21:08:08.595397 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1975/3952] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:08:08 2022] GET /compute/v2.1/servers/5aa948d4-5141-4a18-8778-e8801a5bb9f5 => generated 1408 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:08:08.595397 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-83539ec4-912a-4924-8630-e24e592cd322 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:08:08.595397 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-83539ec4-912a-4924-8630-e24e592cd322 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] [instance: df925c6f-4463-44d7-b951-29dbb9c34ac0] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:08:08.599213 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-83539ec4-912a-4924-8630-e24e592cd322 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:08.601295 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-83539ec4-912a-4924-8630-e24e592cd322 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:08.602004 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-83539ec4-912a-4924-8630-e24e592cd322 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:08.603023 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-83539ec4-912a-4924-8630-e24e592cd322 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:08.604608 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-83539ec4-912a-4924-8630-e24e592cd322 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:08.605356 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-83539ec4-912a-4924-8630-e24e592cd322 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:08.719393 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-bf256502-fb71-4d07-bd47-dface180460b tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98584920f7f948d6995412c700128be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf63c122a5e4685a891957e1b58b9e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:08:08.730332 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-bf256502-fb71-4d07-bd47-dface180460b tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] 10.222.0.18 "GET /compute/v2.1/servers/e1523193-327c-4659-8fc4-7329cbffd32f" status: 200 len: 1404 microversion: 2.1 time: 0.641423 Oct 22 21:08:08.731018 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1978/3953] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:08:08 2022] GET /compute/v2.1/servers/e1523193-327c-4659-8fc4-7329cbffd32f => generated 1404 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:08:08.737139 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-8e5ca99c-98de-4de3-a334-1c2154a39f1b tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:08:08.738453 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-8e5ca99c-98de-4de3-a334-1c2154a39f1b tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] [instance: 5e25931a-04e4-4e25-8aea-012b106aa2c1] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:08:08.746718 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8e5ca99c-98de-4de3-a334-1c2154a39f1b tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:08.747227 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8e5ca99c-98de-4de3-a334-1c2154a39f1b tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:08.747943 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8e5ca99c-98de-4de3-a334-1c2154a39f1b tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:08.748760 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8e5ca99c-98de-4de3-a334-1c2154a39f1b tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:08.749231 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8e5ca99c-98de-4de3-a334-1c2154a39f1b tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:08.749671 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8e5ca99c-98de-4de3-a334-1c2154a39f1b tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:09.135117 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-83539ec4-912a-4924-8630-e24e592cd322 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7102f7b674934e19b3d4a001b563d0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21349e14fb39496c9996d5af817b7f73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:08:09.144466 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-83539ec4-912a-4924-8630-e24e592cd322 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] 10.222.0.18 "GET /compute/v2.1/servers/df925c6f-4463-44d7-b951-29dbb9c34ac0" status: 200 len: 1276 microversion: 2.1 time: 0.558780 Oct 22 21:08:09.159386 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1976/3954] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:08:08 2022] GET /compute/v2.1/servers/df925c6f-4463-44d7-b951-29dbb9c34ac0 => generated 1276 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:08:09.159386 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-fcebe9e8-62f3-491e-83fc-852e05835101 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:08:09.159386 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-fcebe9e8-62f3-491e-83fc-852e05835101 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] [instance: cc7f1980-ecea-437f-ac71-0cdb6ec626b9] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:08:09.170366 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fcebe9e8-62f3-491e-83fc-852e05835101 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:09.170872 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fcebe9e8-62f3-491e-83fc-852e05835101 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:09.171320 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fcebe9e8-62f3-491e-83fc-852e05835101 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:09.172074 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fcebe9e8-62f3-491e-83fc-852e05835101 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:09.173373 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fcebe9e8-62f3-491e-83fc-852e05835101 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:09.174252 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fcebe9e8-62f3-491e-83fc-852e05835101 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:09.568747 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-8e5ca99c-98de-4de3-a334-1c2154a39f1b tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcdfeb6c1cda4810b9fa70fdfd9a66c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c774a85b2c41c98486cf91b1253363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:08:09.583252 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-8e5ca99c-98de-4de3-a334-1c2154a39f1b tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] 10.222.0.18 "GET /compute/v2.1/servers/5e25931a-04e4-4e25-8aea-012b106aa2c1" status: 200 len: 1317 microversion: 2.1 time: 0.850392 Oct 22 21:08:09.584601 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1979/3955] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:08:08 2022] GET /compute/v2.1/servers/5e25931a-04e4-4e25-8aea-012b106aa2c1 => generated 1317 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:08:09.627114 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-038dd89a-cb6f-4070-a2c6-53cdb285ddd3 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:08:09.628228 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-038dd89a-cb6f-4070-a2c6-53cdb285ddd3 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] [instance: 5aa948d4-5141-4a18-8778-e8801a5bb9f5] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:08:09.638780 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-fcebe9e8-62f3-491e-83fc-852e05835101 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:08:09.662087 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-fcebe9e8-62f3-491e-83fc-852e05835101 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:08:09.665840 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-fcebe9e8-62f3-491e-83fc-852e05835101 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:08:09.667174 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-038dd89a-cb6f-4070-a2c6-53cdb285ddd3 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:09.668997 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-038dd89a-cb6f-4070-a2c6-53cdb285ddd3 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:09.670155 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-038dd89a-cb6f-4070-a2c6-53cdb285ddd3 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:09.670834 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-fcebe9e8-62f3-491e-83fc-852e05835101 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] 10.222.0.18 "GET /compute/v2.1/servers/cc7f1980-ecea-437f-ac71-0cdb6ec626b9" status: 200 len: 1406 microversion: 2.20 time: 0.523427 Oct 22 21:08:09.671560 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1977/3956] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:08:09 2022] GET /compute/v2.1/servers/cc7f1980-ecea-437f-ac71-0cdb6ec626b9 => generated 1406 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:08:09.672562 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-038dd89a-cb6f-4070-a2c6-53cdb285ddd3 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:09.673517 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-038dd89a-cb6f-4070-a2c6-53cdb285ddd3 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:09.674603 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-038dd89a-cb6f-4070-a2c6-53cdb285ddd3 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:09.759203 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-774c336b-0b03-446c-bf66-40160186b018 tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:08:09.760249 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-774c336b-0b03-446c-bf66-40160186b018 tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] [instance: e1523193-327c-4659-8fc4-7329cbffd32f] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:08:09.769293 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:08:09.773057 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-774c336b-0b03-446c-bf66-40160186b018 tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:09.773682 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-774c336b-0b03-446c-bf66-40160186b018 tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:09.774278 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-774c336b-0b03-446c-bf66-40160186b018 tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:09.775228 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-774c336b-0b03-446c-bf66-40160186b018 tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:09.775950 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-774c336b-0b03-446c-bf66-40160186b018 tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:09.776588 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-774c336b-0b03-446c-bf66-40160186b018 tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:09.846932 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-038dd89a-cb6f-4070-a2c6-53cdb285ddd3 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fab7ad5c77a437e9b7ca01c806ddd01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3385ef21cec84f6aa5ffa88bfdfd8646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:08:09.858637 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-038dd89a-cb6f-4070-a2c6-53cdb285ddd3 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fab7ad5c77a437e9b7ca01c806ddd01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3385ef21cec84f6aa5ffa88bfdfd8646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:08:09.860290 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-038dd89a-cb6f-4070-a2c6-53cdb285ddd3 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fab7ad5c77a437e9b7ca01c806ddd01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3385ef21cec84f6aa5ffa88bfdfd8646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:08:09.861644 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-038dd89a-cb6f-4070-a2c6-53cdb285ddd3 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] 10.222.0.18 "GET /compute/v2.1/servers/5aa948d4-5141-4a18-8778-e8801a5bb9f5" status: 200 len: 1408 microversion: 2.54 time: 0.244163 Oct 22 21:08:09.862286 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1980/3957] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:08:09 2022] GET /compute/v2.1/servers/5aa948d4-5141-4a18-8778-e8801a5bb9f5 => generated 1408 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:08:10.137665 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-774c336b-0b03-446c-bf66-40160186b018 tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98584920f7f948d6995412c700128be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf63c122a5e4685a891957e1b58b9e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:08:10.146807 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-774c336b-0b03-446c-bf66-40160186b018 tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] 10.222.0.18 "GET /compute/v2.1/servers/e1523193-327c-4659-8fc4-7329cbffd32f" status: 200 len: 1591 microversion: 2.1 time: 0.393900 Oct 22 21:08:10.163395 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1978/3958] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:08:09 2022] GET /compute/v2.1/servers/e1523193-327c-4659-8fc4-7329cbffd32f => generated 1591 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:08:10.170748 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-ac2038f3-405a-4313-9a7b-6a827c19c308 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:08:10.171639 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-ac2038f3-405a-4313-9a7b-6a827c19c308 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] [instance: df925c6f-4463-44d7-b951-29dbb9c34ac0] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:08:10.185421 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ac2038f3-405a-4313-9a7b-6a827c19c308 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:10.186294 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ac2038f3-405a-4313-9a7b-6a827c19c308 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:10.186752 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ac2038f3-405a-4313-9a7b-6a827c19c308 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:10.187420 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-2b651c29-e9af-4ee1-ab01-ef55423b715b tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:08:10.188340 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ac2038f3-405a-4313-9a7b-6a827c19c308 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:10.189311 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-2b651c29-e9af-4ee1-ab01-ef55423b715b tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] [instance: e1523193-327c-4659-8fc4-7329cbffd32f] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:08:10.190310 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ac2038f3-405a-4313-9a7b-6a827c19c308 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:10.192834 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ac2038f3-405a-4313-9a7b-6a827c19c308 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:10.203123 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2b651c29-e9af-4ee1-ab01-ef55423b715b tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:10.204015 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2b651c29-e9af-4ee1-ab01-ef55423b715b tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:10.211482 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2b651c29-e9af-4ee1-ab01-ef55423b715b tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:10.212616 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2b651c29-e9af-4ee1-ab01-ef55423b715b tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:10.213443 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2b651c29-e9af-4ee1-ab01-ef55423b715b tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:10.214101 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2b651c29-e9af-4ee1-ab01-ef55423b715b tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:10.418407 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-2b651c29-e9af-4ee1-ab01-ef55423b715b tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] 10.222.0.18 "GET /compute/v2.1/servers/e1523193-327c-4659-8fc4-7329cbffd32f/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.239717 Oct 22 21:08:10.419115 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1979/3959] 10.222.0.18 () {58 vars in 1275 bytes} [Sat Oct 22 21:08:10 2022] GET /compute/v2.1/servers/e1523193-327c-4659-8fc4-7329cbffd32f/os-interface => generated 285 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:08:10.589010 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-ac2038f3-405a-4313-9a7b-6a827c19c308 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7102f7b674934e19b3d4a001b563d0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21349e14fb39496c9996d5af817b7f73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:08:10.609033 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-bf16ccf7-f089-4102-9388-f5998dca4925 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:08:10.609692 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-bf16ccf7-f089-4102-9388-f5998dca4925 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] [instance: 5e25931a-04e4-4e25-8aea-012b106aa2c1] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:08:10.625165 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-ac2038f3-405a-4313-9a7b-6a827c19c308 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] 10.222.0.18 "GET /compute/v2.1/servers/df925c6f-4463-44d7-b951-29dbb9c34ac0" status: 200 len: 1318 microversion: 2.1 time: 0.452767 Oct 22 21:08:10.629509 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bf16ccf7-f089-4102-9388-f5998dca4925 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:10.630547 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bf16ccf7-f089-4102-9388-f5998dca4925 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:10.631135 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bf16ccf7-f089-4102-9388-f5998dca4925 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:10.632203 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bf16ccf7-f089-4102-9388-f5998dca4925 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:10.632806 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bf16ccf7-f089-4102-9388-f5998dca4925 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:10.633379 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bf16ccf7-f089-4102-9388-f5998dca4925 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:10.657057 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1981/3960] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:08:10 2022] GET /compute/v2.1/servers/df925c6f-4463-44d7-b951-29dbb9c34ac0 => generated 1318 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:08:10.682729 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-317f80de-85d1-4bf5-acda-6b5006ae3259 req-89118723-d5b0-4f0a-b2f2-1b87fb1ea86d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e25931a-04e4-4e25-8aea-012b106aa2c1", "tag": "3634a4c1-9da8-4a1f-bee5-9e74122917b3"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:08:10.704056 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-317f80de-85d1-4bf5-acda-6b5006ae3259 req-89118723-d5b0-4f0a-b2f2-1b87fb1ea86d service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:10.705532 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-317f80de-85d1-4bf5-acda-6b5006ae3259 req-89118723-d5b0-4f0a-b2f2-1b87fb1ea86d service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:10.706201 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-317f80de-85d1-4bf5-acda-6b5006ae3259 req-89118723-d5b0-4f0a-b2f2-1b87fb1ea86d service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:10.721613 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-317f80de-85d1-4bf5-acda-6b5006ae3259 req-89118723-d5b0-4f0a-b2f2-1b87fb1ea86d service nova] Creating event network-changed:3634a4c1-9da8-4a1f-bee5-9e74122917b3 for instance 5e25931a-04e4-4e25-8aea-012b106aa2c1 on nch1-master-1 Oct 22 21:08:10.727519 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-317f80de-85d1-4bf5-acda-6b5006ae3259 req-89118723-d5b0-4f0a-b2f2-1b87fb1ea86d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052154 Oct 22 21:08:10.728683 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1982/3961] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:08:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 21:08:10.737667 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-842d74e8-c184-4b7f-853f-6a24fb241034 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:08:10.738759 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-842d74e8-c184-4b7f-853f-6a24fb241034 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] [instance: cc7f1980-ecea-437f-ac71-0cdb6ec626b9] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:08:10.746676 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-842d74e8-c184-4b7f-853f-6a24fb241034 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:10.747409 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-842d74e8-c184-4b7f-853f-6a24fb241034 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:10.748043 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-842d74e8-c184-4b7f-853f-6a24fb241034 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:10.748950 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-842d74e8-c184-4b7f-853f-6a24fb241034 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:10.749734 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-842d74e8-c184-4b7f-853f-6a24fb241034 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:10.750514 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-842d74e8-c184-4b7f-853f-6a24fb241034 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:11.132573 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-bf16ccf7-f089-4102-9388-f5998dca4925 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcdfeb6c1cda4810b9fa70fdfd9a66c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c774a85b2c41c98486cf91b1253363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:08:11.146083 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-842d74e8-c184-4b7f-853f-6a24fb241034 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:08:11.159081 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-842d74e8-c184-4b7f-853f-6a24fb241034 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:08:11.166171 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-bf16ccf7-f089-4102-9388-f5998dca4925 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] 10.222.0.18 "GET /compute/v2.1/servers/5e25931a-04e4-4e25-8aea-012b106aa2c1" status: 200 len: 1317 microversion: 2.1 time: 0.562205 Oct 22 21:08:11.167789 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1980/3962] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:08:10 2022] GET /compute/v2.1/servers/5e25931a-04e4-4e25-8aea-012b106aa2c1 => generated 1317 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:08:11.168352 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-842d74e8-c184-4b7f-853f-6a24fb241034 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:08:11.169700 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-842d74e8-c184-4b7f-853f-6a24fb241034 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] 10.222.0.18 "GET /compute/v2.1/servers/cc7f1980-ecea-437f-ac71-0cdb6ec626b9" status: 200 len: 1406 microversion: 2.20 time: 0.439047 Oct 22 21:08:11.176867 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-f2e7c05e-d3dd-4e67-8237-2c5039ac7705 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:08:11.177785 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-f2e7c05e-d3dd-4e67-8237-2c5039ac7705 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] [instance: 5aa948d4-5141-4a18-8778-e8801a5bb9f5] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:08:11.186251 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f2e7c05e-d3dd-4e67-8237-2c5039ac7705 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:11.187569 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f2e7c05e-d3dd-4e67-8237-2c5039ac7705 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:11.188379 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f2e7c05e-d3dd-4e67-8237-2c5039ac7705 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:11.189703 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f2e7c05e-d3dd-4e67-8237-2c5039ac7705 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:11.189861 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1983/3963] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:08:10 2022] GET /compute/v2.1/servers/cc7f1980-ecea-437f-ac71-0cdb6ec626b9 => generated 1406 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:08:11.190657 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f2e7c05e-d3dd-4e67-8237-2c5039ac7705 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:11.191454 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f2e7c05e-d3dd-4e67-8237-2c5039ac7705 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:11.309803 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-f2e7c05e-d3dd-4e67-8237-2c5039ac7705 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fab7ad5c77a437e9b7ca01c806ddd01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3385ef21cec84f6aa5ffa88bfdfd8646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:08:11.322811 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-f2e7c05e-d3dd-4e67-8237-2c5039ac7705 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fab7ad5c77a437e9b7ca01c806ddd01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3385ef21cec84f6aa5ffa88bfdfd8646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:08:11.325347 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-f2e7c05e-d3dd-4e67-8237-2c5039ac7705 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fab7ad5c77a437e9b7ca01c806ddd01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3385ef21cec84f6aa5ffa88bfdfd8646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:08:11.326568 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-f2e7c05e-d3dd-4e67-8237-2c5039ac7705 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] 10.222.0.18 "GET /compute/v2.1/servers/5aa948d4-5141-4a18-8778-e8801a5bb9f5" status: 200 len: 1408 microversion: 2.54 time: 0.156122 Oct 22 21:08:11.327323 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1981/3964] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:08:11 2022] GET /compute/v2.1/servers/5aa948d4-5141-4a18-8778-e8801a5bb9f5 => generated 1408 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:08:11.539380 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-b225119a-2ebb-4665-9063-c9263cea8e2c req-25eb2778-5502-4387-8de5-101e9425b93c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc7f1980-ecea-437f-ac71-0cdb6ec626b9", "name": "network-vif-plugged", "status": "completed", "tag": "96502a52-b9c6-4c85-9f2b-97330250e894"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:08:11.550199 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-b225119a-2ebb-4665-9063-c9263cea8e2c req-25eb2778-5502-4387-8de5-101e9425b93c service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:11.550863 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-b225119a-2ebb-4665-9063-c9263cea8e2c req-25eb2778-5502-4387-8de5-101e9425b93c service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:11.551377 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-b225119a-2ebb-4665-9063-c9263cea8e2c req-25eb2778-5502-4387-8de5-101e9425b93c service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:11.572834 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-b225119a-2ebb-4665-9063-c9263cea8e2c req-25eb2778-5502-4387-8de5-101e9425b93c service nova] Creating event network-vif-plugged:96502a52-b9c6-4c85-9f2b-97330250e894 for instance cc7f1980-ecea-437f-ac71-0cdb6ec626b9 on nch1-master-1 Oct 22 21:08:11.592987 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-b225119a-2ebb-4665-9063-c9263cea8e2c req-25eb2778-5502-4387-8de5-101e9425b93c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058151 Oct 22 21:08:11.599984 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1984/3965] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:08:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 21:08:11.657841 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-db1bea26-4e7f-492d-a322-514287d71cdd tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:08:11.658607 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-db1bea26-4e7f-492d-a322-514287d71cdd tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] [instance: df925c6f-4463-44d7-b951-29dbb9c34ac0] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:08:11.669622 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-db1bea26-4e7f-492d-a322-514287d71cdd tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:11.671633 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-db1bea26-4e7f-492d-a322-514287d71cdd tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:11.672898 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-db1bea26-4e7f-492d-a322-514287d71cdd tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:11.673833 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-db1bea26-4e7f-492d-a322-514287d71cdd tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:11.674805 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-db1bea26-4e7f-492d-a322-514287d71cdd tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:11.675484 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-db1bea26-4e7f-492d-a322-514287d71cdd tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:11.968148 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-db1bea26-4e7f-492d-a322-514287d71cdd tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7102f7b674934e19b3d4a001b563d0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21349e14fb39496c9996d5af817b7f73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:08:11.977873 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-db1bea26-4e7f-492d-a322-514287d71cdd tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] 10.222.0.18 "GET /compute/v2.1/servers/df925c6f-4463-44d7-b951-29dbb9c34ac0" status: 200 len: 1318 microversion: 2.1 time: 0.324311 Oct 22 21:08:11.979595 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1982/3966] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:08:11 2022] GET /compute/v2.1/servers/df925c6f-4463-44d7-b951-29dbb9c34ac0 => generated 1318 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:08:12.190621 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-50244570-378b-49d8-8c0a-d1f64d02d147 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:08:12.191542 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-50244570-378b-49d8-8c0a-d1f64d02d147 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] [instance: 5e25931a-04e4-4e25-8aea-012b106aa2c1] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:08:12.198399 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-50244570-378b-49d8-8c0a-d1f64d02d147 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:12.198960 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-50244570-378b-49d8-8c0a-d1f64d02d147 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:12.199652 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-50244570-378b-49d8-8c0a-d1f64d02d147 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:12.200319 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-bcaa19b0-75ca-4723-b021-0c7637044ce3 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:08:12.201422 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-bcaa19b0-75ca-4723-b021-0c7637044ce3 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] [instance: cc7f1980-ecea-437f-ac71-0cdb6ec626b9] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:08:12.201546 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-50244570-378b-49d8-8c0a-d1f64d02d147 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:12.202435 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-50244570-378b-49d8-8c0a-d1f64d02d147 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:12.202872 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-50244570-378b-49d8-8c0a-d1f64d02d147 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:12.208595 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bcaa19b0-75ca-4723-b021-0c7637044ce3 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:12.209149 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bcaa19b0-75ca-4723-b021-0c7637044ce3 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:12.210237 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bcaa19b0-75ca-4723-b021-0c7637044ce3 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:12.212213 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bcaa19b0-75ca-4723-b021-0c7637044ce3 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:12.212688 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bcaa19b0-75ca-4723-b021-0c7637044ce3 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:12.213110 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bcaa19b0-75ca-4723-b021-0c7637044ce3 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:12.413088 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-bcaa19b0-75ca-4723-b021-0c7637044ce3 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:08:12.422132 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-bcaa19b0-75ca-4723-b021-0c7637044ce3 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:08:12.423874 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-bcaa19b0-75ca-4723-b021-0c7637044ce3 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:08:12.424146 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-50244570-378b-49d8-8c0a-d1f64d02d147 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcdfeb6c1cda4810b9fa70fdfd9a66c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c774a85b2c41c98486cf91b1253363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:08:12.425626 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-bcaa19b0-75ca-4723-b021-0c7637044ce3 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] 10.222.0.18 "GET /compute/v2.1/servers/cc7f1980-ecea-437f-ac71-0cdb6ec626b9" status: 200 len: 1406 microversion: 2.20 time: 0.229828 Oct 22 21:08:12.426444 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1983/3967] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:08:12 2022] GET /compute/v2.1/servers/cc7f1980-ecea-437f-ac71-0cdb6ec626b9 => generated 1406 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:08:12.432443 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-82ce5a55-57fe-4a98-971e-a9e270298bdd tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:08:12.433223 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-82ce5a55-57fe-4a98-971e-a9e270298bdd tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] [instance: 5aa948d4-5141-4a18-8778-e8801a5bb9f5] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:08:12.440030 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-82ce5a55-57fe-4a98-971e-a9e270298bdd tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:12.440716 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-82ce5a55-57fe-4a98-971e-a9e270298bdd tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:12.441339 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-82ce5a55-57fe-4a98-971e-a9e270298bdd tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:12.442196 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-82ce5a55-57fe-4a98-971e-a9e270298bdd tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:12.443758 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-82ce5a55-57fe-4a98-971e-a9e270298bdd tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:12.444355 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-82ce5a55-57fe-4a98-971e-a9e270298bdd tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:12.449262 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-50244570-378b-49d8-8c0a-d1f64d02d147 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] 10.222.0.18 "GET /compute/v2.1/servers/5e25931a-04e4-4e25-8aea-012b106aa2c1" status: 200 len: 1317 microversion: 2.1 time: 0.263062 Oct 22 21:08:12.449990 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1985/3968] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:08:12 2022] GET /compute/v2.1/servers/5e25931a-04e4-4e25-8aea-012b106aa2c1 => generated 1317 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:08:12.470609 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-8e92149e-d353-49af-98ab-7ddab1a6fc07 tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:08:12.471556 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-8e92149e-d353-49af-98ab-7ddab1a6fc07 tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] [instance: e1523193-327c-4659-8fc4-7329cbffd32f] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:08:12.479452 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8e92149e-d353-49af-98ab-7ddab1a6fc07 tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:12.479976 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8e92149e-d353-49af-98ab-7ddab1a6fc07 tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:12.480382 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8e92149e-d353-49af-98ab-7ddab1a6fc07 tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:12.481119 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8e92149e-d353-49af-98ab-7ddab1a6fc07 tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:12.481924 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8e92149e-d353-49af-98ab-7ddab1a6fc07 tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:12.482375 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8e92149e-d353-49af-98ab-7ddab1a6fc07 tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:12.539746 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-82ce5a55-57fe-4a98-971e-a9e270298bdd tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fab7ad5c77a437e9b7ca01c806ddd01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3385ef21cec84f6aa5ffa88bfdfd8646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:08:12.554264 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-82ce5a55-57fe-4a98-971e-a9e270298bdd tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fab7ad5c77a437e9b7ca01c806ddd01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3385ef21cec84f6aa5ffa88bfdfd8646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:08:12.555968 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-82ce5a55-57fe-4a98-971e-a9e270298bdd tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fab7ad5c77a437e9b7ca01c806ddd01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3385ef21cec84f6aa5ffa88bfdfd8646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:08:12.557326 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-82ce5a55-57fe-4a98-971e-a9e270298bdd tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] 10.222.0.18 "GET /compute/v2.1/servers/5aa948d4-5141-4a18-8778-e8801a5bb9f5" status: 200 len: 1408 microversion: 2.54 time: 0.128728 Oct 22 21:08:12.558067 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1984/3969] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:08:12 2022] GET /compute/v2.1/servers/5aa948d4-5141-4a18-8778-e8801a5bb9f5 => generated 1408 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:08:12.567621 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-61569f15-0180-4ed3-bdc6-39d1dc044f94 req-428b167f-4550-401b-be8d-8fd75853e9ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1523193-327c-4659-8fc4-7329cbffd32f", "tag": "043fc3dc-4aa8-48d0-bf01-30cbd832a23b"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:08:12.574500 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-61569f15-0180-4ed3-bdc6-39d1dc044f94 req-428b167f-4550-401b-be8d-8fd75853e9ee service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:12.575328 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-61569f15-0180-4ed3-bdc6-39d1dc044f94 req-428b167f-4550-401b-be8d-8fd75853e9ee service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:12.576010 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-61569f15-0180-4ed3-bdc6-39d1dc044f94 req-428b167f-4550-401b-be8d-8fd75853e9ee service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:12.590121 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-61569f15-0180-4ed3-bdc6-39d1dc044f94 req-428b167f-4550-401b-be8d-8fd75853e9ee service nova] Creating event network-changed:043fc3dc-4aa8-48d0-bf01-30cbd832a23b for instance e1523193-327c-4659-8fc4-7329cbffd32f on nch1-master-1 Oct 22 21:08:12.601936 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-61569f15-0180-4ed3-bdc6-39d1dc044f94 req-428b167f-4550-401b-be8d-8fd75853e9ee service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042174 Oct 22 21:08:12.603267 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1985/3970] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:08:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:08:12.694039 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-8e92149e-d353-49af-98ab-7ddab1a6fc07 tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98584920f7f948d6995412c700128be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf63c122a5e4685a891957e1b58b9e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:08:12.705477 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-8e92149e-d353-49af-98ab-7ddab1a6fc07 tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] 10.222.0.18 "GET /compute/v2.1/servers/e1523193-327c-4659-8fc4-7329cbffd32f" status: 200 len: 1591 microversion: 2.1 time: 0.239495 Oct 22 21:08:12.706182 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1986/3971] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:08:12 2022] GET /compute/v2.1/servers/e1523193-327c-4659-8fc4-7329cbffd32f => generated 1591 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:08:12.764814 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-a30d26a6-fa99-4e76-b335-fc09d90b1945 req-3cfb2a4e-0d72-4e96-996e-0a2c35cf149a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df925c6f-4463-44d7-b951-29dbb9c34ac0", "tag": "78db46a3-467b-4f0a-b014-f2cdd0384e0e"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:08:12.775365 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-a30d26a6-fa99-4e76-b335-fc09d90b1945 req-3cfb2a4e-0d72-4e96-996e-0a2c35cf149a service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:12.777070 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-a30d26a6-fa99-4e76-b335-fc09d90b1945 req-3cfb2a4e-0d72-4e96-996e-0a2c35cf149a service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:12.777522 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-a30d26a6-fa99-4e76-b335-fc09d90b1945 req-3cfb2a4e-0d72-4e96-996e-0a2c35cf149a service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:12.790384 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-a30d26a6-fa99-4e76-b335-fc09d90b1945 req-3cfb2a4e-0d72-4e96-996e-0a2c35cf149a service nova] Creating event network-changed:78db46a3-467b-4f0a-b014-f2cdd0384e0e for instance df925c6f-4463-44d7-b951-29dbb9c34ac0 on nch2-master-1 Oct 22 21:08:12.795620 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-a30d26a6-fa99-4e76-b335-fc09d90b1945 req-3cfb2a4e-0d72-4e96-996e-0a2c35cf149a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037121 Oct 22 21:08:12.796270 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1986/3972] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:08:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:08:13.002172 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-d4f56471-39e5-4211-8fd0-f006128ed58f tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:08:13.002883 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-d4f56471-39e5-4211-8fd0-f006128ed58f tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] [instance: df925c6f-4463-44d7-b951-29dbb9c34ac0] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:08:13.010271 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d4f56471-39e5-4211-8fd0-f006128ed58f tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:13.010785 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d4f56471-39e5-4211-8fd0-f006128ed58f tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:13.011274 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d4f56471-39e5-4211-8fd0-f006128ed58f tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:13.012036 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d4f56471-39e5-4211-8fd0-f006128ed58f tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:13.012521 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d4f56471-39e5-4211-8fd0-f006128ed58f tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:13.012964 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d4f56471-39e5-4211-8fd0-f006128ed58f tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:13.455396 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-e5a5a66f-c314-4040-b73a-31c9bb2c2267 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:08:13.456857 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-e5a5a66f-c314-4040-b73a-31c9bb2c2267 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] [instance: cc7f1980-ecea-437f-ac71-0cdb6ec626b9] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:08:13.464044 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e5a5a66f-c314-4040-b73a-31c9bb2c2267 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:13.465530 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e5a5a66f-c314-4040-b73a-31c9bb2c2267 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:13.466059 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e5a5a66f-c314-4040-b73a-31c9bb2c2267 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:13.467825 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e5a5a66f-c314-4040-b73a-31c9bb2c2267 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:13.468393 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e5a5a66f-c314-4040-b73a-31c9bb2c2267 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:13.469206 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e5a5a66f-c314-4040-b73a-31c9bb2c2267 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:13.859588 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-d4f56471-39e5-4211-8fd0-f006128ed58f tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7102f7b674934e19b3d4a001b563d0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21349e14fb39496c9996d5af817b7f73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:08:13.868716 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-d4f56471-39e5-4211-8fd0-f006128ed58f tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] 10.222.0.18 "GET /compute/v2.1/servers/df925c6f-4463-44d7-b951-29dbb9c34ac0" status: 200 len: 1318 microversion: 2.1 time: 0.870691 Oct 22 21:08:13.869414 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1987/3973] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:08:12 2022] GET /compute/v2.1/servers/df925c6f-4463-44d7-b951-29dbb9c34ac0 => generated 1318 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:08:13.874232 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-d93667bc-ebce-4623-873e-03bd103348cb tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:08:13.874926 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-d93667bc-ebce-4623-873e-03bd103348cb tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] [instance: 5e25931a-04e4-4e25-8aea-012b106aa2c1] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:08:13.881668 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d93667bc-ebce-4623-873e-03bd103348cb tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:13.882100 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d93667bc-ebce-4623-873e-03bd103348cb tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:13.882550 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d93667bc-ebce-4623-873e-03bd103348cb tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:13.883285 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d93667bc-ebce-4623-873e-03bd103348cb tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:13.883839 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d93667bc-ebce-4623-873e-03bd103348cb tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:13.884310 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d93667bc-ebce-4623-873e-03bd103348cb tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:14.036397 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-e5a5a66f-c314-4040-b73a-31c9bb2c2267 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:08:14.045308 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-e5a5a66f-c314-4040-b73a-31c9bb2c2267 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:08:14.046766 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-e5a5a66f-c314-4040-b73a-31c9bb2c2267 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:08:14.047958 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-e5a5a66f-c314-4040-b73a-31c9bb2c2267 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] 10.222.0.18 "GET /compute/v2.1/servers/cc7f1980-ecea-437f-ac71-0cdb6ec626b9" status: 200 len: 1406 microversion: 2.20 time: 0.597997 Oct 22 21:08:14.048550 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1987/3974] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:08:13 2022] GET /compute/v2.1/servers/cc7f1980-ecea-437f-ac71-0cdb6ec626b9 => generated 1406 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:08:14.070496 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-c519b6bc-98b1-4e7f-baf1-87d56023a5f3 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:08:14.071128 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-c519b6bc-98b1-4e7f-baf1-87d56023a5f3 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] [instance: 5aa948d4-5141-4a18-8778-e8801a5bb9f5] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:08:14.077596 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c519b6bc-98b1-4e7f-baf1-87d56023a5f3 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:14.078091 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c519b6bc-98b1-4e7f-baf1-87d56023a5f3 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:14.078545 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c519b6bc-98b1-4e7f-baf1-87d56023a5f3 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:14.079287 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c519b6bc-98b1-4e7f-baf1-87d56023a5f3 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:14.079801 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c519b6bc-98b1-4e7f-baf1-87d56023a5f3 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:14.080245 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c519b6bc-98b1-4e7f-baf1-87d56023a5f3 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:14.222199 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-c519b6bc-98b1-4e7f-baf1-87d56023a5f3 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fab7ad5c77a437e9b7ca01c806ddd01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3385ef21cec84f6aa5ffa88bfdfd8646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:08:14.231246 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-c519b6bc-98b1-4e7f-baf1-87d56023a5f3 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fab7ad5c77a437e9b7ca01c806ddd01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3385ef21cec84f6aa5ffa88bfdfd8646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:08:14.232751 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-c519b6bc-98b1-4e7f-baf1-87d56023a5f3 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fab7ad5c77a437e9b7ca01c806ddd01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3385ef21cec84f6aa5ffa88bfdfd8646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:08:14.233983 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-c519b6bc-98b1-4e7f-baf1-87d56023a5f3 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] 10.222.0.18 "GET /compute/v2.1/servers/5aa948d4-5141-4a18-8778-e8801a5bb9f5" status: 200 len: 1408 microversion: 2.54 time: 0.169507 Oct 22 21:08:14.234552 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1988/3975] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:08:14 2022] GET /compute/v2.1/servers/5aa948d4-5141-4a18-8778-e8801a5bb9f5 => generated 1408 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:08:14.427383 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-d93667bc-ebce-4623-873e-03bd103348cb tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcdfeb6c1cda4810b9fa70fdfd9a66c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c774a85b2c41c98486cf91b1253363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:08:14.435857 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-d93667bc-ebce-4623-873e-03bd103348cb tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] 10.222.0.18 "GET /compute/v2.1/servers/5e25931a-04e4-4e25-8aea-012b106aa2c1" status: 200 len: 1317 microversion: 2.1 time: 0.565294 Oct 22 21:08:14.436551 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1988/3976] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:08:13 2022] GET /compute/v2.1/servers/5e25931a-04e4-4e25-8aea-012b106aa2c1 => generated 1317 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:08:14.892236 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-b75585ae-53fe-4aad-9133-f76b1a386a08 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:08:14.893187 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-b75585ae-53fe-4aad-9133-f76b1a386a08 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] [instance: df925c6f-4463-44d7-b951-29dbb9c34ac0] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:08:14.900651 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b75585ae-53fe-4aad-9133-f76b1a386a08 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:14.901220 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b75585ae-53fe-4aad-9133-f76b1a386a08 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:14.901772 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b75585ae-53fe-4aad-9133-f76b1a386a08 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:14.902534 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b75585ae-53fe-4aad-9133-f76b1a386a08 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:14.903082 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b75585ae-53fe-4aad-9133-f76b1a386a08 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:14.903795 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b75585ae-53fe-4aad-9133-f76b1a386a08 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:14.934589 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:SELECT=100 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:08:15.091881 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-4396d9fb-b2e8-4689-8217-b1099349f8a2 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:08:15.092756 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-4396d9fb-b2e8-4689-8217-b1099349f8a2 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] [instance: cc7f1980-ecea-437f-ac71-0cdb6ec626b9] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:08:15.107704 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4396d9fb-b2e8-4689-8217-b1099349f8a2 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:15.108677 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4396d9fb-b2e8-4689-8217-b1099349f8a2 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:15.114190 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4396d9fb-b2e8-4689-8217-b1099349f8a2 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:15.115004 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4396d9fb-b2e8-4689-8217-b1099349f8a2 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:15.115702 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4396d9fb-b2e8-4689-8217-b1099349f8a2 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:15.116253 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4396d9fb-b2e8-4689-8217-b1099349f8a2 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:15.329078 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-b75585ae-53fe-4aad-9133-f76b1a386a08 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7102f7b674934e19b3d4a001b563d0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21349e14fb39496c9996d5af817b7f73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:08:15.338258 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-b75585ae-53fe-4aad-9133-f76b1a386a08 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] 10.222.0.18 "GET /compute/v2.1/servers/df925c6f-4463-44d7-b951-29dbb9c34ac0" status: 200 len: 1318 microversion: 2.1 time: 0.450317 Oct 22 21:08:15.338922 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell0:SELECT=6 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:08:15.351572 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1989/3977] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:08:14 2022] GET /compute/v2.1/servers/df925c6f-4463-44d7-b951-29dbb9c34ac0 => generated 1318 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:08:15.351572 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-619ece3d-22fd-4b4a-8bca-09e1bf6f91c7 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:08:15.351572 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-619ece3d-22fd-4b4a-8bca-09e1bf6f91c7 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] [instance: 5aa948d4-5141-4a18-8778-e8801a5bb9f5] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:08:15.355008 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-619ece3d-22fd-4b4a-8bca-09e1bf6f91c7 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:15.355008 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-619ece3d-22fd-4b4a-8bca-09e1bf6f91c7 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:15.355008 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-619ece3d-22fd-4b4a-8bca-09e1bf6f91c7 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:15.355769 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-619ece3d-22fd-4b4a-8bca-09e1bf6f91c7 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:15.356263 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-619ece3d-22fd-4b4a-8bca-09e1bf6f91c7 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:15.356749 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-619ece3d-22fd-4b4a-8bca-09e1bf6f91c7 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:15.405578 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell0:SELECT=38 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:08:15.779623 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-619ece3d-22fd-4b4a-8bca-09e1bf6f91c7 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fab7ad5c77a437e9b7ca01c806ddd01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3385ef21cec84f6aa5ffa88bfdfd8646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:08:15.788512 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-619ece3d-22fd-4b4a-8bca-09e1bf6f91c7 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fab7ad5c77a437e9b7ca01c806ddd01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3385ef21cec84f6aa5ffa88bfdfd8646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:08:15.789967 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-619ece3d-22fd-4b4a-8bca-09e1bf6f91c7 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fab7ad5c77a437e9b7ca01c806ddd01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3385ef21cec84f6aa5ffa88bfdfd8646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:08:15.791158 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-619ece3d-22fd-4b4a-8bca-09e1bf6f91c7 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] 10.222.0.18 "GET /compute/v2.1/servers/5aa948d4-5141-4a18-8778-e8801a5bb9f5" status: 200 len: 1408 microversion: 2.54 time: 0.450726 Oct 22 21:08:15.791790 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1990/3978] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:08:15 2022] GET /compute/v2.1/servers/5aa948d4-5141-4a18-8778-e8801a5bb9f5 => generated 1408 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:08:15.803685 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-2aa42a97-07c5-4159-b7bb-49273c6c0f07 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:08:15.803685 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-2aa42a97-07c5-4159-b7bb-49273c6c0f07 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] [instance: 5e25931a-04e4-4e25-8aea-012b106aa2c1] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:08:15.803685 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2aa42a97-07c5-4159-b7bb-49273c6c0f07 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:15.804023 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2aa42a97-07c5-4159-b7bb-49273c6c0f07 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:15.804413 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2aa42a97-07c5-4159-b7bb-49273c6c0f07 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:15.805112 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2aa42a97-07c5-4159-b7bb-49273c6c0f07 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:15.805826 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2aa42a97-07c5-4159-b7bb-49273c6c0f07 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:15.806262 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2aa42a97-07c5-4159-b7bb-49273c6c0f07 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:15.983979 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-4396d9fb-b2e8-4689-8217-b1099349f8a2 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:08:15.994916 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-4396d9fb-b2e8-4689-8217-b1099349f8a2 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:08:15.996927 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-4396d9fb-b2e8-4689-8217-b1099349f8a2 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:08:15.998490 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-4396d9fb-b2e8-4689-8217-b1099349f8a2 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] 10.222.0.18 "GET /compute/v2.1/servers/cc7f1980-ecea-437f-ac71-0cdb6ec626b9" status: 200 len: 1599 microversion: 2.20 time: 0.924220 Oct 22 21:08:15.999498 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1989/3979] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:08:15 2022] GET /compute/v2.1/servers/cc7f1980-ecea-437f-ac71-0cdb6ec626b9 => generated 1599 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:08:16.024121 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-3eaf9039-5132-4e59-bfe6-57629d9792dd tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:08:16.024896 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-3eaf9039-5132-4e59-bfe6-57629d9792dd tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] [instance: cc7f1980-ecea-437f-ac71-0cdb6ec626b9] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:08:16.031990 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3eaf9039-5132-4e59-bfe6-57629d9792dd tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:16.032461 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3eaf9039-5132-4e59-bfe6-57629d9792dd tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:16.032895 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3eaf9039-5132-4e59-bfe6-57629d9792dd tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:16.033836 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3eaf9039-5132-4e59-bfe6-57629d9792dd tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:16.034572 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3eaf9039-5132-4e59-bfe6-57629d9792dd tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:16.035077 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3eaf9039-5132-4e59-bfe6-57629d9792dd tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:16.185496 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell0:SELECT=11 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:08:16.233823 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-2aa42a97-07c5-4159-b7bb-49273c6c0f07 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcdfeb6c1cda4810b9fa70fdfd9a66c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c774a85b2c41c98486cf91b1253363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:08:16.243186 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-2aa42a97-07c5-4159-b7bb-49273c6c0f07 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] 10.222.0.18 "GET /compute/v2.1/servers/5e25931a-04e4-4e25-8aea-012b106aa2c1" status: 200 len: 1317 microversion: 2.1 time: 0.449598 Oct 22 21:08:16.247232 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-3eaf9039-5132-4e59-bfe6-57629d9792dd tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] 10.222.0.18 "GET /compute/v2.1/servers/cc7f1980-ecea-437f-ac71-0cdb6ec626b9/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.226413 Oct 22 21:08:16.249108 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1990/3980] 10.222.0.18 () {60 vars in 1316 bytes} [Sat Oct 22 21:08:16 2022] GET /compute/v2.1/servers/cc7f1980-ecea-437f-ac71-0cdb6ec626b9/os-interface => generated 285 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 22 21:08:16.262694 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1991/3981] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:08:15 2022] GET /compute/v2.1/servers/5e25931a-04e4-4e25-8aea-012b106aa2c1 => generated 1317 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:08:16.362924 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-10a90d8e-2387-420b-9a5d-52a4bd91579d tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:08:16.363578 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-10a90d8e-2387-420b-9a5d-52a4bd91579d tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] [instance: df925c6f-4463-44d7-b951-29dbb9c34ac0] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:08:16.370378 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-10a90d8e-2387-420b-9a5d-52a4bd91579d tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:16.370878 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-10a90d8e-2387-420b-9a5d-52a4bd91579d tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:16.371582 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-10a90d8e-2387-420b-9a5d-52a4bd91579d tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:16.372493 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-10a90d8e-2387-420b-9a5d-52a4bd91579d tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:16.372944 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-10a90d8e-2387-420b-9a5d-52a4bd91579d tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:16.373535 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-10a90d8e-2387-420b-9a5d-52a4bd91579d tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:16.536222 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-10a90d8e-2387-420b-9a5d-52a4bd91579d tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7102f7b674934e19b3d4a001b563d0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21349e14fb39496c9996d5af817b7f73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:08:16.548711 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-10a90d8e-2387-420b-9a5d-52a4bd91579d tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] 10.222.0.18 "GET /compute/v2.1/servers/df925c6f-4463-44d7-b951-29dbb9c34ac0" status: 200 len: 1318 microversion: 2.1 time: 0.189724 Oct 22 21:08:16.563456 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1991/3982] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:08:16 2022] GET /compute/v2.1/servers/df925c6f-4463-44d7-b951-29dbb9c34ac0 => generated 1318 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:08:16.711801 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-50797968-64ff-446a-b780-fba7eafee489 req-00b8acf1-4bd0-434a-beb9-e26bc4afc1dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df925c6f-4463-44d7-b951-29dbb9c34ac0", "name": "network-vif-plugged", "status": "completed", "tag": "78db46a3-467b-4f0a-b014-f2cdd0384e0e"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:08:16.726271 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-50797968-64ff-446a-b780-fba7eafee489 req-00b8acf1-4bd0-434a-beb9-e26bc4afc1dd service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:16.727818 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-50797968-64ff-446a-b780-fba7eafee489 req-00b8acf1-4bd0-434a-beb9-e26bc4afc1dd service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:16.728520 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-50797968-64ff-446a-b780-fba7eafee489 req-00b8acf1-4bd0-434a-beb9-e26bc4afc1dd service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:16.744453 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-50797968-64ff-446a-b780-fba7eafee489 req-00b8acf1-4bd0-434a-beb9-e26bc4afc1dd service nova] Creating event network-vif-plugged:78db46a3-467b-4f0a-b014-f2cdd0384e0e for instance df925c6f-4463-44d7-b951-29dbb9c34ac0 on nch2-master-1 Oct 22 21:08:16.750093 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-50797968-64ff-446a-b780-fba7eafee489 req-00b8acf1-4bd0-434a-beb9-e26bc4afc1dd service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042388 Oct 22 21:08:16.751731 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1992/3983] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:08:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:08:16.819586 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-1da9f860-b159-4d56-b9c2-4028fe1bddf2 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:08:16.820521 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-1da9f860-b159-4d56-b9c2-4028fe1bddf2 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] [instance: 5aa948d4-5141-4a18-8778-e8801a5bb9f5] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:08:16.833960 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1da9f860-b159-4d56-b9c2-4028fe1bddf2 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:16.835367 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1da9f860-b159-4d56-b9c2-4028fe1bddf2 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:16.836280 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1da9f860-b159-4d56-b9c2-4028fe1bddf2 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:16.837796 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1da9f860-b159-4d56-b9c2-4028fe1bddf2 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:16.843289 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1da9f860-b159-4d56-b9c2-4028fe1bddf2 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:16.844371 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1da9f860-b159-4d56-b9c2-4028fe1bddf2 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:16.954023 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-1da9f860-b159-4d56-b9c2-4028fe1bddf2 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fab7ad5c77a437e9b7ca01c806ddd01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3385ef21cec84f6aa5ffa88bfdfd8646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:08:16.968133 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-1da9f860-b159-4d56-b9c2-4028fe1bddf2 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fab7ad5c77a437e9b7ca01c806ddd01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3385ef21cec84f6aa5ffa88bfdfd8646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:08:16.970877 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-1da9f860-b159-4d56-b9c2-4028fe1bddf2 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fab7ad5c77a437e9b7ca01c806ddd01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3385ef21cec84f6aa5ffa88bfdfd8646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:08:16.972968 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-1da9f860-b159-4d56-b9c2-4028fe1bddf2 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] 10.222.0.18 "GET /compute/v2.1/servers/5aa948d4-5141-4a18-8778-e8801a5bb9f5" status: 200 len: 1408 microversion: 2.54 time: 0.158701 Oct 22 21:08:16.974212 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1992/3984] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:08:16 2022] GET /compute/v2.1/servers/5aa948d4-5141-4a18-8778-e8801a5bb9f5 => generated 1408 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:08:17.274931 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-c409b65e-729e-4490-ae5f-4aa309f734ef tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:08:17.277197 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-c409b65e-729e-4490-ae5f-4aa309f734ef tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] [instance: 5e25931a-04e4-4e25-8aea-012b106aa2c1] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:08:17.286786 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c409b65e-729e-4490-ae5f-4aa309f734ef tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:17.287276 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c409b65e-729e-4490-ae5f-4aa309f734ef tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:17.287944 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c409b65e-729e-4490-ae5f-4aa309f734ef tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:17.289489 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c409b65e-729e-4490-ae5f-4aa309f734ef tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:17.290107 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c409b65e-729e-4490-ae5f-4aa309f734ef tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:17.290709 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c409b65e-729e-4490-ae5f-4aa309f734ef tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:17.395547 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-9317adeb-2ac0-4df4-a9fb-cb5c18893270 req-64592b53-da1d-4a6e-9752-7e677f39cb51 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc7f1980-ecea-437f-ac71-0cdb6ec626b9", "tag": "96502a52-b9c6-4c85-9f2b-97330250e894"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:08:17.415810 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-9317adeb-2ac0-4df4-a9fb-cb5c18893270 req-64592b53-da1d-4a6e-9752-7e677f39cb51 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:17.416308 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-9317adeb-2ac0-4df4-a9fb-cb5c18893270 req-64592b53-da1d-4a6e-9752-7e677f39cb51 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:17.416757 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-9317adeb-2ac0-4df4-a9fb-cb5c18893270 req-64592b53-da1d-4a6e-9752-7e677f39cb51 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:17.441270 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-9317adeb-2ac0-4df4-a9fb-cb5c18893270 req-64592b53-da1d-4a6e-9752-7e677f39cb51 service nova] Creating event network-changed:96502a52-b9c6-4c85-9f2b-97330250e894 for instance cc7f1980-ecea-437f-ac71-0cdb6ec626b9 on nch1-master-1 Oct 22 21:08:17.451622 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-9317adeb-2ac0-4df4-a9fb-cb5c18893270 req-64592b53-da1d-4a6e-9752-7e677f39cb51 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059526 Oct 22 21:08:17.452783 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1993/3985] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:08:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 21:08:17.574020 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-6cfce5bd-b0d6-4e63-9407-36cd50320374 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:08:17.574740 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-6cfce5bd-b0d6-4e63-9407-36cd50320374 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] [instance: df925c6f-4463-44d7-b951-29dbb9c34ac0] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:08:17.581841 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6cfce5bd-b0d6-4e63-9407-36cd50320374 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:17.582546 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6cfce5bd-b0d6-4e63-9407-36cd50320374 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:17.583176 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6cfce5bd-b0d6-4e63-9407-36cd50320374 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:17.584667 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6cfce5bd-b0d6-4e63-9407-36cd50320374 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:17.585307 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6cfce5bd-b0d6-4e63-9407-36cd50320374 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:17.585904 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6cfce5bd-b0d6-4e63-9407-36cd50320374 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:17.614129 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell1:SELECT=100 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:08:17.620465 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-c409b65e-729e-4490-ae5f-4aa309f734ef tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcdfeb6c1cda4810b9fa70fdfd9a66c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c774a85b2c41c98486cf91b1253363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:08:17.633123 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-c409b65e-729e-4490-ae5f-4aa309f734ef tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] 10.222.0.18 "GET /compute/v2.1/servers/5e25931a-04e4-4e25-8aea-012b106aa2c1" status: 200 len: 1317 microversion: 2.1 time: 0.368636 Oct 22 21:08:17.634582 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1993/3986] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:08:17 2022] GET /compute/v2.1/servers/5e25931a-04e4-4e25-8aea-012b106aa2c1 => generated 1317 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:08:17.964341 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-6cfce5bd-b0d6-4e63-9407-36cd50320374 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7102f7b674934e19b3d4a001b563d0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21349e14fb39496c9996d5af817b7f73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:08:17.981500 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-6cfce5bd-b0d6-4e63-9407-36cd50320374 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] 10.222.0.18 "GET /compute/v2.1/servers/df925c6f-4463-44d7-b951-29dbb9c34ac0" status: 200 len: 1318 microversion: 2.1 time: 0.411942 Oct 22 21:08:18.000900 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1994/3987] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:08:17 2022] GET /compute/v2.1/servers/df925c6f-4463-44d7-b951-29dbb9c34ac0 => generated 1318 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:08:18.008125 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-49e62491-637e-44b9-9835-9be109a58308 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:08:18.008751 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-49e62491-637e-44b9-9835-9be109a58308 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] [instance: 5aa948d4-5141-4a18-8778-e8801a5bb9f5] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:08:18.014981 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-49e62491-637e-44b9-9835-9be109a58308 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:18.015523 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-49e62491-637e-44b9-9835-9be109a58308 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:18.015968 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-49e62491-637e-44b9-9835-9be109a58308 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:18.016738 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-49e62491-637e-44b9-9835-9be109a58308 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:18.017196 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-49e62491-637e-44b9-9835-9be109a58308 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:18.017838 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-49e62491-637e-44b9-9835-9be109a58308 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:18.135070 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-49e62491-637e-44b9-9835-9be109a58308 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fab7ad5c77a437e9b7ca01c806ddd01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3385ef21cec84f6aa5ffa88bfdfd8646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:08:18.160712 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-49e62491-637e-44b9-9835-9be109a58308 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fab7ad5c77a437e9b7ca01c806ddd01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3385ef21cec84f6aa5ffa88bfdfd8646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:08:18.162424 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-49e62491-637e-44b9-9835-9be109a58308 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fab7ad5c77a437e9b7ca01c806ddd01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3385ef21cec84f6aa5ffa88bfdfd8646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:08:18.164099 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-49e62491-637e-44b9-9835-9be109a58308 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] 10.222.0.18 "GET /compute/v2.1/servers/5aa948d4-5141-4a18-8778-e8801a5bb9f5" status: 200 len: 1408 microversion: 2.54 time: 0.159419 Oct 22 21:08:18.169523 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1994/3988] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:08:18 2022] GET /compute/v2.1/servers/5aa948d4-5141-4a18-8778-e8801a5bb9f5 => generated 1408 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:08:18.656916 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-d02c8346-2aed-4963-acfe-4cd2a7d9daf2 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:08:18.657581 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-d02c8346-2aed-4963-acfe-4cd2a7d9daf2 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] [instance: 5e25931a-04e4-4e25-8aea-012b106aa2c1] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:08:18.664989 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d02c8346-2aed-4963-acfe-4cd2a7d9daf2 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:18.665493 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d02c8346-2aed-4963-acfe-4cd2a7d9daf2 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:18.665945 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d02c8346-2aed-4963-acfe-4cd2a7d9daf2 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:18.666673 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d02c8346-2aed-4963-acfe-4cd2a7d9daf2 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:18.667137 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d02c8346-2aed-4963-acfe-4cd2a7d9daf2 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:18.667604 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d02c8346-2aed-4963-acfe-4cd2a7d9daf2 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:18.788538 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-73c75d3b-06b9-4eef-a6a3-a89d573e65ec req-6c8f860f-1f6c-4d5b-8222-9b457c267aaa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e25931a-04e4-4e25-8aea-012b106aa2c1", "name": "network-vif-plugged", "status": "completed", "tag": "3634a4c1-9da8-4a1f-bee5-9e74122917b3"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:08:18.799603 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-73c75d3b-06b9-4eef-a6a3-a89d573e65ec req-6c8f860f-1f6c-4d5b-8222-9b457c267aaa service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:18.800112 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-73c75d3b-06b9-4eef-a6a3-a89d573e65ec req-6c8f860f-1f6c-4d5b-8222-9b457c267aaa service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:18.800762 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-73c75d3b-06b9-4eef-a6a3-a89d573e65ec req-6c8f860f-1f6c-4d5b-8222-9b457c267aaa service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:18.821922 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-73c75d3b-06b9-4eef-a6a3-a89d573e65ec req-6c8f860f-1f6c-4d5b-8222-9b457c267aaa service nova] Creating event network-vif-plugged:3634a4c1-9da8-4a1f-bee5-9e74122917b3 for instance 5e25931a-04e4-4e25-8aea-012b106aa2c1 on nch1-master-1 Oct 22 21:08:18.828971 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-73c75d3b-06b9-4eef-a6a3-a89d573e65ec req-6c8f860f-1f6c-4d5b-8222-9b457c267aaa service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044055 Oct 22 21:08:18.830256 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1995/3989] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:08:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 21:08:19.014063 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-810791bb-c620-495a-807f-656e77f2b731 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:08:19.014797 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-810791bb-c620-495a-807f-656e77f2b731 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] [instance: df925c6f-4463-44d7-b951-29dbb9c34ac0] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:08:19.027571 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-810791bb-c620-495a-807f-656e77f2b731 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:19.028338 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-810791bb-c620-495a-807f-656e77f2b731 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:19.028854 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-810791bb-c620-495a-807f-656e77f2b731 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:19.029560 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-810791bb-c620-495a-807f-656e77f2b731 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:19.030028 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-810791bb-c620-495a-807f-656e77f2b731 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:19.030470 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-810791bb-c620-495a-807f-656e77f2b731 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:19.506631 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-d02c8346-2aed-4963-acfe-4cd2a7d9daf2 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcdfeb6c1cda4810b9fa70fdfd9a66c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c774a85b2c41c98486cf91b1253363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:08:19.515069 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-d02c8346-2aed-4963-acfe-4cd2a7d9daf2 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] 10.222.0.18 "GET /compute/v2.1/servers/5e25931a-04e4-4e25-8aea-012b106aa2c1" status: 200 len: 1317 microversion: 2.1 time: 0.862063 Oct 22 21:08:19.530561 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1995/3990] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:08:18 2022] GET /compute/v2.1/servers/5e25931a-04e4-4e25-8aea-012b106aa2c1 => generated 1317 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:08:19.530823 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-810791bb-c620-495a-807f-656e77f2b731 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7102f7b674934e19b3d4a001b563d0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21349e14fb39496c9996d5af817b7f73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:08:19.530955 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-52e0a280-1dc3-4e6f-b066-e34f0a240265 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:08:19.530955 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-52e0a280-1dc3-4e6f-b066-e34f0a240265 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] [instance: 5aa948d4-5141-4a18-8778-e8801a5bb9f5] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:08:19.530955 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-52e0a280-1dc3-4e6f-b066-e34f0a240265 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:19.531195 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-810791bb-c620-495a-807f-656e77f2b731 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] 10.222.0.18 "GET /compute/v2.1/servers/df925c6f-4463-44d7-b951-29dbb9c34ac0" status: 200 len: 1507 microversion: 2.1 time: 0.519456 Oct 22 21:08:19.531278 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-52e0a280-1dc3-4e6f-b066-e34f0a240265 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:19.531278 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-52e0a280-1dc3-4e6f-b066-e34f0a240265 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:19.531491 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1996/3991] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:08:19 2022] GET /compute/v2.1/servers/df925c6f-4463-44d7-b951-29dbb9c34ac0 => generated 1507 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:08:19.531574 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-52e0a280-1dc3-4e6f-b066-e34f0a240265 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:19.531574 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-52e0a280-1dc3-4e6f-b066-e34f0a240265 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:19.531574 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-52e0a280-1dc3-4e6f-b066-e34f0a240265 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:19.551530 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-1ab9765e-be59-41b3-9b6e-3584b707494a tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b9959707-0ed2-44c8-9e98-fa250b2609b9", "device": "/dev/sdb"}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:08:19.554094 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-1ab9765e-be59-41b3-9b6e-3584b707494a tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] [instance: df925c6f-4463-44d7-b951-29dbb9c34ac0] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:08:19.561087 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1ab9765e-be59-41b3-9b6e-3584b707494a tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:19.561575 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1ab9765e-be59-41b3-9b6e-3584b707494a tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:19.562484 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1ab9765e-be59-41b3-9b6e-3584b707494a tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:19.563579 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1ab9765e-be59-41b3-9b6e-3584b707494a tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:19.564622 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1ab9765e-be59-41b3-9b6e-3584b707494a tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:19.565120 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1ab9765e-be59-41b3-9b6e-3584b707494a tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:19.635955 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-52e0a280-1dc3-4e6f-b066-e34f0a240265 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fab7ad5c77a437e9b7ca01c806ddd01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3385ef21cec84f6aa5ffa88bfdfd8646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:08:19.648610 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-52e0a280-1dc3-4e6f-b066-e34f0a240265 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fab7ad5c77a437e9b7ca01c806ddd01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3385ef21cec84f6aa5ffa88bfdfd8646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:08:19.651766 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-52e0a280-1dc3-4e6f-b066-e34f0a240265 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fab7ad5c77a437e9b7ca01c806ddd01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3385ef21cec84f6aa5ffa88bfdfd8646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:08:19.653343 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-52e0a280-1dc3-4e6f-b066-e34f0a240265 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] 10.222.0.18 "GET /compute/v2.1/servers/5aa948d4-5141-4a18-8778-e8801a5bb9f5" status: 200 len: 1408 microversion: 2.54 time: 0.136021 Oct 22 21:08:19.655518 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1996/3992] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:08:19 2022] GET /compute/v2.1/servers/5aa948d4-5141-4a18-8778-e8801a5bb9f5 => generated 1408 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:08:19.870444 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-1ab9765e-be59-41b3-9b6e-3584b707494a tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] 10.222.0.18 "POST /compute/v2.1/servers/df925c6f-4463-44d7-b951-29dbb9c34ac0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.322766 Oct 22 21:08:19.871089 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1997/3993] 10.222.0.18 () {60 vars in 1323 bytes} [Sat Oct 22 21:08:19 2022] POST /compute/v2.1/servers/df925c6f-4463-44d7-b951-29dbb9c34ac0/os-volume_attachments => generated 194 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 21:08:20.538690 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-7b502031-62ab-42b5-b054-31632fa74076 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:08:20.539947 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-7b502031-62ab-42b5-b054-31632fa74076 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] [instance: 5e25931a-04e4-4e25-8aea-012b106aa2c1] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:08:20.547313 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7b502031-62ab-42b5-b054-31632fa74076 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:20.548311 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7b502031-62ab-42b5-b054-31632fa74076 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:20.548934 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7b502031-62ab-42b5-b054-31632fa74076 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:20.549835 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7b502031-62ab-42b5-b054-31632fa74076 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:20.550461 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7b502031-62ab-42b5-b054-31632fa74076 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:20.551049 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7b502031-62ab-42b5-b054-31632fa74076 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:20.684695 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-89e19189-3894-458e-bd7d-991d95e14351 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:08:20.687124 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-89e19189-3894-458e-bd7d-991d95e14351 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] [instance: 5aa948d4-5141-4a18-8778-e8801a5bb9f5] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:08:20.695795 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-89e19189-3894-458e-bd7d-991d95e14351 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:20.697164 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-89e19189-3894-458e-bd7d-991d95e14351 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:20.697788 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-89e19189-3894-458e-bd7d-991d95e14351 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:20.699558 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-89e19189-3894-458e-bd7d-991d95e14351 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:20.701708 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-89e19189-3894-458e-bd7d-991d95e14351 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:20.702560 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-89e19189-3894-458e-bd7d-991d95e14351 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:20.893144 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-7b502031-62ab-42b5-b054-31632fa74076 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcdfeb6c1cda4810b9fa70fdfd9a66c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c774a85b2c41c98486cf91b1253363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:08:20.905524 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-89e19189-3894-458e-bd7d-991d95e14351 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fab7ad5c77a437e9b7ca01c806ddd01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3385ef21cec84f6aa5ffa88bfdfd8646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:08:20.942308 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-7b502031-62ab-42b5-b054-31632fa74076 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] 10.222.0.18 "GET /compute/v2.1/servers/5e25931a-04e4-4e25-8aea-012b106aa2c1" status: 200 len: 1317 microversion: 2.1 time: 0.407504 Oct 22 21:08:20.944834 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1997/3994] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:08:20 2022] GET /compute/v2.1/servers/5e25931a-04e4-4e25-8aea-012b106aa2c1 => generated 1317 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:08:20.946642 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-89e19189-3894-458e-bd7d-991d95e14351 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fab7ad5c77a437e9b7ca01c806ddd01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3385ef21cec84f6aa5ffa88bfdfd8646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:08:20.948263 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-89e19189-3894-458e-bd7d-991d95e14351 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fab7ad5c77a437e9b7ca01c806ddd01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3385ef21cec84f6aa5ffa88bfdfd8646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:08:20.954689 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-89e19189-3894-458e-bd7d-991d95e14351 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] 10.222.0.18 "GET /compute/v2.1/servers/5aa948d4-5141-4a18-8778-e8801a5bb9f5" status: 200 len: 1408 microversion: 2.54 time: 0.274261 Oct 22 21:08:20.975722 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1998/3995] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:08:20 2022] GET /compute/v2.1/servers/5aa948d4-5141-4a18-8778-e8801a5bb9f5 => generated 1408 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:08:21.975127 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-a0b8336a-2d0c-4c24-a2ae-22d787288513 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:08:21.976164 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-a0b8336a-2d0c-4c24-a2ae-22d787288513 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] [instance: 5e25931a-04e4-4e25-8aea-012b106aa2c1] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:08:21.985598 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a0b8336a-2d0c-4c24-a2ae-22d787288513 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:21.986463 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a0b8336a-2d0c-4c24-a2ae-22d787288513 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:21.987370 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a0b8336a-2d0c-4c24-a2ae-22d787288513 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:21.987647 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-4f380871-e1db-4e97-9dce-1e06ebc6dd11 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:08:21.988336 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-4f380871-e1db-4e97-9dce-1e06ebc6dd11 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] [instance: 5aa948d4-5141-4a18-8778-e8801a5bb9f5] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:08:21.992698 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a0b8336a-2d0c-4c24-a2ae-22d787288513 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:21.993220 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a0b8336a-2d0c-4c24-a2ae-22d787288513 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:21.993697 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a0b8336a-2d0c-4c24-a2ae-22d787288513 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:21.997431 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4f380871-e1db-4e97-9dce-1e06ebc6dd11 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:21.998296 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4f380871-e1db-4e97-9dce-1e06ebc6dd11 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:21.998746 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4f380871-e1db-4e97-9dce-1e06ebc6dd11 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:21.999501 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4f380871-e1db-4e97-9dce-1e06ebc6dd11 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:21.999958 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4f380871-e1db-4e97-9dce-1e06ebc6dd11 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:22.001306 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4f380871-e1db-4e97-9dce-1e06ebc6dd11 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:22.102003 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-4f380871-e1db-4e97-9dce-1e06ebc6dd11 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fab7ad5c77a437e9b7ca01c806ddd01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3385ef21cec84f6aa5ffa88bfdfd8646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:08:22.118693 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-4f380871-e1db-4e97-9dce-1e06ebc6dd11 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fab7ad5c77a437e9b7ca01c806ddd01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3385ef21cec84f6aa5ffa88bfdfd8646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:08:22.120763 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-4f380871-e1db-4e97-9dce-1e06ebc6dd11 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fab7ad5c77a437e9b7ca01c806ddd01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3385ef21cec84f6aa5ffa88bfdfd8646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:08:22.122341 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-4f380871-e1db-4e97-9dce-1e06ebc6dd11 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] 10.222.0.18 "GET /compute/v2.1/servers/5aa948d4-5141-4a18-8778-e8801a5bb9f5" status: 200 len: 1408 microversion: 2.54 time: 0.139720 Oct 22 21:08:22.123811 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 1999/3996] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:08:21 2022] GET /compute/v2.1/servers/5aa948d4-5141-4a18-8778-e8801a5bb9f5 => generated 1408 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:08:22.195513 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-a0b8336a-2d0c-4c24-a2ae-22d787288513 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcdfeb6c1cda4810b9fa70fdfd9a66c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c774a85b2c41c98486cf91b1253363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:08:22.206489 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-a0b8336a-2d0c-4c24-a2ae-22d787288513 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] 10.222.0.18 "GET /compute/v2.1/servers/5e25931a-04e4-4e25-8aea-012b106aa2c1" status: 200 len: 1507 microversion: 2.1 time: 0.236013 Oct 22 21:08:22.207446 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1998/3997] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:08:21 2022] GET /compute/v2.1/servers/5e25931a-04e4-4e25-8aea-012b106aa2c1 => generated 1507 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:08:22.237099 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-710d6880-e14f-4067-b815-818f75229f14 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:08:22.238099 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-710d6880-e14f-4067-b815-818f75229f14 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] [instance: 5e25931a-04e4-4e25-8aea-012b106aa2c1] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:08:22.245338 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-710d6880-e14f-4067-b815-818f75229f14 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:22.245899 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-710d6880-e14f-4067-b815-818f75229f14 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:22.246409 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-710d6880-e14f-4067-b815-818f75229f14 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:22.247427 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-710d6880-e14f-4067-b815-818f75229f14 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:22.248168 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-710d6880-e14f-4067-b815-818f75229f14 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:22.248873 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-710d6880-e14f-4067-b815-818f75229f14 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:22.425182 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-710d6880-e14f-4067-b815-818f75229f14 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcdfeb6c1cda4810b9fa70fdfd9a66c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c774a85b2c41c98486cf91b1253363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:08:22.434995 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-710d6880-e14f-4067-b815-818f75229f14 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] 10.222.0.18 "GET /compute/v2.1/servers/5e25931a-04e4-4e25-8aea-012b106aa2c1" status: 200 len: 1507 microversion: 2.1 time: 0.205972 Oct 22 21:08:22.435663 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2000/3998] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:08:22 2022] GET /compute/v2.1/servers/5e25931a-04e4-4e25-8aea-012b106aa2c1 => generated 1507 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:08:22.460610 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-23af3701-f5e8-4a59-9838-4993221668ec tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:08:22.463764 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-23af3701-f5e8-4a59-9838-4993221668ec tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] [instance: 5e25931a-04e4-4e25-8aea-012b106aa2c1] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:08:22.471984 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-23af3701-f5e8-4a59-9838-4993221668ec tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:22.472572 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-23af3701-f5e8-4a59-9838-4993221668ec tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:22.473279 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-23af3701-f5e8-4a59-9838-4993221668ec tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:22.474161 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-23af3701-f5e8-4a59-9838-4993221668ec tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:22.474734 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-23af3701-f5e8-4a59-9838-4993221668ec tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:22.475851 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-23af3701-f5e8-4a59-9838-4993221668ec tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:22.544700 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-23af3701-f5e8-4a59-9838-4993221668ec tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] 10.222.0.18 "PUT /compute/v2.1/servers/5e25931a-04e4-4e25-8aea-012b106aa2c1" status: 200 len: 1079 microversion: 2.1 time: 0.088951 Oct 22 21:08:22.545553 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 1999/3999] 10.222.0.18 () {60 vars in 1256 bytes} [Sat Oct 22 21:08:22 2022] PUT /compute/v2.1/servers/5e25931a-04e4-4e25-8aea-012b106aa2c1 => generated 1079 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:08:22.564966 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-fd765735-c58a-4fe0-acc2-5ca5690a2242 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:08:22.565697 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-fd765735-c58a-4fe0-acc2-5ca5690a2242 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] [instance: 5e25931a-04e4-4e25-8aea-012b106aa2c1] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:08:22.572894 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fd765735-c58a-4fe0-acc2-5ca5690a2242 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:22.573481 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fd765735-c58a-4fe0-acc2-5ca5690a2242 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:22.574003 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fd765735-c58a-4fe0-acc2-5ca5690a2242 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:22.574728 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fd765735-c58a-4fe0-acc2-5ca5690a2242 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:22.575180 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fd765735-c58a-4fe0-acc2-5ca5690a2242 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:22.575646 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fd765735-c58a-4fe0-acc2-5ca5690a2242 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:22.746669 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-fd765735-c58a-4fe0-acc2-5ca5690a2242 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcdfeb6c1cda4810b9fa70fdfd9a66c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c774a85b2c41c98486cf91b1253363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:08:22.762738 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-fd765735-c58a-4fe0-acc2-5ca5690a2242 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] 10.222.0.18 "GET /compute/v2.1/servers/5e25931a-04e4-4e25-8aea-012b106aa2c1" status: 200 len: 1505 microversion: 2.1 time: 0.201806 Oct 22 21:08:22.763623 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2001/4000] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:08:22 2022] GET /compute/v2.1/servers/5e25931a-04e4-4e25-8aea-012b106aa2c1 => generated 1505 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:08:22.790176 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-f1e9e527-62af-4999-a31d-772e45ccb27f tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:08:22.790884 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-f1e9e527-62af-4999-a31d-772e45ccb27f tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] [instance: 5e25931a-04e4-4e25-8aea-012b106aa2c1] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:08:22.797968 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f1e9e527-62af-4999-a31d-772e45ccb27f tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:22.798546 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f1e9e527-62af-4999-a31d-772e45ccb27f tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:22.799976 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f1e9e527-62af-4999-a31d-772e45ccb27f tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:22.800744 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f1e9e527-62af-4999-a31d-772e45ccb27f tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:22.801319 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f1e9e527-62af-4999-a31d-772e45ccb27f tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:22.801813 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f1e9e527-62af-4999-a31d-772e45ccb27f tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:22.958747 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-f1e9e527-62af-4999-a31d-772e45ccb27f tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcdfeb6c1cda4810b9fa70fdfd9a66c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c774a85b2c41c98486cf91b1253363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:08:22.970628 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-f1e9e527-62af-4999-a31d-772e45ccb27f tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] 10.222.0.18 "GET /compute/v2.1/servers/5e25931a-04e4-4e25-8aea-012b106aa2c1" status: 200 len: 1505 microversion: 2.1 time: 0.186228 Oct 22 21:08:22.971626 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2000/4001] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:08:22 2022] GET /compute/v2.1/servers/5e25931a-04e4-4e25-8aea-012b106aa2c1 => generated 1505 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:08:22.998447 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-f743c0f9-c41a-43a2-ac1e-346976977e5d tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "MANUAL"}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:08:23.001320 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-f743c0f9-c41a-43a2-ac1e-346976977e5d tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] [instance: 5e25931a-04e4-4e25-8aea-012b106aa2c1] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:08:23.007949 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f743c0f9-c41a-43a2-ac1e-346976977e5d tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:23.008518 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f743c0f9-c41a-43a2-ac1e-346976977e5d tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:23.009034 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f743c0f9-c41a-43a2-ac1e-346976977e5d tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:23.009762 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f743c0f9-c41a-43a2-ac1e-346976977e5d tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:23.010291 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f743c0f9-c41a-43a2-ac1e-346976977e5d tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:23.010791 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f743c0f9-c41a-43a2-ac1e-346976977e5d tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:23.083401 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-f743c0f9-c41a-43a2-ac1e-346976977e5d tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] 10.222.0.18 "PUT /compute/v2.1/servers/5e25931a-04e4-4e25-8aea-012b106aa2c1" status: 200 len: 1081 microversion: 2.1 time: 0.089016 Oct 22 21:08:23.092981 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2002/4002] 10.222.0.18 () {60 vars in 1256 bytes} [Sat Oct 22 21:08:22 2022] PUT /compute/v2.1/servers/5e25931a-04e4-4e25-8aea-012b106aa2c1 => generated 1081 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:08:23.105226 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-0cf420fb-728f-497d-9ef5-820efdb6d731 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:08:23.105918 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-0cf420fb-728f-497d-9ef5-820efdb6d731 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] [instance: 5e25931a-04e4-4e25-8aea-012b106aa2c1] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:08:23.113853 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0cf420fb-728f-497d-9ef5-820efdb6d731 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:23.114441 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0cf420fb-728f-497d-9ef5-820efdb6d731 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:23.115020 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0cf420fb-728f-497d-9ef5-820efdb6d731 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:23.116005 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0cf420fb-728f-497d-9ef5-820efdb6d731 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:23.116521 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0cf420fb-728f-497d-9ef5-820efdb6d731 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:23.117004 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0cf420fb-728f-497d-9ef5-820efdb6d731 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:23.152840 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-8c23665c-63c5-4f97-a05c-32d88c1b7970 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:08:23.160556 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-8c23665c-63c5-4f97-a05c-32d88c1b7970 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] [instance: 5aa948d4-5141-4a18-8778-e8801a5bb9f5] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:08:23.169959 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8c23665c-63c5-4f97-a05c-32d88c1b7970 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:23.170548 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8c23665c-63c5-4f97-a05c-32d88c1b7970 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:23.171197 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8c23665c-63c5-4f97-a05c-32d88c1b7970 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:23.172251 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8c23665c-63c5-4f97-a05c-32d88c1b7970 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:23.172735 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8c23665c-63c5-4f97-a05c-32d88c1b7970 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:23.173205 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8c23665c-63c5-4f97-a05c-32d88c1b7970 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:23.281393 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-8c23665c-63c5-4f97-a05c-32d88c1b7970 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fab7ad5c77a437e9b7ca01c806ddd01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3385ef21cec84f6aa5ffa88bfdfd8646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:08:23.293486 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-8c23665c-63c5-4f97-a05c-32d88c1b7970 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fab7ad5c77a437e9b7ca01c806ddd01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3385ef21cec84f6aa5ffa88bfdfd8646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:08:23.295998 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-8c23665c-63c5-4f97-a05c-32d88c1b7970 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fab7ad5c77a437e9b7ca01c806ddd01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3385ef21cec84f6aa5ffa88bfdfd8646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:08:23.297482 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-8c23665c-63c5-4f97-a05c-32d88c1b7970 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] 10.222.0.18 "GET /compute/v2.1/servers/5aa948d4-5141-4a18-8778-e8801a5bb9f5" status: 200 len: 1408 microversion: 2.54 time: 0.151215 Oct 22 21:08:23.299062 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2003/4003] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:08:23 2022] GET /compute/v2.1/servers/5aa948d4-5141-4a18-8778-e8801a5bb9f5 => generated 1408 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:08:23.359096 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-0cf420fb-728f-497d-9ef5-820efdb6d731 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcdfeb6c1cda4810b9fa70fdfd9a66c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c774a85b2c41c98486cf91b1253363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:08:23.367910 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-0cf420fb-728f-497d-9ef5-820efdb6d731 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] 10.222.0.18 "GET /compute/v2.1/servers/5e25931a-04e4-4e25-8aea-012b106aa2c1" status: 200 len: 1507 microversion: 2.1 time: 0.267659 Oct 22 21:08:23.376725 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2001/4004] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:08:23 2022] GET /compute/v2.1/servers/5e25931a-04e4-4e25-8aea-012b106aa2c1 => generated 1507 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:08:23.392849 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-3e234b20-e9b2-4767-9a2a-1c60b7f24db3 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:08:23.394250 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-3e234b20-e9b2-4767-9a2a-1c60b7f24db3 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] [instance: 5e25931a-04e4-4e25-8aea-012b106aa2c1] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:08:23.401178 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3e234b20-e9b2-4767-9a2a-1c60b7f24db3 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:23.402873 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3e234b20-e9b2-4767-9a2a-1c60b7f24db3 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:23.403682 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3e234b20-e9b2-4767-9a2a-1c60b7f24db3 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:23.404784 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3e234b20-e9b2-4767-9a2a-1c60b7f24db3 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:23.405368 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3e234b20-e9b2-4767-9a2a-1c60b7f24db3 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:23.406024 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3e234b20-e9b2-4767-9a2a-1c60b7f24db3 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:23.576055 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-3e234b20-e9b2-4767-9a2a-1c60b7f24db3 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcdfeb6c1cda4810b9fa70fdfd9a66c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c774a85b2c41c98486cf91b1253363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:08:23.585558 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-3e234b20-e9b2-4767-9a2a-1c60b7f24db3 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] 10.222.0.18 "GET /compute/v2.1/servers/5e25931a-04e4-4e25-8aea-012b106aa2c1" status: 200 len: 1507 microversion: 2.1 time: 0.197380 Oct 22 21:08:23.586458 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2004/4005] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:08:23 2022] GET /compute/v2.1/servers/5e25931a-04e4-4e25-8aea-012b106aa2c1 => generated 1507 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:08:23.613405 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-f24ce33c-03b8-45b7-ab6b-ae0c3cbcc030 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:08:23.614205 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-f24ce33c-03b8-45b7-ab6b-ae0c3cbcc030 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] [instance: 5e25931a-04e4-4e25-8aea-012b106aa2c1] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:08:23.624089 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f24ce33c-03b8-45b7-ab6b-ae0c3cbcc030 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:23.624666 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f24ce33c-03b8-45b7-ab6b-ae0c3cbcc030 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:23.625115 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f24ce33c-03b8-45b7-ab6b-ae0c3cbcc030 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:23.626148 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f24ce33c-03b8-45b7-ab6b-ae0c3cbcc030 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:23.627154 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f24ce33c-03b8-45b7-ab6b-ae0c3cbcc030 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:23.628101 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f24ce33c-03b8-45b7-ab6b-ae0c3cbcc030 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:23.677467 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-f24ce33c-03b8-45b7-ab6b-ae0c3cbcc030 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] [instance: 5e25931a-04e4-4e25-8aea-012b106aa2c1] Going to try to terminate instance {{(pid=138745) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 21:08:23.780235 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-f24ce33c-03b8-45b7-ab6b-ae0c3cbcc030 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] 10.222.0.18 "DELETE /compute/v2.1/servers/5e25931a-04e4-4e25-8aea-012b106aa2c1" status: 204 len: 0 microversion: 2.1 time: 0.172197 Oct 22 21:08:23.781064 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2002/4006] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 21:08:23 2022] DELETE /compute/v2.1/servers/5e25931a-04e4-4e25-8aea-012b106aa2c1 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 21:08:23.792928 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-9894dd1c-56b7-440b-815d-61121cd6069c tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:08:23.793684 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-9894dd1c-56b7-440b-815d-61121cd6069c tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] [instance: 5e25931a-04e4-4e25-8aea-012b106aa2c1] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:08:23.801451 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9894dd1c-56b7-440b-815d-61121cd6069c tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:23.802301 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9894dd1c-56b7-440b-815d-61121cd6069c tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:23.802897 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9894dd1c-56b7-440b-815d-61121cd6069c tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:23.803856 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9894dd1c-56b7-440b-815d-61121cd6069c tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:23.804309 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9894dd1c-56b7-440b-815d-61121cd6069c tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:23.804826 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9894dd1c-56b7-440b-815d-61121cd6069c tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:23.829415 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:08:23.838788 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-9894dd1c-56b7-440b-815d-61121cd6069c tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] [instance: 5e25931a-04e4-4e25-8aea-012b106aa2c1] Going to try to terminate instance {{(pid=138744) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 21:08:23.897013 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.compute.api [None req-9894dd1c-56b7-440b-815d-61121cd6069c tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] [instance: 5e25931a-04e4-4e25-8aea-012b106aa2c1] Instance is already in deleting state, ignoring this request Oct 22 21:08:23.898096 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-9894dd1c-56b7-440b-815d-61121cd6069c tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] 10.222.0.18 "DELETE /compute/v2.1/servers/5e25931a-04e4-4e25-8aea-012b106aa2c1" status: 204 len: 0 microversion: 2.1 time: 0.110035 Oct 22 21:08:23.898774 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2005/4007] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 21:08:23 2022] DELETE /compute/v2.1/servers/5e25931a-04e4-4e25-8aea-012b106aa2c1 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 21:08:23.910345 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-c1c32f47-e071-440c-8f5e-d69ed922a395 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:08:23.911466 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-c1c32f47-e071-440c-8f5e-d69ed922a395 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] [instance: 5e25931a-04e4-4e25-8aea-012b106aa2c1] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:08:23.919773 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c1c32f47-e071-440c-8f5e-d69ed922a395 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:23.920419 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c1c32f47-e071-440c-8f5e-d69ed922a395 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:23.920971 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c1c32f47-e071-440c-8f5e-d69ed922a395 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:23.922533 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c1c32f47-e071-440c-8f5e-d69ed922a395 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:23.923456 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c1c32f47-e071-440c-8f5e-d69ed922a395 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:23.924108 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c1c32f47-e071-440c-8f5e-d69ed922a395 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:24.063784 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-c1c32f47-e071-440c-8f5e-d69ed922a395 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcdfeb6c1cda4810b9fa70fdfd9a66c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c774a85b2c41c98486cf91b1253363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:08:24.073115 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-c1c32f47-e071-440c-8f5e-d69ed922a395 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] 10.222.0.18 "GET /compute/v2.1/servers/5e25931a-04e4-4e25-8aea-012b106aa2c1" status: 200 len: 1513 microversion: 2.1 time: 0.169455 Oct 22 21:08:24.073701 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2003/4008] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:08:23 2022] GET /compute/v2.1/servers/5e25931a-04e4-4e25-8aea-012b106aa2c1 => generated 1513 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:08:24.326211 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-09ee89b5-d7eb-47cf-ac2d-fe3df7411e3c tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:08:24.326849 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-09ee89b5-d7eb-47cf-ac2d-fe3df7411e3c tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] [instance: 5aa948d4-5141-4a18-8778-e8801a5bb9f5] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:08:24.336015 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-09ee89b5-d7eb-47cf-ac2d-fe3df7411e3c tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:24.336696 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-09ee89b5-d7eb-47cf-ac2d-fe3df7411e3c tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:24.337358 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-09ee89b5-d7eb-47cf-ac2d-fe3df7411e3c tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:24.338234 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-09ee89b5-d7eb-47cf-ac2d-fe3df7411e3c tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:24.340289 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-09ee89b5-d7eb-47cf-ac2d-fe3df7411e3c tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:24.341069 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-09ee89b5-d7eb-47cf-ac2d-fe3df7411e3c tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:24.803880 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-09ee89b5-d7eb-47cf-ac2d-fe3df7411e3c tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fab7ad5c77a437e9b7ca01c806ddd01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3385ef21cec84f6aa5ffa88bfdfd8646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:08:24.813082 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-09ee89b5-d7eb-47cf-ac2d-fe3df7411e3c tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fab7ad5c77a437e9b7ca01c806ddd01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3385ef21cec84f6aa5ffa88bfdfd8646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:08:24.814878 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-09ee89b5-d7eb-47cf-ac2d-fe3df7411e3c tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fab7ad5c77a437e9b7ca01c806ddd01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3385ef21cec84f6aa5ffa88bfdfd8646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:08:24.816380 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-09ee89b5-d7eb-47cf-ac2d-fe3df7411e3c tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] 10.222.0.18 "GET /compute/v2.1/servers/5aa948d4-5141-4a18-8778-e8801a5bb9f5" status: 200 len: 1408 microversion: 2.54 time: 0.494745 Oct 22 21:08:24.817112 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2006/4009] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:08:24 2022] GET /compute/v2.1/servers/5aa948d4-5141-4a18-8778-e8801a5bb9f5 => generated 1408 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:08:25.098071 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-d5dc2078-b573-499a-987f-d15460ba635e tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:08:25.098707 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-d5dc2078-b573-499a-987f-d15460ba635e tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] [instance: 5e25931a-04e4-4e25-8aea-012b106aa2c1] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:08:25.107628 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d5dc2078-b573-499a-987f-d15460ba635e tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:25.108170 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d5dc2078-b573-499a-987f-d15460ba635e tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:25.108591 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d5dc2078-b573-499a-987f-d15460ba635e tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:25.109333 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d5dc2078-b573-499a-987f-d15460ba635e tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:25.109856 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d5dc2078-b573-499a-987f-d15460ba635e tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:25.110895 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d5dc2078-b573-499a-987f-d15460ba635e tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:25.361949 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-d5dc2078-b573-499a-987f-d15460ba635e tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcdfeb6c1cda4810b9fa70fdfd9a66c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c774a85b2c41c98486cf91b1253363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:08:25.371651 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-d5dc2078-b573-499a-987f-d15460ba635e tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] 10.222.0.18 "GET /compute/v2.1/servers/5e25931a-04e4-4e25-8aea-012b106aa2c1" status: 200 len: 1513 microversion: 2.1 time: 0.278488 Oct 22 21:08:25.372402 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2004/4010] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:08:25 2022] GET /compute/v2.1/servers/5e25931a-04e4-4e25-8aea-012b106aa2c1 => generated 1513 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:08:25.851946 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-197d1209-e2f9-4962-add9-d3e635828c5d tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:08:25.852598 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-197d1209-e2f9-4962-add9-d3e635828c5d tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] [instance: 5aa948d4-5141-4a18-8778-e8801a5bb9f5] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:08:25.862529 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-197d1209-e2f9-4962-add9-d3e635828c5d tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:25.863657 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-197d1209-e2f9-4962-add9-d3e635828c5d tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:25.864168 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-197d1209-e2f9-4962-add9-d3e635828c5d tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:25.864969 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-197d1209-e2f9-4962-add9-d3e635828c5d tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:25.865452 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-197d1209-e2f9-4962-add9-d3e635828c5d tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:25.865939 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-197d1209-e2f9-4962-add9-d3e635828c5d tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:25.945447 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-197d1209-e2f9-4962-add9-d3e635828c5d tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fab7ad5c77a437e9b7ca01c806ddd01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3385ef21cec84f6aa5ffa88bfdfd8646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:08:25.956534 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-197d1209-e2f9-4962-add9-d3e635828c5d tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fab7ad5c77a437e9b7ca01c806ddd01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3385ef21cec84f6aa5ffa88bfdfd8646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:08:25.958017 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-197d1209-e2f9-4962-add9-d3e635828c5d tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fab7ad5c77a437e9b7ca01c806ddd01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3385ef21cec84f6aa5ffa88bfdfd8646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:08:25.959961 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-197d1209-e2f9-4962-add9-d3e635828c5d tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] 10.222.0.18 "GET /compute/v2.1/servers/5aa948d4-5141-4a18-8778-e8801a5bb9f5" status: 200 len: 1408 microversion: 2.54 time: 0.114168 Oct 22 21:08:25.961310 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2007/4011] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:08:25 2022] GET /compute/v2.1/servers/5aa948d4-5141-4a18-8778-e8801a5bb9f5 => generated 1408 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:08:26.162978 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-efc8c90e-1d3b-43ca-97af-57c11cd66714 req-f9615e05-f8fc-498c-98b2-a2dfc7d7b1ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e25931a-04e4-4e25-8aea-012b106aa2c1", "name": "network-vif-deleted", "tag": "3634a4c1-9da8-4a1f-bee5-9e74122917b3"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:08:26.174759 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-efc8c90e-1d3b-43ca-97af-57c11cd66714 req-f9615e05-f8fc-498c-98b2-a2dfc7d7b1ef service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:26.175179 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-efc8c90e-1d3b-43ca-97af-57c11cd66714 req-f9615e05-f8fc-498c-98b2-a2dfc7d7b1ef service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:26.175685 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-efc8c90e-1d3b-43ca-97af-57c11cd66714 req-f9615e05-f8fc-498c-98b2-a2dfc7d7b1ef service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:26.189863 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-efc8c90e-1d3b-43ca-97af-57c11cd66714 req-f9615e05-f8fc-498c-98b2-a2dfc7d7b1ef service nova] Creating event network-vif-deleted:3634a4c1-9da8-4a1f-bee5-9e74122917b3 for instance 5e25931a-04e4-4e25-8aea-012b106aa2c1 on nch1-master-1 Oct 22 21:08:26.196155 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-efc8c90e-1d3b-43ca-97af-57c11cd66714 req-f9615e05-f8fc-498c-98b2-a2dfc7d7b1ef service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040743 Oct 22 21:08:26.200244 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2005/4012] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:08:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:08:26.397076 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-c693d5e1-1c87-4a79-b08a-6e72a81225c2 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:08:26.397772 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-c693d5e1-1c87-4a79-b08a-6e72a81225c2 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] [instance: 5e25931a-04e4-4e25-8aea-012b106aa2c1] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:08:26.405459 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c693d5e1-1c87-4a79-b08a-6e72a81225c2 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:26.406116 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c693d5e1-1c87-4a79-b08a-6e72a81225c2 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:26.406599 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c693d5e1-1c87-4a79-b08a-6e72a81225c2 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:26.407950 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c693d5e1-1c87-4a79-b08a-6e72a81225c2 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:26.408936 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c693d5e1-1c87-4a79-b08a-6e72a81225c2 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:26.409548 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c693d5e1-1c87-4a79-b08a-6e72a81225c2 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:26.448868 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c693d5e1-1c87-4a79-b08a-6e72a81225c2 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:26.449734 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c693d5e1-1c87-4a79-b08a-6e72a81225c2 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:26.450379 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c693d5e1-1c87-4a79-b08a-6e72a81225c2 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:26.450898 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.objects.instance [None req-c693d5e1-1c87-4a79-b08a-6e72a81225c2 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lazy-loading 'fault' on Instance uuid 5e25931a-04e4-4e25-8aea-012b106aa2c1 {{(pid=138744) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 21:08:26.510467 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-c693d5e1-1c87-4a79-b08a-6e72a81225c2 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcdfeb6c1cda4810b9fa70fdfd9a66c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c774a85b2c41c98486cf91b1253363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:08:26.519795 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-c693d5e1-1c87-4a79-b08a-6e72a81225c2 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] 10.222.0.18 "GET /compute/v2.1/servers/5e25931a-04e4-4e25-8aea-012b106aa2c1" status: 200 len: 1307 microversion: 2.1 time: 0.126905 Oct 22 21:08:26.520725 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2008/4013] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:08:26 2022] GET /compute/v2.1/servers/5e25931a-04e4-4e25-8aea-012b106aa2c1 => generated 1307 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:08:26.990545 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-be3ca8bb-e95c-441b-a0d6-9dd56ea707fc tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:08:26.991414 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-be3ca8bb-e95c-441b-a0d6-9dd56ea707fc tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] [instance: 5aa948d4-5141-4a18-8778-e8801a5bb9f5] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:08:27.004128 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-be3ca8bb-e95c-441b-a0d6-9dd56ea707fc tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:27.005005 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-be3ca8bb-e95c-441b-a0d6-9dd56ea707fc tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:27.005466 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-be3ca8bb-e95c-441b-a0d6-9dd56ea707fc tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:27.006231 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-be3ca8bb-e95c-441b-a0d6-9dd56ea707fc tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:27.007023 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-be3ca8bb-e95c-441b-a0d6-9dd56ea707fc tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:27.007531 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-be3ca8bb-e95c-441b-a0d6-9dd56ea707fc tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:27.102483 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-be3ca8bb-e95c-441b-a0d6-9dd56ea707fc tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fab7ad5c77a437e9b7ca01c806ddd01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3385ef21cec84f6aa5ffa88bfdfd8646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:08:27.112600 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-be3ca8bb-e95c-441b-a0d6-9dd56ea707fc tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fab7ad5c77a437e9b7ca01c806ddd01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3385ef21cec84f6aa5ffa88bfdfd8646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:08:27.114251 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-be3ca8bb-e95c-441b-a0d6-9dd56ea707fc tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fab7ad5c77a437e9b7ca01c806ddd01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3385ef21cec84f6aa5ffa88bfdfd8646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:08:27.115524 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-be3ca8bb-e95c-441b-a0d6-9dd56ea707fc tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] 10.222.0.18 "GET /compute/v2.1/servers/5aa948d4-5141-4a18-8778-e8801a5bb9f5" status: 200 len: 1408 microversion: 2.54 time: 0.130569 Oct 22 21:08:27.116098 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2006/4014] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:08:26 2022] GET /compute/v2.1/servers/5aa948d4-5141-4a18-8778-e8801a5bb9f5 => generated 1408 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:08:27.545304 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-2a34b693-8802-4974-8b72-99d4d924c05f tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:08:27.545910 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-2a34b693-8802-4974-8b72-99d4d924c05f tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] [instance: 5e25931a-04e4-4e25-8aea-012b106aa2c1] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:08:27.552978 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2a34b693-8802-4974-8b72-99d4d924c05f tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:27.553464 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2a34b693-8802-4974-8b72-99d4d924c05f tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:27.553918 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2a34b693-8802-4974-8b72-99d4d924c05f tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:27.554608 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2a34b693-8802-4974-8b72-99d4d924c05f tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:27.555057 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2a34b693-8802-4974-8b72-99d4d924c05f tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:27.555517 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2a34b693-8802-4974-8b72-99d4d924c05f tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:27.569659 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-2a34b693-8802-4974-8b72-99d4d924c05f tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] HTTP exception thrown: Instance 5e25931a-04e4-4e25-8aea-012b106aa2c1 could not be found. Oct 22 21:08:27.571521 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-2a34b693-8802-4974-8b72-99d4d924c05f tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Request method failure captured: Oct 22 21:08:27.571521 ncdv-master-1 devstack@n-api.service[138744]: request: GET /compute/v2.1/servers/5e25931a-04e4-4e25-8aea-012b106aa2c1 HTTP/1.1 Oct 22 21:08:27.571521 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 21:08:27.571521 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 21:08:27.571521 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 21:08:27.571521 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 0 Oct 22 21:08:27.571521 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 21:08:27.571521 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 21:08:27.571521 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 21:08:27.571521 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 21:08:27.571521 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVFsqJwgEtdYV-w_0v7cJRFFuuKUgzjSW0YzaMXe4vNshtYfBJQjfUUjNq7ogfgnyyfHfQlDb133EFse1AQ_CYgs-ChUKvyu-eB9xtJK6gdS3hw1-p9Pjwb4k-IkY1kDuqsXV6_5Tm0Oikf-LC7PnT3-p1Ch5iA9fNzPUual9BJib5Jw Oct 22 21:08:27.571521 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 21:08:27.571521 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 21:08:27.571521 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 21:08:27.571521 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 21:08:27.571521 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 21:08:27.571521 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 21:08:27.571521 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: 48c774a85b2c41c98486cf91b1253363 Oct 22 21:08:27.571521 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-ServerDiskConfigTestJSON-735841139 Oct 22 21:08:27.571521 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 21:08:27.571521 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 21:08:27.571521 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_48c774a85b2c41c98486cf91b1253363"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/48c774a85b2c41c98486cf91b1253363"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/48c774a85b2c41c98486cf91b1253363"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/48c774a85b2c41c98486cf91b1253363"}]}] Oct 22 21:08:27.571521 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-ServerDiskConfigTestJSON-735841139 Oct 22 21:08:27.571521 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: 48c774a85b2c41c98486cf91b1253363 Oct 22 21:08:27.571521 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-735841139 Oct 22 21:08:27.571521 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-ServerDiskConfigTestJSON-735841139-project Oct 22 21:08:27.571521 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 21:08:27.571521 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 21:08:27.571521 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: bcdfeb6c1cda4810b9fa70fdfd9a66c8 Oct 22 21:08:27.571521 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-ServerDiskConfigTestJSON-735841139-project Oct 22 21:08:27.571521 ncdv-master-1 devstack@n-api.service[138744]: method: > Oct 22 21:08:27.571521 ncdv-master-1 devstack@n-api.service[138744]: exception: Instance 5e25931a-04e4-4e25-8aea-012b106aa2c1 could not be found. Oct 22 21:08:27.571521 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': '5e25931a-04e4-4e25-8aea-012b106aa2c1'} Oct 22 21:08:27.571521 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:08:27.571521 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:08:27.571521 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 21:08:27.571521 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 21:08:27.571521 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 21:08:27.571521 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 21:08:27.571521 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 21:08:27.571521 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 21:08:27.571521 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 21:08:27.571521 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 21:08:27.571521 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5e25931a-04e4-4e25-8aea-012b106aa2c1 could not be found. Oct 22 21:08:27.571521 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:08:27.571521 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:08:27.571521 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:08:27.571521 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:08:27.571521 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:08:27.571521 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:08:27.571521 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:08:27.571521 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:08:27.571521 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:08:27.571521 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:08:27.571521 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 21:08:27.571521 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 21:08:27.571521 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 21:08:27.571521 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 21:08:27.571521 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 21:08:27.571521 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:08:27.571521 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e25931a-04e4-4e25-8aea-012b106aa2c1 could not be found. Oct 22 21:08:27.571521 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:08:27.571521 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:08:27.571521 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:08:27.576682 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:08:27.576682 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:08:27.576682 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:08:27.576682 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:08:27.576682 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:08:27.576682 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e25931a-04e4-4e25-8aea-012b106aa2c1 could not be found. Oct 22 21:08:27.576682 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:08:27.576682 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-2a34b693-8802-4974-8b72-99d4d924c05f tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Returning 404 to user: Instance 5e25931a-04e4-4e25-8aea-012b106aa2c1 could not be found. {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:08:27.576682 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-2a34b693-8802-4974-8b72-99d4d924c05f tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] 10.222.0.18 "GET /compute/v2.1/servers/5e25931a-04e4-4e25-8aea-012b106aa2c1" status: 404 len: 111 microversion: 2.1 time: 0.032006 Oct 22 21:08:27.576682 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2009/4015] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:08:27 2022] GET /compute/v2.1/servers/5e25931a-04e4-4e25-8aea-012b106aa2c1 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 21:08:27.583981 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-bb0d0150-5a3c-4a29-bd17-a64391417746 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:08:27.584548 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-bb0d0150-5a3c-4a29-bd17-a64391417746 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] [instance: b769064b-9ef9-47b7-9cfd-5d3b8a24a7a1] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:08:27.592436 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bb0d0150-5a3c-4a29-bd17-a64391417746 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:27.592943 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bb0d0150-5a3c-4a29-bd17-a64391417746 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:27.593396 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bb0d0150-5a3c-4a29-bd17-a64391417746 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:27.594120 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bb0d0150-5a3c-4a29-bd17-a64391417746 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:27.594742 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bb0d0150-5a3c-4a29-bd17-a64391417746 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:27.595090 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bb0d0150-5a3c-4a29-bd17-a64391417746 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:27.612386 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.wsgi [None req-bb0d0150-5a3c-4a29-bd17-a64391417746 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] HTTP exception thrown: Instance b769064b-9ef9-47b7-9cfd-5d3b8a24a7a1 could not be found. Oct 22 21:08:27.614530 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-bb0d0150-5a3c-4a29-bd17-a64391417746 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Request method failure captured: Oct 22 21:08:27.614530 ncdv-master-1 devstack@n-api.service[138745]: request: DELETE /compute/v2.1/servers/b769064b-9ef9-47b7-9cfd-5d3b8a24a7a1 HTTP/1.1 Oct 22 21:08:27.614530 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 21:08:27.614530 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 21:08:27.614530 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 21:08:27.614530 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 0 Oct 22 21:08:27.614530 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 21:08:27.614530 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 21:08:27.614530 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 21:08:27.614530 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 21:08:27.614530 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVFsqJwgEtdYV-w_0v7cJRFFuuKUgzjSW0YzaMXe4vNshtYfBJQjfUUjNq7ogfgnyyfHfQlDb133EFse1AQ_CYgs-ChUKvyu-eB9xtJK6gdS3hw1-p9Pjwb4k-IkY1kDuqsXV6_5Tm0Oikf-LC7PnT3-p1Ch5iA9fNzPUual9BJib5Jw Oct 22 21:08:27.614530 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 21:08:27.614530 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 21:08:27.614530 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 21:08:27.614530 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 21:08:27.614530 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 21:08:27.614530 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 21:08:27.614530 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: 48c774a85b2c41c98486cf91b1253363 Oct 22 21:08:27.614530 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-ServerDiskConfigTestJSON-735841139 Oct 22 21:08:27.614530 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 21:08:27.614530 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 21:08:27.614530 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_48c774a85b2c41c98486cf91b1253363"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/48c774a85b2c41c98486cf91b1253363"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/48c774a85b2c41c98486cf91b1253363"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/48c774a85b2c41c98486cf91b1253363"}]}] Oct 22 21:08:27.614530 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-ServerDiskConfigTestJSON-735841139 Oct 22 21:08:27.614530 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: 48c774a85b2c41c98486cf91b1253363 Oct 22 21:08:27.614530 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-735841139 Oct 22 21:08:27.614530 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-ServerDiskConfigTestJSON-735841139-project Oct 22 21:08:27.614530 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 21:08:27.614530 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 21:08:27.614530 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: bcdfeb6c1cda4810b9fa70fdfd9a66c8 Oct 22 21:08:27.614530 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-ServerDiskConfigTestJSON-735841139-project Oct 22 21:08:27.614530 ncdv-master-1 devstack@n-api.service[138745]: method: > Oct 22 21:08:27.614530 ncdv-master-1 devstack@n-api.service[138745]: exception: Instance b769064b-9ef9-47b7-9cfd-5d3b8a24a7a1 could not be found. Oct 22 21:08:27.614530 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'id': 'b769064b-9ef9-47b7-9cfd-5d3b8a24a7a1'} Oct 22 21:08:27.614530 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:08:27.614530 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:08:27.614530 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 21:08:27.614530 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 21:08:27.614530 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 21:08:27.614530 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 21:08:27.614530 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 21:08:27.614530 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 21:08:27.614530 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 21:08:27.614530 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 21:08:27.614530 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b769064b-9ef9-47b7-9cfd-5d3b8a24a7a1 could not be found. Oct 22 21:08:27.614530 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:08:27.614530 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:08:27.614530 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:08:27.614530 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:08:27.614530 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:08:27.614530 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:08:27.614530 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:08:27.614530 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:08:27.614530 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:08:27.614530 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:08:27.614530 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 22 21:08:27.614530 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 22 21:08:27.614530 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 22 21:08:27.614530 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 22 21:08:27.614530 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 21:08:27.614530 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 21:08:27.614530 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 21:08:27.614530 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:08:27.619260 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b769064b-9ef9-47b7-9cfd-5d3b8a24a7a1 could not be found. Oct 22 21:08:27.619260 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:08:27.619260 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:08:27.619260 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:08:27.619260 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:08:27.619260 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:08:27.619260 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:08:27.619260 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:08:27.619260 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:08:27.619260 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b769064b-9ef9-47b7-9cfd-5d3b8a24a7a1 could not be found. Oct 22 21:08:27.619260 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:08:27.619260 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-bb0d0150-5a3c-4a29-bd17-a64391417746 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Returning 404 to user: Instance b769064b-9ef9-47b7-9cfd-5d3b8a24a7a1 could not be found. {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:08:27.619260 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-bb0d0150-5a3c-4a29-bd17-a64391417746 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] 10.222.0.18 "DELETE /compute/v2.1/servers/b769064b-9ef9-47b7-9cfd-5d3b8a24a7a1" status: 404 len: 111 microversion: 2.1 time: 0.036187 Oct 22 21:08:27.619260 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2007/4016] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 21:08:27 2022] DELETE /compute/v2.1/servers/b769064b-9ef9-47b7-9cfd-5d3b8a24a7a1 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 21:08:27.625050 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-8d4ad77b-2721-4219-a757-78679a5ae8ac tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:08:27.625665 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-8d4ad77b-2721-4219-a757-78679a5ae8ac tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] [instance: b769064b-9ef9-47b7-9cfd-5d3b8a24a7a1] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:08:27.632300 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8d4ad77b-2721-4219-a757-78679a5ae8ac tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:27.632756 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8d4ad77b-2721-4219-a757-78679a5ae8ac tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:27.633674 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8d4ad77b-2721-4219-a757-78679a5ae8ac tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:27.634545 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8d4ad77b-2721-4219-a757-78679a5ae8ac tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:27.635152 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8d4ad77b-2721-4219-a757-78679a5ae8ac tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:27.635753 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8d4ad77b-2721-4219-a757-78679a5ae8ac tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:27.655147 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-8d4ad77b-2721-4219-a757-78679a5ae8ac tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] HTTP exception thrown: Instance b769064b-9ef9-47b7-9cfd-5d3b8a24a7a1 could not be found. Oct 22 21:08:27.656736 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-8d4ad77b-2721-4219-a757-78679a5ae8ac tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Request method failure captured: Oct 22 21:08:27.656736 ncdv-master-1 devstack@n-api.service[138744]: request: GET /compute/v2.1/servers/b769064b-9ef9-47b7-9cfd-5d3b8a24a7a1 HTTP/1.1 Oct 22 21:08:27.656736 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 21:08:27.656736 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 21:08:27.656736 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 21:08:27.656736 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 0 Oct 22 21:08:27.656736 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 21:08:27.656736 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 21:08:27.656736 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 21:08:27.656736 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 21:08:27.656736 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVFsqJwgEtdYV-w_0v7cJRFFuuKUgzjSW0YzaMXe4vNshtYfBJQjfUUjNq7ogfgnyyfHfQlDb133EFse1AQ_CYgs-ChUKvyu-eB9xtJK6gdS3hw1-p9Pjwb4k-IkY1kDuqsXV6_5Tm0Oikf-LC7PnT3-p1Ch5iA9fNzPUual9BJib5Jw Oct 22 21:08:27.656736 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 21:08:27.656736 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 21:08:27.656736 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 21:08:27.656736 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 21:08:27.656736 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 21:08:27.656736 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 21:08:27.656736 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: 48c774a85b2c41c98486cf91b1253363 Oct 22 21:08:27.656736 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-ServerDiskConfigTestJSON-735841139 Oct 22 21:08:27.656736 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 21:08:27.656736 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 21:08:27.656736 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_48c774a85b2c41c98486cf91b1253363"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/48c774a85b2c41c98486cf91b1253363"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/48c774a85b2c41c98486cf91b1253363"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/48c774a85b2c41c98486cf91b1253363"}]}] Oct 22 21:08:27.656736 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-ServerDiskConfigTestJSON-735841139 Oct 22 21:08:27.656736 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: 48c774a85b2c41c98486cf91b1253363 Oct 22 21:08:27.656736 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-735841139 Oct 22 21:08:27.656736 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-ServerDiskConfigTestJSON-735841139-project Oct 22 21:08:27.656736 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 21:08:27.656736 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 21:08:27.656736 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: bcdfeb6c1cda4810b9fa70fdfd9a66c8 Oct 22 21:08:27.656736 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-ServerDiskConfigTestJSON-735841139-project Oct 22 21:08:27.656736 ncdv-master-1 devstack@n-api.service[138744]: method: > Oct 22 21:08:27.656736 ncdv-master-1 devstack@n-api.service[138744]: exception: Instance b769064b-9ef9-47b7-9cfd-5d3b8a24a7a1 could not be found. Oct 22 21:08:27.656736 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': 'b769064b-9ef9-47b7-9cfd-5d3b8a24a7a1'} Oct 22 21:08:27.656736 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:08:27.656736 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:08:27.656736 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 21:08:27.656736 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 21:08:27.656736 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 21:08:27.656736 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 21:08:27.656736 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 21:08:27.656736 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 21:08:27.656736 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 21:08:27.656736 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 21:08:27.656736 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b769064b-9ef9-47b7-9cfd-5d3b8a24a7a1 could not be found. Oct 22 21:08:27.656736 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:08:27.656736 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:08:27.656736 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:08:27.656736 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:08:27.656736 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:08:27.656736 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:08:27.656736 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:08:27.656736 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:08:27.656736 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:08:27.656736 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:08:27.656736 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 21:08:27.656736 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 21:08:27.656736 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 21:08:27.656736 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 21:08:27.656736 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 21:08:27.656736 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:08:27.656736 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b769064b-9ef9-47b7-9cfd-5d3b8a24a7a1 could not be found. Oct 22 21:08:27.656736 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:08:27.656736 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:08:27.656736 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:08:27.661021 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:08:27.661021 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:08:27.661021 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:08:27.661021 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:08:27.661021 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:08:27.661021 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b769064b-9ef9-47b7-9cfd-5d3b8a24a7a1 could not be found. Oct 22 21:08:27.661021 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:08:27.661021 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-8d4ad77b-2721-4219-a757-78679a5ae8ac tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Returning 404 to user: Instance b769064b-9ef9-47b7-9cfd-5d3b8a24a7a1 could not be found. {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:08:27.661021 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-8d4ad77b-2721-4219-a757-78679a5ae8ac tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] 10.222.0.18 "GET /compute/v2.1/servers/b769064b-9ef9-47b7-9cfd-5d3b8a24a7a1" status: 404 len: 111 microversion: 2.1 time: 0.037230 Oct 22 21:08:27.661021 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2010/4017] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:08:27 2022] GET /compute/v2.1/servers/b769064b-9ef9-47b7-9cfd-5d3b8a24a7a1 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 21:08:27.667504 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-ba278bb7-ef90-4342-9f99-03ae93a007de tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:08:27.668007 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-ba278bb7-ef90-4342-9f99-03ae93a007de tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] [instance: e09b7865-0b24-4e50-a66a-342dd2e6e5e3] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:08:27.675275 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ba278bb7-ef90-4342-9f99-03ae93a007de tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:27.675834 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ba278bb7-ef90-4342-9f99-03ae93a007de tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:27.676270 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ba278bb7-ef90-4342-9f99-03ae93a007de tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:27.677001 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ba278bb7-ef90-4342-9f99-03ae93a007de tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:27.677470 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ba278bb7-ef90-4342-9f99-03ae93a007de tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:27.677909 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ba278bb7-ef90-4342-9f99-03ae93a007de tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:27.693911 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.wsgi [None req-ba278bb7-ef90-4342-9f99-03ae93a007de tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] HTTP exception thrown: Instance e09b7865-0b24-4e50-a66a-342dd2e6e5e3 could not be found. Oct 22 21:08:27.695545 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-ba278bb7-ef90-4342-9f99-03ae93a007de tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Request method failure captured: Oct 22 21:08:27.695545 ncdv-master-1 devstack@n-api.service[138745]: request: DELETE /compute/v2.1/servers/e09b7865-0b24-4e50-a66a-342dd2e6e5e3 HTTP/1.1 Oct 22 21:08:27.695545 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 21:08:27.695545 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 21:08:27.695545 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 21:08:27.695545 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 0 Oct 22 21:08:27.695545 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 21:08:27.695545 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 21:08:27.695545 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 21:08:27.695545 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 21:08:27.695545 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVFsqJwgEtdYV-w_0v7cJRFFuuKUgzjSW0YzaMXe4vNshtYfBJQjfUUjNq7ogfgnyyfHfQlDb133EFse1AQ_CYgs-ChUKvyu-eB9xtJK6gdS3hw1-p9Pjwb4k-IkY1kDuqsXV6_5Tm0Oikf-LC7PnT3-p1Ch5iA9fNzPUual9BJib5Jw Oct 22 21:08:27.695545 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 21:08:27.695545 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 21:08:27.695545 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 21:08:27.695545 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 21:08:27.695545 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 21:08:27.695545 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 21:08:27.695545 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: 48c774a85b2c41c98486cf91b1253363 Oct 22 21:08:27.695545 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-ServerDiskConfigTestJSON-735841139 Oct 22 21:08:27.695545 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 21:08:27.695545 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 21:08:27.695545 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_48c774a85b2c41c98486cf91b1253363"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/48c774a85b2c41c98486cf91b1253363"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/48c774a85b2c41c98486cf91b1253363"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/48c774a85b2c41c98486cf91b1253363"}]}] Oct 22 21:08:27.695545 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-ServerDiskConfigTestJSON-735841139 Oct 22 21:08:27.695545 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: 48c774a85b2c41c98486cf91b1253363 Oct 22 21:08:27.695545 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-735841139 Oct 22 21:08:27.695545 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-ServerDiskConfigTestJSON-735841139-project Oct 22 21:08:27.695545 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 21:08:27.695545 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 21:08:27.695545 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: bcdfeb6c1cda4810b9fa70fdfd9a66c8 Oct 22 21:08:27.695545 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-ServerDiskConfigTestJSON-735841139-project Oct 22 21:08:27.695545 ncdv-master-1 devstack@n-api.service[138745]: method: > Oct 22 21:08:27.695545 ncdv-master-1 devstack@n-api.service[138745]: exception: Instance e09b7865-0b24-4e50-a66a-342dd2e6e5e3 could not be found. Oct 22 21:08:27.695545 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'id': 'e09b7865-0b24-4e50-a66a-342dd2e6e5e3'} Oct 22 21:08:27.695545 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:08:27.695545 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:08:27.695545 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 21:08:27.695545 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 21:08:27.695545 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 21:08:27.695545 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 21:08:27.695545 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 21:08:27.695545 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 21:08:27.695545 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 21:08:27.695545 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 21:08:27.695545 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e09b7865-0b24-4e50-a66a-342dd2e6e5e3 could not be found. Oct 22 21:08:27.695545 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:08:27.695545 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:08:27.695545 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:08:27.695545 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:08:27.695545 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:08:27.695545 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:08:27.695545 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:08:27.695545 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:08:27.695545 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:08:27.695545 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:08:27.695545 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 22 21:08:27.695545 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 22 21:08:27.695545 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 22 21:08:27.695545 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 22 21:08:27.695545 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 21:08:27.695545 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 21:08:27.695545 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 21:08:27.695545 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:08:27.699963 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e09b7865-0b24-4e50-a66a-342dd2e6e5e3 could not be found. Oct 22 21:08:27.699963 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:08:27.699963 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:08:27.699963 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:08:27.699963 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:08:27.699963 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:08:27.699963 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:08:27.699963 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:08:27.699963 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:08:27.699963 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e09b7865-0b24-4e50-a66a-342dd2e6e5e3 could not be found. Oct 22 21:08:27.699963 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:08:27.699963 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-ba278bb7-ef90-4342-9f99-03ae93a007de tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Returning 404 to user: Instance e09b7865-0b24-4e50-a66a-342dd2e6e5e3 could not be found. {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:08:27.699963 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-ba278bb7-ef90-4342-9f99-03ae93a007de tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] 10.222.0.18 "DELETE /compute/v2.1/servers/e09b7865-0b24-4e50-a66a-342dd2e6e5e3" status: 404 len: 111 microversion: 2.1 time: 0.033807 Oct 22 21:08:27.699963 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2008/4018] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 21:08:27 2022] DELETE /compute/v2.1/servers/e09b7865-0b24-4e50-a66a-342dd2e6e5e3 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 21:08:27.706472 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-4c99ff91-1b61-4f16-8961-e4c746d12548 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:08:27.707126 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-4c99ff91-1b61-4f16-8961-e4c746d12548 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] [instance: e09b7865-0b24-4e50-a66a-342dd2e6e5e3] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:08:27.713570 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4c99ff91-1b61-4f16-8961-e4c746d12548 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:27.714064 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4c99ff91-1b61-4f16-8961-e4c746d12548 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:27.714492 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4c99ff91-1b61-4f16-8961-e4c746d12548 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:27.715213 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4c99ff91-1b61-4f16-8961-e4c746d12548 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:27.715817 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4c99ff91-1b61-4f16-8961-e4c746d12548 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:27.716243 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4c99ff91-1b61-4f16-8961-e4c746d12548 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:27.734358 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-4c99ff91-1b61-4f16-8961-e4c746d12548 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] HTTP exception thrown: Instance e09b7865-0b24-4e50-a66a-342dd2e6e5e3 could not be found. Oct 22 21:08:27.736734 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-4c99ff91-1b61-4f16-8961-e4c746d12548 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Request method failure captured: Oct 22 21:08:27.736734 ncdv-master-1 devstack@n-api.service[138744]: request: GET /compute/v2.1/servers/e09b7865-0b24-4e50-a66a-342dd2e6e5e3 HTTP/1.1 Oct 22 21:08:27.736734 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 21:08:27.736734 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 21:08:27.736734 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 21:08:27.736734 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 0 Oct 22 21:08:27.736734 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 21:08:27.736734 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 21:08:27.736734 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 21:08:27.736734 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 21:08:27.736734 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVFsqJwgEtdYV-w_0v7cJRFFuuKUgzjSW0YzaMXe4vNshtYfBJQjfUUjNq7ogfgnyyfHfQlDb133EFse1AQ_CYgs-ChUKvyu-eB9xtJK6gdS3hw1-p9Pjwb4k-IkY1kDuqsXV6_5Tm0Oikf-LC7PnT3-p1Ch5iA9fNzPUual9BJib5Jw Oct 22 21:08:27.736734 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 21:08:27.736734 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 21:08:27.736734 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 21:08:27.736734 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 21:08:27.736734 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 21:08:27.736734 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 21:08:27.736734 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: 48c774a85b2c41c98486cf91b1253363 Oct 22 21:08:27.736734 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-ServerDiskConfigTestJSON-735841139 Oct 22 21:08:27.736734 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 21:08:27.736734 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 21:08:27.736734 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_48c774a85b2c41c98486cf91b1253363"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/48c774a85b2c41c98486cf91b1253363"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/48c774a85b2c41c98486cf91b1253363"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/48c774a85b2c41c98486cf91b1253363"}]}] Oct 22 21:08:27.736734 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-ServerDiskConfigTestJSON-735841139 Oct 22 21:08:27.736734 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: 48c774a85b2c41c98486cf91b1253363 Oct 22 21:08:27.736734 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-735841139 Oct 22 21:08:27.736734 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-ServerDiskConfigTestJSON-735841139-project Oct 22 21:08:27.736734 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 21:08:27.736734 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 21:08:27.736734 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: bcdfeb6c1cda4810b9fa70fdfd9a66c8 Oct 22 21:08:27.736734 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-ServerDiskConfigTestJSON-735841139-project Oct 22 21:08:27.736734 ncdv-master-1 devstack@n-api.service[138744]: method: > Oct 22 21:08:27.736734 ncdv-master-1 devstack@n-api.service[138744]: exception: Instance e09b7865-0b24-4e50-a66a-342dd2e6e5e3 could not be found. Oct 22 21:08:27.736734 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': 'e09b7865-0b24-4e50-a66a-342dd2e6e5e3'} Oct 22 21:08:27.736734 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:08:27.736734 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:08:27.736734 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 21:08:27.736734 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 21:08:27.736734 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 21:08:27.736734 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 21:08:27.736734 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 21:08:27.736734 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 21:08:27.736734 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 21:08:27.736734 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 21:08:27.736734 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e09b7865-0b24-4e50-a66a-342dd2e6e5e3 could not be found. Oct 22 21:08:27.736734 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:08:27.736734 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:08:27.736734 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:08:27.736734 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:08:27.736734 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:08:27.736734 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:08:27.736734 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:08:27.736734 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:08:27.736734 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:08:27.736734 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:08:27.736734 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 21:08:27.736734 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 21:08:27.736734 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 21:08:27.736734 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 21:08:27.736734 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 21:08:27.736734 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:08:27.736734 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e09b7865-0b24-4e50-a66a-342dd2e6e5e3 could not be found. Oct 22 21:08:27.736734 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:08:27.736734 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:08:27.736734 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:08:27.741359 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:08:27.741359 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:08:27.741359 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:08:27.741359 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:08:27.741359 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:08:27.741359 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e09b7865-0b24-4e50-a66a-342dd2e6e5e3 could not be found. Oct 22 21:08:27.741359 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:08:27.741359 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-4c99ff91-1b61-4f16-8961-e4c746d12548 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] Returning 404 to user: Instance e09b7865-0b24-4e50-a66a-342dd2e6e5e3 could not be found. {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:08:27.741359 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-4c99ff91-1b61-4f16-8961-e4c746d12548 tempest-ServerDiskConfigTestJSON-735841139 tempest-ServerDiskConfigTestJSON-735841139-project] 10.222.0.18 "GET /compute/v2.1/servers/e09b7865-0b24-4e50-a66a-342dd2e6e5e3" status: 404 len: 111 microversion: 2.1 time: 0.035479 Oct 22 21:08:27.741359 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2011/4019] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:08:27 2022] GET /compute/v2.1/servers/e09b7865-0b24-4e50-a66a-342dd2e6e5e3 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 22 21:08:28.143140 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-50c2e2ae-75f5-4e6a-b433-8443a6e0e6d0 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:08:28.144134 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-50c2e2ae-75f5-4e6a-b433-8443a6e0e6d0 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] [instance: 5aa948d4-5141-4a18-8778-e8801a5bb9f5] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:08:28.152094 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-50c2e2ae-75f5-4e6a-b433-8443a6e0e6d0 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:28.152831 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-50c2e2ae-75f5-4e6a-b433-8443a6e0e6d0 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:28.153434 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-50c2e2ae-75f5-4e6a-b433-8443a6e0e6d0 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:28.154333 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-50c2e2ae-75f5-4e6a-b433-8443a6e0e6d0 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:28.154957 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-50c2e2ae-75f5-4e6a-b433-8443a6e0e6d0 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:28.155589 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-50c2e2ae-75f5-4e6a-b433-8443a6e0e6d0 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:28.246148 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-50c2e2ae-75f5-4e6a-b433-8443a6e0e6d0 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fab7ad5c77a437e9b7ca01c806ddd01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3385ef21cec84f6aa5ffa88bfdfd8646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:08:28.255684 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-50c2e2ae-75f5-4e6a-b433-8443a6e0e6d0 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fab7ad5c77a437e9b7ca01c806ddd01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3385ef21cec84f6aa5ffa88bfdfd8646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:08:28.257172 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-50c2e2ae-75f5-4e6a-b433-8443a6e0e6d0 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fab7ad5c77a437e9b7ca01c806ddd01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3385ef21cec84f6aa5ffa88bfdfd8646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:08:28.258422 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-50c2e2ae-75f5-4e6a-b433-8443a6e0e6d0 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] 10.222.0.18 "GET /compute/v2.1/servers/5aa948d4-5141-4a18-8778-e8801a5bb9f5" status: 200 len: 1408 microversion: 2.54 time: 0.119759 Oct 22 21:08:28.258921 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2009/4020] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:08:28 2022] GET /compute/v2.1/servers/5aa948d4-5141-4a18-8778-e8801a5bb9f5 => generated 1408 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:08:29.286211 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-eb335749-7725-4a4c-8f3f-cd35d764e037 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:08:29.287056 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-eb335749-7725-4a4c-8f3f-cd35d764e037 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] [instance: 5aa948d4-5141-4a18-8778-e8801a5bb9f5] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:08:29.304844 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-eb335749-7725-4a4c-8f3f-cd35d764e037 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:29.305812 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-eb335749-7725-4a4c-8f3f-cd35d764e037 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:29.307054 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-eb335749-7725-4a4c-8f3f-cd35d764e037 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:29.307955 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-eb335749-7725-4a4c-8f3f-cd35d764e037 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:29.308509 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-eb335749-7725-4a4c-8f3f-cd35d764e037 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:29.308946 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-eb335749-7725-4a4c-8f3f-cd35d764e037 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:29.425012 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-eb335749-7725-4a4c-8f3f-cd35d764e037 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fab7ad5c77a437e9b7ca01c806ddd01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3385ef21cec84f6aa5ffa88bfdfd8646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:08:29.440548 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-eb335749-7725-4a4c-8f3f-cd35d764e037 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fab7ad5c77a437e9b7ca01c806ddd01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3385ef21cec84f6aa5ffa88bfdfd8646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:08:29.442157 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-eb335749-7725-4a4c-8f3f-cd35d764e037 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fab7ad5c77a437e9b7ca01c806ddd01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3385ef21cec84f6aa5ffa88bfdfd8646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:08:29.443589 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-eb335749-7725-4a4c-8f3f-cd35d764e037 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] 10.222.0.18 "GET /compute/v2.1/servers/5aa948d4-5141-4a18-8778-e8801a5bb9f5" status: 200 len: 1408 microversion: 2.54 time: 0.162260 Oct 22 21:08:29.446354 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2012/4021] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:08:29 2022] GET /compute/v2.1/servers/5aa948d4-5141-4a18-8778-e8801a5bb9f5 => generated 1408 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 22 21:08:30.485604 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-65c12d7c-8e18-4acc-96a1-068c9b4234d1 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:08:30.487256 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-65c12d7c-8e18-4acc-96a1-068c9b4234d1 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] [instance: 5aa948d4-5141-4a18-8778-e8801a5bb9f5] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:08:30.504490 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-65c12d7c-8e18-4acc-96a1-068c9b4234d1 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:30.505653 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-65c12d7c-8e18-4acc-96a1-068c9b4234d1 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:30.507580 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-65c12d7c-8e18-4acc-96a1-068c9b4234d1 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:30.514277 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-65c12d7c-8e18-4acc-96a1-068c9b4234d1 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:30.516649 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-65c12d7c-8e18-4acc-96a1-068c9b4234d1 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:30.521627 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-65c12d7c-8e18-4acc-96a1-068c9b4234d1 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:30.675421 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-65c12d7c-8e18-4acc-96a1-068c9b4234d1 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fab7ad5c77a437e9b7ca01c806ddd01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3385ef21cec84f6aa5ffa88bfdfd8646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:08:30.682012 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:08:30.688523 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-65c12d7c-8e18-4acc-96a1-068c9b4234d1 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fab7ad5c77a437e9b7ca01c806ddd01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3385ef21cec84f6aa5ffa88bfdfd8646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:08:30.690621 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-65c12d7c-8e18-4acc-96a1-068c9b4234d1 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fab7ad5c77a437e9b7ca01c806ddd01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3385ef21cec84f6aa5ffa88bfdfd8646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:08:30.693353 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-65c12d7c-8e18-4acc-96a1-068c9b4234d1 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] 10.222.0.18 "GET /compute/v2.1/servers/5aa948d4-5141-4a18-8778-e8801a5bb9f5" status: 200 len: 1408 microversion: 2.54 time: 0.214267 Oct 22 21:08:30.694532 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2010/4022] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:08:30 2022] GET /compute/v2.1/servers/5aa948d4-5141-4a18-8778-e8801a5bb9f5 => generated 1408 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:08:31.722655 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-0f36a380-a5e4-4ea5-aa6e-7f6e44632ee0 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:08:31.724380 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-0f36a380-a5e4-4ea5-aa6e-7f6e44632ee0 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] [instance: 5aa948d4-5141-4a18-8778-e8801a5bb9f5] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:08:31.733064 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0f36a380-a5e4-4ea5-aa6e-7f6e44632ee0 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:31.733807 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0f36a380-a5e4-4ea5-aa6e-7f6e44632ee0 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:31.734357 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0f36a380-a5e4-4ea5-aa6e-7f6e44632ee0 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:31.735756 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0f36a380-a5e4-4ea5-aa6e-7f6e44632ee0 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:31.736615 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0f36a380-a5e4-4ea5-aa6e-7f6e44632ee0 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:31.737375 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0f36a380-a5e4-4ea5-aa6e-7f6e44632ee0 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:31.821583 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-0f36a380-a5e4-4ea5-aa6e-7f6e44632ee0 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fab7ad5c77a437e9b7ca01c806ddd01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3385ef21cec84f6aa5ffa88bfdfd8646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:08:31.832925 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-0f36a380-a5e4-4ea5-aa6e-7f6e44632ee0 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fab7ad5c77a437e9b7ca01c806ddd01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3385ef21cec84f6aa5ffa88bfdfd8646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:08:31.835388 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-0f36a380-a5e4-4ea5-aa6e-7f6e44632ee0 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fab7ad5c77a437e9b7ca01c806ddd01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3385ef21cec84f6aa5ffa88bfdfd8646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:08:31.837248 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-0f36a380-a5e4-4ea5-aa6e-7f6e44632ee0 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] 10.222.0.18 "GET /compute/v2.1/servers/5aa948d4-5141-4a18-8778-e8801a5bb9f5" status: 200 len: 1408 microversion: 2.54 time: 0.120546 Oct 22 21:08:31.848501 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2013/4023] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:08:31 2022] GET /compute/v2.1/servers/5aa948d4-5141-4a18-8778-e8801a5bb9f5 => generated 1408 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:08:32.867416 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-d6e5abbe-25d9-4836-9e97-13ffa62d1fa2 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:08:32.869097 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-d6e5abbe-25d9-4836-9e97-13ffa62d1fa2 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] [instance: 5aa948d4-5141-4a18-8778-e8801a5bb9f5] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:08:32.878176 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d6e5abbe-25d9-4836-9e97-13ffa62d1fa2 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:32.879249 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d6e5abbe-25d9-4836-9e97-13ffa62d1fa2 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:32.879991 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d6e5abbe-25d9-4836-9e97-13ffa62d1fa2 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:32.881330 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d6e5abbe-25d9-4836-9e97-13ffa62d1fa2 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:32.882071 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d6e5abbe-25d9-4836-9e97-13ffa62d1fa2 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:32.882733 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d6e5abbe-25d9-4836-9e97-13ffa62d1fa2 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:32.964896 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-d6e5abbe-25d9-4836-9e97-13ffa62d1fa2 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fab7ad5c77a437e9b7ca01c806ddd01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3385ef21cec84f6aa5ffa88bfdfd8646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:08:32.975021 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-d6e5abbe-25d9-4836-9e97-13ffa62d1fa2 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fab7ad5c77a437e9b7ca01c806ddd01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3385ef21cec84f6aa5ffa88bfdfd8646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:08:32.978749 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-d6e5abbe-25d9-4836-9e97-13ffa62d1fa2 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fab7ad5c77a437e9b7ca01c806ddd01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3385ef21cec84f6aa5ffa88bfdfd8646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:08:32.980284 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-d6e5abbe-25d9-4836-9e97-13ffa62d1fa2 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] 10.222.0.18 "GET /compute/v2.1/servers/5aa948d4-5141-4a18-8778-e8801a5bb9f5" status: 200 len: 1408 microversion: 2.54 time: 0.117369 Oct 22 21:08:32.980870 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2011/4024] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:08:32 2022] GET /compute/v2.1/servers/5aa948d4-5141-4a18-8778-e8801a5bb9f5 => generated 1408 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:08:34.007469 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-db0acc5a-a519-4824-9447-2de402c5ba97 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:08:34.008762 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-db0acc5a-a519-4824-9447-2de402c5ba97 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] [instance: 5aa948d4-5141-4a18-8778-e8801a5bb9f5] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:08:34.018354 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-db0acc5a-a519-4824-9447-2de402c5ba97 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:34.019504 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-db0acc5a-a519-4824-9447-2de402c5ba97 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:34.020209 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-db0acc5a-a519-4824-9447-2de402c5ba97 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:34.021401 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-db0acc5a-a519-4824-9447-2de402c5ba97 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:34.022083 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-db0acc5a-a519-4824-9447-2de402c5ba97 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:34.022801 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-db0acc5a-a519-4824-9447-2de402c5ba97 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:34.133755 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-db0acc5a-a519-4824-9447-2de402c5ba97 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fab7ad5c77a437e9b7ca01c806ddd01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3385ef21cec84f6aa5ffa88bfdfd8646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:08:34.143610 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-db0acc5a-a519-4824-9447-2de402c5ba97 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fab7ad5c77a437e9b7ca01c806ddd01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3385ef21cec84f6aa5ffa88bfdfd8646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:08:34.145593 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-db0acc5a-a519-4824-9447-2de402c5ba97 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fab7ad5c77a437e9b7ca01c806ddd01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3385ef21cec84f6aa5ffa88bfdfd8646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:08:34.147467 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-db0acc5a-a519-4824-9447-2de402c5ba97 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] 10.222.0.18 "GET /compute/v2.1/servers/5aa948d4-5141-4a18-8778-e8801a5bb9f5" status: 200 len: 1414 microversion: 2.54 time: 0.144047 Oct 22 21:08:34.148585 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2014/4025] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:08:34 2022] GET /compute/v2.1/servers/5aa948d4-5141-4a18-8778-e8801a5bb9f5 => generated 1414 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:08:35.178679 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-3761f955-ed36-47f1-b6d9-d3c8c5b4b994 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:08:35.180277 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-3761f955-ed36-47f1-b6d9-d3c8c5b4b994 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] [instance: 5aa948d4-5141-4a18-8778-e8801a5bb9f5] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:08:35.190136 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3761f955-ed36-47f1-b6d9-d3c8c5b4b994 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:35.191571 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3761f955-ed36-47f1-b6d9-d3c8c5b4b994 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:35.192319 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3761f955-ed36-47f1-b6d9-d3c8c5b4b994 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:35.193154 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3761f955-ed36-47f1-b6d9-d3c8c5b4b994 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:35.193635 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3761f955-ed36-47f1-b6d9-d3c8c5b4b994 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:35.194510 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3761f955-ed36-47f1-b6d9-d3c8c5b4b994 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:35.283494 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-3761f955-ed36-47f1-b6d9-d3c8c5b4b994 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fab7ad5c77a437e9b7ca01c806ddd01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3385ef21cec84f6aa5ffa88bfdfd8646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:08:35.299289 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-3761f955-ed36-47f1-b6d9-d3c8c5b4b994 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fab7ad5c77a437e9b7ca01c806ddd01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3385ef21cec84f6aa5ffa88bfdfd8646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:08:35.301374 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-3761f955-ed36-47f1-b6d9-d3c8c5b4b994 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fab7ad5c77a437e9b7ca01c806ddd01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3385ef21cec84f6aa5ffa88bfdfd8646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:08:35.303090 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-3761f955-ed36-47f1-b6d9-d3c8c5b4b994 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] 10.222.0.18 "GET /compute/v2.1/servers/5aa948d4-5141-4a18-8778-e8801a5bb9f5" status: 200 len: 1414 microversion: 2.54 time: 0.129466 Oct 22 21:08:35.307805 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2012/4026] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:08:35 2022] GET /compute/v2.1/servers/5aa948d4-5141-4a18-8778-e8801a5bb9f5 => generated 1414 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 22 21:08:36.334529 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-0ad12660-91fb-4da0-898d-029860f7cb86 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:08:36.335931 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-0ad12660-91fb-4da0-898d-029860f7cb86 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] [instance: 5aa948d4-5141-4a18-8778-e8801a5bb9f5] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:08:36.357204 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0ad12660-91fb-4da0-898d-029860f7cb86 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:36.358128 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0ad12660-91fb-4da0-898d-029860f7cb86 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:36.358880 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0ad12660-91fb-4da0-898d-029860f7cb86 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:36.360680 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0ad12660-91fb-4da0-898d-029860f7cb86 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:36.361155 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0ad12660-91fb-4da0-898d-029860f7cb86 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:36.362130 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0ad12660-91fb-4da0-898d-029860f7cb86 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:36.551591 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-0ad12660-91fb-4da0-898d-029860f7cb86 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fab7ad5c77a437e9b7ca01c806ddd01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3385ef21cec84f6aa5ffa88bfdfd8646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:08:36.569306 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-0ad12660-91fb-4da0-898d-029860f7cb86 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fab7ad5c77a437e9b7ca01c806ddd01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3385ef21cec84f6aa5ffa88bfdfd8646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:08:36.572996 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-0ad12660-91fb-4da0-898d-029860f7cb86 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fab7ad5c77a437e9b7ca01c806ddd01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3385ef21cec84f6aa5ffa88bfdfd8646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:08:36.584032 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-0ad12660-91fb-4da0-898d-029860f7cb86 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] 10.222.0.18 "GET /compute/v2.1/servers/5aa948d4-5141-4a18-8778-e8801a5bb9f5" status: 200 len: 1399 microversion: 2.54 time: 0.249109 Oct 22 21:08:36.587239 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2015/4027] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:08:36 2022] GET /compute/v2.1/servers/5aa948d4-5141-4a18-8778-e8801a5bb9f5 => generated 1399 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:08:36.615370 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-0342b725-858b-44a9-aef4-af41ee081d1c tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Calling method '.version_select at 0x7fd39ef325e0>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:08:36.667713 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-0342b725-858b-44a9-aef4-af41ee081d1c tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-919355600" status: 204 len: 0 microversion: 2.54 time: 0.056626 Oct 22 21:08:36.669250 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2013/4028] 10.222.0.18 () {60 vars in 1316 bytes} [Sat Oct 22 21:08:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-919355600 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 22 21:08:36.684091 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-cac0543a-92e5-4bc8-9997-aee660eb4c38 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:08:36.684931 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-cac0543a-92e5-4bc8-9997-aee660eb4c38 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] [instance: 5aa948d4-5141-4a18-8778-e8801a5bb9f5] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:08:36.699178 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cac0543a-92e5-4bc8-9997-aee660eb4c38 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:36.700045 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cac0543a-92e5-4bc8-9997-aee660eb4c38 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:36.700687 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cac0543a-92e5-4bc8-9997-aee660eb4c38 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:36.701627 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cac0543a-92e5-4bc8-9997-aee660eb4c38 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:36.702301 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cac0543a-92e5-4bc8-9997-aee660eb4c38 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:36.705321 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cac0543a-92e5-4bc8-9997-aee660eb4c38 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:36.748516 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-cac0543a-92e5-4bc8-9997-aee660eb4c38 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] [instance: 5aa948d4-5141-4a18-8778-e8801a5bb9f5] Going to try to terminate instance {{(pid=138744) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 21:08:36.890137 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-cac0543a-92e5-4bc8-9997-aee660eb4c38 tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] 10.222.0.18 "DELETE /compute/v2.1/servers/5aa948d4-5141-4a18-8778-e8801a5bb9f5" status: 204 len: 0 microversion: 2.54 time: 0.209835 Oct 22 21:08:36.891671 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2016/4029] 10.222.0.18 () {60 vars in 1280 bytes} [Sat Oct 22 21:08:36 2022] DELETE /compute/v2.1/servers/5aa948d4-5141-4a18-8778-e8801a5bb9f5 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 22 21:08:36.902952 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-0afa50cc-4c9c-4131-9cdf-e2b6e7d199ab tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:08:36.904154 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-0afa50cc-4c9c-4131-9cdf-e2b6e7d199ab tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] [instance: 5aa948d4-5141-4a18-8778-e8801a5bb9f5] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:08:36.925145 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0afa50cc-4c9c-4131-9cdf-e2b6e7d199ab tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:36.925676 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0afa50cc-4c9c-4131-9cdf-e2b6e7d199ab tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:36.926136 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0afa50cc-4c9c-4131-9cdf-e2b6e7d199ab tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:36.927136 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0afa50cc-4c9c-4131-9cdf-e2b6e7d199ab tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:36.932248 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0afa50cc-4c9c-4131-9cdf-e2b6e7d199ab tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:36.932729 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0afa50cc-4c9c-4131-9cdf-e2b6e7d199ab tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:37.079498 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-0afa50cc-4c9c-4131-9cdf-e2b6e7d199ab tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fab7ad5c77a437e9b7ca01c806ddd01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3385ef21cec84f6aa5ffa88bfdfd8646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:08:37.092613 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-0afa50cc-4c9c-4131-9cdf-e2b6e7d199ab tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fab7ad5c77a437e9b7ca01c806ddd01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3385ef21cec84f6aa5ffa88bfdfd8646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:08:37.101672 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-0afa50cc-4c9c-4131-9cdf-e2b6e7d199ab tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fab7ad5c77a437e9b7ca01c806ddd01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3385ef21cec84f6aa5ffa88bfdfd8646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:08:37.105087 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-0afa50cc-4c9c-4131-9cdf-e2b6e7d199ab tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] 10.222.0.18 "GET /compute/v2.1/servers/5aa948d4-5141-4a18-8778-e8801a5bb9f5" status: 200 len: 1405 microversion: 2.54 time: 0.206221 Oct 22 21:08:37.117209 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2014/4030] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:08:36 2022] GET /compute/v2.1/servers/5aa948d4-5141-4a18-8778-e8801a5bb9f5 => generated 1405 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:08:38.136145 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-7e168c6d-ad5e-4518-956c-3486b35777fb tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:08:38.136947 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-7e168c6d-ad5e-4518-956c-3486b35777fb tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] [instance: 5aa948d4-5141-4a18-8778-e8801a5bb9f5] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:08:38.158962 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7e168c6d-ad5e-4518-956c-3486b35777fb tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:38.159502 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7e168c6d-ad5e-4518-956c-3486b35777fb tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:38.159955 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7e168c6d-ad5e-4518-956c-3486b35777fb tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:38.160688 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7e168c6d-ad5e-4518-956c-3486b35777fb tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:38.161150 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7e168c6d-ad5e-4518-956c-3486b35777fb tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:38.161589 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7e168c6d-ad5e-4518-956c-3486b35777fb tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:38.301125 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-7e168c6d-ad5e-4518-956c-3486b35777fb tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fab7ad5c77a437e9b7ca01c806ddd01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3385ef21cec84f6aa5ffa88bfdfd8646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:08:38.319686 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-7e168c6d-ad5e-4518-956c-3486b35777fb tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fab7ad5c77a437e9b7ca01c806ddd01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3385ef21cec84f6aa5ffa88bfdfd8646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:08:38.321928 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-7e168c6d-ad5e-4518-956c-3486b35777fb tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fab7ad5c77a437e9b7ca01c806ddd01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3385ef21cec84f6aa5ffa88bfdfd8646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:08:38.324590 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-7e168c6d-ad5e-4518-956c-3486b35777fb tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] 10.222.0.18 "GET /compute/v2.1/servers/5aa948d4-5141-4a18-8778-e8801a5bb9f5" status: 200 len: 1405 microversion: 2.54 time: 0.193567 Oct 22 21:08:38.326880 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2017/4031] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:08:38 2022] GET /compute/v2.1/servers/5aa948d4-5141-4a18-8778-e8801a5bb9f5 => generated 1405 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:08:39.359976 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-2e2fb1b3-1fd2-400b-b374-99cae7a56f7f tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:08:39.361875 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-2e2fb1b3-1fd2-400b-b374-99cae7a56f7f tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] [instance: 5aa948d4-5141-4a18-8778-e8801a5bb9f5] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:08:39.374570 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2e2fb1b3-1fd2-400b-b374-99cae7a56f7f tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:39.375926 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-c24ec4e1-4b65-4f2b-83b5-36358c660122 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-884546737", "imageRef": "085e4478-6edc-4a69-8e08-f9831713eb65", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:08:39.379090 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2e2fb1b3-1fd2-400b-b374-99cae7a56f7f tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:39.381269 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2e2fb1b3-1fd2-400b-b374-99cae7a56f7f tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:39.382306 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2e2fb1b3-1fd2-400b-b374-99cae7a56f7f tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:39.382969 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2e2fb1b3-1fd2-400b-b374-99cae7a56f7f tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:39.383803 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2e2fb1b3-1fd2-400b-b374-99cae7a56f7f tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:39.388924 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_api:SELECT=84,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:08:39.465568 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2e2fb1b3-1fd2-400b-b374-99cae7a56f7f tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:39.467161 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2e2fb1b3-1fd2-400b-b374-99cae7a56f7f tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:39.470007 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.network.neutron [None req-c24ec4e1-4b65-4f2b-83b5-36358c660122 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] validate_networks() for [('0f6a9346-decf-4445-964c-ecc7ed99cf8c', None, None, None, None, None)] {{(pid=138745) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 21:08:39.471241 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2e2fb1b3-1fd2-400b-b374-99cae7a56f7f tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:39.480551 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.objects.instance [None req-2e2fb1b3-1fd2-400b-b374-99cae7a56f7f tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Lazy-loading 'fault' on Instance uuid 5aa948d4-5141-4a18-8778-e8801a5bb9f5 {{(pid=138744) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 21:08:39.608146 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-2e2fb1b3-1fd2-400b-b374-99cae7a56f7f tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fab7ad5c77a437e9b7ca01c806ddd01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3385ef21cec84f6aa5ffa88bfdfd8646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:08:39.619316 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-2e2fb1b3-1fd2-400b-b374-99cae7a56f7f tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fab7ad5c77a437e9b7ca01c806ddd01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3385ef21cec84f6aa5ffa88bfdfd8646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:08:39.621215 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-2e2fb1b3-1fd2-400b-b374-99cae7a56f7f tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fab7ad5c77a437e9b7ca01c806ddd01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3385ef21cec84f6aa5ffa88bfdfd8646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:08:39.622699 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-2e2fb1b3-1fd2-400b-b374-99cae7a56f7f tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] 10.222.0.18 "GET /compute/v2.1/servers/5aa948d4-5141-4a18-8778-e8801a5bb9f5" status: 200 len: 1410 microversion: 2.54 time: 0.269545 Oct 22 21:08:39.623528 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2018/4032] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:08:39 2022] GET /compute/v2.1/servers/5aa948d4-5141-4a18-8778-e8801a5bb9f5 => generated 1410 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:08:39.975780 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-c24ec4e1-4b65-4f2b-83b5-36358c660122 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Flavor limits 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 21:08:39.976391 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-c24ec4e1-4b65-4f2b-83b5-36358c660122 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Image limits 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 21:08:39.977536 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-c24ec4e1-4b65-4f2b-83b5-36358c660122 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Flavor pref 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 21:08:39.977536 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-c24ec4e1-4b65-4f2b-83b5-36358c660122 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Image pref 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 21:08:39.977974 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-c24ec4e1-4b65-4f2b-83b5-36358c660122 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 21:08:39.992319 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c24ec4e1-4b65-4f2b-83b5-36358c660122 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:39.992826 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c24ec4e1-4b65-4f2b-83b5-36358c660122 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:39.993685 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c24ec4e1-4b65-4f2b-83b5-36358c660122 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:39.994413 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c24ec4e1-4b65-4f2b-83b5-36358c660122 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:39.994885 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c24ec4e1-4b65-4f2b-83b5-36358c660122 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:39.995514 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c24ec4e1-4b65-4f2b-83b5-36358c660122 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:40.023760 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-c24ec4e1-4b65-4f2b-83b5-36358c660122 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Getting quotas for project dddce0c46c75496f96f2e2dae77751dc. Resources: {'cores', 'instances', 'ram'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 21:08:40.031533 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-c24ec4e1-4b65-4f2b-83b5-36358c660122 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Getting quotas for user 67e7a09f769748629425ad36120a7fd6 and project dddce0c46c75496f96f2e2dae77751dc. Resources: {'cores', 'instances', 'ram'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 21:08:40.056678 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-c24ec4e1-4b65-4f2b-83b5-36358c660122 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Going to run 1 instances... {{(pid=138745) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 21:08:40.059449 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-c24ec4e1-4b65-4f2b-83b5-36358c660122 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] [instance: 4b876a5c-1d6e-4960-a3f9-f30cc7dc03fa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='085e4478-6edc-4a69-8e08-f9831713eb65',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138745) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 21:08:40.111383 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-c24ec4e1-4b65-4f2b-83b5-36358c660122 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.942923 Oct 22 21:08:40.112317 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2015/4033] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Oct 22 21:08:39 2022] POST /compute/v2.1/servers => generated 383 bytes in 945 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 21:08:40.126064 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-5cf1c83c-c386-4f21-aaa8-d3c958145424 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:08:40.127390 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-5cf1c83c-c386-4f21-aaa8-d3c958145424 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] [instance: 4b876a5c-1d6e-4960-a3f9-f30cc7dc03fa] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:08:40.133512 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=1 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:08:40.196173 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-5cf1c83c-c386-4f21-aaa8-d3c958145424 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e7a09f769748629425ad36120a7fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddce0c46c75496f96f2e2dae77751dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:08:40.204961 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-5cf1c83c-c386-4f21-aaa8-d3c958145424 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] 10.222.0.18 "GET /compute/v2.1/servers/4b876a5c-1d6e-4960-a3f9-f30cc7dc03fa" status: 200 len: 1221 microversion: 2.1 time: 0.083530 Oct 22 21:08:40.205536 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2019/4034] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:08:40 2022] GET /compute/v2.1/servers/4b876a5c-1d6e-4960-a3f9-f30cc7dc03fa => generated 1221 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:08:40.364866 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-0bde9638-a9fd-4243-a0e1-27401287e48e tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-483314822", "imageRef": "085e4478-6edc-4a69-8e08-f9831713eb65", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:08:40.443443 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.network.neutron [None req-0bde9638-a9fd-4243-a0e1-27401287e48e tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] validate_networks() for [('0f6a9346-decf-4445-964c-ecc7ed99cf8c', None, None, None, None, None)] {{(pid=138745) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 21:08:40.653810 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-74e34e45-0de6-460e-8fed-84c94c36a01f tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:08:40.654928 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-74e34e45-0de6-460e-8fed-84c94c36a01f tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] [instance: 5aa948d4-5141-4a18-8778-e8801a5bb9f5] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:08:40.677029 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-74e34e45-0de6-460e-8fed-84c94c36a01f tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:40.677874 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-74e34e45-0de6-460e-8fed-84c94c36a01f tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:40.681910 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-74e34e45-0de6-460e-8fed-84c94c36a01f tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:40.685457 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-74e34e45-0de6-460e-8fed-84c94c36a01f tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:40.687524 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-74e34e45-0de6-460e-8fed-84c94c36a01f tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:40.688497 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-74e34e45-0de6-460e-8fed-84c94c36a01f tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:40.719804 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-74e34e45-0de6-460e-8fed-84c94c36a01f tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] HTTP exception thrown: Instance 5aa948d4-5141-4a18-8778-e8801a5bb9f5 could not be found. Oct 22 21:08:40.722792 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-74e34e45-0de6-460e-8fed-84c94c36a01f tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Request method failure captured: Oct 22 21:08:40.722792 ncdv-master-1 devstack@n-api.service[138744]: request: GET /compute/v2.1/servers/5aa948d4-5141-4a18-8778-e8801a5bb9f5 HTTP/1.1 Oct 22 21:08:40.722792 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 21:08:40.722792 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 21:08:40.722792 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 21:08:40.722792 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 0 Oct 22 21:08:40.722792 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 21:08:40.722792 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 21:08:40.722792 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 21:08:40.722792 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 21:08:40.722792 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVFuq5lJM0OQvrD1nhvB2CHYCQERoKaT9D9UvBhmJWCmC7LQGlCKfbO4Q4-pI4FHtG-TP-O1lnuXFWugu58jz9Ml8oAh3qKztJArzr1JksEz1RQCAlwzZchJhKdsPye_ADMYRZw-cUZuvE7LLtQ5qQySFHMXugwFXS2m2VBWGhq_HrRQ Oct 22 21:08:40.722792 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 21:08:40.722792 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 21:08:40.722792 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 21:08:40.722792 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 21:08:40.722792 ncdv-master-1 devstack@n-api.service[138744]: X-Openstack-Nova-Api-Version: 2.54 Oct 22 21:08:40.722792 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 21:08:40.722792 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 21:08:40.722792 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: 3385ef21cec84f6aa5ffa88bfdfd8646 Oct 22 21:08:40.722792 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-ServerShowV254Test-1801471287 Oct 22 21:08:40.722792 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 21:08:40.722792 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 21:08:40.722792 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_3385ef21cec84f6aa5ffa88bfdfd8646"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/3385ef21cec84f6aa5ffa88bfdfd8646"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/3385ef21cec84f6aa5ffa88bfdfd8646"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/3385ef21cec84f6aa5ffa88bfdfd8646"}]}] Oct 22 21:08:40.722792 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-ServerShowV254Test-1801471287 Oct 22 21:08:40.722792 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: 3385ef21cec84f6aa5ffa88bfdfd8646 Oct 22 21:08:40.722792 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-ServerShowV254Test-1801471287 Oct 22 21:08:40.722792 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-ServerShowV254Test-1801471287-project Oct 22 21:08:40.722792 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 21:08:40.722792 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 21:08:40.722792 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: 2fab7ad5c77a437e9b7ca01c806ddd01 Oct 22 21:08:40.722792 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-ServerShowV254Test-1801471287-project Oct 22 21:08:40.722792 ncdv-master-1 devstack@n-api.service[138744]: method: > Oct 22 21:08:40.722792 ncdv-master-1 devstack@n-api.service[138744]: exception: Instance 5aa948d4-5141-4a18-8778-e8801a5bb9f5 could not be found. Oct 22 21:08:40.722792 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': '5aa948d4-5141-4a18-8778-e8801a5bb9f5'} Oct 22 21:08:40.722792 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:08:40.722792 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:08:40.722792 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 21:08:40.722792 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 21:08:40.722792 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 21:08:40.722792 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 21:08:40.722792 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 21:08:40.722792 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 21:08:40.722792 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 21:08:40.722792 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 21:08:40.722792 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5aa948d4-5141-4a18-8778-e8801a5bb9f5 could not be found. Oct 22 21:08:40.722792 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:08:40.722792 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:08:40.722792 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:08:40.722792 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:08:40.722792 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:08:40.722792 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:08:40.722792 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:08:40.722792 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:08:40.722792 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:08:40.722792 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:08:40.722792 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 21:08:40.722792 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 21:08:40.722792 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 21:08:40.722792 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 21:08:40.722792 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 21:08:40.722792 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:08:40.722792 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5aa948d4-5141-4a18-8778-e8801a5bb9f5 could not be found. Oct 22 21:08:40.722792 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:08:40.722792 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:08:40.722792 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:08:40.729838 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:08:40.729838 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:08:40.729838 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:08:40.729838 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:08:40.729838 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:08:40.729838 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5aa948d4-5141-4a18-8778-e8801a5bb9f5 could not be found. Oct 22 21:08:40.729838 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:08:40.729838 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-74e34e45-0de6-460e-8fed-84c94c36a01f tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] Returning 404 to user: Instance 5aa948d4-5141-4a18-8778-e8801a5bb9f5 could not be found. {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:08:40.732165 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-74e34e45-0de6-460e-8fed-84c94c36a01f tempest-ServerShowV254Test-1801471287 tempest-ServerShowV254Test-1801471287-project] 10.222.0.18 "GET /compute/v2.1/servers/5aa948d4-5141-4a18-8778-e8801a5bb9f5" status: 404 len: 111 microversion: 2.54 time: 0.076361 Oct 22 21:08:40.733233 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2020/4035] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:08:40 2022] GET /compute/v2.1/servers/5aa948d4-5141-4a18-8778-e8801a5bb9f5 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 22 21:08:41.140866 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-0bde9638-a9fd-4243-a0e1-27401287e48e tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Flavor limits 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 21:08:41.141935 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-0bde9638-a9fd-4243-a0e1-27401287e48e tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Image limits 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 21:08:41.142449 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-0bde9638-a9fd-4243-a0e1-27401287e48e tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Flavor pref 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 21:08:41.142888 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-0bde9638-a9fd-4243-a0e1-27401287e48e tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Image pref 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 21:08:41.143323 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-0bde9638-a9fd-4243-a0e1-27401287e48e tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 21:08:41.162839 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0bde9638-a9fd-4243-a0e1-27401287e48e tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:41.186018 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0bde9638-a9fd-4243-a0e1-27401287e48e tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:41.186583 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0bde9638-a9fd-4243-a0e1-27401287e48e tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:41.187332 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0bde9638-a9fd-4243-a0e1-27401287e48e tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:41.187827 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0bde9638-a9fd-4243-a0e1-27401287e48e tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:41.188552 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0bde9638-a9fd-4243-a0e1-27401287e48e tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:41.222515 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-0bde9638-a9fd-4243-a0e1-27401287e48e tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Getting quotas for project dddce0c46c75496f96f2e2dae77751dc. Resources: {'cores', 'instances', 'ram'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 21:08:41.231025 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-0bde9638-a9fd-4243-a0e1-27401287e48e tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Getting quotas for user 67e7a09f769748629425ad36120a7fd6 and project dddce0c46c75496f96f2e2dae77751dc. Resources: {'cores', 'instances', 'ram'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 21:08:41.247270 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-0bde9638-a9fd-4243-a0e1-27401287e48e tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Going to run 1 instances... {{(pid=138745) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 21:08:41.250262 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-0bde9638-a9fd-4243-a0e1-27401287e48e tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] [instance: ff57c0ad-9f38-4c58-a194-b0b0d39b1fe0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='085e4478-6edc-4a69-8e08-f9831713eb65',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138745) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 21:08:41.363276 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-0bde9638-a9fd-4243-a0e1-27401287e48e tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.004282 Oct 22 21:08:41.367675 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2016/4036] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Oct 22 21:08:40 2022] POST /compute/v2.1/servers => generated 383 bytes in 1009 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 21:08:41.377625 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-feee48e1-7903-41b1-91d0-44bab33ec4c8 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:08:41.378724 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-feee48e1-7903-41b1-91d0-44bab33ec4c8 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] [instance: ff57c0ad-9f38-4c58-a194-b0b0d39b1fe0] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:08:41.471198 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-feee48e1-7903-41b1-91d0-44bab33ec4c8 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e7a09f769748629425ad36120a7fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddce0c46c75496f96f2e2dae77751dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:08:41.479422 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-feee48e1-7903-41b1-91d0-44bab33ec4c8 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] 10.222.0.18 "GET /compute/v2.1/servers/ff57c0ad-9f38-4c58-a194-b0b0d39b1fe0" status: 200 len: 1221 microversion: 2.1 time: 0.106522 Oct 22 21:08:41.480093 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2021/4037] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:08:41 2022] GET /compute/v2.1/servers/ff57c0ad-9f38-4c58-a194-b0b0d39b1fe0 => generated 1221 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:08:42.504290 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-ae6ac358-8d26-43ad-b92f-4b84bc2e8c41 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:08:42.505965 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-ae6ac358-8d26-43ad-b92f-4b84bc2e8c41 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] [instance: ff57c0ad-9f38-4c58-a194-b0b0d39b1fe0] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:08:42.525782 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ae6ac358-8d26-43ad-b92f-4b84bc2e8c41 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:42.526713 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ae6ac358-8d26-43ad-b92f-4b84bc2e8c41 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:42.527391 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ae6ac358-8d26-43ad-b92f-4b84bc2e8c41 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:42.528316 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ae6ac358-8d26-43ad-b92f-4b84bc2e8c41 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:42.528955 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ae6ac358-8d26-43ad-b92f-4b84bc2e8c41 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:42.529558 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ae6ac358-8d26-43ad-b92f-4b84bc2e8c41 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:43.319474 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-ae6ac358-8d26-43ad-b92f-4b84bc2e8c41 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e7a09f769748629425ad36120a7fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddce0c46c75496f96f2e2dae77751dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:08:43.334292 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-ae6ac358-8d26-43ad-b92f-4b84bc2e8c41 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] 10.222.0.18 "GET /compute/v2.1/servers/ff57c0ad-9f38-4c58-a194-b0b0d39b1fe0" status: 200 len: 1273 microversion: 2.1 time: 0.835569 Oct 22 21:08:43.338478 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2017/4038] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:08:42 2022] GET /compute/v2.1/servers/ff57c0ad-9f38-4c58-a194-b0b0d39b1fe0 => generated 1273 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:08:43.763252 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-f38c7f4e-f8bc-41aa-86f5-3409028084c9 tempest-ExtensionsTest-1372444231 tempest-ExtensionsTest-1372444231-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:08:43.766529 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-f38c7f4e-f8bc-41aa-86f5-3409028084c9 tempest-ExtensionsTest-1372444231 tempest-ExtensionsTest-1372444231-project] 10.222.0.18 "GET /compute/v2.1/extensions/os-consoles" status: 200 len: 217 microversion: 2.1 time: 0.274351 Oct 22 21:08:43.767715 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2022/4039] 10.222.0.18 () {58 vars in 1170 bytes} [Sat Oct 22 21:08:43 2022] GET /compute/v2.1/extensions/os-consoles => generated 217 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:08:43.777207 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-5abc401f-c124-47ef-b4cf-9e90b061e665 tempest-ExtensionsTest-1372444231 tempest-ExtensionsTest-1372444231-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:08:43.781476 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-5abc401f-c124-47ef-b4cf-9e90b061e665 tempest-ExtensionsTest-1372444231 tempest-ExtensionsTest-1372444231-project] 10.222.0.18 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.007972 Oct 22 21:08:43.782709 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2018/4040] 10.222.0.18 () {58 vars in 1134 bytes} [Sat Oct 22 21:08:43 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 10 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 22 21:08:44.358641 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-ae5541af-4a1e-4ac9-883a-b0535f71a97f tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:08:44.359275 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-ae5541af-4a1e-4ac9-883a-b0535f71a97f tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] [instance: ff57c0ad-9f38-4c58-a194-b0b0d39b1fe0] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:08:44.377437 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ae5541af-4a1e-4ac9-883a-b0535f71a97f tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:44.378185 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ae5541af-4a1e-4ac9-883a-b0535f71a97f tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:44.378763 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ae5541af-4a1e-4ac9-883a-b0535f71a97f tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:44.384265 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ae5541af-4a1e-4ac9-883a-b0535f71a97f tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:44.384857 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ae5541af-4a1e-4ac9-883a-b0535f71a97f tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:44.385488 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ae5541af-4a1e-4ac9-883a-b0535f71a97f tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:44.516800 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-ae5541af-4a1e-4ac9-883a-b0535f71a97f tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e7a09f769748629425ad36120a7fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddce0c46c75496f96f2e2dae77751dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:08:44.543056 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-ae5541af-4a1e-4ac9-883a-b0535f71a97f tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] 10.222.0.18 "GET /compute/v2.1/servers/ff57c0ad-9f38-4c58-a194-b0b0d39b1fe0" status: 200 len: 1279 microversion: 2.1 time: 0.189144 Oct 22 21:08:44.544367 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2023/4041] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:08:44 2022] GET /compute/v2.1/servers/ff57c0ad-9f38-4c58-a194-b0b0d39b1fe0 => generated 1279 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:08:45.567328 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-81bd79b9-cf59-40bf-9176-deb9f5369e0e tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:08:45.567978 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-81bd79b9-cf59-40bf-9176-deb9f5369e0e tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] [instance: ff57c0ad-9f38-4c58-a194-b0b0d39b1fe0] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:08:45.581032 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-81bd79b9-cf59-40bf-9176-deb9f5369e0e tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:45.581865 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-81bd79b9-cf59-40bf-9176-deb9f5369e0e tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:45.582332 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-81bd79b9-cf59-40bf-9176-deb9f5369e0e tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:45.583066 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-81bd79b9-cf59-40bf-9176-deb9f5369e0e tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:45.583560 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-81bd79b9-cf59-40bf-9176-deb9f5369e0e tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:45.584168 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-81bd79b9-cf59-40bf-9176-deb9f5369e0e tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:45.990524 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-81bd79b9-cf59-40bf-9176-deb9f5369e0e tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e7a09f769748629425ad36120a7fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddce0c46c75496f96f2e2dae77751dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:08:46.004912 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-81bd79b9-cf59-40bf-9176-deb9f5369e0e tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] 10.222.0.18 "GET /compute/v2.1/servers/ff57c0ad-9f38-4c58-a194-b0b0d39b1fe0" status: 200 len: 1321 microversion: 2.1 time: 0.441961 Oct 22 21:08:46.007085 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2019/4042] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:08:45 2022] GET /compute/v2.1/servers/ff57c0ad-9f38-4c58-a194-b0b0d39b1fe0 => generated 1321 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:08:46.222885 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-308cfef1-69fa-41a2-b8cd-2b085e96919d req-2b94d105-e4a2-4631-9d25-74ec7936044d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b876a5c-1d6e-4960-a3f9-f30cc7dc03fa", "tag": "44279202-b16f-4c41-a450-1186c656375b"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:08:46.252277 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-308cfef1-69fa-41a2-b8cd-2b085e96919d req-2b94d105-e4a2-4631-9d25-74ec7936044d service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:46.252947 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-308cfef1-69fa-41a2-b8cd-2b085e96919d req-2b94d105-e4a2-4631-9d25-74ec7936044d service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:46.255114 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-308cfef1-69fa-41a2-b8cd-2b085e96919d req-2b94d105-e4a2-4631-9d25-74ec7936044d service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:46.260511 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:08:46.269212 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-308cfef1-69fa-41a2-b8cd-2b085e96919d req-2b94d105-e4a2-4631-9d25-74ec7936044d service nova] Creating event network-changed:44279202-b16f-4c41-a450-1186c656375b for instance 4b876a5c-1d6e-4960-a3f9-f30cc7dc03fa on nch2-master-1 Oct 22 21:08:46.274900 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-308cfef1-69fa-41a2-b8cd-2b085e96919d req-2b94d105-e4a2-4631-9d25-74ec7936044d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056891 Oct 22 21:08:46.276091 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2024/4043] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:08:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:08:46.794494 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-c01b9fc0-547c-46bc-9c78-4e4cf93dc01e tempest-QuotasTestJSON-175143964 tempest-QuotasTestJSON-175143964-project] Calling method '.version_select at 0x7fd3a4233a60>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:08:47.032699 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-5e78d9cf-fce6-42e0-847e-260a56d0fcac tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:08:47.033424 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-5e78d9cf-fce6-42e0-847e-260a56d0fcac tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] [instance: ff57c0ad-9f38-4c58-a194-b0b0d39b1fe0] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:08:47.033982 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-c01b9fc0-547c-46bc-9c78-4e4cf93dc01e tempest-QuotasTestJSON-175143964 tempest-QuotasTestJSON-175143964-project] 10.222.0.18 "GET /compute/v2.1/os-quota-sets/f7f9c1d243404dc9ad434d3ada94cf98/defaults" status: 200 len: 371 microversion: 2.1 time: 0.416749 Oct 22 21:08:47.034592 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2020/4044] 10.222.0.18 () {58 vars in 1269 bytes} [Sat Oct 22 21:08:46 2022] GET /compute/v2.1/os-quota-sets/f7f9c1d243404dc9ad434d3ada94cf98/defaults => generated 371 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:08:47.045403 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5e78d9cf-fce6-42e0-847e-260a56d0fcac tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:47.045791 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5e78d9cf-fce6-42e0-847e-260a56d0fcac tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:47.046249 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5e78d9cf-fce6-42e0-847e-260a56d0fcac tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:47.046978 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5e78d9cf-fce6-42e0-847e-260a56d0fcac tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:47.047653 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5e78d9cf-fce6-42e0-847e-260a56d0fcac tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:47.048110 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5e78d9cf-fce6-42e0-847e-260a56d0fcac tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:47.049253 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-3201d8eb-f83b-4e58-8e62-d0f2be20e83f tempest-QuotasTestJSON-175143964 tempest-QuotasTestJSON-175143964-project] Calling method '.version_select at 0x7fd39eebcd30>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:08:47.148114 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-3201d8eb-f83b-4e58-8e62-d0f2be20e83f tempest-QuotasTestJSON-175143964 tempest-QuotasTestJSON-175143964-project] 10.222.0.18 "GET /compute/v2.1/os-quota-sets/f7f9c1d243404dc9ad434d3ada94cf98" status: 200 len: 371 microversion: 2.1 time: 0.103653 Oct 22 21:08:47.149016 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2021/4045] 10.222.0.18 () {58 vars in 1242 bytes} [Sat Oct 22 21:08:47 2022] GET /compute/v2.1/os-quota-sets/f7f9c1d243404dc9ad434d3ada94cf98 => generated 371 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:08:47.163164 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-4591f5f8-e1c2-4136-bb4a-42a9c83742c7 tempest-QuotasTestJSON-175143964 tempest-QuotasTestJSON-175143964-project] Calling method '.version_select at 0x7fd39fcd81f0>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:08:47.343090 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-5e78d9cf-fce6-42e0-847e-260a56d0fcac tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e7a09f769748629425ad36120a7fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddce0c46c75496f96f2e2dae77751dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:08:47.355314 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-5e78d9cf-fce6-42e0-847e-260a56d0fcac tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] 10.222.0.18 "GET /compute/v2.1/servers/ff57c0ad-9f38-4c58-a194-b0b0d39b1fe0" status: 200 len: 1321 microversion: 2.1 time: 0.327630 Oct 22 21:08:47.357466 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2025/4046] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:08:47 2022] GET /compute/v2.1/servers/ff57c0ad-9f38-4c58-a194-b0b0d39b1fe0 => generated 1321 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:08:47.391602 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-4591f5f8-e1c2-4136-bb4a-42a9c83742c7 tempest-QuotasTestJSON-175143964 tempest-QuotasTestJSON-175143964-project] 10.222.0.18 "GET /compute/v2.1/os-quota-sets/f7f9c1d243404dc9ad434d3ada94cf98/defaults" status: 200 len: 371 microversion: 2.1 time: 0.232001 Oct 22 21:08:47.401913 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2022/4047] 10.222.0.18 () {58 vars in 1269 bytes} [Sat Oct 22 21:08:47 2022] GET /compute/v2.1/os-quota-sets/f7f9c1d243404dc9ad434d3ada94cf98/defaults => generated 371 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:08:47.407590 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-eca1d48a-6bb7-4d5b-8573-ea19c0bd6269 tempest-QuotasTestJSON-175143964 tempest-QuotasTestJSON-175143964-project] Calling method '.version_select at 0x7fd3a8bc1310>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:08:47.628678 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-eca1d48a-6bb7-4d5b-8573-ea19c0bd6269 tempest-QuotasTestJSON-175143964 tempest-QuotasTestJSON-175143964-project] 10.222.0.18 "GET /compute/v2.1/os-quota-sets/f7f9c1d243404dc9ad434d3ada94cf98" status: 200 len: 371 microversion: 2.1 time: 0.224866 Oct 22 21:08:47.629554 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2026/4048] 10.222.0.18 () {58 vars in 1242 bytes} [Sat Oct 22 21:08:47 2022] GET /compute/v2.1/os-quota-sets/f7f9c1d243404dc9ad434d3ada94cf98 => generated 371 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:08:47.642402 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-09f405a9-1350-4fe4-9da2-b51b81881459 tempest-QuotasTestJSON-175143964 tempest-QuotasTestJSON-175143964-project] Calling method '.version_select at 0x7fd39fd7cca0>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:08:47.723755 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-09f405a9-1350-4fe4-9da2-b51b81881459 tempest-QuotasTestJSON-175143964 tempest-QuotasTestJSON-175143964-project] 10.222.0.18 "GET /compute/v2.1/os-quota-sets/f7f9c1d243404dc9ad434d3ada94cf98?user_id=9735d1d612504d6fab47039f784d1b2c" status: 200 len: 371 microversion: 2.1 time: 0.085155 Oct 22 21:08:47.724390 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2023/4049] 10.222.0.18 () {58 vars in 1323 bytes} [Sat Oct 22 21:08:47 2022] GET /compute/v2.1/os-quota-sets/f7f9c1d243404dc9ad434d3ada94cf98?user_id=9735d1d612504d6fab47039f784d1b2c => generated 371 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:08:48.308391 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-43143f68-ee58-4ed6-bb75-39747ac7110e req-f427ebb5-3cfe-4d3a-af97-1a81f2776f79 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff57c0ad-9f38-4c58-a194-b0b0d39b1fe0", "tag": "a468dbb2-8145-4a08-a5cc-6ae5bb40141f"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:08:48.323125 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-43143f68-ee58-4ed6-bb75-39747ac7110e req-f427ebb5-3cfe-4d3a-af97-1a81f2776f79 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:48.323876 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-43143f68-ee58-4ed6-bb75-39747ac7110e req-f427ebb5-3cfe-4d3a-af97-1a81f2776f79 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:48.324698 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-43143f68-ee58-4ed6-bb75-39747ac7110e req-f427ebb5-3cfe-4d3a-af97-1a81f2776f79 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:48.338329 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-43143f68-ee58-4ed6-bb75-39747ac7110e req-f427ebb5-3cfe-4d3a-af97-1a81f2776f79 service nova] Creating event network-changed:a468dbb2-8145-4a08-a5cc-6ae5bb40141f for instance ff57c0ad-9f38-4c58-a194-b0b0d39b1fe0 on nch1-master-1 Oct 22 21:08:48.344419 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-43143f68-ee58-4ed6-bb75-39747ac7110e req-f427ebb5-3cfe-4d3a-af97-1a81f2776f79 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040063 Oct 22 21:08:48.345921 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2027/4050] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:08:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:08:48.383678 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-2d7c1131-c776-454c-b4fc-0fc3a347cd82 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:08:48.384391 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-2d7c1131-c776-454c-b4fc-0fc3a347cd82 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] [instance: ff57c0ad-9f38-4c58-a194-b0b0d39b1fe0] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:08:48.395079 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2d7c1131-c776-454c-b4fc-0fc3a347cd82 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:48.396642 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2d7c1131-c776-454c-b4fc-0fc3a347cd82 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:48.398419 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2d7c1131-c776-454c-b4fc-0fc3a347cd82 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:48.400984 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2d7c1131-c776-454c-b4fc-0fc3a347cd82 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:48.400984 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2d7c1131-c776-454c-b4fc-0fc3a347cd82 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:48.401406 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2d7c1131-c776-454c-b4fc-0fc3a347cd82 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:48.709008 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-2d7c1131-c776-454c-b4fc-0fc3a347cd82 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e7a09f769748629425ad36120a7fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddce0c46c75496f96f2e2dae77751dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:08:48.722654 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-2d7c1131-c776-454c-b4fc-0fc3a347cd82 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] 10.222.0.18 "GET /compute/v2.1/servers/ff57c0ad-9f38-4c58-a194-b0b0d39b1fe0" status: 200 len: 1321 microversion: 2.1 time: 0.345669 Oct 22 21:08:48.723976 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2024/4051] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:08:48 2022] GET /compute/v2.1/servers/ff57c0ad-9f38-4c58-a194-b0b0d39b1fe0 => generated 1321 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:08:49.635927 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-43143f68-ee58-4ed6-bb75-39747ac7110e req-f427ebb5-3cfe-4d3a-af97-1a81f2776f79 service nova] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:08:49.637085 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-43143f68-ee58-4ed6-bb75-39747ac7110e req-f427ebb5-3cfe-4d3a-af97-1a81f2776f79 service nova] 10.222.0.18 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001724 Oct 22 21:08:49.644309 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2028/4052] 10.222.0.18 () {56 vars in 886 bytes} [Sat Oct 22 21:08:49 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (2 switches on core 0) Oct 22 21:08:49.646368 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-2d7c1131-c776-454c-b4fc-0fc3a347cd82 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:08:49.647913 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-2d7c1131-c776-454c-b4fc-0fc3a347cd82 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] 10.222.0.18 "GET /compute/v2/" status: 200 len: 379 microversion: 2.1 time: 0.002188 Oct 22 21:08:49.648508 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2025/4053] 10.222.0.18 () {54 vars in 1035 bytes} [Sat Oct 22 21:08:49 2022] GET /compute/v2/ => generated 379 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 221 bytes (1 switches on core 0) Oct 22 21:08:49.656797 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-43143f68-ee58-4ed6-bb75-39747ac7110e req-f427ebb5-3cfe-4d3a-af97-1a81f2776f79 service nova] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:08:49.659202 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-43143f68-ee58-4ed6-bb75-39747ac7110e req-f427ebb5-3cfe-4d3a-af97-1a81f2776f79 service nova] 10.222.0.18 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.002673 Oct 22 21:08:49.659989 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2029/4054] 10.222.0.18 () {54 vars in 1041 bytes} [Sat Oct 22 21:08:49 2022] GET /compute/v2.1/ => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:08:49.669355 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-2d7c1131-c776-454c-b4fc-0fc3a347cd82 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:08:49.670354 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-2d7c1131-c776-454c-b4fc-0fc3a347cd82 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] 10.222.0.18 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001444 Oct 22 21:08:49.670695 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2026/4055] 10.222.0.18 () {56 vars in 886 bytes} [Sat Oct 22 21:08:49 2022] GET /compute/ => generated 377 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 22 21:08:49.753781 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-9761441b-9c92-4d56-96ea-2da409198da7 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:08:49.763986 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-9761441b-9c92-4d56-96ea-2da409198da7 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] [instance: ff57c0ad-9f38-4c58-a194-b0b0d39b1fe0] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:08:49.776668 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9761441b-9c92-4d56-96ea-2da409198da7 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:49.777436 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9761441b-9c92-4d56-96ea-2da409198da7 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:49.778249 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9761441b-9c92-4d56-96ea-2da409198da7 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:49.779158 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9761441b-9c92-4d56-96ea-2da409198da7 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:49.779921 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9761441b-9c92-4d56-96ea-2da409198da7 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:49.780519 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9761441b-9c92-4d56-96ea-2da409198da7 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:49.937829 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-9761441b-9c92-4d56-96ea-2da409198da7 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e7a09f769748629425ad36120a7fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddce0c46c75496f96f2e2dae77751dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:08:49.969837 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-9761441b-9c92-4d56-96ea-2da409198da7 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] 10.222.0.18 "GET /compute/v2.1/servers/ff57c0ad-9f38-4c58-a194-b0b0d39b1fe0" status: 200 len: 1321 microversion: 2.1 time: 0.222574 Oct 22 21:08:49.970844 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2030/4056] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:08:49 2022] GET /compute/v2.1/servers/ff57c0ad-9f38-4c58-a194-b0b0d39b1fe0 => generated 1321 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:08:51.003569 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-57cfc70f-6a18-4e44-ac8f-8b9e09534499 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:08:51.003569 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-57cfc70f-6a18-4e44-ac8f-8b9e09534499 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] [instance: ff57c0ad-9f38-4c58-a194-b0b0d39b1fe0] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:08:51.009961 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-57cfc70f-6a18-4e44-ac8f-8b9e09534499 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:51.010794 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-57cfc70f-6a18-4e44-ac8f-8b9e09534499 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:51.011447 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-57cfc70f-6a18-4e44-ac8f-8b9e09534499 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:51.012231 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-57cfc70f-6a18-4e44-ac8f-8b9e09534499 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:51.012740 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-57cfc70f-6a18-4e44-ac8f-8b9e09534499 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:51.013192 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-57cfc70f-6a18-4e44-ac8f-8b9e09534499 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:51.117503 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-3e46f43f-c124-4548-99b3-f02721d26035 req-d6af5af0-81f1-4706-8a93-4d7d7eaa73e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b876a5c-1d6e-4960-a3f9-f30cc7dc03fa", "name": "network-vif-plugged", "status": "completed", "tag": "44279202-b16f-4c41-a450-1186c656375b"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:08:51.147924 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-3e46f43f-c124-4548-99b3-f02721d26035 req-d6af5af0-81f1-4706-8a93-4d7d7eaa73e6 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:51.151629 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-3e46f43f-c124-4548-99b3-f02721d26035 req-d6af5af0-81f1-4706-8a93-4d7d7eaa73e6 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:51.152247 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-3e46f43f-c124-4548-99b3-f02721d26035 req-d6af5af0-81f1-4706-8a93-4d7d7eaa73e6 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:51.204162 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell0:SELECT=4 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:08:51.205599 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-3e46f43f-c124-4548-99b3-f02721d26035 req-d6af5af0-81f1-4706-8a93-4d7d7eaa73e6 service nova] Creating event network-vif-plugged:44279202-b16f-4c41-a450-1186c656375b for instance 4b876a5c-1d6e-4960-a3f9-f30cc7dc03fa on nch2-master-1 Oct 22 21:08:51.220827 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-3e46f43f-c124-4548-99b3-f02721d26035 req-d6af5af0-81f1-4706-8a93-4d7d7eaa73e6 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107356 Oct 22 21:08:51.221464 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2031/4057] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:08:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 21:08:51.315858 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-57cfc70f-6a18-4e44-ac8f-8b9e09534499 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e7a09f769748629425ad36120a7fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddce0c46c75496f96f2e2dae77751dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:08:51.329630 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-57cfc70f-6a18-4e44-ac8f-8b9e09534499 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] 10.222.0.18 "GET /compute/v2.1/servers/ff57c0ad-9f38-4c58-a194-b0b0d39b1fe0" status: 200 len: 1321 microversion: 2.1 time: 0.339013 Oct 22 21:08:51.331408 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2027/4058] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:08:50 2022] GET /compute/v2.1/servers/ff57c0ad-9f38-4c58-a194-b0b0d39b1fe0 => generated 1321 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:08:51.807953 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-f9e45d77-1c5e-4f2c-97e9-4da17026874c tempest-VolumesSnapshotsTestJSON-449412194 tempest-VolumesSnapshotsTestJSON-449412194-project] Action: 'create', calling method: .version_select at 0x7fd39fee38b0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-260373374"}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:08:52.150712 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-f9e45d77-1c5e-4f2c-97e9-4da17026874c tempest-VolumesSnapshotsTestJSON-449412194 tempest-VolumesSnapshotsTestJSON-449412194-project] 10.222.0.18 "POST /compute/v2.1/os-volumes" status: 200 len: 337 microversion: 2.1 time: 0.505360 Oct 22 21:08:52.151628 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2032/4059] 10.222.0.18 () {60 vars in 1155 bytes} [Sat Oct 22 21:08:51 2022] POST /compute/v2.1/os-volumes => generated 337 bytes in 507 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 22 21:08:52.170428 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-03b85f29-8962-440d-a1e3-8174fec8390a tempest-VolumesSnapshotsTestJSON-449412194 tempest-VolumesSnapshotsTestJSON-449412194-project] Calling method '.version_select at 0x7fd3a4233dc0>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:08:52.253371 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-03b85f29-8962-440d-a1e3-8174fec8390a tempest-VolumesSnapshotsTestJSON-449412194 tempest-VolumesSnapshotsTestJSON-449412194-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/e181745b-d71c-49fd-8bff-fbeab4fe3a88" status: 200 len: 337 microversion: 2.1 time: 0.092500 Oct 22 21:08:52.256551 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2028/4060] 10.222.0.18 () {58 vars in 1245 bytes} [Sat Oct 22 21:08:52 2022] GET /compute/v2.1/os-volumes/e181745b-d71c-49fd-8bff-fbeab4fe3a88 => generated 337 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:08:52.357572 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-2d9a21a3-31fe-4a81-958e-198a873a3566 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:08:52.358322 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-2d9a21a3-31fe-4a81-958e-198a873a3566 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] [instance: ff57c0ad-9f38-4c58-a194-b0b0d39b1fe0] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:08:52.369620 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2d9a21a3-31fe-4a81-958e-198a873a3566 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:52.370126 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2d9a21a3-31fe-4a81-958e-198a873a3566 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:52.370569 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2d9a21a3-31fe-4a81-958e-198a873a3566 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:52.378637 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2d9a21a3-31fe-4a81-958e-198a873a3566 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:52.379124 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2d9a21a3-31fe-4a81-958e-198a873a3566 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:52.379597 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2d9a21a3-31fe-4a81-958e-198a873a3566 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:52.564770 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-2d9a21a3-31fe-4a81-958e-198a873a3566 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e7a09f769748629425ad36120a7fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddce0c46c75496f96f2e2dae77751dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:08:52.573151 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-2d9a21a3-31fe-4a81-958e-198a873a3566 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] 10.222.0.18 "GET /compute/v2.1/servers/ff57c0ad-9f38-4c58-a194-b0b0d39b1fe0" status: 200 len: 1321 microversion: 2.1 time: 0.219819 Oct 22 21:08:52.573734 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2033/4061] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:08:52 2022] GET /compute/v2.1/servers/ff57c0ad-9f38-4c58-a194-b0b0d39b1fe0 => generated 1321 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:08:53.269271 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-08e24e8c-35ca-4c02-b899-361e361568b0 tempest-VolumesSnapshotsTestJSON-449412194 tempest-VolumesSnapshotsTestJSON-449412194-project] Calling method '.version_select at 0x7fd39ee93280>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:08:53.330499 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-08e24e8c-35ca-4c02-b899-361e361568b0 tempest-VolumesSnapshotsTestJSON-449412194 tempest-VolumesSnapshotsTestJSON-449412194-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/e181745b-d71c-49fd-8bff-fbeab4fe3a88" status: 200 len: 338 microversion: 2.1 time: 0.066545 Oct 22 21:08:53.331170 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2029/4062] 10.222.0.18 () {58 vars in 1245 bytes} [Sat Oct 22 21:08:53 2022] GET /compute/v2.1/os-volumes/e181745b-d71c-49fd-8bff-fbeab4fe3a88 => generated 338 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:08:53.344342 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-ae7473c8-ec92-40c0-9ab7-02ed72caf890 tempest-VolumesSnapshotsTestJSON-449412194 tempest-VolumesSnapshotsTestJSON-449412194-project] Action: 'create', calling method: .version_select at 0x7fd3a4560430>, body: {"snapshot": {"volume_id": "e181745b-d71c-49fd-8bff-fbeab4fe3a88", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-675434323"}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:08:53.550908 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-ae7473c8-ec92-40c0-9ab7-02ed72caf890 tempest-VolumesSnapshotsTestJSON-449412194 tempest-VolumesSnapshotsTestJSON-449412194-project] 10.222.0.18 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.210480 Oct 22 21:08:53.551957 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2034/4063] 10.222.0.18 () {60 vars in 1162 bytes} [Sat Oct 22 21:08:53 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:08:53.565206 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-f3b77201-a1e1-4ead-95b2-abdf3acfeee0 tempest-VolumesSnapshotsTestJSON-449412194 tempest-VolumesSnapshotsTestJSON-449412194-project] Calling method '.version_select at 0x7fd39ee3ff70>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:08:53.603248 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-90f109bd-db8d-4955-bdac-83cb21863269 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:08:53.604316 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-90f109bd-db8d-4955-bdac-83cb21863269 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] [instance: ff57c0ad-9f38-4c58-a194-b0b0d39b1fe0] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:08:53.618538 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-90f109bd-db8d-4955-bdac-83cb21863269 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:53.621716 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-90f109bd-db8d-4955-bdac-83cb21863269 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:53.622478 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-90f109bd-db8d-4955-bdac-83cb21863269 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:53.623640 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-90f109bd-db8d-4955-bdac-83cb21863269 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:53.624932 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-90f109bd-db8d-4955-bdac-83cb21863269 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:53.627775 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-90f109bd-db8d-4955-bdac-83cb21863269 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:53.629256 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-f3b77201-a1e1-4ead-95b2-abdf3acfeee0 tempest-VolumesSnapshotsTestJSON-449412194 tempest-VolumesSnapshotsTestJSON-449412194-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/c61ef67d-4c62-4cbf-9b87-4c8aafc614ed" status: 200 len: 286 microversion: 2.1 time: 0.070263 Oct 22 21:08:53.631318 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2030/4064] 10.222.0.18 () {58 vars in 1251 bytes} [Sat Oct 22 21:08:53 2022] GET /compute/v2.1/os-snapshots/c61ef67d-4c62-4cbf-9b87-4c8aafc614ed => generated 286 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:08:53.665214 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-be19f1df-4704-4f47-8340-819bc7c7c374 tempest-VolumesSnapshotsTestJSON-449412194 tempest-VolumesSnapshotsTestJSON-449412194-project] Calling method '.version_select at 0x7fd39ee43790>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:08:53.759268 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-be19f1df-4704-4f47-8340-819bc7c7c374 tempest-VolumesSnapshotsTestJSON-449412194 tempest-VolumesSnapshotsTestJSON-449412194-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.098350 Oct 22 21:08:53.759268 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2031/4065] 10.222.0.18 () {58 vars in 1140 bytes} [Sat Oct 22 21:08:53 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:08:53.769850 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-d07577c5-5b08-48d0-a34d-66ce9d4928eb tempest-VolumesSnapshotsTestJSON-449412194 tempest-VolumesSnapshotsTestJSON-449412194-project] Calling method '.version_select at 0x7fd39eebcf70>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:08:53.806381 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-d07577c5-5b08-48d0-a34d-66ce9d4928eb tempest-VolumesSnapshotsTestJSON-449412194 tempest-VolumesSnapshotsTestJSON-449412194-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/c61ef67d-4c62-4cbf-9b87-4c8aafc614ed" status: 200 len: 286 microversion: 2.1 time: 0.040311 Oct 22 21:08:53.807213 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2032/4066] 10.222.0.18 () {58 vars in 1251 bytes} [Sat Oct 22 21:08:53 2022] GET /compute/v2.1/os-snapshots/c61ef67d-4c62-4cbf-9b87-4c8aafc614ed => generated 286 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 21:08:53.934710 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-90f109bd-db8d-4955-bdac-83cb21863269 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e7a09f769748629425ad36120a7fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddce0c46c75496f96f2e2dae77751dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:08:53.943892 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-90f109bd-db8d-4955-bdac-83cb21863269 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] 10.222.0.18 "GET /compute/v2.1/servers/ff57c0ad-9f38-4c58-a194-b0b0d39b1fe0" status: 200 len: 1321 microversion: 2.1 time: 0.349278 Oct 22 21:08:53.944661 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2035/4067] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:08:53 2022] GET /compute/v2.1/servers/ff57c0ad-9f38-4c58-a194-b0b0d39b1fe0 => generated 1321 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:08:54.002899 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-e579281c-7c66-4f6d-a63c-acccbccba563 req-1cab4e0c-3b4c-4545-ad41-550aff7bf912 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff57c0ad-9f38-4c58-a194-b0b0d39b1fe0", "name": "network-vif-plugged", "status": "completed", "tag": "a468dbb2-8145-4a08-a5cc-6ae5bb40141f"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:08:54.013695 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-e579281c-7c66-4f6d-a63c-acccbccba563 req-1cab4e0c-3b4c-4545-ad41-550aff7bf912 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:54.014336 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-e579281c-7c66-4f6d-a63c-acccbccba563 req-1cab4e0c-3b4c-4545-ad41-550aff7bf912 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:54.014794 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-e579281c-7c66-4f6d-a63c-acccbccba563 req-1cab4e0c-3b4c-4545-ad41-550aff7bf912 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:54.030997 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-e579281c-7c66-4f6d-a63c-acccbccba563 req-1cab4e0c-3b4c-4545-ad41-550aff7bf912 service nova] Creating event network-vif-plugged:a468dbb2-8145-4a08-a5cc-6ae5bb40141f for instance ff57c0ad-9f38-4c58-a194-b0b0d39b1fe0 on nch1-master-1 Oct 22 21:08:54.038004 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-e579281c-7c66-4f6d-a63c-acccbccba563 req-1cab4e0c-3b4c-4545-ad41-550aff7bf912 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039554 Oct 22 21:08:54.038815 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2033/4068] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:08:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:08:54.820807 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-c347a385-f720-421c-91f3-61c68614f70e tempest-VolumesSnapshotsTestJSON-449412194 tempest-VolumesSnapshotsTestJSON-449412194-project] Calling method '.version_select at 0x7fd3a440a160>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:08:54.870134 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-c347a385-f720-421c-91f3-61c68614f70e tempest-VolumesSnapshotsTestJSON-449412194 tempest-VolumesSnapshotsTestJSON-449412194-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/c61ef67d-4c62-4cbf-9b87-4c8aafc614ed" status: 200 len: 287 microversion: 2.1 time: 0.054084 Oct 22 21:08:54.871143 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2036/4069] 10.222.0.18 () {58 vars in 1251 bytes} [Sat Oct 22 21:08:54 2022] GET /compute/v2.1/os-snapshots/c61ef67d-4c62-4cbf-9b87-4c8aafc614ed => generated 287 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:08:54.887225 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-0b3f3f90-2a16-4412-a867-5ad009b4d2cc tempest-VolumesSnapshotsTestJSON-449412194 tempest-VolumesSnapshotsTestJSON-449412194-project] Calling method '.version_select at 0x7fd39ee43820>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:08:54.967232 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-0b3f3f90-2a16-4412-a867-5ad009b4d2cc tempest-VolumesSnapshotsTestJSON-449412194 tempest-VolumesSnapshotsTestJSON-449412194-project] 10.222.0.18 "DELETE /compute/v2.1/os-snapshots/c61ef67d-4c62-4cbf-9b87-4c8aafc614ed" status: 202 len: 0 microversion: 2.1 time: 0.085083 Oct 22 21:08:54.968092 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2034/4070] 10.222.0.18 () {58 vars in 1254 bytes} [Sat Oct 22 21:08:54 2022] DELETE /compute/v2.1/os-snapshots/c61ef67d-4c62-4cbf-9b87-4c8aafc614ed => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 21:08:54.968313 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-03c4ce4b-6806-46b3-a692-83d5871b6454 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:08:54.968991 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-03c4ce4b-6806-46b3-a692-83d5871b6454 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] [instance: ff57c0ad-9f38-4c58-a194-b0b0d39b1fe0] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:08:54.982833 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-47725dc0-278e-4205-a006-cada22161e80 tempest-VolumesSnapshotsTestJSON-449412194 tempest-VolumesSnapshotsTestJSON-449412194-project] Calling method '.version_select at 0x7fd39ee93430>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:08:54.986870 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-03c4ce4b-6806-46b3-a692-83d5871b6454 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:54.987403 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-03c4ce4b-6806-46b3-a692-83d5871b6454 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:54.987860 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-03c4ce4b-6806-46b3-a692-83d5871b6454 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:54.988736 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-03c4ce4b-6806-46b3-a692-83d5871b6454 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:54.991484 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-03c4ce4b-6806-46b3-a692-83d5871b6454 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:54.992172 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-03c4ce4b-6806-46b3-a692-83d5871b6454 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:55.035546 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-47725dc0-278e-4205-a006-cada22161e80 tempest-VolumesSnapshotsTestJSON-449412194 tempest-VolumesSnapshotsTestJSON-449412194-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/c61ef67d-4c62-4cbf-9b87-4c8aafc614ed" status: 200 len: 286 microversion: 2.1 time: 0.061929 Oct 22 21:08:55.036863 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2035/4071] 10.222.0.18 () {58 vars in 1251 bytes} [Sat Oct 22 21:08:54 2022] GET /compute/v2.1/os-snapshots/c61ef67d-4c62-4cbf-9b87-4c8aafc614ed => generated 286 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:08:55.196845 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-03c4ce4b-6806-46b3-a692-83d5871b6454 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e7a09f769748629425ad36120a7fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddce0c46c75496f96f2e2dae77751dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:08:55.207695 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-03c4ce4b-6806-46b3-a692-83d5871b6454 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] 10.222.0.18 "GET /compute/v2.1/servers/ff57c0ad-9f38-4c58-a194-b0b0d39b1fe0" status: 200 len: 1321 microversion: 2.1 time: 0.243970 Oct 22 21:08:55.208288 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2037/4072] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:08:54 2022] GET /compute/v2.1/servers/ff57c0ad-9f38-4c58-a194-b0b0d39b1fe0 => generated 1321 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:08:56.052040 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-ee666160-033c-4212-bde4-ab7da38cc98f tempest-VolumesSnapshotsTestJSON-449412194 tempest-VolumesSnapshotsTestJSON-449412194-project] Calling method '.version_select at 0x7fd39fd30f70>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:08:56.095807 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.wsgi [None req-ee666160-033c-4212-bde4-ab7da38cc98f tempest-VolumesSnapshotsTestJSON-449412194 tempest-VolumesSnapshotsTestJSON-449412194-project] HTTP exception thrown: Snapshot c61ef67d-4c62-4cbf-9b87-4c8aafc614ed could not be found. Oct 22 21:08:56.113944 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-ee666160-033c-4212-bde4-ab7da38cc98f tempest-VolumesSnapshotsTestJSON-449412194 tempest-VolumesSnapshotsTestJSON-449412194-project] Request method failure captured: Oct 22 21:08:56.113944 ncdv-master-1 devstack@n-api.service[138745]: request: GET /compute/v2.1/os-snapshots/c61ef67d-4c62-4cbf-9b87-4c8aafc614ed HTTP/1.1 Oct 22 21:08:56.113944 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 21:08:56.113944 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 21:08:56.113944 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 21:08:56.113944 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 0 Oct 22 21:08:56.113944 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 21:08:56.113944 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 21:08:56.113944 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 21:08:56.113944 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 21:08:56.113944 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVFvjX4Eg1ddjQa4HmPU587kE_72Rsdh1d_8kuq2sRJNd1T44Ee8pAeVLUZ8SlNvSeTxH-13C9JXvpVmF3ztMve48SIkE1hOMb1e9v401-BA265TJ4NaJZ0xBN2Dd9JHc4YXN2H7qA_nhOqa5OG8FMThlWkp1iwDE5RLtmD7n-xGyaHY Oct 22 21:08:56.113944 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 21:08:56.113944 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 21:08:56.113944 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 21:08:56.113944 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 21:08:56.113944 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 21:08:56.113944 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 21:08:56.113944 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: 52be7dbbbb564c21a11f0597368f9639 Oct 22 21:08:56.113944 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-449412194 Oct 22 21:08:56.113944 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 21:08:56.113944 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 21:08:56.113944 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_52be7dbbbb564c21a11f0597368f9639"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/52be7dbbbb564c21a11f0597368f9639"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/52be7dbbbb564c21a11f0597368f9639"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/52be7dbbbb564c21a11f0597368f9639"}]}] Oct 22 21:08:56.113944 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-VolumesSnapshotsTestJSON-449412194 Oct 22 21:08:56.113944 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: 52be7dbbbb564c21a11f0597368f9639 Oct 22 21:08:56.113944 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-449412194 Oct 22 21:08:56.113944 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-VolumesSnapshotsTestJSON-449412194-project Oct 22 21:08:56.113944 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 21:08:56.113944 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 21:08:56.113944 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: a412a877095a48628146bd1c23ebeddb Oct 22 21:08:56.113944 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-VolumesSnapshotsTestJSON-449412194-project Oct 22 21:08:56.113944 ncdv-master-1 devstack@n-api.service[138745]: method: Oct 22 21:08:56.113944 ncdv-master-1 devstack@n-api.service[138745]: exception: Snapshot c61ef67d-4c62-4cbf-9b87-4c8aafc614ed could not be found. Oct 22 21:08:56.113944 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'id': 'c61ef67d-4c62-4cbf-9b87-4c8aafc614ed'} Oct 22 21:08:56.113944 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:08:56.113944 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:08:56.113944 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 22 21:08:56.113944 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 22 21:08:56.113944 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 22 21:08:56.113944 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 22 21:08:56.113944 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 22 21:08:56.113944 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 22 21:08:56.113944 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 22 21:08:56.113944 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 22 21:08:56.113944 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 22 21:08:56.113944 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 22 21:08:56.113944 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 22 21:08:56.113944 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 22 21:08:56.113944 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 22 21:08:56.113944 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 22 21:08:56.113944 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot c61ef67d-4c62-4cbf-9b87-4c8aafc614ed could not be found. (HTTP 404) (Request-ID: req-83d5b1b2-f3d2-478a-b823-8e5684a22eaf) Oct 22 21:08:56.113944 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:08:56.113944 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:08:56.113944 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:08:56.113944 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:08:56.113944 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Oct 22 21:08:56.113944 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Oct 22 21:08:56.113944 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 22 21:08:56.113944 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 22 21:08:56.113944 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Oct 22 21:08:56.113944 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Oct 22 21:08:56.113944 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 22 21:08:56.113944 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 22 21:08:56.117902 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 22 21:08:56.117902 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 22 21:08:56.117902 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 22 21:08:56.117902 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 22 21:08:56.117902 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 22 21:08:56.117902 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 22 21:08:56.117902 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 22 21:08:56.117902 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 22 21:08:56.117902 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 22 21:08:56.117902 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 22 21:08:56.117902 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 22 21:08:56.117902 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 22 21:08:56.117902 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 22 21:08:56.117902 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 22 21:08:56.117902 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot c61ef67d-4c62-4cbf-9b87-4c8aafc614ed could not be found. Oct 22 21:08:56.117902 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:08:56.117902 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:08:56.117902 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:08:56.117902 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:08:56.117902 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:08:56.117902 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:08:56.117902 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:08:56.117902 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:08:56.117902 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 22 21:08:56.117902 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 22 21:08:56.117902 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:08:56.117902 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:08:56.117902 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Oct 22 21:08:56.117902 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:08:56.117902 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot c61ef67d-4c62-4cbf-9b87-4c8aafc614ed could not be found. Oct 22 21:08:56.117902 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:08:56.117902 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:08:56.117902 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:08:56.117902 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:08:56.117902 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:08:56.117902 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:08:56.117902 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:08:56.117902 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:08:56.117902 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot c61ef67d-4c62-4cbf-9b87-4c8aafc614ed could not be found. Oct 22 21:08:56.117902 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:08:56.117902 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-ee666160-033c-4212-bde4-ab7da38cc98f tempest-VolumesSnapshotsTestJSON-449412194 tempest-VolumesSnapshotsTestJSON-449412194-project] Returning 404 to user: Snapshot c61ef67d-4c62-4cbf-9b87-4c8aafc614ed could not be found. {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:08:56.117902 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-ee666160-033c-4212-bde4-ab7da38cc98f tempest-VolumesSnapshotsTestJSON-449412194 tempest-VolumesSnapshotsTestJSON-449412194-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/c61ef67d-4c62-4cbf-9b87-4c8aafc614ed" status: 404 len: 111 microversion: 2.1 time: 0.069705 Oct 22 21:08:56.117902 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2036/4073] 10.222.0.18 () {58 vars in 1251 bytes} [Sat Oct 22 21:08:56 2022] GET /compute/v2.1/os-snapshots/c61ef67d-4c62-4cbf-9b87-4c8aafc614ed => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 21:08:56.126715 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-534591ad-8945-40a6-8dbd-b8d7eb5e6285 tempest-VolumesSnapshotsTestJSON-449412194 tempest-VolumesSnapshotsTestJSON-449412194-project] Calling method '.version_select at 0x7fd3a4483310>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:08:56.231075 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-534591ad-8945-40a6-8dbd-b8d7eb5e6285 tempest-VolumesSnapshotsTestJSON-449412194 tempest-VolumesSnapshotsTestJSON-449412194-project] 10.222.0.18 "DELETE /compute/v2.1/os-volumes/e181745b-d71c-49fd-8bff-fbeab4fe3a88" status: 202 len: 0 microversion: 2.1 time: 0.103030 Oct 22 21:08:56.233717 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2038/4074] 10.222.0.18 () {58 vars in 1248 bytes} [Sat Oct 22 21:08:56 2022] DELETE /compute/v2.1/os-volumes/e181745b-d71c-49fd-8bff-fbeab4fe3a88 => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 21:08:56.251237 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-5bf6e8e7-a682-4da5-9436-859e67fe1345 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:08:56.251535 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-cef5116a-4a60-4203-8a7d-6272be017c9e tempest-VolumesSnapshotsTestJSON-449412194 tempest-VolumesSnapshotsTestJSON-449412194-project] Calling method '.version_select at 0x7fd39f070430>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:08:56.253133 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-5bf6e8e7-a682-4da5-9436-859e67fe1345 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] [instance: ff57c0ad-9f38-4c58-a194-b0b0d39b1fe0] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:08:56.272854 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5bf6e8e7-a682-4da5-9436-859e67fe1345 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:56.273409 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5bf6e8e7-a682-4da5-9436-859e67fe1345 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:56.273977 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5bf6e8e7-a682-4da5-9436-859e67fe1345 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:56.275090 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5bf6e8e7-a682-4da5-9436-859e67fe1345 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:56.275205 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5bf6e8e7-a682-4da5-9436-859e67fe1345 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:56.276402 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5bf6e8e7-a682-4da5-9436-859e67fe1345 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:56.369126 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-cef5116a-4a60-4203-8a7d-6272be017c9e tempest-VolumesSnapshotsTestJSON-449412194 tempest-VolumesSnapshotsTestJSON-449412194-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/e181745b-d71c-49fd-8bff-fbeab4fe3a88" status: 200 len: 337 microversion: 2.1 time: 0.130242 Oct 22 21:08:56.370395 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2039/4075] 10.222.0.18 () {58 vars in 1245 bytes} [Sat Oct 22 21:08:56 2022] GET /compute/v2.1/os-volumes/e181745b-d71c-49fd-8bff-fbeab4fe3a88 => generated 337 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:08:56.692977 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-5bf6e8e7-a682-4da5-9436-859e67fe1345 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e7a09f769748629425ad36120a7fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddce0c46c75496f96f2e2dae77751dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:08:56.703848 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-5bf6e8e7-a682-4da5-9436-859e67fe1345 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] 10.222.0.18 "GET /compute/v2.1/servers/ff57c0ad-9f38-4c58-a194-b0b0d39b1fe0" status: 200 len: 1516 microversion: 2.1 time: 0.476876 Oct 22 21:08:56.704772 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2037/4076] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:08:56 2022] GET /compute/v2.1/servers/ff57c0ad-9f38-4c58-a194-b0b0d39b1fe0 => generated 1516 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:08:56.729182 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-a9af0dce-a85e-4b28-b692-2623399be6a0 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:08:56.731753 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-a9af0dce-a85e-4b28-b692-2623399be6a0 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] [instance: ff57c0ad-9f38-4c58-a194-b0b0d39b1fe0] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:08:56.740111 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a9af0dce-a85e-4b28-b692-2623399be6a0 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:56.740592 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a9af0dce-a85e-4b28-b692-2623399be6a0 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:56.741107 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a9af0dce-a85e-4b28-b692-2623399be6a0 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:56.742233 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a9af0dce-a85e-4b28-b692-2623399be6a0 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:56.742799 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a9af0dce-a85e-4b28-b692-2623399be6a0 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:56.743172 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a9af0dce-a85e-4b28-b692-2623399be6a0 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:56.773810 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.objects.instance [None req-a9af0dce-a85e-4b28-b692-2623399be6a0 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lazy-loading 'flavor' on Instance uuid ff57c0ad-9f38-4c58-a194-b0b0d39b1fe0 {{(pid=138744) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 21:08:56.874168 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-a9af0dce-a85e-4b28-b692-2623399be6a0 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] 10.222.0.18 "POST /compute/v2.1/servers/ff57c0ad-9f38-4c58-a194-b0b0d39b1fe0/action" status: 200 len: 32 microversion: 2.1 time: 0.149614 Oct 22 21:08:56.875749 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2040/4077] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 21:08:56 2022] POST /compute/v2.1/servers/ff57c0ad-9f38-4c58-a194-b0b0d39b1fe0/action => generated 32 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 22 21:08:56.885329 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-60b5e60c-405e-4d1b-b1f8-938f65e062cf tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:08:56.885960 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-60b5e60c-405e-4d1b-b1f8-938f65e062cf tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] [instance: ff57c0ad-9f38-4c58-a194-b0b0d39b1fe0] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:08:56.894024 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-60b5e60c-405e-4d1b-b1f8-938f65e062cf tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:56.894836 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-60b5e60c-405e-4d1b-b1f8-938f65e062cf tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:56.895484 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-60b5e60c-405e-4d1b-b1f8-938f65e062cf tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:56.896260 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-60b5e60c-405e-4d1b-b1f8-938f65e062cf tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:56.897394 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-60b5e60c-405e-4d1b-b1f8-938f65e062cf tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:56.901346 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-60b5e60c-405e-4d1b-b1f8-938f65e062cf tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:57.153514 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-60b5e60c-405e-4d1b-b1f8-938f65e062cf tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e7a09f769748629425ad36120a7fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddce0c46c75496f96f2e2dae77751dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:08:57.163005 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-60b5e60c-405e-4d1b-b1f8-938f65e062cf tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] 10.222.0.18 "GET /compute/v2.1/servers/ff57c0ad-9f38-4c58-a194-b0b0d39b1fe0" status: 200 len: 1522 microversion: 2.1 time: 0.281888 Oct 22 21:08:57.164123 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2038/4078] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:08:56 2022] GET /compute/v2.1/servers/ff57c0ad-9f38-4c58-a194-b0b0d39b1fe0 => generated 1522 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:08:57.386715 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-5877f078-31f7-41a6-93ec-a59874fb4cd0 tempest-VolumesSnapshotsTestJSON-449412194 tempest-VolumesSnapshotsTestJSON-449412194-project] Calling method '.version_select at 0x7fd3a8ba5dc0>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:08:57.424317 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-5877f078-31f7-41a6-93ec-a59874fb4cd0 tempest-VolumesSnapshotsTestJSON-449412194 tempest-VolumesSnapshotsTestJSON-449412194-project] HTTP exception thrown: Volume e181745b-d71c-49fd-8bff-fbeab4fe3a88 could not be found. Oct 22 21:08:57.442109 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-5877f078-31f7-41a6-93ec-a59874fb4cd0 tempest-VolumesSnapshotsTestJSON-449412194 tempest-VolumesSnapshotsTestJSON-449412194-project] Request method failure captured: Oct 22 21:08:57.442109 ncdv-master-1 devstack@n-api.service[138744]: request: GET /compute/v2.1/os-volumes/e181745b-d71c-49fd-8bff-fbeab4fe3a88 HTTP/1.1 Oct 22 21:08:57.442109 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 21:08:57.442109 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 21:08:57.442109 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 21:08:57.442109 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 0 Oct 22 21:08:57.442109 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 21:08:57.442109 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 21:08:57.442109 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 21:08:57.442109 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 21:08:57.442109 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVFvjX4Eg1ddjQa4HmPU587kE_72Rsdh1d_8kuq2sRJNd1T44Ee8pAeVLUZ8SlNvSeTxH-13C9JXvpVmF3ztMve48SIkE1hOMb1e9v401-BA265TJ4NaJZ0xBN2Dd9JHc4YXN2H7qA_nhOqa5OG8FMThlWkp1iwDE5RLtmD7n-xGyaHY Oct 22 21:08:57.442109 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 21:08:57.442109 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 21:08:57.442109 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 21:08:57.442109 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 21:08:57.442109 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 21:08:57.442109 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 21:08:57.442109 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: 52be7dbbbb564c21a11f0597368f9639 Oct 22 21:08:57.442109 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-449412194 Oct 22 21:08:57.442109 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 21:08:57.442109 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 21:08:57.442109 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_52be7dbbbb564c21a11f0597368f9639"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/52be7dbbbb564c21a11f0597368f9639"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/52be7dbbbb564c21a11f0597368f9639"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/52be7dbbbb564c21a11f0597368f9639"}]}] Oct 22 21:08:57.442109 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-VolumesSnapshotsTestJSON-449412194 Oct 22 21:08:57.442109 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: 52be7dbbbb564c21a11f0597368f9639 Oct 22 21:08:57.442109 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-449412194 Oct 22 21:08:57.442109 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-VolumesSnapshotsTestJSON-449412194-project Oct 22 21:08:57.442109 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 21:08:57.442109 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 21:08:57.442109 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: a412a877095a48628146bd1c23ebeddb Oct 22 21:08:57.442109 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-VolumesSnapshotsTestJSON-449412194-project Oct 22 21:08:57.442109 ncdv-master-1 devstack@n-api.service[138744]: method: Oct 22 21:08:57.442109 ncdv-master-1 devstack@n-api.service[138744]: exception: Volume e181745b-d71c-49fd-8bff-fbeab4fe3a88 could not be found. Oct 22 21:08:57.442109 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': 'e181745b-d71c-49fd-8bff-fbeab4fe3a88'} Oct 22 21:08:57.442109 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:08:57.442109 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:08:57.442109 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 22 21:08:57.442109 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 22 21:08:57.442109 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 22 21:08:57.442109 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 22 21:08:57.442109 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 22 21:08:57.442109 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 22 21:08:57.442109 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 22 21:08:57.442109 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 22 21:08:57.442109 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 22 21:08:57.442109 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 22 21:08:57.442109 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 22 21:08:57.442109 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 22 21:08:57.442109 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 22 21:08:57.442109 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 22 21:08:57.442109 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e181745b-d71c-49fd-8bff-fbeab4fe3a88 could not be found. (HTTP 404) (Request-ID: req-a6eaeb74-09d2-43c9-ab7f-84f840a27ef8) Oct 22 21:08:57.442109 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:08:57.442109 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:08:57.442109 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:08:57.442109 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:08:57.442109 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 22 21:08:57.442109 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 22 21:08:57.442109 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 22 21:08:57.442109 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 22 21:08:57.442109 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 22 21:08:57.442109 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 22 21:08:57.442109 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 22 21:08:57.442109 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 22 21:08:57.442109 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 22 21:08:57.446165 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 22 21:08:57.446165 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 22 21:08:57.446165 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 22 21:08:57.446165 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 22 21:08:57.446165 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 22 21:08:57.446165 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 22 21:08:57.446165 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 22 21:08:57.446165 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 22 21:08:57.446165 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 22 21:08:57.446165 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 22 21:08:57.446165 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 22 21:08:57.446165 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 22 21:08:57.446165 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 22 21:08:57.446165 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e181745b-d71c-49fd-8bff-fbeab4fe3a88 could not be found. Oct 22 21:08:57.446165 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:08:57.446165 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:08:57.446165 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:08:57.446165 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:08:57.446165 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:08:57.446165 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:08:57.446165 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:08:57.446165 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:08:57.446165 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 22 21:08:57.446165 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 22 21:08:57.446165 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:08:57.446165 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:08:57.446165 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 22 21:08:57.446165 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:08:57.446165 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e181745b-d71c-49fd-8bff-fbeab4fe3a88 could not be found. Oct 22 21:08:57.446165 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:08:57.446165 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:08:57.446165 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:08:57.446165 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:08:57.446165 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:08:57.446165 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:08:57.446165 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:08:57.446165 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:08:57.446165 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e181745b-d71c-49fd-8bff-fbeab4fe3a88 could not be found. Oct 22 21:08:57.446165 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:08:57.446165 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-5877f078-31f7-41a6-93ec-a59874fb4cd0 tempest-VolumesSnapshotsTestJSON-449412194 tempest-VolumesSnapshotsTestJSON-449412194-project] Returning 404 to user: Volume e181745b-d71c-49fd-8bff-fbeab4fe3a88 could not be found. {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:08:57.446165 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-5877f078-31f7-41a6-93ec-a59874fb4cd0 tempest-VolumesSnapshotsTestJSON-449412194 tempest-VolumesSnapshotsTestJSON-449412194-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/e181745b-d71c-49fd-8bff-fbeab4fe3a88" status: 404 len: 109 microversion: 2.1 time: 0.062409 Oct 22 21:08:57.446165 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2041/4079] 10.222.0.18 () {58 vars in 1245 bytes} [Sat Oct 22 21:08:57 2022] GET /compute/v2.1/os-volumes/e181745b-d71c-49fd-8bff-fbeab4fe3a88 => generated 109 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 21:08:57.455619 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-8082bf54-fdf6-442f-90b3-d32dc4899d5a tempest-VolumesSnapshotsTestJSON-449412194 tempest-VolumesSnapshotsTestJSON-449412194-project] Calling method '.version_select at 0x7fd39ee3f790>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:08:57.491051 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.wsgi [None req-8082bf54-fdf6-442f-90b3-d32dc4899d5a tempest-VolumesSnapshotsTestJSON-449412194 tempest-VolumesSnapshotsTestJSON-449412194-project] HTTP exception thrown: Volume e181745b-d71c-49fd-8bff-fbeab4fe3a88 could not be found. Oct 22 21:08:57.493697 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-8082bf54-fdf6-442f-90b3-d32dc4899d5a tempest-VolumesSnapshotsTestJSON-449412194 tempest-VolumesSnapshotsTestJSON-449412194-project] Request method failure captured: Oct 22 21:08:57.493697 ncdv-master-1 devstack@n-api.service[138745]: request: DELETE /compute/v2.1/os-volumes/e181745b-d71c-49fd-8bff-fbeab4fe3a88 HTTP/1.1 Oct 22 21:08:57.493697 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 21:08:57.493697 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 21:08:57.493697 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 21:08:57.493697 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 0 Oct 22 21:08:57.493697 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 21:08:57.493697 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 21:08:57.493697 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 21:08:57.493697 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 21:08:57.493697 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVFvjX4Eg1ddjQa4HmPU587kE_72Rsdh1d_8kuq2sRJNd1T44Ee8pAeVLUZ8SlNvSeTxH-13C9JXvpVmF3ztMve48SIkE1hOMb1e9v401-BA265TJ4NaJZ0xBN2Dd9JHc4YXN2H7qA_nhOqa5OG8FMThlWkp1iwDE5RLtmD7n-xGyaHY Oct 22 21:08:57.493697 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 21:08:57.493697 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 21:08:57.493697 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 21:08:57.493697 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 21:08:57.493697 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 21:08:57.493697 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 21:08:57.493697 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: 52be7dbbbb564c21a11f0597368f9639 Oct 22 21:08:57.493697 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-449412194 Oct 22 21:08:57.493697 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 21:08:57.493697 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 21:08:57.493697 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_52be7dbbbb564c21a11f0597368f9639"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/52be7dbbbb564c21a11f0597368f9639"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/52be7dbbbb564c21a11f0597368f9639"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/52be7dbbbb564c21a11f0597368f9639"}]}] Oct 22 21:08:57.493697 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-VolumesSnapshotsTestJSON-449412194 Oct 22 21:08:57.493697 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: 52be7dbbbb564c21a11f0597368f9639 Oct 22 21:08:57.493697 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-449412194 Oct 22 21:08:57.493697 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-VolumesSnapshotsTestJSON-449412194-project Oct 22 21:08:57.493697 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 21:08:57.493697 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 21:08:57.493697 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: a412a877095a48628146bd1c23ebeddb Oct 22 21:08:57.493697 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-VolumesSnapshotsTestJSON-449412194-project Oct 22 21:08:57.493697 ncdv-master-1 devstack@n-api.service[138745]: method: Oct 22 21:08:57.493697 ncdv-master-1 devstack@n-api.service[138745]: exception: Volume e181745b-d71c-49fd-8bff-fbeab4fe3a88 could not be found. Oct 22 21:08:57.493697 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'id': 'e181745b-d71c-49fd-8bff-fbeab4fe3a88'} Oct 22 21:08:57.493697 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:08:57.493697 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:08:57.493697 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 22 21:08:57.493697 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 22 21:08:57.493697 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 22 21:08:57.493697 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 22 21:08:57.493697 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 22 21:08:57.493697 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 22 21:08:57.493697 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 22 21:08:57.493697 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 22 21:08:57.493697 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 22 21:08:57.493697 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 22 21:08:57.493697 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 22 21:08:57.493697 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 22 21:08:57.493697 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 22 21:08:57.493697 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 22 21:08:57.493697 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e181745b-d71c-49fd-8bff-fbeab4fe3a88 could not be found. (HTTP 404) (Request-ID: req-84e891f6-28fc-47b8-af74-f070e4ce04ed) Oct 22 21:08:57.493697 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:08:57.493697 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:08:57.493697 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:08:57.493697 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:08:57.493697 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 22 21:08:57.493697 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 22 21:08:57.493697 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 22 21:08:57.493697 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 22 21:08:57.493697 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 22 21:08:57.493697 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 22 21:08:57.493697 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 22 21:08:57.493697 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 22 21:08:57.493697 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 22 21:08:57.497436 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 22 21:08:57.497436 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 22 21:08:57.497436 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 22 21:08:57.497436 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 22 21:08:57.497436 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 22 21:08:57.497436 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 22 21:08:57.497436 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 22 21:08:57.497436 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 22 21:08:57.497436 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 22 21:08:57.497436 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 22 21:08:57.497436 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 22 21:08:57.497436 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 22 21:08:57.497436 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 22 21:08:57.497436 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e181745b-d71c-49fd-8bff-fbeab4fe3a88 could not be found. Oct 22 21:08:57.497436 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:08:57.497436 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:08:57.497436 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:08:57.497436 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:08:57.497436 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:08:57.497436 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:08:57.497436 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:08:57.497436 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:08:57.497436 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 22 21:08:57.497436 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 22 21:08:57.497436 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:08:57.497436 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:08:57.497436 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 22 21:08:57.497436 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:08:57.497436 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e181745b-d71c-49fd-8bff-fbeab4fe3a88 could not be found. Oct 22 21:08:57.497436 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:08:57.497436 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:08:57.497436 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:08:57.497436 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:08:57.497436 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:08:57.497436 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:08:57.497436 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:08:57.497436 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:08:57.497436 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e181745b-d71c-49fd-8bff-fbeab4fe3a88 could not be found. Oct 22 21:08:57.497436 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:08:57.497436 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-8082bf54-fdf6-442f-90b3-d32dc4899d5a tempest-VolumesSnapshotsTestJSON-449412194 tempest-VolumesSnapshotsTestJSON-449412194-project] Returning 404 to user: Volume e181745b-d71c-49fd-8bff-fbeab4fe3a88 could not be found. {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:08:57.502007 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-8082bf54-fdf6-442f-90b3-d32dc4899d5a tempest-VolumesSnapshotsTestJSON-449412194 tempest-VolumesSnapshotsTestJSON-449412194-project] 10.222.0.18 "DELETE /compute/v2.1/os-volumes/e181745b-d71c-49fd-8bff-fbeab4fe3a88" status: 404 len: 109 microversion: 2.1 time: 0.046952 Oct 22 21:08:57.502007 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2039/4080] 10.222.0.18 () {58 vars in 1248 bytes} [Sat Oct 22 21:08:57 2022] DELETE /compute/v2.1/os-volumes/e181745b-d71c-49fd-8bff-fbeab4fe3a88 => generated 109 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 21:08:57.509600 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-4b03df94-dcaa-4d73-92d2-fe0a3cf005e9 tempest-VolumesSnapshotsTestJSON-449412194 tempest-VolumesSnapshotsTestJSON-449412194-project] Calling method '.version_select at 0x7fd39f8b2700>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:08:57.544814 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-4b03df94-dcaa-4d73-92d2-fe0a3cf005e9 tempest-VolumesSnapshotsTestJSON-449412194 tempest-VolumesSnapshotsTestJSON-449412194-project] HTTP exception thrown: Volume e181745b-d71c-49fd-8bff-fbeab4fe3a88 could not be found. Oct 22 21:08:57.546932 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-4b03df94-dcaa-4d73-92d2-fe0a3cf005e9 tempest-VolumesSnapshotsTestJSON-449412194 tempest-VolumesSnapshotsTestJSON-449412194-project] Request method failure captured: Oct 22 21:08:57.546932 ncdv-master-1 devstack@n-api.service[138744]: request: GET /compute/v2.1/os-volumes/e181745b-d71c-49fd-8bff-fbeab4fe3a88 HTTP/1.1 Oct 22 21:08:57.546932 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 21:08:57.546932 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 21:08:57.546932 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 21:08:57.546932 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 0 Oct 22 21:08:57.546932 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 21:08:57.546932 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 21:08:57.546932 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 21:08:57.546932 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 21:08:57.546932 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVFvjX4Eg1ddjQa4HmPU587kE_72Rsdh1d_8kuq2sRJNd1T44Ee8pAeVLUZ8SlNvSeTxH-13C9JXvpVmF3ztMve48SIkE1hOMb1e9v401-BA265TJ4NaJZ0xBN2Dd9JHc4YXN2H7qA_nhOqa5OG8FMThlWkp1iwDE5RLtmD7n-xGyaHY Oct 22 21:08:57.546932 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 21:08:57.546932 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 21:08:57.546932 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 21:08:57.546932 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 21:08:57.546932 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 21:08:57.546932 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 21:08:57.546932 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: 52be7dbbbb564c21a11f0597368f9639 Oct 22 21:08:57.546932 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-449412194 Oct 22 21:08:57.546932 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 21:08:57.546932 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 21:08:57.546932 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_52be7dbbbb564c21a11f0597368f9639"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/52be7dbbbb564c21a11f0597368f9639"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/52be7dbbbb564c21a11f0597368f9639"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/52be7dbbbb564c21a11f0597368f9639"}]}] Oct 22 21:08:57.546932 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-VolumesSnapshotsTestJSON-449412194 Oct 22 21:08:57.546932 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: 52be7dbbbb564c21a11f0597368f9639 Oct 22 21:08:57.546932 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-449412194 Oct 22 21:08:57.546932 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-VolumesSnapshotsTestJSON-449412194-project Oct 22 21:08:57.546932 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 21:08:57.546932 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 21:08:57.546932 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: a412a877095a48628146bd1c23ebeddb Oct 22 21:08:57.546932 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-VolumesSnapshotsTestJSON-449412194-project Oct 22 21:08:57.546932 ncdv-master-1 devstack@n-api.service[138744]: method: Oct 22 21:08:57.546932 ncdv-master-1 devstack@n-api.service[138744]: exception: Volume e181745b-d71c-49fd-8bff-fbeab4fe3a88 could not be found. Oct 22 21:08:57.546932 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': 'e181745b-d71c-49fd-8bff-fbeab4fe3a88'} Oct 22 21:08:57.546932 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:08:57.546932 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:08:57.546932 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 22 21:08:57.546932 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 22 21:08:57.546932 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 22 21:08:57.546932 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 22 21:08:57.546932 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 22 21:08:57.546932 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 22 21:08:57.546932 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 22 21:08:57.546932 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 22 21:08:57.546932 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 22 21:08:57.546932 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 22 21:08:57.546932 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 22 21:08:57.546932 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 22 21:08:57.546932 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 22 21:08:57.546932 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 22 21:08:57.546932 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e181745b-d71c-49fd-8bff-fbeab4fe3a88 could not be found. (HTTP 404) (Request-ID: req-858b7570-f50a-4bc7-9852-868e62660cf1) Oct 22 21:08:57.546932 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:08:57.546932 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:08:57.546932 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:08:57.546932 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:08:57.546932 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 22 21:08:57.546932 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 22 21:08:57.546932 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 22 21:08:57.546932 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 22 21:08:57.546932 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 22 21:08:57.546932 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 22 21:08:57.546932 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 22 21:08:57.546932 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 22 21:08:57.546932 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 22 21:08:57.552162 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 22 21:08:57.552162 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 22 21:08:57.552162 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 22 21:08:57.552162 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 22 21:08:57.552162 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 22 21:08:57.552162 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 22 21:08:57.552162 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 22 21:08:57.552162 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 22 21:08:57.552162 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 22 21:08:57.552162 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 22 21:08:57.552162 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 22 21:08:57.552162 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 22 21:08:57.552162 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 22 21:08:57.552162 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e181745b-d71c-49fd-8bff-fbeab4fe3a88 could not be found. Oct 22 21:08:57.552162 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:08:57.552162 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:08:57.552162 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:08:57.552162 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:08:57.552162 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:08:57.552162 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:08:57.552162 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:08:57.552162 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:08:57.552162 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 22 21:08:57.552162 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 22 21:08:57.552162 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:08:57.552162 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:08:57.552162 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 22 21:08:57.552162 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:08:57.552162 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e181745b-d71c-49fd-8bff-fbeab4fe3a88 could not be found. Oct 22 21:08:57.552162 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:08:57.552162 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:08:57.552162 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:08:57.552162 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:08:57.552162 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:08:57.552162 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:08:57.552162 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:08:57.552162 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:08:57.552162 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e181745b-d71c-49fd-8bff-fbeab4fe3a88 could not be found. Oct 22 21:08:57.552162 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:08:57.552162 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-4b03df94-dcaa-4d73-92d2-fe0a3cf005e9 tempest-VolumesSnapshotsTestJSON-449412194 tempest-VolumesSnapshotsTestJSON-449412194-project] Returning 404 to user: Volume e181745b-d71c-49fd-8bff-fbeab4fe3a88 could not be found. {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:08:57.552162 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-4b03df94-dcaa-4d73-92d2-fe0a3cf005e9 tempest-VolumesSnapshotsTestJSON-449412194 tempest-VolumesSnapshotsTestJSON-449412194-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/e181745b-d71c-49fd-8bff-fbeab4fe3a88" status: 404 len: 109 microversion: 2.1 time: 0.045901 Oct 22 21:08:57.552162 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2042/4081] 10.222.0.18 () {58 vars in 1245 bytes} [Sat Oct 22 21:08:57 2022] GET /compute/v2.1/os-volumes/e181745b-d71c-49fd-8bff-fbeab4fe3a88 => generated 109 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 21:08:58.188709 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-bb6b2f5c-445a-447c-9b6e-30cca6fb451f tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:08:58.190138 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-bb6b2f5c-445a-447c-9b6e-30cca6fb451f tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] [instance: ff57c0ad-9f38-4c58-a194-b0b0d39b1fe0] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:08:58.194777 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell0:SELECT=18 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:08:58.201007 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bb6b2f5c-445a-447c-9b6e-30cca6fb451f tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:58.201512 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bb6b2f5c-445a-447c-9b6e-30cca6fb451f tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:58.202185 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bb6b2f5c-445a-447c-9b6e-30cca6fb451f tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:58.202962 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bb6b2f5c-445a-447c-9b6e-30cca6fb451f tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:58.203612 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bb6b2f5c-445a-447c-9b6e-30cca6fb451f tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:58.204332 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bb6b2f5c-445a-447c-9b6e-30cca6fb451f tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:58.352534 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-bb6b2f5c-445a-447c-9b6e-30cca6fb451f tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e7a09f769748629425ad36120a7fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddce0c46c75496f96f2e2dae77751dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:08:58.357532 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-bb6b2f5c-445a-447c-9b6e-30cca6fb451f tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] 10.222.0.18 "GET /compute/v2.1/servers/ff57c0ad-9f38-4c58-a194-b0b0d39b1fe0" status: 200 len: 1522 microversion: 2.1 time: 0.174326 Oct 22 21:08:58.369967 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2040/4082] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:08:58 2022] GET /compute/v2.1/servers/ff57c0ad-9f38-4c58-a194-b0b0d39b1fe0 => generated 1522 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:08:59.377299 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell0:SELECT=6 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:08:59.383551 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-410142d0-e02c-4cb4-8b0e-328bd1947a87 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:08:59.384762 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-410142d0-e02c-4cb4-8b0e-328bd1947a87 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] [instance: ff57c0ad-9f38-4c58-a194-b0b0d39b1fe0] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:08:59.396236 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-410142d0-e02c-4cb4-8b0e-328bd1947a87 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:59.397198 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-410142d0-e02c-4cb4-8b0e-328bd1947a87 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:59.397704 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-410142d0-e02c-4cb4-8b0e-328bd1947a87 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:59.398460 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-410142d0-e02c-4cb4-8b0e-328bd1947a87 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:08:59.399000 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-410142d0-e02c-4cb4-8b0e-328bd1947a87 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:08:59.399596 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-410142d0-e02c-4cb4-8b0e-328bd1947a87 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:08:59.618340 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-410142d0-e02c-4cb4-8b0e-328bd1947a87 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e7a09f769748629425ad36120a7fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddce0c46c75496f96f2e2dae77751dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:08:59.629843 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-410142d0-e02c-4cb4-8b0e-328bd1947a87 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] 10.222.0.18 "GET /compute/v2.1/servers/ff57c0ad-9f38-4c58-a194-b0b0d39b1fe0" status: 200 len: 1522 microversion: 2.1 time: 0.252419 Oct 22 21:08:59.630844 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2043/4083] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:08:59 2022] GET /compute/v2.1/servers/ff57c0ad-9f38-4c58-a194-b0b0d39b1fe0 => generated 1522 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:09:00.577365 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-9575e210-dca5-4b10-a9eb-7587995a364b tempest-VolumesTestJSON-308592156 tempest-VolumesTestJSON-308592156-project] Calling method '.version_select at 0x7fd39ee43d30>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:09:00.634801 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-9575e210-dca5-4b10-a9eb-7587995a364b tempest-VolumesTestJSON-308592156 tempest-VolumesTestJSON-308592156-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/7c24f6c6-7a13-4422-8162-fa5bba0b4323" status: 200 len: 343 microversion: 2.1 time: 0.060560 Oct 22 21:09:00.636201 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2041/4084] 10.222.0.18 () {58 vars in 1245 bytes} [Sat Oct 22 21:09:00 2022] GET /compute/v2.1/os-volumes/7c24f6c6-7a13-4422-8162-fa5bba0b4323 => generated 343 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:09:00.657345 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-e2b62274-fb0e-431b-bfe0-60f03b805bd8 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:09:00.658109 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-e2b62274-fb0e-431b-bfe0-60f03b805bd8 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] [instance: ff57c0ad-9f38-4c58-a194-b0b0d39b1fe0] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:09:00.665824 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e2b62274-fb0e-431b-bfe0-60f03b805bd8 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:09:00.666656 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e2b62274-fb0e-431b-bfe0-60f03b805bd8 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:09:00.667103 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e2b62274-fb0e-431b-bfe0-60f03b805bd8 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:09:00.667847 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e2b62274-fb0e-431b-bfe0-60f03b805bd8 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:09:00.668308 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e2b62274-fb0e-431b-bfe0-60f03b805bd8 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:09:00.668732 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e2b62274-fb0e-431b-bfe0-60f03b805bd8 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:09:00.870559 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-e2b62274-fb0e-431b-bfe0-60f03b805bd8 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e7a09f769748629425ad36120a7fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddce0c46c75496f96f2e2dae77751dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:09:00.881847 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-e2b62274-fb0e-431b-bfe0-60f03b805bd8 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] 10.222.0.18 "GET /compute/v2.1/servers/ff57c0ad-9f38-4c58-a194-b0b0d39b1fe0" status: 200 len: 1522 microversion: 2.1 time: 0.228169 Oct 22 21:09:00.897225 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2044/4085] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:09:00 2022] GET /compute/v2.1/servers/ff57c0ad-9f38-4c58-a194-b0b0d39b1fe0 => generated 1522 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:09:01.909126 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-83be31c3-b884-4703-9065-f23aca3bc2d8 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:09:01.910363 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-83be31c3-b884-4703-9065-f23aca3bc2d8 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] [instance: ff57c0ad-9f38-4c58-a194-b0b0d39b1fe0] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:09:01.917560 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-83be31c3-b884-4703-9065-f23aca3bc2d8 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:09:01.918073 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-83be31c3-b884-4703-9065-f23aca3bc2d8 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:09:01.918525 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-83be31c3-b884-4703-9065-f23aca3bc2d8 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:09:01.919249 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-83be31c3-b884-4703-9065-f23aca3bc2d8 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:09:01.919815 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-83be31c3-b884-4703-9065-f23aca3bc2d8 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:09:01.920234 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-83be31c3-b884-4703-9065-f23aca3bc2d8 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:09:01.999026 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-a658be2c-fe46-4a12-abf1-7faf767615f7 tempest-VolumesTestJSON-308592156 tempest-VolumesTestJSON-308592156-project] Calling method '.version_select at 0x7fd3a8bc1e50>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:09:02.059788 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-a658be2c-fe46-4a12-abf1-7faf767615f7 tempest-VolumesTestJSON-308592156 tempest-VolumesTestJSON-308592156-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/08af570e-e95c-4687-b224-57bb57ede083" status: 200 len: 343 microversion: 2.1 time: 0.064601 Oct 22 21:09:02.069816 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2045/4086] 10.222.0.18 () {58 vars in 1245 bytes} [Sat Oct 22 21:09:01 2022] GET /compute/v2.1/os-volumes/08af570e-e95c-4687-b224-57bb57ede083 => generated 343 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:09:02.070968 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-83be31c3-b884-4703-9065-f23aca3bc2d8 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e7a09f769748629425ad36120a7fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddce0c46c75496f96f2e2dae77751dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:09:02.083032 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-83be31c3-b884-4703-9065-f23aca3bc2d8 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] 10.222.0.18 "GET /compute/v2.1/servers/ff57c0ad-9f38-4c58-a194-b0b0d39b1fe0" status: 200 len: 1522 microversion: 2.1 time: 0.179016 Oct 22 21:09:02.098078 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2042/4087] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:09:01 2022] GET /compute/v2.1/servers/ff57c0ad-9f38-4c58-a194-b0b0d39b1fe0 => generated 1522 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:09:03.107625 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-b2f52de9-26b4-45a1-a1d7-f70d7a68eb32 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:09:03.108828 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-b2f52de9-26b4-45a1-a1d7-f70d7a68eb32 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] [instance: ff57c0ad-9f38-4c58-a194-b0b0d39b1fe0] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:09:03.117291 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b2f52de9-26b4-45a1-a1d7-f70d7a68eb32 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:09:03.117777 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b2f52de9-26b4-45a1-a1d7-f70d7a68eb32 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:09:03.118439 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b2f52de9-26b4-45a1-a1d7-f70d7a68eb32 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:09:03.119162 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b2f52de9-26b4-45a1-a1d7-f70d7a68eb32 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:09:03.119631 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b2f52de9-26b4-45a1-a1d7-f70d7a68eb32 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:09:03.120095 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b2f52de9-26b4-45a1-a1d7-f70d7a68eb32 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:09:03.255486 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-b2f52de9-26b4-45a1-a1d7-f70d7a68eb32 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e7a09f769748629425ad36120a7fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddce0c46c75496f96f2e2dae77751dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:09:03.263489 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-b2f52de9-26b4-45a1-a1d7-f70d7a68eb32 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] 10.222.0.18 "GET /compute/v2.1/servers/ff57c0ad-9f38-4c58-a194-b0b0d39b1fe0" status: 200 len: 1522 microversion: 2.1 time: 0.160041 Oct 22 21:09:03.264071 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2046/4088] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:09:03 2022] GET /compute/v2.1/servers/ff57c0ad-9f38-4c58-a194-b0b0d39b1fe0 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:09:03.441872 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-9ccda145-8a11-428e-a3ef-35d9ad1ecb15 tempest-VolumesTestJSON-308592156 tempest-VolumesTestJSON-308592156-project] Calling method '.version_select at 0x7fd39ee93ee0>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:09:03.495768 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-9ccda145-8a11-428e-a3ef-35d9ad1ecb15 tempest-VolumesTestJSON-308592156 tempest-VolumesTestJSON-308592156-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/ecbbed2a-c5b0-45e9-a1fa-b67ff66c50b1" status: 200 len: 344 microversion: 2.1 time: 0.058175 Oct 22 21:09:03.505256 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2043/4089] 10.222.0.18 () {58 vars in 1245 bytes} [Sat Oct 22 21:09:03 2022] GET /compute/v2.1/os-volumes/ecbbed2a-c5b0-45e9-a1fa-b67ff66c50b1 => generated 344 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:09:03.510697 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-3afb8a79-00e3-4a01-929a-bdbeab0d1bb0 tempest-VolumesTestJSON-308592156 tempest-VolumesTestJSON-308592156-project] Calling method '.version_select at 0x7fd3a8ae5700>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:09:03.600676 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-3afb8a79-00e3-4a01-929a-bdbeab0d1bb0 tempest-VolumesTestJSON-308592156 tempest-VolumesTestJSON-308592156-project] 10.222.0.18 "GET /compute/v2.1/os-volumes" status: 200 len: 1013 microversion: 2.1 time: 0.093636 Oct 22 21:09:03.601269 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2047/4090] 10.222.0.18 () {58 vars in 1134 bytes} [Sat Oct 22 21:09:03 2022] GET /compute/v2.1/os-volumes => generated 1013 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:09:03.617181 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-6e31557e-1eef-4dbb-8db9-2043280a0db3 tempest-VolumesTestJSON-308592156 tempest-VolumesTestJSON-308592156-project] Calling method '.version_select at 0x7fd39ef32f70>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:09:03.721634 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-6e31557e-1eef-4dbb-8db9-2043280a0db3 tempest-VolumesTestJSON-308592156 tempest-VolumesTestJSON-308592156-project] 10.222.0.18 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 680 microversion: 2.1 time: 0.109121 Oct 22 21:09:03.731603 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2044/4091] 10.222.0.18 () {58 vars in 1149 bytes} [Sat Oct 22 21:09:03 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 680 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:09:03.736733 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-2d46c359-0c14-462b-a813-08dcd73a0c16 tempest-VolumesTestJSON-308592156 tempest-VolumesTestJSON-308592156-project] Calling method '.version_select at 0x7fd3a8a09ca0>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:09:03.831733 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-2d46c359-0c14-462b-a813-08dcd73a0c16 tempest-VolumesTestJSON-308592156 tempest-VolumesTestJSON-308592156-project] 10.222.0.18 "GET /compute/v2.1/os-volumes" status: 200 len: 1013 microversion: 2.1 time: 0.098802 Oct 22 21:09:03.832512 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2048/4092] 10.222.0.18 () {58 vars in 1134 bytes} [Sat Oct 22 21:09:03 2022] GET /compute/v2.1/os-volumes => generated 1013 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:09:03.846127 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-e07f86f7-f8fe-4ade-a81b-240fe6bc78f9 tempest-VolumesTestJSON-308592156 tempest-VolumesTestJSON-308592156-project] Calling method '.version_select at 0x7fd39ee545e0>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:09:03.973111 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-e07f86f7-f8fe-4ade-a81b-240fe6bc78f9 tempest-VolumesTestJSON-308592156 tempest-VolumesTestJSON-308592156-project] 10.222.0.18 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 346 microversion: 2.1 time: 0.130871 Oct 22 21:09:03.973675 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2045/4093] 10.222.0.18 () {58 vars in 1167 bytes} [Sat Oct 22 21:09:03 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 346 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:09:03.988730 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-ae174298-bf92-4352-8738-e5e466c21b7c tempest-VolumesTestJSON-308592156 tempest-VolumesTestJSON-308592156-project] Calling method '.version_select at 0x7fd39f891af0>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:09:04.249978 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-ae174298-bf92-4352-8738-e5e466c21b7c tempest-VolumesTestJSON-308592156 tempest-VolumesTestJSON-308592156-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 680 microversion: 2.1 time: 0.265652 Oct 22 21:09:04.250658 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2049/4094] 10.222.0.18 () {58 vars in 1170 bytes} [Sat Oct 22 21:09:03 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 680 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:09:04.264221 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-d82546df-5db8-4215-9101-c7afb2f29f90 tempest-VolumesTestJSON-308592156 tempest-VolumesTestJSON-308592156-project] Calling method '.version_select at 0x7fd39f0f4ee0>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:09:04.286153 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-97f72271-c5ea-4c3f-85cc-4888696166e3 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:09:04.287275 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-97f72271-c5ea-4c3f-85cc-4888696166e3 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] [instance: ff57c0ad-9f38-4c58-a194-b0b0d39b1fe0] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:09:04.293870 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-97f72271-c5ea-4c3f-85cc-4888696166e3 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:09:04.294429 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-97f72271-c5ea-4c3f-85cc-4888696166e3 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:09:04.294942 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-97f72271-c5ea-4c3f-85cc-4888696166e3 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:09:04.295754 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-97f72271-c5ea-4c3f-85cc-4888696166e3 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:09:04.296279 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-97f72271-c5ea-4c3f-85cc-4888696166e3 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:09:04.296813 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-97f72271-c5ea-4c3f-85cc-4888696166e3 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:09:04.363819 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-d82546df-5db8-4215-9101-c7afb2f29f90 tempest-VolumesTestJSON-308592156 tempest-VolumesTestJSON-308592156-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1013 microversion: 2.1 time: 0.103319 Oct 22 21:09:04.364587 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2046/4095] 10.222.0.18 () {58 vars in 1155 bytes} [Sat Oct 22 21:09:04 2022] GET /compute/v2.1/os-volumes/detail => generated 1013 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:09:04.378891 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-beab28de-32a0-434c-bda7-7d570bf6fdcd tempest-VolumesTestJSON-308592156 tempest-VolumesTestJSON-308592156-project] Calling method '.version_select at 0x7fd39eebc1f0>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:09:04.466032 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-97f72271-c5ea-4c3f-85cc-4888696166e3 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e7a09f769748629425ad36120a7fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddce0c46c75496f96f2e2dae77751dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:09:04.483681 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-beab28de-32a0-434c-bda7-7d570bf6fdcd tempest-VolumesTestJSON-308592156 tempest-VolumesTestJSON-308592156-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 346 microversion: 2.1 time: 0.109066 Oct 22 21:09:04.484164 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-97f72271-c5ea-4c3f-85cc-4888696166e3 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] 10.222.0.18 "GET /compute/v2.1/servers/ff57c0ad-9f38-4c58-a194-b0b0d39b1fe0" status: 200 len: 1522 microversion: 2.1 time: 0.200700 Oct 22 21:09:04.484538 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2050/4096] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:09:04 2022] GET /compute/v2.1/servers/ff57c0ad-9f38-4c58-a194-b0b0d39b1fe0 => generated 1522 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:09:04.495585 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2047/4097] 10.222.0.18 () {58 vars in 1188 bytes} [Sat Oct 22 21:09:04 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 346 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 21:09:04.497623 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-c1351408-9867-4c0a-bce9-4f760ce5e389 tempest-VolumesTestJSON-308592156 tempest-VolumesTestJSON-308592156-project] Calling method '.version_select at 0x7fd39ee98ca0>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:09:04.585773 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-c1351408-9867-4c0a-bce9-4f760ce5e389 tempest-VolumesTestJSON-308592156 tempest-VolumesTestJSON-308592156-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1013 microversion: 2.1 time: 0.091909 Oct 22 21:09:04.586370 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2048/4098] 10.222.0.18 () {58 vars in 1155 bytes} [Sat Oct 22 21:09:04 2022] GET /compute/v2.1/os-volumes/detail => generated 1013 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:09:05.512168 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-c91894d8-dcb9-483e-960d-acb8486a37fa tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:09:05.512793 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-c91894d8-dcb9-483e-960d-acb8486a37fa tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] [instance: ff57c0ad-9f38-4c58-a194-b0b0d39b1fe0] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:09:05.519895 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c91894d8-dcb9-483e-960d-acb8486a37fa tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:09:05.520390 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c91894d8-dcb9-483e-960d-acb8486a37fa tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:09:05.520834 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c91894d8-dcb9-483e-960d-acb8486a37fa tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:09:05.521577 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c91894d8-dcb9-483e-960d-acb8486a37fa tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:09:05.522036 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c91894d8-dcb9-483e-960d-acb8486a37fa tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:09:05.522467 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c91894d8-dcb9-483e-960d-acb8486a37fa tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:09:05.732506 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-c91894d8-dcb9-483e-960d-acb8486a37fa tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e7a09f769748629425ad36120a7fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddce0c46c75496f96f2e2dae77751dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:09:05.741494 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-c91894d8-dcb9-483e-960d-acb8486a37fa tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] 10.222.0.18 "GET /compute/v2.1/servers/ff57c0ad-9f38-4c58-a194-b0b0d39b1fe0" status: 200 len: 1522 microversion: 2.1 time: 0.233891 Oct 22 21:09:05.756242 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2051/4099] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:09:05 2022] GET /compute/v2.1/servers/ff57c0ad-9f38-4c58-a194-b0b0d39b1fe0 => generated 1522 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:09:06.767777 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-867c7373-7f47-41e9-b3ce-7536a66c2074 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:09:06.768253 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-867c7373-7f47-41e9-b3ce-7536a66c2074 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] [instance: ff57c0ad-9f38-4c58-a194-b0b0d39b1fe0] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:09:06.775916 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-867c7373-7f47-41e9-b3ce-7536a66c2074 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:09:06.776436 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-867c7373-7f47-41e9-b3ce-7536a66c2074 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:09:06.776905 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-867c7373-7f47-41e9-b3ce-7536a66c2074 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:09:06.778048 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-867c7373-7f47-41e9-b3ce-7536a66c2074 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:09:06.778532 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-867c7373-7f47-41e9-b3ce-7536a66c2074 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:09:06.779007 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-867c7373-7f47-41e9-b3ce-7536a66c2074 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:09:06.783649 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell1:SELECT=73 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:09:07.061492 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-867c7373-7f47-41e9-b3ce-7536a66c2074 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e7a09f769748629425ad36120a7fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddce0c46c75496f96f2e2dae77751dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:09:07.075954 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-867c7373-7f47-41e9-b3ce-7536a66c2074 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] 10.222.0.18 "GET /compute/v2.1/servers/ff57c0ad-9f38-4c58-a194-b0b0d39b1fe0" status: 200 len: 1522 microversion: 2.1 time: 0.314195 Oct 22 21:09:07.076754 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2049/4100] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:09:06 2022] GET /compute/v2.1/servers/ff57c0ad-9f38-4c58-a194-b0b0d39b1fe0 => generated 1522 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:09:07.495048 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-80eb70b5-10fd-4059-b3b7-7701bf51b85f tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:09:07.495695 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-80eb70b5-10fd-4059-b3b7-7701bf51b85f tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] [instance: ad302c49-addb-464c-a15f-fa01577f90c4] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:09:07.506546 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-80eb70b5-10fd-4059-b3b7-7701bf51b85f tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:09:07.507045 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-80eb70b5-10fd-4059-b3b7-7701bf51b85f tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:09:07.507568 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-80eb70b5-10fd-4059-b3b7-7701bf51b85f tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:09:07.508452 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-80eb70b5-10fd-4059-b3b7-7701bf51b85f tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:09:07.509083 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-80eb70b5-10fd-4059-b3b7-7701bf51b85f tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:09:07.509721 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-80eb70b5-10fd-4059-b3b7-7701bf51b85f tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:09:07.543329 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-80eb70b5-10fd-4059-b3b7-7701bf51b85f tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] 10.222.0.18 "GET /compute/v2.1/servers/ad302c49-addb-464c-a15f-fa01577f90c4/ips" status: 200 len: 145 microversion: 2.1 time: 0.052440 Oct 22 21:09:07.544460 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2052/4101] 10.222.0.18 () {58 vars in 1248 bytes} [Sat Oct 22 21:09:07 2022] GET /compute/v2.1/servers/ad302c49-addb-464c-a15f-fa01577f90c4/ips => generated 145 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:09:08.102877 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-eb99472b-7f92-4e57-aec0-1197a26757c1 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:09:08.103963 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-eb99472b-7f92-4e57-aec0-1197a26757c1 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] [instance: ff57c0ad-9f38-4c58-a194-b0b0d39b1fe0] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:09:08.114576 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-eb99472b-7f92-4e57-aec0-1197a26757c1 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:09:08.115423 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-eb99472b-7f92-4e57-aec0-1197a26757c1 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:09:08.116069 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-eb99472b-7f92-4e57-aec0-1197a26757c1 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:09:08.116970 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-eb99472b-7f92-4e57-aec0-1197a26757c1 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:09:08.117604 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-eb99472b-7f92-4e57-aec0-1197a26757c1 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:09:08.118468 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-eb99472b-7f92-4e57-aec0-1197a26757c1 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:09:08.410168 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-eb99472b-7f92-4e57-aec0-1197a26757c1 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e7a09f769748629425ad36120a7fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddce0c46c75496f96f2e2dae77751dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:09:08.422855 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-eb99472b-7f92-4e57-aec0-1197a26757c1 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] 10.222.0.18 "GET /compute/v2.1/servers/ff57c0ad-9f38-4c58-a194-b0b0d39b1fe0" status: 200 len: 1522 microversion: 2.1 time: 0.324104 Oct 22 21:09:08.423877 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2050/4102] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:09:08 2022] GET /compute/v2.1/servers/ff57c0ad-9f38-4c58-a194-b0b0d39b1fe0 => generated 1522 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:09:09.451529 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-290232a1-6a44-446e-805c-4717e13c57c1 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:09:09.452195 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-290232a1-6a44-446e-805c-4717e13c57c1 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] [instance: ff57c0ad-9f38-4c58-a194-b0b0d39b1fe0] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:09:09.469068 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-290232a1-6a44-446e-805c-4717e13c57c1 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:09:09.470534 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-290232a1-6a44-446e-805c-4717e13c57c1 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:09:09.473162 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-290232a1-6a44-446e-805c-4717e13c57c1 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:09:09.474277 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-290232a1-6a44-446e-805c-4717e13c57c1 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:09:09.476076 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-290232a1-6a44-446e-805c-4717e13c57c1 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:09:09.480864 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-290232a1-6a44-446e-805c-4717e13c57c1 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:09:09.769715 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-290232a1-6a44-446e-805c-4717e13c57c1 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e7a09f769748629425ad36120a7fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddce0c46c75496f96f2e2dae77751dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:09:09.781996 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-290232a1-6a44-446e-805c-4717e13c57c1 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] 10.222.0.18 "GET /compute/v2.1/servers/ff57c0ad-9f38-4c58-a194-b0b0d39b1fe0" status: 200 len: 1522 microversion: 2.1 time: 0.335068 Oct 22 21:09:09.782840 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2053/4103] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:09:09 2022] GET /compute/v2.1/servers/ff57c0ad-9f38-4c58-a194-b0b0d39b1fe0 => generated 1522 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:09:10.207492 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-dbf22910-21e6-488b-9a09-dd11da966b41 tempest-VolumesNegativeTest-630392981 tempest-VolumesNegativeTest-630392981-project] Action: 'create', calling method: .version_select at 0x7fd39eebc820>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1589533970", "metadata": {"Type": "work"}}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:09:10.211564 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-dbf22910-21e6-488b-9a09-dd11da966b41 tempest-VolumesNegativeTest-630392981 tempest-VolumesNegativeTest-630392981-project] Request method failure captured: Oct 22 21:09:10.211564 ncdv-master-1 devstack@n-api.service[138745]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 22 21:09:10.211564 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 21:09:10.211564 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 21:09:10.211564 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 21:09:10.211564 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 122 Oct 22 21:09:10.211564 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 21:09:10.211564 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 21:09:10.211564 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 21:09:10.211564 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 21:09:10.211564 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVFv13VDOJFPT_Probf5hGKQItQcNmAff96Ihe1qwkUeu1uhCM1oL1WyN_FIzev5z3beSDJBZDWPp3ON40tZCajNCBXP3SLTOuEu3JN6wq_gGlss73EcExYtFD5rVimcxaFT_r_7oHwGG_fDxrd-Uaue1-X1nvRHjtrOLURncjlQIiNo Oct 22 21:09:10.211564 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 21:09:10.211564 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 21:09:10.211564 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 21:09:10.211564 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 21:09:10.211564 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 21:09:10.211564 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 21:09:10.211564 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: 5e2f82ab8605479dabc404ebe9d49e68 Oct 22 21:09:10.211564 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-VolumesNegativeTest-630392981 Oct 22 21:09:10.211564 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 21:09:10.211564 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 21:09:10.211564 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_5e2f82ab8605479dabc404ebe9d49e68"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5e2f82ab8605479dabc404ebe9d49e68"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/5e2f82ab8605479dabc404ebe9d49e68"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5e2f82ab8605479dabc404ebe9d49e68"}]}] Oct 22 21:09:10.211564 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-VolumesNegativeTest-630392981 Oct 22 21:09:10.211564 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: 5e2f82ab8605479dabc404ebe9d49e68 Oct 22 21:09:10.211564 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-VolumesNegativeTest-630392981 Oct 22 21:09:10.211564 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-VolumesNegativeTest-630392981-project Oct 22 21:09:10.211564 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 21:09:10.211564 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 21:09:10.211564 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: 136524e3cec1484cbde4599af32dd118 Oct 22 21:09:10.211564 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-VolumesNegativeTest-630392981-project Oct 22 21:09:10.211564 ncdv-master-1 devstack@n-api.service[138745]: Oct 22 21:09:10.211564 ncdv-master-1 devstack@n-api.service[138745]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1589533970", "metadata": {"Type": "work"}}} Oct 22 21:09:10.211564 ncdv-master-1 devstack@n-api.service[138745]: method: Oct 22 21:09:10.211564 ncdv-master-1 devstack@n-api.service[138745]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 22 21:09:10.211564 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1589533970', 'metadata': {'Type': 'work'}}}} Oct 22 21:09:10.211564 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:09:10.211564 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:09:10.211564 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 22 21:09:10.211564 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 22 21:09:10.211564 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 22 21:09:10.211564 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise error Oct 22 21:09:10.211564 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Oct 22 21:09:10.211564 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:09:10.211564 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 22 21:09:10.211564 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 22 21:09:10.211564 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:09:10.211564 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 22 21:09:10.211564 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi '#$%' Oct 22 21:09:10.211564 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:09:10.211564 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:09:10.211564 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:09:10.211564 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:09:10.211564 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:09:10.211564 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:09:10.211564 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:09:10.211564 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:09:10.211564 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 22 21:09:10.211564 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 22 21:09:10.211564 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:09:10.211564 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:09:10.211564 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 22 21:09:10.211564 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 22 21:09:10.211564 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 22 21:09:10.211564 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 22 21:09:10.211564 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 22 21:09:10.211564 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 22 21:09:10.215646 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 22 21:09:10.215646 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:09:10.215646 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:09:10.215646 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:09:10.215646 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:09:10.215646 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:09:10.215646 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:09:10.215646 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 22 21:09:10.215646 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 22 21:09:10.215646 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 22 21:09:10.215646 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:09:10.215646 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-dbf22910-21e6-488b-9a09-dd11da966b41 tempest-VolumesNegativeTest-630392981 tempest-VolumesNegativeTest-630392981-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:09:10.215646 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-dbf22910-21e6-488b-9a09-dd11da966b41 tempest-VolumesNegativeTest-630392981 tempest-VolumesNegativeTest-630392981-project] 10.222.0.18 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.144225 Oct 22 21:09:10.215646 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2051/4104] 10.222.0.18 () {60 vars in 1156 bytes} [Sat Oct 22 21:09:10 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 145 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 22 21:09:10.223722 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-c5a83b5e-cc0b-4279-b448-ef6c564d7696 tempest-VolumesNegativeTest-630392981 tempest-VolumesNegativeTest-630392981-project] Action: 'create', calling method: .version_select at 0x7fd3a8c09c10>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1188354647", "metadata": {"Type": "work"}}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:09:10.228299 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-c5a83b5e-cc0b-4279-b448-ef6c564d7696 tempest-VolumesNegativeTest-630392981 tempest-VolumesNegativeTest-630392981-project] Request method failure captured: Oct 22 21:09:10.228299 ncdv-master-1 devstack@n-api.service[138744]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 22 21:09:10.228299 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 21:09:10.228299 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 21:09:10.228299 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 21:09:10.228299 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 120 Oct 22 21:09:10.228299 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 21:09:10.228299 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 21:09:10.228299 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 21:09:10.228299 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 21:09:10.228299 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVFv13VDOJFPT_Probf5hGKQItQcNmAff96Ihe1qwkUeu1uhCM1oL1WyN_FIzev5z3beSDJBZDWPp3ON40tZCajNCBXP3SLTOuEu3JN6wq_gGlss73EcExYtFD5rVimcxaFT_r_7oHwGG_fDxrd-Uaue1-X1nvRHjtrOLURncjlQIiNo Oct 22 21:09:10.228299 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 21:09:10.228299 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 21:09:10.228299 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 21:09:10.228299 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 21:09:10.228299 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 21:09:10.228299 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 21:09:10.228299 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: 5e2f82ab8605479dabc404ebe9d49e68 Oct 22 21:09:10.228299 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-VolumesNegativeTest-630392981 Oct 22 21:09:10.228299 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 21:09:10.228299 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 21:09:10.228299 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_5e2f82ab8605479dabc404ebe9d49e68"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5e2f82ab8605479dabc404ebe9d49e68"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/5e2f82ab8605479dabc404ebe9d49e68"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5e2f82ab8605479dabc404ebe9d49e68"}]}] Oct 22 21:09:10.228299 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-VolumesNegativeTest-630392981 Oct 22 21:09:10.228299 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: 5e2f82ab8605479dabc404ebe9d49e68 Oct 22 21:09:10.228299 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-VolumesNegativeTest-630392981 Oct 22 21:09:10.228299 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-VolumesNegativeTest-630392981-project Oct 22 21:09:10.228299 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 21:09:10.228299 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 21:09:10.228299 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: 136524e3cec1484cbde4599af32dd118 Oct 22 21:09:10.228299 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-VolumesNegativeTest-630392981-project Oct 22 21:09:10.228299 ncdv-master-1 devstack@n-api.service[138744]: Oct 22 21:09:10.228299 ncdv-master-1 devstack@n-api.service[138744]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1188354647", "metadata": {"Type": "work"}}} Oct 22 21:09:10.228299 ncdv-master-1 devstack@n-api.service[138744]: method: Oct 22 21:09:10.228299 ncdv-master-1 devstack@n-api.service[138744]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 22 21:09:10.228299 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1188354647', 'metadata': {'Type': 'work'}}}} Oct 22 21:09:10.228299 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:09:10.228299 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:09:10.228299 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 22 21:09:10.228299 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 22 21:09:10.228299 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 22 21:09:10.228299 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise error Oct 22 21:09:10.228299 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 22 21:09:10.228299 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:09:10.228299 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Oct 22 21:09:10.228299 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 22 21:09:10.228299 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:09:10.228299 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 22 21:09:10.228299 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi '0' Oct 22 21:09:10.228299 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:09:10.228299 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:09:10.228299 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:09:10.228299 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:09:10.228299 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:09:10.228299 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:09:10.228299 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:09:10.228299 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:09:10.228299 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 22 21:09:10.228299 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 22 21:09:10.228299 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:09:10.228299 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:09:10.228299 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 22 21:09:10.228299 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 22 21:09:10.228299 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 22 21:09:10.228299 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 22 21:09:10.228299 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 22 21:09:10.228299 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 22 21:09:10.232363 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 22 21:09:10.232363 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:09:10.232363 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:09:10.232363 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:09:10.232363 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:09:10.232363 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:09:10.232363 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:09:10.232363 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 22 21:09:10.232363 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 22 21:09:10.232363 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 22 21:09:10.232363 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:09:10.232363 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-c5a83b5e-cc0b-4279-b448-ef6c564d7696 tempest-VolumesNegativeTest-630392981 tempest-VolumesNegativeTest-630392981-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:09:10.232363 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-c5a83b5e-cc0b-4279-b448-ef6c564d7696 tempest-VolumesNegativeTest-630392981 tempest-VolumesNegativeTest-630392981-project] 10.222.0.18 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.010265 Oct 22 21:09:10.232363 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2054/4105] 10.222.0.18 () {60 vars in 1156 bytes} [Sat Oct 22 21:09:10 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 22 21:09:10.240622 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-3a42ac06-c948-4d22-bfec-b00759a017e2 tempest-VolumesNegativeTest-630392981 tempest-VolumesNegativeTest-630392981-project] Action: 'create', calling method: .version_select at 0x7fd39ee98c10>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1494598525", "metadata": {"Type": "work"}}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:09:10.245315 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-3a42ac06-c948-4d22-bfec-b00759a017e2 tempest-VolumesNegativeTest-630392981 tempest-VolumesNegativeTest-630392981-project] Request method failure captured: Oct 22 21:09:10.245315 ncdv-master-1 devstack@n-api.service[138745]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 22 21:09:10.245315 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 21:09:10.245315 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 21:09:10.245315 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 21:09:10.245315 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 119 Oct 22 21:09:10.245315 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 21:09:10.245315 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 21:09:10.245315 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 21:09:10.245315 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 21:09:10.245315 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVFv13VDOJFPT_Probf5hGKQItQcNmAff96Ihe1qwkUeu1uhCM1oL1WyN_FIzev5z3beSDJBZDWPp3ON40tZCajNCBXP3SLTOuEu3JN6wq_gGlss73EcExYtFD5rVimcxaFT_r_7oHwGG_fDxrd-Uaue1-X1nvRHjtrOLURncjlQIiNo Oct 22 21:09:10.245315 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 21:09:10.245315 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 21:09:10.245315 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 21:09:10.245315 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 21:09:10.245315 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 21:09:10.245315 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 21:09:10.245315 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: 5e2f82ab8605479dabc404ebe9d49e68 Oct 22 21:09:10.245315 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-VolumesNegativeTest-630392981 Oct 22 21:09:10.245315 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 21:09:10.245315 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 21:09:10.245315 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_5e2f82ab8605479dabc404ebe9d49e68"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5e2f82ab8605479dabc404ebe9d49e68"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/5e2f82ab8605479dabc404ebe9d49e68"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5e2f82ab8605479dabc404ebe9d49e68"}]}] Oct 22 21:09:10.245315 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-VolumesNegativeTest-630392981 Oct 22 21:09:10.245315 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: 5e2f82ab8605479dabc404ebe9d49e68 Oct 22 21:09:10.245315 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-VolumesNegativeTest-630392981 Oct 22 21:09:10.245315 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-VolumesNegativeTest-630392981-project Oct 22 21:09:10.245315 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 21:09:10.245315 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 21:09:10.245315 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: 136524e3cec1484cbde4599af32dd118 Oct 22 21:09:10.245315 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-VolumesNegativeTest-630392981-project Oct 22 21:09:10.245315 ncdv-master-1 devstack@n-api.service[138745]: Oct 22 21:09:10.245315 ncdv-master-1 devstack@n-api.service[138745]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1494598525", "metadata": {"Type": "work"}}} Oct 22 21:09:10.245315 ncdv-master-1 devstack@n-api.service[138745]: method: Oct 22 21:09:10.245315 ncdv-master-1 devstack@n-api.service[138745]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 22 21:09:10.245315 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1494598525', 'metadata': {'Type': 'work'}}}} Oct 22 21:09:10.245315 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:09:10.245315 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:09:10.245315 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 22 21:09:10.245315 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 22 21:09:10.245315 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 22 21:09:10.245315 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise error Oct 22 21:09:10.245315 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Oct 22 21:09:10.245315 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:09:10.245315 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 22 21:09:10.245315 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 22 21:09:10.245315 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:09:10.245315 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 22 21:09:10.245315 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi '' Oct 22 21:09:10.245315 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:09:10.245315 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:09:10.245315 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:09:10.245315 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:09:10.245315 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:09:10.245315 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:09:10.245315 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:09:10.245315 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:09:10.245315 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 22 21:09:10.245315 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 22 21:09:10.245315 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:09:10.245315 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:09:10.245315 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 22 21:09:10.245315 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 22 21:09:10.245315 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 22 21:09:10.245315 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 22 21:09:10.245315 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 22 21:09:10.245315 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 22 21:09:10.253103 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 22 21:09:10.253103 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:09:10.253103 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:09:10.253103 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:09:10.253103 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:09:10.253103 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:09:10.253103 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:09:10.253103 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 22 21:09:10.253103 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 22 21:09:10.253103 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 22 21:09:10.253103 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:09:10.253103 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-3a42ac06-c948-4d22-bfec-b00759a017e2 tempest-VolumesNegativeTest-630392981 tempest-VolumesNegativeTest-630392981-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:09:10.253103 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-3a42ac06-c948-4d22-bfec-b00759a017e2 tempest-VolumesNegativeTest-630392981 tempest-VolumesNegativeTest-630392981-project] 10.222.0.18 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.010739 Oct 22 21:09:10.253103 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2052/4106] 10.222.0.18 () {60 vars in 1156 bytes} [Sat Oct 22 21:09:10 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 22 21:09:10.260168 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-c65987f5-8c4c-464f-b0d5-ce7ae06099c3 tempest-VolumesNegativeTest-630392981 tempest-VolumesNegativeTest-630392981-project] Calling method '.version_select at 0x7fd3a8b05310>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:09:10.289106 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-c65987f5-8c4c-464f-b0d5-ce7ae06099c3 tempest-VolumesNegativeTest-630392981 tempest-VolumesNegativeTest-630392981-project] HTTP exception thrown: Volume tempest-invalid-1754202199 could not be found. Oct 22 21:09:10.291965 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-c65987f5-8c4c-464f-b0d5-ce7ae06099c3 tempest-VolumesNegativeTest-630392981 tempest-VolumesNegativeTest-630392981-project] Request method failure captured: Oct 22 21:09:10.291965 ncdv-master-1 devstack@n-api.service[138744]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1754202199 HTTP/1.1 Oct 22 21:09:10.291965 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 21:09:10.291965 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 21:09:10.291965 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 21:09:10.291965 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 0 Oct 22 21:09:10.291965 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 21:09:10.291965 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 21:09:10.291965 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 21:09:10.291965 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 21:09:10.291965 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVFv13VDOJFPT_Probf5hGKQItQcNmAff96Ihe1qwkUeu1uhCM1oL1WyN_FIzev5z3beSDJBZDWPp3ON40tZCajNCBXP3SLTOuEu3JN6wq_gGlss73EcExYtFD5rVimcxaFT_r_7oHwGG_fDxrd-Uaue1-X1nvRHjtrOLURncjlQIiNo Oct 22 21:09:10.291965 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 21:09:10.291965 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 21:09:10.291965 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 21:09:10.291965 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 21:09:10.291965 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 21:09:10.291965 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 21:09:10.291965 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: 5e2f82ab8605479dabc404ebe9d49e68 Oct 22 21:09:10.291965 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-VolumesNegativeTest-630392981 Oct 22 21:09:10.291965 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 21:09:10.291965 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 21:09:10.291965 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_5e2f82ab8605479dabc404ebe9d49e68"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5e2f82ab8605479dabc404ebe9d49e68"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/5e2f82ab8605479dabc404ebe9d49e68"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5e2f82ab8605479dabc404ebe9d49e68"}]}] Oct 22 21:09:10.291965 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-VolumesNegativeTest-630392981 Oct 22 21:09:10.291965 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: 5e2f82ab8605479dabc404ebe9d49e68 Oct 22 21:09:10.291965 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-VolumesNegativeTest-630392981 Oct 22 21:09:10.291965 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-VolumesNegativeTest-630392981-project Oct 22 21:09:10.291965 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 21:09:10.291965 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 21:09:10.291965 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: 136524e3cec1484cbde4599af32dd118 Oct 22 21:09:10.291965 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-VolumesNegativeTest-630392981-project Oct 22 21:09:10.291965 ncdv-master-1 devstack@n-api.service[138744]: method: Oct 22 21:09:10.291965 ncdv-master-1 devstack@n-api.service[138744]: exception: Volume tempest-invalid-1754202199 could not be found. Oct 22 21:09:10.291965 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': 'tempest-invalid-1754202199'} Oct 22 21:09:10.291965 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:09:10.291965 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:09:10.291965 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 22 21:09:10.291965 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 22 21:09:10.291965 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 22 21:09:10.291965 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 22 21:09:10.291965 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 22 21:09:10.291965 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 22 21:09:10.291965 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 22 21:09:10.291965 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 22 21:09:10.291965 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 22 21:09:10.291965 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 22 21:09:10.291965 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 22 21:09:10.291965 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 22 21:09:10.291965 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 22 21:09:10.291965 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 22 21:09:10.291965 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1754202199 could not be found. (HTTP 404) (Request-ID: req-c91c7f48-7517-4141-9ec1-be4058699a3e) Oct 22 21:09:10.291965 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:09:10.291965 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:09:10.291965 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:09:10.291965 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:09:10.291965 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 22 21:09:10.291965 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 22 21:09:10.291965 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 22 21:09:10.291965 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 22 21:09:10.291965 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 22 21:09:10.291965 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 22 21:09:10.291965 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 22 21:09:10.291965 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 22 21:09:10.291965 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 22 21:09:10.296821 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 22 21:09:10.296821 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 22 21:09:10.296821 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 22 21:09:10.296821 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 22 21:09:10.296821 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 22 21:09:10.296821 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 22 21:09:10.296821 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 22 21:09:10.296821 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 22 21:09:10.296821 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 22 21:09:10.296821 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 22 21:09:10.296821 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 22 21:09:10.296821 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 22 21:09:10.296821 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 22 21:09:10.296821 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1754202199 could not be found. Oct 22 21:09:10.296821 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:09:10.296821 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:09:10.296821 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:09:10.296821 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:09:10.296821 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:09:10.296821 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:09:10.296821 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:09:10.296821 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:09:10.296821 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 22 21:09:10.296821 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 22 21:09:10.296821 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:09:10.296821 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:09:10.296821 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 22 21:09:10.296821 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:09:10.296821 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1754202199 could not be found. Oct 22 21:09:10.296821 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:09:10.296821 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:09:10.296821 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:09:10.296821 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:09:10.296821 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:09:10.296821 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:09:10.296821 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:09:10.296821 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:09:10.296821 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1754202199 could not be found. Oct 22 21:09:10.296821 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:09:10.296821 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-c65987f5-8c4c-464f-b0d5-ce7ae06099c3 tempest-VolumesNegativeTest-630392981 tempest-VolumesNegativeTest-630392981-project] Returning 404 to user: Volume tempest-invalid-1754202199 could not be found. {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:09:10.296821 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-c65987f5-8c4c-464f-b0d5-ce7ae06099c3 tempest-VolumesNegativeTest-630392981 tempest-VolumesNegativeTest-630392981-project] 10.222.0.18 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1754202199" status: 404 len: 99 microversion: 2.1 time: 0.037116 Oct 22 21:09:10.296821 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2055/4107] 10.222.0.18 () {58 vars in 1218 bytes} [Sat Oct 22 21:09:10 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1754202199 => generated 99 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 22 21:09:10.305807 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-7c80e86a-382b-44f8-9916-47151911b0d0 tempest-VolumesNegativeTest-630392981 tempest-VolumesNegativeTest-630392981-project] 10.222.0.18 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003948 Oct 22 21:09:10.306341 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2053/4108] 10.222.0.18 () {58 vars in 1140 bytes} [Sat Oct 22 21:09:10 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 22 21:09:10.315477 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-2d166219-b3e7-41c2-adc0-a70003eead8c tempest-VolumesNegativeTest-630392981 tempest-VolumesNegativeTest-630392981-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004120 Oct 22 21:09:10.316392 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2056/4109] 10.222.0.18 () {58 vars in 1137 bytes} [Sat Oct 22 21:09:10 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 22 21:09:10.325153 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-9d3f61d5-ece7-4ee5-a9bb-c7c898d9c9f3 tempest-VolumesNegativeTest-630392981 tempest-VolumesNegativeTest-630392981-project] Calling method '.version_select at 0x7fd39eebc160>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:09:10.355741 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.wsgi [None req-9d3f61d5-ece7-4ee5-a9bb-c7c898d9c9f3 tempest-VolumesNegativeTest-630392981 tempest-VolumesNegativeTest-630392981-project] HTTP exception thrown: Volume c03cdc0d-9515-4658-913e-005515a8b6a9 could not be found. Oct 22 21:09:10.357746 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-9d3f61d5-ece7-4ee5-a9bb-c7c898d9c9f3 tempest-VolumesNegativeTest-630392981 tempest-VolumesNegativeTest-630392981-project] Request method failure captured: Oct 22 21:09:10.357746 ncdv-master-1 devstack@n-api.service[138745]: request: DELETE /compute/v2.1/os-volumes/c03cdc0d-9515-4658-913e-005515a8b6a9 HTTP/1.1 Oct 22 21:09:10.357746 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 21:09:10.357746 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 21:09:10.357746 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 21:09:10.357746 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 0 Oct 22 21:09:10.357746 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 21:09:10.357746 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 21:09:10.357746 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 21:09:10.357746 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 21:09:10.357746 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVFv13VDOJFPT_Probf5hGKQItQcNmAff96Ihe1qwkUeu1uhCM1oL1WyN_FIzev5z3beSDJBZDWPp3ON40tZCajNCBXP3SLTOuEu3JN6wq_gGlss73EcExYtFD5rVimcxaFT_r_7oHwGG_fDxrd-Uaue1-X1nvRHjtrOLURncjlQIiNo Oct 22 21:09:10.357746 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 21:09:10.357746 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 21:09:10.357746 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 21:09:10.357746 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 21:09:10.357746 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 21:09:10.357746 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 21:09:10.357746 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: 5e2f82ab8605479dabc404ebe9d49e68 Oct 22 21:09:10.357746 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-VolumesNegativeTest-630392981 Oct 22 21:09:10.357746 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 21:09:10.357746 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 21:09:10.357746 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_5e2f82ab8605479dabc404ebe9d49e68"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5e2f82ab8605479dabc404ebe9d49e68"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/5e2f82ab8605479dabc404ebe9d49e68"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5e2f82ab8605479dabc404ebe9d49e68"}]}] Oct 22 21:09:10.357746 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-VolumesNegativeTest-630392981 Oct 22 21:09:10.357746 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: 5e2f82ab8605479dabc404ebe9d49e68 Oct 22 21:09:10.357746 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-VolumesNegativeTest-630392981 Oct 22 21:09:10.357746 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-VolumesNegativeTest-630392981-project Oct 22 21:09:10.357746 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 21:09:10.357746 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 21:09:10.357746 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: 136524e3cec1484cbde4599af32dd118 Oct 22 21:09:10.357746 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-VolumesNegativeTest-630392981-project Oct 22 21:09:10.357746 ncdv-master-1 devstack@n-api.service[138745]: method: Oct 22 21:09:10.357746 ncdv-master-1 devstack@n-api.service[138745]: exception: Volume c03cdc0d-9515-4658-913e-005515a8b6a9 could not be found. Oct 22 21:09:10.357746 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'id': 'c03cdc0d-9515-4658-913e-005515a8b6a9'} Oct 22 21:09:10.357746 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:09:10.357746 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:09:10.357746 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 22 21:09:10.357746 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 22 21:09:10.357746 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 22 21:09:10.357746 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 22 21:09:10.357746 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 22 21:09:10.357746 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 22 21:09:10.357746 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 22 21:09:10.357746 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 22 21:09:10.357746 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 22 21:09:10.357746 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 22 21:09:10.357746 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 22 21:09:10.357746 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 22 21:09:10.357746 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 22 21:09:10.357746 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 22 21:09:10.357746 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c03cdc0d-9515-4658-913e-005515a8b6a9 could not be found. (HTTP 404) (Request-ID: req-106e8629-c72f-47bf-8d52-5533fb70b00a) Oct 22 21:09:10.357746 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:09:10.357746 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:09:10.357746 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:09:10.357746 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:09:10.357746 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 22 21:09:10.357746 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 22 21:09:10.357746 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 22 21:09:10.357746 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 22 21:09:10.357746 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 22 21:09:10.357746 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 22 21:09:10.357746 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 22 21:09:10.357746 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 22 21:09:10.357746 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 22 21:09:10.362056 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 22 21:09:10.362056 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 22 21:09:10.362056 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 22 21:09:10.362056 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 22 21:09:10.362056 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 22 21:09:10.362056 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 22 21:09:10.362056 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 22 21:09:10.362056 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 22 21:09:10.362056 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 22 21:09:10.362056 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 22 21:09:10.362056 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 22 21:09:10.362056 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 22 21:09:10.362056 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 22 21:09:10.362056 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c03cdc0d-9515-4658-913e-005515a8b6a9 could not be found. Oct 22 21:09:10.362056 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:09:10.362056 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:09:10.362056 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:09:10.362056 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:09:10.362056 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:09:10.362056 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:09:10.362056 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:09:10.362056 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:09:10.362056 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 22 21:09:10.362056 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 22 21:09:10.362056 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:09:10.362056 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:09:10.362056 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 22 21:09:10.362056 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:09:10.362056 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c03cdc0d-9515-4658-913e-005515a8b6a9 could not be found. Oct 22 21:09:10.362056 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:09:10.362056 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:09:10.362056 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:09:10.362056 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:09:10.362056 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:09:10.362056 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:09:10.362056 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:09:10.362056 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:09:10.362056 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c03cdc0d-9515-4658-913e-005515a8b6a9 could not be found. Oct 22 21:09:10.362056 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:09:10.362056 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-9d3f61d5-ece7-4ee5-a9bb-c7c898d9c9f3 tempest-VolumesNegativeTest-630392981 tempest-VolumesNegativeTest-630392981-project] Returning 404 to user: Volume c03cdc0d-9515-4658-913e-005515a8b6a9 could not be found. {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:09:10.362056 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-9d3f61d5-ece7-4ee5-a9bb-c7c898d9c9f3 tempest-VolumesNegativeTest-630392981 tempest-VolumesNegativeTest-630392981-project] 10.222.0.18 "DELETE /compute/v2.1/os-volumes/c03cdc0d-9515-4658-913e-005515a8b6a9" status: 404 len: 109 microversion: 2.1 time: 0.038082 Oct 22 21:09:10.362056 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2054/4110] 10.222.0.18 () {58 vars in 1248 bytes} [Sat Oct 22 21:09:10 2022] DELETE /compute/v2.1/os-volumes/c03cdc0d-9515-4658-913e-005515a8b6a9 => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 21:09:10.369324 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-8f3f2ca5-0b6a-4759-97d0-164e43bbf73d tempest-VolumesNegativeTest-630392981 tempest-VolumesNegativeTest-630392981-project] Calling method '.version_select at 0x7fd3a8aa15e0>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:09:10.399863 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-8f3f2ca5-0b6a-4759-97d0-164e43bbf73d tempest-VolumesNegativeTest-630392981 tempest-VolumesNegativeTest-630392981-project] HTTP exception thrown: Volume 411f782f-1382-42b7-95d6-b0f457176870 could not be found. Oct 22 21:09:10.401842 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-8f3f2ca5-0b6a-4759-97d0-164e43bbf73d tempest-VolumesNegativeTest-630392981 tempest-VolumesNegativeTest-630392981-project] Request method failure captured: Oct 22 21:09:10.401842 ncdv-master-1 devstack@n-api.service[138744]: request: GET /compute/v2.1/os-volumes/411f782f-1382-42b7-95d6-b0f457176870 HTTP/1.1 Oct 22 21:09:10.401842 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 21:09:10.401842 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 21:09:10.401842 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 21:09:10.401842 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 0 Oct 22 21:09:10.401842 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 21:09:10.401842 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 21:09:10.401842 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 21:09:10.401842 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 21:09:10.401842 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVFv13VDOJFPT_Probf5hGKQItQcNmAff96Ihe1qwkUeu1uhCM1oL1WyN_FIzev5z3beSDJBZDWPp3ON40tZCajNCBXP3SLTOuEu3JN6wq_gGlss73EcExYtFD5rVimcxaFT_r_7oHwGG_fDxrd-Uaue1-X1nvRHjtrOLURncjlQIiNo Oct 22 21:09:10.401842 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 21:09:10.401842 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 21:09:10.401842 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 21:09:10.401842 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 21:09:10.401842 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 21:09:10.401842 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 21:09:10.401842 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: 5e2f82ab8605479dabc404ebe9d49e68 Oct 22 21:09:10.401842 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-VolumesNegativeTest-630392981 Oct 22 21:09:10.401842 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 21:09:10.401842 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 21:09:10.401842 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_5e2f82ab8605479dabc404ebe9d49e68"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5e2f82ab8605479dabc404ebe9d49e68"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/5e2f82ab8605479dabc404ebe9d49e68"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5e2f82ab8605479dabc404ebe9d49e68"}]}] Oct 22 21:09:10.401842 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-VolumesNegativeTest-630392981 Oct 22 21:09:10.401842 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: 5e2f82ab8605479dabc404ebe9d49e68 Oct 22 21:09:10.401842 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-VolumesNegativeTest-630392981 Oct 22 21:09:10.401842 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-VolumesNegativeTest-630392981-project Oct 22 21:09:10.401842 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 21:09:10.401842 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 21:09:10.401842 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: 136524e3cec1484cbde4599af32dd118 Oct 22 21:09:10.401842 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-VolumesNegativeTest-630392981-project Oct 22 21:09:10.401842 ncdv-master-1 devstack@n-api.service[138744]: method: Oct 22 21:09:10.401842 ncdv-master-1 devstack@n-api.service[138744]: exception: Volume 411f782f-1382-42b7-95d6-b0f457176870 could not be found. Oct 22 21:09:10.401842 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': '411f782f-1382-42b7-95d6-b0f457176870'} Oct 22 21:09:10.401842 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:09:10.401842 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:09:10.401842 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 22 21:09:10.401842 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 22 21:09:10.401842 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 22 21:09:10.401842 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 22 21:09:10.401842 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 22 21:09:10.401842 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 22 21:09:10.401842 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 22 21:09:10.401842 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 22 21:09:10.401842 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 22 21:09:10.401842 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 22 21:09:10.401842 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 22 21:09:10.401842 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 22 21:09:10.401842 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 22 21:09:10.401842 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 22 21:09:10.401842 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 411f782f-1382-42b7-95d6-b0f457176870 could not be found. (HTTP 404) (Request-ID: req-db4d9e7e-0db7-444a-9260-b7068cb7dae3) Oct 22 21:09:10.401842 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:09:10.401842 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:09:10.401842 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:09:10.401842 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:09:10.401842 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 22 21:09:10.401842 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 22 21:09:10.401842 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 22 21:09:10.401842 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 22 21:09:10.401842 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 22 21:09:10.401842 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 22 21:09:10.401842 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 22 21:09:10.401842 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 22 21:09:10.401842 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 22 21:09:10.405651 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 22 21:09:10.405651 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 22 21:09:10.405651 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 22 21:09:10.405651 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 22 21:09:10.405651 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 22 21:09:10.405651 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 22 21:09:10.405651 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 22 21:09:10.405651 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 22 21:09:10.405651 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 22 21:09:10.405651 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 22 21:09:10.405651 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 22 21:09:10.405651 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 22 21:09:10.405651 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 22 21:09:10.405651 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 411f782f-1382-42b7-95d6-b0f457176870 could not be found. Oct 22 21:09:10.405651 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:09:10.405651 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:09:10.405651 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:09:10.405651 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:09:10.405651 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:09:10.405651 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:09:10.405651 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:09:10.405651 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:09:10.405651 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 22 21:09:10.405651 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 22 21:09:10.405651 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:09:10.405651 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:09:10.405651 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 22 21:09:10.405651 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:09:10.405651 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 411f782f-1382-42b7-95d6-b0f457176870 could not be found. Oct 22 21:09:10.405651 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:09:10.405651 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:09:10.405651 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:09:10.405651 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:09:10.405651 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:09:10.405651 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:09:10.405651 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:09:10.405651 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:09:10.405651 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 411f782f-1382-42b7-95d6-b0f457176870 could not be found. Oct 22 21:09:10.405651 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:09:10.405651 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-8f3f2ca5-0b6a-4759-97d0-164e43bbf73d tempest-VolumesNegativeTest-630392981 tempest-VolumesNegativeTest-630392981-project] Returning 404 to user: Volume 411f782f-1382-42b7-95d6-b0f457176870 could not be found. {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:09:10.405651 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-8f3f2ca5-0b6a-4759-97d0-164e43bbf73d tempest-VolumesNegativeTest-630392981 tempest-VolumesNegativeTest-630392981-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/411f782f-1382-42b7-95d6-b0f457176870" status: 404 len: 109 microversion: 2.1 time: 0.037908 Oct 22 21:09:10.410038 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2057/4111] 10.222.0.18 () {58 vars in 1245 bytes} [Sat Oct 22 21:09:10 2022] GET /compute/v2.1/os-volumes/411f782f-1382-42b7-95d6-b0f457176870 => generated 109 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 21:09:10.583507 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-98d4cf3f-3fde-4974-b449-c23898c896f7 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5f27abb4-b6a0-4d25-b866-b5618e5dd0dc"}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:09:10.587044 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-98d4cf3f-3fde-4974-b449-c23898c896f7 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] [instance: ad302c49-addb-464c-a15f-fa01577f90c4] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:09:10.589086 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=6 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:09:10.595457 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-98d4cf3f-3fde-4974-b449-c23898c896f7 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:09:10.596189 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-98d4cf3f-3fde-4974-b449-c23898c896f7 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:09:10.596827 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-98d4cf3f-3fde-4974-b449-c23898c896f7 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:09:10.597714 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-98d4cf3f-3fde-4974-b449-c23898c896f7 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:09:10.598339 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-98d4cf3f-3fde-4974-b449-c23898c896f7 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:09:10.598967 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-98d4cf3f-3fde-4974-b449-c23898c896f7 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:09:10.807313 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-3a328849-ce53-46cc-8a84-d4bf8803f0b1 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:09:10.807955 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-3a328849-ce53-46cc-8a84-d4bf8803f0b1 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] [instance: ff57c0ad-9f38-4c58-a194-b0b0d39b1fe0] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:09:10.815062 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_api:SELECT=48 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:09:10.817401 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3a328849-ce53-46cc-8a84-d4bf8803f0b1 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:09:10.818109 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3a328849-ce53-46cc-8a84-d4bf8803f0b1 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:09:10.818922 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3a328849-ce53-46cc-8a84-d4bf8803f0b1 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:09:10.819863 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3a328849-ce53-46cc-8a84-d4bf8803f0b1 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:09:10.820641 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3a328849-ce53-46cc-8a84-d4bf8803f0b1 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:09:10.821266 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3a328849-ce53-46cc-8a84-d4bf8803f0b1 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:09:10.904774 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-98d4cf3f-3fde-4974-b449-c23898c896f7 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] 10.222.0.18 "POST /compute/v2.1/servers/ad302c49-addb-464c-a15f-fa01577f90c4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.325104 Oct 22 21:09:10.906112 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2055/4112] 10.222.0.18 () {60 vars in 1323 bytes} [Sat Oct 22 21:09:10 2022] POST /compute/v2.1/servers/ad302c49-addb-464c-a15f-fa01577f90c4/os-volume_attachments => generated 194 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:09:11.023851 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-3a328849-ce53-46cc-8a84-d4bf8803f0b1 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e7a09f769748629425ad36120a7fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddce0c46c75496f96f2e2dae77751dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:09:11.032856 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-3a328849-ce53-46cc-8a84-d4bf8803f0b1 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] 10.222.0.18 "GET /compute/v2.1/servers/ff57c0ad-9f38-4c58-a194-b0b0d39b1fe0" status: 200 len: 1522 microversion: 2.1 time: 0.230773 Oct 22 21:09:11.033322 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2058/4113] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:09:10 2022] GET /compute/v2.1/servers/ff57c0ad-9f38-4c58-a194-b0b0d39b1fe0 => generated 1522 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:09:12.061717 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-e47093b1-46e3-481f-ab5a-d025bbefbca1 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:09:12.063512 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-e47093b1-46e3-481f-ab5a-d025bbefbca1 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] [instance: ff57c0ad-9f38-4c58-a194-b0b0d39b1fe0] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:09:12.080085 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e47093b1-46e3-481f-ab5a-d025bbefbca1 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:09:12.080605 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e47093b1-46e3-481f-ab5a-d025bbefbca1 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:09:12.081150 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e47093b1-46e3-481f-ab5a-d025bbefbca1 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:09:12.081892 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e47093b1-46e3-481f-ab5a-d025bbefbca1 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:09:12.082367 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e47093b1-46e3-481f-ab5a-d025bbefbca1 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:09:12.082817 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e47093b1-46e3-481f-ab5a-d025bbefbca1 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:09:12.293687 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-e47093b1-46e3-481f-ab5a-d025bbefbca1 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e7a09f769748629425ad36120a7fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddce0c46c75496f96f2e2dae77751dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:09:12.301845 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-e47093b1-46e3-481f-ab5a-d025bbefbca1 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] 10.222.0.18 "GET /compute/v2.1/servers/ff57c0ad-9f38-4c58-a194-b0b0d39b1fe0" status: 200 len: 1522 microversion: 2.1 time: 0.248853 Oct 22 21:09:12.302464 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2056/4114] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:09:12 2022] GET /compute/v2.1/servers/ff57c0ad-9f38-4c58-a194-b0b0d39b1fe0 => generated 1522 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:09:13.324974 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-960d5059-58e3-4716-b03a-c56914fca716 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:09:13.325590 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-960d5059-58e3-4716-b03a-c56914fca716 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] [instance: ff57c0ad-9f38-4c58-a194-b0b0d39b1fe0] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:09:13.338851 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-960d5059-58e3-4716-b03a-c56914fca716 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:09:13.339673 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-960d5059-58e3-4716-b03a-c56914fca716 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:09:13.340629 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-960d5059-58e3-4716-b03a-c56914fca716 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:09:13.341703 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-960d5059-58e3-4716-b03a-c56914fca716 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:09:13.342427 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-960d5059-58e3-4716-b03a-c56914fca716 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:09:13.343082 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-960d5059-58e3-4716-b03a-c56914fca716 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:09:13.373309 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:09:13.571482 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-960d5059-58e3-4716-b03a-c56914fca716 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e7a09f769748629425ad36120a7fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddce0c46c75496f96f2e2dae77751dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:09:13.581454 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-960d5059-58e3-4716-b03a-c56914fca716 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] 10.222.0.18 "GET /compute/v2.1/servers/ff57c0ad-9f38-4c58-a194-b0b0d39b1fe0" status: 200 len: 1522 microversion: 2.1 time: 0.260218 Oct 22 21:09:13.582935 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2059/4115] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:09:13 2022] GET /compute/v2.1/servers/ff57c0ad-9f38-4c58-a194-b0b0d39b1fe0 => generated 1522 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:09:14.331153 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-5a4be685-44d9-4345-9a31-9d5b10843809 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:09:14.339755 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5a4be685-44d9-4345-9a31-9d5b10843809 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:09:14.340637 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5a4be685-44d9-4345-9a31-9d5b10843809 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:09:14.341386 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5a4be685-44d9-4345-9a31-9d5b10843809 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:09:14.368755 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-5a4be685-44d9-4345-9a31-9d5b10843809 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] [instance: ad302c49-addb-464c-a15f-fa01577f90c4] Going to try to stop instance {{(pid=138745) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 22 21:09:14.422347 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-5a4be685-44d9-4345-9a31-9d5b10843809 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] 10.222.0.18 "POST /compute/v2.1/servers/ad302c49-addb-464c-a15f-fa01577f90c4/action" status: 202 len: 0 microversion: 2.1 time: 0.096066 Oct 22 21:09:14.423878 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2057/4116] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 21:09:14 2022] POST /compute/v2.1/servers/ad302c49-addb-464c-a15f-fa01577f90c4/action => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 21:09:14.433106 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-e9dedfd8-99ac-4a00-8c43-8941b822c09e tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:09:14.433741 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-e9dedfd8-99ac-4a00-8c43-8941b822c09e tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] [instance: ad302c49-addb-464c-a15f-fa01577f90c4] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:09:14.443862 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e9dedfd8-99ac-4a00-8c43-8941b822c09e tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:09:14.444746 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e9dedfd8-99ac-4a00-8c43-8941b822c09e tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:09:14.445411 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e9dedfd8-99ac-4a00-8c43-8941b822c09e tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:09:14.446394 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e9dedfd8-99ac-4a00-8c43-8941b822c09e tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:09:14.447135 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e9dedfd8-99ac-4a00-8c43-8941b822c09e tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:09:14.451674 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e9dedfd8-99ac-4a00-8c43-8941b822c09e tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:09:14.607244 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-7a82c55e-a2b2-4b34-b0af-f73f73443617 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:09:14.608025 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-7a82c55e-a2b2-4b34-b0af-f73f73443617 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] [instance: ff57c0ad-9f38-4c58-a194-b0b0d39b1fe0] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:09:14.615725 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7a82c55e-a2b2-4b34-b0af-f73f73443617 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:09:14.616507 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7a82c55e-a2b2-4b34-b0af-f73f73443617 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:09:14.617139 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7a82c55e-a2b2-4b34-b0af-f73f73443617 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:09:14.618178 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7a82c55e-a2b2-4b34-b0af-f73f73443617 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:09:14.618846 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7a82c55e-a2b2-4b34-b0af-f73f73443617 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:09:14.619690 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7a82c55e-a2b2-4b34-b0af-f73f73443617 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:09:14.800414 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-e9dedfd8-99ac-4a00-8c43-8941b822c09e tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0d0bdfb04240209e4efa92f47cbb94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755501ba3e344f1aaf7ef80924bb57d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:09:14.810696 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-e9dedfd8-99ac-4a00-8c43-8941b822c09e tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] 10.222.0.18 "GET /compute/v2.1/servers/ad302c49-addb-464c-a15f-fa01577f90c4" status: 200 len: 1721 microversion: 2.1 time: 0.382189 Oct 22 21:09:14.812446 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2060/4117] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:09:14 2022] GET /compute/v2.1/servers/ad302c49-addb-464c-a15f-fa01577f90c4 => generated 1721 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:09:14.990527 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-7a82c55e-a2b2-4b34-b0af-f73f73443617 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e7a09f769748629425ad36120a7fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddce0c46c75496f96f2e2dae77751dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:09:15.000578 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-7a82c55e-a2b2-4b34-b0af-f73f73443617 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] 10.222.0.18 "GET /compute/v2.1/servers/ff57c0ad-9f38-4c58-a194-b0b0d39b1fe0" status: 200 len: 1522 microversion: 2.1 time: 0.397346 Oct 22 21:09:15.002574 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2058/4118] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:09:14 2022] GET /compute/v2.1/servers/ff57c0ad-9f38-4c58-a194-b0b0d39b1fe0 => generated 1522 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:09:15.837813 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-15fddf82-3503-49da-b060-381f55f25b7b tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:09:15.838520 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-15fddf82-3503-49da-b060-381f55f25b7b tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] [instance: ad302c49-addb-464c-a15f-fa01577f90c4] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:09:15.847665 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-15fddf82-3503-49da-b060-381f55f25b7b tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:09:15.848585 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-15fddf82-3503-49da-b060-381f55f25b7b tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:09:15.849249 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-15fddf82-3503-49da-b060-381f55f25b7b tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:09:15.850714 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-15fddf82-3503-49da-b060-381f55f25b7b tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:09:15.851285 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-15fddf82-3503-49da-b060-381f55f25b7b tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:09:15.851857 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-15fddf82-3503-49da-b060-381f55f25b7b tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:09:16.028150 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-3aaf113a-cb0f-4027-b84e-7ef0e90cae57 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:09:16.030424 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-3aaf113a-cb0f-4027-b84e-7ef0e90cae57 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] [instance: ff57c0ad-9f38-4c58-a194-b0b0d39b1fe0] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:09:16.040772 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3aaf113a-cb0f-4027-b84e-7ef0e90cae57 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:09:16.042403 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3aaf113a-cb0f-4027-b84e-7ef0e90cae57 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:09:16.044265 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3aaf113a-cb0f-4027-b84e-7ef0e90cae57 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:09:16.045819 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3aaf113a-cb0f-4027-b84e-7ef0e90cae57 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:09:16.046608 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3aaf113a-cb0f-4027-b84e-7ef0e90cae57 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:09:16.047813 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3aaf113a-cb0f-4027-b84e-7ef0e90cae57 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:09:16.093488 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-15fddf82-3503-49da-b060-381f55f25b7b tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0d0bdfb04240209e4efa92f47cbb94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755501ba3e344f1aaf7ef80924bb57d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:09:16.105771 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-15fddf82-3503-49da-b060-381f55f25b7b tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] 10.222.0.18 "GET /compute/v2.1/servers/ad302c49-addb-464c-a15f-fa01577f90c4" status: 200 len: 1721 microversion: 2.1 time: 0.270705 Oct 22 21:09:16.107218 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2061/4119] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:09:15 2022] GET /compute/v2.1/servers/ad302c49-addb-464c-a15f-fa01577f90c4 => generated 1721 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:09:16.372081 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-3aaf113a-cb0f-4027-b84e-7ef0e90cae57 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e7a09f769748629425ad36120a7fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddce0c46c75496f96f2e2dae77751dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:09:16.385716 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-3aaf113a-cb0f-4027-b84e-7ef0e90cae57 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] 10.222.0.18 "GET /compute/v2.1/servers/ff57c0ad-9f38-4c58-a194-b0b0d39b1fe0" status: 200 len: 1522 microversion: 2.1 time: 0.363762 Oct 22 21:09:16.386506 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2059/4120] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:09:16 2022] GET /compute/v2.1/servers/ff57c0ad-9f38-4c58-a194-b0b0d39b1fe0 => generated 1522 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:09:17.130670 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-3e49b6b3-e703-4043-889a-fb47e8f90333 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:09:17.131552 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-3e49b6b3-e703-4043-889a-fb47e8f90333 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] [instance: ad302c49-addb-464c-a15f-fa01577f90c4] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:09:17.139143 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3e49b6b3-e703-4043-889a-fb47e8f90333 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:09:17.139630 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3e49b6b3-e703-4043-889a-fb47e8f90333 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:09:17.140078 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3e49b6b3-e703-4043-889a-fb47e8f90333 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:09:17.140854 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3e49b6b3-e703-4043-889a-fb47e8f90333 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:09:17.141492 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3e49b6b3-e703-4043-889a-fb47e8f90333 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:09:17.142058 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3e49b6b3-e703-4043-889a-fb47e8f90333 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:09:17.297448 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-3e49b6b3-e703-4043-889a-fb47e8f90333 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0d0bdfb04240209e4efa92f47cbb94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755501ba3e344f1aaf7ef80924bb57d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:09:17.307300 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-3e49b6b3-e703-4043-889a-fb47e8f90333 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] 10.222.0.18 "GET /compute/v2.1/servers/ad302c49-addb-464c-a15f-fa01577f90c4" status: 200 len: 1721 microversion: 2.1 time: 0.180867 Oct 22 21:09:17.307945 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2062/4121] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:09:17 2022] GET /compute/v2.1/servers/ad302c49-addb-464c-a15f-fa01577f90c4 => generated 1721 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:09:17.412202 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-5ed3283b-cc9f-4e65-bd1a-5ffa7696fd3d tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:09:17.412832 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-5ed3283b-cc9f-4e65-bd1a-5ffa7696fd3d tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] [instance: ff57c0ad-9f38-4c58-a194-b0b0d39b1fe0] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:09:17.419985 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5ed3283b-cc9f-4e65-bd1a-5ffa7696fd3d tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:09:17.420695 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5ed3283b-cc9f-4e65-bd1a-5ffa7696fd3d tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:09:17.421202 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5ed3283b-cc9f-4e65-bd1a-5ffa7696fd3d tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:09:17.422077 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5ed3283b-cc9f-4e65-bd1a-5ffa7696fd3d tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:09:17.422631 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5ed3283b-cc9f-4e65-bd1a-5ffa7696fd3d tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:09:17.423206 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5ed3283b-cc9f-4e65-bd1a-5ffa7696fd3d tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:09:17.577841 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-5ed3283b-cc9f-4e65-bd1a-5ffa7696fd3d tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e7a09f769748629425ad36120a7fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddce0c46c75496f96f2e2dae77751dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:09:17.587130 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-5ed3283b-cc9f-4e65-bd1a-5ffa7696fd3d tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] 10.222.0.18 "GET /compute/v2.1/servers/ff57c0ad-9f38-4c58-a194-b0b0d39b1fe0" status: 200 len: 1522 microversion: 2.1 time: 0.178719 Oct 22 21:09:17.588295 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2060/4122] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:09:17 2022] GET /compute/v2.1/servers/ff57c0ad-9f38-4c58-a194-b0b0d39b1fe0 => generated 1522 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:09:18.332786 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-9d263261-387b-4502-8074-73410fe7151e tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:09:18.336466 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-9d263261-387b-4502-8074-73410fe7151e tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] [instance: ad302c49-addb-464c-a15f-fa01577f90c4] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:09:18.355413 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9d263261-387b-4502-8074-73410fe7151e tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:09:18.356281 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9d263261-387b-4502-8074-73410fe7151e tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:09:18.357049 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9d263261-387b-4502-8074-73410fe7151e tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:09:18.358218 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9d263261-387b-4502-8074-73410fe7151e tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:09:18.359116 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9d263261-387b-4502-8074-73410fe7151e tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:09:18.360040 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9d263261-387b-4502-8074-73410fe7151e tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:09:18.596011 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-9d263261-387b-4502-8074-73410fe7151e tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0d0bdfb04240209e4efa92f47cbb94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755501ba3e344f1aaf7ef80924bb57d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:09:18.609358 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-9d263261-387b-4502-8074-73410fe7151e tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] 10.222.0.18 "GET /compute/v2.1/servers/ad302c49-addb-464c-a15f-fa01577f90c4" status: 200 len: 1721 microversion: 2.1 time: 0.282112 Oct 22 21:09:18.612476 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-0f4813bd-99ab-448b-b5de-4246fa76a0e6 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:09:18.613202 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2063/4123] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:09:18 2022] GET /compute/v2.1/servers/ad302c49-addb-464c-a15f-fa01577f90c4 => generated 1721 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:09:18.614060 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-0f4813bd-99ab-448b-b5de-4246fa76a0e6 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] [instance: ff57c0ad-9f38-4c58-a194-b0b0d39b1fe0] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:09:18.622884 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0f4813bd-99ab-448b-b5de-4246fa76a0e6 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:09:18.623592 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0f4813bd-99ab-448b-b5de-4246fa76a0e6 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:09:18.624190 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0f4813bd-99ab-448b-b5de-4246fa76a0e6 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:09:18.625594 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0f4813bd-99ab-448b-b5de-4246fa76a0e6 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:09:18.626817 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0f4813bd-99ab-448b-b5de-4246fa76a0e6 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:09:18.627681 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0f4813bd-99ab-448b-b5de-4246fa76a0e6 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:09:18.790618 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-0f4813bd-99ab-448b-b5de-4246fa76a0e6 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e7a09f769748629425ad36120a7fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddce0c46c75496f96f2e2dae77751dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:09:18.800655 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-0f4813bd-99ab-448b-b5de-4246fa76a0e6 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] 10.222.0.18 "GET /compute/v2.1/servers/ff57c0ad-9f38-4c58-a194-b0b0d39b1fe0" status: 200 len: 1522 microversion: 2.1 time: 0.192828 Oct 22 21:09:18.802486 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2061/4124] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:09:18 2022] GET /compute/v2.1/servers/ff57c0ad-9f38-4c58-a194-b0b0d39b1fe0 => generated 1522 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:09:19.635460 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-3c19c7fa-157b-4645-93e6-36a0e8b7d76f tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:09:19.636730 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-3c19c7fa-157b-4645-93e6-36a0e8b7d76f tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] [instance: ad302c49-addb-464c-a15f-fa01577f90c4] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:09:19.645475 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3c19c7fa-157b-4645-93e6-36a0e8b7d76f tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:09:19.646250 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3c19c7fa-157b-4645-93e6-36a0e8b7d76f tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:09:19.646870 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3c19c7fa-157b-4645-93e6-36a0e8b7d76f tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:09:19.647799 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3c19c7fa-157b-4645-93e6-36a0e8b7d76f tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:09:19.648607 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3c19c7fa-157b-4645-93e6-36a0e8b7d76f tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:09:19.649207 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3c19c7fa-157b-4645-93e6-36a0e8b7d76f tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:09:19.830986 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-5e436d15-2f45-4868-82c5-c855c0ad3f18 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:09:19.832447 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-5e436d15-2f45-4868-82c5-c855c0ad3f18 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] [instance: ff57c0ad-9f38-4c58-a194-b0b0d39b1fe0] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:09:19.840169 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5e436d15-2f45-4868-82c5-c855c0ad3f18 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:09:19.840929 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5e436d15-2f45-4868-82c5-c855c0ad3f18 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:09:19.841391 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5e436d15-2f45-4868-82c5-c855c0ad3f18 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:09:19.842412 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5e436d15-2f45-4868-82c5-c855c0ad3f18 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:09:19.842896 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5e436d15-2f45-4868-82c5-c855c0ad3f18 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:09:19.843800 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5e436d15-2f45-4868-82c5-c855c0ad3f18 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:09:19.857446 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-3c19c7fa-157b-4645-93e6-36a0e8b7d76f tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0d0bdfb04240209e4efa92f47cbb94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755501ba3e344f1aaf7ef80924bb57d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:09:19.870450 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-3c19c7fa-157b-4645-93e6-36a0e8b7d76f tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] 10.222.0.18 "GET /compute/v2.1/servers/ad302c49-addb-464c-a15f-fa01577f90c4" status: 200 len: 1721 microversion: 2.1 time: 0.238715 Oct 22 21:09:19.886914 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2064/4125] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:09:19 2022] GET /compute/v2.1/servers/ad302c49-addb-464c-a15f-fa01577f90c4 => generated 1721 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:09:20.067879 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-5e436d15-2f45-4868-82c5-c855c0ad3f18 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e7a09f769748629425ad36120a7fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddce0c46c75496f96f2e2dae77751dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:09:20.078280 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-5e436d15-2f45-4868-82c5-c855c0ad3f18 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] 10.222.0.18 "GET /compute/v2.1/servers/ff57c0ad-9f38-4c58-a194-b0b0d39b1fe0" status: 200 len: 1522 microversion: 2.1 time: 0.252981 Oct 22 21:09:20.078873 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2062/4126] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:09:19 2022] GET /compute/v2.1/servers/ff57c0ad-9f38-4c58-a194-b0b0d39b1fe0 => generated 1522 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:09:20.894951 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-66e9d2ae-8258-4702-8ebb-06f5e0799c31 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:09:20.895677 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-66e9d2ae-8258-4702-8ebb-06f5e0799c31 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] [instance: ad302c49-addb-464c-a15f-fa01577f90c4] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:09:20.903574 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-66e9d2ae-8258-4702-8ebb-06f5e0799c31 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:09:20.904083 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-66e9d2ae-8258-4702-8ebb-06f5e0799c31 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:09:20.904529 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-66e9d2ae-8258-4702-8ebb-06f5e0799c31 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:09:20.905431 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-66e9d2ae-8258-4702-8ebb-06f5e0799c31 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:09:20.906060 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-66e9d2ae-8258-4702-8ebb-06f5e0799c31 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:09:20.906605 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-66e9d2ae-8258-4702-8ebb-06f5e0799c31 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:09:21.089433 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-66e9d2ae-8258-4702-8ebb-06f5e0799c31 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0d0bdfb04240209e4efa92f47cbb94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755501ba3e344f1aaf7ef80924bb57d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:09:21.099411 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-66e9d2ae-8258-4702-8ebb-06f5e0799c31 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] 10.222.0.18 "GET /compute/v2.1/servers/ad302c49-addb-464c-a15f-fa01577f90c4" status: 200 len: 1721 microversion: 2.1 time: 0.208781 Oct 22 21:09:21.100632 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2065/4127] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:09:20 2022] GET /compute/v2.1/servers/ad302c49-addb-464c-a15f-fa01577f90c4 => generated 1721 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:09:21.104718 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-08f3308a-37e8-4aa4-b7c8-6c7214524df7 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:09:21.105349 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-08f3308a-37e8-4aa4-b7c8-6c7214524df7 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] [instance: ff57c0ad-9f38-4c58-a194-b0b0d39b1fe0] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:09:21.113887 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-08f3308a-37e8-4aa4-b7c8-6c7214524df7 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:09:21.114895 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-08f3308a-37e8-4aa4-b7c8-6c7214524df7 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:09:21.115169 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-08f3308a-37e8-4aa4-b7c8-6c7214524df7 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:09:21.116617 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-08f3308a-37e8-4aa4-b7c8-6c7214524df7 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:09:21.117351 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-08f3308a-37e8-4aa4-b7c8-6c7214524df7 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:09:21.118133 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-08f3308a-37e8-4aa4-b7c8-6c7214524df7 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:09:21.282866 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-08f3308a-37e8-4aa4-b7c8-6c7214524df7 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e7a09f769748629425ad36120a7fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddce0c46c75496f96f2e2dae77751dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:09:21.292656 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-08f3308a-37e8-4aa4-b7c8-6c7214524df7 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] 10.222.0.18 "GET /compute/v2.1/servers/ff57c0ad-9f38-4c58-a194-b0b0d39b1fe0" status: 200 len: 1522 microversion: 2.1 time: 0.193048 Oct 22 21:09:21.293490 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2063/4128] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:09:21 2022] GET /compute/v2.1/servers/ff57c0ad-9f38-4c58-a194-b0b0d39b1fe0 => generated 1522 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:09:22.127583 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-3ee3df51-4ff4-46a2-9a63-869533a9e08d tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:09:22.128863 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-3ee3df51-4ff4-46a2-9a63-869533a9e08d tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] [instance: ad302c49-addb-464c-a15f-fa01577f90c4] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:09:22.136040 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3ee3df51-4ff4-46a2-9a63-869533a9e08d tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:09:22.136531 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3ee3df51-4ff4-46a2-9a63-869533a9e08d tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:09:22.137181 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3ee3df51-4ff4-46a2-9a63-869533a9e08d tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:09:22.138134 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3ee3df51-4ff4-46a2-9a63-869533a9e08d tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:09:22.138810 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3ee3df51-4ff4-46a2-9a63-869533a9e08d tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:09:22.139850 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3ee3df51-4ff4-46a2-9a63-869533a9e08d tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:09:22.316747 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-ea91c6cd-e616-4f32-be4b-b9d63fc27a83 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:09:22.317384 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-ea91c6cd-e616-4f32-be4b-b9d63fc27a83 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] [instance: ff57c0ad-9f38-4c58-a194-b0b0d39b1fe0] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:09:22.337697 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ea91c6cd-e616-4f32-be4b-b9d63fc27a83 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:09:22.338204 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ea91c6cd-e616-4f32-be4b-b9d63fc27a83 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:09:22.338731 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ea91c6cd-e616-4f32-be4b-b9d63fc27a83 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:09:22.357399 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ea91c6cd-e616-4f32-be4b-b9d63fc27a83 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:09:22.358333 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ea91c6cd-e616-4f32-be4b-b9d63fc27a83 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:09:22.358836 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ea91c6cd-e616-4f32-be4b-b9d63fc27a83 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:09:22.513258 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-3ee3df51-4ff4-46a2-9a63-869533a9e08d tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0d0bdfb04240209e4efa92f47cbb94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755501ba3e344f1aaf7ef80924bb57d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:09:22.526451 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-3ee3df51-4ff4-46a2-9a63-869533a9e08d tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] 10.222.0.18 "GET /compute/v2.1/servers/ad302c49-addb-464c-a15f-fa01577f90c4" status: 200 len: 1721 microversion: 2.1 time: 0.402332 Oct 22 21:09:22.527999 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2066/4129] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:09:22 2022] GET /compute/v2.1/servers/ad302c49-addb-464c-a15f-fa01577f90c4 => generated 1721 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:09:22.733737 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-ea91c6cd-e616-4f32-be4b-b9d63fc27a83 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e7a09f769748629425ad36120a7fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddce0c46c75496f96f2e2dae77751dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:09:22.750335 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-ea91c6cd-e616-4f32-be4b-b9d63fc27a83 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] 10.222.0.18 "GET /compute/v2.1/servers/ff57c0ad-9f38-4c58-a194-b0b0d39b1fe0" status: 200 len: 1522 microversion: 2.1 time: 0.437477 Oct 22 21:09:22.751514 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2064/4130] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:09:22 2022] GET /compute/v2.1/servers/ff57c0ad-9f38-4c58-a194-b0b0d39b1fe0 => generated 1522 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:09:23.551045 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-33566b3d-db2b-4bce-a7b5-061c7358ec41 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:09:23.552338 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-33566b3d-db2b-4bce-a7b5-061c7358ec41 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] [instance: ad302c49-addb-464c-a15f-fa01577f90c4] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:09:23.563757 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-33566b3d-db2b-4bce-a7b5-061c7358ec41 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:09:23.566726 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-33566b3d-db2b-4bce-a7b5-061c7358ec41 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:09:23.567670 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-33566b3d-db2b-4bce-a7b5-061c7358ec41 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:09:23.569207 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-33566b3d-db2b-4bce-a7b5-061c7358ec41 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:09:23.570116 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-33566b3d-db2b-4bce-a7b5-061c7358ec41 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:09:23.571915 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-33566b3d-db2b-4bce-a7b5-061c7358ec41 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:09:23.774561 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-4e81ba5e-6dda-439f-bfee-27e1972f4950 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:09:23.775435 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-4e81ba5e-6dda-439f-bfee-27e1972f4950 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] [instance: ff57c0ad-9f38-4c58-a194-b0b0d39b1fe0] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:09:23.778105 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-33566b3d-db2b-4bce-a7b5-061c7358ec41 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0d0bdfb04240209e4efa92f47cbb94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755501ba3e344f1aaf7ef80924bb57d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:09:23.783245 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4e81ba5e-6dda-439f-bfee-27e1972f4950 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:09:23.783948 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4e81ba5e-6dda-439f-bfee-27e1972f4950 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:09:23.784509 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4e81ba5e-6dda-439f-bfee-27e1972f4950 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:09:23.785492 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4e81ba5e-6dda-439f-bfee-27e1972f4950 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:09:23.786076 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4e81ba5e-6dda-439f-bfee-27e1972f4950 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:09:23.786645 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4e81ba5e-6dda-439f-bfee-27e1972f4950 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:09:23.790015 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-33566b3d-db2b-4bce-a7b5-061c7358ec41 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] 10.222.0.18 "GET /compute/v2.1/servers/ad302c49-addb-464c-a15f-fa01577f90c4" status: 200 len: 1721 microversion: 2.1 time: 0.243226 Oct 22 21:09:23.791749 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2067/4131] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:09:23 2022] GET /compute/v2.1/servers/ad302c49-addb-464c-a15f-fa01577f90c4 => generated 1721 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:09:23.999840 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-4e81ba5e-6dda-439f-bfee-27e1972f4950 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e7a09f769748629425ad36120a7fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddce0c46c75496f96f2e2dae77751dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:09:24.021555 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-4e81ba5e-6dda-439f-bfee-27e1972f4950 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] 10.222.0.18 "GET /compute/v2.1/servers/ff57c0ad-9f38-4c58-a194-b0b0d39b1fe0" status: 200 len: 1522 microversion: 2.1 time: 0.248897 Oct 22 21:09:24.035365 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2065/4132] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:09:23 2022] GET /compute/v2.1/servers/ff57c0ad-9f38-4c58-a194-b0b0d39b1fe0 => generated 1522 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:09:24.814843 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-e9a70bc3-def3-4987-93c5-c45cccd41e78 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:09:24.815720 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-e9a70bc3-def3-4987-93c5-c45cccd41e78 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] [instance: ad302c49-addb-464c-a15f-fa01577f90c4] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:09:24.833472 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e9a70bc3-def3-4987-93c5-c45cccd41e78 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:09:24.834107 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e9a70bc3-def3-4987-93c5-c45cccd41e78 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:09:24.834984 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e9a70bc3-def3-4987-93c5-c45cccd41e78 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:09:24.836395 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e9a70bc3-def3-4987-93c5-c45cccd41e78 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:09:24.837456 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e9a70bc3-def3-4987-93c5-c45cccd41e78 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:09:24.838037 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e9a70bc3-def3-4987-93c5-c45cccd41e78 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:09:25.024332 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-e9a70bc3-def3-4987-93c5-c45cccd41e78 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0d0bdfb04240209e4efa92f47cbb94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755501ba3e344f1aaf7ef80924bb57d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:09:25.034118 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-e9a70bc3-def3-4987-93c5-c45cccd41e78 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] 10.222.0.18 "GET /compute/v2.1/servers/ad302c49-addb-464c-a15f-fa01577f90c4" status: 200 len: 1721 microversion: 2.1 time: 0.224067 Oct 22 21:09:25.035539 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2068/4133] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:09:24 2022] GET /compute/v2.1/servers/ad302c49-addb-464c-a15f-fa01577f90c4 => generated 1721 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:09:25.056738 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-8416871c-4869-47a4-825c-5b3c40527f57 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:09:25.058372 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-8416871c-4869-47a4-825c-5b3c40527f57 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] [instance: ff57c0ad-9f38-4c58-a194-b0b0d39b1fe0] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:09:25.069578 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8416871c-4869-47a4-825c-5b3c40527f57 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:09:25.070400 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8416871c-4869-47a4-825c-5b3c40527f57 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:09:25.071143 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8416871c-4869-47a4-825c-5b3c40527f57 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:09:25.073123 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8416871c-4869-47a4-825c-5b3c40527f57 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:09:25.073857 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8416871c-4869-47a4-825c-5b3c40527f57 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:09:25.074545 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8416871c-4869-47a4-825c-5b3c40527f57 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:09:25.243599 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-8416871c-4869-47a4-825c-5b3c40527f57 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e7a09f769748629425ad36120a7fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddce0c46c75496f96f2e2dae77751dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:09:25.254136 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-8416871c-4869-47a4-825c-5b3c40527f57 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] 10.222.0.18 "GET /compute/v2.1/servers/ff57c0ad-9f38-4c58-a194-b0b0d39b1fe0" status: 200 len: 1522 microversion: 2.1 time: 0.205178 Oct 22 21:09:25.254723 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2066/4134] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:09:25 2022] GET /compute/v2.1/servers/ff57c0ad-9f38-4c58-a194-b0b0d39b1fe0 => generated 1522 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:09:26.061548 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-9d33ca1a-8387-4965-bd54-6e9f0c03f933 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:09:26.064224 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-9d33ca1a-8387-4965-bd54-6e9f0c03f933 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] [instance: ad302c49-addb-464c-a15f-fa01577f90c4] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:09:26.074206 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9d33ca1a-8387-4965-bd54-6e9f0c03f933 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:09:26.075455 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9d33ca1a-8387-4965-bd54-6e9f0c03f933 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:09:26.080615 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9d33ca1a-8387-4965-bd54-6e9f0c03f933 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:09:26.081819 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9d33ca1a-8387-4965-bd54-6e9f0c03f933 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:09:26.084262 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9d33ca1a-8387-4965-bd54-6e9f0c03f933 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:09:26.085036 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9d33ca1a-8387-4965-bd54-6e9f0c03f933 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:09:26.285018 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-0b09f4eb-7c2c-4382-8e3e-2ae26a9d6c30 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:09:26.285665 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-0b09f4eb-7c2c-4382-8e3e-2ae26a9d6c30 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] [instance: ff57c0ad-9f38-4c58-a194-b0b0d39b1fe0] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:09:26.287934 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-9d33ca1a-8387-4965-bd54-6e9f0c03f933 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0d0bdfb04240209e4efa92f47cbb94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755501ba3e344f1aaf7ef80924bb57d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:09:26.293502 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0b09f4eb-7c2c-4382-8e3e-2ae26a9d6c30 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:09:26.294355 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0b09f4eb-7c2c-4382-8e3e-2ae26a9d6c30 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:09:26.294983 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0b09f4eb-7c2c-4382-8e3e-2ae26a9d6c30 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:09:26.295904 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0b09f4eb-7c2c-4382-8e3e-2ae26a9d6c30 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:09:26.296800 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0b09f4eb-7c2c-4382-8e3e-2ae26a9d6c30 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:09:26.297429 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0b09f4eb-7c2c-4382-8e3e-2ae26a9d6c30 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:09:26.297999 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-9d33ca1a-8387-4965-bd54-6e9f0c03f933 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] 10.222.0.18 "GET /compute/v2.1/servers/ad302c49-addb-464c-a15f-fa01577f90c4" status: 200 len: 1721 microversion: 2.1 time: 0.243671 Oct 22 21:09:26.311364 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2069/4135] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:09:26 2022] GET /compute/v2.1/servers/ad302c49-addb-464c-a15f-fa01577f90c4 => generated 1721 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:09:26.334279 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:09:26.513020 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-0b09f4eb-7c2c-4382-8e3e-2ae26a9d6c30 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e7a09f769748629425ad36120a7fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddce0c46c75496f96f2e2dae77751dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:09:26.522492 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-0b09f4eb-7c2c-4382-8e3e-2ae26a9d6c30 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] 10.222.0.18 "GET /compute/v2.1/servers/ff57c0ad-9f38-4c58-a194-b0b0d39b1fe0" status: 200 len: 1522 microversion: 2.1 time: 0.248871 Oct 22 21:09:26.531448 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2067/4136] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:09:26 2022] GET /compute/v2.1/servers/ff57c0ad-9f38-4c58-a194-b0b0d39b1fe0 => generated 1522 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:09:27.325358 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-4d74265d-e01c-4355-98b1-43cad750906b tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:09:27.325980 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-4d74265d-e01c-4355-98b1-43cad750906b tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] [instance: ad302c49-addb-464c-a15f-fa01577f90c4] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:09:27.340175 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4d74265d-e01c-4355-98b1-43cad750906b tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:09:27.340677 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4d74265d-e01c-4355-98b1-43cad750906b tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:09:27.341112 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4d74265d-e01c-4355-98b1-43cad750906b tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:09:27.342001 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4d74265d-e01c-4355-98b1-43cad750906b tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:09:27.342621 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4d74265d-e01c-4355-98b1-43cad750906b tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:09:27.343277 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4d74265d-e01c-4355-98b1-43cad750906b tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:09:27.547931 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-7ac1557d-0024-4ee7-b65b-d7554280b485 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:09:27.549161 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-7ac1557d-0024-4ee7-b65b-d7554280b485 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] [instance: ff57c0ad-9f38-4c58-a194-b0b0d39b1fe0] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:09:27.558048 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7ac1557d-0024-4ee7-b65b-d7554280b485 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:09:27.559315 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7ac1557d-0024-4ee7-b65b-d7554280b485 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:09:27.560063 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7ac1557d-0024-4ee7-b65b-d7554280b485 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:09:27.561913 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7ac1557d-0024-4ee7-b65b-d7554280b485 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:09:27.562616 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7ac1557d-0024-4ee7-b65b-d7554280b485 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:09:27.563989 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7ac1557d-0024-4ee7-b65b-d7554280b485 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:09:27.594345 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-4d74265d-e01c-4355-98b1-43cad750906b tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0d0bdfb04240209e4efa92f47cbb94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755501ba3e344f1aaf7ef80924bb57d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:09:27.609860 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-4d74265d-e01c-4355-98b1-43cad750906b tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] 10.222.0.18 "GET /compute/v2.1/servers/ad302c49-addb-464c-a15f-fa01577f90c4" status: 200 len: 1721 microversion: 2.1 time: 0.288241 Oct 22 21:09:27.616175 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2070/4137] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:09:27 2022] GET /compute/v2.1/servers/ad302c49-addb-464c-a15f-fa01577f90c4 => generated 1721 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:09:27.849679 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-7ac1557d-0024-4ee7-b65b-d7554280b485 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e7a09f769748629425ad36120a7fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddce0c46c75496f96f2e2dae77751dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:09:27.861801 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-7ac1557d-0024-4ee7-b65b-d7554280b485 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] 10.222.0.18 "GET /compute/v2.1/servers/ff57c0ad-9f38-4c58-a194-b0b0d39b1fe0" status: 200 len: 1522 microversion: 2.1 time: 0.318905 Oct 22 21:09:27.863200 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2068/4138] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:09:27 2022] GET /compute/v2.1/servers/ff57c0ad-9f38-4c58-a194-b0b0d39b1fe0 => generated 1522 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:09:28.074614 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-a1f2edb7-eab2-4476-84fe-420eaf9713a6 tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:09:28.093278 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-a1f2edb7-eab2-4476-84fe-420eaf9713a6 tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '98584920f7f948d6995412c700128be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf63c122a5e4685a891957e1b58b9e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:09:28.096795 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-a1f2edb7-eab2-4476-84fe-420eaf9713a6 tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] Searching by: {'deleted': False, 'project_id': '0cf63c122a5e4685a891957e1b58b9e4'} {{(pid=138744) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 22 21:09:28.104805 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a1f2edb7-eab2-4476-84fe-420eaf9713a6 tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:09:28.105701 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a1f2edb7-eab2-4476-84fe-420eaf9713a6 tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:09:28.106544 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a1f2edb7-eab2-4476-84fe-420eaf9713a6 tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:09:28.107648 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a1f2edb7-eab2-4476-84fe-420eaf9713a6 tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:09:28.108403 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a1f2edb7-eab2-4476-84fe-420eaf9713a6 tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:09:28.109371 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a1f2edb7-eab2-4476-84fe-420eaf9713a6 tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:09:28.145419 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.multi_cell_list [None req-a1f2edb7-eab2-4476-84fe-420eaf9713a6 tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=138744) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 22 21:09:28.189273 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-a1f2edb7-eab2-4476-84fe-420eaf9713a6 tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] 10.222.0.18 "GET /compute/v2.1/servers" status: 200 len: 340 microversion: 2.1 time: 0.120292 Oct 22 21:09:28.202016 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2071/4139] 10.222.0.18 () {58 vars in 1125 bytes} [Sat Oct 22 21:09:28 2022] GET /compute/v2.1/servers => generated 340 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:09:28.209313 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-e516a91d-6695-4847-b0a8-ed8f849fe717 tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:09:28.222990 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-e516a91d-6695-4847-b0a8-ed8f849fe717 tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '98584920f7f948d6995412c700128be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf63c122a5e4685a891957e1b58b9e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:09:28.231289 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-e516a91d-6695-4847-b0a8-ed8f849fe717 tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] Searching by: {'deleted': False, 'project_id': '0cf63c122a5e4685a891957e1b58b9e4'} {{(pid=138745) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 22 21:09:28.238631 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e516a91d-6695-4847-b0a8-ed8f849fe717 tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:09:28.239521 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e516a91d-6695-4847-b0a8-ed8f849fe717 tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:09:28.240215 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e516a91d-6695-4847-b0a8-ed8f849fe717 tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:09:28.241403 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e516a91d-6695-4847-b0a8-ed8f849fe717 tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:09:28.245320 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e516a91d-6695-4847-b0a8-ed8f849fe717 tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:09:28.245830 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e516a91d-6695-4847-b0a8-ed8f849fe717 tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:09:28.282658 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.multi_cell_list [None req-e516a91d-6695-4847-b0a8-ed8f849fe717 tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=138745) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 22 21:09:28.354200 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-e516a91d-6695-4847-b0a8-ed8f849fe717 tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98584920f7f948d6995412c700128be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf63c122a5e4685a891957e1b58b9e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:09:28.362818 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e516a91d-6695-4847-b0a8-ed8f849fe717 tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:09:28.363723 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e516a91d-6695-4847-b0a8-ed8f849fe717 tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:09:28.364334 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e516a91d-6695-4847-b0a8-ed8f849fe717 tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:09:28.605083 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-e516a91d-6695-4847-b0a8-ed8f849fe717 tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] 10.222.0.18 "GET /compute/v2.1/servers/detail" status: 200 len: 1713 microversion: 2.1 time: 0.400773 Oct 22 21:09:28.605637 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2069/4140] 10.222.0.18 () {58 vars in 1146 bytes} [Sat Oct 22 21:09:28 2022] GET /compute/v2.1/servers/detail => generated 1713 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:09:28.641270 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-9d0a856d-bc4c-4591-b810-f644016ae4a7 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:09:28.642011 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-ce3cff20-54a8-47dc-b3c3-89d7621893c9 tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:09:28.643403 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-9d0a856d-bc4c-4591-b810-f644016ae4a7 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] [instance: ad302c49-addb-464c-a15f-fa01577f90c4] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:09:28.666974 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-ce3cff20-54a8-47dc-b3c3-89d7621893c9 tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] 10.222.0.18 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.038179 Oct 22 21:09:28.667616 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2072/4141] 10.222.0.18 () {58 vars in 1137 bytes} [Sat Oct 22 21:09:28 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 21:09:28.678853 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9d0a856d-bc4c-4591-b810-f644016ae4a7 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:09:28.679856 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9d0a856d-bc4c-4591-b810-f644016ae4a7 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:09:28.680402 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9d0a856d-bc4c-4591-b810-f644016ae4a7 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:09:28.682765 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9d0a856d-bc4c-4591-b810-f644016ae4a7 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:09:28.685056 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9d0a856d-bc4c-4591-b810-f644016ae4a7 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:09:28.688815 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9d0a856d-bc4c-4591-b810-f644016ae4a7 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:09:28.888848 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-4b19200b-aa7e-4a76-948d-9499da7ab25c tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:09:28.890134 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-4b19200b-aa7e-4a76-948d-9499da7ab25c tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] [instance: ff57c0ad-9f38-4c58-a194-b0b0d39b1fe0] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:09:28.902613 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4b19200b-aa7e-4a76-948d-9499da7ab25c tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:09:28.905242 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4b19200b-aa7e-4a76-948d-9499da7ab25c tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:09:28.909057 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4b19200b-aa7e-4a76-948d-9499da7ab25c tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:09:28.910025 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4b19200b-aa7e-4a76-948d-9499da7ab25c tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:09:28.913837 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4b19200b-aa7e-4a76-948d-9499da7ab25c tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:09:28.914576 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4b19200b-aa7e-4a76-948d-9499da7ab25c tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:09:28.953603 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-9d0a856d-bc4c-4591-b810-f644016ae4a7 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0d0bdfb04240209e4efa92f47cbb94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755501ba3e344f1aaf7ef80924bb57d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:09:28.967651 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-9d0a856d-bc4c-4591-b810-f644016ae4a7 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] 10.222.0.18 "GET /compute/v2.1/servers/ad302c49-addb-464c-a15f-fa01577f90c4" status: 200 len: 1721 microversion: 2.1 time: 0.333802 Oct 22 21:09:28.968964 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2070/4142] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:09:28 2022] GET /compute/v2.1/servers/ad302c49-addb-464c-a15f-fa01577f90c4 => generated 1721 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:09:29.016559 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-b47a2c6e-8272-4aad-8037-9f1099daa878 tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:09:29.017324 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-b47a2c6e-8272-4aad-8037-9f1099daa878 tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] [instance: e1523193-327c-4659-8fc4-7329cbffd32f] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:09:29.025233 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b47a2c6e-8272-4aad-8037-9f1099daa878 tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:09:29.026449 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b47a2c6e-8272-4aad-8037-9f1099daa878 tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:09:29.029911 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b47a2c6e-8272-4aad-8037-9f1099daa878 tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:09:29.031331 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b47a2c6e-8272-4aad-8037-9f1099daa878 tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:09:29.032013 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b47a2c6e-8272-4aad-8037-9f1099daa878 tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:09:29.032934 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b47a2c6e-8272-4aad-8037-9f1099daa878 tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:09:29.080408 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-b47a2c6e-8272-4aad-8037-9f1099daa878 tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] [instance: e1523193-327c-4659-8fc4-7329cbffd32f] Going to try to terminate instance {{(pid=138745) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 21:09:29.162464 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-4b19200b-aa7e-4a76-948d-9499da7ab25c tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e7a09f769748629425ad36120a7fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddce0c46c75496f96f2e2dae77751dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:09:29.181145 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-4b19200b-aa7e-4a76-948d-9499da7ab25c tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] 10.222.0.18 "GET /compute/v2.1/servers/ff57c0ad-9f38-4c58-a194-b0b0d39b1fe0" status: 200 len: 1522 microversion: 2.1 time: 0.297609 Oct 22 21:09:29.181874 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2073/4143] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:09:28 2022] GET /compute/v2.1/servers/ff57c0ad-9f38-4c58-a194-b0b0d39b1fe0 => generated 1522 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:09:29.221908 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-b47a2c6e-8272-4aad-8037-9f1099daa878 tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] 10.222.0.18 "DELETE /compute/v2.1/servers/e1523193-327c-4659-8fc4-7329cbffd32f" status: 204 len: 0 microversion: 2.1 time: 0.210088 Oct 22 21:09:29.223778 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2071/4144] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 21:09:29 2022] DELETE /compute/v2.1/servers/e1523193-327c-4659-8fc4-7329cbffd32f => generated 0 bytes in 213 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 21:09:29.233229 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-4834d98d-e604-4d1c-b20c-e497770662ce tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:09:29.234225 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-4834d98d-e604-4d1c-b20c-e497770662ce tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] [instance: e1523193-327c-4659-8fc4-7329cbffd32f] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:09:29.243037 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4834d98d-e604-4d1c-b20c-e497770662ce tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:09:29.243719 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4834d98d-e604-4d1c-b20c-e497770662ce tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:09:29.244453 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4834d98d-e604-4d1c-b20c-e497770662ce tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:09:29.245408 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4834d98d-e604-4d1c-b20c-e497770662ce tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:09:29.246084 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4834d98d-e604-4d1c-b20c-e497770662ce tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:09:29.247833 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4834d98d-e604-4d1c-b20c-e497770662ce tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:09:29.503236 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-4834d98d-e604-4d1c-b20c-e497770662ce tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98584920f7f948d6995412c700128be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf63c122a5e4685a891957e1b58b9e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:09:29.521930 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-4834d98d-e604-4d1c-b20c-e497770662ce tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] 10.222.0.18 "GET /compute/v2.1/servers/e1523193-327c-4659-8fc4-7329cbffd32f" status: 200 len: 1716 microversion: 2.1 time: 0.293538 Oct 22 21:09:29.522524 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2074/4145] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:09:29 2022] GET /compute/v2.1/servers/e1523193-327c-4659-8fc4-7329cbffd32f => generated 1716 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:09:29.994022 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-1bc662ad-9705-4bf6-87ac-d018d3026984 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:09:29.995462 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-1bc662ad-9705-4bf6-87ac-d018d3026984 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] [instance: ad302c49-addb-464c-a15f-fa01577f90c4] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:09:30.004298 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1bc662ad-9705-4bf6-87ac-d018d3026984 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:09:30.004959 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1bc662ad-9705-4bf6-87ac-d018d3026984 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:09:30.005581 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1bc662ad-9705-4bf6-87ac-d018d3026984 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:09:30.006316 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1bc662ad-9705-4bf6-87ac-d018d3026984 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:09:30.008552 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1bc662ad-9705-4bf6-87ac-d018d3026984 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:09:30.009446 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1bc662ad-9705-4bf6-87ac-d018d3026984 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:09:30.212833 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-a405f800-e7ab-4e7b-8e79-9328a54d25d5 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:09:30.214047 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-a405f800-e7ab-4e7b-8e79-9328a54d25d5 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] [instance: ff57c0ad-9f38-4c58-a194-b0b0d39b1fe0] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:09:30.220449 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-1bc662ad-9705-4bf6-87ac-d018d3026984 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0d0bdfb04240209e4efa92f47cbb94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755501ba3e344f1aaf7ef80924bb57d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:09:30.231254 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-1bc662ad-9705-4bf6-87ac-d018d3026984 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] 10.222.0.18 "GET /compute/v2.1/servers/ad302c49-addb-464c-a15f-fa01577f90c4" status: 200 len: 1721 microversion: 2.1 time: 0.242974 Oct 22 21:09:30.231480 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a405f800-e7ab-4e7b-8e79-9328a54d25d5 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:09:30.231848 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a405f800-e7ab-4e7b-8e79-9328a54d25d5 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:09:30.234300 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a405f800-e7ab-4e7b-8e79-9328a54d25d5 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:09:30.235059 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a405f800-e7ab-4e7b-8e79-9328a54d25d5 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:09:30.238461 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a405f800-e7ab-4e7b-8e79-9328a54d25d5 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:09:30.239270 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a405f800-e7ab-4e7b-8e79-9328a54d25d5 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:09:30.242227 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2072/4146] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:09:29 2022] GET /compute/v2.1/servers/ad302c49-addb-464c-a15f-fa01577f90c4 => generated 1721 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:09:30.432175 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-a405f800-e7ab-4e7b-8e79-9328a54d25d5 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e7a09f769748629425ad36120a7fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddce0c46c75496f96f2e2dae77751dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:09:30.448390 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-a405f800-e7ab-4e7b-8e79-9328a54d25d5 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] 10.222.0.18 "GET /compute/v2.1/servers/ff57c0ad-9f38-4c58-a194-b0b0d39b1fe0" status: 200 len: 1522 microversion: 2.1 time: 0.245118 Oct 22 21:09:30.453718 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2075/4147] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:09:30 2022] GET /compute/v2.1/servers/ff57c0ad-9f38-4c58-a194-b0b0d39b1fe0 => generated 1522 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:09:30.549174 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-0376186d-8672-4718-b5b7-ce1ee3db651f tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:09:30.550185 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-0376186d-8672-4718-b5b7-ce1ee3db651f tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] [instance: e1523193-327c-4659-8fc4-7329cbffd32f] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:09:30.563435 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0376186d-8672-4718-b5b7-ce1ee3db651f tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:09:30.565310 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0376186d-8672-4718-b5b7-ce1ee3db651f tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:09:30.566010 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0376186d-8672-4718-b5b7-ce1ee3db651f tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:09:30.568534 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0376186d-8672-4718-b5b7-ce1ee3db651f tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:09:30.569672 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0376186d-8672-4718-b5b7-ce1ee3db651f tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:09:30.572338 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0376186d-8672-4718-b5b7-ce1ee3db651f tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:09:30.934980 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-0376186d-8672-4718-b5b7-ce1ee3db651f tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98584920f7f948d6995412c700128be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf63c122a5e4685a891957e1b58b9e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:09:30.943826 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-0376186d-8672-4718-b5b7-ce1ee3db651f tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] 10.222.0.18 "GET /compute/v2.1/servers/e1523193-327c-4659-8fc4-7329cbffd32f" status: 200 len: 1716 microversion: 2.1 time: 0.400914 Oct 22 21:09:30.944973 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2073/4148] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:09:30 2022] GET /compute/v2.1/servers/e1523193-327c-4659-8fc4-7329cbffd32f => generated 1716 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:09:31.257717 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-6d85dca7-ca5c-413f-ab97-bb7795ba308b tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:09:31.258339 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-6d85dca7-ca5c-413f-ab97-bb7795ba308b tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] [instance: ad302c49-addb-464c-a15f-fa01577f90c4] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:09:31.268354 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6d85dca7-ca5c-413f-ab97-bb7795ba308b tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:09:31.268944 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6d85dca7-ca5c-413f-ab97-bb7795ba308b tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:09:31.269644 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6d85dca7-ca5c-413f-ab97-bb7795ba308b tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:09:31.270669 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6d85dca7-ca5c-413f-ab97-bb7795ba308b tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:09:31.271199 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6d85dca7-ca5c-413f-ab97-bb7795ba308b tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:09:31.271730 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6d85dca7-ca5c-413f-ab97-bb7795ba308b tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:09:31.295932 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:SELECT=100 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:09:31.480726 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-df9f72e0-2cf4-4e09-a3bf-ef52bc1cdd7c tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:09:31.482199 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-df9f72e0-2cf4-4e09-a3bf-ef52bc1cdd7c tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] [instance: ff57c0ad-9f38-4c58-a194-b0b0d39b1fe0] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:09:31.491110 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-df9f72e0-2cf4-4e09-a3bf-ef52bc1cdd7c tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:09:31.492337 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-df9f72e0-2cf4-4e09-a3bf-ef52bc1cdd7c tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:09:31.493061 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-df9f72e0-2cf4-4e09-a3bf-ef52bc1cdd7c tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:09:31.494729 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-df9f72e0-2cf4-4e09-a3bf-ef52bc1cdd7c tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:09:31.495503 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-df9f72e0-2cf4-4e09-a3bf-ef52bc1cdd7c tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:09:31.496293 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-df9f72e0-2cf4-4e09-a3bf-ef52bc1cdd7c tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:09:31.663847 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-6d85dca7-ca5c-413f-ab97-bb7795ba308b tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0d0bdfb04240209e4efa92f47cbb94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755501ba3e344f1aaf7ef80924bb57d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:09:31.675030 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-6d85dca7-ca5c-413f-ab97-bb7795ba308b tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] 10.222.0.18 "GET /compute/v2.1/servers/ad302c49-addb-464c-a15f-fa01577f90c4" status: 200 len: 1698 microversion: 2.1 time: 0.421399 Oct 22 21:09:31.676788 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2076/4149] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:09:31 2022] GET /compute/v2.1/servers/ad302c49-addb-464c-a15f-fa01577f90c4 => generated 1698 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:09:31.775255 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-214ad19d-3a3d-4a94-bd79-8de0e216562d tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:09:31.785514 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-214ad19d-3a3d-4a94-bd79-8de0e216562d tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:09:31.788936 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-214ad19d-3a3d-4a94-bd79-8de0e216562d tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:09:31.790498 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-214ad19d-3a3d-4a94-bd79-8de0e216562d tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:09:31.816505 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-df9f72e0-2cf4-4e09-a3bf-ef52bc1cdd7c tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e7a09f769748629425ad36120a7fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddce0c46c75496f96f2e2dae77751dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:09:31.832948 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-df9f72e0-2cf4-4e09-a3bf-ef52bc1cdd7c tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] 10.222.0.18 "GET /compute/v2.1/servers/ff57c0ad-9f38-4c58-a194-b0b0d39b1fe0" status: 200 len: 1522 microversion: 2.1 time: 0.357468 Oct 22 21:09:31.835435 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2074/4150] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:09:31 2022] GET /compute/v2.1/servers/ff57c0ad-9f38-4c58-a194-b0b0d39b1fe0 => generated 1522 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:09:31.852480 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-214ad19d-3a3d-4a94-bd79-8de0e216562d tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] [instance: ad302c49-addb-464c-a15f-fa01577f90c4] Going to try to start instance {{(pid=138744) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 22 21:09:31.934230 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-214ad19d-3a3d-4a94-bd79-8de0e216562d tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] 10.222.0.18 "POST /compute/v2.1/servers/ad302c49-addb-464c-a15f-fa01577f90c4/action" status: 202 len: 0 microversion: 2.1 time: 0.162993 Oct 22 21:09:31.934845 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2077/4151] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 21:09:31 2022] POST /compute/v2.1/servers/ad302c49-addb-464c-a15f-fa01577f90c4/action => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 22 21:09:31.947596 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-02503567-136c-4b2c-b15e-8bf59ae3ee59 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:09:31.948619 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-02503567-136c-4b2c-b15e-8bf59ae3ee59 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] [instance: ad302c49-addb-464c-a15f-fa01577f90c4] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:09:31.960194 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-02503567-136c-4b2c-b15e-8bf59ae3ee59 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:09:31.961014 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-02503567-136c-4b2c-b15e-8bf59ae3ee59 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:09:31.961752 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-02503567-136c-4b2c-b15e-8bf59ae3ee59 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:09:31.963066 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-02503567-136c-4b2c-b15e-8bf59ae3ee59 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:09:31.963801 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-02503567-136c-4b2c-b15e-8bf59ae3ee59 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:09:31.964420 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-02503567-136c-4b2c-b15e-8bf59ae3ee59 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:09:31.980941 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-950f93a2-50e8-492b-889f-7b19e73e30c2 tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:09:31.981697 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-950f93a2-50e8-492b-889f-7b19e73e30c2 tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] [instance: e1523193-327c-4659-8fc4-7329cbffd32f] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:09:32.008906 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-950f93a2-50e8-492b-889f-7b19e73e30c2 tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:09:32.010119 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-950f93a2-50e8-492b-889f-7b19e73e30c2 tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:09:32.010797 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-950f93a2-50e8-492b-889f-7b19e73e30c2 tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:09:32.013180 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-950f93a2-50e8-492b-889f-7b19e73e30c2 tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:09:32.016509 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-950f93a2-50e8-492b-889f-7b19e73e30c2 tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:09:32.017372 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-950f93a2-50e8-492b-889f-7b19e73e30c2 tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:09:32.379219 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-950f93a2-50e8-492b-889f-7b19e73e30c2 tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98584920f7f948d6995412c700128be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf63c122a5e4685a891957e1b58b9e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:09:32.390574 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-950f93a2-50e8-492b-889f-7b19e73e30c2 tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] 10.222.0.18 "GET /compute/v2.1/servers/e1523193-327c-4659-8fc4-7329cbffd32f" status: 200 len: 1648 microversion: 2.1 time: 0.423994 Oct 22 21:09:32.391169 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2078/4152] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:09:31 2022] GET /compute/v2.1/servers/e1523193-327c-4659-8fc4-7329cbffd32f => generated 1648 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:09:32.704637 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-02503567-136c-4b2c-b15e-8bf59ae3ee59 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0d0bdfb04240209e4efa92f47cbb94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755501ba3e344f1aaf7ef80924bb57d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:09:32.720553 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-02503567-136c-4b2c-b15e-8bf59ae3ee59 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] 10.222.0.18 "GET /compute/v2.1/servers/ad302c49-addb-464c-a15f-fa01577f90c4" status: 200 len: 1707 microversion: 2.1 time: 0.780054 Oct 22 21:09:32.722513 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2075/4153] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:09:31 2022] GET /compute/v2.1/servers/ad302c49-addb-464c-a15f-fa01577f90c4 => generated 1707 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:09:32.858326 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-4fbade02-bed6-495d-9ced-1b13fe8eee66 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:09:32.858528 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-4fbade02-bed6-495d-9ced-1b13fe8eee66 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] [instance: ff57c0ad-9f38-4c58-a194-b0b0d39b1fe0] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:09:32.866704 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4fbade02-bed6-495d-9ced-1b13fe8eee66 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:09:32.867202 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4fbade02-bed6-495d-9ced-1b13fe8eee66 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:09:32.867673 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4fbade02-bed6-495d-9ced-1b13fe8eee66 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:09:32.868384 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4fbade02-bed6-495d-9ced-1b13fe8eee66 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:09:32.868839 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4fbade02-bed6-495d-9ced-1b13fe8eee66 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:09:32.869269 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4fbade02-bed6-495d-9ced-1b13fe8eee66 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:09:33.168599 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-3bfce05f-e7bb-4b9a-bdf3-c38b4164f49a tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:09:33.169118 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-3bfce05f-e7bb-4b9a-bdf3-c38b4164f49a tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] [instance: cc7f1980-ecea-437f-ac71-0cdb6ec626b9] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:09:33.181381 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3bfce05f-e7bb-4b9a-bdf3-c38b4164f49a tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:09:33.181895 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3bfce05f-e7bb-4b9a-bdf3-c38b4164f49a tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:09:33.182352 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3bfce05f-e7bb-4b9a-bdf3-c38b4164f49a tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:09:33.183100 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3bfce05f-e7bb-4b9a-bdf3-c38b4164f49a tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:09:33.183592 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3bfce05f-e7bb-4b9a-bdf3-c38b4164f49a tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:09:33.184033 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3bfce05f-e7bb-4b9a-bdf3-c38b4164f49a tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:09:33.269871 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-3bfce05f-e7bb-4b9a-bdf3-c38b4164f49a tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] 10.222.0.18 "GET /compute/v2.1/servers/cc7f1980-ecea-437f-ac71-0cdb6ec626b9/ips" status: 200 len: 152 microversion: 2.20 time: 0.104515 Oct 22 21:09:33.270884 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2076/4154] 10.222.0.18 () {60 vars in 1289 bytes} [Sat Oct 22 21:09:33 2022] GET /compute/v2.1/servers/cc7f1980-ecea-437f-ac71-0cdb6ec626b9/ips => generated 152 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 22 21:09:33.416836 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-1b8bbb66-6ef7-43ed-bc46-44dc9a4107ca tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:09:33.417468 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-1b8bbb66-6ef7-43ed-bc46-44dc9a4107ca tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] [instance: e1523193-327c-4659-8fc4-7329cbffd32f] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:09:33.434493 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1b8bbb66-6ef7-43ed-bc46-44dc9a4107ca tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:09:33.435307 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1b8bbb66-6ef7-43ed-bc46-44dc9a4107ca tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:09:33.436063 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1b8bbb66-6ef7-43ed-bc46-44dc9a4107ca tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:09:33.437061 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1b8bbb66-6ef7-43ed-bc46-44dc9a4107ca tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:09:33.437610 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1b8bbb66-6ef7-43ed-bc46-44dc9a4107ca tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:09:33.438055 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1b8bbb66-6ef7-43ed-bc46-44dc9a4107ca tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:09:33.690002 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-1b8bbb66-6ef7-43ed-bc46-44dc9a4107ca tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98584920f7f948d6995412c700128be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf63c122a5e4685a891957e1b58b9e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:09:33.703521 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-1b8bbb66-6ef7-43ed-bc46-44dc9a4107ca tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] 10.222.0.18 "GET /compute/v2.1/servers/e1523193-327c-4659-8fc4-7329cbffd32f" status: 200 len: 1648 microversion: 2.1 time: 0.285712 Oct 22 21:09:33.733275 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2077/4155] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:09:33 2022] GET /compute/v2.1/servers/e1523193-327c-4659-8fc4-7329cbffd32f => generated 1648 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:09:33.746900 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-93d68cea-d120-48e2-9dd7-0a01910f7b7e tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:09:33.747565 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-93d68cea-d120-48e2-9dd7-0a01910f7b7e tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] [instance: ad302c49-addb-464c-a15f-fa01577f90c4] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:09:33.755522 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-93d68cea-d120-48e2-9dd7-0a01910f7b7e tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:09:33.756428 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-93d68cea-d120-48e2-9dd7-0a01910f7b7e tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:09:33.757050 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-93d68cea-d120-48e2-9dd7-0a01910f7b7e tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:09:33.759095 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-93d68cea-d120-48e2-9dd7-0a01910f7b7e tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:09:33.760231 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-93d68cea-d120-48e2-9dd7-0a01910f7b7e tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:09:33.761099 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-93d68cea-d120-48e2-9dd7-0a01910f7b7e tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:09:34.132489 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-4fbade02-bed6-495d-9ced-1b13fe8eee66 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e7a09f769748629425ad36120a7fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddce0c46c75496f96f2e2dae77751dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:09:34.145432 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-4fbade02-bed6-495d-9ced-1b13fe8eee66 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] 10.222.0.18 "GET /compute/v2.1/servers/ff57c0ad-9f38-4c58-a194-b0b0d39b1fe0" status: 200 len: 1502 microversion: 2.1 time: 1.291404 Oct 22 21:09:34.146428 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2079/4156] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:09:32 2022] GET /compute/v2.1/servers/ff57c0ad-9f38-4c58-a194-b0b0d39b1fe0 => generated 1502 bytes in 1293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:09:34.256891 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-93d68cea-d120-48e2-9dd7-0a01910f7b7e tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0d0bdfb04240209e4efa92f47cbb94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755501ba3e344f1aaf7ef80924bb57d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:09:34.279928 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-93d68cea-d120-48e2-9dd7-0a01910f7b7e tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] 10.222.0.18 "GET /compute/v2.1/servers/ad302c49-addb-464c-a15f-fa01577f90c4" status: 200 len: 1707 microversion: 2.1 time: 0.529740 Oct 22 21:09:34.281116 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2078/4157] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:09:33 2022] GET /compute/v2.1/servers/ad302c49-addb-464c-a15f-fa01577f90c4 => generated 1707 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:09:34.286133 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-f89a6263-27e4-43d6-af71-4b12dd4965f7 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:09:34.292255 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-f89a6263-27e4-43d6-af71-4b12dd4965f7 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] [instance: 4b876a5c-1d6e-4960-a3f9-f30cc7dc03fa] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:09:34.329073 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f89a6263-27e4-43d6-af71-4b12dd4965f7 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:09:34.329598 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f89a6263-27e4-43d6-af71-4b12dd4965f7 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:09:34.330124 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f89a6263-27e4-43d6-af71-4b12dd4965f7 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:09:34.335640 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f89a6263-27e4-43d6-af71-4b12dd4965f7 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:09:34.336353 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f89a6263-27e4-43d6-af71-4b12dd4965f7 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:09:34.336889 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f89a6263-27e4-43d6-af71-4b12dd4965f7 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:09:34.744840 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-2c9639bb-c5c0-4361-9451-0aee5017ae15 req-57201697-c367-4472-b180-2edb4fd6fd8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1523193-327c-4659-8fc4-7329cbffd32f", "name": "network-vif-deleted", "tag": "043fc3dc-4aa8-48d0-bf01-30cbd832a23b"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:09:34.769179 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-2c9639bb-c5c0-4361-9451-0aee5017ae15 req-57201697-c367-4472-b180-2edb4fd6fd8d service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:09:34.769637 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-2c9639bb-c5c0-4361-9451-0aee5017ae15 req-57201697-c367-4472-b180-2edb4fd6fd8d service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:09:34.771208 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-2c9639bb-c5c0-4361-9451-0aee5017ae15 req-57201697-c367-4472-b180-2edb4fd6fd8d service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:09:34.796329 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-2c9639bb-c5c0-4361-9451-0aee5017ae15 req-57201697-c367-4472-b180-2edb4fd6fd8d service nova] Creating event network-vif-deleted:043fc3dc-4aa8-48d0-bf01-30cbd832a23b for instance e1523193-327c-4659-8fc4-7329cbffd32f on nch1-master-1 Oct 22 21:09:34.805254 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-2c9639bb-c5c0-4361-9451-0aee5017ae15 req-57201697-c367-4472-b180-2edb4fd6fd8d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.657586 Oct 22 21:09:34.811194 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2080/4158] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:09:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:09:34.817026 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-752058d4-00b8-4a40-b610-6d00b2aa37cb tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:09:34.817899 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-752058d4-00b8-4a40-b610-6d00b2aa37cb tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] [instance: e1523193-327c-4659-8fc4-7329cbffd32f] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:09:34.834541 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-752058d4-00b8-4a40-b610-6d00b2aa37cb tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:09:34.835405 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-752058d4-00b8-4a40-b610-6d00b2aa37cb tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:09:34.835849 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-752058d4-00b8-4a40-b610-6d00b2aa37cb tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:09:34.837029 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-752058d4-00b8-4a40-b610-6d00b2aa37cb tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:09:34.837682 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-752058d4-00b8-4a40-b610-6d00b2aa37cb tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:09:34.849527 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-752058d4-00b8-4a40-b610-6d00b2aa37cb tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:09:34.873969 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-f89a6263-27e4-43d6-af71-4b12dd4965f7 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e7a09f769748629425ad36120a7fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddce0c46c75496f96f2e2dae77751dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:09:34.888594 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-f89a6263-27e4-43d6-af71-4b12dd4965f7 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] 10.222.0.18 "GET /compute/v2.1/servers/4b876a5c-1d6e-4960-a3f9-f30cc7dc03fa" status: 200 len: 1515 microversion: 2.1 time: 0.602905 Oct 22 21:09:34.890040 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2079/4159] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:09:34 2022] GET /compute/v2.1/servers/4b876a5c-1d6e-4960-a3f9-f30cc7dc03fa => generated 1515 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:09:34.915211 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-9a2d974b-b309-4c3c-8e13-21e793f875fb tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:09:34.946548 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-9a2d974b-b309-4c3c-8e13-21e793f875fb tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] [instance: 7a14a711-b18f-4fb1-823e-475398acbf34] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:09:34.957128 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-752058d4-00b8-4a40-b610-6d00b2aa37cb tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:09:34.957985 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-752058d4-00b8-4a40-b610-6d00b2aa37cb tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:09:34.960074 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-752058d4-00b8-4a40-b610-6d00b2aa37cb tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:09:34.961093 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.objects.instance [None req-752058d4-00b8-4a40-b610-6d00b2aa37cb tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] Lazy-loading 'fault' on Instance uuid e1523193-327c-4659-8fc4-7329cbffd32f {{(pid=138744) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 21:09:34.977368 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.wsgi [None req-9a2d974b-b309-4c3c-8e13-21e793f875fb tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] HTTP exception thrown: Instance 7a14a711-b18f-4fb1-823e-475398acbf34 could not be found. Oct 22 21:09:34.985914 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-9a2d974b-b309-4c3c-8e13-21e793f875fb tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Request method failure captured: Oct 22 21:09:34.985914 ncdv-master-1 devstack@n-api.service[138745]: request: POST /compute/v2.1/servers/7a14a711-b18f-4fb1-823e-475398acbf34/action HTTP/1.1 Oct 22 21:09:34.985914 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 21:09:34.985914 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 21:09:34.985914 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 21:09:34.985914 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 14 Oct 22 21:09:34.985914 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 21:09:34.985914 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 21:09:34.985914 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 21:09:34.985914 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 21:09:34.985914 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVFvWfSOLw3btNK4SoFxMjr8wtqLT2k4PIwSqWFeanHIvdQwXt9iIjJT1pUVLfrbgtnh-m8tchSLAY2pHDnqTUexh_EARjCC9pvXEvKIKJHHkmxJW7Q2ZJx8_vGRYvToSXq_GR6KcHjZaBQXLzQj4qX1yg72hOaDAkM7_Yx2kYaYfxok Oct 22 21:09:34.985914 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 21:09:34.985914 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 21:09:34.985914 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 21:09:34.985914 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 21:09:34.985914 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 21:09:34.985914 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 21:09:34.985914 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: dddce0c46c75496f96f2e2dae77751dc Oct 22 21:09:34.985914 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-610226422 Oct 22 21:09:34.985914 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 21:09:34.985914 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 21:09:34.985914 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_dddce0c46c75496f96f2e2dae77751dc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/dddce0c46c75496f96f2e2dae77751dc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/dddce0c46c75496f96f2e2dae77751dc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/dddce0c46c75496f96f2e2dae77751dc"}]}] Oct 22 21:09:34.985914 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-ServerRescueNegativeTestJSON-610226422 Oct 22 21:09:34.985914 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: dddce0c46c75496f96f2e2dae77751dc Oct 22 21:09:34.985914 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-610226422 Oct 22 21:09:34.985914 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-ServerRescueNegativeTestJSON-610226422-project Oct 22 21:09:34.985914 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 21:09:34.985914 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 21:09:34.985914 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: 67e7a09f769748629425ad36120a7fd6 Oct 22 21:09:34.985914 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-ServerRescueNegativeTestJSON-610226422-project Oct 22 21:09:34.985914 ncdv-master-1 devstack@n-api.service[138745]: Oct 22 21:09:34.985914 ncdv-master-1 devstack@n-api.service[138745]: {"rescue": {}} Oct 22 21:09:34.985914 ncdv-master-1 devstack@n-api.service[138745]: method: > Oct 22 21:09:34.985914 ncdv-master-1 devstack@n-api.service[138745]: exception: Instance 7a14a711-b18f-4fb1-823e-475398acbf34 could not be found. Oct 22 21:09:34.985914 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'id': '7a14a711-b18f-4fb1-823e-475398acbf34', 'body': {'rescue': {}}} Oct 22 21:09:34.985914 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:09:34.985914 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:09:34.985914 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 21:09:34.985914 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 21:09:34.985914 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 21:09:34.985914 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 21:09:34.985914 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 22 21:09:34.985914 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 22 21:09:34.985914 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7a14a711-b18f-4fb1-823e-475398acbf34 could not be found. Oct 22 21:09:34.985914 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:09:34.985914 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:09:34.985914 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:09:34.985914 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:09:34.985914 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:09:34.985914 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:09:34.985914 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:09:34.985914 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:09:34.985914 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:09:34.985914 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:09:34.985914 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 21:09:34.985914 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 21:09:34.985914 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 53, in _rescue Oct 22 21:09:34.985914 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 22 21:09:34.985914 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 21:09:34.985914 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:09:34.985914 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7a14a711-b18f-4fb1-823e-475398acbf34 could not be found. Oct 22 21:09:34.985914 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:09:34.985914 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:09:34.985914 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:09:34.985914 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:09:34.991541 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:09:34.991541 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:09:34.991541 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:09:34.991541 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:09:34.991541 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7a14a711-b18f-4fb1-823e-475398acbf34 could not be found. Oct 22 21:09:34.991541 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:09:34.997512 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-9a2d974b-b309-4c3c-8e13-21e793f875fb tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Returning 404 to user: Instance 7a14a711-b18f-4fb1-823e-475398acbf34 could not be found. {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:09:34.998648 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-9a2d974b-b309-4c3c-8e13-21e793f875fb tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] 10.222.0.18 "POST /compute/v2.1/servers/7a14a711-b18f-4fb1-823e-475398acbf34/action" status: 404 len: 111 microversion: 2.1 time: 0.087512 Oct 22 21:09:35.006842 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2080/4160] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 21:09:34 2022] POST /compute/v2.1/servers/7a14a711-b18f-4fb1-823e-475398acbf34/action => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 21:09:35.016189 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-e9a51bcb-ce87-4573-9f1a-df1f243a3512 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:09:35.017752 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-e9a51bcb-ce87-4573-9f1a-df1f243a3512 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] [instance: 4b876a5c-1d6e-4960-a3f9-f30cc7dc03fa] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:09:35.027043 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e9a51bcb-ce87-4573-9f1a-df1f243a3512 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:09:35.027973 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e9a51bcb-ce87-4573-9f1a-df1f243a3512 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:09:35.028824 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e9a51bcb-ce87-4573-9f1a-df1f243a3512 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:09:35.029737 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e9a51bcb-ce87-4573-9f1a-df1f243a3512 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:09:35.030403 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e9a51bcb-ce87-4573-9f1a-df1f243a3512 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:09:35.031035 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e9a51bcb-ce87-4573-9f1a-df1f243a3512 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:09:35.142525 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-752058d4-00b8-4a40-b610-6d00b2aa37cb tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98584920f7f948d6995412c700128be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf63c122a5e4685a891957e1b58b9e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:09:35.153227 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-752058d4-00b8-4a40-b610-6d00b2aa37cb tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] 10.222.0.18 "GET /compute/v2.1/servers/e1523193-327c-4659-8fc4-7329cbffd32f" status: 200 len: 1368 microversion: 2.1 time: 0.340365 Oct 22 21:09:35.164536 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2081/4161] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:09:34 2022] GET /compute/v2.1/servers/e1523193-327c-4659-8fc4-7329cbffd32f => generated 1368 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:09:35.177651 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-e9a51bcb-ce87-4573-9f1a-df1f243a3512 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] 10.222.0.18 "POST /compute/v2.1/servers/4b876a5c-1d6e-4960-a3f9-f30cc7dc03fa/action" status: 202 len: 0 microversion: 2.1 time: 0.169162 Oct 22 21:09:35.181515 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2081/4162] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 21:09:35 2022] POST /compute/v2.1/servers/4b876a5c-1d6e-4960-a3f9-f30cc7dc03fa/action => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 21:09:35.203968 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-12782150-cc5f-4051-8764-8abde82fd64d tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:09:35.209852 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-12782150-cc5f-4051-8764-8abde82fd64d tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] [instance: 4b876a5c-1d6e-4960-a3f9-f30cc7dc03fa] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:09:35.247617 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-12782150-cc5f-4051-8764-8abde82fd64d tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:09:35.248056 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-12782150-cc5f-4051-8764-8abde82fd64d tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:09:35.248513 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-12782150-cc5f-4051-8764-8abde82fd64d tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:09:35.249287 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-12782150-cc5f-4051-8764-8abde82fd64d tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:09:35.249759 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-12782150-cc5f-4051-8764-8abde82fd64d tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:09:35.255777 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-12782150-cc5f-4051-8764-8abde82fd64d tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:09:35.313275 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-dd924c48-749c-4427-9ee0-734e52c73ef3 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:09:35.321522 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-dd924c48-749c-4427-9ee0-734e52c73ef3 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] [instance: ad302c49-addb-464c-a15f-fa01577f90c4] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:09:35.338983 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-dd924c48-749c-4427-9ee0-734e52c73ef3 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:09:35.341813 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-dd924c48-749c-4427-9ee0-734e52c73ef3 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:09:35.342461 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-dd924c48-749c-4427-9ee0-734e52c73ef3 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:09:35.344945 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-dd924c48-749c-4427-9ee0-734e52c73ef3 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:09:35.346034 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-dd924c48-749c-4427-9ee0-734e52c73ef3 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:09:35.348909 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-dd924c48-749c-4427-9ee0-734e52c73ef3 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:09:35.360131 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:09:35.701543 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-12782150-cc5f-4051-8764-8abde82fd64d tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e7a09f769748629425ad36120a7fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddce0c46c75496f96f2e2dae77751dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:09:35.718809 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-12782150-cc5f-4051-8764-8abde82fd64d tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] 10.222.0.18 "GET /compute/v2.1/servers/4b876a5c-1d6e-4960-a3f9-f30cc7dc03fa" status: 200 len: 1520 microversion: 2.1 time: 0.534269 Oct 22 21:09:35.719409 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2082/4163] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:09:35 2022] GET /compute/v2.1/servers/4b876a5c-1d6e-4960-a3f9-f30cc7dc03fa => generated 1520 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:09:35.738171 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-3c262634-4d31-476c-86b8-d30f99c152ff tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:09:35.741962 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-3c262634-4d31-476c-86b8-d30f99c152ff tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] [instance: cc7f1980-ecea-437f-ac71-0cdb6ec626b9] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:09:35.767826 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3c262634-4d31-476c-86b8-d30f99c152ff tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:09:35.768858 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3c262634-4d31-476c-86b8-d30f99c152ff tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:09:35.771444 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3c262634-4d31-476c-86b8-d30f99c152ff tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:09:35.773129 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3c262634-4d31-476c-86b8-d30f99c152ff tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:09:35.773781 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3c262634-4d31-476c-86b8-d30f99c152ff tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:09:35.776823 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3c262634-4d31-476c-86b8-d30f99c152ff tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:09:35.833510 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-dd924c48-749c-4427-9ee0-734e52c73ef3 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0d0bdfb04240209e4efa92f47cbb94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755501ba3e344f1aaf7ef80924bb57d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:09:35.846040 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-dd924c48-749c-4427-9ee0-734e52c73ef3 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] 10.222.0.18 "GET /compute/v2.1/servers/ad302c49-addb-464c-a15f-fa01577f90c4" status: 200 len: 1707 microversion: 2.1 time: 0.542761 Oct 22 21:09:35.846489 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.objects.instance [None req-3c262634-4d31-476c-86b8-d30f99c152ff tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lazy-loading 'flavor' on Instance uuid cc7f1980-ecea-437f-ac71-0cdb6ec626b9 {{(pid=138744) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 21:09:35.848073 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2082/4164] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:09:35 2022] GET /compute/v2.1/servers/ad302c49-addb-464c-a15f-fa01577f90c4 => generated 1707 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:09:36.188380 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-1e696ea1-94c8-4484-913c-0a62e3824ac4 tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:09:36.189089 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-1e696ea1-94c8-4484-913c-0a62e3824ac4 tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] [instance: e1523193-327c-4659-8fc4-7329cbffd32f] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:09:36.199110 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1e696ea1-94c8-4484-913c-0a62e3824ac4 tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:09:36.205440 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1e696ea1-94c8-4484-913c-0a62e3824ac4 tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:09:36.205440 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1e696ea1-94c8-4484-913c-0a62e3824ac4 tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:09:36.205440 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1e696ea1-94c8-4484-913c-0a62e3824ac4 tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:09:36.205440 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1e696ea1-94c8-4484-913c-0a62e3824ac4 tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:09:36.205440 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1e696ea1-94c8-4484-913c-0a62e3824ac4 tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:09:36.237882 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.wsgi [None req-1e696ea1-94c8-4484-913c-0a62e3824ac4 tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] HTTP exception thrown: Instance e1523193-327c-4659-8fc4-7329cbffd32f could not be found. Oct 22 21:09:36.244498 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-1e696ea1-94c8-4484-913c-0a62e3824ac4 tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] Request method failure captured: Oct 22 21:09:36.244498 ncdv-master-1 devstack@n-api.service[138745]: request: GET /compute/v2.1/servers/e1523193-327c-4659-8fc4-7329cbffd32f HTTP/1.1 Oct 22 21:09:36.244498 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 21:09:36.244498 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 21:09:36.244498 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 21:09:36.244498 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 0 Oct 22 21:09:36.244498 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 21:09:36.244498 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 21:09:36.244498 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 21:09:36.244498 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 21:09:36.244498 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVFug71WAaJkfHbqVKDffd9le_M7REHWXb8dUBSkBl7h6D9dpSguXoZgRAJSFr_wEPloqzSeVqO7FrR0Vr77i_7D9MMHGbh9Eh2UMxt-15I55YNs27zflyX5rozvj6Rl1on3EMtEFI4GatnQX6-6_PTljwJY1odDBMvcjxAn5hP-zD8I Oct 22 21:09:36.244498 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 21:09:36.244498 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 21:09:36.244498 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 21:09:36.244498 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 21:09:36.244498 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 21:09:36.244498 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 21:09:36.244498 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: 0cf63c122a5e4685a891957e1b58b9e4 Oct 22 21:09:36.244498 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-ServersTestManualDisk-117069500 Oct 22 21:09:36.244498 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 21:09:36.244498 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 21:09:36.244498 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_0cf63c122a5e4685a891957e1b58b9e4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0cf63c122a5e4685a891957e1b58b9e4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/0cf63c122a5e4685a891957e1b58b9e4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0cf63c122a5e4685a891957e1b58b9e4"}]}] Oct 22 21:09:36.244498 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-ServersTestManualDisk-117069500 Oct 22 21:09:36.244498 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: 0cf63c122a5e4685a891957e1b58b9e4 Oct 22 21:09:36.244498 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-ServersTestManualDisk-117069500 Oct 22 21:09:36.244498 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-ServersTestManualDisk-117069500-project Oct 22 21:09:36.244498 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 21:09:36.244498 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 21:09:36.244498 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: 98584920f7f948d6995412c700128be1 Oct 22 21:09:36.244498 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-ServersTestManualDisk-117069500-project Oct 22 21:09:36.244498 ncdv-master-1 devstack@n-api.service[138745]: method: > Oct 22 21:09:36.244498 ncdv-master-1 devstack@n-api.service[138745]: exception: Instance e1523193-327c-4659-8fc4-7329cbffd32f could not be found. Oct 22 21:09:36.244498 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'id': 'e1523193-327c-4659-8fc4-7329cbffd32f'} Oct 22 21:09:36.244498 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:09:36.244498 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:09:36.244498 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 21:09:36.244498 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 21:09:36.244498 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 21:09:36.244498 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 21:09:36.244498 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 21:09:36.244498 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 21:09:36.244498 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 21:09:36.244498 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 21:09:36.244498 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e1523193-327c-4659-8fc4-7329cbffd32f could not be found. Oct 22 21:09:36.244498 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:09:36.244498 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:09:36.244498 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:09:36.244498 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:09:36.244498 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:09:36.244498 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:09:36.244498 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:09:36.244498 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:09:36.244498 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:09:36.244498 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:09:36.244498 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 21:09:36.244498 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 21:09:36.244498 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 21:09:36.244498 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 21:09:36.244498 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 21:09:36.244498 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:09:36.244498 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e1523193-327c-4659-8fc4-7329cbffd32f could not be found. Oct 22 21:09:36.244498 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:09:36.244498 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:09:36.244498 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:09:36.249442 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:09:36.249442 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:09:36.249442 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:09:36.249442 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:09:36.249442 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:09:36.249442 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e1523193-327c-4659-8fc4-7329cbffd32f could not be found. Oct 22 21:09:36.249442 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:09:36.252820 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-1e696ea1-94c8-4484-913c-0a62e3824ac4 tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] Returning 404 to user: Instance e1523193-327c-4659-8fc4-7329cbffd32f could not be found. {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:09:36.255310 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-1e696ea1-94c8-4484-913c-0a62e3824ac4 tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] 10.222.0.18 "GET /compute/v2.1/servers/e1523193-327c-4659-8fc4-7329cbffd32f" status: 404 len: 111 microversion: 2.1 time: 0.071530 Oct 22 21:09:36.255523 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-3c262634-4d31-476c-86b8-d30f99c152ff tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] 10.222.0.18 "POST /compute/v2.1/servers/cc7f1980-ecea-437f-ac71-0cdb6ec626b9/action" status: 202 len: 0 microversion: 2.20 time: 0.528268 Oct 22 21:09:36.259813 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2083/4165] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:09:36 2022] GET /compute/v2.1/servers/e1523193-327c-4659-8fc4-7329cbffd32f => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 22 21:09:36.260170 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2083/4166] 10.222.0.18 () {62 vars in 1319 bytes} [Sat Oct 22 21:09:35 2022] POST /compute/v2.1/servers/cc7f1980-ecea-437f-ac71-0cdb6ec626b9/action => generated 0 bytes in 534 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 22 21:09:36.270518 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-f07aee1c-cf4b-4ad3-9485-0dab4e7ecb65 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:09:36.271765 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-f07aee1c-cf4b-4ad3-9485-0dab4e7ecb65 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] [instance: cc7f1980-ecea-437f-ac71-0cdb6ec626b9] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:09:36.279265 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f07aee1c-cf4b-4ad3-9485-0dab4e7ecb65 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:09:36.280084 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f07aee1c-cf4b-4ad3-9485-0dab4e7ecb65 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:09:36.280714 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f07aee1c-cf4b-4ad3-9485-0dab4e7ecb65 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:09:36.281405 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-b0f22c47-75d6-4052-b951-3f75ecdb2ca9 tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] Calling method '.version_select at 0x7fd3a8c09af0>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:09:36.281629 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f07aee1c-cf4b-4ad3-9485-0dab4e7ecb65 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:09:36.282552 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f07aee1c-cf4b-4ad3-9485-0dab4e7ecb65 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:09:36.283010 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f07aee1c-cf4b-4ad3-9485-0dab4e7ecb65 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:09:36.325148 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-b0f22c47-75d6-4052-b951-3f75ecdb2ca9 tempest-ServersTestManualDisk-117069500 tempest-ServersTestManualDisk-117069500-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1863563561" status: 202 len: 0 microversion: 2.1 time: 0.051571 Oct 22 21:09:36.325751 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2084/4167] 10.222.0.18 () {58 vars in 1221 bytes} [Sat Oct 22 21:09:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1863563561 => generated 0 bytes in 53 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 21:09:36.456656 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-f07aee1c-cf4b-4ad3-9485-0dab4e7ecb65 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:09:36.476193 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-f07aee1c-cf4b-4ad3-9485-0dab4e7ecb65 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:09:36.478788 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-f07aee1c-cf4b-4ad3-9485-0dab4e7ecb65 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:09:36.482608 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-f07aee1c-cf4b-4ad3-9485-0dab4e7ecb65 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] 10.222.0.18 "GET /compute/v2.1/servers/cc7f1980-ecea-437f-ac71-0cdb6ec626b9" status: 200 len: 1723 microversion: 2.20 time: 0.217741 Oct 22 21:09:36.483511 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2084/4168] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:09:36 2022] GET /compute/v2.1/servers/cc7f1980-ecea-437f-ac71-0cdb6ec626b9 => generated 1723 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:09:36.744297 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-7da2214e-9943-475a-a1a5-7accd39c7610 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:09:36.745050 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-7da2214e-9943-475a-a1a5-7accd39c7610 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] [instance: 4b876a5c-1d6e-4960-a3f9-f30cc7dc03fa] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:09:36.753232 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7da2214e-9943-475a-a1a5-7accd39c7610 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:09:36.753929 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7da2214e-9943-475a-a1a5-7accd39c7610 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:09:36.754618 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7da2214e-9943-475a-a1a5-7accd39c7610 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:09:36.755530 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7da2214e-9943-475a-a1a5-7accd39c7610 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:09:36.756175 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7da2214e-9943-475a-a1a5-7accd39c7610 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:09:36.756951 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7da2214e-9943-475a-a1a5-7accd39c7610 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:09:36.873425 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-c7d18ebb-9476-453a-874e-a7a825f099da tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:09:36.874394 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-c7d18ebb-9476-453a-874e-a7a825f099da tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] [instance: ad302c49-addb-464c-a15f-fa01577f90c4] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:09:36.884736 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c7d18ebb-9476-453a-874e-a7a825f099da tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:09:36.885255 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c7d18ebb-9476-453a-874e-a7a825f099da tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:09:36.885716 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c7d18ebb-9476-453a-874e-a7a825f099da tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:09:36.886520 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c7d18ebb-9476-453a-874e-a7a825f099da tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:09:36.886937 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c7d18ebb-9476-453a-874e-a7a825f099da tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:09:36.887406 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c7d18ebb-9476-453a-874e-a7a825f099da tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:09:37.201589 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-7da2214e-9943-475a-a1a5-7accd39c7610 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e7a09f769748629425ad36120a7fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddce0c46c75496f96f2e2dae77751dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:09:37.211283 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-7da2214e-9943-475a-a1a5-7accd39c7610 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] 10.222.0.18 "GET /compute/v2.1/servers/4b876a5c-1d6e-4960-a3f9-f30cc7dc03fa" status: 200 len: 1500 microversion: 2.1 time: 0.471012 Oct 22 21:09:37.212407 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2085/4169] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:09:36 2022] GET /compute/v2.1/servers/4b876a5c-1d6e-4960-a3f9-f30cc7dc03fa => generated 1500 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:09:37.217400 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-c7d18ebb-9476-453a-874e-a7a825f099da tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0d0bdfb04240209e4efa92f47cbb94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755501ba3e344f1aaf7ef80924bb57d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:09:37.226587 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-c7d18ebb-9476-453a-874e-a7a825f099da tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] 10.222.0.18 "GET /compute/v2.1/servers/ad302c49-addb-464c-a15f-fa01577f90c4" status: 200 len: 1711 microversion: 2.1 time: 0.357011 Oct 22 21:09:37.240160 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2085/4170] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:09:36 2022] GET /compute/v2.1/servers/ad302c49-addb-464c-a15f-fa01577f90c4 => generated 1711 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:09:37.245043 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-5be53172-6a11-4654-9cf6-af33e1ba159a tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:09:37.247729 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-5be53172-6a11-4654-9cf6-af33e1ba159a tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] [instance: 4b876a5c-1d6e-4960-a3f9-f30cc7dc03fa] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:09:37.255831 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5be53172-6a11-4654-9cf6-af33e1ba159a tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:09:37.257028 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5be53172-6a11-4654-9cf6-af33e1ba159a tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:09:37.257642 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5be53172-6a11-4654-9cf6-af33e1ba159a tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:09:37.258551 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5be53172-6a11-4654-9cf6-af33e1ba159a tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:09:37.259183 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5be53172-6a11-4654-9cf6-af33e1ba159a tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:09:37.259684 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5be53172-6a11-4654-9cf6-af33e1ba159a tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:09:37.289102 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.objects.instance [None req-5be53172-6a11-4654-9cf6-af33e1ba159a tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lazy-loading 'flavor' on Instance uuid 4b876a5c-1d6e-4960-a3f9-f30cc7dc03fa {{(pid=138744) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 21:09:37.312589 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-5be53172-6a11-4654-9cf6-af33e1ba159a tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] HTTP exception thrown: Cannot 'rescue' instance 4b876a5c-1d6e-4960-a3f9-f30cc7dc03fa while it is in vm_state paused Oct 22 21:09:37.314820 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-5be53172-6a11-4654-9cf6-af33e1ba159a tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Request method failure captured: Oct 22 21:09:37.314820 ncdv-master-1 devstack@n-api.service[138744]: request: POST /compute/v2.1/servers/4b876a5c-1d6e-4960-a3f9-f30cc7dc03fa/action HTTP/1.1 Oct 22 21:09:37.314820 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 21:09:37.314820 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 21:09:37.314820 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 21:09:37.314820 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 14 Oct 22 21:09:37.314820 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 21:09:37.314820 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 21:09:37.314820 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 21:09:37.314820 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 21:09:37.314820 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVFvWfSOLw3btNK4SoFxMjr8wtqLT2k4PIwSqWFeanHIvdQwXt9iIjJT1pUVLfrbgtnh-m8tchSLAY2pHDnqTUexh_EARjCC9pvXEvKIKJHHkmxJW7Q2ZJx8_vGRYvToSXq_GR6KcHjZaBQXLzQj4qX1yg72hOaDAkM7_Yx2kYaYfxok Oct 22 21:09:37.314820 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 21:09:37.314820 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 21:09:37.314820 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 21:09:37.314820 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 21:09:37.314820 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 21:09:37.314820 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 21:09:37.314820 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: dddce0c46c75496f96f2e2dae77751dc Oct 22 21:09:37.314820 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-610226422 Oct 22 21:09:37.314820 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 21:09:37.314820 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 21:09:37.314820 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_dddce0c46c75496f96f2e2dae77751dc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/dddce0c46c75496f96f2e2dae77751dc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/dddce0c46c75496f96f2e2dae77751dc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/dddce0c46c75496f96f2e2dae77751dc"}]}] Oct 22 21:09:37.314820 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-ServerRescueNegativeTestJSON-610226422 Oct 22 21:09:37.314820 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: dddce0c46c75496f96f2e2dae77751dc Oct 22 21:09:37.314820 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-610226422 Oct 22 21:09:37.314820 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-ServerRescueNegativeTestJSON-610226422-project Oct 22 21:09:37.314820 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 21:09:37.314820 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 21:09:37.314820 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: 67e7a09f769748629425ad36120a7fd6 Oct 22 21:09:37.314820 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-ServerRescueNegativeTestJSON-610226422-project Oct 22 21:09:37.314820 ncdv-master-1 devstack@n-api.service[138744]: Oct 22 21:09:37.314820 ncdv-master-1 devstack@n-api.service[138744]: {"rescue": {}} Oct 22 21:09:37.314820 ncdv-master-1 devstack@n-api.service[138744]: method: > Oct 22 21:09:37.314820 ncdv-master-1 devstack@n-api.service[138744]: exception: Cannot 'rescue' instance 4b876a5c-1d6e-4960-a3f9-f30cc7dc03fa while it is in vm_state paused Oct 22 21:09:37.314820 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': '4b876a5c-1d6e-4960-a3f9-f30cc7dc03fa', 'body': {'rescue': {}}} Oct 22 21:09:37.314820 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:09:37.314820 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:09:37.314820 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 62, in _rescue Oct 22 21:09:37.314820 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi self.compute_api.rescue(context, instance, Oct 22 21:09:37.314820 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 22 21:09:37.314820 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 22 21:09:37.314820 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 22 21:09:37.314820 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 22 21:09:37.314820 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 22 21:09:37.314820 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 22 21:09:37.314820 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 4b876a5c-1d6e-4960-a3f9-f30cc7dc03fa in vm_state paused. Cannot rescue while the instance is in this state. Oct 22 21:09:37.314820 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:09:37.314820 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:09:37.314820 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:09:37.314820 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:09:37.314820 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:09:37.314820 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:09:37.314820 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:09:37.314820 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:09:37.314820 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:09:37.314820 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:09:37.314820 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 21:09:37.314820 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 21:09:37.314820 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 72, in _rescue Oct 22 21:09:37.314820 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Oct 22 21:09:37.314820 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 22 21:09:37.314820 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 22 21:09:37.314820 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rescue' instance 4b876a5c-1d6e-4960-a3f9-f30cc7dc03fa while it is in vm_state paused Oct 22 21:09:37.314820 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:09:37.321001 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:09:37.321001 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:09:37.321001 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:09:37.321001 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:09:37.321001 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:09:37.321001 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:09:37.321001 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:09:37.321001 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rescue' instance 4b876a5c-1d6e-4960-a3f9-f30cc7dc03fa while it is in vm_state paused Oct 22 21:09:37.321001 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:09:37.321001 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-5be53172-6a11-4654-9cf6-af33e1ba159a tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Returning 409 to user: Cannot 'rescue' instance 4b876a5c-1d6e-4960-a3f9-f30cc7dc03fa while it is in vm_state paused {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:09:37.321001 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-5be53172-6a11-4654-9cf6-af33e1ba159a tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] 10.222.0.18 "POST /compute/v2.1/servers/4b876a5c-1d6e-4960-a3f9-f30cc7dc03fa/action" status: 409 len: 144 microversion: 2.1 time: 0.075425 Oct 22 21:09:37.321001 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2086/4171] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 21:09:37 2022] POST /compute/v2.1/servers/4b876a5c-1d6e-4960-a3f9-f30cc7dc03fa/action => generated 144 bytes in 77 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Oct 22 21:09:37.327072 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-a7c76870-448f-41cf-8f02-fee5561d8f49 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:09:37.328401 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-a7c76870-448f-41cf-8f02-fee5561d8f49 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] [instance: 4b876a5c-1d6e-4960-a3f9-f30cc7dc03fa] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:09:37.335008 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a7c76870-448f-41cf-8f02-fee5561d8f49 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:09:37.335670 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a7c76870-448f-41cf-8f02-fee5561d8f49 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:09:37.336354 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a7c76870-448f-41cf-8f02-fee5561d8f49 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:09:37.337373 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a7c76870-448f-41cf-8f02-fee5561d8f49 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:09:37.338162 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a7c76870-448f-41cf-8f02-fee5561d8f49 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:09:37.338779 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a7c76870-448f-41cf-8f02-fee5561d8f49 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:09:37.423862 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-a7c76870-448f-41cf-8f02-fee5561d8f49 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] 10.222.0.18 "POST /compute/v2.1/servers/4b876a5c-1d6e-4960-a3f9-f30cc7dc03fa/action" status: 202 len: 0 microversion: 2.1 time: 0.098746 Oct 22 21:09:37.425229 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2086/4172] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 21:09:37 2022] POST /compute/v2.1/servers/4b876a5c-1d6e-4960-a3f9-f30cc7dc03fa/action => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 21:09:37.441590 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-65399ee0-8b81-4a0b-9896-5d1939de8b4d tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:09:37.445770 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-65399ee0-8b81-4a0b-9896-5d1939de8b4d tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] [instance: 4b876a5c-1d6e-4960-a3f9-f30cc7dc03fa] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:09:37.462724 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-65399ee0-8b81-4a0b-9896-5d1939de8b4d tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:09:37.464377 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-65399ee0-8b81-4a0b-9896-5d1939de8b4d tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:09:37.465114 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-65399ee0-8b81-4a0b-9896-5d1939de8b4d tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:09:37.466577 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-65399ee0-8b81-4a0b-9896-5d1939de8b4d tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:09:37.467107 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-65399ee0-8b81-4a0b-9896-5d1939de8b4d tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:09:37.467593 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-65399ee0-8b81-4a0b-9896-5d1939de8b4d tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:09:37.515719 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-9bfd190f-6a5d-4a5c-8548-2276282faf55 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:09:37.516616 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-9bfd190f-6a5d-4a5c-8548-2276282faf55 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] [instance: cc7f1980-ecea-437f-ac71-0cdb6ec626b9] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:09:37.532127 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9bfd190f-6a5d-4a5c-8548-2276282faf55 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:09:37.532636 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9bfd190f-6a5d-4a5c-8548-2276282faf55 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:09:37.533103 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9bfd190f-6a5d-4a5c-8548-2276282faf55 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:09:37.533836 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9bfd190f-6a5d-4a5c-8548-2276282faf55 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:09:37.534312 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9bfd190f-6a5d-4a5c-8548-2276282faf55 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:09:37.536038 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9bfd190f-6a5d-4a5c-8548-2276282faf55 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:09:37.824562 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-65399ee0-8b81-4a0b-9896-5d1939de8b4d tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e7a09f769748629425ad36120a7fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddce0c46c75496f96f2e2dae77751dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:09:37.836618 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-65399ee0-8b81-4a0b-9896-5d1939de8b4d tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] 10.222.0.18 "GET /compute/v2.1/servers/4b876a5c-1d6e-4960-a3f9-f30cc7dc03fa" status: 200 len: 1507 microversion: 2.1 time: 0.406458 Oct 22 21:09:37.851777 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2087/4173] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:09:37 2022] GET /compute/v2.1/servers/4b876a5c-1d6e-4960-a3f9-f30cc7dc03fa => generated 1507 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:09:37.864568 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-9bfd190f-6a5d-4a5c-8548-2276282faf55 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:09:37.874320 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-9bfd190f-6a5d-4a5c-8548-2276282faf55 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:09:37.875995 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-9bfd190f-6a5d-4a5c-8548-2276282faf55 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:09:37.877525 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-9bfd190f-6a5d-4a5c-8548-2276282faf55 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] 10.222.0.18 "GET /compute/v2.1/servers/cc7f1980-ecea-437f-ac71-0cdb6ec626b9" status: 200 len: 1723 microversion: 2.20 time: 0.369824 Oct 22 21:09:37.878179 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2087/4174] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:09:37 2022] GET /compute/v2.1/servers/cc7f1980-ecea-437f-ac71-0cdb6ec626b9 => generated 1723 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 22 21:09:38.864248 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-29ee229b-d705-48c3-9d8f-d1a6bbe29501 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:09:38.865713 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-29ee229b-d705-48c3-9d8f-d1a6bbe29501 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] [instance: 4b876a5c-1d6e-4960-a3f9-f30cc7dc03fa] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:09:38.869766 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell0:SELECT=2 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:09:38.874371 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-29ee229b-d705-48c3-9d8f-d1a6bbe29501 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:09:38.875197 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-29ee229b-d705-48c3-9d8f-d1a6bbe29501 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:09:38.875963 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-29ee229b-d705-48c3-9d8f-d1a6bbe29501 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:09:38.876868 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-29ee229b-d705-48c3-9d8f-d1a6bbe29501 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:09:38.877571 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-29ee229b-d705-48c3-9d8f-d1a6bbe29501 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:09:38.878233 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-29ee229b-d705-48c3-9d8f-d1a6bbe29501 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:09:38.912017 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-7ac8b32d-57ac-4aa1-91f0-54861e292f2f tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:09:38.912654 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-7ac8b32d-57ac-4aa1-91f0-54861e292f2f tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] [instance: cc7f1980-ecea-437f-ac71-0cdb6ec626b9] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:09:38.920032 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell0:SELECT=2 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:09:38.920750 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell0:SELECT=2 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:09:38.935183 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7ac8b32d-57ac-4aa1-91f0-54861e292f2f tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:09:38.936339 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7ac8b32d-57ac-4aa1-91f0-54861e292f2f tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:09:38.936889 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7ac8b32d-57ac-4aa1-91f0-54861e292f2f tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:09:38.937605 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7ac8b32d-57ac-4aa1-91f0-54861e292f2f tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:09:38.938118 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7ac8b32d-57ac-4aa1-91f0-54861e292f2f tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:09:38.938545 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7ac8b32d-57ac-4aa1-91f0-54861e292f2f tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:09:39.126312 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-29ee229b-d705-48c3-9d8f-d1a6bbe29501 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e7a09f769748629425ad36120a7fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddce0c46c75496f96f2e2dae77751dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:09:39.149449 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-29ee229b-d705-48c3-9d8f-d1a6bbe29501 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] 10.222.0.18 "GET /compute/v2.1/servers/4b876a5c-1d6e-4960-a3f9-f30cc7dc03fa" status: 200 len: 1515 microversion: 2.1 time: 0.289062 Oct 22 21:09:39.150292 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2088/4175] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:09:38 2022] GET /compute/v2.1/servers/4b876a5c-1d6e-4960-a3f9-f30cc7dc03fa => generated 1515 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:09:39.154260 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-7ac8b32d-57ac-4aa1-91f0-54861e292f2f tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:09:39.165955 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-7ac8b32d-57ac-4aa1-91f0-54861e292f2f tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:09:39.167614 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-7ac8b32d-57ac-4aa1-91f0-54861e292f2f tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:09:39.169606 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-7ac8b32d-57ac-4aa1-91f0-54861e292f2f tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] 10.222.0.18 "GET /compute/v2.1/servers/cc7f1980-ecea-437f-ac71-0cdb6ec626b9" status: 200 len: 1723 microversion: 2.20 time: 0.268811 Oct 22 21:09:39.183369 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2088/4176] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:09:38 2022] GET /compute/v2.1/servers/cc7f1980-ecea-437f-ac71-0cdb6ec626b9 => generated 1723 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 22 21:09:40.206152 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-0aa29792-2da6-4d7c-8e17-e36ad962df0a tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:09:40.207761 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-0aa29792-2da6-4d7c-8e17-e36ad962df0a tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] [instance: cc7f1980-ecea-437f-ac71-0cdb6ec626b9] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:09:40.218114 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0aa29792-2da6-4d7c-8e17-e36ad962df0a tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:09:40.219427 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0aa29792-2da6-4d7c-8e17-e36ad962df0a tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:09:40.220073 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0aa29792-2da6-4d7c-8e17-e36ad962df0a tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:09:40.224463 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0aa29792-2da6-4d7c-8e17-e36ad962df0a tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:09:40.228068 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0aa29792-2da6-4d7c-8e17-e36ad962df0a tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:09:40.229231 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0aa29792-2da6-4d7c-8e17-e36ad962df0a tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:09:40.732282 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-0aa29792-2da6-4d7c-8e17-e36ad962df0a tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:09:40.748667 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-0aa29792-2da6-4d7c-8e17-e36ad962df0a tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:09:40.750689 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-0aa29792-2da6-4d7c-8e17-e36ad962df0a tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:09:40.752334 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-0aa29792-2da6-4d7c-8e17-e36ad962df0a tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] 10.222.0.18 "GET /compute/v2.1/servers/cc7f1980-ecea-437f-ac71-0cdb6ec626b9" status: 200 len: 1723 microversion: 2.20 time: 0.559819 Oct 22 21:09:40.753271 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2089/4177] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:09:40 2022] GET /compute/v2.1/servers/cc7f1980-ecea-437f-ac71-0cdb6ec626b9 => generated 1723 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:09:40.845392 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-71c69351-23e4-4b4f-b4d4-0085a5279a26 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:09:40.855594 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-71c69351-23e4-4b4f-b4d4-0085a5279a26 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] [instance: 4b876a5c-1d6e-4960-a3f9-f30cc7dc03fa] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:09:40.869790 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=1 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:09:40.873857 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-71c69351-23e4-4b4f-b4d4-0085a5279a26 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:09:40.876457 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-71c69351-23e4-4b4f-b4d4-0085a5279a26 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:09:40.878401 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-71c69351-23e4-4b4f-b4d4-0085a5279a26 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:09:40.880763 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-71c69351-23e4-4b4f-b4d4-0085a5279a26 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:09:40.881936 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-71c69351-23e4-4b4f-b4d4-0085a5279a26 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:09:40.883670 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-71c69351-23e4-4b4f-b4d4-0085a5279a26 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:09:40.939479 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.objects.instance [None req-71c69351-23e4-4b4f-b4d4-0085a5279a26 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lazy-loading 'flavor' on Instance uuid 4b876a5c-1d6e-4960-a3f9-f30cc7dc03fa {{(pid=138745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 21:09:41.089782 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-71c69351-23e4-4b4f-b4d4-0085a5279a26 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] 10.222.0.18 "POST /compute/v2.1/servers/4b876a5c-1d6e-4960-a3f9-f30cc7dc03fa/action" status: 200 len: 32 microversion: 2.1 time: 0.251000 Oct 22 21:09:41.091476 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2089/4178] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 21:09:40 2022] POST /compute/v2.1/servers/4b876a5c-1d6e-4960-a3f9-f30cc7dc03fa/action => generated 32 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 22 21:09:41.106404 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-5ed0eb4b-4772-47eb-9e3f-4437282d0b0c tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:09:41.107709 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-5ed0eb4b-4772-47eb-9e3f-4437282d0b0c tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] [instance: 4b876a5c-1d6e-4960-a3f9-f30cc7dc03fa] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:09:41.112751 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_api:SELECT=67,nova_api:DELETE=1 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:09:41.163498 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5ed0eb4b-4772-47eb-9e3f-4437282d0b0c tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:09:41.165005 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5ed0eb4b-4772-47eb-9e3f-4437282d0b0c tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:09:41.165571 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5ed0eb4b-4772-47eb-9e3f-4437282d0b0c tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:09:41.167993 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5ed0eb4b-4772-47eb-9e3f-4437282d0b0c tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:09:41.168995 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5ed0eb4b-4772-47eb-9e3f-4437282d0b0c tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:09:41.169542 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5ed0eb4b-4772-47eb-9e3f-4437282d0b0c tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:09:41.536012 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-5ed0eb4b-4772-47eb-9e3f-4437282d0b0c tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e7a09f769748629425ad36120a7fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddce0c46c75496f96f2e2dae77751dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:09:41.549340 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-5ed0eb4b-4772-47eb-9e3f-4437282d0b0c tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] 10.222.0.18 "GET /compute/v2.1/servers/4b876a5c-1d6e-4960-a3f9-f30cc7dc03fa" status: 200 len: 1521 microversion: 2.1 time: 0.449595 Oct 22 21:09:41.550083 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2090/4179] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:09:41 2022] GET /compute/v2.1/servers/4b876a5c-1d6e-4960-a3f9-f30cc7dc03fa => generated 1521 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:09:41.783378 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-68079ae6-02f9-4c0e-9087-92c3a93befce tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:09:41.784123 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-68079ae6-02f9-4c0e-9087-92c3a93befce tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] [instance: cc7f1980-ecea-437f-ac71-0cdb6ec626b9] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:09:41.800531 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-68079ae6-02f9-4c0e-9087-92c3a93befce tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:09:41.801291 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-68079ae6-02f9-4c0e-9087-92c3a93befce tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:09:41.801914 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-68079ae6-02f9-4c0e-9087-92c3a93befce tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:09:41.802955 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-68079ae6-02f9-4c0e-9087-92c3a93befce tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:09:41.803636 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-68079ae6-02f9-4c0e-9087-92c3a93befce tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:09:41.804087 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-68079ae6-02f9-4c0e-9087-92c3a93befce tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:09:42.276345 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-68079ae6-02f9-4c0e-9087-92c3a93befce tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:09:42.296446 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-68079ae6-02f9-4c0e-9087-92c3a93befce tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:09:42.300516 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-68079ae6-02f9-4c0e-9087-92c3a93befce tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:09:42.303435 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-68079ae6-02f9-4c0e-9087-92c3a93befce tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] 10.222.0.18 "GET /compute/v2.1/servers/cc7f1980-ecea-437f-ac71-0cdb6ec626b9" status: 200 len: 1723 microversion: 2.20 time: 0.525773 Oct 22 21:09:42.304446 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2090/4180] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:09:41 2022] GET /compute/v2.1/servers/cc7f1980-ecea-437f-ac71-0cdb6ec626b9 => generated 1723 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:09:42.581438 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-91298858-8a67-4a9d-95c1-a24dd68637a8 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:09:42.586892 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-91298858-8a67-4a9d-95c1-a24dd68637a8 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] [instance: 4b876a5c-1d6e-4960-a3f9-f30cc7dc03fa] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:09:42.614097 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-91298858-8a67-4a9d-95c1-a24dd68637a8 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:09:42.617231 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-91298858-8a67-4a9d-95c1-a24dd68637a8 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:09:42.619807 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-91298858-8a67-4a9d-95c1-a24dd68637a8 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:09:42.622389 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-91298858-8a67-4a9d-95c1-a24dd68637a8 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:09:42.623682 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-91298858-8a67-4a9d-95c1-a24dd68637a8 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:09:42.626217 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-91298858-8a67-4a9d-95c1-a24dd68637a8 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:09:42.698478 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:09:42.973380 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-91298858-8a67-4a9d-95c1-a24dd68637a8 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e7a09f769748629425ad36120a7fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddce0c46c75496f96f2e2dae77751dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:09:42.983535 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-91298858-8a67-4a9d-95c1-a24dd68637a8 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] 10.222.0.18 "GET /compute/v2.1/servers/4b876a5c-1d6e-4960-a3f9-f30cc7dc03fa" status: 200 len: 1521 microversion: 2.1 time: 0.413698 Oct 22 21:09:42.984400 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2091/4181] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:09:42 2022] GET /compute/v2.1/servers/4b876a5c-1d6e-4960-a3f9-f30cc7dc03fa => generated 1521 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:09:43.335511 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-0ebe6258-d897-4f3b-9ce9-54463e0306d9 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:09:43.337662 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-0ebe6258-d897-4f3b-9ce9-54463e0306d9 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] [instance: cc7f1980-ecea-437f-ac71-0cdb6ec626b9] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:09:43.346480 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0ebe6258-d897-4f3b-9ce9-54463e0306d9 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:09:43.347903 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0ebe6258-d897-4f3b-9ce9-54463e0306d9 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:09:43.348561 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0ebe6258-d897-4f3b-9ce9-54463e0306d9 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:09:43.349506 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0ebe6258-d897-4f3b-9ce9-54463e0306d9 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:09:43.350630 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0ebe6258-d897-4f3b-9ce9-54463e0306d9 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:09:43.351169 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0ebe6258-d897-4f3b-9ce9-54463e0306d9 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:09:43.589985 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-0ebe6258-d897-4f3b-9ce9-54463e0306d9 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:09:43.604916 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-0ebe6258-d897-4f3b-9ce9-54463e0306d9 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:09:43.608072 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-0ebe6258-d897-4f3b-9ce9-54463e0306d9 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:09:43.613211 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-0ebe6258-d897-4f3b-9ce9-54463e0306d9 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] 10.222.0.18 "GET /compute/v2.1/servers/cc7f1980-ecea-437f-ac71-0cdb6ec626b9" status: 200 len: 1723 microversion: 2.20 time: 0.280733 Oct 22 21:09:43.615866 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2091/4182] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:09:43 2022] GET /compute/v2.1/servers/cc7f1980-ecea-437f-ac71-0cdb6ec626b9 => generated 1723 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:09:44.007677 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-c05d25a2-06bc-4da9-8055-a970b4ffacf9 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:09:44.008845 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-c05d25a2-06bc-4da9-8055-a970b4ffacf9 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] [instance: 4b876a5c-1d6e-4960-a3f9-f30cc7dc03fa] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:09:44.025910 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c05d25a2-06bc-4da9-8055-a970b4ffacf9 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:09:44.026717 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c05d25a2-06bc-4da9-8055-a970b4ffacf9 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:09:44.027383 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c05d25a2-06bc-4da9-8055-a970b4ffacf9 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:09:44.028331 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c05d25a2-06bc-4da9-8055-a970b4ffacf9 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:09:44.028958 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c05d25a2-06bc-4da9-8055-a970b4ffacf9 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:09:44.029577 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c05d25a2-06bc-4da9-8055-a970b4ffacf9 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:09:44.650676 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-da763f7a-684a-40e5-bbf6-d25dfdf80fbb tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:09:44.651923 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-da763f7a-684a-40e5-bbf6-d25dfdf80fbb tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] [instance: cc7f1980-ecea-437f-ac71-0cdb6ec626b9] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:09:44.678059 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-da763f7a-684a-40e5-bbf6-d25dfdf80fbb tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:09:44.678918 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-da763f7a-684a-40e5-bbf6-d25dfdf80fbb tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:09:44.679849 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-da763f7a-684a-40e5-bbf6-d25dfdf80fbb tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:09:44.681743 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-da763f7a-684a-40e5-bbf6-d25dfdf80fbb tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:09:44.683751 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-da763f7a-684a-40e5-bbf6-d25dfdf80fbb tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:09:44.685158 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-da763f7a-684a-40e5-bbf6-d25dfdf80fbb tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:09:44.794200 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-c05d25a2-06bc-4da9-8055-a970b4ffacf9 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e7a09f769748629425ad36120a7fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddce0c46c75496f96f2e2dae77751dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:09:44.809723 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-c05d25a2-06bc-4da9-8055-a970b4ffacf9 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] 10.222.0.18 "GET /compute/v2.1/servers/4b876a5c-1d6e-4960-a3f9-f30cc7dc03fa" status: 200 len: 1521 microversion: 2.1 time: 0.804326 Oct 22 21:09:44.812730 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2092/4183] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:09:44 2022] GET /compute/v2.1/servers/4b876a5c-1d6e-4960-a3f9-f30cc7dc03fa => generated 1521 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:09:45.012158 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-da763f7a-684a-40e5-bbf6-d25dfdf80fbb tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:09:45.024306 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-da763f7a-684a-40e5-bbf6-d25dfdf80fbb tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:09:45.027242 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-da763f7a-684a-40e5-bbf6-d25dfdf80fbb tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:09:45.029882 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-da763f7a-684a-40e5-bbf6-d25dfdf80fbb tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] 10.222.0.18 "GET /compute/v2.1/servers/cc7f1980-ecea-437f-ac71-0cdb6ec626b9" status: 200 len: 1723 microversion: 2.20 time: 0.389964 Oct 22 21:09:45.034123 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2092/4184] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:09:44 2022] GET /compute/v2.1/servers/cc7f1980-ecea-437f-ac71-0cdb6ec626b9 => generated 1723 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:09:45.836748 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-3f1e3da9-aba7-4dfc-8734-853c01440049 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:09:45.837374 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-3f1e3da9-aba7-4dfc-8734-853c01440049 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] [instance: 4b876a5c-1d6e-4960-a3f9-f30cc7dc03fa] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:09:45.846984 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3f1e3da9-aba7-4dfc-8734-853c01440049 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:09:45.847497 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3f1e3da9-aba7-4dfc-8734-853c01440049 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:09:45.847943 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3f1e3da9-aba7-4dfc-8734-853c01440049 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:09:45.848876 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3f1e3da9-aba7-4dfc-8734-853c01440049 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:09:45.849330 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3f1e3da9-aba7-4dfc-8734-853c01440049 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:09:45.849755 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3f1e3da9-aba7-4dfc-8734-853c01440049 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:09:46.036172 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-3f1e3da9-aba7-4dfc-8734-853c01440049 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e7a09f769748629425ad36120a7fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddce0c46c75496f96f2e2dae77751dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:09:46.045553 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-3f1e3da9-aba7-4dfc-8734-853c01440049 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] 10.222.0.18 "GET /compute/v2.1/servers/4b876a5c-1d6e-4960-a3f9-f30cc7dc03fa" status: 200 len: 1521 microversion: 2.1 time: 0.212723 Oct 22 21:09:46.046479 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2093/4185] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:09:45 2022] GET /compute/v2.1/servers/4b876a5c-1d6e-4960-a3f9-f30cc7dc03fa => generated 1521 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:09:46.058037 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-399727cd-da0f-4140-8c1b-259bac5bcce8 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:09:46.060807 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-399727cd-da0f-4140-8c1b-259bac5bcce8 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] [instance: cc7f1980-ecea-437f-ac71-0cdb6ec626b9] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:09:46.072084 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-399727cd-da0f-4140-8c1b-259bac5bcce8 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:09:46.073447 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-399727cd-da0f-4140-8c1b-259bac5bcce8 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:09:46.074580 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-399727cd-da0f-4140-8c1b-259bac5bcce8 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:09:46.075680 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-399727cd-da0f-4140-8c1b-259bac5bcce8 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:09:46.076654 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-399727cd-da0f-4140-8c1b-259bac5bcce8 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:09:46.077613 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-399727cd-da0f-4140-8c1b-259bac5bcce8 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:09:46.251060 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-399727cd-da0f-4140-8c1b-259bac5bcce8 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:09:46.260714 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-399727cd-da0f-4140-8c1b-259bac5bcce8 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:09:46.262874 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-399727cd-da0f-4140-8c1b-259bac5bcce8 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:09:46.264301 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-399727cd-da0f-4140-8c1b-259bac5bcce8 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] 10.222.0.18 "GET /compute/v2.1/servers/cc7f1980-ecea-437f-ac71-0cdb6ec626b9" status: 200 len: 1723 microversion: 2.20 time: 0.212598 Oct 22 21:09:46.265307 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2093/4186] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:09:46 2022] GET /compute/v2.1/servers/cc7f1980-ecea-437f-ac71-0cdb6ec626b9 => generated 1723 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:09:47.075803 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-e865c94b-1615-4a57-a74e-813e647bd3fc tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:09:47.077918 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-e865c94b-1615-4a57-a74e-813e647bd3fc tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] [instance: 4b876a5c-1d6e-4960-a3f9-f30cc7dc03fa] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:09:47.094071 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e865c94b-1615-4a57-a74e-813e647bd3fc tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:09:47.095507 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e865c94b-1615-4a57-a74e-813e647bd3fc tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:09:47.096389 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e865c94b-1615-4a57-a74e-813e647bd3fc tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:09:47.097669 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e865c94b-1615-4a57-a74e-813e647bd3fc tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:09:47.098449 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e865c94b-1615-4a57-a74e-813e647bd3fc tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:09:47.099164 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e865c94b-1615-4a57-a74e-813e647bd3fc tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:09:47.293101 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-1e7aa130-b1f8-4da7-8c1b-e820e30cdc1b tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:09:47.293653 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-1e7aa130-b1f8-4da7-8c1b-e820e30cdc1b tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] [instance: cc7f1980-ecea-437f-ac71-0cdb6ec626b9] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:09:47.305952 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1e7aa130-b1f8-4da7-8c1b-e820e30cdc1b tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:09:47.306808 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1e7aa130-b1f8-4da7-8c1b-e820e30cdc1b tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:09:47.307281 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1e7aa130-b1f8-4da7-8c1b-e820e30cdc1b tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:09:47.310086 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1e7aa130-b1f8-4da7-8c1b-e820e30cdc1b tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:09:47.314116 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1e7aa130-b1f8-4da7-8c1b-e820e30cdc1b tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:09:47.317862 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1e7aa130-b1f8-4da7-8c1b-e820e30cdc1b tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:09:47.397289 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-e865c94b-1615-4a57-a74e-813e647bd3fc tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e7a09f769748629425ad36120a7fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddce0c46c75496f96f2e2dae77751dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:09:47.417179 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-e865c94b-1615-4a57-a74e-813e647bd3fc tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] 10.222.0.18 "GET /compute/v2.1/servers/4b876a5c-1d6e-4960-a3f9-f30cc7dc03fa" status: 200 len: 1521 microversion: 2.1 time: 0.350544 Oct 22 21:09:47.429873 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2094/4187] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:09:47 2022] GET /compute/v2.1/servers/4b876a5c-1d6e-4960-a3f9-f30cc7dc03fa => generated 1521 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:09:47.627197 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-1e7aa130-b1f8-4da7-8c1b-e820e30cdc1b tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:09:47.642080 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-1e7aa130-b1f8-4da7-8c1b-e820e30cdc1b tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:09:47.643587 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-1e7aa130-b1f8-4da7-8c1b-e820e30cdc1b tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:09:47.645076 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-1e7aa130-b1f8-4da7-8c1b-e820e30cdc1b tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] 10.222.0.18 "GET /compute/v2.1/servers/cc7f1980-ecea-437f-ac71-0cdb6ec626b9" status: 200 len: 1723 microversion: 2.20 time: 0.356542 Oct 22 21:09:47.659368 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2094/4188] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:09:47 2022] GET /compute/v2.1/servers/cc7f1980-ecea-437f-ac71-0cdb6ec626b9 => generated 1723 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:09:48.454674 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-d2430406-7afa-48dd-9d60-f5fcb9fabff0 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:09:48.455433 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-d2430406-7afa-48dd-9d60-f5fcb9fabff0 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] [instance: 4b876a5c-1d6e-4960-a3f9-f30cc7dc03fa] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:09:48.474867 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d2430406-7afa-48dd-9d60-f5fcb9fabff0 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:09:48.476012 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d2430406-7afa-48dd-9d60-f5fcb9fabff0 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:09:48.479444 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d2430406-7afa-48dd-9d60-f5fcb9fabff0 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:09:48.487454 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d2430406-7afa-48dd-9d60-f5fcb9fabff0 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:09:48.489388 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d2430406-7afa-48dd-9d60-f5fcb9fabff0 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:09:48.492323 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d2430406-7afa-48dd-9d60-f5fcb9fabff0 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:09:48.676265 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-e9899538-fbf9-40cb-bbd4-eda6b72eb2c6 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:09:48.677607 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-e9899538-fbf9-40cb-bbd4-eda6b72eb2c6 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] [instance: cc7f1980-ecea-437f-ac71-0cdb6ec626b9] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:09:48.708625 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e9899538-fbf9-40cb-bbd4-eda6b72eb2c6 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:09:48.709489 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e9899538-fbf9-40cb-bbd4-eda6b72eb2c6 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:09:48.710646 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e9899538-fbf9-40cb-bbd4-eda6b72eb2c6 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:09:48.713031 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e9899538-fbf9-40cb-bbd4-eda6b72eb2c6 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:09:48.714158 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e9899538-fbf9-40cb-bbd4-eda6b72eb2c6 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:09:48.716619 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e9899538-fbf9-40cb-bbd4-eda6b72eb2c6 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:09:48.841910 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-d2430406-7afa-48dd-9d60-f5fcb9fabff0 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e7a09f769748629425ad36120a7fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddce0c46c75496f96f2e2dae77751dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:09:48.852617 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-d2430406-7afa-48dd-9d60-f5fcb9fabff0 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] 10.222.0.18 "GET /compute/v2.1/servers/4b876a5c-1d6e-4960-a3f9-f30cc7dc03fa" status: 200 len: 1521 microversion: 2.1 time: 0.411379 Oct 22 21:09:48.855564 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2095/4189] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:09:48 2022] GET /compute/v2.1/servers/4b876a5c-1d6e-4960-a3f9-f30cc7dc03fa => generated 1521 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:09:49.084051 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-e9899538-fbf9-40cb-bbd4-eda6b72eb2c6 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:09:49.096870 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-e9899538-fbf9-40cb-bbd4-eda6b72eb2c6 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:09:49.098647 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-e9899538-fbf9-40cb-bbd4-eda6b72eb2c6 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:09:49.100544 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-e9899538-fbf9-40cb-bbd4-eda6b72eb2c6 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] 10.222.0.18 "GET /compute/v2.1/servers/cc7f1980-ecea-437f-ac71-0cdb6ec626b9" status: 200 len: 1744 microversion: 2.20 time: 0.430067 Oct 22 21:09:49.101628 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2095/4190] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:09:48 2022] GET /compute/v2.1/servers/cc7f1980-ecea-437f-ac71-0cdb6ec626b9 => generated 1744 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 22 21:09:49.884145 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-4592c6ce-4c1e-4b87-943b-e6c2e40e15d6 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:09:49.885620 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-4592c6ce-4c1e-4b87-943b-e6c2e40e15d6 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] [instance: 4b876a5c-1d6e-4960-a3f9-f30cc7dc03fa] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:09:49.897846 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4592c6ce-4c1e-4b87-943b-e6c2e40e15d6 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:09:49.898668 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4592c6ce-4c1e-4b87-943b-e6c2e40e15d6 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:09:49.899616 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4592c6ce-4c1e-4b87-943b-e6c2e40e15d6 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:09:49.901580 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4592c6ce-4c1e-4b87-943b-e6c2e40e15d6 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:09:49.902242 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4592c6ce-4c1e-4b87-943b-e6c2e40e15d6 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:09:49.902897 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4592c6ce-4c1e-4b87-943b-e6c2e40e15d6 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:09:50.131840 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-192d7186-3f57-4eeb-8686-f9159ae09552 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:09:50.133357 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-192d7186-3f57-4eeb-8686-f9159ae09552 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] [instance: cc7f1980-ecea-437f-ac71-0cdb6ec626b9] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:09:50.147240 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-192d7186-3f57-4eeb-8686-f9159ae09552 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:09:50.148455 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-192d7186-3f57-4eeb-8686-f9159ae09552 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:09:50.149696 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-192d7186-3f57-4eeb-8686-f9159ae09552 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:09:50.151176 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-192d7186-3f57-4eeb-8686-f9159ae09552 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:09:50.152372 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-192d7186-3f57-4eeb-8686-f9159ae09552 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:09:50.154317 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-192d7186-3f57-4eeb-8686-f9159ae09552 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:09:50.193408 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:09:50.378885 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-4592c6ce-4c1e-4b87-943b-e6c2e40e15d6 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e7a09f769748629425ad36120a7fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddce0c46c75496f96f2e2dae77751dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:09:50.388328 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-4592c6ce-4c1e-4b87-943b-e6c2e40e15d6 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] 10.222.0.18 "GET /compute/v2.1/servers/4b876a5c-1d6e-4960-a3f9-f30cc7dc03fa" status: 200 len: 1521 microversion: 2.1 time: 0.509060 Oct 22 21:09:50.393230 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2096/4191] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:09:49 2022] GET /compute/v2.1/servers/4b876a5c-1d6e-4960-a3f9-f30cc7dc03fa => generated 1521 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:09:50.455776 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-192d7186-3f57-4eeb-8686-f9159ae09552 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:09:50.466466 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-192d7186-3f57-4eeb-8686-f9159ae09552 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:09:50.468318 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-192d7186-3f57-4eeb-8686-f9159ae09552 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:09:50.470316 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-192d7186-3f57-4eeb-8686-f9159ae09552 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] 10.222.0.18 "GET /compute/v2.1/servers/cc7f1980-ecea-437f-ac71-0cdb6ec626b9" status: 200 len: 1744 microversion: 2.20 time: 0.343633 Oct 22 21:09:50.471513 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2096/4192] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:09:50 2022] GET /compute/v2.1/servers/cc7f1980-ecea-437f-ac71-0cdb6ec626b9 => generated 1744 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:09:51.280762 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-a775e5ac-6eb5-4c3d-a270-246e3b3b85c8 req-89b8f5b8-1add-4668-82a8-a775ae2db336 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc7f1980-ecea-437f-ac71-0cdb6ec626b9", "name": "network-vif-plugged", "status": "completed", "tag": "96502a52-b9c6-4c85-9f2b-97330250e894"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:09:51.300970 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-a775e5ac-6eb5-4c3d-a270-246e3b3b85c8 req-89b8f5b8-1add-4668-82a8-a775ae2db336 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:09:51.302032 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-a775e5ac-6eb5-4c3d-a270-246e3b3b85c8 req-89b8f5b8-1add-4668-82a8-a775ae2db336 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:09:51.303045 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-a775e5ac-6eb5-4c3d-a270-246e3b3b85c8 req-89b8f5b8-1add-4668-82a8-a775ae2db336 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:09:51.339064 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-a775e5ac-6eb5-4c3d-a270-246e3b3b85c8 req-89b8f5b8-1add-4668-82a8-a775ae2db336 service nova] Creating event network-vif-plugged:96502a52-b9c6-4c85-9f2b-97330250e894 for instance cc7f1980-ecea-437f-ac71-0cdb6ec626b9 on nch1-master-1 Oct 22 21:09:51.348175 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-a775e5ac-6eb5-4c3d-a270-246e3b3b85c8 req-89b8f5b8-1add-4668-82a8-a775ae2db336 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.290483 Oct 22 21:09:51.349621 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2097/4193] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:09:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 21:09:51.421653 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-9534708c-0ed0-4b01-8d63-387c35daf959 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:09:51.422927 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-9534708c-0ed0-4b01-8d63-387c35daf959 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] [instance: 4b876a5c-1d6e-4960-a3f9-f30cc7dc03fa] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:09:51.436103 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9534708c-0ed0-4b01-8d63-387c35daf959 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:09:51.436902 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9534708c-0ed0-4b01-8d63-387c35daf959 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:09:51.438359 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9534708c-0ed0-4b01-8d63-387c35daf959 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:09:51.446605 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9534708c-0ed0-4b01-8d63-387c35daf959 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:09:51.447454 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9534708c-0ed0-4b01-8d63-387c35daf959 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:09:51.448071 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9534708c-0ed0-4b01-8d63-387c35daf959 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:09:51.503527 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-1cfb03cc-31b7-4be2-8cf8-6904f6a03bf3 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:09:51.504706 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-1cfb03cc-31b7-4be2-8cf8-6904f6a03bf3 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] [instance: cc7f1980-ecea-437f-ac71-0cdb6ec626b9] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:09:51.515894 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1cfb03cc-31b7-4be2-8cf8-6904f6a03bf3 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:09:51.516712 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1cfb03cc-31b7-4be2-8cf8-6904f6a03bf3 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:09:51.517334 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1cfb03cc-31b7-4be2-8cf8-6904f6a03bf3 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:09:51.520234 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1cfb03cc-31b7-4be2-8cf8-6904f6a03bf3 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:09:51.520976 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1cfb03cc-31b7-4be2-8cf8-6904f6a03bf3 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:09:51.521791 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1cfb03cc-31b7-4be2-8cf8-6904f6a03bf3 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:09:51.983585 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-9534708c-0ed0-4b01-8d63-387c35daf959 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e7a09f769748629425ad36120a7fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddce0c46c75496f96f2e2dae77751dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:09:52.001821 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-9534708c-0ed0-4b01-8d63-387c35daf959 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] 10.222.0.18 "GET /compute/v2.1/servers/4b876a5c-1d6e-4960-a3f9-f30cc7dc03fa" status: 200 len: 1521 microversion: 2.1 time: 0.589348 Oct 22 21:09:52.042339 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2097/4194] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:09:51 2022] GET /compute/v2.1/servers/4b876a5c-1d6e-4960-a3f9-f30cc7dc03fa => generated 1521 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:09:52.044997 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-1cfb03cc-31b7-4be2-8cf8-6904f6a03bf3 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:09:52.057845 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-1cfb03cc-31b7-4be2-8cf8-6904f6a03bf3 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:09:52.059324 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-1cfb03cc-31b7-4be2-8cf8-6904f6a03bf3 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:09:52.060774 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-1cfb03cc-31b7-4be2-8cf8-6904f6a03bf3 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] 10.222.0.18 "GET /compute/v2.1/servers/cc7f1980-ecea-437f-ac71-0cdb6ec626b9" status: 200 len: 1744 microversion: 2.20 time: 0.564811 Oct 22 21:09:52.062010 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2098/4195] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:09:51 2022] GET /compute/v2.1/servers/cc7f1980-ecea-437f-ac71-0cdb6ec626b9 => generated 1744 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:09:53.025516 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-0b0aaa10-3082-4df8-a18d-7d1ad63e475e tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:09:53.026143 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-0b0aaa10-3082-4df8-a18d-7d1ad63e475e tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] [instance: 4b876a5c-1d6e-4960-a3f9-f30cc7dc03fa] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:09:53.035291 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0b0aaa10-3082-4df8-a18d-7d1ad63e475e tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:09:53.039679 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0b0aaa10-3082-4df8-a18d-7d1ad63e475e tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:09:53.040375 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0b0aaa10-3082-4df8-a18d-7d1ad63e475e tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:09:53.041312 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0b0aaa10-3082-4df8-a18d-7d1ad63e475e tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:09:53.043301 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0b0aaa10-3082-4df8-a18d-7d1ad63e475e tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:09:53.045736 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0b0aaa10-3082-4df8-a18d-7d1ad63e475e tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:09:53.097985 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-db3d3beb-84b6-48d8-b8c6-d85c5336f6d7 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:09:53.099403 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-db3d3beb-84b6-48d8-b8c6-d85c5336f6d7 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] [instance: cc7f1980-ecea-437f-ac71-0cdb6ec626b9] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:09:53.113862 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-db3d3beb-84b6-48d8-b8c6-d85c5336f6d7 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:09:53.115184 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-db3d3beb-84b6-48d8-b8c6-d85c5336f6d7 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:09:53.116867 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-db3d3beb-84b6-48d8-b8c6-d85c5336f6d7 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:09:53.118464 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-db3d3beb-84b6-48d8-b8c6-d85c5336f6d7 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:09:53.119275 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-db3d3beb-84b6-48d8-b8c6-d85c5336f6d7 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:09:53.120141 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-db3d3beb-84b6-48d8-b8c6-d85c5336f6d7 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:09:53.551564 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-db3d3beb-84b6-48d8-b8c6-d85c5336f6d7 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:09:53.563965 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-db3d3beb-84b6-48d8-b8c6-d85c5336f6d7 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:09:53.566016 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-db3d3beb-84b6-48d8-b8c6-d85c5336f6d7 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:09:53.567843 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-db3d3beb-84b6-48d8-b8c6-d85c5336f6d7 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] 10.222.0.18 "GET /compute/v2.1/servers/cc7f1980-ecea-437f-ac71-0cdb6ec626b9" status: 200 len: 1739 microversion: 2.20 time: 0.483033 Oct 22 21:09:53.568677 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2099/4196] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:09:53 2022] GET /compute/v2.1/servers/cc7f1980-ecea-437f-ac71-0cdb6ec626b9 => generated 1739 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:09:53.572491 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-0b0aaa10-3082-4df8-a18d-7d1ad63e475e tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e7a09f769748629425ad36120a7fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddce0c46c75496f96f2e2dae77751dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:09:53.582098 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-0b0aaa10-3082-4df8-a18d-7d1ad63e475e tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] 10.222.0.18 "GET /compute/v2.1/servers/4b876a5c-1d6e-4960-a3f9-f30cc7dc03fa" status: 200 len: 1521 microversion: 2.1 time: 0.560395 Oct 22 21:09:53.582880 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2098/4197] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:09:53 2022] GET /compute/v2.1/servers/4b876a5c-1d6e-4960-a3f9-f30cc7dc03fa => generated 1521 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:09:54.595161 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-61f060de-53fe-4ec3-ac24-b6c11c67c262 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:09:54.595956 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-61f060de-53fe-4ec3-ac24-b6c11c67c262 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] [instance: cc7f1980-ecea-437f-ac71-0cdb6ec626b9] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:09:54.609754 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-b6fcfcb0-cf17-43e1-9546-9bef012030ca tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:09:54.610528 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-b6fcfcb0-cf17-43e1-9546-9bef012030ca tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] [instance: 4b876a5c-1d6e-4960-a3f9-f30cc7dc03fa] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:09:54.627205 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-61f060de-53fe-4ec3-ac24-b6c11c67c262 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:09:54.638781 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-61f060de-53fe-4ec3-ac24-b6c11c67c262 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:09:54.641178 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b6fcfcb0-cf17-43e1-9546-9bef012030ca tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:09:54.641717 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b6fcfcb0-cf17-43e1-9546-9bef012030ca tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:09:54.644267 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-61f060de-53fe-4ec3-ac24-b6c11c67c262 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:09:54.650684 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-61f060de-53fe-4ec3-ac24-b6c11c67c262 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:09:54.651428 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-61f060de-53fe-4ec3-ac24-b6c11c67c262 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:09:54.651812 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b6fcfcb0-cf17-43e1-9546-9bef012030ca tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:09:54.655722 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-61f060de-53fe-4ec3-ac24-b6c11c67c262 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:09:54.662191 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b6fcfcb0-cf17-43e1-9546-9bef012030ca tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:09:54.664884 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b6fcfcb0-cf17-43e1-9546-9bef012030ca tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:09:54.668269 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b6fcfcb0-cf17-43e1-9546-9bef012030ca tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:09:55.766818 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-61f060de-53fe-4ec3-ac24-b6c11c67c262 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:09:55.803195 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-61f060de-53fe-4ec3-ac24-b6c11c67c262 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:09:55.806070 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-61f060de-53fe-4ec3-ac24-b6c11c67c262 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:09:55.810370 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-61f060de-53fe-4ec3-ac24-b6c11c67c262 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] 10.222.0.18 "GET /compute/v2.1/servers/cc7f1980-ecea-437f-ac71-0cdb6ec626b9" status: 200 len: 1739 microversion: 2.20 time: 1.220102 Oct 22 21:09:55.813720 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2100/4198] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:09:54 2022] GET /compute/v2.1/servers/cc7f1980-ecea-437f-ac71-0cdb6ec626b9 => generated 1739 bytes in 1224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:09:55.969360 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-b6fcfcb0-cf17-43e1-9546-9bef012030ca tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e7a09f769748629425ad36120a7fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddce0c46c75496f96f2e2dae77751dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:09:55.987824 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-b6fcfcb0-cf17-43e1-9546-9bef012030ca tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] 10.222.0.18 "GET /compute/v2.1/servers/4b876a5c-1d6e-4960-a3f9-f30cc7dc03fa" status: 200 len: 1521 microversion: 2.1 time: 1.380301 Oct 22 21:09:56.003368 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2099/4199] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:09:54 2022] GET /compute/v2.1/servers/4b876a5c-1d6e-4960-a3f9-f30cc7dc03fa => generated 1521 bytes in 1387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:09:56.841418 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-cb53bad4-8fd9-4555-8fc7-e957bbd2cf38 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:09:56.842989 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-cb53bad4-8fd9-4555-8fc7-e957bbd2cf38 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] [instance: cc7f1980-ecea-437f-ac71-0cdb6ec626b9] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:09:56.859615 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cb53bad4-8fd9-4555-8fc7-e957bbd2cf38 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:09:56.867686 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cb53bad4-8fd9-4555-8fc7-e957bbd2cf38 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:09:56.871414 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cb53bad4-8fd9-4555-8fc7-e957bbd2cf38 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:09:56.872671 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cb53bad4-8fd9-4555-8fc7-e957bbd2cf38 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:09:56.876227 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cb53bad4-8fd9-4555-8fc7-e957bbd2cf38 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:09:56.879158 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cb53bad4-8fd9-4555-8fc7-e957bbd2cf38 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:09:57.017772 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-4bab9228-4357-4e55-b54b-ed2975f2498c tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:09:57.019167 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-4bab9228-4357-4e55-b54b-ed2975f2498c tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] [instance: 4b876a5c-1d6e-4960-a3f9-f30cc7dc03fa] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:09:57.033625 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4bab9228-4357-4e55-b54b-ed2975f2498c tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:09:57.036456 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4bab9228-4357-4e55-b54b-ed2975f2498c tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:09:57.038003 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4bab9228-4357-4e55-b54b-ed2975f2498c tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:09:57.041240 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4bab9228-4357-4e55-b54b-ed2975f2498c tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:09:57.043568 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4bab9228-4357-4e55-b54b-ed2975f2498c tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:09:57.045103 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4bab9228-4357-4e55-b54b-ed2975f2498c tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:09:57.364283 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-cb53bad4-8fd9-4555-8fc7-e957bbd2cf38 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:09:57.377284 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-cb53bad4-8fd9-4555-8fc7-e957bbd2cf38 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:09:57.378768 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-cb53bad4-8fd9-4555-8fc7-e957bbd2cf38 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:09:57.399364 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-cb53bad4-8fd9-4555-8fc7-e957bbd2cf38 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] 10.222.0.18 "GET /compute/v2.1/servers/cc7f1980-ecea-437f-ac71-0cdb6ec626b9" status: 200 len: 1739 microversion: 2.20 time: 0.561958 Oct 22 21:09:57.400579 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2101/4200] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:09:56 2022] GET /compute/v2.1/servers/cc7f1980-ecea-437f-ac71-0cdb6ec626b9 => generated 1739 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:09:57.710905 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-4bab9228-4357-4e55-b54b-ed2975f2498c tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e7a09f769748629425ad36120a7fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddce0c46c75496f96f2e2dae77751dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:09:57.731128 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-4bab9228-4357-4e55-b54b-ed2975f2498c tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] 10.222.0.18 "GET /compute/v2.1/servers/4b876a5c-1d6e-4960-a3f9-f30cc7dc03fa" status: 200 len: 1501 microversion: 2.1 time: 0.716438 Oct 22 21:09:57.734760 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2100/4201] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:09:57 2022] GET /compute/v2.1/servers/4b876a5c-1d6e-4960-a3f9-f30cc7dc03fa => generated 1501 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:09:57.761048 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-568fba1f-c914-49d7-ab12-9ad62549a137 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "49bf8882-4d00-468f-a20f-effc54a1c736"}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:09:57.764576 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-568fba1f-c914-49d7-ab12-9ad62549a137 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] [instance: 4b876a5c-1d6e-4960-a3f9-f30cc7dc03fa] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:09:57.776775 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-568fba1f-c914-49d7-ab12-9ad62549a137 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:09:57.777754 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-568fba1f-c914-49d7-ab12-9ad62549a137 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:09:57.778369 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-568fba1f-c914-49d7-ab12-9ad62549a137 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:09:57.779273 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-568fba1f-c914-49d7-ab12-9ad62549a137 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:09:57.779936 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-568fba1f-c914-49d7-ab12-9ad62549a137 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:09:57.780528 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-568fba1f-c914-49d7-ab12-9ad62549a137 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:09:57.822596 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-568fba1f-c914-49d7-ab12-9ad62549a137 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] HTTP exception thrown: Cannot 'attach_volume' instance 4b876a5c-1d6e-4960-a3f9-f30cc7dc03fa while it is in vm_state rescued Oct 22 21:09:57.829530 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-568fba1f-c914-49d7-ab12-9ad62549a137 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Request method failure captured: Oct 22 21:09:57.829530 ncdv-master-1 devstack@n-api.service[138744]: request: POST /compute/v2.1/servers/4b876a5c-1d6e-4960-a3f9-f30cc7dc03fa/os-volume_attachments HTTP/1.1 Oct 22 21:09:57.829530 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 21:09:57.829530 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 21:09:57.829530 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 21:09:57.829530 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 74 Oct 22 21:09:57.829530 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 21:09:57.829530 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 21:09:57.829530 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 21:09:57.829530 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 21:09:57.829530 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVFvWfSOLw3btNK4SoFxMjr8wtqLT2k4PIwSqWFeanHIvdQwXt9iIjJT1pUVLfrbgtnh-m8tchSLAY2pHDnqTUexh_EARjCC9pvXEvKIKJHHkmxJW7Q2ZJx8_vGRYvToSXq_GR6KcHjZaBQXLzQj4qX1yg72hOaDAkM7_Yx2kYaYfxok Oct 22 21:09:57.829530 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 21:09:57.829530 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 21:09:57.829530 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 21:09:57.829530 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 21:09:57.829530 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 21:09:57.829530 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 21:09:57.829530 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: dddce0c46c75496f96f2e2dae77751dc Oct 22 21:09:57.829530 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-610226422 Oct 22 21:09:57.829530 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 21:09:57.829530 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 21:09:57.829530 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_dddce0c46c75496f96f2e2dae77751dc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/dddce0c46c75496f96f2e2dae77751dc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/dddce0c46c75496f96f2e2dae77751dc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/dddce0c46c75496f96f2e2dae77751dc"}]}] Oct 22 21:09:57.829530 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-ServerRescueNegativeTestJSON-610226422 Oct 22 21:09:57.829530 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: dddce0c46c75496f96f2e2dae77751dc Oct 22 21:09:57.829530 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-610226422 Oct 22 21:09:57.829530 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-ServerRescueNegativeTestJSON-610226422-project Oct 22 21:09:57.829530 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 21:09:57.829530 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 21:09:57.829530 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: 67e7a09f769748629425ad36120a7fd6 Oct 22 21:09:57.829530 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-ServerRescueNegativeTestJSON-610226422-project Oct 22 21:09:57.829530 ncdv-master-1 devstack@n-api.service[138744]: Oct 22 21:09:57.829530 ncdv-master-1 devstack@n-api.service[138744]: {"volumeAttachment": {"volumeId": "49bf8882-4d00-468f-a20f-effc54a1c736"}} Oct 22 21:09:57.829530 ncdv-master-1 devstack@n-api.service[138744]: method: > Oct 22 21:09:57.829530 ncdv-master-1 devstack@n-api.service[138744]: exception: Cannot 'attach_volume' instance 4b876a5c-1d6e-4960-a3f9-f30cc7dc03fa while it is in vm_state rescued Oct 22 21:09:57.829530 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'server_id': '4b876a5c-1d6e-4960-a3f9-f30cc7dc03fa', 'body': {'volumeAttachment': {'volumeId': '49bf8882-4d00-468f-a20f-effc54a1c736'}}} Oct 22 21:09:57.829530 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:09:57.829530 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:09:57.829530 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 22 21:09:57.829530 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 22 21:09:57.829530 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 22 21:09:57.829530 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 22 21:09:57.829530 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 22 21:09:57.829530 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 22 21:09:57.829530 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 4b876a5c-1d6e-4960-a3f9-f30cc7dc03fa in vm_state rescued. Cannot attach_volume while the instance is in this state. Oct 22 21:09:57.829530 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:09:57.829530 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:09:57.829530 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:09:57.829530 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:09:57.829530 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:09:57.829530 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:09:57.829530 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:09:57.829530 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:09:57.829530 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:09:57.829530 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:09:57.829530 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 21:09:57.829530 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 21:09:57.829530 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 21:09:57.829530 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 21:09:57.829530 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 21:09:57.829530 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 21:09:57.829530 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Oct 22 21:09:57.829530 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 22 21:09:57.835024 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 22 21:09:57.835024 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 22 21:09:57.835024 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 4b876a5c-1d6e-4960-a3f9-f30cc7dc03fa while it is in vm_state rescued Oct 22 21:09:57.835024 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:09:57.835024 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:09:57.835024 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:09:57.835024 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:09:57.835024 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:09:57.835024 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:09:57.835024 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:09:57.835024 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:09:57.835024 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 4b876a5c-1d6e-4960-a3f9-f30cc7dc03fa while it is in vm_state rescued Oct 22 21:09:57.835024 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:09:57.839960 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-568fba1f-c914-49d7-ab12-9ad62549a137 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Returning 409 to user: Cannot 'attach_volume' instance 4b876a5c-1d6e-4960-a3f9-f30cc7dc03fa while it is in vm_state rescued {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:09:57.841072 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-568fba1f-c914-49d7-ab12-9ad62549a137 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] 10.222.0.18 "POST /compute/v2.1/servers/4b876a5c-1d6e-4960-a3f9-f30cc7dc03fa/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.084270 Oct 22 21:09:57.848102 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2102/4202] 10.222.0.18 () {60 vars in 1323 bytes} [Sat Oct 22 21:09:57 2022] POST /compute/v2.1/servers/4b876a5c-1d6e-4960-a3f9-f30cc7dc03fa/os-volume_attachments => generated 152 bytes in 92 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 22 21:09:57.854250 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-a4a5eee4-bf93-4cde-858c-7d275eb35905 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:09:57.854735 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-a4a5eee4-bf93-4cde-858c-7d275eb35905 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] [instance: 4b876a5c-1d6e-4960-a3f9-f30cc7dc03fa] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:09:57.885792 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a4a5eee4-bf93-4cde-858c-7d275eb35905 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:09:57.892663 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a4a5eee4-bf93-4cde-858c-7d275eb35905 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:09:57.897090 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a4a5eee4-bf93-4cde-858c-7d275eb35905 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:09:57.899553 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a4a5eee4-bf93-4cde-858c-7d275eb35905 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:09:57.904197 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a4a5eee4-bf93-4cde-858c-7d275eb35905 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:09:57.904749 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a4a5eee4-bf93-4cde-858c-7d275eb35905 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:09:58.113873 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-a4a5eee4-bf93-4cde-858c-7d275eb35905 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] 10.222.0.18 "POST /compute/v2.1/servers/4b876a5c-1d6e-4960-a3f9-f30cc7dc03fa/action" status: 202 len: 0 microversion: 2.1 time: 0.264512 Oct 22 21:09:58.116740 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2101/4203] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 21:09:57 2022] POST /compute/v2.1/servers/4b876a5c-1d6e-4960-a3f9-f30cc7dc03fa/action => generated 0 bytes in 268 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 22 21:09:58.126651 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-f7b51120-0f76-4f22-8e63-84e6ffb527c8 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:09:58.127529 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-f7b51120-0f76-4f22-8e63-84e6ffb527c8 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] [instance: 4b876a5c-1d6e-4960-a3f9-f30cc7dc03fa] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:09:58.147006 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f7b51120-0f76-4f22-8e63-84e6ffb527c8 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:09:58.150516 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f7b51120-0f76-4f22-8e63-84e6ffb527c8 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:09:58.151209 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f7b51120-0f76-4f22-8e63-84e6ffb527c8 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:09:58.153268 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f7b51120-0f76-4f22-8e63-84e6ffb527c8 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:09:58.159700 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f7b51120-0f76-4f22-8e63-84e6ffb527c8 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:09:58.160250 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f7b51120-0f76-4f22-8e63-84e6ffb527c8 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:09:58.430322 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-1dc8a125-0876-41a7-9d2a-d9b062f812aa tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:09:58.431071 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-1dc8a125-0876-41a7-9d2a-d9b062f812aa tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] [instance: cc7f1980-ecea-437f-ac71-0cdb6ec626b9] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:09:58.446324 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1dc8a125-0876-41a7-9d2a-d9b062f812aa tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:09:58.446849 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1dc8a125-0876-41a7-9d2a-d9b062f812aa tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:09:58.447310 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1dc8a125-0876-41a7-9d2a-d9b062f812aa tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:09:58.462672 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1dc8a125-0876-41a7-9d2a-d9b062f812aa tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:09:58.463197 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1dc8a125-0876-41a7-9d2a-d9b062f812aa tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:09:58.463704 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1dc8a125-0876-41a7-9d2a-d9b062f812aa tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:09:59.382192 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-f7b51120-0f76-4f22-8e63-84e6ffb527c8 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e7a09f769748629425ad36120a7fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddce0c46c75496f96f2e2dae77751dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:09:59.400902 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-f7b51120-0f76-4f22-8e63-84e6ffb527c8 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] 10.222.0.18 "GET /compute/v2.1/servers/4b876a5c-1d6e-4960-a3f9-f30cc7dc03fa" status: 200 len: 1509 microversion: 2.1 time: 1.276288 Oct 22 21:09:59.417616 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2103/4204] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:09:58 2022] GET /compute/v2.1/servers/4b876a5c-1d6e-4960-a3f9-f30cc7dc03fa => generated 1509 bytes in 1297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:09:59.439192 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-04c8db0c-3646-42c7-98fd-241814bbb216 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:09:59.449774 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-04c8db0c-3646-42c7-98fd-241814bbb216 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] [instance: df925c6f-4463-44d7-b951-29dbb9c34ac0] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:09:59.479767 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-04c8db0c-3646-42c7-98fd-241814bbb216 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:09:59.483424 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-04c8db0c-3646-42c7-98fd-241814bbb216 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:09:59.490665 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-04c8db0c-3646-42c7-98fd-241814bbb216 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:09:59.491938 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-04c8db0c-3646-42c7-98fd-241814bbb216 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:09:59.496339 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-04c8db0c-3646-42c7-98fd-241814bbb216 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:09:59.499175 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-04c8db0c-3646-42c7-98fd-241814bbb216 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:09:59.772597 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.objects.instance [None req-04c8db0c-3646-42c7-98fd-241814bbb216 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Lazy-loading 'services' on Instance uuid df925c6f-4463-44d7-b951-29dbb9c34ac0 {{(pid=138744) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 21:09:59.897581 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-1dc8a125-0876-41a7-9d2a-d9b062f812aa tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:09:59.945218 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-1dc8a125-0876-41a7-9d2a-d9b062f812aa tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:09:59.963965 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-1dc8a125-0876-41a7-9d2a-d9b062f812aa tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:09:59.971109 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-1dc8a125-0876-41a7-9d2a-d9b062f812aa tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] 10.222.0.18 "GET /compute/v2.1/servers/cc7f1980-ecea-437f-ac71-0cdb6ec626b9" status: 200 len: 1739 microversion: 2.20 time: 1.545757 Oct 22 21:09:59.972400 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-04c8db0c-3646-42c7-98fd-241814bbb216 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] 10.222.0.18 "DELETE /compute/v2.1/servers/df925c6f-4463-44d7-b951-29dbb9c34ac0/os-volume_attachments/b9959707-0ed2-44c8-9e98-fa250b2609b9" status: 202 len: 0 microversion: 2.1 time: 0.548261 Oct 22 21:09:59.976258 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2102/4205] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:09:58 2022] GET /compute/v2.1/servers/cc7f1980-ecea-437f-ac71-0cdb6ec626b9 => generated 1739 bytes in 1552 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:09:59.979168 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2104/4206] 10.222.0.18 () {58 vars in 1416 bytes} [Sat Oct 22 21:09:59 2022] DELETE /compute/v2.1/servers/df925c6f-4463-44d7-b951-29dbb9c34ac0/os-volume_attachments/b9959707-0ed2-44c8-9e98-fa250b2609b9 => generated 0 bytes in 561 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 21:10:00.430697 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-676b8323-d26e-492c-be6c-0509610b7e2a tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:10:00.432570 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-676b8323-d26e-492c-be6c-0509610b7e2a tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] [instance: 4b876a5c-1d6e-4960-a3f9-f30cc7dc03fa] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:10:00.456076 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-676b8323-d26e-492c-be6c-0509610b7e2a tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:10:00.456586 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-676b8323-d26e-492c-be6c-0509610b7e2a tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:10:00.461847 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-676b8323-d26e-492c-be6c-0509610b7e2a tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:10:00.465475 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-676b8323-d26e-492c-be6c-0509610b7e2a tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:10:00.467942 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-676b8323-d26e-492c-be6c-0509610b7e2a tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:10:00.473073 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-676b8323-d26e-492c-be6c-0509610b7e2a tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:10:01.028837 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-35c4173a-dba5-4da1-b8ac-b4b2e168414a tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:10:01.030576 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-35c4173a-dba5-4da1-b8ac-b4b2e168414a tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] [instance: cc7f1980-ecea-437f-ac71-0cdb6ec626b9] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:10:01.039719 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-35c4173a-dba5-4da1-b8ac-b4b2e168414a tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:10:01.040469 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-35c4173a-dba5-4da1-b8ac-b4b2e168414a tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:10:01.041171 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-35c4173a-dba5-4da1-b8ac-b4b2e168414a tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:10:01.042191 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-35c4173a-dba5-4da1-b8ac-b4b2e168414a tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:10:01.042984 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-35c4173a-dba5-4da1-b8ac-b4b2e168414a tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:10:01.044034 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-35c4173a-dba5-4da1-b8ac-b4b2e168414a tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:10:01.938460 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-676b8323-d26e-492c-be6c-0509610b7e2a tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e7a09f769748629425ad36120a7fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddce0c46c75496f96f2e2dae77751dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:10:01.959123 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-676b8323-d26e-492c-be6c-0509610b7e2a tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] 10.222.0.18 "GET /compute/v2.1/servers/4b876a5c-1d6e-4960-a3f9-f30cc7dc03fa" status: 200 len: 1509 microversion: 2.1 time: 1.533582 Oct 22 21:10:01.969473 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2103/4207] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:10:00 2022] GET /compute/v2.1/servers/4b876a5c-1d6e-4960-a3f9-f30cc7dc03fa => generated 1509 bytes in 1545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:10:02.137473 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-35c4173a-dba5-4da1-b8ac-b4b2e168414a tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:10:02.151523 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-35c4173a-dba5-4da1-b8ac-b4b2e168414a tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:10:02.155967 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-35c4173a-dba5-4da1-b8ac-b4b2e168414a tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:10:02.157246 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-35c4173a-dba5-4da1-b8ac-b4b2e168414a tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] 10.222.0.18 "GET /compute/v2.1/servers/cc7f1980-ecea-437f-ac71-0cdb6ec626b9" status: 200 len: 1739 microversion: 2.20 time: 1.152817 Oct 22 21:10:02.165477 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2105/4208] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:10:01 2022] GET /compute/v2.1/servers/cc7f1980-ecea-437f-ac71-0cdb6ec626b9 => generated 1739 bytes in 1162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:10:02.423951 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-9c2e06fc-deb6-4fe0-b516-6c7746e9df53 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:10:02.424546 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-9c2e06fc-deb6-4fe0-b516-6c7746e9df53 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] [instance: df925c6f-4463-44d7-b951-29dbb9c34ac0] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:10:02.433140 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9c2e06fc-deb6-4fe0-b516-6c7746e9df53 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:10:02.433653 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9c2e06fc-deb6-4fe0-b516-6c7746e9df53 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:10:02.434109 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9c2e06fc-deb6-4fe0-b516-6c7746e9df53 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:10:02.434860 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9c2e06fc-deb6-4fe0-b516-6c7746e9df53 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:10:02.435328 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9c2e06fc-deb6-4fe0-b516-6c7746e9df53 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:10:02.435792 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9c2e06fc-deb6-4fe0-b516-6c7746e9df53 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:10:02.505444 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-9c2e06fc-deb6-4fe0-b516-6c7746e9df53 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] [instance: df925c6f-4463-44d7-b951-29dbb9c34ac0] Going to try to terminate instance {{(pid=138745) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 21:10:02.704164 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-9c2e06fc-deb6-4fe0-b516-6c7746e9df53 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] 10.222.0.18 "DELETE /compute/v2.1/servers/df925c6f-4463-44d7-b951-29dbb9c34ac0" status: 204 len: 0 microversion: 2.1 time: 0.283989 Oct 22 21:10:02.705839 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2104/4209] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 21:10:02 2022] DELETE /compute/v2.1/servers/df925c6f-4463-44d7-b951-29dbb9c34ac0 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 21:10:02.714716 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-58aa9822-27c4-45cf-acdb-8f31fa3262b2 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:10:02.715741 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-58aa9822-27c4-45cf-acdb-8f31fa3262b2 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] [instance: df925c6f-4463-44d7-b951-29dbb9c34ac0] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:10:02.725589 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-58aa9822-27c4-45cf-acdb-8f31fa3262b2 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:10:02.726401 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-58aa9822-27c4-45cf-acdb-8f31fa3262b2 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:10:02.727321 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-58aa9822-27c4-45cf-acdb-8f31fa3262b2 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:10:02.729126 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-58aa9822-27c4-45cf-acdb-8f31fa3262b2 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:10:02.729794 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-58aa9822-27c4-45cf-acdb-8f31fa3262b2 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:10:02.730381 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-58aa9822-27c4-45cf-acdb-8f31fa3262b2 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:10:03.000527 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-b077f225-f36d-4142-824d-5f2296955f7e tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:10:03.001706 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-b077f225-f36d-4142-824d-5f2296955f7e tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] [instance: 4b876a5c-1d6e-4960-a3f9-f30cc7dc03fa] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:10:03.018746 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b077f225-f36d-4142-824d-5f2296955f7e tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:10:03.019323 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b077f225-f36d-4142-824d-5f2296955f7e tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:10:03.021153 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b077f225-f36d-4142-824d-5f2296955f7e tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:10:03.022830 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b077f225-f36d-4142-824d-5f2296955f7e tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:10:03.024327 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b077f225-f36d-4142-824d-5f2296955f7e tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:10:03.026316 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b077f225-f36d-4142-824d-5f2296955f7e tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:10:03.536641 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-58aa9822-27c4-45cf-acdb-8f31fa3262b2 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7102f7b674934e19b3d4a001b563d0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21349e14fb39496c9996d5af817b7f73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:10:03.570674 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-58aa9822-27c4-45cf-acdb-8f31fa3262b2 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] 10.222.0.18 "GET /compute/v2.1/servers/df925c6f-4463-44d7-b951-29dbb9c34ac0" status: 200 len: 1513 microversion: 2.1 time: 0.860344 Oct 22 21:10:03.587351 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2106/4210] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:10:02 2022] GET /compute/v2.1/servers/df925c6f-4463-44d7-b951-29dbb9c34ac0 => generated 1513 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:10:03.593833 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-e16086c5-d506-4ab3-8602-4cf37b273096 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:10:03.599032 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-e16086c5-d506-4ab3-8602-4cf37b273096 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] [instance: cc7f1980-ecea-437f-ac71-0cdb6ec626b9] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:10:03.606427 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e16086c5-d506-4ab3-8602-4cf37b273096 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:10:03.607178 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e16086c5-d506-4ab3-8602-4cf37b273096 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:10:03.607854 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e16086c5-d506-4ab3-8602-4cf37b273096 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:10:03.608892 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e16086c5-d506-4ab3-8602-4cf37b273096 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:10:03.609514 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e16086c5-d506-4ab3-8602-4cf37b273096 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:10:03.610202 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e16086c5-d506-4ab3-8602-4cf37b273096 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:10:04.013042 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-b077f225-f36d-4142-824d-5f2296955f7e tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e7a09f769748629425ad36120a7fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddce0c46c75496f96f2e2dae77751dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:10:04.024711 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-b077f225-f36d-4142-824d-5f2296955f7e tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] 10.222.0.18 "GET /compute/v2.1/servers/4b876a5c-1d6e-4960-a3f9-f30cc7dc03fa" status: 200 len: 1509 microversion: 2.1 time: 1.030821 Oct 22 21:10:04.025875 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2105/4211] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:10:02 2022] GET /compute/v2.1/servers/4b876a5c-1d6e-4960-a3f9-f30cc7dc03fa => generated 1509 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:10:04.417901 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-e16086c5-d506-4ab3-8602-4cf37b273096 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:10:04.435333 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-e16086c5-d506-4ab3-8602-4cf37b273096 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:10:04.437577 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-e16086c5-d506-4ab3-8602-4cf37b273096 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:10:04.441058 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-e16086c5-d506-4ab3-8602-4cf37b273096 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] 10.222.0.18 "GET /compute/v2.1/servers/cc7f1980-ecea-437f-ac71-0cdb6ec626b9" status: 200 len: 1739 microversion: 2.20 time: 0.850039 Oct 22 21:10:04.445149 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2107/4212] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:10:03 2022] GET /compute/v2.1/servers/cc7f1980-ecea-437f-ac71-0cdb6ec626b9 => generated 1739 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:10:04.595977 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-5c0c0576-dfb8-433d-b959-d7e39acb3428 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:10:04.598163 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-5c0c0576-dfb8-433d-b959-d7e39acb3428 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] [instance: df925c6f-4463-44d7-b951-29dbb9c34ac0] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:10:04.633138 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5c0c0576-dfb8-433d-b959-d7e39acb3428 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:10:04.636593 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5c0c0576-dfb8-433d-b959-d7e39acb3428 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:10:04.638480 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5c0c0576-dfb8-433d-b959-d7e39acb3428 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:10:04.644600 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5c0c0576-dfb8-433d-b959-d7e39acb3428 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:10:04.645503 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5c0c0576-dfb8-433d-b959-d7e39acb3428 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:10:04.646919 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5c0c0576-dfb8-433d-b959-d7e39acb3428 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:10:05.056138 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-8b88fcd0-1364-4668-87f9-9784326a36d3 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:10:05.056951 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-8b88fcd0-1364-4668-87f9-9784326a36d3 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] [instance: 4b876a5c-1d6e-4960-a3f9-f30cc7dc03fa] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:10:05.073135 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8b88fcd0-1364-4668-87f9-9784326a36d3 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:10:05.073634 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8b88fcd0-1364-4668-87f9-9784326a36d3 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:10:05.074079 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8b88fcd0-1364-4668-87f9-9784326a36d3 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:10:05.074800 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8b88fcd0-1364-4668-87f9-9784326a36d3 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:10:05.075260 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8b88fcd0-1364-4668-87f9-9784326a36d3 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:10:05.084471 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8b88fcd0-1364-4668-87f9-9784326a36d3 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:10:05.102422 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-5c0c0576-dfb8-433d-b959-d7e39acb3428 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7102f7b674934e19b3d4a001b563d0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21349e14fb39496c9996d5af817b7f73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:10:05.129860 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-5c0c0576-dfb8-433d-b959-d7e39acb3428 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] 10.222.0.18 "GET /compute/v2.1/servers/df925c6f-4463-44d7-b951-29dbb9c34ac0" status: 200 len: 1513 microversion: 2.1 time: 0.539376 Oct 22 21:10:05.130464 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2106/4213] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:10:04 2022] GET /compute/v2.1/servers/df925c6f-4463-44d7-b951-29dbb9c34ac0 => generated 1513 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:10:05.174642 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:10:05.472213 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-7d7353f4-ef9a-4ff9-a47d-880c69bb41db tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:10:05.472923 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-7d7353f4-ef9a-4ff9-a47d-880c69bb41db tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] [instance: cc7f1980-ecea-437f-ac71-0cdb6ec626b9] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:10:05.493583 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7d7353f4-ef9a-4ff9-a47d-880c69bb41db tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:10:05.494106 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7d7353f4-ef9a-4ff9-a47d-880c69bb41db tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:10:05.494586 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7d7353f4-ef9a-4ff9-a47d-880c69bb41db tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:10:05.504347 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7d7353f4-ef9a-4ff9-a47d-880c69bb41db tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:10:05.504887 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7d7353f4-ef9a-4ff9-a47d-880c69bb41db tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:10:05.505352 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7d7353f4-ef9a-4ff9-a47d-880c69bb41db tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:10:05.691782 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-8b88fcd0-1364-4668-87f9-9784326a36d3 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e7a09f769748629425ad36120a7fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddce0c46c75496f96f2e2dae77751dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:10:05.707237 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-8b88fcd0-1364-4668-87f9-9784326a36d3 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] 10.222.0.18 "GET /compute/v2.1/servers/4b876a5c-1d6e-4960-a3f9-f30cc7dc03fa" status: 200 len: 1515 microversion: 2.1 time: 0.661123 Oct 22 21:10:05.711640 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2108/4214] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:10:05 2022] GET /compute/v2.1/servers/4b876a5c-1d6e-4960-a3f9-f30cc7dc03fa => generated 1515 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:10:06.161502 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-3d929943-f7a3-4cb4-83a8-3e10fe4dab3a tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:10:06.162189 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-3d929943-f7a3-4cb4-83a8-3e10fe4dab3a tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] [instance: df925c6f-4463-44d7-b951-29dbb9c34ac0] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:10:06.177590 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3d929943-f7a3-4cb4-83a8-3e10fe4dab3a tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:10:06.178088 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3d929943-f7a3-4cb4-83a8-3e10fe4dab3a tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:10:06.178534 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3d929943-f7a3-4cb4-83a8-3e10fe4dab3a tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:10:06.179258 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3d929943-f7a3-4cb4-83a8-3e10fe4dab3a tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:10:06.190637 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3d929943-f7a3-4cb4-83a8-3e10fe4dab3a tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:10:06.191163 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3d929943-f7a3-4cb4-83a8-3e10fe4dab3a tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:10:06.732600 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-7d7353f4-ef9a-4ff9-a47d-880c69bb41db tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:10:06.749941 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-7d7353f4-ef9a-4ff9-a47d-880c69bb41db tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:10:06.759729 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-7d7353f4-ef9a-4ff9-a47d-880c69bb41db tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:10:06.767801 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-7d7353f4-ef9a-4ff9-a47d-880c69bb41db tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] 10.222.0.18 "GET /compute/v2.1/servers/cc7f1980-ecea-437f-ac71-0cdb6ec626b9" status: 200 len: 1739 microversion: 2.20 time: 1.300507 Oct 22 21:10:06.770438 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2107/4215] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:10:05 2022] GET /compute/v2.1/servers/cc7f1980-ecea-437f-ac71-0cdb6ec626b9 => generated 1739 bytes in 1304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 22 21:10:07.326198 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-8cc86cb4-7268-43d8-8315-e67626bc0fb0 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Action: 'create', calling method: .version_select at 0x7fd39ee3fe50>, body: {"keypair": {"name": "tempest-keypair-1767231577", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOuZammlvlccNIQS7/1UHAYBJW6twmE+cK9ObZGI3HMJK1KRCXkEPC0RrkZm77yeDBgd1qTHk9iymADEgEOM/i0XAJaJVWEG+iAIu7LAHoMwfAeUmdBQh074vSMOaeycyw=="}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:10:07.348400 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-8cc86cb4-7268-43d8-8315-e67626bc0fb0 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Getting quotas for project dddce0c46c75496f96f2e2dae77751dc. Resources: {'key_pairs'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 21:10:07.358804 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-8cc86cb4-7268-43d8-8315-e67626bc0fb0 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Getting quotas for user 67e7a09f769748629425ad36120a7fd6 and project dddce0c46c75496f96f2e2dae77751dc. Resources: {'key_pairs'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 21:10:07.419620 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-8cc86cb4-7268-43d8-8315-e67626bc0fb0 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.094830 Oct 22 21:10:07.437175 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2108/4216] 10.222.0.18 () {60 vars in 1159 bytes} [Sat Oct 22 21:10:07 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 21:10:07.703413 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-3d929943-f7a3-4cb4-83a8-3e10fe4dab3a tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7102f7b674934e19b3d4a001b563d0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21349e14fb39496c9996d5af817b7f73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:10:07.718218 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-3d929943-f7a3-4cb4-83a8-3e10fe4dab3a tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] 10.222.0.18 "GET /compute/v2.1/servers/df925c6f-4463-44d7-b951-29dbb9c34ac0" status: 200 len: 1513 microversion: 2.1 time: 1.560930 Oct 22 21:10:07.718828 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2109/4217] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:10:06 2022] GET /compute/v2.1/servers/df925c6f-4463-44d7-b951-29dbb9c34ac0 => generated 1513 bytes in 1562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:10:07.799428 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-c9d13f13-6a27-4152-a784-dffc1b18744c tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:10:07.800238 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-c9d13f13-6a27-4152-a784-dffc1b18744c tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] [instance: cc7f1980-ecea-437f-ac71-0cdb6ec626b9] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:10:07.815946 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c9d13f13-6a27-4152-a784-dffc1b18744c tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:10:07.816861 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c9d13f13-6a27-4152-a784-dffc1b18744c tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:10:07.817591 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c9d13f13-6a27-4152-a784-dffc1b18744c tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:10:07.818592 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c9d13f13-6a27-4152-a784-dffc1b18744c tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:10:07.819315 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c9d13f13-6a27-4152-a784-dffc1b18744c tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:10:07.820043 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c9d13f13-6a27-4152-a784-dffc1b18744c tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:10:08.103217 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-c9d13f13-6a27-4152-a784-dffc1b18744c tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:10:08.120922 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-c9d13f13-6a27-4152-a784-dffc1b18744c tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:10:08.122894 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-c9d13f13-6a27-4152-a784-dffc1b18744c tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:10:08.124997 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-c9d13f13-6a27-4152-a784-dffc1b18744c tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] 10.222.0.18 "GET /compute/v2.1/servers/cc7f1980-ecea-437f-ac71-0cdb6ec626b9" status: 200 len: 1739 microversion: 2.20 time: 0.330770 Oct 22 21:10:08.136186 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2109/4218] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:10:07 2022] GET /compute/v2.1/servers/cc7f1980-ecea-437f-ac71-0cdb6ec626b9 => generated 1739 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 22 21:10:08.639610 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-de5c93d2-c274-496e-b9bc-02a4faacd0fa req-866bf84b-b80b-4a01-b95f-85f845e9e1fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df925c6f-4463-44d7-b951-29dbb9c34ac0", "name": "network-vif-deleted", "tag": "78db46a3-467b-4f0a-b014-f2cdd0384e0e"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:10:08.704519 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-de5c93d2-c274-496e-b9bc-02a4faacd0fa req-866bf84b-b80b-4a01-b95f-85f845e9e1fc service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:10:08.709979 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-de5c93d2-c274-496e-b9bc-02a4faacd0fa req-866bf84b-b80b-4a01-b95f-85f845e9e1fc service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:10:08.712717 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-de5c93d2-c274-496e-b9bc-02a4faacd0fa req-866bf84b-b80b-4a01-b95f-85f845e9e1fc service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:10:08.751020 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-a9803e3b-01f5-4abf-9021-97dcead9c8fa tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:10:08.751719 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-a9803e3b-01f5-4abf-9021-97dcead9c8fa tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] [instance: df925c6f-4463-44d7-b951-29dbb9c34ac0] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:10:08.773142 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a9803e3b-01f5-4abf-9021-97dcead9c8fa tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:10:08.773677 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a9803e3b-01f5-4abf-9021-97dcead9c8fa tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:10:08.779014 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a9803e3b-01f5-4abf-9021-97dcead9c8fa tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:10:08.781842 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a9803e3b-01f5-4abf-9021-97dcead9c8fa tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:10:08.785465 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a9803e3b-01f5-4abf-9021-97dcead9c8fa tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:10:08.785770 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a9803e3b-01f5-4abf-9021-97dcead9c8fa tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:10:08.793836 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-de5c93d2-c274-496e-b9bc-02a4faacd0fa req-866bf84b-b80b-4a01-b95f-85f845e9e1fc service nova] Creating event network-vif-deleted:78db46a3-467b-4f0a-b014-f2cdd0384e0e for instance df925c6f-4463-44d7-b951-29dbb9c34ac0 on nch2-master-1 Oct 22 21:10:08.831730 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-de5c93d2-c274-496e-b9bc-02a4faacd0fa req-866bf84b-b80b-4a01-b95f-85f845e9e1fc service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.196963 Oct 22 21:10:08.843057 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2110/4219] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:10:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:10:09.004565 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-a9803e3b-01f5-4abf-9021-97dcead9c8fa tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7102f7b674934e19b3d4a001b563d0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21349e14fb39496c9996d5af817b7f73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:10:09.028896 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-a9803e3b-01f5-4abf-9021-97dcead9c8fa tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] 10.222.0.18 "GET /compute/v2.1/servers/df925c6f-4463-44d7-b951-29dbb9c34ac0" status: 200 len: 1303 microversion: 2.1 time: 0.286244 Oct 22 21:10:09.047005 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2110/4220] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:10:08 2022] GET /compute/v2.1/servers/df925c6f-4463-44d7-b951-29dbb9c34ac0 => generated 1303 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:10:09.167759 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-113121e1-88cf-4b99-8f12-af67ff5ebbdb tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:10:09.168504 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-113121e1-88cf-4b99-8f12-af67ff5ebbdb tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] [instance: cc7f1980-ecea-437f-ac71-0cdb6ec626b9] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:10:09.205546 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-113121e1-88cf-4b99-8f12-af67ff5ebbdb tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:10:09.205949 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-113121e1-88cf-4b99-8f12-af67ff5ebbdb tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:10:09.213568 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-113121e1-88cf-4b99-8f12-af67ff5ebbdb tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:10:09.220640 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-113121e1-88cf-4b99-8f12-af67ff5ebbdb tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:10:09.221243 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-113121e1-88cf-4b99-8f12-af67ff5ebbdb tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:10:09.225811 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-113121e1-88cf-4b99-8f12-af67ff5ebbdb tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:10:09.603727 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-113121e1-88cf-4b99-8f12-af67ff5ebbdb tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:10:09.617571 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-113121e1-88cf-4b99-8f12-af67ff5ebbdb tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:10:09.618831 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-113121e1-88cf-4b99-8f12-af67ff5ebbdb tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:10:09.636174 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-113121e1-88cf-4b99-8f12-af67ff5ebbdb tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] 10.222.0.18 "GET /compute/v2.1/servers/cc7f1980-ecea-437f-ac71-0cdb6ec626b9" status: 200 len: 1739 microversion: 2.20 time: 0.471160 Oct 22 21:10:09.639591 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2111/4221] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:10:09 2022] GET /compute/v2.1/servers/cc7f1980-ecea-437f-ac71-0cdb6ec626b9 => generated 1739 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:10:10.058629 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-f7af1ae9-0bc5-44f3-bb5b-7fd43715d5c4 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:10:10.060215 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-f7af1ae9-0bc5-44f3-bb5b-7fd43715d5c4 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] [instance: df925c6f-4463-44d7-b951-29dbb9c34ac0] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:10:10.083716 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f7af1ae9-0bc5-44f3-bb5b-7fd43715d5c4 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:10:10.091475 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f7af1ae9-0bc5-44f3-bb5b-7fd43715d5c4 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:10:10.092947 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f7af1ae9-0bc5-44f3-bb5b-7fd43715d5c4 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:10:10.101179 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f7af1ae9-0bc5-44f3-bb5b-7fd43715d5c4 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:10:10.102477 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f7af1ae9-0bc5-44f3-bb5b-7fd43715d5c4 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:10:10.107623 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f7af1ae9-0bc5-44f3-bb5b-7fd43715d5c4 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:10:10.150093 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.wsgi [None req-f7af1ae9-0bc5-44f3-bb5b-7fd43715d5c4 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] HTTP exception thrown: Instance df925c6f-4463-44d7-b951-29dbb9c34ac0 could not be found. Oct 22 21:10:10.154899 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-f7af1ae9-0bc5-44f3-bb5b-7fd43715d5c4 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Request method failure captured: Oct 22 21:10:10.154899 ncdv-master-1 devstack@n-api.service[138745]: request: GET /compute/v2.1/servers/df925c6f-4463-44d7-b951-29dbb9c34ac0 HTTP/1.1 Oct 22 21:10:10.154899 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 21:10:10.154899 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 21:10:10.154899 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 21:10:10.154899 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 0 Oct 22 21:10:10.154899 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 21:10:10.154899 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 21:10:10.154899 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 21:10:10.154899 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 21:10:10.154899 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVFsB6TabuGcXkx6rbRnR5vPLgUL0IP99Y-OKdK7kecvQghDVQMlOl_oNeon_Gk_fyfUdoa5iH7X1fu9w56l3kglCtcySb0caG3xy09PyRA-tBz4wf48NqwbilUB0NjukOnr7Pa2cMo1tsGYe61uylJ1NWyL7cKtfzD0hYbTOULY8f7Q Oct 22 21:10:10.154899 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 21:10:10.154899 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 21:10:10.154899 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 21:10:10.154899 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 21:10:10.154899 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 21:10:10.154899 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 21:10:10.154899 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: 21349e14fb39496c9996d5af817b7f73 Oct 22 21:10:10.154899 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1543447304 Oct 22 21:10:10.154899 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 21:10:10.154899 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 21:10:10.154899 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_21349e14fb39496c9996d5af817b7f73"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/21349e14fb39496c9996d5af817b7f73"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/21349e14fb39496c9996d5af817b7f73"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/21349e14fb39496c9996d5af817b7f73"}]}] Oct 22 21:10:10.154899 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-VolumesSnapshotTestJSON-1543447304 Oct 22 21:10:10.154899 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: 21349e14fb39496c9996d5af817b7f73 Oct 22 21:10:10.154899 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1543447304 Oct 22 21:10:10.154899 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-VolumesSnapshotTestJSON-1543447304-project Oct 22 21:10:10.154899 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 21:10:10.154899 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 21:10:10.154899 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: 7102f7b674934e19b3d4a001b563d0d5 Oct 22 21:10:10.154899 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-VolumesSnapshotTestJSON-1543447304-project Oct 22 21:10:10.154899 ncdv-master-1 devstack@n-api.service[138745]: method: > Oct 22 21:10:10.154899 ncdv-master-1 devstack@n-api.service[138745]: exception: Instance df925c6f-4463-44d7-b951-29dbb9c34ac0 could not be found. Oct 22 21:10:10.154899 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'id': 'df925c6f-4463-44d7-b951-29dbb9c34ac0'} Oct 22 21:10:10.154899 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:10:10.154899 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:10:10.154899 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 21:10:10.154899 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 21:10:10.154899 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 21:10:10.154899 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 21:10:10.154899 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 21:10:10.154899 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 21:10:10.154899 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 21:10:10.154899 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 21:10:10.154899 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df925c6f-4463-44d7-b951-29dbb9c34ac0 could not be found. Oct 22 21:10:10.154899 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:10:10.154899 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:10:10.154899 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:10:10.154899 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:10:10.154899 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:10:10.154899 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:10:10.154899 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:10:10.154899 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:10:10.154899 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:10:10.154899 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:10:10.154899 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 21:10:10.154899 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 21:10:10.154899 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 21:10:10.154899 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 21:10:10.154899 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 21:10:10.154899 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:10:10.154899 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df925c6f-4463-44d7-b951-29dbb9c34ac0 could not be found. Oct 22 21:10:10.154899 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:10:10.154899 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:10:10.154899 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:10:10.160808 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:10:10.160808 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:10:10.160808 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:10:10.160808 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:10:10.160808 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:10:10.160808 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df925c6f-4463-44d7-b951-29dbb9c34ac0 could not be found. Oct 22 21:10:10.160808 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:10:10.164014 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-f7af1ae9-0bc5-44f3-bb5b-7fd43715d5c4 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] Returning 404 to user: Instance df925c6f-4463-44d7-b951-29dbb9c34ac0 could not be found. {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:10:10.165373 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-f7af1ae9-0bc5-44f3-bb5b-7fd43715d5c4 tempest-VolumesSnapshotTestJSON-1543447304 tempest-VolumesSnapshotTestJSON-1543447304-project] 10.222.0.18 "GET /compute/v2.1/servers/df925c6f-4463-44d7-b951-29dbb9c34ac0" status: 404 len: 111 microversion: 2.1 time: 0.113091 Oct 22 21:10:10.166509 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2111/4222] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:10:10 2022] GET /compute/v2.1/servers/df925c6f-4463-44d7-b951-29dbb9c34ac0 => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 21:10:10.669741 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-187be9f7-2c1f-4eb0-b268-fb89d7cbea1a tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:10:10.670853 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-187be9f7-2c1f-4eb0-b268-fb89d7cbea1a tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] [instance: cc7f1980-ecea-437f-ac71-0cdb6ec626b9] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:10:10.696983 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-187be9f7-2c1f-4eb0-b268-fb89d7cbea1a tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:10:10.697727 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-187be9f7-2c1f-4eb0-b268-fb89d7cbea1a tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:10:10.698941 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-187be9f7-2c1f-4eb0-b268-fb89d7cbea1a tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:10:10.699919 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-187be9f7-2c1f-4eb0-b268-fb89d7cbea1a tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:10:10.700587 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-187be9f7-2c1f-4eb0-b268-fb89d7cbea1a tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:10:10.701379 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-187be9f7-2c1f-4eb0-b268-fb89d7cbea1a tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:10:11.171746 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-187be9f7-2c1f-4eb0-b268-fb89d7cbea1a tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:10:11.188569 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-187be9f7-2c1f-4eb0-b268-fb89d7cbea1a tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:10:11.191754 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-187be9f7-2c1f-4eb0-b268-fb89d7cbea1a tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:10:11.199719 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-187be9f7-2c1f-4eb0-b268-fb89d7cbea1a tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] 10.222.0.18 "GET /compute/v2.1/servers/cc7f1980-ecea-437f-ac71-0cdb6ec626b9" status: 200 len: 1739 microversion: 2.20 time: 0.533984 Oct 22 21:10:11.203249 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2112/4223] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:10:10 2022] GET /compute/v2.1/servers/cc7f1980-ecea-437f-ac71-0cdb6ec626b9 => generated 1739 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:10:11.996328 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-7df4d497-c618-4bff-82ea-8b5c27d697d7 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1500896789", "imageRef": "085e4478-6edc-4a69-8e08-f9831713eb65", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0f6a9346-decf-4445-964c-ecc7ed99cf8c"}], "security_groups": [{"name": "tempest-securitygroup--496960101"}], "key_name": "tempest-keypair-1767231577", "user_data": "}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:10:12.027815 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:10:12.237943 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-8507ccb6-a81d-4780-a4bb-7aaa7b0d3f5b tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:10:12.238738 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-8507ccb6-a81d-4780-a4bb-7aaa7b0d3f5b tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] [instance: cc7f1980-ecea-437f-ac71-0cdb6ec626b9] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:10:12.242073 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_api:SELECT=46 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:10:12.268167 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8507ccb6-a81d-4780-a4bb-7aaa7b0d3f5b tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:10:12.274089 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8507ccb6-a81d-4780-a4bb-7aaa7b0d3f5b tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:10:12.274549 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8507ccb6-a81d-4780-a4bb-7aaa7b0d3f5b tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:10:12.277383 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8507ccb6-a81d-4780-a4bb-7aaa7b0d3f5b tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:10:12.278088 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8507ccb6-a81d-4780-a4bb-7aaa7b0d3f5b tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:10:12.281249 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8507ccb6-a81d-4780-a4bb-7aaa7b0d3f5b tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:10:12.426313 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.network.neutron [None req-7df4d497-c618-4bff-82ea-8b5c27d697d7 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] validate_networks() for [('0f6a9346-decf-4445-964c-ecc7ed99cf8c', None, None, None, None, None)] {{(pid=138745) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 21:10:12.905684 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-8507ccb6-a81d-4780-a4bb-7aaa7b0d3f5b tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:10:12.944772 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-8507ccb6-a81d-4780-a4bb-7aaa7b0d3f5b tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:10:12.956876 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-8507ccb6-a81d-4780-a4bb-7aaa7b0d3f5b tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:10:12.965861 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-8507ccb6-a81d-4780-a4bb-7aaa7b0d3f5b tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] 10.222.0.18 "GET /compute/v2.1/servers/cc7f1980-ecea-437f-ac71-0cdb6ec626b9" status: 200 len: 1739 microversion: 2.20 time: 0.731032 Oct 22 21:10:12.966409 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2113/4224] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:10:12 2022] GET /compute/v2.1/servers/cc7f1980-ecea-437f-ac71-0cdb6ec626b9 => generated 1739 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 22 21:10:13.616365 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-7df4d497-c618-4bff-82ea-8b5c27d697d7 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Flavor limits 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 21:10:13.616844 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-7df4d497-c618-4bff-82ea-8b5c27d697d7 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Image limits 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 21:10:13.623425 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-7df4d497-c618-4bff-82ea-8b5c27d697d7 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Flavor pref 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 21:10:13.625271 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-7df4d497-c618-4bff-82ea-8b5c27d697d7 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Image pref 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 21:10:13.626911 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-7df4d497-c618-4bff-82ea-8b5c27d697d7 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 21:10:13.647108 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7df4d497-c618-4bff-82ea-8b5c27d697d7 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:10:13.648074 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7df4d497-c618-4bff-82ea-8b5c27d697d7 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:10:13.649041 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7df4d497-c618-4bff-82ea-8b5c27d697d7 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:10:13.651577 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7df4d497-c618-4bff-82ea-8b5c27d697d7 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:10:13.652846 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7df4d497-c618-4bff-82ea-8b5c27d697d7 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:10:13.653890 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7df4d497-c618-4bff-82ea-8b5c27d697d7 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:10:13.667412 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:10:13.719712 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-7df4d497-c618-4bff-82ea-8b5c27d697d7 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Getting quotas for project dddce0c46c75496f96f2e2dae77751dc. Resources: {'cores', 'instances', 'ram'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 21:10:13.760557 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-7df4d497-c618-4bff-82ea-8b5c27d697d7 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Getting quotas for user 67e7a09f769748629425ad36120a7fd6 and project dddce0c46c75496f96f2e2dae77751dc. Resources: {'cores', 'instances', 'ram'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 21:10:13.879537 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-7df4d497-c618-4bff-82ea-8b5c27d697d7 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Going to run 1 instances... {{(pid=138745) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 21:10:13.890048 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-7df4d497-c618-4bff-82ea-8b5c27d697d7 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] [instance: 4dc70956-7b13-4f5b-99fe-f7ea6f320f0b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='085e4478-6edc-4a69-8e08-f9831713eb65',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138745) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 21:10:13.984426 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-7df4d497-c618-4bff-82ea-8b5c27d697d7 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.992588 Oct 22 21:10:13.985109 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2112/4225] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Oct 22 21:10:11 2022] POST /compute/v2.1/servers => generated 408 bytes in 1994 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 21:10:13.996489 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-5b9955f3-b329-420d-9647-7fee3592bcff tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:10:14.000664 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-5b9955f3-b329-420d-9647-7fee3592bcff tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] [instance: 4dc70956-7b13-4f5b-99fe-f7ea6f320f0b] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:10:14.018749 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-61bac537-ce4d-413b-af44-f673de7d4d1f tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:10:14.019730 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-61bac537-ce4d-413b-af44-f673de7d4d1f tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] [instance: cc7f1980-ecea-437f-ac71-0cdb6ec626b9] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:10:14.072049 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-61bac537-ce4d-413b-af44-f673de7d4d1f tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:10:14.072571 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-61bac537-ce4d-413b-af44-f673de7d4d1f tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:10:14.073023 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-61bac537-ce4d-413b-af44-f673de7d4d1f tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:10:14.073787 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-61bac537-ce4d-413b-af44-f673de7d4d1f tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:10:14.074242 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-61bac537-ce4d-413b-af44-f673de7d4d1f tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:10:14.074678 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-61bac537-ce4d-413b-af44-f673de7d4d1f tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:10:14.205064 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-5b9955f3-b329-420d-9647-7fee3592bcff tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e7a09f769748629425ad36120a7fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddce0c46c75496f96f2e2dae77751dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:10:14.229860 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-5b9955f3-b329-420d-9647-7fee3592bcff tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] 10.222.0.18 "GET /compute/v2.1/servers/4dc70956-7b13-4f5b-99fe-f7ea6f320f0b" status: 200 len: 1246 microversion: 2.1 time: 0.237171 Oct 22 21:10:14.238375 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2113/4226] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:10:13 2022] GET /compute/v2.1/servers/4dc70956-7b13-4f5b-99fe-f7ea6f320f0b => generated 1246 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:10:14.474897 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-61bac537-ce4d-413b-af44-f673de7d4d1f tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:10:14.500417 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-61bac537-ce4d-413b-af44-f673de7d4d1f tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:10:14.503280 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-61bac537-ce4d-413b-af44-f673de7d4d1f tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:10:14.511125 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-61bac537-ce4d-413b-af44-f673de7d4d1f tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] 10.222.0.18 "GET /compute/v2.1/servers/cc7f1980-ecea-437f-ac71-0cdb6ec626b9" status: 200 len: 1739 microversion: 2.20 time: 0.518017 Oct 22 21:10:14.512363 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2114/4227] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:10:13 2022] GET /compute/v2.1/servers/cc7f1980-ecea-437f-ac71-0cdb6ec626b9 => generated 1739 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:10:15.258678 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-03bc2c3b-5561-43ec-ab5b-1119f5ab8cfc tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:10:15.259322 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-03bc2c3b-5561-43ec-ab5b-1119f5ab8cfc tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] [instance: 4dc70956-7b13-4f5b-99fe-f7ea6f320f0b] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:10:15.500963 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-03bc2c3b-5561-43ec-ab5b-1119f5ab8cfc tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e7a09f769748629425ad36120a7fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddce0c46c75496f96f2e2dae77751dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:10:15.517359 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-03bc2c3b-5561-43ec-ab5b-1119f5ab8cfc tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] 10.222.0.18 "GET /compute/v2.1/servers/4dc70956-7b13-4f5b-99fe-f7ea6f320f0b" status: 200 len: 1246 microversion: 2.1 time: 0.259339 Oct 22 21:10:15.518004 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2114/4228] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:10:15 2022] GET /compute/v2.1/servers/4dc70956-7b13-4f5b-99fe-f7ea6f320f0b => generated 1246 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:10:15.538717 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-9321a262-d144-46ad-8a0f-20161ca856a1 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:10:15.539393 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-9321a262-d144-46ad-8a0f-20161ca856a1 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] [instance: cc7f1980-ecea-437f-ac71-0cdb6ec626b9] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:10:15.550541 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9321a262-d144-46ad-8a0f-20161ca856a1 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:10:15.551155 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9321a262-d144-46ad-8a0f-20161ca856a1 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:10:15.553857 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9321a262-d144-46ad-8a0f-20161ca856a1 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:10:15.559021 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9321a262-d144-46ad-8a0f-20161ca856a1 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:10:15.559748 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9321a262-d144-46ad-8a0f-20161ca856a1 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:10:15.560665 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9321a262-d144-46ad-8a0f-20161ca856a1 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:10:16.072146 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-9321a262-d144-46ad-8a0f-20161ca856a1 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:10:16.095055 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-9321a262-d144-46ad-8a0f-20161ca856a1 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:10:16.098934 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-9321a262-d144-46ad-8a0f-20161ca856a1 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:10:16.101586 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-9321a262-d144-46ad-8a0f-20161ca856a1 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] 10.222.0.18 "GET /compute/v2.1/servers/cc7f1980-ecea-437f-ac71-0cdb6ec626b9" status: 200 len: 1739 microversion: 2.20 time: 0.567145 Oct 22 21:10:16.115376 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2115/4229] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:10:15 2022] GET /compute/v2.1/servers/cc7f1980-ecea-437f-ac71-0cdb6ec626b9 => generated 1739 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:10:16.543650 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-6561ce94-1960-4112-9893-ceae9a51c761 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:10:16.548227 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-6561ce94-1960-4112-9893-ceae9a51c761 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] [instance: 4dc70956-7b13-4f5b-99fe-f7ea6f320f0b] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:10:16.566727 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6561ce94-1960-4112-9893-ceae9a51c761 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:10:16.567264 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6561ce94-1960-4112-9893-ceae9a51c761 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:10:16.567767 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6561ce94-1960-4112-9893-ceae9a51c761 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:10:16.568535 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6561ce94-1960-4112-9893-ceae9a51c761 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:10:16.569035 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6561ce94-1960-4112-9893-ceae9a51c761 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:10:16.569502 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6561ce94-1960-4112-9893-ceae9a51c761 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:10:16.785826 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-6561ce94-1960-4112-9893-ceae9a51c761 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e7a09f769748629425ad36120a7fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddce0c46c75496f96f2e2dae77751dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:10:16.800478 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-6561ce94-1960-4112-9893-ceae9a51c761 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] 10.222.0.18 "GET /compute/v2.1/servers/4dc70956-7b13-4f5b-99fe-f7ea6f320f0b" status: 200 len: 1306 microversion: 2.1 time: 0.261072 Oct 22 21:10:16.802641 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2115/4230] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:10:16 2022] GET /compute/v2.1/servers/4dc70956-7b13-4f5b-99fe-f7ea6f320f0b => generated 1306 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:10:17.131015 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-a8bd1824-cc16-4732-887e-d43e063b738e tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:10:17.135229 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-a8bd1824-cc16-4732-887e-d43e063b738e tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] [instance: cc7f1980-ecea-437f-ac71-0cdb6ec626b9] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:10:17.163979 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a8bd1824-cc16-4732-887e-d43e063b738e tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:10:17.164521 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a8bd1824-cc16-4732-887e-d43e063b738e tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:10:17.164995 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a8bd1824-cc16-4732-887e-d43e063b738e tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:10:17.165749 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a8bd1824-cc16-4732-887e-d43e063b738e tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:10:17.166228 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a8bd1824-cc16-4732-887e-d43e063b738e tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:10:17.166685 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a8bd1824-cc16-4732-887e-d43e063b738e tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:10:17.533656 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-a8bd1824-cc16-4732-887e-d43e063b738e tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:10:17.545193 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-a8bd1824-cc16-4732-887e-d43e063b738e tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:10:17.555567 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-a8bd1824-cc16-4732-887e-d43e063b738e tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:10:17.557714 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-a8bd1824-cc16-4732-887e-d43e063b738e tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] 10.222.0.18 "GET /compute/v2.1/servers/cc7f1980-ecea-437f-ac71-0cdb6ec626b9" status: 200 len: 1739 microversion: 2.20 time: 0.431746 Oct 22 21:10:17.558771 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2116/4231] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:10:17 2022] GET /compute/v2.1/servers/cc7f1980-ecea-437f-ac71-0cdb6ec626b9 => generated 1739 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 22 21:10:17.794023 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-6021c19d-0930-4e93-88b0-68f87e1119a4 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:10:17.794568 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-6021c19d-0930-4e93-88b0-68f87e1119a4 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] [instance: 1324c851-90ff-47f4-b4e6-8acc8b829c5e] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:10:17.831999 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-b24faf02-a0ff-4868-a871-f2a9b54868f0 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:10:17.832838 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-b24faf02-a0ff-4868-a871-f2a9b54868f0 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] [instance: 4dc70956-7b13-4f5b-99fe-f7ea6f320f0b] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:10:17.848895 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6021c19d-0930-4e93-88b0-68f87e1119a4 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:10:17.851487 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6021c19d-0930-4e93-88b0-68f87e1119a4 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:10:17.856869 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6021c19d-0930-4e93-88b0-68f87e1119a4 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:10:17.862238 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6021c19d-0930-4e93-88b0-68f87e1119a4 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:10:17.866528 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6021c19d-0930-4e93-88b0-68f87e1119a4 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:10:17.869706 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6021c19d-0930-4e93-88b0-68f87e1119a4 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:10:17.870573 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b24faf02-a0ff-4868-a871-f2a9b54868f0 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:10:17.877838 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b24faf02-a0ff-4868-a871-f2a9b54868f0 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:10:17.878924 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b24faf02-a0ff-4868-a871-f2a9b54868f0 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:10:17.880059 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b24faf02-a0ff-4868-a871-f2a9b54868f0 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:10:17.883808 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b24faf02-a0ff-4868-a871-f2a9b54868f0 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:10:17.884274 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b24faf02-a0ff-4868-a871-f2a9b54868f0 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:10:18.024095 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-6021c19d-0930-4e93-88b0-68f87e1119a4 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] [instance: 1324c851-90ff-47f4-b4e6-8acc8b829c5e] Going to try to terminate instance {{(pid=138744) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 21:10:18.300108 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-6021c19d-0930-4e93-88b0-68f87e1119a4 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] 10.222.0.18 "DELETE /compute/v2.1/servers/1324c851-90ff-47f4-b4e6-8acc8b829c5e" status: 204 len: 0 microversion: 2.1 time: 1.550065 Oct 22 21:10:18.306600 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2116/4232] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 21:10:16 2022] DELETE /compute/v2.1/servers/1324c851-90ff-47f4-b4e6-8acc8b829c5e => generated 0 bytes in 1559 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 22 21:10:18.330657 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-4e2c475c-9627-4d69-b511-6947529508ce tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:10:18.336042 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-4e2c475c-9627-4d69-b511-6947529508ce tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] [instance: 1324c851-90ff-47f4-b4e6-8acc8b829c5e] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:10:18.356497 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4e2c475c-9627-4d69-b511-6947529508ce tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:10:18.359104 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4e2c475c-9627-4d69-b511-6947529508ce tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:10:18.360005 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4e2c475c-9627-4d69-b511-6947529508ce tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:10:18.362146 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4e2c475c-9627-4d69-b511-6947529508ce tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:10:18.366473 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4e2c475c-9627-4d69-b511-6947529508ce tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:10:18.367120 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4e2c475c-9627-4d69-b511-6947529508ce tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:10:18.473599 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-b24faf02-a0ff-4868-a871-f2a9b54868f0 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e7a09f769748629425ad36120a7fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddce0c46c75496f96f2e2dae77751dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:10:18.484443 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-b24faf02-a0ff-4868-a871-f2a9b54868f0 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] 10.222.0.18 "GET /compute/v2.1/servers/4dc70956-7b13-4f5b-99fe-f7ea6f320f0b" status: 200 len: 1304 microversion: 2.1 time: 0.658486 Oct 22 21:10:18.485043 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2117/4233] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:10:17 2022] GET /compute/v2.1/servers/4dc70956-7b13-4f5b-99fe-f7ea6f320f0b => generated 1304 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:10:18.594541 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-f2a6cd7a-53b9-490b-a35f-062c3e37f10f tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:10:18.597064 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-f2a6cd7a-53b9-490b-a35f-062c3e37f10f tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] [instance: cc7f1980-ecea-437f-ac71-0cdb6ec626b9] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:10:18.609690 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f2a6cd7a-53b9-490b-a35f-062c3e37f10f tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:10:18.610036 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f2a6cd7a-53b9-490b-a35f-062c3e37f10f tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:10:18.613450 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f2a6cd7a-53b9-490b-a35f-062c3e37f10f tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:10:18.626705 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f2a6cd7a-53b9-490b-a35f-062c3e37f10f tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:10:18.627497 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f2a6cd7a-53b9-490b-a35f-062c3e37f10f tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:10:18.628113 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f2a6cd7a-53b9-490b-a35f-062c3e37f10f tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:10:19.052754 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-4e2c475c-9627-4d69-b511-6947529508ce tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3820b31a424c3a9216a6ef91fcb285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a42c3ecf474883ac652fcc8c01c9f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:10:19.067496 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-4e2c475c-9627-4d69-b511-6947529508ce tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] 10.222.0.18 "GET /compute/v2.1/servers/1324c851-90ff-47f4-b4e6-8acc8b829c5e" status: 200 len: 1576 microversion: 2.1 time: 0.749068 Oct 22 21:10:19.068573 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2117/4234] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:10:18 2022] GET /compute/v2.1/servers/1324c851-90ff-47f4-b4e6-8acc8b829c5e => generated 1576 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:10:19.171965 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-f2a6cd7a-53b9-490b-a35f-062c3e37f10f tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:10:19.182131 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-f2a6cd7a-53b9-490b-a35f-062c3e37f10f tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:10:19.192802 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-f2a6cd7a-53b9-490b-a35f-062c3e37f10f tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:10:19.198529 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-f2a6cd7a-53b9-490b-a35f-062c3e37f10f tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] 10.222.0.18 "GET /compute/v2.1/servers/cc7f1980-ecea-437f-ac71-0cdb6ec626b9" status: 200 len: 1739 microversion: 2.20 time: 0.616761 Oct 22 21:10:19.202594 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2118/4235] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:10:18 2022] GET /compute/v2.1/servers/cc7f1980-ecea-437f-ac71-0cdb6ec626b9 => generated 1739 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:10:19.513125 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-3a640da5-d396-4a7b-a7ca-1a928a733cda tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:10:19.516136 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-3a640da5-d396-4a7b-a7ca-1a928a733cda tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] [instance: 4dc70956-7b13-4f5b-99fe-f7ea6f320f0b] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:10:19.539878 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3a640da5-d396-4a7b-a7ca-1a928a733cda tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:10:19.542022 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3a640da5-d396-4a7b-a7ca-1a928a733cda tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:10:19.545253 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3a640da5-d396-4a7b-a7ca-1a928a733cda tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:10:19.551695 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3a640da5-d396-4a7b-a7ca-1a928a733cda tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:10:19.552194 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3a640da5-d396-4a7b-a7ca-1a928a733cda tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:10:19.555637 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3a640da5-d396-4a7b-a7ca-1a928a733cda tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:10:19.906128 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-4d94dd00-ce23-4ae7-8121-a26b0ccfeff3 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1189672641 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1189672641-project-admin] Calling method '.version_select at 0x7fd39c586310>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:10:19.909170 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4d94dd00-ce23-4ae7-8121-a26b0ccfeff3 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1189672641 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1189672641-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:10:19.910087 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4d94dd00-ce23-4ae7-8121-a26b0ccfeff3 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1189672641 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1189672641-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:10:19.910931 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4d94dd00-ce23-4ae7-8121-a26b0ccfeff3 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1189672641 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1189672641-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:10:19.992950 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4d94dd00-ce23-4ae7-8121-a26b0ccfeff3 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1189672641 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1189672641-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:10:19.993470 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4d94dd00-ce23-4ae7-8121-a26b0ccfeff3 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1189672641 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1189672641-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:10:19.994813 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4d94dd00-ce23-4ae7-8121-a26b0ccfeff3 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1189672641 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1189672641-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:10:20.040440 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4d94dd00-ce23-4ae7-8121-a26b0ccfeff3 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1189672641 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1189672641-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:10:20.053924 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4d94dd00-ce23-4ae7-8121-a26b0ccfeff3 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1189672641 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1189672641-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:10:20.064894 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4d94dd00-ce23-4ae7-8121-a26b0ccfeff3 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1189672641 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1189672641-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:10:20.095556 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-4d94dd00-ce23-4ae7-8121-a26b0ccfeff3 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1189672641 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1189672641-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.506967 Oct 22 21:10:20.103939 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2119/4236] 10.222.0.18 () {58 vars in 1146 bytes} [Sat Oct 22 21:10:19 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:10:20.120931 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-d44db4fb-2f12-4b6f-b97a-22257130d577 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:10:20.122902 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-d44db4fb-2f12-4b6f-b97a-22257130d577 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] [instance: 1324c851-90ff-47f4-b4e6-8acc8b829c5e] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:10:20.143838 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d44db4fb-2f12-4b6f-b97a-22257130d577 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:10:20.144351 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d44db4fb-2f12-4b6f-b97a-22257130d577 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:10:20.144803 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d44db4fb-2f12-4b6f-b97a-22257130d577 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:10:20.145526 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d44db4fb-2f12-4b6f-b97a-22257130d577 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:10:20.146001 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d44db4fb-2f12-4b6f-b97a-22257130d577 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:10:20.146440 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d44db4fb-2f12-4b6f-b97a-22257130d577 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:10:20.206453 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-3a640da5-d396-4a7b-a7ca-1a928a733cda tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e7a09f769748629425ad36120a7fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddce0c46c75496f96f2e2dae77751dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:10:20.215658 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-3a640da5-d396-4a7b-a7ca-1a928a733cda tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] 10.222.0.18 "GET /compute/v2.1/servers/4dc70956-7b13-4f5b-99fe-f7ea6f320f0b" status: 200 len: 1371 microversion: 2.1 time: 0.710050 Oct 22 21:10:20.229028 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2118/4237] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:10:19 2022] GET /compute/v2.1/servers/4dc70956-7b13-4f5b-99fe-f7ea6f320f0b => generated 1371 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:10:20.239126 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-754ad3be-0ae5-417c-8970-46bb688ff136 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:10:20.239767 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-754ad3be-0ae5-417c-8970-46bb688ff136 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] [instance: cc7f1980-ecea-437f-ac71-0cdb6ec626b9] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:10:20.267726 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-754ad3be-0ae5-417c-8970-46bb688ff136 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:10:20.268240 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-754ad3be-0ae5-417c-8970-46bb688ff136 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:10:20.268742 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-754ad3be-0ae5-417c-8970-46bb688ff136 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:10:20.269526 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-754ad3be-0ae5-417c-8970-46bb688ff136 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:10:20.270007 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-754ad3be-0ae5-417c-8970-46bb688ff136 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:10:20.270439 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-754ad3be-0ae5-417c-8970-46bb688ff136 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:10:21.137888 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-d44db4fb-2f12-4b6f-b97a-22257130d577 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3820b31a424c3a9216a6ef91fcb285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a42c3ecf474883ac652fcc8c01c9f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:10:21.154749 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-d44db4fb-2f12-4b6f-b97a-22257130d577 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] 10.222.0.18 "GET /compute/v2.1/servers/1324c851-90ff-47f4-b4e6-8acc8b829c5e" status: 200 len: 1576 microversion: 2.1 time: 1.048955 Oct 22 21:10:21.156871 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2120/4238] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:10:20 2022] GET /compute/v2.1/servers/1324c851-90ff-47f4-b4e6-8acc8b829c5e => generated 1576 bytes in 1052 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:10:21.256744 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-4dee575e-dd1e-466a-a2c8-18d1bca295cc tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:10:21.257809 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-4dee575e-dd1e-466a-a2c8-18d1bca295cc tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] [instance: 4dc70956-7b13-4f5b-99fe-f7ea6f320f0b] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:10:21.277382 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4dee575e-dd1e-466a-a2c8-18d1bca295cc tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:10:21.278342 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4dee575e-dd1e-466a-a2c8-18d1bca295cc tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:10:21.279054 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4dee575e-dd1e-466a-a2c8-18d1bca295cc tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:10:21.280562 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4dee575e-dd1e-466a-a2c8-18d1bca295cc tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:10:21.281303 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4dee575e-dd1e-466a-a2c8-18d1bca295cc tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:10:21.282011 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4dee575e-dd1e-466a-a2c8-18d1bca295cc tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:10:21.868508 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-754ad3be-0ae5-417c-8970-46bb688ff136 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:10:21.909099 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-754ad3be-0ae5-417c-8970-46bb688ff136 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:10:21.912421 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-754ad3be-0ae5-417c-8970-46bb688ff136 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:10:21.914427 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-754ad3be-0ae5-417c-8970-46bb688ff136 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] 10.222.0.18 "GET /compute/v2.1/servers/cc7f1980-ecea-437f-ac71-0cdb6ec626b9" status: 200 len: 1739 microversion: 2.20 time: 1.683987 Oct 22 21:10:21.916611 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2119/4239] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:10:20 2022] GET /compute/v2.1/servers/cc7f1980-ecea-437f-ac71-0cdb6ec626b9 => generated 1739 bytes in 1687 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:10:22.184216 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-c24ca25f-f358-420d-81e2-6d165ac7317f tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:10:22.185064 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-c24ca25f-f358-420d-81e2-6d165ac7317f tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] [instance: 1324c851-90ff-47f4-b4e6-8acc8b829c5e] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:10:22.205633 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-4dee575e-dd1e-466a-a2c8-18d1bca295cc tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e7a09f769748629425ad36120a7fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddce0c46c75496f96f2e2dae77751dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:10:22.215197 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c24ca25f-f358-420d-81e2-6d165ac7317f tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:10:22.216144 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c24ca25f-f358-420d-81e2-6d165ac7317f tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:10:22.219746 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c24ca25f-f358-420d-81e2-6d165ac7317f tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:10:22.225485 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c24ca25f-f358-420d-81e2-6d165ac7317f tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:10:22.226226 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c24ca25f-f358-420d-81e2-6d165ac7317f tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:10:22.227407 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-4dee575e-dd1e-466a-a2c8-18d1bca295cc tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] 10.222.0.18 "GET /compute/v2.1/servers/4dc70956-7b13-4f5b-99fe-f7ea6f320f0b" status: 200 len: 1371 microversion: 2.1 time: 0.972640 Oct 22 21:10:22.228127 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c24ca25f-f358-420d-81e2-6d165ac7317f tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:10:22.233668 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2121/4240] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:10:21 2022] GET /compute/v2.1/servers/4dc70956-7b13-4f5b-99fe-f7ea6f320f0b => generated 1371 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:10:22.946286 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-24b042a0-f013-46b0-8e4e-f8b7a0b5f12d tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:10:22.947211 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-24b042a0-f013-46b0-8e4e-f8b7a0b5f12d tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] [instance: cc7f1980-ecea-437f-ac71-0cdb6ec626b9] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:10:22.955326 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-24b042a0-f013-46b0-8e4e-f8b7a0b5f12d tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:10:22.957378 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-24b042a0-f013-46b0-8e4e-f8b7a0b5f12d tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:10:22.958003 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-24b042a0-f013-46b0-8e4e-f8b7a0b5f12d tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:10:22.958932 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-24b042a0-f013-46b0-8e4e-f8b7a0b5f12d tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:10:22.959603 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-24b042a0-f013-46b0-8e4e-f8b7a0b5f12d tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:10:22.960238 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-24b042a0-f013-46b0-8e4e-f8b7a0b5f12d tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:10:23.184124 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-c24ca25f-f358-420d-81e2-6d165ac7317f tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3820b31a424c3a9216a6ef91fcb285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a42c3ecf474883ac652fcc8c01c9f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:10:23.195696 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-c24ca25f-f358-420d-81e2-6d165ac7317f tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] 10.222.0.18 "GET /compute/v2.1/servers/1324c851-90ff-47f4-b4e6-8acc8b829c5e" status: 200 len: 1576 microversion: 2.1 time: 1.015455 Oct 22 21:10:23.198952 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2120/4241] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:10:22 2022] GET /compute/v2.1/servers/1324c851-90ff-47f4-b4e6-8acc8b829c5e => generated 1576 bytes in 1019 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:10:23.258590 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-63e6ae65-6ab0-4254-a63f-538f5a455842 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:10:23.259216 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-63e6ae65-6ab0-4254-a63f-538f5a455842 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] [instance: 4dc70956-7b13-4f5b-99fe-f7ea6f320f0b] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:10:23.283398 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-63e6ae65-6ab0-4254-a63f-538f5a455842 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:10:23.283871 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-63e6ae65-6ab0-4254-a63f-538f5a455842 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:10:23.284341 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-63e6ae65-6ab0-4254-a63f-538f5a455842 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:10:23.285207 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-63e6ae65-6ab0-4254-a63f-538f5a455842 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:10:23.285670 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-63e6ae65-6ab0-4254-a63f-538f5a455842 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:10:23.286107 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-63e6ae65-6ab0-4254-a63f-538f5a455842 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:10:23.667370 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell0:SELECT=2 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:10:23.700745 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-24b042a0-f013-46b0-8e4e-f8b7a0b5f12d tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:10:23.717676 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-24b042a0-f013-46b0-8e4e-f8b7a0b5f12d tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:10:23.723878 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-24b042a0-f013-46b0-8e4e-f8b7a0b5f12d tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:10:23.728223 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-24b042a0-f013-46b0-8e4e-f8b7a0b5f12d tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] 10.222.0.18 "GET /compute/v2.1/servers/cc7f1980-ecea-437f-ac71-0cdb6ec626b9" status: 200 len: 1739 microversion: 2.20 time: 0.784598 Oct 22 21:10:23.734556 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2122/4242] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:10:22 2022] GET /compute/v2.1/servers/cc7f1980-ecea-437f-ac71-0cdb6ec626b9 => generated 1739 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:10:23.755179 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-8b8e07d3-2f7e-4b1e-bd1e-b6e7eaf062c5 req-c8e00712-6d0f-4d6e-b647-dd1ede7ed4f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4dc70956-7b13-4f5b-99fe-f7ea6f320f0b", "tag": "88166dcc-9792-4971-8d68-0960842beacf"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:10:23.790340 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-8b8e07d3-2f7e-4b1e-bd1e-b6e7eaf062c5 req-c8e00712-6d0f-4d6e-b647-dd1ede7ed4f4 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:10:23.790844 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-8b8e07d3-2f7e-4b1e-bd1e-b6e7eaf062c5 req-c8e00712-6d0f-4d6e-b647-dd1ede7ed4f4 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:10:23.791289 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-8b8e07d3-2f7e-4b1e-bd1e-b6e7eaf062c5 req-c8e00712-6d0f-4d6e-b647-dd1ede7ed4f4 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:10:23.810992 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-8b8e07d3-2f7e-4b1e-bd1e-b6e7eaf062c5 req-c8e00712-6d0f-4d6e-b647-dd1ede7ed4f4 service nova] Creating event network-changed:88166dcc-9792-4971-8d68-0960842beacf for instance 4dc70956-7b13-4f5b-99fe-f7ea6f320f0b on nch2-master-1 Oct 22 21:10:23.831520 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-8b8e07d3-2f7e-4b1e-bd1e-b6e7eaf062c5 req-c8e00712-6d0f-4d6e-b647-dd1ede7ed4f4 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090980 Oct 22 21:10:23.832138 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2123/4243] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:10:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:10:24.223745 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-63e6ae65-6ab0-4254-a63f-538f5a455842 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e7a09f769748629425ad36120a7fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddce0c46c75496f96f2e2dae77751dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:10:24.231291 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-aaf19acc-999a-460e-a35f-5ab587f123c6 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:10:24.232773 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-aaf19acc-999a-460e-a35f-5ab587f123c6 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] [instance: 1324c851-90ff-47f4-b4e6-8acc8b829c5e] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:10:24.252502 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-63e6ae65-6ab0-4254-a63f-538f5a455842 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] 10.222.0.18 "GET /compute/v2.1/servers/4dc70956-7b13-4f5b-99fe-f7ea6f320f0b" status: 200 len: 1371 microversion: 2.1 time: 0.992329 Oct 22 21:10:24.256435 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2121/4244] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:10:23 2022] GET /compute/v2.1/servers/4dc70956-7b13-4f5b-99fe-f7ea6f320f0b => generated 1371 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:10:24.261955 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-aaf19acc-999a-460e-a35f-5ab587f123c6 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:10:24.264407 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-aaf19acc-999a-460e-a35f-5ab587f123c6 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:10:24.266638 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-aaf19acc-999a-460e-a35f-5ab587f123c6 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:10:24.269519 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-aaf19acc-999a-460e-a35f-5ab587f123c6 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:10:24.270486 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-aaf19acc-999a-460e-a35f-5ab587f123c6 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:10:24.272730 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-aaf19acc-999a-460e-a35f-5ab587f123c6 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:10:24.765279 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-1631610e-d173-46ad-99f6-b6fa7133201c tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:10:24.766089 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-1631610e-d173-46ad-99f6-b6fa7133201c tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] [instance: cc7f1980-ecea-437f-ac71-0cdb6ec626b9] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:10:24.802235 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1631610e-d173-46ad-99f6-b6fa7133201c tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:10:24.802796 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1631610e-d173-46ad-99f6-b6fa7133201c tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:10:24.803260 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1631610e-d173-46ad-99f6-b6fa7133201c tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:10:24.804047 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1631610e-d173-46ad-99f6-b6fa7133201c tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:10:24.810693 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1631610e-d173-46ad-99f6-b6fa7133201c tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:10:24.811471 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1631610e-d173-46ad-99f6-b6fa7133201c tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:10:24.857181 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-aaf19acc-999a-460e-a35f-5ab587f123c6 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3820b31a424c3a9216a6ef91fcb285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a42c3ecf474883ac652fcc8c01c9f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:10:24.875969 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-aaf19acc-999a-460e-a35f-5ab587f123c6 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] 10.222.0.18 "GET /compute/v2.1/servers/1324c851-90ff-47f4-b4e6-8acc8b829c5e" status: 200 len: 1509 microversion: 2.1 time: 0.656105 Oct 22 21:10:24.881309 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2124/4245] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:10:24 2022] GET /compute/v2.1/servers/1324c851-90ff-47f4-b4e6-8acc8b829c5e => generated 1509 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:10:25.281844 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-c8876bd0-82f4-441c-b713-846f581c9c22 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:10:25.283165 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-c8876bd0-82f4-441c-b713-846f581c9c22 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] [instance: 4dc70956-7b13-4f5b-99fe-f7ea6f320f0b] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:10:25.290637 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c8876bd0-82f4-441c-b713-846f581c9c22 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:10:25.292526 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c8876bd0-82f4-441c-b713-846f581c9c22 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:10:25.294048 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c8876bd0-82f4-441c-b713-846f581c9c22 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:10:25.295120 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c8876bd0-82f4-441c-b713-846f581c9c22 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:10:25.295905 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c8876bd0-82f4-441c-b713-846f581c9c22 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:10:25.296633 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c8876bd0-82f4-441c-b713-846f581c9c22 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:10:25.513106 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell0:SELECT=14 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:10:26.839851 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-1631610e-d173-46ad-99f6-b6fa7133201c tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:10:26.851155 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-1631610e-d173-46ad-99f6-b6fa7133201c tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:10:26.854955 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-1631610e-d173-46ad-99f6-b6fa7133201c tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:10:26.856670 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-1631610e-d173-46ad-99f6-b6fa7133201c tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] 10.222.0.18 "GET /compute/v2.1/servers/cc7f1980-ecea-437f-ac71-0cdb6ec626b9" status: 200 len: 1739 microversion: 2.20 time: 2.096041 Oct 22 21:10:26.857547 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2122/4246] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:10:24 2022] GET /compute/v2.1/servers/cc7f1980-ecea-437f-ac71-0cdb6ec626b9 => generated 1739 bytes in 2098 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:10:26.891002 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-1f9c2c67-5734-4333-acc3-8b4968700341 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:10:26.900227 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-1f9c2c67-5734-4333-acc3-8b4968700341 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] [instance: 1324c851-90ff-47f4-b4e6-8acc8b829c5e] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:10:26.946198 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1f9c2c67-5734-4333-acc3-8b4968700341 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:10:26.949338 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1f9c2c67-5734-4333-acc3-8b4968700341 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:10:26.951508 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1f9c2c67-5734-4333-acc3-8b4968700341 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:10:26.952847 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1f9c2c67-5734-4333-acc3-8b4968700341 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:10:26.953684 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1f9c2c67-5734-4333-acc3-8b4968700341 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:10:26.954362 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1f9c2c67-5734-4333-acc3-8b4968700341 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:10:27.009074 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1f9c2c67-5734-4333-acc3-8b4968700341 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:10:27.010760 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1f9c2c67-5734-4333-acc3-8b4968700341 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:10:27.011451 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1f9c2c67-5734-4333-acc3-8b4968700341 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:10:27.012259 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.objects.instance [None req-1f9c2c67-5734-4333-acc3-8b4968700341 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lazy-loading 'fault' on Instance uuid 1324c851-90ff-47f4-b4e6-8acc8b829c5e {{(pid=138744) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 21:10:27.142866 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-c8876bd0-82f4-441c-b713-846f581c9c22 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e7a09f769748629425ad36120a7fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddce0c46c75496f96f2e2dae77751dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:10:27.162528 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-c8876bd0-82f4-441c-b713-846f581c9c22 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] 10.222.0.18 "GET /compute/v2.1/servers/4dc70956-7b13-4f5b-99fe-f7ea6f320f0b" status: 200 len: 1371 microversion: 2.1 time: 1.880399 Oct 22 21:10:27.163881 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2125/4247] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:10:25 2022] GET /compute/v2.1/servers/4dc70956-7b13-4f5b-99fe-f7ea6f320f0b => generated 1371 bytes in 1888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:10:27.175043 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-14d9ea5f-3501-42a7-9068-51f10ccd1f00 req-78260e8e-c2c0-45cb-a197-e00060036c84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1324c851-90ff-47f4-b4e6-8acc8b829c5e", "name": "network-vif-deleted", "tag": "1113aabe-4c05-4eae-bc2b-f7bdc1f1d7ce"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:10:27.204360 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-14d9ea5f-3501-42a7-9068-51f10ccd1f00 req-78260e8e-c2c0-45cb-a197-e00060036c84 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:10:27.204900 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-14d9ea5f-3501-42a7-9068-51f10ccd1f00 req-78260e8e-c2c0-45cb-a197-e00060036c84 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:10:27.205372 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-14d9ea5f-3501-42a7-9068-51f10ccd1f00 req-78260e8e-c2c0-45cb-a197-e00060036c84 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:10:27.256487 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-14d9ea5f-3501-42a7-9068-51f10ccd1f00 req-78260e8e-c2c0-45cb-a197-e00060036c84 service nova] Creating event network-vif-deleted:1113aabe-4c05-4eae-bc2b-f7bdc1f1d7ce for instance 1324c851-90ff-47f4-b4e6-8acc8b829c5e on nch2-master-1 Oct 22 21:10:27.264095 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-14d9ea5f-3501-42a7-9068-51f10ccd1f00 req-78260e8e-c2c0-45cb-a197-e00060036c84 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098613 Oct 22 21:10:27.264869 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2126/4248] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:10:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:10:27.311271 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-1f9c2c67-5734-4333-acc3-8b4968700341 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3820b31a424c3a9216a6ef91fcb285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a42c3ecf474883ac652fcc8c01c9f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:10:27.324689 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:10:27.332356 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-1f9c2c67-5734-4333-acc3-8b4968700341 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] 10.222.0.18 "GET /compute/v2.1/servers/1324c851-90ff-47f4-b4e6-8acc8b829c5e" status: 200 len: 1230 microversion: 2.1 time: 0.465341 Oct 22 21:10:27.351227 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2123/4249] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:10:26 2022] GET /compute/v2.1/servers/1324c851-90ff-47f4-b4e6-8acc8b829c5e => generated 1230 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:10:27.889490 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-c1eae9f2-f3bc-44ec-87de-b796655683f2 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:10:27.890488 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-c1eae9f2-f3bc-44ec-87de-b796655683f2 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] [instance: cc7f1980-ecea-437f-ac71-0cdb6ec626b9] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:10:27.911171 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c1eae9f2-f3bc-44ec-87de-b796655683f2 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:10:27.913179 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c1eae9f2-f3bc-44ec-87de-b796655683f2 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:10:27.914320 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c1eae9f2-f3bc-44ec-87de-b796655683f2 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:10:27.915217 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c1eae9f2-f3bc-44ec-87de-b796655683f2 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:10:27.920027 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c1eae9f2-f3bc-44ec-87de-b796655683f2 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:10:27.920788 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c1eae9f2-f3bc-44ec-87de-b796655683f2 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:10:28.190650 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-38bc259d-1a30-4bcd-8f82-cc674e34a784 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:10:28.192056 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-38bc259d-1a30-4bcd-8f82-cc674e34a784 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] [instance: 4dc70956-7b13-4f5b-99fe-f7ea6f320f0b] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:10:28.208008 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-38bc259d-1a30-4bcd-8f82-cc674e34a784 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:10:28.209053 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-38bc259d-1a30-4bcd-8f82-cc674e34a784 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:10:28.211330 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-38bc259d-1a30-4bcd-8f82-cc674e34a784 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:10:28.213906 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-38bc259d-1a30-4bcd-8f82-cc674e34a784 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:10:28.214680 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-38bc259d-1a30-4bcd-8f82-cc674e34a784 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:10:28.216384 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-38bc259d-1a30-4bcd-8f82-cc674e34a784 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:10:28.857070 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-c1eae9f2-f3bc-44ec-87de-b796655683f2 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:10:28.872733 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-c1eae9f2-f3bc-44ec-87de-b796655683f2 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:10:28.877554 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-c1eae9f2-f3bc-44ec-87de-b796655683f2 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:10:28.882004 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-c1eae9f2-f3bc-44ec-87de-b796655683f2 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] 10.222.0.18 "GET /compute/v2.1/servers/cc7f1980-ecea-437f-ac71-0cdb6ec626b9" status: 200 len: 1721 microversion: 2.20 time: 0.997201 Oct 22 21:10:28.884689 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2127/4250] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:10:27 2022] GET /compute/v2.1/servers/cc7f1980-ecea-437f-ac71-0cdb6ec626b9 => generated 1721 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:10:28.896025 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-2a2ec5a8-ddb9-4a5a-937c-86babfb6f6a7 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:10:28.898496 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-2a2ec5a8-ddb9-4a5a-937c-86babfb6f6a7 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] [instance: 1324c851-90ff-47f4-b4e6-8acc8b829c5e] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:10:28.916146 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2a2ec5a8-ddb9-4a5a-937c-86babfb6f6a7 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:10:28.920186 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2a2ec5a8-ddb9-4a5a-937c-86babfb6f6a7 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:10:28.921821 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2a2ec5a8-ddb9-4a5a-937c-86babfb6f6a7 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:10:28.923161 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2a2ec5a8-ddb9-4a5a-937c-86babfb6f6a7 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:10:28.925328 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2a2ec5a8-ddb9-4a5a-937c-86babfb6f6a7 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:10:28.925946 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2a2ec5a8-ddb9-4a5a-937c-86babfb6f6a7 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:10:28.950967 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.wsgi [None req-2a2ec5a8-ddb9-4a5a-937c-86babfb6f6a7 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] HTTP exception thrown: Instance 1324c851-90ff-47f4-b4e6-8acc8b829c5e could not be found. Oct 22 21:10:28.953062 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-2a2ec5a8-ddb9-4a5a-937c-86babfb6f6a7 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Request method failure captured: Oct 22 21:10:28.953062 ncdv-master-1 devstack@n-api.service[138745]: request: GET /compute/v2.1/servers/1324c851-90ff-47f4-b4e6-8acc8b829c5e HTTP/1.1 Oct 22 21:10:28.953062 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 21:10:28.953062 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 21:10:28.953062 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 21:10:28.953062 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 0 Oct 22 21:10:28.953062 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 21:10:28.953062 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 21:10:28.953062 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 21:10:28.953062 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 21:10:28.953062 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVFrcKw86EUEeUngnG9DZUJvE3lmhBNDPmC4isrFt9sa-3M5uM6HCkY-mE9Fr6XyLPpjJ3yZx9ru813oA85o16iJwDuF8Nlz1bpd8p9u41wsyi0Zep7ygHQQJ9tgdQV6IQKIEN7AplmICrhSHFCRaS0cX6FN1kXuVbLH1K6CsNjHq7jM Oct 22 21:10:28.953062 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 21:10:28.953062 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 21:10:28.953062 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 21:10:28.953062 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 21:10:28.953062 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 21:10:28.953062 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 21:10:28.953062 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: 82a42c3ecf474883ac652fcc8c01c9f2 Oct 22 21:10:28.953062 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-TestVolumeBootPattern-1443368191 Oct 22 21:10:28.953062 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 21:10:28.953062 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 21:10:28.953062 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_82a42c3ecf474883ac652fcc8c01c9f2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/82a42c3ecf474883ac652fcc8c01c9f2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/82a42c3ecf474883ac652fcc8c01c9f2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/82a42c3ecf474883ac652fcc8c01c9f2"}]}] Oct 22 21:10:28.953062 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-TestVolumeBootPattern-1443368191 Oct 22 21:10:28.953062 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: 82a42c3ecf474883ac652fcc8c01c9f2 Oct 22 21:10:28.953062 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-TestVolumeBootPattern-1443368191 Oct 22 21:10:28.953062 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-TestVolumeBootPattern-1443368191-project Oct 22 21:10:28.953062 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 21:10:28.953062 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 21:10:28.953062 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: 7e3820b31a424c3a9216a6ef91fcb285 Oct 22 21:10:28.953062 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-TestVolumeBootPattern-1443368191-project Oct 22 21:10:28.953062 ncdv-master-1 devstack@n-api.service[138745]: method: > Oct 22 21:10:28.953062 ncdv-master-1 devstack@n-api.service[138745]: exception: Instance 1324c851-90ff-47f4-b4e6-8acc8b829c5e could not be found. Oct 22 21:10:28.953062 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'id': '1324c851-90ff-47f4-b4e6-8acc8b829c5e'} Oct 22 21:10:28.953062 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:10:28.953062 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:10:28.953062 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 21:10:28.953062 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 21:10:28.953062 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 21:10:28.953062 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 21:10:28.953062 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 21:10:28.953062 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 21:10:28.953062 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 21:10:28.953062 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 21:10:28.953062 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1324c851-90ff-47f4-b4e6-8acc8b829c5e could not be found. Oct 22 21:10:28.953062 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:10:28.953062 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:10:28.953062 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:10:28.953062 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:10:28.953062 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:10:28.953062 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:10:28.953062 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:10:28.953062 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:10:28.953062 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:10:28.953062 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:10:28.953062 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 21:10:28.953062 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 21:10:28.953062 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 21:10:28.953062 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 21:10:28.953062 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 21:10:28.953062 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:10:28.953062 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1324c851-90ff-47f4-b4e6-8acc8b829c5e could not be found. Oct 22 21:10:28.953062 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:10:28.953062 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:10:28.953062 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:10:28.958469 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:10:28.958469 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:10:28.958469 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:10:28.958469 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:10:28.958469 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:10:28.958469 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1324c851-90ff-47f4-b4e6-8acc8b829c5e could not be found. Oct 22 21:10:28.958469 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:10:28.958469 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-2a2ec5a8-ddb9-4a5a-937c-86babfb6f6a7 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Returning 404 to user: Instance 1324c851-90ff-47f4-b4e6-8acc8b829c5e could not be found. {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:10:28.958469 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-2a2ec5a8-ddb9-4a5a-937c-86babfb6f6a7 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] 10.222.0.18 "GET /compute/v2.1/servers/1324c851-90ff-47f4-b4e6-8acc8b829c5e" status: 404 len: 111 microversion: 2.1 time: 0.068674 Oct 22 21:10:28.958469 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2128/4251] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:10:28 2022] GET /compute/v2.1/servers/1324c851-90ff-47f4-b4e6-8acc8b829c5e => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 21:10:28.991905 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-38bc259d-1a30-4bcd-8f82-cc674e34a784 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e7a09f769748629425ad36120a7fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddce0c46c75496f96f2e2dae77751dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:10:29.007545 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-38bc259d-1a30-4bcd-8f82-cc674e34a784 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] 10.222.0.18 "GET /compute/v2.1/servers/4dc70956-7b13-4f5b-99fe-f7ea6f320f0b" status: 200 len: 1371 microversion: 2.1 time: 0.815563 Oct 22 21:10:29.011443 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2124/4252] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:10:28 2022] GET /compute/v2.1/servers/4dc70956-7b13-4f5b-99fe-f7ea6f320f0b => generated 1371 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:10:29.149323 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-bc430bd4-90ce-44dd-9540-dca2397072f5 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1990278871", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-615719538", "security_groups": [{"name": "tempest-secgroup-smoke-335632321"}], "block_device_mapping_v2": [{"uuid": "636027aa-4bd0-4937-b625-4929d9464061", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "7fc34993-7108-4fcb-8386-9f829c6044b7"}]}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:10:29.696098 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.network.neutron [None req-bc430bd4-90ce-44dd-9540-dca2397072f5 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] validate_networks() for [('7fc34993-7108-4fcb-8386-9f829c6044b7', None, None, None, None, None)] {{(pid=138745) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 21:10:29.913302 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-4618464c-eea9-4fb0-983c-ea33394ffe21 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:10:29.914748 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-4618464c-eea9-4fb0-983c-ea33394ffe21 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] [instance: cc7f1980-ecea-437f-ac71-0cdb6ec626b9] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:10:29.923984 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4618464c-eea9-4fb0-983c-ea33394ffe21 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:10:29.925028 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4618464c-eea9-4fb0-983c-ea33394ffe21 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:10:29.925526 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4618464c-eea9-4fb0-983c-ea33394ffe21 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:10:29.926695 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4618464c-eea9-4fb0-983c-ea33394ffe21 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:10:29.927244 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4618464c-eea9-4fb0-983c-ea33394ffe21 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:10:29.927783 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4618464c-eea9-4fb0-983c-ea33394ffe21 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:10:30.736199 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-4618464c-eea9-4fb0-983c-ea33394ffe21 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:10:30.745675 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-4618464c-eea9-4fb0-983c-ea33394ffe21 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:10:30.747097 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-4618464c-eea9-4fb0-983c-ea33394ffe21 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:10:30.748612 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-4618464c-eea9-4fb0-983c-ea33394ffe21 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] 10.222.0.18 "GET /compute/v2.1/servers/cc7f1980-ecea-437f-ac71-0cdb6ec626b9" status: 200 len: 1721 microversion: 2.20 time: 0.839980 Oct 22 21:10:30.767425 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2125/4253] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:10:29 2022] GET /compute/v2.1/servers/cc7f1980-ecea-437f-ac71-0cdb6ec626b9 => generated 1721 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:10:30.778529 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-9a011c62-193c-4d2a-b2fa-1fa4bf9c7fb0 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:10:30.779544 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-9a011c62-193c-4d2a-b2fa-1fa4bf9c7fb0 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] [instance: 4dc70956-7b13-4f5b-99fe-f7ea6f320f0b] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:10:30.788779 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9a011c62-193c-4d2a-b2fa-1fa4bf9c7fb0 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:10:30.789604 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9a011c62-193c-4d2a-b2fa-1fa4bf9c7fb0 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:10:30.790270 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9a011c62-193c-4d2a-b2fa-1fa4bf9c7fb0 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:10:30.791222 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9a011c62-193c-4d2a-b2fa-1fa4bf9c7fb0 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:10:30.792205 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9a011c62-193c-4d2a-b2fa-1fa4bf9c7fb0 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:10:30.793393 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9a011c62-193c-4d2a-b2fa-1fa4bf9c7fb0 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:10:31.149237 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-9a011c62-193c-4d2a-b2fa-1fa4bf9c7fb0 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e7a09f769748629425ad36120a7fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddce0c46c75496f96f2e2dae77751dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:10:31.164099 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-9a011c62-193c-4d2a-b2fa-1fa4bf9c7fb0 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] 10.222.0.18 "GET /compute/v2.1/servers/4dc70956-7b13-4f5b-99fe-f7ea6f320f0b" status: 200 len: 1371 microversion: 2.1 time: 0.394648 Oct 22 21:10:31.171554 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2126/4254] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:10:30 2022] GET /compute/v2.1/servers/4dc70956-7b13-4f5b-99fe-f7ea6f320f0b => generated 1371 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:10:31.182660 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-52b3d53d-ddd8-46b6-b1ce-326698d550fb req-2555eb5b-98ba-4a83-99a0-09d8ff7fb731 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc7f1980-ecea-437f-ac71-0cdb6ec626b9", "name": "network-vif-unplugged", "status": "completed", "tag": "96502a52-b9c6-4c85-9f2b-97330250e894"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:10:31.230490 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-52b3d53d-ddd8-46b6-b1ce-326698d550fb req-2555eb5b-98ba-4a83-99a0-09d8ff7fb731 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:10:31.231256 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-52b3d53d-ddd8-46b6-b1ce-326698d550fb req-2555eb5b-98ba-4a83-99a0-09d8ff7fb731 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:10:31.231970 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-52b3d53d-ddd8-46b6-b1ce-326698d550fb req-2555eb5b-98ba-4a83-99a0-09d8ff7fb731 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:10:31.249166 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-bc430bd4-90ce-44dd-9540-dca2397072f5 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Flavor limits 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 21:10:31.251105 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-bc430bd4-90ce-44dd-9540-dca2397072f5 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Image limits 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 21:10:31.253106 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-bc430bd4-90ce-44dd-9540-dca2397072f5 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Flavor pref 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 21:10:31.253807 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-bc430bd4-90ce-44dd-9540-dca2397072f5 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Image pref 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 21:10:31.254459 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-bc430bd4-90ce-44dd-9540-dca2397072f5 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 21:10:31.266755 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bc430bd4-90ce-44dd-9540-dca2397072f5 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:10:31.267862 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bc430bd4-90ce-44dd-9540-dca2397072f5 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:10:31.268425 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-52b3d53d-ddd8-46b6-b1ce-326698d550fb req-2555eb5b-98ba-4a83-99a0-09d8ff7fb731 service nova] Creating event network-vif-unplugged:96502a52-b9c6-4c85-9f2b-97330250e894 for instance cc7f1980-ecea-437f-ac71-0cdb6ec626b9 on nch1-master-1 Oct 22 21:10:31.268778 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bc430bd4-90ce-44dd-9540-dca2397072f5 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:10:31.273846 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bc430bd4-90ce-44dd-9540-dca2397072f5 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:10:31.274456 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bc430bd4-90ce-44dd-9540-dca2397072f5 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:10:31.274930 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bc430bd4-90ce-44dd-9540-dca2397072f5 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:10:31.278648 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-52b3d53d-ddd8-46b6-b1ce-326698d550fb req-2555eb5b-98ba-4a83-99a0-09d8ff7fb731 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.104929 Oct 22 21:10:31.279713 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2127/4255] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:10:31 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:10:31.302067 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-bc430bd4-90ce-44dd-9540-dca2397072f5 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Getting quotas for project 82a42c3ecf474883ac652fcc8c01c9f2. Resources: {'cores', 'instances', 'ram'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 21:10:31.307709 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-bc430bd4-90ce-44dd-9540-dca2397072f5 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Getting quotas for user 7e3820b31a424c3a9216a6ef91fcb285 and project 82a42c3ecf474883ac652fcc8c01c9f2. Resources: {'cores', 'instances', 'ram'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 21:10:31.430939 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-bc430bd4-90ce-44dd-9540-dca2397072f5 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Going to run 1 instances... {{(pid=138745) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 21:10:31.434918 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-bc430bd4-90ce-44dd-9540-dca2397072f5 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] [instance: a12803be-4bbe-44d5-bfb4-f8298113556c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='636027aa-4bd0-4937-b625-4929d9464061',volume_size=None,volume_type=None)] {{(pid=138745) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 21:10:31.781575 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-1b1f1bdd-c754-4ce7-9845-a71fd550e305 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:10:31.782677 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-1b1f1bdd-c754-4ce7-9845-a71fd550e305 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] [instance: cc7f1980-ecea-437f-ac71-0cdb6ec626b9] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:10:31.794944 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1b1f1bdd-c754-4ce7-9845-a71fd550e305 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:10:31.795455 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1b1f1bdd-c754-4ce7-9845-a71fd550e305 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:10:31.796019 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1b1f1bdd-c754-4ce7-9845-a71fd550e305 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:10:31.796873 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1b1f1bdd-c754-4ce7-9845-a71fd550e305 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:10:31.797338 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1b1f1bdd-c754-4ce7-9845-a71fd550e305 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:10:31.798614 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1b1f1bdd-c754-4ce7-9845-a71fd550e305 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:10:31.818590 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-bc430bd4-90ce-44dd-9540-dca2397072f5 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.672349 Oct 22 21:10:31.824325 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2129/4256] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Oct 22 21:10:29 2022] POST /compute/v2.1/servers => generated 405 bytes in 2679 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 21:10:31.839844 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-ca30f7a6-c04d-434a-ac9a-dfc39c58f544 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:10:31.841451 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-ca30f7a6-c04d-434a-ac9a-dfc39c58f544 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] [instance: a12803be-4bbe-44d5-bfb4-f8298113556c] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:10:32.220269 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-ca30f7a6-c04d-434a-ac9a-dfc39c58f544 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3820b31a424c3a9216a6ef91fcb285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a42c3ecf474883ac652fcc8c01c9f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:10:32.229748 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-ca30f7a6-c04d-434a-ac9a-dfc39c58f544 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] 10.222.0.18 "GET /compute/v2.1/servers/a12803be-4bbe-44d5-bfb4-f8298113556c" status: 200 len: 1094 microversion: 2.1 time: 0.401233 Oct 22 21:10:32.245116 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2130/4257] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:10:31 2022] GET /compute/v2.1/servers/a12803be-4bbe-44d5-bfb4-f8298113556c => generated 1094 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:10:32.253585 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-2878e099-dcfb-4fa7-b55c-44e942036dc0 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:10:32.255663 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-2878e099-dcfb-4fa7-b55c-44e942036dc0 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] [instance: 4dc70956-7b13-4f5b-99fe-f7ea6f320f0b] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:10:32.274386 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2878e099-dcfb-4fa7-b55c-44e942036dc0 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:10:32.275319 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2878e099-dcfb-4fa7-b55c-44e942036dc0 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:10:32.277730 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2878e099-dcfb-4fa7-b55c-44e942036dc0 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:10:32.279619 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2878e099-dcfb-4fa7-b55c-44e942036dc0 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:10:32.280279 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2878e099-dcfb-4fa7-b55c-44e942036dc0 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:10:32.281197 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2878e099-dcfb-4fa7-b55c-44e942036dc0 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:10:32.452710 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-1b1f1bdd-c754-4ce7-9845-a71fd550e305 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:10:32.492647 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-1b1f1bdd-c754-4ce7-9845-a71fd550e305 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:10:32.497247 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-1b1f1bdd-c754-4ce7-9845-a71fd550e305 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:10:32.501405 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-1b1f1bdd-c754-4ce7-9845-a71fd550e305 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] 10.222.0.18 "GET /compute/v2.1/servers/cc7f1980-ecea-437f-ac71-0cdb6ec626b9" status: 200 len: 1721 microversion: 2.20 time: 0.726365 Oct 22 21:10:32.502866 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2128/4258] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:10:31 2022] GET /compute/v2.1/servers/cc7f1980-ecea-437f-ac71-0cdb6ec626b9 => generated 1721 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:10:32.512227 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-4d80d9a0-5070-41ff-bd8c-07127249324b tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Action: 'create', calling method: .version_select at 0x7fd3a415d700>, body: {"keypair": {"name": "tempest-keypair-1280684049", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKgp8TOTKRD5IuqVQVtxvPcD6qR1R9M7sAZKBDi9TWTQgS6KnzpEUhRsGl4Y4rohFZiywCId+vuHUtku+vls8/s4Ed4cGAt9AHppVGBZPD6WaM2ebez0kcUFlfm8mUukxA=="}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:10:32.547413 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-2878e099-dcfb-4fa7-b55c-44e942036dc0 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e7a09f769748629425ad36120a7fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddce0c46c75496f96f2e2dae77751dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:10:32.564580 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-2878e099-dcfb-4fa7-b55c-44e942036dc0 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] 10.222.0.18 "GET /compute/v2.1/servers/4dc70956-7b13-4f5b-99fe-f7ea6f320f0b" status: 200 len: 1371 microversion: 2.1 time: 0.331095 Oct 22 21:10:32.566980 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2131/4259] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:10:32 2022] GET /compute/v2.1/servers/4dc70956-7b13-4f5b-99fe-f7ea6f320f0b => generated 1371 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:10:32.570087 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-4d80d9a0-5070-41ff-bd8c-07127249324b tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Getting quotas for project 09185bfad7944b199a490305c22ffc3d. Resources: {'key_pairs'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 21:10:32.578336 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-4d80d9a0-5070-41ff-bd8c-07127249324b tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Getting quotas for user d69c1f0203b047eeb6a9fa0a215a63c2 and project 09185bfad7944b199a490305c22ffc3d. Resources: {'key_pairs'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 21:10:32.598022 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-019fe492-9541-4c22-9176-71f0a5330ffa tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:10:32.598959 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-019fe492-9541-4c22-9176-71f0a5330ffa tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] [instance: ad302c49-addb-464c-a15f-fa01577f90c4] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:10:32.617632 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-019fe492-9541-4c22-9176-71f0a5330ffa tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:10:32.618567 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-019fe492-9541-4c22-9176-71f0a5330ffa tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:10:32.619976 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-019fe492-9541-4c22-9176-71f0a5330ffa tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:10:32.621052 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-019fe492-9541-4c22-9176-71f0a5330ffa tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:10:32.623649 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-019fe492-9541-4c22-9176-71f0a5330ffa tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:10:32.629053 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-019fe492-9541-4c22-9176-71f0a5330ffa tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:10:32.650932 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-4d80d9a0-5070-41ff-bd8c-07127249324b tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.32 time: 0.144081 Oct 22 21:10:32.652865 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2129/4260] 10.222.0.18 () {62 vars in 1200 bytes} [Sat Oct 22 21:10:32 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 147 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 22 21:10:32.758251 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.objects.instance [None req-019fe492-9541-4c22-9176-71f0a5330ffa tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lazy-loading 'services' on Instance uuid ad302c49-addb-464c-a15f-fa01577f90c4 {{(pid=138745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 21:10:32.902946 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-019fe492-9541-4c22-9176-71f0a5330ffa tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] 10.222.0.18 "DELETE /compute/v2.1/servers/ad302c49-addb-464c-a15f-fa01577f90c4/os-volume_attachments/5f27abb4-b6a0-4d25-b866-b5618e5dd0dc" status: 202 len: 0 microversion: 2.1 time: 0.309020 Oct 22 21:10:32.904335 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2132/4261] 10.222.0.18 () {58 vars in 1416 bytes} [Sat Oct 22 21:10:32 2022] DELETE /compute/v2.1/servers/ad302c49-addb-464c-a15f-fa01577f90c4/os-volume_attachments/5f27abb4-b6a0-4d25-b866-b5618e5dd0dc => generated 0 bytes in 311 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 22 21:10:33.260525 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-e81f27ef-a208-460e-9856-e8f4cb77c901 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:10:33.261467 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-e81f27ef-a208-460e-9856-e8f4cb77c901 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] [instance: a12803be-4bbe-44d5-bfb4-f8298113556c] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:10:33.274951 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e81f27ef-a208-460e-9856-e8f4cb77c901 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:10:33.278489 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e81f27ef-a208-460e-9856-e8f4cb77c901 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:10:33.280045 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e81f27ef-a208-460e-9856-e8f4cb77c901 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:10:33.281207 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e81f27ef-a208-460e-9856-e8f4cb77c901 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:10:33.283208 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e81f27ef-a208-460e-9856-e8f4cb77c901 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:10:33.283680 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e81f27ef-a208-460e-9856-e8f4cb77c901 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:10:33.330970 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-162a6919-1b07-4597-bfe1-0681e608e6c5 req-63adeced-c70d-44f1-8195-9d3f18a1e2b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4dc70956-7b13-4f5b-99fe-f7ea6f320f0b", "name": "network-vif-plugged", "status": "completed", "tag": "88166dcc-9792-4971-8d68-0960842beacf"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:10:33.359177 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-162a6919-1b07-4597-bfe1-0681e608e6c5 req-63adeced-c70d-44f1-8195-9d3f18a1e2b2 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:10:33.360086 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-162a6919-1b07-4597-bfe1-0681e608e6c5 req-63adeced-c70d-44f1-8195-9d3f18a1e2b2 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:10:33.361038 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-162a6919-1b07-4597-bfe1-0681e608e6c5 req-63adeced-c70d-44f1-8195-9d3f18a1e2b2 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:10:33.388042 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-162a6919-1b07-4597-bfe1-0681e608e6c5 req-63adeced-c70d-44f1-8195-9d3f18a1e2b2 service nova] Creating event network-vif-plugged:88166dcc-9792-4971-8d68-0960842beacf for instance 4dc70956-7b13-4f5b-99fe-f7ea6f320f0b on nch2-master-1 Oct 22 21:10:33.401905 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-162a6919-1b07-4597-bfe1-0681e608e6c5 req-63adeced-c70d-44f1-8195-9d3f18a1e2b2 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078324 Oct 22 21:10:33.415801 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2133/4262] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:10:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 21:10:33.427534 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-e81f27ef-a208-460e-9856-e8f4cb77c901 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3820b31a424c3a9216a6ef91fcb285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a42c3ecf474883ac652fcc8c01c9f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:10:33.438984 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-e81f27ef-a208-460e-9856-e8f4cb77c901 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] 10.222.0.18 "GET /compute/v2.1/servers/a12803be-4bbe-44d5-bfb4-f8298113556c" status: 200 len: 1192 microversion: 2.1 time: 0.184539 Oct 22 21:10:33.442349 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2130/4263] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:10:33 2022] GET /compute/v2.1/servers/a12803be-4bbe-44d5-bfb4-f8298113556c => generated 1192 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:10:33.531236 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-138c2437-9cba-4706-942a-c3c4c0308f78 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:10:33.531994 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-138c2437-9cba-4706-942a-c3c4c0308f78 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] [instance: cc7f1980-ecea-437f-ac71-0cdb6ec626b9] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:10:33.540139 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-138c2437-9cba-4706-942a-c3c4c0308f78 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:10:33.540888 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-138c2437-9cba-4706-942a-c3c4c0308f78 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:10:33.541492 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-138c2437-9cba-4706-942a-c3c4c0308f78 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:10:33.542369 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-138c2437-9cba-4706-942a-c3c4c0308f78 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:10:33.543002 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-138c2437-9cba-4706-942a-c3c4c0308f78 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:10:33.543618 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-138c2437-9cba-4706-942a-c3c4c0308f78 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:10:33.602155 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-e2e275b3-89f3-4f35-aec7-8d0bbf30c43e tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:10:33.603322 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-e2e275b3-89f3-4f35-aec7-8d0bbf30c43e tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] [instance: 4dc70956-7b13-4f5b-99fe-f7ea6f320f0b] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:10:33.616016 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e2e275b3-89f3-4f35-aec7-8d0bbf30c43e tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:10:33.616806 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e2e275b3-89f3-4f35-aec7-8d0bbf30c43e tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:10:33.617413 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e2e275b3-89f3-4f35-aec7-8d0bbf30c43e tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:10:33.618720 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e2e275b3-89f3-4f35-aec7-8d0bbf30c43e tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:10:33.619386 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e2e275b3-89f3-4f35-aec7-8d0bbf30c43e tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:10:33.619971 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e2e275b3-89f3-4f35-aec7-8d0bbf30c43e tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:10:33.973606 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-138c2437-9cba-4706-942a-c3c4c0308f78 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:10:33.986291 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-138c2437-9cba-4706-942a-c3c4c0308f78 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:10:33.988603 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-138c2437-9cba-4706-942a-c3c4c0308f78 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:10:33.991483 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-138c2437-9cba-4706-942a-c3c4c0308f78 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] 10.222.0.18 "GET /compute/v2.1/servers/cc7f1980-ecea-437f-ac71-0cdb6ec626b9" status: 200 len: 1664 microversion: 2.20 time: 0.464826 Oct 22 21:10:33.992332 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2134/4264] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:10:33 2022] GET /compute/v2.1/servers/cc7f1980-ecea-437f-ac71-0cdb6ec626b9 => generated 1664 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 22 21:10:34.021066 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-e2e275b3-89f3-4f35-aec7-8d0bbf30c43e tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e7a09f769748629425ad36120a7fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddce0c46c75496f96f2e2dae77751dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:10:34.034477 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-c517d54e-222c-4c8a-85cf-f046eaa765b2 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c67610e1-af2e-402f-8cee-c3d2c0eb9bfd"}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:10:34.037213 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-e2e275b3-89f3-4f35-aec7-8d0bbf30c43e tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] 10.222.0.18 "GET /compute/v2.1/servers/4dc70956-7b13-4f5b-99fe-f7ea6f320f0b" status: 200 len: 1371 microversion: 2.1 time: 0.445904 Oct 22 21:10:34.039460 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2131/4265] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:10:33 2022] GET /compute/v2.1/servers/4dc70956-7b13-4f5b-99fe-f7ea6f320f0b => generated 1371 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:10:34.040632 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-c517d54e-222c-4c8a-85cf-f046eaa765b2 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] [instance: cc7f1980-ecea-437f-ac71-0cdb6ec626b9] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:10:34.048661 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c517d54e-222c-4c8a-85cf-f046eaa765b2 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:10:34.049416 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c517d54e-222c-4c8a-85cf-f046eaa765b2 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:10:34.050147 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c517d54e-222c-4c8a-85cf-f046eaa765b2 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:10:34.051373 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c517d54e-222c-4c8a-85cf-f046eaa765b2 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:10:34.051993 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c517d54e-222c-4c8a-85cf-f046eaa765b2 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:10:34.052765 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c517d54e-222c-4c8a-85cf-f046eaa765b2 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:10:34.057865 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:10:34.155723 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-68043749-c630-4392-8fcd-821014a8887c tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:10:34.169341 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-68043749-c630-4392-8fcd-821014a8887c tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:10:34.170183 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-68043749-c630-4392-8fcd-821014a8887c tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:10:34.170866 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-68043749-c630-4392-8fcd-821014a8887c tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:10:34.225835 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-68043749-c630-4392-8fcd-821014a8887c tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] [instance: ad302c49-addb-464c-a15f-fa01577f90c4] Going to try to stop instance {{(pid=138744) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 22 21:10:34.337354 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-68043749-c630-4392-8fcd-821014a8887c tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] 10.222.0.18 "POST /compute/v2.1/servers/ad302c49-addb-464c-a15f-fa01577f90c4/action" status: 202 len: 0 microversion: 2.1 time: 0.185746 Oct 22 21:10:34.341031 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2132/4266] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 21:10:34 2022] POST /compute/v2.1/servers/ad302c49-addb-464c-a15f-fa01577f90c4/action => generated 0 bytes in 191 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 21:10:34.362878 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-809f724c-cd17-4edc-b5c0-262c3776a4ed tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:10:34.367565 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-809f724c-cd17-4edc-b5c0-262c3776a4ed tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] [instance: ad302c49-addb-464c-a15f-fa01577f90c4] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:10:34.384715 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-809f724c-cd17-4edc-b5c0-262c3776a4ed tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:10:34.386941 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-809f724c-cd17-4edc-b5c0-262c3776a4ed tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:10:34.387718 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-809f724c-cd17-4edc-b5c0-262c3776a4ed tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:10:34.390459 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-809f724c-cd17-4edc-b5c0-262c3776a4ed tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:10:34.391656 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-809f724c-cd17-4edc-b5c0-262c3776a4ed tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:10:34.393566 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-809f724c-cd17-4edc-b5c0-262c3776a4ed tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:10:34.567642 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-c517d54e-222c-4c8a-85cf-f046eaa765b2 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] 10.222.0.18 "POST /compute/v2.1/servers/cc7f1980-ecea-437f-ac71-0cdb6ec626b9/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.552123 Oct 22 21:10:34.568453 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2135/4267] 10.222.0.18 () {62 vars in 1364 bytes} [Sat Oct 22 21:10:34 2022] POST /compute/v2.1/servers/cc7f1980-ecea-437f-ac71-0cdb6ec626b9/os-volume_attachments => generated 188 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 22 21:10:34.573422 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-e4c91a7e-4a7f-4e82-acff-01ddb5d468a9 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:10:34.574390 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-e4c91a7e-4a7f-4e82-acff-01ddb5d468a9 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] [instance: a12803be-4bbe-44d5-bfb4-f8298113556c] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:10:34.582023 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e4c91a7e-4a7f-4e82-acff-01ddb5d468a9 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:10:34.582695 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e4c91a7e-4a7f-4e82-acff-01ddb5d468a9 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:10:34.583304 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e4c91a7e-4a7f-4e82-acff-01ddb5d468a9 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:10:34.584577 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e4c91a7e-4a7f-4e82-acff-01ddb5d468a9 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:10:34.587168 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e4c91a7e-4a7f-4e82-acff-01ddb5d468a9 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:10:34.587698 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e4c91a7e-4a7f-4e82-acff-01ddb5d468a9 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:10:34.796318 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-e4c91a7e-4a7f-4e82-acff-01ddb5d468a9 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3820b31a424c3a9216a6ef91fcb285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a42c3ecf474883ac652fcc8c01c9f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:10:34.805329 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-e4c91a7e-4a7f-4e82-acff-01ddb5d468a9 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] 10.222.0.18 "GET /compute/v2.1/servers/a12803be-4bbe-44d5-bfb4-f8298113556c" status: 200 len: 1210 microversion: 2.1 time: 0.235460 Oct 22 21:10:34.806015 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2136/4268] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:10:34 2022] GET /compute/v2.1/servers/a12803be-4bbe-44d5-bfb4-f8298113556c => generated 1210 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:10:34.829283 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-563815f1-5889-4031-8d04-a5361ccdab4d tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:10:34.830354 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-563815f1-5889-4031-8d04-a5361ccdab4d tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] [instance: cc7f1980-ecea-437f-ac71-0cdb6ec626b9] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:10:34.837993 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-563815f1-5889-4031-8d04-a5361ccdab4d tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:10:34.838947 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-563815f1-5889-4031-8d04-a5361ccdab4d tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:10:34.839600 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-563815f1-5889-4031-8d04-a5361ccdab4d tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:10:34.840511 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-563815f1-5889-4031-8d04-a5361ccdab4d tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:10:34.841146 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-563815f1-5889-4031-8d04-a5361ccdab4d tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:10:34.842443 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-563815f1-5889-4031-8d04-a5361ccdab4d tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:10:34.884386 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-563815f1-5889-4031-8d04-a5361ccdab4d tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] [instance: cc7f1980-ecea-437f-ac71-0cdb6ec626b9] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=138745) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 22 21:10:34.965265 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-809f724c-cd17-4edc-b5c0-262c3776a4ed tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0d0bdfb04240209e4efa92f47cbb94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755501ba3e344f1aaf7ef80924bb57d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:10:34.982704 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-809f724c-cd17-4edc-b5c0-262c3776a4ed tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] 10.222.0.18 "GET /compute/v2.1/servers/ad302c49-addb-464c-a15f-fa01577f90c4" status: 200 len: 1675 microversion: 2.1 time: 0.636490 Oct 22 21:10:34.990563 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2133/4269] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:10:34 2022] GET /compute/v2.1/servers/ad302c49-addb-464c-a15f-fa01577f90c4 => generated 1675 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:10:35.012756 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-563815f1-5889-4031-8d04-a5361ccdab4d tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] 10.222.0.18 "POST /compute/v2.1/servers/cc7f1980-ecea-437f-ac71-0cdb6ec626b9/action" status: 202 len: 0 microversion: 2.20 time: 0.192772 Oct 22 21:10:35.017781 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2137/4270] 10.222.0.18 () {62 vars in 1319 bytes} [Sat Oct 22 21:10:34 2022] POST /compute/v2.1/servers/cc7f1980-ecea-437f-ac71-0cdb6ec626b9/action => generated 0 bytes in 199 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 22 21:10:35.024425 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-d6283cc7-5ddc-4df3-8b90-9857713fbe37 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:10:35.025352 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-d6283cc7-5ddc-4df3-8b90-9857713fbe37 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] [instance: cc7f1980-ecea-437f-ac71-0cdb6ec626b9] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:10:35.032340 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d6283cc7-5ddc-4df3-8b90-9857713fbe37 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:10:35.032826 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d6283cc7-5ddc-4df3-8b90-9857713fbe37 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:10:35.040112 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d6283cc7-5ddc-4df3-8b90-9857713fbe37 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:10:35.041128 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d6283cc7-5ddc-4df3-8b90-9857713fbe37 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:10:35.041677 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d6283cc7-5ddc-4df3-8b90-9857713fbe37 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:10:35.042032 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d6283cc7-5ddc-4df3-8b90-9857713fbe37 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:10:35.071749 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-05216143-76a4-447d-a6ee-0761bfdb9647 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:10:35.072754 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-05216143-76a4-447d-a6ee-0761bfdb9647 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] [instance: 4dc70956-7b13-4f5b-99fe-f7ea6f320f0b] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:10:35.106244 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-05216143-76a4-447d-a6ee-0761bfdb9647 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:10:35.107993 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-05216143-76a4-447d-a6ee-0761bfdb9647 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:10:35.110771 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-05216143-76a4-447d-a6ee-0761bfdb9647 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:10:35.111857 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-05216143-76a4-447d-a6ee-0761bfdb9647 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:10:35.113787 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-05216143-76a4-447d-a6ee-0761bfdb9647 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:10:35.116064 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-05216143-76a4-447d-a6ee-0761bfdb9647 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:10:35.580207 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-d6283cc7-5ddc-4df3-8b90-9857713fbe37 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:10:35.584264 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-05216143-76a4-447d-a6ee-0761bfdb9647 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e7a09f769748629425ad36120a7fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddce0c46c75496f96f2e2dae77751dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:10:35.595886 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-05216143-76a4-447d-a6ee-0761bfdb9647 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] 10.222.0.18 "GET /compute/v2.1/servers/4dc70956-7b13-4f5b-99fe-f7ea6f320f0b" status: 200 len: 1565 microversion: 2.1 time: 0.529493 Oct 22 21:10:35.596911 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2138/4271] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:10:35 2022] GET /compute/v2.1/servers/4dc70956-7b13-4f5b-99fe-f7ea6f320f0b => generated 1565 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:10:35.625578 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-d6283cc7-5ddc-4df3-8b90-9857713fbe37 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:10:35.625822 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-30ed6731-bd83-4d9a-9f79-ae907467b435 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:10:35.626140 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-30ed6731-bd83-4d9a-9f79-ae907467b435 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] [instance: 4dc70956-7b13-4f5b-99fe-f7ea6f320f0b] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:10:35.629859 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:10:35.635528 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-d6283cc7-5ddc-4df3-8b90-9857713fbe37 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:10:35.641564 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-30ed6731-bd83-4d9a-9f79-ae907467b435 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:10:35.641564 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-30ed6731-bd83-4d9a-9f79-ae907467b435 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:10:35.641564 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-30ed6731-bd83-4d9a-9f79-ae907467b435 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:10:35.641564 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-30ed6731-bd83-4d9a-9f79-ae907467b435 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:10:35.641564 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-30ed6731-bd83-4d9a-9f79-ae907467b435 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:10:35.642114 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-30ed6731-bd83-4d9a-9f79-ae907467b435 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:10:35.645009 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-d6283cc7-5ddc-4df3-8b90-9857713fbe37 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] 10.222.0.18 "GET /compute/v2.1/servers/cc7f1980-ecea-437f-ac71-0cdb6ec626b9" status: 200 len: 1750 microversion: 2.20 time: 0.624593 Oct 22 21:10:35.667066 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2134/4272] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:10:35 2022] GET /compute/v2.1/servers/cc7f1980-ecea-437f-ac71-0cdb6ec626b9 => generated 1750 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:10:35.836453 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-6523c74c-5257-422c-a9bc-db750fd5f21e tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:10:35.837207 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-6523c74c-5257-422c-a9bc-db750fd5f21e tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] [instance: a12803be-4bbe-44d5-bfb4-f8298113556c] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:10:35.844010 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6523c74c-5257-422c-a9bc-db750fd5f21e tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:10:35.844671 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6523c74c-5257-422c-a9bc-db750fd5f21e tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:10:35.845211 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6523c74c-5257-422c-a9bc-db750fd5f21e tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:10:35.846212 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6523c74c-5257-422c-a9bc-db750fd5f21e tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:10:35.846906 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6523c74c-5257-422c-a9bc-db750fd5f21e tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:10:35.847586 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6523c74c-5257-422c-a9bc-db750fd5f21e tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:10:36.549378 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-30ed6731-bd83-4d9a-9f79-ae907467b435 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] 10.222.0.18 "GET /compute/v2.1/servers/4dc70956-7b13-4f5b-99fe-f7ea6f320f0b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.928179 Oct 22 21:10:36.550294 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2139/4273] 10.222.0.18 () {58 vars in 1275 bytes} [Sat Oct 22 21:10:35 2022] GET /compute/v2.1/servers/4dc70956-7b13-4f5b-99fe-f7ea6f320f0b/os-interface => generated 284 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:10:36.555382 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-3a217be1-d18a-4f8a-a85a-3dbeaff26597 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:10:36.555628 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-3a217be1-d18a-4f8a-a85a-3dbeaff26597 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] [instance: ad302c49-addb-464c-a15f-fa01577f90c4] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:10:36.567242 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3a217be1-d18a-4f8a-a85a-3dbeaff26597 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:10:36.569729 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3a217be1-d18a-4f8a-a85a-3dbeaff26597 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:10:36.570333 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3a217be1-d18a-4f8a-a85a-3dbeaff26597 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:10:36.572059 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3a217be1-d18a-4f8a-a85a-3dbeaff26597 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:10:36.579757 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3a217be1-d18a-4f8a-a85a-3dbeaff26597 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:10:36.580561 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3a217be1-d18a-4f8a-a85a-3dbeaff26597 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:10:36.612594 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-6523c74c-5257-422c-a9bc-db750fd5f21e tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3820b31a424c3a9216a6ef91fcb285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a42c3ecf474883ac652fcc8c01c9f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:10:36.634502 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-6523c74c-5257-422c-a9bc-db750fd5f21e tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] 10.222.0.18 "GET /compute/v2.1/servers/a12803be-4bbe-44d5-bfb4-f8298113556c" status: 200 len: 1210 microversion: 2.1 time: 0.801815 Oct 22 21:10:36.638498 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2135/4274] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:10:35 2022] GET /compute/v2.1/servers/a12803be-4bbe-44d5-bfb4-f8298113556c => generated 1210 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:10:36.676927 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-6a884bb4-a95d-4a87-ae52-ebfd1d4bdb9c tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:10:36.677843 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-6a884bb4-a95d-4a87-ae52-ebfd1d4bdb9c tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] [instance: cc7f1980-ecea-437f-ac71-0cdb6ec626b9] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:10:36.693431 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6a884bb4-a95d-4a87-ae52-ebfd1d4bdb9c tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:10:36.694587 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6a884bb4-a95d-4a87-ae52-ebfd1d4bdb9c tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:10:36.695272 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6a884bb4-a95d-4a87-ae52-ebfd1d4bdb9c tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:10:36.696777 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6a884bb4-a95d-4a87-ae52-ebfd1d4bdb9c tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:10:36.697447 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6a884bb4-a95d-4a87-ae52-ebfd1d4bdb9c tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:10:36.699262 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6a884bb4-a95d-4a87-ae52-ebfd1d4bdb9c tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:10:37.109235 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-3a217be1-d18a-4f8a-a85a-3dbeaff26597 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0d0bdfb04240209e4efa92f47cbb94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755501ba3e344f1aaf7ef80924bb57d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:10:37.135426 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-3a217be1-d18a-4f8a-a85a-3dbeaff26597 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] 10.222.0.18 "GET /compute/v2.1/servers/ad302c49-addb-464c-a15f-fa01577f90c4" status: 200 len: 1675 microversion: 2.1 time: 0.579607 Oct 22 21:10:37.135426 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2140/4275] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:10:36 2022] GET /compute/v2.1/servers/ad302c49-addb-464c-a15f-fa01577f90c4 => generated 1675 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:10:37.256846 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-6a884bb4-a95d-4a87-ae52-ebfd1d4bdb9c tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:10:37.280119 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-6a884bb4-a95d-4a87-ae52-ebfd1d4bdb9c tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:10:37.282184 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-6a884bb4-a95d-4a87-ae52-ebfd1d4bdb9c tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:10:37.285956 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-6a884bb4-a95d-4a87-ae52-ebfd1d4bdb9c tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] 10.222.0.18 "GET /compute/v2.1/servers/cc7f1980-ecea-437f-ac71-0cdb6ec626b9" status: 200 len: 1750 microversion: 2.20 time: 0.615317 Oct 22 21:10:37.294773 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2136/4276] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:10:36 2022] GET /compute/v2.1/servers/cc7f1980-ecea-437f-ac71-0cdb6ec626b9 => generated 1750 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 22 21:10:37.664471 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-cf70bd76-081f-42b6-89c9-24727568e1ba tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:10:37.665140 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-cf70bd76-081f-42b6-89c9-24727568e1ba tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] [instance: a12803be-4bbe-44d5-bfb4-f8298113556c] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:10:37.680564 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cf70bd76-081f-42b6-89c9-24727568e1ba tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:10:37.681490 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cf70bd76-081f-42b6-89c9-24727568e1ba tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:10:37.684720 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cf70bd76-081f-42b6-89c9-24727568e1ba tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:10:37.686820 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cf70bd76-081f-42b6-89c9-24727568e1ba tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:10:37.688663 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cf70bd76-081f-42b6-89c9-24727568e1ba tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:10:37.691166 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cf70bd76-081f-42b6-89c9-24727568e1ba tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:10:38.118985 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-73358546-602d-4aae-aeeb-8dee7def107d tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-110518885", "imageRef": "085e4478-6edc-4a69-8e08-f9831713eb65", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "60ac769f-f148-404a-b77a-540412d8b94e"}, {"port": "983bc5e7-7127-473c-8be5-1308c3a42ef9", "tag": "port-1"}, {"port": "05dfecf4-4df5-49e0-a137-d704760c00a1", "tag": "port-2"}, {"uuid": "354d95a1-56b4-4da7-aef1-9790b47d8838", "tag": "net-1"}, {"uuid": "354d95a1-56b4-4da7-aef1-9790b47d8838"}, {"uuid": "f91e3b84-3468-48a2-b5c1-43f7e3cb8f82", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "f91e3b84-3468-48a2-b5c1-43f7e3cb8f82", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "af9a7f61-9e74-4d62-8f44-7bb6c43f3d57", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "d741aba9-6d17-41ea-aedf-8915327ec92f", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "0f2ae7f9-0c2d-4ec8-abb0-5a3968c88eb4", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1450115799"}], "key_name": "tempest-keypair-1280684049", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:10:38.320384 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-cf70bd76-081f-42b6-89c9-24727568e1ba tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3820b31a424c3a9216a6ef91fcb285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a42c3ecf474883ac652fcc8c01c9f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:10:38.329797 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-cf70bd76-081f-42b6-89c9-24727568e1ba tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] 10.222.0.18 "GET /compute/v2.1/servers/a12803be-4bbe-44d5-bfb4-f8298113556c" status: 200 len: 1265 microversion: 2.1 time: 0.669793 Oct 22 21:10:38.341697 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2141/4277] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:10:37 2022] GET /compute/v2.1/servers/a12803be-4bbe-44d5-bfb4-f8298113556c => generated 1265 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:10:38.347278 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-2bf49f53-1e5b-485b-97b1-7a314550a82f tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:10:38.348113 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-2bf49f53-1e5b-485b-97b1-7a314550a82f tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] [instance: ad302c49-addb-464c-a15f-fa01577f90c4] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:10:38.355377 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2bf49f53-1e5b-485b-97b1-7a314550a82f tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:10:38.356112 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2bf49f53-1e5b-485b-97b1-7a314550a82f tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:10:38.356780 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2bf49f53-1e5b-485b-97b1-7a314550a82f tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:10:38.357735 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2bf49f53-1e5b-485b-97b1-7a314550a82f tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:10:38.358461 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2bf49f53-1e5b-485b-97b1-7a314550a82f tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:10:38.359064 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2bf49f53-1e5b-485b-97b1-7a314550a82f tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:10:38.478510 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.network.neutron [None req-73358546-602d-4aae-aeeb-8dee7def107d tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] validate_networks() for [('60ac769f-f148-404a-b77a-540412d8b94e', None, None, None, None, None), (None, None, '983bc5e7-7127-473c-8be5-1308c3a42ef9', None, None, None), (None, None, '05dfecf4-4df5-49e0-a137-d704760c00a1', None, None, None), ('354d95a1-56b4-4da7-aef1-9790b47d8838', None, None, None, None, None), ('354d95a1-56b4-4da7-aef1-9790b47d8838', None, None, None, None, None), ('f91e3b84-3468-48a2-b5c1-43f7e3cb8f82', '10.2.2.100', None, None, None, None), ('f91e3b84-3468-48a2-b5c1-43f7e3cb8f82', '10.2.2.200', None, None, None, None)] {{(pid=138744) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 21:10:38.753192 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-2bf49f53-1e5b-485b-97b1-7a314550a82f tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0d0bdfb04240209e4efa92f47cbb94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755501ba3e344f1aaf7ef80924bb57d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:10:38.781642 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-2bf49f53-1e5b-485b-97b1-7a314550a82f tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] 10.222.0.18 "GET /compute/v2.1/servers/ad302c49-addb-464c-a15f-fa01577f90c4" status: 200 len: 1675 microversion: 2.1 time: 0.436832 Oct 22 21:10:38.782362 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2142/4278] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:10:38 2022] GET /compute/v2.1/servers/ad302c49-addb-464c-a15f-fa01577f90c4 => generated 1675 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:10:38.795018 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-e8e7c023-fc86-4552-b8cd-5a7d491d60b9 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:10:38.797930 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-e8e7c023-fc86-4552-b8cd-5a7d491d60b9 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] [instance: cc7f1980-ecea-437f-ac71-0cdb6ec626b9] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:10:38.819182 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e8e7c023-fc86-4552-b8cd-5a7d491d60b9 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:10:38.819818 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e8e7c023-fc86-4552-b8cd-5a7d491d60b9 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:10:38.820334 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e8e7c023-fc86-4552-b8cd-5a7d491d60b9 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:10:38.821349 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e8e7c023-fc86-4552-b8cd-5a7d491d60b9 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:10:38.821907 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e8e7c023-fc86-4552-b8cd-5a7d491d60b9 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:10:38.822409 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e8e7c023-fc86-4552-b8cd-5a7d491d60b9 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:10:39.556803 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-e8e7c023-fc86-4552-b8cd-5a7d491d60b9 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:10:39.577515 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-e8e7c023-fc86-4552-b8cd-5a7d491d60b9 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:10:39.586261 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-e8e7c023-fc86-4552-b8cd-5a7d491d60b9 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:10:39.591147 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-e8e7c023-fc86-4552-b8cd-5a7d491d60b9 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] 10.222.0.18 "GET /compute/v2.1/servers/cc7f1980-ecea-437f-ac71-0cdb6ec626b9" status: 200 len: 1752 microversion: 2.20 time: 0.805851 Oct 22 21:10:39.593896 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2143/4279] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:10:38 2022] GET /compute/v2.1/servers/cc7f1980-ecea-437f-ac71-0cdb6ec626b9 => generated 1752 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:10:39.943000 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-c403dd2d-4e8f-4ac0-bd35-32217cf926f7 req-14d2bea4-c171-401c-97ec-cd918e8b261c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4dc70956-7b13-4f5b-99fe-f7ea6f320f0b", "tag": "88166dcc-9792-4971-8d68-0960842beacf"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:10:39.961185 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-c403dd2d-4e8f-4ac0-bd35-32217cf926f7 req-14d2bea4-c171-401c-97ec-cd918e8b261c service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:10:39.963853 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-c403dd2d-4e8f-4ac0-bd35-32217cf926f7 req-14d2bea4-c171-401c-97ec-cd918e8b261c service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:10:39.964332 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-c403dd2d-4e8f-4ac0-bd35-32217cf926f7 req-14d2bea4-c171-401c-97ec-cd918e8b261c service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:10:39.992246 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-c403dd2d-4e8f-4ac0-bd35-32217cf926f7 req-14d2bea4-c171-401c-97ec-cd918e8b261c service nova] Creating event network-changed:88166dcc-9792-4971-8d68-0960842beacf for instance 4dc70956-7b13-4f5b-99fe-f7ea6f320f0b on nch2-master-1 Oct 22 21:10:40.003567 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-c403dd2d-4e8f-4ac0-bd35-32217cf926f7 req-14d2bea4-c171-401c-97ec-cd918e8b261c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.406218 Oct 22 21:10:40.004181 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2144/4280] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:10:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:10:40.013475 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-69930c8e-3079-43eb-8898-c11e7e1ad841 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:10:40.014397 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-69930c8e-3079-43eb-8898-c11e7e1ad841 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] [instance: a12803be-4bbe-44d5-bfb4-f8298113556c] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:10:40.038029 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-69930c8e-3079-43eb-8898-c11e7e1ad841 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:10:40.038564 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-69930c8e-3079-43eb-8898-c11e7e1ad841 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:10:40.039026 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-69930c8e-3079-43eb-8898-c11e7e1ad841 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:10:40.039984 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-69930c8e-3079-43eb-8898-c11e7e1ad841 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:10:40.040591 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-69930c8e-3079-43eb-8898-c11e7e1ad841 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:10:40.041267 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-69930c8e-3079-43eb-8898-c11e7e1ad841 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:10:40.776769 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-69930c8e-3079-43eb-8898-c11e7e1ad841 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3820b31a424c3a9216a6ef91fcb285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a42c3ecf474883ac652fcc8c01c9f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:10:40.791358 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-69930c8e-3079-43eb-8898-c11e7e1ad841 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] 10.222.0.18 "GET /compute/v2.1/servers/a12803be-4bbe-44d5-bfb4-f8298113556c" status: 200 len: 1265 microversion: 2.1 time: 0.781958 Oct 22 21:10:40.792576 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2145/4281] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:10:40 2022] GET /compute/v2.1/servers/a12803be-4bbe-44d5-bfb4-f8298113556c => generated 1265 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:10:40.800626 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-c4d4693a-0e32-424c-8dee-960327b4b950 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:10:40.801524 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-c4d4693a-0e32-424c-8dee-960327b4b950 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] [instance: ad302c49-addb-464c-a15f-fa01577f90c4] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:10:40.810684 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c4d4693a-0e32-424c-8dee-960327b4b950 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:10:40.811882 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c4d4693a-0e32-424c-8dee-960327b4b950 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:10:40.812544 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c4d4693a-0e32-424c-8dee-960327b4b950 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:10:40.814431 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c4d4693a-0e32-424c-8dee-960327b4b950 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:10:40.815087 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c4d4693a-0e32-424c-8dee-960327b4b950 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:10:40.815735 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c4d4693a-0e32-424c-8dee-960327b4b950 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:10:41.290223 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell0:SELECT=2 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:10:41.876547 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-c4d4693a-0e32-424c-8dee-960327b4b950 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0d0bdfb04240209e4efa92f47cbb94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755501ba3e344f1aaf7ef80924bb57d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:10:41.893251 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-c4d4693a-0e32-424c-8dee-960327b4b950 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] 10.222.0.18 "GET /compute/v2.1/servers/ad302c49-addb-464c-a15f-fa01577f90c4" status: 200 len: 1675 microversion: 2.1 time: 1.098871 Oct 22 21:10:41.894365 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2146/4282] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:10:40 2022] GET /compute/v2.1/servers/ad302c49-addb-464c-a15f-fa01577f90c4 => generated 1675 bytes in 1101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:10:41.912476 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-dea72c80-657e-4e5e-80a6-7c773461b573 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:10:41.913232 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-dea72c80-657e-4e5e-80a6-7c773461b573 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] [instance: cc7f1980-ecea-437f-ac71-0cdb6ec626b9] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:10:41.920907 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-dea72c80-657e-4e5e-80a6-7c773461b573 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:10:41.922138 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-dea72c80-657e-4e5e-80a6-7c773461b573 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:10:41.922874 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-dea72c80-657e-4e5e-80a6-7c773461b573 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:10:41.923942 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-dea72c80-657e-4e5e-80a6-7c773461b573 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:10:41.924633 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-dea72c80-657e-4e5e-80a6-7c773461b573 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:10:41.925263 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-dea72c80-657e-4e5e-80a6-7c773461b573 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:10:42.229540 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell0:SELECT=8 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:10:42.619792 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell0:SELECT=4 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:10:42.687188 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-dea72c80-657e-4e5e-80a6-7c773461b573 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:10:42.703045 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-dea72c80-657e-4e5e-80a6-7c773461b573 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:10:42.705023 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-dea72c80-657e-4e5e-80a6-7c773461b573 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:10:42.706567 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-dea72c80-657e-4e5e-80a6-7c773461b573 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] 10.222.0.18 "GET /compute/v2.1/servers/cc7f1980-ecea-437f-ac71-0cdb6ec626b9" status: 200 len: 1808 microversion: 2.20 time: 0.810966 Oct 22 21:10:42.719847 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2147/4283] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:10:41 2022] GET /compute/v2.1/servers/cc7f1980-ecea-437f-ac71-0cdb6ec626b9 => generated 1808 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:10:42.730571 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-347576f7-0ae8-48a7-a64d-51950f3a5c68 req-3d606ed1-0a8e-4262-80c1-cf34170fbfab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a12803be-4bbe-44d5-bfb4-f8298113556c", "tag": "5d0f1ea1-53be-4e61-b434-385f6b16da00"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:10:42.741409 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-347576f7-0ae8-48a7-a64d-51950f3a5c68 req-3d606ed1-0a8e-4262-80c1-cf34170fbfab service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:10:42.741409 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-347576f7-0ae8-48a7-a64d-51950f3a5c68 req-3d606ed1-0a8e-4262-80c1-cf34170fbfab service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:10:42.741795 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-347576f7-0ae8-48a7-a64d-51950f3a5c68 req-3d606ed1-0a8e-4262-80c1-cf34170fbfab service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:10:42.755107 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-347576f7-0ae8-48a7-a64d-51950f3a5c68 req-3d606ed1-0a8e-4262-80c1-cf34170fbfab service nova] Creating event network-changed:5d0f1ea1-53be-4e61-b434-385f6b16da00 for instance a12803be-4bbe-44d5-bfb4-f8298113556c on nch1-master-1 Oct 22 21:10:42.760138 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-347576f7-0ae8-48a7-a64d-51950f3a5c68 req-3d606ed1-0a8e-4262-80c1-cf34170fbfab service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039039 Oct 22 21:10:42.761154 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2148/4284] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:10:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:10:42.765961 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-2798174a-5724-479a-8dbc-0240dd30e90d tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:10:42.766676 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-2798174a-5724-479a-8dbc-0240dd30e90d tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] [instance: a12803be-4bbe-44d5-bfb4-f8298113556c] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:10:42.773154 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2798174a-5724-479a-8dbc-0240dd30e90d tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:10:42.773642 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2798174a-5724-479a-8dbc-0240dd30e90d tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:10:42.774103 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2798174a-5724-479a-8dbc-0240dd30e90d tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:10:42.774820 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2798174a-5724-479a-8dbc-0240dd30e90d tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:10:42.775288 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2798174a-5724-479a-8dbc-0240dd30e90d tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:10:42.775755 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2798174a-5724-479a-8dbc-0240dd30e90d tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:10:43.254250 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-2798174a-5724-479a-8dbc-0240dd30e90d tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3820b31a424c3a9216a6ef91fcb285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a42c3ecf474883ac652fcc8c01c9f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:10:43.257107 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:10:43.265395 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-2798174a-5724-479a-8dbc-0240dd30e90d tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] 10.222.0.18 "GET /compute/v2.1/servers/a12803be-4bbe-44d5-bfb4-f8298113556c" status: 200 len: 1265 microversion: 2.1 time: 0.503271 Oct 22 21:10:43.266265 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2149/4285] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:10:42 2022] GET /compute/v2.1/servers/a12803be-4bbe-44d5-bfb4-f8298113556c => generated 1265 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:10:43.566940 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-0089d3d1-11e4-4041-8d16-2ef58b4d98ce tempest-PortsAdminExtendedAttrsTestJSON-57943733 tempest-PortsAdminExtendedAttrsTestJSON-57943733-project-admin] Calling method '.version_select at 0x7fd39c54c5e0>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:10:43.569051 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0089d3d1-11e4-4041-8d16-2ef58b4d98ce tempest-PortsAdminExtendedAttrsTestJSON-57943733 tempest-PortsAdminExtendedAttrsTestJSON-57943733-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:10:43.569553 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0089d3d1-11e4-4041-8d16-2ef58b4d98ce tempest-PortsAdminExtendedAttrsTestJSON-57943733 tempest-PortsAdminExtendedAttrsTestJSON-57943733-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:10:43.570031 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0089d3d1-11e4-4041-8d16-2ef58b4d98ce tempest-PortsAdminExtendedAttrsTestJSON-57943733 tempest-PortsAdminExtendedAttrsTestJSON-57943733-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:10:43.586577 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0089d3d1-11e4-4041-8d16-2ef58b4d98ce tempest-PortsAdminExtendedAttrsTestJSON-57943733 tempest-PortsAdminExtendedAttrsTestJSON-57943733-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:10:43.587365 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0089d3d1-11e4-4041-8d16-2ef58b4d98ce tempest-PortsAdminExtendedAttrsTestJSON-57943733 tempest-PortsAdminExtendedAttrsTestJSON-57943733-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:10:43.587813 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0089d3d1-11e4-4041-8d16-2ef58b4d98ce tempest-PortsAdminExtendedAttrsTestJSON-57943733 tempest-PortsAdminExtendedAttrsTestJSON-57943733-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:10:43.598801 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0089d3d1-11e4-4041-8d16-2ef58b4d98ce tempest-PortsAdminExtendedAttrsTestJSON-57943733 tempest-PortsAdminExtendedAttrsTestJSON-57943733-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:10:43.599617 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0089d3d1-11e4-4041-8d16-2ef58b4d98ce tempest-PortsAdminExtendedAttrsTestJSON-57943733 tempest-PortsAdminExtendedAttrsTestJSON-57943733-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:10:43.600581 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0089d3d1-11e4-4041-8d16-2ef58b4d98ce tempest-PortsAdminExtendedAttrsTestJSON-57943733 tempest-PortsAdminExtendedAttrsTestJSON-57943733-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:10:43.607720 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-0089d3d1-11e4-4041-8d16-2ef58b4d98ce tempest-PortsAdminExtendedAttrsTestJSON-57943733 tempest-PortsAdminExtendedAttrsTestJSON-57943733-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.339309 Oct 22 21:10:43.608861 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2150/4286] 10.222.0.18 () {58 vars in 1146 bytes} [Sat Oct 22 21:10:43 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:10:43.614065 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-9106b9f9-712f-434e-9845-55d75a2769e1 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:10:43.614873 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-9106b9f9-712f-434e-9845-55d75a2769e1 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] [instance: ad302c49-addb-464c-a15f-fa01577f90c4] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:10:43.621910 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9106b9f9-712f-434e-9845-55d75a2769e1 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:10:43.622412 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9106b9f9-712f-434e-9845-55d75a2769e1 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:10:43.623201 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9106b9f9-712f-434e-9845-55d75a2769e1 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:10:43.623977 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9106b9f9-712f-434e-9845-55d75a2769e1 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:10:43.624477 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9106b9f9-712f-434e-9845-55d75a2769e1 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:10:43.624926 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9106b9f9-712f-434e-9845-55d75a2769e1 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:10:44.597451 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-9106b9f9-712f-434e-9845-55d75a2769e1 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0d0bdfb04240209e4efa92f47cbb94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755501ba3e344f1aaf7ef80924bb57d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:10:44.630820 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-9106b9f9-712f-434e-9845-55d75a2769e1 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] 10.222.0.18 "GET /compute/v2.1/servers/ad302c49-addb-464c-a15f-fa01577f90c4" status: 200 len: 1675 microversion: 2.1 time: 1.017408 Oct 22 21:10:44.652208 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2151/4287] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:10:43 2022] GET /compute/v2.1/servers/ad302c49-addb-464c-a15f-fa01577f90c4 => generated 1675 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:10:44.662792 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-9899a2d2-8dd8-4248-9b0a-fc4faed578ee tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:10:44.663818 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-9899a2d2-8dd8-4248-9b0a-fc4faed578ee tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] [instance: cc7f1980-ecea-437f-ac71-0cdb6ec626b9] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:10:44.671309 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9899a2d2-8dd8-4248-9b0a-fc4faed578ee tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:10:44.672159 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9899a2d2-8dd8-4248-9b0a-fc4faed578ee tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:10:44.672875 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9899a2d2-8dd8-4248-9b0a-fc4faed578ee tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:10:44.673960 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9899a2d2-8dd8-4248-9b0a-fc4faed578ee tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:10:44.674715 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9899a2d2-8dd8-4248-9b0a-fc4faed578ee tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:10:44.675415 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9899a2d2-8dd8-4248-9b0a-fc4faed578ee tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:10:45.297183 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-9899a2d2-8dd8-4248-9b0a-fc4faed578ee tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:10:45.307962 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-9899a2d2-8dd8-4248-9b0a-fc4faed578ee tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:10:45.310021 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-9899a2d2-8dd8-4248-9b0a-fc4faed578ee tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:10:45.312661 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-9899a2d2-8dd8-4248-9b0a-fc4faed578ee tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] 10.222.0.18 "GET /compute/v2.1/servers/cc7f1980-ecea-437f-ac71-0cdb6ec626b9" status: 200 len: 1808 microversion: 2.20 time: 0.655301 Oct 22 21:10:45.313567 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2152/4288] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:10:44 2022] GET /compute/v2.1/servers/cc7f1980-ecea-437f-ac71-0cdb6ec626b9 => generated 1808 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:10:45.319239 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-9d622a10-b8e0-4856-9e2b-6a630679ae5c tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:10:45.320228 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-9d622a10-b8e0-4856-9e2b-6a630679ae5c tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] [instance: a12803be-4bbe-44d5-bfb4-f8298113556c] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:10:45.327512 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9d622a10-b8e0-4856-9e2b-6a630679ae5c tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:10:45.328374 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9d622a10-b8e0-4856-9e2b-6a630679ae5c tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:10:45.329079 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9d622a10-b8e0-4856-9e2b-6a630679ae5c tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:10:45.330334 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9d622a10-b8e0-4856-9e2b-6a630679ae5c tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:10:45.331042 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9d622a10-b8e0-4856-9e2b-6a630679ae5c tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:10:45.333225 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9d622a10-b8e0-4856-9e2b-6a630679ae5c tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:10:45.937644 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-9d622a10-b8e0-4856-9e2b-6a630679ae5c tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3820b31a424c3a9216a6ef91fcb285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a42c3ecf474883ac652fcc8c01c9f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:10:45.955542 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-9d622a10-b8e0-4856-9e2b-6a630679ae5c tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] 10.222.0.18 "GET /compute/v2.1/servers/a12803be-4bbe-44d5-bfb4-f8298113556c" status: 200 len: 1265 microversion: 2.1 time: 0.639236 Oct 22 21:10:45.957848 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2153/4289] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:10:45 2022] GET /compute/v2.1/servers/a12803be-4bbe-44d5-bfb4-f8298113556c => generated 1265 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:10:45.969655 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-6bcd65f4-9395-4593-93ca-57a6ba47117d req-0708145f-e2c4-4619-8803-a4f2427b89bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc7f1980-ecea-437f-ac71-0cdb6ec626b9", "tag": "96502a52-b9c6-4c85-9f2b-97330250e894"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:10:45.989767 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-6bcd65f4-9395-4593-93ca-57a6ba47117d req-0708145f-e2c4-4619-8803-a4f2427b89bc service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:10:45.990566 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-6bcd65f4-9395-4593-93ca-57a6ba47117d req-0708145f-e2c4-4619-8803-a4f2427b89bc service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:10:45.991185 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-6bcd65f4-9395-4593-93ca-57a6ba47117d req-0708145f-e2c4-4619-8803-a4f2427b89bc service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:10:46.031993 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-6bcd65f4-9395-4593-93ca-57a6ba47117d req-0708145f-e2c4-4619-8803-a4f2427b89bc service nova] Creating event network-changed:96502a52-b9c6-4c85-9f2b-97330250e894 for instance cc7f1980-ecea-437f-ac71-0cdb6ec626b9 on nch2-master-1 Oct 22 21:10:46.037408 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-6bcd65f4-9395-4593-93ca-57a6ba47117d req-0708145f-e2c4-4619-8803-a4f2427b89bc service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077224 Oct 22 21:10:46.038322 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2154/4290] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:10:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:10:46.046263 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-553a0f91-597c-4fbb-9c0b-82a8fc883d98 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:10:46.047269 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-553a0f91-597c-4fbb-9c0b-82a8fc883d98 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] [instance: ad302c49-addb-464c-a15f-fa01577f90c4] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:10:46.074803 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-553a0f91-597c-4fbb-9c0b-82a8fc883d98 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:10:46.080346 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-553a0f91-597c-4fbb-9c0b-82a8fc883d98 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:10:46.081905 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-553a0f91-597c-4fbb-9c0b-82a8fc883d98 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:10:46.083608 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-553a0f91-597c-4fbb-9c0b-82a8fc883d98 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:10:46.086410 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-553a0f91-597c-4fbb-9c0b-82a8fc883d98 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:10:46.087313 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-553a0f91-597c-4fbb-9c0b-82a8fc883d98 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:10:46.734984 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-553a0f91-597c-4fbb-9c0b-82a8fc883d98 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0d0bdfb04240209e4efa92f47cbb94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755501ba3e344f1aaf7ef80924bb57d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:10:46.746076 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-553a0f91-597c-4fbb-9c0b-82a8fc883d98 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] 10.222.0.18 "GET /compute/v2.1/servers/ad302c49-addb-464c-a15f-fa01577f90c4" status: 200 len: 1675 microversion: 2.1 time: 0.706315 Oct 22 21:10:46.754506 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2155/4291] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:10:46 2022] GET /compute/v2.1/servers/ad302c49-addb-464c-a15f-fa01577f90c4 => generated 1675 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:10:46.765501 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-52339297-7b19-4c02-a2ec-ae3e7f5c88c2 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:10:46.766203 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-52339297-7b19-4c02-a2ec-ae3e7f5c88c2 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] [instance: cc7f1980-ecea-437f-ac71-0cdb6ec626b9] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:10:46.797398 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-52339297-7b19-4c02-a2ec-ae3e7f5c88c2 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:10:46.808436 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-52339297-7b19-4c02-a2ec-ae3e7f5c88c2 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:10:46.808925 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-52339297-7b19-4c02-a2ec-ae3e7f5c88c2 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:10:46.809727 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-52339297-7b19-4c02-a2ec-ae3e7f5c88c2 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:10:46.810338 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-52339297-7b19-4c02-a2ec-ae3e7f5c88c2 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:10:46.811023 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-52339297-7b19-4c02-a2ec-ae3e7f5c88c2 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:10:47.262108 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:10:47.848131 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-52339297-7b19-4c02-a2ec-ae3e7f5c88c2 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:10:47.858776 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-52339297-7b19-4c02-a2ec-ae3e7f5c88c2 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:10:47.860264 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-52339297-7b19-4c02-a2ec-ae3e7f5c88c2 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:10:47.861747 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-52339297-7b19-4c02-a2ec-ae3e7f5c88c2 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] 10.222.0.18 "GET /compute/v2.1/servers/cc7f1980-ecea-437f-ac71-0cdb6ec626b9" status: 200 len: 1808 microversion: 2.20 time: 1.106184 Oct 22 21:10:47.862339 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2156/4292] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:10:46 2022] GET /compute/v2.1/servers/cc7f1980-ecea-437f-ac71-0cdb6ec626b9 => generated 1808 bytes in 1107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:10:47.866787 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-9e0e03b4-9080-44c0-b728-5ddf7802e492 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:10:47.867426 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-9e0e03b4-9080-44c0-b728-5ddf7802e492 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] [instance: a12803be-4bbe-44d5-bfb4-f8298113556c] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:10:47.873602 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9e0e03b4-9080-44c0-b728-5ddf7802e492 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:10:47.874704 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9e0e03b4-9080-44c0-b728-5ddf7802e492 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:10:47.875420 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9e0e03b4-9080-44c0-b728-5ddf7802e492 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:10:47.876354 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9e0e03b4-9080-44c0-b728-5ddf7802e492 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:10:47.877636 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9e0e03b4-9080-44c0-b728-5ddf7802e492 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:10:47.878304 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9e0e03b4-9080-44c0-b728-5ddf7802e492 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:10:48.360677 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-9e0e03b4-9080-44c0-b728-5ddf7802e492 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3820b31a424c3a9216a6ef91fcb285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a42c3ecf474883ac652fcc8c01c9f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:10:48.380279 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-73358546-602d-4aae-aeeb-8dee7def107d tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Flavor limits 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 21:10:48.381246 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-73358546-602d-4aae-aeeb-8dee7def107d tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Image limits 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 21:10:48.381506 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-73358546-602d-4aae-aeeb-8dee7def107d tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Flavor pref 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 21:10:48.381937 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-73358546-602d-4aae-aeeb-8dee7def107d tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Image pref 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 21:10:48.382356 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-73358546-602d-4aae-aeeb-8dee7def107d tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 21:10:48.387549 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_api:SELECT=68,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:10:48.391051 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-9e0e03b4-9080-44c0-b728-5ddf7802e492 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] 10.222.0.18 "GET /compute/v2.1/servers/a12803be-4bbe-44d5-bfb4-f8298113556c" status: 200 len: 1265 microversion: 2.1 time: 0.527017 Oct 22 21:10:48.393457 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2157/4293] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:10:47 2022] GET /compute/v2.1/servers/a12803be-4bbe-44d5-bfb4-f8298113556c => generated 1265 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:10:48.394640 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-73358546-602d-4aae-aeeb-8dee7def107d tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:10:48.395270 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-73358546-602d-4aae-aeeb-8dee7def107d tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:10:48.395964 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-73358546-602d-4aae-aeeb-8dee7def107d tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:10:48.396907 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-73358546-602d-4aae-aeeb-8dee7def107d tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:10:48.397520 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-73358546-602d-4aae-aeeb-8dee7def107d tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:10:48.398093 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-73358546-602d-4aae-aeeb-8dee7def107d tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:10:48.401454 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-ebdbd87e-6be6-45b7-bb61-b6a1f3beea47 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:10:48.402460 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-ebdbd87e-6be6-45b7-bb61-b6a1f3beea47 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] [instance: ad302c49-addb-464c-a15f-fa01577f90c4] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:10:48.410924 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ebdbd87e-6be6-45b7-bb61-b6a1f3beea47 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:10:48.411687 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ebdbd87e-6be6-45b7-bb61-b6a1f3beea47 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:10:48.412425 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ebdbd87e-6be6-45b7-bb61-b6a1f3beea47 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:10:48.413505 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ebdbd87e-6be6-45b7-bb61-b6a1f3beea47 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:10:48.414380 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ebdbd87e-6be6-45b7-bb61-b6a1f3beea47 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:10:48.415154 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ebdbd87e-6be6-45b7-bb61-b6a1f3beea47 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:10:48.434795 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-73358546-602d-4aae-aeeb-8dee7def107d tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Getting quotas for project 09185bfad7944b199a490305c22ffc3d. Resources: {'cores', 'instances', 'ram'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 21:10:48.460975 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-73358546-602d-4aae-aeeb-8dee7def107d tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Getting quotas for user d69c1f0203b047eeb6a9fa0a215a63c2 and project 09185bfad7944b199a490305c22ffc3d. Resources: {'cores', 'instances', 'ram'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 21:10:48.835334 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-73358546-602d-4aae-aeeb-8dee7def107d tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Going to run 1 instances... {{(pid=138744) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 21:10:48.839588 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-73358546-602d-4aae-aeeb-8dee7def107d tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] [instance: 4d285bc1-33a9-47e0-a148-756be61c0488] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='af9a7f61-9e74-4d62-8f44-7bb6c43f3d57',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='d741aba9-6d17-41ea-aedf-8915327ec92f',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0f2ae7f9-0c2d-4ec8-abb0-5a3968c88eb4',volume_size=None,volume_type=None)] {{(pid=138744) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 21:10:48.845687 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-ebdbd87e-6be6-45b7-bb61-b6a1f3beea47 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0d0bdfb04240209e4efa92f47cbb94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755501ba3e344f1aaf7ef80924bb57d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:10:48.857493 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-ebdbd87e-6be6-45b7-bb61-b6a1f3beea47 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] 10.222.0.18 "GET /compute/v2.1/servers/ad302c49-addb-464c-a15f-fa01577f90c4" status: 200 len: 1675 microversion: 2.1 time: 0.462415 Oct 22 21:10:48.858142 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2158/4294] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:10:48 2022] GET /compute/v2.1/servers/ad302c49-addb-464c-a15f-fa01577f90c4 => generated 1675 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:10:48.887219 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-3889e66d-4682-4c25-b34c-5e8bc7966a1e req-44ee09dc-1584-4e5b-812d-71be5bfb47b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a12803be-4bbe-44d5-bfb4-f8298113556c", "name": "network-vif-plugged", "status": "completed", "tag": "5d0f1ea1-53be-4e61-b434-385f6b16da00"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:10:48.913629 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-3889e66d-4682-4c25-b34c-5e8bc7966a1e req-44ee09dc-1584-4e5b-812d-71be5bfb47b8 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:10:48.915954 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-3889e66d-4682-4c25-b34c-5e8bc7966a1e req-44ee09dc-1584-4e5b-812d-71be5bfb47b8 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:10:48.916635 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-3889e66d-4682-4c25-b34c-5e8bc7966a1e req-44ee09dc-1584-4e5b-812d-71be5bfb47b8 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:10:48.948907 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-3889e66d-4682-4c25-b34c-5e8bc7966a1e req-44ee09dc-1584-4e5b-812d-71be5bfb47b8 service nova] Creating event network-vif-plugged:5d0f1ea1-53be-4e61-b434-385f6b16da00 for instance a12803be-4bbe-44d5-bfb4-f8298113556c on nch1-master-1 Oct 22 21:10:48.964388 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-3889e66d-4682-4c25-b34c-5e8bc7966a1e req-44ee09dc-1584-4e5b-812d-71be5bfb47b8 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080731 Oct 22 21:10:48.968098 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2159/4295] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:10:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:10:48.991599 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-8e7b5d0a-8269-476d-85b2-05ba2fc1f641 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:10:48.995167 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-8e7b5d0a-8269-476d-85b2-05ba2fc1f641 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] [instance: cc7f1980-ecea-437f-ac71-0cdb6ec626b9] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:10:49.012530 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8e7b5d0a-8269-476d-85b2-05ba2fc1f641 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:10:49.015150 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8e7b5d0a-8269-476d-85b2-05ba2fc1f641 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:10:49.017077 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8e7b5d0a-8269-476d-85b2-05ba2fc1f641 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:10:49.018138 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8e7b5d0a-8269-476d-85b2-05ba2fc1f641 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:10:49.020698 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8e7b5d0a-8269-476d-85b2-05ba2fc1f641 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:10:49.021394 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8e7b5d0a-8269-476d-85b2-05ba2fc1f641 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:10:49.599543 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-73358546-602d-4aae-aeeb-8dee7def107d tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.32 time: 11.483414 Oct 22 21:10:49.603666 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2137/4296] 10.222.0.18 () {62 vars in 1189 bytes} [Sat Oct 22 21:10:38 2022] POST /compute/v2.1/servers => generated 406 bytes in 11490 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 22 21:10:49.611006 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-b242597a-3609-4339-bf0f-72953ab4fe9b tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:10:49.615216 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-b242597a-3609-4339-bf0f-72953ab4fe9b tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] [instance: a12803be-4bbe-44d5-bfb4-f8298113556c] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:10:49.627449 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b242597a-3609-4339-bf0f-72953ab4fe9b tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:10:49.628614 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b242597a-3609-4339-bf0f-72953ab4fe9b tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:10:49.630232 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b242597a-3609-4339-bf0f-72953ab4fe9b tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:10:49.631623 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b242597a-3609-4339-bf0f-72953ab4fe9b tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:10:49.633962 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b242597a-3609-4339-bf0f-72953ab4fe9b tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:10:49.634689 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b242597a-3609-4339-bf0f-72953ab4fe9b tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:10:49.715383 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-8e7b5d0a-8269-476d-85b2-05ba2fc1f641 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:10:49.749120 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-8e7b5d0a-8269-476d-85b2-05ba2fc1f641 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:10:49.764980 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-8e7b5d0a-8269-476d-85b2-05ba2fc1f641 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:10:49.770967 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-8e7b5d0a-8269-476d-85b2-05ba2fc1f641 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] 10.222.0.18 "GET /compute/v2.1/servers/cc7f1980-ecea-437f-ac71-0cdb6ec626b9" status: 200 len: 1808 microversion: 2.20 time: 0.801387 Oct 22 21:10:49.774427 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2160/4297] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:10:48 2022] GET /compute/v2.1/servers/cc7f1980-ecea-437f-ac71-0cdb6ec626b9 => generated 1808 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:10:49.798364 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-5580e5a7-3172-4283-973a-5f9f02aad1e1 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:10:49.801666 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-5580e5a7-3172-4283-973a-5f9f02aad1e1 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] [instance: 4d285bc1-33a9-47e0-a148-756be61c0488] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:10:50.079849 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-5580e5a7-3172-4283-973a-5f9f02aad1e1 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd69c1f0203b047eeb6a9fa0a215a63c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09185bfad7944b199a490305c22ffc3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:10:50.089133 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-5580e5a7-3172-4283-973a-5f9f02aad1e1 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd69c1f0203b047eeb6a9fa0a215a63c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09185bfad7944b199a490305c22ffc3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:10:50.096886 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-5580e5a7-3172-4283-973a-5f9f02aad1e1 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd69c1f0203b047eeb6a9fa0a215a63c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09185bfad7944b199a490305c22ffc3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:10:50.098247 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-5580e5a7-3172-4283-973a-5f9f02aad1e1 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] 10.222.0.18 "GET /compute/v2.1/servers/4d285bc1-33a9-47e0-a148-756be61c0488" status: 200 len: 1285 microversion: 2.32 time: 0.321748 Oct 22 21:10:50.099294 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2161/4298] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:10:49 2022] GET /compute/v2.1/servers/4d285bc1-33a9-47e0-a148-756be61c0488 => generated 1285 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:10:50.111278 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-03b2bf44-d06d-4413-a8f5-a187883bdd89 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:10:50.112205 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-03b2bf44-d06d-4413-a8f5-a187883bdd89 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] [instance: ad302c49-addb-464c-a15f-fa01577f90c4] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:10:50.126463 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-03b2bf44-d06d-4413-a8f5-a187883bdd89 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:10:50.129119 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-03b2bf44-d06d-4413-a8f5-a187883bdd89 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:10:50.129766 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-03b2bf44-d06d-4413-a8f5-a187883bdd89 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:10:50.134758 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-03b2bf44-d06d-4413-a8f5-a187883bdd89 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:10:50.135500 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-03b2bf44-d06d-4413-a8f5-a187883bdd89 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:10:50.136140 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-03b2bf44-d06d-4413-a8f5-a187883bdd89 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:10:50.284445 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-b242597a-3609-4339-bf0f-72953ab4fe9b tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3820b31a424c3a9216a6ef91fcb285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a42c3ecf474883ac652fcc8c01c9f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:10:50.316201 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-b242597a-3609-4339-bf0f-72953ab4fe9b tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] 10.222.0.18 "GET /compute/v2.1/servers/a12803be-4bbe-44d5-bfb4-f8298113556c" status: 200 len: 1265 microversion: 2.1 time: 0.710908 Oct 22 21:10:50.316800 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2138/4299] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:10:49 2022] GET /compute/v2.1/servers/a12803be-4bbe-44d5-bfb4-f8298113556c => generated 1265 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:10:50.670323 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-03b2bf44-d06d-4413-a8f5-a187883bdd89 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0d0bdfb04240209e4efa92f47cbb94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755501ba3e344f1aaf7ef80924bb57d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:10:50.691503 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-03b2bf44-d06d-4413-a8f5-a187883bdd89 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] 10.222.0.18 "GET /compute/v2.1/servers/ad302c49-addb-464c-a15f-fa01577f90c4" status: 200 len: 1652 microversion: 2.1 time: 0.590262 Oct 22 21:10:50.692460 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2162/4300] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:10:50 2022] GET /compute/v2.1/servers/ad302c49-addb-464c-a15f-fa01577f90c4 => generated 1652 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:10:50.716415 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-e6eaaa26-3896-4dc0-b000-384865a5242e tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:10:50.732091 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e6eaaa26-3896-4dc0-b000-384865a5242e tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:10:50.733758 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e6eaaa26-3896-4dc0-b000-384865a5242e tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:10:50.734573 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e6eaaa26-3896-4dc0-b000-384865a5242e tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:10:50.805904 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-08a86884-4dbd-4b77-bc4e-f672651927a0 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:10:50.806736 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-08a86884-4dbd-4b77-bc4e-f672651927a0 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] [instance: cc7f1980-ecea-437f-ac71-0cdb6ec626b9] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:10:50.829235 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-e6eaaa26-3896-4dc0-b000-384865a5242e tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] [instance: ad302c49-addb-464c-a15f-fa01577f90c4] Going to try to start instance {{(pid=138744) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 22 21:10:50.833977 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-08a86884-4dbd-4b77-bc4e-f672651927a0 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:10:50.835799 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-08a86884-4dbd-4b77-bc4e-f672651927a0 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:10:50.842045 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-08a86884-4dbd-4b77-bc4e-f672651927a0 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:10:50.845567 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-08a86884-4dbd-4b77-bc4e-f672651927a0 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:10:50.846505 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-08a86884-4dbd-4b77-bc4e-f672651927a0 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:10:50.847660 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-08a86884-4dbd-4b77-bc4e-f672651927a0 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:10:50.969114 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-e6eaaa26-3896-4dc0-b000-384865a5242e tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] 10.222.0.18 "POST /compute/v2.1/servers/ad302c49-addb-464c-a15f-fa01577f90c4/action" status: 202 len: 0 microversion: 2.1 time: 0.254658 Oct 22 21:10:50.971420 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2139/4301] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 21:10:50 2022] POST /compute/v2.1/servers/ad302c49-addb-464c-a15f-fa01577f90c4/action => generated 0 bytes in 261 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 21:10:50.992177 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-73e769ba-acef-4b63-b334-e28dc8b75cf1 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:10:50.998340 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-73e769ba-acef-4b63-b334-e28dc8b75cf1 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] [instance: ad302c49-addb-464c-a15f-fa01577f90c4] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:10:51.019079 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-73e769ba-acef-4b63-b334-e28dc8b75cf1 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:10:51.022835 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-73e769ba-acef-4b63-b334-e28dc8b75cf1 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:10:51.030682 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-73e769ba-acef-4b63-b334-e28dc8b75cf1 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:10:51.034321 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-73e769ba-acef-4b63-b334-e28dc8b75cf1 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:10:51.035865 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-73e769ba-acef-4b63-b334-e28dc8b75cf1 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:10:51.037215 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-73e769ba-acef-4b63-b334-e28dc8b75cf1 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:10:52.452915 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-08a86884-4dbd-4b77-bc4e-f672651927a0 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:10:52.473492 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-08a86884-4dbd-4b77-bc4e-f672651927a0 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:10:52.481902 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-08a86884-4dbd-4b77-bc4e-f672651927a0 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:10:52.486264 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-08a86884-4dbd-4b77-bc4e-f672651927a0 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] 10.222.0.18 "GET /compute/v2.1/servers/cc7f1980-ecea-437f-ac71-0cdb6ec626b9" status: 200 len: 1808 microversion: 2.20 time: 1.683021 Oct 22 21:10:52.507370 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2163/4302] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:10:50 2022] GET /compute/v2.1/servers/cc7f1980-ecea-437f-ac71-0cdb6ec626b9 => generated 1808 bytes in 1691 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 22 21:10:52.512397 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-7d8ea86b-1450-4cbd-a635-8f977adf6a8b tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:10:52.514040 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-7d8ea86b-1450-4cbd-a635-8f977adf6a8b tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] [instance: 4d285bc1-33a9-47e0-a148-756be61c0488] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:10:52.523441 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7d8ea86b-1450-4cbd-a635-8f977adf6a8b tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:10:52.526397 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7d8ea86b-1450-4cbd-a635-8f977adf6a8b tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:10:52.527023 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7d8ea86b-1450-4cbd-a635-8f977adf6a8b tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:10:52.529452 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7d8ea86b-1450-4cbd-a635-8f977adf6a8b tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:10:52.530144 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7d8ea86b-1450-4cbd-a635-8f977adf6a8b tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:10:52.530709 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7d8ea86b-1450-4cbd-a635-8f977adf6a8b tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:10:53.097909 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-73e769ba-acef-4b63-b334-e28dc8b75cf1 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0d0bdfb04240209e4efa92f47cbb94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755501ba3e344f1aaf7ef80924bb57d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:10:53.108585 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-73e769ba-acef-4b63-b334-e28dc8b75cf1 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] 10.222.0.18 "GET /compute/v2.1/servers/ad302c49-addb-464c-a15f-fa01577f90c4" status: 200 len: 1661 microversion: 2.1 time: 2.130952 Oct 22 21:10:53.114217 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2140/4303] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:10:50 2022] GET /compute/v2.1/servers/ad302c49-addb-464c-a15f-fa01577f90c4 => generated 1661 bytes in 2140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:10:53.115224 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-7d8ea86b-1450-4cbd-a635-8f977adf6a8b tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd69c1f0203b047eeb6a9fa0a215a63c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09185bfad7944b199a490305c22ffc3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:10:53.127119 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-b1579456-0bdb-46cd-8e8c-ec1a4aa88271 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:10:53.129660 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-b1579456-0bdb-46cd-8e8c-ec1a4aa88271 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] [instance: a12803be-4bbe-44d5-bfb4-f8298113556c] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:10:53.133676 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-7d8ea86b-1450-4cbd-a635-8f977adf6a8b tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd69c1f0203b047eeb6a9fa0a215a63c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09185bfad7944b199a490305c22ffc3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:10:53.137288 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-7d8ea86b-1450-4cbd-a635-8f977adf6a8b tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd69c1f0203b047eeb6a9fa0a215a63c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09185bfad7944b199a490305c22ffc3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:10:53.139061 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-7d8ea86b-1450-4cbd-a635-8f977adf6a8b tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] 10.222.0.18 "GET /compute/v2.1/servers/4d285bc1-33a9-47e0-a148-756be61c0488" status: 200 len: 1583 microversion: 2.32 time: 0.646128 Oct 22 21:10:53.145348 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b1579456-0bdb-46cd-8e8c-ec1a4aa88271 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:10:53.146296 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b1579456-0bdb-46cd-8e8c-ec1a4aa88271 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:10:53.150265 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b1579456-0bdb-46cd-8e8c-ec1a4aa88271 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:10:53.151202 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b1579456-0bdb-46cd-8e8c-ec1a4aa88271 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:10:53.152839 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b1579456-0bdb-46cd-8e8c-ec1a4aa88271 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:10:53.153451 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b1579456-0bdb-46cd-8e8c-ec1a4aa88271 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:10:53.158749 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2164/4304] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:10:52 2022] GET /compute/v2.1/servers/4d285bc1-33a9-47e0-a148-756be61c0488 => generated 1583 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:10:53.521439 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-be8e90da-fc6c-4ed5-9318-ca6a890d0b03 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:10:53.522232 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-be8e90da-fc6c-4ed5-9318-ca6a890d0b03 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] [instance: cc7f1980-ecea-437f-ac71-0cdb6ec626b9] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:10:53.530708 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-be8e90da-fc6c-4ed5-9318-ca6a890d0b03 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:10:53.532136 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-be8e90da-fc6c-4ed5-9318-ca6a890d0b03 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:10:53.532806 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-be8e90da-fc6c-4ed5-9318-ca6a890d0b03 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:10:53.534352 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-be8e90da-fc6c-4ed5-9318-ca6a890d0b03 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:10:53.535087 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-be8e90da-fc6c-4ed5-9318-ca6a890d0b03 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:10:53.535764 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-be8e90da-fc6c-4ed5-9318-ca6a890d0b03 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:10:54.139922 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-b1579456-0bdb-46cd-8e8c-ec1a4aa88271 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3820b31a424c3a9216a6ef91fcb285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a42c3ecf474883ac652fcc8c01c9f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:10:54.169784 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-b1579456-0bdb-46cd-8e8c-ec1a4aa88271 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] 10.222.0.18 "GET /compute/v2.1/servers/a12803be-4bbe-44d5-bfb4-f8298113556c" status: 200 len: 1452 microversion: 2.1 time: 1.052717 Oct 22 21:10:54.174885 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2141/4305] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:10:53 2022] GET /compute/v2.1/servers/a12803be-4bbe-44d5-bfb4-f8298113556c => generated 1452 bytes in 1060 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:10:54.192300 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-abb02643-52ef-48e0-b509-2f0d05c4a771 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:10:54.215535 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-abb02643-52ef-48e0-b509-2f0d05c4a771 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] [instance: ad302c49-addb-464c-a15f-fa01577f90c4] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:10:54.240865 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-abb02643-52ef-48e0-b509-2f0d05c4a771 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:10:54.241380 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-abb02643-52ef-48e0-b509-2f0d05c4a771 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:10:54.245732 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-abb02643-52ef-48e0-b509-2f0d05c4a771 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:10:54.247958 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-abb02643-52ef-48e0-b509-2f0d05c4a771 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:10:54.251606 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-abb02643-52ef-48e0-b509-2f0d05c4a771 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:10:54.262455 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-abb02643-52ef-48e0-b509-2f0d05c4a771 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:10:55.157101 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-abb02643-52ef-48e0-b509-2f0d05c4a771 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0d0bdfb04240209e4efa92f47cbb94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755501ba3e344f1aaf7ef80924bb57d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:10:55.175692 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-abb02643-52ef-48e0-b509-2f0d05c4a771 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] 10.222.0.18 "GET /compute/v2.1/servers/ad302c49-addb-464c-a15f-fa01577f90c4" status: 200 len: 1661 microversion: 2.1 time: 0.998118 Oct 22 21:10:55.182528 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-be8e90da-fc6c-4ed5-9318-ca6a890d0b03 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:10:55.195191 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2142/4306] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:10:54 2022] GET /compute/v2.1/servers/ad302c49-addb-464c-a15f-fa01577f90c4 => generated 1661 bytes in 1019 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:10:55.207889 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-be8e90da-fc6c-4ed5-9318-ca6a890d0b03 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:10:55.212957 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-584f1a6a-1f3a-4ffc-b0c6-e6730cd05f43 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:10:55.214791 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-be8e90da-fc6c-4ed5-9318-ca6a890d0b03 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:10:55.219869 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-584f1a6a-1f3a-4ffc-b0c6-e6730cd05f43 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] [instance: 4d285bc1-33a9-47e0-a148-756be61c0488] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:10:55.226937 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-be8e90da-fc6c-4ed5-9318-ca6a890d0b03 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] 10.222.0.18 "GET /compute/v2.1/servers/cc7f1980-ecea-437f-ac71-0cdb6ec626b9" status: 200 len: 1808 microversion: 2.20 time: 1.705673 Oct 22 21:10:55.230552 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2165/4307] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:10:53 2022] GET /compute/v2.1/servers/cc7f1980-ecea-437f-ac71-0cdb6ec626b9 => generated 1808 bytes in 1714 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:10:55.254967 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-f1886d4f-0a7f-43e0-8b0d-28176a09514f tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:10:55.258066 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-584f1a6a-1f3a-4ffc-b0c6-e6730cd05f43 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:10:55.259735 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-f1886d4f-0a7f-43e0-8b0d-28176a09514f tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] [instance: a12803be-4bbe-44d5-bfb4-f8298113556c] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:10:55.261884 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-584f1a6a-1f3a-4ffc-b0c6-e6730cd05f43 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:10:55.262392 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-584f1a6a-1f3a-4ffc-b0c6-e6730cd05f43 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:10:55.263257 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-584f1a6a-1f3a-4ffc-b0c6-e6730cd05f43 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:10:55.263836 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-584f1a6a-1f3a-4ffc-b0c6-e6730cd05f43 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:10:55.264271 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-584f1a6a-1f3a-4ffc-b0c6-e6730cd05f43 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:10:55.278094 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f1886d4f-0a7f-43e0-8b0d-28176a09514f tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:10:55.280230 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f1886d4f-0a7f-43e0-8b0d-28176a09514f tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:10:55.283519 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f1886d4f-0a7f-43e0-8b0d-28176a09514f tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:10:55.284768 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f1886d4f-0a7f-43e0-8b0d-28176a09514f tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:10:55.285748 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f1886d4f-0a7f-43e0-8b0d-28176a09514f tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:10:55.286736 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f1886d4f-0a7f-43e0-8b0d-28176a09514f tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:10:55.615174 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-584f1a6a-1f3a-4ffc-b0c6-e6730cd05f43 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd69c1f0203b047eeb6a9fa0a215a63c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09185bfad7944b199a490305c22ffc3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:10:55.635533 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-584f1a6a-1f3a-4ffc-b0c6-e6730cd05f43 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd69c1f0203b047eeb6a9fa0a215a63c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09185bfad7944b199a490305c22ffc3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:10:55.640220 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-584f1a6a-1f3a-4ffc-b0c6-e6730cd05f43 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd69c1f0203b047eeb6a9fa0a215a63c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09185bfad7944b199a490305c22ffc3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:10:55.641822 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-584f1a6a-1f3a-4ffc-b0c6-e6730cd05f43 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] 10.222.0.18 "GET /compute/v2.1/servers/4d285bc1-33a9-47e0-a148-756be61c0488" status: 200 len: 1593 microversion: 2.32 time: 0.442722 Oct 22 21:10:55.647880 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2143/4308] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:10:55 2022] GET /compute/v2.1/servers/4d285bc1-33a9-47e0-a148-756be61c0488 => generated 1593 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:10:56.104724 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-f1886d4f-0a7f-43e0-8b0d-28176a09514f tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3820b31a424c3a9216a6ef91fcb285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a42c3ecf474883ac652fcc8c01c9f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:10:56.127004 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-f1886d4f-0a7f-43e0-8b0d-28176a09514f tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] 10.222.0.18 "GET /compute/v2.1/servers/a12803be-4bbe-44d5-bfb4-f8298113556c" status: 200 len: 1452 microversion: 2.1 time: 0.889430 Oct 22 21:10:56.129249 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2166/4309] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:10:55 2022] GET /compute/v2.1/servers/a12803be-4bbe-44d5-bfb4-f8298113556c => generated 1452 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:10:56.220792 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-a7c3d8fd-35de-4569-b8b6-8b410ed9f57e tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:10:56.221862 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-a7c3d8fd-35de-4569-b8b6-8b410ed9f57e tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] [instance: ad302c49-addb-464c-a15f-fa01577f90c4] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:10:56.236881 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a7c3d8fd-35de-4569-b8b6-8b410ed9f57e tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:10:56.237377 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a7c3d8fd-35de-4569-b8b6-8b410ed9f57e tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:10:56.237832 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a7c3d8fd-35de-4569-b8b6-8b410ed9f57e tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:10:56.238569 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a7c3d8fd-35de-4569-b8b6-8b410ed9f57e tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:10:56.239038 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a7c3d8fd-35de-4569-b8b6-8b410ed9f57e tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:10:56.239513 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a7c3d8fd-35de-4569-b8b6-8b410ed9f57e tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:10:56.260121 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-8317e6ed-b98c-421a-8a97-b2b12ad1d08a tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:10:56.260778 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-8317e6ed-b98c-421a-8a97-b2b12ad1d08a tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] [instance: cc7f1980-ecea-437f-ac71-0cdb6ec626b9] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:10:56.302980 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8317e6ed-b98c-421a-8a97-b2b12ad1d08a tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:10:56.303752 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8317e6ed-b98c-421a-8a97-b2b12ad1d08a tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:10:56.304253 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8317e6ed-b98c-421a-8a97-b2b12ad1d08a tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:10:56.309039 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8317e6ed-b98c-421a-8a97-b2b12ad1d08a tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:10:56.309647 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8317e6ed-b98c-421a-8a97-b2b12ad1d08a tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:10:56.310183 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8317e6ed-b98c-421a-8a97-b2b12ad1d08a tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:10:57.744190 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-8317e6ed-b98c-421a-8a97-b2b12ad1d08a tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:10:57.773166 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-8317e6ed-b98c-421a-8a97-b2b12ad1d08a tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:10:57.782683 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-8317e6ed-b98c-421a-8a97-b2b12ad1d08a tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:10:57.789943 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-8317e6ed-b98c-421a-8a97-b2b12ad1d08a tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] 10.222.0.18 "GET /compute/v2.1/servers/cc7f1980-ecea-437f-ac71-0cdb6ec626b9" status: 200 len: 1808 microversion: 2.20 time: 1.534078 Oct 22 21:10:57.825190 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2167/4310] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:10:56 2022] GET /compute/v2.1/servers/cc7f1980-ecea-437f-ac71-0cdb6ec626b9 => generated 1808 bytes in 1570 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:10:57.845596 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-7cbd8d4a-d3c3-470a-bde8-ea344a7fbfab tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:10:57.846476 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-7cbd8d4a-d3c3-470a-bde8-ea344a7fbfab tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] [instance: 4d285bc1-33a9-47e0-a148-756be61c0488] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:10:57.879437 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-a7c3d8fd-35de-4569-b8b6-8b410ed9f57e tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0d0bdfb04240209e4efa92f47cbb94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755501ba3e344f1aaf7ef80924bb57d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:10:57.882304 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7cbd8d4a-d3c3-470a-bde8-ea344a7fbfab tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:10:57.886125 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7cbd8d4a-d3c3-470a-bde8-ea344a7fbfab tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:10:57.886609 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7cbd8d4a-d3c3-470a-bde8-ea344a7fbfab tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:10:57.888695 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7cbd8d4a-d3c3-470a-bde8-ea344a7fbfab tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:10:57.889185 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7cbd8d4a-d3c3-470a-bde8-ea344a7fbfab tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:10:57.889638 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7cbd8d4a-d3c3-470a-bde8-ea344a7fbfab tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:10:57.900331 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-a7c3d8fd-35de-4569-b8b6-8b410ed9f57e tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] 10.222.0.18 "GET /compute/v2.1/servers/ad302c49-addb-464c-a15f-fa01577f90c4" status: 200 len: 1661 microversion: 2.1 time: 1.675587 Oct 22 21:10:57.904306 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2144/4311] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:10:56 2022] GET /compute/v2.1/servers/ad302c49-addb-464c-a15f-fa01577f90c4 => generated 1661 bytes in 1689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:10:58.830491 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-cbb564eb-80be-4d53-ad41-fe7a75bb7007 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:10:58.832618 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-cbb564eb-80be-4d53-ad41-fe7a75bb7007 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] [instance: cc7f1980-ecea-437f-ac71-0cdb6ec626b9] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:10:58.842650 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell0:SELECT=2 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:10:58.846560 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell0:SELECT=6 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:10:58.855072 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cbb564eb-80be-4d53-ad41-fe7a75bb7007 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:10:58.858800 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cbb564eb-80be-4d53-ad41-fe7a75bb7007 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:10:58.859228 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cbb564eb-80be-4d53-ad41-fe7a75bb7007 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:10:58.861274 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cbb564eb-80be-4d53-ad41-fe7a75bb7007 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:10:58.865997 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cbb564eb-80be-4d53-ad41-fe7a75bb7007 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:10:58.867281 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cbb564eb-80be-4d53-ad41-fe7a75bb7007 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:10:59.091785 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-7cbd8d4a-d3c3-470a-bde8-ea344a7fbfab tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd69c1f0203b047eeb6a9fa0a215a63c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09185bfad7944b199a490305c22ffc3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:10:59.095147 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell1:SELECT=100 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:10:59.150580 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-7cbd8d4a-d3c3-470a-bde8-ea344a7fbfab tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd69c1f0203b047eeb6a9fa0a215a63c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09185bfad7944b199a490305c22ffc3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:10:59.154329 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-7cbd8d4a-d3c3-470a-bde8-ea344a7fbfab tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd69c1f0203b047eeb6a9fa0a215a63c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09185bfad7944b199a490305c22ffc3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:10:59.164215 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-7cbd8d4a-d3c3-470a-bde8-ea344a7fbfab tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] 10.222.0.18 "GET /compute/v2.1/servers/4d285bc1-33a9-47e0-a148-756be61c0488" status: 200 len: 1661 microversion: 2.32 time: 1.334650 Oct 22 21:10:59.187329 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2168/4312] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:10:57 2022] GET /compute/v2.1/servers/4d285bc1-33a9-47e0-a148-756be61c0488 => generated 1661 bytes in 1361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:10:59.203002 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-d5f61731-0a12-4dd8-9e6d-d705670d965a tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:10:59.206216 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-d5f61731-0a12-4dd8-9e6d-d705670d965a tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] [instance: ad302c49-addb-464c-a15f-fa01577f90c4] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:10:59.214555 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d5f61731-0a12-4dd8-9e6d-d705670d965a tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:10:59.227076 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d5f61731-0a12-4dd8-9e6d-d705670d965a tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:10:59.227963 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d5f61731-0a12-4dd8-9e6d-d705670d965a tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:10:59.230118 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d5f61731-0a12-4dd8-9e6d-d705670d965a tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:10:59.231818 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d5f61731-0a12-4dd8-9e6d-d705670d965a tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:10:59.234287 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d5f61731-0a12-4dd8-9e6d-d705670d965a tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:10:59.780511 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-cbb564eb-80be-4d53-ad41-fe7a75bb7007 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:10:59.809605 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-cbb564eb-80be-4d53-ad41-fe7a75bb7007 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:10:59.823144 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-cbb564eb-80be-4d53-ad41-fe7a75bb7007 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:10:59.824795 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-cbb564eb-80be-4d53-ad41-fe7a75bb7007 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] 10.222.0.18 "GET /compute/v2.1/servers/cc7f1980-ecea-437f-ac71-0cdb6ec626b9" status: 200 len: 1808 microversion: 2.20 time: 0.999209 Oct 22 21:10:59.825606 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2145/4313] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:10:58 2022] GET /compute/v2.1/servers/cc7f1980-ecea-437f-ac71-0cdb6ec626b9 => generated 1808 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:10:59.952404 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-d5f61731-0a12-4dd8-9e6d-d705670d965a tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0d0bdfb04240209e4efa92f47cbb94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755501ba3e344f1aaf7ef80924bb57d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:10:59.977038 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-d5f61731-0a12-4dd8-9e6d-d705670d965a tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] 10.222.0.18 "GET /compute/v2.1/servers/ad302c49-addb-464c-a15f-fa01577f90c4" status: 200 len: 1665 microversion: 2.1 time: 0.783569 Oct 22 21:10:59.997227 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2169/4314] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:10:59 2022] GET /compute/v2.1/servers/ad302c49-addb-464c-a15f-fa01577f90c4 => generated 1665 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:11:00.196405 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-7301b2a8-366d-4226-9631-f2b835a12675 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:11:00.197054 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-7301b2a8-366d-4226-9631-f2b835a12675 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] [instance: 4d285bc1-33a9-47e0-a148-756be61c0488] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:11:00.222649 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7301b2a8-366d-4226-9631-f2b835a12675 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:00.223188 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7301b2a8-366d-4226-9631-f2b835a12675 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:00.225590 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7301b2a8-366d-4226-9631-f2b835a12675 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:00.229134 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7301b2a8-366d-4226-9631-f2b835a12675 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:00.233721 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7301b2a8-366d-4226-9631-f2b835a12675 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:00.236576 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7301b2a8-366d-4226-9631-f2b835a12675 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:00.858081 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-3c68342b-68cb-42d1-9d82-9b27699fd38f tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:11:00.860012 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-3c68342b-68cb-42d1-9d82-9b27699fd38f tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] [instance: cc7f1980-ecea-437f-ac71-0cdb6ec626b9] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:11:00.867800 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell0:SELECT=2 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:11:00.888420 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3c68342b-68cb-42d1-9d82-9b27699fd38f tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:00.894989 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3c68342b-68cb-42d1-9d82-9b27699fd38f tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:00.895908 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3c68342b-68cb-42d1-9d82-9b27699fd38f tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:00.899417 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3c68342b-68cb-42d1-9d82-9b27699fd38f tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:00.901762 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3c68342b-68cb-42d1-9d82-9b27699fd38f tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:00.902695 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3c68342b-68cb-42d1-9d82-9b27699fd38f tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:01.750721 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-7301b2a8-366d-4226-9631-f2b835a12675 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd69c1f0203b047eeb6a9fa0a215a63c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09185bfad7944b199a490305c22ffc3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:11:01.778372 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-7301b2a8-366d-4226-9631-f2b835a12675 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd69c1f0203b047eeb6a9fa0a215a63c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09185bfad7944b199a490305c22ffc3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:11:01.797792 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-7301b2a8-366d-4226-9631-f2b835a12675 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd69c1f0203b047eeb6a9fa0a215a63c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09185bfad7944b199a490305c22ffc3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:11:01.806861 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-7301b2a8-366d-4226-9631-f2b835a12675 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] 10.222.0.18 "GET /compute/v2.1/servers/4d285bc1-33a9-47e0-a148-756be61c0488" status: 200 len: 1661 microversion: 2.32 time: 1.611325 Oct 22 21:11:01.837877 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2146/4315] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:11:00 2022] GET /compute/v2.1/servers/4d285bc1-33a9-47e0-a148-756be61c0488 => generated 1661 bytes in 1620 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:11:02.061806 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-3c68342b-68cb-42d1-9d82-9b27699fd38f tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:11:02.089147 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-3c68342b-68cb-42d1-9d82-9b27699fd38f tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:11:02.097735 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-3c68342b-68cb-42d1-9d82-9b27699fd38f tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:11:02.102929 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-3c68342b-68cb-42d1-9d82-9b27699fd38f tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] 10.222.0.18 "GET /compute/v2.1/servers/cc7f1980-ecea-437f-ac71-0cdb6ec626b9" status: 200 len: 1808 microversion: 2.20 time: 1.245829 Oct 22 21:11:02.104490 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2170/4316] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:11:00 2022] GET /compute/v2.1/servers/cc7f1980-ecea-437f-ac71-0cdb6ec626b9 => generated 1808 bytes in 1252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:11:02.849196 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-adf31b0d-d34a-4364-89a3-ee203b52106e tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:11:02.851051 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-adf31b0d-d34a-4364-89a3-ee203b52106e tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] [instance: 4d285bc1-33a9-47e0-a148-756be61c0488] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:11:02.862280 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-adf31b0d-d34a-4364-89a3-ee203b52106e tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:02.876056 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-adf31b0d-d34a-4364-89a3-ee203b52106e tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:02.878632 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-adf31b0d-d34a-4364-89a3-ee203b52106e tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:02.880570 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-adf31b0d-d34a-4364-89a3-ee203b52106e tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:02.888439 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-adf31b0d-d34a-4364-89a3-ee203b52106e tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:02.893304 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-adf31b0d-d34a-4364-89a3-ee203b52106e tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:03.136192 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-d7926583-5347-40d2-b6e3-1bfd8c0eaef6 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:11:03.137888 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-d7926583-5347-40d2-b6e3-1bfd8c0eaef6 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] [instance: cc7f1980-ecea-437f-ac71-0cdb6ec626b9] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:11:03.147161 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d7926583-5347-40d2-b6e3-1bfd8c0eaef6 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:03.148054 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d7926583-5347-40d2-b6e3-1bfd8c0eaef6 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:03.148682 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d7926583-5347-40d2-b6e3-1bfd8c0eaef6 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:03.149578 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d7926583-5347-40d2-b6e3-1bfd8c0eaef6 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:03.150209 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d7926583-5347-40d2-b6e3-1bfd8c0eaef6 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:03.150869 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d7926583-5347-40d2-b6e3-1bfd8c0eaef6 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:03.581069 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-adf31b0d-d34a-4364-89a3-ee203b52106e tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd69c1f0203b047eeb6a9fa0a215a63c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09185bfad7944b199a490305c22ffc3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:11:03.592583 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-adf31b0d-d34a-4364-89a3-ee203b52106e tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd69c1f0203b047eeb6a9fa0a215a63c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09185bfad7944b199a490305c22ffc3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:11:03.600755 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-adf31b0d-d34a-4364-89a3-ee203b52106e tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd69c1f0203b047eeb6a9fa0a215a63c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09185bfad7944b199a490305c22ffc3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:11:03.608379 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-adf31b0d-d34a-4364-89a3-ee203b52106e tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] 10.222.0.18 "GET /compute/v2.1/servers/4d285bc1-33a9-47e0-a148-756be61c0488" status: 200 len: 1696 microversion: 2.32 time: 0.765263 Oct 22 21:11:03.609245 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2147/4317] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:11:02 2022] GET /compute/v2.1/servers/4d285bc1-33a9-47e0-a148-756be61c0488 => generated 1696 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:11:03.744349 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-d7926583-5347-40d2-b6e3-1bfd8c0eaef6 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:11:03.769975 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-d7926583-5347-40d2-b6e3-1bfd8c0eaef6 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:11:03.775056 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-d7926583-5347-40d2-b6e3-1bfd8c0eaef6 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:11:03.776378 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-d7926583-5347-40d2-b6e3-1bfd8c0eaef6 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] 10.222.0.18 "GET /compute/v2.1/servers/cc7f1980-ecea-437f-ac71-0cdb6ec626b9" status: 200 len: 1808 microversion: 2.20 time: 0.644769 Oct 22 21:11:03.784301 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2171/4318] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:11:03 2022] GET /compute/v2.1/servers/cc7f1980-ecea-437f-ac71-0cdb6ec626b9 => generated 1808 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:11:04.643949 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-4abb9c99-2eed-4e4f-bf92-00c33faa069c tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:11:04.644945 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-4abb9c99-2eed-4e4f-bf92-00c33faa069c tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] [instance: 4d285bc1-33a9-47e0-a148-756be61c0488] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:11:04.666493 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4abb9c99-2eed-4e4f-bf92-00c33faa069c tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:04.667397 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4abb9c99-2eed-4e4f-bf92-00c33faa069c tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:04.667807 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4abb9c99-2eed-4e4f-bf92-00c33faa069c tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:04.668729 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4abb9c99-2eed-4e4f-bf92-00c33faa069c tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:04.669267 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4abb9c99-2eed-4e4f-bf92-00c33faa069c tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:04.670022 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4abb9c99-2eed-4e4f-bf92-00c33faa069c tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:04.812312 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-49451585-5745-4a65-8453-136a0848af83 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:11:04.813601 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-49451585-5745-4a65-8453-136a0848af83 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] [instance: cc7f1980-ecea-437f-ac71-0cdb6ec626b9] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:11:04.827771 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-49451585-5745-4a65-8453-136a0848af83 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:04.831585 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-49451585-5745-4a65-8453-136a0848af83 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:04.832359 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-49451585-5745-4a65-8453-136a0848af83 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:04.833395 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-49451585-5745-4a65-8453-136a0848af83 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:04.835495 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-49451585-5745-4a65-8453-136a0848af83 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:04.836608 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-49451585-5745-4a65-8453-136a0848af83 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:05.255997 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-49451585-5745-4a65-8453-136a0848af83 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:11:05.273795 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-49451585-5745-4a65-8453-136a0848af83 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:11:05.275363 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-49451585-5745-4a65-8453-136a0848af83 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:11:05.285190 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-49451585-5745-4a65-8453-136a0848af83 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] 10.222.0.18 "GET /compute/v2.1/servers/cc7f1980-ecea-437f-ac71-0cdb6ec626b9" status: 200 len: 1808 microversion: 2.20 time: 0.479347 Oct 22 21:11:05.295186 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2172/4319] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:11:04 2022] GET /compute/v2.1/servers/cc7f1980-ecea-437f-ac71-0cdb6ec626b9 => generated 1808 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:11:06.064301 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-4abb9c99-2eed-4e4f-bf92-00c33faa069c tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd69c1f0203b047eeb6a9fa0a215a63c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09185bfad7944b199a490305c22ffc3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:11:06.080334 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-4abb9c99-2eed-4e4f-bf92-00c33faa069c tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd69c1f0203b047eeb6a9fa0a215a63c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09185bfad7944b199a490305c22ffc3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:11:06.082989 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-4abb9c99-2eed-4e4f-bf92-00c33faa069c tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd69c1f0203b047eeb6a9fa0a215a63c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09185bfad7944b199a490305c22ffc3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:11:06.084303 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-4abb9c99-2eed-4e4f-bf92-00c33faa069c tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] 10.222.0.18 "GET /compute/v2.1/servers/4d285bc1-33a9-47e0-a148-756be61c0488" status: 200 len: 1696 microversion: 2.32 time: 1.449258 Oct 22 21:11:06.085414 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2148/4320] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:11:04 2022] GET /compute/v2.1/servers/4d285bc1-33a9-47e0-a148-756be61c0488 => generated 1696 bytes in 1451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:11:06.322936 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-2880b999-400b-432d-8793-c14a4b5ef41a tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:11:06.323602 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-2880b999-400b-432d-8793-c14a4b5ef41a tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] [instance: cc7f1980-ecea-437f-ac71-0cdb6ec626b9] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:11:06.346051 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_api:SELECT=71 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:11:06.347817 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2880b999-400b-432d-8793-c14a4b5ef41a tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:06.351751 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2880b999-400b-432d-8793-c14a4b5ef41a tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:06.352528 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2880b999-400b-432d-8793-c14a4b5ef41a tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:06.353747 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2880b999-400b-432d-8793-c14a4b5ef41a tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:06.355038 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2880b999-400b-432d-8793-c14a4b5ef41a tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:06.356931 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2880b999-400b-432d-8793-c14a4b5ef41a tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:06.926766 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-2880b999-400b-432d-8793-c14a4b5ef41a tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:11:06.955045 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-2880b999-400b-432d-8793-c14a4b5ef41a tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:11:06.962549 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-2880b999-400b-432d-8793-c14a4b5ef41a tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:11:06.963808 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-2880b999-400b-432d-8793-c14a4b5ef41a tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] 10.222.0.18 "GET /compute/v2.1/servers/cc7f1980-ecea-437f-ac71-0cdb6ec626b9" status: 200 len: 1808 microversion: 2.20 time: 0.648459 Oct 22 21:11:06.965488 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2173/4321] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:11:06 2022] GET /compute/v2.1/servers/cc7f1980-ecea-437f-ac71-0cdb6ec626b9 => generated 1808 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:11:07.113835 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-553f5151-975b-4f6e-a74d-7dfa730e76e2 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:11:07.114546 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-553f5151-975b-4f6e-a74d-7dfa730e76e2 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] [instance: 4d285bc1-33a9-47e0-a148-756be61c0488] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:11:07.128438 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-553f5151-975b-4f6e-a74d-7dfa730e76e2 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:07.131737 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-553f5151-975b-4f6e-a74d-7dfa730e76e2 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:07.132803 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-553f5151-975b-4f6e-a74d-7dfa730e76e2 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:07.135265 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-553f5151-975b-4f6e-a74d-7dfa730e76e2 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:07.136524 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-553f5151-975b-4f6e-a74d-7dfa730e76e2 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:07.138045 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-553f5151-975b-4f6e-a74d-7dfa730e76e2 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:07.173414 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-8b4ea556-52b3-454e-a7b9-9755681c76ec req-563b3762-0a0a-4c3a-89dc-310da6fb0f11 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a12803be-4bbe-44d5-bfb4-f8298113556c", "tag": "5d0f1ea1-53be-4e61-b434-385f6b16da00"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:11:07.193026 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-8b4ea556-52b3-454e-a7b9-9755681c76ec req-563b3762-0a0a-4c3a-89dc-310da6fb0f11 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:07.193723 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-8b4ea556-52b3-454e-a7b9-9755681c76ec req-563b3762-0a0a-4c3a-89dc-310da6fb0f11 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:07.194339 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-8b4ea556-52b3-454e-a7b9-9755681c76ec req-563b3762-0a0a-4c3a-89dc-310da6fb0f11 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:07.209983 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-8b4ea556-52b3-454e-a7b9-9755681c76ec req-563b3762-0a0a-4c3a-89dc-310da6fb0f11 service nova] Creating event network-changed:5d0f1ea1-53be-4e61-b434-385f6b16da00 for instance a12803be-4bbe-44d5-bfb4-f8298113556c on nch1-master-1 Oct 22 21:11:07.216644 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-8b4ea556-52b3-454e-a7b9-9755681c76ec req-563b3762-0a0a-4c3a-89dc-310da6fb0f11 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047292 Oct 22 21:11:07.217853 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2174/4322] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:11:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:11:07.775895 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-553f5151-975b-4f6e-a74d-7dfa730e76e2 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd69c1f0203b047eeb6a9fa0a215a63c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09185bfad7944b199a490305c22ffc3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:11:07.790796 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-553f5151-975b-4f6e-a74d-7dfa730e76e2 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd69c1f0203b047eeb6a9fa0a215a63c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09185bfad7944b199a490305c22ffc3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:11:07.793006 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-553f5151-975b-4f6e-a74d-7dfa730e76e2 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd69c1f0203b047eeb6a9fa0a215a63c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09185bfad7944b199a490305c22ffc3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:11:07.800182 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-553f5151-975b-4f6e-a74d-7dfa730e76e2 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] 10.222.0.18 "GET /compute/v2.1/servers/4d285bc1-33a9-47e0-a148-756be61c0488" status: 200 len: 1743 microversion: 2.32 time: 0.686367 Oct 22 21:11:07.804185 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2149/4323] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:11:07 2022] GET /compute/v2.1/servers/4d285bc1-33a9-47e0-a148-756be61c0488 => generated 1743 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:11:07.998103 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-bf699ace-29d1-4850-b50f-b62ebaebd017 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:11:08.006631 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-bf699ace-29d1-4850-b50f-b62ebaebd017 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] [instance: cc7f1980-ecea-437f-ac71-0cdb6ec626b9] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:11:08.015168 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bf699ace-29d1-4850-b50f-b62ebaebd017 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:08.019955 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bf699ace-29d1-4850-b50f-b62ebaebd017 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:08.020699 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bf699ace-29d1-4850-b50f-b62ebaebd017 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:08.021644 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bf699ace-29d1-4850-b50f-b62ebaebd017 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:08.025310 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bf699ace-29d1-4850-b50f-b62ebaebd017 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:08.025984 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bf699ace-29d1-4850-b50f-b62ebaebd017 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:08.670624 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-bf699ace-29d1-4850-b50f-b62ebaebd017 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:11:08.702485 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-bf699ace-29d1-4850-b50f-b62ebaebd017 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:11:08.704234 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-bf699ace-29d1-4850-b50f-b62ebaebd017 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:11:08.705486 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-bf699ace-29d1-4850-b50f-b62ebaebd017 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] 10.222.0.18 "GET /compute/v2.1/servers/cc7f1980-ecea-437f-ac71-0cdb6ec626b9" status: 200 len: 1808 microversion: 2.20 time: 0.713500 Oct 22 21:11:08.706051 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2175/4324] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:11:07 2022] GET /compute/v2.1/servers/cc7f1980-ecea-437f-ac71-0cdb6ec626b9 => generated 1808 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:11:08.834750 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-23cde2dd-12d1-482e-936d-2089428aeb74 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:11:08.837529 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-23cde2dd-12d1-482e-936d-2089428aeb74 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] [instance: 4d285bc1-33a9-47e0-a148-756be61c0488] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:11:08.847743 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-23cde2dd-12d1-482e-936d-2089428aeb74 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:08.848666 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-23cde2dd-12d1-482e-936d-2089428aeb74 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:08.849355 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-23cde2dd-12d1-482e-936d-2089428aeb74 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:08.850774 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-23cde2dd-12d1-482e-936d-2089428aeb74 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:08.851560 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-23cde2dd-12d1-482e-936d-2089428aeb74 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:08.852236 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-23cde2dd-12d1-482e-936d-2089428aeb74 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:09.734044 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-92bf4fc8-3917-47df-9525-f152c99582d0 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:11:09.735408 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-92bf4fc8-3917-47df-9525-f152c99582d0 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] [instance: cc7f1980-ecea-437f-ac71-0cdb6ec626b9] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:11:09.754463 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-92bf4fc8-3917-47df-9525-f152c99582d0 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:09.755260 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-92bf4fc8-3917-47df-9525-f152c99582d0 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:09.762111 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-92bf4fc8-3917-47df-9525-f152c99582d0 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:09.763285 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-92bf4fc8-3917-47df-9525-f152c99582d0 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:09.763979 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-92bf4fc8-3917-47df-9525-f152c99582d0 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:09.764599 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-92bf4fc8-3917-47df-9525-f152c99582d0 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:10.241081 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-23cde2dd-12d1-482e-936d-2089428aeb74 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd69c1f0203b047eeb6a9fa0a215a63c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09185bfad7944b199a490305c22ffc3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:11:10.252712 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-23cde2dd-12d1-482e-936d-2089428aeb74 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd69c1f0203b047eeb6a9fa0a215a63c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09185bfad7944b199a490305c22ffc3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:11:10.254723 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-23cde2dd-12d1-482e-936d-2089428aeb74 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd69c1f0203b047eeb6a9fa0a215a63c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09185bfad7944b199a490305c22ffc3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:11:10.256585 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-23cde2dd-12d1-482e-936d-2089428aeb74 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] 10.222.0.18 "GET /compute/v2.1/servers/4d285bc1-33a9-47e0-a148-756be61c0488" status: 200 len: 1743 microversion: 2.32 time: 1.429177 Oct 22 21:11:10.257193 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2150/4325] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:11:08 2022] GET /compute/v2.1/servers/4d285bc1-33a9-47e0-a148-756be61c0488 => generated 1743 bytes in 1431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:11:10.334968 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-a8c63b57-c2ab-4002-9877-fa04da3656a9 req-b6f4682d-e261-4b30-92a7-d8209de42a12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc7f1980-ecea-437f-ac71-0cdb6ec626b9", "name": "network-vif-plugged", "status": "completed", "tag": "96502a52-b9c6-4c85-9f2b-97330250e894"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:11:10.354884 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-a8c63b57-c2ab-4002-9877-fa04da3656a9 req-b6f4682d-e261-4b30-92a7-d8209de42a12 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:10.357760 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-a8c63b57-c2ab-4002-9877-fa04da3656a9 req-b6f4682d-e261-4b30-92a7-d8209de42a12 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:10.358834 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-a8c63b57-c2ab-4002-9877-fa04da3656a9 req-b6f4682d-e261-4b30-92a7-d8209de42a12 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:10.392575 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-a8c63b57-c2ab-4002-9877-fa04da3656a9 req-b6f4682d-e261-4b30-92a7-d8209de42a12 service nova] Creating event network-vif-plugged:96502a52-b9c6-4c85-9f2b-97330250e894 for instance cc7f1980-ecea-437f-ac71-0cdb6ec626b9 on nch2-master-1 Oct 22 21:11:10.405834 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-a8c63b57-c2ab-4002-9877-fa04da3656a9 req-b6f4682d-e261-4b30-92a7-d8209de42a12 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074685 Oct 22 21:11:10.409099 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2151/4326] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:11:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:11:10.679440 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-92bf4fc8-3917-47df-9525-f152c99582d0 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:11:10.706863 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-92bf4fc8-3917-47df-9525-f152c99582d0 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:11:10.714875 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-92bf4fc8-3917-47df-9525-f152c99582d0 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:11:10.716801 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-92bf4fc8-3917-47df-9525-f152c99582d0 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] 10.222.0.18 "GET /compute/v2.1/servers/cc7f1980-ecea-437f-ac71-0cdb6ec626b9" status: 200 len: 1808 microversion: 2.20 time: 0.987145 Oct 22 21:11:10.734328 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2176/4327] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:11:09 2022] GET /compute/v2.1/servers/cc7f1980-ecea-437f-ac71-0cdb6ec626b9 => generated 1808 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:11:11.288903 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-c0cdabd5-a9a4-4513-96b9-cf01bb2b8303 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:11:11.290559 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-c0cdabd5-a9a4-4513-96b9-cf01bb2b8303 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] [instance: 4d285bc1-33a9-47e0-a148-756be61c0488] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:11:11.307321 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c0cdabd5-a9a4-4513-96b9-cf01bb2b8303 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:11.307859 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c0cdabd5-a9a4-4513-96b9-cf01bb2b8303 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:11.316524 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c0cdabd5-a9a4-4513-96b9-cf01bb2b8303 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:11.317404 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c0cdabd5-a9a4-4513-96b9-cf01bb2b8303 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:11.317897 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c0cdabd5-a9a4-4513-96b9-cf01bb2b8303 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:11.318357 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c0cdabd5-a9a4-4513-96b9-cf01bb2b8303 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:11.748038 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-05710149-33e6-4e1e-97d0-b0116f2ba269 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:11:11.750276 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-05710149-33e6-4e1e-97d0-b0116f2ba269 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] [instance: cc7f1980-ecea-437f-ac71-0cdb6ec626b9] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:11:11.771609 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-05710149-33e6-4e1e-97d0-b0116f2ba269 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:11.781271 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-05710149-33e6-4e1e-97d0-b0116f2ba269 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:11.782052 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-05710149-33e6-4e1e-97d0-b0116f2ba269 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:11.783144 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-05710149-33e6-4e1e-97d0-b0116f2ba269 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:11.783865 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-05710149-33e6-4e1e-97d0-b0116f2ba269 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:11.784508 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-05710149-33e6-4e1e-97d0-b0116f2ba269 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:12.210093 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-c0cdabd5-a9a4-4513-96b9-cf01bb2b8303 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd69c1f0203b047eeb6a9fa0a215a63c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09185bfad7944b199a490305c22ffc3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:11:12.243427 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-c0cdabd5-a9a4-4513-96b9-cf01bb2b8303 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd69c1f0203b047eeb6a9fa0a215a63c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09185bfad7944b199a490305c22ffc3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:11:12.251962 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-c0cdabd5-a9a4-4513-96b9-cf01bb2b8303 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd69c1f0203b047eeb6a9fa0a215a63c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09185bfad7944b199a490305c22ffc3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:11:12.259157 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-c0cdabd5-a9a4-4513-96b9-cf01bb2b8303 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] 10.222.0.18 "GET /compute/v2.1/servers/4d285bc1-33a9-47e0-a148-756be61c0488" status: 200 len: 1790 microversion: 2.32 time: 0.972488 Oct 22 21:11:12.261764 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2152/4328] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:11:11 2022] GET /compute/v2.1/servers/4d285bc1-33a9-47e0-a148-756be61c0488 => generated 1790 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:11:12.556504 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-05710149-33e6-4e1e-97d0-b0116f2ba269 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:11:12.574506 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-05710149-33e6-4e1e-97d0-b0116f2ba269 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:11:12.576542 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-05710149-33e6-4e1e-97d0-b0116f2ba269 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:11:12.578030 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-05710149-33e6-4e1e-97d0-b0116f2ba269 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] 10.222.0.18 "GET /compute/v2.1/servers/cc7f1980-ecea-437f-ac71-0cdb6ec626b9" status: 200 len: 1808 microversion: 2.20 time: 0.835280 Oct 22 21:11:12.579587 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2177/4329] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:11:11 2022] GET /compute/v2.1/servers/cc7f1980-ecea-437f-ac71-0cdb6ec626b9 => generated 1808 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:11:13.302030 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-7b12e0a0-1643-4d58-b49c-eb8520ff513d tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:11:13.302956 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-7b12e0a0-1643-4d58-b49c-eb8520ff513d tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] [instance: 4d285bc1-33a9-47e0-a148-756be61c0488] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:11:13.326047 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7b12e0a0-1643-4d58-b49c-eb8520ff513d tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:13.328823 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7b12e0a0-1643-4d58-b49c-eb8520ff513d tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:13.330108 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7b12e0a0-1643-4d58-b49c-eb8520ff513d tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:13.332405 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7b12e0a0-1643-4d58-b49c-eb8520ff513d tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:13.332966 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7b12e0a0-1643-4d58-b49c-eb8520ff513d tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:13.335136 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7b12e0a0-1643-4d58-b49c-eb8520ff513d tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:13.617068 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-1bb7055a-d903-4b7e-92dd-583cdff91e25 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:11:13.619839 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-1bb7055a-d903-4b7e-92dd-583cdff91e25 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] [instance: cc7f1980-ecea-437f-ac71-0cdb6ec626b9] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:11:13.649654 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1bb7055a-d903-4b7e-92dd-583cdff91e25 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:13.650440 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1bb7055a-d903-4b7e-92dd-583cdff91e25 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:13.651763 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1bb7055a-d903-4b7e-92dd-583cdff91e25 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:13.655172 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1bb7055a-d903-4b7e-92dd-583cdff91e25 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:13.658312 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1bb7055a-d903-4b7e-92dd-583cdff91e25 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:13.660487 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1bb7055a-d903-4b7e-92dd-583cdff91e25 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:14.166812 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-1bb7055a-d903-4b7e-92dd-583cdff91e25 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:11:14.181068 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-1bb7055a-d903-4b7e-92dd-583cdff91e25 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:11:14.182619 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-1bb7055a-d903-4b7e-92dd-583cdff91e25 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:11:14.183879 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-1bb7055a-d903-4b7e-92dd-583cdff91e25 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] 10.222.0.18 "GET /compute/v2.1/servers/cc7f1980-ecea-437f-ac71-0cdb6ec626b9" status: 200 len: 1808 microversion: 2.20 time: 0.578437 Oct 22 21:11:14.190322 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2178/4330] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:11:13 2022] GET /compute/v2.1/servers/cc7f1980-ecea-437f-ac71-0cdb6ec626b9 => generated 1808 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:11:14.241179 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-7b12e0a0-1643-4d58-b49c-eb8520ff513d tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd69c1f0203b047eeb6a9fa0a215a63c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09185bfad7944b199a490305c22ffc3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:11:14.253559 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:11:14.277914 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-7b12e0a0-1643-4d58-b49c-eb8520ff513d tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd69c1f0203b047eeb6a9fa0a215a63c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09185bfad7944b199a490305c22ffc3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:11:14.281002 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-7b12e0a0-1643-4d58-b49c-eb8520ff513d tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd69c1f0203b047eeb6a9fa0a215a63c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09185bfad7944b199a490305c22ffc3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:11:14.287419 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-7b12e0a0-1643-4d58-b49c-eb8520ff513d tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] 10.222.0.18 "GET /compute/v2.1/servers/4d285bc1-33a9-47e0-a148-756be61c0488" status: 200 len: 1790 microversion: 2.32 time: 0.988329 Oct 22 21:11:14.291720 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2153/4331] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:11:13 2022] GET /compute/v2.1/servers/4d285bc1-33a9-47e0-a148-756be61c0488 => generated 1790 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:11:15.225002 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-ba21afae-d9b0-4623-b8ef-d89babeaebc0 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:11:15.226250 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-ba21afae-d9b0-4623-b8ef-d89babeaebc0 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] [instance: cc7f1980-ecea-437f-ac71-0cdb6ec626b9] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:11:15.238172 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ba21afae-d9b0-4623-b8ef-d89babeaebc0 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:15.242891 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ba21afae-d9b0-4623-b8ef-d89babeaebc0 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:15.243564 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ba21afae-d9b0-4623-b8ef-d89babeaebc0 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:15.244356 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ba21afae-d9b0-4623-b8ef-d89babeaebc0 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:15.247319 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ba21afae-d9b0-4623-b8ef-d89babeaebc0 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:15.249844 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ba21afae-d9b0-4623-b8ef-d89babeaebc0 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:15.324397 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-199563e7-71b4-468a-9cf3-abcc21ff04b9 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:11:15.325551 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-199563e7-71b4-468a-9cf3-abcc21ff04b9 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] [instance: 4d285bc1-33a9-47e0-a148-756be61c0488] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:11:15.350905 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-199563e7-71b4-468a-9cf3-abcc21ff04b9 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:15.351764 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-199563e7-71b4-468a-9cf3-abcc21ff04b9 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:15.352270 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-199563e7-71b4-468a-9cf3-abcc21ff04b9 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:15.359532 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-199563e7-71b4-468a-9cf3-abcc21ff04b9 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:15.360824 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-199563e7-71b4-468a-9cf3-abcc21ff04b9 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:15.361380 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-199563e7-71b4-468a-9cf3-abcc21ff04b9 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:15.809376 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-ba21afae-d9b0-4623-b8ef-d89babeaebc0 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:11:15.827496 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-ba21afae-d9b0-4623-b8ef-d89babeaebc0 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:11:15.829641 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-ba21afae-d9b0-4623-b8ef-d89babeaebc0 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:11:15.831088 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-ba21afae-d9b0-4623-b8ef-d89babeaebc0 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] 10.222.0.18 "GET /compute/v2.1/servers/cc7f1980-ecea-437f-ac71-0cdb6ec626b9" status: 200 len: 1795 microversion: 2.20 time: 0.611049 Oct 22 21:11:15.832173 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2179/4332] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:11:15 2022] GET /compute/v2.1/servers/cc7f1980-ecea-437f-ac71-0cdb6ec626b9 => generated 1795 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:11:15.840035 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-b5b85e61-b391-402c-89eb-518f2845b74b tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a27768b2-577b-4af0-8f2f-5c9897b3e528"}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:11:15.843059 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-b5b85e61-b391-402c-89eb-518f2845b74b tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] [instance: 4dc70956-7b13-4f5b-99fe-f7ea6f320f0b] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:11:15.849854 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b5b85e61-b391-402c-89eb-518f2845b74b tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:15.851103 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b5b85e61-b391-402c-89eb-518f2845b74b tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:15.855106 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-199563e7-71b4-468a-9cf3-abcc21ff04b9 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd69c1f0203b047eeb6a9fa0a215a63c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09185bfad7944b199a490305c22ffc3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:11:15.861008 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b5b85e61-b391-402c-89eb-518f2845b74b tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:15.865102 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b5b85e61-b391-402c-89eb-518f2845b74b tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:15.870216 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b5b85e61-b391-402c-89eb-518f2845b74b tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:15.871063 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b5b85e61-b391-402c-89eb-518f2845b74b tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:15.873577 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-199563e7-71b4-468a-9cf3-abcc21ff04b9 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd69c1f0203b047eeb6a9fa0a215a63c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09185bfad7944b199a490305c22ffc3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:11:15.878210 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-199563e7-71b4-468a-9cf3-abcc21ff04b9 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd69c1f0203b047eeb6a9fa0a215a63c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09185bfad7944b199a490305c22ffc3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:11:15.879802 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-199563e7-71b4-468a-9cf3-abcc21ff04b9 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] 10.222.0.18 "GET /compute/v2.1/servers/4d285bc1-33a9-47e0-a148-756be61c0488" status: 200 len: 1837 microversion: 2.32 time: 0.560492 Oct 22 21:11:15.899600 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2154/4333] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:11:15 2022] GET /compute/v2.1/servers/4d285bc1-33a9-47e0-a148-756be61c0488 => generated 1837 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 22 21:11:16.324297 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-b5b85e61-b391-402c-89eb-518f2845b74b tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] 10.222.0.18 "POST /compute/v2.1/servers/4dc70956-7b13-4f5b-99fe-f7ea6f320f0b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.487894 Oct 22 21:11:16.327140 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2180/4334] 10.222.0.18 () {60 vars in 1323 bytes} [Sat Oct 22 21:11:15 2022] POST /compute/v2.1/servers/4dc70956-7b13-4f5b-99fe-f7ea6f320f0b/os-volume_attachments => generated 194 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:11:16.338107 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-2a0d7b21-4a74-48bb-9fd0-4acdad8c43f0 req-0cdc65d1-7453-4ed2-ac8c-40a03a76c088 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d285bc1-33a9-47e0-a148-756be61c0488", "tag": "7338f23d-cbc9-4db5-9c77-7a4f58137c5c"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:11:16.371472 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-2a0d7b21-4a74-48bb-9fd0-4acdad8c43f0 req-0cdc65d1-7453-4ed2-ac8c-40a03a76c088 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:16.374245 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-2a0d7b21-4a74-48bb-9fd0-4acdad8c43f0 req-0cdc65d1-7453-4ed2-ac8c-40a03a76c088 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:16.375103 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-2a0d7b21-4a74-48bb-9fd0-4acdad8c43f0 req-0cdc65d1-7453-4ed2-ac8c-40a03a76c088 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:16.403665 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-2a0d7b21-4a74-48bb-9fd0-4acdad8c43f0 req-0cdc65d1-7453-4ed2-ac8c-40a03a76c088 service nova] Creating event network-changed:7338f23d-cbc9-4db5-9c77-7a4f58137c5c for instance 4d285bc1-33a9-47e0-a148-756be61c0488 on nch1-master-1 Oct 22 21:11:16.431856 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-2a0d7b21-4a74-48bb-9fd0-4acdad8c43f0 req-0cdc65d1-7453-4ed2-ac8c-40a03a76c088 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102023 Oct 22 21:11:16.434921 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2181/4335] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:11:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:11:16.496299 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-da076921-c9f5-4ae8-94b2-6f7625099738 tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:11:16.498978 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-da076921-c9f5-4ae8-94b2-6f7625099738 tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:16.499781 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-da076921-c9f5-4ae8-94b2-6f7625099738 tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:16.500452 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-da076921-c9f5-4ae8-94b2-6f7625099738 tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:16.501487 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-da076921-c9f5-4ae8-94b2-6f7625099738 tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:16.502511 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-da076921-c9f5-4ae8-94b2-6f7625099738 tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:16.503164 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-da076921-c9f5-4ae8-94b2-6f7625099738 tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:16.550150 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-da076921-c9f5-4ae8-94b2-6f7625099738 tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] 10.222.0.18 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 613 microversion: 2.1 time: 0.653389 Oct 22 21:11:16.550762 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2155/4336] 10.222.0.18 () {58 vars in 1185 bytes} [Sat Oct 22 21:11:15 2022] GET /compute/v2.1/os-availability-zone/detail => generated 613 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:11:16.733765 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-3b80e7b1-12cc-4eff-a6b6-1f6350b0662f tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-570469913", "imageRef": "085e4478-6edc-4a69-8e08-f9831713eb65", "flavorRef": "452", "availability_zone": "nova:nch1-master-1", "networks": [{"uuid": "f28d8cdf-31b6-45b2-aec1-67cd3a0cd48b"}]}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:11:16.864617 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.network.neutron [None req-3b80e7b1-12cc-4eff-a6b6-1f6350b0662f tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] validate_networks() for [('f28d8cdf-31b6-45b2-aec1-67cd3a0cd48b', None, None, None, None, None)] {{(pid=138745) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 21:11:16.920894 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-adedd06b-2403-4e4b-b94a-0253fe1985c2 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:11:16.922755 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-adedd06b-2403-4e4b-b94a-0253fe1985c2 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] [instance: 4d285bc1-33a9-47e0-a148-756be61c0488] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:11:16.941336 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-adedd06b-2403-4e4b-b94a-0253fe1985c2 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:16.942711 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-adedd06b-2403-4e4b-b94a-0253fe1985c2 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:16.943426 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-adedd06b-2403-4e4b-b94a-0253fe1985c2 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:16.947029 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-adedd06b-2403-4e4b-b94a-0253fe1985c2 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:16.948323 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-adedd06b-2403-4e4b-b94a-0253fe1985c2 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:16.948856 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-adedd06b-2403-4e4b-b94a-0253fe1985c2 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:17.927425 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-adedd06b-2403-4e4b-b94a-0253fe1985c2 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd69c1f0203b047eeb6a9fa0a215a63c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09185bfad7944b199a490305c22ffc3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:11:17.968338 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-adedd06b-2403-4e4b-b94a-0253fe1985c2 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd69c1f0203b047eeb6a9fa0a215a63c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09185bfad7944b199a490305c22ffc3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:11:17.972772 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-adedd06b-2403-4e4b-b94a-0253fe1985c2 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd69c1f0203b047eeb6a9fa0a215a63c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09185bfad7944b199a490305c22ffc3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:11:17.977538 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-adedd06b-2403-4e4b-b94a-0253fe1985c2 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] 10.222.0.18 "GET /compute/v2.1/servers/4d285bc1-33a9-47e0-a148-756be61c0488" status: 200 len: 1837 microversion: 2.32 time: 1.062448 Oct 22 21:11:17.994025 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2156/4337] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:11:16 2022] GET /compute/v2.1/servers/4d285bc1-33a9-47e0-a148-756be61c0488 => generated 1837 bytes in 1080 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:11:18.609872 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-3b80e7b1-12cc-4eff-a6b6-1f6350b0662f tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Flavor limits 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 21:11:18.610936 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-3b80e7b1-12cc-4eff-a6b6-1f6350b0662f tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Image limits 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 21:11:18.611683 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-3b80e7b1-12cc-4eff-a6b6-1f6350b0662f tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Flavor pref 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 21:11:18.612647 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-3b80e7b1-12cc-4eff-a6b6-1f6350b0662f tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Image pref 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 21:11:18.613094 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-3b80e7b1-12cc-4eff-a6b6-1f6350b0662f tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 21:11:18.638132 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3b80e7b1-12cc-4eff-a6b6-1f6350b0662f tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:18.638959 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3b80e7b1-12cc-4eff-a6b6-1f6350b0662f tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:18.639673 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3b80e7b1-12cc-4eff-a6b6-1f6350b0662f tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:18.640642 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3b80e7b1-12cc-4eff-a6b6-1f6350b0662f tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:18.641311 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3b80e7b1-12cc-4eff-a6b6-1f6350b0662f tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:18.646149 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3b80e7b1-12cc-4eff-a6b6-1f6350b0662f tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:18.695419 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-3b80e7b1-12cc-4eff-a6b6-1f6350b0662f tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Getting quotas for project 5824d7d0370d430dba4f1e36acca8f8c. Resources: {'cores', 'instances', 'ram'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 21:11:18.724043 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-3b80e7b1-12cc-4eff-a6b6-1f6350b0662f tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Getting quotas for user 7c54ba11e3454a8cb83fd56bc73d812f and project 5824d7d0370d430dba4f1e36acca8f8c. Resources: {'cores', 'instances', 'ram'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 21:11:18.742918 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-3b80e7b1-12cc-4eff-a6b6-1f6350b0662f tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Going to run 1 instances... {{(pid=138745) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 21:11:18.745882 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-3b80e7b1-12cc-4eff-a6b6-1f6350b0662f tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] [instance: 44a9d1f4-4298-4e12-b656-5c1b999c9ba8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='085e4478-6edc-4a69-8e08-f9831713eb65',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138745) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 21:11:18.819049 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-3b80e7b1-12cc-4eff-a6b6-1f6350b0662f tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.090883 Oct 22 21:11:18.821123 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2182/4338] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Oct 22 21:11:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 2095 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 21:11:18.835065 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-2b5c8bba-9357-4880-b47b-e055c8663c0e tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:11:18.836372 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-2b5c8bba-9357-4880-b47b-e055c8663c0e tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] [instance: 44a9d1f4-4298-4e12-b656-5c1b999c9ba8] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:11:18.851930 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=3 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:11:19.010820 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-696d4ec1-761b-4f56-8cdd-9ddf8f93d375 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:11:19.011908 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-696d4ec1-761b-4f56-8cdd-9ddf8f93d375 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] [instance: 4d285bc1-33a9-47e0-a148-756be61c0488] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:11:19.030057 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-696d4ec1-761b-4f56-8cdd-9ddf8f93d375 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:19.030591 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-696d4ec1-761b-4f56-8cdd-9ddf8f93d375 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:19.033102 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-696d4ec1-761b-4f56-8cdd-9ddf8f93d375 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:19.036381 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-696d4ec1-761b-4f56-8cdd-9ddf8f93d375 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:19.040089 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-696d4ec1-761b-4f56-8cdd-9ddf8f93d375 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:19.040858 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-696d4ec1-761b-4f56-8cdd-9ddf8f93d375 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:19.073577 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-2b5c8bba-9357-4880-b47b-e055c8663c0e tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/44a9d1f4-4298-4e12-b656-5c1b999c9ba8" status: 200 len: 1328 microversion: 2.1 time: 0.237907 Oct 22 21:11:19.075271 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2157/4339] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:11:18 2022] GET /compute/v2.1/servers/44a9d1f4-4298-4e12-b656-5c1b999c9ba8 => generated 1328 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:11:19.506005 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-40b28b8e-8d92-48a1-b754-b49df51f7645 req-77e8573d-dfe1-4b8d-aa48-4980bc27f0da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d285bc1-33a9-47e0-a148-756be61c0488", "tag": "983bc5e7-7127-473c-8be5-1308c3a42ef9"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:11:19.544689 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-40b28b8e-8d92-48a1-b754-b49df51f7645 req-77e8573d-dfe1-4b8d-aa48-4980bc27f0da service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:19.549550 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-40b28b8e-8d92-48a1-b754-b49df51f7645 req-77e8573d-dfe1-4b8d-aa48-4980bc27f0da service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:19.551128 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-40b28b8e-8d92-48a1-b754-b49df51f7645 req-77e8573d-dfe1-4b8d-aa48-4980bc27f0da service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:19.578143 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-40b28b8e-8d92-48a1-b754-b49df51f7645 req-77e8573d-dfe1-4b8d-aa48-4980bc27f0da service nova] Creating event network-changed:983bc5e7-7127-473c-8be5-1308c3a42ef9 for instance 4d285bc1-33a9-47e0-a148-756be61c0488 on nch1-master-1 Oct 22 21:11:19.588223 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-40b28b8e-8d92-48a1-b754-b49df51f7645 req-77e8573d-dfe1-4b8d-aa48-4980bc27f0da service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082836 Oct 22 21:11:19.589431 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2158/4340] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:11:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 21:11:19.986023 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-8b3ae8c5-afac-4066-91a4-381d8bc6844d tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:11:19.989395 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-8b3ae8c5-afac-4066-91a4-381d8bc6844d tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] [instance: 4dc70956-7b13-4f5b-99fe-f7ea6f320f0b] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:11:19.996915 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8b3ae8c5-afac-4066-91a4-381d8bc6844d tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:19.997882 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8b3ae8c5-afac-4066-91a4-381d8bc6844d tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:19.998820 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8b3ae8c5-afac-4066-91a4-381d8bc6844d tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:19.999842 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8b3ae8c5-afac-4066-91a4-381d8bc6844d tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:20.000534 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8b3ae8c5-afac-4066-91a4-381d8bc6844d tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:20.001208 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8b3ae8c5-afac-4066-91a4-381d8bc6844d tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:20.048857 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.objects.instance [None req-8b3ae8c5-afac-4066-91a4-381d8bc6844d tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lazy-loading 'flavor' on Instance uuid 4dc70956-7b13-4f5b-99fe-f7ea6f320f0b {{(pid=138744) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 21:11:20.320818 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-696d4ec1-761b-4f56-8cdd-9ddf8f93d375 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd69c1f0203b047eeb6a9fa0a215a63c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09185bfad7944b199a490305c22ffc3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:11:20.358488 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-696d4ec1-761b-4f56-8cdd-9ddf8f93d375 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd69c1f0203b047eeb6a9fa0a215a63c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09185bfad7944b199a490305c22ffc3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:11:20.360053 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-696d4ec1-761b-4f56-8cdd-9ddf8f93d375 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd69c1f0203b047eeb6a9fa0a215a63c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09185bfad7944b199a490305c22ffc3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:11:20.370370 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-696d4ec1-761b-4f56-8cdd-9ddf8f93d375 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] 10.222.0.18 "GET /compute/v2.1/servers/4d285bc1-33a9-47e0-a148-756be61c0488" status: 200 len: 1858 microversion: 2.32 time: 1.363858 Oct 22 21:11:20.397771 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2183/4341] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:11:19 2022] GET /compute/v2.1/servers/4d285bc1-33a9-47e0-a148-756be61c0488 => generated 1858 bytes in 1392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:11:20.414295 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-2af0da2f-98d3-48b5-af32-8f995c241183 tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:11:20.418900 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-2af0da2f-98d3-48b5-af32-8f995c241183 tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] [instance: 44a9d1f4-4298-4e12-b656-5c1b999c9ba8] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:11:20.438412 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2af0da2f-98d3-48b5-af32-8f995c241183 tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:20.441688 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2af0da2f-98d3-48b5-af32-8f995c241183 tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:20.442522 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2af0da2f-98d3-48b5-af32-8f995c241183 tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:20.444784 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2af0da2f-98d3-48b5-af32-8f995c241183 tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:20.447214 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2af0da2f-98d3-48b5-af32-8f995c241183 tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:20.448456 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2af0da2f-98d3-48b5-af32-8f995c241183 tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:20.551802 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-8b3ae8c5-afac-4066-91a4-381d8bc6844d tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] 10.222.0.18 "POST /compute/v2.1/servers/4dc70956-7b13-4f5b-99fe-f7ea6f320f0b/action" status: 200 len: 32 microversion: 2.1 time: 0.543796 Oct 22 21:11:20.569742 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2159/4342] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 21:11:19 2022] POST /compute/v2.1/servers/4dc70956-7b13-4f5b-99fe-f7ea6f320f0b/action => generated 32 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 22 21:11:20.611790 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-e1ecbde4-d02c-499a-b0eb-a5b899edfd7d tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:11:20.613937 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-e1ecbde4-d02c-499a-b0eb-a5b899edfd7d tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] [instance: 4dc70956-7b13-4f5b-99fe-f7ea6f320f0b] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:11:20.626720 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e1ecbde4-d02c-499a-b0eb-a5b899edfd7d tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:20.631003 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e1ecbde4-d02c-499a-b0eb-a5b899edfd7d tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:20.631931 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e1ecbde4-d02c-499a-b0eb-a5b899edfd7d tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:20.633795 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e1ecbde4-d02c-499a-b0eb-a5b899edfd7d tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:20.635173 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e1ecbde4-d02c-499a-b0eb-a5b899edfd7d tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:20.637360 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e1ecbde4-d02c-499a-b0eb-a5b899edfd7d tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:20.769435 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-2af0da2f-98d3-48b5-af32-8f995c241183 tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/44a9d1f4-4298-4e12-b656-5c1b999c9ba8" status: 200 len: 1415 microversion: 2.1 time: 0.368832 Oct 22 21:11:20.785544 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2184/4343] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:11:20 2022] GET /compute/v2.1/servers/44a9d1f4-4298-4e12-b656-5c1b999c9ba8 => generated 1415 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:11:21.401576 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-b5506000-787d-484d-bd8d-3d1eda048636 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:11:21.405886 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-b5506000-787d-484d-bd8d-3d1eda048636 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] [instance: 4d285bc1-33a9-47e0-a148-756be61c0488] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:11:21.426271 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b5506000-787d-484d-bd8d-3d1eda048636 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:21.428082 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b5506000-787d-484d-bd8d-3d1eda048636 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:21.428849 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b5506000-787d-484d-bd8d-3d1eda048636 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:21.433917 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b5506000-787d-484d-bd8d-3d1eda048636 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:21.434913 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b5506000-787d-484d-bd8d-3d1eda048636 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:21.435717 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b5506000-787d-484d-bd8d-3d1eda048636 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:22.106498 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-e1ecbde4-d02c-499a-b0eb-a5b899edfd7d tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e7a09f769748629425ad36120a7fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddce0c46c75496f96f2e2dae77751dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:11:22.122895 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-e1ecbde4-d02c-499a-b0eb-a5b899edfd7d tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] 10.222.0.18 "GET /compute/v2.1/servers/4dc70956-7b13-4f5b-99fe-f7ea6f320f0b" status: 200 len: 1736 microversion: 2.1 time: 1.535825 Oct 22 21:11:22.125875 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2160/4344] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:11:20 2022] GET /compute/v2.1/servers/4dc70956-7b13-4f5b-99fe-f7ea6f320f0b => generated 1736 bytes in 1555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:11:22.135251 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-726cfd44-61ba-492c-96ea-ada0b6f67e8a tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:11:22.139139 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-726cfd44-61ba-492c-96ea-ada0b6f67e8a tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] [instance: 44a9d1f4-4298-4e12-b656-5c1b999c9ba8] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:11:22.156263 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-726cfd44-61ba-492c-96ea-ada0b6f67e8a tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:22.161602 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-726cfd44-61ba-492c-96ea-ada0b6f67e8a tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:22.162450 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-726cfd44-61ba-492c-96ea-ada0b6f67e8a tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:22.163619 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-726cfd44-61ba-492c-96ea-ada0b6f67e8a tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:22.164408 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-726cfd44-61ba-492c-96ea-ada0b6f67e8a tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:22.165012 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-726cfd44-61ba-492c-96ea-ada0b6f67e8a tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:22.380573 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-726cfd44-61ba-492c-96ea-ada0b6f67e8a tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/44a9d1f4-4298-4e12-b656-5c1b999c9ba8" status: 200 len: 1421 microversion: 2.1 time: 0.253432 Oct 22 21:11:22.382714 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2161/4345] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:11:22 2022] GET /compute/v2.1/servers/44a9d1f4-4298-4e12-b656-5c1b999c9ba8 => generated 1421 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:11:22.436716 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-b5506000-787d-484d-bd8d-3d1eda048636 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd69c1f0203b047eeb6a9fa0a215a63c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09185bfad7944b199a490305c22ffc3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:11:22.449496 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-b5506000-787d-484d-bd8d-3d1eda048636 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd69c1f0203b047eeb6a9fa0a215a63c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09185bfad7944b199a490305c22ffc3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:11:22.454414 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-b5506000-787d-484d-bd8d-3d1eda048636 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd69c1f0203b047eeb6a9fa0a215a63c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09185bfad7944b199a490305c22ffc3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:11:22.456805 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-b5506000-787d-484d-bd8d-3d1eda048636 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] 10.222.0.18 "GET /compute/v2.1/servers/4d285bc1-33a9-47e0-a148-756be61c0488" status: 200 len: 1858 microversion: 2.32 time: 1.060117 Oct 22 21:11:22.458374 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2185/4346] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:11:21 2022] GET /compute/v2.1/servers/4d285bc1-33a9-47e0-a148-756be61c0488 => generated 1858 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:11:23.149922 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-1ba77208-0a46-4c97-9a8c-0a5657ab3241 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:11:23.151693 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-1ba77208-0a46-4c97-9a8c-0a5657ab3241 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] [instance: 4dc70956-7b13-4f5b-99fe-f7ea6f320f0b] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:11:23.164244 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1ba77208-0a46-4c97-9a8c-0a5657ab3241 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:23.164944 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1ba77208-0a46-4c97-9a8c-0a5657ab3241 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:23.165213 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1ba77208-0a46-4c97-9a8c-0a5657ab3241 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:23.183952 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-34b00a11-595e-4e79-8e6c-411907726fad req-384922da-9c47-466b-bfdd-dd4370872703 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d285bc1-33a9-47e0-a148-756be61c0488", "tag": "05dfecf4-4df5-49e0-a137-d704760c00a1"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:11:23.198174 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1ba77208-0a46-4c97-9a8c-0a5657ab3241 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:23.198689 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1ba77208-0a46-4c97-9a8c-0a5657ab3241 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:23.199163 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1ba77208-0a46-4c97-9a8c-0a5657ab3241 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:23.227821 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-34b00a11-595e-4e79-8e6c-411907726fad req-384922da-9c47-466b-bfdd-dd4370872703 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:23.228776 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-34b00a11-595e-4e79-8e6c-411907726fad req-384922da-9c47-466b-bfdd-dd4370872703 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:23.230037 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-34b00a11-595e-4e79-8e6c-411907726fad req-384922da-9c47-466b-bfdd-dd4370872703 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:23.258735 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:11:23.267870 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-34b00a11-595e-4e79-8e6c-411907726fad req-384922da-9c47-466b-bfdd-dd4370872703 service nova] Creating event network-changed:05dfecf4-4df5-49e0-a137-d704760c00a1 for instance 4d285bc1-33a9-47e0-a148-756be61c0488 on nch1-master-1 Oct 22 21:11:23.302597 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-34b00a11-595e-4e79-8e6c-411907726fad req-384922da-9c47-466b-bfdd-dd4370872703 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119744 Oct 22 21:11:23.317104 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2186/4347] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:11:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:11:23.410612 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-32e6f84c-0a65-4db7-97d4-dac257bf6b16 tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:11:23.411654 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-32e6f84c-0a65-4db7-97d4-dac257bf6b16 tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] [instance: 44a9d1f4-4298-4e12-b656-5c1b999c9ba8] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:11:23.433749 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-32e6f84c-0a65-4db7-97d4-dac257bf6b16 tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:23.438451 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-32e6f84c-0a65-4db7-97d4-dac257bf6b16 tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:23.439153 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-32e6f84c-0a65-4db7-97d4-dac257bf6b16 tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:23.446863 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-32e6f84c-0a65-4db7-97d4-dac257bf6b16 tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:23.448923 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-32e6f84c-0a65-4db7-97d4-dac257bf6b16 tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:23.451956 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-32e6f84c-0a65-4db7-97d4-dac257bf6b16 tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:23.777753 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-1ba77208-0a46-4c97-9a8c-0a5657ab3241 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e7a09f769748629425ad36120a7fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddce0c46c75496f96f2e2dae77751dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:11:23.788734 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-1ba77208-0a46-4c97-9a8c-0a5657ab3241 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] 10.222.0.18 "GET /compute/v2.1/servers/4dc70956-7b13-4f5b-99fe-f7ea6f320f0b" status: 200 len: 1736 microversion: 2.1 time: 0.642731 Oct 22 21:11:23.789424 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2162/4348] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:11:23 2022] GET /compute/v2.1/servers/4dc70956-7b13-4f5b-99fe-f7ea6f320f0b => generated 1736 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:11:23.812336 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-8a564492-6ad6-49e3-9949-3b9e87326335 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:11:23.813401 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-8a564492-6ad6-49e3-9949-3b9e87326335 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] [instance: 4d285bc1-33a9-47e0-a148-756be61c0488] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:11:23.821562 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8a564492-6ad6-49e3-9949-3b9e87326335 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:23.822177 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8a564492-6ad6-49e3-9949-3b9e87326335 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:23.822735 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8a564492-6ad6-49e3-9949-3b9e87326335 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:23.823539 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8a564492-6ad6-49e3-9949-3b9e87326335 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:23.824579 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8a564492-6ad6-49e3-9949-3b9e87326335 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:23.825069 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8a564492-6ad6-49e3-9949-3b9e87326335 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:24.145835 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-32e6f84c-0a65-4db7-97d4-dac257bf6b16 tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/44a9d1f4-4298-4e12-b656-5c1b999c9ba8" status: 200 len: 1463 microversion: 2.1 time: 0.743241 Oct 22 21:11:24.146713 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2187/4349] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:11:23 2022] GET /compute/v2.1/servers/44a9d1f4-4298-4e12-b656-5c1b999c9ba8 => generated 1463 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:11:24.374182 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-8a564492-6ad6-49e3-9949-3b9e87326335 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd69c1f0203b047eeb6a9fa0a215a63c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09185bfad7944b199a490305c22ffc3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:11:24.393465 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-8a564492-6ad6-49e3-9949-3b9e87326335 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd69c1f0203b047eeb6a9fa0a215a63c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09185bfad7944b199a490305c22ffc3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:11:24.406213 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-8a564492-6ad6-49e3-9949-3b9e87326335 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd69c1f0203b047eeb6a9fa0a215a63c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09185bfad7944b199a490305c22ffc3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:11:24.407550 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-8a564492-6ad6-49e3-9949-3b9e87326335 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] 10.222.0.18 "GET /compute/v2.1/servers/4d285bc1-33a9-47e0-a148-756be61c0488" status: 200 len: 1879 microversion: 2.32 time: 0.602436 Oct 22 21:11:24.408377 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2163/4350] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:11:23 2022] GET /compute/v2.1/servers/4d285bc1-33a9-47e0-a148-756be61c0488 => generated 1879 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:11:24.820749 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-daa8a8a2-6c94-40ab-a769-522289f0427d tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:11:24.824098 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-daa8a8a2-6c94-40ab-a769-522289f0427d tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] [instance: 4dc70956-7b13-4f5b-99fe-f7ea6f320f0b] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:11:24.845992 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-daa8a8a2-6c94-40ab-a769-522289f0427d tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:24.851833 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-daa8a8a2-6c94-40ab-a769-522289f0427d tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:24.853914 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-daa8a8a2-6c94-40ab-a769-522289f0427d tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:24.856340 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-daa8a8a2-6c94-40ab-a769-522289f0427d tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:24.856949 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-daa8a8a2-6c94-40ab-a769-522289f0427d tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:24.859098 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-daa8a8a2-6c94-40ab-a769-522289f0427d tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:25.173172 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-b57d111c-bc6d-418a-98e2-13bfb8786dd2 tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:11:25.174015 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-b57d111c-bc6d-418a-98e2-13bfb8786dd2 tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] [instance: 44a9d1f4-4298-4e12-b656-5c1b999c9ba8] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:11:25.188131 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b57d111c-bc6d-418a-98e2-13bfb8786dd2 tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:25.188639 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b57d111c-bc6d-418a-98e2-13bfb8786dd2 tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:25.189088 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b57d111c-bc6d-418a-98e2-13bfb8786dd2 tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:25.189846 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b57d111c-bc6d-418a-98e2-13bfb8786dd2 tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:25.190246 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b57d111c-bc6d-418a-98e2-13bfb8786dd2 tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:25.190681 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b57d111c-bc6d-418a-98e2-13bfb8786dd2 tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:25.897018 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-daa8a8a2-6c94-40ab-a769-522289f0427d tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e7a09f769748629425ad36120a7fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddce0c46c75496f96f2e2dae77751dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:11:25.908102 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-daa8a8a2-6c94-40ab-a769-522289f0427d tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] 10.222.0.18 "GET /compute/v2.1/servers/4dc70956-7b13-4f5b-99fe-f7ea6f320f0b" status: 200 len: 1736 microversion: 2.1 time: 1.093869 Oct 22 21:11:25.908799 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2188/4351] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:11:24 2022] GET /compute/v2.1/servers/4dc70956-7b13-4f5b-99fe-f7ea6f320f0b => generated 1736 bytes in 1097 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:11:25.914189 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-28d92b4d-96d8-4fea-9685-b08361981080 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:11:25.915097 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-28d92b4d-96d8-4fea-9685-b08361981080 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] [instance: 4d285bc1-33a9-47e0-a148-756be61c0488] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:11:25.921714 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-28d92b4d-96d8-4fea-9685-b08361981080 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:25.922451 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-28d92b4d-96d8-4fea-9685-b08361981080 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:25.922967 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-28d92b4d-96d8-4fea-9685-b08361981080 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:25.923805 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-28d92b4d-96d8-4fea-9685-b08361981080 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:25.924337 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-28d92b4d-96d8-4fea-9685-b08361981080 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:25.924835 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-28d92b4d-96d8-4fea-9685-b08361981080 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:26.091225 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-b57d111c-bc6d-418a-98e2-13bfb8786dd2 tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/44a9d1f4-4298-4e12-b656-5c1b999c9ba8" status: 200 len: 1463 microversion: 2.1 time: 0.921396 Oct 22 21:11:26.091225 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2164/4352] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:11:25 2022] GET /compute/v2.1/servers/44a9d1f4-4298-4e12-b656-5c1b999c9ba8 => generated 1463 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:11:26.514754 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-28d92b4d-96d8-4fea-9685-b08361981080 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd69c1f0203b047eeb6a9fa0a215a63c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09185bfad7944b199a490305c22ffc3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:11:26.525102 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-28d92b4d-96d8-4fea-9685-b08361981080 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd69c1f0203b047eeb6a9fa0a215a63c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09185bfad7944b199a490305c22ffc3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:11:26.526558 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-28d92b4d-96d8-4fea-9685-b08361981080 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd69c1f0203b047eeb6a9fa0a215a63c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09185bfad7944b199a490305c22ffc3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:11:26.527983 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-28d92b4d-96d8-4fea-9685-b08361981080 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] 10.222.0.18 "GET /compute/v2.1/servers/4d285bc1-33a9-47e0-a148-756be61c0488" status: 200 len: 1879 microversion: 2.32 time: 0.617357 Oct 22 21:11:26.528769 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2189/4353] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:11:25 2022] GET /compute/v2.1/servers/4d285bc1-33a9-47e0-a148-756be61c0488 => generated 1879 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:11:26.635933 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-e0434317-71e2-41e5-8b9b-ec0a1ad91bc3 req-019fd3ab-9ad7-45c3-bb5c-d94b4cceecde service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d285bc1-33a9-47e0-a148-756be61c0488", "tag": "11971775-e198-4095-93a1-f9241775933a"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:11:26.658412 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell0:SELECT=2 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:11:26.661917 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-e0434317-71e2-41e5-8b9b-ec0a1ad91bc3 req-019fd3ab-9ad7-45c3-bb5c-d94b4cceecde service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:26.664641 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-e0434317-71e2-41e5-8b9b-ec0a1ad91bc3 req-019fd3ab-9ad7-45c3-bb5c-d94b4cceecde service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:26.664641 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-e0434317-71e2-41e5-8b9b-ec0a1ad91bc3 req-019fd3ab-9ad7-45c3-bb5c-d94b4cceecde service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:26.692713 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-e0434317-71e2-41e5-8b9b-ec0a1ad91bc3 req-019fd3ab-9ad7-45c3-bb5c-d94b4cceecde service nova] Creating event network-changed:11971775-e198-4095-93a1-f9241775933a for instance 4d285bc1-33a9-47e0-a148-756be61c0488 on nch1-master-1 Oct 22 21:11:26.698738 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-e0434317-71e2-41e5-8b9b-ec0a1ad91bc3 req-019fd3ab-9ad7-45c3-bb5c-d94b4cceecde service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073545 Oct 22 21:11:26.699518 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2165/4354] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:11:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:11:26.937504 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-54e2a628-a203-40e4-9520-565247ace21d tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:11:26.938153 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-54e2a628-a203-40e4-9520-565247ace21d tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] [instance: 4dc70956-7b13-4f5b-99fe-f7ea6f320f0b] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:11:26.963804 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-54e2a628-a203-40e4-9520-565247ace21d tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:26.964541 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-54e2a628-a203-40e4-9520-565247ace21d tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:26.965010 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-54e2a628-a203-40e4-9520-565247ace21d tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:26.966748 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-54e2a628-a203-40e4-9520-565247ace21d tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:26.967240 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-54e2a628-a203-40e4-9520-565247ace21d tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:26.967734 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-54e2a628-a203-40e4-9520-565247ace21d tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:27.114389 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-e54fe867-dbf6-49f1-96d3-f0d287f570b7 tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:11:27.116597 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-e54fe867-dbf6-49f1-96d3-f0d287f570b7 tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] [instance: 44a9d1f4-4298-4e12-b656-5c1b999c9ba8] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:11:27.130274 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e54fe867-dbf6-49f1-96d3-f0d287f570b7 tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:27.133868 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e54fe867-dbf6-49f1-96d3-f0d287f570b7 tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:27.136004 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e54fe867-dbf6-49f1-96d3-f0d287f570b7 tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:27.136876 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e54fe867-dbf6-49f1-96d3-f0d287f570b7 tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:27.137528 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e54fe867-dbf6-49f1-96d3-f0d287f570b7 tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:27.138659 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e54fe867-dbf6-49f1-96d3-f0d287f570b7 tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:27.614101 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-54e2a628-a203-40e4-9520-565247ace21d tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e7a09f769748629425ad36120a7fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddce0c46c75496f96f2e2dae77751dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:11:27.630210 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-54e2a628-a203-40e4-9520-565247ace21d tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] 10.222.0.18 "GET /compute/v2.1/servers/4dc70956-7b13-4f5b-99fe-f7ea6f320f0b" status: 200 len: 1736 microversion: 2.1 time: 0.697980 Oct 22 21:11:27.633235 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2190/4355] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:11:26 2022] GET /compute/v2.1/servers/4dc70956-7b13-4f5b-99fe-f7ea6f320f0b => generated 1736 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:11:27.640259 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-d181040b-7740-437d-a05a-ff0ee27c13d9 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:11:27.644367 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-d181040b-7740-437d-a05a-ff0ee27c13d9 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] [instance: 4d285bc1-33a9-47e0-a148-756be61c0488] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:11:27.654822 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-e54fe867-dbf6-49f1-96d3-f0d287f570b7 tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/44a9d1f4-4298-4e12-b656-5c1b999c9ba8" status: 200 len: 1463 microversion: 2.1 time: 0.545411 Oct 22 21:11:27.656058 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2166/4356] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:11:27 2022] GET /compute/v2.1/servers/44a9d1f4-4298-4e12-b656-5c1b999c9ba8 => generated 1463 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:11:27.663536 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d181040b-7740-437d-a05a-ff0ee27c13d9 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:27.664201 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d181040b-7740-437d-a05a-ff0ee27c13d9 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:27.665751 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d181040b-7740-437d-a05a-ff0ee27c13d9 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:27.666619 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d181040b-7740-437d-a05a-ff0ee27c13d9 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:27.668336 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d181040b-7740-437d-a05a-ff0ee27c13d9 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:27.669624 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d181040b-7740-437d-a05a-ff0ee27c13d9 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:28.085532 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-d181040b-7740-437d-a05a-ff0ee27c13d9 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd69c1f0203b047eeb6a9fa0a215a63c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09185bfad7944b199a490305c22ffc3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:11:28.105232 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-d181040b-7740-437d-a05a-ff0ee27c13d9 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd69c1f0203b047eeb6a9fa0a215a63c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09185bfad7944b199a490305c22ffc3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:11:28.106941 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-d181040b-7740-437d-a05a-ff0ee27c13d9 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd69c1f0203b047eeb6a9fa0a215a63c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09185bfad7944b199a490305c22ffc3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:11:28.108323 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-d181040b-7740-437d-a05a-ff0ee27c13d9 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] 10.222.0.18 "GET /compute/v2.1/servers/4d285bc1-33a9-47e0-a148-756be61c0488" status: 200 len: 1879 microversion: 2.32 time: 0.473746 Oct 22 21:11:28.109047 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2191/4357] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:11:27 2022] GET /compute/v2.1/servers/4d285bc1-33a9-47e0-a148-756be61c0488 => generated 1879 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:11:28.654474 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-7ed00d42-93c8-427f-845a-3c3921a13687 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:11:28.655065 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-7ed00d42-93c8-427f-845a-3c3921a13687 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] [instance: 4dc70956-7b13-4f5b-99fe-f7ea6f320f0b] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:11:28.663213 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7ed00d42-93c8-427f-845a-3c3921a13687 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:28.663760 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7ed00d42-93c8-427f-845a-3c3921a13687 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:28.664197 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7ed00d42-93c8-427f-845a-3c3921a13687 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:28.664912 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7ed00d42-93c8-427f-845a-3c3921a13687 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:28.665364 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7ed00d42-93c8-427f-845a-3c3921a13687 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:28.665927 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7ed00d42-93c8-427f-845a-3c3921a13687 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:28.680762 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-170a1f18-73b2-4930-8dec-20fd1401a5c2 tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:11:28.681777 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-170a1f18-73b2-4930-8dec-20fd1401a5c2 tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] [instance: 44a9d1f4-4298-4e12-b656-5c1b999c9ba8] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:11:28.685253 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell0:SELECT=2 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:11:28.689711 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-170a1f18-73b2-4930-8dec-20fd1401a5c2 tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:28.690678 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-170a1f18-73b2-4930-8dec-20fd1401a5c2 tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:28.691704 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-170a1f18-73b2-4930-8dec-20fd1401a5c2 tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:28.692711 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-170a1f18-73b2-4930-8dec-20fd1401a5c2 tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:28.693406 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-170a1f18-73b2-4930-8dec-20fd1401a5c2 tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:28.694077 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-170a1f18-73b2-4930-8dec-20fd1401a5c2 tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:28.735788 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell0:SELECT=6 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:11:29.063271 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell0:SELECT=2 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:11:29.116489 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-7ed00d42-93c8-427f-845a-3c3921a13687 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e7a09f769748629425ad36120a7fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddce0c46c75496f96f2e2dae77751dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:11:29.130023 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-7ed00d42-93c8-427f-845a-3c3921a13687 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] 10.222.0.18 "GET /compute/v2.1/servers/4dc70956-7b13-4f5b-99fe-f7ea6f320f0b" status: 200 len: 1736 microversion: 2.1 time: 0.479701 Oct 22 21:11:29.134639 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-170a1f18-73b2-4930-8dec-20fd1401a5c2 tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/44a9d1f4-4298-4e12-b656-5c1b999c9ba8" status: 200 len: 1463 microversion: 2.1 time: 0.457821 Oct 22 21:11:29.138411 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2167/4358] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:11:28 2022] GET /compute/v2.1/servers/4dc70956-7b13-4f5b-99fe-f7ea6f320f0b => generated 1736 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:11:29.142205 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2192/4359] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:11:28 2022] GET /compute/v2.1/servers/44a9d1f4-4298-4e12-b656-5c1b999c9ba8 => generated 1463 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:11:29.151560 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-9e794adf-4b31-47fb-acf9-7e0fe218fb07 req-793cd898-e1b1-4855-b48f-eb4c052b473b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "44a9d1f4-4298-4e12-b656-5c1b999c9ba8", "tag": "b69ad18f-bd0f-4e1d-8f0f-3900fe884ad7"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:11:29.153450 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-9c4e4854-247b-443b-a597-88ad5a3b6014 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:11:29.155832 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-9c4e4854-247b-443b-a597-88ad5a3b6014 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] [instance: 4d285bc1-33a9-47e0-a148-756be61c0488] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:11:29.165391 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9c4e4854-247b-443b-a597-88ad5a3b6014 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:29.165933 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9c4e4854-247b-443b-a597-88ad5a3b6014 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:29.166395 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9c4e4854-247b-443b-a597-88ad5a3b6014 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:29.166665 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-9e794adf-4b31-47fb-acf9-7e0fe218fb07 req-793cd898-e1b1-4855-b48f-eb4c052b473b service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:29.167123 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9c4e4854-247b-443b-a597-88ad5a3b6014 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:29.167551 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-9e794adf-4b31-47fb-acf9-7e0fe218fb07 req-793cd898-e1b1-4855-b48f-eb4c052b473b service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:29.167709 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9c4e4854-247b-443b-a597-88ad5a3b6014 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:29.168260 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-9e794adf-4b31-47fb-acf9-7e0fe218fb07 req-793cd898-e1b1-4855-b48f-eb4c052b473b service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:29.169052 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9c4e4854-247b-443b-a597-88ad5a3b6014 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:29.183611 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-9e794adf-4b31-47fb-acf9-7e0fe218fb07 req-793cd898-e1b1-4855-b48f-eb4c052b473b service nova] Creating event network-changed:b69ad18f-bd0f-4e1d-8f0f-3900fe884ad7 for instance 44a9d1f4-4298-4e12-b656-5c1b999c9ba8 on nch1-master-1 Oct 22 21:11:29.189566 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-9e794adf-4b31-47fb-acf9-7e0fe218fb07 req-793cd898-e1b1-4855-b48f-eb4c052b473b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049232 Oct 22 21:11:29.190471 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2168/4360] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:11:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:11:29.559441 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-9c4e4854-247b-443b-a597-88ad5a3b6014 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd69c1f0203b047eeb6a9fa0a215a63c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09185bfad7944b199a490305c22ffc3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:11:29.569568 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-9c4e4854-247b-443b-a597-88ad5a3b6014 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd69c1f0203b047eeb6a9fa0a215a63c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09185bfad7944b199a490305c22ffc3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:11:29.571122 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-9c4e4854-247b-443b-a597-88ad5a3b6014 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd69c1f0203b047eeb6a9fa0a215a63c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09185bfad7944b199a490305c22ffc3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:11:29.572470 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-9c4e4854-247b-443b-a597-88ad5a3b6014 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] 10.222.0.18 "GET /compute/v2.1/servers/4d285bc1-33a9-47e0-a148-756be61c0488" status: 200 len: 1879 microversion: 2.32 time: 0.429055 Oct 22 21:11:29.573426 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2193/4361] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:11:29 2022] GET /compute/v2.1/servers/4d285bc1-33a9-47e0-a148-756be61c0488 => generated 1879 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:11:30.159374 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-a14ffa3b-4958-46b2-abd2-e66bab4120fd tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:11:30.160095 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-a14ffa3b-4958-46b2-abd2-e66bab4120fd tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] [instance: 44a9d1f4-4298-4e12-b656-5c1b999c9ba8] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:11:30.161210 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-fec0e104-354d-40bb-8317-0242efb846c0 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:11:30.163074 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-fec0e104-354d-40bb-8317-0242efb846c0 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] [instance: 4dc70956-7b13-4f5b-99fe-f7ea6f320f0b] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:11:30.171173 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a14ffa3b-4958-46b2-abd2-e66bab4120fd tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:30.174015 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a14ffa3b-4958-46b2-abd2-e66bab4120fd tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:30.174680 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a14ffa3b-4958-46b2-abd2-e66bab4120fd tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:30.179303 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a14ffa3b-4958-46b2-abd2-e66bab4120fd tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:30.180029 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a14ffa3b-4958-46b2-abd2-e66bab4120fd tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:30.180687 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a14ffa3b-4958-46b2-abd2-e66bab4120fd tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:30.185190 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fec0e104-354d-40bb-8317-0242efb846c0 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:30.186249 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fec0e104-354d-40bb-8317-0242efb846c0 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:30.187045 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fec0e104-354d-40bb-8317-0242efb846c0 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:30.188163 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fec0e104-354d-40bb-8317-0242efb846c0 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:30.189334 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fec0e104-354d-40bb-8317-0242efb846c0 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:30.190485 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fec0e104-354d-40bb-8317-0242efb846c0 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:30.558447 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-fec0e104-354d-40bb-8317-0242efb846c0 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e7a09f769748629425ad36120a7fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddce0c46c75496f96f2e2dae77751dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:11:30.570037 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-fec0e104-354d-40bb-8317-0242efb846c0 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] 10.222.0.18 "GET /compute/v2.1/servers/4dc70956-7b13-4f5b-99fe-f7ea6f320f0b" status: 200 len: 1736 microversion: 2.1 time: 0.414372 Oct 22 21:11:30.571787 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2194/4362] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:11:30 2022] GET /compute/v2.1/servers/4dc70956-7b13-4f5b-99fe-f7ea6f320f0b => generated 1736 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:11:30.600748 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-ef4c43a4-74de-4fe0-931d-d678a0e4d99e tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:11:30.601731 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-ef4c43a4-74de-4fe0-931d-d678a0e4d99e tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] [instance: 4d285bc1-33a9-47e0-a148-756be61c0488] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:11:30.614198 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ef4c43a4-74de-4fe0-931d-d678a0e4d99e tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:30.615128 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ef4c43a4-74de-4fe0-931d-d678a0e4d99e tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:30.615828 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ef4c43a4-74de-4fe0-931d-d678a0e4d99e tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:30.619552 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ef4c43a4-74de-4fe0-931d-d678a0e4d99e tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:30.620357 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ef4c43a4-74de-4fe0-931d-d678a0e4d99e tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:30.662469 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ef4c43a4-74de-4fe0-931d-d678a0e4d99e tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.042s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:30.666234 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-a14ffa3b-4958-46b2-abd2-e66bab4120fd tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/44a9d1f4-4298-4e12-b656-5c1b999c9ba8" status: 200 len: 1463 microversion: 2.1 time: 0.511944 Oct 22 21:11:30.675865 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2169/4363] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:11:30 2022] GET /compute/v2.1/servers/44a9d1f4-4298-4e12-b656-5c1b999c9ba8 => generated 1463 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:11:31.027853 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-ef4c43a4-74de-4fe0-931d-d678a0e4d99e tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd69c1f0203b047eeb6a9fa0a215a63c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09185bfad7944b199a490305c22ffc3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:11:31.042337 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-ef4c43a4-74de-4fe0-931d-d678a0e4d99e tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd69c1f0203b047eeb6a9fa0a215a63c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09185bfad7944b199a490305c22ffc3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:11:31.044021 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-ef4c43a4-74de-4fe0-931d-d678a0e4d99e tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd69c1f0203b047eeb6a9fa0a215a63c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09185bfad7944b199a490305c22ffc3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:11:31.045214 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-ef4c43a4-74de-4fe0-931d-d678a0e4d99e tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] 10.222.0.18 "GET /compute/v2.1/servers/4d285bc1-33a9-47e0-a148-756be61c0488" status: 200 len: 1879 microversion: 2.32 time: 0.448871 Oct 22 21:11:31.055723 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2195/4364] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:11:30 2022] GET /compute/v2.1/servers/4d285bc1-33a9-47e0-a148-756be61c0488 => generated 1879 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 22 21:11:31.223034 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-04ab6ab0-a6d5-407d-a133-59190abce5f0 req-5b80126a-fc87-41a0-9f49-20e6fdb674b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d285bc1-33a9-47e0-a148-756be61c0488", "tag": "d9858e8d-9b0c-457e-8078-ee77f74b3e78"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:11:31.237027 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-04ab6ab0-a6d5-407d-a133-59190abce5f0 req-5b80126a-fc87-41a0-9f49-20e6fdb674b1 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:31.237610 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-04ab6ab0-a6d5-407d-a133-59190abce5f0 req-5b80126a-fc87-41a0-9f49-20e6fdb674b1 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:31.238133 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-04ab6ab0-a6d5-407d-a133-59190abce5f0 req-5b80126a-fc87-41a0-9f49-20e6fdb674b1 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:31.251395 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-04ab6ab0-a6d5-407d-a133-59190abce5f0 req-5b80126a-fc87-41a0-9f49-20e6fdb674b1 service nova] Creating event network-changed:d9858e8d-9b0c-457e-8078-ee77f74b3e78 for instance 4d285bc1-33a9-47e0-a148-756be61c0488 on nch1-master-1 Oct 22 21:11:31.257736 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-04ab6ab0-a6d5-407d-a133-59190abce5f0 req-5b80126a-fc87-41a0-9f49-20e6fdb674b1 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038505 Oct 22 21:11:31.258996 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2170/4365] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:11:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:11:31.601175 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-2a582f8e-241c-452e-bfdc-538e5954019e tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:11:31.602442 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-2a582f8e-241c-452e-bfdc-538e5954019e tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] [instance: 4dc70956-7b13-4f5b-99fe-f7ea6f320f0b] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:11:31.610674 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2a582f8e-241c-452e-bfdc-538e5954019e tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:31.611586 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2a582f8e-241c-452e-bfdc-538e5954019e tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:31.612283 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2a582f8e-241c-452e-bfdc-538e5954019e tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:31.613995 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2a582f8e-241c-452e-bfdc-538e5954019e tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:31.614727 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2a582f8e-241c-452e-bfdc-538e5954019e tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:31.615465 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2a582f8e-241c-452e-bfdc-538e5954019e tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:31.703427 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-735a4bad-fcea-4161-8483-1d0e78c2faf7 tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:11:31.704329 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-735a4bad-fcea-4161-8483-1d0e78c2faf7 tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] [instance: 44a9d1f4-4298-4e12-b656-5c1b999c9ba8] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:11:31.713565 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-735a4bad-fcea-4161-8483-1d0e78c2faf7 tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:31.714508 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-735a4bad-fcea-4161-8483-1d0e78c2faf7 tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:31.715040 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-735a4bad-fcea-4161-8483-1d0e78c2faf7 tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:31.716048 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-735a4bad-fcea-4161-8483-1d0e78c2faf7 tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:31.716792 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-735a4bad-fcea-4161-8483-1d0e78c2faf7 tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:31.717386 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-735a4bad-fcea-4161-8483-1d0e78c2faf7 tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:32.290897 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-2a582f8e-241c-452e-bfdc-538e5954019e tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e7a09f769748629425ad36120a7fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddce0c46c75496f96f2e2dae77751dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:11:32.307728 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-2a582f8e-241c-452e-bfdc-538e5954019e tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] 10.222.0.18 "GET /compute/v2.1/servers/4dc70956-7b13-4f5b-99fe-f7ea6f320f0b" status: 200 len: 1736 microversion: 2.1 time: 0.711764 Oct 22 21:11:32.319870 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2196/4366] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:11:31 2022] GET /compute/v2.1/servers/4dc70956-7b13-4f5b-99fe-f7ea6f320f0b => generated 1736 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:11:32.326688 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-904b675a-e850-4244-a871-acdf1a53f17b tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:11:32.327446 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-904b675a-e850-4244-a871-acdf1a53f17b tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] [instance: 4d285bc1-33a9-47e0-a148-756be61c0488] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:11:32.328347 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-735a4bad-fcea-4161-8483-1d0e78c2faf7 tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/44a9d1f4-4298-4e12-b656-5c1b999c9ba8" status: 200 len: 1463 microversion: 2.1 time: 0.629650 Oct 22 21:11:32.340158 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2171/4367] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:11:31 2022] GET /compute/v2.1/servers/44a9d1f4-4298-4e12-b656-5c1b999c9ba8 => generated 1463 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:11:32.348761 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-904b675a-e850-4244-a871-acdf1a53f17b tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:32.349292 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-904b675a-e850-4244-a871-acdf1a53f17b tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:32.349858 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-904b675a-e850-4244-a871-acdf1a53f17b tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:32.352080 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-904b675a-e850-4244-a871-acdf1a53f17b tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:32.352812 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-904b675a-e850-4244-a871-acdf1a53f17b tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:32.353431 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-904b675a-e850-4244-a871-acdf1a53f17b tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:32.752485 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-904b675a-e850-4244-a871-acdf1a53f17b tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd69c1f0203b047eeb6a9fa0a215a63c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09185bfad7944b199a490305c22ffc3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:11:32.762311 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-904b675a-e850-4244-a871-acdf1a53f17b tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd69c1f0203b047eeb6a9fa0a215a63c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09185bfad7944b199a490305c22ffc3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:11:32.764098 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-904b675a-e850-4244-a871-acdf1a53f17b tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd69c1f0203b047eeb6a9fa0a215a63c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09185bfad7944b199a490305c22ffc3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:11:32.765279 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-904b675a-e850-4244-a871-acdf1a53f17b tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] 10.222.0.18 "GET /compute/v2.1/servers/4d285bc1-33a9-47e0-a148-756be61c0488" status: 200 len: 1879 microversion: 2.32 time: 0.455967 Oct 22 21:11:32.766067 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2197/4368] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:11:32 2022] GET /compute/v2.1/servers/4d285bc1-33a9-47e0-a148-756be61c0488 => generated 1879 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:11:33.307397 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-60886d2c-f618-4816-b9a7-3c4a3a25b3da req-7a307de8-5a8c-4943-98fd-38a82015ca12 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d285bc1-33a9-47e0-a148-756be61c0488", "tag": "f622764f-b85f-427d-8e63-b432c6444156"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:11:33.319572 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-60886d2c-f618-4816-b9a7-3c4a3a25b3da req-7a307de8-5a8c-4943-98fd-38a82015ca12 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:33.320194 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-60886d2c-f618-4816-b9a7-3c4a3a25b3da req-7a307de8-5a8c-4943-98fd-38a82015ca12 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:33.320704 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-60886d2c-f618-4816-b9a7-3c4a3a25b3da req-7a307de8-5a8c-4943-98fd-38a82015ca12 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:33.333657 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-2d46e7ad-4a51-4fdb-badd-453d4d7ec903 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:11:33.334684 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-2d46e7ad-4a51-4fdb-badd-453d4d7ec903 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] [instance: 4dc70956-7b13-4f5b-99fe-f7ea6f320f0b] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:11:33.335085 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-60886d2c-f618-4816-b9a7-3c4a3a25b3da req-7a307de8-5a8c-4943-98fd-38a82015ca12 service nova] Creating event network-changed:f622764f-b85f-427d-8e63-b432c6444156 for instance 4d285bc1-33a9-47e0-a148-756be61c0488 on nch1-master-1 Oct 22 21:11:33.340451 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-60886d2c-f618-4816-b9a7-3c4a3a25b3da req-7a307de8-5a8c-4943-98fd-38a82015ca12 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036994 Oct 22 21:11:33.341100 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2172/4369] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:11:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:11:33.345091 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2d46e7ad-4a51-4fdb-badd-453d4d7ec903 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:33.345727 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2d46e7ad-4a51-4fdb-badd-453d4d7ec903 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:33.346148 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2d46e7ad-4a51-4fdb-badd-453d4d7ec903 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:33.347004 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2d46e7ad-4a51-4fdb-badd-453d4d7ec903 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:33.347377 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2d46e7ad-4a51-4fdb-badd-453d4d7ec903 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:33.353004 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-214571d7-c807-4802-895d-68c751516ddb tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:11:33.353708 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-214571d7-c807-4802-895d-68c751516ddb tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] [instance: 44a9d1f4-4298-4e12-b656-5c1b999c9ba8] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:11:33.356005 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2d46e7ad-4a51-4fdb-badd-453d4d7ec903 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:33.365659 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-214571d7-c807-4802-895d-68c751516ddb tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:33.366394 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-214571d7-c807-4802-895d-68c751516ddb tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:33.366998 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-214571d7-c807-4802-895d-68c751516ddb tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:33.367908 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-214571d7-c807-4802-895d-68c751516ddb tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:33.368539 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-214571d7-c807-4802-895d-68c751516ddb tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:33.370160 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-214571d7-c807-4802-895d-68c751516ddb tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:33.406723 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:11:33.754891 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-2d46e7ad-4a51-4fdb-badd-453d4d7ec903 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e7a09f769748629425ad36120a7fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddce0c46c75496f96f2e2dae77751dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:11:33.765095 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-2d46e7ad-4a51-4fdb-badd-453d4d7ec903 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] 10.222.0.18 "GET /compute/v2.1/servers/4dc70956-7b13-4f5b-99fe-f7ea6f320f0b" status: 200 len: 1736 microversion: 2.1 time: 0.435259 Oct 22 21:11:33.765666 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2198/4370] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:11:33 2022] GET /compute/v2.1/servers/4dc70956-7b13-4f5b-99fe-f7ea6f320f0b => generated 1736 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:11:33.798189 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-f141e4d3-5954-40f3-9121-4511e008836b tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:11:33.799086 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-f141e4d3-5954-40f3-9121-4511e008836b tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] [instance: 4d285bc1-33a9-47e0-a148-756be61c0488] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:11:33.802809 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-214571d7-c807-4802-895d-68c751516ddb tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/44a9d1f4-4298-4e12-b656-5c1b999c9ba8" status: 200 len: 1463 microversion: 2.1 time: 0.453443 Oct 22 21:11:33.803981 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2173/4371] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:11:33 2022] GET /compute/v2.1/servers/44a9d1f4-4298-4e12-b656-5c1b999c9ba8 => generated 1463 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:11:33.805699 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f141e4d3-5954-40f3-9121-4511e008836b tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:33.806415 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f141e4d3-5954-40f3-9121-4511e008836b tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:33.806873 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f141e4d3-5954-40f3-9121-4511e008836b tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:33.807649 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f141e4d3-5954-40f3-9121-4511e008836b tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:33.808465 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f141e4d3-5954-40f3-9121-4511e008836b tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:33.809243 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f141e4d3-5954-40f3-9121-4511e008836b tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:34.392279 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-99842f57-5a80-4d33-8846-1eab4a29f24d req-63c63e4e-4f60-43d0-9627-b6b5c1af6035 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44a9d1f4-4298-4e12-b656-5c1b999c9ba8", "name": "network-vif-plugged", "status": "completed", "tag": "b69ad18f-bd0f-4e1d-8f0f-3900fe884ad7"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:11:34.407971 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-99842f57-5a80-4d33-8846-1eab4a29f24d req-63c63e4e-4f60-43d0-9627-b6b5c1af6035 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:34.409197 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-99842f57-5a80-4d33-8846-1eab4a29f24d req-63c63e4e-4f60-43d0-9627-b6b5c1af6035 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:34.409813 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-99842f57-5a80-4d33-8846-1eab4a29f24d req-63c63e4e-4f60-43d0-9627-b6b5c1af6035 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:34.425185 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-99842f57-5a80-4d33-8846-1eab4a29f24d req-63c63e4e-4f60-43d0-9627-b6b5c1af6035 service nova] Creating event network-vif-plugged:b69ad18f-bd0f-4e1d-8f0f-3900fe884ad7 for instance 44a9d1f4-4298-4e12-b656-5c1b999c9ba8 on nch1-master-1 Oct 22 21:11:34.432594 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-99842f57-5a80-4d33-8846-1eab4a29f24d req-63c63e4e-4f60-43d0-9627-b6b5c1af6035 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044111 Oct 22 21:11:34.434001 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2174/4372] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:11:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:11:34.443070 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-f141e4d3-5954-40f3-9121-4511e008836b tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd69c1f0203b047eeb6a9fa0a215a63c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09185bfad7944b199a490305c22ffc3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:11:34.471997 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-f141e4d3-5954-40f3-9121-4511e008836b tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd69c1f0203b047eeb6a9fa0a215a63c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09185bfad7944b199a490305c22ffc3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:11:34.473651 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-f141e4d3-5954-40f3-9121-4511e008836b tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd69c1f0203b047eeb6a9fa0a215a63c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09185bfad7944b199a490305c22ffc3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:11:34.474965 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-f141e4d3-5954-40f3-9121-4511e008836b tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] 10.222.0.18 "GET /compute/v2.1/servers/4d285bc1-33a9-47e0-a148-756be61c0488" status: 200 len: 1879 microversion: 2.32 time: 0.683285 Oct 22 21:11:34.476099 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2199/4373] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:11:33 2022] GET /compute/v2.1/servers/4d285bc1-33a9-47e0-a148-756be61c0488 => generated 1879 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:11:34.790192 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-b6f7c497-f4bf-47b7-9e12-9bb3fd0644c4 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:11:34.790868 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-b6f7c497-f4bf-47b7-9e12-9bb3fd0644c4 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] [instance: 4dc70956-7b13-4f5b-99fe-f7ea6f320f0b] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:11:34.800122 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b6f7c497-f4bf-47b7-9e12-9bb3fd0644c4 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:34.800983 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b6f7c497-f4bf-47b7-9e12-9bb3fd0644c4 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:34.801667 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b6f7c497-f4bf-47b7-9e12-9bb3fd0644c4 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:34.802425 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b6f7c497-f4bf-47b7-9e12-9bb3fd0644c4 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:34.803553 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b6f7c497-f4bf-47b7-9e12-9bb3fd0644c4 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:34.803995 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b6f7c497-f4bf-47b7-9e12-9bb3fd0644c4 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:34.826634 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-c2050518-0f56-44b9-a021-71d786fde6a5 tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:11:34.827891 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-c2050518-0f56-44b9-a021-71d786fde6a5 tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] [instance: 44a9d1f4-4298-4e12-b656-5c1b999c9ba8] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:11:34.838649 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c2050518-0f56-44b9-a021-71d786fde6a5 tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:34.841342 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c2050518-0f56-44b9-a021-71d786fde6a5 tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:34.841820 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c2050518-0f56-44b9-a021-71d786fde6a5 tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:34.844193 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c2050518-0f56-44b9-a021-71d786fde6a5 tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:34.844678 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c2050518-0f56-44b9-a021-71d786fde6a5 tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:34.847860 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c2050518-0f56-44b9-a021-71d786fde6a5 tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:35.051928 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-b6f7c497-f4bf-47b7-9e12-9bb3fd0644c4 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e7a09f769748629425ad36120a7fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddce0c46c75496f96f2e2dae77751dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:11:35.062855 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-b6f7c497-f4bf-47b7-9e12-9bb3fd0644c4 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] 10.222.0.18 "GET /compute/v2.1/servers/4dc70956-7b13-4f5b-99fe-f7ea6f320f0b" status: 200 len: 1736 microversion: 2.1 time: 0.277319 Oct 22 21:11:35.065501 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2175/4374] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:11:34 2022] GET /compute/v2.1/servers/4dc70956-7b13-4f5b-99fe-f7ea6f320f0b => generated 1736 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:11:35.088815 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-c2050518-0f56-44b9-a021-71d786fde6a5 tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/44a9d1f4-4298-4e12-b656-5c1b999c9ba8" status: 200 len: 1463 microversion: 2.1 time: 0.266371 Oct 22 21:11:35.099369 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2200/4375] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:11:34 2022] GET /compute/v2.1/servers/44a9d1f4-4298-4e12-b656-5c1b999c9ba8 => generated 1463 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:11:35.360276 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-03b3b09e-825c-4295-ab1b-51105a3d43e7 req-0138f3eb-6d10-4f44-b3ea-d5b25f9e4169 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d285bc1-33a9-47e0-a148-756be61c0488", "tag": "cff21c6e-345f-4103-b49b-c2a074abbfe3"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:11:35.370187 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-03b3b09e-825c-4295-ab1b-51105a3d43e7 req-0138f3eb-6d10-4f44-b3ea-d5b25f9e4169 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:35.370663 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-03b3b09e-825c-4295-ab1b-51105a3d43e7 req-0138f3eb-6d10-4f44-b3ea-d5b25f9e4169 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:35.371159 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-03b3b09e-825c-4295-ab1b-51105a3d43e7 req-0138f3eb-6d10-4f44-b3ea-d5b25f9e4169 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:35.383059 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-03b3b09e-825c-4295-ab1b-51105a3d43e7 req-0138f3eb-6d10-4f44-b3ea-d5b25f9e4169 service nova] Creating event network-changed:cff21c6e-345f-4103-b49b-c2a074abbfe3 for instance 4d285bc1-33a9-47e0-a148-756be61c0488 on nch1-master-1 Oct 22 21:11:35.389000 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-03b3b09e-825c-4295-ab1b-51105a3d43e7 req-0138f3eb-6d10-4f44-b3ea-d5b25f9e4169 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032665 Oct 22 21:11:35.389622 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2176/4376] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:11:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:11:35.504434 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-ce83719c-8d99-423f-89df-44b3ea68abc7 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:11:35.505160 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-ce83719c-8d99-423f-89df-44b3ea68abc7 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] [instance: 4d285bc1-33a9-47e0-a148-756be61c0488] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:11:35.512046 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ce83719c-8d99-423f-89df-44b3ea68abc7 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:35.512614 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ce83719c-8d99-423f-89df-44b3ea68abc7 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:35.513070 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ce83719c-8d99-423f-89df-44b3ea68abc7 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:35.513820 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ce83719c-8d99-423f-89df-44b3ea68abc7 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:35.514275 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ce83719c-8d99-423f-89df-44b3ea68abc7 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:35.514749 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ce83719c-8d99-423f-89df-44b3ea68abc7 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:35.797065 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-ce83719c-8d99-423f-89df-44b3ea68abc7 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd69c1f0203b047eeb6a9fa0a215a63c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09185bfad7944b199a490305c22ffc3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:11:35.809505 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-ce83719c-8d99-423f-89df-44b3ea68abc7 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd69c1f0203b047eeb6a9fa0a215a63c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09185bfad7944b199a490305c22ffc3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:11:35.811414 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-ce83719c-8d99-423f-89df-44b3ea68abc7 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd69c1f0203b047eeb6a9fa0a215a63c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09185bfad7944b199a490305c22ffc3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:11:35.812815 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-ce83719c-8d99-423f-89df-44b3ea68abc7 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] 10.222.0.18 "GET /compute/v2.1/servers/4d285bc1-33a9-47e0-a148-756be61c0488" status: 200 len: 1879 microversion: 2.32 time: 0.313996 Oct 22 21:11:35.813409 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2201/4377] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:11:35 2022] GET /compute/v2.1/servers/4d285bc1-33a9-47e0-a148-756be61c0488 => generated 1879 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:11:36.091896 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-839aeafd-13d0-4318-9f22-938fc7b9208b tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:11:36.093260 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-839aeafd-13d0-4318-9f22-938fc7b9208b tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] [instance: 4dc70956-7b13-4f5b-99fe-f7ea6f320f0b] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:11:36.103397 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-839aeafd-13d0-4318-9f22-938fc7b9208b tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:36.106257 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-839aeafd-13d0-4318-9f22-938fc7b9208b tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:36.107555 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-839aeafd-13d0-4318-9f22-938fc7b9208b tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:36.108878 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-839aeafd-13d0-4318-9f22-938fc7b9208b tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:36.109889 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-839aeafd-13d0-4318-9f22-938fc7b9208b tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:36.111253 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-839aeafd-13d0-4318-9f22-938fc7b9208b tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:36.118524 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-80f7cc56-b1a9-47d8-866b-ef0a95205961 tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:11:36.119265 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-80f7cc56-b1a9-47d8-866b-ef0a95205961 tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] [instance: 44a9d1f4-4298-4e12-b656-5c1b999c9ba8] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:11:36.161921 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-80f7cc56-b1a9-47d8-866b-ef0a95205961 tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:36.162606 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-80f7cc56-b1a9-47d8-866b-ef0a95205961 tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:36.165486 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-80f7cc56-b1a9-47d8-866b-ef0a95205961 tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:36.168675 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-80f7cc56-b1a9-47d8-866b-ef0a95205961 tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:36.177902 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-80f7cc56-b1a9-47d8-866b-ef0a95205961 tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:36.179550 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-80f7cc56-b1a9-47d8-866b-ef0a95205961 tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:36.500060 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-839aeafd-13d0-4318-9f22-938fc7b9208b tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e7a09f769748629425ad36120a7fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddce0c46c75496f96f2e2dae77751dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:11:36.529758 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-839aeafd-13d0-4318-9f22-938fc7b9208b tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] 10.222.0.18 "GET /compute/v2.1/servers/4dc70956-7b13-4f5b-99fe-f7ea6f320f0b" status: 200 len: 1716 microversion: 2.1 time: 0.444784 Oct 22 21:11:36.534329 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2177/4378] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:11:36 2022] GET /compute/v2.1/servers/4dc70956-7b13-4f5b-99fe-f7ea6f320f0b => generated 1716 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:11:36.658501 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-80f7cc56-b1a9-47d8-866b-ef0a95205961 tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/44a9d1f4-4298-4e12-b656-5c1b999c9ba8" status: 200 len: 1649 microversion: 2.1 time: 0.546261 Oct 22 21:11:36.675887 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2202/4379] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:11:36 2022] GET /compute/v2.1/servers/44a9d1f4-4298-4e12-b656-5c1b999c9ba8 => generated 1649 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:11:36.683835 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-caacd327-ca21-4a29-a08f-5fd70c6d4230 tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:11:36.684949 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-caacd327-ca21-4a29-a08f-5fd70c6d4230 tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] [instance: 44a9d1f4-4298-4e12-b656-5c1b999c9ba8] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:11:36.697934 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-caacd327-ca21-4a29-a08f-5fd70c6d4230 tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:36.699328 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-caacd327-ca21-4a29-a08f-5fd70c6d4230 tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:36.700144 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-caacd327-ca21-4a29-a08f-5fd70c6d4230 tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:36.701167 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-caacd327-ca21-4a29-a08f-5fd70c6d4230 tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:36.701944 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-caacd327-ca21-4a29-a08f-5fd70c6d4230 tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:36.702583 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-caacd327-ca21-4a29-a08f-5fd70c6d4230 tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:36.730164 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-1c827d8a-a616-458a-9198-a4740c390818 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:11:36.730932 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-1c827d8a-a616-458a-9198-a4740c390818 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] [instance: 4dc70956-7b13-4f5b-99fe-f7ea6f320f0b] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:11:36.737100 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=3 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:11:36.739319 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1c827d8a-a616-458a-9198-a4740c390818 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:36.740022 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1c827d8a-a616-458a-9198-a4740c390818 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:36.740569 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1c827d8a-a616-458a-9198-a4740c390818 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:36.741482 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1c827d8a-a616-458a-9198-a4740c390818 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:36.741957 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1c827d8a-a616-458a-9198-a4740c390818 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:36.742485 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1c827d8a-a616-458a-9198-a4740c390818 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:36.767444 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell1:SELECT=100 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:11:36.859833 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.wsgi [None req-1c827d8a-a616-458a-9198-a4740c390818 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] HTTP exception thrown: Cannot 'detach_volume' instance 4dc70956-7b13-4f5b-99fe-f7ea6f320f0b while it is in vm_state rescued Oct 22 21:11:36.862038 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-1c827d8a-a616-458a-9198-a4740c390818 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Request method failure captured: Oct 22 21:11:36.862038 ncdv-master-1 devstack@n-api.service[138745]: request: DELETE /compute/v2.1/servers/4dc70956-7b13-4f5b-99fe-f7ea6f320f0b/os-volume_attachments/a27768b2-577b-4af0-8f2f-5c9897b3e528 HTTP/1.1 Oct 22 21:11:36.862038 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 21:11:36.862038 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 21:11:36.862038 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 21:11:36.862038 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 0 Oct 22 21:11:36.862038 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 21:11:36.862038 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 21:11:36.862038 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 21:11:36.862038 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 21:11:36.862038 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVFvWfSOLw3btNK4SoFxMjr8wtqLT2k4PIwSqWFeanHIvdQwXt9iIjJT1pUVLfrbgtnh-m8tchSLAY2pHDnqTUexh_EARjCC9pvXEvKIKJHHkmxJW7Q2ZJx8_vGRYvToSXq_GR6KcHjZaBQXLzQj4qX1yg72hOaDAkM7_Yx2kYaYfxok Oct 22 21:11:36.862038 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 21:11:36.862038 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 21:11:36.862038 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 21:11:36.862038 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 21:11:36.862038 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 21:11:36.862038 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 21:11:36.862038 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: dddce0c46c75496f96f2e2dae77751dc Oct 22 21:11:36.862038 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-610226422 Oct 22 21:11:36.862038 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 21:11:36.862038 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 21:11:36.862038 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_dddce0c46c75496f96f2e2dae77751dc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/dddce0c46c75496f96f2e2dae77751dc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/dddce0c46c75496f96f2e2dae77751dc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/dddce0c46c75496f96f2e2dae77751dc"}]}] Oct 22 21:11:36.862038 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-ServerRescueNegativeTestJSON-610226422 Oct 22 21:11:36.862038 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: dddce0c46c75496f96f2e2dae77751dc Oct 22 21:11:36.862038 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-610226422 Oct 22 21:11:36.862038 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-ServerRescueNegativeTestJSON-610226422-project Oct 22 21:11:36.862038 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 21:11:36.862038 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 21:11:36.862038 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: 67e7a09f769748629425ad36120a7fd6 Oct 22 21:11:36.862038 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-ServerRescueNegativeTestJSON-610226422-project Oct 22 21:11:36.862038 ncdv-master-1 devstack@n-api.service[138745]: method: > Oct 22 21:11:36.862038 ncdv-master-1 devstack@n-api.service[138745]: exception: Cannot 'detach_volume' instance 4dc70956-7b13-4f5b-99fe-f7ea6f320f0b while it is in vm_state rescued Oct 22 21:11:36.862038 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'server_id': '4dc70956-7b13-4f5b-99fe-f7ea6f320f0b', 'id': 'a27768b2-577b-4af0-8f2f-5c9897b3e528'} Oct 22 21:11:36.862038 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:11:36.862038 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:11:36.862038 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Oct 22 21:11:36.862038 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Oct 22 21:11:36.862038 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 22 21:11:36.862038 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 22 21:11:36.862038 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 22 21:11:36.862038 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 22 21:11:36.862038 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 4dc70956-7b13-4f5b-99fe-f7ea6f320f0b in vm_state rescued. Cannot detach_volume while the instance is in this state. Oct 22 21:11:36.862038 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:11:36.862038 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:11:36.862038 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:11:36.862038 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:11:36.862038 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:11:36.862038 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:11:36.862038 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:11:36.862038 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:11:36.862038 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:11:36.862038 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:11:36.862038 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Oct 22 21:11:36.862038 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 22 21:11:36.862038 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 22 21:11:36.862038 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 22 21:11:36.862038 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 4dc70956-7b13-4f5b-99fe-f7ea6f320f0b while it is in vm_state rescued Oct 22 21:11:36.862038 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:11:36.862038 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:11:36.862038 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:11:36.862038 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:11:36.866244 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:11:36.866244 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:11:36.866244 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:11:36.866244 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:11:36.866244 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 4dc70956-7b13-4f5b-99fe-f7ea6f320f0b while it is in vm_state rescued Oct 22 21:11:36.866244 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:11:36.868490 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-1c827d8a-a616-458a-9198-a4740c390818 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Returning 409 to user: Cannot 'detach_volume' instance 4dc70956-7b13-4f5b-99fe-f7ea6f320f0b while it is in vm_state rescued {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:11:36.870610 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-1c827d8a-a616-458a-9198-a4740c390818 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] 10.222.0.18 "DELETE /compute/v2.1/servers/4dc70956-7b13-4f5b-99fe-f7ea6f320f0b/os-volume_attachments/a27768b2-577b-4af0-8f2f-5c9897b3e528" status: 409 len: 152 microversion: 2.1 time: 0.146091 Oct 22 21:11:36.872138 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2203/4380] 10.222.0.18 () {58 vars in 1416 bytes} [Sat Oct 22 21:11:36 2022] DELETE /compute/v2.1/servers/4dc70956-7b13-4f5b-99fe-f7ea6f320f0b/os-volume_attachments/a27768b2-577b-4af0-8f2f-5c9897b3e528 => generated 152 bytes in 148 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 22 21:11:36.878635 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-515b4014-1aa9-45fc-a599-de4e884b52a2 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:11:36.879632 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-515b4014-1aa9-45fc-a599-de4e884b52a2 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] [instance: 4d285bc1-33a9-47e0-a148-756be61c0488] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:11:36.888893 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-515b4014-1aa9-45fc-a599-de4e884b52a2 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:36.889726 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-515b4014-1aa9-45fc-a599-de4e884b52a2 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:36.891207 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-515b4014-1aa9-45fc-a599-de4e884b52a2 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:36.892479 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-515b4014-1aa9-45fc-a599-de4e884b52a2 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:36.894458 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-515b4014-1aa9-45fc-a599-de4e884b52a2 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:36.895128 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-515b4014-1aa9-45fc-a599-de4e884b52a2 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:37.057057 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-caacd327-ca21-4a29-a08f-5fd70c6d4230 tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/44a9d1f4-4298-4e12-b656-5c1b999c9ba8" status: 200 len: 1649 microversion: 2.1 time: 0.378747 Oct 22 21:11:37.057946 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2178/4381] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:11:36 2022] GET /compute/v2.1/servers/44a9d1f4-4298-4e12-b656-5c1b999c9ba8 => generated 1649 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:11:37.063443 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-ad633f76-ad0c-404d-a461-a217e418e680 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:11:37.064247 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-ad633f76-ad0c-404d-a461-a217e418e680 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] [instance: 4dc70956-7b13-4f5b-99fe-f7ea6f320f0b] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:11:37.071722 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ad633f76-ad0c-404d-a461-a217e418e680 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:37.072561 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ad633f76-ad0c-404d-a461-a217e418e680 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:37.073229 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ad633f76-ad0c-404d-a461-a217e418e680 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:37.074251 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ad633f76-ad0c-404d-a461-a217e418e680 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:37.075029 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ad633f76-ad0c-404d-a461-a217e418e680 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:37.075585 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ad633f76-ad0c-404d-a461-a217e418e680 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:37.160292 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-ad633f76-ad0c-404d-a461-a217e418e680 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] 10.222.0.18 "POST /compute/v2.1/servers/4dc70956-7b13-4f5b-99fe-f7ea6f320f0b/action" status: 202 len: 0 microversion: 2.1 time: 0.100105 Oct 22 21:11:37.163480 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2179/4382] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 21:11:37 2022] POST /compute/v2.1/servers/4dc70956-7b13-4f5b-99fe-f7ea6f320f0b/action => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 21:11:37.172046 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-a07ad0b2-0b2b-4008-9d78-51b40a25cccb tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:11:37.173263 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-a07ad0b2-0b2b-4008-9d78-51b40a25cccb tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] [instance: 44a9d1f4-4298-4e12-b656-5c1b999c9ba8] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:11:37.183104 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a07ad0b2-0b2b-4008-9d78-51b40a25cccb tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:37.183720 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a07ad0b2-0b2b-4008-9d78-51b40a25cccb tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:37.184586 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a07ad0b2-0b2b-4008-9d78-51b40a25cccb tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:37.185370 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a07ad0b2-0b2b-4008-9d78-51b40a25cccb tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:37.185844 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a07ad0b2-0b2b-4008-9d78-51b40a25cccb tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:37.186292 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a07ad0b2-0b2b-4008-9d78-51b40a25cccb tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:37.402587 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-515b4014-1aa9-45fc-a599-de4e884b52a2 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd69c1f0203b047eeb6a9fa0a215a63c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09185bfad7944b199a490305c22ffc3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:11:37.414728 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-515b4014-1aa9-45fc-a599-de4e884b52a2 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd69c1f0203b047eeb6a9fa0a215a63c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09185bfad7944b199a490305c22ffc3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:11:37.416274 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-515b4014-1aa9-45fc-a599-de4e884b52a2 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd69c1f0203b047eeb6a9fa0a215a63c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09185bfad7944b199a490305c22ffc3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:11:37.417737 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-515b4014-1aa9-45fc-a599-de4e884b52a2 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] 10.222.0.18 "GET /compute/v2.1/servers/4d285bc1-33a9-47e0-a148-756be61c0488" status: 200 len: 1879 microversion: 2.32 time: 0.544383 Oct 22 21:11:37.419116 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2204/4383] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:11:36 2022] GET /compute/v2.1/servers/4d285bc1-33a9-47e0-a148-756be61c0488 => generated 1879 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:11:37.424458 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-b7ccfc6d-0e55-4db4-b985-3a90c841546b tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:11:37.425306 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-b7ccfc6d-0e55-4db4-b985-3a90c841546b tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] [instance: 4dc70956-7b13-4f5b-99fe-f7ea6f320f0b] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:11:37.433801 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b7ccfc6d-0e55-4db4-b985-3a90c841546b tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:37.434609 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b7ccfc6d-0e55-4db4-b985-3a90c841546b tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:37.436672 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b7ccfc6d-0e55-4db4-b985-3a90c841546b tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:37.437675 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b7ccfc6d-0e55-4db4-b985-3a90c841546b tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:37.438315 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b7ccfc6d-0e55-4db4-b985-3a90c841546b tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:37.439213 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b7ccfc6d-0e55-4db4-b985-3a90c841546b tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:37.694949 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-a07ad0b2-0b2b-4008-9d78-51b40a25cccb tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/44a9d1f4-4298-4e12-b656-5c1b999c9ba8" status: 200 len: 1649 microversion: 2.1 time: 0.529587 Oct 22 21:11:37.697943 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2180/4384] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:11:37 2022] GET /compute/v2.1/servers/44a9d1f4-4298-4e12-b656-5c1b999c9ba8 => generated 1649 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:11:37.790831 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-b7ccfc6d-0e55-4db4-b985-3a90c841546b tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e7a09f769748629425ad36120a7fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddce0c46c75496f96f2e2dae77751dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:11:37.805954 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-b7ccfc6d-0e55-4db4-b985-3a90c841546b tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] 10.222.0.18 "GET /compute/v2.1/servers/4dc70956-7b13-4f5b-99fe-f7ea6f320f0b" status: 200 len: 1724 microversion: 2.1 time: 0.382766 Oct 22 21:11:37.819121 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2205/4385] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:11:37 2022] GET /compute/v2.1/servers/4dc70956-7b13-4f5b-99fe-f7ea6f320f0b => generated 1724 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:11:37.858209 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-9322bea3-d0ab-4424-9bec-518706a4a97d tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-6643147", "imageRef": "085e4478-6edc-4a69-8e08-f9831713eb65", "flavorRef": "452", "availability_zone": "nova:nch2-master-1", "networks": [{"uuid": "f28d8cdf-31b6-45b2-aec1-67cd3a0cd48b"}]}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:11:37.926998 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.network.neutron [None req-9322bea3-d0ab-4424-9bec-518706a4a97d tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] validate_networks() for [('f28d8cdf-31b6-45b2-aec1-67cd3a0cd48b', None, None, None, None, None)] {{(pid=138744) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 21:11:38.445131 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-9b9168f4-2f5c-47d2-9dd3-9fd4b8a5d71e tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:11:38.445770 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-9b9168f4-2f5c-47d2-9dd3-9fd4b8a5d71e tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] [instance: 4d285bc1-33a9-47e0-a148-756be61c0488] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:11:38.453004 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9b9168f4-2f5c-47d2-9dd3-9fd4b8a5d71e tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:38.453506 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9b9168f4-2f5c-47d2-9dd3-9fd4b8a5d71e tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:38.454442 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9b9168f4-2f5c-47d2-9dd3-9fd4b8a5d71e tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:38.455427 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9b9168f4-2f5c-47d2-9dd3-9fd4b8a5d71e tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:38.456097 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9b9168f4-2f5c-47d2-9dd3-9fd4b8a5d71e tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:38.456729 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9b9168f4-2f5c-47d2-9dd3-9fd4b8a5d71e tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:39.187724 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-9b9168f4-2f5c-47d2-9dd3-9fd4b8a5d71e tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd69c1f0203b047eeb6a9fa0a215a63c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09185bfad7944b199a490305c22ffc3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:11:39.205873 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-9b9168f4-2f5c-47d2-9dd3-9fd4b8a5d71e tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd69c1f0203b047eeb6a9fa0a215a63c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09185bfad7944b199a490305c22ffc3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:11:39.209488 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-9b9168f4-2f5c-47d2-9dd3-9fd4b8a5d71e tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd69c1f0203b047eeb6a9fa0a215a63c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09185bfad7944b199a490305c22ffc3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:11:39.210757 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-9b9168f4-2f5c-47d2-9dd3-9fd4b8a5d71e tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] 10.222.0.18 "GET /compute/v2.1/servers/4d285bc1-33a9-47e0-a148-756be61c0488" status: 200 len: 1879 microversion: 2.32 time: 0.769567 Oct 22 21:11:39.228315 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2206/4386] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:11:38 2022] GET /compute/v2.1/servers/4d285bc1-33a9-47e0-a148-756be61c0488 => generated 1879 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 22 21:11:39.240072 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-5bf0f3f8-2bda-4b34-a9f8-cec2b3fc830d tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:11:39.240956 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-5bf0f3f8-2bda-4b34-a9f8-cec2b3fc830d tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] [instance: 4dc70956-7b13-4f5b-99fe-f7ea6f320f0b] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:11:39.248872 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5bf0f3f8-2bda-4b34-a9f8-cec2b3fc830d tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:39.249384 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5bf0f3f8-2bda-4b34-a9f8-cec2b3fc830d tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:39.250051 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5bf0f3f8-2bda-4b34-a9f8-cec2b3fc830d tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:39.250964 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5bf0f3f8-2bda-4b34-a9f8-cec2b3fc830d tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:39.251461 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5bf0f3f8-2bda-4b34-a9f8-cec2b3fc830d tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:39.251906 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5bf0f3f8-2bda-4b34-a9f8-cec2b3fc830d tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:39.597893 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-9322bea3-d0ab-4424-9bec-518706a4a97d tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Flavor limits 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 21:11:39.598337 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-9322bea3-d0ab-4424-9bec-518706a4a97d tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Image limits 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 21:11:39.599470 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-9322bea3-d0ab-4424-9bec-518706a4a97d tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Flavor pref 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 21:11:39.599906 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-9322bea3-d0ab-4424-9bec-518706a4a97d tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Image pref 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 21:11:39.600663 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-9322bea3-d0ab-4424-9bec-518706a4a97d tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 21:11:39.613793 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9322bea3-d0ab-4424-9bec-518706a4a97d tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:39.614303 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9322bea3-d0ab-4424-9bec-518706a4a97d tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:39.614991 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9322bea3-d0ab-4424-9bec-518706a4a97d tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:39.616107 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9322bea3-d0ab-4424-9bec-518706a4a97d tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:39.616837 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9322bea3-d0ab-4424-9bec-518706a4a97d tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:39.617421 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9322bea3-d0ab-4424-9bec-518706a4a97d tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:39.641530 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-9322bea3-d0ab-4424-9bec-518706a4a97d tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Getting quotas for project 5824d7d0370d430dba4f1e36acca8f8c. Resources: {'cores', 'instances', 'ram'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 21:11:39.648855 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-9322bea3-d0ab-4424-9bec-518706a4a97d tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Getting quotas for user 7c54ba11e3454a8cb83fd56bc73d812f and project 5824d7d0370d430dba4f1e36acca8f8c. Resources: {'cores', 'instances', 'ram'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 21:11:39.667374 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-9322bea3-d0ab-4424-9bec-518706a4a97d tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Going to run 1 instances... {{(pid=138744) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 21:11:39.671036 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-9322bea3-d0ab-4424-9bec-518706a4a97d tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] [instance: c7c717a4-9925-4455-9963-ffdcae9f06f4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='085e4478-6edc-4a69-8e08-f9831713eb65',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138744) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 21:11:39.699150 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-5bf0f3f8-2bda-4b34-a9f8-cec2b3fc830d tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e7a09f769748629425ad36120a7fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddce0c46c75496f96f2e2dae77751dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:11:39.713952 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-5bf0f3f8-2bda-4b34-a9f8-cec2b3fc830d tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] 10.222.0.18 "GET /compute/v2.1/servers/4dc70956-7b13-4f5b-99fe-f7ea6f320f0b" status: 200 len: 1724 microversion: 2.1 time: 0.483808 Oct 22 21:11:39.715258 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2207/4387] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:11:39 2022] GET /compute/v2.1/servers/4dc70956-7b13-4f5b-99fe-f7ea6f320f0b => generated 1724 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:11:39.734367 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-9322bea3-d0ab-4424-9bec-518706a4a97d tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.880451 Oct 22 21:11:39.735372 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2181/4388] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Oct 22 21:11:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 1882 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 21:11:39.748850 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-1325edf9-e685-4bca-8484-5b3197f5e28e tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:11:39.760869 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-1325edf9-e685-4bca-8484-5b3197f5e28e tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] [instance: c7c717a4-9925-4455-9963-ffdcae9f06f4] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:11:39.889356 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-1325edf9-e685-4bca-8484-5b3197f5e28e tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/c7c717a4-9925-4455-9963-ffdcae9f06f4" status: 200 len: 1326 microversion: 2.1 time: 0.144466 Oct 22 21:11:39.890296 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2208/4389] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:11:39 2022] GET /compute/v2.1/servers/c7c717a4-9925-4455-9963-ffdcae9f06f4 => generated 1326 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:11:40.245676 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-ba52d684-ecb4-4945-85fc-de8afa03ce35 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:11:40.247106 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-ba52d684-ecb4-4945-85fc-de8afa03ce35 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] [instance: 4d285bc1-33a9-47e0-a148-756be61c0488] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:11:40.254449 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ba52d684-ecb4-4945-85fc-de8afa03ce35 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:40.254940 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ba52d684-ecb4-4945-85fc-de8afa03ce35 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:40.255494 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ba52d684-ecb4-4945-85fc-de8afa03ce35 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:40.257614 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ba52d684-ecb4-4945-85fc-de8afa03ce35 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:40.258502 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ba52d684-ecb4-4945-85fc-de8afa03ce35 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:40.258881 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ba52d684-ecb4-4945-85fc-de8afa03ce35 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:40.685071 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-ba52d684-ecb4-4945-85fc-de8afa03ce35 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd69c1f0203b047eeb6a9fa0a215a63c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09185bfad7944b199a490305c22ffc3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:11:40.697913 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-ba52d684-ecb4-4945-85fc-de8afa03ce35 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd69c1f0203b047eeb6a9fa0a215a63c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09185bfad7944b199a490305c22ffc3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:11:40.699583 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-ba52d684-ecb4-4945-85fc-de8afa03ce35 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd69c1f0203b047eeb6a9fa0a215a63c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09185bfad7944b199a490305c22ffc3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:11:40.700988 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-ba52d684-ecb4-4945-85fc-de8afa03ce35 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] 10.222.0.18 "GET /compute/v2.1/servers/4d285bc1-33a9-47e0-a148-756be61c0488" status: 200 len: 1879 microversion: 2.32 time: 0.460407 Oct 22 21:11:40.713508 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2182/4390] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:11:40 2022] GET /compute/v2.1/servers/4d285bc1-33a9-47e0-a148-756be61c0488 => generated 1879 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:11:40.741118 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-5444e2f5-6f1e-45da-b001-98a8ce1970db tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:11:40.741873 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-5444e2f5-6f1e-45da-b001-98a8ce1970db tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] [instance: 4dc70956-7b13-4f5b-99fe-f7ea6f320f0b] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:11:40.751956 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5444e2f5-6f1e-45da-b001-98a8ce1970db tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:40.752571 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5444e2f5-6f1e-45da-b001-98a8ce1970db tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:40.753106 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5444e2f5-6f1e-45da-b001-98a8ce1970db tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:40.753926 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5444e2f5-6f1e-45da-b001-98a8ce1970db tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:40.754475 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5444e2f5-6f1e-45da-b001-98a8ce1970db tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:40.755039 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5444e2f5-6f1e-45da-b001-98a8ce1970db tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:40.915639 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-31097cab-7715-4784-95ef-435077b8bea0 tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:11:40.916836 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-31097cab-7715-4784-95ef-435077b8bea0 tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] [instance: c7c717a4-9925-4455-9963-ffdcae9f06f4] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:11:40.925299 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-31097cab-7715-4784-95ef-435077b8bea0 tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:40.926127 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-31097cab-7715-4784-95ef-435077b8bea0 tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:40.926723 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-31097cab-7715-4784-95ef-435077b8bea0 tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:40.927656 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-31097cab-7715-4784-95ef-435077b8bea0 tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:40.928400 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-31097cab-7715-4784-95ef-435077b8bea0 tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:40.928992 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-31097cab-7715-4784-95ef-435077b8bea0 tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:41.148857 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-31097cab-7715-4784-95ef-435077b8bea0 tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/c7c717a4-9925-4455-9963-ffdcae9f06f4" status: 200 len: 1413 microversion: 2.1 time: 0.238291 Oct 22 21:11:41.149942 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2183/4391] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:11:40 2022] GET /compute/v2.1/servers/c7c717a4-9925-4455-9963-ffdcae9f06f4 => generated 1413 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:11:41.248661 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-5444e2f5-6f1e-45da-b001-98a8ce1970db tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e7a09f769748629425ad36120a7fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddce0c46c75496f96f2e2dae77751dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:11:41.259391 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-5444e2f5-6f1e-45da-b001-98a8ce1970db tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] 10.222.0.18 "GET /compute/v2.1/servers/4dc70956-7b13-4f5b-99fe-f7ea6f320f0b" status: 200 len: 1724 microversion: 2.1 time: 0.522200 Oct 22 21:11:41.260596 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2209/4392] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:11:40 2022] GET /compute/v2.1/servers/4dc70956-7b13-4f5b-99fe-f7ea6f320f0b => generated 1724 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:11:41.729421 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-68d95030-826d-4db9-a196-ffdc85a9dd8c tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:11:41.730386 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-68d95030-826d-4db9-a196-ffdc85a9dd8c tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] [instance: 4d285bc1-33a9-47e0-a148-756be61c0488] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:11:41.739581 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-68d95030-826d-4db9-a196-ffdc85a9dd8c tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:41.740435 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-68d95030-826d-4db9-a196-ffdc85a9dd8c tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:41.741087 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-68d95030-826d-4db9-a196-ffdc85a9dd8c tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:41.741994 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-68d95030-826d-4db9-a196-ffdc85a9dd8c tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:41.742676 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-68d95030-826d-4db9-a196-ffdc85a9dd8c tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:41.743724 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-68d95030-826d-4db9-a196-ffdc85a9dd8c tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:42.136026 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-68d95030-826d-4db9-a196-ffdc85a9dd8c tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd69c1f0203b047eeb6a9fa0a215a63c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09185bfad7944b199a490305c22ffc3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:11:42.146462 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-68d95030-826d-4db9-a196-ffdc85a9dd8c tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd69c1f0203b047eeb6a9fa0a215a63c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09185bfad7944b199a490305c22ffc3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:11:42.148259 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-68d95030-826d-4db9-a196-ffdc85a9dd8c tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd69c1f0203b047eeb6a9fa0a215a63c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09185bfad7944b199a490305c22ffc3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:11:42.149558 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-68d95030-826d-4db9-a196-ffdc85a9dd8c tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] 10.222.0.18 "GET /compute/v2.1/servers/4d285bc1-33a9-47e0-a148-756be61c0488" status: 200 len: 1879 microversion: 2.32 time: 0.425093 Oct 22 21:11:42.150313 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2184/4393] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:11:41 2022] GET /compute/v2.1/servers/4d285bc1-33a9-47e0-a148-756be61c0488 => generated 1879 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 22 21:11:42.173574 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-eb1bae09-8b3b-46fd-be03-f0b7715e0bae tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:11:42.174740 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-eb1bae09-8b3b-46fd-be03-f0b7715e0bae tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] [instance: c7c717a4-9925-4455-9963-ffdcae9f06f4] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:11:42.182766 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-eb1bae09-8b3b-46fd-be03-f0b7715e0bae tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:42.183735 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-eb1bae09-8b3b-46fd-be03-f0b7715e0bae tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:42.184707 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-eb1bae09-8b3b-46fd-be03-f0b7715e0bae tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:42.185689 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-eb1bae09-8b3b-46fd-be03-f0b7715e0bae tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:42.186590 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-eb1bae09-8b3b-46fd-be03-f0b7715e0bae tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:42.187259 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-eb1bae09-8b3b-46fd-be03-f0b7715e0bae tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:42.284832 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-4e5364a4-432d-4819-81d4-322d697f5580 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:11:42.285979 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-4e5364a4-432d-4819-81d4-322d697f5580 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] [instance: 4dc70956-7b13-4f5b-99fe-f7ea6f320f0b] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:11:42.293035 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4e5364a4-432d-4819-81d4-322d697f5580 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:42.293553 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4e5364a4-432d-4819-81d4-322d697f5580 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:42.294472 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4e5364a4-432d-4819-81d4-322d697f5580 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:42.295208 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4e5364a4-432d-4819-81d4-322d697f5580 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:42.296088 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4e5364a4-432d-4819-81d4-322d697f5580 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:42.296682 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4e5364a4-432d-4819-81d4-322d697f5580 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:42.306044 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-eb1bae09-8b3b-46fd-be03-f0b7715e0bae tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/c7c717a4-9925-4455-9963-ffdcae9f06f4" status: 200 len: 1419 microversion: 2.1 time: 0.137508 Oct 22 21:11:42.306971 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2210/4394] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:11:42 2022] GET /compute/v2.1/servers/c7c717a4-9925-4455-9963-ffdcae9f06f4 => generated 1419 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:11:42.903864 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-4e5364a4-432d-4819-81d4-322d697f5580 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e7a09f769748629425ad36120a7fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddce0c46c75496f96f2e2dae77751dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:11:42.913535 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-4e5364a4-432d-4819-81d4-322d697f5580 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] 10.222.0.18 "GET /compute/v2.1/servers/4dc70956-7b13-4f5b-99fe-f7ea6f320f0b" status: 200 len: 1730 microversion: 2.1 time: 0.633020 Oct 22 21:11:42.914840 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2185/4395] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:11:42 2022] GET /compute/v2.1/servers/4dc70956-7b13-4f5b-99fe-f7ea6f320f0b => generated 1730 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:11:42.936962 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-b8cb5214-b8e7-44d4-8400-4b9a6bf8cc8a tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:11:42.937470 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-b8cb5214-b8e7-44d4-8400-4b9a6bf8cc8a tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] [instance: 4dc70956-7b13-4f5b-99fe-f7ea6f320f0b] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:11:42.944713 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b8cb5214-b8e7-44d4-8400-4b9a6bf8cc8a tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:42.945468 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b8cb5214-b8e7-44d4-8400-4b9a6bf8cc8a tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:42.946241 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b8cb5214-b8e7-44d4-8400-4b9a6bf8cc8a tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:42.947283 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b8cb5214-b8e7-44d4-8400-4b9a6bf8cc8a tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:42.947964 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b8cb5214-b8e7-44d4-8400-4b9a6bf8cc8a tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:42.948437 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b8cb5214-b8e7-44d4-8400-4b9a6bf8cc8a tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:43.136355 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-b8cb5214-b8e7-44d4-8400-4b9a6bf8cc8a tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] 10.222.0.18 "GET /compute/v2.1/servers/4dc70956-7b13-4f5b-99fe-f7ea6f320f0b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.203349 Oct 22 21:11:43.145602 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2211/4396] 10.222.0.18 () {58 vars in 1275 bytes} [Sat Oct 22 21:11:42 2022] GET /compute/v2.1/servers/4dc70956-7b13-4f5b-99fe-f7ea6f320f0b/os-interface => generated 284 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:11:43.183941 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-f581a804-cde9-4d78-b151-ff2393c73339 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:11:43.185683 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-f581a804-cde9-4d78-b151-ff2393c73339 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] [instance: 4d285bc1-33a9-47e0-a148-756be61c0488] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:11:43.199981 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f581a804-cde9-4d78-b151-ff2393c73339 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:43.200926 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f581a804-cde9-4d78-b151-ff2393c73339 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:43.201599 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f581a804-cde9-4d78-b151-ff2393c73339 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:43.203848 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f581a804-cde9-4d78-b151-ff2393c73339 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:43.204641 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f581a804-cde9-4d78-b151-ff2393c73339 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:43.205320 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f581a804-cde9-4d78-b151-ff2393c73339 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:43.332435 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-7d88b349-662f-49a7-9808-5c023c7ebbec tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:11:43.334344 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-7d88b349-662f-49a7-9808-5c023c7ebbec tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] [instance: c7c717a4-9925-4455-9963-ffdcae9f06f4] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:11:43.341921 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7d88b349-662f-49a7-9808-5c023c7ebbec tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:43.342857 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7d88b349-662f-49a7-9808-5c023c7ebbec tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:43.343308 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7d88b349-662f-49a7-9808-5c023c7ebbec tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:43.344163 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7d88b349-662f-49a7-9808-5c023c7ebbec tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:43.344742 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7d88b349-662f-49a7-9808-5c023c7ebbec tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:43.345176 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7d88b349-662f-49a7-9808-5c023c7ebbec tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:43.677623 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-f581a804-cde9-4d78-b151-ff2393c73339 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd69c1f0203b047eeb6a9fa0a215a63c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09185bfad7944b199a490305c22ffc3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:11:43.687692 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-f581a804-cde9-4d78-b151-ff2393c73339 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd69c1f0203b047eeb6a9fa0a215a63c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09185bfad7944b199a490305c22ffc3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:11:43.689420 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-f581a804-cde9-4d78-b151-ff2393c73339 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd69c1f0203b047eeb6a9fa0a215a63c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09185bfad7944b199a490305c22ffc3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:11:43.690885 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-f581a804-cde9-4d78-b151-ff2393c73339 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] 10.222.0.18 "GET /compute/v2.1/servers/4d285bc1-33a9-47e0-a148-756be61c0488" status: 200 len: 1879 microversion: 2.32 time: 0.516114 Oct 22 21:11:43.691610 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2186/4397] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:11:43 2022] GET /compute/v2.1/servers/4d285bc1-33a9-47e0-a148-756be61c0488 => generated 1879 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:11:43.740935 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-7d88b349-662f-49a7-9808-5c023c7ebbec tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/c7c717a4-9925-4455-9963-ffdcae9f06f4" status: 200 len: 1461 microversion: 2.1 time: 0.413517 Oct 22 21:11:43.742186 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2212/4398] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:11:43 2022] GET /compute/v2.1/servers/c7c717a4-9925-4455-9963-ffdcae9f06f4 => generated 1461 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:11:44.502903 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-efee6a44-15a1-4cf4-9d3e-b7818f588f33 req-befae901-3213-45d5-9288-8dae21572f2c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7c717a4-9925-4455-9963-ffdcae9f06f4", "tag": "15d85ce2-9636-48a1-8fec-cb35fe59c08b"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:11:44.516966 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-efee6a44-15a1-4cf4-9d3e-b7818f588f33 req-befae901-3213-45d5-9288-8dae21572f2c service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:44.517907 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-efee6a44-15a1-4cf4-9d3e-b7818f588f33 req-befae901-3213-45d5-9288-8dae21572f2c service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:44.518559 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-efee6a44-15a1-4cf4-9d3e-b7818f588f33 req-befae901-3213-45d5-9288-8dae21572f2c service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:44.548278 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-efee6a44-15a1-4cf4-9d3e-b7818f588f33 req-befae901-3213-45d5-9288-8dae21572f2c service nova] Creating event network-changed:15d85ce2-9636-48a1-8fec-cb35fe59c08b for instance c7c717a4-9925-4455-9963-ffdcae9f06f4 on nch2-master-1 Oct 22 21:11:44.554778 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-efee6a44-15a1-4cf4-9d3e-b7818f588f33 req-befae901-3213-45d5-9288-8dae21572f2c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055868 Oct 22 21:11:44.556162 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2187/4399] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:11:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:11:44.720829 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-71b24369-6e30-416b-a7c2-48110ea1942d tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:11:44.722360 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-71b24369-6e30-416b-a7c2-48110ea1942d tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] [instance: 4d285bc1-33a9-47e0-a148-756be61c0488] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:11:44.734330 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-71b24369-6e30-416b-a7c2-48110ea1942d tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:44.735181 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-71b24369-6e30-416b-a7c2-48110ea1942d tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:44.736027 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-71b24369-6e30-416b-a7c2-48110ea1942d tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:44.737184 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-71b24369-6e30-416b-a7c2-48110ea1942d tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:44.738030 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-71b24369-6e30-416b-a7c2-48110ea1942d tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:44.739392 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-71b24369-6e30-416b-a7c2-48110ea1942d tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:44.765916 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-f8ffd300-3d12-478b-b236-6266e4eb570d tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:11:44.766630 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-f8ffd300-3d12-478b-b236-6266e4eb570d tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] [instance: c7c717a4-9925-4455-9963-ffdcae9f06f4] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:11:44.784338 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f8ffd300-3d12-478b-b236-6266e4eb570d tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:44.784846 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f8ffd300-3d12-478b-b236-6266e4eb570d tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:44.785296 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f8ffd300-3d12-478b-b236-6266e4eb570d tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:44.786014 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f8ffd300-3d12-478b-b236-6266e4eb570d tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:44.786477 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f8ffd300-3d12-478b-b236-6266e4eb570d tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:44.786903 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f8ffd300-3d12-478b-b236-6266e4eb570d tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:45.201765 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-f8ffd300-3d12-478b-b236-6266e4eb570d tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/c7c717a4-9925-4455-9963-ffdcae9f06f4" status: 200 len: 1461 microversion: 2.1 time: 0.440452 Oct 22 21:11:45.211373 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-71b24369-6e30-416b-a7c2-48110ea1942d tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd69c1f0203b047eeb6a9fa0a215a63c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09185bfad7944b199a490305c22ffc3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:11:45.218089 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2188/4400] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:11:44 2022] GET /compute/v2.1/servers/c7c717a4-9925-4455-9963-ffdcae9f06f4 => generated 1461 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:11:45.218584 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-71b24369-6e30-416b-a7c2-48110ea1942d tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd69c1f0203b047eeb6a9fa0a215a63c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09185bfad7944b199a490305c22ffc3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:11:45.222677 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-71b24369-6e30-416b-a7c2-48110ea1942d tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd69c1f0203b047eeb6a9fa0a215a63c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09185bfad7944b199a490305c22ffc3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:11:45.224255 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-71b24369-6e30-416b-a7c2-48110ea1942d tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] 10.222.0.18 "GET /compute/v2.1/servers/4d285bc1-33a9-47e0-a148-756be61c0488" status: 200 len: 1879 microversion: 2.32 time: 0.510944 Oct 22 21:11:45.232474 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-b6f95d3d-ffaa-40be-929d-c3d92ef84198 req-3b686c27-2293-426f-b460-6c00b68e3c90 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4dc70956-7b13-4f5b-99fe-f7ea6f320f0b", "tag": "88166dcc-9792-4971-8d68-0960842beacf"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:11:45.243856 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2213/4401] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:11:44 2022] GET /compute/v2.1/servers/4d285bc1-33a9-47e0-a148-756be61c0488 => generated 1879 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:11:45.244743 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-b6f95d3d-ffaa-40be-929d-c3d92ef84198 req-3b686c27-2293-426f-b460-6c00b68e3c90 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:45.245401 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-b6f95d3d-ffaa-40be-929d-c3d92ef84198 req-3b686c27-2293-426f-b460-6c00b68e3c90 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:45.245995 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-b6f95d3d-ffaa-40be-929d-c3d92ef84198 req-3b686c27-2293-426f-b460-6c00b68e3c90 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:45.260279 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-b6f95d3d-ffaa-40be-929d-c3d92ef84198 req-3b686c27-2293-426f-b460-6c00b68e3c90 service nova] Creating event network-changed:88166dcc-9792-4971-8d68-0960842beacf for instance 4dc70956-7b13-4f5b-99fe-f7ea6f320f0b on nch2-master-1 Oct 22 21:11:45.269114 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-b6f95d3d-ffaa-40be-929d-c3d92ef84198 req-3b686c27-2293-426f-b460-6c00b68e3c90 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046018 Oct 22 21:11:45.270281 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2189/4402] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:11:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 21:11:46.227640 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-f874f520-7217-4fca-a7c5-18d4eeb678f6 tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:11:46.228645 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-f874f520-7217-4fca-a7c5-18d4eeb678f6 tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] [instance: c7c717a4-9925-4455-9963-ffdcae9f06f4] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:11:46.236413 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f874f520-7217-4fca-a7c5-18d4eeb678f6 tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:46.237096 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f874f520-7217-4fca-a7c5-18d4eeb678f6 tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:46.237564 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f874f520-7217-4fca-a7c5-18d4eeb678f6 tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:46.238287 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f874f520-7217-4fca-a7c5-18d4eeb678f6 tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:46.238746 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f874f520-7217-4fca-a7c5-18d4eeb678f6 tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:46.240044 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f874f520-7217-4fca-a7c5-18d4eeb678f6 tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:46.261448 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-4541a31e-38c1-4b2f-9335-efe599457179 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:11:46.262389 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-4541a31e-38c1-4b2f-9335-efe599457179 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] [instance: 4d285bc1-33a9-47e0-a148-756be61c0488] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:11:46.269399 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4541a31e-38c1-4b2f-9335-efe599457179 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:46.269900 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4541a31e-38c1-4b2f-9335-efe599457179 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:46.270439 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4541a31e-38c1-4b2f-9335-efe599457179 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:46.271218 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4541a31e-38c1-4b2f-9335-efe599457179 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:46.271780 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4541a31e-38c1-4b2f-9335-efe599457179 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:46.272278 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4541a31e-38c1-4b2f-9335-efe599457179 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:46.634592 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-f874f520-7217-4fca-a7c5-18d4eeb678f6 tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/c7c717a4-9925-4455-9963-ffdcae9f06f4" status: 200 len: 1461 microversion: 2.1 time: 0.412145 Oct 22 21:11:46.636242 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2214/4403] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:11:46 2022] GET /compute/v2.1/servers/c7c717a4-9925-4455-9963-ffdcae9f06f4 => generated 1461 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:11:46.721209 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-4541a31e-38c1-4b2f-9335-efe599457179 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd69c1f0203b047eeb6a9fa0a215a63c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09185bfad7944b199a490305c22ffc3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:11:46.734450 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-4541a31e-38c1-4b2f-9335-efe599457179 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd69c1f0203b047eeb6a9fa0a215a63c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09185bfad7944b199a490305c22ffc3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:11:46.736215 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-4541a31e-38c1-4b2f-9335-efe599457179 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd69c1f0203b047eeb6a9fa0a215a63c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09185bfad7944b199a490305c22ffc3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:11:46.737540 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-4541a31e-38c1-4b2f-9335-efe599457179 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] 10.222.0.18 "GET /compute/v2.1/servers/4d285bc1-33a9-47e0-a148-756be61c0488" status: 200 len: 1879 microversion: 2.32 time: 0.481714 Oct 22 21:11:46.738212 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2190/4404] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:11:46 2022] GET /compute/v2.1/servers/4d285bc1-33a9-47e0-a148-756be61c0488 => generated 1879 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:11:47.327904 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-c98bab8e-9ca7-49dd-b668-ebeefa799879 req-6584248a-d70b-4679-ab19-aba529a4714d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4dc70956-7b13-4f5b-99fe-f7ea6f320f0b", "tag": "88166dcc-9792-4971-8d68-0960842beacf"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:11:47.339296 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-c98bab8e-9ca7-49dd-b668-ebeefa799879 req-6584248a-d70b-4679-ab19-aba529a4714d service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:47.339929 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-c98bab8e-9ca7-49dd-b668-ebeefa799879 req-6584248a-d70b-4679-ab19-aba529a4714d service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:47.340470 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-c98bab8e-9ca7-49dd-b668-ebeefa799879 req-6584248a-d70b-4679-ab19-aba529a4714d service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:47.353183 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-c98bab8e-9ca7-49dd-b668-ebeefa799879 req-6584248a-d70b-4679-ab19-aba529a4714d service nova] Creating event network-changed:88166dcc-9792-4971-8d68-0960842beacf for instance 4dc70956-7b13-4f5b-99fe-f7ea6f320f0b on nch2-master-1 Oct 22 21:11:47.359270 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-c98bab8e-9ca7-49dd-b668-ebeefa799879 req-6584248a-d70b-4679-ab19-aba529a4714d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034980 Oct 22 21:11:47.359729 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2215/4405] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:11:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:11:47.381177 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-a01615d5-73b9-4d3c-92db-05a79b79022d tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:11:47.381990 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-a01615d5-73b9-4d3c-92db-05a79b79022d tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] [instance: cc7f1980-ecea-437f-ac71-0cdb6ec626b9] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:11:47.389867 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a01615d5-73b9-4d3c-92db-05a79b79022d tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:47.390381 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a01615d5-73b9-4d3c-92db-05a79b79022d tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:47.390831 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a01615d5-73b9-4d3c-92db-05a79b79022d tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:47.391590 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a01615d5-73b9-4d3c-92db-05a79b79022d tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:47.392223 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a01615d5-73b9-4d3c-92db-05a79b79022d tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:47.392819 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a01615d5-73b9-4d3c-92db-05a79b79022d tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:47.430441 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-a01615d5-73b9-4d3c-92db-05a79b79022d tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] 10.222.0.18 "GET /compute/v2.1/servers/cc7f1980-ecea-437f-ac71-0cdb6ec626b9/os-volume_attachments/c67610e1-af2e-402f-8cee-c3d2c0eb9bfd" status: 200 len: 194 microversion: 2.20 time: 0.055316 Oct 22 21:11:47.431750 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2191/4406] 10.222.0.18 () {60 vars in 1454 bytes} [Sat Oct 22 21:11:47 2022] GET /compute/v2.1/servers/cc7f1980-ecea-437f-ac71-0cdb6ec626b9/os-volume_attachments/c67610e1-af2e-402f-8cee-c3d2c0eb9bfd => generated 194 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 22 21:11:47.512649 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-cd3f29ae-5ad7-445e-8c6d-4a6de4e91633 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:11:47.513548 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-cd3f29ae-5ad7-445e-8c6d-4a6de4e91633 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] [instance: cc7f1980-ecea-437f-ac71-0cdb6ec626b9] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:11:47.521727 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cd3f29ae-5ad7-445e-8c6d-4a6de4e91633 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:47.522629 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cd3f29ae-5ad7-445e-8c6d-4a6de4e91633 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:47.523256 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cd3f29ae-5ad7-445e-8c6d-4a6de4e91633 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:47.524649 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cd3f29ae-5ad7-445e-8c6d-4a6de4e91633 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:47.525315 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cd3f29ae-5ad7-445e-8c6d-4a6de4e91633 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:47.525919 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cd3f29ae-5ad7-445e-8c6d-4a6de4e91633 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:47.624975 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.objects.instance [None req-cd3f29ae-5ad7-445e-8c6d-4a6de4e91633 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lazy-loading 'services' on Instance uuid cc7f1980-ecea-437f-ac71-0cdb6ec626b9 {{(pid=138745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 21:11:47.659428 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-cfdebd39-ec30-4f6e-9f0e-7c71e8e956f2 tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:11:47.660208 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-cfdebd39-ec30-4f6e-9f0e-7c71e8e956f2 tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] [instance: c7c717a4-9925-4455-9963-ffdcae9f06f4] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:11:47.676001 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cfdebd39-ec30-4f6e-9f0e-7c71e8e956f2 tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:47.676583 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cfdebd39-ec30-4f6e-9f0e-7c71e8e956f2 tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:47.677142 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cfdebd39-ec30-4f6e-9f0e-7c71e8e956f2 tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:47.679864 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cfdebd39-ec30-4f6e-9f0e-7c71e8e956f2 tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:47.680422 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cfdebd39-ec30-4f6e-9f0e-7c71e8e956f2 tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:47.681734 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cfdebd39-ec30-4f6e-9f0e-7c71e8e956f2 tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:47.720573 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-cd3f29ae-5ad7-445e-8c6d-4a6de4e91633 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] 10.222.0.18 "DELETE /compute/v2.1/servers/cc7f1980-ecea-437f-ac71-0cdb6ec626b9/os-volume_attachments/c67610e1-af2e-402f-8cee-c3d2c0eb9bfd" status: 202 len: 0 microversion: 2.20 time: 0.211975 Oct 22 21:11:47.726347 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2216/4407] 10.222.0.18 () {60 vars in 1457 bytes} [Sat Oct 22 21:11:47 2022] DELETE /compute/v2.1/servers/cc7f1980-ecea-437f-ac71-0cdb6ec626b9/os-volume_attachments/c67610e1-af2e-402f-8cee-c3d2c0eb9bfd => generated 0 bytes in 219 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 22 21:11:47.738992 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:11:47.741319 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-3b688116-266c-4711-bda5-c4bb1640218d tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:11:47.744512 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-3b688116-266c-4711-bda5-c4bb1640218d tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] [instance: cc7f1980-ecea-437f-ac71-0cdb6ec626b9] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:11:47.765021 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3b688116-266c-4711-bda5-c4bb1640218d tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:47.765827 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3b688116-266c-4711-bda5-c4bb1640218d tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:47.767146 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3b688116-266c-4711-bda5-c4bb1640218d tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:47.768526 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3b688116-266c-4711-bda5-c4bb1640218d tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:47.771999 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3b688116-266c-4711-bda5-c4bb1640218d tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:47.772723 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3b688116-266c-4711-bda5-c4bb1640218d tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:47.814329 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-3b688116-266c-4711-bda5-c4bb1640218d tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] 10.222.0.18 "GET /compute/v2.1/servers/cc7f1980-ecea-437f-ac71-0cdb6ec626b9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.086253 Oct 22 21:11:47.814910 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2217/4408] 10.222.0.18 () {60 vars in 1343 bytes} [Sat Oct 22 21:11:47 2022] GET /compute/v2.1/servers/cc7f1980-ecea-437f-ac71-0cdb6ec626b9/os-volume_attachments => generated 197 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 22 21:11:47.826492 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-43a62ffd-8ef3-4249-aa07-a02553aceea4 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:11:47.827702 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-43a62ffd-8ef3-4249-aa07-a02553aceea4 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] [instance: 4d285bc1-33a9-47e0-a148-756be61c0488] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:11:47.835235 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-43a62ffd-8ef3-4249-aa07-a02553aceea4 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:47.836113 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-43a62ffd-8ef3-4249-aa07-a02553aceea4 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:47.836727 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-43a62ffd-8ef3-4249-aa07-a02553aceea4 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:47.837761 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-43a62ffd-8ef3-4249-aa07-a02553aceea4 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:47.838401 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-43a62ffd-8ef3-4249-aa07-a02553aceea4 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:47.839077 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-43a62ffd-8ef3-4249-aa07-a02553aceea4 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:48.195554 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-cfdebd39-ec30-4f6e-9f0e-7c71e8e956f2 tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/c7c717a4-9925-4455-9963-ffdcae9f06f4" status: 200 len: 1461 microversion: 2.1 time: 0.539478 Oct 22 21:11:48.199483 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2192/4409] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:11:47 2022] GET /compute/v2.1/servers/c7c717a4-9925-4455-9963-ffdcae9f06f4 => generated 1461 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:11:48.203978 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-43a62ffd-8ef3-4249-aa07-a02553aceea4 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd69c1f0203b047eeb6a9fa0a215a63c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09185bfad7944b199a490305c22ffc3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:11:48.213749 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-43a62ffd-8ef3-4249-aa07-a02553aceea4 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd69c1f0203b047eeb6a9fa0a215a63c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09185bfad7944b199a490305c22ffc3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:11:48.216184 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-43a62ffd-8ef3-4249-aa07-a02553aceea4 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd69c1f0203b047eeb6a9fa0a215a63c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09185bfad7944b199a490305c22ffc3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:11:48.217568 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-43a62ffd-8ef3-4249-aa07-a02553aceea4 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] 10.222.0.18 "GET /compute/v2.1/servers/4d285bc1-33a9-47e0-a148-756be61c0488" status: 200 len: 1879 microversion: 2.32 time: 0.397003 Oct 22 21:11:48.218141 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2218/4410] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:11:47 2022] GET /compute/v2.1/servers/4d285bc1-33a9-47e0-a148-756be61c0488 => generated 1879 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:11:48.829887 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-f9d1f633-7819-4830-a35f-e501901a1eec tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:11:48.834296 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-f9d1f633-7819-4830-a35f-e501901a1eec tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] [instance: cc7f1980-ecea-437f-ac71-0cdb6ec626b9] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:11:48.842274 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f9d1f633-7819-4830-a35f-e501901a1eec tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:48.842897 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f9d1f633-7819-4830-a35f-e501901a1eec tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:48.843449 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f9d1f633-7819-4830-a35f-e501901a1eec tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:48.844226 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f9d1f633-7819-4830-a35f-e501901a1eec tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:48.844747 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f9d1f633-7819-4830-a35f-e501901a1eec tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:48.845493 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f9d1f633-7819-4830-a35f-e501901a1eec tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:48.882898 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-f9d1f633-7819-4830-a35f-e501901a1eec tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] 10.222.0.18 "GET /compute/v2.1/servers/cc7f1980-ecea-437f-ac71-0cdb6ec626b9/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.059707 Oct 22 21:11:48.883689 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2193/4411] 10.222.0.18 () {60 vars in 1343 bytes} [Sat Oct 22 21:11:48 2022] GET /compute/v2.1/servers/cc7f1980-ecea-437f-ac71-0cdb6ec626b9/os-volume_attachments => generated 25 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:11:48.956806 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-79aeb333-7ef9-47a2-87e5-af189e4839ba tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:11:48.957688 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-79aeb333-7ef9-47a2-87e5-af189e4839ba tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] [instance: cc7f1980-ecea-437f-ac71-0cdb6ec626b9] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:11:48.965031 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-79aeb333-7ef9-47a2-87e5-af189e4839ba tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:48.965921 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-79aeb333-7ef9-47a2-87e5-af189e4839ba tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:48.966481 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-79aeb333-7ef9-47a2-87e5-af189e4839ba tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:48.967445 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-79aeb333-7ef9-47a2-87e5-af189e4839ba tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:48.968085 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-79aeb333-7ef9-47a2-87e5-af189e4839ba tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:48.968728 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-79aeb333-7ef9-47a2-87e5-af189e4839ba tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:48.995788 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-79aeb333-7ef9-47a2-87e5-af189e4839ba tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] [instance: cc7f1980-ecea-437f-ac71-0cdb6ec626b9] Going to try to terminate instance {{(pid=138745) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 21:11:49.061032 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1,nova_cell1:UPDATE=1 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:11:49.103456 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-79aeb333-7ef9-47a2-87e5-af189e4839ba tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] 10.222.0.18 "DELETE /compute/v2.1/servers/cc7f1980-ecea-437f-ac71-0cdb6ec626b9" status: 204 len: 0 microversion: 2.20 time: 0.150512 Oct 22 21:11:49.104350 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2219/4412] 10.222.0.18 () {60 vars in 1280 bytes} [Sat Oct 22 21:11:48 2022] DELETE /compute/v2.1/servers/cc7f1980-ecea-437f-ac71-0cdb6ec626b9 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 22 21:11:49.112874 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-f186b9f3-2f12-447b-a738-26d0bdecb05c tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:11:49.113504 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-f186b9f3-2f12-447b-a738-26d0bdecb05c tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] [instance: cc7f1980-ecea-437f-ac71-0cdb6ec626b9] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:11:49.115424 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=3 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:11:49.124675 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f186b9f3-2f12-447b-a738-26d0bdecb05c tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:49.125632 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f186b9f3-2f12-447b-a738-26d0bdecb05c tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:49.125632 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f186b9f3-2f12-447b-a738-26d0bdecb05c tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:49.126228 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f186b9f3-2f12-447b-a738-26d0bdecb05c tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:49.126714 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f186b9f3-2f12-447b-a738-26d0bdecb05c tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:49.127129 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f186b9f3-2f12-447b-a738-26d0bdecb05c tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:49.221191 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-72f87476-8cf3-490e-8753-78fcc612ad62 tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:11:49.222225 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-72f87476-8cf3-490e-8753-78fcc612ad62 tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] [instance: c7c717a4-9925-4455-9963-ffdcae9f06f4] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:11:49.229653 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-72f87476-8cf3-490e-8753-78fcc612ad62 tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:49.230414 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-72f87476-8cf3-490e-8753-78fcc612ad62 tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:49.231357 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-72f87476-8cf3-490e-8753-78fcc612ad62 tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:49.232518 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-72f87476-8cf3-490e-8753-78fcc612ad62 tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:49.233164 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-72f87476-8cf3-490e-8753-78fcc612ad62 tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:49.233774 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-72f87476-8cf3-490e-8753-78fcc612ad62 tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:49.379031 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-f186b9f3-2f12-447b-a738-26d0bdecb05c tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:11:49.389152 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-f186b9f3-2f12-447b-a738-26d0bdecb05c tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:11:49.390861 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-f186b9f3-2f12-447b-a738-26d0bdecb05c tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:11:49.392071 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-f186b9f3-2f12-447b-a738-26d0bdecb05c tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] 10.222.0.18 "GET /compute/v2.1/servers/cc7f1980-ecea-437f-ac71-0cdb6ec626b9" status: 200 len: 1723 microversion: 2.20 time: 0.283149 Oct 22 21:11:49.392938 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2194/4413] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:11:49 2022] GET /compute/v2.1/servers/cc7f1980-ecea-437f-ac71-0cdb6ec626b9 => generated 1723 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 22 21:11:49.417375 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-07637aca-f9bb-4c1d-b6b3-34e0c567444e tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:11:49.418345 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-07637aca-f9bb-4c1d-b6b3-34e0c567444e tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] [instance: 4d285bc1-33a9-47e0-a148-756be61c0488] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:11:49.425373 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-07637aca-f9bb-4c1d-b6b3-34e0c567444e tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:49.426067 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-07637aca-f9bb-4c1d-b6b3-34e0c567444e tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:49.427292 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-07637aca-f9bb-4c1d-b6b3-34e0c567444e tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:49.428534 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-07637aca-f9bb-4c1d-b6b3-34e0c567444e tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:49.429240 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-07637aca-f9bb-4c1d-b6b3-34e0c567444e tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:49.430143 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-07637aca-f9bb-4c1d-b6b3-34e0c567444e tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:49.486368 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-72f87476-8cf3-490e-8753-78fcc612ad62 tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/c7c717a4-9925-4455-9963-ffdcae9f06f4" status: 200 len: 1461 microversion: 2.1 time: 0.269824 Oct 22 21:11:49.487164 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2220/4414] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:11:49 2022] GET /compute/v2.1/servers/c7c717a4-9925-4455-9963-ffdcae9f06f4 => generated 1461 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:11:49.629941 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell0:SELECT=2 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:11:49.662223 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell0:SELECT=6 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:11:49.826350 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-07637aca-f9bb-4c1d-b6b3-34e0c567444e tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd69c1f0203b047eeb6a9fa0a215a63c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09185bfad7944b199a490305c22ffc3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:11:49.839669 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-07637aca-f9bb-4c1d-b6b3-34e0c567444e tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd69c1f0203b047eeb6a9fa0a215a63c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09185bfad7944b199a490305c22ffc3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:11:49.844315 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-07637aca-f9bb-4c1d-b6b3-34e0c567444e tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd69c1f0203b047eeb6a9fa0a215a63c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09185bfad7944b199a490305c22ffc3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:11:49.845863 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-07637aca-f9bb-4c1d-b6b3-34e0c567444e tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] 10.222.0.18 "GET /compute/v2.1/servers/4d285bc1-33a9-47e0-a148-756be61c0488" status: 200 len: 1879 microversion: 2.32 time: 0.436630 Oct 22 21:11:49.847418 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2195/4415] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:11:49 2022] GET /compute/v2.1/servers/4d285bc1-33a9-47e0-a148-756be61c0488 => generated 1879 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:11:50.422404 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-ab068af5-5530-43f8-aa0a-1ff0830ef43f tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:11:50.423772 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-ab068af5-5530-43f8-aa0a-1ff0830ef43f tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] [instance: cc7f1980-ecea-437f-ac71-0cdb6ec626b9] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:11:50.431367 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell0:SELECT=2 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:11:50.434431 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ab068af5-5530-43f8-aa0a-1ff0830ef43f tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:50.435275 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ab068af5-5530-43f8-aa0a-1ff0830ef43f tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:50.436070 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ab068af5-5530-43f8-aa0a-1ff0830ef43f tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:50.437977 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ab068af5-5530-43f8-aa0a-1ff0830ef43f tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:50.438633 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ab068af5-5530-43f8-aa0a-1ff0830ef43f tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:50.439307 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ab068af5-5530-43f8-aa0a-1ff0830ef43f tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:50.511754 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-f544ee37-98ff-4710-9ee1-fc32ec3520b9 tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:11:50.513187 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-f544ee37-98ff-4710-9ee1-fc32ec3520b9 tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] [instance: c7c717a4-9925-4455-9963-ffdcae9f06f4] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:11:50.525721 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f544ee37-98ff-4710-9ee1-fc32ec3520b9 tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:50.529001 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f544ee37-98ff-4710-9ee1-fc32ec3520b9 tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:50.529812 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f544ee37-98ff-4710-9ee1-fc32ec3520b9 tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:50.532267 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f544ee37-98ff-4710-9ee1-fc32ec3520b9 tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:50.532848 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f544ee37-98ff-4710-9ee1-fc32ec3520b9 tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:50.533516 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f544ee37-98ff-4710-9ee1-fc32ec3520b9 tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:51.038513 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-f544ee37-98ff-4710-9ee1-fc32ec3520b9 tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/c7c717a4-9925-4455-9963-ffdcae9f06f4" status: 200 len: 1461 microversion: 2.1 time: 0.532072 Oct 22 21:11:51.040495 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2196/4416] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:11:50 2022] GET /compute/v2.1/servers/c7c717a4-9925-4455-9963-ffdcae9f06f4 => generated 1461 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:11:51.047154 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-1d91184c-074d-42d8-8eae-aa3aae065ce0 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:11:51.048068 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-1d91184c-074d-42d8-8eae-aa3aae065ce0 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] [instance: 4d285bc1-33a9-47e0-a148-756be61c0488] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:11:51.078306 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1d91184c-074d-42d8-8eae-aa3aae065ce0 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:51.079071 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1d91184c-074d-42d8-8eae-aa3aae065ce0 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:51.079709 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1d91184c-074d-42d8-8eae-aa3aae065ce0 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:51.083619 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1d91184c-074d-42d8-8eae-aa3aae065ce0 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:51.084358 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1d91184c-074d-42d8-8eae-aa3aae065ce0 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:51.089871 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1d91184c-074d-42d8-8eae-aa3aae065ce0 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:51.276464 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-ab068af5-5530-43f8-aa0a-1ff0830ef43f tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:11:51.286022 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-ab068af5-5530-43f8-aa0a-1ff0830ef43f tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:11:51.288258 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-ab068af5-5530-43f8-aa0a-1ff0830ef43f tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:11:51.290619 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-ab068af5-5530-43f8-aa0a-1ff0830ef43f tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] 10.222.0.18 "GET /compute/v2.1/servers/cc7f1980-ecea-437f-ac71-0cdb6ec626b9" status: 200 len: 1723 microversion: 2.20 time: 0.872266 Oct 22 21:11:51.313769 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2221/4417] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:11:50 2022] GET /compute/v2.1/servers/cc7f1980-ecea-437f-ac71-0cdb6ec626b9 => generated 1723 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:11:51.570622 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-1d91184c-074d-42d8-8eae-aa3aae065ce0 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd69c1f0203b047eeb6a9fa0a215a63c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09185bfad7944b199a490305c22ffc3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:11:51.608890 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-1d91184c-074d-42d8-8eae-aa3aae065ce0 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd69c1f0203b047eeb6a9fa0a215a63c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09185bfad7944b199a490305c22ffc3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:11:51.612225 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-1d91184c-074d-42d8-8eae-aa3aae065ce0 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd69c1f0203b047eeb6a9fa0a215a63c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09185bfad7944b199a490305c22ffc3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:11:51.615184 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-1d91184c-074d-42d8-8eae-aa3aae065ce0 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] 10.222.0.18 "GET /compute/v2.1/servers/4d285bc1-33a9-47e0-a148-756be61c0488" status: 200 len: 1879 microversion: 2.32 time: 0.572605 Oct 22 21:11:51.616268 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2197/4418] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:11:51 2022] GET /compute/v2.1/servers/4d285bc1-33a9-47e0-a148-756be61c0488 => generated 1879 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:11:52.063212 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-1fae1bb9-297c-4899-bc84-fc32f78a523f tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:11:52.064712 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-1fae1bb9-297c-4899-bc84-fc32f78a523f tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] [instance: c7c717a4-9925-4455-9963-ffdcae9f06f4] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:11:52.082034 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1fae1bb9-297c-4899-bc84-fc32f78a523f tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:52.082914 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1fae1bb9-297c-4899-bc84-fc32f78a523f tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:52.083650 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1fae1bb9-297c-4899-bc84-fc32f78a523f tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:52.085361 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1fae1bb9-297c-4899-bc84-fc32f78a523f tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:52.087366 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1fae1bb9-297c-4899-bc84-fc32f78a523f tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:52.089118 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1fae1bb9-297c-4899-bc84-fc32f78a523f tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:52.323078 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-2d147a93-08a1-4858-afe9-7126c54eb074 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:11:52.324221 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-2d147a93-08a1-4858-afe9-7126c54eb074 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] [instance: cc7f1980-ecea-437f-ac71-0cdb6ec626b9] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:11:52.343501 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2d147a93-08a1-4858-afe9-7126c54eb074 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:52.344008 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2d147a93-08a1-4858-afe9-7126c54eb074 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:52.352101 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2d147a93-08a1-4858-afe9-7126c54eb074 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:52.355075 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2d147a93-08a1-4858-afe9-7126c54eb074 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:52.355680 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2d147a93-08a1-4858-afe9-7126c54eb074 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:52.356268 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2d147a93-08a1-4858-afe9-7126c54eb074 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:52.547819 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-2d147a93-08a1-4858-afe9-7126c54eb074 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:11:52.568359 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-1fae1bb9-297c-4899-bc84-fc32f78a523f tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/c7c717a4-9925-4455-9963-ffdcae9f06f4" status: 200 len: 1461 microversion: 2.1 time: 0.509632 Oct 22 21:11:52.573791 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-2d147a93-08a1-4858-afe9-7126c54eb074 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:11:52.574320 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2222/4419] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:11:52 2022] GET /compute/v2.1/servers/c7c717a4-9925-4455-9963-ffdcae9f06f4 => generated 1461 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:11:52.588678 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-2d147a93-08a1-4858-afe9-7126c54eb074 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:11:52.590019 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-2d147a93-08a1-4858-afe9-7126c54eb074 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] 10.222.0.18 "GET /compute/v2.1/servers/cc7f1980-ecea-437f-ac71-0cdb6ec626b9" status: 200 len: 1655 microversion: 2.20 time: 0.271815 Oct 22 21:11:52.591912 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-4fdaa188-0f95-41ba-aefa-0035de41e125 req-1cc18ec4-d5f9-47f4-937f-5c0a99233663 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc7f1980-ecea-437f-ac71-0cdb6ec626b9", "name": "network-vif-deleted", "tag": "96502a52-b9c6-4c85-9f2b-97330250e894"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:11:52.592727 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2198/4420] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:11:52 2022] GET /compute/v2.1/servers/cc7f1980-ecea-437f-ac71-0cdb6ec626b9 => generated 1655 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:11:52.610774 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-4fdaa188-0f95-41ba-aefa-0035de41e125 req-1cc18ec4-d5f9-47f4-937f-5c0a99233663 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:52.614369 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-4fdaa188-0f95-41ba-aefa-0035de41e125 req-1cc18ec4-d5f9-47f4-937f-5c0a99233663 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:52.615068 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-4fdaa188-0f95-41ba-aefa-0035de41e125 req-1cc18ec4-d5f9-47f4-937f-5c0a99233663 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:52.630693 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-4fdaa188-0f95-41ba-aefa-0035de41e125 req-1cc18ec4-d5f9-47f4-937f-5c0a99233663 service nova] Creating event network-vif-deleted:96502a52-b9c6-4c85-9f2b-97330250e894 for instance cc7f1980-ecea-437f-ac71-0cdb6ec626b9 on nch2-master-1 Oct 22 21:11:52.651151 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-a2ba2e87-c023-4661-9d4a-3ff7f327aea2 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:11:52.652008 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-a2ba2e87-c023-4661-9d4a-3ff7f327aea2 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] [instance: 4d285bc1-33a9-47e0-a148-756be61c0488] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:11:52.654940 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-4fdaa188-0f95-41ba-aefa-0035de41e125 req-1cc18ec4-d5f9-47f4-937f-5c0a99233663 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075140 Oct 22 21:11:52.656341 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2223/4421] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:11:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:11:52.671657 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-bc6a46da-1ef5-4bbd-81df-8bbed869ab3d req-5ba0c0cf-8d1a-46e9-9314-4e17d8bc947d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7c717a4-9925-4455-9963-ffdcae9f06f4", "name": "network-vif-plugged", "status": "completed", "tag": "15d85ce2-9636-48a1-8fec-cb35fe59c08b"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:11:52.673421 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a2ba2e87-c023-4661-9d4a-3ff7f327aea2 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:52.676888 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a2ba2e87-c023-4661-9d4a-3ff7f327aea2 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:52.677627 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a2ba2e87-c023-4661-9d4a-3ff7f327aea2 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:52.678579 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a2ba2e87-c023-4661-9d4a-3ff7f327aea2 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:52.679164 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a2ba2e87-c023-4661-9d4a-3ff7f327aea2 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:52.679963 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a2ba2e87-c023-4661-9d4a-3ff7f327aea2 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:52.694441 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-bc6a46da-1ef5-4bbd-81df-8bbed869ab3d req-5ba0c0cf-8d1a-46e9-9314-4e17d8bc947d service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:52.694940 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-bc6a46da-1ef5-4bbd-81df-8bbed869ab3d req-5ba0c0cf-8d1a-46e9-9314-4e17d8bc947d service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:52.700763 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-bc6a46da-1ef5-4bbd-81df-8bbed869ab3d req-5ba0c0cf-8d1a-46e9-9314-4e17d8bc947d service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:52.722733 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-bc6a46da-1ef5-4bbd-81df-8bbed869ab3d req-5ba0c0cf-8d1a-46e9-9314-4e17d8bc947d service nova] Creating event network-vif-plugged:15d85ce2-9636-48a1-8fec-cb35fe59c08b for instance c7c717a4-9925-4455-9963-ffdcae9f06f4 on nch2-master-1 Oct 22 21:11:52.730287 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-bc6a46da-1ef5-4bbd-81df-8bbed869ab3d req-5ba0c0cf-8d1a-46e9-9314-4e17d8bc947d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069748 Oct 22 21:11:52.731536 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2224/4422] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:11:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:11:53.018973 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-a2ba2e87-c023-4661-9d4a-3ff7f327aea2 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd69c1f0203b047eeb6a9fa0a215a63c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09185bfad7944b199a490305c22ffc3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:11:53.030989 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-a2ba2e87-c023-4661-9d4a-3ff7f327aea2 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd69c1f0203b047eeb6a9fa0a215a63c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09185bfad7944b199a490305c22ffc3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:11:53.035930 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-a2ba2e87-c023-4661-9d4a-3ff7f327aea2 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd69c1f0203b047eeb6a9fa0a215a63c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09185bfad7944b199a490305c22ffc3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:11:53.042733 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-a2ba2e87-c023-4661-9d4a-3ff7f327aea2 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] 10.222.0.18 "GET /compute/v2.1/servers/4d285bc1-33a9-47e0-a148-756be61c0488" status: 200 len: 1879 microversion: 2.32 time: 0.399257 Oct 22 21:11:53.052834 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2199/4423] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:11:52 2022] GET /compute/v2.1/servers/4d285bc1-33a9-47e0-a148-756be61c0488 => generated 1879 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:11:53.603746 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-eed33c89-2c4a-4b7c-a424-4b6b9249afb5 tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:11:53.605312 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-eed33c89-2c4a-4b7c-a424-4b6b9249afb5 tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] [instance: c7c717a4-9925-4455-9963-ffdcae9f06f4] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:11:53.613060 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-eed33c89-2c4a-4b7c-a424-4b6b9249afb5 tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:53.613827 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-eed33c89-2c4a-4b7c-a424-4b6b9249afb5 tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:53.614489 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-eed33c89-2c4a-4b7c-a424-4b6b9249afb5 tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:53.616043 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-eed33c89-2c4a-4b7c-a424-4b6b9249afb5 tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:53.616708 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-eed33c89-2c4a-4b7c-a424-4b6b9249afb5 tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:53.617416 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-eed33c89-2c4a-4b7c-a424-4b6b9249afb5 tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:53.621121 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-46aae944-d733-4dd6-bdd8-b91ac8d55da0 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:11:53.622243 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-46aae944-d733-4dd6-bdd8-b91ac8d55da0 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] [instance: cc7f1980-ecea-437f-ac71-0cdb6ec626b9] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:11:53.640461 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-46aae944-d733-4dd6-bdd8-b91ac8d55da0 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:53.641290 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-46aae944-d733-4dd6-bdd8-b91ac8d55da0 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:53.641739 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-46aae944-d733-4dd6-bdd8-b91ac8d55da0 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:53.652595 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-46aae944-d733-4dd6-bdd8-b91ac8d55da0 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:53.652595 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-46aae944-d733-4dd6-bdd8-b91ac8d55da0 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:53.652986 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-46aae944-d733-4dd6-bdd8-b91ac8d55da0 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:53.679614 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-46aae944-d733-4dd6-bdd8-b91ac8d55da0 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] HTTP exception thrown: Instance cc7f1980-ecea-437f-ac71-0cdb6ec626b9 could not be found. Oct 22 21:11:53.684408 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-46aae944-d733-4dd6-bdd8-b91ac8d55da0 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Request method failure captured: Oct 22 21:11:53.684408 ncdv-master-1 devstack@n-api.service[138744]: request: GET /compute/v2.1/servers/cc7f1980-ecea-437f-ac71-0cdb6ec626b9 HTTP/1.1 Oct 22 21:11:53.684408 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 21:11:53.684408 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 21:11:53.684408 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 21:11:53.684408 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 0 Oct 22 21:11:53.684408 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 21:11:53.684408 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 21:11:53.684408 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 21:11:53.684408 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 21:11:53.684408 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVFugDsWG2IAzbMUoHuuhrO6MyXdPJkrInxcOEEmhduLReIFyY--04h_-SeI5urJWlmHW7uHeD0kBGwkXZkwP_QPcuM-pJyRnDk91VX__R2vNwtxynmOyv7o9Nh6PRqtk-VcxClrEgpoCZ7vTtPisBuUTEBcpL7ZpeZr-3H2SGnoohSM Oct 22 21:11:53.684408 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 21:11:53.684408 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 21:11:53.684408 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 21:11:53.684408 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 21:11:53.684408 ncdv-master-1 devstack@n-api.service[138744]: X-Openstack-Nova-Api-Version: 2.20 Oct 22 21:11:53.684408 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 21:11:53.684408 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 21:11:53.684408 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: f7f28cafad8942518b882192687b8b77 Oct 22 21:11:53.684408 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1454811106 Oct 22 21:11:53.684408 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 21:11:53.684408 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 21:11:53.684408 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_f7f28cafad8942518b882192687b8b77"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f7f28cafad8942518b882192687b8b77"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/f7f28cafad8942518b882192687b8b77"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f7f28cafad8942518b882192687b8b77"}]}] Oct 22 21:11:53.684408 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1454811106 Oct 22 21:11:53.684408 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: f7f28cafad8942518b882192687b8b77 Oct 22 21:11:53.684408 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1454811106 Oct 22 21:11:53.684408 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-AttachVolumeShelveTestJSON-1454811106-project Oct 22 21:11:53.684408 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 21:11:53.684408 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 21:11:53.684408 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: eb24324c9c174645a3e9bc8bb913afe9 Oct 22 21:11:53.684408 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1454811106-project Oct 22 21:11:53.684408 ncdv-master-1 devstack@n-api.service[138744]: method: > Oct 22 21:11:53.684408 ncdv-master-1 devstack@n-api.service[138744]: exception: Instance cc7f1980-ecea-437f-ac71-0cdb6ec626b9 could not be found. Oct 22 21:11:53.684408 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': 'cc7f1980-ecea-437f-ac71-0cdb6ec626b9'} Oct 22 21:11:53.684408 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:11:53.684408 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:11:53.684408 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 21:11:53.684408 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 21:11:53.684408 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 21:11:53.684408 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 21:11:53.684408 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 21:11:53.684408 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 21:11:53.684408 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 21:11:53.684408 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 21:11:53.684408 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc7f1980-ecea-437f-ac71-0cdb6ec626b9 could not be found. Oct 22 21:11:53.684408 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:11:53.684408 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:11:53.684408 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:11:53.684408 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:11:53.684408 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:11:53.684408 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:11:53.684408 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:11:53.684408 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:11:53.684408 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:11:53.684408 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:11:53.684408 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 21:11:53.684408 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 21:11:53.684408 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 21:11:53.684408 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 21:11:53.684408 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 21:11:53.684408 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:11:53.684408 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc7f1980-ecea-437f-ac71-0cdb6ec626b9 could not be found. Oct 22 21:11:53.684408 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:11:53.684408 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:11:53.689296 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:11:53.689296 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:11:53.689296 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:11:53.689296 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:11:53.689296 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:11:53.689296 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:11:53.689296 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc7f1980-ecea-437f-ac71-0cdb6ec626b9 could not be found. Oct 22 21:11:53.689296 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:11:53.691986 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-46aae944-d733-4dd6-bdd8-b91ac8d55da0 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Returning 404 to user: Instance cc7f1980-ecea-437f-ac71-0cdb6ec626b9 could not be found. {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:11:53.693596 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-46aae944-d733-4dd6-bdd8-b91ac8d55da0 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] 10.222.0.18 "GET /compute/v2.1/servers/cc7f1980-ecea-437f-ac71-0cdb6ec626b9" status: 404 len: 111 microversion: 2.20 time: 0.076711 Oct 22 21:11:53.694871 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2200/4424] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:11:53 2022] GET /compute/v2.1/servers/cc7f1980-ecea-437f-ac71-0cdb6ec626b9 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 22 21:11:53.711449 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-1d3f5f9b-af4b-4212-a049-bea8ff131817 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Calling method '.version_select at 0x7fd39f1354c0>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:11:53.764327 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-1d3f5f9b-af4b-4212-a049-bea8ff131817 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-632076854" status: 204 len: 0 microversion: 2.20 time: 0.062129 Oct 22 21:11:53.765092 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2201/4425] 10.222.0.18 () {60 vars in 1259 bytes} [Sat Oct 22 21:11:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-632076854 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 22 21:11:53.835920 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-eed33c89-2c4a-4b7c-a424-4b6b9249afb5 tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/c7c717a4-9925-4455-9963-ffdcae9f06f4" status: 200 len: 1461 microversion: 2.1 time: 0.238651 Oct 22 21:11:53.837548 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2225/4426] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:11:53 2022] GET /compute/v2.1/servers/c7c717a4-9925-4455-9963-ffdcae9f06f4 => generated 1461 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:11:54.069636 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-039e4fb7-8ae8-4858-8c75-c57aa29d0cf8 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:11:54.070249 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-039e4fb7-8ae8-4858-8c75-c57aa29d0cf8 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] [instance: 4d285bc1-33a9-47e0-a148-756be61c0488] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:11:54.080737 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-039e4fb7-8ae8-4858-8c75-c57aa29d0cf8 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:54.081264 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-039e4fb7-8ae8-4858-8c75-c57aa29d0cf8 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:54.081679 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-039e4fb7-8ae8-4858-8c75-c57aa29d0cf8 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:54.082388 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-039e4fb7-8ae8-4858-8c75-c57aa29d0cf8 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:54.082847 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-039e4fb7-8ae8-4858-8c75-c57aa29d0cf8 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:54.083313 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-039e4fb7-8ae8-4858-8c75-c57aa29d0cf8 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:54.422329 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-039e4fb7-8ae8-4858-8c75-c57aa29d0cf8 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd69c1f0203b047eeb6a9fa0a215a63c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09185bfad7944b199a490305c22ffc3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:11:54.438422 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-039e4fb7-8ae8-4858-8c75-c57aa29d0cf8 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd69c1f0203b047eeb6a9fa0a215a63c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09185bfad7944b199a490305c22ffc3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:11:54.440650 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-039e4fb7-8ae8-4858-8c75-c57aa29d0cf8 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd69c1f0203b047eeb6a9fa0a215a63c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09185bfad7944b199a490305c22ffc3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:11:54.445148 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-039e4fb7-8ae8-4858-8c75-c57aa29d0cf8 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] 10.222.0.18 "GET /compute/v2.1/servers/4d285bc1-33a9-47e0-a148-756be61c0488" status: 200 len: 1879 microversion: 2.32 time: 0.380684 Oct 22 21:11:54.446323 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2202/4427] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:11:54 2022] GET /compute/v2.1/servers/4d285bc1-33a9-47e0-a148-756be61c0488 => generated 1879 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 22 21:11:54.862901 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-46cd3722-b0bb-41c1-93d3-5a41b63d1ab2 tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:11:54.863620 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-46cd3722-b0bb-41c1-93d3-5a41b63d1ab2 tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] [instance: c7c717a4-9925-4455-9963-ffdcae9f06f4] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:11:54.877027 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-46cd3722-b0bb-41c1-93d3-5a41b63d1ab2 tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:54.877573 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-46cd3722-b0bb-41c1-93d3-5a41b63d1ab2 tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:54.878037 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-46cd3722-b0bb-41c1-93d3-5a41b63d1ab2 tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:54.878788 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-46cd3722-b0bb-41c1-93d3-5a41b63d1ab2 tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:54.879298 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-46cd3722-b0bb-41c1-93d3-5a41b63d1ab2 tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:54.882860 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-46cd3722-b0bb-41c1-93d3-5a41b63d1ab2 tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:55.090383 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-46cd3722-b0bb-41c1-93d3-5a41b63d1ab2 tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/c7c717a4-9925-4455-9963-ffdcae9f06f4" status: 200 len: 1646 microversion: 2.1 time: 0.233005 Oct 22 21:11:55.090987 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2226/4428] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:11:54 2022] GET /compute/v2.1/servers/c7c717a4-9925-4455-9963-ffdcae9f06f4 => generated 1646 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:11:55.113557 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-a838bf7a-d2c9-4ce0-b180-5c317a8d0c51 tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:11:55.117742 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-a838bf7a-d2c9-4ce0-b180-5c317a8d0c51 tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] [instance: c7c717a4-9925-4455-9963-ffdcae9f06f4] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:11:55.130606 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a838bf7a-d2c9-4ce0-b180-5c317a8d0c51 tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:55.131421 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a838bf7a-d2c9-4ce0-b180-5c317a8d0c51 tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:55.131687 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a838bf7a-d2c9-4ce0-b180-5c317a8d0c51 tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:55.133802 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a838bf7a-d2c9-4ce0-b180-5c317a8d0c51 tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:55.134481 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a838bf7a-d2c9-4ce0-b180-5c317a8d0c51 tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:55.134927 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a838bf7a-d2c9-4ce0-b180-5c317a8d0c51 tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:55.301000 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-a838bf7a-d2c9-4ce0-b180-5c317a8d0c51 tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/c7c717a4-9925-4455-9963-ffdcae9f06f4" status: 200 len: 1646 microversion: 2.1 time: 0.191688 Oct 22 21:11:55.301741 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2203/4429] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:11:55 2022] GET /compute/v2.1/servers/c7c717a4-9925-4455-9963-ffdcae9f06f4 => generated 1646 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:11:55.324533 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-c584927c-6cdc-47a5-8a35-ef64ab4540c9 tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:11:55.325451 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-c584927c-6cdc-47a5-8a35-ef64ab4540c9 tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] [instance: c7c717a4-9925-4455-9963-ffdcae9f06f4] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:11:55.334374 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c584927c-6cdc-47a5-8a35-ef64ab4540c9 tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:55.335745 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c584927c-6cdc-47a5-8a35-ef64ab4540c9 tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:55.338393 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c584927c-6cdc-47a5-8a35-ef64ab4540c9 tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:55.339689 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c584927c-6cdc-47a5-8a35-ef64ab4540c9 tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:55.340402 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c584927c-6cdc-47a5-8a35-ef64ab4540c9 tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:55.341489 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c584927c-6cdc-47a5-8a35-ef64ab4540c9 tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:55.481216 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-9b2dfd8a-7df8-48b9-8ac5-ef33b7dc34ae tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:11:55.486572 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-9b2dfd8a-7df8-48b9-8ac5-ef33b7dc34ae tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] [instance: ad302c49-addb-464c-a15f-fa01577f90c4] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:11:55.501309 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9b2dfd8a-7df8-48b9-8ac5-ef33b7dc34ae tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:55.505188 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9b2dfd8a-7df8-48b9-8ac5-ef33b7dc34ae tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:55.505895 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9b2dfd8a-7df8-48b9-8ac5-ef33b7dc34ae tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:55.506862 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9b2dfd8a-7df8-48b9-8ac5-ef33b7dc34ae tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:55.507659 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9b2dfd8a-7df8-48b9-8ac5-ef33b7dc34ae tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:55.508916 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9b2dfd8a-7df8-48b9-8ac5-ef33b7dc34ae tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:55.588794 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-9b2dfd8a-7df8-48b9-8ac5-ef33b7dc34ae tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] 10.222.0.18 "GET /compute/v2.1/servers/ad302c49-addb-464c-a15f-fa01577f90c4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.112511 Oct 22 21:11:55.590558 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2204/4430] 10.222.0.18 () {58 vars in 1302 bytes} [Sat Oct 22 21:11:55 2022] GET /compute/v2.1/servers/ad302c49-addb-464c-a15f-fa01577f90c4/os-volume_attachments => generated 25 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 22 21:11:55.605865 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-c39e1908-8825-4491-a73f-acf5e2eea9f1 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:11:55.609349 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-c39e1908-8825-4491-a73f-acf5e2eea9f1 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] [instance: 4d285bc1-33a9-47e0-a148-756be61c0488] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:11:55.630884 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c39e1908-8825-4491-a73f-acf5e2eea9f1 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:55.632830 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c39e1908-8825-4491-a73f-acf5e2eea9f1 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:55.636045 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c39e1908-8825-4491-a73f-acf5e2eea9f1 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:55.647009 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c39e1908-8825-4491-a73f-acf5e2eea9f1 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:55.648577 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c39e1908-8825-4491-a73f-acf5e2eea9f1 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:55.649330 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c39e1908-8825-4491-a73f-acf5e2eea9f1 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:55.651933 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-c584927c-6cdc-47a5-8a35-ef64ab4540c9 tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/c7c717a4-9925-4455-9963-ffdcae9f06f4" status: 200 len: 1646 microversion: 2.1 time: 0.330968 Oct 22 21:11:55.653000 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2227/4431] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:11:55 2022] GET /compute/v2.1/servers/c7c717a4-9925-4455-9963-ffdcae9f06f4 => generated 1646 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:11:55.681712 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-8b7d0293-c4a1-4601-9920-c59c96d9c5b3 tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:11:55.682247 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-8b7d0293-c4a1-4601-9920-c59c96d9c5b3 tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] [instance: c7c717a4-9925-4455-9963-ffdcae9f06f4] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:11:55.704013 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8b7d0293-c4a1-4601-9920-c59c96d9c5b3 tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:55.705158 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8b7d0293-c4a1-4601-9920-c59c96d9c5b3 tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:55.705853 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8b7d0293-c4a1-4601-9920-c59c96d9c5b3 tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:55.707329 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8b7d0293-c4a1-4601-9920-c59c96d9c5b3 tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:55.708194 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8b7d0293-c4a1-4601-9920-c59c96d9c5b3 tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:55.709264 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8b7d0293-c4a1-4601-9920-c59c96d9c5b3 tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:55.738590 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-8b7d0293-c4a1-4601-9920-c59c96d9c5b3 tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] [instance: c7c717a4-9925-4455-9963-ffdcae9f06f4] Going to try to terminate instance {{(pid=138745) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 21:11:55.847671 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-8b7d0293-c4a1-4601-9920-c59c96d9c5b3 tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] 10.222.0.18 "DELETE /compute/v2.1/servers/c7c717a4-9925-4455-9963-ffdcae9f06f4" status: 204 len: 0 microversion: 2.1 time: 0.170783 Oct 22 21:11:55.848450 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2228/4432] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 21:11:55 2022] DELETE /compute/v2.1/servers/c7c717a4-9925-4455-9963-ffdcae9f06f4 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 21:11:55.860795 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-ec51d1ea-4a6e-4472-a0c0-a5bbde4092ed tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Action: 'create', calling method: .version_select at 0x7fd39edcaca0>, body: {"keypair": {"name": "tempest-keypair-825925012", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOuN3b8ApTINCmzycAlR8qkRYA6TgMR2fuiddrJif57u7kaifTtVLQasOdyyYjBKSQgKDy091pH03rra52LuhDro/bww2hgwWCABf2KiqjMJecsmzLJeOS1C4W1XnRbWDA=="}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:11:55.881508 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-ec51d1ea-4a6e-4472-a0c0-a5bbde4092ed tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Getting quotas for project f7f28cafad8942518b882192687b8b77. Resources: {'key_pairs'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 21:11:55.890675 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-ec51d1ea-4a6e-4472-a0c0-a5bbde4092ed tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Getting quotas for user eb24324c9c174645a3e9bc8bb913afe9 and project f7f28cafad8942518b882192687b8b77. Resources: {'key_pairs'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 21:11:55.926651 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-ec51d1ea-4a6e-4472-a0c0-a5bbde4092ed tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.073282 Oct 22 21:11:55.927935 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2229/4433] 10.222.0.18 () {62 vars in 1200 bytes} [Sat Oct 22 21:11:55 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 79 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 22 21:11:55.953320 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-daa2df7f-bc64-443a-9e63-abec124be7be tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:11:55.955626 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-daa2df7f-bc64-443a-9e63-abec124be7be tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] [instance: ad302c49-addb-464c-a15f-fa01577f90c4] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:11:55.968893 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-daa2df7f-bc64-443a-9e63-abec124be7be tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:55.970337 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-daa2df7f-bc64-443a-9e63-abec124be7be tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:55.970950 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-daa2df7f-bc64-443a-9e63-abec124be7be tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:55.972634 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-daa2df7f-bc64-443a-9e63-abec124be7be tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:55.973237 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-daa2df7f-bc64-443a-9e63-abec124be7be tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:55.973825 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-daa2df7f-bc64-443a-9e63-abec124be7be tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:56.024398 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-daa2df7f-bc64-443a-9e63-abec124be7be tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] [instance: ad302c49-addb-464c-a15f-fa01577f90c4] Going to try to terminate instance {{(pid=138745) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 21:11:56.094061 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-c39e1908-8825-4491-a73f-acf5e2eea9f1 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd69c1f0203b047eeb6a9fa0a215a63c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09185bfad7944b199a490305c22ffc3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:11:56.113594 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-c39e1908-8825-4491-a73f-acf5e2eea9f1 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd69c1f0203b047eeb6a9fa0a215a63c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09185bfad7944b199a490305c22ffc3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:11:56.116751 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-c39e1908-8825-4491-a73f-acf5e2eea9f1 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd69c1f0203b047eeb6a9fa0a215a63c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09185bfad7944b199a490305c22ffc3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:11:56.119669 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-c39e1908-8825-4491-a73f-acf5e2eea9f1 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] 10.222.0.18 "GET /compute/v2.1/servers/4d285bc1-33a9-47e0-a148-756be61c0488" status: 200 len: 1879 microversion: 2.32 time: 0.527028 Oct 22 21:11:56.120635 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2205/4434] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:11:55 2022] GET /compute/v2.1/servers/4d285bc1-33a9-47e0-a148-756be61c0488 => generated 1879 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:11:56.126670 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-7707f9f4-ee66-4c29-be22-9deb17d3e39e tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:11:56.127646 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-7707f9f4-ee66-4c29-be22-9deb17d3e39e tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] [instance: c7c717a4-9925-4455-9963-ffdcae9f06f4] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:11:56.150554 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7707f9f4-ee66-4c29-be22-9deb17d3e39e tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:56.151733 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7707f9f4-ee66-4c29-be22-9deb17d3e39e tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:56.152624 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7707f9f4-ee66-4c29-be22-9deb17d3e39e tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:56.153845 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7707f9f4-ee66-4c29-be22-9deb17d3e39e tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:56.154704 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7707f9f4-ee66-4c29-be22-9deb17d3e39e tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:56.155430 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7707f9f4-ee66-4c29-be22-9deb17d3e39e tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:56.187978 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-daa2df7f-bc64-443a-9e63-abec124be7be tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] 10.222.0.18 "DELETE /compute/v2.1/servers/ad302c49-addb-464c-a15f-fa01577f90c4" status: 204 len: 0 microversion: 2.1 time: 0.258349 Oct 22 21:11:56.188638 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2230/4435] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 21:11:55 2022] DELETE /compute/v2.1/servers/ad302c49-addb-464c-a15f-fa01577f90c4 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 21:11:56.205434 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-d379bcb8-7b1a-4931-becc-6ca48dcc2bbe tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:11:56.209013 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-d379bcb8-7b1a-4931-becc-6ca48dcc2bbe tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] [instance: ad302c49-addb-464c-a15f-fa01577f90c4] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:11:56.226698 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d379bcb8-7b1a-4931-becc-6ca48dcc2bbe tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:56.228427 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d379bcb8-7b1a-4931-becc-6ca48dcc2bbe tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:56.230063 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d379bcb8-7b1a-4931-becc-6ca48dcc2bbe tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:56.233104 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d379bcb8-7b1a-4931-becc-6ca48dcc2bbe tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:56.234748 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d379bcb8-7b1a-4931-becc-6ca48dcc2bbe tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:56.237465 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d379bcb8-7b1a-4931-becc-6ca48dcc2bbe tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:56.580522 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-7707f9f4-ee66-4c29-be22-9deb17d3e39e tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/c7c717a4-9925-4455-9963-ffdcae9f06f4" status: 200 len: 1652 microversion: 2.1 time: 0.458130 Oct 22 21:11:56.584406 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2206/4436] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:11:56 2022] GET /compute/v2.1/servers/c7c717a4-9925-4455-9963-ffdcae9f06f4 => generated 1652 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:11:56.641544 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-d379bcb8-7b1a-4931-becc-6ca48dcc2bbe tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0d0bdfb04240209e4efa92f47cbb94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755501ba3e344f1aaf7ef80924bb57d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:11:56.656314 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-d379bcb8-7b1a-4931-becc-6ca48dcc2bbe tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] 10.222.0.18 "GET /compute/v2.1/servers/ad302c49-addb-464c-a15f-fa01577f90c4" status: 200 len: 1671 microversion: 2.1 time: 0.461289 Oct 22 21:11:56.660459 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2231/4437] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:11:56 2022] GET /compute/v2.1/servers/ad302c49-addb-464c-a15f-fa01577f90c4 => generated 1671 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:11:57.156667 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-1f63f53b-f954-410b-ba2a-b61ff343c227 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:11:57.158688 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-1f63f53b-f954-410b-ba2a-b61ff343c227 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] [instance: 4d285bc1-33a9-47e0-a148-756be61c0488] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:11:57.173416 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1f63f53b-f954-410b-ba2a-b61ff343c227 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:57.174715 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1f63f53b-f954-410b-ba2a-b61ff343c227 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:57.175618 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1f63f53b-f954-410b-ba2a-b61ff343c227 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:57.176616 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1f63f53b-f954-410b-ba2a-b61ff343c227 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:57.177243 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1f63f53b-f954-410b-ba2a-b61ff343c227 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:57.177830 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1f63f53b-f954-410b-ba2a-b61ff343c227 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:57.616764 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-2f80abdc-e1e0-4def-b0c9-0e51a504dfae tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:11:57.617180 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-2f80abdc-e1e0-4def-b0c9-0e51a504dfae tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] [instance: c7c717a4-9925-4455-9963-ffdcae9f06f4] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:11:57.627002 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2f80abdc-e1e0-4def-b0c9-0e51a504dfae tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:57.628454 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2f80abdc-e1e0-4def-b0c9-0e51a504dfae tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:57.629607 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2f80abdc-e1e0-4def-b0c9-0e51a504dfae tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:57.632482 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2f80abdc-e1e0-4def-b0c9-0e51a504dfae tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:57.636351 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2f80abdc-e1e0-4def-b0c9-0e51a504dfae tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:57.638141 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2f80abdc-e1e0-4def-b0c9-0e51a504dfae tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:57.976374 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-1f63f53b-f954-410b-ba2a-b61ff343c227 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd69c1f0203b047eeb6a9fa0a215a63c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09185bfad7944b199a490305c22ffc3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:11:57.989881 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-1f63f53b-f954-410b-ba2a-b61ff343c227 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd69c1f0203b047eeb6a9fa0a215a63c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09185bfad7944b199a490305c22ffc3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:11:57.991852 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-1f63f53b-f954-410b-ba2a-b61ff343c227 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd69c1f0203b047eeb6a9fa0a215a63c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09185bfad7944b199a490305c22ffc3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:11:57.993258 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-1f63f53b-f954-410b-ba2a-b61ff343c227 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] 10.222.0.18 "GET /compute/v2.1/servers/4d285bc1-33a9-47e0-a148-756be61c0488" status: 200 len: 1879 microversion: 2.32 time: 0.847069 Oct 22 21:11:57.997522 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2207/4438] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:11:57 2022] GET /compute/v2.1/servers/4d285bc1-33a9-47e0-a148-756be61c0488 => generated 1879 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:11:58.011519 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-f86b227a-238f-47ec-9df8-183595541280 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:11:58.012587 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-f86b227a-238f-47ec-9df8-183595541280 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] [instance: ad302c49-addb-464c-a15f-fa01577f90c4] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:11:58.022914 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f86b227a-238f-47ec-9df8-183595541280 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:58.024064 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f86b227a-238f-47ec-9df8-183595541280 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:58.024778 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f86b227a-238f-47ec-9df8-183595541280 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:58.025905 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f86b227a-238f-47ec-9df8-183595541280 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:58.026898 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f86b227a-238f-47ec-9df8-183595541280 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:58.027703 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f86b227a-238f-47ec-9df8-183595541280 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:58.060697 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-2f80abdc-e1e0-4def-b0c9-0e51a504dfae tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/c7c717a4-9925-4455-9963-ffdcae9f06f4" status: 200 len: 1652 microversion: 2.1 time: 0.450103 Oct 22 21:11:58.067104 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2232/4439] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:11:57 2022] GET /compute/v2.1/servers/c7c717a4-9925-4455-9963-ffdcae9f06f4 => generated 1652 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:11:58.080482 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-0c7cfbe8-fc26-4b96-a835-e10e7b90652f tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1493854205", "imageRef": "085e4478-6edc-4a69-8e08-f9831713eb65", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b0b78097-ffa0-4066-b6da-bef483f12519"}], "security_groups": [{"name": "tempest-securitygroup--1191868152"}], "key_name": "tempest-keypair-825925012", "user_data": "}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:11:58.274449 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.network.neutron [None req-0c7cfbe8-fc26-4b96-a835-e10e7b90652f tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] validate_networks() for [('b0b78097-ffa0-4066-b6da-bef483f12519', None, None, None, None, None)] {{(pid=138745) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 21:11:58.421024 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-f86b227a-238f-47ec-9df8-183595541280 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0d0bdfb04240209e4efa92f47cbb94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755501ba3e344f1aaf7ef80924bb57d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:11:58.440602 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-f86b227a-238f-47ec-9df8-183595541280 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] 10.222.0.18 "GET /compute/v2.1/servers/ad302c49-addb-464c-a15f-fa01577f90c4" status: 200 len: 1671 microversion: 2.1 time: 0.440909 Oct 22 21:11:58.441868 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2208/4440] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:11:57 2022] GET /compute/v2.1/servers/ad302c49-addb-464c-a15f-fa01577f90c4 => generated 1671 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:11:58.950905 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-03029065-5e0d-4715-bba1-e6e676422e3a req-9010dbeb-cdd7-4081-9893-f26d65df8688 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7c717a4-9925-4455-9963-ffdcae9f06f4", "name": "network-vif-deleted", "tag": "15d85ce2-9636-48a1-8fec-cb35fe59c08b"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:11:58.973079 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-03029065-5e0d-4715-bba1-e6e676422e3a req-9010dbeb-cdd7-4081-9893-f26d65df8688 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:58.974219 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-03029065-5e0d-4715-bba1-e6e676422e3a req-9010dbeb-cdd7-4081-9893-f26d65df8688 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:58.974911 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-03029065-5e0d-4715-bba1-e6e676422e3a req-9010dbeb-cdd7-4081-9893-f26d65df8688 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:59.010417 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-03029065-5e0d-4715-bba1-e6e676422e3a req-9010dbeb-cdd7-4081-9893-f26d65df8688 service nova] Creating event network-vif-deleted:15d85ce2-9636-48a1-8fec-cb35fe59c08b for instance c7c717a4-9925-4455-9963-ffdcae9f06f4 on nch2-master-1 Oct 22 21:11:59.035647 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-03029065-5e0d-4715-bba1-e6e676422e3a req-9010dbeb-cdd7-4081-9893-f26d65df8688 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084740 Oct 22 21:11:59.040318 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2209/4441] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:11:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 21:11:59.048587 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-15e7786a-a1f0-4025-bddb-a5ab9b65a2dd tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:11:59.049449 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-15e7786a-a1f0-4025-bddb-a5ab9b65a2dd tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] [instance: 4d285bc1-33a9-47e0-a148-756be61c0488] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:11:59.057997 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-15e7786a-a1f0-4025-bddb-a5ab9b65a2dd tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:59.060967 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-15e7786a-a1f0-4025-bddb-a5ab9b65a2dd tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:59.079080 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-15e7786a-a1f0-4025-bddb-a5ab9b65a2dd tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:59.081827 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-15e7786a-a1f0-4025-bddb-a5ab9b65a2dd tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:59.092765 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-15e7786a-a1f0-4025-bddb-a5ab9b65a2dd tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:59.093716 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-15e7786a-a1f0-4025-bddb-a5ab9b65a2dd tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:59.544674 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-15e7786a-a1f0-4025-bddb-a5ab9b65a2dd tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd69c1f0203b047eeb6a9fa0a215a63c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09185bfad7944b199a490305c22ffc3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:11:59.556137 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-15e7786a-a1f0-4025-bddb-a5ab9b65a2dd tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd69c1f0203b047eeb6a9fa0a215a63c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09185bfad7944b199a490305c22ffc3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:11:59.558213 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-15e7786a-a1f0-4025-bddb-a5ab9b65a2dd tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd69c1f0203b047eeb6a9fa0a215a63c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09185bfad7944b199a490305c22ffc3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:11:59.559774 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-15e7786a-a1f0-4025-bddb-a5ab9b65a2dd tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] 10.222.0.18 "GET /compute/v2.1/servers/4d285bc1-33a9-47e0-a148-756be61c0488" status: 200 len: 1879 microversion: 2.32 time: 0.518080 Oct 22 21:11:59.579178 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2210/4442] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:11:59 2022] GET /compute/v2.1/servers/4d285bc1-33a9-47e0-a148-756be61c0488 => generated 1879 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:11:59.585103 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-4425c8c0-1900-4f4c-a9b4-b822642ff46b tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:11:59.585719 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-4425c8c0-1900-4f4c-a9b4-b822642ff46b tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] [instance: c7c717a4-9925-4455-9963-ffdcae9f06f4] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:11:59.592817 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4425c8c0-1900-4f4c-a9b4-b822642ff46b tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:59.593685 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4425c8c0-1900-4f4c-a9b4-b822642ff46b tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:59.594324 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4425c8c0-1900-4f4c-a9b4-b822642ff46b tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:59.595404 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4425c8c0-1900-4f4c-a9b4-b822642ff46b tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:59.595839 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4425c8c0-1900-4f4c-a9b4-b822642ff46b tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:59.596437 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4425c8c0-1900-4f4c-a9b4-b822642ff46b tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:59.617905 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:SELECT=100 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:11:59.633540 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4425c8c0-1900-4f4c-a9b4-b822642ff46b tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:59.634368 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4425c8c0-1900-4f4c-a9b4-b822642ff46b tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:59.634809 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4425c8c0-1900-4f4c-a9b4-b822642ff46b tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:59.635325 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.objects.instance [None req-4425c8c0-1900-4f4c-a9b4-b822642ff46b tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Lazy-loading 'fault' on Instance uuid c7c717a4-9925-4455-9963-ffdcae9f06f4 {{(pid=138744) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 21:11:59.702513 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-0c7cfbe8-fc26-4b96-a835-e10e7b90652f tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Flavor limits 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 21:11:59.706043 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-0c7cfbe8-fc26-4b96-a835-e10e7b90652f tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Image limits 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 21:11:59.707969 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-0c7cfbe8-fc26-4b96-a835-e10e7b90652f tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Flavor pref 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 21:11:59.709375 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-0c7cfbe8-fc26-4b96-a835-e10e7b90652f tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Image pref 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 21:11:59.710332 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-0c7cfbe8-fc26-4b96-a835-e10e7b90652f tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 21:11:59.724750 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-4425c8c0-1900-4f4c-a9b4-b822642ff46b tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/c7c717a4-9925-4455-9963-ffdcae9f06f4" status: 200 len: 1451 microversion: 2.1 time: 0.142730 Oct 22 21:11:59.732445 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2211/4443] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:11:59 2022] GET /compute/v2.1/servers/c7c717a4-9925-4455-9963-ffdcae9f06f4 => generated 1451 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:11:59.733245 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0c7cfbe8-fc26-4b96-a835-e10e7b90652f tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:59.734107 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0c7cfbe8-fc26-4b96-a835-e10e7b90652f tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:59.734785 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0c7cfbe8-fc26-4b96-a835-e10e7b90652f tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:59.735925 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0c7cfbe8-fc26-4b96-a835-e10e7b90652f tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:59.736629 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0c7cfbe8-fc26-4b96-a835-e10e7b90652f tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:59.737289 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0c7cfbe8-fc26-4b96-a835-e10e7b90652f tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:59.743750 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-d25ddede-1f67-4aa1-9272-e9c98b2d4e43 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:11:59.745141 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-d25ddede-1f67-4aa1-9272-e9c98b2d4e43 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] [instance: ad302c49-addb-464c-a15f-fa01577f90c4] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:11:59.754058 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d25ddede-1f67-4aa1-9272-e9c98b2d4e43 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:59.754809 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d25ddede-1f67-4aa1-9272-e9c98b2d4e43 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:59.755467 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d25ddede-1f67-4aa1-9272-e9c98b2d4e43 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:59.756388 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d25ddede-1f67-4aa1-9272-e9c98b2d4e43 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:11:59.757051 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d25ddede-1f67-4aa1-9272-e9c98b2d4e43 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:11:59.757639 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d25ddede-1f67-4aa1-9272-e9c98b2d4e43 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:11:59.761489 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-0c7cfbe8-fc26-4b96-a835-e10e7b90652f tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Getting quotas for project f7f28cafad8942518b882192687b8b77. Resources: {'cores', 'instances', 'ram'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 21:11:59.792038 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-0c7cfbe8-fc26-4b96-a835-e10e7b90652f tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Getting quotas for user eb24324c9c174645a3e9bc8bb913afe9 and project f7f28cafad8942518b882192687b8b77. Resources: {'cores', 'instances', 'ram'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 21:11:59.799056 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=3,nova_api:INSERT=1 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:11:59.833352 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-0c7cfbe8-fc26-4b96-a835-e10e7b90652f tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Going to run 1 instances... {{(pid=138745) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 21:11:59.841756 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-0c7cfbe8-fc26-4b96-a835-e10e7b90652f tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] [instance: 34dcd1da-b94c-426b-b08b-204ea287c8a2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='085e4478-6edc-4a69-8e08-f9831713eb65',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138745) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 21:11:59.913069 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-0c7cfbe8-fc26-4b96-a835-e10e7b90652f tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.844119 Oct 22 21:11:59.920366 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2233/4444] 10.222.0.18 () {62 vars in 1188 bytes} [Sat Oct 22 21:11:58 2022] POST /compute/v2.1/servers => generated 402 bytes in 1847 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 22 21:11:59.932200 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-9bef1e62-9da0-446a-91fa-6bbe8aae4eab tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:11:59.933666 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-9bef1e62-9da0-446a-91fa-6bbe8aae4eab tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] [instance: 34dcd1da-b94c-426b-b08b-204ea287c8a2] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:12:00.063811 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-9bef1e62-9da0-446a-91fa-6bbe8aae4eab tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:12:00.083488 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-9bef1e62-9da0-446a-91fa-6bbe8aae4eab tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:12:00.085354 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-9bef1e62-9da0-446a-91fa-6bbe8aae4eab tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:12:00.086791 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-9bef1e62-9da0-446a-91fa-6bbe8aae4eab tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] 10.222.0.18 "GET /compute/v2.1/servers/34dcd1da-b94c-426b-b08b-204ea287c8a2" status: 200 len: 1281 microversion: 2.20 time: 0.164197 Oct 22 21:12:00.087609 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2234/4445] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:11:59 2022] GET /compute/v2.1/servers/34dcd1da-b94c-426b-b08b-204ea287c8a2 => generated 1281 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:12:00.139163 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-d25ddede-1f67-4aa1-9272-e9c98b2d4e43 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0d0bdfb04240209e4efa92f47cbb94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755501ba3e344f1aaf7ef80924bb57d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:12:00.150638 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-d25ddede-1f67-4aa1-9272-e9c98b2d4e43 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] 10.222.0.18 "GET /compute/v2.1/servers/ad302c49-addb-464c-a15f-fa01577f90c4" status: 200 len: 1671 microversion: 2.1 time: 0.416491 Oct 22 21:12:00.154048 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2212/4446] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:11:59 2022] GET /compute/v2.1/servers/ad302c49-addb-464c-a15f-fa01577f90c4 => generated 1671 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:12:00.591108 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-54a89d8f-507f-4758-8839-2c44cdf041d7 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:12:00.592326 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-54a89d8f-507f-4758-8839-2c44cdf041d7 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] [instance: 4d285bc1-33a9-47e0-a148-756be61c0488] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:12:00.603628 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-54a89d8f-507f-4758-8839-2c44cdf041d7 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:12:00.605172 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-54a89d8f-507f-4758-8839-2c44cdf041d7 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:12:00.606534 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-54a89d8f-507f-4758-8839-2c44cdf041d7 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:12:00.608200 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-54a89d8f-507f-4758-8839-2c44cdf041d7 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:12:00.609523 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-54a89d8f-507f-4758-8839-2c44cdf041d7 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:12:00.612078 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-54a89d8f-507f-4758-8839-2c44cdf041d7 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:12:00.754159 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-a93f1f67-0255-4ef0-9888-ca444784f6f1 tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:12:00.754730 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-a93f1f67-0255-4ef0-9888-ca444784f6f1 tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] [instance: c7c717a4-9925-4455-9963-ffdcae9f06f4] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:12:00.777867 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a93f1f67-0255-4ef0-9888-ca444784f6f1 tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:12:00.785427 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a93f1f67-0255-4ef0-9888-ca444784f6f1 tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:12:00.787680 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a93f1f67-0255-4ef0-9888-ca444784f6f1 tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:12:00.789068 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a93f1f67-0255-4ef0-9888-ca444784f6f1 tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:12:00.789808 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a93f1f67-0255-4ef0-9888-ca444784f6f1 tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:12:00.790353 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a93f1f67-0255-4ef0-9888-ca444784f6f1 tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:12:00.841417 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-a93f1f67-0255-4ef0-9888-ca444784f6f1 tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] HTTP exception thrown: Instance c7c717a4-9925-4455-9963-ffdcae9f06f4 could not be found. Oct 22 21:12:00.843623 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-a93f1f67-0255-4ef0-9888-ca444784f6f1 tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Request method failure captured: Oct 22 21:12:00.843623 ncdv-master-1 devstack@n-api.service[138744]: request: GET /compute/v2.1/servers/c7c717a4-9925-4455-9963-ffdcae9f06f4 HTTP/1.1 Oct 22 21:12:00.843623 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 21:12:00.843623 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 21:12:00.843623 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 21:12:00.843623 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 0 Oct 22 21:12:00.843623 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 21:12:00.843623 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 21:12:00.843623 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 21:12:00.843623 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 21:12:00.843623 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVFxzJCjpqnOJwZ7fhwvxHalnJDslZGEM8q2jsDyatwq05S8MEWErikELmkotxvaa_2t2KYMQ3icTz7WwKm3d6Dx2Nb1g-yxFiSG5tnpLZcPVb86y86Mw1USrBc-COad4tfPlLc2EXK1uZs-_eD4q_3g9tdvOF67uoPtMkbb16Us8BTI Oct 22 21:12:00.843623 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 21:12:00.843623 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 21:12:00.843623 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 21:12:00.843623 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 21:12:00.843623 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 21:12:00.843623 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 21:12:00.843623 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: 5824d7d0370d430dba4f1e36acca8f8c Oct 22 21:12:00.843623 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-TestServerMultinode-831239059 Oct 22 21:12:00.843623 ncdv-master-1 devstack@n-api.service[138744]: X-Role: admin,member,reader Oct 22 21:12:00.843623 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: admin,member,reader Oct 22 21:12:00.843623 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_5824d7d0370d430dba4f1e36acca8f8c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5824d7d0370d430dba4f1e36acca8f8c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/5824d7d0370d430dba4f1e36acca8f8c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5824d7d0370d430dba4f1e36acca8f8c"}]}] Oct 22 21:12:00.843623 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-TestServerMultinode-831239059 Oct 22 21:12:00.843623 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: 5824d7d0370d430dba4f1e36acca8f8c Oct 22 21:12:00.843623 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-TestServerMultinode-831239059 Oct 22 21:12:00.843623 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-TestServerMultinode-831239059-project-admin Oct 22 21:12:00.843623 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 21:12:00.843623 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 21:12:00.843623 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: 7c54ba11e3454a8cb83fd56bc73d812f Oct 22 21:12:00.843623 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-TestServerMultinode-831239059-project-admin Oct 22 21:12:00.843623 ncdv-master-1 devstack@n-api.service[138744]: method: > Oct 22 21:12:00.843623 ncdv-master-1 devstack@n-api.service[138744]: exception: Instance c7c717a4-9925-4455-9963-ffdcae9f06f4 could not be found. Oct 22 21:12:00.843623 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': 'c7c717a4-9925-4455-9963-ffdcae9f06f4'} Oct 22 21:12:00.843623 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:12:00.843623 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:12:00.843623 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 21:12:00.843623 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 21:12:00.843623 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 21:12:00.843623 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 21:12:00.843623 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 21:12:00.843623 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 21:12:00.843623 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 21:12:00.843623 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 21:12:00.843623 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c7c717a4-9925-4455-9963-ffdcae9f06f4 could not be found. Oct 22 21:12:00.843623 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:12:00.843623 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:12:00.843623 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:12:00.843623 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:12:00.843623 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:12:00.843623 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:12:00.843623 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:12:00.843623 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:12:00.843623 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:12:00.843623 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:12:00.843623 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 21:12:00.843623 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 21:12:00.843623 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 21:12:00.843623 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 21:12:00.843623 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 21:12:00.843623 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:12:00.843623 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c7c717a4-9925-4455-9963-ffdcae9f06f4 could not be found. Oct 22 21:12:00.843623 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:12:00.843623 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:12:00.843623 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:12:00.849516 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:12:00.849516 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:12:00.849516 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:12:00.849516 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:12:00.849516 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:12:00.849516 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c7c717a4-9925-4455-9963-ffdcae9f06f4 could not be found. Oct 22 21:12:00.849516 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:12:00.851803 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-a93f1f67-0255-4ef0-9888-ca444784f6f1 tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Returning 404 to user: Instance c7c717a4-9925-4455-9963-ffdcae9f06f4 could not be found. {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:12:00.853013 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-a93f1f67-0255-4ef0-9888-ca444784f6f1 tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/c7c717a4-9925-4455-9963-ffdcae9f06f4" status: 404 len: 111 microversion: 2.1 time: 0.103555 Oct 22 21:12:00.858834 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2213/4447] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:12:00 2022] GET /compute/v2.1/servers/c7c717a4-9925-4455-9963-ffdcae9f06f4 => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 21:12:00.872410 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-d04eb984-c34d-439a-a1a8-5f36d09afeaf tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:12:00.876377 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-d04eb984-c34d-439a-a1a8-5f36d09afeaf tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] [instance: 44a9d1f4-4298-4e12-b656-5c1b999c9ba8] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:12:00.898866 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d04eb984-c34d-439a-a1a8-5f36d09afeaf tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:12:00.899409 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d04eb984-c34d-439a-a1a8-5f36d09afeaf tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:12:00.899962 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d04eb984-c34d-439a-a1a8-5f36d09afeaf tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:12:00.902232 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d04eb984-c34d-439a-a1a8-5f36d09afeaf tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:12:00.903698 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d04eb984-c34d-439a-a1a8-5f36d09afeaf tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:12:00.904118 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d04eb984-c34d-439a-a1a8-5f36d09afeaf tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:12:00.957921 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-d04eb984-c34d-439a-a1a8-5f36d09afeaf tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] [instance: 44a9d1f4-4298-4e12-b656-5c1b999c9ba8] Going to try to terminate instance {{(pid=138744) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 21:12:01.137052 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-d04eb984-c34d-439a-a1a8-5f36d09afeaf tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] 10.222.0.18 "DELETE /compute/v2.1/servers/44a9d1f4-4298-4e12-b656-5c1b999c9ba8" status: 204 len: 0 microversion: 2.1 time: 0.272087 Oct 22 21:12:01.141111 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2214/4448] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 21:12:00 2022] DELETE /compute/v2.1/servers/44a9d1f4-4298-4e12-b656-5c1b999c9ba8 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 21:12:01.159714 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-e41a3c5d-66d4-4914-b9cd-c8b439e5d950 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:12:01.161359 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-e41a3c5d-66d4-4914-b9cd-c8b439e5d950 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] [instance: 34dcd1da-b94c-426b-b08b-204ea287c8a2] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:12:01.184759 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e41a3c5d-66d4-4914-b9cd-c8b439e5d950 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:12:01.192879 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e41a3c5d-66d4-4914-b9cd-c8b439e5d950 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:12:01.193405 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e41a3c5d-66d4-4914-b9cd-c8b439e5d950 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:12:01.194277 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e41a3c5d-66d4-4914-b9cd-c8b439e5d950 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:12:01.194849 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e41a3c5d-66d4-4914-b9cd-c8b439e5d950 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:12:01.195480 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e41a3c5d-66d4-4914-b9cd-c8b439e5d950 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:12:01.263744 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-54a89d8f-507f-4758-8839-2c44cdf041d7 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd69c1f0203b047eeb6a9fa0a215a63c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09185bfad7944b199a490305c22ffc3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:12:01.291967 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-54a89d8f-507f-4758-8839-2c44cdf041d7 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd69c1f0203b047eeb6a9fa0a215a63c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09185bfad7944b199a490305c22ffc3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:12:01.298613 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-54a89d8f-507f-4758-8839-2c44cdf041d7 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd69c1f0203b047eeb6a9fa0a215a63c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09185bfad7944b199a490305c22ffc3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:12:01.303800 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-54a89d8f-507f-4758-8839-2c44cdf041d7 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] 10.222.0.18 "GET /compute/v2.1/servers/4d285bc1-33a9-47e0-a148-756be61c0488" status: 200 len: 1879 microversion: 2.32 time: 0.721353 Oct 22 21:12:01.305109 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2235/4449] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:12:00 2022] GET /compute/v2.1/servers/4d285bc1-33a9-47e0-a148-756be61c0488 => generated 1879 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:12:01.320628 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-aa7c915c-b138-411f-871e-ffc446cfb707 tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:12:01.321555 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-aa7c915c-b138-411f-871e-ffc446cfb707 tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] [instance: 44a9d1f4-4298-4e12-b656-5c1b999c9ba8] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:12:01.340980 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-aa7c915c-b138-411f-871e-ffc446cfb707 tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:12:01.342543 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-aa7c915c-b138-411f-871e-ffc446cfb707 tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:12:01.343758 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-aa7c915c-b138-411f-871e-ffc446cfb707 tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:12:01.344880 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-aa7c915c-b138-411f-871e-ffc446cfb707 tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:12:01.345449 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-aa7c915c-b138-411f-871e-ffc446cfb707 tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:12:01.346128 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-aa7c915c-b138-411f-871e-ffc446cfb707 tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:12:01.355797 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-e41a3c5d-66d4-4914-b9cd-c8b439e5d950 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:12:01.365015 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-e41a3c5d-66d4-4914-b9cd-c8b439e5d950 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:12:01.366439 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-e41a3c5d-66d4-4914-b9cd-c8b439e5d950 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:12:01.367807 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-e41a3c5d-66d4-4914-b9cd-c8b439e5d950 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] 10.222.0.18 "GET /compute/v2.1/servers/34dcd1da-b94c-426b-b08b-204ea287c8a2" status: 200 len: 1333 microversion: 2.20 time: 0.226100 Oct 22 21:12:01.378062 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2215/4450] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:12:01 2022] GET /compute/v2.1/servers/34dcd1da-b94c-426b-b08b-204ea287c8a2 => generated 1333 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:12:01.378062 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-0f3c799a-8869-4e88-ad46-956a01bc8249 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:12:01.378062 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-0f3c799a-8869-4e88-ad46-956a01bc8249 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] [instance: ad302c49-addb-464c-a15f-fa01577f90c4] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:12:01.386818 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0f3c799a-8869-4e88-ad46-956a01bc8249 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:12:01.387142 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0f3c799a-8869-4e88-ad46-956a01bc8249 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:12:01.387901 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0f3c799a-8869-4e88-ad46-956a01bc8249 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:12:01.389001 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0f3c799a-8869-4e88-ad46-956a01bc8249 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:12:01.389767 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0f3c799a-8869-4e88-ad46-956a01bc8249 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:12:01.390449 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0f3c799a-8869-4e88-ad46-956a01bc8249 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:12:01.496429 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-0f3c799a-8869-4e88-ad46-956a01bc8249 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0d0bdfb04240209e4efa92f47cbb94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755501ba3e344f1aaf7ef80924bb57d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:12:01.508328 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-0f3c799a-8869-4e88-ad46-956a01bc8249 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] 10.222.0.18 "GET /compute/v2.1/servers/ad302c49-addb-464c-a15f-fa01577f90c4" status: 200 len: 1604 microversion: 2.1 time: 0.138262 Oct 22 21:12:01.509386 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2216/4451] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:12:01 2022] GET /compute/v2.1/servers/ad302c49-addb-464c-a15f-fa01577f90c4 => generated 1604 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:12:01.533024 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-e6ed57e1-8a97-4944-a6cd-5cbfaf6c1795 req-56422cdb-dee8-404b-b9f4-1f521892ae27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad302c49-addb-464c-a15f-fa01577f90c4", "name": "network-vif-deleted", "tag": "f6f36de6-f297-4ad8-a5a7-45c041622a1f"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:12:01.547025 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-e6ed57e1-8a97-4944-a6cd-5cbfaf6c1795 req-56422cdb-dee8-404b-b9f4-1f521892ae27 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:12:01.547908 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-e6ed57e1-8a97-4944-a6cd-5cbfaf6c1795 req-56422cdb-dee8-404b-b9f4-1f521892ae27 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:12:01.548575 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-e6ed57e1-8a97-4944-a6cd-5cbfaf6c1795 req-56422cdb-dee8-404b-b9f4-1f521892ae27 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:12:01.564448 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-e6ed57e1-8a97-4944-a6cd-5cbfaf6c1795 req-56422cdb-dee8-404b-b9f4-1f521892ae27 service nova] Creating event network-vif-deleted:f6f36de6-f297-4ad8-a5a7-45c041622a1f for instance ad302c49-addb-464c-a15f-fa01577f90c4 on nch1-master-1 Oct 22 21:12:01.570737 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-e6ed57e1-8a97-4944-a6cd-5cbfaf6c1795 req-56422cdb-dee8-404b-b9f4-1f521892ae27 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044699 Oct 22 21:12:01.572121 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2217/4452] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:12:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:12:01.628420 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-aa7c915c-b138-411f-871e-ffc446cfb707 tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/44a9d1f4-4298-4e12-b656-5c1b999c9ba8" status: 200 len: 1655 microversion: 2.1 time: 0.320767 Oct 22 21:12:01.629914 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2236/4453] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:12:01 2022] GET /compute/v2.1/servers/44a9d1f4-4298-4e12-b656-5c1b999c9ba8 => generated 1655 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:12:02.136878 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-fafc586b-cdd1-4a78-99d8-983160acb746 req-3126224f-cef0-4193-88a1-1210c8840d6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d285bc1-33a9-47e0-a148-756be61c0488", "name": "network-vif-plugged", "status": "completed", "tag": "7338f23d-cbc9-4db5-9c77-7a4f58137c5c"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:12:02.157362 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-fafc586b-cdd1-4a78-99d8-983160acb746 req-3126224f-cef0-4193-88a1-1210c8840d6c service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:12:02.157822 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-fafc586b-cdd1-4a78-99d8-983160acb746 req-3126224f-cef0-4193-88a1-1210c8840d6c service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:12:02.158462 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-fafc586b-cdd1-4a78-99d8-983160acb746 req-3126224f-cef0-4193-88a1-1210c8840d6c service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:12:02.200437 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-fafc586b-cdd1-4a78-99d8-983160acb746 req-3126224f-cef0-4193-88a1-1210c8840d6c service nova] Creating event network-vif-plugged:7338f23d-cbc9-4db5-9c77-7a4f58137c5c for instance 4d285bc1-33a9-47e0-a148-756be61c0488 on nch1-master-1 Oct 22 21:12:02.207939 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-fafc586b-cdd1-4a78-99d8-983160acb746 req-3126224f-cef0-4193-88a1-1210c8840d6c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076735 Oct 22 21:12:02.209714 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2218/4454] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:12:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:12:02.332302 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-04d12e60-67ac-4dd1-887e-e6ea2077be3a tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:12:02.333120 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-04d12e60-67ac-4dd1-887e-e6ea2077be3a tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] [instance: 4d285bc1-33a9-47e0-a148-756be61c0488] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:12:02.354502 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-04d12e60-67ac-4dd1-887e-e6ea2077be3a tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:12:02.356450 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-04d12e60-67ac-4dd1-887e-e6ea2077be3a tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:12:02.357476 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-04d12e60-67ac-4dd1-887e-e6ea2077be3a tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:12:02.358677 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-04d12e60-67ac-4dd1-887e-e6ea2077be3a tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:12:02.360196 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-04d12e60-67ac-4dd1-887e-e6ea2077be3a tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:12:02.360932 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-04d12e60-67ac-4dd1-887e-e6ea2077be3a tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:12:02.373068 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell1:INSERT=3,nova_cell1:SELECT=95,nova_cell1:UPDATE=2 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:12:02.404190 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-9e475ea1-8c08-411a-8132-9bf8fca065b9 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:12:02.406212 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-9e475ea1-8c08-411a-8132-9bf8fca065b9 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] [instance: 34dcd1da-b94c-426b-b08b-204ea287c8a2] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:12:02.419816 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9e475ea1-8c08-411a-8132-9bf8fca065b9 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:12:02.428096 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9e475ea1-8c08-411a-8132-9bf8fca065b9 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:12:02.432257 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9e475ea1-8c08-411a-8132-9bf8fca065b9 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:12:02.433677 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9e475ea1-8c08-411a-8132-9bf8fca065b9 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:12:02.434440 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9e475ea1-8c08-411a-8132-9bf8fca065b9 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:12:02.435383 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9e475ea1-8c08-411a-8132-9bf8fca065b9 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:12:02.681553 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-9e475ea1-8c08-411a-8132-9bf8fca065b9 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:12:02.698181 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-9e475ea1-8c08-411a-8132-9bf8fca065b9 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:12:02.701448 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-9e475ea1-8c08-411a-8132-9bf8fca065b9 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:12:02.703097 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-9e475ea1-8c08-411a-8132-9bf8fca065b9 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] 10.222.0.18 "GET /compute/v2.1/servers/34dcd1da-b94c-426b-b08b-204ea287c8a2" status: 200 len: 1339 microversion: 2.20 time: 0.308972 Oct 22 21:12:02.719367 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2219/4455] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:12:02 2022] GET /compute/v2.1/servers/34dcd1da-b94c-426b-b08b-204ea287c8a2 => generated 1339 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:12:02.731018 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-ecdb8ccb-141f-4079-8f3b-a09dddd1d096 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:12:02.732007 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-ecdb8ccb-141f-4079-8f3b-a09dddd1d096 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] [instance: ad302c49-addb-464c-a15f-fa01577f90c4] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:12:02.739435 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ecdb8ccb-141f-4079-8f3b-a09dddd1d096 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:12:02.741191 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ecdb8ccb-141f-4079-8f3b-a09dddd1d096 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:12:02.741822 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ecdb8ccb-141f-4079-8f3b-a09dddd1d096 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:12:02.742791 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ecdb8ccb-141f-4079-8f3b-a09dddd1d096 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:12:02.743444 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ecdb8ccb-141f-4079-8f3b-a09dddd1d096 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:12:02.744053 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ecdb8ccb-141f-4079-8f3b-a09dddd1d096 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:12:02.793765 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ecdb8ccb-141f-4079-8f3b-a09dddd1d096 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:12:02.794541 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ecdb8ccb-141f-4079-8f3b-a09dddd1d096 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:12:02.795516 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ecdb8ccb-141f-4079-8f3b-a09dddd1d096 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:12:02.796367 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.objects.instance [None req-ecdb8ccb-141f-4079-8f3b-a09dddd1d096 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lazy-loading 'fault' on Instance uuid ad302c49-addb-464c-a15f-fa01577f90c4 {{(pid=138744) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 21:12:02.936126 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-ecdb8ccb-141f-4079-8f3b-a09dddd1d096 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0d0bdfb04240209e4efa92f47cbb94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755501ba3e344f1aaf7ef80924bb57d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:12:02.947941 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-ecdb8ccb-141f-4079-8f3b-a09dddd1d096 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] 10.222.0.18 "GET /compute/v2.1/servers/ad302c49-addb-464c-a15f-fa01577f90c4" status: 200 len: 1326 microversion: 2.1 time: 0.226027 Oct 22 21:12:02.951672 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2220/4456] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:12:02 2022] GET /compute/v2.1/servers/ad302c49-addb-464c-a15f-fa01577f90c4 => generated 1326 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:12:02.962593 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-4d7eaf4f-2dc8-4cae-9be4-437a9a9d0a20 tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:12:02.963536 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-4d7eaf4f-2dc8-4cae-9be4-437a9a9d0a20 tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] [instance: 44a9d1f4-4298-4e12-b656-5c1b999c9ba8] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:12:02.970520 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4d7eaf4f-2dc8-4cae-9be4-437a9a9d0a20 tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:12:02.971286 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4d7eaf4f-2dc8-4cae-9be4-437a9a9d0a20 tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:12:02.972087 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4d7eaf4f-2dc8-4cae-9be4-437a9a9d0a20 tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:12:02.973099 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4d7eaf4f-2dc8-4cae-9be4-437a9a9d0a20 tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:12:02.974528 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4d7eaf4f-2dc8-4cae-9be4-437a9a9d0a20 tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:12:02.975514 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4d7eaf4f-2dc8-4cae-9be4-437a9a9d0a20 tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:12:02.980824 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-04d12e60-67ac-4dd1-887e-e6ea2077be3a tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd69c1f0203b047eeb6a9fa0a215a63c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09185bfad7944b199a490305c22ffc3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:12:02.994674 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-04d12e60-67ac-4dd1-887e-e6ea2077be3a tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd69c1f0203b047eeb6a9fa0a215a63c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09185bfad7944b199a490305c22ffc3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:12:02.996361 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-04d12e60-67ac-4dd1-887e-e6ea2077be3a tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd69c1f0203b047eeb6a9fa0a215a63c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09185bfad7944b199a490305c22ffc3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:12:02.998656 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-04d12e60-67ac-4dd1-887e-e6ea2077be3a tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] 10.222.0.18 "GET /compute/v2.1/servers/4d285bc1-33a9-47e0-a148-756be61c0488" status: 200 len: 1879 microversion: 2.32 time: 0.669611 Oct 22 21:12:03.001875 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2237/4457] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:12:02 2022] GET /compute/v2.1/servers/4d285bc1-33a9-47e0-a148-756be61c0488 => generated 1879 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:12:03.562186 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-4d7eaf4f-2dc8-4cae-9be4-437a9a9d0a20 tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/44a9d1f4-4298-4e12-b656-5c1b999c9ba8" status: 200 len: 1655 microversion: 2.1 time: 0.608110 Oct 22 21:12:03.566242 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2221/4458] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:12:02 2022] GET /compute/v2.1/servers/44a9d1f4-4298-4e12-b656-5c1b999c9ba8 => generated 1655 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:12:03.736905 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-f075606e-c3d5-4d53-a603-eaa0e00b8fc2 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:12:03.738225 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-f075606e-c3d5-4d53-a603-eaa0e00b8fc2 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] [instance: 34dcd1da-b94c-426b-b08b-204ea287c8a2] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:12:03.754344 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f075606e-c3d5-4d53-a603-eaa0e00b8fc2 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:12:03.754999 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f075606e-c3d5-4d53-a603-eaa0e00b8fc2 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:12:03.757236 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f075606e-c3d5-4d53-a603-eaa0e00b8fc2 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:12:03.758173 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f075606e-c3d5-4d53-a603-eaa0e00b8fc2 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:12:03.758713 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f075606e-c3d5-4d53-a603-eaa0e00b8fc2 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:12:03.762939 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f075606e-c3d5-4d53-a603-eaa0e00b8fc2 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:12:03.982499 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-6575e3b7-bef5-449c-bb0b-cf65c81bcd59 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:12:03.983587 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-6575e3b7-bef5-449c-bb0b-cf65c81bcd59 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] [instance: ad302c49-addb-464c-a15f-fa01577f90c4] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:12:04.014199 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6575e3b7-bef5-449c-bb0b-cf65c81bcd59 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:12:04.018385 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6575e3b7-bef5-449c-bb0b-cf65c81bcd59 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:12:04.028423 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6575e3b7-bef5-449c-bb0b-cf65c81bcd59 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:12:04.029387 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6575e3b7-bef5-449c-bb0b-cf65c81bcd59 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:12:04.029874 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6575e3b7-bef5-449c-bb0b-cf65c81bcd59 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:12:04.030309 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6575e3b7-bef5-449c-bb0b-cf65c81bcd59 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:12:04.081546 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-6575e3b7-bef5-449c-bb0b-cf65c81bcd59 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] HTTP exception thrown: Instance ad302c49-addb-464c-a15f-fa01577f90c4 could not be found. Oct 22 21:12:04.083163 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-6575e3b7-bef5-449c-bb0b-cf65c81bcd59 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Request method failure captured: Oct 22 21:12:04.083163 ncdv-master-1 devstack@n-api.service[138744]: request: GET /compute/v2.1/servers/ad302c49-addb-464c-a15f-fa01577f90c4 HTTP/1.1 Oct 22 21:12:04.083163 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 21:12:04.083163 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 21:12:04.083163 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 21:12:04.083163 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 0 Oct 22 21:12:04.083163 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 21:12:04.083163 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 21:12:04.083163 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 21:12:04.083163 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 21:12:04.083163 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVFuUBtPDLFT8At_zrn_bBaaE2zzyF_nT22PiPjaxHPU2YIA_DgSr2gz12ljL2A8fqsjxUzqntMDUF7z7I3jTzNnIvnaGuvHcioSaq_gOgTI6yASMb4L3UiCnl8Esgqq5uU50izm2mW77ycOQXfK6m6BecIab0G9mkZWEbgIL-w8TVK4 Oct 22 21:12:04.083163 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 21:12:04.083163 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 21:12:04.083163 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 21:12:04.083163 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 21:12:04.083163 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 21:12:04.083163 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 21:12:04.083163 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: 755501ba3e344f1aaf7ef80924bb57d7 Oct 22 21:12:04.083163 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-AttachVolumeTestJSON-485250435 Oct 22 21:12:04.083163 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 21:12:04.083163 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 21:12:04.083163 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_755501ba3e344f1aaf7ef80924bb57d7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/755501ba3e344f1aaf7ef80924bb57d7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/755501ba3e344f1aaf7ef80924bb57d7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/755501ba3e344f1aaf7ef80924bb57d7"}]}] Oct 22 21:12:04.083163 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-AttachVolumeTestJSON-485250435 Oct 22 21:12:04.083163 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: 755501ba3e344f1aaf7ef80924bb57d7 Oct 22 21:12:04.083163 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-AttachVolumeTestJSON-485250435 Oct 22 21:12:04.083163 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-AttachVolumeTestJSON-485250435-project Oct 22 21:12:04.083163 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 21:12:04.083163 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 21:12:04.083163 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: ba0d0bdfb04240209e4efa92f47cbb94 Oct 22 21:12:04.083163 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-AttachVolumeTestJSON-485250435-project Oct 22 21:12:04.083163 ncdv-master-1 devstack@n-api.service[138744]: method: > Oct 22 21:12:04.083163 ncdv-master-1 devstack@n-api.service[138744]: exception: Instance ad302c49-addb-464c-a15f-fa01577f90c4 could not be found. Oct 22 21:12:04.083163 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': 'ad302c49-addb-464c-a15f-fa01577f90c4'} Oct 22 21:12:04.083163 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:12:04.083163 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:12:04.083163 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 21:12:04.083163 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 21:12:04.083163 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 21:12:04.083163 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 21:12:04.083163 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 21:12:04.083163 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 21:12:04.083163 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 21:12:04.083163 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 21:12:04.083163 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ad302c49-addb-464c-a15f-fa01577f90c4 could not be found. Oct 22 21:12:04.083163 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:12:04.083163 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:12:04.083163 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:12:04.083163 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:12:04.083163 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:12:04.083163 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:12:04.083163 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:12:04.083163 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:12:04.083163 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:12:04.083163 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:12:04.083163 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 21:12:04.083163 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 21:12:04.083163 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 21:12:04.083163 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 21:12:04.083163 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 21:12:04.083163 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:12:04.083163 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ad302c49-addb-464c-a15f-fa01577f90c4 could not be found. Oct 22 21:12:04.083163 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:12:04.083163 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:12:04.083163 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:12:04.090200 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:12:04.090200 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:12:04.090200 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:12:04.090200 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:12:04.090200 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:12:04.090200 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ad302c49-addb-464c-a15f-fa01577f90c4 could not be found. Oct 22 21:12:04.090200 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:12:04.097549 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-6575e3b7-bef5-449c-bb0b-cf65c81bcd59 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Returning 404 to user: Instance ad302c49-addb-464c-a15f-fa01577f90c4 could not be found. {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:12:04.099076 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-6575e3b7-bef5-449c-bb0b-cf65c81bcd59 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] 10.222.0.18 "GET /compute/v2.1/servers/ad302c49-addb-464c-a15f-fa01577f90c4" status: 404 len: 111 microversion: 2.1 time: 0.124603 Oct 22 21:12:04.110337 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2222/4459] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:12:03 2022] GET /compute/v2.1/servers/ad302c49-addb-464c-a15f-fa01577f90c4 => generated 111 bytes in 136 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 21:12:04.119697 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-22d1919b-9e6f-4f0d-a991-480c18bffd7b tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:12:04.120773 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-22d1919b-9e6f-4f0d-a991-480c18bffd7b tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] [instance: 4d285bc1-33a9-47e0-a148-756be61c0488] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:12:04.139107 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-22d1919b-9e6f-4f0d-a991-480c18bffd7b tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:12:04.139537 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-22d1919b-9e6f-4f0d-a991-480c18bffd7b tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:12:04.140247 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-22d1919b-9e6f-4f0d-a991-480c18bffd7b tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:12:04.141399 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-22d1919b-9e6f-4f0d-a991-480c18bffd7b tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:12:04.142101 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-22d1919b-9e6f-4f0d-a991-480c18bffd7b tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:12:04.142964 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-22d1919b-9e6f-4f0d-a991-480c18bffd7b tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:12:04.441466 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-f075606e-c3d5-4d53-a603-eaa0e00b8fc2 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:12:04.452316 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-f075606e-c3d5-4d53-a603-eaa0e00b8fc2 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:12:04.453925 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-f075606e-c3d5-4d53-a603-eaa0e00b8fc2 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:12:04.455564 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-f075606e-c3d5-4d53-a603-eaa0e00b8fc2 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] 10.222.0.18 "GET /compute/v2.1/servers/34dcd1da-b94c-426b-b08b-204ea287c8a2" status: 200 len: 1407 microversion: 2.20 time: 0.724772 Oct 22 21:12:04.456566 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2238/4460] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:12:03 2022] GET /compute/v2.1/servers/34dcd1da-b94c-426b-b08b-204ea287c8a2 => generated 1407 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:12:04.462069 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-e798e814-bcce-4e88-bbcf-dab960af4d0d tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Calling method '.version_select at 0x7fd39c4d80d0>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:12:04.487535 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-e798e814-bcce-4e88-bbcf-dab960af4d0d tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-141956617" status: 202 len: 0 microversion: 2.1 time: 0.029375 Oct 22 21:12:04.488139 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2239/4461] 10.222.0.18 () {58 vars in 1218 bytes} [Sat Oct 22 21:12:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-141956617 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 21:12:04.493524 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-b3d33738-65df-4aeb-8bc8-076f57a5ef0a req-983b1069-6b2c-4294-86a4-57d7e3747d70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d285bc1-33a9-47e0-a148-756be61c0488", "name": "network-vif-plugged", "status": "completed", "tag": "983bc5e7-7127-473c-8be5-1308c3a42ef9"}, {"server_uuid": "4d285bc1-33a9-47e0-a148-756be61c0488", "name": "network-vif-plugged", "status": "completed", "tag": "cff21c6e-345f-4103-b49b-c2a074abbfe3"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:12:04.505680 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-b3d33738-65df-4aeb-8bc8-076f57a5ef0a req-983b1069-6b2c-4294-86a4-57d7e3747d70 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:12:04.506704 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-b3d33738-65df-4aeb-8bc8-076f57a5ef0a req-983b1069-6b2c-4294-86a4-57d7e3747d70 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:12:04.507318 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-b3d33738-65df-4aeb-8bc8-076f57a5ef0a req-983b1069-6b2c-4294-86a4-57d7e3747d70 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:12:04.523115 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-b3d33738-65df-4aeb-8bc8-076f57a5ef0a req-983b1069-6b2c-4294-86a4-57d7e3747d70 service nova] Creating event network-vif-plugged:983bc5e7-7127-473c-8be5-1308c3a42ef9 for instance 4d285bc1-33a9-47e0-a148-756be61c0488 on nch1-master-1 Oct 22 21:12:04.523922 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-b3d33738-65df-4aeb-8bc8-076f57a5ef0a req-983b1069-6b2c-4294-86a4-57d7e3747d70 service nova] Creating event network-vif-plugged:cff21c6e-345f-4103-b49b-c2a074abbfe3 for instance 4d285bc1-33a9-47e0-a148-756be61c0488 on nch1-master-1 Oct 22 21:12:04.530756 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-b3d33738-65df-4aeb-8bc8-076f57a5ef0a req-983b1069-6b2c-4294-86a4-57d7e3747d70 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.040817 Oct 22 21:12:04.531872 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2240/4462] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:12:04 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:12:04.610220 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-e0f833de-e4f9-4a17-b46b-c46a7817c6ad tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:12:04.610922 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-e0f833de-e4f9-4a17-b46b-c46a7817c6ad tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] [instance: 44a9d1f4-4298-4e12-b656-5c1b999c9ba8] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:12:04.619333 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e0f833de-e4f9-4a17-b46b-c46a7817c6ad tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:12:04.620279 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e0f833de-e4f9-4a17-b46b-c46a7817c6ad tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:12:04.622827 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e0f833de-e4f9-4a17-b46b-c46a7817c6ad tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:12:04.624981 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e0f833de-e4f9-4a17-b46b-c46a7817c6ad tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:12:04.627165 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e0f833de-e4f9-4a17-b46b-c46a7817c6ad tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:12:04.628138 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e0f833de-e4f9-4a17-b46b-c46a7817c6ad tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:12:04.855579 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-22d1919b-9e6f-4f0d-a991-480c18bffd7b tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd69c1f0203b047eeb6a9fa0a215a63c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09185bfad7944b199a490305c22ffc3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:12:04.875527 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-22d1919b-9e6f-4f0d-a991-480c18bffd7b tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd69c1f0203b047eeb6a9fa0a215a63c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09185bfad7944b199a490305c22ffc3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:12:04.877387 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-22d1919b-9e6f-4f0d-a991-480c18bffd7b tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd69c1f0203b047eeb6a9fa0a215a63c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09185bfad7944b199a490305c22ffc3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:12:04.881795 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-22d1919b-9e6f-4f0d-a991-480c18bffd7b tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] 10.222.0.18 "GET /compute/v2.1/servers/4d285bc1-33a9-47e0-a148-756be61c0488" status: 200 len: 1879 microversion: 2.32 time: 0.769916 Oct 22 21:12:04.884817 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2223/4463] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:12:04 2022] GET /compute/v2.1/servers/4d285bc1-33a9-47e0-a148-756be61c0488 => generated 1879 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:12:05.020490 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-e0f833de-e4f9-4a17-b46b-c46a7817c6ad tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/44a9d1f4-4298-4e12-b656-5c1b999c9ba8" status: 200 len: 1613 microversion: 2.1 time: 0.416686 Oct 22 21:12:05.021433 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2241/4464] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:12:04 2022] GET /compute/v2.1/servers/44a9d1f4-4298-4e12-b656-5c1b999c9ba8 => generated 1613 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:12:05.050042 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-cbcf77a8-e034-4888-b8f3-86e82030d617 req-f5265b98-85be-4066-b41a-2d6b7cfe38ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44a9d1f4-4298-4e12-b656-5c1b999c9ba8", "name": "network-vif-deleted", "tag": "b69ad18f-bd0f-4e1d-8f0f-3900fe884ad7"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:12:05.064970 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-cbcf77a8-e034-4888-b8f3-86e82030d617 req-f5265b98-85be-4066-b41a-2d6b7cfe38ad service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:12:05.065769 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-cbcf77a8-e034-4888-b8f3-86e82030d617 req-f5265b98-85be-4066-b41a-2d6b7cfe38ad service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:12:05.067956 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-cbcf77a8-e034-4888-b8f3-86e82030d617 req-f5265b98-85be-4066-b41a-2d6b7cfe38ad service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:12:05.107999 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-cbcf77a8-e034-4888-b8f3-86e82030d617 req-f5265b98-85be-4066-b41a-2d6b7cfe38ad service nova] Creating event network-vif-deleted:b69ad18f-bd0f-4e1d-8f0f-3900fe884ad7 for instance 44a9d1f4-4298-4e12-b656-5c1b999c9ba8 on nch1-master-1 Oct 22 21:12:05.117839 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-cbcf77a8-e034-4888-b8f3-86e82030d617 req-f5265b98-85be-4066-b41a-2d6b7cfe38ad service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079078 Oct 22 21:12:05.119437 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2224/4465] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:12:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:12:05.484442 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-7a144eca-7134-4f72-9c1f-8842ecceca0a tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:12:05.485107 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-7a144eca-7134-4f72-9c1f-8842ecceca0a tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] [instance: 34dcd1da-b94c-426b-b08b-204ea287c8a2] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:12:05.499186 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7a144eca-7134-4f72-9c1f-8842ecceca0a tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:12:05.499988 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7a144eca-7134-4f72-9c1f-8842ecceca0a tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:12:05.501229 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7a144eca-7134-4f72-9c1f-8842ecceca0a tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:12:05.502218 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7a144eca-7134-4f72-9c1f-8842ecceca0a tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:12:05.502896 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7a144eca-7134-4f72-9c1f-8842ecceca0a tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:12:05.503592 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7a144eca-7134-4f72-9c1f-8842ecceca0a tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:12:05.922449 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-0a39bb91-4005-45ed-ac3c-4d977a5d84df tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:12:05.923931 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-0a39bb91-4005-45ed-ac3c-4d977a5d84df tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] [instance: 4d285bc1-33a9-47e0-a148-756be61c0488] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:12:05.943483 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0a39bb91-4005-45ed-ac3c-4d977a5d84df tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:12:05.944259 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0a39bb91-4005-45ed-ac3c-4d977a5d84df tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:12:05.944962 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0a39bb91-4005-45ed-ac3c-4d977a5d84df tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:12:05.948289 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0a39bb91-4005-45ed-ac3c-4d977a5d84df tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:12:05.950436 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0a39bb91-4005-45ed-ac3c-4d977a5d84df tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:12:05.952050 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0a39bb91-4005-45ed-ac3c-4d977a5d84df tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:12:06.469123 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-7a144eca-7134-4f72-9c1f-8842ecceca0a tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:12:06.495236 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-7a144eca-7134-4f72-9c1f-8842ecceca0a tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:12:06.497410 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-7a144eca-7134-4f72-9c1f-8842ecceca0a tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:12:06.501238 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-7a144eca-7134-4f72-9c1f-8842ecceca0a tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] 10.222.0.18 "GET /compute/v2.1/servers/34dcd1da-b94c-426b-b08b-204ea287c8a2" status: 200 len: 1407 microversion: 2.20 time: 1.023544 Oct 22 21:12:06.514528 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-0a39bb91-4005-45ed-ac3c-4d977a5d84df tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd69c1f0203b047eeb6a9fa0a215a63c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09185bfad7944b199a490305c22ffc3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:12:06.516306 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2242/4466] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:12:05 2022] GET /compute/v2.1/servers/34dcd1da-b94c-426b-b08b-204ea287c8a2 => generated 1407 bytes in 1039 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:12:06.525525 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-f2700ee7-1fe2-41c2-bed2-69427811fda3 tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:12:06.526422 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-f2700ee7-1fe2-41c2-bed2-69427811fda3 tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] [instance: 44a9d1f4-4298-4e12-b656-5c1b999c9ba8] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:12:06.533131 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f2700ee7-1fe2-41c2-bed2-69427811fda3 tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:12:06.533636 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f2700ee7-1fe2-41c2-bed2-69427811fda3 tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:12:06.534084 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f2700ee7-1fe2-41c2-bed2-69427811fda3 tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:12:06.535086 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f2700ee7-1fe2-41c2-bed2-69427811fda3 tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:12:06.535964 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-0a39bb91-4005-45ed-ac3c-4d977a5d84df tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd69c1f0203b047eeb6a9fa0a215a63c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09185bfad7944b199a490305c22ffc3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:12:06.539204 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-0a39bb91-4005-45ed-ac3c-4d977a5d84df tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd69c1f0203b047eeb6a9fa0a215a63c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09185bfad7944b199a490305c22ffc3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:12:06.544022 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-0a39bb91-4005-45ed-ac3c-4d977a5d84df tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] 10.222.0.18 "GET /compute/v2.1/servers/4d285bc1-33a9-47e0-a148-756be61c0488" status: 200 len: 1879 microversion: 2.32 time: 0.627045 Oct 22 21:12:06.545220 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2225/4467] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:12:05 2022] GET /compute/v2.1/servers/4d285bc1-33a9-47e0-a148-756be61c0488 => generated 1879 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:12:06.559974 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f2700ee7-1fe2-41c2-bed2-69427811fda3 tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:12:06.563197 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-f2e34c62-b2d7-408d-8a6c-58a1a428e1a0 req-05121c56-8961-4422-93a6-59d432c11043 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d285bc1-33a9-47e0-a148-756be61c0488", "name": "network-vif-plugged", "status": "completed", "tag": "d9858e8d-9b0c-457e-8078-ee77f74b3e78"}, {"server_uuid": "4d285bc1-33a9-47e0-a148-756be61c0488", "name": "network-vif-plugged", "status": "completed", "tag": "05dfecf4-4df5-49e0-a137-d704760c00a1"}, {"server_uuid": "4d285bc1-33a9-47e0-a148-756be61c0488", "name": "network-vif-plugged", "status": "completed", "tag": "f622764f-b85f-427d-8e63-b432c6444156"}, {"server_uuid": "4d285bc1-33a9-47e0-a148-756be61c0488", "name": "network-vif-plugged", "status": "completed", "tag": "11971775-e198-4095-93a1-f9241775933a"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:12:06.566645 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f2700ee7-1fe2-41c2-bed2-69427811fda3 tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:12:06.584863 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-f2e34c62-b2d7-408d-8a6c-58a1a428e1a0 req-05121c56-8961-4422-93a6-59d432c11043 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:12:06.585842 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-f2e34c62-b2d7-408d-8a6c-58a1a428e1a0 req-05121c56-8961-4422-93a6-59d432c11043 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:12:06.586465 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-f2e34c62-b2d7-408d-8a6c-58a1a428e1a0 req-05121c56-8961-4422-93a6-59d432c11043 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:12:06.615359 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-f2e34c62-b2d7-408d-8a6c-58a1a428e1a0 req-05121c56-8961-4422-93a6-59d432c11043 service nova] Creating event network-vif-plugged:d9858e8d-9b0c-457e-8078-ee77f74b3e78 for instance 4d285bc1-33a9-47e0-a148-756be61c0488 on nch1-master-1 Oct 22 21:12:06.615563 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.wsgi [None req-f2700ee7-1fe2-41c2-bed2-69427811fda3 tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] HTTP exception thrown: Instance 44a9d1f4-4298-4e12-b656-5c1b999c9ba8 could not be found. Oct 22 21:12:06.617242 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-f2700ee7-1fe2-41c2-bed2-69427811fda3 tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Request method failure captured: Oct 22 21:12:06.617242 ncdv-master-1 devstack@n-api.service[138745]: request: GET /compute/v2.1/servers/44a9d1f4-4298-4e12-b656-5c1b999c9ba8 HTTP/1.1 Oct 22 21:12:06.617242 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 21:12:06.617242 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 21:12:06.617242 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 21:12:06.617242 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 0 Oct 22 21:12:06.617242 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 21:12:06.617242 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 21:12:06.617242 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 21:12:06.617242 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 21:12:06.617242 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVFxzJCjpqnOJwZ7fhwvxHalnJDslZGEM8q2jsDyatwq05S8MEWErikELmkotxvaa_2t2KYMQ3icTz7WwKm3d6Dx2Nb1g-yxFiSG5tnpLZcPVb86y86Mw1USrBc-COad4tfPlLc2EXK1uZs-_eD4q_3g9tdvOF67uoPtMkbb16Us8BTI Oct 22 21:12:06.617242 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 21:12:06.617242 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 21:12:06.617242 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 21:12:06.617242 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 21:12:06.617242 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 21:12:06.617242 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 21:12:06.617242 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: 5824d7d0370d430dba4f1e36acca8f8c Oct 22 21:12:06.617242 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-TestServerMultinode-831239059 Oct 22 21:12:06.617242 ncdv-master-1 devstack@n-api.service[138745]: X-Role: admin,member,reader Oct 22 21:12:06.617242 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: admin,member,reader Oct 22 21:12:06.617242 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_5824d7d0370d430dba4f1e36acca8f8c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5824d7d0370d430dba4f1e36acca8f8c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/5824d7d0370d430dba4f1e36acca8f8c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5824d7d0370d430dba4f1e36acca8f8c"}]}] Oct 22 21:12:06.617242 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-TestServerMultinode-831239059 Oct 22 21:12:06.617242 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: 5824d7d0370d430dba4f1e36acca8f8c Oct 22 21:12:06.617242 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-TestServerMultinode-831239059 Oct 22 21:12:06.617242 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-TestServerMultinode-831239059-project-admin Oct 22 21:12:06.617242 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 21:12:06.617242 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 21:12:06.617242 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: 7c54ba11e3454a8cb83fd56bc73d812f Oct 22 21:12:06.617242 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-TestServerMultinode-831239059-project-admin Oct 22 21:12:06.617242 ncdv-master-1 devstack@n-api.service[138745]: method: > Oct 22 21:12:06.617242 ncdv-master-1 devstack@n-api.service[138745]: exception: Instance 44a9d1f4-4298-4e12-b656-5c1b999c9ba8 could not be found. Oct 22 21:12:06.617242 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'id': '44a9d1f4-4298-4e12-b656-5c1b999c9ba8'} Oct 22 21:12:06.617242 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:12:06.617242 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:12:06.617242 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 21:12:06.617242 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 21:12:06.617242 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 21:12:06.617242 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 21:12:06.617242 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 21:12:06.617242 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 21:12:06.617242 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 21:12:06.617242 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 21:12:06.617242 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 44a9d1f4-4298-4e12-b656-5c1b999c9ba8 could not be found. Oct 22 21:12:06.617242 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:12:06.617242 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:12:06.617242 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:12:06.617242 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:12:06.617242 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:12:06.617242 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:12:06.617242 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:12:06.617242 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:12:06.617242 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:12:06.617242 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:12:06.617242 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 21:12:06.617242 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 21:12:06.617242 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 21:12:06.617242 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 21:12:06.617242 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 21:12:06.617242 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:12:06.617242 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 44a9d1f4-4298-4e12-b656-5c1b999c9ba8 could not be found. Oct 22 21:12:06.617242 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:12:06.617242 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:12:06.617242 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:12:06.622453 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:12:06.622453 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:12:06.622453 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:12:06.622453 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:12:06.622453 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:12:06.622453 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 44a9d1f4-4298-4e12-b656-5c1b999c9ba8 could not be found. Oct 22 21:12:06.622453 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:12:06.622453 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-f2700ee7-1fe2-41c2-bed2-69427811fda3 tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] Returning 404 to user: Instance 44a9d1f4-4298-4e12-b656-5c1b999c9ba8 could not be found. {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:12:06.622453 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-f2700ee7-1fe2-41c2-bed2-69427811fda3 tempest-TestServerMultinode-831239059 tempest-TestServerMultinode-831239059-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/44a9d1f4-4298-4e12-b656-5c1b999c9ba8" status: 404 len: 111 microversion: 2.1 time: 0.104798 Oct 22 21:12:06.624300 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-f2e34c62-b2d7-408d-8a6c-58a1a428e1a0 req-05121c56-8961-4422-93a6-59d432c11043 service nova] Creating event network-vif-plugged:05dfecf4-4df5-49e0-a137-d704760c00a1 for instance 4d285bc1-33a9-47e0-a148-756be61c0488 on nch1-master-1 Oct 22 21:12:06.625129 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-f2e34c62-b2d7-408d-8a6c-58a1a428e1a0 req-05121c56-8961-4422-93a6-59d432c11043 service nova] Creating event network-vif-plugged:f622764f-b85f-427d-8e63-b432c6444156 for instance 4d285bc1-33a9-47e0-a148-756be61c0488 on nch1-master-1 Oct 22 21:12:06.626357 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-f2e34c62-b2d7-408d-8a6c-58a1a428e1a0 req-05121c56-8961-4422-93a6-59d432c11043 service nova] Creating event network-vif-plugged:11971775-e198-4095-93a1-f9241775933a for instance 4d285bc1-33a9-47e0-a148-756be61c0488 on nch1-master-1 Oct 22 21:12:06.627291 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2243/4468] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:12:06 2022] GET /compute/v2.1/servers/44a9d1f4-4298-4e12-b656-5c1b999c9ba8 => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 21:12:06.654259 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-f2e34c62-b2d7-408d-8a6c-58a1a428e1a0 req-05121c56-8961-4422-93a6-59d432c11043 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.094896 Oct 22 21:12:06.657709 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2226/4469] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:12:06 2022] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 21:12:06.802562 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-f411ff5f-3de8-4e93-b3d4-890f75342cdd tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Action: 'create', calling method: .version_select at 0x7fd39c55c5e0>, body: {"keypair": {"name": "tempest-keypair-793519269", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLdzlzSwgXeOE6UxYCsjcuSxxiqBKzzgQLcLInLvxUZYjrq+Yod7BdeN7Jaq+H6GBw+w5Zc8bjObXyGHIUwSwIlM0VnDAB3Ew/L1XJP/IzXzBXwiBYZcz6/ZMeHXlRAKgQ=="}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:12:06.837904 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-f411ff5f-3de8-4e93-b3d4-890f75342cdd tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Getting quotas for project 755501ba3e344f1aaf7ef80924bb57d7. Resources: {'key_pairs'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 21:12:06.845562 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-f411ff5f-3de8-4e93-b3d4-890f75342cdd tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Getting quotas for user ba0d0bdfb04240209e4efa92f47cbb94 and project 755501ba3e344f1aaf7ef80924bb57d7. Resources: {'key_pairs'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 21:12:06.881956 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-f411ff5f-3de8-4e93-b3d4-890f75342cdd tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.083440 Oct 22 21:12:06.885408 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2244/4470] 10.222.0.18 () {60 vars in 1159 bytes} [Sat Oct 22 21:12:06 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:12:07.170827 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-da790908-a3be-4a45-a172-4039c726d3eb req-69876086-a8ac-4f8d-8700-aaacd27284e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34dcd1da-b94c-426b-b08b-204ea287c8a2", "tag": "692705ac-81f3-4f8a-bfa8-a2581d7d7567"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:12:07.205246 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-da790908-a3be-4a45-a172-4039c726d3eb req-69876086-a8ac-4f8d-8700-aaacd27284e2 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:12:07.206272 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-da790908-a3be-4a45-a172-4039c726d3eb req-69876086-a8ac-4f8d-8700-aaacd27284e2 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:12:07.208665 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-da790908-a3be-4a45-a172-4039c726d3eb req-69876086-a8ac-4f8d-8700-aaacd27284e2 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:12:07.253154 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-da790908-a3be-4a45-a172-4039c726d3eb req-69876086-a8ac-4f8d-8700-aaacd27284e2 service nova] Creating event network-changed:692705ac-81f3-4f8a-bfa8-a2581d7d7567 for instance 34dcd1da-b94c-426b-b08b-204ea287c8a2 on nch2-master-1 Oct 22 21:12:07.269191 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-da790908-a3be-4a45-a172-4039c726d3eb req-69876086-a8ac-4f8d-8700-aaacd27284e2 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102501 Oct 22 21:12:07.270930 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2227/4471] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:12:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:12:07.530986 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-9415a827-791a-413a-bb8d-40f3b8e3c478 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:12:07.532310 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-9415a827-791a-413a-bb8d-40f3b8e3c478 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] [instance: 34dcd1da-b94c-426b-b08b-204ea287c8a2] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:12:07.540682 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9415a827-791a-413a-bb8d-40f3b8e3c478 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:12:07.541195 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9415a827-791a-413a-bb8d-40f3b8e3c478 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:12:07.541653 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9415a827-791a-413a-bb8d-40f3b8e3c478 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:12:07.542391 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9415a827-791a-413a-bb8d-40f3b8e3c478 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:12:07.543120 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9415a827-791a-413a-bb8d-40f3b8e3c478 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:12:07.559221 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9415a827-791a-413a-bb8d-40f3b8e3c478 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:12:07.572872 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-e237c3ce-a268-489b-8472-9296e3f66e13 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:12:07.574085 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-e237c3ce-a268-489b-8472-9296e3f66e13 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] [instance: 4d285bc1-33a9-47e0-a148-756be61c0488] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:12:07.598045 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e237c3ce-a268-489b-8472-9296e3f66e13 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:12:07.598608 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e237c3ce-a268-489b-8472-9296e3f66e13 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:12:07.599060 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e237c3ce-a268-489b-8472-9296e3f66e13 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:12:07.605173 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e237c3ce-a268-489b-8472-9296e3f66e13 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:12:07.605913 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e237c3ce-a268-489b-8472-9296e3f66e13 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:12:07.606512 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e237c3ce-a268-489b-8472-9296e3f66e13 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:12:08.282977 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-9415a827-791a-413a-bb8d-40f3b8e3c478 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:12:08.313938 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-9415a827-791a-413a-bb8d-40f3b8e3c478 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:12:08.316548 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-9415a827-791a-413a-bb8d-40f3b8e3c478 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:12:08.318231 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-9415a827-791a-413a-bb8d-40f3b8e3c478 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] 10.222.0.18 "GET /compute/v2.1/servers/34dcd1da-b94c-426b-b08b-204ea287c8a2" status: 200 len: 1407 microversion: 2.20 time: 0.791506 Oct 22 21:12:08.319889 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2245/4472] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:12:07 2022] GET /compute/v2.1/servers/34dcd1da-b94c-426b-b08b-204ea287c8a2 => generated 1407 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:12:08.390815 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-e237c3ce-a268-489b-8472-9296e3f66e13 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd69c1f0203b047eeb6a9fa0a215a63c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09185bfad7944b199a490305c22ffc3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:12:08.406409 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-e237c3ce-a268-489b-8472-9296e3f66e13 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd69c1f0203b047eeb6a9fa0a215a63c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09185bfad7944b199a490305c22ffc3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:12:08.411009 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-e237c3ce-a268-489b-8472-9296e3f66e13 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd69c1f0203b047eeb6a9fa0a215a63c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09185bfad7944b199a490305c22ffc3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:12:08.419657 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-e237c3ce-a268-489b-8472-9296e3f66e13 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] 10.222.0.18 "GET /compute/v2.1/servers/4d285bc1-33a9-47e0-a148-756be61c0488" status: 200 len: 1879 microversion: 2.32 time: 0.847607 Oct 22 21:12:08.436296 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2228/4473] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:12:07 2022] GET /compute/v2.1/servers/4d285bc1-33a9-47e0-a148-756be61c0488 => generated 1879 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:12:09.358087 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-f1bfdc5e-f7ed-4b3d-9698-591bae8d60c2 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:12:09.359762 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-f1bfdc5e-f7ed-4b3d-9698-591bae8d60c2 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] [instance: 34dcd1da-b94c-426b-b08b-204ea287c8a2] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:12:09.374788 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f1bfdc5e-f7ed-4b3d-9698-591bae8d60c2 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:12:09.376628 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f1bfdc5e-f7ed-4b3d-9698-591bae8d60c2 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:12:09.381706 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f1bfdc5e-f7ed-4b3d-9698-591bae8d60c2 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:12:09.390194 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f1bfdc5e-f7ed-4b3d-9698-591bae8d60c2 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:12:09.391328 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f1bfdc5e-f7ed-4b3d-9698-591bae8d60c2 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:12:09.392160 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f1bfdc5e-f7ed-4b3d-9698-591bae8d60c2 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:12:09.446782 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-ac57078a-31d4-4c18-bf2f-8f25f393683f tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:12:09.447652 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-ac57078a-31d4-4c18-bf2f-8f25f393683f tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] [instance: 4d285bc1-33a9-47e0-a148-756be61c0488] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:12:09.463004 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ac57078a-31d4-4c18-bf2f-8f25f393683f tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:12:09.463957 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ac57078a-31d4-4c18-bf2f-8f25f393683f tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:12:09.464112 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ac57078a-31d4-4c18-bf2f-8f25f393683f tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:12:09.464959 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ac57078a-31d4-4c18-bf2f-8f25f393683f tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:12:09.465593 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ac57078a-31d4-4c18-bf2f-8f25f393683f tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:12:09.466047 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ac57078a-31d4-4c18-bf2f-8f25f393683f tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:12:09.749898 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell0:SELECT=2 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:12:10.004778 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-f1bfdc5e-f7ed-4b3d-9698-591bae8d60c2 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:12:10.014104 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-f1bfdc5e-f7ed-4b3d-9698-591bae8d60c2 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:12:10.024223 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-f1bfdc5e-f7ed-4b3d-9698-591bae8d60c2 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:12:10.038538 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-f1bfdc5e-f7ed-4b3d-9698-591bae8d60c2 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] 10.222.0.18 "GET /compute/v2.1/servers/34dcd1da-b94c-426b-b08b-204ea287c8a2" status: 200 len: 1407 microversion: 2.20 time: 0.695383 Oct 22 21:12:10.057335 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2246/4474] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:12:09 2022] GET /compute/v2.1/servers/34dcd1da-b94c-426b-b08b-204ea287c8a2 => generated 1407 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:12:10.153395 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-ac57078a-31d4-4c18-bf2f-8f25f393683f tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd69c1f0203b047eeb6a9fa0a215a63c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09185bfad7944b199a490305c22ffc3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:12:10.177551 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-ac57078a-31d4-4c18-bf2f-8f25f393683f tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd69c1f0203b047eeb6a9fa0a215a63c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09185bfad7944b199a490305c22ffc3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:12:10.179625 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-ac57078a-31d4-4c18-bf2f-8f25f393683f tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd69c1f0203b047eeb6a9fa0a215a63c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09185bfad7944b199a490305c22ffc3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:12:10.181775 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-ac57078a-31d4-4c18-bf2f-8f25f393683f tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] 10.222.0.18 "GET /compute/v2.1/servers/4d285bc1-33a9-47e0-a148-756be61c0488" status: 200 len: 2832 microversion: 2.32 time: 0.739019 Oct 22 21:12:10.184406 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2229/4475] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:12:09 2022] GET /compute/v2.1/servers/4d285bc1-33a9-47e0-a148-756be61c0488 => generated 2832 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:12:10.212931 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-19a5d336-4463-42a2-8ff6-270179f4dfe1 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:12:10.213458 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-19a5d336-4463-42a2-8ff6-270179f4dfe1 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] [instance: 4d285bc1-33a9-47e0-a148-756be61c0488] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:12:10.234672 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-19a5d336-4463-42a2-8ff6-270179f4dfe1 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:12:10.236367 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-19a5d336-4463-42a2-8ff6-270179f4dfe1 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:12:10.237047 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-19a5d336-4463-42a2-8ff6-270179f4dfe1 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:12:10.238027 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-19a5d336-4463-42a2-8ff6-270179f4dfe1 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:12:10.238709 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-19a5d336-4463-42a2-8ff6-270179f4dfe1 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:12:10.239424 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-19a5d336-4463-42a2-8ff6-270179f4dfe1 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:12:10.588376 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-19a5d336-4463-42a2-8ff6-270179f4dfe1 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] 10.222.0.18 "GET /compute/v2.1/servers/4d285bc1-33a9-47e0-a148-756be61c0488/os-interface" status: 200 len: 1832 microversion: 2.32 time: 0.379302 Oct 22 21:12:10.589576 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2247/4476] 10.222.0.18 () {60 vars in 1316 bytes} [Sat Oct 22 21:12:10 2022] GET /compute/v2.1/servers/4d285bc1-33a9-47e0-a148-756be61c0488/os-interface => generated 1832 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:12:10.909230 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-c66bae52-59ae-40b3-8f81-0192177ade2d tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1860002177", "imageRef": "085e4478-6edc-4a69-8e08-f9831713eb65", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ca9349bd-3a50-4a00-9835-d7bef81d5673"}], "security_groups": [{"name": "tempest-securitygroup--1770989745"}], "key_name": "tempest-keypair-793519269", "user_data": "}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:12:11.074714 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-ae55a313-f342-4246-9e9f-15e93f945bba tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:12:11.075485 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-ae55a313-f342-4246-9e9f-15e93f945bba tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] [instance: 34dcd1da-b94c-426b-b08b-204ea287c8a2] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:12:11.088631 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ae55a313-f342-4246-9e9f-15e93f945bba tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:12:11.089140 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ae55a313-f342-4246-9e9f-15e93f945bba tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:12:11.089727 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ae55a313-f342-4246-9e9f-15e93f945bba tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:12:11.090494 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ae55a313-f342-4246-9e9f-15e93f945bba tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:12:11.090964 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ae55a313-f342-4246-9e9f-15e93f945bba tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:12:11.091436 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ae55a313-f342-4246-9e9f-15e93f945bba tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:12:11.581249 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.network.neutron [None req-c66bae52-59ae-40b3-8f81-0192177ade2d tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] validate_networks() for [('ca9349bd-3a50-4a00-9835-d7bef81d5673', None, None, None, None, None)] {{(pid=138744) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 21:12:11.903890 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-ae55a313-f342-4246-9e9f-15e93f945bba tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:12:11.917535 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-ae55a313-f342-4246-9e9f-15e93f945bba tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:12:11.919408 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-ae55a313-f342-4246-9e9f-15e93f945bba tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:12:11.925176 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-ae55a313-f342-4246-9e9f-15e93f945bba tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] 10.222.0.18 "GET /compute/v2.1/servers/34dcd1da-b94c-426b-b08b-204ea287c8a2" status: 200 len: 1407 microversion: 2.20 time: 0.857741 Oct 22 21:12:11.930921 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2248/4477] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:12:11 2022] GET /compute/v2.1/servers/34dcd1da-b94c-426b-b08b-204ea287c8a2 => generated 1407 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:12:12.938207 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-c66bae52-59ae-40b3-8f81-0192177ade2d tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Flavor limits 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 21:12:12.938787 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-c66bae52-59ae-40b3-8f81-0192177ade2d tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Image limits 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 21:12:12.939683 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-c66bae52-59ae-40b3-8f81-0192177ade2d tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Flavor pref 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 21:12:12.940683 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-c66bae52-59ae-40b3-8f81-0192177ade2d tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Image pref 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 21:12:12.941387 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-c66bae52-59ae-40b3-8f81-0192177ade2d tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 21:12:12.962893 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-f55a69d9-211f-4f3c-80b7-8ab9784a0528 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:12:12.964615 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-f55a69d9-211f-4f3c-80b7-8ab9784a0528 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] [instance: 34dcd1da-b94c-426b-b08b-204ea287c8a2] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:12:12.965979 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c66bae52-59ae-40b3-8f81-0192177ade2d tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:12:12.967944 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c66bae52-59ae-40b3-8f81-0192177ade2d tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:12:12.968582 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c66bae52-59ae-40b3-8f81-0192177ade2d tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:12:12.970019 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c66bae52-59ae-40b3-8f81-0192177ade2d tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:12:12.971919 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c66bae52-59ae-40b3-8f81-0192177ade2d tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:12:12.973094 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c66bae52-59ae-40b3-8f81-0192177ade2d tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:12:13.003443 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f55a69d9-211f-4f3c-80b7-8ab9784a0528 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:12:13.004242 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f55a69d9-211f-4f3c-80b7-8ab9784a0528 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:12:13.004796 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f55a69d9-211f-4f3c-80b7-8ab9784a0528 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:12:13.005655 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f55a69d9-211f-4f3c-80b7-8ab9784a0528 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:12:13.006167 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f55a69d9-211f-4f3c-80b7-8ab9784a0528 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:12:13.006667 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f55a69d9-211f-4f3c-80b7-8ab9784a0528 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:12:13.030171 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-c66bae52-59ae-40b3-8f81-0192177ade2d tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Getting quotas for project 755501ba3e344f1aaf7ef80924bb57d7. Resources: {'cores', 'instances', 'ram'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 21:12:13.040882 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-c66bae52-59ae-40b3-8f81-0192177ade2d tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Getting quotas for user ba0d0bdfb04240209e4efa92f47cbb94 and project 755501ba3e344f1aaf7ef80924bb57d7. Resources: {'cores', 'instances', 'ram'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 21:12:13.075602 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-c66bae52-59ae-40b3-8f81-0192177ade2d tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Going to run 1 instances... {{(pid=138744) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 21:12:13.081697 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-c66bae52-59ae-40b3-8f81-0192177ade2d tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] [instance: 9dd3ccc4-26f1-4d75-b990-6636ed02293e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='085e4478-6edc-4a69-8e08-f9831713eb65',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138744) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 21:12:13.139150 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=2 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:12:13.186289 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-c66bae52-59ae-40b3-8f81-0192177ade2d tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.282584 Oct 22 21:12:13.189451 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2230/4478] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Oct 22 21:12:10 2022] POST /compute/v2.1/servers => generated 402 bytes in 2287 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 21:12:13.206177 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-40f39414-a64a-4a98-97f4-1fee68270758 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:12:13.206756 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-40f39414-a64a-4a98-97f4-1fee68270758 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] [instance: 9dd3ccc4-26f1-4d75-b990-6636ed02293e] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:12:14.199119 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-40f39414-a64a-4a98-97f4-1fee68270758 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0d0bdfb04240209e4efa92f47cbb94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755501ba3e344f1aaf7ef80924bb57d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:12:14.210413 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-40f39414-a64a-4a98-97f4-1fee68270758 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] 10.222.0.18 "GET /compute/v2.1/servers/9dd3ccc4-26f1-4d75-b990-6636ed02293e" status: 200 len: 1237 microversion: 2.1 time: 1.010912 Oct 22 21:12:14.212186 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2231/4479] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:12:13 2022] GET /compute/v2.1/servers/9dd3ccc4-26f1-4d75-b990-6636ed02293e => generated 1237 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:12:14.416289 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-f55a69d9-211f-4f3c-80b7-8ab9784a0528 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:12:14.435867 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-f55a69d9-211f-4f3c-80b7-8ab9784a0528 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:12:14.446227 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-f55a69d9-211f-4f3c-80b7-8ab9784a0528 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:12:14.449667 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-f55a69d9-211f-4f3c-80b7-8ab9784a0528 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] 10.222.0.18 "GET /compute/v2.1/servers/34dcd1da-b94c-426b-b08b-204ea287c8a2" status: 200 len: 1407 microversion: 2.20 time: 1.492682 Oct 22 21:12:14.453822 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2249/4480] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:12:12 2022] GET /compute/v2.1/servers/34dcd1da-b94c-426b-b08b-204ea287c8a2 => generated 1407 bytes in 1498 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 22 21:12:14.816582 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-e24b4043-8855-406c-9647-d03539e7bf24 req-9811789b-3361-44d4-9046-ad2fe8d57f19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34dcd1da-b94c-426b-b08b-204ea287c8a2", "name": "network-vif-plugged", "status": "completed", "tag": "692705ac-81f3-4f8a-bfa8-a2581d7d7567"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:12:14.849593 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-e24b4043-8855-406c-9647-d03539e7bf24 req-9811789b-3361-44d4-9046-ad2fe8d57f19 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:12:14.850647 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-e24b4043-8855-406c-9647-d03539e7bf24 req-9811789b-3361-44d4-9046-ad2fe8d57f19 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:12:14.851447 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-e24b4043-8855-406c-9647-d03539e7bf24 req-9811789b-3361-44d4-9046-ad2fe8d57f19 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:12:14.878132 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:12:14.889891 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-e24b4043-8855-406c-9647-d03539e7bf24 req-9811789b-3361-44d4-9046-ad2fe8d57f19 service nova] Creating event network-vif-plugged:692705ac-81f3-4f8a-bfa8-a2581d7d7567 for instance 34dcd1da-b94c-426b-b08b-204ea287c8a2 on nch2-master-1 Oct 22 21:12:14.906213 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-e24b4043-8855-406c-9647-d03539e7bf24 req-9811789b-3361-44d4-9046-ad2fe8d57f19 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092011 Oct 22 21:12:14.906882 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2232/4481] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:12:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:12:15.245671 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-e6a0fd5b-1b47-4021-9ab1-5dc8b3e9e66e tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:12:15.250122 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-e6a0fd5b-1b47-4021-9ab1-5dc8b3e9e66e tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] [instance: 9dd3ccc4-26f1-4d75-b990-6636ed02293e] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:12:15.263829 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e6a0fd5b-1b47-4021-9ab1-5dc8b3e9e66e tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:12:15.268767 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e6a0fd5b-1b47-4021-9ab1-5dc8b3e9e66e tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:12:15.271571 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e6a0fd5b-1b47-4021-9ab1-5dc8b3e9e66e tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:12:15.272658 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e6a0fd5b-1b47-4021-9ab1-5dc8b3e9e66e tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:12:15.277461 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e6a0fd5b-1b47-4021-9ab1-5dc8b3e9e66e tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:12:15.278444 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e6a0fd5b-1b47-4021-9ab1-5dc8b3e9e66e tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:12:15.386141 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-98572e10-6aeb-4878-a9be-2d51d2922262 req-5abb0de3-7c97-49f6-a526-d02e7a5d5b88 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d285bc1-33a9-47e0-a148-756be61c0488", "tag": "7338f23d-cbc9-4db5-9c77-7a4f58137c5c"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:12:15.431246 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-98572e10-6aeb-4878-a9be-2d51d2922262 req-5abb0de3-7c97-49f6-a526-d02e7a5d5b88 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:12:15.438699 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-98572e10-6aeb-4878-a9be-2d51d2922262 req-5abb0de3-7c97-49f6-a526-d02e7a5d5b88 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:12:15.440679 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-98572e10-6aeb-4878-a9be-2d51d2922262 req-5abb0de3-7c97-49f6-a526-d02e7a5d5b88 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:12:15.479407 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-98572e10-6aeb-4878-a9be-2d51d2922262 req-5abb0de3-7c97-49f6-a526-d02e7a5d5b88 service nova] Creating event network-changed:7338f23d-cbc9-4db5-9c77-7a4f58137c5c for instance 4d285bc1-33a9-47e0-a148-756be61c0488 on nch1-master-1 Oct 22 21:12:15.488158 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-e6a0fd5b-1b47-4021-9ab1-5dc8b3e9e66e tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0d0bdfb04240209e4efa92f47cbb94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755501ba3e344f1aaf7ef80924bb57d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:12:15.495836 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-98572e10-6aeb-4878-a9be-2d51d2922262 req-5abb0de3-7c97-49f6-a526-d02e7a5d5b88 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115159 Oct 22 21:12:15.498711 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2233/4482] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:12:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:12:15.506883 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-e6a0fd5b-1b47-4021-9ab1-5dc8b3e9e66e tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] 10.222.0.18 "GET /compute/v2.1/servers/9dd3ccc4-26f1-4d75-b990-6636ed02293e" status: 200 len: 1307 microversion: 2.1 time: 0.265950 Oct 22 21:12:15.518306 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2250/4483] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:12:15 2022] GET /compute/v2.1/servers/9dd3ccc4-26f1-4d75-b990-6636ed02293e => generated 1307 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:12:15.532428 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-b0c8940b-1bfb-403a-92a6-b33201913f0a tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:12:15.533438 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-b0c8940b-1bfb-403a-92a6-b33201913f0a tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] [instance: 34dcd1da-b94c-426b-b08b-204ea287c8a2] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:12:15.554353 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b0c8940b-1bfb-403a-92a6-b33201913f0a tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:12:15.559320 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b0c8940b-1bfb-403a-92a6-b33201913f0a tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:12:15.560113 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b0c8940b-1bfb-403a-92a6-b33201913f0a tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:12:15.561428 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b0c8940b-1bfb-403a-92a6-b33201913f0a tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:12:15.563816 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b0c8940b-1bfb-403a-92a6-b33201913f0a tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:12:15.567996 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b0c8940b-1bfb-403a-92a6-b33201913f0a tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:12:15.998861 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-b0c8940b-1bfb-403a-92a6-b33201913f0a tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:12:16.017066 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-b0c8940b-1bfb-403a-92a6-b33201913f0a tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:12:16.020796 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-b0c8940b-1bfb-403a-92a6-b33201913f0a tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:12:16.025979 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-b0c8940b-1bfb-403a-92a6-b33201913f0a tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] 10.222.0.18 "GET /compute/v2.1/servers/34dcd1da-b94c-426b-b08b-204ea287c8a2" status: 200 len: 1407 microversion: 2.20 time: 0.524264 Oct 22 21:12:16.026658 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2234/4484] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:12:15 2022] GET /compute/v2.1/servers/34dcd1da-b94c-426b-b08b-204ea287c8a2 => generated 1407 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:12:16.552426 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-d5270b76-9f25-4378-86bc-e97babc673d4 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:12:16.554665 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-d5270b76-9f25-4378-86bc-e97babc673d4 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] [instance: 9dd3ccc4-26f1-4d75-b990-6636ed02293e] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:12:16.608510 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d5270b76-9f25-4378-86bc-e97babc673d4 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:12:16.615708 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d5270b76-9f25-4378-86bc-e97babc673d4 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:12:16.619829 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d5270b76-9f25-4378-86bc-e97babc673d4 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:12:16.622765 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d5270b76-9f25-4378-86bc-e97babc673d4 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:12:16.624158 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d5270b76-9f25-4378-86bc-e97babc673d4 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:12:16.625125 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d5270b76-9f25-4378-86bc-e97babc673d4 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:12:16.785074 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-d5270b76-9f25-4378-86bc-e97babc673d4 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0d0bdfb04240209e4efa92f47cbb94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755501ba3e344f1aaf7ef80924bb57d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:12:16.804471 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-d5270b76-9f25-4378-86bc-e97babc673d4 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] 10.222.0.18 "GET /compute/v2.1/servers/9dd3ccc4-26f1-4d75-b990-6636ed02293e" status: 200 len: 1295 microversion: 2.1 time: 0.270416 Oct 22 21:12:16.820477 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2251/4485] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:12:16 2022] GET /compute/v2.1/servers/9dd3ccc4-26f1-4d75-b990-6636ed02293e => generated 1295 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:12:17.059711 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-10a10f39-fe82-4c02-9b89-70f629ab54d3 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:12:17.061779 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-10a10f39-fe82-4c02-9b89-70f629ab54d3 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] [instance: 34dcd1da-b94c-426b-b08b-204ea287c8a2] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:12:17.095656 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-10a10f39-fe82-4c02-9b89-70f629ab54d3 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:12:17.097764 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-10a10f39-fe82-4c02-9b89-70f629ab54d3 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:12:17.097764 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-10a10f39-fe82-4c02-9b89-70f629ab54d3 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:12:17.098253 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-10a10f39-fe82-4c02-9b89-70f629ab54d3 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:12:17.099088 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-10a10f39-fe82-4c02-9b89-70f629ab54d3 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:12:17.100784 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-10a10f39-fe82-4c02-9b89-70f629ab54d3 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:12:17.434202 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-10a10f39-fe82-4c02-9b89-70f629ab54d3 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:12:17.453309 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-10a10f39-fe82-4c02-9b89-70f629ab54d3 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:12:17.455169 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-10a10f39-fe82-4c02-9b89-70f629ab54d3 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:12:17.456483 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-10a10f39-fe82-4c02-9b89-70f629ab54d3 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] 10.222.0.18 "GET /compute/v2.1/servers/34dcd1da-b94c-426b-b08b-204ea287c8a2" status: 200 len: 1599 microversion: 2.20 time: 0.407647 Oct 22 21:12:17.463804 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2235/4486] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:12:17 2022] GET /compute/v2.1/servers/34dcd1da-b94c-426b-b08b-204ea287c8a2 => generated 1599 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:12:17.499621 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-fd78ebce-199d-4ed6-bf33-f4e0015201d3 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:12:17.504143 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-fd78ebce-199d-4ed6-bf33-f4e0015201d3 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] [instance: 34dcd1da-b94c-426b-b08b-204ea287c8a2] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:12:17.519008 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell0:SELECT=16 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:12:17.532106 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fd78ebce-199d-4ed6-bf33-f4e0015201d3 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:12:17.540392 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fd78ebce-199d-4ed6-bf33-f4e0015201d3 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:12:17.542445 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fd78ebce-199d-4ed6-bf33-f4e0015201d3 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:12:17.543897 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fd78ebce-199d-4ed6-bf33-f4e0015201d3 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:12:17.552153 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fd78ebce-199d-4ed6-bf33-f4e0015201d3 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:12:17.554484 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fd78ebce-199d-4ed6-bf33-f4e0015201d3 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:12:17.610914 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-7f215c01-ed19-4eee-84f7-a27133401f15 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:12:17.611411 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-7f215c01-ed19-4eee-84f7-a27133401f15 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] [instance: 4dc70956-7b13-4f5b-99fe-f7ea6f320f0b] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:12:17.627845 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7f215c01-ed19-4eee-84f7-a27133401f15 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:12:17.628435 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7f215c01-ed19-4eee-84f7-a27133401f15 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:12:17.629010 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7f215c01-ed19-4eee-84f7-a27133401f15 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:12:17.629812 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7f215c01-ed19-4eee-84f7-a27133401f15 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:12:17.630274 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7f215c01-ed19-4eee-84f7-a27133401f15 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:12:17.630871 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7f215c01-ed19-4eee-84f7-a27133401f15 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:12:17.797494 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.objects.instance [None req-7f215c01-ed19-4eee-84f7-a27133401f15 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lazy-loading 'services' on Instance uuid 4dc70956-7b13-4f5b-99fe-f7ea6f320f0b {{(pid=138744) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 21:12:17.843844 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-fd78ebce-199d-4ed6-bf33-f4e0015201d3 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] 10.222.0.18 "GET /compute/v2.1/servers/34dcd1da-b94c-426b-b08b-204ea287c8a2/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.353150 Oct 22 21:12:17.844538 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2252/4487] 10.222.0.18 () {60 vars in 1316 bytes} [Sat Oct 22 21:12:17 2022] GET /compute/v2.1/servers/34dcd1da-b94c-426b-b08b-204ea287c8a2/os-interface => generated 284 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 22 21:12:17.861589 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-73da43c0-cfd5-4951-8027-905d9139b8c2 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:12:17.862924 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-73da43c0-cfd5-4951-8027-905d9139b8c2 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] [instance: 9dd3ccc4-26f1-4d75-b990-6636ed02293e] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:12:17.879603 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-73da43c0-cfd5-4951-8027-905d9139b8c2 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:12:17.881356 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-73da43c0-cfd5-4951-8027-905d9139b8c2 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:12:17.886347 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-73da43c0-cfd5-4951-8027-905d9139b8c2 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:12:17.887467 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-73da43c0-cfd5-4951-8027-905d9139b8c2 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:12:17.889910 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-73da43c0-cfd5-4951-8027-905d9139b8c2 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:12:17.890554 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-73da43c0-cfd5-4951-8027-905d9139b8c2 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:12:17.971972 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-7f215c01-ed19-4eee-84f7-a27133401f15 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] 10.222.0.18 "DELETE /compute/v2.1/servers/4dc70956-7b13-4f5b-99fe-f7ea6f320f0b/os-volume_attachments/a27768b2-577b-4af0-8f2f-5c9897b3e528" status: 202 len: 0 microversion: 2.1 time: 0.365118 Oct 22 21:12:17.973459 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2236/4488] 10.222.0.18 () {58 vars in 1416 bytes} [Sat Oct 22 21:12:17 2022] DELETE /compute/v2.1/servers/4dc70956-7b13-4f5b-99fe-f7ea6f320f0b/os-volume_attachments/a27768b2-577b-4af0-8f2f-5c9897b3e528 => generated 0 bytes in 368 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 21:12:17.992552 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-95b297c1-089b-4984-b242-0fb1fa19742e tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:12:17.996635 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-95b297c1-089b-4984-b242-0fb1fa19742e tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] [instance: 4dc70956-7b13-4f5b-99fe-f7ea6f320f0b] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:12:18.006982 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-95b297c1-089b-4984-b242-0fb1fa19742e tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:12:18.008238 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-95b297c1-089b-4984-b242-0fb1fa19742e tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:12:18.008975 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-95b297c1-089b-4984-b242-0fb1fa19742e tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:12:18.010096 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-95b297c1-089b-4984-b242-0fb1fa19742e tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:12:18.011995 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-95b297c1-089b-4984-b242-0fb1fa19742e tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:12:18.012877 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-95b297c1-089b-4984-b242-0fb1fa19742e tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:12:18.109940 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-95b297c1-089b-4984-b242-0fb1fa19742e tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] 10.222.0.18 "GET /compute/v2.1/servers/4dc70956-7b13-4f5b-99fe-f7ea6f320f0b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.120649 Oct 22 21:12:18.111359 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2237/4489] 10.222.0.18 () {58 vars in 1302 bytes} [Sat Oct 22 21:12:17 2022] GET /compute/v2.1/servers/4dc70956-7b13-4f5b-99fe-f7ea6f320f0b/os-volume_attachments => generated 197 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:12:19.007091 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-73da43c0-cfd5-4951-8027-905d9139b8c2 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0d0bdfb04240209e4efa92f47cbb94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755501ba3e344f1aaf7ef80924bb57d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:12:19.019137 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-73da43c0-cfd5-4951-8027-905d9139b8c2 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] 10.222.0.18 "GET /compute/v2.1/servers/9dd3ccc4-26f1-4d75-b990-6636ed02293e" status: 200 len: 1363 microversion: 2.1 time: 1.172739 Oct 22 21:12:19.019856 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2253/4490] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:12:17 2022] GET /compute/v2.1/servers/9dd3ccc4-26f1-4d75-b990-6636ed02293e => generated 1363 bytes in 1175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:12:19.126275 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-435cc38e-4046-44e3-b3ce-a8af8937f1d2 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:12:19.132145 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-435cc38e-4046-44e3-b3ce-a8af8937f1d2 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] [instance: 4dc70956-7b13-4f5b-99fe-f7ea6f320f0b] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:12:19.146570 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-435cc38e-4046-44e3-b3ce-a8af8937f1d2 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:12:19.147844 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-435cc38e-4046-44e3-b3ce-a8af8937f1d2 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:12:19.149467 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-435cc38e-4046-44e3-b3ce-a8af8937f1d2 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:12:19.152291 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-435cc38e-4046-44e3-b3ce-a8af8937f1d2 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:12:19.152890 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-435cc38e-4046-44e3-b3ce-a8af8937f1d2 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:12:19.154542 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-435cc38e-4046-44e3-b3ce-a8af8937f1d2 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:12:19.216580 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-435cc38e-4046-44e3-b3ce-a8af8937f1d2 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] 10.222.0.18 "GET /compute/v2.1/servers/4dc70956-7b13-4f5b-99fe-f7ea6f320f0b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.096928 Oct 22 21:12:19.238646 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2238/4491] 10.222.0.18 () {58 vars in 1302 bytes} [Sat Oct 22 21:12:19 2022] GET /compute/v2.1/servers/4dc70956-7b13-4f5b-99fe-f7ea6f320f0b/os-volume_attachments => generated 25 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 22 21:12:19.328270 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-3268af2f-4e76-4998-9ed4-0fa153fcae1a tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:12:19.330668 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-3268af2f-4e76-4998-9ed4-0fa153fcae1a tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] [instance: ff57c0ad-9f38-4c58-a194-b0b0d39b1fe0] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:12:19.342059 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3268af2f-4e76-4998-9ed4-0fa153fcae1a tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:12:19.344612 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3268af2f-4e76-4998-9ed4-0fa153fcae1a tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:12:19.347286 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3268af2f-4e76-4998-9ed4-0fa153fcae1a tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:12:19.348434 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3268af2f-4e76-4998-9ed4-0fa153fcae1a tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:12:19.349082 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3268af2f-4e76-4998-9ed4-0fa153fcae1a tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:12:19.351875 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3268af2f-4e76-4998-9ed4-0fa153fcae1a tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:12:19.408703 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.wsgi [None req-3268af2f-4e76-4998-9ed4-0fa153fcae1a tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] HTTP exception thrown: Cannot 'reboot' instance ff57c0ad-9f38-4c58-a194-b0b0d39b1fe0 while it is in vm_state rescued Oct 22 21:12:19.413186 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-3268af2f-4e76-4998-9ed4-0fa153fcae1a tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Request method failure captured: Oct 22 21:12:19.413186 ncdv-master-1 devstack@n-api.service[138745]: request: POST /compute/v2.1/servers/ff57c0ad-9f38-4c58-a194-b0b0d39b1fe0/action HTTP/1.1 Oct 22 21:12:19.413186 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 21:12:19.413186 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 21:12:19.413186 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 21:12:19.413186 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 28 Oct 22 21:12:19.413186 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 21:12:19.413186 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 21:12:19.413186 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 21:12:19.413186 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 21:12:19.413186 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVFvWfSOLw3btNK4SoFxMjr8wtqLT2k4PIwSqWFeanHIvdQwXt9iIjJT1pUVLfrbgtnh-m8tchSLAY2pHDnqTUexh_EARjCC9pvXEvKIKJHHkmxJW7Q2ZJx8_vGRYvToSXq_GR6KcHjZaBQXLzQj4qX1yg72hOaDAkM7_Yx2kYaYfxok Oct 22 21:12:19.413186 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 21:12:19.413186 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 21:12:19.413186 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 21:12:19.413186 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 21:12:19.413186 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 21:12:19.413186 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 21:12:19.413186 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: dddce0c46c75496f96f2e2dae77751dc Oct 22 21:12:19.413186 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-610226422 Oct 22 21:12:19.413186 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 21:12:19.413186 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 21:12:19.413186 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_dddce0c46c75496f96f2e2dae77751dc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/dddce0c46c75496f96f2e2dae77751dc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/dddce0c46c75496f96f2e2dae77751dc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/dddce0c46c75496f96f2e2dae77751dc"}]}] Oct 22 21:12:19.413186 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-ServerRescueNegativeTestJSON-610226422 Oct 22 21:12:19.413186 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: dddce0c46c75496f96f2e2dae77751dc Oct 22 21:12:19.413186 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-610226422 Oct 22 21:12:19.413186 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-ServerRescueNegativeTestJSON-610226422-project Oct 22 21:12:19.413186 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 21:12:19.413186 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 21:12:19.413186 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: 67e7a09f769748629425ad36120a7fd6 Oct 22 21:12:19.413186 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-ServerRescueNegativeTestJSON-610226422-project Oct 22 21:12:19.413186 ncdv-master-1 devstack@n-api.service[138745]: Oct 22 21:12:19.413186 ncdv-master-1 devstack@n-api.service[138745]: {"reboot": {"type": "HARD"}} Oct 22 21:12:19.413186 ncdv-master-1 devstack@n-api.service[138745]: method: > Oct 22 21:12:19.413186 ncdv-master-1 devstack@n-api.service[138745]: exception: Cannot 'reboot' instance ff57c0ad-9f38-4c58-a194-b0b0d39b1fe0 while it is in vm_state rescued Oct 22 21:12:19.413186 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'id': 'ff57c0ad-9f38-4c58-a194-b0b0d39b1fe0', 'body': {'reboot': {'type': 'HARD'}}} Oct 22 21:12:19.413186 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:12:19.413186 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:12:19.413186 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1036, in _action_reboot Oct 22 21:12:19.413186 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi self.compute_api.reboot(context, instance, reboot_type) Oct 22 21:12:19.413186 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 22 21:12:19.413186 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 22 21:12:19.413186 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3552, in reboot Oct 22 21:12:19.413186 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi self._hard_reboot(context, instance) Oct 22 21:12:19.413186 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 22 21:12:19.413186 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 22 21:12:19.413186 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance ff57c0ad-9f38-4c58-a194-b0b0d39b1fe0 in vm_state rescued. Cannot _hard_reboot while the instance is in this state. Oct 22 21:12:19.413186 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:12:19.413186 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:12:19.413186 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:12:19.413186 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:12:19.413186 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:12:19.413186 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:12:19.413186 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:12:19.413186 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:12:19.413186 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:12:19.413186 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:12:19.413186 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 21:12:19.413186 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 21:12:19.413186 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1040, in _action_reboot Oct 22 21:12:19.413186 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 22 21:12:19.413186 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 22 21:12:19.413186 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 22 21:12:19.417691 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'reboot' instance ff57c0ad-9f38-4c58-a194-b0b0d39b1fe0 while it is in vm_state rescued Oct 22 21:12:19.417691 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:12:19.417691 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:12:19.417691 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:12:19.417691 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:12:19.417691 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:12:19.417691 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:12:19.417691 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:12:19.417691 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:12:19.417691 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'reboot' instance ff57c0ad-9f38-4c58-a194-b0b0d39b1fe0 while it is in vm_state rescued Oct 22 21:12:19.417691 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:12:19.419663 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-3268af2f-4e76-4998-9ed4-0fa153fcae1a tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Returning 409 to user: Cannot 'reboot' instance ff57c0ad-9f38-4c58-a194-b0b0d39b1fe0 while it is in vm_state rescued {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:12:19.420838 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-3268af2f-4e76-4998-9ed4-0fa153fcae1a tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] 10.222.0.18 "POST /compute/v2.1/servers/ff57c0ad-9f38-4c58-a194-b0b0d39b1fe0/action" status: 409 len: 145 microversion: 2.1 time: 0.098667 Oct 22 21:12:19.426140 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2254/4492] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 21:12:19 2022] POST /compute/v2.1/servers/ff57c0ad-9f38-4c58-a194-b0b0d39b1fe0/action => generated 145 bytes in 100 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 22 21:12:19.432478 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-3c275fa0-6c3e-444c-a504-db6380d2cded tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "085e4478-6edc-4a69-8e08-f9831713eb65"}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:12:19.435706 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-3c275fa0-6c3e-444c-a504-db6380d2cded tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] [instance: ff57c0ad-9f38-4c58-a194-b0b0d39b1fe0] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:12:19.445141 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3c275fa0-6c3e-444c-a504-db6380d2cded tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:12:19.445930 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3c275fa0-6c3e-444c-a504-db6380d2cded tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:12:19.448438 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3c275fa0-6c3e-444c-a504-db6380d2cded tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:12:19.449445 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3c275fa0-6c3e-444c-a504-db6380d2cded tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:12:19.450336 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3c275fa0-6c3e-444c-a504-db6380d2cded tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:12:19.450878 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3c275fa0-6c3e-444c-a504-db6380d2cded tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:12:19.497700 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-3c275fa0-6c3e-444c-a504-db6380d2cded tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] HTTP exception thrown: Cannot 'rebuild' instance ff57c0ad-9f38-4c58-a194-b0b0d39b1fe0 while it is in vm_state rescued Oct 22 21:12:19.500282 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-3c275fa0-6c3e-444c-a504-db6380d2cded tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Request method failure captured: Oct 22 21:12:19.500282 ncdv-master-1 devstack@n-api.service[138744]: request: POST /compute/v2.1/servers/ff57c0ad-9f38-4c58-a194-b0b0d39b1fe0/action HTTP/1.1 Oct 22 21:12:19.500282 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 21:12:19.500282 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 21:12:19.500282 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 21:12:19.500282 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 65 Oct 22 21:12:19.500282 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 21:12:19.500282 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 21:12:19.500282 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 21:12:19.500282 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 21:12:19.500282 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVFvWfSOLw3btNK4SoFxMjr8wtqLT2k4PIwSqWFeanHIvdQwXt9iIjJT1pUVLfrbgtnh-m8tchSLAY2pHDnqTUexh_EARjCC9pvXEvKIKJHHkmxJW7Q2ZJx8_vGRYvToSXq_GR6KcHjZaBQXLzQj4qX1yg72hOaDAkM7_Yx2kYaYfxok Oct 22 21:12:19.500282 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 21:12:19.500282 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 21:12:19.500282 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 21:12:19.500282 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 21:12:19.500282 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 21:12:19.500282 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 21:12:19.500282 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: dddce0c46c75496f96f2e2dae77751dc Oct 22 21:12:19.500282 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-610226422 Oct 22 21:12:19.500282 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 21:12:19.500282 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 21:12:19.500282 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_dddce0c46c75496f96f2e2dae77751dc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/dddce0c46c75496f96f2e2dae77751dc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/dddce0c46c75496f96f2e2dae77751dc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/dddce0c46c75496f96f2e2dae77751dc"}]}] Oct 22 21:12:19.500282 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-ServerRescueNegativeTestJSON-610226422 Oct 22 21:12:19.500282 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: dddce0c46c75496f96f2e2dae77751dc Oct 22 21:12:19.500282 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-610226422 Oct 22 21:12:19.500282 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-ServerRescueNegativeTestJSON-610226422-project Oct 22 21:12:19.500282 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 21:12:19.500282 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 21:12:19.500282 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: 67e7a09f769748629425ad36120a7fd6 Oct 22 21:12:19.500282 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-ServerRescueNegativeTestJSON-610226422-project Oct 22 21:12:19.500282 ncdv-master-1 devstack@n-api.service[138744]: Oct 22 21:12:19.500282 ncdv-master-1 devstack@n-api.service[138744]: {"rebuild": {"imageRef": "085e4478-6edc-4a69-8e08-f9831713eb65"}} Oct 22 21:12:19.500282 ncdv-master-1 devstack@n-api.service[138744]: method: > Oct 22 21:12:19.500282 ncdv-master-1 devstack@n-api.service[138744]: exception: Cannot 'rebuild' instance ff57c0ad-9f38-4c58-a194-b0b0d39b1fe0 while it is in vm_state rescued Oct 22 21:12:19.500282 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': 'ff57c0ad-9f38-4c58-a194-b0b0d39b1fe0', 'body': {'rebuild': {'imageRef': '085e4478-6edc-4a69-8e08-f9831713eb65'}}} Oct 22 21:12:19.500282 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:12:19.500282 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:12:19.500282 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1223, in _action_rebuild Oct 22 21:12:19.500282 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi self.compute_api.rebuild(context, Oct 22 21:12:19.500282 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 22 21:12:19.500282 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 22 21:12:19.500282 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 22 21:12:19.500282 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 22 21:12:19.500282 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 22 21:12:19.500282 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 22 21:12:19.500282 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 22 21:12:19.500282 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 22 21:12:19.500282 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance ff57c0ad-9f38-4c58-a194-b0b0d39b1fe0 in vm_state rescued. Cannot rebuild while the instance is in this state. Oct 22 21:12:19.500282 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:12:19.500282 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:12:19.500282 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:12:19.500282 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:12:19.500282 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:12:19.500282 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:12:19.500282 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:12:19.500282 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:12:19.500282 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:12:19.500282 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:12:19.500282 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 21:12:19.500282 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 21:12:19.500282 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 21:12:19.500282 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 21:12:19.500282 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 21:12:19.506393 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 21:12:19.506393 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Oct 22 21:12:19.506393 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1231, in _action_rebuild Oct 22 21:12:19.506393 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 22 21:12:19.506393 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 22 21:12:19.506393 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 22 21:12:19.506393 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rebuild' instance ff57c0ad-9f38-4c58-a194-b0b0d39b1fe0 while it is in vm_state rescued Oct 22 21:12:19.506393 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:12:19.506393 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:12:19.506393 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:12:19.506393 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:12:19.506393 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:12:19.506393 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:12:19.506393 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:12:19.506393 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:12:19.506393 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rebuild' instance ff57c0ad-9f38-4c58-a194-b0b0d39b1fe0 while it is in vm_state rescued Oct 22 21:12:19.506393 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:12:19.506393 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-3c275fa0-6c3e-444c-a504-db6380d2cded tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Returning 409 to user: Cannot 'rebuild' instance ff57c0ad-9f38-4c58-a194-b0b0d39b1fe0 while it is in vm_state rescued {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:12:19.506393 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-3c275fa0-6c3e-444c-a504-db6380d2cded tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] 10.222.0.18 "POST /compute/v2.1/servers/ff57c0ad-9f38-4c58-a194-b0b0d39b1fe0/action" status: 409 len: 146 microversion: 2.1 time: 0.073719 Oct 22 21:12:19.506393 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2239/4493] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 21:12:19 2022] POST /compute/v2.1/servers/ff57c0ad-9f38-4c58-a194-b0b0d39b1fe0/action => generated 146 bytes in 76 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Oct 22 21:12:19.515409 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-35570f7a-178d-4d3a-96a2-33a85cc1cc1c tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:12:19.515901 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-35570f7a-178d-4d3a-96a2-33a85cc1cc1c tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] [instance: 4dc70956-7b13-4f5b-99fe-f7ea6f320f0b] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:12:19.523245 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-35570f7a-178d-4d3a-96a2-33a85cc1cc1c tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:12:19.524769 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-35570f7a-178d-4d3a-96a2-33a85cc1cc1c tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:12:19.525416 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-35570f7a-178d-4d3a-96a2-33a85cc1cc1c tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:12:19.526388 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-35570f7a-178d-4d3a-96a2-33a85cc1cc1c tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:12:19.527315 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-35570f7a-178d-4d3a-96a2-33a85cc1cc1c tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:12:19.528350 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-35570f7a-178d-4d3a-96a2-33a85cc1cc1c tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:12:19.584605 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-35570f7a-178d-4d3a-96a2-33a85cc1cc1c tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] [instance: 4dc70956-7b13-4f5b-99fe-f7ea6f320f0b] Going to try to terminate instance {{(pid=138745) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 21:12:19.799466 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-35570f7a-178d-4d3a-96a2-33a85cc1cc1c tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] 10.222.0.18 "DELETE /compute/v2.1/servers/4dc70956-7b13-4f5b-99fe-f7ea6f320f0b" status: 204 len: 0 microversion: 2.1 time: 0.286101 Oct 22 21:12:19.802141 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2255/4494] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 21:12:19 2022] DELETE /compute/v2.1/servers/4dc70956-7b13-4f5b-99fe-f7ea6f320f0b => generated 0 bytes in 293 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 21:12:19.810836 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-7dbbf34e-f173-461a-b17c-0277b7560f77 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:12:19.812097 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-7dbbf34e-f173-461a-b17c-0277b7560f77 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] [instance: 4dc70956-7b13-4f5b-99fe-f7ea6f320f0b] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:12:19.833564 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7dbbf34e-f173-461a-b17c-0277b7560f77 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:12:19.834610 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7dbbf34e-f173-461a-b17c-0277b7560f77 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:12:19.835103 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7dbbf34e-f173-461a-b17c-0277b7560f77 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:12:19.836151 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7dbbf34e-f173-461a-b17c-0277b7560f77 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:12:19.836817 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7dbbf34e-f173-461a-b17c-0277b7560f77 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:12:19.838815 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7dbbf34e-f173-461a-b17c-0277b7560f77 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:12:20.043932 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-c1dc86ad-1adb-4268-8cbe-913daf4e0910 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:12:20.044860 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-c1dc86ad-1adb-4268-8cbe-913daf4e0910 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] [instance: 9dd3ccc4-26f1-4d75-b990-6636ed02293e] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:12:20.058046 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c1dc86ad-1adb-4268-8cbe-913daf4e0910 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:12:20.060553 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c1dc86ad-1adb-4268-8cbe-913daf4e0910 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:12:20.061078 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c1dc86ad-1adb-4268-8cbe-913daf4e0910 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:12:20.061855 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c1dc86ad-1adb-4268-8cbe-913daf4e0910 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:12:20.063864 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c1dc86ad-1adb-4268-8cbe-913daf4e0910 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:12:20.064556 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c1dc86ad-1adb-4268-8cbe-913daf4e0910 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:12:20.119269 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:12:20.292660 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-7dbbf34e-f173-461a-b17c-0277b7560f77 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e7a09f769748629425ad36120a7fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddce0c46c75496f96f2e2dae77751dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:12:20.302250 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-7dbbf34e-f173-461a-b17c-0277b7560f77 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] 10.222.0.18 "GET /compute/v2.1/servers/4dc70956-7b13-4f5b-99fe-f7ea6f320f0b" status: 200 len: 1690 microversion: 2.1 time: 0.495877 Oct 22 21:12:20.308298 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2240/4495] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:12:19 2022] GET /compute/v2.1/servers/4dc70956-7b13-4f5b-99fe-f7ea6f320f0b => generated 1690 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:12:20.482894 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-c1dc86ad-1adb-4268-8cbe-913daf4e0910 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0d0bdfb04240209e4efa92f47cbb94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755501ba3e344f1aaf7ef80924bb57d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:12:20.494513 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-c1dc86ad-1adb-4268-8cbe-913daf4e0910 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] 10.222.0.18 "GET /compute/v2.1/servers/9dd3ccc4-26f1-4d75-b990-6636ed02293e" status: 200 len: 1363 microversion: 2.1 time: 0.455765 Oct 22 21:12:20.495594 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2256/4496] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:12:20 2022] GET /compute/v2.1/servers/9dd3ccc4-26f1-4d75-b990-6636ed02293e => generated 1363 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:12:20.540369 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-7235f0d5-6777-4150-bf55-00ce424e808e req-7ccb4f69-e0ce-495e-9226-546706ff05bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9dd3ccc4-26f1-4d75-b990-6636ed02293e", "tag": "82bb390e-11d5-425f-8b41-2ddc73f226c9"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:12:20.551319 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-7235f0d5-6777-4150-bf55-00ce424e808e req-7ccb4f69-e0ce-495e-9226-546706ff05bd service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:12:20.552198 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-7235f0d5-6777-4150-bf55-00ce424e808e req-7ccb4f69-e0ce-495e-9226-546706ff05bd service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:12:20.552857 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-7235f0d5-6777-4150-bf55-00ce424e808e req-7ccb4f69-e0ce-495e-9226-546706ff05bd service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:12:20.571519 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-7235f0d5-6777-4150-bf55-00ce424e808e req-7ccb4f69-e0ce-495e-9226-546706ff05bd service nova] Creating event network-changed:82bb390e-11d5-425f-8b41-2ddc73f226c9 for instance 9dd3ccc4-26f1-4d75-b990-6636ed02293e on nch1-master-1 Oct 22 21:12:20.576344 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-7235f0d5-6777-4150-bf55-00ce424e808e req-7ccb4f69-e0ce-495e-9226-546706ff05bd service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039564 Oct 22 21:12:20.577235 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2241/4497] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:12:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:12:21.338543 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-aa7cb4d4-1641-411b-8935-2c7e21bb2f46 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:12:21.341061 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-aa7cb4d4-1641-411b-8935-2c7e21bb2f46 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] [instance: 4dc70956-7b13-4f5b-99fe-f7ea6f320f0b] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:12:21.356955 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-aa7cb4d4-1641-411b-8935-2c7e21bb2f46 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:12:21.357736 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-aa7cb4d4-1641-411b-8935-2c7e21bb2f46 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:12:21.358465 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-aa7cb4d4-1641-411b-8935-2c7e21bb2f46 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:12:21.360114 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-aa7cb4d4-1641-411b-8935-2c7e21bb2f46 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:12:21.360886 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-aa7cb4d4-1641-411b-8935-2c7e21bb2f46 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:12:21.361559 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-aa7cb4d4-1641-411b-8935-2c7e21bb2f46 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:12:21.519324 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-0582c35d-c5f9-4243-95f6-6a6ceb5b6382 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:12:21.520274 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-0582c35d-c5f9-4243-95f6-6a6ceb5b6382 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] [instance: 9dd3ccc4-26f1-4d75-b990-6636ed02293e] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:12:21.540746 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0582c35d-c5f9-4243-95f6-6a6ceb5b6382 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:12:21.541618 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0582c35d-c5f9-4243-95f6-6a6ceb5b6382 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:12:21.542407 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0582c35d-c5f9-4243-95f6-6a6ceb5b6382 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:12:21.545100 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0582c35d-c5f9-4243-95f6-6a6ceb5b6382 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:12:21.549860 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0582c35d-c5f9-4243-95f6-6a6ceb5b6382 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:12:21.554293 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0582c35d-c5f9-4243-95f6-6a6ceb5b6382 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:12:21.751773 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-aa7cb4d4-1641-411b-8935-2c7e21bb2f46 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e7a09f769748629425ad36120a7fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddce0c46c75496f96f2e2dae77751dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:12:21.780601 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-aa7cb4d4-1641-411b-8935-2c7e21bb2f46 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] 10.222.0.18 "GET /compute/v2.1/servers/4dc70956-7b13-4f5b-99fe-f7ea6f320f0b" status: 200 len: 1690 microversion: 2.1 time: 0.451558 Oct 22 21:12:21.797862 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2257/4498] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:12:21 2022] GET /compute/v2.1/servers/4dc70956-7b13-4f5b-99fe-f7ea6f320f0b => generated 1690 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:12:21.971622 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-0582c35d-c5f9-4243-95f6-6a6ceb5b6382 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0d0bdfb04240209e4efa92f47cbb94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755501ba3e344f1aaf7ef80924bb57d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:12:21.994318 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-0582c35d-c5f9-4243-95f6-6a6ceb5b6382 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] 10.222.0.18 "GET /compute/v2.1/servers/9dd3ccc4-26f1-4d75-b990-6636ed02293e" status: 200 len: 1363 microversion: 2.1 time: 0.480696 Oct 22 21:12:21.995568 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2242/4499] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:12:21 2022] GET /compute/v2.1/servers/9dd3ccc4-26f1-4d75-b990-6636ed02293e => generated 1363 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:12:22.605802 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-61bfd95d-858b-467e-94ab-61ea8ca9c484 req-f2f31a52-02a5-490a-9ce9-23daaf80fec9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34dcd1da-b94c-426b-b08b-204ea287c8a2", "tag": "692705ac-81f3-4f8a-bfa8-a2581d7d7567"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:12:22.628966 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-61bfd95d-858b-467e-94ab-61ea8ca9c484 req-f2f31a52-02a5-490a-9ce9-23daaf80fec9 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:12:22.629532 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-61bfd95d-858b-467e-94ab-61ea8ca9c484 req-f2f31a52-02a5-490a-9ce9-23daaf80fec9 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:12:22.630316 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-61bfd95d-858b-467e-94ab-61ea8ca9c484 req-f2f31a52-02a5-490a-9ce9-23daaf80fec9 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:12:22.666845 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-61bfd95d-858b-467e-94ab-61ea8ca9c484 req-f2f31a52-02a5-490a-9ce9-23daaf80fec9 service nova] Creating event network-changed:692705ac-81f3-4f8a-bfa8-a2581d7d7567 for instance 34dcd1da-b94c-426b-b08b-204ea287c8a2 on nch2-master-1 Oct 22 21:12:22.686211 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-61bfd95d-858b-467e-94ab-61ea8ca9c484 req-f2f31a52-02a5-490a-9ce9-23daaf80fec9 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084165 Oct 22 21:12:22.687098 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2258/4500] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:12:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:12:22.812514 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-6c231294-1c36-4cce-a3a4-f3f973fa60b1 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:12:22.813126 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-6c231294-1c36-4cce-a3a4-f3f973fa60b1 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] [instance: 4dc70956-7b13-4f5b-99fe-f7ea6f320f0b] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:12:22.830610 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6c231294-1c36-4cce-a3a4-f3f973fa60b1 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:12:22.831147 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6c231294-1c36-4cce-a3a4-f3f973fa60b1 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:12:22.832004 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6c231294-1c36-4cce-a3a4-f3f973fa60b1 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:12:22.832973 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6c231294-1c36-4cce-a3a4-f3f973fa60b1 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:12:22.834927 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6c231294-1c36-4cce-a3a4-f3f973fa60b1 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:12:22.835746 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6c231294-1c36-4cce-a3a4-f3f973fa60b1 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:12:23.000549 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell0:SELECT=2 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:12:23.020769 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-1a77e978-2bf7-4a0a-a88c-d4d7c0184240 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:12:23.021606 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-1a77e978-2bf7-4a0a-a88c-d4d7c0184240 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] [instance: 9dd3ccc4-26f1-4d75-b990-6636ed02293e] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:12:23.029890 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1a77e978-2bf7-4a0a-a88c-d4d7c0184240 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:12:23.030408 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1a77e978-2bf7-4a0a-a88c-d4d7c0184240 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:12:23.030871 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1a77e978-2bf7-4a0a-a88c-d4d7c0184240 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:12:23.031636 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1a77e978-2bf7-4a0a-a88c-d4d7c0184240 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:12:23.032354 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1a77e978-2bf7-4a0a-a88c-d4d7c0184240 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:12:23.033404 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1a77e978-2bf7-4a0a-a88c-d4d7c0184240 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:12:23.417467 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-6c231294-1c36-4cce-a3a4-f3f973fa60b1 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e7a09f769748629425ad36120a7fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddce0c46c75496f96f2e2dae77751dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:12:23.425652 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-6c231294-1c36-4cce-a3a4-f3f973fa60b1 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] 10.222.0.18 "GET /compute/v2.1/servers/4dc70956-7b13-4f5b-99fe-f7ea6f320f0b" status: 200 len: 1690 microversion: 2.1 time: 0.618296 Oct 22 21:12:23.427209 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2243/4501] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:12:22 2022] GET /compute/v2.1/servers/4dc70956-7b13-4f5b-99fe-f7ea6f320f0b => generated 1690 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:12:23.686501 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-1a77e978-2bf7-4a0a-a88c-d4d7c0184240 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0d0bdfb04240209e4efa92f47cbb94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755501ba3e344f1aaf7ef80924bb57d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:12:23.697437 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-1a77e978-2bf7-4a0a-a88c-d4d7c0184240 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] 10.222.0.18 "GET /compute/v2.1/servers/9dd3ccc4-26f1-4d75-b990-6636ed02293e" status: 200 len: 1363 microversion: 2.1 time: 0.680891 Oct 22 21:12:23.698220 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2259/4502] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:12:23 2022] GET /compute/v2.1/servers/9dd3ccc4-26f1-4d75-b990-6636ed02293e => generated 1363 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:12:24.450376 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-27df1dad-c4ec-4904-be0c-844b94f26364 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:12:24.451730 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-27df1dad-c4ec-4904-be0c-844b94f26364 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] [instance: 4dc70956-7b13-4f5b-99fe-f7ea6f320f0b] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:12:24.462995 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell0:SELECT=8 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:12:24.467125 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-27df1dad-c4ec-4904-be0c-844b94f26364 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:12:24.468040 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-27df1dad-c4ec-4904-be0c-844b94f26364 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:12:24.468826 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-27df1dad-c4ec-4904-be0c-844b94f26364 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:12:24.469812 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-27df1dad-c4ec-4904-be0c-844b94f26364 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:12:24.470437 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-27df1dad-c4ec-4904-be0c-844b94f26364 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:12:24.471117 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-27df1dad-c4ec-4904-be0c-844b94f26364 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:12:24.724690 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-d919a1f2-f018-48df-940a-f6f5772ab7a6 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:12:24.726639 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-d919a1f2-f018-48df-940a-f6f5772ab7a6 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] [instance: 9dd3ccc4-26f1-4d75-b990-6636ed02293e] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:12:24.738710 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d919a1f2-f018-48df-940a-f6f5772ab7a6 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:12:24.739716 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d919a1f2-f018-48df-940a-f6f5772ab7a6 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:12:24.740578 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d919a1f2-f018-48df-940a-f6f5772ab7a6 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:12:24.741775 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d919a1f2-f018-48df-940a-f6f5772ab7a6 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:12:24.744115 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d919a1f2-f018-48df-940a-f6f5772ab7a6 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:12:24.745389 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d919a1f2-f018-48df-940a-f6f5772ab7a6 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:12:25.380221 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-27df1dad-c4ec-4904-be0c-844b94f26364 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e7a09f769748629425ad36120a7fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddce0c46c75496f96f2e2dae77751dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:12:25.396374 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-27df1dad-c4ec-4904-be0c-844b94f26364 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] 10.222.0.18 "GET /compute/v2.1/servers/4dc70956-7b13-4f5b-99fe-f7ea6f320f0b" status: 200 len: 1690 microversion: 2.1 time: 0.949769 Oct 22 21:12:25.408097 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2244/4503] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:12:24 2022] GET /compute/v2.1/servers/4dc70956-7b13-4f5b-99fe-f7ea6f320f0b => generated 1690 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:12:25.541824 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-d919a1f2-f018-48df-940a-f6f5772ab7a6 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0d0bdfb04240209e4efa92f47cbb94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755501ba3e344f1aaf7ef80924bb57d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:12:25.552472 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-d919a1f2-f018-48df-940a-f6f5772ab7a6 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] 10.222.0.18 "GET /compute/v2.1/servers/9dd3ccc4-26f1-4d75-b990-6636ed02293e" status: 200 len: 1363 microversion: 2.1 time: 0.834599 Oct 22 21:12:25.553486 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2260/4504] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:12:24 2022] GET /compute/v2.1/servers/9dd3ccc4-26f1-4d75-b990-6636ed02293e => generated 1363 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:12:26.179669 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-1c38be9c-dafb-4499-9859-23e2cfcb1b00 req-39a18653-041a-4998-81aa-b7f1ad482ea4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4dc70956-7b13-4f5b-99fe-f7ea6f320f0b", "name": "network-vif-deleted", "tag": "88166dcc-9792-4971-8d68-0960842beacf"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:12:26.238330 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-1c38be9c-dafb-4499-9859-23e2cfcb1b00 req-39a18653-041a-4998-81aa-b7f1ad482ea4 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:12:26.243536 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-1c38be9c-dafb-4499-9859-23e2cfcb1b00 req-39a18653-041a-4998-81aa-b7f1ad482ea4 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:12:26.248234 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-1c38be9c-dafb-4499-9859-23e2cfcb1b00 req-39a18653-041a-4998-81aa-b7f1ad482ea4 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:12:26.294322 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-1c38be9c-dafb-4499-9859-23e2cfcb1b00 req-39a18653-041a-4998-81aa-b7f1ad482ea4 service nova] Creating event network-vif-deleted:88166dcc-9792-4971-8d68-0960842beacf for instance 4dc70956-7b13-4f5b-99fe-f7ea6f320f0b on nch2-master-1 Oct 22 21:12:26.305909 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-1c38be9c-dafb-4499-9859-23e2cfcb1b00 req-39a18653-041a-4998-81aa-b7f1ad482ea4 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132240 Oct 22 21:12:26.307428 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2245/4505] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:12:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:12:26.424221 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-f9387c77-9655-4576-b21d-977d911b42d7 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:12:26.427615 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-f9387c77-9655-4576-b21d-977d911b42d7 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] [instance: 4dc70956-7b13-4f5b-99fe-f7ea6f320f0b] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:12:26.450533 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f9387c77-9655-4576-b21d-977d911b42d7 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:12:26.451504 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f9387c77-9655-4576-b21d-977d911b42d7 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:12:26.452226 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f9387c77-9655-4576-b21d-977d911b42d7 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:12:26.453219 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f9387c77-9655-4576-b21d-977d911b42d7 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:12:26.459486 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f9387c77-9655-4576-b21d-977d911b42d7 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:12:26.460328 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f9387c77-9655-4576-b21d-977d911b42d7 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:12:26.547184 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f9387c77-9655-4576-b21d-977d911b42d7 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:12:26.548016 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f9387c77-9655-4576-b21d-977d911b42d7 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:12:26.548688 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f9387c77-9655-4576-b21d-977d911b42d7 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:12:26.550159 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.objects.instance [None req-f9387c77-9655-4576-b21d-977d911b42d7 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lazy-loading 'fault' on Instance uuid 4dc70956-7b13-4f5b-99fe-f7ea6f320f0b {{(pid=138745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 21:12:26.578620 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-6dd7b5d8-1f46-4def-9a10-ff3798ea34ea tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:12:26.579354 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-6dd7b5d8-1f46-4def-9a10-ff3798ea34ea tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] [instance: 9dd3ccc4-26f1-4d75-b990-6636ed02293e] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:12:26.602133 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6dd7b5d8-1f46-4def-9a10-ff3798ea34ea tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:12:26.603662 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6dd7b5d8-1f46-4def-9a10-ff3798ea34ea tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:12:26.605545 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6dd7b5d8-1f46-4def-9a10-ff3798ea34ea tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:12:26.608979 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6dd7b5d8-1f46-4def-9a10-ff3798ea34ea tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:12:26.609699 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6dd7b5d8-1f46-4def-9a10-ff3798ea34ea tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:12:26.612527 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6dd7b5d8-1f46-4def-9a10-ff3798ea34ea tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:12:26.647714 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-f9387c77-9655-4576-b21d-977d911b42d7 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e7a09f769748629425ad36120a7fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddce0c46c75496f96f2e2dae77751dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:12:26.678658 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-f9387c77-9655-4576-b21d-977d911b42d7 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] 10.222.0.18 "GET /compute/v2.1/servers/4dc70956-7b13-4f5b-99fe-f7ea6f320f0b" status: 200 len: 1336 microversion: 2.1 time: 0.258219 Oct 22 21:12:26.681439 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2261/4506] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:12:26 2022] GET /compute/v2.1/servers/4dc70956-7b13-4f5b-99fe-f7ea6f320f0b => generated 1336 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:12:26.931854 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-6dd7b5d8-1f46-4def-9a10-ff3798ea34ea tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0d0bdfb04240209e4efa92f47cbb94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755501ba3e344f1aaf7ef80924bb57d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:12:26.951742 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-6dd7b5d8-1f46-4def-9a10-ff3798ea34ea tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] 10.222.0.18 "GET /compute/v2.1/servers/9dd3ccc4-26f1-4d75-b990-6636ed02293e" status: 200 len: 1363 microversion: 2.1 time: 0.367267 Oct 22 21:12:26.953376 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2246/4507] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:12:26 2022] GET /compute/v2.1/servers/9dd3ccc4-26f1-4d75-b990-6636ed02293e => generated 1363 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:12:27.705166 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-4b5d0d39-abbc-4480-a5b6-d7aadebfb061 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:12:27.706274 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-4b5d0d39-abbc-4480-a5b6-d7aadebfb061 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] [instance: 4dc70956-7b13-4f5b-99fe-f7ea6f320f0b] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:12:27.725533 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4b5d0d39-abbc-4480-a5b6-d7aadebfb061 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:12:27.726983 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4b5d0d39-abbc-4480-a5b6-d7aadebfb061 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:12:27.728166 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4b5d0d39-abbc-4480-a5b6-d7aadebfb061 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:12:27.729257 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4b5d0d39-abbc-4480-a5b6-d7aadebfb061 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:12:27.730738 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4b5d0d39-abbc-4480-a5b6-d7aadebfb061 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:12:27.731710 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4b5d0d39-abbc-4480-a5b6-d7aadebfb061 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:12:27.754114 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.wsgi [None req-4b5d0d39-abbc-4480-a5b6-d7aadebfb061 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] HTTP exception thrown: Instance 4dc70956-7b13-4f5b-99fe-f7ea6f320f0b could not be found. Oct 22 21:12:27.756050 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-4b5d0d39-abbc-4480-a5b6-d7aadebfb061 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Request method failure captured: Oct 22 21:12:27.756050 ncdv-master-1 devstack@n-api.service[138745]: request: GET /compute/v2.1/servers/4dc70956-7b13-4f5b-99fe-f7ea6f320f0b HTTP/1.1 Oct 22 21:12:27.756050 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 21:12:27.756050 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 21:12:27.756050 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 21:12:27.756050 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 0 Oct 22 21:12:27.756050 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 21:12:27.756050 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 21:12:27.756050 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 21:12:27.756050 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 21:12:27.756050 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVFvWfSOLw3btNK4SoFxMjr8wtqLT2k4PIwSqWFeanHIvdQwXt9iIjJT1pUVLfrbgtnh-m8tchSLAY2pHDnqTUexh_EARjCC9pvXEvKIKJHHkmxJW7Q2ZJx8_vGRYvToSXq_GR6KcHjZaBQXLzQj4qX1yg72hOaDAkM7_Yx2kYaYfxok Oct 22 21:12:27.756050 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 21:12:27.756050 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 21:12:27.756050 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 21:12:27.756050 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 21:12:27.756050 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 21:12:27.756050 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 21:12:27.756050 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: dddce0c46c75496f96f2e2dae77751dc Oct 22 21:12:27.756050 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-610226422 Oct 22 21:12:27.756050 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 21:12:27.756050 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 21:12:27.756050 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_dddce0c46c75496f96f2e2dae77751dc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/dddce0c46c75496f96f2e2dae77751dc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/dddce0c46c75496f96f2e2dae77751dc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/dddce0c46c75496f96f2e2dae77751dc"}]}] Oct 22 21:12:27.756050 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-ServerRescueNegativeTestJSON-610226422 Oct 22 21:12:27.756050 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: dddce0c46c75496f96f2e2dae77751dc Oct 22 21:12:27.756050 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-610226422 Oct 22 21:12:27.756050 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-ServerRescueNegativeTestJSON-610226422-project Oct 22 21:12:27.756050 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 21:12:27.756050 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 21:12:27.756050 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: 67e7a09f769748629425ad36120a7fd6 Oct 22 21:12:27.756050 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-ServerRescueNegativeTestJSON-610226422-project Oct 22 21:12:27.756050 ncdv-master-1 devstack@n-api.service[138745]: method: > Oct 22 21:12:27.756050 ncdv-master-1 devstack@n-api.service[138745]: exception: Instance 4dc70956-7b13-4f5b-99fe-f7ea6f320f0b could not be found. Oct 22 21:12:27.756050 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'id': '4dc70956-7b13-4f5b-99fe-f7ea6f320f0b'} Oct 22 21:12:27.756050 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:12:27.756050 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:12:27.756050 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 21:12:27.756050 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 21:12:27.756050 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 21:12:27.756050 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 21:12:27.756050 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 21:12:27.756050 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 21:12:27.756050 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 21:12:27.756050 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 21:12:27.756050 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4dc70956-7b13-4f5b-99fe-f7ea6f320f0b could not be found. Oct 22 21:12:27.756050 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:12:27.756050 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:12:27.756050 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:12:27.756050 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:12:27.756050 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:12:27.756050 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:12:27.756050 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:12:27.756050 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:12:27.756050 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:12:27.756050 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:12:27.756050 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 21:12:27.756050 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 21:12:27.756050 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 21:12:27.756050 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 21:12:27.756050 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 21:12:27.756050 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:12:27.756050 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4dc70956-7b13-4f5b-99fe-f7ea6f320f0b could not be found. Oct 22 21:12:27.756050 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:12:27.756050 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:12:27.760969 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:12:27.760969 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:12:27.760969 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:12:27.760969 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:12:27.760969 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:12:27.760969 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:12:27.760969 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4dc70956-7b13-4f5b-99fe-f7ea6f320f0b could not be found. Oct 22 21:12:27.760969 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:12:27.764022 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-4b5d0d39-abbc-4480-a5b6-d7aadebfb061 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Returning 404 to user: Instance 4dc70956-7b13-4f5b-99fe-f7ea6f320f0b could not be found. {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:12:27.765411 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-4b5d0d39-abbc-4480-a5b6-d7aadebfb061 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] 10.222.0.18 "GET /compute/v2.1/servers/4dc70956-7b13-4f5b-99fe-f7ea6f320f0b" status: 404 len: 111 microversion: 2.1 time: 0.066938 Oct 22 21:12:27.777020 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-76303b4b-c7a2-45c6-ac83-affb154439d8 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Calling method '.version_select at 0x7fd39ed9fb80>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:12:27.782099 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2262/4508] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:12:27 2022] GET /compute/v2.1/servers/4dc70956-7b13-4f5b-99fe-f7ea6f320f0b => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 21:12:27.808945 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-76303b4b-c7a2-45c6-ac83-affb154439d8 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1767231577" status: 202 len: 0 microversion: 2.1 time: 0.036909 Oct 22 21:12:27.814252 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2247/4509] 10.222.0.18 () {58 vars in 1221 bytes} [Sat Oct 22 21:12:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1767231577 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 21:12:27.979194 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-9d332e58-493b-44a8-a927-a9aca6db32dd tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:12:27.980703 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-9d332e58-493b-44a8-a927-a9aca6db32dd tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] [instance: 9dd3ccc4-26f1-4d75-b990-6636ed02293e] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:12:27.989072 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9d332e58-493b-44a8-a927-a9aca6db32dd tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:12:27.990088 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9d332e58-493b-44a8-a927-a9aca6db32dd tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:12:27.991036 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9d332e58-493b-44a8-a927-a9aca6db32dd tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:12:27.992072 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9d332e58-493b-44a8-a927-a9aca6db32dd tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:12:27.992781 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9d332e58-493b-44a8-a927-a9aca6db32dd tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:12:27.993462 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9d332e58-493b-44a8-a927-a9aca6db32dd tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:12:28.282455 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-9d332e58-493b-44a8-a927-a9aca6db32dd tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0d0bdfb04240209e4efa92f47cbb94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755501ba3e344f1aaf7ef80924bb57d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:12:28.301796 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-9d332e58-493b-44a8-a927-a9aca6db32dd tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] 10.222.0.18 "GET /compute/v2.1/servers/9dd3ccc4-26f1-4d75-b990-6636ed02293e" status: 200 len: 1363 microversion: 2.1 time: 0.328487 Oct 22 21:12:28.302893 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2263/4510] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:12:27 2022] GET /compute/v2.1/servers/9dd3ccc4-26f1-4d75-b990-6636ed02293e => generated 1363 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:12:29.330136 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-bef011e5-e7f8-4203-b474-89b2ef2043d3 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:12:29.330826 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-bef011e5-e7f8-4203-b474-89b2ef2043d3 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] [instance: 9dd3ccc4-26f1-4d75-b990-6636ed02293e] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:12:29.368376 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bef011e5-e7f8-4203-b474-89b2ef2043d3 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:12:29.368904 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bef011e5-e7f8-4203-b474-89b2ef2043d3 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:12:29.369348 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bef011e5-e7f8-4203-b474-89b2ef2043d3 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:12:29.380089 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bef011e5-e7f8-4203-b474-89b2ef2043d3 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:12:29.380714 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bef011e5-e7f8-4203-b474-89b2ef2043d3 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:12:29.381129 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bef011e5-e7f8-4203-b474-89b2ef2043d3 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:12:29.693685 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-bef011e5-e7f8-4203-b474-89b2ef2043d3 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0d0bdfb04240209e4efa92f47cbb94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755501ba3e344f1aaf7ef80924bb57d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:12:29.707026 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-bef011e5-e7f8-4203-b474-89b2ef2043d3 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] 10.222.0.18 "GET /compute/v2.1/servers/9dd3ccc4-26f1-4d75-b990-6636ed02293e" status: 200 len: 1363 microversion: 2.1 time: 0.382629 Oct 22 21:12:29.729171 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2248/4511] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:12:29 2022] GET /compute/v2.1/servers/9dd3ccc4-26f1-4d75-b990-6636ed02293e => generated 1363 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:12:30.734564 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-c4b30717-3a10-42d3-be4c-8e4cfb4046e9 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:12:30.735024 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-c4b30717-3a10-42d3-be4c-8e4cfb4046e9 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] [instance: 9dd3ccc4-26f1-4d75-b990-6636ed02293e] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:12:30.741725 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=4,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:12:30.747281 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c4b30717-3a10-42d3-be4c-8e4cfb4046e9 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:12:30.748503 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c4b30717-3a10-42d3-be4c-8e4cfb4046e9 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:12:30.749025 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c4b30717-3a10-42d3-be4c-8e4cfb4046e9 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:12:30.749765 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c4b30717-3a10-42d3-be4c-8e4cfb4046e9 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:12:30.750244 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c4b30717-3a10-42d3-be4c-8e4cfb4046e9 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:12:30.750893 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c4b30717-3a10-42d3-be4c-8e4cfb4046e9 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:12:30.783023 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-5d15f76f-5426-46fe-b102-c1388f3223af req-2d701abc-c655-48d6-bd0b-bde0ea0f4965 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9dd3ccc4-26f1-4d75-b990-6636ed02293e", "name": "network-vif-plugged", "status": "completed", "tag": "82bb390e-11d5-425f-8b41-2ddc73f226c9"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:12:30.795612 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-5d15f76f-5426-46fe-b102-c1388f3223af req-2d701abc-c655-48d6-bd0b-bde0ea0f4965 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:12:30.797110 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-5d15f76f-5426-46fe-b102-c1388f3223af req-2d701abc-c655-48d6-bd0b-bde0ea0f4965 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:12:30.797629 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-5d15f76f-5426-46fe-b102-c1388f3223af req-2d701abc-c655-48d6-bd0b-bde0ea0f4965 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:12:30.811888 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-5d15f76f-5426-46fe-b102-c1388f3223af req-2d701abc-c655-48d6-bd0b-bde0ea0f4965 service nova] Creating event network-vif-plugged:82bb390e-11d5-425f-8b41-2ddc73f226c9 for instance 9dd3ccc4-26f1-4d75-b990-6636ed02293e on nch1-master-1 Oct 22 21:12:30.822343 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-5d15f76f-5426-46fe-b102-c1388f3223af req-2d701abc-c655-48d6-bd0b-bde0ea0f4965 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042212 Oct 22 21:12:30.823392 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2249/4512] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:12:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:12:31.263609 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-c4b30717-3a10-42d3-be4c-8e4cfb4046e9 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0d0bdfb04240209e4efa92f47cbb94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755501ba3e344f1aaf7ef80924bb57d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:12:31.276867 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-c4b30717-3a10-42d3-be4c-8e4cfb4046e9 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] 10.222.0.18 "GET /compute/v2.1/servers/9dd3ccc4-26f1-4d75-b990-6636ed02293e" status: 200 len: 1363 microversion: 2.1 time: 0.546941 Oct 22 21:12:31.278136 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2264/4513] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:12:30 2022] GET /compute/v2.1/servers/9dd3ccc4-26f1-4d75-b990-6636ed02293e => generated 1363 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:12:32.132194 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-33ca6104-9762-46f3-9416-692ff7903915 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:12:32.132917 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-33ca6104-9762-46f3-9416-692ff7903915 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] [instance: ff57c0ad-9f38-4c58-a194-b0b0d39b1fe0] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:12:32.146818 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-33ca6104-9762-46f3-9416-692ff7903915 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:12:32.150306 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-33ca6104-9762-46f3-9416-692ff7903915 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:12:32.153674 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-33ca6104-9762-46f3-9416-692ff7903915 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:12:32.154584 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-33ca6104-9762-46f3-9416-692ff7903915 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:12:32.156268 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-33ca6104-9762-46f3-9416-692ff7903915 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:12:32.156832 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-33ca6104-9762-46f3-9416-692ff7903915 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:12:32.217842 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-33ca6104-9762-46f3-9416-692ff7903915 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] [instance: ff57c0ad-9f38-4c58-a194-b0b0d39b1fe0] Going to try to terminate instance {{(pid=138744) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 21:12:32.310014 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-d9f6b983-eb62-4678-a7c8-c8eb712ea688 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:12:32.310854 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-d9f6b983-eb62-4678-a7c8-c8eb712ea688 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] [instance: 9dd3ccc4-26f1-4d75-b990-6636ed02293e] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:12:32.329205 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d9f6b983-eb62-4678-a7c8-c8eb712ea688 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:12:32.349229 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d9f6b983-eb62-4678-a7c8-c8eb712ea688 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:12:32.350296 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d9f6b983-eb62-4678-a7c8-c8eb712ea688 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:12:32.357627 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d9f6b983-eb62-4678-a7c8-c8eb712ea688 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:12:32.359196 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d9f6b983-eb62-4678-a7c8-c8eb712ea688 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:12:32.362054 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d9f6b983-eb62-4678-a7c8-c8eb712ea688 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:12:32.432995 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-33ca6104-9762-46f3-9416-692ff7903915 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] 10.222.0.18 "DELETE /compute/v2.1/servers/ff57c0ad-9f38-4c58-a194-b0b0d39b1fe0" status: 204 len: 0 microversion: 2.1 time: 0.306277 Oct 22 21:12:32.435370 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2250/4514] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 21:12:32 2022] DELETE /compute/v2.1/servers/ff57c0ad-9f38-4c58-a194-b0b0d39b1fe0 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 21:12:32.445217 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-cbed57d3-2ef2-456f-9873-4a881ac62f25 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:12:32.446024 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-cbed57d3-2ef2-456f-9873-4a881ac62f25 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] [instance: ff57c0ad-9f38-4c58-a194-b0b0d39b1fe0] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:12:32.459279 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cbed57d3-2ef2-456f-9873-4a881ac62f25 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:12:32.462353 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cbed57d3-2ef2-456f-9873-4a881ac62f25 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:12:32.467212 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cbed57d3-2ef2-456f-9873-4a881ac62f25 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:12:32.470262 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cbed57d3-2ef2-456f-9873-4a881ac62f25 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:12:32.471419 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cbed57d3-2ef2-456f-9873-4a881ac62f25 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:12:32.472150 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cbed57d3-2ef2-456f-9873-4a881ac62f25 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:12:32.504056 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:12:32.849167 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-cbed57d3-2ef2-456f-9873-4a881ac62f25 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e7a09f769748629425ad36120a7fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddce0c46c75496f96f2e2dae77751dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:12:32.865371 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-cbed57d3-2ef2-456f-9873-4a881ac62f25 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] 10.222.0.18 "GET /compute/v2.1/servers/ff57c0ad-9f38-4c58-a194-b0b0d39b1fe0" status: 200 len: 1508 microversion: 2.1 time: 0.425519 Oct 22 21:12:32.866506 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2251/4515] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:12:32 2022] GET /compute/v2.1/servers/ff57c0ad-9f38-4c58-a194-b0b0d39b1fe0 => generated 1508 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:12:32.997181 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-d9f6b983-eb62-4678-a7c8-c8eb712ea688 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0d0bdfb04240209e4efa92f47cbb94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755501ba3e344f1aaf7ef80924bb57d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:12:33.006286 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-d9f6b983-eb62-4678-a7c8-c8eb712ea688 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] 10.222.0.18 "GET /compute/v2.1/servers/9dd3ccc4-26f1-4d75-b990-6636ed02293e" status: 200 len: 1363 microversion: 2.1 time: 0.709738 Oct 22 21:12:33.007205 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2265/4516] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:12:32 2022] GET /compute/v2.1/servers/9dd3ccc4-26f1-4d75-b990-6636ed02293e => generated 1363 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:12:33.889374 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-e9c2d46e-2180-4ecf-9f13-f5aa112db932 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:12:33.889999 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-e9c2d46e-2180-4ecf-9f13-f5aa112db932 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] [instance: ff57c0ad-9f38-4c58-a194-b0b0d39b1fe0] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:12:33.898837 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e9c2d46e-2180-4ecf-9f13-f5aa112db932 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:12:33.899641 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e9c2d46e-2180-4ecf-9f13-f5aa112db932 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:12:33.900451 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e9c2d46e-2180-4ecf-9f13-f5aa112db932 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:12:33.901372 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e9c2d46e-2180-4ecf-9f13-f5aa112db932 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:12:33.901990 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e9c2d46e-2180-4ecf-9f13-f5aa112db932 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:12:33.902588 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e9c2d46e-2180-4ecf-9f13-f5aa112db932 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:12:34.033057 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-4784ac40-f4e5-4326-b4e2-2f467b5dac19 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:12:34.034361 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-4784ac40-f4e5-4326-b4e2-2f467b5dac19 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] [instance: 9dd3ccc4-26f1-4d75-b990-6636ed02293e] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:12:34.042671 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4784ac40-f4e5-4326-b4e2-2f467b5dac19 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:12:34.043618 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4784ac40-f4e5-4326-b4e2-2f467b5dac19 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:12:34.044474 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4784ac40-f4e5-4326-b4e2-2f467b5dac19 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:12:34.045444 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4784ac40-f4e5-4326-b4e2-2f467b5dac19 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:12:34.046141 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4784ac40-f4e5-4326-b4e2-2f467b5dac19 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:12:34.046791 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4784ac40-f4e5-4326-b4e2-2f467b5dac19 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:12:34.138569 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-e9c2d46e-2180-4ecf-9f13-f5aa112db932 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e7a09f769748629425ad36120a7fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddce0c46c75496f96f2e2dae77751dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:12:34.150324 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-e9c2d46e-2180-4ecf-9f13-f5aa112db932 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] 10.222.0.18 "GET /compute/v2.1/servers/ff57c0ad-9f38-4c58-a194-b0b0d39b1fe0" status: 200 len: 1508 microversion: 2.1 time: 0.265168 Oct 22 21:12:34.151121 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2252/4517] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:12:33 2022] GET /compute/v2.1/servers/ff57c0ad-9f38-4c58-a194-b0b0d39b1fe0 => generated 1508 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:12:34.251249 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-4784ac40-f4e5-4326-b4e2-2f467b5dac19 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0d0bdfb04240209e4efa92f47cbb94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755501ba3e344f1aaf7ef80924bb57d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:12:34.261747 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-4784ac40-f4e5-4326-b4e2-2f467b5dac19 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] 10.222.0.18 "GET /compute/v2.1/servers/9dd3ccc4-26f1-4d75-b990-6636ed02293e" status: 200 len: 1550 microversion: 2.1 time: 0.236447 Oct 22 21:12:34.262354 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2266/4518] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:12:34 2022] GET /compute/v2.1/servers/9dd3ccc4-26f1-4d75-b990-6636ed02293e => generated 1550 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:12:34.285343 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-deb6ccc5-7a31-47aa-ba6e-d1c1378b38d3 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:12:34.285845 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-deb6ccc5-7a31-47aa-ba6e-d1c1378b38d3 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] [instance: 9dd3ccc4-26f1-4d75-b990-6636ed02293e] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:12:34.292730 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-deb6ccc5-7a31-47aa-ba6e-d1c1378b38d3 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:12:34.293209 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-deb6ccc5-7a31-47aa-ba6e-d1c1378b38d3 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:12:34.293698 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-deb6ccc5-7a31-47aa-ba6e-d1c1378b38d3 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:12:34.294556 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-deb6ccc5-7a31-47aa-ba6e-d1c1378b38d3 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:12:34.295008 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-deb6ccc5-7a31-47aa-ba6e-d1c1378b38d3 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:12:34.295564 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-deb6ccc5-7a31-47aa-ba6e-d1c1378b38d3 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:12:34.411315 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-deb6ccc5-7a31-47aa-ba6e-d1c1378b38d3 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] 10.222.0.18 "GET /compute/v2.1/servers/9dd3ccc4-26f1-4d75-b990-6636ed02293e/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.130241 Oct 22 21:12:34.412148 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2253/4519] 10.222.0.18 () {58 vars in 1275 bytes} [Sat Oct 22 21:12:34 2022] GET /compute/v2.1/servers/9dd3ccc4-26f1-4d75-b990-6636ed02293e/os-interface => generated 285 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:12:35.176062 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-9b6dc887-a04e-4bb6-ae19-0d7563ecbc9c tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:12:35.177304 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-9b6dc887-a04e-4bb6-ae19-0d7563ecbc9c tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] [instance: ff57c0ad-9f38-4c58-a194-b0b0d39b1fe0] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:12:35.196020 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9b6dc887-a04e-4bb6-ae19-0d7563ecbc9c tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:12:35.196845 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9b6dc887-a04e-4bb6-ae19-0d7563ecbc9c tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:12:35.198458 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9b6dc887-a04e-4bb6-ae19-0d7563ecbc9c tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:12:35.202687 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9b6dc887-a04e-4bb6-ae19-0d7563ecbc9c tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:12:35.203022 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9b6dc887-a04e-4bb6-ae19-0d7563ecbc9c tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:12:35.203740 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9b6dc887-a04e-4bb6-ae19-0d7563ecbc9c tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:12:35.624904 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-9b6dc887-a04e-4bb6-ae19-0d7563ecbc9c tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e7a09f769748629425ad36120a7fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddce0c46c75496f96f2e2dae77751dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:12:35.672489 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-9b6dc887-a04e-4bb6-ae19-0d7563ecbc9c tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] 10.222.0.18 "GET /compute/v2.1/servers/ff57c0ad-9f38-4c58-a194-b0b0d39b1fe0" status: 200 len: 1508 microversion: 2.1 time: 0.500857 Oct 22 21:12:35.674645 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2267/4520] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:12:35 2022] GET /compute/v2.1/servers/ff57c0ad-9f38-4c58-a194-b0b0d39b1fe0 => generated 1508 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:12:36.382700 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-6102a28f-d8c0-4fb5-ac07-6e0580c1d529 req-e4358136-1c19-4d20-a197-a7e737d4cd57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff57c0ad-9f38-4c58-a194-b0b0d39b1fe0", "name": "network-vif-deleted", "tag": "a468dbb2-8145-4a08-a5cc-6ae5bb40141f"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:12:36.415886 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-6102a28f-d8c0-4fb5-ac07-6e0580c1d529 req-e4358136-1c19-4d20-a197-a7e737d4cd57 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:12:36.417384 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-6102a28f-d8c0-4fb5-ac07-6e0580c1d529 req-e4358136-1c19-4d20-a197-a7e737d4cd57 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:12:36.418280 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-6102a28f-d8c0-4fb5-ac07-6e0580c1d529 req-e4358136-1c19-4d20-a197-a7e737d4cd57 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:12:36.483602 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-6102a28f-d8c0-4fb5-ac07-6e0580c1d529 req-e4358136-1c19-4d20-a197-a7e737d4cd57 service nova] Creating event network-vif-deleted:a468dbb2-8145-4a08-a5cc-6ae5bb40141f for instance ff57c0ad-9f38-4c58-a194-b0b0d39b1fe0 on nch1-master-1 Oct 22 21:12:36.490019 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-6102a28f-d8c0-4fb5-ac07-6e0580c1d529 req-e4358136-1c19-4d20-a197-a7e737d4cd57 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120515 Oct 22 21:12:36.491373 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2254/4521] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:12:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:12:36.521965 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-01206b4f-a4eb-4fdf-b6d5-5ab060667375 req-df177f3a-d4f3-4b14-836d-cd38793d55d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9dd3ccc4-26f1-4d75-b990-6636ed02293e", "tag": "82bb390e-11d5-425f-8b41-2ddc73f226c9"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:12:36.542967 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-01206b4f-a4eb-4fdf-b6d5-5ab060667375 req-df177f3a-d4f3-4b14-836d-cd38793d55d3 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:12:36.546143 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-01206b4f-a4eb-4fdf-b6d5-5ab060667375 req-df177f3a-d4f3-4b14-836d-cd38793d55d3 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:12:36.547403 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-01206b4f-a4eb-4fdf-b6d5-5ab060667375 req-df177f3a-d4f3-4b14-836d-cd38793d55d3 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:12:36.570400 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-01206b4f-a4eb-4fdf-b6d5-5ab060667375 req-df177f3a-d4f3-4b14-836d-cd38793d55d3 service nova] Creating event network-changed:82bb390e-11d5-425f-8b41-2ddc73f226c9 for instance 9dd3ccc4-26f1-4d75-b990-6636ed02293e on nch1-master-1 Oct 22 21:12:36.583766 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-01206b4f-a4eb-4fdf-b6d5-5ab060667375 req-df177f3a-d4f3-4b14-836d-cd38793d55d3 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064006 Oct 22 21:12:36.588950 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2268/4522] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:12:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:12:36.696949 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-3ad8d2a4-0d63-42e8-bf69-f61af55c7368 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:12:36.697746 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-3ad8d2a4-0d63-42e8-bf69-f61af55c7368 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] [instance: ff57c0ad-9f38-4c58-a194-b0b0d39b1fe0] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:12:36.708711 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3ad8d2a4-0d63-42e8-bf69-f61af55c7368 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:12:36.726671 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3ad8d2a4-0d63-42e8-bf69-f61af55c7368 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:12:36.727464 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3ad8d2a4-0d63-42e8-bf69-f61af55c7368 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:12:36.728381 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3ad8d2a4-0d63-42e8-bf69-f61af55c7368 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:12:36.728784 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3ad8d2a4-0d63-42e8-bf69-f61af55c7368 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:12:36.729220 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3ad8d2a4-0d63-42e8-bf69-f61af55c7368 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:12:36.827143 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3ad8d2a4-0d63-42e8-bf69-f61af55c7368 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:12:36.827666 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3ad8d2a4-0d63-42e8-bf69-f61af55c7368 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:12:36.828115 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3ad8d2a4-0d63-42e8-bf69-f61af55c7368 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:12:36.828585 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.objects.instance [None req-3ad8d2a4-0d63-42e8-bf69-f61af55c7368 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lazy-loading 'fault' on Instance uuid ff57c0ad-9f38-4c58-a194-b0b0d39b1fe0 {{(pid=138744) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 21:12:36.940359 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-3ad8d2a4-0d63-42e8-bf69-f61af55c7368 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e7a09f769748629425ad36120a7fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddce0c46c75496f96f2e2dae77751dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:12:36.954716 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-3ad8d2a4-0d63-42e8-bf69-f61af55c7368 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] 10.222.0.18 "GET /compute/v2.1/servers/ff57c0ad-9f38-4c58-a194-b0b0d39b1fe0" status: 200 len: 1311 microversion: 2.1 time: 0.261914 Oct 22 21:12:36.955848 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2255/4523] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:12:36 2022] GET /compute/v2.1/servers/ff57c0ad-9f38-4c58-a194-b0b0d39b1fe0 => generated 1311 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:12:37.982039 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-da699cc4-517d-4d50-8417-783e48051e2a tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:12:37.984911 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-da699cc4-517d-4d50-8417-783e48051e2a tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] [instance: ff57c0ad-9f38-4c58-a194-b0b0d39b1fe0] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:12:37.994816 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-da699cc4-517d-4d50-8417-783e48051e2a tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:12:38.005629 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-da699cc4-517d-4d50-8417-783e48051e2a tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:12:38.007172 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-da699cc4-517d-4d50-8417-783e48051e2a tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:12:38.009504 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-da699cc4-517d-4d50-8417-783e48051e2a tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:12:38.012347 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-da699cc4-517d-4d50-8417-783e48051e2a tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:12:38.015168 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-da699cc4-517d-4d50-8417-783e48051e2a tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:12:38.039643 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.wsgi [None req-da699cc4-517d-4d50-8417-783e48051e2a tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] HTTP exception thrown: Instance ff57c0ad-9f38-4c58-a194-b0b0d39b1fe0 could not be found. Oct 22 21:12:38.042356 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-da699cc4-517d-4d50-8417-783e48051e2a tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Request method failure captured: Oct 22 21:12:38.042356 ncdv-master-1 devstack@n-api.service[138745]: request: GET /compute/v2.1/servers/ff57c0ad-9f38-4c58-a194-b0b0d39b1fe0 HTTP/1.1 Oct 22 21:12:38.042356 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 21:12:38.042356 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 21:12:38.042356 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 21:12:38.042356 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 0 Oct 22 21:12:38.042356 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 21:12:38.042356 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 21:12:38.042356 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 21:12:38.042356 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 21:12:38.042356 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVFvWfSOLw3btNK4SoFxMjr8wtqLT2k4PIwSqWFeanHIvdQwXt9iIjJT1pUVLfrbgtnh-m8tchSLAY2pHDnqTUexh_EARjCC9pvXEvKIKJHHkmxJW7Q2ZJx8_vGRYvToSXq_GR6KcHjZaBQXLzQj4qX1yg72hOaDAkM7_Yx2kYaYfxok Oct 22 21:12:38.042356 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 21:12:38.042356 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 21:12:38.042356 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 21:12:38.042356 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 21:12:38.042356 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 21:12:38.042356 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 21:12:38.042356 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: dddce0c46c75496f96f2e2dae77751dc Oct 22 21:12:38.042356 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-610226422 Oct 22 21:12:38.042356 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 21:12:38.042356 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 21:12:38.042356 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_dddce0c46c75496f96f2e2dae77751dc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/dddce0c46c75496f96f2e2dae77751dc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/dddce0c46c75496f96f2e2dae77751dc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/dddce0c46c75496f96f2e2dae77751dc"}]}] Oct 22 21:12:38.042356 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-ServerRescueNegativeTestJSON-610226422 Oct 22 21:12:38.042356 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: dddce0c46c75496f96f2e2dae77751dc Oct 22 21:12:38.042356 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-610226422 Oct 22 21:12:38.042356 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-ServerRescueNegativeTestJSON-610226422-project Oct 22 21:12:38.042356 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 21:12:38.042356 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 21:12:38.042356 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: 67e7a09f769748629425ad36120a7fd6 Oct 22 21:12:38.042356 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-ServerRescueNegativeTestJSON-610226422-project Oct 22 21:12:38.042356 ncdv-master-1 devstack@n-api.service[138745]: method: > Oct 22 21:12:38.042356 ncdv-master-1 devstack@n-api.service[138745]: exception: Instance ff57c0ad-9f38-4c58-a194-b0b0d39b1fe0 could not be found. Oct 22 21:12:38.042356 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'id': 'ff57c0ad-9f38-4c58-a194-b0b0d39b1fe0'} Oct 22 21:12:38.042356 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:12:38.042356 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:12:38.042356 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 21:12:38.042356 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 21:12:38.042356 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 21:12:38.042356 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 21:12:38.042356 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 21:12:38.042356 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 21:12:38.042356 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 21:12:38.042356 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 21:12:38.042356 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff57c0ad-9f38-4c58-a194-b0b0d39b1fe0 could not be found. Oct 22 21:12:38.042356 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:12:38.042356 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:12:38.042356 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:12:38.042356 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:12:38.042356 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:12:38.042356 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:12:38.042356 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:12:38.042356 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:12:38.042356 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:12:38.042356 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:12:38.042356 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 21:12:38.042356 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 21:12:38.042356 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 21:12:38.042356 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 21:12:38.042356 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 21:12:38.042356 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:12:38.042356 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff57c0ad-9f38-4c58-a194-b0b0d39b1fe0 could not be found. Oct 22 21:12:38.042356 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:12:38.042356 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:12:38.047150 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:12:38.047150 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:12:38.047150 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:12:38.047150 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:12:38.047150 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:12:38.047150 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:12:38.047150 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff57c0ad-9f38-4c58-a194-b0b0d39b1fe0 could not be found. Oct 22 21:12:38.047150 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:12:38.047150 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-da699cc4-517d-4d50-8417-783e48051e2a tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Returning 404 to user: Instance ff57c0ad-9f38-4c58-a194-b0b0d39b1fe0 could not be found. {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:12:38.047150 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-da699cc4-517d-4d50-8417-783e48051e2a tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] 10.222.0.18 "GET /compute/v2.1/servers/ff57c0ad-9f38-4c58-a194-b0b0d39b1fe0" status: 404 len: 111 microversion: 2.1 time: 0.069977 Oct 22 21:12:38.047150 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2269/4524] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:12:37 2022] GET /compute/v2.1/servers/ff57c0ad-9f38-4c58-a194-b0b0d39b1fe0 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 21:12:38.057915 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-e201fb9e-9036-4f68-b42c-df88d05e7353 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:12:38.058663 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-e201fb9e-9036-4f68-b42c-df88d05e7353 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] [instance: 4b876a5c-1d6e-4960-a3f9-f30cc7dc03fa] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:12:38.069430 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e201fb9e-9036-4f68-b42c-df88d05e7353 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:12:38.070075 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e201fb9e-9036-4f68-b42c-df88d05e7353 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:12:38.070635 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e201fb9e-9036-4f68-b42c-df88d05e7353 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:12:38.072139 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e201fb9e-9036-4f68-b42c-df88d05e7353 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:12:38.072794 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e201fb9e-9036-4f68-b42c-df88d05e7353 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:12:38.073415 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e201fb9e-9036-4f68-b42c-df88d05e7353 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:12:38.124765 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-e201fb9e-9036-4f68-b42c-df88d05e7353 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] [instance: 4b876a5c-1d6e-4960-a3f9-f30cc7dc03fa] Going to try to terminate instance {{(pid=138744) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 21:12:38.286981 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-e201fb9e-9036-4f68-b42c-df88d05e7353 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] 10.222.0.18 "DELETE /compute/v2.1/servers/4b876a5c-1d6e-4960-a3f9-f30cc7dc03fa" status: 204 len: 0 microversion: 2.1 time: 0.236936 Oct 22 21:12:38.287622 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2256/4525] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 21:12:38 2022] DELETE /compute/v2.1/servers/4b876a5c-1d6e-4960-a3f9-f30cc7dc03fa => generated 0 bytes in 238 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 21:12:38.300901 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-56909564-0c27-4321-9d9e-3613c63eae6c tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:12:38.302118 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-56909564-0c27-4321-9d9e-3613c63eae6c tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] [instance: 4b876a5c-1d6e-4960-a3f9-f30cc7dc03fa] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:12:38.312559 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-56909564-0c27-4321-9d9e-3613c63eae6c tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:12:38.313433 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-56909564-0c27-4321-9d9e-3613c63eae6c tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:12:38.315438 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-56909564-0c27-4321-9d9e-3613c63eae6c tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:12:38.317539 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-56909564-0c27-4321-9d9e-3613c63eae6c tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:12:38.319194 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-56909564-0c27-4321-9d9e-3613c63eae6c tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:12:38.320048 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-56909564-0c27-4321-9d9e-3613c63eae6c tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:12:38.787554 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-56909564-0c27-4321-9d9e-3613c63eae6c tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e7a09f769748629425ad36120a7fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddce0c46c75496f96f2e2dae77751dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:12:38.796945 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-56909564-0c27-4321-9d9e-3613c63eae6c tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] 10.222.0.18 "GET /compute/v2.1/servers/4b876a5c-1d6e-4960-a3f9-f30cc7dc03fa" status: 200 len: 1521 microversion: 2.1 time: 0.502642 Oct 22 21:12:38.798132 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2270/4526] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:12:38 2022] GET /compute/v2.1/servers/4b876a5c-1d6e-4960-a3f9-f30cc7dc03fa => generated 1521 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:12:39.832380 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-4271b7b2-89d6-49f8-928e-bfaf22f98040 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:12:39.834583 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-4271b7b2-89d6-49f8-928e-bfaf22f98040 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] [instance: 4b876a5c-1d6e-4960-a3f9-f30cc7dc03fa] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:12:39.845207 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4271b7b2-89d6-49f8-928e-bfaf22f98040 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:12:39.845559 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4271b7b2-89d6-49f8-928e-bfaf22f98040 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:12:39.846276 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4271b7b2-89d6-49f8-928e-bfaf22f98040 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:12:39.847095 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4271b7b2-89d6-49f8-928e-bfaf22f98040 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:12:39.847630 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4271b7b2-89d6-49f8-928e-bfaf22f98040 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:12:39.848361 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4271b7b2-89d6-49f8-928e-bfaf22f98040 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:12:40.212358 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-4271b7b2-89d6-49f8-928e-bfaf22f98040 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e7a09f769748629425ad36120a7fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddce0c46c75496f96f2e2dae77751dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:12:40.227178 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-4271b7b2-89d6-49f8-928e-bfaf22f98040 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] 10.222.0.18 "GET /compute/v2.1/servers/4b876a5c-1d6e-4960-a3f9-f30cc7dc03fa" status: 200 len: 1521 microversion: 2.1 time: 0.401917 Oct 22 21:12:40.229195 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2257/4527] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:12:39 2022] GET /compute/v2.1/servers/4b876a5c-1d6e-4960-a3f9-f30cc7dc03fa => generated 1521 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:12:41.253009 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-01b14618-46d6-44bf-98be-7950467e6edc tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:12:41.253656 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-01b14618-46d6-44bf-98be-7950467e6edc tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] [instance: 4b876a5c-1d6e-4960-a3f9-f30cc7dc03fa] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:12:41.269607 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-01b14618-46d6-44bf-98be-7950467e6edc tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:12:41.270154 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-01b14618-46d6-44bf-98be-7950467e6edc tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:12:41.271387 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-01b14618-46d6-44bf-98be-7950467e6edc tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:12:41.274712 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-01b14618-46d6-44bf-98be-7950467e6edc tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:12:41.275224 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-01b14618-46d6-44bf-98be-7950467e6edc tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:12:41.275922 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-01b14618-46d6-44bf-98be-7950467e6edc tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:12:41.676945 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-01b14618-46d6-44bf-98be-7950467e6edc tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e7a09f769748629425ad36120a7fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddce0c46c75496f96f2e2dae77751dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:12:41.688825 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-01b14618-46d6-44bf-98be-7950467e6edc tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] 10.222.0.18 "GET /compute/v2.1/servers/4b876a5c-1d6e-4960-a3f9-f30cc7dc03fa" status: 200 len: 1521 microversion: 2.1 time: 0.441185 Oct 22 21:12:41.690053 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2271/4528] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:12:41 2022] GET /compute/v2.1/servers/4b876a5c-1d6e-4960-a3f9-f30cc7dc03fa => generated 1521 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:12:42.719946 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-f61babf2-1881-491b-b517-8fc8c5484498 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:12:42.721005 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-f61babf2-1881-491b-b517-8fc8c5484498 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] [instance: 4b876a5c-1d6e-4960-a3f9-f30cc7dc03fa] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:12:42.744912 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f61babf2-1881-491b-b517-8fc8c5484498 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:12:42.748630 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f61babf2-1881-491b-b517-8fc8c5484498 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:12:42.749389 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f61babf2-1881-491b-b517-8fc8c5484498 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:12:42.753013 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f61babf2-1881-491b-b517-8fc8c5484498 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:12:42.753749 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f61babf2-1881-491b-b517-8fc8c5484498 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:12:42.754390 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f61babf2-1881-491b-b517-8fc8c5484498 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:12:43.216092 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-f61babf2-1881-491b-b517-8fc8c5484498 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e7a09f769748629425ad36120a7fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddce0c46c75496f96f2e2dae77751dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:12:43.232913 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-f61babf2-1881-491b-b517-8fc8c5484498 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] 10.222.0.18 "GET /compute/v2.1/servers/4b876a5c-1d6e-4960-a3f9-f30cc7dc03fa" status: 200 len: 1521 microversion: 2.1 time: 0.520669 Oct 22 21:12:43.233743 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2258/4529] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:12:42 2022] GET /compute/v2.1/servers/4b876a5c-1d6e-4960-a3f9-f30cc7dc03fa => generated 1521 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:12:43.924109 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-aeb3c595-e6ad-481d-8420-9d870974ab83 req-4579b47d-1e0e-4f3b-a6ba-41bc2dd34007 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b876a5c-1d6e-4960-a3f9-f30cc7dc03fa", "name": "network-vif-deleted", "tag": "44279202-b16f-4c41-a450-1186c656375b"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:12:43.979695 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-aeb3c595-e6ad-481d-8420-9d870974ab83 req-4579b47d-1e0e-4f3b-a6ba-41bc2dd34007 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:12:43.980214 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-aeb3c595-e6ad-481d-8420-9d870974ab83 req-4579b47d-1e0e-4f3b-a6ba-41bc2dd34007 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:12:43.982751 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-aeb3c595-e6ad-481d-8420-9d870974ab83 req-4579b47d-1e0e-4f3b-a6ba-41bc2dd34007 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:12:44.016489 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-aeb3c595-e6ad-481d-8420-9d870974ab83 req-4579b47d-1e0e-4f3b-a6ba-41bc2dd34007 service nova] Creating event network-vif-deleted:44279202-b16f-4c41-a450-1186c656375b for instance 4b876a5c-1d6e-4960-a3f9-f30cc7dc03fa on nch2-master-1 Oct 22 21:12:44.034936 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-aeb3c595-e6ad-481d-8420-9d870974ab83 req-4579b47d-1e0e-4f3b-a6ba-41bc2dd34007 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110571 Oct 22 21:12:44.036074 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2272/4530] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:12:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:12:44.264608 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-81b76c85-45c1-4032-8962-c56eb9aa5870 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:12:44.265318 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-81b76c85-45c1-4032-8962-c56eb9aa5870 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] [instance: 4b876a5c-1d6e-4960-a3f9-f30cc7dc03fa] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:12:44.268472 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_api:INSERT=1,nova_api:SELECT=72,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:12:44.279622 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-81b76c85-45c1-4032-8962-c56eb9aa5870 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:12:44.280448 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-81b76c85-45c1-4032-8962-c56eb9aa5870 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:12:44.281134 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-81b76c85-45c1-4032-8962-c56eb9aa5870 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:12:44.282944 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-81b76c85-45c1-4032-8962-c56eb9aa5870 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:12:44.283664 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-81b76c85-45c1-4032-8962-c56eb9aa5870 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:12:44.284551 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-81b76c85-45c1-4032-8962-c56eb9aa5870 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:12:44.337283 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-81b76c85-45c1-4032-8962-c56eb9aa5870 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:12:44.337891 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-81b76c85-45c1-4032-8962-c56eb9aa5870 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:12:44.338464 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-81b76c85-45c1-4032-8962-c56eb9aa5870 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:12:44.339765 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.objects.instance [None req-81b76c85-45c1-4032-8962-c56eb9aa5870 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lazy-loading 'fault' on Instance uuid 4b876a5c-1d6e-4960-a3f9-f30cc7dc03fa {{(pid=138744) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 21:12:44.445038 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-81b76c85-45c1-4032-8962-c56eb9aa5870 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e7a09f769748629425ad36120a7fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddce0c46c75496f96f2e2dae77751dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:12:44.458107 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-81b76c85-45c1-4032-8962-c56eb9aa5870 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] 10.222.0.18 "GET /compute/v2.1/servers/4b876a5c-1d6e-4960-a3f9-f30cc7dc03fa" status: 200 len: 1311 microversion: 2.1 time: 0.201673 Oct 22 21:12:44.459500 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2259/4531] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:12:44 2022] GET /compute/v2.1/servers/4b876a5c-1d6e-4960-a3f9-f30cc7dc03fa => generated 1311 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:12:45.483058 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-42fd8af8-62f8-4ce1-8c89-ab72bf830511 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:12:45.484368 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-42fd8af8-62f8-4ce1-8c89-ab72bf830511 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] [instance: 4b876a5c-1d6e-4960-a3f9-f30cc7dc03fa] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:12:45.502536 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-42fd8af8-62f8-4ce1-8c89-ab72bf830511 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:12:45.503135 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-42fd8af8-62f8-4ce1-8c89-ab72bf830511 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:12:45.503535 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-42fd8af8-62f8-4ce1-8c89-ab72bf830511 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:12:45.504302 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-42fd8af8-62f8-4ce1-8c89-ab72bf830511 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:12:45.504770 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-42fd8af8-62f8-4ce1-8c89-ab72bf830511 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:12:45.505298 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-42fd8af8-62f8-4ce1-8c89-ab72bf830511 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:12:45.521083 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.wsgi [None req-42fd8af8-62f8-4ce1-8c89-ab72bf830511 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] HTTP exception thrown: Instance 4b876a5c-1d6e-4960-a3f9-f30cc7dc03fa could not be found. Oct 22 21:12:45.522547 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-42fd8af8-62f8-4ce1-8c89-ab72bf830511 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Request method failure captured: Oct 22 21:12:45.522547 ncdv-master-1 devstack@n-api.service[138745]: request: GET /compute/v2.1/servers/4b876a5c-1d6e-4960-a3f9-f30cc7dc03fa HTTP/1.1 Oct 22 21:12:45.522547 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 21:12:45.522547 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 21:12:45.522547 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 21:12:45.522547 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 0 Oct 22 21:12:45.522547 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 21:12:45.522547 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 21:12:45.522547 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 21:12:45.522547 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 21:12:45.522547 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVFvWfSOLw3btNK4SoFxMjr8wtqLT2k4PIwSqWFeanHIvdQwXt9iIjJT1pUVLfrbgtnh-m8tchSLAY2pHDnqTUexh_EARjCC9pvXEvKIKJHHkmxJW7Q2ZJx8_vGRYvToSXq_GR6KcHjZaBQXLzQj4qX1yg72hOaDAkM7_Yx2kYaYfxok Oct 22 21:12:45.522547 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 21:12:45.522547 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 21:12:45.522547 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 21:12:45.522547 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 21:12:45.522547 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 21:12:45.522547 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 21:12:45.522547 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: dddce0c46c75496f96f2e2dae77751dc Oct 22 21:12:45.522547 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-610226422 Oct 22 21:12:45.522547 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 21:12:45.522547 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 21:12:45.522547 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_dddce0c46c75496f96f2e2dae77751dc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/dddce0c46c75496f96f2e2dae77751dc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/dddce0c46c75496f96f2e2dae77751dc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/dddce0c46c75496f96f2e2dae77751dc"}]}] Oct 22 21:12:45.522547 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-ServerRescueNegativeTestJSON-610226422 Oct 22 21:12:45.522547 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: dddce0c46c75496f96f2e2dae77751dc Oct 22 21:12:45.522547 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-610226422 Oct 22 21:12:45.522547 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-ServerRescueNegativeTestJSON-610226422-project Oct 22 21:12:45.522547 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 21:12:45.522547 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 21:12:45.522547 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: 67e7a09f769748629425ad36120a7fd6 Oct 22 21:12:45.522547 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-ServerRescueNegativeTestJSON-610226422-project Oct 22 21:12:45.522547 ncdv-master-1 devstack@n-api.service[138745]: method: > Oct 22 21:12:45.522547 ncdv-master-1 devstack@n-api.service[138745]: exception: Instance 4b876a5c-1d6e-4960-a3f9-f30cc7dc03fa could not be found. Oct 22 21:12:45.522547 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'id': '4b876a5c-1d6e-4960-a3f9-f30cc7dc03fa'} Oct 22 21:12:45.522547 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:12:45.522547 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:12:45.522547 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 21:12:45.522547 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 21:12:45.522547 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 21:12:45.522547 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 21:12:45.522547 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 21:12:45.522547 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 21:12:45.522547 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 21:12:45.522547 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 21:12:45.522547 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b876a5c-1d6e-4960-a3f9-f30cc7dc03fa could not be found. Oct 22 21:12:45.522547 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:12:45.522547 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:12:45.522547 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:12:45.522547 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:12:45.522547 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:12:45.522547 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:12:45.522547 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:12:45.522547 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:12:45.522547 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:12:45.522547 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:12:45.522547 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 21:12:45.522547 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 21:12:45.522547 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 21:12:45.522547 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 21:12:45.522547 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 21:12:45.522547 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:12:45.522547 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b876a5c-1d6e-4960-a3f9-f30cc7dc03fa could not be found. Oct 22 21:12:45.522547 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:12:45.522547 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:12:45.530942 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:12:45.530942 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:12:45.530942 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:12:45.530942 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:12:45.530942 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:12:45.530942 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:12:45.530942 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b876a5c-1d6e-4960-a3f9-f30cc7dc03fa could not be found. Oct 22 21:12:45.530942 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:12:45.530942 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-42fd8af8-62f8-4ce1-8c89-ab72bf830511 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] Returning 404 to user: Instance 4b876a5c-1d6e-4960-a3f9-f30cc7dc03fa could not be found. {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:12:45.530942 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-42fd8af8-62f8-4ce1-8c89-ab72bf830511 tempest-ServerRescueNegativeTestJSON-610226422 tempest-ServerRescueNegativeTestJSON-610226422-project] 10.222.0.18 "GET /compute/v2.1/servers/4b876a5c-1d6e-4960-a3f9-f30cc7dc03fa" status: 404 len: 111 microversion: 2.1 time: 0.045662 Oct 22 21:12:45.530942 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2273/4532] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:12:45 2022] GET /compute/v2.1/servers/4b876a5c-1d6e-4960-a3f9-f30cc7dc03fa => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 21:12:58.126505 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_api:SELECT=3 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:12:58.130697 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:12:58.564975 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-506b20b4-9a79-4462-8f6e-4417665031b8 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:12:58.566022 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-506b20b4-9a79-4462-8f6e-4417665031b8 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] [instance: 34dcd1da-b94c-426b-b08b-204ea287c8a2] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:12:58.573436 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-506b20b4-9a79-4462-8f6e-4417665031b8 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:12:58.584860 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-506b20b4-9a79-4462-8f6e-4417665031b8 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:12:58.597630 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-506b20b4-9a79-4462-8f6e-4417665031b8 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:12:58.598674 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-506b20b4-9a79-4462-8f6e-4417665031b8 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:12:58.614339 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-506b20b4-9a79-4462-8f6e-4417665031b8 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:12:58.619063 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-506b20b4-9a79-4462-8f6e-4417665031b8 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:12:58.685210 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-506b20b4-9a79-4462-8f6e-4417665031b8 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] 10.222.0.18 "GET /compute/v2.1/servers/34dcd1da-b94c-426b-b08b-204ea287c8a2/ips" status: 200 len: 152 microversion: 2.20 time: 0.566969 Oct 22 21:12:58.695493 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2260/4533] 10.222.0.18 () {60 vars in 1289 bytes} [Sat Oct 22 21:12:58 2022] GET /compute/v2.1/servers/34dcd1da-b94c-426b-b08b-204ea287c8a2/ips => generated 152 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 22 21:12:59.940522 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_api:SELECT=19 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:12:59.941290 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell1:SELECT=83 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:13:00.152048 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-f01438ac-9334-46b4-8091-f062de7315f6 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-\u20a1-2142298044", "imageRef": "085e4478-6edc-4a69-8e08-f9831713eb65", "flavorRef": "452", "networks": [{"uuid": "ea7e3c31-2bc2-4b4f-ab48-7d75cccdd3b0"}]}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:13:00.235442 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.network.neutron [None req-f01438ac-9334-46b4-8091-f062de7315f6 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] validate_networks() for [('ea7e3c31-2bc2-4b4f-ab48-7d75cccdd3b0', None, None, None, None, None)] {{(pid=138745) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 21:13:00.887896 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-f01438ac-9334-46b4-8091-f062de7315f6 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Flavor limits 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 21:13:00.888476 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-f01438ac-9334-46b4-8091-f062de7315f6 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Image limits 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 21:13:00.889315 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-f01438ac-9334-46b4-8091-f062de7315f6 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Flavor pref 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 21:13:00.889825 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-f01438ac-9334-46b4-8091-f062de7315f6 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Image pref 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 21:13:00.890375 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-f01438ac-9334-46b4-8091-f062de7315f6 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 21:13:00.908119 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f01438ac-9334-46b4-8091-f062de7315f6 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:00.910120 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f01438ac-9334-46b4-8091-f062de7315f6 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:00.911782 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f01438ac-9334-46b4-8091-f062de7315f6 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:00.912757 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f01438ac-9334-46b4-8091-f062de7315f6 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:00.913289 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f01438ac-9334-46b4-8091-f062de7315f6 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:00.913868 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f01438ac-9334-46b4-8091-f062de7315f6 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:00.951991 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-f01438ac-9334-46b4-8091-f062de7315f6 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Getting quotas for project e87474d4b4c547abbfe6308b6dd8e1c8. Resources: {'cores', 'instances', 'ram'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 21:13:00.960522 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-f01438ac-9334-46b4-8091-f062de7315f6 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Getting quotas for user 799f987b3aa7426ba5d7a464052d6490 and project e87474d4b4c547abbfe6308b6dd8e1c8. Resources: {'cores', 'instances', 'ram'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 21:13:00.984779 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-f01438ac-9334-46b4-8091-f062de7315f6 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Going to run 1 instances... {{(pid=138745) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 21:13:00.989283 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-f01438ac-9334-46b4-8091-f062de7315f6 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] [instance: ecbbbe88-8a1a-4480-b826-5ba23c6a4404] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='085e4478-6edc-4a69-8e08-f9831713eb65',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138745) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 21:13:01.074326 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-f01438ac-9334-46b4-8091-f062de7315f6 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.139807 Oct 22 21:13:01.075592 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2274/4534] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Oct 22 21:12:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 1142 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 21:13:01.088149 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-13a9793a-6dd7-495d-afbd-d2b2552e1e2b tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:13:01.088894 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-13a9793a-6dd7-495d-afbd-d2b2552e1e2b tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] [instance: ecbbbe88-8a1a-4480-b826-5ba23c6a4404] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:13:01.272545 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-13a9793a-6dd7-495d-afbd-d2b2552e1e2b tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799f987b3aa7426ba5d7a464052d6490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87474d4b4c547abbfe6308b6dd8e1c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:13:01.281696 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-13a9793a-6dd7-495d-afbd-d2b2552e1e2b tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] 10.222.0.18 "GET /compute/v2.1/servers/ecbbbe88-8a1a-4480-b826-5ba23c6a4404" status: 200 len: 1193 microversion: 2.1 time: 0.197507 Oct 22 21:13:01.287004 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2261/4535] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:13:01 2022] GET /compute/v2.1/servers/ecbbbe88-8a1a-4480-b826-5ba23c6a4404 => generated 1193 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:13:01.586089 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-67b3a136-579e-4dc4-a21c-5c2e86733773 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1972210097", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-615719538", "security_groups": [{"name": "tempest-secgroup-smoke-335632321"}], "block_device_mapping_v2": [{"uuid": "b2b053a3-6082-4ecb-aa86-9bc2e5608d19", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "7fc34993-7108-4fcb-8386-9f829c6044b7"}]}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:13:01.889228 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.network.neutron [None req-67b3a136-579e-4dc4-a21c-5c2e86733773 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] validate_networks() for [('7fc34993-7108-4fcb-8386-9f829c6044b7', None, None, None, None, None)] {{(pid=138745) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 21:13:02.314697 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-cc9c2776-5e90-46e8-b540-c9caee7bbfec tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:13:02.315842 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-cc9c2776-5e90-46e8-b540-c9caee7bbfec tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] [instance: ecbbbe88-8a1a-4480-b826-5ba23c6a4404] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:13:02.348834 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cc9c2776-5e90-46e8-b540-c9caee7bbfec tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:02.351993 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cc9c2776-5e90-46e8-b540-c9caee7bbfec tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:02.352750 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cc9c2776-5e90-46e8-b540-c9caee7bbfec tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:02.355650 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cc9c2776-5e90-46e8-b540-c9caee7bbfec tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:02.356873 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cc9c2776-5e90-46e8-b540-c9caee7bbfec tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:02.358067 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cc9c2776-5e90-46e8-b540-c9caee7bbfec tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:02.484042 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-cc9c2776-5e90-46e8-b540-c9caee7bbfec tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799f987b3aa7426ba5d7a464052d6490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87474d4b4c547abbfe6308b6dd8e1c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:13:02.497751 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-cc9c2776-5e90-46e8-b540-c9caee7bbfec tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] 10.222.0.18 "GET /compute/v2.1/servers/ecbbbe88-8a1a-4480-b826-5ba23c6a4404" status: 200 len: 1245 microversion: 2.1 time: 0.188288 Oct 22 21:13:02.499352 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2262/4536] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:13:02 2022] GET /compute/v2.1/servers/ecbbbe88-8a1a-4480-b826-5ba23c6a4404 => generated 1245 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:13:02.511639 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-c8c823aa-4cc3-4ab2-ac2a-6f770edfd6dd tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:13:02.512194 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-c8c823aa-4cc3-4ab2-ac2a-6f770edfd6dd tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] [instance: 34dcd1da-b94c-426b-b08b-204ea287c8a2] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:13:02.520062 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c8c823aa-4cc3-4ab2-ac2a-6f770edfd6dd tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:02.520772 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c8c823aa-4cc3-4ab2-ac2a-6f770edfd6dd tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:02.521419 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c8c823aa-4cc3-4ab2-ac2a-6f770edfd6dd tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:02.523539 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c8c823aa-4cc3-4ab2-ac2a-6f770edfd6dd tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:02.525799 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c8c823aa-4cc3-4ab2-ac2a-6f770edfd6dd tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:02.526776 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c8c823aa-4cc3-4ab2-ac2a-6f770edfd6dd tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:02.531481 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-67b3a136-579e-4dc4-a21c-5c2e86733773 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Flavor limits 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 21:13:02.532790 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-67b3a136-579e-4dc4-a21c-5c2e86733773 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Image limits 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 21:13:02.533759 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-67b3a136-579e-4dc4-a21c-5c2e86733773 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Flavor pref 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 21:13:02.534406 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-67b3a136-579e-4dc4-a21c-5c2e86733773 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Image pref 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 21:13:02.535034 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-67b3a136-579e-4dc4-a21c-5c2e86733773 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 21:13:02.554005 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-67b3a136-579e-4dc4-a21c-5c2e86733773 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:02.554833 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-67b3a136-579e-4dc4-a21c-5c2e86733773 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:02.555489 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-67b3a136-579e-4dc4-a21c-5c2e86733773 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:02.556465 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-67b3a136-579e-4dc4-a21c-5c2e86733773 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:02.558158 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-67b3a136-579e-4dc4-a21c-5c2e86733773 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:02.558859 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-67b3a136-579e-4dc4-a21c-5c2e86733773 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:02.566033 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.objects.instance [None req-c8c823aa-4cc3-4ab2-ac2a-6f770edfd6dd tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lazy-loading 'flavor' on Instance uuid 34dcd1da-b94c-426b-b08b-204ea287c8a2 {{(pid=138744) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 21:13:02.587165 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-67b3a136-579e-4dc4-a21c-5c2e86733773 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Getting quotas for project 82a42c3ecf474883ac652fcc8c01c9f2. Resources: {'cores', 'instances', 'ram'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 21:13:02.594169 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-67b3a136-579e-4dc4-a21c-5c2e86733773 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Getting quotas for user 7e3820b31a424c3a9216a6ef91fcb285 and project 82a42c3ecf474883ac652fcc8c01c9f2. Resources: {'cores', 'instances', 'ram'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 21:13:02.704369 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-67b3a136-579e-4dc4-a21c-5c2e86733773 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Going to run 1 instances... {{(pid=138745) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 21:13:02.706980 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-67b3a136-579e-4dc4-a21c-5c2e86733773 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] [instance: 5c197028-ff9e-46ff-81f4-0feb4748da97] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b2b053a3-6082-4ecb-aa86-9bc2e5608d19',volume_size=None,volume_type=None)] {{(pid=138745) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 21:13:02.890884 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-c8c823aa-4cc3-4ab2-ac2a-6f770edfd6dd tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] 10.222.0.18 "POST /compute/v2.1/servers/34dcd1da-b94c-426b-b08b-204ea287c8a2/action" status: 202 len: 0 microversion: 2.20 time: 0.389321 Oct 22 21:13:02.894907 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2263/4537] 10.222.0.18 () {62 vars in 1319 bytes} [Sat Oct 22 21:13:02 2022] POST /compute/v2.1/servers/34dcd1da-b94c-426b-b08b-204ea287c8a2/action => generated 0 bytes in 395 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 22 21:13:02.907237 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-1f47d77a-e4c0-450e-8e90-23c8ffee740c tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:13:02.908516 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-1f47d77a-e4c0-450e-8e90-23c8ffee740c tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] [instance: 34dcd1da-b94c-426b-b08b-204ea287c8a2] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:13:02.919155 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1f47d77a-e4c0-450e-8e90-23c8ffee740c tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:02.919722 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1f47d77a-e4c0-450e-8e90-23c8ffee740c tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:02.920286 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1f47d77a-e4c0-450e-8e90-23c8ffee740c tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:02.921155 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1f47d77a-e4c0-450e-8e90-23c8ffee740c tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:02.921661 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1f47d77a-e4c0-450e-8e90-23c8ffee740c tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:02.922041 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1f47d77a-e4c0-450e-8e90-23c8ffee740c tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:02.936722 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-67b3a136-579e-4dc4-a21c-5c2e86733773 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.357451 Oct 22 21:13:02.938108 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2275/4538] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Oct 22 21:13:01 2022] POST /compute/v2.1/servers => generated 405 bytes in 1360 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 21:13:02.981205 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-a23dee67-2f3d-464e-99fb-83c3f7d2c8d3 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:13:02.985410 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-a23dee67-2f3d-464e-99fb-83c3f7d2c8d3 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] [instance: 5c197028-ff9e-46ff-81f4-0feb4748da97] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:13:03.797138 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-a23dee67-2f3d-464e-99fb-83c3f7d2c8d3 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3820b31a424c3a9216a6ef91fcb285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a42c3ecf474883ac652fcc8c01c9f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:13:03.807192 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-a23dee67-2f3d-464e-99fb-83c3f7d2c8d3 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] 10.222.0.18 "GET /compute/v2.1/servers/5c197028-ff9e-46ff-81f4-0feb4748da97" status: 200 len: 1094 microversion: 2.1 time: 0.855997 Oct 22 21:13:03.814710 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2276/4539] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:13:02 2022] GET /compute/v2.1/servers/5c197028-ff9e-46ff-81f4-0feb4748da97 => generated 1094 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:13:03.820104 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-e907490b-5f8b-4a00-9d06-3b6b98f8b199 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:13:03.823599 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-e907490b-5f8b-4a00-9d06-3b6b98f8b199 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] [instance: ecbbbe88-8a1a-4480-b826-5ba23c6a4404] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:13:03.840388 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e907490b-5f8b-4a00-9d06-3b6b98f8b199 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:03.843854 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e907490b-5f8b-4a00-9d06-3b6b98f8b199 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:03.844661 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e907490b-5f8b-4a00-9d06-3b6b98f8b199 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:03.845503 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e907490b-5f8b-4a00-9d06-3b6b98f8b199 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:03.849162 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e907490b-5f8b-4a00-9d06-3b6b98f8b199 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:03.849658 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e907490b-5f8b-4a00-9d06-3b6b98f8b199 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:04.016537 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-e907490b-5f8b-4a00-9d06-3b6b98f8b199 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799f987b3aa7426ba5d7a464052d6490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87474d4b4c547abbfe6308b6dd8e1c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:13:04.026288 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-e907490b-5f8b-4a00-9d06-3b6b98f8b199 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] 10.222.0.18 "GET /compute/v2.1/servers/ecbbbe88-8a1a-4480-b826-5ba23c6a4404" status: 200 len: 1251 microversion: 2.1 time: 0.209911 Oct 22 21:13:04.027540 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2277/4540] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:13:03 2022] GET /compute/v2.1/servers/ecbbbe88-8a1a-4480-b826-5ba23c6a4404 => generated 1251 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:13:04.084729 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-1f47d77a-e4c0-450e-8e90-23c8ffee740c tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:13:04.099175 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-1f47d77a-e4c0-450e-8e90-23c8ffee740c tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:13:04.101392 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-1f47d77a-e4c0-450e-8e90-23c8ffee740c tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:13:04.104956 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-1f47d77a-e4c0-450e-8e90-23c8ffee740c tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] 10.222.0.18 "GET /compute/v2.1/servers/34dcd1da-b94c-426b-b08b-204ea287c8a2" status: 200 len: 1724 microversion: 2.20 time: 1.204907 Oct 22 21:13:04.110841 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2264/4541] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:13:02 2022] GET /compute/v2.1/servers/34dcd1da-b94c-426b-b08b-204ea287c8a2 => generated 1724 bytes in 1212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:13:04.844831 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-8f867796-a232-4301-becd-a73211b2fbd9 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:13:04.845596 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-8f867796-a232-4301-becd-a73211b2fbd9 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] [instance: 5c197028-ff9e-46ff-81f4-0feb4748da97] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:13:04.866039 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8f867796-a232-4301-becd-a73211b2fbd9 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:04.866832 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8f867796-a232-4301-becd-a73211b2fbd9 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:04.872970 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8f867796-a232-4301-becd-a73211b2fbd9 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:04.873754 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8f867796-a232-4301-becd-a73211b2fbd9 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:04.874223 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8f867796-a232-4301-becd-a73211b2fbd9 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:04.874627 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8f867796-a232-4301-becd-a73211b2fbd9 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:05.051381 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-cf4a73ab-69eb-4c5e-9343-20391ca29dc1 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:13:05.052211 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-cf4a73ab-69eb-4c5e-9343-20391ca29dc1 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] [instance: ecbbbe88-8a1a-4480-b826-5ba23c6a4404] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:13:05.066136 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cf4a73ab-69eb-4c5e-9343-20391ca29dc1 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:05.070431 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cf4a73ab-69eb-4c5e-9343-20391ca29dc1 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:05.071127 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cf4a73ab-69eb-4c5e-9343-20391ca29dc1 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:05.072293 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cf4a73ab-69eb-4c5e-9343-20391ca29dc1 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:05.073456 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cf4a73ab-69eb-4c5e-9343-20391ca29dc1 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:05.074961 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cf4a73ab-69eb-4c5e-9343-20391ca29dc1 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:05.167693 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-8f867796-a232-4301-becd-a73211b2fbd9 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3820b31a424c3a9216a6ef91fcb285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a42c3ecf474883ac652fcc8c01c9f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:13:05.184410 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-8f867796-a232-4301-becd-a73211b2fbd9 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] 10.222.0.18 "GET /compute/v2.1/servers/5c197028-ff9e-46ff-81f4-0feb4748da97" status: 200 len: 1200 microversion: 2.1 time: 0.343096 Oct 22 21:13:05.185020 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2278/4542] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:13:04 2022] GET /compute/v2.1/servers/5c197028-ff9e-46ff-81f4-0feb4748da97 => generated 1200 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:13:05.221523 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-6de8b62e-5604-4c88-9992-564c983ce1d9 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:13:05.223869 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-6de8b62e-5604-4c88-9992-564c983ce1d9 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] [instance: 34dcd1da-b94c-426b-b08b-204ea287c8a2] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:13:05.240642 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6de8b62e-5604-4c88-9992-564c983ce1d9 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:05.241286 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6de8b62e-5604-4c88-9992-564c983ce1d9 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:05.241904 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6de8b62e-5604-4c88-9992-564c983ce1d9 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:05.242578 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6de8b62e-5604-4c88-9992-564c983ce1d9 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:05.245148 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6de8b62e-5604-4c88-9992-564c983ce1d9 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:05.247971 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6de8b62e-5604-4c88-9992-564c983ce1d9 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:05.992025 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-cf4a73ab-69eb-4c5e-9343-20391ca29dc1 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799f987b3aa7426ba5d7a464052d6490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87474d4b4c547abbfe6308b6dd8e1c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:13:06.017394 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-cf4a73ab-69eb-4c5e-9343-20391ca29dc1 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] 10.222.0.18 "GET /compute/v2.1/servers/ecbbbe88-8a1a-4480-b826-5ba23c6a4404" status: 200 len: 1293 microversion: 2.1 time: 0.969029 Oct 22 21:13:06.018992 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2265/4543] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:13:05 2022] GET /compute/v2.1/servers/ecbbbe88-8a1a-4480-b826-5ba23c6a4404 => generated 1293 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:13:06.161943 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-6de8b62e-5604-4c88-9992-564c983ce1d9 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:13:06.174787 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-6de8b62e-5604-4c88-9992-564c983ce1d9 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:13:06.180652 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-6de8b62e-5604-4c88-9992-564c983ce1d9 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:13:06.182497 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-6de8b62e-5604-4c88-9992-564c983ce1d9 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] 10.222.0.18 "GET /compute/v2.1/servers/34dcd1da-b94c-426b-b08b-204ea287c8a2" status: 200 len: 1724 microversion: 2.20 time: 0.977905 Oct 22 21:13:06.187068 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2279/4544] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:13:05 2022] GET /compute/v2.1/servers/34dcd1da-b94c-426b-b08b-204ea287c8a2 => generated 1724 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:13:06.219154 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-578d72f4-1a41-4495-94ef-717840d7038c tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:13:06.220765 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-578d72f4-1a41-4495-94ef-717840d7038c tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] [instance: 5c197028-ff9e-46ff-81f4-0feb4748da97] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:13:06.266369 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-578d72f4-1a41-4495-94ef-717840d7038c tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:06.269667 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-578d72f4-1a41-4495-94ef-717840d7038c tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:06.272405 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-578d72f4-1a41-4495-94ef-717840d7038c tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:06.274834 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-578d72f4-1a41-4495-94ef-717840d7038c tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:06.276682 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-578d72f4-1a41-4495-94ef-717840d7038c tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:06.277346 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-578d72f4-1a41-4495-94ef-717840d7038c tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:06.642730 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-578d72f4-1a41-4495-94ef-717840d7038c tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3820b31a424c3a9216a6ef91fcb285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a42c3ecf474883ac652fcc8c01c9f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:13:06.669469 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-578d72f4-1a41-4495-94ef-717840d7038c tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] 10.222.0.18 "GET /compute/v2.1/servers/5c197028-ff9e-46ff-81f4-0feb4748da97" status: 200 len: 1277 microversion: 2.1 time: 0.462649 Oct 22 21:13:06.672977 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2266/4545] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:13:06 2022] GET /compute/v2.1/servers/5c197028-ff9e-46ff-81f4-0feb4748da97 => generated 1277 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:13:07.045536 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-87ae7ea6-03dd-448f-9d95-e5208ed31b20 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:13:07.046189 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-87ae7ea6-03dd-448f-9d95-e5208ed31b20 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] [instance: ecbbbe88-8a1a-4480-b826-5ba23c6a4404] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:13:07.061111 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-87ae7ea6-03dd-448f-9d95-e5208ed31b20 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:07.061619 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-87ae7ea6-03dd-448f-9d95-e5208ed31b20 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:07.062063 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-87ae7ea6-03dd-448f-9d95-e5208ed31b20 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:07.063568 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-87ae7ea6-03dd-448f-9d95-e5208ed31b20 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:07.067402 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-87ae7ea6-03dd-448f-9d95-e5208ed31b20 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:07.068118 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-87ae7ea6-03dd-448f-9d95-e5208ed31b20 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:07.096297 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-3a44eb57-b0fc-406e-9439-ceb2389be101 req-28256dfd-382d-48e9-b93b-5061b549141e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ecbbbe88-8a1a-4480-b826-5ba23c6a4404", "tag": "f77d3df4-f455-42ee-bc7d-c9161b77a4a2"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:13:07.133172 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-3a44eb57-b0fc-406e-9439-ceb2389be101 req-28256dfd-382d-48e9-b93b-5061b549141e service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:07.136932 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-3a44eb57-b0fc-406e-9439-ceb2389be101 req-28256dfd-382d-48e9-b93b-5061b549141e service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:07.138320 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-3a44eb57-b0fc-406e-9439-ceb2389be101 req-28256dfd-382d-48e9-b93b-5061b549141e service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:07.176382 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-3a44eb57-b0fc-406e-9439-ceb2389be101 req-28256dfd-382d-48e9-b93b-5061b549141e service nova] Creating event network-changed:f77d3df4-f455-42ee-bc7d-c9161b77a4a2 for instance ecbbbe88-8a1a-4480-b826-5ba23c6a4404 on nch2-master-1 Oct 22 21:13:07.191136 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-3a44eb57-b0fc-406e-9439-ceb2389be101 req-28256dfd-382d-48e9-b93b-5061b549141e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108973 Oct 22 21:13:07.192012 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2267/4546] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:13:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 21:13:07.222624 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-0ecaabb8-a552-48e9-bf28-375eb01cbff3 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:13:07.223590 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-0ecaabb8-a552-48e9-bf28-375eb01cbff3 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] [instance: 34dcd1da-b94c-426b-b08b-204ea287c8a2] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:13:07.240960 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0ecaabb8-a552-48e9-bf28-375eb01cbff3 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:07.247058 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0ecaabb8-a552-48e9-bf28-375eb01cbff3 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:07.247873 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0ecaabb8-a552-48e9-bf28-375eb01cbff3 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:07.248797 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0ecaabb8-a552-48e9-bf28-375eb01cbff3 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:07.249436 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0ecaabb8-a552-48e9-bf28-375eb01cbff3 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:07.250070 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0ecaabb8-a552-48e9-bf28-375eb01cbff3 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:07.729192 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-87ae7ea6-03dd-448f-9d95-e5208ed31b20 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799f987b3aa7426ba5d7a464052d6490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87474d4b4c547abbfe6308b6dd8e1c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:13:07.749621 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-0ecaabb8-a552-48e9-bf28-375eb01cbff3 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:13:07.750847 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-87ae7ea6-03dd-448f-9d95-e5208ed31b20 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] 10.222.0.18 "GET /compute/v2.1/servers/ecbbbe88-8a1a-4480-b826-5ba23c6a4404" status: 200 len: 1293 microversion: 2.1 time: 0.709245 Oct 22 21:13:07.753471 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2280/4547] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:13:07 2022] GET /compute/v2.1/servers/ecbbbe88-8a1a-4480-b826-5ba23c6a4404 => generated 1293 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:13:07.761595 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-f2f53448-ffc2-4c84-81cf-a02f3be89494 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:13:07.763795 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-f2f53448-ffc2-4c84-81cf-a02f3be89494 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] [instance: 5c197028-ff9e-46ff-81f4-0feb4748da97] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:13:07.774953 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f2f53448-ffc2-4c84-81cf-a02f3be89494 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:07.777631 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f2f53448-ffc2-4c84-81cf-a02f3be89494 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:07.779201 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f2f53448-ffc2-4c84-81cf-a02f3be89494 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:07.780897 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f2f53448-ffc2-4c84-81cf-a02f3be89494 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:07.781679 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f2f53448-ffc2-4c84-81cf-a02f3be89494 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:07.782854 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f2f53448-ffc2-4c84-81cf-a02f3be89494 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:07.786371 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-0ecaabb8-a552-48e9-bf28-375eb01cbff3 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:13:07.790467 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-0ecaabb8-a552-48e9-bf28-375eb01cbff3 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:13:07.802360 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-0ecaabb8-a552-48e9-bf28-375eb01cbff3 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] 10.222.0.18 "GET /compute/v2.1/servers/34dcd1da-b94c-426b-b08b-204ea287c8a2" status: 200 len: 1724 microversion: 2.20 time: 0.588651 Oct 22 21:13:07.820968 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2268/4548] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:13:07 2022] GET /compute/v2.1/servers/34dcd1da-b94c-426b-b08b-204ea287c8a2 => generated 1724 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:13:08.161557 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-f2f53448-ffc2-4c84-81cf-a02f3be89494 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3820b31a424c3a9216a6ef91fcb285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a42c3ecf474883ac652fcc8c01c9f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:13:08.171241 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-f2f53448-ffc2-4c84-81cf-a02f3be89494 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] 10.222.0.18 "GET /compute/v2.1/servers/5c197028-ff9e-46ff-81f4-0feb4748da97" status: 200 len: 1265 microversion: 2.1 time: 0.416324 Oct 22 21:13:08.171844 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2281/4549] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:13:07 2022] GET /compute/v2.1/servers/5c197028-ff9e-46ff-81f4-0feb4748da97 => generated 1265 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:13:08.414735 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-a81561c7-f581-4a19-90c6-5e240fc394a8 req-84b11901-321d-4afb-b0f0-cf6caa5a7e02 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c197028-ff9e-46ff-81f4-0feb4748da97", "tag": "c5e164ee-0bd2-495e-9036-a2f07d700b5e"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:13:08.430300 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-a81561c7-f581-4a19-90c6-5e240fc394a8 req-84b11901-321d-4afb-b0f0-cf6caa5a7e02 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:08.437673 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-a81561c7-f581-4a19-90c6-5e240fc394a8 req-84b11901-321d-4afb-b0f0-cf6caa5a7e02 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:08.438514 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-a81561c7-f581-4a19-90c6-5e240fc394a8 req-84b11901-321d-4afb-b0f0-cf6caa5a7e02 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:08.459172 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-a81561c7-f581-4a19-90c6-5e240fc394a8 req-84b11901-321d-4afb-b0f0-cf6caa5a7e02 service nova] Creating event network-changed:c5e164ee-0bd2-495e-9036-a2f07d700b5e for instance 5c197028-ff9e-46ff-81f4-0feb4748da97 on nch1-master-1 Oct 22 21:13:08.466807 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-a81561c7-f581-4a19-90c6-5e240fc394a8 req-84b11901-321d-4afb-b0f0-cf6caa5a7e02 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058218 Oct 22 21:13:08.467957 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2269/4550] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:13:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:13:08.793997 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-0ed31fd2-2d80-4427-b99e-2f353cc1a282 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:13:08.794875 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-0ed31fd2-2d80-4427-b99e-2f353cc1a282 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] [instance: ecbbbe88-8a1a-4480-b826-5ba23c6a4404] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:13:08.801817 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0ed31fd2-2d80-4427-b99e-2f353cc1a282 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:08.802459 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0ed31fd2-2d80-4427-b99e-2f353cc1a282 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:08.802939 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0ed31fd2-2d80-4427-b99e-2f353cc1a282 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:08.804223 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0ed31fd2-2d80-4427-b99e-2f353cc1a282 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:08.804632 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0ed31fd2-2d80-4427-b99e-2f353cc1a282 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:08.805327 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0ed31fd2-2d80-4427-b99e-2f353cc1a282 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:08.847509 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-f8cf4092-cd8f-44f9-a533-1d19a2872a87 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:13:08.850565 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-f8cf4092-cd8f-44f9-a533-1d19a2872a87 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] [instance: 34dcd1da-b94c-426b-b08b-204ea287c8a2] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:13:08.881543 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f8cf4092-cd8f-44f9-a533-1d19a2872a87 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:08.882465 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f8cf4092-cd8f-44f9-a533-1d19a2872a87 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:08.883119 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f8cf4092-cd8f-44f9-a533-1d19a2872a87 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:08.884657 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f8cf4092-cd8f-44f9-a533-1d19a2872a87 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:08.885532 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f8cf4092-cd8f-44f9-a533-1d19a2872a87 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:08.886271 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f8cf4092-cd8f-44f9-a533-1d19a2872a87 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:09.028035 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-0ed31fd2-2d80-4427-b99e-2f353cc1a282 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799f987b3aa7426ba5d7a464052d6490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87474d4b4c547abbfe6308b6dd8e1c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:13:09.048240 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-0ed31fd2-2d80-4427-b99e-2f353cc1a282 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] 10.222.0.18 "GET /compute/v2.1/servers/ecbbbe88-8a1a-4480-b826-5ba23c6a4404" status: 200 len: 1293 microversion: 2.1 time: 0.259074 Oct 22 21:13:09.048984 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2282/4551] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:13:08 2022] GET /compute/v2.1/servers/ecbbbe88-8a1a-4480-b826-5ba23c6a4404 => generated 1293 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:13:09.128748 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-f8cf4092-cd8f-44f9-a533-1d19a2872a87 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:13:09.139949 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-f8cf4092-cd8f-44f9-a533-1d19a2872a87 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:13:09.142047 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-f8cf4092-cd8f-44f9-a533-1d19a2872a87 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:13:09.143919 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-f8cf4092-cd8f-44f9-a533-1d19a2872a87 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] 10.222.0.18 "GET /compute/v2.1/servers/34dcd1da-b94c-426b-b08b-204ea287c8a2" status: 200 len: 1724 microversion: 2.20 time: 0.302387 Oct 22 21:13:09.144895 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2270/4552] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:13:08 2022] GET /compute/v2.1/servers/34dcd1da-b94c-426b-b08b-204ea287c8a2 => generated 1724 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:13:09.199423 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-9331c406-e131-400c-9b18-d89cedfb58f2 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:13:09.200328 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-9331c406-e131-400c-9b18-d89cedfb58f2 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] [instance: 5c197028-ff9e-46ff-81f4-0feb4748da97] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:13:09.210100 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9331c406-e131-400c-9b18-d89cedfb58f2 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:09.210667 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9331c406-e131-400c-9b18-d89cedfb58f2 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:09.211118 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9331c406-e131-400c-9b18-d89cedfb58f2 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:09.211992 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9331c406-e131-400c-9b18-d89cedfb58f2 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:09.212454 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9331c406-e131-400c-9b18-d89cedfb58f2 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:09.212984 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9331c406-e131-400c-9b18-d89cedfb58f2 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:09.510408 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-9331c406-e131-400c-9b18-d89cedfb58f2 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3820b31a424c3a9216a6ef91fcb285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a42c3ecf474883ac652fcc8c01c9f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:13:09.521856 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-9331c406-e131-400c-9b18-d89cedfb58f2 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] 10.222.0.18 "GET /compute/v2.1/servers/5c197028-ff9e-46ff-81f4-0feb4748da97" status: 200 len: 1265 microversion: 2.1 time: 0.327384 Oct 22 21:13:09.522763 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2283/4553] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:13:09 2022] GET /compute/v2.1/servers/5c197028-ff9e-46ff-81f4-0feb4748da97 => generated 1265 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:13:10.073754 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-ce38a723-7cf3-4c25-aeae-50e250eb78f6 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:13:10.074383 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-ce38a723-7cf3-4c25-aeae-50e250eb78f6 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] [instance: ecbbbe88-8a1a-4480-b826-5ba23c6a4404] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:13:10.081799 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ce38a723-7cf3-4c25-aeae-50e250eb78f6 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:10.082332 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ce38a723-7cf3-4c25-aeae-50e250eb78f6 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:10.082798 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ce38a723-7cf3-4c25-aeae-50e250eb78f6 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:10.084513 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ce38a723-7cf3-4c25-aeae-50e250eb78f6 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:10.084990 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ce38a723-7cf3-4c25-aeae-50e250eb78f6 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:10.085615 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ce38a723-7cf3-4c25-aeae-50e250eb78f6 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:10.171369 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-aa205103-0a67-4cc3-bc2f-a23cc0a047a3 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:13:10.172228 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-aa205103-0a67-4cc3-bc2f-a23cc0a047a3 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] [instance: 34dcd1da-b94c-426b-b08b-204ea287c8a2] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:13:10.181378 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-aa205103-0a67-4cc3-bc2f-a23cc0a047a3 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:10.183528 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-aa205103-0a67-4cc3-bc2f-a23cc0a047a3 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:10.184215 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-aa205103-0a67-4cc3-bc2f-a23cc0a047a3 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:10.185297 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-aa205103-0a67-4cc3-bc2f-a23cc0a047a3 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:10.186007 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-aa205103-0a67-4cc3-bc2f-a23cc0a047a3 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:10.186545 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-aa205103-0a67-4cc3-bc2f-a23cc0a047a3 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:10.325356 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-ce38a723-7cf3-4c25-aeae-50e250eb78f6 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799f987b3aa7426ba5d7a464052d6490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87474d4b4c547abbfe6308b6dd8e1c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:13:10.344724 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-ce38a723-7cf3-4c25-aeae-50e250eb78f6 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] 10.222.0.18 "GET /compute/v2.1/servers/ecbbbe88-8a1a-4480-b826-5ba23c6a4404" status: 200 len: 1293 microversion: 2.1 time: 0.275075 Oct 22 21:13:10.345637 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2271/4554] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:13:10 2022] GET /compute/v2.1/servers/ecbbbe88-8a1a-4480-b826-5ba23c6a4404 => generated 1293 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:13:10.398432 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-aa205103-0a67-4cc3-bc2f-a23cc0a047a3 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:13:10.419750 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-aa205103-0a67-4cc3-bc2f-a23cc0a047a3 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:13:10.421616 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-aa205103-0a67-4cc3-bc2f-a23cc0a047a3 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:13:10.430830 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-aa205103-0a67-4cc3-bc2f-a23cc0a047a3 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] 10.222.0.18 "GET /compute/v2.1/servers/34dcd1da-b94c-426b-b08b-204ea287c8a2" status: 200 len: 1724 microversion: 2.20 time: 0.260132 Oct 22 21:13:10.452727 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2284/4555] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:13:10 2022] GET /compute/v2.1/servers/34dcd1da-b94c-426b-b08b-204ea287c8a2 => generated 1724 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 22 21:13:10.548926 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-a6d87670-c084-45a9-adfa-3d7e239402b5 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:13:10.549674 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-a6d87670-c084-45a9-adfa-3d7e239402b5 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] [instance: 5c197028-ff9e-46ff-81f4-0feb4748da97] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:13:10.560956 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a6d87670-c084-45a9-adfa-3d7e239402b5 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:10.561895 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a6d87670-c084-45a9-adfa-3d7e239402b5 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:10.562614 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a6d87670-c084-45a9-adfa-3d7e239402b5 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:10.563659 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a6d87670-c084-45a9-adfa-3d7e239402b5 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:10.564159 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a6d87670-c084-45a9-adfa-3d7e239402b5 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:10.564807 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a6d87670-c084-45a9-adfa-3d7e239402b5 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:10.829096 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-a6d87670-c084-45a9-adfa-3d7e239402b5 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3820b31a424c3a9216a6ef91fcb285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a42c3ecf474883ac652fcc8c01c9f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:13:10.840860 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-a6d87670-c084-45a9-adfa-3d7e239402b5 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] 10.222.0.18 "GET /compute/v2.1/servers/5c197028-ff9e-46ff-81f4-0feb4748da97" status: 200 len: 1265 microversion: 2.1 time: 0.296496 Oct 22 21:13:10.845360 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2272/4556] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:13:10 2022] GET /compute/v2.1/servers/5c197028-ff9e-46ff-81f4-0feb4748da97 => generated 1265 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:13:11.372396 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-fc273f4e-b027-4d66-8720-5fd4dc8200f2 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:13:11.373022 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-fc273f4e-b027-4d66-8720-5fd4dc8200f2 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] [instance: ecbbbe88-8a1a-4480-b826-5ba23c6a4404] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:13:11.379973 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fc273f4e-b027-4d66-8720-5fd4dc8200f2 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:11.380486 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fc273f4e-b027-4d66-8720-5fd4dc8200f2 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:11.380947 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fc273f4e-b027-4d66-8720-5fd4dc8200f2 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:11.381677 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fc273f4e-b027-4d66-8720-5fd4dc8200f2 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:11.382196 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fc273f4e-b027-4d66-8720-5fd4dc8200f2 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:11.382636 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fc273f4e-b027-4d66-8720-5fd4dc8200f2 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:11.458496 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-80d80f62-bba9-4345-9691-6e24e25eed6e tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:13:11.459150 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-80d80f62-bba9-4345-9691-6e24e25eed6e tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] [instance: 34dcd1da-b94c-426b-b08b-204ea287c8a2] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:13:11.468572 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell0:SELECT=2 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:13:11.470414 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-80d80f62-bba9-4345-9691-6e24e25eed6e tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:11.470900 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-80d80f62-bba9-4345-9691-6e24e25eed6e tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:11.474660 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-80d80f62-bba9-4345-9691-6e24e25eed6e tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:11.477245 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-80d80f62-bba9-4345-9691-6e24e25eed6e tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:11.482830 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-80d80f62-bba9-4345-9691-6e24e25eed6e tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:11.483673 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-80d80f62-bba9-4345-9691-6e24e25eed6e tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:11.684390 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-fc273f4e-b027-4d66-8720-5fd4dc8200f2 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799f987b3aa7426ba5d7a464052d6490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87474d4b4c547abbfe6308b6dd8e1c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:13:11.712471 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-fc273f4e-b027-4d66-8720-5fd4dc8200f2 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] 10.222.0.18 "GET /compute/v2.1/servers/ecbbbe88-8a1a-4480-b826-5ba23c6a4404" status: 200 len: 1293 microversion: 2.1 time: 0.342579 Oct 22 21:13:11.727057 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2285/4557] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:13:11 2022] GET /compute/v2.1/servers/ecbbbe88-8a1a-4480-b826-5ba23c6a4404 => generated 1293 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:13:11.781858 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-80d80f62-bba9-4345-9691-6e24e25eed6e tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:13:11.793012 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-80d80f62-bba9-4345-9691-6e24e25eed6e tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:13:11.794385 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-80d80f62-bba9-4345-9691-6e24e25eed6e tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:13:11.796413 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-80d80f62-bba9-4345-9691-6e24e25eed6e tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] 10.222.0.18 "GET /compute/v2.1/servers/34dcd1da-b94c-426b-b08b-204ea287c8a2" status: 200 len: 1724 microversion: 2.20 time: 0.343506 Oct 22 21:13:11.811402 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2273/4558] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:13:11 2022] GET /compute/v2.1/servers/34dcd1da-b94c-426b-b08b-204ea287c8a2 => generated 1724 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:13:11.869130 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-60bda4b0-a32b-45d7-b359-e37c7cad984e tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:13:11.869774 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-60bda4b0-a32b-45d7-b359-e37c7cad984e tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] [instance: 5c197028-ff9e-46ff-81f4-0feb4748da97] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:13:11.877134 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-60bda4b0-a32b-45d7-b359-e37c7cad984e tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:11.878277 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-60bda4b0-a32b-45d7-b359-e37c7cad984e tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:11.878967 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-60bda4b0-a32b-45d7-b359-e37c7cad984e tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:11.879968 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-60bda4b0-a32b-45d7-b359-e37c7cad984e tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:11.880461 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-60bda4b0-a32b-45d7-b359-e37c7cad984e tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:11.881095 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-60bda4b0-a32b-45d7-b359-e37c7cad984e tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:12.109288 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-60bda4b0-a32b-45d7-b359-e37c7cad984e tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3820b31a424c3a9216a6ef91fcb285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a42c3ecf474883ac652fcc8c01c9f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:13:12.122426 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-60bda4b0-a32b-45d7-b359-e37c7cad984e tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] 10.222.0.18 "GET /compute/v2.1/servers/5c197028-ff9e-46ff-81f4-0feb4748da97" status: 200 len: 1265 microversion: 2.1 time: 0.257815 Oct 22 21:13:12.123385 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2286/4559] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:13:11 2022] GET /compute/v2.1/servers/5c197028-ff9e-46ff-81f4-0feb4748da97 => generated 1265 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:13:12.742944 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-a886b791-7b54-491e-a2d2-6d7b8fdc9904 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:13:12.744804 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-a886b791-7b54-491e-a2d2-6d7b8fdc9904 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] [instance: ecbbbe88-8a1a-4480-b826-5ba23c6a4404] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:13:12.756423 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a886b791-7b54-491e-a2d2-6d7b8fdc9904 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:12.757170 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a886b791-7b54-491e-a2d2-6d7b8fdc9904 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:12.757722 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a886b791-7b54-491e-a2d2-6d7b8fdc9904 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:12.758920 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a886b791-7b54-491e-a2d2-6d7b8fdc9904 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:12.759559 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a886b791-7b54-491e-a2d2-6d7b8fdc9904 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:12.760369 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a886b791-7b54-491e-a2d2-6d7b8fdc9904 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:12.823852 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-567e8861-cc38-4a5e-874f-4e199f5b82eb tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:13:12.825105 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-567e8861-cc38-4a5e-874f-4e199f5b82eb tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] [instance: 34dcd1da-b94c-426b-b08b-204ea287c8a2] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:13:12.828310 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell0:SELECT=4 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:13:12.835034 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-567e8861-cc38-4a5e-874f-4e199f5b82eb tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:12.835645 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-567e8861-cc38-4a5e-874f-4e199f5b82eb tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:12.836115 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-567e8861-cc38-4a5e-874f-4e199f5b82eb tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:12.836871 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-567e8861-cc38-4a5e-874f-4e199f5b82eb tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:12.837395 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-567e8861-cc38-4a5e-874f-4e199f5b82eb tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:12.837852 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-567e8861-cc38-4a5e-874f-4e199f5b82eb tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:13.005038 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-a886b791-7b54-491e-a2d2-6d7b8fdc9904 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799f987b3aa7426ba5d7a464052d6490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87474d4b4c547abbfe6308b6dd8e1c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:13:13.015151 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-a886b791-7b54-491e-a2d2-6d7b8fdc9904 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] 10.222.0.18 "GET /compute/v2.1/servers/ecbbbe88-8a1a-4480-b826-5ba23c6a4404" status: 200 len: 1293 microversion: 2.1 time: 0.278101 Oct 22 21:13:13.015800 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2274/4560] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:13:12 2022] GET /compute/v2.1/servers/ecbbbe88-8a1a-4480-b826-5ba23c6a4404 => generated 1293 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:13:13.052732 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-567e8861-cc38-4a5e-874f-4e199f5b82eb tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:13:13.062007 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-567e8861-cc38-4a5e-874f-4e199f5b82eb tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:13:13.063728 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-567e8861-cc38-4a5e-874f-4e199f5b82eb tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:13:13.065201 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-567e8861-cc38-4a5e-874f-4e199f5b82eb tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] 10.222.0.18 "GET /compute/v2.1/servers/34dcd1da-b94c-426b-b08b-204ea287c8a2" status: 200 len: 1724 microversion: 2.20 time: 0.246588 Oct 22 21:13:13.066064 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2287/4561] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:13:12 2022] GET /compute/v2.1/servers/34dcd1da-b94c-426b-b08b-204ea287c8a2 => generated 1724 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 22 21:13:13.147627 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-85d85eaf-f49c-42f0-9992-e6fb0d06b092 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:13:13.148251 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-85d85eaf-f49c-42f0-9992-e6fb0d06b092 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] [instance: 5c197028-ff9e-46ff-81f4-0feb4748da97] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:13:13.155241 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-85d85eaf-f49c-42f0-9992-e6fb0d06b092 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:13.155809 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-85d85eaf-f49c-42f0-9992-e6fb0d06b092 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:13.156408 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-85d85eaf-f49c-42f0-9992-e6fb0d06b092 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:13.157008 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-85d85eaf-f49c-42f0-9992-e6fb0d06b092 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:13.157457 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-85d85eaf-f49c-42f0-9992-e6fb0d06b092 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:13.158038 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-85d85eaf-f49c-42f0-9992-e6fb0d06b092 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:13.303142 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-85d85eaf-f49c-42f0-9992-e6fb0d06b092 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3820b31a424c3a9216a6ef91fcb285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a42c3ecf474883ac652fcc8c01c9f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:13:13.311907 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-85d85eaf-f49c-42f0-9992-e6fb0d06b092 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] 10.222.0.18 "GET /compute/v2.1/servers/5c197028-ff9e-46ff-81f4-0feb4748da97" status: 200 len: 1265 microversion: 2.1 time: 0.168505 Oct 22 21:13:13.312499 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2275/4562] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:13:13 2022] GET /compute/v2.1/servers/5c197028-ff9e-46ff-81f4-0feb4748da97 => generated 1265 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:13:14.039320 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-62d7d07a-5fc4-467f-83bb-5d4f8ed08bde tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:13:14.040594 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-62d7d07a-5fc4-467f-83bb-5d4f8ed08bde tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] [instance: ecbbbe88-8a1a-4480-b826-5ba23c6a4404] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:13:14.044060 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell0:SELECT=14 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:13:14.049660 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-62d7d07a-5fc4-467f-83bb-5d4f8ed08bde tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:14.050179 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-62d7d07a-5fc4-467f-83bb-5d4f8ed08bde tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:14.050642 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-62d7d07a-5fc4-467f-83bb-5d4f8ed08bde tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:14.051480 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-62d7d07a-5fc4-467f-83bb-5d4f8ed08bde tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:14.051930 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-62d7d07a-5fc4-467f-83bb-5d4f8ed08bde tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:14.052605 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-62d7d07a-5fc4-467f-83bb-5d4f8ed08bde tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:14.093809 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-f83770fd-cda8-4e63-a771-e82974daa423 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:13:14.094625 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-f83770fd-cda8-4e63-a771-e82974daa423 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] [instance: 34dcd1da-b94c-426b-b08b-204ea287c8a2] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:13:14.104283 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f83770fd-cda8-4e63-a771-e82974daa423 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:14.105354 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f83770fd-cda8-4e63-a771-e82974daa423 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:14.106040 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f83770fd-cda8-4e63-a771-e82974daa423 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:14.107529 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f83770fd-cda8-4e63-a771-e82974daa423 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:14.108430 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f83770fd-cda8-4e63-a771-e82974daa423 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:14.108960 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f83770fd-cda8-4e63-a771-e82974daa423 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:14.262836 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-62d7d07a-5fc4-467f-83bb-5d4f8ed08bde tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799f987b3aa7426ba5d7a464052d6490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87474d4b4c547abbfe6308b6dd8e1c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:13:14.291538 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-62d7d07a-5fc4-467f-83bb-5d4f8ed08bde tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] 10.222.0.18 "GET /compute/v2.1/servers/ecbbbe88-8a1a-4480-b826-5ba23c6a4404" status: 200 len: 1293 microversion: 2.1 time: 0.256021 Oct 22 21:13:14.292939 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2288/4563] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:13:14 2022] GET /compute/v2.1/servers/ecbbbe88-8a1a-4480-b826-5ba23c6a4404 => generated 1293 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:13:14.318321 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-b4f42313-a116-4093-bd10-6f085e7f98f7 req-419fc3c7-5ce4-4a28-adf0-6c90c59bf177 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ecbbbe88-8a1a-4480-b826-5ba23c6a4404", "name": "network-vif-plugged", "status": "completed", "tag": "f77d3df4-f455-42ee-bc7d-c9161b77a4a2"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:13:14.345148 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-b4f42313-a116-4093-bd10-6f085e7f98f7 req-419fc3c7-5ce4-4a28-adf0-6c90c59bf177 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:14.346726 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-b4f42313-a116-4093-bd10-6f085e7f98f7 req-419fc3c7-5ce4-4a28-adf0-6c90c59bf177 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:14.347269 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-b4f42313-a116-4093-bd10-6f085e7f98f7 req-419fc3c7-5ce4-4a28-adf0-6c90c59bf177 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:14.369678 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-b4f42313-a116-4093-bd10-6f085e7f98f7 req-419fc3c7-5ce4-4a28-adf0-6c90c59bf177 service nova] Creating event network-vif-plugged:f77d3df4-f455-42ee-bc7d-c9161b77a4a2 for instance ecbbbe88-8a1a-4480-b826-5ba23c6a4404 on nch2-master-1 Oct 22 21:13:14.375313 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-f83770fd-cda8-4e63-a771-e82974daa423 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:13:14.376905 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-b4f42313-a116-4093-bd10-6f085e7f98f7 req-419fc3c7-5ce4-4a28-adf0-6c90c59bf177 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063609 Oct 22 21:13:14.378064 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2289/4564] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:13:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 21:13:14.386350 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-56b20033-f93f-4e94-a846-7b41944f581b tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:13:14.387386 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-56b20033-f93f-4e94-a846-7b41944f581b tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] [instance: 5c197028-ff9e-46ff-81f4-0feb4748da97] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:13:14.388859 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-f83770fd-cda8-4e63-a771-e82974daa423 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:13:14.390823 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-f83770fd-cda8-4e63-a771-e82974daa423 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:13:14.392391 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-f83770fd-cda8-4e63-a771-e82974daa423 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] 10.222.0.18 "GET /compute/v2.1/servers/34dcd1da-b94c-426b-b08b-204ea287c8a2" status: 200 len: 1745 microversion: 2.20 time: 0.302944 Oct 22 21:13:14.393650 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2276/4565] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:13:14 2022] GET /compute/v2.1/servers/34dcd1da-b94c-426b-b08b-204ea287c8a2 => generated 1745 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 22 21:13:14.396422 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-56b20033-f93f-4e94-a846-7b41944f581b tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:14.397297 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-56b20033-f93f-4e94-a846-7b41944f581b tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:14.397952 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-56b20033-f93f-4e94-a846-7b41944f581b tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:14.398870 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-56b20033-f93f-4e94-a846-7b41944f581b tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:14.399546 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-56b20033-f93f-4e94-a846-7b41944f581b tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:14.400189 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-56b20033-f93f-4e94-a846-7b41944f581b tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:14.624997 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-56b20033-f93f-4e94-a846-7b41944f581b tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3820b31a424c3a9216a6ef91fcb285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a42c3ecf474883ac652fcc8c01c9f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:13:14.634563 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-56b20033-f93f-4e94-a846-7b41944f581b tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] 10.222.0.18 "GET /compute/v2.1/servers/5c197028-ff9e-46ff-81f4-0feb4748da97" status: 200 len: 1265 microversion: 2.1 time: 0.254684 Oct 22 21:13:14.635039 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2290/4566] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:13:14 2022] GET /compute/v2.1/servers/5c197028-ff9e-46ff-81f4-0feb4748da97 => generated 1265 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:13:15.216530 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-dbf1b55f-cab5-4350-8f27-e904c6682b55 tempest-TestVolumeBackupRestore-2071196610 tempest-TestVolumeBackupRestore-2071196610-project] Action: 'create', calling method: .version_select at 0x7fd39eda9f70>, body: {"keypair": {"name": "tempest-TestVolumeBackupRestore-1818971266", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAZ7cyqIFN+cC5ip+5LcfAfvDODoDvxxUUrb6fHTT8bnG6n5yW/E+OyGWT6H2TCX2Muidr4/w5eQw45cIwc+Pgv7RyW0oKym6S6XjWeSfloH8U5Gl8N1/jsCP2qEDBwkGA=="}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:13:15.234603 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-dbf1b55f-cab5-4350-8f27-e904c6682b55 tempest-TestVolumeBackupRestore-2071196610 tempest-TestVolumeBackupRestore-2071196610-project] Getting quotas for project ba71430f3dc046f68faab18103ba9007. Resources: {'key_pairs'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 21:13:15.243379 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-dbf1b55f-cab5-4350-8f27-e904c6682b55 tempest-TestVolumeBackupRestore-2071196610 tempest-TestVolumeBackupRestore-2071196610-project] Getting quotas for user cb4464172f8d43a986f7de04724a8d52 and project ba71430f3dc046f68faab18103ba9007. Resources: {'key_pairs'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 21:13:15.269717 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-dbf1b55f-cab5-4350-8f27-e904c6682b55 tempest-TestVolumeBackupRestore-2071196610 tempest-TestVolumeBackupRestore-2071196610-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.060100 Oct 22 21:13:15.270346 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2277/4567] 10.222.0.18 () {60 vars in 1159 bytes} [Sat Oct 22 21:13:15 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:13:15.319187 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-0150e60d-2a52-41d6-ad5e-6d036ce686aa tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:13:15.319187 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-0150e60d-2a52-41d6-ad5e-6d036ce686aa tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] [instance: ecbbbe88-8a1a-4480-b826-5ba23c6a4404] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:13:15.335882 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0150e60d-2a52-41d6-ad5e-6d036ce686aa tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:15.336389 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0150e60d-2a52-41d6-ad5e-6d036ce686aa tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:15.336828 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0150e60d-2a52-41d6-ad5e-6d036ce686aa tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:15.337763 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0150e60d-2a52-41d6-ad5e-6d036ce686aa tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:15.338785 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0150e60d-2a52-41d6-ad5e-6d036ce686aa tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:15.340259 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0150e60d-2a52-41d6-ad5e-6d036ce686aa tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:15.424891 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-a3ab54f8-1453-4016-88b2-ab6494044e5c tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:13:15.426786 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-a3ab54f8-1453-4016-88b2-ab6494044e5c tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] [instance: 34dcd1da-b94c-426b-b08b-204ea287c8a2] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:13:15.437819 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a3ab54f8-1453-4016-88b2-ab6494044e5c tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:15.439415 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a3ab54f8-1453-4016-88b2-ab6494044e5c tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:15.440658 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a3ab54f8-1453-4016-88b2-ab6494044e5c tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:15.441467 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a3ab54f8-1453-4016-88b2-ab6494044e5c tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:15.442583 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a3ab54f8-1453-4016-88b2-ab6494044e5c tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:15.443440 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a3ab54f8-1453-4016-88b2-ab6494044e5c tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:15.486790 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:13:15.605250 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-0150e60d-2a52-41d6-ad5e-6d036ce686aa tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799f987b3aa7426ba5d7a464052d6490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87474d4b4c547abbfe6308b6dd8e1c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:13:15.623636 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-0150e60d-2a52-41d6-ad5e-6d036ce686aa tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] 10.222.0.18 "GET /compute/v2.1/servers/ecbbbe88-8a1a-4480-b826-5ba23c6a4404" status: 200 len: 1293 microversion: 2.1 time: 0.310763 Oct 22 21:13:15.624300 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2291/4568] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:13:15 2022] GET /compute/v2.1/servers/ecbbbe88-8a1a-4480-b826-5ba23c6a4404 => generated 1293 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:13:15.665491 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-63c0c9f8-19a8-4d2a-b2a9-dabf63a51cd9 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:13:15.667647 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-63c0c9f8-19a8-4d2a-b2a9-dabf63a51cd9 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] [instance: 5c197028-ff9e-46ff-81f4-0feb4748da97] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:13:15.680794 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-63c0c9f8-19a8-4d2a-b2a9-dabf63a51cd9 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:15.684515 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-63c0c9f8-19a8-4d2a-b2a9-dabf63a51cd9 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:15.685609 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-63c0c9f8-19a8-4d2a-b2a9-dabf63a51cd9 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:15.687266 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-63c0c9f8-19a8-4d2a-b2a9-dabf63a51cd9 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:15.690136 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-63c0c9f8-19a8-4d2a-b2a9-dabf63a51cd9 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:15.694108 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-63c0c9f8-19a8-4d2a-b2a9-dabf63a51cd9 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:15.777561 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-a3ab54f8-1453-4016-88b2-ab6494044e5c tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:13:15.790162 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-a3ab54f8-1453-4016-88b2-ab6494044e5c tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:13:15.792398 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-a3ab54f8-1453-4016-88b2-ab6494044e5c tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:13:15.794507 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-a3ab54f8-1453-4016-88b2-ab6494044e5c tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] 10.222.0.18 "GET /compute/v2.1/servers/34dcd1da-b94c-426b-b08b-204ea287c8a2" status: 200 len: 1745 microversion: 2.20 time: 0.377986 Oct 22 21:13:15.825494 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2278/4569] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:13:15 2022] GET /compute/v2.1/servers/34dcd1da-b94c-426b-b08b-204ea287c8a2 => generated 1745 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:13:15.961797 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-63c0c9f8-19a8-4d2a-b2a9-dabf63a51cd9 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3820b31a424c3a9216a6ef91fcb285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a42c3ecf474883ac652fcc8c01c9f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:13:15.971046 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-63c0c9f8-19a8-4d2a-b2a9-dabf63a51cd9 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] 10.222.0.18 "GET /compute/v2.1/servers/5c197028-ff9e-46ff-81f4-0feb4748da97" status: 200 len: 1265 microversion: 2.1 time: 0.312721 Oct 22 21:13:15.973213 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2292/4570] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:13:15 2022] GET /compute/v2.1/servers/5c197028-ff9e-46ff-81f4-0feb4748da97 => generated 1265 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:13:16.661278 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-6065b378-5e2f-4305-8deb-7835279705b3 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:13:16.661966 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-6065b378-5e2f-4305-8deb-7835279705b3 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] [instance: ecbbbe88-8a1a-4480-b826-5ba23c6a4404] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:13:16.680294 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6065b378-5e2f-4305-8deb-7835279705b3 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:16.680787 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6065b378-5e2f-4305-8deb-7835279705b3 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:16.684842 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6065b378-5e2f-4305-8deb-7835279705b3 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:16.685618 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6065b378-5e2f-4305-8deb-7835279705b3 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:16.688908 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6065b378-5e2f-4305-8deb-7835279705b3 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:16.691206 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6065b378-5e2f-4305-8deb-7835279705b3 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:16.831409 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-9ab32c46-ba4a-4313-94e3-90e02d78a05e tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:13:16.833157 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-9ab32c46-ba4a-4313-94e3-90e02d78a05e tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] [instance: 34dcd1da-b94c-426b-b08b-204ea287c8a2] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:13:16.842691 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9ab32c46-ba4a-4313-94e3-90e02d78a05e tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:16.843422 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9ab32c46-ba4a-4313-94e3-90e02d78a05e tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:16.844435 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9ab32c46-ba4a-4313-94e3-90e02d78a05e tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:16.845762 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9ab32c46-ba4a-4313-94e3-90e02d78a05e tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:16.846340 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9ab32c46-ba4a-4313-94e3-90e02d78a05e tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:16.846844 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9ab32c46-ba4a-4313-94e3-90e02d78a05e tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:16.871908 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell1:SELECT=100 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:13:16.966303 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-6065b378-5e2f-4305-8deb-7835279705b3 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799f987b3aa7426ba5d7a464052d6490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87474d4b4c547abbfe6308b6dd8e1c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:13:16.978197 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-6065b378-5e2f-4305-8deb-7835279705b3 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] 10.222.0.18 "GET /compute/v2.1/servers/ecbbbe88-8a1a-4480-b826-5ba23c6a4404" status: 200 len: 1474 microversion: 2.1 time: 0.323537 Oct 22 21:13:16.990451 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2279/4571] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:13:16 2022] GET /compute/v2.1/servers/ecbbbe88-8a1a-4480-b826-5ba23c6a4404 => generated 1474 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:13:17.004374 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-7a6254d5-603c-4448-b501-49ecec640f69 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:13:17.016361 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-7a6254d5-603c-4448-b501-49ecec640f69 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] [instance: 5c197028-ff9e-46ff-81f4-0feb4748da97] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:13:17.034422 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7a6254d5-603c-4448-b501-49ecec640f69 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:17.037901 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7a6254d5-603c-4448-b501-49ecec640f69 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:17.038602 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7a6254d5-603c-4448-b501-49ecec640f69 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:17.042258 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7a6254d5-603c-4448-b501-49ecec640f69 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:17.043014 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7a6254d5-603c-4448-b501-49ecec640f69 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:17.046552 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7a6254d5-603c-4448-b501-49ecec640f69 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:17.114034 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-9ab32c46-ba4a-4313-94e3-90e02d78a05e tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:13:17.128421 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-9ab32c46-ba4a-4313-94e3-90e02d78a05e tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:13:17.129880 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-9ab32c46-ba4a-4313-94e3-90e02d78a05e tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:13:17.142295 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-9ab32c46-ba4a-4313-94e3-90e02d78a05e tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] 10.222.0.18 "GET /compute/v2.1/servers/34dcd1da-b94c-426b-b08b-204ea287c8a2" status: 200 len: 1740 microversion: 2.20 time: 0.315219 Oct 22 21:13:17.144113 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2293/4572] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:13:16 2022] GET /compute/v2.1/servers/34dcd1da-b94c-426b-b08b-204ea287c8a2 => generated 1740 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:13:17.189276 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-ef134ac3-d4a3-41da-8738-47373b174408 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1740143898", "imageRef": "085e4478-6edc-4a69-8e08-f9831713eb65", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:13:17.295587 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.network.neutron [None req-ef134ac3-d4a3-41da-8738-47373b174408 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] validate_networks() for [('ea7e3c31-2bc2-4b4f-ab48-7d75cccdd3b0', None, None, None, None, None)] {{(pid=138745) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 21:13:17.509035 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-7a6254d5-603c-4448-b501-49ecec640f69 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3820b31a424c3a9216a6ef91fcb285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a42c3ecf474883ac652fcc8c01c9f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:13:17.518899 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-7a6254d5-603c-4448-b501-49ecec640f69 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] 10.222.0.18 "GET /compute/v2.1/servers/5c197028-ff9e-46ff-81f4-0feb4748da97" status: 200 len: 1265 microversion: 2.1 time: 0.519494 Oct 22 21:13:17.519746 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2280/4573] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:13:16 2022] GET /compute/v2.1/servers/5c197028-ff9e-46ff-81f4-0feb4748da97 => generated 1265 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:13:17.524644 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-08043a15-be8a-4d91-a342-358a9b570559 req-6ce29ffc-d81f-44da-9d1e-2f42be73285d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c197028-ff9e-46ff-81f4-0feb4748da97", "name": "network-vif-plugged", "status": "completed", "tag": "c5e164ee-0bd2-495e-9036-a2f07d700b5e"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:13:17.535965 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-08043a15-be8a-4d91-a342-358a9b570559 req-6ce29ffc-d81f-44da-9d1e-2f42be73285d service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:17.536754 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-08043a15-be8a-4d91-a342-358a9b570559 req-6ce29ffc-d81f-44da-9d1e-2f42be73285d service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:17.537398 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-08043a15-be8a-4d91-a342-358a9b570559 req-6ce29ffc-d81f-44da-9d1e-2f42be73285d service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:17.553067 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-08043a15-be8a-4d91-a342-358a9b570559 req-6ce29ffc-d81f-44da-9d1e-2f42be73285d service nova] Creating event network-vif-plugged:c5e164ee-0bd2-495e-9036-a2f07d700b5e for instance 5c197028-ff9e-46ff-81f4-0feb4748da97 on nch1-master-1 Oct 22 21:13:17.562658 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-08043a15-be8a-4d91-a342-358a9b570559 req-6ce29ffc-d81f-44da-9d1e-2f42be73285d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041008 Oct 22 21:13:17.567911 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2281/4574] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:13:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:13:17.585062 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-c240def6-5699-4100-b8e4-b2b5e619f68c tempest-TestVolumeBackupRestore-2071196610 tempest-TestVolumeBackupRestore-2071196610-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBackupRestore-server-964881880", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "4678044e-7418-4ed6-afa9-88f7a689bd0c", "source_type": "volume", "destination_type": "volume", "boot_index": 0}], "key_name": "tempest-TestVolumeBackupRestore-1818971266", "security_groups": [{"name": "tempest-secgroup-smoke-809421367"}], "networks": [{"uuid": "c36a7735-da20-41d8-b8d5-d76c657d0857"}]}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:13:18.136737 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.network.neutron [None req-c240def6-5699-4100-b8e4-b2b5e619f68c tempest-TestVolumeBackupRestore-2071196610 tempest-TestVolumeBackupRestore-2071196610-project] validate_networks() for [('c36a7735-da20-41d8-b8d5-d76c657d0857', None, None, None, None, None)] {{(pid=138744) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 21:13:18.665032 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-ef134ac3-d4a3-41da-8738-47373b174408 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Flavor limits 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 21:13:18.665676 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-ef134ac3-d4a3-41da-8738-47373b174408 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Image limits 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 21:13:18.665957 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-ef134ac3-d4a3-41da-8738-47373b174408 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Flavor pref 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 21:13:18.666426 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-ef134ac3-d4a3-41da-8738-47373b174408 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Image pref 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 21:13:18.666862 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-ef134ac3-d4a3-41da-8738-47373b174408 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 21:13:18.681276 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ef134ac3-d4a3-41da-8738-47373b174408 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:18.686572 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ef134ac3-d4a3-41da-8738-47373b174408 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:18.687293 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ef134ac3-d4a3-41da-8738-47373b174408 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:18.688400 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ef134ac3-d4a3-41da-8738-47373b174408 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:18.689190 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ef134ac3-d4a3-41da-8738-47373b174408 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:18.689821 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ef134ac3-d4a3-41da-8738-47373b174408 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:18.712417 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-ef134ac3-d4a3-41da-8738-47373b174408 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Getting quotas for project e87474d4b4c547abbfe6308b6dd8e1c8. Resources: {'cores', 'instances', 'ram'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 21:13:18.718850 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-ef134ac3-d4a3-41da-8738-47373b174408 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Getting quotas for user 799f987b3aa7426ba5d7a464052d6490 and project e87474d4b4c547abbfe6308b6dd8e1c8. Resources: {'cores', 'instances', 'ram'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 21:13:18.734395 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-ef134ac3-d4a3-41da-8738-47373b174408 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Going to run 1 instances... {{(pid=138745) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 21:13:18.738829 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-ef134ac3-d4a3-41da-8738-47373b174408 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] [instance: 05f873ef-847a-4c86-9009-ca367cc7ac67] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='085e4478-6edc-4a69-8e08-f9831713eb65',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138745) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 21:13:18.802284 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-ef134ac3-d4a3-41da-8738-47373b174408 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.623172 Oct 22 21:13:18.804137 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2294/4575] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Oct 22 21:13:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 1625 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 21:13:18.810493 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-0961daaf-9a3a-4b80-b2b3-f46a68f6a62d tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:13:18.811419 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-0961daaf-9a3a-4b80-b2b3-f46a68f6a62d tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] [instance: 34dcd1da-b94c-426b-b08b-204ea287c8a2] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:13:18.821109 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0961daaf-9a3a-4b80-b2b3-f46a68f6a62d tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:18.822052 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0961daaf-9a3a-4b80-b2b3-f46a68f6a62d tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:18.823123 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0961daaf-9a3a-4b80-b2b3-f46a68f6a62d tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:18.824178 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0961daaf-9a3a-4b80-b2b3-f46a68f6a62d tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:18.825288 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0961daaf-9a3a-4b80-b2b3-f46a68f6a62d tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:18.826025 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0961daaf-9a3a-4b80-b2b3-f46a68f6a62d tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:19.223394 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-0961daaf-9a3a-4b80-b2b3-f46a68f6a62d tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:13:19.252819 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-0961daaf-9a3a-4b80-b2b3-f46a68f6a62d tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:13:19.255248 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-0961daaf-9a3a-4b80-b2b3-f46a68f6a62d tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:13:19.262017 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-0961daaf-9a3a-4b80-b2b3-f46a68f6a62d tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] 10.222.0.18 "GET /compute/v2.1/servers/34dcd1da-b94c-426b-b08b-204ea287c8a2" status: 200 len: 1740 microversion: 2.20 time: 0.454470 Oct 22 21:13:19.264209 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2295/4576] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:13:18 2022] GET /compute/v2.1/servers/34dcd1da-b94c-426b-b08b-204ea287c8a2 => generated 1740 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:13:19.273259 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-fa1f704b-d785-4a21-9fcc-f0ff2b048a14 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:13:19.276188 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-fa1f704b-d785-4a21-9fcc-f0ff2b048a14 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] [instance: 5c197028-ff9e-46ff-81f4-0feb4748da97] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:13:19.296471 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fa1f704b-d785-4a21-9fcc-f0ff2b048a14 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:19.297378 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fa1f704b-d785-4a21-9fcc-f0ff2b048a14 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:19.298345 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fa1f704b-d785-4a21-9fcc-f0ff2b048a14 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:19.299402 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fa1f704b-d785-4a21-9fcc-f0ff2b048a14 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:19.300014 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fa1f704b-d785-4a21-9fcc-f0ff2b048a14 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:19.301014 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fa1f704b-d785-4a21-9fcc-f0ff2b048a14 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:19.303115 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-c240def6-5699-4100-b8e4-b2b5e619f68c tempest-TestVolumeBackupRestore-2071196610 tempest-TestVolumeBackupRestore-2071196610-project] Flavor limits 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 21:13:19.303675 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-c240def6-5699-4100-b8e4-b2b5e619f68c tempest-TestVolumeBackupRestore-2071196610 tempest-TestVolumeBackupRestore-2071196610-project] Image limits 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 21:13:19.304398 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-c240def6-5699-4100-b8e4-b2b5e619f68c tempest-TestVolumeBackupRestore-2071196610 tempest-TestVolumeBackupRestore-2071196610-project] Flavor pref 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 21:13:19.305011 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-c240def6-5699-4100-b8e4-b2b5e619f68c tempest-TestVolumeBackupRestore-2071196610 tempest-TestVolumeBackupRestore-2071196610-project] Image pref 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 21:13:19.305677 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-c240def6-5699-4100-b8e4-b2b5e619f68c tempest-TestVolumeBackupRestore-2071196610 tempest-TestVolumeBackupRestore-2071196610-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 21:13:19.398731 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c240def6-5699-4100-b8e4-b2b5e619f68c tempest-TestVolumeBackupRestore-2071196610 tempest-TestVolumeBackupRestore-2071196610-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:19.400070 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c240def6-5699-4100-b8e4-b2b5e619f68c tempest-TestVolumeBackupRestore-2071196610 tempest-TestVolumeBackupRestore-2071196610-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:19.401232 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c240def6-5699-4100-b8e4-b2b5e619f68c tempest-TestVolumeBackupRestore-2071196610 tempest-TestVolumeBackupRestore-2071196610-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:19.405222 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c240def6-5699-4100-b8e4-b2b5e619f68c tempest-TestVolumeBackupRestore-2071196610 tempest-TestVolumeBackupRestore-2071196610-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:19.406041 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c240def6-5699-4100-b8e4-b2b5e619f68c tempest-TestVolumeBackupRestore-2071196610 tempest-TestVolumeBackupRestore-2071196610-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:19.410274 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c240def6-5699-4100-b8e4-b2b5e619f68c tempest-TestVolumeBackupRestore-2071196610 tempest-TestVolumeBackupRestore-2071196610-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:19.470321 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-fa1f704b-d785-4a21-9fcc-f0ff2b048a14 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3820b31a424c3a9216a6ef91fcb285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a42c3ecf474883ac652fcc8c01c9f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:13:19.481211 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-fa1f704b-d785-4a21-9fcc-f0ff2b048a14 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] 10.222.0.18 "GET /compute/v2.1/servers/5c197028-ff9e-46ff-81f4-0feb4748da97" status: 200 len: 1265 microversion: 2.1 time: 0.213388 Oct 22 21:13:19.482464 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2296/4577] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:13:19 2022] GET /compute/v2.1/servers/5c197028-ff9e-46ff-81f4-0feb4748da97 => generated 1265 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:13:19.487861 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-ac43e293-dc4f-4cbb-be12-7a743234072a tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:13:19.488366 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-ac43e293-dc4f-4cbb-be12-7a743234072a tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] [instance: 05f873ef-847a-4c86-9009-ca367cc7ac67] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:13:19.507498 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-c240def6-5699-4100-b8e4-b2b5e619f68c tempest-TestVolumeBackupRestore-2071196610 tempest-TestVolumeBackupRestore-2071196610-project] Getting quotas for project ba71430f3dc046f68faab18103ba9007. Resources: {'cores', 'instances', 'ram'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 21:13:19.509930 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-ac43e293-dc4f-4cbb-be12-7a743234072a tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] [instance: 05f873ef-847a-4c86-9009-ca367cc7ac67] Going to try to terminate instance {{(pid=138745) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 21:13:19.522328 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-c240def6-5699-4100-b8e4-b2b5e619f68c tempest-TestVolumeBackupRestore-2071196610 tempest-TestVolumeBackupRestore-2071196610-project] Getting quotas for user cb4464172f8d43a986f7de04724a8d52 and project ba71430f3dc046f68faab18103ba9007. Resources: {'cores', 'instances', 'ram'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 21:13:19.526400 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=9,nova_api:DELETE=1 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:13:19.701688 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-c240def6-5699-4100-b8e4-b2b5e619f68c tempest-TestVolumeBackupRestore-2071196610 tempest-TestVolumeBackupRestore-2071196610-project] Going to run 1 instances... {{(pid=138744) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 21:13:19.704304 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-c240def6-5699-4100-b8e4-b2b5e619f68c tempest-TestVolumeBackupRestore-2071196610 tempest-TestVolumeBackupRestore-2071196610-project] [instance: 77705065-40b2-4fba-8cf9-def4abeae0e4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='4678044e-7418-4ed6-afa9-88f7a689bd0c',volume_size=None,volume_type=None)] {{(pid=138744) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 21:13:20.003874 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-c240def6-5699-4100-b8e4-b2b5e619f68c tempest-TestVolumeBackupRestore-2071196610 tempest-TestVolumeBackupRestore-2071196610-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.433485 Oct 22 21:13:20.014588 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2282/4578] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Oct 22 21:13:17 2022] POST /compute/v2.1/servers => generated 405 bytes in 2446 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 21:13:20.020719 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-bcd33fc3-ad88-4959-bfe5-f46f19bb009e req-4793c9a3-d83b-4997-9855-17233255a27c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34dcd1da-b94c-426b-b08b-204ea287c8a2", "name": "network-vif-plugged", "status": "completed", "tag": "692705ac-81f3-4f8a-bfa8-a2581d7d7567"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:13:20.038934 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-bcd33fc3-ad88-4959-bfe5-f46f19bb009e req-4793c9a3-d83b-4997-9855-17233255a27c service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:20.039718 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-bcd33fc3-ad88-4959-bfe5-f46f19bb009e req-4793c9a3-d83b-4997-9855-17233255a27c service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:20.044685 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-bcd33fc3-ad88-4959-bfe5-f46f19bb009e req-4793c9a3-d83b-4997-9855-17233255a27c service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:20.070481 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-bcd33fc3-ad88-4959-bfe5-f46f19bb009e req-4793c9a3-d83b-4997-9855-17233255a27c service nova] Creating event network-vif-plugged:692705ac-81f3-4f8a-bfa8-a2581d7d7567 for instance 34dcd1da-b94c-426b-b08b-204ea287c8a2 on nch2-master-1 Oct 22 21:13:20.081686 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-bcd33fc3-ad88-4959-bfe5-f46f19bb009e req-4793c9a3-d83b-4997-9855-17233255a27c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061892 Oct 22 21:13:20.082712 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2283/4579] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:13:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:13:20.092139 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-517a316b-c8d7-4453-b192-4b6db2575ccb tempest-TestVolumeBackupRestore-2071196610 tempest-TestVolumeBackupRestore-2071196610-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:13:20.092859 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-517a316b-c8d7-4453-b192-4b6db2575ccb tempest-TestVolumeBackupRestore-2071196610 tempest-TestVolumeBackupRestore-2071196610-project] [instance: 77705065-40b2-4fba-8cf9-def4abeae0e4] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:13:20.144901 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.scheduler.client.report [None req-ac43e293-dc4f-4cbb-be12-7a743234072a tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Deleted allocations for instance 05f873ef-847a-4c86-9009-ca367cc7ac67 Oct 22 21:13:20.196364 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-ac43e293-dc4f-4cbb-be12-7a743234072a tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] 10.222.0.18 "DELETE /compute/v2.1/servers/05f873ef-847a-4c86-9009-ca367cc7ac67" status: 204 len: 0 microversion: 2.1 time: 0.712538 Oct 22 21:13:20.197511 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2297/4580] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 21:13:19 2022] DELETE /compute/v2.1/servers/05f873ef-847a-4c86-9009-ca367cc7ac67 => generated 0 bytes in 714 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 21:13:20.207681 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-ee2c9d9f-61be-4b98-a4c0-8e571b11911e tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:13:20.208341 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-ee2c9d9f-61be-4b98-a4c0-8e571b11911e tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] [instance: 05f873ef-847a-4c86-9009-ca367cc7ac67] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:13:20.211626 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-517a316b-c8d7-4453-b192-4b6db2575ccb tempest-TestVolumeBackupRestore-2071196610 tempest-TestVolumeBackupRestore-2071196610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4464172f8d43a986f7de04724a8d52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba71430f3dc046f68faab18103ba9007', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:13:20.221092 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ee2c9d9f-61be-4b98-a4c0-8e571b11911e tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:20.222524 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-517a316b-c8d7-4453-b192-4b6db2575ccb tempest-TestVolumeBackupRestore-2071196610 tempest-TestVolumeBackupRestore-2071196610-project] 10.222.0.18 "GET /compute/v2.1/servers/77705065-40b2-4fba-8cf9-def4abeae0e4" status: 200 len: 1098 microversion: 2.1 time: 0.134897 Oct 22 21:13:20.223113 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2284/4581] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:13:20 2022] GET /compute/v2.1/servers/77705065-40b2-4fba-8cf9-def4abeae0e4 => generated 1098 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:13:20.235733 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ee2c9d9f-61be-4b98-a4c0-8e571b11911e tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:20.235733 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ee2c9d9f-61be-4b98-a4c0-8e571b11911e tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:20.235733 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ee2c9d9f-61be-4b98-a4c0-8e571b11911e tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:20.235733 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ee2c9d9f-61be-4b98-a4c0-8e571b11911e tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:20.235733 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ee2c9d9f-61be-4b98-a4c0-8e571b11911e tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:20.293122 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-e6ac0676-447c-4e31-89a0-562c96b5b873 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:13:20.293842 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-e6ac0676-447c-4e31-89a0-562c96b5b873 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] [instance: 34dcd1da-b94c-426b-b08b-204ea287c8a2] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:13:20.309076 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e6ac0676-447c-4e31-89a0-562c96b5b873 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:20.309976 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e6ac0676-447c-4e31-89a0-562c96b5b873 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:20.310580 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e6ac0676-447c-4e31-89a0-562c96b5b873 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:20.312453 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e6ac0676-447c-4e31-89a0-562c96b5b873 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:20.313271 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e6ac0676-447c-4e31-89a0-562c96b5b873 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:20.314390 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e6ac0676-447c-4e31-89a0-562c96b5b873 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:20.366590 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-ee2c9d9f-61be-4b98-a4c0-8e571b11911e tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799f987b3aa7426ba5d7a464052d6490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87474d4b4c547abbfe6308b6dd8e1c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:13:20.380505 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-ee2c9d9f-61be-4b98-a4c0-8e571b11911e tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] 10.222.0.18 "GET /compute/v2.1/servers/05f873ef-847a-4c86-9009-ca367cc7ac67" status: 200 len: 1213 microversion: 2.1 time: 0.177968 Oct 22 21:13:20.381180 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2298/4582] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:13:20 2022] GET /compute/v2.1/servers/05f873ef-847a-4c86-9009-ca367cc7ac67 => generated 1213 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:13:20.508522 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-7997638a-ad10-458f-9ae7-fd485fabc6eb tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:13:20.509563 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-7997638a-ad10-458f-9ae7-fd485fabc6eb tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] [instance: 5c197028-ff9e-46ff-81f4-0feb4748da97] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:13:20.513798 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-e6ac0676-447c-4e31-89a0-562c96b5b873 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:13:20.524565 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-e6ac0676-447c-4e31-89a0-562c96b5b873 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:13:20.527502 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-e6ac0676-447c-4e31-89a0-562c96b5b873 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:13:20.529442 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-e6ac0676-447c-4e31-89a0-562c96b5b873 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] 10.222.0.18 "GET /compute/v2.1/servers/34dcd1da-b94c-426b-b08b-204ea287c8a2" status: 200 len: 1740 microversion: 2.20 time: 0.240952 Oct 22 21:13:20.534110 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7997638a-ad10-458f-9ae7-fd485fabc6eb tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:20.538626 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7997638a-ad10-458f-9ae7-fd485fabc6eb tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:20.543980 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7997638a-ad10-458f-9ae7-fd485fabc6eb tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:20.543980 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7997638a-ad10-458f-9ae7-fd485fabc6eb tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:20.543980 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7997638a-ad10-458f-9ae7-fd485fabc6eb tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:20.544825 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2285/4583] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:13:20 2022] GET /compute/v2.1/servers/34dcd1da-b94c-426b-b08b-204ea287c8a2 => generated 1740 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 22 21:13:20.547646 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7997638a-ad10-458f-9ae7-fd485fabc6eb tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:20.899623 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-7997638a-ad10-458f-9ae7-fd485fabc6eb tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3820b31a424c3a9216a6ef91fcb285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a42c3ecf474883ac652fcc8c01c9f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:13:20.919790 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-7997638a-ad10-458f-9ae7-fd485fabc6eb tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] 10.222.0.18 "GET /compute/v2.1/servers/5c197028-ff9e-46ff-81f4-0feb4748da97" status: 200 len: 1452 microversion: 2.1 time: 0.418000 Oct 22 21:13:20.929402 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2299/4584] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:13:20 2022] GET /compute/v2.1/servers/5c197028-ff9e-46ff-81f4-0feb4748da97 => generated 1452 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:13:20.955787 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-5c4d5fd8-760e-44cc-b910-41423daf99ef tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:13:20.956699 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-5c4d5fd8-760e-44cc-b910-41423daf99ef tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] [instance: 5c197028-ff9e-46ff-81f4-0feb4748da97] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:13:20.966758 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5c4d5fd8-760e-44cc-b910-41423daf99ef tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:20.971959 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5c4d5fd8-760e-44cc-b910-41423daf99ef tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:20.972684 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5c4d5fd8-760e-44cc-b910-41423daf99ef tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:20.974153 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5c4d5fd8-760e-44cc-b910-41423daf99ef tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:20.974706 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5c4d5fd8-760e-44cc-b910-41423daf99ef tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:20.979319 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5c4d5fd8-760e-44cc-b910-41423daf99ef tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:21.223099 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-5c4d5fd8-760e-44cc-b910-41423daf99ef tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3820b31a424c3a9216a6ef91fcb285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a42c3ecf474883ac652fcc8c01c9f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:13:21.234630 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-5c4d5fd8-760e-44cc-b910-41423daf99ef tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] 10.222.0.18 "GET /compute/v2.1/servers/5c197028-ff9e-46ff-81f4-0feb4748da97" status: 200 len: 1452 microversion: 2.1 time: 0.282961 Oct 22 21:13:21.235825 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2286/4585] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:13:20 2022] GET /compute/v2.1/servers/5c197028-ff9e-46ff-81f4-0feb4748da97 => generated 1452 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:13:21.265016 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-52248f2b-54a9-4d3a-bc59-6f5263a69f42 tempest-TestVolumeBackupRestore-2071196610 tempest-TestVolumeBackupRestore-2071196610-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:13:21.266368 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-52248f2b-54a9-4d3a-bc59-6f5263a69f42 tempest-TestVolumeBackupRestore-2071196610 tempest-TestVolumeBackupRestore-2071196610-project] [instance: 77705065-40b2-4fba-8cf9-def4abeae0e4] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:13:21.287822 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-52248f2b-54a9-4d3a-bc59-6f5263a69f42 tempest-TestVolumeBackupRestore-2071196610 tempest-TestVolumeBackupRestore-2071196610-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:21.290648 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-52248f2b-54a9-4d3a-bc59-6f5263a69f42 tempest-TestVolumeBackupRestore-2071196610 tempest-TestVolumeBackupRestore-2071196610-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:21.291151 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-52248f2b-54a9-4d3a-bc59-6f5263a69f42 tempest-TestVolumeBackupRestore-2071196610 tempest-TestVolumeBackupRestore-2071196610-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:21.294892 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-52248f2b-54a9-4d3a-bc59-6f5263a69f42 tempest-TestVolumeBackupRestore-2071196610 tempest-TestVolumeBackupRestore-2071196610-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:21.297153 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-52248f2b-54a9-4d3a-bc59-6f5263a69f42 tempest-TestVolumeBackupRestore-2071196610 tempest-TestVolumeBackupRestore-2071196610-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:21.299456 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-52248f2b-54a9-4d3a-bc59-6f5263a69f42 tempest-TestVolumeBackupRestore-2071196610 tempest-TestVolumeBackupRestore-2071196610-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:21.406854 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-04e05ca0-458f-4fdb-829b-6bb8764345c7 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:13:21.407542 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-04e05ca0-458f-4fdb-829b-6bb8764345c7 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] [instance: 05f873ef-847a-4c86-9009-ca367cc7ac67] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:13:21.417585 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-04e05ca0-458f-4fdb-829b-6bb8764345c7 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:21.418188 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-04e05ca0-458f-4fdb-829b-6bb8764345c7 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:21.421298 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-04e05ca0-458f-4fdb-829b-6bb8764345c7 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:21.422155 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-04e05ca0-458f-4fdb-829b-6bb8764345c7 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:21.423902 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-04e05ca0-458f-4fdb-829b-6bb8764345c7 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:21.424480 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-04e05ca0-458f-4fdb-829b-6bb8764345c7 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:21.435907 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-52248f2b-54a9-4d3a-bc59-6f5263a69f42 tempest-TestVolumeBackupRestore-2071196610 tempest-TestVolumeBackupRestore-2071196610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4464172f8d43a986f7de04724a8d52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba71430f3dc046f68faab18103ba9007', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:13:21.448865 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-52248f2b-54a9-4d3a-bc59-6f5263a69f42 tempest-TestVolumeBackupRestore-2071196610 tempest-TestVolumeBackupRestore-2071196610-project] 10.222.0.18 "GET /compute/v2.1/servers/77705065-40b2-4fba-8cf9-def4abeae0e4" status: 200 len: 1196 microversion: 2.1 time: 0.189966 Oct 22 21:13:21.451936 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2300/4586] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:13:21 2022] GET /compute/v2.1/servers/77705065-40b2-4fba-8cf9-def4abeae0e4 => generated 1196 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:13:21.464298 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-04e05ca0-458f-4fdb-829b-6bb8764345c7 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] HTTP exception thrown: Instance 05f873ef-847a-4c86-9009-ca367cc7ac67 could not be found. Oct 22 21:13:21.467694 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-04e05ca0-458f-4fdb-829b-6bb8764345c7 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Request method failure captured: Oct 22 21:13:21.467694 ncdv-master-1 devstack@n-api.service[138744]: request: GET /compute/v2.1/servers/05f873ef-847a-4c86-9009-ca367cc7ac67 HTTP/1.1 Oct 22 21:13:21.467694 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 21:13:21.467694 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 21:13:21.467694 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 21:13:21.467694 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 0 Oct 22 21:13:21.467694 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 21:13:21.467694 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 21:13:21.467694 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 21:13:21.467694 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 21:13:21.467694 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVFzbjFuxlabhGO5W5IN5r54yzIxFa_mX4J74OzfXM08pyPGfws2Ww4pm5qGKXFC4h2Ttyt1JiFfrSI-ucQt7MPAhDqF8_tQs5Z1aGjJkE87trFhYgYaJFSihYuRhX8jAUHeeDuqMpE3BFEYcIHoIoAbD2BZHLThVUs-wQCfowY_4sFQ Oct 22 21:13:21.467694 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 21:13:21.467694 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 21:13:21.467694 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 21:13:21.467694 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 21:13:21.467694 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 21:13:21.467694 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 21:13:21.467694 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: e87474d4b4c547abbfe6308b6dd8e1c8 Oct 22 21:13:21.467694 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-ServersTestJSON-2007137082 Oct 22 21:13:21.467694 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 21:13:21.467694 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 21:13:21.467694 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_e87474d4b4c547abbfe6308b6dd8e1c8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e87474d4b4c547abbfe6308b6dd8e1c8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/e87474d4b4c547abbfe6308b6dd8e1c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e87474d4b4c547abbfe6308b6dd8e1c8"}]}] Oct 22 21:13:21.467694 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-ServersTestJSON-2007137082 Oct 22 21:13:21.467694 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: e87474d4b4c547abbfe6308b6dd8e1c8 Oct 22 21:13:21.467694 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-ServersTestJSON-2007137082 Oct 22 21:13:21.467694 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-ServersTestJSON-2007137082-project Oct 22 21:13:21.467694 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 21:13:21.467694 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 21:13:21.467694 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: 799f987b3aa7426ba5d7a464052d6490 Oct 22 21:13:21.467694 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-ServersTestJSON-2007137082-project Oct 22 21:13:21.467694 ncdv-master-1 devstack@n-api.service[138744]: method: > Oct 22 21:13:21.467694 ncdv-master-1 devstack@n-api.service[138744]: exception: Instance 05f873ef-847a-4c86-9009-ca367cc7ac67 could not be found. Oct 22 21:13:21.467694 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': '05f873ef-847a-4c86-9009-ca367cc7ac67'} Oct 22 21:13:21.467694 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:13:21.467694 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:13:21.467694 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 21:13:21.467694 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 21:13:21.467694 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 21:13:21.467694 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 21:13:21.467694 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 21:13:21.467694 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 21:13:21.467694 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 21:13:21.467694 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 21:13:21.467694 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 05f873ef-847a-4c86-9009-ca367cc7ac67 could not be found. Oct 22 21:13:21.467694 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:13:21.467694 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:13:21.467694 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:13:21.467694 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:13:21.467694 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:13:21.467694 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:13:21.467694 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:13:21.467694 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:13:21.467694 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:13:21.467694 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:13:21.467694 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 21:13:21.467694 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 21:13:21.467694 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 21:13:21.467694 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 21:13:21.467694 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 21:13:21.467694 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:13:21.467694 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 05f873ef-847a-4c86-9009-ca367cc7ac67 could not be found. Oct 22 21:13:21.467694 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:13:21.467694 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:13:21.467694 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:13:21.472470 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:13:21.472470 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:13:21.472470 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:13:21.472470 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:13:21.472470 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:13:21.472470 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 05f873ef-847a-4c86-9009-ca367cc7ac67 could not be found. Oct 22 21:13:21.472470 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:13:21.476500 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-04e05ca0-458f-4fdb-829b-6bb8764345c7 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Returning 404 to user: Instance 05f873ef-847a-4c86-9009-ca367cc7ac67 could not be found. {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:13:21.477736 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-04e05ca0-458f-4fdb-829b-6bb8764345c7 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] 10.222.0.18 "GET /compute/v2.1/servers/05f873ef-847a-4c86-9009-ca367cc7ac67" status: 404 len: 111 microversion: 2.1 time: 0.075243 Oct 22 21:13:21.479690 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2287/4587] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:13:21 2022] GET /compute/v2.1/servers/05f873ef-847a-4c86-9009-ca367cc7ac67 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 22 21:13:21.560688 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-588c2a4f-fa6a-42c6-bc0b-dd7218ce38f6 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:13:21.561750 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-588c2a4f-fa6a-42c6-bc0b-dd7218ce38f6 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] [instance: 34dcd1da-b94c-426b-b08b-204ea287c8a2] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:13:21.570324 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-588c2a4f-fa6a-42c6-bc0b-dd7218ce38f6 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:21.571442 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-588c2a4f-fa6a-42c6-bc0b-dd7218ce38f6 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:21.572200 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-588c2a4f-fa6a-42c6-bc0b-dd7218ce38f6 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:21.573180 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-588c2a4f-fa6a-42c6-bc0b-dd7218ce38f6 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:21.574358 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-588c2a4f-fa6a-42c6-bc0b-dd7218ce38f6 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:21.576053 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-588c2a4f-fa6a-42c6-bc0b-dd7218ce38f6 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:21.849453 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-588c2a4f-fa6a-42c6-bc0b-dd7218ce38f6 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:13:21.857727 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-4135852a-6b78-451f-bf67-80a4b7583489 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1091605067", "imageRef": "085e4478-6edc-4a69-8e08-f9831713eb65", "flavorRef": "452", "accessIPv6": "2001:2001::3", "networks": [{"uuid": "ea7e3c31-2bc2-4b4f-ab48-7d75cccdd3b0"}]}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:13:21.870796 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-588c2a4f-fa6a-42c6-bc0b-dd7218ce38f6 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:13:21.873828 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-588c2a4f-fa6a-42c6-bc0b-dd7218ce38f6 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:13:21.875651 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-588c2a4f-fa6a-42c6-bc0b-dd7218ce38f6 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] 10.222.0.18 "GET /compute/v2.1/servers/34dcd1da-b94c-426b-b08b-204ea287c8a2" status: 200 len: 1740 microversion: 2.20 time: 0.323931 Oct 22 21:13:21.876680 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2301/4588] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:13:21 2022] GET /compute/v2.1/servers/34dcd1da-b94c-426b-b08b-204ea287c8a2 => generated 1740 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:13:22.008823 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.network.neutron [None req-4135852a-6b78-451f-bf67-80a4b7583489 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] validate_networks() for [('ea7e3c31-2bc2-4b4f-ab48-7d75cccdd3b0', None, None, None, None, None)] {{(pid=138744) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 21:13:22.475466 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-688e16cb-4bf3-4f6e-b12a-7206948c2051 tempest-TestVolumeBackupRestore-2071196610 tempest-TestVolumeBackupRestore-2071196610-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:13:22.476435 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-688e16cb-4bf3-4f6e-b12a-7206948c2051 tempest-TestVolumeBackupRestore-2071196610 tempest-TestVolumeBackupRestore-2071196610-project] [instance: 77705065-40b2-4fba-8cf9-def4abeae0e4] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:13:22.491308 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-688e16cb-4bf3-4f6e-b12a-7206948c2051 tempest-TestVolumeBackupRestore-2071196610 tempest-TestVolumeBackupRestore-2071196610-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:22.491961 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-688e16cb-4bf3-4f6e-b12a-7206948c2051 tempest-TestVolumeBackupRestore-2071196610 tempest-TestVolumeBackupRestore-2071196610-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:22.495622 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-688e16cb-4bf3-4f6e-b12a-7206948c2051 tempest-TestVolumeBackupRestore-2071196610 tempest-TestVolumeBackupRestore-2071196610-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:22.497268 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-688e16cb-4bf3-4f6e-b12a-7206948c2051 tempest-TestVolumeBackupRestore-2071196610 tempest-TestVolumeBackupRestore-2071196610-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:22.498534 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-688e16cb-4bf3-4f6e-b12a-7206948c2051 tempest-TestVolumeBackupRestore-2071196610 tempest-TestVolumeBackupRestore-2071196610-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:22.499235 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-688e16cb-4bf3-4f6e-b12a-7206948c2051 tempest-TestVolumeBackupRestore-2071196610 tempest-TestVolumeBackupRestore-2071196610-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:22.789727 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-688e16cb-4bf3-4f6e-b12a-7206948c2051 tempest-TestVolumeBackupRestore-2071196610 tempest-TestVolumeBackupRestore-2071196610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4464172f8d43a986f7de04724a8d52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba71430f3dc046f68faab18103ba9007', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:13:22.806258 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-688e16cb-4bf3-4f6e-b12a-7206948c2051 tempest-TestVolumeBackupRestore-2071196610 tempest-TestVolumeBackupRestore-2071196610-project] 10.222.0.18 "GET /compute/v2.1/servers/77705065-40b2-4fba-8cf9-def4abeae0e4" status: 200 len: 1214 microversion: 2.1 time: 0.335816 Oct 22 21:13:22.833244 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2302/4589] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:13:22 2022] GET /compute/v2.1/servers/77705065-40b2-4fba-8cf9-def4abeae0e4 => generated 1214 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:13:22.904175 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-d78e46b9-36b5-4af4-965a-49cd961029c2 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:13:22.904821 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-d78e46b9-36b5-4af4-965a-49cd961029c2 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] [instance: 34dcd1da-b94c-426b-b08b-204ea287c8a2] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:13:22.933484 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d78e46b9-36b5-4af4-965a-49cd961029c2 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:22.934149 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d78e46b9-36b5-4af4-965a-49cd961029c2 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:22.942228 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d78e46b9-36b5-4af4-965a-49cd961029c2 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:22.943643 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d78e46b9-36b5-4af4-965a-49cd961029c2 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:22.946470 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d78e46b9-36b5-4af4-965a-49cd961029c2 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:22.951470 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d78e46b9-36b5-4af4-965a-49cd961029c2 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:23.373931 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-4135852a-6b78-451f-bf67-80a4b7583489 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Flavor limits 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 21:13:23.374533 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-4135852a-6b78-451f-bf67-80a4b7583489 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Image limits 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 21:13:23.375110 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-4135852a-6b78-451f-bf67-80a4b7583489 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Flavor pref 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 21:13:23.375844 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-4135852a-6b78-451f-bf67-80a4b7583489 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Image pref 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 21:13:23.376633 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-4135852a-6b78-451f-bf67-80a4b7583489 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 21:13:23.404758 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4135852a-6b78-451f-bf67-80a4b7583489 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:23.413800 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4135852a-6b78-451f-bf67-80a4b7583489 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:23.415817 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4135852a-6b78-451f-bf67-80a4b7583489 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:23.417240 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4135852a-6b78-451f-bf67-80a4b7583489 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:23.432277 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4135852a-6b78-451f-bf67-80a4b7583489 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:23.433069 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4135852a-6b78-451f-bf67-80a4b7583489 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:23.466765 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-d78e46b9-36b5-4af4-965a-49cd961029c2 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:13:23.482785 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-d78e46b9-36b5-4af4-965a-49cd961029c2 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:13:23.486787 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-d78e46b9-36b5-4af4-965a-49cd961029c2 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:13:23.493204 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-d78e46b9-36b5-4af4-965a-49cd961029c2 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] 10.222.0.18 "GET /compute/v2.1/servers/34dcd1da-b94c-426b-b08b-204ea287c8a2" status: 200 len: 1740 microversion: 2.20 time: 0.593343 Oct 22 21:13:23.495045 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2303/4590] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:13:22 2022] GET /compute/v2.1/servers/34dcd1da-b94c-426b-b08b-204ea287c8a2 => generated 1740 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:13:23.497840 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-4135852a-6b78-451f-bf67-80a4b7583489 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Getting quotas for project e87474d4b4c547abbfe6308b6dd8e1c8. Resources: {'cores', 'instances', 'ram'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 21:13:23.515722 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-4135852a-6b78-451f-bf67-80a4b7583489 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Getting quotas for user 799f987b3aa7426ba5d7a464052d6490 and project e87474d4b4c547abbfe6308b6dd8e1c8. Resources: {'cores', 'instances', 'ram'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 21:13:23.547297 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-4135852a-6b78-451f-bf67-80a4b7583489 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Going to run 1 instances... {{(pid=138744) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 21:13:23.553760 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-4135852a-6b78-451f-bf67-80a4b7583489 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] [instance: 955c9477-85e2-4d95-ab3b-035dbf7d5a03] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='085e4478-6edc-4a69-8e08-f9831713eb65',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138744) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 21:13:23.580966 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:13:23.673058 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-4135852a-6b78-451f-bf67-80a4b7583489 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.820458 Oct 22 21:13:23.677516 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2288/4591] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Oct 22 21:13:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 1826 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 21:13:23.690026 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-387ba51d-bbeb-40c5-9f95-832b6d69b4b4 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:13:23.691429 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-387ba51d-bbeb-40c5-9f95-832b6d69b4b4 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] [instance: 955c9477-85e2-4d95-ab3b-035dbf7d5a03] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:13:23.832165 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-969fe3b6-8d5a-481a-b5e5-f37dc0c61ff1 tempest-TestVolumeBackupRestore-2071196610 tempest-TestVolumeBackupRestore-2071196610-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:13:23.833037 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-969fe3b6-8d5a-481a-b5e5-f37dc0c61ff1 tempest-TestVolumeBackupRestore-2071196610 tempest-TestVolumeBackupRestore-2071196610-project] [instance: 77705065-40b2-4fba-8cf9-def4abeae0e4] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:13:23.844683 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-969fe3b6-8d5a-481a-b5e5-f37dc0c61ff1 tempest-TestVolumeBackupRestore-2071196610 tempest-TestVolumeBackupRestore-2071196610-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:23.848465 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-969fe3b6-8d5a-481a-b5e5-f37dc0c61ff1 tempest-TestVolumeBackupRestore-2071196610 tempest-TestVolumeBackupRestore-2071196610-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:23.849141 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-969fe3b6-8d5a-481a-b5e5-f37dc0c61ff1 tempest-TestVolumeBackupRestore-2071196610 tempest-TestVolumeBackupRestore-2071196610-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:23.852810 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-969fe3b6-8d5a-481a-b5e5-f37dc0c61ff1 tempest-TestVolumeBackupRestore-2071196610 tempest-TestVolumeBackupRestore-2071196610-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:23.853528 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-969fe3b6-8d5a-481a-b5e5-f37dc0c61ff1 tempest-TestVolumeBackupRestore-2071196610 tempest-TestVolumeBackupRestore-2071196610-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:23.854162 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-969fe3b6-8d5a-481a-b5e5-f37dc0c61ff1 tempest-TestVolumeBackupRestore-2071196610 tempest-TestVolumeBackupRestore-2071196610-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:23.919738 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-387ba51d-bbeb-40c5-9f95-832b6d69b4b4 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799f987b3aa7426ba5d7a464052d6490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87474d4b4c547abbfe6308b6dd8e1c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:13:23.931584 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-387ba51d-bbeb-40c5-9f95-832b6d69b4b4 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] 10.222.0.18 "GET /compute/v2.1/servers/955c9477-85e2-4d95-ab3b-035dbf7d5a03" status: 200 len: 1221 microversion: 2.1 time: 0.243999 Oct 22 21:13:23.943180 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2304/4592] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:13:23 2022] GET /compute/v2.1/servers/955c9477-85e2-4d95-ab3b-035dbf7d5a03 => generated 1221 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:13:24.149405 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-969fe3b6-8d5a-481a-b5e5-f37dc0c61ff1 tempest-TestVolumeBackupRestore-2071196610 tempest-TestVolumeBackupRestore-2071196610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4464172f8d43a986f7de04724a8d52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba71430f3dc046f68faab18103ba9007', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:13:24.166779 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-969fe3b6-8d5a-481a-b5e5-f37dc0c61ff1 tempest-TestVolumeBackupRestore-2071196610 tempest-TestVolumeBackupRestore-2071196610-project] 10.222.0.18 "GET /compute/v2.1/servers/77705065-40b2-4fba-8cf9-def4abeae0e4" status: 200 len: 1214 microversion: 2.1 time: 0.336103 Oct 22 21:13:24.169348 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2289/4593] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:13:23 2022] GET /compute/v2.1/servers/77705065-40b2-4fba-8cf9-def4abeae0e4 => generated 1214 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:13:24.525552 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-60b4f1d9-de51-4fc0-a977-8a000a7aa821 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:13:24.526275 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-60b4f1d9-de51-4fc0-a977-8a000a7aa821 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] [instance: 34dcd1da-b94c-426b-b08b-204ea287c8a2] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:13:24.547854 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-60b4f1d9-de51-4fc0-a977-8a000a7aa821 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:24.548695 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-60b4f1d9-de51-4fc0-a977-8a000a7aa821 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:24.549270 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-60b4f1d9-de51-4fc0-a977-8a000a7aa821 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:24.554744 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-60b4f1d9-de51-4fc0-a977-8a000a7aa821 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:24.555440 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-60b4f1d9-de51-4fc0-a977-8a000a7aa821 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:24.558299 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-60b4f1d9-de51-4fc0-a977-8a000a7aa821 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:24.960365 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-3cf81025-96b4-445b-88b6-59ea3efd6d4c tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:13:24.961044 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-3cf81025-96b4-445b-88b6-59ea3efd6d4c tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] [instance: 955c9477-85e2-4d95-ab3b-035dbf7d5a03] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:13:24.988878 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3cf81025-96b4-445b-88b6-59ea3efd6d4c tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:24.991517 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3cf81025-96b4-445b-88b6-59ea3efd6d4c tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:24.997410 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-60b4f1d9-de51-4fc0-a977-8a000a7aa821 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:13:25.021092 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3cf81025-96b4-445b-88b6-59ea3efd6d4c tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:25.021909 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3cf81025-96b4-445b-88b6-59ea3efd6d4c tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:25.022399 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3cf81025-96b4-445b-88b6-59ea3efd6d4c tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:25.022849 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3cf81025-96b4-445b-88b6-59ea3efd6d4c tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:25.038790 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-60b4f1d9-de51-4fc0-a977-8a000a7aa821 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:13:25.048694 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-60b4f1d9-de51-4fc0-a977-8a000a7aa821 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:13:25.055995 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-60b4f1d9-de51-4fc0-a977-8a000a7aa821 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] 10.222.0.18 "GET /compute/v2.1/servers/34dcd1da-b94c-426b-b08b-204ea287c8a2" status: 200 len: 1740 microversion: 2.20 time: 0.536126 Oct 22 21:13:25.060101 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2305/4594] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:13:24 2022] GET /compute/v2.1/servers/34dcd1da-b94c-426b-b08b-204ea287c8a2 => generated 1740 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:13:25.199714 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-62829841-e97b-4c65-b6a4-8ebbeba71022 tempest-TestVolumeBackupRestore-2071196610 tempest-TestVolumeBackupRestore-2071196610-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:13:25.200579 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-62829841-e97b-4c65-b6a4-8ebbeba71022 tempest-TestVolumeBackupRestore-2071196610 tempest-TestVolumeBackupRestore-2071196610-project] [instance: 77705065-40b2-4fba-8cf9-def4abeae0e4] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:13:25.216424 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-62829841-e97b-4c65-b6a4-8ebbeba71022 tempest-TestVolumeBackupRestore-2071196610 tempest-TestVolumeBackupRestore-2071196610-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:25.220300 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-62829841-e97b-4c65-b6a4-8ebbeba71022 tempest-TestVolumeBackupRestore-2071196610 tempest-TestVolumeBackupRestore-2071196610-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:25.222993 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-62829841-e97b-4c65-b6a4-8ebbeba71022 tempest-TestVolumeBackupRestore-2071196610 tempest-TestVolumeBackupRestore-2071196610-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:25.228620 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-62829841-e97b-4c65-b6a4-8ebbeba71022 tempest-TestVolumeBackupRestore-2071196610 tempest-TestVolumeBackupRestore-2071196610-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:25.229163 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-62829841-e97b-4c65-b6a4-8ebbeba71022 tempest-TestVolumeBackupRestore-2071196610 tempest-TestVolumeBackupRestore-2071196610-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:25.232638 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-62829841-e97b-4c65-b6a4-8ebbeba71022 tempest-TestVolumeBackupRestore-2071196610 tempest-TestVolumeBackupRestore-2071196610-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:25.645680 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-3cf81025-96b4-445b-88b6-59ea3efd6d4c tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799f987b3aa7426ba5d7a464052d6490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87474d4b4c547abbfe6308b6dd8e1c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:13:25.657135 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-3cf81025-96b4-445b-88b6-59ea3efd6d4c tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] 10.222.0.18 "GET /compute/v2.1/servers/955c9477-85e2-4d95-ab3b-035dbf7d5a03" status: 200 len: 1217 microversion: 2.1 time: 0.702530 Oct 22 21:13:25.660806 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2290/4595] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:13:24 2022] GET /compute/v2.1/servers/955c9477-85e2-4d95-ab3b-035dbf7d5a03 => generated 1217 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:13:26.088843 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-8e17a0e6-1fe7-42f6-80a1-7ebe6b2a6f6d tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:13:26.089563 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-8e17a0e6-1fe7-42f6-80a1-7ebe6b2a6f6d tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] [instance: 34dcd1da-b94c-426b-b08b-204ea287c8a2] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:13:26.111515 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8e17a0e6-1fe7-42f6-80a1-7ebe6b2a6f6d tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:26.117244 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8e17a0e6-1fe7-42f6-80a1-7ebe6b2a6f6d tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:26.117873 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8e17a0e6-1fe7-42f6-80a1-7ebe6b2a6f6d tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:26.119903 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8e17a0e6-1fe7-42f6-80a1-7ebe6b2a6f6d tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:26.123281 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8e17a0e6-1fe7-42f6-80a1-7ebe6b2a6f6d tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:26.124728 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8e17a0e6-1fe7-42f6-80a1-7ebe6b2a6f6d tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:26.341915 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-62829841-e97b-4c65-b6a4-8ebbeba71022 tempest-TestVolumeBackupRestore-2071196610 tempest-TestVolumeBackupRestore-2071196610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4464172f8d43a986f7de04724a8d52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba71430f3dc046f68faab18103ba9007', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:13:26.356482 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-62829841-e97b-4c65-b6a4-8ebbeba71022 tempest-TestVolumeBackupRestore-2071196610 tempest-TestVolumeBackupRestore-2071196610-project] 10.222.0.18 "GET /compute/v2.1/servers/77705065-40b2-4fba-8cf9-def4abeae0e4" status: 200 len: 1269 microversion: 2.1 time: 1.165031 Oct 22 21:13:26.372519 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2306/4596] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:13:25 2022] GET /compute/v2.1/servers/77705065-40b2-4fba-8cf9-def4abeae0e4 => generated 1269 bytes in 1182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:13:26.594361 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-cf10aee8-fbcf-48e3-a302-70dd3a93102b req-6bfd7658-a786-4e0a-8efb-3aaba1c42554 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c197028-ff9e-46ff-81f4-0feb4748da97", "tag": "c5e164ee-0bd2-495e-9036-a2f07d700b5e"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:13:26.618885 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-cf10aee8-fbcf-48e3-a302-70dd3a93102b req-6bfd7658-a786-4e0a-8efb-3aaba1c42554 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:26.622145 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-cf10aee8-fbcf-48e3-a302-70dd3a93102b req-6bfd7658-a786-4e0a-8efb-3aaba1c42554 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:26.623470 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-cf10aee8-fbcf-48e3-a302-70dd3a93102b req-6bfd7658-a786-4e0a-8efb-3aaba1c42554 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:26.706931 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-cf10aee8-fbcf-48e3-a302-70dd3a93102b req-6bfd7658-a786-4e0a-8efb-3aaba1c42554 service nova] Creating event network-changed:c5e164ee-0bd2-495e-9036-a2f07d700b5e for instance 5c197028-ff9e-46ff-81f4-0feb4748da97 on nch1-master-1 Oct 22 21:13:26.726920 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-cf10aee8-fbcf-48e3-a302-70dd3a93102b req-6bfd7658-a786-4e0a-8efb-3aaba1c42554 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.136365 Oct 22 21:13:26.729321 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2307/4597] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:13:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:13:26.763760 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-336ef2b1-bfc0-4367-9cde-31d257289014 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:13:26.765502 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-336ef2b1-bfc0-4367-9cde-31d257289014 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] [instance: 955c9477-85e2-4d95-ab3b-035dbf7d5a03] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:13:26.793378 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-336ef2b1-bfc0-4367-9cde-31d257289014 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:26.795592 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-336ef2b1-bfc0-4367-9cde-31d257289014 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:26.799058 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-336ef2b1-bfc0-4367-9cde-31d257289014 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:26.802050 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-336ef2b1-bfc0-4367-9cde-31d257289014 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:26.802851 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-336ef2b1-bfc0-4367-9cde-31d257289014 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:26.803792 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-336ef2b1-bfc0-4367-9cde-31d257289014 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:26.963613 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-336ef2b1-bfc0-4367-9cde-31d257289014 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799f987b3aa7426ba5d7a464052d6490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87474d4b4c547abbfe6308b6dd8e1c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:13:26.976322 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-336ef2b1-bfc0-4367-9cde-31d257289014 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] 10.222.0.18 "GET /compute/v2.1/servers/955c9477-85e2-4d95-ab3b-035dbf7d5a03" status: 200 len: 1279 microversion: 2.1 time: 0.245038 Oct 22 21:13:26.978863 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2308/4598] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:13:26 2022] GET /compute/v2.1/servers/955c9477-85e2-4d95-ab3b-035dbf7d5a03 => generated 1279 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:13:27.110593 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-8e17a0e6-1fe7-42f6-80a1-7ebe6b2a6f6d tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:13:27.124099 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-8e17a0e6-1fe7-42f6-80a1-7ebe6b2a6f6d tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:13:27.130245 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-8e17a0e6-1fe7-42f6-80a1-7ebe6b2a6f6d tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:13:27.131548 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-8e17a0e6-1fe7-42f6-80a1-7ebe6b2a6f6d tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] 10.222.0.18 "GET /compute/v2.1/servers/34dcd1da-b94c-426b-b08b-204ea287c8a2" status: 200 len: 1740 microversion: 2.20 time: 1.048424 Oct 22 21:13:27.136912 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2291/4599] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:13:26 2022] GET /compute/v2.1/servers/34dcd1da-b94c-426b-b08b-204ea287c8a2 => generated 1740 bytes in 1054 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:13:27.379746 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-3c1e653d-ed20-46c0-93a0-aa3b4ecf0eeb tempest-TestVolumeBackupRestore-2071196610 tempest-TestVolumeBackupRestore-2071196610-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:13:27.380487 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-3c1e653d-ed20-46c0-93a0-aa3b4ecf0eeb tempest-TestVolumeBackupRestore-2071196610 tempest-TestVolumeBackupRestore-2071196610-project] [instance: 77705065-40b2-4fba-8cf9-def4abeae0e4] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:13:27.397644 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3c1e653d-ed20-46c0-93a0-aa3b4ecf0eeb tempest-TestVolumeBackupRestore-2071196610 tempest-TestVolumeBackupRestore-2071196610-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:27.398393 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3c1e653d-ed20-46c0-93a0-aa3b4ecf0eeb tempest-TestVolumeBackupRestore-2071196610 tempest-TestVolumeBackupRestore-2071196610-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:27.399842 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3c1e653d-ed20-46c0-93a0-aa3b4ecf0eeb tempest-TestVolumeBackupRestore-2071196610 tempest-TestVolumeBackupRestore-2071196610-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:27.400873 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3c1e653d-ed20-46c0-93a0-aa3b4ecf0eeb tempest-TestVolumeBackupRestore-2071196610 tempest-TestVolumeBackupRestore-2071196610-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:27.403484 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3c1e653d-ed20-46c0-93a0-aa3b4ecf0eeb tempest-TestVolumeBackupRestore-2071196610 tempest-TestVolumeBackupRestore-2071196610-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:27.404447 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3c1e653d-ed20-46c0-93a0-aa3b4ecf0eeb tempest-TestVolumeBackupRestore-2071196610 tempest-TestVolumeBackupRestore-2071196610-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:27.523167 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-4842acf8-e08a-446d-8f46-7c31183157ee req-9a2e6509-348e-4f8b-b3bb-19483e8e23f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77705065-40b2-4fba-8cf9-def4abeae0e4", "tag": "77793879-ddc1-4a27-89fe-4f5537f05251"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:13:27.555389 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-4842acf8-e08a-446d-8f46-7c31183157ee req-9a2e6509-348e-4f8b-b3bb-19483e8e23f1 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:27.556800 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-4842acf8-e08a-446d-8f46-7c31183157ee req-9a2e6509-348e-4f8b-b3bb-19483e8e23f1 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:27.557480 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-4842acf8-e08a-446d-8f46-7c31183157ee req-9a2e6509-348e-4f8b-b3bb-19483e8e23f1 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:27.582165 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-4842acf8-e08a-446d-8f46-7c31183157ee req-9a2e6509-348e-4f8b-b3bb-19483e8e23f1 service nova] Creating event network-changed:77793879-ddc1-4a27-89fe-4f5537f05251 for instance 77705065-40b2-4fba-8cf9-def4abeae0e4 on nch2-master-1 Oct 22 21:13:27.590473 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-4842acf8-e08a-446d-8f46-7c31183157ee req-9a2e6509-348e-4f8b-b3bb-19483e8e23f1 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073401 Oct 22 21:13:27.591837 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2292/4600] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:13:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 21:13:28.010589 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-8d0a6e32-3b9d-4db0-8d58-c0bf7abb042a tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:13:28.012167 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-8d0a6e32-3b9d-4db0-8d58-c0bf7abb042a tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] [instance: 955c9477-85e2-4d95-ab3b-035dbf7d5a03] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:13:28.039945 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8d0a6e32-3b9d-4db0-8d58-c0bf7abb042a tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:28.044264 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8d0a6e32-3b9d-4db0-8d58-c0bf7abb042a tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:28.044903 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8d0a6e32-3b9d-4db0-8d58-c0bf7abb042a tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:28.046817 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8d0a6e32-3b9d-4db0-8d58-c0bf7abb042a tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:28.050122 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8d0a6e32-3b9d-4db0-8d58-c0bf7abb042a tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:28.053190 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8d0a6e32-3b9d-4db0-8d58-c0bf7abb042a tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:28.467176 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-8d0a6e32-3b9d-4db0-8d58-c0bf7abb042a tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799f987b3aa7426ba5d7a464052d6490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87474d4b4c547abbfe6308b6dd8e1c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:13:28.480424 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-8d0a6e32-3b9d-4db0-8d58-c0bf7abb042a tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] 10.222.0.18 "GET /compute/v2.1/servers/955c9477-85e2-4d95-ab3b-035dbf7d5a03" status: 200 len: 1279 microversion: 2.1 time: 0.474625 Oct 22 21:13:28.485296 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2293/4601] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:13:28 2022] GET /compute/v2.1/servers/955c9477-85e2-4d95-ab3b-035dbf7d5a03 => generated 1279 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:13:28.499795 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-faced6d2-c953-4318-aaee-6cad298c5760 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:13:28.500479 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-faced6d2-c953-4318-aaee-6cad298c5760 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] [instance: 34dcd1da-b94c-426b-b08b-204ea287c8a2] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:13:28.510039 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-faced6d2-c953-4318-aaee-6cad298c5760 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:28.513192 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-faced6d2-c953-4318-aaee-6cad298c5760 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:28.514188 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-faced6d2-c953-4318-aaee-6cad298c5760 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:28.517161 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-faced6d2-c953-4318-aaee-6cad298c5760 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:28.517857 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-faced6d2-c953-4318-aaee-6cad298c5760 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:28.518751 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-faced6d2-c953-4318-aaee-6cad298c5760 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:28.700085 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell0:SELECT=2 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:13:28.959822 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-3c1e653d-ed20-46c0-93a0-aa3b4ecf0eeb tempest-TestVolumeBackupRestore-2071196610 tempest-TestVolumeBackupRestore-2071196610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4464172f8d43a986f7de04724a8d52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba71430f3dc046f68faab18103ba9007', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:13:28.982564 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-3c1e653d-ed20-46c0-93a0-aa3b4ecf0eeb tempest-TestVolumeBackupRestore-2071196610 tempest-TestVolumeBackupRestore-2071196610-project] 10.222.0.18 "GET /compute/v2.1/servers/77705065-40b2-4fba-8cf9-def4abeae0e4" status: 200 len: 1269 microversion: 2.1 time: 1.607425 Oct 22 21:13:28.986844 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2309/4602] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:13:27 2022] GET /compute/v2.1/servers/77705065-40b2-4fba-8cf9-def4abeae0e4 => generated 1269 bytes in 1612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:13:29.260232 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-faced6d2-c953-4318-aaee-6cad298c5760 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:13:29.274506 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-faced6d2-c953-4318-aaee-6cad298c5760 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:13:29.277590 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-faced6d2-c953-4318-aaee-6cad298c5760 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:13:29.279316 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-faced6d2-c953-4318-aaee-6cad298c5760 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] 10.222.0.18 "GET /compute/v2.1/servers/34dcd1da-b94c-426b-b08b-204ea287c8a2" status: 200 len: 1740 microversion: 2.20 time: 0.792930 Oct 22 21:13:29.280473 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2294/4603] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:13:28 2022] GET /compute/v2.1/servers/34dcd1da-b94c-426b-b08b-204ea287c8a2 => generated 1740 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:13:29.511249 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-d5cd7b5b-d23a-4053-bb7a-43e172cf1886 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:13:29.512350 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-d5cd7b5b-d23a-4053-bb7a-43e172cf1886 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] [instance: 955c9477-85e2-4d95-ab3b-035dbf7d5a03] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:13:29.537702 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d5cd7b5b-d23a-4053-bb7a-43e172cf1886 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:29.538868 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d5cd7b5b-d23a-4053-bb7a-43e172cf1886 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:29.539594 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d5cd7b5b-d23a-4053-bb7a-43e172cf1886 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:29.540962 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d5cd7b5b-d23a-4053-bb7a-43e172cf1886 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:29.541259 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d5cd7b5b-d23a-4053-bb7a-43e172cf1886 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:29.541932 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d5cd7b5b-d23a-4053-bb7a-43e172cf1886 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:30.010805 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-e7f1ff22-f368-4dbf-856f-4b3f0235c8c8 tempest-TestVolumeBackupRestore-2071196610 tempest-TestVolumeBackupRestore-2071196610-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:13:30.012016 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-e7f1ff22-f368-4dbf-856f-4b3f0235c8c8 tempest-TestVolumeBackupRestore-2071196610 tempest-TestVolumeBackupRestore-2071196610-project] [instance: 77705065-40b2-4fba-8cf9-def4abeae0e4] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:13:30.024170 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e7f1ff22-f368-4dbf-856f-4b3f0235c8c8 tempest-TestVolumeBackupRestore-2071196610 tempest-TestVolumeBackupRestore-2071196610-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:30.025596 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e7f1ff22-f368-4dbf-856f-4b3f0235c8c8 tempest-TestVolumeBackupRestore-2071196610 tempest-TestVolumeBackupRestore-2071196610-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:30.028480 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e7f1ff22-f368-4dbf-856f-4b3f0235c8c8 tempest-TestVolumeBackupRestore-2071196610 tempest-TestVolumeBackupRestore-2071196610-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:30.029620 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e7f1ff22-f368-4dbf-856f-4b3f0235c8c8 tempest-TestVolumeBackupRestore-2071196610 tempest-TestVolumeBackupRestore-2071196610-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:30.031091 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e7f1ff22-f368-4dbf-856f-4b3f0235c8c8 tempest-TestVolumeBackupRestore-2071196610 tempest-TestVolumeBackupRestore-2071196610-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:30.032329 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e7f1ff22-f368-4dbf-856f-4b3f0235c8c8 tempest-TestVolumeBackupRestore-2071196610 tempest-TestVolumeBackupRestore-2071196610-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:30.131965 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-d5cd7b5b-d23a-4053-bb7a-43e172cf1886 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799f987b3aa7426ba5d7a464052d6490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87474d4b4c547abbfe6308b6dd8e1c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:13:30.154821 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-d5cd7b5b-d23a-4053-bb7a-43e172cf1886 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] 10.222.0.18 "GET /compute/v2.1/servers/955c9477-85e2-4d95-ab3b-035dbf7d5a03" status: 200 len: 1321 microversion: 2.1 time: 0.647980 Oct 22 21:13:30.155751 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2310/4604] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:13:29 2022] GET /compute/v2.1/servers/955c9477-85e2-4d95-ab3b-035dbf7d5a03 => generated 1321 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:13:30.306779 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-b412c4ab-6d81-432d-a6ee-bd99a8e3ee74 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:13:30.307632 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-b412c4ab-6d81-432d-a6ee-bd99a8e3ee74 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] [instance: 34dcd1da-b94c-426b-b08b-204ea287c8a2] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:13:30.323130 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b412c4ab-6d81-432d-a6ee-bd99a8e3ee74 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:30.334504 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b412c4ab-6d81-432d-a6ee-bd99a8e3ee74 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:30.335650 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b412c4ab-6d81-432d-a6ee-bd99a8e3ee74 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:30.336668 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b412c4ab-6d81-432d-a6ee-bd99a8e3ee74 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:30.337232 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b412c4ab-6d81-432d-a6ee-bd99a8e3ee74 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:30.337755 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b412c4ab-6d81-432d-a6ee-bd99a8e3ee74 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:30.782395 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-e7f1ff22-f368-4dbf-856f-4b3f0235c8c8 tempest-TestVolumeBackupRestore-2071196610 tempest-TestVolumeBackupRestore-2071196610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4464172f8d43a986f7de04724a8d52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba71430f3dc046f68faab18103ba9007', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:13:30.797178 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-e7f1ff22-f368-4dbf-856f-4b3f0235c8c8 tempest-TestVolumeBackupRestore-2071196610 tempest-TestVolumeBackupRestore-2071196610-project] 10.222.0.18 "GET /compute/v2.1/servers/77705065-40b2-4fba-8cf9-def4abeae0e4" status: 200 len: 1269 microversion: 2.1 time: 0.788121 Oct 22 21:13:30.815470 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2295/4605] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:13:30 2022] GET /compute/v2.1/servers/77705065-40b2-4fba-8cf9-def4abeae0e4 => generated 1269 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:13:30.949305 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-b412c4ab-6d81-432d-a6ee-bd99a8e3ee74 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:13:31.002190 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-b412c4ab-6d81-432d-a6ee-bd99a8e3ee74 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:13:31.004799 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-b412c4ab-6d81-432d-a6ee-bd99a8e3ee74 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:13:31.008831 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-b412c4ab-6d81-432d-a6ee-bd99a8e3ee74 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] 10.222.0.18 "GET /compute/v2.1/servers/34dcd1da-b94c-426b-b08b-204ea287c8a2" status: 200 len: 1740 microversion: 2.20 time: 0.706347 Oct 22 21:13:31.009964 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2311/4606] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:13:30 2022] GET /compute/v2.1/servers/34dcd1da-b94c-426b-b08b-204ea287c8a2 => generated 1740 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 22 21:13:31.186676 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-594bedd5-51d9-4ca6-8be2-283443b4e9aa tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:13:31.187389 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-594bedd5-51d9-4ca6-8be2-283443b4e9aa tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] [instance: 955c9477-85e2-4d95-ab3b-035dbf7d5a03] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:13:31.227658 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-594bedd5-51d9-4ca6-8be2-283443b4e9aa tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:31.228792 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-594bedd5-51d9-4ca6-8be2-283443b4e9aa tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:31.230999 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-594bedd5-51d9-4ca6-8be2-283443b4e9aa tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:31.233710 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-594bedd5-51d9-4ca6-8be2-283443b4e9aa tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:31.235979 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-594bedd5-51d9-4ca6-8be2-283443b4e9aa tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:31.236893 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-594bedd5-51d9-4ca6-8be2-283443b4e9aa tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:31.823562 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-afb99b20-b236-4dc4-bd76-c8bb7190b43a tempest-TestVolumeBackupRestore-2071196610 tempest-TestVolumeBackupRestore-2071196610-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:13:31.825798 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-afb99b20-b236-4dc4-bd76-c8bb7190b43a tempest-TestVolumeBackupRestore-2071196610 tempest-TestVolumeBackupRestore-2071196610-project] [instance: 77705065-40b2-4fba-8cf9-def4abeae0e4] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:13:31.835824 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-afb99b20-b236-4dc4-bd76-c8bb7190b43a tempest-TestVolumeBackupRestore-2071196610 tempest-TestVolumeBackupRestore-2071196610-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:31.837693 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-afb99b20-b236-4dc4-bd76-c8bb7190b43a tempest-TestVolumeBackupRestore-2071196610 tempest-TestVolumeBackupRestore-2071196610-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:31.838406 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-afb99b20-b236-4dc4-bd76-c8bb7190b43a tempest-TestVolumeBackupRestore-2071196610 tempest-TestVolumeBackupRestore-2071196610-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:31.840096 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-afb99b20-b236-4dc4-bd76-c8bb7190b43a tempest-TestVolumeBackupRestore-2071196610 tempest-TestVolumeBackupRestore-2071196610-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:31.841219 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-afb99b20-b236-4dc4-bd76-c8bb7190b43a tempest-TestVolumeBackupRestore-2071196610 tempest-TestVolumeBackupRestore-2071196610-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:31.842096 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-afb99b20-b236-4dc4-bd76-c8bb7190b43a tempest-TestVolumeBackupRestore-2071196610 tempest-TestVolumeBackupRestore-2071196610-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:31.880530 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-594bedd5-51d9-4ca6-8be2-283443b4e9aa tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799f987b3aa7426ba5d7a464052d6490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87474d4b4c547abbfe6308b6dd8e1c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:13:31.901516 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-594bedd5-51d9-4ca6-8be2-283443b4e9aa tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] 10.222.0.18 "GET /compute/v2.1/servers/955c9477-85e2-4d95-ab3b-035dbf7d5a03" status: 200 len: 1321 microversion: 2.1 time: 0.715749 Oct 22 21:13:31.902424 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2296/4607] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:13:31 2022] GET /compute/v2.1/servers/955c9477-85e2-4d95-ab3b-035dbf7d5a03 => generated 1321 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:13:32.045532 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-624b1d3a-5707-493a-b460-2bd305b3a773 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:13:32.046359 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-624b1d3a-5707-493a-b460-2bd305b3a773 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] [instance: 34dcd1da-b94c-426b-b08b-204ea287c8a2] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:13:32.064375 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-624b1d3a-5707-493a-b460-2bd305b3a773 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:32.064899 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-624b1d3a-5707-493a-b460-2bd305b3a773 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:32.067075 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-624b1d3a-5707-493a-b460-2bd305b3a773 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:32.068183 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-624b1d3a-5707-493a-b460-2bd305b3a773 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:32.070415 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-624b1d3a-5707-493a-b460-2bd305b3a773 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:32.071767 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-624b1d3a-5707-493a-b460-2bd305b3a773 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:32.365506 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-afb99b20-b236-4dc4-bd76-c8bb7190b43a tempest-TestVolumeBackupRestore-2071196610 tempest-TestVolumeBackupRestore-2071196610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4464172f8d43a986f7de04724a8d52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba71430f3dc046f68faab18103ba9007', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:13:32.373864 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-afb99b20-b236-4dc4-bd76-c8bb7190b43a tempest-TestVolumeBackupRestore-2071196610 tempest-TestVolumeBackupRestore-2071196610-project] 10.222.0.18 "GET /compute/v2.1/servers/77705065-40b2-4fba-8cf9-def4abeae0e4" status: 200 len: 1269 microversion: 2.1 time: 0.555396 Oct 22 21:13:32.374466 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2312/4608] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:13:31 2022] GET /compute/v2.1/servers/77705065-40b2-4fba-8cf9-def4abeae0e4 => generated 1269 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:13:32.533746 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-624b1d3a-5707-493a-b460-2bd305b3a773 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:13:32.547858 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-624b1d3a-5707-493a-b460-2bd305b3a773 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:13:32.552783 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-624b1d3a-5707-493a-b460-2bd305b3a773 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:13:32.556875 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-624b1d3a-5707-493a-b460-2bd305b3a773 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] 10.222.0.18 "GET /compute/v2.1/servers/34dcd1da-b94c-426b-b08b-204ea287c8a2" status: 200 len: 1740 microversion: 2.20 time: 0.514648 Oct 22 21:13:32.558233 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2297/4609] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:13:32 2022] GET /compute/v2.1/servers/34dcd1da-b94c-426b-b08b-204ea287c8a2 => generated 1740 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:13:32.674119 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-6410aa91-8628-45aa-9d9e-2b3355fda9e8 req-26550d82-f6aa-4053-9027-630f28587f5a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "955c9477-85e2-4d95-ab3b-035dbf7d5a03", "tag": "661b6506-965b-46e7-8fa7-2e2f98a2d9d0"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:13:32.706574 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-6410aa91-8628-45aa-9d9e-2b3355fda9e8 req-26550d82-f6aa-4053-9027-630f28587f5a service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:32.707418 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-6410aa91-8628-45aa-9d9e-2b3355fda9e8 req-26550d82-f6aa-4053-9027-630f28587f5a service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:32.707945 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-6410aa91-8628-45aa-9d9e-2b3355fda9e8 req-26550d82-f6aa-4053-9027-630f28587f5a service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:32.745101 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-6410aa91-8628-45aa-9d9e-2b3355fda9e8 req-26550d82-f6aa-4053-9027-630f28587f5a service nova] Creating event network-changed:661b6506-965b-46e7-8fa7-2e2f98a2d9d0 for instance 955c9477-85e2-4d95-ab3b-035dbf7d5a03 on nch1-master-1 Oct 22 21:13:32.753326 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-6410aa91-8628-45aa-9d9e-2b3355fda9e8 req-26550d82-f6aa-4053-9027-630f28587f5a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111105 Oct 22 21:13:32.760503 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2313/4610] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:13:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:13:32.929306 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-408bac4b-8584-4afb-b0a8-95a937d9aa63 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:13:32.929932 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-408bac4b-8584-4afb-b0a8-95a937d9aa63 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] [instance: 955c9477-85e2-4d95-ab3b-035dbf7d5a03] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:13:32.945222 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-408bac4b-8584-4afb-b0a8-95a937d9aa63 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:32.945972 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-408bac4b-8584-4afb-b0a8-95a937d9aa63 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:32.946593 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-408bac4b-8584-4afb-b0a8-95a937d9aa63 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:32.948274 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-408bac4b-8584-4afb-b0a8-95a937d9aa63 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:32.949464 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-408bac4b-8584-4afb-b0a8-95a937d9aa63 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:32.952167 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-408bac4b-8584-4afb-b0a8-95a937d9aa63 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:33.400839 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-728ba77d-3faf-4b0f-ba7d-ca990b41c380 tempest-TestVolumeBackupRestore-2071196610 tempest-TestVolumeBackupRestore-2071196610-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:13:33.402343 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-728ba77d-3faf-4b0f-ba7d-ca990b41c380 tempest-TestVolumeBackupRestore-2071196610 tempest-TestVolumeBackupRestore-2071196610-project] [instance: 77705065-40b2-4fba-8cf9-def4abeae0e4] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:13:33.415598 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-728ba77d-3faf-4b0f-ba7d-ca990b41c380 tempest-TestVolumeBackupRestore-2071196610 tempest-TestVolumeBackupRestore-2071196610-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:33.416583 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-728ba77d-3faf-4b0f-ba7d-ca990b41c380 tempest-TestVolumeBackupRestore-2071196610 tempest-TestVolumeBackupRestore-2071196610-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:33.418021 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-728ba77d-3faf-4b0f-ba7d-ca990b41c380 tempest-TestVolumeBackupRestore-2071196610 tempest-TestVolumeBackupRestore-2071196610-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:33.419300 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-728ba77d-3faf-4b0f-ba7d-ca990b41c380 tempest-TestVolumeBackupRestore-2071196610 tempest-TestVolumeBackupRestore-2071196610-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:33.421979 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-728ba77d-3faf-4b0f-ba7d-ca990b41c380 tempest-TestVolumeBackupRestore-2071196610 tempest-TestVolumeBackupRestore-2071196610-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:33.422685 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-728ba77d-3faf-4b0f-ba7d-ca990b41c380 tempest-TestVolumeBackupRestore-2071196610 tempest-TestVolumeBackupRestore-2071196610-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:33.455139 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell1:SELECT=100 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:13:33.470609 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell0:SELECT=4 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:13:33.522216 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-408bac4b-8584-4afb-b0a8-95a937d9aa63 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799f987b3aa7426ba5d7a464052d6490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87474d4b4c547abbfe6308b6dd8e1c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:13:33.532113 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-408bac4b-8584-4afb-b0a8-95a937d9aa63 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] 10.222.0.18 "GET /compute/v2.1/servers/955c9477-85e2-4d95-ab3b-035dbf7d5a03" status: 200 len: 1321 microversion: 2.1 time: 0.607741 Oct 22 21:13:33.546146 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2298/4611] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:13:32 2022] GET /compute/v2.1/servers/955c9477-85e2-4d95-ab3b-035dbf7d5a03 => generated 1321 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:13:33.557829 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell0:SELECT=18 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:13:33.684122 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-728ba77d-3faf-4b0f-ba7d-ca990b41c380 tempest-TestVolumeBackupRestore-2071196610 tempest-TestVolumeBackupRestore-2071196610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4464172f8d43a986f7de04724a8d52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba71430f3dc046f68faab18103ba9007', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:13:33.697481 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-728ba77d-3faf-4b0f-ba7d-ca990b41c380 tempest-TestVolumeBackupRestore-2071196610 tempest-TestVolumeBackupRestore-2071196610-project] 10.222.0.18 "GET /compute/v2.1/servers/77705065-40b2-4fba-8cf9-def4abeae0e4" status: 200 len: 1269 microversion: 2.1 time: 0.302590 Oct 22 21:13:33.705898 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2314/4612] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:13:33 2022] GET /compute/v2.1/servers/77705065-40b2-4fba-8cf9-def4abeae0e4 => generated 1269 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:13:33.711504 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-11675c1b-82e6-4780-be0c-40b8aeaf9c7b tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:13:33.717616 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-11675c1b-82e6-4780-be0c-40b8aeaf9c7b tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] [instance: 34dcd1da-b94c-426b-b08b-204ea287c8a2] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:13:33.724323 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-11675c1b-82e6-4780-be0c-40b8aeaf9c7b tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:33.725417 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-11675c1b-82e6-4780-be0c-40b8aeaf9c7b tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:33.726169 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-11675c1b-82e6-4780-be0c-40b8aeaf9c7b tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:33.727095 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-11675c1b-82e6-4780-be0c-40b8aeaf9c7b tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:33.728031 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-11675c1b-82e6-4780-be0c-40b8aeaf9c7b tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:33.728769 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-11675c1b-82e6-4780-be0c-40b8aeaf9c7b tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:33.782995 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-bbb2bcdd-72e5-4639-8331-169580bd9285 tempest-VolumesActionsTest-1108413952 tempest-VolumesActionsTest-1108413952-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1773486995", "imageRef": "085e4478-6edc-4a69-8e08-f9831713eb65", "flavorRef": "452", "networks": [{"uuid": "797980eb-d322-4cb2-86f2-f7d3e6cbe8dd"}]}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:13:33.848463 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.network.neutron [None req-bbb2bcdd-72e5-4639-8331-169580bd9285 tempest-VolumesActionsTest-1108413952 tempest-VolumesActionsTest-1108413952-project] validate_networks() for [('797980eb-d322-4cb2-86f2-f7d3e6cbe8dd', None, None, None, None, None)] {{(pid=138744) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 21:13:33.929114 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell0:SELECT=10 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:13:34.055186 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-11675c1b-82e6-4780-be0c-40b8aeaf9c7b tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:13:34.064406 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-11675c1b-82e6-4780-be0c-40b8aeaf9c7b tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:13:34.066215 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-11675c1b-82e6-4780-be0c-40b8aeaf9c7b tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:13:34.067517 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-11675c1b-82e6-4780-be0c-40b8aeaf9c7b tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] 10.222.0.18 "GET /compute/v2.1/servers/34dcd1da-b94c-426b-b08b-204ea287c8a2" status: 200 len: 1740 microversion: 2.20 time: 0.360268 Oct 22 21:13:34.068417 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2315/4613] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:13:33 2022] GET /compute/v2.1/servers/34dcd1da-b94c-426b-b08b-204ea287c8a2 => generated 1740 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:13:34.353885 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-bbb2bcdd-72e5-4639-8331-169580bd9285 tempest-VolumesActionsTest-1108413952 tempest-VolumesActionsTest-1108413952-project] Flavor limits 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 21:13:34.353885 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-bbb2bcdd-72e5-4639-8331-169580bd9285 tempest-VolumesActionsTest-1108413952 tempest-VolumesActionsTest-1108413952-project] Image limits 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 21:13:34.353885 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-bbb2bcdd-72e5-4639-8331-169580bd9285 tempest-VolumesActionsTest-1108413952 tempest-VolumesActionsTest-1108413952-project] Flavor pref 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 21:13:34.353885 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-bbb2bcdd-72e5-4639-8331-169580bd9285 tempest-VolumesActionsTest-1108413952 tempest-VolumesActionsTest-1108413952-project] Image pref 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 21:13:34.353885 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-bbb2bcdd-72e5-4639-8331-169580bd9285 tempest-VolumesActionsTest-1108413952 tempest-VolumesActionsTest-1108413952-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 21:13:34.364632 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bbb2bcdd-72e5-4639-8331-169580bd9285 tempest-VolumesActionsTest-1108413952 tempest-VolumesActionsTest-1108413952-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:34.365560 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bbb2bcdd-72e5-4639-8331-169580bd9285 tempest-VolumesActionsTest-1108413952 tempest-VolumesActionsTest-1108413952-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:34.367761 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bbb2bcdd-72e5-4639-8331-169580bd9285 tempest-VolumesActionsTest-1108413952 tempest-VolumesActionsTest-1108413952-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:34.368518 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bbb2bcdd-72e5-4639-8331-169580bd9285 tempest-VolumesActionsTest-1108413952 tempest-VolumesActionsTest-1108413952-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:34.369307 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bbb2bcdd-72e5-4639-8331-169580bd9285 tempest-VolumesActionsTest-1108413952 tempest-VolumesActionsTest-1108413952-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:34.369753 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bbb2bcdd-72e5-4639-8331-169580bd9285 tempest-VolumesActionsTest-1108413952 tempest-VolumesActionsTest-1108413952-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:34.398734 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-bbb2bcdd-72e5-4639-8331-169580bd9285 tempest-VolumesActionsTest-1108413952 tempest-VolumesActionsTest-1108413952-project] Getting quotas for project 90c7a88417a446cd87a91bf19ef81232. Resources: {'cores', 'instances', 'ram'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 21:13:34.405827 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-bbb2bcdd-72e5-4639-8331-169580bd9285 tempest-VolumesActionsTest-1108413952 tempest-VolumesActionsTest-1108413952-project] Getting quotas for user 037ea1eef49c4f7fba0dec413ce15e5e and project 90c7a88417a446cd87a91bf19ef81232. Resources: {'cores', 'instances', 'ram'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 21:13:34.432587 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-bbb2bcdd-72e5-4639-8331-169580bd9285 tempest-VolumesActionsTest-1108413952 tempest-VolumesActionsTest-1108413952-project] Going to run 1 instances... {{(pid=138744) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 21:13:34.435576 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-bbb2bcdd-72e5-4639-8331-169580bd9285 tempest-VolumesActionsTest-1108413952 tempest-VolumesActionsTest-1108413952-project] [instance: 75885b47-51e4-4752-8150-00dff6c524f6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='085e4478-6edc-4a69-8e08-f9831713eb65',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138744) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 21:13:34.498817 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-bbb2bcdd-72e5-4639-8331-169580bd9285 tempest-VolumesActionsTest-1108413952 tempest-VolumesActionsTest-1108413952-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.950562 Oct 22 21:13:34.499529 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2299/4614] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Oct 22 21:13:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 952 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 21:13:34.512219 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-67d9ccc8-dea5-41e3-a14b-25c1e4c41849 tempest-VolumesActionsTest-1108413952 tempest-VolumesActionsTest-1108413952-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:13:34.512858 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-67d9ccc8-dea5-41e3-a14b-25c1e4c41849 tempest-VolumesActionsTest-1108413952 tempest-VolumesActionsTest-1108413952-project] [instance: 75885b47-51e4-4752-8150-00dff6c524f6] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:13:34.561948 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-266f67b2-d170-4410-8f00-68b084dfa616 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:13:34.562622 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-266f67b2-d170-4410-8f00-68b084dfa616 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] [instance: 955c9477-85e2-4d95-ab3b-035dbf7d5a03] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:13:34.577200 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-266f67b2-d170-4410-8f00-68b084dfa616 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:34.577765 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-266f67b2-d170-4410-8f00-68b084dfa616 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:34.578210 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-266f67b2-d170-4410-8f00-68b084dfa616 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:34.578942 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-266f67b2-d170-4410-8f00-68b084dfa616 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:34.579429 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-266f67b2-d170-4410-8f00-68b084dfa616 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:34.579862 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-266f67b2-d170-4410-8f00-68b084dfa616 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:34.614444 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:SELECT=100 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:13:34.626437 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-67d9ccc8-dea5-41e3-a14b-25c1e4c41849 tempest-VolumesActionsTest-1108413952 tempest-VolumesActionsTest-1108413952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037ea1eef49c4f7fba0dec413ce15e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c7a88417a446cd87a91bf19ef81232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:13:34.635745 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-67d9ccc8-dea5-41e3-a14b-25c1e4c41849 tempest-VolumesActionsTest-1108413952 tempest-VolumesActionsTest-1108413952-project] 10.222.0.18 "GET /compute/v2.1/servers/75885b47-51e4-4752-8150-00dff6c524f6" status: 200 len: 1214 microversion: 2.1 time: 0.128025 Oct 22 21:13:34.653106 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2316/4615] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:13:34 2022] GET /compute/v2.1/servers/75885b47-51e4-4752-8150-00dff6c524f6 => generated 1214 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:13:34.755586 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-31e3467c-71a4-4dc3-9e54-3cad4b95055a tempest-TestVolumeBackupRestore-2071196610 tempest-TestVolumeBackupRestore-2071196610-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:13:34.756849 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-31e3467c-71a4-4dc3-9e54-3cad4b95055a tempest-TestVolumeBackupRestore-2071196610 tempest-TestVolumeBackupRestore-2071196610-project] [instance: 77705065-40b2-4fba-8cf9-def4abeae0e4] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:13:34.769007 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-31e3467c-71a4-4dc3-9e54-3cad4b95055a tempest-TestVolumeBackupRestore-2071196610 tempest-TestVolumeBackupRestore-2071196610-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:34.769828 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-31e3467c-71a4-4dc3-9e54-3cad4b95055a tempest-TestVolumeBackupRestore-2071196610 tempest-TestVolumeBackupRestore-2071196610-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:34.771200 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-31e3467c-71a4-4dc3-9e54-3cad4b95055a tempest-TestVolumeBackupRestore-2071196610 tempest-TestVolumeBackupRestore-2071196610-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:34.772864 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-31e3467c-71a4-4dc3-9e54-3cad4b95055a tempest-TestVolumeBackupRestore-2071196610 tempest-TestVolumeBackupRestore-2071196610-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:34.774354 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-31e3467c-71a4-4dc3-9e54-3cad4b95055a tempest-TestVolumeBackupRestore-2071196610 tempest-TestVolumeBackupRestore-2071196610-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:34.776278 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-31e3467c-71a4-4dc3-9e54-3cad4b95055a tempest-TestVolumeBackupRestore-2071196610 tempest-TestVolumeBackupRestore-2071196610-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:34.885480 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-266f67b2-d170-4410-8f00-68b084dfa616 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799f987b3aa7426ba5d7a464052d6490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87474d4b4c547abbfe6308b6dd8e1c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:13:34.901768 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-266f67b2-d170-4410-8f00-68b084dfa616 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] 10.222.0.18 "GET /compute/v2.1/servers/955c9477-85e2-4d95-ab3b-035dbf7d5a03" status: 200 len: 1321 microversion: 2.1 time: 0.344961 Oct 22 21:13:34.902654 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2300/4616] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:13:34 2022] GET /compute/v2.1/servers/955c9477-85e2-4d95-ab3b-035dbf7d5a03 => generated 1321 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:13:34.985150 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-31e3467c-71a4-4dc3-9e54-3cad4b95055a tempest-TestVolumeBackupRestore-2071196610 tempest-TestVolumeBackupRestore-2071196610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4464172f8d43a986f7de04724a8d52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba71430f3dc046f68faab18103ba9007', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:13:35.005560 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-31e3467c-71a4-4dc3-9e54-3cad4b95055a tempest-TestVolumeBackupRestore-2071196610 tempest-TestVolumeBackupRestore-2071196610-project] 10.222.0.18 "GET /compute/v2.1/servers/77705065-40b2-4fba-8cf9-def4abeae0e4" status: 200 len: 1269 microversion: 2.1 time: 0.256847 Oct 22 21:13:35.006187 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2317/4617] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:13:34 2022] GET /compute/v2.1/servers/77705065-40b2-4fba-8cf9-def4abeae0e4 => generated 1269 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:13:35.096800 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-c7a5df0b-3578-4d2e-8f33-76501b0917c2 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:13:35.097501 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-c7a5df0b-3578-4d2e-8f33-76501b0917c2 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] [instance: 34dcd1da-b94c-426b-b08b-204ea287c8a2] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:13:35.112461 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c7a5df0b-3578-4d2e-8f33-76501b0917c2 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:35.113011 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c7a5df0b-3578-4d2e-8f33-76501b0917c2 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:35.113772 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c7a5df0b-3578-4d2e-8f33-76501b0917c2 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:35.115469 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c7a5df0b-3578-4d2e-8f33-76501b0917c2 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:35.116248 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c7a5df0b-3578-4d2e-8f33-76501b0917c2 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:35.117112 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c7a5df0b-3578-4d2e-8f33-76501b0917c2 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:35.288009 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-c7a5df0b-3578-4d2e-8f33-76501b0917c2 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:13:35.298367 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-c7a5df0b-3578-4d2e-8f33-76501b0917c2 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:13:35.300679 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-c7a5df0b-3578-4d2e-8f33-76501b0917c2 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:13:35.302009 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-c7a5df0b-3578-4d2e-8f33-76501b0917c2 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] 10.222.0.18 "GET /compute/v2.1/servers/34dcd1da-b94c-426b-b08b-204ea287c8a2" status: 200 len: 1740 microversion: 2.20 time: 0.209563 Oct 22 21:13:35.302628 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2301/4618] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:13:35 2022] GET /compute/v2.1/servers/34dcd1da-b94c-426b-b08b-204ea287c8a2 => generated 1740 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:13:35.665857 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-9e67ac3b-da0e-42a2-9cf0-e22bbf2d81b9 tempest-VolumesActionsTest-1108413952 tempest-VolumesActionsTest-1108413952-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:13:35.666495 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-9e67ac3b-da0e-42a2-9cf0-e22bbf2d81b9 tempest-VolumesActionsTest-1108413952 tempest-VolumesActionsTest-1108413952-project] [instance: 75885b47-51e4-4752-8150-00dff6c524f6] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:13:35.676221 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9e67ac3b-da0e-42a2-9cf0-e22bbf2d81b9 tempest-VolumesActionsTest-1108413952 tempest-VolumesActionsTest-1108413952-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:35.676799 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9e67ac3b-da0e-42a2-9cf0-e22bbf2d81b9 tempest-VolumesActionsTest-1108413952 tempest-VolumesActionsTest-1108413952-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:35.677275 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9e67ac3b-da0e-42a2-9cf0-e22bbf2d81b9 tempest-VolumesActionsTest-1108413952 tempest-VolumesActionsTest-1108413952-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:35.677991 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9e67ac3b-da0e-42a2-9cf0-e22bbf2d81b9 tempest-VolumesActionsTest-1108413952 tempest-VolumesActionsTest-1108413952-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:35.678492 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9e67ac3b-da0e-42a2-9cf0-e22bbf2d81b9 tempest-VolumesActionsTest-1108413952 tempest-VolumesActionsTest-1108413952-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:35.678961 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9e67ac3b-da0e-42a2-9cf0-e22bbf2d81b9 tempest-VolumesActionsTest-1108413952 tempest-VolumesActionsTest-1108413952-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:35.747099 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-9e67ac3b-da0e-42a2-9cf0-e22bbf2d81b9 tempest-VolumesActionsTest-1108413952 tempest-VolumesActionsTest-1108413952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037ea1eef49c4f7fba0dec413ce15e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c7a88417a446cd87a91bf19ef81232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:13:35.755454 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-9e67ac3b-da0e-42a2-9cf0-e22bbf2d81b9 tempest-VolumesActionsTest-1108413952 tempest-VolumesActionsTest-1108413952-project] 10.222.0.18 "GET /compute/v2.1/servers/75885b47-51e4-4752-8150-00dff6c524f6" status: 200 len: 1266 microversion: 2.1 time: 0.093919 Oct 22 21:13:35.756024 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2318/4619] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:13:35 2022] GET /compute/v2.1/servers/75885b47-51e4-4752-8150-00dff6c524f6 => generated 1266 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:13:35.930514 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-9c1d0be9-0ef4-4d49-98b5-c94258fd0d43 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:13:35.931108 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-9c1d0be9-0ef4-4d49-98b5-c94258fd0d43 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] [instance: 955c9477-85e2-4d95-ab3b-035dbf7d5a03] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:13:35.939599 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9c1d0be9-0ef4-4d49-98b5-c94258fd0d43 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:35.940177 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9c1d0be9-0ef4-4d49-98b5-c94258fd0d43 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:35.940707 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9c1d0be9-0ef4-4d49-98b5-c94258fd0d43 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:35.941549 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9c1d0be9-0ef4-4d49-98b5-c94258fd0d43 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:35.942166 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9c1d0be9-0ef4-4d49-98b5-c94258fd0d43 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:35.942728 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9c1d0be9-0ef4-4d49-98b5-c94258fd0d43 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:36.032048 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-065febbd-cbfc-4b94-a18b-f5ea6dcd1ee4 tempest-TestVolumeBackupRestore-2071196610 tempest-TestVolumeBackupRestore-2071196610-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:13:36.032678 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-065febbd-cbfc-4b94-a18b-f5ea6dcd1ee4 tempest-TestVolumeBackupRestore-2071196610 tempest-TestVolumeBackupRestore-2071196610-project] [instance: 77705065-40b2-4fba-8cf9-def4abeae0e4] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:13:36.039525 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-065febbd-cbfc-4b94-a18b-f5ea6dcd1ee4 tempest-TestVolumeBackupRestore-2071196610 tempest-TestVolumeBackupRestore-2071196610-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:36.040307 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-065febbd-cbfc-4b94-a18b-f5ea6dcd1ee4 tempest-TestVolumeBackupRestore-2071196610 tempest-TestVolumeBackupRestore-2071196610-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:36.040939 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-065febbd-cbfc-4b94-a18b-f5ea6dcd1ee4 tempest-TestVolumeBackupRestore-2071196610 tempest-TestVolumeBackupRestore-2071196610-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:36.041679 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-065febbd-cbfc-4b94-a18b-f5ea6dcd1ee4 tempest-TestVolumeBackupRestore-2071196610 tempest-TestVolumeBackupRestore-2071196610-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:36.042155 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-065febbd-cbfc-4b94-a18b-f5ea6dcd1ee4 tempest-TestVolumeBackupRestore-2071196610 tempest-TestVolumeBackupRestore-2071196610-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:36.042768 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-065febbd-cbfc-4b94-a18b-f5ea6dcd1ee4 tempest-TestVolumeBackupRestore-2071196610 tempest-TestVolumeBackupRestore-2071196610-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:36.824166 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-9c1d0be9-0ef4-4d49-98b5-c94258fd0d43 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799f987b3aa7426ba5d7a464052d6490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87474d4b4c547abbfe6308b6dd8e1c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:13:36.833893 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-9c1d0be9-0ef4-4d49-98b5-c94258fd0d43 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] 10.222.0.18 "GET /compute/v2.1/servers/955c9477-85e2-4d95-ab3b-035dbf7d5a03" status: 200 len: 1321 microversion: 2.1 time: 0.908344 Oct 22 21:13:36.834665 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2302/4620] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:13:35 2022] GET /compute/v2.1/servers/955c9477-85e2-4d95-ab3b-035dbf7d5a03 => generated 1321 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:13:36.839151 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-1df9cf08-f9b0-4f83-bbfc-3e8935ddb2d0 req-fe1db28d-a9dc-49f9-88c1-4c0280b4122c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77705065-40b2-4fba-8cf9-def4abeae0e4", "name": "network-vif-plugged", "status": "completed", "tag": "77793879-ddc1-4a27-89fe-4f5537f05251"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:13:36.849285 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-1df9cf08-f9b0-4f83-bbfc-3e8935ddb2d0 req-fe1db28d-a9dc-49f9-88c1-4c0280b4122c service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:36.850439 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-1df9cf08-f9b0-4f83-bbfc-3e8935ddb2d0 req-fe1db28d-a9dc-49f9-88c1-4c0280b4122c service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:36.850976 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-1df9cf08-f9b0-4f83-bbfc-3e8935ddb2d0 req-fe1db28d-a9dc-49f9-88c1-4c0280b4122c service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:36.863682 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-065febbd-cbfc-4b94-a18b-f5ea6dcd1ee4 tempest-TestVolumeBackupRestore-2071196610 tempest-TestVolumeBackupRestore-2071196610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4464172f8d43a986f7de04724a8d52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba71430f3dc046f68faab18103ba9007', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:13:36.864916 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-1df9cf08-f9b0-4f83-bbfc-3e8935ddb2d0 req-fe1db28d-a9dc-49f9-88c1-4c0280b4122c service nova] Creating event network-vif-plugged:77793879-ddc1-4a27-89fe-4f5537f05251 for instance 77705065-40b2-4fba-8cf9-def4abeae0e4 on nch2-master-1 Oct 22 21:13:36.870558 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-1df9cf08-f9b0-4f83-bbfc-3e8935ddb2d0 req-fe1db28d-a9dc-49f9-88c1-4c0280b4122c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034676 Oct 22 21:13:36.874979 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2303/4621] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:13:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:13:36.882831 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-065febbd-cbfc-4b94-a18b-f5ea6dcd1ee4 tempest-TestVolumeBackupRestore-2071196610 tempest-TestVolumeBackupRestore-2071196610-project] 10.222.0.18 "GET /compute/v2.1/servers/77705065-40b2-4fba-8cf9-def4abeae0e4" status: 200 len: 1269 microversion: 2.1 time: 0.854827 Oct 22 21:13:36.885582 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2319/4622] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:13:36 2022] GET /compute/v2.1/servers/77705065-40b2-4fba-8cf9-def4abeae0e4 => generated 1269 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:13:36.888701 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-6fbcede3-3e6f-4915-ad67-e9a88ff5a49e tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:13:36.889990 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-6fbcede3-3e6f-4915-ad67-e9a88ff5a49e tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] [instance: 34dcd1da-b94c-426b-b08b-204ea287c8a2] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:13:36.897290 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-d174732f-385c-482a-b78e-b3439ff4f2c7 tempest-VolumesActionsTest-1108413952 tempest-VolumesActionsTest-1108413952-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:13:36.897998 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6fbcede3-3e6f-4915-ad67-e9a88ff5a49e tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:36.898841 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6fbcede3-3e6f-4915-ad67-e9a88ff5a49e tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:36.899711 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6fbcede3-3e6f-4915-ad67-e9a88ff5a49e tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:36.900621 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6fbcede3-3e6f-4915-ad67-e9a88ff5a49e tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:36.901507 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-d174732f-385c-482a-b78e-b3439ff4f2c7 tempest-VolumesActionsTest-1108413952 tempest-VolumesActionsTest-1108413952-project] [instance: 75885b47-51e4-4752-8150-00dff6c524f6] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:13:36.902174 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6fbcede3-3e6f-4915-ad67-e9a88ff5a49e tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:36.902922 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6fbcede3-3e6f-4915-ad67-e9a88ff5a49e tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:36.916456 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d174732f-385c-482a-b78e-b3439ff4f2c7 tempest-VolumesActionsTest-1108413952 tempest-VolumesActionsTest-1108413952-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:36.917334 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d174732f-385c-482a-b78e-b3439ff4f2c7 tempest-VolumesActionsTest-1108413952 tempest-VolumesActionsTest-1108413952-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:36.917867 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d174732f-385c-482a-b78e-b3439ff4f2c7 tempest-VolumesActionsTest-1108413952 tempest-VolumesActionsTest-1108413952-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:36.918819 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d174732f-385c-482a-b78e-b3439ff4f2c7 tempest-VolumesActionsTest-1108413952 tempest-VolumesActionsTest-1108413952-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:36.919512 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d174732f-385c-482a-b78e-b3439ff4f2c7 tempest-VolumesActionsTest-1108413952 tempest-VolumesActionsTest-1108413952-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:36.920046 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d174732f-385c-482a-b78e-b3439ff4f2c7 tempest-VolumesActionsTest-1108413952 tempest-VolumesActionsTest-1108413952-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:37.129777 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-d174732f-385c-482a-b78e-b3439ff4f2c7 tempest-VolumesActionsTest-1108413952 tempest-VolumesActionsTest-1108413952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037ea1eef49c4f7fba0dec413ce15e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c7a88417a446cd87a91bf19ef81232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:13:37.141282 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-d174732f-385c-482a-b78e-b3439ff4f2c7 tempest-VolumesActionsTest-1108413952 tempest-VolumesActionsTest-1108413952-project] 10.222.0.18 "GET /compute/v2.1/servers/75885b47-51e4-4752-8150-00dff6c524f6" status: 200 len: 1272 microversion: 2.1 time: 0.252934 Oct 22 21:13:37.142680 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2320/4623] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:13:36 2022] GET /compute/v2.1/servers/75885b47-51e4-4752-8150-00dff6c524f6 => generated 1272 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:13:37.342588 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-6fbcede3-3e6f-4915-ad67-e9a88ff5a49e tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:13:37.355635 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-6fbcede3-3e6f-4915-ad67-e9a88ff5a49e tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:13:37.357180 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-6fbcede3-3e6f-4915-ad67-e9a88ff5a49e tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:13:37.358364 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-6fbcede3-3e6f-4915-ad67-e9a88ff5a49e tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] 10.222.0.18 "GET /compute/v2.1/servers/34dcd1da-b94c-426b-b08b-204ea287c8a2" status: 200 len: 1722 microversion: 2.20 time: 0.481988 Oct 22 21:13:37.358936 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2304/4624] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:13:36 2022] GET /compute/v2.1/servers/34dcd1da-b94c-426b-b08b-204ea287c8a2 => generated 1722 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:13:37.859772 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-00bc8c0d-94c0-4e4e-8fc3-c7957f44d1d0 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:13:37.860735 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-00bc8c0d-94c0-4e4e-8fc3-c7957f44d1d0 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] [instance: 955c9477-85e2-4d95-ab3b-035dbf7d5a03] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:13:37.868626 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-00bc8c0d-94c0-4e4e-8fc3-c7957f44d1d0 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:37.869243 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-00bc8c0d-94c0-4e4e-8fc3-c7957f44d1d0 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:37.869611 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-00bc8c0d-94c0-4e4e-8fc3-c7957f44d1d0 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:37.870355 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-00bc8c0d-94c0-4e4e-8fc3-c7957f44d1d0 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:37.871031 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-00bc8c0d-94c0-4e4e-8fc3-c7957f44d1d0 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:37.871590 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-00bc8c0d-94c0-4e4e-8fc3-c7957f44d1d0 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:37.908571 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-0ca19160-d604-429b-9510-673ef441116c tempest-TestVolumeBackupRestore-2071196610 tempest-TestVolumeBackupRestore-2071196610-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:13:37.909195 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-0ca19160-d604-429b-9510-673ef441116c tempest-TestVolumeBackupRestore-2071196610 tempest-TestVolumeBackupRestore-2071196610-project] [instance: 77705065-40b2-4fba-8cf9-def4abeae0e4] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:13:37.915762 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0ca19160-d604-429b-9510-673ef441116c tempest-TestVolumeBackupRestore-2071196610 tempest-TestVolumeBackupRestore-2071196610-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:37.916493 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0ca19160-d604-429b-9510-673ef441116c tempest-TestVolumeBackupRestore-2071196610 tempest-TestVolumeBackupRestore-2071196610-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:37.917004 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0ca19160-d604-429b-9510-673ef441116c tempest-TestVolumeBackupRestore-2071196610 tempest-TestVolumeBackupRestore-2071196610-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:37.917911 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0ca19160-d604-429b-9510-673ef441116c tempest-TestVolumeBackupRestore-2071196610 tempest-TestVolumeBackupRestore-2071196610-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:37.918510 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0ca19160-d604-429b-9510-673ef441116c tempest-TestVolumeBackupRestore-2071196610 tempest-TestVolumeBackupRestore-2071196610-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:37.919530 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0ca19160-d604-429b-9510-673ef441116c tempest-TestVolumeBackupRestore-2071196610 tempest-TestVolumeBackupRestore-2071196610-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:38.172243 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-00bc8c0d-94c0-4e4e-8fc3-c7957f44d1d0 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799f987b3aa7426ba5d7a464052d6490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87474d4b4c547abbfe6308b6dd8e1c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:13:38.181358 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-00bc8c0d-94c0-4e4e-8fc3-c7957f44d1d0 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] 10.222.0.18 "GET /compute/v2.1/servers/955c9477-85e2-4d95-ab3b-035dbf7d5a03" status: 200 len: 1321 microversion: 2.1 time: 0.326122 Oct 22 21:13:38.196084 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2321/4625] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:13:37 2022] GET /compute/v2.1/servers/955c9477-85e2-4d95-ab3b-035dbf7d5a03 => generated 1321 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:13:38.204300 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-ccb5dbd3-7ba0-4fbe-af5b-d6fa31dd1daa tempest-VolumesActionsTest-1108413952 tempest-VolumesActionsTest-1108413952-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:13:38.204710 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-ccb5dbd3-7ba0-4fbe-af5b-d6fa31dd1daa tempest-VolumesActionsTest-1108413952 tempest-VolumesActionsTest-1108413952-project] [instance: 75885b47-51e4-4752-8150-00dff6c524f6] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:13:38.211857 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ccb5dbd3-7ba0-4fbe-af5b-d6fa31dd1daa tempest-VolumesActionsTest-1108413952 tempest-VolumesActionsTest-1108413952-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:38.212580 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ccb5dbd3-7ba0-4fbe-af5b-d6fa31dd1daa tempest-VolumesActionsTest-1108413952 tempest-VolumesActionsTest-1108413952-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:38.213010 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ccb5dbd3-7ba0-4fbe-af5b-d6fa31dd1daa tempest-VolumesActionsTest-1108413952 tempest-VolumesActionsTest-1108413952-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:38.213518 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-0ca19160-d604-429b-9510-673ef441116c tempest-TestVolumeBackupRestore-2071196610 tempest-TestVolumeBackupRestore-2071196610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4464172f8d43a986f7de04724a8d52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba71430f3dc046f68faab18103ba9007', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:13:38.214156 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ccb5dbd3-7ba0-4fbe-af5b-d6fa31dd1daa tempest-VolumesActionsTest-1108413952 tempest-VolumesActionsTest-1108413952-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:38.214632 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ccb5dbd3-7ba0-4fbe-af5b-d6fa31dd1daa tempest-VolumesActionsTest-1108413952 tempest-VolumesActionsTest-1108413952-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:38.215099 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ccb5dbd3-7ba0-4fbe-af5b-d6fa31dd1daa tempest-VolumesActionsTest-1108413952 tempest-VolumesActionsTest-1108413952-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:38.227535 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-0ca19160-d604-429b-9510-673ef441116c tempest-TestVolumeBackupRestore-2071196610 tempest-TestVolumeBackupRestore-2071196610-project] 10.222.0.18 "GET /compute/v2.1/servers/77705065-40b2-4fba-8cf9-def4abeae0e4" status: 200 len: 1269 microversion: 2.1 time: 0.322729 Oct 22 21:13:38.228395 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2305/4626] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:13:37 2022] GET /compute/v2.1/servers/77705065-40b2-4fba-8cf9-def4abeae0e4 => generated 1269 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:13:38.386287 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-02977e74-f71f-4b37-9a5c-261dae2eddd4 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:13:38.387031 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-02977e74-f71f-4b37-9a5c-261dae2eddd4 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] [instance: 34dcd1da-b94c-426b-b08b-204ea287c8a2] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:13:38.393947 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-02977e74-f71f-4b37-9a5c-261dae2eddd4 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:38.394477 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-02977e74-f71f-4b37-9a5c-261dae2eddd4 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:38.394902 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-02977e74-f71f-4b37-9a5c-261dae2eddd4 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:38.395664 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-02977e74-f71f-4b37-9a5c-261dae2eddd4 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:38.396119 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-02977e74-f71f-4b37-9a5c-261dae2eddd4 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:38.396536 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-02977e74-f71f-4b37-9a5c-261dae2eddd4 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:38.550911 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-ccb5dbd3-7ba0-4fbe-af5b-d6fa31dd1daa tempest-VolumesActionsTest-1108413952 tempest-VolumesActionsTest-1108413952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037ea1eef49c4f7fba0dec413ce15e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c7a88417a446cd87a91bf19ef81232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:13:38.559726 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-ccb5dbd3-7ba0-4fbe-af5b-d6fa31dd1daa tempest-VolumesActionsTest-1108413952 tempest-VolumesActionsTest-1108413952-project] 10.222.0.18 "GET /compute/v2.1/servers/75885b47-51e4-4752-8150-00dff6c524f6" status: 200 len: 1314 microversion: 2.1 time: 0.362422 Oct 22 21:13:38.560415 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2322/4627] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:13:38 2022] GET /compute/v2.1/servers/75885b47-51e4-4752-8150-00dff6c524f6 => generated 1314 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:13:38.629591 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-02977e74-f71f-4b37-9a5c-261dae2eddd4 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:13:38.645411 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-02977e74-f71f-4b37-9a5c-261dae2eddd4 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:13:38.647144 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-02977e74-f71f-4b37-9a5c-261dae2eddd4 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:13:38.648567 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-02977e74-f71f-4b37-9a5c-261dae2eddd4 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] 10.222.0.18 "GET /compute/v2.1/servers/34dcd1da-b94c-426b-b08b-204ea287c8a2" status: 200 len: 1722 microversion: 2.20 time: 0.266273 Oct 22 21:13:38.659769 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2306/4628] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:13:38 2022] GET /compute/v2.1/servers/34dcd1da-b94c-426b-b08b-204ea287c8a2 => generated 1722 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:13:39.140542 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-107e5913-cccf-495d-a5df-602fc33d7625 req-1e6c50ce-a25f-4543-be10-91c7ceee4c4c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "955c9477-85e2-4d95-ab3b-035dbf7d5a03", "name": "network-vif-plugged", "status": "completed", "tag": "661b6506-965b-46e7-8fa7-2e2f98a2d9d0"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:13:39.151313 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-107e5913-cccf-495d-a5df-602fc33d7625 req-1e6c50ce-a25f-4543-be10-91c7ceee4c4c service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:39.152113 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-107e5913-cccf-495d-a5df-602fc33d7625 req-1e6c50ce-a25f-4543-be10-91c7ceee4c4c service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:39.152806 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-107e5913-cccf-495d-a5df-602fc33d7625 req-1e6c50ce-a25f-4543-be10-91c7ceee4c4c service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:39.167697 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-107e5913-cccf-495d-a5df-602fc33d7625 req-1e6c50ce-a25f-4543-be10-91c7ceee4c4c service nova] Creating event network-vif-plugged:661b6506-965b-46e7-8fa7-2e2f98a2d9d0 for instance 955c9477-85e2-4d95-ab3b-035dbf7d5a03 on nch1-master-1 Oct 22 21:13:39.173087 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-107e5913-cccf-495d-a5df-602fc33d7625 req-1e6c50ce-a25f-4543-be10-91c7ceee4c4c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036482 Oct 22 21:13:39.173786 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2323/4629] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:13:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:13:39.194010 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-8150ed45-b603-4ba7-add3-4171930e222a req-6ac7fa32-c54e-41d9-b3d7-7562f8641927 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75885b47-51e4-4752-8150-00dff6c524f6", "tag": "20d578f5-f035-4fa8-aeda-a0849361750e"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:13:39.205014 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-8150ed45-b603-4ba7-add3-4171930e222a req-6ac7fa32-c54e-41d9-b3d7-7562f8641927 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:39.205878 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-8150ed45-b603-4ba7-add3-4171930e222a req-6ac7fa32-c54e-41d9-b3d7-7562f8641927 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:39.206491 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-8150ed45-b603-4ba7-add3-4171930e222a req-6ac7fa32-c54e-41d9-b3d7-7562f8641927 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:39.214010 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-832865d8-ebcf-4f18-9287-76dafe4121a4 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:13:39.218832 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-832865d8-ebcf-4f18-9287-76dafe4121a4 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] [instance: 955c9477-85e2-4d95-ab3b-035dbf7d5a03] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:13:39.219504 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-8150ed45-b603-4ba7-add3-4171930e222a req-6ac7fa32-c54e-41d9-b3d7-7562f8641927 service nova] Creating event network-changed:20d578f5-f035-4fa8-aeda-a0849361750e for instance 75885b47-51e4-4752-8150-00dff6c524f6 on nch2-master-1 Oct 22 21:13:39.224866 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-8150ed45-b603-4ba7-add3-4171930e222a req-6ac7fa32-c54e-41d9-b3d7-7562f8641927 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035149 Oct 22 21:13:39.226348 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2307/4630] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:13:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:13:39.237940 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-832865d8-ebcf-4f18-9287-76dafe4121a4 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:39.238540 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-832865d8-ebcf-4f18-9287-76dafe4121a4 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:39.239058 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-832865d8-ebcf-4f18-9287-76dafe4121a4 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:39.239951 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-832865d8-ebcf-4f18-9287-76dafe4121a4 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:39.241164 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-832865d8-ebcf-4f18-9287-76dafe4121a4 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:39.242031 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-832865d8-ebcf-4f18-9287-76dafe4121a4 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:39.253714 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-12c9bc96-5630-47f1-8b7c-b15338f7d884 tempest-TestVolumeBackupRestore-2071196610 tempest-TestVolumeBackupRestore-2071196610-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:13:39.254943 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-12c9bc96-5630-47f1-8b7c-b15338f7d884 tempest-TestVolumeBackupRestore-2071196610 tempest-TestVolumeBackupRestore-2071196610-project] [instance: 77705065-40b2-4fba-8cf9-def4abeae0e4] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:13:39.266669 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-12c9bc96-5630-47f1-8b7c-b15338f7d884 tempest-TestVolumeBackupRestore-2071196610 tempest-TestVolumeBackupRestore-2071196610-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:39.267186 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-12c9bc96-5630-47f1-8b7c-b15338f7d884 tempest-TestVolumeBackupRestore-2071196610 tempest-TestVolumeBackupRestore-2071196610-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:39.267752 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-12c9bc96-5630-47f1-8b7c-b15338f7d884 tempest-TestVolumeBackupRestore-2071196610 tempest-TestVolumeBackupRestore-2071196610-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:39.268551 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-12c9bc96-5630-47f1-8b7c-b15338f7d884 tempest-TestVolumeBackupRestore-2071196610 tempest-TestVolumeBackupRestore-2071196610-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:39.269010 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-12c9bc96-5630-47f1-8b7c-b15338f7d884 tempest-TestVolumeBackupRestore-2071196610 tempest-TestVolumeBackupRestore-2071196610-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:39.269446 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-12c9bc96-5630-47f1-8b7c-b15338f7d884 tempest-TestVolumeBackupRestore-2071196610 tempest-TestVolumeBackupRestore-2071196610-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:39.926017 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-832865d8-ebcf-4f18-9287-76dafe4121a4 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799f987b3aa7426ba5d7a464052d6490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87474d4b4c547abbfe6308b6dd8e1c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:13:39.930688 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-12c9bc96-5630-47f1-8b7c-b15338f7d884 tempest-TestVolumeBackupRestore-2071196610 tempest-TestVolumeBackupRestore-2071196610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4464172f8d43a986f7de04724a8d52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba71430f3dc046f68faab18103ba9007', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:13:39.935492 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-832865d8-ebcf-4f18-9287-76dafe4121a4 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] 10.222.0.18 "GET /compute/v2.1/servers/955c9477-85e2-4d95-ab3b-035dbf7d5a03" status: 200 len: 1321 microversion: 2.1 time: 0.730187 Oct 22 21:13:39.951210 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-12c9bc96-5630-47f1-8b7c-b15338f7d884 tempest-TestVolumeBackupRestore-2071196610 tempest-TestVolumeBackupRestore-2071196610-project] 10.222.0.18 "GET /compute/v2.1/servers/77705065-40b2-4fba-8cf9-def4abeae0e4" status: 200 len: 1459 microversion: 2.1 time: 0.692129 Oct 22 21:13:39.951210 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2308/4631] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:13:39 2022] GET /compute/v2.1/servers/77705065-40b2-4fba-8cf9-def4abeae0e4 => generated 1459 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:13:39.951210 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-d4f448a7-83c5-410d-a408-6d6ee9608cd7 tempest-VolumesActionsTest-1108413952 tempest-VolumesActionsTest-1108413952-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:13:39.951210 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-d4f448a7-83c5-410d-a408-6d6ee9608cd7 tempest-VolumesActionsTest-1108413952 tempest-VolumesActionsTest-1108413952-project] [instance: 75885b47-51e4-4752-8150-00dff6c524f6] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:13:39.953148 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2324/4632] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:13:39 2022] GET /compute/v2.1/servers/955c9477-85e2-4d95-ab3b-035dbf7d5a03 => generated 1321 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:13:39.953794 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d4f448a7-83c5-410d-a408-6d6ee9608cd7 tempest-VolumesActionsTest-1108413952 tempest-VolumesActionsTest-1108413952-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:39.954417 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d4f448a7-83c5-410d-a408-6d6ee9608cd7 tempest-VolumesActionsTest-1108413952 tempest-VolumesActionsTest-1108413952-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:39.954909 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d4f448a7-83c5-410d-a408-6d6ee9608cd7 tempest-VolumesActionsTest-1108413952 tempest-VolumesActionsTest-1108413952-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:39.955656 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d4f448a7-83c5-410d-a408-6d6ee9608cd7 tempest-VolumesActionsTest-1108413952 tempest-VolumesActionsTest-1108413952-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:39.956113 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d4f448a7-83c5-410d-a408-6d6ee9608cd7 tempest-VolumesActionsTest-1108413952 tempest-VolumesActionsTest-1108413952-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:39.956565 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d4f448a7-83c5-410d-a408-6d6ee9608cd7 tempest-VolumesActionsTest-1108413952 tempest-VolumesActionsTest-1108413952-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:39.959775 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-6808941f-32e6-4b8a-ab63-b9009d32dacc tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:13:39.960591 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-6808941f-32e6-4b8a-ab63-b9009d32dacc tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] [instance: 34dcd1da-b94c-426b-b08b-204ea287c8a2] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:13:39.968388 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6808941f-32e6-4b8a-ab63-b9009d32dacc tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:39.968867 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6808941f-32e6-4b8a-ab63-b9009d32dacc tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:39.969371 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6808941f-32e6-4b8a-ab63-b9009d32dacc tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:39.970128 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6808941f-32e6-4b8a-ab63-b9009d32dacc tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:39.970609 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6808941f-32e6-4b8a-ab63-b9009d32dacc tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:39.971115 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6808941f-32e6-4b8a-ab63-b9009d32dacc tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:40.219637 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-6808941f-32e6-4b8a-ab63-b9009d32dacc tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:13:40.230169 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-6808941f-32e6-4b8a-ab63-b9009d32dacc tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:13:40.230814 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-d4f448a7-83c5-410d-a408-6d6ee9608cd7 tempest-VolumesActionsTest-1108413952 tempest-VolumesActionsTest-1108413952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037ea1eef49c4f7fba0dec413ce15e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c7a88417a446cd87a91bf19ef81232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:13:40.231970 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-6808941f-32e6-4b8a-ab63-b9009d32dacc tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:13:40.233335 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-6808941f-32e6-4b8a-ab63-b9009d32dacc tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] 10.222.0.18 "GET /compute/v2.1/servers/34dcd1da-b94c-426b-b08b-204ea287c8a2" status: 200 len: 1722 microversion: 2.20 time: 0.278617 Oct 22 21:13:40.233910 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2325/4633] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:13:39 2022] GET /compute/v2.1/servers/34dcd1da-b94c-426b-b08b-204ea287c8a2 => generated 1722 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:13:40.239551 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-3ca1d0bc-a949-4184-a673-fc26c5d27a1c tempest-TestVolumeBackupRestore-2071196610 tempest-TestVolumeBackupRestore-2071196610-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:13:40.240944 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-3ca1d0bc-a949-4184-a673-fc26c5d27a1c tempest-TestVolumeBackupRestore-2071196610 tempest-TestVolumeBackupRestore-2071196610-project] [instance: 77705065-40b2-4fba-8cf9-def4abeae0e4] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:13:40.246390 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-d4f448a7-83c5-410d-a408-6d6ee9608cd7 tempest-VolumesActionsTest-1108413952 tempest-VolumesActionsTest-1108413952-project] 10.222.0.18 "GET /compute/v2.1/servers/75885b47-51e4-4752-8150-00dff6c524f6" status: 200 len: 1314 microversion: 2.1 time: 0.303065 Oct 22 21:13:40.247288 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2309/4634] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:13:39 2022] GET /compute/v2.1/servers/75885b47-51e4-4752-8150-00dff6c524f6 => generated 1314 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:13:40.278509 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3ca1d0bc-a949-4184-a673-fc26c5d27a1c tempest-TestVolumeBackupRestore-2071196610 tempest-TestVolumeBackupRestore-2071196610-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:40.279042 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3ca1d0bc-a949-4184-a673-fc26c5d27a1c tempest-TestVolumeBackupRestore-2071196610 tempest-TestVolumeBackupRestore-2071196610-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:40.279490 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3ca1d0bc-a949-4184-a673-fc26c5d27a1c tempest-TestVolumeBackupRestore-2071196610 tempest-TestVolumeBackupRestore-2071196610-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:40.282107 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3ca1d0bc-a949-4184-a673-fc26c5d27a1c tempest-TestVolumeBackupRestore-2071196610 tempest-TestVolumeBackupRestore-2071196610-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:40.282588 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3ca1d0bc-a949-4184-a673-fc26c5d27a1c tempest-TestVolumeBackupRestore-2071196610 tempest-TestVolumeBackupRestore-2071196610-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:40.283055 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3ca1d0bc-a949-4184-a673-fc26c5d27a1c tempest-TestVolumeBackupRestore-2071196610 tempest-TestVolumeBackupRestore-2071196610-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:40.581251 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-3ca1d0bc-a949-4184-a673-fc26c5d27a1c tempest-TestVolumeBackupRestore-2071196610 tempest-TestVolumeBackupRestore-2071196610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4464172f8d43a986f7de04724a8d52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba71430f3dc046f68faab18103ba9007', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:13:40.590242 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-3ca1d0bc-a949-4184-a673-fc26c5d27a1c tempest-TestVolumeBackupRestore-2071196610 tempest-TestVolumeBackupRestore-2071196610-project] 10.222.0.18 "GET /compute/v2.1/servers/77705065-40b2-4fba-8cf9-def4abeae0e4" status: 200 len: 1459 microversion: 2.1 time: 0.354845 Oct 22 21:13:40.591427 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2326/4635] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:13:40 2022] GET /compute/v2.1/servers/77705065-40b2-4fba-8cf9-def4abeae0e4 => generated 1459 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:13:40.958452 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-174c883a-3a1a-4874-aa3d-342669255248 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:13:40.959140 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-174c883a-3a1a-4874-aa3d-342669255248 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] [instance: 955c9477-85e2-4d95-ab3b-035dbf7d5a03] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:13:40.973257 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-174c883a-3a1a-4874-aa3d-342669255248 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:40.973920 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-174c883a-3a1a-4874-aa3d-342669255248 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:40.974411 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-174c883a-3a1a-4874-aa3d-342669255248 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:40.975584 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-174c883a-3a1a-4874-aa3d-342669255248 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:40.976029 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-174c883a-3a1a-4874-aa3d-342669255248 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:40.976518 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-174c883a-3a1a-4874-aa3d-342669255248 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:41.209031 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-a3cad7cf-b98a-48b8-8466-340c2a6cb6b5 req-759be256-b33c-4cd7-a5f5-79fa0c7d4a3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34dcd1da-b94c-426b-b08b-204ea287c8a2", "name": "network-vif-unplugged", "status": "completed", "tag": "692705ac-81f3-4f8a-bfa8-a2581d7d7567"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:13:41.229395 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-a3cad7cf-b98a-48b8-8466-340c2a6cb6b5 req-759be256-b33c-4cd7-a5f5-79fa0c7d4a3a service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:41.230275 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-a3cad7cf-b98a-48b8-8466-340c2a6cb6b5 req-759be256-b33c-4cd7-a5f5-79fa0c7d4a3a service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:41.230946 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-a3cad7cf-b98a-48b8-8466-340c2a6cb6b5 req-759be256-b33c-4cd7-a5f5-79fa0c7d4a3a service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:41.250079 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-174c883a-3a1a-4874-aa3d-342669255248 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799f987b3aa7426ba5d7a464052d6490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87474d4b4c547abbfe6308b6dd8e1c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:13:41.254443 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.compute.server_external_events [req-a3cad7cf-b98a-48b8-8466-340c2a6cb6b5 req-759be256-b33c-4cd7-a5f5-79fa0c7d4a3a service nova] Unable to find a host for instance 34dcd1da-b94c-426b-b08b-204ea287c8a2. Dropping event network-vif-unplugged {{(pid=138745) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 22 21:13:41.255397 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-a3cad7cf-b98a-48b8-8466-340c2a6cb6b5 req-759be256-b33c-4cd7-a5f5-79fa0c7d4a3a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.051730 Oct 22 21:13:41.260810 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-174c883a-3a1a-4874-aa3d-342669255248 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] 10.222.0.18 "GET /compute/v2.1/servers/955c9477-85e2-4d95-ab3b-035dbf7d5a03" status: 200 len: 1321 microversion: 2.1 time: 0.306209 Oct 22 21:13:41.261317 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2327/4636] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:13:41 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 58 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Oct 22 21:13:41.262521 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2310/4637] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:13:40 2022] GET /compute/v2.1/servers/955c9477-85e2-4d95-ab3b-035dbf7d5a03 => generated 1321 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:13:41.291213 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-c4a6c578-50a7-43ce-a9e2-a86f779d105d tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:13:41.292901 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-c5079f56-7322-4993-a4ac-6cc5af42dae1 tempest-VolumesActionsTest-1108413952 tempest-VolumesActionsTest-1108413952-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:13:41.293780 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-c5079f56-7322-4993-a4ac-6cc5af42dae1 tempest-VolumesActionsTest-1108413952 tempest-VolumesActionsTest-1108413952-project] [instance: 75885b47-51e4-4752-8150-00dff6c524f6] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:13:41.296542 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-c4a6c578-50a7-43ce-a9e2-a86f779d105d tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] [instance: 34dcd1da-b94c-426b-b08b-204ea287c8a2] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:13:41.310754 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c5079f56-7322-4993-a4ac-6cc5af42dae1 tempest-VolumesActionsTest-1108413952 tempest-VolumesActionsTest-1108413952-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:41.311240 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c4a6c578-50a7-43ce-a9e2-a86f779d105d tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:41.312597 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c5079f56-7322-4993-a4ac-6cc5af42dae1 tempest-VolumesActionsTest-1108413952 tempest-VolumesActionsTest-1108413952-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:41.313346 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c4a6c578-50a7-43ce-a9e2-a86f779d105d tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:41.313782 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c5079f56-7322-4993-a4ac-6cc5af42dae1 tempest-VolumesActionsTest-1108413952 tempest-VolumesActionsTest-1108413952-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:41.314315 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c4a6c578-50a7-43ce-a9e2-a86f779d105d tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:41.315894 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c5079f56-7322-4993-a4ac-6cc5af42dae1 tempest-VolumesActionsTest-1108413952 tempest-VolumesActionsTest-1108413952-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:41.316319 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c4a6c578-50a7-43ce-a9e2-a86f779d105d tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:41.317968 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c5079f56-7322-4993-a4ac-6cc5af42dae1 tempest-VolumesActionsTest-1108413952 tempest-VolumesActionsTest-1108413952-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:41.318519 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c4a6c578-50a7-43ce-a9e2-a86f779d105d tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:41.319046 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c5079f56-7322-4993-a4ac-6cc5af42dae1 tempest-VolumesActionsTest-1108413952 tempest-VolumesActionsTest-1108413952-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:41.319702 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c4a6c578-50a7-43ce-a9e2-a86f779d105d tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:41.600420 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-c5079f56-7322-4993-a4ac-6cc5af42dae1 tempest-VolumesActionsTest-1108413952 tempest-VolumesActionsTest-1108413952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037ea1eef49c4f7fba0dec413ce15e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c7a88417a446cd87a91bf19ef81232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:13:41.610228 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-c5079f56-7322-4993-a4ac-6cc5af42dae1 tempest-VolumesActionsTest-1108413952 tempest-VolumesActionsTest-1108413952-project] 10.222.0.18 "GET /compute/v2.1/servers/75885b47-51e4-4752-8150-00dff6c524f6" status: 200 len: 1314 microversion: 2.1 time: 0.330773 Oct 22 21:13:41.611131 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2311/4638] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:13:41 2022] GET /compute/v2.1/servers/75885b47-51e4-4752-8150-00dff6c524f6 => generated 1314 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:13:41.623864 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-882e9df7-1450-423d-8bad-d7104d4185f5 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:13:41.624651 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-882e9df7-1450-423d-8bad-d7104d4185f5 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] [instance: 9dd3ccc4-26f1-4d75-b990-6636ed02293e] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:13:41.631812 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-882e9df7-1450-423d-8bad-d7104d4185f5 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:41.632314 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-882e9df7-1450-423d-8bad-d7104d4185f5 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:41.633414 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-882e9df7-1450-423d-8bad-d7104d4185f5 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:41.634156 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-882e9df7-1450-423d-8bad-d7104d4185f5 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:41.634303 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-c4a6c578-50a7-43ce-a9e2-a86f779d105d tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:13:41.634950 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-882e9df7-1450-423d-8bad-d7104d4185f5 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:41.635685 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-882e9df7-1450-423d-8bad-d7104d4185f5 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:41.647302 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-c4a6c578-50a7-43ce-a9e2-a86f779d105d tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:13:41.649364 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-c4a6c578-50a7-43ce-a9e2-a86f779d105d tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:13:41.651218 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-c4a6c578-50a7-43ce-a9e2-a86f779d105d tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] 10.222.0.18 "GET /compute/v2.1/servers/34dcd1da-b94c-426b-b08b-204ea287c8a2" status: 200 len: 1665 microversion: 2.20 time: 0.372473 Oct 22 21:13:41.652412 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2328/4639] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:13:41 2022] GET /compute/v2.1/servers/34dcd1da-b94c-426b-b08b-204ea287c8a2 => generated 1665 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:13:41.659574 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-fd852d4c-fed2-4072-aeec-508a242ed149 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:13:41.661602 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-fd852d4c-fed2-4072-aeec-508a242ed149 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] [instance: 4d285bc1-33a9-47e0-a148-756be61c0488] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:13:41.670818 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fd852d4c-fed2-4072-aeec-508a242ed149 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:41.671368 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fd852d4c-fed2-4072-aeec-508a242ed149 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:41.671834 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fd852d4c-fed2-4072-aeec-508a242ed149 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:41.672580 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fd852d4c-fed2-4072-aeec-508a242ed149 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:41.673185 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fd852d4c-fed2-4072-aeec-508a242ed149 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:41.673775 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fd852d4c-fed2-4072-aeec-508a242ed149 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:41.682757 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-882e9df7-1450-423d-8bad-d7104d4185f5 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] 10.222.0.18 "GET /compute/v2.1/servers/9dd3ccc4-26f1-4d75-b990-6636ed02293e/ips" status: 200 len: 147 microversion: 2.1 time: 0.065900 Oct 22 21:13:41.685432 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2312/4640] 10.222.0.18 () {58 vars in 1248 bytes} [Sat Oct 22 21:13:41 2022] GET /compute/v2.1/servers/9dd3ccc4-26f1-4d75-b990-6636ed02293e/ips => generated 147 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 21:13:41.701159 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-ac8ae19e-32d3-48d4-8d5b-b837e0db2e4d tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cd8c9d9a-c8b6-4103-804b-d25128f1cb17"}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:13:41.705242 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-ac8ae19e-32d3-48d4-8d5b-b837e0db2e4d tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] [instance: 34dcd1da-b94c-426b-b08b-204ea287c8a2] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:13:41.715319 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ac8ae19e-32d3-48d4-8d5b-b837e0db2e4d tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:41.716235 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ac8ae19e-32d3-48d4-8d5b-b837e0db2e4d tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:41.716752 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ac8ae19e-32d3-48d4-8d5b-b837e0db2e4d tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:41.717463 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ac8ae19e-32d3-48d4-8d5b-b837e0db2e4d tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:41.718084 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ac8ae19e-32d3-48d4-8d5b-b837e0db2e4d tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:41.718717 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ac8ae19e-32d3-48d4-8d5b-b837e0db2e4d tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:41.906456 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-fd852d4c-fed2-4072-aeec-508a242ed149 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd69c1f0203b047eeb6a9fa0a215a63c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09185bfad7944b199a490305c22ffc3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:13:41.917536 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-fd852d4c-fed2-4072-aeec-508a242ed149 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd69c1f0203b047eeb6a9fa0a215a63c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09185bfad7944b199a490305c22ffc3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:13:41.919874 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-fd852d4c-fed2-4072-aeec-508a242ed149 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd69c1f0203b047eeb6a9fa0a215a63c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09185bfad7944b199a490305c22ffc3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:13:41.921689 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-fd852d4c-fed2-4072-aeec-508a242ed149 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] 10.222.0.18 "GET /compute/v2.1/servers/4d285bc1-33a9-47e0-a148-756be61c0488" status: 200 len: 2950 microversion: 2.32 time: 0.267678 Oct 22 21:13:41.922889 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2329/4641] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:13:41 2022] GET /compute/v2.1/servers/4d285bc1-33a9-47e0-a148-756be61c0488 => generated 2950 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:13:41.949832 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-27ccd22c-adfb-4d5c-a857-6f47747703f8 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:13:41.950356 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-27ccd22c-adfb-4d5c-a857-6f47747703f8 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] [instance: 4d285bc1-33a9-47e0-a148-756be61c0488] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:13:41.957316 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-27ccd22c-adfb-4d5c-a857-6f47747703f8 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:41.958034 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-27ccd22c-adfb-4d5c-a857-6f47747703f8 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:41.958655 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-27ccd22c-adfb-4d5c-a857-6f47747703f8 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:41.959645 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-27ccd22c-adfb-4d5c-a857-6f47747703f8 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:41.960110 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-27ccd22c-adfb-4d5c-a857-6f47747703f8 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:41.960747 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-27ccd22c-adfb-4d5c-a857-6f47747703f8 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:42.156466 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-27ccd22c-adfb-4d5c-a857-6f47747703f8 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] 10.222.0.18 "GET /compute/v2.1/servers/4d285bc1-33a9-47e0-a148-756be61c0488/os-interface" status: 200 len: 1832 microversion: 2.32 time: 0.210533 Oct 22 21:13:42.157772 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2330/4642] 10.222.0.18 () {60 vars in 1316 bytes} [Sat Oct 22 21:13:41 2022] GET /compute/v2.1/servers/4d285bc1-33a9-47e0-a148-756be61c0488/os-interface => generated 1832 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 22 21:13:42.177016 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-ac8ae19e-32d3-48d4-8d5b-b837e0db2e4d tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] 10.222.0.18 "POST /compute/v2.1/servers/34dcd1da-b94c-426b-b08b-204ea287c8a2/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.489708 Oct 22 21:13:42.177760 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2313/4643] 10.222.0.18 () {62 vars in 1364 bytes} [Sat Oct 22 21:13:41 2022] POST /compute/v2.1/servers/34dcd1da-b94c-426b-b08b-204ea287c8a2/os-volume_attachments => generated 188 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 22 21:13:42.288155 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-29aa2bea-f567-4714-828e-769e4da249c1 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:13:42.289765 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-29aa2bea-f567-4714-828e-769e4da249c1 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] [instance: 955c9477-85e2-4d95-ab3b-035dbf7d5a03] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:13:42.301701 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-29aa2bea-f567-4714-828e-769e4da249c1 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:42.315722 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-29aa2bea-f567-4714-828e-769e4da249c1 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:42.315722 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-29aa2bea-f567-4714-828e-769e4da249c1 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:42.315722 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-29aa2bea-f567-4714-828e-769e4da249c1 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:42.315722 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-29aa2bea-f567-4714-828e-769e4da249c1 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:42.315722 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-29aa2bea-f567-4714-828e-769e4da249c1 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:42.333473 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-70a94dcb-5407-4f50-94f8-ec1d57061b46 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:13:42.334060 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-70a94dcb-5407-4f50-94f8-ec1d57061b46 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] [instance: 34dcd1da-b94c-426b-b08b-204ea287c8a2] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:13:42.344401 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-70a94dcb-5407-4f50-94f8-ec1d57061b46 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:42.345146 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-70a94dcb-5407-4f50-94f8-ec1d57061b46 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:42.345624 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-70a94dcb-5407-4f50-94f8-ec1d57061b46 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:42.346360 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-70a94dcb-5407-4f50-94f8-ec1d57061b46 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:42.346820 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-70a94dcb-5407-4f50-94f8-ec1d57061b46 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:42.347253 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-70a94dcb-5407-4f50-94f8-ec1d57061b46 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:42.484815 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:SELECT=90,nova_cell1:INSERT=5,nova_cell1:UPDATE=5 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:13:42.488486 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-29aa2bea-f567-4714-828e-769e4da249c1 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799f987b3aa7426ba5d7a464052d6490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87474d4b4c547abbfe6308b6dd8e1c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:13:42.499441 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-29aa2bea-f567-4714-828e-769e4da249c1 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] 10.222.0.18 "GET /compute/v2.1/servers/955c9477-85e2-4d95-ab3b-035dbf7d5a03" status: 200 len: 1503 microversion: 2.1 time: 0.219324 Oct 22 21:13:42.500846 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2331/4644] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:13:42 2022] GET /compute/v2.1/servers/955c9477-85e2-4d95-ab3b-035dbf7d5a03 => generated 1503 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:13:42.523523 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-e65f2f68-5479-44ce-8927-88d9064b51ad tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:13:42.524240 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-e65f2f68-5479-44ce-8927-88d9064b51ad tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] [instance: 955c9477-85e2-4d95-ab3b-035dbf7d5a03] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:13:42.532294 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e65f2f68-5479-44ce-8927-88d9064b51ad tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:42.532921 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e65f2f68-5479-44ce-8927-88d9064b51ad tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:42.533452 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e65f2f68-5479-44ce-8927-88d9064b51ad tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:42.534296 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e65f2f68-5479-44ce-8927-88d9064b51ad tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:42.535016 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e65f2f68-5479-44ce-8927-88d9064b51ad tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:42.535717 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e65f2f68-5479-44ce-8927-88d9064b51ad tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:42.669544 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-70a94dcb-5407-4f50-94f8-ec1d57061b46 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] 10.222.0.18 "DELETE /compute/v2.1/servers/34dcd1da-b94c-426b-b08b-204ea287c8a2/os-volume_attachments/cd8c9d9a-c8b6-4103-804b-d25128f1cb17" status: 202 len: 0 microversion: 2.20 time: 0.346461 Oct 22 21:13:42.670564 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2314/4645] 10.222.0.18 () {60 vars in 1457 bytes} [Sat Oct 22 21:13:42 2022] DELETE /compute/v2.1/servers/34dcd1da-b94c-426b-b08b-204ea287c8a2/os-volume_attachments/cd8c9d9a-c8b6-4103-804b-d25128f1cb17 => generated 0 bytes in 350 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 22 21:13:42.677590 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-0050f363-532e-4c67-a0e5-bc2623543afc tempest-VolumesActionsTest-1108413952 tempest-VolumesActionsTest-1108413952-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:13:42.678711 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-0050f363-532e-4c67-a0e5-bc2623543afc tempest-VolumesActionsTest-1108413952 tempest-VolumesActionsTest-1108413952-project] [instance: 75885b47-51e4-4752-8150-00dff6c524f6] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:13:42.688097 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0050f363-532e-4c67-a0e5-bc2623543afc tempest-VolumesActionsTest-1108413952 tempest-VolumesActionsTest-1108413952-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:42.688881 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0050f363-532e-4c67-a0e5-bc2623543afc tempest-VolumesActionsTest-1108413952 tempest-VolumesActionsTest-1108413952-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:42.689331 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0050f363-532e-4c67-a0e5-bc2623543afc tempest-VolumesActionsTest-1108413952 tempest-VolumesActionsTest-1108413952-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:42.690136 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0050f363-532e-4c67-a0e5-bc2623543afc tempest-VolumesActionsTest-1108413952 tempest-VolumesActionsTest-1108413952-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:42.690635 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0050f363-532e-4c67-a0e5-bc2623543afc tempest-VolumesActionsTest-1108413952 tempest-VolumesActionsTest-1108413952-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:42.691078 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0050f363-532e-4c67-a0e5-bc2623543afc tempest-VolumesActionsTest-1108413952 tempest-VolumesActionsTest-1108413952-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:42.735859 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-e65f2f68-5479-44ce-8927-88d9064b51ad tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799f987b3aa7426ba5d7a464052d6490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87474d4b4c547abbfe6308b6dd8e1c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:13:42.745527 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-e65f2f68-5479-44ce-8927-88d9064b51ad tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] 10.222.0.18 "GET /compute/v2.1/servers/955c9477-85e2-4d95-ab3b-035dbf7d5a03" status: 200 len: 1503 microversion: 2.1 time: 0.226354 Oct 22 21:13:42.746163 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2332/4646] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:13:42 2022] GET /compute/v2.1/servers/955c9477-85e2-4d95-ab3b-035dbf7d5a03 => generated 1503 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:13:42.767739 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-b502c728-1ac7-4341-ae66-087c5e4fa79a tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:13:42.768376 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-b502c728-1ac7-4341-ae66-087c5e4fa79a tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] [instance: 34dcd1da-b94c-426b-b08b-204ea287c8a2] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:13:42.775076 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b502c728-1ac7-4341-ae66-087c5e4fa79a tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:42.775612 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b502c728-1ac7-4341-ae66-087c5e4fa79a tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:42.776073 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b502c728-1ac7-4341-ae66-087c5e4fa79a tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:42.776804 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b502c728-1ac7-4341-ae66-087c5e4fa79a tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:42.777289 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b502c728-1ac7-4341-ae66-087c5e4fa79a tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:42.777785 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b502c728-1ac7-4341-ae66-087c5e4fa79a tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:42.798363 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell1:SELECT=100 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:13:42.813803 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-b502c728-1ac7-4341-ae66-087c5e4fa79a tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] [instance: 34dcd1da-b94c-426b-b08b-204ea287c8a2] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=138745) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 22 21:13:42.861132 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-0050f363-532e-4c67-a0e5-bc2623543afc tempest-VolumesActionsTest-1108413952 tempest-VolumesActionsTest-1108413952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037ea1eef49c4f7fba0dec413ce15e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c7a88417a446cd87a91bf19ef81232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:13:42.870329 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-0050f363-532e-4c67-a0e5-bc2623543afc tempest-VolumesActionsTest-1108413952 tempest-VolumesActionsTest-1108413952-project] 10.222.0.18 "GET /compute/v2.1/servers/75885b47-51e4-4752-8150-00dff6c524f6" status: 200 len: 1314 microversion: 2.1 time: 0.198090 Oct 22 21:13:42.871418 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2315/4647] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:13:42 2022] GET /compute/v2.1/servers/75885b47-51e4-4752-8150-00dff6c524f6 => generated 1314 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:13:42.877059 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-c8f2e3e7-8272-4f8a-bc82-184e702f956f tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:13:42.877654 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-c8f2e3e7-8272-4f8a-bc82-184e702f956f tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] [instance: 955c9477-85e2-4d95-ab3b-035dbf7d5a03] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:13:42.884543 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c8f2e3e7-8272-4f8a-bc82-184e702f956f tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:42.885161 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c8f2e3e7-8272-4f8a-bc82-184e702f956f tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:42.885623 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c8f2e3e7-8272-4f8a-bc82-184e702f956f tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:42.886450 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c8f2e3e7-8272-4f8a-bc82-184e702f956f tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:42.886978 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c8f2e3e7-8272-4f8a-bc82-184e702f956f tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:42.887458 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c8f2e3e7-8272-4f8a-bc82-184e702f956f tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:42.889959 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-b502c728-1ac7-4341-ae66-087c5e4fa79a tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] 10.222.0.18 "POST /compute/v2.1/servers/34dcd1da-b94c-426b-b08b-204ea287c8a2/action" status: 202 len: 0 microversion: 2.20 time: 0.135784 Oct 22 21:13:42.894538 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2333/4648] 10.222.0.18 () {62 vars in 1319 bytes} [Sat Oct 22 21:13:42 2022] POST /compute/v2.1/servers/34dcd1da-b94c-426b-b08b-204ea287c8a2/action => generated 0 bytes in 140 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 22 21:13:42.901534 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-38ae9a16-de67-4929-ae80-5a5fc8876a08 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:13:42.901534 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-38ae9a16-de67-4929-ae80-5a5fc8876a08 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] [instance: 34dcd1da-b94c-426b-b08b-204ea287c8a2] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:13:42.909753 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-38ae9a16-de67-4929-ae80-5a5fc8876a08 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:42.911024 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-38ae9a16-de67-4929-ae80-5a5fc8876a08 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:42.911558 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-38ae9a16-de67-4929-ae80-5a5fc8876a08 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:42.912591 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-38ae9a16-de67-4929-ae80-5a5fc8876a08 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:42.913255 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-38ae9a16-de67-4929-ae80-5a5fc8876a08 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:42.913961 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-38ae9a16-de67-4929-ae80-5a5fc8876a08 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:42.938607 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-c8f2e3e7-8272-4f8a-bc82-184e702f956f tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] [instance: 955c9477-85e2-4d95-ab3b-035dbf7d5a03] Going to try to terminate instance {{(pid=138744) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 21:13:43.187236 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-c8f2e3e7-8272-4f8a-bc82-184e702f956f tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] 10.222.0.18 "DELETE /compute/v2.1/servers/955c9477-85e2-4d95-ab3b-035dbf7d5a03" status: 204 len: 0 microversion: 2.1 time: 0.314220 Oct 22 21:13:43.188012 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2316/4649] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 21:13:42 2022] DELETE /compute/v2.1/servers/955c9477-85e2-4d95-ab3b-035dbf7d5a03 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 21:13:43.202153 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-ace79157-e4f4-4743-be3f-467c31776d4b tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:13:43.204521 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-ace79157-e4f4-4743-be3f-467c31776d4b tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] [instance: 955c9477-85e2-4d95-ab3b-035dbf7d5a03] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:13:43.221481 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ace79157-e4f4-4743-be3f-467c31776d4b tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:43.222007 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ace79157-e4f4-4743-be3f-467c31776d4b tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:43.222474 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ace79157-e4f4-4743-be3f-467c31776d4b tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:43.223182 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ace79157-e4f4-4743-be3f-467c31776d4b tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:43.223706 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ace79157-e4f4-4743-be3f-467c31776d4b tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:43.224138 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ace79157-e4f4-4743-be3f-467c31776d4b tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:43.401332 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-38ae9a16-de67-4929-ae80-5a5fc8876a08 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:13:43.412967 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-38ae9a16-de67-4929-ae80-5a5fc8876a08 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:13:43.415642 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-38ae9a16-de67-4929-ae80-5a5fc8876a08 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:13:43.417507 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-38ae9a16-de67-4929-ae80-5a5fc8876a08 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] 10.222.0.18 "GET /compute/v2.1/servers/34dcd1da-b94c-426b-b08b-204ea287c8a2" status: 200 len: 1673 microversion: 2.20 time: 0.522196 Oct 22 21:13:43.418641 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2334/4650] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:13:42 2022] GET /compute/v2.1/servers/34dcd1da-b94c-426b-b08b-204ea287c8a2 => generated 1673 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:13:43.440709 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-3d556c3c-01b5-454e-b0ed-5affb2876301 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c3d2ed04-7d94-4677-95f3-3146478267d8"}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:13:43.443492 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-3d556c3c-01b5-454e-b0ed-5affb2876301 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] [instance: 9dd3ccc4-26f1-4d75-b990-6636ed02293e] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:13:43.452502 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3d556c3c-01b5-454e-b0ed-5affb2876301 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:43.453183 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3d556c3c-01b5-454e-b0ed-5affb2876301 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:43.453841 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3d556c3c-01b5-454e-b0ed-5affb2876301 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:43.454771 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3d556c3c-01b5-454e-b0ed-5affb2876301 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:43.456043 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3d556c3c-01b5-454e-b0ed-5affb2876301 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:43.456808 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3d556c3c-01b5-454e-b0ed-5affb2876301 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:43.469695 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-ace79157-e4f4-4743-be3f-467c31776d4b tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799f987b3aa7426ba5d7a464052d6490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87474d4b4c547abbfe6308b6dd8e1c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:13:43.498737 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-ace79157-e4f4-4743-be3f-467c31776d4b tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] 10.222.0.18 "GET /compute/v2.1/servers/955c9477-85e2-4d95-ab3b-035dbf7d5a03" status: 200 len: 1509 microversion: 2.1 time: 0.305347 Oct 22 21:13:43.514886 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2317/4651] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:13:43 2022] GET /compute/v2.1/servers/955c9477-85e2-4d95-ab3b-035dbf7d5a03 => generated 1509 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:13:43.582493 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-215e8229-3c75-4050-8160-85a81f429f70 req-0c46a64b-0bdd-4dc8-86f7-46aced808a81 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77705065-40b2-4fba-8cf9-def4abeae0e4", "tag": "77793879-ddc1-4a27-89fe-4f5537f05251"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:13:43.605412 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-215e8229-3c75-4050-8160-85a81f429f70 req-0c46a64b-0bdd-4dc8-86f7-46aced808a81 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:43.606530 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-215e8229-3c75-4050-8160-85a81f429f70 req-0c46a64b-0bdd-4dc8-86f7-46aced808a81 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:43.607504 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-215e8229-3c75-4050-8160-85a81f429f70 req-0c46a64b-0bdd-4dc8-86f7-46aced808a81 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:43.624673 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-215e8229-3c75-4050-8160-85a81f429f70 req-0c46a64b-0bdd-4dc8-86f7-46aced808a81 service nova] Creating event network-changed:77793879-ddc1-4a27-89fe-4f5537f05251 for instance 77705065-40b2-4fba-8cf9-def4abeae0e4 on nch2-master-1 Oct 22 21:13:43.632916 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-215e8229-3c75-4050-8160-85a81f429f70 req-0c46a64b-0bdd-4dc8-86f7-46aced808a81 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060992 Oct 22 21:13:43.634632 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2318/4652] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:13:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 21:13:43.904318 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-b69f4f08-be1f-4f47-bada-124899fbdb8e tempest-VolumesActionsTest-1108413952 tempest-VolumesActionsTest-1108413952-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:13:43.914581 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-b69f4f08-be1f-4f47-bada-124899fbdb8e tempest-VolumesActionsTest-1108413952 tempest-VolumesActionsTest-1108413952-project] [instance: 75885b47-51e4-4752-8150-00dff6c524f6] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:13:43.924798 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b69f4f08-be1f-4f47-bada-124899fbdb8e tempest-VolumesActionsTest-1108413952 tempest-VolumesActionsTest-1108413952-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:43.925848 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b69f4f08-be1f-4f47-bada-124899fbdb8e tempest-VolumesActionsTest-1108413952 tempest-VolumesActionsTest-1108413952-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:43.926470 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b69f4f08-be1f-4f47-bada-124899fbdb8e tempest-VolumesActionsTest-1108413952 tempest-VolumesActionsTest-1108413952-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:43.927415 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b69f4f08-be1f-4f47-bada-124899fbdb8e tempest-VolumesActionsTest-1108413952 tempest-VolumesActionsTest-1108413952-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:43.928271 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b69f4f08-be1f-4f47-bada-124899fbdb8e tempest-VolumesActionsTest-1108413952 tempest-VolumesActionsTest-1108413952-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:43.928946 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b69f4f08-be1f-4f47-bada-124899fbdb8e tempest-VolumesActionsTest-1108413952 tempest-VolumesActionsTest-1108413952-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:44.186381 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-b69f4f08-be1f-4f47-bada-124899fbdb8e tempest-VolumesActionsTest-1108413952 tempest-VolumesActionsTest-1108413952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037ea1eef49c4f7fba0dec413ce15e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c7a88417a446cd87a91bf19ef81232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:13:44.201313 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-b69f4f08-be1f-4f47-bada-124899fbdb8e tempest-VolumesActionsTest-1108413952 tempest-VolumesActionsTest-1108413952-project] 10.222.0.18 "GET /compute/v2.1/servers/75885b47-51e4-4752-8150-00dff6c524f6" status: 200 len: 1314 microversion: 2.1 time: 0.311043 Oct 22 21:13:44.204515 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2319/4653] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:13:43 2022] GET /compute/v2.1/servers/75885b47-51e4-4752-8150-00dff6c524f6 => generated 1314 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:13:44.449097 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell0:SELECT=2 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:13:44.450058 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell0:SELECT=6 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:13:44.486332 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-3c74ac18-8b51-428e-9b47-9e85130b345b tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:13:44.496093 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-3c74ac18-8b51-428e-9b47-9e85130b345b tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] [instance: 34dcd1da-b94c-426b-b08b-204ea287c8a2] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:13:44.534165 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3c74ac18-8b51-428e-9b47-9e85130b345b tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:44.537056 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3c74ac18-8b51-428e-9b47-9e85130b345b tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:44.537584 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3c74ac18-8b51-428e-9b47-9e85130b345b tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:44.539594 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3c74ac18-8b51-428e-9b47-9e85130b345b tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:44.540110 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3c74ac18-8b51-428e-9b47-9e85130b345b tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:44.541411 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3c74ac18-8b51-428e-9b47-9e85130b345b tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:44.661126 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell0:SELECT=2 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:13:44.844770 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-3d556c3c-01b5-454e-b0ed-5affb2876301 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] 10.222.0.18 "POST /compute/v2.1/servers/9dd3ccc4-26f1-4d75-b990-6636ed02293e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.424168 Oct 22 21:13:44.846078 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2335/4654] 10.222.0.18 () {60 vars in 1323 bytes} [Sat Oct 22 21:13:43 2022] POST /compute/v2.1/servers/9dd3ccc4-26f1-4d75-b990-6636ed02293e/os-volume_attachments => generated 194 bytes in 1427 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:13:44.855998 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-a29c6c2e-2ee2-444d-9eb3-8f2a2dcb3058 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:13:44.857547 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-a29c6c2e-2ee2-444d-9eb3-8f2a2dcb3058 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] [instance: 955c9477-85e2-4d95-ab3b-035dbf7d5a03] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:13:44.870670 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a29c6c2e-2ee2-444d-9eb3-8f2a2dcb3058 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:44.871594 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a29c6c2e-2ee2-444d-9eb3-8f2a2dcb3058 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:44.872827 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a29c6c2e-2ee2-444d-9eb3-8f2a2dcb3058 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:44.874008 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a29c6c2e-2ee2-444d-9eb3-8f2a2dcb3058 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:44.874731 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a29c6c2e-2ee2-444d-9eb3-8f2a2dcb3058 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:44.877147 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a29c6c2e-2ee2-444d-9eb3-8f2a2dcb3058 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:45.119366 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-3c74ac18-8b51-428e-9b47-9e85130b345b tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:13:45.133813 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-3c74ac18-8b51-428e-9b47-9e85130b345b tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:13:45.141282 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-3c74ac18-8b51-428e-9b47-9e85130b345b tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:13:45.149112 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-3c74ac18-8b51-428e-9b47-9e85130b345b tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] 10.222.0.18 "GET /compute/v2.1/servers/34dcd1da-b94c-426b-b08b-204ea287c8a2" status: 200 len: 1673 microversion: 2.20 time: 0.698211 Oct 22 21:13:45.150365 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2320/4655] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:13:44 2022] GET /compute/v2.1/servers/34dcd1da-b94c-426b-b08b-204ea287c8a2 => generated 1673 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:13:45.231376 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-7854da66-bfba-4cc5-937c-c8c46e075977 tempest-VolumesActionsTest-1108413952 tempest-VolumesActionsTest-1108413952-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:13:45.232224 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-7854da66-bfba-4cc5-937c-c8c46e075977 tempest-VolumesActionsTest-1108413952 tempest-VolumesActionsTest-1108413952-project] [instance: 75885b47-51e4-4752-8150-00dff6c524f6] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:13:45.246608 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7854da66-bfba-4cc5-937c-c8c46e075977 tempest-VolumesActionsTest-1108413952 tempest-VolumesActionsTest-1108413952-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:45.251177 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7854da66-bfba-4cc5-937c-c8c46e075977 tempest-VolumesActionsTest-1108413952 tempest-VolumesActionsTest-1108413952-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:45.261474 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7854da66-bfba-4cc5-937c-c8c46e075977 tempest-VolumesActionsTest-1108413952 tempest-VolumesActionsTest-1108413952-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:45.271784 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7854da66-bfba-4cc5-937c-c8c46e075977 tempest-VolumesActionsTest-1108413952 tempest-VolumesActionsTest-1108413952-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:45.272656 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7854da66-bfba-4cc5-937c-c8c46e075977 tempest-VolumesActionsTest-1108413952 tempest-VolumesActionsTest-1108413952-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:45.273344 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7854da66-bfba-4cc5-937c-c8c46e075977 tempest-VolumesActionsTest-1108413952 tempest-VolumesActionsTest-1108413952-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:45.483680 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-a29c6c2e-2ee2-444d-9eb3-8f2a2dcb3058 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799f987b3aa7426ba5d7a464052d6490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87474d4b4c547abbfe6308b6dd8e1c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:13:45.492232 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-a29c6c2e-2ee2-444d-9eb3-8f2a2dcb3058 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] 10.222.0.18 "GET /compute/v2.1/servers/955c9477-85e2-4d95-ab3b-035dbf7d5a03" status: 200 len: 1509 microversion: 2.1 time: 0.644615 Oct 22 21:13:45.495260 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2336/4656] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:13:44 2022] GET /compute/v2.1/servers/955c9477-85e2-4d95-ab3b-035dbf7d5a03 => generated 1509 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:13:45.656203 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-f5165693-ff4c-4fd1-8183-1e7484294cfd req-86f4c344-8186-4a84-b8c9-06f525f84a6f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77705065-40b2-4fba-8cf9-def4abeae0e4", "tag": "77793879-ddc1-4a27-89fe-4f5537f05251"}, {"name": "network-changed", "server_uuid": "77705065-40b2-4fba-8cf9-def4abeae0e4", "tag": "77793879-ddc1-4a27-89fe-4f5537f05251"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:13:45.680582 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-f5165693-ff4c-4fd1-8183-1e7484294cfd req-86f4c344-8186-4a84-b8c9-06f525f84a6f service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:45.681335 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-f5165693-ff4c-4fd1-8183-1e7484294cfd req-86f4c344-8186-4a84-b8c9-06f525f84a6f service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:45.682748 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-f5165693-ff4c-4fd1-8183-1e7484294cfd req-86f4c344-8186-4a84-b8c9-06f525f84a6f service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:45.717664 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-f5165693-ff4c-4fd1-8183-1e7484294cfd req-86f4c344-8186-4a84-b8c9-06f525f84a6f service nova] Creating event network-changed:77793879-ddc1-4a27-89fe-4f5537f05251 for instance 77705065-40b2-4fba-8cf9-def4abeae0e4 on nch2-master-1 Oct 22 21:13:45.720301 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-f5165693-ff4c-4fd1-8183-1e7484294cfd req-86f4c344-8186-4a84-b8c9-06f525f84a6f service nova] Creating event network-changed:77793879-ddc1-4a27-89fe-4f5537f05251 for instance 77705065-40b2-4fba-8cf9-def4abeae0e4 on nch2-master-1 Oct 22 21:13:45.729321 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-f5165693-ff4c-4fd1-8183-1e7484294cfd req-86f4c344-8186-4a84-b8c9-06f525f84a6f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.077514 Oct 22 21:13:45.734243 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2337/4657] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:13:45 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:13:45.975888 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-7854da66-bfba-4cc5-937c-c8c46e075977 tempest-VolumesActionsTest-1108413952 tempest-VolumesActionsTest-1108413952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037ea1eef49c4f7fba0dec413ce15e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c7a88417a446cd87a91bf19ef81232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:13:45.990544 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-7854da66-bfba-4cc5-937c-c8c46e075977 tempest-VolumesActionsTest-1108413952 tempest-VolumesActionsTest-1108413952-project] 10.222.0.18 "GET /compute/v2.1/servers/75885b47-51e4-4752-8150-00dff6c524f6" status: 200 len: 1314 microversion: 2.1 time: 0.760181 Oct 22 21:13:45.995793 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2321/4658] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:13:45 2022] GET /compute/v2.1/servers/75885b47-51e4-4752-8150-00dff6c524f6 => generated 1314 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:13:46.179370 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-a988d26b-c64f-4eec-8a29-52fbc6cbd228 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:13:46.180197 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-a988d26b-c64f-4eec-8a29-52fbc6cbd228 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] [instance: 34dcd1da-b94c-426b-b08b-204ea287c8a2] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:13:46.192501 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a988d26b-c64f-4eec-8a29-52fbc6cbd228 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:46.193107 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a988d26b-c64f-4eec-8a29-52fbc6cbd228 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:46.193574 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a988d26b-c64f-4eec-8a29-52fbc6cbd228 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:46.196835 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a988d26b-c64f-4eec-8a29-52fbc6cbd228 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:46.198698 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a988d26b-c64f-4eec-8a29-52fbc6cbd228 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:46.199683 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a988d26b-c64f-4eec-8a29-52fbc6cbd228 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:46.520974 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-a6716b8b-1066-4b85-87a5-7a7270afa864 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:13:46.521769 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-a6716b8b-1066-4b85-87a5-7a7270afa864 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] [instance: 955c9477-85e2-4d95-ab3b-035dbf7d5a03] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:13:46.537388 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a6716b8b-1066-4b85-87a5-7a7270afa864 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:46.538459 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a6716b8b-1066-4b85-87a5-7a7270afa864 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:46.540283 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a6716b8b-1066-4b85-87a5-7a7270afa864 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:46.541253 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a6716b8b-1066-4b85-87a5-7a7270afa864 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:46.544241 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a6716b8b-1066-4b85-87a5-7a7270afa864 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:46.548671 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a6716b8b-1066-4b85-87a5-7a7270afa864 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:46.925893 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-a6716b8b-1066-4b85-87a5-7a7270afa864 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799f987b3aa7426ba5d7a464052d6490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87474d4b4c547abbfe6308b6dd8e1c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:13:46.949139 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-a6716b8b-1066-4b85-87a5-7a7270afa864 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] 10.222.0.18 "GET /compute/v2.1/servers/955c9477-85e2-4d95-ab3b-035dbf7d5a03" status: 200 len: 1306 microversion: 2.1 time: 0.434750 Oct 22 21:13:46.951850 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2322/4659] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:13:46 2022] GET /compute/v2.1/servers/955c9477-85e2-4d95-ab3b-035dbf7d5a03 => generated 1306 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:13:46.969023 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-6bb1271a-2b9a-4922-a62f-183440c69f78 req-f399058e-fa67-49c6-8f92-bbdaf91fbdaf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "955c9477-85e2-4d95-ab3b-035dbf7d5a03", "name": "network-vif-deleted", "tag": "661b6506-965b-46e7-8fa7-2e2f98a2d9d0"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:13:46.982101 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-6bb1271a-2b9a-4922-a62f-183440c69f78 req-f399058e-fa67-49c6-8f92-bbdaf91fbdaf service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:46.982645 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-6bb1271a-2b9a-4922-a62f-183440c69f78 req-f399058e-fa67-49c6-8f92-bbdaf91fbdaf service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:46.983221 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-6bb1271a-2b9a-4922-a62f-183440c69f78 req-f399058e-fa67-49c6-8f92-bbdaf91fbdaf service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:47.007722 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-6bb1271a-2b9a-4922-a62f-183440c69f78 req-f399058e-fa67-49c6-8f92-bbdaf91fbdaf service nova] Creating event network-vif-deleted:661b6506-965b-46e7-8fa7-2e2f98a2d9d0 for instance 955c9477-85e2-4d95-ab3b-035dbf7d5a03 on nch1-master-1 Oct 22 21:13:47.013178 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-a988d26b-c64f-4eec-8a29-52fbc6cbd228 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:13:47.027546 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-a988d26b-c64f-4eec-8a29-52fbc6cbd228 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:13:47.030561 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-6bb1271a-2b9a-4922-a62f-183440c69f78 req-f399058e-fa67-49c6-8f92-bbdaf91fbdaf service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076329 Oct 22 21:13:47.031072 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-a988d26b-c64f-4eec-8a29-52fbc6cbd228 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:13:47.033716 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2323/4660] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:13:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:13:47.040607 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-a988d26b-c64f-4eec-8a29-52fbc6cbd228 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] 10.222.0.18 "GET /compute/v2.1/servers/34dcd1da-b94c-426b-b08b-204ea287c8a2" status: 200 len: 1731 microversion: 2.20 time: 0.865891 Oct 22 21:13:47.041872 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-43edc678-96a6-4ba5-8ea8-5243141ebaf7 req-b553d686-468d-4a87-ac26-b38f24438aa6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75885b47-51e4-4752-8150-00dff6c524f6", "name": "network-vif-plugged", "status": "completed", "tag": "20d578f5-f035-4fa8-aeda-a0849361750e"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:13:47.051976 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2338/4661] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:13:46 2022] GET /compute/v2.1/servers/34dcd1da-b94c-426b-b08b-204ea287c8a2 => generated 1731 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:13:47.060222 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-43edc678-96a6-4ba5-8ea8-5243141ebaf7 req-b553d686-468d-4a87-ac26-b38f24438aa6 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:47.061269 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-43edc678-96a6-4ba5-8ea8-5243141ebaf7 req-b553d686-468d-4a87-ac26-b38f24438aa6 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:47.062048 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-43edc678-96a6-4ba5-8ea8-5243141ebaf7 req-b553d686-468d-4a87-ac26-b38f24438aa6 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:47.077537 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-e4319b31-0e46-4518-83f5-2909c959af0f tempest-VolumesActionsTest-1108413952 tempest-VolumesActionsTest-1108413952-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:13:47.078478 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-e4319b31-0e46-4518-83f5-2909c959af0f tempest-VolumesActionsTest-1108413952 tempest-VolumesActionsTest-1108413952-project] [instance: 75885b47-51e4-4752-8150-00dff6c524f6] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:13:47.079620 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-43edc678-96a6-4ba5-8ea8-5243141ebaf7 req-b553d686-468d-4a87-ac26-b38f24438aa6 service nova] Creating event network-vif-plugged:20d578f5-f035-4fa8-aeda-a0849361750e for instance 75885b47-51e4-4752-8150-00dff6c524f6 on nch2-master-1 Oct 22 21:13:47.086216 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:13:47.087169 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-43edc678-96a6-4ba5-8ea8-5243141ebaf7 req-b553d686-468d-4a87-ac26-b38f24438aa6 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049712 Oct 22 21:13:47.087946 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2324/4662] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:13:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:13:47.088931 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e4319b31-0e46-4518-83f5-2909c959af0f tempest-VolumesActionsTest-1108413952 tempest-VolumesActionsTest-1108413952-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:47.089557 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e4319b31-0e46-4518-83f5-2909c959af0f tempest-VolumesActionsTest-1108413952 tempest-VolumesActionsTest-1108413952-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:47.090188 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e4319b31-0e46-4518-83f5-2909c959af0f tempest-VolumesActionsTest-1108413952 tempest-VolumesActionsTest-1108413952-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:47.091021 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e4319b31-0e46-4518-83f5-2909c959af0f tempest-VolumesActionsTest-1108413952 tempest-VolumesActionsTest-1108413952-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:47.091719 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e4319b31-0e46-4518-83f5-2909c959af0f tempest-VolumesActionsTest-1108413952 tempest-VolumesActionsTest-1108413952-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:47.092184 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e4319b31-0e46-4518-83f5-2909c959af0f tempest-VolumesActionsTest-1108413952 tempest-VolumesActionsTest-1108413952-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:47.954334 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-e4319b31-0e46-4518-83f5-2909c959af0f tempest-VolumesActionsTest-1108413952 tempest-VolumesActionsTest-1108413952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037ea1eef49c4f7fba0dec413ce15e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c7a88417a446cd87a91bf19ef81232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:13:47.971579 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-e4319b31-0e46-4518-83f5-2909c959af0f tempest-VolumesActionsTest-1108413952 tempest-VolumesActionsTest-1108413952-project] 10.222.0.18 "GET /compute/v2.1/servers/75885b47-51e4-4752-8150-00dff6c524f6" status: 200 len: 1314 microversion: 2.1 time: 0.913258 Oct 22 21:13:47.972601 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2339/4663] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:13:47 2022] GET /compute/v2.1/servers/75885b47-51e4-4752-8150-00dff6c524f6 => generated 1314 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:13:47.991260 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-0504bb41-ec7d-4898-a572-1f769850b7fd tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:13:47.992807 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-0504bb41-ec7d-4898-a572-1f769850b7fd tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] [instance: 955c9477-85e2-4d95-ab3b-035dbf7d5a03] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:13:48.000987 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0504bb41-ec7d-4898-a572-1f769850b7fd tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:48.001424 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0504bb41-ec7d-4898-a572-1f769850b7fd tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:48.002518 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0504bb41-ec7d-4898-a572-1f769850b7fd tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:48.003044 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0504bb41-ec7d-4898-a572-1f769850b7fd tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:48.003842 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0504bb41-ec7d-4898-a572-1f769850b7fd tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:48.004244 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0504bb41-ec7d-4898-a572-1f769850b7fd tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:48.029837 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-0504bb41-ec7d-4898-a572-1f769850b7fd tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] HTTP exception thrown: Instance 955c9477-85e2-4d95-ab3b-035dbf7d5a03 could not be found. Oct 22 21:13:48.031737 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-0504bb41-ec7d-4898-a572-1f769850b7fd tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Request method failure captured: Oct 22 21:13:48.031737 ncdv-master-1 devstack@n-api.service[138744]: request: GET /compute/v2.1/servers/955c9477-85e2-4d95-ab3b-035dbf7d5a03 HTTP/1.1 Oct 22 21:13:48.031737 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 21:13:48.031737 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 21:13:48.031737 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 21:13:48.031737 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 0 Oct 22 21:13:48.031737 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 21:13:48.031737 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 21:13:48.031737 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 21:13:48.031737 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 21:13:48.031737 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVFzbjFuxlabhGO5W5IN5r54yzIxFa_mX4J74OzfXM08pyPGfws2Ww4pm5qGKXFC4h2Ttyt1JiFfrSI-ucQt7MPAhDqF8_tQs5Z1aGjJkE87trFhYgYaJFSihYuRhX8jAUHeeDuqMpE3BFEYcIHoIoAbD2BZHLThVUs-wQCfowY_4sFQ Oct 22 21:13:48.031737 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 21:13:48.031737 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 21:13:48.031737 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 21:13:48.031737 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 21:13:48.031737 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 21:13:48.031737 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 21:13:48.031737 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: e87474d4b4c547abbfe6308b6dd8e1c8 Oct 22 21:13:48.031737 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-ServersTestJSON-2007137082 Oct 22 21:13:48.031737 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 21:13:48.031737 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 21:13:48.031737 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_e87474d4b4c547abbfe6308b6dd8e1c8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e87474d4b4c547abbfe6308b6dd8e1c8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/e87474d4b4c547abbfe6308b6dd8e1c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e87474d4b4c547abbfe6308b6dd8e1c8"}]}] Oct 22 21:13:48.031737 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-ServersTestJSON-2007137082 Oct 22 21:13:48.031737 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: e87474d4b4c547abbfe6308b6dd8e1c8 Oct 22 21:13:48.031737 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-ServersTestJSON-2007137082 Oct 22 21:13:48.031737 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-ServersTestJSON-2007137082-project Oct 22 21:13:48.031737 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 21:13:48.031737 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 21:13:48.031737 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: 799f987b3aa7426ba5d7a464052d6490 Oct 22 21:13:48.031737 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-ServersTestJSON-2007137082-project Oct 22 21:13:48.031737 ncdv-master-1 devstack@n-api.service[138744]: method: > Oct 22 21:13:48.031737 ncdv-master-1 devstack@n-api.service[138744]: exception: Instance 955c9477-85e2-4d95-ab3b-035dbf7d5a03 could not be found. Oct 22 21:13:48.031737 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': '955c9477-85e2-4d95-ab3b-035dbf7d5a03'} Oct 22 21:13:48.031737 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:13:48.031737 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:13:48.031737 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 21:13:48.031737 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 21:13:48.031737 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 21:13:48.031737 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 21:13:48.031737 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 21:13:48.031737 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 21:13:48.031737 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 21:13:48.031737 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 21:13:48.031737 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 955c9477-85e2-4d95-ab3b-035dbf7d5a03 could not be found. Oct 22 21:13:48.031737 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:13:48.031737 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:13:48.031737 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:13:48.031737 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:13:48.031737 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:13:48.031737 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:13:48.031737 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:13:48.031737 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:13:48.031737 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:13:48.031737 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:13:48.031737 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 21:13:48.031737 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 21:13:48.031737 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 21:13:48.031737 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 21:13:48.031737 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 21:13:48.031737 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:13:48.031737 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 955c9477-85e2-4d95-ab3b-035dbf7d5a03 could not be found. Oct 22 21:13:48.031737 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:13:48.031737 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:13:48.031737 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:13:48.036924 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:13:48.036924 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:13:48.036924 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:13:48.036924 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:13:48.036924 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:13:48.036924 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 955c9477-85e2-4d95-ab3b-035dbf7d5a03 could not be found. Oct 22 21:13:48.036924 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:13:48.038275 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-0504bb41-ec7d-4898-a572-1f769850b7fd tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Returning 404 to user: Instance 955c9477-85e2-4d95-ab3b-035dbf7d5a03 could not be found. {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:13:48.039305 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-0504bb41-ec7d-4898-a572-1f769850b7fd tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] 10.222.0.18 "GET /compute/v2.1/servers/955c9477-85e2-4d95-ab3b-035dbf7d5a03" status: 404 len: 111 microversion: 2.1 time: 0.066476 Oct 22 21:13:48.048983 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2325/4664] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:13:47 2022] GET /compute/v2.1/servers/955c9477-85e2-4d95-ab3b-035dbf7d5a03 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 22 21:13:48.056445 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-f27dc647-83f5-4819-bff4-7a47949b9c54 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Action: 'create', calling method: .version_select at 0x7fd39fcddee0>, body: {"keypair": {"name": "tempest-key-930355142", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK8oWOKSK6yqrXXGX3FKPtOz0CjxfLyBu9qcmiWkDI9EyImMSV5fZL34X3u4w8YWO8YO9IxEBpplF25A2FVM4jh+Eqp1GS6f92dDDPk74IvleSmAc2Lr5z1UJUUoa0vqig=="}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:13:48.072018 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-65dd4355-fb9b-4b25-9688-dc381724d291 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:13:48.073079 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-65dd4355-fb9b-4b25-9688-dc381724d291 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] [instance: 34dcd1da-b94c-426b-b08b-204ea287c8a2] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:13:48.082403 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-f27dc647-83f5-4819-bff4-7a47949b9c54 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Getting quotas for project e87474d4b4c547abbfe6308b6dd8e1c8. Resources: {'key_pairs'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 21:13:48.082838 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-65dd4355-fb9b-4b25-9688-dc381724d291 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:48.083478 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-65dd4355-fb9b-4b25-9688-dc381724d291 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:48.085794 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-65dd4355-fb9b-4b25-9688-dc381724d291 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:48.085794 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-65dd4355-fb9b-4b25-9688-dc381724d291 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:48.086272 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-65dd4355-fb9b-4b25-9688-dc381724d291 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:48.086612 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-65dd4355-fb9b-4b25-9688-dc381724d291 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:48.091625 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-f27dc647-83f5-4819-bff4-7a47949b9c54 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Getting quotas for user 799f987b3aa7426ba5d7a464052d6490 and project e87474d4b4c547abbfe6308b6dd8e1c8. Resources: {'key_pairs'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 21:13:48.153268 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-f27dc647-83f5-4819-bff4-7a47949b9c54 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 381 microversion: 2.1 time: 0.100891 Oct 22 21:13:48.154321 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2340/4665] 10.222.0.18 () {60 vars in 1159 bytes} [Sat Oct 22 21:13:48 2022] POST /compute/v2.1/os-keypairs => generated 381 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:13:48.165351 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-2fd702b4-5e74-40a0-be31-7e967a49f6d0 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Calling method '.version_select at 0x7fd39c54c8b0>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:13:48.170480 ncdv-master-1 devstack@n-api.service[138745]: WARNING oslo_db.sqlalchemy.utils [None req-2fd702b4-5e74-40a0-be31-7e967a49f6d0 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 22 21:13:48.177034 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-2fd702b4-5e74-40a0-be31-7e967a49f6d0 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] 10.222.0.18 "GET /compute/v2.1/os-keypairs" status: 200 len: 350 microversion: 2.1 time: 0.015985 Oct 22 21:13:48.188065 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2341/4666] 10.222.0.18 () {58 vars in 1137 bytes} [Sat Oct 22 21:13:48 2022] GET /compute/v2.1/os-keypairs => generated 350 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 21:13:48.299943 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-feb2affd-55c3-48e4-b01e-a4f16cf26a73 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-467678808", "imageRef": "085e4478-6edc-4a69-8e08-f9831713eb65", "flavorRef": "452", "key_name": "tempest-key-930355142", "networks": [{"uuid": "ea7e3c31-2bc2-4b4f-ab48-7d75cccdd3b0"}]}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:13:48.366490 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.network.neutron [None req-feb2affd-55c3-48e4-b01e-a4f16cf26a73 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] validate_networks() for [('ea7e3c31-2bc2-4b4f-ab48-7d75cccdd3b0', None, None, None, None, None)] {{(pid=138745) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 21:13:48.461578 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-65dd4355-fb9b-4b25-9688-dc381724d291 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:13:48.471054 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-65dd4355-fb9b-4b25-9688-dc381724d291 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:13:48.472550 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-65dd4355-fb9b-4b25-9688-dc381724d291 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:13:48.473801 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-65dd4355-fb9b-4b25-9688-dc381724d291 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] 10.222.0.18 "GET /compute/v2.1/servers/34dcd1da-b94c-426b-b08b-204ea287c8a2" status: 200 len: 1731 microversion: 2.20 time: 0.408645 Oct 22 21:13:48.474399 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2326/4667] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:13:48 2022] GET /compute/v2.1/servers/34dcd1da-b94c-426b-b08b-204ea287c8a2 => generated 1731 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:13:48.479328 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-61e7fb62-3295-404c-879f-d97c580cde22 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:13:48.481895 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-61e7fb62-3295-404c-879f-d97c580cde22 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] [instance: 9dd3ccc4-26f1-4d75-b990-6636ed02293e] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:13:48.485060 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=94,nova_api:UPDATE=1 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:13:48.489404 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-61e7fb62-3295-404c-879f-d97c580cde22 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:48.490127 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-61e7fb62-3295-404c-879f-d97c580cde22 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:48.490975 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-61e7fb62-3295-404c-879f-d97c580cde22 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:48.491743 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-61e7fb62-3295-404c-879f-d97c580cde22 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:48.492582 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-61e7fb62-3295-404c-879f-d97c580cde22 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:48.493092 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-61e7fb62-3295-404c-879f-d97c580cde22 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:48.528119 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-61e7fb62-3295-404c-879f-d97c580cde22 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] 10.222.0.18 "GET /compute/v2.1/servers/9dd3ccc4-26f1-4d75-b990-6636ed02293e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052153 Oct 22 21:13:48.528749 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2327/4668] 10.222.0.18 () {58 vars in 1302 bytes} [Sat Oct 22 21:13:48 2022] GET /compute/v2.1/servers/9dd3ccc4-26f1-4d75-b990-6636ed02293e/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:13:48.542168 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-01b41ad9-bd15-4809-8bba-fcbd42611f1d tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:13:48.542594 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-01b41ad9-bd15-4809-8bba-fcbd42611f1d tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] [instance: 9dd3ccc4-26f1-4d75-b990-6636ed02293e] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:13:48.549794 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-01b41ad9-bd15-4809-8bba-fcbd42611f1d tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:48.550299 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-01b41ad9-bd15-4809-8bba-fcbd42611f1d tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:48.550801 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-01b41ad9-bd15-4809-8bba-fcbd42611f1d tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:48.551504 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-01b41ad9-bd15-4809-8bba-fcbd42611f1d tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:48.551974 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-01b41ad9-bd15-4809-8bba-fcbd42611f1d tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:48.552440 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-01b41ad9-bd15-4809-8bba-fcbd42611f1d tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:48.590515 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-01b41ad9-bd15-4809-8bba-fcbd42611f1d tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] 10.222.0.18 "GET /compute/v2.1/servers/9dd3ccc4-26f1-4d75-b990-6636ed02293e/os-volume_attachments/c3d2ed04-7d94-4677-95f3-3146478267d8" status: 200 len: 194 microversion: 2.1 time: 0.052232 Oct 22 21:13:48.591858 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2328/4669] 10.222.0.18 () {58 vars in 1413 bytes} [Sat Oct 22 21:13:48 2022] GET /compute/v2.1/servers/9dd3ccc4-26f1-4d75-b990-6636ed02293e/os-volume_attachments/c3d2ed04-7d94-4677-95f3-3146478267d8 => generated 194 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 21:13:48.999592 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-aeef7d66-f9f4-42b4-9f31-bdddb7098e67 tempest-VolumesActionsTest-1108413952 tempest-VolumesActionsTest-1108413952-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:13:49.001833 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-aeef7d66-f9f4-42b4-9f31-bdddb7098e67 tempest-VolumesActionsTest-1108413952 tempest-VolumesActionsTest-1108413952-project] [instance: 75885b47-51e4-4752-8150-00dff6c524f6] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:13:49.011330 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-aeef7d66-f9f4-42b4-9f31-bdddb7098e67 tempest-VolumesActionsTest-1108413952 tempest-VolumesActionsTest-1108413952-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:49.012695 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-aeef7d66-f9f4-42b4-9f31-bdddb7098e67 tempest-VolumesActionsTest-1108413952 tempest-VolumesActionsTest-1108413952-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:49.013138 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-aeef7d66-f9f4-42b4-9f31-bdddb7098e67 tempest-VolumesActionsTest-1108413952 tempest-VolumesActionsTest-1108413952-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:49.014222 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-aeef7d66-f9f4-42b4-9f31-bdddb7098e67 tempest-VolumesActionsTest-1108413952 tempest-VolumesActionsTest-1108413952-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:49.014843 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-aeef7d66-f9f4-42b4-9f31-bdddb7098e67 tempest-VolumesActionsTest-1108413952 tempest-VolumesActionsTest-1108413952-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:49.015488 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-aeef7d66-f9f4-42b4-9f31-bdddb7098e67 tempest-VolumesActionsTest-1108413952 tempest-VolumesActionsTest-1108413952-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:49.387958 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-feb2affd-55c3-48e4-b01e-a4f16cf26a73 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Flavor limits 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 21:13:49.387958 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-feb2affd-55c3-48e4-b01e-a4f16cf26a73 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Image limits 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 21:13:49.388634 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-feb2affd-55c3-48e4-b01e-a4f16cf26a73 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Flavor pref 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 21:13:49.389072 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-feb2affd-55c3-48e4-b01e-a4f16cf26a73 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Image pref 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 21:13:49.389500 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-feb2affd-55c3-48e4-b01e-a4f16cf26a73 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 21:13:49.399446 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-feb2affd-55c3-48e4-b01e-a4f16cf26a73 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:49.399986 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-feb2affd-55c3-48e4-b01e-a4f16cf26a73 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:49.400445 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-feb2affd-55c3-48e4-b01e-a4f16cf26a73 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:49.401202 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-feb2affd-55c3-48e4-b01e-a4f16cf26a73 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:49.401753 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-feb2affd-55c3-48e4-b01e-a4f16cf26a73 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:49.402204 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-feb2affd-55c3-48e4-b01e-a4f16cf26a73 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:49.422080 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-feb2affd-55c3-48e4-b01e-a4f16cf26a73 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Getting quotas for project e87474d4b4c547abbfe6308b6dd8e1c8. Resources: {'cores', 'instances', 'ram'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 21:13:49.428092 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-feb2affd-55c3-48e4-b01e-a4f16cf26a73 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Getting quotas for user 799f987b3aa7426ba5d7a464052d6490 and project e87474d4b4c547abbfe6308b6dd8e1c8. Resources: {'cores', 'instances', 'ram'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 21:13:49.442414 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-feb2affd-55c3-48e4-b01e-a4f16cf26a73 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Going to run 1 instances... {{(pid=138745) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 21:13:49.445028 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-feb2affd-55c3-48e4-b01e-a4f16cf26a73 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] [instance: e8de4ee1-bd84-496c-8376-025eaf5c5094] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='085e4478-6edc-4a69-8e08-f9831713eb65',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138745) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 21:13:49.497848 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-feb2affd-55c3-48e4-b01e-a4f16cf26a73 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.202456 Oct 22 21:13:49.498835 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2342/4670] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Oct 22 21:13:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 1205 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 22 21:13:49.503712 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-1bb9fa79-af73-4f9c-952b-265439d3c4eb req-29b712f2-596a-4dad-999f-b4390255d06a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34dcd1da-b94c-426b-b08b-204ea287c8a2", "tag": "692705ac-81f3-4f8a-bfa8-a2581d7d7567"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:13:49.514506 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-1bb9fa79-af73-4f9c-952b-265439d3c4eb req-29b712f2-596a-4dad-999f-b4390255d06a service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:49.515039 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-1bb9fa79-af73-4f9c-952b-265439d3c4eb req-29b712f2-596a-4dad-999f-b4390255d06a service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:49.515722 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-1bb9fa79-af73-4f9c-952b-265439d3c4eb req-29b712f2-596a-4dad-999f-b4390255d06a service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:49.526006 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-aeef7d66-f9f4-42b4-9f31-bdddb7098e67 tempest-VolumesActionsTest-1108413952 tempest-VolumesActionsTest-1108413952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037ea1eef49c4f7fba0dec413ce15e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c7a88417a446cd87a91bf19ef81232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:13:49.528992 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-1bb9fa79-af73-4f9c-952b-265439d3c4eb req-29b712f2-596a-4dad-999f-b4390255d06a service nova] Creating event network-changed:692705ac-81f3-4f8a-bfa8-a2581d7d7567 for instance 34dcd1da-b94c-426b-b08b-204ea287c8a2 on nch1-master-1 Oct 22 21:13:49.536015 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-1bb9fa79-af73-4f9c-952b-265439d3c4eb req-29b712f2-596a-4dad-999f-b4390255d06a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035376 Oct 22 21:13:49.537210 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2343/4671] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:13:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:13:49.549200 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-aeef7d66-f9f4-42b4-9f31-bdddb7098e67 tempest-VolumesActionsTest-1108413952 tempest-VolumesActionsTest-1108413952-project] 10.222.0.18 "GET /compute/v2.1/servers/75885b47-51e4-4752-8150-00dff6c524f6" status: 200 len: 1314 microversion: 2.1 time: 0.555045 Oct 22 21:13:49.550437 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2329/4672] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:13:48 2022] GET /compute/v2.1/servers/75885b47-51e4-4752-8150-00dff6c524f6 => generated 1314 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:13:49.556699 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-a9fcd467-bd0d-4ef1-bd31-6aede93d8e16 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:13:49.557431 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-a9fcd467-bd0d-4ef1-bd31-6aede93d8e16 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] [instance: 34dcd1da-b94c-426b-b08b-204ea287c8a2] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:13:49.559306 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-78cfe445-8efc-42f7-a541-450b374cfebe tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:13:49.560352 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-78cfe445-8efc-42f7-a541-450b374cfebe tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] [instance: e8de4ee1-bd84-496c-8376-025eaf5c5094] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:13:49.564568 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a9fcd467-bd0d-4ef1-bd31-6aede93d8e16 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:49.566019 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a9fcd467-bd0d-4ef1-bd31-6aede93d8e16 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:49.566492 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a9fcd467-bd0d-4ef1-bd31-6aede93d8e16 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:49.567269 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a9fcd467-bd0d-4ef1-bd31-6aede93d8e16 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:49.567987 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a9fcd467-bd0d-4ef1-bd31-6aede93d8e16 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:49.568650 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a9fcd467-bd0d-4ef1-bd31-6aede93d8e16 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:49.694333 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-78cfe445-8efc-42f7-a541-450b374cfebe tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799f987b3aa7426ba5d7a464052d6490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87474d4b4c547abbfe6308b6dd8e1c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:13:49.704423 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-78cfe445-8efc-42f7-a541-450b374cfebe tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] 10.222.0.18 "GET /compute/v2.1/servers/e8de4ee1-bd84-496c-8376-025eaf5c5094" status: 200 len: 1227 microversion: 2.1 time: 0.152532 Oct 22 21:13:49.705237 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2330/4673] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:13:49 2022] GET /compute/v2.1/servers/e8de4ee1-bd84-496c-8376-025eaf5c5094 => generated 1227 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:13:49.959797 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-a9fcd467-bd0d-4ef1-bd31-6aede93d8e16 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:13:49.969743 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-a9fcd467-bd0d-4ef1-bd31-6aede93d8e16 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:13:49.971795 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-a9fcd467-bd0d-4ef1-bd31-6aede93d8e16 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:13:49.973465 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-a9fcd467-bd0d-4ef1-bd31-6aede93d8e16 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] 10.222.0.18 "GET /compute/v2.1/servers/34dcd1da-b94c-426b-b08b-204ea287c8a2" status: 200 len: 1731 microversion: 2.20 time: 0.434543 Oct 22 21:13:49.974434 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2344/4674] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:13:49 2022] GET /compute/v2.1/servers/34dcd1da-b94c-426b-b08b-204ea287c8a2 => generated 1731 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:13:50.073171 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-a0670ed3-2309-42de-81bd-c2f0d5035edd tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "892ac359-4f4c-4fa6-acef-543e24a4f004"}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:13:50.077493 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-a0670ed3-2309-42de-81bd-c2f0d5035edd tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] [instance: 9dd3ccc4-26f1-4d75-b990-6636ed02293e] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:13:50.091858 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a0670ed3-2309-42de-81bd-c2f0d5035edd tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:50.092722 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a0670ed3-2309-42de-81bd-c2f0d5035edd tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:50.093446 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a0670ed3-2309-42de-81bd-c2f0d5035edd tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:50.094590 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a0670ed3-2309-42de-81bd-c2f0d5035edd tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:50.095171 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a0670ed3-2309-42de-81bd-c2f0d5035edd tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:50.096679 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a0670ed3-2309-42de-81bd-c2f0d5035edd tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:50.314383 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=5,nova_cell1:INSERT=1 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:13:50.541440 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-a0670ed3-2309-42de-81bd-c2f0d5035edd tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] 10.222.0.18 "POST /compute/v2.1/servers/9dd3ccc4-26f1-4d75-b990-6636ed02293e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.471167 Oct 22 21:13:50.543723 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2331/4675] 10.222.0.18 () {60 vars in 1323 bytes} [Sat Oct 22 21:13:50 2022] POST /compute/v2.1/servers/9dd3ccc4-26f1-4d75-b990-6636ed02293e/os-volume_attachments => generated 194 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:13:50.576182 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-c29cc404-1809-412e-92fc-b5937bd6c87b tempest-VolumesActionsTest-1108413952 tempest-VolumesActionsTest-1108413952-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:13:50.576822 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-c29cc404-1809-412e-92fc-b5937bd6c87b tempest-VolumesActionsTest-1108413952 tempest-VolumesActionsTest-1108413952-project] [instance: 75885b47-51e4-4752-8150-00dff6c524f6] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:13:50.588003 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c29cc404-1809-412e-92fc-b5937bd6c87b tempest-VolumesActionsTest-1108413952 tempest-VolumesActionsTest-1108413952-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:50.588515 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c29cc404-1809-412e-92fc-b5937bd6c87b tempest-VolumesActionsTest-1108413952 tempest-VolumesActionsTest-1108413952-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:50.592230 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c29cc404-1809-412e-92fc-b5937bd6c87b tempest-VolumesActionsTest-1108413952 tempest-VolumesActionsTest-1108413952-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:50.593044 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c29cc404-1809-412e-92fc-b5937bd6c87b tempest-VolumesActionsTest-1108413952 tempest-VolumesActionsTest-1108413952-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:50.593533 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c29cc404-1809-412e-92fc-b5937bd6c87b tempest-VolumesActionsTest-1108413952 tempest-VolumesActionsTest-1108413952-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:50.593987 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c29cc404-1809-412e-92fc-b5937bd6c87b tempest-VolumesActionsTest-1108413952 tempest-VolumesActionsTest-1108413952-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:50.730829 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-13859b25-52b6-44a4-ad7b-f635b2936601 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:13:50.731626 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-13859b25-52b6-44a4-ad7b-f635b2936601 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] [instance: e8de4ee1-bd84-496c-8376-025eaf5c5094] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:13:50.738607 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-13859b25-52b6-44a4-ad7b-f635b2936601 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:50.739103 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-13859b25-52b6-44a4-ad7b-f635b2936601 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:50.739579 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-13859b25-52b6-44a4-ad7b-f635b2936601 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:50.740305 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-13859b25-52b6-44a4-ad7b-f635b2936601 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:50.740762 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-13859b25-52b6-44a4-ad7b-f635b2936601 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:50.741321 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-13859b25-52b6-44a4-ad7b-f635b2936601 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:50.830686 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-13859b25-52b6-44a4-ad7b-f635b2936601 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799f987b3aa7426ba5d7a464052d6490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87474d4b4c547abbfe6308b6dd8e1c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:13:50.851898 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-13859b25-52b6-44a4-ad7b-f635b2936601 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] 10.222.0.18 "GET /compute/v2.1/servers/e8de4ee1-bd84-496c-8376-025eaf5c5094" status: 200 len: 1279 microversion: 2.1 time: 0.126370 Oct 22 21:13:50.853305 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2332/4676] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:13:50 2022] GET /compute/v2.1/servers/e8de4ee1-bd84-496c-8376-025eaf5c5094 => generated 1279 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:13:50.859710 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-c29cc404-1809-412e-92fc-b5937bd6c87b tempest-VolumesActionsTest-1108413952 tempest-VolumesActionsTest-1108413952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037ea1eef49c4f7fba0dec413ce15e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c7a88417a446cd87a91bf19ef81232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:13:50.871852 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-c29cc404-1809-412e-92fc-b5937bd6c87b tempest-VolumesActionsTest-1108413952 tempest-VolumesActionsTest-1108413952-project] 10.222.0.18 "GET /compute/v2.1/servers/75885b47-51e4-4752-8150-00dff6c524f6" status: 200 len: 1497 microversion: 2.1 time: 0.300980 Oct 22 21:13:50.873387 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2345/4677] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:13:50 2022] GET /compute/v2.1/servers/75885b47-51e4-4752-8150-00dff6c524f6 => generated 1497 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:13:51.001986 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-c8a731d9-d36e-408f-900e-b08f5bb1c343 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:13:51.002602 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-c8a731d9-d36e-408f-900e-b08f5bb1c343 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] [instance: 34dcd1da-b94c-426b-b08b-204ea287c8a2] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:13:51.012178 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c8a731d9-d36e-408f-900e-b08f5bb1c343 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:51.012758 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c8a731d9-d36e-408f-900e-b08f5bb1c343 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:51.013203 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c8a731d9-d36e-408f-900e-b08f5bb1c343 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:51.013927 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c8a731d9-d36e-408f-900e-b08f5bb1c343 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:51.014400 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c8a731d9-d36e-408f-900e-b08f5bb1c343 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:51.014828 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c8a731d9-d36e-408f-900e-b08f5bb1c343 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:51.239422 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-c8a731d9-d36e-408f-900e-b08f5bb1c343 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:13:51.274231 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-c8a731d9-d36e-408f-900e-b08f5bb1c343 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:13:51.276987 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-c8a731d9-d36e-408f-900e-b08f5bb1c343 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:13:51.278988 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-c8a731d9-d36e-408f-900e-b08f5bb1c343 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] 10.222.0.18 "GET /compute/v2.1/servers/34dcd1da-b94c-426b-b08b-204ea287c8a2" status: 200 len: 1731 microversion: 2.20 time: 0.281725 Oct 22 21:13:51.280271 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2333/4678] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:13:50 2022] GET /compute/v2.1/servers/34dcd1da-b94c-426b-b08b-204ea287c8a2 => generated 1731 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:13:51.885080 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-9e5fd22c-2c31-49bc-bc03-4484c499706d tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:13:51.887823 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-9e5fd22c-2c31-49bc-bc03-4484c499706d tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] [instance: e8de4ee1-bd84-496c-8376-025eaf5c5094] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:13:51.924247 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9e5fd22c-2c31-49bc-bc03-4484c499706d tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:51.926292 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9e5fd22c-2c31-49bc-bc03-4484c499706d tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:51.929941 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9e5fd22c-2c31-49bc-bc03-4484c499706d tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:51.932794 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9e5fd22c-2c31-49bc-bc03-4484c499706d tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:51.939104 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9e5fd22c-2c31-49bc-bc03-4484c499706d tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:51.941704 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9e5fd22c-2c31-49bc-bc03-4484c499706d tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:52.150885 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-9e5fd22c-2c31-49bc-bc03-4484c499706d tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799f987b3aa7426ba5d7a464052d6490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87474d4b4c547abbfe6308b6dd8e1c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:13:52.170024 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-9e5fd22c-2c31-49bc-bc03-4484c499706d tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] 10.222.0.18 "GET /compute/v2.1/servers/e8de4ee1-bd84-496c-8376-025eaf5c5094" status: 200 len: 1285 microversion: 2.1 time: 0.289424 Oct 22 21:13:52.173450 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2346/4679] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:13:51 2022] GET /compute/v2.1/servers/e8de4ee1-bd84-496c-8376-025eaf5c5094 => generated 1285 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:13:52.314626 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-13a6e1c4-8efc-40f5-a4f1-f6d69c5f4c7e tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:13:52.316186 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-13a6e1c4-8efc-40f5-a4f1-f6d69c5f4c7e tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] [instance: 34dcd1da-b94c-426b-b08b-204ea287c8a2] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:13:52.330288 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-13a6e1c4-8efc-40f5-a4f1-f6d69c5f4c7e tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:52.331107 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-13a6e1c4-8efc-40f5-a4f1-f6d69c5f4c7e tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:52.331607 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-13a6e1c4-8efc-40f5-a4f1-f6d69c5f4c7e tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:52.334034 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-13a6e1c4-8efc-40f5-a4f1-f6d69c5f4c7e tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:52.336359 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-13a6e1c4-8efc-40f5-a4f1-f6d69c5f4c7e tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:52.336765 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-13a6e1c4-8efc-40f5-a4f1-f6d69c5f4c7e tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:52.760474 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-13a6e1c4-8efc-40f5-a4f1-f6d69c5f4c7e tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:13:52.786507 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-13a6e1c4-8efc-40f5-a4f1-f6d69c5f4c7e tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:13:52.792907 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-13a6e1c4-8efc-40f5-a4f1-f6d69c5f4c7e tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:13:52.811024 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-13a6e1c4-8efc-40f5-a4f1-f6d69c5f4c7e tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] 10.222.0.18 "GET /compute/v2.1/servers/34dcd1da-b94c-426b-b08b-204ea287c8a2" status: 200 len: 1731 microversion: 2.20 time: 0.501035 Oct 22 21:13:52.826793 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2334/4680] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:13:52 2022] GET /compute/v2.1/servers/34dcd1da-b94c-426b-b08b-204ea287c8a2 => generated 1731 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:13:53.201318 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-df4cfc88-2257-4919-a58f-919554dd8f44 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:13:53.202072 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-df4cfc88-2257-4919-a58f-919554dd8f44 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] [instance: e8de4ee1-bd84-496c-8376-025eaf5c5094] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:13:53.222316 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-df4cfc88-2257-4919-a58f-919554dd8f44 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:53.223250 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-df4cfc88-2257-4919-a58f-919554dd8f44 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:53.227279 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-df4cfc88-2257-4919-a58f-919554dd8f44 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:53.229117 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-df4cfc88-2257-4919-a58f-919554dd8f44 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:53.229969 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-df4cfc88-2257-4919-a58f-919554dd8f44 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:53.230632 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-df4cfc88-2257-4919-a58f-919554dd8f44 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:53.753604 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-df4cfc88-2257-4919-a58f-919554dd8f44 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799f987b3aa7426ba5d7a464052d6490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87474d4b4c547abbfe6308b6dd8e1c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:13:53.764953 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-df4cfc88-2257-4919-a58f-919554dd8f44 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] 10.222.0.18 "GET /compute/v2.1/servers/e8de4ee1-bd84-496c-8376-025eaf5c5094" status: 200 len: 1285 microversion: 2.1 time: 0.569313 Oct 22 21:13:53.775543 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2347/4681] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:13:53 2022] GET /compute/v2.1/servers/e8de4ee1-bd84-496c-8376-025eaf5c5094 => generated 1285 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:13:53.848893 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-8baee720-893b-4820-8344-68492e8b3b65 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:13:53.849665 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-8baee720-893b-4820-8344-68492e8b3b65 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] [instance: 34dcd1da-b94c-426b-b08b-204ea287c8a2] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:13:53.868681 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8baee720-893b-4820-8344-68492e8b3b65 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:53.869289 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8baee720-893b-4820-8344-68492e8b3b65 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:53.869747 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8baee720-893b-4820-8344-68492e8b3b65 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:53.870524 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8baee720-893b-4820-8344-68492e8b3b65 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:53.871228 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8baee720-893b-4820-8344-68492e8b3b65 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:53.871964 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8baee720-893b-4820-8344-68492e8b3b65 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:54.198228 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-8baee720-893b-4820-8344-68492e8b3b65 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:13:54.221184 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-8baee720-893b-4820-8344-68492e8b3b65 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:13:54.229769 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-8baee720-893b-4820-8344-68492e8b3b65 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:13:54.234626 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-8baee720-893b-4820-8344-68492e8b3b65 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] 10.222.0.18 "GET /compute/v2.1/servers/34dcd1da-b94c-426b-b08b-204ea287c8a2" status: 200 len: 1731 microversion: 2.20 time: 0.391662 Oct 22 21:13:54.237951 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2335/4682] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:13:53 2022] GET /compute/v2.1/servers/34dcd1da-b94c-426b-b08b-204ea287c8a2 => generated 1731 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:13:54.792695 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-624879b6-600a-4e28-b276-a2211b8113cb tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:13:54.794003 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-624879b6-600a-4e28-b276-a2211b8113cb tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] [instance: e8de4ee1-bd84-496c-8376-025eaf5c5094] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:13:54.812854 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-624879b6-600a-4e28-b276-a2211b8113cb tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:54.820250 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-624879b6-600a-4e28-b276-a2211b8113cb tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:54.821156 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-624879b6-600a-4e28-b276-a2211b8113cb tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:54.821894 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-624879b6-600a-4e28-b276-a2211b8113cb tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:54.822695 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-624879b6-600a-4e28-b276-a2211b8113cb tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:54.823476 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-624879b6-600a-4e28-b276-a2211b8113cb tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:54.940093 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-dba02f89-39c3-40a3-a0fa-3fe4d5aa8ee7 tempest-VolumesActionsTest-1108413952 tempest-VolumesActionsTest-1108413952-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:13:54.941427 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-dba02f89-39c3-40a3-a0fa-3fe4d5aa8ee7 tempest-VolumesActionsTest-1108413952 tempest-VolumesActionsTest-1108413952-project] [instance: 75885b47-51e4-4752-8150-00dff6c524f6] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:13:54.950602 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-dba02f89-39c3-40a3-a0fa-3fe4d5aa8ee7 tempest-VolumesActionsTest-1108413952 tempest-VolumesActionsTest-1108413952-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:54.951555 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-dba02f89-39c3-40a3-a0fa-3fe4d5aa8ee7 tempest-VolumesActionsTest-1108413952 tempest-VolumesActionsTest-1108413952-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:54.952330 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-dba02f89-39c3-40a3-a0fa-3fe4d5aa8ee7 tempest-VolumesActionsTest-1108413952 tempest-VolumesActionsTest-1108413952-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:54.953511 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-dba02f89-39c3-40a3-a0fa-3fe4d5aa8ee7 tempest-VolumesActionsTest-1108413952 tempest-VolumesActionsTest-1108413952-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:54.954203 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-dba02f89-39c3-40a3-a0fa-3fe4d5aa8ee7 tempest-VolumesActionsTest-1108413952 tempest-VolumesActionsTest-1108413952-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:54.955290 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-dba02f89-39c3-40a3-a0fa-3fe4d5aa8ee7 tempest-VolumesActionsTest-1108413952 tempest-VolumesActionsTest-1108413952-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:54.991155 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-dba02f89-39c3-40a3-a0fa-3fe4d5aa8ee7 tempest-VolumesActionsTest-1108413952 tempest-VolumesActionsTest-1108413952-project] [instance: 75885b47-51e4-4752-8150-00dff6c524f6] Going to try to terminate instance {{(pid=138744) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 21:13:55.143699 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-dba02f89-39c3-40a3-a0fa-3fe4d5aa8ee7 tempest-VolumesActionsTest-1108413952 tempest-VolumesActionsTest-1108413952-project] 10.222.0.18 "DELETE /compute/v2.1/servers/75885b47-51e4-4752-8150-00dff6c524f6" status: 204 len: 0 microversion: 2.1 time: 0.208648 Oct 22 21:13:55.145579 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2336/4683] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 21:13:54 2022] DELETE /compute/v2.1/servers/75885b47-51e4-4752-8150-00dff6c524f6 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 21:13:55.165978 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-f9aabe4f-e1f5-48f4-9d7c-d62153ea4be1 tempest-VolumesActionsTest-1108413952 tempest-VolumesActionsTest-1108413952-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:13:55.166706 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-f9aabe4f-e1f5-48f4-9d7c-d62153ea4be1 tempest-VolumesActionsTest-1108413952 tempest-VolumesActionsTest-1108413952-project] [instance: 75885b47-51e4-4752-8150-00dff6c524f6] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:13:55.200294 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f9aabe4f-e1f5-48f4-9d7c-d62153ea4be1 tempest-VolumesActionsTest-1108413952 tempest-VolumesActionsTest-1108413952-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:55.201936 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f9aabe4f-e1f5-48f4-9d7c-d62153ea4be1 tempest-VolumesActionsTest-1108413952 tempest-VolumesActionsTest-1108413952-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:55.202734 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f9aabe4f-e1f5-48f4-9d7c-d62153ea4be1 tempest-VolumesActionsTest-1108413952 tempest-VolumesActionsTest-1108413952-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:55.204305 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f9aabe4f-e1f5-48f4-9d7c-d62153ea4be1 tempest-VolumesActionsTest-1108413952 tempest-VolumesActionsTest-1108413952-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:55.205069 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f9aabe4f-e1f5-48f4-9d7c-d62153ea4be1 tempest-VolumesActionsTest-1108413952 tempest-VolumesActionsTest-1108413952-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:55.205863 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f9aabe4f-e1f5-48f4-9d7c-d62153ea4be1 tempest-VolumesActionsTest-1108413952 tempest-VolumesActionsTest-1108413952-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:55.253024 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-624879b6-600a-4e28-b276-a2211b8113cb tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799f987b3aa7426ba5d7a464052d6490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87474d4b4c547abbfe6308b6dd8e1c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:13:55.263885 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-624879b6-600a-4e28-b276-a2211b8113cb tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] 10.222.0.18 "GET /compute/v2.1/servers/e8de4ee1-bd84-496c-8376-025eaf5c5094" status: 200 len: 1327 microversion: 2.1 time: 0.475459 Oct 22 21:13:55.264474 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2348/4684] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:13:54 2022] GET /compute/v2.1/servers/e8de4ee1-bd84-496c-8376-025eaf5c5094 => generated 1327 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:13:55.269309 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-62a68d1f-e582-454b-af5d-304877296d01 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:13:55.269931 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-62a68d1f-e582-454b-af5d-304877296d01 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] [instance: 34dcd1da-b94c-426b-b08b-204ea287c8a2] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:13:55.276355 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-62a68d1f-e582-454b-af5d-304877296d01 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:55.276785 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-62a68d1f-e582-454b-af5d-304877296d01 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:55.277379 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-62a68d1f-e582-454b-af5d-304877296d01 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:55.278269 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-62a68d1f-e582-454b-af5d-304877296d01 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:55.278745 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-62a68d1f-e582-454b-af5d-304877296d01 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:55.279187 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-62a68d1f-e582-454b-af5d-304877296d01 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:55.640123 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-f9aabe4f-e1f5-48f4-9d7c-d62153ea4be1 tempest-VolumesActionsTest-1108413952 tempest-VolumesActionsTest-1108413952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037ea1eef49c4f7fba0dec413ce15e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c7a88417a446cd87a91bf19ef81232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:13:55.655034 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-f9aabe4f-e1f5-48f4-9d7c-d62153ea4be1 tempest-VolumesActionsTest-1108413952 tempest-VolumesActionsTest-1108413952-project] 10.222.0.18 "GET /compute/v2.1/servers/75885b47-51e4-4752-8150-00dff6c524f6" status: 200 len: 1503 microversion: 2.1 time: 0.498038 Oct 22 21:13:55.655898 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2337/4685] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:13:55 2022] GET /compute/v2.1/servers/75885b47-51e4-4752-8150-00dff6c524f6 => generated 1503 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:13:55.731530 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-62a68d1f-e582-454b-af5d-304877296d01 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:13:55.741741 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-62a68d1f-e582-454b-af5d-304877296d01 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:13:55.752461 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-62a68d1f-e582-454b-af5d-304877296d01 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:13:55.754063 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-62a68d1f-e582-454b-af5d-304877296d01 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] 10.222.0.18 "GET /compute/v2.1/servers/34dcd1da-b94c-426b-b08b-204ea287c8a2" status: 200 len: 1731 microversion: 2.20 time: 0.488623 Oct 22 21:13:55.771767 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2349/4686] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:13:55 2022] GET /compute/v2.1/servers/34dcd1da-b94c-426b-b08b-204ea287c8a2 => generated 1731 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:13:56.156974 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-6344fccf-55d6-4438-9e48-07859edf3c07 req-c9a68bef-977a-4206-8049-76f3a9f879a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8de4ee1-bd84-496c-8376-025eaf5c5094", "tag": "002b824f-cfe7-4fd8-a75e-a545afd44187"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:13:56.169271 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-6344fccf-55d6-4438-9e48-07859edf3c07 req-c9a68bef-977a-4206-8049-76f3a9f879a7 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:56.169872 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-6344fccf-55d6-4438-9e48-07859edf3c07 req-c9a68bef-977a-4206-8049-76f3a9f879a7 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:56.170364 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-6344fccf-55d6-4438-9e48-07859edf3c07 req-c9a68bef-977a-4206-8049-76f3a9f879a7 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:56.184453 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-6344fccf-55d6-4438-9e48-07859edf3c07 req-c9a68bef-977a-4206-8049-76f3a9f879a7 service nova] Creating event network-changed:002b824f-cfe7-4fd8-a75e-a545afd44187 for instance e8de4ee1-bd84-496c-8376-025eaf5c5094 on nch1-master-1 Oct 22 21:13:56.190696 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-6344fccf-55d6-4438-9e48-07859edf3c07 req-c9a68bef-977a-4206-8049-76f3a9f879a7 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048765 Oct 22 21:13:56.192023 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2338/4687] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:13:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:13:56.287980 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-c1a6e471-bb72-4e6c-814a-bc865768c04b tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:13:56.288670 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-c1a6e471-bb72-4e6c-814a-bc865768c04b tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] [instance: e8de4ee1-bd84-496c-8376-025eaf5c5094] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:13:56.297049 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c1a6e471-bb72-4e6c-814a-bc865768c04b tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:56.297866 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c1a6e471-bb72-4e6c-814a-bc865768c04b tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:56.298511 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c1a6e471-bb72-4e6c-814a-bc865768c04b tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:56.299993 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c1a6e471-bb72-4e6c-814a-bc865768c04b tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:56.300856 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c1a6e471-bb72-4e6c-814a-bc865768c04b tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:56.301523 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c1a6e471-bb72-4e6c-814a-bc865768c04b tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:56.486079 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-c1a6e471-bb72-4e6c-814a-bc865768c04b tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799f987b3aa7426ba5d7a464052d6490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87474d4b4c547abbfe6308b6dd8e1c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:13:56.496811 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-c1a6e471-bb72-4e6c-814a-bc865768c04b tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] 10.222.0.18 "GET /compute/v2.1/servers/e8de4ee1-bd84-496c-8376-025eaf5c5094" status: 200 len: 1327 microversion: 2.1 time: 0.212831 Oct 22 21:13:56.511364 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2350/4688] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:13:56 2022] GET /compute/v2.1/servers/e8de4ee1-bd84-496c-8376-025eaf5c5094 => generated 1327 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:13:56.692695 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-0a0b6f1c-401d-4c76-87cc-01a327b3a088 tempest-VolumesActionsTest-1108413952 tempest-VolumesActionsTest-1108413952-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:13:56.695747 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-0a0b6f1c-401d-4c76-87cc-01a327b3a088 tempest-VolumesActionsTest-1108413952 tempest-VolumesActionsTest-1108413952-project] [instance: 75885b47-51e4-4752-8150-00dff6c524f6] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:13:56.707452 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0a0b6f1c-401d-4c76-87cc-01a327b3a088 tempest-VolumesActionsTest-1108413952 tempest-VolumesActionsTest-1108413952-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:56.707944 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0a0b6f1c-401d-4c76-87cc-01a327b3a088 tempest-VolumesActionsTest-1108413952 tempest-VolumesActionsTest-1108413952-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:56.708601 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0a0b6f1c-401d-4c76-87cc-01a327b3a088 tempest-VolumesActionsTest-1108413952 tempest-VolumesActionsTest-1108413952-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:56.709320 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0a0b6f1c-401d-4c76-87cc-01a327b3a088 tempest-VolumesActionsTest-1108413952 tempest-VolumesActionsTest-1108413952-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:56.709843 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0a0b6f1c-401d-4c76-87cc-01a327b3a088 tempest-VolumesActionsTest-1108413952 tempest-VolumesActionsTest-1108413952-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:56.710190 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0a0b6f1c-401d-4c76-87cc-01a327b3a088 tempest-VolumesActionsTest-1108413952 tempest-VolumesActionsTest-1108413952-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:56.781355 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-c83f260e-1820-4994-af1f-1a3fdce9ac00 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:13:56.782008 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-c83f260e-1820-4994-af1f-1a3fdce9ac00 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] [instance: 34dcd1da-b94c-426b-b08b-204ea287c8a2] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:13:56.791462 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c83f260e-1820-4994-af1f-1a3fdce9ac00 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:56.792360 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c83f260e-1820-4994-af1f-1a3fdce9ac00 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:56.793263 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c83f260e-1820-4994-af1f-1a3fdce9ac00 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:56.794244 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c83f260e-1820-4994-af1f-1a3fdce9ac00 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:56.794939 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c83f260e-1820-4994-af1f-1a3fdce9ac00 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:56.795815 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c83f260e-1820-4994-af1f-1a3fdce9ac00 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:57.139359 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-0a0b6f1c-401d-4c76-87cc-01a327b3a088 tempest-VolumesActionsTest-1108413952 tempest-VolumesActionsTest-1108413952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037ea1eef49c4f7fba0dec413ce15e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c7a88417a446cd87a91bf19ef81232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:13:57.150075 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-0a0b6f1c-401d-4c76-87cc-01a327b3a088 tempest-VolumesActionsTest-1108413952 tempest-VolumesActionsTest-1108413952-project] 10.222.0.18 "GET /compute/v2.1/servers/75885b47-51e4-4752-8150-00dff6c524f6" status: 200 len: 1503 microversion: 2.1 time: 0.471076 Oct 22 21:13:57.150730 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2339/4689] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:13:56 2022] GET /compute/v2.1/servers/75885b47-51e4-4752-8150-00dff6c524f6 => generated 1503 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:13:57.190314 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-c83f260e-1820-4994-af1f-1a3fdce9ac00 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:13:57.195030 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:13:57.212712 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-c83f260e-1820-4994-af1f-1a3fdce9ac00 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:13:57.214232 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-c83f260e-1820-4994-af1f-1a3fdce9ac00 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:13:57.215943 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-c83f260e-1820-4994-af1f-1a3fdce9ac00 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] 10.222.0.18 "GET /compute/v2.1/servers/34dcd1da-b94c-426b-b08b-204ea287c8a2" status: 200 len: 1731 microversion: 2.20 time: 0.438748 Oct 22 21:13:57.216599 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2351/4690] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:13:56 2022] GET /compute/v2.1/servers/34dcd1da-b94c-426b-b08b-204ea287c8a2 => generated 1731 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:13:57.523954 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-106dbebf-0f0c-4a7e-8de5-2582662e82cc tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:13:57.524681 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-106dbebf-0f0c-4a7e-8de5-2582662e82cc tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] [instance: e8de4ee1-bd84-496c-8376-025eaf5c5094] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:13:57.542113 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-106dbebf-0f0c-4a7e-8de5-2582662e82cc tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:57.543044 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-106dbebf-0f0c-4a7e-8de5-2582662e82cc tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:57.543768 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-106dbebf-0f0c-4a7e-8de5-2582662e82cc tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:57.545158 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-106dbebf-0f0c-4a7e-8de5-2582662e82cc tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:57.547271 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-106dbebf-0f0c-4a7e-8de5-2582662e82cc tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:57.548164 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-106dbebf-0f0c-4a7e-8de5-2582662e82cc tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:57.801781 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-106dbebf-0f0c-4a7e-8de5-2582662e82cc tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799f987b3aa7426ba5d7a464052d6490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87474d4b4c547abbfe6308b6dd8e1c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:13:57.815688 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-106dbebf-0f0c-4a7e-8de5-2582662e82cc tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] 10.222.0.18 "GET /compute/v2.1/servers/e8de4ee1-bd84-496c-8376-025eaf5c5094" status: 200 len: 1327 microversion: 2.1 time: 0.297664 Oct 22 21:13:57.817408 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2340/4691] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:13:57 2022] GET /compute/v2.1/servers/e8de4ee1-bd84-496c-8376-025eaf5c5094 => generated 1327 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:13:58.178239 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-e3ccc6d7-dff8-4fde-a91a-32ff0079a006 tempest-VolumesActionsTest-1108413952 tempest-VolumesActionsTest-1108413952-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:13:58.178919 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-e3ccc6d7-dff8-4fde-a91a-32ff0079a006 tempest-VolumesActionsTest-1108413952 tempest-VolumesActionsTest-1108413952-project] [instance: 75885b47-51e4-4752-8150-00dff6c524f6] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:13:58.188093 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e3ccc6d7-dff8-4fde-a91a-32ff0079a006 tempest-VolumesActionsTest-1108413952 tempest-VolumesActionsTest-1108413952-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:58.188587 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e3ccc6d7-dff8-4fde-a91a-32ff0079a006 tempest-VolumesActionsTest-1108413952 tempest-VolumesActionsTest-1108413952-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:58.189049 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e3ccc6d7-dff8-4fde-a91a-32ff0079a006 tempest-VolumesActionsTest-1108413952 tempest-VolumesActionsTest-1108413952-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:58.189855 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e3ccc6d7-dff8-4fde-a91a-32ff0079a006 tempest-VolumesActionsTest-1108413952 tempest-VolumesActionsTest-1108413952-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:58.190273 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e3ccc6d7-dff8-4fde-a91a-32ff0079a006 tempest-VolumesActionsTest-1108413952 tempest-VolumesActionsTest-1108413952-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:58.190726 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e3ccc6d7-dff8-4fde-a91a-32ff0079a006 tempest-VolumesActionsTest-1108413952 tempest-VolumesActionsTest-1108413952-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:58.222791 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-31e60f37-4084-45df-8acc-25dc9287b298 req-ca516712-eb63-4d32-8892-cc883d126360 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75885b47-51e4-4752-8150-00dff6c524f6", "name": "network-vif-deleted", "tag": "20d578f5-f035-4fa8-aeda-a0849361750e"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:13:58.236624 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e3ccc6d7-dff8-4fde-a91a-32ff0079a006 tempest-VolumesActionsTest-1108413952 tempest-VolumesActionsTest-1108413952-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:58.239884 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e3ccc6d7-dff8-4fde-a91a-32ff0079a006 tempest-VolumesActionsTest-1108413952 tempest-VolumesActionsTest-1108413952-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:58.240577 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e3ccc6d7-dff8-4fde-a91a-32ff0079a006 tempest-VolumesActionsTest-1108413952 tempest-VolumesActionsTest-1108413952-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:58.241273 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.objects.instance [None req-e3ccc6d7-dff8-4fde-a91a-32ff0079a006 tempest-VolumesActionsTest-1108413952 tempest-VolumesActionsTest-1108413952-project] Lazy-loading 'fault' on Instance uuid 75885b47-51e4-4752-8150-00dff6c524f6 {{(pid=138745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 21:13:58.249640 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-31e60f37-4084-45df-8acc-25dc9287b298 req-ca516712-eb63-4d32-8892-cc883d126360 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:58.251176 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-31e60f37-4084-45df-8acc-25dc9287b298 req-ca516712-eb63-4d32-8892-cc883d126360 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:58.252392 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-31e60f37-4084-45df-8acc-25dc9287b298 req-ca516712-eb63-4d32-8892-cc883d126360 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:58.294481 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-31e60f37-4084-45df-8acc-25dc9287b298 req-ca516712-eb63-4d32-8892-cc883d126360 service nova] Creating event network-vif-deleted:20d578f5-f035-4fa8-aeda-a0849361750e for instance 75885b47-51e4-4752-8150-00dff6c524f6 on nch2-master-1 Oct 22 21:13:58.318651 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-31e60f37-4084-45df-8acc-25dc9287b298 req-ca516712-eb63-4d32-8892-cc883d126360 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101531 Oct 22 21:13:58.320667 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2341/4692] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:13:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 21:13:58.330461 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-e58ebf62-a642-408a-b9d2-ad0c8125ce25 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:13:58.331715 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-e58ebf62-a642-408a-b9d2-ad0c8125ce25 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] [instance: 34dcd1da-b94c-426b-b08b-204ea287c8a2] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:13:58.339233 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e58ebf62-a642-408a-b9d2-ad0c8125ce25 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:58.340998 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e58ebf62-a642-408a-b9d2-ad0c8125ce25 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:58.341466 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e58ebf62-a642-408a-b9d2-ad0c8125ce25 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:58.342843 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e58ebf62-a642-408a-b9d2-ad0c8125ce25 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:58.343567 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e58ebf62-a642-408a-b9d2-ad0c8125ce25 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:58.344456 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e58ebf62-a642-408a-b9d2-ad0c8125ce25 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:58.347097 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-e3ccc6d7-dff8-4fde-a91a-32ff0079a006 tempest-VolumesActionsTest-1108413952 tempest-VolumesActionsTest-1108413952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037ea1eef49c4f7fba0dec413ce15e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c7a88417a446cd87a91bf19ef81232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:13:58.356896 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-e3ccc6d7-dff8-4fde-a91a-32ff0079a006 tempest-VolumesActionsTest-1108413952 tempest-VolumesActionsTest-1108413952-project] 10.222.0.18 "GET /compute/v2.1/servers/75885b47-51e4-4752-8150-00dff6c524f6" status: 200 len: 1304 microversion: 2.1 time: 0.182518 Oct 22 21:13:58.368442 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2352/4693] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:13:58 2022] GET /compute/v2.1/servers/75885b47-51e4-4752-8150-00dff6c524f6 => generated 1304 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:13:58.572207 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-e58ebf62-a642-408a-b9d2-ad0c8125ce25 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:13:58.583417 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-e58ebf62-a642-408a-b9d2-ad0c8125ce25 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:13:58.584909 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-e58ebf62-a642-408a-b9d2-ad0c8125ce25 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:13:58.586204 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-e58ebf62-a642-408a-b9d2-ad0c8125ce25 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] 10.222.0.18 "GET /compute/v2.1/servers/34dcd1da-b94c-426b-b08b-204ea287c8a2" status: 200 len: 1731 microversion: 2.20 time: 0.264136 Oct 22 21:13:58.587014 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2342/4694] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:13:58 2022] GET /compute/v2.1/servers/34dcd1da-b94c-426b-b08b-204ea287c8a2 => generated 1731 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:13:58.842107 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-51e39c8c-7322-40b3-ad12-8c0ad0389530 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:13:58.843467 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-51e39c8c-7322-40b3-ad12-8c0ad0389530 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] [instance: e8de4ee1-bd84-496c-8376-025eaf5c5094] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:13:58.851133 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-51e39c8c-7322-40b3-ad12-8c0ad0389530 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:58.851772 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-51e39c8c-7322-40b3-ad12-8c0ad0389530 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:58.852509 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-51e39c8c-7322-40b3-ad12-8c0ad0389530 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:58.853499 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-51e39c8c-7322-40b3-ad12-8c0ad0389530 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:58.854046 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-51e39c8c-7322-40b3-ad12-8c0ad0389530 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:58.854558 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-51e39c8c-7322-40b3-ad12-8c0ad0389530 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:59.022239 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-51e39c8c-7322-40b3-ad12-8c0ad0389530 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799f987b3aa7426ba5d7a464052d6490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87474d4b4c547abbfe6308b6dd8e1c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:13:59.034839 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-51e39c8c-7322-40b3-ad12-8c0ad0389530 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] 10.222.0.18 "GET /compute/v2.1/servers/e8de4ee1-bd84-496c-8376-025eaf5c5094" status: 200 len: 1327 microversion: 2.1 time: 0.197991 Oct 22 21:13:59.050814 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2353/4695] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:13:58 2022] GET /compute/v2.1/servers/e8de4ee1-bd84-496c-8376-025eaf5c5094 => generated 1327 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:13:59.393602 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-b2c97022-a50f-4f63-b9e5-2599d9957246 tempest-VolumesActionsTest-1108413952 tempest-VolumesActionsTest-1108413952-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:13:59.394238 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-b2c97022-a50f-4f63-b9e5-2599d9957246 tempest-VolumesActionsTest-1108413952 tempest-VolumesActionsTest-1108413952-project] [instance: 75885b47-51e4-4752-8150-00dff6c524f6] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:13:59.401673 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b2c97022-a50f-4f63-b9e5-2599d9957246 tempest-VolumesActionsTest-1108413952 tempest-VolumesActionsTest-1108413952-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:59.402259 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b2c97022-a50f-4f63-b9e5-2599d9957246 tempest-VolumesActionsTest-1108413952 tempest-VolumesActionsTest-1108413952-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:59.402836 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b2c97022-a50f-4f63-b9e5-2599d9957246 tempest-VolumesActionsTest-1108413952 tempest-VolumesActionsTest-1108413952-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:59.403609 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b2c97022-a50f-4f63-b9e5-2599d9957246 tempest-VolumesActionsTest-1108413952 tempest-VolumesActionsTest-1108413952-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:59.404055 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b2c97022-a50f-4f63-b9e5-2599d9957246 tempest-VolumesActionsTest-1108413952 tempest-VolumesActionsTest-1108413952-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:59.404485 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b2c97022-a50f-4f63-b9e5-2599d9957246 tempest-VolumesActionsTest-1108413952 tempest-VolumesActionsTest-1108413952-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:59.421116 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-b2c97022-a50f-4f63-b9e5-2599d9957246 tempest-VolumesActionsTest-1108413952 tempest-VolumesActionsTest-1108413952-project] HTTP exception thrown: Instance 75885b47-51e4-4752-8150-00dff6c524f6 could not be found. Oct 22 21:13:59.423619 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-b2c97022-a50f-4f63-b9e5-2599d9957246 tempest-VolumesActionsTest-1108413952 tempest-VolumesActionsTest-1108413952-project] Request method failure captured: Oct 22 21:13:59.423619 ncdv-master-1 devstack@n-api.service[138744]: request: GET /compute/v2.1/servers/75885b47-51e4-4752-8150-00dff6c524f6 HTTP/1.1 Oct 22 21:13:59.423619 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 21:13:59.423619 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 21:13:59.423619 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 21:13:59.423619 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 0 Oct 22 21:13:59.423619 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 21:13:59.423619 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 21:13:59.423619 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 21:13:59.423619 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 21:13:59.423619 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVFz7vsQgFNeXS_7TXsVOenyGgxAxAFt9ugUtO6EiLbTHXlhq4v3NAks4zfjbQkVbvl0K-l4vNzVA2B4wSU4pnmLzsSG7f9scNcgFCYZuZ2d1hkr0GpY2l3lQVUgEXFDQqBBV0F4uir_InV8FG36gCBCi3h65lc_zDXlLeZlR9VIk7dE Oct 22 21:13:59.423619 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 21:13:59.423619 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 21:13:59.423619 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 21:13:59.423619 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 21:13:59.423619 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 21:13:59.423619 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 21:13:59.423619 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: 90c7a88417a446cd87a91bf19ef81232 Oct 22 21:13:59.423619 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-VolumesActionsTest-1108413952 Oct 22 21:13:59.423619 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 21:13:59.423619 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 21:13:59.423619 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_90c7a88417a446cd87a91bf19ef81232"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/90c7a88417a446cd87a91bf19ef81232"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/90c7a88417a446cd87a91bf19ef81232"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/90c7a88417a446cd87a91bf19ef81232"}]}] Oct 22 21:13:59.423619 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-VolumesActionsTest-1108413952 Oct 22 21:13:59.423619 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: 90c7a88417a446cd87a91bf19ef81232 Oct 22 21:13:59.423619 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-VolumesActionsTest-1108413952 Oct 22 21:13:59.423619 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-VolumesActionsTest-1108413952-project Oct 22 21:13:59.423619 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 21:13:59.423619 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 21:13:59.423619 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: 037ea1eef49c4f7fba0dec413ce15e5e Oct 22 21:13:59.423619 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-VolumesActionsTest-1108413952-project Oct 22 21:13:59.423619 ncdv-master-1 devstack@n-api.service[138744]: method: > Oct 22 21:13:59.423619 ncdv-master-1 devstack@n-api.service[138744]: exception: Instance 75885b47-51e4-4752-8150-00dff6c524f6 could not be found. Oct 22 21:13:59.423619 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': '75885b47-51e4-4752-8150-00dff6c524f6'} Oct 22 21:13:59.423619 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:13:59.423619 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:13:59.423619 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 21:13:59.423619 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 21:13:59.423619 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 21:13:59.423619 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 21:13:59.423619 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 21:13:59.423619 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 21:13:59.423619 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 21:13:59.423619 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 21:13:59.423619 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75885b47-51e4-4752-8150-00dff6c524f6 could not be found. Oct 22 21:13:59.423619 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:13:59.423619 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:13:59.423619 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:13:59.423619 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:13:59.423619 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:13:59.423619 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:13:59.423619 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:13:59.423619 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:13:59.423619 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:13:59.423619 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:13:59.423619 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 21:13:59.423619 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 21:13:59.423619 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 21:13:59.423619 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 21:13:59.423619 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 21:13:59.423619 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:13:59.423619 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75885b47-51e4-4752-8150-00dff6c524f6 could not be found. Oct 22 21:13:59.423619 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:13:59.423619 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:13:59.423619 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:13:59.436479 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:13:59.436479 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:13:59.436479 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:13:59.436479 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:13:59.436479 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:13:59.436479 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75885b47-51e4-4752-8150-00dff6c524f6 could not be found. Oct 22 21:13:59.436479 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:13:59.436479 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-b2c97022-a50f-4f63-b9e5-2599d9957246 tempest-VolumesActionsTest-1108413952 tempest-VolumesActionsTest-1108413952-project] Returning 404 to user: Instance 75885b47-51e4-4752-8150-00dff6c524f6 could not be found. {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:13:59.436479 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-b2c97022-a50f-4f63-b9e5-2599d9957246 tempest-VolumesActionsTest-1108413952 tempest-VolumesActionsTest-1108413952-project] 10.222.0.18 "GET /compute/v2.1/servers/75885b47-51e4-4752-8150-00dff6c524f6" status: 404 len: 111 microversion: 2.1 time: 0.037563 Oct 22 21:13:59.436479 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2343/4696] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:13:59 2022] GET /compute/v2.1/servers/75885b47-51e4-4752-8150-00dff6c524f6 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 21:13:59.615403 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-daa85a18-44a5-44f6-aed8-c36cb6dba49a tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:13:59.616816 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-daa85a18-44a5-44f6-aed8-c36cb6dba49a tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] [instance: 34dcd1da-b94c-426b-b08b-204ea287c8a2] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:13:59.623836 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell0:SELECT=2 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:13:59.624491 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell0:SELECT=10 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:13:59.626445 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-daa85a18-44a5-44f6-aed8-c36cb6dba49a tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:59.627032 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-daa85a18-44a5-44f6-aed8-c36cb6dba49a tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:59.632342 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-daa85a18-44a5-44f6-aed8-c36cb6dba49a tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:59.637734 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-daa85a18-44a5-44f6-aed8-c36cb6dba49a tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:13:59.638288 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-daa85a18-44a5-44f6-aed8-c36cb6dba49a tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:13:59.638751 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-daa85a18-44a5-44f6-aed8-c36cb6dba49a tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:13:59.863681 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-daa85a18-44a5-44f6-aed8-c36cb6dba49a tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:13:59.872376 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-daa85a18-44a5-44f6-aed8-c36cb6dba49a tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:13:59.874281 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-daa85a18-44a5-44f6-aed8-c36cb6dba49a tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:13:59.875884 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-daa85a18-44a5-44f6-aed8-c36cb6dba49a tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] 10.222.0.18 "GET /compute/v2.1/servers/34dcd1da-b94c-426b-b08b-204ea287c8a2" status: 200 len: 1731 microversion: 2.20 time: 0.264514 Oct 22 21:13:59.876660 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2354/4697] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:13:59 2022] GET /compute/v2.1/servers/34dcd1da-b94c-426b-b08b-204ea287c8a2 => generated 1731 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:14:00.058401 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-ffd353b4-7e12-467c-bf56-a6f944c345b4 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:14:00.059163 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-ffd353b4-7e12-467c-bf56-a6f944c345b4 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] [instance: e8de4ee1-bd84-496c-8376-025eaf5c5094] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:14:00.061298 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell0:SELECT=2 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:14:00.066490 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ffd353b4-7e12-467c-bf56-a6f944c345b4 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:00.066979 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ffd353b4-7e12-467c-bf56-a6f944c345b4 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:00.067738 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ffd353b4-7e12-467c-bf56-a6f944c345b4 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:00.068415 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ffd353b4-7e12-467c-bf56-a6f944c345b4 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:00.068875 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ffd353b4-7e12-467c-bf56-a6f944c345b4 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:00.069318 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ffd353b4-7e12-467c-bf56-a6f944c345b4 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:00.205945 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-ffd353b4-7e12-467c-bf56-a6f944c345b4 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799f987b3aa7426ba5d7a464052d6490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87474d4b4c547abbfe6308b6dd8e1c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:14:00.214226 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-ffd353b4-7e12-467c-bf56-a6f944c345b4 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] 10.222.0.18 "GET /compute/v2.1/servers/e8de4ee1-bd84-496c-8376-025eaf5c5094" status: 200 len: 1327 microversion: 2.1 time: 0.159872 Oct 22 21:14:00.214922 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2344/4698] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:14:00 2022] GET /compute/v2.1/servers/e8de4ee1-bd84-496c-8376-025eaf5c5094 => generated 1327 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:14:00.906044 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-904370aa-43a0-4f36-ae39-7292ad2768f7 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:14:00.906879 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-904370aa-43a0-4f36-ae39-7292ad2768f7 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] [instance: 34dcd1da-b94c-426b-b08b-204ea287c8a2] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:14:00.916320 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-904370aa-43a0-4f36-ae39-7292ad2768f7 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:00.917118 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-904370aa-43a0-4f36-ae39-7292ad2768f7 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:00.917580 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-904370aa-43a0-4f36-ae39-7292ad2768f7 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:00.918312 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-904370aa-43a0-4f36-ae39-7292ad2768f7 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:00.918783 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-904370aa-43a0-4f36-ae39-7292ad2768f7 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:00.919218 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-904370aa-43a0-4f36-ae39-7292ad2768f7 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:01.066346 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-904370aa-43a0-4f36-ae39-7292ad2768f7 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:14:01.078324 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-904370aa-43a0-4f36-ae39-7292ad2768f7 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:14:01.079537 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-904370aa-43a0-4f36-ae39-7292ad2768f7 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:14:01.080727 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-904370aa-43a0-4f36-ae39-7292ad2768f7 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] 10.222.0.18 "GET /compute/v2.1/servers/34dcd1da-b94c-426b-b08b-204ea287c8a2" status: 200 len: 1731 microversion: 2.20 time: 0.182023 Oct 22 21:14:01.089204 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2355/4699] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:14:00 2022] GET /compute/v2.1/servers/34dcd1da-b94c-426b-b08b-204ea287c8a2 => generated 1731 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:14:01.238788 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-15728882-ca5b-4bbf-a530-ab010b4aefa8 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:14:01.239426 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-15728882-ca5b-4bbf-a530-ab010b4aefa8 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] [instance: e8de4ee1-bd84-496c-8376-025eaf5c5094] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:14:01.247581 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-15728882-ca5b-4bbf-a530-ab010b4aefa8 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:01.254448 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-15728882-ca5b-4bbf-a530-ab010b4aefa8 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:01.254448 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-15728882-ca5b-4bbf-a530-ab010b4aefa8 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:01.254448 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-15728882-ca5b-4bbf-a530-ab010b4aefa8 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:01.254448 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-15728882-ca5b-4bbf-a530-ab010b4aefa8 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:01.254448 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-15728882-ca5b-4bbf-a530-ab010b4aefa8 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:01.387826 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-15728882-ca5b-4bbf-a530-ab010b4aefa8 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799f987b3aa7426ba5d7a464052d6490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87474d4b4c547abbfe6308b6dd8e1c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:14:01.396133 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-15728882-ca5b-4bbf-a530-ab010b4aefa8 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] 10.222.0.18 "GET /compute/v2.1/servers/e8de4ee1-bd84-496c-8376-025eaf5c5094" status: 200 len: 1327 microversion: 2.1 time: 0.161664 Oct 22 21:14:01.396703 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2345/4700] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:14:01 2022] GET /compute/v2.1/servers/e8de4ee1-bd84-496c-8376-025eaf5c5094 => generated 1327 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:14:02.106890 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-6f641332-57d3-471f-ab4b-73e7c179766c tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:14:02.107507 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-6f641332-57d3-471f-ab4b-73e7c179766c tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] [instance: 34dcd1da-b94c-426b-b08b-204ea287c8a2] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:14:02.115090 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6f641332-57d3-471f-ab4b-73e7c179766c tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:02.115623 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6f641332-57d3-471f-ab4b-73e7c179766c tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:02.116041 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6f641332-57d3-471f-ab4b-73e7c179766c tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:02.116999 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6f641332-57d3-471f-ab4b-73e7c179766c tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:02.117468 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6f641332-57d3-471f-ab4b-73e7c179766c tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:02.117911 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6f641332-57d3-471f-ab4b-73e7c179766c tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:02.259300 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-6f641332-57d3-471f-ab4b-73e7c179766c tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:14:02.268324 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-6f641332-57d3-471f-ab4b-73e7c179766c tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:14:02.269783 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-6f641332-57d3-471f-ab4b-73e7c179766c tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:14:02.270991 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-6f641332-57d3-471f-ab4b-73e7c179766c tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] 10.222.0.18 "GET /compute/v2.1/servers/34dcd1da-b94c-426b-b08b-204ea287c8a2" status: 200 len: 1731 microversion: 2.20 time: 0.168244 Oct 22 21:14:02.274392 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2356/4701] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:14:02 2022] GET /compute/v2.1/servers/34dcd1da-b94c-426b-b08b-204ea287c8a2 => generated 1731 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:14:02.418705 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-86958283-d3e0-402f-9302-4db24e14eadb tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:14:02.419418 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-86958283-d3e0-402f-9302-4db24e14eadb tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] [instance: e8de4ee1-bd84-496c-8376-025eaf5c5094] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:14:02.427879 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-86958283-d3e0-402f-9302-4db24e14eadb tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:02.428501 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-86958283-d3e0-402f-9302-4db24e14eadb tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:02.429017 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-86958283-d3e0-402f-9302-4db24e14eadb tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:02.429998 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-86958283-d3e0-402f-9302-4db24e14eadb tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:02.430459 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-86958283-d3e0-402f-9302-4db24e14eadb tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:02.431102 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-86958283-d3e0-402f-9302-4db24e14eadb tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:02.576369 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-86958283-d3e0-402f-9302-4db24e14eadb tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799f987b3aa7426ba5d7a464052d6490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87474d4b4c547abbfe6308b6dd8e1c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:14:02.584881 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-86958283-d3e0-402f-9302-4db24e14eadb tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] 10.222.0.18 "GET /compute/v2.1/servers/e8de4ee1-bd84-496c-8376-025eaf5c5094" status: 200 len: 1327 microversion: 2.1 time: 0.170508 Oct 22 21:14:02.585526 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2346/4702] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:14:02 2022] GET /compute/v2.1/servers/e8de4ee1-bd84-496c-8376-025eaf5c5094 => generated 1327 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:14:03.300041 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-3274940f-9b46-4fbe-bdd9-b4b3d551f11a tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:14:03.301090 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-3274940f-9b46-4fbe-bdd9-b4b3d551f11a tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] [instance: 34dcd1da-b94c-426b-b08b-204ea287c8a2] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:14:03.309837 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3274940f-9b46-4fbe-bdd9-b4b3d551f11a tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:03.310343 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3274940f-9b46-4fbe-bdd9-b4b3d551f11a tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:03.311425 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3274940f-9b46-4fbe-bdd9-b4b3d551f11a tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:03.312676 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3274940f-9b46-4fbe-bdd9-b4b3d551f11a tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:03.313162 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3274940f-9b46-4fbe-bdd9-b4b3d551f11a tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:03.313733 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3274940f-9b46-4fbe-bdd9-b4b3d551f11a tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:03.536228 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-3274940f-9b46-4fbe-bdd9-b4b3d551f11a tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:14:03.544810 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-3274940f-9b46-4fbe-bdd9-b4b3d551f11a tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:14:03.546359 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-3274940f-9b46-4fbe-bdd9-b4b3d551f11a tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:14:03.547707 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-3274940f-9b46-4fbe-bdd9-b4b3d551f11a tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] 10.222.0.18 "GET /compute/v2.1/servers/34dcd1da-b94c-426b-b08b-204ea287c8a2" status: 200 len: 1731 microversion: 2.20 time: 0.253471 Oct 22 21:14:03.548498 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2357/4703] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:14:03 2022] GET /compute/v2.1/servers/34dcd1da-b94c-426b-b08b-204ea287c8a2 => generated 1731 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:14:03.610331 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-d2f28173-d3a4-45c9-b710-62f91b2a47f5 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:14:03.611155 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-d2f28173-d3a4-45c9-b710-62f91b2a47f5 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] [instance: e8de4ee1-bd84-496c-8376-025eaf5c5094] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:14:03.620028 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d2f28173-d3a4-45c9-b710-62f91b2a47f5 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:03.620527 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d2f28173-d3a4-45c9-b710-62f91b2a47f5 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:03.621075 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d2f28173-d3a4-45c9-b710-62f91b2a47f5 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:03.621995 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d2f28173-d3a4-45c9-b710-62f91b2a47f5 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:03.622452 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d2f28173-d3a4-45c9-b710-62f91b2a47f5 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:03.622878 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d2f28173-d3a4-45c9-b710-62f91b2a47f5 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:03.780730 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-d2f28173-d3a4-45c9-b710-62f91b2a47f5 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799f987b3aa7426ba5d7a464052d6490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87474d4b4c547abbfe6308b6dd8e1c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:14:03.789299 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-d2f28173-d3a4-45c9-b710-62f91b2a47f5 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] 10.222.0.18 "GET /compute/v2.1/servers/e8de4ee1-bd84-496c-8376-025eaf5c5094" status: 200 len: 1327 microversion: 2.1 time: 0.182974 Oct 22 21:14:03.790163 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2347/4704] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:14:03 2022] GET /compute/v2.1/servers/e8de4ee1-bd84-496c-8376-025eaf5c5094 => generated 1327 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:14:04.189621 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-7e6eb083-68b9-47e9-b0a2-fbfce0136ea6 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:14:04.192031 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-7e6eb083-68b9-47e9-b0a2-fbfce0136ea6 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] [instance: 9dd3ccc4-26f1-4d75-b990-6636ed02293e] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:14:04.198298 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7e6eb083-68b9-47e9-b0a2-fbfce0136ea6 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:04.198805 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7e6eb083-68b9-47e9-b0a2-fbfce0136ea6 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:04.199241 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7e6eb083-68b9-47e9-b0a2-fbfce0136ea6 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:04.200007 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7e6eb083-68b9-47e9-b0a2-fbfce0136ea6 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:04.200485 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7e6eb083-68b9-47e9-b0a2-fbfce0136ea6 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:04.200932 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7e6eb083-68b9-47e9-b0a2-fbfce0136ea6 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:04.231989 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-7e6eb083-68b9-47e9-b0a2-fbfce0136ea6 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] 10.222.0.18 "GET /compute/v2.1/servers/9dd3ccc4-26f1-4d75-b990-6636ed02293e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046530 Oct 22 21:14:04.232778 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2358/4705] 10.222.0.18 () {58 vars in 1302 bytes} [Sat Oct 22 21:14:04 2022] GET /compute/v2.1/servers/9dd3ccc4-26f1-4d75-b990-6636ed02293e/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:14:04.382159 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-dc404df7-cdbf-4209-96de-8c9ec752c25b tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:14:04.382612 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-dc404df7-cdbf-4209-96de-8c9ec752c25b tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] [instance: 9dd3ccc4-26f1-4d75-b990-6636ed02293e] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:14:04.389696 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-dc404df7-cdbf-4209-96de-8c9ec752c25b tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:04.390478 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-dc404df7-cdbf-4209-96de-8c9ec752c25b tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:04.390925 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-dc404df7-cdbf-4209-96de-8c9ec752c25b tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:04.391674 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-dc404df7-cdbf-4209-96de-8c9ec752c25b tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:04.392144 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-dc404df7-cdbf-4209-96de-8c9ec752c25b tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:04.392605 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-dc404df7-cdbf-4209-96de-8c9ec752c25b tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:04.395110 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:14:04.425126 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-dc404df7-cdbf-4209-96de-8c9ec752c25b tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] 10.222.0.18 "GET /compute/v2.1/servers/9dd3ccc4-26f1-4d75-b990-6636ed02293e/os-volume_attachments/c3d2ed04-7d94-4677-95f3-3146478267d8" status: 200 len: 194 microversion: 2.1 time: 0.047171 Oct 22 21:14:04.425738 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2348/4706] 10.222.0.18 () {58 vars in 1413 bytes} [Sat Oct 22 21:14:04 2022] GET /compute/v2.1/servers/9dd3ccc4-26f1-4d75-b990-6636ed02293e/os-volume_attachments/c3d2ed04-7d94-4677-95f3-3146478267d8 => generated 194 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:14:04.437062 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-9adc7b18-1452-42c3-9dca-f16020969d17 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:14:04.437611 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-9adc7b18-1452-42c3-9dca-f16020969d17 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] [instance: 9dd3ccc4-26f1-4d75-b990-6636ed02293e] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:14:04.444856 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9adc7b18-1452-42c3-9dca-f16020969d17 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:04.445356 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9adc7b18-1452-42c3-9dca-f16020969d17 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:04.445811 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9adc7b18-1452-42c3-9dca-f16020969d17 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:04.446529 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9adc7b18-1452-42c3-9dca-f16020969d17 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:04.446997 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9adc7b18-1452-42c3-9dca-f16020969d17 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:04.447495 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9adc7b18-1452-42c3-9dca-f16020969d17 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:04.570060 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.objects.instance [None req-9adc7b18-1452-42c3-9dca-f16020969d17 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lazy-loading 'services' on Instance uuid 9dd3ccc4-26f1-4d75-b990-6636ed02293e {{(pid=138745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 21:14:04.575518 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-f44381cb-dff4-4231-9ac9-42246cf48000 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:14:04.576128 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-f44381cb-dff4-4231-9ac9-42246cf48000 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] [instance: 34dcd1da-b94c-426b-b08b-204ea287c8a2] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:14:04.582302 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f44381cb-dff4-4231-9ac9-42246cf48000 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:04.582785 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f44381cb-dff4-4231-9ac9-42246cf48000 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:04.583217 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f44381cb-dff4-4231-9ac9-42246cf48000 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:04.583952 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f44381cb-dff4-4231-9ac9-42246cf48000 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:04.584393 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f44381cb-dff4-4231-9ac9-42246cf48000 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:04.584823 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f44381cb-dff4-4231-9ac9-42246cf48000 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:04.646933 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-9adc7b18-1452-42c3-9dca-f16020969d17 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] 10.222.0.18 "DELETE /compute/v2.1/servers/9dd3ccc4-26f1-4d75-b990-6636ed02293e/os-volume_attachments/c3d2ed04-7d94-4677-95f3-3146478267d8" status: 202 len: 0 microversion: 2.1 time: 0.213618 Oct 22 21:14:04.647481 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2359/4707] 10.222.0.18 () {58 vars in 1416 bytes} [Sat Oct 22 21:14:04 2022] DELETE /compute/v2.1/servers/9dd3ccc4-26f1-4d75-b990-6636ed02293e/os-volume_attachments/c3d2ed04-7d94-4677-95f3-3146478267d8 => generated 0 bytes in 215 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 21:14:04.725578 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-f44381cb-dff4-4231-9ac9-42246cf48000 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:14:04.735207 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-f44381cb-dff4-4231-9ac9-42246cf48000 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:14:04.736939 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-f44381cb-dff4-4231-9ac9-42246cf48000 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:14:04.738161 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-f44381cb-dff4-4231-9ac9-42246cf48000 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] 10.222.0.18 "GET /compute/v2.1/servers/34dcd1da-b94c-426b-b08b-204ea287c8a2" status: 200 len: 1731 microversion: 2.20 time: 0.167843 Oct 22 21:14:04.738728 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2349/4708] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:14:04 2022] GET /compute/v2.1/servers/34dcd1da-b94c-426b-b08b-204ea287c8a2 => generated 1731 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 22 21:14:04.814083 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-46689098-7d98-40c1-8c22-cf4a2b394931 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:14:04.814849 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-46689098-7d98-40c1-8c22-cf4a2b394931 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] [instance: e8de4ee1-bd84-496c-8376-025eaf5c5094] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:14:04.822227 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-46689098-7d98-40c1-8c22-cf4a2b394931 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:04.822839 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-46689098-7d98-40c1-8c22-cf4a2b394931 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:04.823298 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-46689098-7d98-40c1-8c22-cf4a2b394931 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:04.824063 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-46689098-7d98-40c1-8c22-cf4a2b394931 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:04.824597 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-46689098-7d98-40c1-8c22-cf4a2b394931 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:04.825042 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-46689098-7d98-40c1-8c22-cf4a2b394931 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:04.970263 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-46689098-7d98-40c1-8c22-cf4a2b394931 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799f987b3aa7426ba5d7a464052d6490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87474d4b4c547abbfe6308b6dd8e1c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:14:04.978929 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-46689098-7d98-40c1-8c22-cf4a2b394931 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] 10.222.0.18 "GET /compute/v2.1/servers/e8de4ee1-bd84-496c-8376-025eaf5c5094" status: 200 len: 1327 microversion: 2.1 time: 0.169677 Oct 22 21:14:04.979569 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2360/4709] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:14:04 2022] GET /compute/v2.1/servers/e8de4ee1-bd84-496c-8376-025eaf5c5094 => generated 1327 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:14:05.763523 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-db1462e2-7c51-468d-bda3-133d6bc1d2ba tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:14:05.764165 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-db1462e2-7c51-468d-bda3-133d6bc1d2ba tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] [instance: 34dcd1da-b94c-426b-b08b-204ea287c8a2] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:14:05.772097 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-db1462e2-7c51-468d-bda3-133d6bc1d2ba tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:05.772593 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-db1462e2-7c51-468d-bda3-133d6bc1d2ba tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:05.773030 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-db1462e2-7c51-468d-bda3-133d6bc1d2ba tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:05.773726 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-db1462e2-7c51-468d-bda3-133d6bc1d2ba tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:05.774195 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-db1462e2-7c51-468d-bda3-133d6bc1d2ba tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:05.774609 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-db1462e2-7c51-468d-bda3-133d6bc1d2ba tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:06.001463 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-db1462e2-7c51-468d-bda3-133d6bc1d2ba tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:14:06.002577 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-a3ff7b54-df15-4b57-95d5-80bd29e38379 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:14:06.003287 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-a3ff7b54-df15-4b57-95d5-80bd29e38379 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] [instance: e8de4ee1-bd84-496c-8376-025eaf5c5094] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:14:06.010062 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-db1462e2-7c51-468d-bda3-133d6bc1d2ba tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:14:06.010566 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a3ff7b54-df15-4b57-95d5-80bd29e38379 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:06.011141 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a3ff7b54-df15-4b57-95d5-80bd29e38379 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:06.011538 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-db1462e2-7c51-468d-bda3-133d6bc1d2ba tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:14:06.011789 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a3ff7b54-df15-4b57-95d5-80bd29e38379 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:06.012577 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a3ff7b54-df15-4b57-95d5-80bd29e38379 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:06.012698 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-db1462e2-7c51-468d-bda3-133d6bc1d2ba tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] 10.222.0.18 "GET /compute/v2.1/servers/34dcd1da-b94c-426b-b08b-204ea287c8a2" status: 200 len: 1731 microversion: 2.20 time: 0.253889 Oct 22 21:14:06.013197 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a3ff7b54-df15-4b57-95d5-80bd29e38379 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:06.013337 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2350/4710] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:14:05 2022] GET /compute/v2.1/servers/34dcd1da-b94c-426b-b08b-204ea287c8a2 => generated 1731 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 22 21:14:06.013997 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a3ff7b54-df15-4b57-95d5-80bd29e38379 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:06.231259 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-a3ff7b54-df15-4b57-95d5-80bd29e38379 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799f987b3aa7426ba5d7a464052d6490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87474d4b4c547abbfe6308b6dd8e1c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:14:06.241668 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-a3ff7b54-df15-4b57-95d5-80bd29e38379 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] 10.222.0.18 "GET /compute/v2.1/servers/e8de4ee1-bd84-496c-8376-025eaf5c5094" status: 200 len: 1327 microversion: 2.1 time: 0.243223 Oct 22 21:14:06.242324 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2361/4711] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:14:05 2022] GET /compute/v2.1/servers/e8de4ee1-bd84-496c-8376-025eaf5c5094 => generated 1327 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:14:07.040752 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-771887a2-9598-4ab1-bfcc-0fa7cbd14587 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:14:07.041639 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-771887a2-9598-4ab1-bfcc-0fa7cbd14587 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] [instance: 34dcd1da-b94c-426b-b08b-204ea287c8a2] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:14:07.051131 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-771887a2-9598-4ab1-bfcc-0fa7cbd14587 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:07.051685 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-771887a2-9598-4ab1-bfcc-0fa7cbd14587 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:07.052173 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-771887a2-9598-4ab1-bfcc-0fa7cbd14587 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:07.052957 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-771887a2-9598-4ab1-bfcc-0fa7cbd14587 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:07.053412 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-771887a2-9598-4ab1-bfcc-0fa7cbd14587 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:07.053842 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-771887a2-9598-4ab1-bfcc-0fa7cbd14587 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:07.199208 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-771887a2-9598-4ab1-bfcc-0fa7cbd14587 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:14:07.209048 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-771887a2-9598-4ab1-bfcc-0fa7cbd14587 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:14:07.210504 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-771887a2-9598-4ab1-bfcc-0fa7cbd14587 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:14:07.212173 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-771887a2-9598-4ab1-bfcc-0fa7cbd14587 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] 10.222.0.18 "GET /compute/v2.1/servers/34dcd1da-b94c-426b-b08b-204ea287c8a2" status: 200 len: 1731 microversion: 2.20 time: 0.176768 Oct 22 21:14:07.212723 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2351/4712] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:14:07 2022] GET /compute/v2.1/servers/34dcd1da-b94c-426b-b08b-204ea287c8a2 => generated 1731 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:14:07.265662 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-c40cf3bd-07b7-45da-a3b8-5fedb78780eb tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:14:07.266226 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-c40cf3bd-07b7-45da-a3b8-5fedb78780eb tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] [instance: e8de4ee1-bd84-496c-8376-025eaf5c5094] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:14:07.275291 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c40cf3bd-07b7-45da-a3b8-5fedb78780eb tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:07.276043 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c40cf3bd-07b7-45da-a3b8-5fedb78780eb tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:07.276546 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c40cf3bd-07b7-45da-a3b8-5fedb78780eb tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:07.277389 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c40cf3bd-07b7-45da-a3b8-5fedb78780eb tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:07.277907 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c40cf3bd-07b7-45da-a3b8-5fedb78780eb tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:07.278530 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c40cf3bd-07b7-45da-a3b8-5fedb78780eb tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:07.435315 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-c40cf3bd-07b7-45da-a3b8-5fedb78780eb tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799f987b3aa7426ba5d7a464052d6490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87474d4b4c547abbfe6308b6dd8e1c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:14:07.444865 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-c40cf3bd-07b7-45da-a3b8-5fedb78780eb tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] 10.222.0.18 "GET /compute/v2.1/servers/e8de4ee1-bd84-496c-8376-025eaf5c5094" status: 200 len: 1327 microversion: 2.1 time: 0.184129 Oct 22 21:14:07.445449 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2362/4713] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:14:07 2022] GET /compute/v2.1/servers/e8de4ee1-bd84-496c-8376-025eaf5c5094 => generated 1327 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:14:08.242964 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-c6e8b660-6918-4189-9c45-ae4b61716f90 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:14:08.243596 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-c6e8b660-6918-4189-9c45-ae4b61716f90 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] [instance: 34dcd1da-b94c-426b-b08b-204ea287c8a2] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:14:08.251382 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c6e8b660-6918-4189-9c45-ae4b61716f90 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:08.251874 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c6e8b660-6918-4189-9c45-ae4b61716f90 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:08.252323 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c6e8b660-6918-4189-9c45-ae4b61716f90 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:08.252999 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c6e8b660-6918-4189-9c45-ae4b61716f90 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:08.253503 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c6e8b660-6918-4189-9c45-ae4b61716f90 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:08.253960 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c6e8b660-6918-4189-9c45-ae4b61716f90 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:08.399670 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-c6e8b660-6918-4189-9c45-ae4b61716f90 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:14:08.408708 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-c6e8b660-6918-4189-9c45-ae4b61716f90 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:14:08.410330 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-c6e8b660-6918-4189-9c45-ae4b61716f90 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:14:08.411563 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-c6e8b660-6918-4189-9c45-ae4b61716f90 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] 10.222.0.18 "GET /compute/v2.1/servers/34dcd1da-b94c-426b-b08b-204ea287c8a2" status: 200 len: 1731 microversion: 2.20 time: 0.172969 Oct 22 21:14:08.412343 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2352/4714] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:14:08 2022] GET /compute/v2.1/servers/34dcd1da-b94c-426b-b08b-204ea287c8a2 => generated 1731 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:14:08.468425 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-90f8cea3-2b06-40d1-9276-50ca67c351ff tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:14:08.469219 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-90f8cea3-2b06-40d1-9276-50ca67c351ff tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] [instance: e8de4ee1-bd84-496c-8376-025eaf5c5094] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:14:08.477338 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-90f8cea3-2b06-40d1-9276-50ca67c351ff tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:08.477843 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-90f8cea3-2b06-40d1-9276-50ca67c351ff tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:08.478312 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-90f8cea3-2b06-40d1-9276-50ca67c351ff tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:08.479108 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-90f8cea3-2b06-40d1-9276-50ca67c351ff tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:08.479623 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-90f8cea3-2b06-40d1-9276-50ca67c351ff tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:08.480117 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-90f8cea3-2b06-40d1-9276-50ca67c351ff tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:08.623704 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-90f8cea3-2b06-40d1-9276-50ca67c351ff tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799f987b3aa7426ba5d7a464052d6490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87474d4b4c547abbfe6308b6dd8e1c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:14:08.632627 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-90f8cea3-2b06-40d1-9276-50ca67c351ff tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] 10.222.0.18 "GET /compute/v2.1/servers/e8de4ee1-bd84-496c-8376-025eaf5c5094" status: 200 len: 1327 microversion: 2.1 time: 0.168219 Oct 22 21:14:08.633513 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2363/4715] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:14:08 2022] GET /compute/v2.1/servers/e8de4ee1-bd84-496c-8376-025eaf5c5094 => generated 1327 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:14:08.982601 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-bb0cfe91-34ba-4bb9-8023-803512586c4b tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:14:08.983366 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-bb0cfe91-34ba-4bb9-8023-803512586c4b tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] [instance: 9dd3ccc4-26f1-4d75-b990-6636ed02293e] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:14:08.991539 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bb0cfe91-34ba-4bb9-8023-803512586c4b tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:08.992140 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bb0cfe91-34ba-4bb9-8023-803512586c4b tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:08.992520 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bb0cfe91-34ba-4bb9-8023-803512586c4b tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:08.993279 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bb0cfe91-34ba-4bb9-8023-803512586c4b tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:08.995855 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bb0cfe91-34ba-4bb9-8023-803512586c4b tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:08.996682 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bb0cfe91-34ba-4bb9-8023-803512586c4b tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:09.035190 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-bb0cfe91-34ba-4bb9-8023-803512586c4b tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] 10.222.0.18 "GET /compute/v2.1/servers/9dd3ccc4-26f1-4d75-b990-6636ed02293e/os-volume_attachments/892ac359-4f4c-4fa6-acef-543e24a4f004" status: 200 len: 194 microversion: 2.1 time: 0.056837 Oct 22 21:14:09.036220 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2353/4716] 10.222.0.18 () {58 vars in 1413 bytes} [Sat Oct 22 21:14:08 2022] GET /compute/v2.1/servers/9dd3ccc4-26f1-4d75-b990-6636ed02293e/os-volume_attachments/892ac359-4f4c-4fa6-acef-543e24a4f004 => generated 194 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:14:09.048747 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-fe55a23f-4b8b-440c-9d14-341b901dcacd tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:14:09.049523 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-fe55a23f-4b8b-440c-9d14-341b901dcacd tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] [instance: 9dd3ccc4-26f1-4d75-b990-6636ed02293e] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:14:09.071727 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fe55a23f-4b8b-440c-9d14-341b901dcacd tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:09.072287 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fe55a23f-4b8b-440c-9d14-341b901dcacd tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:09.072748 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fe55a23f-4b8b-440c-9d14-341b901dcacd tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:09.073626 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fe55a23f-4b8b-440c-9d14-341b901dcacd tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:09.074324 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fe55a23f-4b8b-440c-9d14-341b901dcacd tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:09.074772 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fe55a23f-4b8b-440c-9d14-341b901dcacd tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:09.163981 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.objects.instance [None req-fe55a23f-4b8b-440c-9d14-341b901dcacd tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lazy-loading 'services' on Instance uuid 9dd3ccc4-26f1-4d75-b990-6636ed02293e {{(pid=138745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 21:14:09.249338 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-fe55a23f-4b8b-440c-9d14-341b901dcacd tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] 10.222.0.18 "DELETE /compute/v2.1/servers/9dd3ccc4-26f1-4d75-b990-6636ed02293e/os-volume_attachments/892ac359-4f4c-4fa6-acef-543e24a4f004" status: 202 len: 0 microversion: 2.1 time: 0.205399 Oct 22 21:14:09.249950 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2364/4717] 10.222.0.18 () {58 vars in 1416 bytes} [Sat Oct 22 21:14:09 2022] DELETE /compute/v2.1/servers/9dd3ccc4-26f1-4d75-b990-6636ed02293e/os-volume_attachments/892ac359-4f4c-4fa6-acef-543e24a4f004 => generated 0 bytes in 207 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 21:14:09.373346 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-2b976ff2-0aa4-416f-ad9f-f792624becc7 req-7132f3cf-9e96-451a-936f-732565661c7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34dcd1da-b94c-426b-b08b-204ea287c8a2", "name": "network-vif-plugged", "status": "completed", "tag": "692705ac-81f3-4f8a-bfa8-a2581d7d7567"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:14:09.386250 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-2b976ff2-0aa4-416f-ad9f-f792624becc7 req-7132f3cf-9e96-451a-936f-732565661c7f service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:09.387431 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-2b976ff2-0aa4-416f-ad9f-f792624becc7 req-7132f3cf-9e96-451a-936f-732565661c7f service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:09.387431 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-2b976ff2-0aa4-416f-ad9f-f792624becc7 req-7132f3cf-9e96-451a-936f-732565661c7f service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:09.401237 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-2b976ff2-0aa4-416f-ad9f-f792624becc7 req-7132f3cf-9e96-451a-936f-732565661c7f service nova] Creating event network-vif-plugged:692705ac-81f3-4f8a-bfa8-a2581d7d7567 for instance 34dcd1da-b94c-426b-b08b-204ea287c8a2 on nch1-master-1 Oct 22 21:14:09.406600 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-2b976ff2-0aa4-416f-ad9f-f792624becc7 req-7132f3cf-9e96-451a-936f-732565661c7f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038696 Oct 22 21:14:09.407252 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2354/4718] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:14:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:14:09.440771 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-2cf878ca-bada-4fcc-afc4-1c0b2a1ebe2f tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:14:09.442141 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-2cf878ca-bada-4fcc-afc4-1c0b2a1ebe2f tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] [instance: 34dcd1da-b94c-426b-b08b-204ea287c8a2] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:14:09.451458 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2cf878ca-bada-4fcc-afc4-1c0b2a1ebe2f tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:09.452139 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2cf878ca-bada-4fcc-afc4-1c0b2a1ebe2f tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:09.452855 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2cf878ca-bada-4fcc-afc4-1c0b2a1ebe2f tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:09.453769 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2cf878ca-bada-4fcc-afc4-1c0b2a1ebe2f tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:09.454441 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2cf878ca-bada-4fcc-afc4-1c0b2a1ebe2f tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:09.454990 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2cf878ca-bada-4fcc-afc4-1c0b2a1ebe2f tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:09.624637 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-2cf878ca-bada-4fcc-afc4-1c0b2a1ebe2f tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:14:09.634990 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-2cf878ca-bada-4fcc-afc4-1c0b2a1ebe2f tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:14:09.636600 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-2cf878ca-bada-4fcc-afc4-1c0b2a1ebe2f tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:14:09.637822 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-2cf878ca-bada-4fcc-afc4-1c0b2a1ebe2f tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] 10.222.0.18 "GET /compute/v2.1/servers/34dcd1da-b94c-426b-b08b-204ea287c8a2" status: 200 len: 1731 microversion: 2.20 time: 0.203063 Oct 22 21:14:09.638400 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2365/4719] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:14:09 2022] GET /compute/v2.1/servers/34dcd1da-b94c-426b-b08b-204ea287c8a2 => generated 1731 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 22 21:14:09.661612 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-c759225d-0088-4954-9a57-7117e149d237 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:14:09.662395 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-c759225d-0088-4954-9a57-7117e149d237 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] [instance: e8de4ee1-bd84-496c-8376-025eaf5c5094] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:14:09.670212 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c759225d-0088-4954-9a57-7117e149d237 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:09.670695 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c759225d-0088-4954-9a57-7117e149d237 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:09.671185 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c759225d-0088-4954-9a57-7117e149d237 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:09.672023 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c759225d-0088-4954-9a57-7117e149d237 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:09.672549 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c759225d-0088-4954-9a57-7117e149d237 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:09.673034 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c759225d-0088-4954-9a57-7117e149d237 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:09.817916 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-c759225d-0088-4954-9a57-7117e149d237 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799f987b3aa7426ba5d7a464052d6490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87474d4b4c547abbfe6308b6dd8e1c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:14:09.827040 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-c759225d-0088-4954-9a57-7117e149d237 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] 10.222.0.18 "GET /compute/v2.1/servers/e8de4ee1-bd84-496c-8376-025eaf5c5094" status: 200 len: 1327 microversion: 2.1 time: 0.174287 Oct 22 21:14:09.827795 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2355/4720] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:14:09 2022] GET /compute/v2.1/servers/e8de4ee1-bd84-496c-8376-025eaf5c5094 => generated 1327 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:14:10.491275 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-36e5ec46-6d1e-4187-9c7a-772ec5f6fb60 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:14:10.493705 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-36e5ec46-6d1e-4187-9c7a-772ec5f6fb60 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] [instance: 9dd3ccc4-26f1-4d75-b990-6636ed02293e] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:14:10.502132 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-36e5ec46-6d1e-4187-9c7a-772ec5f6fb60 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:10.502558 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-36e5ec46-6d1e-4187-9c7a-772ec5f6fb60 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:10.503229 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-36e5ec46-6d1e-4187-9c7a-772ec5f6fb60 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:10.503934 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-36e5ec46-6d1e-4187-9c7a-772ec5f6fb60 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:10.504565 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-36e5ec46-6d1e-4187-9c7a-772ec5f6fb60 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:10.505058 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-36e5ec46-6d1e-4187-9c7a-772ec5f6fb60 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:10.535247 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:14:10.540951 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-36e5ec46-6d1e-4187-9c7a-772ec5f6fb60 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] 10.222.0.18 "GET /compute/v2.1/servers/9dd3ccc4-26f1-4d75-b990-6636ed02293e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.054784 Oct 22 21:14:10.541731 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2366/4721] 10.222.0.18 () {58 vars in 1302 bytes} [Sat Oct 22 21:14:10 2022] GET /compute/v2.1/servers/9dd3ccc4-26f1-4d75-b990-6636ed02293e/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 22 21:14:10.665641 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-344325ae-0e8a-49c1-911c-133a57e62e23 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:14:10.666380 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-344325ae-0e8a-49c1-911c-133a57e62e23 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] [instance: 34dcd1da-b94c-426b-b08b-204ea287c8a2] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:14:10.673845 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-344325ae-0e8a-49c1-911c-133a57e62e23 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:10.679329 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-002aaac2-d1a3-4b3c-a236-2502eb551bfd tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:14:10.680035 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-344325ae-0e8a-49c1-911c-133a57e62e23 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:10.681078 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-344325ae-0e8a-49c1-911c-133a57e62e23 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:10.681756 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-002aaac2-d1a3-4b3c-a236-2502eb551bfd tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] [instance: 9dd3ccc4-26f1-4d75-b990-6636ed02293e] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:14:10.682221 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-344325ae-0e8a-49c1-911c-133a57e62e23 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:10.682748 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-344325ae-0e8a-49c1-911c-133a57e62e23 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:10.683332 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-344325ae-0e8a-49c1-911c-133a57e62e23 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:10.689193 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-002aaac2-d1a3-4b3c-a236-2502eb551bfd tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:10.689746 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-002aaac2-d1a3-4b3c-a236-2502eb551bfd tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:10.690319 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-002aaac2-d1a3-4b3c-a236-2502eb551bfd tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:10.691042 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-002aaac2-d1a3-4b3c-a236-2502eb551bfd tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:10.691564 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-002aaac2-d1a3-4b3c-a236-2502eb551bfd tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:10.691988 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-002aaac2-d1a3-4b3c-a236-2502eb551bfd tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:10.723989 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-002aaac2-d1a3-4b3c-a236-2502eb551bfd tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] 10.222.0.18 "GET /compute/v2.1/servers/9dd3ccc4-26f1-4d75-b990-6636ed02293e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048733 Oct 22 21:14:10.725210 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2367/4722] 10.222.0.18 () {58 vars in 1302 bytes} [Sat Oct 22 21:14:10 2022] GET /compute/v2.1/servers/9dd3ccc4-26f1-4d75-b990-6636ed02293e/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 22 21:14:10.793474 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-3b1100df-6d7f-4e2f-9c91-cb9109fcb168 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:14:10.794056 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-3b1100df-6d7f-4e2f-9c91-cb9109fcb168 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] [instance: 9dd3ccc4-26f1-4d75-b990-6636ed02293e] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:14:10.800231 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3b1100df-6d7f-4e2f-9c91-cb9109fcb168 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:10.800751 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3b1100df-6d7f-4e2f-9c91-cb9109fcb168 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:10.801178 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3b1100df-6d7f-4e2f-9c91-cb9109fcb168 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:10.801893 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3b1100df-6d7f-4e2f-9c91-cb9109fcb168 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:10.802454 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3b1100df-6d7f-4e2f-9c91-cb9109fcb168 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:10.802925 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3b1100df-6d7f-4e2f-9c91-cb9109fcb168 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:10.829985 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-3b1100df-6d7f-4e2f-9c91-cb9109fcb168 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] [instance: 9dd3ccc4-26f1-4d75-b990-6636ed02293e] Going to try to terminate instance {{(pid=138745) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 21:14:10.833417 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-344325ae-0e8a-49c1-911c-133a57e62e23 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:14:10.841856 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-344325ae-0e8a-49c1-911c-133a57e62e23 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:14:10.843393 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-344325ae-0e8a-49c1-911c-133a57e62e23 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:14:10.844753 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-344325ae-0e8a-49c1-911c-133a57e62e23 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] 10.222.0.18 "GET /compute/v2.1/servers/34dcd1da-b94c-426b-b08b-204ea287c8a2" status: 200 len: 1731 microversion: 2.20 time: 0.183773 Oct 22 21:14:10.845322 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2356/4723] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:14:10 2022] GET /compute/v2.1/servers/34dcd1da-b94c-426b-b08b-204ea287c8a2 => generated 1731 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:14:10.857466 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-5c5187f5-53bb-42f2-bd0a-12512eb9e772 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:14:10.858204 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-5c5187f5-53bb-42f2-bd0a-12512eb9e772 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] [instance: e8de4ee1-bd84-496c-8376-025eaf5c5094] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:14:10.865086 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5c5187f5-53bb-42f2-bd0a-12512eb9e772 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:10.865682 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5c5187f5-53bb-42f2-bd0a-12512eb9e772 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:10.866233 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5c5187f5-53bb-42f2-bd0a-12512eb9e772 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:10.867045 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5c5187f5-53bb-42f2-bd0a-12512eb9e772 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:10.867590 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5c5187f5-53bb-42f2-bd0a-12512eb9e772 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:10.868023 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5c5187f5-53bb-42f2-bd0a-12512eb9e772 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:10.915978 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-3b1100df-6d7f-4e2f-9c91-cb9109fcb168 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] 10.222.0.18 "DELETE /compute/v2.1/servers/9dd3ccc4-26f1-4d75-b990-6636ed02293e" status: 204 len: 0 microversion: 2.1 time: 0.125997 Oct 22 21:14:10.916501 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2368/4724] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 21:14:10 2022] DELETE /compute/v2.1/servers/9dd3ccc4-26f1-4d75-b990-6636ed02293e => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 21:14:10.926491 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-a80befcf-31b7-4131-bbe3-e902d25665d7 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:14:10.927281 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-a80befcf-31b7-4131-bbe3-e902d25665d7 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] [instance: 9dd3ccc4-26f1-4d75-b990-6636ed02293e] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:14:10.934275 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a80befcf-31b7-4131-bbe3-e902d25665d7 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:10.934803 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a80befcf-31b7-4131-bbe3-e902d25665d7 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:10.935268 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a80befcf-31b7-4131-bbe3-e902d25665d7 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:10.936096 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a80befcf-31b7-4131-bbe3-e902d25665d7 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:10.936651 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a80befcf-31b7-4131-bbe3-e902d25665d7 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:10.937101 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a80befcf-31b7-4131-bbe3-e902d25665d7 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:11.054901 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-5c5187f5-53bb-42f2-bd0a-12512eb9e772 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799f987b3aa7426ba5d7a464052d6490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87474d4b4c547abbfe6308b6dd8e1c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:14:11.064256 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-5c5187f5-53bb-42f2-bd0a-12512eb9e772 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] 10.222.0.18 "GET /compute/v2.1/servers/e8de4ee1-bd84-496c-8376-025eaf5c5094" status: 200 len: 1327 microversion: 2.1 time: 0.215381 Oct 22 21:14:11.064849 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2357/4725] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:14:10 2022] GET /compute/v2.1/servers/e8de4ee1-bd84-496c-8376-025eaf5c5094 => generated 1327 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:14:11.103694 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-a80befcf-31b7-4131-bbe3-e902d25665d7 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0d0bdfb04240209e4efa92f47cbb94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755501ba3e344f1aaf7ef80924bb57d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:14:11.114034 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-a80befcf-31b7-4131-bbe3-e902d25665d7 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] 10.222.0.18 "GET /compute/v2.1/servers/9dd3ccc4-26f1-4d75-b990-6636ed02293e" status: 200 len: 1675 microversion: 2.1 time: 0.192287 Oct 22 21:14:11.114942 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2369/4726] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:14:10 2022] GET /compute/v2.1/servers/9dd3ccc4-26f1-4d75-b990-6636ed02293e => generated 1675 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:14:11.873990 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-dbeffbf5-5fcb-4033-8ecd-11eda22adcfc tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:14:11.874825 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-dbeffbf5-5fcb-4033-8ecd-11eda22adcfc tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] [instance: 34dcd1da-b94c-426b-b08b-204ea287c8a2] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:14:11.883328 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-dbeffbf5-5fcb-4033-8ecd-11eda22adcfc tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:11.884025 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-dbeffbf5-5fcb-4033-8ecd-11eda22adcfc tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:11.884554 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-dbeffbf5-5fcb-4033-8ecd-11eda22adcfc tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:11.885538 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-dbeffbf5-5fcb-4033-8ecd-11eda22adcfc tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:11.886104 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-dbeffbf5-5fcb-4033-8ecd-11eda22adcfc tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:11.886627 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-dbeffbf5-5fcb-4033-8ecd-11eda22adcfc tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:12.036364 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-dbeffbf5-5fcb-4033-8ecd-11eda22adcfc tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:14:12.045427 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-dbeffbf5-5fcb-4033-8ecd-11eda22adcfc tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:14:12.046850 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-dbeffbf5-5fcb-4033-8ecd-11eda22adcfc tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:14:12.048153 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-dbeffbf5-5fcb-4033-8ecd-11eda22adcfc tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] 10.222.0.18 "GET /compute/v2.1/servers/34dcd1da-b94c-426b-b08b-204ea287c8a2" status: 200 len: 1731 microversion: 2.20 time: 0.180382 Oct 22 21:14:12.049031 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2358/4727] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:14:11 2022] GET /compute/v2.1/servers/34dcd1da-b94c-426b-b08b-204ea287c8a2 => generated 1731 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 22 21:14:12.088763 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-77226e8c-009b-4ed0-add7-333cf2f2ca07 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:14:12.089432 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-77226e8c-009b-4ed0-add7-333cf2f2ca07 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] [instance: e8de4ee1-bd84-496c-8376-025eaf5c5094] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:14:12.097912 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-77226e8c-009b-4ed0-add7-333cf2f2ca07 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:12.098345 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-77226e8c-009b-4ed0-add7-333cf2f2ca07 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:12.098801 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-77226e8c-009b-4ed0-add7-333cf2f2ca07 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:12.099652 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-77226e8c-009b-4ed0-add7-333cf2f2ca07 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:12.100466 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-77226e8c-009b-4ed0-add7-333cf2f2ca07 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:12.100911 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-77226e8c-009b-4ed0-add7-333cf2f2ca07 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:12.140059 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-ff273fff-4f3b-4a33-8509-dad3da239b58 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:14:12.140672 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-ff273fff-4f3b-4a33-8509-dad3da239b58 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] [instance: 9dd3ccc4-26f1-4d75-b990-6636ed02293e] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:14:12.147080 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ff273fff-4f3b-4a33-8509-dad3da239b58 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:12.147608 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ff273fff-4f3b-4a33-8509-dad3da239b58 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:12.148048 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ff273fff-4f3b-4a33-8509-dad3da239b58 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:12.148750 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ff273fff-4f3b-4a33-8509-dad3da239b58 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:12.149199 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ff273fff-4f3b-4a33-8509-dad3da239b58 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:12.149625 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ff273fff-4f3b-4a33-8509-dad3da239b58 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:12.307494 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-77226e8c-009b-4ed0-add7-333cf2f2ca07 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799f987b3aa7426ba5d7a464052d6490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87474d4b4c547abbfe6308b6dd8e1c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:14:12.316024 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-77226e8c-009b-4ed0-add7-333cf2f2ca07 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] 10.222.0.18 "GET /compute/v2.1/servers/e8de4ee1-bd84-496c-8376-025eaf5c5094" status: 200 len: 1327 microversion: 2.1 time: 0.231764 Oct 22 21:14:12.331378 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2370/4728] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:14:12 2022] GET /compute/v2.1/servers/e8de4ee1-bd84-496c-8376-025eaf5c5094 => generated 1327 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:14:12.332447 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-ff273fff-4f3b-4a33-8509-dad3da239b58 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0d0bdfb04240209e4efa92f47cbb94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755501ba3e344f1aaf7ef80924bb57d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:14:12.340812 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-ff273fff-4f3b-4a33-8509-dad3da239b58 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] 10.222.0.18 "GET /compute/v2.1/servers/9dd3ccc4-26f1-4d75-b990-6636ed02293e" status: 200 len: 1675 microversion: 2.1 time: 0.204646 Oct 22 21:14:12.341446 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2359/4729] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:14:12 2022] GET /compute/v2.1/servers/9dd3ccc4-26f1-4d75-b990-6636ed02293e => generated 1675 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:14:13.075010 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-57107d7b-359e-48e1-b1a5-ec5bbdc99ca8 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:14:13.075696 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-57107d7b-359e-48e1-b1a5-ec5bbdc99ca8 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] [instance: 34dcd1da-b94c-426b-b08b-204ea287c8a2] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:14:13.081919 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-57107d7b-359e-48e1-b1a5-ec5bbdc99ca8 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:13.082708 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-57107d7b-359e-48e1-b1a5-ec5bbdc99ca8 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:13.083197 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-57107d7b-359e-48e1-b1a5-ec5bbdc99ca8 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:13.084156 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-57107d7b-359e-48e1-b1a5-ec5bbdc99ca8 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:13.084670 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-57107d7b-359e-48e1-b1a5-ec5bbdc99ca8 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:13.085123 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-57107d7b-359e-48e1-b1a5-ec5bbdc99ca8 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:13.344518 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-57107d7b-359e-48e1-b1a5-ec5bbdc99ca8 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:14:13.348939 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-2ecbcb99-371b-40fe-ab59-204ab2de1c84 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:14:13.354380 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-2ecbcb99-371b-40fe-ab59-204ab2de1c84 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] [instance: e8de4ee1-bd84-496c-8376-025eaf5c5094] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:14:13.375364 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-57107d7b-359e-48e1-b1a5-ec5bbdc99ca8 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:14:13.376983 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2ecbcb99-371b-40fe-ab59-204ab2de1c84 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:13.377627 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2ecbcb99-371b-40fe-ab59-204ab2de1c84 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:13.379902 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-57107d7b-359e-48e1-b1a5-ec5bbdc99ca8 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:14:13.380528 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2ecbcb99-371b-40fe-ab59-204ab2de1c84 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:13.381471 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2ecbcb99-371b-40fe-ab59-204ab2de1c84 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:13.381934 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2ecbcb99-371b-40fe-ab59-204ab2de1c84 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:13.382367 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2ecbcb99-371b-40fe-ab59-204ab2de1c84 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:13.385111 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-57107d7b-359e-48e1-b1a5-ec5bbdc99ca8 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] 10.222.0.18 "GET /compute/v2.1/servers/34dcd1da-b94c-426b-b08b-204ea287c8a2" status: 200 len: 1718 microversion: 2.20 time: 0.314105 Oct 22 21:14:13.387028 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2371/4730] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:14:13 2022] GET /compute/v2.1/servers/34dcd1da-b94c-426b-b08b-204ea287c8a2 => generated 1718 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:14:13.392198 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-caad72ed-4224-4aa3-8d13-96097c3a8da5 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:14:13.392821 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-caad72ed-4224-4aa3-8d13-96097c3a8da5 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] [instance: 9dd3ccc4-26f1-4d75-b990-6636ed02293e] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:14:13.399728 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:14:13.418208 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-caad72ed-4224-4aa3-8d13-96097c3a8da5 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:13.422264 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-caad72ed-4224-4aa3-8d13-96097c3a8da5 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:13.422969 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-caad72ed-4224-4aa3-8d13-96097c3a8da5 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:13.423898 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-caad72ed-4224-4aa3-8d13-96097c3a8da5 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:13.424417 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-caad72ed-4224-4aa3-8d13-96097c3a8da5 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:13.425767 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-caad72ed-4224-4aa3-8d13-96097c3a8da5 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:13.737553 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-2ecbcb99-371b-40fe-ab59-204ab2de1c84 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799f987b3aa7426ba5d7a464052d6490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87474d4b4c547abbfe6308b6dd8e1c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:14:13.747555 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-2ecbcb99-371b-40fe-ab59-204ab2de1c84 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] 10.222.0.18 "GET /compute/v2.1/servers/e8de4ee1-bd84-496c-8376-025eaf5c5094" status: 200 len: 1327 microversion: 2.1 time: 0.409664 Oct 22 21:14:13.748161 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2360/4731] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:14:13 2022] GET /compute/v2.1/servers/e8de4ee1-bd84-496c-8376-025eaf5c5094 => generated 1327 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:14:13.753117 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-54e430c2-17f8-4f3a-93ab-b9d7a4386849 req-6c4b6898-b05f-4f94-b6af-176e9ce74fd6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8de4ee1-bd84-496c-8376-025eaf5c5094", "name": "network-vif-plugged", "status": "completed", "tag": "002b824f-cfe7-4fd8-a75e-a545afd44187"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:14:13.760434 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-caad72ed-4224-4aa3-8d13-96097c3a8da5 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0d0bdfb04240209e4efa92f47cbb94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755501ba3e344f1aaf7ef80924bb57d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:14:13.764076 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-54e430c2-17f8-4f3a-93ab-b9d7a4386849 req-6c4b6898-b05f-4f94-b6af-176e9ce74fd6 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:13.764861 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-54e430c2-17f8-4f3a-93ab-b9d7a4386849 req-6c4b6898-b05f-4f94-b6af-176e9ce74fd6 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:13.765307 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-54e430c2-17f8-4f3a-93ab-b9d7a4386849 req-6c4b6898-b05f-4f94-b6af-176e9ce74fd6 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:13.779703 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-caad72ed-4224-4aa3-8d13-96097c3a8da5 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] 10.222.0.18 "GET /compute/v2.1/servers/9dd3ccc4-26f1-4d75-b990-6636ed02293e" status: 200 len: 1675 microversion: 2.1 time: 0.391275 Oct 22 21:14:13.780748 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2372/4732] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:14:13 2022] GET /compute/v2.1/servers/9dd3ccc4-26f1-4d75-b990-6636ed02293e => generated 1675 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:14:13.780989 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-54e430c2-17f8-4f3a-93ab-b9d7a4386849 req-6c4b6898-b05f-4f94-b6af-176e9ce74fd6 service nova] Creating event network-vif-plugged:002b824f-cfe7-4fd8-a75e-a545afd44187 for instance e8de4ee1-bd84-496c-8376-025eaf5c5094 on nch1-master-1 Oct 22 21:14:13.786284 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-54e430c2-17f8-4f3a-93ab-b9d7a4386849 req-6c4b6898-b05f-4f94-b6af-176e9ce74fd6 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036504 Oct 22 21:14:13.787071 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2361/4733] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:14:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:14:14.410121 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-106dcf09-09ab-486a-8f34-3b43f2c17834 req-86323b39-e691-4881-a82b-d3c34db8eb58 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9dd3ccc4-26f1-4d75-b990-6636ed02293e", "name": "network-vif-deleted", "tag": "82bb390e-11d5-425f-8b41-2ddc73f226c9"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:14:14.424009 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-106dcf09-09ab-486a-8f34-3b43f2c17834 req-86323b39-e691-4881-a82b-d3c34db8eb58 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:14.424816 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-106dcf09-09ab-486a-8f34-3b43f2c17834 req-86323b39-e691-4881-a82b-d3c34db8eb58 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:14.425499 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-106dcf09-09ab-486a-8f34-3b43f2c17834 req-86323b39-e691-4881-a82b-d3c34db8eb58 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:14.445071 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-106dcf09-09ab-486a-8f34-3b43f2c17834 req-86323b39-e691-4881-a82b-d3c34db8eb58 service nova] Creating event network-vif-deleted:82bb390e-11d5-425f-8b41-2ddc73f226c9 for instance 9dd3ccc4-26f1-4d75-b990-6636ed02293e on nch1-master-1 Oct 22 21:14:14.453848 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-106dcf09-09ab-486a-8f34-3b43f2c17834 req-86323b39-e691-4881-a82b-d3c34db8eb58 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055438 Oct 22 21:14:14.455195 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2373/4734] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:14:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:14:14.777686 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-afe56616-ecb0-4e01-ae87-231462fae2b3 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:14:14.778389 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-afe56616-ecb0-4e01-ae87-231462fae2b3 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] [instance: e8de4ee1-bd84-496c-8376-025eaf5c5094] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:14:14.787183 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-afe56616-ecb0-4e01-ae87-231462fae2b3 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:14.788204 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-afe56616-ecb0-4e01-ae87-231462fae2b3 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:14.788749 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-afe56616-ecb0-4e01-ae87-231462fae2b3 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:14.789525 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-afe56616-ecb0-4e01-ae87-231462fae2b3 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:14.790064 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-afe56616-ecb0-4e01-ae87-231462fae2b3 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:14.790554 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-afe56616-ecb0-4e01-ae87-231462fae2b3 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:14.807447 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-b3ff3ddc-00fd-4014-b182-d71528ca1b11 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:14:14.808533 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-b3ff3ddc-00fd-4014-b182-d71528ca1b11 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] [instance: 9dd3ccc4-26f1-4d75-b990-6636ed02293e] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:14:14.815860 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b3ff3ddc-00fd-4014-b182-d71528ca1b11 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:14.816543 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b3ff3ddc-00fd-4014-b182-d71528ca1b11 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:14.817017 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b3ff3ddc-00fd-4014-b182-d71528ca1b11 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:14.818085 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b3ff3ddc-00fd-4014-b182-d71528ca1b11 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:14.818994 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b3ff3ddc-00fd-4014-b182-d71528ca1b11 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:14.820144 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b3ff3ddc-00fd-4014-b182-d71528ca1b11 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:14.877331 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b3ff3ddc-00fd-4014-b182-d71528ca1b11 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:14.877833 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b3ff3ddc-00fd-4014-b182-d71528ca1b11 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:14.878709 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b3ff3ddc-00fd-4014-b182-d71528ca1b11 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:14.879851 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.objects.instance [None req-b3ff3ddc-00fd-4014-b182-d71528ca1b11 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lazy-loading 'fault' on Instance uuid 9dd3ccc4-26f1-4d75-b990-6636ed02293e {{(pid=138745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 21:14:14.950698 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-b3ff3ddc-00fd-4014-b182-d71528ca1b11 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0d0bdfb04240209e4efa92f47cbb94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755501ba3e344f1aaf7ef80924bb57d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:14:14.965716 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-b3ff3ddc-00fd-4014-b182-d71528ca1b11 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] 10.222.0.18 "GET /compute/v2.1/servers/9dd3ccc4-26f1-4d75-b990-6636ed02293e" status: 200 len: 1327 microversion: 2.1 time: 0.161264 Oct 22 21:14:14.986826 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2374/4735] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:14:14 2022] GET /compute/v2.1/servers/9dd3ccc4-26f1-4d75-b990-6636ed02293e => generated 1327 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:14:14.993194 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-afe56616-ecb0-4e01-ae87-231462fae2b3 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799f987b3aa7426ba5d7a464052d6490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87474d4b4c547abbfe6308b6dd8e1c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:14:15.004659 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-afe56616-ecb0-4e01-ae87-231462fae2b3 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] 10.222.0.18 "GET /compute/v2.1/servers/e8de4ee1-bd84-496c-8376-025eaf5c5094" status: 200 len: 1327 microversion: 2.1 time: 0.232192 Oct 22 21:14:15.011468 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2362/4736] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:14:14 2022] GET /compute/v2.1/servers/e8de4ee1-bd84-496c-8376-025eaf5c5094 => generated 1327 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:14:15.996076 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-cf3f0f1d-7b6b-4f84-8f1d-50c2437a808f tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:14:15.999135 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-cf3f0f1d-7b6b-4f84-8f1d-50c2437a808f tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] [instance: 9dd3ccc4-26f1-4d75-b990-6636ed02293e] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:14:16.010650 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cf3f0f1d-7b6b-4f84-8f1d-50c2437a808f tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:16.011589 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cf3f0f1d-7b6b-4f84-8f1d-50c2437a808f tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:16.012382 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cf3f0f1d-7b6b-4f84-8f1d-50c2437a808f tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:16.013250 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cf3f0f1d-7b6b-4f84-8f1d-50c2437a808f tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:16.013724 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cf3f0f1d-7b6b-4f84-8f1d-50c2437a808f tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:16.014536 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cf3f0f1d-7b6b-4f84-8f1d-50c2437a808f tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:16.037694 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-16af43be-8735-46d3-81c6-fe0067071232 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:14:16.039451 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-16af43be-8735-46d3-81c6-fe0067071232 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] [instance: e8de4ee1-bd84-496c-8376-025eaf5c5094] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:14:16.047955 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-16af43be-8735-46d3-81c6-fe0067071232 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:16.049384 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-16af43be-8735-46d3-81c6-fe0067071232 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:16.050070 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-16af43be-8735-46d3-81c6-fe0067071232 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:16.050784 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-16af43be-8735-46d3-81c6-fe0067071232 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:16.051450 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-16af43be-8735-46d3-81c6-fe0067071232 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:16.052236 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-16af43be-8735-46d3-81c6-fe0067071232 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:16.054428 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cf3f0f1d-7b6b-4f84-8f1d-50c2437a808f tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:16.055008 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cf3f0f1d-7b6b-4f84-8f1d-50c2437a808f tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:16.055510 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cf3f0f1d-7b6b-4f84-8f1d-50c2437a808f tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:16.056254 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.objects.instance [None req-cf3f0f1d-7b6b-4f84-8f1d-50c2437a808f tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lazy-loading 'fault' on Instance uuid 9dd3ccc4-26f1-4d75-b990-6636ed02293e {{(pid=138745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 21:14:16.125448 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-cf3f0f1d-7b6b-4f84-8f1d-50c2437a808f tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0d0bdfb04240209e4efa92f47cbb94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755501ba3e344f1aaf7ef80924bb57d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:14:16.136213 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-cf3f0f1d-7b6b-4f84-8f1d-50c2437a808f tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] 10.222.0.18 "GET /compute/v2.1/servers/9dd3ccc4-26f1-4d75-b990-6636ed02293e" status: 200 len: 1327 microversion: 2.1 time: 0.145798 Oct 22 21:14:16.147465 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2375/4737] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:14:15 2022] GET /compute/v2.1/servers/9dd3ccc4-26f1-4d75-b990-6636ed02293e => generated 1327 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:14:16.236391 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-16af43be-8735-46d3-81c6-fe0067071232 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799f987b3aa7426ba5d7a464052d6490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87474d4b4c547abbfe6308b6dd8e1c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:14:16.245273 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-16af43be-8735-46d3-81c6-fe0067071232 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] 10.222.0.18 "GET /compute/v2.1/servers/e8de4ee1-bd84-496c-8376-025eaf5c5094" status: 200 len: 1508 microversion: 2.1 time: 0.213282 Oct 22 21:14:16.245911 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2363/4738] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:14:16 2022] GET /compute/v2.1/servers/e8de4ee1-bd84-496c-8376-025eaf5c5094 => generated 1508 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:14:16.268930 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-0a8fe1e4-2817-41c9-a780-225345ed418d tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:14:16.269661 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-0a8fe1e4-2817-41c9-a780-225345ed418d tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] [instance: e8de4ee1-bd84-496c-8376-025eaf5c5094] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:14:16.276680 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0a8fe1e4-2817-41c9-a780-225345ed418d tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:16.277205 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0a8fe1e4-2817-41c9-a780-225345ed418d tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:16.277759 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0a8fe1e4-2817-41c9-a780-225345ed418d tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:16.278517 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0a8fe1e4-2817-41c9-a780-225345ed418d tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:16.279061 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0a8fe1e4-2817-41c9-a780-225345ed418d tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:16.279547 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0a8fe1e4-2817-41c9-a780-225345ed418d tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:16.428461 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-0a8fe1e4-2817-41c9-a780-225345ed418d tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799f987b3aa7426ba5d7a464052d6490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87474d4b4c547abbfe6308b6dd8e1c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:14:16.437961 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-0a8fe1e4-2817-41c9-a780-225345ed418d tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] 10.222.0.18 "GET /compute/v2.1/servers/e8de4ee1-bd84-496c-8376-025eaf5c5094" status: 200 len: 1508 microversion: 2.1 time: 0.172954 Oct 22 21:14:16.438555 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2376/4739] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:14:16 2022] GET /compute/v2.1/servers/e8de4ee1-bd84-496c-8376-025eaf5c5094 => generated 1508 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:14:16.464383 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-8ca8c3cb-06cd-499c-95da-a8699021a674 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:14:16.465268 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-8ca8c3cb-06cd-499c-95da-a8699021a674 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] [instance: e8de4ee1-bd84-496c-8376-025eaf5c5094] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:14:16.473539 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8ca8c3cb-06cd-499c-95da-a8699021a674 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:16.474281 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8ca8c3cb-06cd-499c-95da-a8699021a674 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:16.474849 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8ca8c3cb-06cd-499c-95da-a8699021a674 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:16.476090 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8ca8c3cb-06cd-499c-95da-a8699021a674 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:16.476515 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8ca8c3cb-06cd-499c-95da-a8699021a674 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:16.477019 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8ca8c3cb-06cd-499c-95da-a8699021a674 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:16.504215 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-8ca8c3cb-06cd-499c-95da-a8699021a674 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] [instance: e8de4ee1-bd84-496c-8376-025eaf5c5094] Going to try to terminate instance {{(pid=138744) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 21:14:16.555545 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:14:16.601138 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-8ca8c3cb-06cd-499c-95da-a8699021a674 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] 10.222.0.18 "DELETE /compute/v2.1/servers/e8de4ee1-bd84-496c-8376-025eaf5c5094" status: 204 len: 0 microversion: 2.1 time: 0.142478 Oct 22 21:14:16.602226 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2364/4740] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 21:14:16 2022] DELETE /compute/v2.1/servers/e8de4ee1-bd84-496c-8376-025eaf5c5094 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 22 21:14:16.613491 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-991a9e4b-aa7c-47fb-9094-6ca88244a0a7 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:14:16.614048 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-991a9e4b-aa7c-47fb-9094-6ca88244a0a7 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] [instance: e8de4ee1-bd84-496c-8376-025eaf5c5094] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:14:16.621414 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-991a9e4b-aa7c-47fb-9094-6ca88244a0a7 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:16.621993 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-991a9e4b-aa7c-47fb-9094-6ca88244a0a7 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:16.622731 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-991a9e4b-aa7c-47fb-9094-6ca88244a0a7 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:16.623574 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-991a9e4b-aa7c-47fb-9094-6ca88244a0a7 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:16.624095 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-991a9e4b-aa7c-47fb-9094-6ca88244a0a7 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:16.624629 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-991a9e4b-aa7c-47fb-9094-6ca88244a0a7 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:16.845832 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-991a9e4b-aa7c-47fb-9094-6ca88244a0a7 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799f987b3aa7426ba5d7a464052d6490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87474d4b4c547abbfe6308b6dd8e1c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:14:16.861421 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-991a9e4b-aa7c-47fb-9094-6ca88244a0a7 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] 10.222.0.18 "GET /compute/v2.1/servers/e8de4ee1-bd84-496c-8376-025eaf5c5094" status: 200 len: 1514 microversion: 2.1 time: 0.253111 Oct 22 21:14:16.862336 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2377/4741] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:14:16 2022] GET /compute/v2.1/servers/e8de4ee1-bd84-496c-8376-025eaf5c5094 => generated 1514 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:14:17.162609 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-92f7b519-dedc-4c44-8e2e-b35442ae9963 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:14:17.163793 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-92f7b519-dedc-4c44-8e2e-b35442ae9963 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] [instance: 9dd3ccc4-26f1-4d75-b990-6636ed02293e] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:14:17.178601 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-92f7b519-dedc-4c44-8e2e-b35442ae9963 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:17.179161 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-92f7b519-dedc-4c44-8e2e-b35442ae9963 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:17.179735 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-92f7b519-dedc-4c44-8e2e-b35442ae9963 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:17.180352 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-92f7b519-dedc-4c44-8e2e-b35442ae9963 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:17.181057 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-92f7b519-dedc-4c44-8e2e-b35442ae9963 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:17.181804 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-92f7b519-dedc-4c44-8e2e-b35442ae9963 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:17.198189 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-92f7b519-dedc-4c44-8e2e-b35442ae9963 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] HTTP exception thrown: Instance 9dd3ccc4-26f1-4d75-b990-6636ed02293e could not be found. Oct 22 21:14:17.199934 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-92f7b519-dedc-4c44-8e2e-b35442ae9963 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Request method failure captured: Oct 22 21:14:17.199934 ncdv-master-1 devstack@n-api.service[138744]: request: GET /compute/v2.1/servers/9dd3ccc4-26f1-4d75-b990-6636ed02293e HTTP/1.1 Oct 22 21:14:17.199934 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 21:14:17.199934 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 21:14:17.199934 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 21:14:17.199934 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 0 Oct 22 21:14:17.199934 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 21:14:17.199934 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 21:14:17.199934 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 21:14:17.199934 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 21:14:17.199934 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVFuUBtPDLFT8At_zrn_bBaaE2zzyF_nT22PiPjaxHPU2YIA_DgSr2gz12ljL2A8fqsjxUzqntMDUF7z7I3jTzNnIvnaGuvHcioSaq_gOgTI6yASMb4L3UiCnl8Esgqq5uU50izm2mW77ycOQXfK6m6BecIab0G9mkZWEbgIL-w8TVK4 Oct 22 21:14:17.199934 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 21:14:17.199934 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 21:14:17.199934 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 21:14:17.199934 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 21:14:17.199934 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 21:14:17.199934 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 21:14:17.199934 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: 755501ba3e344f1aaf7ef80924bb57d7 Oct 22 21:14:17.199934 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-AttachVolumeTestJSON-485250435 Oct 22 21:14:17.199934 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 21:14:17.199934 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 21:14:17.199934 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_755501ba3e344f1aaf7ef80924bb57d7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/755501ba3e344f1aaf7ef80924bb57d7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/755501ba3e344f1aaf7ef80924bb57d7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/755501ba3e344f1aaf7ef80924bb57d7"}]}] Oct 22 21:14:17.199934 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-AttachVolumeTestJSON-485250435 Oct 22 21:14:17.199934 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: 755501ba3e344f1aaf7ef80924bb57d7 Oct 22 21:14:17.199934 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-AttachVolumeTestJSON-485250435 Oct 22 21:14:17.199934 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-AttachVolumeTestJSON-485250435-project Oct 22 21:14:17.199934 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 21:14:17.199934 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 21:14:17.199934 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: ba0d0bdfb04240209e4efa92f47cbb94 Oct 22 21:14:17.199934 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-AttachVolumeTestJSON-485250435-project Oct 22 21:14:17.199934 ncdv-master-1 devstack@n-api.service[138744]: method: > Oct 22 21:14:17.199934 ncdv-master-1 devstack@n-api.service[138744]: exception: Instance 9dd3ccc4-26f1-4d75-b990-6636ed02293e could not be found. Oct 22 21:14:17.199934 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': '9dd3ccc4-26f1-4d75-b990-6636ed02293e'} Oct 22 21:14:17.199934 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:14:17.199934 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:14:17.199934 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 21:14:17.199934 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 21:14:17.199934 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 21:14:17.199934 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 21:14:17.199934 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 21:14:17.199934 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 21:14:17.199934 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 21:14:17.199934 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 21:14:17.199934 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9dd3ccc4-26f1-4d75-b990-6636ed02293e could not be found. Oct 22 21:14:17.199934 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:14:17.199934 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:14:17.199934 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:14:17.199934 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:14:17.199934 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:14:17.199934 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:14:17.199934 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:14:17.199934 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:14:17.199934 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:14:17.199934 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:14:17.199934 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 21:14:17.199934 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 21:14:17.199934 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 21:14:17.199934 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 21:14:17.199934 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 21:14:17.199934 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:14:17.199934 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9dd3ccc4-26f1-4d75-b990-6636ed02293e could not be found. Oct 22 21:14:17.199934 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:14:17.199934 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:14:17.199934 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:14:17.205216 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:14:17.205216 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:14:17.205216 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:14:17.205216 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:14:17.205216 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:14:17.205216 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9dd3ccc4-26f1-4d75-b990-6636ed02293e could not be found. Oct 22 21:14:17.205216 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:14:17.205216 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-92f7b519-dedc-4c44-8e2e-b35442ae9963 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Returning 404 to user: Instance 9dd3ccc4-26f1-4d75-b990-6636ed02293e could not be found. {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:14:17.205216 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-92f7b519-dedc-4c44-8e2e-b35442ae9963 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] 10.222.0.18 "GET /compute/v2.1/servers/9dd3ccc4-26f1-4d75-b990-6636ed02293e" status: 404 len: 111 microversion: 2.1 time: 0.044226 Oct 22 21:14:17.205216 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2365/4742] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:14:17 2022] GET /compute/v2.1/servers/9dd3ccc4-26f1-4d75-b990-6636ed02293e => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 21:14:17.210935 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-cfb6a6b5-a7c8-47a3-b291-63468f051886 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Calling method '.version_select at 0x7fd3a4118670>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:14:17.240197 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-cfb6a6b5-a7c8-47a3-b291-63468f051886 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-793519269" status: 202 len: 0 microversion: 2.1 time: 0.033214 Oct 22 21:14:17.240906 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2378/4743] 10.222.0.18 () {58 vars in 1218 bytes} [Sat Oct 22 21:14:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-793519269 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 21:14:17.904769 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-55b92585-f242-4047-8b07-8e7261d89574 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:14:17.904769 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-55b92585-f242-4047-8b07-8e7261d89574 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] [instance: e8de4ee1-bd84-496c-8376-025eaf5c5094] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:14:17.909941 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-55b92585-f242-4047-8b07-8e7261d89574 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:17.911585 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-55b92585-f242-4047-8b07-8e7261d89574 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:17.912820 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-55b92585-f242-4047-8b07-8e7261d89574 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:17.913552 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-55b92585-f242-4047-8b07-8e7261d89574 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:17.914200 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-55b92585-f242-4047-8b07-8e7261d89574 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:17.914801 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-55b92585-f242-4047-8b07-8e7261d89574 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:18.121882 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-55b92585-f242-4047-8b07-8e7261d89574 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799f987b3aa7426ba5d7a464052d6490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87474d4b4c547abbfe6308b6dd8e1c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:14:18.134149 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-55b92585-f242-4047-8b07-8e7261d89574 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] 10.222.0.18 "GET /compute/v2.1/servers/e8de4ee1-bd84-496c-8376-025eaf5c5094" status: 200 len: 1514 microversion: 2.1 time: 0.251038 Oct 22 21:14:18.134975 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2366/4744] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:14:17 2022] GET /compute/v2.1/servers/e8de4ee1-bd84-496c-8376-025eaf5c5094 => generated 1514 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:14:18.745872 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-194aeaae-9ae9-475f-ac08-83ce5405d38d req-f792b38c-17c8-4a5a-a126-996691467059 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8de4ee1-bd84-496c-8376-025eaf5c5094", "name": "network-vif-deleted", "tag": "002b824f-cfe7-4fd8-a75e-a545afd44187"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:14:18.762342 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-194aeaae-9ae9-475f-ac08-83ce5405d38d req-f792b38c-17c8-4a5a-a126-996691467059 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:18.763278 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-194aeaae-9ae9-475f-ac08-83ce5405d38d req-f792b38c-17c8-4a5a-a126-996691467059 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:18.764140 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-194aeaae-9ae9-475f-ac08-83ce5405d38d req-f792b38c-17c8-4a5a-a126-996691467059 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:18.782339 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-194aeaae-9ae9-475f-ac08-83ce5405d38d req-f792b38c-17c8-4a5a-a126-996691467059 service nova] Creating event network-vif-deleted:002b824f-cfe7-4fd8-a75e-a545afd44187 for instance e8de4ee1-bd84-496c-8376-025eaf5c5094 on nch1-master-1 Oct 22 21:14:18.791664 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-194aeaae-9ae9-475f-ac08-83ce5405d38d req-f792b38c-17c8-4a5a-a126-996691467059 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054208 Oct 22 21:14:18.793387 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2379/4745] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:14:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 21:14:19.162478 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-6361a7b9-fa7f-497b-b57c-07c593477770 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:14:19.163097 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-6361a7b9-fa7f-497b-b57c-07c593477770 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] [instance: e8de4ee1-bd84-496c-8376-025eaf5c5094] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:14:19.167315 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=2 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:14:19.171908 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6361a7b9-fa7f-497b-b57c-07c593477770 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:19.172398 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6361a7b9-fa7f-497b-b57c-07c593477770 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:19.172839 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6361a7b9-fa7f-497b-b57c-07c593477770 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:19.173566 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6361a7b9-fa7f-497b-b57c-07c593477770 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:19.174031 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6361a7b9-fa7f-497b-b57c-07c593477770 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:19.174498 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6361a7b9-fa7f-497b-b57c-07c593477770 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:19.213124 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6361a7b9-fa7f-497b-b57c-07c593477770 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:19.213715 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6361a7b9-fa7f-497b-b57c-07c593477770 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:19.214388 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6361a7b9-fa7f-497b-b57c-07c593477770 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:19.214695 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.objects.instance [None req-6361a7b9-fa7f-497b-b57c-07c593477770 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lazy-loading 'fault' on Instance uuid e8de4ee1-bd84-496c-8376-025eaf5c5094 {{(pid=138744) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 21:14:19.280244 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-6361a7b9-fa7f-497b-b57c-07c593477770 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799f987b3aa7426ba5d7a464052d6490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87474d4b4c547abbfe6308b6dd8e1c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:14:19.291383 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-6361a7b9-fa7f-497b-b57c-07c593477770 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] 10.222.0.18 "GET /compute/v2.1/servers/e8de4ee1-bd84-496c-8376-025eaf5c5094" status: 200 len: 1317 microversion: 2.1 time: 0.132964 Oct 22 21:14:19.292262 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2367/4746] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:14:19 2022] GET /compute/v2.1/servers/e8de4ee1-bd84-496c-8376-025eaf5c5094 => generated 1317 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:14:19.426951 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-3fb7b7ff-a277-479d-b778-7a92dd899b96 tempest-VolumesBackupsTest-1343612709 tempest-VolumesBackupsTest-1343612709-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesBackupsTest-instance-1346416265", "imageRef": "085e4478-6edc-4a69-8e08-f9831713eb65", "flavorRef": "452"}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:14:19.489576 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.network.neutron [None req-3fb7b7ff-a277-479d-b778-7a92dd899b96 tempest-VolumesBackupsTest-1343612709 tempest-VolumesBackupsTest-1343612709-project] validate_networks() for None {{(pid=138745) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 21:14:19.818341 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-3fb7b7ff-a277-479d-b778-7a92dd899b96 tempest-VolumesBackupsTest-1343612709 tempest-VolumesBackupsTest-1343612709-project] Flavor limits 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 21:14:19.819024 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-3fb7b7ff-a277-479d-b778-7a92dd899b96 tempest-VolumesBackupsTest-1343612709 tempest-VolumesBackupsTest-1343612709-project] Image limits 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 21:14:19.819566 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-3fb7b7ff-a277-479d-b778-7a92dd899b96 tempest-VolumesBackupsTest-1343612709 tempest-VolumesBackupsTest-1343612709-project] Flavor pref 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 21:14:19.820212 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-3fb7b7ff-a277-479d-b778-7a92dd899b96 tempest-VolumesBackupsTest-1343612709 tempest-VolumesBackupsTest-1343612709-project] Image pref 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 21:14:19.820721 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-3fb7b7ff-a277-479d-b778-7a92dd899b96 tempest-VolumesBackupsTest-1343612709 tempest-VolumesBackupsTest-1343612709-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 21:14:19.831157 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3fb7b7ff-a277-479d-b778-7a92dd899b96 tempest-VolumesBackupsTest-1343612709 tempest-VolumesBackupsTest-1343612709-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:19.831819 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3fb7b7ff-a277-479d-b778-7a92dd899b96 tempest-VolumesBackupsTest-1343612709 tempest-VolumesBackupsTest-1343612709-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:19.832275 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3fb7b7ff-a277-479d-b778-7a92dd899b96 tempest-VolumesBackupsTest-1343612709 tempest-VolumesBackupsTest-1343612709-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:19.833046 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3fb7b7ff-a277-479d-b778-7a92dd899b96 tempest-VolumesBackupsTest-1343612709 tempest-VolumesBackupsTest-1343612709-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:19.833505 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3fb7b7ff-a277-479d-b778-7a92dd899b96 tempest-VolumesBackupsTest-1343612709 tempest-VolumesBackupsTest-1343612709-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:19.834248 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3fb7b7ff-a277-479d-b778-7a92dd899b96 tempest-VolumesBackupsTest-1343612709 tempest-VolumesBackupsTest-1343612709-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:19.854522 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-3fb7b7ff-a277-479d-b778-7a92dd899b96 tempest-VolumesBackupsTest-1343612709 tempest-VolumesBackupsTest-1343612709-project] Getting quotas for project a25f382da0674f74ada627cf75ad37d0. Resources: {'cores', 'instances', 'ram'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 21:14:19.860656 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-3fb7b7ff-a277-479d-b778-7a92dd899b96 tempest-VolumesBackupsTest-1343612709 tempest-VolumesBackupsTest-1343612709-project] Getting quotas for user d25f7d1fb76e4eb5a8af45ff5d61efce and project a25f382da0674f74ada627cf75ad37d0. Resources: {'cores', 'instances', 'ram'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 21:14:19.875185 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-3fb7b7ff-a277-479d-b778-7a92dd899b96 tempest-VolumesBackupsTest-1343612709 tempest-VolumesBackupsTest-1343612709-project] Going to run 1 instances... {{(pid=138745) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 21:14:19.877885 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-3fb7b7ff-a277-479d-b778-7a92dd899b96 tempest-VolumesBackupsTest-1343612709 tempest-VolumesBackupsTest-1343612709-project] [instance: 6bacb456-9f6a-42a0-9f8b-8374cc17f54a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='085e4478-6edc-4a69-8e08-f9831713eb65',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138745) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 21:14:19.926860 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-3fb7b7ff-a277-479d-b778-7a92dd899b96 tempest-VolumesBackupsTest-1343612709 tempest-VolumesBackupsTest-1343612709-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.505408 Oct 22 21:14:19.927801 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2380/4747] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Oct 22 21:14:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 507 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 21:14:19.939666 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-2a8fabbf-2efa-4046-87a0-db71317fa3b5 tempest-VolumesBackupsTest-1343612709 tempest-VolumesBackupsTest-1343612709-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:14:19.940459 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-2a8fabbf-2efa-4046-87a0-db71317fa3b5 tempest-VolumesBackupsTest-1343612709 tempest-VolumesBackupsTest-1343612709-project] [instance: 6bacb456-9f6a-42a0-9f8b-8374cc17f54a] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:14:20.007020 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-2a8fabbf-2efa-4046-87a0-db71317fa3b5 tempest-VolumesBackupsTest-1343612709 tempest-VolumesBackupsTest-1343612709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd25f7d1fb76e4eb5a8af45ff5d61efce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25f382da0674f74ada627cf75ad37d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:14:20.015202 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-2a8fabbf-2efa-4046-87a0-db71317fa3b5 tempest-VolumesBackupsTest-1343612709 tempest-VolumesBackupsTest-1343612709-project] 10.222.0.18 "GET /compute/v2.1/servers/6bacb456-9f6a-42a0-9f8b-8374cc17f54a" status: 200 len: 1214 microversion: 2.1 time: 0.079728 Oct 22 21:14:20.016173 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2368/4748] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:14:19 2022] GET /compute/v2.1/servers/6bacb456-9f6a-42a0-9f8b-8374cc17f54a => generated 1214 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:14:20.320725 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-8bf5cfb4-04a4-413b-aacb-c7c740ad8db6 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:14:20.321546 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-8bf5cfb4-04a4-413b-aacb-c7c740ad8db6 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] [instance: e8de4ee1-bd84-496c-8376-025eaf5c5094] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:14:20.329719 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-2c095cc5-5f09-4711-b97e-c320efff6986 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:14:20.330214 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-2c095cc5-5f09-4711-b97e-c320efff6986 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] [instance: 9dd3ccc4-26f1-4d75-b990-6636ed02293e] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:14:20.331504 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8bf5cfb4-04a4-413b-aacb-c7c740ad8db6 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:20.332053 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8bf5cfb4-04a4-413b-aacb-c7c740ad8db6 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:20.332639 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8bf5cfb4-04a4-413b-aacb-c7c740ad8db6 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:20.333385 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8bf5cfb4-04a4-413b-aacb-c7c740ad8db6 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:20.334101 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8bf5cfb4-04a4-413b-aacb-c7c740ad8db6 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:20.334720 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8bf5cfb4-04a4-413b-aacb-c7c740ad8db6 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:20.337427 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2c095cc5-5f09-4711-b97e-c320efff6986 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:20.338324 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2c095cc5-5f09-4711-b97e-c320efff6986 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:20.338827 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2c095cc5-5f09-4711-b97e-c320efff6986 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:20.339542 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2c095cc5-5f09-4711-b97e-c320efff6986 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:20.340052 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2c095cc5-5f09-4711-b97e-c320efff6986 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:20.340470 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2c095cc5-5f09-4711-b97e-c320efff6986 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:20.353975 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.wsgi [None req-8bf5cfb4-04a4-413b-aacb-c7c740ad8db6 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] HTTP exception thrown: Instance e8de4ee1-bd84-496c-8376-025eaf5c5094 could not be found. Oct 22 21:14:20.355741 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-8bf5cfb4-04a4-413b-aacb-c7c740ad8db6 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Request method failure captured: Oct 22 21:14:20.355741 ncdv-master-1 devstack@n-api.service[138745]: request: GET /compute/v2.1/servers/e8de4ee1-bd84-496c-8376-025eaf5c5094 HTTP/1.1 Oct 22 21:14:20.355741 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 21:14:20.355741 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 21:14:20.355741 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 21:14:20.355741 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 0 Oct 22 21:14:20.355741 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 21:14:20.355741 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 21:14:20.355741 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 21:14:20.355741 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 21:14:20.355741 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVFzbjFuxlabhGO5W5IN5r54yzIxFa_mX4J74OzfXM08pyPGfws2Ww4pm5qGKXFC4h2Ttyt1JiFfrSI-ucQt7MPAhDqF8_tQs5Z1aGjJkE87trFhYgYaJFSihYuRhX8jAUHeeDuqMpE3BFEYcIHoIoAbD2BZHLThVUs-wQCfowY_4sFQ Oct 22 21:14:20.355741 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 21:14:20.355741 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 21:14:20.355741 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 21:14:20.355741 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 21:14:20.355741 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 21:14:20.355741 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 21:14:20.355741 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: e87474d4b4c547abbfe6308b6dd8e1c8 Oct 22 21:14:20.355741 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-ServersTestJSON-2007137082 Oct 22 21:14:20.355741 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 21:14:20.355741 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 21:14:20.355741 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_e87474d4b4c547abbfe6308b6dd8e1c8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e87474d4b4c547abbfe6308b6dd8e1c8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/e87474d4b4c547abbfe6308b6dd8e1c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e87474d4b4c547abbfe6308b6dd8e1c8"}]}] Oct 22 21:14:20.355741 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-ServersTestJSON-2007137082 Oct 22 21:14:20.355741 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: e87474d4b4c547abbfe6308b6dd8e1c8 Oct 22 21:14:20.355741 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-ServersTestJSON-2007137082 Oct 22 21:14:20.355741 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-ServersTestJSON-2007137082-project Oct 22 21:14:20.355741 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 21:14:20.355741 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 21:14:20.355741 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: 799f987b3aa7426ba5d7a464052d6490 Oct 22 21:14:20.355741 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-ServersTestJSON-2007137082-project Oct 22 21:14:20.355741 ncdv-master-1 devstack@n-api.service[138745]: method: > Oct 22 21:14:20.355741 ncdv-master-1 devstack@n-api.service[138745]: exception: Instance e8de4ee1-bd84-496c-8376-025eaf5c5094 could not be found. Oct 22 21:14:20.355741 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'id': 'e8de4ee1-bd84-496c-8376-025eaf5c5094'} Oct 22 21:14:20.355741 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:14:20.355741 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:14:20.355741 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 21:14:20.355741 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 21:14:20.355741 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 21:14:20.355741 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 21:14:20.355741 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 21:14:20.355741 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 21:14:20.355741 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 21:14:20.355741 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 21:14:20.355741 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e8de4ee1-bd84-496c-8376-025eaf5c5094 could not be found. Oct 22 21:14:20.355741 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:14:20.355741 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:14:20.355741 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:14:20.355741 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:14:20.355741 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:14:20.355741 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:14:20.355741 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:14:20.355741 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:14:20.355741 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:14:20.355741 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:14:20.355741 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 21:14:20.355741 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 21:14:20.355741 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 21:14:20.355741 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 21:14:20.355741 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 21:14:20.355741 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:14:20.355741 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e8de4ee1-bd84-496c-8376-025eaf5c5094 could not be found. Oct 22 21:14:20.355741 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:14:20.355741 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:14:20.355741 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:14:20.361016 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:14:20.361016 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:14:20.361016 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:14:20.361016 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:14:20.361016 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:14:20.361016 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e8de4ee1-bd84-496c-8376-025eaf5c5094 could not be found. Oct 22 21:14:20.361016 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:14:20.361016 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-8bf5cfb4-04a4-413b-aacb-c7c740ad8db6 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Returning 404 to user: Instance e8de4ee1-bd84-496c-8376-025eaf5c5094 could not be found. {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:14:20.361016 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-8bf5cfb4-04a4-413b-aacb-c7c740ad8db6 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] 10.222.0.18 "GET /compute/v2.1/servers/e8de4ee1-bd84-496c-8376-025eaf5c5094" status: 404 len: 111 microversion: 2.1 time: 0.042943 Oct 22 21:14:20.361016 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2381/4749] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:14:20 2022] GET /compute/v2.1/servers/e8de4ee1-bd84-496c-8376-025eaf5c5094 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 21:14:20.366146 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-6eaef7e4-9f09-4aaf-bc0d-640c46ba82a4 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Calling method '.version_select at 0x7fd39ee1e9d0>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:14:20.371040 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-2c095cc5-5f09-4711-b97e-c320efff6986 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] HTTP exception thrown: Instance 9dd3ccc4-26f1-4d75-b990-6636ed02293e could not be found. Oct 22 21:14:20.373464 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-2c095cc5-5f09-4711-b97e-c320efff6986 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Request method failure captured: Oct 22 21:14:20.373464 ncdv-master-1 devstack@n-api.service[138744]: request: DELETE /compute/v2.1/servers/9dd3ccc4-26f1-4d75-b990-6636ed02293e HTTP/1.1 Oct 22 21:14:20.373464 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 21:14:20.373464 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 21:14:20.373464 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 21:14:20.373464 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 0 Oct 22 21:14:20.373464 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 21:14:20.373464 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 21:14:20.373464 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 21:14:20.373464 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 21:14:20.373464 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVFuUBtPDLFT8At_zrn_bBaaE2zzyF_nT22PiPjaxHPU2YIA_DgSr2gz12ljL2A8fqsjxUzqntMDUF7z7I3jTzNnIvnaGuvHcioSaq_gOgTI6yASMb4L3UiCnl8Esgqq5uU50izm2mW77ycOQXfK6m6BecIab0G9mkZWEbgIL-w8TVK4 Oct 22 21:14:20.373464 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 21:14:20.373464 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 21:14:20.373464 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 21:14:20.373464 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 21:14:20.373464 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 21:14:20.373464 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 21:14:20.373464 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: 755501ba3e344f1aaf7ef80924bb57d7 Oct 22 21:14:20.373464 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-AttachVolumeTestJSON-485250435 Oct 22 21:14:20.373464 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 21:14:20.373464 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 21:14:20.373464 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_755501ba3e344f1aaf7ef80924bb57d7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/755501ba3e344f1aaf7ef80924bb57d7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/755501ba3e344f1aaf7ef80924bb57d7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/755501ba3e344f1aaf7ef80924bb57d7"}]}] Oct 22 21:14:20.373464 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-AttachVolumeTestJSON-485250435 Oct 22 21:14:20.373464 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: 755501ba3e344f1aaf7ef80924bb57d7 Oct 22 21:14:20.373464 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-AttachVolumeTestJSON-485250435 Oct 22 21:14:20.373464 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-AttachVolumeTestJSON-485250435-project Oct 22 21:14:20.373464 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 21:14:20.373464 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 21:14:20.373464 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: ba0d0bdfb04240209e4efa92f47cbb94 Oct 22 21:14:20.373464 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-AttachVolumeTestJSON-485250435-project Oct 22 21:14:20.373464 ncdv-master-1 devstack@n-api.service[138744]: method: > Oct 22 21:14:20.373464 ncdv-master-1 devstack@n-api.service[138744]: exception: Instance 9dd3ccc4-26f1-4d75-b990-6636ed02293e could not be found. Oct 22 21:14:20.373464 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': '9dd3ccc4-26f1-4d75-b990-6636ed02293e'} Oct 22 21:14:20.373464 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:14:20.373464 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:14:20.373464 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 21:14:20.373464 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 21:14:20.373464 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 21:14:20.373464 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 21:14:20.373464 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 21:14:20.373464 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 21:14:20.373464 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 21:14:20.373464 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 21:14:20.373464 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9dd3ccc4-26f1-4d75-b990-6636ed02293e could not be found. Oct 22 21:14:20.373464 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:14:20.373464 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:14:20.373464 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:14:20.373464 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:14:20.373464 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:14:20.373464 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:14:20.373464 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:14:20.373464 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:14:20.373464 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:14:20.373464 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:14:20.373464 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 22 21:14:20.373464 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 22 21:14:20.373464 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 22 21:14:20.373464 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 22 21:14:20.373464 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 21:14:20.373464 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 21:14:20.373464 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 21:14:20.373464 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:14:20.378574 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9dd3ccc4-26f1-4d75-b990-6636ed02293e could not be found. Oct 22 21:14:20.378574 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:14:20.378574 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:14:20.378574 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:14:20.378574 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:14:20.378574 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:14:20.378574 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:14:20.378574 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:14:20.378574 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:14:20.378574 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9dd3ccc4-26f1-4d75-b990-6636ed02293e could not be found. Oct 22 21:14:20.378574 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:14:20.378574 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-2c095cc5-5f09-4711-b97e-c320efff6986 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Returning 404 to user: Instance 9dd3ccc4-26f1-4d75-b990-6636ed02293e could not be found. {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:14:20.378574 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-2c095cc5-5f09-4711-b97e-c320efff6986 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] 10.222.0.18 "DELETE /compute/v2.1/servers/9dd3ccc4-26f1-4d75-b990-6636ed02293e" status: 404 len: 111 microversion: 2.1 time: 0.052643 Oct 22 21:14:20.383853 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2369/4750] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 21:14:20 2022] DELETE /compute/v2.1/servers/9dd3ccc4-26f1-4d75-b990-6636ed02293e => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 22 21:14:20.389212 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-617bd3d8-f8b1-40c5-abb0-a5f898dc8b19 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:14:20.389999 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-617bd3d8-f8b1-40c5-abb0-a5f898dc8b19 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] [instance: 9dd3ccc4-26f1-4d75-b990-6636ed02293e] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:14:20.393695 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-6eaef7e4-9f09-4aaf-bc0d-640c46ba82a4 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-key-930355142" status: 202 len: 0 microversion: 2.1 time: 0.031372 Oct 22 21:14:20.399241 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2382/4751] 10.222.0.18 () {58 vars in 1206 bytes} [Sat Oct 22 21:14:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-key-930355142 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 21:14:20.400421 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-617bd3d8-f8b1-40c5-abb0-a5f898dc8b19 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:20.401086 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-617bd3d8-f8b1-40c5-abb0-a5f898dc8b19 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:20.401771 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-617bd3d8-f8b1-40c5-abb0-a5f898dc8b19 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:20.403446 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-617bd3d8-f8b1-40c5-abb0-a5f898dc8b19 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:20.403446 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-617bd3d8-f8b1-40c5-abb0-a5f898dc8b19 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:20.403905 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-617bd3d8-f8b1-40c5-abb0-a5f898dc8b19 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:20.421775 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-617bd3d8-f8b1-40c5-abb0-a5f898dc8b19 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] HTTP exception thrown: Instance 9dd3ccc4-26f1-4d75-b990-6636ed02293e could not be found. Oct 22 21:14:20.423522 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-617bd3d8-f8b1-40c5-abb0-a5f898dc8b19 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Request method failure captured: Oct 22 21:14:20.423522 ncdv-master-1 devstack@n-api.service[138744]: request: GET /compute/v2.1/servers/9dd3ccc4-26f1-4d75-b990-6636ed02293e HTTP/1.1 Oct 22 21:14:20.423522 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 21:14:20.423522 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 21:14:20.423522 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 21:14:20.423522 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 0 Oct 22 21:14:20.423522 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 21:14:20.423522 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 21:14:20.423522 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 21:14:20.423522 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 21:14:20.423522 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVFuUBtPDLFT8At_zrn_bBaaE2zzyF_nT22PiPjaxHPU2YIA_DgSr2gz12ljL2A8fqsjxUzqntMDUF7z7I3jTzNnIvnaGuvHcioSaq_gOgTI6yASMb4L3UiCnl8Esgqq5uU50izm2mW77ycOQXfK6m6BecIab0G9mkZWEbgIL-w8TVK4 Oct 22 21:14:20.423522 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 21:14:20.423522 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 21:14:20.423522 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 21:14:20.423522 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 21:14:20.423522 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 21:14:20.423522 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 21:14:20.423522 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: 755501ba3e344f1aaf7ef80924bb57d7 Oct 22 21:14:20.423522 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-AttachVolumeTestJSON-485250435 Oct 22 21:14:20.423522 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 21:14:20.423522 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 21:14:20.423522 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_755501ba3e344f1aaf7ef80924bb57d7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/755501ba3e344f1aaf7ef80924bb57d7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/755501ba3e344f1aaf7ef80924bb57d7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/755501ba3e344f1aaf7ef80924bb57d7"}]}] Oct 22 21:14:20.423522 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-AttachVolumeTestJSON-485250435 Oct 22 21:14:20.423522 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: 755501ba3e344f1aaf7ef80924bb57d7 Oct 22 21:14:20.423522 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-AttachVolumeTestJSON-485250435 Oct 22 21:14:20.423522 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-AttachVolumeTestJSON-485250435-project Oct 22 21:14:20.423522 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 21:14:20.423522 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 21:14:20.423522 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: ba0d0bdfb04240209e4efa92f47cbb94 Oct 22 21:14:20.423522 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-AttachVolumeTestJSON-485250435-project Oct 22 21:14:20.423522 ncdv-master-1 devstack@n-api.service[138744]: method: > Oct 22 21:14:20.423522 ncdv-master-1 devstack@n-api.service[138744]: exception: Instance 9dd3ccc4-26f1-4d75-b990-6636ed02293e could not be found. Oct 22 21:14:20.423522 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': '9dd3ccc4-26f1-4d75-b990-6636ed02293e'} Oct 22 21:14:20.423522 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:14:20.423522 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:14:20.423522 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 21:14:20.423522 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 21:14:20.423522 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 21:14:20.423522 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 21:14:20.423522 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 21:14:20.423522 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 21:14:20.423522 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 21:14:20.423522 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 21:14:20.423522 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9dd3ccc4-26f1-4d75-b990-6636ed02293e could not be found. Oct 22 21:14:20.423522 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:14:20.423522 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:14:20.423522 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:14:20.423522 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:14:20.423522 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:14:20.423522 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:14:20.423522 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:14:20.423522 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:14:20.423522 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:14:20.423522 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:14:20.423522 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 21:14:20.423522 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 21:14:20.423522 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 21:14:20.423522 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 21:14:20.423522 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 21:14:20.423522 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:14:20.423522 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9dd3ccc4-26f1-4d75-b990-6636ed02293e could not be found. Oct 22 21:14:20.423522 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:14:20.423522 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:14:20.423522 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:14:20.431558 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:14:20.431558 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:14:20.431558 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:14:20.431558 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:14:20.431558 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:14:20.431558 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9dd3ccc4-26f1-4d75-b990-6636ed02293e could not be found. Oct 22 21:14:20.431558 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:14:20.431558 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-617bd3d8-f8b1-40c5-abb0-a5f898dc8b19 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Returning 404 to user: Instance 9dd3ccc4-26f1-4d75-b990-6636ed02293e could not be found. {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:14:20.431558 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-617bd3d8-f8b1-40c5-abb0-a5f898dc8b19 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] 10.222.0.18 "GET /compute/v2.1/servers/9dd3ccc4-26f1-4d75-b990-6636ed02293e" status: 404 len: 111 microversion: 2.1 time: 0.041603 Oct 22 21:14:20.431558 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2370/4752] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:14:20 2022] GET /compute/v2.1/servers/9dd3ccc4-26f1-4d75-b990-6636ed02293e => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 21:14:20.546633 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-9626862a-6fb2-4015-99fc-5b52fc4c9b8f tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1728901193", "imageRef": "085e4478-6edc-4a69-8e08-f9831713eb65", "flavorRef": "452", "networks": [{"uuid": "ea7e3c31-2bc2-4b4f-ab48-7d75cccdd3b0"}]}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:14:20.617742 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.network.neutron [None req-9626862a-6fb2-4015-99fc-5b52fc4c9b8f tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] validate_networks() for [('ea7e3c31-2bc2-4b4f-ab48-7d75cccdd3b0', None, None, None, None, None)] {{(pid=138745) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 21:14:21.038596 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-23f74bb7-3fef-4735-81cf-68c09267d508 tempest-VolumesBackupsTest-1343612709 tempest-VolumesBackupsTest-1343612709-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:14:21.039649 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-23f74bb7-3fef-4735-81cf-68c09267d508 tempest-VolumesBackupsTest-1343612709 tempest-VolumesBackupsTest-1343612709-project] [instance: 6bacb456-9f6a-42a0-9f8b-8374cc17f54a] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:14:21.046530 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-23f74bb7-3fef-4735-81cf-68c09267d508 tempest-VolumesBackupsTest-1343612709 tempest-VolumesBackupsTest-1343612709-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:21.047332 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-23f74bb7-3fef-4735-81cf-68c09267d508 tempest-VolumesBackupsTest-1343612709 tempest-VolumesBackupsTest-1343612709-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:21.047783 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-23f74bb7-3fef-4735-81cf-68c09267d508 tempest-VolumesBackupsTest-1343612709 tempest-VolumesBackupsTest-1343612709-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:21.048596 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-23f74bb7-3fef-4735-81cf-68c09267d508 tempest-VolumesBackupsTest-1343612709 tempest-VolumesBackupsTest-1343612709-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:21.049009 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-23f74bb7-3fef-4735-81cf-68c09267d508 tempest-VolumesBackupsTest-1343612709 tempest-VolumesBackupsTest-1343612709-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:21.049614 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-23f74bb7-3fef-4735-81cf-68c09267d508 tempest-VolumesBackupsTest-1343612709 tempest-VolumesBackupsTest-1343612709-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:21.080782 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-9626862a-6fb2-4015-99fc-5b52fc4c9b8f tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Flavor limits 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 21:14:21.081461 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-9626862a-6fb2-4015-99fc-5b52fc4c9b8f tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Image limits 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 21:14:21.081972 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-9626862a-6fb2-4015-99fc-5b52fc4c9b8f tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Flavor pref 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 21:14:21.082575 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-9626862a-6fb2-4015-99fc-5b52fc4c9b8f tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Image pref 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 21:14:21.083300 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-9626862a-6fb2-4015-99fc-5b52fc4c9b8f tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 21:14:21.097464 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9626862a-6fb2-4015-99fc-5b52fc4c9b8f tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:21.098301 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9626862a-6fb2-4015-99fc-5b52fc4c9b8f tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:21.098870 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9626862a-6fb2-4015-99fc-5b52fc4c9b8f tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:21.100675 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9626862a-6fb2-4015-99fc-5b52fc4c9b8f tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:21.101383 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9626862a-6fb2-4015-99fc-5b52fc4c9b8f tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:21.103800 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9626862a-6fb2-4015-99fc-5b52fc4c9b8f tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:21.127512 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-23f74bb7-3fef-4735-81cf-68c09267d508 tempest-VolumesBackupsTest-1343612709 tempest-VolumesBackupsTest-1343612709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd25f7d1fb76e4eb5a8af45ff5d61efce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25f382da0674f74ada627cf75ad37d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:14:21.130244 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-9626862a-6fb2-4015-99fc-5b52fc4c9b8f tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Getting quotas for project e87474d4b4c547abbfe6308b6dd8e1c8. Resources: {'cores', 'instances', 'ram'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 21:14:21.137473 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-9626862a-6fb2-4015-99fc-5b52fc4c9b8f tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Getting quotas for user 799f987b3aa7426ba5d7a464052d6490 and project e87474d4b4c547abbfe6308b6dd8e1c8. Resources: {'cores', 'instances', 'ram'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 21:14:21.138247 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-23f74bb7-3fef-4735-81cf-68c09267d508 tempest-VolumesBackupsTest-1343612709 tempest-VolumesBackupsTest-1343612709-project] 10.222.0.18 "GET /compute/v2.1/servers/6bacb456-9f6a-42a0-9f8b-8374cc17f54a" status: 200 len: 1266 microversion: 2.1 time: 0.103658 Oct 22 21:14:21.138997 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2371/4753] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:14:21 2022] GET /compute/v2.1/servers/6bacb456-9f6a-42a0-9f8b-8374cc17f54a => generated 1266 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:14:21.158513 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-9626862a-6fb2-4015-99fc-5b52fc4c9b8f tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Going to run 1 instances... {{(pid=138745) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 21:14:21.160856 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-9626862a-6fb2-4015-99fc-5b52fc4c9b8f tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] [instance: c05b27d6-ba86-4600-bb33-8d2daeda2094] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='085e4478-6edc-4a69-8e08-f9831713eb65',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138745) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 21:14:21.213762 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-9626862a-6fb2-4015-99fc-5b52fc4c9b8f tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.671983 Oct 22 21:14:21.215172 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2383/4754] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Oct 22 21:14:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 674 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 21:14:21.229570 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-64385362-f416-414e-aa39-4e116a6947d5 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:14:21.230649 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-64385362-f416-414e-aa39-4e116a6947d5 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] [instance: c05b27d6-ba86-4600-bb33-8d2daeda2094] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:14:21.319285 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-64385362-f416-414e-aa39-4e116a6947d5 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799f987b3aa7426ba5d7a464052d6490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87474d4b4c547abbfe6308b6dd8e1c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:14:21.328695 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-64385362-f416-414e-aa39-4e116a6947d5 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] 10.222.0.18 "GET /compute/v2.1/servers/c05b27d6-ba86-4600-bb33-8d2daeda2094" status: 200 len: 1209 microversion: 2.1 time: 0.105677 Oct 22 21:14:21.339607 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2372/4755] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:14:21 2022] GET /compute/v2.1/servers/c05b27d6-ba86-4600-bb33-8d2daeda2094 => generated 1209 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:14:21.629599 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-c650b467-4a9f-4665-b770-1d22b1c1a0bb tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:14:21.630134 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-c650b467-4a9f-4665-b770-1d22b1c1a0bb tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] [instance: ad302c49-addb-464c-a15f-fa01577f90c4] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:14:21.650366 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c650b467-4a9f-4665-b770-1d22b1c1a0bb tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:21.651465 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c650b467-4a9f-4665-b770-1d22b1c1a0bb tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:21.652622 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c650b467-4a9f-4665-b770-1d22b1c1a0bb tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:21.653038 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c650b467-4a9f-4665-b770-1d22b1c1a0bb tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:21.653452 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c650b467-4a9f-4665-b770-1d22b1c1a0bb tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:21.654234 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c650b467-4a9f-4665-b770-1d22b1c1a0bb tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:21.672472 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.wsgi [None req-c650b467-4a9f-4665-b770-1d22b1c1a0bb tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] HTTP exception thrown: Instance ad302c49-addb-464c-a15f-fa01577f90c4 could not be found. Oct 22 21:14:21.676095 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-c650b467-4a9f-4665-b770-1d22b1c1a0bb tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Request method failure captured: Oct 22 21:14:21.676095 ncdv-master-1 devstack@n-api.service[138745]: request: DELETE /compute/v2.1/servers/ad302c49-addb-464c-a15f-fa01577f90c4 HTTP/1.1 Oct 22 21:14:21.676095 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 21:14:21.676095 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 21:14:21.676095 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 21:14:21.676095 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 0 Oct 22 21:14:21.676095 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 21:14:21.676095 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 21:14:21.676095 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 21:14:21.676095 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 21:14:21.676095 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVFuUBtPDLFT8At_zrn_bBaaE2zzyF_nT22PiPjaxHPU2YIA_DgSr2gz12ljL2A8fqsjxUzqntMDUF7z7I3jTzNnIvnaGuvHcioSaq_gOgTI6yASMb4L3UiCnl8Esgqq5uU50izm2mW77ycOQXfK6m6BecIab0G9mkZWEbgIL-w8TVK4 Oct 22 21:14:21.676095 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 21:14:21.676095 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 21:14:21.676095 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 21:14:21.676095 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 21:14:21.676095 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 21:14:21.676095 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 21:14:21.676095 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: 755501ba3e344f1aaf7ef80924bb57d7 Oct 22 21:14:21.676095 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-AttachVolumeTestJSON-485250435 Oct 22 21:14:21.676095 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 21:14:21.676095 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 21:14:21.676095 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_755501ba3e344f1aaf7ef80924bb57d7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/755501ba3e344f1aaf7ef80924bb57d7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/755501ba3e344f1aaf7ef80924bb57d7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/755501ba3e344f1aaf7ef80924bb57d7"}]}] Oct 22 21:14:21.676095 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-AttachVolumeTestJSON-485250435 Oct 22 21:14:21.676095 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: 755501ba3e344f1aaf7ef80924bb57d7 Oct 22 21:14:21.676095 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-AttachVolumeTestJSON-485250435 Oct 22 21:14:21.676095 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-AttachVolumeTestJSON-485250435-project Oct 22 21:14:21.676095 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 21:14:21.676095 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 21:14:21.676095 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: ba0d0bdfb04240209e4efa92f47cbb94 Oct 22 21:14:21.676095 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-AttachVolumeTestJSON-485250435-project Oct 22 21:14:21.676095 ncdv-master-1 devstack@n-api.service[138745]: method: > Oct 22 21:14:21.676095 ncdv-master-1 devstack@n-api.service[138745]: exception: Instance ad302c49-addb-464c-a15f-fa01577f90c4 could not be found. Oct 22 21:14:21.676095 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'id': 'ad302c49-addb-464c-a15f-fa01577f90c4'} Oct 22 21:14:21.676095 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:14:21.676095 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:14:21.676095 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 21:14:21.676095 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 21:14:21.676095 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 21:14:21.676095 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 21:14:21.676095 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 21:14:21.676095 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 21:14:21.676095 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 21:14:21.676095 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 21:14:21.676095 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ad302c49-addb-464c-a15f-fa01577f90c4 could not be found. Oct 22 21:14:21.676095 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:14:21.676095 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:14:21.676095 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:14:21.676095 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:14:21.676095 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:14:21.676095 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:14:21.676095 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:14:21.676095 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:14:21.676095 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:14:21.676095 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:14:21.676095 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 22 21:14:21.676095 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 22 21:14:21.676095 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 22 21:14:21.676095 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 22 21:14:21.676095 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 21:14:21.676095 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 21:14:21.676095 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 21:14:21.676095 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:14:21.681799 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ad302c49-addb-464c-a15f-fa01577f90c4 could not be found. Oct 22 21:14:21.681799 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:14:21.681799 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:14:21.681799 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:14:21.681799 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:14:21.681799 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:14:21.681799 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:14:21.681799 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:14:21.681799 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:14:21.681799 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ad302c49-addb-464c-a15f-fa01577f90c4 could not be found. Oct 22 21:14:21.681799 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:14:21.681799 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-c650b467-4a9f-4665-b770-1d22b1c1a0bb tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Returning 404 to user: Instance ad302c49-addb-464c-a15f-fa01577f90c4 could not be found. {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:14:21.681799 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-c650b467-4a9f-4665-b770-1d22b1c1a0bb tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] 10.222.0.18 "DELETE /compute/v2.1/servers/ad302c49-addb-464c-a15f-fa01577f90c4" status: 404 len: 111 microversion: 2.1 time: 0.057046 Oct 22 21:14:21.687260 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2384/4756] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 21:14:21 2022] DELETE /compute/v2.1/servers/ad302c49-addb-464c-a15f-fa01577f90c4 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 21:14:21.692260 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-7889d3e0-5569-4848-b386-acfb53120975 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:14:21.692890 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-7889d3e0-5569-4848-b386-acfb53120975 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] [instance: ad302c49-addb-464c-a15f-fa01577f90c4] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:14:21.701415 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7889d3e0-5569-4848-b386-acfb53120975 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:21.702360 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7889d3e0-5569-4848-b386-acfb53120975 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:21.703180 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7889d3e0-5569-4848-b386-acfb53120975 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:21.704240 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7889d3e0-5569-4848-b386-acfb53120975 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:21.704598 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7889d3e0-5569-4848-b386-acfb53120975 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:21.706140 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7889d3e0-5569-4848-b386-acfb53120975 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:21.724771 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-7889d3e0-5569-4848-b386-acfb53120975 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] HTTP exception thrown: Instance ad302c49-addb-464c-a15f-fa01577f90c4 could not be found. Oct 22 21:14:21.728410 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-7889d3e0-5569-4848-b386-acfb53120975 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Request method failure captured: Oct 22 21:14:21.728410 ncdv-master-1 devstack@n-api.service[138744]: request: GET /compute/v2.1/servers/ad302c49-addb-464c-a15f-fa01577f90c4 HTTP/1.1 Oct 22 21:14:21.728410 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 21:14:21.728410 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 21:14:21.728410 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 21:14:21.728410 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 0 Oct 22 21:14:21.728410 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 21:14:21.728410 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 21:14:21.728410 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 21:14:21.728410 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 21:14:21.728410 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVFuUBtPDLFT8At_zrn_bBaaE2zzyF_nT22PiPjaxHPU2YIA_DgSr2gz12ljL2A8fqsjxUzqntMDUF7z7I3jTzNnIvnaGuvHcioSaq_gOgTI6yASMb4L3UiCnl8Esgqq5uU50izm2mW77ycOQXfK6m6BecIab0G9mkZWEbgIL-w8TVK4 Oct 22 21:14:21.728410 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 21:14:21.728410 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 21:14:21.728410 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 21:14:21.728410 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 21:14:21.728410 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 21:14:21.728410 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 21:14:21.728410 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: 755501ba3e344f1aaf7ef80924bb57d7 Oct 22 21:14:21.728410 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-AttachVolumeTestJSON-485250435 Oct 22 21:14:21.728410 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 21:14:21.728410 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 21:14:21.728410 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_755501ba3e344f1aaf7ef80924bb57d7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/755501ba3e344f1aaf7ef80924bb57d7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/755501ba3e344f1aaf7ef80924bb57d7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/755501ba3e344f1aaf7ef80924bb57d7"}]}] Oct 22 21:14:21.728410 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-AttachVolumeTestJSON-485250435 Oct 22 21:14:21.728410 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: 755501ba3e344f1aaf7ef80924bb57d7 Oct 22 21:14:21.728410 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-AttachVolumeTestJSON-485250435 Oct 22 21:14:21.728410 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-AttachVolumeTestJSON-485250435-project Oct 22 21:14:21.728410 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 21:14:21.728410 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 21:14:21.728410 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: ba0d0bdfb04240209e4efa92f47cbb94 Oct 22 21:14:21.728410 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-AttachVolumeTestJSON-485250435-project Oct 22 21:14:21.728410 ncdv-master-1 devstack@n-api.service[138744]: method: > Oct 22 21:14:21.728410 ncdv-master-1 devstack@n-api.service[138744]: exception: Instance ad302c49-addb-464c-a15f-fa01577f90c4 could not be found. Oct 22 21:14:21.728410 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': 'ad302c49-addb-464c-a15f-fa01577f90c4'} Oct 22 21:14:21.728410 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:14:21.728410 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:14:21.728410 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 21:14:21.728410 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 21:14:21.728410 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 21:14:21.728410 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 21:14:21.728410 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 21:14:21.728410 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 21:14:21.728410 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 21:14:21.728410 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 21:14:21.728410 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ad302c49-addb-464c-a15f-fa01577f90c4 could not be found. Oct 22 21:14:21.728410 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:14:21.728410 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:14:21.728410 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:14:21.728410 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:14:21.728410 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:14:21.728410 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:14:21.728410 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:14:21.728410 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:14:21.728410 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:14:21.728410 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:14:21.728410 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 21:14:21.728410 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 21:14:21.728410 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 21:14:21.728410 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 21:14:21.728410 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 21:14:21.728410 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:14:21.728410 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ad302c49-addb-464c-a15f-fa01577f90c4 could not be found. Oct 22 21:14:21.728410 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:14:21.728410 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:14:21.728410 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:14:21.736085 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:14:21.736085 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:14:21.736085 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:14:21.736085 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:14:21.736085 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:14:21.736085 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ad302c49-addb-464c-a15f-fa01577f90c4 could not be found. Oct 22 21:14:21.736085 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:14:21.736085 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-7889d3e0-5569-4848-b386-acfb53120975 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] Returning 404 to user: Instance ad302c49-addb-464c-a15f-fa01577f90c4 could not be found. {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:14:21.736085 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-7889d3e0-5569-4848-b386-acfb53120975 tempest-AttachVolumeTestJSON-485250435 tempest-AttachVolumeTestJSON-485250435-project] 10.222.0.18 "GET /compute/v2.1/servers/ad302c49-addb-464c-a15f-fa01577f90c4" status: 404 len: 111 microversion: 2.1 time: 0.042536 Oct 22 21:14:21.736085 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2373/4757] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:14:21 2022] GET /compute/v2.1/servers/ad302c49-addb-464c-a15f-fa01577f90c4 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 22 21:14:22.163078 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-b4768532-dab8-40a7-9c4c-4cb9bfd85fb3 tempest-VolumesBackupsTest-1343612709 tempest-VolumesBackupsTest-1343612709-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:14:22.163805 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-b4768532-dab8-40a7-9c4c-4cb9bfd85fb3 tempest-VolumesBackupsTest-1343612709 tempest-VolumesBackupsTest-1343612709-project] [instance: 6bacb456-9f6a-42a0-9f8b-8374cc17f54a] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:14:22.173323 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b4768532-dab8-40a7-9c4c-4cb9bfd85fb3 tempest-VolumesBackupsTest-1343612709 tempest-VolumesBackupsTest-1343612709-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:22.174147 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b4768532-dab8-40a7-9c4c-4cb9bfd85fb3 tempest-VolumesBackupsTest-1343612709 tempest-VolumesBackupsTest-1343612709-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:22.174675 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b4768532-dab8-40a7-9c4c-4cb9bfd85fb3 tempest-VolumesBackupsTest-1343612709 tempest-VolumesBackupsTest-1343612709-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:22.175650 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b4768532-dab8-40a7-9c4c-4cb9bfd85fb3 tempest-VolumesBackupsTest-1343612709 tempest-VolumesBackupsTest-1343612709-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:22.176528 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b4768532-dab8-40a7-9c4c-4cb9bfd85fb3 tempest-VolumesBackupsTest-1343612709 tempest-VolumesBackupsTest-1343612709-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:22.176969 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b4768532-dab8-40a7-9c4c-4cb9bfd85fb3 tempest-VolumesBackupsTest-1343612709 tempest-VolumesBackupsTest-1343612709-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:22.274842 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-b4768532-dab8-40a7-9c4c-4cb9bfd85fb3 tempest-VolumesBackupsTest-1343612709 tempest-VolumesBackupsTest-1343612709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd25f7d1fb76e4eb5a8af45ff5d61efce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25f382da0674f74ada627cf75ad37d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:14:22.284477 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-b4768532-dab8-40a7-9c4c-4cb9bfd85fb3 tempest-VolumesBackupsTest-1343612709 tempest-VolumesBackupsTest-1343612709-project] 10.222.0.18 "GET /compute/v2.1/servers/6bacb456-9f6a-42a0-9f8b-8374cc17f54a" status: 200 len: 1272 microversion: 2.1 time: 0.126335 Oct 22 21:14:22.285864 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2385/4758] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:14:22 2022] GET /compute/v2.1/servers/6bacb456-9f6a-42a0-9f8b-8374cc17f54a => generated 1272 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:14:22.355791 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-16597513-de42-40e1-a3f3-c16320c4becd tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:14:22.356800 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-16597513-de42-40e1-a3f3-c16320c4becd tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] [instance: c05b27d6-ba86-4600-bb33-8d2daeda2094] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:14:22.363515 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-16597513-de42-40e1-a3f3-c16320c4becd tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:22.364008 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-16597513-de42-40e1-a3f3-c16320c4becd tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:22.364436 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-16597513-de42-40e1-a3f3-c16320c4becd tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:22.365329 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-16597513-de42-40e1-a3f3-c16320c4becd tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:22.365815 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-16597513-de42-40e1-a3f3-c16320c4becd tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:22.366421 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-16597513-de42-40e1-a3f3-c16320c4becd tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:22.449330 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-16597513-de42-40e1-a3f3-c16320c4becd tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799f987b3aa7426ba5d7a464052d6490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87474d4b4c547abbfe6308b6dd8e1c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:14:22.457334 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-16597513-de42-40e1-a3f3-c16320c4becd tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] 10.222.0.18 "GET /compute/v2.1/servers/c05b27d6-ba86-4600-bb33-8d2daeda2094" status: 200 len: 1261 microversion: 2.1 time: 0.106168 Oct 22 21:14:22.457907 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2374/4759] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:14:22 2022] GET /compute/v2.1/servers/c05b27d6-ba86-4600-bb33-8d2daeda2094 => generated 1261 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:14:23.310366 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-af382bb1-6ce2-4eb1-b467-e0e26ffcfa8c tempest-VolumesBackupsTest-1343612709 tempest-VolumesBackupsTest-1343612709-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:14:23.311153 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-af382bb1-6ce2-4eb1-b467-e0e26ffcfa8c tempest-VolumesBackupsTest-1343612709 tempest-VolumesBackupsTest-1343612709-project] [instance: 6bacb456-9f6a-42a0-9f8b-8374cc17f54a] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:14:23.319304 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-af382bb1-6ce2-4eb1-b467-e0e26ffcfa8c tempest-VolumesBackupsTest-1343612709 tempest-VolumesBackupsTest-1343612709-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:23.320089 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-af382bb1-6ce2-4eb1-b467-e0e26ffcfa8c tempest-VolumesBackupsTest-1343612709 tempest-VolumesBackupsTest-1343612709-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:23.320553 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-af382bb1-6ce2-4eb1-b467-e0e26ffcfa8c tempest-VolumesBackupsTest-1343612709 tempest-VolumesBackupsTest-1343612709-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:23.321319 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-af382bb1-6ce2-4eb1-b467-e0e26ffcfa8c tempest-VolumesBackupsTest-1343612709 tempest-VolumesBackupsTest-1343612709-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:23.321949 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-af382bb1-6ce2-4eb1-b467-e0e26ffcfa8c tempest-VolumesBackupsTest-1343612709 tempest-VolumesBackupsTest-1343612709-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:23.322620 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-af382bb1-6ce2-4eb1-b467-e0e26ffcfa8c tempest-VolumesBackupsTest-1343612709 tempest-VolumesBackupsTest-1343612709-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:23.484022 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-b8b37027-ea0b-40f5-8f1e-c0b2b66f81e1 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:14:23.485504 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-b8b37027-ea0b-40f5-8f1e-c0b2b66f81e1 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] [instance: c05b27d6-ba86-4600-bb33-8d2daeda2094] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:14:23.493432 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b8b37027-ea0b-40f5-8f1e-c0b2b66f81e1 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:23.493963 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b8b37027-ea0b-40f5-8f1e-c0b2b66f81e1 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:23.494369 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b8b37027-ea0b-40f5-8f1e-c0b2b66f81e1 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:23.495835 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b8b37027-ea0b-40f5-8f1e-c0b2b66f81e1 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:23.496322 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b8b37027-ea0b-40f5-8f1e-c0b2b66f81e1 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:23.496795 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b8b37027-ea0b-40f5-8f1e-c0b2b66f81e1 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:23.669012 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-b8b37027-ea0b-40f5-8f1e-c0b2b66f81e1 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799f987b3aa7426ba5d7a464052d6490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87474d4b4c547abbfe6308b6dd8e1c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:14:23.681322 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-b8b37027-ea0b-40f5-8f1e-c0b2b66f81e1 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] 10.222.0.18 "GET /compute/v2.1/servers/c05b27d6-ba86-4600-bb33-8d2daeda2094" status: 200 len: 1267 microversion: 2.1 time: 0.202766 Oct 22 21:14:23.682411 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2375/4760] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:14:23 2022] GET /compute/v2.1/servers/c05b27d6-ba86-4600-bb33-8d2daeda2094 => generated 1267 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:14:23.773031 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-af382bb1-6ce2-4eb1-b467-e0e26ffcfa8c tempest-VolumesBackupsTest-1343612709 tempest-VolumesBackupsTest-1343612709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd25f7d1fb76e4eb5a8af45ff5d61efce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25f382da0674f74ada627cf75ad37d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:14:23.782254 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-af382bb1-6ce2-4eb1-b467-e0e26ffcfa8c tempest-VolumesBackupsTest-1343612709 tempest-VolumesBackupsTest-1343612709-project] 10.222.0.18 "GET /compute/v2.1/servers/6bacb456-9f6a-42a0-9f8b-8374cc17f54a" status: 200 len: 1314 microversion: 2.1 time: 0.476306 Oct 22 21:14:23.782927 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2386/4761] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:14:23 2022] GET /compute/v2.1/servers/6bacb456-9f6a-42a0-9f8b-8374cc17f54a => generated 1314 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:14:24.708096 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-9e54db9e-de27-4f94-a28a-48132bed691c tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:14:24.713155 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-9e54db9e-de27-4f94-a28a-48132bed691c tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] [instance: c05b27d6-ba86-4600-bb33-8d2daeda2094] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:14:24.726005 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9e54db9e-de27-4f94-a28a-48132bed691c tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:24.726005 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9e54db9e-de27-4f94-a28a-48132bed691c tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:24.726005 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9e54db9e-de27-4f94-a28a-48132bed691c tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:24.726005 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9e54db9e-de27-4f94-a28a-48132bed691c tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:24.727211 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9e54db9e-de27-4f94-a28a-48132bed691c tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:24.728086 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9e54db9e-de27-4f94-a28a-48132bed691c tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:24.807501 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-54e7615a-0136-4113-80ac-d0cf267fe7d0 tempest-VolumesBackupsTest-1343612709 tempest-VolumesBackupsTest-1343612709-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:14:24.808405 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-54e7615a-0136-4113-80ac-d0cf267fe7d0 tempest-VolumesBackupsTest-1343612709 tempest-VolumesBackupsTest-1343612709-project] [instance: 6bacb456-9f6a-42a0-9f8b-8374cc17f54a] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:14:24.819809 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-54e7615a-0136-4113-80ac-d0cf267fe7d0 tempest-VolumesBackupsTest-1343612709 tempest-VolumesBackupsTest-1343612709-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:24.820458 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-54e7615a-0136-4113-80ac-d0cf267fe7d0 tempest-VolumesBackupsTest-1343612709 tempest-VolumesBackupsTest-1343612709-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:24.821068 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-54e7615a-0136-4113-80ac-d0cf267fe7d0 tempest-VolumesBackupsTest-1343612709 tempest-VolumesBackupsTest-1343612709-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:24.824459 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-54e7615a-0136-4113-80ac-d0cf267fe7d0 tempest-VolumesBackupsTest-1343612709 tempest-VolumesBackupsTest-1343612709-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:24.825243 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-54e7615a-0136-4113-80ac-d0cf267fe7d0 tempest-VolumesBackupsTest-1343612709 tempest-VolumesBackupsTest-1343612709-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:24.843128 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-54e7615a-0136-4113-80ac-d0cf267fe7d0 tempest-VolumesBackupsTest-1343612709 tempest-VolumesBackupsTest-1343612709-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:24.855054 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:14:25.299498 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-9e54db9e-de27-4f94-a28a-48132bed691c tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799f987b3aa7426ba5d7a464052d6490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87474d4b4c547abbfe6308b6dd8e1c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:14:25.309170 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-9e54db9e-de27-4f94-a28a-48132bed691c tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] 10.222.0.18 "GET /compute/v2.1/servers/c05b27d6-ba86-4600-bb33-8d2daeda2094" status: 200 len: 1309 microversion: 2.1 time: 0.606961 Oct 22 21:14:25.310915 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2376/4762] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:14:24 2022] GET /compute/v2.1/servers/c05b27d6-ba86-4600-bb33-8d2daeda2094 => generated 1309 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:14:25.455900 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-54e7615a-0136-4113-80ac-d0cf267fe7d0 tempest-VolumesBackupsTest-1343612709 tempest-VolumesBackupsTest-1343612709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd25f7d1fb76e4eb5a8af45ff5d61efce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25f382da0674f74ada627cf75ad37d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:14:25.468736 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-54e7615a-0136-4113-80ac-d0cf267fe7d0 tempest-VolumesBackupsTest-1343612709 tempest-VolumesBackupsTest-1343612709-project] 10.222.0.18 "GET /compute/v2.1/servers/6bacb456-9f6a-42a0-9f8b-8374cc17f54a" status: 200 len: 1314 microversion: 2.1 time: 0.666613 Oct 22 21:14:25.470369 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2387/4763] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:14:24 2022] GET /compute/v2.1/servers/6bacb456-9f6a-42a0-9f8b-8374cc17f54a => generated 1314 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:14:25.586345 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-bc6f727a-7e61-4afc-bc73-7698afb80186 req-79a205c8-99a0-4a52-b52e-4d432bf78bad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6bacb456-9f6a-42a0-9f8b-8374cc17f54a", "tag": "b1fd66d8-496a-4dba-85ef-f2f0268abd67"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:14:25.613411 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-bc6f727a-7e61-4afc-bc73-7698afb80186 req-79a205c8-99a0-4a52-b52e-4d432bf78bad service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:25.613954 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-bc6f727a-7e61-4afc-bc73-7698afb80186 req-79a205c8-99a0-4a52-b52e-4d432bf78bad service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:25.615484 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-bc6f727a-7e61-4afc-bc73-7698afb80186 req-79a205c8-99a0-4a52-b52e-4d432bf78bad service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:25.632805 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-bc6f727a-7e61-4afc-bc73-7698afb80186 req-79a205c8-99a0-4a52-b52e-4d432bf78bad service nova] Creating event network-changed:b1fd66d8-496a-4dba-85ef-f2f0268abd67 for instance 6bacb456-9f6a-42a0-9f8b-8374cc17f54a on nch1-master-1 Oct 22 21:14:25.644238 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-bc6f727a-7e61-4afc-bc73-7698afb80186 req-79a205c8-99a0-4a52-b52e-4d432bf78bad service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065383 Oct 22 21:14:25.647286 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2377/4764] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:14:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:14:26.335027 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-eb3889c5-b5df-44b1-a0c8-91265035e3ef tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:14:26.335644 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-eb3889c5-b5df-44b1-a0c8-91265035e3ef tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] [instance: c05b27d6-ba86-4600-bb33-8d2daeda2094] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:14:26.343621 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-eb3889c5-b5df-44b1-a0c8-91265035e3ef tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:26.344130 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-eb3889c5-b5df-44b1-a0c8-91265035e3ef tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:26.344563 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-eb3889c5-b5df-44b1-a0c8-91265035e3ef tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:26.345476 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-eb3889c5-b5df-44b1-a0c8-91265035e3ef tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:26.345953 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-eb3889c5-b5df-44b1-a0c8-91265035e3ef tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:26.346392 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-eb3889c5-b5df-44b1-a0c8-91265035e3ef tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:26.497783 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-7a36508e-6876-4ad3-a353-aa296d5d302e tempest-VolumesBackupsTest-1343612709 tempest-VolumesBackupsTest-1343612709-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:14:26.498739 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-7a36508e-6876-4ad3-a353-aa296d5d302e tempest-VolumesBackupsTest-1343612709 tempest-VolumesBackupsTest-1343612709-project] [instance: 6bacb456-9f6a-42a0-9f8b-8374cc17f54a] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:14:26.505387 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7a36508e-6876-4ad3-a353-aa296d5d302e tempest-VolumesBackupsTest-1343612709 tempest-VolumesBackupsTest-1343612709-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:26.505971 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7a36508e-6876-4ad3-a353-aa296d5d302e tempest-VolumesBackupsTest-1343612709 tempest-VolumesBackupsTest-1343612709-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:26.506442 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7a36508e-6876-4ad3-a353-aa296d5d302e tempest-VolumesBackupsTest-1343612709 tempest-VolumesBackupsTest-1343612709-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:26.507157 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7a36508e-6876-4ad3-a353-aa296d5d302e tempest-VolumesBackupsTest-1343612709 tempest-VolumesBackupsTest-1343612709-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:26.507651 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7a36508e-6876-4ad3-a353-aa296d5d302e tempest-VolumesBackupsTest-1343612709 tempest-VolumesBackupsTest-1343612709-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:26.508138 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7a36508e-6876-4ad3-a353-aa296d5d302e tempest-VolumesBackupsTest-1343612709 tempest-VolumesBackupsTest-1343612709-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:26.995459 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-eb3889c5-b5df-44b1-a0c8-91265035e3ef tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799f987b3aa7426ba5d7a464052d6490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87474d4b4c547abbfe6308b6dd8e1c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:14:27.004975 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-eb3889c5-b5df-44b1-a0c8-91265035e3ef tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] 10.222.0.18 "GET /compute/v2.1/servers/c05b27d6-ba86-4600-bb33-8d2daeda2094" status: 200 len: 1309 microversion: 2.1 time: 0.675383 Oct 22 21:14:27.019785 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2388/4765] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:14:26 2022] GET /compute/v2.1/servers/c05b27d6-ba86-4600-bb33-8d2daeda2094 => generated 1309 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:14:27.119989 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-7a36508e-6876-4ad3-a353-aa296d5d302e tempest-VolumesBackupsTest-1343612709 tempest-VolumesBackupsTest-1343612709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd25f7d1fb76e4eb5a8af45ff5d61efce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25f382da0674f74ada627cf75ad37d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:14:27.129606 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-7a36508e-6876-4ad3-a353-aa296d5d302e tempest-VolumesBackupsTest-1343612709 tempest-VolumesBackupsTest-1343612709-project] 10.222.0.18 "GET /compute/v2.1/servers/6bacb456-9f6a-42a0-9f8b-8374cc17f54a" status: 200 len: 1314 microversion: 2.1 time: 0.637038 Oct 22 21:14:27.130781 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2378/4766] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:14:26 2022] GET /compute/v2.1/servers/6bacb456-9f6a-42a0-9f8b-8374cc17f54a => generated 1314 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:14:27.865359 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-26c2c9cf-5d6b-4580-b1e0-d7f1fd34c0b4 req-0e6ea294-6be5-4292-8e95-f65ea642b4c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c05b27d6-ba86-4600-bb33-8d2daeda2094", "tag": "99c14781-7778-47ae-b534-86ecf7493cef"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:14:27.904174 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-26c2c9cf-5d6b-4580-b1e0-d7f1fd34c0b4 req-0e6ea294-6be5-4292-8e95-f65ea642b4c7 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:27.904810 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-26c2c9cf-5d6b-4580-b1e0-d7f1fd34c0b4 req-0e6ea294-6be5-4292-8e95-f65ea642b4c7 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:27.905639 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-26c2c9cf-5d6b-4580-b1e0-d7f1fd34c0b4 req-0e6ea294-6be5-4292-8e95-f65ea642b4c7 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:27.927618 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-26c2c9cf-5d6b-4580-b1e0-d7f1fd34c0b4 req-0e6ea294-6be5-4292-8e95-f65ea642b4c7 service nova] Creating event network-changed:99c14781-7778-47ae-b534-86ecf7493cef for instance c05b27d6-ba86-4600-bb33-8d2daeda2094 on nch2-master-1 Oct 22 21:14:27.935448 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-26c2c9cf-5d6b-4580-b1e0-d7f1fd34c0b4 req-0e6ea294-6be5-4292-8e95-f65ea642b4c7 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074866 Oct 22 21:14:27.936941 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2389/4767] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:14:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:14:28.030176 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-04c6d651-50de-4a9c-9bcb-7330c0a4b728 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:14:28.030824 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-04c6d651-50de-4a9c-9bcb-7330c0a4b728 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] [instance: c05b27d6-ba86-4600-bb33-8d2daeda2094] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:14:28.038539 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-04c6d651-50de-4a9c-9bcb-7330c0a4b728 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:28.039038 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-04c6d651-50de-4a9c-9bcb-7330c0a4b728 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:28.039696 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-04c6d651-50de-4a9c-9bcb-7330c0a4b728 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:28.040649 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-04c6d651-50de-4a9c-9bcb-7330c0a4b728 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:28.041169 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-04c6d651-50de-4a9c-9bcb-7330c0a4b728 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:28.041639 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-04c6d651-50de-4a9c-9bcb-7330c0a4b728 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:28.157488 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-0bc5f911-56ae-4103-a0b9-24e1a8b7a0e2 tempest-VolumesBackupsTest-1343612709 tempest-VolumesBackupsTest-1343612709-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:14:28.158367 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-0bc5f911-56ae-4103-a0b9-24e1a8b7a0e2 tempest-VolumesBackupsTest-1343612709 tempest-VolumesBackupsTest-1343612709-project] [instance: 6bacb456-9f6a-42a0-9f8b-8374cc17f54a] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:14:28.170593 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0bc5f911-56ae-4103-a0b9-24e1a8b7a0e2 tempest-VolumesBackupsTest-1343612709 tempest-VolumesBackupsTest-1343612709-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:28.171175 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0bc5f911-56ae-4103-a0b9-24e1a8b7a0e2 tempest-VolumesBackupsTest-1343612709 tempest-VolumesBackupsTest-1343612709-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:28.172194 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0bc5f911-56ae-4103-a0b9-24e1a8b7a0e2 tempest-VolumesBackupsTest-1343612709 tempest-VolumesBackupsTest-1343612709-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:28.173248 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0bc5f911-56ae-4103-a0b9-24e1a8b7a0e2 tempest-VolumesBackupsTest-1343612709 tempest-VolumesBackupsTest-1343612709-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:28.175275 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0bc5f911-56ae-4103-a0b9-24e1a8b7a0e2 tempest-VolumesBackupsTest-1343612709 tempest-VolumesBackupsTest-1343612709-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:28.175987 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0bc5f911-56ae-4103-a0b9-24e1a8b7a0e2 tempest-VolumesBackupsTest-1343612709 tempest-VolumesBackupsTest-1343612709-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:28.218236 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-04c6d651-50de-4a9c-9bcb-7330c0a4b728 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799f987b3aa7426ba5d7a464052d6490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87474d4b4c547abbfe6308b6dd8e1c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:14:28.226665 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-04c6d651-50de-4a9c-9bcb-7330c0a4b728 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] 10.222.0.18 "GET /compute/v2.1/servers/c05b27d6-ba86-4600-bb33-8d2daeda2094" status: 200 len: 1309 microversion: 2.1 time: 0.200425 Oct 22 21:14:28.232146 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2379/4768] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:14:28 2022] GET /compute/v2.1/servers/c05b27d6-ba86-4600-bb33-8d2daeda2094 => generated 1309 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:14:28.430534 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-0bc5f911-56ae-4103-a0b9-24e1a8b7a0e2 tempest-VolumesBackupsTest-1343612709 tempest-VolumesBackupsTest-1343612709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd25f7d1fb76e4eb5a8af45ff5d61efce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25f382da0674f74ada627cf75ad37d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:14:28.440124 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-0bc5f911-56ae-4103-a0b9-24e1a8b7a0e2 tempest-VolumesBackupsTest-1343612709 tempest-VolumesBackupsTest-1343612709-project] 10.222.0.18 "GET /compute/v2.1/servers/6bacb456-9f6a-42a0-9f8b-8374cc17f54a" status: 200 len: 1314 microversion: 2.1 time: 0.289350 Oct 22 21:14:28.440723 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2390/4769] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:14:28 2022] GET /compute/v2.1/servers/6bacb456-9f6a-42a0-9f8b-8374cc17f54a => generated 1314 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:14:29.251577 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-4070c062-3428-4a0e-86cf-21eb5090ab6f tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:14:29.252903 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-4070c062-3428-4a0e-86cf-21eb5090ab6f tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] [instance: c05b27d6-ba86-4600-bb33-8d2daeda2094] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:14:29.261616 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4070c062-3428-4a0e-86cf-21eb5090ab6f tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:29.262251 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4070c062-3428-4a0e-86cf-21eb5090ab6f tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:29.262894 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4070c062-3428-4a0e-86cf-21eb5090ab6f tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:29.263633 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4070c062-3428-4a0e-86cf-21eb5090ab6f tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:29.264232 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4070c062-3428-4a0e-86cf-21eb5090ab6f tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:29.264668 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4070c062-3428-4a0e-86cf-21eb5090ab6f tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:29.408353 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-4070c062-3428-4a0e-86cf-21eb5090ab6f tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799f987b3aa7426ba5d7a464052d6490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87474d4b4c547abbfe6308b6dd8e1c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:14:29.416813 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-4070c062-3428-4a0e-86cf-21eb5090ab6f tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] 10.222.0.18 "GET /compute/v2.1/servers/c05b27d6-ba86-4600-bb33-8d2daeda2094" status: 200 len: 1309 microversion: 2.1 time: 0.169351 Oct 22 21:14:29.417550 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2380/4770] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:14:29 2022] GET /compute/v2.1/servers/c05b27d6-ba86-4600-bb33-8d2daeda2094 => generated 1309 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:14:29.465288 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-aacacc8e-b54d-4843-827e-305103f4ad40 tempest-VolumesBackupsTest-1343612709 tempest-VolumesBackupsTest-1343612709-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:14:29.465911 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-aacacc8e-b54d-4843-827e-305103f4ad40 tempest-VolumesBackupsTest-1343612709 tempest-VolumesBackupsTest-1343612709-project] [instance: 6bacb456-9f6a-42a0-9f8b-8374cc17f54a] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:14:29.472979 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-aacacc8e-b54d-4843-827e-305103f4ad40 tempest-VolumesBackupsTest-1343612709 tempest-VolumesBackupsTest-1343612709-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:29.473477 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-aacacc8e-b54d-4843-827e-305103f4ad40 tempest-VolumesBackupsTest-1343612709 tempest-VolumesBackupsTest-1343612709-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:29.473925 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-aacacc8e-b54d-4843-827e-305103f4ad40 tempest-VolumesBackupsTest-1343612709 tempest-VolumesBackupsTest-1343612709-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:29.475900 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-aacacc8e-b54d-4843-827e-305103f4ad40 tempest-VolumesBackupsTest-1343612709 tempest-VolumesBackupsTest-1343612709-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:29.476377 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-aacacc8e-b54d-4843-827e-305103f4ad40 tempest-VolumesBackupsTest-1343612709 tempest-VolumesBackupsTest-1343612709-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:29.476821 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-aacacc8e-b54d-4843-827e-305103f4ad40 tempest-VolumesBackupsTest-1343612709 tempest-VolumesBackupsTest-1343612709-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:29.620481 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-aacacc8e-b54d-4843-827e-305103f4ad40 tempest-VolumesBackupsTest-1343612709 tempest-VolumesBackupsTest-1343612709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd25f7d1fb76e4eb5a8af45ff5d61efce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25f382da0674f74ada627cf75ad37d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:14:29.630606 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-aacacc8e-b54d-4843-827e-305103f4ad40 tempest-VolumesBackupsTest-1343612709 tempest-VolumesBackupsTest-1343612709-project] 10.222.0.18 "GET /compute/v2.1/servers/6bacb456-9f6a-42a0-9f8b-8374cc17f54a" status: 200 len: 1314 microversion: 2.1 time: 0.169072 Oct 22 21:14:29.631676 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2391/4771] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:14:29 2022] GET /compute/v2.1/servers/6bacb456-9f6a-42a0-9f8b-8374cc17f54a => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:14:30.440747 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-5a4563fb-0427-4a01-b585-609410ff936e tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:14:30.441433 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-5a4563fb-0427-4a01-b585-609410ff936e tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] [instance: c05b27d6-ba86-4600-bb33-8d2daeda2094] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:14:30.452376 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5a4563fb-0427-4a01-b585-609410ff936e tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:30.453147 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5a4563fb-0427-4a01-b585-609410ff936e tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:30.455455 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5a4563fb-0427-4a01-b585-609410ff936e tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:30.457173 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5a4563fb-0427-4a01-b585-609410ff936e tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:30.461934 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5a4563fb-0427-4a01-b585-609410ff936e tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:30.463059 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5a4563fb-0427-4a01-b585-609410ff936e tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:30.656047 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-e8fd7a36-a8e3-4b79-85c9-b133f31565ac tempest-VolumesBackupsTest-1343612709 tempest-VolumesBackupsTest-1343612709-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:14:30.657780 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-e8fd7a36-a8e3-4b79-85c9-b133f31565ac tempest-VolumesBackupsTest-1343612709 tempest-VolumesBackupsTest-1343612709-project] [instance: 6bacb456-9f6a-42a0-9f8b-8374cc17f54a] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:14:30.666255 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e8fd7a36-a8e3-4b79-85c9-b133f31565ac tempest-VolumesBackupsTest-1343612709 tempest-VolumesBackupsTest-1343612709-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:30.667002 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e8fd7a36-a8e3-4b79-85c9-b133f31565ac tempest-VolumesBackupsTest-1343612709 tempest-VolumesBackupsTest-1343612709-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:30.667820 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e8fd7a36-a8e3-4b79-85c9-b133f31565ac tempest-VolumesBackupsTest-1343612709 tempest-VolumesBackupsTest-1343612709-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:30.668710 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e8fd7a36-a8e3-4b79-85c9-b133f31565ac tempest-VolumesBackupsTest-1343612709 tempest-VolumesBackupsTest-1343612709-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:30.669180 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e8fd7a36-a8e3-4b79-85c9-b133f31565ac tempest-VolumesBackupsTest-1343612709 tempest-VolumesBackupsTest-1343612709-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:30.669625 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e8fd7a36-a8e3-4b79-85c9-b133f31565ac tempest-VolumesBackupsTest-1343612709 tempest-VolumesBackupsTest-1343612709-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:31.032566 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-5a4563fb-0427-4a01-b585-609410ff936e tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799f987b3aa7426ba5d7a464052d6490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87474d4b4c547abbfe6308b6dd8e1c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:14:31.048002 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-5a4563fb-0427-4a01-b585-609410ff936e tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] 10.222.0.18 "GET /compute/v2.1/servers/c05b27d6-ba86-4600-bb33-8d2daeda2094" status: 200 len: 1309 microversion: 2.1 time: 0.611384 Oct 22 21:14:31.050519 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2381/4772] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:14:30 2022] GET /compute/v2.1/servers/c05b27d6-ba86-4600-bb33-8d2daeda2094 => generated 1309 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:14:31.117313 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell0:SELECT=4 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:14:31.152071 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell0:SELECT=12 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:14:31.248320 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-e8fd7a36-a8e3-4b79-85c9-b133f31565ac tempest-VolumesBackupsTest-1343612709 tempest-VolumesBackupsTest-1343612709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd25f7d1fb76e4eb5a8af45ff5d61efce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25f382da0674f74ada627cf75ad37d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:14:31.260345 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-e8fd7a36-a8e3-4b79-85c9-b133f31565ac tempest-VolumesBackupsTest-1343612709 tempest-VolumesBackupsTest-1343612709-project] 10.222.0.18 "GET /compute/v2.1/servers/6bacb456-9f6a-42a0-9f8b-8374cc17f54a" status: 200 len: 1314 microversion: 2.1 time: 0.609746 Oct 22 21:14:31.261914 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2392/4773] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:14:30 2022] GET /compute/v2.1/servers/6bacb456-9f6a-42a0-9f8b-8374cc17f54a => generated 1314 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:14:32.077393 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-313256f9-30ad-4f5d-ba00-6cbf14321df5 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:14:32.078898 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-313256f9-30ad-4f5d-ba00-6cbf14321df5 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] [instance: c05b27d6-ba86-4600-bb33-8d2daeda2094] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:14:32.082895 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell0:SELECT=4 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:14:32.090188 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-313256f9-30ad-4f5d-ba00-6cbf14321df5 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:32.090836 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-313256f9-30ad-4f5d-ba00-6cbf14321df5 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:32.091333 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-313256f9-30ad-4f5d-ba00-6cbf14321df5 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:32.092421 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-313256f9-30ad-4f5d-ba00-6cbf14321df5 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:32.092968 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-313256f9-30ad-4f5d-ba00-6cbf14321df5 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:32.093416 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-313256f9-30ad-4f5d-ba00-6cbf14321df5 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:32.286628 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-5b72fc7e-83b3-4753-ae82-72beee1d47e7 tempest-VolumesBackupsTest-1343612709 tempest-VolumesBackupsTest-1343612709-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:14:32.288550 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-5b72fc7e-83b3-4753-ae82-72beee1d47e7 tempest-VolumesBackupsTest-1343612709 tempest-VolumesBackupsTest-1343612709-project] [instance: 6bacb456-9f6a-42a0-9f8b-8374cc17f54a] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:14:32.300524 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5b72fc7e-83b3-4753-ae82-72beee1d47e7 tempest-VolumesBackupsTest-1343612709 tempest-VolumesBackupsTest-1343612709-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:32.301404 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5b72fc7e-83b3-4753-ae82-72beee1d47e7 tempest-VolumesBackupsTest-1343612709 tempest-VolumesBackupsTest-1343612709-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:32.302423 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5b72fc7e-83b3-4753-ae82-72beee1d47e7 tempest-VolumesBackupsTest-1343612709 tempest-VolumesBackupsTest-1343612709-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:32.304033 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5b72fc7e-83b3-4753-ae82-72beee1d47e7 tempest-VolumesBackupsTest-1343612709 tempest-VolumesBackupsTest-1343612709-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:32.304856 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5b72fc7e-83b3-4753-ae82-72beee1d47e7 tempest-VolumesBackupsTest-1343612709 tempest-VolumesBackupsTest-1343612709-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:32.305670 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5b72fc7e-83b3-4753-ae82-72beee1d47e7 tempest-VolumesBackupsTest-1343612709 tempest-VolumesBackupsTest-1343612709-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:32.458863 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-313256f9-30ad-4f5d-ba00-6cbf14321df5 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799f987b3aa7426ba5d7a464052d6490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87474d4b4c547abbfe6308b6dd8e1c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:14:32.471620 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-313256f9-30ad-4f5d-ba00-6cbf14321df5 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] 10.222.0.18 "GET /compute/v2.1/servers/c05b27d6-ba86-4600-bb33-8d2daeda2094" status: 200 len: 1309 microversion: 2.1 time: 0.400993 Oct 22 21:14:32.472859 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2382/4774] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:14:32 2022] GET /compute/v2.1/servers/c05b27d6-ba86-4600-bb33-8d2daeda2094 => generated 1309 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:14:32.636721 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-5b72fc7e-83b3-4753-ae82-72beee1d47e7 tempest-VolumesBackupsTest-1343612709 tempest-VolumesBackupsTest-1343612709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd25f7d1fb76e4eb5a8af45ff5d61efce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25f382da0674f74ada627cf75ad37d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:14:32.645539 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-5b72fc7e-83b3-4753-ae82-72beee1d47e7 tempest-VolumesBackupsTest-1343612709 tempest-VolumesBackupsTest-1343612709-project] 10.222.0.18 "GET /compute/v2.1/servers/6bacb456-9f6a-42a0-9f8b-8374cc17f54a" status: 200 len: 1314 microversion: 2.1 time: 0.365208 Oct 22 21:14:32.646341 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2393/4775] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:14:32 2022] GET /compute/v2.1/servers/6bacb456-9f6a-42a0-9f8b-8374cc17f54a => generated 1314 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:14:33.448877 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-8c2ee8ae-8dba-47d0-9ad7-6a7029d9bfe1 req-3bab22f2-109c-4d04-998b-1818a266e4df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6bacb456-9f6a-42a0-9f8b-8374cc17f54a", "name": "network-vif-plugged", "status": "completed", "tag": "b1fd66d8-496a-4dba-85ef-f2f0268abd67"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:14:33.469063 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-8c2ee8ae-8dba-47d0-9ad7-6a7029d9bfe1 req-3bab22f2-109c-4d04-998b-1818a266e4df service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:33.474707 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-8c2ee8ae-8dba-47d0-9ad7-6a7029d9bfe1 req-3bab22f2-109c-4d04-998b-1818a266e4df service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:33.476342 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-8c2ee8ae-8dba-47d0-9ad7-6a7029d9bfe1 req-3bab22f2-109c-4d04-998b-1818a266e4df service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:33.501797 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-985ac692-d312-497b-b9c5-0790b43752c1 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:14:33.503095 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-985ac692-d312-497b-b9c5-0790b43752c1 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] [instance: c05b27d6-ba86-4600-bb33-8d2daeda2094] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:14:33.518815 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-8c2ee8ae-8dba-47d0-9ad7-6a7029d9bfe1 req-3bab22f2-109c-4d04-998b-1818a266e4df service nova] Creating event network-vif-plugged:b1fd66d8-496a-4dba-85ef-f2f0268abd67 for instance 6bacb456-9f6a-42a0-9f8b-8374cc17f54a on nch1-master-1 Oct 22 21:14:33.527493 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-985ac692-d312-497b-b9c5-0790b43752c1 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:33.528380 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-985ac692-d312-497b-b9c5-0790b43752c1 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:33.530533 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-985ac692-d312-497b-b9c5-0790b43752c1 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:33.533087 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-985ac692-d312-497b-b9c5-0790b43752c1 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:33.533839 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-985ac692-d312-497b-b9c5-0790b43752c1 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:33.534514 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-985ac692-d312-497b-b9c5-0790b43752c1 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:33.539925 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-8c2ee8ae-8dba-47d0-9ad7-6a7029d9bfe1 req-3bab22f2-109c-4d04-998b-1818a266e4df service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092947 Oct 22 21:14:33.543309 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2383/4776] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:14:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:14:33.674457 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-e1589db6-43f8-4dc5-8c7a-8877b0445ac3 tempest-VolumesBackupsTest-1343612709 tempest-VolumesBackupsTest-1343612709-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:14:33.675449 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-e1589db6-43f8-4dc5-8c7a-8877b0445ac3 tempest-VolumesBackupsTest-1343612709 tempest-VolumesBackupsTest-1343612709-project] [instance: 6bacb456-9f6a-42a0-9f8b-8374cc17f54a] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:14:33.687459 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e1589db6-43f8-4dc5-8c7a-8877b0445ac3 tempest-VolumesBackupsTest-1343612709 tempest-VolumesBackupsTest-1343612709-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:33.688555 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e1589db6-43f8-4dc5-8c7a-8877b0445ac3 tempest-VolumesBackupsTest-1343612709 tempest-VolumesBackupsTest-1343612709-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:33.689930 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e1589db6-43f8-4dc5-8c7a-8877b0445ac3 tempest-VolumesBackupsTest-1343612709 tempest-VolumesBackupsTest-1343612709-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:33.692268 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e1589db6-43f8-4dc5-8c7a-8877b0445ac3 tempest-VolumesBackupsTest-1343612709 tempest-VolumesBackupsTest-1343612709-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:33.693314 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e1589db6-43f8-4dc5-8c7a-8877b0445ac3 tempest-VolumesBackupsTest-1343612709 tempest-VolumesBackupsTest-1343612709-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:33.694435 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e1589db6-43f8-4dc5-8c7a-8877b0445ac3 tempest-VolumesBackupsTest-1343612709 tempest-VolumesBackupsTest-1343612709-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:34.338043 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-985ac692-d312-497b-b9c5-0790b43752c1 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799f987b3aa7426ba5d7a464052d6490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87474d4b4c547abbfe6308b6dd8e1c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:14:34.349759 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-985ac692-d312-497b-b9c5-0790b43752c1 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] 10.222.0.18 "GET /compute/v2.1/servers/c05b27d6-ba86-4600-bb33-8d2daeda2094" status: 200 len: 1309 microversion: 2.1 time: 0.852504 Oct 22 21:14:34.350848 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2394/4777] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:14:33 2022] GET /compute/v2.1/servers/c05b27d6-ba86-4600-bb33-8d2daeda2094 => generated 1309 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:14:34.409499 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-e1589db6-43f8-4dc5-8c7a-8877b0445ac3 tempest-VolumesBackupsTest-1343612709 tempest-VolumesBackupsTest-1343612709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd25f7d1fb76e4eb5a8af45ff5d61efce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25f382da0674f74ada627cf75ad37d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:14:34.419795 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-e1589db6-43f8-4dc5-8c7a-8877b0445ac3 tempest-VolumesBackupsTest-1343612709 tempest-VolumesBackupsTest-1343612709-project] 10.222.0.18 "GET /compute/v2.1/servers/6bacb456-9f6a-42a0-9f8b-8374cc17f54a" status: 200 len: 1314 microversion: 2.1 time: 0.750692 Oct 22 21:14:34.420641 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2384/4778] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:14:33 2022] GET /compute/v2.1/servers/6bacb456-9f6a-42a0-9f8b-8374cc17f54a => generated 1314 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:14:35.374079 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-66062094-e4fc-47b9-b08e-3d8a597f34de tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:14:35.374705 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-66062094-e4fc-47b9-b08e-3d8a597f34de tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] [instance: c05b27d6-ba86-4600-bb33-8d2daeda2094] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:14:35.388421 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-66062094-e4fc-47b9-b08e-3d8a597f34de tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:35.388958 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-66062094-e4fc-47b9-b08e-3d8a597f34de tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:35.389414 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-66062094-e4fc-47b9-b08e-3d8a597f34de tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:35.390388 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-66062094-e4fc-47b9-b08e-3d8a597f34de tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:35.390860 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-66062094-e4fc-47b9-b08e-3d8a597f34de tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:35.391307 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-66062094-e4fc-47b9-b08e-3d8a597f34de tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:35.445839 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-525ab695-abc7-42e9-ba76-dfe8e14893e1 tempest-VolumesBackupsTest-1343612709 tempest-VolumesBackupsTest-1343612709-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:14:35.446691 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-525ab695-abc7-42e9-ba76-dfe8e14893e1 tempest-VolumesBackupsTest-1343612709 tempest-VolumesBackupsTest-1343612709-project] [instance: 6bacb456-9f6a-42a0-9f8b-8374cc17f54a] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:14:35.455611 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-525ab695-abc7-42e9-ba76-dfe8e14893e1 tempest-VolumesBackupsTest-1343612709 tempest-VolumesBackupsTest-1343612709-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:35.456148 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-525ab695-abc7-42e9-ba76-dfe8e14893e1 tempest-VolumesBackupsTest-1343612709 tempest-VolumesBackupsTest-1343612709-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:35.456625 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-525ab695-abc7-42e9-ba76-dfe8e14893e1 tempest-VolumesBackupsTest-1343612709 tempest-VolumesBackupsTest-1343612709-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:35.457577 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-525ab695-abc7-42e9-ba76-dfe8e14893e1 tempest-VolumesBackupsTest-1343612709 tempest-VolumesBackupsTest-1343612709-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:35.457908 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-525ab695-abc7-42e9-ba76-dfe8e14893e1 tempest-VolumesBackupsTest-1343612709 tempest-VolumesBackupsTest-1343612709-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:35.459209 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-525ab695-abc7-42e9-ba76-dfe8e14893e1 tempest-VolumesBackupsTest-1343612709 tempest-VolumesBackupsTest-1343612709-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:35.611616 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-66062094-e4fc-47b9-b08e-3d8a597f34de tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799f987b3aa7426ba5d7a464052d6490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87474d4b4c547abbfe6308b6dd8e1c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:14:35.629405 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-66062094-e4fc-47b9-b08e-3d8a597f34de tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] 10.222.0.18 "GET /compute/v2.1/servers/c05b27d6-ba86-4600-bb33-8d2daeda2094" status: 200 len: 1309 microversion: 2.1 time: 0.259252 Oct 22 21:14:35.630173 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2395/4779] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:14:35 2022] GET /compute/v2.1/servers/c05b27d6-ba86-4600-bb33-8d2daeda2094 => generated 1309 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:14:35.636333 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-283b524e-ee12-499d-9c2b-1c16ab382e78 req-5d6b2f2e-14b2-4ad8-bb11-2b78e35c2773 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c05b27d6-ba86-4600-bb33-8d2daeda2094", "name": "network-vif-plugged", "status": "completed", "tag": "99c14781-7778-47ae-b534-86ecf7493cef"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:14:35.648494 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-283b524e-ee12-499d-9c2b-1c16ab382e78 req-5d6b2f2e-14b2-4ad8-bb11-2b78e35c2773 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:35.648993 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-283b524e-ee12-499d-9c2b-1c16ab382e78 req-5d6b2f2e-14b2-4ad8-bb11-2b78e35c2773 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:35.649442 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-283b524e-ee12-499d-9c2b-1c16ab382e78 req-5d6b2f2e-14b2-4ad8-bb11-2b78e35c2773 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:35.666222 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-283b524e-ee12-499d-9c2b-1c16ab382e78 req-5d6b2f2e-14b2-4ad8-bb11-2b78e35c2773 service nova] Creating event network-vif-plugged:99c14781-7778-47ae-b534-86ecf7493cef for instance c05b27d6-ba86-4600-bb33-8d2daeda2094 on nch2-master-1 Oct 22 21:14:35.672296 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-283b524e-ee12-499d-9c2b-1c16ab382e78 req-5d6b2f2e-14b2-4ad8-bb11-2b78e35c2773 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040056 Oct 22 21:14:35.676172 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2396/4780] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:14:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:14:35.684775 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-525ab695-abc7-42e9-ba76-dfe8e14893e1 tempest-VolumesBackupsTest-1343612709 tempest-VolumesBackupsTest-1343612709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd25f7d1fb76e4eb5a8af45ff5d61efce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25f382da0674f74ada627cf75ad37d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:14:35.694170 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-525ab695-abc7-42e9-ba76-dfe8e14893e1 tempest-VolumesBackupsTest-1343612709 tempest-VolumesBackupsTest-1343612709-project] 10.222.0.18 "GET /compute/v2.1/servers/6bacb456-9f6a-42a0-9f8b-8374cc17f54a" status: 200 len: 1314 microversion: 2.1 time: 0.253918 Oct 22 21:14:35.694993 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2385/4781] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:14:35 2022] GET /compute/v2.1/servers/6bacb456-9f6a-42a0-9f8b-8374cc17f54a => generated 1314 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:14:36.656494 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-5c3bc534-70f3-449a-8bff-7651d7394983 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:14:36.657336 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-5c3bc534-70f3-449a-8bff-7651d7394983 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] [instance: c05b27d6-ba86-4600-bb33-8d2daeda2094] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:14:36.665146 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5c3bc534-70f3-449a-8bff-7651d7394983 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:36.665962 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5c3bc534-70f3-449a-8bff-7651d7394983 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:36.666412 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5c3bc534-70f3-449a-8bff-7651d7394983 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:36.667146 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5c3bc534-70f3-449a-8bff-7651d7394983 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:36.667632 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5c3bc534-70f3-449a-8bff-7651d7394983 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:36.668057 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5c3bc534-70f3-449a-8bff-7651d7394983 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:36.721525 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-8ce1efed-8ec0-4334-bef8-92059b9a92c2 tempest-VolumesBackupsTest-1343612709 tempest-VolumesBackupsTest-1343612709-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:14:36.722062 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-8ce1efed-8ec0-4334-bef8-92059b9a92c2 tempest-VolumesBackupsTest-1343612709 tempest-VolumesBackupsTest-1343612709-project] [instance: 6bacb456-9f6a-42a0-9f8b-8374cc17f54a] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:14:36.733652 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8ce1efed-8ec0-4334-bef8-92059b9a92c2 tempest-VolumesBackupsTest-1343612709 tempest-VolumesBackupsTest-1343612709-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:36.734324 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8ce1efed-8ec0-4334-bef8-92059b9a92c2 tempest-VolumesBackupsTest-1343612709 tempest-VolumesBackupsTest-1343612709-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:36.734790 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8ce1efed-8ec0-4334-bef8-92059b9a92c2 tempest-VolumesBackupsTest-1343612709 tempest-VolumesBackupsTest-1343612709-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:36.735514 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8ce1efed-8ec0-4334-bef8-92059b9a92c2 tempest-VolumesBackupsTest-1343612709 tempest-VolumesBackupsTest-1343612709-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:36.736531 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8ce1efed-8ec0-4334-bef8-92059b9a92c2 tempest-VolumesBackupsTest-1343612709 tempest-VolumesBackupsTest-1343612709-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:36.737123 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8ce1efed-8ec0-4334-bef8-92059b9a92c2 tempest-VolumesBackupsTest-1343612709 tempest-VolumesBackupsTest-1343612709-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:36.898908 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-5c3bc534-70f3-449a-8bff-7651d7394983 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799f987b3aa7426ba5d7a464052d6490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87474d4b4c547abbfe6308b6dd8e1c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:14:36.917743 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-5c3bc534-70f3-449a-8bff-7651d7394983 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] 10.222.0.18 "GET /compute/v2.1/servers/c05b27d6-ba86-4600-bb33-8d2daeda2094" status: 200 len: 1309 microversion: 2.1 time: 0.265294 Oct 22 21:14:36.918420 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2397/4782] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:14:36 2022] GET /compute/v2.1/servers/c05b27d6-ba86-4600-bb33-8d2daeda2094 => generated 1309 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:14:36.976608 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-8ce1efed-8ec0-4334-bef8-92059b9a92c2 tempest-VolumesBackupsTest-1343612709 tempest-VolumesBackupsTest-1343612709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd25f7d1fb76e4eb5a8af45ff5d61efce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25f382da0674f74ada627cf75ad37d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:14:36.979479 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:14:36.988948 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-8ce1efed-8ec0-4334-bef8-92059b9a92c2 tempest-VolumesBackupsTest-1343612709 tempest-VolumesBackupsTest-1343612709-project] 10.222.0.18 "GET /compute/v2.1/servers/6bacb456-9f6a-42a0-9f8b-8374cc17f54a" status: 200 len: 1463 microversion: 2.1 time: 0.272154 Oct 22 21:14:36.990015 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2386/4783] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:14:36 2022] GET /compute/v2.1/servers/6bacb456-9f6a-42a0-9f8b-8374cc17f54a => generated 1463 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:14:37.013426 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-ceee0496-838c-4ef5-b367-ccab3557c6b0 tempest-VolumesBackupsTest-1343612709 tempest-VolumesBackupsTest-1343612709-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "52f315b5-455c-4987-8ca7-2e5d415d5ad2", "device": "/dev/sdb"}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:14:37.017236 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-ceee0496-838c-4ef5-b367-ccab3557c6b0 tempest-VolumesBackupsTest-1343612709 tempest-VolumesBackupsTest-1343612709-project] [instance: 6bacb456-9f6a-42a0-9f8b-8374cc17f54a] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:14:37.024117 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ceee0496-838c-4ef5-b367-ccab3557c6b0 tempest-VolumesBackupsTest-1343612709 tempest-VolumesBackupsTest-1343612709-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:37.025156 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ceee0496-838c-4ef5-b367-ccab3557c6b0 tempest-VolumesBackupsTest-1343612709 tempest-VolumesBackupsTest-1343612709-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:37.025664 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ceee0496-838c-4ef5-b367-ccab3557c6b0 tempest-VolumesBackupsTest-1343612709 tempest-VolumesBackupsTest-1343612709-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:37.026884 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ceee0496-838c-4ef5-b367-ccab3557c6b0 tempest-VolumesBackupsTest-1343612709 tempest-VolumesBackupsTest-1343612709-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:37.027547 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ceee0496-838c-4ef5-b367-ccab3557c6b0 tempest-VolumesBackupsTest-1343612709 tempest-VolumesBackupsTest-1343612709-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:37.028185 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ceee0496-838c-4ef5-b367-ccab3557c6b0 tempest-VolumesBackupsTest-1343612709 tempest-VolumesBackupsTest-1343612709-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:37.388866 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-ceee0496-838c-4ef5-b367-ccab3557c6b0 tempest-VolumesBackupsTest-1343612709 tempest-VolumesBackupsTest-1343612709-project] 10.222.0.18 "POST /compute/v2.1/servers/6bacb456-9f6a-42a0-9f8b-8374cc17f54a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.379106 Oct 22 21:14:37.390019 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2398/4784] 10.222.0.18 () {60 vars in 1323 bytes} [Sat Oct 22 21:14:37 2022] POST /compute/v2.1/servers/6bacb456-9f6a-42a0-9f8b-8374cc17f54a/os-volume_attachments => generated 194 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 21:14:37.943608 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-e3e5dc8c-6b1d-43fa-b381-95a46229b907 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:14:37.944978 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-e3e5dc8c-6b1d-43fa-b381-95a46229b907 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] [instance: c05b27d6-ba86-4600-bb33-8d2daeda2094] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:14:37.959738 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e3e5dc8c-6b1d-43fa-b381-95a46229b907 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:37.960418 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e3e5dc8c-6b1d-43fa-b381-95a46229b907 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:37.961064 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e3e5dc8c-6b1d-43fa-b381-95a46229b907 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:37.962120 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e3e5dc8c-6b1d-43fa-b381-95a46229b907 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:37.962784 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e3e5dc8c-6b1d-43fa-b381-95a46229b907 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:37.963388 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e3e5dc8c-6b1d-43fa-b381-95a46229b907 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:38.056702 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-3e2e0eb7-8184-4435-8813-e22da0bedee5 tempest-TestVolumeBackupRestore-2071196610 tempest-TestVolumeBackupRestore-2071196610-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:14:38.058172 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-3e2e0eb7-8184-4435-8813-e22da0bedee5 tempest-TestVolumeBackupRestore-2071196610 tempest-TestVolumeBackupRestore-2071196610-project] [instance: 77705065-40b2-4fba-8cf9-def4abeae0e4] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:14:38.073939 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3e2e0eb7-8184-4435-8813-e22da0bedee5 tempest-TestVolumeBackupRestore-2071196610 tempest-TestVolumeBackupRestore-2071196610-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:38.074903 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3e2e0eb7-8184-4435-8813-e22da0bedee5 tempest-TestVolumeBackupRestore-2071196610 tempest-TestVolumeBackupRestore-2071196610-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:38.075599 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3e2e0eb7-8184-4435-8813-e22da0bedee5 tempest-TestVolumeBackupRestore-2071196610 tempest-TestVolumeBackupRestore-2071196610-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:38.076535 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3e2e0eb7-8184-4435-8813-e22da0bedee5 tempest-TestVolumeBackupRestore-2071196610 tempest-TestVolumeBackupRestore-2071196610-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:38.077419 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3e2e0eb7-8184-4435-8813-e22da0bedee5 tempest-TestVolumeBackupRestore-2071196610 tempest-TestVolumeBackupRestore-2071196610-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:38.078111 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3e2e0eb7-8184-4435-8813-e22da0bedee5 tempest-TestVolumeBackupRestore-2071196610 tempest-TestVolumeBackupRestore-2071196610-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:38.118527 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-3e2e0eb7-8184-4435-8813-e22da0bedee5 tempest-TestVolumeBackupRestore-2071196610 tempest-TestVolumeBackupRestore-2071196610-project] [instance: 77705065-40b2-4fba-8cf9-def4abeae0e4] Going to try to terminate instance {{(pid=138745) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 21:14:38.179622 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-e3e5dc8c-6b1d-43fa-b381-95a46229b907 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799f987b3aa7426ba5d7a464052d6490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87474d4b4c547abbfe6308b6dd8e1c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:14:38.194178 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-e3e5dc8c-6b1d-43fa-b381-95a46229b907 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] 10.222.0.18 "GET /compute/v2.1/servers/c05b27d6-ba86-4600-bb33-8d2daeda2094" status: 200 len: 1490 microversion: 2.1 time: 0.255164 Oct 22 21:14:38.206738 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2387/4785] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:14:37 2022] GET /compute/v2.1/servers/c05b27d6-ba86-4600-bb33-8d2daeda2094 => generated 1490 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:14:38.260314 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-4de7aa57-349a-4d23-83b0-589cffcb03b1 req-f786935d-49c1-40ef-973e-c5c44d8e4dcc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77705065-40b2-4fba-8cf9-def4abeae0e4", "tag": "77793879-ddc1-4a27-89fe-4f5537f05251"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:14:38.264941 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-3e2e0eb7-8184-4435-8813-e22da0bedee5 tempest-TestVolumeBackupRestore-2071196610 tempest-TestVolumeBackupRestore-2071196610-project] 10.222.0.18 "DELETE /compute/v2.1/servers/77705065-40b2-4fba-8cf9-def4abeae0e4" status: 204 len: 0 microversion: 2.1 time: 0.215359 Oct 22 21:14:38.268703 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2399/4786] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 21:14:38 2022] DELETE /compute/v2.1/servers/77705065-40b2-4fba-8cf9-def4abeae0e4 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 22 21:14:38.286819 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-52bb4013-1a0c-4349-8e98-d13218f58340 tempest-TestVolumeBackupRestore-2071196610 tempest-TestVolumeBackupRestore-2071196610-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:14:38.288882 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-52bb4013-1a0c-4349-8e98-d13218f58340 tempest-TestVolumeBackupRestore-2071196610 tempest-TestVolumeBackupRestore-2071196610-project] [instance: 77705065-40b2-4fba-8cf9-def4abeae0e4] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:14:38.310605 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-4de7aa57-349a-4d23-83b0-589cffcb03b1 req-f786935d-49c1-40ef-973e-c5c44d8e4dcc service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:38.311308 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-4de7aa57-349a-4d23-83b0-589cffcb03b1 req-f786935d-49c1-40ef-973e-c5c44d8e4dcc service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:38.313909 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-52bb4013-1a0c-4349-8e98-d13218f58340 tempest-TestVolumeBackupRestore-2071196610 tempest-TestVolumeBackupRestore-2071196610-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:38.314237 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-4de7aa57-349a-4d23-83b0-589cffcb03b1 req-f786935d-49c1-40ef-973e-c5c44d8e4dcc service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:38.314859 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-52bb4013-1a0c-4349-8e98-d13218f58340 tempest-TestVolumeBackupRestore-2071196610 tempest-TestVolumeBackupRestore-2071196610-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:38.316604 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-52bb4013-1a0c-4349-8e98-d13218f58340 tempest-TestVolumeBackupRestore-2071196610 tempest-TestVolumeBackupRestore-2071196610-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:38.322108 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-52bb4013-1a0c-4349-8e98-d13218f58340 tempest-TestVolumeBackupRestore-2071196610 tempest-TestVolumeBackupRestore-2071196610-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:38.322108 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-52bb4013-1a0c-4349-8e98-d13218f58340 tempest-TestVolumeBackupRestore-2071196610 tempest-TestVolumeBackupRestore-2071196610-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:38.322108 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-52bb4013-1a0c-4349-8e98-d13218f58340 tempest-TestVolumeBackupRestore-2071196610 tempest-TestVolumeBackupRestore-2071196610-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:38.357482 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-4de7aa57-349a-4d23-83b0-589cffcb03b1 req-f786935d-49c1-40ef-973e-c5c44d8e4dcc service nova] Creating event network-changed:77793879-ddc1-4a27-89fe-4f5537f05251 for instance 77705065-40b2-4fba-8cf9-def4abeae0e4 on nch2-master-1 Oct 22 21:14:38.381534 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-4de7aa57-349a-4d23-83b0-589cffcb03b1 req-f786935d-49c1-40ef-973e-c5c44d8e4dcc service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.162416 Oct 22 21:14:38.384728 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2388/4787] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:14:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:14:38.473161 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-3b29a050-30df-4dec-b14f-1f84b3ab1e12 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1728901193", "imageRef": "085e4478-6edc-4a69-8e08-f9831713eb65", "flavorRef": "452", "networks": [{"uuid": "ea7e3c31-2bc2-4b4f-ab48-7d75cccdd3b0"}]}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:14:38.549980 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.network.neutron [None req-3b29a050-30df-4dec-b14f-1f84b3ab1e12 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] validate_networks() for [('ea7e3c31-2bc2-4b4f-ab48-7d75cccdd3b0', None, None, None, None, None)] {{(pid=138744) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 21:14:38.714383 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-52bb4013-1a0c-4349-8e98-d13218f58340 tempest-TestVolumeBackupRestore-2071196610 tempest-TestVolumeBackupRestore-2071196610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4464172f8d43a986f7de04724a8d52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba71430f3dc046f68faab18103ba9007', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:14:38.730551 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-52bb4013-1a0c-4349-8e98-d13218f58340 tempest-TestVolumeBackupRestore-2071196610 tempest-TestVolumeBackupRestore-2071196610-project] 10.222.0.18 "GET /compute/v2.1/servers/77705065-40b2-4fba-8cf9-def4abeae0e4" status: 200 len: 1583 microversion: 2.1 time: 0.452320 Oct 22 21:14:38.732394 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2400/4788] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:14:38 2022] GET /compute/v2.1/servers/77705065-40b2-4fba-8cf9-def4abeae0e4 => generated 1583 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:14:39.125410 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-3b29a050-30df-4dec-b14f-1f84b3ab1e12 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Flavor limits 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 21:14:39.127406 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-3b29a050-30df-4dec-b14f-1f84b3ab1e12 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Image limits 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 21:14:39.129157 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-3b29a050-30df-4dec-b14f-1f84b3ab1e12 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Flavor pref 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 21:14:39.131150 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-3b29a050-30df-4dec-b14f-1f84b3ab1e12 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Image pref 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 21:14:39.133929 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-3b29a050-30df-4dec-b14f-1f84b3ab1e12 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 21:14:39.152323 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3b29a050-30df-4dec-b14f-1f84b3ab1e12 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:39.153105 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3b29a050-30df-4dec-b14f-1f84b3ab1e12 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:39.153621 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3b29a050-30df-4dec-b14f-1f84b3ab1e12 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:39.154748 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3b29a050-30df-4dec-b14f-1f84b3ab1e12 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:39.155661 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3b29a050-30df-4dec-b14f-1f84b3ab1e12 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:39.156953 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3b29a050-30df-4dec-b14f-1f84b3ab1e12 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:39.185573 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-3b29a050-30df-4dec-b14f-1f84b3ab1e12 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Getting quotas for project e87474d4b4c547abbfe6308b6dd8e1c8. Resources: {'cores', 'instances', 'ram'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 21:14:39.192395 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-3b29a050-30df-4dec-b14f-1f84b3ab1e12 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Getting quotas for user 799f987b3aa7426ba5d7a464052d6490 and project e87474d4b4c547abbfe6308b6dd8e1c8. Resources: {'cores', 'instances', 'ram'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 21:14:39.212435 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-3b29a050-30df-4dec-b14f-1f84b3ab1e12 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Going to run 1 instances... {{(pid=138744) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 21:14:39.215137 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-3b29a050-30df-4dec-b14f-1f84b3ab1e12 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] [instance: 6404fc61-0c84-4fab-9557-cefbd8e6da63] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='085e4478-6edc-4a69-8e08-f9831713eb65',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138744) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 21:14:39.275565 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-3b29a050-30df-4dec-b14f-1f84b3ab1e12 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.808274 Oct 22 21:14:39.277165 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2389/4789] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Oct 22 21:14:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 811 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 21:14:39.289782 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-a3db7e39-71ed-4454-bb23-0292d6980f54 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:14:39.294503 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-a3db7e39-71ed-4454-bb23-0292d6980f54 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] [instance: 6404fc61-0c84-4fab-9557-cefbd8e6da63] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:14:39.298589 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_api:SELECT=91,nova_api:DELETE=2,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:14:39.386512 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-a3db7e39-71ed-4454-bb23-0292d6980f54 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799f987b3aa7426ba5d7a464052d6490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87474d4b4c547abbfe6308b6dd8e1c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:14:39.403114 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-a3db7e39-71ed-4454-bb23-0292d6980f54 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] 10.222.0.18 "GET /compute/v2.1/servers/6404fc61-0c84-4fab-9557-cefbd8e6da63" status: 200 len: 1209 microversion: 2.1 time: 0.117569 Oct 22 21:14:39.405656 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2401/4790] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:14:39 2022] GET /compute/v2.1/servers/6404fc61-0c84-4fab-9557-cefbd8e6da63 => generated 1209 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:14:39.758644 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-e527ce05-07b9-4009-978c-81436e80feb0 tempest-TestVolumeBackupRestore-2071196610 tempest-TestVolumeBackupRestore-2071196610-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:14:39.760082 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-e527ce05-07b9-4009-978c-81436e80feb0 tempest-TestVolumeBackupRestore-2071196610 tempest-TestVolumeBackupRestore-2071196610-project] [instance: 77705065-40b2-4fba-8cf9-def4abeae0e4] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:14:39.770621 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e527ce05-07b9-4009-978c-81436e80feb0 tempest-TestVolumeBackupRestore-2071196610 tempest-TestVolumeBackupRestore-2071196610-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:39.772079 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e527ce05-07b9-4009-978c-81436e80feb0 tempest-TestVolumeBackupRestore-2071196610 tempest-TestVolumeBackupRestore-2071196610-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:39.772569 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e527ce05-07b9-4009-978c-81436e80feb0 tempest-TestVolumeBackupRestore-2071196610 tempest-TestVolumeBackupRestore-2071196610-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:39.774265 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e527ce05-07b9-4009-978c-81436e80feb0 tempest-TestVolumeBackupRestore-2071196610 tempest-TestVolumeBackupRestore-2071196610-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:39.775018 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e527ce05-07b9-4009-978c-81436e80feb0 tempest-TestVolumeBackupRestore-2071196610 tempest-TestVolumeBackupRestore-2071196610-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:39.775612 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e527ce05-07b9-4009-978c-81436e80feb0 tempest-TestVolumeBackupRestore-2071196610 tempest-TestVolumeBackupRestore-2071196610-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:40.206603 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-e527ce05-07b9-4009-978c-81436e80feb0 tempest-TestVolumeBackupRestore-2071196610 tempest-TestVolumeBackupRestore-2071196610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4464172f8d43a986f7de04724a8d52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba71430f3dc046f68faab18103ba9007', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:14:40.215186 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-e527ce05-07b9-4009-978c-81436e80feb0 tempest-TestVolumeBackupRestore-2071196610 tempest-TestVolumeBackupRestore-2071196610-project] 10.222.0.18 "GET /compute/v2.1/servers/77705065-40b2-4fba-8cf9-def4abeae0e4" status: 200 len: 1583 microversion: 2.1 time: 0.462613 Oct 22 21:14:40.232375 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2390/4791] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:14:39 2022] GET /compute/v2.1/servers/77705065-40b2-4fba-8cf9-def4abeae0e4 => generated 1583 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:14:40.430830 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-e9df632c-9ae4-48c8-a4bb-57187c50e451 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:14:40.431772 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-e9df632c-9ae4-48c8-a4bb-57187c50e451 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] [instance: 6404fc61-0c84-4fab-9557-cefbd8e6da63] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:14:40.443605 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e9df632c-9ae4-48c8-a4bb-57187c50e451 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:40.444244 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e9df632c-9ae4-48c8-a4bb-57187c50e451 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:40.444922 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e9df632c-9ae4-48c8-a4bb-57187c50e451 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:40.445757 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e9df632c-9ae4-48c8-a4bb-57187c50e451 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:40.446597 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e9df632c-9ae4-48c8-a4bb-57187c50e451 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:40.447612 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e9df632c-9ae4-48c8-a4bb-57187c50e451 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:40.570807 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-e9df632c-9ae4-48c8-a4bb-57187c50e451 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799f987b3aa7426ba5d7a464052d6490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87474d4b4c547abbfe6308b6dd8e1c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:14:40.580521 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-e9df632c-9ae4-48c8-a4bb-57187c50e451 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] 10.222.0.18 "GET /compute/v2.1/servers/6404fc61-0c84-4fab-9557-cefbd8e6da63" status: 200 len: 1261 microversion: 2.1 time: 0.155032 Oct 22 21:14:40.581353 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2402/4792] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:14:40 2022] GET /compute/v2.1/servers/6404fc61-0c84-4fab-9557-cefbd8e6da63 => generated 1261 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:14:41.240970 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-96c3440d-a464-424d-8474-9156ecf8d928 tempest-TestVolumeBackupRestore-2071196610 tempest-TestVolumeBackupRestore-2071196610-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:14:41.242105 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-96c3440d-a464-424d-8474-9156ecf8d928 tempest-TestVolumeBackupRestore-2071196610 tempest-TestVolumeBackupRestore-2071196610-project] [instance: 77705065-40b2-4fba-8cf9-def4abeae0e4] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:14:41.253558 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-96c3440d-a464-424d-8474-9156ecf8d928 tempest-TestVolumeBackupRestore-2071196610 tempest-TestVolumeBackupRestore-2071196610-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:41.254296 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-96c3440d-a464-424d-8474-9156ecf8d928 tempest-TestVolumeBackupRestore-2071196610 tempest-TestVolumeBackupRestore-2071196610-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:41.255120 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-96c3440d-a464-424d-8474-9156ecf8d928 tempest-TestVolumeBackupRestore-2071196610 tempest-TestVolumeBackupRestore-2071196610-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:41.256323 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-96c3440d-a464-424d-8474-9156ecf8d928 tempest-TestVolumeBackupRestore-2071196610 tempest-TestVolumeBackupRestore-2071196610-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:41.257401 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-96c3440d-a464-424d-8474-9156ecf8d928 tempest-TestVolumeBackupRestore-2071196610 tempest-TestVolumeBackupRestore-2071196610-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:41.257992 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-96c3440d-a464-424d-8474-9156ecf8d928 tempest-TestVolumeBackupRestore-2071196610 tempest-TestVolumeBackupRestore-2071196610-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:41.265129 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:14:41.363747 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-7917da1c-2971-4477-a44a-6f734dda404b req-e4535925-91e1-466c-a1da-501b3bb663e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77705065-40b2-4fba-8cf9-def4abeae0e4", "name": "network-vif-deleted", "tag": "77793879-ddc1-4a27-89fe-4f5537f05251"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:14:41.390213 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-7917da1c-2971-4477-a44a-6f734dda404b req-e4535925-91e1-466c-a1da-501b3bb663e7 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:41.391086 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-7917da1c-2971-4477-a44a-6f734dda404b req-e4535925-91e1-466c-a1da-501b3bb663e7 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:41.393687 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-7917da1c-2971-4477-a44a-6f734dda404b req-e4535925-91e1-466c-a1da-501b3bb663e7 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:41.407751 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-96c3440d-a464-424d-8474-9156ecf8d928 tempest-TestVolumeBackupRestore-2071196610 tempest-TestVolumeBackupRestore-2071196610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4464172f8d43a986f7de04724a8d52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba71430f3dc046f68faab18103ba9007', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:14:41.415465 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-7917da1c-2971-4477-a44a-6f734dda404b req-e4535925-91e1-466c-a1da-501b3bb663e7 service nova] Creating event network-vif-deleted:77793879-ddc1-4a27-89fe-4f5537f05251 for instance 77705065-40b2-4fba-8cf9-def4abeae0e4 on nch2-master-1 Oct 22 21:14:41.420784 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-96c3440d-a464-424d-8474-9156ecf8d928 tempest-TestVolumeBackupRestore-2071196610 tempest-TestVolumeBackupRestore-2071196610-project] 10.222.0.18 "GET /compute/v2.1/servers/77705065-40b2-4fba-8cf9-def4abeae0e4" status: 200 len: 1229 microversion: 2.1 time: 0.185389 Oct 22 21:14:41.421716 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2403/4793] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:14:41 2022] GET /compute/v2.1/servers/77705065-40b2-4fba-8cf9-def4abeae0e4 => generated 1229 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:14:41.427259 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-7917da1c-2971-4477-a44a-6f734dda404b req-e4535925-91e1-466c-a1da-501b3bb663e7 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.544147 Oct 22 21:14:41.428647 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2391/4794] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:14:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:14:41.604817 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-774742b3-2cc9-4293-b6e6-1db55e85b89b tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:14:41.606252 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-774742b3-2cc9-4293-b6e6-1db55e85b89b tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] [instance: 6404fc61-0c84-4fab-9557-cefbd8e6da63] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:14:41.612780 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-774742b3-2cc9-4293-b6e6-1db55e85b89b tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:41.613317 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-774742b3-2cc9-4293-b6e6-1db55e85b89b tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:41.613736 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-774742b3-2cc9-4293-b6e6-1db55e85b89b tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:41.614641 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-774742b3-2cc9-4293-b6e6-1db55e85b89b tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:41.615294 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-774742b3-2cc9-4293-b6e6-1db55e85b89b tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:41.615900 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-774742b3-2cc9-4293-b6e6-1db55e85b89b tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:41.721294 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-774742b3-2cc9-4293-b6e6-1db55e85b89b tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799f987b3aa7426ba5d7a464052d6490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87474d4b4c547abbfe6308b6dd8e1c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:14:41.735076 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-774742b3-2cc9-4293-b6e6-1db55e85b89b tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] 10.222.0.18 "GET /compute/v2.1/servers/6404fc61-0c84-4fab-9557-cefbd8e6da63" status: 200 len: 1267 microversion: 2.1 time: 0.133765 Oct 22 21:14:41.736552 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2404/4795] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:14:41 2022] GET /compute/v2.1/servers/6404fc61-0c84-4fab-9557-cefbd8e6da63 => generated 1267 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:14:42.449791 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-a8b9d5f1-e4a6-404a-8506-9a08320b08ad tempest-TestVolumeBackupRestore-2071196610 tempest-TestVolumeBackupRestore-2071196610-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:14:42.450532 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-a8b9d5f1-e4a6-404a-8506-9a08320b08ad tempest-TestVolumeBackupRestore-2071196610 tempest-TestVolumeBackupRestore-2071196610-project] [instance: 77705065-40b2-4fba-8cf9-def4abeae0e4] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:14:42.459043 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a8b9d5f1-e4a6-404a-8506-9a08320b08ad tempest-TestVolumeBackupRestore-2071196610 tempest-TestVolumeBackupRestore-2071196610-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:42.459793 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a8b9d5f1-e4a6-404a-8506-9a08320b08ad tempest-TestVolumeBackupRestore-2071196610 tempest-TestVolumeBackupRestore-2071196610-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:42.460689 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a8b9d5f1-e4a6-404a-8506-9a08320b08ad tempest-TestVolumeBackupRestore-2071196610 tempest-TestVolumeBackupRestore-2071196610-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:42.461677 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a8b9d5f1-e4a6-404a-8506-9a08320b08ad tempest-TestVolumeBackupRestore-2071196610 tempest-TestVolumeBackupRestore-2071196610-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:42.462349 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a8b9d5f1-e4a6-404a-8506-9a08320b08ad tempest-TestVolumeBackupRestore-2071196610 tempest-TestVolumeBackupRestore-2071196610-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:42.462955 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a8b9d5f1-e4a6-404a-8506-9a08320b08ad tempest-TestVolumeBackupRestore-2071196610 tempest-TestVolumeBackupRestore-2071196610-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:42.482154 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-a8b9d5f1-e4a6-404a-8506-9a08320b08ad tempest-TestVolumeBackupRestore-2071196610 tempest-TestVolumeBackupRestore-2071196610-project] HTTP exception thrown: Instance 77705065-40b2-4fba-8cf9-def4abeae0e4 could not be found. Oct 22 21:14:42.484383 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-a8b9d5f1-e4a6-404a-8506-9a08320b08ad tempest-TestVolumeBackupRestore-2071196610 tempest-TestVolumeBackupRestore-2071196610-project] Request method failure captured: Oct 22 21:14:42.484383 ncdv-master-1 devstack@n-api.service[138744]: request: GET /compute/v2.1/servers/77705065-40b2-4fba-8cf9-def4abeae0e4 HTTP/1.1 Oct 22 21:14:42.484383 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 21:14:42.484383 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 21:14:42.484383 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 21:14:42.484383 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 0 Oct 22 21:14:42.484383 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 21:14:42.484383 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 21:14:42.484383 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 21:14:42.484383 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 21:14:42.484383 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVFzGKd8MYTLXcqpKLxiZFX2X1IdkRVvJnHzfPPSM9arD1j9g-HdbP6ro1H2cbygqDBq50RWmNakQ2zgBPyLe9aifxFCtJg_YwnWu9JtZmi-Fxxkqo3CNBvbPUhb0QgmCpILeJIsF__4AEBYW2jhadc6YaUvqixk-2ljenuGyuFiuh_4 Oct 22 21:14:42.484383 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 21:14:42.484383 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 21:14:42.484383 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 21:14:42.484383 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 21:14:42.484383 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 21:14:42.484383 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 21:14:42.484383 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: ba71430f3dc046f68faab18103ba9007 Oct 22 21:14:42.484383 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-TestVolumeBackupRestore-2071196610 Oct 22 21:14:42.484383 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 21:14:42.484383 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 21:14:42.484383 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ba71430f3dc046f68faab18103ba9007"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ba71430f3dc046f68faab18103ba9007"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ba71430f3dc046f68faab18103ba9007"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ba71430f3dc046f68faab18103ba9007"}]}] Oct 22 21:14:42.484383 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-TestVolumeBackupRestore-2071196610 Oct 22 21:14:42.484383 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: ba71430f3dc046f68faab18103ba9007 Oct 22 21:14:42.484383 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-TestVolumeBackupRestore-2071196610 Oct 22 21:14:42.484383 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-TestVolumeBackupRestore-2071196610-project Oct 22 21:14:42.484383 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 21:14:42.484383 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 21:14:42.484383 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: cb4464172f8d43a986f7de04724a8d52 Oct 22 21:14:42.484383 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-TestVolumeBackupRestore-2071196610-project Oct 22 21:14:42.484383 ncdv-master-1 devstack@n-api.service[138744]: method: > Oct 22 21:14:42.484383 ncdv-master-1 devstack@n-api.service[138744]: exception: Instance 77705065-40b2-4fba-8cf9-def4abeae0e4 could not be found. Oct 22 21:14:42.484383 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': '77705065-40b2-4fba-8cf9-def4abeae0e4'} Oct 22 21:14:42.484383 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:14:42.484383 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:14:42.484383 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 21:14:42.484383 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 21:14:42.484383 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 21:14:42.484383 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 21:14:42.484383 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 21:14:42.484383 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 21:14:42.484383 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 21:14:42.484383 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 21:14:42.484383 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 77705065-40b2-4fba-8cf9-def4abeae0e4 could not be found. Oct 22 21:14:42.484383 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:14:42.484383 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:14:42.484383 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:14:42.484383 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:14:42.484383 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:14:42.484383 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:14:42.484383 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:14:42.484383 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:14:42.484383 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:14:42.484383 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:14:42.484383 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 21:14:42.484383 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 21:14:42.484383 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 21:14:42.484383 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 21:14:42.484383 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 21:14:42.484383 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:14:42.484383 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 77705065-40b2-4fba-8cf9-def4abeae0e4 could not be found. Oct 22 21:14:42.484383 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:14:42.484383 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:14:42.484383 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:14:42.487825 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:14:42.487825 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:14:42.487825 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:14:42.487825 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:14:42.487825 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:14:42.487825 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 77705065-40b2-4fba-8cf9-def4abeae0e4 could not be found. Oct 22 21:14:42.487825 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:14:42.490136 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-a8b9d5f1-e4a6-404a-8506-9a08320b08ad tempest-TestVolumeBackupRestore-2071196610 tempest-TestVolumeBackupRestore-2071196610-project] Returning 404 to user: Instance 77705065-40b2-4fba-8cf9-def4abeae0e4 could not be found. {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:14:42.491232 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-a8b9d5f1-e4a6-404a-8506-9a08320b08ad tempest-TestVolumeBackupRestore-2071196610 tempest-TestVolumeBackupRestore-2071196610-project] 10.222.0.18 "GET /compute/v2.1/servers/77705065-40b2-4fba-8cf9-def4abeae0e4" status: 404 len: 111 microversion: 2.1 time: 0.049431 Oct 22 21:14:42.495692 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2392/4796] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:14:42 2022] GET /compute/v2.1/servers/77705065-40b2-4fba-8cf9-def4abeae0e4 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 21:14:42.770212 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-7b9ec56b-cd0a-46e4-bb93-575582e9f2b8 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:14:42.771054 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-7b9ec56b-cd0a-46e4-bb93-575582e9f2b8 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] [instance: 6404fc61-0c84-4fab-9557-cefbd8e6da63] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:14:42.780761 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7b9ec56b-cd0a-46e4-bb93-575582e9f2b8 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:42.781517 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7b9ec56b-cd0a-46e4-bb93-575582e9f2b8 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:42.782180 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7b9ec56b-cd0a-46e4-bb93-575582e9f2b8 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:42.783546 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7b9ec56b-cd0a-46e4-bb93-575582e9f2b8 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:42.784389 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7b9ec56b-cd0a-46e4-bb93-575582e9f2b8 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:42.785280 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7b9ec56b-cd0a-46e4-bb93-575582e9f2b8 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:42.800889 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-c48d6f42-7481-4cc9-a837-91ac54a229e2 tempest-TestVolumeBackupRestore-2071196610 tempest-TestVolumeBackupRestore-2071196610-project] Calling method '.version_select at 0x7fd39ecfd8b0>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:14:42.845186 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-c48d6f42-7481-4cc9-a837-91ac54a229e2 tempest-TestVolumeBackupRestore-2071196610 tempest-TestVolumeBackupRestore-2071196610-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-1818971266" status: 202 len: 0 microversion: 2.1 time: 0.048394 Oct 22 21:14:42.846528 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2393/4797] 10.222.0.18 () {58 vars in 1269 bytes} [Sat Oct 22 21:14:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-1818971266 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 22 21:14:43.103514 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-7b9ec56b-cd0a-46e4-bb93-575582e9f2b8 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799f987b3aa7426ba5d7a464052d6490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87474d4b4c547abbfe6308b6dd8e1c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:14:43.119357 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-7b9ec56b-cd0a-46e4-bb93-575582e9f2b8 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] 10.222.0.18 "GET /compute/v2.1/servers/6404fc61-0c84-4fab-9557-cefbd8e6da63" status: 200 len: 1309 microversion: 2.1 time: 0.360039 Oct 22 21:14:43.120452 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2405/4798] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:14:42 2022] GET /compute/v2.1/servers/6404fc61-0c84-4fab-9557-cefbd8e6da63 => generated 1309 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:14:43.483070 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-e241a549-b51a-42c0-838f-d17633046427 req-f8fce31a-2788-4c03-b539-5e7783e4adf9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6404fc61-0c84-4fab-9557-cefbd8e6da63", "tag": "6f56403c-835c-4238-b6a5-ef1992a6a5ee"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:14:43.495284 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-e241a549-b51a-42c0-838f-d17633046427 req-f8fce31a-2788-4c03-b539-5e7783e4adf9 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:43.495900 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-e241a549-b51a-42c0-838f-d17633046427 req-f8fce31a-2788-4c03-b539-5e7783e4adf9 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:43.496539 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-e241a549-b51a-42c0-838f-d17633046427 req-f8fce31a-2788-4c03-b539-5e7783e4adf9 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:43.508252 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-e241a549-b51a-42c0-838f-d17633046427 req-f8fce31a-2788-4c03-b539-5e7783e4adf9 service nova] Creating event network-changed:6f56403c-835c-4238-b6a5-ef1992a6a5ee for instance 6404fc61-0c84-4fab-9557-cefbd8e6da63 on nch2-master-1 Oct 22 21:14:43.514749 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-e241a549-b51a-42c0-838f-d17633046427 req-f8fce31a-2788-4c03-b539-5e7783e4adf9 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036439 Oct 22 21:14:43.515403 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2394/4799] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:14:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:14:44.143574 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-9878adb2-cfb7-4f97-8030-9efd5753d432 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:14:44.144785 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-9878adb2-cfb7-4f97-8030-9efd5753d432 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] [instance: 6404fc61-0c84-4fab-9557-cefbd8e6da63] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:14:44.159202 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9878adb2-cfb7-4f97-8030-9efd5753d432 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:44.159979 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9878adb2-cfb7-4f97-8030-9efd5753d432 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:44.160595 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9878adb2-cfb7-4f97-8030-9efd5753d432 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:44.162026 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9878adb2-cfb7-4f97-8030-9efd5753d432 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:44.163167 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9878adb2-cfb7-4f97-8030-9efd5753d432 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:44.163931 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9878adb2-cfb7-4f97-8030-9efd5753d432 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:44.402509 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-9878adb2-cfb7-4f97-8030-9efd5753d432 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799f987b3aa7426ba5d7a464052d6490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87474d4b4c547abbfe6308b6dd8e1c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:14:44.409797 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-9878adb2-cfb7-4f97-8030-9efd5753d432 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] 10.222.0.18 "GET /compute/v2.1/servers/6404fc61-0c84-4fab-9557-cefbd8e6da63" status: 200 len: 1309 microversion: 2.1 time: 0.271184 Oct 22 21:14:44.410701 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2406/4800] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:14:44 2022] GET /compute/v2.1/servers/6404fc61-0c84-4fab-9557-cefbd8e6da63 => generated 1309 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:14:45.434272 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-de28c755-83f8-4e30-97ca-01e2b19b660f tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:14:45.436191 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-de28c755-83f8-4e30-97ca-01e2b19b660f tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] [instance: 6404fc61-0c84-4fab-9557-cefbd8e6da63] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:14:45.451397 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-de28c755-83f8-4e30-97ca-01e2b19b660f tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:45.452992 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-de28c755-83f8-4e30-97ca-01e2b19b660f tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:45.453443 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-de28c755-83f8-4e30-97ca-01e2b19b660f tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:45.454188 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-de28c755-83f8-4e30-97ca-01e2b19b660f tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:45.454655 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-de28c755-83f8-4e30-97ca-01e2b19b660f tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:45.455100 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-de28c755-83f8-4e30-97ca-01e2b19b660f tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:45.904827 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-de28c755-83f8-4e30-97ca-01e2b19b660f tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799f987b3aa7426ba5d7a464052d6490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87474d4b4c547abbfe6308b6dd8e1c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:14:45.913200 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-de28c755-83f8-4e30-97ca-01e2b19b660f tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] 10.222.0.18 "GET /compute/v2.1/servers/6404fc61-0c84-4fab-9557-cefbd8e6da63" status: 200 len: 1309 microversion: 2.1 time: 0.483360 Oct 22 21:14:45.913910 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2395/4801] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:14:45 2022] GET /compute/v2.1/servers/6404fc61-0c84-4fab-9557-cefbd8e6da63 => generated 1309 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:14:46.938122 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-565c7290-932e-4dcf-bba8-a8b919538431 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:14:46.938783 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-565c7290-932e-4dcf-bba8-a8b919538431 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] [instance: 6404fc61-0c84-4fab-9557-cefbd8e6da63] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:14:46.950487 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-565c7290-932e-4dcf-bba8-a8b919538431 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:46.951189 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-565c7290-932e-4dcf-bba8-a8b919538431 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:46.951850 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-565c7290-932e-4dcf-bba8-a8b919538431 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:46.952771 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-565c7290-932e-4dcf-bba8-a8b919538431 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:46.953448 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-565c7290-932e-4dcf-bba8-a8b919538431 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:46.954081 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-565c7290-932e-4dcf-bba8-a8b919538431 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:47.196326 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-565c7290-932e-4dcf-bba8-a8b919538431 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799f987b3aa7426ba5d7a464052d6490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87474d4b4c547abbfe6308b6dd8e1c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:14:47.209367 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-565c7290-932e-4dcf-bba8-a8b919538431 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] 10.222.0.18 "GET /compute/v2.1/servers/6404fc61-0c84-4fab-9557-cefbd8e6da63" status: 200 len: 1309 microversion: 2.1 time: 0.274408 Oct 22 21:14:47.227435 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2407/4802] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:14:46 2022] GET /compute/v2.1/servers/6404fc61-0c84-4fab-9557-cefbd8e6da63 => generated 1309 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:14:47.571865 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-6384d683-af58-40fd-9c4b-ff1144f0065a tempest-VolumesBackupsTest-1343612709 tempest-VolumesBackupsTest-1343612709-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:14:47.573094 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-6384d683-af58-40fd-9c4b-ff1144f0065a tempest-VolumesBackupsTest-1343612709 tempest-VolumesBackupsTest-1343612709-project] [instance: 6bacb456-9f6a-42a0-9f8b-8374cc17f54a] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:14:47.580031 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6384d683-af58-40fd-9c4b-ff1144f0065a tempest-VolumesBackupsTest-1343612709 tempest-VolumesBackupsTest-1343612709-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:47.580524 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6384d683-af58-40fd-9c4b-ff1144f0065a tempest-VolumesBackupsTest-1343612709 tempest-VolumesBackupsTest-1343612709-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:47.580967 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6384d683-af58-40fd-9c4b-ff1144f0065a tempest-VolumesBackupsTest-1343612709 tempest-VolumesBackupsTest-1343612709-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:47.581672 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6384d683-af58-40fd-9c4b-ff1144f0065a tempest-VolumesBackupsTest-1343612709 tempest-VolumesBackupsTest-1343612709-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:47.582127 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6384d683-af58-40fd-9c4b-ff1144f0065a tempest-VolumesBackupsTest-1343612709 tempest-VolumesBackupsTest-1343612709-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:47.582552 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6384d683-af58-40fd-9c4b-ff1144f0065a tempest-VolumesBackupsTest-1343612709 tempest-VolumesBackupsTest-1343612709-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:47.677054 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.objects.instance [None req-6384d683-af58-40fd-9c4b-ff1144f0065a tempest-VolumesBackupsTest-1343612709 tempest-VolumesBackupsTest-1343612709-project] Lazy-loading 'services' on Instance uuid 6bacb456-9f6a-42a0-9f8b-8374cc17f54a {{(pid=138744) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 21:14:47.779485 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-6384d683-af58-40fd-9c4b-ff1144f0065a tempest-VolumesBackupsTest-1343612709 tempest-VolumesBackupsTest-1343612709-project] 10.222.0.18 "DELETE /compute/v2.1/servers/6bacb456-9f6a-42a0-9f8b-8374cc17f54a/os-volume_attachments/52f315b5-455c-4987-8ca7-2e5d415d5ad2" status: 202 len: 0 microversion: 2.1 time: 0.211554 Oct 22 21:14:47.780086 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2396/4803] 10.222.0.18 () {58 vars in 1416 bytes} [Sat Oct 22 21:14:47 2022] DELETE /compute/v2.1/servers/6bacb456-9f6a-42a0-9f8b-8374cc17f54a/os-volume_attachments/52f315b5-455c-4987-8ca7-2e5d415d5ad2 => generated 0 bytes in 213 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 22 21:14:48.234198 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-e11d31cc-44d6-4ea5-8250-dc40f8e1f832 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:14:48.234859 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-e11d31cc-44d6-4ea5-8250-dc40f8e1f832 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] [instance: 6404fc61-0c84-4fab-9557-cefbd8e6da63] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:14:48.245381 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e11d31cc-44d6-4ea5-8250-dc40f8e1f832 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:48.246112 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e11d31cc-44d6-4ea5-8250-dc40f8e1f832 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:48.246566 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e11d31cc-44d6-4ea5-8250-dc40f8e1f832 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:48.247461 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e11d31cc-44d6-4ea5-8250-dc40f8e1f832 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:48.248068 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e11d31cc-44d6-4ea5-8250-dc40f8e1f832 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:48.248647 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e11d31cc-44d6-4ea5-8250-dc40f8e1f832 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:48.549883 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-e11d31cc-44d6-4ea5-8250-dc40f8e1f832 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799f987b3aa7426ba5d7a464052d6490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87474d4b4c547abbfe6308b6dd8e1c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:14:48.565516 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-e11d31cc-44d6-4ea5-8250-dc40f8e1f832 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] 10.222.0.18 "GET /compute/v2.1/servers/6404fc61-0c84-4fab-9557-cefbd8e6da63" status: 200 len: 1309 microversion: 2.1 time: 0.335101 Oct 22 21:14:48.566786 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2408/4804] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:14:48 2022] GET /compute/v2.1/servers/6404fc61-0c84-4fab-9557-cefbd8e6da63 => generated 1309 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:14:49.146503 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-2c9a50be-e430-4a47-82eb-89dce70ee531 req-a5628a7e-f3df-4bf9-9f28-efec4f2f9245 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6404fc61-0c84-4fab-9557-cefbd8e6da63", "name": "network-vif-plugged", "status": "completed", "tag": "6f56403c-835c-4238-b6a5-ef1992a6a5ee"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:14:49.183794 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell0:SELECT=2 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:14:49.186552 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:14:49.203055 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell0:SELECT=6 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:14:49.206457 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-2c9a50be-e430-4a47-82eb-89dce70ee531 req-a5628a7e-f3df-4bf9-9f28-efec4f2f9245 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:49.211733 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-2c9a50be-e430-4a47-82eb-89dce70ee531 req-a5628a7e-f3df-4bf9-9f28-efec4f2f9245 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:49.212228 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-2c9a50be-e430-4a47-82eb-89dce70ee531 req-a5628a7e-f3df-4bf9-9f28-efec4f2f9245 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:49.239192 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-2c9a50be-e430-4a47-82eb-89dce70ee531 req-a5628a7e-f3df-4bf9-9f28-efec4f2f9245 service nova] Creating event network-vif-plugged:6f56403c-835c-4238-b6a5-ef1992a6a5ee for instance 6404fc61-0c84-4fab-9557-cefbd8e6da63 on nch2-master-1 Oct 22 21:14:49.245461 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-2c9a50be-e430-4a47-82eb-89dce70ee531 req-a5628a7e-f3df-4bf9-9f28-efec4f2f9245 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109582 Oct 22 21:14:49.246040 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2397/4805] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:14:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:14:49.595254 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-b18a2e4a-004c-45b3-9346-28178e8b6349 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:14:49.595929 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-b18a2e4a-004c-45b3-9346-28178e8b6349 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] [instance: 6404fc61-0c84-4fab-9557-cefbd8e6da63] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:14:49.599093 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell0:SELECT=2 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:14:49.609580 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b18a2e4a-004c-45b3-9346-28178e8b6349 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:49.611112 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b18a2e4a-004c-45b3-9346-28178e8b6349 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:49.612626 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b18a2e4a-004c-45b3-9346-28178e8b6349 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:49.613230 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b18a2e4a-004c-45b3-9346-28178e8b6349 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:49.613711 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b18a2e4a-004c-45b3-9346-28178e8b6349 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:49.616157 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b18a2e4a-004c-45b3-9346-28178e8b6349 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:49.836655 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-b18a2e4a-004c-45b3-9346-28178e8b6349 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799f987b3aa7426ba5d7a464052d6490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87474d4b4c547abbfe6308b6dd8e1c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:14:49.846709 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-b18a2e4a-004c-45b3-9346-28178e8b6349 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] 10.222.0.18 "GET /compute/v2.1/servers/6404fc61-0c84-4fab-9557-cefbd8e6da63" status: 200 len: 1309 microversion: 2.1 time: 0.256739 Oct 22 21:14:49.847537 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2409/4806] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:14:49 2022] GET /compute/v2.1/servers/6404fc61-0c84-4fab-9557-cefbd8e6da63 => generated 1309 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:14:50.125717 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-a4745464-80c5-4631-a486-30b30cffede1 tempest-VolumesBackupsTest-1343612709 tempest-VolumesBackupsTest-1343612709-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:14:50.126830 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-a4745464-80c5-4631-a486-30b30cffede1 tempest-VolumesBackupsTest-1343612709 tempest-VolumesBackupsTest-1343612709-project] [instance: 6bacb456-9f6a-42a0-9f8b-8374cc17f54a] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:14:50.140288 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a4745464-80c5-4631-a486-30b30cffede1 tempest-VolumesBackupsTest-1343612709 tempest-VolumesBackupsTest-1343612709-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:50.140907 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a4745464-80c5-4631-a486-30b30cffede1 tempest-VolumesBackupsTest-1343612709 tempest-VolumesBackupsTest-1343612709-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:50.142736 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a4745464-80c5-4631-a486-30b30cffede1 tempest-VolumesBackupsTest-1343612709 tempest-VolumesBackupsTest-1343612709-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:50.144941 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a4745464-80c5-4631-a486-30b30cffede1 tempest-VolumesBackupsTest-1343612709 tempest-VolumesBackupsTest-1343612709-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:50.145637 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a4745464-80c5-4631-a486-30b30cffede1 tempest-VolumesBackupsTest-1343612709 tempest-VolumesBackupsTest-1343612709-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:50.146707 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a4745464-80c5-4631-a486-30b30cffede1 tempest-VolumesBackupsTest-1343612709 tempest-VolumesBackupsTest-1343612709-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:50.198241 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-a4745464-80c5-4631-a486-30b30cffede1 tempest-VolumesBackupsTest-1343612709 tempest-VolumesBackupsTest-1343612709-project] [instance: 6bacb456-9f6a-42a0-9f8b-8374cc17f54a] Going to try to terminate instance {{(pid=138744) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 21:14:50.319878 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-a4745464-80c5-4631-a486-30b30cffede1 tempest-VolumesBackupsTest-1343612709 tempest-VolumesBackupsTest-1343612709-project] 10.222.0.18 "DELETE /compute/v2.1/servers/6bacb456-9f6a-42a0-9f8b-8374cc17f54a" status: 204 len: 0 microversion: 2.1 time: 0.199131 Oct 22 21:14:50.324046 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2398/4807] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 21:14:50 2022] DELETE /compute/v2.1/servers/6bacb456-9f6a-42a0-9f8b-8374cc17f54a => generated 0 bytes in 202 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 21:14:50.343127 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-6b912f41-3b0b-443f-a2b8-a45c7c363445 tempest-VolumesBackupsTest-1343612709 tempest-VolumesBackupsTest-1343612709-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:14:50.344199 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-6b912f41-3b0b-443f-a2b8-a45c7c363445 tempest-VolumesBackupsTest-1343612709 tempest-VolumesBackupsTest-1343612709-project] [instance: 6bacb456-9f6a-42a0-9f8b-8374cc17f54a] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:14:50.352258 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6b912f41-3b0b-443f-a2b8-a45c7c363445 tempest-VolumesBackupsTest-1343612709 tempest-VolumesBackupsTest-1343612709-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:50.352938 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6b912f41-3b0b-443f-a2b8-a45c7c363445 tempest-VolumesBackupsTest-1343612709 tempest-VolumesBackupsTest-1343612709-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:50.353627 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6b912f41-3b0b-443f-a2b8-a45c7c363445 tempest-VolumesBackupsTest-1343612709 tempest-VolumesBackupsTest-1343612709-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:50.354706 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6b912f41-3b0b-443f-a2b8-a45c7c363445 tempest-VolumesBackupsTest-1343612709 tempest-VolumesBackupsTest-1343612709-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:50.355771 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6b912f41-3b0b-443f-a2b8-a45c7c363445 tempest-VolumesBackupsTest-1343612709 tempest-VolumesBackupsTest-1343612709-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:50.356419 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6b912f41-3b0b-443f-a2b8-a45c7c363445 tempest-VolumesBackupsTest-1343612709 tempest-VolumesBackupsTest-1343612709-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:50.590176 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-6b912f41-3b0b-443f-a2b8-a45c7c363445 tempest-VolumesBackupsTest-1343612709 tempest-VolumesBackupsTest-1343612709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd25f7d1fb76e4eb5a8af45ff5d61efce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25f382da0674f74ada627cf75ad37d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:14:50.600733 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-6b912f41-3b0b-443f-a2b8-a45c7c363445 tempest-VolumesBackupsTest-1343612709 tempest-VolumesBackupsTest-1343612709-project] 10.222.0.18 "GET /compute/v2.1/servers/6bacb456-9f6a-42a0-9f8b-8374cc17f54a" status: 200 len: 1469 microversion: 2.1 time: 0.274297 Oct 22 21:14:50.606346 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2410/4808] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:14:50 2022] GET /compute/v2.1/servers/6bacb456-9f6a-42a0-9f8b-8374cc17f54a => generated 1469 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:14:50.875720 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-bafab8de-71a7-4678-a3cb-5728bf862669 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:14:50.876557 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-bafab8de-71a7-4678-a3cb-5728bf862669 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] [instance: 6404fc61-0c84-4fab-9557-cefbd8e6da63] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:14:50.883601 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bafab8de-71a7-4678-a3cb-5728bf862669 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:50.884207 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bafab8de-71a7-4678-a3cb-5728bf862669 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:50.884886 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bafab8de-71a7-4678-a3cb-5728bf862669 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:50.885841 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bafab8de-71a7-4678-a3cb-5728bf862669 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:50.886436 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bafab8de-71a7-4678-a3cb-5728bf862669 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:50.886966 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bafab8de-71a7-4678-a3cb-5728bf862669 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:51.044833 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-bafab8de-71a7-4678-a3cb-5728bf862669 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799f987b3aa7426ba5d7a464052d6490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87474d4b4c547abbfe6308b6dd8e1c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:14:51.053790 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-bafab8de-71a7-4678-a3cb-5728bf862669 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] 10.222.0.18 "GET /compute/v2.1/servers/6404fc61-0c84-4fab-9557-cefbd8e6da63" status: 200 len: 1490 microversion: 2.1 time: 0.182693 Oct 22 21:14:51.054370 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2399/4809] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:14:50 2022] GET /compute/v2.1/servers/6404fc61-0c84-4fab-9557-cefbd8e6da63 => generated 1490 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:14:51.078347 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-9d1666f3-c474-4422-8249-ad45a1aa293a tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:14:51.079081 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-9d1666f3-c474-4422-8249-ad45a1aa293a tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] [instance: c05b27d6-ba86-4600-bb33-8d2daeda2094] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:14:51.088232 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9d1666f3-c474-4422-8249-ad45a1aa293a tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:51.088843 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9d1666f3-c474-4422-8249-ad45a1aa293a tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:51.089649 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9d1666f3-c474-4422-8249-ad45a1aa293a tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:51.090866 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9d1666f3-c474-4422-8249-ad45a1aa293a tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:51.091376 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9d1666f3-c474-4422-8249-ad45a1aa293a tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:51.092133 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9d1666f3-c474-4422-8249-ad45a1aa293a tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:51.261836 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-9d1666f3-c474-4422-8249-ad45a1aa293a tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799f987b3aa7426ba5d7a464052d6490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87474d4b4c547abbfe6308b6dd8e1c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:14:51.270805 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-9d1666f3-c474-4422-8249-ad45a1aa293a tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] 10.222.0.18 "GET /compute/v2.1/servers/c05b27d6-ba86-4600-bb33-8d2daeda2094" status: 200 len: 1490 microversion: 2.1 time: 0.196340 Oct 22 21:14:51.271760 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2411/4810] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:14:51 2022] GET /compute/v2.1/servers/c05b27d6-ba86-4600-bb33-8d2daeda2094 => generated 1490 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:14:51.293877 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-e459c3a6-4ab1-4fbb-8d8c-2d940ad566cd tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:14:51.294679 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-e459c3a6-4ab1-4fbb-8d8c-2d940ad566cd tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] [instance: 6404fc61-0c84-4fab-9557-cefbd8e6da63] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:14:51.302817 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e459c3a6-4ab1-4fbb-8d8c-2d940ad566cd tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:51.303428 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e459c3a6-4ab1-4fbb-8d8c-2d940ad566cd tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:51.303937 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e459c3a6-4ab1-4fbb-8d8c-2d940ad566cd tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:51.304748 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e459c3a6-4ab1-4fbb-8d8c-2d940ad566cd tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:51.305407 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e459c3a6-4ab1-4fbb-8d8c-2d940ad566cd tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:51.305909 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e459c3a6-4ab1-4fbb-8d8c-2d940ad566cd tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:51.475947 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-e459c3a6-4ab1-4fbb-8d8c-2d940ad566cd tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799f987b3aa7426ba5d7a464052d6490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87474d4b4c547abbfe6308b6dd8e1c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:14:51.486632 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-e459c3a6-4ab1-4fbb-8d8c-2d940ad566cd tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] 10.222.0.18 "GET /compute/v2.1/servers/6404fc61-0c84-4fab-9557-cefbd8e6da63" status: 200 len: 1490 microversion: 2.1 time: 0.195196 Oct 22 21:14:51.486632 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2400/4811] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:14:51 2022] GET /compute/v2.1/servers/6404fc61-0c84-4fab-9557-cefbd8e6da63 => generated 1490 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:14:51.507952 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-e166441c-54a4-4900-8e2b-799c8536ec5b tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:14:51.508597 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-e166441c-54a4-4900-8e2b-799c8536ec5b tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] [instance: 6404fc61-0c84-4fab-9557-cefbd8e6da63] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:14:51.515482 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e166441c-54a4-4900-8e2b-799c8536ec5b tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:51.516093 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e166441c-54a4-4900-8e2b-799c8536ec5b tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:51.516605 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e166441c-54a4-4900-8e2b-799c8536ec5b tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:51.517490 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e166441c-54a4-4900-8e2b-799c8536ec5b tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:51.518024 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e166441c-54a4-4900-8e2b-799c8536ec5b tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:51.518531 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e166441c-54a4-4900-8e2b-799c8536ec5b tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:51.559090 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-e166441c-54a4-4900-8e2b-799c8536ec5b tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] [instance: 6404fc61-0c84-4fab-9557-cefbd8e6da63] Going to try to terminate instance {{(pid=138745) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 21:14:51.628959 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-ffd3f9cb-5f51-4122-913f-d3b4e89f8019 tempest-VolumesBackupsTest-1343612709 tempest-VolumesBackupsTest-1343612709-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:14:51.630129 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-ffd3f9cb-5f51-4122-913f-d3b4e89f8019 tempest-VolumesBackupsTest-1343612709 tempest-VolumesBackupsTest-1343612709-project] [instance: 6bacb456-9f6a-42a0-9f8b-8374cc17f54a] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:14:51.637900 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ffd3f9cb-5f51-4122-913f-d3b4e89f8019 tempest-VolumesBackupsTest-1343612709 tempest-VolumesBackupsTest-1343612709-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:51.638667 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ffd3f9cb-5f51-4122-913f-d3b4e89f8019 tempest-VolumesBackupsTest-1343612709 tempest-VolumesBackupsTest-1343612709-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:51.639296 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ffd3f9cb-5f51-4122-913f-d3b4e89f8019 tempest-VolumesBackupsTest-1343612709 tempest-VolumesBackupsTest-1343612709-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:51.640230 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ffd3f9cb-5f51-4122-913f-d3b4e89f8019 tempest-VolumesBackupsTest-1343612709 tempest-VolumesBackupsTest-1343612709-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:51.640871 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ffd3f9cb-5f51-4122-913f-d3b4e89f8019 tempest-VolumesBackupsTest-1343612709 tempest-VolumesBackupsTest-1343612709-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:51.641513 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ffd3f9cb-5f51-4122-913f-d3b4e89f8019 tempest-VolumesBackupsTest-1343612709 tempest-VolumesBackupsTest-1343612709-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:51.684096 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-e166441c-54a4-4900-8e2b-799c8536ec5b tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] 10.222.0.18 "DELETE /compute/v2.1/servers/6404fc61-0c84-4fab-9557-cefbd8e6da63" status: 204 len: 0 microversion: 2.1 time: 0.180023 Oct 22 21:14:51.685449 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2412/4812] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 21:14:51 2022] DELETE /compute/v2.1/servers/6404fc61-0c84-4fab-9557-cefbd8e6da63 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 21:14:51.696181 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-aaf99213-4157-4d57-b2aa-ac1002d07780 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:14:51.697627 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-aaf99213-4157-4d57-b2aa-ac1002d07780 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] [instance: 6404fc61-0c84-4fab-9557-cefbd8e6da63] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:14:51.704965 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-aaf99213-4157-4d57-b2aa-ac1002d07780 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:51.706433 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-aaf99213-4157-4d57-b2aa-ac1002d07780 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:51.707039 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-aaf99213-4157-4d57-b2aa-ac1002d07780 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:51.708522 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-aaf99213-4157-4d57-b2aa-ac1002d07780 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:51.709286 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-aaf99213-4157-4d57-b2aa-ac1002d07780 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:51.710153 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-aaf99213-4157-4d57-b2aa-ac1002d07780 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:51.906470 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-ffd3f9cb-5f51-4122-913f-d3b4e89f8019 tempest-VolumesBackupsTest-1343612709 tempest-VolumesBackupsTest-1343612709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd25f7d1fb76e4eb5a8af45ff5d61efce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25f382da0674f74ada627cf75ad37d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:14:51.918542 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-ffd3f9cb-5f51-4122-913f-d3b4e89f8019 tempest-VolumesBackupsTest-1343612709 tempest-VolumesBackupsTest-1343612709-project] 10.222.0.18 "GET /compute/v2.1/servers/6bacb456-9f6a-42a0-9f8b-8374cc17f54a" status: 200 len: 1469 microversion: 2.1 time: 0.293887 Oct 22 21:14:51.922312 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2401/4813] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:14:51 2022] GET /compute/v2.1/servers/6bacb456-9f6a-42a0-9f8b-8374cc17f54a => generated 1469 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:14:51.945281 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-aaf99213-4157-4d57-b2aa-ac1002d07780 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799f987b3aa7426ba5d7a464052d6490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87474d4b4c547abbfe6308b6dd8e1c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:14:51.964675 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-aaf99213-4157-4d57-b2aa-ac1002d07780 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] 10.222.0.18 "GET /compute/v2.1/servers/6404fc61-0c84-4fab-9557-cefbd8e6da63" status: 200 len: 1496 microversion: 2.1 time: 0.274207 Oct 22 21:14:51.965254 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2413/4814] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:14:51 2022] GET /compute/v2.1/servers/6404fc61-0c84-4fab-9557-cefbd8e6da63 => generated 1496 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:14:52.947856 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-097c66ca-7286-4abe-9c81-fed0f1f3e6b4 tempest-VolumesBackupsTest-1343612709 tempest-VolumesBackupsTest-1343612709-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:14:52.948228 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-097c66ca-7286-4abe-9c81-fed0f1f3e6b4 tempest-VolumesBackupsTest-1343612709 tempest-VolumesBackupsTest-1343612709-project] [instance: 6bacb456-9f6a-42a0-9f8b-8374cc17f54a] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:14:52.962411 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-097c66ca-7286-4abe-9c81-fed0f1f3e6b4 tempest-VolumesBackupsTest-1343612709 tempest-VolumesBackupsTest-1343612709-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:52.963186 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-097c66ca-7286-4abe-9c81-fed0f1f3e6b4 tempest-VolumesBackupsTest-1343612709 tempest-VolumesBackupsTest-1343612709-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:52.964046 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-097c66ca-7286-4abe-9c81-fed0f1f3e6b4 tempest-VolumesBackupsTest-1343612709 tempest-VolumesBackupsTest-1343612709-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:52.965054 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-097c66ca-7286-4abe-9c81-fed0f1f3e6b4 tempest-VolumesBackupsTest-1343612709 tempest-VolumesBackupsTest-1343612709-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:52.968475 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-097c66ca-7286-4abe-9c81-fed0f1f3e6b4 tempest-VolumesBackupsTest-1343612709 tempest-VolumesBackupsTest-1343612709-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:52.970044 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-097c66ca-7286-4abe-9c81-fed0f1f3e6b4 tempest-VolumesBackupsTest-1343612709 tempest-VolumesBackupsTest-1343612709-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:52.994211 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-654d6496-24e9-42fe-a3d8-9bac8ea892a6 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:14:52.996267 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-654d6496-24e9-42fe-a3d8-9bac8ea892a6 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] [instance: 6404fc61-0c84-4fab-9557-cefbd8e6da63] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:14:53.018234 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-654d6496-24e9-42fe-a3d8-9bac8ea892a6 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:53.019516 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-654d6496-24e9-42fe-a3d8-9bac8ea892a6 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:53.020661 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-654d6496-24e9-42fe-a3d8-9bac8ea892a6 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:53.023201 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-654d6496-24e9-42fe-a3d8-9bac8ea892a6 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:53.024804 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-654d6496-24e9-42fe-a3d8-9bac8ea892a6 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:53.029019 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-654d6496-24e9-42fe-a3d8-9bac8ea892a6 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:53.254612 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-097c66ca-7286-4abe-9c81-fed0f1f3e6b4 tempest-VolumesBackupsTest-1343612709 tempest-VolumesBackupsTest-1343612709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd25f7d1fb76e4eb5a8af45ff5d61efce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25f382da0674f74ada627cf75ad37d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:14:53.268572 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-097c66ca-7286-4abe-9c81-fed0f1f3e6b4 tempest-VolumesBackupsTest-1343612709 tempest-VolumesBackupsTest-1343612709-project] 10.222.0.18 "GET /compute/v2.1/servers/6bacb456-9f6a-42a0-9f8b-8374cc17f54a" status: 200 len: 1427 microversion: 2.1 time: 0.327443 Oct 22 21:14:53.275047 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2402/4815] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:14:52 2022] GET /compute/v2.1/servers/6bacb456-9f6a-42a0-9f8b-8374cc17f54a => generated 1427 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:14:53.283596 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-51012b5c-afa6-4183-b612-21f667069536 req-90f941d2-fe56-46c5-8880-aec73c9cddf3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6bacb456-9f6a-42a0-9f8b-8374cc17f54a", "name": "network-vif-deleted", "tag": "b1fd66d8-496a-4dba-85ef-f2f0268abd67"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:14:53.297836 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-51012b5c-afa6-4183-b612-21f667069536 req-90f941d2-fe56-46c5-8880-aec73c9cddf3 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:53.300113 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-51012b5c-afa6-4183-b612-21f667069536 req-90f941d2-fe56-46c5-8880-aec73c9cddf3 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:53.300734 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-51012b5c-afa6-4183-b612-21f667069536 req-90f941d2-fe56-46c5-8880-aec73c9cddf3 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:53.321642 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-51012b5c-afa6-4183-b612-21f667069536 req-90f941d2-fe56-46c5-8880-aec73c9cddf3 service nova] Creating event network-vif-deleted:b1fd66d8-496a-4dba-85ef-f2f0268abd67 for instance 6bacb456-9f6a-42a0-9f8b-8374cc17f54a on nch1-master-1 Oct 22 21:14:53.352044 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-51012b5c-afa6-4183-b612-21f667069536 req-90f941d2-fe56-46c5-8880-aec73c9cddf3 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071886 Oct 22 21:14:53.353232 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2403/4816] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:14:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:14:53.692401 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-654d6496-24e9-42fe-a3d8-9bac8ea892a6 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799f987b3aa7426ba5d7a464052d6490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87474d4b4c547abbfe6308b6dd8e1c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:14:53.707879 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-654d6496-24e9-42fe-a3d8-9bac8ea892a6 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] 10.222.0.18 "GET /compute/v2.1/servers/6404fc61-0c84-4fab-9557-cefbd8e6da63" status: 200 len: 1496 microversion: 2.1 time: 0.721282 Oct 22 21:14:53.708647 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2414/4817] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:14:52 2022] GET /compute/v2.1/servers/6404fc61-0c84-4fab-9557-cefbd8e6da63 => generated 1496 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:14:54.307921 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-b5488612-1b5f-48ea-94d4-1c2e3f5f178f tempest-VolumesBackupsTest-1343612709 tempest-VolumesBackupsTest-1343612709-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:14:54.308657 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-b5488612-1b5f-48ea-94d4-1c2e3f5f178f tempest-VolumesBackupsTest-1343612709 tempest-VolumesBackupsTest-1343612709-project] [instance: 6bacb456-9f6a-42a0-9f8b-8374cc17f54a] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:14:54.323024 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b5488612-1b5f-48ea-94d4-1c2e3f5f178f tempest-VolumesBackupsTest-1343612709 tempest-VolumesBackupsTest-1343612709-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:54.324755 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b5488612-1b5f-48ea-94d4-1c2e3f5f178f tempest-VolumesBackupsTest-1343612709 tempest-VolumesBackupsTest-1343612709-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:54.325195 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b5488612-1b5f-48ea-94d4-1c2e3f5f178f tempest-VolumesBackupsTest-1343612709 tempest-VolumesBackupsTest-1343612709-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:54.325940 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b5488612-1b5f-48ea-94d4-1c2e3f5f178f tempest-VolumesBackupsTest-1343612709 tempest-VolumesBackupsTest-1343612709-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:54.332419 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b5488612-1b5f-48ea-94d4-1c2e3f5f178f tempest-VolumesBackupsTest-1343612709 tempest-VolumesBackupsTest-1343612709-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:54.332979 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b5488612-1b5f-48ea-94d4-1c2e3f5f178f tempest-VolumesBackupsTest-1343612709 tempest-VolumesBackupsTest-1343612709-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:54.363135 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-b5488612-1b5f-48ea-94d4-1c2e3f5f178f tempest-VolumesBackupsTest-1343612709 tempest-VolumesBackupsTest-1343612709-project] HTTP exception thrown: Instance 6bacb456-9f6a-42a0-9f8b-8374cc17f54a could not be found. Oct 22 21:14:54.366255 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-b5488612-1b5f-48ea-94d4-1c2e3f5f178f tempest-VolumesBackupsTest-1343612709 tempest-VolumesBackupsTest-1343612709-project] Request method failure captured: Oct 22 21:14:54.366255 ncdv-master-1 devstack@n-api.service[138744]: request: GET /compute/v2.1/servers/6bacb456-9f6a-42a0-9f8b-8374cc17f54a HTTP/1.1 Oct 22 21:14:54.366255 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 21:14:54.366255 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 21:14:54.366255 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 21:14:54.366255 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 0 Oct 22 21:14:54.366255 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 21:14:54.366255 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 21:14:54.366255 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 21:14:54.366255 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 21:14:54.366255 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVF0pIfM-qXCMqdOIhucr5Js9Dz8Jta6gArVlNkoKVcrl8Y7RMCmp_IeCelKdBbDa07c5QHNelyKGvTm4gVy1OncwJzPUxJsab8-l-4SzZs0NNdLagsGsLnEMOPwr14UHeESv4n0SS2dW-pGOoc96rzL-cdgeDhLzvtpEA4tdblhr3qE Oct 22 21:14:54.366255 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 21:14:54.366255 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 21:14:54.366255 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 21:14:54.366255 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 21:14:54.366255 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 21:14:54.366255 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 21:14:54.366255 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: a25f382da0674f74ada627cf75ad37d0 Oct 22 21:14:54.366255 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-VolumesBackupsTest-1343612709 Oct 22 21:14:54.366255 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 21:14:54.366255 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 21:14:54.366255 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_a25f382da0674f74ada627cf75ad37d0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a25f382da0674f74ada627cf75ad37d0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/a25f382da0674f74ada627cf75ad37d0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a25f382da0674f74ada627cf75ad37d0"}]}] Oct 22 21:14:54.366255 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-VolumesBackupsTest-1343612709 Oct 22 21:14:54.366255 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: a25f382da0674f74ada627cf75ad37d0 Oct 22 21:14:54.366255 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-VolumesBackupsTest-1343612709 Oct 22 21:14:54.366255 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-VolumesBackupsTest-1343612709-project Oct 22 21:14:54.366255 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 21:14:54.366255 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 21:14:54.366255 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: d25f7d1fb76e4eb5a8af45ff5d61efce Oct 22 21:14:54.366255 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-VolumesBackupsTest-1343612709-project Oct 22 21:14:54.366255 ncdv-master-1 devstack@n-api.service[138744]: method: > Oct 22 21:14:54.366255 ncdv-master-1 devstack@n-api.service[138744]: exception: Instance 6bacb456-9f6a-42a0-9f8b-8374cc17f54a could not be found. Oct 22 21:14:54.366255 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': '6bacb456-9f6a-42a0-9f8b-8374cc17f54a'} Oct 22 21:14:54.366255 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:14:54.366255 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:14:54.366255 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 21:14:54.366255 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 21:14:54.366255 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 21:14:54.366255 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 21:14:54.366255 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 21:14:54.366255 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 21:14:54.366255 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 21:14:54.366255 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 21:14:54.366255 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6bacb456-9f6a-42a0-9f8b-8374cc17f54a could not be found. Oct 22 21:14:54.366255 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:14:54.366255 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:14:54.366255 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:14:54.366255 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:14:54.366255 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:14:54.366255 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:14:54.366255 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:14:54.366255 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:14:54.366255 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:14:54.366255 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:14:54.366255 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 21:14:54.366255 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 21:14:54.366255 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 21:14:54.366255 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 21:14:54.366255 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 21:14:54.366255 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:14:54.366255 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6bacb456-9f6a-42a0-9f8b-8374cc17f54a could not be found. Oct 22 21:14:54.366255 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:14:54.366255 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:14:54.366255 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:14:54.370041 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:14:54.370041 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:14:54.370041 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:14:54.370041 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:14:54.370041 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:14:54.370041 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6bacb456-9f6a-42a0-9f8b-8374cc17f54a could not be found. Oct 22 21:14:54.370041 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:14:54.372850 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-b5488612-1b5f-48ea-94d4-1c2e3f5f178f tempest-VolumesBackupsTest-1343612709 tempest-VolumesBackupsTest-1343612709-project] Returning 404 to user: Instance 6bacb456-9f6a-42a0-9f8b-8374cc17f54a could not be found. {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:14:54.373732 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-b5488612-1b5f-48ea-94d4-1c2e3f5f178f tempest-VolumesBackupsTest-1343612709 tempest-VolumesBackupsTest-1343612709-project] 10.222.0.18 "GET /compute/v2.1/servers/6bacb456-9f6a-42a0-9f8b-8374cc17f54a" status: 404 len: 111 microversion: 2.1 time: 0.077732 Oct 22 21:14:54.374312 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2404/4818] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:14:54 2022] GET /compute/v2.1/servers/6bacb456-9f6a-42a0-9f8b-8374cc17f54a => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 21:14:54.748989 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-6edf6271-57f1-4eaa-a5ca-9e5fe848a448 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:14:54.749734 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-6edf6271-57f1-4eaa-a5ca-9e5fe848a448 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] [instance: 6404fc61-0c84-4fab-9557-cefbd8e6da63] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:14:54.776403 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6edf6271-57f1-4eaa-a5ca-9e5fe848a448 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:54.776929 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6edf6271-57f1-4eaa-a5ca-9e5fe848a448 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:54.777495 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6edf6271-57f1-4eaa-a5ca-9e5fe848a448 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:54.779025 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6edf6271-57f1-4eaa-a5ca-9e5fe848a448 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:54.779550 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6edf6271-57f1-4eaa-a5ca-9e5fe848a448 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:54.780454 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6edf6271-57f1-4eaa-a5ca-9e5fe848a448 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:54.918865 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-6edf6271-57f1-4eaa-a5ca-9e5fe848a448 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799f987b3aa7426ba5d7a464052d6490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87474d4b4c547abbfe6308b6dd8e1c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:14:54.936424 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-6edf6271-57f1-4eaa-a5ca-9e5fe848a448 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] 10.222.0.18 "GET /compute/v2.1/servers/6404fc61-0c84-4fab-9557-cefbd8e6da63" status: 200 len: 1454 microversion: 2.1 time: 0.203212 Oct 22 21:14:54.939492 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2415/4819] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:14:54 2022] GET /compute/v2.1/servers/6404fc61-0c84-4fab-9557-cefbd8e6da63 => generated 1454 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:14:55.378643 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-5437a32d-4acf-4dee-b265-60e322a98a19 req-58e6f803-b689-4c0f-b83b-76b5db0627f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6404fc61-0c84-4fab-9557-cefbd8e6da63", "name": "network-vif-deleted", "tag": "6f56403c-835c-4238-b6a5-ef1992a6a5ee"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:14:55.394128 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-5437a32d-4acf-4dee-b265-60e322a98a19 req-58e6f803-b689-4c0f-b83b-76b5db0627f2 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:55.394880 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-5437a32d-4acf-4dee-b265-60e322a98a19 req-58e6f803-b689-4c0f-b83b-76b5db0627f2 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:55.398837 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-5437a32d-4acf-4dee-b265-60e322a98a19 req-58e6f803-b689-4c0f-b83b-76b5db0627f2 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:55.420990 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-5437a32d-4acf-4dee-b265-60e322a98a19 req-58e6f803-b689-4c0f-b83b-76b5db0627f2 service nova] Creating event network-vif-deleted:6f56403c-835c-4238-b6a5-ef1992a6a5ee for instance 6404fc61-0c84-4fab-9557-cefbd8e6da63 on nch2-master-1 Oct 22 21:14:55.427620 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-5437a32d-4acf-4dee-b265-60e322a98a19 req-58e6f803-b689-4c0f-b83b-76b5db0627f2 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053824 Oct 22 21:14:55.428366 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2405/4820] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:14:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:14:55.966279 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-54d28951-a142-469b-a828-08de00c98509 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:14:55.968599 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-54d28951-a142-469b-a828-08de00c98509 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] [instance: 6404fc61-0c84-4fab-9557-cefbd8e6da63] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:14:55.979193 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-54d28951-a142-469b-a828-08de00c98509 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:55.979817 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-54d28951-a142-469b-a828-08de00c98509 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:55.981220 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-54d28951-a142-469b-a828-08de00c98509 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:55.982941 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-54d28951-a142-469b-a828-08de00c98509 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:55.983612 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-54d28951-a142-469b-a828-08de00c98509 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:55.984208 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-54d28951-a142-469b-a828-08de00c98509 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:56.003769 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.wsgi [None req-54d28951-a142-469b-a828-08de00c98509 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] HTTP exception thrown: Instance 6404fc61-0c84-4fab-9557-cefbd8e6da63 could not be found. Oct 22 21:14:56.006104 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-54d28951-a142-469b-a828-08de00c98509 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Request method failure captured: Oct 22 21:14:56.006104 ncdv-master-1 devstack@n-api.service[138745]: request: GET /compute/v2.1/servers/6404fc61-0c84-4fab-9557-cefbd8e6da63 HTTP/1.1 Oct 22 21:14:56.006104 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 21:14:56.006104 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 21:14:56.006104 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 21:14:56.006104 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 0 Oct 22 21:14:56.006104 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 21:14:56.006104 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 21:14:56.006104 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 21:14:56.006104 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 21:14:56.006104 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVFzbjFuxlabhGO5W5IN5r54yzIxFa_mX4J74OzfXM08pyPGfws2Ww4pm5qGKXFC4h2Ttyt1JiFfrSI-ucQt7MPAhDqF8_tQs5Z1aGjJkE87trFhYgYaJFSihYuRhX8jAUHeeDuqMpE3BFEYcIHoIoAbD2BZHLThVUs-wQCfowY_4sFQ Oct 22 21:14:56.006104 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 21:14:56.006104 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 21:14:56.006104 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 21:14:56.006104 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 21:14:56.006104 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 21:14:56.006104 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 21:14:56.006104 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: e87474d4b4c547abbfe6308b6dd8e1c8 Oct 22 21:14:56.006104 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-ServersTestJSON-2007137082 Oct 22 21:14:56.006104 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 21:14:56.006104 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 21:14:56.006104 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_e87474d4b4c547abbfe6308b6dd8e1c8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e87474d4b4c547abbfe6308b6dd8e1c8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/e87474d4b4c547abbfe6308b6dd8e1c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e87474d4b4c547abbfe6308b6dd8e1c8"}]}] Oct 22 21:14:56.006104 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-ServersTestJSON-2007137082 Oct 22 21:14:56.006104 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: e87474d4b4c547abbfe6308b6dd8e1c8 Oct 22 21:14:56.006104 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-ServersTestJSON-2007137082 Oct 22 21:14:56.006104 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-ServersTestJSON-2007137082-project Oct 22 21:14:56.006104 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 21:14:56.006104 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 21:14:56.006104 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: 799f987b3aa7426ba5d7a464052d6490 Oct 22 21:14:56.006104 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-ServersTestJSON-2007137082-project Oct 22 21:14:56.006104 ncdv-master-1 devstack@n-api.service[138745]: method: > Oct 22 21:14:56.006104 ncdv-master-1 devstack@n-api.service[138745]: exception: Instance 6404fc61-0c84-4fab-9557-cefbd8e6da63 could not be found. Oct 22 21:14:56.006104 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'id': '6404fc61-0c84-4fab-9557-cefbd8e6da63'} Oct 22 21:14:56.006104 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:14:56.006104 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:14:56.006104 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 21:14:56.006104 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 21:14:56.006104 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 21:14:56.006104 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 21:14:56.006104 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 21:14:56.006104 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 21:14:56.006104 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 21:14:56.006104 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 21:14:56.006104 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6404fc61-0c84-4fab-9557-cefbd8e6da63 could not be found. Oct 22 21:14:56.006104 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:14:56.006104 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:14:56.006104 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:14:56.006104 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:14:56.006104 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:14:56.006104 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:14:56.006104 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:14:56.006104 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:14:56.006104 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:14:56.006104 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:14:56.006104 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 21:14:56.006104 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 21:14:56.006104 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 21:14:56.006104 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 21:14:56.006104 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 21:14:56.006104 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:14:56.006104 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6404fc61-0c84-4fab-9557-cefbd8e6da63 could not be found. Oct 22 21:14:56.006104 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:14:56.006104 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:14:56.006104 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:14:56.009918 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:14:56.009918 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:14:56.009918 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:14:56.009918 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:14:56.009918 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:14:56.009918 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6404fc61-0c84-4fab-9557-cefbd8e6da63 could not be found. Oct 22 21:14:56.009918 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:14:56.012961 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-54d28951-a142-469b-a828-08de00c98509 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Returning 404 to user: Instance 6404fc61-0c84-4fab-9557-cefbd8e6da63 could not be found. {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:14:56.013897 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-54d28951-a142-469b-a828-08de00c98509 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] 10.222.0.18 "GET /compute/v2.1/servers/6404fc61-0c84-4fab-9557-cefbd8e6da63" status: 404 len: 111 microversion: 2.1 time: 0.053824 Oct 22 21:14:56.014725 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2416/4821] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:14:55 2022] GET /compute/v2.1/servers/6404fc61-0c84-4fab-9557-cefbd8e6da63 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 21:14:56.023916 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-b1e7483f-1b66-4de8-bc9e-582bd63dfcb8 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:14:56.024515 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-b1e7483f-1b66-4de8-bc9e-582bd63dfcb8 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] [instance: c05b27d6-ba86-4600-bb33-8d2daeda2094] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:14:56.031996 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b1e7483f-1b66-4de8-bc9e-582bd63dfcb8 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:56.032500 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b1e7483f-1b66-4de8-bc9e-582bd63dfcb8 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:56.032949 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b1e7483f-1b66-4de8-bc9e-582bd63dfcb8 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:56.034013 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b1e7483f-1b66-4de8-bc9e-582bd63dfcb8 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:56.034470 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b1e7483f-1b66-4de8-bc9e-582bd63dfcb8 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:56.035465 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b1e7483f-1b66-4de8-bc9e-582bd63dfcb8 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:56.063673 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-b1e7483f-1b66-4de8-bc9e-582bd63dfcb8 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] [instance: c05b27d6-ba86-4600-bb33-8d2daeda2094] Going to try to terminate instance {{(pid=138744) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 21:14:56.120981 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:14:56.163182 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-b1e7483f-1b66-4de8-bc9e-582bd63dfcb8 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] 10.222.0.18 "DELETE /compute/v2.1/servers/c05b27d6-ba86-4600-bb33-8d2daeda2094" status: 204 len: 0 microversion: 2.1 time: 0.142267 Oct 22 21:14:56.165225 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2406/4822] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 21:14:56 2022] DELETE /compute/v2.1/servers/c05b27d6-ba86-4600-bb33-8d2daeda2094 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 22 21:14:56.173694 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-159edf90-3045-4506-9d4a-f12db68c85f2 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:14:56.174345 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-159edf90-3045-4506-9d4a-f12db68c85f2 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] [instance: c05b27d6-ba86-4600-bb33-8d2daeda2094] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:14:56.181676 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-159edf90-3045-4506-9d4a-f12db68c85f2 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:56.182509 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-159edf90-3045-4506-9d4a-f12db68c85f2 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:56.183286 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-159edf90-3045-4506-9d4a-f12db68c85f2 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:56.184378 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-159edf90-3045-4506-9d4a-f12db68c85f2 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:56.185000 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-159edf90-3045-4506-9d4a-f12db68c85f2 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:56.185665 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-159edf90-3045-4506-9d4a-f12db68c85f2 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:56.329936 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-159edf90-3045-4506-9d4a-f12db68c85f2 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799f987b3aa7426ba5d7a464052d6490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87474d4b4c547abbfe6308b6dd8e1c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:14:56.338625 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-159edf90-3045-4506-9d4a-f12db68c85f2 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] 10.222.0.18 "GET /compute/v2.1/servers/c05b27d6-ba86-4600-bb33-8d2daeda2094" status: 200 len: 1496 microversion: 2.1 time: 0.169223 Oct 22 21:14:56.339237 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2417/4823] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:14:56 2022] GET /compute/v2.1/servers/c05b27d6-ba86-4600-bb33-8d2daeda2094 => generated 1496 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:14:57.363605 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-8a8fac2b-68de-4636-a372-fb6281cc51ad tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:14:57.364364 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-8a8fac2b-68de-4636-a372-fb6281cc51ad tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] [instance: c05b27d6-ba86-4600-bb33-8d2daeda2094] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:14:57.395632 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8a8fac2b-68de-4636-a372-fb6281cc51ad tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:57.396153 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8a8fac2b-68de-4636-a372-fb6281cc51ad tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:57.396712 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8a8fac2b-68de-4636-a372-fb6281cc51ad tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:57.397415 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8a8fac2b-68de-4636-a372-fb6281cc51ad tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:57.397961 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8a8fac2b-68de-4636-a372-fb6281cc51ad tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:57.398404 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8a8fac2b-68de-4636-a372-fb6281cc51ad tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:57.599020 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-8a8fac2b-68de-4636-a372-fb6281cc51ad tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799f987b3aa7426ba5d7a464052d6490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87474d4b4c547abbfe6308b6dd8e1c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:14:57.609205 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-8a8fac2b-68de-4636-a372-fb6281cc51ad tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] 10.222.0.18 "GET /compute/v2.1/servers/c05b27d6-ba86-4600-bb33-8d2daeda2094" status: 200 len: 1496 microversion: 2.1 time: 0.250305 Oct 22 21:14:57.610248 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2407/4824] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:14:57 2022] GET /compute/v2.1/servers/c05b27d6-ba86-4600-bb33-8d2daeda2094 => generated 1496 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:14:58.407042 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-e5bb07f1-ffb4-4844-aa03-a7d9e64b8a96 req-81ca81f4-4847-4077-91f7-3fe947f459bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c05b27d6-ba86-4600-bb33-8d2daeda2094", "name": "network-vif-deleted", "tag": "99c14781-7778-47ae-b534-86ecf7493cef"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:14:58.433954 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-e5bb07f1-ffb4-4844-aa03-a7d9e64b8a96 req-81ca81f4-4847-4077-91f7-3fe947f459bf service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:58.434464 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-e5bb07f1-ffb4-4844-aa03-a7d9e64b8a96 req-81ca81f4-4847-4077-91f7-3fe947f459bf service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:58.434914 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-e5bb07f1-ffb4-4844-aa03-a7d9e64b8a96 req-81ca81f4-4847-4077-91f7-3fe947f459bf service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:58.453827 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-e5bb07f1-ffb4-4844-aa03-a7d9e64b8a96 req-81ca81f4-4847-4077-91f7-3fe947f459bf service nova] Creating event network-vif-deleted:99c14781-7778-47ae-b534-86ecf7493cef for instance c05b27d6-ba86-4600-bb33-8d2daeda2094 on nch2-master-1 Oct 22 21:14:58.461504 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-e5bb07f1-ffb4-4844-aa03-a7d9e64b8a96 req-81ca81f4-4847-4077-91f7-3fe947f459bf service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057864 Oct 22 21:14:58.462441 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2418/4825] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:14:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:14:58.647441 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-e18daaa0-72fb-47da-b859-7e782f7e2cc8 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:14:58.648163 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-e18daaa0-72fb-47da-b859-7e782f7e2cc8 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] [instance: c05b27d6-ba86-4600-bb33-8d2daeda2094] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:14:58.655854 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e18daaa0-72fb-47da-b859-7e782f7e2cc8 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:58.656434 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e18daaa0-72fb-47da-b859-7e782f7e2cc8 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:58.656925 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e18daaa0-72fb-47da-b859-7e782f7e2cc8 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:58.657648 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e18daaa0-72fb-47da-b859-7e782f7e2cc8 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:58.658110 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e18daaa0-72fb-47da-b859-7e782f7e2cc8 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:58.658545 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e18daaa0-72fb-47da-b859-7e782f7e2cc8 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:58.715236 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e18daaa0-72fb-47da-b859-7e782f7e2cc8 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:58.716242 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e18daaa0-72fb-47da-b859-7e782f7e2cc8 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:58.717313 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e18daaa0-72fb-47da-b859-7e782f7e2cc8 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:58.717786 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.objects.instance [None req-e18daaa0-72fb-47da-b859-7e782f7e2cc8 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lazy-loading 'fault' on Instance uuid c05b27d6-ba86-4600-bb33-8d2daeda2094 {{(pid=138744) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 21:14:58.802028 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-e18daaa0-72fb-47da-b859-7e782f7e2cc8 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799f987b3aa7426ba5d7a464052d6490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87474d4b4c547abbfe6308b6dd8e1c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:14:58.820047 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-e18daaa0-72fb-47da-b859-7e782f7e2cc8 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] 10.222.0.18 "GET /compute/v2.1/servers/c05b27d6-ba86-4600-bb33-8d2daeda2094" status: 200 len: 1299 microversion: 2.1 time: 0.185409 Oct 22 21:14:58.820810 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2408/4826] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:14:58 2022] GET /compute/v2.1/servers/c05b27d6-ba86-4600-bb33-8d2daeda2094 => generated 1299 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:14:59.848334 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-7b59360f-c1e1-4338-943a-f2bc9b292d2a tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:14:59.850876 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-7b59360f-c1e1-4338-943a-f2bc9b292d2a tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] [instance: c05b27d6-ba86-4600-bb33-8d2daeda2094] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:14:59.857930 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7b59360f-c1e1-4338-943a-f2bc9b292d2a tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:59.858526 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7b59360f-c1e1-4338-943a-f2bc9b292d2a tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:59.858968 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7b59360f-c1e1-4338-943a-f2bc9b292d2a tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:59.859856 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7b59360f-c1e1-4338-943a-f2bc9b292d2a tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:14:59.860588 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7b59360f-c1e1-4338-943a-f2bc9b292d2a tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:14:59.861033 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7b59360f-c1e1-4338-943a-f2bc9b292d2a tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:14:59.878614 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.wsgi [None req-7b59360f-c1e1-4338-943a-f2bc9b292d2a tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] HTTP exception thrown: Instance c05b27d6-ba86-4600-bb33-8d2daeda2094 could not be found. Oct 22 21:14:59.880441 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-7b59360f-c1e1-4338-943a-f2bc9b292d2a tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Request method failure captured: Oct 22 21:14:59.880441 ncdv-master-1 devstack@n-api.service[138745]: request: GET /compute/v2.1/servers/c05b27d6-ba86-4600-bb33-8d2daeda2094 HTTP/1.1 Oct 22 21:14:59.880441 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 21:14:59.880441 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 21:14:59.880441 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 21:14:59.880441 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 0 Oct 22 21:14:59.880441 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 21:14:59.880441 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 21:14:59.880441 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 21:14:59.880441 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 21:14:59.880441 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVFzbjFuxlabhGO5W5IN5r54yzIxFa_mX4J74OzfXM08pyPGfws2Ww4pm5qGKXFC4h2Ttyt1JiFfrSI-ucQt7MPAhDqF8_tQs5Z1aGjJkE87trFhYgYaJFSihYuRhX8jAUHeeDuqMpE3BFEYcIHoIoAbD2BZHLThVUs-wQCfowY_4sFQ Oct 22 21:14:59.880441 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 21:14:59.880441 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 21:14:59.880441 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 21:14:59.880441 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 21:14:59.880441 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 21:14:59.880441 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 21:14:59.880441 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: e87474d4b4c547abbfe6308b6dd8e1c8 Oct 22 21:14:59.880441 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-ServersTestJSON-2007137082 Oct 22 21:14:59.880441 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 21:14:59.880441 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 21:14:59.880441 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_e87474d4b4c547abbfe6308b6dd8e1c8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e87474d4b4c547abbfe6308b6dd8e1c8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/e87474d4b4c547abbfe6308b6dd8e1c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e87474d4b4c547abbfe6308b6dd8e1c8"}]}] Oct 22 21:14:59.880441 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-ServersTestJSON-2007137082 Oct 22 21:14:59.880441 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: e87474d4b4c547abbfe6308b6dd8e1c8 Oct 22 21:14:59.880441 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-ServersTestJSON-2007137082 Oct 22 21:14:59.880441 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-ServersTestJSON-2007137082-project Oct 22 21:14:59.880441 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 21:14:59.880441 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 21:14:59.880441 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: 799f987b3aa7426ba5d7a464052d6490 Oct 22 21:14:59.880441 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-ServersTestJSON-2007137082-project Oct 22 21:14:59.880441 ncdv-master-1 devstack@n-api.service[138745]: method: > Oct 22 21:14:59.880441 ncdv-master-1 devstack@n-api.service[138745]: exception: Instance c05b27d6-ba86-4600-bb33-8d2daeda2094 could not be found. Oct 22 21:14:59.880441 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'id': 'c05b27d6-ba86-4600-bb33-8d2daeda2094'} Oct 22 21:14:59.880441 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:14:59.880441 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:14:59.880441 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 21:14:59.880441 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 21:14:59.880441 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 21:14:59.880441 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 21:14:59.880441 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 21:14:59.880441 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 21:14:59.880441 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 21:14:59.880441 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 21:14:59.880441 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c05b27d6-ba86-4600-bb33-8d2daeda2094 could not be found. Oct 22 21:14:59.880441 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:14:59.880441 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:14:59.880441 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:14:59.880441 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:14:59.880441 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:14:59.880441 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:14:59.880441 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:14:59.880441 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:14:59.880441 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:14:59.880441 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:14:59.880441 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 21:14:59.880441 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 21:14:59.880441 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 21:14:59.880441 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 21:14:59.880441 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 21:14:59.880441 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:14:59.880441 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c05b27d6-ba86-4600-bb33-8d2daeda2094 could not be found. Oct 22 21:14:59.880441 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:14:59.880441 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:14:59.880441 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:14:59.884258 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:14:59.884258 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:14:59.884258 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:14:59.884258 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:14:59.884258 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:14:59.884258 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c05b27d6-ba86-4600-bb33-8d2daeda2094 could not be found. Oct 22 21:14:59.884258 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:14:59.884258 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-7b59360f-c1e1-4338-943a-f2bc9b292d2a tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Returning 404 to user: Instance c05b27d6-ba86-4600-bb33-8d2daeda2094 could not be found. {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:14:59.884258 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-7b59360f-c1e1-4338-943a-f2bc9b292d2a tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] 10.222.0.18 "GET /compute/v2.1/servers/c05b27d6-ba86-4600-bb33-8d2daeda2094" status: 404 len: 111 microversion: 2.1 time: 0.039155 Oct 22 21:14:59.884258 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2419/4827] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:14:59 2022] GET /compute/v2.1/servers/c05b27d6-ba86-4600-bb33-8d2daeda2094 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 21:14:59.989052 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-af12410c-81c3-4fed-9e32-2d0abb8a98ed tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-200428732", "imageRef": "085e4478-6edc-4a69-8e08-f9831713eb65", "flavorRef": "452", "networks": [{"uuid": "ea7e3c31-2bc2-4b4f-ab48-7d75cccdd3b0"}]}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:15:00.045131 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.network.neutron [None req-af12410c-81c3-4fed-9e32-2d0abb8a98ed tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] validate_networks() for [('ea7e3c31-2bc2-4b4f-ab48-7d75cccdd3b0', None, None, None, None, None)] {{(pid=138744) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 21:15:00.464920 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-af12410c-81c3-4fed-9e32-2d0abb8a98ed tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Flavor limits 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 21:15:00.465343 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-af12410c-81c3-4fed-9e32-2d0abb8a98ed tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Image limits 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 21:15:00.465874 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-af12410c-81c3-4fed-9e32-2d0abb8a98ed tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Flavor pref 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 21:15:00.466287 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-af12410c-81c3-4fed-9e32-2d0abb8a98ed tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Image pref 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 21:15:00.466705 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-af12410c-81c3-4fed-9e32-2d0abb8a98ed tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 21:15:00.477684 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-af12410c-81c3-4fed-9e32-2d0abb8a98ed tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:15:00.478687 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-af12410c-81c3-4fed-9e32-2d0abb8a98ed tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:15:00.479084 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-af12410c-81c3-4fed-9e32-2d0abb8a98ed tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:15:00.480227 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-af12410c-81c3-4fed-9e32-2d0abb8a98ed tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:15:00.480690 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-af12410c-81c3-4fed-9e32-2d0abb8a98ed tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:15:00.481211 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-af12410c-81c3-4fed-9e32-2d0abb8a98ed tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:15:00.499542 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-af12410c-81c3-4fed-9e32-2d0abb8a98ed tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Getting quotas for project e87474d4b4c547abbfe6308b6dd8e1c8. Resources: {'cores', 'instances', 'ram'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 21:15:00.505474 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-af12410c-81c3-4fed-9e32-2d0abb8a98ed tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Getting quotas for user 799f987b3aa7426ba5d7a464052d6490 and project e87474d4b4c547abbfe6308b6dd8e1c8. Resources: {'cores', 'instances', 'ram'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 21:15:00.519750 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-af12410c-81c3-4fed-9e32-2d0abb8a98ed tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Going to run 1 instances... {{(pid=138744) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 21:15:00.522545 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-af12410c-81c3-4fed-9e32-2d0abb8a98ed tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] [instance: 5ec23653-3f53-406b-a0e3-1d3b3c683fb7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='085e4478-6edc-4a69-8e08-f9831713eb65',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138744) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 21:15:00.573038 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-af12410c-81c3-4fed-9e32-2d0abb8a98ed tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.587961 Oct 22 21:15:00.573858 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2409/4828] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Oct 22 21:14:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 589 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 21:15:00.587141 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-30a248e7-9899-4640-96bb-a10b9a3498f9 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:15:00.588188 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-30a248e7-9899-4640-96bb-a10b9a3498f9 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] [instance: 5ec23653-3f53-406b-a0e3-1d3b3c683fb7] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:15:00.679141 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-30a248e7-9899-4640-96bb-a10b9a3498f9 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799f987b3aa7426ba5d7a464052d6490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87474d4b4c547abbfe6308b6dd8e1c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:15:00.699039 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-30a248e7-9899-4640-96bb-a10b9a3498f9 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] 10.222.0.18 "GET /compute/v2.1/servers/5ec23653-3f53-406b-a0e3-1d3b3c683fb7" status: 200 len: 1208 microversion: 2.1 time: 0.116579 Oct 22 21:15:00.715462 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2420/4829] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:15:00 2022] GET /compute/v2.1/servers/5ec23653-3f53-406b-a0e3-1d3b3c683fb7 => generated 1208 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:15:01.726976 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-9a211c41-fe50-4f54-962f-574aaae61018 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:15:01.727599 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-9a211c41-fe50-4f54-962f-574aaae61018 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] [instance: 5ec23653-3f53-406b-a0e3-1d3b3c683fb7] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:15:01.734502 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9a211c41-fe50-4f54-962f-574aaae61018 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:15:01.735066 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9a211c41-fe50-4f54-962f-574aaae61018 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:15:01.735671 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9a211c41-fe50-4f54-962f-574aaae61018 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:15:01.736405 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9a211c41-fe50-4f54-962f-574aaae61018 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:15:01.736864 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9a211c41-fe50-4f54-962f-574aaae61018 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:15:01.737469 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9a211c41-fe50-4f54-962f-574aaae61018 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:15:01.809690 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-9a211c41-fe50-4f54-962f-574aaae61018 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799f987b3aa7426ba5d7a464052d6490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87474d4b4c547abbfe6308b6dd8e1c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:15:01.819882 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-9a211c41-fe50-4f54-962f-574aaae61018 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] 10.222.0.18 "GET /compute/v2.1/servers/5ec23653-3f53-406b-a0e3-1d3b3c683fb7" status: 200 len: 1260 microversion: 2.1 time: 0.098362 Oct 22 21:15:01.854980 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2410/4830] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:15:01 2022] GET /compute/v2.1/servers/5ec23653-3f53-406b-a0e3-1d3b3c683fb7 => generated 1260 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:15:02.847946 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-a0a33af4-bf7e-42c4-8761-094cf8e5da49 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:15:02.854128 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-a0a33af4-bf7e-42c4-8761-094cf8e5da49 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] [instance: 5ec23653-3f53-406b-a0e3-1d3b3c683fb7] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:15:02.878356 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a0a33af4-bf7e-42c4-8761-094cf8e5da49 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:15:02.885650 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a0a33af4-bf7e-42c4-8761-094cf8e5da49 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:15:02.886561 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a0a33af4-bf7e-42c4-8761-094cf8e5da49 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:15:02.889215 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a0a33af4-bf7e-42c4-8761-094cf8e5da49 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:15:02.889890 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a0a33af4-bf7e-42c4-8761-094cf8e5da49 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:15:02.899080 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a0a33af4-bf7e-42c4-8761-094cf8e5da49 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:15:02.904474 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:15:03.395085 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-a0a33af4-bf7e-42c4-8761-094cf8e5da49 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799f987b3aa7426ba5d7a464052d6490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87474d4b4c547abbfe6308b6dd8e1c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:15:03.434244 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-a0a33af4-bf7e-42c4-8761-094cf8e5da49 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] 10.222.0.18 "GET /compute/v2.1/servers/5ec23653-3f53-406b-a0e3-1d3b3c683fb7" status: 200 len: 1308 microversion: 2.1 time: 0.592892 Oct 22 21:15:03.434886 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2421/4831] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:15:02 2022] GET /compute/v2.1/servers/5ec23653-3f53-406b-a0e3-1d3b3c683fb7 => generated 1308 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:15:04.300354 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-69f8d877-1a80-43ce-b0ee-aa677c80e079 req-36d73f2b-e998-40cd-9cd5-1f68b93d3aff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ec23653-3f53-406b-a0e3-1d3b3c683fb7", "tag": "b6bfb689-2181-4132-ace8-d7cd70041a0d"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:15:04.331934 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-69f8d877-1a80-43ce-b0ee-aa677c80e079 req-36d73f2b-e998-40cd-9cd5-1f68b93d3aff service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:15:04.332633 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-69f8d877-1a80-43ce-b0ee-aa677c80e079 req-36d73f2b-e998-40cd-9cd5-1f68b93d3aff service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:15:04.333117 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-69f8d877-1a80-43ce-b0ee-aa677c80e079 req-36d73f2b-e998-40cd-9cd5-1f68b93d3aff service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:15:04.345416 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-69f8d877-1a80-43ce-b0ee-aa677c80e079 req-36d73f2b-e998-40cd-9cd5-1f68b93d3aff service nova] Creating event network-changed:b6bfb689-2181-4132-ace8-d7cd70041a0d for instance 5ec23653-3f53-406b-a0e3-1d3b3c683fb7 on nch2-master-1 Oct 22 21:15:04.351902 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-69f8d877-1a80-43ce-b0ee-aa677c80e079 req-36d73f2b-e998-40cd-9cd5-1f68b93d3aff service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062523 Oct 22 21:15:04.352527 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2411/4832] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:15:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:15:04.458703 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-8d23658d-ab8b-44d8-99d1-b708780dee83 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:15:04.460082 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-8d23658d-ab8b-44d8-99d1-b708780dee83 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] [instance: 5ec23653-3f53-406b-a0e3-1d3b3c683fb7] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:15:04.469640 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8d23658d-ab8b-44d8-99d1-b708780dee83 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:15:04.469891 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8d23658d-ab8b-44d8-99d1-b708780dee83 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:15:04.470578 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8d23658d-ab8b-44d8-99d1-b708780dee83 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:15:04.473446 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8d23658d-ab8b-44d8-99d1-b708780dee83 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:15:04.474311 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8d23658d-ab8b-44d8-99d1-b708780dee83 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:15:04.474813 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8d23658d-ab8b-44d8-99d1-b708780dee83 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:15:04.726041 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-8d23658d-ab8b-44d8-99d1-b708780dee83 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799f987b3aa7426ba5d7a464052d6490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87474d4b4c547abbfe6308b6dd8e1c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:15:04.734757 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-8d23658d-ab8b-44d8-99d1-b708780dee83 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] 10.222.0.18 "GET /compute/v2.1/servers/5ec23653-3f53-406b-a0e3-1d3b3c683fb7" status: 200 len: 1308 microversion: 2.1 time: 0.280491 Oct 22 21:15:04.735367 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2422/4833] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:15:04 2022] GET /compute/v2.1/servers/5ec23653-3f53-406b-a0e3-1d3b3c683fb7 => generated 1308 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:15:05.759450 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-a9ed05ab-80d4-4351-84de-c4f0da5e152f tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:15:05.760123 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-a9ed05ab-80d4-4351-84de-c4f0da5e152f tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] [instance: 5ec23653-3f53-406b-a0e3-1d3b3c683fb7] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:15:05.766728 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a9ed05ab-80d4-4351-84de-c4f0da5e152f tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:15:05.767206 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a9ed05ab-80d4-4351-84de-c4f0da5e152f tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:15:05.767665 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a9ed05ab-80d4-4351-84de-c4f0da5e152f tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:15:05.768344 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a9ed05ab-80d4-4351-84de-c4f0da5e152f tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:15:05.768977 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a9ed05ab-80d4-4351-84de-c4f0da5e152f tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:15:05.769403 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a9ed05ab-80d4-4351-84de-c4f0da5e152f tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:15:05.912962 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-a9ed05ab-80d4-4351-84de-c4f0da5e152f tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799f987b3aa7426ba5d7a464052d6490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87474d4b4c547abbfe6308b6dd8e1c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:15:05.923520 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-a9ed05ab-80d4-4351-84de-c4f0da5e152f tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] 10.222.0.18 "GET /compute/v2.1/servers/5ec23653-3f53-406b-a0e3-1d3b3c683fb7" status: 200 len: 1308 microversion: 2.1 time: 0.169266 Oct 22 21:15:05.924116 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2412/4834] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:15:05 2022] GET /compute/v2.1/servers/5ec23653-3f53-406b-a0e3-1d3b3c683fb7 => generated 1308 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:15:06.946268 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-b8b22bd4-970e-4ef0-ade2-0ab40a9117c3 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:15:06.946881 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-b8b22bd4-970e-4ef0-ade2-0ab40a9117c3 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] [instance: 5ec23653-3f53-406b-a0e3-1d3b3c683fb7] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:15:06.954514 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b8b22bd4-970e-4ef0-ade2-0ab40a9117c3 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:15:06.955103 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b8b22bd4-970e-4ef0-ade2-0ab40a9117c3 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:15:06.955662 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b8b22bd4-970e-4ef0-ade2-0ab40a9117c3 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:15:06.956650 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b8b22bd4-970e-4ef0-ade2-0ab40a9117c3 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:15:06.957131 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b8b22bd4-970e-4ef0-ade2-0ab40a9117c3 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:15:06.957642 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b8b22bd4-970e-4ef0-ade2-0ab40a9117c3 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:15:07.102452 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-b8b22bd4-970e-4ef0-ade2-0ab40a9117c3 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799f987b3aa7426ba5d7a464052d6490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87474d4b4c547abbfe6308b6dd8e1c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:15:07.111039 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-b8b22bd4-970e-4ef0-ade2-0ab40a9117c3 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] 10.222.0.18 "GET /compute/v2.1/servers/5ec23653-3f53-406b-a0e3-1d3b3c683fb7" status: 200 len: 1308 microversion: 2.1 time: 0.168759 Oct 22 21:15:07.111727 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2423/4835] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:15:06 2022] GET /compute/v2.1/servers/5ec23653-3f53-406b-a0e3-1d3b3c683fb7 => generated 1308 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:15:08.134254 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-6269c8f3-9ce8-43ff-96bc-3772352960c7 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:15:08.134843 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-6269c8f3-9ce8-43ff-96bc-3772352960c7 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] [instance: 5ec23653-3f53-406b-a0e3-1d3b3c683fb7] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:15:08.142021 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6269c8f3-9ce8-43ff-96bc-3772352960c7 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:15:08.142510 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6269c8f3-9ce8-43ff-96bc-3772352960c7 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:15:08.142984 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6269c8f3-9ce8-43ff-96bc-3772352960c7 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:15:08.143672 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6269c8f3-9ce8-43ff-96bc-3772352960c7 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:15:08.144130 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6269c8f3-9ce8-43ff-96bc-3772352960c7 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:15:08.144558 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6269c8f3-9ce8-43ff-96bc-3772352960c7 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:15:08.280999 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-6269c8f3-9ce8-43ff-96bc-3772352960c7 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799f987b3aa7426ba5d7a464052d6490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87474d4b4c547abbfe6308b6dd8e1c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:15:08.289311 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-6269c8f3-9ce8-43ff-96bc-3772352960c7 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] 10.222.0.18 "GET /compute/v2.1/servers/5ec23653-3f53-406b-a0e3-1d3b3c683fb7" status: 200 len: 1308 microversion: 2.1 time: 0.159151 Oct 22 21:15:08.290109 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2413/4836] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:15:08 2022] GET /compute/v2.1/servers/5ec23653-3f53-406b-a0e3-1d3b3c683fb7 => generated 1308 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:15:09.313401 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-aeb4de8c-1dc2-481e-9a42-431c9b8eb52f tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:15:09.314035 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-aeb4de8c-1dc2-481e-9a42-431c9b8eb52f tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] [instance: 5ec23653-3f53-406b-a0e3-1d3b3c683fb7] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:15:09.321376 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-aeb4de8c-1dc2-481e-9a42-431c9b8eb52f tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:15:09.322244 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-aeb4de8c-1dc2-481e-9a42-431c9b8eb52f tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:15:09.322244 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-aeb4de8c-1dc2-481e-9a42-431c9b8eb52f tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:15:09.322917 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-aeb4de8c-1dc2-481e-9a42-431c9b8eb52f tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:15:09.323411 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-aeb4de8c-1dc2-481e-9a42-431c9b8eb52f tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:15:09.323855 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-aeb4de8c-1dc2-481e-9a42-431c9b8eb52f tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:15:09.487500 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-aeb4de8c-1dc2-481e-9a42-431c9b8eb52f tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799f987b3aa7426ba5d7a464052d6490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87474d4b4c547abbfe6308b6dd8e1c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:15:09.497694 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-aeb4de8c-1dc2-481e-9a42-431c9b8eb52f tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] 10.222.0.18 "GET /compute/v2.1/servers/5ec23653-3f53-406b-a0e3-1d3b3c683fb7" status: 200 len: 1308 microversion: 2.1 time: 0.188255 Oct 22 21:15:09.498510 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2424/4837] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:15:09 2022] GET /compute/v2.1/servers/5ec23653-3f53-406b-a0e3-1d3b3c683fb7 => generated 1308 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:15:10.523155 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-f3b96799-112b-45b3-aa5f-1af4c8e250ce tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:15:10.524136 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-f3b96799-112b-45b3-aa5f-1af4c8e250ce tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] [instance: 5ec23653-3f53-406b-a0e3-1d3b3c683fb7] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:15:10.532900 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell0:SELECT=2 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:15:10.535873 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell0:SELECT=6 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:15:10.536440 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f3b96799-112b-45b3-aa5f-1af4c8e250ce tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:15:10.537239 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f3b96799-112b-45b3-aa5f-1af4c8e250ce tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:15:10.538427 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f3b96799-112b-45b3-aa5f-1af4c8e250ce tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:15:10.540045 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f3b96799-112b-45b3-aa5f-1af4c8e250ce tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:15:10.540706 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f3b96799-112b-45b3-aa5f-1af4c8e250ce tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:15:10.541291 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f3b96799-112b-45b3-aa5f-1af4c8e250ce tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:15:10.766688 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-f3b96799-112b-45b3-aa5f-1af4c8e250ce tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799f987b3aa7426ba5d7a464052d6490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87474d4b4c547abbfe6308b6dd8e1c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:15:10.776157 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-f3b96799-112b-45b3-aa5f-1af4c8e250ce tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] 10.222.0.18 "GET /compute/v2.1/servers/5ec23653-3f53-406b-a0e3-1d3b3c683fb7" status: 200 len: 1308 microversion: 2.1 time: 0.258372 Oct 22 21:15:10.777364 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2414/4838] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:15:10 2022] GET /compute/v2.1/servers/5ec23653-3f53-406b-a0e3-1d3b3c683fb7 => generated 1308 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:15:11.067059 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell0:SELECT=2 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:15:11.437323 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-b5f785fb-731e-4657-872f-608f4f13bf51 req-718bc93f-b845-4bf6-afd1-2a86e1b141ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ec23653-3f53-406b-a0e3-1d3b3c683fb7", "name": "network-vif-plugged", "status": "completed", "tag": "b6bfb689-2181-4132-ace8-d7cd70041a0d"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:15:11.447700 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:15:11.450428 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-b5f785fb-731e-4657-872f-608f4f13bf51 req-718bc93f-b845-4bf6-afd1-2a86e1b141ca service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:15:11.451279 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-b5f785fb-731e-4657-872f-608f4f13bf51 req-718bc93f-b845-4bf6-afd1-2a86e1b141ca service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:15:11.452008 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-b5f785fb-731e-4657-872f-608f4f13bf51 req-718bc93f-b845-4bf6-afd1-2a86e1b141ca service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:15:11.468159 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-b5f785fb-731e-4657-872f-608f4f13bf51 req-718bc93f-b845-4bf6-afd1-2a86e1b141ca service nova] Creating event network-vif-plugged:b6bfb689-2181-4132-ace8-d7cd70041a0d for instance 5ec23653-3f53-406b-a0e3-1d3b3c683fb7 on nch2-master-1 Oct 22 21:15:11.475245 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-b5f785fb-731e-4657-872f-608f4f13bf51 req-718bc93f-b845-4bf6-afd1-2a86e1b141ca service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.422364 Oct 22 21:15:11.476105 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2425/4839] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:15:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:15:11.803418 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-27c0935a-10eb-4e2b-bcfe-97ce00d6de75 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:15:11.804743 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-27c0935a-10eb-4e2b-bcfe-97ce00d6de75 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] [instance: 5ec23653-3f53-406b-a0e3-1d3b3c683fb7] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:15:11.816623 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-27c0935a-10eb-4e2b-bcfe-97ce00d6de75 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:15:11.817543 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-27c0935a-10eb-4e2b-bcfe-97ce00d6de75 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:15:11.818249 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-27c0935a-10eb-4e2b-bcfe-97ce00d6de75 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:15:11.819178 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-27c0935a-10eb-4e2b-bcfe-97ce00d6de75 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:15:11.819824 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-27c0935a-10eb-4e2b-bcfe-97ce00d6de75 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:15:11.820435 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-27c0935a-10eb-4e2b-bcfe-97ce00d6de75 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:15:11.870211 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-596efb84-f3a9-4932-9cc6-4db43e35be10 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:15:11.877458 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-596efb84-f3a9-4932-9cc6-4db43e35be10 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] [instance: 34dcd1da-b94c-426b-b08b-204ea287c8a2] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:15:11.887090 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-596efb84-f3a9-4932-9cc6-4db43e35be10 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:15:11.888152 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-596efb84-f3a9-4932-9cc6-4db43e35be10 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:15:11.888646 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-596efb84-f3a9-4932-9cc6-4db43e35be10 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:15:11.889548 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-596efb84-f3a9-4932-9cc6-4db43e35be10 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:15:11.890148 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-596efb84-f3a9-4932-9cc6-4db43e35be10 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:15:11.891209 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-596efb84-f3a9-4932-9cc6-4db43e35be10 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:15:11.951092 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-596efb84-f3a9-4932-9cc6-4db43e35be10 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] 10.222.0.18 "GET /compute/v2.1/servers/34dcd1da-b94c-426b-b08b-204ea287c8a2/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.086365 Oct 22 21:15:11.960898 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2426/4840] 10.222.0.18 () {60 vars in 1343 bytes} [Sat Oct 22 21:15:11 2022] GET /compute/v2.1/servers/34dcd1da-b94c-426b-b08b-204ea287c8a2/os-volume_attachments => generated 25 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:15:12.062699 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-e2aa5cf4-422d-4fe1-8466-d5648686e474 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:15:12.063952 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-e2aa5cf4-422d-4fe1-8466-d5648686e474 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] [instance: 34dcd1da-b94c-426b-b08b-204ea287c8a2] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:15:12.072373 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e2aa5cf4-422d-4fe1-8466-d5648686e474 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:15:12.073651 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e2aa5cf4-422d-4fe1-8466-d5648686e474 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:15:12.074152 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e2aa5cf4-422d-4fe1-8466-d5648686e474 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:15:12.074869 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e2aa5cf4-422d-4fe1-8466-d5648686e474 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:15:12.075177 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-27c0935a-10eb-4e2b-bcfe-97ce00d6de75 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799f987b3aa7426ba5d7a464052d6490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87474d4b4c547abbfe6308b6dd8e1c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:15:12.075659 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e2aa5cf4-422d-4fe1-8466-d5648686e474 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:15:12.076253 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e2aa5cf4-422d-4fe1-8466-d5648686e474 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:15:12.090721 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-27c0935a-10eb-4e2b-bcfe-97ce00d6de75 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] 10.222.0.18 "GET /compute/v2.1/servers/5ec23653-3f53-406b-a0e3-1d3b3c683fb7" status: 200 len: 1308 microversion: 2.1 time: 0.291631 Oct 22 21:15:12.107674 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2415/4841] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:15:11 2022] GET /compute/v2.1/servers/5ec23653-3f53-406b-a0e3-1d3b3c683fb7 => generated 1308 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:15:12.114889 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-e2aa5cf4-422d-4fe1-8466-d5648686e474 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] [instance: 34dcd1da-b94c-426b-b08b-204ea287c8a2] Going to try to terminate instance {{(pid=138745) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 21:15:12.263476 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-e2aa5cf4-422d-4fe1-8466-d5648686e474 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] 10.222.0.18 "DELETE /compute/v2.1/servers/34dcd1da-b94c-426b-b08b-204ea287c8a2" status: 204 len: 0 microversion: 2.20 time: 0.205240 Oct 22 21:15:12.269518 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2427/4842] 10.222.0.18 () {60 vars in 1280 bytes} [Sat Oct 22 21:15:12 2022] DELETE /compute/v2.1/servers/34dcd1da-b94c-426b-b08b-204ea287c8a2 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 22 21:15:12.280178 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-f66357d1-5f41-4956-8a72-a16a0aa2ed60 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:15:12.280866 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-f66357d1-5f41-4956-8a72-a16a0aa2ed60 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] [instance: 34dcd1da-b94c-426b-b08b-204ea287c8a2] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:15:12.289013 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f66357d1-5f41-4956-8a72-a16a0aa2ed60 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:15:12.289510 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f66357d1-5f41-4956-8a72-a16a0aa2ed60 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:15:12.290014 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f66357d1-5f41-4956-8a72-a16a0aa2ed60 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:15:12.290829 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f66357d1-5f41-4956-8a72-a16a0aa2ed60 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:15:12.291521 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f66357d1-5f41-4956-8a72-a16a0aa2ed60 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:15:12.292146 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f66357d1-5f41-4956-8a72-a16a0aa2ed60 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:15:12.487517 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-f66357d1-5f41-4956-8a72-a16a0aa2ed60 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:15:12.503371 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-f66357d1-5f41-4956-8a72-a16a0aa2ed60 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:15:12.506188 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-f66357d1-5f41-4956-8a72-a16a0aa2ed60 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:15:12.507852 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-f66357d1-5f41-4956-8a72-a16a0aa2ed60 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] 10.222.0.18 "GET /compute/v2.1/servers/34dcd1da-b94c-426b-b08b-204ea287c8a2" status: 200 len: 1724 microversion: 2.20 time: 0.232239 Oct 22 21:15:12.508630 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2416/4843] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:15:12 2022] GET /compute/v2.1/servers/34dcd1da-b94c-426b-b08b-204ea287c8a2 => generated 1724 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:15:13.116134 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-0f054c49-0c8a-47ae-bdc0-740e67885b6f tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:15:13.116983 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-0f054c49-0c8a-47ae-bdc0-740e67885b6f tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] [instance: 5ec23653-3f53-406b-a0e3-1d3b3c683fb7] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:15:13.123994 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0f054c49-0c8a-47ae-bdc0-740e67885b6f tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:15:13.124495 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0f054c49-0c8a-47ae-bdc0-740e67885b6f tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:15:13.124953 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0f054c49-0c8a-47ae-bdc0-740e67885b6f tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:15:13.125672 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0f054c49-0c8a-47ae-bdc0-740e67885b6f tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:15:13.126143 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0f054c49-0c8a-47ae-bdc0-740e67885b6f tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:15:13.126767 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0f054c49-0c8a-47ae-bdc0-740e67885b6f tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:15:13.264553 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-0f054c49-0c8a-47ae-bdc0-740e67885b6f tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799f987b3aa7426ba5d7a464052d6490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87474d4b4c547abbfe6308b6dd8e1c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:15:13.272823 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-0f054c49-0c8a-47ae-bdc0-740e67885b6f tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] 10.222.0.18 "GET /compute/v2.1/servers/5ec23653-3f53-406b-a0e3-1d3b3c683fb7" status: 200 len: 1489 microversion: 2.1 time: 0.161228 Oct 22 21:15:13.273410 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2428/4844] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:15:13 2022] GET /compute/v2.1/servers/5ec23653-3f53-406b-a0e3-1d3b3c683fb7 => generated 1489 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:15:13.295512 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-0d72cc5f-0297-4403-ba56-cfed588fd9ee tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Action: 'update', calling method: >, body: {"server": {"accessIPv4": "1.1.1.1", "accessIPv6": "::babe:202:202"}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:15:13.298315 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-0d72cc5f-0297-4403-ba56-cfed588fd9ee tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] [instance: 5ec23653-3f53-406b-a0e3-1d3b3c683fb7] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:15:13.305373 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0d72cc5f-0297-4403-ba56-cfed588fd9ee tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:15:13.305906 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0d72cc5f-0297-4403-ba56-cfed588fd9ee tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:15:13.306385 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0d72cc5f-0297-4403-ba56-cfed588fd9ee tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:15:13.307143 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0d72cc5f-0297-4403-ba56-cfed588fd9ee tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:15:13.307680 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0d72cc5f-0297-4403-ba56-cfed588fd9ee tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:15:13.308158 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0d72cc5f-0297-4403-ba56-cfed588fd9ee tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:15:13.380410 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-0d72cc5f-0297-4403-ba56-cfed588fd9ee tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] 10.222.0.18 "PUT /compute/v2.1/servers/5ec23653-3f53-406b-a0e3-1d3b3c683fb7" status: 200 len: 1084 microversion: 2.1 time: 0.088797 Oct 22 21:15:13.381260 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2417/4845] 10.222.0.18 () {60 vars in 1256 bytes} [Sat Oct 22 21:15:13 2022] PUT /compute/v2.1/servers/5ec23653-3f53-406b-a0e3-1d3b3c683fb7 => generated 1084 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:15:13.400350 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-2b12ffa5-4256-4427-afb4-531faf4ce9c7 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:15:13.400977 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-2b12ffa5-4256-4427-afb4-531faf4ce9c7 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] [instance: 5ec23653-3f53-406b-a0e3-1d3b3c683fb7] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:15:13.407961 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2b12ffa5-4256-4427-afb4-531faf4ce9c7 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:15:13.408460 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2b12ffa5-4256-4427-afb4-531faf4ce9c7 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:15:13.409332 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2b12ffa5-4256-4427-afb4-531faf4ce9c7 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:15:13.409607 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2b12ffa5-4256-4427-afb4-531faf4ce9c7 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:15:13.410078 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2b12ffa5-4256-4427-afb4-531faf4ce9c7 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:15:13.410520 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2b12ffa5-4256-4427-afb4-531faf4ce9c7 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:15:13.538383 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-cf5639f9-a730-48d6-8d98-0924784db0f6 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:15:13.539013 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-cf5639f9-a730-48d6-8d98-0924784db0f6 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] [instance: 34dcd1da-b94c-426b-b08b-204ea287c8a2] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:15:13.546534 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cf5639f9-a730-48d6-8d98-0924784db0f6 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:15:13.547031 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cf5639f9-a730-48d6-8d98-0924784db0f6 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:15:13.547495 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cf5639f9-a730-48d6-8d98-0924784db0f6 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:15:13.548541 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cf5639f9-a730-48d6-8d98-0924784db0f6 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:15:13.549149 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cf5639f9-a730-48d6-8d98-0924784db0f6 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:15:13.549725 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cf5639f9-a730-48d6-8d98-0924784db0f6 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:15:13.565860 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-2b12ffa5-4256-4427-afb4-531faf4ce9c7 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799f987b3aa7426ba5d7a464052d6490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87474d4b4c547abbfe6308b6dd8e1c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:15:13.576396 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-2b12ffa5-4256-4427-afb4-531faf4ce9c7 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] 10.222.0.18 "GET /compute/v2.1/servers/5ec23653-3f53-406b-a0e3-1d3b3c683fb7" status: 200 len: 1510 microversion: 2.1 time: 0.180792 Oct 22 21:15:13.577106 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2429/4846] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:15:13 2022] GET /compute/v2.1/servers/5ec23653-3f53-406b-a0e3-1d3b3c683fb7 => generated 1510 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:15:13.600240 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-ff63434b-1847-4839-ba6c-f066da0046c1 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:15:13.601193 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-ff63434b-1847-4839-ba6c-f066da0046c1 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] [instance: 5ec23653-3f53-406b-a0e3-1d3b3c683fb7] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:15:13.608740 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ff63434b-1847-4839-ba6c-f066da0046c1 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:15:13.610167 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ff63434b-1847-4839-ba6c-f066da0046c1 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:15:13.610636 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ff63434b-1847-4839-ba6c-f066da0046c1 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:15:13.611554 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ff63434b-1847-4839-ba6c-f066da0046c1 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:15:13.612162 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ff63434b-1847-4839-ba6c-f066da0046c1 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:15:13.613050 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ff63434b-1847-4839-ba6c-f066da0046c1 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:15:13.753756 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-cf5639f9-a730-48d6-8d98-0924784db0f6 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:15:13.765982 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-cf5639f9-a730-48d6-8d98-0924784db0f6 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:15:13.767634 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-cf5639f9-a730-48d6-8d98-0924784db0f6 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:15:13.768899 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-cf5639f9-a730-48d6-8d98-0924784db0f6 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] 10.222.0.18 "GET /compute/v2.1/servers/34dcd1da-b94c-426b-b08b-204ea287c8a2" status: 200 len: 1724 microversion: 2.20 time: 0.234786 Oct 22 21:15:13.769760 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2418/4847] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:15:13 2022] GET /compute/v2.1/servers/34dcd1da-b94c-426b-b08b-204ea287c8a2 => generated 1724 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 22 21:15:13.815083 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-ff63434b-1847-4839-ba6c-f066da0046c1 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799f987b3aa7426ba5d7a464052d6490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87474d4b4c547abbfe6308b6dd8e1c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:15:13.823453 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-ff63434b-1847-4839-ba6c-f066da0046c1 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] 10.222.0.18 "GET /compute/v2.1/servers/5ec23653-3f53-406b-a0e3-1d3b3c683fb7" status: 200 len: 1510 microversion: 2.1 time: 0.228720 Oct 22 21:15:13.824288 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2430/4848] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:15:13 2022] GET /compute/v2.1/servers/5ec23653-3f53-406b-a0e3-1d3b3c683fb7 => generated 1510 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:15:13.846464 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-4381df2a-1147-42d8-a373-2701f526fca7 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:15:13.846975 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-4381df2a-1147-42d8-a373-2701f526fca7 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] [instance: 5ec23653-3f53-406b-a0e3-1d3b3c683fb7] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:15:13.853550 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4381df2a-1147-42d8-a373-2701f526fca7 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:15:13.854040 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4381df2a-1147-42d8-a373-2701f526fca7 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:15:13.854479 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4381df2a-1147-42d8-a373-2701f526fca7 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:15:13.855178 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4381df2a-1147-42d8-a373-2701f526fca7 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:15:13.855668 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4381df2a-1147-42d8-a373-2701f526fca7 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:15:13.856133 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4381df2a-1147-42d8-a373-2701f526fca7 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:15:13.885849 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-4381df2a-1147-42d8-a373-2701f526fca7 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] [instance: 5ec23653-3f53-406b-a0e3-1d3b3c683fb7] Going to try to terminate instance {{(pid=138744) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 21:15:13.979210 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-4381df2a-1147-42d8-a373-2701f526fca7 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] 10.222.0.18 "DELETE /compute/v2.1/servers/5ec23653-3f53-406b-a0e3-1d3b3c683fb7" status: 204 len: 0 microversion: 2.1 time: 0.136131 Oct 22 21:15:13.983370 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2419/4849] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 21:15:13 2022] DELETE /compute/v2.1/servers/5ec23653-3f53-406b-a0e3-1d3b3c683fb7 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 21:15:13.991590 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-6e42a37a-843d-440b-b79e-1f2e5ec04b20 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:15:13.991590 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-6e42a37a-843d-440b-b79e-1f2e5ec04b20 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] [instance: 5ec23653-3f53-406b-a0e3-1d3b3c683fb7] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:15:14.009745 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6e42a37a-843d-440b-b79e-1f2e5ec04b20 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:15:14.010586 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6e42a37a-843d-440b-b79e-1f2e5ec04b20 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:15:14.011103 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6e42a37a-843d-440b-b79e-1f2e5ec04b20 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:15:14.012464 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6e42a37a-843d-440b-b79e-1f2e5ec04b20 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:15:14.013135 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6e42a37a-843d-440b-b79e-1f2e5ec04b20 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:15:14.013733 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6e42a37a-843d-440b-b79e-1f2e5ec04b20 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:15:14.266055 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-6e42a37a-843d-440b-b79e-1f2e5ec04b20 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799f987b3aa7426ba5d7a464052d6490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87474d4b4c547abbfe6308b6dd8e1c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:15:14.276874 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-6e42a37a-843d-440b-b79e-1f2e5ec04b20 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] 10.222.0.18 "GET /compute/v2.1/servers/5ec23653-3f53-406b-a0e3-1d3b3c683fb7" status: 200 len: 1516 microversion: 2.1 time: 0.291869 Oct 22 21:15:14.278268 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2431/4850] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:15:13 2022] GET /compute/v2.1/servers/5ec23653-3f53-406b-a0e3-1d3b3c683fb7 => generated 1516 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:15:14.798916 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-a3cbefea-0786-49c5-99ba-2797fb5867c7 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:15:14.799736 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-a3cbefea-0786-49c5-99ba-2797fb5867c7 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] [instance: 34dcd1da-b94c-426b-b08b-204ea287c8a2] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:15:14.811849 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a3cbefea-0786-49c5-99ba-2797fb5867c7 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:15:14.812355 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a3cbefea-0786-49c5-99ba-2797fb5867c7 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:15:14.812794 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a3cbefea-0786-49c5-99ba-2797fb5867c7 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:15:14.815954 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a3cbefea-0786-49c5-99ba-2797fb5867c7 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:15:14.816430 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a3cbefea-0786-49c5-99ba-2797fb5867c7 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:15:14.816877 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a3cbefea-0786-49c5-99ba-2797fb5867c7 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:15:14.942105 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-5f760787-84a0-40f9-b39c-5afd947ba4a0 req-39356dfd-642e-4dc6-9d7f-db568f6dcb92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34dcd1da-b94c-426b-b08b-204ea287c8a2", "name": "network-vif-deleted", "tag": "692705ac-81f3-4f8a-bfa8-a2581d7d7567"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:15:14.958230 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-5f760787-84a0-40f9-b39c-5afd947ba4a0 req-39356dfd-642e-4dc6-9d7f-db568f6dcb92 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:15:14.958727 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-5f760787-84a0-40f9-b39c-5afd947ba4a0 req-39356dfd-642e-4dc6-9d7f-db568f6dcb92 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:15:14.962625 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-a3cbefea-0786-49c5-99ba-2797fb5867c7 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:15:14.974004 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-a3cbefea-0786-49c5-99ba-2797fb5867c7 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:15:14.976082 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-a3cbefea-0786-49c5-99ba-2797fb5867c7 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb24324c9c174645a3e9bc8bb913afe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f28cafad8942518b882192687b8b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:15:14.977283 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-a3cbefea-0786-49c5-99ba-2797fb5867c7 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] 10.222.0.18 "GET /compute/v2.1/servers/34dcd1da-b94c-426b-b08b-204ea287c8a2" status: 200 len: 1656 microversion: 2.20 time: 0.182710 Oct 22 21:15:14.977691 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-5f760787-84a0-40f9-b39c-5afd947ba4a0 req-39356dfd-642e-4dc6-9d7f-db568f6dcb92 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:15:14.993879 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2420/4851] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:15:14 2022] GET /compute/v2.1/servers/34dcd1da-b94c-426b-b08b-204ea287c8a2 => generated 1656 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:15:15.004821 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-5f760787-84a0-40f9-b39c-5afd947ba4a0 req-39356dfd-642e-4dc6-9d7f-db568f6dcb92 service nova] Creating event network-vif-deleted:692705ac-81f3-4f8a-bfa8-a2581d7d7567 for instance 34dcd1da-b94c-426b-b08b-204ea287c8a2 on nch1-master-1 Oct 22 21:15:15.015842 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-5f760787-84a0-40f9-b39c-5afd947ba4a0 req-39356dfd-642e-4dc6-9d7f-db568f6dcb92 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083529 Oct 22 21:15:15.020318 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2432/4852] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:15:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:15:15.304663 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-0d2c0a59-2e83-4225-be21-c85a6a4f0ea0 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:15:15.305679 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-0d2c0a59-2e83-4225-be21-c85a6a4f0ea0 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] [instance: 5ec23653-3f53-406b-a0e3-1d3b3c683fb7] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:15:15.321080 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0d2c0a59-2e83-4225-be21-c85a6a4f0ea0 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:15:15.321844 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0d2c0a59-2e83-4225-be21-c85a6a4f0ea0 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:15:15.322368 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0d2c0a59-2e83-4225-be21-c85a6a4f0ea0 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:15:15.323162 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0d2c0a59-2e83-4225-be21-c85a6a4f0ea0 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:15:15.323986 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0d2c0a59-2e83-4225-be21-c85a6a4f0ea0 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:15:15.324506 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0d2c0a59-2e83-4225-be21-c85a6a4f0ea0 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:15:15.953296 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-0d2c0a59-2e83-4225-be21-c85a6a4f0ea0 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799f987b3aa7426ba5d7a464052d6490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87474d4b4c547abbfe6308b6dd8e1c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:15:15.955791 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:15:15.968214 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-0d2c0a59-2e83-4225-be21-c85a6a4f0ea0 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] 10.222.0.18 "GET /compute/v2.1/servers/5ec23653-3f53-406b-a0e3-1d3b3c683fb7" status: 200 len: 1516 microversion: 2.1 time: 0.669787 Oct 22 21:15:15.968951 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2421/4853] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:15:15 2022] GET /compute/v2.1/servers/5ec23653-3f53-406b-a0e3-1d3b3c683fb7 => generated 1516 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:15:16.023037 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-8e32a2b5-49f7-4d9b-a4fa-846b8b3a25bd tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:15:16.023914 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-8e32a2b5-49f7-4d9b-a4fa-846b8b3a25bd tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] [instance: 34dcd1da-b94c-426b-b08b-204ea287c8a2] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:15:16.032629 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8e32a2b5-49f7-4d9b-a4fa-846b8b3a25bd tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:15:16.033230 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8e32a2b5-49f7-4d9b-a4fa-846b8b3a25bd tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:15:16.033733 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8e32a2b5-49f7-4d9b-a4fa-846b8b3a25bd tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:15:16.038509 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8e32a2b5-49f7-4d9b-a4fa-846b8b3a25bd tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:15:16.039004 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8e32a2b5-49f7-4d9b-a4fa-846b8b3a25bd tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:15:16.039673 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8e32a2b5-49f7-4d9b-a4fa-846b8b3a25bd tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:15:16.058153 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.wsgi [None req-8e32a2b5-49f7-4d9b-a4fa-846b8b3a25bd tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] HTTP exception thrown: Instance 34dcd1da-b94c-426b-b08b-204ea287c8a2 could not be found. Oct 22 21:15:16.060432 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-8e32a2b5-49f7-4d9b-a4fa-846b8b3a25bd tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Request method failure captured: Oct 22 21:15:16.060432 ncdv-master-1 devstack@n-api.service[138745]: request: GET /compute/v2.1/servers/34dcd1da-b94c-426b-b08b-204ea287c8a2 HTTP/1.1 Oct 22 21:15:16.060432 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 21:15:16.060432 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 21:15:16.060432 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 21:15:16.060432 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 0 Oct 22 21:15:16.060432 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 21:15:16.060432 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 21:15:16.060432 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 21:15:16.060432 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 21:15:16.060432 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVFugDsWG2IAzbMUoHuuhrO6MyXdPJkrInxcOEEmhduLReIFyY--04h_-SeI5urJWlmHW7uHeD0kBGwkXZkwP_QPcuM-pJyRnDk91VX__R2vNwtxynmOyv7o9Nh6PRqtk-VcxClrEgpoCZ7vTtPisBuUTEBcpL7ZpeZr-3H2SGnoohSM Oct 22 21:15:16.060432 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 21:15:16.060432 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 21:15:16.060432 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 21:15:16.060432 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 21:15:16.060432 ncdv-master-1 devstack@n-api.service[138745]: X-Openstack-Nova-Api-Version: 2.20 Oct 22 21:15:16.060432 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 21:15:16.060432 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 21:15:16.060432 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: f7f28cafad8942518b882192687b8b77 Oct 22 21:15:16.060432 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1454811106 Oct 22 21:15:16.060432 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 21:15:16.060432 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 21:15:16.060432 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_f7f28cafad8942518b882192687b8b77"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f7f28cafad8942518b882192687b8b77"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/f7f28cafad8942518b882192687b8b77"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f7f28cafad8942518b882192687b8b77"}]}] Oct 22 21:15:16.060432 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1454811106 Oct 22 21:15:16.060432 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: f7f28cafad8942518b882192687b8b77 Oct 22 21:15:16.060432 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1454811106 Oct 22 21:15:16.060432 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-AttachVolumeShelveTestJSON-1454811106-project Oct 22 21:15:16.060432 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 21:15:16.060432 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 21:15:16.060432 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: eb24324c9c174645a3e9bc8bb913afe9 Oct 22 21:15:16.060432 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1454811106-project Oct 22 21:15:16.060432 ncdv-master-1 devstack@n-api.service[138745]: method: > Oct 22 21:15:16.060432 ncdv-master-1 devstack@n-api.service[138745]: exception: Instance 34dcd1da-b94c-426b-b08b-204ea287c8a2 could not be found. Oct 22 21:15:16.060432 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'id': '34dcd1da-b94c-426b-b08b-204ea287c8a2'} Oct 22 21:15:16.060432 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:15:16.060432 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:15:16.060432 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 21:15:16.060432 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 21:15:16.060432 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 21:15:16.060432 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 21:15:16.060432 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 21:15:16.060432 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 21:15:16.060432 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 21:15:16.060432 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 21:15:16.060432 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 34dcd1da-b94c-426b-b08b-204ea287c8a2 could not be found. Oct 22 21:15:16.060432 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:15:16.060432 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:15:16.060432 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:15:16.060432 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:15:16.060432 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:15:16.060432 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:15:16.060432 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:15:16.060432 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:15:16.060432 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:15:16.060432 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:15:16.060432 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 21:15:16.060432 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 21:15:16.060432 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 21:15:16.060432 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 21:15:16.060432 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 21:15:16.060432 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:15:16.060432 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 34dcd1da-b94c-426b-b08b-204ea287c8a2 could not be found. Oct 22 21:15:16.060432 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:15:16.060432 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:15:16.064462 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:15:16.064462 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:15:16.064462 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:15:16.064462 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:15:16.064462 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:15:16.064462 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:15:16.064462 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 34dcd1da-b94c-426b-b08b-204ea287c8a2 could not be found. Oct 22 21:15:16.064462 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:15:16.065913 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-8e32a2b5-49f7-4d9b-a4fa-846b8b3a25bd tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Returning 404 to user: Instance 34dcd1da-b94c-426b-b08b-204ea287c8a2 could not be found. {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:15:16.066970 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-8e32a2b5-49f7-4d9b-a4fa-846b8b3a25bd tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] 10.222.0.18 "GET /compute/v2.1/servers/34dcd1da-b94c-426b-b08b-204ea287c8a2" status: 404 len: 111 microversion: 2.20 time: 0.049089 Oct 22 21:15:16.067732 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2433/4854] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:15:16 2022] GET /compute/v2.1/servers/34dcd1da-b94c-426b-b08b-204ea287c8a2 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 22 21:15:16.077865 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-9d619954-b71a-480e-b035-6945d92060ae tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Calling method '.version_select at 0x7fd39ed9dd30>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:15:16.103058 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-9d619954-b71a-480e-b035-6945d92060ae tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-825925012" status: 204 len: 0 microversion: 2.20 time: 0.030298 Oct 22 21:15:16.104090 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2422/4855] 10.222.0.18 () {60 vars in 1259 bytes} [Sat Oct 22 21:15:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-825925012 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 22 21:15:16.994392 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-8d44dad8-098c-4805-b443-5c59cd493247 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:15:16.995287 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-8d44dad8-098c-4805-b443-5c59cd493247 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] [instance: 5ec23653-3f53-406b-a0e3-1d3b3c683fb7] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:15:17.005239 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8d44dad8-098c-4805-b443-5c59cd493247 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:15:17.010572 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8d44dad8-098c-4805-b443-5c59cd493247 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:15:17.011146 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8d44dad8-098c-4805-b443-5c59cd493247 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:15:17.011959 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8d44dad8-098c-4805-b443-5c59cd493247 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:15:17.013053 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8d44dad8-098c-4805-b443-5c59cd493247 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:15:17.013646 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8d44dad8-098c-4805-b443-5c59cd493247 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:15:17.039550 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-e486b1f1-ebf1-4f7a-bb6b-f1623dda4d52 req-108c994f-fcfd-49d5-967e-664a571a65a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ec23653-3f53-406b-a0e3-1d3b3c683fb7", "name": "network-vif-deleted", "tag": "b6bfb689-2181-4132-ace8-d7cd70041a0d"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:15:17.056838 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-e486b1f1-ebf1-4f7a-bb6b-f1623dda4d52 req-108c994f-fcfd-49d5-967e-664a571a65a7 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:15:17.059784 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-e486b1f1-ebf1-4f7a-bb6b-f1623dda4d52 req-108c994f-fcfd-49d5-967e-664a571a65a7 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:15:17.060224 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8d44dad8-098c-4805-b443-5c59cd493247 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:15:17.060962 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-e486b1f1-ebf1-4f7a-bb6b-f1623dda4d52 req-108c994f-fcfd-49d5-967e-664a571a65a7 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:15:17.061790 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8d44dad8-098c-4805-b443-5c59cd493247 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:15:17.062268 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8d44dad8-098c-4805-b443-5c59cd493247 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:15:17.062746 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.objects.instance [None req-8d44dad8-098c-4805-b443-5c59cd493247 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lazy-loading 'fault' on Instance uuid 5ec23653-3f53-406b-a0e3-1d3b3c683fb7 {{(pid=138745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 21:15:17.075046 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-e486b1f1-ebf1-4f7a-bb6b-f1623dda4d52 req-108c994f-fcfd-49d5-967e-664a571a65a7 service nova] Creating event network-vif-deleted:b6bfb689-2181-4132-ace8-d7cd70041a0d for instance 5ec23653-3f53-406b-a0e3-1d3b3c683fb7 on nch2-master-1 Oct 22 21:15:17.083581 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-e486b1f1-ebf1-4f7a-bb6b-f1623dda4d52 req-108c994f-fcfd-49d5-967e-664a571a65a7 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049569 Oct 22 21:15:17.084399 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2423/4856] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:15:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:15:17.117196 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-8d44dad8-098c-4805-b443-5c59cd493247 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799f987b3aa7426ba5d7a464052d6490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87474d4b4c547abbfe6308b6dd8e1c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:15:17.125715 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-8d44dad8-098c-4805-b443-5c59cd493247 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] 10.222.0.18 "GET /compute/v2.1/servers/5ec23653-3f53-406b-a0e3-1d3b3c683fb7" status: 200 len: 1319 microversion: 2.1 time: 0.135790 Oct 22 21:15:17.126291 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2434/4857] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:15:16 2022] GET /compute/v2.1/servers/5ec23653-3f53-406b-a0e3-1d3b3c683fb7 => generated 1319 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:15:18.151650 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-c4e7ff59-2973-489d-975f-4101be55c1dd tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:15:18.152362 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-c4e7ff59-2973-489d-975f-4101be55c1dd tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] [instance: 5ec23653-3f53-406b-a0e3-1d3b3c683fb7] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:15:18.159103 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c4e7ff59-2973-489d-975f-4101be55c1dd tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:15:18.159630 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c4e7ff59-2973-489d-975f-4101be55c1dd tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:15:18.160076 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c4e7ff59-2973-489d-975f-4101be55c1dd tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:15:18.160786 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c4e7ff59-2973-489d-975f-4101be55c1dd tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:15:18.161432 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c4e7ff59-2973-489d-975f-4101be55c1dd tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:15:18.162141 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c4e7ff59-2973-489d-975f-4101be55c1dd tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:15:18.176658 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-c4e7ff59-2973-489d-975f-4101be55c1dd tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] HTTP exception thrown: Instance 5ec23653-3f53-406b-a0e3-1d3b3c683fb7 could not be found. Oct 22 21:15:18.179650 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-c4e7ff59-2973-489d-975f-4101be55c1dd tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Request method failure captured: Oct 22 21:15:18.179650 ncdv-master-1 devstack@n-api.service[138744]: request: GET /compute/v2.1/servers/5ec23653-3f53-406b-a0e3-1d3b3c683fb7 HTTP/1.1 Oct 22 21:15:18.179650 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 21:15:18.179650 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 21:15:18.179650 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 21:15:18.179650 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 0 Oct 22 21:15:18.179650 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 21:15:18.179650 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 21:15:18.179650 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 21:15:18.179650 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 21:15:18.179650 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVFzbjFuxlabhGO5W5IN5r54yzIxFa_mX4J74OzfXM08pyPGfws2Ww4pm5qGKXFC4h2Ttyt1JiFfrSI-ucQt7MPAhDqF8_tQs5Z1aGjJkE87trFhYgYaJFSihYuRhX8jAUHeeDuqMpE3BFEYcIHoIoAbD2BZHLThVUs-wQCfowY_4sFQ Oct 22 21:15:18.179650 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 21:15:18.179650 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 21:15:18.179650 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 21:15:18.179650 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 21:15:18.179650 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 21:15:18.179650 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 21:15:18.179650 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: e87474d4b4c547abbfe6308b6dd8e1c8 Oct 22 21:15:18.179650 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-ServersTestJSON-2007137082 Oct 22 21:15:18.179650 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 21:15:18.179650 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 21:15:18.179650 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_e87474d4b4c547abbfe6308b6dd8e1c8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e87474d4b4c547abbfe6308b6dd8e1c8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/e87474d4b4c547abbfe6308b6dd8e1c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e87474d4b4c547abbfe6308b6dd8e1c8"}]}] Oct 22 21:15:18.179650 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-ServersTestJSON-2007137082 Oct 22 21:15:18.179650 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: e87474d4b4c547abbfe6308b6dd8e1c8 Oct 22 21:15:18.179650 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-ServersTestJSON-2007137082 Oct 22 21:15:18.179650 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-ServersTestJSON-2007137082-project Oct 22 21:15:18.179650 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 21:15:18.179650 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 21:15:18.179650 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: 799f987b3aa7426ba5d7a464052d6490 Oct 22 21:15:18.179650 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-ServersTestJSON-2007137082-project Oct 22 21:15:18.179650 ncdv-master-1 devstack@n-api.service[138744]: method: > Oct 22 21:15:18.179650 ncdv-master-1 devstack@n-api.service[138744]: exception: Instance 5ec23653-3f53-406b-a0e3-1d3b3c683fb7 could not be found. Oct 22 21:15:18.179650 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': '5ec23653-3f53-406b-a0e3-1d3b3c683fb7'} Oct 22 21:15:18.179650 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:15:18.179650 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:15:18.179650 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 21:15:18.179650 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 21:15:18.179650 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 21:15:18.179650 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 21:15:18.179650 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 21:15:18.179650 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 21:15:18.179650 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 21:15:18.179650 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 21:15:18.179650 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ec23653-3f53-406b-a0e3-1d3b3c683fb7 could not be found. Oct 22 21:15:18.179650 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:15:18.179650 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:15:18.179650 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:15:18.179650 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:15:18.179650 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:15:18.179650 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:15:18.179650 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:15:18.179650 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:15:18.179650 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:15:18.179650 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:15:18.179650 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 21:15:18.179650 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 21:15:18.179650 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 21:15:18.179650 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 21:15:18.179650 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 21:15:18.179650 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:15:18.179650 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ec23653-3f53-406b-a0e3-1d3b3c683fb7 could not be found. Oct 22 21:15:18.179650 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:15:18.179650 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:15:18.179650 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:15:18.182958 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:15:18.182958 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:15:18.182958 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:15:18.182958 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:15:18.182958 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:15:18.182958 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ec23653-3f53-406b-a0e3-1d3b3c683fb7 could not be found. Oct 22 21:15:18.182958 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:15:18.185405 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-c4e7ff59-2973-489d-975f-4101be55c1dd tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Returning 404 to user: Instance 5ec23653-3f53-406b-a0e3-1d3b3c683fb7 could not be found. {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:15:18.186579 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-c4e7ff59-2973-489d-975f-4101be55c1dd tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] 10.222.0.18 "GET /compute/v2.1/servers/5ec23653-3f53-406b-a0e3-1d3b3c683fb7" status: 404 len: 111 microversion: 2.1 time: 0.040369 Oct 22 21:15:18.187285 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2424/4858] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:15:18 2022] GET /compute/v2.1/servers/5ec23653-3f53-406b-a0e3-1d3b3c683fb7 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 21:15:18.297088 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-793bb5f0-a673-477c-8c53-c0f485411592 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:15:18.298566 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-793bb5f0-a673-477c-8c53-c0f485411592 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] [instance: 34dcd1da-b94c-426b-b08b-204ea287c8a2] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:15:18.310012 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-793bb5f0-a673-477c-8c53-c0f485411592 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:15:18.310898 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-793bb5f0-a673-477c-8c53-c0f485411592 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:15:18.312221 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-793bb5f0-a673-477c-8c53-c0f485411592 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:15:18.313324 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-793bb5f0-a673-477c-8c53-c0f485411592 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:15:18.314016 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-793bb5f0-a673-477c-8c53-c0f485411592 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:15:18.314679 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-793bb5f0-a673-477c-8c53-c0f485411592 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:15:18.332752 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.wsgi [None req-793bb5f0-a673-477c-8c53-c0f485411592 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] HTTP exception thrown: Instance 34dcd1da-b94c-426b-b08b-204ea287c8a2 could not be found. Oct 22 21:15:18.334804 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-793bb5f0-a673-477c-8c53-c0f485411592 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Request method failure captured: Oct 22 21:15:18.334804 ncdv-master-1 devstack@n-api.service[138745]: request: DELETE /compute/v2.1/servers/34dcd1da-b94c-426b-b08b-204ea287c8a2 HTTP/1.1 Oct 22 21:15:18.334804 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 21:15:18.334804 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 21:15:18.334804 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 21:15:18.334804 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 0 Oct 22 21:15:18.334804 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 21:15:18.334804 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 21:15:18.334804 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 21:15:18.334804 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 21:15:18.334804 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVFugDsWG2IAzbMUoHuuhrO6MyXdPJkrInxcOEEmhduLReIFyY--04h_-SeI5urJWlmHW7uHeD0kBGwkXZkwP_QPcuM-pJyRnDk91VX__R2vNwtxynmOyv7o9Nh6PRqtk-VcxClrEgpoCZ7vTtPisBuUTEBcpL7ZpeZr-3H2SGnoohSM Oct 22 21:15:18.334804 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 21:15:18.334804 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 21:15:18.334804 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 21:15:18.334804 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 21:15:18.334804 ncdv-master-1 devstack@n-api.service[138745]: X-Openstack-Nova-Api-Version: 2.20 Oct 22 21:15:18.334804 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 21:15:18.334804 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 21:15:18.334804 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: f7f28cafad8942518b882192687b8b77 Oct 22 21:15:18.334804 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1454811106 Oct 22 21:15:18.334804 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 21:15:18.334804 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 21:15:18.334804 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_f7f28cafad8942518b882192687b8b77"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f7f28cafad8942518b882192687b8b77"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/f7f28cafad8942518b882192687b8b77"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f7f28cafad8942518b882192687b8b77"}]}] Oct 22 21:15:18.334804 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1454811106 Oct 22 21:15:18.334804 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: f7f28cafad8942518b882192687b8b77 Oct 22 21:15:18.334804 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1454811106 Oct 22 21:15:18.334804 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-AttachVolumeShelveTestJSON-1454811106-project Oct 22 21:15:18.334804 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 21:15:18.334804 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 21:15:18.334804 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: eb24324c9c174645a3e9bc8bb913afe9 Oct 22 21:15:18.334804 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1454811106-project Oct 22 21:15:18.334804 ncdv-master-1 devstack@n-api.service[138745]: method: > Oct 22 21:15:18.334804 ncdv-master-1 devstack@n-api.service[138745]: exception: Instance 34dcd1da-b94c-426b-b08b-204ea287c8a2 could not be found. Oct 22 21:15:18.334804 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'id': '34dcd1da-b94c-426b-b08b-204ea287c8a2'} Oct 22 21:15:18.334804 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:15:18.334804 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:15:18.334804 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 21:15:18.334804 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 21:15:18.334804 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 21:15:18.334804 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 21:15:18.334804 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 21:15:18.334804 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 21:15:18.334804 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 21:15:18.334804 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 21:15:18.334804 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 34dcd1da-b94c-426b-b08b-204ea287c8a2 could not be found. Oct 22 21:15:18.334804 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:15:18.334804 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:15:18.334804 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:15:18.334804 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:15:18.334804 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:15:18.334804 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:15:18.334804 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:15:18.334804 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:15:18.334804 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:15:18.334804 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:15:18.334804 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 22 21:15:18.334804 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 22 21:15:18.334804 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 22 21:15:18.334804 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 22 21:15:18.334804 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 21:15:18.334804 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 21:15:18.334804 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 21:15:18.334804 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:15:18.338890 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 34dcd1da-b94c-426b-b08b-204ea287c8a2 could not be found. Oct 22 21:15:18.338890 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:15:18.338890 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:15:18.338890 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:15:18.338890 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:15:18.338890 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:15:18.338890 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:15:18.338890 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:15:18.338890 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:15:18.338890 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 34dcd1da-b94c-426b-b08b-204ea287c8a2 could not be found. Oct 22 21:15:18.338890 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:15:18.340581 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-793bb5f0-a673-477c-8c53-c0f485411592 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Returning 404 to user: Instance 34dcd1da-b94c-426b-b08b-204ea287c8a2 could not be found. {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:15:18.341737 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-793bb5f0-a673-477c-8c53-c0f485411592 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] 10.222.0.18 "DELETE /compute/v2.1/servers/34dcd1da-b94c-426b-b08b-204ea287c8a2" status: 404 len: 111 microversion: 2.20 time: 0.050163 Oct 22 21:15:18.342758 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2435/4859] 10.222.0.18 () {60 vars in 1280 bytes} [Sat Oct 22 21:15:18 2022] DELETE /compute/v2.1/servers/34dcd1da-b94c-426b-b08b-204ea287c8a2 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 22 21:15:18.345458 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-e07b626f-ac5a-430c-99d5-678c70d6fe32 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-352152825", "imageRef": "085e4478-6edc-4a69-8e08-f9831713eb65", "flavorRef": "452", "networks": [{"uuid": "ea7e3c31-2bc2-4b4f-ab48-7d75cccdd3b0"}]}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:15:18.353831 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-0011a8ad-cccf-44fc-8f17-faf7383fbef2 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:15:18.354718 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-0011a8ad-cccf-44fc-8f17-faf7383fbef2 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] [instance: 34dcd1da-b94c-426b-b08b-204ea287c8a2] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:15:18.366470 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0011a8ad-cccf-44fc-8f17-faf7383fbef2 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:15:18.367250 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0011a8ad-cccf-44fc-8f17-faf7383fbef2 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:15:18.367938 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0011a8ad-cccf-44fc-8f17-faf7383fbef2 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:15:18.371077 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0011a8ad-cccf-44fc-8f17-faf7383fbef2 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:15:18.372081 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0011a8ad-cccf-44fc-8f17-faf7383fbef2 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:15:18.384331 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0011a8ad-cccf-44fc-8f17-faf7383fbef2 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:15:18.406116 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.wsgi [None req-0011a8ad-cccf-44fc-8f17-faf7383fbef2 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] HTTP exception thrown: Instance 34dcd1da-b94c-426b-b08b-204ea287c8a2 could not be found. Oct 22 21:15:18.408104 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-0011a8ad-cccf-44fc-8f17-faf7383fbef2 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Request method failure captured: Oct 22 21:15:18.408104 ncdv-master-1 devstack@n-api.service[138745]: request: GET /compute/v2.1/servers/34dcd1da-b94c-426b-b08b-204ea287c8a2 HTTP/1.1 Oct 22 21:15:18.408104 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 21:15:18.408104 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 21:15:18.408104 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 21:15:18.408104 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 0 Oct 22 21:15:18.408104 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 21:15:18.408104 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 21:15:18.408104 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 21:15:18.408104 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 21:15:18.408104 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVFugDsWG2IAzbMUoHuuhrO6MyXdPJkrInxcOEEmhduLReIFyY--04h_-SeI5urJWlmHW7uHeD0kBGwkXZkwP_QPcuM-pJyRnDk91VX__R2vNwtxynmOyv7o9Nh6PRqtk-VcxClrEgpoCZ7vTtPisBuUTEBcpL7ZpeZr-3H2SGnoohSM Oct 22 21:15:18.408104 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 21:15:18.408104 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 21:15:18.408104 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 21:15:18.408104 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 21:15:18.408104 ncdv-master-1 devstack@n-api.service[138745]: X-Openstack-Nova-Api-Version: 2.20 Oct 22 21:15:18.408104 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 21:15:18.408104 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 21:15:18.408104 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: f7f28cafad8942518b882192687b8b77 Oct 22 21:15:18.408104 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1454811106 Oct 22 21:15:18.408104 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 21:15:18.408104 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 21:15:18.408104 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_f7f28cafad8942518b882192687b8b77"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f7f28cafad8942518b882192687b8b77"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/f7f28cafad8942518b882192687b8b77"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f7f28cafad8942518b882192687b8b77"}]}] Oct 22 21:15:18.408104 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1454811106 Oct 22 21:15:18.408104 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: f7f28cafad8942518b882192687b8b77 Oct 22 21:15:18.408104 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1454811106 Oct 22 21:15:18.408104 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-AttachVolumeShelveTestJSON-1454811106-project Oct 22 21:15:18.408104 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 21:15:18.408104 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 21:15:18.408104 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: eb24324c9c174645a3e9bc8bb913afe9 Oct 22 21:15:18.408104 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1454811106-project Oct 22 21:15:18.408104 ncdv-master-1 devstack@n-api.service[138745]: method: > Oct 22 21:15:18.408104 ncdv-master-1 devstack@n-api.service[138745]: exception: Instance 34dcd1da-b94c-426b-b08b-204ea287c8a2 could not be found. Oct 22 21:15:18.408104 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'id': '34dcd1da-b94c-426b-b08b-204ea287c8a2'} Oct 22 21:15:18.408104 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:15:18.408104 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:15:18.408104 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 21:15:18.408104 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 21:15:18.408104 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 21:15:18.408104 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 21:15:18.408104 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 21:15:18.408104 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 21:15:18.408104 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 21:15:18.408104 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 21:15:18.408104 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 34dcd1da-b94c-426b-b08b-204ea287c8a2 could not be found. Oct 22 21:15:18.408104 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:15:18.408104 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:15:18.408104 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:15:18.408104 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:15:18.408104 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:15:18.408104 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:15:18.408104 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:15:18.408104 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:15:18.408104 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:15:18.408104 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:15:18.408104 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 21:15:18.408104 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 21:15:18.408104 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 21:15:18.408104 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 21:15:18.408104 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 21:15:18.408104 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:15:18.408104 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 34dcd1da-b94c-426b-b08b-204ea287c8a2 could not be found. Oct 22 21:15:18.408104 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:15:18.408104 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:15:18.413090 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:15:18.413090 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:15:18.413090 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:15:18.413090 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:15:18.413090 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:15:18.413090 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:15:18.413090 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 34dcd1da-b94c-426b-b08b-204ea287c8a2 could not be found. Oct 22 21:15:18.413090 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:15:18.414792 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-0011a8ad-cccf-44fc-8f17-faf7383fbef2 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Returning 404 to user: Instance 34dcd1da-b94c-426b-b08b-204ea287c8a2 could not be found. {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:15:18.416708 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-0011a8ad-cccf-44fc-8f17-faf7383fbef2 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] 10.222.0.18 "GET /compute/v2.1/servers/34dcd1da-b94c-426b-b08b-204ea287c8a2" status: 404 len: 111 microversion: 2.20 time: 0.069293 Oct 22 21:15:18.417936 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2436/4860] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:15:18 2022] GET /compute/v2.1/servers/34dcd1da-b94c-426b-b08b-204ea287c8a2 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 22 21:15:18.447308 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.network.neutron [None req-e07b626f-ac5a-430c-99d5-678c70d6fe32 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] validate_networks() for [('ea7e3c31-2bc2-4b4f-ab48-7d75cccdd3b0', None, None, None, None, None)] {{(pid=138744) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 21:15:19.325597 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-43df6f60-6f18-4fa5-95e4-919639f71571 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:15:19.326716 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-43df6f60-6f18-4fa5-95e4-919639f71571 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] [instance: 5c197028-ff9e-46ff-81f4-0feb4748da97] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:15:19.328687 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-e07b626f-ac5a-430c-99d5-678c70d6fe32 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Flavor limits 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 21:15:19.329837 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-e07b626f-ac5a-430c-99d5-678c70d6fe32 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Image limits 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 21:15:19.330324 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-e07b626f-ac5a-430c-99d5-678c70d6fe32 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Flavor pref 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 21:15:19.330889 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-e07b626f-ac5a-430c-99d5-678c70d6fe32 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Image pref 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 21:15:19.331530 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-e07b626f-ac5a-430c-99d5-678c70d6fe32 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 21:15:19.338693 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-43df6f60-6f18-4fa5-95e4-919639f71571 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:15:19.339277 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-43df6f60-6f18-4fa5-95e4-919639f71571 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:15:19.340810 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-43df6f60-6f18-4fa5-95e4-919639f71571 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:15:19.342293 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-43df6f60-6f18-4fa5-95e4-919639f71571 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:15:19.343008 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-43df6f60-6f18-4fa5-95e4-919639f71571 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:15:19.343598 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-43df6f60-6f18-4fa5-95e4-919639f71571 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:15:19.343703 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e07b626f-ac5a-430c-99d5-678c70d6fe32 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:15:19.344070 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e07b626f-ac5a-430c-99d5-678c70d6fe32 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:15:19.344917 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e07b626f-ac5a-430c-99d5-678c70d6fe32 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:15:19.345849 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e07b626f-ac5a-430c-99d5-678c70d6fe32 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:15:19.346476 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e07b626f-ac5a-430c-99d5-678c70d6fe32 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:15:19.347072 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e07b626f-ac5a-430c-99d5-678c70d6fe32 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:15:19.377554 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-e07b626f-ac5a-430c-99d5-678c70d6fe32 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Getting quotas for project e87474d4b4c547abbfe6308b6dd8e1c8. Resources: {'cores', 'instances', 'ram'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 21:15:19.383487 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-43df6f60-6f18-4fa5-95e4-919639f71571 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] [instance: 5c197028-ff9e-46ff-81f4-0feb4748da97] Going to try to terminate instance {{(pid=138745) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 21:15:19.384873 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-e07b626f-ac5a-430c-99d5-678c70d6fe32 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Getting quotas for user 799f987b3aa7426ba5d7a464052d6490 and project e87474d4b4c547abbfe6308b6dd8e1c8. Resources: {'cores', 'instances', 'ram'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 21:15:19.389750 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=3,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:15:19.402727 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-e07b626f-ac5a-430c-99d5-678c70d6fe32 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Going to run 1 instances... {{(pid=138744) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 21:15:19.406239 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-e07b626f-ac5a-430c-99d5-678c70d6fe32 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] [instance: 803a198e-9b90-4fb4-85fa-e1131abf9517] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='085e4478-6edc-4a69-8e08-f9831713eb65',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138744) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 21:15:19.444459 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:15:19.478248 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-e07b626f-ac5a-430c-99d5-678c70d6fe32 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.137061 Oct 22 21:15:19.480445 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2425/4861] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Oct 22 21:15:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 1144 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 21:15:19.494013 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-67f4fd4e-e769-45ec-8b1b-82b0330f1784 req-64b81318-70ac-46cf-a0ce-db0423c057f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c197028-ff9e-46ff-81f4-0feb4748da97", "tag": "c5e164ee-0bd2-495e-9036-a2f07d700b5e"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:15:19.508315 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-67f4fd4e-e769-45ec-8b1b-82b0330f1784 req-64b81318-70ac-46cf-a0ce-db0423c057f5 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:15:19.508535 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-43df6f60-6f18-4fa5-95e4-919639f71571 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] 10.222.0.18 "DELETE /compute/v2.1/servers/5c197028-ff9e-46ff-81f4-0feb4748da97" status: 204 len: 0 microversion: 2.1 time: 0.187060 Oct 22 21:15:19.509782 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-67f4fd4e-e769-45ec-8b1b-82b0330f1784 req-64b81318-70ac-46cf-a0ce-db0423c057f5 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:15:19.510336 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-67f4fd4e-e769-45ec-8b1b-82b0330f1784 req-64b81318-70ac-46cf-a0ce-db0423c057f5 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:15:19.517771 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2437/4862] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 21:15:19 2022] DELETE /compute/v2.1/servers/5c197028-ff9e-46ff-81f4-0feb4748da97 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 21:15:19.527518 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-67f4fd4e-e769-45ec-8b1b-82b0330f1784 req-64b81318-70ac-46cf-a0ce-db0423c057f5 service nova] Creating event network-changed:c5e164ee-0bd2-495e-9036-a2f07d700b5e for instance 5c197028-ff9e-46ff-81f4-0feb4748da97 on nch1-master-1 Oct 22 21:15:19.534768 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-67f4fd4e-e769-45ec-8b1b-82b0330f1784 req-64b81318-70ac-46cf-a0ce-db0423c057f5 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052313 Oct 22 21:15:19.536088 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2426/4863] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:15:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:15:19.540987 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-65185c27-4015-40ae-bb51-294d3bdd59c0 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:15:19.560017 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-65185c27-4015-40ae-bb51-294d3bdd59c0 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] [instance: 803a198e-9b90-4fb4-85fa-e1131abf9517] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:15:19.564608 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-5e391a3c-2af8-4200-ac55-3c12880eb5cc tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:15:19.565654 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-5e391a3c-2af8-4200-ac55-3c12880eb5cc tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] [instance: 5c197028-ff9e-46ff-81f4-0feb4748da97] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:15:19.573321 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5e391a3c-2af8-4200-ac55-3c12880eb5cc tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:15:19.574171 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5e391a3c-2af8-4200-ac55-3c12880eb5cc tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:15:19.574816 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5e391a3c-2af8-4200-ac55-3c12880eb5cc tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:15:19.575924 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5e391a3c-2af8-4200-ac55-3c12880eb5cc tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:15:19.576689 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5e391a3c-2af8-4200-ac55-3c12880eb5cc tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:15:19.577324 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5e391a3c-2af8-4200-ac55-3c12880eb5cc tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:15:19.693992 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-65185c27-4015-40ae-bb51-294d3bdd59c0 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799f987b3aa7426ba5d7a464052d6490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87474d4b4c547abbfe6308b6dd8e1c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:15:19.702960 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-65185c27-4015-40ae-bb51-294d3bdd59c0 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] 10.222.0.18 "GET /compute/v2.1/servers/803a198e-9b90-4fb4-85fa-e1131abf9517" status: 200 len: 1208 microversion: 2.1 time: 0.182074 Oct 22 21:15:19.706293 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2438/4864] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:15:19 2022] GET /compute/v2.1/servers/803a198e-9b90-4fb4-85fa-e1131abf9517 => generated 1208 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:15:19.713971 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-e4b165f0-7e6e-4cfe-973a-c6bb50947328 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:15:19.714698 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-e4b165f0-7e6e-4cfe-973a-c6bb50947328 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] [instance: cc7f1980-ecea-437f-ac71-0cdb6ec626b9] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:15:19.738809 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e4b165f0-7e6e-4cfe-973a-c6bb50947328 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:15:19.739528 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e4b165f0-7e6e-4cfe-973a-c6bb50947328 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:15:19.740307 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e4b165f0-7e6e-4cfe-973a-c6bb50947328 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:15:19.741282 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e4b165f0-7e6e-4cfe-973a-c6bb50947328 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:15:19.741901 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e4b165f0-7e6e-4cfe-973a-c6bb50947328 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:15:19.742829 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e4b165f0-7e6e-4cfe-973a-c6bb50947328 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:15:19.789572 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.wsgi [None req-e4b165f0-7e6e-4cfe-973a-c6bb50947328 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] HTTP exception thrown: Instance cc7f1980-ecea-437f-ac71-0cdb6ec626b9 could not be found. Oct 22 21:15:19.791923 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-e4b165f0-7e6e-4cfe-973a-c6bb50947328 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Request method failure captured: Oct 22 21:15:19.791923 ncdv-master-1 devstack@n-api.service[138745]: request: DELETE /compute/v2.1/servers/cc7f1980-ecea-437f-ac71-0cdb6ec626b9 HTTP/1.1 Oct 22 21:15:19.791923 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 21:15:19.791923 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 21:15:19.791923 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 21:15:19.791923 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 0 Oct 22 21:15:19.791923 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 21:15:19.791923 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 21:15:19.791923 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 21:15:19.791923 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 21:15:19.791923 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVFugDsWG2IAzbMUoHuuhrO6MyXdPJkrInxcOEEmhduLReIFyY--04h_-SeI5urJWlmHW7uHeD0kBGwkXZkwP_QPcuM-pJyRnDk91VX__R2vNwtxynmOyv7o9Nh6PRqtk-VcxClrEgpoCZ7vTtPisBuUTEBcpL7ZpeZr-3H2SGnoohSM Oct 22 21:15:19.791923 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 21:15:19.791923 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 21:15:19.791923 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 21:15:19.791923 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 21:15:19.791923 ncdv-master-1 devstack@n-api.service[138745]: X-Openstack-Nova-Api-Version: 2.20 Oct 22 21:15:19.791923 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 21:15:19.791923 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 21:15:19.791923 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: f7f28cafad8942518b882192687b8b77 Oct 22 21:15:19.791923 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1454811106 Oct 22 21:15:19.791923 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 21:15:19.791923 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 21:15:19.791923 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_f7f28cafad8942518b882192687b8b77"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f7f28cafad8942518b882192687b8b77"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/f7f28cafad8942518b882192687b8b77"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f7f28cafad8942518b882192687b8b77"}]}] Oct 22 21:15:19.791923 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1454811106 Oct 22 21:15:19.791923 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: f7f28cafad8942518b882192687b8b77 Oct 22 21:15:19.791923 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1454811106 Oct 22 21:15:19.791923 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-AttachVolumeShelveTestJSON-1454811106-project Oct 22 21:15:19.791923 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 21:15:19.791923 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 21:15:19.791923 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: eb24324c9c174645a3e9bc8bb913afe9 Oct 22 21:15:19.791923 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1454811106-project Oct 22 21:15:19.791923 ncdv-master-1 devstack@n-api.service[138745]: method: > Oct 22 21:15:19.791923 ncdv-master-1 devstack@n-api.service[138745]: exception: Instance cc7f1980-ecea-437f-ac71-0cdb6ec626b9 could not be found. Oct 22 21:15:19.791923 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'id': 'cc7f1980-ecea-437f-ac71-0cdb6ec626b9'} Oct 22 21:15:19.791923 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:15:19.791923 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:15:19.791923 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 21:15:19.791923 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 21:15:19.791923 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 21:15:19.791923 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 21:15:19.791923 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 21:15:19.791923 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 21:15:19.791923 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 21:15:19.791923 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 21:15:19.791923 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc7f1980-ecea-437f-ac71-0cdb6ec626b9 could not be found. Oct 22 21:15:19.791923 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:15:19.791923 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:15:19.791923 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:15:19.791923 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:15:19.791923 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:15:19.791923 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:15:19.791923 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:15:19.791923 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:15:19.791923 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:15:19.791923 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:15:19.791923 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 22 21:15:19.791923 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 22 21:15:19.791923 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 22 21:15:19.791923 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 22 21:15:19.791923 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 21:15:19.791923 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 21:15:19.791923 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 21:15:19.791923 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:15:19.795813 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc7f1980-ecea-437f-ac71-0cdb6ec626b9 could not be found. Oct 22 21:15:19.795813 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:15:19.795813 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:15:19.795813 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:15:19.795813 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:15:19.795813 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:15:19.795813 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:15:19.795813 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:15:19.795813 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:15:19.795813 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc7f1980-ecea-437f-ac71-0cdb6ec626b9 could not be found. Oct 22 21:15:19.795813 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:15:19.797546 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-e4b165f0-7e6e-4cfe-973a-c6bb50947328 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Returning 404 to user: Instance cc7f1980-ecea-437f-ac71-0cdb6ec626b9 could not be found. {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:15:19.798673 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-e4b165f0-7e6e-4cfe-973a-c6bb50947328 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] 10.222.0.18 "DELETE /compute/v2.1/servers/cc7f1980-ecea-437f-ac71-0cdb6ec626b9" status: 404 len: 111 microversion: 2.20 time: 0.090955 Oct 22 21:15:19.799493 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2439/4865] 10.222.0.18 () {60 vars in 1280 bytes} [Sat Oct 22 21:15:19 2022] DELETE /compute/v2.1/servers/cc7f1980-ecea-437f-ac71-0cdb6ec626b9 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 22 21:15:19.815527 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-adb76ef7-cf7b-45f8-806a-e8acc9319388 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:15:19.816529 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-adb76ef7-cf7b-45f8-806a-e8acc9319388 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] [instance: cc7f1980-ecea-437f-ac71-0cdb6ec626b9] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:15:19.824211 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-adb76ef7-cf7b-45f8-806a-e8acc9319388 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:15:19.824991 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-adb76ef7-cf7b-45f8-806a-e8acc9319388 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:15:19.825609 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-adb76ef7-cf7b-45f8-806a-e8acc9319388 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:15:19.826512 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-adb76ef7-cf7b-45f8-806a-e8acc9319388 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:15:19.827568 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-adb76ef7-cf7b-45f8-806a-e8acc9319388 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:15:19.828179 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-adb76ef7-cf7b-45f8-806a-e8acc9319388 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:15:19.848147 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-5e391a3c-2af8-4200-ac55-3c12880eb5cc tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3820b31a424c3a9216a6ef91fcb285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a42c3ecf474883ac652fcc8c01c9f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:15:19.852448 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.wsgi [None req-adb76ef7-cf7b-45f8-806a-e8acc9319388 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] HTTP exception thrown: Instance cc7f1980-ecea-437f-ac71-0cdb6ec626b9 could not be found. Oct 22 21:15:19.854187 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-adb76ef7-cf7b-45f8-806a-e8acc9319388 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Request method failure captured: Oct 22 21:15:19.854187 ncdv-master-1 devstack@n-api.service[138745]: request: GET /compute/v2.1/servers/cc7f1980-ecea-437f-ac71-0cdb6ec626b9 HTTP/1.1 Oct 22 21:15:19.854187 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 21:15:19.854187 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 21:15:19.854187 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 21:15:19.854187 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 0 Oct 22 21:15:19.854187 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 21:15:19.854187 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 21:15:19.854187 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 21:15:19.854187 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 21:15:19.854187 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVFugDsWG2IAzbMUoHuuhrO6MyXdPJkrInxcOEEmhduLReIFyY--04h_-SeI5urJWlmHW7uHeD0kBGwkXZkwP_QPcuM-pJyRnDk91VX__R2vNwtxynmOyv7o9Nh6PRqtk-VcxClrEgpoCZ7vTtPisBuUTEBcpL7ZpeZr-3H2SGnoohSM Oct 22 21:15:19.854187 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 21:15:19.854187 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 21:15:19.854187 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 21:15:19.854187 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 21:15:19.854187 ncdv-master-1 devstack@n-api.service[138745]: X-Openstack-Nova-Api-Version: 2.20 Oct 22 21:15:19.854187 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 21:15:19.854187 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 21:15:19.854187 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: f7f28cafad8942518b882192687b8b77 Oct 22 21:15:19.854187 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1454811106 Oct 22 21:15:19.854187 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 21:15:19.854187 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 21:15:19.854187 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_f7f28cafad8942518b882192687b8b77"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f7f28cafad8942518b882192687b8b77"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/f7f28cafad8942518b882192687b8b77"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f7f28cafad8942518b882192687b8b77"}]}] Oct 22 21:15:19.854187 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1454811106 Oct 22 21:15:19.854187 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: f7f28cafad8942518b882192687b8b77 Oct 22 21:15:19.854187 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1454811106 Oct 22 21:15:19.854187 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-AttachVolumeShelveTestJSON-1454811106-project Oct 22 21:15:19.854187 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 21:15:19.854187 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 21:15:19.854187 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: eb24324c9c174645a3e9bc8bb913afe9 Oct 22 21:15:19.854187 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1454811106-project Oct 22 21:15:19.854187 ncdv-master-1 devstack@n-api.service[138745]: method: > Oct 22 21:15:19.854187 ncdv-master-1 devstack@n-api.service[138745]: exception: Instance cc7f1980-ecea-437f-ac71-0cdb6ec626b9 could not be found. Oct 22 21:15:19.854187 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'id': 'cc7f1980-ecea-437f-ac71-0cdb6ec626b9'} Oct 22 21:15:19.854187 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:15:19.854187 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:15:19.854187 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 21:15:19.854187 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 21:15:19.854187 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 21:15:19.854187 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 21:15:19.854187 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 21:15:19.854187 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 21:15:19.854187 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 21:15:19.854187 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 21:15:19.854187 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc7f1980-ecea-437f-ac71-0cdb6ec626b9 could not be found. Oct 22 21:15:19.854187 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:15:19.854187 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:15:19.854187 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:15:19.854187 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:15:19.854187 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:15:19.854187 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:15:19.854187 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:15:19.854187 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:15:19.854187 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:15:19.854187 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:15:19.854187 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 21:15:19.854187 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 21:15:19.854187 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 21:15:19.854187 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 21:15:19.854187 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 21:15:19.854187 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:15:19.854187 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc7f1980-ecea-437f-ac71-0cdb6ec626b9 could not be found. Oct 22 21:15:19.854187 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:15:19.854187 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:15:19.858788 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:15:19.858788 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:15:19.858788 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:15:19.858788 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:15:19.858788 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:15:19.858788 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:15:19.858788 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc7f1980-ecea-437f-ac71-0cdb6ec626b9 could not be found. Oct 22 21:15:19.858788 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:15:19.858788 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-adb76ef7-cf7b-45f8-806a-e8acc9319388 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] Returning 404 to user: Instance cc7f1980-ecea-437f-ac71-0cdb6ec626b9 could not be found. {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:15:19.858788 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-adb76ef7-cf7b-45f8-806a-e8acc9319388 tempest-AttachVolumeShelveTestJSON-1454811106 tempest-AttachVolumeShelveTestJSON-1454811106-project] 10.222.0.18 "GET /compute/v2.1/servers/cc7f1980-ecea-437f-ac71-0cdb6ec626b9" status: 404 len: 111 microversion: 2.20 time: 0.051105 Oct 22 21:15:19.858788 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2440/4866] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:15:19 2022] GET /compute/v2.1/servers/cc7f1980-ecea-437f-ac71-0cdb6ec626b9 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 22 21:15:19.863957 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-5e391a3c-2af8-4200-ac55-3c12880eb5cc tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] 10.222.0.18 "GET /compute/v2.1/servers/5c197028-ff9e-46ff-81f4-0feb4748da97" status: 200 len: 1577 microversion: 2.1 time: 0.325423 Oct 22 21:15:19.864641 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2427/4867] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:15:19 2022] GET /compute/v2.1/servers/5c197028-ff9e-46ff-81f4-0feb4748da97 => generated 1577 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:15:20.733205 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-eb694eab-b022-4317-8a5b-17fb6b0b93e9 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:15:20.734126 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-eb694eab-b022-4317-8a5b-17fb6b0b93e9 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] [instance: 803a198e-9b90-4fb4-85fa-e1131abf9517] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:15:20.742374 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-eb694eab-b022-4317-8a5b-17fb6b0b93e9 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:15:20.743482 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-eb694eab-b022-4317-8a5b-17fb6b0b93e9 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:15:20.744090 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-eb694eab-b022-4317-8a5b-17fb6b0b93e9 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:15:20.745307 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-eb694eab-b022-4317-8a5b-17fb6b0b93e9 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:15:20.745877 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-eb694eab-b022-4317-8a5b-17fb6b0b93e9 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:15:20.746474 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-eb694eab-b022-4317-8a5b-17fb6b0b93e9 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:15:20.890415 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-700a6166-7304-4030-a8b4-13993572213f tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:15:20.891677 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-700a6166-7304-4030-a8b4-13993572213f tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] [instance: 5c197028-ff9e-46ff-81f4-0feb4748da97] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:15:20.896210 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-eb694eab-b022-4317-8a5b-17fb6b0b93e9 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799f987b3aa7426ba5d7a464052d6490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87474d4b4c547abbfe6308b6dd8e1c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:15:20.902726 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-700a6166-7304-4030-a8b4-13993572213f tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:15:20.910857 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-700a6166-7304-4030-a8b4-13993572213f tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:15:20.911597 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-700a6166-7304-4030-a8b4-13993572213f tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:15:20.913088 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-700a6166-7304-4030-a8b4-13993572213f tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:15:20.913759 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-700a6166-7304-4030-a8b4-13993572213f tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:15:20.914246 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-eb694eab-b022-4317-8a5b-17fb6b0b93e9 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] 10.222.0.18 "GET /compute/v2.1/servers/803a198e-9b90-4fb4-85fa-e1131abf9517" status: 200 len: 1204 microversion: 2.1 time: 0.185071 Oct 22 21:15:20.914444 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-700a6166-7304-4030-a8b4-13993572213f tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:15:20.915217 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2441/4868] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:15:20 2022] GET /compute/v2.1/servers/803a198e-9b90-4fb4-85fa-e1131abf9517 => generated 1204 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:15:21.326038 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-700a6166-7304-4030-a8b4-13993572213f tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3820b31a424c3a9216a6ef91fcb285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a42c3ecf474883ac652fcc8c01c9f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:15:21.338055 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-700a6166-7304-4030-a8b4-13993572213f tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] 10.222.0.18 "GET /compute/v2.1/servers/5c197028-ff9e-46ff-81f4-0feb4748da97" status: 200 len: 1577 microversion: 2.1 time: 0.451333 Oct 22 21:15:21.348453 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2428/4869] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:15:20 2022] GET /compute/v2.1/servers/5c197028-ff9e-46ff-81f4-0feb4748da97 => generated 1577 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:15:21.941305 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-ec1155f3-ec90-4754-84b0-49f4114832b8 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:15:21.941947 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-ec1155f3-ec90-4754-84b0-49f4114832b8 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] [instance: 803a198e-9b90-4fb4-85fa-e1131abf9517] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:15:21.949820 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ec1155f3-ec90-4754-84b0-49f4114832b8 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:15:21.950674 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ec1155f3-ec90-4754-84b0-49f4114832b8 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:15:21.951511 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ec1155f3-ec90-4754-84b0-49f4114832b8 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:15:21.952335 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ec1155f3-ec90-4754-84b0-49f4114832b8 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:15:21.953043 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ec1155f3-ec90-4754-84b0-49f4114832b8 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:15:21.953556 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ec1155f3-ec90-4754-84b0-49f4114832b8 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:15:22.126501 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-ec1155f3-ec90-4754-84b0-49f4114832b8 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799f987b3aa7426ba5d7a464052d6490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87474d4b4c547abbfe6308b6dd8e1c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:15:22.138736 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-ec1155f3-ec90-4754-84b0-49f4114832b8 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] 10.222.0.18 "GET /compute/v2.1/servers/803a198e-9b90-4fb4-85fa-e1131abf9517" status: 200 len: 1266 microversion: 2.1 time: 0.202873 Oct 22 21:15:22.153814 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2442/4870] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:15:21 2022] GET /compute/v2.1/servers/803a198e-9b90-4fb4-85fa-e1131abf9517 => generated 1266 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:15:22.364015 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-e152e611-db15-4dcb-bf4b-13b98127ea3e tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:15:22.365267 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-e152e611-db15-4dcb-bf4b-13b98127ea3e tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] [instance: 5c197028-ff9e-46ff-81f4-0feb4748da97] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:15:22.372790 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e152e611-db15-4dcb-bf4b-13b98127ea3e tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:15:22.373443 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e152e611-db15-4dcb-bf4b-13b98127ea3e tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:15:22.374034 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e152e611-db15-4dcb-bf4b-13b98127ea3e tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:15:22.374889 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e152e611-db15-4dcb-bf4b-13b98127ea3e tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:15:22.375537 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e152e611-db15-4dcb-bf4b-13b98127ea3e tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:15:22.375965 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e152e611-db15-4dcb-bf4b-13b98127ea3e tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:15:22.740764 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-e152e611-db15-4dcb-bf4b-13b98127ea3e tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3820b31a424c3a9216a6ef91fcb285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a42c3ecf474883ac652fcc8c01c9f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:15:22.755909 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-e152e611-db15-4dcb-bf4b-13b98127ea3e tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] 10.222.0.18 "GET /compute/v2.1/servers/5c197028-ff9e-46ff-81f4-0feb4748da97" status: 200 len: 1577 microversion: 2.1 time: 0.395541 Oct 22 21:15:22.757603 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2429/4871] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:15:22 2022] GET /compute/v2.1/servers/5c197028-ff9e-46ff-81f4-0feb4748da97 => generated 1577 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:15:23.114246 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-26972f61-3299-4c7f-80c2-24849c78c96f req-c7304813-be17-48ce-814b-84938eff0ae3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c197028-ff9e-46ff-81f4-0feb4748da97", "name": "network-vif-deleted", "tag": "c5e164ee-0bd2-495e-9036-a2f07d700b5e"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:15:23.149972 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-26972f61-3299-4c7f-80c2-24849c78c96f req-c7304813-be17-48ce-814b-84938eff0ae3 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:15:23.150933 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-26972f61-3299-4c7f-80c2-24849c78c96f req-c7304813-be17-48ce-814b-84938eff0ae3 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:15:23.151557 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-26972f61-3299-4c7f-80c2-24849c78c96f req-c7304813-be17-48ce-814b-84938eff0ae3 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:15:23.165499 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-ed2e820e-ea4a-46d8-8df3-911a3a8cacfc tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:15:23.170184 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-26972f61-3299-4c7f-80c2-24849c78c96f req-c7304813-be17-48ce-814b-84938eff0ae3 service nova] Creating event network-vif-deleted:c5e164ee-0bd2-495e-9036-a2f07d700b5e for instance 5c197028-ff9e-46ff-81f4-0feb4748da97 on nch1-master-1 Oct 22 21:15:23.173198 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-ed2e820e-ea4a-46d8-8df3-911a3a8cacfc tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] [instance: 803a198e-9b90-4fb4-85fa-e1131abf9517] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:15:23.177458 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-26972f61-3299-4c7f-80c2-24849c78c96f req-c7304813-be17-48ce-814b-84938eff0ae3 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070381 Oct 22 21:15:23.178976 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2443/4872] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:15:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:15:23.183219 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ed2e820e-ea4a-46d8-8df3-911a3a8cacfc tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:15:23.184079 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ed2e820e-ea4a-46d8-8df3-911a3a8cacfc tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:15:23.184760 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ed2e820e-ea4a-46d8-8df3-911a3a8cacfc tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:15:23.185777 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ed2e820e-ea4a-46d8-8df3-911a3a8cacfc tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:15:23.186461 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ed2e820e-ea4a-46d8-8df3-911a3a8cacfc tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:15:23.189393 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ed2e820e-ea4a-46d8-8df3-911a3a8cacfc tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:15:23.415553 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-ed2e820e-ea4a-46d8-8df3-911a3a8cacfc tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799f987b3aa7426ba5d7a464052d6490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87474d4b4c547abbfe6308b6dd8e1c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:15:23.437554 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-ed2e820e-ea4a-46d8-8df3-911a3a8cacfc tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] 10.222.0.18 "GET /compute/v2.1/servers/803a198e-9b90-4fb4-85fa-e1131abf9517" status: 200 len: 1266 microversion: 2.1 time: 0.274999 Oct 22 21:15:23.445613 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2430/4873] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:15:23 2022] GET /compute/v2.1/servers/803a198e-9b90-4fb4-85fa-e1131abf9517 => generated 1266 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:15:23.781637 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-1f66c8d9-88cd-4a01-b9f4-202147c5f006 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:15:23.782363 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-1f66c8d9-88cd-4a01-b9f4-202147c5f006 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] [instance: 5c197028-ff9e-46ff-81f4-0feb4748da97] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:15:23.789570 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1f66c8d9-88cd-4a01-b9f4-202147c5f006 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:15:23.790222 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1f66c8d9-88cd-4a01-b9f4-202147c5f006 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:15:23.790860 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1f66c8d9-88cd-4a01-b9f4-202147c5f006 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:15:23.791776 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1f66c8d9-88cd-4a01-b9f4-202147c5f006 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:15:23.792389 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1f66c8d9-88cd-4a01-b9f4-202147c5f006 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:15:23.793006 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1f66c8d9-88cd-4a01-b9f4-202147c5f006 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:15:23.827513 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1f66c8d9-88cd-4a01-b9f4-202147c5f006 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:15:23.828409 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1f66c8d9-88cd-4a01-b9f4-202147c5f006 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:15:23.829000 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1f66c8d9-88cd-4a01-b9f4-202147c5f006 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:15:23.829633 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.objects.instance [None req-1f66c8d9-88cd-4a01-b9f4-202147c5f006 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lazy-loading 'fault' on Instance uuid 5c197028-ff9e-46ff-81f4-0feb4748da97 {{(pid=138745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 21:15:23.902533 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-1f66c8d9-88cd-4a01-b9f4-202147c5f006 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3820b31a424c3a9216a6ef91fcb285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a42c3ecf474883ac652fcc8c01c9f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:15:23.932985 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-1f66c8d9-88cd-4a01-b9f4-202147c5f006 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] 10.222.0.18 "GET /compute/v2.1/servers/5c197028-ff9e-46ff-81f4-0feb4748da97" status: 200 len: 1230 microversion: 2.1 time: 0.154940 Oct 22 21:15:23.935088 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2444/4874] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:15:23 2022] GET /compute/v2.1/servers/5c197028-ff9e-46ff-81f4-0feb4748da97 => generated 1230 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:15:24.470644 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-b4176135-a94c-45ef-a1a7-0b25bd68d311 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:15:24.472060 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-b4176135-a94c-45ef-a1a7-0b25bd68d311 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] [instance: 803a198e-9b90-4fb4-85fa-e1131abf9517] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:15:24.481720 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b4176135-a94c-45ef-a1a7-0b25bd68d311 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:15:24.482647 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b4176135-a94c-45ef-a1a7-0b25bd68d311 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:15:24.483104 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b4176135-a94c-45ef-a1a7-0b25bd68d311 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:15:24.484165 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b4176135-a94c-45ef-a1a7-0b25bd68d311 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:15:24.484595 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b4176135-a94c-45ef-a1a7-0b25bd68d311 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:15:24.485176 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b4176135-a94c-45ef-a1a7-0b25bd68d311 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:15:24.960814 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-bb7050c5-2ea0-4c3f-b490-f5d502a71986 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:15:24.962127 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-bb7050c5-2ea0-4c3f-b490-f5d502a71986 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] [instance: 5c197028-ff9e-46ff-81f4-0feb4748da97] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:15:24.976551 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bb7050c5-2ea0-4c3f-b490-f5d502a71986 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:15:24.977068 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bb7050c5-2ea0-4c3f-b490-f5d502a71986 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:15:24.977526 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bb7050c5-2ea0-4c3f-b490-f5d502a71986 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:15:24.978275 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bb7050c5-2ea0-4c3f-b490-f5d502a71986 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:15:24.978749 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bb7050c5-2ea0-4c3f-b490-f5d502a71986 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:15:24.979199 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bb7050c5-2ea0-4c3f-b490-f5d502a71986 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:15:25.024169 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.wsgi [None req-bb7050c5-2ea0-4c3f-b490-f5d502a71986 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] HTTP exception thrown: Instance 5c197028-ff9e-46ff-81f4-0feb4748da97 could not be found. Oct 22 21:15:25.025928 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-bb7050c5-2ea0-4c3f-b490-f5d502a71986 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Request method failure captured: Oct 22 21:15:25.025928 ncdv-master-1 devstack@n-api.service[138745]: request: GET /compute/v2.1/servers/5c197028-ff9e-46ff-81f4-0feb4748da97 HTTP/1.1 Oct 22 21:15:25.025928 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 21:15:25.025928 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 21:15:25.025928 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 21:15:25.025928 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 0 Oct 22 21:15:25.025928 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 21:15:25.025928 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 21:15:25.025928 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 21:15:25.025928 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 21:15:25.025928 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVFrcKw86EUEeUngnG9DZUJvE3lmhBNDPmC4isrFt9sa-3M5uM6HCkY-mE9Fr6XyLPpjJ3yZx9ru813oA85o16iJwDuF8Nlz1bpd8p9u41wsyi0Zep7ygHQQJ9tgdQV6IQKIEN7AplmICrhSHFCRaS0cX6FN1kXuVbLH1K6CsNjHq7jM Oct 22 21:15:25.025928 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 21:15:25.025928 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 21:15:25.025928 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 21:15:25.025928 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 21:15:25.025928 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 21:15:25.025928 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 21:15:25.025928 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: 82a42c3ecf474883ac652fcc8c01c9f2 Oct 22 21:15:25.025928 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-TestVolumeBootPattern-1443368191 Oct 22 21:15:25.025928 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 21:15:25.025928 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 21:15:25.025928 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_82a42c3ecf474883ac652fcc8c01c9f2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/82a42c3ecf474883ac652fcc8c01c9f2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/82a42c3ecf474883ac652fcc8c01c9f2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/82a42c3ecf474883ac652fcc8c01c9f2"}]}] Oct 22 21:15:25.025928 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-TestVolumeBootPattern-1443368191 Oct 22 21:15:25.025928 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: 82a42c3ecf474883ac652fcc8c01c9f2 Oct 22 21:15:25.025928 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-TestVolumeBootPattern-1443368191 Oct 22 21:15:25.025928 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-TestVolumeBootPattern-1443368191-project Oct 22 21:15:25.025928 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 21:15:25.025928 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 21:15:25.025928 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: 7e3820b31a424c3a9216a6ef91fcb285 Oct 22 21:15:25.025928 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-TestVolumeBootPattern-1443368191-project Oct 22 21:15:25.025928 ncdv-master-1 devstack@n-api.service[138745]: method: > Oct 22 21:15:25.025928 ncdv-master-1 devstack@n-api.service[138745]: exception: Instance 5c197028-ff9e-46ff-81f4-0feb4748da97 could not be found. Oct 22 21:15:25.025928 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'id': '5c197028-ff9e-46ff-81f4-0feb4748da97'} Oct 22 21:15:25.025928 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:15:25.025928 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:15:25.025928 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 21:15:25.025928 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 21:15:25.025928 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 21:15:25.025928 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 21:15:25.025928 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 21:15:25.025928 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 21:15:25.025928 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 21:15:25.025928 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 21:15:25.025928 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c197028-ff9e-46ff-81f4-0feb4748da97 could not be found. Oct 22 21:15:25.025928 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:15:25.025928 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:15:25.025928 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:15:25.025928 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:15:25.025928 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:15:25.025928 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:15:25.025928 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:15:25.025928 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:15:25.025928 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:15:25.025928 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:15:25.025928 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 21:15:25.025928 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 21:15:25.025928 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 21:15:25.025928 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 21:15:25.025928 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 21:15:25.025928 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:15:25.025928 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c197028-ff9e-46ff-81f4-0feb4748da97 could not be found. Oct 22 21:15:25.025928 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:15:25.025928 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:15:25.025928 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:15:25.030258 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:15:25.030258 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:15:25.030258 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:15:25.030258 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:15:25.030258 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:15:25.030258 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c197028-ff9e-46ff-81f4-0feb4748da97 could not be found. Oct 22 21:15:25.030258 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:15:25.030258 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-bb7050c5-2ea0-4c3f-b490-f5d502a71986 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Returning 404 to user: Instance 5c197028-ff9e-46ff-81f4-0feb4748da97 could not be found. {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:15:25.030258 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-bb7050c5-2ea0-4c3f-b490-f5d502a71986 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] 10.222.0.18 "GET /compute/v2.1/servers/5c197028-ff9e-46ff-81f4-0feb4748da97" status: 404 len: 111 microversion: 2.1 time: 0.071882 Oct 22 21:15:25.030258 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2445/4875] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:15:24 2022] GET /compute/v2.1/servers/5c197028-ff9e-46ff-81f4-0feb4748da97 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 22 21:15:25.079496 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-b4176135-a94c-45ef-a1a7-0b25bd68d311 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799f987b3aa7426ba5d7a464052d6490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87474d4b4c547abbfe6308b6dd8e1c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:15:25.092696 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-b4176135-a94c-45ef-a1a7-0b25bd68d311 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] 10.222.0.18 "GET /compute/v2.1/servers/803a198e-9b90-4fb4-85fa-e1131abf9517" status: 200 len: 1308 microversion: 2.1 time: 0.627626 Oct 22 21:15:25.093285 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2431/4876] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:15:24 2022] GET /compute/v2.1/servers/803a198e-9b90-4fb4-85fa-e1131abf9517 => generated 1308 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:15:26.118350 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-ada450ab-ffda-43bc-a891-28601e27eea5 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:15:26.119567 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-ada450ab-ffda-43bc-a891-28601e27eea5 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] [instance: 803a198e-9b90-4fb4-85fa-e1131abf9517] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:15:26.129217 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ada450ab-ffda-43bc-a891-28601e27eea5 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:15:26.129910 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ada450ab-ffda-43bc-a891-28601e27eea5 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:15:26.130666 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ada450ab-ffda-43bc-a891-28601e27eea5 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:15:26.131687 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ada450ab-ffda-43bc-a891-28601e27eea5 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:15:26.132161 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ada450ab-ffda-43bc-a891-28601e27eea5 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:15:26.132603 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ada450ab-ffda-43bc-a891-28601e27eea5 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:15:26.538248 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-ada450ab-ffda-43bc-a891-28601e27eea5 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799f987b3aa7426ba5d7a464052d6490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87474d4b4c547abbfe6308b6dd8e1c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:15:26.549268 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-ada450ab-ffda-43bc-a891-28601e27eea5 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] 10.222.0.18 "GET /compute/v2.1/servers/803a198e-9b90-4fb4-85fa-e1131abf9517" status: 200 len: 1308 microversion: 2.1 time: 0.435832 Oct 22 21:15:26.550346 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2446/4877] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:15:26 2022] GET /compute/v2.1/servers/803a198e-9b90-4fb4-85fa-e1131abf9517 => generated 1308 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:15:27.078123 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-a9d21cd9-b867-49a6-9134-5a5718b2fc03 req-7bca2071-71bb-4e18-b06e-246eff6d384d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "803a198e-9b90-4fb4-85fa-e1131abf9517", "tag": "6efed533-3c69-4b21-aa51-cb41b855cf3e"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:15:27.106977 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-a9d21cd9-b867-49a6-9134-5a5718b2fc03 req-7bca2071-71bb-4e18-b06e-246eff6d384d service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:15:27.107418 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-a9d21cd9-b867-49a6-9134-5a5718b2fc03 req-7bca2071-71bb-4e18-b06e-246eff6d384d service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:15:27.109418 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-a9d21cd9-b867-49a6-9134-5a5718b2fc03 req-7bca2071-71bb-4e18-b06e-246eff6d384d service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:15:27.129287 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-a9d21cd9-b867-49a6-9134-5a5718b2fc03 req-7bca2071-71bb-4e18-b06e-246eff6d384d service nova] Creating event network-changed:6efed533-3c69-4b21-aa51-cb41b855cf3e for instance 803a198e-9b90-4fb4-85fa-e1131abf9517 on nch2-master-1 Oct 22 21:15:27.135035 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-a9d21cd9-b867-49a6-9134-5a5718b2fc03 req-7bca2071-71bb-4e18-b06e-246eff6d384d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063204 Oct 22 21:15:27.136534 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2432/4878] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:15:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:15:27.588993 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-e35759ce-5d4b-40a5-a3ce-4ff30cb6bcfa tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:15:27.590312 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-e35759ce-5d4b-40a5-a3ce-4ff30cb6bcfa tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] [instance: 803a198e-9b90-4fb4-85fa-e1131abf9517] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:15:27.605929 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e35759ce-5d4b-40a5-a3ce-4ff30cb6bcfa tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:15:27.613079 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e35759ce-5d4b-40a5-a3ce-4ff30cb6bcfa tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:15:27.613562 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e35759ce-5d4b-40a5-a3ce-4ff30cb6bcfa tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:15:27.614337 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e35759ce-5d4b-40a5-a3ce-4ff30cb6bcfa tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:15:27.614849 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e35759ce-5d4b-40a5-a3ce-4ff30cb6bcfa tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:15:27.617224 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e35759ce-5d4b-40a5-a3ce-4ff30cb6bcfa tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:15:27.863569 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-e35759ce-5d4b-40a5-a3ce-4ff30cb6bcfa tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799f987b3aa7426ba5d7a464052d6490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87474d4b4c547abbfe6308b6dd8e1c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:15:27.878439 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-e35759ce-5d4b-40a5-a3ce-4ff30cb6bcfa tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] 10.222.0.18 "GET /compute/v2.1/servers/803a198e-9b90-4fb4-85fa-e1131abf9517" status: 200 len: 1308 microversion: 2.1 time: 0.305192 Oct 22 21:15:27.879056 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2447/4879] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:15:27 2022] GET /compute/v2.1/servers/803a198e-9b90-4fb4-85fa-e1131abf9517 => generated 1308 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:15:28.903188 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-aff4c792-7dcf-403b-b28e-2fe6941b00a6 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:15:28.904314 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-aff4c792-7dcf-403b-b28e-2fe6941b00a6 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] [instance: 803a198e-9b90-4fb4-85fa-e1131abf9517] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:15:28.913163 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-aff4c792-7dcf-403b-b28e-2fe6941b00a6 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:15:28.913688 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-aff4c792-7dcf-403b-b28e-2fe6941b00a6 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:15:28.914283 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-aff4c792-7dcf-403b-b28e-2fe6941b00a6 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:15:28.915143 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-aff4c792-7dcf-403b-b28e-2fe6941b00a6 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:15:28.915827 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-aff4c792-7dcf-403b-b28e-2fe6941b00a6 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:15:28.916446 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-aff4c792-7dcf-403b-b28e-2fe6941b00a6 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:15:29.065143 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-aff4c792-7dcf-403b-b28e-2fe6941b00a6 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799f987b3aa7426ba5d7a464052d6490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87474d4b4c547abbfe6308b6dd8e1c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:15:29.074036 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-aff4c792-7dcf-403b-b28e-2fe6941b00a6 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] 10.222.0.18 "GET /compute/v2.1/servers/803a198e-9b90-4fb4-85fa-e1131abf9517" status: 200 len: 1308 microversion: 2.1 time: 0.176496 Oct 22 21:15:29.087738 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2433/4880] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:15:28 2022] GET /compute/v2.1/servers/803a198e-9b90-4fb4-85fa-e1131abf9517 => generated 1308 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:15:30.097228 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-24f70264-5d3e-4ed0-9b4c-4c0056609645 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:15:30.097932 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-24f70264-5d3e-4ed0-9b4c-4c0056609645 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] [instance: 803a198e-9b90-4fb4-85fa-e1131abf9517] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:15:30.102961 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell0:SELECT=2 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:15:30.107366 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-24f70264-5d3e-4ed0-9b4c-4c0056609645 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:15:30.107960 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-24f70264-5d3e-4ed0-9b4c-4c0056609645 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:15:30.108417 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-24f70264-5d3e-4ed0-9b4c-4c0056609645 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:15:30.109473 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-24f70264-5d3e-4ed0-9b4c-4c0056609645 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:15:30.109994 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-24f70264-5d3e-4ed0-9b4c-4c0056609645 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:15:30.110538 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-24f70264-5d3e-4ed0-9b4c-4c0056609645 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:15:30.264953 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-24f70264-5d3e-4ed0-9b4c-4c0056609645 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799f987b3aa7426ba5d7a464052d6490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87474d4b4c547abbfe6308b6dd8e1c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:15:30.276043 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-24f70264-5d3e-4ed0-9b4c-4c0056609645 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] 10.222.0.18 "GET /compute/v2.1/servers/803a198e-9b90-4fb4-85fa-e1131abf9517" status: 200 len: 1308 microversion: 2.1 time: 0.182368 Oct 22 21:15:30.276779 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2448/4881] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:15:30 2022] GET /compute/v2.1/servers/803a198e-9b90-4fb4-85fa-e1131abf9517 => generated 1308 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:15:31.303099 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-69aaddfc-119c-4db1-931e-cb3a6deaefe1 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:15:31.303770 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-69aaddfc-119c-4db1-931e-cb3a6deaefe1 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] [instance: 803a198e-9b90-4fb4-85fa-e1131abf9517] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:15:31.306588 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell0:SELECT=2 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:15:31.307468 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell0:SELECT=6 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:15:31.316627 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-69aaddfc-119c-4db1-931e-cb3a6deaefe1 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:15:31.317360 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-69aaddfc-119c-4db1-931e-cb3a6deaefe1 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:15:31.318014 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-69aaddfc-119c-4db1-931e-cb3a6deaefe1 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:15:31.319055 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-69aaddfc-119c-4db1-931e-cb3a6deaefe1 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:15:31.319554 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-69aaddfc-119c-4db1-931e-cb3a6deaefe1 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:15:31.320006 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-69aaddfc-119c-4db1-931e-cb3a6deaefe1 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:15:31.623861 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-69aaddfc-119c-4db1-931e-cb3a6deaefe1 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799f987b3aa7426ba5d7a464052d6490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87474d4b4c547abbfe6308b6dd8e1c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:15:31.649146 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-69aaddfc-119c-4db1-931e-cb3a6deaefe1 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] 10.222.0.18 "GET /compute/v2.1/servers/803a198e-9b90-4fb4-85fa-e1131abf9517" status: 200 len: 1308 microversion: 2.1 time: 0.349993 Oct 22 21:15:31.650118 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2434/4882] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:15:31 2022] GET /compute/v2.1/servers/803a198e-9b90-4fb4-85fa-e1131abf9517 => generated 1308 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:15:32.674570 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-b7c887fa-0616-44de-b2f4-1d37efbdcaab tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:15:32.675321 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-b7c887fa-0616-44de-b2f4-1d37efbdcaab tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] [instance: 803a198e-9b90-4fb4-85fa-e1131abf9517] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:15:32.684900 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b7c887fa-0616-44de-b2f4-1d37efbdcaab tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:15:32.685550 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b7c887fa-0616-44de-b2f4-1d37efbdcaab tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:15:32.687066 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b7c887fa-0616-44de-b2f4-1d37efbdcaab tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:15:32.688338 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b7c887fa-0616-44de-b2f4-1d37efbdcaab tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:15:32.689076 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b7c887fa-0616-44de-b2f4-1d37efbdcaab tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:15:32.689738 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b7c887fa-0616-44de-b2f4-1d37efbdcaab tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:15:32.989768 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-b7c887fa-0616-44de-b2f4-1d37efbdcaab tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799f987b3aa7426ba5d7a464052d6490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87474d4b4c547abbfe6308b6dd8e1c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:15:33.008952 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-b7c887fa-0616-44de-b2f4-1d37efbdcaab tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] 10.222.0.18 "GET /compute/v2.1/servers/803a198e-9b90-4fb4-85fa-e1131abf9517" status: 200 len: 1308 microversion: 2.1 time: 0.338422 Oct 22 21:15:33.009748 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2449/4883] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:15:32 2022] GET /compute/v2.1/servers/803a198e-9b90-4fb4-85fa-e1131abf9517 => generated 1308 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:15:33.229896 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-c1595554-28a9-4f0e-a511-155c5762e206 req-c9c1fa4d-beea-47fc-96fe-38f3c38323b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "803a198e-9b90-4fb4-85fa-e1131abf9517", "name": "network-vif-plugged", "status": "completed", "tag": "6efed533-3c69-4b21-aa51-cb41b855cf3e"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:15:33.240710 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-c1595554-28a9-4f0e-a511-155c5762e206 req-c9c1fa4d-beea-47fc-96fe-38f3c38323b3 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:15:33.241411 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-c1595554-28a9-4f0e-a511-155c5762e206 req-c9c1fa4d-beea-47fc-96fe-38f3c38323b3 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:15:33.242004 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-c1595554-28a9-4f0e-a511-155c5762e206 req-c9c1fa4d-beea-47fc-96fe-38f3c38323b3 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:15:33.273758 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-c1595554-28a9-4f0e-a511-155c5762e206 req-c9c1fa4d-beea-47fc-96fe-38f3c38323b3 service nova] Creating event network-vif-plugged:6efed533-3c69-4b21-aa51-cb41b855cf3e for instance 803a198e-9b90-4fb4-85fa-e1131abf9517 on nch2-master-1 Oct 22 21:15:33.281196 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-c1595554-28a9-4f0e-a511-155c5762e206 req-c9c1fa4d-beea-47fc-96fe-38f3c38323b3 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054913 Oct 22 21:15:33.282323 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2435/4884] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:15:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:15:34.033377 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-adc0ee93-84e2-443a-8f46-cb9ad551318e tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:15:34.034831 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-adc0ee93-84e2-443a-8f46-cb9ad551318e tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] [instance: 803a198e-9b90-4fb4-85fa-e1131abf9517] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:15:34.045556 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-adc0ee93-84e2-443a-8f46-cb9ad551318e tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:15:34.046074 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-adc0ee93-84e2-443a-8f46-cb9ad551318e tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:15:34.049680 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-adc0ee93-84e2-443a-8f46-cb9ad551318e tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:15:34.052312 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-adc0ee93-84e2-443a-8f46-cb9ad551318e tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:15:34.053728 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-adc0ee93-84e2-443a-8f46-cb9ad551318e tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:15:34.056282 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-adc0ee93-84e2-443a-8f46-cb9ad551318e tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:15:34.300923 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-adc0ee93-84e2-443a-8f46-cb9ad551318e tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799f987b3aa7426ba5d7a464052d6490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87474d4b4c547abbfe6308b6dd8e1c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:15:34.318528 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-adc0ee93-84e2-443a-8f46-cb9ad551318e tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] 10.222.0.18 "GET /compute/v2.1/servers/803a198e-9b90-4fb4-85fa-e1131abf9517" status: 200 len: 1308 microversion: 2.1 time: 0.288900 Oct 22 21:15:34.320629 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2450/4885] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:15:34 2022] GET /compute/v2.1/servers/803a198e-9b90-4fb4-85fa-e1131abf9517 => generated 1308 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:15:35.344701 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-f7451158-ae6b-42ac-9e0f-21ede4905847 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:15:35.346402 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-f7451158-ae6b-42ac-9e0f-21ede4905847 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] [instance: 803a198e-9b90-4fb4-85fa-e1131abf9517] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:15:35.359825 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f7451158-ae6b-42ac-9e0f-21ede4905847 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:15:35.360345 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f7451158-ae6b-42ac-9e0f-21ede4905847 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:15:35.361145 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f7451158-ae6b-42ac-9e0f-21ede4905847 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:15:35.361922 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f7451158-ae6b-42ac-9e0f-21ede4905847 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:15:35.363016 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f7451158-ae6b-42ac-9e0f-21ede4905847 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:15:35.363495 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f7451158-ae6b-42ac-9e0f-21ede4905847 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:15:35.534077 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-f7451158-ae6b-42ac-9e0f-21ede4905847 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799f987b3aa7426ba5d7a464052d6490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87474d4b4c547abbfe6308b6dd8e1c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:15:35.543424 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-f7451158-ae6b-42ac-9e0f-21ede4905847 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] 10.222.0.18 "GET /compute/v2.1/servers/803a198e-9b90-4fb4-85fa-e1131abf9517" status: 200 len: 1490 microversion: 2.1 time: 0.203877 Oct 22 21:15:35.544017 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2436/4886] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:15:35 2022] GET /compute/v2.1/servers/803a198e-9b90-4fb4-85fa-e1131abf9517 => generated 1490 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:15:35.566284 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-91c8e8cd-5f64-4da5-9f82-051a8cddfc4c tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-1679851503"}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:15:35.569095 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-91c8e8cd-5f64-4da5-9f82-051a8cddfc4c tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] [instance: 803a198e-9b90-4fb4-85fa-e1131abf9517] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:15:35.577090 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-91c8e8cd-5f64-4da5-9f82-051a8cddfc4c tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:15:35.577598 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-91c8e8cd-5f64-4da5-9f82-051a8cddfc4c tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:15:35.578217 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-91c8e8cd-5f64-4da5-9f82-051a8cddfc4c tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:15:35.579118 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-91c8e8cd-5f64-4da5-9f82-051a8cddfc4c tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:15:35.579777 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-91c8e8cd-5f64-4da5-9f82-051a8cddfc4c tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:15:35.580612 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-91c8e8cd-5f64-4da5-9f82-051a8cddfc4c tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:15:35.658465 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-91c8e8cd-5f64-4da5-9f82-051a8cddfc4c tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] 10.222.0.18 "PUT /compute/v2.1/servers/803a198e-9b90-4fb4-85fa-e1131abf9517" status: 200 len: 1076 microversion: 2.1 time: 0.095815 Oct 22 21:15:35.667729 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2451/4887] 10.222.0.18 () {60 vars in 1256 bytes} [Sat Oct 22 21:15:35 2022] PUT /compute/v2.1/servers/803a198e-9b90-4fb4-85fa-e1131abf9517 => generated 1076 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:15:35.680396 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-6a68b7c1-18af-496f-baa9-76ea4d579140 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:15:35.681059 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-6a68b7c1-18af-496f-baa9-76ea4d579140 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] [instance: 803a198e-9b90-4fb4-85fa-e1131abf9517] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:15:35.687646 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6a68b7c1-18af-496f-baa9-76ea4d579140 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:15:35.688144 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6a68b7c1-18af-496f-baa9-76ea4d579140 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:15:35.688587 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6a68b7c1-18af-496f-baa9-76ea4d579140 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:15:35.689304 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6a68b7c1-18af-496f-baa9-76ea4d579140 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:15:35.689817 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6a68b7c1-18af-496f-baa9-76ea4d579140 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:15:35.690198 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6a68b7c1-18af-496f-baa9-76ea4d579140 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:15:35.837686 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-6a68b7c1-18af-496f-baa9-76ea4d579140 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799f987b3aa7426ba5d7a464052d6490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87474d4b4c547abbfe6308b6dd8e1c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:15:35.850643 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-6a68b7c1-18af-496f-baa9-76ea4d579140 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] 10.222.0.18 "GET /compute/v2.1/servers/803a198e-9b90-4fb4-85fa-e1131abf9517" status: 200 len: 1502 microversion: 2.1 time: 0.174134 Oct 22 21:15:35.851892 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2437/4888] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:15:35 2022] GET /compute/v2.1/servers/803a198e-9b90-4fb4-85fa-e1131abf9517 => generated 1502 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:15:35.873757 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-0d24f204-347d-4160-b3a7-2ace06c9cb4b tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:15:35.874827 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-0d24f204-347d-4160-b3a7-2ace06c9cb4b tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] [instance: 803a198e-9b90-4fb4-85fa-e1131abf9517] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:15:35.881919 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0d24f204-347d-4160-b3a7-2ace06c9cb4b tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:15:35.882437 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0d24f204-347d-4160-b3a7-2ace06c9cb4b tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:15:35.882906 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0d24f204-347d-4160-b3a7-2ace06c9cb4b tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:15:35.883691 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0d24f204-347d-4160-b3a7-2ace06c9cb4b tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:15:35.884170 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0d24f204-347d-4160-b3a7-2ace06c9cb4b tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:15:35.884624 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0d24f204-347d-4160-b3a7-2ace06c9cb4b tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:15:36.043924 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-0d24f204-347d-4160-b3a7-2ace06c9cb4b tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799f987b3aa7426ba5d7a464052d6490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87474d4b4c547abbfe6308b6dd8e1c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:15:36.053921 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-0d24f204-347d-4160-b3a7-2ace06c9cb4b tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] 10.222.0.18 "GET /compute/v2.1/servers/803a198e-9b90-4fb4-85fa-e1131abf9517" status: 200 len: 1502 microversion: 2.1 time: 0.184031 Oct 22 21:15:36.055229 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2452/4889] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:15:35 2022] GET /compute/v2.1/servers/803a198e-9b90-4fb4-85fa-e1131abf9517 => generated 1502 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:15:36.078981 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-6ef025a7-b297-454e-8f63-5a6fd2dbb5f9 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:15:36.084262 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6ef025a7-b297-454e-8f63-5a6fd2dbb5f9 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:15:36.084759 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6ef025a7-b297-454e-8f63-5a6fd2dbb5f9 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:15:36.085206 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6ef025a7-b297-454e-8f63-5a6fd2dbb5f9 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:15:36.111284 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-6ef025a7-b297-454e-8f63-5a6fd2dbb5f9 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] [instance: 803a198e-9b90-4fb4-85fa-e1131abf9517] Going to try to stop instance {{(pid=138744) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 22 21:15:36.170397 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-6ef025a7-b297-454e-8f63-5a6fd2dbb5f9 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] 10.222.0.18 "POST /compute/v2.1/servers/803a198e-9b90-4fb4-85fa-e1131abf9517/action" status: 202 len: 0 microversion: 2.1 time: 0.096899 Oct 22 21:15:36.171262 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2438/4890] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 21:15:36 2022] POST /compute/v2.1/servers/803a198e-9b90-4fb4-85fa-e1131abf9517/action => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 21:15:36.182607 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-000f773e-f04e-4d45-80a3-0f7f7be6098a tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:15:36.183325 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-000f773e-f04e-4d45-80a3-0f7f7be6098a tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] [instance: 803a198e-9b90-4fb4-85fa-e1131abf9517] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:15:36.194290 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-000f773e-f04e-4d45-80a3-0f7f7be6098a tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:15:36.194878 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-000f773e-f04e-4d45-80a3-0f7f7be6098a tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:15:36.195651 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-000f773e-f04e-4d45-80a3-0f7f7be6098a tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:15:36.196756 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-000f773e-f04e-4d45-80a3-0f7f7be6098a tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:15:36.197385 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-000f773e-f04e-4d45-80a3-0f7f7be6098a tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:15:36.197842 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-000f773e-f04e-4d45-80a3-0f7f7be6098a tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:15:36.452531 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-000f773e-f04e-4d45-80a3-0f7f7be6098a tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799f987b3aa7426ba5d7a464052d6490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87474d4b4c547abbfe6308b6dd8e1c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:15:36.462245 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-000f773e-f04e-4d45-80a3-0f7f7be6098a tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] 10.222.0.18 "GET /compute/v2.1/servers/803a198e-9b90-4fb4-85fa-e1131abf9517" status: 200 len: 1512 microversion: 2.1 time: 0.286324 Oct 22 21:15:36.464014 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2453/4891] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:15:36 2022] GET /compute/v2.1/servers/803a198e-9b90-4fb4-85fa-e1131abf9517 => generated 1512 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:15:37.491709 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-c610cd5c-e031-48b5-b70d-b08c9e5418c6 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:15:37.492695 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-c610cd5c-e031-48b5-b70d-b08c9e5418c6 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] [instance: 803a198e-9b90-4fb4-85fa-e1131abf9517] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:15:37.501237 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c610cd5c-e031-48b5-b70d-b08c9e5418c6 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:15:37.502398 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c610cd5c-e031-48b5-b70d-b08c9e5418c6 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:15:37.503486 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c610cd5c-e031-48b5-b70d-b08c9e5418c6 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:15:37.505614 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c610cd5c-e031-48b5-b70d-b08c9e5418c6 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:15:37.506304 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c610cd5c-e031-48b5-b70d-b08c9e5418c6 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:15:37.507094 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c610cd5c-e031-48b5-b70d-b08c9e5418c6 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:15:37.685722 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-c610cd5c-e031-48b5-b70d-b08c9e5418c6 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799f987b3aa7426ba5d7a464052d6490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87474d4b4c547abbfe6308b6dd8e1c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:15:37.696884 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-c610cd5c-e031-48b5-b70d-b08c9e5418c6 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] 10.222.0.18 "GET /compute/v2.1/servers/803a198e-9b90-4fb4-85fa-e1131abf9517" status: 200 len: 1512 microversion: 2.1 time: 0.211132 Oct 22 21:15:37.697665 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2439/4892] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:15:37 2022] GET /compute/v2.1/servers/803a198e-9b90-4fb4-85fa-e1131abf9517 => generated 1512 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:15:38.722053 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-38e833cb-c37e-40a4-be5e-2b1947d3db40 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:15:38.722989 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-38e833cb-c37e-40a4-be5e-2b1947d3db40 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] [instance: 803a198e-9b90-4fb4-85fa-e1131abf9517] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:15:38.733439 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-38e833cb-c37e-40a4-be5e-2b1947d3db40 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:15:38.733947 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-38e833cb-c37e-40a4-be5e-2b1947d3db40 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:15:38.739892 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-38e833cb-c37e-40a4-be5e-2b1947d3db40 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:15:38.740664 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-38e833cb-c37e-40a4-be5e-2b1947d3db40 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:15:38.741319 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-38e833cb-c37e-40a4-be5e-2b1947d3db40 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:15:38.741789 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-38e833cb-c37e-40a4-be5e-2b1947d3db40 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:15:38.883589 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-38e833cb-c37e-40a4-be5e-2b1947d3db40 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799f987b3aa7426ba5d7a464052d6490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87474d4b4c547abbfe6308b6dd8e1c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:15:38.893163 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-38e833cb-c37e-40a4-be5e-2b1947d3db40 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] 10.222.0.18 "GET /compute/v2.1/servers/803a198e-9b90-4fb4-85fa-e1131abf9517" status: 200 len: 1512 microversion: 2.1 time: 0.175858 Oct 22 21:15:38.893847 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2454/4893] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:15:38 2022] GET /compute/v2.1/servers/803a198e-9b90-4fb4-85fa-e1131abf9517 => generated 1512 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:15:39.917020 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-182cd065-5076-4d75-9139-e84b2639ac21 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:15:39.917642 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-182cd065-5076-4d75-9139-e84b2639ac21 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] [instance: 803a198e-9b90-4fb4-85fa-e1131abf9517] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:15:39.924676 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-182cd065-5076-4d75-9139-e84b2639ac21 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:15:39.925162 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-182cd065-5076-4d75-9139-e84b2639ac21 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:15:39.925957 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-182cd065-5076-4d75-9139-e84b2639ac21 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:15:39.927223 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-182cd065-5076-4d75-9139-e84b2639ac21 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:15:39.927803 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-182cd065-5076-4d75-9139-e84b2639ac21 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:15:39.928239 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-182cd065-5076-4d75-9139-e84b2639ac21 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:15:40.102275 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-182cd065-5076-4d75-9139-e84b2639ac21 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799f987b3aa7426ba5d7a464052d6490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87474d4b4c547abbfe6308b6dd8e1c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:15:40.113169 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-182cd065-5076-4d75-9139-e84b2639ac21 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] 10.222.0.18 "GET /compute/v2.1/servers/803a198e-9b90-4fb4-85fa-e1131abf9517" status: 200 len: 1512 microversion: 2.1 time: 0.199977 Oct 22 21:15:40.113878 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2440/4894] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:15:39 2022] GET /compute/v2.1/servers/803a198e-9b90-4fb4-85fa-e1131abf9517 => generated 1512 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:15:41.137296 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-0e4f5d03-26ee-461e-ae37-0e0f85b076c6 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:15:41.137932 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-0e4f5d03-26ee-461e-ae37-0e0f85b076c6 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] [instance: 803a198e-9b90-4fb4-85fa-e1131abf9517] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:15:41.146090 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0e4f5d03-26ee-461e-ae37-0e0f85b076c6 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:15:41.146870 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0e4f5d03-26ee-461e-ae37-0e0f85b076c6 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:15:41.147520 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0e4f5d03-26ee-461e-ae37-0e0f85b076c6 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:15:41.148669 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0e4f5d03-26ee-461e-ae37-0e0f85b076c6 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:15:41.149310 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0e4f5d03-26ee-461e-ae37-0e0f85b076c6 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:15:41.149930 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0e4f5d03-26ee-461e-ae37-0e0f85b076c6 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:15:41.362012 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-0e4f5d03-26ee-461e-ae37-0e0f85b076c6 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799f987b3aa7426ba5d7a464052d6490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87474d4b4c547abbfe6308b6dd8e1c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:15:41.372599 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-0e4f5d03-26ee-461e-ae37-0e0f85b076c6 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] 10.222.0.18 "GET /compute/v2.1/servers/803a198e-9b90-4fb4-85fa-e1131abf9517" status: 200 len: 1512 microversion: 2.1 time: 0.239815 Oct 22 21:15:41.373263 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2455/4895] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:15:41 2022] GET /compute/v2.1/servers/803a198e-9b90-4fb4-85fa-e1131abf9517 => generated 1512 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:15:42.397275 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-b0483745-1878-40e4-8f18-8c3ec75eac7e tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:15:42.398170 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-b0483745-1878-40e4-8f18-8c3ec75eac7e tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] [instance: 803a198e-9b90-4fb4-85fa-e1131abf9517] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:15:42.405549 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b0483745-1878-40e4-8f18-8c3ec75eac7e tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:15:42.406161 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b0483745-1878-40e4-8f18-8c3ec75eac7e tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:15:42.406697 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b0483745-1878-40e4-8f18-8c3ec75eac7e tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:15:42.407529 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b0483745-1878-40e4-8f18-8c3ec75eac7e tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:15:42.408171 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b0483745-1878-40e4-8f18-8c3ec75eac7e tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:15:42.408763 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b0483745-1878-40e4-8f18-8c3ec75eac7e tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:15:42.638731 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-b0483745-1878-40e4-8f18-8c3ec75eac7e tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799f987b3aa7426ba5d7a464052d6490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87474d4b4c547abbfe6308b6dd8e1c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:15:42.653379 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-b0483745-1878-40e4-8f18-8c3ec75eac7e tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] 10.222.0.18 "GET /compute/v2.1/servers/803a198e-9b90-4fb4-85fa-e1131abf9517" status: 200 len: 1512 microversion: 2.1 time: 0.261353 Oct 22 21:15:42.654977 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2441/4896] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:15:42 2022] GET /compute/v2.1/servers/803a198e-9b90-4fb4-85fa-e1131abf9517 => generated 1512 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:15:43.680492 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-0e552620-480e-4569-819e-493a924ef641 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:15:43.681105 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-0e552620-480e-4569-819e-493a924ef641 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] [instance: 803a198e-9b90-4fb4-85fa-e1131abf9517] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:15:43.685235 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_api:SELECT=78,nova_api:UPDATE=2 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:15:43.688862 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0e552620-480e-4569-819e-493a924ef641 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:15:43.689571 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0e552620-480e-4569-819e-493a924ef641 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:15:43.690029 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0e552620-480e-4569-819e-493a924ef641 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:15:43.690774 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0e552620-480e-4569-819e-493a924ef641 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:15:43.691246 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0e552620-480e-4569-819e-493a924ef641 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:15:43.691730 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0e552620-480e-4569-819e-493a924ef641 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:15:43.851073 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-0e552620-480e-4569-819e-493a924ef641 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799f987b3aa7426ba5d7a464052d6490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87474d4b4c547abbfe6308b6dd8e1c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:15:43.856276 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1,nova_cell1:UPDATE=1 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:15:43.861538 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-0e552620-480e-4569-819e-493a924ef641 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] 10.222.0.18 "GET /compute/v2.1/servers/803a198e-9b90-4fb4-85fa-e1131abf9517" status: 200 len: 1512 microversion: 2.1 time: 0.187616 Oct 22 21:15:43.862677 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2456/4897] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:15:43 2022] GET /compute/v2.1/servers/803a198e-9b90-4fb4-85fa-e1131abf9517 => generated 1512 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:15:44.890149 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-7a9632b5-a6c6-40c4-92f4-c7bc99f634eb tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:15:44.890149 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-7a9632b5-a6c6-40c4-92f4-c7bc99f634eb tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] [instance: 803a198e-9b90-4fb4-85fa-e1131abf9517] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:15:44.895774 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7a9632b5-a6c6-40c4-92f4-c7bc99f634eb tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:15:44.896271 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7a9632b5-a6c6-40c4-92f4-c7bc99f634eb tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:15:44.896908 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7a9632b5-a6c6-40c4-92f4-c7bc99f634eb tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:15:44.897629 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7a9632b5-a6c6-40c4-92f4-c7bc99f634eb tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:15:44.898094 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7a9632b5-a6c6-40c4-92f4-c7bc99f634eb tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:15:44.898711 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7a9632b5-a6c6-40c4-92f4-c7bc99f634eb tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:15:44.915570 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:15:45.054714 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-7a9632b5-a6c6-40c4-92f4-c7bc99f634eb tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799f987b3aa7426ba5d7a464052d6490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87474d4b4c547abbfe6308b6dd8e1c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:15:45.064435 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-7a9632b5-a6c6-40c4-92f4-c7bc99f634eb tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] 10.222.0.18 "GET /compute/v2.1/servers/803a198e-9b90-4fb4-85fa-e1131abf9517" status: 200 len: 1512 microversion: 2.1 time: 0.182105 Oct 22 21:15:45.066687 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2442/4898] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:15:44 2022] GET /compute/v2.1/servers/803a198e-9b90-4fb4-85fa-e1131abf9517 => generated 1512 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:15:46.092374 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-868660c8-ab79-4882-ae81-1a8021bf3220 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:15:46.093107 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-868660c8-ab79-4882-ae81-1a8021bf3220 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] [instance: 803a198e-9b90-4fb4-85fa-e1131abf9517] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:15:46.102136 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-868660c8-ab79-4882-ae81-1a8021bf3220 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:15:46.102921 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-868660c8-ab79-4882-ae81-1a8021bf3220 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:15:46.103555 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-868660c8-ab79-4882-ae81-1a8021bf3220 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:15:46.104496 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-868660c8-ab79-4882-ae81-1a8021bf3220 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:15:46.105133 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-868660c8-ab79-4882-ae81-1a8021bf3220 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:15:46.105785 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-868660c8-ab79-4882-ae81-1a8021bf3220 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:15:46.340574 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-868660c8-ab79-4882-ae81-1a8021bf3220 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799f987b3aa7426ba5d7a464052d6490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87474d4b4c547abbfe6308b6dd8e1c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:15:46.349162 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-868660c8-ab79-4882-ae81-1a8021bf3220 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] 10.222.0.18 "GET /compute/v2.1/servers/803a198e-9b90-4fb4-85fa-e1131abf9517" status: 200 len: 1512 microversion: 2.1 time: 0.262782 Oct 22 21:15:46.360272 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2457/4899] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:15:46 2022] GET /compute/v2.1/servers/803a198e-9b90-4fb4-85fa-e1131abf9517 => generated 1512 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:15:47.376961 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-ffc8b2f6-4f62-4f10-a1d4-ec447a038f5e tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:15:47.378978 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-ffc8b2f6-4f62-4f10-a1d4-ec447a038f5e tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] [instance: 803a198e-9b90-4fb4-85fa-e1131abf9517] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:15:47.389309 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ffc8b2f6-4f62-4f10-a1d4-ec447a038f5e tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:15:47.389918 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ffc8b2f6-4f62-4f10-a1d4-ec447a038f5e tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:15:47.390464 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ffc8b2f6-4f62-4f10-a1d4-ec447a038f5e tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:15:47.392161 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ffc8b2f6-4f62-4f10-a1d4-ec447a038f5e tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:15:47.393060 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ffc8b2f6-4f62-4f10-a1d4-ec447a038f5e tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:15:47.393734 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ffc8b2f6-4f62-4f10-a1d4-ec447a038f5e tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:15:47.583426 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-ffc8b2f6-4f62-4f10-a1d4-ec447a038f5e tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799f987b3aa7426ba5d7a464052d6490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87474d4b4c547abbfe6308b6dd8e1c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:15:47.603154 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-ffc8b2f6-4f62-4f10-a1d4-ec447a038f5e tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] 10.222.0.18 "GET /compute/v2.1/servers/803a198e-9b90-4fb4-85fa-e1131abf9517" status: 200 len: 1512 microversion: 2.1 time: 0.232699 Oct 22 21:15:47.627792 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2443/4900] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:15:47 2022] GET /compute/v2.1/servers/803a198e-9b90-4fb4-85fa-e1131abf9517 => generated 1512 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:15:48.469288 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-f3688c1f-9690-4413-92b1-34b2e716d8b2 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:15:48.469908 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-f3688c1f-9690-4413-92b1-34b2e716d8b2 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] [instance: 4d285bc1-33a9-47e0-a148-756be61c0488] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:15:48.476805 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f3688c1f-9690-4413-92b1-34b2e716d8b2 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:15:48.477329 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f3688c1f-9690-4413-92b1-34b2e716d8b2 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:15:48.477902 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f3688c1f-9690-4413-92b1-34b2e716d8b2 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:15:48.478653 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f3688c1f-9690-4413-92b1-34b2e716d8b2 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:15:48.479129 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f3688c1f-9690-4413-92b1-34b2e716d8b2 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:15:48.479600 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f3688c1f-9690-4413-92b1-34b2e716d8b2 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:15:48.536640 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-f3688c1f-9690-4413-92b1-34b2e716d8b2 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] [instance: 4d285bc1-33a9-47e0-a148-756be61c0488] Going to try to terminate instance {{(pid=138745) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 21:15:48.633676 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-ca062fef-f6dc-4813-afe9-bdb2a654402e tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:15:48.635713 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-ca062fef-f6dc-4813-afe9-bdb2a654402e tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] [instance: 803a198e-9b90-4fb4-85fa-e1131abf9517] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:15:48.649184 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ca062fef-f6dc-4813-afe9-bdb2a654402e tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:15:48.649693 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ca062fef-f6dc-4813-afe9-bdb2a654402e tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:15:48.650146 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ca062fef-f6dc-4813-afe9-bdb2a654402e tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:15:48.650886 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ca062fef-f6dc-4813-afe9-bdb2a654402e tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:15:48.651387 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ca062fef-f6dc-4813-afe9-bdb2a654402e tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:15:48.651806 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ca062fef-f6dc-4813-afe9-bdb2a654402e tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:15:48.724397 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-f3688c1f-9690-4413-92b1-34b2e716d8b2 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] 10.222.0.18 "DELETE /compute/v2.1/servers/4d285bc1-33a9-47e0-a148-756be61c0488" status: 204 len: 0 microversion: 2.32 time: 0.540468 Oct 22 21:15:48.725350 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2458/4901] 10.222.0.18 () {60 vars in 1280 bytes} [Sat Oct 22 21:15:48 2022] DELETE /compute/v2.1/servers/4d285bc1-33a9-47e0-a148-756be61c0488 => generated 0 bytes in 543 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 22 21:15:48.738359 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-d02b7a25-20a6-452d-98e8-86fb9bf22ff4 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:15:48.739572 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-d02b7a25-20a6-452d-98e8-86fb9bf22ff4 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] [instance: 4d285bc1-33a9-47e0-a148-756be61c0488] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:15:48.756607 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d02b7a25-20a6-452d-98e8-86fb9bf22ff4 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:15:48.758002 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d02b7a25-20a6-452d-98e8-86fb9bf22ff4 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:15:48.758669 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d02b7a25-20a6-452d-98e8-86fb9bf22ff4 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:15:48.760265 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d02b7a25-20a6-452d-98e8-86fb9bf22ff4 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:15:48.761891 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d02b7a25-20a6-452d-98e8-86fb9bf22ff4 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:15:48.762638 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d02b7a25-20a6-452d-98e8-86fb9bf22ff4 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:15:48.969445 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-ca062fef-f6dc-4813-afe9-bdb2a654402e tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799f987b3aa7426ba5d7a464052d6490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87474d4b4c547abbfe6308b6dd8e1c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:15:48.982680 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-ca062fef-f6dc-4813-afe9-bdb2a654402e tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] 10.222.0.18 "GET /compute/v2.1/servers/803a198e-9b90-4fb4-85fa-e1131abf9517" status: 200 len: 1512 microversion: 2.1 time: 0.352979 Oct 22 21:15:48.996666 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2444/4902] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:15:48 2022] GET /compute/v2.1/servers/803a198e-9b90-4fb4-85fa-e1131abf9517 => generated 1512 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:15:49.123018 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-d02b7a25-20a6-452d-98e8-86fb9bf22ff4 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd69c1f0203b047eeb6a9fa0a215a63c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09185bfad7944b199a490305c22ffc3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:15:49.133973 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-d02b7a25-20a6-452d-98e8-86fb9bf22ff4 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd69c1f0203b047eeb6a9fa0a215a63c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09185bfad7944b199a490305c22ffc3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:15:49.135697 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-d02b7a25-20a6-452d-98e8-86fb9bf22ff4 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd69c1f0203b047eeb6a9fa0a215a63c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09185bfad7944b199a490305c22ffc3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:15:49.137089 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-d02b7a25-20a6-452d-98e8-86fb9bf22ff4 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] 10.222.0.18 "GET /compute/v2.1/servers/4d285bc1-33a9-47e0-a148-756be61c0488" status: 200 len: 2956 microversion: 2.32 time: 0.403667 Oct 22 21:15:49.137791 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2459/4903] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:15:48 2022] GET /compute/v2.1/servers/4d285bc1-33a9-47e0-a148-756be61c0488 => generated 2956 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:15:50.008539 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-7da0f587-e356-4a7c-9633-b22d94ea8a0e tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:15:50.010559 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-7da0f587-e356-4a7c-9633-b22d94ea8a0e tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] [instance: 803a198e-9b90-4fb4-85fa-e1131abf9517] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:15:50.014190 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:15:50.021721 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7da0f587-e356-4a7c-9633-b22d94ea8a0e tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:15:50.022530 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7da0f587-e356-4a7c-9633-b22d94ea8a0e tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:15:50.023179 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7da0f587-e356-4a7c-9633-b22d94ea8a0e tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:15:50.024922 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7da0f587-e356-4a7c-9633-b22d94ea8a0e tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:15:50.025581 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7da0f587-e356-4a7c-9633-b22d94ea8a0e tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:15:50.026202 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7da0f587-e356-4a7c-9633-b22d94ea8a0e tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:15:50.168410 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-e9918984-e6f2-4a03-b46c-f8d09ab77efb tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:15:50.169120 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-e9918984-e6f2-4a03-b46c-f8d09ab77efb tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] [instance: 4d285bc1-33a9-47e0-a148-756be61c0488] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:15:50.180833 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e9918984-e6f2-4a03-b46c-f8d09ab77efb tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:15:50.181343 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e9918984-e6f2-4a03-b46c-f8d09ab77efb tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:15:50.183970 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e9918984-e6f2-4a03-b46c-f8d09ab77efb tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:15:50.185385 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e9918984-e6f2-4a03-b46c-f8d09ab77efb tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:15:50.186293 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e9918984-e6f2-4a03-b46c-f8d09ab77efb tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:15:50.187167 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e9918984-e6f2-4a03-b46c-f8d09ab77efb tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:15:50.227216 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-7da0f587-e356-4a7c-9633-b22d94ea8a0e tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799f987b3aa7426ba5d7a464052d6490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87474d4b4c547abbfe6308b6dd8e1c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:15:50.241085 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-7da0f587-e356-4a7c-9633-b22d94ea8a0e tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] 10.222.0.18 "GET /compute/v2.1/servers/803a198e-9b90-4fb4-85fa-e1131abf9517" status: 200 len: 1512 microversion: 2.1 time: 0.235265 Oct 22 21:15:50.253211 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2445/4904] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:15:50 2022] GET /compute/v2.1/servers/803a198e-9b90-4fb4-85fa-e1131abf9517 => generated 1512 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:15:50.468154 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-e9918984-e6f2-4a03-b46c-f8d09ab77efb tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd69c1f0203b047eeb6a9fa0a215a63c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09185bfad7944b199a490305c22ffc3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:15:50.482880 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-e9918984-e6f2-4a03-b46c-f8d09ab77efb tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd69c1f0203b047eeb6a9fa0a215a63c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09185bfad7944b199a490305c22ffc3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:15:50.484584 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-e9918984-e6f2-4a03-b46c-f8d09ab77efb tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd69c1f0203b047eeb6a9fa0a215a63c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09185bfad7944b199a490305c22ffc3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:15:50.486650 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-e9918984-e6f2-4a03-b46c-f8d09ab77efb tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] 10.222.0.18 "GET /compute/v2.1/servers/4d285bc1-33a9-47e0-a148-756be61c0488" status: 200 len: 2956 microversion: 2.32 time: 0.323903 Oct 22 21:15:50.487948 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2460/4905] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:15:50 2022] GET /compute/v2.1/servers/4d285bc1-33a9-47e0-a148-756be61c0488 => generated 2956 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:15:51.269056 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-ba119e9f-a351-4968-9df9-e3cc69dfdf0c tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:15:51.271253 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-ba119e9f-a351-4968-9df9-e3cc69dfdf0c tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] [instance: 803a198e-9b90-4fb4-85fa-e1131abf9517] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:15:51.280854 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ba119e9f-a351-4968-9df9-e3cc69dfdf0c tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:15:51.281718 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ba119e9f-a351-4968-9df9-e3cc69dfdf0c tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:15:51.282374 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ba119e9f-a351-4968-9df9-e3cc69dfdf0c tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:15:51.283642 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ba119e9f-a351-4968-9df9-e3cc69dfdf0c tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:15:51.284549 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ba119e9f-a351-4968-9df9-e3cc69dfdf0c tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:15:51.285465 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ba119e9f-a351-4968-9df9-e3cc69dfdf0c tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:15:51.519908 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-45d557b6-6f91-4a0a-90a6-3d54bb54fade tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:15:51.520909 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-45d557b6-6f91-4a0a-90a6-3d54bb54fade tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] [instance: 4d285bc1-33a9-47e0-a148-756be61c0488] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:15:51.544212 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-45d557b6-6f91-4a0a-90a6-3d54bb54fade tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:15:51.548011 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-45d557b6-6f91-4a0a-90a6-3d54bb54fade tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:15:51.548681 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-45d557b6-6f91-4a0a-90a6-3d54bb54fade tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:15:51.549623 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-45d557b6-6f91-4a0a-90a6-3d54bb54fade tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:15:51.550253 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-45d557b6-6f91-4a0a-90a6-3d54bb54fade tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:15:51.551239 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-45d557b6-6f91-4a0a-90a6-3d54bb54fade tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:15:51.585918 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-ba119e9f-a351-4968-9df9-e3cc69dfdf0c tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799f987b3aa7426ba5d7a464052d6490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87474d4b4c547abbfe6308b6dd8e1c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:15:51.598725 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-ba119e9f-a351-4968-9df9-e3cc69dfdf0c tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] 10.222.0.18 "GET /compute/v2.1/servers/803a198e-9b90-4fb4-85fa-e1131abf9517" status: 200 len: 1512 microversion: 2.1 time: 0.333258 Oct 22 21:15:51.617500 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2446/4906] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:15:51 2022] GET /compute/v2.1/servers/803a198e-9b90-4fb4-85fa-e1131abf9517 => generated 1512 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:15:51.982808 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-45d557b6-6f91-4a0a-90a6-3d54bb54fade tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd69c1f0203b047eeb6a9fa0a215a63c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09185bfad7944b199a490305c22ffc3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:15:52.011254 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-45d557b6-6f91-4a0a-90a6-3d54bb54fade tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd69c1f0203b047eeb6a9fa0a215a63c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09185bfad7944b199a490305c22ffc3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:15:52.013392 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-45d557b6-6f91-4a0a-90a6-3d54bb54fade tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd69c1f0203b047eeb6a9fa0a215a63c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09185bfad7944b199a490305c22ffc3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:15:52.015724 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-45d557b6-6f91-4a0a-90a6-3d54bb54fade tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] 10.222.0.18 "GET /compute/v2.1/servers/4d285bc1-33a9-47e0-a148-756be61c0488" status: 200 len: 2956 microversion: 2.32 time: 0.502836 Oct 22 21:15:52.019014 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2461/4907] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:15:51 2022] GET /compute/v2.1/servers/4d285bc1-33a9-47e0-a148-756be61c0488 => generated 2956 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:15:52.629485 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-34241992-74fb-4e7f-907c-271e0405e8b9 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:15:52.631154 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-34241992-74fb-4e7f-907c-271e0405e8b9 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] [instance: 803a198e-9b90-4fb4-85fa-e1131abf9517] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:15:52.641128 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-34241992-74fb-4e7f-907c-271e0405e8b9 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:15:52.642527 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-34241992-74fb-4e7f-907c-271e0405e8b9 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:15:52.644199 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-34241992-74fb-4e7f-907c-271e0405e8b9 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:15:52.647044 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-34241992-74fb-4e7f-907c-271e0405e8b9 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:15:52.647804 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-34241992-74fb-4e7f-907c-271e0405e8b9 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:15:52.648874 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-34241992-74fb-4e7f-907c-271e0405e8b9 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:15:52.910158 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-34241992-74fb-4e7f-907c-271e0405e8b9 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799f987b3aa7426ba5d7a464052d6490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87474d4b4c547abbfe6308b6dd8e1c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:15:52.929407 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-34241992-74fb-4e7f-907c-271e0405e8b9 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] 10.222.0.18 "GET /compute/v2.1/servers/803a198e-9b90-4fb4-85fa-e1131abf9517" status: 200 len: 1512 microversion: 2.1 time: 0.307073 Oct 22 21:15:52.934563 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2447/4908] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:15:52 2022] GET /compute/v2.1/servers/803a198e-9b90-4fb4-85fa-e1131abf9517 => generated 1512 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:15:53.049495 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-a053684b-3f82-4138-816a-8a2d2495f2bc tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:15:53.050120 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-a053684b-3f82-4138-816a-8a2d2495f2bc tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] [instance: 4d285bc1-33a9-47e0-a148-756be61c0488] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:15:53.071536 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a053684b-3f82-4138-816a-8a2d2495f2bc tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:15:53.072316 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a053684b-3f82-4138-816a-8a2d2495f2bc tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:15:53.072985 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a053684b-3f82-4138-816a-8a2d2495f2bc tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:15:53.077314 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a053684b-3f82-4138-816a-8a2d2495f2bc tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:15:53.078622 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a053684b-3f82-4138-816a-8a2d2495f2bc tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:15:53.079466 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a053684b-3f82-4138-816a-8a2d2495f2bc tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:15:53.483539 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-a053684b-3f82-4138-816a-8a2d2495f2bc tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd69c1f0203b047eeb6a9fa0a215a63c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09185bfad7944b199a490305c22ffc3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:15:53.511687 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-a053684b-3f82-4138-816a-8a2d2495f2bc tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd69c1f0203b047eeb6a9fa0a215a63c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09185bfad7944b199a490305c22ffc3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:15:53.521283 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-a053684b-3f82-4138-816a-8a2d2495f2bc tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd69c1f0203b047eeb6a9fa0a215a63c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09185bfad7944b199a490305c22ffc3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:15:53.523997 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-a053684b-3f82-4138-816a-8a2d2495f2bc tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] 10.222.0.18 "GET /compute/v2.1/servers/4d285bc1-33a9-47e0-a148-756be61c0488" status: 200 len: 2914 microversion: 2.32 time: 0.478711 Oct 22 21:15:53.524666 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2462/4909] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:15:53 2022] GET /compute/v2.1/servers/4d285bc1-33a9-47e0-a148-756be61c0488 => generated 2914 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:15:53.960823 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-bc7b3d3d-5291-40f7-a220-f8ecab2d0030 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:15:53.961488 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-bc7b3d3d-5291-40f7-a220-f8ecab2d0030 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] [instance: 803a198e-9b90-4fb4-85fa-e1131abf9517] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:15:53.970075 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bc7b3d3d-5291-40f7-a220-f8ecab2d0030 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:15:53.970654 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bc7b3d3d-5291-40f7-a220-f8ecab2d0030 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:15:53.971110 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bc7b3d3d-5291-40f7-a220-f8ecab2d0030 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:15:53.971910 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bc7b3d3d-5291-40f7-a220-f8ecab2d0030 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:15:53.972371 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bc7b3d3d-5291-40f7-a220-f8ecab2d0030 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:15:53.972808 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bc7b3d3d-5291-40f7-a220-f8ecab2d0030 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:15:54.351089 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-bc7b3d3d-5291-40f7-a220-f8ecab2d0030 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799f987b3aa7426ba5d7a464052d6490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87474d4b4c547abbfe6308b6dd8e1c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:15:54.369652 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-bc7b3d3d-5291-40f7-a220-f8ecab2d0030 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] 10.222.0.18 "GET /compute/v2.1/servers/803a198e-9b90-4fb4-85fa-e1131abf9517" status: 200 len: 1512 microversion: 2.1 time: 0.412841 Oct 22 21:15:54.369652 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2448/4910] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:15:53 2022] GET /compute/v2.1/servers/803a198e-9b90-4fb4-85fa-e1131abf9517 => generated 1512 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:15:54.407138 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-1d8bb898-e3b1-42be-9df0-3290fd8ecf90 req-24f1d0e2-9d94-47a2-8bd0-023ee60a9d18 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d285bc1-33a9-47e0-a148-756be61c0488", "name": "network-vif-deleted", "tag": "11971775-e198-4095-93a1-f9241775933a"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:15:54.429204 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-1d8bb898-e3b1-42be-9df0-3290fd8ecf90 req-24f1d0e2-9d94-47a2-8bd0-023ee60a9d18 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:15:54.429757 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-1d8bb898-e3b1-42be-9df0-3290fd8ecf90 req-24f1d0e2-9d94-47a2-8bd0-023ee60a9d18 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:15:54.430228 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-1d8bb898-e3b1-42be-9df0-3290fd8ecf90 req-24f1d0e2-9d94-47a2-8bd0-023ee60a9d18 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:15:54.448505 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-1d8bb898-e3b1-42be-9df0-3290fd8ecf90 req-24f1d0e2-9d94-47a2-8bd0-023ee60a9d18 service nova] Creating event network-vif-deleted:11971775-e198-4095-93a1-f9241775933a for instance 4d285bc1-33a9-47e0-a148-756be61c0488 on nch1-master-1 Oct 22 21:15:54.457061 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-1d8bb898-e3b1-42be-9df0-3290fd8ecf90 req-24f1d0e2-9d94-47a2-8bd0-023ee60a9d18 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053559 Oct 22 21:15:54.459939 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2463/4911] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:15:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:15:54.562033 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-382906d2-9cc2-401d-9219-661636482d84 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:15:54.562782 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-382906d2-9cc2-401d-9219-661636482d84 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] [instance: 4d285bc1-33a9-47e0-a148-756be61c0488] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:15:54.583823 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-382906d2-9cc2-401d-9219-661636482d84 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:15:54.584334 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-382906d2-9cc2-401d-9219-661636482d84 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:15:54.584787 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-382906d2-9cc2-401d-9219-661636482d84 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:15:54.585517 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-382906d2-9cc2-401d-9219-661636482d84 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:15:54.589562 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-382906d2-9cc2-401d-9219-661636482d84 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:15:54.592104 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-382906d2-9cc2-401d-9219-661636482d84 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:15:55.005585 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-382906d2-9cc2-401d-9219-661636482d84 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd69c1f0203b047eeb6a9fa0a215a63c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09185bfad7944b199a490305c22ffc3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:15:55.024860 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-382906d2-9cc2-401d-9219-661636482d84 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd69c1f0203b047eeb6a9fa0a215a63c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09185bfad7944b199a490305c22ffc3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:15:55.028023 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-382906d2-9cc2-401d-9219-661636482d84 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd69c1f0203b047eeb6a9fa0a215a63c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09185bfad7944b199a490305c22ffc3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:15:55.030577 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-382906d2-9cc2-401d-9219-661636482d84 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] 10.222.0.18 "GET /compute/v2.1/servers/4d285bc1-33a9-47e0-a148-756be61c0488" status: 200 len: 2753 microversion: 2.32 time: 0.472870 Oct 22 21:15:55.032783 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2449/4912] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:15:54 2022] GET /compute/v2.1/servers/4d285bc1-33a9-47e0-a148-756be61c0488 => generated 2753 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:15:55.389542 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-673ec0c2-18fb-4d49-bd59-fef8cdef46d3 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:15:55.390556 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-673ec0c2-18fb-4d49-bd59-fef8cdef46d3 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] [instance: 803a198e-9b90-4fb4-85fa-e1131abf9517] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:15:55.436404 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-673ec0c2-18fb-4d49-bd59-fef8cdef46d3 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:15:55.439168 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-673ec0c2-18fb-4d49-bd59-fef8cdef46d3 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:15:55.439882 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-673ec0c2-18fb-4d49-bd59-fef8cdef46d3 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:15:55.440655 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-673ec0c2-18fb-4d49-bd59-fef8cdef46d3 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:15:55.441258 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-673ec0c2-18fb-4d49-bd59-fef8cdef46d3 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:15:55.444457 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-673ec0c2-18fb-4d49-bd59-fef8cdef46d3 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:15:55.908430 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-673ec0c2-18fb-4d49-bd59-fef8cdef46d3 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799f987b3aa7426ba5d7a464052d6490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87474d4b4c547abbfe6308b6dd8e1c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:15:55.929819 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-673ec0c2-18fb-4d49-bd59-fef8cdef46d3 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] 10.222.0.18 "GET /compute/v2.1/servers/803a198e-9b90-4fb4-85fa-e1131abf9517" status: 200 len: 1512 microversion: 2.1 time: 0.547004 Oct 22 21:15:55.933891 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2464/4913] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:15:55 2022] GET /compute/v2.1/servers/803a198e-9b90-4fb4-85fa-e1131abf9517 => generated 1512 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:15:56.060449 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-a7a870eb-c5ce-48fe-950c-aa2de2e4db6d tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:15:56.061760 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-a7a870eb-c5ce-48fe-950c-aa2de2e4db6d tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] [instance: 4d285bc1-33a9-47e0-a148-756be61c0488] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:15:56.075124 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a7a870eb-c5ce-48fe-950c-aa2de2e4db6d tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:15:56.076012 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a7a870eb-c5ce-48fe-950c-aa2de2e4db6d tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:15:56.076734 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a7a870eb-c5ce-48fe-950c-aa2de2e4db6d tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:15:56.077964 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a7a870eb-c5ce-48fe-950c-aa2de2e4db6d tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:15:56.078909 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a7a870eb-c5ce-48fe-950c-aa2de2e4db6d tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:15:56.081228 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a7a870eb-c5ce-48fe-950c-aa2de2e4db6d tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:15:56.102393 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-5508e522-870f-4cff-b227-d66167ddde82 req-8c993bfd-aa5d-41fa-9ec3-c7611eb155af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d285bc1-33a9-47e0-a148-756be61c0488", "name": "network-vif-unplugged", "status": "completed", "tag": "7338f23d-cbc9-4db5-9c77-7a4f58137c5c"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:15:56.118957 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-5508e522-870f-4cff-b227-d66167ddde82 req-8c993bfd-aa5d-41fa-9ec3-c7611eb155af service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:15:56.128191 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-5508e522-870f-4cff-b227-d66167ddde82 req-8c993bfd-aa5d-41fa-9ec3-c7611eb155af service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:15:56.128895 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-5508e522-870f-4cff-b227-d66167ddde82 req-8c993bfd-aa5d-41fa-9ec3-c7611eb155af service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:15:56.151867 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-5508e522-870f-4cff-b227-d66167ddde82 req-8c993bfd-aa5d-41fa-9ec3-c7611eb155af service nova] Creating event network-vif-unplugged:7338f23d-cbc9-4db5-9c77-7a4f58137c5c for instance 4d285bc1-33a9-47e0-a148-756be61c0488 on nch1-master-1 Oct 22 21:15:56.157804 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-5508e522-870f-4cff-b227-d66167ddde82 req-8c993bfd-aa5d-41fa-9ec3-c7611eb155af service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.059685 Oct 22 21:15:56.158622 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2465/4914] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:15:56 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:15:56.821780 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-89eb91ca-cf7b-4b13-8191-212e997012ed req-a2bdbb5d-5ae8-476b-9df9-bf2500032d7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d285bc1-33a9-47e0-a148-756be61c0488", "name": "network-vif-deleted", "tag": "cff21c6e-345f-4103-b49b-c2a074abbfe3"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:15:56.849469 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-89eb91ca-cf7b-4b13-8191-212e997012ed req-a2bdbb5d-5ae8-476b-9df9-bf2500032d7e service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:15:56.850705 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-89eb91ca-cf7b-4b13-8191-212e997012ed req-a2bdbb5d-5ae8-476b-9df9-bf2500032d7e service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:15:56.851579 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-89eb91ca-cf7b-4b13-8191-212e997012ed req-a2bdbb5d-5ae8-476b-9df9-bf2500032d7e service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:15:56.872586 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-89eb91ca-cf7b-4b13-8191-212e997012ed req-a2bdbb5d-5ae8-476b-9df9-bf2500032d7e service nova] Creating event network-vif-deleted:cff21c6e-345f-4103-b49b-c2a074abbfe3 for instance 4d285bc1-33a9-47e0-a148-756be61c0488 on nch1-master-1 Oct 22 21:15:56.881862 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-89eb91ca-cf7b-4b13-8191-212e997012ed req-a2bdbb5d-5ae8-476b-9df9-bf2500032d7e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069373 Oct 22 21:15:56.882841 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2466/4915] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:15:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:15:56.960093 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-d341d786-33ff-4a52-a9ca-9f989384c5e5 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:15:56.960750 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-d341d786-33ff-4a52-a9ca-9f989384c5e5 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] [instance: 803a198e-9b90-4fb4-85fa-e1131abf9517] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:15:56.970965 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d341d786-33ff-4a52-a9ca-9f989384c5e5 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:15:56.971836 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d341d786-33ff-4a52-a9ca-9f989384c5e5 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:15:56.972597 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d341d786-33ff-4a52-a9ca-9f989384c5e5 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:15:56.973573 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d341d786-33ff-4a52-a9ca-9f989384c5e5 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:15:56.974297 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d341d786-33ff-4a52-a9ca-9f989384c5e5 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:15:56.977435 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d341d786-33ff-4a52-a9ca-9f989384c5e5 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:15:57.146836 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-a7a870eb-c5ce-48fe-950c-aa2de2e4db6d tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd69c1f0203b047eeb6a9fa0a215a63c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09185bfad7944b199a490305c22ffc3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:15:57.166591 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-a7a870eb-c5ce-48fe-950c-aa2de2e4db6d tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd69c1f0203b047eeb6a9fa0a215a63c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09185bfad7944b199a490305c22ffc3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:15:57.168088 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-a7a870eb-c5ce-48fe-950c-aa2de2e4db6d tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd69c1f0203b047eeb6a9fa0a215a63c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09185bfad7944b199a490305c22ffc3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:15:57.169397 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-a7a870eb-c5ce-48fe-950c-aa2de2e4db6d tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] 10.222.0.18 "GET /compute/v2.1/servers/4d285bc1-33a9-47e0-a148-756be61c0488" status: 200 len: 2706 microversion: 2.32 time: 1.113024 Oct 22 21:15:57.170313 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2450/4916] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:15:56 2022] GET /compute/v2.1/servers/4d285bc1-33a9-47e0-a148-756be61c0488 => generated 2706 bytes in 1115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:15:57.610778 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-d341d786-33ff-4a52-a9ca-9f989384c5e5 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799f987b3aa7426ba5d7a464052d6490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87474d4b4c547abbfe6308b6dd8e1c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:15:57.619262 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-d341d786-33ff-4a52-a9ca-9f989384c5e5 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] 10.222.0.18 "GET /compute/v2.1/servers/803a198e-9b90-4fb4-85fa-e1131abf9517" status: 200 len: 1512 microversion: 2.1 time: 0.664292 Oct 22 21:15:57.619906 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2467/4917] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:15:56 2022] GET /compute/v2.1/servers/803a198e-9b90-4fb4-85fa-e1131abf9517 => generated 1512 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:15:58.181529 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-26edda1c-b56a-40d0-990a-cde7967d983b req-304d152f-ed65-45ad-9db5-e0ec40e59ca0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d285bc1-33a9-47e0-a148-756be61c0488", "name": "network-vif-unplugged", "status": "completed", "tag": "d9858e8d-9b0c-457e-8078-ee77f74b3e78"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:15:58.208114 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-36a1003a-fae7-4d92-89df-c4556962beb4 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:15:58.208989 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-36a1003a-fae7-4d92-89df-c4556962beb4 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] [instance: 4d285bc1-33a9-47e0-a148-756be61c0488] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:15:58.220186 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-26edda1c-b56a-40d0-990a-cde7967d983b req-304d152f-ed65-45ad-9db5-e0ec40e59ca0 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:15:58.221345 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-36a1003a-fae7-4d92-89df-c4556962beb4 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:15:58.222046 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-26edda1c-b56a-40d0-990a-cde7967d983b req-304d152f-ed65-45ad-9db5-e0ec40e59ca0 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:15:58.223207 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-36a1003a-fae7-4d92-89df-c4556962beb4 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:15:58.223790 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-26edda1c-b56a-40d0-990a-cde7967d983b req-304d152f-ed65-45ad-9db5-e0ec40e59ca0 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:15:58.224693 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-36a1003a-fae7-4d92-89df-c4556962beb4 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:15:58.227107 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-36a1003a-fae7-4d92-89df-c4556962beb4 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:15:58.228939 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-36a1003a-fae7-4d92-89df-c4556962beb4 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:15:58.229584 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-36a1003a-fae7-4d92-89df-c4556962beb4 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:15:58.274227 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-26edda1c-b56a-40d0-990a-cde7967d983b req-304d152f-ed65-45ad-9db5-e0ec40e59ca0 service nova] Creating event network-vif-unplugged:d9858e8d-9b0c-457e-8078-ee77f74b3e78 for instance 4d285bc1-33a9-47e0-a148-756be61c0488 on nch1-master-1 Oct 22 21:15:58.285250 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-26edda1c-b56a-40d0-990a-cde7967d983b req-304d152f-ed65-45ad-9db5-e0ec40e59ca0 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.106428 Oct 22 21:15:58.290685 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2451/4918] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:15:58 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:15:58.656194 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-d60d8697-306b-41ce-b877-615e0509de16 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:15:58.657775 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-d60d8697-306b-41ce-b877-615e0509de16 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] [instance: 803a198e-9b90-4fb4-85fa-e1131abf9517] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:15:58.666333 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d60d8697-306b-41ce-b877-615e0509de16 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:15:58.667258 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d60d8697-306b-41ce-b877-615e0509de16 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:15:58.668196 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d60d8697-306b-41ce-b877-615e0509de16 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:15:58.669287 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d60d8697-306b-41ce-b877-615e0509de16 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:15:58.670117 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d60d8697-306b-41ce-b877-615e0509de16 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:15:58.671153 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d60d8697-306b-41ce-b877-615e0509de16 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:15:58.682128 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-36a1003a-fae7-4d92-89df-c4556962beb4 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd69c1f0203b047eeb6a9fa0a215a63c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09185bfad7944b199a490305c22ffc3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:15:58.712694 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-36a1003a-fae7-4d92-89df-c4556962beb4 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd69c1f0203b047eeb6a9fa0a215a63c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09185bfad7944b199a490305c22ffc3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:15:58.726633 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-36a1003a-fae7-4d92-89df-c4556962beb4 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd69c1f0203b047eeb6a9fa0a215a63c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09185bfad7944b199a490305c22ffc3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:15:58.733436 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-36a1003a-fae7-4d92-89df-c4556962beb4 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] 10.222.0.18 "GET /compute/v2.1/servers/4d285bc1-33a9-47e0-a148-756be61c0488" status: 200 len: 2545 microversion: 2.32 time: 0.530505 Oct 22 21:15:58.733970 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2468/4919] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:15:58 2022] GET /compute/v2.1/servers/4d285bc1-33a9-47e0-a148-756be61c0488 => generated 2545 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:15:58.921864 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-cd062db9-81a9-4a70-b114-99b890be22a8 req-a4366dd5-1668-46fc-9bc9-afbd032e99c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d285bc1-33a9-47e0-a148-756be61c0488", "name": "network-vif-deleted", "tag": "f622764f-b85f-427d-8e63-b432c6444156"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:15:58.934668 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-cd062db9-81a9-4a70-b114-99b890be22a8 req-a4366dd5-1668-46fc-9bc9-afbd032e99c4 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:15:58.935177 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-cd062db9-81a9-4a70-b114-99b890be22a8 req-a4366dd5-1668-46fc-9bc9-afbd032e99c4 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:15:58.935916 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-cd062db9-81a9-4a70-b114-99b890be22a8 req-a4366dd5-1668-46fc-9bc9-afbd032e99c4 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:15:58.962173 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-cd062db9-81a9-4a70-b114-99b890be22a8 req-a4366dd5-1668-46fc-9bc9-afbd032e99c4 service nova] Creating event network-vif-deleted:f622764f-b85f-427d-8e63-b432c6444156 for instance 4d285bc1-33a9-47e0-a148-756be61c0488 on nch1-master-1 Oct 22 21:15:58.969688 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-cd062db9-81a9-4a70-b114-99b890be22a8 req-a4366dd5-1668-46fc-9bc9-afbd032e99c4 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051459 Oct 22 21:15:58.971318 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2469/4920] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:15:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 21:15:59.138114 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-d60d8697-306b-41ce-b877-615e0509de16 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799f987b3aa7426ba5d7a464052d6490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87474d4b4c547abbfe6308b6dd8e1c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:15:59.153865 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-d60d8697-306b-41ce-b877-615e0509de16 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] 10.222.0.18 "GET /compute/v2.1/servers/803a198e-9b90-4fb4-85fa-e1131abf9517" status: 200 len: 1512 microversion: 2.1 time: 0.511726 Oct 22 21:15:59.154764 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2452/4921] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:15:58 2022] GET /compute/v2.1/servers/803a198e-9b90-4fb4-85fa-e1131abf9517 => generated 1512 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:15:59.768224 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-58c5efbb-f5cb-42e0-a1e8-287314474ce9 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:15:59.768954 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-58c5efbb-f5cb-42e0-a1e8-287314474ce9 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] [instance: 4d285bc1-33a9-47e0-a148-756be61c0488] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:15:59.792794 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-58c5efbb-f5cb-42e0-a1e8-287314474ce9 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:15:59.793296 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-58c5efbb-f5cb-42e0-a1e8-287314474ce9 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:15:59.793925 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-58c5efbb-f5cb-42e0-a1e8-287314474ce9 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:15:59.794842 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-58c5efbb-f5cb-42e0-a1e8-287314474ce9 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:15:59.795489 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-58c5efbb-f5cb-42e0-a1e8-287314474ce9 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:15:59.796080 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-58c5efbb-f5cb-42e0-a1e8-287314474ce9 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:16:00.089178 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-58c5efbb-f5cb-42e0-a1e8-287314474ce9 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd69c1f0203b047eeb6a9fa0a215a63c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09185bfad7944b199a490305c22ffc3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:16:00.104389 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-58c5efbb-f5cb-42e0-a1e8-287314474ce9 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd69c1f0203b047eeb6a9fa0a215a63c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09185bfad7944b199a490305c22ffc3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:16:00.106491 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-58c5efbb-f5cb-42e0-a1e8-287314474ce9 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd69c1f0203b047eeb6a9fa0a215a63c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09185bfad7944b199a490305c22ffc3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:16:00.115529 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-58c5efbb-f5cb-42e0-a1e8-287314474ce9 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] 10.222.0.18 "GET /compute/v2.1/servers/4d285bc1-33a9-47e0-a148-756be61c0488" status: 200 len: 2340 microversion: 2.32 time: 0.345249 Oct 22 21:16:00.116718 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2470/4922] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:15:59 2022] GET /compute/v2.1/servers/4d285bc1-33a9-47e0-a148-756be61c0488 => generated 2340 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:16:00.181833 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-1f5d7a91-72e5-44d3-89ac-7ebb55b19593 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:16:00.183190 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-1f5d7a91-72e5-44d3-89ac-7ebb55b19593 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] [instance: 803a198e-9b90-4fb4-85fa-e1131abf9517] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:16:00.197450 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1f5d7a91-72e5-44d3-89ac-7ebb55b19593 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:16:00.198083 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1f5d7a91-72e5-44d3-89ac-7ebb55b19593 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:16:00.198494 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1f5d7a91-72e5-44d3-89ac-7ebb55b19593 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:16:00.199272 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1f5d7a91-72e5-44d3-89ac-7ebb55b19593 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:16:00.202213 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1f5d7a91-72e5-44d3-89ac-7ebb55b19593 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:16:00.202676 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1f5d7a91-72e5-44d3-89ac-7ebb55b19593 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:16:00.571511 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-63cb9422-1981-4aa9-ae21-dd491899eac7 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:16:00.572727 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-63cb9422-1981-4aa9-ae21-dd491899eac7 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] [instance: a12803be-4bbe-44d5-bfb4-f8298113556c] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:16:00.604775 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-63cb9422-1981-4aa9-ae21-dd491899eac7 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:16:00.606978 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-63cb9422-1981-4aa9-ae21-dd491899eac7 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:16:00.611110 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-63cb9422-1981-4aa9-ae21-dd491899eac7 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:16:00.619480 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-63cb9422-1981-4aa9-ae21-dd491899eac7 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:16:00.620765 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-63cb9422-1981-4aa9-ae21-dd491899eac7 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:16:00.623541 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-63cb9422-1981-4aa9-ae21-dd491899eac7 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:16:00.661139 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-1f5d7a91-72e5-44d3-89ac-7ebb55b19593 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799f987b3aa7426ba5d7a464052d6490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87474d4b4c547abbfe6308b6dd8e1c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:16:00.676739 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-1f5d7a91-72e5-44d3-89ac-7ebb55b19593 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] 10.222.0.18 "GET /compute/v2.1/servers/803a198e-9b90-4fb4-85fa-e1131abf9517" status: 200 len: 1512 microversion: 2.1 time: 0.497034 Oct 22 21:16:00.680497 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2453/4923] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:16:00 2022] GET /compute/v2.1/servers/803a198e-9b90-4fb4-85fa-e1131abf9517 => generated 1512 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:16:00.686189 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-63cb9422-1981-4aa9-ae21-dd491899eac7 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] [instance: a12803be-4bbe-44d5-bfb4-f8298113556c] Going to try to terminate instance {{(pid=138745) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 21:16:00.906226 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-63cb9422-1981-4aa9-ae21-dd491899eac7 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] 10.222.0.18 "DELETE /compute/v2.1/servers/a12803be-4bbe-44d5-bfb4-f8298113556c" status: 204 len: 0 microversion: 2.1 time: 0.340656 Oct 22 21:16:00.911015 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2471/4924] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 21:16:00 2022] DELETE /compute/v2.1/servers/a12803be-4bbe-44d5-bfb4-f8298113556c => generated 0 bytes in 343 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 21:16:00.922453 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-ce509edb-cae1-4fd4-9751-4c06262bbacd tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:16:00.925449 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-ce509edb-cae1-4fd4-9751-4c06262bbacd tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] [instance: a12803be-4bbe-44d5-bfb4-f8298113556c] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:16:00.945071 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ce509edb-cae1-4fd4-9751-4c06262bbacd tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:16:00.948612 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ce509edb-cae1-4fd4-9751-4c06262bbacd tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:16:00.949468 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ce509edb-cae1-4fd4-9751-4c06262bbacd tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:16:00.950388 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ce509edb-cae1-4fd4-9751-4c06262bbacd tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:16:00.951798 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ce509edb-cae1-4fd4-9751-4c06262bbacd tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:16:00.954184 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ce509edb-cae1-4fd4-9751-4c06262bbacd tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:16:00.964846 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-3e2167a0-a2ba-457a-b37c-552c7c9149c5 req-3e5c7f01-e373-4c8e-b091-6e1873e099d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a12803be-4bbe-44d5-bfb4-f8298113556c", "tag": "5d0f1ea1-53be-4e61-b434-385f6b16da00"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:16:00.993080 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-3e2167a0-a2ba-457a-b37c-552c7c9149c5 req-3e5c7f01-e373-4c8e-b091-6e1873e099d5 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:16:00.998326 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-3e2167a0-a2ba-457a-b37c-552c7c9149c5 req-3e5c7f01-e373-4c8e-b091-6e1873e099d5 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:16:00.998875 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-3e2167a0-a2ba-457a-b37c-552c7c9149c5 req-3e5c7f01-e373-4c8e-b091-6e1873e099d5 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:16:01.024831 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-3e2167a0-a2ba-457a-b37c-552c7c9149c5 req-3e5c7f01-e373-4c8e-b091-6e1873e099d5 service nova] Creating event network-changed:5d0f1ea1-53be-4e61-b434-385f6b16da00 for instance a12803be-4bbe-44d5-bfb4-f8298113556c on nch1-master-1 Oct 22 21:16:01.031585 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-3e2167a0-a2ba-457a-b37c-552c7c9149c5 req-3e5c7f01-e373-4c8e-b091-6e1873e099d5 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.348681 Oct 22 21:16:01.032722 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2454/4925] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:16:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:16:01.044727 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-67d0472e-e92b-4062-8381-f5db2b02047f req-fd0a024b-f77c-40a0-9d33-86e23c5705a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d285bc1-33a9-47e0-a148-756be61c0488", "name": "network-vif-deleted", "tag": "7338f23d-cbc9-4db5-9c77-7a4f58137c5c"}, {"server_uuid": "4d285bc1-33a9-47e0-a148-756be61c0488", "name": "network-vif-deleted", "tag": "d9858e8d-9b0c-457e-8078-ee77f74b3e78"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:16:01.060527 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-67d0472e-e92b-4062-8381-f5db2b02047f req-fd0a024b-f77c-40a0-9d33-86e23c5705a3 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:16:01.061263 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-67d0472e-e92b-4062-8381-f5db2b02047f req-fd0a024b-f77c-40a0-9d33-86e23c5705a3 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:16:01.061872 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-67d0472e-e92b-4062-8381-f5db2b02047f req-fd0a024b-f77c-40a0-9d33-86e23c5705a3 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:16:01.084861 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-67d0472e-e92b-4062-8381-f5db2b02047f req-fd0a024b-f77c-40a0-9d33-86e23c5705a3 service nova] Creating event network-vif-deleted:7338f23d-cbc9-4db5-9c77-7a4f58137c5c for instance 4d285bc1-33a9-47e0-a148-756be61c0488 on nch1-master-1 Oct 22 21:16:01.089967 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-67d0472e-e92b-4062-8381-f5db2b02047f req-fd0a024b-f77c-40a0-9d33-86e23c5705a3 service nova] Creating event network-vif-deleted:d9858e8d-9b0c-457e-8078-ee77f74b3e78 for instance 4d285bc1-33a9-47e0-a148-756be61c0488 on nch1-master-1 Oct 22 21:16:01.127172 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-67d0472e-e92b-4062-8381-f5db2b02047f req-fd0a024b-f77c-40a0-9d33-86e23c5705a3 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.087715 Oct 22 21:16:01.128995 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2455/4926] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:16:01 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 21:16:01.158014 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-5813b2ae-fa13-4107-8d7c-d54685b2b293 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:16:01.159203 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-5813b2ae-fa13-4107-8d7c-d54685b2b293 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] [instance: 4d285bc1-33a9-47e0-a148-756be61c0488] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:16:01.175651 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5813b2ae-fa13-4107-8d7c-d54685b2b293 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:16:01.176687 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5813b2ae-fa13-4107-8d7c-d54685b2b293 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:16:01.178540 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5813b2ae-fa13-4107-8d7c-d54685b2b293 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:16:01.179307 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5813b2ae-fa13-4107-8d7c-d54685b2b293 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:16:01.180985 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5813b2ae-fa13-4107-8d7c-d54685b2b293 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:16:01.181479 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5813b2ae-fa13-4107-8d7c-d54685b2b293 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:16:01.466412 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-5813b2ae-fa13-4107-8d7c-d54685b2b293 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd69c1f0203b047eeb6a9fa0a215a63c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09185bfad7944b199a490305c22ffc3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:16:01.485871 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-5813b2ae-fa13-4107-8d7c-d54685b2b293 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd69c1f0203b047eeb6a9fa0a215a63c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09185bfad7944b199a490305c22ffc3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:16:01.498478 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-5813b2ae-fa13-4107-8d7c-d54685b2b293 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd69c1f0203b047eeb6a9fa0a215a63c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09185bfad7944b199a490305c22ffc3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:16:01.504028 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-5813b2ae-fa13-4107-8d7c-d54685b2b293 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] 10.222.0.18 "GET /compute/v2.1/servers/4d285bc1-33a9-47e0-a148-756be61c0488" status: 200 len: 1604 microversion: 2.32 time: 0.360270 Oct 22 21:16:01.525687 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2456/4927] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:16:01 2022] GET /compute/v2.1/servers/4d285bc1-33a9-47e0-a148-756be61c0488 => generated 1604 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:16:01.707748 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-511eaf4d-8a7a-407c-bb06-e7496d075955 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:16:01.708954 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-511eaf4d-8a7a-407c-bb06-e7496d075955 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] [instance: 803a198e-9b90-4fb4-85fa-e1131abf9517] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:16:01.723573 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-511eaf4d-8a7a-407c-bb06-e7496d075955 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:16:01.727645 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-511eaf4d-8a7a-407c-bb06-e7496d075955 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:16:01.728344 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-511eaf4d-8a7a-407c-bb06-e7496d075955 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:16:01.729287 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-511eaf4d-8a7a-407c-bb06-e7496d075955 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:16:01.730108 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-511eaf4d-8a7a-407c-bb06-e7496d075955 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:16:01.731500 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-511eaf4d-8a7a-407c-bb06-e7496d075955 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:16:02.038565 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-ce509edb-cae1-4fd4-9751-4c06262bbacd tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3820b31a424c3a9216a6ef91fcb285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a42c3ecf474883ac652fcc8c01c9f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:16:02.049394 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:16:02.055717 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-ce509edb-cae1-4fd4-9751-4c06262bbacd tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] 10.222.0.18 "GET /compute/v2.1/servers/a12803be-4bbe-44d5-bfb4-f8298113556c" status: 200 len: 1577 microversion: 2.1 time: 1.142949 Oct 22 21:16:02.056568 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2472/4928] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:16:00 2022] GET /compute/v2.1/servers/a12803be-4bbe-44d5-bfb4-f8298113556c => generated 1577 bytes in 1145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:16:02.377275 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-511eaf4d-8a7a-407c-bb06-e7496d075955 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799f987b3aa7426ba5d7a464052d6490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87474d4b4c547abbfe6308b6dd8e1c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:16:02.389660 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-511eaf4d-8a7a-407c-bb06-e7496d075955 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] 10.222.0.18 "GET /compute/v2.1/servers/803a198e-9b90-4fb4-85fa-e1131abf9517" status: 200 len: 1489 microversion: 2.1 time: 0.687553 Oct 22 21:16:02.401243 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2457/4929] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:16:01 2022] GET /compute/v2.1/servers/803a198e-9b90-4fb4-85fa-e1131abf9517 => generated 1489 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:16:02.421281 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-c2e80ba9-c327-4cb7-adf2-0906fc84a2e2 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-381761331"}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:16:02.424238 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-c2e80ba9-c327-4cb7-adf2-0906fc84a2e2 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] [instance: 803a198e-9b90-4fb4-85fa-e1131abf9517] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:16:02.439631 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c2e80ba9-c327-4cb7-adf2-0906fc84a2e2 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:16:02.444083 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c2e80ba9-c327-4cb7-adf2-0906fc84a2e2 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:16:02.444837 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c2e80ba9-c327-4cb7-adf2-0906fc84a2e2 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:16:02.445813 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c2e80ba9-c327-4cb7-adf2-0906fc84a2e2 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:16:02.446517 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c2e80ba9-c327-4cb7-adf2-0906fc84a2e2 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:16:02.447195 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c2e80ba9-c327-4cb7-adf2-0906fc84a2e2 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:16:02.533767 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-213907a7-e930-44ff-bfe6-b8c79945002f tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:16:02.535286 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-213907a7-e930-44ff-bfe6-b8c79945002f tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] [instance: 4d285bc1-33a9-47e0-a148-756be61c0488] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:16:02.548493 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-213907a7-e930-44ff-bfe6-b8c79945002f tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:16:02.550014 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-213907a7-e930-44ff-bfe6-b8c79945002f tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:16:02.556102 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-213907a7-e930-44ff-bfe6-b8c79945002f tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:16:02.558351 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-213907a7-e930-44ff-bfe6-b8c79945002f tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:16:02.559067 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-213907a7-e930-44ff-bfe6-b8c79945002f tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:16:02.560406 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-213907a7-e930-44ff-bfe6-b8c79945002f tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:16:02.609808 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-c2e80ba9-c327-4cb7-adf2-0906fc84a2e2 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] 10.222.0.18 "PUT /compute/v2.1/servers/803a198e-9b90-4fb4-85fa-e1131abf9517" status: 200 len: 1061 microversion: 2.1 time: 0.192624 Oct 22 21:16:02.612996 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2473/4930] 10.222.0.18 () {60 vars in 1256 bytes} [Sat Oct 22 21:16:02 2022] PUT /compute/v2.1/servers/803a198e-9b90-4fb4-85fa-e1131abf9517 => generated 1061 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:16:02.620970 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-213907a7-e930-44ff-bfe6-b8c79945002f tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] HTTP exception thrown: Instance 4d285bc1-33a9-47e0-a148-756be61c0488 could not be found. Oct 22 21:16:02.626380 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-213907a7-e930-44ff-bfe6-b8c79945002f tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Request method failure captured: Oct 22 21:16:02.626380 ncdv-master-1 devstack@n-api.service[138744]: request: GET /compute/v2.1/servers/4d285bc1-33a9-47e0-a148-756be61c0488 HTTP/1.1 Oct 22 21:16:02.626380 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 21:16:02.626380 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 21:16:02.626380 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 21:16:02.626380 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 0 Oct 22 21:16:02.626380 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 21:16:02.626380 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 21:16:02.626380 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 21:16:02.626380 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 21:16:02.626380 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVFwgi8_GDbhksi35GsRy2Yt8vG76mKk3gAWSyQkwoXrIgHg8N5ez_jrewwz49KUUCHQl9HMjUIRdvJgvSbwKJeWy1dGikr0ZE-SQ1YHB6mPpoW3WiPNg4GJ1oy_ToPSEg34j2ErHLeyL0fg7AUzlxpjsD8HAhIMB7pgtOaw-1PfbJ-c Oct 22 21:16:02.626380 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 21:16:02.626380 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 21:16:02.626380 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 21:16:02.626380 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 21:16:02.626380 ncdv-master-1 devstack@n-api.service[138744]: X-Openstack-Nova-Api-Version: 2.32 Oct 22 21:16:02.626380 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 21:16:02.626380 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 21:16:02.626380 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: 09185bfad7944b199a490305c22ffc3d Oct 22 21:16:02.626380 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-TaggedBootDevicesTest-288730008 Oct 22 21:16:02.626380 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 21:16:02.626380 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 21:16:02.626380 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_09185bfad7944b199a490305c22ffc3d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/09185bfad7944b199a490305c22ffc3d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/09185bfad7944b199a490305c22ffc3d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/09185bfad7944b199a490305c22ffc3d"}]}] Oct 22 21:16:02.626380 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-TaggedBootDevicesTest-288730008 Oct 22 21:16:02.626380 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: 09185bfad7944b199a490305c22ffc3d Oct 22 21:16:02.626380 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-TaggedBootDevicesTest-288730008 Oct 22 21:16:02.626380 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-TaggedBootDevicesTest-288730008-project Oct 22 21:16:02.626380 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 21:16:02.626380 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 21:16:02.626380 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: d69c1f0203b047eeb6a9fa0a215a63c2 Oct 22 21:16:02.626380 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-TaggedBootDevicesTest-288730008-project Oct 22 21:16:02.626380 ncdv-master-1 devstack@n-api.service[138744]: method: > Oct 22 21:16:02.626380 ncdv-master-1 devstack@n-api.service[138744]: exception: Instance 4d285bc1-33a9-47e0-a148-756be61c0488 could not be found. Oct 22 21:16:02.626380 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': '4d285bc1-33a9-47e0-a148-756be61c0488'} Oct 22 21:16:02.626380 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:16:02.626380 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:16:02.626380 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 21:16:02.626380 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 21:16:02.626380 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 21:16:02.626380 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 21:16:02.626380 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 21:16:02.626380 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 21:16:02.626380 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 21:16:02.626380 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 21:16:02.626380 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d285bc1-33a9-47e0-a148-756be61c0488 could not be found. Oct 22 21:16:02.626380 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:16:02.626380 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:16:02.626380 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:16:02.626380 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:16:02.626380 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:16:02.626380 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:16:02.626380 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:16:02.626380 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:16:02.626380 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:16:02.626380 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:16:02.626380 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 21:16:02.626380 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 21:16:02.626380 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 21:16:02.626380 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 21:16:02.626380 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 21:16:02.626380 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:16:02.626380 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d285bc1-33a9-47e0-a148-756be61c0488 could not be found. Oct 22 21:16:02.626380 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:16:02.626380 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:16:02.626380 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:16:02.630442 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:16:02.630442 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:16:02.630442 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:16:02.630442 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:16:02.630442 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:16:02.630442 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d285bc1-33a9-47e0-a148-756be61c0488 could not be found. Oct 22 21:16:02.630442 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:16:02.633341 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-213907a7-e930-44ff-bfe6-b8c79945002f tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Returning 404 to user: Instance 4d285bc1-33a9-47e0-a148-756be61c0488 could not be found. {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:16:02.634433 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-213907a7-e930-44ff-bfe6-b8c79945002f tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] 10.222.0.18 "GET /compute/v2.1/servers/4d285bc1-33a9-47e0-a148-756be61c0488" status: 404 len: 111 microversion: 2.32 time: 0.104888 Oct 22 21:16:02.635210 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2458/4931] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:16:02 2022] GET /compute/v2.1/servers/4d285bc1-33a9-47e0-a148-756be61c0488 => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 22 21:16:02.639475 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-b605f429-4637-4bc2-8bb2-1b626e949201 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:16:02.640769 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-b605f429-4637-4bc2-8bb2-1b626e949201 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] [instance: 803a198e-9b90-4fb4-85fa-e1131abf9517] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:16:02.648507 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-ec884353-3182-466e-8ea0-34725201445d tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Calling method '.version_select at 0x7fd39f1eaf70>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:16:02.699034 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-ec884353-3182-466e-8ea0-34725201445d tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1280684049" status: 204 len: 0 microversion: 2.32 time: 0.058248 Oct 22 21:16:02.700541 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2459/4932] 10.222.0.18 () {60 vars in 1262 bytes} [Sat Oct 22 21:16:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1280684049 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 22 21:16:02.701751 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b605f429-4637-4bc2-8bb2-1b626e949201 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:16:02.703906 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b605f429-4637-4bc2-8bb2-1b626e949201 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:16:02.708353 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b605f429-4637-4bc2-8bb2-1b626e949201 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:16:02.712699 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b605f429-4637-4bc2-8bb2-1b626e949201 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:16:02.716866 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b605f429-4637-4bc2-8bb2-1b626e949201 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:16:02.719600 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b605f429-4637-4bc2-8bb2-1b626e949201 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:16:03.086191 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-347a1542-5359-4357-b6b1-d57901fe51fa tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:16:03.087124 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-347a1542-5359-4357-b6b1-d57901fe51fa tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] [instance: a12803be-4bbe-44d5-bfb4-f8298113556c] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:16:03.094788 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-347a1542-5359-4357-b6b1-d57901fe51fa tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:16:03.095714 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-347a1542-5359-4357-b6b1-d57901fe51fa tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:16:03.096363 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-347a1542-5359-4357-b6b1-d57901fe51fa tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:16:03.098028 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-347a1542-5359-4357-b6b1-d57901fe51fa tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:16:03.098959 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-347a1542-5359-4357-b6b1-d57901fe51fa tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:16:03.100138 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-347a1542-5359-4357-b6b1-d57901fe51fa tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:16:03.452137 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-b605f429-4637-4bc2-8bb2-1b626e949201 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799f987b3aa7426ba5d7a464052d6490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87474d4b4c547abbfe6308b6dd8e1c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:16:03.464803 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-b605f429-4637-4bc2-8bb2-1b626e949201 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] 10.222.0.18 "GET /compute/v2.1/servers/803a198e-9b90-4fb4-85fa-e1131abf9517" status: 200 len: 1488 microversion: 2.1 time: 0.836150 Oct 22 21:16:03.481565 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2474/4933] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:16:02 2022] GET /compute/v2.1/servers/803a198e-9b90-4fb4-85fa-e1131abf9517 => generated 1488 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:16:03.490635 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-4f05c32f-8373-4746-af1d-de9d2338a4a0 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:16:03.495990 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-4f05c32f-8373-4746-af1d-de9d2338a4a0 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] [instance: 803a198e-9b90-4fb4-85fa-e1131abf9517] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:16:03.512170 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4f05c32f-8373-4746-af1d-de9d2338a4a0 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:16:03.512927 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4f05c32f-8373-4746-af1d-de9d2338a4a0 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:16:03.513640 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4f05c32f-8373-4746-af1d-de9d2338a4a0 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:16:03.514910 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4f05c32f-8373-4746-af1d-de9d2338a4a0 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:16:03.515616 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4f05c32f-8373-4746-af1d-de9d2338a4a0 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:16:03.516314 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4f05c32f-8373-4746-af1d-de9d2338a4a0 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:16:03.953071 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-347a1542-5359-4357-b6b1-d57901fe51fa tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3820b31a424c3a9216a6ef91fcb285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a42c3ecf474883ac652fcc8c01c9f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:16:03.970798 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-347a1542-5359-4357-b6b1-d57901fe51fa tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] 10.222.0.18 "GET /compute/v2.1/servers/a12803be-4bbe-44d5-bfb4-f8298113556c" status: 200 len: 1577 microversion: 2.1 time: 0.890421 Oct 22 21:16:03.974002 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2460/4934] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:16:03 2022] GET /compute/v2.1/servers/a12803be-4bbe-44d5-bfb4-f8298113556c => generated 1577 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:16:04.128766 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-4f05c32f-8373-4746-af1d-de9d2338a4a0 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799f987b3aa7426ba5d7a464052d6490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87474d4b4c547abbfe6308b6dd8e1c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:16:04.142605 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-4f05c32f-8373-4746-af1d-de9d2338a4a0 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] 10.222.0.18 "GET /compute/v2.1/servers/803a198e-9b90-4fb4-85fa-e1131abf9517" status: 200 len: 1488 microversion: 2.1 time: 0.656487 Oct 22 21:16:04.156242 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2475/4935] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:16:03 2022] GET /compute/v2.1/servers/803a198e-9b90-4fb4-85fa-e1131abf9517 => generated 1488 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:16:04.181749 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-654cb016-81db-4ab8-845d-f61b13183ca0 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:16:04.182502 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-654cb016-81db-4ab8-845d-f61b13183ca0 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] [instance: 803a198e-9b90-4fb4-85fa-e1131abf9517] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:16:04.190127 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-654cb016-81db-4ab8-845d-f61b13183ca0 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:16:04.190895 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-654cb016-81db-4ab8-845d-f61b13183ca0 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:16:04.191714 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-654cb016-81db-4ab8-845d-f61b13183ca0 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:16:04.192783 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-654cb016-81db-4ab8-845d-f61b13183ca0 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:16:04.193572 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-654cb016-81db-4ab8-845d-f61b13183ca0 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:16:04.194176 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-654cb016-81db-4ab8-845d-f61b13183ca0 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:16:04.228835 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-654cb016-81db-4ab8-845d-f61b13183ca0 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] [instance: 803a198e-9b90-4fb4-85fa-e1131abf9517] Going to try to terminate instance {{(pid=138744) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 21:16:04.280454 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:16:04.351678 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-654cb016-81db-4ab8-845d-f61b13183ca0 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] 10.222.0.18 "DELETE /compute/v2.1/servers/803a198e-9b90-4fb4-85fa-e1131abf9517" status: 204 len: 0 microversion: 2.1 time: 0.174038 Oct 22 21:16:04.356756 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2461/4936] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 21:16:04 2022] DELETE /compute/v2.1/servers/803a198e-9b90-4fb4-85fa-e1131abf9517 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 21:16:04.361150 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-79d02cfe-b66a-4afa-8e9b-938d5aa4e568 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:16:04.361784 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-79d02cfe-b66a-4afa-8e9b-938d5aa4e568 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] [instance: 803a198e-9b90-4fb4-85fa-e1131abf9517] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:16:04.373647 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-79d02cfe-b66a-4afa-8e9b-938d5aa4e568 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:16:04.375608 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-79d02cfe-b66a-4afa-8e9b-938d5aa4e568 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:16:04.376134 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-79d02cfe-b66a-4afa-8e9b-938d5aa4e568 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:16:04.378496 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-79d02cfe-b66a-4afa-8e9b-938d5aa4e568 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:16:04.380621 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-79d02cfe-b66a-4afa-8e9b-938d5aa4e568 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:16:04.381353 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-79d02cfe-b66a-4afa-8e9b-938d5aa4e568 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:16:04.657270 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-f750083a-9863-4fd4-bc74-f8814c5fb623 req-d71a39c7-de0f-471c-bb25-dc420340f443 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a12803be-4bbe-44d5-bfb4-f8298113556c", "name": "network-vif-deleted", "tag": "5d0f1ea1-53be-4e61-b434-385f6b16da00"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:16:04.713038 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-f750083a-9863-4fd4-bc74-f8814c5fb623 req-d71a39c7-de0f-471c-bb25-dc420340f443 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:16:04.713894 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-f750083a-9863-4fd4-bc74-f8814c5fb623 req-d71a39c7-de0f-471c-bb25-dc420340f443 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:16:04.714639 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-f750083a-9863-4fd4-bc74-f8814c5fb623 req-d71a39c7-de0f-471c-bb25-dc420340f443 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:16:04.731157 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-f750083a-9863-4fd4-bc74-f8814c5fb623 req-d71a39c7-de0f-471c-bb25-dc420340f443 service nova] Creating event network-vif-deleted:5d0f1ea1-53be-4e61-b434-385f6b16da00 for instance a12803be-4bbe-44d5-bfb4-f8298113556c on nch1-master-1 Oct 22 21:16:04.742056 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-f750083a-9863-4fd4-bc74-f8814c5fb623 req-d71a39c7-de0f-471c-bb25-dc420340f443 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086526 Oct 22 21:16:04.743474 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2462/4937] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:16:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 21:16:04.858178 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-79d02cfe-b66a-4afa-8e9b-938d5aa4e568 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799f987b3aa7426ba5d7a464052d6490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87474d4b4c547abbfe6308b6dd8e1c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:16:04.889387 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-79d02cfe-b66a-4afa-8e9b-938d5aa4e568 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] 10.222.0.18 "GET /compute/v2.1/servers/803a198e-9b90-4fb4-85fa-e1131abf9517" status: 200 len: 1494 microversion: 2.1 time: 0.532209 Oct 22 21:16:04.917013 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2476/4938] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:16:04 2022] GET /compute/v2.1/servers/803a198e-9b90-4fb4-85fa-e1131abf9517 => generated 1494 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:16:05.007187 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-8b9c001d-e1cc-441e-b2d2-6e7a5ff8a864 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:16:05.008210 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-8b9c001d-e1cc-441e-b2d2-6e7a5ff8a864 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] [instance: a12803be-4bbe-44d5-bfb4-f8298113556c] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:16:05.017800 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8b9c001d-e1cc-441e-b2d2-6e7a5ff8a864 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:16:05.018546 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8b9c001d-e1cc-441e-b2d2-6e7a5ff8a864 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:16:05.019194 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8b9c001d-e1cc-441e-b2d2-6e7a5ff8a864 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:16:05.022108 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8b9c001d-e1cc-441e-b2d2-6e7a5ff8a864 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:16:05.022781 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8b9c001d-e1cc-441e-b2d2-6e7a5ff8a864 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:16:05.023444 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8b9c001d-e1cc-441e-b2d2-6e7a5ff8a864 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:16:05.094852 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8b9c001d-e1cc-441e-b2d2-6e7a5ff8a864 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:16:05.098705 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8b9c001d-e1cc-441e-b2d2-6e7a5ff8a864 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:16:05.104835 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8b9c001d-e1cc-441e-b2d2-6e7a5ff8a864 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:16:05.105331 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.objects.instance [None req-8b9c001d-e1cc-441e-b2d2-6e7a5ff8a864 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lazy-loading 'fault' on Instance uuid a12803be-4bbe-44d5-bfb4-f8298113556c {{(pid=138744) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 21:16:05.183819 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-8b9c001d-e1cc-441e-b2d2-6e7a5ff8a864 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3820b31a424c3a9216a6ef91fcb285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a42c3ecf474883ac652fcc8c01c9f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:16:05.203801 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-8b9c001d-e1cc-441e-b2d2-6e7a5ff8a864 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] 10.222.0.18 "GET /compute/v2.1/servers/a12803be-4bbe-44d5-bfb4-f8298113556c" status: 200 len: 1230 microversion: 2.1 time: 0.202780 Oct 22 21:16:05.217234 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2463/4939] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:16:04 2022] GET /compute/v2.1/servers/a12803be-4bbe-44d5-bfb4-f8298113556c => generated 1230 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:16:05.928003 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-34d3921d-a6ca-4659-a4cb-03a2f4d884ee tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:16:05.929591 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-34d3921d-a6ca-4659-a4cb-03a2f4d884ee tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] [instance: 803a198e-9b90-4fb4-85fa-e1131abf9517] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:16:05.939359 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-34d3921d-a6ca-4659-a4cb-03a2f4d884ee tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:16:05.940054 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-34d3921d-a6ca-4659-a4cb-03a2f4d884ee tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:16:05.940667 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-34d3921d-a6ca-4659-a4cb-03a2f4d884ee tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:16:05.941560 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-34d3921d-a6ca-4659-a4cb-03a2f4d884ee tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:16:05.942424 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-34d3921d-a6ca-4659-a4cb-03a2f4d884ee tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:16:05.943498 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-34d3921d-a6ca-4659-a4cb-03a2f4d884ee tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:16:06.245726 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-f9e0b292-72b6-43e7-a18d-47a4e6c28f7d tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:16:06.246362 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-f9e0b292-72b6-43e7-a18d-47a4e6c28f7d tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] [instance: a12803be-4bbe-44d5-bfb4-f8298113556c] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:16:06.259048 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f9e0b292-72b6-43e7-a18d-47a4e6c28f7d tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:16:06.259787 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f9e0b292-72b6-43e7-a18d-47a4e6c28f7d tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:16:06.260623 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f9e0b292-72b6-43e7-a18d-47a4e6c28f7d tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:16:06.261730 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f9e0b292-72b6-43e7-a18d-47a4e6c28f7d tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:16:06.273402 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f9e0b292-72b6-43e7-a18d-47a4e6c28f7d tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:16:06.275284 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f9e0b292-72b6-43e7-a18d-47a4e6c28f7d tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:16:06.322025 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-f9e0b292-72b6-43e7-a18d-47a4e6c28f7d tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] HTTP exception thrown: Instance a12803be-4bbe-44d5-bfb4-f8298113556c could not be found. Oct 22 21:16:06.325343 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-f9e0b292-72b6-43e7-a18d-47a4e6c28f7d tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Request method failure captured: Oct 22 21:16:06.325343 ncdv-master-1 devstack@n-api.service[138744]: request: GET /compute/v2.1/servers/a12803be-4bbe-44d5-bfb4-f8298113556c HTTP/1.1 Oct 22 21:16:06.325343 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 21:16:06.325343 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 21:16:06.325343 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 21:16:06.325343 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 0 Oct 22 21:16:06.325343 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 21:16:06.325343 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 21:16:06.325343 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 21:16:06.325343 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 21:16:06.325343 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVFrcKw86EUEeUngnG9DZUJvE3lmhBNDPmC4isrFt9sa-3M5uM6HCkY-mE9Fr6XyLPpjJ3yZx9ru813oA85o16iJwDuF8Nlz1bpd8p9u41wsyi0Zep7ygHQQJ9tgdQV6IQKIEN7AplmICrhSHFCRaS0cX6FN1kXuVbLH1K6CsNjHq7jM Oct 22 21:16:06.325343 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 21:16:06.325343 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 21:16:06.325343 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 21:16:06.325343 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 21:16:06.325343 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 21:16:06.325343 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 21:16:06.325343 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: 82a42c3ecf474883ac652fcc8c01c9f2 Oct 22 21:16:06.325343 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-TestVolumeBootPattern-1443368191 Oct 22 21:16:06.325343 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 21:16:06.325343 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 21:16:06.325343 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_82a42c3ecf474883ac652fcc8c01c9f2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/82a42c3ecf474883ac652fcc8c01c9f2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/82a42c3ecf474883ac652fcc8c01c9f2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/82a42c3ecf474883ac652fcc8c01c9f2"}]}] Oct 22 21:16:06.325343 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-TestVolumeBootPattern-1443368191 Oct 22 21:16:06.325343 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: 82a42c3ecf474883ac652fcc8c01c9f2 Oct 22 21:16:06.325343 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-TestVolumeBootPattern-1443368191 Oct 22 21:16:06.325343 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-TestVolumeBootPattern-1443368191-project Oct 22 21:16:06.325343 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 21:16:06.325343 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 21:16:06.325343 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: 7e3820b31a424c3a9216a6ef91fcb285 Oct 22 21:16:06.325343 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-TestVolumeBootPattern-1443368191-project Oct 22 21:16:06.325343 ncdv-master-1 devstack@n-api.service[138744]: method: > Oct 22 21:16:06.325343 ncdv-master-1 devstack@n-api.service[138744]: exception: Instance a12803be-4bbe-44d5-bfb4-f8298113556c could not be found. Oct 22 21:16:06.325343 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': 'a12803be-4bbe-44d5-bfb4-f8298113556c'} Oct 22 21:16:06.325343 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:16:06.325343 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:16:06.325343 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 21:16:06.325343 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 21:16:06.325343 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 21:16:06.325343 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 21:16:06.325343 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 21:16:06.325343 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 21:16:06.325343 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 21:16:06.325343 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 21:16:06.325343 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a12803be-4bbe-44d5-bfb4-f8298113556c could not be found. Oct 22 21:16:06.325343 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:16:06.325343 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:16:06.325343 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:16:06.325343 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:16:06.325343 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:16:06.325343 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:16:06.325343 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:16:06.325343 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:16:06.325343 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:16:06.325343 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:16:06.325343 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 21:16:06.325343 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 21:16:06.325343 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 21:16:06.325343 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 21:16:06.325343 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 21:16:06.325343 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:16:06.325343 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a12803be-4bbe-44d5-bfb4-f8298113556c could not be found. Oct 22 21:16:06.325343 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:16:06.325343 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:16:06.325343 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:16:06.330420 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:16:06.330420 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:16:06.330420 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:16:06.330420 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:16:06.330420 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:16:06.330420 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a12803be-4bbe-44d5-bfb4-f8298113556c could not be found. Oct 22 21:16:06.330420 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:16:06.330420 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-f9e0b292-72b6-43e7-a18d-47a4e6c28f7d tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Returning 404 to user: Instance a12803be-4bbe-44d5-bfb4-f8298113556c could not be found. {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:16:06.330420 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-f9e0b292-72b6-43e7-a18d-47a4e6c28f7d tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] 10.222.0.18 "GET /compute/v2.1/servers/a12803be-4bbe-44d5-bfb4-f8298113556c" status: 404 len: 111 microversion: 2.1 time: 0.099966 Oct 22 21:16:06.334160 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2464/4940] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:16:06 2022] GET /compute/v2.1/servers/a12803be-4bbe-44d5-bfb4-f8298113556c => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 22 21:16:06.390253 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-34d3921d-a6ca-4659-a4cb-03a2f4d884ee tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799f987b3aa7426ba5d7a464052d6490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87474d4b4c547abbfe6308b6dd8e1c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:16:06.398696 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-34d3921d-a6ca-4659-a4cb-03a2f4d884ee tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] 10.222.0.18 "GET /compute/v2.1/servers/803a198e-9b90-4fb4-85fa-e1131abf9517" status: 200 len: 1494 microversion: 2.1 time: 0.475962 Oct 22 21:16:06.409388 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2477/4941] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:16:05 2022] GET /compute/v2.1/servers/803a198e-9b90-4fb4-85fa-e1131abf9517 => generated 1494 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:16:07.199163 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-62bb0e69-fd82-4b93-b97a-7700521ecc1c req-b570f0ad-cab8-4e3e-b669-1d14a1131bcd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "803a198e-9b90-4fb4-85fa-e1131abf9517", "name": "network-vif-deleted", "tag": "6efed533-3c69-4b21-aa51-cb41b855cf3e"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:16:07.225488 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-62bb0e69-fd82-4b93-b97a-7700521ecc1c req-b570f0ad-cab8-4e3e-b669-1d14a1131bcd service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:16:07.226212 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-62bb0e69-fd82-4b93-b97a-7700521ecc1c req-b570f0ad-cab8-4e3e-b669-1d14a1131bcd service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:16:07.227453 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-62bb0e69-fd82-4b93-b97a-7700521ecc1c req-b570f0ad-cab8-4e3e-b669-1d14a1131bcd service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:16:07.241277 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-62bb0e69-fd82-4b93-b97a-7700521ecc1c req-b570f0ad-cab8-4e3e-b669-1d14a1131bcd service nova] Creating event network-vif-deleted:6efed533-3c69-4b21-aa51-cb41b855cf3e for instance 803a198e-9b90-4fb4-85fa-e1131abf9517 on nch2-master-1 Oct 22 21:16:07.248393 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-62bb0e69-fd82-4b93-b97a-7700521ecc1c req-b570f0ad-cab8-4e3e-b669-1d14a1131bcd service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063037 Oct 22 21:16:07.250073 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2465/4942] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:16:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:16:07.399003 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-21a81fe6-5792-48e3-b4cd-ad99d625910a tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:16:07.399003 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-21a81fe6-5792-48e3-b4cd-ad99d625910a tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] [instance: 1324c851-90ff-47f4-b4e6-8acc8b829c5e] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:16:07.407177 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-21a81fe6-5792-48e3-b4cd-ad99d625910a tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:16:07.407721 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-21a81fe6-5792-48e3-b4cd-ad99d625910a tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:16:07.408186 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-21a81fe6-5792-48e3-b4cd-ad99d625910a tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:16:07.408932 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-21a81fe6-5792-48e3-b4cd-ad99d625910a tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:16:07.409411 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-21a81fe6-5792-48e3-b4cd-ad99d625910a tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:16:07.409862 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-21a81fe6-5792-48e3-b4cd-ad99d625910a tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:16:07.437125 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-18e9749e-96a4-4d1c-9f1a-5e26212d4b72 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:16:07.437853 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-18e9749e-96a4-4d1c-9f1a-5e26212d4b72 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] [instance: 803a198e-9b90-4fb4-85fa-e1131abf9517] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:16:07.451593 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-18e9749e-96a4-4d1c-9f1a-5e26212d4b72 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:16:07.452402 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-18e9749e-96a4-4d1c-9f1a-5e26212d4b72 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:16:07.453013 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-18e9749e-96a4-4d1c-9f1a-5e26212d4b72 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:16:07.453907 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-18e9749e-96a4-4d1c-9f1a-5e26212d4b72 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:16:07.454316 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.wsgi [None req-21a81fe6-5792-48e3-b4cd-ad99d625910a tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] HTTP exception thrown: Instance 1324c851-90ff-47f4-b4e6-8acc8b829c5e could not be found. Oct 22 21:16:07.455628 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-18e9749e-96a4-4d1c-9f1a-5e26212d4b72 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:16:07.456243 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-18e9749e-96a4-4d1c-9f1a-5e26212d4b72 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:16:07.456443 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-21a81fe6-5792-48e3-b4cd-ad99d625910a tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Request method failure captured: Oct 22 21:16:07.456443 ncdv-master-1 devstack@n-api.service[138745]: request: DELETE /compute/v2.1/servers/1324c851-90ff-47f4-b4e6-8acc8b829c5e HTTP/1.1 Oct 22 21:16:07.456443 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 21:16:07.456443 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 21:16:07.456443 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 21:16:07.456443 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 0 Oct 22 21:16:07.456443 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 21:16:07.456443 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 21:16:07.456443 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 21:16:07.456443 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 21:16:07.456443 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVFrcKw86EUEeUngnG9DZUJvE3lmhBNDPmC4isrFt9sa-3M5uM6HCkY-mE9Fr6XyLPpjJ3yZx9ru813oA85o16iJwDuF8Nlz1bpd8p9u41wsyi0Zep7ygHQQJ9tgdQV6IQKIEN7AplmICrhSHFCRaS0cX6FN1kXuVbLH1K6CsNjHq7jM Oct 22 21:16:07.456443 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 21:16:07.456443 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 21:16:07.456443 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 21:16:07.456443 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 21:16:07.456443 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 21:16:07.456443 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 21:16:07.456443 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: 82a42c3ecf474883ac652fcc8c01c9f2 Oct 22 21:16:07.456443 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-TestVolumeBootPattern-1443368191 Oct 22 21:16:07.456443 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 21:16:07.456443 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 21:16:07.456443 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_82a42c3ecf474883ac652fcc8c01c9f2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/82a42c3ecf474883ac652fcc8c01c9f2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/82a42c3ecf474883ac652fcc8c01c9f2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/82a42c3ecf474883ac652fcc8c01c9f2"}]}] Oct 22 21:16:07.456443 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-TestVolumeBootPattern-1443368191 Oct 22 21:16:07.456443 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: 82a42c3ecf474883ac652fcc8c01c9f2 Oct 22 21:16:07.456443 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-TestVolumeBootPattern-1443368191 Oct 22 21:16:07.456443 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-TestVolumeBootPattern-1443368191-project Oct 22 21:16:07.456443 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 21:16:07.456443 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 21:16:07.456443 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: 7e3820b31a424c3a9216a6ef91fcb285 Oct 22 21:16:07.456443 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-TestVolumeBootPattern-1443368191-project Oct 22 21:16:07.456443 ncdv-master-1 devstack@n-api.service[138745]: method: > Oct 22 21:16:07.456443 ncdv-master-1 devstack@n-api.service[138745]: exception: Instance 1324c851-90ff-47f4-b4e6-8acc8b829c5e could not be found. Oct 22 21:16:07.456443 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'id': '1324c851-90ff-47f4-b4e6-8acc8b829c5e'} Oct 22 21:16:07.456443 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:16:07.456443 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:16:07.456443 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 21:16:07.456443 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 21:16:07.456443 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 21:16:07.456443 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 21:16:07.456443 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 21:16:07.456443 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 21:16:07.456443 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 21:16:07.456443 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 21:16:07.456443 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1324c851-90ff-47f4-b4e6-8acc8b829c5e could not be found. Oct 22 21:16:07.456443 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:16:07.456443 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:16:07.456443 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:16:07.456443 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:16:07.456443 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:16:07.456443 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:16:07.456443 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:16:07.456443 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:16:07.456443 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:16:07.456443 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:16:07.456443 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 22 21:16:07.456443 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 22 21:16:07.456443 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 22 21:16:07.456443 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 22 21:16:07.456443 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 21:16:07.456443 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 21:16:07.456443 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 21:16:07.456443 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:16:07.461568 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1324c851-90ff-47f4-b4e6-8acc8b829c5e could not be found. Oct 22 21:16:07.461568 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:16:07.461568 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:16:07.461568 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:16:07.461568 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:16:07.461568 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:16:07.461568 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:16:07.461568 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:16:07.461568 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:16:07.461568 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1324c851-90ff-47f4-b4e6-8acc8b829c5e could not be found. Oct 22 21:16:07.461568 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:16:07.467096 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-21a81fe6-5792-48e3-b4cd-ad99d625910a tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Returning 404 to user: Instance 1324c851-90ff-47f4-b4e6-8acc8b829c5e could not be found. {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:16:07.468339 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-21a81fe6-5792-48e3-b4cd-ad99d625910a tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] 10.222.0.18 "DELETE /compute/v2.1/servers/1324c851-90ff-47f4-b4e6-8acc8b829c5e" status: 404 len: 111 microversion: 2.1 time: 0.079752 Oct 22 21:16:07.469078 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2478/4943] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 21:16:07 2022] DELETE /compute/v2.1/servers/1324c851-90ff-47f4-b4e6-8acc8b829c5e => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 21:16:07.479638 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-a62411a6-6f47-4ad7-88bf-662cc74b64f3 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:16:07.480756 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-a62411a6-6f47-4ad7-88bf-662cc74b64f3 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] [instance: 1324c851-90ff-47f4-b4e6-8acc8b829c5e] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:16:07.488618 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a62411a6-6f47-4ad7-88bf-662cc74b64f3 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:16:07.489809 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a62411a6-6f47-4ad7-88bf-662cc74b64f3 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:16:07.492097 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a62411a6-6f47-4ad7-88bf-662cc74b64f3 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:16:07.493172 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a62411a6-6f47-4ad7-88bf-662cc74b64f3 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:16:07.493916 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a62411a6-6f47-4ad7-88bf-662cc74b64f3 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:16:07.494892 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a62411a6-6f47-4ad7-88bf-662cc74b64f3 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:16:07.520193 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.wsgi [None req-a62411a6-6f47-4ad7-88bf-662cc74b64f3 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] HTTP exception thrown: Instance 1324c851-90ff-47f4-b4e6-8acc8b829c5e could not be found. Oct 22 21:16:07.522691 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-a62411a6-6f47-4ad7-88bf-662cc74b64f3 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Request method failure captured: Oct 22 21:16:07.522691 ncdv-master-1 devstack@n-api.service[138745]: request: GET /compute/v2.1/servers/1324c851-90ff-47f4-b4e6-8acc8b829c5e HTTP/1.1 Oct 22 21:16:07.522691 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 21:16:07.522691 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 21:16:07.522691 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 21:16:07.522691 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 0 Oct 22 21:16:07.522691 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 21:16:07.522691 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 21:16:07.522691 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 21:16:07.522691 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 21:16:07.522691 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVFrcKw86EUEeUngnG9DZUJvE3lmhBNDPmC4isrFt9sa-3M5uM6HCkY-mE9Fr6XyLPpjJ3yZx9ru813oA85o16iJwDuF8Nlz1bpd8p9u41wsyi0Zep7ygHQQJ9tgdQV6IQKIEN7AplmICrhSHFCRaS0cX6FN1kXuVbLH1K6CsNjHq7jM Oct 22 21:16:07.522691 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 21:16:07.522691 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 21:16:07.522691 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 21:16:07.522691 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 21:16:07.522691 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 21:16:07.522691 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 21:16:07.522691 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: 82a42c3ecf474883ac652fcc8c01c9f2 Oct 22 21:16:07.522691 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-TestVolumeBootPattern-1443368191 Oct 22 21:16:07.522691 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 21:16:07.522691 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 21:16:07.522691 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_82a42c3ecf474883ac652fcc8c01c9f2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/82a42c3ecf474883ac652fcc8c01c9f2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/82a42c3ecf474883ac652fcc8c01c9f2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/82a42c3ecf474883ac652fcc8c01c9f2"}]}] Oct 22 21:16:07.522691 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-TestVolumeBootPattern-1443368191 Oct 22 21:16:07.522691 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: 82a42c3ecf474883ac652fcc8c01c9f2 Oct 22 21:16:07.522691 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-TestVolumeBootPattern-1443368191 Oct 22 21:16:07.522691 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-TestVolumeBootPattern-1443368191-project Oct 22 21:16:07.522691 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 21:16:07.522691 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 21:16:07.522691 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: 7e3820b31a424c3a9216a6ef91fcb285 Oct 22 21:16:07.522691 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-TestVolumeBootPattern-1443368191-project Oct 22 21:16:07.522691 ncdv-master-1 devstack@n-api.service[138745]: method: > Oct 22 21:16:07.522691 ncdv-master-1 devstack@n-api.service[138745]: exception: Instance 1324c851-90ff-47f4-b4e6-8acc8b829c5e could not be found. Oct 22 21:16:07.522691 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'id': '1324c851-90ff-47f4-b4e6-8acc8b829c5e'} Oct 22 21:16:07.522691 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:16:07.522691 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:16:07.522691 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 21:16:07.522691 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 21:16:07.522691 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 21:16:07.522691 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 21:16:07.522691 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 21:16:07.522691 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 21:16:07.522691 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 21:16:07.522691 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 21:16:07.522691 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1324c851-90ff-47f4-b4e6-8acc8b829c5e could not be found. Oct 22 21:16:07.522691 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:16:07.522691 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:16:07.522691 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:16:07.522691 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:16:07.522691 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:16:07.522691 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:16:07.522691 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:16:07.522691 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:16:07.522691 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:16:07.522691 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:16:07.522691 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 21:16:07.522691 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 21:16:07.522691 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 21:16:07.522691 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 21:16:07.522691 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 21:16:07.522691 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:16:07.522691 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1324c851-90ff-47f4-b4e6-8acc8b829c5e could not be found. Oct 22 21:16:07.522691 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:16:07.522691 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:16:07.522691 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:16:07.527005 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:16:07.527005 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:16:07.527005 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:16:07.527005 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:16:07.527005 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:16:07.527005 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1324c851-90ff-47f4-b4e6-8acc8b829c5e could not be found. Oct 22 21:16:07.527005 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:16:07.532422 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-a62411a6-6f47-4ad7-88bf-662cc74b64f3 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Returning 404 to user: Instance 1324c851-90ff-47f4-b4e6-8acc8b829c5e could not be found. {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:16:07.534377 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-a62411a6-6f47-4ad7-88bf-662cc74b64f3 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] 10.222.0.18 "GET /compute/v2.1/servers/1324c851-90ff-47f4-b4e6-8acc8b829c5e" status: 404 len: 111 microversion: 2.1 time: 0.060549 Oct 22 21:16:07.535379 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2479/4944] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:16:07 2022] GET /compute/v2.1/servers/1324c851-90ff-47f4-b4e6-8acc8b829c5e => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 21:16:07.576264 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-18e9749e-96a4-4d1c-9f1a-5e26212d4b72 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:16:07.576780 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-18e9749e-96a4-4d1c-9f1a-5e26212d4b72 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:16:07.577361 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-18e9749e-96a4-4d1c-9f1a-5e26212d4b72 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:16:07.577839 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.objects.instance [None req-18e9749e-96a4-4d1c-9f1a-5e26212d4b72 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lazy-loading 'fault' on Instance uuid 803a198e-9b90-4fb4-85fa-e1131abf9517 {{(pid=138744) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 21:16:07.853908 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-18e9749e-96a4-4d1c-9f1a-5e26212d4b72 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799f987b3aa7426ba5d7a464052d6490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87474d4b4c547abbfe6308b6dd8e1c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:16:07.875537 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-18e9749e-96a4-4d1c-9f1a-5e26212d4b72 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] 10.222.0.18 "GET /compute/v2.1/servers/803a198e-9b90-4fb4-85fa-e1131abf9517" status: 200 len: 1309 microversion: 2.1 time: 0.444224 Oct 22 21:16:07.876594 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2466/4945] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:16:07 2022] GET /compute/v2.1/servers/803a198e-9b90-4fb4-85fa-e1131abf9517 => generated 1309 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:16:08.901388 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-39388557-4240-415b-ad15-9414d0b35ec3 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:16:08.902762 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-39388557-4240-415b-ad15-9414d0b35ec3 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] [instance: 803a198e-9b90-4fb4-85fa-e1131abf9517] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:16:08.911684 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-39388557-4240-415b-ad15-9414d0b35ec3 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:16:08.912451 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-39388557-4240-415b-ad15-9414d0b35ec3 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:16:08.913156 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-39388557-4240-415b-ad15-9414d0b35ec3 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:16:08.915515 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-39388557-4240-415b-ad15-9414d0b35ec3 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:16:08.916083 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-39388557-4240-415b-ad15-9414d0b35ec3 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:16:08.917309 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-39388557-4240-415b-ad15-9414d0b35ec3 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:16:08.944358 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.wsgi [None req-39388557-4240-415b-ad15-9414d0b35ec3 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] HTTP exception thrown: Instance 803a198e-9b90-4fb4-85fa-e1131abf9517 could not be found. Oct 22 21:16:08.946494 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-39388557-4240-415b-ad15-9414d0b35ec3 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Request method failure captured: Oct 22 21:16:08.946494 ncdv-master-1 devstack@n-api.service[138745]: request: GET /compute/v2.1/servers/803a198e-9b90-4fb4-85fa-e1131abf9517 HTTP/1.1 Oct 22 21:16:08.946494 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 21:16:08.946494 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 21:16:08.946494 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 21:16:08.946494 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 0 Oct 22 21:16:08.946494 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 21:16:08.946494 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 21:16:08.946494 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 21:16:08.946494 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 21:16:08.946494 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVFzbjFuxlabhGO5W5IN5r54yzIxFa_mX4J74OzfXM08pyPGfws2Ww4pm5qGKXFC4h2Ttyt1JiFfrSI-ucQt7MPAhDqF8_tQs5Z1aGjJkE87trFhYgYaJFSihYuRhX8jAUHeeDuqMpE3BFEYcIHoIoAbD2BZHLThVUs-wQCfowY_4sFQ Oct 22 21:16:08.946494 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 21:16:08.946494 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 21:16:08.946494 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 21:16:08.946494 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 21:16:08.946494 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 21:16:08.946494 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 21:16:08.946494 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: e87474d4b4c547abbfe6308b6dd8e1c8 Oct 22 21:16:08.946494 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-ServersTestJSON-2007137082 Oct 22 21:16:08.946494 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 21:16:08.946494 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 21:16:08.946494 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_e87474d4b4c547abbfe6308b6dd8e1c8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e87474d4b4c547abbfe6308b6dd8e1c8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/e87474d4b4c547abbfe6308b6dd8e1c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e87474d4b4c547abbfe6308b6dd8e1c8"}]}] Oct 22 21:16:08.946494 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-ServersTestJSON-2007137082 Oct 22 21:16:08.946494 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: e87474d4b4c547abbfe6308b6dd8e1c8 Oct 22 21:16:08.946494 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-ServersTestJSON-2007137082 Oct 22 21:16:08.946494 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-ServersTestJSON-2007137082-project Oct 22 21:16:08.946494 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 21:16:08.946494 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 21:16:08.946494 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: 799f987b3aa7426ba5d7a464052d6490 Oct 22 21:16:08.946494 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-ServersTestJSON-2007137082-project Oct 22 21:16:08.946494 ncdv-master-1 devstack@n-api.service[138745]: method: > Oct 22 21:16:08.946494 ncdv-master-1 devstack@n-api.service[138745]: exception: Instance 803a198e-9b90-4fb4-85fa-e1131abf9517 could not be found. Oct 22 21:16:08.946494 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'id': '803a198e-9b90-4fb4-85fa-e1131abf9517'} Oct 22 21:16:08.946494 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:16:08.946494 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:16:08.946494 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 21:16:08.946494 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 21:16:08.946494 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 21:16:08.946494 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 21:16:08.946494 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 21:16:08.946494 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 21:16:08.946494 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 21:16:08.946494 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 21:16:08.946494 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 803a198e-9b90-4fb4-85fa-e1131abf9517 could not be found. Oct 22 21:16:08.946494 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:16:08.946494 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:16:08.946494 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:16:08.946494 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:16:08.946494 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:16:08.946494 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:16:08.946494 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:16:08.946494 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:16:08.946494 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:16:08.946494 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:16:08.946494 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 21:16:08.946494 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 21:16:08.946494 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 21:16:08.946494 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 21:16:08.946494 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 21:16:08.946494 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:16:08.946494 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 803a198e-9b90-4fb4-85fa-e1131abf9517 could not be found. Oct 22 21:16:08.946494 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:16:08.946494 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:16:08.946494 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:16:08.950865 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:16:08.950865 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:16:08.950865 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:16:08.950865 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:16:08.950865 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:16:08.950865 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 803a198e-9b90-4fb4-85fa-e1131abf9517 could not be found. Oct 22 21:16:08.950865 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:16:08.952607 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-39388557-4240-415b-ad15-9414d0b35ec3 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Returning 404 to user: Instance 803a198e-9b90-4fb4-85fa-e1131abf9517 could not be found. {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:16:08.953853 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-39388557-4240-415b-ad15-9414d0b35ec3 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] 10.222.0.18 "GET /compute/v2.1/servers/803a198e-9b90-4fb4-85fa-e1131abf9517" status: 404 len: 111 microversion: 2.1 time: 0.056708 Oct 22 21:16:08.954604 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2480/4946] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:16:08 2022] GET /compute/v2.1/servers/803a198e-9b90-4fb4-85fa-e1131abf9517 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 21:16:08.981151 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-8c77480f-fde7-43c9-a29b-d78c1c57828d tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:16:08.982196 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-8c77480f-fde7-43c9-a29b-d78c1c57828d tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] [instance: 803a198e-9b90-4fb4-85fa-e1131abf9517] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:16:08.990197 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8c77480f-fde7-43c9-a29b-d78c1c57828d tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:16:08.996436 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-70dab06c-1244-4449-9446-daafd29bcc62 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:16:08.996972 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-70dab06c-1244-4449-9446-daafd29bcc62 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] [instance: 4d285bc1-33a9-47e0-a148-756be61c0488] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:16:09.000643 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8c77480f-fde7-43c9-a29b-d78c1c57828d tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:16:09.001112 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8c77480f-fde7-43c9-a29b-d78c1c57828d tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:16:09.001929 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8c77480f-fde7-43c9-a29b-d78c1c57828d tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:16:09.002405 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8c77480f-fde7-43c9-a29b-d78c1c57828d tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:16:09.002847 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8c77480f-fde7-43c9-a29b-d78c1c57828d tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:16:09.005617 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-70dab06c-1244-4449-9446-daafd29bcc62 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:16:09.006509 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-70dab06c-1244-4449-9446-daafd29bcc62 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:16:09.007090 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-70dab06c-1244-4449-9446-daafd29bcc62 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:16:09.008279 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-70dab06c-1244-4449-9446-daafd29bcc62 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:16:09.010040 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-70dab06c-1244-4449-9446-daafd29bcc62 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:16:09.010614 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-70dab06c-1244-4449-9446-daafd29bcc62 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:16:09.024109 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-8c77480f-fde7-43c9-a29b-d78c1c57828d tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] HTTP exception thrown: Instance 803a198e-9b90-4fb4-85fa-e1131abf9517 could not be found. Oct 22 21:16:09.025861 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-8c77480f-fde7-43c9-a29b-d78c1c57828d tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Request method failure captured: Oct 22 21:16:09.025861 ncdv-master-1 devstack@n-api.service[138744]: request: DELETE /compute/v2.1/servers/803a198e-9b90-4fb4-85fa-e1131abf9517 HTTP/1.1 Oct 22 21:16:09.025861 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 21:16:09.025861 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 21:16:09.025861 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 21:16:09.025861 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 0 Oct 22 21:16:09.025861 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 21:16:09.025861 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 21:16:09.025861 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 21:16:09.025861 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 21:16:09.025861 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVFzbjFuxlabhGO5W5IN5r54yzIxFa_mX4J74OzfXM08pyPGfws2Ww4pm5qGKXFC4h2Ttyt1JiFfrSI-ucQt7MPAhDqF8_tQs5Z1aGjJkE87trFhYgYaJFSihYuRhX8jAUHeeDuqMpE3BFEYcIHoIoAbD2BZHLThVUs-wQCfowY_4sFQ Oct 22 21:16:09.025861 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 21:16:09.025861 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 21:16:09.025861 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 21:16:09.025861 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 21:16:09.025861 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 21:16:09.025861 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 21:16:09.025861 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: e87474d4b4c547abbfe6308b6dd8e1c8 Oct 22 21:16:09.025861 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-ServersTestJSON-2007137082 Oct 22 21:16:09.025861 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 21:16:09.025861 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 21:16:09.025861 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_e87474d4b4c547abbfe6308b6dd8e1c8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e87474d4b4c547abbfe6308b6dd8e1c8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/e87474d4b4c547abbfe6308b6dd8e1c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e87474d4b4c547abbfe6308b6dd8e1c8"}]}] Oct 22 21:16:09.025861 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-ServersTestJSON-2007137082 Oct 22 21:16:09.025861 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: e87474d4b4c547abbfe6308b6dd8e1c8 Oct 22 21:16:09.025861 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-ServersTestJSON-2007137082 Oct 22 21:16:09.025861 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-ServersTestJSON-2007137082-project Oct 22 21:16:09.025861 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 21:16:09.025861 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 21:16:09.025861 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: 799f987b3aa7426ba5d7a464052d6490 Oct 22 21:16:09.025861 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-ServersTestJSON-2007137082-project Oct 22 21:16:09.025861 ncdv-master-1 devstack@n-api.service[138744]: method: > Oct 22 21:16:09.025861 ncdv-master-1 devstack@n-api.service[138744]: exception: Instance 803a198e-9b90-4fb4-85fa-e1131abf9517 could not be found. Oct 22 21:16:09.025861 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': '803a198e-9b90-4fb4-85fa-e1131abf9517'} Oct 22 21:16:09.025861 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:16:09.025861 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:16:09.025861 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 21:16:09.025861 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 21:16:09.025861 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 21:16:09.025861 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 21:16:09.025861 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 21:16:09.025861 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 21:16:09.025861 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 21:16:09.025861 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 21:16:09.025861 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 803a198e-9b90-4fb4-85fa-e1131abf9517 could not be found. Oct 22 21:16:09.025861 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:16:09.025861 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:16:09.025861 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:16:09.025861 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:16:09.025861 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:16:09.025861 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:16:09.025861 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:16:09.025861 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:16:09.025861 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:16:09.025861 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:16:09.025861 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 22 21:16:09.025861 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 22 21:16:09.025861 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 22 21:16:09.025861 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 22 21:16:09.025861 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 21:16:09.025861 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 21:16:09.025861 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 21:16:09.025861 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:16:09.025861 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 803a198e-9b90-4fb4-85fa-e1131abf9517 could not be found. Oct 22 21:16:09.030427 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:16:09.030427 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:16:09.030427 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:16:09.030427 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:16:09.030427 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:16:09.030427 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:16:09.030427 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:16:09.030427 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:16:09.030427 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 803a198e-9b90-4fb4-85fa-e1131abf9517 could not be found. Oct 22 21:16:09.030427 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:16:09.030427 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-8c77480f-fde7-43c9-a29b-d78c1c57828d tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Returning 404 to user: Instance 803a198e-9b90-4fb4-85fa-e1131abf9517 could not be found. {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:16:09.030427 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-8c77480f-fde7-43c9-a29b-d78c1c57828d tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] 10.222.0.18 "DELETE /compute/v2.1/servers/803a198e-9b90-4fb4-85fa-e1131abf9517" status: 404 len: 111 microversion: 2.1 time: 0.050333 Oct 22 21:16:09.031430 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2467/4947] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 21:16:08 2022] DELETE /compute/v2.1/servers/803a198e-9b90-4fb4-85fa-e1131abf9517 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 21:16:09.034663 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.wsgi [None req-70dab06c-1244-4449-9446-daafd29bcc62 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] HTTP exception thrown: Instance 4d285bc1-33a9-47e0-a148-756be61c0488 could not be found. Oct 22 21:16:09.036644 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-70dab06c-1244-4449-9446-daafd29bcc62 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Request method failure captured: Oct 22 21:16:09.036644 ncdv-master-1 devstack@n-api.service[138745]: request: DELETE /compute/v2.1/servers/4d285bc1-33a9-47e0-a148-756be61c0488 HTTP/1.1 Oct 22 21:16:09.036644 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 21:16:09.036644 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 21:16:09.036644 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 21:16:09.036644 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 0 Oct 22 21:16:09.036644 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 21:16:09.036644 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 21:16:09.036644 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 21:16:09.036644 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 21:16:09.036644 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVFwgi8_GDbhksi35GsRy2Yt8vG76mKk3gAWSyQkwoXrIgHg8N5ez_jrewwz49KUUCHQl9HMjUIRdvJgvSbwKJeWy1dGikr0ZE-SQ1YHB6mPpoW3WiPNg4GJ1oy_ToPSEg34j2ErHLeyL0fg7AUzlxpjsD8HAhIMB7pgtOaw-1PfbJ-c Oct 22 21:16:09.036644 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 21:16:09.036644 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 21:16:09.036644 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 21:16:09.036644 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 21:16:09.036644 ncdv-master-1 devstack@n-api.service[138745]: X-Openstack-Nova-Api-Version: 2.32 Oct 22 21:16:09.036644 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 21:16:09.036644 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 21:16:09.036644 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: 09185bfad7944b199a490305c22ffc3d Oct 22 21:16:09.036644 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-TaggedBootDevicesTest-288730008 Oct 22 21:16:09.036644 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 21:16:09.036644 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 21:16:09.036644 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_09185bfad7944b199a490305c22ffc3d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/09185bfad7944b199a490305c22ffc3d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/09185bfad7944b199a490305c22ffc3d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/09185bfad7944b199a490305c22ffc3d"}]}] Oct 22 21:16:09.036644 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-TaggedBootDevicesTest-288730008 Oct 22 21:16:09.036644 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: 09185bfad7944b199a490305c22ffc3d Oct 22 21:16:09.036644 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-TaggedBootDevicesTest-288730008 Oct 22 21:16:09.036644 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-TaggedBootDevicesTest-288730008-project Oct 22 21:16:09.036644 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 21:16:09.036644 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 21:16:09.036644 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: d69c1f0203b047eeb6a9fa0a215a63c2 Oct 22 21:16:09.036644 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-TaggedBootDevicesTest-288730008-project Oct 22 21:16:09.036644 ncdv-master-1 devstack@n-api.service[138745]: method: > Oct 22 21:16:09.036644 ncdv-master-1 devstack@n-api.service[138745]: exception: Instance 4d285bc1-33a9-47e0-a148-756be61c0488 could not be found. Oct 22 21:16:09.036644 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'id': '4d285bc1-33a9-47e0-a148-756be61c0488'} Oct 22 21:16:09.036644 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:16:09.036644 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:16:09.036644 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 21:16:09.036644 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 21:16:09.036644 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 21:16:09.036644 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 21:16:09.036644 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 21:16:09.036644 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 21:16:09.036644 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 21:16:09.036644 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 21:16:09.036644 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d285bc1-33a9-47e0-a148-756be61c0488 could not be found. Oct 22 21:16:09.036644 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:16:09.036644 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:16:09.036644 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:16:09.036644 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:16:09.036644 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:16:09.036644 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:16:09.036644 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:16:09.036644 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:16:09.036644 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:16:09.036644 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:16:09.036644 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 22 21:16:09.036644 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 22 21:16:09.036644 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 22 21:16:09.036644 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 22 21:16:09.036644 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 21:16:09.036644 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 21:16:09.036644 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 21:16:09.036644 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:16:09.041124 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d285bc1-33a9-47e0-a148-756be61c0488 could not be found. Oct 22 21:16:09.041124 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:16:09.041124 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:16:09.041124 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:16:09.041124 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:16:09.041124 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:16:09.041124 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:16:09.041124 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:16:09.041124 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:16:09.041124 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d285bc1-33a9-47e0-a148-756be61c0488 could not be found. Oct 22 21:16:09.041124 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:16:09.041124 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-70dab06c-1244-4449-9446-daafd29bcc62 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Returning 404 to user: Instance 4d285bc1-33a9-47e0-a148-756be61c0488 could not be found. {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:16:09.041124 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-70dab06c-1244-4449-9446-daafd29bcc62 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] 10.222.0.18 "DELETE /compute/v2.1/servers/4d285bc1-33a9-47e0-a148-756be61c0488" status: 404 len: 111 microversion: 2.32 time: 0.046342 Oct 22 21:16:09.042173 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2481/4948] 10.222.0.18 () {60 vars in 1280 bytes} [Sat Oct 22 21:16:08 2022] DELETE /compute/v2.1/servers/4d285bc1-33a9-47e0-a148-756be61c0488 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 22 21:16:09.045217 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-25aeea83-e201-4c00-96af-149d8edc2993 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:16:09.045957 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-25aeea83-e201-4c00-96af-149d8edc2993 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] [instance: 803a198e-9b90-4fb4-85fa-e1131abf9517] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:16:09.046890 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-ffeefd86-958c-42b6-ac6c-a4a79def6cf8 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:16:09.047566 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-ffeefd86-958c-42b6-ac6c-a4a79def6cf8 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] [instance: 4d285bc1-33a9-47e0-a148-756be61c0488] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:16:09.054543 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ffeefd86-958c-42b6-ac6c-a4a79def6cf8 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:16:09.055065 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ffeefd86-958c-42b6-ac6c-a4a79def6cf8 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:16:09.055555 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ffeefd86-958c-42b6-ac6c-a4a79def6cf8 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:16:09.055694 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-25aeea83-e201-4c00-96af-149d8edc2993 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:16:09.056270 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-25aeea83-e201-4c00-96af-149d8edc2993 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:16:09.056409 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ffeefd86-958c-42b6-ac6c-a4a79def6cf8 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:16:09.056742 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ffeefd86-958c-42b6-ac6c-a4a79def6cf8 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:16:09.057375 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ffeefd86-958c-42b6-ac6c-a4a79def6cf8 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:16:09.057994 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-25aeea83-e201-4c00-96af-149d8edc2993 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:16:09.060171 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-25aeea83-e201-4c00-96af-149d8edc2993 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:16:09.060757 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-25aeea83-e201-4c00-96af-149d8edc2993 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:16:09.065107 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-25aeea83-e201-4c00-96af-149d8edc2993 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:16:09.085325 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.wsgi [None req-ffeefd86-958c-42b6-ac6c-a4a79def6cf8 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] HTTP exception thrown: Instance 4d285bc1-33a9-47e0-a148-756be61c0488 could not be found. Oct 22 21:16:09.087241 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-ffeefd86-958c-42b6-ac6c-a4a79def6cf8 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Request method failure captured: Oct 22 21:16:09.087241 ncdv-master-1 devstack@n-api.service[138745]: request: GET /compute/v2.1/servers/4d285bc1-33a9-47e0-a148-756be61c0488 HTTP/1.1 Oct 22 21:16:09.087241 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 21:16:09.087241 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 21:16:09.087241 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 21:16:09.087241 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 0 Oct 22 21:16:09.087241 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 21:16:09.087241 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 21:16:09.087241 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 21:16:09.087241 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 21:16:09.087241 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVFwgi8_GDbhksi35GsRy2Yt8vG76mKk3gAWSyQkwoXrIgHg8N5ez_jrewwz49KUUCHQl9HMjUIRdvJgvSbwKJeWy1dGikr0ZE-SQ1YHB6mPpoW3WiPNg4GJ1oy_ToPSEg34j2ErHLeyL0fg7AUzlxpjsD8HAhIMB7pgtOaw-1PfbJ-c Oct 22 21:16:09.087241 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 21:16:09.087241 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 21:16:09.087241 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 21:16:09.087241 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 21:16:09.087241 ncdv-master-1 devstack@n-api.service[138745]: X-Openstack-Nova-Api-Version: 2.32 Oct 22 21:16:09.087241 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 21:16:09.087241 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 21:16:09.087241 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: 09185bfad7944b199a490305c22ffc3d Oct 22 21:16:09.087241 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-TaggedBootDevicesTest-288730008 Oct 22 21:16:09.087241 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 21:16:09.087241 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 21:16:09.087241 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_09185bfad7944b199a490305c22ffc3d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/09185bfad7944b199a490305c22ffc3d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/09185bfad7944b199a490305c22ffc3d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/09185bfad7944b199a490305c22ffc3d"}]}] Oct 22 21:16:09.087241 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-TaggedBootDevicesTest-288730008 Oct 22 21:16:09.087241 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: 09185bfad7944b199a490305c22ffc3d Oct 22 21:16:09.087241 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-TaggedBootDevicesTest-288730008 Oct 22 21:16:09.087241 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-TaggedBootDevicesTest-288730008-project Oct 22 21:16:09.087241 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 21:16:09.087241 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 21:16:09.087241 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: d69c1f0203b047eeb6a9fa0a215a63c2 Oct 22 21:16:09.087241 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-TaggedBootDevicesTest-288730008-project Oct 22 21:16:09.087241 ncdv-master-1 devstack@n-api.service[138745]: method: > Oct 22 21:16:09.087241 ncdv-master-1 devstack@n-api.service[138745]: exception: Instance 4d285bc1-33a9-47e0-a148-756be61c0488 could not be found. Oct 22 21:16:09.087241 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'id': '4d285bc1-33a9-47e0-a148-756be61c0488'} Oct 22 21:16:09.087241 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:16:09.087241 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:16:09.087241 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 21:16:09.087241 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 21:16:09.087241 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 21:16:09.087241 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 21:16:09.087241 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 21:16:09.087241 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 21:16:09.087241 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 21:16:09.087241 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 21:16:09.087241 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d285bc1-33a9-47e0-a148-756be61c0488 could not be found. Oct 22 21:16:09.087241 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:16:09.087241 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:16:09.087241 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:16:09.087241 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:16:09.087241 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:16:09.087241 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:16:09.087241 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:16:09.087241 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:16:09.087241 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:16:09.087241 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:16:09.087241 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 21:16:09.087241 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 21:16:09.087241 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 21:16:09.087241 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 21:16:09.087241 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 21:16:09.087241 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:16:09.087241 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d285bc1-33a9-47e0-a148-756be61c0488 could not be found. Oct 22 21:16:09.087241 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:16:09.087241 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:16:09.087241 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:16:09.091576 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:16:09.091576 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:16:09.091576 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:16:09.091576 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:16:09.091576 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:16:09.091576 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d285bc1-33a9-47e0-a148-756be61c0488 could not be found. Oct 22 21:16:09.091576 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:16:09.092887 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-ffeefd86-958c-42b6-ac6c-a4a79def6cf8 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] Returning 404 to user: Instance 4d285bc1-33a9-47e0-a148-756be61c0488 could not be found. {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:16:09.093958 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-ffeefd86-958c-42b6-ac6c-a4a79def6cf8 tempest-TaggedBootDevicesTest-288730008 tempest-TaggedBootDevicesTest-288730008-project] 10.222.0.18 "GET /compute/v2.1/servers/4d285bc1-33a9-47e0-a148-756be61c0488" status: 404 len: 111 microversion: 2.32 time: 0.051100 Oct 22 21:16:09.095749 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-25aeea83-e201-4c00-96af-149d8edc2993 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] HTTP exception thrown: Instance 803a198e-9b90-4fb4-85fa-e1131abf9517 could not be found. Oct 22 21:16:09.098475 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-25aeea83-e201-4c00-96af-149d8edc2993 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Request method failure captured: Oct 22 21:16:09.098475 ncdv-master-1 devstack@n-api.service[138744]: request: GET /compute/v2.1/servers/803a198e-9b90-4fb4-85fa-e1131abf9517 HTTP/1.1 Oct 22 21:16:09.098475 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 21:16:09.098475 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 21:16:09.098475 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 21:16:09.098475 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 0 Oct 22 21:16:09.098475 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 21:16:09.098475 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 21:16:09.098475 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 21:16:09.098475 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 21:16:09.098475 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVFzbjFuxlabhGO5W5IN5r54yzIxFa_mX4J74OzfXM08pyPGfws2Ww4pm5qGKXFC4h2Ttyt1JiFfrSI-ucQt7MPAhDqF8_tQs5Z1aGjJkE87trFhYgYaJFSihYuRhX8jAUHeeDuqMpE3BFEYcIHoIoAbD2BZHLThVUs-wQCfowY_4sFQ Oct 22 21:16:09.098475 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 21:16:09.098475 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 21:16:09.098475 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 21:16:09.098475 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 21:16:09.098475 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 21:16:09.098475 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 21:16:09.098475 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: e87474d4b4c547abbfe6308b6dd8e1c8 Oct 22 21:16:09.098475 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-ServersTestJSON-2007137082 Oct 22 21:16:09.098475 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 21:16:09.098475 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 21:16:09.098475 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_e87474d4b4c547abbfe6308b6dd8e1c8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e87474d4b4c547abbfe6308b6dd8e1c8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/e87474d4b4c547abbfe6308b6dd8e1c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e87474d4b4c547abbfe6308b6dd8e1c8"}]}] Oct 22 21:16:09.098475 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-ServersTestJSON-2007137082 Oct 22 21:16:09.098475 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: e87474d4b4c547abbfe6308b6dd8e1c8 Oct 22 21:16:09.098475 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-ServersTestJSON-2007137082 Oct 22 21:16:09.098475 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-ServersTestJSON-2007137082-project Oct 22 21:16:09.098475 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 21:16:09.098475 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 21:16:09.098475 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: 799f987b3aa7426ba5d7a464052d6490 Oct 22 21:16:09.098475 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-ServersTestJSON-2007137082-project Oct 22 21:16:09.098475 ncdv-master-1 devstack@n-api.service[138744]: method: > Oct 22 21:16:09.098475 ncdv-master-1 devstack@n-api.service[138744]: exception: Instance 803a198e-9b90-4fb4-85fa-e1131abf9517 could not be found. Oct 22 21:16:09.098475 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': '803a198e-9b90-4fb4-85fa-e1131abf9517'} Oct 22 21:16:09.098475 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:16:09.098475 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:16:09.098475 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 21:16:09.098475 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 21:16:09.098475 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 21:16:09.098475 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 21:16:09.098475 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 21:16:09.098475 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 21:16:09.098475 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 21:16:09.098475 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 21:16:09.098475 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 803a198e-9b90-4fb4-85fa-e1131abf9517 could not be found. Oct 22 21:16:09.098475 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:16:09.098475 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:16:09.098475 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:16:09.098475 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:16:09.098475 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:16:09.098475 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:16:09.098475 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:16:09.098475 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:16:09.098475 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:16:09.098475 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:16:09.098475 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 21:16:09.098475 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 21:16:09.098475 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 21:16:09.098475 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 21:16:09.098475 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 21:16:09.098475 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:16:09.098475 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 803a198e-9b90-4fb4-85fa-e1131abf9517 could not be found. Oct 22 21:16:09.098475 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:16:09.098475 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:16:09.098475 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:16:09.104582 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:16:09.104582 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:16:09.104582 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:16:09.104582 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:16:09.104582 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:16:09.104582 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 803a198e-9b90-4fb4-85fa-e1131abf9517 could not be found. Oct 22 21:16:09.104582 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:16:09.109425 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2482/4949] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:16:09 2022] GET /compute/v2.1/servers/4d285bc1-33a9-47e0-a148-756be61c0488 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 22 21:16:09.109650 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-25aeea83-e201-4c00-96af-149d8edc2993 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Returning 404 to user: Instance 803a198e-9b90-4fb4-85fa-e1131abf9517 could not be found. {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:16:09.109650 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-25aeea83-e201-4c00-96af-149d8edc2993 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] 10.222.0.18 "GET /compute/v2.1/servers/803a198e-9b90-4fb4-85fa-e1131abf9517" status: 404 len: 111 microversion: 2.1 time: 0.068784 Oct 22 21:16:09.109650 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2468/4950] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:16:09 2022] GET /compute/v2.1/servers/803a198e-9b90-4fb4-85fa-e1131abf9517 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 21:16:09.116134 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-840b27b1-0ab3-44ad-9242-b50ea3b8258f tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:16:09.116669 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-840b27b1-0ab3-44ad-9242-b50ea3b8258f tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] [instance: 5ec23653-3f53-406b-a0e3-1d3b3c683fb7] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:16:09.125854 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-840b27b1-0ab3-44ad-9242-b50ea3b8258f tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:16:09.126376 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-840b27b1-0ab3-44ad-9242-b50ea3b8258f tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:16:09.126853 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-840b27b1-0ab3-44ad-9242-b50ea3b8258f tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:16:09.127826 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-840b27b1-0ab3-44ad-9242-b50ea3b8258f tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:16:09.128500 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-840b27b1-0ab3-44ad-9242-b50ea3b8258f tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:16:09.129109 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-840b27b1-0ab3-44ad-9242-b50ea3b8258f tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:16:09.182713 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.wsgi [None req-840b27b1-0ab3-44ad-9242-b50ea3b8258f tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] HTTP exception thrown: Instance 5ec23653-3f53-406b-a0e3-1d3b3c683fb7 could not be found. Oct 22 21:16:09.192752 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-840b27b1-0ab3-44ad-9242-b50ea3b8258f tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Request method failure captured: Oct 22 21:16:09.192752 ncdv-master-1 devstack@n-api.service[138745]: request: DELETE /compute/v2.1/servers/5ec23653-3f53-406b-a0e3-1d3b3c683fb7 HTTP/1.1 Oct 22 21:16:09.192752 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 21:16:09.192752 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 21:16:09.192752 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 21:16:09.192752 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 0 Oct 22 21:16:09.192752 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 21:16:09.192752 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 21:16:09.192752 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 21:16:09.192752 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 21:16:09.192752 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVFzbjFuxlabhGO5W5IN5r54yzIxFa_mX4J74OzfXM08pyPGfws2Ww4pm5qGKXFC4h2Ttyt1JiFfrSI-ucQt7MPAhDqF8_tQs5Z1aGjJkE87trFhYgYaJFSihYuRhX8jAUHeeDuqMpE3BFEYcIHoIoAbD2BZHLThVUs-wQCfowY_4sFQ Oct 22 21:16:09.192752 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 21:16:09.192752 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 21:16:09.192752 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 21:16:09.192752 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 21:16:09.192752 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 21:16:09.192752 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 21:16:09.192752 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: e87474d4b4c547abbfe6308b6dd8e1c8 Oct 22 21:16:09.192752 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-ServersTestJSON-2007137082 Oct 22 21:16:09.192752 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 21:16:09.192752 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 21:16:09.192752 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_e87474d4b4c547abbfe6308b6dd8e1c8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e87474d4b4c547abbfe6308b6dd8e1c8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/e87474d4b4c547abbfe6308b6dd8e1c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e87474d4b4c547abbfe6308b6dd8e1c8"}]}] Oct 22 21:16:09.192752 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-ServersTestJSON-2007137082 Oct 22 21:16:09.192752 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: e87474d4b4c547abbfe6308b6dd8e1c8 Oct 22 21:16:09.192752 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-ServersTestJSON-2007137082 Oct 22 21:16:09.192752 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-ServersTestJSON-2007137082-project Oct 22 21:16:09.192752 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 21:16:09.192752 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 21:16:09.192752 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: 799f987b3aa7426ba5d7a464052d6490 Oct 22 21:16:09.192752 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-ServersTestJSON-2007137082-project Oct 22 21:16:09.192752 ncdv-master-1 devstack@n-api.service[138745]: method: > Oct 22 21:16:09.192752 ncdv-master-1 devstack@n-api.service[138745]: exception: Instance 5ec23653-3f53-406b-a0e3-1d3b3c683fb7 could not be found. Oct 22 21:16:09.192752 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'id': '5ec23653-3f53-406b-a0e3-1d3b3c683fb7'} Oct 22 21:16:09.192752 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:16:09.192752 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:16:09.192752 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 21:16:09.192752 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 21:16:09.192752 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 21:16:09.192752 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 21:16:09.192752 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 21:16:09.192752 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 21:16:09.192752 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 21:16:09.192752 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 21:16:09.192752 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ec23653-3f53-406b-a0e3-1d3b3c683fb7 could not be found. Oct 22 21:16:09.192752 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:16:09.192752 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:16:09.192752 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:16:09.192752 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:16:09.192752 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:16:09.192752 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:16:09.192752 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:16:09.192752 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:16:09.192752 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:16:09.192752 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:16:09.192752 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 22 21:16:09.192752 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 22 21:16:09.192752 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 22 21:16:09.192752 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 22 21:16:09.192752 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 21:16:09.192752 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 21:16:09.192752 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 21:16:09.192752 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:16:09.192752 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ec23653-3f53-406b-a0e3-1d3b3c683fb7 could not be found. Oct 22 21:16:09.196743 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:16:09.196743 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:16:09.196743 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:16:09.196743 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:16:09.196743 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:16:09.196743 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:16:09.196743 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:16:09.196743 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:16:09.196743 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ec23653-3f53-406b-a0e3-1d3b3c683fb7 could not be found. Oct 22 21:16:09.196743 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:16:09.196743 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-840b27b1-0ab3-44ad-9242-b50ea3b8258f tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Returning 404 to user: Instance 5ec23653-3f53-406b-a0e3-1d3b3c683fb7 could not be found. {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:16:09.196743 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-840b27b1-0ab3-44ad-9242-b50ea3b8258f tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] 10.222.0.18 "DELETE /compute/v2.1/servers/5ec23653-3f53-406b-a0e3-1d3b3c683fb7" status: 404 len: 111 microversion: 2.1 time: 0.084341 Oct 22 21:16:09.198575 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2483/4951] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 21:16:09 2022] DELETE /compute/v2.1/servers/5ec23653-3f53-406b-a0e3-1d3b3c683fb7 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 21:16:09.203977 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-bb3b89eb-379d-4e1a-a3c1-a314c0b1f686 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:16:09.204841 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-bb3b89eb-379d-4e1a-a3c1-a314c0b1f686 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] [instance: 5ec23653-3f53-406b-a0e3-1d3b3c683fb7] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:16:09.212658 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bb3b89eb-379d-4e1a-a3c1-a314c0b1f686 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:16:09.213256 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bb3b89eb-379d-4e1a-a3c1-a314c0b1f686 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:16:09.214674 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bb3b89eb-379d-4e1a-a3c1-a314c0b1f686 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:16:09.215705 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bb3b89eb-379d-4e1a-a3c1-a314c0b1f686 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:16:09.216385 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bb3b89eb-379d-4e1a-a3c1-a314c0b1f686 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:16:09.217056 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bb3b89eb-379d-4e1a-a3c1-a314c0b1f686 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:16:09.248073 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-bb3b89eb-379d-4e1a-a3c1-a314c0b1f686 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] HTTP exception thrown: Instance 5ec23653-3f53-406b-a0e3-1d3b3c683fb7 could not be found. Oct 22 21:16:09.250781 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-bb3b89eb-379d-4e1a-a3c1-a314c0b1f686 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Request method failure captured: Oct 22 21:16:09.250781 ncdv-master-1 devstack@n-api.service[138744]: request: GET /compute/v2.1/servers/5ec23653-3f53-406b-a0e3-1d3b3c683fb7 HTTP/1.1 Oct 22 21:16:09.250781 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 21:16:09.250781 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 21:16:09.250781 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 21:16:09.250781 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 0 Oct 22 21:16:09.250781 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 21:16:09.250781 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 21:16:09.250781 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 21:16:09.250781 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 21:16:09.250781 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVFzbjFuxlabhGO5W5IN5r54yzIxFa_mX4J74OzfXM08pyPGfws2Ww4pm5qGKXFC4h2Ttyt1JiFfrSI-ucQt7MPAhDqF8_tQs5Z1aGjJkE87trFhYgYaJFSihYuRhX8jAUHeeDuqMpE3BFEYcIHoIoAbD2BZHLThVUs-wQCfowY_4sFQ Oct 22 21:16:09.250781 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 21:16:09.250781 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 21:16:09.250781 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 21:16:09.250781 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 21:16:09.250781 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 21:16:09.250781 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 21:16:09.250781 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: e87474d4b4c547abbfe6308b6dd8e1c8 Oct 22 21:16:09.250781 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-ServersTestJSON-2007137082 Oct 22 21:16:09.250781 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 21:16:09.250781 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 21:16:09.250781 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_e87474d4b4c547abbfe6308b6dd8e1c8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e87474d4b4c547abbfe6308b6dd8e1c8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/e87474d4b4c547abbfe6308b6dd8e1c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e87474d4b4c547abbfe6308b6dd8e1c8"}]}] Oct 22 21:16:09.250781 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-ServersTestJSON-2007137082 Oct 22 21:16:09.250781 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: e87474d4b4c547abbfe6308b6dd8e1c8 Oct 22 21:16:09.250781 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-ServersTestJSON-2007137082 Oct 22 21:16:09.250781 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-ServersTestJSON-2007137082-project Oct 22 21:16:09.250781 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 21:16:09.250781 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 21:16:09.250781 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: 799f987b3aa7426ba5d7a464052d6490 Oct 22 21:16:09.250781 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-ServersTestJSON-2007137082-project Oct 22 21:16:09.250781 ncdv-master-1 devstack@n-api.service[138744]: method: > Oct 22 21:16:09.250781 ncdv-master-1 devstack@n-api.service[138744]: exception: Instance 5ec23653-3f53-406b-a0e3-1d3b3c683fb7 could not be found. Oct 22 21:16:09.250781 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': '5ec23653-3f53-406b-a0e3-1d3b3c683fb7'} Oct 22 21:16:09.250781 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:16:09.250781 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:16:09.250781 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 21:16:09.250781 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 21:16:09.250781 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 21:16:09.250781 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 21:16:09.250781 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 21:16:09.250781 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 21:16:09.250781 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 21:16:09.250781 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 21:16:09.250781 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ec23653-3f53-406b-a0e3-1d3b3c683fb7 could not be found. Oct 22 21:16:09.250781 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:16:09.250781 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:16:09.250781 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:16:09.250781 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:16:09.250781 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:16:09.250781 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:16:09.250781 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:16:09.250781 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:16:09.250781 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:16:09.250781 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:16:09.250781 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 21:16:09.250781 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 21:16:09.250781 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 21:16:09.250781 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 21:16:09.250781 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 21:16:09.250781 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:16:09.250781 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ec23653-3f53-406b-a0e3-1d3b3c683fb7 could not be found. Oct 22 21:16:09.250781 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:16:09.250781 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:16:09.250781 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:16:09.254264 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:16:09.254264 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:16:09.254264 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:16:09.254264 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:16:09.254264 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:16:09.254264 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ec23653-3f53-406b-a0e3-1d3b3c683fb7 could not be found. Oct 22 21:16:09.254264 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:16:09.257684 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-bb3b89eb-379d-4e1a-a3c1-a314c0b1f686 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Returning 404 to user: Instance 5ec23653-3f53-406b-a0e3-1d3b3c683fb7 could not be found. {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:16:09.258858 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-bb3b89eb-379d-4e1a-a3c1-a314c0b1f686 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] 10.222.0.18 "GET /compute/v2.1/servers/5ec23653-3f53-406b-a0e3-1d3b3c683fb7" status: 404 len: 111 microversion: 2.1 time: 0.059634 Oct 22 21:16:09.259932 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2469/4952] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:16:09 2022] GET /compute/v2.1/servers/5ec23653-3f53-406b-a0e3-1d3b3c683fb7 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 22 21:16:09.278869 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-836a7a58-5647-428d-b717-edfdc8fe5883 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:16:09.279746 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-836a7a58-5647-428d-b717-edfdc8fe5883 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] [instance: 6404fc61-0c84-4fab-9557-cefbd8e6da63] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:16:09.289961 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-836a7a58-5647-428d-b717-edfdc8fe5883 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:16:09.290744 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-836a7a58-5647-428d-b717-edfdc8fe5883 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:16:09.291559 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-836a7a58-5647-428d-b717-edfdc8fe5883 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:16:09.292435 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-836a7a58-5647-428d-b717-edfdc8fe5883 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:16:09.293352 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-836a7a58-5647-428d-b717-edfdc8fe5883 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:16:09.293942 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-836a7a58-5647-428d-b717-edfdc8fe5883 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:16:09.315729 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.wsgi [None req-836a7a58-5647-428d-b717-edfdc8fe5883 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] HTTP exception thrown: Instance 6404fc61-0c84-4fab-9557-cefbd8e6da63 could not be found. Oct 22 21:16:09.317709 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-836a7a58-5647-428d-b717-edfdc8fe5883 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Request method failure captured: Oct 22 21:16:09.317709 ncdv-master-1 devstack@n-api.service[138745]: request: DELETE /compute/v2.1/servers/6404fc61-0c84-4fab-9557-cefbd8e6da63 HTTP/1.1 Oct 22 21:16:09.317709 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 21:16:09.317709 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 21:16:09.317709 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 21:16:09.317709 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 0 Oct 22 21:16:09.317709 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 21:16:09.317709 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 21:16:09.317709 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 21:16:09.317709 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 21:16:09.317709 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVFzbjFuxlabhGO5W5IN5r54yzIxFa_mX4J74OzfXM08pyPGfws2Ww4pm5qGKXFC4h2Ttyt1JiFfrSI-ucQt7MPAhDqF8_tQs5Z1aGjJkE87trFhYgYaJFSihYuRhX8jAUHeeDuqMpE3BFEYcIHoIoAbD2BZHLThVUs-wQCfowY_4sFQ Oct 22 21:16:09.317709 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 21:16:09.317709 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 21:16:09.317709 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 21:16:09.317709 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 21:16:09.317709 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 21:16:09.317709 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 21:16:09.317709 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: e87474d4b4c547abbfe6308b6dd8e1c8 Oct 22 21:16:09.317709 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-ServersTestJSON-2007137082 Oct 22 21:16:09.317709 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 21:16:09.317709 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 21:16:09.317709 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_e87474d4b4c547abbfe6308b6dd8e1c8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e87474d4b4c547abbfe6308b6dd8e1c8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/e87474d4b4c547abbfe6308b6dd8e1c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e87474d4b4c547abbfe6308b6dd8e1c8"}]}] Oct 22 21:16:09.317709 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-ServersTestJSON-2007137082 Oct 22 21:16:09.317709 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: e87474d4b4c547abbfe6308b6dd8e1c8 Oct 22 21:16:09.317709 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-ServersTestJSON-2007137082 Oct 22 21:16:09.317709 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-ServersTestJSON-2007137082-project Oct 22 21:16:09.317709 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 21:16:09.317709 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 21:16:09.317709 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: 799f987b3aa7426ba5d7a464052d6490 Oct 22 21:16:09.317709 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-ServersTestJSON-2007137082-project Oct 22 21:16:09.317709 ncdv-master-1 devstack@n-api.service[138745]: method: > Oct 22 21:16:09.317709 ncdv-master-1 devstack@n-api.service[138745]: exception: Instance 6404fc61-0c84-4fab-9557-cefbd8e6da63 could not be found. Oct 22 21:16:09.317709 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'id': '6404fc61-0c84-4fab-9557-cefbd8e6da63'} Oct 22 21:16:09.317709 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:16:09.317709 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:16:09.317709 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 21:16:09.317709 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 21:16:09.317709 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 21:16:09.317709 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 21:16:09.317709 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 21:16:09.317709 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 21:16:09.317709 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 21:16:09.317709 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 21:16:09.317709 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6404fc61-0c84-4fab-9557-cefbd8e6da63 could not be found. Oct 22 21:16:09.317709 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:16:09.317709 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:16:09.317709 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:16:09.317709 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:16:09.317709 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:16:09.317709 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:16:09.317709 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:16:09.317709 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:16:09.317709 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:16:09.317709 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:16:09.317709 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 22 21:16:09.317709 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 22 21:16:09.317709 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 22 21:16:09.317709 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 22 21:16:09.317709 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 21:16:09.317709 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 21:16:09.317709 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 21:16:09.317709 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:16:09.317709 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6404fc61-0c84-4fab-9557-cefbd8e6da63 could not be found. Oct 22 21:16:09.325539 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:16:09.325539 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:16:09.325539 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:16:09.325539 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:16:09.325539 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:16:09.325539 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:16:09.325539 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:16:09.325539 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:16:09.325539 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6404fc61-0c84-4fab-9557-cefbd8e6da63 could not be found. Oct 22 21:16:09.325539 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:16:09.325539 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-836a7a58-5647-428d-b717-edfdc8fe5883 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Returning 404 to user: Instance 6404fc61-0c84-4fab-9557-cefbd8e6da63 could not be found. {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:16:09.325539 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-836a7a58-5647-428d-b717-edfdc8fe5883 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] 10.222.0.18 "DELETE /compute/v2.1/servers/6404fc61-0c84-4fab-9557-cefbd8e6da63" status: 404 len: 111 microversion: 2.1 time: 0.054985 Oct 22 21:16:09.325539 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2484/4953] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 21:16:09 2022] DELETE /compute/v2.1/servers/6404fc61-0c84-4fab-9557-cefbd8e6da63 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 22 21:16:09.328534 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-4ee5a634-ed24-4c28-9510-4a8380959cd6 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:16:09.329184 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-4ee5a634-ed24-4c28-9510-4a8380959cd6 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] [instance: 6404fc61-0c84-4fab-9557-cefbd8e6da63] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:16:09.336840 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4ee5a634-ed24-4c28-9510-4a8380959cd6 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:16:09.337379 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4ee5a634-ed24-4c28-9510-4a8380959cd6 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:16:09.338098 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4ee5a634-ed24-4c28-9510-4a8380959cd6 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:16:09.338836 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4ee5a634-ed24-4c28-9510-4a8380959cd6 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:16:09.339325 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4ee5a634-ed24-4c28-9510-4a8380959cd6 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:16:09.339755 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4ee5a634-ed24-4c28-9510-4a8380959cd6 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:16:09.363324 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-4ee5a634-ed24-4c28-9510-4a8380959cd6 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] HTTP exception thrown: Instance 6404fc61-0c84-4fab-9557-cefbd8e6da63 could not be found. Oct 22 21:16:09.365079 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-4ee5a634-ed24-4c28-9510-4a8380959cd6 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Request method failure captured: Oct 22 21:16:09.365079 ncdv-master-1 devstack@n-api.service[138744]: request: GET /compute/v2.1/servers/6404fc61-0c84-4fab-9557-cefbd8e6da63 HTTP/1.1 Oct 22 21:16:09.365079 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 21:16:09.365079 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 21:16:09.365079 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 21:16:09.365079 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 0 Oct 22 21:16:09.365079 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 21:16:09.365079 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 21:16:09.365079 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 21:16:09.365079 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 21:16:09.365079 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVFzbjFuxlabhGO5W5IN5r54yzIxFa_mX4J74OzfXM08pyPGfws2Ww4pm5qGKXFC4h2Ttyt1JiFfrSI-ucQt7MPAhDqF8_tQs5Z1aGjJkE87trFhYgYaJFSihYuRhX8jAUHeeDuqMpE3BFEYcIHoIoAbD2BZHLThVUs-wQCfowY_4sFQ Oct 22 21:16:09.365079 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 21:16:09.365079 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 21:16:09.365079 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 21:16:09.365079 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 21:16:09.365079 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 21:16:09.365079 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 21:16:09.365079 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: e87474d4b4c547abbfe6308b6dd8e1c8 Oct 22 21:16:09.365079 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-ServersTestJSON-2007137082 Oct 22 21:16:09.365079 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 21:16:09.365079 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 21:16:09.365079 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_e87474d4b4c547abbfe6308b6dd8e1c8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e87474d4b4c547abbfe6308b6dd8e1c8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/e87474d4b4c547abbfe6308b6dd8e1c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e87474d4b4c547abbfe6308b6dd8e1c8"}]}] Oct 22 21:16:09.365079 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-ServersTestJSON-2007137082 Oct 22 21:16:09.365079 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: e87474d4b4c547abbfe6308b6dd8e1c8 Oct 22 21:16:09.365079 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-ServersTestJSON-2007137082 Oct 22 21:16:09.365079 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-ServersTestJSON-2007137082-project Oct 22 21:16:09.365079 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 21:16:09.365079 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 21:16:09.365079 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: 799f987b3aa7426ba5d7a464052d6490 Oct 22 21:16:09.365079 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-ServersTestJSON-2007137082-project Oct 22 21:16:09.365079 ncdv-master-1 devstack@n-api.service[138744]: method: > Oct 22 21:16:09.365079 ncdv-master-1 devstack@n-api.service[138744]: exception: Instance 6404fc61-0c84-4fab-9557-cefbd8e6da63 could not be found. Oct 22 21:16:09.365079 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': '6404fc61-0c84-4fab-9557-cefbd8e6da63'} Oct 22 21:16:09.365079 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:16:09.365079 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:16:09.365079 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 21:16:09.365079 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 21:16:09.365079 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 21:16:09.365079 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 21:16:09.365079 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 21:16:09.365079 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 21:16:09.365079 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 21:16:09.365079 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 21:16:09.365079 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6404fc61-0c84-4fab-9557-cefbd8e6da63 could not be found. Oct 22 21:16:09.365079 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:16:09.365079 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:16:09.365079 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:16:09.365079 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:16:09.365079 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:16:09.365079 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:16:09.365079 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:16:09.365079 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:16:09.365079 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:16:09.365079 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:16:09.365079 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 21:16:09.365079 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 21:16:09.365079 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 21:16:09.365079 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 21:16:09.365079 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 21:16:09.365079 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:16:09.365079 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6404fc61-0c84-4fab-9557-cefbd8e6da63 could not be found. Oct 22 21:16:09.365079 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:16:09.365079 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:16:09.365079 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:16:09.369915 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:16:09.369915 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:16:09.369915 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:16:09.369915 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:16:09.369915 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:16:09.369915 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6404fc61-0c84-4fab-9557-cefbd8e6da63 could not be found. Oct 22 21:16:09.369915 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:16:09.369915 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-4ee5a634-ed24-4c28-9510-4a8380959cd6 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Returning 404 to user: Instance 6404fc61-0c84-4fab-9557-cefbd8e6da63 could not be found. {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:16:09.369915 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-4ee5a634-ed24-4c28-9510-4a8380959cd6 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] 10.222.0.18 "GET /compute/v2.1/servers/6404fc61-0c84-4fab-9557-cefbd8e6da63" status: 404 len: 111 microversion: 2.1 time: 0.042362 Oct 22 21:16:09.371311 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2470/4954] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:16:09 2022] GET /compute/v2.1/servers/6404fc61-0c84-4fab-9557-cefbd8e6da63 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 22 21:16:09.377814 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-144b8e8b-3c35-41b1-866c-0ca4d448c3d9 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:16:09.378333 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-144b8e8b-3c35-41b1-866c-0ca4d448c3d9 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] [instance: c05b27d6-ba86-4600-bb33-8d2daeda2094] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:16:09.390100 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-144b8e8b-3c35-41b1-866c-0ca4d448c3d9 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:16:09.390594 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-144b8e8b-3c35-41b1-866c-0ca4d448c3d9 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:16:09.393118 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-144b8e8b-3c35-41b1-866c-0ca4d448c3d9 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:16:09.394131 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-144b8e8b-3c35-41b1-866c-0ca4d448c3d9 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:16:09.394615 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-144b8e8b-3c35-41b1-866c-0ca4d448c3d9 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:16:09.395114 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-144b8e8b-3c35-41b1-866c-0ca4d448c3d9 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:16:09.426083 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.wsgi [None req-144b8e8b-3c35-41b1-866c-0ca4d448c3d9 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] HTTP exception thrown: Instance c05b27d6-ba86-4600-bb33-8d2daeda2094 could not be found. Oct 22 21:16:09.436005 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-144b8e8b-3c35-41b1-866c-0ca4d448c3d9 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Request method failure captured: Oct 22 21:16:09.436005 ncdv-master-1 devstack@n-api.service[138745]: request: DELETE /compute/v2.1/servers/c05b27d6-ba86-4600-bb33-8d2daeda2094 HTTP/1.1 Oct 22 21:16:09.436005 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 21:16:09.436005 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 21:16:09.436005 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 21:16:09.436005 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 0 Oct 22 21:16:09.436005 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 21:16:09.436005 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 21:16:09.436005 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 21:16:09.436005 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 21:16:09.436005 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVFzbjFuxlabhGO5W5IN5r54yzIxFa_mX4J74OzfXM08pyPGfws2Ww4pm5qGKXFC4h2Ttyt1JiFfrSI-ucQt7MPAhDqF8_tQs5Z1aGjJkE87trFhYgYaJFSihYuRhX8jAUHeeDuqMpE3BFEYcIHoIoAbD2BZHLThVUs-wQCfowY_4sFQ Oct 22 21:16:09.436005 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 21:16:09.436005 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 21:16:09.436005 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 21:16:09.436005 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 21:16:09.436005 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 21:16:09.436005 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 21:16:09.436005 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: e87474d4b4c547abbfe6308b6dd8e1c8 Oct 22 21:16:09.436005 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-ServersTestJSON-2007137082 Oct 22 21:16:09.436005 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 21:16:09.436005 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 21:16:09.436005 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_e87474d4b4c547abbfe6308b6dd8e1c8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e87474d4b4c547abbfe6308b6dd8e1c8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/e87474d4b4c547abbfe6308b6dd8e1c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e87474d4b4c547abbfe6308b6dd8e1c8"}]}] Oct 22 21:16:09.436005 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-ServersTestJSON-2007137082 Oct 22 21:16:09.436005 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: e87474d4b4c547abbfe6308b6dd8e1c8 Oct 22 21:16:09.436005 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-ServersTestJSON-2007137082 Oct 22 21:16:09.436005 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-ServersTestJSON-2007137082-project Oct 22 21:16:09.436005 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 21:16:09.436005 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 21:16:09.436005 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: 799f987b3aa7426ba5d7a464052d6490 Oct 22 21:16:09.436005 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-ServersTestJSON-2007137082-project Oct 22 21:16:09.436005 ncdv-master-1 devstack@n-api.service[138745]: method: > Oct 22 21:16:09.436005 ncdv-master-1 devstack@n-api.service[138745]: exception: Instance c05b27d6-ba86-4600-bb33-8d2daeda2094 could not be found. Oct 22 21:16:09.436005 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'id': 'c05b27d6-ba86-4600-bb33-8d2daeda2094'} Oct 22 21:16:09.436005 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:16:09.436005 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:16:09.436005 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 21:16:09.436005 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 21:16:09.436005 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 21:16:09.436005 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 21:16:09.436005 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 21:16:09.436005 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 21:16:09.436005 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 21:16:09.436005 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 21:16:09.436005 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c05b27d6-ba86-4600-bb33-8d2daeda2094 could not be found. Oct 22 21:16:09.436005 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:16:09.436005 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:16:09.436005 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:16:09.436005 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:16:09.436005 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:16:09.436005 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:16:09.436005 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:16:09.436005 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:16:09.436005 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:16:09.436005 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:16:09.436005 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 22 21:16:09.436005 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 22 21:16:09.436005 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 22 21:16:09.436005 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 22 21:16:09.436005 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 21:16:09.436005 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 21:16:09.436005 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 21:16:09.436005 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:16:09.436005 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c05b27d6-ba86-4600-bb33-8d2daeda2094 could not be found. Oct 22 21:16:09.440181 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:16:09.440181 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:16:09.440181 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:16:09.440181 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:16:09.440181 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:16:09.440181 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:16:09.440181 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:16:09.440181 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:16:09.440181 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c05b27d6-ba86-4600-bb33-8d2daeda2094 could not be found. Oct 22 21:16:09.440181 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:16:09.440181 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-144b8e8b-3c35-41b1-866c-0ca4d448c3d9 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Returning 404 to user: Instance c05b27d6-ba86-4600-bb33-8d2daeda2094 could not be found. {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:16:09.440181 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-144b8e8b-3c35-41b1-866c-0ca4d448c3d9 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] 10.222.0.18 "DELETE /compute/v2.1/servers/c05b27d6-ba86-4600-bb33-8d2daeda2094" status: 404 len: 111 microversion: 2.1 time: 0.064808 Oct 22 21:16:09.440181 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2485/4955] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 21:16:09 2022] DELETE /compute/v2.1/servers/c05b27d6-ba86-4600-bb33-8d2daeda2094 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 21:16:09.449094 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-099e3fdb-17b4-4556-b02c-d26b896b95d7 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:16:09.449811 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-099e3fdb-17b4-4556-b02c-d26b896b95d7 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] [instance: c05b27d6-ba86-4600-bb33-8d2daeda2094] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:16:09.459654 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-099e3fdb-17b4-4556-b02c-d26b896b95d7 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:16:09.460393 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-099e3fdb-17b4-4556-b02c-d26b896b95d7 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:16:09.461008 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-099e3fdb-17b4-4556-b02c-d26b896b95d7 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:16:09.463958 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-099e3fdb-17b4-4556-b02c-d26b896b95d7 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:16:09.464704 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-099e3fdb-17b4-4556-b02c-d26b896b95d7 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:16:09.465299 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-099e3fdb-17b4-4556-b02c-d26b896b95d7 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:16:09.501945 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-099e3fdb-17b4-4556-b02c-d26b896b95d7 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] HTTP exception thrown: Instance c05b27d6-ba86-4600-bb33-8d2daeda2094 could not be found. Oct 22 21:16:09.503584 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-099e3fdb-17b4-4556-b02c-d26b896b95d7 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Request method failure captured: Oct 22 21:16:09.503584 ncdv-master-1 devstack@n-api.service[138744]: request: GET /compute/v2.1/servers/c05b27d6-ba86-4600-bb33-8d2daeda2094 HTTP/1.1 Oct 22 21:16:09.503584 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 21:16:09.503584 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 21:16:09.503584 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 21:16:09.503584 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 0 Oct 22 21:16:09.503584 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 21:16:09.503584 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 21:16:09.503584 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 21:16:09.503584 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 21:16:09.503584 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVFzbjFuxlabhGO5W5IN5r54yzIxFa_mX4J74OzfXM08pyPGfws2Ww4pm5qGKXFC4h2Ttyt1JiFfrSI-ucQt7MPAhDqF8_tQs5Z1aGjJkE87trFhYgYaJFSihYuRhX8jAUHeeDuqMpE3BFEYcIHoIoAbD2BZHLThVUs-wQCfowY_4sFQ Oct 22 21:16:09.503584 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 21:16:09.503584 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 21:16:09.503584 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 21:16:09.503584 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 21:16:09.503584 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 21:16:09.503584 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 21:16:09.503584 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: e87474d4b4c547abbfe6308b6dd8e1c8 Oct 22 21:16:09.503584 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-ServersTestJSON-2007137082 Oct 22 21:16:09.503584 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 21:16:09.503584 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 21:16:09.503584 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_e87474d4b4c547abbfe6308b6dd8e1c8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e87474d4b4c547abbfe6308b6dd8e1c8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/e87474d4b4c547abbfe6308b6dd8e1c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e87474d4b4c547abbfe6308b6dd8e1c8"}]}] Oct 22 21:16:09.503584 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-ServersTestJSON-2007137082 Oct 22 21:16:09.503584 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: e87474d4b4c547abbfe6308b6dd8e1c8 Oct 22 21:16:09.503584 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-ServersTestJSON-2007137082 Oct 22 21:16:09.503584 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-ServersTestJSON-2007137082-project Oct 22 21:16:09.503584 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 21:16:09.503584 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 21:16:09.503584 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: 799f987b3aa7426ba5d7a464052d6490 Oct 22 21:16:09.503584 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-ServersTestJSON-2007137082-project Oct 22 21:16:09.503584 ncdv-master-1 devstack@n-api.service[138744]: method: > Oct 22 21:16:09.503584 ncdv-master-1 devstack@n-api.service[138744]: exception: Instance c05b27d6-ba86-4600-bb33-8d2daeda2094 could not be found. Oct 22 21:16:09.503584 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': 'c05b27d6-ba86-4600-bb33-8d2daeda2094'} Oct 22 21:16:09.503584 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:16:09.503584 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:16:09.503584 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 21:16:09.503584 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 21:16:09.503584 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 21:16:09.503584 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 21:16:09.503584 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 21:16:09.503584 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 21:16:09.503584 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 21:16:09.503584 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 21:16:09.503584 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c05b27d6-ba86-4600-bb33-8d2daeda2094 could not be found. Oct 22 21:16:09.503584 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:16:09.503584 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:16:09.503584 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:16:09.503584 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:16:09.503584 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:16:09.503584 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:16:09.503584 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:16:09.503584 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:16:09.503584 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:16:09.503584 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:16:09.503584 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 21:16:09.503584 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 21:16:09.503584 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 21:16:09.503584 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 21:16:09.503584 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 21:16:09.503584 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:16:09.503584 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c05b27d6-ba86-4600-bb33-8d2daeda2094 could not be found. Oct 22 21:16:09.503584 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:16:09.503584 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:16:09.503584 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:16:09.508080 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:16:09.508080 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:16:09.508080 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:16:09.508080 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:16:09.508080 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:16:09.508080 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c05b27d6-ba86-4600-bb33-8d2daeda2094 could not be found. Oct 22 21:16:09.508080 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:16:09.508080 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-099e3fdb-17b4-4556-b02c-d26b896b95d7 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Returning 404 to user: Instance c05b27d6-ba86-4600-bb33-8d2daeda2094 could not be found. {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:16:09.508080 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-099e3fdb-17b4-4556-b02c-d26b896b95d7 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] 10.222.0.18 "GET /compute/v2.1/servers/c05b27d6-ba86-4600-bb33-8d2daeda2094" status: 404 len: 111 microversion: 2.1 time: 0.062843 Oct 22 21:16:09.509294 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2471/4956] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:16:09 2022] GET /compute/v2.1/servers/c05b27d6-ba86-4600-bb33-8d2daeda2094 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 21:16:09.517224 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-aa1983fc-cd48-420b-8802-6c6c6d4fc5eb tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:16:09.517839 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-aa1983fc-cd48-420b-8802-6c6c6d4fc5eb tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] [instance: e8de4ee1-bd84-496c-8376-025eaf5c5094] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:16:09.528661 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-aa1983fc-cd48-420b-8802-6c6c6d4fc5eb tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:16:09.530351 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-aa1983fc-cd48-420b-8802-6c6c6d4fc5eb tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:16:09.531003 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-aa1983fc-cd48-420b-8802-6c6c6d4fc5eb tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:16:09.533111 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-aa1983fc-cd48-420b-8802-6c6c6d4fc5eb tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:16:09.535784 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-aa1983fc-cd48-420b-8802-6c6c6d4fc5eb tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:16:09.536261 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-aa1983fc-cd48-420b-8802-6c6c6d4fc5eb tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:16:09.572414 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.wsgi [None req-aa1983fc-cd48-420b-8802-6c6c6d4fc5eb tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] HTTP exception thrown: Instance e8de4ee1-bd84-496c-8376-025eaf5c5094 could not be found. Oct 22 21:16:09.579238 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-aa1983fc-cd48-420b-8802-6c6c6d4fc5eb tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Request method failure captured: Oct 22 21:16:09.579238 ncdv-master-1 devstack@n-api.service[138745]: request: DELETE /compute/v2.1/servers/e8de4ee1-bd84-496c-8376-025eaf5c5094 HTTP/1.1 Oct 22 21:16:09.579238 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 21:16:09.579238 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 21:16:09.579238 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 21:16:09.579238 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 0 Oct 22 21:16:09.579238 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 21:16:09.579238 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 21:16:09.579238 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 21:16:09.579238 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 21:16:09.579238 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVFzbjFuxlabhGO5W5IN5r54yzIxFa_mX4J74OzfXM08pyPGfws2Ww4pm5qGKXFC4h2Ttyt1JiFfrSI-ucQt7MPAhDqF8_tQs5Z1aGjJkE87trFhYgYaJFSihYuRhX8jAUHeeDuqMpE3BFEYcIHoIoAbD2BZHLThVUs-wQCfowY_4sFQ Oct 22 21:16:09.579238 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 21:16:09.579238 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 21:16:09.579238 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 21:16:09.579238 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 21:16:09.579238 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 21:16:09.579238 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 21:16:09.579238 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: e87474d4b4c547abbfe6308b6dd8e1c8 Oct 22 21:16:09.579238 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-ServersTestJSON-2007137082 Oct 22 21:16:09.579238 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 21:16:09.579238 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 21:16:09.579238 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_e87474d4b4c547abbfe6308b6dd8e1c8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e87474d4b4c547abbfe6308b6dd8e1c8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/e87474d4b4c547abbfe6308b6dd8e1c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e87474d4b4c547abbfe6308b6dd8e1c8"}]}] Oct 22 21:16:09.579238 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-ServersTestJSON-2007137082 Oct 22 21:16:09.579238 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: e87474d4b4c547abbfe6308b6dd8e1c8 Oct 22 21:16:09.579238 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-ServersTestJSON-2007137082 Oct 22 21:16:09.579238 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-ServersTestJSON-2007137082-project Oct 22 21:16:09.579238 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 21:16:09.579238 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 21:16:09.579238 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: 799f987b3aa7426ba5d7a464052d6490 Oct 22 21:16:09.579238 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-ServersTestJSON-2007137082-project Oct 22 21:16:09.579238 ncdv-master-1 devstack@n-api.service[138745]: method: > Oct 22 21:16:09.579238 ncdv-master-1 devstack@n-api.service[138745]: exception: Instance e8de4ee1-bd84-496c-8376-025eaf5c5094 could not be found. Oct 22 21:16:09.579238 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'id': 'e8de4ee1-bd84-496c-8376-025eaf5c5094'} Oct 22 21:16:09.579238 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:16:09.579238 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:16:09.579238 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 21:16:09.579238 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 21:16:09.579238 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 21:16:09.579238 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 21:16:09.579238 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 21:16:09.579238 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 21:16:09.579238 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 21:16:09.579238 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 21:16:09.579238 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e8de4ee1-bd84-496c-8376-025eaf5c5094 could not be found. Oct 22 21:16:09.579238 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:16:09.579238 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:16:09.579238 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:16:09.579238 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:16:09.579238 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:16:09.579238 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:16:09.579238 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:16:09.579238 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:16:09.579238 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:16:09.579238 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:16:09.579238 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 22 21:16:09.579238 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 22 21:16:09.579238 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 22 21:16:09.579238 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 22 21:16:09.579238 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 21:16:09.579238 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 21:16:09.579238 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 21:16:09.579238 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:16:09.579238 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e8de4ee1-bd84-496c-8376-025eaf5c5094 could not be found. Oct 22 21:16:09.583580 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:16:09.583580 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:16:09.583580 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:16:09.583580 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:16:09.583580 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:16:09.583580 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:16:09.583580 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:16:09.583580 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:16:09.583580 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e8de4ee1-bd84-496c-8376-025eaf5c5094 could not be found. Oct 22 21:16:09.583580 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:16:09.588278 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-aa1983fc-cd48-420b-8802-6c6c6d4fc5eb tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Returning 404 to user: Instance e8de4ee1-bd84-496c-8376-025eaf5c5094 could not be found. {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:16:09.589416 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-aa1983fc-cd48-420b-8802-6c6c6d4fc5eb tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] 10.222.0.18 "DELETE /compute/v2.1/servers/e8de4ee1-bd84-496c-8376-025eaf5c5094" status: 404 len: 111 microversion: 2.1 time: 0.077096 Oct 22 21:16:09.591877 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2486/4957] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 21:16:09 2022] DELETE /compute/v2.1/servers/e8de4ee1-bd84-496c-8376-025eaf5c5094 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 21:16:09.601010 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-74228e0c-8093-4d83-bced-5b5275c9086f tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:16:09.601628 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-74228e0c-8093-4d83-bced-5b5275c9086f tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] [instance: e8de4ee1-bd84-496c-8376-025eaf5c5094] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:16:09.608626 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-74228e0c-8093-4d83-bced-5b5275c9086f tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:16:09.609289 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-74228e0c-8093-4d83-bced-5b5275c9086f tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:16:09.609943 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-74228e0c-8093-4d83-bced-5b5275c9086f tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:16:09.610664 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-74228e0c-8093-4d83-bced-5b5275c9086f tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:16:09.611121 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-74228e0c-8093-4d83-bced-5b5275c9086f tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:16:09.611636 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-74228e0c-8093-4d83-bced-5b5275c9086f tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:16:09.636218 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-74228e0c-8093-4d83-bced-5b5275c9086f tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] HTTP exception thrown: Instance e8de4ee1-bd84-496c-8376-025eaf5c5094 could not be found. Oct 22 21:16:09.638058 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-74228e0c-8093-4d83-bced-5b5275c9086f tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Request method failure captured: Oct 22 21:16:09.638058 ncdv-master-1 devstack@n-api.service[138744]: request: GET /compute/v2.1/servers/e8de4ee1-bd84-496c-8376-025eaf5c5094 HTTP/1.1 Oct 22 21:16:09.638058 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 21:16:09.638058 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 21:16:09.638058 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 21:16:09.638058 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 0 Oct 22 21:16:09.638058 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 21:16:09.638058 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 21:16:09.638058 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 21:16:09.638058 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 21:16:09.638058 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVFzbjFuxlabhGO5W5IN5r54yzIxFa_mX4J74OzfXM08pyPGfws2Ww4pm5qGKXFC4h2Ttyt1JiFfrSI-ucQt7MPAhDqF8_tQs5Z1aGjJkE87trFhYgYaJFSihYuRhX8jAUHeeDuqMpE3BFEYcIHoIoAbD2BZHLThVUs-wQCfowY_4sFQ Oct 22 21:16:09.638058 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 21:16:09.638058 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 21:16:09.638058 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 21:16:09.638058 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 21:16:09.638058 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 21:16:09.638058 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 21:16:09.638058 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: e87474d4b4c547abbfe6308b6dd8e1c8 Oct 22 21:16:09.638058 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-ServersTestJSON-2007137082 Oct 22 21:16:09.638058 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 21:16:09.638058 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 21:16:09.638058 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_e87474d4b4c547abbfe6308b6dd8e1c8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e87474d4b4c547abbfe6308b6dd8e1c8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/e87474d4b4c547abbfe6308b6dd8e1c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e87474d4b4c547abbfe6308b6dd8e1c8"}]}] Oct 22 21:16:09.638058 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-ServersTestJSON-2007137082 Oct 22 21:16:09.638058 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: e87474d4b4c547abbfe6308b6dd8e1c8 Oct 22 21:16:09.638058 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-ServersTestJSON-2007137082 Oct 22 21:16:09.638058 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-ServersTestJSON-2007137082-project Oct 22 21:16:09.638058 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 21:16:09.638058 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 21:16:09.638058 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: 799f987b3aa7426ba5d7a464052d6490 Oct 22 21:16:09.638058 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-ServersTestJSON-2007137082-project Oct 22 21:16:09.638058 ncdv-master-1 devstack@n-api.service[138744]: method: > Oct 22 21:16:09.638058 ncdv-master-1 devstack@n-api.service[138744]: exception: Instance e8de4ee1-bd84-496c-8376-025eaf5c5094 could not be found. Oct 22 21:16:09.638058 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': 'e8de4ee1-bd84-496c-8376-025eaf5c5094'} Oct 22 21:16:09.638058 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:16:09.638058 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:16:09.638058 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 21:16:09.638058 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 21:16:09.638058 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 21:16:09.638058 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 21:16:09.638058 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 21:16:09.638058 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 21:16:09.638058 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 21:16:09.638058 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 21:16:09.638058 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e8de4ee1-bd84-496c-8376-025eaf5c5094 could not be found. Oct 22 21:16:09.638058 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:16:09.638058 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:16:09.638058 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:16:09.638058 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:16:09.638058 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:16:09.638058 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:16:09.638058 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:16:09.638058 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:16:09.638058 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:16:09.638058 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:16:09.638058 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 21:16:09.638058 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 21:16:09.638058 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 21:16:09.638058 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 21:16:09.638058 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 21:16:09.638058 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:16:09.638058 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e8de4ee1-bd84-496c-8376-025eaf5c5094 could not be found. Oct 22 21:16:09.638058 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:16:09.638058 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:16:09.638058 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:16:09.642143 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:16:09.642143 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:16:09.642143 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:16:09.642143 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:16:09.642143 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:16:09.642143 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e8de4ee1-bd84-496c-8376-025eaf5c5094 could not be found. Oct 22 21:16:09.642143 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:16:09.643506 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-74228e0c-8093-4d83-bced-5b5275c9086f tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Returning 404 to user: Instance e8de4ee1-bd84-496c-8376-025eaf5c5094 could not be found. {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:16:09.644542 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-74228e0c-8093-4d83-bced-5b5275c9086f tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] 10.222.0.18 "GET /compute/v2.1/servers/e8de4ee1-bd84-496c-8376-025eaf5c5094" status: 404 len: 111 microversion: 2.1 time: 0.048231 Oct 22 21:16:09.645443 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2472/4958] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:16:09 2022] GET /compute/v2.1/servers/e8de4ee1-bd84-496c-8376-025eaf5c5094 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 21:16:09.654320 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-17177920-dd91-4a7f-81de-aaf973729469 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:16:09.654844 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-17177920-dd91-4a7f-81de-aaf973729469 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] [instance: 955c9477-85e2-4d95-ab3b-035dbf7d5a03] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:16:09.676735 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-17177920-dd91-4a7f-81de-aaf973729469 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:16:09.680787 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-17177920-dd91-4a7f-81de-aaf973729469 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:16:09.681330 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-17177920-dd91-4a7f-81de-aaf973729469 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:16:09.682230 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-17177920-dd91-4a7f-81de-aaf973729469 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:16:09.682718 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-17177920-dd91-4a7f-81de-aaf973729469 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:16:09.684946 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-17177920-dd91-4a7f-81de-aaf973729469 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:16:09.714512 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.wsgi [None req-17177920-dd91-4a7f-81de-aaf973729469 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] HTTP exception thrown: Instance 955c9477-85e2-4d95-ab3b-035dbf7d5a03 could not be found. Oct 22 21:16:09.716412 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-17177920-dd91-4a7f-81de-aaf973729469 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Request method failure captured: Oct 22 21:16:09.716412 ncdv-master-1 devstack@n-api.service[138745]: request: DELETE /compute/v2.1/servers/955c9477-85e2-4d95-ab3b-035dbf7d5a03 HTTP/1.1 Oct 22 21:16:09.716412 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 21:16:09.716412 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 21:16:09.716412 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 21:16:09.716412 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 0 Oct 22 21:16:09.716412 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 21:16:09.716412 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 21:16:09.716412 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 21:16:09.716412 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 21:16:09.716412 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVFzbjFuxlabhGO5W5IN5r54yzIxFa_mX4J74OzfXM08pyPGfws2Ww4pm5qGKXFC4h2Ttyt1JiFfrSI-ucQt7MPAhDqF8_tQs5Z1aGjJkE87trFhYgYaJFSihYuRhX8jAUHeeDuqMpE3BFEYcIHoIoAbD2BZHLThVUs-wQCfowY_4sFQ Oct 22 21:16:09.716412 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 21:16:09.716412 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 21:16:09.716412 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 21:16:09.716412 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 21:16:09.716412 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 21:16:09.716412 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 21:16:09.716412 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: e87474d4b4c547abbfe6308b6dd8e1c8 Oct 22 21:16:09.716412 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-ServersTestJSON-2007137082 Oct 22 21:16:09.716412 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 21:16:09.716412 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 21:16:09.716412 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_e87474d4b4c547abbfe6308b6dd8e1c8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e87474d4b4c547abbfe6308b6dd8e1c8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/e87474d4b4c547abbfe6308b6dd8e1c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e87474d4b4c547abbfe6308b6dd8e1c8"}]}] Oct 22 21:16:09.716412 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-ServersTestJSON-2007137082 Oct 22 21:16:09.716412 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: e87474d4b4c547abbfe6308b6dd8e1c8 Oct 22 21:16:09.716412 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-ServersTestJSON-2007137082 Oct 22 21:16:09.716412 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-ServersTestJSON-2007137082-project Oct 22 21:16:09.716412 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 21:16:09.716412 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 21:16:09.716412 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: 799f987b3aa7426ba5d7a464052d6490 Oct 22 21:16:09.716412 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-ServersTestJSON-2007137082-project Oct 22 21:16:09.716412 ncdv-master-1 devstack@n-api.service[138745]: method: > Oct 22 21:16:09.716412 ncdv-master-1 devstack@n-api.service[138745]: exception: Instance 955c9477-85e2-4d95-ab3b-035dbf7d5a03 could not be found. Oct 22 21:16:09.716412 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'id': '955c9477-85e2-4d95-ab3b-035dbf7d5a03'} Oct 22 21:16:09.716412 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:16:09.716412 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:16:09.716412 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 21:16:09.716412 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 21:16:09.716412 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 21:16:09.716412 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 21:16:09.716412 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 21:16:09.716412 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 21:16:09.716412 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 21:16:09.716412 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 21:16:09.716412 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 955c9477-85e2-4d95-ab3b-035dbf7d5a03 could not be found. Oct 22 21:16:09.716412 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:16:09.716412 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:16:09.716412 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:16:09.716412 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:16:09.716412 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:16:09.716412 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:16:09.716412 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:16:09.716412 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:16:09.716412 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:16:09.716412 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:16:09.716412 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 22 21:16:09.716412 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 22 21:16:09.716412 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 22 21:16:09.716412 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 22 21:16:09.716412 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 21:16:09.716412 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 21:16:09.716412 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 21:16:09.716412 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:16:09.716412 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 955c9477-85e2-4d95-ab3b-035dbf7d5a03 could not be found. Oct 22 21:16:09.720042 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:16:09.720042 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:16:09.720042 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:16:09.720042 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:16:09.720042 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:16:09.720042 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:16:09.720042 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:16:09.720042 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:16:09.720042 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 955c9477-85e2-4d95-ab3b-035dbf7d5a03 could not be found. Oct 22 21:16:09.720042 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:16:09.732208 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-17177920-dd91-4a7f-81de-aaf973729469 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Returning 404 to user: Instance 955c9477-85e2-4d95-ab3b-035dbf7d5a03 could not be found. {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:16:09.733293 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-17177920-dd91-4a7f-81de-aaf973729469 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] 10.222.0.18 "DELETE /compute/v2.1/servers/955c9477-85e2-4d95-ab3b-035dbf7d5a03" status: 404 len: 111 microversion: 2.1 time: 0.083045 Oct 22 21:16:09.738972 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2487/4959] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 21:16:09 2022] DELETE /compute/v2.1/servers/955c9477-85e2-4d95-ab3b-035dbf7d5a03 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 21:16:09.744748 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-dc9411f1-89f4-4990-9ed5-4bfebe5d28d2 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:16:09.747973 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-dc9411f1-89f4-4990-9ed5-4bfebe5d28d2 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] [instance: 955c9477-85e2-4d95-ab3b-035dbf7d5a03] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:16:09.763682 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-dc9411f1-89f4-4990-9ed5-4bfebe5d28d2 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:16:09.763682 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-dc9411f1-89f4-4990-9ed5-4bfebe5d28d2 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:16:09.763682 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-dc9411f1-89f4-4990-9ed5-4bfebe5d28d2 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:16:09.764754 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-dc9411f1-89f4-4990-9ed5-4bfebe5d28d2 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:16:09.765359 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-dc9411f1-89f4-4990-9ed5-4bfebe5d28d2 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:16:09.766252 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-dc9411f1-89f4-4990-9ed5-4bfebe5d28d2 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:16:09.825028 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-dc9411f1-89f4-4990-9ed5-4bfebe5d28d2 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] HTTP exception thrown: Instance 955c9477-85e2-4d95-ab3b-035dbf7d5a03 could not be found. Oct 22 21:16:09.827914 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-dc9411f1-89f4-4990-9ed5-4bfebe5d28d2 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Request method failure captured: Oct 22 21:16:09.827914 ncdv-master-1 devstack@n-api.service[138744]: request: GET /compute/v2.1/servers/955c9477-85e2-4d95-ab3b-035dbf7d5a03 HTTP/1.1 Oct 22 21:16:09.827914 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 21:16:09.827914 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 21:16:09.827914 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 21:16:09.827914 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 0 Oct 22 21:16:09.827914 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 21:16:09.827914 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 21:16:09.827914 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 21:16:09.827914 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 21:16:09.827914 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVFzbjFuxlabhGO5W5IN5r54yzIxFa_mX4J74OzfXM08pyPGfws2Ww4pm5qGKXFC4h2Ttyt1JiFfrSI-ucQt7MPAhDqF8_tQs5Z1aGjJkE87trFhYgYaJFSihYuRhX8jAUHeeDuqMpE3BFEYcIHoIoAbD2BZHLThVUs-wQCfowY_4sFQ Oct 22 21:16:09.827914 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 21:16:09.827914 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 21:16:09.827914 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 21:16:09.827914 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 21:16:09.827914 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 21:16:09.827914 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 21:16:09.827914 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: e87474d4b4c547abbfe6308b6dd8e1c8 Oct 22 21:16:09.827914 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-ServersTestJSON-2007137082 Oct 22 21:16:09.827914 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 21:16:09.827914 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 21:16:09.827914 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_e87474d4b4c547abbfe6308b6dd8e1c8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e87474d4b4c547abbfe6308b6dd8e1c8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/e87474d4b4c547abbfe6308b6dd8e1c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e87474d4b4c547abbfe6308b6dd8e1c8"}]}] Oct 22 21:16:09.827914 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-ServersTestJSON-2007137082 Oct 22 21:16:09.827914 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: e87474d4b4c547abbfe6308b6dd8e1c8 Oct 22 21:16:09.827914 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-ServersTestJSON-2007137082 Oct 22 21:16:09.827914 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-ServersTestJSON-2007137082-project Oct 22 21:16:09.827914 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 21:16:09.827914 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 21:16:09.827914 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: 799f987b3aa7426ba5d7a464052d6490 Oct 22 21:16:09.827914 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-ServersTestJSON-2007137082-project Oct 22 21:16:09.827914 ncdv-master-1 devstack@n-api.service[138744]: method: > Oct 22 21:16:09.827914 ncdv-master-1 devstack@n-api.service[138744]: exception: Instance 955c9477-85e2-4d95-ab3b-035dbf7d5a03 could not be found. Oct 22 21:16:09.827914 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': '955c9477-85e2-4d95-ab3b-035dbf7d5a03'} Oct 22 21:16:09.827914 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:16:09.827914 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:16:09.827914 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 21:16:09.827914 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 21:16:09.827914 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 21:16:09.827914 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 21:16:09.827914 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 21:16:09.827914 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 21:16:09.827914 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 21:16:09.827914 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 21:16:09.827914 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 955c9477-85e2-4d95-ab3b-035dbf7d5a03 could not be found. Oct 22 21:16:09.827914 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:16:09.827914 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:16:09.827914 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:16:09.827914 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:16:09.827914 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:16:09.827914 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:16:09.827914 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:16:09.827914 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:16:09.827914 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:16:09.827914 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:16:09.827914 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 21:16:09.827914 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 21:16:09.827914 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 21:16:09.827914 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 21:16:09.827914 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 21:16:09.827914 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:16:09.827914 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 955c9477-85e2-4d95-ab3b-035dbf7d5a03 could not be found. Oct 22 21:16:09.827914 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:16:09.827914 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:16:09.827914 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:16:09.832068 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:16:09.832068 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:16:09.832068 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:16:09.832068 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:16:09.832068 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:16:09.832068 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 955c9477-85e2-4d95-ab3b-035dbf7d5a03 could not be found. Oct 22 21:16:09.832068 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:16:09.832068 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-dc9411f1-89f4-4990-9ed5-4bfebe5d28d2 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Returning 404 to user: Instance 955c9477-85e2-4d95-ab3b-035dbf7d5a03 could not be found. {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:16:09.833483 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-dc9411f1-89f4-4990-9ed5-4bfebe5d28d2 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] 10.222.0.18 "GET /compute/v2.1/servers/955c9477-85e2-4d95-ab3b-035dbf7d5a03" status: 404 len: 111 microversion: 2.1 time: 0.090508 Oct 22 21:16:09.834802 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2473/4960] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:16:09 2022] GET /compute/v2.1/servers/955c9477-85e2-4d95-ab3b-035dbf7d5a03 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 22 21:16:09.844344 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-9975e028-96f6-4c57-8e14-4ea8adb6b5fa tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:16:09.844968 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-9975e028-96f6-4c57-8e14-4ea8adb6b5fa tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] [instance: 05f873ef-847a-4c86-9009-ca367cc7ac67] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:16:09.870888 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9975e028-96f6-4c57-8e14-4ea8adb6b5fa tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:16:09.874135 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9975e028-96f6-4c57-8e14-4ea8adb6b5fa tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:16:09.874828 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9975e028-96f6-4c57-8e14-4ea8adb6b5fa tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:16:09.875633 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9975e028-96f6-4c57-8e14-4ea8adb6b5fa tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:16:09.884257 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9975e028-96f6-4c57-8e14-4ea8adb6b5fa tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:16:09.884900 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9975e028-96f6-4c57-8e14-4ea8adb6b5fa tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:16:09.923272 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.wsgi [None req-9975e028-96f6-4c57-8e14-4ea8adb6b5fa tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] HTTP exception thrown: Instance 05f873ef-847a-4c86-9009-ca367cc7ac67 could not be found. Oct 22 21:16:09.926411 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-9975e028-96f6-4c57-8e14-4ea8adb6b5fa tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Request method failure captured: Oct 22 21:16:09.926411 ncdv-master-1 devstack@n-api.service[138745]: request: DELETE /compute/v2.1/servers/05f873ef-847a-4c86-9009-ca367cc7ac67 HTTP/1.1 Oct 22 21:16:09.926411 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 21:16:09.926411 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 21:16:09.926411 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 21:16:09.926411 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 0 Oct 22 21:16:09.926411 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 21:16:09.926411 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 21:16:09.926411 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 21:16:09.926411 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 21:16:09.926411 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVFzbjFuxlabhGO5W5IN5r54yzIxFa_mX4J74OzfXM08pyPGfws2Ww4pm5qGKXFC4h2Ttyt1JiFfrSI-ucQt7MPAhDqF8_tQs5Z1aGjJkE87trFhYgYaJFSihYuRhX8jAUHeeDuqMpE3BFEYcIHoIoAbD2BZHLThVUs-wQCfowY_4sFQ Oct 22 21:16:09.926411 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 21:16:09.926411 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 21:16:09.926411 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 21:16:09.926411 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 21:16:09.926411 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 21:16:09.926411 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 21:16:09.926411 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: e87474d4b4c547abbfe6308b6dd8e1c8 Oct 22 21:16:09.926411 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-ServersTestJSON-2007137082 Oct 22 21:16:09.926411 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 21:16:09.926411 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 21:16:09.926411 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_e87474d4b4c547abbfe6308b6dd8e1c8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e87474d4b4c547abbfe6308b6dd8e1c8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/e87474d4b4c547abbfe6308b6dd8e1c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e87474d4b4c547abbfe6308b6dd8e1c8"}]}] Oct 22 21:16:09.926411 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-ServersTestJSON-2007137082 Oct 22 21:16:09.926411 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: e87474d4b4c547abbfe6308b6dd8e1c8 Oct 22 21:16:09.926411 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-ServersTestJSON-2007137082 Oct 22 21:16:09.926411 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-ServersTestJSON-2007137082-project Oct 22 21:16:09.926411 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 21:16:09.926411 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 21:16:09.926411 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: 799f987b3aa7426ba5d7a464052d6490 Oct 22 21:16:09.926411 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-ServersTestJSON-2007137082-project Oct 22 21:16:09.926411 ncdv-master-1 devstack@n-api.service[138745]: method: > Oct 22 21:16:09.926411 ncdv-master-1 devstack@n-api.service[138745]: exception: Instance 05f873ef-847a-4c86-9009-ca367cc7ac67 could not be found. Oct 22 21:16:09.926411 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'id': '05f873ef-847a-4c86-9009-ca367cc7ac67'} Oct 22 21:16:09.926411 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:16:09.926411 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:16:09.926411 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 21:16:09.926411 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 21:16:09.926411 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 21:16:09.926411 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 21:16:09.926411 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 21:16:09.926411 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 21:16:09.926411 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 21:16:09.926411 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 21:16:09.926411 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 05f873ef-847a-4c86-9009-ca367cc7ac67 could not be found. Oct 22 21:16:09.926411 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:16:09.926411 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:16:09.926411 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:16:09.926411 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:16:09.926411 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:16:09.926411 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:16:09.926411 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:16:09.926411 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:16:09.926411 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:16:09.926411 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:16:09.926411 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 22 21:16:09.926411 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 22 21:16:09.926411 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 22 21:16:09.926411 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 22 21:16:09.926411 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 21:16:09.926411 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 21:16:09.926411 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 21:16:09.926411 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:16:09.926411 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 05f873ef-847a-4c86-9009-ca367cc7ac67 could not be found. Oct 22 21:16:09.931311 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:16:09.931311 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:16:09.931311 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:16:09.931311 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:16:09.931311 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:16:09.931311 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:16:09.931311 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:16:09.931311 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:16:09.931311 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 05f873ef-847a-4c86-9009-ca367cc7ac67 could not be found. Oct 22 21:16:09.931311 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:16:09.934255 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-9975e028-96f6-4c57-8e14-4ea8adb6b5fa tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Returning 404 to user: Instance 05f873ef-847a-4c86-9009-ca367cc7ac67 could not be found. {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:16:09.935401 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-9975e028-96f6-4c57-8e14-4ea8adb6b5fa tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] 10.222.0.18 "DELETE /compute/v2.1/servers/05f873ef-847a-4c86-9009-ca367cc7ac67" status: 404 len: 111 microversion: 2.1 time: 0.096712 Oct 22 21:16:09.937326 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2488/4961] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 21:16:09 2022] DELETE /compute/v2.1/servers/05f873ef-847a-4c86-9009-ca367cc7ac67 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 21:16:09.946961 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-e78a3a18-9001-46c6-b399-6081e9d3f40f tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:16:09.947671 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-e78a3a18-9001-46c6-b399-6081e9d3f40f tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] [instance: 05f873ef-847a-4c86-9009-ca367cc7ac67] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:16:09.962934 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e78a3a18-9001-46c6-b399-6081e9d3f40f tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:16:09.966228 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e78a3a18-9001-46c6-b399-6081e9d3f40f tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:16:09.966671 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e78a3a18-9001-46c6-b399-6081e9d3f40f tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:16:09.967492 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e78a3a18-9001-46c6-b399-6081e9d3f40f tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:16:09.971097 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e78a3a18-9001-46c6-b399-6081e9d3f40f tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:16:09.971609 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e78a3a18-9001-46c6-b399-6081e9d3f40f tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:16:10.010170 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-e78a3a18-9001-46c6-b399-6081e9d3f40f tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] HTTP exception thrown: Instance 05f873ef-847a-4c86-9009-ca367cc7ac67 could not be found. Oct 22 21:16:10.015665 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-e78a3a18-9001-46c6-b399-6081e9d3f40f tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Request method failure captured: Oct 22 21:16:10.015665 ncdv-master-1 devstack@n-api.service[138744]: request: GET /compute/v2.1/servers/05f873ef-847a-4c86-9009-ca367cc7ac67 HTTP/1.1 Oct 22 21:16:10.015665 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 21:16:10.015665 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 21:16:10.015665 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 21:16:10.015665 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 0 Oct 22 21:16:10.015665 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 21:16:10.015665 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 21:16:10.015665 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 21:16:10.015665 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 21:16:10.015665 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVFzbjFuxlabhGO5W5IN5r54yzIxFa_mX4J74OzfXM08pyPGfws2Ww4pm5qGKXFC4h2Ttyt1JiFfrSI-ucQt7MPAhDqF8_tQs5Z1aGjJkE87trFhYgYaJFSihYuRhX8jAUHeeDuqMpE3BFEYcIHoIoAbD2BZHLThVUs-wQCfowY_4sFQ Oct 22 21:16:10.015665 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 21:16:10.015665 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 21:16:10.015665 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 21:16:10.015665 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 21:16:10.015665 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 21:16:10.015665 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 21:16:10.015665 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: e87474d4b4c547abbfe6308b6dd8e1c8 Oct 22 21:16:10.015665 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-ServersTestJSON-2007137082 Oct 22 21:16:10.015665 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 21:16:10.015665 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 21:16:10.015665 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_e87474d4b4c547abbfe6308b6dd8e1c8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e87474d4b4c547abbfe6308b6dd8e1c8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/e87474d4b4c547abbfe6308b6dd8e1c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e87474d4b4c547abbfe6308b6dd8e1c8"}]}] Oct 22 21:16:10.015665 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-ServersTestJSON-2007137082 Oct 22 21:16:10.015665 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: e87474d4b4c547abbfe6308b6dd8e1c8 Oct 22 21:16:10.015665 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-ServersTestJSON-2007137082 Oct 22 21:16:10.015665 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-ServersTestJSON-2007137082-project Oct 22 21:16:10.015665 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 21:16:10.015665 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 21:16:10.015665 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: 799f987b3aa7426ba5d7a464052d6490 Oct 22 21:16:10.015665 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-ServersTestJSON-2007137082-project Oct 22 21:16:10.015665 ncdv-master-1 devstack@n-api.service[138744]: method: > Oct 22 21:16:10.015665 ncdv-master-1 devstack@n-api.service[138744]: exception: Instance 05f873ef-847a-4c86-9009-ca367cc7ac67 could not be found. Oct 22 21:16:10.015665 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': '05f873ef-847a-4c86-9009-ca367cc7ac67'} Oct 22 21:16:10.015665 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:16:10.015665 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:16:10.015665 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 21:16:10.015665 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 21:16:10.015665 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 21:16:10.015665 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 21:16:10.015665 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 21:16:10.015665 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 21:16:10.015665 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 21:16:10.015665 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 21:16:10.015665 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 05f873ef-847a-4c86-9009-ca367cc7ac67 could not be found. Oct 22 21:16:10.015665 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:16:10.015665 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:16:10.015665 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:16:10.015665 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:16:10.015665 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:16:10.015665 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:16:10.015665 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:16:10.015665 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:16:10.015665 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:16:10.015665 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:16:10.015665 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 21:16:10.015665 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 21:16:10.015665 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 21:16:10.015665 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 21:16:10.015665 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 21:16:10.015665 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:16:10.015665 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 05f873ef-847a-4c86-9009-ca367cc7ac67 could not be found. Oct 22 21:16:10.015665 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:16:10.015665 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:16:10.015665 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:16:10.020426 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:16:10.020426 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:16:10.020426 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:16:10.020426 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:16:10.020426 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:16:10.020426 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 05f873ef-847a-4c86-9009-ca367cc7ac67 could not be found. Oct 22 21:16:10.020426 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:16:10.021890 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-e78a3a18-9001-46c6-b399-6081e9d3f40f tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Returning 404 to user: Instance 05f873ef-847a-4c86-9009-ca367cc7ac67 could not be found. {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:16:10.024103 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-e78a3a18-9001-46c6-b399-6081e9d3f40f tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] 10.222.0.18 "GET /compute/v2.1/servers/05f873ef-847a-4c86-9009-ca367cc7ac67" status: 404 len: 111 microversion: 2.1 time: 0.082728 Oct 22 21:16:10.027118 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2474/4962] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:16:09 2022] GET /compute/v2.1/servers/05f873ef-847a-4c86-9009-ca367cc7ac67 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 21:16:10.035361 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-4ef7ea5f-5fd5-40b1-aca0-b36525ffd0f6 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:16:10.036573 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-4ef7ea5f-5fd5-40b1-aca0-b36525ffd0f6 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] [instance: ecbbbe88-8a1a-4480-b826-5ba23c6a4404] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:16:10.051224 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4ef7ea5f-5fd5-40b1-aca0-b36525ffd0f6 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:16:10.051901 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4ef7ea5f-5fd5-40b1-aca0-b36525ffd0f6 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:16:10.053254 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4ef7ea5f-5fd5-40b1-aca0-b36525ffd0f6 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:16:10.058879 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4ef7ea5f-5fd5-40b1-aca0-b36525ffd0f6 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:16:10.060123 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4ef7ea5f-5fd5-40b1-aca0-b36525ffd0f6 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:16:10.061010 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4ef7ea5f-5fd5-40b1-aca0-b36525ffd0f6 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:16:10.113942 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-4ef7ea5f-5fd5-40b1-aca0-b36525ffd0f6 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] [instance: ecbbbe88-8a1a-4480-b826-5ba23c6a4404] Going to try to terminate instance {{(pid=138745) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 21:16:10.274678 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-4ef7ea5f-5fd5-40b1-aca0-b36525ffd0f6 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] 10.222.0.18 "DELETE /compute/v2.1/servers/ecbbbe88-8a1a-4480-b826-5ba23c6a4404" status: 204 len: 0 microversion: 2.1 time: 0.243423 Oct 22 21:16:10.276105 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2489/4963] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 21:16:10 2022] DELETE /compute/v2.1/servers/ecbbbe88-8a1a-4480-b826-5ba23c6a4404 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 21:16:10.287112 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-0375a315-0473-485a-aca4-1a30913eea2f tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:16:10.288818 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-0375a315-0473-485a-aca4-1a30913eea2f tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] [instance: ecbbbe88-8a1a-4480-b826-5ba23c6a4404] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:16:10.299863 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0375a315-0473-485a-aca4-1a30913eea2f tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:16:10.302457 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0375a315-0473-485a-aca4-1a30913eea2f tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:16:10.302986 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0375a315-0473-485a-aca4-1a30913eea2f tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:16:10.318466 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0375a315-0473-485a-aca4-1a30913eea2f tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:16:10.321719 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0375a315-0473-485a-aca4-1a30913eea2f tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:16:10.322144 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-eae521a6-0e8b-4fc0-a4ab-47389023d356 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] Calling method '.version_select at 0x7fd3a44f7a60>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:16:10.323670 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0375a315-0473-485a-aca4-1a30913eea2f tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:16:10.385348 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-eae521a6-0e8b-4fc0-a4ab-47389023d356 tempest-TestVolumeBootPattern-1443368191 tempest-TestVolumeBootPattern-1443368191-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-615719538" status: 202 len: 0 microversion: 2.1 time: 0.074220 Oct 22 21:16:10.391548 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2490/4964] 10.222.0.18 () {58 vars in 1260 bytes} [Sat Oct 22 21:16:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-615719538 => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 22 21:16:11.212935 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-0375a315-0473-485a-aca4-1a30913eea2f tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799f987b3aa7426ba5d7a464052d6490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87474d4b4c547abbfe6308b6dd8e1c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:16:11.236430 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-0375a315-0473-485a-aca4-1a30913eea2f tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] 10.222.0.18 "GET /compute/v2.1/servers/ecbbbe88-8a1a-4480-b826-5ba23c6a4404" status: 200 len: 1480 microversion: 2.1 time: 0.955253 Oct 22 21:16:11.249741 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2475/4965] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:16:10 2022] GET /compute/v2.1/servers/ecbbbe88-8a1a-4480-b826-5ba23c6a4404 => generated 1480 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:16:12.260876 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-633cf95d-9799-4cb1-96dd-6b2b3e5f8890 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:16:12.261649 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-633cf95d-9799-4cb1-96dd-6b2b3e5f8890 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] [instance: ecbbbe88-8a1a-4480-b826-5ba23c6a4404] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:16:12.274511 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-633cf95d-9799-4cb1-96dd-6b2b3e5f8890 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:16:12.275402 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-633cf95d-9799-4cb1-96dd-6b2b3e5f8890 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:16:12.276759 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-633cf95d-9799-4cb1-96dd-6b2b3e5f8890 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:16:12.277719 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-633cf95d-9799-4cb1-96dd-6b2b3e5f8890 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:16:12.278390 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-633cf95d-9799-4cb1-96dd-6b2b3e5f8890 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:16:12.279041 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-633cf95d-9799-4cb1-96dd-6b2b3e5f8890 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:16:12.585722 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-633cf95d-9799-4cb1-96dd-6b2b3e5f8890 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799f987b3aa7426ba5d7a464052d6490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87474d4b4c547abbfe6308b6dd8e1c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:16:12.596396 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-633cf95d-9799-4cb1-96dd-6b2b3e5f8890 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] 10.222.0.18 "GET /compute/v2.1/servers/ecbbbe88-8a1a-4480-b826-5ba23c6a4404" status: 200 len: 1480 microversion: 2.1 time: 0.339591 Oct 22 21:16:12.600763 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2491/4966] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:16:12 2022] GET /compute/v2.1/servers/ecbbbe88-8a1a-4480-b826-5ba23c6a4404 => generated 1480 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:16:12.995306 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-03ec4968-9384-4c27-a4e7-e38e88a03b77 req-e83d1ee9-15b1-452f-bbb5-125f0be4f196 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ecbbbe88-8a1a-4480-b826-5ba23c6a4404", "name": "network-vif-deleted", "tag": "f77d3df4-f455-42ee-bc7d-c9161b77a4a2"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:16:13.010633 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-03ec4968-9384-4c27-a4e7-e38e88a03b77 req-e83d1ee9-15b1-452f-bbb5-125f0be4f196 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:16:13.014141 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-03ec4968-9384-4c27-a4e7-e38e88a03b77 req-e83d1ee9-15b1-452f-bbb5-125f0be4f196 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:16:13.016514 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-03ec4968-9384-4c27-a4e7-e38e88a03b77 req-e83d1ee9-15b1-452f-bbb5-125f0be4f196 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:16:13.042544 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-03ec4968-9384-4c27-a4e7-e38e88a03b77 req-e83d1ee9-15b1-452f-bbb5-125f0be4f196 service nova] Creating event network-vif-deleted:f77d3df4-f455-42ee-bc7d-c9161b77a4a2 for instance ecbbbe88-8a1a-4480-b826-5ba23c6a4404 on nch2-master-1 Oct 22 21:16:13.048498 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-03ec4968-9384-4c27-a4e7-e38e88a03b77 req-e83d1ee9-15b1-452f-bbb5-125f0be4f196 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056880 Oct 22 21:16:13.049637 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2476/4967] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:16:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:16:13.623726 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-207ca3d1-6f1a-4e21-b254-d5fdac812cdc tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:16:13.625658 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-207ca3d1-6f1a-4e21-b254-d5fdac812cdc tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] [instance: ecbbbe88-8a1a-4480-b826-5ba23c6a4404] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:16:13.648656 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-207ca3d1-6f1a-4e21-b254-d5fdac812cdc tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:16:13.651037 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-207ca3d1-6f1a-4e21-b254-d5fdac812cdc tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:16:13.654089 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-207ca3d1-6f1a-4e21-b254-d5fdac812cdc tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:16:13.654633 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-207ca3d1-6f1a-4e21-b254-d5fdac812cdc tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:16:13.655120 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-207ca3d1-6f1a-4e21-b254-d5fdac812cdc tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:16:13.655885 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-207ca3d1-6f1a-4e21-b254-d5fdac812cdc tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:16:13.740361 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:16:13.744992 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-207ca3d1-6f1a-4e21-b254-d5fdac812cdc tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:16:13.745558 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-207ca3d1-6f1a-4e21-b254-d5fdac812cdc tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:16:13.746037 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-207ca3d1-6f1a-4e21-b254-d5fdac812cdc tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:16:13.746533 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.objects.instance [None req-207ca3d1-6f1a-4e21-b254-d5fdac812cdc tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lazy-loading 'fault' on Instance uuid ecbbbe88-8a1a-4480-b826-5ba23c6a4404 {{(pid=138745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 21:16:13.855035 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-207ca3d1-6f1a-4e21-b254-d5fdac812cdc tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799f987b3aa7426ba5d7a464052d6490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87474d4b4c547abbfe6308b6dd8e1c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:16:13.871416 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-207ca3d1-6f1a-4e21-b254-d5fdac812cdc tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] 10.222.0.18 "GET /compute/v2.1/servers/ecbbbe88-8a1a-4480-b826-5ba23c6a4404" status: 200 len: 1283 microversion: 2.1 time: 0.251819 Oct 22 21:16:13.873303 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2492/4968] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:16:13 2022] GET /compute/v2.1/servers/ecbbbe88-8a1a-4480-b826-5ba23c6a4404 => generated 1283 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:16:14.900586 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-239b7350-32e6-47ab-94eb-500df459d071 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:16:14.902099 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-239b7350-32e6-47ab-94eb-500df459d071 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] [instance: ecbbbe88-8a1a-4480-b826-5ba23c6a4404] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:16:14.920439 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-239b7350-32e6-47ab-94eb-500df459d071 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:16:14.926831 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-239b7350-32e6-47ab-94eb-500df459d071 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:16:14.930597 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-239b7350-32e6-47ab-94eb-500df459d071 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:16:14.931882 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-239b7350-32e6-47ab-94eb-500df459d071 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:16:14.934802 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-239b7350-32e6-47ab-94eb-500df459d071 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:16:14.935813 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-239b7350-32e6-47ab-94eb-500df459d071 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:16:14.971427 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-239b7350-32e6-47ab-94eb-500df459d071 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] HTTP exception thrown: Instance ecbbbe88-8a1a-4480-b826-5ba23c6a4404 could not be found. Oct 22 21:16:14.973434 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-239b7350-32e6-47ab-94eb-500df459d071 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Request method failure captured: Oct 22 21:16:14.973434 ncdv-master-1 devstack@n-api.service[138744]: request: GET /compute/v2.1/servers/ecbbbe88-8a1a-4480-b826-5ba23c6a4404 HTTP/1.1 Oct 22 21:16:14.973434 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 21:16:14.973434 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 21:16:14.973434 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 21:16:14.973434 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 0 Oct 22 21:16:14.973434 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 21:16:14.973434 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 21:16:14.973434 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 21:16:14.973434 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 21:16:14.973434 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVFzbjFuxlabhGO5W5IN5r54yzIxFa_mX4J74OzfXM08pyPGfws2Ww4pm5qGKXFC4h2Ttyt1JiFfrSI-ucQt7MPAhDqF8_tQs5Z1aGjJkE87trFhYgYaJFSihYuRhX8jAUHeeDuqMpE3BFEYcIHoIoAbD2BZHLThVUs-wQCfowY_4sFQ Oct 22 21:16:14.973434 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 21:16:14.973434 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 21:16:14.973434 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 21:16:14.973434 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 21:16:14.973434 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 21:16:14.973434 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 21:16:14.973434 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: e87474d4b4c547abbfe6308b6dd8e1c8 Oct 22 21:16:14.973434 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-ServersTestJSON-2007137082 Oct 22 21:16:14.973434 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 21:16:14.973434 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 21:16:14.973434 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_e87474d4b4c547abbfe6308b6dd8e1c8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e87474d4b4c547abbfe6308b6dd8e1c8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/e87474d4b4c547abbfe6308b6dd8e1c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e87474d4b4c547abbfe6308b6dd8e1c8"}]}] Oct 22 21:16:14.973434 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-ServersTestJSON-2007137082 Oct 22 21:16:14.973434 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: e87474d4b4c547abbfe6308b6dd8e1c8 Oct 22 21:16:14.973434 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-ServersTestJSON-2007137082 Oct 22 21:16:14.973434 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-ServersTestJSON-2007137082-project Oct 22 21:16:14.973434 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 21:16:14.973434 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 21:16:14.973434 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: 799f987b3aa7426ba5d7a464052d6490 Oct 22 21:16:14.973434 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-ServersTestJSON-2007137082-project Oct 22 21:16:14.973434 ncdv-master-1 devstack@n-api.service[138744]: method: > Oct 22 21:16:14.973434 ncdv-master-1 devstack@n-api.service[138744]: exception: Instance ecbbbe88-8a1a-4480-b826-5ba23c6a4404 could not be found. Oct 22 21:16:14.973434 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': 'ecbbbe88-8a1a-4480-b826-5ba23c6a4404'} Oct 22 21:16:14.973434 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:16:14.973434 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:16:14.973434 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 21:16:14.973434 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 21:16:14.973434 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 21:16:14.973434 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 21:16:14.973434 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 21:16:14.973434 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 21:16:14.973434 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 21:16:14.973434 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 21:16:14.973434 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ecbbbe88-8a1a-4480-b826-5ba23c6a4404 could not be found. Oct 22 21:16:14.973434 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:16:14.973434 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:16:14.973434 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:16:14.973434 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:16:14.973434 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:16:14.973434 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:16:14.973434 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:16:14.973434 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:16:14.973434 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:16:14.973434 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:16:14.973434 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 21:16:14.973434 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 21:16:14.973434 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 21:16:14.973434 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 21:16:14.973434 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 21:16:14.973434 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:16:14.973434 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ecbbbe88-8a1a-4480-b826-5ba23c6a4404 could not be found. Oct 22 21:16:14.973434 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:16:14.973434 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:16:14.973434 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:16:14.978086 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:16:14.978086 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:16:14.978086 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:16:14.978086 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:16:14.978086 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:16:14.978086 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ecbbbe88-8a1a-4480-b826-5ba23c6a4404 could not be found. Oct 22 21:16:14.978086 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:16:14.978086 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-239b7350-32e6-47ab-94eb-500df459d071 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] Returning 404 to user: Instance ecbbbe88-8a1a-4480-b826-5ba23c6a4404 could not be found. {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:16:14.978086 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-239b7350-32e6-47ab-94eb-500df459d071 tempest-ServersTestJSON-2007137082 tempest-ServersTestJSON-2007137082-project] 10.222.0.18 "GET /compute/v2.1/servers/ecbbbe88-8a1a-4480-b826-5ba23c6a4404" status: 404 len: 111 microversion: 2.1 time: 0.082211 Oct 22 21:16:14.982270 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2477/4969] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:16:14 2022] GET /compute/v2.1/servers/ecbbbe88-8a1a-4480-b826-5ba23c6a4404 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 21:16:26.036322 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_api:SELECT=1 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:16:26.037437 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:16:26.237610 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-588ffc2d-a656-4c12-9b24-c3875a9735b2 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV257Test-server-470851422", "imageRef": "085e4478-6edc-4a69-8e08-f9831713eb65", "flavorRef": "452", "networks": "none"}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:16:26.329480 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-588ffc2d-a656-4c12-9b24-c3875a9735b2 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Flavor limits 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 21:16:26.330230 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-588ffc2d-a656-4c12-9b24-c3875a9735b2 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Image limits 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 21:16:26.330724 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-588ffc2d-a656-4c12-9b24-c3875a9735b2 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Flavor pref 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 21:16:26.331157 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-588ffc2d-a656-4c12-9b24-c3875a9735b2 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Image pref 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 21:16:26.331603 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-588ffc2d-a656-4c12-9b24-c3875a9735b2 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 21:16:26.344880 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-588ffc2d-a656-4c12-9b24-c3875a9735b2 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:16:26.345834 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-588ffc2d-a656-4c12-9b24-c3875a9735b2 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:16:26.346710 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-588ffc2d-a656-4c12-9b24-c3875a9735b2 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:16:26.347718 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-588ffc2d-a656-4c12-9b24-c3875a9735b2 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:16:26.348342 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-588ffc2d-a656-4c12-9b24-c3875a9735b2 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:16:26.349106 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-588ffc2d-a656-4c12-9b24-c3875a9735b2 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:16:26.371640 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-588ffc2d-a656-4c12-9b24-c3875a9735b2 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Getting quotas for project 9e9da591f0cc4d60aae0abe808be33a8. Resources: {'cores', 'instances', 'ram'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 21:16:26.377904 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-588ffc2d-a656-4c12-9b24-c3875a9735b2 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Getting quotas for user 38e4ed23a2bb4537b00b90ec116ea084 and project 9e9da591f0cc4d60aae0abe808be33a8. Resources: {'cores', 'instances', 'ram'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 21:16:26.394519 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-588ffc2d-a656-4c12-9b24-c3875a9735b2 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Going to run 1 instances... {{(pid=138745) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 21:16:26.397589 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-588ffc2d-a656-4c12-9b24-c3875a9735b2 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] [instance: 8ad825e9-f825-4c28-997c-5bb6d6cb405f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='085e4478-6edc-4a69-8e08-f9831713eb65',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138745) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 21:16:26.461073 ncdv-master-1 devstack@n-api.service[138745]: ERROR oslo.messaging._drivers.impl_rabbit [None req-588ffc2d-a656-4c12-9b24-c3875a9735b2 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] [56d69d84-d163-4032-a20a-431de1095b7a] AMQP server on 10.222.0.18:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 22 21:16:27.475254 ncdv-master-1 devstack@n-api.service[138745]: INFO oslo.messaging._drivers.impl_rabbit [None req-588ffc2d-a656-4c12-9b24-c3875a9735b2 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] [56d69d84-d163-4032-a20a-431de1095b7a] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 46676. Oct 22 21:16:27.480498 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-588ffc2d-a656-4c12-9b24-c3875a9735b2 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.57 time: 1.449534 Oct 22 21:16:27.481957 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2493/4970] 10.222.0.18 () {62 vars in 1188 bytes} [Sat Oct 22 21:16:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 1452 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 22 21:16:27.493349 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-07918beb-817a-45b1-a2b6-890cb1246023 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:16:27.493971 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-07918beb-817a-45b1-a2b6-890cb1246023 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] [instance: 8ad825e9-f825-4c28-997c-5bb6d6cb405f] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:16:27.497912 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_api:SELECT=75,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:16:27.500405 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:SELECT=52,nova_cell1:INSERT=1 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:16:27.866729 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-07918beb-817a-45b1-a2b6-890cb1246023 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e4ed23a2bb4537b00b90ec116ea084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9da591f0cc4d60aae0abe808be33a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:16:27.884272 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-07918beb-817a-45b1-a2b6-890cb1246023 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38e4ed23a2bb4537b00b90ec116ea084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9da591f0cc4d60aae0abe808be33a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:16:27.885907 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-07918beb-817a-45b1-a2b6-890cb1246023 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38e4ed23a2bb4537b00b90ec116ea084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9da591f0cc4d60aae0abe808be33a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:16:27.887141 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-07918beb-817a-45b1-a2b6-890cb1246023 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] 10.222.0.18 "GET /compute/v2.1/servers/8ad825e9-f825-4c28-997c-5bb6d6cb405f" status: 200 len: 1277 microversion: 2.57 time: 0.397841 Oct 22 21:16:27.888247 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2478/4971] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:16:27 2022] GET /compute/v2.1/servers/8ad825e9-f825-4c28-997c-5bb6d6cb405f => generated 1277 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:16:28.923387 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-d01063a8-e331-4c2b-95bc-2415b881dbfc tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:16:28.924031 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-d01063a8-e331-4c2b-95bc-2415b881dbfc tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] [instance: 8ad825e9-f825-4c28-997c-5bb6d6cb405f] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:16:28.952768 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d01063a8-e331-4c2b-95bc-2415b881dbfc tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:16:28.953288 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d01063a8-e331-4c2b-95bc-2415b881dbfc tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:16:28.953755 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d01063a8-e331-4c2b-95bc-2415b881dbfc tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:16:28.954503 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d01063a8-e331-4c2b-95bc-2415b881dbfc tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:16:28.962373 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d01063a8-e331-4c2b-95bc-2415b881dbfc tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:16:28.962905 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d01063a8-e331-4c2b-95bc-2415b881dbfc tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:16:29.245566 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-d01063a8-e331-4c2b-95bc-2415b881dbfc tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e4ed23a2bb4537b00b90ec116ea084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9da591f0cc4d60aae0abe808be33a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:16:29.275027 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-d01063a8-e331-4c2b-95bc-2415b881dbfc tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38e4ed23a2bb4537b00b90ec116ea084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9da591f0cc4d60aae0abe808be33a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:16:29.284322 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-d01063a8-e331-4c2b-95bc-2415b881dbfc tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38e4ed23a2bb4537b00b90ec116ea084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9da591f0cc4d60aae0abe808be33a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:16:29.292307 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-d01063a8-e331-4c2b-95bc-2415b881dbfc tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] 10.222.0.18 "GET /compute/v2.1/servers/8ad825e9-f825-4c28-997c-5bb6d6cb405f" status: 200 len: 1329 microversion: 2.57 time: 0.372689 Oct 22 21:16:29.294389 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2494/4972] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:16:28 2022] GET /compute/v2.1/servers/8ad825e9-f825-4c28-997c-5bb6d6cb405f => generated 1329 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:16:30.326017 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-7da7bb4a-66b7-4bd4-96d9-f09e116b4688 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:16:30.327134 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-7da7bb4a-66b7-4bd4-96d9-f09e116b4688 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] [instance: 8ad825e9-f825-4c28-997c-5bb6d6cb405f] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:16:30.344874 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7da7bb4a-66b7-4bd4-96d9-f09e116b4688 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:16:30.346557 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7da7bb4a-66b7-4bd4-96d9-f09e116b4688 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:16:30.347313 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7da7bb4a-66b7-4bd4-96d9-f09e116b4688 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:16:30.349234 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7da7bb4a-66b7-4bd4-96d9-f09e116b4688 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:16:30.350746 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7da7bb4a-66b7-4bd4-96d9-f09e116b4688 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:16:30.351602 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7da7bb4a-66b7-4bd4-96d9-f09e116b4688 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:16:30.762454 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-7da7bb4a-66b7-4bd4-96d9-f09e116b4688 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e4ed23a2bb4537b00b90ec116ea084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9da591f0cc4d60aae0abe808be33a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:16:30.776091 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-7da7bb4a-66b7-4bd4-96d9-f09e116b4688 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38e4ed23a2bb4537b00b90ec116ea084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9da591f0cc4d60aae0abe808be33a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:16:30.780723 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-7da7bb4a-66b7-4bd4-96d9-f09e116b4688 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38e4ed23a2bb4537b00b90ec116ea084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9da591f0cc4d60aae0abe808be33a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:16:30.784605 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-7da7bb4a-66b7-4bd4-96d9-f09e116b4688 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] 10.222.0.18 "GET /compute/v2.1/servers/8ad825e9-f825-4c28-997c-5bb6d6cb405f" status: 200 len: 1335 microversion: 2.57 time: 0.463694 Oct 22 21:16:30.787182 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2479/4973] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:16:30 2022] GET /compute/v2.1/servers/8ad825e9-f825-4c28-997c-5bb6d6cb405f => generated 1335 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:16:31.821286 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-5c2e5a83-1c0b-4cd4-a538-7fb9186df4c2 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:16:31.825463 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-5c2e5a83-1c0b-4cd4-a538-7fb9186df4c2 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] [instance: 8ad825e9-f825-4c28-997c-5bb6d6cb405f] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:16:31.843419 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5c2e5a83-1c0b-4cd4-a538-7fb9186df4c2 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:16:31.843935 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5c2e5a83-1c0b-4cd4-a538-7fb9186df4c2 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:16:31.844393 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5c2e5a83-1c0b-4cd4-a538-7fb9186df4c2 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:16:31.845131 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5c2e5a83-1c0b-4cd4-a538-7fb9186df4c2 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:16:31.848990 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5c2e5a83-1c0b-4cd4-a538-7fb9186df4c2 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:16:31.849596 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5c2e5a83-1c0b-4cd4-a538-7fb9186df4c2 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:16:32.070385 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-5c2e5a83-1c0b-4cd4-a538-7fb9186df4c2 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e4ed23a2bb4537b00b90ec116ea084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9da591f0cc4d60aae0abe808be33a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:16:32.083972 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-5c2e5a83-1c0b-4cd4-a538-7fb9186df4c2 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38e4ed23a2bb4537b00b90ec116ea084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9da591f0cc4d60aae0abe808be33a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:16:32.090699 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-5c2e5a83-1c0b-4cd4-a538-7fb9186df4c2 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38e4ed23a2bb4537b00b90ec116ea084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9da591f0cc4d60aae0abe808be33a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:16:32.092305 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-5c2e5a83-1c0b-4cd4-a538-7fb9186df4c2 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] 10.222.0.18 "GET /compute/v2.1/servers/8ad825e9-f825-4c28-997c-5bb6d6cb405f" status: 200 len: 1335 microversion: 2.57 time: 0.278225 Oct 22 21:16:32.094707 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2495/4974] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:16:31 2022] GET /compute/v2.1/servers/8ad825e9-f825-4c28-997c-5bb6d6cb405f => generated 1335 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:16:33.122977 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-f14c8615-aa65-44c0-a3ce-8f6412de788a tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:16:33.123707 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-f14c8615-aa65-44c0-a3ce-8f6412de788a tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] [instance: 8ad825e9-f825-4c28-997c-5bb6d6cb405f] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:16:33.140923 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f14c8615-aa65-44c0-a3ce-8f6412de788a tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:16:33.142154 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f14c8615-aa65-44c0-a3ce-8f6412de788a tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:16:33.143884 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f14c8615-aa65-44c0-a3ce-8f6412de788a tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:16:33.145267 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f14c8615-aa65-44c0-a3ce-8f6412de788a tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:16:33.146731 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f14c8615-aa65-44c0-a3ce-8f6412de788a tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:16:33.147942 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f14c8615-aa65-44c0-a3ce-8f6412de788a tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:16:33.265287 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-f14c8615-aa65-44c0-a3ce-8f6412de788a tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e4ed23a2bb4537b00b90ec116ea084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9da591f0cc4d60aae0abe808be33a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:16:33.287906 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-f14c8615-aa65-44c0-a3ce-8f6412de788a tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38e4ed23a2bb4537b00b90ec116ea084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9da591f0cc4d60aae0abe808be33a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:16:33.292015 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-f14c8615-aa65-44c0-a3ce-8f6412de788a tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38e4ed23a2bb4537b00b90ec116ea084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9da591f0cc4d60aae0abe808be33a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:16:33.296113 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-f14c8615-aa65-44c0-a3ce-8f6412de788a tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] 10.222.0.18 "GET /compute/v2.1/servers/8ad825e9-f825-4c28-997c-5bb6d6cb405f" status: 200 len: 1356 microversion: 2.57 time: 0.178585 Oct 22 21:16:33.297613 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2480/4975] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:16:33 2022] GET /compute/v2.1/servers/8ad825e9-f825-4c28-997c-5bb6d6cb405f => generated 1356 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:16:33.329348 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-a6cb502b-dfc6-479c-97d9-84e712ad92e0 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Action: 'action', calling method: >, body: {"rebuild": {"user_data": "ZWNobyAiaGVsbG8gd29ybGQi", "imageRef": "085e4478-6edc-4a69-8e08-f9831713eb65"}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:16:33.332591 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-a6cb502b-dfc6-479c-97d9-84e712ad92e0 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] [instance: 8ad825e9-f825-4c28-997c-5bb6d6cb405f] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:16:33.352188 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a6cb502b-dfc6-479c-97d9-84e712ad92e0 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:16:33.352708 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a6cb502b-dfc6-479c-97d9-84e712ad92e0 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:16:33.353166 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a6cb502b-dfc6-479c-97d9-84e712ad92e0 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:16:33.353910 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a6cb502b-dfc6-479c-97d9-84e712ad92e0 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:16:33.354382 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a6cb502b-dfc6-479c-97d9-84e712ad92e0 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:16:33.358853 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a6cb502b-dfc6-479c-97d9-84e712ad92e0 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:16:33.476749 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-a6cb502b-dfc6-479c-97d9-84e712ad92e0 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Flavor limits 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 21:16:33.477467 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-a6cb502b-dfc6-479c-97d9-84e712ad92e0 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Image limits 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 21:16:33.478026 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-a6cb502b-dfc6-479c-97d9-84e712ad92e0 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Flavor pref 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 21:16:33.478626 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-a6cb502b-dfc6-479c-97d9-84e712ad92e0 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Image pref 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 21:16:33.479616 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-a6cb502b-dfc6-479c-97d9-84e712ad92e0 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 21:16:33.571276 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-a6cb502b-dfc6-479c-97d9-84e712ad92e0 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] [instance: 8ad825e9-f825-4c28-997c-5bb6d6cb405f] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:16:33.578554 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a6cb502b-dfc6-479c-97d9-84e712ad92e0 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:16:33.579072 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a6cb502b-dfc6-479c-97d9-84e712ad92e0 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:16:33.579548 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a6cb502b-dfc6-479c-97d9-84e712ad92e0 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:16:33.581978 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a6cb502b-dfc6-479c-97d9-84e712ad92e0 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:16:33.583953 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a6cb502b-dfc6-479c-97d9-84e712ad92e0 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:16:33.584748 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a6cb502b-dfc6-479c-97d9-84e712ad92e0 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:16:33.629673 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-a6cb502b-dfc6-479c-97d9-84e712ad92e0 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] 10.222.0.18 "POST /compute/v2.1/servers/8ad825e9-f825-4c28-997c-5bb6d6cb405f/action" status: 202 len: 1137 microversion: 2.57 time: 0.305292 Oct 22 21:16:33.630997 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2496/4976] 10.222.0.18 () {62 vars in 1320 bytes} [Sat Oct 22 21:16:33 2022] POST /compute/v2.1/servers/8ad825e9-f825-4c28-997c-5bb6d6cb405f/action => generated 1137 bytes in 307 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 22 21:16:33.657865 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-575dbc59-7e26-41a5-9fee-f40ac5b58f26 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:16:33.658689 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-575dbc59-7e26-41a5-9fee-f40ac5b58f26 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] [instance: 8ad825e9-f825-4c28-997c-5bb6d6cb405f] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:16:33.672344 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-575dbc59-7e26-41a5-9fee-f40ac5b58f26 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:16:33.672862 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-575dbc59-7e26-41a5-9fee-f40ac5b58f26 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:16:33.673291 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-575dbc59-7e26-41a5-9fee-f40ac5b58f26 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:16:33.676302 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-575dbc59-7e26-41a5-9fee-f40ac5b58f26 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:16:33.676844 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-575dbc59-7e26-41a5-9fee-f40ac5b58f26 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:16:33.677308 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-575dbc59-7e26-41a5-9fee-f40ac5b58f26 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:16:33.938359 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-575dbc59-7e26-41a5-9fee-f40ac5b58f26 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e4ed23a2bb4537b00b90ec116ea084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9da591f0cc4d60aae0abe808be33a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:16:33.950707 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-575dbc59-7e26-41a5-9fee-f40ac5b58f26 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38e4ed23a2bb4537b00b90ec116ea084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9da591f0cc4d60aae0abe808be33a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:16:33.952744 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-575dbc59-7e26-41a5-9fee-f40ac5b58f26 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38e4ed23a2bb4537b00b90ec116ea084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9da591f0cc4d60aae0abe808be33a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:16:33.955006 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-575dbc59-7e26-41a5-9fee-f40ac5b58f26 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] 10.222.0.18 "GET /compute/v2.1/servers/8ad825e9-f825-4c28-997c-5bb6d6cb405f" status: 200 len: 1365 microversion: 2.57 time: 0.302341 Oct 22 21:16:33.956133 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2481/4977] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:16:33 2022] GET /compute/v2.1/servers/8ad825e9-f825-4c28-997c-5bb6d6cb405f => generated 1365 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:16:34.987880 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-8232c26b-66ef-4213-a2ff-d12d90389bd1 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:16:34.989034 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-8232c26b-66ef-4213-a2ff-d12d90389bd1 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] [instance: 8ad825e9-f825-4c28-997c-5bb6d6cb405f] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:16:35.006434 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8232c26b-66ef-4213-a2ff-d12d90389bd1 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:16:35.007083 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8232c26b-66ef-4213-a2ff-d12d90389bd1 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:16:35.008610 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8232c26b-66ef-4213-a2ff-d12d90389bd1 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:16:35.010664 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8232c26b-66ef-4213-a2ff-d12d90389bd1 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:16:35.011777 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8232c26b-66ef-4213-a2ff-d12d90389bd1 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:16:35.012881 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8232c26b-66ef-4213-a2ff-d12d90389bd1 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:16:35.595286 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-8232c26b-66ef-4213-a2ff-d12d90389bd1 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e4ed23a2bb4537b00b90ec116ea084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9da591f0cc4d60aae0abe808be33a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:16:35.605511 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-8232c26b-66ef-4213-a2ff-d12d90389bd1 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38e4ed23a2bb4537b00b90ec116ea084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9da591f0cc4d60aae0abe808be33a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:16:35.615691 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-8232c26b-66ef-4213-a2ff-d12d90389bd1 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38e4ed23a2bb4537b00b90ec116ea084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9da591f0cc4d60aae0abe808be33a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:16:35.617070 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-8232c26b-66ef-4213-a2ff-d12d90389bd1 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] 10.222.0.18 "GET /compute/v2.1/servers/8ad825e9-f825-4c28-997c-5bb6d6cb405f" status: 200 len: 1365 microversion: 2.57 time: 0.635136 Oct 22 21:16:35.627443 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2497/4978] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:16:34 2022] GET /compute/v2.1/servers/8ad825e9-f825-4c28-997c-5bb6d6cb405f => generated 1365 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:16:36.651765 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-324cb068-9ecf-4b63-ac12-f0e24172943a tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:16:36.653891 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-324cb068-9ecf-4b63-ac12-f0e24172943a tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] [instance: 8ad825e9-f825-4c28-997c-5bb6d6cb405f] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:16:36.664694 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-324cb068-9ecf-4b63-ac12-f0e24172943a tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:16:36.665741 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-324cb068-9ecf-4b63-ac12-f0e24172943a tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:16:36.666197 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-324cb068-9ecf-4b63-ac12-f0e24172943a tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:16:36.667243 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-324cb068-9ecf-4b63-ac12-f0e24172943a tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:16:36.667809 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-324cb068-9ecf-4b63-ac12-f0e24172943a tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:16:36.668244 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-324cb068-9ecf-4b63-ac12-f0e24172943a tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:16:36.788549 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-324cb068-9ecf-4b63-ac12-f0e24172943a tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e4ed23a2bb4537b00b90ec116ea084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9da591f0cc4d60aae0abe808be33a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:16:36.813593 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-324cb068-9ecf-4b63-ac12-f0e24172943a tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38e4ed23a2bb4537b00b90ec116ea084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9da591f0cc4d60aae0abe808be33a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:16:36.825370 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-324cb068-9ecf-4b63-ac12-f0e24172943a tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38e4ed23a2bb4537b00b90ec116ea084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9da591f0cc4d60aae0abe808be33a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:16:36.827012 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-324cb068-9ecf-4b63-ac12-f0e24172943a tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] 10.222.0.18 "GET /compute/v2.1/servers/8ad825e9-f825-4c28-997c-5bb6d6cb405f" status: 200 len: 1365 microversion: 2.57 time: 0.181451 Oct 22 21:16:36.828247 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2482/4979] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:16:36 2022] GET /compute/v2.1/servers/8ad825e9-f825-4c28-997c-5bb6d6cb405f => generated 1365 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:16:37.854360 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-4436ef37-4297-4a3c-86be-86e57a00ff7c tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:16:37.854995 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-4436ef37-4297-4a3c-86be-86e57a00ff7c tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] [instance: 8ad825e9-f825-4c28-997c-5bb6d6cb405f] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:16:37.871702 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell0:SELECT=2 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:16:37.874067 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell0:SELECT=6 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:16:37.878631 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4436ef37-4297-4a3c-86be-86e57a00ff7c tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:16:37.883524 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4436ef37-4297-4a3c-86be-86e57a00ff7c tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:16:37.884927 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4436ef37-4297-4a3c-86be-86e57a00ff7c tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:16:37.887063 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4436ef37-4297-4a3c-86be-86e57a00ff7c tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:16:37.887782 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4436ef37-4297-4a3c-86be-86e57a00ff7c tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:16:37.895725 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4436ef37-4297-4a3c-86be-86e57a00ff7c tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:16:38.110486 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-4436ef37-4297-4a3c-86be-86e57a00ff7c tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e4ed23a2bb4537b00b90ec116ea084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9da591f0cc4d60aae0abe808be33a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:16:38.128750 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-4436ef37-4297-4a3c-86be-86e57a00ff7c tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38e4ed23a2bb4537b00b90ec116ea084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9da591f0cc4d60aae0abe808be33a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:16:38.142028 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-4436ef37-4297-4a3c-86be-86e57a00ff7c tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38e4ed23a2bb4537b00b90ec116ea084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9da591f0cc4d60aae0abe808be33a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:16:38.149907 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-4436ef37-4297-4a3c-86be-86e57a00ff7c tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] 10.222.0.18 "GET /compute/v2.1/servers/8ad825e9-f825-4c28-997c-5bb6d6cb405f" status: 200 len: 1365 microversion: 2.57 time: 0.297696 Oct 22 21:16:38.153659 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2498/4980] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:16:37 2022] GET /compute/v2.1/servers/8ad825e9-f825-4c28-997c-5bb6d6cb405f => generated 1365 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:16:39.181854 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-b5e4e7c8-8f6e-4926-883c-65488e8933b0 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:16:39.182477 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-b5e4e7c8-8f6e-4926-883c-65488e8933b0 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] [instance: 8ad825e9-f825-4c28-997c-5bb6d6cb405f] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:16:39.186492 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell0:SELECT=2 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:16:39.197867 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b5e4e7c8-8f6e-4926-883c-65488e8933b0 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:16:39.198376 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b5e4e7c8-8f6e-4926-883c-65488e8933b0 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:16:39.198826 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b5e4e7c8-8f6e-4926-883c-65488e8933b0 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:16:39.199588 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b5e4e7c8-8f6e-4926-883c-65488e8933b0 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:16:39.200067 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b5e4e7c8-8f6e-4926-883c-65488e8933b0 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:16:39.200692 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b5e4e7c8-8f6e-4926-883c-65488e8933b0 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:16:39.659013 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-b5e4e7c8-8f6e-4926-883c-65488e8933b0 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e4ed23a2bb4537b00b90ec116ea084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9da591f0cc4d60aae0abe808be33a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:16:39.671813 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-b5e4e7c8-8f6e-4926-883c-65488e8933b0 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38e4ed23a2bb4537b00b90ec116ea084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9da591f0cc4d60aae0abe808be33a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:16:39.674806 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-b5e4e7c8-8f6e-4926-883c-65488e8933b0 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38e4ed23a2bb4537b00b90ec116ea084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9da591f0cc4d60aae0abe808be33a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:16:39.677105 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-b5e4e7c8-8f6e-4926-883c-65488e8933b0 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] 10.222.0.18 "GET /compute/v2.1/servers/8ad825e9-f825-4c28-997c-5bb6d6cb405f" status: 200 len: 1365 microversion: 2.57 time: 0.499082 Oct 22 21:16:39.678698 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2483/4981] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:16:39 2022] GET /compute/v2.1/servers/8ad825e9-f825-4c28-997c-5bb6d6cb405f => generated 1365 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:16:40.704153 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-720ac93a-260e-4fc0-a027-ae5f8465ce0f tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:16:40.704906 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-720ac93a-260e-4fc0-a027-ae5f8465ce0f tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] [instance: 8ad825e9-f825-4c28-997c-5bb6d6cb405f] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:16:40.715646 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-720ac93a-260e-4fc0-a027-ae5f8465ce0f tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:16:40.720390 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-720ac93a-260e-4fc0-a027-ae5f8465ce0f tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:16:40.721276 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-720ac93a-260e-4fc0-a027-ae5f8465ce0f tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:16:40.723038 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-720ac93a-260e-4fc0-a027-ae5f8465ce0f tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:16:40.725264 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-720ac93a-260e-4fc0-a027-ae5f8465ce0f tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:16:40.726116 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-720ac93a-260e-4fc0-a027-ae5f8465ce0f tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:16:40.895147 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-720ac93a-260e-4fc0-a027-ae5f8465ce0f tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e4ed23a2bb4537b00b90ec116ea084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9da591f0cc4d60aae0abe808be33a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:16:40.920128 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-720ac93a-260e-4fc0-a027-ae5f8465ce0f tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38e4ed23a2bb4537b00b90ec116ea084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9da591f0cc4d60aae0abe808be33a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:16:40.927443 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-720ac93a-260e-4fc0-a027-ae5f8465ce0f tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38e4ed23a2bb4537b00b90ec116ea084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9da591f0cc4d60aae0abe808be33a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:16:40.932904 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-720ac93a-260e-4fc0-a027-ae5f8465ce0f tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] 10.222.0.18 "GET /compute/v2.1/servers/8ad825e9-f825-4c28-997c-5bb6d6cb405f" status: 200 len: 1365 microversion: 2.57 time: 0.232499 Oct 22 21:16:40.935192 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2499/4982] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:16:40 2022] GET /compute/v2.1/servers/8ad825e9-f825-4c28-997c-5bb6d6cb405f => generated 1365 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:16:41.961593 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-63e7b62f-dee5-4db7-a773-ed819434fa3d tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:16:41.962213 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-63e7b62f-dee5-4db7-a773-ed819434fa3d tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] [instance: 8ad825e9-f825-4c28-997c-5bb6d6cb405f] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:16:41.978942 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-63e7b62f-dee5-4db7-a773-ed819434fa3d tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:16:41.979429 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-63e7b62f-dee5-4db7-a773-ed819434fa3d tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:16:41.980604 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-63e7b62f-dee5-4db7-a773-ed819434fa3d tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:16:41.981628 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-63e7b62f-dee5-4db7-a773-ed819434fa3d tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:16:41.983331 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-63e7b62f-dee5-4db7-a773-ed819434fa3d tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:16:41.984115 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-63e7b62f-dee5-4db7-a773-ed819434fa3d tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:16:42.108686 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-63e7b62f-dee5-4db7-a773-ed819434fa3d tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e4ed23a2bb4537b00b90ec116ea084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9da591f0cc4d60aae0abe808be33a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:16:42.122107 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-63e7b62f-dee5-4db7-a773-ed819434fa3d tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38e4ed23a2bb4537b00b90ec116ea084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9da591f0cc4d60aae0abe808be33a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:16:42.124547 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-63e7b62f-dee5-4db7-a773-ed819434fa3d tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38e4ed23a2bb4537b00b90ec116ea084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9da591f0cc4d60aae0abe808be33a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:16:42.126030 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-63e7b62f-dee5-4db7-a773-ed819434fa3d tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] 10.222.0.18 "GET /compute/v2.1/servers/8ad825e9-f825-4c28-997c-5bb6d6cb405f" status: 200 len: 1365 microversion: 2.57 time: 0.170188 Oct 22 21:16:42.126802 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2484/4983] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:16:41 2022] GET /compute/v2.1/servers/8ad825e9-f825-4c28-997c-5bb6d6cb405f => generated 1365 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:16:42.900147 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-94344a7b-03e5-457f-a3c4-c82134b2b170 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServersNegativeTestJSON-server-1405343458", "imageRef": "085e4478-6edc-4a69-8e08-f9831713eb65", "flavorRef": "452", "min_count": 3, "networks": [{"uuid": "d1d09434-894d-4b3f-b0fa-59b6440757d0"}]}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:16:43.033828 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.network.neutron [None req-94344a7b-03e5-457f-a3c4-c82134b2b170 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] validate_networks() for [('d1d09434-894d-4b3f-b0fa-59b6440757d0', None, None, None, None, None)] {{(pid=138745) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 21:16:43.152900 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-d81bb7b9-8517-4cf6-874c-4afd3cd1e350 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:16:43.155055 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-d81bb7b9-8517-4cf6-874c-4afd3cd1e350 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] [instance: 8ad825e9-f825-4c28-997c-5bb6d6cb405f] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:16:43.177958 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d81bb7b9-8517-4cf6-874c-4afd3cd1e350 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:16:43.179366 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d81bb7b9-8517-4cf6-874c-4afd3cd1e350 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:16:43.180868 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d81bb7b9-8517-4cf6-874c-4afd3cd1e350 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:16:43.181867 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d81bb7b9-8517-4cf6-874c-4afd3cd1e350 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:16:43.182552 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d81bb7b9-8517-4cf6-874c-4afd3cd1e350 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:16:43.183203 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d81bb7b9-8517-4cf6-874c-4afd3cd1e350 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:16:43.603733 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-d81bb7b9-8517-4cf6-874c-4afd3cd1e350 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e4ed23a2bb4537b00b90ec116ea084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9da591f0cc4d60aae0abe808be33a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:16:43.618894 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-d81bb7b9-8517-4cf6-874c-4afd3cd1e350 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38e4ed23a2bb4537b00b90ec116ea084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9da591f0cc4d60aae0abe808be33a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:16:43.621146 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-d81bb7b9-8517-4cf6-874c-4afd3cd1e350 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38e4ed23a2bb4537b00b90ec116ea084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9da591f0cc4d60aae0abe808be33a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:16:43.622936 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-d81bb7b9-8517-4cf6-874c-4afd3cd1e350 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] 10.222.0.18 "GET /compute/v2.1/servers/8ad825e9-f825-4c28-997c-5bb6d6cb405f" status: 200 len: 1365 microversion: 2.57 time: 0.474662 Oct 22 21:16:43.624154 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2485/4984] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:16:43 2022] GET /compute/v2.1/servers/8ad825e9-f825-4c28-997c-5bb6d6cb405f => generated 1365 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:16:44.408805 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-94344a7b-03e5-457f-a3c4-c82134b2b170 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Flavor limits 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 21:16:44.409940 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-94344a7b-03e5-457f-a3c4-c82134b2b170 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Image limits 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 21:16:44.410740 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-94344a7b-03e5-457f-a3c4-c82134b2b170 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Flavor pref 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 21:16:44.411522 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-94344a7b-03e5-457f-a3c4-c82134b2b170 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Image pref 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 21:16:44.412189 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-94344a7b-03e5-457f-a3c4-c82134b2b170 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 21:16:44.440022 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-94344a7b-03e5-457f-a3c4-c82134b2b170 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:16:44.440708 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-94344a7b-03e5-457f-a3c4-c82134b2b170 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:16:44.446276 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-94344a7b-03e5-457f-a3c4-c82134b2b170 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:16:44.449086 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-94344a7b-03e5-457f-a3c4-c82134b2b170 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:16:44.450024 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-94344a7b-03e5-457f-a3c4-c82134b2b170 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:16:44.450867 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-94344a7b-03e5-457f-a3c4-c82134b2b170 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:16:44.535320 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-94344a7b-03e5-457f-a3c4-c82134b2b170 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Getting quotas for project d4b2530a0555405ab0240fdb0087e6a8. Resources: {'cores', 'instances', 'ram'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 21:16:44.583509 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-94344a7b-03e5-457f-a3c4-c82134b2b170 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Getting quotas for user 271a94b5c9324dac963afb958f054e0f and project d4b2530a0555405ab0240fdb0087e6a8. Resources: {'cores', 'instances', 'ram'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 21:16:44.621725 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-94344a7b-03e5-457f-a3c4-c82134b2b170 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Going to run 3 instances... {{(pid=138745) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 21:16:44.624491 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-94344a7b-03e5-457f-a3c4-c82134b2b170 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] [instance: ac635cb1-9b28-4ac2-b0da-c27f3a5388a4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='085e4478-6edc-4a69-8e08-f9831713eb65',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138745) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 21:16:44.661852 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-70a0df5a-2fcb-47be-9d6a-08ba15b4a4f2 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:16:44.662410 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-70a0df5a-2fcb-47be-9d6a-08ba15b4a4f2 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] [instance: 8ad825e9-f825-4c28-997c-5bb6d6cb405f] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:16:44.675884 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-70a0df5a-2fcb-47be-9d6a-08ba15b4a4f2 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:16:44.696923 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-70a0df5a-2fcb-47be-9d6a-08ba15b4a4f2 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:16:44.705314 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-70a0df5a-2fcb-47be-9d6a-08ba15b4a4f2 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:16:44.706118 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-70a0df5a-2fcb-47be-9d6a-08ba15b4a4f2 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:16:44.706639 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-70a0df5a-2fcb-47be-9d6a-08ba15b4a4f2 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:16:44.707083 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-70a0df5a-2fcb-47be-9d6a-08ba15b4a4f2 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:16:44.790596 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-94344a7b-03e5-457f-a3c4-c82134b2b170 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] [instance: 739c029e-b589-495d-89db-50c7a706b7f7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='085e4478-6edc-4a69-8e08-f9831713eb65',instance=,instance_uuid=ac635cb1-9b28-4ac2-b0da-c27f3a5388a4,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138745) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 21:16:44.876392 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-94344a7b-03e5-457f-a3c4-c82134b2b170 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] [instance: dde943e5-12d5-4d2c-859a-1ab238280e4e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='085e4478-6edc-4a69-8e08-f9831713eb65',instance=,instance_uuid=739c029e-b589-495d-89db-50c7a706b7f7,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138745) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 21:16:44.942590 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-70a0df5a-2fcb-47be-9d6a-08ba15b4a4f2 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e4ed23a2bb4537b00b90ec116ea084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9da591f0cc4d60aae0abe808be33a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:16:44.959604 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-70a0df5a-2fcb-47be-9d6a-08ba15b4a4f2 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38e4ed23a2bb4537b00b90ec116ea084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9da591f0cc4d60aae0abe808be33a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:16:44.961305 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-70a0df5a-2fcb-47be-9d6a-08ba15b4a4f2 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38e4ed23a2bb4537b00b90ec116ea084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9da591f0cc4d60aae0abe808be33a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:16:44.962960 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-70a0df5a-2fcb-47be-9d6a-08ba15b4a4f2 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] 10.222.0.18 "GET /compute/v2.1/servers/8ad825e9-f825-4c28-997c-5bb6d6cb405f" status: 200 len: 1365 microversion: 2.57 time: 0.317299 Oct 22 21:16:44.965486 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2486/4985] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:16:44 2022] GET /compute/v2.1/servers/8ad825e9-f825-4c28-997c-5bb6d6cb405f => generated 1365 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:16:45.020553 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-94344a7b-03e5-457f-a3c4-c82134b2b170 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.415778 Oct 22 21:16:45.021231 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2500/4986] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Oct 22 21:16:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 2419 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 21:16:45.035856 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-734b27e0-0022-4b8f-af07-8279a0ddf419 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:16:45.041329 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-734b27e0-0022-4b8f-af07-8279a0ddf419 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '271a94b5c9324dac963afb958f054e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b2530a0555405ab0240fdb0087e6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:16:45.051594 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-734b27e0-0022-4b8f-af07-8279a0ddf419 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Searching by: {'deleted': False, 'project_id': 'd4b2530a0555405ab0240fdb0087e6a8'} {{(pid=138744) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 22 21:16:45.110146 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-734b27e0-0022-4b8f-af07-8279a0ddf419 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:16:45.110644 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-734b27e0-0022-4b8f-af07-8279a0ddf419 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:16:45.111392 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-734b27e0-0022-4b8f-af07-8279a0ddf419 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:16:45.112301 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-734b27e0-0022-4b8f-af07-8279a0ddf419 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:16:45.113036 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-734b27e0-0022-4b8f-af07-8279a0ddf419 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:16:45.113655 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-734b27e0-0022-4b8f-af07-8279a0ddf419 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:16:45.146299 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-734b27e0-0022-4b8f-af07-8279a0ddf419 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] 10.222.0.18 "GET /compute/v2.1/servers" status: 200 len: 1018 microversion: 2.1 time: 0.117056 Oct 22 21:16:45.147177 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2487/4987] 10.222.0.18 () {58 vars in 1125 bytes} [Sat Oct 22 21:16:45 2022] GET /compute/v2.1/servers => generated 1018 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:16:45.159697 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-3c167730-9017-476d-a359-009a1edc7bcf tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:16:45.161042 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-3c167730-9017-476d-a359-009a1edc7bcf tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] [instance: dde943e5-12d5-4d2c-859a-1ab238280e4e] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:16:45.320782 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-3c167730-9017-476d-a359-009a1edc7bcf tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '271a94b5c9324dac963afb958f054e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b2530a0555405ab0240fdb0087e6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:16:45.330755 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-3c167730-9017-476d-a359-009a1edc7bcf tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] 10.222.0.18 "GET /compute/v2.1/servers/dde943e5-12d5-4d2c-859a-1ab238280e4e" status: 200 len: 1223 microversion: 2.1 time: 0.175345 Oct 22 21:16:45.353290 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2501/4988] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:16:45 2022] GET /compute/v2.1/servers/dde943e5-12d5-4d2c-859a-1ab238280e4e => generated 1223 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:16:45.992586 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-9828140d-6fcb-433d-8a66-49e61ce3152a tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:16:45.993270 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-9828140d-6fcb-433d-8a66-49e61ce3152a tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] [instance: 8ad825e9-f825-4c28-997c-5bb6d6cb405f] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:16:46.014017 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9828140d-6fcb-433d-8a66-49e61ce3152a tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:16:46.014563 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9828140d-6fcb-433d-8a66-49e61ce3152a tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:16:46.016042 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9828140d-6fcb-433d-8a66-49e61ce3152a tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:16:46.017064 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9828140d-6fcb-433d-8a66-49e61ce3152a tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:16:46.018861 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9828140d-6fcb-433d-8a66-49e61ce3152a tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:16:46.025575 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9828140d-6fcb-433d-8a66-49e61ce3152a tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:16:46.255689 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-9828140d-6fcb-433d-8a66-49e61ce3152a tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e4ed23a2bb4537b00b90ec116ea084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9da591f0cc4d60aae0abe808be33a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:16:46.278009 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-9828140d-6fcb-433d-8a66-49e61ce3152a tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38e4ed23a2bb4537b00b90ec116ea084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9da591f0cc4d60aae0abe808be33a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:16:46.280813 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-9828140d-6fcb-433d-8a66-49e61ce3152a tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38e4ed23a2bb4537b00b90ec116ea084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9da591f0cc4d60aae0abe808be33a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:16:46.282391 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-9828140d-6fcb-433d-8a66-49e61ce3152a tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] 10.222.0.18 "GET /compute/v2.1/servers/8ad825e9-f825-4c28-997c-5bb6d6cb405f" status: 200 len: 1365 microversion: 2.57 time: 0.294801 Oct 22 21:16:46.283131 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2488/4989] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:16:45 2022] GET /compute/v2.1/servers/8ad825e9-f825-4c28-997c-5bb6d6cb405f => generated 1365 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:16:46.358186 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-6a7a64cc-694f-4df4-a65e-d8ac0bf775a0 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:16:46.360103 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-6a7a64cc-694f-4df4-a65e-d8ac0bf775a0 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] [instance: dde943e5-12d5-4d2c-859a-1ab238280e4e] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:16:46.454463 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-6a7a64cc-694f-4df4-a65e-d8ac0bf775a0 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '271a94b5c9324dac963afb958f054e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b2530a0555405ab0240fdb0087e6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:16:46.470081 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-6a7a64cc-694f-4df4-a65e-d8ac0bf775a0 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] 10.222.0.18 "GET /compute/v2.1/servers/dde943e5-12d5-4d2c-859a-1ab238280e4e" status: 200 len: 1223 microversion: 2.1 time: 0.116776 Oct 22 21:16:46.483808 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2502/4990] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:16:46 2022] GET /compute/v2.1/servers/dde943e5-12d5-4d2c-859a-1ab238280e4e => generated 1223 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:16:47.309180 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-4df5249c-d101-449e-a90f-c936941df985 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:16:47.309807 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-4df5249c-d101-449e-a90f-c936941df985 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] [instance: 8ad825e9-f825-4c28-997c-5bb6d6cb405f] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:16:47.327286 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4df5249c-d101-449e-a90f-c936941df985 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:16:47.328166 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4df5249c-d101-449e-a90f-c936941df985 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:16:47.329372 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4df5249c-d101-449e-a90f-c936941df985 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:16:47.333403 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4df5249c-d101-449e-a90f-c936941df985 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:16:47.334297 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4df5249c-d101-449e-a90f-c936941df985 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:16:47.334930 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4df5249c-d101-449e-a90f-c936941df985 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:16:47.498878 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-f4dc42d8-5cb1-441c-9a69-cb561d17e648 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:16:47.499648 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-f4dc42d8-5cb1-441c-9a69-cb561d17e648 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] [instance: dde943e5-12d5-4d2c-859a-1ab238280e4e] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:16:47.514546 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f4dc42d8-5cb1-441c-9a69-cb561d17e648 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:16:47.518755 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f4dc42d8-5cb1-441c-9a69-cb561d17e648 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:16:47.524388 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f4dc42d8-5cb1-441c-9a69-cb561d17e648 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:16:47.525466 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f4dc42d8-5cb1-441c-9a69-cb561d17e648 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:16:47.526070 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f4dc42d8-5cb1-441c-9a69-cb561d17e648 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:16:47.526691 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f4dc42d8-5cb1-441c-9a69-cb561d17e648 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:16:47.777453 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-f4dc42d8-5cb1-441c-9a69-cb561d17e648 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '271a94b5c9324dac963afb958f054e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b2530a0555405ab0240fdb0087e6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:16:47.795776 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-f4dc42d8-5cb1-441c-9a69-cb561d17e648 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] 10.222.0.18 "GET /compute/v2.1/servers/dde943e5-12d5-4d2c-859a-1ab238280e4e" status: 200 len: 1219 microversion: 2.1 time: 0.300975 Oct 22 21:16:47.798000 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-4df5249c-d101-449e-a90f-c936941df985 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e4ed23a2bb4537b00b90ec116ea084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9da591f0cc4d60aae0abe808be33a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:16:47.811930 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2503/4991] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:16:47 2022] GET /compute/v2.1/servers/dde943e5-12d5-4d2c-859a-1ab238280e4e => generated 1219 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:16:47.819700 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-4df5249c-d101-449e-a90f-c936941df985 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38e4ed23a2bb4537b00b90ec116ea084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9da591f0cc4d60aae0abe808be33a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:16:47.835386 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-4df5249c-d101-449e-a90f-c936941df985 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38e4ed23a2bb4537b00b90ec116ea084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9da591f0cc4d60aae0abe808be33a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:16:47.841878 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-4df5249c-d101-449e-a90f-c936941df985 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] 10.222.0.18 "GET /compute/v2.1/servers/8ad825e9-f825-4c28-997c-5bb6d6cb405f" status: 200 len: 1365 microversion: 2.57 time: 0.534081 Oct 22 21:16:47.886410 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2489/4992] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:16:47 2022] GET /compute/v2.1/servers/8ad825e9-f825-4c28-997c-5bb6d6cb405f => generated 1365 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 22 21:16:48.831747 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-c74c0e6f-2651-4b79-860f-6df5acc6e510 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:16:48.833595 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-c74c0e6f-2651-4b79-860f-6df5acc6e510 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] [instance: dde943e5-12d5-4d2c-859a-1ab238280e4e] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:16:48.850388 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c74c0e6f-2651-4b79-860f-6df5acc6e510 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:16:48.851576 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c74c0e6f-2651-4b79-860f-6df5acc6e510 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:16:48.853560 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c74c0e6f-2651-4b79-860f-6df5acc6e510 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:16:48.855947 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c74c0e6f-2651-4b79-860f-6df5acc6e510 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:16:48.863913 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c74c0e6f-2651-4b79-860f-6df5acc6e510 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:16:48.865890 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c74c0e6f-2651-4b79-860f-6df5acc6e510 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:16:48.874091 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-60f6d422-b5a1-47c2-bab3-76e1efebd475 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:16:48.874713 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-60f6d422-b5a1-47c2-bab3-76e1efebd475 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] [instance: 8ad825e9-f825-4c28-997c-5bb6d6cb405f] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:16:48.889355 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-60f6d422-b5a1-47c2-bab3-76e1efebd475 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:16:48.889856 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-60f6d422-b5a1-47c2-bab3-76e1efebd475 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:16:48.890303 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-60f6d422-b5a1-47c2-bab3-76e1efebd475 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:16:48.891037 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-60f6d422-b5a1-47c2-bab3-76e1efebd475 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:16:48.891615 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-60f6d422-b5a1-47c2-bab3-76e1efebd475 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:16:48.891975 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-60f6d422-b5a1-47c2-bab3-76e1efebd475 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:16:49.262849 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-c74c0e6f-2651-4b79-860f-6df5acc6e510 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '271a94b5c9324dac963afb958f054e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b2530a0555405ab0240fdb0087e6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:16:49.271303 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-c74c0e6f-2651-4b79-860f-6df5acc6e510 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] 10.222.0.18 "GET /compute/v2.1/servers/dde943e5-12d5-4d2c-859a-1ab238280e4e" status: 200 len: 1275 microversion: 2.1 time: 0.447866 Oct 22 21:16:49.271932 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2504/4993] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:16:48 2022] GET /compute/v2.1/servers/dde943e5-12d5-4d2c-859a-1ab238280e4e => generated 1275 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:16:49.534686 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-60f6d422-b5a1-47c2-bab3-76e1efebd475 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e4ed23a2bb4537b00b90ec116ea084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9da591f0cc4d60aae0abe808be33a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:16:49.551964 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-60f6d422-b5a1-47c2-bab3-76e1efebd475 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38e4ed23a2bb4537b00b90ec116ea084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9da591f0cc4d60aae0abe808be33a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:16:49.553533 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-60f6d422-b5a1-47c2-bab3-76e1efebd475 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38e4ed23a2bb4537b00b90ec116ea084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9da591f0cc4d60aae0abe808be33a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:16:49.555491 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-60f6d422-b5a1-47c2-bab3-76e1efebd475 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] 10.222.0.18 "GET /compute/v2.1/servers/8ad825e9-f825-4c28-997c-5bb6d6cb405f" status: 200 len: 1365 microversion: 2.57 time: 0.685264 Oct 22 21:16:49.556078 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2490/4994] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:16:48 2022] GET /compute/v2.1/servers/8ad825e9-f825-4c28-997c-5bb6d6cb405f => generated 1365 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 22 21:16:50.297159 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-19f94c4a-4c8e-4da3-b9a8-7a753b36a751 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:16:50.297828 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-19f94c4a-4c8e-4da3-b9a8-7a753b36a751 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] [instance: dde943e5-12d5-4d2c-859a-1ab238280e4e] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:16:50.319126 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-19f94c4a-4c8e-4da3-b9a8-7a753b36a751 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:16:50.319902 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-19f94c4a-4c8e-4da3-b9a8-7a753b36a751 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:16:50.320899 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-19f94c4a-4c8e-4da3-b9a8-7a753b36a751 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:16:50.324133 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-19f94c4a-4c8e-4da3-b9a8-7a753b36a751 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:16:50.324800 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-19f94c4a-4c8e-4da3-b9a8-7a753b36a751 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:16:50.325444 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-19f94c4a-4c8e-4da3-b9a8-7a753b36a751 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:16:50.474687 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-19f94c4a-4c8e-4da3-b9a8-7a753b36a751 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '271a94b5c9324dac963afb958f054e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b2530a0555405ab0240fdb0087e6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:16:50.493341 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-19f94c4a-4c8e-4da3-b9a8-7a753b36a751 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] 10.222.0.18 "GET /compute/v2.1/servers/dde943e5-12d5-4d2c-859a-1ab238280e4e" status: 200 len: 1281 microversion: 2.1 time: 0.200880 Oct 22 21:16:50.495941 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2505/4995] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:16:50 2022] GET /compute/v2.1/servers/dde943e5-12d5-4d2c-859a-1ab238280e4e => generated 1281 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:16:50.582177 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-ac6e13f1-aead-4ce9-acd3-6dff48ce4f20 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:16:50.583618 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-ac6e13f1-aead-4ce9-acd3-6dff48ce4f20 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] [instance: 8ad825e9-f825-4c28-997c-5bb6d6cb405f] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:16:50.596195 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ac6e13f1-aead-4ce9-acd3-6dff48ce4f20 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:16:50.597527 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ac6e13f1-aead-4ce9-acd3-6dff48ce4f20 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:16:50.602734 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ac6e13f1-aead-4ce9-acd3-6dff48ce4f20 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:16:50.605312 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ac6e13f1-aead-4ce9-acd3-6dff48ce4f20 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:16:50.607634 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ac6e13f1-aead-4ce9-acd3-6dff48ce4f20 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:16:50.609261 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ac6e13f1-aead-4ce9-acd3-6dff48ce4f20 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:16:50.826458 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-ac6e13f1-aead-4ce9-acd3-6dff48ce4f20 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e4ed23a2bb4537b00b90ec116ea084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9da591f0cc4d60aae0abe808be33a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:16:50.846217 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-ac6e13f1-aead-4ce9-acd3-6dff48ce4f20 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38e4ed23a2bb4537b00b90ec116ea084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9da591f0cc4d60aae0abe808be33a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:16:50.848844 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-ac6e13f1-aead-4ce9-acd3-6dff48ce4f20 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38e4ed23a2bb4537b00b90ec116ea084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9da591f0cc4d60aae0abe808be33a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:16:50.853442 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-ac6e13f1-aead-4ce9-acd3-6dff48ce4f20 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] 10.222.0.18 "GET /compute/v2.1/servers/8ad825e9-f825-4c28-997c-5bb6d6cb405f" status: 200 len: 1365 microversion: 2.57 time: 0.275892 Oct 22 21:16:50.866024 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2491/4996] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:16:50 2022] GET /compute/v2.1/servers/8ad825e9-f825-4c28-997c-5bb6d6cb405f => generated 1365 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:16:51.535780 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-fe01abf9-96e3-44b5-b303-b404696a3ff8 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:16:51.536654 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-fe01abf9-96e3-44b5-b303-b404696a3ff8 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] [instance: dde943e5-12d5-4d2c-859a-1ab238280e4e] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:16:51.549034 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fe01abf9-96e3-44b5-b303-b404696a3ff8 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:16:51.551415 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fe01abf9-96e3-44b5-b303-b404696a3ff8 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:16:51.552221 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fe01abf9-96e3-44b5-b303-b404696a3ff8 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:16:51.554855 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fe01abf9-96e3-44b5-b303-b404696a3ff8 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:16:51.555960 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fe01abf9-96e3-44b5-b303-b404696a3ff8 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:16:51.556661 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fe01abf9-96e3-44b5-b303-b404696a3ff8 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:16:51.843443 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-fe01abf9-96e3-44b5-b303-b404696a3ff8 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '271a94b5c9324dac963afb958f054e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b2530a0555405ab0240fdb0087e6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:16:51.856155 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-fe01abf9-96e3-44b5-b303-b404696a3ff8 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] 10.222.0.18 "GET /compute/v2.1/servers/dde943e5-12d5-4d2c-859a-1ab238280e4e" status: 200 len: 1323 microversion: 2.1 time: 0.341098 Oct 22 21:16:51.858335 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2506/4997] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:16:51 2022] GET /compute/v2.1/servers/dde943e5-12d5-4d2c-859a-1ab238280e4e => generated 1323 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:16:51.890062 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-9e62273d-6043-4557-add7-6324f2248bc7 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:16:51.891396 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-9e62273d-6043-4557-add7-6324f2248bc7 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] [instance: 8ad825e9-f825-4c28-997c-5bb6d6cb405f] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:16:51.905124 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9e62273d-6043-4557-add7-6324f2248bc7 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:16:51.906147 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9e62273d-6043-4557-add7-6324f2248bc7 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:16:51.907037 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9e62273d-6043-4557-add7-6324f2248bc7 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:16:51.908057 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9e62273d-6043-4557-add7-6324f2248bc7 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:16:51.912818 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9e62273d-6043-4557-add7-6324f2248bc7 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:16:51.913852 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9e62273d-6043-4557-add7-6324f2248bc7 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:16:52.100202 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-9e62273d-6043-4557-add7-6324f2248bc7 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e4ed23a2bb4537b00b90ec116ea084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9da591f0cc4d60aae0abe808be33a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:16:52.122343 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-9e62273d-6043-4557-add7-6324f2248bc7 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38e4ed23a2bb4537b00b90ec116ea084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9da591f0cc4d60aae0abe808be33a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:16:52.123838 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-9e62273d-6043-4557-add7-6324f2248bc7 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38e4ed23a2bb4537b00b90ec116ea084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9da591f0cc4d60aae0abe808be33a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:16:52.125071 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-9e62273d-6043-4557-add7-6324f2248bc7 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] 10.222.0.18 "GET /compute/v2.1/servers/8ad825e9-f825-4c28-997c-5bb6d6cb405f" status: 200 len: 1365 microversion: 2.57 time: 0.241496 Oct 22 21:16:52.135767 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2492/4998] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:16:51 2022] GET /compute/v2.1/servers/8ad825e9-f825-4c28-997c-5bb6d6cb405f => generated 1365 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:16:52.889867 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-f74c13f8-f776-4281-9a71-735115d6177b tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:16:52.891632 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-f74c13f8-f776-4281-9a71-735115d6177b tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] [instance: dde943e5-12d5-4d2c-859a-1ab238280e4e] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:16:52.912494 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f74c13f8-f776-4281-9a71-735115d6177b tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:16:52.913410 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f74c13f8-f776-4281-9a71-735115d6177b tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:16:52.914113 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f74c13f8-f776-4281-9a71-735115d6177b tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:16:52.915073 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f74c13f8-f776-4281-9a71-735115d6177b tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:16:52.915803 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f74c13f8-f776-4281-9a71-735115d6177b tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:16:52.916463 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f74c13f8-f776-4281-9a71-735115d6177b tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:16:53.155570 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-36a3dc4a-518d-4010-ada3-1e67b850c6b2 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:16:53.156193 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-36a3dc4a-518d-4010-ada3-1e67b850c6b2 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] [instance: 8ad825e9-f825-4c28-997c-5bb6d6cb405f] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:16:53.171697 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-36a3dc4a-518d-4010-ada3-1e67b850c6b2 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:16:53.172193 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-36a3dc4a-518d-4010-ada3-1e67b850c6b2 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:16:53.177499 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-36a3dc4a-518d-4010-ada3-1e67b850c6b2 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:16:53.178751 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-36a3dc4a-518d-4010-ada3-1e67b850c6b2 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:16:53.179249 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-36a3dc4a-518d-4010-ada3-1e67b850c6b2 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:16:53.189093 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-36a3dc4a-518d-4010-ada3-1e67b850c6b2 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:16:53.394509 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-f74c13f8-f776-4281-9a71-735115d6177b tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '271a94b5c9324dac963afb958f054e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b2530a0555405ab0240fdb0087e6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:16:53.408079 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-f74c13f8-f776-4281-9a71-735115d6177b tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] 10.222.0.18 "GET /compute/v2.1/servers/dde943e5-12d5-4d2c-859a-1ab238280e4e" status: 200 len: 1323 microversion: 2.1 time: 0.528098 Oct 22 21:16:53.410857 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-36a3dc4a-518d-4010-ada3-1e67b850c6b2 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e4ed23a2bb4537b00b90ec116ea084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9da591f0cc4d60aae0abe808be33a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:16:53.411315 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2507/4999] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:16:52 2022] GET /compute/v2.1/servers/dde943e5-12d5-4d2c-859a-1ab238280e4e => generated 1323 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:16:53.424818 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-36a3dc4a-518d-4010-ada3-1e67b850c6b2 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38e4ed23a2bb4537b00b90ec116ea084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9da591f0cc4d60aae0abe808be33a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:16:53.431520 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-36a3dc4a-518d-4010-ada3-1e67b850c6b2 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38e4ed23a2bb4537b00b90ec116ea084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9da591f0cc4d60aae0abe808be33a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:16:53.433090 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-36a3dc4a-518d-4010-ada3-1e67b850c6b2 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] 10.222.0.18 "GET /compute/v2.1/servers/8ad825e9-f825-4c28-997c-5bb6d6cb405f" status: 200 len: 1365 microversion: 2.57 time: 0.281863 Oct 22 21:16:53.434170 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2493/5000] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:16:53 2022] GET /compute/v2.1/servers/8ad825e9-f825-4c28-997c-5bb6d6cb405f => generated 1365 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 22 21:16:54.437308 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-78249dad-adff-4cff-ada1-c25bc7a4e6d0 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:16:54.438612 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-78249dad-adff-4cff-ada1-c25bc7a4e6d0 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] [instance: dde943e5-12d5-4d2c-859a-1ab238280e4e] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:16:54.446917 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-78249dad-adff-4cff-ada1-c25bc7a4e6d0 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:16:54.447441 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-78249dad-adff-4cff-ada1-c25bc7a4e6d0 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:16:54.448115 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-78249dad-adff-4cff-ada1-c25bc7a4e6d0 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:16:54.448853 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-78249dad-adff-4cff-ada1-c25bc7a4e6d0 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:16:54.449368 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-78249dad-adff-4cff-ada1-c25bc7a4e6d0 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:16:54.449813 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-78249dad-adff-4cff-ada1-c25bc7a4e6d0 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:16:54.460181 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-83604829-f400-4338-882c-0ef4c4d8b445 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:16:54.460816 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-83604829-f400-4338-882c-0ef4c4d8b445 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] [instance: 8ad825e9-f825-4c28-997c-5bb6d6cb405f] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:16:54.469633 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-83604829-f400-4338-882c-0ef4c4d8b445 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:16:54.470124 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-83604829-f400-4338-882c-0ef4c4d8b445 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:16:54.470562 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-83604829-f400-4338-882c-0ef4c4d8b445 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:16:54.471267 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-83604829-f400-4338-882c-0ef4c4d8b445 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:16:54.471745 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-83604829-f400-4338-882c-0ef4c4d8b445 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:16:54.472268 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-83604829-f400-4338-882c-0ef4c4d8b445 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:16:54.504828 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell0:SELECT=2 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:16:54.677478 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-83604829-f400-4338-882c-0ef4c4d8b445 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e4ed23a2bb4537b00b90ec116ea084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9da591f0cc4d60aae0abe808be33a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:16:54.688196 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-83604829-f400-4338-882c-0ef4c4d8b445 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38e4ed23a2bb4537b00b90ec116ea084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9da591f0cc4d60aae0abe808be33a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:16:54.690384 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-83604829-f400-4338-882c-0ef4c4d8b445 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38e4ed23a2bb4537b00b90ec116ea084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9da591f0cc4d60aae0abe808be33a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:16:54.692375 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-83604829-f400-4338-882c-0ef4c4d8b445 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] 10.222.0.18 "GET /compute/v2.1/servers/8ad825e9-f825-4c28-997c-5bb6d6cb405f" status: 200 len: 1365 microversion: 2.57 time: 0.237064 Oct 22 21:16:54.719816 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2494/5001] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:16:54 2022] GET /compute/v2.1/servers/8ad825e9-f825-4c28-997c-5bb6d6cb405f => generated 1365 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:16:55.018879 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-78249dad-adff-4cff-ada1-c25bc7a4e6d0 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '271a94b5c9324dac963afb958f054e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b2530a0555405ab0240fdb0087e6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:16:55.027693 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-78249dad-adff-4cff-ada1-c25bc7a4e6d0 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] 10.222.0.18 "GET /compute/v2.1/servers/dde943e5-12d5-4d2c-859a-1ab238280e4e" status: 200 len: 1323 microversion: 2.1 time: 0.595073 Oct 22 21:16:55.039871 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2508/5002] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:16:54 2022] GET /compute/v2.1/servers/dde943e5-12d5-4d2c-859a-1ab238280e4e => generated 1323 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:16:55.339991 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-efc5e185-2795-4385-a00d-4c19036d4ac6 req-5894dc84-8e51-4da8-b6b7-353d77059ca0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac635cb1-9b28-4ac2-b0da-c27f3a5388a4", "tag": "4ffb13fd-86bc-4729-af81-af5f6f60a723"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:16:55.345787 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell0:SELECT=2 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:16:55.365296 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-efc5e185-2795-4385-a00d-4c19036d4ac6 req-5894dc84-8e51-4da8-b6b7-353d77059ca0 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:16:55.365814 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-efc5e185-2795-4385-a00d-4c19036d4ac6 req-5894dc84-8e51-4da8-b6b7-353d77059ca0 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:16:55.366261 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-efc5e185-2795-4385-a00d-4c19036d4ac6 req-5894dc84-8e51-4da8-b6b7-353d77059ca0 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:16:55.389578 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-efc5e185-2795-4385-a00d-4c19036d4ac6 req-5894dc84-8e51-4da8-b6b7-353d77059ca0 service nova] Creating event network-changed:4ffb13fd-86bc-4729-af81-af5f6f60a723 for instance ac635cb1-9b28-4ac2-b0da-c27f3a5388a4 on nch2-master-1 Oct 22 21:16:55.412656 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-efc5e185-2795-4385-a00d-4c19036d4ac6 req-5894dc84-8e51-4da8-b6b7-353d77059ca0 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077071 Oct 22 21:16:55.413893 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2495/5003] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:16:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 21:16:55.728227 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-7f6b0e3d-ac23-4b2c-87e3-681429c7e52f tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:16:55.730354 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-7f6b0e3d-ac23-4b2c-87e3-681429c7e52f tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] [instance: 8ad825e9-f825-4c28-997c-5bb6d6cb405f] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:16:55.743804 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7f6b0e3d-ac23-4b2c-87e3-681429c7e52f tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:16:55.744874 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7f6b0e3d-ac23-4b2c-87e3-681429c7e52f tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:16:55.745517 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7f6b0e3d-ac23-4b2c-87e3-681429c7e52f tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:16:55.746825 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7f6b0e3d-ac23-4b2c-87e3-681429c7e52f tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:16:55.747614 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7f6b0e3d-ac23-4b2c-87e3-681429c7e52f tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:16:55.749427 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7f6b0e3d-ac23-4b2c-87e3-681429c7e52f tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:16:55.930302 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-7f6b0e3d-ac23-4b2c-87e3-681429c7e52f tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e4ed23a2bb4537b00b90ec116ea084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9da591f0cc4d60aae0abe808be33a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:16:55.939216 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-7f6b0e3d-ac23-4b2c-87e3-681429c7e52f tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38e4ed23a2bb4537b00b90ec116ea084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9da591f0cc4d60aae0abe808be33a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:16:55.945434 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-7f6b0e3d-ac23-4b2c-87e3-681429c7e52f tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38e4ed23a2bb4537b00b90ec116ea084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9da591f0cc4d60aae0abe808be33a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:16:55.946596 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-7f6b0e3d-ac23-4b2c-87e3-681429c7e52f tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] 10.222.0.18 "GET /compute/v2.1/servers/8ad825e9-f825-4c28-997c-5bb6d6cb405f" status: 200 len: 1365 microversion: 2.57 time: 0.228703 Oct 22 21:16:55.947179 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2509/5004] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:16:55 2022] GET /compute/v2.1/servers/8ad825e9-f825-4c28-997c-5bb6d6cb405f => generated 1365 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:16:56.054318 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-178dd6a9-3bbf-4449-a5e1-3903440730dc tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:16:56.056122 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-178dd6a9-3bbf-4449-a5e1-3903440730dc tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] [instance: dde943e5-12d5-4d2c-859a-1ab238280e4e] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:16:56.068451 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-178dd6a9-3bbf-4449-a5e1-3903440730dc tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:16:56.072052 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-178dd6a9-3bbf-4449-a5e1-3903440730dc tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:16:56.072609 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-178dd6a9-3bbf-4449-a5e1-3903440730dc tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:16:56.073637 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-178dd6a9-3bbf-4449-a5e1-3903440730dc tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:16:56.074441 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-178dd6a9-3bbf-4449-a5e1-3903440730dc tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:16:56.074879 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-178dd6a9-3bbf-4449-a5e1-3903440730dc tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:16:56.933485 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-178dd6a9-3bbf-4449-a5e1-3903440730dc tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '271a94b5c9324dac963afb958f054e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b2530a0555405ab0240fdb0087e6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:16:56.940434 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:SELECT=100 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:16:56.946915 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-178dd6a9-3bbf-4449-a5e1-3903440730dc tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] 10.222.0.18 "GET /compute/v2.1/servers/dde943e5-12d5-4d2c-859a-1ab238280e4e" status: 200 len: 1323 microversion: 2.1 time: 0.897966 Oct 22 21:16:56.965257 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2496/5005] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:16:56 2022] GET /compute/v2.1/servers/dde943e5-12d5-4d2c-859a-1ab238280e4e => generated 1323 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:16:56.974444 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-c35e8065-6a24-4dd7-beed-965aa22bcf2e tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:16:56.976194 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-c35e8065-6a24-4dd7-beed-965aa22bcf2e tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] [instance: 8ad825e9-f825-4c28-997c-5bb6d6cb405f] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:16:56.982088 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell0:SELECT=10 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:16:56.984342 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=12 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:16:56.986474 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c35e8065-6a24-4dd7-beed-965aa22bcf2e tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:16:56.987630 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c35e8065-6a24-4dd7-beed-965aa22bcf2e tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:16:56.988607 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c35e8065-6a24-4dd7-beed-965aa22bcf2e tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:16:56.989723 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c35e8065-6a24-4dd7-beed-965aa22bcf2e tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:16:56.990391 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c35e8065-6a24-4dd7-beed-965aa22bcf2e tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:16:56.991179 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c35e8065-6a24-4dd7-beed-965aa22bcf2e tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:16:57.056141 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:16:57.201146 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-c35e8065-6a24-4dd7-beed-965aa22bcf2e tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e4ed23a2bb4537b00b90ec116ea084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9da591f0cc4d60aae0abe808be33a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:16:57.218107 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-c35e8065-6a24-4dd7-beed-965aa22bcf2e tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38e4ed23a2bb4537b00b90ec116ea084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9da591f0cc4d60aae0abe808be33a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:16:57.219540 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-c35e8065-6a24-4dd7-beed-965aa22bcf2e tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38e4ed23a2bb4537b00b90ec116ea084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9da591f0cc4d60aae0abe808be33a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:16:57.220784 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-c35e8065-6a24-4dd7-beed-965aa22bcf2e tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] 10.222.0.18 "GET /compute/v2.1/servers/8ad825e9-f825-4c28-997c-5bb6d6cb405f" status: 200 len: 1365 microversion: 2.57 time: 0.250586 Oct 22 21:16:57.230596 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2510/5006] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:16:56 2022] GET /compute/v2.1/servers/8ad825e9-f825-4c28-997c-5bb6d6cb405f => generated 1365 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:16:57.453854 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-d7914c0f-69af-4656-8569-72661dd1799b req-4974f2af-7374-4c5b-b6ae-8dd345d29277 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dde943e5-12d5-4d2c-859a-1ab238280e4e", "tag": "d14b66a1-86a2-415c-a4de-a68be3b4318a"}, {"name": "network-changed", "server_uuid": "739c029e-b589-495d-89db-50c7a706b7f7", "tag": "8bf4ea8f-c61d-4368-8ed8-6fea715d71ee"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:16:57.469493 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-d7914c0f-69af-4656-8569-72661dd1799b req-4974f2af-7374-4c5b-b6ae-8dd345d29277 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:16:57.469493 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-d7914c0f-69af-4656-8569-72661dd1799b req-4974f2af-7374-4c5b-b6ae-8dd345d29277 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:16:57.470744 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-d7914c0f-69af-4656-8569-72661dd1799b req-4974f2af-7374-4c5b-b6ae-8dd345d29277 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:16:57.499709 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-d7914c0f-69af-4656-8569-72661dd1799b req-4974f2af-7374-4c5b-b6ae-8dd345d29277 service nova] Creating event network-changed:d14b66a1-86a2-415c-a4de-a68be3b4318a for instance dde943e5-12d5-4d2c-859a-1ab238280e4e on nch2-master-1 Oct 22 21:16:57.500406 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-d7914c0f-69af-4656-8569-72661dd1799b req-4974f2af-7374-4c5b-b6ae-8dd345d29277 service nova] Creating event network-changed:8bf4ea8f-c61d-4368-8ed8-6fea715d71ee for instance 739c029e-b589-495d-89db-50c7a706b7f7 on nch1-master-1 Oct 22 21:16:57.523188 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-d7914c0f-69af-4656-8569-72661dd1799b req-4974f2af-7374-4c5b-b6ae-8dd345d29277 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.072833 Oct 22 21:16:57.524254 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2497/5007] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:16:57 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:16:57.974188 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-3e1e0c8a-2950-4d26-a200-2c6222cbba6d tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:16:57.974582 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-3e1e0c8a-2950-4d26-a200-2c6222cbba6d tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] [instance: dde943e5-12d5-4d2c-859a-1ab238280e4e] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:16:57.982742 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3e1e0c8a-2950-4d26-a200-2c6222cbba6d tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:16:57.983736 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3e1e0c8a-2950-4d26-a200-2c6222cbba6d tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:16:57.985044 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3e1e0c8a-2950-4d26-a200-2c6222cbba6d tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:16:57.986005 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3e1e0c8a-2950-4d26-a200-2c6222cbba6d tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:16:57.986678 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3e1e0c8a-2950-4d26-a200-2c6222cbba6d tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:16:57.987125 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3e1e0c8a-2950-4d26-a200-2c6222cbba6d tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:16:58.254868 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-0238d525-1492-4629-ac30-a3e1085ca356 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:16:58.255596 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-0238d525-1492-4629-ac30-a3e1085ca356 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] [instance: 8ad825e9-f825-4c28-997c-5bb6d6cb405f] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:16:58.261565 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_api:SELECT=43 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:16:58.263488 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0238d525-1492-4629-ac30-a3e1085ca356 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:16:58.264163 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0238d525-1492-4629-ac30-a3e1085ca356 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:16:58.264755 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0238d525-1492-4629-ac30-a3e1085ca356 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:16:58.265617 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0238d525-1492-4629-ac30-a3e1085ca356 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:16:58.266234 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0238d525-1492-4629-ac30-a3e1085ca356 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:16:58.266814 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0238d525-1492-4629-ac30-a3e1085ca356 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:16:58.428886 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-0238d525-1492-4629-ac30-a3e1085ca356 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e4ed23a2bb4537b00b90ec116ea084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9da591f0cc4d60aae0abe808be33a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:16:58.444511 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-0238d525-1492-4629-ac30-a3e1085ca356 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38e4ed23a2bb4537b00b90ec116ea084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9da591f0cc4d60aae0abe808be33a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:16:58.447038 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-0238d525-1492-4629-ac30-a3e1085ca356 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38e4ed23a2bb4537b00b90ec116ea084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9da591f0cc4d60aae0abe808be33a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:16:58.451753 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-3e1e0c8a-2950-4d26-a200-2c6222cbba6d tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '271a94b5c9324dac963afb958f054e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b2530a0555405ab0240fdb0087e6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:16:58.456775 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-0238d525-1492-4629-ac30-a3e1085ca356 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] 10.222.0.18 "GET /compute/v2.1/servers/8ad825e9-f825-4c28-997c-5bb6d6cb405f" status: 200 len: 1365 microversion: 2.57 time: 0.209437 Oct 22 21:16:58.463358 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2498/5008] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:16:58 2022] GET /compute/v2.1/servers/8ad825e9-f825-4c28-997c-5bb6d6cb405f => generated 1365 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:16:58.464144 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-3e1e0c8a-2950-4d26-a200-2c6222cbba6d tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] 10.222.0.18 "GET /compute/v2.1/servers/dde943e5-12d5-4d2c-859a-1ab238280e4e" status: 200 len: 1323 microversion: 2.1 time: 0.492853 Oct 22 21:16:58.465226 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2511/5009] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:16:57 2022] GET /compute/v2.1/servers/dde943e5-12d5-4d2c-859a-1ab238280e4e => generated 1323 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:16:59.492335 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-0189a1e6-ec79-47d6-91dd-e7f26fb02c79 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:16:59.493250 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-0189a1e6-ec79-47d6-91dd-e7f26fb02c79 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] [instance: 8ad825e9-f825-4c28-997c-5bb6d6cb405f] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:16:59.493622 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-d440159a-e06d-4a2b-bbc8-c5949b19c6d7 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:16:59.494714 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-d440159a-e06d-4a2b-bbc8-c5949b19c6d7 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] [instance: dde943e5-12d5-4d2c-859a-1ab238280e4e] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:16:59.504429 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d440159a-e06d-4a2b-bbc8-c5949b19c6d7 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:16:59.504869 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0189a1e6-ec79-47d6-91dd-e7f26fb02c79 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:16:59.505351 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d440159a-e06d-4a2b-bbc8-c5949b19c6d7 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:16:59.505633 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0189a1e6-ec79-47d6-91dd-e7f26fb02c79 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:16:59.506151 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d440159a-e06d-4a2b-bbc8-c5949b19c6d7 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:16:59.506276 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0189a1e6-ec79-47d6-91dd-e7f26fb02c79 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:16:59.507154 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0189a1e6-ec79-47d6-91dd-e7f26fb02c79 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:16:59.507911 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0189a1e6-ec79-47d6-91dd-e7f26fb02c79 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:16:59.508026 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d440159a-e06d-4a2b-bbc8-c5949b19c6d7 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:16:59.508469 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d440159a-e06d-4a2b-bbc8-c5949b19c6d7 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:16:59.509075 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d440159a-e06d-4a2b-bbc8-c5949b19c6d7 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:16:59.509198 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0189a1e6-ec79-47d6-91dd-e7f26fb02c79 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:16:59.670440 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-0189a1e6-ec79-47d6-91dd-e7f26fb02c79 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e4ed23a2bb4537b00b90ec116ea084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9da591f0cc4d60aae0abe808be33a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:16:59.696255 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-0189a1e6-ec79-47d6-91dd-e7f26fb02c79 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38e4ed23a2bb4537b00b90ec116ea084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9da591f0cc4d60aae0abe808be33a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:16:59.697908 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-0189a1e6-ec79-47d6-91dd-e7f26fb02c79 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38e4ed23a2bb4537b00b90ec116ea084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9da591f0cc4d60aae0abe808be33a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:16:59.699151 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-0189a1e6-ec79-47d6-91dd-e7f26fb02c79 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] 10.222.0.18 "GET /compute/v2.1/servers/8ad825e9-f825-4c28-997c-5bb6d6cb405f" status: 200 len: 1365 microversion: 2.57 time: 0.211687 Oct 22 21:16:59.701784 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2512/5010] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:16:59 2022] GET /compute/v2.1/servers/8ad825e9-f825-4c28-997c-5bb6d6cb405f => generated 1365 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:17:00.238191 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-d440159a-e06d-4a2b-bbc8-c5949b19c6d7 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '271a94b5c9324dac963afb958f054e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b2530a0555405ab0240fdb0087e6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:17:00.247984 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-d440159a-e06d-4a2b-bbc8-c5949b19c6d7 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] 10.222.0.18 "GET /compute/v2.1/servers/dde943e5-12d5-4d2c-859a-1ab238280e4e" status: 200 len: 1323 microversion: 2.1 time: 0.763446 Oct 22 21:17:00.269161 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2499/5011] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:16:59 2022] GET /compute/v2.1/servers/dde943e5-12d5-4d2c-859a-1ab238280e4e => generated 1323 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:17:00.728622 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-909d7317-f890-4002-8498-4d5650d410f1 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:17:00.729276 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-909d7317-f890-4002-8498-4d5650d410f1 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] [instance: 8ad825e9-f825-4c28-997c-5bb6d6cb405f] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:17:00.753470 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-909d7317-f890-4002-8498-4d5650d410f1 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:17:00.754177 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-909d7317-f890-4002-8498-4d5650d410f1 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:17:00.754798 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-909d7317-f890-4002-8498-4d5650d410f1 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:17:00.755752 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-909d7317-f890-4002-8498-4d5650d410f1 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:17:00.756383 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-909d7317-f890-4002-8498-4d5650d410f1 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:17:00.756999 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-909d7317-f890-4002-8498-4d5650d410f1 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:17:00.934827 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-909d7317-f890-4002-8498-4d5650d410f1 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e4ed23a2bb4537b00b90ec116ea084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9da591f0cc4d60aae0abe808be33a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:17:00.947632 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-909d7317-f890-4002-8498-4d5650d410f1 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38e4ed23a2bb4537b00b90ec116ea084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9da591f0cc4d60aae0abe808be33a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:17:00.949109 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-909d7317-f890-4002-8498-4d5650d410f1 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38e4ed23a2bb4537b00b90ec116ea084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9da591f0cc4d60aae0abe808be33a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:17:00.957610 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-909d7317-f890-4002-8498-4d5650d410f1 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] 10.222.0.18 "GET /compute/v2.1/servers/8ad825e9-f825-4c28-997c-5bb6d6cb405f" status: 200 len: 1365 microversion: 2.57 time: 0.233374 Oct 22 21:17:00.964469 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2513/5012] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:17:00 2022] GET /compute/v2.1/servers/8ad825e9-f825-4c28-997c-5bb6d6cb405f => generated 1365 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:17:01.288134 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-8233b5e5-889a-42b1-8e34-a3fe509a8a39 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:17:01.290186 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-8233b5e5-889a-42b1-8e34-a3fe509a8a39 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] [instance: dde943e5-12d5-4d2c-859a-1ab238280e4e] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:17:01.300216 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8233b5e5-889a-42b1-8e34-a3fe509a8a39 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:17:01.301440 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8233b5e5-889a-42b1-8e34-a3fe509a8a39 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:17:01.303253 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8233b5e5-889a-42b1-8e34-a3fe509a8a39 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:17:01.304216 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8233b5e5-889a-42b1-8e34-a3fe509a8a39 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:17:01.306248 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8233b5e5-889a-42b1-8e34-a3fe509a8a39 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:17:01.307121 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8233b5e5-889a-42b1-8e34-a3fe509a8a39 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:17:01.523315 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-8233b5e5-889a-42b1-8e34-a3fe509a8a39 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '271a94b5c9324dac963afb958f054e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b2530a0555405ab0240fdb0087e6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:17:01.546700 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-8233b5e5-889a-42b1-8e34-a3fe509a8a39 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] 10.222.0.18 "GET /compute/v2.1/servers/dde943e5-12d5-4d2c-859a-1ab238280e4e" status: 200 len: 1323 microversion: 2.1 time: 0.270278 Oct 22 21:17:01.561594 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2500/5013] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:17:01 2022] GET /compute/v2.1/servers/dde943e5-12d5-4d2c-859a-1ab238280e4e => generated 1323 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:17:01.993771 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-7f72ba02-ff7b-4354-8c4b-e857ea7396f7 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:17:01.995322 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-7f72ba02-ff7b-4354-8c4b-e857ea7396f7 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] [instance: 8ad825e9-f825-4c28-997c-5bb6d6cb405f] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:17:02.003013 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7f72ba02-ff7b-4354-8c4b-e857ea7396f7 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:17:02.003839 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7f72ba02-ff7b-4354-8c4b-e857ea7396f7 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:17:02.004364 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7f72ba02-ff7b-4354-8c4b-e857ea7396f7 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:17:02.005469 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7f72ba02-ff7b-4354-8c4b-e857ea7396f7 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:17:02.006196 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7f72ba02-ff7b-4354-8c4b-e857ea7396f7 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:17:02.006803 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7f72ba02-ff7b-4354-8c4b-e857ea7396f7 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:17:02.093726 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-7f72ba02-ff7b-4354-8c4b-e857ea7396f7 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e4ed23a2bb4537b00b90ec116ea084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9da591f0cc4d60aae0abe808be33a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:17:02.104301 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-7f72ba02-ff7b-4354-8c4b-e857ea7396f7 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38e4ed23a2bb4537b00b90ec116ea084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9da591f0cc4d60aae0abe808be33a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:17:02.106260 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-7f72ba02-ff7b-4354-8c4b-e857ea7396f7 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38e4ed23a2bb4537b00b90ec116ea084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9da591f0cc4d60aae0abe808be33a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:17:02.107769 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-7f72ba02-ff7b-4354-8c4b-e857ea7396f7 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] 10.222.0.18 "GET /compute/v2.1/servers/8ad825e9-f825-4c28-997c-5bb6d6cb405f" status: 200 len: 1371 microversion: 2.57 time: 0.119844 Oct 22 21:17:02.108995 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2514/5014] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:17:01 2022] GET /compute/v2.1/servers/8ad825e9-f825-4c28-997c-5bb6d6cb405f => generated 1371 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:17:02.278988 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-1e83ff89-db7d-472e-a87e-ce3257e65b0e req-efbf148b-c6a3-488b-adc1-080443c8067d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac635cb1-9b28-4ac2-b0da-c27f3a5388a4", "name": "network-vif-plugged", "status": "completed", "tag": "4ffb13fd-86bc-4729-af81-af5f6f60a723"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:17:02.290410 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-1e83ff89-db7d-472e-a87e-ce3257e65b0e req-efbf148b-c6a3-488b-adc1-080443c8067d service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:17:02.291089 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-1e83ff89-db7d-472e-a87e-ce3257e65b0e req-efbf148b-c6a3-488b-adc1-080443c8067d service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:17:02.291522 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-1e83ff89-db7d-472e-a87e-ce3257e65b0e req-efbf148b-c6a3-488b-adc1-080443c8067d service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:17:02.307237 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-1e83ff89-db7d-472e-a87e-ce3257e65b0e req-efbf148b-c6a3-488b-adc1-080443c8067d service nova] Creating event network-vif-plugged:4ffb13fd-86bc-4729-af81-af5f6f60a723 for instance ac635cb1-9b28-4ac2-b0da-c27f3a5388a4 on nch2-master-1 Oct 22 21:17:02.312484 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-1e83ff89-db7d-472e-a87e-ce3257e65b0e req-efbf148b-c6a3-488b-adc1-080443c8067d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037730 Oct 22 21:17:02.313088 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2501/5015] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:17:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 21:17:02.573439 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-8d2390df-49d8-444e-95fc-aa41191e7761 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:17:02.574693 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-8d2390df-49d8-444e-95fc-aa41191e7761 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] [instance: dde943e5-12d5-4d2c-859a-1ab238280e4e] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:17:02.581457 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8d2390df-49d8-444e-95fc-aa41191e7761 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:17:02.582224 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8d2390df-49d8-444e-95fc-aa41191e7761 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:17:02.582709 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8d2390df-49d8-444e-95fc-aa41191e7761 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:17:02.583473 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8d2390df-49d8-444e-95fc-aa41191e7761 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:17:02.583946 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8d2390df-49d8-444e-95fc-aa41191e7761 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:17:02.584417 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8d2390df-49d8-444e-95fc-aa41191e7761 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:17:03.135007 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-7078420f-ba96-41f9-8f10-6ae1165ba520 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:17:03.136114 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-7078420f-ba96-41f9-8f10-6ae1165ba520 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] [instance: 8ad825e9-f825-4c28-997c-5bb6d6cb405f] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:17:03.143487 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7078420f-ba96-41f9-8f10-6ae1165ba520 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:17:03.144350 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7078420f-ba96-41f9-8f10-6ae1165ba520 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:17:03.145017 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7078420f-ba96-41f9-8f10-6ae1165ba520 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:17:03.146143 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7078420f-ba96-41f9-8f10-6ae1165ba520 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:17:03.146779 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7078420f-ba96-41f9-8f10-6ae1165ba520 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:17:03.148593 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7078420f-ba96-41f9-8f10-6ae1165ba520 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:17:03.303464 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-8d2390df-49d8-444e-95fc-aa41191e7761 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '271a94b5c9324dac963afb958f054e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b2530a0555405ab0240fdb0087e6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:17:03.312547 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-8d2390df-49d8-444e-95fc-aa41191e7761 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] 10.222.0.18 "GET /compute/v2.1/servers/dde943e5-12d5-4d2c-859a-1ab238280e4e" status: 200 len: 1323 microversion: 2.1 time: 0.743442 Oct 22 21:17:03.313323 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2515/5016] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:17:02 2022] GET /compute/v2.1/servers/dde943e5-12d5-4d2c-859a-1ab238280e4e => generated 1323 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:17:03.317537 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-7078420f-ba96-41f9-8f10-6ae1165ba520 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e4ed23a2bb4537b00b90ec116ea084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9da591f0cc4d60aae0abe808be33a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:17:03.327594 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-7078420f-ba96-41f9-8f10-6ae1165ba520 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38e4ed23a2bb4537b00b90ec116ea084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9da591f0cc4d60aae0abe808be33a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:17:03.330261 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-7078420f-ba96-41f9-8f10-6ae1165ba520 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38e4ed23a2bb4537b00b90ec116ea084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9da591f0cc4d60aae0abe808be33a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:17:03.331841 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-7078420f-ba96-41f9-8f10-6ae1165ba520 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] 10.222.0.18 "GET /compute/v2.1/servers/8ad825e9-f825-4c28-997c-5bb6d6cb405f" status: 200 len: 1371 microversion: 2.57 time: 0.201223 Oct 22 21:17:03.332550 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2502/5017] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:17:03 2022] GET /compute/v2.1/servers/8ad825e9-f825-4c28-997c-5bb6d6cb405f => generated 1371 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:17:04.336455 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-5f4bc8ea-656c-4a78-85c1-b3388856652d tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:17:04.337917 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-5f4bc8ea-656c-4a78-85c1-b3388856652d tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] [instance: dde943e5-12d5-4d2c-859a-1ab238280e4e] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:17:04.348725 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-44ea1ce1-1e9a-46a6-a23f-261719b545a2 req-37ec7570-82e9-4da5-80bf-6edaeaf9bf6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "739c029e-b589-495d-89db-50c7a706b7f7", "name": "network-vif-plugged", "status": "completed", "tag": "8bf4ea8f-c61d-4368-8ed8-6fea715d71ee"}, {"server_uuid": "dde943e5-12d5-4d2c-859a-1ab238280e4e", "name": "network-vif-plugged", "status": "completed", "tag": "d14b66a1-86a2-415c-a4de-a68be3b4318a"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:17:04.359314 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5f4bc8ea-656c-4a78-85c1-b3388856652d tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:17:04.366644 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5f4bc8ea-656c-4a78-85c1-b3388856652d tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:17:04.367932 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5f4bc8ea-656c-4a78-85c1-b3388856652d tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:17:04.368445 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-44ea1ce1-1e9a-46a6-a23f-261719b545a2 req-37ec7570-82e9-4da5-80bf-6edaeaf9bf6b service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:17:04.369120 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-44ea1ce1-1e9a-46a6-a23f-261719b545a2 req-37ec7570-82e9-4da5-80bf-6edaeaf9bf6b service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:17:04.369731 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-44ea1ce1-1e9a-46a6-a23f-261719b545a2 req-37ec7570-82e9-4da5-80bf-6edaeaf9bf6b service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:17:04.370967 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5f4bc8ea-656c-4a78-85c1-b3388856652d tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:17:04.373526 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5f4bc8ea-656c-4a78-85c1-b3388856652d tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:17:04.374447 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5f4bc8ea-656c-4a78-85c1-b3388856652d tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:17:04.384663 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-44ea1ce1-1e9a-46a6-a23f-261719b545a2 req-37ec7570-82e9-4da5-80bf-6edaeaf9bf6b service nova] Creating event network-vif-plugged:8bf4ea8f-c61d-4368-8ed8-6fea715d71ee for instance 739c029e-b589-495d-89db-50c7a706b7f7 on nch1-master-1 Oct 22 21:17:04.385531 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-44ea1ce1-1e9a-46a6-a23f-261719b545a2 req-37ec7570-82e9-4da5-80bf-6edaeaf9bf6b service nova] Creating event network-vif-plugged:d14b66a1-86a2-415c-a4de-a68be3b4318a for instance dde943e5-12d5-4d2c-859a-1ab238280e4e on nch2-master-1 Oct 22 21:17:04.396829 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-44ea1ce1-1e9a-46a6-a23f-261719b545a2 req-37ec7570-82e9-4da5-80bf-6edaeaf9bf6b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.052291 Oct 22 21:17:04.398206 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2503/5018] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:17:04 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:17:04.413798 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-51d37d3a-8b0b-461b-bf3d-2bc7ff803511 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:17:04.414527 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-51d37d3a-8b0b-461b-bf3d-2bc7ff803511 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] [instance: 8ad825e9-f825-4c28-997c-5bb6d6cb405f] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:17:04.422784 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-51d37d3a-8b0b-461b-bf3d-2bc7ff803511 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:17:04.423855 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-51d37d3a-8b0b-461b-bf3d-2bc7ff803511 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:17:04.424453 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-51d37d3a-8b0b-461b-bf3d-2bc7ff803511 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:17:04.425550 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-51d37d3a-8b0b-461b-bf3d-2bc7ff803511 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:17:04.427403 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-51d37d3a-8b0b-461b-bf3d-2bc7ff803511 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:17:04.428071 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-51d37d3a-8b0b-461b-bf3d-2bc7ff803511 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:17:04.618161 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-51d37d3a-8b0b-461b-bf3d-2bc7ff803511 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e4ed23a2bb4537b00b90ec116ea084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9da591f0cc4d60aae0abe808be33a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:17:04.651262 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-51d37d3a-8b0b-461b-bf3d-2bc7ff803511 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38e4ed23a2bb4537b00b90ec116ea084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9da591f0cc4d60aae0abe808be33a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:17:04.655888 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-51d37d3a-8b0b-461b-bf3d-2bc7ff803511 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38e4ed23a2bb4537b00b90ec116ea084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9da591f0cc4d60aae0abe808be33a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:17:04.659784 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-51d37d3a-8b0b-461b-bf3d-2bc7ff803511 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] 10.222.0.18 "GET /compute/v2.1/servers/8ad825e9-f825-4c28-997c-5bb6d6cb405f" status: 200 len: 1371 microversion: 2.57 time: 0.259276 Oct 22 21:17:04.661121 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2504/5019] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:17:04 2022] GET /compute/v2.1/servers/8ad825e9-f825-4c28-997c-5bb6d6cb405f => generated 1371 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:17:04.813756 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-5f4bc8ea-656c-4a78-85c1-b3388856652d tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '271a94b5c9324dac963afb958f054e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b2530a0555405ab0240fdb0087e6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:17:04.830507 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-5f4bc8ea-656c-4a78-85c1-b3388856652d tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] 10.222.0.18 "GET /compute/v2.1/servers/dde943e5-12d5-4d2c-859a-1ab238280e4e" status: 200 len: 1323 microversion: 2.1 time: 0.497879 Oct 22 21:17:04.833652 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2516/5020] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:17:04 2022] GET /compute/v2.1/servers/dde943e5-12d5-4d2c-859a-1ab238280e4e => generated 1323 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:17:05.714588 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-a68f184f-3093-49ed-a6ee-421275d808c3 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:17:05.715209 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-a68f184f-3093-49ed-a6ee-421275d808c3 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] [instance: 8ad825e9-f825-4c28-997c-5bb6d6cb405f] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:17:05.735691 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a68f184f-3093-49ed-a6ee-421275d808c3 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:17:05.736057 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a68f184f-3093-49ed-a6ee-421275d808c3 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:17:05.736498 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a68f184f-3093-49ed-a6ee-421275d808c3 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:17:05.737238 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a68f184f-3093-49ed-a6ee-421275d808c3 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:17:05.739857 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a68f184f-3093-49ed-a6ee-421275d808c3 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:17:05.740466 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a68f184f-3093-49ed-a6ee-421275d808c3 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:17:05.838160 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-a68f184f-3093-49ed-a6ee-421275d808c3 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e4ed23a2bb4537b00b90ec116ea084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9da591f0cc4d60aae0abe808be33a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:17:05.851958 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-a68f184f-3093-49ed-a6ee-421275d808c3 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38e4ed23a2bb4537b00b90ec116ea084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9da591f0cc4d60aae0abe808be33a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:17:05.854536 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-a68f184f-3093-49ed-a6ee-421275d808c3 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38e4ed23a2bb4537b00b90ec116ea084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9da591f0cc4d60aae0abe808be33a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:17:05.857295 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-7ea7a23c-77a1-4c3d-ad6c-ca2a311dc58e tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:17:05.858101 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-a68f184f-3093-49ed-a6ee-421275d808c3 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] 10.222.0.18 "GET /compute/v2.1/servers/8ad825e9-f825-4c28-997c-5bb6d6cb405f" status: 200 len: 1356 microversion: 2.57 time: 0.147651 Oct 22 21:17:05.859853 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-7ea7a23c-77a1-4c3d-ad6c-ca2a311dc58e tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] [instance: dde943e5-12d5-4d2c-859a-1ab238280e4e] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:17:05.878905 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7ea7a23c-77a1-4c3d-ad6c-ca2a311dc58e tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:17:05.880017 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7ea7a23c-77a1-4c3d-ad6c-ca2a311dc58e tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:17:05.881407 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7ea7a23c-77a1-4c3d-ad6c-ca2a311dc58e tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:17:05.887877 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2505/5021] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:17:05 2022] GET /compute/v2.1/servers/8ad825e9-f825-4c28-997c-5bb6d6cb405f => generated 1356 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:17:05.891794 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7ea7a23c-77a1-4c3d-ad6c-ca2a311dc58e tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:17:05.894105 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7ea7a23c-77a1-4c3d-ad6c-ca2a311dc58e tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:17:05.898051 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-7a6a8d75-693f-459b-b095-17b98f9dd519 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:17:05.898568 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-7a6a8d75-693f-459b-b095-17b98f9dd519 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] [instance: 8ad825e9-f825-4c28-997c-5bb6d6cb405f] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:17:05.904100 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7ea7a23c-77a1-4c3d-ad6c-ca2a311dc58e tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:17:05.927892 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7a6a8d75-693f-459b-b095-17b98f9dd519 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:17:05.928622 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7a6a8d75-693f-459b-b095-17b98f9dd519 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:17:05.929215 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7a6a8d75-693f-459b-b095-17b98f9dd519 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:17:05.930091 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7a6a8d75-693f-459b-b095-17b98f9dd519 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:17:05.930697 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7a6a8d75-693f-459b-b095-17b98f9dd519 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:17:05.931277 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7a6a8d75-693f-459b-b095-17b98f9dd519 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:17:05.973195 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-7a6a8d75-693f-459b-b095-17b98f9dd519 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] [instance: 8ad825e9-f825-4c28-997c-5bb6d6cb405f] Going to try to terminate instance {{(pid=138744) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 21:17:06.178480 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-7a6a8d75-693f-459b-b095-17b98f9dd519 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] 10.222.0.18 "DELETE /compute/v2.1/servers/8ad825e9-f825-4c28-997c-5bb6d6cb405f" status: 204 len: 0 microversion: 2.57 time: 0.286755 Oct 22 21:17:06.185952 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-7ea7a23c-77a1-4c3d-ad6c-ca2a311dc58e tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '271a94b5c9324dac963afb958f054e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b2530a0555405ab0240fdb0087e6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:17:06.189078 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2506/5022] 10.222.0.18 () {60 vars in 1280 bytes} [Sat Oct 22 21:17:05 2022] DELETE /compute/v2.1/servers/8ad825e9-f825-4c28-997c-5bb6d6cb405f => generated 0 bytes in 289 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 22 21:17:06.202937 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-7ea7a23c-77a1-4c3d-ad6c-ca2a311dc58e tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] 10.222.0.18 "GET /compute/v2.1/servers/dde943e5-12d5-4d2c-859a-1ab238280e4e" status: 200 len: 1323 microversion: 2.1 time: 0.351007 Oct 22 21:17:06.205581 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-7301636b-754f-4ba8-bf16-7ff70a71c533 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:17:06.207184 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2517/5023] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:17:05 2022] GET /compute/v2.1/servers/dde943e5-12d5-4d2c-859a-1ab238280e4e => generated 1323 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:17:06.208189 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-7301636b-754f-4ba8-bf16-7ff70a71c533 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] [instance: 8ad825e9-f825-4c28-997c-5bb6d6cb405f] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:17:06.217050 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7301636b-754f-4ba8-bf16-7ff70a71c533 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:17:06.217797 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7301636b-754f-4ba8-bf16-7ff70a71c533 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:17:06.219226 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7301636b-754f-4ba8-bf16-7ff70a71c533 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:17:06.220246 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7301636b-754f-4ba8-bf16-7ff70a71c533 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:17:06.220786 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7301636b-754f-4ba8-bf16-7ff70a71c533 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:17:06.221292 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7301636b-754f-4ba8-bf16-7ff70a71c533 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:17:06.353105 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-7301636b-754f-4ba8-bf16-7ff70a71c533 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e4ed23a2bb4537b00b90ec116ea084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9da591f0cc4d60aae0abe808be33a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:17:06.362519 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-7301636b-754f-4ba8-bf16-7ff70a71c533 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38e4ed23a2bb4537b00b90ec116ea084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9da591f0cc4d60aae0abe808be33a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:17:06.364351 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-7301636b-754f-4ba8-bf16-7ff70a71c533 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38e4ed23a2bb4537b00b90ec116ea084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9da591f0cc4d60aae0abe808be33a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:17:06.365811 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-7301636b-754f-4ba8-bf16-7ff70a71c533 tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] 10.222.0.18 "GET /compute/v2.1/servers/8ad825e9-f825-4c28-997c-5bb6d6cb405f" status: 200 len: 1362 microversion: 2.57 time: 0.175252 Oct 22 21:17:06.367101 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2507/5024] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:17:06 2022] GET /compute/v2.1/servers/8ad825e9-f825-4c28-997c-5bb6d6cb405f => generated 1362 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:17:07.235027 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-13a09af2-c60f-4b84-8850-c7809d2dd458 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:17:07.235723 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-13a09af2-c60f-4b84-8850-c7809d2dd458 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] [instance: dde943e5-12d5-4d2c-859a-1ab238280e4e] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:17:07.249525 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-13a09af2-c60f-4b84-8850-c7809d2dd458 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:17:07.250193 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-13a09af2-c60f-4b84-8850-c7809d2dd458 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:17:07.250835 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-13a09af2-c60f-4b84-8850-c7809d2dd458 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:17:07.251593 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-13a09af2-c60f-4b84-8850-c7809d2dd458 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:17:07.252277 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-13a09af2-c60f-4b84-8850-c7809d2dd458 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:17:07.252932 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-13a09af2-c60f-4b84-8850-c7809d2dd458 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:17:07.394272 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-8e52e6fa-e8fc-4a61-b1b8-501c00a7681a tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:17:07.395602 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-8e52e6fa-e8fc-4a61-b1b8-501c00a7681a tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] [instance: 8ad825e9-f825-4c28-997c-5bb6d6cb405f] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:17:07.403501 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8e52e6fa-e8fc-4a61-b1b8-501c00a7681a tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:17:07.404254 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8e52e6fa-e8fc-4a61-b1b8-501c00a7681a tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:17:07.404866 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8e52e6fa-e8fc-4a61-b1b8-501c00a7681a tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:17:07.405756 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8e52e6fa-e8fc-4a61-b1b8-501c00a7681a tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:17:07.406370 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8e52e6fa-e8fc-4a61-b1b8-501c00a7681a tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:17:07.406970 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8e52e6fa-e8fc-4a61-b1b8-501c00a7681a tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:17:07.438199 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-13a09af2-c60f-4b84-8850-c7809d2dd458 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '271a94b5c9324dac963afb958f054e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b2530a0555405ab0240fdb0087e6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:17:07.455856 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-13a09af2-c60f-4b84-8850-c7809d2dd458 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] 10.222.0.18 "GET /compute/v2.1/servers/dde943e5-12d5-4d2c-859a-1ab238280e4e" status: 200 len: 1516 microversion: 2.1 time: 0.225149 Oct 22 21:17:07.472221 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2518/5025] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:17:07 2022] GET /compute/v2.1/servers/dde943e5-12d5-4d2c-859a-1ab238280e4e => generated 1516 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:17:07.480764 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-1f570044-358d-45d9-8506-3f361fb29f2b tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:17:07.481546 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-1f570044-358d-45d9-8506-3f361fb29f2b tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] [instance: 739c029e-b589-495d-89db-50c7a706b7f7] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:17:07.488864 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1f570044-358d-45d9-8506-3f361fb29f2b tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:17:07.489767 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1f570044-358d-45d9-8506-3f361fb29f2b tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:17:07.490443 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1f570044-358d-45d9-8506-3f361fb29f2b tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:17:07.491461 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1f570044-358d-45d9-8506-3f361fb29f2b tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:17:07.492550 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1f570044-358d-45d9-8506-3f361fb29f2b tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:17:07.493271 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1f570044-358d-45d9-8506-3f361fb29f2b tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:17:07.505139 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-8e52e6fa-e8fc-4a61-b1b8-501c00a7681a tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e4ed23a2bb4537b00b90ec116ea084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9da591f0cc4d60aae0abe808be33a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:17:07.515464 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-8e52e6fa-e8fc-4a61-b1b8-501c00a7681a tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38e4ed23a2bb4537b00b90ec116ea084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9da591f0cc4d60aae0abe808be33a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:17:07.517161 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-8e52e6fa-e8fc-4a61-b1b8-501c00a7681a tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38e4ed23a2bb4537b00b90ec116ea084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9da591f0cc4d60aae0abe808be33a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:17:07.519468 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-8e52e6fa-e8fc-4a61-b1b8-501c00a7681a tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] 10.222.0.18 "GET /compute/v2.1/servers/8ad825e9-f825-4c28-997c-5bb6d6cb405f" status: 200 len: 1362 microversion: 2.57 time: 0.129493 Oct 22 21:17:07.520528 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2508/5026] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:17:07 2022] GET /compute/v2.1/servers/8ad825e9-f825-4c28-997c-5bb6d6cb405f => generated 1362 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:17:07.798516 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-1f570044-358d-45d9-8506-3f361fb29f2b tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '271a94b5c9324dac963afb958f054e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b2530a0555405ab0240fdb0087e6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:17:07.810592 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-1f570044-358d-45d9-8506-3f361fb29f2b tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] 10.222.0.18 "GET /compute/v2.1/servers/739c029e-b589-495d-89db-50c7a706b7f7" status: 200 len: 1516 microversion: 2.1 time: 0.333075 Oct 22 21:17:07.811526 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2519/5027] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:17:07 2022] GET /compute/v2.1/servers/739c029e-b589-495d-89db-50c7a706b7f7 => generated 1516 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:17:07.835399 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-a289c198-ae86-4ce0-94f6-cdc27632ed2b tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:17:07.836518 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-a289c198-ae86-4ce0-94f6-cdc27632ed2b tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] [instance: ac635cb1-9b28-4ac2-b0da-c27f3a5388a4] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:17:07.843483 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a289c198-ae86-4ce0-94f6-cdc27632ed2b tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:17:07.844517 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a289c198-ae86-4ce0-94f6-cdc27632ed2b tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:17:07.845067 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a289c198-ae86-4ce0-94f6-cdc27632ed2b tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:17:07.846054 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a289c198-ae86-4ce0-94f6-cdc27632ed2b tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:17:07.846848 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a289c198-ae86-4ce0-94f6-cdc27632ed2b tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:17:07.847621 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a289c198-ae86-4ce0-94f6-cdc27632ed2b tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:17:08.132287 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-a289c198-ae86-4ce0-94f6-cdc27632ed2b tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '271a94b5c9324dac963afb958f054e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b2530a0555405ab0240fdb0087e6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:17:08.143214 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-a289c198-ae86-4ce0-94f6-cdc27632ed2b tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] 10.222.0.18 "GET /compute/v2.1/servers/ac635cb1-9b28-4ac2-b0da-c27f3a5388a4" status: 200 len: 1517 microversion: 2.1 time: 0.311822 Oct 22 21:17:08.156162 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2509/5028] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:17:07 2022] GET /compute/v2.1/servers/ac635cb1-9b28-4ac2-b0da-c27f3a5388a4 => generated 1517 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:17:08.174388 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-ac066b93-b264-4ac7-af83-e1a4fe320e83 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:17:08.175512 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-ac066b93-b264-4ac7-af83-e1a4fe320e83 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] [instance: ac635cb1-9b28-4ac2-b0da-c27f3a5388a4] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:17:08.187675 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ac066b93-b264-4ac7-af83-e1a4fe320e83 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:17:08.188767 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ac066b93-b264-4ac7-af83-e1a4fe320e83 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:17:08.189534 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ac066b93-b264-4ac7-af83-e1a4fe320e83 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:17:08.190541 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ac066b93-b264-4ac7-af83-e1a4fe320e83 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:17:08.191216 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ac066b93-b264-4ac7-af83-e1a4fe320e83 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:17:08.192023 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ac066b93-b264-4ac7-af83-e1a4fe320e83 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:17:08.268863 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-ac066b93-b264-4ac7-af83-e1a4fe320e83 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] [instance: ac635cb1-9b28-4ac2-b0da-c27f3a5388a4] Going to try to terminate instance {{(pid=138745) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 21:17:08.372890 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-ac066b93-b264-4ac7-af83-e1a4fe320e83 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] 10.222.0.18 "DELETE /compute/v2.1/servers/ac635cb1-9b28-4ac2-b0da-c27f3a5388a4" status: 204 len: 0 microversion: 2.1 time: 0.203382 Oct 22 21:17:08.374107 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2520/5029] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 21:17:08 2022] DELETE /compute/v2.1/servers/ac635cb1-9b28-4ac2-b0da-c27f3a5388a4 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 21:17:08.383948 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-07ee12c3-bd40-4ec2-a221-6eeef29f1fa6 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:17:08.384582 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-07ee12c3-bd40-4ec2-a221-6eeef29f1fa6 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] [instance: ac635cb1-9b28-4ac2-b0da-c27f3a5388a4] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:17:08.391147 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-07ee12c3-bd40-4ec2-a221-6eeef29f1fa6 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:17:08.391697 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-07ee12c3-bd40-4ec2-a221-6eeef29f1fa6 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:17:08.392156 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-07ee12c3-bd40-4ec2-a221-6eeef29f1fa6 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:17:08.392865 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-07ee12c3-bd40-4ec2-a221-6eeef29f1fa6 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:17:08.393635 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-07ee12c3-bd40-4ec2-a221-6eeef29f1fa6 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:17:08.394314 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-07ee12c3-bd40-4ec2-a221-6eeef29f1fa6 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:17:08.547738 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-5460dfb5-09db-4869-8b69-46aa525f837d tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:17:08.549003 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-5460dfb5-09db-4869-8b69-46aa525f837d tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] [instance: 8ad825e9-f825-4c28-997c-5bb6d6cb405f] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:17:08.557445 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5460dfb5-09db-4869-8b69-46aa525f837d tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:17:08.558473 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5460dfb5-09db-4869-8b69-46aa525f837d tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:17:08.561044 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5460dfb5-09db-4869-8b69-46aa525f837d tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:17:08.562127 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5460dfb5-09db-4869-8b69-46aa525f837d tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:17:08.562831 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5460dfb5-09db-4869-8b69-46aa525f837d tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:17:08.563525 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5460dfb5-09db-4869-8b69-46aa525f837d tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:17:08.611802 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5460dfb5-09db-4869-8b69-46aa525f837d tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:17:08.613774 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5460dfb5-09db-4869-8b69-46aa525f837d tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:17:08.614493 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5460dfb5-09db-4869-8b69-46aa525f837d tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:17:08.615054 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.objects.instance [None req-5460dfb5-09db-4869-8b69-46aa525f837d tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Lazy-loading 'fault' on Instance uuid 8ad825e9-f825-4c28-997c-5bb6d6cb405f {{(pid=138745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 21:17:08.915080 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-5460dfb5-09db-4869-8b69-46aa525f837d tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e4ed23a2bb4537b00b90ec116ea084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9da591f0cc4d60aae0abe808be33a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:17:08.927118 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-5460dfb5-09db-4869-8b69-46aa525f837d tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38e4ed23a2bb4537b00b90ec116ea084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9da591f0cc4d60aae0abe808be33a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:17:08.929083 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-5460dfb5-09db-4869-8b69-46aa525f837d tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38e4ed23a2bb4537b00b90ec116ea084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9da591f0cc4d60aae0abe808be33a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:17:08.930338 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-5460dfb5-09db-4869-8b69-46aa525f837d tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] 10.222.0.18 "GET /compute/v2.1/servers/8ad825e9-f825-4c28-997c-5bb6d6cb405f" status: 200 len: 1367 microversion: 2.57 time: 0.387796 Oct 22 21:17:08.931096 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2521/5030] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:17:08 2022] GET /compute/v2.1/servers/8ad825e9-f825-4c28-997c-5bb6d6cb405f => generated 1367 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 22 21:17:09.005186 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-07ee12c3-bd40-4ec2-a221-6eeef29f1fa6 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '271a94b5c9324dac963afb958f054e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b2530a0555405ab0240fdb0087e6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:17:09.016842 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-07ee12c3-bd40-4ec2-a221-6eeef29f1fa6 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] 10.222.0.18 "GET /compute/v2.1/servers/ac635cb1-9b28-4ac2-b0da-c27f3a5388a4" status: 200 len: 1523 microversion: 2.1 time: 0.638426 Oct 22 21:17:09.017828 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2510/5031] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:17:08 2022] GET /compute/v2.1/servers/ac635cb1-9b28-4ac2-b0da-c27f3a5388a4 => generated 1523 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:17:09.957938 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-dc367cfd-128a-4740-b98d-23f4a313156e tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:17:09.959296 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-dc367cfd-128a-4740-b98d-23f4a313156e tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] [instance: 8ad825e9-f825-4c28-997c-5bb6d6cb405f] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:17:09.965747 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-dc367cfd-128a-4740-b98d-23f4a313156e tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:17:09.966457 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-dc367cfd-128a-4740-b98d-23f4a313156e tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:17:09.969288 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-dc367cfd-128a-4740-b98d-23f4a313156e tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:17:09.970195 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-dc367cfd-128a-4740-b98d-23f4a313156e tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:17:09.970827 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-dc367cfd-128a-4740-b98d-23f4a313156e tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:17:09.971504 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-dc367cfd-128a-4740-b98d-23f4a313156e tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:17:09.995590 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.wsgi [None req-dc367cfd-128a-4740-b98d-23f4a313156e tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] HTTP exception thrown: Instance 8ad825e9-f825-4c28-997c-5bb6d6cb405f could not be found. Oct 22 21:17:09.997580 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-dc367cfd-128a-4740-b98d-23f4a313156e tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Request method failure captured: Oct 22 21:17:09.997580 ncdv-master-1 devstack@n-api.service[138745]: request: GET /compute/v2.1/servers/8ad825e9-f825-4c28-997c-5bb6d6cb405f HTTP/1.1 Oct 22 21:17:09.997580 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 21:17:09.997580 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 21:17:09.997580 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 21:17:09.997580 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 0 Oct 22 21:17:09.997580 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 21:17:09.997580 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 21:17:09.997580 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 21:17:09.997580 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 21:17:09.997580 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVF2pZqevvSFgw45Mr_o9ztVE3bWYF-EBolQmpiWh-mEmK6AvmlvjxcMXvTa1ZDPSE5j_vnAHesYS3RAfzFqaUL3YiNhwCuXDOcipom53xaUR_MbixtXWCn6YAHZBWEw4wDS3-vICyNeEHjPnZ17DI2B_cXX9rSAMITjn33W4mLhpEnw Oct 22 21:17:09.997580 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 21:17:09.997580 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 21:17:09.997580 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 21:17:09.997580 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 21:17:09.997580 ncdv-master-1 devstack@n-api.service[138745]: X-Openstack-Nova-Api-Version: 2.57 Oct 22 21:17:09.997580 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 21:17:09.997580 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 21:17:09.997580 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: 9e9da591f0cc4d60aae0abe808be33a8 Oct 22 21:17:09.997580 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-ServerShowV257Test-411148361 Oct 22 21:17:09.997580 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 21:17:09.997580 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 21:17:09.997580 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_9e9da591f0cc4d60aae0abe808be33a8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9e9da591f0cc4d60aae0abe808be33a8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/9e9da591f0cc4d60aae0abe808be33a8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9e9da591f0cc4d60aae0abe808be33a8"}]}] Oct 22 21:17:09.997580 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-ServerShowV257Test-411148361 Oct 22 21:17:09.997580 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: 9e9da591f0cc4d60aae0abe808be33a8 Oct 22 21:17:09.997580 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-ServerShowV257Test-411148361 Oct 22 21:17:09.997580 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-ServerShowV257Test-411148361-project Oct 22 21:17:09.997580 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 21:17:09.997580 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 21:17:09.997580 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: 38e4ed23a2bb4537b00b90ec116ea084 Oct 22 21:17:09.997580 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-ServerShowV257Test-411148361-project Oct 22 21:17:09.997580 ncdv-master-1 devstack@n-api.service[138745]: method: > Oct 22 21:17:09.997580 ncdv-master-1 devstack@n-api.service[138745]: exception: Instance 8ad825e9-f825-4c28-997c-5bb6d6cb405f could not be found. Oct 22 21:17:09.997580 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'id': '8ad825e9-f825-4c28-997c-5bb6d6cb405f'} Oct 22 21:17:09.997580 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:17:09.997580 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:17:09.997580 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 21:17:09.997580 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 21:17:09.997580 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 21:17:09.997580 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 21:17:09.997580 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 21:17:09.997580 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 21:17:09.997580 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 21:17:09.997580 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 21:17:09.997580 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ad825e9-f825-4c28-997c-5bb6d6cb405f could not be found. Oct 22 21:17:09.997580 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:17:09.997580 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:17:09.997580 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:17:09.997580 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:17:09.997580 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:17:09.997580 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:17:09.997580 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:17:09.997580 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:17:09.997580 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:17:09.997580 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:17:09.997580 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 21:17:09.997580 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 21:17:09.997580 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 21:17:09.997580 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 21:17:09.997580 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 21:17:09.997580 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:17:09.997580 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ad825e9-f825-4c28-997c-5bb6d6cb405f could not be found. Oct 22 21:17:09.997580 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:17:09.997580 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:17:09.997580 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:17:10.002279 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:17:10.002279 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:17:10.002279 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:17:10.002279 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:17:10.002279 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:17:10.002279 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ad825e9-f825-4c28-997c-5bb6d6cb405f could not be found. Oct 22 21:17:10.002279 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:17:10.003669 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-dc367cfd-128a-4740-b98d-23f4a313156e tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] Returning 404 to user: Instance 8ad825e9-f825-4c28-997c-5bb6d6cb405f could not be found. {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:17:10.004769 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-dc367cfd-128a-4740-b98d-23f4a313156e tempest-ServerShowV257Test-411148361 tempest-ServerShowV257Test-411148361-project] 10.222.0.18 "GET /compute/v2.1/servers/8ad825e9-f825-4c28-997c-5bb6d6cb405f" status: 404 len: 111 microversion: 2.57 time: 0.052222 Oct 22 21:17:10.005838 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2522/5032] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:17:09 2022] GET /compute/v2.1/servers/8ad825e9-f825-4c28-997c-5bb6d6cb405f => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 22 21:17:10.043106 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-f81a19fb-1929-4f84-aee5-b45376627756 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:17:10.044287 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-f81a19fb-1929-4f84-aee5-b45376627756 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] [instance: ac635cb1-9b28-4ac2-b0da-c27f3a5388a4] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:17:10.059081 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f81a19fb-1929-4f84-aee5-b45376627756 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:17:10.059905 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f81a19fb-1929-4f84-aee5-b45376627756 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:17:10.062127 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f81a19fb-1929-4f84-aee5-b45376627756 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:17:10.063487 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f81a19fb-1929-4f84-aee5-b45376627756 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:17:10.065588 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f81a19fb-1929-4f84-aee5-b45376627756 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:17:10.066225 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f81a19fb-1929-4f84-aee5-b45376627756 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:17:10.445789 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-f81a19fb-1929-4f84-aee5-b45376627756 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '271a94b5c9324dac963afb958f054e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b2530a0555405ab0240fdb0087e6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:17:10.457124 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-f81a19fb-1929-4f84-aee5-b45376627756 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] 10.222.0.18 "GET /compute/v2.1/servers/ac635cb1-9b28-4ac2-b0da-c27f3a5388a4" status: 200 len: 1523 microversion: 2.1 time: 0.418119 Oct 22 21:17:10.458207 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2511/5033] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:17:10 2022] GET /compute/v2.1/servers/ac635cb1-9b28-4ac2-b0da-c27f3a5388a4 => generated 1523 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:17:10.921156 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-6fb732a0-fbf8-41bb-947c-e4f761385137 req-90aafccd-723a-4a61-9292-8249b5016741 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac635cb1-9b28-4ac2-b0da-c27f3a5388a4", "name": "network-vif-deleted", "tag": "4ffb13fd-86bc-4729-af81-af5f6f60a723"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:17:10.969485 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-6fb732a0-fbf8-41bb-947c-e4f761385137 req-90aafccd-723a-4a61-9292-8249b5016741 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:17:10.970477 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-6fb732a0-fbf8-41bb-947c-e4f761385137 req-90aafccd-723a-4a61-9292-8249b5016741 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:17:10.973896 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-6fb732a0-fbf8-41bb-947c-e4f761385137 req-90aafccd-723a-4a61-9292-8249b5016741 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:17:10.996087 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-6fb732a0-fbf8-41bb-947c-e4f761385137 req-90aafccd-723a-4a61-9292-8249b5016741 service nova] Creating event network-vif-deleted:4ffb13fd-86bc-4729-af81-af5f6f60a723 for instance ac635cb1-9b28-4ac2-b0da-c27f3a5388a4 on nch2-master-1 Oct 22 21:17:11.004511 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-6fb732a0-fbf8-41bb-947c-e4f761385137 req-90aafccd-723a-4a61-9292-8249b5016741 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094746 Oct 22 21:17:11.005821 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2523/5034] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:17:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:17:11.490215 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-d44d4820-f393-4fa4-82c7-b2029b243f2c tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:17:11.491773 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-d44d4820-f393-4fa4-82c7-b2029b243f2c tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] [instance: ac635cb1-9b28-4ac2-b0da-c27f3a5388a4] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:17:11.503055 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d44d4820-f393-4fa4-82c7-b2029b243f2c tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:17:11.503880 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d44d4820-f393-4fa4-82c7-b2029b243f2c tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:17:11.504837 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d44d4820-f393-4fa4-82c7-b2029b243f2c tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:17:11.505900 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d44d4820-f393-4fa4-82c7-b2029b243f2c tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:17:11.506518 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d44d4820-f393-4fa4-82c7-b2029b243f2c tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:17:11.507109 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d44d4820-f393-4fa4-82c7-b2029b243f2c tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:17:11.563079 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d44d4820-f393-4fa4-82c7-b2029b243f2c tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:17:11.564525 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d44d4820-f393-4fa4-82c7-b2029b243f2c tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:17:11.565095 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d44d4820-f393-4fa4-82c7-b2029b243f2c tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:17:11.565958 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.objects.instance [None req-d44d4820-f393-4fa4-82c7-b2029b243f2c tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Lazy-loading 'fault' on Instance uuid ac635cb1-9b28-4ac2-b0da-c27f3a5388a4 {{(pid=138744) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 21:17:11.645816 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-d44d4820-f393-4fa4-82c7-b2029b243f2c tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '271a94b5c9324dac963afb958f054e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b2530a0555405ab0240fdb0087e6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:17:11.656668 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-d44d4820-f393-4fa4-82c7-b2029b243f2c tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] 10.222.0.18 "GET /compute/v2.1/servers/ac635cb1-9b28-4ac2-b0da-c27f3a5388a4" status: 200 len: 1313 microversion: 2.1 time: 0.178153 Oct 22 21:17:11.672866 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2512/5035] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:17:11 2022] GET /compute/v2.1/servers/ac635cb1-9b28-4ac2-b0da-c27f3a5388a4 => generated 1313 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:17:12.689922 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-e40e07a6-b849-4082-a834-5078dfc5909c tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:17:12.691732 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-e40e07a6-b849-4082-a834-5078dfc5909c tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] [instance: ac635cb1-9b28-4ac2-b0da-c27f3a5388a4] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:17:12.712153 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e40e07a6-b849-4082-a834-5078dfc5909c tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:17:12.712851 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e40e07a6-b849-4082-a834-5078dfc5909c tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:17:12.714955 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e40e07a6-b849-4082-a834-5078dfc5909c tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:17:12.716039 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e40e07a6-b849-4082-a834-5078dfc5909c tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:17:12.716823 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e40e07a6-b849-4082-a834-5078dfc5909c tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:17:12.720235 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e40e07a6-b849-4082-a834-5078dfc5909c tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:17:12.746878 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.wsgi [None req-e40e07a6-b849-4082-a834-5078dfc5909c tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] HTTP exception thrown: Instance ac635cb1-9b28-4ac2-b0da-c27f3a5388a4 could not be found. Oct 22 21:17:12.750182 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-e40e07a6-b849-4082-a834-5078dfc5909c tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Request method failure captured: Oct 22 21:17:12.750182 ncdv-master-1 devstack@n-api.service[138745]: request: GET /compute/v2.1/servers/ac635cb1-9b28-4ac2-b0da-c27f3a5388a4 HTTP/1.1 Oct 22 21:17:12.750182 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 21:17:12.750182 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 21:17:12.750182 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 21:17:12.750182 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 0 Oct 22 21:17:12.750182 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 21:17:12.750182 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 21:17:12.750182 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 21:17:12.750182 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 21:17:12.750182 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVF26k_ApaAj3vJ-NHGRb2NjCUYlq5hDr7GaQ3K7mKoB5XY0ezvNlvwBTDl7jFZ1RI69LZf7-L53_zfYbxMaO9th7xloXmk1Z2JTV9HIUlMJ0Guh0bK_1bj1Em5OQKOCFPpr9qqnfBwUL-LY6Jch2aeL8zXsS0IQIzHH0-S3ZVWyXgEY Oct 22 21:17:12.750182 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 21:17:12.750182 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 21:17:12.750182 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 21:17:12.750182 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 21:17:12.750182 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 21:17:12.750182 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 21:17:12.750182 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: d4b2530a0555405ab0240fdb0087e6a8 Oct 22 21:17:12.750182 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-ListServersNegativeTestJSON-1599927421 Oct 22 21:17:12.750182 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 21:17:12.750182 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 21:17:12.750182 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_d4b2530a0555405ab0240fdb0087e6a8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d4b2530a0555405ab0240fdb0087e6a8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/d4b2530a0555405ab0240fdb0087e6a8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d4b2530a0555405ab0240fdb0087e6a8"}]}] Oct 22 21:17:12.750182 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-ListServersNegativeTestJSON-1599927421 Oct 22 21:17:12.750182 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: d4b2530a0555405ab0240fdb0087e6a8 Oct 22 21:17:12.750182 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1599927421 Oct 22 21:17:12.750182 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-ListServersNegativeTestJSON-1599927421-project Oct 22 21:17:12.750182 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 21:17:12.750182 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 21:17:12.750182 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: 271a94b5c9324dac963afb958f054e0f Oct 22 21:17:12.750182 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-ListServersNegativeTestJSON-1599927421-project Oct 22 21:17:12.750182 ncdv-master-1 devstack@n-api.service[138745]: method: > Oct 22 21:17:12.750182 ncdv-master-1 devstack@n-api.service[138745]: exception: Instance ac635cb1-9b28-4ac2-b0da-c27f3a5388a4 could not be found. Oct 22 21:17:12.750182 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'id': 'ac635cb1-9b28-4ac2-b0da-c27f3a5388a4'} Oct 22 21:17:12.750182 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:17:12.750182 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:17:12.750182 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 21:17:12.750182 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 21:17:12.750182 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 21:17:12.750182 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 21:17:12.750182 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 21:17:12.750182 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 21:17:12.750182 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 21:17:12.750182 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 21:17:12.750182 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac635cb1-9b28-4ac2-b0da-c27f3a5388a4 could not be found. Oct 22 21:17:12.750182 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:17:12.750182 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:17:12.750182 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:17:12.750182 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:17:12.750182 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:17:12.750182 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:17:12.750182 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:17:12.750182 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:17:12.750182 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:17:12.750182 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:17:12.750182 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 21:17:12.750182 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 21:17:12.750182 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 21:17:12.750182 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 21:17:12.750182 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 21:17:12.750182 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:17:12.750182 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac635cb1-9b28-4ac2-b0da-c27f3a5388a4 could not be found. Oct 22 21:17:12.750182 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:17:12.750182 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:17:12.753905 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:17:12.753905 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:17:12.753905 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:17:12.753905 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:17:12.753905 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:17:12.753905 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:17:12.753905 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac635cb1-9b28-4ac2-b0da-c27f3a5388a4 could not be found. Oct 22 21:17:12.753905 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:17:12.761570 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-e40e07a6-b849-4082-a834-5078dfc5909c tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Returning 404 to user: Instance ac635cb1-9b28-4ac2-b0da-c27f3a5388a4 could not be found. {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:17:12.762800 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-e40e07a6-b849-4082-a834-5078dfc5909c tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] 10.222.0.18 "GET /compute/v2.1/servers/ac635cb1-9b28-4ac2-b0da-c27f3a5388a4" status: 404 len: 111 microversion: 2.1 time: 0.085583 Oct 22 21:17:12.763967 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2524/5036] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:17:12 2022] GET /compute/v2.1/servers/ac635cb1-9b28-4ac2-b0da-c27f3a5388a4 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 21:17:12.774078 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-09ea723b-24dd-4af2-89b6-633bce5722cc tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:17:12.780012 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-09ea723b-24dd-4af2-89b6-633bce5722cc tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '271a94b5c9324dac963afb958f054e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b2530a0555405ab0240fdb0087e6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:17:12.780933 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-09ea723b-24dd-4af2-89b6-633bce5722cc tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Searching by: {'changes-since': datetime.datetime(2051, 1, 1, 12, 34, tzinfo=datetime.timezone.utc), 'vm_state': ['active'], 'project_id': 'd4b2530a0555405ab0240fdb0087e6a8'} {{(pid=138744) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 22 21:17:12.792667 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-09ea723b-24dd-4af2-89b6-633bce5722cc tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:17:12.795167 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-09ea723b-24dd-4af2-89b6-633bce5722cc tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:17:12.796296 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-09ea723b-24dd-4af2-89b6-633bce5722cc tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:17:12.797340 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-09ea723b-24dd-4af2-89b6-633bce5722cc tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:17:12.797910 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-09ea723b-24dd-4af2-89b6-633bce5722cc tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:17:12.798536 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-09ea723b-24dd-4af2-89b6-633bce5722cc tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:17:12.902818 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-09ea723b-24dd-4af2-89b6-633bce5722cc tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] 10.222.0.18 "GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE" status: 200 len: 15 microversion: 2.1 time: 0.133924 Oct 22 21:17:12.903773 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2513/5037] 10.222.0.18 () {58 vars in 1230 bytes} [Sat Oct 22 21:17:12 2022] GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE => generated 15 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 22 21:17:12.917847 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-da284cc3-e54b-49f0-a338-930b51f17ef8 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:17:12.924361 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-da284cc3-e54b-49f0-a338-930b51f17ef8 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Request method failure captured: Oct 22 21:17:12.924361 ncdv-master-1 devstack@n-api.service[138745]: request: GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 HTTP/1.1 Oct 22 21:17:12.924361 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 21:17:12.924361 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 21:17:12.924361 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 21:17:12.924361 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 0 Oct 22 21:17:12.924361 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 21:17:12.924361 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 21:17:12.924361 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 21:17:12.924361 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 21:17:12.924361 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVF26k_ApaAj3vJ-NHGRb2NjCUYlq5hDr7GaQ3K7mKoB5XY0ezvNlvwBTDl7jFZ1RI69LZf7-L53_zfYbxMaO9th7xloXmk1Z2JTV9HIUlMJ0Guh0bK_1bj1Em5OQKOCFPpr9qqnfBwUL-LY6Jch2aeL8zXsS0IQIzHH0-S3ZVWyXgEY Oct 22 21:17:12.924361 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 21:17:12.924361 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 21:17:12.924361 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 21:17:12.924361 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 21:17:12.924361 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 21:17:12.924361 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 21:17:12.924361 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: d4b2530a0555405ab0240fdb0087e6a8 Oct 22 21:17:12.924361 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-ListServersNegativeTestJSON-1599927421 Oct 22 21:17:12.924361 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 21:17:12.924361 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 21:17:12.924361 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_d4b2530a0555405ab0240fdb0087e6a8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d4b2530a0555405ab0240fdb0087e6a8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/d4b2530a0555405ab0240fdb0087e6a8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d4b2530a0555405ab0240fdb0087e6a8"}]}] Oct 22 21:17:12.924361 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-ListServersNegativeTestJSON-1599927421 Oct 22 21:17:12.924361 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: d4b2530a0555405ab0240fdb0087e6a8 Oct 22 21:17:12.924361 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1599927421 Oct 22 21:17:12.924361 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-ListServersNegativeTestJSON-1599927421-project Oct 22 21:17:12.924361 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 21:17:12.924361 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 21:17:12.924361 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: 271a94b5c9324dac963afb958f054e0f Oct 22 21:17:12.924361 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-ListServersNegativeTestJSON-1599927421-project Oct 22 21:17:12.924361 ncdv-master-1 devstack@n-api.service[138745]: method: > Oct 22 21:17:12.924361 ncdv-master-1 devstack@n-api.service[138745]: exception: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Oct 22 21:17:12.924361 ncdv-master-1 devstack@n-api.service[138745]: action_args: {} Oct 22 21:17:12.924361 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:17:12.924361 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:17:12.924361 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 22 21:17:12.924361 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 22 21:17:12.924361 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 22 21:17:12.924361 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise error Oct 22 21:17:12.924361 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '2011/01/01' is not a 'date-time' Oct 22 21:17:12.924361 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:17:12.924361 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['changes-since']['items']: Oct 22 21:17:12.924361 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi {'format': 'date-time', 'type': 'string'} Oct 22 21:17:12.924361 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:17:12.924361 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi On instance[0]: Oct 22 21:17:12.924361 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi '2011/01/01' Oct 22 21:17:12.924361 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:17:12.924361 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:17:12.924361 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:17:12.924361 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:17:12.924361 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:17:12.924361 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:17:12.924361 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:17:12.924361 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:17:12.924361 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:17:12.924361 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:17:12.924361 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 22 21:17:12.924361 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 21:17:12.924361 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 22 21:17:12.924361 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 21:17:12.924361 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 22 21:17:12.924361 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 21:17:12.924361 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 22 21:17:12.924361 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Oct 22 21:17:12.924361 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Oct 22 21:17:12.924361 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 22 21:17:12.930554 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 22 21:17:12.930554 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 22 21:17:12.930554 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 22 21:17:12.930554 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Oct 22 21:17:12.930554 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:17:12.930554 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:17:12.930554 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:17:12.930554 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:17:12.930554 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:17:12.930554 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:17:12.930554 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 22 21:17:12.930554 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 22 21:17:12.930554 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Oct 22 21:17:12.930554 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:17:12.930554 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-da284cc3-e54b-49f0-a338-930b51f17ef8 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Returning 400 to user: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:17:12.934280 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-da284cc3-e54b-49f0-a338-930b51f17ef8 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] 10.222.0.18 "GET /compute/v2.1/servers?changes-since=2011%2F01%2F01" status: 400 len: 146 microversion: 2.1 time: 0.019930 Oct 22 21:17:12.935069 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2525/5038] 10.222.0.18 () {58 vars in 1182 bytes} [Sat Oct 22 21:17:12 2022] GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 => generated 146 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 22 21:17:12.945466 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-41669270-5c9b-44d2-a4be-984f0b4848b5 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:17:12.954674 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-41669270-5c9b-44d2-a4be-984f0b4848b5 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '271a94b5c9324dac963afb958f054e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b2530a0555405ab0240fdb0087e6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:17:12.955991 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-41669270-5c9b-44d2-a4be-984f0b4848b5 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Searching by: {'deleted': False, 'project_id': 'd4b2530a0555405ab0240fdb0087e6a8'} {{(pid=138744) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 22 21:17:12.964487 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-41669270-5c9b-44d2-a4be-984f0b4848b5 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:17:12.965226 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-41669270-5c9b-44d2-a4be-984f0b4848b5 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:17:12.966250 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-41669270-5c9b-44d2-a4be-984f0b4848b5 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:17:12.975804 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-41669270-5c9b-44d2-a4be-984f0b4848b5 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:17:12.976464 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-41669270-5c9b-44d2-a4be-984f0b4848b5 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:17:12.976929 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-41669270-5c9b-44d2-a4be-984f0b4848b5 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:17:12.995566 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:17:13.013044 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.multi_cell_list [None req-41669270-5c9b-44d2-a4be-984f0b4848b5 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=138744) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 22 21:17:13.051133 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-41669270-5c9b-44d2-a4be-984f0b4848b5 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] 10.222.0.18 "GET /compute/v2.1/servers" status: 200 len: 683 microversion: 2.1 time: 0.109653 Oct 22 21:17:13.056455 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2514/5039] 10.222.0.18 () {58 vars in 1125 bytes} [Sat Oct 22 21:17:12 2022] GET /compute/v2.1/servers => generated 683 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:17:13.066182 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-48e3b976-1426-4d26-a473-02ba1f1498f2 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:17:13.072653 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-48e3b976-1426-4d26-a473-02ba1f1498f2 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '271a94b5c9324dac963afb958f054e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b2530a0555405ab0240fdb0087e6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:17:13.073128 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.compute.servers [None req-48e3b976-1426-4d26-a473-02ba1f1498f2 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Removing options 'limit' from query {{(pid=138745) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 22 21:17:13.073941 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-48e3b976-1426-4d26-a473-02ba1f1498f2 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Searching by: {'deleted': False, 'project_id': 'd4b2530a0555405ab0240fdb0087e6a8'} {{(pid=138745) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 22 21:17:13.085791 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-48e3b976-1426-4d26-a473-02ba1f1498f2 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:17:13.086570 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-48e3b976-1426-4d26-a473-02ba1f1498f2 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:17:13.090873 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-48e3b976-1426-4d26-a473-02ba1f1498f2 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:17:13.092009 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-48e3b976-1426-4d26-a473-02ba1f1498f2 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:17:13.092693 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-48e3b976-1426-4d26-a473-02ba1f1498f2 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:17:13.094472 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-48e3b976-1426-4d26-a473-02ba1f1498f2 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:17:13.143956 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.multi_cell_list [None req-48e3b976-1426-4d26-a473-02ba1f1498f2 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Listed batch of 2 results from cell out of 102 limit. Returned 2 total so far. {{(pid=138745) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 22 21:17:13.200158 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-48e3b976-1426-4d26-a473-02ba1f1498f2 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] 10.222.0.18 "GET /compute/v2.1/servers?limit=102" status: 200 len: 683 microversion: 2.1 time: 0.138974 Oct 22 21:17:13.200968 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2526/5040] 10.222.0.18 () {58 vars in 1144 bytes} [Sat Oct 22 21:17:13 2022] GET /compute/v2.1/servers?limit=102 => generated 683 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:17:13.217621 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-dfb32dc3-79ff-412d-9226-d81f31f918af tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:17:13.224565 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-dfb32dc3-79ff-412d-9226-d81f31f918af tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Request method failure captured: Oct 22 21:17:13.224565 ncdv-master-1 devstack@n-api.service[138744]: request: GET /compute/v2.1/servers?limit=-1 HTTP/1.1 Oct 22 21:17:13.224565 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 21:17:13.224565 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 21:17:13.224565 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 21:17:13.224565 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 0 Oct 22 21:17:13.224565 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 21:17:13.224565 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 21:17:13.224565 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 21:17:13.224565 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 21:17:13.224565 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVF26k_ApaAj3vJ-NHGRb2NjCUYlq5hDr7GaQ3K7mKoB5XY0ezvNlvwBTDl7jFZ1RI69LZf7-L53_zfYbxMaO9th7xloXmk1Z2JTV9HIUlMJ0Guh0bK_1bj1Em5OQKOCFPpr9qqnfBwUL-LY6Jch2aeL8zXsS0IQIzHH0-S3ZVWyXgEY Oct 22 21:17:13.224565 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 21:17:13.224565 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 21:17:13.224565 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 21:17:13.224565 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 21:17:13.224565 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 21:17:13.224565 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 21:17:13.224565 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: d4b2530a0555405ab0240fdb0087e6a8 Oct 22 21:17:13.224565 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-ListServersNegativeTestJSON-1599927421 Oct 22 21:17:13.224565 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 21:17:13.224565 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 21:17:13.224565 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_d4b2530a0555405ab0240fdb0087e6a8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d4b2530a0555405ab0240fdb0087e6a8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/d4b2530a0555405ab0240fdb0087e6a8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d4b2530a0555405ab0240fdb0087e6a8"}]}] Oct 22 21:17:13.224565 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-ListServersNegativeTestJSON-1599927421 Oct 22 21:17:13.224565 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: d4b2530a0555405ab0240fdb0087e6a8 Oct 22 21:17:13.224565 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1599927421 Oct 22 21:17:13.224565 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-ListServersNegativeTestJSON-1599927421-project Oct 22 21:17:13.224565 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 21:17:13.224565 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 21:17:13.224565 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: 271a94b5c9324dac963afb958f054e0f Oct 22 21:17:13.224565 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-ListServersNegativeTestJSON-1599927421-project Oct 22 21:17:13.224565 ncdv-master-1 devstack@n-api.service[138744]: method: > Oct 22 21:17:13.224565 ncdv-master-1 devstack@n-api.service[138744]: exception: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Oct 22 21:17:13.224565 ncdv-master-1 devstack@n-api.service[138744]: action_args: {} Oct 22 21:17:13.224565 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:17:13.224565 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:17:13.224565 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 22 21:17:13.224565 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 22 21:17:13.224565 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 22 21:17:13.224565 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise error Oct 22 21:17:13.224565 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '-1' does not match '^[0-9]*$' Oct 22 21:17:13.224565 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:17:13.224565 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Oct 22 21:17:13.224565 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 22 21:17:13.224565 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi 'minimum': 0, Oct 22 21:17:13.224565 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 22 21:17:13.224565 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 22 21:17:13.224565 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:17:13.224565 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi On instance[0]: Oct 22 21:17:13.224565 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi '-1' Oct 22 21:17:13.224565 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:17:13.224565 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:17:13.224565 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:17:13.224565 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:17:13.224565 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:17:13.224565 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:17:13.224565 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:17:13.224565 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:17:13.224565 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:17:13.224565 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:17:13.224565 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 22 21:17:13.224565 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 21:17:13.224565 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 22 21:17:13.224565 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 21:17:13.224565 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 22 21:17:13.224565 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 21:17:13.224565 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 22 21:17:13.224565 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Oct 22 21:17:13.224565 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Oct 22 21:17:13.235613 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 22 21:17:13.235613 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 22 21:17:13.235613 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 22 21:17:13.235613 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 22 21:17:13.235613 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Oct 22 21:17:13.235613 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:17:13.235613 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:17:13.235613 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:17:13.235613 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:17:13.235613 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:17:13.235613 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:17:13.235613 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 22 21:17:13.235613 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 22 21:17:13.235613 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Oct 22 21:17:13.235613 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:17:13.235613 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-dfb32dc3-79ff-412d-9226-d81f31f918af tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Returning 400 to user: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:17:13.235613 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-dfb32dc3-79ff-412d-9226-d81f31f918af tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] 10.222.0.18 "GET /compute/v2.1/servers?limit=-1" status: 400 len: 127 microversion: 2.1 time: 0.015344 Oct 22 21:17:13.235613 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2515/5041] 10.222.0.18 () {58 vars in 1142 bytes} [Sat Oct 22 21:17:13 2022] GET /compute/v2.1/servers?limit=-1 => generated 127 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 22 21:17:13.237937 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-a3471919-760a-4490-aece-8578f9f1653f tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:17:13.243353 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-a3471919-760a-4490-aece-8578f9f1653f tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Request method failure captured: Oct 22 21:17:13.243353 ncdv-master-1 devstack@n-api.service[138745]: request: GET /compute/v2.1/servers?limit=testing HTTP/1.1 Oct 22 21:17:13.243353 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 21:17:13.243353 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 21:17:13.243353 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 21:17:13.243353 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 0 Oct 22 21:17:13.243353 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 21:17:13.243353 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 21:17:13.243353 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 21:17:13.243353 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 21:17:13.243353 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVF26k_ApaAj3vJ-NHGRb2NjCUYlq5hDr7GaQ3K7mKoB5XY0ezvNlvwBTDl7jFZ1RI69LZf7-L53_zfYbxMaO9th7xloXmk1Z2JTV9HIUlMJ0Guh0bK_1bj1Em5OQKOCFPpr9qqnfBwUL-LY6Jch2aeL8zXsS0IQIzHH0-S3ZVWyXgEY Oct 22 21:17:13.243353 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 21:17:13.243353 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 21:17:13.243353 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 21:17:13.243353 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 21:17:13.243353 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 21:17:13.243353 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 21:17:13.243353 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: d4b2530a0555405ab0240fdb0087e6a8 Oct 22 21:17:13.243353 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-ListServersNegativeTestJSON-1599927421 Oct 22 21:17:13.243353 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 21:17:13.243353 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 21:17:13.243353 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_d4b2530a0555405ab0240fdb0087e6a8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d4b2530a0555405ab0240fdb0087e6a8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/d4b2530a0555405ab0240fdb0087e6a8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d4b2530a0555405ab0240fdb0087e6a8"}]}] Oct 22 21:17:13.243353 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-ListServersNegativeTestJSON-1599927421 Oct 22 21:17:13.243353 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: d4b2530a0555405ab0240fdb0087e6a8 Oct 22 21:17:13.243353 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1599927421 Oct 22 21:17:13.243353 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-ListServersNegativeTestJSON-1599927421-project Oct 22 21:17:13.243353 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 21:17:13.243353 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 21:17:13.243353 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: 271a94b5c9324dac963afb958f054e0f Oct 22 21:17:13.243353 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-ListServersNegativeTestJSON-1599927421-project Oct 22 21:17:13.243353 ncdv-master-1 devstack@n-api.service[138745]: method: > Oct 22 21:17:13.243353 ncdv-master-1 devstack@n-api.service[138745]: exception: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Oct 22 21:17:13.243353 ncdv-master-1 devstack@n-api.service[138745]: action_args: {} Oct 22 21:17:13.243353 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:17:13.243353 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:17:13.243353 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 22 21:17:13.243353 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 22 21:17:13.243353 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 22 21:17:13.243353 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise error Oct 22 21:17:13.243353 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'testing' does not match '^[0-9]*$' Oct 22 21:17:13.243353 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:17:13.243353 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Oct 22 21:17:13.243353 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 22 21:17:13.243353 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi 'minimum': 0, Oct 22 21:17:13.243353 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 22 21:17:13.243353 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 22 21:17:13.243353 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:17:13.243353 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi On instance[0]: Oct 22 21:17:13.243353 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi 'testing' Oct 22 21:17:13.243353 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:17:13.243353 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:17:13.243353 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:17:13.243353 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:17:13.243353 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:17:13.243353 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:17:13.243353 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:17:13.243353 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:17:13.243353 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:17:13.243353 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:17:13.243353 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 22 21:17:13.243353 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 21:17:13.243353 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 22 21:17:13.243353 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 21:17:13.243353 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 22 21:17:13.243353 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 21:17:13.243353 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 22 21:17:13.243353 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Oct 22 21:17:13.243353 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Oct 22 21:17:13.251683 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 22 21:17:13.251683 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 22 21:17:13.251683 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 22 21:17:13.251683 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 22 21:17:13.251683 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Oct 22 21:17:13.251683 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:17:13.251683 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:17:13.251683 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:17:13.251683 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:17:13.251683 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:17:13.251683 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:17:13.251683 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 22 21:17:13.251683 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 22 21:17:13.251683 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Oct 22 21:17:13.251683 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:17:13.251683 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-a3471919-760a-4490-aece-8578f9f1653f tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Returning 400 to user: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:17:13.251683 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-a3471919-760a-4490-aece-8578f9f1653f tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] 10.222.0.18 "GET /compute/v2.1/servers?limit=testing" status: 400 len: 137 microversion: 2.1 time: 0.012061 Oct 22 21:17:13.251683 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2527/5042] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Oct 22 21:17:13 2022] GET /compute/v2.1/servers?limit=testing => generated 137 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 22 21:17:13.259488 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-fa2c47ab-c0a5-421c-b24b-92cdf303cbf2 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:17:13.270296 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-fa2c47ab-c0a5-421c-b24b-92cdf303cbf2 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '271a94b5c9324dac963afb958f054e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b2530a0555405ab0240fdb0087e6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:17:13.270998 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-fa2c47ab-c0a5-421c-b24b-92cdf303cbf2 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Searching by: {'flavor': 'non_existing_flavor', 'deleted': False, 'project_id': 'd4b2530a0555405ab0240fdb0087e6a8'} {{(pid=138744) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 22 21:17:13.282659 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.compute.servers [None req-fa2c47ab-c0a5-421c-b24b-92cdf303cbf2 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Flavor 'non_existing_flavor' could not be found {{(pid=138744) _get_servers /opt/stack/nova/nova/api/openstack/compute/servers.py:336}} Oct 22 21:17:13.284001 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-fa2c47ab-c0a5-421c-b24b-92cdf303cbf2 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] 10.222.0.18 "GET /compute/v2.1/servers?flavor=non_existing_flavor" status: 200 len: 15 microversion: 2.1 time: 0.032688 Oct 22 21:17:13.293975 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2516/5043] 10.222.0.18 () {58 vars in 1178 bytes} [Sat Oct 22 21:17:13 2022] GET /compute/v2.1/servers?flavor=non_existing_flavor => generated 15 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 22 21:17:13.300910 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-77cb5810-ac71-4760-9842-42bd01644636 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:17:13.306160 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-77cb5810-ac71-4760-9842-42bd01644636 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '271a94b5c9324dac963afb958f054e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b2530a0555405ab0240fdb0087e6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:17:13.306979 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-77cb5810-ac71-4760-9842-42bd01644636 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Searching by: {'image': 'non_existing_image', 'deleted': False, 'project_id': 'd4b2530a0555405ab0240fdb0087e6a8'} {{(pid=138745) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 22 21:17:13.325081 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-77cb5810-ac71-4760-9842-42bd01644636 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:17:13.325811 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-77cb5810-ac71-4760-9842-42bd01644636 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:17:13.326460 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-77cb5810-ac71-4760-9842-42bd01644636 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:17:13.328187 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-77cb5810-ac71-4760-9842-42bd01644636 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:17:13.328876 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-77cb5810-ac71-4760-9842-42bd01644636 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:17:13.329569 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-77cb5810-ac71-4760-9842-42bd01644636 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:17:13.459681 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-77cb5810-ac71-4760-9842-42bd01644636 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] 10.222.0.18 "GET /compute/v2.1/servers?image=non_existing_image" status: 200 len: 15 microversion: 2.1 time: 0.163922 Oct 22 21:17:13.461039 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2528/5044] 10.222.0.18 () {58 vars in 1174 bytes} [Sat Oct 22 21:17:13 2022] GET /compute/v2.1/servers?image=non_existing_image => generated 15 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 22 21:17:13.474436 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-718bc6d8-66f1-432b-b870-f23f3d27a172 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:17:13.481048 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-718bc6d8-66f1-432b-b870-f23f3d27a172 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '271a94b5c9324dac963afb958f054e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b2530a0555405ab0240fdb0087e6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:17:13.484304 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-718bc6d8-66f1-432b-b870-f23f3d27a172 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Searching by: {'name': 'non_existing_server_name', 'deleted': False, 'project_id': 'd4b2530a0555405ab0240fdb0087e6a8'} {{(pid=138744) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 22 21:17:13.496824 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-718bc6d8-66f1-432b-b870-f23f3d27a172 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:17:13.497316 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-718bc6d8-66f1-432b-b870-f23f3d27a172 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:17:13.497765 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-718bc6d8-66f1-432b-b870-f23f3d27a172 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:17:13.498489 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-718bc6d8-66f1-432b-b870-f23f3d27a172 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:17:13.498942 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-718bc6d8-66f1-432b-b870-f23f3d27a172 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:17:13.503532 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-718bc6d8-66f1-432b-b870-f23f3d27a172 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:17:13.756296 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-718bc6d8-66f1-432b-b870-f23f3d27a172 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] 10.222.0.18 "GET /compute/v2.1/servers?name=non_existing_server_name" status: 200 len: 15 microversion: 2.1 time: 0.285679 Oct 22 21:17:13.757751 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2517/5045] 10.222.0.18 () {58 vars in 1184 bytes} [Sat Oct 22 21:17:13 2022] GET /compute/v2.1/servers?name=non_existing_server_name => generated 15 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 22 21:17:13.770859 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-8979cbf0-fe0a-40e2-af27-759cb00bb533 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:17:13.780216 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-8979cbf0-fe0a-40e2-af27-759cb00bb533 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '271a94b5c9324dac963afb958f054e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b2530a0555405ab0240fdb0087e6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:17:13.782941 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-8979cbf0-fe0a-40e2-af27-759cb00bb533 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Searching by: {'deleted': False, 'project_id': 'd4b2530a0555405ab0240fdb0087e6a8'} {{(pid=138745) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 22 21:17:13.815682 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8979cbf0-fe0a-40e2-af27-759cb00bb533 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:17:13.816291 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8979cbf0-fe0a-40e2-af27-759cb00bb533 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:17:13.817627 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8979cbf0-fe0a-40e2-af27-759cb00bb533 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:17:13.821292 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8979cbf0-fe0a-40e2-af27-759cb00bb533 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:17:13.830273 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8979cbf0-fe0a-40e2-af27-759cb00bb533 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:17:13.832464 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8979cbf0-fe0a-40e2-af27-759cb00bb533 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:17:13.885445 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:17:13.891266 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.multi_cell_list [None req-8979cbf0-fe0a-40e2-af27-759cb00bb533 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=138745) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 22 21:17:13.932102 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-8979cbf0-fe0a-40e2-af27-759cb00bb533 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '271a94b5c9324dac963afb958f054e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b2530a0555405ab0240fdb0087e6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:17:13.939743 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8979cbf0-fe0a-40e2-af27-759cb00bb533 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:17:13.940549 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8979cbf0-fe0a-40e2-af27-759cb00bb533 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:17:13.941159 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8979cbf0-fe0a-40e2-af27-759cb00bb533 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:17:14.622772 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-8979cbf0-fe0a-40e2-af27-759cb00bb533 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] 10.222.0.18 "GET /compute/v2.1/servers/detail" status: 200 len: 3025 microversion: 2.1 time: 0.855808 Oct 22 21:17:14.623716 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2529/5046] 10.222.0.18 () {58 vars in 1146 bytes} [Sat Oct 22 21:17:13 2022] GET /compute/v2.1/servers/detail => generated 3025 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:17:14.649993 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-5c045865-2ef4-4a04-9965-52a3c8d1753a tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:17:14.655863 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-5c045865-2ef4-4a04-9965-52a3c8d1753a tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '271a94b5c9324dac963afb958f054e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b2530a0555405ab0240fdb0087e6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:17:14.656893 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-5c045865-2ef4-4a04-9965-52a3c8d1753a tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] 10.222.0.18 "GET /compute/v2.1/servers?status=non_existing_status" status: 200 len: 15 microversion: 2.1 time: 0.010885 Oct 22 21:17:14.670591 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-21aba705-6cb1-4068-b17b-7a14676b772b tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:17:14.675915 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2518/5047] 10.222.0.18 () {58 vars in 1178 bytes} [Sat Oct 22 21:17:14 2022] GET /compute/v2.1/servers?status=non_existing_status => generated 15 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 22 21:17:14.676371 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-21aba705-6cb1-4068-b17b-7a14676b772b tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '271a94b5c9324dac963afb958f054e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b2530a0555405ab0240fdb0087e6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:17:14.677289 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-21aba705-6cb1-4068-b17b-7a14676b772b tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Searching by: {'deleted': False, 'project_id': 'd4b2530a0555405ab0240fdb0087e6a8'} {{(pid=138745) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 22 21:17:14.682930 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-21aba705-6cb1-4068-b17b-7a14676b772b tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:17:14.683715 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-21aba705-6cb1-4068-b17b-7a14676b772b tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:17:14.684326 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-21aba705-6cb1-4068-b17b-7a14676b772b tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:17:14.685244 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-21aba705-6cb1-4068-b17b-7a14676b772b tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:17:14.686200 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-21aba705-6cb1-4068-b17b-7a14676b772b tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:17:14.686850 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-21aba705-6cb1-4068-b17b-7a14676b772b tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:17:14.734099 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.multi_cell_list [None req-21aba705-6cb1-4068-b17b-7a14676b772b tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=138745) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 22 21:17:14.770279 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-21aba705-6cb1-4068-b17b-7a14676b772b tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] 10.222.0.18 "GET /compute/v2.1/servers" status: 200 len: 683 microversion: 2.1 time: 0.103438 Oct 22 21:17:14.785453 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-22379721-7b3e-48b0-856c-7a4eedf27fb8 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:17:14.785960 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-22379721-7b3e-48b0-856c-7a4eedf27fb8 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] [instance: ac635cb1-9b28-4ac2-b0da-c27f3a5388a4] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:17:14.789239 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2530/5048] 10.222.0.18 () {58 vars in 1125 bytes} [Sat Oct 22 21:17:14 2022] GET /compute/v2.1/servers => generated 683 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:17:14.794436 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-22379721-7b3e-48b0-856c-7a4eedf27fb8 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:17:14.795152 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-22379721-7b3e-48b0-856c-7a4eedf27fb8 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:17:14.795806 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-22379721-7b3e-48b0-856c-7a4eedf27fb8 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:17:14.796688 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-22379721-7b3e-48b0-856c-7a4eedf27fb8 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:17:14.797301 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-22379721-7b3e-48b0-856c-7a4eedf27fb8 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:17:14.798399 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-22379721-7b3e-48b0-856c-7a4eedf27fb8 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:17:14.820563 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-22379721-7b3e-48b0-856c-7a4eedf27fb8 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] HTTP exception thrown: Instance ac635cb1-9b28-4ac2-b0da-c27f3a5388a4 could not be found. Oct 22 21:17:14.822346 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-22379721-7b3e-48b0-856c-7a4eedf27fb8 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Request method failure captured: Oct 22 21:17:14.822346 ncdv-master-1 devstack@n-api.service[138744]: request: DELETE /compute/v2.1/servers/ac635cb1-9b28-4ac2-b0da-c27f3a5388a4 HTTP/1.1 Oct 22 21:17:14.822346 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 21:17:14.822346 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 21:17:14.822346 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 21:17:14.822346 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 0 Oct 22 21:17:14.822346 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 21:17:14.822346 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 21:17:14.822346 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 21:17:14.822346 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 21:17:14.822346 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVF26k_ApaAj3vJ-NHGRb2NjCUYlq5hDr7GaQ3K7mKoB5XY0ezvNlvwBTDl7jFZ1RI69LZf7-L53_zfYbxMaO9th7xloXmk1Z2JTV9HIUlMJ0Guh0bK_1bj1Em5OQKOCFPpr9qqnfBwUL-LY6Jch2aeL8zXsS0IQIzHH0-S3ZVWyXgEY Oct 22 21:17:14.822346 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 21:17:14.822346 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 21:17:14.822346 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 21:17:14.822346 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 21:17:14.822346 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 21:17:14.822346 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 21:17:14.822346 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: d4b2530a0555405ab0240fdb0087e6a8 Oct 22 21:17:14.822346 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-ListServersNegativeTestJSON-1599927421 Oct 22 21:17:14.822346 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 21:17:14.822346 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 21:17:14.822346 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_d4b2530a0555405ab0240fdb0087e6a8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d4b2530a0555405ab0240fdb0087e6a8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/d4b2530a0555405ab0240fdb0087e6a8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d4b2530a0555405ab0240fdb0087e6a8"}]}] Oct 22 21:17:14.822346 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-ListServersNegativeTestJSON-1599927421 Oct 22 21:17:14.822346 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: d4b2530a0555405ab0240fdb0087e6a8 Oct 22 21:17:14.822346 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1599927421 Oct 22 21:17:14.822346 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-ListServersNegativeTestJSON-1599927421-project Oct 22 21:17:14.822346 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 21:17:14.822346 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 21:17:14.822346 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: 271a94b5c9324dac963afb958f054e0f Oct 22 21:17:14.822346 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-ListServersNegativeTestJSON-1599927421-project Oct 22 21:17:14.822346 ncdv-master-1 devstack@n-api.service[138744]: method: > Oct 22 21:17:14.822346 ncdv-master-1 devstack@n-api.service[138744]: exception: Instance ac635cb1-9b28-4ac2-b0da-c27f3a5388a4 could not be found. Oct 22 21:17:14.822346 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': 'ac635cb1-9b28-4ac2-b0da-c27f3a5388a4'} Oct 22 21:17:14.822346 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:17:14.822346 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:17:14.822346 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 21:17:14.822346 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 21:17:14.822346 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 21:17:14.822346 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 21:17:14.822346 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 21:17:14.822346 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 21:17:14.822346 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 21:17:14.822346 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 21:17:14.822346 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac635cb1-9b28-4ac2-b0da-c27f3a5388a4 could not be found. Oct 22 21:17:14.822346 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:17:14.822346 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:17:14.822346 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:17:14.822346 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:17:14.822346 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:17:14.822346 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:17:14.822346 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:17:14.822346 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:17:14.822346 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:17:14.822346 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:17:14.822346 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 22 21:17:14.822346 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 22 21:17:14.822346 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 22 21:17:14.822346 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 22 21:17:14.822346 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 21:17:14.822346 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 21:17:14.822346 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 21:17:14.822346 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:17:14.826811 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac635cb1-9b28-4ac2-b0da-c27f3a5388a4 could not be found. Oct 22 21:17:14.826811 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:17:14.826811 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:17:14.826811 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:17:14.826811 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:17:14.826811 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:17:14.826811 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:17:14.826811 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:17:14.826811 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:17:14.826811 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac635cb1-9b28-4ac2-b0da-c27f3a5388a4 could not be found. Oct 22 21:17:14.826811 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:17:14.828454 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-22379721-7b3e-48b0-856c-7a4eedf27fb8 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Returning 404 to user: Instance ac635cb1-9b28-4ac2-b0da-c27f3a5388a4 could not be found. {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:17:14.830414 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-22379721-7b3e-48b0-856c-7a4eedf27fb8 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] 10.222.0.18 "DELETE /compute/v2.1/servers/ac635cb1-9b28-4ac2-b0da-c27f3a5388a4" status: 404 len: 111 microversion: 2.1 time: 0.050439 Oct 22 21:17:14.831087 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2519/5049] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 21:17:14 2022] DELETE /compute/v2.1/servers/ac635cb1-9b28-4ac2-b0da-c27f3a5388a4 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 21:17:14.871389 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-c01e1d11-03d1-490a-8748-990f43f0bf48 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:17:14.872243 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-c01e1d11-03d1-490a-8748-990f43f0bf48 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] [instance: 739c029e-b589-495d-89db-50c7a706b7f7] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:17:14.882988 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c01e1d11-03d1-490a-8748-990f43f0bf48 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:17:14.883536 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c01e1d11-03d1-490a-8748-990f43f0bf48 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:17:14.883993 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c01e1d11-03d1-490a-8748-990f43f0bf48 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:17:14.884720 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c01e1d11-03d1-490a-8748-990f43f0bf48 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:17:14.885189 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c01e1d11-03d1-490a-8748-990f43f0bf48 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:17:14.885632 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c01e1d11-03d1-490a-8748-990f43f0bf48 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:17:14.922236 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-c01e1d11-03d1-490a-8748-990f43f0bf48 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] [instance: 739c029e-b589-495d-89db-50c7a706b7f7] Going to try to terminate instance {{(pid=138745) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 21:17:15.039093 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-c01e1d11-03d1-490a-8748-990f43f0bf48 tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] 10.222.0.18 "DELETE /compute/v2.1/servers/739c029e-b589-495d-89db-50c7a706b7f7" status: 204 len: 0 microversion: 2.1 time: 0.202202 Oct 22 21:17:15.040435 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2531/5050] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 21:17:14 2022] DELETE /compute/v2.1/servers/739c029e-b589-495d-89db-50c7a706b7f7 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 21:17:15.050168 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-58185db3-9f2e-4a6b-a089-ad99a70bbccd tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:17:15.051983 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-58185db3-9f2e-4a6b-a089-ad99a70bbccd tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] [instance: dde943e5-12d5-4d2c-859a-1ab238280e4e] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:17:15.067930 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-58185db3-9f2e-4a6b-a089-ad99a70bbccd tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:17:15.069091 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-58185db3-9f2e-4a6b-a089-ad99a70bbccd tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:17:15.070230 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-58185db3-9f2e-4a6b-a089-ad99a70bbccd tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:17:15.071698 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-58185db3-9f2e-4a6b-a089-ad99a70bbccd tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:17:15.072661 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-58185db3-9f2e-4a6b-a089-ad99a70bbccd tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:17:15.073332 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-58185db3-9f2e-4a6b-a089-ad99a70bbccd tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:17:15.110224 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-58185db3-9f2e-4a6b-a089-ad99a70bbccd tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] [instance: dde943e5-12d5-4d2c-859a-1ab238280e4e] Going to try to terminate instance {{(pid=138744) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 21:17:15.234752 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-58185db3-9f2e-4a6b-a089-ad99a70bbccd tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] 10.222.0.18 "DELETE /compute/v2.1/servers/dde943e5-12d5-4d2c-859a-1ab238280e4e" status: 204 len: 0 microversion: 2.1 time: 0.189288 Oct 22 21:17:15.236311 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2520/5051] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 21:17:15 2022] DELETE /compute/v2.1/servers/dde943e5-12d5-4d2c-859a-1ab238280e4e => generated 0 bytes in 192 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 21:17:15.250362 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-f5257c27-484c-4c89-8dfd-2cc7d4b92a3e tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:17:15.251529 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-f5257c27-484c-4c89-8dfd-2cc7d4b92a3e tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] [instance: ac635cb1-9b28-4ac2-b0da-c27f3a5388a4] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:17:15.262715 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f5257c27-484c-4c89-8dfd-2cc7d4b92a3e tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:17:15.263766 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f5257c27-484c-4c89-8dfd-2cc7d4b92a3e tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:17:15.264387 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f5257c27-484c-4c89-8dfd-2cc7d4b92a3e tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:17:15.265443 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f5257c27-484c-4c89-8dfd-2cc7d4b92a3e tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:17:15.266979 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f5257c27-484c-4c89-8dfd-2cc7d4b92a3e tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:17:15.267640 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f5257c27-484c-4c89-8dfd-2cc7d4b92a3e tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:17:15.291494 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.wsgi [None req-f5257c27-484c-4c89-8dfd-2cc7d4b92a3e tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] HTTP exception thrown: Instance ac635cb1-9b28-4ac2-b0da-c27f3a5388a4 could not be found. Oct 22 21:17:15.293577 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-f5257c27-484c-4c89-8dfd-2cc7d4b92a3e tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Request method failure captured: Oct 22 21:17:15.293577 ncdv-master-1 devstack@n-api.service[138745]: request: GET /compute/v2.1/servers/ac635cb1-9b28-4ac2-b0da-c27f3a5388a4 HTTP/1.1 Oct 22 21:17:15.293577 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 21:17:15.293577 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 21:17:15.293577 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 21:17:15.293577 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 0 Oct 22 21:17:15.293577 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 21:17:15.293577 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 21:17:15.293577 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 21:17:15.293577 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 21:17:15.293577 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVF26k_ApaAj3vJ-NHGRb2NjCUYlq5hDr7GaQ3K7mKoB5XY0ezvNlvwBTDl7jFZ1RI69LZf7-L53_zfYbxMaO9th7xloXmk1Z2JTV9HIUlMJ0Guh0bK_1bj1Em5OQKOCFPpr9qqnfBwUL-LY6Jch2aeL8zXsS0IQIzHH0-S3ZVWyXgEY Oct 22 21:17:15.293577 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 21:17:15.293577 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 21:17:15.293577 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 21:17:15.293577 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 21:17:15.293577 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 21:17:15.293577 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 21:17:15.293577 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: d4b2530a0555405ab0240fdb0087e6a8 Oct 22 21:17:15.293577 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-ListServersNegativeTestJSON-1599927421 Oct 22 21:17:15.293577 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 21:17:15.293577 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 21:17:15.293577 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_d4b2530a0555405ab0240fdb0087e6a8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d4b2530a0555405ab0240fdb0087e6a8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/d4b2530a0555405ab0240fdb0087e6a8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d4b2530a0555405ab0240fdb0087e6a8"}]}] Oct 22 21:17:15.293577 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-ListServersNegativeTestJSON-1599927421 Oct 22 21:17:15.293577 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: d4b2530a0555405ab0240fdb0087e6a8 Oct 22 21:17:15.293577 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1599927421 Oct 22 21:17:15.293577 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-ListServersNegativeTestJSON-1599927421-project Oct 22 21:17:15.293577 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 21:17:15.293577 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 21:17:15.293577 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: 271a94b5c9324dac963afb958f054e0f Oct 22 21:17:15.293577 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-ListServersNegativeTestJSON-1599927421-project Oct 22 21:17:15.293577 ncdv-master-1 devstack@n-api.service[138745]: method: > Oct 22 21:17:15.293577 ncdv-master-1 devstack@n-api.service[138745]: exception: Instance ac635cb1-9b28-4ac2-b0da-c27f3a5388a4 could not be found. Oct 22 21:17:15.293577 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'id': 'ac635cb1-9b28-4ac2-b0da-c27f3a5388a4'} Oct 22 21:17:15.293577 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:17:15.293577 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:17:15.293577 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 21:17:15.293577 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 21:17:15.293577 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 21:17:15.293577 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 21:17:15.293577 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 21:17:15.293577 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 21:17:15.293577 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 21:17:15.293577 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 21:17:15.293577 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac635cb1-9b28-4ac2-b0da-c27f3a5388a4 could not be found. Oct 22 21:17:15.293577 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:17:15.293577 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:17:15.293577 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:17:15.293577 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:17:15.293577 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:17:15.293577 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:17:15.293577 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:17:15.293577 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:17:15.293577 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:17:15.293577 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:17:15.293577 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 21:17:15.293577 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 21:17:15.293577 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 21:17:15.293577 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 21:17:15.293577 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 21:17:15.293577 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:17:15.293577 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac635cb1-9b28-4ac2-b0da-c27f3a5388a4 could not be found. Oct 22 21:17:15.293577 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:17:15.293577 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:17:15.297376 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:17:15.297376 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:17:15.297376 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:17:15.297376 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:17:15.297376 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:17:15.297376 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:17:15.297376 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac635cb1-9b28-4ac2-b0da-c27f3a5388a4 could not be found. Oct 22 21:17:15.297376 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:17:15.297376 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-f5257c27-484c-4c89-8dfd-2cc7d4b92a3e tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Returning 404 to user: Instance ac635cb1-9b28-4ac2-b0da-c27f3a5388a4 could not be found. {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:17:15.297376 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-f5257c27-484c-4c89-8dfd-2cc7d4b92a3e tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] 10.222.0.18 "GET /compute/v2.1/servers/ac635cb1-9b28-4ac2-b0da-c27f3a5388a4" status: 404 len: 111 microversion: 2.1 time: 0.053025 Oct 22 21:17:15.297376 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2532/5052] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:17:15 2022] GET /compute/v2.1/servers/ac635cb1-9b28-4ac2-b0da-c27f3a5388a4 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 22 21:17:15.310239 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-1881d3b0-2301-4dd8-8ef2-4dadf86284ae tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:17:15.311166 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-1881d3b0-2301-4dd8-8ef2-4dadf86284ae tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] [instance: 739c029e-b589-495d-89db-50c7a706b7f7] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:17:15.319113 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1881d3b0-2301-4dd8-8ef2-4dadf86284ae tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:17:15.319674 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1881d3b0-2301-4dd8-8ef2-4dadf86284ae tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:17:15.320184 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1881d3b0-2301-4dd8-8ef2-4dadf86284ae tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:17:15.321112 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1881d3b0-2301-4dd8-8ef2-4dadf86284ae tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:17:15.321453 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1881d3b0-2301-4dd8-8ef2-4dadf86284ae tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:17:15.321812 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1881d3b0-2301-4dd8-8ef2-4dadf86284ae tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:17:15.755366 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-1881d3b0-2301-4dd8-8ef2-4dadf86284ae tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '271a94b5c9324dac963afb958f054e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b2530a0555405ab0240fdb0087e6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:17:15.765939 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-1881d3b0-2301-4dd8-8ef2-4dadf86284ae tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] 10.222.0.18 "GET /compute/v2.1/servers/739c029e-b589-495d-89db-50c7a706b7f7" status: 200 len: 1522 microversion: 2.1 time: 0.465364 Oct 22 21:17:15.785322 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2521/5053] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:17:15 2022] GET /compute/v2.1/servers/739c029e-b589-495d-89db-50c7a706b7f7 => generated 1522 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:17:16.810290 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-5fb89eb8-5d00-49ec-8d41-adc3873937dd tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:17:16.813189 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-5fb89eb8-5d00-49ec-8d41-adc3873937dd tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] [instance: 739c029e-b589-495d-89db-50c7a706b7f7] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:17:16.824751 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5fb89eb8-5d00-49ec-8d41-adc3873937dd tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:17:16.825625 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5fb89eb8-5d00-49ec-8d41-adc3873937dd tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:17:16.826322 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5fb89eb8-5d00-49ec-8d41-adc3873937dd tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:17:16.835246 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5fb89eb8-5d00-49ec-8d41-adc3873937dd tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:17:16.836207 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5fb89eb8-5d00-49ec-8d41-adc3873937dd tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:17:16.836902 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5fb89eb8-5d00-49ec-8d41-adc3873937dd tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:17:17.825838 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-5fb89eb8-5d00-49ec-8d41-adc3873937dd tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '271a94b5c9324dac963afb958f054e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b2530a0555405ab0240fdb0087e6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:17:17.865920 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-5fb89eb8-5d00-49ec-8d41-adc3873937dd tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] 10.222.0.18 "GET /compute/v2.1/servers/739c029e-b589-495d-89db-50c7a706b7f7" status: 200 len: 1522 microversion: 2.1 time: 1.069325 Oct 22 21:17:17.890852 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2533/5054] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:17:16 2022] GET /compute/v2.1/servers/739c029e-b589-495d-89db-50c7a706b7f7 => generated 1522 bytes in 1099 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:17:18.897217 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-e96e2ee5-81a8-4552-950b-4cf349511e4b tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:17:18.898461 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-e96e2ee5-81a8-4552-950b-4cf349511e4b tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] [instance: 739c029e-b589-495d-89db-50c7a706b7f7] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:17:18.914329 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e96e2ee5-81a8-4552-950b-4cf349511e4b tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:17:18.915428 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e96e2ee5-81a8-4552-950b-4cf349511e4b tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:17:18.917242 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e96e2ee5-81a8-4552-950b-4cf349511e4b tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:17:18.921345 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e96e2ee5-81a8-4552-950b-4cf349511e4b tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:17:18.925800 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e96e2ee5-81a8-4552-950b-4cf349511e4b tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:17:18.926645 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e96e2ee5-81a8-4552-950b-4cf349511e4b tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:17:18.983862 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-bef56e3b-6545-4f1e-93a7-cc0fe04709e3 req-c9bd6b9c-e790-4d56-b72a-2f05d46efb10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dde943e5-12d5-4d2c-859a-1ab238280e4e", "name": "network-vif-deleted", "tag": "d14b66a1-86a2-415c-a4de-a68be3b4318a"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:17:19.032467 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-bef56e3b-6545-4f1e-93a7-cc0fe04709e3 req-c9bd6b9c-e790-4d56-b72a-2f05d46efb10 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:17:19.033108 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-bef56e3b-6545-4f1e-93a7-cc0fe04709e3 req-c9bd6b9c-e790-4d56-b72a-2f05d46efb10 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:17:19.033573 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-bef56e3b-6545-4f1e-93a7-cc0fe04709e3 req-c9bd6b9c-e790-4d56-b72a-2f05d46efb10 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:17:19.063691 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-bef56e3b-6545-4f1e-93a7-cc0fe04709e3 req-c9bd6b9c-e790-4d56-b72a-2f05d46efb10 service nova] Creating event network-vif-deleted:d14b66a1-86a2-415c-a4de-a68be3b4318a for instance dde943e5-12d5-4d2c-859a-1ab238280e4e on nch2-master-1 Oct 22 21:17:19.078379 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-bef56e3b-6545-4f1e-93a7-cc0fe04709e3 req-c9bd6b9c-e790-4d56-b72a-2f05d46efb10 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098179 Oct 22 21:17:19.079384 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2534/5055] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:17:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:17:19.183659 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-e96e2ee5-81a8-4552-950b-4cf349511e4b tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '271a94b5c9324dac963afb958f054e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b2530a0555405ab0240fdb0087e6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:17:19.193575 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-e96e2ee5-81a8-4552-950b-4cf349511e4b tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] 10.222.0.18 "GET /compute/v2.1/servers/739c029e-b589-495d-89db-50c7a706b7f7" status: 200 len: 1480 microversion: 2.1 time: 0.301210 Oct 22 21:17:19.219377 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2522/5056] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:17:18 2022] GET /compute/v2.1/servers/739c029e-b589-495d-89db-50c7a706b7f7 => generated 1480 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:17:20.237547 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-a322c612-666d-4be3-8c2a-65d376575f3c tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:17:20.238404 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-a322c612-666d-4be3-8c2a-65d376575f3c tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] [instance: 739c029e-b589-495d-89db-50c7a706b7f7] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:17:20.255592 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a322c612-666d-4be3-8c2a-65d376575f3c tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:17:20.257608 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a322c612-666d-4be3-8c2a-65d376575f3c tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:17:20.259775 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a322c612-666d-4be3-8c2a-65d376575f3c tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:17:20.261892 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a322c612-666d-4be3-8c2a-65d376575f3c tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:17:20.262609 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a322c612-666d-4be3-8c2a-65d376575f3c tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:17:20.263994 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a322c612-666d-4be3-8c2a-65d376575f3c tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:17:20.285103 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.wsgi [None req-a322c612-666d-4be3-8c2a-65d376575f3c tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] HTTP exception thrown: Instance 739c029e-b589-495d-89db-50c7a706b7f7 could not be found. Oct 22 21:17:20.287881 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-a322c612-666d-4be3-8c2a-65d376575f3c tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Request method failure captured: Oct 22 21:17:20.287881 ncdv-master-1 devstack@n-api.service[138745]: request: GET /compute/v2.1/servers/739c029e-b589-495d-89db-50c7a706b7f7 HTTP/1.1 Oct 22 21:17:20.287881 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 21:17:20.287881 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 21:17:20.287881 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 21:17:20.287881 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 0 Oct 22 21:17:20.287881 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 21:17:20.287881 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 21:17:20.287881 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 21:17:20.287881 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 21:17:20.287881 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVF26k_ApaAj3vJ-NHGRb2NjCUYlq5hDr7GaQ3K7mKoB5XY0ezvNlvwBTDl7jFZ1RI69LZf7-L53_zfYbxMaO9th7xloXmk1Z2JTV9HIUlMJ0Guh0bK_1bj1Em5OQKOCFPpr9qqnfBwUL-LY6Jch2aeL8zXsS0IQIzHH0-S3ZVWyXgEY Oct 22 21:17:20.287881 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 21:17:20.287881 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 21:17:20.287881 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 21:17:20.287881 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 21:17:20.287881 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 21:17:20.287881 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 21:17:20.287881 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: d4b2530a0555405ab0240fdb0087e6a8 Oct 22 21:17:20.287881 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-ListServersNegativeTestJSON-1599927421 Oct 22 21:17:20.287881 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 21:17:20.287881 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 21:17:20.287881 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_d4b2530a0555405ab0240fdb0087e6a8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d4b2530a0555405ab0240fdb0087e6a8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/d4b2530a0555405ab0240fdb0087e6a8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d4b2530a0555405ab0240fdb0087e6a8"}]}] Oct 22 21:17:20.287881 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-ListServersNegativeTestJSON-1599927421 Oct 22 21:17:20.287881 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: d4b2530a0555405ab0240fdb0087e6a8 Oct 22 21:17:20.287881 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1599927421 Oct 22 21:17:20.287881 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-ListServersNegativeTestJSON-1599927421-project Oct 22 21:17:20.287881 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 21:17:20.287881 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 21:17:20.287881 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: 271a94b5c9324dac963afb958f054e0f Oct 22 21:17:20.287881 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-ListServersNegativeTestJSON-1599927421-project Oct 22 21:17:20.287881 ncdv-master-1 devstack@n-api.service[138745]: method: > Oct 22 21:17:20.287881 ncdv-master-1 devstack@n-api.service[138745]: exception: Instance 739c029e-b589-495d-89db-50c7a706b7f7 could not be found. Oct 22 21:17:20.287881 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'id': '739c029e-b589-495d-89db-50c7a706b7f7'} Oct 22 21:17:20.287881 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:17:20.287881 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:17:20.287881 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 21:17:20.287881 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 21:17:20.287881 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 21:17:20.287881 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 21:17:20.287881 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 21:17:20.287881 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 21:17:20.287881 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 21:17:20.287881 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 21:17:20.287881 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 739c029e-b589-495d-89db-50c7a706b7f7 could not be found. Oct 22 21:17:20.287881 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:17:20.287881 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:17:20.287881 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:17:20.287881 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:17:20.287881 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:17:20.287881 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:17:20.287881 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:17:20.287881 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:17:20.287881 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:17:20.287881 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:17:20.287881 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 21:17:20.287881 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 21:17:20.287881 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 21:17:20.287881 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 21:17:20.287881 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 21:17:20.287881 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:17:20.287881 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 739c029e-b589-495d-89db-50c7a706b7f7 could not be found. Oct 22 21:17:20.287881 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:17:20.287881 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:17:20.291570 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:17:20.291570 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:17:20.291570 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:17:20.291570 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:17:20.291570 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:17:20.291570 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:17:20.291570 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 739c029e-b589-495d-89db-50c7a706b7f7 could not be found. Oct 22 21:17:20.291570 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:17:20.294589 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-a322c612-666d-4be3-8c2a-65d376575f3c tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Returning 404 to user: Instance 739c029e-b589-495d-89db-50c7a706b7f7 could not be found. {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:17:20.295796 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-a322c612-666d-4be3-8c2a-65d376575f3c tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] 10.222.0.18 "GET /compute/v2.1/servers/739c029e-b589-495d-89db-50c7a706b7f7" status: 404 len: 111 microversion: 2.1 time: 0.063684 Oct 22 21:17:20.300409 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2535/5057] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:17:20 2022] GET /compute/v2.1/servers/739c029e-b589-495d-89db-50c7a706b7f7 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 21:17:20.305222 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-06745bea-4ab6-4252-8251-36d4d1ac96bf tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:17:20.305905 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-06745bea-4ab6-4252-8251-36d4d1ac96bf tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] [instance: dde943e5-12d5-4d2c-859a-1ab238280e4e] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:17:20.319193 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-06745bea-4ab6-4252-8251-36d4d1ac96bf tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:17:20.319739 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-06745bea-4ab6-4252-8251-36d4d1ac96bf tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:17:20.320193 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-06745bea-4ab6-4252-8251-36d4d1ac96bf tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:17:20.320926 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-06745bea-4ab6-4252-8251-36d4d1ac96bf tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:17:20.321389 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-06745bea-4ab6-4252-8251-36d4d1ac96bf tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:17:20.321827 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-06745bea-4ab6-4252-8251-36d4d1ac96bf tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:17:20.353611 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-06745bea-4ab6-4252-8251-36d4d1ac96bf tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] HTTP exception thrown: Instance dde943e5-12d5-4d2c-859a-1ab238280e4e could not be found. Oct 22 21:17:20.355678 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-06745bea-4ab6-4252-8251-36d4d1ac96bf tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Request method failure captured: Oct 22 21:17:20.355678 ncdv-master-1 devstack@n-api.service[138744]: request: GET /compute/v2.1/servers/dde943e5-12d5-4d2c-859a-1ab238280e4e HTTP/1.1 Oct 22 21:17:20.355678 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 21:17:20.355678 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 21:17:20.355678 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 21:17:20.355678 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 0 Oct 22 21:17:20.355678 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 21:17:20.355678 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 21:17:20.355678 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 21:17:20.355678 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 21:17:20.355678 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVF26k_ApaAj3vJ-NHGRb2NjCUYlq5hDr7GaQ3K7mKoB5XY0ezvNlvwBTDl7jFZ1RI69LZf7-L53_zfYbxMaO9th7xloXmk1Z2JTV9HIUlMJ0Guh0bK_1bj1Em5OQKOCFPpr9qqnfBwUL-LY6Jch2aeL8zXsS0IQIzHH0-S3ZVWyXgEY Oct 22 21:17:20.355678 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 21:17:20.355678 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 21:17:20.355678 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 21:17:20.355678 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 21:17:20.355678 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 21:17:20.355678 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 21:17:20.355678 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: d4b2530a0555405ab0240fdb0087e6a8 Oct 22 21:17:20.355678 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-ListServersNegativeTestJSON-1599927421 Oct 22 21:17:20.355678 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 21:17:20.355678 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 21:17:20.355678 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_d4b2530a0555405ab0240fdb0087e6a8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d4b2530a0555405ab0240fdb0087e6a8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/d4b2530a0555405ab0240fdb0087e6a8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d4b2530a0555405ab0240fdb0087e6a8"}]}] Oct 22 21:17:20.355678 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-ListServersNegativeTestJSON-1599927421 Oct 22 21:17:20.355678 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: d4b2530a0555405ab0240fdb0087e6a8 Oct 22 21:17:20.355678 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1599927421 Oct 22 21:17:20.355678 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-ListServersNegativeTestJSON-1599927421-project Oct 22 21:17:20.355678 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 21:17:20.355678 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 21:17:20.355678 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: 271a94b5c9324dac963afb958f054e0f Oct 22 21:17:20.355678 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-ListServersNegativeTestJSON-1599927421-project Oct 22 21:17:20.355678 ncdv-master-1 devstack@n-api.service[138744]: method: > Oct 22 21:17:20.355678 ncdv-master-1 devstack@n-api.service[138744]: exception: Instance dde943e5-12d5-4d2c-859a-1ab238280e4e could not be found. Oct 22 21:17:20.355678 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': 'dde943e5-12d5-4d2c-859a-1ab238280e4e'} Oct 22 21:17:20.355678 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:17:20.355678 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:17:20.355678 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 21:17:20.355678 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 21:17:20.355678 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 21:17:20.355678 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 21:17:20.355678 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 21:17:20.355678 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 21:17:20.355678 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 21:17:20.355678 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 21:17:20.355678 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dde943e5-12d5-4d2c-859a-1ab238280e4e could not be found. Oct 22 21:17:20.355678 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:17:20.355678 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:17:20.355678 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:17:20.355678 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:17:20.355678 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:17:20.355678 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:17:20.355678 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:17:20.355678 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:17:20.355678 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:17:20.355678 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:17:20.355678 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 21:17:20.355678 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 21:17:20.355678 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 21:17:20.355678 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 21:17:20.355678 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 21:17:20.355678 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:17:20.355678 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dde943e5-12d5-4d2c-859a-1ab238280e4e could not be found. Oct 22 21:17:20.355678 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:17:20.355678 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:17:20.359279 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:17:20.359279 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:17:20.359279 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:17:20.359279 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:17:20.359279 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:17:20.359279 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:17:20.359279 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dde943e5-12d5-4d2c-859a-1ab238280e4e could not be found. Oct 22 21:17:20.359279 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:17:20.359279 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-06745bea-4ab6-4252-8251-36d4d1ac96bf tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] Returning 404 to user: Instance dde943e5-12d5-4d2c-859a-1ab238280e4e could not be found. {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:17:20.359279 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-06745bea-4ab6-4252-8251-36d4d1ac96bf tempest-ListServersNegativeTestJSON-1599927421 tempest-ListServersNegativeTestJSON-1599927421-project] 10.222.0.18 "GET /compute/v2.1/servers/dde943e5-12d5-4d2c-859a-1ab238280e4e" status: 404 len: 111 microversion: 2.1 time: 0.056143 Oct 22 21:17:20.359279 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2523/5058] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:17:20 2022] GET /compute/v2.1/servers/dde943e5-12d5-4d2c-859a-1ab238280e4e => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 22 21:17:21.147080 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-342a0a16-c649-476f-b871-f897aa12a653 req-561b3595-71ed-478c-8df9-7be665034ab3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "739c029e-b589-495d-89db-50c7a706b7f7", "name": "network-vif-deleted", "tag": "8bf4ea8f-c61d-4368-8ed8-6fea715d71ee"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:17:21.173814 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-342a0a16-c649-476f-b871-f897aa12a653 req-561b3595-71ed-478c-8df9-7be665034ab3 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:17:21.174611 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-342a0a16-c649-476f-b871-f897aa12a653 req-561b3595-71ed-478c-8df9-7be665034ab3 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:17:21.175287 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-342a0a16-c649-476f-b871-f897aa12a653 req-561b3595-71ed-478c-8df9-7be665034ab3 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:17:21.220115 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-342a0a16-c649-476f-b871-f897aa12a653 req-561b3595-71ed-478c-8df9-7be665034ab3 service nova] Creating event network-vif-deleted:8bf4ea8f-c61d-4368-8ed8-6fea715d71ee for instance 739c029e-b589-495d-89db-50c7a706b7f7 on nch1-master-1 Oct 22 21:17:21.232444 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-342a0a16-c649-476f-b871-f897aa12a653 req-561b3595-71ed-478c-8df9-7be665034ab3 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092132 Oct 22 21:17:21.237636 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2536/5059] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:17:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:17:21.621638 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-246c2a1d-2df7-49f3-8ea5-79501faf5e61 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2075012339", "imageRef": "085e4478-6edc-4a69-8e08-f9831713eb65", "flavorRef": "452", "networks": [{"uuid": "b17a38c5-877b-428d-bd53-e74609d155b2"}]}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:17:21.730103 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.network.neutron [None req-246c2a1d-2df7-49f3-8ea5-79501faf5e61 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] validate_networks() for [('b17a38c5-877b-428d-bd53-e74609d155b2', None, None, None, None, None)] {{(pid=138744) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 21:17:22.484463 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-246c2a1d-2df7-49f3-8ea5-79501faf5e61 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Flavor limits 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 21:17:22.486405 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-246c2a1d-2df7-49f3-8ea5-79501faf5e61 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Image limits 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 21:17:22.487685 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-246c2a1d-2df7-49f3-8ea5-79501faf5e61 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Flavor pref 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 21:17:22.508277 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-246c2a1d-2df7-49f3-8ea5-79501faf5e61 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Image pref 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 21:17:22.509054 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-246c2a1d-2df7-49f3-8ea5-79501faf5e61 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 21:17:22.539894 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-246c2a1d-2df7-49f3-8ea5-79501faf5e61 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:17:22.540391 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-246c2a1d-2df7-49f3-8ea5-79501faf5e61 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:17:22.540838 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-246c2a1d-2df7-49f3-8ea5-79501faf5e61 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:17:22.549494 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-246c2a1d-2df7-49f3-8ea5-79501faf5e61 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:17:22.550025 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-246c2a1d-2df7-49f3-8ea5-79501faf5e61 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:17:22.550506 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-246c2a1d-2df7-49f3-8ea5-79501faf5e61 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:17:22.608278 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-246c2a1d-2df7-49f3-8ea5-79501faf5e61 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Getting quotas for project 28af724189a24022b3ef7651b7157a9d. Resources: {'cores', 'instances', 'ram'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 21:17:22.622456 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-246c2a1d-2df7-49f3-8ea5-79501faf5e61 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Getting quotas for user 6c8a9229e7da421b9e0e6f7df52f71e2 and project 28af724189a24022b3ef7651b7157a9d. Resources: {'cores', 'instances', 'ram'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 21:17:22.667568 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-246c2a1d-2df7-49f3-8ea5-79501faf5e61 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Going to run 1 instances... {{(pid=138744) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 21:17:22.670553 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-246c2a1d-2df7-49f3-8ea5-79501faf5e61 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] [instance: 3de67bb0-04d9-4d3a-a925-102f04d677bb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='085e4478-6edc-4a69-8e08-f9831713eb65',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138744) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 21:17:22.778305 ncdv-master-1 devstack@n-api.service[138744]: ERROR oslo.messaging._drivers.impl_rabbit [None req-246c2a1d-2df7-49f3-8ea5-79501faf5e61 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] [894ea493-95ca-42ff-9245-6702fbcc6ce0] AMQP server on 10.222.0.18:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 22 21:17:23.789342 ncdv-master-1 devstack@n-api.service[138744]: INFO oslo.messaging._drivers.impl_rabbit [None req-246c2a1d-2df7-49f3-8ea5-79501faf5e61 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] [894ea493-95ca-42ff-9245-6702fbcc6ce0] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 47558. Oct 22 21:17:23.794573 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-246c2a1d-2df7-49f3-8ea5-79501faf5e61 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.373389 Oct 22 21:17:23.794772 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2524/5060] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Oct 22 21:17:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 2375 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 21:17:23.806771 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-da02f2fc-b60f-43c5-b617-e9c983a7e0b5 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:17:23.808835 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-da02f2fc-b60f-43c5-b617-e9c983a7e0b5 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] [instance: 3de67bb0-04d9-4d3a-a925-102f04d677bb] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:17:23.931445 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell0:SELECT=2 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:17:23.976882 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-da02f2fc-b60f-43c5-b617-e9c983a7e0b5 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a9229e7da421b9e0e6f7df52f71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28af724189a24022b3ef7651b7157a9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:17:23.994185 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-da02f2fc-b60f-43c5-b617-e9c983a7e0b5 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] 10.222.0.18 "GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb" status: 200 len: 1217 microversion: 2.1 time: 0.191586 Oct 22 21:17:23.995513 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2537/5061] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:17:23 2022] GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb => generated 1217 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:17:25.022264 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-409d46c2-b959-4bf2-9e28-2ac38d352d30 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:17:25.023602 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-409d46c2-b959-4bf2-9e28-2ac38d352d30 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] [instance: 3de67bb0-04d9-4d3a-a925-102f04d677bb] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:17:25.041341 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-409d46c2-b959-4bf2-9e28-2ac38d352d30 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:17:25.041844 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-409d46c2-b959-4bf2-9e28-2ac38d352d30 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:17:25.042293 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-409d46c2-b959-4bf2-9e28-2ac38d352d30 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:17:25.043022 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-409d46c2-b959-4bf2-9e28-2ac38d352d30 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:17:25.043524 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-409d46c2-b959-4bf2-9e28-2ac38d352d30 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:17:25.043995 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-409d46c2-b959-4bf2-9e28-2ac38d352d30 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:17:25.267919 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-409d46c2-b959-4bf2-9e28-2ac38d352d30 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a9229e7da421b9e0e6f7df52f71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28af724189a24022b3ef7651b7157a9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:17:25.279476 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-409d46c2-b959-4bf2-9e28-2ac38d352d30 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] 10.222.0.18 "GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb" status: 200 len: 1269 microversion: 2.1 time: 0.261221 Oct 22 21:17:25.303873 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2525/5062] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:17:25 2022] GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb => generated 1269 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:17:26.310343 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-2e266779-749b-4b83-9926-cb2acf983b03 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:17:26.311618 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-2e266779-749b-4b83-9926-cb2acf983b03 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] [instance: 3de67bb0-04d9-4d3a-a925-102f04d677bb] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:17:26.332405 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell0:SELECT=8 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:17:26.336132 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2e266779-749b-4b83-9926-cb2acf983b03 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:17:26.343376 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2e266779-749b-4b83-9926-cb2acf983b03 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:17:26.344204 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2e266779-749b-4b83-9926-cb2acf983b03 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:17:26.345420 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2e266779-749b-4b83-9926-cb2acf983b03 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:17:26.346153 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2e266779-749b-4b83-9926-cb2acf983b03 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:17:26.347182 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2e266779-749b-4b83-9926-cb2acf983b03 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:17:26.566743 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-2e266779-749b-4b83-9926-cb2acf983b03 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a9229e7da421b9e0e6f7df52f71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28af724189a24022b3ef7651b7157a9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:17:26.575658 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-2e266779-749b-4b83-9926-cb2acf983b03 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] 10.222.0.18 "GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb" status: 200 len: 1275 microversion: 2.1 time: 0.269163 Oct 22 21:17:26.589514 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2538/5063] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:17:26 2022] GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb => generated 1275 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:17:27.607314 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-412d7c65-5dbf-4941-931a-729dd1d28317 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:17:27.608766 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-412d7c65-5dbf-4941-931a-729dd1d28317 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] [instance: 3de67bb0-04d9-4d3a-a925-102f04d677bb] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:17:27.618252 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-412d7c65-5dbf-4941-931a-729dd1d28317 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:17:27.620810 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-412d7c65-5dbf-4941-931a-729dd1d28317 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:17:27.621709 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-412d7c65-5dbf-4941-931a-729dd1d28317 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:17:27.623539 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-412d7c65-5dbf-4941-931a-729dd1d28317 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:17:27.625723 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-412d7c65-5dbf-4941-931a-729dd1d28317 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:17:27.627829 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-412d7c65-5dbf-4941-931a-729dd1d28317 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:17:28.065050 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-412d7c65-5dbf-4941-931a-729dd1d28317 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a9229e7da421b9e0e6f7df52f71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28af724189a24022b3ef7651b7157a9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:17:28.082450 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-412d7c65-5dbf-4941-931a-729dd1d28317 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] 10.222.0.18 "GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb" status: 200 len: 1317 microversion: 2.1 time: 0.483740 Oct 22 21:17:28.085096 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2526/5064] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:17:27 2022] GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb => generated 1317 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:17:28.927603 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-84639491-a820-4537-b487-f41458fad62a req-dcf9043b-29ff-4cce-92f7-e07b66335e9e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3de67bb0-04d9-4d3a-a925-102f04d677bb", "tag": "1ae72240-5ec3-4fe0-b5c9-40ffe2e04689"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:17:28.947027 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_api:SELECT=70,nova_api:UPDATE=2 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:17:28.970542 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-84639491-a820-4537-b487-f41458fad62a req-dcf9043b-29ff-4cce-92f7-e07b66335e9e service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:17:28.971544 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-84639491-a820-4537-b487-f41458fad62a req-dcf9043b-29ff-4cce-92f7-e07b66335e9e service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:17:28.972465 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-84639491-a820-4537-b487-f41458fad62a req-dcf9043b-29ff-4cce-92f7-e07b66335e9e service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:17:29.007601 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-84639491-a820-4537-b487-f41458fad62a req-dcf9043b-29ff-4cce-92f7-e07b66335e9e service nova] Creating event network-changed:1ae72240-5ec3-4fe0-b5c9-40ffe2e04689 for instance 3de67bb0-04d9-4d3a-a925-102f04d677bb on nch1-master-1 Oct 22 21:17:29.022902 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-84639491-a820-4537-b487-f41458fad62a req-dcf9043b-29ff-4cce-92f7-e07b66335e9e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102854 Oct 22 21:17:29.025033 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2539/5065] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:17:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:17:29.112535 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-8aea2637-7337-4720-a507-9f84088abbda tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:17:29.115566 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-8aea2637-7337-4720-a507-9f84088abbda tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] [instance: 3de67bb0-04d9-4d3a-a925-102f04d677bb] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:17:29.118526 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_api:SELECT=77,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:17:29.126499 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8aea2637-7337-4720-a507-9f84088abbda tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:17:29.128720 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8aea2637-7337-4720-a507-9f84088abbda tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:17:29.130429 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8aea2637-7337-4720-a507-9f84088abbda tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:17:29.131438 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8aea2637-7337-4720-a507-9f84088abbda tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:17:29.133150 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8aea2637-7337-4720-a507-9f84088abbda tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:17:29.133717 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8aea2637-7337-4720-a507-9f84088abbda tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:17:30.014614 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-8aea2637-7337-4720-a507-9f84088abbda tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a9229e7da421b9e0e6f7df52f71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28af724189a24022b3ef7651b7157a9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:17:30.033728 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-8aea2637-7337-4720-a507-9f84088abbda tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] 10.222.0.18 "GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb" status: 200 len: 1317 microversion: 2.1 time: 0.925161 Oct 22 21:17:30.034484 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2527/5066] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:17:29 2022] GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb => generated 1317 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:17:31.058746 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-7c451188-b82c-4584-8670-8542040ccb86 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:17:31.059936 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-7c451188-b82c-4584-8670-8542040ccb86 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] [instance: 3de67bb0-04d9-4d3a-a925-102f04d677bb] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:17:31.071499 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7c451188-b82c-4584-8670-8542040ccb86 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:17:31.072282 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7c451188-b82c-4584-8670-8542040ccb86 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:17:31.073215 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7c451188-b82c-4584-8670-8542040ccb86 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:17:31.074079 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7c451188-b82c-4584-8670-8542040ccb86 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:17:31.075289 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7c451188-b82c-4584-8670-8542040ccb86 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:17:31.075855 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7c451188-b82c-4584-8670-8542040ccb86 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:17:31.295611 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-7c451188-b82c-4584-8670-8542040ccb86 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a9229e7da421b9e0e6f7df52f71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28af724189a24022b3ef7651b7157a9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:17:31.313068 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-7c451188-b82c-4584-8670-8542040ccb86 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] 10.222.0.18 "GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb" status: 200 len: 1317 microversion: 2.1 time: 0.259823 Oct 22 21:17:31.328682 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2540/5067] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:17:31 2022] GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb => generated 1317 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:17:32.338534 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-478fa132-6fa1-4be1-b69a-a0ec902a8772 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:17:32.340063 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-478fa132-6fa1-4be1-b69a-a0ec902a8772 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] [instance: 3de67bb0-04d9-4d3a-a925-102f04d677bb] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:17:32.369845 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-478fa132-6fa1-4be1-b69a-a0ec902a8772 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:17:32.370347 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-478fa132-6fa1-4be1-b69a-a0ec902a8772 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:17:32.370870 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-478fa132-6fa1-4be1-b69a-a0ec902a8772 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:17:32.371813 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-478fa132-6fa1-4be1-b69a-a0ec902a8772 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:17:32.372356 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-478fa132-6fa1-4be1-b69a-a0ec902a8772 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:17:32.372839 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-478fa132-6fa1-4be1-b69a-a0ec902a8772 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:17:32.590682 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell0:SELECT=8 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:17:32.644778 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell0:SELECT=6 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:17:32.745282 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-478fa132-6fa1-4be1-b69a-a0ec902a8772 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a9229e7da421b9e0e6f7df52f71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28af724189a24022b3ef7651b7157a9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:17:32.759071 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-478fa132-6fa1-4be1-b69a-a0ec902a8772 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] 10.222.0.18 "GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb" status: 200 len: 1317 microversion: 2.1 time: 0.424981 Oct 22 21:17:32.760141 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2528/5068] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:17:32 2022] GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb => generated 1317 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:17:33.784410 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-fac43ba2-e59d-4967-a325-763c4f5b3012 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:17:33.785587 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-fac43ba2-e59d-4967-a325-763c4f5b3012 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] [instance: 3de67bb0-04d9-4d3a-a925-102f04d677bb] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:17:33.803733 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fac43ba2-e59d-4967-a325-763c4f5b3012 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:17:33.804406 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fac43ba2-e59d-4967-a325-763c4f5b3012 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:17:33.804990 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fac43ba2-e59d-4967-a325-763c4f5b3012 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:17:33.806204 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fac43ba2-e59d-4967-a325-763c4f5b3012 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:17:33.806790 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fac43ba2-e59d-4967-a325-763c4f5b3012 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:17:33.807350 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fac43ba2-e59d-4967-a325-763c4f5b3012 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:17:33.993321 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell0:SELECT=2 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:17:34.224173 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-fac43ba2-e59d-4967-a325-763c4f5b3012 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a9229e7da421b9e0e6f7df52f71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28af724189a24022b3ef7651b7157a9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:17:34.293794 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-fac43ba2-e59d-4967-a325-763c4f5b3012 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] 10.222.0.18 "GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb" status: 200 len: 1317 microversion: 2.1 time: 0.512330 Oct 22 21:17:34.294657 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2541/5069] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:17:33 2022] GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb => generated 1317 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:17:34.971661 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-c3e6b509-7154-4c17-885a-284f1cc5ac0f req-aecc4737-e8fa-4f2a-8883-5189cce31732 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3de67bb0-04d9-4d3a-a925-102f04d677bb", "name": "network-vif-plugged", "status": "completed", "tag": "1ae72240-5ec3-4fe0-b5c9-40ffe2e04689"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:17:34.991867 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-c3e6b509-7154-4c17-885a-284f1cc5ac0f req-aecc4737-e8fa-4f2a-8883-5189cce31732 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:17:34.996412 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-c3e6b509-7154-4c17-885a-284f1cc5ac0f req-aecc4737-e8fa-4f2a-8883-5189cce31732 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:17:35.000079 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-c3e6b509-7154-4c17-885a-284f1cc5ac0f req-aecc4737-e8fa-4f2a-8883-5189cce31732 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:17:35.030269 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-c3e6b509-7154-4c17-885a-284f1cc5ac0f req-aecc4737-e8fa-4f2a-8883-5189cce31732 service nova] Creating event network-vif-plugged:1ae72240-5ec3-4fe0-b5c9-40ffe2e04689 for instance 3de67bb0-04d9-4d3a-a925-102f04d677bb on nch1-master-1 Oct 22 21:17:35.038646 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-c3e6b509-7154-4c17-885a-284f1cc5ac0f req-aecc4737-e8fa-4f2a-8883-5189cce31732 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071526 Oct 22 21:17:35.040412 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2529/5070] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:17:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:17:35.318126 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-47ae04d4-2ed9-4720-b889-3a9c9f1fb243 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:17:35.319483 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-47ae04d4-2ed9-4720-b889-3a9c9f1fb243 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] [instance: 3de67bb0-04d9-4d3a-a925-102f04d677bb] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:17:35.331603 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-47ae04d4-2ed9-4720-b889-3a9c9f1fb243 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:17:35.333342 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-47ae04d4-2ed9-4720-b889-3a9c9f1fb243 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:17:35.334150 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-47ae04d4-2ed9-4720-b889-3a9c9f1fb243 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:17:35.335311 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-47ae04d4-2ed9-4720-b889-3a9c9f1fb243 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:17:35.336221 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-47ae04d4-2ed9-4720-b889-3a9c9f1fb243 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:17:35.336928 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-47ae04d4-2ed9-4720-b889-3a9c9f1fb243 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:17:35.664472 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-47ae04d4-2ed9-4720-b889-3a9c9f1fb243 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a9229e7da421b9e0e6f7df52f71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28af724189a24022b3ef7651b7157a9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:17:35.680766 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-47ae04d4-2ed9-4720-b889-3a9c9f1fb243 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] 10.222.0.18 "GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb" status: 200 len: 1317 microversion: 2.1 time: 0.363245 Oct 22 21:17:35.687599 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2542/5071] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:17:35 2022] GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb => generated 1317 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:17:36.718313 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-d6ed1d96-4df3-4094-b29a-fabc673b8179 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:17:36.723387 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-d6ed1d96-4df3-4094-b29a-fabc673b8179 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] [instance: 3de67bb0-04d9-4d3a-a925-102f04d677bb] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:17:36.744061 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d6ed1d96-4df3-4094-b29a-fabc673b8179 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:17:36.745739 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d6ed1d96-4df3-4094-b29a-fabc673b8179 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:17:36.747046 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d6ed1d96-4df3-4094-b29a-fabc673b8179 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:17:36.748547 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d6ed1d96-4df3-4094-b29a-fabc673b8179 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:17:36.749437 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d6ed1d96-4df3-4094-b29a-fabc673b8179 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:17:36.751010 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d6ed1d96-4df3-4094-b29a-fabc673b8179 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:17:37.006656 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-d6ed1d96-4df3-4094-b29a-fabc673b8179 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a9229e7da421b9e0e6f7df52f71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28af724189a24022b3ef7651b7157a9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:17:37.019906 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-d6ed1d96-4df3-4094-b29a-fabc673b8179 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] 10.222.0.18 "GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb" status: 200 len: 1507 microversion: 2.1 time: 0.308762 Oct 22 21:17:37.022218 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2530/5072] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:17:36 2022] GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb => generated 1507 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:17:37.153608 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-e3a1749b-cd83-470d-aa07-3ac2d84bf7a7 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1363573838", "imageRef": "085e4478-6edc-4a69-8e08-f9831713eb65", "flavorRef": "452", "networks": [{"uuid": "b17a38c5-877b-428d-bd53-e74609d155b2"}]}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:17:37.246127 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.network.neutron [None req-e3a1749b-cd83-470d-aa07-3ac2d84bf7a7 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] validate_networks() for [('b17a38c5-877b-428d-bd53-e74609d155b2', None, None, None, None, None)] {{(pid=138745) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 21:17:38.460832 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-e3a1749b-cd83-470d-aa07-3ac2d84bf7a7 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Flavor limits 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 21:17:38.462611 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-e3a1749b-cd83-470d-aa07-3ac2d84bf7a7 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Image limits 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 21:17:38.463383 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-e3a1749b-cd83-470d-aa07-3ac2d84bf7a7 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Flavor pref 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 21:17:38.464048 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-e3a1749b-cd83-470d-aa07-3ac2d84bf7a7 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Image pref 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 21:17:38.464705 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-e3a1749b-cd83-470d-aa07-3ac2d84bf7a7 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 21:17:38.481588 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e3a1749b-cd83-470d-aa07-3ac2d84bf7a7 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:17:38.482973 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e3a1749b-cd83-470d-aa07-3ac2d84bf7a7 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:17:38.483708 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e3a1749b-cd83-470d-aa07-3ac2d84bf7a7 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:17:38.484702 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e3a1749b-cd83-470d-aa07-3ac2d84bf7a7 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:17:38.485410 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e3a1749b-cd83-470d-aa07-3ac2d84bf7a7 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:17:38.486630 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e3a1749b-cd83-470d-aa07-3ac2d84bf7a7 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:17:38.514093 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-e3a1749b-cd83-470d-aa07-3ac2d84bf7a7 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Getting quotas for project 28af724189a24022b3ef7651b7157a9d. Resources: {'cores', 'instances', 'ram'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 21:17:38.521780 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-e3a1749b-cd83-470d-aa07-3ac2d84bf7a7 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Getting quotas for user 6c8a9229e7da421b9e0e6f7df52f71e2 and project 28af724189a24022b3ef7651b7157a9d. Resources: {'cores', 'instances', 'ram'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 21:17:38.545601 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-e3a1749b-cd83-470d-aa07-3ac2d84bf7a7 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Going to run 1 instances... {{(pid=138745) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 21:17:38.552564 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-e3a1749b-cd83-470d-aa07-3ac2d84bf7a7 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] [instance: cea3693e-cb10-4129-9f00-18f678998bbd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='085e4478-6edc-4a69-8e08-f9831713eb65',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138745) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 21:17:38.715383 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-e3a1749b-cd83-470d-aa07-3ac2d84bf7a7 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.563444 Oct 22 21:17:38.720757 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2543/5073] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Oct 22 21:17:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 1572 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 21:17:38.733718 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-ccd0b4ad-f6bb-4bc8-89ca-199f8aeb1bf6 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:17:38.735882 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-ccd0b4ad-f6bb-4bc8-89ca-199f8aeb1bf6 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] [instance: cea3693e-cb10-4129-9f00-18f678998bbd] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:17:38.840967 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-ccd0b4ad-f6bb-4bc8-89ca-199f8aeb1bf6 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a9229e7da421b9e0e6f7df52f71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28af724189a24022b3ef7651b7157a9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:17:38.851329 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-ccd0b4ad-f6bb-4bc8-89ca-199f8aeb1bf6 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] 10.222.0.18 "GET /compute/v2.1/servers/cea3693e-cb10-4129-9f00-18f678998bbd" status: 200 len: 1217 microversion: 2.1 time: 0.122508 Oct 22 21:17:38.856310 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2544/5074] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:17:38 2022] GET /compute/v2.1/servers/cea3693e-cb10-4129-9f00-18f678998bbd => generated 1217 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:17:38.999737 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-d5eef627-fe97-4bba-9d18-fc914580956a tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Action: 'create', calling method: .version_select at 0x7fd3a44b4b80>, body: {"keypair": {"name": "tempest-keypair-486334743", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGXwgCqY4E8ATLT7+sL/f/XqjR4aVO2UyRYDKLVQcMvxkRcSO/COTcf8dd18yAUqIJZQKJr4zGm9Ke/xtNJpXtJZYl5vWgS6jeMmXXhGyUUUZNB93yD7zGgHQrAPXJpBvA=="}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:17:39.028327 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-d5eef627-fe97-4bba-9d18-fc914580956a tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Getting quotas for project 45cb377c6a9a43b3b91c99a64e37f1eb. Resources: {'key_pairs'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 21:17:39.035726 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-d5eef627-fe97-4bba-9d18-fc914580956a tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Getting quotas for user c9c85602851244d4a632b9c861eb4416 and project 45cb377c6a9a43b3b91c99a64e37f1eb. Resources: {'key_pairs'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 21:17:39.067194 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-d5eef627-fe97-4bba-9d18-fc914580956a tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.659483 Oct 22 21:17:39.068063 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2531/5075] 10.222.0.18 () {60 vars in 1159 bytes} [Sat Oct 22 21:17:38 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:17:39.895970 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-6686c2fb-79b2-46e8-8036-92d8e9a09dc2 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:17:39.897790 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-6686c2fb-79b2-46e8-8036-92d8e9a09dc2 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] [instance: cea3693e-cb10-4129-9f00-18f678998bbd] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:17:39.909465 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6686c2fb-79b2-46e8-8036-92d8e9a09dc2 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:17:39.912015 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6686c2fb-79b2-46e8-8036-92d8e9a09dc2 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:17:39.915958 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6686c2fb-79b2-46e8-8036-92d8e9a09dc2 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:17:39.917108 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6686c2fb-79b2-46e8-8036-92d8e9a09dc2 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:17:39.917737 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6686c2fb-79b2-46e8-8036-92d8e9a09dc2 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:17:39.918506 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6686c2fb-79b2-46e8-8036-92d8e9a09dc2 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:17:40.156074 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-6686c2fb-79b2-46e8-8036-92d8e9a09dc2 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a9229e7da421b9e0e6f7df52f71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28af724189a24022b3ef7651b7157a9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:17:40.179013 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-6686c2fb-79b2-46e8-8036-92d8e9a09dc2 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] 10.222.0.18 "GET /compute/v2.1/servers/cea3693e-cb10-4129-9f00-18f678998bbd" status: 200 len: 1269 microversion: 2.1 time: 0.304596 Oct 22 21:17:40.180120 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2545/5076] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:17:39 2022] GET /compute/v2.1/servers/cea3693e-cb10-4129-9f00-18f678998bbd => generated 1269 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:17:41.202079 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-95a4ee78-9bed-472f-9190-8b894e218cf0 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:17:41.202704 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-95a4ee78-9bed-472f-9190-8b894e218cf0 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] [instance: cea3693e-cb10-4129-9f00-18f678998bbd] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:17:41.223071 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-95a4ee78-9bed-472f-9190-8b894e218cf0 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:17:41.223602 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-95a4ee78-9bed-472f-9190-8b894e218cf0 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:17:41.224104 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-95a4ee78-9bed-472f-9190-8b894e218cf0 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:17:41.225170 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-95a4ee78-9bed-472f-9190-8b894e218cf0 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:17:41.225780 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-95a4ee78-9bed-472f-9190-8b894e218cf0 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:17:41.226358 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-95a4ee78-9bed-472f-9190-8b894e218cf0 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:17:41.375179 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-95a4ee78-9bed-472f-9190-8b894e218cf0 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a9229e7da421b9e0e6f7df52f71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28af724189a24022b3ef7651b7157a9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:17:41.390679 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-95a4ee78-9bed-472f-9190-8b894e218cf0 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] 10.222.0.18 "GET /compute/v2.1/servers/cea3693e-cb10-4129-9f00-18f678998bbd" status: 200 len: 1275 microversion: 2.1 time: 0.191833 Oct 22 21:17:41.392795 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2532/5077] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:17:41 2022] GET /compute/v2.1/servers/cea3693e-cb10-4129-9f00-18f678998bbd => generated 1275 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:17:42.418398 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-3c5df7a2-db25-49c6-a0c9-d474df0e93bf tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:17:42.419034 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-3c5df7a2-db25-49c6-a0c9-d474df0e93bf tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] [instance: cea3693e-cb10-4129-9f00-18f678998bbd] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:17:42.440404 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3c5df7a2-db25-49c6-a0c9-d474df0e93bf tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:17:42.441359 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3c5df7a2-db25-49c6-a0c9-d474df0e93bf tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:17:42.442059 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3c5df7a2-db25-49c6-a0c9-d474df0e93bf tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:17:42.443223 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3c5df7a2-db25-49c6-a0c9-d474df0e93bf tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:17:42.443975 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3c5df7a2-db25-49c6-a0c9-d474df0e93bf tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:17:42.444642 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3c5df7a2-db25-49c6-a0c9-d474df0e93bf tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:17:42.592312 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-3c5df7a2-db25-49c6-a0c9-d474df0e93bf tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a9229e7da421b9e0e6f7df52f71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28af724189a24022b3ef7651b7157a9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:17:42.606027 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-3c5df7a2-db25-49c6-a0c9-d474df0e93bf tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] 10.222.0.18 "GET /compute/v2.1/servers/cea3693e-cb10-4129-9f00-18f678998bbd" status: 200 len: 1275 microversion: 2.1 time: 0.193656 Oct 22 21:17:42.610063 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2546/5078] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:17:42 2022] GET /compute/v2.1/servers/cea3693e-cb10-4129-9f00-18f678998bbd => generated 1275 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:17:43.617180 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-ffa96361-bf9e-47fb-87b6-a9436d0c891f tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-750540197", "imageRef": "085e4478-6edc-4a69-8e08-f9831713eb65", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8c5a5758-cdfc-480f-aa56-074dfadd0152"}], "security_groups": [{"name": "tempest-securitygroup--1040685805"}], "key_name": "tempest-keypair-486334743", "user_data": "}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:17:43.635985 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-5d2bfccd-eab2-4002-9ad3-ded6ca3cdace tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:17:43.637333 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-5d2bfccd-eab2-4002-9ad3-ded6ca3cdace tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] [instance: cea3693e-cb10-4129-9f00-18f678998bbd] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:17:43.645726 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5d2bfccd-eab2-4002-9ad3-ded6ca3cdace tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:17:43.646521 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5d2bfccd-eab2-4002-9ad3-ded6ca3cdace tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:17:43.647232 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5d2bfccd-eab2-4002-9ad3-ded6ca3cdace tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:17:43.648264 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5d2bfccd-eab2-4002-9ad3-ded6ca3cdace tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:17:43.649007 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5d2bfccd-eab2-4002-9ad3-ded6ca3cdace tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:17:43.649705 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5d2bfccd-eab2-4002-9ad3-ded6ca3cdace tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:17:44.020922 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.network.neutron [None req-ffa96361-bf9e-47fb-87b6-a9436d0c891f tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] validate_networks() for [('8c5a5758-cdfc-480f-aa56-074dfadd0152', None, None, None, None, None)] {{(pid=138744) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 21:17:44.435644 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-5d2bfccd-eab2-4002-9ad3-ded6ca3cdace tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a9229e7da421b9e0e6f7df52f71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28af724189a24022b3ef7651b7157a9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:17:44.443148 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:17:44.447435 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-5d2bfccd-eab2-4002-9ad3-ded6ca3cdace tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] 10.222.0.18 "GET /compute/v2.1/servers/cea3693e-cb10-4129-9f00-18f678998bbd" status: 200 len: 1317 microversion: 2.1 time: 0.813696 Oct 22 21:17:44.458726 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2547/5079] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:17:43 2022] GET /compute/v2.1/servers/cea3693e-cb10-4129-9f00-18f678998bbd => generated 1317 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:17:44.981210 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-ffa96361-bf9e-47fb-87b6-a9436d0c891f tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Flavor limits 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 21:17:44.981686 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-ffa96361-bf9e-47fb-87b6-a9436d0c891f tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Image limits 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 21:17:44.982111 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-ffa96361-bf9e-47fb-87b6-a9436d0c891f tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Flavor pref 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 21:17:44.982532 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-ffa96361-bf9e-47fb-87b6-a9436d0c891f tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Image pref 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 21:17:44.982953 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-ffa96361-bf9e-47fb-87b6-a9436d0c891f tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 21:17:44.999770 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ffa96361-bf9e-47fb-87b6-a9436d0c891f tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:17:45.000539 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ffa96361-bf9e-47fb-87b6-a9436d0c891f tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:17:45.002093 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ffa96361-bf9e-47fb-87b6-a9436d0c891f tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:17:45.004604 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ffa96361-bf9e-47fb-87b6-a9436d0c891f tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:17:45.005267 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ffa96361-bf9e-47fb-87b6-a9436d0c891f tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:17:45.006650 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ffa96361-bf9e-47fb-87b6-a9436d0c891f tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:17:45.029250 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:17:45.057665 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-ffa96361-bf9e-47fb-87b6-a9436d0c891f tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Getting quotas for project 45cb377c6a9a43b3b91c99a64e37f1eb. Resources: {'cores', 'instances', 'ram'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 21:17:45.072508 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-ffa96361-bf9e-47fb-87b6-a9436d0c891f tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Getting quotas for user c9c85602851244d4a632b9c861eb4416 and project 45cb377c6a9a43b3b91c99a64e37f1eb. Resources: {'cores', 'instances', 'ram'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 21:17:45.103203 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-ffa96361-bf9e-47fb-87b6-a9436d0c891f tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Going to run 1 instances... {{(pid=138744) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 21:17:45.105642 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-ffa96361-bf9e-47fb-87b6-a9436d0c891f tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: 20d90b58-3fad-4a44-b6bf-4ef0cc587def] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='085e4478-6edc-4a69-8e08-f9831713eb65',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138744) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 21:17:45.164310 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-ffa96361-bf9e-47fb-87b6-a9436d0c891f tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.551523 Oct 22 21:17:45.165672 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2533/5080] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Oct 22 21:17:43 2022] POST /compute/v2.1/servers => generated 409 bytes in 1554 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 21:17:45.178253 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-f68053b5-841a-4d58-b264-7d1278bef4ac tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:17:45.179014 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-f68053b5-841a-4d58-b264-7d1278bef4ac tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: 20d90b58-3fad-4a44-b6bf-4ef0cc587def] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:17:45.358202 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-f68053b5-841a-4d58-b264-7d1278bef4ac tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c85602851244d4a632b9c861eb4416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45cb377c6a9a43b3b91c99a64e37f1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:17:45.373540 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-f68053b5-841a-4d58-b264-7d1278bef4ac tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def" status: 200 len: 1237 microversion: 2.1 time: 0.198518 Oct 22 21:17:45.375869 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2548/5081] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:17:45 2022] GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def => generated 1237 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:17:45.471576 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-b8e83814-81dd-4d52-a90a-cb5e57bf66fa tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:17:45.472365 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-b8e83814-81dd-4d52-a90a-cb5e57bf66fa tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] [instance: cea3693e-cb10-4129-9f00-18f678998bbd] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:17:45.488480 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b8e83814-81dd-4d52-a90a-cb5e57bf66fa tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:17:45.488992 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b8e83814-81dd-4d52-a90a-cb5e57bf66fa tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:17:45.492611 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b8e83814-81dd-4d52-a90a-cb5e57bf66fa tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:17:45.494343 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b8e83814-81dd-4d52-a90a-cb5e57bf66fa tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:17:45.494837 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b8e83814-81dd-4d52-a90a-cb5e57bf66fa tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:17:45.502893 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b8e83814-81dd-4d52-a90a-cb5e57bf66fa tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:17:45.728228 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-57b6b4b1-dc2a-4bf8-b74b-38e6cdc35419 req-6e56bcff-6985-4f44-a752-b2f2e3e1bf67 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cea3693e-cb10-4129-9f00-18f678998bbd", "tag": "9e2f60df-092f-4a92-9eb4-287057b52f6a"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:17:45.753128 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-57b6b4b1-dc2a-4bf8-b74b-38e6cdc35419 req-6e56bcff-6985-4f44-a752-b2f2e3e1bf67 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:17:45.753893 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-57b6b4b1-dc2a-4bf8-b74b-38e6cdc35419 req-6e56bcff-6985-4f44-a752-b2f2e3e1bf67 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:17:45.755634 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-57b6b4b1-dc2a-4bf8-b74b-38e6cdc35419 req-6e56bcff-6985-4f44-a752-b2f2e3e1bf67 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:17:45.781871 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-b8e83814-81dd-4d52-a90a-cb5e57bf66fa tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a9229e7da421b9e0e6f7df52f71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28af724189a24022b3ef7651b7157a9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:17:45.785265 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-57b6b4b1-dc2a-4bf8-b74b-38e6cdc35419 req-6e56bcff-6985-4f44-a752-b2f2e3e1bf67 service nova] Creating event network-changed:9e2f60df-092f-4a92-9eb4-287057b52f6a for instance cea3693e-cb10-4129-9f00-18f678998bbd on nch2-master-1 Oct 22 21:17:45.793605 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-b8e83814-81dd-4d52-a90a-cb5e57bf66fa tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] 10.222.0.18 "GET /compute/v2.1/servers/cea3693e-cb10-4129-9f00-18f678998bbd" status: 200 len: 1317 microversion: 2.1 time: 0.326833 Oct 22 21:17:45.796542 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-57b6b4b1-dc2a-4bf8-b74b-38e6cdc35419 req-6e56bcff-6985-4f44-a752-b2f2e3e1bf67 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073001 Oct 22 21:17:45.801108 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2549/5082] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:17:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:17:45.812376 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2534/5083] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:17:45 2022] GET /compute/v2.1/servers/cea3693e-cb10-4129-9f00-18f678998bbd => generated 1317 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:17:46.400749 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-268477c8-0ec7-4337-8db7-293668b789f1 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:17:46.411412 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-268477c8-0ec7-4337-8db7-293668b789f1 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: 20d90b58-3fad-4a44-b6bf-4ef0cc587def] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:17:46.432650 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-268477c8-0ec7-4337-8db7-293668b789f1 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:17:46.435436 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-268477c8-0ec7-4337-8db7-293668b789f1 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:17:46.436098 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-268477c8-0ec7-4337-8db7-293668b789f1 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:17:46.439136 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-268477c8-0ec7-4337-8db7-293668b789f1 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:17:46.439907 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-268477c8-0ec7-4337-8db7-293668b789f1 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:17:46.440915 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-268477c8-0ec7-4337-8db7-293668b789f1 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:17:46.569221 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-268477c8-0ec7-4337-8db7-293668b789f1 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c85602851244d4a632b9c861eb4416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45cb377c6a9a43b3b91c99a64e37f1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:17:46.581974 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-268477c8-0ec7-4337-8db7-293668b789f1 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def" status: 200 len: 1289 microversion: 2.1 time: 0.182776 Oct 22 21:17:46.583133 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2550/5084] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:17:46 2022] GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def => generated 1289 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:17:46.824432 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-ec8f8993-7401-4db2-a2e4-091015c95d1c tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:17:46.825169 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-ec8f8993-7401-4db2-a2e4-091015c95d1c tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] [instance: cea3693e-cb10-4129-9f00-18f678998bbd] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:17:46.848489 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ec8f8993-7401-4db2-a2e4-091015c95d1c tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:17:46.849293 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ec8f8993-7401-4db2-a2e4-091015c95d1c tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:17:46.850484 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ec8f8993-7401-4db2-a2e4-091015c95d1c tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:17:46.851521 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ec8f8993-7401-4db2-a2e4-091015c95d1c tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:17:46.852170 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ec8f8993-7401-4db2-a2e4-091015c95d1c tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:17:46.852755 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ec8f8993-7401-4db2-a2e4-091015c95d1c tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:17:47.289289 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-ec8f8993-7401-4db2-a2e4-091015c95d1c tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a9229e7da421b9e0e6f7df52f71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28af724189a24022b3ef7651b7157a9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:17:47.312212 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-ec8f8993-7401-4db2-a2e4-091015c95d1c tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] 10.222.0.18 "GET /compute/v2.1/servers/cea3693e-cb10-4129-9f00-18f678998bbd" status: 200 len: 1317 microversion: 2.1 time: 0.492082 Oct 22 21:17:47.317635 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2535/5085] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:17:46 2022] GET /compute/v2.1/servers/cea3693e-cb10-4129-9f00-18f678998bbd => generated 1317 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:17:47.606412 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-7197283d-0cae-4389-a9f6-3b40992efd2d tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:17:47.607691 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-7197283d-0cae-4389-a9f6-3b40992efd2d tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: 20d90b58-3fad-4a44-b6bf-4ef0cc587def] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:17:47.620680 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7197283d-0cae-4389-a9f6-3b40992efd2d tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:17:47.621870 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7197283d-0cae-4389-a9f6-3b40992efd2d tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:17:47.625100 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7197283d-0cae-4389-a9f6-3b40992efd2d tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:17:47.626163 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7197283d-0cae-4389-a9f6-3b40992efd2d tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:17:47.626850 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7197283d-0cae-4389-a9f6-3b40992efd2d tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:17:47.627644 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7197283d-0cae-4389-a9f6-3b40992efd2d tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:17:47.782236 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-7197283d-0cae-4389-a9f6-3b40992efd2d tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c85602851244d4a632b9c861eb4416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45cb377c6a9a43b3b91c99a64e37f1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:17:47.800346 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-7197283d-0cae-4389-a9f6-3b40992efd2d tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def" status: 200 len: 1295 microversion: 2.1 time: 0.198195 Oct 22 21:17:47.802706 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2551/5086] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:17:47 2022] GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def => generated 1295 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:17:48.348257 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-2afc3100-dcdc-493d-86b0-990ad79310a7 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:17:48.349461 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-2afc3100-dcdc-493d-86b0-990ad79310a7 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] [instance: cea3693e-cb10-4129-9f00-18f678998bbd] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:17:48.365748 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2afc3100-dcdc-493d-86b0-990ad79310a7 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:17:48.368642 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2afc3100-dcdc-493d-86b0-990ad79310a7 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:17:48.369226 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2afc3100-dcdc-493d-86b0-990ad79310a7 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:17:48.371387 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2afc3100-dcdc-493d-86b0-990ad79310a7 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:17:48.372139 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2afc3100-dcdc-493d-86b0-990ad79310a7 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:17:48.374714 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2afc3100-dcdc-493d-86b0-990ad79310a7 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:17:48.725273 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-2afc3100-dcdc-493d-86b0-990ad79310a7 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a9229e7da421b9e0e6f7df52f71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28af724189a24022b3ef7651b7157a9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:17:48.736801 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-2afc3100-dcdc-493d-86b0-990ad79310a7 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] 10.222.0.18 "GET /compute/v2.1/servers/cea3693e-cb10-4129-9f00-18f678998bbd" status: 200 len: 1317 microversion: 2.1 time: 0.394125 Oct 22 21:17:48.738073 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2536/5087] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:17:48 2022] GET /compute/v2.1/servers/cea3693e-cb10-4129-9f00-18f678998bbd => generated 1317 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:17:48.824327 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-bac276e0-46ff-4169-946e-af4575d05a64 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:17:48.825014 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-bac276e0-46ff-4169-946e-af4575d05a64 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: 20d90b58-3fad-4a44-b6bf-4ef0cc587def] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:17:48.833519 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell0:SELECT=2 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:17:48.839815 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bac276e0-46ff-4169-946e-af4575d05a64 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:17:48.844897 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bac276e0-46ff-4169-946e-af4575d05a64 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:17:48.845572 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bac276e0-46ff-4169-946e-af4575d05a64 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:17:48.846731 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bac276e0-46ff-4169-946e-af4575d05a64 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:17:48.847571 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bac276e0-46ff-4169-946e-af4575d05a64 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:17:48.848209 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bac276e0-46ff-4169-946e-af4575d05a64 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:17:49.246724 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-bac276e0-46ff-4169-946e-af4575d05a64 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c85602851244d4a632b9c861eb4416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45cb377c6a9a43b3b91c99a64e37f1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:17:49.257997 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-bac276e0-46ff-4169-946e-af4575d05a64 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def" status: 200 len: 1363 microversion: 2.1 time: 0.437537 Oct 22 21:17:49.258600 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2552/5088] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:17:48 2022] GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def => generated 1363 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:17:49.760846 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-1f634c48-a576-41d2-81c4-c51bf72050e7 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:17:49.762273 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-1f634c48-a576-41d2-81c4-c51bf72050e7 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] [instance: cea3693e-cb10-4129-9f00-18f678998bbd] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:17:49.775108 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1f634c48-a576-41d2-81c4-c51bf72050e7 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:17:49.779831 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1f634c48-a576-41d2-81c4-c51bf72050e7 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:17:49.780628 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1f634c48-a576-41d2-81c4-c51bf72050e7 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:17:49.781604 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1f634c48-a576-41d2-81c4-c51bf72050e7 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:17:49.784213 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1f634c48-a576-41d2-81c4-c51bf72050e7 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:17:49.785447 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1f634c48-a576-41d2-81c4-c51bf72050e7 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:17:50.098488 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-1f634c48-a576-41d2-81c4-c51bf72050e7 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a9229e7da421b9e0e6f7df52f71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28af724189a24022b3ef7651b7157a9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:17:50.111305 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-1f634c48-a576-41d2-81c4-c51bf72050e7 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] 10.222.0.18 "GET /compute/v2.1/servers/cea3693e-cb10-4129-9f00-18f678998bbd" status: 200 len: 1317 microversion: 2.1 time: 0.351456 Oct 22 21:17:50.114037 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2537/5089] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:17:49 2022] GET /compute/v2.1/servers/cea3693e-cb10-4129-9f00-18f678998bbd => generated 1317 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:17:50.288411 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-099fda54-227e-4b44-89b3-3ee1d9eaa36e tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:17:50.290572 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-099fda54-227e-4b44-89b3-3ee1d9eaa36e tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: 20d90b58-3fad-4a44-b6bf-4ef0cc587def] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:17:50.306363 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-099fda54-227e-4b44-89b3-3ee1d9eaa36e tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:17:50.308224 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-099fda54-227e-4b44-89b3-3ee1d9eaa36e tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:17:50.308917 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-099fda54-227e-4b44-89b3-3ee1d9eaa36e tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:17:50.309882 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-099fda54-227e-4b44-89b3-3ee1d9eaa36e tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:17:50.310779 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-099fda54-227e-4b44-89b3-3ee1d9eaa36e tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:17:50.311490 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-099fda54-227e-4b44-89b3-3ee1d9eaa36e tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:17:50.318146 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-0fc14fab-127a-4e99-98e7-c66f2c0e9683 req-4a87fe63-5220-437c-bfe5-b79877d6d854 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20d90b58-3fad-4a44-b6bf-4ef0cc587def", "tag": "7ef4550f-d128-432a-9dbc-ce1802e6c6da"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:17:50.347394 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-0fc14fab-127a-4e99-98e7-c66f2c0e9683 req-4a87fe63-5220-437c-bfe5-b79877d6d854 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:17:50.347988 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-0fc14fab-127a-4e99-98e7-c66f2c0e9683 req-4a87fe63-5220-437c-bfe5-b79877d6d854 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:17:50.349145 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-0fc14fab-127a-4e99-98e7-c66f2c0e9683 req-4a87fe63-5220-437c-bfe5-b79877d6d854 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:17:50.396127 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-0fc14fab-127a-4e99-98e7-c66f2c0e9683 req-4a87fe63-5220-437c-bfe5-b79877d6d854 service nova] Creating event network-changed:7ef4550f-d128-432a-9dbc-ce1802e6c6da for instance 20d90b58-3fad-4a44-b6bf-4ef0cc587def on nch1-master-1 Oct 22 21:17:50.406787 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-0fc14fab-127a-4e99-98e7-c66f2c0e9683 req-4a87fe63-5220-437c-bfe5-b79877d6d854 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092309 Oct 22 21:17:50.409789 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2538/5090] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:17:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 21:17:50.632058 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-099fda54-227e-4b44-89b3-3ee1d9eaa36e tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c85602851244d4a632b9c861eb4416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45cb377c6a9a43b3b91c99a64e37f1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:17:50.658523 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-099fda54-227e-4b44-89b3-3ee1d9eaa36e tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def" status: 200 len: 1363 microversion: 2.1 time: 0.379853 Oct 22 21:17:50.660553 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2553/5091] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:17:50 2022] GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def => generated 1363 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:17:51.142091 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-8117a4ec-7248-441c-a2a5-f88add70d38d tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:17:51.142860 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-8117a4ec-7248-441c-a2a5-f88add70d38d tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] [instance: cea3693e-cb10-4129-9f00-18f678998bbd] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:17:51.151193 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8117a4ec-7248-441c-a2a5-f88add70d38d tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:17:51.151728 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8117a4ec-7248-441c-a2a5-f88add70d38d tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:17:51.152162 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8117a4ec-7248-441c-a2a5-f88add70d38d tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:17:51.152875 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8117a4ec-7248-441c-a2a5-f88add70d38d tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:17:51.153466 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8117a4ec-7248-441c-a2a5-f88add70d38d tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:17:51.154074 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8117a4ec-7248-441c-a2a5-f88add70d38d tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:17:51.311473 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-8117a4ec-7248-441c-a2a5-f88add70d38d tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a9229e7da421b9e0e6f7df52f71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28af724189a24022b3ef7651b7157a9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:17:51.320047 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-8117a4ec-7248-441c-a2a5-f88add70d38d tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] 10.222.0.18 "GET /compute/v2.1/servers/cea3693e-cb10-4129-9f00-18f678998bbd" status: 200 len: 1317 microversion: 2.1 time: 0.183525 Oct 22 21:17:51.320648 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2539/5092] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:17:51 2022] GET /compute/v2.1/servers/cea3693e-cb10-4129-9f00-18f678998bbd => generated 1317 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:17:51.685169 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-1f109878-a2ce-42eb-97b9-f64e6ebe430d tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:17:51.685887 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-1f109878-a2ce-42eb-97b9-f64e6ebe430d tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: 20d90b58-3fad-4a44-b6bf-4ef0cc587def] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:17:51.700958 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1f109878-a2ce-42eb-97b9-f64e6ebe430d tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:17:51.701659 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1f109878-a2ce-42eb-97b9-f64e6ebe430d tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:17:51.702116 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1f109878-a2ce-42eb-97b9-f64e6ebe430d tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:17:51.703267 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1f109878-a2ce-42eb-97b9-f64e6ebe430d tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:17:51.705216 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1f109878-a2ce-42eb-97b9-f64e6ebe430d tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:17:51.705678 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1f109878-a2ce-42eb-97b9-f64e6ebe430d tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:17:51.880653 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-1f109878-a2ce-42eb-97b9-f64e6ebe430d tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c85602851244d4a632b9c861eb4416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45cb377c6a9a43b3b91c99a64e37f1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:17:51.889923 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-1f109878-a2ce-42eb-97b9-f64e6ebe430d tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def" status: 200 len: 1363 microversion: 2.1 time: 0.209583 Oct 22 21:17:51.890971 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2554/5093] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:17:51 2022] GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def => generated 1363 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:17:52.344585 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-d13bf94e-cf1e-4477-9f05-a43b58c7003b tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:17:52.345321 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-d13bf94e-cf1e-4477-9f05-a43b58c7003b tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] [instance: cea3693e-cb10-4129-9f00-18f678998bbd] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:17:52.348900 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-1048ec61-947c-413f-9e26-5b195b7a797e req-0440ee78-1407-456d-b526-a307e557f11a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cea3693e-cb10-4129-9f00-18f678998bbd", "name": "network-vif-plugged", "status": "completed", "tag": "9e2f60df-092f-4a92-9eb4-287057b52f6a"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:17:52.358623 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d13bf94e-cf1e-4477-9f05-a43b58c7003b tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:17:52.359489 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d13bf94e-cf1e-4477-9f05-a43b58c7003b tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:17:52.360197 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d13bf94e-cf1e-4477-9f05-a43b58c7003b tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:17:52.361162 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d13bf94e-cf1e-4477-9f05-a43b58c7003b tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:17:52.361944 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d13bf94e-cf1e-4477-9f05-a43b58c7003b tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:17:52.362851 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d13bf94e-cf1e-4477-9f05-a43b58c7003b tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:17:52.362996 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-1048ec61-947c-413f-9e26-5b195b7a797e req-0440ee78-1407-456d-b526-a307e557f11a service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:17:52.363686 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-1048ec61-947c-413f-9e26-5b195b7a797e req-0440ee78-1407-456d-b526-a307e557f11a service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:17:52.364348 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-1048ec61-947c-413f-9e26-5b195b7a797e req-0440ee78-1407-456d-b526-a307e557f11a service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:17:52.380070 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-1048ec61-947c-413f-9e26-5b195b7a797e req-0440ee78-1407-456d-b526-a307e557f11a service nova] Creating event network-vif-plugged:9e2f60df-092f-4a92-9eb4-287057b52f6a for instance cea3693e-cb10-4129-9f00-18f678998bbd on nch2-master-1 Oct 22 21:17:52.389667 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-1048ec61-947c-413f-9e26-5b195b7a797e req-0440ee78-1407-456d-b526-a307e557f11a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047478 Oct 22 21:17:52.391114 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2555/5094] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:17:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:17:52.615645 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-d13bf94e-cf1e-4477-9f05-a43b58c7003b tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a9229e7da421b9e0e6f7df52f71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28af724189a24022b3ef7651b7157a9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:17:52.625302 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-d13bf94e-cf1e-4477-9f05-a43b58c7003b tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] 10.222.0.18 "GET /compute/v2.1/servers/cea3693e-cb10-4129-9f00-18f678998bbd" status: 200 len: 1317 microversion: 2.1 time: 0.286873 Oct 22 21:17:52.625881 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2540/5095] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:17:52 2022] GET /compute/v2.1/servers/cea3693e-cb10-4129-9f00-18f678998bbd => generated 1317 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:17:52.917184 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-e38f9209-b1dc-4f92-80e0-8d6639ad8b7f tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:17:52.918588 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-e38f9209-b1dc-4f92-80e0-8d6639ad8b7f tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: 20d90b58-3fad-4a44-b6bf-4ef0cc587def] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:17:52.927016 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e38f9209-b1dc-4f92-80e0-8d6639ad8b7f tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:17:52.928967 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e38f9209-b1dc-4f92-80e0-8d6639ad8b7f tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:17:52.928967 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e38f9209-b1dc-4f92-80e0-8d6639ad8b7f tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:17:52.929876 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e38f9209-b1dc-4f92-80e0-8d6639ad8b7f tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:17:52.930559 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e38f9209-b1dc-4f92-80e0-8d6639ad8b7f tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:17:52.931191 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e38f9209-b1dc-4f92-80e0-8d6639ad8b7f tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:17:53.418657 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-e38f9209-b1dc-4f92-80e0-8d6639ad8b7f tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c85602851244d4a632b9c861eb4416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45cb377c6a9a43b3b91c99a64e37f1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:17:53.429663 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-e38f9209-b1dc-4f92-80e0-8d6639ad8b7f tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def" status: 200 len: 1363 microversion: 2.1 time: 0.519046 Oct 22 21:17:53.431258 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2556/5096] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:17:52 2022] GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def => generated 1363 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:17:53.653287 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-ddf6e520-df74-46ee-ad1f-e93de3c5cf80 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:17:53.653976 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-ddf6e520-df74-46ee-ad1f-e93de3c5cf80 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] [instance: cea3693e-cb10-4129-9f00-18f678998bbd] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:17:53.665886 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ddf6e520-df74-46ee-ad1f-e93de3c5cf80 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:17:53.666726 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ddf6e520-df74-46ee-ad1f-e93de3c5cf80 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:17:53.668117 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ddf6e520-df74-46ee-ad1f-e93de3c5cf80 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:17:53.668881 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ddf6e520-df74-46ee-ad1f-e93de3c5cf80 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:17:53.669354 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ddf6e520-df74-46ee-ad1f-e93de3c5cf80 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:17:53.670235 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ddf6e520-df74-46ee-ad1f-e93de3c5cf80 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:17:54.010597 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-ddf6e520-df74-46ee-ad1f-e93de3c5cf80 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a9229e7da421b9e0e6f7df52f71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28af724189a24022b3ef7651b7157a9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:17:54.020015 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-ddf6e520-df74-46ee-ad1f-e93de3c5cf80 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] 10.222.0.18 "GET /compute/v2.1/servers/cea3693e-cb10-4129-9f00-18f678998bbd" status: 200 len: 1317 microversion: 2.1 time: 0.375148 Oct 22 21:17:54.020679 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2541/5097] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:17:53 2022] GET /compute/v2.1/servers/cea3693e-cb10-4129-9f00-18f678998bbd => generated 1317 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:17:54.455318 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-44895a61-a3a4-4a33-a29b-567cfb4ea78c tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:17:54.456583 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-44895a61-a3a4-4a33-a29b-567cfb4ea78c tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: 20d90b58-3fad-4a44-b6bf-4ef0cc587def] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:17:54.466395 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-44895a61-a3a4-4a33-a29b-567cfb4ea78c tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:17:54.467132 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-44895a61-a3a4-4a33-a29b-567cfb4ea78c tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:17:54.468067 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-44895a61-a3a4-4a33-a29b-567cfb4ea78c tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:17:54.469000 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-44895a61-a3a4-4a33-a29b-567cfb4ea78c tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:17:54.469679 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-44895a61-a3a4-4a33-a29b-567cfb4ea78c tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:17:54.470321 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-44895a61-a3a4-4a33-a29b-567cfb4ea78c tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:17:54.716254 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-44895a61-a3a4-4a33-a29b-567cfb4ea78c tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c85602851244d4a632b9c861eb4416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45cb377c6a9a43b3b91c99a64e37f1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:17:54.730775 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-44895a61-a3a4-4a33-a29b-567cfb4ea78c tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def" status: 200 len: 1363 microversion: 2.1 time: 0.280849 Oct 22 21:17:54.748332 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2557/5098] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:17:54 2022] GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def => generated 1363 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:17:55.046497 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-928365e3-43c6-4cd6-901b-9e1a37cec19e tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:17:55.047998 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-928365e3-43c6-4cd6-901b-9e1a37cec19e tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] [instance: cea3693e-cb10-4129-9f00-18f678998bbd] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:17:55.051507 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell0:SELECT=2 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:17:55.060324 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-928365e3-43c6-4cd6-901b-9e1a37cec19e tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:17:55.061414 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-928365e3-43c6-4cd6-901b-9e1a37cec19e tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:17:55.062021 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-928365e3-43c6-4cd6-901b-9e1a37cec19e tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:17:55.062901 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-928365e3-43c6-4cd6-901b-9e1a37cec19e tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:17:55.063373 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-928365e3-43c6-4cd6-901b-9e1a37cec19e tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:17:55.063814 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-928365e3-43c6-4cd6-901b-9e1a37cec19e tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:17:55.096331 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell0:SELECT=10 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:17:55.286466 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-928365e3-43c6-4cd6-901b-9e1a37cec19e tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a9229e7da421b9e0e6f7df52f71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28af724189a24022b3ef7651b7157a9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:17:55.316171 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-928365e3-43c6-4cd6-901b-9e1a37cec19e tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] 10.222.0.18 "GET /compute/v2.1/servers/cea3693e-cb10-4129-9f00-18f678998bbd" status: 200 len: 1506 microversion: 2.1 time: 0.274799 Oct 22 21:17:55.316963 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2542/5099] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:17:55 2022] GET /compute/v2.1/servers/cea3693e-cb10-4129-9f00-18f678998bbd => generated 1506 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:17:55.340655 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-eff1a924-020f-41cd-83ba-ea28b4e4bd42 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:17:55.341346 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-eff1a924-020f-41cd-83ba-ea28b4e4bd42 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] [instance: cea3693e-cb10-4129-9f00-18f678998bbd] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:17:55.348999 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-eff1a924-020f-41cd-83ba-ea28b4e4bd42 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:17:55.350687 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-eff1a924-020f-41cd-83ba-ea28b4e4bd42 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:17:55.351414 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-eff1a924-020f-41cd-83ba-ea28b4e4bd42 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:17:55.352552 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-eff1a924-020f-41cd-83ba-ea28b4e4bd42 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:17:55.353101 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-eff1a924-020f-41cd-83ba-ea28b4e4bd42 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:17:55.353772 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-eff1a924-020f-41cd-83ba-ea28b4e4bd42 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:17:55.381386 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell0:SELECT=10 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:17:55.400385 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-eff1a924-020f-41cd-83ba-ea28b4e4bd42 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] [instance: cea3693e-cb10-4129-9f00-18f678998bbd] Going to try to terminate instance {{(pid=138745) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 21:17:55.499413 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-eff1a924-020f-41cd-83ba-ea28b4e4bd42 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] 10.222.0.18 "DELETE /compute/v2.1/servers/cea3693e-cb10-4129-9f00-18f678998bbd" status: 204 len: 0 microversion: 2.1 time: 0.162435 Oct 22 21:17:55.500821 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2558/5100] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 21:17:55 2022] DELETE /compute/v2.1/servers/cea3693e-cb10-4129-9f00-18f678998bbd => generated 0 bytes in 165 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 21:17:55.512709 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-8e157db4-8b66-449c-aa3d-0870c3eacf08 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:17:55.513585 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-8e157db4-8b66-449c-aa3d-0870c3eacf08 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] [instance: cea3693e-cb10-4129-9f00-18f678998bbd] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:17:55.524161 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8e157db4-8b66-449c-aa3d-0870c3eacf08 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:17:55.526425 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8e157db4-8b66-449c-aa3d-0870c3eacf08 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:17:55.527600 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8e157db4-8b66-449c-aa3d-0870c3eacf08 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:17:55.528857 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8e157db4-8b66-449c-aa3d-0870c3eacf08 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:17:55.529511 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8e157db4-8b66-449c-aa3d-0870c3eacf08 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:17:55.530289 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8e157db4-8b66-449c-aa3d-0870c3eacf08 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:17:55.760974 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-35292105-56c7-4c0e-a197-cb652e2576b5 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:17:55.761911 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-35292105-56c7-4c0e-a197-cb652e2576b5 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: 20d90b58-3fad-4a44-b6bf-4ef0cc587def] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:17:55.773818 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-35292105-56c7-4c0e-a197-cb652e2576b5 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:17:55.774358 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-35292105-56c7-4c0e-a197-cb652e2576b5 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:17:55.774799 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-35292105-56c7-4c0e-a197-cb652e2576b5 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:17:55.775898 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-35292105-56c7-4c0e-a197-cb652e2576b5 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:17:55.776368 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-35292105-56c7-4c0e-a197-cb652e2576b5 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:17:55.776848 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-35292105-56c7-4c0e-a197-cb652e2576b5 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:17:55.796590 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-8e157db4-8b66-449c-aa3d-0870c3eacf08 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a9229e7da421b9e0e6f7df52f71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28af724189a24022b3ef7651b7157a9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:17:55.806552 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-8e157db4-8b66-449c-aa3d-0870c3eacf08 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] 10.222.0.18 "GET /compute/v2.1/servers/cea3693e-cb10-4129-9f00-18f678998bbd" status: 200 len: 1512 microversion: 2.1 time: 0.299476 Oct 22 21:17:55.808008 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2543/5101] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:17:55 2022] GET /compute/v2.1/servers/cea3693e-cb10-4129-9f00-18f678998bbd => generated 1512 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:17:56.093035 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-35292105-56c7-4c0e-a197-cb652e2576b5 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c85602851244d4a632b9c861eb4416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45cb377c6a9a43b3b91c99a64e37f1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:17:56.111468 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-35292105-56c7-4c0e-a197-cb652e2576b5 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def" status: 200 len: 1363 microversion: 2.1 time: 0.360299 Oct 22 21:17:56.112372 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2559/5102] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:17:55 2022] GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def => generated 1363 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:17:56.828683 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-f17efed5-689e-487e-81ef-2e8284196fad req-85f14060-d075-402d-a654-55de5f2e7dd2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20d90b58-3fad-4a44-b6bf-4ef0cc587def", "name": "network-vif-plugged", "status": "completed", "tag": "7ef4550f-d128-432a-9dbc-ce1802e6c6da"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:17:56.830581 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-7f9be4dc-4091-4e95-84c8-bee05f65689f tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:17:56.831443 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-7f9be4dc-4091-4e95-84c8-bee05f65689f tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] [instance: cea3693e-cb10-4129-9f00-18f678998bbd] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:17:56.847040 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7f9be4dc-4091-4e95-84c8-bee05f65689f tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:17:56.847588 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7f9be4dc-4091-4e95-84c8-bee05f65689f tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:17:56.848009 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-f17efed5-689e-487e-81ef-2e8284196fad req-85f14060-d075-402d-a654-55de5f2e7dd2 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:17:56.848130 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7f9be4dc-4091-4e95-84c8-bee05f65689f tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:17:56.848503 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-f17efed5-689e-487e-81ef-2e8284196fad req-85f14060-d075-402d-a654-55de5f2e7dd2 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:17:56.848764 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7f9be4dc-4091-4e95-84c8-bee05f65689f tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:17:56.849027 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-f17efed5-689e-487e-81ef-2e8284196fad req-85f14060-d075-402d-a654-55de5f2e7dd2 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:17:56.849237 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7f9be4dc-4091-4e95-84c8-bee05f65689f tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:17:56.849686 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7f9be4dc-4091-4e95-84c8-bee05f65689f tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:17:56.873079 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-f17efed5-689e-487e-81ef-2e8284196fad req-85f14060-d075-402d-a654-55de5f2e7dd2 service nova] Creating event network-vif-plugged:7ef4550f-d128-432a-9dbc-ce1802e6c6da for instance 20d90b58-3fad-4a44-b6bf-4ef0cc587def on nch1-master-1 Oct 22 21:17:56.887756 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-f17efed5-689e-487e-81ef-2e8284196fad req-85f14060-d075-402d-a654-55de5f2e7dd2 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065155 Oct 22 21:17:56.889061 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2544/5103] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:17:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 21:17:57.141491 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-370ac06d-f73c-4cff-bc36-9330689f2147 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:17:57.143529 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-370ac06d-f73c-4cff-bc36-9330689f2147 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: 20d90b58-3fad-4a44-b6bf-4ef0cc587def] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:17:57.151570 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-370ac06d-f73c-4cff-bc36-9330689f2147 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:17:57.152605 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-370ac06d-f73c-4cff-bc36-9330689f2147 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:17:57.153291 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-370ac06d-f73c-4cff-bc36-9330689f2147 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:17:57.154431 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-370ac06d-f73c-4cff-bc36-9330689f2147 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:17:57.155143 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-370ac06d-f73c-4cff-bc36-9330689f2147 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:17:57.155820 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-370ac06d-f73c-4cff-bc36-9330689f2147 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:17:57.299506 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-7f9be4dc-4091-4e95-84c8-bee05f65689f tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a9229e7da421b9e0e6f7df52f71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28af724189a24022b3ef7651b7157a9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:17:57.321105 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-7f9be4dc-4091-4e95-84c8-bee05f65689f tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] 10.222.0.18 "GET /compute/v2.1/servers/cea3693e-cb10-4129-9f00-18f678998bbd" status: 200 len: 1512 microversion: 2.1 time: 0.494801 Oct 22 21:17:57.322254 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2560/5104] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:17:56 2022] GET /compute/v2.1/servers/cea3693e-cb10-4129-9f00-18f678998bbd => generated 1512 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:17:57.460913 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-370ac06d-f73c-4cff-bc36-9330689f2147 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c85602851244d4a632b9c861eb4416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45cb377c6a9a43b3b91c99a64e37f1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:17:57.491705 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-370ac06d-f73c-4cff-bc36-9330689f2147 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def" status: 200 len: 1363 microversion: 2.1 time: 0.352876 Oct 22 21:17:57.514639 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2545/5105] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:17:57 2022] GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def => generated 1363 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:17:57.985401 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-df863708-e88a-44d7-a7a3-811bcf049461 req-3af6ca3e-42a2-4050-9cf7-1251caa2be3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cea3693e-cb10-4129-9f00-18f678998bbd", "name": "network-vif-deleted", "tag": "9e2f60df-092f-4a92-9eb4-287057b52f6a"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:17:58.007616 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-df863708-e88a-44d7-a7a3-811bcf049461 req-3af6ca3e-42a2-4050-9cf7-1251caa2be3e service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:17:58.008386 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-df863708-e88a-44d7-a7a3-811bcf049461 req-3af6ca3e-42a2-4050-9cf7-1251caa2be3e service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:17:58.010289 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-df863708-e88a-44d7-a7a3-811bcf049461 req-3af6ca3e-42a2-4050-9cf7-1251caa2be3e service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:17:58.024307 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-df863708-e88a-44d7-a7a3-811bcf049461 req-3af6ca3e-42a2-4050-9cf7-1251caa2be3e service nova] Creating event network-vif-deleted:9e2f60df-092f-4a92-9eb4-287057b52f6a for instance cea3693e-cb10-4129-9f00-18f678998bbd on nch2-master-1 Oct 22 21:17:58.037190 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-df863708-e88a-44d7-a7a3-811bcf049461 req-3af6ca3e-42a2-4050-9cf7-1251caa2be3e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061704 Oct 22 21:17:58.037814 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2561/5106] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:17:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:17:58.351434 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-4eefe01c-11d3-447b-8025-344ec750c1ae tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:17:58.352193 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-4eefe01c-11d3-447b-8025-344ec750c1ae tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] [instance: cea3693e-cb10-4129-9f00-18f678998bbd] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:17:58.360661 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4eefe01c-11d3-447b-8025-344ec750c1ae tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:17:58.361223 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4eefe01c-11d3-447b-8025-344ec750c1ae tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:17:58.361621 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4eefe01c-11d3-447b-8025-344ec750c1ae tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:17:58.362804 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4eefe01c-11d3-447b-8025-344ec750c1ae tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:17:58.364054 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4eefe01c-11d3-447b-8025-344ec750c1ae tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:17:58.364612 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4eefe01c-11d3-447b-8025-344ec750c1ae tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:17:58.425694 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4eefe01c-11d3-447b-8025-344ec750c1ae tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:17:58.426298 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4eefe01c-11d3-447b-8025-344ec750c1ae tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:17:58.426715 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4eefe01c-11d3-447b-8025-344ec750c1ae tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:17:58.427169 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.objects.instance [None req-4eefe01c-11d3-447b-8025-344ec750c1ae tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lazy-loading 'fault' on Instance uuid cea3693e-cb10-4129-9f00-18f678998bbd {{(pid=138744) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 21:17:58.489016 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-4eefe01c-11d3-447b-8025-344ec750c1ae tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a9229e7da421b9e0e6f7df52f71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28af724189a24022b3ef7651b7157a9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:17:58.500033 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-4eefe01c-11d3-447b-8025-344ec750c1ae tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] 10.222.0.18 "GET /compute/v2.1/servers/cea3693e-cb10-4129-9f00-18f678998bbd" status: 200 len: 1307 microversion: 2.1 time: 0.156803 Oct 22 21:17:58.501272 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2546/5107] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:17:58 2022] GET /compute/v2.1/servers/cea3693e-cb10-4129-9f00-18f678998bbd => generated 1307 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:17:58.524273 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-f89cef36-7982-4e7f-86e8-5b430e1f0c7a tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:17:58.525776 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-f89cef36-7982-4e7f-86e8-5b430e1f0c7a tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: 20d90b58-3fad-4a44-b6bf-4ef0cc587def] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:17:58.534579 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f89cef36-7982-4e7f-86e8-5b430e1f0c7a tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:17:58.535533 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f89cef36-7982-4e7f-86e8-5b430e1f0c7a tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:17:58.536303 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f89cef36-7982-4e7f-86e8-5b430e1f0c7a tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:17:58.537334 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f89cef36-7982-4e7f-86e8-5b430e1f0c7a tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:17:58.538021 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f89cef36-7982-4e7f-86e8-5b430e1f0c7a tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:17:58.538675 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f89cef36-7982-4e7f-86e8-5b430e1f0c7a tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:17:59.165910 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-f89cef36-7982-4e7f-86e8-5b430e1f0c7a tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c85602851244d4a632b9c861eb4416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45cb377c6a9a43b3b91c99a64e37f1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:17:59.180716 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-f89cef36-7982-4e7f-86e8-5b430e1f0c7a tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def" status: 200 len: 1363 microversion: 2.1 time: 0.661014 Oct 22 21:17:59.183704 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2562/5108] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:17:58 2022] GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def => generated 1363 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:17:59.525624 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-f5331188-bc99-410a-9f37-d8d3534befdc tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:17:59.526865 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-f5331188-bc99-410a-9f37-d8d3534befdc tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] [instance: cea3693e-cb10-4129-9f00-18f678998bbd] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:17:59.534912 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_api:SELECT=64,nova_api:INSERT=4 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:17:59.536379 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f5331188-bc99-410a-9f37-d8d3534befdc tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:17:59.537044 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f5331188-bc99-410a-9f37-d8d3534befdc tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:17:59.537828 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f5331188-bc99-410a-9f37-d8d3534befdc tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:17:59.538702 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f5331188-bc99-410a-9f37-d8d3534befdc tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:17:59.539317 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f5331188-bc99-410a-9f37-d8d3534befdc tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:17:59.539951 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f5331188-bc99-410a-9f37-d8d3534befdc tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:17:59.556739 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-f5331188-bc99-410a-9f37-d8d3534befdc tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] HTTP exception thrown: Instance cea3693e-cb10-4129-9f00-18f678998bbd could not be found. Oct 22 21:17:59.558620 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-f5331188-bc99-410a-9f37-d8d3534befdc tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Request method failure captured: Oct 22 21:17:59.558620 ncdv-master-1 devstack@n-api.service[138744]: request: GET /compute/v2.1/servers/cea3693e-cb10-4129-9f00-18f678998bbd HTTP/1.1 Oct 22 21:17:59.558620 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 21:17:59.558620 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 21:17:59.558620 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 21:17:59.558620 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 0 Oct 22 21:17:59.558620 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 21:17:59.558620 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 21:17:59.558620 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 21:17:59.558620 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 21:17:59.558620 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVF3hm7PiLG1R8Tw2syJVqR4znaBscty3weljpQpv2aVSYokkqaFvTxJu_8ZsVDxnVWNFBjrkTk4hem6vgNXmexe0yUI_M8pHEKoh5CWO6b1coilxRZ6VgX94mIL_xf6l3t9Q4mcnT856zV-XemvxZab0Ooy1ChU21L_her9Zn74z_zU Oct 22 21:17:59.558620 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 21:17:59.558620 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 21:17:59.558620 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 21:17:59.558620 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 21:17:59.558620 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 21:17:59.558620 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 21:17:59.558620 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: 28af724189a24022b3ef7651b7157a9d Oct 22 21:17:59.558620 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-ServersNegativeTestJSON-766586991 Oct 22 21:17:59.558620 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 21:17:59.558620 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 21:17:59.558620 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_28af724189a24022b3ef7651b7157a9d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/28af724189a24022b3ef7651b7157a9d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/28af724189a24022b3ef7651b7157a9d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/28af724189a24022b3ef7651b7157a9d"}]}] Oct 22 21:17:59.558620 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-ServersNegativeTestJSON-766586991 Oct 22 21:17:59.558620 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: 28af724189a24022b3ef7651b7157a9d Oct 22 21:17:59.558620 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-ServersNegativeTestJSON-766586991 Oct 22 21:17:59.558620 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-ServersNegativeTestJSON-766586991-project Oct 22 21:17:59.558620 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 21:17:59.558620 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 21:17:59.558620 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: 6c8a9229e7da421b9e0e6f7df52f71e2 Oct 22 21:17:59.558620 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-ServersNegativeTestJSON-766586991-project Oct 22 21:17:59.558620 ncdv-master-1 devstack@n-api.service[138744]: method: > Oct 22 21:17:59.558620 ncdv-master-1 devstack@n-api.service[138744]: exception: Instance cea3693e-cb10-4129-9f00-18f678998bbd could not be found. Oct 22 21:17:59.558620 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': 'cea3693e-cb10-4129-9f00-18f678998bbd'} Oct 22 21:17:59.558620 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:17:59.558620 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:17:59.558620 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 21:17:59.558620 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 21:17:59.558620 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 21:17:59.558620 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 21:17:59.558620 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 21:17:59.558620 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 21:17:59.558620 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 21:17:59.558620 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 21:17:59.558620 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cea3693e-cb10-4129-9f00-18f678998bbd could not be found. Oct 22 21:17:59.558620 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:17:59.558620 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:17:59.558620 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:17:59.558620 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:17:59.558620 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:17:59.558620 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:17:59.558620 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:17:59.558620 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:17:59.558620 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:17:59.558620 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:17:59.558620 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 21:17:59.558620 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 21:17:59.558620 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 21:17:59.558620 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 21:17:59.558620 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 21:17:59.558620 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:17:59.558620 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cea3693e-cb10-4129-9f00-18f678998bbd could not be found. Oct 22 21:17:59.558620 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:17:59.558620 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:17:59.558620 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:17:59.563850 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:17:59.563850 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:17:59.563850 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:17:59.563850 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:17:59.563850 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:17:59.563850 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cea3693e-cb10-4129-9f00-18f678998bbd could not be found. Oct 22 21:17:59.563850 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:17:59.565469 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-f5331188-bc99-410a-9f37-d8d3534befdc tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Returning 404 to user: Instance cea3693e-cb10-4129-9f00-18f678998bbd could not be found. {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:17:59.566509 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-f5331188-bc99-410a-9f37-d8d3534befdc tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] 10.222.0.18 "GET /compute/v2.1/servers/cea3693e-cb10-4129-9f00-18f678998bbd" status: 404 len: 111 microversion: 2.1 time: 0.044873 Oct 22 21:17:59.567573 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2547/5109] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:17:59 2022] GET /compute/v2.1/servers/cea3693e-cb10-4129-9f00-18f678998bbd => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 21:17:59.582547 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-07a5c8e5-20cf-4525-9cd8-5884f40ca7af tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:17:59.583535 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-07a5c8e5-20cf-4525-9cd8-5884f40ca7af tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] [instance: 3de67bb0-04d9-4d3a-a925-102f04d677bb] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:17:59.597445 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-07a5c8e5-20cf-4525-9cd8-5884f40ca7af tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:17:59.599071 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-07a5c8e5-20cf-4525-9cd8-5884f40ca7af tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:17:59.600077 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-07a5c8e5-20cf-4525-9cd8-5884f40ca7af tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:17:59.601509 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-07a5c8e5-20cf-4525-9cd8-5884f40ca7af tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:17:59.602602 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-07a5c8e5-20cf-4525-9cd8-5884f40ca7af tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:17:59.604432 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-07a5c8e5-20cf-4525-9cd8-5884f40ca7af tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:17:59.762548 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-07a5c8e5-20cf-4525-9cd8-5884f40ca7af tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a9229e7da421b9e0e6f7df52f71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28af724189a24022b3ef7651b7157a9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:17:59.772078 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-07a5c8e5-20cf-4525-9cd8-5884f40ca7af tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] 10.222.0.18 "GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb" status: 200 len: 1507 microversion: 2.1 time: 0.199277 Oct 22 21:17:59.772811 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2563/5110] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:17:59 2022] GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb => generated 1507 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:17:59.929738 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-f2f4249c-50fd-460b-8612-ed619006db4f tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Action: 'create', calling method: >, body: {"server": {"name": 12345, "imageRef": "085e4478-6edc-4a69-8e08-f9831713eb65", "flavorRef": "452", "networks": [{"uuid": "b17a38c5-877b-428d-bd53-e74609d155b2"}]}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:17:59.935005 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-f2f4249c-50fd-460b-8612-ed619006db4f tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Request method failure captured: Oct 22 21:17:59.935005 ncdv-master-1 devstack@n-api.service[138744]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 22 21:17:59.935005 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 21:17:59.935005 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 21:17:59.935005 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 21:17:59.935005 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 163 Oct 22 21:17:59.935005 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 21:17:59.935005 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 21:17:59.935005 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 21:17:59.935005 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 21:17:59.935005 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVF3hm7PiLG1R8Tw2syJVqR4znaBscty3weljpQpv2aVSYokkqaFvTxJu_8ZsVDxnVWNFBjrkTk4hem6vgNXmexe0yUI_M8pHEKoh5CWO6b1coilxRZ6VgX94mIL_xf6l3t9Q4mcnT856zV-XemvxZab0Ooy1ChU21L_her9Zn74z_zU Oct 22 21:17:59.935005 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 21:17:59.935005 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 21:17:59.935005 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 21:17:59.935005 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 21:17:59.935005 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 21:17:59.935005 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 21:17:59.935005 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: 28af724189a24022b3ef7651b7157a9d Oct 22 21:17:59.935005 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-ServersNegativeTestJSON-766586991 Oct 22 21:17:59.935005 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 21:17:59.935005 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 21:17:59.935005 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_28af724189a24022b3ef7651b7157a9d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/28af724189a24022b3ef7651b7157a9d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/28af724189a24022b3ef7651b7157a9d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/28af724189a24022b3ef7651b7157a9d"}]}] Oct 22 21:17:59.935005 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-ServersNegativeTestJSON-766586991 Oct 22 21:17:59.935005 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: 28af724189a24022b3ef7651b7157a9d Oct 22 21:17:59.935005 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-ServersNegativeTestJSON-766586991 Oct 22 21:17:59.935005 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-ServersNegativeTestJSON-766586991-project Oct 22 21:17:59.935005 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 21:17:59.935005 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 21:17:59.935005 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: 6c8a9229e7da421b9e0e6f7df52f71e2 Oct 22 21:17:59.935005 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-ServersNegativeTestJSON-766586991-project Oct 22 21:17:59.935005 ncdv-master-1 devstack@n-api.service[138744]: Oct 22 21:17:59.935005 ncdv-master-1 devstack@n-api.service[138744]: {"server": {"name": 12345, "imageRef": "085e4478-6edc-4a69-8e08-f9831713eb65", "flavorRef": "452", "networks": [{"uuid": "b17a38c5-877b-428d-bd53-e74609d155b2"}]}} Oct 22 21:17:59.935005 ncdv-master-1 devstack@n-api.service[138744]: method: > Oct 22 21:17:59.935005 ncdv-master-1 devstack@n-api.service[138744]: exception: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Oct 22 21:17:59.935005 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'body': {'server': {'name': 12345, 'imageRef': '085e4478-6edc-4a69-8e08-f9831713eb65', 'flavorRef': '452', 'networks': [{'uuid': 'b17a38c5-877b-428d-bd53-e74609d155b2'}]}}} Oct 22 21:17:59.935005 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:17:59.935005 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:17:59.935005 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 22 21:17:59.935005 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 22 21:17:59.935005 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 22 21:17:59.935005 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise error Oct 22 21:17:59.935005 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 12345 is not of type 'string' Oct 22 21:17:59.935005 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:17:59.935005 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['name']: Oct 22 21:17:59.935005 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 22 21:17:59.935005 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:17:59.935005 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 22 21:17:59.935005 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi 12345 Oct 22 21:17:59.935005 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:17:59.935005 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:17:59.935005 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:17:59.935005 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:17:59.935005 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:17:59.935005 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:17:59.935005 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:17:59.935005 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:17:59.935005 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:17:59.935005 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:17:59.935005 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 21:17:59.935005 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 21:17:59.935005 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 22 21:17:59.935005 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 22 21:17:59.935005 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 22 21:17:59.935005 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 22 21:17:59.935005 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 22 21:17:59.941310 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 22 21:17:59.941310 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Oct 22 21:17:59.941310 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:17:59.941310 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:17:59.941310 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:17:59.941310 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:17:59.941310 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:17:59.941310 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:17:59.941310 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 22 21:17:59.941310 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 22 21:17:59.941310 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Oct 22 21:17:59.941310 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:17:59.941310 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-f2f4249c-50fd-460b-8612-ed619006db4f tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Returning 400 to user: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:17:59.941310 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-f2f4249c-50fd-460b-8612-ed619006db4f tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 400 len: 127 microversion: 2.1 time: 0.013268 Oct 22 21:17:59.941310 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2548/5111] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Oct 22 21:17:59 2022] POST /compute/v2.1/servers => generated 127 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 22 21:17:59.947980 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-84e1517d-61fa-46bc-a472-59f1a50006a0 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:17:59.948977 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-84e1517d-61fa-46bc-a472-59f1a50006a0 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] [instance: 3de67bb0-04d9-4d3a-a925-102f04d677bb] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:17:59.957121 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-84e1517d-61fa-46bc-a472-59f1a50006a0 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:17:59.957723 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-84e1517d-61fa-46bc-a472-59f1a50006a0 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:17:59.958289 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-84e1517d-61fa-46bc-a472-59f1a50006a0 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:17:59.961388 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-84e1517d-61fa-46bc-a472-59f1a50006a0 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:17:59.961882 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-84e1517d-61fa-46bc-a472-59f1a50006a0 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:17:59.962344 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-84e1517d-61fa-46bc-a472-59f1a50006a0 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:18:00.108475 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-84e1517d-61fa-46bc-a472-59f1a50006a0 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a9229e7da421b9e0e6f7df52f71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28af724189a24022b3ef7651b7157a9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:18:00.117765 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-84e1517d-61fa-46bc-a472-59f1a50006a0 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] 10.222.0.18 "GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb" status: 200 len: 1507 microversion: 2.1 time: 0.173813 Oct 22 21:18:00.118657 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2564/5112] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:17:59 2022] GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb => generated 1507 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:18:00.141030 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-b4a81b67-8e81-483c-8627-5b7f4212964d tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:18:00.141640 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-b4a81b67-8e81-483c-8627-5b7f4212964d tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] [instance: 3de67bb0-04d9-4d3a-a925-102f04d677bb] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:18:00.149196 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b4a81b67-8e81-483c-8627-5b7f4212964d tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:18:00.149695 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b4a81b67-8e81-483c-8627-5b7f4212964d tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:18:00.150127 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b4a81b67-8e81-483c-8627-5b7f4212964d tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:18:00.150821 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b4a81b67-8e81-483c-8627-5b7f4212964d tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:18:00.151275 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b4a81b67-8e81-483c-8627-5b7f4212964d tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:18:00.151727 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b4a81b67-8e81-483c-8627-5b7f4212964d tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:18:00.206529 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-fd8fef37-bc74-4f68-b71a-5592e07c0291 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:18:00.207911 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-fd8fef37-bc74-4f68-b71a-5592e07c0291 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: 20d90b58-3fad-4a44-b6bf-4ef0cc587def] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:18:00.215121 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fd8fef37-bc74-4f68-b71a-5592e07c0291 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:18:00.216100 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fd8fef37-bc74-4f68-b71a-5592e07c0291 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:18:00.216886 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fd8fef37-bc74-4f68-b71a-5592e07c0291 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:18:00.217867 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fd8fef37-bc74-4f68-b71a-5592e07c0291 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:18:00.218544 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fd8fef37-bc74-4f68-b71a-5592e07c0291 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:18:00.219192 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fd8fef37-bc74-4f68-b71a-5592e07c0291 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:18:00.389208 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-b4a81b67-8e81-483c-8627-5b7f4212964d tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a9229e7da421b9e0e6f7df52f71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28af724189a24022b3ef7651b7157a9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:18:00.400998 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-b4a81b67-8e81-483c-8627-5b7f4212964d tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] 10.222.0.18 "GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb" status: 200 len: 1507 microversion: 2.1 time: 0.263842 Oct 22 21:18:00.403996 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2549/5113] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:18:00 2022] GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb => generated 1507 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:18:00.437662 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-fd8fef37-bc74-4f68-b71a-5592e07c0291 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c85602851244d4a632b9c861eb4416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45cb377c6a9a43b3b91c99a64e37f1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:18:00.442370 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:18:00.454430 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-fd8fef37-bc74-4f68-b71a-5592e07c0291 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def" status: 200 len: 1550 microversion: 2.1 time: 0.251999 Oct 22 21:18:00.467547 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2565/5114] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:18:00 2022] GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def => generated 1550 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:18:00.483409 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-9d1281c6-337b-4b17-a4e2-ce8fdb6ab5c2 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:18:00.483916 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-9d1281c6-337b-4b17-a4e2-ce8fdb6ab5c2 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: 20d90b58-3fad-4a44-b6bf-4ef0cc587def] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:18:00.498999 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9d1281c6-337b-4b17-a4e2-ce8fdb6ab5c2 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:18:00.499582 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9d1281c6-337b-4b17-a4e2-ce8fdb6ab5c2 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:18:00.500029 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9d1281c6-337b-4b17-a4e2-ce8fdb6ab5c2 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:18:00.500745 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9d1281c6-337b-4b17-a4e2-ce8fdb6ab5c2 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:18:00.501207 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9d1281c6-337b-4b17-a4e2-ce8fdb6ab5c2 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:18:00.501667 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9d1281c6-337b-4b17-a4e2-ce8fdb6ab5c2 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:18:00.684388 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-9d1281c6-337b-4b17-a4e2-ce8fdb6ab5c2 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.204894 Oct 22 21:18:00.686042 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2550/5115] 10.222.0.18 () {58 vars in 1275 bytes} [Sat Oct 22 21:18:00 2022] GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def/os-interface => generated 285 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:18:02.131539 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-c21acc91-4c8b-4465-a3f0-a10c0a27304a req-960c455c-09fa-458b-82b2-359dacf4f36c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20d90b58-3fad-4a44-b6bf-4ef0cc587def", "tag": "7ef4550f-d128-432a-9dbc-ce1802e6c6da"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:18:02.167172 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:18:02.174403 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-c21acc91-4c8b-4465-a3f0-a10c0a27304a req-960c455c-09fa-458b-82b2-359dacf4f36c service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:18:02.174929 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-c21acc91-4c8b-4465-a3f0-a10c0a27304a req-960c455c-09fa-458b-82b2-359dacf4f36c service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:18:02.175677 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-c21acc91-4c8b-4465-a3f0-a10c0a27304a req-960c455c-09fa-458b-82b2-359dacf4f36c service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:18:02.208437 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-c21acc91-4c8b-4465-a3f0-a10c0a27304a req-960c455c-09fa-458b-82b2-359dacf4f36c service nova] Creating event network-changed:7ef4550f-d128-432a-9dbc-ce1802e6c6da for instance 20d90b58-3fad-4a44-b6bf-4ef0cc587def on nch1-master-1 Oct 22 21:18:02.248535 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-c21acc91-4c8b-4465-a3f0-a10c0a27304a req-960c455c-09fa-458b-82b2-359dacf4f36c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120904 Oct 22 21:18:02.249158 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2566/5116] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:18:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:18:02.306665 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-306b421b-a6c1-4a5c-a737-45bcd0330f80 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1931970246", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "3eaddf40-8188-4b1b-980a-3be0b9b0e509", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "b17a38c5-877b-428d-bd53-e74609d155b2"}]}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:18:02.494012 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-306b421b-a6c1-4a5c-a737-45bcd0330f80 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] HTTP exception thrown: Block Device 3eaddf40-8188-4b1b-980a-3be0b9b0e509 is not bootable. Oct 22 21:18:02.512699 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-306b421b-a6c1-4a5c-a737-45bcd0330f80 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Request method failure captured: Oct 22 21:18:02.512699 ncdv-master-1 devstack@n-api.service[138744]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 22 21:18:02.512699 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 21:18:02.512699 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 21:18:02.512699 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 21:18:02.512699 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 358 Oct 22 21:18:02.512699 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 21:18:02.512699 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 21:18:02.512699 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 21:18:02.512699 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 21:18:02.512699 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVF3hm7PiLG1R8Tw2syJVqR4znaBscty3weljpQpv2aVSYokkqaFvTxJu_8ZsVDxnVWNFBjrkTk4hem6vgNXmexe0yUI_M8pHEKoh5CWO6b1coilxRZ6VgX94mIL_xf6l3t9Q4mcnT856zV-XemvxZab0Ooy1ChU21L_her9Zn74z_zU Oct 22 21:18:02.512699 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 21:18:02.512699 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 21:18:02.512699 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 21:18:02.512699 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 21:18:02.512699 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 21:18:02.512699 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 21:18:02.512699 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: 28af724189a24022b3ef7651b7157a9d Oct 22 21:18:02.512699 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-ServersNegativeTestJSON-766586991 Oct 22 21:18:02.512699 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 21:18:02.512699 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 21:18:02.512699 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_28af724189a24022b3ef7651b7157a9d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/28af724189a24022b3ef7651b7157a9d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/28af724189a24022b3ef7651b7157a9d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/28af724189a24022b3ef7651b7157a9d"}]}] Oct 22 21:18:02.512699 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-ServersNegativeTestJSON-766586991 Oct 22 21:18:02.512699 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: 28af724189a24022b3ef7651b7157a9d Oct 22 21:18:02.512699 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-ServersNegativeTestJSON-766586991 Oct 22 21:18:02.512699 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-ServersNegativeTestJSON-766586991-project Oct 22 21:18:02.512699 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 21:18:02.512699 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 21:18:02.512699 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: 6c8a9229e7da421b9e0e6f7df52f71e2 Oct 22 21:18:02.512699 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-ServersNegativeTestJSON-766586991-project Oct 22 21:18:02.512699 ncdv-master-1 devstack@n-api.service[138744]: Oct 22 21:18:02.512699 ncdv-master-1 devstack@n-api.service[138744]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1931970246", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "3eaddf40-8188-4b1b-980a-3be0b9b0e509", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "b17a38c5-877b-428d-bd53-e74609d155b2"}]}} Oct 22 21:18:02.512699 ncdv-master-1 devstack@n-api.service[138744]: method: > Oct 22 21:18:02.512699 ncdv-master-1 devstack@n-api.service[138744]: exception: Block Device 3eaddf40-8188-4b1b-980a-3be0b9b0e509 is not bootable. Oct 22 21:18:02.512699 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1931970246', 'imageRef': '', 'flavorRef': '452', 'block_device_mapping_v2': [{'boot_index': 0, 'source_type': 'volume', 'destination_type': 'volume', 'delete_on_termination': False, 'volume_id': '3eaddf40-8188-4b1b-980a-3be0b9b0e509'}], 'networks': [{'uuid': 'b17a38c5-877b-428d-bd53-e74609d155b2'}]}}} Oct 22 21:18:02.512699 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:18:02.512699 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:18:02.512699 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 22 21:18:02.512699 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 22 21:18:02.512699 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 22 21:18:02.512699 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 22 21:18:02.512699 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1672, in _create_instance Oct 22 21:18:02.512699 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi boot_meta = block_device.get_bdm_image_metadata( Oct 22 21:18:02.512699 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/block_device.py", line 664, in get_bdm_image_metadata Oct 22 21:18:02.512699 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.InvalidBDMVolumeNotBootable(id=volume_id) Oct 22 21:18:02.512699 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.InvalidBDMVolumeNotBootable: Block Device 3eaddf40-8188-4b1b-980a-3be0b9b0e509 is not bootable. Oct 22 21:18:02.512699 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:18:02.512699 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:18:02.512699 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:18:02.512699 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:18:02.512699 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:18:02.512699 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:18:02.512699 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:18:02.512699 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:18:02.512699 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:18:02.512699 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:18:02.512699 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 21:18:02.512699 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 21:18:02.512699 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 21:18:02.516202 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 21:18:02.516202 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 21:18:02.516202 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 21:18:02.516202 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 22 21:18:02.516202 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 22 21:18:02.516202 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 22 21:18:02.516202 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Block Device 3eaddf40-8188-4b1b-980a-3be0b9b0e509 is not bootable. Oct 22 21:18:02.516202 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:18:02.516202 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:18:02.516202 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:18:02.516202 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:18:02.516202 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:18:02.516202 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:18:02.516202 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:18:02.516202 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:18:02.516202 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Block Device 3eaddf40-8188-4b1b-980a-3be0b9b0e509 is not bootable. Oct 22 21:18:02.516202 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:18:02.516202 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-306b421b-a6c1-4a5c-a737-45bcd0330f80 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Returning 400 to user: Block Device 3eaddf40-8188-4b1b-980a-3be0b9b0e509 is not bootable. {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:18:02.516202 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-306b421b-a6c1-4a5c-a737-45bcd0330f80 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.212952 Oct 22 21:18:02.518332 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2551/5117] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Oct 22 21:18:02 2022] POST /compute/v2.1/servers => generated 110 bytes in 217 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 22 21:18:02.528366 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-62ada62b-a9c2-4f02-b53b-8222f93483e5 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:18:02.529700 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-62ada62b-a9c2-4f02-b53b-8222f93483e5 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] [instance: 3de67bb0-04d9-4d3a-a925-102f04d677bb] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:18:02.545586 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-62ada62b-a9c2-4f02-b53b-8222f93483e5 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:18:02.546774 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-62ada62b-a9c2-4f02-b53b-8222f93483e5 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:18:02.547247 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-62ada62b-a9c2-4f02-b53b-8222f93483e5 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:18:02.551831 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-62ada62b-a9c2-4f02-b53b-8222f93483e5 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:18:02.552903 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-62ada62b-a9c2-4f02-b53b-8222f93483e5 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:18:02.553381 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-62ada62b-a9c2-4f02-b53b-8222f93483e5 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:18:02.999732 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-62ada62b-a9c2-4f02-b53b-8222f93483e5 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a9229e7da421b9e0e6f7df52f71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28af724189a24022b3ef7651b7157a9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:18:03.014474 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-62ada62b-a9c2-4f02-b53b-8222f93483e5 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] 10.222.0.18 "GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb" status: 200 len: 1507 microversion: 2.1 time: 0.493903 Oct 22 21:18:03.016126 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2567/5118] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:18:02 2022] GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb => generated 1507 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:18:03.044227 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-ca15ca7f-5169-4db9-ad3d-cb90941b3776 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:18:03.044853 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-ca15ca7f-5169-4db9-ad3d-cb90941b3776 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] [instance: 3de67bb0-04d9-4d3a-a925-102f04d677bb] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:18:03.059291 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ca15ca7f-5169-4db9-ad3d-cb90941b3776 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:18:03.068921 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ca15ca7f-5169-4db9-ad3d-cb90941b3776 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:18:03.069440 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ca15ca7f-5169-4db9-ad3d-cb90941b3776 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:18:03.071727 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ca15ca7f-5169-4db9-ad3d-cb90941b3776 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:18:03.073298 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ca15ca7f-5169-4db9-ad3d-cb90941b3776 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:18:03.075197 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ca15ca7f-5169-4db9-ad3d-cb90941b3776 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:18:03.394274 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-ca15ca7f-5169-4db9-ad3d-cb90941b3776 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a9229e7da421b9e0e6f7df52f71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28af724189a24022b3ef7651b7157a9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:18:03.414095 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-ca15ca7f-5169-4db9-ad3d-cb90941b3776 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] 10.222.0.18 "GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb" status: 200 len: 1507 microversion: 2.1 time: 0.374773 Oct 22 21:18:03.418512 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2552/5119] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:18:03 2022] GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb => generated 1507 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:18:05.105309 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-ea86ddf8-0c88-4360-9a41-b66f107b4dea tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-437827830", "imageRef": "085e4478-6edc-4a69-8e08-f9831713eb65", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "085e4478-6edc-4a69-8e08-f9831713eb65", "destination_type": "local"}, {"source_type": "volume", "uuid": "201624cb-7374-478d-a393-3406988e013a", "destination_type": "invalid"}], "networks": [{"uuid": "b17a38c5-877b-428d-bd53-e74609d155b2"}]}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:18:05.111637 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-ea86ddf8-0c88-4360-9a41-b66f107b4dea tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Request method failure captured: Oct 22 21:18:05.111637 ncdv-master-1 devstack@n-api.service[138745]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 22 21:18:05.111637 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 21:18:05.111637 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 21:18:05.111637 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 21:18:05.111637 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 494 Oct 22 21:18:05.111637 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 21:18:05.111637 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 21:18:05.111637 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 21:18:05.111637 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 21:18:05.111637 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVF3hm7PiLG1R8Tw2syJVqR4znaBscty3weljpQpv2aVSYokkqaFvTxJu_8ZsVDxnVWNFBjrkTk4hem6vgNXmexe0yUI_M8pHEKoh5CWO6b1coilxRZ6VgX94mIL_xf6l3t9Q4mcnT856zV-XemvxZab0Ooy1ChU21L_her9Zn74z_zU Oct 22 21:18:05.111637 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 21:18:05.111637 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 21:18:05.111637 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 21:18:05.111637 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 21:18:05.111637 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 21:18:05.111637 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 21:18:05.111637 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: 28af724189a24022b3ef7651b7157a9d Oct 22 21:18:05.111637 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-ServersNegativeTestJSON-766586991 Oct 22 21:18:05.111637 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 21:18:05.111637 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 21:18:05.111637 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_28af724189a24022b3ef7651b7157a9d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/28af724189a24022b3ef7651b7157a9d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/28af724189a24022b3ef7651b7157a9d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/28af724189a24022b3ef7651b7157a9d"}]}] Oct 22 21:18:05.111637 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-ServersNegativeTestJSON-766586991 Oct 22 21:18:05.111637 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: 28af724189a24022b3ef7651b7157a9d Oct 22 21:18:05.111637 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-ServersNegativeTestJSON-766586991 Oct 22 21:18:05.111637 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-ServersNegativeTestJSON-766586991-project Oct 22 21:18:05.111637 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 21:18:05.111637 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 21:18:05.111637 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: 6c8a9229e7da421b9e0e6f7df52f71e2 Oct 22 21:18:05.111637 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-ServersNegativeTestJSON-766586991-project Oct 22 21:18:05.111637 ncdv-master-1 devstack@n-api.service[138745]: Oct 22 21:18:05.111637 ncdv-master-1 devstack@n-api.service[138745]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-437827830", "imageRef": "085e4478-6edc-4a69-8e08-f9831713eb65", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "085e4478-6edc-4a69-8e08-f9831713eb65", "destination_type": "local"}, {"source_type": "volume", "uuid": "201624cb-7374-478d-a393-3406988e013a", "destination_type": "invalid"}], "networks": [{"uuid": "b17a38c5-877b-428d-bd53-e74609d155b2"}]}} Oct 22 21:18:05.111637 ncdv-master-1 devstack@n-api.service[138745]: method: > Oct 22 21:18:05.111637 ncdv-master-1 devstack@n-api.service[138745]: exception: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Oct 22 21:18:05.111637 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-437827830', 'imageRef': '085e4478-6edc-4a69-8e08-f9831713eb65', 'flavorRef': '452', 'block_device_mapping_v2': [{'source_type': 'image', 'delete_on_termination': True, 'boot_index': 0, 'uuid': '085e4478-6edc-4a69-8e08-f9831713eb65', 'destination_type': 'local'}, {'source_type': 'volume', 'uuid': '201624cb-7374-478d-a393-3406988e013a', 'destination_type': 'invalid'}], 'networks': [{'uuid': 'b17a38c5-877b-428d-bd53-e74609d155b2'}]}}} Oct 22 21:18:05.111637 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:18:05.111637 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:18:05.111637 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 22 21:18:05.111637 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 22 21:18:05.111637 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 22 21:18:05.111637 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise error Oct 22 21:18:05.111637 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['local', 'volume'] Oct 22 21:18:05.111637 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:18:05.111637 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['server']['properties']['block_device_mapping_v2']['items']['properties']['destination_type']: Oct 22 21:18:05.111637 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi {'enum': ['local', 'volume'], 'type': 'string'} Oct 22 21:18:05.111637 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:18:05.111637 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi On instance['server']['block_device_mapping_v2'][1]: Oct 22 21:18:05.111637 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi 'invalid' Oct 22 21:18:05.111637 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:18:05.111637 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:18:05.111637 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:18:05.111637 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:18:05.111637 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:18:05.111637 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:18:05.111637 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:18:05.111637 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:18:05.111637 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:18:05.111637 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:18:05.116089 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 21:18:05.116089 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 21:18:05.116089 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 22 21:18:05.116089 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 22 21:18:05.116089 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 22 21:18:05.116089 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 22 21:18:05.116089 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 22 21:18:05.116089 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 22 21:18:05.116089 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Oct 22 21:18:05.116089 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:18:05.116089 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:18:05.116089 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:18:05.116089 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:18:05.116089 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:18:05.116089 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:18:05.116089 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 22 21:18:05.116089 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 22 21:18:05.116089 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Oct 22 21:18:05.116089 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:18:05.120937 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-ea86ddf8-0c88-4360-9a41-b66f107b4dea tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:18:05.122524 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-ea86ddf8-0c88-4360-9a41-b66f107b4dea tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.027196 Oct 22 21:18:05.124092 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2568/5120] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Oct 22 21:18:05 2022] POST /compute/v2.1/servers => generated 155 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 22 21:18:05.133782 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-23f1e7e9-67fa-422e-9082-88a1d7ead025 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:18:05.134408 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-23f1e7e9-67fa-422e-9082-88a1d7ead025 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] [instance: 3de67bb0-04d9-4d3a-a925-102f04d677bb] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:18:05.152663 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-23f1e7e9-67fa-422e-9082-88a1d7ead025 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:18:05.158499 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-23f1e7e9-67fa-422e-9082-88a1d7ead025 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:18:05.162296 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-23f1e7e9-67fa-422e-9082-88a1d7ead025 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:18:05.163266 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-23f1e7e9-67fa-422e-9082-88a1d7ead025 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:18:05.163771 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-23f1e7e9-67fa-422e-9082-88a1d7ead025 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:18:05.164207 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-23f1e7e9-67fa-422e-9082-88a1d7ead025 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:18:05.370561 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-23f1e7e9-67fa-422e-9082-88a1d7ead025 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a9229e7da421b9e0e6f7df52f71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28af724189a24022b3ef7651b7157a9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:18:05.378967 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-23f1e7e9-67fa-422e-9082-88a1d7ead025 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] 10.222.0.18 "GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb" status: 200 len: 1507 microversion: 2.1 time: 0.250523 Oct 22 21:18:05.388845 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2553/5121] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:18:05 2022] GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb => generated 1507 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:18:05.403597 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-37a6e3fe-2849-4715-a50f-d079e422efff tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:18:05.404314 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-37a6e3fe-2849-4715-a50f-d079e422efff tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] [instance: 3de67bb0-04d9-4d3a-a925-102f04d677bb] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:18:05.412130 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-37a6e3fe-2849-4715-a50f-d079e422efff tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:18:05.413020 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-37a6e3fe-2849-4715-a50f-d079e422efff tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:18:05.413561 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-37a6e3fe-2849-4715-a50f-d079e422efff tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:18:05.414751 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-37a6e3fe-2849-4715-a50f-d079e422efff tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:18:05.415296 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-37a6e3fe-2849-4715-a50f-d079e422efff tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:18:05.415835 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-37a6e3fe-2849-4715-a50f-d079e422efff tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:18:05.560601 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-37a6e3fe-2849-4715-a50f-d079e422efff tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a9229e7da421b9e0e6f7df52f71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28af724189a24022b3ef7651b7157a9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:18:05.569338 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-37a6e3fe-2849-4715-a50f-d079e422efff tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] 10.222.0.18 "GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb" status: 200 len: 1507 microversion: 2.1 time: 0.170614 Oct 22 21:18:05.570044 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2569/5122] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:18:05 2022] GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb => generated 1507 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:18:05.645559 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-d5a5a2de-d9af-461c-bf8c-da6756a2cd15 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1751146176", "imageRef": "085e4478-6edc-4a69-8e08-f9831713eb65", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "b17a38c5-877b-428d-bd53-e74609d155b2"}]}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:18:05.649868 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-d5a5a2de-d9af-461c-bf8c-da6756a2cd15 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Request method failure captured: Oct 22 21:18:05.649868 ncdv-master-1 devstack@n-api.service[138744]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 22 21:18:05.649868 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 21:18:05.649868 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 21:18:05.649868 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 21:18:05.649868 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 492 Oct 22 21:18:05.649868 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 21:18:05.649868 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 21:18:05.649868 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 21:18:05.649868 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 21:18:05.649868 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVF3hm7PiLG1R8Tw2syJVqR4znaBscty3weljpQpv2aVSYokkqaFvTxJu_8ZsVDxnVWNFBjrkTk4hem6vgNXmexe0yUI_M8pHEKoh5CWO6b1coilxRZ6VgX94mIL_xf6l3t9Q4mcnT856zV-XemvxZab0Ooy1ChU21L_her9Zn74z_zU Oct 22 21:18:05.649868 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 21:18:05.649868 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 21:18:05.649868 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 21:18:05.649868 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 21:18:05.649868 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 21:18:05.649868 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 21:18:05.649868 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: 28af724189a24022b3ef7651b7157a9d Oct 22 21:18:05.649868 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-ServersNegativeTestJSON-766586991 Oct 22 21:18:05.649868 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 21:18:05.649868 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 21:18:05.649868 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_28af724189a24022b3ef7651b7157a9d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/28af724189a24022b3ef7651b7157a9d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/28af724189a24022b3ef7651b7157a9d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/28af724189a24022b3ef7651b7157a9d"}]}] Oct 22 21:18:05.649868 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-ServersNegativeTestJSON-766586991 Oct 22 21:18:05.649868 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: 28af724189a24022b3ef7651b7157a9d Oct 22 21:18:05.649868 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-ServersNegativeTestJSON-766586991 Oct 22 21:18:05.649868 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-ServersNegativeTestJSON-766586991-project Oct 22 21:18:05.649868 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 21:18:05.649868 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 21:18:05.649868 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: 6c8a9229e7da421b9e0e6f7df52f71e2 Oct 22 21:18:05.649868 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-ServersNegativeTestJSON-766586991-project Oct 22 21:18:05.649868 ncdv-master-1 devstack@n-api.service[138744]: Oct 22 21:18:05.649868 ncdv-master-1 devstack@n-api.service[138744]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1751146176", "imageRef": "085e4478-6edc-4a69-8e08-f9831713eb65", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "b17a38c5-877b-428d-bd53-e74609d155b2"}]}} Oct 22 21:18:05.649868 ncdv-master-1 devstack@n-api.service[138744]: method: > Oct 22 21:18:05.649868 ncdv-master-1 devstack@n-api.service[138744]: exception: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 22 21:18:05.649868 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1751146176', 'imageRef': '085e4478-6edc-4a69-8e08-f9831713eb65', 'flavorRef': '452', 'metadata': {'a': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}, 'networks': [{'uuid': 'b17a38c5-877b-428d-bd53-e74609d155b2'}]}}} Oct 22 21:18:05.649868 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:18:05.649868 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:18:05.649868 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 22 21:18:05.649868 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 22 21:18:05.649868 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 22 21:18:05.649868 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise error Oct 22 21:18:05.649868 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 22 21:18:05.649868 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:18:05.649868 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['metadata']['patternProperties']['^[a-zA-Z0-9-_:. ]{1,255}$']: Oct 22 21:18:05.649868 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi {'maxLength': 255, 'type': 'string'} Oct 22 21:18:05.649868 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:18:05.649868 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi On instance['server']['metadata']: Oct 22 21:18:05.653294 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' Oct 22 21:18:05.653294 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:18:05.653294 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:18:05.653294 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:18:05.653294 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:18:05.653294 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:18:05.653294 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:18:05.653294 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:18:05.653294 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:18:05.653294 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:18:05.653294 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:18:05.653294 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 21:18:05.653294 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 21:18:05.653294 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 22 21:18:05.653294 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 22 21:18:05.653294 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 22 21:18:05.653294 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 22 21:18:05.653294 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 22 21:18:05.653294 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 22 21:18:05.653294 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 22 21:18:05.653294 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:18:05.653294 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:18:05.653294 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:18:05.653294 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:18:05.653294 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:18:05.653294 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:18:05.653294 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 22 21:18:05.653294 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 22 21:18:05.653294 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 22 21:18:05.653294 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:18:05.653294 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-d5a5a2de-d9af-461c-bf8c-da6756a2cd15 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Returning 400 to user: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:18:05.656092 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-d5a5a2de-d9af-461c-bf8c-da6756a2cd15 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 400 len: 624 microversion: 2.1 time: 0.012552 Oct 22 21:18:05.656092 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2554/5123] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Oct 22 21:18:05 2022] POST /compute/v2.1/servers => generated 624 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 22 21:18:05.664598 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-e1ba0b80-ef41-4fe8-90b2-097ec74c86d2 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:18:05.665262 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-e1ba0b80-ef41-4fe8-90b2-097ec74c86d2 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] [instance: 3de67bb0-04d9-4d3a-a925-102f04d677bb] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:18:05.671747 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e1ba0b80-ef41-4fe8-90b2-097ec74c86d2 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:18:05.672268 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e1ba0b80-ef41-4fe8-90b2-097ec74c86d2 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:18:05.672725 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e1ba0b80-ef41-4fe8-90b2-097ec74c86d2 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:18:05.673505 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e1ba0b80-ef41-4fe8-90b2-097ec74c86d2 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:18:05.673978 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e1ba0b80-ef41-4fe8-90b2-097ec74c86d2 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:18:05.674423 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e1ba0b80-ef41-4fe8-90b2-097ec74c86d2 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:18:05.820881 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-e1ba0b80-ef41-4fe8-90b2-097ec74c86d2 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a9229e7da421b9e0e6f7df52f71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28af724189a24022b3ef7651b7157a9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:18:05.829316 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-e1ba0b80-ef41-4fe8-90b2-097ec74c86d2 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] 10.222.0.18 "GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb" status: 200 len: 1507 microversion: 2.1 time: 0.168882 Oct 22 21:18:05.829950 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2570/5124] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:18:05 2022] GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb => generated 1507 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:18:05.856245 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-b3bded02-d657-4768-81ec-3ce515899926 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:18:05.857055 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-b3bded02-d657-4768-81ec-3ce515899926 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] [instance: 3de67bb0-04d9-4d3a-a925-102f04d677bb] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:18:05.867490 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b3bded02-d657-4768-81ec-3ce515899926 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:18:05.867996 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b3bded02-d657-4768-81ec-3ce515899926 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:18:05.868435 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b3bded02-d657-4768-81ec-3ce515899926 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:18:05.869140 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b3bded02-d657-4768-81ec-3ce515899926 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:18:05.869591 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b3bded02-d657-4768-81ec-3ce515899926 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:18:05.870018 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b3bded02-d657-4768-81ec-3ce515899926 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:18:05.885673 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:SELECT=100 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:18:06.005094 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-b3bded02-d657-4768-81ec-3ce515899926 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a9229e7da421b9e0e6f7df52f71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28af724189a24022b3ef7651b7157a9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:18:06.013386 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-b3bded02-d657-4768-81ec-3ce515899926 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] 10.222.0.18 "GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb" status: 200 len: 1507 microversion: 2.1 time: 0.162123 Oct 22 21:18:06.013992 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2555/5125] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:18:05 2022] GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb => generated 1507 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:18:06.076831 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-127084e9-0c05-4e8f-ac78-65a5a3b7813e tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Action: 'create', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "085e4478-6edc-4a69-8e08-f9831713eb65", "flavorRef": "452", "networks": [{"uuid": "b17a38c5-877b-428d-bd53-e74609d155b2"}]}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:18:06.080861 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-127084e9-0c05-4e8f-ac78-65a5a3b7813e tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Request method failure captured: Oct 22 21:18:06.080861 ncdv-master-1 devstack@n-api.service[138745]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 22 21:18:06.080861 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 21:18:06.080861 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 21:18:06.080861 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 21:18:06.080861 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 416 Oct 22 21:18:06.080861 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 21:18:06.080861 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 21:18:06.080861 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 21:18:06.080861 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 21:18:06.080861 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVF3hm7PiLG1R8Tw2syJVqR4znaBscty3weljpQpv2aVSYokkqaFvTxJu_8ZsVDxnVWNFBjrkTk4hem6vgNXmexe0yUI_M8pHEKoh5CWO6b1coilxRZ6VgX94mIL_xf6l3t9Q4mcnT856zV-XemvxZab0Ooy1ChU21L_her9Zn74z_zU Oct 22 21:18:06.080861 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 21:18:06.080861 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 21:18:06.080861 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 21:18:06.080861 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 21:18:06.080861 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 21:18:06.080861 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 21:18:06.080861 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: 28af724189a24022b3ef7651b7157a9d Oct 22 21:18:06.080861 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-ServersNegativeTestJSON-766586991 Oct 22 21:18:06.080861 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 21:18:06.080861 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 21:18:06.080861 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_28af724189a24022b3ef7651b7157a9d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/28af724189a24022b3ef7651b7157a9d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/28af724189a24022b3ef7651b7157a9d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/28af724189a24022b3ef7651b7157a9d"}]}] Oct 22 21:18:06.080861 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-ServersNegativeTestJSON-766586991 Oct 22 21:18:06.080861 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: 28af724189a24022b3ef7651b7157a9d Oct 22 21:18:06.080861 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-ServersNegativeTestJSON-766586991 Oct 22 21:18:06.080861 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-ServersNegativeTestJSON-766586991-project Oct 22 21:18:06.080861 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 21:18:06.080861 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 21:18:06.080861 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: 6c8a9229e7da421b9e0e6f7df52f71e2 Oct 22 21:18:06.080861 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-ServersNegativeTestJSON-766586991-project Oct 22 21:18:06.080861 ncdv-master-1 devstack@n-api.service[138745]: Oct 22 21:18:06.080861 ncdv-master-1 devstack@n-api.service[138745]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "085e4478-6edc-4a69-8e08-f9831713eb65", "flavorRef": "452", "networks": [{"uuid": "b17a38c5-877b-428d-bd53-e74609d155b2"}]}} Oct 22 21:18:06.080861 ncdv-master-1 devstack@n-api.service[138745]: method: > Oct 22 21:18:06.080861 ncdv-master-1 devstack@n-api.service[138745]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 22 21:18:06.080861 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'imageRef': '085e4478-6edc-4a69-8e08-f9831713eb65', 'flavorRef': '452', 'networks': [{'uuid': 'b17a38c5-877b-428d-bd53-e74609d155b2'}]}}} Oct 22 21:18:06.080861 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:18:06.080861 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:18:06.080861 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 22 21:18:06.080861 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 22 21:18:06.080861 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 22 21:18:06.080861 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise error Oct 22 21:18:06.080861 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 22 21:18:06.080861 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:18:06.080861 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Oct 22 21:18:06.080861 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 22 21:18:06.080861 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:18:06.080861 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 22 21:18:06.080861 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 22 21:18:06.080861 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:18:06.080861 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:18:06.084422 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:18:06.084422 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:18:06.084422 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:18:06.084422 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:18:06.084422 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:18:06.084422 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:18:06.084422 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:18:06.084422 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:18:06.084422 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 21:18:06.084422 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 21:18:06.084422 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 22 21:18:06.084422 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 22 21:18:06.084422 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 22 21:18:06.084422 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 22 21:18:06.084422 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 22 21:18:06.084422 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 22 21:18:06.084422 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 22 21:18:06.084422 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:18:06.084422 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:18:06.084422 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:18:06.084422 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:18:06.084422 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:18:06.084422 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:18:06.084422 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 22 21:18:06.084422 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 22 21:18:06.084422 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 22 21:18:06.084422 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:18:06.084422 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-127084e9-0c05-4e8f-ac78-65a5a3b7813e tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:18:06.084422 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-127084e9-0c05-4e8f-ac78-65a5a3b7813e tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 400 len: 619 microversion: 2.1 time: 0.009922 Oct 22 21:18:06.084422 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2571/5126] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Oct 22 21:18:06 2022] POST /compute/v2.1/servers => generated 619 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 22 21:18:06.092475 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-632b802d-bfb8-4fe6-b8fd-3c3e8aba9002 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:18:06.093093 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-632b802d-bfb8-4fe6-b8fd-3c3e8aba9002 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] [instance: 3de67bb0-04d9-4d3a-a925-102f04d677bb] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:18:06.099615 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-632b802d-bfb8-4fe6-b8fd-3c3e8aba9002 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:18:06.100480 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-632b802d-bfb8-4fe6-b8fd-3c3e8aba9002 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:18:06.100895 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-632b802d-bfb8-4fe6-b8fd-3c3e8aba9002 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:18:06.101602 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-632b802d-bfb8-4fe6-b8fd-3c3e8aba9002 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:18:06.102057 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-632b802d-bfb8-4fe6-b8fd-3c3e8aba9002 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:18:06.102495 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-632b802d-bfb8-4fe6-b8fd-3c3e8aba9002 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:18:06.248496 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-632b802d-bfb8-4fe6-b8fd-3c3e8aba9002 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a9229e7da421b9e0e6f7df52f71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28af724189a24022b3ef7651b7157a9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:18:06.256794 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-632b802d-bfb8-4fe6-b8fd-3c3e8aba9002 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] 10.222.0.18 "GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb" status: 200 len: 1507 microversion: 2.1 time: 0.168300 Oct 22 21:18:06.257480 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2556/5127] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:18:06 2022] GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb => generated 1507 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:18:06.280930 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-5e61e7e0-3b7c-4c19-8d3f-4f7a0502f23e tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:18:06.281540 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-5e61e7e0-3b7c-4c19-8d3f-4f7a0502f23e tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] [instance: 3de67bb0-04d9-4d3a-a925-102f04d677bb] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:18:06.289412 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5e61e7e0-3b7c-4c19-8d3f-4f7a0502f23e tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:18:06.289932 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5e61e7e0-3b7c-4c19-8d3f-4f7a0502f23e tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:18:06.290361 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5e61e7e0-3b7c-4c19-8d3f-4f7a0502f23e tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:18:06.291312 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5e61e7e0-3b7c-4c19-8d3f-4f7a0502f23e tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:18:06.291818 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5e61e7e0-3b7c-4c19-8d3f-4f7a0502f23e tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:18:06.292567 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5e61e7e0-3b7c-4c19-8d3f-4f7a0502f23e tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:18:06.482278 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-5e61e7e0-3b7c-4c19-8d3f-4f7a0502f23e tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a9229e7da421b9e0e6f7df52f71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28af724189a24022b3ef7651b7157a9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:18:06.491549 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-5e61e7e0-3b7c-4c19-8d3f-4f7a0502f23e tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] 10.222.0.18 "GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb" status: 200 len: 1507 microversion: 2.1 time: 0.214435 Oct 22 21:18:06.492162 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2572/5128] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:18:06 2022] GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb => generated 1507 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:18:06.558072 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-af1e9db3-70e7-4770-ae24-fec264ed0c71 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-171650704", "imageRef": "085e4478-6edc-4a69-8e08-f9831713eb65", "flavorRef": -1, "networks": [{"uuid": "b17a38c5-877b-428d-bd53-e74609d155b2"}]}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:18:06.570856 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-af1e9db3-70e7-4770-ae24-fec264ed0c71 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] HTTP exception thrown: Flavor -1 could not be found. Oct 22 21:18:06.584264 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-af1e9db3-70e7-4770-ae24-fec264ed0c71 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Request method failure captured: Oct 22 21:18:06.584264 ncdv-master-1 devstack@n-api.service[138744]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 22 21:18:06.584264 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 21:18:06.584264 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 21:18:06.584264 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 21:18:06.584264 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 205 Oct 22 21:18:06.584264 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 21:18:06.584264 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 21:18:06.584264 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 21:18:06.584264 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 21:18:06.584264 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVF3hm7PiLG1R8Tw2syJVqR4znaBscty3weljpQpv2aVSYokkqaFvTxJu_8ZsVDxnVWNFBjrkTk4hem6vgNXmexe0yUI_M8pHEKoh5CWO6b1coilxRZ6VgX94mIL_xf6l3t9Q4mcnT856zV-XemvxZab0Ooy1ChU21L_her9Zn74z_zU Oct 22 21:18:06.584264 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 21:18:06.584264 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 21:18:06.584264 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 21:18:06.584264 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 21:18:06.584264 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 21:18:06.584264 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 21:18:06.584264 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: 28af724189a24022b3ef7651b7157a9d Oct 22 21:18:06.584264 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-ServersNegativeTestJSON-766586991 Oct 22 21:18:06.584264 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 21:18:06.584264 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 21:18:06.584264 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_28af724189a24022b3ef7651b7157a9d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/28af724189a24022b3ef7651b7157a9d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/28af724189a24022b3ef7651b7157a9d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/28af724189a24022b3ef7651b7157a9d"}]}] Oct 22 21:18:06.584264 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-ServersNegativeTestJSON-766586991 Oct 22 21:18:06.584264 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: 28af724189a24022b3ef7651b7157a9d Oct 22 21:18:06.584264 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-ServersNegativeTestJSON-766586991 Oct 22 21:18:06.584264 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-ServersNegativeTestJSON-766586991-project Oct 22 21:18:06.584264 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 21:18:06.584264 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 21:18:06.584264 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: 6c8a9229e7da421b9e0e6f7df52f71e2 Oct 22 21:18:06.584264 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-ServersNegativeTestJSON-766586991-project Oct 22 21:18:06.584264 ncdv-master-1 devstack@n-api.service[138744]: Oct 22 21:18:06.584264 ncdv-master-1 devstack@n-api.service[138744]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-171650704", "imageRef": "085e4478-6edc-4a69-8e08-f9831713eb65", "flavorRef": -1, "networks": [{"uuid": "b17a38c5-877b-428d-bd53-e74609d155b2"}]}} Oct 22 21:18:06.584264 ncdv-master-1 devstack@n-api.service[138744]: method: > Oct 22 21:18:06.584264 ncdv-master-1 devstack@n-api.service[138744]: exception: Flavor -1 could not be found. Oct 22 21:18:06.584264 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-171650704', 'imageRef': '085e4478-6edc-4a69-8e08-f9831713eb65', 'flavorRef': -1, 'networks': [{'uuid': 'b17a38c5-877b-428d-bd53-e74609d155b2'}]}}} Oct 22 21:18:06.584264 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:18:06.584264 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:18:06.584264 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Oct 22 21:18:06.584264 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Oct 22 21:18:06.584264 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 22 21:18:06.584264 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 22 21:18:06.584264 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 22 21:18:06.584264 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 22 21:18:06.584264 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 22 21:18:06.584264 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 22 21:18:06.584264 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 22 21:18:06.584264 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:18:06.584264 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 22 21:18:06.584264 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 22 21:18:06.584264 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor -1 could not be found. Oct 22 21:18:06.584264 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:18:06.584264 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:18:06.584264 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:18:06.584264 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:18:06.584264 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:18:06.584264 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:18:06.584264 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:18:06.584264 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:18:06.584264 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:18:06.584264 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:18:06.584264 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 21:18:06.584264 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 21:18:06.589363 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 21:18:06.589363 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 21:18:06.589363 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 21:18:06.589363 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 21:18:06.589363 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 22 21:18:06.589363 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 22 21:18:06.589363 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 22 21:18:06.589363 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor -1 could not be found. Oct 22 21:18:06.589363 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:18:06.589363 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:18:06.589363 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:18:06.589363 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:18:06.589363 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:18:06.589363 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:18:06.589363 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:18:06.589363 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:18:06.589363 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor -1 could not be found. Oct 22 21:18:06.589363 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:18:06.589363 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-af1e9db3-70e7-4770-ae24-fec264ed0c71 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Returning 400 to user: Flavor -1 could not be found. {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:18:06.589363 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-af1e9db3-70e7-4770-ae24-fec264ed0c71 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 400 len: 73 microversion: 2.1 time: 0.032860 Oct 22 21:18:06.589363 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2557/5129] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Oct 22 21:18:06 2022] POST /compute/v2.1/servers => generated 73 bytes in 34 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 22 21:18:06.596429 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-f086a58f-80a0-4d16-95f6-813840c638b0 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:18:06.597776 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-f086a58f-80a0-4d16-95f6-813840c638b0 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] [instance: 3de67bb0-04d9-4d3a-a925-102f04d677bb] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:18:06.603558 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f086a58f-80a0-4d16-95f6-813840c638b0 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:18:06.604056 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f086a58f-80a0-4d16-95f6-813840c638b0 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:18:06.604509 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f086a58f-80a0-4d16-95f6-813840c638b0 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:18:06.605224 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f086a58f-80a0-4d16-95f6-813840c638b0 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:18:06.605771 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f086a58f-80a0-4d16-95f6-813840c638b0 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:18:06.606213 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f086a58f-80a0-4d16-95f6-813840c638b0 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:18:06.744033 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-f086a58f-80a0-4d16-95f6-813840c638b0 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a9229e7da421b9e0e6f7df52f71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28af724189a24022b3ef7651b7157a9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:18:06.752710 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-f086a58f-80a0-4d16-95f6-813840c638b0 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] 10.222.0.18 "GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb" status: 200 len: 1507 microversion: 2.1 time: 0.160314 Oct 22 21:18:06.767397 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2573/5130] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:18:06 2022] GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb => generated 1507 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:18:06.778349 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-9dd32cd3-b5a9-4076-b524-afde3e23e9a1 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:18:06.779182 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-9dd32cd3-b5a9-4076-b524-afde3e23e9a1 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] [instance: 3de67bb0-04d9-4d3a-a925-102f04d677bb] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:18:06.785992 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9dd32cd3-b5a9-4076-b524-afde3e23e9a1 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:18:06.786571 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9dd32cd3-b5a9-4076-b524-afde3e23e9a1 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:18:06.787089 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9dd32cd3-b5a9-4076-b524-afde3e23e9a1 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:18:06.787882 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9dd32cd3-b5a9-4076-b524-afde3e23e9a1 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:18:06.788422 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9dd32cd3-b5a9-4076-b524-afde3e23e9a1 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:18:06.789052 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9dd32cd3-b5a9-4076-b524-afde3e23e9a1 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:18:06.932211 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-9dd32cd3-b5a9-4076-b524-afde3e23e9a1 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a9229e7da421b9e0e6f7df52f71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28af724189a24022b3ef7651b7157a9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:18:06.941026 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-9dd32cd3-b5a9-4076-b524-afde3e23e9a1 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] 10.222.0.18 "GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb" status: 200 len: 1507 microversion: 2.1 time: 0.168568 Oct 22 21:18:06.942014 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2558/5131] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:18:06 2022] GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb => generated 1507 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:18:07.003534 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-3000773f-fd27-46fa-b39d-e0bdff71d63c tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1321915357", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "b17a38c5-877b-428d-bd53-e74609d155b2"}]}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:18:07.007656 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-3000773f-fd27-46fa-b39d-e0bdff71d63c tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Request method failure captured: Oct 22 21:18:07.007656 ncdv-master-1 devstack@n-api.service[138745]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 22 21:18:07.007656 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 21:18:07.007656 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 21:18:07.007656 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 21:18:07.007656 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 173 Oct 22 21:18:07.007656 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 21:18:07.007656 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 21:18:07.007656 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 21:18:07.007656 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 21:18:07.007656 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVF3hm7PiLG1R8Tw2syJVqR4znaBscty3weljpQpv2aVSYokkqaFvTxJu_8ZsVDxnVWNFBjrkTk4hem6vgNXmexe0yUI_M8pHEKoh5CWO6b1coilxRZ6VgX94mIL_xf6l3t9Q4mcnT856zV-XemvxZab0Ooy1ChU21L_her9Zn74z_zU Oct 22 21:18:07.007656 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 21:18:07.007656 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 21:18:07.007656 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 21:18:07.007656 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 21:18:07.007656 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 21:18:07.007656 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 21:18:07.007656 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: 28af724189a24022b3ef7651b7157a9d Oct 22 21:18:07.007656 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-ServersNegativeTestJSON-766586991 Oct 22 21:18:07.007656 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 21:18:07.007656 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 21:18:07.007656 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_28af724189a24022b3ef7651b7157a9d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/28af724189a24022b3ef7651b7157a9d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/28af724189a24022b3ef7651b7157a9d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/28af724189a24022b3ef7651b7157a9d"}]}] Oct 22 21:18:07.007656 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-ServersNegativeTestJSON-766586991 Oct 22 21:18:07.007656 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: 28af724189a24022b3ef7651b7157a9d Oct 22 21:18:07.007656 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-ServersNegativeTestJSON-766586991 Oct 22 21:18:07.007656 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-ServersNegativeTestJSON-766586991-project Oct 22 21:18:07.007656 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 21:18:07.007656 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 21:18:07.007656 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: 6c8a9229e7da421b9e0e6f7df52f71e2 Oct 22 21:18:07.007656 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-ServersNegativeTestJSON-766586991-project Oct 22 21:18:07.007656 ncdv-master-1 devstack@n-api.service[138745]: Oct 22 21:18:07.007656 ncdv-master-1 devstack@n-api.service[138745]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1321915357", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "b17a38c5-877b-428d-bd53-e74609d155b2"}]}} Oct 22 21:18:07.007656 ncdv-master-1 devstack@n-api.service[138745]: method: > Oct 22 21:18:07.007656 ncdv-master-1 devstack@n-api.service[138745]: exception: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Oct 22 21:18:07.007656 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1321915357', 'imageRef': -1, 'flavorRef': '452', 'networks': [{'uuid': 'b17a38c5-877b-428d-bd53-e74609d155b2'}]}}} Oct 22 21:18:07.007656 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:18:07.007656 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:18:07.007656 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 22 21:18:07.007656 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 22 21:18:07.007656 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 22 21:18:07.007656 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise error Oct 22 21:18:07.007656 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: -1 is not valid under any of the given schemas Oct 22 21:18:07.007656 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:18:07.007656 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['server']['properties']['imageRef']: Oct 22 21:18:07.007656 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'uuid', 'type': 'string'}, Oct 22 21:18:07.007656 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi {'maxLength': 0, 'type': 'string'}]} Oct 22 21:18:07.007656 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:18:07.007656 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 22 21:18:07.007656 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi -1 Oct 22 21:18:07.007656 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:18:07.007656 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:18:07.007656 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:18:07.007656 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:18:07.007656 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:18:07.007656 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:18:07.007656 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:18:07.007656 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:18:07.007656 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:18:07.007656 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:18:07.007656 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 21:18:07.007656 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 21:18:07.007656 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 22 21:18:07.007656 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 22 21:18:07.007656 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 22 21:18:07.007656 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 22 21:18:07.011596 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 22 21:18:07.011596 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 22 21:18:07.011596 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Oct 22 21:18:07.011596 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:18:07.011596 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:18:07.011596 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:18:07.011596 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:18:07.011596 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:18:07.011596 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:18:07.011596 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 22 21:18:07.011596 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 22 21:18:07.011596 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Oct 22 21:18:07.011596 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:18:07.011596 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-3000773f-fd27-46fa-b39d-e0bdff71d63c tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Returning 400 to user: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:18:07.011596 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-3000773f-fd27-46fa-b39d-e0bdff71d63c tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 400 len: 145 microversion: 2.1 time: 0.009610 Oct 22 21:18:07.011596 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2574/5132] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Oct 22 21:18:06 2022] POST /compute/v2.1/servers => generated 145 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 22 21:18:07.017584 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-dbb2f99e-3e44-4543-bede-c8a99625617b tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:18:07.018268 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-dbb2f99e-3e44-4543-bede-c8a99625617b tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] [instance: 3de67bb0-04d9-4d3a-a925-102f04d677bb] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:18:07.024403 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-dbb2f99e-3e44-4543-bede-c8a99625617b tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:18:07.024889 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-dbb2f99e-3e44-4543-bede-c8a99625617b tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:18:07.025333 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-dbb2f99e-3e44-4543-bede-c8a99625617b tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:18:07.026033 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-dbb2f99e-3e44-4543-bede-c8a99625617b tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:18:07.026485 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-dbb2f99e-3e44-4543-bede-c8a99625617b tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:18:07.026891 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-dbb2f99e-3e44-4543-bede-c8a99625617b tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:18:07.161926 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-dbb2f99e-3e44-4543-bede-c8a99625617b tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a9229e7da421b9e0e6f7df52f71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28af724189a24022b3ef7651b7157a9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:18:07.169850 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-dbb2f99e-3e44-4543-bede-c8a99625617b tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] 10.222.0.18 "GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb" status: 200 len: 1507 microversion: 2.1 time: 0.156272 Oct 22 21:18:07.170442 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2559/5133] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:18:07 2022] GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb => generated 1507 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:18:07.192818 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-b7e0791c-7acc-4a54-a640-b100b6f5d26c tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:18:07.193442 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-b7e0791c-7acc-4a54-a640-b100b6f5d26c tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] [instance: 3de67bb0-04d9-4d3a-a925-102f04d677bb] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:18:07.200476 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b7e0791c-7acc-4a54-a640-b100b6f5d26c tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:18:07.201082 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b7e0791c-7acc-4a54-a640-b100b6f5d26c tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:18:07.201903 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b7e0791c-7acc-4a54-a640-b100b6f5d26c tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:18:07.202608 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b7e0791c-7acc-4a54-a640-b100b6f5d26c tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:18:07.203145 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b7e0791c-7acc-4a54-a640-b100b6f5d26c tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:18:07.203720 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b7e0791c-7acc-4a54-a640-b100b6f5d26c tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:18:07.337477 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-b7e0791c-7acc-4a54-a640-b100b6f5d26c tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a9229e7da421b9e0e6f7df52f71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28af724189a24022b3ef7651b7157a9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:18:07.346013 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-b7e0791c-7acc-4a54-a640-b100b6f5d26c tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] 10.222.0.18 "GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb" status: 200 len: 1507 microversion: 2.1 time: 0.156970 Oct 22 21:18:07.346854 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2575/5134] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:18:07 2022] GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb => generated 1507 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:18:07.467070 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-48b29149-a27d-4a2c-9c08-42ea1f452c06 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-727540987", "imageRef": "085e4478-6edc-4a69-8e08-f9831713eb65", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:18:07.472390 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-48b29149-a27d-4a2c-9c08-42ea1f452c06 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] HTTP exception thrown: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 22 21:18:07.473947 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-48b29149-a27d-4a2c-9c08-42ea1f452c06 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Request method failure captured: Oct 22 21:18:07.473947 ncdv-master-1 devstack@n-api.service[138744]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 22 21:18:07.473947 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 21:18:07.473947 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 21:18:07.473947 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 21:18:07.473947 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 215 Oct 22 21:18:07.473947 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 21:18:07.473947 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 21:18:07.473947 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 21:18:07.473947 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 21:18:07.473947 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVF3hm7PiLG1R8Tw2syJVqR4znaBscty3weljpQpv2aVSYokkqaFvTxJu_8ZsVDxnVWNFBjrkTk4hem6vgNXmexe0yUI_M8pHEKoh5CWO6b1coilxRZ6VgX94mIL_xf6l3t9Q4mcnT856zV-XemvxZab0Ooy1ChU21L_her9Zn74z_zU Oct 22 21:18:07.473947 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 21:18:07.473947 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 21:18:07.473947 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 21:18:07.473947 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 21:18:07.473947 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 21:18:07.473947 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 21:18:07.473947 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: 28af724189a24022b3ef7651b7157a9d Oct 22 21:18:07.473947 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-ServersNegativeTestJSON-766586991 Oct 22 21:18:07.473947 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 21:18:07.473947 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 21:18:07.473947 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_28af724189a24022b3ef7651b7157a9d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/28af724189a24022b3ef7651b7157a9d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/28af724189a24022b3ef7651b7157a9d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/28af724189a24022b3ef7651b7157a9d"}]}] Oct 22 21:18:07.473947 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-ServersNegativeTestJSON-766586991 Oct 22 21:18:07.473947 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: 28af724189a24022b3ef7651b7157a9d Oct 22 21:18:07.473947 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-ServersNegativeTestJSON-766586991 Oct 22 21:18:07.473947 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-ServersNegativeTestJSON-766586991-project Oct 22 21:18:07.473947 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 21:18:07.473947 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 21:18:07.473947 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: 6c8a9229e7da421b9e0e6f7df52f71e2 Oct 22 21:18:07.473947 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-ServersNegativeTestJSON-766586991-project Oct 22 21:18:07.473947 ncdv-master-1 devstack@n-api.service[138744]: Oct 22 21:18:07.473947 ncdv-master-1 devstack@n-api.service[138744]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-727540987", "imageRef": "085e4478-6edc-4a69-8e08-f9831713eb65", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} Oct 22 21:18:07.473947 ncdv-master-1 devstack@n-api.service[138744]: method: > Oct 22 21:18:07.473947 ncdv-master-1 devstack@n-api.service[138744]: exception: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 22 21:18:07.473947 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-727540987', 'imageRef': '085e4478-6edc-4a69-8e08-f9831713eb65', 'flavorRef': '452', 'networks': [{'fixed_ip': '10.0.1.1', 'uuid': 'a-b-c-d-e-f-g-h-i-j'}]}}} Oct 22 21:18:07.473947 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:18:07.473947 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:18:07.473947 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:18:07.473947 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:18:07.473947 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:18:07.473947 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:18:07.473947 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:18:07.473947 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:18:07.473947 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 21:18:07.473947 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 21:18:07.473947 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 21:18:07.473947 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 21:18:07.473947 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 21:18:07.473947 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 21:18:07.473947 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 22 21:18:07.473947 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 773, in create Oct 22 21:18:07.473947 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi self._process_networks_for_create( Oct 22 21:18:07.473947 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 547, in _process_networks_for_create Oct 22 21:18:07.473947 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi requested_networks = self._get_requested_networks( Oct 22 21:18:07.473947 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 447, in _get_requested_networks Oct 22 21:18:07.473947 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi self._validate_network_id( Oct 22 21:18:07.473947 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 396, in _validate_network_id Oct 22 21:18:07.473947 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 22 21:18:07.473947 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 22 21:18:07.473947 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:18:07.473947 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:18:07.473947 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:18:07.478609 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:18:07.478609 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:18:07.478609 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:18:07.478609 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:18:07.478609 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:18:07.478609 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 22 21:18:07.478609 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:18:07.478609 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-48b29149-a27d-4a2c-9c08-42ea1f452c06 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Returning 400 to user: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:18:07.478609 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-48b29149-a27d-4a2c-9c08-42ea1f452c06 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 400 len: 123 microversion: 2.1 time: 0.012782 Oct 22 21:18:07.478609 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2560/5135] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Oct 22 21:18:07 2022] POST /compute/v2.1/servers => generated 123 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 22 21:18:07.484968 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-a11e7c1c-2b1c-4c78-b614-04f613385879 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:18:07.485580 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-a11e7c1c-2b1c-4c78-b614-04f613385879 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] [instance: 3de67bb0-04d9-4d3a-a925-102f04d677bb] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:18:07.494455 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a11e7c1c-2b1c-4c78-b614-04f613385879 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:18:07.494964 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a11e7c1c-2b1c-4c78-b614-04f613385879 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:18:07.495645 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a11e7c1c-2b1c-4c78-b614-04f613385879 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:18:07.496371 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a11e7c1c-2b1c-4c78-b614-04f613385879 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:18:07.496845 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a11e7c1c-2b1c-4c78-b614-04f613385879 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:18:07.497291 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a11e7c1c-2b1c-4c78-b614-04f613385879 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:18:07.660242 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-a11e7c1c-2b1c-4c78-b614-04f613385879 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a9229e7da421b9e0e6f7df52f71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28af724189a24022b3ef7651b7157a9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:18:07.668253 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-a11e7c1c-2b1c-4c78-b614-04f613385879 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] 10.222.0.18 "GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb" status: 200 len: 1507 microversion: 2.1 time: 0.187358 Oct 22 21:18:07.669014 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2576/5136] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:18:07 2022] GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb => generated 1507 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:18:07.691965 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-c9e51d85-468a-4776-80a8-74df1ddbc057 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:18:07.692583 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-c9e51d85-468a-4776-80a8-74df1ddbc057 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] [instance: 3de67bb0-04d9-4d3a-a925-102f04d677bb] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:18:07.699953 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c9e51d85-468a-4776-80a8-74df1ddbc057 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:18:07.700455 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c9e51d85-468a-4776-80a8-74df1ddbc057 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:18:07.700902 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c9e51d85-468a-4776-80a8-74df1ddbc057 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:18:07.701611 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c9e51d85-468a-4776-80a8-74df1ddbc057 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:18:07.702064 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c9e51d85-468a-4776-80a8-74df1ddbc057 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:18:07.702497 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c9e51d85-468a-4776-80a8-74df1ddbc057 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:18:07.842342 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-c9e51d85-468a-4776-80a8-74df1ddbc057 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a9229e7da421b9e0e6f7df52f71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28af724189a24022b3ef7651b7157a9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:18:07.851069 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-c9e51d85-468a-4776-80a8-74df1ddbc057 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] 10.222.0.18 "GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb" status: 200 len: 1507 microversion: 2.1 time: 0.163371 Oct 22 21:18:07.851486 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2561/5137] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:18:07 2022] GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb => generated 1507 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:18:07.962277 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-b49bd74c-d4de-4b2b-bfbb-999dfcf4bd47 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-498478182", "imageRef": "085e4478-6edc-4a69-8e08-f9831713eb65", "flavorRef": "452", "key_name": "tempest-key-1316425241", "networks": [{"uuid": "b17a38c5-877b-428d-bd53-e74609d155b2"}]}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:18:08.019782 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.network.neutron [None req-b49bd74c-d4de-4b2b-bfbb-999dfcf4bd47 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] validate_networks() for [('b17a38c5-877b-428d-bd53-e74609d155b2', None, None, None, None, None)] {{(pid=138745) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 21:18:08.215604 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.wsgi [None req-b49bd74c-d4de-4b2b-bfbb-999dfcf4bd47 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] HTTP exception thrown: Invalid key_name provided. Oct 22 21:18:08.217509 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-b49bd74c-d4de-4b2b-bfbb-999dfcf4bd47 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Request method failure captured: Oct 22 21:18:08.217509 ncdv-master-1 devstack@n-api.service[138745]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 22 21:18:08.217509 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 21:18:08.217509 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 21:18:08.217509 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 21:18:08.217509 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 246 Oct 22 21:18:08.217509 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 21:18:08.217509 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 21:18:08.217509 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 21:18:08.217509 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 21:18:08.217509 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVF3hm7PiLG1R8Tw2syJVqR4znaBscty3weljpQpv2aVSYokkqaFvTxJu_8ZsVDxnVWNFBjrkTk4hem6vgNXmexe0yUI_M8pHEKoh5CWO6b1coilxRZ6VgX94mIL_xf6l3t9Q4mcnT856zV-XemvxZab0Ooy1ChU21L_her9Zn74z_zU Oct 22 21:18:08.217509 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 21:18:08.217509 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 21:18:08.217509 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 21:18:08.217509 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 21:18:08.217509 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 21:18:08.217509 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 21:18:08.217509 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: 28af724189a24022b3ef7651b7157a9d Oct 22 21:18:08.217509 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-ServersNegativeTestJSON-766586991 Oct 22 21:18:08.217509 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 21:18:08.217509 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 21:18:08.217509 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_28af724189a24022b3ef7651b7157a9d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/28af724189a24022b3ef7651b7157a9d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/28af724189a24022b3ef7651b7157a9d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/28af724189a24022b3ef7651b7157a9d"}]}] Oct 22 21:18:08.217509 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-ServersNegativeTestJSON-766586991 Oct 22 21:18:08.217509 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: 28af724189a24022b3ef7651b7157a9d Oct 22 21:18:08.217509 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-ServersNegativeTestJSON-766586991 Oct 22 21:18:08.217509 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-ServersNegativeTestJSON-766586991-project Oct 22 21:18:08.217509 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 21:18:08.217509 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 21:18:08.217509 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: 6c8a9229e7da421b9e0e6f7df52f71e2 Oct 22 21:18:08.217509 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-ServersNegativeTestJSON-766586991-project Oct 22 21:18:08.217509 ncdv-master-1 devstack@n-api.service[138745]: Oct 22 21:18:08.217509 ncdv-master-1 devstack@n-api.service[138745]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-498478182", "imageRef": "085e4478-6edc-4a69-8e08-f9831713eb65", "flavorRef": "452", "key_name": "tempest-key-1316425241", "networks": [{"uuid": "b17a38c5-877b-428d-bd53-e74609d155b2"}]}} Oct 22 21:18:08.217509 ncdv-master-1 devstack@n-api.service[138745]: method: > Oct 22 21:18:08.217509 ncdv-master-1 devstack@n-api.service[138745]: exception: Invalid key_name provided. Oct 22 21:18:08.217509 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-498478182', 'imageRef': '085e4478-6edc-4a69-8e08-f9831713eb65', 'flavorRef': '452', 'key_name': 'tempest-key-1316425241', 'networks': [{'uuid': 'b17a38c5-877b-428d-bd53-e74609d155b2'}]}}} Oct 22 21:18:08.217509 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:18:08.217509 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:18:08.217509 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 22 21:18:08.217509 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 22 21:18:08.217509 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 22 21:18:08.217509 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 22 21:18:08.217509 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 22 21:18:08.217509 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 22 21:18:08.217509 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1089, in _validate_and_build_base_options Oct 22 21:18:08.217509 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi key_pair = objects.KeyPair.get_by_name(context, Oct 22 21:18:08.217509 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 22 21:18:08.217509 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 22 21:18:08.217509 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Oct 22 21:18:08.217509 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Oct 22 21:18:08.217509 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Oct 22 21:18:08.217509 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Oct 22 21:18:08.217509 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 22 21:18:08.217509 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 22 21:18:08.217509 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Oct 22 21:18:08.217509 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Oct 22 21:18:08.217509 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-key-1316425241 not found for user 6c8a9229e7da421b9e0e6f7df52f71e2 Oct 22 21:18:08.217509 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:18:08.217509 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:18:08.217509 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:18:08.217509 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:18:08.217509 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:18:08.222351 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:18:08.222351 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:18:08.222351 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:18:08.222351 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:18:08.222351 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:18:08.222351 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 21:18:08.222351 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 21:18:08.222351 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 21:18:08.222351 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 21:18:08.222351 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 21:18:08.222351 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 21:18:08.222351 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 22 21:18:08.222351 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 807, in create Oct 22 21:18:08.222351 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 22 21:18:08.222351 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid key_name provided. Oct 22 21:18:08.222351 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:18:08.222351 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:18:08.222351 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:18:08.222351 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:18:08.222351 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:18:08.222351 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:18:08.222351 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:18:08.222351 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:18:08.222351 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid key_name provided. Oct 22 21:18:08.222351 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:18:08.222351 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-b49bd74c-d4de-4b2b-bfbb-999dfcf4bd47 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Returning 400 to user: Invalid key_name provided. {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:18:08.222351 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-b49bd74c-d4de-4b2b-bfbb-999dfcf4bd47 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 400 len: 70 microversion: 2.1 time: 0.260707 Oct 22 21:18:08.222351 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2577/5138] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Oct 22 21:18:07 2022] POST /compute/v2.1/servers => generated 70 bytes in 262 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 22 21:18:08.228435 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-0423baba-6bd1-4057-9ddf-4e67c3ab49f3 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:18:08.229063 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-0423baba-6bd1-4057-9ddf-4e67c3ab49f3 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] [instance: 3de67bb0-04d9-4d3a-a925-102f04d677bb] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:18:08.236519 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0423baba-6bd1-4057-9ddf-4e67c3ab49f3 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:18:08.237017 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0423baba-6bd1-4057-9ddf-4e67c3ab49f3 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:18:08.237456 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0423baba-6bd1-4057-9ddf-4e67c3ab49f3 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:18:08.238160 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0423baba-6bd1-4057-9ddf-4e67c3ab49f3 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:18:08.238612 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0423baba-6bd1-4057-9ddf-4e67c3ab49f3 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:18:08.239039 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0423baba-6bd1-4057-9ddf-4e67c3ab49f3 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:18:08.376364 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-0423baba-6bd1-4057-9ddf-4e67c3ab49f3 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a9229e7da421b9e0e6f7df52f71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28af724189a24022b3ef7651b7157a9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:18:08.384716 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-0423baba-6bd1-4057-9ddf-4e67c3ab49f3 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] 10.222.0.18 "GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb" status: 200 len: 1507 microversion: 2.1 time: 0.160612 Oct 22 21:18:08.385498 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2562/5139] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:18:08 2022] GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb => generated 1507 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:18:08.409622 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-57761497-a461-4728-9f30-95ffdae39e57 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:18:08.410261 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-57761497-a461-4728-9f30-95ffdae39e57 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] [instance: 3de67bb0-04d9-4d3a-a925-102f04d677bb] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:18:08.417027 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-57761497-a461-4728-9f30-95ffdae39e57 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:18:08.417536 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-57761497-a461-4728-9f30-95ffdae39e57 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:18:08.418608 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-57761497-a461-4728-9f30-95ffdae39e57 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:18:08.418714 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-57761497-a461-4728-9f30-95ffdae39e57 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:18:08.419168 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-57761497-a461-4728-9f30-95ffdae39e57 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:18:08.420968 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-57761497-a461-4728-9f30-95ffdae39e57 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:18:08.553839 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-57761497-a461-4728-9f30-95ffdae39e57 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a9229e7da421b9e0e6f7df52f71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28af724189a24022b3ef7651b7157a9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:18:08.562425 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-57761497-a461-4728-9f30-95ffdae39e57 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] 10.222.0.18 "GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb" status: 200 len: 1507 microversion: 2.1 time: 0.157230 Oct 22 21:18:08.563037 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2578/5140] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:18:08 2022] GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb => generated 1507 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:18:08.709935 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-1936a06b-f2a4-4994-aa9e-aa4965131eec tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-593754858", "imageRef": "085e4478-6edc-4a69-8e08-f9831713eb65", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "b17a38c5-877b-428d-bd53-e74609d155b2"}]}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:18:08.842108 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.network.security_group_api [None req-1936a06b-f2a4-4994-aa9e-aa4965131eec tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Neutron security group does_not_exist not found {{(pid=138744) validate_name /opt/stack/nova/nova/network/security_group_api.py:74}} Oct 22 21:18:08.842832 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-1936a06b-f2a4-4994-aa9e-aa4965131eec tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] HTTP exception thrown: Unable to find security_group with name or id 'does_not_exist' Oct 22 21:18:08.861234 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-1936a06b-f2a4-4994-aa9e-aa4965131eec tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Request method failure captured: Oct 22 21:18:08.861234 ncdv-master-1 devstack@n-api.service[138744]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 22 21:18:08.861234 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 21:18:08.861234 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 21:18:08.861234 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 21:18:08.861234 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 257 Oct 22 21:18:08.861234 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 21:18:08.861234 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 21:18:08.861234 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 21:18:08.861234 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 21:18:08.861234 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVF3hm7PiLG1R8Tw2syJVqR4znaBscty3weljpQpv2aVSYokkqaFvTxJu_8ZsVDxnVWNFBjrkTk4hem6vgNXmexe0yUI_M8pHEKoh5CWO6b1coilxRZ6VgX94mIL_xf6l3t9Q4mcnT856zV-XemvxZab0Ooy1ChU21L_her9Zn74z_zU Oct 22 21:18:08.861234 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 21:18:08.861234 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 21:18:08.861234 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 21:18:08.861234 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 21:18:08.861234 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 21:18:08.861234 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 21:18:08.861234 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: 28af724189a24022b3ef7651b7157a9d Oct 22 21:18:08.861234 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-ServersNegativeTestJSON-766586991 Oct 22 21:18:08.861234 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 21:18:08.861234 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 21:18:08.861234 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_28af724189a24022b3ef7651b7157a9d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/28af724189a24022b3ef7651b7157a9d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/28af724189a24022b3ef7651b7157a9d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/28af724189a24022b3ef7651b7157a9d"}]}] Oct 22 21:18:08.861234 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-ServersNegativeTestJSON-766586991 Oct 22 21:18:08.861234 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: 28af724189a24022b3ef7651b7157a9d Oct 22 21:18:08.861234 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-ServersNegativeTestJSON-766586991 Oct 22 21:18:08.861234 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-ServersNegativeTestJSON-766586991-project Oct 22 21:18:08.861234 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 21:18:08.861234 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 21:18:08.861234 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: 6c8a9229e7da421b9e0e6f7df52f71e2 Oct 22 21:18:08.861234 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-ServersNegativeTestJSON-766586991-project Oct 22 21:18:08.861234 ncdv-master-1 devstack@n-api.service[138744]: Oct 22 21:18:08.861234 ncdv-master-1 devstack@n-api.service[138744]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-593754858", "imageRef": "085e4478-6edc-4a69-8e08-f9831713eb65", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "b17a38c5-877b-428d-bd53-e74609d155b2"}]}} Oct 22 21:18:08.861234 ncdv-master-1 devstack@n-api.service[138744]: method: > Oct 22 21:18:08.861234 ncdv-master-1 devstack@n-api.service[138744]: exception: Unable to find security_group with name or id 'does_not_exist' Oct 22 21:18:08.861234 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-593754858', 'imageRef': '085e4478-6edc-4a69-8e08-f9831713eb65', 'flavorRef': '452', 'security_groups': [{'name': 'does_not_exist'}], 'networks': [{'uuid': 'b17a38c5-877b-428d-bd53-e74609d155b2'}]}}} Oct 22 21:18:08.861234 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:18:08.861234 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:18:08.861234 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 476, in find_resource Oct 22 21:18:08.861234 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return self.find_resource_by_id(resource, name_or_id, Oct 22 21:18:08.861234 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 21:18:08.861234 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 21:18:08.861234 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 440, in find_resource_by_id Oct 22 21:18:08.861234 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Oct 22 21:18:08.861234 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with id 'does_not_exist' Oct 22 21:18:08.861234 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:18:08.861234 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:18:08.861234 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:18:08.861234 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:18:08.861234 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 480, in find_resource Oct 22 21:18:08.861234 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return self._find_resource_by_name( Oct 22 21:18:08.861234 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 21:18:08.861234 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 21:18:08.861234 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 469, in _find_resource_by_name Oct 22 21:18:08.861234 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Oct 22 21:18:08.861234 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name 'does_not_exist' Oct 22 21:18:08.861234 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:18:08.861234 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:18:08.861234 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:18:08.861234 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:18:08.861234 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 68, in validate_name Oct 22 21:18:08.861234 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return neutronv20.find_resourceid_by_name_or_id( Oct 22 21:18:08.865741 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 56, in find_resourceid_by_name_or_id Oct 22 21:18:08.865741 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return find_resource_by_name_or_id(client, resource, name_or_id, Oct 22 21:18:08.865741 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 49, in find_resource_by_name_or_id Oct 22 21:18:08.865741 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return client.find_resource(resource, name_or_id, project_id, Oct 22 21:18:08.865741 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 21:18:08.865741 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 21:18:08.865741 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 488, in find_resource Oct 22 21:18:08.865741 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound( Oct 22 21:18:08.865741 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name or id 'does_not_exist' Oct 22 21:18:08.865741 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:18:08.865741 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:18:08.865741 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:18:08.865741 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:18:08.865741 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 22 21:18:08.865741 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 22 21:18:08.865741 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 22 21:18:08.865741 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 22 21:18:08.865741 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 22 21:18:08.865741 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 22 21:18:08.865741 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1074, in _validate_and_build_base_options Oct 22 21:18:08.865741 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi security_groups = self._check_requested_secgroups( Oct 22 21:18:08.865741 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 521, in _check_requested_secgroups Oct 22 21:18:08.865741 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi secgroup_uuid = security_group_api.validate_name(context, secgroup) Oct 22 21:18:08.865741 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 75, in validate_name Oct 22 21:18:08.865741 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 22 21:18:08.865741 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Unable to find security_group with name or id 'does_not_exist' Oct 22 21:18:08.865741 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:18:08.865741 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:18:08.865741 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:18:08.865741 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:18:08.865741 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:18:08.865741 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:18:08.865741 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:18:08.865741 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:18:08.865741 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:18:08.865741 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:18:08.865741 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 21:18:08.865741 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 21:18:08.865741 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 21:18:08.865741 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 21:18:08.865741 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 21:18:08.865741 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 21:18:08.865741 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 22 21:18:08.865741 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 22 21:18:08.865741 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 22 21:18:08.865741 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Unable to find security_group with name or id 'does_not_exist' Oct 22 21:18:08.865741 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:18:08.865741 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:18:08.865741 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:18:08.865741 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:18:08.865741 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:18:08.865741 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:18:08.865741 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:18:08.865741 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:18:08.865741 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unable to find security_group with name or id 'does_not_exist' Oct 22 21:18:08.865741 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:18:08.865741 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-1936a06b-f2a4-4994-aa9e-aa4965131eec tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Returning 400 to user: Unable to find security_group with name or id 'does_not_exist' {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:18:08.870765 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-1936a06b-f2a4-4994-aa9e-aa4965131eec tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 400 len: 106 microversion: 2.1 time: 0.158812 Oct 22 21:18:08.870765 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2563/5141] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Oct 22 21:18:08 2022] POST /compute/v2.1/servers => generated 106 bytes in 161 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 22 21:18:08.875325 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-bd689b87-54fc-48ca-9147-feaa33127eeb tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:18:08.876103 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-bd689b87-54fc-48ca-9147-feaa33127eeb tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] [instance: 3de67bb0-04d9-4d3a-a925-102f04d677bb] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:18:08.884637 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bd689b87-54fc-48ca-9147-feaa33127eeb tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:18:08.885261 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bd689b87-54fc-48ca-9147-feaa33127eeb tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:18:08.885855 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bd689b87-54fc-48ca-9147-feaa33127eeb tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:18:08.886674 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bd689b87-54fc-48ca-9147-feaa33127eeb tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:18:08.887161 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bd689b87-54fc-48ca-9147-feaa33127eeb tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:18:08.887638 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bd689b87-54fc-48ca-9147-feaa33127eeb tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:18:09.025965 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-bd689b87-54fc-48ca-9147-feaa33127eeb tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a9229e7da421b9e0e6f7df52f71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28af724189a24022b3ef7651b7157a9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:18:09.034310 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-bd689b87-54fc-48ca-9147-feaa33127eeb tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] 10.222.0.18 "GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb" status: 200 len: 1507 microversion: 2.1 time: 0.163373 Oct 22 21:18:09.034886 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2579/5142] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:18:08 2022] GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb => generated 1507 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:18:09.057534 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-b65cc57e-9db2-4116-9d8c-942fbd770451 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:18:09.058160 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-b65cc57e-9db2-4116-9d8c-942fbd770451 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] [instance: 3de67bb0-04d9-4d3a-a925-102f04d677bb] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:18:09.064744 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b65cc57e-9db2-4116-9d8c-942fbd770451 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:18:09.065343 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b65cc57e-9db2-4116-9d8c-942fbd770451 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:18:09.065795 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b65cc57e-9db2-4116-9d8c-942fbd770451 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:18:09.066515 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b65cc57e-9db2-4116-9d8c-942fbd770451 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:18:09.066981 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b65cc57e-9db2-4116-9d8c-942fbd770451 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:18:09.067446 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b65cc57e-9db2-4116-9d8c-942fbd770451 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:18:09.202725 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-b65cc57e-9db2-4116-9d8c-942fbd770451 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a9229e7da421b9e0e6f7df52f71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28af724189a24022b3ef7651b7157a9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:18:09.211301 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-b65cc57e-9db2-4116-9d8c-942fbd770451 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] 10.222.0.18 "GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb" status: 200 len: 1507 microversion: 2.1 time: 0.157755 Oct 22 21:18:09.212450 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2564/5143] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:18:09 2022] GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb => generated 1507 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:18:09.236168 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-aecbb815-07a5-40ec-a049-5f366048a2c6 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:18:09.236692 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-aecbb815-07a5-40ec-a049-5f366048a2c6 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] [instance: 8a1f34c9-160d-4686-9b36-07c6ec9438a5] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:18:09.242709 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.wsgi [None req-aecbb815-07a5-40ec-a049-5f366048a2c6 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] HTTP exception thrown: Instance 8a1f34c9-160d-4686-9b36-07c6ec9438a5 could not be found. Oct 22 21:18:09.244474 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-aecbb815-07a5-40ec-a049-5f366048a2c6 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Request method failure captured: Oct 22 21:18:09.244474 ncdv-master-1 devstack@n-api.service[138745]: request: DELETE /compute/v2.1/servers/8a1f34c9-160d-4686-9b36-07c6ec9438a5 HTTP/1.1 Oct 22 21:18:09.244474 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 21:18:09.244474 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 21:18:09.244474 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 21:18:09.244474 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 0 Oct 22 21:18:09.244474 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 21:18:09.244474 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 21:18:09.244474 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 21:18:09.244474 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 21:18:09.244474 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVF3hm7PiLG1R8Tw2syJVqR4znaBscty3weljpQpv2aVSYokkqaFvTxJu_8ZsVDxnVWNFBjrkTk4hem6vgNXmexe0yUI_M8pHEKoh5CWO6b1coilxRZ6VgX94mIL_xf6l3t9Q4mcnT856zV-XemvxZab0Ooy1ChU21L_her9Zn74z_zU Oct 22 21:18:09.244474 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 21:18:09.244474 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 21:18:09.244474 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 21:18:09.244474 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 21:18:09.244474 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 21:18:09.244474 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 21:18:09.244474 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: 28af724189a24022b3ef7651b7157a9d Oct 22 21:18:09.244474 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-ServersNegativeTestJSON-766586991 Oct 22 21:18:09.244474 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 21:18:09.244474 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 21:18:09.244474 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_28af724189a24022b3ef7651b7157a9d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/28af724189a24022b3ef7651b7157a9d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/28af724189a24022b3ef7651b7157a9d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/28af724189a24022b3ef7651b7157a9d"}]}] Oct 22 21:18:09.244474 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-ServersNegativeTestJSON-766586991 Oct 22 21:18:09.244474 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: 28af724189a24022b3ef7651b7157a9d Oct 22 21:18:09.244474 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-ServersNegativeTestJSON-766586991 Oct 22 21:18:09.244474 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-ServersNegativeTestJSON-766586991-project Oct 22 21:18:09.244474 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 21:18:09.244474 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 21:18:09.244474 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: 6c8a9229e7da421b9e0e6f7df52f71e2 Oct 22 21:18:09.244474 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-ServersNegativeTestJSON-766586991-project Oct 22 21:18:09.244474 ncdv-master-1 devstack@n-api.service[138745]: method: > Oct 22 21:18:09.244474 ncdv-master-1 devstack@n-api.service[138745]: exception: Instance 8a1f34c9-160d-4686-9b36-07c6ec9438a5 could not be found. Oct 22 21:18:09.244474 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'id': '8a1f34c9-160d-4686-9b36-07c6ec9438a5'} Oct 22 21:18:09.244474 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:18:09.244474 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:18:09.244474 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 21:18:09.244474 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 21:18:09.244474 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 21:18:09.244474 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 21:18:09.244474 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 22 21:18:09.244474 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 22 21:18:09.244474 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a1f34c9-160d-4686-9b36-07c6ec9438a5 could not be found. Oct 22 21:18:09.244474 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:18:09.244474 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:18:09.244474 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:18:09.244474 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:18:09.244474 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:18:09.244474 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:18:09.244474 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:18:09.244474 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:18:09.244474 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:18:09.244474 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:18:09.244474 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 22 21:18:09.244474 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 22 21:18:09.244474 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 22 21:18:09.244474 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 22 21:18:09.244474 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 21:18:09.244474 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 21:18:09.244474 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 21:18:09.244474 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:18:09.244474 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a1f34c9-160d-4686-9b36-07c6ec9438a5 could not be found. Oct 22 21:18:09.244474 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:18:09.244474 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:18:09.248560 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:18:09.248560 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:18:09.248560 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:18:09.248560 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:18:09.248560 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:18:09.248560 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:18:09.248560 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a1f34c9-160d-4686-9b36-07c6ec9438a5 could not be found. Oct 22 21:18:09.248560 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:18:09.248560 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-aecbb815-07a5-40ec-a049-5f366048a2c6 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Returning 404 to user: Instance 8a1f34c9-160d-4686-9b36-07c6ec9438a5 could not be found. {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:18:09.248560 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-aecbb815-07a5-40ec-a049-5f366048a2c6 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] 10.222.0.18 "DELETE /compute/v2.1/servers/8a1f34c9-160d-4686-9b36-07c6ec9438a5" status: 404 len: 111 microversion: 2.1 time: 0.013856 Oct 22 21:18:09.248560 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2580/5144] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 21:18:09 2022] DELETE /compute/v2.1/servers/8a1f34c9-160d-4686-9b36-07c6ec9438a5 => generated 111 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 22 21:18:09.256077 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-fb2d66a1-f24a-4512-8f5b-5afc34539a93 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:18:09.256763 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-fb2d66a1-f24a-4512-8f5b-5afc34539a93 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] [instance: 3de67bb0-04d9-4d3a-a925-102f04d677bb] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:18:09.264782 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fb2d66a1-f24a-4512-8f5b-5afc34539a93 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:18:09.265271 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fb2d66a1-f24a-4512-8f5b-5afc34539a93 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:18:09.265771 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fb2d66a1-f24a-4512-8f5b-5afc34539a93 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:18:09.266483 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fb2d66a1-f24a-4512-8f5b-5afc34539a93 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:18:09.266939 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fb2d66a1-f24a-4512-8f5b-5afc34539a93 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:18:09.267519 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fb2d66a1-f24a-4512-8f5b-5afc34539a93 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:18:09.417650 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-fb2d66a1-f24a-4512-8f5b-5afc34539a93 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a9229e7da421b9e0e6f7df52f71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28af724189a24022b3ef7651b7157a9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:18:09.430031 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-fb2d66a1-f24a-4512-8f5b-5afc34539a93 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] 10.222.0.18 "GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb" status: 200 len: 1507 microversion: 2.1 time: 0.177668 Oct 22 21:18:09.432046 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2565/5145] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:18:09 2022] GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb => generated 1507 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:18:09.455585 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-925975d3-a162-477f-95a7-814a96eda6e0 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:18:09.456838 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-925975d3-a162-477f-95a7-814a96eda6e0 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] [instance: 3de67bb0-04d9-4d3a-a925-102f04d677bb] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:18:09.464019 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-925975d3-a162-477f-95a7-814a96eda6e0 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:18:09.464497 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-925975d3-a162-477f-95a7-814a96eda6e0 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:18:09.465135 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-925975d3-a162-477f-95a7-814a96eda6e0 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:18:09.465855 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-925975d3-a162-477f-95a7-814a96eda6e0 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:18:09.466475 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-925975d3-a162-477f-95a7-814a96eda6e0 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:18:09.467006 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-925975d3-a162-477f-95a7-814a96eda6e0 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:18:09.611264 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-925975d3-a162-477f-95a7-814a96eda6e0 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a9229e7da421b9e0e6f7df52f71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28af724189a24022b3ef7651b7157a9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:18:09.621856 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-925975d3-a162-477f-95a7-814a96eda6e0 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] 10.222.0.18 "GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb" status: 200 len: 1507 microversion: 2.1 time: 0.170153 Oct 22 21:18:09.622836 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2581/5146] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:18:09 2022] GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb => generated 1507 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:18:09.645796 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-f3a1d923-db67-4084-9dec-dbf1d3edae38 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:18:09.648827 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-f3a1d923-db67-4084-9dec-dbf1d3edae38 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Failed to fetch instance by id 9223372036854775808 {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 22 21:18:09.649557 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-f3a1d923-db67-4084-9dec-dbf1d3edae38 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] HTTP exception thrown: Instance 9223372036854775808 could not be found. Oct 22 21:18:09.651323 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-f3a1d923-db67-4084-9dec-dbf1d3edae38 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Request method failure captured: Oct 22 21:18:09.651323 ncdv-master-1 devstack@n-api.service[138744]: request: DELETE /compute/v2.1/servers/9223372036854775808 HTTP/1.1 Oct 22 21:18:09.651323 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 21:18:09.651323 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 21:18:09.651323 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 21:18:09.651323 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 0 Oct 22 21:18:09.651323 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 21:18:09.651323 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 21:18:09.651323 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 21:18:09.651323 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 21:18:09.651323 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVF3hm7PiLG1R8Tw2syJVqR4znaBscty3weljpQpv2aVSYokkqaFvTxJu_8ZsVDxnVWNFBjrkTk4hem6vgNXmexe0yUI_M8pHEKoh5CWO6b1coilxRZ6VgX94mIL_xf6l3t9Q4mcnT856zV-XemvxZab0Ooy1ChU21L_her9Zn74z_zU Oct 22 21:18:09.651323 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 21:18:09.651323 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 21:18:09.651323 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 21:18:09.651323 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 21:18:09.651323 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 21:18:09.651323 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 21:18:09.651323 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: 28af724189a24022b3ef7651b7157a9d Oct 22 21:18:09.651323 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-ServersNegativeTestJSON-766586991 Oct 22 21:18:09.651323 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 21:18:09.651323 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 21:18:09.651323 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_28af724189a24022b3ef7651b7157a9d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/28af724189a24022b3ef7651b7157a9d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/28af724189a24022b3ef7651b7157a9d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/28af724189a24022b3ef7651b7157a9d"}]}] Oct 22 21:18:09.651323 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-ServersNegativeTestJSON-766586991 Oct 22 21:18:09.651323 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: 28af724189a24022b3ef7651b7157a9d Oct 22 21:18:09.651323 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-ServersNegativeTestJSON-766586991 Oct 22 21:18:09.651323 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-ServersNegativeTestJSON-766586991-project Oct 22 21:18:09.651323 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 21:18:09.651323 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 21:18:09.651323 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: 6c8a9229e7da421b9e0e6f7df52f71e2 Oct 22 21:18:09.651323 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-ServersNegativeTestJSON-766586991-project Oct 22 21:18:09.651323 ncdv-master-1 devstack@n-api.service[138744]: method: > Oct 22 21:18:09.651323 ncdv-master-1 devstack@n-api.service[138744]: exception: Instance 9223372036854775808 could not be found. Oct 22 21:18:09.651323 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': '9223372036854775808'} Oct 22 21:18:09.651323 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:18:09.651323 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:18:09.651323 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 21:18:09.651323 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 21:18:09.651323 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 22 21:18:09.651323 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 22 21:18:09.651323 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9223372036854775808 could not be found. Oct 22 21:18:09.651323 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:18:09.651323 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:18:09.651323 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:18:09.651323 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:18:09.651323 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:18:09.651323 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:18:09.651323 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:18:09.651323 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:18:09.651323 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:18:09.651323 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:18:09.651323 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 22 21:18:09.651323 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 22 21:18:09.651323 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 22 21:18:09.651323 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 22 21:18:09.651323 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 21:18:09.651323 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 21:18:09.651323 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 21:18:09.651323 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:18:09.651323 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9223372036854775808 could not be found. Oct 22 21:18:09.651323 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:18:09.651323 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:18:09.651323 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:18:09.651323 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:18:09.651323 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:18:09.655933 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:18:09.655933 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:18:09.655933 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:18:09.655933 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9223372036854775808 could not be found. Oct 22 21:18:09.655933 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:18:09.657639 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-f3a1d923-db67-4084-9dec-dbf1d3edae38 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Returning 404 to user: Instance 9223372036854775808 could not be found. {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:18:09.658588 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-f3a1d923-db67-4084-9dec-dbf1d3edae38 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] 10.222.0.18 "DELETE /compute/v2.1/servers/9223372036854775808" status: 404 len: 94 microversion: 2.1 time: 0.017035 Oct 22 21:18:09.663026 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2566/5147] 10.222.0.18 () {58 vars in 1188 bytes} [Sat Oct 22 21:18:09 2022] DELETE /compute/v2.1/servers/9223372036854775808 => generated 94 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 22 21:18:09.669154 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-08a3ae13-1646-4f97-8aea-48d679823186 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:18:09.669924 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-08a3ae13-1646-4f97-8aea-48d679823186 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] [instance: 3de67bb0-04d9-4d3a-a925-102f04d677bb] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:18:09.677611 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-08a3ae13-1646-4f97-8aea-48d679823186 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:18:09.679069 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-08a3ae13-1646-4f97-8aea-48d679823186 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:18:09.679799 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-08a3ae13-1646-4f97-8aea-48d679823186 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:18:09.680692 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-08a3ae13-1646-4f97-8aea-48d679823186 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:18:09.681441 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-08a3ae13-1646-4f97-8aea-48d679823186 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:18:09.682075 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-08a3ae13-1646-4f97-8aea-48d679823186 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:18:09.872142 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-08a3ae13-1646-4f97-8aea-48d679823186 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a9229e7da421b9e0e6f7df52f71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28af724189a24022b3ef7651b7157a9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:18:09.887818 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-08a3ae13-1646-4f97-8aea-48d679823186 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] 10.222.0.18 "GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb" status: 200 len: 1507 microversion: 2.1 time: 0.223936 Oct 22 21:18:09.888931 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2582/5148] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:18:09 2022] GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb => generated 1507 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:18:09.912041 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-8f4911bf-3193-40e9-ae98-59d7e8c25d00 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:18:09.913754 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-8f4911bf-3193-40e9-ae98-59d7e8c25d00 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] [instance: 3de67bb0-04d9-4d3a-a925-102f04d677bb] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:18:09.923382 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8f4911bf-3193-40e9-ae98-59d7e8c25d00 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:18:09.924348 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8f4911bf-3193-40e9-ae98-59d7e8c25d00 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:18:09.925010 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8f4911bf-3193-40e9-ae98-59d7e8c25d00 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:18:09.926249 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8f4911bf-3193-40e9-ae98-59d7e8c25d00 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:18:09.927047 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8f4911bf-3193-40e9-ae98-59d7e8c25d00 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:18:09.928344 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8f4911bf-3193-40e9-ae98-59d7e8c25d00 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:18:10.106423 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-8f4911bf-3193-40e9-ae98-59d7e8c25d00 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a9229e7da421b9e0e6f7df52f71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28af724189a24022b3ef7651b7157a9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:18:10.117009 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-8f4911bf-3193-40e9-ae98-59d7e8c25d00 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] 10.222.0.18 "GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb" status: 200 len: 1507 microversion: 2.1 time: 0.208353 Oct 22 21:18:10.118063 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2567/5149] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:18:09 2022] GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb => generated 1507 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:18:10.143221 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-8c8a95cb-f129-44d4-b6e5-1ce2b73edb78 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:18:10.144626 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-8c8a95cb-f129-44d4-b6e5-1ce2b73edb78 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Failed to fetch instance by id -1 {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 22 21:18:10.146295 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.wsgi [None req-8c8a95cb-f129-44d4-b6e5-1ce2b73edb78 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] HTTP exception thrown: Instance -1 could not be found. Oct 22 21:18:10.150850 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-8c8a95cb-f129-44d4-b6e5-1ce2b73edb78 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Request method failure captured: Oct 22 21:18:10.150850 ncdv-master-1 devstack@n-api.service[138745]: request: DELETE /compute/v2.1/servers/-1 HTTP/1.1 Oct 22 21:18:10.150850 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 21:18:10.150850 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 21:18:10.150850 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 21:18:10.150850 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 0 Oct 22 21:18:10.150850 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 21:18:10.150850 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 21:18:10.150850 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 21:18:10.150850 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 21:18:10.150850 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVF3hm7PiLG1R8Tw2syJVqR4znaBscty3weljpQpv2aVSYokkqaFvTxJu_8ZsVDxnVWNFBjrkTk4hem6vgNXmexe0yUI_M8pHEKoh5CWO6b1coilxRZ6VgX94mIL_xf6l3t9Q4mcnT856zV-XemvxZab0Ooy1ChU21L_her9Zn74z_zU Oct 22 21:18:10.150850 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 21:18:10.150850 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 21:18:10.150850 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 21:18:10.150850 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 21:18:10.150850 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 21:18:10.150850 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 21:18:10.150850 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: 28af724189a24022b3ef7651b7157a9d Oct 22 21:18:10.150850 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-ServersNegativeTestJSON-766586991 Oct 22 21:18:10.150850 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 21:18:10.150850 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 21:18:10.150850 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_28af724189a24022b3ef7651b7157a9d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/28af724189a24022b3ef7651b7157a9d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/28af724189a24022b3ef7651b7157a9d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/28af724189a24022b3ef7651b7157a9d"}]}] Oct 22 21:18:10.150850 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-ServersNegativeTestJSON-766586991 Oct 22 21:18:10.150850 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: 28af724189a24022b3ef7651b7157a9d Oct 22 21:18:10.150850 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-ServersNegativeTestJSON-766586991 Oct 22 21:18:10.150850 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-ServersNegativeTestJSON-766586991-project Oct 22 21:18:10.150850 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 21:18:10.150850 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 21:18:10.150850 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: 6c8a9229e7da421b9e0e6f7df52f71e2 Oct 22 21:18:10.150850 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-ServersNegativeTestJSON-766586991-project Oct 22 21:18:10.150850 ncdv-master-1 devstack@n-api.service[138745]: method: > Oct 22 21:18:10.150850 ncdv-master-1 devstack@n-api.service[138745]: exception: Instance -1 could not be found. Oct 22 21:18:10.150850 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'id': '-1'} Oct 22 21:18:10.150850 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:18:10.150850 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:18:10.150850 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 21:18:10.150850 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 21:18:10.150850 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 22 21:18:10.150850 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 22 21:18:10.150850 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance -1 could not be found. Oct 22 21:18:10.150850 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:18:10.150850 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:18:10.150850 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:18:10.150850 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:18:10.150850 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:18:10.150850 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:18:10.150850 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:18:10.150850 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:18:10.150850 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:18:10.150850 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:18:10.150850 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 22 21:18:10.150850 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 22 21:18:10.150850 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 22 21:18:10.150850 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 22 21:18:10.150850 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 21:18:10.150850 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 21:18:10.150850 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 21:18:10.150850 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:18:10.150850 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance -1 could not be found. Oct 22 21:18:10.150850 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:18:10.150850 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:18:10.150850 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:18:10.150850 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:18:10.150850 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:18:10.150850 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:18:10.154735 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:18:10.154735 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:18:10.154735 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance -1 could not be found. Oct 22 21:18:10.154735 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:18:10.154735 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-8c8a95cb-f129-44d4-b6e5-1ce2b73edb78 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Returning 404 to user: Instance -1 could not be found. {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:18:10.154735 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-8c8a95cb-f129-44d4-b6e5-1ce2b73edb78 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] 10.222.0.18 "DELETE /compute/v2.1/servers/-1" status: 404 len: 77 microversion: 2.1 time: 0.015176 Oct 22 21:18:10.154735 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2583/5150] 10.222.0.18 () {58 vars in 1137 bytes} [Sat Oct 22 21:18:10 2022] DELETE /compute/v2.1/servers/-1 => generated 77 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 22 21:18:10.163000 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-2eaf2bae-60b0-4eb9-99d0-6865f51594bc tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:18:10.163750 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-2eaf2bae-60b0-4eb9-99d0-6865f51594bc tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] [instance: 3de67bb0-04d9-4d3a-a925-102f04d677bb] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:18:10.171801 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2eaf2bae-60b0-4eb9-99d0-6865f51594bc tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:18:10.172431 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2eaf2bae-60b0-4eb9-99d0-6865f51594bc tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:18:10.172931 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2eaf2bae-60b0-4eb9-99d0-6865f51594bc tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:18:10.173700 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2eaf2bae-60b0-4eb9-99d0-6865f51594bc tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:18:10.174148 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2eaf2bae-60b0-4eb9-99d0-6865f51594bc tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:18:10.174582 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2eaf2bae-60b0-4eb9-99d0-6865f51594bc tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:18:10.361553 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-2eaf2bae-60b0-4eb9-99d0-6865f51594bc tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a9229e7da421b9e0e6f7df52f71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28af724189a24022b3ef7651b7157a9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:18:10.371502 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-2eaf2bae-60b0-4eb9-99d0-6865f51594bc tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] 10.222.0.18 "GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb" status: 200 len: 1507 microversion: 2.1 time: 0.213305 Oct 22 21:18:10.384548 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2568/5151] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:18:10 2022] GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb => generated 1507 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:18:10.402847 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-f324db06-ea82-4a55-be76-9ff8f58b2abc tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:18:10.403564 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-f324db06-ea82-4a55-be76-9ff8f58b2abc tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] [instance: 3de67bb0-04d9-4d3a-a925-102f04d677bb] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:18:10.410780 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f324db06-ea82-4a55-be76-9ff8f58b2abc tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:18:10.411987 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f324db06-ea82-4a55-be76-9ff8f58b2abc tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:18:10.412616 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f324db06-ea82-4a55-be76-9ff8f58b2abc tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:18:10.415905 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f324db06-ea82-4a55-be76-9ff8f58b2abc tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:18:10.416395 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f324db06-ea82-4a55-be76-9ff8f58b2abc tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:18:10.417023 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f324db06-ea82-4a55-be76-9ff8f58b2abc tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:18:10.648913 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-f324db06-ea82-4a55-be76-9ff8f58b2abc tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a9229e7da421b9e0e6f7df52f71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28af724189a24022b3ef7651b7157a9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:18:10.670987 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-f324db06-ea82-4a55-be76-9ff8f58b2abc tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] 10.222.0.18 "GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb" status: 200 len: 1507 microversion: 2.1 time: 0.272430 Oct 22 21:18:10.677033 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2584/5152] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:18:10 2022] GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb => generated 1507 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:18:10.704093 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-8b9f1277-ee9f-46ab-9236-e32932da3822 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Action: 'action', calling method: >, body: {"forceDelete": {}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:18:10.704816 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-8b9f1277-ee9f-46ab-9236-e32932da3822 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] [instance: 020e7f60-3b5d-47cd-84d0-47864b920a85] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:18:10.721218 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-8b9f1277-ee9f-46ab-9236-e32932da3822 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] HTTP exception thrown: Instance 020e7f60-3b5d-47cd-84d0-47864b920a85 could not be found. Oct 22 21:18:10.727392 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-8b9f1277-ee9f-46ab-9236-e32932da3822 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Request method failure captured: Oct 22 21:18:10.727392 ncdv-master-1 devstack@n-api.service[138744]: request: POST /compute/v2.1/servers/020e7f60-3b5d-47cd-84d0-47864b920a85/action HTTP/1.1 Oct 22 21:18:10.727392 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 21:18:10.727392 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 21:18:10.727392 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 21:18:10.727392 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 19 Oct 22 21:18:10.727392 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 21:18:10.727392 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 21:18:10.727392 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 21:18:10.727392 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 21:18:10.727392 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVF3hm7PiLG1R8Tw2syJVqR4znaBscty3weljpQpv2aVSYokkqaFvTxJu_8ZsVDxnVWNFBjrkTk4hem6vgNXmexe0yUI_M8pHEKoh5CWO6b1coilxRZ6VgX94mIL_xf6l3t9Q4mcnT856zV-XemvxZab0Ooy1ChU21L_her9Zn74z_zU Oct 22 21:18:10.727392 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 21:18:10.727392 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 21:18:10.727392 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 21:18:10.727392 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 21:18:10.727392 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 21:18:10.727392 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 21:18:10.727392 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: 28af724189a24022b3ef7651b7157a9d Oct 22 21:18:10.727392 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-ServersNegativeTestJSON-766586991 Oct 22 21:18:10.727392 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 21:18:10.727392 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 21:18:10.727392 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_28af724189a24022b3ef7651b7157a9d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/28af724189a24022b3ef7651b7157a9d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/28af724189a24022b3ef7651b7157a9d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/28af724189a24022b3ef7651b7157a9d"}]}] Oct 22 21:18:10.727392 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-ServersNegativeTestJSON-766586991 Oct 22 21:18:10.727392 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: 28af724189a24022b3ef7651b7157a9d Oct 22 21:18:10.727392 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-ServersNegativeTestJSON-766586991 Oct 22 21:18:10.727392 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-ServersNegativeTestJSON-766586991-project Oct 22 21:18:10.727392 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 21:18:10.727392 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 21:18:10.727392 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: 6c8a9229e7da421b9e0e6f7df52f71e2 Oct 22 21:18:10.727392 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-ServersNegativeTestJSON-766586991-project Oct 22 21:18:10.727392 ncdv-master-1 devstack@n-api.service[138744]: Oct 22 21:18:10.727392 ncdv-master-1 devstack@n-api.service[138744]: {"forceDelete": {}} Oct 22 21:18:10.727392 ncdv-master-1 devstack@n-api.service[138744]: method: > Oct 22 21:18:10.727392 ncdv-master-1 devstack@n-api.service[138744]: exception: Instance 020e7f60-3b5d-47cd-84d0-47864b920a85 could not be found. Oct 22 21:18:10.727392 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': '020e7f60-3b5d-47cd-84d0-47864b920a85', 'body': {'forceDelete': {}}} Oct 22 21:18:10.727392 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:18:10.727392 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:18:10.727392 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 21:18:10.727392 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 21:18:10.727392 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 21:18:10.727392 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 21:18:10.727392 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 22 21:18:10.727392 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 22 21:18:10.727392 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 020e7f60-3b5d-47cd-84d0-47864b920a85 could not be found. Oct 22 21:18:10.727392 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:18:10.727392 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:18:10.727392 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:18:10.727392 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:18:10.727392 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:18:10.727392 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:18:10.727392 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:18:10.727392 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:18:10.727392 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:18:10.727392 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:18:10.727392 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 55, in _force_delete Oct 22 21:18:10.727392 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 22 21:18:10.727392 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 21:18:10.727392 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:18:10.727392 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 020e7f60-3b5d-47cd-84d0-47864b920a85 could not be found. Oct 22 21:18:10.727392 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:18:10.727392 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:18:10.727392 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:18:10.727392 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:18:10.727392 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:18:10.727392 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:18:10.732113 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:18:10.732113 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:18:10.732113 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 020e7f60-3b5d-47cd-84d0-47864b920a85 could not be found. Oct 22 21:18:10.732113 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:18:10.733481 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-8b9f1277-ee9f-46ab-9236-e32932da3822 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Returning 404 to user: Instance 020e7f60-3b5d-47cd-84d0-47864b920a85 could not be found. {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:18:10.734486 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-8b9f1277-ee9f-46ab-9236-e32932da3822 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] 10.222.0.18 "POST /compute/v2.1/servers/020e7f60-3b5d-47cd-84d0-47864b920a85/action" status: 404 len: 111 microversion: 2.1 time: 0.035137 Oct 22 21:18:10.735590 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2569/5153] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 21:18:10 2022] POST /compute/v2.1/servers/020e7f60-3b5d-47cd-84d0-47864b920a85/action => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 21:18:10.745010 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-7f74517f-8b84-49c8-bf0c-6a643ba1b88f tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:18:10.745653 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-7f74517f-8b84-49c8-bf0c-6a643ba1b88f tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] [instance: 3de67bb0-04d9-4d3a-a925-102f04d677bb] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:18:10.754137 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7f74517f-8b84-49c8-bf0c-6a643ba1b88f tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:18:10.754651 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7f74517f-8b84-49c8-bf0c-6a643ba1b88f tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:18:10.755108 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7f74517f-8b84-49c8-bf0c-6a643ba1b88f tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:18:10.758550 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7f74517f-8b84-49c8-bf0c-6a643ba1b88f tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:18:10.769556 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7f74517f-8b84-49c8-bf0c-6a643ba1b88f tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:18:10.770032 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7f74517f-8b84-49c8-bf0c-6a643ba1b88f tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:18:10.952829 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-7f74517f-8b84-49c8-bf0c-6a643ba1b88f tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a9229e7da421b9e0e6f7df52f71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28af724189a24022b3ef7651b7157a9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:18:10.961131 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-7f74517f-8b84-49c8-bf0c-6a643ba1b88f tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] 10.222.0.18 "GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb" status: 200 len: 1507 microversion: 2.1 time: 0.220829 Oct 22 21:18:10.962016 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2585/5154] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:18:10 2022] GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb => generated 1507 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:18:10.989354 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-2a977fb8-cda8-4f52-b3e0-43e648b3c85e tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:18:10.990066 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-2a977fb8-cda8-4f52-b3e0-43e648b3c85e tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] [instance: 3de67bb0-04d9-4d3a-a925-102f04d677bb] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:18:11.002071 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2a977fb8-cda8-4f52-b3e0-43e648b3c85e tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:18:11.002997 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2a977fb8-cda8-4f52-b3e0-43e648b3c85e tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:18:11.004800 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2a977fb8-cda8-4f52-b3e0-43e648b3c85e tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:18:11.008381 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2a977fb8-cda8-4f52-b3e0-43e648b3c85e tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:18:11.010873 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2a977fb8-cda8-4f52-b3e0-43e648b3c85e tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:18:11.011618 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2a977fb8-cda8-4f52-b3e0-43e648b3c85e tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:18:11.178701 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-2a977fb8-cda8-4f52-b3e0-43e648b3c85e tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a9229e7da421b9e0e6f7df52f71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28af724189a24022b3ef7651b7157a9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:18:11.187399 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-2a977fb8-cda8-4f52-b3e0-43e648b3c85e tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] 10.222.0.18 "GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb" status: 200 len: 1507 microversion: 2.1 time: 0.206063 Oct 22 21:18:11.187986 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2570/5155] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:18:10 2022] GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb => generated 1507 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:18:11.210772 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-b078ec46-8856-4f4a-9fa7-dd8fa662bfaa tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 10}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:18:11.227093 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-b078ec46-8856-4f4a-9fa7-dd8fa662bfaa tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] [instance: cc71abb8-271f-4bad-a371-4bb5a0a368d1] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:18:11.233471 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.wsgi [None req-b078ec46-8856-4f4a-9fa7-dd8fa662bfaa tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] HTTP exception thrown: Instance cc71abb8-271f-4bad-a371-4bb5a0a368d1 could not be found. Oct 22 21:18:11.242894 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-b078ec46-8856-4f4a-9fa7-dd8fa662bfaa tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Request method failure captured: Oct 22 21:18:11.242894 ncdv-master-1 devstack@n-api.service[138745]: request: POST /compute/v2.1/servers/cc71abb8-271f-4bad-a371-4bb5a0a368d1/action HTTP/1.1 Oct 22 21:18:11.242894 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 21:18:11.242894 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 21:18:11.242894 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 21:18:11.242894 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 39 Oct 22 21:18:11.242894 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 21:18:11.242894 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 21:18:11.242894 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 21:18:11.242894 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 21:18:11.242894 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVF3hm7PiLG1R8Tw2syJVqR4znaBscty3weljpQpv2aVSYokkqaFvTxJu_8ZsVDxnVWNFBjrkTk4hem6vgNXmexe0yUI_M8pHEKoh5CWO6b1coilxRZ6VgX94mIL_xf6l3t9Q4mcnT856zV-XemvxZab0Ooy1ChU21L_her9Zn74z_zU Oct 22 21:18:11.242894 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 21:18:11.242894 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 21:18:11.242894 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 21:18:11.242894 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 21:18:11.242894 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 21:18:11.242894 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 21:18:11.242894 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: 28af724189a24022b3ef7651b7157a9d Oct 22 21:18:11.242894 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-ServersNegativeTestJSON-766586991 Oct 22 21:18:11.242894 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 21:18:11.242894 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 21:18:11.242894 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_28af724189a24022b3ef7651b7157a9d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/28af724189a24022b3ef7651b7157a9d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/28af724189a24022b3ef7651b7157a9d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/28af724189a24022b3ef7651b7157a9d"}]}] Oct 22 21:18:11.242894 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-ServersNegativeTestJSON-766586991 Oct 22 21:18:11.242894 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: 28af724189a24022b3ef7651b7157a9d Oct 22 21:18:11.242894 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-ServersNegativeTestJSON-766586991 Oct 22 21:18:11.242894 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-ServersNegativeTestJSON-766586991-project Oct 22 21:18:11.242894 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 21:18:11.242894 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 21:18:11.242894 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: 6c8a9229e7da421b9e0e6f7df52f71e2 Oct 22 21:18:11.242894 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-ServersNegativeTestJSON-766586991-project Oct 22 21:18:11.242894 ncdv-master-1 devstack@n-api.service[138745]: Oct 22 21:18:11.242894 ncdv-master-1 devstack@n-api.service[138745]: {"os-getConsoleOutput": {"length": 10}} Oct 22 21:18:11.242894 ncdv-master-1 devstack@n-api.service[138745]: method: > Oct 22 21:18:11.242894 ncdv-master-1 devstack@n-api.service[138745]: exception: Instance cc71abb8-271f-4bad-a371-4bb5a0a368d1 could not be found. Oct 22 21:18:11.242894 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'id': 'cc71abb8-271f-4bad-a371-4bb5a0a368d1', 'body': {'os-getConsoleOutput': {'length': 10}}} Oct 22 21:18:11.242894 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:18:11.242894 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:18:11.242894 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 21:18:11.242894 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 21:18:11.242894 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 21:18:11.242894 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 21:18:11.242894 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 22 21:18:11.242894 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 22 21:18:11.242894 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc71abb8-271f-4bad-a371-4bb5a0a368d1 could not be found. Oct 22 21:18:11.242894 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:18:11.242894 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:18:11.242894 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:18:11.242894 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:18:11.242894 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:18:11.242894 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:18:11.242894 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:18:11.242894 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:18:11.242894 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:18:11.242894 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:18:11.242894 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 21:18:11.242894 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 21:18:11.242894 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/console_output.py", line 41, in get_console_output Oct 22 21:18:11.242894 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 22 21:18:11.242894 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 21:18:11.242894 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:18:11.242894 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc71abb8-271f-4bad-a371-4bb5a0a368d1 could not be found. Oct 22 21:18:11.242894 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:18:11.242894 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:18:11.242894 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:18:11.242894 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:18:11.247657 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:18:11.247657 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:18:11.247657 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:18:11.247657 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:18:11.247657 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc71abb8-271f-4bad-a371-4bb5a0a368d1 could not be found. Oct 22 21:18:11.247657 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:18:11.247657 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-b078ec46-8856-4f4a-9fa7-dd8fa662bfaa tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Returning 404 to user: Instance cc71abb8-271f-4bad-a371-4bb5a0a368d1 could not be found. {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:18:11.247657 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-b078ec46-8856-4f4a-9fa7-dd8fa662bfaa tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] 10.222.0.18 "POST /compute/v2.1/servers/cc71abb8-271f-4bad-a371-4bb5a0a368d1/action" status: 404 len: 111 microversion: 2.1 time: 0.038387 Oct 22 21:18:11.248747 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2586/5156] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 21:18:11 2022] POST /compute/v2.1/servers/cc71abb8-271f-4bad-a371-4bb5a0a368d1/action => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 21:18:11.256816 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-3c1f5519-7d17-4179-976b-1508857eab4f tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:18:11.257448 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-3c1f5519-7d17-4179-976b-1508857eab4f tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] [instance: 3de67bb0-04d9-4d3a-a925-102f04d677bb] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:18:11.268714 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3c1f5519-7d17-4179-976b-1508857eab4f tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:18:11.269219 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3c1f5519-7d17-4179-976b-1508857eab4f tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:18:11.269669 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3c1f5519-7d17-4179-976b-1508857eab4f tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:18:11.270551 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3c1f5519-7d17-4179-976b-1508857eab4f tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:18:11.271014 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3c1f5519-7d17-4179-976b-1508857eab4f tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:18:11.271613 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3c1f5519-7d17-4179-976b-1508857eab4f tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:18:11.443393 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-3c1f5519-7d17-4179-976b-1508857eab4f tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a9229e7da421b9e0e6f7df52f71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28af724189a24022b3ef7651b7157a9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:18:11.452144 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-3c1f5519-7d17-4179-976b-1508857eab4f tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] 10.222.0.18 "GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb" status: 200 len: 1507 microversion: 2.1 time: 0.201015 Oct 22 21:18:11.453528 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2571/5157] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:18:11 2022] GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb => generated 1507 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:18:11.480218 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-7d39861a-3203-4888-8699-a170c51a839b tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:18:11.480913 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-7d39861a-3203-4888-8699-a170c51a839b tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] [instance: 3de67bb0-04d9-4d3a-a925-102f04d677bb] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:18:11.497103 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7d39861a-3203-4888-8699-a170c51a839b tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:18:11.497642 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7d39861a-3203-4888-8699-a170c51a839b tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:18:11.498075 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7d39861a-3203-4888-8699-a170c51a839b tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:18:11.498810 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7d39861a-3203-4888-8699-a170c51a839b tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:18:11.499541 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7d39861a-3203-4888-8699-a170c51a839b tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:18:11.500164 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7d39861a-3203-4888-8699-a170c51a839b tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:18:11.650774 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-7d39861a-3203-4888-8699-a170c51a839b tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a9229e7da421b9e0e6f7df52f71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28af724189a24022b3ef7651b7157a9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:18:11.660447 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-7d39861a-3203-4888-8699-a170c51a839b tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] 10.222.0.18 "GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb" status: 200 len: 1507 microversion: 2.1 time: 0.185175 Oct 22 21:18:11.661104 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2587/5158] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:18:11 2022] GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb => generated 1507 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:18:11.682920 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-aa2de599-94f9-4b26-aa02-6ce701a5b245 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:18:11.683569 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-aa2de599-94f9-4b26-aa02-6ce701a5b245 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] [instance: 5673eb51-dc1a-45f4-9a2d-6599449266ef] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:18:11.689786 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-aa2de599-94f9-4b26-aa02-6ce701a5b245 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] HTTP exception thrown: Instance 5673eb51-dc1a-45f4-9a2d-6599449266ef could not be found. Oct 22 21:18:11.691212 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-aa2de599-94f9-4b26-aa02-6ce701a5b245 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Request method failure captured: Oct 22 21:18:11.691212 ncdv-master-1 devstack@n-api.service[138744]: request: GET /compute/v2.1/servers/5673eb51-dc1a-45f4-9a2d-6599449266ef HTTP/1.1 Oct 22 21:18:11.691212 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 21:18:11.691212 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 21:18:11.691212 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 21:18:11.691212 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 0 Oct 22 21:18:11.691212 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 21:18:11.691212 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 21:18:11.691212 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 21:18:11.691212 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 21:18:11.691212 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVF3hm7PiLG1R8Tw2syJVqR4znaBscty3weljpQpv2aVSYokkqaFvTxJu_8ZsVDxnVWNFBjrkTk4hem6vgNXmexe0yUI_M8pHEKoh5CWO6b1coilxRZ6VgX94mIL_xf6l3t9Q4mcnT856zV-XemvxZab0Ooy1ChU21L_her9Zn74z_zU Oct 22 21:18:11.691212 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 21:18:11.691212 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 21:18:11.691212 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 21:18:11.691212 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 21:18:11.691212 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 21:18:11.691212 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 21:18:11.691212 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: 28af724189a24022b3ef7651b7157a9d Oct 22 21:18:11.691212 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-ServersNegativeTestJSON-766586991 Oct 22 21:18:11.691212 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 21:18:11.691212 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 21:18:11.691212 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_28af724189a24022b3ef7651b7157a9d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/28af724189a24022b3ef7651b7157a9d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/28af724189a24022b3ef7651b7157a9d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/28af724189a24022b3ef7651b7157a9d"}]}] Oct 22 21:18:11.691212 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-ServersNegativeTestJSON-766586991 Oct 22 21:18:11.691212 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: 28af724189a24022b3ef7651b7157a9d Oct 22 21:18:11.691212 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-ServersNegativeTestJSON-766586991 Oct 22 21:18:11.691212 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-ServersNegativeTestJSON-766586991-project Oct 22 21:18:11.691212 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 21:18:11.691212 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 21:18:11.691212 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: 6c8a9229e7da421b9e0e6f7df52f71e2 Oct 22 21:18:11.691212 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-ServersNegativeTestJSON-766586991-project Oct 22 21:18:11.691212 ncdv-master-1 devstack@n-api.service[138744]: method: > Oct 22 21:18:11.691212 ncdv-master-1 devstack@n-api.service[138744]: exception: Instance 5673eb51-dc1a-45f4-9a2d-6599449266ef could not be found. Oct 22 21:18:11.691212 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': '5673eb51-dc1a-45f4-9a2d-6599449266ef'} Oct 22 21:18:11.691212 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:18:11.691212 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:18:11.691212 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 21:18:11.691212 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 21:18:11.691212 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 21:18:11.691212 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 21:18:11.691212 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 22 21:18:11.691212 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 22 21:18:11.691212 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5673eb51-dc1a-45f4-9a2d-6599449266ef could not be found. Oct 22 21:18:11.691212 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:18:11.691212 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:18:11.691212 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:18:11.691212 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:18:11.691212 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:18:11.691212 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:18:11.691212 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:18:11.691212 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:18:11.691212 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:18:11.691212 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:18:11.691212 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 21:18:11.691212 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 21:18:11.691212 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 21:18:11.691212 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 21:18:11.691212 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 21:18:11.691212 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:18:11.691212 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5673eb51-dc1a-45f4-9a2d-6599449266ef could not be found. Oct 22 21:18:11.691212 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:18:11.691212 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:18:11.691212 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:18:11.691212 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:18:11.691212 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:18:11.698774 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:18:11.698774 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:18:11.698774 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:18:11.698774 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5673eb51-dc1a-45f4-9a2d-6599449266ef could not be found. Oct 22 21:18:11.698774 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:18:11.698774 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-aa2de599-94f9-4b26-aa02-6ce701a5b245 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Returning 404 to user: Instance 5673eb51-dc1a-45f4-9a2d-6599449266ef could not be found. {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:18:11.698774 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-aa2de599-94f9-4b26-aa02-6ce701a5b245 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] 10.222.0.18 "GET /compute/v2.1/servers/5673eb51-dc1a-45f4-9a2d-6599449266ef" status: 404 len: 111 microversion: 2.1 time: 0.013990 Oct 22 21:18:11.703629 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-5ce59b4d-3c6a-448b-992a-b23df04a95df tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:18:11.704350 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-5ce59b4d-3c6a-448b-992a-b23df04a95df tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] [instance: 3de67bb0-04d9-4d3a-a925-102f04d677bb] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:18:11.713930 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2572/5159] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:18:11 2022] GET /compute/v2.1/servers/5673eb51-dc1a-45f4-9a2d-6599449266ef => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 21:18:11.717462 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5ce59b4d-3c6a-448b-992a-b23df04a95df tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:18:11.718193 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5ce59b4d-3c6a-448b-992a-b23df04a95df tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:18:11.718404 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5ce59b4d-3c6a-448b-992a-b23df04a95df tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:18:11.719148 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5ce59b4d-3c6a-448b-992a-b23df04a95df tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:18:11.719644 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5ce59b4d-3c6a-448b-992a-b23df04a95df tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:18:11.720073 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5ce59b4d-3c6a-448b-992a-b23df04a95df tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:18:11.990462 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-5ce59b4d-3c6a-448b-992a-b23df04a95df tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a9229e7da421b9e0e6f7df52f71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28af724189a24022b3ef7651b7157a9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:18:12.031392 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-5ce59b4d-3c6a-448b-992a-b23df04a95df tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] 10.222.0.18 "GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb" status: 200 len: 1507 microversion: 2.1 time: 0.332767 Oct 22 21:18:12.032239 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2588/5160] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:18:11 2022] GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb => generated 1507 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:18:12.054969 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-33641c94-ae22-48e2-89c8-cd1cf3b57532 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:18:12.055607 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-33641c94-ae22-48e2-89c8-cd1cf3b57532 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] [instance: 3de67bb0-04d9-4d3a-a925-102f04d677bb] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:18:12.066754 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-33641c94-ae22-48e2-89c8-cd1cf3b57532 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:18:12.072537 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-33641c94-ae22-48e2-89c8-cd1cf3b57532 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:18:12.073572 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-33641c94-ae22-48e2-89c8-cd1cf3b57532 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:18:12.074543 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-33641c94-ae22-48e2-89c8-cd1cf3b57532 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:18:12.076316 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-33641c94-ae22-48e2-89c8-cd1cf3b57532 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:18:12.077017 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-33641c94-ae22-48e2-89c8-cd1cf3b57532 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:18:12.734778 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-33641c94-ae22-48e2-89c8-cd1cf3b57532 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a9229e7da421b9e0e6f7df52f71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28af724189a24022b3ef7651b7157a9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:18:12.748454 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-33641c94-ae22-48e2-89c8-cd1cf3b57532 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] 10.222.0.18 "GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb" status: 200 len: 1507 microversion: 2.1 time: 0.697326 Oct 22 21:18:12.749054 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2573/5161] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:18:12 2022] GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb => generated 1507 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:18:12.855902 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-1cd236c3-782b-40c5-a6e1-44737b498b09 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-971534098", "imageRef": "085e4478-6edc-4a69-8e08-f9831713eb65", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "b17a38c5-877b-428d-bd53-e74609d155b2"}]}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:18:12.877794 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-1cd236c3-782b-40c5-a6e1-44737b498b09 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Request method failure captured: Oct 22 21:18:12.877794 ncdv-master-1 devstack@n-api.service[138745]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 22 21:18:12.877794 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 21:18:12.877794 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 21:18:12.877794 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 21:18:12.877794 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 237 Oct 22 21:18:12.877794 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 21:18:12.877794 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 21:18:12.877794 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 21:18:12.877794 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 21:18:12.877794 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVF3hm7PiLG1R8Tw2syJVqR4znaBscty3weljpQpv2aVSYokkqaFvTxJu_8ZsVDxnVWNFBjrkTk4hem6vgNXmexe0yUI_M8pHEKoh5CWO6b1coilxRZ6VgX94mIL_xf6l3t9Q4mcnT856zV-XemvxZab0Ooy1ChU21L_her9Zn74z_zU Oct 22 21:18:12.877794 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 21:18:12.877794 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 21:18:12.877794 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 21:18:12.877794 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 21:18:12.877794 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 21:18:12.877794 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 21:18:12.877794 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: 28af724189a24022b3ef7651b7157a9d Oct 22 21:18:12.877794 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-ServersNegativeTestJSON-766586991 Oct 22 21:18:12.877794 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 21:18:12.877794 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 21:18:12.877794 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_28af724189a24022b3ef7651b7157a9d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/28af724189a24022b3ef7651b7157a9d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/28af724189a24022b3ef7651b7157a9d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/28af724189a24022b3ef7651b7157a9d"}]}] Oct 22 21:18:12.877794 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-ServersNegativeTestJSON-766586991 Oct 22 21:18:12.877794 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: 28af724189a24022b3ef7651b7157a9d Oct 22 21:18:12.877794 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-ServersNegativeTestJSON-766586991 Oct 22 21:18:12.877794 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-ServersNegativeTestJSON-766586991-project Oct 22 21:18:12.877794 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 21:18:12.877794 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 21:18:12.877794 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: 6c8a9229e7da421b9e0e6f7df52f71e2 Oct 22 21:18:12.877794 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-ServersNegativeTestJSON-766586991-project Oct 22 21:18:12.877794 ncdv-master-1 devstack@n-api.service[138745]: Oct 22 21:18:12.877794 ncdv-master-1 devstack@n-api.service[138745]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-971534098", "imageRef": "085e4478-6edc-4a69-8e08-f9831713eb65", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "b17a38c5-877b-428d-bd53-e74609d155b2"}]}} Oct 22 21:18:12.877794 ncdv-master-1 devstack@n-api.service[138745]: method: > Oct 22 21:18:12.877794 ncdv-master-1 devstack@n-api.service[138745]: exception: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Oct 22 21:18:12.877794 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-971534098', 'imageRef': '085e4478-6edc-4a69-8e08-f9831713eb65', 'flavorRef': '452', 'accessIPv4': '1.1.1.1.1.1', 'networks': [{'uuid': 'b17a38c5-877b-428d-bd53-e74609d155b2'}]}}} Oct 22 21:18:12.877794 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:18:12.877794 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:18:12.877794 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Oct 22 21:18:12.877794 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi result = func(instance) Oct 22 21:18:12.877794 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 253, in is_ipv4 Oct 22 21:18:12.877794 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return bool(ipaddress.IPv4Address(instance)) Oct 22 21:18:12.877794 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1257, in __init__ Oct 22 21:18:12.877794 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Oct 22 21:18:12.877794 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1144, in _ip_int_from_string Oct 22 21:18:12.877794 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise AddressValueError("Expected 4 octets in %r" % ip_str) Oct 22 21:18:12.877794 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: Expected 4 octets in '1.1.1.1.1.1' Oct 22 21:18:12.877794 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:18:12.877794 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 22 21:18:12.877794 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:18:12.877794 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:18:12.877794 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 22 21:18:12.877794 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 22 21:18:12.877794 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 22 21:18:12.877794 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise error Oct 22 21:18:12.877794 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '1.1.1.1.1.1' is not a 'ipv4' Oct 22 21:18:12.877794 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:18:12.877794 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv4']: Oct 22 21:18:12.877794 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi {'format': 'ipv4', 'type': 'string'} Oct 22 21:18:12.877794 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:18:12.877794 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 22 21:18:12.877794 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi '1.1.1.1.1.1' Oct 22 21:18:12.877794 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:18:12.877794 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:18:12.877794 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:18:12.877794 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:18:12.882747 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:18:12.882747 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:18:12.882747 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:18:12.882747 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:18:12.882747 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:18:12.882747 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:18:12.882747 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 21:18:12.882747 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 21:18:12.882747 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 22 21:18:12.882747 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 22 21:18:12.882747 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 22 21:18:12.882747 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 22 21:18:12.882747 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 22 21:18:12.882747 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 22 21:18:12.882747 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Oct 22 21:18:12.882747 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:18:12.882747 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:18:12.882747 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:18:12.882747 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:18:12.882747 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:18:12.882747 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:18:12.882747 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 22 21:18:12.882747 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 22 21:18:12.882747 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Oct 22 21:18:12.882747 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:18:12.887910 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-1cd236c3-782b-40c5-a6e1-44737b498b09 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Returning 400 to user: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:18:12.893771 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-1cd236c3-782b-40c5-a6e1-44737b498b09 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.041840 Oct 22 21:18:12.895124 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2589/5162] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Oct 22 21:18:12 2022] POST /compute/v2.1/servers => generated 139 bytes in 44 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 22 21:18:12.904932 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-a263dc62-3cb5-40c1-95e9-9872d627a83b tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:18:12.905562 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-a263dc62-3cb5-40c1-95e9-9872d627a83b tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] [instance: 3de67bb0-04d9-4d3a-a925-102f04d677bb] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:18:12.915000 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a263dc62-3cb5-40c1-95e9-9872d627a83b tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:18:12.917263 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a263dc62-3cb5-40c1-95e9-9872d627a83b tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:18:12.917902 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a263dc62-3cb5-40c1-95e9-9872d627a83b tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:18:12.918637 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a263dc62-3cb5-40c1-95e9-9872d627a83b tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:18:12.919103 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a263dc62-3cb5-40c1-95e9-9872d627a83b tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:18:12.919567 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a263dc62-3cb5-40c1-95e9-9872d627a83b tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:18:13.216710 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-a263dc62-3cb5-40c1-95e9-9872d627a83b tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a9229e7da421b9e0e6f7df52f71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28af724189a24022b3ef7651b7157a9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:18:13.225887 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-a263dc62-3cb5-40c1-95e9-9872d627a83b tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] 10.222.0.18 "GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb" status: 200 len: 1507 microversion: 2.1 time: 0.326579 Oct 22 21:18:13.226591 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2574/5163] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:18:12 2022] GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb => generated 1507 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:18:13.249047 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-e16c6ef4-bb03-437f-8dab-29d654cc294b tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:18:13.249956 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-e16c6ef4-bb03-437f-8dab-29d654cc294b tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] [instance: 3de67bb0-04d9-4d3a-a925-102f04d677bb] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:18:13.258209 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e16c6ef4-bb03-437f-8dab-29d654cc294b tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:18:13.258691 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e16c6ef4-bb03-437f-8dab-29d654cc294b tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:18:13.259376 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e16c6ef4-bb03-437f-8dab-29d654cc294b tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:18:13.260094 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e16c6ef4-bb03-437f-8dab-29d654cc294b tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:18:13.260561 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e16c6ef4-bb03-437f-8dab-29d654cc294b tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:18:13.260995 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e16c6ef4-bb03-437f-8dab-29d654cc294b tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:18:13.483047 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-e16c6ef4-bb03-437f-8dab-29d654cc294b tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a9229e7da421b9e0e6f7df52f71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28af724189a24022b3ef7651b7157a9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:18:13.492024 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-e16c6ef4-bb03-437f-8dab-29d654cc294b tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] 10.222.0.18 "GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb" status: 200 len: 1507 microversion: 2.1 time: 0.246699 Oct 22 21:18:13.492629 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2590/5164] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:18:13 2022] GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb => generated 1507 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:18:13.553542 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-bc36a880-36b8-44a2-b5a6-bf5d91d41f70 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1187021806", "imageRef": "085e4478-6edc-4a69-8e08-f9831713eb65", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "b17a38c5-877b-428d-bd53-e74609d155b2"}]}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:18:13.558838 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-bc36a880-36b8-44a2-b5a6-bf5d91d41f70 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Request method failure captured: Oct 22 21:18:13.558838 ncdv-master-1 devstack@n-api.service[138744]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 22 21:18:13.558838 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 21:18:13.558838 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 21:18:13.558838 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 21:18:13.558838 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 235 Oct 22 21:18:13.558838 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 21:18:13.558838 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 21:18:13.558838 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 21:18:13.558838 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 21:18:13.558838 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVF3hm7PiLG1R8Tw2syJVqR4znaBscty3weljpQpv2aVSYokkqaFvTxJu_8ZsVDxnVWNFBjrkTk4hem6vgNXmexe0yUI_M8pHEKoh5CWO6b1coilxRZ6VgX94mIL_xf6l3t9Q4mcnT856zV-XemvxZab0Ooy1ChU21L_her9Zn74z_zU Oct 22 21:18:13.558838 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 21:18:13.558838 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 21:18:13.558838 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 21:18:13.558838 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 21:18:13.558838 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 21:18:13.558838 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 21:18:13.558838 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: 28af724189a24022b3ef7651b7157a9d Oct 22 21:18:13.558838 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-ServersNegativeTestJSON-766586991 Oct 22 21:18:13.558838 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 21:18:13.558838 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 21:18:13.558838 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_28af724189a24022b3ef7651b7157a9d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/28af724189a24022b3ef7651b7157a9d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/28af724189a24022b3ef7651b7157a9d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/28af724189a24022b3ef7651b7157a9d"}]}] Oct 22 21:18:13.558838 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-ServersNegativeTestJSON-766586991 Oct 22 21:18:13.558838 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: 28af724189a24022b3ef7651b7157a9d Oct 22 21:18:13.558838 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-ServersNegativeTestJSON-766586991 Oct 22 21:18:13.558838 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-ServersNegativeTestJSON-766586991-project Oct 22 21:18:13.558838 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 21:18:13.558838 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 21:18:13.558838 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: 6c8a9229e7da421b9e0e6f7df52f71e2 Oct 22 21:18:13.558838 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-ServersNegativeTestJSON-766586991-project Oct 22 21:18:13.558838 ncdv-master-1 devstack@n-api.service[138744]: Oct 22 21:18:13.558838 ncdv-master-1 devstack@n-api.service[138744]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1187021806", "imageRef": "085e4478-6edc-4a69-8e08-f9831713eb65", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "b17a38c5-877b-428d-bd53-e74609d155b2"}]}} Oct 22 21:18:13.558838 ncdv-master-1 devstack@n-api.service[138744]: method: > Oct 22 21:18:13.558838 ncdv-master-1 devstack@n-api.service[138744]: exception: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Oct 22 21:18:13.558838 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1187021806', 'imageRef': '085e4478-6edc-4a69-8e08-f9831713eb65', 'flavorRef': '452', 'accessIPv6': 'notvalid', 'networks': [{'uuid': 'b17a38c5-877b-428d-bd53-e74609d155b2'}]}}} Oct 22 21:18:13.558838 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:18:13.558838 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:18:13.558838 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Oct 22 21:18:13.558838 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi result = func(instance) Oct 22 21:18:13.558838 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 260, in is_ipv6 Oct 22 21:18:13.558838 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi address = ipaddress.IPv6Address(instance) Oct 22 21:18:13.558838 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1844, in __init__ Oct 22 21:18:13.558838 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Oct 22 21:18:13.558838 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1581, in _ip_int_from_string Oct 22 21:18:13.558838 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise AddressValueError(msg) Oct 22 21:18:13.558838 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: At least 3 parts expected in 'notvalid' Oct 22 21:18:13.558838 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:18:13.558838 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 22 21:18:13.558838 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:18:13.558838 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:18:13.558838 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 22 21:18:13.558838 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 22 21:18:13.558838 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 22 21:18:13.558838 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise error Oct 22 21:18:13.558838 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'notvalid' is not a 'ipv6' Oct 22 21:18:13.558838 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:18:13.558838 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv6']: Oct 22 21:18:13.558838 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi {'format': 'ipv6', 'type': 'string'} Oct 22 21:18:13.558838 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:18:13.558838 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 22 21:18:13.558838 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi 'notvalid' Oct 22 21:18:13.558838 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:18:13.558838 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:18:13.558838 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:18:13.558838 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:18:13.563172 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:18:13.563172 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:18:13.563172 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:18:13.563172 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:18:13.563172 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:18:13.563172 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:18:13.563172 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 21:18:13.563172 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 21:18:13.563172 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 22 21:18:13.563172 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 22 21:18:13.563172 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 22 21:18:13.563172 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 22 21:18:13.563172 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 22 21:18:13.563172 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 22 21:18:13.563172 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Oct 22 21:18:13.563172 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:18:13.563172 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:18:13.563172 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:18:13.563172 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:18:13.563172 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:18:13.563172 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:18:13.563172 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 22 21:18:13.563172 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 22 21:18:13.563172 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Oct 22 21:18:13.563172 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:18:13.563172 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-bc36a880-36b8-44a2-b5a6-bf5d91d41f70 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Returning 400 to user: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:18:13.563172 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-bc36a880-36b8-44a2-b5a6-bf5d91d41f70 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 400 len: 133 microversion: 2.1 time: 0.010701 Oct 22 21:18:13.563172 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2575/5165] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Oct 22 21:18:13 2022] POST /compute/v2.1/servers => generated 133 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 22 21:18:13.571084 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-c7b4eb1d-d0ce-4adf-9ee9-250b6f80d603 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:18:13.571819 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-c7b4eb1d-d0ce-4adf-9ee9-250b6f80d603 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] [instance: 3de67bb0-04d9-4d3a-a925-102f04d677bb] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:18:13.578017 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c7b4eb1d-d0ce-4adf-9ee9-250b6f80d603 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:18:13.578488 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c7b4eb1d-d0ce-4adf-9ee9-250b6f80d603 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:18:13.579927 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c7b4eb1d-d0ce-4adf-9ee9-250b6f80d603 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:18:13.580296 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c7b4eb1d-d0ce-4adf-9ee9-250b6f80d603 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:18:13.580604 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c7b4eb1d-d0ce-4adf-9ee9-250b6f80d603 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:18:13.580992 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c7b4eb1d-d0ce-4adf-9ee9-250b6f80d603 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:18:13.584038 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell1:SELECT=100 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:18:13.775532 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-c7b4eb1d-d0ce-4adf-9ee9-250b6f80d603 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a9229e7da421b9e0e6f7df52f71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28af724189a24022b3ef7651b7157a9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:18:13.790633 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-c7b4eb1d-d0ce-4adf-9ee9-250b6f80d603 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] 10.222.0.18 "GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb" status: 200 len: 1507 microversion: 2.1 time: 0.224658 Oct 22 21:18:13.791240 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2591/5166] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:18:13 2022] GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb => generated 1507 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:18:13.821814 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-fbf88c96-d334-4ab9-958e-c2931a9a88c0 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:18:13.822452 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-fbf88c96-d334-4ab9-958e-c2931a9a88c0 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] [instance: 3de67bb0-04d9-4d3a-a925-102f04d677bb] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:18:13.839001 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fbf88c96-d334-4ab9-958e-c2931a9a88c0 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:18:13.839701 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fbf88c96-d334-4ab9-958e-c2931a9a88c0 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:18:13.840151 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fbf88c96-d334-4ab9-958e-c2931a9a88c0 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:18:13.840866 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fbf88c96-d334-4ab9-958e-c2931a9a88c0 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:18:13.841326 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fbf88c96-d334-4ab9-958e-c2931a9a88c0 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:18:13.841795 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fbf88c96-d334-4ab9-958e-c2931a9a88c0 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:18:14.115884 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-fbf88c96-d334-4ab9-958e-c2931a9a88c0 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a9229e7da421b9e0e6f7df52f71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28af724189a24022b3ef7651b7157a9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:18:14.126812 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-fbf88c96-d334-4ab9-958e-c2931a9a88c0 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] 10.222.0.18 "GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb" status: 200 len: 1507 microversion: 2.1 time: 0.310346 Oct 22 21:18:14.128187 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2576/5167] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:18:13 2022] GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb => generated 1507 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:18:14.150390 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-7e803186-d66a-4939-80d0-e9dcc0980b56 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:18:14.150987 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-7e803186-d66a-4939-80d0-e9dcc0980b56 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] [instance: dc5fe772-8cd1-4ea5-ac94-fe055813f22f] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:18:14.157331 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.wsgi [None req-7e803186-d66a-4939-80d0-e9dcc0980b56 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] HTTP exception thrown: Instance dc5fe772-8cd1-4ea5-ac94-fe055813f22f could not be found. Oct 22 21:18:14.166789 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-7e803186-d66a-4939-80d0-e9dcc0980b56 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Request method failure captured: Oct 22 21:18:14.166789 ncdv-master-1 devstack@n-api.service[138745]: request: POST /compute/v2.1/servers/dc5fe772-8cd1-4ea5-ac94-fe055813f22f/action HTTP/1.1 Oct 22 21:18:14.166789 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 21:18:14.166789 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 21:18:14.166789 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 21:18:14.166789 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 13 Oct 22 21:18:14.166789 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 21:18:14.166789 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 21:18:14.166789 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 21:18:14.166789 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 21:18:14.166789 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVF3hm7PiLG1R8Tw2syJVqR4znaBscty3weljpQpv2aVSYokkqaFvTxJu_8ZsVDxnVWNFBjrkTk4hem6vgNXmexe0yUI_M8pHEKoh5CWO6b1coilxRZ6VgX94mIL_xf6l3t9Q4mcnT856zV-XemvxZab0Ooy1ChU21L_her9Zn74z_zU Oct 22 21:18:14.166789 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 21:18:14.166789 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 21:18:14.166789 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 21:18:14.166789 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 21:18:14.166789 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 21:18:14.166789 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 21:18:14.166789 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: 28af724189a24022b3ef7651b7157a9d Oct 22 21:18:14.166789 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-ServersNegativeTestJSON-766586991 Oct 22 21:18:14.166789 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 21:18:14.166789 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 21:18:14.166789 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_28af724189a24022b3ef7651b7157a9d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/28af724189a24022b3ef7651b7157a9d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/28af724189a24022b3ef7651b7157a9d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/28af724189a24022b3ef7651b7157a9d"}]}] Oct 22 21:18:14.166789 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-ServersNegativeTestJSON-766586991 Oct 22 21:18:14.166789 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: 28af724189a24022b3ef7651b7157a9d Oct 22 21:18:14.166789 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-ServersNegativeTestJSON-766586991 Oct 22 21:18:14.166789 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-ServersNegativeTestJSON-766586991-project Oct 22 21:18:14.166789 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 21:18:14.166789 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 21:18:14.166789 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: 6c8a9229e7da421b9e0e6f7df52f71e2 Oct 22 21:18:14.166789 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-ServersNegativeTestJSON-766586991-project Oct 22 21:18:14.166789 ncdv-master-1 devstack@n-api.service[138745]: Oct 22 21:18:14.166789 ncdv-master-1 devstack@n-api.service[138745]: {"pause": {}} Oct 22 21:18:14.166789 ncdv-master-1 devstack@n-api.service[138745]: method: > Oct 22 21:18:14.166789 ncdv-master-1 devstack@n-api.service[138745]: exception: Instance dc5fe772-8cd1-4ea5-ac94-fe055813f22f could not be found. Oct 22 21:18:14.166789 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'id': 'dc5fe772-8cd1-4ea5-ac94-fe055813f22f', 'body': {'pause': {}}} Oct 22 21:18:14.166789 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:18:14.166789 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:18:14.166789 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 21:18:14.166789 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 21:18:14.166789 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 21:18:14.166789 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 21:18:14.166789 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 22 21:18:14.166789 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 22 21:18:14.166789 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc5fe772-8cd1-4ea5-ac94-fe055813f22f could not be found. Oct 22 21:18:14.166789 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:18:14.166789 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:18:14.166789 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:18:14.166789 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:18:14.166789 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:18:14.166789 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:18:14.166789 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:18:14.166789 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:18:14.166789 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:18:14.166789 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:18:14.166789 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 36, in _pause Oct 22 21:18:14.166789 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Oct 22 21:18:14.166789 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 21:18:14.166789 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:18:14.166789 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc5fe772-8cd1-4ea5-ac94-fe055813f22f could not be found. Oct 22 21:18:14.166789 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:18:14.166789 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:18:14.166789 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:18:14.166789 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:18:14.166789 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:18:14.166789 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:18:14.174422 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:18:14.174422 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:18:14.174422 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc5fe772-8cd1-4ea5-ac94-fe055813f22f could not be found. Oct 22 21:18:14.174422 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:18:14.174422 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-7e803186-d66a-4939-80d0-e9dcc0980b56 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Returning 404 to user: Instance dc5fe772-8cd1-4ea5-ac94-fe055813f22f could not be found. {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:18:14.174422 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-7e803186-d66a-4939-80d0-e9dcc0980b56 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] 10.222.0.18 "POST /compute/v2.1/servers/dc5fe772-8cd1-4ea5-ac94-fe055813f22f/action" status: 404 len: 111 microversion: 2.1 time: 0.023211 Oct 22 21:18:14.174422 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2592/5168] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 21:18:14 2022] POST /compute/v2.1/servers/dc5fe772-8cd1-4ea5-ac94-fe055813f22f/action => generated 111 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 21:18:14.181855 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-420061e6-d109-41a0-b3c0-fead4cc8166b tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:18:14.182548 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-420061e6-d109-41a0-b3c0-fead4cc8166b tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] [instance: 3de67bb0-04d9-4d3a-a925-102f04d677bb] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:18:14.189062 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-420061e6-d109-41a0-b3c0-fead4cc8166b tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:18:14.189647 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-420061e6-d109-41a0-b3c0-fead4cc8166b tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:18:14.190264 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-420061e6-d109-41a0-b3c0-fead4cc8166b tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:18:14.191029 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-420061e6-d109-41a0-b3c0-fead4cc8166b tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:18:14.191600 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-420061e6-d109-41a0-b3c0-fead4cc8166b tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:18:14.192092 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-420061e6-d109-41a0-b3c0-fead4cc8166b tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:18:14.408846 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-420061e6-d109-41a0-b3c0-fead4cc8166b tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a9229e7da421b9e0e6f7df52f71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28af724189a24022b3ef7651b7157a9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:18:14.417383 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-420061e6-d109-41a0-b3c0-fead4cc8166b tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] 10.222.0.18 "GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb" status: 200 len: 1507 microversion: 2.1 time: 0.239836 Oct 22 21:18:14.418209 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2577/5169] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:18:14 2022] GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb => generated 1507 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:18:14.441237 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-7c81b4c3-3434-402d-a8d2-435a56657cae tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:18:14.441863 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-7c81b4c3-3434-402d-a8d2-435a56657cae tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] [instance: 3de67bb0-04d9-4d3a-a925-102f04d677bb] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:18:14.449821 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7c81b4c3-3434-402d-a8d2-435a56657cae tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:18:14.450316 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7c81b4c3-3434-402d-a8d2-435a56657cae tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:18:14.450789 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7c81b4c3-3434-402d-a8d2-435a56657cae tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:18:14.451537 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7c81b4c3-3434-402d-a8d2-435a56657cae tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:18:14.452007 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7c81b4c3-3434-402d-a8d2-435a56657cae tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:18:14.452449 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7c81b4c3-3434-402d-a8d2-435a56657cae tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:18:14.692940 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-7c81b4c3-3434-402d-a8d2-435a56657cae tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a9229e7da421b9e0e6f7df52f71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28af724189a24022b3ef7651b7157a9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:18:14.703192 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-7c81b4c3-3434-402d-a8d2-435a56657cae tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] 10.222.0.18 "GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb" status: 200 len: 1507 microversion: 2.1 time: 0.265983 Oct 22 21:18:14.704159 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2593/5170] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:18:14 2022] GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb => generated 1507 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:18:14.726638 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-29f997d2-ae33-4151-b99e-f870f0214541 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:18:14.727285 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-29f997d2-ae33-4151-b99e-f870f0214541 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] [instance: 3de67bb0-04d9-4d3a-a925-102f04d677bb] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:18:14.735081 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-29f997d2-ae33-4151-b99e-f870f0214541 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:18:14.735759 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-29f997d2-ae33-4151-b99e-f870f0214541 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:18:14.736502 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-29f997d2-ae33-4151-b99e-f870f0214541 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:18:14.737335 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-29f997d2-ae33-4151-b99e-f870f0214541 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:18:14.737874 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-29f997d2-ae33-4151-b99e-f870f0214541 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:18:14.738383 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-29f997d2-ae33-4151-b99e-f870f0214541 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:18:14.795334 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:SELECT=100 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:18:14.827927 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-29f997d2-ae33-4151-b99e-f870f0214541 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] 10.222.0.18 "POST /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb/action" status: 202 len: 0 microversion: 2.1 time: 0.105206 Oct 22 21:18:14.828600 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2578/5171] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 21:18:14 2022] POST /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb/action => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 21:18:14.838006 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-6046a8a3-d54f-4adf-819d-70e797bc77e7 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:18:14.838914 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-6046a8a3-d54f-4adf-819d-70e797bc77e7 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] [instance: 3de67bb0-04d9-4d3a-a925-102f04d677bb] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:18:14.852411 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6046a8a3-d54f-4adf-819d-70e797bc77e7 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:18:14.854349 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6046a8a3-d54f-4adf-819d-70e797bc77e7 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:18:14.854820 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6046a8a3-d54f-4adf-819d-70e797bc77e7 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:18:14.855652 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6046a8a3-d54f-4adf-819d-70e797bc77e7 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:18:14.856353 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6046a8a3-d54f-4adf-819d-70e797bc77e7 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:18:14.857031 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6046a8a3-d54f-4adf-819d-70e797bc77e7 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:18:15.091954 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-6046a8a3-d54f-4adf-819d-70e797bc77e7 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a9229e7da421b9e0e6f7df52f71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28af724189a24022b3ef7651b7157a9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:18:15.104798 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-6046a8a3-d54f-4adf-819d-70e797bc77e7 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] 10.222.0.18 "GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb" status: 200 len: 1512 microversion: 2.1 time: 0.271576 Oct 22 21:18:15.105567 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2594/5172] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:18:14 2022] GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb => generated 1512 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:18:16.132519 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-d2a4add4-c3c2-4f0e-9826-23795a2192b3 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:18:16.134421 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-d2a4add4-c3c2-4f0e-9826-23795a2192b3 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] [instance: 3de67bb0-04d9-4d3a-a925-102f04d677bb] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:18:16.141266 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d2a4add4-c3c2-4f0e-9826-23795a2192b3 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:18:16.141711 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d2a4add4-c3c2-4f0e-9826-23795a2192b3 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:18:16.142176 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d2a4add4-c3c2-4f0e-9826-23795a2192b3 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:18:16.143060 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d2a4add4-c3c2-4f0e-9826-23795a2192b3 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:18:16.143713 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d2a4add4-c3c2-4f0e-9826-23795a2192b3 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:18:16.144169 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d2a4add4-c3c2-4f0e-9826-23795a2192b3 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:18:16.296337 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-d2a4add4-c3c2-4f0e-9826-23795a2192b3 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a9229e7da421b9e0e6f7df52f71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28af724189a24022b3ef7651b7157a9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:18:16.314004 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-d2a4add4-c3c2-4f0e-9826-23795a2192b3 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] 10.222.0.18 "GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb" status: 200 len: 1492 microversion: 2.1 time: 0.187869 Oct 22 21:18:16.314928 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2579/5173] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:18:16 2022] GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb => generated 1492 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:18:16.337052 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-2ecae9ef-cf44-4a4c-ae7b-e392bb29b502 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:18:16.337607 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-2ecae9ef-cf44-4a4c-ae7b-e392bb29b502 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] [instance: 3de67bb0-04d9-4d3a-a925-102f04d677bb] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:18:16.345214 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2ecae9ef-cf44-4a4c-ae7b-e392bb29b502 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:18:16.345733 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2ecae9ef-cf44-4a4c-ae7b-e392bb29b502 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:18:16.346261 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2ecae9ef-cf44-4a4c-ae7b-e392bb29b502 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:18:16.347093 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2ecae9ef-cf44-4a4c-ae7b-e392bb29b502 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:18:16.347786 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2ecae9ef-cf44-4a4c-ae7b-e392bb29b502 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:18:16.348283 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2ecae9ef-cf44-4a4c-ae7b-e392bb29b502 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:18:16.374207 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.wsgi [None req-2ecae9ef-cf44-4a4c-ae7b-e392bb29b502 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] HTTP exception thrown: Cannot 'pause' instance 3de67bb0-04d9-4d3a-a925-102f04d677bb while it is in vm_state paused Oct 22 21:18:16.375784 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-2ecae9ef-cf44-4a4c-ae7b-e392bb29b502 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Request method failure captured: Oct 22 21:18:16.375784 ncdv-master-1 devstack@n-api.service[138745]: request: POST /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb/action HTTP/1.1 Oct 22 21:18:16.375784 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 21:18:16.375784 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 21:18:16.375784 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 21:18:16.375784 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 13 Oct 22 21:18:16.375784 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 21:18:16.375784 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 21:18:16.375784 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 21:18:16.375784 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 21:18:16.375784 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVF3hm7PiLG1R8Tw2syJVqR4znaBscty3weljpQpv2aVSYokkqaFvTxJu_8ZsVDxnVWNFBjrkTk4hem6vgNXmexe0yUI_M8pHEKoh5CWO6b1coilxRZ6VgX94mIL_xf6l3t9Q4mcnT856zV-XemvxZab0Ooy1ChU21L_her9Zn74z_zU Oct 22 21:18:16.375784 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 21:18:16.375784 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 21:18:16.375784 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 21:18:16.375784 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 21:18:16.375784 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 21:18:16.375784 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 21:18:16.375784 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: 28af724189a24022b3ef7651b7157a9d Oct 22 21:18:16.375784 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-ServersNegativeTestJSON-766586991 Oct 22 21:18:16.375784 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 21:18:16.375784 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 21:18:16.375784 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_28af724189a24022b3ef7651b7157a9d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/28af724189a24022b3ef7651b7157a9d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/28af724189a24022b3ef7651b7157a9d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/28af724189a24022b3ef7651b7157a9d"}]}] Oct 22 21:18:16.375784 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-ServersNegativeTestJSON-766586991 Oct 22 21:18:16.375784 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: 28af724189a24022b3ef7651b7157a9d Oct 22 21:18:16.375784 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-ServersNegativeTestJSON-766586991 Oct 22 21:18:16.375784 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-ServersNegativeTestJSON-766586991-project Oct 22 21:18:16.375784 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 21:18:16.375784 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 21:18:16.375784 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: 6c8a9229e7da421b9e0e6f7df52f71e2 Oct 22 21:18:16.375784 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-ServersNegativeTestJSON-766586991-project Oct 22 21:18:16.375784 ncdv-master-1 devstack@n-api.service[138745]: Oct 22 21:18:16.375784 ncdv-master-1 devstack@n-api.service[138745]: {"pause": {}} Oct 22 21:18:16.375784 ncdv-master-1 devstack@n-api.service[138745]: method: > Oct 22 21:18:16.375784 ncdv-master-1 devstack@n-api.service[138745]: exception: Cannot 'pause' instance 3de67bb0-04d9-4d3a-a925-102f04d677bb while it is in vm_state paused Oct 22 21:18:16.375784 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'id': '3de67bb0-04d9-4d3a-a925-102f04d677bb', 'body': {'pause': {}}} Oct 22 21:18:16.375784 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:18:16.375784 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:18:16.375784 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 41, in _pause Oct 22 21:18:16.375784 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi self.compute_api.pause(ctxt, server) Oct 22 21:18:16.375784 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 22 21:18:16.375784 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 22 21:18:16.375784 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 22 21:18:16.375784 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 22 21:18:16.375784 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 3de67bb0-04d9-4d3a-a925-102f04d677bb in vm_state paused. Cannot pause while the instance is in this state. Oct 22 21:18:16.375784 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:18:16.375784 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:18:16.375784 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:18:16.375784 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:18:16.375784 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:18:16.375784 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:18:16.375784 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:18:16.375784 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:18:16.375784 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:18:16.375784 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:18:16.375784 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 45, in _pause Oct 22 21:18:16.375784 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 22 21:18:16.375784 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 22 21:18:16.375784 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 22 21:18:16.375784 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'pause' instance 3de67bb0-04d9-4d3a-a925-102f04d677bb while it is in vm_state paused Oct 22 21:18:16.375784 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:18:16.375784 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:18:16.375784 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:18:16.375784 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:18:16.375784 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:18:16.380621 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:18:16.380621 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:18:16.380621 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:18:16.380621 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'pause' instance 3de67bb0-04d9-4d3a-a925-102f04d677bb while it is in vm_state paused Oct 22 21:18:16.380621 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:18:16.380621 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-2ecae9ef-cf44-4a4c-ae7b-e392bb29b502 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Returning 409 to user: Cannot 'pause' instance 3de67bb0-04d9-4d3a-a925-102f04d677bb while it is in vm_state paused {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:18:16.380621 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-2ecae9ef-cf44-4a4c-ae7b-e392bb29b502 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] 10.222.0.18 "POST /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb/action" status: 409 len: 143 microversion: 2.1 time: 0.044492 Oct 22 21:18:16.381497 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2595/5174] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 21:18:16 2022] POST /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb/action => generated 143 bytes in 49 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 22 21:18:16.386568 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-a65bc591-2f0c-49f2-8ee6-aa4ba78093d0 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:18:16.387110 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-a65bc591-2f0c-49f2-8ee6-aa4ba78093d0 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] [instance: 3de67bb0-04d9-4d3a-a925-102f04d677bb] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:18:16.394221 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a65bc591-2f0c-49f2-8ee6-aa4ba78093d0 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:18:16.394724 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a65bc591-2f0c-49f2-8ee6-aa4ba78093d0 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:18:16.395164 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a65bc591-2f0c-49f2-8ee6-aa4ba78093d0 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:18:16.395898 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a65bc591-2f0c-49f2-8ee6-aa4ba78093d0 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:18:16.396541 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a65bc591-2f0c-49f2-8ee6-aa4ba78093d0 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:18:16.396969 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a65bc591-2f0c-49f2-8ee6-aa4ba78093d0 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:18:16.473633 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-a65bc591-2f0c-49f2-8ee6-aa4ba78093d0 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] 10.222.0.18 "POST /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb/action" status: 202 len: 0 microversion: 2.1 time: 0.090727 Oct 22 21:18:16.475097 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2580/5175] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 21:18:16 2022] POST /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb/action => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 21:18:16.485775 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-c30fbda5-12a1-4161-82b6-6a90e1da0f46 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:18:16.486516 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-c30fbda5-12a1-4161-82b6-6a90e1da0f46 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] [instance: 3de67bb0-04d9-4d3a-a925-102f04d677bb] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:18:16.495817 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c30fbda5-12a1-4161-82b6-6a90e1da0f46 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:18:16.496498 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c30fbda5-12a1-4161-82b6-6a90e1da0f46 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:18:16.497049 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c30fbda5-12a1-4161-82b6-6a90e1da0f46 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:18:16.498088 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c30fbda5-12a1-4161-82b6-6a90e1da0f46 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:18:16.498672 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c30fbda5-12a1-4161-82b6-6a90e1da0f46 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:18:16.499230 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c30fbda5-12a1-4161-82b6-6a90e1da0f46 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:18:16.717668 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-c30fbda5-12a1-4161-82b6-6a90e1da0f46 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a9229e7da421b9e0e6f7df52f71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28af724189a24022b3ef7651b7157a9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:18:16.731168 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-c30fbda5-12a1-4161-82b6-6a90e1da0f46 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] 10.222.0.18 "GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb" status: 200 len: 1499 microversion: 2.1 time: 0.252115 Oct 22 21:18:16.732474 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2596/5176] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:18:16 2022] GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb => generated 1499 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:18:17.767694 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-9aec57ab-f203-453f-91ea-5fcc54f5132b tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:18:17.771425 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-9aec57ab-f203-453f-91ea-5fcc54f5132b tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] [instance: 3de67bb0-04d9-4d3a-a925-102f04d677bb] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:18:17.784489 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9aec57ab-f203-453f-91ea-5fcc54f5132b tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:18:17.785891 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9aec57ab-f203-453f-91ea-5fcc54f5132b tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:18:17.789949 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9aec57ab-f203-453f-91ea-5fcc54f5132b tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:18:17.790706 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9aec57ab-f203-453f-91ea-5fcc54f5132b tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:18:17.791229 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9aec57ab-f203-453f-91ea-5fcc54f5132b tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:18:17.791659 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9aec57ab-f203-453f-91ea-5fcc54f5132b tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:18:18.020808 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-9aec57ab-f203-453f-91ea-5fcc54f5132b tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a9229e7da421b9e0e6f7df52f71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28af724189a24022b3ef7651b7157a9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:18:18.032218 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-9aec57ab-f203-453f-91ea-5fcc54f5132b tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] 10.222.0.18 "GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb" status: 200 len: 1507 microversion: 2.1 time: 0.278742 Oct 22 21:18:18.050064 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2581/5177] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:18:17 2022] GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb => generated 1507 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:18:18.062441 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-279bc403-3f1b-4b16-9411-eb22afc5e028 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:18:18.064326 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-279bc403-3f1b-4b16-9411-eb22afc5e028 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] [instance: 3de67bb0-04d9-4d3a-a925-102f04d677bb] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:18:18.078419 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-279bc403-3f1b-4b16-9411-eb22afc5e028 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:18:18.080907 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-279bc403-3f1b-4b16-9411-eb22afc5e028 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:18:18.083246 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-279bc403-3f1b-4b16-9411-eb22afc5e028 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:18:18.084307 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-279bc403-3f1b-4b16-9411-eb22afc5e028 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:18:18.084966 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-279bc403-3f1b-4b16-9411-eb22afc5e028 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:18:18.085659 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-279bc403-3f1b-4b16-9411-eb22afc5e028 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:18:18.604308 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-279bc403-3f1b-4b16-9411-eb22afc5e028 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a9229e7da421b9e0e6f7df52f71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28af724189a24022b3ef7651b7157a9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:18:18.613598 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-279bc403-3f1b-4b16-9411-eb22afc5e028 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] 10.222.0.18 "GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb" status: 200 len: 1507 microversion: 2.1 time: 0.557235 Oct 22 21:18:18.632059 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2597/5178] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:18:18 2022] GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb => generated 1507 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:18:18.637501 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-efb68ad3-eec4-40a4-ac7c-2e0084d54722 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:18:18.641146 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-efb68ad3-eec4-40a4-ac7c-2e0084d54722 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] [instance: cea3693e-cb10-4129-9f00-18f678998bbd] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:18:18.648825 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-efb68ad3-eec4-40a4-ac7c-2e0084d54722 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:18:18.649530 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-efb68ad3-eec4-40a4-ac7c-2e0084d54722 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:18:18.650573 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-efb68ad3-eec4-40a4-ac7c-2e0084d54722 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:18:18.652277 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-efb68ad3-eec4-40a4-ac7c-2e0084d54722 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:18:18.652972 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-efb68ad3-eec4-40a4-ac7c-2e0084d54722 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:18:18.653628 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-efb68ad3-eec4-40a4-ac7c-2e0084d54722 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:18:18.675565 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-efb68ad3-eec4-40a4-ac7c-2e0084d54722 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] HTTP exception thrown: Instance cea3693e-cb10-4129-9f00-18f678998bbd could not be found. Oct 22 21:18:18.677647 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-efb68ad3-eec4-40a4-ac7c-2e0084d54722 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Request method failure captured: Oct 22 21:18:18.677647 ncdv-master-1 devstack@n-api.service[138744]: request: POST /compute/v2.1/servers/cea3693e-cb10-4129-9f00-18f678998bbd/action HTTP/1.1 Oct 22 21:18:18.677647 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 21:18:18.677647 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 21:18:18.677647 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 21:18:18.677647 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 28 Oct 22 21:18:18.677647 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 21:18:18.677647 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 21:18:18.677647 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 21:18:18.677647 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 21:18:18.677647 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVF3hm7PiLG1R8Tw2syJVqR4znaBscty3weljpQpv2aVSYokkqaFvTxJu_8ZsVDxnVWNFBjrkTk4hem6vgNXmexe0yUI_M8pHEKoh5CWO6b1coilxRZ6VgX94mIL_xf6l3t9Q4mcnT856zV-XemvxZab0Ooy1ChU21L_her9Zn74z_zU Oct 22 21:18:18.677647 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 21:18:18.677647 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 21:18:18.677647 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 21:18:18.677647 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 21:18:18.677647 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 21:18:18.677647 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 21:18:18.677647 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: 28af724189a24022b3ef7651b7157a9d Oct 22 21:18:18.677647 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-ServersNegativeTestJSON-766586991 Oct 22 21:18:18.677647 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 21:18:18.677647 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 21:18:18.677647 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_28af724189a24022b3ef7651b7157a9d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/28af724189a24022b3ef7651b7157a9d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/28af724189a24022b3ef7651b7157a9d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/28af724189a24022b3ef7651b7157a9d"}]}] Oct 22 21:18:18.677647 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-ServersNegativeTestJSON-766586991 Oct 22 21:18:18.677647 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: 28af724189a24022b3ef7651b7157a9d Oct 22 21:18:18.677647 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-ServersNegativeTestJSON-766586991 Oct 22 21:18:18.677647 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-ServersNegativeTestJSON-766586991-project Oct 22 21:18:18.677647 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 21:18:18.677647 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 21:18:18.677647 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: 6c8a9229e7da421b9e0e6f7df52f71e2 Oct 22 21:18:18.677647 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-ServersNegativeTestJSON-766586991-project Oct 22 21:18:18.677647 ncdv-master-1 devstack@n-api.service[138744]: Oct 22 21:18:18.677647 ncdv-master-1 devstack@n-api.service[138744]: {"reboot": {"type": "SOFT"}} Oct 22 21:18:18.677647 ncdv-master-1 devstack@n-api.service[138744]: method: > Oct 22 21:18:18.677647 ncdv-master-1 devstack@n-api.service[138744]: exception: Instance cea3693e-cb10-4129-9f00-18f678998bbd could not be found. Oct 22 21:18:18.677647 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': 'cea3693e-cb10-4129-9f00-18f678998bbd', 'body': {'reboot': {'type': 'SOFT'}}} Oct 22 21:18:18.677647 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:18:18.677647 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:18:18.677647 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 21:18:18.677647 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 21:18:18.677647 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 21:18:18.677647 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 21:18:18.677647 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 21:18:18.677647 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 21:18:18.677647 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 21:18:18.677647 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 21:18:18.677647 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cea3693e-cb10-4129-9f00-18f678998bbd could not be found. Oct 22 21:18:18.677647 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:18:18.677647 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:18:18.677647 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:18:18.677647 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:18:18.677647 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:18:18.677647 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:18:18.677647 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:18:18.677647 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:18:18.677647 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:18:18.677647 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:18:18.677647 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 21:18:18.677647 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 21:18:18.677647 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Oct 22 21:18:18.677647 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 22 21:18:18.677647 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 21:18:18.677647 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 21:18:18.677647 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 21:18:18.677647 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:18:18.681826 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cea3693e-cb10-4129-9f00-18f678998bbd could not be found. Oct 22 21:18:18.681826 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:18:18.681826 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:18:18.681826 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:18:18.681826 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:18:18.681826 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:18:18.681826 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:18:18.681826 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:18:18.681826 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:18:18.681826 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cea3693e-cb10-4129-9f00-18f678998bbd could not be found. Oct 22 21:18:18.681826 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:18:18.684224 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-efb68ad3-eec4-40a4-ac7c-2e0084d54722 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Returning 404 to user: Instance cea3693e-cb10-4129-9f00-18f678998bbd could not be found. {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:18:18.685427 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-efb68ad3-eec4-40a4-ac7c-2e0084d54722 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] 10.222.0.18 "POST /compute/v2.1/servers/cea3693e-cb10-4129-9f00-18f678998bbd/action" status: 404 len: 111 microversion: 2.1 time: 0.051984 Oct 22 21:18:18.686921 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2582/5179] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 21:18:18 2022] POST /compute/v2.1/servers/cea3693e-cb10-4129-9f00-18f678998bbd/action => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 22 21:18:18.696405 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-27668c42-d5d2-456a-bed5-61e311c2384d tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:18:18.696996 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-27668c42-d5d2-456a-bed5-61e311c2384d tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] [instance: 3de67bb0-04d9-4d3a-a925-102f04d677bb] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:18:18.703693 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-27668c42-d5d2-456a-bed5-61e311c2384d tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:18:18.704873 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-27668c42-d5d2-456a-bed5-61e311c2384d tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:18:18.705317 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-27668c42-d5d2-456a-bed5-61e311c2384d tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:18:18.706066 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-27668c42-d5d2-456a-bed5-61e311c2384d tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:18:18.706781 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-27668c42-d5d2-456a-bed5-61e311c2384d tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:18:18.707471 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-27668c42-d5d2-456a-bed5-61e311c2384d tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:18:18.859659 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-27668c42-d5d2-456a-bed5-61e311c2384d tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a9229e7da421b9e0e6f7df52f71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28af724189a24022b3ef7651b7157a9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:18:18.873117 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-27668c42-d5d2-456a-bed5-61e311c2384d tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] 10.222.0.18 "GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb" status: 200 len: 1507 microversion: 2.1 time: 0.181600 Oct 22 21:18:18.874307 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2598/5180] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:18:18 2022] GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb => generated 1507 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:18:18.903655 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-cb08fcfc-28b1-4a45-bdde-d563b8eb4cb2 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:18:18.904282 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-cb08fcfc-28b1-4a45-bdde-d563b8eb4cb2 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] [instance: 3de67bb0-04d9-4d3a-a925-102f04d677bb] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:18:18.912175 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cb08fcfc-28b1-4a45-bdde-d563b8eb4cb2 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:18:18.912656 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cb08fcfc-28b1-4a45-bdde-d563b8eb4cb2 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:18:18.913105 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cb08fcfc-28b1-4a45-bdde-d563b8eb4cb2 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:18:18.913987 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cb08fcfc-28b1-4a45-bdde-d563b8eb4cb2 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:18:18.914527 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cb08fcfc-28b1-4a45-bdde-d563b8eb4cb2 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:18:18.917796 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cb08fcfc-28b1-4a45-bdde-d563b8eb4cb2 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:18:19.058931 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-cb08fcfc-28b1-4a45-bdde-d563b8eb4cb2 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a9229e7da421b9e0e6f7df52f71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28af724189a24022b3ef7651b7157a9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:18:19.067572 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-cb08fcfc-28b1-4a45-bdde-d563b8eb4cb2 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] 10.222.0.18 "GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb" status: 200 len: 1507 microversion: 2.1 time: 0.171942 Oct 22 21:18:19.068380 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2583/5181] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:18:18 2022] GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb => generated 1507 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:18:19.090645 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-5dad8fec-2f7e-43ba-b30f-877de98cfb4a tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:18:19.093100 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-5dad8fec-2f7e-43ba-b30f-877de98cfb4a tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] [instance: 8c3a1627-ee87-4c2e-b0b2-87e8557fad18] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:18:19.100677 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.wsgi [None req-5dad8fec-2f7e-43ba-b30f-877de98cfb4a tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] HTTP exception thrown: Instance 8c3a1627-ee87-4c2e-b0b2-87e8557fad18 could not be found. Oct 22 21:18:19.102427 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-5dad8fec-2f7e-43ba-b30f-877de98cfb4a tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Request method failure captured: Oct 22 21:18:19.102427 ncdv-master-1 devstack@n-api.service[138745]: request: POST /compute/v2.1/servers/8c3a1627-ee87-4c2e-b0b2-87e8557fad18/action HTTP/1.1 Oct 22 21:18:19.102427 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 21:18:19.102427 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 21:18:19.102427 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 21:18:19.102427 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 28 Oct 22 21:18:19.102427 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 21:18:19.102427 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 21:18:19.102427 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 21:18:19.102427 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 21:18:19.102427 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVF3hm7PiLG1R8Tw2syJVqR4znaBscty3weljpQpv2aVSYokkqaFvTxJu_8ZsVDxnVWNFBjrkTk4hem6vgNXmexe0yUI_M8pHEKoh5CWO6b1coilxRZ6VgX94mIL_xf6l3t9Q4mcnT856zV-XemvxZab0Ooy1ChU21L_her9Zn74z_zU Oct 22 21:18:19.102427 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 21:18:19.102427 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 21:18:19.102427 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 21:18:19.102427 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 21:18:19.102427 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 21:18:19.102427 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 21:18:19.102427 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: 28af724189a24022b3ef7651b7157a9d Oct 22 21:18:19.102427 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-ServersNegativeTestJSON-766586991 Oct 22 21:18:19.102427 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 21:18:19.102427 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 21:18:19.102427 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_28af724189a24022b3ef7651b7157a9d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/28af724189a24022b3ef7651b7157a9d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/28af724189a24022b3ef7651b7157a9d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/28af724189a24022b3ef7651b7157a9d"}]}] Oct 22 21:18:19.102427 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-ServersNegativeTestJSON-766586991 Oct 22 21:18:19.102427 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: 28af724189a24022b3ef7651b7157a9d Oct 22 21:18:19.102427 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-ServersNegativeTestJSON-766586991 Oct 22 21:18:19.102427 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-ServersNegativeTestJSON-766586991-project Oct 22 21:18:19.102427 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 21:18:19.102427 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 21:18:19.102427 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: 6c8a9229e7da421b9e0e6f7df52f71e2 Oct 22 21:18:19.102427 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-ServersNegativeTestJSON-766586991-project Oct 22 21:18:19.102427 ncdv-master-1 devstack@n-api.service[138745]: Oct 22 21:18:19.102427 ncdv-master-1 devstack@n-api.service[138745]: {"reboot": {"type": "SOFT"}} Oct 22 21:18:19.102427 ncdv-master-1 devstack@n-api.service[138745]: method: > Oct 22 21:18:19.102427 ncdv-master-1 devstack@n-api.service[138745]: exception: Instance 8c3a1627-ee87-4c2e-b0b2-87e8557fad18 could not be found. Oct 22 21:18:19.102427 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'id': '8c3a1627-ee87-4c2e-b0b2-87e8557fad18', 'body': {'reboot': {'type': 'SOFT'}}} Oct 22 21:18:19.102427 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:18:19.102427 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:18:19.102427 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 21:18:19.102427 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 21:18:19.102427 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 21:18:19.102427 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 21:18:19.102427 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 22 21:18:19.102427 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 22 21:18:19.102427 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c3a1627-ee87-4c2e-b0b2-87e8557fad18 could not be found. Oct 22 21:18:19.102427 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:18:19.102427 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:18:19.102427 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:18:19.102427 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:18:19.102427 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:18:19.102427 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:18:19.102427 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:18:19.102427 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:18:19.102427 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:18:19.102427 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:18:19.102427 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 21:18:19.102427 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 21:18:19.102427 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Oct 22 21:18:19.102427 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 22 21:18:19.102427 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 21:18:19.102427 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 21:18:19.102427 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 21:18:19.102427 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:18:19.102427 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c3a1627-ee87-4c2e-b0b2-87e8557fad18 could not be found. Oct 22 21:18:19.102427 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:18:19.106950 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:18:19.106950 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:18:19.106950 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:18:19.106950 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:18:19.106950 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:18:19.106950 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:18:19.106950 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:18:19.106950 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c3a1627-ee87-4c2e-b0b2-87e8557fad18 could not be found. Oct 22 21:18:19.106950 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:18:19.106950 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-5dad8fec-2f7e-43ba-b30f-877de98cfb4a tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Returning 404 to user: Instance 8c3a1627-ee87-4c2e-b0b2-87e8557fad18 could not be found. {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:18:19.106950 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-5dad8fec-2f7e-43ba-b30f-877de98cfb4a tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] 10.222.0.18 "POST /compute/v2.1/servers/8c3a1627-ee87-4c2e-b0b2-87e8557fad18/action" status: 404 len: 111 microversion: 2.1 time: 0.017379 Oct 22 21:18:19.107814 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2599/5182] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 21:18:19 2022] POST /compute/v2.1/servers/8c3a1627-ee87-4c2e-b0b2-87e8557fad18/action => generated 111 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 21:18:19.113764 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-555a69da-722a-4f9b-a250-b986ede7c0c9 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:18:19.114412 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-555a69da-722a-4f9b-a250-b986ede7c0c9 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] [instance: 3de67bb0-04d9-4d3a-a925-102f04d677bb] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:18:19.120624 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-555a69da-722a-4f9b-a250-b986ede7c0c9 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:18:19.121104 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-555a69da-722a-4f9b-a250-b986ede7c0c9 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:18:19.121537 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-555a69da-722a-4f9b-a250-b986ede7c0c9 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:18:19.122228 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-555a69da-722a-4f9b-a250-b986ede7c0c9 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:18:19.122677 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-555a69da-722a-4f9b-a250-b986ede7c0c9 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:18:19.123101 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-555a69da-722a-4f9b-a250-b986ede7c0c9 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:18:19.267311 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-555a69da-722a-4f9b-a250-b986ede7c0c9 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a9229e7da421b9e0e6f7df52f71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28af724189a24022b3ef7651b7157a9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:18:19.278041 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-555a69da-722a-4f9b-a250-b986ede7c0c9 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] 10.222.0.18 "GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb" status: 200 len: 1507 microversion: 2.1 time: 0.168447 Oct 22 21:18:19.278746 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2584/5183] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:18:19 2022] GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb => generated 1507 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:18:19.301690 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-872420f8-1575-474e-975b-025285117c31 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:18:19.302505 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-872420f8-1575-474e-975b-025285117c31 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] [instance: 3de67bb0-04d9-4d3a-a925-102f04d677bb] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:18:19.310292 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-872420f8-1575-474e-975b-025285117c31 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:18:19.311081 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-872420f8-1575-474e-975b-025285117c31 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:18:19.311608 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-872420f8-1575-474e-975b-025285117c31 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:18:19.312340 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-872420f8-1575-474e-975b-025285117c31 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:18:19.312793 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-872420f8-1575-474e-975b-025285117c31 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:18:19.313231 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-872420f8-1575-474e-975b-025285117c31 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:18:19.456968 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-872420f8-1575-474e-975b-025285117c31 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a9229e7da421b9e0e6f7df52f71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28af724189a24022b3ef7651b7157a9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:18:19.465824 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-872420f8-1575-474e-975b-025285117c31 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] 10.222.0.18 "GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb" status: 200 len: 1507 microversion: 2.1 time: 0.168199 Oct 22 21:18:19.466844 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2600/5184] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:18:19 2022] GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb => generated 1507 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:18:19.491923 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-8b527b9a-27de-4cff-bcbd-e0e8d7ee091d tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "085e4478-6edc-4a69-8e08-f9831713eb65"}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:18:19.495470 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-8b527b9a-27de-4cff-bcbd-e0e8d7ee091d tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] [instance: cea3693e-cb10-4129-9f00-18f678998bbd] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:18:19.502358 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8b527b9a-27de-4cff-bcbd-e0e8d7ee091d tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:18:19.503135 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8b527b9a-27de-4cff-bcbd-e0e8d7ee091d tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:18:19.503776 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8b527b9a-27de-4cff-bcbd-e0e8d7ee091d tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:18:19.504873 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8b527b9a-27de-4cff-bcbd-e0e8d7ee091d tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:18:19.505505 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8b527b9a-27de-4cff-bcbd-e0e8d7ee091d tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:18:19.506100 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8b527b9a-27de-4cff-bcbd-e0e8d7ee091d tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:18:19.525686 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-8b527b9a-27de-4cff-bcbd-e0e8d7ee091d tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] HTTP exception thrown: Instance cea3693e-cb10-4129-9f00-18f678998bbd could not be found. Oct 22 21:18:19.528138 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-8b527b9a-27de-4cff-bcbd-e0e8d7ee091d tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Request method failure captured: Oct 22 21:18:19.528138 ncdv-master-1 devstack@n-api.service[138744]: request: POST /compute/v2.1/servers/cea3693e-cb10-4129-9f00-18f678998bbd/action HTTP/1.1 Oct 22 21:18:19.528138 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 21:18:19.528138 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 21:18:19.528138 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 21:18:19.528138 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 65 Oct 22 21:18:19.528138 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 21:18:19.528138 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 21:18:19.528138 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 21:18:19.528138 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 21:18:19.528138 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVF3hm7PiLG1R8Tw2syJVqR4znaBscty3weljpQpv2aVSYokkqaFvTxJu_8ZsVDxnVWNFBjrkTk4hem6vgNXmexe0yUI_M8pHEKoh5CWO6b1coilxRZ6VgX94mIL_xf6l3t9Q4mcnT856zV-XemvxZab0Ooy1ChU21L_her9Zn74z_zU Oct 22 21:18:19.528138 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 21:18:19.528138 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 21:18:19.528138 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 21:18:19.528138 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 21:18:19.528138 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 21:18:19.528138 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 21:18:19.528138 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: 28af724189a24022b3ef7651b7157a9d Oct 22 21:18:19.528138 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-ServersNegativeTestJSON-766586991 Oct 22 21:18:19.528138 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 21:18:19.528138 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 21:18:19.528138 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_28af724189a24022b3ef7651b7157a9d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/28af724189a24022b3ef7651b7157a9d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/28af724189a24022b3ef7651b7157a9d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/28af724189a24022b3ef7651b7157a9d"}]}] Oct 22 21:18:19.528138 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-ServersNegativeTestJSON-766586991 Oct 22 21:18:19.528138 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: 28af724189a24022b3ef7651b7157a9d Oct 22 21:18:19.528138 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-ServersNegativeTestJSON-766586991 Oct 22 21:18:19.528138 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-ServersNegativeTestJSON-766586991-project Oct 22 21:18:19.528138 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 21:18:19.528138 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 21:18:19.528138 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: 6c8a9229e7da421b9e0e6f7df52f71e2 Oct 22 21:18:19.528138 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-ServersNegativeTestJSON-766586991-project Oct 22 21:18:19.528138 ncdv-master-1 devstack@n-api.service[138744]: Oct 22 21:18:19.528138 ncdv-master-1 devstack@n-api.service[138744]: {"rebuild": {"imageRef": "085e4478-6edc-4a69-8e08-f9831713eb65"}} Oct 22 21:18:19.528138 ncdv-master-1 devstack@n-api.service[138744]: method: > Oct 22 21:18:19.528138 ncdv-master-1 devstack@n-api.service[138744]: exception: Instance cea3693e-cb10-4129-9f00-18f678998bbd could not be found. Oct 22 21:18:19.528138 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': 'cea3693e-cb10-4129-9f00-18f678998bbd', 'body': {'rebuild': {'imageRef': '085e4478-6edc-4a69-8e08-f9831713eb65'}}} Oct 22 21:18:19.528138 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:18:19.528138 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:18:19.528138 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 21:18:19.528138 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 21:18:19.528138 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 21:18:19.528138 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 21:18:19.528138 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 21:18:19.528138 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 21:18:19.528138 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 21:18:19.528138 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 21:18:19.528138 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cea3693e-cb10-4129-9f00-18f678998bbd could not be found. Oct 22 21:18:19.528138 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:18:19.528138 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:18:19.528138 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:18:19.528138 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:18:19.528138 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:18:19.528138 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:18:19.528138 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:18:19.528138 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:18:19.528138 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:18:19.528138 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:18:19.528138 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 21:18:19.528138 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 21:18:19.528138 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 21:18:19.528138 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 21:18:19.528138 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 21:18:19.528138 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 21:18:19.528138 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Oct 22 21:18:19.528138 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Oct 22 21:18:19.532821 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 22 21:18:19.532821 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 21:18:19.532821 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 21:18:19.532821 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 21:18:19.532821 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:18:19.532821 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cea3693e-cb10-4129-9f00-18f678998bbd could not be found. Oct 22 21:18:19.532821 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:18:19.532821 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:18:19.532821 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:18:19.532821 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:18:19.532821 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:18:19.532821 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:18:19.532821 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:18:19.532821 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:18:19.532821 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cea3693e-cb10-4129-9f00-18f678998bbd could not be found. Oct 22 21:18:19.532821 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:18:19.540516 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-8b527b9a-27de-4cff-bcbd-e0e8d7ee091d tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Returning 404 to user: Instance cea3693e-cb10-4129-9f00-18f678998bbd could not be found. {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:18:19.542019 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-8b527b9a-27de-4cff-bcbd-e0e8d7ee091d tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] 10.222.0.18 "POST /compute/v2.1/servers/cea3693e-cb10-4129-9f00-18f678998bbd/action" status: 404 len: 111 microversion: 2.1 time: 0.054282 Oct 22 21:18:19.542948 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2585/5185] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 21:18:19 2022] POST /compute/v2.1/servers/cea3693e-cb10-4129-9f00-18f678998bbd/action => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 21:18:19.553345 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-d7818504-99b0-4422-8f71-518fe9e55377 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:18:19.554001 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-d7818504-99b0-4422-8f71-518fe9e55377 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] [instance: 3de67bb0-04d9-4d3a-a925-102f04d677bb] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:18:19.561612 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d7818504-99b0-4422-8f71-518fe9e55377 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:18:19.562399 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d7818504-99b0-4422-8f71-518fe9e55377 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:18:19.563054 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d7818504-99b0-4422-8f71-518fe9e55377 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:18:19.564232 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d7818504-99b0-4422-8f71-518fe9e55377 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:18:19.564900 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d7818504-99b0-4422-8f71-518fe9e55377 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:18:19.565258 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d7818504-99b0-4422-8f71-518fe9e55377 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:18:19.817629 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-d7818504-99b0-4422-8f71-518fe9e55377 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a9229e7da421b9e0e6f7df52f71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28af724189a24022b3ef7651b7157a9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:18:19.836812 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-d7818504-99b0-4422-8f71-518fe9e55377 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] 10.222.0.18 "GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb" status: 200 len: 1507 microversion: 2.1 time: 0.289685 Oct 22 21:18:19.842363 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2601/5186] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:18:19 2022] GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb => generated 1507 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:18:19.869524 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-4a870adc-10d3-44d1-9fd5-1439d122155e tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:18:19.870320 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-4a870adc-10d3-44d1-9fd5-1439d122155e tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] [instance: 3de67bb0-04d9-4d3a-a925-102f04d677bb] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:18:19.880648 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4a870adc-10d3-44d1-9fd5-1439d122155e tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:18:19.881260 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4a870adc-10d3-44d1-9fd5-1439d122155e tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:18:19.881802 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4a870adc-10d3-44d1-9fd5-1439d122155e tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:18:19.883920 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4a870adc-10d3-44d1-9fd5-1439d122155e tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:18:19.884405 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4a870adc-10d3-44d1-9fd5-1439d122155e tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:18:19.884845 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4a870adc-10d3-44d1-9fd5-1439d122155e tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:18:20.143177 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-4a870adc-10d3-44d1-9fd5-1439d122155e tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a9229e7da421b9e0e6f7df52f71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28af724189a24022b3ef7651b7157a9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:18:20.151213 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-4a870adc-10d3-44d1-9fd5-1439d122155e tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] 10.222.0.18 "GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb" status: 200 len: 1507 microversion: 2.1 time: 0.289139 Oct 22 21:18:20.151810 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2586/5187] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:18:19 2022] GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb => generated 1507 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:18:20.174083 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-9917d956-8344-459a-aeee-7d0d2b6e3512 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "085e4478-6edc-4a69-8e08-f9831713eb65"}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:18:20.176809 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-9917d956-8344-459a-aeee-7d0d2b6e3512 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] [instance: fc7dea5f-64c3-4caa-9efa-d845a16989b1] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:18:20.183526 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.wsgi [None req-9917d956-8344-459a-aeee-7d0d2b6e3512 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] HTTP exception thrown: Instance fc7dea5f-64c3-4caa-9efa-d845a16989b1 could not be found. Oct 22 21:18:20.185162 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-9917d956-8344-459a-aeee-7d0d2b6e3512 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Request method failure captured: Oct 22 21:18:20.185162 ncdv-master-1 devstack@n-api.service[138745]: request: POST /compute/v2.1/servers/fc7dea5f-64c3-4caa-9efa-d845a16989b1/action HTTP/1.1 Oct 22 21:18:20.185162 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 21:18:20.185162 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 21:18:20.185162 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 21:18:20.185162 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 65 Oct 22 21:18:20.185162 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 21:18:20.185162 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 21:18:20.185162 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 21:18:20.185162 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 21:18:20.185162 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVF3hm7PiLG1R8Tw2syJVqR4znaBscty3weljpQpv2aVSYokkqaFvTxJu_8ZsVDxnVWNFBjrkTk4hem6vgNXmexe0yUI_M8pHEKoh5CWO6b1coilxRZ6VgX94mIL_xf6l3t9Q4mcnT856zV-XemvxZab0Ooy1ChU21L_her9Zn74z_zU Oct 22 21:18:20.185162 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 21:18:20.185162 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 21:18:20.185162 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 21:18:20.185162 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 21:18:20.185162 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 21:18:20.185162 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 21:18:20.185162 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: 28af724189a24022b3ef7651b7157a9d Oct 22 21:18:20.185162 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-ServersNegativeTestJSON-766586991 Oct 22 21:18:20.185162 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 21:18:20.185162 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 21:18:20.185162 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_28af724189a24022b3ef7651b7157a9d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/28af724189a24022b3ef7651b7157a9d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/28af724189a24022b3ef7651b7157a9d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/28af724189a24022b3ef7651b7157a9d"}]}] Oct 22 21:18:20.185162 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-ServersNegativeTestJSON-766586991 Oct 22 21:18:20.185162 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: 28af724189a24022b3ef7651b7157a9d Oct 22 21:18:20.185162 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-ServersNegativeTestJSON-766586991 Oct 22 21:18:20.185162 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-ServersNegativeTestJSON-766586991-project Oct 22 21:18:20.185162 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 21:18:20.185162 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 21:18:20.185162 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: 6c8a9229e7da421b9e0e6f7df52f71e2 Oct 22 21:18:20.185162 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-ServersNegativeTestJSON-766586991-project Oct 22 21:18:20.185162 ncdv-master-1 devstack@n-api.service[138745]: Oct 22 21:18:20.185162 ncdv-master-1 devstack@n-api.service[138745]: {"rebuild": {"imageRef": "085e4478-6edc-4a69-8e08-f9831713eb65"}} Oct 22 21:18:20.185162 ncdv-master-1 devstack@n-api.service[138745]: method: > Oct 22 21:18:20.185162 ncdv-master-1 devstack@n-api.service[138745]: exception: Instance fc7dea5f-64c3-4caa-9efa-d845a16989b1 could not be found. Oct 22 21:18:20.185162 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'id': 'fc7dea5f-64c3-4caa-9efa-d845a16989b1', 'body': {'rebuild': {'imageRef': '085e4478-6edc-4a69-8e08-f9831713eb65'}}} Oct 22 21:18:20.185162 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:18:20.185162 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:18:20.185162 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 21:18:20.185162 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 21:18:20.185162 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 21:18:20.185162 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 21:18:20.185162 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 22 21:18:20.185162 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 22 21:18:20.185162 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fc7dea5f-64c3-4caa-9efa-d845a16989b1 could not be found. Oct 22 21:18:20.185162 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:18:20.185162 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:18:20.185162 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:18:20.185162 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:18:20.185162 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:18:20.185162 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:18:20.185162 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:18:20.185162 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:18:20.185162 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:18:20.185162 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:18:20.185162 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 21:18:20.185162 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 21:18:20.185162 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 21:18:20.185162 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 21:18:20.185162 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 21:18:20.185162 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 21:18:20.185162 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Oct 22 21:18:20.185162 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Oct 22 21:18:20.185162 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 22 21:18:20.185162 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 21:18:20.189684 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 21:18:20.189684 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 21:18:20.189684 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:18:20.189684 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fc7dea5f-64c3-4caa-9efa-d845a16989b1 could not be found. Oct 22 21:18:20.189684 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:18:20.189684 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:18:20.189684 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:18:20.189684 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:18:20.189684 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:18:20.189684 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:18:20.189684 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:18:20.189684 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:18:20.189684 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fc7dea5f-64c3-4caa-9efa-d845a16989b1 could not be found. Oct 22 21:18:20.189684 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:18:20.189684 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-9917d956-8344-459a-aeee-7d0d2b6e3512 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Returning 404 to user: Instance fc7dea5f-64c3-4caa-9efa-d845a16989b1 could not be found. {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:18:20.189684 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-9917d956-8344-459a-aeee-7d0d2b6e3512 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] 10.222.0.18 "POST /compute/v2.1/servers/fc7dea5f-64c3-4caa-9efa-d845a16989b1/action" status: 404 len: 111 microversion: 2.1 time: 0.016677 Oct 22 21:18:20.189684 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2602/5188] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 21:18:20 2022] POST /compute/v2.1/servers/fc7dea5f-64c3-4caa-9efa-d845a16989b1/action => generated 111 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 21:18:20.195740 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-b92e63f0-35e1-40d8-9d53-cfdc921778fb tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:18:20.196387 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-b92e63f0-35e1-40d8-9d53-cfdc921778fb tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] [instance: 3de67bb0-04d9-4d3a-a925-102f04d677bb] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:18:20.202749 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b92e63f0-35e1-40d8-9d53-cfdc921778fb tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:18:20.203245 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b92e63f0-35e1-40d8-9d53-cfdc921778fb tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:18:20.203714 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b92e63f0-35e1-40d8-9d53-cfdc921778fb tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:18:20.204483 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b92e63f0-35e1-40d8-9d53-cfdc921778fb tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:18:20.205139 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b92e63f0-35e1-40d8-9d53-cfdc921778fb tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:18:20.205566 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b92e63f0-35e1-40d8-9d53-cfdc921778fb tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:18:20.438193 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-b92e63f0-35e1-40d8-9d53-cfdc921778fb tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a9229e7da421b9e0e6f7df52f71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28af724189a24022b3ef7651b7157a9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:18:20.446912 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-b92e63f0-35e1-40d8-9d53-cfdc921778fb tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] 10.222.0.18 "GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb" status: 200 len: 1507 microversion: 2.1 time: 0.255064 Oct 22 21:18:20.447637 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2587/5189] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:18:20 2022] GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb => generated 1507 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:18:20.472397 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-e29f5a76-1096-47e9-92cc-7f50637f7281 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:18:20.473286 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-e29f5a76-1096-47e9-92cc-7f50637f7281 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] [instance: 3de67bb0-04d9-4d3a-a925-102f04d677bb] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:18:20.482028 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e29f5a76-1096-47e9-92cc-7f50637f7281 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:18:20.482738 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e29f5a76-1096-47e9-92cc-7f50637f7281 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:18:20.483240 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e29f5a76-1096-47e9-92cc-7f50637f7281 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:18:20.484061 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e29f5a76-1096-47e9-92cc-7f50637f7281 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:18:20.484633 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e29f5a76-1096-47e9-92cc-7f50637f7281 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:18:20.485071 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e29f5a76-1096-47e9-92cc-7f50637f7281 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:18:20.628378 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-e29f5a76-1096-47e9-92cc-7f50637f7281 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a9229e7da421b9e0e6f7df52f71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28af724189a24022b3ef7651b7157a9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:18:20.636305 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-e29f5a76-1096-47e9-92cc-7f50637f7281 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] 10.222.0.18 "GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb" status: 200 len: 1507 microversion: 2.1 time: 0.168641 Oct 22 21:18:20.636950 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2603/5190] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:18:20 2022] GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb => generated 1507 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:18:20.659555 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-fe509103-cc16-48f4-8553-a43a266bf40f tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:18:20.660110 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-fe509103-cc16-48f4-8553-a43a266bf40f tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] [instance: 155cdda7-4b60-4bd8-b051-c6fcc23600fe] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:18:20.665632 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-fe509103-cc16-48f4-8553-a43a266bf40f tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] HTTP exception thrown: Instance 155cdda7-4b60-4bd8-b051-c6fcc23600fe could not be found. Oct 22 21:18:20.667126 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-fe509103-cc16-48f4-8553-a43a266bf40f tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Request method failure captured: Oct 22 21:18:20.667126 ncdv-master-1 devstack@n-api.service[138744]: request: POST /compute/v2.1/servers/155cdda7-4b60-4bd8-b051-c6fcc23600fe/action HTTP/1.1 Oct 22 21:18:20.667126 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 21:18:20.667126 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 21:18:20.667126 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 21:18:20.667126 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 15 Oct 22 21:18:20.667126 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 21:18:20.667126 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 21:18:20.667126 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 21:18:20.667126 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 21:18:20.667126 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVF3hm7PiLG1R8Tw2syJVqR4znaBscty3weljpQpv2aVSYokkqaFvTxJu_8ZsVDxnVWNFBjrkTk4hem6vgNXmexe0yUI_M8pHEKoh5CWO6b1coilxRZ6VgX94mIL_xf6l3t9Q4mcnT856zV-XemvxZab0Ooy1ChU21L_her9Zn74z_zU Oct 22 21:18:20.667126 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 21:18:20.667126 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 21:18:20.667126 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 21:18:20.667126 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 21:18:20.667126 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 21:18:20.667126 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 21:18:20.667126 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: 28af724189a24022b3ef7651b7157a9d Oct 22 21:18:20.667126 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-ServersNegativeTestJSON-766586991 Oct 22 21:18:20.667126 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 21:18:20.667126 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 21:18:20.667126 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_28af724189a24022b3ef7651b7157a9d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/28af724189a24022b3ef7651b7157a9d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/28af724189a24022b3ef7651b7157a9d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/28af724189a24022b3ef7651b7157a9d"}]}] Oct 22 21:18:20.667126 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-ServersNegativeTestJSON-766586991 Oct 22 21:18:20.667126 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: 28af724189a24022b3ef7651b7157a9d Oct 22 21:18:20.667126 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-ServersNegativeTestJSON-766586991 Oct 22 21:18:20.667126 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-ServersNegativeTestJSON-766586991-project Oct 22 21:18:20.667126 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 21:18:20.667126 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 21:18:20.667126 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: 6c8a9229e7da421b9e0e6f7df52f71e2 Oct 22 21:18:20.667126 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-ServersNegativeTestJSON-766586991-project Oct 22 21:18:20.667126 ncdv-master-1 devstack@n-api.service[138744]: Oct 22 21:18:20.667126 ncdv-master-1 devstack@n-api.service[138744]: {"restore": {}} Oct 22 21:18:20.667126 ncdv-master-1 devstack@n-api.service[138744]: method: > Oct 22 21:18:20.667126 ncdv-master-1 devstack@n-api.service[138744]: exception: Instance 155cdda7-4b60-4bd8-b051-c6fcc23600fe could not be found. Oct 22 21:18:20.667126 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': '155cdda7-4b60-4bd8-b051-c6fcc23600fe', 'body': {'restore': {}}} Oct 22 21:18:20.667126 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:18:20.667126 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:18:20.667126 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 21:18:20.667126 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 21:18:20.667126 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 21:18:20.667126 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 21:18:20.667126 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 22 21:18:20.667126 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 22 21:18:20.667126 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 155cdda7-4b60-4bd8-b051-c6fcc23600fe could not be found. Oct 22 21:18:20.667126 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:18:20.667126 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:18:20.667126 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:18:20.667126 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:18:20.667126 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:18:20.667126 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:18:20.667126 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:18:20.667126 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:18:20.667126 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:18:20.667126 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:18:20.667126 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 38, in _restore Oct 22 21:18:20.667126 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 22 21:18:20.667126 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 21:18:20.667126 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:18:20.667126 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 155cdda7-4b60-4bd8-b051-c6fcc23600fe could not be found. Oct 22 21:18:20.667126 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:18:20.667126 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:18:20.667126 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:18:20.667126 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:18:20.667126 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:18:20.667126 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:18:20.671506 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:18:20.671506 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:18:20.671506 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 155cdda7-4b60-4bd8-b051-c6fcc23600fe could not be found. Oct 22 21:18:20.671506 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:18:20.671506 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-fe509103-cc16-48f4-8553-a43a266bf40f tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Returning 404 to user: Instance 155cdda7-4b60-4bd8-b051-c6fcc23600fe could not be found. {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:18:20.671506 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-fe509103-cc16-48f4-8553-a43a266bf40f tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] 10.222.0.18 "POST /compute/v2.1/servers/155cdda7-4b60-4bd8-b051-c6fcc23600fe/action" status: 404 len: 111 microversion: 2.1 time: 0.013418 Oct 22 21:18:20.671506 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2588/5191] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 21:18:20 2022] POST /compute/v2.1/servers/155cdda7-4b60-4bd8-b051-c6fcc23600fe/action => generated 111 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 21:18:20.678061 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-c159eec8-1626-4338-a53a-b66ba43d5f96 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:18:20.678686 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-c159eec8-1626-4338-a53a-b66ba43d5f96 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] [instance: 3de67bb0-04d9-4d3a-a925-102f04d677bb] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:18:20.685089 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c159eec8-1626-4338-a53a-b66ba43d5f96 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:18:20.685606 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c159eec8-1626-4338-a53a-b66ba43d5f96 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:18:20.686058 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c159eec8-1626-4338-a53a-b66ba43d5f96 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:18:20.686765 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c159eec8-1626-4338-a53a-b66ba43d5f96 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:18:20.687231 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c159eec8-1626-4338-a53a-b66ba43d5f96 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:18:20.687692 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c159eec8-1626-4338-a53a-b66ba43d5f96 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:18:20.864233 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-c159eec8-1626-4338-a53a-b66ba43d5f96 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a9229e7da421b9e0e6f7df52f71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28af724189a24022b3ef7651b7157a9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:18:20.873737 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-c159eec8-1626-4338-a53a-b66ba43d5f96 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] 10.222.0.18 "GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb" status: 200 len: 1507 microversion: 2.1 time: 0.199408 Oct 22 21:18:20.874310 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2604/5192] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:18:20 2022] GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb => generated 1507 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:18:20.899155 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-e137575e-8c29-4bd0-b9f3-dd405c60dd6d tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:18:20.899809 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-e137575e-8c29-4bd0-b9f3-dd405c60dd6d tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] [instance: 3de67bb0-04d9-4d3a-a925-102f04d677bb] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:18:20.907186 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e137575e-8c29-4bd0-b9f3-dd405c60dd6d tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:18:20.907790 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e137575e-8c29-4bd0-b9f3-dd405c60dd6d tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:18:20.908241 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e137575e-8c29-4bd0-b9f3-dd405c60dd6d tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:18:20.909106 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e137575e-8c29-4bd0-b9f3-dd405c60dd6d tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:18:20.909652 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e137575e-8c29-4bd0-b9f3-dd405c60dd6d tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:18:20.910093 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e137575e-8c29-4bd0-b9f3-dd405c60dd6d tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:18:21.151144 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-e137575e-8c29-4bd0-b9f3-dd405c60dd6d tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a9229e7da421b9e0e6f7df52f71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28af724189a24022b3ef7651b7157a9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:18:21.166214 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-e137575e-8c29-4bd0-b9f3-dd405c60dd6d tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] 10.222.0.18 "GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb" status: 200 len: 1507 microversion: 2.1 time: 0.270854 Oct 22 21:18:21.167321 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2589/5193] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:18:20 2022] GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb => generated 1507 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:18:21.193020 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-0f73a894-b5d3-4b86-89ea-a8d96dd3a54d tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:18:21.193585 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-0f73a894-b5d3-4b86-89ea-a8d96dd3a54d tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] [instance: 3de67bb0-04d9-4d3a-a925-102f04d677bb] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:18:21.200890 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0f73a894-b5d3-4b86-89ea-a8d96dd3a54d tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:18:21.201578 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0f73a894-b5d3-4b86-89ea-a8d96dd3a54d tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:18:21.202387 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0f73a894-b5d3-4b86-89ea-a8d96dd3a54d tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:18:21.203301 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0f73a894-b5d3-4b86-89ea-a8d96dd3a54d tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:18:21.204769 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0f73a894-b5d3-4b86-89ea-a8d96dd3a54d tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:18:21.205402 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0f73a894-b5d3-4b86-89ea-a8d96dd3a54d tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:18:21.233045 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.wsgi [None req-0f73a894-b5d3-4b86-89ea-a8d96dd3a54d tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] HTTP exception thrown: Cannot 'restore' instance 3de67bb0-04d9-4d3a-a925-102f04d677bb while it is in vm_state active Oct 22 21:18:21.235378 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-0f73a894-b5d3-4b86-89ea-a8d96dd3a54d tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Request method failure captured: Oct 22 21:18:21.235378 ncdv-master-1 devstack@n-api.service[138745]: request: POST /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb/action HTTP/1.1 Oct 22 21:18:21.235378 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 21:18:21.235378 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 21:18:21.235378 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 21:18:21.235378 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 15 Oct 22 21:18:21.235378 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 21:18:21.235378 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 21:18:21.235378 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 21:18:21.235378 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 21:18:21.235378 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVF3hm7PiLG1R8Tw2syJVqR4znaBscty3weljpQpv2aVSYokkqaFvTxJu_8ZsVDxnVWNFBjrkTk4hem6vgNXmexe0yUI_M8pHEKoh5CWO6b1coilxRZ6VgX94mIL_xf6l3t9Q4mcnT856zV-XemvxZab0Ooy1ChU21L_her9Zn74z_zU Oct 22 21:18:21.235378 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 21:18:21.235378 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 21:18:21.235378 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 21:18:21.235378 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 21:18:21.235378 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 21:18:21.235378 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 21:18:21.235378 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: 28af724189a24022b3ef7651b7157a9d Oct 22 21:18:21.235378 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-ServersNegativeTestJSON-766586991 Oct 22 21:18:21.235378 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 21:18:21.235378 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 21:18:21.235378 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_28af724189a24022b3ef7651b7157a9d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/28af724189a24022b3ef7651b7157a9d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/28af724189a24022b3ef7651b7157a9d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/28af724189a24022b3ef7651b7157a9d"}]}] Oct 22 21:18:21.235378 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-ServersNegativeTestJSON-766586991 Oct 22 21:18:21.235378 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: 28af724189a24022b3ef7651b7157a9d Oct 22 21:18:21.235378 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-ServersNegativeTestJSON-766586991 Oct 22 21:18:21.235378 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-ServersNegativeTestJSON-766586991-project Oct 22 21:18:21.235378 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 21:18:21.235378 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 21:18:21.235378 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: 6c8a9229e7da421b9e0e6f7df52f71e2 Oct 22 21:18:21.235378 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-ServersNegativeTestJSON-766586991-project Oct 22 21:18:21.235378 ncdv-master-1 devstack@n-api.service[138745]: Oct 22 21:18:21.235378 ncdv-master-1 devstack@n-api.service[138745]: {"restore": {}} Oct 22 21:18:21.235378 ncdv-master-1 devstack@n-api.service[138745]: method: > Oct 22 21:18:21.235378 ncdv-master-1 devstack@n-api.service[138745]: exception: Cannot 'restore' instance 3de67bb0-04d9-4d3a-a925-102f04d677bb while it is in vm_state active Oct 22 21:18:21.235378 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'id': '3de67bb0-04d9-4d3a-a925-102f04d677bb', 'body': {'restore': {}}} Oct 22 21:18:21.235378 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:18:21.235378 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:18:21.235378 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 42, in _restore Oct 22 21:18:21.235378 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi self.compute_api.restore(context, instance) Oct 22 21:18:21.235378 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 22 21:18:21.235378 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 22 21:18:21.235378 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 22 21:18:21.235378 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 22 21:18:21.235378 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 3de67bb0-04d9-4d3a-a925-102f04d677bb in vm_state active. Cannot restore while the instance is in this state. Oct 22 21:18:21.235378 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:18:21.235378 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:18:21.235378 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:18:21.235378 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:18:21.235378 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:18:21.235378 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:18:21.235378 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:18:21.235378 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:18:21.235378 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:18:21.235378 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:18:21.235378 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 46, in _restore Oct 22 21:18:21.235378 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 22 21:18:21.235378 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 22 21:18:21.235378 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 22 21:18:21.235378 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'restore' instance 3de67bb0-04d9-4d3a-a925-102f04d677bb while it is in vm_state active Oct 22 21:18:21.235378 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:18:21.235378 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:18:21.235378 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:18:21.235378 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:18:21.235378 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:18:21.240584 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:18:21.240584 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:18:21.240584 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:18:21.240584 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'restore' instance 3de67bb0-04d9-4d3a-a925-102f04d677bb while it is in vm_state active Oct 22 21:18:21.240584 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:18:21.243362 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-0f73a894-b5d3-4b86-89ea-a8d96dd3a54d tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Returning 409 to user: Cannot 'restore' instance 3de67bb0-04d9-4d3a-a925-102f04d677bb while it is in vm_state active {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:18:21.244348 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-0f73a894-b5d3-4b86-89ea-a8d96dd3a54d tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] 10.222.0.18 "POST /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb/action" status: 409 len: 145 microversion: 2.1 time: 0.055461 Oct 22 21:18:21.245095 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2605/5194] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 21:18:21 2022] POST /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb/action => generated 145 bytes in 57 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 22 21:18:21.254011 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-53052c1e-c796-4f40-9434-8b12cd1b95ec tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:18:21.254826 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-53052c1e-c796-4f40-9434-8b12cd1b95ec tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] [instance: 3de67bb0-04d9-4d3a-a925-102f04d677bb] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:18:21.261466 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-53052c1e-c796-4f40-9434-8b12cd1b95ec tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:18:21.261960 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-53052c1e-c796-4f40-9434-8b12cd1b95ec tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:18:21.262399 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-53052c1e-c796-4f40-9434-8b12cd1b95ec tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:18:21.263107 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-53052c1e-c796-4f40-9434-8b12cd1b95ec tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:18:21.263610 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-53052c1e-c796-4f40-9434-8b12cd1b95ec tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:18:21.264047 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-53052c1e-c796-4f40-9434-8b12cd1b95ec tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:18:21.405879 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-53052c1e-c796-4f40-9434-8b12cd1b95ec tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a9229e7da421b9e0e6f7df52f71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28af724189a24022b3ef7651b7157a9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:18:21.414718 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-53052c1e-c796-4f40-9434-8b12cd1b95ec tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] 10.222.0.18 "GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb" status: 200 len: 1507 microversion: 2.1 time: 0.165203 Oct 22 21:18:21.415556 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2590/5195] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:18:21 2022] GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb => generated 1507 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:18:21.440308 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-6ac82d7a-ec48-4483-b187-9a8e077309ac tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:18:21.440914 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-6ac82d7a-ec48-4483-b187-9a8e077309ac tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] [instance: 3de67bb0-04d9-4d3a-a925-102f04d677bb] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:18:21.447102 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6ac82d7a-ec48-4483-b187-9a8e077309ac tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:18:21.447639 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6ac82d7a-ec48-4483-b187-9a8e077309ac tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:18:21.448271 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6ac82d7a-ec48-4483-b187-9a8e077309ac tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:18:21.448989 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6ac82d7a-ec48-4483-b187-9a8e077309ac tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:18:21.449489 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6ac82d7a-ec48-4483-b187-9a8e077309ac tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:18:21.449924 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6ac82d7a-ec48-4483-b187-9a8e077309ac tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:18:21.607109 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-6ac82d7a-ec48-4483-b187-9a8e077309ac tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a9229e7da421b9e0e6f7df52f71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28af724189a24022b3ef7651b7157a9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:18:21.632539 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-6ac82d7a-ec48-4483-b187-9a8e077309ac tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] 10.222.0.18 "GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb" status: 200 len: 1507 microversion: 2.1 time: 0.194908 Oct 22 21:18:21.633699 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2606/5196] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:18:21 2022] GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb => generated 1507 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:18:21.659124 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-95846ccd-3ee6-4c8e-a856-b1bed5a7c440 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:18:21.659748 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-95846ccd-3ee6-4c8e-a856-b1bed5a7c440 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] [instance: 527e8c68-0bca-458e-a5bb-8a62f163478f] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:18:21.666680 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-95846ccd-3ee6-4c8e-a856-b1bed5a7c440 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] HTTP exception thrown: Instance 527e8c68-0bca-458e-a5bb-8a62f163478f could not be found. Oct 22 21:18:21.678587 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-95846ccd-3ee6-4c8e-a856-b1bed5a7c440 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Request method failure captured: Oct 22 21:18:21.678587 ncdv-master-1 devstack@n-api.service[138744]: request: POST /compute/v2.1/servers/527e8c68-0bca-458e-a5bb-8a62f163478f/action HTTP/1.1 Oct 22 21:18:21.678587 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 21:18:21.678587 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 21:18:21.678587 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 21:18:21.678587 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 14 Oct 22 21:18:21.678587 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 21:18:21.678587 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 21:18:21.678587 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 21:18:21.678587 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 21:18:21.678587 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVF3hm7PiLG1R8Tw2syJVqR4znaBscty3weljpQpv2aVSYokkqaFvTxJu_8ZsVDxnVWNFBjrkTk4hem6vgNXmexe0yUI_M8pHEKoh5CWO6b1coilxRZ6VgX94mIL_xf6l3t9Q4mcnT856zV-XemvxZab0Ooy1ChU21L_her9Zn74z_zU Oct 22 21:18:21.678587 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 21:18:21.678587 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 21:18:21.678587 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 21:18:21.678587 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 21:18:21.678587 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 21:18:21.678587 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 21:18:21.678587 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: 28af724189a24022b3ef7651b7157a9d Oct 22 21:18:21.678587 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-ServersNegativeTestJSON-766586991 Oct 22 21:18:21.678587 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 21:18:21.678587 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 21:18:21.678587 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_28af724189a24022b3ef7651b7157a9d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/28af724189a24022b3ef7651b7157a9d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/28af724189a24022b3ef7651b7157a9d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/28af724189a24022b3ef7651b7157a9d"}]}] Oct 22 21:18:21.678587 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-ServersNegativeTestJSON-766586991 Oct 22 21:18:21.678587 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: 28af724189a24022b3ef7651b7157a9d Oct 22 21:18:21.678587 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-ServersNegativeTestJSON-766586991 Oct 22 21:18:21.678587 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-ServersNegativeTestJSON-766586991-project Oct 22 21:18:21.678587 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 21:18:21.678587 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 21:18:21.678587 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: 6c8a9229e7da421b9e0e6f7df52f71e2 Oct 22 21:18:21.678587 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-ServersNegativeTestJSON-766586991-project Oct 22 21:18:21.678587 ncdv-master-1 devstack@n-api.service[138744]: Oct 22 21:18:21.678587 ncdv-master-1 devstack@n-api.service[138744]: {"resume": {}} Oct 22 21:18:21.678587 ncdv-master-1 devstack@n-api.service[138744]: method: > Oct 22 21:18:21.678587 ncdv-master-1 devstack@n-api.service[138744]: exception: Instance 527e8c68-0bca-458e-a5bb-8a62f163478f could not be found. Oct 22 21:18:21.678587 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': '527e8c68-0bca-458e-a5bb-8a62f163478f', 'body': {'resume': {}}} Oct 22 21:18:21.678587 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:18:21.678587 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:18:21.678587 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 21:18:21.678587 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 21:18:21.678587 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 21:18:21.678587 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 21:18:21.678587 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 22 21:18:21.678587 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 22 21:18:21.678587 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 527e8c68-0bca-458e-a5bb-8a62f163478f could not be found. Oct 22 21:18:21.678587 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:18:21.678587 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:18:21.678587 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:18:21.678587 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:18:21.678587 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:18:21.678587 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:18:21.678587 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:18:21.678587 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:18:21.678587 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:18:21.678587 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:18:21.678587 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 55, in _resume Oct 22 21:18:21.678587 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Oct 22 21:18:21.678587 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 21:18:21.678587 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:18:21.678587 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 527e8c68-0bca-458e-a5bb-8a62f163478f could not be found. Oct 22 21:18:21.678587 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:18:21.678587 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:18:21.678587 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:18:21.678587 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:18:21.678587 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:18:21.678587 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:18:21.683186 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:18:21.683186 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:18:21.683186 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 527e8c68-0bca-458e-a5bb-8a62f163478f could not be found. Oct 22 21:18:21.683186 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:18:21.683186 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-95846ccd-3ee6-4c8e-a856-b1bed5a7c440 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Returning 404 to user: Instance 527e8c68-0bca-458e-a5bb-8a62f163478f could not be found. {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:18:21.683721 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-95846ccd-3ee6-4c8e-a856-b1bed5a7c440 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] 10.222.0.18 "POST /compute/v2.1/servers/527e8c68-0bca-458e-a5bb-8a62f163478f/action" status: 404 len: 111 microversion: 2.1 time: 0.028976 Oct 22 21:18:21.684480 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2591/5197] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 21:18:21 2022] POST /compute/v2.1/servers/527e8c68-0bca-458e-a5bb-8a62f163478f/action => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 21:18:21.694818 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-7798caf2-c098-4fc2-aad9-30e5beaf30e9 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:18:21.695783 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-7798caf2-c098-4fc2-aad9-30e5beaf30e9 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] [instance: 3de67bb0-04d9-4d3a-a925-102f04d677bb] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:18:21.702330 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7798caf2-c098-4fc2-aad9-30e5beaf30e9 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:18:21.703004 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7798caf2-c098-4fc2-aad9-30e5beaf30e9 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:18:21.703576 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7798caf2-c098-4fc2-aad9-30e5beaf30e9 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:18:21.704732 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7798caf2-c098-4fc2-aad9-30e5beaf30e9 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:18:21.706877 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7798caf2-c098-4fc2-aad9-30e5beaf30e9 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:18:21.707826 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7798caf2-c098-4fc2-aad9-30e5beaf30e9 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:18:21.874704 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-7798caf2-c098-4fc2-aad9-30e5beaf30e9 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a9229e7da421b9e0e6f7df52f71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28af724189a24022b3ef7651b7157a9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:18:21.883029 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-7798caf2-c098-4fc2-aad9-30e5beaf30e9 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] 10.222.0.18 "GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb" status: 200 len: 1507 microversion: 2.1 time: 0.193670 Oct 22 21:18:21.883648 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2607/5198] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:18:21 2022] GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb => generated 1507 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:18:21.906942 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-bbadc2c9-a7ea-4adf-94e8-81b549eed3c6 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:18:21.907619 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-bbadc2c9-a7ea-4adf-94e8-81b549eed3c6 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] [instance: 3de67bb0-04d9-4d3a-a925-102f04d677bb] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:18:21.915899 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bbadc2c9-a7ea-4adf-94e8-81b549eed3c6 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:18:21.916341 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bbadc2c9-a7ea-4adf-94e8-81b549eed3c6 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:18:21.916780 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bbadc2c9-a7ea-4adf-94e8-81b549eed3c6 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:18:21.917513 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bbadc2c9-a7ea-4adf-94e8-81b549eed3c6 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:18:21.917968 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bbadc2c9-a7ea-4adf-94e8-81b549eed3c6 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:18:21.918572 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bbadc2c9-a7ea-4adf-94e8-81b549eed3c6 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:18:22.066972 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-bbadc2c9-a7ea-4adf-94e8-81b549eed3c6 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a9229e7da421b9e0e6f7df52f71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28af724189a24022b3ef7651b7157a9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:18:22.075255 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-bbadc2c9-a7ea-4adf-94e8-81b549eed3c6 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] 10.222.0.18 "GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb" status: 200 len: 1507 microversion: 2.1 time: 0.172342 Oct 22 21:18:22.075890 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2592/5199] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:18:21 2022] GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb => generated 1507 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:18:22.098030 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-e6074278-6bc8-483a-8364-91429ed966e1 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:18:22.098578 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-e6074278-6bc8-483a-8364-91429ed966e1 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] [instance: 3de67bb0-04d9-4d3a-a925-102f04d677bb] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:18:22.105161 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e6074278-6bc8-483a-8364-91429ed966e1 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:18:22.105667 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e6074278-6bc8-483a-8364-91429ed966e1 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:18:22.106123 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e6074278-6bc8-483a-8364-91429ed966e1 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:18:22.106839 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e6074278-6bc8-483a-8364-91429ed966e1 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:18:22.107312 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e6074278-6bc8-483a-8364-91429ed966e1 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:18:22.107778 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e6074278-6bc8-483a-8364-91429ed966e1 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:18:22.134743 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.wsgi [None req-e6074278-6bc8-483a-8364-91429ed966e1 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] HTTP exception thrown: Cannot 'resume' instance 3de67bb0-04d9-4d3a-a925-102f04d677bb while it is in vm_state active Oct 22 21:18:22.136844 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-e6074278-6bc8-483a-8364-91429ed966e1 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Request method failure captured: Oct 22 21:18:22.136844 ncdv-master-1 devstack@n-api.service[138745]: request: POST /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb/action HTTP/1.1 Oct 22 21:18:22.136844 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 21:18:22.136844 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 21:18:22.136844 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 21:18:22.136844 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 14 Oct 22 21:18:22.136844 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 21:18:22.136844 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 21:18:22.136844 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 21:18:22.136844 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 21:18:22.136844 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVF3hm7PiLG1R8Tw2syJVqR4znaBscty3weljpQpv2aVSYokkqaFvTxJu_8ZsVDxnVWNFBjrkTk4hem6vgNXmexe0yUI_M8pHEKoh5CWO6b1coilxRZ6VgX94mIL_xf6l3t9Q4mcnT856zV-XemvxZab0Ooy1ChU21L_her9Zn74z_zU Oct 22 21:18:22.136844 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 21:18:22.136844 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 21:18:22.136844 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 21:18:22.136844 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 21:18:22.136844 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 21:18:22.136844 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 21:18:22.136844 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: 28af724189a24022b3ef7651b7157a9d Oct 22 21:18:22.136844 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-ServersNegativeTestJSON-766586991 Oct 22 21:18:22.136844 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 21:18:22.136844 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 21:18:22.136844 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_28af724189a24022b3ef7651b7157a9d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/28af724189a24022b3ef7651b7157a9d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/28af724189a24022b3ef7651b7157a9d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/28af724189a24022b3ef7651b7157a9d"}]}] Oct 22 21:18:22.136844 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-ServersNegativeTestJSON-766586991 Oct 22 21:18:22.136844 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: 28af724189a24022b3ef7651b7157a9d Oct 22 21:18:22.136844 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-ServersNegativeTestJSON-766586991 Oct 22 21:18:22.136844 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-ServersNegativeTestJSON-766586991-project Oct 22 21:18:22.136844 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 21:18:22.136844 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 21:18:22.136844 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: 6c8a9229e7da421b9e0e6f7df52f71e2 Oct 22 21:18:22.136844 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-ServersNegativeTestJSON-766586991-project Oct 22 21:18:22.136844 ncdv-master-1 devstack@n-api.service[138745]: Oct 22 21:18:22.136844 ncdv-master-1 devstack@n-api.service[138745]: {"resume": {}} Oct 22 21:18:22.136844 ncdv-master-1 devstack@n-api.service[138745]: method: > Oct 22 21:18:22.136844 ncdv-master-1 devstack@n-api.service[138745]: exception: Cannot 'resume' instance 3de67bb0-04d9-4d3a-a925-102f04d677bb while it is in vm_state active Oct 22 21:18:22.136844 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'id': '3de67bb0-04d9-4d3a-a925-102f04d677bb', 'body': {'resume': {}}} Oct 22 21:18:22.136844 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:18:22.136844 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:18:22.136844 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 59, in _resume Oct 22 21:18:22.136844 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi self.compute_api.resume(context, server) Oct 22 21:18:22.136844 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 22 21:18:22.136844 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 22 21:18:22.136844 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 22 21:18:22.136844 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 22 21:18:22.136844 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 22 21:18:22.136844 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 22 21:18:22.136844 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 3de67bb0-04d9-4d3a-a925-102f04d677bb in vm_state active. Cannot resume while the instance is in this state. Oct 22 21:18:22.136844 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:18:22.136844 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:18:22.136844 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:18:22.136844 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:18:22.136844 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:18:22.136844 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:18:22.136844 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:18:22.136844 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:18:22.136844 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:18:22.136844 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:18:22.136844 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 63, in _resume Oct 22 21:18:22.136844 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 22 21:18:22.136844 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 22 21:18:22.136844 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 22 21:18:22.136844 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'resume' instance 3de67bb0-04d9-4d3a-a925-102f04d677bb while it is in vm_state active Oct 22 21:18:22.136844 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:18:22.136844 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:18:22.136844 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:18:22.141147 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:18:22.141147 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:18:22.141147 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:18:22.141147 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:18:22.141147 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:18:22.141147 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'resume' instance 3de67bb0-04d9-4d3a-a925-102f04d677bb while it is in vm_state active Oct 22 21:18:22.141147 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:18:22.141147 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-e6074278-6bc8-483a-8364-91429ed966e1 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Returning 409 to user: Cannot 'resume' instance 3de67bb0-04d9-4d3a-a925-102f04d677bb while it is in vm_state active {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:18:22.141147 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-e6074278-6bc8-483a-8364-91429ed966e1 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] 10.222.0.18 "POST /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb/action" status: 409 len: 144 microversion: 2.1 time: 0.044415 Oct 22 21:18:22.142270 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2608/5200] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 21:18:22 2022] POST /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb/action => generated 144 bytes in 49 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 22 21:18:22.147646 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-a9d28e38-338e-4f29-9425-c36970e4dd0e tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:18:22.148260 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-a9d28e38-338e-4f29-9425-c36970e4dd0e tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] [instance: 3de67bb0-04d9-4d3a-a925-102f04d677bb] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:18:22.155778 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a9d28e38-338e-4f29-9425-c36970e4dd0e tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:18:22.156413 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a9d28e38-338e-4f29-9425-c36970e4dd0e tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:18:22.156716 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a9d28e38-338e-4f29-9425-c36970e4dd0e tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:18:22.157530 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a9d28e38-338e-4f29-9425-c36970e4dd0e tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:18:22.158065 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a9d28e38-338e-4f29-9425-c36970e4dd0e tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:18:22.158680 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a9d28e38-338e-4f29-9425-c36970e4dd0e tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:18:22.307239 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-a9d28e38-338e-4f29-9425-c36970e4dd0e tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a9229e7da421b9e0e6f7df52f71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28af724189a24022b3ef7651b7157a9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:18:22.329619 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-a9d28e38-338e-4f29-9425-c36970e4dd0e tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] 10.222.0.18 "GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb" status: 200 len: 1507 microversion: 2.1 time: 0.186077 Oct 22 21:18:22.332857 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2593/5201] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:18:22 2022] GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb => generated 1507 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:18:22.356248 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-0c184682-1918-4881-aeed-a98807e0b16e tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:18:22.357443 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-0c184682-1918-4881-aeed-a98807e0b16e tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] [instance: 3de67bb0-04d9-4d3a-a925-102f04d677bb] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:18:22.365352 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0c184682-1918-4881-aeed-a98807e0b16e tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:18:22.366406 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0c184682-1918-4881-aeed-a98807e0b16e tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:18:22.367058 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0c184682-1918-4881-aeed-a98807e0b16e tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:18:22.367978 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0c184682-1918-4881-aeed-a98807e0b16e tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:18:22.368601 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0c184682-1918-4881-aeed-a98807e0b16e tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:18:22.369252 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0c184682-1918-4881-aeed-a98807e0b16e tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:18:22.588080 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-0c184682-1918-4881-aeed-a98807e0b16e tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a9229e7da421b9e0e6f7df52f71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28af724189a24022b3ef7651b7157a9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:18:22.599178 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-0c184682-1918-4881-aeed-a98807e0b16e tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] 10.222.0.18 "GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb" status: 200 len: 1507 microversion: 2.1 time: 0.247156 Oct 22 21:18:22.600488 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2609/5202] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:18:22 2022] GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb => generated 1507 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:18:22.677134 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-8d792cc0-9dd5-4c3e-8a58-0e28df7270f1 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Action: 'create', calling method: >, body: {"server": {"name": "", "imageRef": "085e4478-6edc-4a69-8e08-f9831713eb65", "flavorRef": "452", "networks": [{"uuid": "b17a38c5-877b-428d-bd53-e74609d155b2"}]}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:18:22.681092 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-8d792cc0-9dd5-4c3e-8a58-0e28df7270f1 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Request method failure captured: Oct 22 21:18:22.681092 ncdv-master-1 devstack@n-api.service[138744]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 22 21:18:22.681092 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 21:18:22.681092 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 21:18:22.681092 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 21:18:22.681092 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 160 Oct 22 21:18:22.681092 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 21:18:22.681092 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 21:18:22.681092 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 21:18:22.681092 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 21:18:22.681092 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVF3hm7PiLG1R8Tw2syJVqR4znaBscty3weljpQpv2aVSYokkqaFvTxJu_8ZsVDxnVWNFBjrkTk4hem6vgNXmexe0yUI_M8pHEKoh5CWO6b1coilxRZ6VgX94mIL_xf6l3t9Q4mcnT856zV-XemvxZab0Ooy1ChU21L_her9Zn74z_zU Oct 22 21:18:22.681092 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 21:18:22.681092 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 21:18:22.681092 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 21:18:22.681092 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 21:18:22.681092 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 21:18:22.681092 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 21:18:22.681092 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: 28af724189a24022b3ef7651b7157a9d Oct 22 21:18:22.681092 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-ServersNegativeTestJSON-766586991 Oct 22 21:18:22.681092 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 21:18:22.681092 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 21:18:22.681092 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_28af724189a24022b3ef7651b7157a9d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/28af724189a24022b3ef7651b7157a9d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/28af724189a24022b3ef7651b7157a9d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/28af724189a24022b3ef7651b7157a9d"}]}] Oct 22 21:18:22.681092 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-ServersNegativeTestJSON-766586991 Oct 22 21:18:22.681092 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: 28af724189a24022b3ef7651b7157a9d Oct 22 21:18:22.681092 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-ServersNegativeTestJSON-766586991 Oct 22 21:18:22.681092 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-ServersNegativeTestJSON-766586991-project Oct 22 21:18:22.681092 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 21:18:22.681092 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 21:18:22.681092 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: 6c8a9229e7da421b9e0e6f7df52f71e2 Oct 22 21:18:22.681092 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-ServersNegativeTestJSON-766586991-project Oct 22 21:18:22.681092 ncdv-master-1 devstack@n-api.service[138744]: Oct 22 21:18:22.681092 ncdv-master-1 devstack@n-api.service[138744]: {"server": {"name": "", "imageRef": "085e4478-6edc-4a69-8e08-f9831713eb65", "flavorRef": "452", "networks": [{"uuid": "b17a38c5-877b-428d-bd53-e74609d155b2"}]}} Oct 22 21:18:22.681092 ncdv-master-1 devstack@n-api.service[138744]: method: > Oct 22 21:18:22.681092 ncdv-master-1 devstack@n-api.service[138744]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 22 21:18:22.681092 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'body': {'server': {'name': '', 'imageRef': '085e4478-6edc-4a69-8e08-f9831713eb65', 'flavorRef': '452', 'networks': [{'uuid': 'b17a38c5-877b-428d-bd53-e74609d155b2'}]}}} Oct 22 21:18:22.681092 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:18:22.681092 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:18:22.681092 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 22 21:18:22.681092 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 22 21:18:22.681092 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 22 21:18:22.681092 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise error Oct 22 21:18:22.681092 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 22 21:18:22.681092 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:18:22.681092 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Oct 22 21:18:22.681092 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 22 21:18:22.681092 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:18:22.681092 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 22 21:18:22.681092 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi '' Oct 22 21:18:22.681092 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:18:22.681092 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:18:22.681092 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:18:22.681092 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:18:22.681092 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:18:22.681092 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:18:22.681092 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:18:22.681092 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:18:22.681092 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:18:22.681092 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:18:22.681092 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 21:18:22.681092 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 21:18:22.681092 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 22 21:18:22.681092 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 22 21:18:22.681092 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 22 21:18:22.681092 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 22 21:18:22.681092 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 22 21:18:22.685933 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 22 21:18:22.685933 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 22 21:18:22.685933 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:18:22.685933 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:18:22.685933 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:18:22.685933 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:18:22.685933 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:18:22.685933 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:18:22.685933 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 22 21:18:22.685933 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 22 21:18:22.685933 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 22 21:18:22.685933 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:18:22.685933 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-8d792cc0-9dd5-4c3e-8a58-0e28df7270f1 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:18:22.688642 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-8d792cc0-9dd5-4c3e-8a58-0e28df7270f1 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 400 len: 108 microversion: 2.1 time: 0.010598 Oct 22 21:18:22.689604 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2594/5203] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Oct 22 21:18:22 2022] POST /compute/v2.1/servers => generated 108 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 22 21:18:22.721500 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-270bfad7-34aa-441e-a11b-80d7c636b7ca tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:18:22.727068 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-270bfad7-34aa-441e-a11b-80d7c636b7ca tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] [instance: 3de67bb0-04d9-4d3a-a925-102f04d677bb] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:18:22.737782 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-270bfad7-34aa-441e-a11b-80d7c636b7ca tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:18:22.738512 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-270bfad7-34aa-441e-a11b-80d7c636b7ca tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:18:22.739138 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-270bfad7-34aa-441e-a11b-80d7c636b7ca tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:18:22.740880 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-270bfad7-34aa-441e-a11b-80d7c636b7ca tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:18:22.741772 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-270bfad7-34aa-441e-a11b-80d7c636b7ca tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:18:22.742380 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-270bfad7-34aa-441e-a11b-80d7c636b7ca tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:18:22.932428 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-270bfad7-34aa-441e-a11b-80d7c636b7ca tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a9229e7da421b9e0e6f7df52f71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28af724189a24022b3ef7651b7157a9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:18:22.941793 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-270bfad7-34aa-441e-a11b-80d7c636b7ca tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] 10.222.0.18 "GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb" status: 200 len: 1507 microversion: 2.1 time: 0.233883 Oct 22 21:18:22.942855 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2610/5204] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:18:22 2022] GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb => generated 1507 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:18:22.971388 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-68adab00-dfc6-40d4-9ace-6f7d74bfc78f tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:18:22.971931 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-68adab00-dfc6-40d4-9ace-6f7d74bfc78f tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] [instance: 3de67bb0-04d9-4d3a-a925-102f04d677bb] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:18:22.980843 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-68adab00-dfc6-40d4-9ace-6f7d74bfc78f tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:18:22.981345 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-68adab00-dfc6-40d4-9ace-6f7d74bfc78f tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:18:22.981798 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-68adab00-dfc6-40d4-9ace-6f7d74bfc78f tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:18:22.982516 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-68adab00-dfc6-40d4-9ace-6f7d74bfc78f tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:18:22.982971 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-68adab00-dfc6-40d4-9ace-6f7d74bfc78f tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:18:22.983420 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-68adab00-dfc6-40d4-9ace-6f7d74bfc78f tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:18:23.158105 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-68adab00-dfc6-40d4-9ace-6f7d74bfc78f tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a9229e7da421b9e0e6f7df52f71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28af724189a24022b3ef7651b7157a9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:18:23.174425 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-68adab00-dfc6-40d4-9ace-6f7d74bfc78f tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] 10.222.0.18 "GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb" status: 200 len: 1507 microversion: 2.1 time: 0.212045 Oct 22 21:18:23.175103 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2595/5205] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:18:22 2022] GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb => generated 1507 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:18:23.199118 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-9b99fd17-f171-45c1-9f27-b0fc8876145d tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:18:23.199855 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-9b99fd17-f171-45c1-9f27-b0fc8876145d tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] [instance: 73f16d6a-4dcb-4fa4-8046-b104176d5062] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:18:23.207151 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.wsgi [None req-9b99fd17-f171-45c1-9f27-b0fc8876145d tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] HTTP exception thrown: Instance 73f16d6a-4dcb-4fa4-8046-b104176d5062 could not be found. Oct 22 21:18:23.216003 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-9b99fd17-f171-45c1-9f27-b0fc8876145d tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Request method failure captured: Oct 22 21:18:23.216003 ncdv-master-1 devstack@n-api.service[138745]: request: POST /compute/v2.1/servers/73f16d6a-4dcb-4fa4-8046-b104176d5062/action HTTP/1.1 Oct 22 21:18:23.216003 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 21:18:23.216003 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 21:18:23.216003 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 21:18:23.216003 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 14 Oct 22 21:18:23.216003 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 21:18:23.216003 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 21:18:23.216003 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 21:18:23.216003 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 21:18:23.216003 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVF3hm7PiLG1R8Tw2syJVqR4znaBscty3weljpQpv2aVSYokkqaFvTxJu_8ZsVDxnVWNFBjrkTk4hem6vgNXmexe0yUI_M8pHEKoh5CWO6b1coilxRZ6VgX94mIL_xf6l3t9Q4mcnT856zV-XemvxZab0Ooy1ChU21L_her9Zn74z_zU Oct 22 21:18:23.216003 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 21:18:23.216003 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 21:18:23.216003 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 21:18:23.216003 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 21:18:23.216003 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 21:18:23.216003 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 21:18:23.216003 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: 28af724189a24022b3ef7651b7157a9d Oct 22 21:18:23.216003 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-ServersNegativeTestJSON-766586991 Oct 22 21:18:23.216003 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 21:18:23.216003 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 21:18:23.216003 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_28af724189a24022b3ef7651b7157a9d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/28af724189a24022b3ef7651b7157a9d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/28af724189a24022b3ef7651b7157a9d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/28af724189a24022b3ef7651b7157a9d"}]}] Oct 22 21:18:23.216003 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-ServersNegativeTestJSON-766586991 Oct 22 21:18:23.216003 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: 28af724189a24022b3ef7651b7157a9d Oct 22 21:18:23.216003 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-ServersNegativeTestJSON-766586991 Oct 22 21:18:23.216003 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-ServersNegativeTestJSON-766586991-project Oct 22 21:18:23.216003 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 21:18:23.216003 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 21:18:23.216003 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: 6c8a9229e7da421b9e0e6f7df52f71e2 Oct 22 21:18:23.216003 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-ServersNegativeTestJSON-766586991-project Oct 22 21:18:23.216003 ncdv-master-1 devstack@n-api.service[138745]: Oct 22 21:18:23.216003 ncdv-master-1 devstack@n-api.service[138745]: {"shelve": {}} Oct 22 21:18:23.216003 ncdv-master-1 devstack@n-api.service[138745]: method: > Oct 22 21:18:23.216003 ncdv-master-1 devstack@n-api.service[138745]: exception: Instance 73f16d6a-4dcb-4fa4-8046-b104176d5062 could not be found. Oct 22 21:18:23.216003 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'id': '73f16d6a-4dcb-4fa4-8046-b104176d5062', 'body': {'shelve': {}}} Oct 22 21:18:23.216003 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:18:23.216003 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:18:23.216003 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 21:18:23.216003 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 21:18:23.216003 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 21:18:23.216003 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 21:18:23.216003 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 22 21:18:23.216003 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 22 21:18:23.216003 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73f16d6a-4dcb-4fa4-8046-b104176d5062 could not be found. Oct 22 21:18:23.216003 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:18:23.216003 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:18:23.216003 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:18:23.216003 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:18:23.216003 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:18:23.216003 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:18:23.216003 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:18:23.216003 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:18:23.216003 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:18:23.216003 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:18:23.216003 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 44, in _shelve Oct 22 21:18:23.216003 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 22 21:18:23.216003 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 21:18:23.216003 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:18:23.216003 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73f16d6a-4dcb-4fa4-8046-b104176d5062 could not be found. Oct 22 21:18:23.216003 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:18:23.216003 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:18:23.216003 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:18:23.216003 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:18:23.216003 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:18:23.216003 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:18:23.220620 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:18:23.220620 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:18:23.220620 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73f16d6a-4dcb-4fa4-8046-b104176d5062 could not be found. Oct 22 21:18:23.220620 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:18:23.220620 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-9b99fd17-f171-45c1-9f27-b0fc8876145d tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Returning 404 to user: Instance 73f16d6a-4dcb-4fa4-8046-b104176d5062 could not be found. {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:18:23.220620 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-9b99fd17-f171-45c1-9f27-b0fc8876145d tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] 10.222.0.18 "POST /compute/v2.1/servers/73f16d6a-4dcb-4fa4-8046-b104176d5062/action" status: 404 len: 111 microversion: 2.1 time: 0.023089 Oct 22 21:18:23.220620 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2611/5206] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 21:18:23 2022] POST /compute/v2.1/servers/73f16d6a-4dcb-4fa4-8046-b104176d5062/action => generated 111 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 21:18:23.229893 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-004543f6-13c1-4a2b-b3bf-f658a955c208 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:18:23.230526 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-004543f6-13c1-4a2b-b3bf-f658a955c208 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] [instance: 3de67bb0-04d9-4d3a-a925-102f04d677bb] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:18:23.250175 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-004543f6-13c1-4a2b-b3bf-f658a955c208 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:18:23.250827 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-004543f6-13c1-4a2b-b3bf-f658a955c208 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:18:23.251497 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-004543f6-13c1-4a2b-b3bf-f658a955c208 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:18:23.252406 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-004543f6-13c1-4a2b-b3bf-f658a955c208 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:18:23.252936 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-004543f6-13c1-4a2b-b3bf-f658a955c208 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:18:23.253751 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-004543f6-13c1-4a2b-b3bf-f658a955c208 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:18:23.466523 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-004543f6-13c1-4a2b-b3bf-f658a955c208 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a9229e7da421b9e0e6f7df52f71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28af724189a24022b3ef7651b7157a9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:18:23.476983 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-004543f6-13c1-4a2b-b3bf-f658a955c208 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] 10.222.0.18 "GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb" status: 200 len: 1507 microversion: 2.1 time: 0.252904 Oct 22 21:18:23.478342 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2596/5207] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:18:23 2022] GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb => generated 1507 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:18:23.504848 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-7ee837a4-31a4-49c7-bec4-3604765bcef3 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:18:23.505505 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-7ee837a4-31a4-49c7-bec4-3604765bcef3 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] [instance: 3de67bb0-04d9-4d3a-a925-102f04d677bb] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:18:23.513574 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7ee837a4-31a4-49c7-bec4-3604765bcef3 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:18:23.517709 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7ee837a4-31a4-49c7-bec4-3604765bcef3 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:18:23.517709 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7ee837a4-31a4-49c7-bec4-3604765bcef3 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:18:23.517709 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7ee837a4-31a4-49c7-bec4-3604765bcef3 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:18:23.517709 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7ee837a4-31a4-49c7-bec4-3604765bcef3 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:18:23.517709 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7ee837a4-31a4-49c7-bec4-3604765bcef3 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:18:23.683373 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-7ee837a4-31a4-49c7-bec4-3604765bcef3 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a9229e7da421b9e0e6f7df52f71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28af724189a24022b3ef7651b7157a9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:18:23.685892 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell1:SELECT=100 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:18:23.693730 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-7ee837a4-31a4-49c7-bec4-3604765bcef3 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] 10.222.0.18 "GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb" status: 200 len: 1507 microversion: 2.1 time: 0.193451 Oct 22 21:18:23.699980 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2612/5208] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:18:23 2022] GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb => generated 1507 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:18:23.717108 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-05fb50b9-104e-4bda-a435-c863b5c0555e tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:18:23.717714 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-05fb50b9-104e-4bda-a435-c863b5c0555e tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] [instance: 3de67bb0-04d9-4d3a-a925-102f04d677bb] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:18:23.724311 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-05fb50b9-104e-4bda-a435-c863b5c0555e tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:18:23.725155 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-05fb50b9-104e-4bda-a435-c863b5c0555e tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:18:23.725598 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-05fb50b9-104e-4bda-a435-c863b5c0555e tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:18:23.726422 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-05fb50b9-104e-4bda-a435-c863b5c0555e tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:18:23.726886 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-05fb50b9-104e-4bda-a435-c863b5c0555e tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:18:23.727320 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-05fb50b9-104e-4bda-a435-c863b5c0555e tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:18:23.755112 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.objects.instance [None req-05fb50b9-104e-4bda-a435-c863b5c0555e tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lazy-loading 'flavor' on Instance uuid 3de67bb0-04d9-4d3a-a925-102f04d677bb {{(pid=138744) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 21:18:23.776547 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:18:24.070653 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-05fb50b9-104e-4bda-a435-c863b5c0555e tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] 10.222.0.18 "POST /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb/action" status: 202 len: 0 microversion: 2.1 time: 0.357657 Oct 22 21:18:24.071369 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2597/5209] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 21:18:23 2022] POST /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb/action => generated 0 bytes in 359 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 21:18:24.082247 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-49c0e565-dab6-4973-9e28-fe53fd0ce0de tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:18:24.082944 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-49c0e565-dab6-4973-9e28-fe53fd0ce0de tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] [instance: 3de67bb0-04d9-4d3a-a925-102f04d677bb] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:18:24.096024 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-49c0e565-dab6-4973-9e28-fe53fd0ce0de tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:18:24.102292 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-49c0e565-dab6-4973-9e28-fe53fd0ce0de tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:18:24.103090 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-49c0e565-dab6-4973-9e28-fe53fd0ce0de tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:18:24.104896 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-49c0e565-dab6-4973-9e28-fe53fd0ce0de tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:18:24.105626 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-49c0e565-dab6-4973-9e28-fe53fd0ce0de tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:18:24.106242 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-49c0e565-dab6-4973-9e28-fe53fd0ce0de tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:18:24.311072 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-49c0e565-dab6-4973-9e28-fe53fd0ce0de tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a9229e7da421b9e0e6f7df52f71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28af724189a24022b3ef7651b7157a9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:18:24.322218 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-49c0e565-dab6-4973-9e28-fe53fd0ce0de tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] 10.222.0.18 "GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb" status: 200 len: 1513 microversion: 2.1 time: 0.246213 Oct 22 21:18:24.323731 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2613/5210] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:18:24 2022] GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb => generated 1513 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:18:25.352500 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-18171711-3715-4aef-bb0b-364fff45c350 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:18:25.353796 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-18171711-3715-4aef-bb0b-364fff45c350 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] [instance: 3de67bb0-04d9-4d3a-a925-102f04d677bb] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:18:25.362928 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-18171711-3715-4aef-bb0b-364fff45c350 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:18:25.363734 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-18171711-3715-4aef-bb0b-364fff45c350 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:18:25.364931 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-18171711-3715-4aef-bb0b-364fff45c350 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:18:25.365811 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-18171711-3715-4aef-bb0b-364fff45c350 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:18:25.366850 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-18171711-3715-4aef-bb0b-364fff45c350 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:18:25.367507 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-18171711-3715-4aef-bb0b-364fff45c350 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:18:25.667641 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-18171711-3715-4aef-bb0b-364fff45c350 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a9229e7da421b9e0e6f7df52f71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28af724189a24022b3ef7651b7157a9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:18:25.676151 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-18171711-3715-4aef-bb0b-364fff45c350 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] 10.222.0.18 "GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb" status: 200 len: 1513 microversion: 2.1 time: 0.330477 Oct 22 21:18:25.691420 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2598/5211] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:18:25 2022] GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb => generated 1513 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:18:26.702462 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-dc8bca70-3d5a-44ad-92cf-b3526eb5adc8 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:18:26.704666 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-dc8bca70-3d5a-44ad-92cf-b3526eb5adc8 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] [instance: 3de67bb0-04d9-4d3a-a925-102f04d677bb] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:18:26.723861 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-dc8bca70-3d5a-44ad-92cf-b3526eb5adc8 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:18:26.730230 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-dc8bca70-3d5a-44ad-92cf-b3526eb5adc8 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:18:26.730818 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-dc8bca70-3d5a-44ad-92cf-b3526eb5adc8 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:18:26.731630 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-dc8bca70-3d5a-44ad-92cf-b3526eb5adc8 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:18:26.732122 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-dc8bca70-3d5a-44ad-92cf-b3526eb5adc8 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:18:26.732567 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-dc8bca70-3d5a-44ad-92cf-b3526eb5adc8 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:18:26.919884 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-dc8bca70-3d5a-44ad-92cf-b3526eb5adc8 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a9229e7da421b9e0e6f7df52f71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28af724189a24022b3ef7651b7157a9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:18:26.929387 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-dc8bca70-3d5a-44ad-92cf-b3526eb5adc8 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] 10.222.0.18 "GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb" status: 200 len: 1513 microversion: 2.1 time: 0.231419 Oct 22 21:18:26.929981 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2614/5212] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:18:26 2022] GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb => generated 1513 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:18:27.957696 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-080d73ad-9222-4472-9ef4-50b215fcb3df tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:18:27.958948 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-080d73ad-9222-4472-9ef4-50b215fcb3df tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] [instance: 3de67bb0-04d9-4d3a-a925-102f04d677bb] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:18:27.966581 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-080d73ad-9222-4472-9ef4-50b215fcb3df tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:18:27.968148 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-080d73ad-9222-4472-9ef4-50b215fcb3df tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:18:27.968937 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-080d73ad-9222-4472-9ef4-50b215fcb3df tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:18:27.970294 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-080d73ad-9222-4472-9ef4-50b215fcb3df tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:18:27.970935 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-080d73ad-9222-4472-9ef4-50b215fcb3df tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:18:27.972084 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-080d73ad-9222-4472-9ef4-50b215fcb3df tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:18:28.193589 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-080d73ad-9222-4472-9ef4-50b215fcb3df tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a9229e7da421b9e0e6f7df52f71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28af724189a24022b3ef7651b7157a9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:18:28.208423 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-080d73ad-9222-4472-9ef4-50b215fcb3df tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] 10.222.0.18 "GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb" status: 200 len: 1513 microversion: 2.1 time: 0.255381 Oct 22 21:18:28.210381 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2599/5213] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:18:27 2022] GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb => generated 1513 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:18:29.234912 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-ec6a1bdc-56c4-4ecf-ad4a-9928634bd41c tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:18:29.236524 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-ec6a1bdc-56c4-4ecf-ad4a-9928634bd41c tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] [instance: 3de67bb0-04d9-4d3a-a925-102f04d677bb] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:18:29.247954 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ec6a1bdc-56c4-4ecf-ad4a-9928634bd41c tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:18:29.248485 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ec6a1bdc-56c4-4ecf-ad4a-9928634bd41c tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:18:29.249186 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ec6a1bdc-56c4-4ecf-ad4a-9928634bd41c tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:18:29.251020 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ec6a1bdc-56c4-4ecf-ad4a-9928634bd41c tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:18:29.251839 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ec6a1bdc-56c4-4ecf-ad4a-9928634bd41c tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:18:29.252634 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ec6a1bdc-56c4-4ecf-ad4a-9928634bd41c tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:18:29.441641 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-ec6a1bdc-56c4-4ecf-ad4a-9928634bd41c tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a9229e7da421b9e0e6f7df52f71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28af724189a24022b3ef7651b7157a9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:18:29.450287 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-ec6a1bdc-56c4-4ecf-ad4a-9928634bd41c tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] 10.222.0.18 "GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb" status: 200 len: 1513 microversion: 2.1 time: 0.220707 Oct 22 21:18:29.451785 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2615/5214] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:18:29 2022] GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb => generated 1513 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:18:30.475163 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-b73f438a-e9dc-4659-ae2c-a4da3b5838b9 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:18:30.475955 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-b73f438a-e9dc-4659-ae2c-a4da3b5838b9 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] [instance: 3de67bb0-04d9-4d3a-a925-102f04d677bb] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:18:30.482440 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_api:SELECT=94 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:18:30.484511 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b73f438a-e9dc-4659-ae2c-a4da3b5838b9 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:18:30.485004 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b73f438a-e9dc-4659-ae2c-a4da3b5838b9 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:18:30.485511 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b73f438a-e9dc-4659-ae2c-a4da3b5838b9 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:18:30.486237 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b73f438a-e9dc-4659-ae2c-a4da3b5838b9 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:18:30.487867 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b73f438a-e9dc-4659-ae2c-a4da3b5838b9 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:18:30.488373 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b73f438a-e9dc-4659-ae2c-a4da3b5838b9 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:18:30.685984 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-b73f438a-e9dc-4659-ae2c-a4da3b5838b9 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a9229e7da421b9e0e6f7df52f71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28af724189a24022b3ef7651b7157a9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:18:30.697681 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-b73f438a-e9dc-4659-ae2c-a4da3b5838b9 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] 10.222.0.18 "GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb" status: 200 len: 1513 microversion: 2.1 time: 0.227279 Oct 22 21:18:30.698969 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2600/5215] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:18:30 2022] GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb => generated 1513 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:18:31.722737 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-4ce19822-3e7b-4160-89f3-7c791d0c5cc4 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:18:31.724579 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-4ce19822-3e7b-4160-89f3-7c791d0c5cc4 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] [instance: 3de67bb0-04d9-4d3a-a925-102f04d677bb] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:18:31.737593 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4ce19822-3e7b-4160-89f3-7c791d0c5cc4 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:18:31.738105 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4ce19822-3e7b-4160-89f3-7c791d0c5cc4 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:18:31.738562 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4ce19822-3e7b-4160-89f3-7c791d0c5cc4 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:18:31.739296 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4ce19822-3e7b-4160-89f3-7c791d0c5cc4 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:18:31.744142 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4ce19822-3e7b-4160-89f3-7c791d0c5cc4 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:18:31.745350 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4ce19822-3e7b-4160-89f3-7c791d0c5cc4 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:18:31.968830 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-4ce19822-3e7b-4160-89f3-7c791d0c5cc4 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a9229e7da421b9e0e6f7df52f71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28af724189a24022b3ef7651b7157a9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:18:31.979490 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-4ce19822-3e7b-4160-89f3-7c791d0c5cc4 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] 10.222.0.18 "GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb" status: 200 len: 1513 microversion: 2.1 time: 0.261039 Oct 22 21:18:31.980451 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2616/5216] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:18:31 2022] GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb => generated 1513 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:18:33.003872 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-e20e4334-644f-4d41-b322-0e2cd1cfcbfc tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:18:33.004593 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-e20e4334-644f-4d41-b322-0e2cd1cfcbfc tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] [instance: 3de67bb0-04d9-4d3a-a925-102f04d677bb] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:18:33.012404 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e20e4334-644f-4d41-b322-0e2cd1cfcbfc tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:18:33.013437 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e20e4334-644f-4d41-b322-0e2cd1cfcbfc tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:18:33.014234 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e20e4334-644f-4d41-b322-0e2cd1cfcbfc tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:18:33.015189 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e20e4334-644f-4d41-b322-0e2cd1cfcbfc tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:18:33.015830 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e20e4334-644f-4d41-b322-0e2cd1cfcbfc tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:18:33.016562 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e20e4334-644f-4d41-b322-0e2cd1cfcbfc tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:18:33.294372 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-e20e4334-644f-4d41-b322-0e2cd1cfcbfc tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a9229e7da421b9e0e6f7df52f71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28af724189a24022b3ef7651b7157a9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:18:33.303414 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-e20e4334-644f-4d41-b322-0e2cd1cfcbfc tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] 10.222.0.18 "GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb" status: 200 len: 1513 microversion: 2.1 time: 0.304252 Oct 22 21:18:33.304090 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2601/5217] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:18:32 2022] GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb => generated 1513 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:18:34.330906 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-7847d94c-b6be-4c6c-881a-84d5cac586ac tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:18:34.331650 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-7847d94c-b6be-4c6c-881a-84d5cac586ac tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] [instance: 3de67bb0-04d9-4d3a-a925-102f04d677bb] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:18:34.334721 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_api:SELECT=94 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:18:34.340278 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7847d94c-b6be-4c6c-881a-84d5cac586ac tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:18:34.340762 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7847d94c-b6be-4c6c-881a-84d5cac586ac tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:18:34.341403 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7847d94c-b6be-4c6c-881a-84d5cac586ac tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:18:34.342733 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7847d94c-b6be-4c6c-881a-84d5cac586ac tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:18:34.343227 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7847d94c-b6be-4c6c-881a-84d5cac586ac tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:18:34.343903 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7847d94c-b6be-4c6c-881a-84d5cac586ac tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:18:34.515074 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-7847d94c-b6be-4c6c-881a-84d5cac586ac tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a9229e7da421b9e0e6f7df52f71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28af724189a24022b3ef7651b7157a9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:18:34.530233 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-7847d94c-b6be-4c6c-881a-84d5cac586ac tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] 10.222.0.18 "GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb" status: 200 len: 1513 microversion: 2.1 time: 0.203157 Oct 22 21:18:34.547000 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2617/5218] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:18:34 2022] GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb => generated 1513 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:18:35.554692 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-203d9255-426c-4b56-aeea-0cdae1c7d5b0 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:18:35.555564 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-203d9255-426c-4b56-aeea-0cdae1c7d5b0 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] [instance: 3de67bb0-04d9-4d3a-a925-102f04d677bb] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:18:35.562774 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-203d9255-426c-4b56-aeea-0cdae1c7d5b0 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:18:35.563492 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-203d9255-426c-4b56-aeea-0cdae1c7d5b0 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:18:35.564206 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-203d9255-426c-4b56-aeea-0cdae1c7d5b0 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:18:35.565010 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-203d9255-426c-4b56-aeea-0cdae1c7d5b0 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:18:35.565753 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-203d9255-426c-4b56-aeea-0cdae1c7d5b0 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:18:35.566300 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-203d9255-426c-4b56-aeea-0cdae1c7d5b0 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:18:36.085460 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-203d9255-426c-4b56-aeea-0cdae1c7d5b0 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a9229e7da421b9e0e6f7df52f71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28af724189a24022b3ef7651b7157a9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:18:36.094073 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-203d9255-426c-4b56-aeea-0cdae1c7d5b0 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] 10.222.0.18 "GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb" status: 200 len: 1534 microversion: 2.1 time: 0.543661 Oct 22 21:18:36.094723 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2602/5219] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:18:35 2022] GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb => generated 1534 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:18:37.120859 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-3a102e76-5ccb-4722-8f4d-9baa41909dc9 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:18:37.121739 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-3a102e76-5ccb-4722-8f4d-9baa41909dc9 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] [instance: 3de67bb0-04d9-4d3a-a925-102f04d677bb] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:18:37.130239 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3a102e76-5ccb-4722-8f4d-9baa41909dc9 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:18:37.131079 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3a102e76-5ccb-4722-8f4d-9baa41909dc9 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:18:37.131428 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3a102e76-5ccb-4722-8f4d-9baa41909dc9 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:18:37.132249 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3a102e76-5ccb-4722-8f4d-9baa41909dc9 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:18:37.132820 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3a102e76-5ccb-4722-8f4d-9baa41909dc9 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:18:37.133368 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3a102e76-5ccb-4722-8f4d-9baa41909dc9 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:18:37.284539 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-3a102e76-5ccb-4722-8f4d-9baa41909dc9 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a9229e7da421b9e0e6f7df52f71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28af724189a24022b3ef7651b7157a9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:18:37.294629 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-3a102e76-5ccb-4722-8f4d-9baa41909dc9 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] 10.222.0.18 "GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb" status: 200 len: 1534 microversion: 2.1 time: 0.180492 Oct 22 21:18:37.295228 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2618/5220] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:18:37 2022] GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb => generated 1534 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:18:38.318344 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-0f6946ce-8e49-45b9-8afc-0bf2005b6da0 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:18:38.318918 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-0f6946ce-8e49-45b9-8afc-0bf2005b6da0 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] [instance: 3de67bb0-04d9-4d3a-a925-102f04d677bb] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:18:38.326257 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0f6946ce-8e49-45b9-8afc-0bf2005b6da0 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:18:38.326757 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0f6946ce-8e49-45b9-8afc-0bf2005b6da0 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:18:38.327207 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0f6946ce-8e49-45b9-8afc-0bf2005b6da0 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:18:38.327973 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0f6946ce-8e49-45b9-8afc-0bf2005b6da0 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:18:38.328448 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0f6946ce-8e49-45b9-8afc-0bf2005b6da0 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:18:38.328917 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0f6946ce-8e49-45b9-8afc-0bf2005b6da0 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:18:38.466997 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-0f6946ce-8e49-45b9-8afc-0bf2005b6da0 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a9229e7da421b9e0e6f7df52f71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28af724189a24022b3ef7651b7157a9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:18:38.478363 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-0f6946ce-8e49-45b9-8afc-0bf2005b6da0 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] 10.222.0.18 "GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb" status: 200 len: 1534 microversion: 2.1 time: 0.163981 Oct 22 21:18:38.479049 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2603/5221] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:18:38 2022] GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb => generated 1534 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:18:38.765953 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-eff07356-3ca3-405b-9437-285ccb90a87c req-43339bb1-6bc4-4e8a-9b87-802e9a061285 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3de67bb0-04d9-4d3a-a925-102f04d677bb", "name": "network-vif-plugged", "status": "completed", "tag": "1ae72240-5ec3-4fe0-b5c9-40ffe2e04689"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:18:38.779555 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-eff07356-3ca3-405b-9437-285ccb90a87c req-43339bb1-6bc4-4e8a-9b87-802e9a061285 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:18:38.780054 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-eff07356-3ca3-405b-9437-285ccb90a87c req-43339bb1-6bc4-4e8a-9b87-802e9a061285 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:18:38.780674 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-eff07356-3ca3-405b-9437-285ccb90a87c req-43339bb1-6bc4-4e8a-9b87-802e9a061285 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:18:38.795433 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-eff07356-3ca3-405b-9437-285ccb90a87c req-43339bb1-6bc4-4e8a-9b87-802e9a061285 service nova] Creating event network-vif-plugged:1ae72240-5ec3-4fe0-b5c9-40ffe2e04689 for instance 3de67bb0-04d9-4d3a-a925-102f04d677bb on nch1-master-1 Oct 22 21:18:38.801432 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-eff07356-3ca3-405b-9437-285ccb90a87c req-43339bb1-6bc4-4e8a-9b87-802e9a061285 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039621 Oct 22 21:18:38.802581 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2619/5222] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:18:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:18:39.504268 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-e4b44908-f128-41ee-9d9c-9273981c5dc0 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:18:39.504875 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-e4b44908-f128-41ee-9d9c-9273981c5dc0 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] [instance: 3de67bb0-04d9-4d3a-a925-102f04d677bb] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:18:39.518020 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e4b44908-f128-41ee-9d9c-9273981c5dc0 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:18:39.518540 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e4b44908-f128-41ee-9d9c-9273981c5dc0 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:18:39.518975 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e4b44908-f128-41ee-9d9c-9273981c5dc0 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:18:39.519709 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e4b44908-f128-41ee-9d9c-9273981c5dc0 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:18:39.520164 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e4b44908-f128-41ee-9d9c-9273981c5dc0 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:18:39.520591 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e4b44908-f128-41ee-9d9c-9273981c5dc0 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:18:39.791074 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-e4b44908-f128-41ee-9d9c-9273981c5dc0 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a9229e7da421b9e0e6f7df52f71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28af724189a24022b3ef7651b7157a9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:18:39.799932 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-e4b44908-f128-41ee-9d9c-9273981c5dc0 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] 10.222.0.18 "GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb" status: 200 len: 1534 microversion: 2.1 time: 0.301482 Oct 22 21:18:39.801091 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2604/5223] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:18:39 2022] GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb => generated 1534 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:18:40.827145 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-0669cb97-685d-4cbd-b0c0-85df1a9b2351 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:18:40.829245 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-0669cb97-685d-4cbd-b0c0-85df1a9b2351 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] [instance: 3de67bb0-04d9-4d3a-a925-102f04d677bb] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:18:40.838985 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0669cb97-685d-4cbd-b0c0-85df1a9b2351 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:18:40.839799 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0669cb97-685d-4cbd-b0c0-85df1a9b2351 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:18:40.840423 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0669cb97-685d-4cbd-b0c0-85df1a9b2351 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:18:40.841364 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0669cb97-685d-4cbd-b0c0-85df1a9b2351 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:18:40.842054 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0669cb97-685d-4cbd-b0c0-85df1a9b2351 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:18:40.843358 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0669cb97-685d-4cbd-b0c0-85df1a9b2351 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:18:41.448019 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-0669cb97-685d-4cbd-b0c0-85df1a9b2351 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a9229e7da421b9e0e6f7df52f71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28af724189a24022b3ef7651b7157a9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:18:41.464134 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-0669cb97-685d-4cbd-b0c0-85df1a9b2351 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] 10.222.0.18 "GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb" status: 200 len: 1534 microversion: 2.1 time: 0.642790 Oct 22 21:18:41.479875 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2620/5224] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:18:40 2022] GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb => generated 1534 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:18:42.489865 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-ec61e72a-b5f0-4efb-8da1-173747669dfb tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:18:42.493686 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-ec61e72a-b5f0-4efb-8da1-173747669dfb tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] [instance: 3de67bb0-04d9-4d3a-a925-102f04d677bb] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:18:42.502059 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ec61e72a-b5f0-4efb-8da1-173747669dfb tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:18:42.502912 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ec61e72a-b5f0-4efb-8da1-173747669dfb tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:18:42.503584 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ec61e72a-b5f0-4efb-8da1-173747669dfb tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:18:42.509084 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ec61e72a-b5f0-4efb-8da1-173747669dfb tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:18:42.509859 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ec61e72a-b5f0-4efb-8da1-173747669dfb tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:18:42.510492 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ec61e72a-b5f0-4efb-8da1-173747669dfb tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:18:42.749836 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-ec61e72a-b5f0-4efb-8da1-173747669dfb tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a9229e7da421b9e0e6f7df52f71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28af724189a24022b3ef7651b7157a9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:18:42.762625 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-ec61e72a-b5f0-4efb-8da1-173747669dfb tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] 10.222.0.18 "GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb" status: 200 len: 1529 microversion: 2.1 time: 0.277531 Oct 22 21:18:42.779462 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2605/5225] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:18:42 2022] GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb => generated 1529 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:18:43.796305 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-25892c20-64e0-4dd9-971a-2c736fe91058 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:18:43.799148 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-25892c20-64e0-4dd9-971a-2c736fe91058 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] [instance: 3de67bb0-04d9-4d3a-a925-102f04d677bb] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:18:43.811957 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-25892c20-64e0-4dd9-971a-2c736fe91058 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:18:43.819073 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-25892c20-64e0-4dd9-971a-2c736fe91058 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:18:43.822077 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-25892c20-64e0-4dd9-971a-2c736fe91058 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:18:43.822885 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-25892c20-64e0-4dd9-971a-2c736fe91058 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:18:43.823412 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-25892c20-64e0-4dd9-971a-2c736fe91058 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:18:43.823874 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-25892c20-64e0-4dd9-971a-2c736fe91058 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:18:44.389977 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-25892c20-64e0-4dd9-971a-2c736fe91058 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a9229e7da421b9e0e6f7df52f71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28af724189a24022b3ef7651b7157a9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:18:44.400824 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-25892c20-64e0-4dd9-971a-2c736fe91058 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] 10.222.0.18 "GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb" status: 200 len: 1529 microversion: 2.1 time: 0.613106 Oct 22 21:18:44.402110 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2621/5226] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:18:43 2022] GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb => generated 1529 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:18:45.428211 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-968c77f2-fc32-4459-856d-ea2c293b9547 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:18:45.431632 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-968c77f2-fc32-4459-856d-ea2c293b9547 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] [instance: 3de67bb0-04d9-4d3a-a925-102f04d677bb] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:18:45.450936 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-968c77f2-fc32-4459-856d-ea2c293b9547 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:18:45.457885 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-968c77f2-fc32-4459-856d-ea2c293b9547 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:18:45.458699 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-968c77f2-fc32-4459-856d-ea2c293b9547 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:18:45.459692 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-968c77f2-fc32-4459-856d-ea2c293b9547 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:18:45.460385 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-968c77f2-fc32-4459-856d-ea2c293b9547 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:18:45.461035 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-968c77f2-fc32-4459-856d-ea2c293b9547 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:18:45.742840 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-968c77f2-fc32-4459-856d-ea2c293b9547 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a9229e7da421b9e0e6f7df52f71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28af724189a24022b3ef7651b7157a9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:18:45.753598 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-968c77f2-fc32-4459-856d-ea2c293b9547 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] 10.222.0.18 "GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb" status: 200 len: 1529 microversion: 2.1 time: 0.329543 Oct 22 21:18:45.767190 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2606/5227] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:18:45 2022] GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb => generated 1529 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:18:46.782342 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-5662b703-8f17-4201-9dee-9d5180125b1d tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:18:46.783229 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-5662b703-8f17-4201-9dee-9d5180125b1d tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] [instance: 3de67bb0-04d9-4d3a-a925-102f04d677bb] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:18:46.795416 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5662b703-8f17-4201-9dee-9d5180125b1d tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:18:46.796107 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5662b703-8f17-4201-9dee-9d5180125b1d tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:18:46.796728 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5662b703-8f17-4201-9dee-9d5180125b1d tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:18:46.799157 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5662b703-8f17-4201-9dee-9d5180125b1d tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:18:46.799936 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5662b703-8f17-4201-9dee-9d5180125b1d tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:18:46.800572 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5662b703-8f17-4201-9dee-9d5180125b1d tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:18:47.136227 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-5662b703-8f17-4201-9dee-9d5180125b1d tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a9229e7da421b9e0e6f7df52f71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28af724189a24022b3ef7651b7157a9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:18:47.152681 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-5662b703-8f17-4201-9dee-9d5180125b1d tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] 10.222.0.18 "GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb" status: 200 len: 1529 microversion: 2.1 time: 0.372034 Oct 22 21:18:47.154276 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2622/5228] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:18:46 2022] GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb => generated 1529 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:18:48.180788 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-1f1aa17b-3809-40a7-bb36-249f96361e0a tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:18:48.182263 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-1f1aa17b-3809-40a7-bb36-249f96361e0a tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] [instance: 3de67bb0-04d9-4d3a-a925-102f04d677bb] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:18:48.198127 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1f1aa17b-3809-40a7-bb36-249f96361e0a tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:18:48.198941 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1f1aa17b-3809-40a7-bb36-249f96361e0a tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:18:48.199576 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1f1aa17b-3809-40a7-bb36-249f96361e0a tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:18:48.200533 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1f1aa17b-3809-40a7-bb36-249f96361e0a tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:18:48.201146 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1f1aa17b-3809-40a7-bb36-249f96361e0a tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:18:48.201931 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1f1aa17b-3809-40a7-bb36-249f96361e0a tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:18:48.409521 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-1f1aa17b-3809-40a7-bb36-249f96361e0a tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a9229e7da421b9e0e6f7df52f71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28af724189a24022b3ef7651b7157a9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:18:48.422216 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-1f1aa17b-3809-40a7-bb36-249f96361e0a tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] 10.222.0.18 "GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb" status: 200 len: 1529 microversion: 2.1 time: 0.247073 Oct 22 21:18:48.426114 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2607/5229] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:18:48 2022] GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb => generated 1529 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:18:49.450376 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-2ce4fa99-df92-4170-a23c-a3d732fb666b tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:18:49.452429 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-2ce4fa99-df92-4170-a23c-a3d732fb666b tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] [instance: 3de67bb0-04d9-4d3a-a925-102f04d677bb] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:18:49.463773 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2ce4fa99-df92-4170-a23c-a3d732fb666b tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:18:49.464581 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2ce4fa99-df92-4170-a23c-a3d732fb666b tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:18:49.465555 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2ce4fa99-df92-4170-a23c-a3d732fb666b tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:18:49.466666 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2ce4fa99-df92-4170-a23c-a3d732fb666b tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:18:49.467600 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2ce4fa99-df92-4170-a23c-a3d732fb666b tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:18:49.468525 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2ce4fa99-df92-4170-a23c-a3d732fb666b tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:18:49.704495 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-2ce4fa99-df92-4170-a23c-a3d732fb666b tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a9229e7da421b9e0e6f7df52f71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28af724189a24022b3ef7651b7157a9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:18:49.717511 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-2ce4fa99-df92-4170-a23c-a3d732fb666b tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] 10.222.0.18 "GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb" status: 200 len: 1529 microversion: 2.1 time: 0.270825 Oct 22 21:18:49.719649 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2623/5230] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:18:49 2022] GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb => generated 1529 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:18:50.748977 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-7ea4c40e-4ae2-4bb0-af08-bd85ad776378 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:18:50.751215 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-7ea4c40e-4ae2-4bb0-af08-bd85ad776378 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] [instance: 3de67bb0-04d9-4d3a-a925-102f04d677bb] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:18:50.773687 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7ea4c40e-4ae2-4bb0-af08-bd85ad776378 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:18:50.777330 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7ea4c40e-4ae2-4bb0-af08-bd85ad776378 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:18:50.777860 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7ea4c40e-4ae2-4bb0-af08-bd85ad776378 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:18:50.778813 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7ea4c40e-4ae2-4bb0-af08-bd85ad776378 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:18:50.779372 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7ea4c40e-4ae2-4bb0-af08-bd85ad776378 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:18:50.779829 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7ea4c40e-4ae2-4bb0-af08-bd85ad776378 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:18:50.934683 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-7ea4c40e-4ae2-4bb0-af08-bd85ad776378 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a9229e7da421b9e0e6f7df52f71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28af724189a24022b3ef7651b7157a9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:18:50.947594 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-7ea4c40e-4ae2-4bb0-af08-bd85ad776378 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] 10.222.0.18 "GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb" status: 200 len: 1529 microversion: 2.1 time: 0.204017 Oct 22 21:18:50.948234 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2608/5231] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:18:50 2022] GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb => generated 1529 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:18:51.977262 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-5b1fefe2-c4be-4788-b3da-760b87b40161 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:18:51.980623 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-5b1fefe2-c4be-4788-b3da-760b87b40161 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] [instance: 3de67bb0-04d9-4d3a-a925-102f04d677bb] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:18:51.998190 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5b1fefe2-c4be-4788-b3da-760b87b40161 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:18:51.998713 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5b1fefe2-c4be-4788-b3da-760b87b40161 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:18:51.999140 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5b1fefe2-c4be-4788-b3da-760b87b40161 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:18:52.002231 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5b1fefe2-c4be-4788-b3da-760b87b40161 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:18:52.002750 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5b1fefe2-c4be-4788-b3da-760b87b40161 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:18:52.003197 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5b1fefe2-c4be-4788-b3da-760b87b40161 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:18:52.286728 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-5b1fefe2-c4be-4788-b3da-760b87b40161 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a9229e7da421b9e0e6f7df52f71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28af724189a24022b3ef7651b7157a9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:18:52.299578 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-5b1fefe2-c4be-4788-b3da-760b87b40161 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] 10.222.0.18 "GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb" status: 200 len: 1529 microversion: 2.1 time: 0.326421 Oct 22 21:18:52.302330 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2624/5232] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:18:51 2022] GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb => generated 1529 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:18:53.334422 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-b9c3f3a3-267b-41df-9430-83094f6fa498 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:18:53.335836 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-b9c3f3a3-267b-41df-9430-83094f6fa498 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] [instance: 3de67bb0-04d9-4d3a-a925-102f04d677bb] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:18:53.365283 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b9c3f3a3-267b-41df-9430-83094f6fa498 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:18:53.366313 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b9c3f3a3-267b-41df-9430-83094f6fa498 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:18:53.367889 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b9c3f3a3-267b-41df-9430-83094f6fa498 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:18:53.368884 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b9c3f3a3-267b-41df-9430-83094f6fa498 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:18:53.372958 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b9c3f3a3-267b-41df-9430-83094f6fa498 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:18:53.373477 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b9c3f3a3-267b-41df-9430-83094f6fa498 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:18:53.652923 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-b9c3f3a3-267b-41df-9430-83094f6fa498 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a9229e7da421b9e0e6f7df52f71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28af724189a24022b3ef7651b7157a9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:18:53.674027 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-b9c3f3a3-267b-41df-9430-83094f6fa498 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] 10.222.0.18 "GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb" status: 200 len: 1529 microversion: 2.1 time: 0.343445 Oct 22 21:18:53.687068 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2609/5233] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:18:53 2022] GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb => generated 1529 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:18:54.702450 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-a614c9a6-ff0b-416e-92db-3ce811786362 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:18:54.705336 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-a614c9a6-ff0b-416e-92db-3ce811786362 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] [instance: 3de67bb0-04d9-4d3a-a925-102f04d677bb] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:18:54.720637 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a614c9a6-ff0b-416e-92db-3ce811786362 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:18:54.721745 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a614c9a6-ff0b-416e-92db-3ce811786362 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:18:54.722467 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a614c9a6-ff0b-416e-92db-3ce811786362 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:18:54.723454 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a614c9a6-ff0b-416e-92db-3ce811786362 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:18:54.724160 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a614c9a6-ff0b-416e-92db-3ce811786362 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:18:54.725812 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a614c9a6-ff0b-416e-92db-3ce811786362 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:18:54.729691 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell1:SELECT=70 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:18:55.677608 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-a614c9a6-ff0b-416e-92db-3ce811786362 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a9229e7da421b9e0e6f7df52f71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28af724189a24022b3ef7651b7157a9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:18:55.686355 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-a614c9a6-ff0b-416e-92db-3ce811786362 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] 10.222.0.18 "GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb" status: 200 len: 1529 microversion: 2.1 time: 0.987806 Oct 22 21:18:55.692933 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2625/5234] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:18:54 2022] GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb => generated 1529 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:18:56.716372 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-1fe19483-53de-4fca-aa08-c8ca61ad22ae tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:18:56.718969 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-1fe19483-53de-4fca-aa08-c8ca61ad22ae tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] [instance: 3de67bb0-04d9-4d3a-a925-102f04d677bb] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:18:56.733074 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1fe19483-53de-4fca-aa08-c8ca61ad22ae tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:18:56.737035 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1fe19483-53de-4fca-aa08-c8ca61ad22ae tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:18:56.738389 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1fe19483-53de-4fca-aa08-c8ca61ad22ae tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:18:56.765236 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1fe19483-53de-4fca-aa08-c8ca61ad22ae tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:18:56.766415 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1fe19483-53de-4fca-aa08-c8ca61ad22ae tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.026s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:18:56.768117 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1fe19483-53de-4fca-aa08-c8ca61ad22ae tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:18:56.790381 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=81,nova_cell1:INSERT=1 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:18:57.322476 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-1fe19483-53de-4fca-aa08-c8ca61ad22ae tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a9229e7da421b9e0e6f7df52f71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28af724189a24022b3ef7651b7157a9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:18:57.338045 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-1fe19483-53de-4fca-aa08-c8ca61ad22ae tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] 10.222.0.18 "GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb" status: 200 len: 1529 microversion: 2.1 time: 0.626698 Oct 22 21:18:57.350489 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2610/5235] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:18:56 2022] GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb => generated 1529 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:18:58.376723 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-0a694a8d-a7fe-419a-843c-ed0445f92c8a tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:18:58.377368 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-0a694a8d-a7fe-419a-843c-ed0445f92c8a tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] [instance: 3de67bb0-04d9-4d3a-a925-102f04d677bb] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:18:58.391021 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0a694a8d-a7fe-419a-843c-ed0445f92c8a tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:18:58.391996 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0a694a8d-a7fe-419a-843c-ed0445f92c8a tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:18:58.392792 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0a694a8d-a7fe-419a-843c-ed0445f92c8a tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:18:58.394355 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0a694a8d-a7fe-419a-843c-ed0445f92c8a tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:18:58.394631 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0a694a8d-a7fe-419a-843c-ed0445f92c8a tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:18:58.395267 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0a694a8d-a7fe-419a-843c-ed0445f92c8a tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:18:58.651763 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-0a694a8d-a7fe-419a-843c-ed0445f92c8a tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a9229e7da421b9e0e6f7df52f71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28af724189a24022b3ef7651b7157a9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:18:58.663933 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-0a694a8d-a7fe-419a-843c-ed0445f92c8a tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] 10.222.0.18 "GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb" status: 200 len: 1529 microversion: 2.1 time: 0.291431 Oct 22 21:18:58.665677 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2626/5236] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:18:58 2022] GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb => generated 1529 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:18:59.693761 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-dc5cfe35-5548-413f-a5f1-4b152282f1d7 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:18:59.695474 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-dc5cfe35-5548-413f-a5f1-4b152282f1d7 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] [instance: 3de67bb0-04d9-4d3a-a925-102f04d677bb] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:18:59.703485 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-dc5cfe35-5548-413f-a5f1-4b152282f1d7 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:18:59.705568 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-dc5cfe35-5548-413f-a5f1-4b152282f1d7 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:18:59.706991 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-dc5cfe35-5548-413f-a5f1-4b152282f1d7 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:18:59.708465 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-dc5cfe35-5548-413f-a5f1-4b152282f1d7 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:18:59.709355 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-dc5cfe35-5548-413f-a5f1-4b152282f1d7 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:18:59.709844 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-dc5cfe35-5548-413f-a5f1-4b152282f1d7 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:19:00.028368 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-dc5cfe35-5548-413f-a5f1-4b152282f1d7 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a9229e7da421b9e0e6f7df52f71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28af724189a24022b3ef7651b7157a9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:19:00.039158 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-dc5cfe35-5548-413f-a5f1-4b152282f1d7 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] 10.222.0.18 "GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb" status: 200 len: 1511 microversion: 2.1 time: 0.349698 Oct 22 21:19:00.044196 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2611/5237] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:18:59 2022] GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb => generated 1511 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:19:01.069221 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-0caef917-3fcc-4070-ac6d-a3beabeaf287 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:19:01.069887 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-0caef917-3fcc-4070-ac6d-a3beabeaf287 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] [instance: 3de67bb0-04d9-4d3a-a925-102f04d677bb] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:19:01.076735 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0caef917-3fcc-4070-ac6d-a3beabeaf287 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:19:01.077436 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0caef917-3fcc-4070-ac6d-a3beabeaf287 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:19:01.078330 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0caef917-3fcc-4070-ac6d-a3beabeaf287 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:19:01.079408 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0caef917-3fcc-4070-ac6d-a3beabeaf287 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:19:01.080050 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0caef917-3fcc-4070-ac6d-a3beabeaf287 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:19:01.080655 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0caef917-3fcc-4070-ac6d-a3beabeaf287 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:19:01.254110 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-0caef917-3fcc-4070-ac6d-a3beabeaf287 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a9229e7da421b9e0e6f7df52f71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28af724189a24022b3ef7651b7157a9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:19:01.287605 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-0caef917-3fcc-4070-ac6d-a3beabeaf287 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] 10.222.0.18 "GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb" status: 200 len: 1511 microversion: 2.1 time: 0.221761 Oct 22 21:19:01.299609 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2627/5238] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:19:01 2022] GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb => generated 1511 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:19:02.313673 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-4da7d995-4121-4627-ba4f-0000c7de98fd tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:19:02.314299 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-4da7d995-4121-4627-ba4f-0000c7de98fd tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] [instance: 3de67bb0-04d9-4d3a-a925-102f04d677bb] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:19:02.318527 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_api:SELECT=24 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:19:02.322349 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4da7d995-4121-4627-ba4f-0000c7de98fd tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:19:02.323129 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4da7d995-4121-4627-ba4f-0000c7de98fd tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:19:02.323702 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4da7d995-4121-4627-ba4f-0000c7de98fd tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:19:02.324464 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4da7d995-4121-4627-ba4f-0000c7de98fd tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:19:02.325177 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4da7d995-4121-4627-ba4f-0000c7de98fd tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:19:02.325696 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4da7d995-4121-4627-ba4f-0000c7de98fd tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:19:02.486455 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-4da7d995-4121-4627-ba4f-0000c7de98fd tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a9229e7da421b9e0e6f7df52f71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28af724189a24022b3ef7651b7157a9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:19:02.496840 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-4da7d995-4121-4627-ba4f-0000c7de98fd tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] 10.222.0.18 "GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb" status: 200 len: 1514 microversion: 2.1 time: 0.187099 Oct 22 21:19:02.497442 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2612/5239] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:19:02 2022] GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb => generated 1514 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:19:02.520166 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-2375f83e-6981-416a-9fb1-8cc260f838bd tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:19:02.521417 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-2375f83e-6981-416a-9fb1-8cc260f838bd tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] [instance: 3de67bb0-04d9-4d3a-a925-102f04d677bb] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:19:02.529275 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2375f83e-6981-416a-9fb1-8cc260f838bd tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:19:02.529945 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2375f83e-6981-416a-9fb1-8cc260f838bd tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:19:02.530536 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2375f83e-6981-416a-9fb1-8cc260f838bd tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:19:02.531499 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2375f83e-6981-416a-9fb1-8cc260f838bd tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:19:02.532187 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2375f83e-6981-416a-9fb1-8cc260f838bd tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:19:02.532815 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2375f83e-6981-416a-9fb1-8cc260f838bd tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:19:02.777524 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-2375f83e-6981-416a-9fb1-8cc260f838bd tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a9229e7da421b9e0e6f7df52f71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28af724189a24022b3ef7651b7157a9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:19:02.789734 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-2375f83e-6981-416a-9fb1-8cc260f838bd tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] 10.222.0.18 "GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb" status: 200 len: 1514 microversion: 2.1 time: 0.272979 Oct 22 21:19:02.804194 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2628/5240] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:19:02 2022] GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb => generated 1514 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:19:02.847090 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-4bf5d358-6cbe-4c97-bd17-10eb500f136b tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:19:02.848024 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-4bf5d358-6cbe-4c97-bd17-10eb500f136b tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] [instance: 3de67bb0-04d9-4d3a-a925-102f04d677bb] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:19:02.856553 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4bf5d358-6cbe-4c97-bd17-10eb500f136b tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:19:02.857272 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4bf5d358-6cbe-4c97-bd17-10eb500f136b tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:19:02.858167 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4bf5d358-6cbe-4c97-bd17-10eb500f136b tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:19:02.859037 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4bf5d358-6cbe-4c97-bd17-10eb500f136b tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:19:02.859814 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4bf5d358-6cbe-4c97-bd17-10eb500f136b tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:19:02.860258 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4bf5d358-6cbe-4c97-bd17-10eb500f136b tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:19:02.888126 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.objects.instance [None req-4bf5d358-6cbe-4c97-bd17-10eb500f136b tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lazy-loading 'flavor' on Instance uuid 3de67bb0-04d9-4d3a-a925-102f04d677bb {{(pid=138744) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 21:19:02.907528 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-4bf5d358-6cbe-4c97-bd17-10eb500f136b tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] HTTP exception thrown: Cannot 'shelve' instance 3de67bb0-04d9-4d3a-a925-102f04d677bb while it is in vm_state shelved_offloaded Oct 22 21:19:02.910507 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-4bf5d358-6cbe-4c97-bd17-10eb500f136b tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Request method failure captured: Oct 22 21:19:02.910507 ncdv-master-1 devstack@n-api.service[138744]: request: POST /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb/action HTTP/1.1 Oct 22 21:19:02.910507 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 21:19:02.910507 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 21:19:02.910507 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 21:19:02.910507 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 14 Oct 22 21:19:02.910507 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 21:19:02.910507 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 21:19:02.910507 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 21:19:02.910507 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 21:19:02.910507 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVF3hm7PiLG1R8Tw2syJVqR4znaBscty3weljpQpv2aVSYokkqaFvTxJu_8ZsVDxnVWNFBjrkTk4hem6vgNXmexe0yUI_M8pHEKoh5CWO6b1coilxRZ6VgX94mIL_xf6l3t9Q4mcnT856zV-XemvxZab0Ooy1ChU21L_her9Zn74z_zU Oct 22 21:19:02.910507 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 21:19:02.910507 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 21:19:02.910507 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 21:19:02.910507 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 21:19:02.910507 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 21:19:02.910507 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 21:19:02.910507 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: 28af724189a24022b3ef7651b7157a9d Oct 22 21:19:02.910507 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-ServersNegativeTestJSON-766586991 Oct 22 21:19:02.910507 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 21:19:02.910507 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 21:19:02.910507 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_28af724189a24022b3ef7651b7157a9d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/28af724189a24022b3ef7651b7157a9d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/28af724189a24022b3ef7651b7157a9d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/28af724189a24022b3ef7651b7157a9d"}]}] Oct 22 21:19:02.910507 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-ServersNegativeTestJSON-766586991 Oct 22 21:19:02.910507 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: 28af724189a24022b3ef7651b7157a9d Oct 22 21:19:02.910507 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-ServersNegativeTestJSON-766586991 Oct 22 21:19:02.910507 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-ServersNegativeTestJSON-766586991-project Oct 22 21:19:02.910507 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 21:19:02.910507 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 21:19:02.910507 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: 6c8a9229e7da421b9e0e6f7df52f71e2 Oct 22 21:19:02.910507 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-ServersNegativeTestJSON-766586991-project Oct 22 21:19:02.910507 ncdv-master-1 devstack@n-api.service[138744]: Oct 22 21:19:02.910507 ncdv-master-1 devstack@n-api.service[138744]: {"shelve": {}} Oct 22 21:19:02.910507 ncdv-master-1 devstack@n-api.service[138744]: method: > Oct 22 21:19:02.910507 ncdv-master-1 devstack@n-api.service[138744]: exception: Cannot 'shelve' instance 3de67bb0-04d9-4d3a-a925-102f04d677bb while it is in vm_state shelved_offloaded Oct 22 21:19:02.910507 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': '3de67bb0-04d9-4d3a-a925-102f04d677bb', 'body': {'shelve': {}}} Oct 22 21:19:02.910507 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:19:02.910507 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:19:02.910507 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 49, in _shelve Oct 22 21:19:02.910507 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi self.compute_api.shelve(context, instance) Oct 22 21:19:02.910507 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 22 21:19:02.910507 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 22 21:19:02.910507 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 22 21:19:02.910507 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 22 21:19:02.910507 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 22 21:19:02.910507 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 22 21:19:02.910507 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 22 21:19:02.910507 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 22 21:19:02.910507 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 22 21:19:02.910507 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 22 21:19:02.910507 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 3de67bb0-04d9-4d3a-a925-102f04d677bb in vm_state shelved_offloaded. Cannot shelve while the instance is in this state. Oct 22 21:19:02.910507 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:19:02.910507 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:19:02.910507 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:19:02.910507 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:19:02.910507 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:19:02.910507 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:19:02.910507 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:19:02.910507 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:19:02.910507 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:19:02.910507 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:19:02.910507 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 56, in _shelve Oct 22 21:19:02.910507 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 22 21:19:02.910507 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 22 21:19:02.910507 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 22 21:19:02.915545 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'shelve' instance 3de67bb0-04d9-4d3a-a925-102f04d677bb while it is in vm_state shelved_offloaded Oct 22 21:19:02.915545 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:19:02.915545 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:19:02.915545 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:19:02.915545 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:19:02.915545 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:19:02.915545 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:19:02.915545 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:19:02.915545 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:19:02.915545 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'shelve' instance 3de67bb0-04d9-4d3a-a925-102f04d677bb while it is in vm_state shelved_offloaded Oct 22 21:19:02.915545 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:19:02.919136 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-4bf5d358-6cbe-4c97-bd17-10eb500f136b tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Returning 409 to user: Cannot 'shelve' instance 3de67bb0-04d9-4d3a-a925-102f04d677bb while it is in vm_state shelved_offloaded {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:19:02.920292 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-4bf5d358-6cbe-4c97-bd17-10eb500f136b tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] 10.222.0.18 "POST /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb/action" status: 409 len: 155 microversion: 2.1 time: 0.077507 Oct 22 21:19:02.920895 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2613/5241] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 21:19:02 2022] POST /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb/action => generated 155 bytes in 79 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 22 21:19:02.930448 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-71d5f216-e49c-462d-8c29-161e09888c64 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:19:02.931661 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-71d5f216-e49c-462d-8c29-161e09888c64 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] [instance: 3de67bb0-04d9-4d3a-a925-102f04d677bb] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:19:02.938762 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-71d5f216-e49c-462d-8c29-161e09888c64 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:19:02.939293 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-71d5f216-e49c-462d-8c29-161e09888c64 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:19:02.939758 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-71d5f216-e49c-462d-8c29-161e09888c64 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:19:02.940650 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-71d5f216-e49c-462d-8c29-161e09888c64 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:19:02.941141 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-71d5f216-e49c-462d-8c29-161e09888c64 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:19:02.941558 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-71d5f216-e49c-462d-8c29-161e09888c64 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:19:02.991405 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-71d5f216-e49c-462d-8c29-161e09888c64 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] [instance: 3de67bb0-04d9-4d3a-a925-102f04d677bb] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=138745) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 22 21:19:03.105743 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-71d5f216-e49c-462d-8c29-161e09888c64 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] 10.222.0.18 "POST /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb/action" status: 202 len: 0 microversion: 2.1 time: 0.179561 Oct 22 21:19:03.108516 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2629/5242] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 21:19:02 2022] POST /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb/action => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 21:19:03.115861 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-623e4fc2-2740-48d8-aa4b-ed6b8003d989 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:19:03.117057 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-623e4fc2-2740-48d8-aa4b-ed6b8003d989 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] [instance: 3de67bb0-04d9-4d3a-a925-102f04d677bb] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:19:03.124181 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-623e4fc2-2740-48d8-aa4b-ed6b8003d989 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:19:03.124758 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-623e4fc2-2740-48d8-aa4b-ed6b8003d989 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:19:03.125246 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-623e4fc2-2740-48d8-aa4b-ed6b8003d989 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:19:03.126518 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-623e4fc2-2740-48d8-aa4b-ed6b8003d989 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:19:03.127209 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-623e4fc2-2740-48d8-aa4b-ed6b8003d989 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:19:03.128253 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-623e4fc2-2740-48d8-aa4b-ed6b8003d989 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:19:03.366166 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-6b04b35c-0312-4d34-ad93-4b78f1002bd2 req-5720379b-0cbf-4a74-bdd8-f6777f3f97d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3de67bb0-04d9-4d3a-a925-102f04d677bb", "name": "network-vif-unplugged", "status": "completed", "tag": "1ae72240-5ec3-4fe0-b5c9-40ffe2e04689"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:19:03.392998 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-6b04b35c-0312-4d34-ad93-4b78f1002bd2 req-5720379b-0cbf-4a74-bdd8-f6777f3f97d4 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:19:03.393720 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-6b04b35c-0312-4d34-ad93-4b78f1002bd2 req-5720379b-0cbf-4a74-bdd8-f6777f3f97d4 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:19:03.394432 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-6b04b35c-0312-4d34-ad93-4b78f1002bd2 req-5720379b-0cbf-4a74-bdd8-f6777f3f97d4 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:19:03.395703 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-623e4fc2-2740-48d8-aa4b-ed6b8003d989 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a9229e7da421b9e0e6f7df52f71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28af724189a24022b3ef7651b7157a9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:19:03.411565 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-623e4fc2-2740-48d8-aa4b-ed6b8003d989 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] 10.222.0.18 "GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb" status: 200 len: 1462 microversion: 2.1 time: 0.300040 Oct 22 21:19:03.411793 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.compute.server_external_events [req-6b04b35c-0312-4d34-ad93-4b78f1002bd2 req-5720379b-0cbf-4a74-bdd8-f6777f3f97d4 service nova] Unable to find a host for instance 3de67bb0-04d9-4d3a-a925-102f04d677bb. Dropping event network-vif-unplugged {{(pid=138745) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 22 21:19:03.413286 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-6b04b35c-0312-4d34-ad93-4b78f1002bd2 req-5720379b-0cbf-4a74-bdd8-f6777f3f97d4 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.051991 Oct 22 21:19:03.414546 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2630/5243] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:19:03 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 54 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Oct 22 21:19:03.415105 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2614/5244] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:19:03 2022] GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb => generated 1462 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:19:04.438754 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-971b6863-8a19-4827-a173-7c274dee9e6f tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:19:04.439406 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-971b6863-8a19-4827-a173-7c274dee9e6f tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] [instance: 3de67bb0-04d9-4d3a-a925-102f04d677bb] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:19:04.442187 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:19:04.457186 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-971b6863-8a19-4827-a173-7c274dee9e6f tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:19:04.458581 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-971b6863-8a19-4827-a173-7c274dee9e6f tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:19:04.459414 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-971b6863-8a19-4827-a173-7c274dee9e6f tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:19:04.460324 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-971b6863-8a19-4827-a173-7c274dee9e6f tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:19:04.461012 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-971b6863-8a19-4827-a173-7c274dee9e6f tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:19:04.461435 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-971b6863-8a19-4827-a173-7c274dee9e6f tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:19:04.699804 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-971b6863-8a19-4827-a173-7c274dee9e6f tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a9229e7da421b9e0e6f7df52f71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28af724189a24022b3ef7651b7157a9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:19:04.711719 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-971b6863-8a19-4827-a173-7c274dee9e6f tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] 10.222.0.18 "GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb" status: 200 len: 1462 microversion: 2.1 time: 0.275947 Oct 22 21:19:04.714827 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2631/5245] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:19:04 2022] GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb => generated 1462 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:19:05.415090 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-606d2e7e-0976-4114-b7fa-e65c45028749 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:19:05.415774 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-606d2e7e-0976-4114-b7fa-e65c45028749 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: 20d90b58-3fad-4a44-b6bf-4ef0cc587def] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:19:05.435809 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-606d2e7e-0976-4114-b7fa-e65c45028749 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:19:05.439647 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-606d2e7e-0976-4114-b7fa-e65c45028749 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:19:05.440757 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-606d2e7e-0976-4114-b7fa-e65c45028749 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:19:05.443277 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-606d2e7e-0976-4114-b7fa-e65c45028749 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:19:05.444301 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-606d2e7e-0976-4114-b7fa-e65c45028749 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:19:05.445806 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-606d2e7e-0976-4114-b7fa-e65c45028749 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:19:05.739830 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-3d4ff002-52f1-43de-9b4e-8ec0ec626373 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:19:05.740469 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-3d4ff002-52f1-43de-9b4e-8ec0ec626373 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] [instance: 3de67bb0-04d9-4d3a-a925-102f04d677bb] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:19:05.753029 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3d4ff002-52f1-43de-9b4e-8ec0ec626373 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:19:05.753541 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3d4ff002-52f1-43de-9b4e-8ec0ec626373 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:19:05.753995 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3d4ff002-52f1-43de-9b4e-8ec0ec626373 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:19:05.754729 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3d4ff002-52f1-43de-9b4e-8ec0ec626373 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:19:05.755193 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3d4ff002-52f1-43de-9b4e-8ec0ec626373 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:19:05.760886 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3d4ff002-52f1-43de-9b4e-8ec0ec626373 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:19:06.533200 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-3d4ff002-52f1-43de-9b4e-8ec0ec626373 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a9229e7da421b9e0e6f7df52f71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28af724189a24022b3ef7651b7157a9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:19:06.544900 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-3d4ff002-52f1-43de-9b4e-8ec0ec626373 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] 10.222.0.18 "GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb" status: 200 len: 1520 microversion: 2.1 time: 0.809348 Oct 22 21:19:06.547687 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2632/5246] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:19:05 2022] GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb => generated 1520 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:19:06.575158 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-606d2e7e-0976-4114-b7fa-e65c45028749 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c85602851244d4a632b9c861eb4416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45cb377c6a9a43b3b91c99a64e37f1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:19:06.586083 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-606d2e7e-0976-4114-b7fa-e65c45028749 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def" status: 200 len: 1669 microversion: 2.1 time: 1.174831 Oct 22 21:19:06.586686 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2615/5247] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:19:05 2022] GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def => generated 1669 bytes in 1176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:19:06.611595 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-51cc8784-4d30-44aa-a291-ba919b57f027 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:19:06.612357 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-51cc8784-4d30-44aa-a291-ba919b57f027 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: 20d90b58-3fad-4a44-b6bf-4ef0cc587def] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:19:06.624680 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-51cc8784-4d30-44aa-a291-ba919b57f027 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:19:06.625643 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-51cc8784-4d30-44aa-a291-ba919b57f027 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:19:06.627662 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-51cc8784-4d30-44aa-a291-ba919b57f027 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:19:06.629581 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-51cc8784-4d30-44aa-a291-ba919b57f027 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:19:06.631425 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-51cc8784-4d30-44aa-a291-ba919b57f027 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:19:06.632952 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-51cc8784-4d30-44aa-a291-ba919b57f027 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:19:07.046308 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-51cc8784-4d30-44aa-a291-ba919b57f027 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c85602851244d4a632b9c861eb4416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45cb377c6a9a43b3b91c99a64e37f1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:19:07.058096 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-51cc8784-4d30-44aa-a291-ba919b57f027 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def" status: 200 len: 1669 microversion: 2.1 time: 0.448435 Oct 22 21:19:07.059679 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2633/5248] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:19:06 2022] GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def => generated 1669 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:19:07.085872 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-3f69f413-6a52-4cfc-8690-8da628e4c6e4 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:19:07.086589 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-3f69f413-6a52-4cfc-8690-8da628e4c6e4 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: 20d90b58-3fad-4a44-b6bf-4ef0cc587def] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:19:07.101134 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3f69f413-6a52-4cfc-8690-8da628e4c6e4 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:19:07.101660 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3f69f413-6a52-4cfc-8690-8da628e4c6e4 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:19:07.102120 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3f69f413-6a52-4cfc-8690-8da628e4c6e4 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:19:07.105100 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3f69f413-6a52-4cfc-8690-8da628e4c6e4 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:19:07.106386 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3f69f413-6a52-4cfc-8690-8da628e4c6e4 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:19:07.108728 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3f69f413-6a52-4cfc-8690-8da628e4c6e4 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:19:07.438096 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-3f69f413-6a52-4cfc-8690-8da628e4c6e4 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c85602851244d4a632b9c861eb4416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45cb377c6a9a43b3b91c99a64e37f1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:19:07.450469 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-3f69f413-6a52-4cfc-8690-8da628e4c6e4 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def" status: 200 len: 1669 microversion: 2.1 time: 0.371477 Oct 22 21:19:07.463257 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2616/5249] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:19:07 2022] GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def => generated 1669 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:19:07.478563 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-b11e2a1c-38f0-4acd-b1b8-f41cc1484c3d tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-422641920"}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:19:07.481148 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-b11e2a1c-38f0-4acd-b1b8-f41cc1484c3d tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: 20d90b58-3fad-4a44-b6bf-4ef0cc587def] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:19:07.505130 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b11e2a1c-38f0-4acd-b1b8-f41cc1484c3d tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:19:07.505798 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b11e2a1c-38f0-4acd-b1b8-f41cc1484c3d tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:19:07.506521 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b11e2a1c-38f0-4acd-b1b8-f41cc1484c3d tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:19:07.507522 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b11e2a1c-38f0-4acd-b1b8-f41cc1484c3d tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:19:07.508221 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b11e2a1c-38f0-4acd-b1b8-f41cc1484c3d tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:19:07.508880 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b11e2a1c-38f0-4acd-b1b8-f41cc1484c3d tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:19:07.571036 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-407583ac-4d4d-4faa-a3a7-42308549770f tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:19:07.571691 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-407583ac-4d4d-4faa-a3a7-42308549770f tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] [instance: 3de67bb0-04d9-4d3a-a925-102f04d677bb] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:19:07.590674 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-407583ac-4d4d-4faa-a3a7-42308549770f tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:19:07.591262 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-407583ac-4d4d-4faa-a3a7-42308549770f tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:19:07.591701 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-407583ac-4d4d-4faa-a3a7-42308549770f tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:19:07.592444 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-407583ac-4d4d-4faa-a3a7-42308549770f tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:19:07.592910 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-407583ac-4d4d-4faa-a3a7-42308549770f tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:19:07.593968 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-407583ac-4d4d-4faa-a3a7-42308549770f tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:19:07.815529 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-b11e2a1c-38f0-4acd-b1b8-f41cc1484c3d tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "POST /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def/action" status: 202 len: 0 microversion: 2.1 time: 0.340406 Oct 22 21:19:07.820047 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2634/5250] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 21:19:07 2022] POST /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def/action => generated 0 bytes in 343 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Oct 22 21:19:08.014772 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-407583ac-4d4d-4faa-a3a7-42308549770f tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a9229e7da421b9e0e6f7df52f71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28af724189a24022b3ef7651b7157a9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:19:08.024341 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-407583ac-4d4d-4faa-a3a7-42308549770f tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] 10.222.0.18 "GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb" status: 200 len: 1520 microversion: 2.1 time: 0.459786 Oct 22 21:19:08.042215 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2617/5251] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:19:07 2022] GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb => generated 1520 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:19:08.101539 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-6c72ffa8-4907-4b76-a1b3-180553145b9b req-d6072e27-6a05-42c2-913d-d4ee43d28ee5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3de67bb0-04d9-4d3a-a925-102f04d677bb", "tag": "1ae72240-5ec3-4fe0-b5c9-40ffe2e04689"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:19:08.118097 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-6c72ffa8-4907-4b76-a1b3-180553145b9b req-d6072e27-6a05-42c2-913d-d4ee43d28ee5 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:19:08.121446 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-6c72ffa8-4907-4b76-a1b3-180553145b9b req-d6072e27-6a05-42c2-913d-d4ee43d28ee5 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:19:08.121908 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-6c72ffa8-4907-4b76-a1b3-180553145b9b req-d6072e27-6a05-42c2-913d-d4ee43d28ee5 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:19:08.147250 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-6c72ffa8-4907-4b76-a1b3-180553145b9b req-d6072e27-6a05-42c2-913d-d4ee43d28ee5 service nova] Creating event network-changed:1ae72240-5ec3-4fe0-b5c9-40ffe2e04689 for instance 3de67bb0-04d9-4d3a-a925-102f04d677bb on nch2-master-1 Oct 22 21:19:08.161274 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-6c72ffa8-4907-4b76-a1b3-180553145b9b req-d6072e27-6a05-42c2-913d-d4ee43d28ee5 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064932 Oct 22 21:19:08.162085 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2635/5252] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:19:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 21:19:09.055076 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-ba198682-8551-4a41-8c26-afd4e0da8039 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:19:09.055714 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-ba198682-8551-4a41-8c26-afd4e0da8039 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] [instance: 3de67bb0-04d9-4d3a-a925-102f04d677bb] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:19:09.068687 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ba198682-8551-4a41-8c26-afd4e0da8039 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:19:09.069387 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ba198682-8551-4a41-8c26-afd4e0da8039 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:19:09.069838 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ba198682-8551-4a41-8c26-afd4e0da8039 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:19:09.076717 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ba198682-8551-4a41-8c26-afd4e0da8039 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:19:09.077702 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ba198682-8551-4a41-8c26-afd4e0da8039 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:19:09.078679 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ba198682-8551-4a41-8c26-afd4e0da8039 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:19:09.468966 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-ba198682-8551-4a41-8c26-afd4e0da8039 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a9229e7da421b9e0e6f7df52f71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28af724189a24022b3ef7651b7157a9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:19:09.484014 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-ba198682-8551-4a41-8c26-afd4e0da8039 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] 10.222.0.18 "GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb" status: 200 len: 1520 microversion: 2.1 time: 0.439349 Oct 22 21:19:09.508482 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2618/5253] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:19:09 2022] GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb => generated 1520 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:19:10.515078 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-5932f4a9-a237-40af-a833-25a7896b030f tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:19:10.516034 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-5932f4a9-a237-40af-a833-25a7896b030f tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] [instance: 3de67bb0-04d9-4d3a-a925-102f04d677bb] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:19:10.535421 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5932f4a9-a237-40af-a833-25a7896b030f tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:19:10.535945 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5932f4a9-a237-40af-a833-25a7896b030f tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:19:10.536397 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5932f4a9-a237-40af-a833-25a7896b030f tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:19:10.537127 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5932f4a9-a237-40af-a833-25a7896b030f tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:19:10.537593 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5932f4a9-a237-40af-a833-25a7896b030f tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:19:10.538032 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5932f4a9-a237-40af-a833-25a7896b030f tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:19:10.895124 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-5932f4a9-a237-40af-a833-25a7896b030f tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a9229e7da421b9e0e6f7df52f71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28af724189a24022b3ef7651b7157a9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:19:10.903618 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-5932f4a9-a237-40af-a833-25a7896b030f tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] 10.222.0.18 "GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb" status: 200 len: 1520 microversion: 2.1 time: 0.393832 Oct 22 21:19:10.915617 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2636/5254] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:19:10 2022] GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb => generated 1520 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:19:11.939698 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-46bd0ce0-5d9a-4346-a7c6-4e0a29b16b82 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:19:11.941627 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-46bd0ce0-5d9a-4346-a7c6-4e0a29b16b82 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] [instance: 3de67bb0-04d9-4d3a-a925-102f04d677bb] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:19:11.956294 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-46bd0ce0-5d9a-4346-a7c6-4e0a29b16b82 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:19:11.957253 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-46bd0ce0-5d9a-4346-a7c6-4e0a29b16b82 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:19:11.957854 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-46bd0ce0-5d9a-4346-a7c6-4e0a29b16b82 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:19:11.958812 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-46bd0ce0-5d9a-4346-a7c6-4e0a29b16b82 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:19:11.959634 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-46bd0ce0-5d9a-4346-a7c6-4e0a29b16b82 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:19:11.960230 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-46bd0ce0-5d9a-4346-a7c6-4e0a29b16b82 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:19:12.233274 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-46bd0ce0-5d9a-4346-a7c6-4e0a29b16b82 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a9229e7da421b9e0e6f7df52f71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28af724189a24022b3ef7651b7157a9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:19:12.249623 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-46bd0ce0-5d9a-4346-a7c6-4e0a29b16b82 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] 10.222.0.18 "GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb" status: 200 len: 1520 microversion: 2.1 time: 0.322364 Oct 22 21:19:12.250283 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2619/5255] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:19:11 2022] GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb => generated 1520 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:19:13.279546 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-bea2f5d8-c45e-4bdc-9c6f-9c39ae4d2469 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:19:13.281952 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-bea2f5d8-c45e-4bdc-9c6f-9c39ae4d2469 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] [instance: 3de67bb0-04d9-4d3a-a925-102f04d677bb] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:19:13.317444 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bea2f5d8-c45e-4bdc-9c6f-9c39ae4d2469 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:19:13.318363 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bea2f5d8-c45e-4bdc-9c6f-9c39ae4d2469 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:19:13.319118 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bea2f5d8-c45e-4bdc-9c6f-9c39ae4d2469 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:19:13.322023 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bea2f5d8-c45e-4bdc-9c6f-9c39ae4d2469 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:19:13.323519 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bea2f5d8-c45e-4bdc-9c6f-9c39ae4d2469 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:19:13.324212 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bea2f5d8-c45e-4bdc-9c6f-9c39ae4d2469 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:19:13.572468 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-182d44ee-9102-428d-89d5-e77defc7b071 req-4507a562-52db-459f-b94c-c3fc50e6ba7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20d90b58-3fad-4a44-b6bf-4ef0cc587def", "name": "network-vif-plugged", "status": "completed", "tag": "7ef4550f-d128-432a-9dbc-ce1802e6c6da"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:19:13.605020 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-182d44ee-9102-428d-89d5-e77defc7b071 req-4507a562-52db-459f-b94c-c3fc50e6ba7e service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:19:13.612478 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-182d44ee-9102-428d-89d5-e77defc7b071 req-4507a562-52db-459f-b94c-c3fc50e6ba7e service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:19:13.613095 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-182d44ee-9102-428d-89d5-e77defc7b071 req-4507a562-52db-459f-b94c-c3fc50e6ba7e service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:19:13.658203 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-182d44ee-9102-428d-89d5-e77defc7b071 req-4507a562-52db-459f-b94c-c3fc50e6ba7e service nova] Creating event network-vif-plugged:7ef4550f-d128-432a-9dbc-ce1802e6c6da for instance 20d90b58-3fad-4a44-b6bf-4ef0cc587def on nch1-master-1 Oct 22 21:19:13.677661 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-182d44ee-9102-428d-89d5-e77defc7b071 req-4507a562-52db-459f-b94c-c3fc50e6ba7e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107527 Oct 22 21:19:13.679190 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2620/5256] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:19:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:19:13.903711 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-bea2f5d8-c45e-4bdc-9c6f-9c39ae4d2469 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a9229e7da421b9e0e6f7df52f71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28af724189a24022b3ef7651b7157a9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:19:13.917110 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-bea2f5d8-c45e-4bdc-9c6f-9c39ae4d2469 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] 10.222.0.18 "GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb" status: 200 len: 1520 microversion: 2.1 time: 0.642957 Oct 22 21:19:13.917380 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2637/5257] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:19:13 2022] GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb => generated 1520 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:19:14.952777 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-6cf3af99-f6be-494e-83cd-1f54d84fbff5 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:19:14.952777 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-6cf3af99-f6be-494e-83cd-1f54d84fbff5 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] [instance: 3de67bb0-04d9-4d3a-a925-102f04d677bb] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:19:14.962509 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6cf3af99-f6be-494e-83cd-1f54d84fbff5 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:19:14.963790 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6cf3af99-f6be-494e-83cd-1f54d84fbff5 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:19:14.964365 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6cf3af99-f6be-494e-83cd-1f54d84fbff5 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:19:14.965169 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6cf3af99-f6be-494e-83cd-1f54d84fbff5 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:19:14.965823 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6cf3af99-f6be-494e-83cd-1f54d84fbff5 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:19:14.966630 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6cf3af99-f6be-494e-83cd-1f54d84fbff5 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:19:15.229840 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-6cf3af99-f6be-494e-83cd-1f54d84fbff5 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a9229e7da421b9e0e6f7df52f71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28af724189a24022b3ef7651b7157a9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:19:15.245008 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-6cf3af99-f6be-494e-83cd-1f54d84fbff5 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] 10.222.0.18 "GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb" status: 200 len: 1520 microversion: 2.1 time: 0.303710 Oct 22 21:19:15.261432 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2621/5258] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:19:14 2022] GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb => generated 1520 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:19:16.273673 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-6fe06da3-54e9-4a3b-9cb4-7282ba2e9a5e tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:19:16.274278 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-6fe06da3-54e9-4a3b-9cb4-7282ba2e9a5e tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] [instance: 3de67bb0-04d9-4d3a-a925-102f04d677bb] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:19:16.288668 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6fe06da3-54e9-4a3b-9cb4-7282ba2e9a5e tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:19:16.291728 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6fe06da3-54e9-4a3b-9cb4-7282ba2e9a5e tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:19:16.292413 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6fe06da3-54e9-4a3b-9cb4-7282ba2e9a5e tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:19:16.293553 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6fe06da3-54e9-4a3b-9cb4-7282ba2e9a5e tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:19:16.297171 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6fe06da3-54e9-4a3b-9cb4-7282ba2e9a5e tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:19:16.297642 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6fe06da3-54e9-4a3b-9cb4-7282ba2e9a5e tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:19:16.703428 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-6fe06da3-54e9-4a3b-9cb4-7282ba2e9a5e tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a9229e7da421b9e0e6f7df52f71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28af724189a24022b3ef7651b7157a9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:19:16.715044 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-6fe06da3-54e9-4a3b-9cb4-7282ba2e9a5e tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] 10.222.0.18 "GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb" status: 200 len: 1520 microversion: 2.1 time: 0.445166 Oct 22 21:19:16.719631 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2638/5259] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:19:16 2022] GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb => generated 1520 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:19:17.745658 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-b64292b9-31f5-41e0-b52c-0c503c614097 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:19:17.747129 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-b64292b9-31f5-41e0-b52c-0c503c614097 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] [instance: 3de67bb0-04d9-4d3a-a925-102f04d677bb] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:19:17.767997 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b64292b9-31f5-41e0-b52c-0c503c614097 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:19:17.770599 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b64292b9-31f5-41e0-b52c-0c503c614097 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:19:17.773643 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b64292b9-31f5-41e0-b52c-0c503c614097 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:19:17.783685 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b64292b9-31f5-41e0-b52c-0c503c614097 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:19:17.784577 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b64292b9-31f5-41e0-b52c-0c503c614097 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:19:17.785280 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b64292b9-31f5-41e0-b52c-0c503c614097 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:19:18.153516 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-b64292b9-31f5-41e0-b52c-0c503c614097 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a9229e7da421b9e0e6f7df52f71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28af724189a24022b3ef7651b7157a9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:19:18.166541 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-b64292b9-31f5-41e0-b52c-0c503c614097 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] 10.222.0.18 "GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb" status: 200 len: 1520 microversion: 2.1 time: 0.421170 Oct 22 21:19:18.169555 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2622/5260] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:19:17 2022] GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb => generated 1520 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:19:19.194542 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-594fc653-7be9-49c2-a730-0b6c2e5e3eda tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:19:19.196104 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-594fc653-7be9-49c2-a730-0b6c2e5e3eda tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] [instance: 3de67bb0-04d9-4d3a-a925-102f04d677bb] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:19:19.216720 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-594fc653-7be9-49c2-a730-0b6c2e5e3eda tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:19:19.217655 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-594fc653-7be9-49c2-a730-0b6c2e5e3eda tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:19:19.219653 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-594fc653-7be9-49c2-a730-0b6c2e5e3eda tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:19:19.222961 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-594fc653-7be9-49c2-a730-0b6c2e5e3eda tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:19:19.225073 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-594fc653-7be9-49c2-a730-0b6c2e5e3eda tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:19:19.230548 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-594fc653-7be9-49c2-a730-0b6c2e5e3eda tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:19:19.833606 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-594fc653-7be9-49c2-a730-0b6c2e5e3eda tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a9229e7da421b9e0e6f7df52f71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28af724189a24022b3ef7651b7157a9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:19:19.847119 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-594fc653-7be9-49c2-a730-0b6c2e5e3eda tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] 10.222.0.18 "GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb" status: 200 len: 1520 microversion: 2.1 time: 0.656539 Oct 22 21:19:19.855284 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2639/5261] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:19:19 2022] GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb => generated 1520 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:19:20.879634 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-24faa945-bac0-4b5d-aa81-eefcd7a086ab tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:19:20.880959 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-24faa945-bac0-4b5d-aa81-eefcd7a086ab tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] [instance: 3de67bb0-04d9-4d3a-a925-102f04d677bb] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:19:20.895198 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-24faa945-bac0-4b5d-aa81-eefcd7a086ab tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:19:20.896013 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-24faa945-bac0-4b5d-aa81-eefcd7a086ab tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:19:20.896626 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-24faa945-bac0-4b5d-aa81-eefcd7a086ab tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:19:20.899439 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-24faa945-bac0-4b5d-aa81-eefcd7a086ab tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:19:20.900406 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-24faa945-bac0-4b5d-aa81-eefcd7a086ab tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:19:20.902039 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-24faa945-bac0-4b5d-aa81-eefcd7a086ab tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:19:21.166279 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-24faa945-bac0-4b5d-aa81-eefcd7a086ab tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a9229e7da421b9e0e6f7df52f71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28af724189a24022b3ef7651b7157a9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:19:21.180649 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-24faa945-bac0-4b5d-aa81-eefcd7a086ab tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] 10.222.0.18 "GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb" status: 200 len: 1520 microversion: 2.1 time: 0.306225 Oct 22 21:19:21.184549 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2623/5262] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:19:20 2022] GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb => generated 1520 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:19:22.221487 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-42aeee93-b0ec-499b-886c-0bf8f06a2557 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:19:22.222243 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-42aeee93-b0ec-499b-886c-0bf8f06a2557 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] [instance: 3de67bb0-04d9-4d3a-a925-102f04d677bb] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:19:22.238096 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-42aeee93-b0ec-499b-886c-0bf8f06a2557 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:19:22.238872 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-42aeee93-b0ec-499b-886c-0bf8f06a2557 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:19:22.239784 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-42aeee93-b0ec-499b-886c-0bf8f06a2557 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:19:22.240788 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-42aeee93-b0ec-499b-886c-0bf8f06a2557 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:19:22.241485 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-42aeee93-b0ec-499b-886c-0bf8f06a2557 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:19:22.242191 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-42aeee93-b0ec-499b-886c-0bf8f06a2557 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:19:22.617898 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-42aeee93-b0ec-499b-886c-0bf8f06a2557 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a9229e7da421b9e0e6f7df52f71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28af724189a24022b3ef7651b7157a9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:19:22.620451 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:19:22.633195 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-42aeee93-b0ec-499b-886c-0bf8f06a2557 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] 10.222.0.18 "GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb" status: 200 len: 1520 microversion: 2.1 time: 0.415759 Oct 22 21:19:22.643401 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2640/5263] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:19:22 2022] GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb => generated 1520 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:19:23.662269 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-e6e9f98e-80a7-4739-966e-c18673c8f765 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:19:23.664631 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-e6e9f98e-80a7-4739-966e-c18673c8f765 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] [instance: 3de67bb0-04d9-4d3a-a925-102f04d677bb] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:19:23.681016 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e6e9f98e-80a7-4739-966e-c18673c8f765 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:19:23.681849 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e6e9f98e-80a7-4739-966e-c18673c8f765 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:19:23.682407 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e6e9f98e-80a7-4739-966e-c18673c8f765 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:19:23.683185 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e6e9f98e-80a7-4739-966e-c18673c8f765 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:19:23.684150 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e6e9f98e-80a7-4739-966e-c18673c8f765 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:19:23.684805 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e6e9f98e-80a7-4739-966e-c18673c8f765 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:19:23.978441 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-e6e9f98e-80a7-4739-966e-c18673c8f765 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a9229e7da421b9e0e6f7df52f71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28af724189a24022b3ef7651b7157a9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:19:24.008566 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-e6e9f98e-80a7-4739-966e-c18673c8f765 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] 10.222.0.18 "GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb" status: 200 len: 1520 microversion: 2.1 time: 0.345441 Oct 22 21:19:24.009273 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2624/5264] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:19:23 2022] GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb => generated 1520 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:19:25.038887 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-0772761a-5ed9-42d0-bd51-986d2c732c1a tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:19:25.042930 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-0772761a-5ed9-42d0-bd51-986d2c732c1a tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] [instance: 3de67bb0-04d9-4d3a-a925-102f04d677bb] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:19:25.061922 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0772761a-5ed9-42d0-bd51-986d2c732c1a tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:19:25.065256 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0772761a-5ed9-42d0-bd51-986d2c732c1a tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:19:25.067610 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0772761a-5ed9-42d0-bd51-986d2c732c1a tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:19:25.068562 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0772761a-5ed9-42d0-bd51-986d2c732c1a tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:19:25.076401 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0772761a-5ed9-42d0-bd51-986d2c732c1a tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:19:25.077183 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0772761a-5ed9-42d0-bd51-986d2c732c1a tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:19:25.349080 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-0772761a-5ed9-42d0-bd51-986d2c732c1a tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a9229e7da421b9e0e6f7df52f71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28af724189a24022b3ef7651b7157a9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:19:25.367100 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-0772761a-5ed9-42d0-bd51-986d2c732c1a tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] 10.222.0.18 "GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb" status: 200 len: 1520 microversion: 2.1 time: 0.334549 Oct 22 21:19:25.392839 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2641/5265] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:19:25 2022] GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb => generated 1520 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:19:26.398660 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-31b87872-b2c3-471e-9884-c96cf309f84a tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:19:26.400044 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-31b87872-b2c3-471e-9884-c96cf309f84a tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] [instance: 3de67bb0-04d9-4d3a-a925-102f04d677bb] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:19:26.415325 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-31b87872-b2c3-471e-9884-c96cf309f84a tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:19:26.416103 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-31b87872-b2c3-471e-9884-c96cf309f84a tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:19:26.416706 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-31b87872-b2c3-471e-9884-c96cf309f84a tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:19:26.417609 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-31b87872-b2c3-471e-9884-c96cf309f84a tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:19:26.418223 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-31b87872-b2c3-471e-9884-c96cf309f84a tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:19:26.418827 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-31b87872-b2c3-471e-9884-c96cf309f84a tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:19:26.902272 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-31b87872-b2c3-471e-9884-c96cf309f84a tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a9229e7da421b9e0e6f7df52f71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28af724189a24022b3ef7651b7157a9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:19:26.906443 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:SELECT=90 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:19:26.911964 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-31b87872-b2c3-471e-9884-c96cf309f84a tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] 10.222.0.18 "GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb" status: 200 len: 1520 microversion: 2.1 time: 0.517362 Oct 22 21:19:26.918486 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2625/5266] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:19:26 2022] GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb => generated 1520 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:19:27.944974 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-5b3d8a7f-42ea-498e-a42e-cc0223b2dc84 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:19:27.946471 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-5b3d8a7f-42ea-498e-a42e-cc0223b2dc84 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] [instance: 3de67bb0-04d9-4d3a-a925-102f04d677bb] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:19:27.957004 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5b3d8a7f-42ea-498e-a42e-cc0223b2dc84 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:19:27.957911 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5b3d8a7f-42ea-498e-a42e-cc0223b2dc84 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:19:27.958967 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5b3d8a7f-42ea-498e-a42e-cc0223b2dc84 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:19:27.960035 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5b3d8a7f-42ea-498e-a42e-cc0223b2dc84 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:19:27.961936 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5b3d8a7f-42ea-498e-a42e-cc0223b2dc84 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:19:27.962750 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5b3d8a7f-42ea-498e-a42e-cc0223b2dc84 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:19:28.158234 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-5b3d8a7f-42ea-498e-a42e-cc0223b2dc84 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a9229e7da421b9e0e6f7df52f71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28af724189a24022b3ef7651b7157a9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:19:28.167302 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-5b3d8a7f-42ea-498e-a42e-cc0223b2dc84 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] 10.222.0.18 "GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb" status: 200 len: 1520 microversion: 2.1 time: 0.226535 Oct 22 21:19:28.187200 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2642/5267] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:19:27 2022] GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb => generated 1520 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:19:28.404796 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-3c16f8d4-4898-479d-8483-d1b653b573fb req-b617e711-e68f-4221-af46-1e4d709db3b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3de67bb0-04d9-4d3a-a925-102f04d677bb", "name": "network-vif-plugged", "status": "completed", "tag": "1ae72240-5ec3-4fe0-b5c9-40ffe2e04689"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:19:28.438653 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-3c16f8d4-4898-479d-8483-d1b653b573fb req-b617e711-e68f-4221-af46-1e4d709db3b2 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:19:28.439608 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-3c16f8d4-4898-479d-8483-d1b653b573fb req-b617e711-e68f-4221-af46-1e4d709db3b2 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:19:28.440183 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-3c16f8d4-4898-479d-8483-d1b653b573fb req-b617e711-e68f-4221-af46-1e4d709db3b2 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:19:28.465107 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-3c16f8d4-4898-479d-8483-d1b653b573fb req-b617e711-e68f-4221-af46-1e4d709db3b2 service nova] Creating event network-vif-plugged:1ae72240-5ec3-4fe0-b5c9-40ffe2e04689 for instance 3de67bb0-04d9-4d3a-a925-102f04d677bb on nch2-master-1 Oct 22 21:19:28.472933 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-3c16f8d4-4898-479d-8483-d1b653b573fb req-b617e711-e68f-4221-af46-1e4d709db3b2 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074101 Oct 22 21:19:28.475746 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2626/5268] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:19:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:19:29.196464 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-25975005-09e3-4f32-836e-c75f43da08bb tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:19:29.197969 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-25975005-09e3-4f32-836e-c75f43da08bb tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] [instance: 3de67bb0-04d9-4d3a-a925-102f04d677bb] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:19:29.206823 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-25975005-09e3-4f32-836e-c75f43da08bb tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:19:29.207601 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-25975005-09e3-4f32-836e-c75f43da08bb tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:19:29.211127 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-25975005-09e3-4f32-836e-c75f43da08bb tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:19:29.212056 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-25975005-09e3-4f32-836e-c75f43da08bb tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:19:29.212630 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-25975005-09e3-4f32-836e-c75f43da08bb tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:19:29.213281 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-25975005-09e3-4f32-836e-c75f43da08bb tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:19:29.473151 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-25975005-09e3-4f32-836e-c75f43da08bb tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a9229e7da421b9e0e6f7df52f71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28af724189a24022b3ef7651b7157a9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:19:29.486694 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-25975005-09e3-4f32-836e-c75f43da08bb tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] 10.222.0.18 "GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb" status: 200 len: 1520 microversion: 2.1 time: 0.296009 Oct 22 21:19:29.506806 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2643/5269] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:19:29 2022] GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb => generated 1520 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:19:30.512697 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-0dff4dfe-ce77-4161-8f08-a3d79ac103cc tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:19:30.513455 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-0dff4dfe-ce77-4161-8f08-a3d79ac103cc tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] [instance: 3de67bb0-04d9-4d3a-a925-102f04d677bb] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:19:30.526305 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0dff4dfe-ce77-4161-8f08-a3d79ac103cc tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:19:30.526813 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0dff4dfe-ce77-4161-8f08-a3d79ac103cc tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:19:30.527264 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0dff4dfe-ce77-4161-8f08-a3d79ac103cc tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:19:30.528055 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0dff4dfe-ce77-4161-8f08-a3d79ac103cc tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:19:30.528569 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0dff4dfe-ce77-4161-8f08-a3d79ac103cc tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:19:30.528973 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0dff4dfe-ce77-4161-8f08-a3d79ac103cc tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:19:30.789274 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-0dff4dfe-ce77-4161-8f08-a3d79ac103cc tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a9229e7da421b9e0e6f7df52f71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28af724189a24022b3ef7651b7157a9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:19:30.799712 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-0dff4dfe-ce77-4161-8f08-a3d79ac103cc tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] 10.222.0.18 "GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb" status: 200 len: 1520 microversion: 2.1 time: 0.291594 Oct 22 21:19:30.800772 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2627/5270] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:19:30 2022] GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb => generated 1520 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:19:31.824579 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-28c343d7-515a-4b31-9f86-83bd6082535b tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:19:31.825226 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-28c343d7-515a-4b31-9f86-83bd6082535b tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] [instance: 3de67bb0-04d9-4d3a-a925-102f04d677bb] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:19:31.833343 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-28c343d7-515a-4b31-9f86-83bd6082535b tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:19:31.833846 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-28c343d7-515a-4b31-9f86-83bd6082535b tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:19:31.834315 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-28c343d7-515a-4b31-9f86-83bd6082535b tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:19:31.835025 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-28c343d7-515a-4b31-9f86-83bd6082535b tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:19:31.835537 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-28c343d7-515a-4b31-9f86-83bd6082535b tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:19:31.835984 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-28c343d7-515a-4b31-9f86-83bd6082535b tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:19:32.017809 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-28c343d7-515a-4b31-9f86-83bd6082535b tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a9229e7da421b9e0e6f7df52f71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28af724189a24022b3ef7651b7157a9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:19:32.037347 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-28c343d7-515a-4b31-9f86-83bd6082535b tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] 10.222.0.18 "GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb" status: 200 len: 1507 microversion: 2.1 time: 0.217027 Oct 22 21:19:32.038118 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2644/5271] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:19:31 2022] GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb => generated 1507 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:19:32.060295 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-80d5195e-e7f2-4bca-9baa-8bca096948e5 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:19:32.061332 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-80d5195e-e7f2-4bca-9baa-8bca096948e5 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] [instance: 3de67bb0-04d9-4d3a-a925-102f04d677bb] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:19:32.065449 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-c6b85db2-020c-4392-b8e1-2fb973f0efd5 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:19:32.066254 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-c6b85db2-020c-4392-b8e1-2fb973f0efd5 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: 20d90b58-3fad-4a44-b6bf-4ef0cc587def] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:19:32.074324 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-80d5195e-e7f2-4bca-9baa-8bca096948e5 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:19:32.074526 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c6b85db2-020c-4392-b8e1-2fb973f0efd5 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:19:32.074954 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c6b85db2-020c-4392-b8e1-2fb973f0efd5 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:19:32.075499 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-80d5195e-e7f2-4bca-9baa-8bca096948e5 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:19:32.075640 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c6b85db2-020c-4392-b8e1-2fb973f0efd5 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:19:32.076245 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c6b85db2-020c-4392-b8e1-2fb973f0efd5 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:19:32.076373 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-80d5195e-e7f2-4bca-9baa-8bca096948e5 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:19:32.076718 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c6b85db2-020c-4392-b8e1-2fb973f0efd5 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:19:32.077181 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c6b85db2-020c-4392-b8e1-2fb973f0efd5 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:19:32.077741 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-80d5195e-e7f2-4bca-9baa-8bca096948e5 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:19:32.078360 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-80d5195e-e7f2-4bca-9baa-8bca096948e5 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:19:32.078953 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-80d5195e-e7f2-4bca-9baa-8bca096948e5 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:19:32.405939 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-c6b85db2-020c-4392-b8e1-2fb973f0efd5 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c85602851244d4a632b9c861eb4416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45cb377c6a9a43b3b91c99a64e37f1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:19:32.418174 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-80d5195e-e7f2-4bca-9baa-8bca096948e5 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a9229e7da421b9e0e6f7df52f71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28af724189a24022b3ef7651b7157a9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:19:32.426066 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-c6b85db2-020c-4392-b8e1-2fb973f0efd5 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def" status: 200 len: 1669 microversion: 2.1 time: 0.366148 Oct 22 21:19:32.427839 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2645/5272] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:19:32 2022] GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def => generated 1669 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:19:32.432571 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-80d5195e-e7f2-4bca-9baa-8bca096948e5 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] 10.222.0.18 "GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb" status: 200 len: 1507 microversion: 2.1 time: 0.376167 Oct 22 21:19:32.433768 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2628/5273] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:19:32 2022] GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb => generated 1507 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:19:32.460486 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-f034a034-9e8a-41d3-8c49-c0249a811124 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-2-1722497180"}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:19:32.466753 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-f034a034-9e8a-41d3-8c49-c0249a811124 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: 20d90b58-3fad-4a44-b6bf-4ef0cc587def] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:19:32.470348 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-fa701a19-9092-4f26-a156-a3efef662bca tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:19:32.471100 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-fa701a19-9092-4f26-a156-a3efef662bca tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] [instance: 3de67bb0-04d9-4d3a-a925-102f04d677bb] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:19:32.473389 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_api:SELECT=34 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:19:32.476773 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f034a034-9e8a-41d3-8c49-c0249a811124 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:19:32.478033 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f034a034-9e8a-41d3-8c49-c0249a811124 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:19:32.478705 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f034a034-9e8a-41d3-8c49-c0249a811124 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:19:32.479784 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f034a034-9e8a-41d3-8c49-c0249a811124 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:19:32.480481 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f034a034-9e8a-41d3-8c49-c0249a811124 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:19:32.481200 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f034a034-9e8a-41d3-8c49-c0249a811124 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:19:32.486482 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fa701a19-9092-4f26-a156-a3efef662bca tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:19:32.487119 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fa701a19-9092-4f26-a156-a3efef662bca tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:19:32.489417 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fa701a19-9092-4f26-a156-a3efef662bca tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:19:32.490185 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fa701a19-9092-4f26-a156-a3efef662bca tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:19:32.490707 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fa701a19-9092-4f26-a156-a3efef662bca tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:19:32.491270 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fa701a19-9092-4f26-a156-a3efef662bca tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:19:32.774492 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-f034a034-9e8a-41d3-8c49-c0249a811124 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "POST /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def/action" status: 202 len: 0 microversion: 2.1 time: 0.327277 Oct 22 21:19:32.778610 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2646/5274] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 21:19:32 2022] POST /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def/action => generated 0 bytes in 333 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Oct 22 21:19:32.796653 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-fa701a19-9092-4f26-a156-a3efef662bca tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a9229e7da421b9e0e6f7df52f71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28af724189a24022b3ef7651b7157a9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:19:32.808220 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-fa701a19-9092-4f26-a156-a3efef662bca tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] 10.222.0.18 "GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb" status: 200 len: 1507 microversion: 2.1 time: 0.341335 Oct 22 21:19:32.820824 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2629/5275] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:19:32 2022] GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb => generated 1507 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:19:32.844692 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-e15c01f1-e953-4864-92fe-f0b91aa80871 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:19:32.852580 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.wsgi [None req-e15c01f1-e953-4864-92fe-f0b91aa80871 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] HTTP exception thrown: Instance a0ca9b08-7d6b-4a30-a520-3bbb13054f5c has no mapping to a cell. Oct 22 21:19:32.856662 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-e15c01f1-e953-4864-92fe-f0b91aa80871 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Request method failure captured: Oct 22 21:19:32.856662 ncdv-master-1 devstack@n-api.service[138745]: request: POST /compute/v2.1/servers/a0ca9b08-7d6b-4a30-a520-3bbb13054f5c/action HTTP/1.1 Oct 22 21:19:32.856662 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 21:19:32.856662 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 21:19:32.856662 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 21:19:32.856662 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 15 Oct 22 21:19:32.856662 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 21:19:32.856662 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 21:19:32.856662 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 21:19:32.856662 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 21:19:32.856662 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVF3hm7PiLG1R8Tw2syJVqR4znaBscty3weljpQpv2aVSYokkqaFvTxJu_8ZsVDxnVWNFBjrkTk4hem6vgNXmexe0yUI_M8pHEKoh5CWO6b1coilxRZ6VgX94mIL_xf6l3t9Q4mcnT856zV-XemvxZab0Ooy1ChU21L_her9Zn74z_zU Oct 22 21:19:32.856662 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 21:19:32.856662 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 21:19:32.856662 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 21:19:32.856662 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 21:19:32.856662 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 21:19:32.856662 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 21:19:32.856662 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: 28af724189a24022b3ef7651b7157a9d Oct 22 21:19:32.856662 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-ServersNegativeTestJSON-766586991 Oct 22 21:19:32.856662 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 21:19:32.856662 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 21:19:32.856662 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_28af724189a24022b3ef7651b7157a9d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/28af724189a24022b3ef7651b7157a9d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/28af724189a24022b3ef7651b7157a9d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/28af724189a24022b3ef7651b7157a9d"}]}] Oct 22 21:19:32.856662 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-ServersNegativeTestJSON-766586991 Oct 22 21:19:32.856662 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: 28af724189a24022b3ef7651b7157a9d Oct 22 21:19:32.856662 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-ServersNegativeTestJSON-766586991 Oct 22 21:19:32.856662 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-ServersNegativeTestJSON-766586991-project Oct 22 21:19:32.856662 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 21:19:32.856662 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 21:19:32.856662 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: 6c8a9229e7da421b9e0e6f7df52f71e2 Oct 22 21:19:32.856662 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-ServersNegativeTestJSON-766586991-project Oct 22 21:19:32.856662 ncdv-master-1 devstack@n-api.service[138745]: Oct 22 21:19:32.856662 ncdv-master-1 devstack@n-api.service[138745]: {"os-stop": {}} Oct 22 21:19:32.856662 ncdv-master-1 devstack@n-api.service[138745]: method: > Oct 22 21:19:32.856662 ncdv-master-1 devstack@n-api.service[138745]: exception: Instance a0ca9b08-7d6b-4a30-a520-3bbb13054f5c has no mapping to a cell. Oct 22 21:19:32.856662 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'id': 'a0ca9b08-7d6b-4a30-a520-3bbb13054f5c', 'body': {'os-stop': {}}} Oct 22 21:19:32.856662 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:19:32.856662 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:19:32.856662 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1411, in _get_instance Oct 22 21:19:32.856662 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi mapping = objects.InstanceMapping.get_by_instance_uuid( Oct 22 21:19:32.856662 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 22 21:19:32.856662 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 22 21:19:32.856662 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 112, in get_by_instance_uuid Oct 22 21:19:32.856662 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_instance_uuid_from_db(context, instance_uuid) Oct 22 21:19:32.856662 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 22 21:19:32.856662 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 22 21:19:32.856662 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 106, in _get_by_instance_uuid_from_db Oct 22 21:19:32.856662 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.InstanceMappingNotFound(uuid=instance_uuid) Oct 22 21:19:32.856662 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceMappingNotFound: Instance a0ca9b08-7d6b-4a30-a520-3bbb13054f5c has no mapping to a cell. Oct 22 21:19:32.856662 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:19:32.856662 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:19:32.856662 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:19:32.856662 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:19:32.856662 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:19:32.856662 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:19:32.856662 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:19:32.856662 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:19:32.856662 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:19:32.856662 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:19:32.856662 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1444, in _stop_server Oct 22 21:19:32.856662 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, id) Oct 22 21:19:32.856662 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1418, in _get_instance Oct 22 21:19:32.856662 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:19:32.856662 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a0ca9b08-7d6b-4a30-a520-3bbb13054f5c has no mapping to a cell. Oct 22 21:19:32.863569 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:19:32.863569 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:19:32.863569 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:19:32.863569 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:19:32.863569 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:19:32.863569 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:19:32.863569 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:19:32.863569 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:19:32.863569 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a0ca9b08-7d6b-4a30-a520-3bbb13054f5c has no mapping to a cell. Oct 22 21:19:32.863569 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:19:32.863569 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-e15c01f1-e953-4864-92fe-f0b91aa80871 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Returning 404 to user: Instance a0ca9b08-7d6b-4a30-a520-3bbb13054f5c has no mapping to a cell. {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:19:32.863569 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-e15c01f1-e953-4864-92fe-f0b91aa80871 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] 10.222.0.18 "POST /compute/v2.1/servers/a0ca9b08-7d6b-4a30-a520-3bbb13054f5c/action" status: 404 len: 117 microversion: 2.1 time: 0.021968 Oct 22 21:19:32.863569 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2647/5276] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 21:19:32 2022] POST /compute/v2.1/servers/a0ca9b08-7d6b-4a30-a520-3bbb13054f5c/action => generated 117 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 21:19:32.870254 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-138e5e22-b5d3-41ee-8d8a-2980ef4861db tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:19:32.871021 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-138e5e22-b5d3-41ee-8d8a-2980ef4861db tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] [instance: 3de67bb0-04d9-4d3a-a925-102f04d677bb] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:19:32.883229 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-138e5e22-b5d3-41ee-8d8a-2980ef4861db tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:19:32.884072 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-138e5e22-b5d3-41ee-8d8a-2980ef4861db tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:19:32.884630 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-138e5e22-b5d3-41ee-8d8a-2980ef4861db tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:19:32.885579 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-138e5e22-b5d3-41ee-8d8a-2980ef4861db tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:19:32.886259 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-138e5e22-b5d3-41ee-8d8a-2980ef4861db tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:19:32.886824 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-138e5e22-b5d3-41ee-8d8a-2980ef4861db tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:19:33.105133 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-138e5e22-b5d3-41ee-8d8a-2980ef4861db tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a9229e7da421b9e0e6f7df52f71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28af724189a24022b3ef7651b7157a9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:19:33.117573 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-138e5e22-b5d3-41ee-8d8a-2980ef4861db tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] 10.222.0.18 "GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb" status: 200 len: 1507 microversion: 2.1 time: 0.250811 Oct 22 21:19:33.118189 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2630/5277] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:19:32 2022] GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb => generated 1507 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:19:33.142360 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-08782f6b-c1f5-45ec-8c19-c295b2b73f27 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:19:33.143398 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-08782f6b-c1f5-45ec-8c19-c295b2b73f27 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] [instance: 3de67bb0-04d9-4d3a-a925-102f04d677bb] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:19:33.152893 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-08782f6b-c1f5-45ec-8c19-c295b2b73f27 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:19:33.154483 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-08782f6b-c1f5-45ec-8c19-c295b2b73f27 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:19:33.155175 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-08782f6b-c1f5-45ec-8c19-c295b2b73f27 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:19:33.156437 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-08782f6b-c1f5-45ec-8c19-c295b2b73f27 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:19:33.157020 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-08782f6b-c1f5-45ec-8c19-c295b2b73f27 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:19:33.157666 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-08782f6b-c1f5-45ec-8c19-c295b2b73f27 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:19:33.336689 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-08782f6b-c1f5-45ec-8c19-c295b2b73f27 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a9229e7da421b9e0e6f7df52f71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28af724189a24022b3ef7651b7157a9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:19:33.345993 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-08782f6b-c1f5-45ec-8c19-c295b2b73f27 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] 10.222.0.18 "GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb" status: 200 len: 1507 microversion: 2.1 time: 0.208076 Oct 22 21:19:33.346855 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2648/5278] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:19:33 2022] GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb => generated 1507 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:19:33.370552 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-dee8a400-cbbe-49ce-94d8-2b95a67df9d7 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:19:33.372025 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-dee8a400-cbbe-49ce-94d8-2b95a67df9d7 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] [instance: 544512ad-67b3-4023-bab1-f173e133094e] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:19:33.378592 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-dee8a400-cbbe-49ce-94d8-2b95a67df9d7 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] HTTP exception thrown: Instance 544512ad-67b3-4023-bab1-f173e133094e could not be found. Oct 22 21:19:33.380315 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-dee8a400-cbbe-49ce-94d8-2b95a67df9d7 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Request method failure captured: Oct 22 21:19:33.380315 ncdv-master-1 devstack@n-api.service[138744]: request: POST /compute/v2.1/servers/544512ad-67b3-4023-bab1-f173e133094e/action HTTP/1.1 Oct 22 21:19:33.380315 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 21:19:33.380315 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 21:19:33.380315 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 21:19:33.380315 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 15 Oct 22 21:19:33.380315 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 21:19:33.380315 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 21:19:33.380315 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 21:19:33.380315 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 21:19:33.380315 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVF3hm7PiLG1R8Tw2syJVqR4znaBscty3weljpQpv2aVSYokkqaFvTxJu_8ZsVDxnVWNFBjrkTk4hem6vgNXmexe0yUI_M8pHEKoh5CWO6b1coilxRZ6VgX94mIL_xf6l3t9Q4mcnT856zV-XemvxZab0Ooy1ChU21L_her9Zn74z_zU Oct 22 21:19:33.380315 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 21:19:33.380315 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 21:19:33.380315 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 21:19:33.380315 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 21:19:33.380315 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 21:19:33.380315 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 21:19:33.380315 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: 28af724189a24022b3ef7651b7157a9d Oct 22 21:19:33.380315 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-ServersNegativeTestJSON-766586991 Oct 22 21:19:33.380315 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 21:19:33.380315 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 21:19:33.380315 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_28af724189a24022b3ef7651b7157a9d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/28af724189a24022b3ef7651b7157a9d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/28af724189a24022b3ef7651b7157a9d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/28af724189a24022b3ef7651b7157a9d"}]}] Oct 22 21:19:33.380315 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-ServersNegativeTestJSON-766586991 Oct 22 21:19:33.380315 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: 28af724189a24022b3ef7651b7157a9d Oct 22 21:19:33.380315 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-ServersNegativeTestJSON-766586991 Oct 22 21:19:33.380315 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-ServersNegativeTestJSON-766586991-project Oct 22 21:19:33.380315 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 21:19:33.380315 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 21:19:33.380315 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: 6c8a9229e7da421b9e0e6f7df52f71e2 Oct 22 21:19:33.380315 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-ServersNegativeTestJSON-766586991-project Oct 22 21:19:33.380315 ncdv-master-1 devstack@n-api.service[138744]: Oct 22 21:19:33.380315 ncdv-master-1 devstack@n-api.service[138744]: {"suspend": {}} Oct 22 21:19:33.380315 ncdv-master-1 devstack@n-api.service[138744]: method: > Oct 22 21:19:33.380315 ncdv-master-1 devstack@n-api.service[138744]: exception: Instance 544512ad-67b3-4023-bab1-f173e133094e could not be found. Oct 22 21:19:33.380315 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': '544512ad-67b3-4023-bab1-f173e133094e', 'body': {'suspend': {}}} Oct 22 21:19:33.380315 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:19:33.380315 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:19:33.380315 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 21:19:33.380315 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 21:19:33.380315 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 21:19:33.380315 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 21:19:33.380315 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 22 21:19:33.380315 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 22 21:19:33.380315 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 544512ad-67b3-4023-bab1-f173e133094e could not be found. Oct 22 21:19:33.380315 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:19:33.380315 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:19:33.380315 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:19:33.380315 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:19:33.380315 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:19:33.380315 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:19:33.380315 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:19:33.380315 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:19:33.380315 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:19:33.380315 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:19:33.380315 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 35, in _suspend Oct 22 21:19:33.380315 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Oct 22 21:19:33.380315 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 21:19:33.380315 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:19:33.380315 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 544512ad-67b3-4023-bab1-f173e133094e could not be found. Oct 22 21:19:33.380315 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:19:33.380315 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:19:33.380315 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:19:33.380315 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:19:33.380315 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:19:33.380315 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:19:33.385217 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:19:33.385217 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:19:33.385217 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 544512ad-67b3-4023-bab1-f173e133094e could not be found. Oct 22 21:19:33.385217 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:19:33.386318 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-dee8a400-cbbe-49ce-94d8-2b95a67df9d7 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Returning 404 to user: Instance 544512ad-67b3-4023-bab1-f173e133094e could not be found. {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:19:33.387404 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-dee8a400-cbbe-49ce-94d8-2b95a67df9d7 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] 10.222.0.18 "POST /compute/v2.1/servers/544512ad-67b3-4023-bab1-f173e133094e/action" status: 404 len: 111 microversion: 2.1 time: 0.020944 Oct 22 21:19:33.391911 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2631/5279] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 21:19:33 2022] POST /compute/v2.1/servers/544512ad-67b3-4023-bab1-f173e133094e/action => generated 111 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 21:19:33.397362 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-a1b014aa-bcaa-4217-9776-c2696d36ff01 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:19:33.398128 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-a1b014aa-bcaa-4217-9776-c2696d36ff01 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] [instance: 3de67bb0-04d9-4d3a-a925-102f04d677bb] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:19:33.405944 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a1b014aa-bcaa-4217-9776-c2696d36ff01 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:19:33.406924 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a1b014aa-bcaa-4217-9776-c2696d36ff01 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:19:33.407191 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a1b014aa-bcaa-4217-9776-c2696d36ff01 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:19:33.407970 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a1b014aa-bcaa-4217-9776-c2696d36ff01 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:19:33.408468 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a1b014aa-bcaa-4217-9776-c2696d36ff01 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:19:33.409379 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a1b014aa-bcaa-4217-9776-c2696d36ff01 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:19:33.599486 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-a1b014aa-bcaa-4217-9776-c2696d36ff01 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a9229e7da421b9e0e6f7df52f71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28af724189a24022b3ef7651b7157a9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:19:33.616457 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-a1b014aa-bcaa-4217-9776-c2696d36ff01 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] 10.222.0.18 "GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb" status: 200 len: 1507 microversion: 2.1 time: 0.223363 Oct 22 21:19:33.617338 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2649/5280] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:19:33 2022] GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb => generated 1507 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:19:33.661804 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-ade7bcb6-83cf-4ed9-91ed-5e8c4a5e2eaf tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:19:33.662450 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-ade7bcb6-83cf-4ed9-91ed-5e8c4a5e2eaf tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] [instance: 3de67bb0-04d9-4d3a-a925-102f04d677bb] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:19:33.677877 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ade7bcb6-83cf-4ed9-91ed-5e8c4a5e2eaf tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:19:33.680691 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ade7bcb6-83cf-4ed9-91ed-5e8c4a5e2eaf tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:19:33.681277 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ade7bcb6-83cf-4ed9-91ed-5e8c4a5e2eaf tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:19:33.682038 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ade7bcb6-83cf-4ed9-91ed-5e8c4a5e2eaf tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:19:33.682995 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ade7bcb6-83cf-4ed9-91ed-5e8c4a5e2eaf tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:19:33.682995 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ade7bcb6-83cf-4ed9-91ed-5e8c4a5e2eaf tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:19:33.882268 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-ade7bcb6-83cf-4ed9-91ed-5e8c4a5e2eaf tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a9229e7da421b9e0e6f7df52f71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28af724189a24022b3ef7651b7157a9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:19:33.892085 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-ade7bcb6-83cf-4ed9-91ed-5e8c4a5e2eaf tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] 10.222.0.18 "GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb" status: 200 len: 1507 microversion: 2.1 time: 0.238301 Oct 22 21:19:33.903854 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2632/5281] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:19:33 2022] GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb => generated 1507 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:19:33.918652 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-738fafb3-121f-4fc7-898d-50675435885b tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:19:33.920612 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-738fafb3-121f-4fc7-898d-50675435885b tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] [instance: 3de67bb0-04d9-4d3a-a925-102f04d677bb] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:19:33.946116 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-738fafb3-121f-4fc7-898d-50675435885b tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:19:33.951330 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-738fafb3-121f-4fc7-898d-50675435885b tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:19:33.952640 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-738fafb3-121f-4fc7-898d-50675435885b tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:19:33.955646 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-738fafb3-121f-4fc7-898d-50675435885b tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:19:33.957121 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-738fafb3-121f-4fc7-898d-50675435885b tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:19:33.958867 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-738fafb3-121f-4fc7-898d-50675435885b tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:19:34.018945 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.objects.instance [None req-738fafb3-121f-4fc7-898d-50675435885b tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lazy-loading 'flavor' on Instance uuid 3de67bb0-04d9-4d3a-a925-102f04d677bb {{(pid=138745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 21:19:34.153889 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-738fafb3-121f-4fc7-898d-50675435885b tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] 10.222.0.18 "POST /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb/action" status: 202 len: 0 microversion: 2.1 time: 0.240242 Oct 22 21:19:34.154543 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2650/5282] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 21:19:33 2022] POST /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb/action => generated 0 bytes in 242 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 22 21:19:34.165153 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-33e18e03-8df1-4737-8963-730d6e984b5d tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:19:34.166613 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-33e18e03-8df1-4737-8963-730d6e984b5d tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] [instance: 3de67bb0-04d9-4d3a-a925-102f04d677bb] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:19:34.182151 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-33e18e03-8df1-4737-8963-730d6e984b5d tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:19:34.185344 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-33e18e03-8df1-4737-8963-730d6e984b5d tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:19:34.186041 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-33e18e03-8df1-4737-8963-730d6e984b5d tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:19:34.189185 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-33e18e03-8df1-4737-8963-730d6e984b5d tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:19:34.189873 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-33e18e03-8df1-4737-8963-730d6e984b5d tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:19:34.190506 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-33e18e03-8df1-4737-8963-730d6e984b5d tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:19:34.579056 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-33e18e03-8df1-4737-8963-730d6e984b5d tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a9229e7da421b9e0e6f7df52f71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28af724189a24022b3ef7651b7157a9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:19:34.590970 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-33e18e03-8df1-4737-8963-730d6e984b5d tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] 10.222.0.18 "GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb" status: 200 len: 1515 microversion: 2.1 time: 0.430124 Oct 22 21:19:34.604656 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2633/5283] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:19:34 2022] GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb => generated 1515 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:19:35.565108 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-a89b9323-2200-4a2b-9226-57dbf22196fe req-283075ee-bcae-4104-8823-1bc3837638d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20d90b58-3fad-4a44-b6bf-4ef0cc587def", "name": "network-vif-unplugged", "status": "completed", "tag": "7ef4550f-d128-432a-9dbc-ce1802e6c6da"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:19:35.577301 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_api:SELECT=40 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:19:35.591038 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-a89b9323-2200-4a2b-9226-57dbf22196fe req-283075ee-bcae-4104-8823-1bc3837638d7 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:19:35.593378 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-a89b9323-2200-4a2b-9226-57dbf22196fe req-283075ee-bcae-4104-8823-1bc3837638d7 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:19:35.594218 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-a89b9323-2200-4a2b-9226-57dbf22196fe req-283075ee-bcae-4104-8823-1bc3837638d7 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:19:35.616572 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-585859fb-f6c3-4210-b044-7f9bb329a5be tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:19:35.617121 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-585859fb-f6c3-4210-b044-7f9bb329a5be tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] [instance: 3de67bb0-04d9-4d3a-a925-102f04d677bb] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:19:35.618146 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-a89b9323-2200-4a2b-9226-57dbf22196fe req-283075ee-bcae-4104-8823-1bc3837638d7 service nova] Creating event network-vif-unplugged:7ef4550f-d128-432a-9dbc-ce1802e6c6da for instance 20d90b58-3fad-4a44-b6bf-4ef0cc587def on nch1-master-1 Oct 22 21:19:35.627161 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-585859fb-f6c3-4210-b044-7f9bb329a5be tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:19:35.627697 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-585859fb-f6c3-4210-b044-7f9bb329a5be tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:19:35.628157 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-585859fb-f6c3-4210-b044-7f9bb329a5be tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:19:35.628883 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-585859fb-f6c3-4210-b044-7f9bb329a5be tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:19:35.629348 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-585859fb-f6c3-4210-b044-7f9bb329a5be tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:19:35.629786 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-585859fb-f6c3-4210-b044-7f9bb329a5be tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:19:35.630616 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-a89b9323-2200-4a2b-9226-57dbf22196fe req-283075ee-bcae-4104-8823-1bc3837638d7 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.072953 Oct 22 21:19:35.633787 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2651/5284] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:19:35 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:19:36.034841 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-585859fb-f6c3-4210-b044-7f9bb329a5be tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a9229e7da421b9e0e6f7df52f71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28af724189a24022b3ef7651b7157a9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:19:36.049752 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-585859fb-f6c3-4210-b044-7f9bb329a5be tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] 10.222.0.18 "GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb" status: 200 len: 1498 microversion: 2.1 time: 0.437104 Oct 22 21:19:36.051467 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2634/5285] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:19:35 2022] GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb => generated 1498 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:19:36.077266 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-b78277db-edd5-4cd0-bcc7-1c7c44a008e7 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:19:36.078502 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-b78277db-edd5-4cd0-bcc7-1c7c44a008e7 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] [instance: 3de67bb0-04d9-4d3a-a925-102f04d677bb] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:19:36.088714 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b78277db-edd5-4cd0-bcc7-1c7c44a008e7 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:19:36.089694 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b78277db-edd5-4cd0-bcc7-1c7c44a008e7 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:19:36.090427 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b78277db-edd5-4cd0-bcc7-1c7c44a008e7 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:19:36.091425 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b78277db-edd5-4cd0-bcc7-1c7c44a008e7 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:19:36.092089 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b78277db-edd5-4cd0-bcc7-1c7c44a008e7 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:19:36.092698 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b78277db-edd5-4cd0-bcc7-1c7c44a008e7 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:19:36.159333 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.objects.instance [None req-b78277db-edd5-4cd0-bcc7-1c7c44a008e7 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lazy-loading 'flavor' on Instance uuid 3de67bb0-04d9-4d3a-a925-102f04d677bb {{(pid=138745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 21:19:36.184278 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.wsgi [None req-b78277db-edd5-4cd0-bcc7-1c7c44a008e7 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] HTTP exception thrown: Cannot 'suspend' instance 3de67bb0-04d9-4d3a-a925-102f04d677bb while it is in vm_state suspended Oct 22 21:19:36.188224 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-b78277db-edd5-4cd0-bcc7-1c7c44a008e7 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Request method failure captured: Oct 22 21:19:36.188224 ncdv-master-1 devstack@n-api.service[138745]: request: POST /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb/action HTTP/1.1 Oct 22 21:19:36.188224 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 21:19:36.188224 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 21:19:36.188224 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 21:19:36.188224 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 15 Oct 22 21:19:36.188224 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 21:19:36.188224 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 21:19:36.188224 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 21:19:36.188224 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 21:19:36.188224 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVF3hm7PiLG1R8Tw2syJVqR4znaBscty3weljpQpv2aVSYokkqaFvTxJu_8ZsVDxnVWNFBjrkTk4hem6vgNXmexe0yUI_M8pHEKoh5CWO6b1coilxRZ6VgX94mIL_xf6l3t9Q4mcnT856zV-XemvxZab0Ooy1ChU21L_her9Zn74z_zU Oct 22 21:19:36.188224 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 21:19:36.188224 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 21:19:36.188224 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 21:19:36.188224 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 21:19:36.188224 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 21:19:36.188224 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 21:19:36.188224 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: 28af724189a24022b3ef7651b7157a9d Oct 22 21:19:36.188224 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-ServersNegativeTestJSON-766586991 Oct 22 21:19:36.188224 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 21:19:36.188224 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 21:19:36.188224 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_28af724189a24022b3ef7651b7157a9d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/28af724189a24022b3ef7651b7157a9d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/28af724189a24022b3ef7651b7157a9d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/28af724189a24022b3ef7651b7157a9d"}]}] Oct 22 21:19:36.188224 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-ServersNegativeTestJSON-766586991 Oct 22 21:19:36.188224 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: 28af724189a24022b3ef7651b7157a9d Oct 22 21:19:36.188224 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-ServersNegativeTestJSON-766586991 Oct 22 21:19:36.188224 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-ServersNegativeTestJSON-766586991-project Oct 22 21:19:36.188224 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 21:19:36.188224 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 21:19:36.188224 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: 6c8a9229e7da421b9e0e6f7df52f71e2 Oct 22 21:19:36.188224 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-ServersNegativeTestJSON-766586991-project Oct 22 21:19:36.188224 ncdv-master-1 devstack@n-api.service[138745]: Oct 22 21:19:36.188224 ncdv-master-1 devstack@n-api.service[138745]: {"suspend": {}} Oct 22 21:19:36.188224 ncdv-master-1 devstack@n-api.service[138745]: method: > Oct 22 21:19:36.188224 ncdv-master-1 devstack@n-api.service[138745]: exception: Cannot 'suspend' instance 3de67bb0-04d9-4d3a-a925-102f04d677bb while it is in vm_state suspended Oct 22 21:19:36.188224 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'id': '3de67bb0-04d9-4d3a-a925-102f04d677bb', 'body': {'suspend': {}}} Oct 22 21:19:36.188224 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:19:36.188224 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:19:36.188224 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 40, in _suspend Oct 22 21:19:36.188224 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi self.compute_api.suspend(context, server) Oct 22 21:19:36.188224 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 22 21:19:36.188224 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 22 21:19:36.188224 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 22 21:19:36.188224 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 22 21:19:36.188224 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 22 21:19:36.188224 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 22 21:19:36.188224 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Oct 22 21:19:36.188224 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 22 21:19:36.188224 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 22 21:19:36.188224 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 22 21:19:36.188224 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 22 21:19:36.188224 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 22 21:19:36.188224 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 3de67bb0-04d9-4d3a-a925-102f04d677bb in vm_state suspended. Cannot suspend while the instance is in this state. Oct 22 21:19:36.188224 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:19:36.188224 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:19:36.188224 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:19:36.188224 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:19:36.188224 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:19:36.188224 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:19:36.188224 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:19:36.188224 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:19:36.188224 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:19:36.188224 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:19:36.188224 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 44, in _suspend Oct 22 21:19:36.188224 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 22 21:19:36.193169 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 22 21:19:36.193169 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 22 21:19:36.193169 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'suspend' instance 3de67bb0-04d9-4d3a-a925-102f04d677bb while it is in vm_state suspended Oct 22 21:19:36.193169 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:19:36.193169 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:19:36.193169 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:19:36.193169 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:19:36.193169 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:19:36.193169 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:19:36.193169 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:19:36.193169 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:19:36.193169 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'suspend' instance 3de67bb0-04d9-4d3a-a925-102f04d677bb while it is in vm_state suspended Oct 22 21:19:36.193169 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:19:36.196485 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-b78277db-edd5-4cd0-bcc7-1c7c44a008e7 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Returning 409 to user: Cannot 'suspend' instance 3de67bb0-04d9-4d3a-a925-102f04d677bb while it is in vm_state suspended {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:19:36.199026 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-b78277db-edd5-4cd0-bcc7-1c7c44a008e7 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] 10.222.0.18 "POST /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb/action" status: 409 len: 148 microversion: 2.1 time: 0.126632 Oct 22 21:19:36.205274 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2652/5286] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 21:19:36 2022] POST /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb/action => generated 148 bytes in 135 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 22 21:19:36.211094 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-061a2496-20a3-48ad-9825-90d75fb632c6 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:19:36.211663 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-061a2496-20a3-48ad-9825-90d75fb632c6 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] [instance: 3de67bb0-04d9-4d3a-a925-102f04d677bb] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:19:36.218913 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-061a2496-20a3-48ad-9825-90d75fb632c6 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:19:36.219945 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-061a2496-20a3-48ad-9825-90d75fb632c6 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:19:36.220401 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-061a2496-20a3-48ad-9825-90d75fb632c6 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:19:36.221140 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-061a2496-20a3-48ad-9825-90d75fb632c6 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:19:36.221608 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-061a2496-20a3-48ad-9825-90d75fb632c6 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:19:36.222048 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-061a2496-20a3-48ad-9825-90d75fb632c6 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:19:36.335791 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-061a2496-20a3-48ad-9825-90d75fb632c6 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] 10.222.0.18 "POST /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb/action" status: 202 len: 0 microversion: 2.1 time: 0.128473 Oct 22 21:19:36.338089 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2635/5287] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 21:19:36 2022] POST /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb/action => generated 0 bytes in 132 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 21:19:36.348470 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-60b6e95d-e227-46e6-af22-7ed4d27d45d5 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:19:36.349411 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-60b6e95d-e227-46e6-af22-7ed4d27d45d5 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] [instance: 3de67bb0-04d9-4d3a-a925-102f04d677bb] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:19:36.362950 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-60b6e95d-e227-46e6-af22-7ed4d27d45d5 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:19:36.367236 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-60b6e95d-e227-46e6-af22-7ed4d27d45d5 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:19:36.368244 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-60b6e95d-e227-46e6-af22-7ed4d27d45d5 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:19:36.369201 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-60b6e95d-e227-46e6-af22-7ed4d27d45d5 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:19:36.371523 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-60b6e95d-e227-46e6-af22-7ed4d27d45d5 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:19:36.372197 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-60b6e95d-e227-46e6-af22-7ed4d27d45d5 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:19:36.785245 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-60b6e95d-e227-46e6-af22-7ed4d27d45d5 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a9229e7da421b9e0e6f7df52f71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28af724189a24022b3ef7651b7157a9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:19:36.814365 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-60b6e95d-e227-46e6-af22-7ed4d27d45d5 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] 10.222.0.18 "GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb" status: 200 len: 1504 microversion: 2.1 time: 0.472131 Oct 22 21:19:36.815882 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2653/5288] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:19:36 2022] GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb => generated 1504 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:19:37.850273 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-a980492f-86e0-488d-b362-d03a02fbe135 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:19:37.851808 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-a980492f-86e0-488d-b362-d03a02fbe135 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] [instance: 3de67bb0-04d9-4d3a-a925-102f04d677bb] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:19:37.867637 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a980492f-86e0-488d-b362-d03a02fbe135 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:19:37.868559 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a980492f-86e0-488d-b362-d03a02fbe135 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:19:37.869229 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a980492f-86e0-488d-b362-d03a02fbe135 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:19:37.874302 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a980492f-86e0-488d-b362-d03a02fbe135 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:19:37.875622 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a980492f-86e0-488d-b362-d03a02fbe135 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:19:37.876821 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a980492f-86e0-488d-b362-d03a02fbe135 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:19:38.243792 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-a980492f-86e0-488d-b362-d03a02fbe135 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a9229e7da421b9e0e6f7df52f71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28af724189a24022b3ef7651b7157a9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:19:38.256608 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-a980492f-86e0-488d-b362-d03a02fbe135 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] 10.222.0.18 "GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb" status: 200 len: 1504 microversion: 2.1 time: 0.418450 Oct 22 21:19:38.257822 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2636/5289] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:19:37 2022] GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb => generated 1504 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:19:39.288801 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-0756c9f1-c950-405e-9fcc-103d199617d7 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:19:39.290431 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-0756c9f1-c950-405e-9fcc-103d199617d7 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] [instance: 3de67bb0-04d9-4d3a-a925-102f04d677bb] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:19:39.314608 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0756c9f1-c950-405e-9fcc-103d199617d7 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:19:39.315868 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0756c9f1-c950-405e-9fcc-103d199617d7 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:19:39.316564 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0756c9f1-c950-405e-9fcc-103d199617d7 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:19:39.317482 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0756c9f1-c950-405e-9fcc-103d199617d7 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:19:39.318196 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0756c9f1-c950-405e-9fcc-103d199617d7 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:19:39.318557 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0756c9f1-c950-405e-9fcc-103d199617d7 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:19:39.504752 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-0756c9f1-c950-405e-9fcc-103d199617d7 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a9229e7da421b9e0e6f7df52f71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28af724189a24022b3ef7651b7157a9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:19:39.517744 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-0756c9f1-c950-405e-9fcc-103d199617d7 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] 10.222.0.18 "GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb" status: 200 len: 1507 microversion: 2.1 time: 0.238560 Oct 22 21:19:39.529110 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2654/5290] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:19:39 2022] GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb => generated 1507 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:19:39.552506 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-5d711f16-ba31-4d64-9ae5-b22d22047800 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:19:39.554450 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-5d711f16-ba31-4d64-9ae5-b22d22047800 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] [instance: 3de67bb0-04d9-4d3a-a925-102f04d677bb] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:19:39.563865 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5d711f16-ba31-4d64-9ae5-b22d22047800 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:19:39.564981 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5d711f16-ba31-4d64-9ae5-b22d22047800 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:19:39.565650 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5d711f16-ba31-4d64-9ae5-b22d22047800 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:19:39.566473 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5d711f16-ba31-4d64-9ae5-b22d22047800 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:19:39.567105 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5d711f16-ba31-4d64-9ae5-b22d22047800 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:19:39.567785 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5d711f16-ba31-4d64-9ae5-b22d22047800 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:19:39.634442 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-64d438e3-e8ba-4b30-b85d-f3c766ce7b1b tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-182479090", "imageRef": "085e4478-6edc-4a69-8e08-f9831713eb65", "flavorRef": "452", "networks": [{"uuid": "e6b635f6-c8b1-4d13-922e-5ce3087d5e15"}]}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:19:39.705450 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.network.neutron [None req-64d438e3-e8ba-4b30-b85d-f3c766ce7b1b tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] validate_networks() for [('e6b635f6-c8b1-4d13-922e-5ce3087d5e15', None, None, None, None, None)] {{(pid=138745) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 21:19:39.801648 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-5d711f16-ba31-4d64-9ae5-b22d22047800 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a9229e7da421b9e0e6f7df52f71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28af724189a24022b3ef7651b7157a9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:19:39.813849 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-5d711f16-ba31-4d64-9ae5-b22d22047800 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] 10.222.0.18 "GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb" status: 200 len: 1507 microversion: 2.1 time: 0.265636 Oct 22 21:19:39.816034 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2637/5291] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:19:39 2022] GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb => generated 1507 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:19:39.853171 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-29c77eb7-c4e4-457d-af97-94fce78e2f28 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:19:39.853737 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-29c77eb7-c4e4-457d-af97-94fce78e2f28 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] [instance: 6e059afe-4c55-4ca1-ba4a-ce041da589d1] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:19:39.871502 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-29c77eb7-c4e4-457d-af97-94fce78e2f28 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] HTTP exception thrown: Instance 6e059afe-4c55-4ca1-ba4a-ce041da589d1 could not be found. Oct 22 21:19:39.874460 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-29c77eb7-c4e4-457d-af97-94fce78e2f28 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Request method failure captured: Oct 22 21:19:39.874460 ncdv-master-1 devstack@n-api.service[138744]: request: POST /compute/v2.1/servers/6e059afe-4c55-4ca1-ba4a-ce041da589d1/action HTTP/1.1 Oct 22 21:19:39.874460 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 21:19:39.874460 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 21:19:39.874460 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 21:19:39.874460 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 15 Oct 22 21:19:39.874460 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 21:19:39.874460 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 21:19:39.874460 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 21:19:39.874460 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 21:19:39.874460 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVF3hm7PiLG1R8Tw2syJVqR4znaBscty3weljpQpv2aVSYokkqaFvTxJu_8ZsVDxnVWNFBjrkTk4hem6vgNXmexe0yUI_M8pHEKoh5CWO6b1coilxRZ6VgX94mIL_xf6l3t9Q4mcnT856zV-XemvxZab0Ooy1ChU21L_her9Zn74z_zU Oct 22 21:19:39.874460 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 21:19:39.874460 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 21:19:39.874460 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 21:19:39.874460 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 21:19:39.874460 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 21:19:39.874460 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 21:19:39.874460 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: 28af724189a24022b3ef7651b7157a9d Oct 22 21:19:39.874460 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-ServersNegativeTestJSON-766586991 Oct 22 21:19:39.874460 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 21:19:39.874460 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 21:19:39.874460 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_28af724189a24022b3ef7651b7157a9d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/28af724189a24022b3ef7651b7157a9d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/28af724189a24022b3ef7651b7157a9d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/28af724189a24022b3ef7651b7157a9d"}]}] Oct 22 21:19:39.874460 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-ServersNegativeTestJSON-766586991 Oct 22 21:19:39.874460 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: 28af724189a24022b3ef7651b7157a9d Oct 22 21:19:39.874460 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-ServersNegativeTestJSON-766586991 Oct 22 21:19:39.874460 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-ServersNegativeTestJSON-766586991-project Oct 22 21:19:39.874460 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 21:19:39.874460 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 21:19:39.874460 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: 6c8a9229e7da421b9e0e6f7df52f71e2 Oct 22 21:19:39.874460 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-ServersNegativeTestJSON-766586991-project Oct 22 21:19:39.874460 ncdv-master-1 devstack@n-api.service[138744]: Oct 22 21:19:39.874460 ncdv-master-1 devstack@n-api.service[138744]: {"unpause": {}} Oct 22 21:19:39.874460 ncdv-master-1 devstack@n-api.service[138744]: method: > Oct 22 21:19:39.874460 ncdv-master-1 devstack@n-api.service[138744]: exception: Instance 6e059afe-4c55-4ca1-ba4a-ce041da589d1 could not be found. Oct 22 21:19:39.874460 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': '6e059afe-4c55-4ca1-ba4a-ce041da589d1', 'body': {'unpause': {}}} Oct 22 21:19:39.874460 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:19:39.874460 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:19:39.874460 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 21:19:39.874460 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 21:19:39.874460 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 21:19:39.874460 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 21:19:39.874460 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 22 21:19:39.874460 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 22 21:19:39.874460 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e059afe-4c55-4ca1-ba4a-ce041da589d1 could not be found. Oct 22 21:19:39.874460 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:19:39.874460 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:19:39.874460 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:19:39.874460 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:19:39.874460 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:19:39.874460 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:19:39.874460 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:19:39.874460 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:19:39.874460 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:19:39.874460 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:19:39.874460 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 58, in _unpause Oct 22 21:19:39.874460 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Oct 22 21:19:39.874460 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 21:19:39.874460 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:19:39.874460 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e059afe-4c55-4ca1-ba4a-ce041da589d1 could not be found. Oct 22 21:19:39.874460 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:19:39.874460 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:19:39.874460 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:19:39.874460 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:19:39.874460 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:19:39.874460 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:19:39.879075 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:19:39.879075 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:19:39.879075 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e059afe-4c55-4ca1-ba4a-ce041da589d1 could not be found. Oct 22 21:19:39.879075 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:19:39.880352 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-29c77eb7-c4e4-457d-af97-94fce78e2f28 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Returning 404 to user: Instance 6e059afe-4c55-4ca1-ba4a-ce041da589d1 could not be found. {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:19:39.881914 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-29c77eb7-c4e4-457d-af97-94fce78e2f28 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] 10.222.0.18 "POST /compute/v2.1/servers/6e059afe-4c55-4ca1-ba4a-ce041da589d1/action" status: 404 len: 111 microversion: 2.1 time: 0.042547 Oct 22 21:19:39.883022 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2638/5292] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 21:19:39 2022] POST /compute/v2.1/servers/6e059afe-4c55-4ca1-ba4a-ce041da589d1/action => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 21:19:39.891978 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-025390ef-5d38-497f-9187-88ed1b214044 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:19:39.895453 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-025390ef-5d38-497f-9187-88ed1b214044 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] [instance: 3de67bb0-04d9-4d3a-a925-102f04d677bb] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:19:39.909233 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-025390ef-5d38-497f-9187-88ed1b214044 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:19:39.909976 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-025390ef-5d38-497f-9187-88ed1b214044 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:19:39.910627 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-025390ef-5d38-497f-9187-88ed1b214044 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:19:39.911700 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-025390ef-5d38-497f-9187-88ed1b214044 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:19:39.912320 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-025390ef-5d38-497f-9187-88ed1b214044 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:19:39.913423 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-025390ef-5d38-497f-9187-88ed1b214044 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:19:40.549424 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-025390ef-5d38-497f-9187-88ed1b214044 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a9229e7da421b9e0e6f7df52f71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28af724189a24022b3ef7651b7157a9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:19:40.560421 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-025390ef-5d38-497f-9187-88ed1b214044 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] 10.222.0.18 "GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb" status: 200 len: 1507 microversion: 2.1 time: 0.672535 Oct 22 21:19:40.562060 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2639/5293] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:19:39 2022] GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb => generated 1507 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:19:40.585242 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-95c89d47-c857-43ce-986c-c2990a4a5033 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:19:40.586374 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-95c89d47-c857-43ce-986c-c2990a4a5033 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] [instance: 3de67bb0-04d9-4d3a-a925-102f04d677bb] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:19:40.594255 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-95c89d47-c857-43ce-986c-c2990a4a5033 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:19:40.595151 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-95c89d47-c857-43ce-986c-c2990a4a5033 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:19:40.595829 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-95c89d47-c857-43ce-986c-c2990a4a5033 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:19:40.597047 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-95c89d47-c857-43ce-986c-c2990a4a5033 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:19:40.597567 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-64d438e3-e8ba-4b30-b85d-f3c766ce7b1b tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Flavor limits 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 21:19:40.598049 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-64d438e3-e8ba-4b30-b85d-f3c766ce7b1b tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Image limits 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 21:19:40.598368 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-64d438e3-e8ba-4b30-b85d-f3c766ce7b1b tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Flavor pref 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 21:19:40.598701 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-95c89d47-c857-43ce-986c-c2990a4a5033 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:19:40.598917 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-64d438e3-e8ba-4b30-b85d-f3c766ce7b1b tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Image pref 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 21:19:40.599449 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-64d438e3-e8ba-4b30-b85d-f3c766ce7b1b tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 21:19:40.602991 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-95c89d47-c857-43ce-986c-c2990a4a5033 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:19:40.611642 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-64d438e3-e8ba-4b30-b85d-f3c766ce7b1b tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:19:40.612302 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-64d438e3-e8ba-4b30-b85d-f3c766ce7b1b tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:19:40.613000 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-64d438e3-e8ba-4b30-b85d-f3c766ce7b1b tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:19:40.613761 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-64d438e3-e8ba-4b30-b85d-f3c766ce7b1b tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:19:40.614238 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-64d438e3-e8ba-4b30-b85d-f3c766ce7b1b tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:19:40.614684 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-64d438e3-e8ba-4b30-b85d-f3c766ce7b1b tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:19:40.639393 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-64d438e3-e8ba-4b30-b85d-f3c766ce7b1b tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Getting quotas for project 8bb594dfc7d54c26b2badde74ee74d18. Resources: {'cores', 'instances', 'ram'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 21:19:40.646838 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-64d438e3-e8ba-4b30-b85d-f3c766ce7b1b tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Getting quotas for user 712b1eb4d5f542219f248896a5b85be3 and project 8bb594dfc7d54c26b2badde74ee74d18. Resources: {'cores', 'instances', 'ram'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 21:19:40.670662 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-64d438e3-e8ba-4b30-b85d-f3c766ce7b1b tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Going to run 1 instances... {{(pid=138745) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 21:19:40.674318 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-64d438e3-e8ba-4b30-b85d-f3c766ce7b1b tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] [instance: 7c614e45-6138-43f4-85a5-303093b91055] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='085e4478-6edc-4a69-8e08-f9831713eb65',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138745) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 21:19:40.746065 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-64d438e3-e8ba-4b30-b85d-f3c766ce7b1b tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.116407 Oct 22 21:19:40.747419 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2655/5294] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Oct 22 21:19:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 1118 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 21:19:40.761606 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-fb43c911-b5d6-487d-81eb-29ce9f120414 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:19:40.762432 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-fb43c911-b5d6-487d-81eb-29ce9f120414 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] [instance: 7c614e45-6138-43f4-85a5-303093b91055] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:19:40.810424 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-95c89d47-c857-43ce-986c-c2990a4a5033 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a9229e7da421b9e0e6f7df52f71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28af724189a24022b3ef7651b7157a9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:19:40.820518 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-95c89d47-c857-43ce-986c-c2990a4a5033 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] 10.222.0.18 "GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb" status: 200 len: 1507 microversion: 2.1 time: 0.238832 Oct 22 21:19:40.830656 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2640/5295] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:19:40 2022] GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb => generated 1507 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:19:40.845981 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-fa96975d-1406-4075-9900-134ccc67d783 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:19:40.853355 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-fa96975d-1406-4075-9900-134ccc67d783 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] [instance: 3de67bb0-04d9-4d3a-a925-102f04d677bb] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:19:40.865311 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-fb43c911-b5d6-487d-81eb-29ce9f120414 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712b1eb4d5f542219f248896a5b85be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb594dfc7d54c26b2badde74ee74d18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:19:40.869623 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fa96975d-1406-4075-9900-134ccc67d783 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:19:40.870120 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fa96975d-1406-4075-9900-134ccc67d783 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:19:40.874459 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-fb43c911-b5d6-487d-81eb-29ce9f120414 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] 10.222.0.18 "GET /compute/v2.1/servers/7c614e45-6138-43f4-85a5-303093b91055" status: 200 len: 1213 microversion: 2.1 time: 0.118564 Oct 22 21:19:40.875071 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2656/5296] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:19:40 2022] GET /compute/v2.1/servers/7c614e45-6138-43f4-85a5-303093b91055 => generated 1213 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:19:40.888608 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fa96975d-1406-4075-9900-134ccc67d783 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:19:40.888608 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fa96975d-1406-4075-9900-134ccc67d783 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:19:40.888608 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fa96975d-1406-4075-9900-134ccc67d783 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:19:40.888608 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fa96975d-1406-4075-9900-134ccc67d783 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:19:40.938823 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-fa96975d-1406-4075-9900-134ccc67d783 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] HTTP exception thrown: Cannot 'unpause' instance 3de67bb0-04d9-4d3a-a925-102f04d677bb while it is in vm_state active Oct 22 21:19:40.940521 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-fa96975d-1406-4075-9900-134ccc67d783 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Request method failure captured: Oct 22 21:19:40.940521 ncdv-master-1 devstack@n-api.service[138744]: request: POST /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb/action HTTP/1.1 Oct 22 21:19:40.940521 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 21:19:40.940521 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 21:19:40.940521 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 21:19:40.940521 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 15 Oct 22 21:19:40.940521 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 21:19:40.940521 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 21:19:40.940521 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 21:19:40.940521 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 21:19:40.940521 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVF3hm7PiLG1R8Tw2syJVqR4znaBscty3weljpQpv2aVSYokkqaFvTxJu_8ZsVDxnVWNFBjrkTk4hem6vgNXmexe0yUI_M8pHEKoh5CWO6b1coilxRZ6VgX94mIL_xf6l3t9Q4mcnT856zV-XemvxZab0Ooy1ChU21L_her9Zn74z_zU Oct 22 21:19:40.940521 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 21:19:40.940521 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 21:19:40.940521 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 21:19:40.940521 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 21:19:40.940521 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 21:19:40.940521 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 21:19:40.940521 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: 28af724189a24022b3ef7651b7157a9d Oct 22 21:19:40.940521 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-ServersNegativeTestJSON-766586991 Oct 22 21:19:40.940521 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 21:19:40.940521 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 21:19:40.940521 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_28af724189a24022b3ef7651b7157a9d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/28af724189a24022b3ef7651b7157a9d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/28af724189a24022b3ef7651b7157a9d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/28af724189a24022b3ef7651b7157a9d"}]}] Oct 22 21:19:40.940521 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-ServersNegativeTestJSON-766586991 Oct 22 21:19:40.940521 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: 28af724189a24022b3ef7651b7157a9d Oct 22 21:19:40.940521 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-ServersNegativeTestJSON-766586991 Oct 22 21:19:40.940521 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-ServersNegativeTestJSON-766586991-project Oct 22 21:19:40.940521 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 21:19:40.940521 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 21:19:40.940521 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: 6c8a9229e7da421b9e0e6f7df52f71e2 Oct 22 21:19:40.940521 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-ServersNegativeTestJSON-766586991-project Oct 22 21:19:40.940521 ncdv-master-1 devstack@n-api.service[138744]: Oct 22 21:19:40.940521 ncdv-master-1 devstack@n-api.service[138744]: {"unpause": {}} Oct 22 21:19:40.940521 ncdv-master-1 devstack@n-api.service[138744]: method: > Oct 22 21:19:40.940521 ncdv-master-1 devstack@n-api.service[138744]: exception: Cannot 'unpause' instance 3de67bb0-04d9-4d3a-a925-102f04d677bb while it is in vm_state active Oct 22 21:19:40.940521 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': '3de67bb0-04d9-4d3a-a925-102f04d677bb', 'body': {'unpause': {}}} Oct 22 21:19:40.940521 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:19:40.940521 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:19:40.940521 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 62, in _unpause Oct 22 21:19:40.940521 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi self.compute_api.unpause(ctxt, server) Oct 22 21:19:40.940521 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 22 21:19:40.940521 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 22 21:19:40.940521 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 22 21:19:40.940521 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 22 21:19:40.940521 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 3de67bb0-04d9-4d3a-a925-102f04d677bb in vm_state active. Cannot unpause while the instance is in this state. Oct 22 21:19:40.940521 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:19:40.940521 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:19:40.940521 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:19:40.940521 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:19:40.940521 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:19:40.940521 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:19:40.940521 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:19:40.940521 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:19:40.940521 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:19:40.940521 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:19:40.940521 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 66, in _unpause Oct 22 21:19:40.940521 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 22 21:19:40.940521 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 22 21:19:40.940521 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 22 21:19:40.940521 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unpause' instance 3de67bb0-04d9-4d3a-a925-102f04d677bb while it is in vm_state active Oct 22 21:19:40.940521 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:19:40.940521 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:19:40.940521 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:19:40.940521 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:19:40.940521 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:19:40.945830 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:19:40.945830 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:19:40.945830 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:19:40.945830 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unpause' instance 3de67bb0-04d9-4d3a-a925-102f04d677bb while it is in vm_state active Oct 22 21:19:40.945830 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:19:40.945830 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-fa96975d-1406-4075-9900-134ccc67d783 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Returning 409 to user: Cannot 'unpause' instance 3de67bb0-04d9-4d3a-a925-102f04d677bb while it is in vm_state active {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:19:40.945830 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-fa96975d-1406-4075-9900-134ccc67d783 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] 10.222.0.18 "POST /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb/action" status: 409 len: 145 microversion: 2.1 time: 0.103451 Oct 22 21:19:40.945830 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2641/5297] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 21:19:40 2022] POST /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb/action => generated 145 bytes in 106 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 22 21:19:40.954442 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-6da996bb-19b4-4702-a37f-9ea29aee06ac tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:19:40.955093 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-6da996bb-19b4-4702-a37f-9ea29aee06ac tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] [instance: 3de67bb0-04d9-4d3a-a925-102f04d677bb] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:19:40.963075 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6da996bb-19b4-4702-a37f-9ea29aee06ac tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:19:40.963570 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6da996bb-19b4-4702-a37f-9ea29aee06ac tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:19:40.963987 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6da996bb-19b4-4702-a37f-9ea29aee06ac tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:19:40.966362 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6da996bb-19b4-4702-a37f-9ea29aee06ac tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:19:40.967430 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6da996bb-19b4-4702-a37f-9ea29aee06ac tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:19:40.968371 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6da996bb-19b4-4702-a37f-9ea29aee06ac tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:19:41.212774 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-6da996bb-19b4-4702-a37f-9ea29aee06ac tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a9229e7da421b9e0e6f7df52f71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28af724189a24022b3ef7651b7157a9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:19:41.222469 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:19:41.243118 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-6da996bb-19b4-4702-a37f-9ea29aee06ac tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] 10.222.0.18 "GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb" status: 200 len: 1507 microversion: 2.1 time: 0.293288 Oct 22 21:19:41.245704 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2657/5298] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:19:40 2022] GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb => generated 1507 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:19:41.269454 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-ea6f2f0c-8aa0-4908-8d39-70dc9d114f9d tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:19:41.270792 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-ea6f2f0c-8aa0-4908-8d39-70dc9d114f9d tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] [instance: 3de67bb0-04d9-4d3a-a925-102f04d677bb] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:19:41.277354 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ea6f2f0c-8aa0-4908-8d39-70dc9d114f9d tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:19:41.278301 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ea6f2f0c-8aa0-4908-8d39-70dc9d114f9d tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:19:41.278989 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ea6f2f0c-8aa0-4908-8d39-70dc9d114f9d tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:19:41.279975 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ea6f2f0c-8aa0-4908-8d39-70dc9d114f9d tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:19:41.280690 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ea6f2f0c-8aa0-4908-8d39-70dc9d114f9d tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:19:41.281345 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ea6f2f0c-8aa0-4908-8d39-70dc9d114f9d tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:19:41.297182 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-ab57c03b-18fd-40f2-b8d5-6feb201a9d50 req-206ec9b6-f792-449d-ac3f-f7a4e52b4216 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20d90b58-3fad-4a44-b6bf-4ef0cc587def", "name": "network-vif-plugged", "status": "completed", "tag": "7ef4550f-d128-432a-9dbc-ce1802e6c6da"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:19:41.319040 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-ab57c03b-18fd-40f2-b8d5-6feb201a9d50 req-206ec9b6-f792-449d-ac3f-f7a4e52b4216 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:19:41.320016 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-ab57c03b-18fd-40f2-b8d5-6feb201a9d50 req-206ec9b6-f792-449d-ac3f-f7a4e52b4216 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:19:41.321507 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-ab57c03b-18fd-40f2-b8d5-6feb201a9d50 req-206ec9b6-f792-449d-ac3f-f7a4e52b4216 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:19:41.348212 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-ab57c03b-18fd-40f2-b8d5-6feb201a9d50 req-206ec9b6-f792-449d-ac3f-f7a4e52b4216 service nova] Creating event network-vif-plugged:7ef4550f-d128-432a-9dbc-ce1802e6c6da for instance 20d90b58-3fad-4a44-b6bf-4ef0cc587def on nch1-master-1 Oct 22 21:19:41.367065 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-ab57c03b-18fd-40f2-b8d5-6feb201a9d50 req-206ec9b6-f792-449d-ac3f-f7a4e52b4216 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075781 Oct 22 21:19:41.369599 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2658/5299] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:19:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:19:41.509998 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-ea6f2f0c-8aa0-4908-8d39-70dc9d114f9d tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a9229e7da421b9e0e6f7df52f71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28af724189a24022b3ef7651b7157a9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:19:41.542121 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-ea6f2f0c-8aa0-4908-8d39-70dc9d114f9d tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] 10.222.0.18 "GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb" status: 200 len: 1507 microversion: 2.1 time: 0.255061 Oct 22 21:19:41.549094 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2642/5300] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:19:41 2022] GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb => generated 1507 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:19:41.569911 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-5da0cc7d-19e2-443b-9057-dfed9f33af66 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:19:41.570621 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-5da0cc7d-19e2-443b-9057-dfed9f33af66 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] [instance: e29dd2de-2edd-47a1-a14a-6ad3de8b9d17] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:19:41.583719 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.wsgi [None req-5da0cc7d-19e2-443b-9057-dfed9f33af66 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] HTTP exception thrown: Instance e29dd2de-2edd-47a1-a14a-6ad3de8b9d17 could not be found. Oct 22 21:19:41.596400 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-5da0cc7d-19e2-443b-9057-dfed9f33af66 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Request method failure captured: Oct 22 21:19:41.596400 ncdv-master-1 devstack@n-api.service[138745]: request: POST /compute/v2.1/servers/e29dd2de-2edd-47a1-a14a-6ad3de8b9d17/action HTTP/1.1 Oct 22 21:19:41.596400 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 21:19:41.596400 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 21:19:41.596400 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 21:19:41.596400 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 18 Oct 22 21:19:41.596400 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 21:19:41.596400 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 21:19:41.596400 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 21:19:41.596400 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 21:19:41.596400 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVF3hm7PiLG1R8Tw2syJVqR4znaBscty3weljpQpv2aVSYokkqaFvTxJu_8ZsVDxnVWNFBjrkTk4hem6vgNXmexe0yUI_M8pHEKoh5CWO6b1coilxRZ6VgX94mIL_xf6l3t9Q4mcnT856zV-XemvxZab0Ooy1ChU21L_her9Zn74z_zU Oct 22 21:19:41.596400 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 21:19:41.596400 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 21:19:41.596400 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 21:19:41.596400 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 21:19:41.596400 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 21:19:41.596400 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 21:19:41.596400 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: 28af724189a24022b3ef7651b7157a9d Oct 22 21:19:41.596400 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-ServersNegativeTestJSON-766586991 Oct 22 21:19:41.596400 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 21:19:41.596400 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 21:19:41.596400 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_28af724189a24022b3ef7651b7157a9d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/28af724189a24022b3ef7651b7157a9d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/28af724189a24022b3ef7651b7157a9d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/28af724189a24022b3ef7651b7157a9d"}]}] Oct 22 21:19:41.596400 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-ServersNegativeTestJSON-766586991 Oct 22 21:19:41.596400 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: 28af724189a24022b3ef7651b7157a9d Oct 22 21:19:41.596400 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-ServersNegativeTestJSON-766586991 Oct 22 21:19:41.596400 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-ServersNegativeTestJSON-766586991-project Oct 22 21:19:41.596400 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 21:19:41.596400 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 21:19:41.596400 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: 6c8a9229e7da421b9e0e6f7df52f71e2 Oct 22 21:19:41.596400 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-ServersNegativeTestJSON-766586991-project Oct 22 21:19:41.596400 ncdv-master-1 devstack@n-api.service[138745]: Oct 22 21:19:41.596400 ncdv-master-1 devstack@n-api.service[138745]: {"unshelve": null} Oct 22 21:19:41.596400 ncdv-master-1 devstack@n-api.service[138745]: method: > Oct 22 21:19:41.596400 ncdv-master-1 devstack@n-api.service[138745]: exception: Instance e29dd2de-2edd-47a1-a14a-6ad3de8b9d17 could not be found. Oct 22 21:19:41.596400 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'id': 'e29dd2de-2edd-47a1-a14a-6ad3de8b9d17', 'body': {'unshelve': None}} Oct 22 21:19:41.596400 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:19:41.596400 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:19:41.596400 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 21:19:41.596400 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 21:19:41.596400 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 21:19:41.596400 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 21:19:41.596400 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 22 21:19:41.596400 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 22 21:19:41.596400 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e29dd2de-2edd-47a1-a14a-6ad3de8b9d17 could not be found. Oct 22 21:19:41.596400 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:19:41.596400 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:19:41.596400 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:19:41.596400 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:19:41.596400 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:19:41.596400 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:19:41.596400 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:19:41.596400 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:19:41.596400 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:19:41.596400 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:19:41.596400 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 21:19:41.596400 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 21:19:41.596400 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 21:19:41.596400 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 21:19:41.596400 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 102, in _unshelve Oct 22 21:19:41.596400 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 22 21:19:41.596400 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 21:19:41.596400 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:19:41.596400 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e29dd2de-2edd-47a1-a14a-6ad3de8b9d17 could not be found. Oct 22 21:19:41.596400 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:19:41.596400 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:19:41.603058 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:19:41.603058 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:19:41.603058 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:19:41.603058 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:19:41.603058 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:19:41.603058 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:19:41.603058 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e29dd2de-2edd-47a1-a14a-6ad3de8b9d17 could not be found. Oct 22 21:19:41.603058 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:19:41.603058 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-5da0cc7d-19e2-443b-9057-dfed9f33af66 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Returning 404 to user: Instance e29dd2de-2edd-47a1-a14a-6ad3de8b9d17 could not be found. {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:19:41.603058 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-5da0cc7d-19e2-443b-9057-dfed9f33af66 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] 10.222.0.18 "POST /compute/v2.1/servers/e29dd2de-2edd-47a1-a14a-6ad3de8b9d17/action" status: 404 len: 111 microversion: 2.1 time: 0.035459 Oct 22 21:19:41.606271 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2659/5301] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 21:19:41 2022] POST /compute/v2.1/servers/e29dd2de-2edd-47a1-a14a-6ad3de8b9d17/action => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 21:19:41.612303 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-003d724c-10d7-4a77-9624-6f133a84bf45 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:19:41.615600 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-003d724c-10d7-4a77-9624-6f133a84bf45 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] [instance: 3de67bb0-04d9-4d3a-a925-102f04d677bb] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:19:41.626271 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-003d724c-10d7-4a77-9624-6f133a84bf45 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:19:41.627030 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-003d724c-10d7-4a77-9624-6f133a84bf45 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:19:41.628686 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-003d724c-10d7-4a77-9624-6f133a84bf45 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:19:41.629617 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-003d724c-10d7-4a77-9624-6f133a84bf45 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:19:41.630257 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-003d724c-10d7-4a77-9624-6f133a84bf45 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:19:41.630858 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-003d724c-10d7-4a77-9624-6f133a84bf45 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:19:41.899191 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-717054d0-cf74-462b-856c-67adf2c84c62 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:19:41.899852 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-717054d0-cf74-462b-856c-67adf2c84c62 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] [instance: 7c614e45-6138-43f4-85a5-303093b91055] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:19:41.909414 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-003d724c-10d7-4a77-9624-6f133a84bf45 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a9229e7da421b9e0e6f7df52f71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28af724189a24022b3ef7651b7157a9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:19:41.915424 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-717054d0-cf74-462b-856c-67adf2c84c62 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:19:41.915948 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-717054d0-cf74-462b-856c-67adf2c84c62 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:19:41.916407 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-717054d0-cf74-462b-856c-67adf2c84c62 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:19:41.917143 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-717054d0-cf74-462b-856c-67adf2c84c62 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:19:41.917615 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-717054d0-cf74-462b-856c-67adf2c84c62 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:19:41.918060 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-717054d0-cf74-462b-856c-67adf2c84c62 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:19:41.924337 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-003d724c-10d7-4a77-9624-6f133a84bf45 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] 10.222.0.18 "GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb" status: 200 len: 1507 microversion: 2.1 time: 0.316346 Oct 22 21:19:41.926072 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2643/5302] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:19:41 2022] GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb => generated 1507 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:19:41.957568 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-f9947dab-47bc-4133-a36e-585232e376b7 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:19:41.959255 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-f9947dab-47bc-4133-a36e-585232e376b7 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] [instance: 3de67bb0-04d9-4d3a-a925-102f04d677bb] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:19:41.976499 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f9947dab-47bc-4133-a36e-585232e376b7 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:19:41.977853 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f9947dab-47bc-4133-a36e-585232e376b7 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:19:41.979282 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f9947dab-47bc-4133-a36e-585232e376b7 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:19:41.980653 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f9947dab-47bc-4133-a36e-585232e376b7 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:19:41.981347 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f9947dab-47bc-4133-a36e-585232e376b7 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:19:41.981997 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f9947dab-47bc-4133-a36e-585232e376b7 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:19:42.040629 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:19:42.077951 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-717054d0-cf74-462b-856c-67adf2c84c62 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712b1eb4d5f542219f248896a5b85be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb594dfc7d54c26b2badde74ee74d18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:19:42.091913 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-717054d0-cf74-462b-856c-67adf2c84c62 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] 10.222.0.18 "GET /compute/v2.1/servers/7c614e45-6138-43f4-85a5-303093b91055" status: 200 len: 1209 microversion: 2.1 time: 0.196414 Oct 22 21:19:42.093082 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2660/5303] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:19:41 2022] GET /compute/v2.1/servers/7c614e45-6138-43f4-85a5-303093b91055 => generated 1209 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:19:42.262175 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-f9947dab-47bc-4133-a36e-585232e376b7 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a9229e7da421b9e0e6f7df52f71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28af724189a24022b3ef7651b7157a9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:19:42.271611 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-f9947dab-47bc-4133-a36e-585232e376b7 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] 10.222.0.18 "GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb" status: 200 len: 1507 microversion: 2.1 time: 0.323537 Oct 22 21:19:42.272730 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2644/5304] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:19:41 2022] GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb => generated 1507 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:19:42.295307 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-2068dae7-ecaa-4834-aed8-7afc053ad269 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:19:42.296259 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-2068dae7-ecaa-4834-aed8-7afc053ad269 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] [instance: 3de67bb0-04d9-4d3a-a925-102f04d677bb] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:19:42.303076 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2068dae7-ecaa-4834-aed8-7afc053ad269 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:19:42.303884 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2068dae7-ecaa-4834-aed8-7afc053ad269 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:19:42.304540 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2068dae7-ecaa-4834-aed8-7afc053ad269 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:19:42.306152 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2068dae7-ecaa-4834-aed8-7afc053ad269 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:19:42.307586 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2068dae7-ecaa-4834-aed8-7afc053ad269 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:19:42.308269 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2068dae7-ecaa-4834-aed8-7afc053ad269 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:19:42.345140 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.wsgi [None req-2068dae7-ecaa-4834-aed8-7afc053ad269 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] HTTP exception thrown: Cannot 'unshelve' instance 3de67bb0-04d9-4d3a-a925-102f04d677bb while it is in vm_state active Oct 22 21:19:42.348131 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-2068dae7-ecaa-4834-aed8-7afc053ad269 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Request method failure captured: Oct 22 21:19:42.348131 ncdv-master-1 devstack@n-api.service[138745]: request: POST /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb/action HTTP/1.1 Oct 22 21:19:42.348131 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 21:19:42.348131 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 21:19:42.348131 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 21:19:42.348131 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 18 Oct 22 21:19:42.348131 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 21:19:42.348131 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 21:19:42.348131 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 21:19:42.348131 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 21:19:42.348131 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVF3hm7PiLG1R8Tw2syJVqR4znaBscty3weljpQpv2aVSYokkqaFvTxJu_8ZsVDxnVWNFBjrkTk4hem6vgNXmexe0yUI_M8pHEKoh5CWO6b1coilxRZ6VgX94mIL_xf6l3t9Q4mcnT856zV-XemvxZab0Ooy1ChU21L_her9Zn74z_zU Oct 22 21:19:42.348131 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 21:19:42.348131 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 21:19:42.348131 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 21:19:42.348131 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 21:19:42.348131 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 21:19:42.348131 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 21:19:42.348131 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: 28af724189a24022b3ef7651b7157a9d Oct 22 21:19:42.348131 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-ServersNegativeTestJSON-766586991 Oct 22 21:19:42.348131 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 21:19:42.348131 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 21:19:42.348131 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_28af724189a24022b3ef7651b7157a9d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/28af724189a24022b3ef7651b7157a9d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/28af724189a24022b3ef7651b7157a9d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/28af724189a24022b3ef7651b7157a9d"}]}] Oct 22 21:19:42.348131 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-ServersNegativeTestJSON-766586991 Oct 22 21:19:42.348131 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: 28af724189a24022b3ef7651b7157a9d Oct 22 21:19:42.348131 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-ServersNegativeTestJSON-766586991 Oct 22 21:19:42.348131 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-ServersNegativeTestJSON-766586991-project Oct 22 21:19:42.348131 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 21:19:42.348131 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 21:19:42.348131 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: 6c8a9229e7da421b9e0e6f7df52f71e2 Oct 22 21:19:42.348131 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-ServersNegativeTestJSON-766586991-project Oct 22 21:19:42.348131 ncdv-master-1 devstack@n-api.service[138745]: Oct 22 21:19:42.348131 ncdv-master-1 devstack@n-api.service[138745]: {"unshelve": null} Oct 22 21:19:42.348131 ncdv-master-1 devstack@n-api.service[138745]: method: > Oct 22 21:19:42.348131 ncdv-master-1 devstack@n-api.service[138745]: exception: Cannot 'unshelve' instance 3de67bb0-04d9-4d3a-a925-102f04d677bb while it is in vm_state active Oct 22 21:19:42.348131 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'id': '3de67bb0-04d9-4d3a-a925-102f04d677bb', 'body': {'unshelve': None}} Oct 22 21:19:42.348131 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:19:42.348131 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:19:42.348131 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 124, in _unshelve Oct 22 21:19:42.348131 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi self.compute_api.unshelve( Oct 22 21:19:42.348131 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 22 21:19:42.348131 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 22 21:19:42.348131 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 22 21:19:42.348131 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 22 21:19:42.348131 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 22 21:19:42.348131 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 22 21:19:42.348131 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 3de67bb0-04d9-4d3a-a925-102f04d677bb in vm_state active. Cannot unshelve while the instance is in this state. Oct 22 21:19:42.348131 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:19:42.348131 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:19:42.348131 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:19:42.348131 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:19:42.348131 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:19:42.348131 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:19:42.348131 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:19:42.348131 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:19:42.348131 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:19:42.348131 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:19:42.348131 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 21:19:42.348131 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 21:19:42.348131 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 21:19:42.348131 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 21:19:42.348131 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 137, in _unshelve Oct 22 21:19:42.348131 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Oct 22 21:19:42.348131 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 22 21:19:42.348131 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 22 21:19:42.353316 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unshelve' instance 3de67bb0-04d9-4d3a-a925-102f04d677bb while it is in vm_state active Oct 22 21:19:42.353316 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:19:42.353316 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:19:42.353316 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:19:42.353316 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:19:42.353316 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:19:42.353316 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:19:42.353316 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:19:42.353316 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:19:42.353316 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unshelve' instance 3de67bb0-04d9-4d3a-a925-102f04d677bb while it is in vm_state active Oct 22 21:19:42.353316 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:19:42.356654 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-2068dae7-ecaa-4834-aed8-7afc053ad269 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Returning 409 to user: Cannot 'unshelve' instance 3de67bb0-04d9-4d3a-a925-102f04d677bb while it is in vm_state active {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:19:42.358269 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-2068dae7-ecaa-4834-aed8-7afc053ad269 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] 10.222.0.18 "POST /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb/action" status: 409 len: 146 microversion: 2.1 time: 0.066964 Oct 22 21:19:42.363021 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2661/5305] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 21:19:42 2022] POST /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb/action => generated 146 bytes in 72 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 22 21:19:42.367448 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-059913d5-abac-4427-b29a-9bfbcc176e7a tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:19:42.368071 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-059913d5-abac-4427-b29a-9bfbcc176e7a tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] [instance: 3de67bb0-04d9-4d3a-a925-102f04d677bb] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:19:42.387095 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-059913d5-abac-4427-b29a-9bfbcc176e7a tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:19:42.387803 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-059913d5-abac-4427-b29a-9bfbcc176e7a tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:19:42.388660 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-059913d5-abac-4427-b29a-9bfbcc176e7a tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:19:42.389536 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-059913d5-abac-4427-b29a-9bfbcc176e7a tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:19:42.390638 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-059913d5-abac-4427-b29a-9bfbcc176e7a tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:19:42.391241 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-059913d5-abac-4427-b29a-9bfbcc176e7a tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:19:42.775987 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-059913d5-abac-4427-b29a-9bfbcc176e7a tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a9229e7da421b9e0e6f7df52f71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28af724189a24022b3ef7651b7157a9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:19:42.789657 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-059913d5-abac-4427-b29a-9bfbcc176e7a tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] 10.222.0.18 "GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb" status: 200 len: 1507 microversion: 2.1 time: 0.425853 Oct 22 21:19:42.791973 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2645/5306] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:19:42 2022] GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb => generated 1507 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:19:42.814477 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-81ad716a-313f-4b0e-98f8-6a83c5674b92 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:19:42.815270 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-81ad716a-313f-4b0e-98f8-6a83c5674b92 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] [instance: 3de67bb0-04d9-4d3a-a925-102f04d677bb] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:19:42.830677 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-81ad716a-313f-4b0e-98f8-6a83c5674b92 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:19:42.831659 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-81ad716a-313f-4b0e-98f8-6a83c5674b92 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:19:42.832367 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-81ad716a-313f-4b0e-98f8-6a83c5674b92 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:19:42.833344 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-81ad716a-313f-4b0e-98f8-6a83c5674b92 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:19:42.834018 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-81ad716a-313f-4b0e-98f8-6a83c5674b92 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:19:42.834651 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-81ad716a-313f-4b0e-98f8-6a83c5674b92 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:19:43.120887 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-e08af754-99e8-45be-8b21-bd619cdc8504 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:19:43.121970 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-e08af754-99e8-45be-8b21-bd619cdc8504 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] [instance: 7c614e45-6138-43f4-85a5-303093b91055] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:19:43.129242 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e08af754-99e8-45be-8b21-bd619cdc8504 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:19:43.131040 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e08af754-99e8-45be-8b21-bd619cdc8504 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:19:43.131751 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e08af754-99e8-45be-8b21-bd619cdc8504 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:19:43.132754 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e08af754-99e8-45be-8b21-bd619cdc8504 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:19:43.133425 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e08af754-99e8-45be-8b21-bd619cdc8504 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:19:43.134018 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e08af754-99e8-45be-8b21-bd619cdc8504 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:19:43.175042 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-81ad716a-313f-4b0e-98f8-6a83c5674b92 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a9229e7da421b9e0e6f7df52f71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28af724189a24022b3ef7651b7157a9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:19:43.188798 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-81ad716a-313f-4b0e-98f8-6a83c5674b92 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] 10.222.0.18 "GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb" status: 200 len: 1507 microversion: 2.1 time: 0.378239 Oct 22 21:19:43.189669 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2662/5307] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:19:42 2022] GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb => generated 1507 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:19:43.211458 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-aa838943-eaef-4960-a650-e7a060f22285 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1932366228_updated"}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:19:43.214460 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-aa838943-eaef-4960-a650-e7a060f22285 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] [instance: a7b76d61-6ed4-4786-92e4-25d54c6d2b0f] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:19:43.227969 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.wsgi [None req-aa838943-eaef-4960-a650-e7a060f22285 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] HTTP exception thrown: Instance a7b76d61-6ed4-4786-92e4-25d54c6d2b0f could not be found. Oct 22 21:19:43.229623 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-aa838943-eaef-4960-a650-e7a060f22285 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Request method failure captured: Oct 22 21:19:43.229623 ncdv-master-1 devstack@n-api.service[138745]: request: PUT /compute/v2.1/servers/a7b76d61-6ed4-4786-92e4-25d54c6d2b0f HTTP/1.1 Oct 22 21:19:43.229623 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 21:19:43.229623 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 21:19:43.229623 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 21:19:43.229623 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 81 Oct 22 21:19:43.229623 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 21:19:43.229623 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 21:19:43.229623 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 21:19:43.229623 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 21:19:43.229623 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVF3hm7PiLG1R8Tw2syJVqR4znaBscty3weljpQpv2aVSYokkqaFvTxJu_8ZsVDxnVWNFBjrkTk4hem6vgNXmexe0yUI_M8pHEKoh5CWO6b1coilxRZ6VgX94mIL_xf6l3t9Q4mcnT856zV-XemvxZab0Ooy1ChU21L_her9Zn74z_zU Oct 22 21:19:43.229623 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 21:19:43.229623 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 21:19:43.229623 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 21:19:43.229623 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 21:19:43.229623 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 21:19:43.229623 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 21:19:43.229623 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: 28af724189a24022b3ef7651b7157a9d Oct 22 21:19:43.229623 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-ServersNegativeTestJSON-766586991 Oct 22 21:19:43.229623 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 21:19:43.229623 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 21:19:43.229623 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_28af724189a24022b3ef7651b7157a9d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/28af724189a24022b3ef7651b7157a9d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/28af724189a24022b3ef7651b7157a9d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/28af724189a24022b3ef7651b7157a9d"}]}] Oct 22 21:19:43.229623 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-ServersNegativeTestJSON-766586991 Oct 22 21:19:43.229623 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: 28af724189a24022b3ef7651b7157a9d Oct 22 21:19:43.229623 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-ServersNegativeTestJSON-766586991 Oct 22 21:19:43.229623 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-ServersNegativeTestJSON-766586991-project Oct 22 21:19:43.229623 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 21:19:43.229623 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 21:19:43.229623 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: 6c8a9229e7da421b9e0e6f7df52f71e2 Oct 22 21:19:43.229623 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-ServersNegativeTestJSON-766586991-project Oct 22 21:19:43.229623 ncdv-master-1 devstack@n-api.service[138745]: Oct 22 21:19:43.229623 ncdv-master-1 devstack@n-api.service[138745]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1932366228_updated"}} Oct 22 21:19:43.229623 ncdv-master-1 devstack@n-api.service[138745]: method: > Oct 22 21:19:43.229623 ncdv-master-1 devstack@n-api.service[138745]: exception: Instance a7b76d61-6ed4-4786-92e4-25d54c6d2b0f could not be found. Oct 22 21:19:43.229623 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'id': 'a7b76d61-6ed4-4786-92e4-25d54c6d2b0f', 'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1932366228_updated'}}} Oct 22 21:19:43.229623 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:19:43.229623 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:19:43.229623 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 21:19:43.229623 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 21:19:43.229623 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 21:19:43.229623 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 21:19:43.229623 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 22 21:19:43.229623 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 22 21:19:43.229623 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a7b76d61-6ed4-4786-92e4-25d54c6d2b0f could not be found. Oct 22 21:19:43.229623 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:19:43.229623 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:19:43.229623 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:19:43.229623 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:19:43.229623 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:19:43.229623 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:19:43.229623 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:19:43.229623 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:19:43.229623 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:19:43.229623 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:19:43.229623 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 21:19:43.229623 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 21:19:43.229623 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 21:19:43.229623 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 21:19:43.229623 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 21:19:43.229623 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 21:19:43.229623 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 22 21:19:43.229623 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Oct 22 21:19:43.229623 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Oct 22 21:19:43.229623 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 21:19:43.233729 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 21:19:43.233729 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 21:19:43.233729 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:19:43.233729 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a7b76d61-6ed4-4786-92e4-25d54c6d2b0f could not be found. Oct 22 21:19:43.233729 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:19:43.233729 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:19:43.233729 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:19:43.233729 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:19:43.233729 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:19:43.233729 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:19:43.233729 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:19:43.233729 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:19:43.233729 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a7b76d61-6ed4-4786-92e4-25d54c6d2b0f could not be found. Oct 22 21:19:43.233729 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:19:43.233729 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-aa838943-eaef-4960-a650-e7a060f22285 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Returning 404 to user: Instance a7b76d61-6ed4-4786-92e4-25d54c6d2b0f could not be found. {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:19:43.233729 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-aa838943-eaef-4960-a650-e7a060f22285 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] 10.222.0.18 "PUT /compute/v2.1/servers/a7b76d61-6ed4-4786-92e4-25d54c6d2b0f" status: 404 len: 111 microversion: 2.1 time: 0.023718 Oct 22 21:19:43.239752 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2663/5308] 10.222.0.18 () {60 vars in 1256 bytes} [Sat Oct 22 21:19:43 2022] PUT /compute/v2.1/servers/a7b76d61-6ed4-4786-92e4-25d54c6d2b0f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 21:19:43.255545 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-8483c920-f52f-47c5-b75a-a8dcc58d5399 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:19:43.257007 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-8483c920-f52f-47c5-b75a-a8dcc58d5399 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] [instance: 3de67bb0-04d9-4d3a-a925-102f04d677bb] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:19:43.273702 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8483c920-f52f-47c5-b75a-a8dcc58d5399 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:19:43.274413 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8483c920-f52f-47c5-b75a-a8dcc58d5399 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:19:43.275063 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8483c920-f52f-47c5-b75a-a8dcc58d5399 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:19:43.275923 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8483c920-f52f-47c5-b75a-a8dcc58d5399 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:19:43.276545 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8483c920-f52f-47c5-b75a-a8dcc58d5399 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:19:43.277081 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8483c920-f52f-47c5-b75a-a8dcc58d5399 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:19:43.277644 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-e08af754-99e8-45be-8b21-bd619cdc8504 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712b1eb4d5f542219f248896a5b85be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb594dfc7d54c26b2badde74ee74d18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:19:43.305262 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-e08af754-99e8-45be-8b21-bd619cdc8504 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] 10.222.0.18 "GET /compute/v2.1/servers/7c614e45-6138-43f4-85a5-303093b91055" status: 200 len: 1271 microversion: 2.1 time: 0.188322 Oct 22 21:19:43.322389 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2646/5309] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:19:43 2022] GET /compute/v2.1/servers/7c614e45-6138-43f4-85a5-303093b91055 => generated 1271 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:19:43.505647 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-8483c920-f52f-47c5-b75a-a8dcc58d5399 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a9229e7da421b9e0e6f7df52f71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28af724189a24022b3ef7651b7157a9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:19:43.518333 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-8483c920-f52f-47c5-b75a-a8dcc58d5399 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] 10.222.0.18 "GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb" status: 200 len: 1507 microversion: 2.1 time: 0.277387 Oct 22 21:19:43.518919 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2664/5310] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:19:43 2022] GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb => generated 1507 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:19:43.543655 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-79607d97-a794-407d-91dd-844e3358c9e5 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:19:43.544289 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-79607d97-a794-407d-91dd-844e3358c9e5 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] [instance: 3de67bb0-04d9-4d3a-a925-102f04d677bb] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:19:43.559876 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-79607d97-a794-407d-91dd-844e3358c9e5 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:19:43.560390 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-79607d97-a794-407d-91dd-844e3358c9e5 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:19:43.560840 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-79607d97-a794-407d-91dd-844e3358c9e5 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:19:43.567429 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-79607d97-a794-407d-91dd-844e3358c9e5 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:19:43.568388 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-79607d97-a794-407d-91dd-844e3358c9e5 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:19:43.568857 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-79607d97-a794-407d-91dd-844e3358c9e5 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:19:43.979310 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-79607d97-a794-407d-91dd-844e3358c9e5 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a9229e7da421b9e0e6f7df52f71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28af724189a24022b3ef7651b7157a9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:19:43.992869 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-79607d97-a794-407d-91dd-844e3358c9e5 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] 10.222.0.18 "GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb" status: 200 len: 1507 microversion: 2.1 time: 0.455158 Oct 22 21:19:44.008243 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2647/5311] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:19:43 2022] GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb => generated 1507 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:19:44.019738 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-bfee03ff-5073-4b3c-830b-0dc7a4daeadb tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Action: 'update', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:19:44.023697 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-bfee03ff-5073-4b3c-830b-0dc7a4daeadb tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Request method failure captured: Oct 22 21:19:44.023697 ncdv-master-1 devstack@n-api.service[138745]: request: PUT /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb HTTP/1.1 Oct 22 21:19:44.023697 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 21:19:44.023697 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 21:19:44.023697 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 21:19:44.023697 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 280 Oct 22 21:19:44.023697 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 21:19:44.023697 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 21:19:44.023697 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 21:19:44.023697 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 21:19:44.023697 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVF3hm7PiLG1R8Tw2syJVqR4znaBscty3weljpQpv2aVSYokkqaFvTxJu_8ZsVDxnVWNFBjrkTk4hem6vgNXmexe0yUI_M8pHEKoh5CWO6b1coilxRZ6VgX94mIL_xf6l3t9Q4mcnT856zV-XemvxZab0Ooy1ChU21L_her9Zn74z_zU Oct 22 21:19:44.023697 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 21:19:44.023697 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 21:19:44.023697 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 21:19:44.023697 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 21:19:44.023697 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 21:19:44.023697 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 21:19:44.023697 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: 28af724189a24022b3ef7651b7157a9d Oct 22 21:19:44.023697 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-ServersNegativeTestJSON-766586991 Oct 22 21:19:44.023697 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 21:19:44.023697 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 21:19:44.023697 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_28af724189a24022b3ef7651b7157a9d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/28af724189a24022b3ef7651b7157a9d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/28af724189a24022b3ef7651b7157a9d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/28af724189a24022b3ef7651b7157a9d"}]}] Oct 22 21:19:44.023697 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-ServersNegativeTestJSON-766586991 Oct 22 21:19:44.023697 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: 28af724189a24022b3ef7651b7157a9d Oct 22 21:19:44.023697 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-ServersNegativeTestJSON-766586991 Oct 22 21:19:44.023697 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-ServersNegativeTestJSON-766586991-project Oct 22 21:19:44.023697 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 21:19:44.023697 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 21:19:44.023697 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: 6c8a9229e7da421b9e0e6f7df52f71e2 Oct 22 21:19:44.023697 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-ServersNegativeTestJSON-766586991-project Oct 22 21:19:44.023697 ncdv-master-1 devstack@n-api.service[138745]: Oct 22 21:19:44.023697 ncdv-master-1 devstack@n-api.service[138745]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Oct 22 21:19:44.023697 ncdv-master-1 devstack@n-api.service[138745]: method: > Oct 22 21:19:44.023697 ncdv-master-1 devstack@n-api.service[138745]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 22 21:19:44.023697 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'id': '3de67bb0-04d9-4d3a-a925-102f04d677bb', 'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Oct 22 21:19:44.023697 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:19:44.023697 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:19:44.023697 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 22 21:19:44.023697 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 22 21:19:44.023697 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 22 21:19:44.023697 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise error Oct 22 21:19:44.023697 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 22 21:19:44.023697 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:19:44.023697 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Oct 22 21:19:44.023697 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 22 21:19:44.023697 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:19:44.023697 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 22 21:19:44.023697 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 22 21:19:44.023697 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:19:44.023697 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:19:44.023697 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:19:44.023697 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:19:44.027133 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:19:44.027133 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:19:44.027133 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:19:44.027133 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:19:44.027133 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:19:44.027133 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:19:44.027133 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 21:19:44.027133 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 21:19:44.027133 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 22 21:19:44.027133 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 22 21:19:44.027133 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 22 21:19:44.027133 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 22 21:19:44.027133 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 22 21:19:44.027133 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 22 21:19:44.027133 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 22 21:19:44.027133 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:19:44.027133 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:19:44.027133 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:19:44.027133 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:19:44.027133 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:19:44.027133 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:19:44.027133 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 22 21:19:44.027133 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 22 21:19:44.027133 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 22 21:19:44.027133 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:19:44.027133 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-bfee03ff-5073-4b3c-830b-0dc7a4daeadb tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:19:44.027133 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-bfee03ff-5073-4b3c-830b-0dc7a4daeadb tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] 10.222.0.18 "PUT /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb" status: 400 len: 619 microversion: 2.1 time: 0.011650 Oct 22 21:19:44.035011 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-e6a0508d-1691-426b-8274-701c970d8210 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:19:44.035659 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-e6a0508d-1691-426b-8274-701c970d8210 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] [instance: 3de67bb0-04d9-4d3a-a925-102f04d677bb] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:19:44.037430 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2665/5312] 10.222.0.18 () {60 vars in 1257 bytes} [Sat Oct 22 21:19:44 2022] PUT /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb => generated 619 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 22 21:19:44.043237 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e6a0508d-1691-426b-8274-701c970d8210 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:19:44.043994 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e6a0508d-1691-426b-8274-701c970d8210 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:19:44.044621 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e6a0508d-1691-426b-8274-701c970d8210 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:19:44.045497 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e6a0508d-1691-426b-8274-701c970d8210 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:19:44.046144 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e6a0508d-1691-426b-8274-701c970d8210 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:19:44.046735 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e6a0508d-1691-426b-8274-701c970d8210 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:19:44.313147 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-e6a0508d-1691-426b-8274-701c970d8210 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a9229e7da421b9e0e6f7df52f71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28af724189a24022b3ef7651b7157a9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:19:44.321952 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-e6a0508d-1691-426b-8274-701c970d8210 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] 10.222.0.18 "GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb" status: 200 len: 1507 microversion: 2.1 time: 0.291326 Oct 22 21:19:44.330027 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-64a30e59-eaa4-45d4-9189-5a7d5e6431a3 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:19:44.330802 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-64a30e59-eaa4-45d4-9189-5a7d5e6431a3 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] [instance: 7c614e45-6138-43f4-85a5-303093b91055] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:19:44.342374 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2648/5313] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:19:44 2022] GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb => generated 1507 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:19:44.366010 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-64a30e59-eaa4-45d4-9189-5a7d5e6431a3 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:19:44.366902 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-64a30e59-eaa4-45d4-9189-5a7d5e6431a3 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:19:44.367416 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-64a30e59-eaa4-45d4-9189-5a7d5e6431a3 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:19:44.368199 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-64a30e59-eaa4-45d4-9189-5a7d5e6431a3 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:19:44.368677 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-64a30e59-eaa4-45d4-9189-5a7d5e6431a3 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:19:44.369124 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-64a30e59-eaa4-45d4-9189-5a7d5e6431a3 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:19:44.372805 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-4743334b-a44b-4a45-869d-eccb6547e6a5 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:19:44.384408 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-4743334b-a44b-4a45-869d-eccb6547e6a5 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] [instance: 3de67bb0-04d9-4d3a-a925-102f04d677bb] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:19:44.391442 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4743334b-a44b-4a45-869d-eccb6547e6a5 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:19:44.392314 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4743334b-a44b-4a45-869d-eccb6547e6a5 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:19:44.392985 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4743334b-a44b-4a45-869d-eccb6547e6a5 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:19:44.393935 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4743334b-a44b-4a45-869d-eccb6547e6a5 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:19:44.394642 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4743334b-a44b-4a45-869d-eccb6547e6a5 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:19:44.395308 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4743334b-a44b-4a45-869d-eccb6547e6a5 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:19:44.753997 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-4743334b-a44b-4a45-869d-eccb6547e6a5 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a9229e7da421b9e0e6f7df52f71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28af724189a24022b3ef7651b7157a9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:19:44.764604 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-4743334b-a44b-4a45-869d-eccb6547e6a5 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] 10.222.0.18 "GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb" status: 200 len: 1507 microversion: 2.1 time: 0.398315 Oct 22 21:19:44.768062 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2649/5314] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:19:44 2022] GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb => generated 1507 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:19:44.793284 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-64a30e59-eaa4-45d4-9189-5a7d5e6431a3 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712b1eb4d5f542219f248896a5b85be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb594dfc7d54c26b2badde74ee74d18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:19:44.812136 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-64a30e59-eaa4-45d4-9189-5a7d5e6431a3 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] 10.222.0.18 "GET /compute/v2.1/servers/7c614e45-6138-43f4-85a5-303093b91055" status: 200 len: 1313 microversion: 2.1 time: 0.486388 Oct 22 21:19:44.813850 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-7b62660c-99ba-4ab9-9a4e-d4ea742713f0 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Action: 'update', calling method: >, body: {"server": {"name": ""}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:19:44.817983 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-7b62660c-99ba-4ab9-9a4e-d4ea742713f0 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Request method failure captured: Oct 22 21:19:44.817983 ncdv-master-1 devstack@n-api.service[138744]: request: PUT /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb HTTP/1.1 Oct 22 21:19:44.817983 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 21:19:44.817983 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 21:19:44.817983 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 21:19:44.817983 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 24 Oct 22 21:19:44.817983 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 21:19:44.817983 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 21:19:44.817983 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 21:19:44.817983 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 21:19:44.817983 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVF3hm7PiLG1R8Tw2syJVqR4znaBscty3weljpQpv2aVSYokkqaFvTxJu_8ZsVDxnVWNFBjrkTk4hem6vgNXmexe0yUI_M8pHEKoh5CWO6b1coilxRZ6VgX94mIL_xf6l3t9Q4mcnT856zV-XemvxZab0Ooy1ChU21L_her9Zn74z_zU Oct 22 21:19:44.817983 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 21:19:44.817983 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 21:19:44.817983 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 21:19:44.817983 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 21:19:44.817983 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 21:19:44.817983 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 21:19:44.817983 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: 28af724189a24022b3ef7651b7157a9d Oct 22 21:19:44.817983 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-ServersNegativeTestJSON-766586991 Oct 22 21:19:44.817983 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 21:19:44.817983 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 21:19:44.817983 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_28af724189a24022b3ef7651b7157a9d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/28af724189a24022b3ef7651b7157a9d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/28af724189a24022b3ef7651b7157a9d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/28af724189a24022b3ef7651b7157a9d"}]}] Oct 22 21:19:44.817983 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-ServersNegativeTestJSON-766586991 Oct 22 21:19:44.817983 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: 28af724189a24022b3ef7651b7157a9d Oct 22 21:19:44.817983 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-ServersNegativeTestJSON-766586991 Oct 22 21:19:44.817983 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-ServersNegativeTestJSON-766586991-project Oct 22 21:19:44.817983 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 21:19:44.817983 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 21:19:44.817983 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: 6c8a9229e7da421b9e0e6f7df52f71e2 Oct 22 21:19:44.817983 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-ServersNegativeTestJSON-766586991-project Oct 22 21:19:44.817983 ncdv-master-1 devstack@n-api.service[138744]: Oct 22 21:19:44.817983 ncdv-master-1 devstack@n-api.service[138744]: {"server": {"name": ""}} Oct 22 21:19:44.817983 ncdv-master-1 devstack@n-api.service[138744]: method: > Oct 22 21:19:44.817983 ncdv-master-1 devstack@n-api.service[138744]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 22 21:19:44.817983 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': '3de67bb0-04d9-4d3a-a925-102f04d677bb', 'body': {'server': {'name': ''}}} Oct 22 21:19:44.817983 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:19:44.817983 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:19:44.817983 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 22 21:19:44.817983 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 22 21:19:44.817983 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 22 21:19:44.817983 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise error Oct 22 21:19:44.817983 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 22 21:19:44.817983 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:19:44.817983 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Oct 22 21:19:44.817983 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 22 21:19:44.817983 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:19:44.817983 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 22 21:19:44.817983 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi '' Oct 22 21:19:44.817983 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:19:44.817983 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:19:44.817983 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:19:44.817983 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:19:44.817983 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:19:44.817983 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:19:44.817983 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:19:44.817983 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:19:44.817983 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:19:44.817983 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:19:44.817983 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 21:19:44.817983 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 21:19:44.817983 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 22 21:19:44.817983 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 22 21:19:44.817983 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 22 21:19:44.817983 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 22 21:19:44.817983 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 22 21:19:44.817983 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 22 21:19:44.817983 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 22 21:19:44.822310 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:19:44.822310 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:19:44.822310 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:19:44.822310 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:19:44.822310 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:19:44.822310 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:19:44.822310 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 22 21:19:44.822310 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 22 21:19:44.822310 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 22 21:19:44.822310 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:19:44.822953 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2666/5315] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:19:44 2022] GET /compute/v2.1/servers/7c614e45-6138-43f4-85a5-303093b91055 => generated 1313 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:19:44.836603 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-7b62660c-99ba-4ab9-9a4e-d4ea742713f0 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:19:44.841677 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-7b62660c-99ba-4ab9-9a4e-d4ea742713f0 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] 10.222.0.18 "PUT /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb" status: 400 len: 108 microversion: 2.1 time: 0.040178 Oct 22 21:19:44.843998 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2650/5316] 10.222.0.18 () {60 vars in 1256 bytes} [Sat Oct 22 21:19:44 2022] PUT /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb => generated 108 bytes in 47 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 22 21:19:44.852857 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-aebdcf2c-0f43-4852-9354-db33aa6920bd tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:19:44.859328 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-aebdcf2c-0f43-4852-9354-db33aa6920bd tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] [instance: 3de67bb0-04d9-4d3a-a925-102f04d677bb] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:19:44.879454 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-aebdcf2c-0f43-4852-9354-db33aa6920bd tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:19:44.879967 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-aebdcf2c-0f43-4852-9354-db33aa6920bd tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:19:44.880414 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-aebdcf2c-0f43-4852-9354-db33aa6920bd tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:19:44.881155 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-aebdcf2c-0f43-4852-9354-db33aa6920bd tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:19:44.881622 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-aebdcf2c-0f43-4852-9354-db33aa6920bd tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:19:44.882057 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-aebdcf2c-0f43-4852-9354-db33aa6920bd tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:19:45.147689 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-aebdcf2c-0f43-4852-9354-db33aa6920bd tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a9229e7da421b9e0e6f7df52f71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28af724189a24022b3ef7651b7157a9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:19:45.160223 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-aebdcf2c-0f43-4852-9354-db33aa6920bd tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] 10.222.0.18 "GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb" status: 200 len: 1507 microversion: 2.1 time: 0.311650 Oct 22 21:19:45.163889 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2667/5317] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:19:44 2022] GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb => generated 1507 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:19:45.851815 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-44697b52-0748-4bae-908c-621061f20a12 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:19:45.853105 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-44697b52-0748-4bae-908c-621061f20a12 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] [instance: 7c614e45-6138-43f4-85a5-303093b91055] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:19:45.873777 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-44697b52-0748-4bae-908c-621061f20a12 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:19:45.877351 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-44697b52-0748-4bae-908c-621061f20a12 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:19:45.881149 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-44697b52-0748-4bae-908c-621061f20a12 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:19:45.882143 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-44697b52-0748-4bae-908c-621061f20a12 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:19:45.883906 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-44697b52-0748-4bae-908c-621061f20a12 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:19:45.886235 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-44697b52-0748-4bae-908c-621061f20a12 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:19:46.122621 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-09ddafb8-8807-4978-985f-ba890c814127 req-10112a28-a86a-4a21-a43e-b6726e0cbafe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c614e45-6138-43f4-85a5-303093b91055", "tag": "55a25cb6-9771-4042-939f-e953aff571b7"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:19:46.139292 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-09ddafb8-8807-4978-985f-ba890c814127 req-10112a28-a86a-4a21-a43e-b6726e0cbafe service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:19:46.146113 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-09ddafb8-8807-4978-985f-ba890c814127 req-10112a28-a86a-4a21-a43e-b6726e0cbafe service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:19:46.146772 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-09ddafb8-8807-4978-985f-ba890c814127 req-10112a28-a86a-4a21-a43e-b6726e0cbafe service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:19:46.169025 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-09ddafb8-8807-4978-985f-ba890c814127 req-10112a28-a86a-4a21-a43e-b6726e0cbafe service nova] Creating event network-changed:55a25cb6-9771-4042-939f-e953aff571b7 for instance 7c614e45-6138-43f4-85a5-303093b91055 on nch1-master-1 Oct 22 21:19:46.188322 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-09ddafb8-8807-4978-985f-ba890c814127 req-10112a28-a86a-4a21-a43e-b6726e0cbafe service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.399668 Oct 22 21:19:46.192858 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2651/5318] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:19:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:19:46.465748 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-44697b52-0748-4bae-908c-621061f20a12 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712b1eb4d5f542219f248896a5b85be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb594dfc7d54c26b2badde74ee74d18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:19:46.493395 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-44697b52-0748-4bae-908c-621061f20a12 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] 10.222.0.18 "GET /compute/v2.1/servers/7c614e45-6138-43f4-85a5-303093b91055" status: 200 len: 1313 microversion: 2.1 time: 0.630108 Oct 22 21:19:46.494278 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2668/5319] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:19:45 2022] GET /compute/v2.1/servers/7c614e45-6138-43f4-85a5-303093b91055 => generated 1313 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:19:47.523290 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-3529216c-5dea-4854-87e1-56fc52c4a0a6 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:19:47.524041 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-3529216c-5dea-4854-87e1-56fc52c4a0a6 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] [instance: 7c614e45-6138-43f4-85a5-303093b91055] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:19:47.533843 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3529216c-5dea-4854-87e1-56fc52c4a0a6 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:19:47.534613 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3529216c-5dea-4854-87e1-56fc52c4a0a6 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:19:47.535302 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3529216c-5dea-4854-87e1-56fc52c4a0a6 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:19:47.536210 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3529216c-5dea-4854-87e1-56fc52c4a0a6 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:19:47.538146 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3529216c-5dea-4854-87e1-56fc52c4a0a6 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:19:47.539064 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3529216c-5dea-4854-87e1-56fc52c4a0a6 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:19:47.774978 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-3529216c-5dea-4854-87e1-56fc52c4a0a6 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712b1eb4d5f542219f248896a5b85be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb594dfc7d54c26b2badde74ee74d18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:19:47.784693 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-3529216c-5dea-4854-87e1-56fc52c4a0a6 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] 10.222.0.18 "GET /compute/v2.1/servers/7c614e45-6138-43f4-85a5-303093b91055" status: 200 len: 1313 microversion: 2.1 time: 0.265976 Oct 22 21:19:47.800213 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2652/5320] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:19:47 2022] GET /compute/v2.1/servers/7c614e45-6138-43f4-85a5-303093b91055 => generated 1313 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:19:47.865753 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-537dc9ec-0307-4e1f-9069-814f62f59f5b tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:19:47.866969 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-537dc9ec-0307-4e1f-9069-814f62f59f5b tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] [instance: cea3693e-cb10-4129-9f00-18f678998bbd] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:19:47.875862 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-537dc9ec-0307-4e1f-9069-814f62f59f5b tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:19:47.876620 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-537dc9ec-0307-4e1f-9069-814f62f59f5b tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:19:47.877256 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-537dc9ec-0307-4e1f-9069-814f62f59f5b tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:19:47.878205 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-537dc9ec-0307-4e1f-9069-814f62f59f5b tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:19:47.879643 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-537dc9ec-0307-4e1f-9069-814f62f59f5b tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:19:47.882801 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-537dc9ec-0307-4e1f-9069-814f62f59f5b tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:19:47.932318 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.wsgi [None req-537dc9ec-0307-4e1f-9069-814f62f59f5b tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] HTTP exception thrown: Instance cea3693e-cb10-4129-9f00-18f678998bbd could not be found. Oct 22 21:19:47.934278 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-537dc9ec-0307-4e1f-9069-814f62f59f5b tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Request method failure captured: Oct 22 21:19:47.934278 ncdv-master-1 devstack@n-api.service[138745]: request: DELETE /compute/v2.1/servers/cea3693e-cb10-4129-9f00-18f678998bbd HTTP/1.1 Oct 22 21:19:47.934278 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 21:19:47.934278 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 21:19:47.934278 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 21:19:47.934278 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 0 Oct 22 21:19:47.934278 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 21:19:47.934278 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 21:19:47.934278 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 21:19:47.934278 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 21:19:47.934278 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVF3hm7PiLG1R8Tw2syJVqR4znaBscty3weljpQpv2aVSYokkqaFvTxJu_8ZsVDxnVWNFBjrkTk4hem6vgNXmexe0yUI_M8pHEKoh5CWO6b1coilxRZ6VgX94mIL_xf6l3t9Q4mcnT856zV-XemvxZab0Ooy1ChU21L_her9Zn74z_zU Oct 22 21:19:47.934278 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 21:19:47.934278 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 21:19:47.934278 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 21:19:47.934278 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 21:19:47.934278 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 21:19:47.934278 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 21:19:47.934278 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: 28af724189a24022b3ef7651b7157a9d Oct 22 21:19:47.934278 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-ServersNegativeTestJSON-766586991 Oct 22 21:19:47.934278 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 21:19:47.934278 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 21:19:47.934278 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_28af724189a24022b3ef7651b7157a9d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/28af724189a24022b3ef7651b7157a9d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/28af724189a24022b3ef7651b7157a9d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/28af724189a24022b3ef7651b7157a9d"}]}] Oct 22 21:19:47.934278 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-ServersNegativeTestJSON-766586991 Oct 22 21:19:47.934278 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: 28af724189a24022b3ef7651b7157a9d Oct 22 21:19:47.934278 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-ServersNegativeTestJSON-766586991 Oct 22 21:19:47.934278 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-ServersNegativeTestJSON-766586991-project Oct 22 21:19:47.934278 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 21:19:47.934278 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 21:19:47.934278 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: 6c8a9229e7da421b9e0e6f7df52f71e2 Oct 22 21:19:47.934278 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-ServersNegativeTestJSON-766586991-project Oct 22 21:19:47.934278 ncdv-master-1 devstack@n-api.service[138745]: method: > Oct 22 21:19:47.934278 ncdv-master-1 devstack@n-api.service[138745]: exception: Instance cea3693e-cb10-4129-9f00-18f678998bbd could not be found. Oct 22 21:19:47.934278 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'id': 'cea3693e-cb10-4129-9f00-18f678998bbd'} Oct 22 21:19:47.934278 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:19:47.934278 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:19:47.934278 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 21:19:47.934278 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 21:19:47.934278 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 21:19:47.934278 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 21:19:47.934278 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 21:19:47.934278 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 21:19:47.934278 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 21:19:47.934278 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 21:19:47.934278 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cea3693e-cb10-4129-9f00-18f678998bbd could not be found. Oct 22 21:19:47.934278 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:19:47.934278 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:19:47.934278 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:19:47.934278 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:19:47.934278 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:19:47.934278 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:19:47.934278 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:19:47.934278 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:19:47.934278 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:19:47.934278 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:19:47.934278 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 22 21:19:47.934278 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 22 21:19:47.934278 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 22 21:19:47.934278 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 22 21:19:47.934278 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 21:19:47.934278 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 21:19:47.934278 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 21:19:47.934278 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:19:47.939077 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cea3693e-cb10-4129-9f00-18f678998bbd could not be found. Oct 22 21:19:47.939077 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:19:47.939077 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:19:47.939077 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:19:47.939077 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:19:47.939077 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:19:47.939077 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:19:47.939077 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:19:47.939077 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:19:47.939077 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cea3693e-cb10-4129-9f00-18f678998bbd could not be found. Oct 22 21:19:47.939077 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:19:47.941253 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-537dc9ec-0307-4e1f-9069-814f62f59f5b tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Returning 404 to user: Instance cea3693e-cb10-4129-9f00-18f678998bbd could not be found. {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:19:47.942310 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-537dc9ec-0307-4e1f-9069-814f62f59f5b tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] 10.222.0.18 "DELETE /compute/v2.1/servers/cea3693e-cb10-4129-9f00-18f678998bbd" status: 404 len: 111 microversion: 2.1 time: 0.081281 Oct 22 21:19:47.943388 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2669/5321] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 21:19:47 2022] DELETE /compute/v2.1/servers/cea3693e-cb10-4129-9f00-18f678998bbd => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 21:19:47.955242 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-972129ac-409e-47dd-bfff-da0ba96e07ea tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:19:47.955918 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-972129ac-409e-47dd-bfff-da0ba96e07ea tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] [instance: cea3693e-cb10-4129-9f00-18f678998bbd] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:19:47.967298 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-972129ac-409e-47dd-bfff-da0ba96e07ea tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:19:47.967922 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-972129ac-409e-47dd-bfff-da0ba96e07ea tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:19:47.968471 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-972129ac-409e-47dd-bfff-da0ba96e07ea tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:19:47.969236 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-972129ac-409e-47dd-bfff-da0ba96e07ea tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:19:47.971002 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-972129ac-409e-47dd-bfff-da0ba96e07ea tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:19:47.976236 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-972129ac-409e-47dd-bfff-da0ba96e07ea tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:19:48.012132 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-972129ac-409e-47dd-bfff-da0ba96e07ea tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] HTTP exception thrown: Instance cea3693e-cb10-4129-9f00-18f678998bbd could not be found. Oct 22 21:19:48.015525 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-972129ac-409e-47dd-bfff-da0ba96e07ea tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Request method failure captured: Oct 22 21:19:48.015525 ncdv-master-1 devstack@n-api.service[138744]: request: GET /compute/v2.1/servers/cea3693e-cb10-4129-9f00-18f678998bbd HTTP/1.1 Oct 22 21:19:48.015525 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 21:19:48.015525 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 21:19:48.015525 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 21:19:48.015525 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 0 Oct 22 21:19:48.015525 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 21:19:48.015525 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 21:19:48.015525 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 21:19:48.015525 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 21:19:48.015525 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVF3hm7PiLG1R8Tw2syJVqR4znaBscty3weljpQpv2aVSYokkqaFvTxJu_8ZsVDxnVWNFBjrkTk4hem6vgNXmexe0yUI_M8pHEKoh5CWO6b1coilxRZ6VgX94mIL_xf6l3t9Q4mcnT856zV-XemvxZab0Ooy1ChU21L_her9Zn74z_zU Oct 22 21:19:48.015525 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 21:19:48.015525 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 21:19:48.015525 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 21:19:48.015525 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 21:19:48.015525 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 21:19:48.015525 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 21:19:48.015525 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: 28af724189a24022b3ef7651b7157a9d Oct 22 21:19:48.015525 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-ServersNegativeTestJSON-766586991 Oct 22 21:19:48.015525 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 21:19:48.015525 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 21:19:48.015525 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_28af724189a24022b3ef7651b7157a9d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/28af724189a24022b3ef7651b7157a9d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/28af724189a24022b3ef7651b7157a9d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/28af724189a24022b3ef7651b7157a9d"}]}] Oct 22 21:19:48.015525 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-ServersNegativeTestJSON-766586991 Oct 22 21:19:48.015525 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: 28af724189a24022b3ef7651b7157a9d Oct 22 21:19:48.015525 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-ServersNegativeTestJSON-766586991 Oct 22 21:19:48.015525 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-ServersNegativeTestJSON-766586991-project Oct 22 21:19:48.015525 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 21:19:48.015525 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 21:19:48.015525 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: 6c8a9229e7da421b9e0e6f7df52f71e2 Oct 22 21:19:48.015525 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-ServersNegativeTestJSON-766586991-project Oct 22 21:19:48.015525 ncdv-master-1 devstack@n-api.service[138744]: method: > Oct 22 21:19:48.015525 ncdv-master-1 devstack@n-api.service[138744]: exception: Instance cea3693e-cb10-4129-9f00-18f678998bbd could not be found. Oct 22 21:19:48.015525 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': 'cea3693e-cb10-4129-9f00-18f678998bbd'} Oct 22 21:19:48.015525 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:19:48.015525 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:19:48.015525 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 21:19:48.015525 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 21:19:48.015525 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 21:19:48.015525 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 21:19:48.015525 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 21:19:48.015525 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 21:19:48.015525 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 21:19:48.015525 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 21:19:48.015525 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cea3693e-cb10-4129-9f00-18f678998bbd could not be found. Oct 22 21:19:48.015525 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:19:48.015525 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:19:48.015525 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:19:48.015525 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:19:48.015525 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:19:48.015525 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:19:48.015525 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:19:48.015525 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:19:48.015525 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:19:48.015525 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:19:48.015525 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 21:19:48.015525 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 21:19:48.015525 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 21:19:48.015525 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 21:19:48.015525 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 21:19:48.015525 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:19:48.015525 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cea3693e-cb10-4129-9f00-18f678998bbd could not be found. Oct 22 21:19:48.015525 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:19:48.015525 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:19:48.015525 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:19:48.020247 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:19:48.020247 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:19:48.020247 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:19:48.020247 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:19:48.020247 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:19:48.020247 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cea3693e-cb10-4129-9f00-18f678998bbd could not be found. Oct 22 21:19:48.020247 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:19:48.024989 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-972129ac-409e-47dd-bfff-da0ba96e07ea tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Returning 404 to user: Instance cea3693e-cb10-4129-9f00-18f678998bbd could not be found. {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:19:48.028421 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-972129ac-409e-47dd-bfff-da0ba96e07ea tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] 10.222.0.18 "GET /compute/v2.1/servers/cea3693e-cb10-4129-9f00-18f678998bbd" status: 404 len: 111 microversion: 2.1 time: 0.080794 Oct 22 21:19:48.032137 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2653/5322] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:19:47 2022] GET /compute/v2.1/servers/cea3693e-cb10-4129-9f00-18f678998bbd => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 21:19:48.042536 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-579c2688-5438-4691-a93d-334e83e564c2 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:19:48.043327 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-579c2688-5438-4691-a93d-334e83e564c2 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] [instance: 3de67bb0-04d9-4d3a-a925-102f04d677bb] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:19:48.056552 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-579c2688-5438-4691-a93d-334e83e564c2 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:19:48.057088 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-579c2688-5438-4691-a93d-334e83e564c2 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:19:48.057570 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-579c2688-5438-4691-a93d-334e83e564c2 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:19:48.058323 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-579c2688-5438-4691-a93d-334e83e564c2 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:19:48.058804 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-579c2688-5438-4691-a93d-334e83e564c2 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:19:48.059255 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-579c2688-5438-4691-a93d-334e83e564c2 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:19:48.105388 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-579c2688-5438-4691-a93d-334e83e564c2 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] [instance: 3de67bb0-04d9-4d3a-a925-102f04d677bb] Going to try to terminate instance {{(pid=138745) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 21:19:48.226194 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-579c2688-5438-4691-a93d-334e83e564c2 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] 10.222.0.18 "DELETE /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb" status: 204 len: 0 microversion: 2.1 time: 0.187737 Oct 22 21:19:48.227500 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2670/5323] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 21:19:48 2022] DELETE /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb => generated 0 bytes in 191 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 21:19:48.239015 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-aa3f56bb-64a6-4353-818d-607ad869e573 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:19:48.239687 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-aa3f56bb-64a6-4353-818d-607ad869e573 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] [instance: 3de67bb0-04d9-4d3a-a925-102f04d677bb] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:19:48.248252 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-aa3f56bb-64a6-4353-818d-607ad869e573 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:19:48.249843 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-aa3f56bb-64a6-4353-818d-607ad869e573 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:19:48.250482 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-aa3f56bb-64a6-4353-818d-607ad869e573 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:19:48.251635 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-aa3f56bb-64a6-4353-818d-607ad869e573 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:19:48.252585 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-aa3f56bb-64a6-4353-818d-607ad869e573 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:19:48.253186 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-aa3f56bb-64a6-4353-818d-607ad869e573 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:19:48.482809 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-aa3f56bb-64a6-4353-818d-607ad869e573 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a9229e7da421b9e0e6f7df52f71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28af724189a24022b3ef7651b7157a9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:19:48.497765 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-aa3f56bb-64a6-4353-818d-607ad869e573 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] 10.222.0.18 "GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb" status: 200 len: 1513 microversion: 2.1 time: 0.265683 Oct 22 21:19:48.499020 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2654/5324] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:19:48 2022] GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb => generated 1513 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:19:48.809748 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-5b4d4def-b3b1-4ce1-b9ff-d5012e5f23c3 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:19:48.819801 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-5b4d4def-b3b1-4ce1-b9ff-d5012e5f23c3 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] [instance: 7c614e45-6138-43f4-85a5-303093b91055] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:19:48.831955 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5b4d4def-b3b1-4ce1-b9ff-d5012e5f23c3 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:19:48.835847 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5b4d4def-b3b1-4ce1-b9ff-d5012e5f23c3 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:19:48.837649 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5b4d4def-b3b1-4ce1-b9ff-d5012e5f23c3 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:19:48.838814 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5b4d4def-b3b1-4ce1-b9ff-d5012e5f23c3 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:19:48.839738 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5b4d4def-b3b1-4ce1-b9ff-d5012e5f23c3 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:19:48.840392 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5b4d4def-b3b1-4ce1-b9ff-d5012e5f23c3 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:19:49.198888 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-5b4d4def-b3b1-4ce1-b9ff-d5012e5f23c3 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712b1eb4d5f542219f248896a5b85be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb594dfc7d54c26b2badde74ee74d18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:19:49.208705 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-5b4d4def-b3b1-4ce1-b9ff-d5012e5f23c3 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] 10.222.0.18 "GET /compute/v2.1/servers/7c614e45-6138-43f4-85a5-303093b91055" status: 200 len: 1313 microversion: 2.1 time: 0.403996 Oct 22 21:19:49.216350 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2671/5325] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:19:48 2022] GET /compute/v2.1/servers/7c614e45-6138-43f4-85a5-303093b91055 => generated 1313 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:19:49.525133 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-ab1d6163-32c3-4e3c-b23c-42e8bc81ea2c tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:19:49.527708 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-ab1d6163-32c3-4e3c-b23c-42e8bc81ea2c tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] [instance: 3de67bb0-04d9-4d3a-a925-102f04d677bb] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:19:49.535611 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ab1d6163-32c3-4e3c-b23c-42e8bc81ea2c tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:19:49.536534 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ab1d6163-32c3-4e3c-b23c-42e8bc81ea2c tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:19:49.537219 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ab1d6163-32c3-4e3c-b23c-42e8bc81ea2c tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:19:49.538252 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ab1d6163-32c3-4e3c-b23c-42e8bc81ea2c tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:19:49.538950 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ab1d6163-32c3-4e3c-b23c-42e8bc81ea2c tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:19:49.541487 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ab1d6163-32c3-4e3c-b23c-42e8bc81ea2c tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:19:50.110161 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-ab1d6163-32c3-4e3c-b23c-42e8bc81ea2c tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a9229e7da421b9e0e6f7df52f71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28af724189a24022b3ef7651b7157a9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:19:50.122320 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-ab1d6163-32c3-4e3c-b23c-42e8bc81ea2c tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] 10.222.0.18 "GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb" status: 200 len: 1513 microversion: 2.1 time: 0.604270 Oct 22 21:19:50.123664 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2655/5326] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:19:49 2022] GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb => generated 1513 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:19:50.238358 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-bb913c1e-3f21-46fd-a850-401f0140a3b7 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:19:50.239789 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-bb913c1e-3f21-46fd-a850-401f0140a3b7 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] [instance: 7c614e45-6138-43f4-85a5-303093b91055] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:19:50.247324 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bb913c1e-3f21-46fd-a850-401f0140a3b7 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:19:50.248233 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bb913c1e-3f21-46fd-a850-401f0140a3b7 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:19:50.248920 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bb913c1e-3f21-46fd-a850-401f0140a3b7 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:19:50.250102 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bb913c1e-3f21-46fd-a850-401f0140a3b7 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:19:50.250887 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bb913c1e-3f21-46fd-a850-401f0140a3b7 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:19:50.251453 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bb913c1e-3f21-46fd-a850-401f0140a3b7 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:19:50.521390 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-bb913c1e-3f21-46fd-a850-401f0140a3b7 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712b1eb4d5f542219f248896a5b85be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb594dfc7d54c26b2badde74ee74d18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:19:50.529341 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-bb913c1e-3f21-46fd-a850-401f0140a3b7 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] 10.222.0.18 "GET /compute/v2.1/servers/7c614e45-6138-43f4-85a5-303093b91055" status: 200 len: 1313 microversion: 2.1 time: 0.294872 Oct 22 21:19:50.537828 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2672/5327] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:19:50 2022] GET /compute/v2.1/servers/7c614e45-6138-43f4-85a5-303093b91055 => generated 1313 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:19:50.883192 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-90f94ffa-6454-40e3-a043-b043e3608f38 req-2020c331-385b-477c-8395-47a92ee870d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3de67bb0-04d9-4d3a-a925-102f04d677bb", "name": "network-vif-deleted", "tag": "1ae72240-5ec3-4fe0-b5c9-40ffe2e04689"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:19:50.900557 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-90f94ffa-6454-40e3-a043-b043e3608f38 req-2020c331-385b-477c-8395-47a92ee870d1 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:19:50.901066 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-90f94ffa-6454-40e3-a043-b043e3608f38 req-2020c331-385b-477c-8395-47a92ee870d1 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:19:50.902308 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-90f94ffa-6454-40e3-a043-b043e3608f38 req-2020c331-385b-477c-8395-47a92ee870d1 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:19:50.934495 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-90f94ffa-6454-40e3-a043-b043e3608f38 req-2020c331-385b-477c-8395-47a92ee870d1 service nova] Creating event network-vif-deleted:1ae72240-5ec3-4fe0-b5c9-40ffe2e04689 for instance 3de67bb0-04d9-4d3a-a925-102f04d677bb on nch2-master-1 Oct 22 21:19:50.944109 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-90f94ffa-6454-40e3-a043-b043e3608f38 req-2020c331-385b-477c-8395-47a92ee870d1 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066143 Oct 22 21:19:50.950707 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2656/5328] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:19:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:19:51.146615 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-243dddd1-6787-4b59-bdaa-e6c905b85d5c tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:19:51.147936 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-243dddd1-6787-4b59-bdaa-e6c905b85d5c tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] [instance: 3de67bb0-04d9-4d3a-a925-102f04d677bb] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:19:51.153193 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell0:SELECT=2 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:19:51.155837 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell0:SELECT=8 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:19:51.161201 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-243dddd1-6787-4b59-bdaa-e6c905b85d5c tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:19:51.162106 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-243dddd1-6787-4b59-bdaa-e6c905b85d5c tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:19:51.162812 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-243dddd1-6787-4b59-bdaa-e6c905b85d5c tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:19:51.164059 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-243dddd1-6787-4b59-bdaa-e6c905b85d5c tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:19:51.164872 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-243dddd1-6787-4b59-bdaa-e6c905b85d5c tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:19:51.165629 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-243dddd1-6787-4b59-bdaa-e6c905b85d5c tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:19:51.246015 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-243dddd1-6787-4b59-bdaa-e6c905b85d5c tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:19:51.246649 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-243dddd1-6787-4b59-bdaa-e6c905b85d5c tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:19:51.246955 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-243dddd1-6787-4b59-bdaa-e6c905b85d5c tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:19:51.247677 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.objects.instance [None req-243dddd1-6787-4b59-bdaa-e6c905b85d5c tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lazy-loading 'fault' on Instance uuid 3de67bb0-04d9-4d3a-a925-102f04d677bb {{(pid=138745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 21:19:51.304413 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-243dddd1-6787-4b59-bdaa-e6c905b85d5c tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a9229e7da421b9e0e6f7df52f71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28af724189a24022b3ef7651b7157a9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:19:51.320177 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-243dddd1-6787-4b59-bdaa-e6c905b85d5c tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] 10.222.0.18 "GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb" status: 200 len: 1307 microversion: 2.1 time: 0.172988 Oct 22 21:19:51.321206 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2673/5329] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:19:51 2022] GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb => generated 1307 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:19:51.554470 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-254e433c-e824-4c75-8cad-2c2cdfdb66c9 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:19:51.555359 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-254e433c-e824-4c75-8cad-2c2cdfdb66c9 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] [instance: 7c614e45-6138-43f4-85a5-303093b91055] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:19:51.562590 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-254e433c-e824-4c75-8cad-2c2cdfdb66c9 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:19:51.563655 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-254e433c-e824-4c75-8cad-2c2cdfdb66c9 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:19:51.564377 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-254e433c-e824-4c75-8cad-2c2cdfdb66c9 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:19:51.565339 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-254e433c-e824-4c75-8cad-2c2cdfdb66c9 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:19:51.566015 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-254e433c-e824-4c75-8cad-2c2cdfdb66c9 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:19:51.566668 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-254e433c-e824-4c75-8cad-2c2cdfdb66c9 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:19:51.852506 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-254e433c-e824-4c75-8cad-2c2cdfdb66c9 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712b1eb4d5f542219f248896a5b85be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb594dfc7d54c26b2badde74ee74d18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:19:51.866114 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-254e433c-e824-4c75-8cad-2c2cdfdb66c9 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] 10.222.0.18 "GET /compute/v2.1/servers/7c614e45-6138-43f4-85a5-303093b91055" status: 200 len: 1313 microversion: 2.1 time: 0.315698 Oct 22 21:19:51.867367 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2657/5330] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:19:51 2022] GET /compute/v2.1/servers/7c614e45-6138-43f4-85a5-303093b91055 => generated 1313 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:19:52.350845 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-7fd3341a-d54b-4bc8-adbd-762e29c3f7c1 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:19:52.351519 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-7fd3341a-d54b-4bc8-adbd-762e29c3f7c1 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] [instance: 3de67bb0-04d9-4d3a-a925-102f04d677bb] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:19:52.360315 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7fd3341a-d54b-4bc8-adbd-762e29c3f7c1 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:19:52.360714 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7fd3341a-d54b-4bc8-adbd-762e29c3f7c1 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:19:52.361360 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7fd3341a-d54b-4bc8-adbd-762e29c3f7c1 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:19:52.362255 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7fd3341a-d54b-4bc8-adbd-762e29c3f7c1 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:19:52.362886 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7fd3341a-d54b-4bc8-adbd-762e29c3f7c1 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:19:52.363540 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7fd3341a-d54b-4bc8-adbd-762e29c3f7c1 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:19:52.381464 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.wsgi [None req-7fd3341a-d54b-4bc8-adbd-762e29c3f7c1 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] HTTP exception thrown: Instance 3de67bb0-04d9-4d3a-a925-102f04d677bb could not be found. Oct 22 21:19:52.383403 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-7fd3341a-d54b-4bc8-adbd-762e29c3f7c1 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Request method failure captured: Oct 22 21:19:52.383403 ncdv-master-1 devstack@n-api.service[138745]: request: GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb HTTP/1.1 Oct 22 21:19:52.383403 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 21:19:52.383403 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 21:19:52.383403 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 21:19:52.383403 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 0 Oct 22 21:19:52.383403 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 21:19:52.383403 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 21:19:52.383403 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 21:19:52.383403 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 21:19:52.383403 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVF3hm7PiLG1R8Tw2syJVqR4znaBscty3weljpQpv2aVSYokkqaFvTxJu_8ZsVDxnVWNFBjrkTk4hem6vgNXmexe0yUI_M8pHEKoh5CWO6b1coilxRZ6VgX94mIL_xf6l3t9Q4mcnT856zV-XemvxZab0Ooy1ChU21L_her9Zn74z_zU Oct 22 21:19:52.383403 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 21:19:52.383403 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 21:19:52.383403 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 21:19:52.383403 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 21:19:52.383403 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 21:19:52.383403 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 21:19:52.383403 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: 28af724189a24022b3ef7651b7157a9d Oct 22 21:19:52.383403 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-ServersNegativeTestJSON-766586991 Oct 22 21:19:52.383403 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 21:19:52.383403 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 21:19:52.383403 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_28af724189a24022b3ef7651b7157a9d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/28af724189a24022b3ef7651b7157a9d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/28af724189a24022b3ef7651b7157a9d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/28af724189a24022b3ef7651b7157a9d"}]}] Oct 22 21:19:52.383403 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-ServersNegativeTestJSON-766586991 Oct 22 21:19:52.383403 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: 28af724189a24022b3ef7651b7157a9d Oct 22 21:19:52.383403 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-ServersNegativeTestJSON-766586991 Oct 22 21:19:52.383403 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-ServersNegativeTestJSON-766586991-project Oct 22 21:19:52.383403 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 21:19:52.383403 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 21:19:52.383403 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: 6c8a9229e7da421b9e0e6f7df52f71e2 Oct 22 21:19:52.383403 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-ServersNegativeTestJSON-766586991-project Oct 22 21:19:52.383403 ncdv-master-1 devstack@n-api.service[138745]: method: > Oct 22 21:19:52.383403 ncdv-master-1 devstack@n-api.service[138745]: exception: Instance 3de67bb0-04d9-4d3a-a925-102f04d677bb could not be found. Oct 22 21:19:52.383403 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'id': '3de67bb0-04d9-4d3a-a925-102f04d677bb'} Oct 22 21:19:52.383403 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:19:52.383403 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:19:52.383403 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 21:19:52.383403 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 21:19:52.383403 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 21:19:52.383403 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 21:19:52.383403 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 21:19:52.383403 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 21:19:52.383403 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 21:19:52.383403 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 21:19:52.383403 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3de67bb0-04d9-4d3a-a925-102f04d677bb could not be found. Oct 22 21:19:52.383403 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:19:52.383403 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:19:52.383403 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:19:52.383403 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:19:52.383403 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:19:52.383403 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:19:52.383403 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:19:52.383403 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:19:52.383403 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:19:52.383403 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:19:52.383403 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 21:19:52.383403 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 21:19:52.383403 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 21:19:52.383403 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 21:19:52.383403 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 21:19:52.383403 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:19:52.383403 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3de67bb0-04d9-4d3a-a925-102f04d677bb could not be found. Oct 22 21:19:52.383403 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:19:52.383403 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:19:52.383403 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:19:52.387609 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:19:52.387609 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:19:52.387609 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:19:52.387609 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:19:52.387609 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:19:52.387609 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3de67bb0-04d9-4d3a-a925-102f04d677bb could not be found. Oct 22 21:19:52.387609 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:19:52.388918 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-7fd3341a-d54b-4bc8-adbd-762e29c3f7c1 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] Returning 404 to user: Instance 3de67bb0-04d9-4d3a-a925-102f04d677bb could not be found. {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:19:52.389840 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-7fd3341a-d54b-4bc8-adbd-762e29c3f7c1 tempest-ServersNegativeTestJSON-766586991 tempest-ServersNegativeTestJSON-766586991-project] 10.222.0.18 "GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb" status: 404 len: 111 microversion: 2.1 time: 0.045328 Oct 22 21:19:52.390739 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2674/5331] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:19:52 2022] GET /compute/v2.1/servers/3de67bb0-04d9-4d3a-a925-102f04d677bb => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 21:19:52.891415 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-322d891c-3223-4710-bdec-7f926d408477 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:19:52.894743 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-322d891c-3223-4710-bdec-7f926d408477 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] [instance: 7c614e45-6138-43f4-85a5-303093b91055] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:19:52.916772 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-322d891c-3223-4710-bdec-7f926d408477 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:19:52.917293 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-322d891c-3223-4710-bdec-7f926d408477 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:19:52.917752 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-322d891c-3223-4710-bdec-7f926d408477 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:19:52.920884 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-322d891c-3223-4710-bdec-7f926d408477 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:19:52.925494 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-322d891c-3223-4710-bdec-7f926d408477 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:19:52.926217 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-322d891c-3223-4710-bdec-7f926d408477 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:19:53.174027 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-322d891c-3223-4710-bdec-7f926d408477 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712b1eb4d5f542219f248896a5b85be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb594dfc7d54c26b2badde74ee74d18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:19:53.188860 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-322d891c-3223-4710-bdec-7f926d408477 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] 10.222.0.18 "GET /compute/v2.1/servers/7c614e45-6138-43f4-85a5-303093b91055" status: 200 len: 1313 microversion: 2.1 time: 0.302490 Oct 22 21:19:53.190254 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2658/5332] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:19:52 2022] GET /compute/v2.1/servers/7c614e45-6138-43f4-85a5-303093b91055 => generated 1313 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:19:53.209405 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-182e43aa-6ee4-4fdd-966d-9d534ad6171b req-44af98ce-2276-447e-aeea-dddcab9a0b01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c614e45-6138-43f4-85a5-303093b91055", "name": "network-vif-plugged", "status": "completed", "tag": "55a25cb6-9771-4042-939f-e953aff571b7"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:19:53.222006 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-182e43aa-6ee4-4fdd-966d-9d534ad6171b req-44af98ce-2276-447e-aeea-dddcab9a0b01 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:19:53.222764 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-182e43aa-6ee4-4fdd-966d-9d534ad6171b req-44af98ce-2276-447e-aeea-dddcab9a0b01 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:19:53.223471 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-182e43aa-6ee4-4fdd-966d-9d534ad6171b req-44af98ce-2276-447e-aeea-dddcab9a0b01 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:19:53.238002 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-182e43aa-6ee4-4fdd-966d-9d534ad6171b req-44af98ce-2276-447e-aeea-dddcab9a0b01 service nova] Creating event network-vif-plugged:55a25cb6-9771-4042-939f-e953aff571b7 for instance 7c614e45-6138-43f4-85a5-303093b91055 on nch1-master-1 Oct 22 21:19:53.245449 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-182e43aa-6ee4-4fdd-966d-9d534ad6171b req-44af98ce-2276-447e-aeea-dddcab9a0b01 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056949 Oct 22 21:19:53.246729 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2675/5333] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:19:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:19:54.221319 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-0fbd3dfd-9199-4630-8f8f-f2208c53d168 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:19:54.222123 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-0fbd3dfd-9199-4630-8f8f-f2208c53d168 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] [instance: 7c614e45-6138-43f4-85a5-303093b91055] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:19:54.241464 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0fbd3dfd-9199-4630-8f8f-f2208c53d168 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:19:54.243841 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0fbd3dfd-9199-4630-8f8f-f2208c53d168 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:19:54.246689 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0fbd3dfd-9199-4630-8f8f-f2208c53d168 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:19:54.247521 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0fbd3dfd-9199-4630-8f8f-f2208c53d168 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:19:54.251050 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0fbd3dfd-9199-4630-8f8f-f2208c53d168 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:19:54.251761 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0fbd3dfd-9199-4630-8f8f-f2208c53d168 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:19:54.525700 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-0fbd3dfd-9199-4630-8f8f-f2208c53d168 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712b1eb4d5f542219f248896a5b85be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb594dfc7d54c26b2badde74ee74d18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:19:54.535162 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-0fbd3dfd-9199-4630-8f8f-f2208c53d168 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] 10.222.0.18 "GET /compute/v2.1/servers/7c614e45-6138-43f4-85a5-303093b91055" status: 200 len: 1313 microversion: 2.1 time: 0.322549 Oct 22 21:19:54.539845 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2659/5334] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:19:54 2022] GET /compute/v2.1/servers/7c614e45-6138-43f4-85a5-303093b91055 => generated 1313 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:19:55.566542 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-c6c2ca08-ce34-4368-8cbd-f7d101bdca9a tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:19:55.567247 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-c6c2ca08-ce34-4368-8cbd-f7d101bdca9a tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] [instance: 7c614e45-6138-43f4-85a5-303093b91055] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:19:55.580083 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c6c2ca08-ce34-4368-8cbd-f7d101bdca9a tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:19:55.580879 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c6c2ca08-ce34-4368-8cbd-f7d101bdca9a tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:19:55.586623 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c6c2ca08-ce34-4368-8cbd-f7d101bdca9a tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:19:55.587692 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c6c2ca08-ce34-4368-8cbd-f7d101bdca9a tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:19:55.588339 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c6c2ca08-ce34-4368-8cbd-f7d101bdca9a tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:19:55.588963 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c6c2ca08-ce34-4368-8cbd-f7d101bdca9a tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:19:55.837317 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-c6c2ca08-ce34-4368-8cbd-f7d101bdca9a tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712b1eb4d5f542219f248896a5b85be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb594dfc7d54c26b2badde74ee74d18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:19:55.846659 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-c6c2ca08-ce34-4368-8cbd-f7d101bdca9a tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] 10.222.0.18 "GET /compute/v2.1/servers/7c614e45-6138-43f4-85a5-303093b91055" status: 200 len: 1497 microversion: 2.1 time: 0.285635 Oct 22 21:19:55.861637 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2676/5335] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:19:55 2022] GET /compute/v2.1/servers/7c614e45-6138-43f4-85a5-303093b91055 => generated 1497 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:19:56.363598 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-e7a25a1a-56f2-41dc-86ed-ce7cd0452ddd tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:19:56.364170 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-e7a25a1a-56f2-41dc-86ed-ce7cd0452ddd tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] [instance: 7c614e45-6138-43f4-85a5-303093b91055] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:19:56.371411 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e7a25a1a-56f2-41dc-86ed-ce7cd0452ddd tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:19:56.371955 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e7a25a1a-56f2-41dc-86ed-ce7cd0452ddd tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:19:56.372393 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e7a25a1a-56f2-41dc-86ed-ce7cd0452ddd tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:19:56.373096 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e7a25a1a-56f2-41dc-86ed-ce7cd0452ddd tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:19:56.373663 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e7a25a1a-56f2-41dc-86ed-ce7cd0452ddd tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:19:56.374367 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e7a25a1a-56f2-41dc-86ed-ce7cd0452ddd tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:19:56.405923 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-e7a25a1a-56f2-41dc-86ed-ce7cd0452ddd tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] [instance: 7c614e45-6138-43f4-85a5-303093b91055] Going to try to terminate instance {{(pid=138744) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 21:19:56.530079 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-e7a25a1a-56f2-41dc-86ed-ce7cd0452ddd tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] 10.222.0.18 "DELETE /compute/v2.1/servers/7c614e45-6138-43f4-85a5-303093b91055" status: 204 len: 0 microversion: 2.1 time: 0.179674 Oct 22 21:19:56.536121 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2660/5336] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 21:19:56 2022] DELETE /compute/v2.1/servers/7c614e45-6138-43f4-85a5-303093b91055 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 21:19:56.542475 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-5f45a1d8-aa3b-4230-925b-e5e1ea412fe0 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:19:56.543113 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-5f45a1d8-aa3b-4230-925b-e5e1ea412fe0 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] [instance: 7c614e45-6138-43f4-85a5-303093b91055] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:19:56.550617 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5f45a1d8-aa3b-4230-925b-e5e1ea412fe0 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:19:56.551123 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5f45a1d8-aa3b-4230-925b-e5e1ea412fe0 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:19:56.559253 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5f45a1d8-aa3b-4230-925b-e5e1ea412fe0 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:19:56.560313 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5f45a1d8-aa3b-4230-925b-e5e1ea412fe0 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:19:56.560966 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5f45a1d8-aa3b-4230-925b-e5e1ea412fe0 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:19:56.561676 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5f45a1d8-aa3b-4230-925b-e5e1ea412fe0 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:19:56.889198 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-5f45a1d8-aa3b-4230-925b-e5e1ea412fe0 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712b1eb4d5f542219f248896a5b85be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb594dfc7d54c26b2badde74ee74d18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:19:56.903536 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-5f45a1d8-aa3b-4230-925b-e5e1ea412fe0 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] 10.222.0.18 "GET /compute/v2.1/servers/7c614e45-6138-43f4-85a5-303093b91055" status: 200 len: 1503 microversion: 2.1 time: 0.365233 Oct 22 21:19:56.918013 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2677/5337] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:19:56 2022] GET /compute/v2.1/servers/7c614e45-6138-43f4-85a5-303093b91055 => generated 1503 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:19:56.923599 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-2cc87266-b488-46f9-8c4b-a06aadd9cda3 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:19:56.924984 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-2cc87266-b488-46f9-8c4b-a06aadd9cda3 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: 20d90b58-3fad-4a44-b6bf-4ef0cc587def] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:19:56.933186 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2cc87266-b488-46f9-8c4b-a06aadd9cda3 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:19:56.933908 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2cc87266-b488-46f9-8c4b-a06aadd9cda3 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:19:56.935059 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2cc87266-b488-46f9-8c4b-a06aadd9cda3 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:19:56.935966 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2cc87266-b488-46f9-8c4b-a06aadd9cda3 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:19:56.936633 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2cc87266-b488-46f9-8c4b-a06aadd9cda3 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:19:56.937193 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2cc87266-b488-46f9-8c4b-a06aadd9cda3 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:19:57.180766 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-2cc87266-b488-46f9-8c4b-a06aadd9cda3 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c85602851244d4a632b9c861eb4416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45cb377c6a9a43b3b91c99a64e37f1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:19:57.189373 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-2cc87266-b488-46f9-8c4b-a06aadd9cda3 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def" status: 200 len: 1669 microversion: 2.1 time: 0.274530 Oct 22 21:19:57.190568 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2661/5338] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:19:56 2022] GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def => generated 1669 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:19:57.218968 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-8f68ca22-f827-4db2-8af2-e7a30bbbf4c3 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-3-260527770"}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:19:57.226635 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-8f68ca22-f827-4db2-8af2-e7a30bbbf4c3 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: 20d90b58-3fad-4a44-b6bf-4ef0cc587def] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:19:57.234343 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8f68ca22-f827-4db2-8af2-e7a30bbbf4c3 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:19:57.234945 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8f68ca22-f827-4db2-8af2-e7a30bbbf4c3 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:19:57.235424 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8f68ca22-f827-4db2-8af2-e7a30bbbf4c3 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:19:57.237376 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8f68ca22-f827-4db2-8af2-e7a30bbbf4c3 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:19:57.238332 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8f68ca22-f827-4db2-8af2-e7a30bbbf4c3 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:19:57.239014 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8f68ca22-f827-4db2-8af2-e7a30bbbf4c3 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:19:57.260354 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:19:57.507933 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-8f68ca22-f827-4db2-8af2-e7a30bbbf4c3 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "POST /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def/action" status: 202 len: 0 microversion: 2.1 time: 0.296903 Oct 22 21:19:57.511961 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2678/5339] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 21:19:57 2022] POST /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def/action => generated 0 bytes in 299 msecs (HTTP/1.1 202) 10 headers in 456 bytes (2 switches on core 0) Oct 22 21:19:57.518196 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-f3eff5f2-25b4-4070-b564-4abdaeae0326 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:19:57.518850 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-f3eff5f2-25b4-4070-b564-4abdaeae0326 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: 20d90b58-3fad-4a44-b6bf-4ef0cc587def] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:19:57.547925 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f3eff5f2-25b4-4070-b564-4abdaeae0326 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:19:57.549846 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f3eff5f2-25b4-4070-b564-4abdaeae0326 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:19:57.550432 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f3eff5f2-25b4-4070-b564-4abdaeae0326 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:19:57.552189 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f3eff5f2-25b4-4070-b564-4abdaeae0326 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:19:57.555178 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f3eff5f2-25b4-4070-b564-4abdaeae0326 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:19:57.555758 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f3eff5f2-25b4-4070-b564-4abdaeae0326 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:19:57.603428 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:19:57.936068 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-70e851f0-5d1c-4335-90e9-0629037931e3 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:19:57.938148 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-70e851f0-5d1c-4335-90e9-0629037931e3 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] [instance: 7c614e45-6138-43f4-85a5-303093b91055] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:19:57.947966 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-70e851f0-5d1c-4335-90e9-0629037931e3 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:19:57.948988 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-70e851f0-5d1c-4335-90e9-0629037931e3 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:19:57.949608 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-70e851f0-5d1c-4335-90e9-0629037931e3 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:19:57.950546 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-70e851f0-5d1c-4335-90e9-0629037931e3 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:19:57.951537 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-70e851f0-5d1c-4335-90e9-0629037931e3 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:19:57.952104 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-70e851f0-5d1c-4335-90e9-0629037931e3 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:19:58.412895 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-70e851f0-5d1c-4335-90e9-0629037931e3 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712b1eb4d5f542219f248896a5b85be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb594dfc7d54c26b2badde74ee74d18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:19:58.437273 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-70e851f0-5d1c-4335-90e9-0629037931e3 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] 10.222.0.18 "GET /compute/v2.1/servers/7c614e45-6138-43f4-85a5-303093b91055" status: 200 len: 1503 microversion: 2.1 time: 0.507707 Oct 22 21:19:58.438439 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2679/5340] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:19:57 2022] GET /compute/v2.1/servers/7c614e45-6138-43f4-85a5-303093b91055 => generated 1503 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:19:58.470735 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-f3eff5f2-25b4-4070-b564-4abdaeae0326 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c85602851244d4a632b9c861eb4416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45cb377c6a9a43b3b91c99a64e37f1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:19:58.487846 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-f3eff5f2-25b4-4070-b564-4abdaeae0326 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def" status: 200 len: 1679 microversion: 2.1 time: 0.973824 Oct 22 21:19:58.488780 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2662/5341] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:19:57 2022] GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def => generated 1679 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:19:59.057491 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-49fd1ae9-81c7-4205-b549-6780da5e42b5 req-6cc0ca0c-4463-4545-8fc4-f576f3761c67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c614e45-6138-43f4-85a5-303093b91055", "name": "network-vif-deleted", "tag": "55a25cb6-9771-4042-939f-e953aff571b7"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:19:59.070632 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-49fd1ae9-81c7-4205-b549-6780da5e42b5 req-6cc0ca0c-4463-4545-8fc4-f576f3761c67 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:19:59.070632 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-49fd1ae9-81c7-4205-b549-6780da5e42b5 req-6cc0ca0c-4463-4545-8fc4-f576f3761c67 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:19:59.071078 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-49fd1ae9-81c7-4205-b549-6780da5e42b5 req-6cc0ca0c-4463-4545-8fc4-f576f3761c67 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:19:59.085584 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-49fd1ae9-81c7-4205-b549-6780da5e42b5 req-6cc0ca0c-4463-4545-8fc4-f576f3761c67 service nova] Creating event network-vif-deleted:55a25cb6-9771-4042-939f-e953aff571b7 for instance 7c614e45-6138-43f4-85a5-303093b91055 on nch1-master-1 Oct 22 21:19:59.096281 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-49fd1ae9-81c7-4205-b549-6780da5e42b5 req-6cc0ca0c-4463-4545-8fc4-f576f3761c67 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039147 Oct 22 21:19:59.097415 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2680/5342] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:19:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:19:59.466132 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-f0f06d60-be5d-4c2f-9e53-1c2a9274f157 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:19:59.467451 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-f0f06d60-be5d-4c2f-9e53-1c2a9274f157 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] [instance: 7c614e45-6138-43f4-85a5-303093b91055] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:19:59.476072 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f0f06d60-be5d-4c2f-9e53-1c2a9274f157 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:19:59.476962 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f0f06d60-be5d-4c2f-9e53-1c2a9274f157 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:19:59.477650 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f0f06d60-be5d-4c2f-9e53-1c2a9274f157 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:19:59.478881 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f0f06d60-be5d-4c2f-9e53-1c2a9274f157 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:19:59.479736 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f0f06d60-be5d-4c2f-9e53-1c2a9274f157 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:19:59.480457 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f0f06d60-be5d-4c2f-9e53-1c2a9274f157 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:19:59.515392 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-a6e1eeee-edc0-4c99-9301-edd3c514f30b tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:19:59.517196 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-a6e1eeee-edc0-4c99-9301-edd3c514f30b tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: 20d90b58-3fad-4a44-b6bf-4ef0cc587def] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:19:59.523474 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f0f06d60-be5d-4c2f-9e53-1c2a9274f157 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:19:59.524248 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f0f06d60-be5d-4c2f-9e53-1c2a9274f157 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:19:59.524913 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f0f06d60-be5d-4c2f-9e53-1c2a9274f157 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:19:59.525620 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.objects.instance [None req-f0f06d60-be5d-4c2f-9e53-1c2a9274f157 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Lazy-loading 'fault' on Instance uuid 7c614e45-6138-43f4-85a5-303093b91055 {{(pid=138744) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 21:19:59.526260 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a6e1eeee-edc0-4c99-9301-edd3c514f30b tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:19:59.527084 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a6e1eeee-edc0-4c99-9301-edd3c514f30b tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:19:59.528075 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a6e1eeee-edc0-4c99-9301-edd3c514f30b tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:19:59.529096 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a6e1eeee-edc0-4c99-9301-edd3c514f30b tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:19:59.529831 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a6e1eeee-edc0-4c99-9301-edd3c514f30b tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:19:59.531048 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a6e1eeee-edc0-4c99-9301-edd3c514f30b tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:19:59.580897 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-f0f06d60-be5d-4c2f-9e53-1c2a9274f157 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712b1eb4d5f542219f248896a5b85be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb594dfc7d54c26b2badde74ee74d18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:19:59.594442 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-f0f06d60-be5d-4c2f-9e53-1c2a9274f157 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] 10.222.0.18 "GET /compute/v2.1/servers/7c614e45-6138-43f4-85a5-303093b91055" status: 200 len: 1303 microversion: 2.1 time: 0.133430 Oct 22 21:19:59.596454 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2663/5343] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:19:59 2022] GET /compute/v2.1/servers/7c614e45-6138-43f4-85a5-303093b91055 => generated 1303 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:19:59.806854 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-a6e1eeee-edc0-4c99-9301-edd3c514f30b tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c85602851244d4a632b9c861eb4416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45cb377c6a9a43b3b91c99a64e37f1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:19:59.821864 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-a6e1eeee-edc0-4c99-9301-edd3c514f30b tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def" status: 200 len: 1679 microversion: 2.1 time: 0.313169 Oct 22 21:19:59.822618 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2681/5344] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:19:59 2022] GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def => generated 1679 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:20:00.624822 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-de3ca3ab-c3ab-4b03-aada-b45dcd73b8e5 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:20:00.625491 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-de3ca3ab-c3ab-4b03-aada-b45dcd73b8e5 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] [instance: 7c614e45-6138-43f4-85a5-303093b91055] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:20:00.661397 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-de3ca3ab-c3ab-4b03-aada-b45dcd73b8e5 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:20:00.661912 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-de3ca3ab-c3ab-4b03-aada-b45dcd73b8e5 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:20:00.662395 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-de3ca3ab-c3ab-4b03-aada-b45dcd73b8e5 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:20:00.663140 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-de3ca3ab-c3ab-4b03-aada-b45dcd73b8e5 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:20:00.672739 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-de3ca3ab-c3ab-4b03-aada-b45dcd73b8e5 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:20:00.674634 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-de3ca3ab-c3ab-4b03-aada-b45dcd73b8e5 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:20:00.693910 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-de3ca3ab-c3ab-4b03-aada-b45dcd73b8e5 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] HTTP exception thrown: Instance 7c614e45-6138-43f4-85a5-303093b91055 could not be found. Oct 22 21:20:00.696717 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-de3ca3ab-c3ab-4b03-aada-b45dcd73b8e5 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Request method failure captured: Oct 22 21:20:00.696717 ncdv-master-1 devstack@n-api.service[138744]: request: GET /compute/v2.1/servers/7c614e45-6138-43f4-85a5-303093b91055 HTTP/1.1 Oct 22 21:20:00.696717 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 21:20:00.696717 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 21:20:00.696717 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 21:20:00.696717 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 0 Oct 22 21:20:00.696717 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 21:20:00.696717 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 21:20:00.696717 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 21:20:00.696717 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 21:20:00.696717 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVF5pkZROGSv9Qd5jW6xJoxGvWm63ddoT1wqRUaVh66VIKHzDmqZB73F9rifVMxZ4S_nGedZ_u4FJ9MkU74kaow56HbsCOFgMtMWCuDnMrRWgYX_Blrnl70AC2J5is9dv3bXPdfhRXix-7IfEcyPonIvq-mYjS9CxoZEMv83hgkqN0ZY Oct 22 21:20:00.696717 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 21:20:00.696717 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 21:20:00.696717 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 21:20:00.696717 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 21:20:00.696717 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 21:20:00.696717 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 21:20:00.696717 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: 8bb594dfc7d54c26b2badde74ee74d18 Oct 22 21:20:00.696717 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-VolumesActionsTest-1407931533 Oct 22 21:20:00.696717 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 21:20:00.696717 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 21:20:00.696717 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_8bb594dfc7d54c26b2badde74ee74d18"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8bb594dfc7d54c26b2badde74ee74d18"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/8bb594dfc7d54c26b2badde74ee74d18"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8bb594dfc7d54c26b2badde74ee74d18"}]}] Oct 22 21:20:00.696717 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-VolumesActionsTest-1407931533 Oct 22 21:20:00.696717 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: 8bb594dfc7d54c26b2badde74ee74d18 Oct 22 21:20:00.696717 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-VolumesActionsTest-1407931533 Oct 22 21:20:00.696717 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-VolumesActionsTest-1407931533-project Oct 22 21:20:00.696717 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 21:20:00.696717 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 21:20:00.696717 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: 712b1eb4d5f542219f248896a5b85be3 Oct 22 21:20:00.696717 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-VolumesActionsTest-1407931533-project Oct 22 21:20:00.696717 ncdv-master-1 devstack@n-api.service[138744]: method: > Oct 22 21:20:00.696717 ncdv-master-1 devstack@n-api.service[138744]: exception: Instance 7c614e45-6138-43f4-85a5-303093b91055 could not be found. Oct 22 21:20:00.696717 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': '7c614e45-6138-43f4-85a5-303093b91055'} Oct 22 21:20:00.696717 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:20:00.696717 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:20:00.696717 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 21:20:00.696717 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 21:20:00.696717 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 21:20:00.696717 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 21:20:00.696717 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 21:20:00.696717 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 21:20:00.696717 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 21:20:00.696717 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 21:20:00.696717 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c614e45-6138-43f4-85a5-303093b91055 could not be found. Oct 22 21:20:00.696717 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:20:00.696717 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:20:00.696717 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:20:00.696717 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:20:00.696717 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:20:00.696717 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:20:00.696717 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:20:00.696717 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:20:00.696717 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:20:00.696717 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:20:00.696717 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 21:20:00.696717 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 21:20:00.696717 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 21:20:00.696717 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 21:20:00.696717 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 21:20:00.696717 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:20:00.696717 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c614e45-6138-43f4-85a5-303093b91055 could not be found. Oct 22 21:20:00.696717 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:20:00.696717 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:20:00.696717 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:20:00.701854 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:20:00.701854 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:20:00.701854 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:20:00.701854 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:20:00.701854 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:20:00.701854 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c614e45-6138-43f4-85a5-303093b91055 could not be found. Oct 22 21:20:00.701854 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:20:00.705219 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-de3ca3ab-c3ab-4b03-aada-b45dcd73b8e5 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Returning 404 to user: Instance 7c614e45-6138-43f4-85a5-303093b91055 could not be found. {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:20:00.706941 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-de3ca3ab-c3ab-4b03-aada-b45dcd73b8e5 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] 10.222.0.18 "GET /compute/v2.1/servers/7c614e45-6138-43f4-85a5-303093b91055" status: 404 len: 111 microversion: 2.1 time: 0.086846 Oct 22 21:20:00.709746 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2664/5345] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:20:00 2022] GET /compute/v2.1/servers/7c614e45-6138-43f4-85a5-303093b91055 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 21:20:00.851465 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-957c364f-080b-4812-a26f-d43080cb28f4 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:20:00.852927 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-957c364f-080b-4812-a26f-d43080cb28f4 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: 20d90b58-3fad-4a44-b6bf-4ef0cc587def] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:20:00.872885 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-474c7789-7edc-4d21-bb5e-1702701bc0dc tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-2102560696", "imageRef": "085e4478-6edc-4a69-8e08-f9831713eb65", "flavorRef": "452", "networks": [{"uuid": "e6b635f6-c8b1-4d13-922e-5ce3087d5e15"}]}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:20:00.877453 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-957c364f-080b-4812-a26f-d43080cb28f4 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:20:00.877989 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-957c364f-080b-4812-a26f-d43080cb28f4 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:20:00.878465 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-957c364f-080b-4812-a26f-d43080cb28f4 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:20:00.879187 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-957c364f-080b-4812-a26f-d43080cb28f4 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:20:00.881013 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-957c364f-080b-4812-a26f-d43080cb28f4 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:20:00.883858 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-957c364f-080b-4812-a26f-d43080cb28f4 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:20:00.979587 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.network.neutron [None req-474c7789-7edc-4d21-bb5e-1702701bc0dc tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] validate_networks() for [('e6b635f6-c8b1-4d13-922e-5ce3087d5e15', None, None, None, None, None)] {{(pid=138744) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 21:20:01.266817 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-957c364f-080b-4812-a26f-d43080cb28f4 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c85602851244d4a632b9c861eb4416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45cb377c6a9a43b3b91c99a64e37f1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:20:01.278927 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-957c364f-080b-4812-a26f-d43080cb28f4 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def" status: 200 len: 1687 microversion: 2.1 time: 0.433231 Oct 22 21:20:01.280194 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2682/5346] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:20:00 2022] GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def => generated 1687 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:20:01.285312 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-637f05c2-2624-425f-9718-f1867df61432 req-99d46541-084e-44b6-bec3-4fad97729f69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20d90b58-3fad-4a44-b6bf-4ef0cc587def", "name": "network-vif-unplugged", "status": "completed", "tag": "7ef4550f-d128-432a-9dbc-ce1802e6c6da"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:20:01.297174 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-637f05c2-2624-425f-9718-f1867df61432 req-99d46541-084e-44b6-bec3-4fad97729f69 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:20:01.298059 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-637f05c2-2624-425f-9718-f1867df61432 req-99d46541-084e-44b6-bec3-4fad97729f69 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:20:01.299407 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-637f05c2-2624-425f-9718-f1867df61432 req-99d46541-084e-44b6-bec3-4fad97729f69 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:20:01.348787 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-637f05c2-2624-425f-9718-f1867df61432 req-99d46541-084e-44b6-bec3-4fad97729f69 service nova] Creating event network-vif-unplugged:7ef4550f-d128-432a-9dbc-ce1802e6c6da for instance 20d90b58-3fad-4a44-b6bf-4ef0cc587def on nch1-master-1 Oct 22 21:20:01.356841 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-637f05c2-2624-425f-9718-f1867df61432 req-99d46541-084e-44b6-bec3-4fad97729f69 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.074049 Oct 22 21:20:01.358306 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2683/5347] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:20:01 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:20:02.224313 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-474c7789-7edc-4d21-bb5e-1702701bc0dc tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Flavor limits 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 21:20:02.225171 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-474c7789-7edc-4d21-bb5e-1702701bc0dc tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Image limits 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 21:20:02.225819 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-474c7789-7edc-4d21-bb5e-1702701bc0dc tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Flavor pref 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 21:20:02.225962 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-474c7789-7edc-4d21-bb5e-1702701bc0dc tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Image pref 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 21:20:02.226706 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-474c7789-7edc-4d21-bb5e-1702701bc0dc tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 21:20:02.245030 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-474c7789-7edc-4d21-bb5e-1702701bc0dc tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:20:02.245533 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-474c7789-7edc-4d21-bb5e-1702701bc0dc tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:20:02.245977 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-474c7789-7edc-4d21-bb5e-1702701bc0dc tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:20:02.246724 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-474c7789-7edc-4d21-bb5e-1702701bc0dc tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:20:02.247190 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-474c7789-7edc-4d21-bb5e-1702701bc0dc tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:20:02.247652 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-474c7789-7edc-4d21-bb5e-1702701bc0dc tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:20:02.284740 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-474c7789-7edc-4d21-bb5e-1702701bc0dc tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Getting quotas for project 8bb594dfc7d54c26b2badde74ee74d18. Resources: {'cores', 'instances', 'ram'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 21:20:02.292211 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-474c7789-7edc-4d21-bb5e-1702701bc0dc tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Getting quotas for user 712b1eb4d5f542219f248896a5b85be3 and project 8bb594dfc7d54c26b2badde74ee74d18. Resources: {'cores', 'instances', 'ram'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 21:20:02.307721 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-3c8f710b-e4a6-4062-a226-2f7b4eab42cc tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:20:02.308447 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-3c8f710b-e4a6-4062-a226-2f7b4eab42cc tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: 20d90b58-3fad-4a44-b6bf-4ef0cc587def] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:20:02.315242 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-474c7789-7edc-4d21-bb5e-1702701bc0dc tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Going to run 1 instances... {{(pid=138744) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 21:20:02.316311 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-474c7789-7edc-4d21-bb5e-1702701bc0dc tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] [instance: cbdf6f32-0fbe-4fc0-89c3-7108862f56ac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='085e4478-6edc-4a69-8e08-f9831713eb65',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138744) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 21:20:02.335230 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3c8f710b-e4a6-4062-a226-2f7b4eab42cc tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:20:02.341641 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3c8f710b-e4a6-4062-a226-2f7b4eab42cc tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:20:02.342533 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3c8f710b-e4a6-4062-a226-2f7b4eab42cc tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:20:02.343377 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3c8f710b-e4a6-4062-a226-2f7b4eab42cc tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:20:02.343858 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3c8f710b-e4a6-4062-a226-2f7b4eab42cc tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:20:02.344307 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3c8f710b-e4a6-4062-a226-2f7b4eab42cc tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:20:02.384531 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-474c7789-7edc-4d21-bb5e-1702701bc0dc tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.515683 Oct 22 21:20:02.400025 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2665/5348] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Oct 22 21:20:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 1532 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 22 21:20:02.422685 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-42fbe2af-eff0-4d52-aec5-fb5311602668 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:20:02.425084 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-42fbe2af-eff0-4d52-aec5-fb5311602668 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] [instance: cbdf6f32-0fbe-4fc0-89c3-7108862f56ac] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:20:02.624656 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-42fbe2af-eff0-4d52-aec5-fb5311602668 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712b1eb4d5f542219f248896a5b85be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb594dfc7d54c26b2badde74ee74d18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:20:02.640872 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-42fbe2af-eff0-4d52-aec5-fb5311602668 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] 10.222.0.18 "GET /compute/v2.1/servers/cbdf6f32-0fbe-4fc0-89c3-7108862f56ac" status: 200 len: 1214 microversion: 2.1 time: 0.228959 Oct 22 21:20:02.643863 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2666/5349] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:20:02 2022] GET /compute/v2.1/servers/cbdf6f32-0fbe-4fc0-89c3-7108862f56ac => generated 1214 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:20:02.893063 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-3c8f710b-e4a6-4062-a226-2f7b4eab42cc tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c85602851244d4a632b9c861eb4416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45cb377c6a9a43b3b91c99a64e37f1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:20:02.906746 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-3c8f710b-e4a6-4062-a226-2f7b4eab42cc tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def" status: 200 len: 1687 microversion: 2.1 time: 0.602235 Oct 22 21:20:02.909133 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2684/5350] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:20:02 2022] GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def => generated 1687 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:20:03.676425 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-88251177-f733-43be-ba3b-a70b7ead8bc5 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:20:03.677885 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-88251177-f733-43be-ba3b-a70b7ead8bc5 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] [instance: cbdf6f32-0fbe-4fc0-89c3-7108862f56ac] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:20:03.683817 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:20:03.688098 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-88251177-f733-43be-ba3b-a70b7ead8bc5 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:20:03.688622 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-88251177-f733-43be-ba3b-a70b7ead8bc5 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:20:03.689053 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-88251177-f733-43be-ba3b-a70b7ead8bc5 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:20:03.690533 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-88251177-f733-43be-ba3b-a70b7ead8bc5 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:20:03.691150 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-88251177-f733-43be-ba3b-a70b7ead8bc5 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:20:03.691761 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-88251177-f733-43be-ba3b-a70b7ead8bc5 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:20:03.851975 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-88251177-f733-43be-ba3b-a70b7ead8bc5 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712b1eb4d5f542219f248896a5b85be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb594dfc7d54c26b2badde74ee74d18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:20:03.865370 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-88251177-f733-43be-ba3b-a70b7ead8bc5 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] 10.222.0.18 "GET /compute/v2.1/servers/cbdf6f32-0fbe-4fc0-89c3-7108862f56ac" status: 200 len: 1266 microversion: 2.1 time: 0.198146 Oct 22 21:20:03.869467 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2667/5351] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:20:03 2022] GET /compute/v2.1/servers/cbdf6f32-0fbe-4fc0-89c3-7108862f56ac => generated 1266 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:20:03.933986 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-4a333325-2559-4f36-a726-92c6780e1aec tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:20:03.934606 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-4a333325-2559-4f36-a726-92c6780e1aec tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: 20d90b58-3fad-4a44-b6bf-4ef0cc587def] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:20:03.944093 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4a333325-2559-4f36-a726-92c6780e1aec tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:20:03.944594 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4a333325-2559-4f36-a726-92c6780e1aec tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:20:03.950485 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4a333325-2559-4f36-a726-92c6780e1aec tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:20:03.957167 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4a333325-2559-4f36-a726-92c6780e1aec tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:20:03.957765 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4a333325-2559-4f36-a726-92c6780e1aec tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:20:03.958641 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4a333325-2559-4f36-a726-92c6780e1aec tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:20:04.338418 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-4a333325-2559-4f36-a726-92c6780e1aec tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c85602851244d4a632b9c861eb4416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45cb377c6a9a43b3b91c99a64e37f1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:20:04.355426 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-4a333325-2559-4f36-a726-92c6780e1aec tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def" status: 200 len: 1687 microversion: 2.1 time: 0.426366 Oct 22 21:20:04.358230 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2685/5352] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:20:03 2022] GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def => generated 1687 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:20:04.895297 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-d06a9fbb-1273-43e0-9af4-ccdbe12a57e2 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:20:04.897482 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-d06a9fbb-1273-43e0-9af4-ccdbe12a57e2 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] [instance: cbdf6f32-0fbe-4fc0-89c3-7108862f56ac] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:20:04.909461 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d06a9fbb-1273-43e0-9af4-ccdbe12a57e2 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:20:04.910252 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d06a9fbb-1273-43e0-9af4-ccdbe12a57e2 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:20:04.912372 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d06a9fbb-1273-43e0-9af4-ccdbe12a57e2 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:20:04.913314 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d06a9fbb-1273-43e0-9af4-ccdbe12a57e2 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:20:04.914266 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d06a9fbb-1273-43e0-9af4-ccdbe12a57e2 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:20:04.914945 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d06a9fbb-1273-43e0-9af4-ccdbe12a57e2 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:20:05.190622 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-d06a9fbb-1273-43e0-9af4-ccdbe12a57e2 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712b1eb4d5f542219f248896a5b85be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb594dfc7d54c26b2badde74ee74d18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:20:05.200524 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-d06a9fbb-1273-43e0-9af4-ccdbe12a57e2 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] 10.222.0.18 "GET /compute/v2.1/servers/cbdf6f32-0fbe-4fc0-89c3-7108862f56ac" status: 200 len: 1314 microversion: 2.1 time: 0.314032 Oct 22 21:20:05.201625 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2668/5353] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:20:04 2022] GET /compute/v2.1/servers/cbdf6f32-0fbe-4fc0-89c3-7108862f56ac => generated 1314 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:20:05.382202 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-9f1f1652-9548-4fbb-a4d2-004012ab0352 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:20:05.382812 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-9f1f1652-9548-4fbb-a4d2-004012ab0352 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: 20d90b58-3fad-4a44-b6bf-4ef0cc587def] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:20:05.413027 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9f1f1652-9548-4fbb-a4d2-004012ab0352 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:20:05.415069 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9f1f1652-9548-4fbb-a4d2-004012ab0352 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:20:05.415929 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9f1f1652-9548-4fbb-a4d2-004012ab0352 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:20:05.417529 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9f1f1652-9548-4fbb-a4d2-004012ab0352 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:20:05.422995 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9f1f1652-9548-4fbb-a4d2-004012ab0352 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:20:05.423895 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9f1f1652-9548-4fbb-a4d2-004012ab0352 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:20:05.693120 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-9f1f1652-9548-4fbb-a4d2-004012ab0352 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c85602851244d4a632b9c861eb4416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45cb377c6a9a43b3b91c99a64e37f1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:20:05.703218 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-9f1f1652-9548-4fbb-a4d2-004012ab0352 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def" status: 200 len: 1687 microversion: 2.1 time: 0.323130 Oct 22 21:20:05.708140 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2686/5354] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:20:05 2022] GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def => generated 1687 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:20:06.017316 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-5e42c320-9b44-4805-87fb-9422ac519512 req-87c8ee6e-af92-4ed3-8dbf-a0e636005d7b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20d90b58-3fad-4a44-b6bf-4ef0cc587def", "name": "network-vif-plugged", "status": "completed", "tag": "7ef4550f-d128-432a-9dbc-ce1802e6c6da"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:20:06.048461 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-5e42c320-9b44-4805-87fb-9422ac519512 req-87c8ee6e-af92-4ed3-8dbf-a0e636005d7b service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:20:06.050709 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-5e42c320-9b44-4805-87fb-9422ac519512 req-87c8ee6e-af92-4ed3-8dbf-a0e636005d7b service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:20:06.051800 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-5e42c320-9b44-4805-87fb-9422ac519512 req-87c8ee6e-af92-4ed3-8dbf-a0e636005d7b service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:20:06.097499 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-5e42c320-9b44-4805-87fb-9422ac519512 req-87c8ee6e-af92-4ed3-8dbf-a0e636005d7b service nova] Creating event network-vif-plugged:7ef4550f-d128-432a-9dbc-ce1802e6c6da for instance 20d90b58-3fad-4a44-b6bf-4ef0cc587def on nch1-master-1 Oct 22 21:20:06.104354 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-5e42c320-9b44-4805-87fb-9422ac519512 req-87c8ee6e-af92-4ed3-8dbf-a0e636005d7b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092544 Oct 22 21:20:06.105259 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2669/5355] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:20:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:20:06.225615 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-034c9ba5-6902-4515-82d3-bfc84fa5fab5 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:20:06.226255 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-034c9ba5-6902-4515-82d3-bfc84fa5fab5 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] [instance: cbdf6f32-0fbe-4fc0-89c3-7108862f56ac] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:20:06.228570 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:20:06.240010 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-034c9ba5-6902-4515-82d3-bfc84fa5fab5 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:20:06.240859 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-034c9ba5-6902-4515-82d3-bfc84fa5fab5 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:20:06.242662 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-034c9ba5-6902-4515-82d3-bfc84fa5fab5 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:20:06.249745 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-36e00521-1a6c-4167-a572-0c48febc680d req-c10ebd73-5113-4ae7-bd36-21d7d75e9170 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cbdf6f32-0fbe-4fc0-89c3-7108862f56ac", "tag": "3b8b1566-375f-43d8-a33c-f659992ce5c5"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:20:06.258978 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-034c9ba5-6902-4515-82d3-bfc84fa5fab5 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:20:06.259700 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-034c9ba5-6902-4515-82d3-bfc84fa5fab5 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:20:06.260179 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-034c9ba5-6902-4515-82d3-bfc84fa5fab5 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:20:06.270917 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-36e00521-1a6c-4167-a572-0c48febc680d req-c10ebd73-5113-4ae7-bd36-21d7d75e9170 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:20:06.272468 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-36e00521-1a6c-4167-a572-0c48febc680d req-c10ebd73-5113-4ae7-bd36-21d7d75e9170 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:20:06.273096 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-36e00521-1a6c-4167-a572-0c48febc680d req-c10ebd73-5113-4ae7-bd36-21d7d75e9170 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:20:06.298501 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-36e00521-1a6c-4167-a572-0c48febc680d req-c10ebd73-5113-4ae7-bd36-21d7d75e9170 service nova] Creating event network-changed:3b8b1566-375f-43d8-a33c-f659992ce5c5 for instance cbdf6f32-0fbe-4fc0-89c3-7108862f56ac on nch2-master-1 Oct 22 21:20:06.334620 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-36e00521-1a6c-4167-a572-0c48febc680d req-c10ebd73-5113-4ae7-bd36-21d7d75e9170 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077582 Oct 22 21:20:06.340258 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2670/5356] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:20:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 21:20:06.723847 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-034c9ba5-6902-4515-82d3-bfc84fa5fab5 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712b1eb4d5f542219f248896a5b85be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb594dfc7d54c26b2badde74ee74d18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:20:06.736038 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-e3c552ee-d916-4ac0-bbb2-ea9f9e70148f tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:20:06.738040 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-e3c552ee-d916-4ac0-bbb2-ea9f9e70148f tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: 20d90b58-3fad-4a44-b6bf-4ef0cc587def] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:20:06.752408 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-034c9ba5-6902-4515-82d3-bfc84fa5fab5 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] 10.222.0.18 "GET /compute/v2.1/servers/cbdf6f32-0fbe-4fc0-89c3-7108862f56ac" status: 200 len: 1314 microversion: 2.1 time: 0.531378 Oct 22 21:20:06.752940 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2687/5357] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:20:06 2022] GET /compute/v2.1/servers/cbdf6f32-0fbe-4fc0-89c3-7108862f56ac => generated 1314 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:20:06.756632 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e3c552ee-d916-4ac0-bbb2-ea9f9e70148f tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:20:06.757147 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e3c552ee-d916-4ac0-bbb2-ea9f9e70148f tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:20:06.757598 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e3c552ee-d916-4ac0-bbb2-ea9f9e70148f tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:20:06.758332 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e3c552ee-d916-4ac0-bbb2-ea9f9e70148f tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:20:06.758793 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e3c552ee-d916-4ac0-bbb2-ea9f9e70148f tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:20:06.759231 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e3c552ee-d916-4ac0-bbb2-ea9f9e70148f tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:20:07.140037 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-e3c552ee-d916-4ac0-bbb2-ea9f9e70148f tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c85602851244d4a632b9c861eb4416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45cb377c6a9a43b3b91c99a64e37f1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:20:07.150279 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-e3c552ee-d916-4ac0-bbb2-ea9f9e70148f tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def" status: 200 len: 1682 microversion: 2.1 time: 0.419937 Oct 22 21:20:07.172291 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2671/5358] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:20:06 2022] GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def => generated 1682 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:20:07.776971 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-0a25822e-ee2b-4b72-98fe-b765f5b4d8f9 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:20:07.778251 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-0a25822e-ee2b-4b72-98fe-b765f5b4d8f9 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] [instance: cbdf6f32-0fbe-4fc0-89c3-7108862f56ac] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:20:07.805971 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0a25822e-ee2b-4b72-98fe-b765f5b4d8f9 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:20:07.806781 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0a25822e-ee2b-4b72-98fe-b765f5b4d8f9 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:20:07.807264 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0a25822e-ee2b-4b72-98fe-b765f5b4d8f9 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:20:07.808080 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0a25822e-ee2b-4b72-98fe-b765f5b4d8f9 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:20:07.808556 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0a25822e-ee2b-4b72-98fe-b765f5b4d8f9 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:20:07.809009 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0a25822e-ee2b-4b72-98fe-b765f5b4d8f9 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:20:08.088983 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-0a25822e-ee2b-4b72-98fe-b765f5b4d8f9 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712b1eb4d5f542219f248896a5b85be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb594dfc7d54c26b2badde74ee74d18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:20:08.100577 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-0a25822e-ee2b-4b72-98fe-b765f5b4d8f9 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] 10.222.0.18 "GET /compute/v2.1/servers/cbdf6f32-0fbe-4fc0-89c3-7108862f56ac" status: 200 len: 1314 microversion: 2.1 time: 0.327614 Oct 22 21:20:08.101182 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2688/5359] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:20:07 2022] GET /compute/v2.1/servers/cbdf6f32-0fbe-4fc0-89c3-7108862f56ac => generated 1314 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:20:08.183251 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-870cc921-9d3c-48e7-9333-c4cfc081228f tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:20:08.183940 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-870cc921-9d3c-48e7-9333-c4cfc081228f tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: 20d90b58-3fad-4a44-b6bf-4ef0cc587def] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:20:08.197496 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-870cc921-9d3c-48e7-9333-c4cfc081228f tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:20:08.198292 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-870cc921-9d3c-48e7-9333-c4cfc081228f tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:20:08.198942 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-870cc921-9d3c-48e7-9333-c4cfc081228f tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:20:08.200238 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-870cc921-9d3c-48e7-9333-c4cfc081228f tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:20:08.200861 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-870cc921-9d3c-48e7-9333-c4cfc081228f tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:20:08.201456 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-870cc921-9d3c-48e7-9333-c4cfc081228f tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:20:08.419599 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-870cc921-9d3c-48e7-9333-c4cfc081228f tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c85602851244d4a632b9c861eb4416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45cb377c6a9a43b3b91c99a64e37f1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:20:08.433648 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-870cc921-9d3c-48e7-9333-c4cfc081228f tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def" status: 200 len: 1682 microversion: 2.1 time: 0.254697 Oct 22 21:20:08.434182 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2672/5360] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:20:08 2022] GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def => generated 1682 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:20:09.126429 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-0564c214-2d4e-4e88-90eb-4ad96ffbe2e2 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:20:09.127170 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-0564c214-2d4e-4e88-90eb-4ad96ffbe2e2 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] [instance: cbdf6f32-0fbe-4fc0-89c3-7108862f56ac] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:20:09.143937 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0564c214-2d4e-4e88-90eb-4ad96ffbe2e2 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:20:09.145025 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0564c214-2d4e-4e88-90eb-4ad96ffbe2e2 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:20:09.145492 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0564c214-2d4e-4e88-90eb-4ad96ffbe2e2 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:20:09.146277 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0564c214-2d4e-4e88-90eb-4ad96ffbe2e2 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:20:09.146693 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0564c214-2d4e-4e88-90eb-4ad96ffbe2e2 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:20:09.147135 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0564c214-2d4e-4e88-90eb-4ad96ffbe2e2 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:20:09.464279 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-8850f95c-cdfe-4be5-b3a6-d90a15d83d0c tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:20:09.465306 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-8850f95c-cdfe-4be5-b3a6-d90a15d83d0c tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: 20d90b58-3fad-4a44-b6bf-4ef0cc587def] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:20:09.480328 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8850f95c-cdfe-4be5-b3a6-d90a15d83d0c tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:20:09.483277 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8850f95c-cdfe-4be5-b3a6-d90a15d83d0c tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:20:09.484158 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8850f95c-cdfe-4be5-b3a6-d90a15d83d0c tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:20:09.485914 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8850f95c-cdfe-4be5-b3a6-d90a15d83d0c tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:20:09.487990 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8850f95c-cdfe-4be5-b3a6-d90a15d83d0c tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:20:09.489435 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8850f95c-cdfe-4be5-b3a6-d90a15d83d0c tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:20:09.554935 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-0564c214-2d4e-4e88-90eb-4ad96ffbe2e2 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712b1eb4d5f542219f248896a5b85be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb594dfc7d54c26b2badde74ee74d18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:20:09.577960 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-0564c214-2d4e-4e88-90eb-4ad96ffbe2e2 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] 10.222.0.18 "GET /compute/v2.1/servers/cbdf6f32-0fbe-4fc0-89c3-7108862f56ac" status: 200 len: 1314 microversion: 2.1 time: 0.449551 Oct 22 21:20:09.581867 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2689/5361] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:20:09 2022] GET /compute/v2.1/servers/cbdf6f32-0fbe-4fc0-89c3-7108862f56ac => generated 1314 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:20:09.850157 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-8850f95c-cdfe-4be5-b3a6-d90a15d83d0c tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c85602851244d4a632b9c861eb4416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45cb377c6a9a43b3b91c99a64e37f1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:20:09.864146 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-8850f95c-cdfe-4be5-b3a6-d90a15d83d0c tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def" status: 200 len: 1682 microversion: 2.1 time: 0.403412 Oct 22 21:20:09.865302 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2673/5362] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:20:09 2022] GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def => generated 1682 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:20:10.607924 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-528f92da-866e-4d06-a528-52b68e6850d3 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:20:10.608889 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-528f92da-866e-4d06-a528-52b68e6850d3 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] [instance: cbdf6f32-0fbe-4fc0-89c3-7108862f56ac] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:20:10.621054 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-528f92da-866e-4d06-a528-52b68e6850d3 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:20:10.621582 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-528f92da-866e-4d06-a528-52b68e6850d3 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:20:10.622027 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-528f92da-866e-4d06-a528-52b68e6850d3 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:20:10.624814 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-528f92da-866e-4d06-a528-52b68e6850d3 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:20:10.625413 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-528f92da-866e-4d06-a528-52b68e6850d3 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:20:10.626368 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-528f92da-866e-4d06-a528-52b68e6850d3 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:20:10.892396 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-382020f5-dcba-4adc-a267-6366400087c2 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:20:10.893791 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-382020f5-dcba-4adc-a267-6366400087c2 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: 20d90b58-3fad-4a44-b6bf-4ef0cc587def] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:20:10.907487 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-382020f5-dcba-4adc-a267-6366400087c2 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:20:10.933447 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-382020f5-dcba-4adc-a267-6366400087c2 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.026s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:20:10.940445 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-382020f5-dcba-4adc-a267-6366400087c2 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:20:10.942468 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-382020f5-dcba-4adc-a267-6366400087c2 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:20:10.944555 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-382020f5-dcba-4adc-a267-6366400087c2 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:20:10.949409 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-382020f5-dcba-4adc-a267-6366400087c2 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:20:11.669006 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-382020f5-dcba-4adc-a267-6366400087c2 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c85602851244d4a632b9c861eb4416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45cb377c6a9a43b3b91c99a64e37f1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:20:11.680070 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-382020f5-dcba-4adc-a267-6366400087c2 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def" status: 200 len: 1682 microversion: 2.1 time: 0.794140 Oct 22 21:20:11.680668 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2674/5363] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:20:10 2022] GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def => generated 1682 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:20:11.703400 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-528f92da-866e-4d06-a528-52b68e6850d3 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712b1eb4d5f542219f248896a5b85be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb594dfc7d54c26b2badde74ee74d18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:20:11.718224 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-528f92da-866e-4d06-a528-52b68e6850d3 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] 10.222.0.18 "GET /compute/v2.1/servers/cbdf6f32-0fbe-4fc0-89c3-7108862f56ac" status: 200 len: 1314 microversion: 2.1 time: 1.115346 Oct 22 21:20:11.718857 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2690/5364] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:20:10 2022] GET /compute/v2.1/servers/cbdf6f32-0fbe-4fc0-89c3-7108862f56ac => generated 1314 bytes in 1117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:20:12.708467 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-069f02e3-1bcc-4e0c-8e0e-5c1e8173f91a tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:20:12.710107 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-069f02e3-1bcc-4e0c-8e0e-5c1e8173f91a tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: 20d90b58-3fad-4a44-b6bf-4ef0cc587def] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:20:12.714046 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell0:SELECT=2 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:20:12.717866 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell0:SELECT=8 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:20:12.744897 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-069f02e3-1bcc-4e0c-8e0e-5c1e8173f91a tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:20:12.745418 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-069f02e3-1bcc-4e0c-8e0e-5c1e8173f91a tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:20:12.745549 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-cd38de71-ef03-41e4-8f7a-dc56aced067c tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:20:12.746030 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-069f02e3-1bcc-4e0c-8e0e-5c1e8173f91a tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:20:12.746125 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-cd38de71-ef03-41e4-8f7a-dc56aced067c tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] [instance: cbdf6f32-0fbe-4fc0-89c3-7108862f56ac] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:20:12.746585 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-069f02e3-1bcc-4e0c-8e0e-5c1e8173f91a tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:20:12.747047 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-069f02e3-1bcc-4e0c-8e0e-5c1e8173f91a tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:20:12.747502 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-069f02e3-1bcc-4e0c-8e0e-5c1e8173f91a tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:20:12.759881 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cd38de71-ef03-41e4-8f7a-dc56aced067c tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:20:12.760452 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cd38de71-ef03-41e4-8f7a-dc56aced067c tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:20:12.763964 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cd38de71-ef03-41e4-8f7a-dc56aced067c tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:20:12.765267 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cd38de71-ef03-41e4-8f7a-dc56aced067c tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:20:12.765916 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cd38de71-ef03-41e4-8f7a-dc56aced067c tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:20:12.766539 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cd38de71-ef03-41e4-8f7a-dc56aced067c tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:20:13.493502 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-cd38de71-ef03-41e4-8f7a-dc56aced067c tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712b1eb4d5f542219f248896a5b85be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb594dfc7d54c26b2badde74ee74d18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:20:13.507649 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-cd38de71-ef03-41e4-8f7a-dc56aced067c tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] 10.222.0.18 "GET /compute/v2.1/servers/cbdf6f32-0fbe-4fc0-89c3-7108862f56ac" status: 200 len: 1314 microversion: 2.1 time: 0.765345 Oct 22 21:20:13.509049 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2691/5365] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:20:12 2022] GET /compute/v2.1/servers/cbdf6f32-0fbe-4fc0-89c3-7108862f56ac => generated 1314 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:20:13.602055 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-069f02e3-1bcc-4e0c-8e0e-5c1e8173f91a tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c85602851244d4a632b9c861eb4416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45cb377c6a9a43b3b91c99a64e37f1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:20:13.617919 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-069f02e3-1bcc-4e0c-8e0e-5c1e8173f91a tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def" status: 200 len: 1682 microversion: 2.1 time: 0.913315 Oct 22 21:20:13.618612 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2675/5366] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:20:12 2022] GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def => generated 1682 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:20:14.536889 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-7e6ac15c-62a8-497d-8710-14a3fe163484 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:20:14.539293 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-7e6ac15c-62a8-497d-8710-14a3fe163484 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] [instance: cbdf6f32-0fbe-4fc0-89c3-7108862f56ac] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:20:14.564339 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7e6ac15c-62a8-497d-8710-14a3fe163484 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:20:14.565376 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7e6ac15c-62a8-497d-8710-14a3fe163484 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:20:14.569943 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7e6ac15c-62a8-497d-8710-14a3fe163484 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:20:14.571599 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7e6ac15c-62a8-497d-8710-14a3fe163484 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:20:14.573968 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7e6ac15c-62a8-497d-8710-14a3fe163484 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:20:14.574698 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7e6ac15c-62a8-497d-8710-14a3fe163484 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:20:14.604435 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-fe4a9759-0448-47d7-8587-f723aa8ec7f9 req-7fbc38b9-2b68-4242-b13a-af07b3b3519c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cbdf6f32-0fbe-4fc0-89c3-7108862f56ac", "name": "network-vif-plugged", "status": "completed", "tag": "3b8b1566-375f-43d8-a33c-f659992ce5c5"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:20:14.622695 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-fe4a9759-0448-47d7-8587-f723aa8ec7f9 req-7fbc38b9-2b68-4242-b13a-af07b3b3519c service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:20:14.623505 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-fe4a9759-0448-47d7-8587-f723aa8ec7f9 req-7fbc38b9-2b68-4242-b13a-af07b3b3519c service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:20:14.624256 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-fe4a9759-0448-47d7-8587-f723aa8ec7f9 req-7fbc38b9-2b68-4242-b13a-af07b3b3519c service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:20:14.641575 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-fe4a9759-0448-47d7-8587-f723aa8ec7f9 req-7fbc38b9-2b68-4242-b13a-af07b3b3519c service nova] Creating event network-vif-plugged:3b8b1566-375f-43d8-a33c-f659992ce5c5 for instance cbdf6f32-0fbe-4fc0-89c3-7108862f56ac on nch2-master-1 Oct 22 21:20:14.647811 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-fe4a9759-0448-47d7-8587-f723aa8ec7f9 req-7fbc38b9-2b68-4242-b13a-af07b3b3519c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.337885 Oct 22 21:20:14.649043 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2692/5367] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:20:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:20:14.656765 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-c9d52efe-0cd0-4633-93fa-d0f9d0e5e532 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:20:14.657783 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-c9d52efe-0cd0-4633-93fa-d0f9d0e5e532 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: 20d90b58-3fad-4a44-b6bf-4ef0cc587def] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:20:14.679648 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c9d52efe-0cd0-4633-93fa-d0f9d0e5e532 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:20:14.680356 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c9d52efe-0cd0-4633-93fa-d0f9d0e5e532 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:20:14.694707 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c9d52efe-0cd0-4633-93fa-d0f9d0e5e532 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:20:14.696286 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c9d52efe-0cd0-4633-93fa-d0f9d0e5e532 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:20:14.699398 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c9d52efe-0cd0-4633-93fa-d0f9d0e5e532 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:20:14.702831 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c9d52efe-0cd0-4633-93fa-d0f9d0e5e532 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:20:14.976689 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-7e6ac15c-62a8-497d-8710-14a3fe163484 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712b1eb4d5f542219f248896a5b85be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb594dfc7d54c26b2badde74ee74d18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:20:14.991519 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-7e6ac15c-62a8-497d-8710-14a3fe163484 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] 10.222.0.18 "GET /compute/v2.1/servers/cbdf6f32-0fbe-4fc0-89c3-7108862f56ac" status: 200 len: 1314 microversion: 2.1 time: 0.460804 Oct 22 21:20:14.992618 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2676/5368] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:20:14 2022] GET /compute/v2.1/servers/cbdf6f32-0fbe-4fc0-89c3-7108862f56ac => generated 1314 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:20:15.170684 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-c9d52efe-0cd0-4633-93fa-d0f9d0e5e532 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c85602851244d4a632b9c861eb4416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45cb377c6a9a43b3b91c99a64e37f1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:20:15.179819 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-c9d52efe-0cd0-4633-93fa-d0f9d0e5e532 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def" status: 200 len: 1682 microversion: 2.1 time: 0.529172 Oct 22 21:20:15.182588 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2693/5369] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:20:14 2022] GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def => generated 1682 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:20:16.025429 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-43d73798-8c52-4224-9504-4e0841ae5aac tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:20:16.026248 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-43d73798-8c52-4224-9504-4e0841ae5aac tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] [instance: cbdf6f32-0fbe-4fc0-89c3-7108862f56ac] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:20:16.037363 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-43d73798-8c52-4224-9504-4e0841ae5aac tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:20:16.038461 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-43d73798-8c52-4224-9504-4e0841ae5aac tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:20:16.038983 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-43d73798-8c52-4224-9504-4e0841ae5aac tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:20:16.039833 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-43d73798-8c52-4224-9504-4e0841ae5aac tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:20:16.040357 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-43d73798-8c52-4224-9504-4e0841ae5aac tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:20:16.040864 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-43d73798-8c52-4224-9504-4e0841ae5aac tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:20:16.247872 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-43d73798-8c52-4224-9504-4e0841ae5aac tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712b1eb4d5f542219f248896a5b85be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb594dfc7d54c26b2badde74ee74d18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:20:16.257127 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-43d73798-8c52-4224-9504-4e0841ae5aac tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] 10.222.0.18 "GET /compute/v2.1/servers/cbdf6f32-0fbe-4fc0-89c3-7108862f56ac" status: 200 len: 1314 microversion: 2.1 time: 0.238775 Oct 22 21:20:16.258108 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2677/5370] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:20:16 2022] GET /compute/v2.1/servers/cbdf6f32-0fbe-4fc0-89c3-7108862f56ac => generated 1314 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:20:16.281064 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-853964dc-6966-4704-b7c1-644f90ea9d46 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:20:16.282330 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-853964dc-6966-4704-b7c1-644f90ea9d46 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: 20d90b58-3fad-4a44-b6bf-4ef0cc587def] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:20:16.291786 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-e9506843-538d-469e-bfae-c5f2a6da1689 tempest-ServersNegativeTestMultiTenantJSON-327266304 tempest-ServersNegativeTestMultiTenantJSON-327266304-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestMultiTenantJSON-server-595786349", "imageRef": "085e4478-6edc-4a69-8e08-f9831713eb65", "flavorRef": "452", "networks": [{"uuid": "e7da69cf-3c53-4ae5-b09c-d092a9ecd33a"}]}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:20:16.318522 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-853964dc-6966-4704-b7c1-644f90ea9d46 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:20:16.343942 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-853964dc-6966-4704-b7c1-644f90ea9d46 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:20:16.344426 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-853964dc-6966-4704-b7c1-644f90ea9d46 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:20:16.345204 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-853964dc-6966-4704-b7c1-644f90ea9d46 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:20:16.345677 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-853964dc-6966-4704-b7c1-644f90ea9d46 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:20:16.346115 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-853964dc-6966-4704-b7c1-644f90ea9d46 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:20:16.449939 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.network.neutron [None req-e9506843-538d-469e-bfae-c5f2a6da1689 tempest-ServersNegativeTestMultiTenantJSON-327266304 tempest-ServersNegativeTestMultiTenantJSON-327266304-project] validate_networks() for [('e7da69cf-3c53-4ae5-b09c-d092a9ecd33a', None, None, None, None, None)] {{(pid=138745) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 21:20:16.931849 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-853964dc-6966-4704-b7c1-644f90ea9d46 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c85602851244d4a632b9c861eb4416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45cb377c6a9a43b3b91c99a64e37f1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:20:16.950333 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-853964dc-6966-4704-b7c1-644f90ea9d46 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def" status: 200 len: 1682 microversion: 2.1 time: 0.691042 Oct 22 21:20:16.951676 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2678/5371] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:20:16 2022] GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def => generated 1682 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:20:17.138254 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-e9506843-538d-469e-bfae-c5f2a6da1689 tempest-ServersNegativeTestMultiTenantJSON-327266304 tempest-ServersNegativeTestMultiTenantJSON-327266304-project] Flavor limits 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 21:20:17.138963 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-e9506843-538d-469e-bfae-c5f2a6da1689 tempest-ServersNegativeTestMultiTenantJSON-327266304 tempest-ServersNegativeTestMultiTenantJSON-327266304-project] Image limits 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 21:20:17.140084 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-e9506843-538d-469e-bfae-c5f2a6da1689 tempest-ServersNegativeTestMultiTenantJSON-327266304 tempest-ServersNegativeTestMultiTenantJSON-327266304-project] Flavor pref 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 21:20:17.140727 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-e9506843-538d-469e-bfae-c5f2a6da1689 tempest-ServersNegativeTestMultiTenantJSON-327266304 tempest-ServersNegativeTestMultiTenantJSON-327266304-project] Image pref 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 21:20:17.141524 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-e9506843-538d-469e-bfae-c5f2a6da1689 tempest-ServersNegativeTestMultiTenantJSON-327266304 tempest-ServersNegativeTestMultiTenantJSON-327266304-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 21:20:17.173069 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e9506843-538d-469e-bfae-c5f2a6da1689 tempest-ServersNegativeTestMultiTenantJSON-327266304 tempest-ServersNegativeTestMultiTenantJSON-327266304-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:20:17.173825 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e9506843-538d-469e-bfae-c5f2a6da1689 tempest-ServersNegativeTestMultiTenantJSON-327266304 tempest-ServersNegativeTestMultiTenantJSON-327266304-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:20:17.174475 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e9506843-538d-469e-bfae-c5f2a6da1689 tempest-ServersNegativeTestMultiTenantJSON-327266304 tempest-ServersNegativeTestMultiTenantJSON-327266304-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:20:17.175551 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e9506843-538d-469e-bfae-c5f2a6da1689 tempest-ServersNegativeTestMultiTenantJSON-327266304 tempest-ServersNegativeTestMultiTenantJSON-327266304-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:20:17.176389 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e9506843-538d-469e-bfae-c5f2a6da1689 tempest-ServersNegativeTestMultiTenantJSON-327266304 tempest-ServersNegativeTestMultiTenantJSON-327266304-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:20:17.177015 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e9506843-538d-469e-bfae-c5f2a6da1689 tempest-ServersNegativeTestMultiTenantJSON-327266304 tempest-ServersNegativeTestMultiTenantJSON-327266304-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:20:17.200389 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-e9506843-538d-469e-bfae-c5f2a6da1689 tempest-ServersNegativeTestMultiTenantJSON-327266304 tempest-ServersNegativeTestMultiTenantJSON-327266304-project] Getting quotas for project cefb200280d4407ab97de3dadf6bb281. Resources: {'cores', 'instances', 'ram'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 21:20:17.206634 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-e9506843-538d-469e-bfae-c5f2a6da1689 tempest-ServersNegativeTestMultiTenantJSON-327266304 tempest-ServersNegativeTestMultiTenantJSON-327266304-project] Getting quotas for user 2acb3d1b6eba4df187ac68bf39e7aa73 and project cefb200280d4407ab97de3dadf6bb281. Resources: {'cores', 'instances', 'ram'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 21:20:17.228467 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-e9506843-538d-469e-bfae-c5f2a6da1689 tempest-ServersNegativeTestMultiTenantJSON-327266304 tempest-ServersNegativeTestMultiTenantJSON-327266304-project] Going to run 1 instances... {{(pid=138745) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 21:20:17.230887 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-e9506843-538d-469e-bfae-c5f2a6da1689 tempest-ServersNegativeTestMultiTenantJSON-327266304 tempest-ServersNegativeTestMultiTenantJSON-327266304-project] [instance: 6853e911-3704-4087-a449-427f7fc0ba31] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='085e4478-6edc-4a69-8e08-f9831713eb65',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138745) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 21:20:17.288739 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-d11c4cc4-9988-4d3d-85fc-e457eabe4443 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:20:17.291183 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-d11c4cc4-9988-4d3d-85fc-e457eabe4443 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] [instance: cbdf6f32-0fbe-4fc0-89c3-7108862f56ac] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:20:17.297935 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-e9506843-538d-469e-bfae-c5f2a6da1689 tempest-ServersNegativeTestMultiTenantJSON-327266304 tempest-ServersNegativeTestMultiTenantJSON-327266304-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.116667 Oct 22 21:20:17.299650 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2694/5372] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Oct 22 21:20:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 1119 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 22 21:20:17.306949 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d11c4cc4-9988-4d3d-85fc-e457eabe4443 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:20:17.307887 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d11c4cc4-9988-4d3d-85fc-e457eabe4443 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:20:17.308606 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d11c4cc4-9988-4d3d-85fc-e457eabe4443 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:20:17.309535 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d11c4cc4-9988-4d3d-85fc-e457eabe4443 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:20:17.316744 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d11c4cc4-9988-4d3d-85fc-e457eabe4443 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:20:17.317505 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d11c4cc4-9988-4d3d-85fc-e457eabe4443 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:20:17.317737 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-66d4da05-4351-443d-94c3-ddd9e937fb8b tempest-ServersNegativeTestMultiTenantJSON-327266304 tempest-ServersNegativeTestMultiTenantJSON-327266304-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:20:17.318403 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-66d4da05-4351-443d-94c3-ddd9e937fb8b tempest-ServersNegativeTestMultiTenantJSON-327266304 tempest-ServersNegativeTestMultiTenantJSON-327266304-project] [instance: 6853e911-3704-4087-a449-427f7fc0ba31] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:20:17.428206 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-66d4da05-4351-443d-94c3-ddd9e937fb8b tempest-ServersNegativeTestMultiTenantJSON-327266304 tempest-ServersNegativeTestMultiTenantJSON-327266304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2acb3d1b6eba4df187ac68bf39e7aa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cefb200280d4407ab97de3dadf6bb281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:20:17.439510 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-66d4da05-4351-443d-94c3-ddd9e937fb8b tempest-ServersNegativeTestMultiTenantJSON-327266304 tempest-ServersNegativeTestMultiTenantJSON-327266304-project] 10.222.0.18 "GET /compute/v2.1/servers/6853e911-3704-4087-a449-427f7fc0ba31" status: 200 len: 1227 microversion: 2.1 time: 0.132536 Oct 22 21:20:17.440302 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2695/5373] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:20:17 2022] GET /compute/v2.1/servers/6853e911-3704-4087-a449-427f7fc0ba31 => generated 1227 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:20:17.598079 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-d11c4cc4-9988-4d3d-85fc-e457eabe4443 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712b1eb4d5f542219f248896a5b85be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb594dfc7d54c26b2badde74ee74d18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:20:17.608269 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-d11c4cc4-9988-4d3d-85fc-e457eabe4443 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] 10.222.0.18 "GET /compute/v2.1/servers/cbdf6f32-0fbe-4fc0-89c3-7108862f56ac" status: 200 len: 1498 microversion: 2.1 time: 0.326131 Oct 22 21:20:17.609038 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2679/5374] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:20:17 2022] GET /compute/v2.1/servers/cbdf6f32-0fbe-4fc0-89c3-7108862f56ac => generated 1498 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:20:17.984315 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-12e41662-9231-4be5-a673-0891c3a12c6e tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:20:17.984913 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-12e41662-9231-4be5-a673-0891c3a12c6e tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: 20d90b58-3fad-4a44-b6bf-4ef0cc587def] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:20:18.005469 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-12e41662-9231-4be5-a673-0891c3a12c6e tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:20:18.006307 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-12e41662-9231-4be5-a673-0891c3a12c6e tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:20:18.006946 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-12e41662-9231-4be5-a673-0891c3a12c6e tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:20:18.011758 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-12e41662-9231-4be5-a673-0891c3a12c6e tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:20:18.018829 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-12e41662-9231-4be5-a673-0891c3a12c6e tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:20:18.019304 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-12e41662-9231-4be5-a673-0891c3a12c6e tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:20:18.452140 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-12e41662-9231-4be5-a673-0891c3a12c6e tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c85602851244d4a632b9c861eb4416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45cb377c6a9a43b3b91c99a64e37f1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:20:18.461829 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-12e41662-9231-4be5-a673-0891c3a12c6e tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def" status: 200 len: 1682 microversion: 2.1 time: 0.486122 Oct 22 21:20:18.463193 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2696/5375] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:20:17 2022] GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def => generated 1682 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:20:18.466423 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-71998200-80f4-4198-a748-ba7e4d4c7781 tempest-ServersNegativeTestMultiTenantJSON-327266304 tempest-ServersNegativeTestMultiTenantJSON-327266304-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:20:18.467738 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-71998200-80f4-4198-a748-ba7e4d4c7781 tempest-ServersNegativeTestMultiTenantJSON-327266304 tempest-ServersNegativeTestMultiTenantJSON-327266304-project] [instance: 6853e911-3704-4087-a449-427f7fc0ba31] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:20:18.482840 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-71998200-80f4-4198-a748-ba7e4d4c7781 tempest-ServersNegativeTestMultiTenantJSON-327266304 tempest-ServersNegativeTestMultiTenantJSON-327266304-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:20:18.483520 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-71998200-80f4-4198-a748-ba7e4d4c7781 tempest-ServersNegativeTestMultiTenantJSON-327266304 tempest-ServersNegativeTestMultiTenantJSON-327266304-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:20:18.489545 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-71998200-80f4-4198-a748-ba7e4d4c7781 tempest-ServersNegativeTestMultiTenantJSON-327266304 tempest-ServersNegativeTestMultiTenantJSON-327266304-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:20:18.491551 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-71998200-80f4-4198-a748-ba7e4d4c7781 tempest-ServersNegativeTestMultiTenantJSON-327266304 tempest-ServersNegativeTestMultiTenantJSON-327266304-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:20:18.511761 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-71998200-80f4-4198-a748-ba7e4d4c7781 tempest-ServersNegativeTestMultiTenantJSON-327266304 tempest-ServersNegativeTestMultiTenantJSON-327266304-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:20:18.511761 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-71998200-80f4-4198-a748-ba7e4d4c7781 tempest-ServersNegativeTestMultiTenantJSON-327266304 tempest-ServersNegativeTestMultiTenantJSON-327266304-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:20:18.531709 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-0875ce91-37ac-411e-bdf5-4f70277daa6f tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:20:18.533084 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-0875ce91-37ac-411e-bdf5-4f70277daa6f tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] [instance: cbdf6f32-0fbe-4fc0-89c3-7108862f56ac] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:20:18.551061 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0875ce91-37ac-411e-bdf5-4f70277daa6f tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:20:18.551776 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0875ce91-37ac-411e-bdf5-4f70277daa6f tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:20:18.552803 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0875ce91-37ac-411e-bdf5-4f70277daa6f tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:20:18.553624 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0875ce91-37ac-411e-bdf5-4f70277daa6f tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:20:18.554167 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0875ce91-37ac-411e-bdf5-4f70277daa6f tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:20:18.554680 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0875ce91-37ac-411e-bdf5-4f70277daa6f tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:20:18.587490 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-71998200-80f4-4198-a748-ba7e4d4c7781 tempest-ServersNegativeTestMultiTenantJSON-327266304 tempest-ServersNegativeTestMultiTenantJSON-327266304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2acb3d1b6eba4df187ac68bf39e7aa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cefb200280d4407ab97de3dadf6bb281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:20:18.596782 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-71998200-80f4-4198-a748-ba7e4d4c7781 tempest-ServersNegativeTestMultiTenantJSON-327266304 tempest-ServersNegativeTestMultiTenantJSON-327266304-project] 10.222.0.18 "GET /compute/v2.1/servers/6853e911-3704-4087-a449-427f7fc0ba31" status: 200 len: 1279 microversion: 2.1 time: 0.134839 Oct 22 21:20:18.598032 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2680/5376] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:20:18 2022] GET /compute/v2.1/servers/6853e911-3704-4087-a449-427f7fc0ba31 => generated 1279 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:20:18.622885 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:20:18.658440 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-0875ce91-37ac-411e-bdf5-4f70277daa6f tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] [instance: cbdf6f32-0fbe-4fc0-89c3-7108862f56ac] Going to try to terminate instance {{(pid=138745) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 21:20:18.814360 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-0875ce91-37ac-411e-bdf5-4f70277daa6f tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] 10.222.0.18 "DELETE /compute/v2.1/servers/cbdf6f32-0fbe-4fc0-89c3-7108862f56ac" status: 204 len: 0 microversion: 2.1 time: 0.289598 Oct 22 21:20:18.815514 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2697/5377] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 21:20:18 2022] DELETE /compute/v2.1/servers/cbdf6f32-0fbe-4fc0-89c3-7108862f56ac => generated 0 bytes in 292 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 22 21:20:18.825757 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-18ca07b8-65ba-4a07-97bc-532df8b88878 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:20:18.826446 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-18ca07b8-65ba-4a07-97bc-532df8b88878 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] [instance: cbdf6f32-0fbe-4fc0-89c3-7108862f56ac] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:20:18.840132 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-18ca07b8-65ba-4a07-97bc-532df8b88878 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:20:18.840775 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-18ca07b8-65ba-4a07-97bc-532df8b88878 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:20:18.841229 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-18ca07b8-65ba-4a07-97bc-532df8b88878 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:20:18.843327 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-18ca07b8-65ba-4a07-97bc-532df8b88878 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:20:18.844443 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-18ca07b8-65ba-4a07-97bc-532df8b88878 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:20:18.845074 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-18ca07b8-65ba-4a07-97bc-532df8b88878 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:20:19.291420 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-18ca07b8-65ba-4a07-97bc-532df8b88878 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712b1eb4d5f542219f248896a5b85be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb594dfc7d54c26b2badde74ee74d18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:20:19.301503 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-18ca07b8-65ba-4a07-97bc-532df8b88878 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] 10.222.0.18 "GET /compute/v2.1/servers/cbdf6f32-0fbe-4fc0-89c3-7108862f56ac" status: 200 len: 1504 microversion: 2.1 time: 0.480610 Oct 22 21:20:19.315550 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2681/5378] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:20:18 2022] GET /compute/v2.1/servers/cbdf6f32-0fbe-4fc0-89c3-7108862f56ac => generated 1504 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:20:19.493151 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-30983763-7d6a-4506-a70e-5a4d402ff88e tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:20:19.494537 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-30983763-7d6a-4506-a70e-5a4d402ff88e tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: 20d90b58-3fad-4a44-b6bf-4ef0cc587def] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:20:19.502726 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-30983763-7d6a-4506-a70e-5a4d402ff88e tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:20:19.504618 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-30983763-7d6a-4506-a70e-5a4d402ff88e tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:20:19.505974 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-30983763-7d6a-4506-a70e-5a4d402ff88e tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:20:19.507993 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-30983763-7d6a-4506-a70e-5a4d402ff88e tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:20:19.508917 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-30983763-7d6a-4506-a70e-5a4d402ff88e tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:20:19.509557 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-30983763-7d6a-4506-a70e-5a4d402ff88e tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:20:19.629459 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-91a25d9c-d630-4214-b0f8-c096f1c226a0 tempest-ServersNegativeTestMultiTenantJSON-327266304 tempest-ServersNegativeTestMultiTenantJSON-327266304-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:20:19.630418 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-91a25d9c-d630-4214-b0f8-c096f1c226a0 tempest-ServersNegativeTestMultiTenantJSON-327266304 tempest-ServersNegativeTestMultiTenantJSON-327266304-project] [instance: 6853e911-3704-4087-a449-427f7fc0ba31] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:20:19.645576 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-91a25d9c-d630-4214-b0f8-c096f1c226a0 tempest-ServersNegativeTestMultiTenantJSON-327266304 tempest-ServersNegativeTestMultiTenantJSON-327266304-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:20:19.646895 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-91a25d9c-d630-4214-b0f8-c096f1c226a0 tempest-ServersNegativeTestMultiTenantJSON-327266304 tempest-ServersNegativeTestMultiTenantJSON-327266304-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:20:19.647749 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-91a25d9c-d630-4214-b0f8-c096f1c226a0 tempest-ServersNegativeTestMultiTenantJSON-327266304 tempest-ServersNegativeTestMultiTenantJSON-327266304-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:20:19.648847 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-91a25d9c-d630-4214-b0f8-c096f1c226a0 tempest-ServersNegativeTestMultiTenantJSON-327266304 tempest-ServersNegativeTestMultiTenantJSON-327266304-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:20:19.649839 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-91a25d9c-d630-4214-b0f8-c096f1c226a0 tempest-ServersNegativeTestMultiTenantJSON-327266304 tempest-ServersNegativeTestMultiTenantJSON-327266304-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:20:19.650790 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-91a25d9c-d630-4214-b0f8-c096f1c226a0 tempest-ServersNegativeTestMultiTenantJSON-327266304 tempest-ServersNegativeTestMultiTenantJSON-327266304-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:20:19.682922 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:SELECT=100 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:20:19.837037 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-91a25d9c-d630-4214-b0f8-c096f1c226a0 tempest-ServersNegativeTestMultiTenantJSON-327266304 tempest-ServersNegativeTestMultiTenantJSON-327266304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2acb3d1b6eba4df187ac68bf39e7aa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cefb200280d4407ab97de3dadf6bb281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:20:19.850991 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-91a25d9c-d630-4214-b0f8-c096f1c226a0 tempest-ServersNegativeTestMultiTenantJSON-327266304 tempest-ServersNegativeTestMultiTenantJSON-327266304-project] 10.222.0.18 "GET /compute/v2.1/servers/6853e911-3704-4087-a449-427f7fc0ba31" status: 200 len: 1285 microversion: 2.1 time: 0.227529 Oct 22 21:20:19.867372 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2682/5379] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:20:19 2022] GET /compute/v2.1/servers/6853e911-3704-4087-a449-427f7fc0ba31 => generated 1285 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:20:20.035159 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-30983763-7d6a-4506-a70e-5a4d402ff88e tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c85602851244d4a632b9c861eb4416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45cb377c6a9a43b3b91c99a64e37f1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:20:20.058125 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-30983763-7d6a-4506-a70e-5a4d402ff88e tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def" status: 200 len: 1682 microversion: 2.1 time: 0.569798 Oct 22 21:20:20.062508 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2698/5380] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:20:19 2022] GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def => generated 1682 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:20:20.331617 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-1b031e9d-1abf-4ef9-9202-d99f03874a95 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:20:20.331617 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-1b031e9d-1abf-4ef9-9202-d99f03874a95 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] [instance: cbdf6f32-0fbe-4fc0-89c3-7108862f56ac] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:20:20.341824 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1b031e9d-1abf-4ef9-9202-d99f03874a95 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:20:20.342412 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1b031e9d-1abf-4ef9-9202-d99f03874a95 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:20:20.342863 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1b031e9d-1abf-4ef9-9202-d99f03874a95 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:20:20.343608 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1b031e9d-1abf-4ef9-9202-d99f03874a95 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:20:20.346940 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1b031e9d-1abf-4ef9-9202-d99f03874a95 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:20:20.350021 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1b031e9d-1abf-4ef9-9202-d99f03874a95 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:20:20.674311 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-1b031e9d-1abf-4ef9-9202-d99f03874a95 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712b1eb4d5f542219f248896a5b85be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb594dfc7d54c26b2badde74ee74d18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:20:20.687757 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-1b031e9d-1abf-4ef9-9202-d99f03874a95 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] 10.222.0.18 "GET /compute/v2.1/servers/cbdf6f32-0fbe-4fc0-89c3-7108862f56ac" status: 200 len: 1504 microversion: 2.1 time: 0.361552 Oct 22 21:20:20.691897 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2683/5381] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:20:20 2022] GET /compute/v2.1/servers/cbdf6f32-0fbe-4fc0-89c3-7108862f56ac => generated 1504 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:20:20.881019 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-b96786ae-b99b-4566-a71b-e2d3cc658fa2 tempest-ServersNegativeTestMultiTenantJSON-327266304 tempest-ServersNegativeTestMultiTenantJSON-327266304-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:20:20.888758 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-b96786ae-b99b-4566-a71b-e2d3cc658fa2 tempest-ServersNegativeTestMultiTenantJSON-327266304 tempest-ServersNegativeTestMultiTenantJSON-327266304-project] [instance: 6853e911-3704-4087-a449-427f7fc0ba31] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:20:20.905813 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b96786ae-b99b-4566-a71b-e2d3cc658fa2 tempest-ServersNegativeTestMultiTenantJSON-327266304 tempest-ServersNegativeTestMultiTenantJSON-327266304-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:20:20.908115 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b96786ae-b99b-4566-a71b-e2d3cc658fa2 tempest-ServersNegativeTestMultiTenantJSON-327266304 tempest-ServersNegativeTestMultiTenantJSON-327266304-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:20:20.908775 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b96786ae-b99b-4566-a71b-e2d3cc658fa2 tempest-ServersNegativeTestMultiTenantJSON-327266304 tempest-ServersNegativeTestMultiTenantJSON-327266304-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:20:20.911245 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b96786ae-b99b-4566-a71b-e2d3cc658fa2 tempest-ServersNegativeTestMultiTenantJSON-327266304 tempest-ServersNegativeTestMultiTenantJSON-327266304-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:20:20.912019 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b96786ae-b99b-4566-a71b-e2d3cc658fa2 tempest-ServersNegativeTestMultiTenantJSON-327266304 tempest-ServersNegativeTestMultiTenantJSON-327266304-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:20:20.913794 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b96786ae-b99b-4566-a71b-e2d3cc658fa2 tempest-ServersNegativeTestMultiTenantJSON-327266304 tempest-ServersNegativeTestMultiTenantJSON-327266304-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:20:21.084644 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-160377cd-8f2d-4629-87bf-1188eaff0d3b tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:20:21.085708 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-160377cd-8f2d-4629-87bf-1188eaff0d3b tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: 20d90b58-3fad-4a44-b6bf-4ef0cc587def] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:20:21.096747 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-160377cd-8f2d-4629-87bf-1188eaff0d3b tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:20:21.100025 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-160377cd-8f2d-4629-87bf-1188eaff0d3b tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:20:21.100740 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-160377cd-8f2d-4629-87bf-1188eaff0d3b tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:20:21.102409 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-160377cd-8f2d-4629-87bf-1188eaff0d3b tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:20:21.103856 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-160377cd-8f2d-4629-87bf-1188eaff0d3b tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:20:21.112304 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-160377cd-8f2d-4629-87bf-1188eaff0d3b tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:20:21.812064 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-b96786ae-b99b-4566-a71b-e2d3cc658fa2 tempest-ServersNegativeTestMultiTenantJSON-327266304 tempest-ServersNegativeTestMultiTenantJSON-327266304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2acb3d1b6eba4df187ac68bf39e7aa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cefb200280d4407ab97de3dadf6bb281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:20:21.823087 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-b96786ae-b99b-4566-a71b-e2d3cc658fa2 tempest-ServersNegativeTestMultiTenantJSON-327266304 tempest-ServersNegativeTestMultiTenantJSON-327266304-project] 10.222.0.18 "GET /compute/v2.1/servers/6853e911-3704-4087-a449-427f7fc0ba31" status: 200 len: 1327 microversion: 2.1 time: 0.946056 Oct 22 21:20:21.824343 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2699/5382] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:20:20 2022] GET /compute/v2.1/servers/6853e911-3704-4087-a449-427f7fc0ba31 => generated 1327 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:20:21.830058 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-df7e5daa-b3e2-4f46-b602-1aa2dcee668e tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:20:21.830968 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-df7e5daa-b3e2-4f46-b602-1aa2dcee668e tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] [instance: cbdf6f32-0fbe-4fc0-89c3-7108862f56ac] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:20:21.838603 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-df7e5daa-b3e2-4f46-b602-1aa2dcee668e tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:20:21.839329 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-df7e5daa-b3e2-4f46-b602-1aa2dcee668e tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:20:21.840083 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-df7e5daa-b3e2-4f46-b602-1aa2dcee668e tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:20:21.840985 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-df7e5daa-b3e2-4f46-b602-1aa2dcee668e tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:20:21.841622 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-df7e5daa-b3e2-4f46-b602-1aa2dcee668e tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:20:21.842360 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-df7e5daa-b3e2-4f46-b602-1aa2dcee668e tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:20:21.917537 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-160377cd-8f2d-4629-87bf-1188eaff0d3b tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c85602851244d4a632b9c861eb4416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45cb377c6a9a43b3b91c99a64e37f1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:20:21.931398 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-160377cd-8f2d-4629-87bf-1188eaff0d3b tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def" status: 200 len: 1682 microversion: 2.1 time: 0.850868 Oct 22 21:20:21.932305 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2684/5383] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:20:21 2022] GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def => generated 1682 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:20:22.007960 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-df7e5daa-b3e2-4f46-b602-1aa2dcee668e tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712b1eb4d5f542219f248896a5b85be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb594dfc7d54c26b2badde74ee74d18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:20:22.018259 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-df7e5daa-b3e2-4f46-b602-1aa2dcee668e tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] 10.222.0.18 "GET /compute/v2.1/servers/cbdf6f32-0fbe-4fc0-89c3-7108862f56ac" status: 200 len: 1462 microversion: 2.1 time: 0.192622 Oct 22 21:20:22.021850 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2700/5384] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:20:21 2022] GET /compute/v2.1/servers/cbdf6f32-0fbe-4fc0-89c3-7108862f56ac => generated 1462 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:20:22.081673 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-9c1d8e17-0663-453c-ad1e-9856e7d71e72 req-94a50ed1-e1de-425e-a766-b44476560c84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cbdf6f32-0fbe-4fc0-89c3-7108862f56ac", "name": "network-vif-deleted", "tag": "3b8b1566-375f-43d8-a33c-f659992ce5c5"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:20:22.102802 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-9c1d8e17-0663-453c-ad1e-9856e7d71e72 req-94a50ed1-e1de-425e-a766-b44476560c84 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:20:22.105003 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-9c1d8e17-0663-453c-ad1e-9856e7d71e72 req-94a50ed1-e1de-425e-a766-b44476560c84 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:20:22.105750 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-9c1d8e17-0663-453c-ad1e-9856e7d71e72 req-94a50ed1-e1de-425e-a766-b44476560c84 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:20:22.132978 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-9c1d8e17-0663-453c-ad1e-9856e7d71e72 req-94a50ed1-e1de-425e-a766-b44476560c84 service nova] Creating event network-vif-deleted:3b8b1566-375f-43d8-a33c-f659992ce5c5 for instance cbdf6f32-0fbe-4fc0-89c3-7108862f56ac on nch2-master-1 Oct 22 21:20:22.143061 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-9c1d8e17-0663-453c-ad1e-9856e7d71e72 req-94a50ed1-e1de-425e-a766-b44476560c84 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066877 Oct 22 21:20:22.149445 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2685/5385] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:20:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 21:20:22.849123 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-f70beb00-bcd0-4d19-b7fd-8fde417619b1 tempest-ServersNegativeTestMultiTenantJSON-327266304 tempest-ServersNegativeTestMultiTenantJSON-327266304-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:20:22.850191 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-f70beb00-bcd0-4d19-b7fd-8fde417619b1 tempest-ServersNegativeTestMultiTenantJSON-327266304 tempest-ServersNegativeTestMultiTenantJSON-327266304-project] [instance: 6853e911-3704-4087-a449-427f7fc0ba31] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:20:22.903263 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f70beb00-bcd0-4d19-b7fd-8fde417619b1 tempest-ServersNegativeTestMultiTenantJSON-327266304 tempest-ServersNegativeTestMultiTenantJSON-327266304-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:20:22.904226 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f70beb00-bcd0-4d19-b7fd-8fde417619b1 tempest-ServersNegativeTestMultiTenantJSON-327266304 tempest-ServersNegativeTestMultiTenantJSON-327266304-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:20:22.905184 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f70beb00-bcd0-4d19-b7fd-8fde417619b1 tempest-ServersNegativeTestMultiTenantJSON-327266304 tempest-ServersNegativeTestMultiTenantJSON-327266304-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:20:22.906363 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f70beb00-bcd0-4d19-b7fd-8fde417619b1 tempest-ServersNegativeTestMultiTenantJSON-327266304 tempest-ServersNegativeTestMultiTenantJSON-327266304-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:20:22.907158 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f70beb00-bcd0-4d19-b7fd-8fde417619b1 tempest-ServersNegativeTestMultiTenantJSON-327266304 tempest-ServersNegativeTestMultiTenantJSON-327266304-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:20:22.907902 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f70beb00-bcd0-4d19-b7fd-8fde417619b1 tempest-ServersNegativeTestMultiTenantJSON-327266304 tempest-ServersNegativeTestMultiTenantJSON-327266304-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:20:22.970803 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-75c6ccad-ba4c-445a-b8a9-6eda293e000e tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:20:22.972172 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-75c6ccad-ba4c-445a-b8a9-6eda293e000e tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: 20d90b58-3fad-4a44-b6bf-4ef0cc587def] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:20:22.987639 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-75c6ccad-ba4c-445a-b8a9-6eda293e000e tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:20:22.992540 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-75c6ccad-ba4c-445a-b8a9-6eda293e000e tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:20:22.993208 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-75c6ccad-ba4c-445a-b8a9-6eda293e000e tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:20:22.994512 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-75c6ccad-ba4c-445a-b8a9-6eda293e000e tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:20:22.994983 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-75c6ccad-ba4c-445a-b8a9-6eda293e000e tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:20:22.995461 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-75c6ccad-ba4c-445a-b8a9-6eda293e000e tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:20:23.305511 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-f70beb00-bcd0-4d19-b7fd-8fde417619b1 tempest-ServersNegativeTestMultiTenantJSON-327266304 tempest-ServersNegativeTestMultiTenantJSON-327266304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2acb3d1b6eba4df187ac68bf39e7aa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cefb200280d4407ab97de3dadf6bb281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:20:23.320590 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-f70beb00-bcd0-4d19-b7fd-8fde417619b1 tempest-ServersNegativeTestMultiTenantJSON-327266304 tempest-ServersNegativeTestMultiTenantJSON-327266304-project] 10.222.0.18 "GET /compute/v2.1/servers/6853e911-3704-4087-a449-427f7fc0ba31" status: 200 len: 1327 microversion: 2.1 time: 0.475641 Oct 22 21:20:23.339065 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2701/5386] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:20:22 2022] GET /compute/v2.1/servers/6853e911-3704-4087-a449-427f7fc0ba31 => generated 1327 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:20:23.348012 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-ef3f8c83-916b-4d6d-a6f7-673a96c906b3 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:20:23.348877 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-ef3f8c83-916b-4d6d-a6f7-673a96c906b3 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] [instance: cbdf6f32-0fbe-4fc0-89c3-7108862f56ac] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:20:23.359826 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ef3f8c83-916b-4d6d-a6f7-673a96c906b3 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:20:23.360974 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ef3f8c83-916b-4d6d-a6f7-673a96c906b3 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:20:23.361952 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ef3f8c83-916b-4d6d-a6f7-673a96c906b3 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:20:23.363279 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ef3f8c83-916b-4d6d-a6f7-673a96c906b3 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:20:23.364206 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ef3f8c83-916b-4d6d-a6f7-673a96c906b3 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:20:23.364862 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ef3f8c83-916b-4d6d-a6f7-673a96c906b3 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:20:23.388624 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.wsgi [None req-ef3f8c83-916b-4d6d-a6f7-673a96c906b3 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] HTTP exception thrown: Instance cbdf6f32-0fbe-4fc0-89c3-7108862f56ac could not be found. Oct 22 21:20:23.393130 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-ef3f8c83-916b-4d6d-a6f7-673a96c906b3 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Request method failure captured: Oct 22 21:20:23.393130 ncdv-master-1 devstack@n-api.service[138745]: request: GET /compute/v2.1/servers/cbdf6f32-0fbe-4fc0-89c3-7108862f56ac HTTP/1.1 Oct 22 21:20:23.393130 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 21:20:23.393130 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 21:20:23.393130 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 21:20:23.393130 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 0 Oct 22 21:20:23.393130 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 21:20:23.393130 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 21:20:23.393130 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 21:20:23.393130 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 21:20:23.393130 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVF5pkZROGSv9Qd5jW6xJoxGvWm63ddoT1wqRUaVh66VIKHzDmqZB73F9rifVMxZ4S_nGedZ_u4FJ9MkU74kaow56HbsCOFgMtMWCuDnMrRWgYX_Blrnl70AC2J5is9dv3bXPdfhRXix-7IfEcyPonIvq-mYjS9CxoZEMv83hgkqN0ZY Oct 22 21:20:23.393130 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 21:20:23.393130 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 21:20:23.393130 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 21:20:23.393130 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 21:20:23.393130 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 21:20:23.393130 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 21:20:23.393130 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: 8bb594dfc7d54c26b2badde74ee74d18 Oct 22 21:20:23.393130 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-VolumesActionsTest-1407931533 Oct 22 21:20:23.393130 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 21:20:23.393130 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 21:20:23.393130 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_8bb594dfc7d54c26b2badde74ee74d18"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8bb594dfc7d54c26b2badde74ee74d18"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/8bb594dfc7d54c26b2badde74ee74d18"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8bb594dfc7d54c26b2badde74ee74d18"}]}] Oct 22 21:20:23.393130 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-VolumesActionsTest-1407931533 Oct 22 21:20:23.393130 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: 8bb594dfc7d54c26b2badde74ee74d18 Oct 22 21:20:23.393130 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-VolumesActionsTest-1407931533 Oct 22 21:20:23.393130 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-VolumesActionsTest-1407931533-project Oct 22 21:20:23.393130 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 21:20:23.393130 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 21:20:23.393130 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: 712b1eb4d5f542219f248896a5b85be3 Oct 22 21:20:23.393130 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-VolumesActionsTest-1407931533-project Oct 22 21:20:23.393130 ncdv-master-1 devstack@n-api.service[138745]: method: > Oct 22 21:20:23.393130 ncdv-master-1 devstack@n-api.service[138745]: exception: Instance cbdf6f32-0fbe-4fc0-89c3-7108862f56ac could not be found. Oct 22 21:20:23.393130 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'id': 'cbdf6f32-0fbe-4fc0-89c3-7108862f56ac'} Oct 22 21:20:23.393130 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:20:23.393130 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:20:23.393130 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 21:20:23.393130 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 21:20:23.393130 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 21:20:23.393130 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 21:20:23.393130 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 21:20:23.393130 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 21:20:23.393130 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 21:20:23.393130 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 21:20:23.393130 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cbdf6f32-0fbe-4fc0-89c3-7108862f56ac could not be found. Oct 22 21:20:23.393130 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:20:23.393130 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:20:23.393130 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:20:23.393130 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:20:23.393130 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:20:23.393130 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:20:23.393130 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:20:23.393130 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:20:23.393130 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:20:23.393130 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:20:23.393130 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 21:20:23.393130 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 21:20:23.393130 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 21:20:23.393130 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 21:20:23.393130 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 21:20:23.393130 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:20:23.393130 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cbdf6f32-0fbe-4fc0-89c3-7108862f56ac could not be found. Oct 22 21:20:23.393130 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:20:23.393130 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:20:23.393130 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:20:23.399199 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:20:23.399199 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:20:23.399199 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:20:23.399199 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:20:23.399199 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:20:23.399199 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cbdf6f32-0fbe-4fc0-89c3-7108862f56ac could not be found. Oct 22 21:20:23.399199 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:20:23.402777 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-ef3f8c83-916b-4d6d-a6f7-673a96c906b3 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] Returning 404 to user: Instance cbdf6f32-0fbe-4fc0-89c3-7108862f56ac could not be found. {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:20:23.404047 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-ef3f8c83-916b-4d6d-a6f7-673a96c906b3 tempest-VolumesActionsTest-1407931533 tempest-VolumesActionsTest-1407931533-project] 10.222.0.18 "GET /compute/v2.1/servers/cbdf6f32-0fbe-4fc0-89c3-7108862f56ac" status: 404 len: 111 microversion: 2.1 time: 0.063399 Oct 22 21:20:23.405532 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2702/5387] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:20:23 2022] GET /compute/v2.1/servers/cbdf6f32-0fbe-4fc0-89c3-7108862f56ac => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 21:20:23.464416 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-75c6ccad-ba4c-445a-b8a9-6eda293e000e tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c85602851244d4a632b9c861eb4416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45cb377c6a9a43b3b91c99a64e37f1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:20:23.477605 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-75c6ccad-ba4c-445a-b8a9-6eda293e000e tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def" status: 200 len: 1682 microversion: 2.1 time: 0.519217 Oct 22 21:20:23.480214 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2686/5388] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:20:22 2022] GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def => generated 1682 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:20:24.182711 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-27827fbe-c01a-4bff-85a3-4691ab49b844 req-c048ee12-386e-4512-aa81-4a54d602f84a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6853e911-3704-4087-a449-427f7fc0ba31", "tag": "a62c12be-871a-4554-a872-93c4372deedb"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:20:24.216928 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-27827fbe-c01a-4bff-85a3-4691ab49b844 req-c048ee12-386e-4512-aa81-4a54d602f84a service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:20:24.217626 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-27827fbe-c01a-4bff-85a3-4691ab49b844 req-c048ee12-386e-4512-aa81-4a54d602f84a service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:20:24.218526 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-27827fbe-c01a-4bff-85a3-4691ab49b844 req-c048ee12-386e-4512-aa81-4a54d602f84a service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:20:24.241864 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-27827fbe-c01a-4bff-85a3-4691ab49b844 req-c048ee12-386e-4512-aa81-4a54d602f84a service nova] Creating event network-changed:a62c12be-871a-4554-a872-93c4372deedb for instance 6853e911-3704-4087-a449-427f7fc0ba31 on nch1-master-1 Oct 22 21:20:24.249256 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-27827fbe-c01a-4bff-85a3-4691ab49b844 req-c048ee12-386e-4512-aa81-4a54d602f84a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070561 Oct 22 21:20:24.253741 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2703/5389] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:20:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:20:24.353763 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-0332d905-8ba8-4ff0-b8e1-ca1dda940d0f tempest-ServersNegativeTestMultiTenantJSON-327266304 tempest-ServersNegativeTestMultiTenantJSON-327266304-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:20:24.355196 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-0332d905-8ba8-4ff0-b8e1-ca1dda940d0f tempest-ServersNegativeTestMultiTenantJSON-327266304 tempest-ServersNegativeTestMultiTenantJSON-327266304-project] [instance: 6853e911-3704-4087-a449-427f7fc0ba31] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:20:24.363456 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0332d905-8ba8-4ff0-b8e1-ca1dda940d0f tempest-ServersNegativeTestMultiTenantJSON-327266304 tempest-ServersNegativeTestMultiTenantJSON-327266304-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:20:24.364266 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0332d905-8ba8-4ff0-b8e1-ca1dda940d0f tempest-ServersNegativeTestMultiTenantJSON-327266304 tempest-ServersNegativeTestMultiTenantJSON-327266304-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:20:24.365010 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0332d905-8ba8-4ff0-b8e1-ca1dda940d0f tempest-ServersNegativeTestMultiTenantJSON-327266304 tempest-ServersNegativeTestMultiTenantJSON-327266304-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:20:24.365907 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0332d905-8ba8-4ff0-b8e1-ca1dda940d0f tempest-ServersNegativeTestMultiTenantJSON-327266304 tempest-ServersNegativeTestMultiTenantJSON-327266304-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:20:24.371844 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0332d905-8ba8-4ff0-b8e1-ca1dda940d0f tempest-ServersNegativeTestMultiTenantJSON-327266304 tempest-ServersNegativeTestMultiTenantJSON-327266304-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:20:24.372313 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0332d905-8ba8-4ff0-b8e1-ca1dda940d0f tempest-ServersNegativeTestMultiTenantJSON-327266304 tempest-ServersNegativeTestMultiTenantJSON-327266304-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:20:24.510782 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-2af72059-a87e-4ae9-a55f-f6c930e6594b tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:20:24.512657 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-2af72059-a87e-4ae9-a55f-f6c930e6594b tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: 20d90b58-3fad-4a44-b6bf-4ef0cc587def] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:20:24.520763 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2af72059-a87e-4ae9-a55f-f6c930e6594b tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:20:24.521529 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2af72059-a87e-4ae9-a55f-f6c930e6594b tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:20:24.522236 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2af72059-a87e-4ae9-a55f-f6c930e6594b tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:20:24.523267 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2af72059-a87e-4ae9-a55f-f6c930e6594b tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:20:24.523989 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2af72059-a87e-4ae9-a55f-f6c930e6594b tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:20:24.524592 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2af72059-a87e-4ae9-a55f-f6c930e6594b tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:20:24.564959 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-0332d905-8ba8-4ff0-b8e1-ca1dda940d0f tempest-ServersNegativeTestMultiTenantJSON-327266304 tempest-ServersNegativeTestMultiTenantJSON-327266304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2acb3d1b6eba4df187ac68bf39e7aa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cefb200280d4407ab97de3dadf6bb281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:20:24.576020 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-0332d905-8ba8-4ff0-b8e1-ca1dda940d0f tempest-ServersNegativeTestMultiTenantJSON-327266304 tempest-ServersNegativeTestMultiTenantJSON-327266304-project] 10.222.0.18 "GET /compute/v2.1/servers/6853e911-3704-4087-a449-427f7fc0ba31" status: 200 len: 1327 microversion: 2.1 time: 0.226313 Oct 22 21:20:24.582439 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2687/5390] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:20:24 2022] GET /compute/v2.1/servers/6853e911-3704-4087-a449-427f7fc0ba31 => generated 1327 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:20:24.742725 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-2af72059-a87e-4ae9-a55f-f6c930e6594b tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c85602851244d4a632b9c861eb4416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45cb377c6a9a43b3b91c99a64e37f1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:20:24.752050 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-2af72059-a87e-4ae9-a55f-f6c930e6594b tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def" status: 200 len: 1682 microversion: 2.1 time: 0.248009 Oct 22 21:20:24.767003 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2704/5391] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:20:24 2022] GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def => generated 1682 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:20:25.606813 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-7d4dd6f7-36cd-440e-bf79-a822e45554e1 tempest-ServersNegativeTestMultiTenantJSON-327266304 tempest-ServersNegativeTestMultiTenantJSON-327266304-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:20:25.608574 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-7d4dd6f7-36cd-440e-bf79-a822e45554e1 tempest-ServersNegativeTestMultiTenantJSON-327266304 tempest-ServersNegativeTestMultiTenantJSON-327266304-project] [instance: 6853e911-3704-4087-a449-427f7fc0ba31] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:20:25.618326 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7d4dd6f7-36cd-440e-bf79-a822e45554e1 tempest-ServersNegativeTestMultiTenantJSON-327266304 tempest-ServersNegativeTestMultiTenantJSON-327266304-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:20:25.619113 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7d4dd6f7-36cd-440e-bf79-a822e45554e1 tempest-ServersNegativeTestMultiTenantJSON-327266304 tempest-ServersNegativeTestMultiTenantJSON-327266304-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:20:25.619823 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7d4dd6f7-36cd-440e-bf79-a822e45554e1 tempest-ServersNegativeTestMultiTenantJSON-327266304 tempest-ServersNegativeTestMultiTenantJSON-327266304-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:20:25.620937 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7d4dd6f7-36cd-440e-bf79-a822e45554e1 tempest-ServersNegativeTestMultiTenantJSON-327266304 tempest-ServersNegativeTestMultiTenantJSON-327266304-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:20:25.621657 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7d4dd6f7-36cd-440e-bf79-a822e45554e1 tempest-ServersNegativeTestMultiTenantJSON-327266304 tempest-ServersNegativeTestMultiTenantJSON-327266304-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:20:25.622346 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7d4dd6f7-36cd-440e-bf79-a822e45554e1 tempest-ServersNegativeTestMultiTenantJSON-327266304 tempest-ServersNegativeTestMultiTenantJSON-327266304-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:20:25.784748 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-21a9c765-4779-4c08-b1fd-8df4c971104e tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:20:25.786625 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-21a9c765-4779-4c08-b1fd-8df4c971104e tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: 20d90b58-3fad-4a44-b6bf-4ef0cc587def] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:20:25.809218 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-21a9c765-4779-4c08-b1fd-8df4c971104e tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:20:25.809778 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-21a9c765-4779-4c08-b1fd-8df4c971104e tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:20:25.810936 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-21a9c765-4779-4c08-b1fd-8df4c971104e tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:20:25.814658 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-21a9c765-4779-4c08-b1fd-8df4c971104e tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:20:25.815487 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-21a9c765-4779-4c08-b1fd-8df4c971104e tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:20:25.818844 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-21a9c765-4779-4c08-b1fd-8df4c971104e tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:20:25.873987 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-7d4dd6f7-36cd-440e-bf79-a822e45554e1 tempest-ServersNegativeTestMultiTenantJSON-327266304 tempest-ServersNegativeTestMultiTenantJSON-327266304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2acb3d1b6eba4df187ac68bf39e7aa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cefb200280d4407ab97de3dadf6bb281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:20:25.883561 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-7d4dd6f7-36cd-440e-bf79-a822e45554e1 tempest-ServersNegativeTestMultiTenantJSON-327266304 tempest-ServersNegativeTestMultiTenantJSON-327266304-project] 10.222.0.18 "GET /compute/v2.1/servers/6853e911-3704-4087-a449-427f7fc0ba31" status: 200 len: 1327 microversion: 2.1 time: 0.281157 Oct 22 21:20:25.896267 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2688/5392] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:20:25 2022] GET /compute/v2.1/servers/6853e911-3704-4087-a449-427f7fc0ba31 => generated 1327 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:20:26.108785 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-21a9c765-4779-4c08-b1fd-8df4c971104e tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c85602851244d4a632b9c861eb4416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45cb377c6a9a43b3b91c99a64e37f1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:20:26.119608 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-21a9c765-4779-4c08-b1fd-8df4c971104e tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def" status: 200 len: 1682 microversion: 2.1 time: 0.339249 Oct 22 21:20:26.120475 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2705/5393] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:20:25 2022] GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def => generated 1682 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:20:26.910103 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-7a65bc58-e855-4909-a377-ddbc670fa7b3 tempest-ServersNegativeTestMultiTenantJSON-327266304 tempest-ServersNegativeTestMultiTenantJSON-327266304-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:20:26.910749 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-7a65bc58-e855-4909-a377-ddbc670fa7b3 tempest-ServersNegativeTestMultiTenantJSON-327266304 tempest-ServersNegativeTestMultiTenantJSON-327266304-project] [instance: 6853e911-3704-4087-a449-427f7fc0ba31] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:20:26.920268 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7a65bc58-e855-4909-a377-ddbc670fa7b3 tempest-ServersNegativeTestMultiTenantJSON-327266304 tempest-ServersNegativeTestMultiTenantJSON-327266304-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:20:26.921017 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7a65bc58-e855-4909-a377-ddbc670fa7b3 tempest-ServersNegativeTestMultiTenantJSON-327266304 tempest-ServersNegativeTestMultiTenantJSON-327266304-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:20:26.921468 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7a65bc58-e855-4909-a377-ddbc670fa7b3 tempest-ServersNegativeTestMultiTenantJSON-327266304 tempest-ServersNegativeTestMultiTenantJSON-327266304-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:20:26.922187 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7a65bc58-e855-4909-a377-ddbc670fa7b3 tempest-ServersNegativeTestMultiTenantJSON-327266304 tempest-ServersNegativeTestMultiTenantJSON-327266304-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:20:26.922645 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7a65bc58-e855-4909-a377-ddbc670fa7b3 tempest-ServersNegativeTestMultiTenantJSON-327266304 tempest-ServersNegativeTestMultiTenantJSON-327266304-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:20:26.923117 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7a65bc58-e855-4909-a377-ddbc670fa7b3 tempest-ServersNegativeTestMultiTenantJSON-327266304 tempest-ServersNegativeTestMultiTenantJSON-327266304-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:20:27.076991 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-7a65bc58-e855-4909-a377-ddbc670fa7b3 tempest-ServersNegativeTestMultiTenantJSON-327266304 tempest-ServersNegativeTestMultiTenantJSON-327266304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2acb3d1b6eba4df187ac68bf39e7aa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cefb200280d4407ab97de3dadf6bb281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:20:27.085221 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-7a65bc58-e855-4909-a377-ddbc670fa7b3 tempest-ServersNegativeTestMultiTenantJSON-327266304 tempest-ServersNegativeTestMultiTenantJSON-327266304-project] 10.222.0.18 "GET /compute/v2.1/servers/6853e911-3704-4087-a449-427f7fc0ba31" status: 200 len: 1327 microversion: 2.1 time: 0.180465 Oct 22 21:20:27.086895 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2689/5394] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:20:26 2022] GET /compute/v2.1/servers/6853e911-3704-4087-a449-427f7fc0ba31 => generated 1327 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:20:27.144295 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-4818ec04-7cdb-431d-874f-d1bd4be069dc tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:20:27.144854 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-4818ec04-7cdb-431d-874f-d1bd4be069dc tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: 20d90b58-3fad-4a44-b6bf-4ef0cc587def] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:20:27.152577 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4818ec04-7cdb-431d-874f-d1bd4be069dc tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:20:27.153352 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4818ec04-7cdb-431d-874f-d1bd4be069dc tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:20:27.153975 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4818ec04-7cdb-431d-874f-d1bd4be069dc tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:20:27.154918 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4818ec04-7cdb-431d-874f-d1bd4be069dc tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:20:27.155503 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4818ec04-7cdb-431d-874f-d1bd4be069dc tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:20:27.156478 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4818ec04-7cdb-431d-874f-d1bd4be069dc tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:20:27.190360 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell0:SELECT=2 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:20:27.357283 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-4818ec04-7cdb-431d-874f-d1bd4be069dc tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c85602851244d4a632b9c861eb4416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45cb377c6a9a43b3b91c99a64e37f1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:20:27.368471 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-4818ec04-7cdb-431d-874f-d1bd4be069dc tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def" status: 200 len: 1669 microversion: 2.1 time: 0.228159 Oct 22 21:20:27.384755 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2706/5395] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:20:27 2022] GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def => generated 1669 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:20:27.548425 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-55d9a0c0-a321-4149-8958-8160dbd22472 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:20:27.549335 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-55d9a0c0-a321-4149-8958-8160dbd22472 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: 20d90b58-3fad-4a44-b6bf-4ef0cc587def] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:20:27.558266 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-55d9a0c0-a321-4149-8958-8160dbd22472 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:20:27.558765 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-55d9a0c0-a321-4149-8958-8160dbd22472 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:20:27.559213 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-55d9a0c0-a321-4149-8958-8160dbd22472 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:20:27.559962 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-55d9a0c0-a321-4149-8958-8160dbd22472 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:20:27.560431 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-55d9a0c0-a321-4149-8958-8160dbd22472 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:20:27.563515 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-55d9a0c0-a321-4149-8958-8160dbd22472 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:20:27.744451 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-55d9a0c0-a321-4149-8958-8160dbd22472 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c85602851244d4a632b9c861eb4416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45cb377c6a9a43b3b91c99a64e37f1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:20:27.755931 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-55d9a0c0-a321-4149-8958-8160dbd22472 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def" status: 200 len: 1669 microversion: 2.1 time: 0.210977 Oct 22 21:20:27.756751 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2690/5396] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:20:27 2022] GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def => generated 1669 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:20:28.111707 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-f6264df2-3d01-4145-a9e0-9e168407a0c1 tempest-ServersNegativeTestMultiTenantJSON-327266304 tempest-ServersNegativeTestMultiTenantJSON-327266304-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:20:28.112646 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-f6264df2-3d01-4145-a9e0-9e168407a0c1 tempest-ServersNegativeTestMultiTenantJSON-327266304 tempest-ServersNegativeTestMultiTenantJSON-327266304-project] [instance: 6853e911-3704-4087-a449-427f7fc0ba31] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:20:28.125889 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell0:SELECT=8 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:20:28.130319 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f6264df2-3d01-4145-a9e0-9e168407a0c1 tempest-ServersNegativeTestMultiTenantJSON-327266304 tempest-ServersNegativeTestMultiTenantJSON-327266304-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:20:28.132023 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f6264df2-3d01-4145-a9e0-9e168407a0c1 tempest-ServersNegativeTestMultiTenantJSON-327266304 tempest-ServersNegativeTestMultiTenantJSON-327266304-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:20:28.133965 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f6264df2-3d01-4145-a9e0-9e168407a0c1 tempest-ServersNegativeTestMultiTenantJSON-327266304 tempest-ServersNegativeTestMultiTenantJSON-327266304-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:20:28.134854 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f6264df2-3d01-4145-a9e0-9e168407a0c1 tempest-ServersNegativeTestMultiTenantJSON-327266304 tempest-ServersNegativeTestMultiTenantJSON-327266304-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:20:28.136122 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f6264df2-3d01-4145-a9e0-9e168407a0c1 tempest-ServersNegativeTestMultiTenantJSON-327266304 tempest-ServersNegativeTestMultiTenantJSON-327266304-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:20:28.136654 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f6264df2-3d01-4145-a9e0-9e168407a0c1 tempest-ServersNegativeTestMultiTenantJSON-327266304 tempest-ServersNegativeTestMultiTenantJSON-327266304-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:20:28.399890 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-f6264df2-3d01-4145-a9e0-9e168407a0c1 tempest-ServersNegativeTestMultiTenantJSON-327266304 tempest-ServersNegativeTestMultiTenantJSON-327266304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2acb3d1b6eba4df187ac68bf39e7aa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cefb200280d4407ab97de3dadf6bb281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:20:28.418027 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-f6264df2-3d01-4145-a9e0-9e168407a0c1 tempest-ServersNegativeTestMultiTenantJSON-327266304 tempest-ServersNegativeTestMultiTenantJSON-327266304-project] 10.222.0.18 "GET /compute/v2.1/servers/6853e911-3704-4087-a449-427f7fc0ba31" status: 200 len: 1327 microversion: 2.1 time: 0.311064 Oct 22 21:20:28.419882 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2707/5397] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:20:28 2022] GET /compute/v2.1/servers/6853e911-3704-4087-a449-427f7fc0ba31 => generated 1327 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:20:29.397298 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-c9b3756d-fafd-43e4-b6db-3f85eefbbbb5 req-4c04f814-9d1f-480e-8f33-06f141957810 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6853e911-3704-4087-a449-427f7fc0ba31", "name": "network-vif-plugged", "status": "completed", "tag": "a62c12be-871a-4554-a872-93c4372deedb"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:20:29.442839 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-0f8d1a48-6092-4561-90e7-b1d8072168c9 tempest-ServersNegativeTestMultiTenantJSON-327266304 tempest-ServersNegativeTestMultiTenantJSON-327266304-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:20:29.444219 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-0f8d1a48-6092-4561-90e7-b1d8072168c9 tempest-ServersNegativeTestMultiTenantJSON-327266304 tempest-ServersNegativeTestMultiTenantJSON-327266304-project] [instance: 6853e911-3704-4087-a449-427f7fc0ba31] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:20:29.450120 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-c9b3756d-fafd-43e4-b6db-3f85eefbbbb5 req-4c04f814-9d1f-480e-8f33-06f141957810 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:20:29.450616 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-c9b3756d-fafd-43e4-b6db-3f85eefbbbb5 req-4c04f814-9d1f-480e-8f33-06f141957810 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:20:29.451062 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-c9b3756d-fafd-43e4-b6db-3f85eefbbbb5 req-4c04f814-9d1f-480e-8f33-06f141957810 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:20:29.470781 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0f8d1a48-6092-4561-90e7-b1d8072168c9 tempest-ServersNegativeTestMultiTenantJSON-327266304 tempest-ServersNegativeTestMultiTenantJSON-327266304-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:20:29.475092 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0f8d1a48-6092-4561-90e7-b1d8072168c9 tempest-ServersNegativeTestMultiTenantJSON-327266304 tempest-ServersNegativeTestMultiTenantJSON-327266304-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:20:29.475856 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0f8d1a48-6092-4561-90e7-b1d8072168c9 tempest-ServersNegativeTestMultiTenantJSON-327266304 tempest-ServersNegativeTestMultiTenantJSON-327266304-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:20:29.476860 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0f8d1a48-6092-4561-90e7-b1d8072168c9 tempest-ServersNegativeTestMultiTenantJSON-327266304 tempest-ServersNegativeTestMultiTenantJSON-327266304-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:20:29.477532 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0f8d1a48-6092-4561-90e7-b1d8072168c9 tempest-ServersNegativeTestMultiTenantJSON-327266304 tempest-ServersNegativeTestMultiTenantJSON-327266304-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:20:29.479438 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0f8d1a48-6092-4561-90e7-b1d8072168c9 tempest-ServersNegativeTestMultiTenantJSON-327266304 tempest-ServersNegativeTestMultiTenantJSON-327266304-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:20:29.527241 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-c9b3756d-fafd-43e4-b6db-3f85eefbbbb5 req-4c04f814-9d1f-480e-8f33-06f141957810 service nova] Creating event network-vif-plugged:a62c12be-871a-4554-a872-93c4372deedb for instance 6853e911-3704-4087-a449-427f7fc0ba31 on nch1-master-1 Oct 22 21:20:29.560078 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-c9b3756d-fafd-43e4-b6db-3f85eefbbbb5 req-4c04f814-9d1f-480e-8f33-06f141957810 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.164093 Oct 22 21:20:29.564383 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2691/5398] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:20:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:20:29.851193 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-5a12dc64-3165-486e-96e3-2f84fe9ee5ef tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:20:29.852807 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-5a12dc64-3165-486e-96e3-2f84fe9ee5ef tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: 20d90b58-3fad-4a44-b6bf-4ef0cc587def] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:20:29.871926 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5a12dc64-3165-486e-96e3-2f84fe9ee5ef tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:20:29.873056 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5a12dc64-3165-486e-96e3-2f84fe9ee5ef tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:20:29.876400 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5a12dc64-3165-486e-96e3-2f84fe9ee5ef tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:20:29.877348 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5a12dc64-3165-486e-96e3-2f84fe9ee5ef tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:20:29.879048 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5a12dc64-3165-486e-96e3-2f84fe9ee5ef tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:20:29.881068 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5a12dc64-3165-486e-96e3-2f84fe9ee5ef tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:20:30.208051 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-0f8d1a48-6092-4561-90e7-b1d8072168c9 tempest-ServersNegativeTestMultiTenantJSON-327266304 tempest-ServersNegativeTestMultiTenantJSON-327266304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2acb3d1b6eba4df187ac68bf39e7aa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cefb200280d4407ab97de3dadf6bb281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:20:30.211056 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-5a12dc64-3165-486e-96e3-2f84fe9ee5ef tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c85602851244d4a632b9c861eb4416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45cb377c6a9a43b3b91c99a64e37f1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:20:30.220212 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-5a12dc64-3165-486e-96e3-2f84fe9ee5ef tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def" status: 200 len: 1669 microversion: 2.1 time: 0.385596 Oct 22 21:20:30.221035 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2692/5399] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:20:29 2022] GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def => generated 1669 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:20:30.225178 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-0f8d1a48-6092-4561-90e7-b1d8072168c9 tempest-ServersNegativeTestMultiTenantJSON-327266304 tempest-ServersNegativeTestMultiTenantJSON-327266304-project] 10.222.0.18 "GET /compute/v2.1/servers/6853e911-3704-4087-a449-427f7fc0ba31" status: 200 len: 1327 microversion: 2.1 time: 0.786288 Oct 22 21:20:30.225776 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2708/5400] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:20:29 2022] GET /compute/v2.1/servers/6853e911-3704-4087-a449-427f7fc0ba31 => generated 1327 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:20:30.254016 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-27683818-94d5-44db-bd1f-e227a080f815 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:20:30.254693 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-27683818-94d5-44db-bd1f-e227a080f815 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: 20d90b58-3fad-4a44-b6bf-4ef0cc587def] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:20:30.262275 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-27683818-94d5-44db-bd1f-e227a080f815 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:20:30.263613 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-27683818-94d5-44db-bd1f-e227a080f815 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:20:30.264287 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-27683818-94d5-44db-bd1f-e227a080f815 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:20:30.265254 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-27683818-94d5-44db-bd1f-e227a080f815 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:20:30.265862 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-27683818-94d5-44db-bd1f-e227a080f815 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:20:30.266434 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-27683818-94d5-44db-bd1f-e227a080f815 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:20:30.412558 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-27683818-94d5-44db-bd1f-e227a080f815 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c85602851244d4a632b9c861eb4416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45cb377c6a9a43b3b91c99a64e37f1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:20:30.429425 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-27683818-94d5-44db-bd1f-e227a080f815 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def" status: 200 len: 1669 microversion: 2.1 time: 0.184995 Oct 22 21:20:30.431947 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2693/5401] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:20:30 2022] GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def => generated 1669 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:20:30.454184 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-5e07a21f-9d5f-4c00-b8da-758f3d63c1b1 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:20:30.454884 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-5e07a21f-9d5f-4c00-b8da-758f3d63c1b1 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: 20d90b58-3fad-4a44-b6bf-4ef0cc587def] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:20:30.465444 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5e07a21f-9d5f-4c00-b8da-758f3d63c1b1 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:20:30.466329 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5e07a21f-9d5f-4c00-b8da-758f3d63c1b1 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:20:30.467155 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5e07a21f-9d5f-4c00-b8da-758f3d63c1b1 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:20:30.468387 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5e07a21f-9d5f-4c00-b8da-758f3d63c1b1 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:20:30.469152 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5e07a21f-9d5f-4c00-b8da-758f3d63c1b1 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:20:30.469829 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5e07a21f-9d5f-4c00-b8da-758f3d63c1b1 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:20:30.670937 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-5e07a21f-9d5f-4c00-b8da-758f3d63c1b1 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c85602851244d4a632b9c861eb4416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45cb377c6a9a43b3b91c99a64e37f1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:20:30.680996 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-5e07a21f-9d5f-4c00-b8da-758f3d63c1b1 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def" status: 200 len: 1669 microversion: 2.1 time: 0.230870 Oct 22 21:20:30.682376 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2709/5402] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:20:30 2022] GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def => generated 1669 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:20:30.709332 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-151241c4-bbf9-4ab2-86d9-8bb0682c87af tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:20:30.712813 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-151241c4-bbf9-4ab2-86d9-8bb0682c87af tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: 20d90b58-3fad-4a44-b6bf-4ef0cc587def] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:20:30.721230 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-151241c4-bbf9-4ab2-86d9-8bb0682c87af tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:20:30.726824 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-151241c4-bbf9-4ab2-86d9-8bb0682c87af tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:20:30.728096 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-151241c4-bbf9-4ab2-86d9-8bb0682c87af tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:20:30.729001 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-151241c4-bbf9-4ab2-86d9-8bb0682c87af tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:20:30.729531 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-151241c4-bbf9-4ab2-86d9-8bb0682c87af tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:20:30.730244 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-151241c4-bbf9-4ab2-86d9-8bb0682c87af tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:20:30.849075 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-151241c4-bbf9-4ab2-86d9-8bb0682c87af tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "POST /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def/action" status: 202 len: 0 microversion: 2.1 time: 0.145050 Oct 22 21:20:30.860595 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-b0f29690-62a9-4acc-83c8-91f9bf0715d7 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:20:30.862154 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-b0f29690-62a9-4acc-83c8-91f9bf0715d7 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: 20d90b58-3fad-4a44-b6bf-4ef0cc587def] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:20:30.866252 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2694/5403] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 21:20:30 2022] POST /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def/action => generated 0 bytes in 147 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 21:20:30.876972 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b0f29690-62a9-4acc-83c8-91f9bf0715d7 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:20:30.877591 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b0f29690-62a9-4acc-83c8-91f9bf0715d7 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:20:30.878192 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b0f29690-62a9-4acc-83c8-91f9bf0715d7 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:20:30.879285 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b0f29690-62a9-4acc-83c8-91f9bf0715d7 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:20:30.879889 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b0f29690-62a9-4acc-83c8-91f9bf0715d7 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:20:30.881068 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b0f29690-62a9-4acc-83c8-91f9bf0715d7 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:20:31.199289 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-b0f29690-62a9-4acc-83c8-91f9bf0715d7 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c85602851244d4a632b9c861eb4416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45cb377c6a9a43b3b91c99a64e37f1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:20:31.209167 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-b0f29690-62a9-4acc-83c8-91f9bf0715d7 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def" status: 200 len: 1671 microversion: 2.1 time: 0.353982 Oct 22 21:20:31.209756 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2710/5404] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:20:30 2022] GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def => generated 1671 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:20:31.260745 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-f2823a51-30be-4a52-b3cf-1a91c36cba23 tempest-ServersNegativeTestMultiTenantJSON-327266304 tempest-ServersNegativeTestMultiTenantJSON-327266304-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:20:31.261762 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-f2823a51-30be-4a52-b3cf-1a91c36cba23 tempest-ServersNegativeTestMultiTenantJSON-327266304 tempest-ServersNegativeTestMultiTenantJSON-327266304-project] [instance: 6853e911-3704-4087-a449-427f7fc0ba31] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:20:31.284641 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f2823a51-30be-4a52-b3cf-1a91c36cba23 tempest-ServersNegativeTestMultiTenantJSON-327266304 tempest-ServersNegativeTestMultiTenantJSON-327266304-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:20:31.287389 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f2823a51-30be-4a52-b3cf-1a91c36cba23 tempest-ServersNegativeTestMultiTenantJSON-327266304 tempest-ServersNegativeTestMultiTenantJSON-327266304-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:20:31.289960 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f2823a51-30be-4a52-b3cf-1a91c36cba23 tempest-ServersNegativeTestMultiTenantJSON-327266304 tempest-ServersNegativeTestMultiTenantJSON-327266304-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:20:31.290877 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f2823a51-30be-4a52-b3cf-1a91c36cba23 tempest-ServersNegativeTestMultiTenantJSON-327266304 tempest-ServersNegativeTestMultiTenantJSON-327266304-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:20:31.291864 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f2823a51-30be-4a52-b3cf-1a91c36cba23 tempest-ServersNegativeTestMultiTenantJSON-327266304 tempest-ServersNegativeTestMultiTenantJSON-327266304-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:20:31.293320 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f2823a51-30be-4a52-b3cf-1a91c36cba23 tempest-ServersNegativeTestMultiTenantJSON-327266304 tempest-ServersNegativeTestMultiTenantJSON-327266304-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:20:31.595991 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-b2cba00d-bfbd-4436-b04c-66c9af1edd01 req-d2b4a35a-ecdb-4afd-a19c-917c89d038e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20d90b58-3fad-4a44-b6bf-4ef0cc587def", "name": "network-vif-unplugged", "status": "completed", "tag": "7ef4550f-d128-432a-9dbc-ce1802e6c6da"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:20:31.617152 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-b2cba00d-bfbd-4436-b04c-66c9af1edd01 req-d2b4a35a-ecdb-4afd-a19c-917c89d038e1 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:20:31.617972 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-b2cba00d-bfbd-4436-b04c-66c9af1edd01 req-d2b4a35a-ecdb-4afd-a19c-917c89d038e1 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:20:31.618757 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-b2cba00d-bfbd-4436-b04c-66c9af1edd01 req-d2b4a35a-ecdb-4afd-a19c-917c89d038e1 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:20:31.662388 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-b2cba00d-bfbd-4436-b04c-66c9af1edd01 req-d2b4a35a-ecdb-4afd-a19c-917c89d038e1 service nova] Creating event network-vif-unplugged:7ef4550f-d128-432a-9dbc-ce1802e6c6da for instance 20d90b58-3fad-4a44-b6bf-4ef0cc587def on nch1-master-1 Oct 22 21:20:31.662884 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-f2823a51-30be-4a52-b3cf-1a91c36cba23 tempest-ServersNegativeTestMultiTenantJSON-327266304 tempest-ServersNegativeTestMultiTenantJSON-327266304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2acb3d1b6eba4df187ac68bf39e7aa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cefb200280d4407ab97de3dadf6bb281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:20:31.672317 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-b2cba00d-bfbd-4436-b04c-66c9af1edd01 req-d2b4a35a-ecdb-4afd-a19c-917c89d038e1 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.084262 Oct 22 21:20:31.679282 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2711/5405] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:20:31 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:20:31.699891 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-f2823a51-30be-4a52-b3cf-1a91c36cba23 tempest-ServersNegativeTestMultiTenantJSON-327266304 tempest-ServersNegativeTestMultiTenantJSON-327266304-project] 10.222.0.18 "GET /compute/v2.1/servers/6853e911-3704-4087-a449-427f7fc0ba31" status: 200 len: 1327 microversion: 2.1 time: 0.443410 Oct 22 21:20:31.720764 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2695/5406] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:20:31 2022] GET /compute/v2.1/servers/6853e911-3704-4087-a449-427f7fc0ba31 => generated 1327 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:20:32.239302 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-2ce755b1-fc3d-41c7-81a6-e321046d77a6 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:20:32.240049 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-2ce755b1-fc3d-41c7-81a6-e321046d77a6 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: 20d90b58-3fad-4a44-b6bf-4ef0cc587def] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:20:32.262200 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2ce755b1-fc3d-41c7-81a6-e321046d77a6 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:20:32.263364 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2ce755b1-fc3d-41c7-81a6-e321046d77a6 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:20:32.264783 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2ce755b1-fc3d-41c7-81a6-e321046d77a6 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:20:32.266949 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2ce755b1-fc3d-41c7-81a6-e321046d77a6 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:20:32.269608 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2ce755b1-fc3d-41c7-81a6-e321046d77a6 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:20:32.270078 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2ce755b1-fc3d-41c7-81a6-e321046d77a6 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:20:32.494694 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-2ce755b1-fc3d-41c7-81a6-e321046d77a6 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c85602851244d4a632b9c861eb4416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45cb377c6a9a43b3b91c99a64e37f1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:20:32.506135 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-2ce755b1-fc3d-41c7-81a6-e321046d77a6 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def" status: 200 len: 1671 microversion: 2.1 time: 0.271839 Oct 22 21:20:32.507304 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2712/5407] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:20:32 2022] GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def => generated 1671 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:20:32.730916 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-2b6f154b-7278-4c53-bb32-26d18db955ab tempest-ServersNegativeTestMultiTenantJSON-327266304 tempest-ServersNegativeTestMultiTenantJSON-327266304-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:20:32.732313 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-2b6f154b-7278-4c53-bb32-26d18db955ab tempest-ServersNegativeTestMultiTenantJSON-327266304 tempest-ServersNegativeTestMultiTenantJSON-327266304-project] [instance: 6853e911-3704-4087-a449-427f7fc0ba31] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:20:32.748856 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2b6f154b-7278-4c53-bb32-26d18db955ab tempest-ServersNegativeTestMultiTenantJSON-327266304 tempest-ServersNegativeTestMultiTenantJSON-327266304-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:20:32.750870 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2b6f154b-7278-4c53-bb32-26d18db955ab tempest-ServersNegativeTestMultiTenantJSON-327266304 tempest-ServersNegativeTestMultiTenantJSON-327266304-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:20:32.752946 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2b6f154b-7278-4c53-bb32-26d18db955ab tempest-ServersNegativeTestMultiTenantJSON-327266304 tempest-ServersNegativeTestMultiTenantJSON-327266304-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:20:32.757731 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2b6f154b-7278-4c53-bb32-26d18db955ab tempest-ServersNegativeTestMultiTenantJSON-327266304 tempest-ServersNegativeTestMultiTenantJSON-327266304-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:20:32.759152 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2b6f154b-7278-4c53-bb32-26d18db955ab tempest-ServersNegativeTestMultiTenantJSON-327266304 tempest-ServersNegativeTestMultiTenantJSON-327266304-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:20:32.760875 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2b6f154b-7278-4c53-bb32-26d18db955ab tempest-ServersNegativeTestMultiTenantJSON-327266304 tempest-ServersNegativeTestMultiTenantJSON-327266304-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:20:32.971540 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-2b6f154b-7278-4c53-bb32-26d18db955ab tempest-ServersNegativeTestMultiTenantJSON-327266304 tempest-ServersNegativeTestMultiTenantJSON-327266304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2acb3d1b6eba4df187ac68bf39e7aa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cefb200280d4407ab97de3dadf6bb281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:20:32.981777 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-2b6f154b-7278-4c53-bb32-26d18db955ab tempest-ServersNegativeTestMultiTenantJSON-327266304 tempest-ServersNegativeTestMultiTenantJSON-327266304-project] 10.222.0.18 "GET /compute/v2.1/servers/6853e911-3704-4087-a449-427f7fc0ba31" status: 200 len: 1528 microversion: 2.1 time: 0.256172 Oct 22 21:20:32.983669 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2696/5408] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:20:32 2022] GET /compute/v2.1/servers/6853e911-3704-4087-a449-427f7fc0ba31 => generated 1528 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:20:33.009375 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-2824c19c-111b-4a76-b595-0d5f110a1e16 tempest-ServersNegativeTestMultiTenantJSON-327266304 tempest-ServersNegativeTestMultiTenantJSON-327266304-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:20:33.010080 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-2824c19c-111b-4a76-b595-0d5f110a1e16 tempest-ServersNegativeTestMultiTenantJSON-327266304 tempest-ServersNegativeTestMultiTenantJSON-327266304-project] [instance: 6853e911-3704-4087-a449-427f7fc0ba31] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:20:33.017574 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2824c19c-111b-4a76-b595-0d5f110a1e16 tempest-ServersNegativeTestMultiTenantJSON-327266304 tempest-ServersNegativeTestMultiTenantJSON-327266304-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:20:33.018086 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2824c19c-111b-4a76-b595-0d5f110a1e16 tempest-ServersNegativeTestMultiTenantJSON-327266304 tempest-ServersNegativeTestMultiTenantJSON-327266304-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:20:33.019789 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2824c19c-111b-4a76-b595-0d5f110a1e16 tempest-ServersNegativeTestMultiTenantJSON-327266304 tempest-ServersNegativeTestMultiTenantJSON-327266304-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:20:33.021161 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2824c19c-111b-4a76-b595-0d5f110a1e16 tempest-ServersNegativeTestMultiTenantJSON-327266304 tempest-ServersNegativeTestMultiTenantJSON-327266304-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:20:33.021841 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2824c19c-111b-4a76-b595-0d5f110a1e16 tempest-ServersNegativeTestMultiTenantJSON-327266304 tempest-ServersNegativeTestMultiTenantJSON-327266304-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:20:33.022648 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2824c19c-111b-4a76-b595-0d5f110a1e16 tempest-ServersNegativeTestMultiTenantJSON-327266304 tempest-ServersNegativeTestMultiTenantJSON-327266304-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:20:33.267493 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-2824c19c-111b-4a76-b595-0d5f110a1e16 tempest-ServersNegativeTestMultiTenantJSON-327266304 tempest-ServersNegativeTestMultiTenantJSON-327266304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2acb3d1b6eba4df187ac68bf39e7aa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cefb200280d4407ab97de3dadf6bb281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:20:33.277818 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-2824c19c-111b-4a76-b595-0d5f110a1e16 tempest-ServersNegativeTestMultiTenantJSON-327266304 tempest-ServersNegativeTestMultiTenantJSON-327266304-project] 10.222.0.18 "GET /compute/v2.1/servers/6853e911-3704-4087-a449-427f7fc0ba31" status: 200 len: 1528 microversion: 2.1 time: 0.272012 Oct 22 21:20:33.278694 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2713/5409] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:20:33 2022] GET /compute/v2.1/servers/6853e911-3704-4087-a449-427f7fc0ba31 => generated 1528 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:20:33.531237 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-94cfedd3-b388-48c5-9038-29fbf8ff0838 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:20:33.532050 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-94cfedd3-b388-48c5-9038-29fbf8ff0838 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: 20d90b58-3fad-4a44-b6bf-4ef0cc587def] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:20:33.542668 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-94cfedd3-b388-48c5-9038-29fbf8ff0838 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:20:33.544463 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-94cfedd3-b388-48c5-9038-29fbf8ff0838 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:20:33.547502 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-94cfedd3-b388-48c5-9038-29fbf8ff0838 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:20:33.548551 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-94cfedd3-b388-48c5-9038-29fbf8ff0838 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:20:33.549251 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-94cfedd3-b388-48c5-9038-29fbf8ff0838 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:20:33.549943 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-94cfedd3-b388-48c5-9038-29fbf8ff0838 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:20:33.585276 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:20:33.676482 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-52a2b9fc-27b2-4c40-ace6-682cdbc55e2c tempest-ServersNegativeTestMultiTenantJSON-985236361 tempest-ServersNegativeTestMultiTenantJSON-985236361-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:20:33.677265 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-52a2b9fc-27b2-4c40-ace6-682cdbc55e2c tempest-ServersNegativeTestMultiTenantJSON-985236361 tempest-ServersNegativeTestMultiTenantJSON-985236361-project] [instance: 6853e911-3704-4087-a449-427f7fc0ba31] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:20:33.691608 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-52a2b9fc-27b2-4c40-ace6-682cdbc55e2c tempest-ServersNegativeTestMultiTenantJSON-985236361 tempest-ServersNegativeTestMultiTenantJSON-985236361-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:20:33.692696 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-52a2b9fc-27b2-4c40-ace6-682cdbc55e2c tempest-ServersNegativeTestMultiTenantJSON-985236361 tempest-ServersNegativeTestMultiTenantJSON-985236361-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:20:33.693139 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-52a2b9fc-27b2-4c40-ace6-682cdbc55e2c tempest-ServersNegativeTestMultiTenantJSON-985236361 tempest-ServersNegativeTestMultiTenantJSON-985236361-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:20:33.693929 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-52a2b9fc-27b2-4c40-ace6-682cdbc55e2c tempest-ServersNegativeTestMultiTenantJSON-985236361 tempest-ServersNegativeTestMultiTenantJSON-985236361-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:20:33.694320 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-52a2b9fc-27b2-4c40-ace6-682cdbc55e2c tempest-ServersNegativeTestMultiTenantJSON-985236361 tempest-ServersNegativeTestMultiTenantJSON-985236361-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:20:33.694748 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-52a2b9fc-27b2-4c40-ace6-682cdbc55e2c tempest-ServersNegativeTestMultiTenantJSON-985236361 tempest-ServersNegativeTestMultiTenantJSON-985236361-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:20:33.712710 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-52a2b9fc-27b2-4c40-ace6-682cdbc55e2c tempest-ServersNegativeTestMultiTenantJSON-985236361 tempest-ServersNegativeTestMultiTenantJSON-985236361-project] HTTP exception thrown: Instance 6853e911-3704-4087-a449-427f7fc0ba31 could not be found. Oct 22 21:20:33.714906 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-52a2b9fc-27b2-4c40-ace6-682cdbc55e2c tempest-ServersNegativeTestMultiTenantJSON-985236361 tempest-ServersNegativeTestMultiTenantJSON-985236361-project] Request method failure captured: Oct 22 21:20:33.714906 ncdv-master-1 devstack@n-api.service[138744]: request: DELETE /compute/v2.1/servers/6853e911-3704-4087-a449-427f7fc0ba31 HTTP/1.1 Oct 22 21:20:33.714906 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 21:20:33.714906 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 21:20:33.714906 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 21:20:33.714906 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 0 Oct 22 21:20:33.714906 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 21:20:33.714906 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 21:20:33.714906 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 21:20:33.714906 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 21:20:33.714906 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVF6PpPBikakL2GTEaOEwdnQqHbKYwqMIRGkHcrLOxCUVKs9JX-OEqoQJ1zI8t88V5e-Xbca0NXihutYb1_O1R2sXbbSSAYP7X3UJfbz_0enIPXLUiEV3nZh3PLcUbd89TE-YAiQiutWnQGEFfz8etf2A0DmMi16qOTidtJNf3AdwRLk Oct 22 21:20:33.714906 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 21:20:33.714906 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 21:20:33.714906 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 21:20:33.714906 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 21:20:33.714906 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 21:20:33.714906 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 21:20:33.714906 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: 0f26b0c3026d41599f44d11ef2bc39bb Oct 22 21:20:33.714906 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-985236361 Oct 22 21:20:33.714906 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 21:20:33.714906 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 21:20:33.714906 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_0f26b0c3026d41599f44d11ef2bc39bb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0f26b0c3026d41599f44d11ef2bc39bb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/0f26b0c3026d41599f44d11ef2bc39bb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0f26b0c3026d41599f44d11ef2bc39bb"}]}] Oct 22 21:20:33.714906 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-985236361 Oct 22 21:20:33.714906 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: 0f26b0c3026d41599f44d11ef2bc39bb Oct 22 21:20:33.714906 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-985236361 Oct 22 21:20:33.714906 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-ServersNegativeTestMultiTenantJSON-985236361-project Oct 22 21:20:33.714906 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 21:20:33.714906 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 21:20:33.714906 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: e2c807a2c537465a9493a050b4e024cb Oct 22 21:20:33.714906 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-985236361-project Oct 22 21:20:33.714906 ncdv-master-1 devstack@n-api.service[138744]: method: > Oct 22 21:20:33.714906 ncdv-master-1 devstack@n-api.service[138744]: exception: Instance 6853e911-3704-4087-a449-427f7fc0ba31 could not be found. Oct 22 21:20:33.714906 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': '6853e911-3704-4087-a449-427f7fc0ba31'} Oct 22 21:20:33.714906 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:20:33.714906 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:20:33.714906 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 21:20:33.714906 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 21:20:33.714906 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 21:20:33.714906 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 21:20:33.714906 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 21:20:33.714906 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 21:20:33.714906 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 21:20:33.714906 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 21:20:33.714906 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6853e911-3704-4087-a449-427f7fc0ba31 could not be found. Oct 22 21:20:33.714906 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:20:33.714906 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:20:33.714906 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:20:33.714906 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:20:33.714906 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:20:33.714906 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:20:33.714906 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:20:33.714906 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:20:33.714906 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:20:33.714906 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:20:33.714906 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 22 21:20:33.714906 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 22 21:20:33.714906 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 22 21:20:33.714906 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 22 21:20:33.714906 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 21:20:33.714906 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 21:20:33.714906 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 21:20:33.714906 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:20:33.719181 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6853e911-3704-4087-a449-427f7fc0ba31 could not be found. Oct 22 21:20:33.719181 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:20:33.719181 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:20:33.719181 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:20:33.719181 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:20:33.719181 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:20:33.719181 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:20:33.719181 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:20:33.719181 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:20:33.719181 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6853e911-3704-4087-a449-427f7fc0ba31 could not be found. Oct 22 21:20:33.719181 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:20:33.721651 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-52a2b9fc-27b2-4c40-ace6-682cdbc55e2c tempest-ServersNegativeTestMultiTenantJSON-985236361 tempest-ServersNegativeTestMultiTenantJSON-985236361-project] Returning 404 to user: Instance 6853e911-3704-4087-a449-427f7fc0ba31 could not be found. {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:20:33.722917 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-52a2b9fc-27b2-4c40-ace6-682cdbc55e2c tempest-ServersNegativeTestMultiTenantJSON-985236361 tempest-ServersNegativeTestMultiTenantJSON-985236361-project] 10.222.0.18 "DELETE /compute/v2.1/servers/6853e911-3704-4087-a449-427f7fc0ba31" status: 404 len: 111 microversion: 2.1 time: 0.422805 Oct 22 21:20:33.723984 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2697/5410] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 21:20:33 2022] DELETE /compute/v2.1/servers/6853e911-3704-4087-a449-427f7fc0ba31 => generated 111 bytes in 425 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 21:20:33.736832 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-6d4fddf2-f7d5-4324-a5d6-25b6cf8bc8a5 tempest-ServersNegativeTestMultiTenantJSON-327266304 tempest-ServersNegativeTestMultiTenantJSON-327266304-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:20:33.738410 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-6d4fddf2-f7d5-4324-a5d6-25b6cf8bc8a5 tempest-ServersNegativeTestMultiTenantJSON-327266304 tempest-ServersNegativeTestMultiTenantJSON-327266304-project] [instance: 6853e911-3704-4087-a449-427f7fc0ba31] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:20:33.745258 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_api:SELECT=62 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:20:33.747651 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6d4fddf2-f7d5-4324-a5d6-25b6cf8bc8a5 tempest-ServersNegativeTestMultiTenantJSON-327266304 tempest-ServersNegativeTestMultiTenantJSON-327266304-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:20:33.748558 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6d4fddf2-f7d5-4324-a5d6-25b6cf8bc8a5 tempest-ServersNegativeTestMultiTenantJSON-327266304 tempest-ServersNegativeTestMultiTenantJSON-327266304-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:20:33.749526 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6d4fddf2-f7d5-4324-a5d6-25b6cf8bc8a5 tempest-ServersNegativeTestMultiTenantJSON-327266304 tempest-ServersNegativeTestMultiTenantJSON-327266304-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:20:33.750472 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6d4fddf2-f7d5-4324-a5d6-25b6cf8bc8a5 tempest-ServersNegativeTestMultiTenantJSON-327266304 tempest-ServersNegativeTestMultiTenantJSON-327266304-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:20:33.751390 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6d4fddf2-f7d5-4324-a5d6-25b6cf8bc8a5 tempest-ServersNegativeTestMultiTenantJSON-327266304 tempest-ServersNegativeTestMultiTenantJSON-327266304-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:20:33.752036 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6d4fddf2-f7d5-4324-a5d6-25b6cf8bc8a5 tempest-ServersNegativeTestMultiTenantJSON-327266304 tempest-ServersNegativeTestMultiTenantJSON-327266304-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:20:33.942589 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-94cfedd3-b388-48c5-9038-29fbf8ff0838 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c85602851244d4a632b9c861eb4416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45cb377c6a9a43b3b91c99a64e37f1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:20:33.954506 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-94cfedd3-b388-48c5-9038-29fbf8ff0838 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def" status: 200 len: 1669 microversion: 2.1 time: 0.426968 Oct 22 21:20:33.955130 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2714/5411] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:20:33 2022] GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def => generated 1669 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:20:33.979230 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-742e6e0b-8430-42d5-b2cd-1b8c284f0b1d tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:20:33.981539 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-742e6e0b-8430-42d5-b2cd-1b8c284f0b1d tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: 20d90b58-3fad-4a44-b6bf-4ef0cc587def] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:20:34.005988 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-742e6e0b-8430-42d5-b2cd-1b8c284f0b1d tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:20:34.009384 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-742e6e0b-8430-42d5-b2cd-1b8c284f0b1d tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:20:34.011208 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-742e6e0b-8430-42d5-b2cd-1b8c284f0b1d tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:20:34.012755 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-742e6e0b-8430-42d5-b2cd-1b8c284f0b1d tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:20:34.014938 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-742e6e0b-8430-42d5-b2cd-1b8c284f0b1d tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:20:34.016463 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-742e6e0b-8430-42d5-b2cd-1b8c284f0b1d tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:20:34.069130 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-6d4fddf2-f7d5-4324-a5d6-25b6cf8bc8a5 tempest-ServersNegativeTestMultiTenantJSON-327266304 tempest-ServersNegativeTestMultiTenantJSON-327266304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2acb3d1b6eba4df187ac68bf39e7aa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cefb200280d4407ab97de3dadf6bb281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:20:34.077931 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-6d4fddf2-f7d5-4324-a5d6-25b6cf8bc8a5 tempest-ServersNegativeTestMultiTenantJSON-327266304 tempest-ServersNegativeTestMultiTenantJSON-327266304-project] 10.222.0.18 "GET /compute/v2.1/servers/6853e911-3704-4087-a449-427f7fc0ba31" status: 200 len: 1528 microversion: 2.1 time: 0.347301 Oct 22 21:20:34.078494 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-742e6e0b-8430-42d5-b2cd-1b8c284f0b1d tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "POST /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def/action" status: 200 len: 138 microversion: 2.1 time: 0.103134 Oct 22 21:20:34.078919 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2698/5412] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:20:33 2022] GET /compute/v2.1/servers/6853e911-3704-4087-a449-427f7fc0ba31 => generated 1528 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:20:34.096789 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2715/5413] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 21:20:33 2022] POST /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def/action => generated 138 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:20:34.111023 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-ddab97fb-2f09-49dd-bcb9-8cd3c26cbadc tempest-ServersNegativeTestMultiTenantJSON-985236361 tempest-ServersNegativeTestMultiTenantJSON-985236361-project] Action: 'update', calling method: >, body: {"server": {"name": "6853e911-3704-4087-a449-427f7fc0ba31_new"}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:20:34.116606 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-ddab97fb-2f09-49dd-bcb9-8cd3c26cbadc tempest-ServersNegativeTestMultiTenantJSON-985236361 tempest-ServersNegativeTestMultiTenantJSON-985236361-project] [instance: 6853e911-3704-4087-a449-427f7fc0ba31] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:20:34.117571 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-bbd3b6a4-0f68-4142-a91c-c383ebfbfa7f tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:20:34.120280 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-bbd3b6a4-0f68-4142-a91c-c383ebfbfa7f tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: 20d90b58-3fad-4a44-b6bf-4ef0cc587def] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:20:34.131136 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ddab97fb-2f09-49dd-bcb9-8cd3c26cbadc tempest-ServersNegativeTestMultiTenantJSON-985236361 tempest-ServersNegativeTestMultiTenantJSON-985236361-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:20:34.132277 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ddab97fb-2f09-49dd-bcb9-8cd3c26cbadc tempest-ServersNegativeTestMultiTenantJSON-985236361 tempest-ServersNegativeTestMultiTenantJSON-985236361-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:20:34.132909 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ddab97fb-2f09-49dd-bcb9-8cd3c26cbadc tempest-ServersNegativeTestMultiTenantJSON-985236361 tempest-ServersNegativeTestMultiTenantJSON-985236361-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:20:34.133968 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ddab97fb-2f09-49dd-bcb9-8cd3c26cbadc tempest-ServersNegativeTestMultiTenantJSON-985236361 tempest-ServersNegativeTestMultiTenantJSON-985236361-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:20:34.134831 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ddab97fb-2f09-49dd-bcb9-8cd3c26cbadc tempest-ServersNegativeTestMultiTenantJSON-985236361 tempest-ServersNegativeTestMultiTenantJSON-985236361-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:20:34.135441 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ddab97fb-2f09-49dd-bcb9-8cd3c26cbadc tempest-ServersNegativeTestMultiTenantJSON-985236361 tempest-ServersNegativeTestMultiTenantJSON-985236361-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:20:34.135824 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bbd3b6a4-0f68-4142-a91c-c383ebfbfa7f tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:20:34.142405 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bbd3b6a4-0f68-4142-a91c-c383ebfbfa7f tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:20:34.150591 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bbd3b6a4-0f68-4142-a91c-c383ebfbfa7f tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:20:34.151938 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bbd3b6a4-0f68-4142-a91c-c383ebfbfa7f tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:20:34.152070 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-ddab97fb-2f09-49dd-bcb9-8cd3c26cbadc tempest-ServersNegativeTestMultiTenantJSON-985236361 tempest-ServersNegativeTestMultiTenantJSON-985236361-project] HTTP exception thrown: Instance 6853e911-3704-4087-a449-427f7fc0ba31 could not be found. Oct 22 21:20:34.152738 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bbd3b6a4-0f68-4142-a91c-c383ebfbfa7f tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:20:34.153366 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bbd3b6a4-0f68-4142-a91c-c383ebfbfa7f tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:20:34.153794 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-ddab97fb-2f09-49dd-bcb9-8cd3c26cbadc tempest-ServersNegativeTestMultiTenantJSON-985236361 tempest-ServersNegativeTestMultiTenantJSON-985236361-project] Request method failure captured: Oct 22 21:20:34.153794 ncdv-master-1 devstack@n-api.service[138744]: request: PUT /compute/v2.1/servers/6853e911-3704-4087-a449-427f7fc0ba31 HTTP/1.1 Oct 22 21:20:34.153794 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 21:20:34.153794 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 21:20:34.153794 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 21:20:34.153794 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 64 Oct 22 21:20:34.153794 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 21:20:34.153794 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 21:20:34.153794 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 21:20:34.153794 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 21:20:34.153794 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVF6PpPBikakL2GTEaOEwdnQqHbKYwqMIRGkHcrLOxCUVKs9JX-OEqoQJ1zI8t88V5e-Xbca0NXihutYb1_O1R2sXbbSSAYP7X3UJfbz_0enIPXLUiEV3nZh3PLcUbd89TE-YAiQiutWnQGEFfz8etf2A0DmMi16qOTidtJNf3AdwRLk Oct 22 21:20:34.153794 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 21:20:34.153794 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 21:20:34.153794 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 21:20:34.153794 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 21:20:34.153794 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 21:20:34.153794 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 21:20:34.153794 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: 0f26b0c3026d41599f44d11ef2bc39bb Oct 22 21:20:34.153794 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-985236361 Oct 22 21:20:34.153794 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 21:20:34.153794 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 21:20:34.153794 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_0f26b0c3026d41599f44d11ef2bc39bb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0f26b0c3026d41599f44d11ef2bc39bb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/0f26b0c3026d41599f44d11ef2bc39bb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0f26b0c3026d41599f44d11ef2bc39bb"}]}] Oct 22 21:20:34.153794 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-985236361 Oct 22 21:20:34.153794 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: 0f26b0c3026d41599f44d11ef2bc39bb Oct 22 21:20:34.153794 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-985236361 Oct 22 21:20:34.153794 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-ServersNegativeTestMultiTenantJSON-985236361-project Oct 22 21:20:34.153794 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 21:20:34.153794 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 21:20:34.153794 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: e2c807a2c537465a9493a050b4e024cb Oct 22 21:20:34.153794 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-985236361-project Oct 22 21:20:34.153794 ncdv-master-1 devstack@n-api.service[138744]: Oct 22 21:20:34.153794 ncdv-master-1 devstack@n-api.service[138744]: {"server": {"name": "6853e911-3704-4087-a449-427f7fc0ba31_new"}} Oct 22 21:20:34.153794 ncdv-master-1 devstack@n-api.service[138744]: method: > Oct 22 21:20:34.153794 ncdv-master-1 devstack@n-api.service[138744]: exception: Instance 6853e911-3704-4087-a449-427f7fc0ba31 could not be found. Oct 22 21:20:34.153794 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': '6853e911-3704-4087-a449-427f7fc0ba31', 'body': {'server': {'name': '6853e911-3704-4087-a449-427f7fc0ba31_new'}}} Oct 22 21:20:34.153794 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:20:34.153794 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:20:34.153794 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 21:20:34.153794 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 21:20:34.153794 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 21:20:34.153794 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 21:20:34.153794 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 21:20:34.153794 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 21:20:34.153794 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 21:20:34.153794 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 21:20:34.153794 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6853e911-3704-4087-a449-427f7fc0ba31 could not be found. Oct 22 21:20:34.153794 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:20:34.153794 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:20:34.153794 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:20:34.153794 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:20:34.153794 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:20:34.153794 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:20:34.153794 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:20:34.153794 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:20:34.153794 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:20:34.153794 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:20:34.153794 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 21:20:34.153794 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 21:20:34.153794 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 21:20:34.153794 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 21:20:34.153794 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 21:20:34.153794 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 21:20:34.153794 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 22 21:20:34.166879 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Oct 22 21:20:34.166879 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Oct 22 21:20:34.166879 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 21:20:34.166879 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 21:20:34.166879 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 21:20:34.166879 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:20:34.166879 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6853e911-3704-4087-a449-427f7fc0ba31 could not be found. Oct 22 21:20:34.166879 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:20:34.166879 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:20:34.166879 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:20:34.166879 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:20:34.166879 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:20:34.166879 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:20:34.166879 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:20:34.166879 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:20:34.166879 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6853e911-3704-4087-a449-427f7fc0ba31 could not be found. Oct 22 21:20:34.166879 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:20:34.169138 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-ddab97fb-2f09-49dd-bcb9-8cd3c26cbadc tempest-ServersNegativeTestMultiTenantJSON-985236361 tempest-ServersNegativeTestMultiTenantJSON-985236361-project] Returning 404 to user: Instance 6853e911-3704-4087-a449-427f7fc0ba31 could not be found. {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:20:34.170308 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-ddab97fb-2f09-49dd-bcb9-8cd3c26cbadc tempest-ServersNegativeTestMultiTenantJSON-985236361 tempest-ServersNegativeTestMultiTenantJSON-985236361-project] 10.222.0.18 "PUT /compute/v2.1/servers/6853e911-3704-4087-a449-427f7fc0ba31" status: 404 len: 111 microversion: 2.1 time: 0.071906 Oct 22 21:20:34.171818 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2699/5414] 10.222.0.18 () {60 vars in 1256 bytes} [Sat Oct 22 21:20:34 2022] PUT /compute/v2.1/servers/6853e911-3704-4087-a449-427f7fc0ba31 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 21:20:34.181618 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-f0e770d0-3fc4-465a-8e91-d2144fa6e311 tempest-ServersNegativeTestMultiTenantJSON-327266304 tempest-ServersNegativeTestMultiTenantJSON-327266304-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:20:34.182459 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-f0e770d0-3fc4-465a-8e91-d2144fa6e311 tempest-ServersNegativeTestMultiTenantJSON-327266304 tempest-ServersNegativeTestMultiTenantJSON-327266304-project] [instance: 6853e911-3704-4087-a449-427f7fc0ba31] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:20:34.190643 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f0e770d0-3fc4-465a-8e91-d2144fa6e311 tempest-ServersNegativeTestMultiTenantJSON-327266304 tempest-ServersNegativeTestMultiTenantJSON-327266304-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:20:34.191490 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f0e770d0-3fc4-465a-8e91-d2144fa6e311 tempest-ServersNegativeTestMultiTenantJSON-327266304 tempest-ServersNegativeTestMultiTenantJSON-327266304-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:20:34.192118 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f0e770d0-3fc4-465a-8e91-d2144fa6e311 tempest-ServersNegativeTestMultiTenantJSON-327266304 tempest-ServersNegativeTestMultiTenantJSON-327266304-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:20:34.193056 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f0e770d0-3fc4-465a-8e91-d2144fa6e311 tempest-ServersNegativeTestMultiTenantJSON-327266304 tempest-ServersNegativeTestMultiTenantJSON-327266304-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:20:34.193770 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f0e770d0-3fc4-465a-8e91-d2144fa6e311 tempest-ServersNegativeTestMultiTenantJSON-327266304 tempest-ServersNegativeTestMultiTenantJSON-327266304-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:20:34.194380 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f0e770d0-3fc4-465a-8e91-d2144fa6e311 tempest-ServersNegativeTestMultiTenantJSON-327266304 tempest-ServersNegativeTestMultiTenantJSON-327266304-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:20:34.233603 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-f0e770d0-3fc4-465a-8e91-d2144fa6e311 tempest-ServersNegativeTestMultiTenantJSON-327266304 tempest-ServersNegativeTestMultiTenantJSON-327266304-project] [instance: 6853e911-3704-4087-a449-427f7fc0ba31] Going to try to terminate instance {{(pid=138744) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 21:20:34.233603 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:20:34.412199 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-f0e770d0-3fc4-465a-8e91-d2144fa6e311 tempest-ServersNegativeTestMultiTenantJSON-327266304 tempest-ServersNegativeTestMultiTenantJSON-327266304-project] 10.222.0.18 "DELETE /compute/v2.1/servers/6853e911-3704-4087-a449-427f7fc0ba31" status: 204 len: 0 microversion: 2.1 time: 0.191644 Oct 22 21:20:34.412199 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2700/5415] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 21:20:34 2022] DELETE /compute/v2.1/servers/6853e911-3704-4087-a449-427f7fc0ba31 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 21:20:34.415225 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-bbd3b6a4-0f68-4142-a91c-c383ebfbfa7f tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c85602851244d4a632b9c861eb4416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45cb377c6a9a43b3b91c99a64e37f1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:20:34.415225 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-bbd3b6a4-0f68-4142-a91c-c383ebfbfa7f tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def" status: 200 len: 1669 microversion: 2.1 time: 0.286987 Oct 22 21:20:34.415225 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2716/5416] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:20:34 2022] GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def => generated 1669 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:20:34.415658 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-43a22886-9938-477b-8c46-f13af584ea15 tempest-ServersNegativeTestMultiTenantJSON-327266304 tempest-ServersNegativeTestMultiTenantJSON-327266304-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:20:34.415658 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-43a22886-9938-477b-8c46-f13af584ea15 tempest-ServersNegativeTestMultiTenantJSON-327266304 tempest-ServersNegativeTestMultiTenantJSON-327266304-project] [instance: 6853e911-3704-4087-a449-427f7fc0ba31] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:20:34.415658 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-43a22886-9938-477b-8c46-f13af584ea15 tempest-ServersNegativeTestMultiTenantJSON-327266304 tempest-ServersNegativeTestMultiTenantJSON-327266304-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:20:34.415658 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-43a22886-9938-477b-8c46-f13af584ea15 tempest-ServersNegativeTestMultiTenantJSON-327266304 tempest-ServersNegativeTestMultiTenantJSON-327266304-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:20:34.415658 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-43a22886-9938-477b-8c46-f13af584ea15 tempest-ServersNegativeTestMultiTenantJSON-327266304 tempest-ServersNegativeTestMultiTenantJSON-327266304-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:20:34.415658 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-43a22886-9938-477b-8c46-f13af584ea15 tempest-ServersNegativeTestMultiTenantJSON-327266304 tempest-ServersNegativeTestMultiTenantJSON-327266304-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:20:34.415658 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-43a22886-9938-477b-8c46-f13af584ea15 tempest-ServersNegativeTestMultiTenantJSON-327266304 tempest-ServersNegativeTestMultiTenantJSON-327266304-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:20:34.415658 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-43a22886-9938-477b-8c46-f13af584ea15 tempest-ServersNegativeTestMultiTenantJSON-327266304 tempest-ServersNegativeTestMultiTenantJSON-327266304-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:20:34.416489 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-95e08616-fc02-4d06-ad3d-226b4e94e6c9 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:20:34.416880 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-95e08616-fc02-4d06-ad3d-226b4e94e6c9 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: 20d90b58-3fad-4a44-b6bf-4ef0cc587def] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:20:34.429459 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-95e08616-fc02-4d06-ad3d-226b4e94e6c9 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:20:34.431117 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-95e08616-fc02-4d06-ad3d-226b4e94e6c9 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:20:34.431827 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-95e08616-fc02-4d06-ad3d-226b4e94e6c9 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:20:34.433265 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-95e08616-fc02-4d06-ad3d-226b4e94e6c9 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:20:34.435941 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-95e08616-fc02-4d06-ad3d-226b4e94e6c9 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:20:34.437289 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-95e08616-fc02-4d06-ad3d-226b4e94e6c9 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:20:34.655210 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-43a22886-9938-477b-8c46-f13af584ea15 tempest-ServersNegativeTestMultiTenantJSON-327266304 tempest-ServersNegativeTestMultiTenantJSON-327266304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2acb3d1b6eba4df187ac68bf39e7aa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cefb200280d4407ab97de3dadf6bb281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:20:34.669236 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-43a22886-9938-477b-8c46-f13af584ea15 tempest-ServersNegativeTestMultiTenantJSON-327266304 tempest-ServersNegativeTestMultiTenantJSON-327266304-project] 10.222.0.18 "GET /compute/v2.1/servers/6853e911-3704-4087-a449-427f7fc0ba31" status: 200 len: 1534 microversion: 2.1 time: 0.281610 Oct 22 21:20:34.670224 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2701/5417] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:20:34 2022] GET /compute/v2.1/servers/6853e911-3704-4087-a449-427f7fc0ba31 => generated 1534 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:20:34.715753 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-95e08616-fc02-4d06-ad3d-226b4e94e6c9 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c85602851244d4a632b9c861eb4416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45cb377c6a9a43b3b91c99a64e37f1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:20:34.726543 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-95e08616-fc02-4d06-ad3d-226b4e94e6c9 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def" status: 200 len: 1669 microversion: 2.1 time: 0.314222 Oct 22 21:20:34.730934 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2717/5418] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:20:34 2022] GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def => generated 1669 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:20:34.754124 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-c6464105-cc64-446e-993e-7fad4c781d74 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:20:34.754701 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-c6464105-cc64-446e-993e-7fad4c781d74 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: 20d90b58-3fad-4a44-b6bf-4ef0cc587def] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:20:34.765467 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c6464105-cc64-446e-993e-7fad4c781d74 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:20:34.766267 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c6464105-cc64-446e-993e-7fad4c781d74 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:20:34.767042 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c6464105-cc64-446e-993e-7fad4c781d74 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:20:34.768257 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c6464105-cc64-446e-993e-7fad4c781d74 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:20:34.768889 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c6464105-cc64-446e-993e-7fad4c781d74 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:20:34.769474 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c6464105-cc64-446e-993e-7fad4c781d74 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:20:34.971421 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-c6464105-cc64-446e-993e-7fad4c781d74 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c85602851244d4a632b9c861eb4416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45cb377c6a9a43b3b91c99a64e37f1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:20:34.988999 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-c6464105-cc64-446e-993e-7fad4c781d74 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def" status: 200 len: 1669 microversion: 2.1 time: 0.239478 Oct 22 21:20:35.005270 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2702/5419] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:20:34 2022] GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def => generated 1669 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:20:35.017700 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-aeae8d31-5bd8-4e45-b932-09ebc686ad85 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:20:35.019104 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-aeae8d31-5bd8-4e45-b932-09ebc686ad85 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: 20d90b58-3fad-4a44-b6bf-4ef0cc587def] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:20:35.029208 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-aeae8d31-5bd8-4e45-b932-09ebc686ad85 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:20:35.029922 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-aeae8d31-5bd8-4e45-b932-09ebc686ad85 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:20:35.035097 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-aeae8d31-5bd8-4e45-b932-09ebc686ad85 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:20:35.036438 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-aeae8d31-5bd8-4e45-b932-09ebc686ad85 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:20:35.037101 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-aeae8d31-5bd8-4e45-b932-09ebc686ad85 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:20:35.037720 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-aeae8d31-5bd8-4e45-b932-09ebc686ad85 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:20:35.223090 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-aeae8d31-5bd8-4e45-b932-09ebc686ad85 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c85602851244d4a632b9c861eb4416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45cb377c6a9a43b3b91c99a64e37f1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:20:35.232128 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-aeae8d31-5bd8-4e45-b932-09ebc686ad85 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def" status: 200 len: 1669 microversion: 2.1 time: 0.219522 Oct 22 21:20:35.247368 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2718/5420] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:20:35 2022] GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def => generated 1669 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:20:35.480497 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-2f355271-f02d-453f-9822-1fcc625b2d7d tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-887994563", "imageRef": "085e4478-6edc-4a69-8e08-f9831713eb65", "flavorRef": "452", "networks": [{"uuid": "8c5a5758-cdfc-480f-aa56-074dfadd0152"}]}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:20:35.545085 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.network.neutron [None req-2f355271-f02d-453f-9822-1fcc625b2d7d tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] validate_networks() for [('8c5a5758-cdfc-480f-aa56-074dfadd0152', None, None, None, None, None)] {{(pid=138744) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 21:20:35.696433 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-730589dd-2ec8-4cb6-b3b4-c5334a5f4fd9 tempest-ServersNegativeTestMultiTenantJSON-327266304 tempest-ServersNegativeTestMultiTenantJSON-327266304-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:20:35.697894 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-730589dd-2ec8-4cb6-b3b4-c5334a5f4fd9 tempest-ServersNegativeTestMultiTenantJSON-327266304 tempest-ServersNegativeTestMultiTenantJSON-327266304-project] [instance: 6853e911-3704-4087-a449-427f7fc0ba31] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:20:35.706739 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-730589dd-2ec8-4cb6-b3b4-c5334a5f4fd9 tempest-ServersNegativeTestMultiTenantJSON-327266304 tempest-ServersNegativeTestMultiTenantJSON-327266304-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:20:35.707921 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-730589dd-2ec8-4cb6-b3b4-c5334a5f4fd9 tempest-ServersNegativeTestMultiTenantJSON-327266304 tempest-ServersNegativeTestMultiTenantJSON-327266304-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:20:35.708917 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-730589dd-2ec8-4cb6-b3b4-c5334a5f4fd9 tempest-ServersNegativeTestMultiTenantJSON-327266304 tempest-ServersNegativeTestMultiTenantJSON-327266304-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:20:35.710263 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-730589dd-2ec8-4cb6-b3b4-c5334a5f4fd9 tempest-ServersNegativeTestMultiTenantJSON-327266304 tempest-ServersNegativeTestMultiTenantJSON-327266304-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:20:35.711929 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-730589dd-2ec8-4cb6-b3b4-c5334a5f4fd9 tempest-ServersNegativeTestMultiTenantJSON-327266304 tempest-ServersNegativeTestMultiTenantJSON-327266304-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:20:35.715785 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-730589dd-2ec8-4cb6-b3b4-c5334a5f4fd9 tempest-ServersNegativeTestMultiTenantJSON-327266304 tempest-ServersNegativeTestMultiTenantJSON-327266304-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:20:36.275324 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-730589dd-2ec8-4cb6-b3b4-c5334a5f4fd9 tempest-ServersNegativeTestMultiTenantJSON-327266304 tempest-ServersNegativeTestMultiTenantJSON-327266304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2acb3d1b6eba4df187ac68bf39e7aa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cefb200280d4407ab97de3dadf6bb281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:20:36.289249 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-730589dd-2ec8-4cb6-b3b4-c5334a5f4fd9 tempest-ServersNegativeTestMultiTenantJSON-327266304 tempest-ServersNegativeTestMultiTenantJSON-327266304-project] 10.222.0.18 "GET /compute/v2.1/servers/6853e911-3704-4087-a449-427f7fc0ba31" status: 200 len: 1534 microversion: 2.1 time: 0.597427 Oct 22 21:20:36.291647 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2719/5421] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:20:35 2022] GET /compute/v2.1/servers/6853e911-3704-4087-a449-427f7fc0ba31 => generated 1534 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:20:36.614336 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-2f355271-f02d-453f-9822-1fcc625b2d7d tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Flavor limits 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 21:20:36.616779 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-2f355271-f02d-453f-9822-1fcc625b2d7d tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Image limits 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 21:20:36.617677 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-2f355271-f02d-453f-9822-1fcc625b2d7d tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Flavor pref 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 21:20:36.618278 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-2f355271-f02d-453f-9822-1fcc625b2d7d tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Image pref 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 21:20:36.618902 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-2f355271-f02d-453f-9822-1fcc625b2d7d tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 21:20:36.658776 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2f355271-f02d-453f-9822-1fcc625b2d7d tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:20:36.660012 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2f355271-f02d-453f-9822-1fcc625b2d7d tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:20:36.661890 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2f355271-f02d-453f-9822-1fcc625b2d7d tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:20:36.663515 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2f355271-f02d-453f-9822-1fcc625b2d7d tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:20:36.664253 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2f355271-f02d-453f-9822-1fcc625b2d7d tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:20:36.664941 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2f355271-f02d-453f-9822-1fcc625b2d7d tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:20:36.702402 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-2f355271-f02d-453f-9822-1fcc625b2d7d tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Getting quotas for project 45cb377c6a9a43b3b91c99a64e37f1eb. Resources: {'cores', 'instances', 'ram'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 21:20:36.714020 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-2f355271-f02d-453f-9822-1fcc625b2d7d tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Getting quotas for user c9c85602851244d4a632b9c861eb4416 and project 45cb377c6a9a43b3b91c99a64e37f1eb. Resources: {'cores', 'instances', 'ram'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 21:20:36.743224 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-2f355271-f02d-453f-9822-1fcc625b2d7d tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Going to run 1 instances... {{(pid=138744) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 21:20:36.750584 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-2f355271-f02d-453f-9822-1fcc625b2d7d tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: ec15d899-3167-4bce-9b78-f8d8b15455b3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='085e4478-6edc-4a69-8e08-f9831713eb65',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138744) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 21:20:36.911550 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-2f355271-f02d-453f-9822-1fcc625b2d7d tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.435884 Oct 22 21:20:36.914568 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2703/5422] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Oct 22 21:20:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 1440 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 21:20:36.926413 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-ea30b6b7-4b13-4533-aefb-3536d5628073 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:20:36.926413 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-ea30b6b7-4b13-4533-aefb-3536d5628073 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: ec15d899-3167-4bce-9b78-f8d8b15455b3] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:20:36.932200 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:20:37.015647 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-ba5b4aed-1f14-4d07-b431-d51bbfdc947d req-34d5093e-8fb2-4a74-bec7-f4ec65603789 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6853e911-3704-4087-a449-427f7fc0ba31", "name": "network-vif-deleted", "tag": "a62c12be-871a-4554-a872-93c4372deedb"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:20:37.044265 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-ba5b4aed-1f14-4d07-b431-d51bbfdc947d req-34d5093e-8fb2-4a74-bec7-f4ec65603789 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:20:37.044746 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-ba5b4aed-1f14-4d07-b431-d51bbfdc947d req-34d5093e-8fb2-4a74-bec7-f4ec65603789 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:20:37.051158 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-ba5b4aed-1f14-4d07-b431-d51bbfdc947d req-34d5093e-8fb2-4a74-bec7-f4ec65603789 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:20:37.082134 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-ba5b4aed-1f14-4d07-b431-d51bbfdc947d req-34d5093e-8fb2-4a74-bec7-f4ec65603789 service nova] Creating event network-vif-deleted:a62c12be-871a-4554-a872-93c4372deedb for instance 6853e911-3704-4087-a449-427f7fc0ba31 on nch1-master-1 Oct 22 21:20:37.105060 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-ea30b6b7-4b13-4533-aefb-3536d5628073 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c85602851244d4a632b9c861eb4416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45cb377c6a9a43b3b91c99a64e37f1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:20:37.124445 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-ea30b6b7-4b13-4533-aefb-3536d5628073 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "GET /compute/v2.1/servers/ec15d899-3167-4bce-9b78-f8d8b15455b3" status: 200 len: 1214 microversion: 2.1 time: 0.202004 Oct 22 21:20:37.125510 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-ba5b4aed-1f14-4d07-b431-d51bbfdc947d req-34d5093e-8fb2-4a74-bec7-f4ec65603789 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108767 Oct 22 21:20:37.126366 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2720/5423] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:20:36 2022] GET /compute/v2.1/servers/ec15d899-3167-4bce-9b78-f8d8b15455b3 => generated 1214 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:20:37.130216 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2704/5424] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:20:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:20:37.317398 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-7ae7cda8-61d7-447d-8bc4-aa5ef29ffaad tempest-ServersNegativeTestMultiTenantJSON-327266304 tempest-ServersNegativeTestMultiTenantJSON-327266304-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:20:37.318426 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-7ae7cda8-61d7-447d-8bc4-aa5ef29ffaad tempest-ServersNegativeTestMultiTenantJSON-327266304 tempest-ServersNegativeTestMultiTenantJSON-327266304-project] [instance: 6853e911-3704-4087-a449-427f7fc0ba31] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:20:37.327598 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7ae7cda8-61d7-447d-8bc4-aa5ef29ffaad tempest-ServersNegativeTestMultiTenantJSON-327266304 tempest-ServersNegativeTestMultiTenantJSON-327266304-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:20:37.338504 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7ae7cda8-61d7-447d-8bc4-aa5ef29ffaad tempest-ServersNegativeTestMultiTenantJSON-327266304 tempest-ServersNegativeTestMultiTenantJSON-327266304-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:20:37.338969 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7ae7cda8-61d7-447d-8bc4-aa5ef29ffaad tempest-ServersNegativeTestMultiTenantJSON-327266304 tempest-ServersNegativeTestMultiTenantJSON-327266304-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:20:37.339759 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7ae7cda8-61d7-447d-8bc4-aa5ef29ffaad tempest-ServersNegativeTestMultiTenantJSON-327266304 tempest-ServersNegativeTestMultiTenantJSON-327266304-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:20:37.340257 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7ae7cda8-61d7-447d-8bc4-aa5ef29ffaad tempest-ServersNegativeTestMultiTenantJSON-327266304 tempest-ServersNegativeTestMultiTenantJSON-327266304-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:20:37.340642 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7ae7cda8-61d7-447d-8bc4-aa5ef29ffaad tempest-ServersNegativeTestMultiTenantJSON-327266304 tempest-ServersNegativeTestMultiTenantJSON-327266304-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:20:37.424013 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7ae7cda8-61d7-447d-8bc4-aa5ef29ffaad tempest-ServersNegativeTestMultiTenantJSON-327266304 tempest-ServersNegativeTestMultiTenantJSON-327266304-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:20:37.424517 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7ae7cda8-61d7-447d-8bc4-aa5ef29ffaad tempest-ServersNegativeTestMultiTenantJSON-327266304 tempest-ServersNegativeTestMultiTenantJSON-327266304-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:20:37.425080 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7ae7cda8-61d7-447d-8bc4-aa5ef29ffaad tempest-ServersNegativeTestMultiTenantJSON-327266304 tempest-ServersNegativeTestMultiTenantJSON-327266304-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:20:37.425585 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.objects.instance [None req-7ae7cda8-61d7-447d-8bc4-aa5ef29ffaad tempest-ServersNegativeTestMultiTenantJSON-327266304 tempest-ServersNegativeTestMultiTenantJSON-327266304-project] Lazy-loading 'fault' on Instance uuid 6853e911-3704-4087-a449-427f7fc0ba31 {{(pid=138744) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 21:20:37.506562 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-7ae7cda8-61d7-447d-8bc4-aa5ef29ffaad tempest-ServersNegativeTestMultiTenantJSON-327266304 tempest-ServersNegativeTestMultiTenantJSON-327266304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2acb3d1b6eba4df187ac68bf39e7aa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cefb200280d4407ab97de3dadf6bb281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:20:37.544632 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-7ae7cda8-61d7-447d-8bc4-aa5ef29ffaad tempest-ServersNegativeTestMultiTenantJSON-327266304 tempest-ServersNegativeTestMultiTenantJSON-327266304-project] 10.222.0.18 "GET /compute/v2.1/servers/6853e911-3704-4087-a449-427f7fc0ba31" status: 200 len: 1317 microversion: 2.1 time: 0.232061 Oct 22 21:20:37.545949 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2705/5425] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:20:37 2022] GET /compute/v2.1/servers/6853e911-3704-4087-a449-427f7fc0ba31 => generated 1317 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:20:38.149054 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-b0cc04df-80d1-4276-a190-611393bd2946 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:20:38.149703 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-b0cc04df-80d1-4276-a190-611393bd2946 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: ec15d899-3167-4bce-9b78-f8d8b15455b3] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:20:38.158618 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b0cc04df-80d1-4276-a190-611393bd2946 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:20:38.159135 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b0cc04df-80d1-4276-a190-611393bd2946 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:20:38.159701 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b0cc04df-80d1-4276-a190-611393bd2946 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:20:38.160550 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b0cc04df-80d1-4276-a190-611393bd2946 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:20:38.161163 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b0cc04df-80d1-4276-a190-611393bd2946 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:20:38.161829 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b0cc04df-80d1-4276-a190-611393bd2946 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:20:38.258154 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-b0cc04df-80d1-4276-a190-611393bd2946 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c85602851244d4a632b9c861eb4416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45cb377c6a9a43b3b91c99a64e37f1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:20:38.269239 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-b0cc04df-80d1-4276-a190-611393bd2946 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "GET /compute/v2.1/servers/ec15d899-3167-4bce-9b78-f8d8b15455b3" status: 200 len: 1210 microversion: 2.1 time: 0.123389 Oct 22 21:20:38.284672 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2721/5426] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:20:38 2022] GET /compute/v2.1/servers/ec15d899-3167-4bce-9b78-f8d8b15455b3 => generated 1210 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:20:38.571718 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-6b061508-abf4-49c3-838a-29efbd9389a9 tempest-ServersNegativeTestMultiTenantJSON-327266304 tempest-ServersNegativeTestMultiTenantJSON-327266304-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:20:38.573422 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-6b061508-abf4-49c3-838a-29efbd9389a9 tempest-ServersNegativeTestMultiTenantJSON-327266304 tempest-ServersNegativeTestMultiTenantJSON-327266304-project] [instance: 6853e911-3704-4087-a449-427f7fc0ba31] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:20:38.598911 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6b061508-abf4-49c3-838a-29efbd9389a9 tempest-ServersNegativeTestMultiTenantJSON-327266304 tempest-ServersNegativeTestMultiTenantJSON-327266304-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:20:38.600403 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6b061508-abf4-49c3-838a-29efbd9389a9 tempest-ServersNegativeTestMultiTenantJSON-327266304 tempest-ServersNegativeTestMultiTenantJSON-327266304-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:20:38.601048 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6b061508-abf4-49c3-838a-29efbd9389a9 tempest-ServersNegativeTestMultiTenantJSON-327266304 tempest-ServersNegativeTestMultiTenantJSON-327266304-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:20:38.601990 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6b061508-abf4-49c3-838a-29efbd9389a9 tempest-ServersNegativeTestMultiTenantJSON-327266304 tempest-ServersNegativeTestMultiTenantJSON-327266304-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:20:38.602656 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6b061508-abf4-49c3-838a-29efbd9389a9 tempest-ServersNegativeTestMultiTenantJSON-327266304 tempest-ServersNegativeTestMultiTenantJSON-327266304-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:20:38.603416 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6b061508-abf4-49c3-838a-29efbd9389a9 tempest-ServersNegativeTestMultiTenantJSON-327266304 tempest-ServersNegativeTestMultiTenantJSON-327266304-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:20:38.626154 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-6b061508-abf4-49c3-838a-29efbd9389a9 tempest-ServersNegativeTestMultiTenantJSON-327266304 tempest-ServersNegativeTestMultiTenantJSON-327266304-project] HTTP exception thrown: Instance 6853e911-3704-4087-a449-427f7fc0ba31 could not be found. Oct 22 21:20:38.628827 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-6b061508-abf4-49c3-838a-29efbd9389a9 tempest-ServersNegativeTestMultiTenantJSON-327266304 tempest-ServersNegativeTestMultiTenantJSON-327266304-project] Request method failure captured: Oct 22 21:20:38.628827 ncdv-master-1 devstack@n-api.service[138744]: request: GET /compute/v2.1/servers/6853e911-3704-4087-a449-427f7fc0ba31 HTTP/1.1 Oct 22 21:20:38.628827 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 21:20:38.628827 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 21:20:38.628827 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 21:20:38.628827 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 0 Oct 22 21:20:38.628827 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 21:20:38.628827 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 21:20:38.628827 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 21:20:38.628827 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 21:20:38.628827 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVF6Go0MWAga4vBE728zvITvfm6I1bWECyQKzpPqM0R4rOGSrItaSGq6Yb5KzqWfIIxqHb-vYOfBs-PMjTWVQCLrHPvI7erADsGawN3kqlTBp8WLE9EGXAWADufHUIppZjnQTMj-hDIU-949uG1FJtOUnHmV3QL_2h01_H4-sU3MikGw Oct 22 21:20:38.628827 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 21:20:38.628827 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 21:20:38.628827 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 21:20:38.628827 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 21:20:38.628827 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 21:20:38.628827 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 21:20:38.628827 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: cefb200280d4407ab97de3dadf6bb281 Oct 22 21:20:38.628827 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-327266304 Oct 22 21:20:38.628827 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 21:20:38.628827 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 21:20:38.628827 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_cefb200280d4407ab97de3dadf6bb281"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/cefb200280d4407ab97de3dadf6bb281"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/cefb200280d4407ab97de3dadf6bb281"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/cefb200280d4407ab97de3dadf6bb281"}]}] Oct 22 21:20:38.628827 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-327266304 Oct 22 21:20:38.628827 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: cefb200280d4407ab97de3dadf6bb281 Oct 22 21:20:38.628827 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-327266304 Oct 22 21:20:38.628827 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-ServersNegativeTestMultiTenantJSON-327266304-project Oct 22 21:20:38.628827 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 21:20:38.628827 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 21:20:38.628827 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: 2acb3d1b6eba4df187ac68bf39e7aa73 Oct 22 21:20:38.628827 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-327266304-project Oct 22 21:20:38.628827 ncdv-master-1 devstack@n-api.service[138744]: method: > Oct 22 21:20:38.628827 ncdv-master-1 devstack@n-api.service[138744]: exception: Instance 6853e911-3704-4087-a449-427f7fc0ba31 could not be found. Oct 22 21:20:38.628827 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': '6853e911-3704-4087-a449-427f7fc0ba31'} Oct 22 21:20:38.628827 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:20:38.628827 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:20:38.628827 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 21:20:38.628827 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 21:20:38.628827 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 21:20:38.628827 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 21:20:38.628827 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 21:20:38.628827 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 21:20:38.628827 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 21:20:38.628827 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 21:20:38.628827 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6853e911-3704-4087-a449-427f7fc0ba31 could not be found. Oct 22 21:20:38.628827 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:20:38.628827 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:20:38.628827 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:20:38.628827 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:20:38.628827 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:20:38.628827 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:20:38.628827 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:20:38.628827 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:20:38.628827 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:20:38.628827 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:20:38.628827 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 21:20:38.628827 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 21:20:38.628827 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 21:20:38.628827 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 21:20:38.628827 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 21:20:38.628827 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:20:38.628827 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6853e911-3704-4087-a449-427f7fc0ba31 could not be found. Oct 22 21:20:38.628827 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:20:38.636672 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:20:38.636672 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:20:38.636672 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:20:38.636672 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:20:38.636672 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:20:38.636672 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:20:38.636672 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:20:38.636672 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6853e911-3704-4087-a449-427f7fc0ba31 could not be found. Oct 22 21:20:38.636672 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:20:38.638843 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-6b061508-abf4-49c3-838a-29efbd9389a9 tempest-ServersNegativeTestMultiTenantJSON-327266304 tempest-ServersNegativeTestMultiTenantJSON-327266304-project] Returning 404 to user: Instance 6853e911-3704-4087-a449-427f7fc0ba31 could not be found. {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:20:38.640154 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-6b061508-abf4-49c3-838a-29efbd9389a9 tempest-ServersNegativeTestMultiTenantJSON-327266304 tempest-ServersNegativeTestMultiTenantJSON-327266304-project] 10.222.0.18 "GET /compute/v2.1/servers/6853e911-3704-4087-a449-427f7fc0ba31" status: 404 len: 111 microversion: 2.1 time: 0.073898 Oct 22 21:20:38.645351 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2706/5427] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:20:38 2022] GET /compute/v2.1/servers/6853e911-3704-4087-a449-427f7fc0ba31 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 21:20:39.294837 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-150e66a1-4f4d-4740-92bb-65b21ea6ccb3 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:20:39.295631 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-150e66a1-4f4d-4740-92bb-65b21ea6ccb3 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: ec15d899-3167-4bce-9b78-f8d8b15455b3] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:20:39.309579 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-150e66a1-4f4d-4740-92bb-65b21ea6ccb3 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:20:39.310599 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-150e66a1-4f4d-4740-92bb-65b21ea6ccb3 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:20:39.312193 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-150e66a1-4f4d-4740-92bb-65b21ea6ccb3 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:20:39.313544 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-150e66a1-4f4d-4740-92bb-65b21ea6ccb3 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:20:39.319892 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-150e66a1-4f4d-4740-92bb-65b21ea6ccb3 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:20:39.320962 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-150e66a1-4f4d-4740-92bb-65b21ea6ccb3 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:20:39.885709 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-150e66a1-4f4d-4740-92bb-65b21ea6ccb3 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c85602851244d4a632b9c861eb4416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45cb377c6a9a43b3b91c99a64e37f1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:20:39.894933 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-150e66a1-4f4d-4740-92bb-65b21ea6ccb3 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "GET /compute/v2.1/servers/ec15d899-3167-4bce-9b78-f8d8b15455b3" status: 200 len: 1272 microversion: 2.1 time: 0.604648 Oct 22 21:20:39.895559 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2722/5428] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:20:39 2022] GET /compute/v2.1/servers/ec15d899-3167-4bce-9b78-f8d8b15455b3 => generated 1272 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:20:40.922070 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-3b6df464-dd07-4736-b35d-27805b7b3ec4 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:20:40.923471 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-3b6df464-dd07-4736-b35d-27805b7b3ec4 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: ec15d899-3167-4bce-9b78-f8d8b15455b3] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:20:40.930829 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3b6df464-dd07-4736-b35d-27805b7b3ec4 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:20:40.931577 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3b6df464-dd07-4736-b35d-27805b7b3ec4 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:20:40.932020 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3b6df464-dd07-4736-b35d-27805b7b3ec4 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:20:40.932918 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3b6df464-dd07-4736-b35d-27805b7b3ec4 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:20:40.933699 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3b6df464-dd07-4736-b35d-27805b7b3ec4 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:20:40.934273 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3b6df464-dd07-4736-b35d-27805b7b3ec4 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:20:41.158130 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-3b6df464-dd07-4736-b35d-27805b7b3ec4 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c85602851244d4a632b9c861eb4416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45cb377c6a9a43b3b91c99a64e37f1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:20:41.167089 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-3b6df464-dd07-4736-b35d-27805b7b3ec4 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "GET /compute/v2.1/servers/ec15d899-3167-4bce-9b78-f8d8b15455b3" status: 200 len: 1314 microversion: 2.1 time: 0.249108 Oct 22 21:20:41.181647 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2707/5429] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:20:40 2022] GET /compute/v2.1/servers/ec15d899-3167-4bce-9b78-f8d8b15455b3 => generated 1314 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:20:41.549776 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-75dd6b38-3efa-4304-a78e-69542595e6a4 req-7cba73cf-4ed2-4250-93d6-c8b2000d34d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec15d899-3167-4bce-9b78-f8d8b15455b3", "tag": "ac7f29a5-7912-4f95-b7f3-24677fd1743d"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:20:41.576768 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-75dd6b38-3efa-4304-a78e-69542595e6a4 req-7cba73cf-4ed2-4250-93d6-c8b2000d34d7 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:20:41.576768 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-75dd6b38-3efa-4304-a78e-69542595e6a4 req-7cba73cf-4ed2-4250-93d6-c8b2000d34d7 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:20:41.577000 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-75dd6b38-3efa-4304-a78e-69542595e6a4 req-7cba73cf-4ed2-4250-93d6-c8b2000d34d7 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:20:41.606260 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-75dd6b38-3efa-4304-a78e-69542595e6a4 req-7cba73cf-4ed2-4250-93d6-c8b2000d34d7 service nova] Creating event network-changed:ac7f29a5-7912-4f95-b7f3-24677fd1743d for instance ec15d899-3167-4bce-9b78-f8d8b15455b3 on nch2-master-1 Oct 22 21:20:41.611647 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-75dd6b38-3efa-4304-a78e-69542595e6a4 req-7cba73cf-4ed2-4250-93d6-c8b2000d34d7 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065580 Oct 22 21:20:41.612340 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2723/5430] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:20:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:20:42.194434 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-509ae43c-9069-4bf6-9e9a-70a81bba8112 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:20:42.194986 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-509ae43c-9069-4bf6-9e9a-70a81bba8112 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: ec15d899-3167-4bce-9b78-f8d8b15455b3] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:20:42.204817 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-509ae43c-9069-4bf6-9e9a-70a81bba8112 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:20:42.205326 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-509ae43c-9069-4bf6-9e9a-70a81bba8112 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:20:42.205884 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-509ae43c-9069-4bf6-9e9a-70a81bba8112 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:20:42.206484 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-509ae43c-9069-4bf6-9e9a-70a81bba8112 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:20:42.206946 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-509ae43c-9069-4bf6-9e9a-70a81bba8112 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:20:42.207431 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-509ae43c-9069-4bf6-9e9a-70a81bba8112 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:20:42.452373 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-509ae43c-9069-4bf6-9e9a-70a81bba8112 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c85602851244d4a632b9c861eb4416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45cb377c6a9a43b3b91c99a64e37f1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:20:42.461910 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-509ae43c-9069-4bf6-9e9a-70a81bba8112 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "GET /compute/v2.1/servers/ec15d899-3167-4bce-9b78-f8d8b15455b3" status: 200 len: 1314 microversion: 2.1 time: 0.271566 Oct 22 21:20:42.463815 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2708/5431] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:20:42 2022] GET /compute/v2.1/servers/ec15d899-3167-4bce-9b78-f8d8b15455b3 => generated 1314 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:20:43.492696 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-c261281c-5ed6-43c8-b4b5-24126810720f tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:20:43.495176 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-c261281c-5ed6-43c8-b4b5-24126810720f tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: ec15d899-3167-4bce-9b78-f8d8b15455b3] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:20:43.518087 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c261281c-5ed6-43c8-b4b5-24126810720f tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:20:43.528373 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c261281c-5ed6-43c8-b4b5-24126810720f tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:20:43.529977 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c261281c-5ed6-43c8-b4b5-24126810720f tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:20:43.531313 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c261281c-5ed6-43c8-b4b5-24126810720f tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:20:43.536438 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c261281c-5ed6-43c8-b4b5-24126810720f tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:20:43.538649 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c261281c-5ed6-43c8-b4b5-24126810720f tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:20:44.176147 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-c261281c-5ed6-43c8-b4b5-24126810720f tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c85602851244d4a632b9c861eb4416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45cb377c6a9a43b3b91c99a64e37f1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:20:44.192610 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-c261281c-5ed6-43c8-b4b5-24126810720f tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "GET /compute/v2.1/servers/ec15d899-3167-4bce-9b78-f8d8b15455b3" status: 200 len: 1314 microversion: 2.1 time: 0.707875 Oct 22 21:20:44.197399 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2724/5432] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:20:43 2022] GET /compute/v2.1/servers/ec15d899-3167-4bce-9b78-f8d8b15455b3 => generated 1314 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:20:45.222017 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-152f9964-f981-4235-bb1d-5f416f292d0a tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:20:45.222740 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-152f9964-f981-4235-bb1d-5f416f292d0a tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: ec15d899-3167-4bce-9b78-f8d8b15455b3] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:20:45.234804 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-152f9964-f981-4235-bb1d-5f416f292d0a tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:20:45.235308 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-152f9964-f981-4235-bb1d-5f416f292d0a tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:20:45.235778 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-152f9964-f981-4235-bb1d-5f416f292d0a tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:20:45.236488 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-152f9964-f981-4235-bb1d-5f416f292d0a tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:20:45.236960 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-152f9964-f981-4235-bb1d-5f416f292d0a tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:20:45.237387 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-152f9964-f981-4235-bb1d-5f416f292d0a tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:20:45.455180 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-152f9964-f981-4235-bb1d-5f416f292d0a tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c85602851244d4a632b9c861eb4416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45cb377c6a9a43b3b91c99a64e37f1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:20:45.463282 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-152f9964-f981-4235-bb1d-5f416f292d0a tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "GET /compute/v2.1/servers/ec15d899-3167-4bce-9b78-f8d8b15455b3" status: 200 len: 1314 microversion: 2.1 time: 0.245440 Oct 22 21:20:45.464154 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2709/5433] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:20:45 2022] GET /compute/v2.1/servers/ec15d899-3167-4bce-9b78-f8d8b15455b3 => generated 1314 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:20:46.491650 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-80eecac9-f949-4345-83c0-e0030ad6cceb tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:20:46.492228 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-80eecac9-f949-4345-83c0-e0030ad6cceb tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: ec15d899-3167-4bce-9b78-f8d8b15455b3] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:20:46.522722 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-80eecac9-f949-4345-83c0-e0030ad6cceb tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:20:46.523242 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-80eecac9-f949-4345-83c0-e0030ad6cceb tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:20:46.523733 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-80eecac9-f949-4345-83c0-e0030ad6cceb tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:20:46.524487 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-80eecac9-f949-4345-83c0-e0030ad6cceb tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:20:46.524966 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-80eecac9-f949-4345-83c0-e0030ad6cceb tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:20:46.525416 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-80eecac9-f949-4345-83c0-e0030ad6cceb tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:20:47.070288 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-a43f6488-0f2a-4c69-999c-fb22bf1ae86a req-9dacaec7-5c0b-4eee-83b4-3cf6b3af647b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec15d899-3167-4bce-9b78-f8d8b15455b3", "name": "network-vif-plugged", "status": "completed", "tag": "ac7f29a5-7912-4f95-b7f3-24677fd1743d"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:20:47.079040 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell0:SELECT=2 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:20:47.090364 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell0:SELECT=6 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:20:47.110290 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-a43f6488-0f2a-4c69-999c-fb22bf1ae86a req-9dacaec7-5c0b-4eee-83b4-3cf6b3af647b service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:20:47.111116 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-a43f6488-0f2a-4c69-999c-fb22bf1ae86a req-9dacaec7-5c0b-4eee-83b4-3cf6b3af647b service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:20:47.111572 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell0:SELECT=2 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:20:47.111974 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-a43f6488-0f2a-4c69-999c-fb22bf1ae86a req-9dacaec7-5c0b-4eee-83b4-3cf6b3af647b service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:20:47.146087 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-a43f6488-0f2a-4c69-999c-fb22bf1ae86a req-9dacaec7-5c0b-4eee-83b4-3cf6b3af647b service nova] Creating event network-vif-plugged:ac7f29a5-7912-4f95-b7f3-24677fd1743d for instance ec15d899-3167-4bce-9b78-f8d8b15455b3 on nch2-master-1 Oct 22 21:20:47.176955 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-a43f6488-0f2a-4c69-999c-fb22bf1ae86a req-9dacaec7-5c0b-4eee-83b4-3cf6b3af647b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102011 Oct 22 21:20:47.176955 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2710/5434] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:20:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:20:47.770601 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-80eecac9-f949-4345-83c0-e0030ad6cceb tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c85602851244d4a632b9c861eb4416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45cb377c6a9a43b3b91c99a64e37f1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:20:47.782333 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-80eecac9-f949-4345-83c0-e0030ad6cceb tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "GET /compute/v2.1/servers/ec15d899-3167-4bce-9b78-f8d8b15455b3" status: 200 len: 1314 microversion: 2.1 time: 1.298024 Oct 22 21:20:47.784393 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2725/5435] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:20:46 2022] GET /compute/v2.1/servers/ec15d899-3167-4bce-9b78-f8d8b15455b3 => generated 1314 bytes in 1301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:20:48.825210 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-ea9503a7-09c4-4aa2-a223-5b13ddac20d5 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:20:48.825210 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-ea9503a7-09c4-4aa2-a223-5b13ddac20d5 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: ec15d899-3167-4bce-9b78-f8d8b15455b3] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:20:48.876056 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ea9503a7-09c4-4aa2-a223-5b13ddac20d5 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:20:48.876056 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ea9503a7-09c4-4aa2-a223-5b13ddac20d5 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:20:48.876056 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ea9503a7-09c4-4aa2-a223-5b13ddac20d5 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:20:48.876056 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ea9503a7-09c4-4aa2-a223-5b13ddac20d5 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:20:48.876056 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ea9503a7-09c4-4aa2-a223-5b13ddac20d5 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:20:48.876056 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ea9503a7-09c4-4aa2-a223-5b13ddac20d5 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:20:49.236756 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-ea9503a7-09c4-4aa2-a223-5b13ddac20d5 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c85602851244d4a632b9c861eb4416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45cb377c6a9a43b3b91c99a64e37f1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:20:49.254746 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-ea9503a7-09c4-4aa2-a223-5b13ddac20d5 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "GET /compute/v2.1/servers/ec15d899-3167-4bce-9b78-f8d8b15455b3" status: 200 len: 1314 microversion: 2.1 time: 0.449863 Oct 22 21:20:49.272941 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2711/5436] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:20:48 2022] GET /compute/v2.1/servers/ec15d899-3167-4bce-9b78-f8d8b15455b3 => generated 1314 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:20:50.285300 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-6c83a845-f88b-4c8d-a8e1-2b7f1d06b7a6 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:20:50.285958 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-6c83a845-f88b-4c8d-a8e1-2b7f1d06b7a6 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: ec15d899-3167-4bce-9b78-f8d8b15455b3] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:20:50.300478 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6c83a845-f88b-4c8d-a8e1-2b7f1d06b7a6 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:20:50.304065 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6c83a845-f88b-4c8d-a8e1-2b7f1d06b7a6 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:20:50.304545 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6c83a845-f88b-4c8d-a8e1-2b7f1d06b7a6 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:20:50.305307 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6c83a845-f88b-4c8d-a8e1-2b7f1d06b7a6 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:20:50.307304 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6c83a845-f88b-4c8d-a8e1-2b7f1d06b7a6 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:20:50.307885 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6c83a845-f88b-4c8d-a8e1-2b7f1d06b7a6 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:20:50.527147 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-6c83a845-f88b-4c8d-a8e1-2b7f1d06b7a6 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c85602851244d4a632b9c861eb4416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45cb377c6a9a43b3b91c99a64e37f1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:20:50.539775 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-6c83a845-f88b-4c8d-a8e1-2b7f1d06b7a6 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "GET /compute/v2.1/servers/ec15d899-3167-4bce-9b78-f8d8b15455b3" status: 200 len: 1500 microversion: 2.1 time: 0.257015 Oct 22 21:20:50.552324 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2726/5437] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:20:50 2022] GET /compute/v2.1/servers/ec15d899-3167-4bce-9b78-f8d8b15455b3 => generated 1500 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:20:50.566151 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-919d6182-af44-4f6f-8e7f-4cca80a40004 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:20:50.577497 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-919d6182-af44-4f6f-8e7f-4cca80a40004 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:20:50.578889 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-919d6182-af44-4f6f-8e7f-4cca80a40004 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:20:50.580705 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-919d6182-af44-4f6f-8e7f-4cca80a40004 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:20:50.640433 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-919d6182-af44-4f6f-8e7f-4cca80a40004 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: ec15d899-3167-4bce-9b78-f8d8b15455b3] Going to try to stop instance {{(pid=138744) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 22 21:20:50.716691 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-919d6182-af44-4f6f-8e7f-4cca80a40004 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "POST /compute/v2.1/servers/ec15d899-3167-4bce-9b78-f8d8b15455b3/action" status: 202 len: 0 microversion: 2.1 time: 0.154717 Oct 22 21:20:50.717928 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2712/5438] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 21:20:50 2022] POST /compute/v2.1/servers/ec15d899-3167-4bce-9b78-f8d8b15455b3/action => generated 0 bytes in 159 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 21:20:50.731582 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-94ead59e-709e-4a7e-92b9-4907fd1fac94 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:20:50.732251 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-94ead59e-709e-4a7e-92b9-4907fd1fac94 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: ec15d899-3167-4bce-9b78-f8d8b15455b3] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:20:50.753299 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-94ead59e-709e-4a7e-92b9-4907fd1fac94 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:20:50.756697 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-94ead59e-709e-4a7e-92b9-4907fd1fac94 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:20:50.758264 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-94ead59e-709e-4a7e-92b9-4907fd1fac94 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:20:50.760859 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-94ead59e-709e-4a7e-92b9-4907fd1fac94 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:20:50.761413 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-94ead59e-709e-4a7e-92b9-4907fd1fac94 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:20:50.761875 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-94ead59e-709e-4a7e-92b9-4907fd1fac94 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:20:51.005062 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-94ead59e-709e-4a7e-92b9-4907fd1fac94 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c85602851244d4a632b9c861eb4416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45cb377c6a9a43b3b91c99a64e37f1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:20:51.015384 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-94ead59e-709e-4a7e-92b9-4907fd1fac94 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "GET /compute/v2.1/servers/ec15d899-3167-4bce-9b78-f8d8b15455b3" status: 200 len: 1510 microversion: 2.1 time: 0.293315 Oct 22 21:20:51.016392 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2727/5439] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:20:50 2022] GET /compute/v2.1/servers/ec15d899-3167-4bce-9b78-f8d8b15455b3 => generated 1510 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:20:52.042666 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-9124c465-64ac-4e0e-9ecf-aa01360877fa tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:20:52.043401 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-9124c465-64ac-4e0e-9ecf-aa01360877fa tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: ec15d899-3167-4bce-9b78-f8d8b15455b3] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:20:52.062010 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9124c465-64ac-4e0e-9ecf-aa01360877fa tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:20:52.062517 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9124c465-64ac-4e0e-9ecf-aa01360877fa tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:20:52.063507 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9124c465-64ac-4e0e-9ecf-aa01360877fa tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:20:52.064239 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9124c465-64ac-4e0e-9ecf-aa01360877fa tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:20:52.064698 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9124c465-64ac-4e0e-9ecf-aa01360877fa tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:20:52.065638 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9124c465-64ac-4e0e-9ecf-aa01360877fa tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:20:52.285966 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-9124c465-64ac-4e0e-9ecf-aa01360877fa tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c85602851244d4a632b9c861eb4416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45cb377c6a9a43b3b91c99a64e37f1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:20:52.297827 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-9124c465-64ac-4e0e-9ecf-aa01360877fa tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "GET /compute/v2.1/servers/ec15d899-3167-4bce-9b78-f8d8b15455b3" status: 200 len: 1510 microversion: 2.1 time: 0.258475 Oct 22 21:20:52.299026 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2713/5440] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:20:52 2022] GET /compute/v2.1/servers/ec15d899-3167-4bce-9b78-f8d8b15455b3 => generated 1510 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:20:52.554115 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-0d1f12aa-4fa7-4f03-8b6f-d3a6aa332a7b tempest-VolumesGetTestJSON-1888422140 tempest-VolumesGetTestJSON-1888422140-project] Action: 'create', calling method: .version_select at 0x7fd39c4a28b0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1156696081", "metadata": {"Type": "work"}}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:20:52.872303 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-0d1f12aa-4fa7-4f03-8b6f-d3a6aa332a7b tempest-VolumesGetTestJSON-1888422140 tempest-VolumesGetTestJSON-1888422140-project] 10.222.0.18 "POST /compute/v2.1/os-volumes" status: 200 len: 346 microversion: 2.1 time: 0.453612 Oct 22 21:20:52.873127 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2728/5441] 10.222.0.18 () {60 vars in 1156 bytes} [Sat Oct 22 21:20:52 2022] POST /compute/v2.1/os-volumes => generated 346 bytes in 455 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Oct 22 21:20:52.886487 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-d2d9d125-7c28-4dc5-86b7-ce2298bb5740 tempest-VolumesGetTestJSON-1888422140 tempest-VolumesGetTestJSON-1888422140-project] Calling method '.version_select at 0x7fd39ef3aaf0>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:20:52.941434 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-d2d9d125-7c28-4dc5-86b7-ce2298bb5740 tempest-VolumesGetTestJSON-1888422140 tempest-VolumesGetTestJSON-1888422140-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/26ae2ccb-78e1-45c7-a98a-8f07fca7729f" status: 200 len: 346 microversion: 2.1 time: 0.058796 Oct 22 21:20:52.942293 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2714/5442] 10.222.0.18 () {58 vars in 1245 bytes} [Sat Oct 22 21:20:52 2022] GET /compute/v2.1/os-volumes/26ae2ccb-78e1-45c7-a98a-8f07fca7729f => generated 346 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:20:53.325736 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-1b0b04f5-c476-46be-8b83-32da24b90516 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:20:53.326572 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-1b0b04f5-c476-46be-8b83-32da24b90516 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: ec15d899-3167-4bce-9b78-f8d8b15455b3] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:20:53.334788 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1b0b04f5-c476-46be-8b83-32da24b90516 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:20:53.335539 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1b0b04f5-c476-46be-8b83-32da24b90516 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:20:53.336866 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1b0b04f5-c476-46be-8b83-32da24b90516 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:20:53.337933 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1b0b04f5-c476-46be-8b83-32da24b90516 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:20:53.338820 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1b0b04f5-c476-46be-8b83-32da24b90516 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:20:53.339746 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1b0b04f5-c476-46be-8b83-32da24b90516 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:20:53.487041 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-1b0b04f5-c476-46be-8b83-32da24b90516 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c85602851244d4a632b9c861eb4416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45cb377c6a9a43b3b91c99a64e37f1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:20:53.496235 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-1b0b04f5-c476-46be-8b83-32da24b90516 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "GET /compute/v2.1/servers/ec15d899-3167-4bce-9b78-f8d8b15455b3" status: 200 len: 1510 microversion: 2.1 time: 0.174777 Oct 22 21:20:53.505447 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2729/5443] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:20:53 2022] GET /compute/v2.1/servers/ec15d899-3167-4bce-9b78-f8d8b15455b3 => generated 1510 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:20:53.956869 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-44eb8088-f4a0-4f04-94f9-00bc72effb23 tempest-VolumesGetTestJSON-1888422140 tempest-VolumesGetTestJSON-1888422140-project] Calling method '.version_select at 0x7fd39ef9f310>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:20:54.009663 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-44eb8088-f4a0-4f04-94f9-00bc72effb23 tempest-VolumesGetTestJSON-1888422140 tempest-VolumesGetTestJSON-1888422140-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/26ae2ccb-78e1-45c7-a98a-8f07fca7729f" status: 200 len: 347 microversion: 2.1 time: 0.056953 Oct 22 21:20:54.010345 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2715/5444] 10.222.0.18 () {58 vars in 1245 bytes} [Sat Oct 22 21:20:53 2022] GET /compute/v2.1/os-volumes/26ae2ccb-78e1-45c7-a98a-8f07fca7729f => generated 347 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 21:20:54.025171 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-eaae55c8-b60c-4b1e-bfb6-d608e84996ee tempest-VolumesGetTestJSON-1888422140 tempest-VolumesGetTestJSON-1888422140-project] Calling method '.version_select at 0x7fd39c44d790>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:20:54.078061 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-eaae55c8-b60c-4b1e-bfb6-d608e84996ee tempest-VolumesGetTestJSON-1888422140 tempest-VolumesGetTestJSON-1888422140-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/26ae2ccb-78e1-45c7-a98a-8f07fca7729f" status: 200 len: 347 microversion: 2.1 time: 0.057864 Oct 22 21:20:54.078798 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2730/5445] 10.222.0.18 () {58 vars in 1245 bytes} [Sat Oct 22 21:20:54 2022] GET /compute/v2.1/os-volumes/26ae2ccb-78e1-45c7-a98a-8f07fca7729f => generated 347 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:20:54.093696 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-43f01aad-e49d-45d2-92ad-64c5de6a0708 tempest-VolumesGetTestJSON-1888422140 tempest-VolumesGetTestJSON-1888422140-project] Calling method '.version_select at 0x7fd39ef1c820>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:20:54.167423 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-43f01aad-e49d-45d2-92ad-64c5de6a0708 tempest-VolumesGetTestJSON-1888422140 tempest-VolumesGetTestJSON-1888422140-project] 10.222.0.18 "DELETE /compute/v2.1/os-volumes/26ae2ccb-78e1-45c7-a98a-8f07fca7729f" status: 202 len: 0 microversion: 2.1 time: 0.078528 Oct 22 21:20:54.168222 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2716/5446] 10.222.0.18 () {58 vars in 1248 bytes} [Sat Oct 22 21:20:54 2022] DELETE /compute/v2.1/os-volumes/26ae2ccb-78e1-45c7-a98a-8f07fca7729f => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 21:20:54.177071 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-79d330d1-ac1f-4142-93f1-0be9846de3d9 tempest-VolumesGetTestJSON-1888422140 tempest-VolumesGetTestJSON-1888422140-project] Calling method '.version_select at 0x7fd39c4453a0>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:20:54.227463 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-79d330d1-ac1f-4142-93f1-0be9846de3d9 tempest-VolumesGetTestJSON-1888422140 tempest-VolumesGetTestJSON-1888422140-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/26ae2ccb-78e1-45c7-a98a-8f07fca7729f" status: 200 len: 346 microversion: 2.1 time: 0.054432 Oct 22 21:20:54.234962 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2731/5447] 10.222.0.18 () {58 vars in 1245 bytes} [Sat Oct 22 21:20:54 2022] GET /compute/v2.1/os-volumes/26ae2ccb-78e1-45c7-a98a-8f07fca7729f => generated 346 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:20:54.520061 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-4b8af78a-0b12-4bc4-ae99-bb142ac3c40c tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:20:54.520912 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-4b8af78a-0b12-4bc4-ae99-bb142ac3c40c tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: ec15d899-3167-4bce-9b78-f8d8b15455b3] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:20:54.527154 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4b8af78a-0b12-4bc4-ae99-bb142ac3c40c tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:20:54.527820 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4b8af78a-0b12-4bc4-ae99-bb142ac3c40c tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:20:54.528514 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4b8af78a-0b12-4bc4-ae99-bb142ac3c40c tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:20:54.529256 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4b8af78a-0b12-4bc4-ae99-bb142ac3c40c tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:20:54.529708 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4b8af78a-0b12-4bc4-ae99-bb142ac3c40c tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:20:54.530636 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4b8af78a-0b12-4bc4-ae99-bb142ac3c40c tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:20:54.685539 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-4b8af78a-0b12-4bc4-ae99-bb142ac3c40c tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c85602851244d4a632b9c861eb4416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45cb377c6a9a43b3b91c99a64e37f1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:20:54.694758 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-4b8af78a-0b12-4bc4-ae99-bb142ac3c40c tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "GET /compute/v2.1/servers/ec15d899-3167-4bce-9b78-f8d8b15455b3" status: 200 len: 1510 microversion: 2.1 time: 0.178719 Oct 22 21:20:54.695388 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2717/5448] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:20:54 2022] GET /compute/v2.1/servers/ec15d899-3167-4bce-9b78-f8d8b15455b3 => generated 1510 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:20:55.244523 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-54859487-500e-4dbb-a505-01ca40f595d2 tempest-VolumesGetTestJSON-1888422140 tempest-VolumesGetTestJSON-1888422140-project] Calling method '.version_select at 0x7fd39c468dc0>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:20:55.278611 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.wsgi [None req-54859487-500e-4dbb-a505-01ca40f595d2 tempest-VolumesGetTestJSON-1888422140 tempest-VolumesGetTestJSON-1888422140-project] HTTP exception thrown: Volume 26ae2ccb-78e1-45c7-a98a-8f07fca7729f could not be found. Oct 22 21:20:55.281218 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-54859487-500e-4dbb-a505-01ca40f595d2 tempest-VolumesGetTestJSON-1888422140 tempest-VolumesGetTestJSON-1888422140-project] Request method failure captured: Oct 22 21:20:55.281218 ncdv-master-1 devstack@n-api.service[138745]: request: GET /compute/v2.1/os-volumes/26ae2ccb-78e1-45c7-a98a-8f07fca7729f HTTP/1.1 Oct 22 21:20:55.281218 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 21:20:55.281218 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 21:20:55.281218 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 21:20:55.281218 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 0 Oct 22 21:20:55.281218 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 21:20:55.281218 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 21:20:55.281218 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 21:20:55.281218 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 21:20:55.281218 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVF60zdavWNquf1HTEomNSrmokHc-XJFZKj4wR12aHym-8vvSopau_dLr5cd3LJy_jjW3WJRzsLdyMN9j5XGNRAdNBceMaIg6bYjslYMJ8XH4MXytlJEV26mf8DC-Jc3jwlRV53eMcy5ffPVYdCeI1LZWYnhi6fDfcaixoeKKXBhV4Zk Oct 22 21:20:55.281218 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 21:20:55.281218 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 21:20:55.281218 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 21:20:55.281218 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 21:20:55.281218 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 21:20:55.281218 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 21:20:55.281218 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: 1814af9a0d8d48e0b73dbfde03d495b1 Oct 22 21:20:55.281218 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-VolumesGetTestJSON-1888422140 Oct 22 21:20:55.281218 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 21:20:55.281218 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 21:20:55.281218 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_1814af9a0d8d48e0b73dbfde03d495b1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1814af9a0d8d48e0b73dbfde03d495b1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/1814af9a0d8d48e0b73dbfde03d495b1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1814af9a0d8d48e0b73dbfde03d495b1"}]}] Oct 22 21:20:55.281218 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-VolumesGetTestJSON-1888422140 Oct 22 21:20:55.281218 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: 1814af9a0d8d48e0b73dbfde03d495b1 Oct 22 21:20:55.281218 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-VolumesGetTestJSON-1888422140 Oct 22 21:20:55.281218 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-VolumesGetTestJSON-1888422140-project Oct 22 21:20:55.281218 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 21:20:55.281218 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 21:20:55.281218 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: b9248fe1a6fc4fe995378573e5f55b83 Oct 22 21:20:55.281218 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-VolumesGetTestJSON-1888422140-project Oct 22 21:20:55.281218 ncdv-master-1 devstack@n-api.service[138745]: method: Oct 22 21:20:55.281218 ncdv-master-1 devstack@n-api.service[138745]: exception: Volume 26ae2ccb-78e1-45c7-a98a-8f07fca7729f could not be found. Oct 22 21:20:55.281218 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'id': '26ae2ccb-78e1-45c7-a98a-8f07fca7729f'} Oct 22 21:20:55.281218 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:20:55.281218 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:20:55.281218 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 22 21:20:55.281218 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 22 21:20:55.281218 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 22 21:20:55.281218 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 22 21:20:55.281218 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 22 21:20:55.281218 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 22 21:20:55.281218 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 22 21:20:55.281218 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 22 21:20:55.281218 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 22 21:20:55.281218 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 22 21:20:55.281218 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 22 21:20:55.281218 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 22 21:20:55.281218 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 22 21:20:55.281218 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 22 21:20:55.281218 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 26ae2ccb-78e1-45c7-a98a-8f07fca7729f could not be found. (HTTP 404) (Request-ID: req-6cb250c1-331f-4f5d-b0d5-592d0abfde84) Oct 22 21:20:55.281218 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:20:55.281218 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:20:55.281218 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:20:55.281218 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:20:55.281218 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 22 21:20:55.281218 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 22 21:20:55.281218 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 22 21:20:55.281218 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 22 21:20:55.281218 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 22 21:20:55.281218 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 22 21:20:55.281218 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 22 21:20:55.281218 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 22 21:20:55.281218 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 22 21:20:55.287309 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 22 21:20:55.287309 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 22 21:20:55.287309 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 22 21:20:55.287309 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 22 21:20:55.287309 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 22 21:20:55.287309 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 22 21:20:55.287309 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 22 21:20:55.287309 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 22 21:20:55.287309 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 22 21:20:55.287309 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 22 21:20:55.287309 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 22 21:20:55.287309 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 22 21:20:55.287309 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 22 21:20:55.287309 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 26ae2ccb-78e1-45c7-a98a-8f07fca7729f could not be found. Oct 22 21:20:55.287309 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:20:55.287309 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:20:55.287309 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:20:55.287309 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:20:55.287309 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:20:55.287309 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:20:55.287309 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:20:55.287309 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:20:55.287309 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 22 21:20:55.287309 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 22 21:20:55.287309 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:20:55.287309 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:20:55.287309 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 22 21:20:55.287309 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:20:55.287309 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 26ae2ccb-78e1-45c7-a98a-8f07fca7729f could not be found. Oct 22 21:20:55.287309 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:20:55.287309 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:20:55.287309 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:20:55.287309 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:20:55.287309 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:20:55.287309 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:20:55.287309 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:20:55.287309 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:20:55.287309 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 26ae2ccb-78e1-45c7-a98a-8f07fca7729f could not be found. Oct 22 21:20:55.287309 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:20:55.287309 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-54859487-500e-4dbb-a505-01ca40f595d2 tempest-VolumesGetTestJSON-1888422140 tempest-VolumesGetTestJSON-1888422140-project] Returning 404 to user: Volume 26ae2ccb-78e1-45c7-a98a-8f07fca7729f could not be found. {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:20:55.287309 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-54859487-500e-4dbb-a505-01ca40f595d2 tempest-VolumesGetTestJSON-1888422140 tempest-VolumesGetTestJSON-1888422140-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/26ae2ccb-78e1-45c7-a98a-8f07fca7729f" status: 404 len: 109 microversion: 2.1 time: 0.044379 Oct 22 21:20:55.287309 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2732/5449] 10.222.0.18 () {58 vars in 1245 bytes} [Sat Oct 22 21:20:55 2022] GET /compute/v2.1/os-volumes/26ae2ccb-78e1-45c7-a98a-8f07fca7729f => generated 109 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 21:20:55.719757 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-2427cb5f-47b0-4485-b435-81af941fd048 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:20:55.720386 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-2427cb5f-47b0-4485-b435-81af941fd048 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: ec15d899-3167-4bce-9b78-f8d8b15455b3] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:20:55.731792 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2427cb5f-47b0-4485-b435-81af941fd048 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:20:55.736786 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2427cb5f-47b0-4485-b435-81af941fd048 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:20:55.737281 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2427cb5f-47b0-4485-b435-81af941fd048 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:20:55.738024 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2427cb5f-47b0-4485-b435-81af941fd048 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:20:55.738499 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2427cb5f-47b0-4485-b435-81af941fd048 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:20:55.738938 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2427cb5f-47b0-4485-b435-81af941fd048 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:20:55.957179 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-2427cb5f-47b0-4485-b435-81af941fd048 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c85602851244d4a632b9c861eb4416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45cb377c6a9a43b3b91c99a64e37f1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:20:55.965861 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-2427cb5f-47b0-4485-b435-81af941fd048 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "GET /compute/v2.1/servers/ec15d899-3167-4bce-9b78-f8d8b15455b3" status: 200 len: 1510 microversion: 2.1 time: 0.251564 Oct 22 21:20:55.967191 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2718/5450] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:20:55 2022] GET /compute/v2.1/servers/ec15d899-3167-4bce-9b78-f8d8b15455b3 => generated 1510 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:20:56.991658 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-4589def3-8376-4ca1-ac3d-92b5300fc282 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:20:56.993399 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-4589def3-8376-4ca1-ac3d-92b5300fc282 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: ec15d899-3167-4bce-9b78-f8d8b15455b3] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:20:57.006753 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4589def3-8376-4ca1-ac3d-92b5300fc282 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:20:57.007373 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4589def3-8376-4ca1-ac3d-92b5300fc282 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:20:57.007879 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4589def3-8376-4ca1-ac3d-92b5300fc282 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:20:57.008791 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4589def3-8376-4ca1-ac3d-92b5300fc282 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:20:57.009265 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4589def3-8376-4ca1-ac3d-92b5300fc282 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:20:57.010004 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4589def3-8376-4ca1-ac3d-92b5300fc282 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:20:57.254550 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-4589def3-8376-4ca1-ac3d-92b5300fc282 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c85602851244d4a632b9c861eb4416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45cb377c6a9a43b3b91c99a64e37f1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:20:57.263135 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-4589def3-8376-4ca1-ac3d-92b5300fc282 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "GET /compute/v2.1/servers/ec15d899-3167-4bce-9b78-f8d8b15455b3" status: 200 len: 1510 microversion: 2.1 time: 0.276799 Oct 22 21:20:57.264422 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2733/5451] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:20:56 2022] GET /compute/v2.1/servers/ec15d899-3167-4bce-9b78-f8d8b15455b3 => generated 1510 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:20:58.288703 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-1d993152-019f-4056-a546-b65960ce01c0 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:20:58.289317 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-1d993152-019f-4056-a546-b65960ce01c0 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: ec15d899-3167-4bce-9b78-f8d8b15455b3] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:20:58.301825 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1d993152-019f-4056-a546-b65960ce01c0 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:20:58.302286 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1d993152-019f-4056-a546-b65960ce01c0 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:20:58.304976 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1d993152-019f-4056-a546-b65960ce01c0 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:20:58.306330 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1d993152-019f-4056-a546-b65960ce01c0 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:20:58.306984 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1d993152-019f-4056-a546-b65960ce01c0 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:20:58.309028 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1d993152-019f-4056-a546-b65960ce01c0 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:20:58.547022 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-1d993152-019f-4056-a546-b65960ce01c0 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c85602851244d4a632b9c861eb4416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45cb377c6a9a43b3b91c99a64e37f1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:20:58.558489 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-1d993152-019f-4056-a546-b65960ce01c0 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "GET /compute/v2.1/servers/ec15d899-3167-4bce-9b78-f8d8b15455b3" status: 200 len: 1510 microversion: 2.1 time: 0.273690 Oct 22 21:20:58.560266 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2719/5452] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:20:58 2022] GET /compute/v2.1/servers/ec15d899-3167-4bce-9b78-f8d8b15455b3 => generated 1510 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:20:59.584434 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-71b9f91a-f687-4b0c-8a53-9d498fa6a65b tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:20:59.585082 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-71b9f91a-f687-4b0c-8a53-9d498fa6a65b tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: ec15d899-3167-4bce-9b78-f8d8b15455b3] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:20:59.600894 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-71b9f91a-f687-4b0c-8a53-9d498fa6a65b tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:20:59.601521 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-71b9f91a-f687-4b0c-8a53-9d498fa6a65b tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:20:59.604300 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-71b9f91a-f687-4b0c-8a53-9d498fa6a65b tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:20:59.605279 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-71b9f91a-f687-4b0c-8a53-9d498fa6a65b tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:20:59.606596 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-71b9f91a-f687-4b0c-8a53-9d498fa6a65b tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:20:59.608630 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-71b9f91a-f687-4b0c-8a53-9d498fa6a65b tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:20:59.948322 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-71b9f91a-f687-4b0c-8a53-9d498fa6a65b tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c85602851244d4a632b9c861eb4416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45cb377c6a9a43b3b91c99a64e37f1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:20:59.961108 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-71b9f91a-f687-4b0c-8a53-9d498fa6a65b tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "GET /compute/v2.1/servers/ec15d899-3167-4bce-9b78-f8d8b15455b3" status: 200 len: 1510 microversion: 2.1 time: 0.379958 Oct 22 21:20:59.962258 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2734/5453] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:20:59 2022] GET /compute/v2.1/servers/ec15d899-3167-4bce-9b78-f8d8b15455b3 => generated 1510 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:21:00.986666 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-a4dbfeab-6762-496f-856e-38a051b4f37b tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:21:00.987389 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-a4dbfeab-6762-496f-856e-38a051b4f37b tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: ec15d899-3167-4bce-9b78-f8d8b15455b3] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:21:00.997751 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a4dbfeab-6762-496f-856e-38a051b4f37b tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:21:01.000465 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a4dbfeab-6762-496f-856e-38a051b4f37b tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:21:01.001427 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a4dbfeab-6762-496f-856e-38a051b4f37b tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:21:01.002377 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a4dbfeab-6762-496f-856e-38a051b4f37b tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:21:01.003107 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a4dbfeab-6762-496f-856e-38a051b4f37b tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:21:01.003963 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a4dbfeab-6762-496f-856e-38a051b4f37b tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:21:01.012015 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:21:01.210440 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-a4dbfeab-6762-496f-856e-38a051b4f37b tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c85602851244d4a632b9c861eb4416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45cb377c6a9a43b3b91c99a64e37f1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:21:01.218826 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-a4dbfeab-6762-496f-856e-38a051b4f37b tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "GET /compute/v2.1/servers/ec15d899-3167-4bce-9b78-f8d8b15455b3" status: 200 len: 1510 microversion: 2.1 time: 0.236301 Oct 22 21:21:01.232847 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2720/5454] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:21:00 2022] GET /compute/v2.1/servers/ec15d899-3167-4bce-9b78-f8d8b15455b3 => generated 1510 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:21:02.244838 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-5df64284-ef1b-47c5-b7cf-d9f4c90910ed tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:21:02.246633 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-5df64284-ef1b-47c5-b7cf-d9f4c90910ed tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: ec15d899-3167-4bce-9b78-f8d8b15455b3] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:21:02.255437 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5df64284-ef1b-47c5-b7cf-d9f4c90910ed tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:21:02.256368 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5df64284-ef1b-47c5-b7cf-d9f4c90910ed tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:21:02.257185 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5df64284-ef1b-47c5-b7cf-d9f4c90910ed tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:21:02.259151 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5df64284-ef1b-47c5-b7cf-d9f4c90910ed tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:21:02.259872 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5df64284-ef1b-47c5-b7cf-d9f4c90910ed tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:21:02.260529 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5df64284-ef1b-47c5-b7cf-d9f4c90910ed tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:21:02.468431 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-5df64284-ef1b-47c5-b7cf-d9f4c90910ed tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c85602851244d4a632b9c861eb4416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45cb377c6a9a43b3b91c99a64e37f1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:21:02.481640 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-5df64284-ef1b-47c5-b7cf-d9f4c90910ed tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "GET /compute/v2.1/servers/ec15d899-3167-4bce-9b78-f8d8b15455b3" status: 200 len: 1510 microversion: 2.1 time: 0.241163 Oct 22 21:21:02.498262 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2735/5455] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:21:02 2022] GET /compute/v2.1/servers/ec15d899-3167-4bce-9b78-f8d8b15455b3 => generated 1510 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:21:03.511681 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-9d3f70b8-79c1-488e-a7f2-ccfc252c899d tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:21:03.513690 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-9d3f70b8-79c1-488e-a7f2-ccfc252c899d tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: ec15d899-3167-4bce-9b78-f8d8b15455b3] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:21:03.525844 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9d3f70b8-79c1-488e-a7f2-ccfc252c899d tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:21:03.526359 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9d3f70b8-79c1-488e-a7f2-ccfc252c899d tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:21:03.529947 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9d3f70b8-79c1-488e-a7f2-ccfc252c899d tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:21:03.530843 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9d3f70b8-79c1-488e-a7f2-ccfc252c899d tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:21:03.531443 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9d3f70b8-79c1-488e-a7f2-ccfc252c899d tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:21:03.531827 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9d3f70b8-79c1-488e-a7f2-ccfc252c899d tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:21:03.728402 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-9d3f70b8-79c1-488e-a7f2-ccfc252c899d tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c85602851244d4a632b9c861eb4416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45cb377c6a9a43b3b91c99a64e37f1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:21:03.739868 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-9d3f70b8-79c1-488e-a7f2-ccfc252c899d tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "GET /compute/v2.1/servers/ec15d899-3167-4bce-9b78-f8d8b15455b3" status: 200 len: 1510 microversion: 2.1 time: 0.232115 Oct 22 21:21:03.740624 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2721/5456] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:21:03 2022] GET /compute/v2.1/servers/ec15d899-3167-4bce-9b78-f8d8b15455b3 => generated 1510 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:21:04.766953 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-953bc64e-8153-4203-bd0f-d0e4340f7848 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:21:04.769152 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-953bc64e-8153-4203-bd0f-d0e4340f7848 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: ec15d899-3167-4bce-9b78-f8d8b15455b3] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:21:04.780011 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-953bc64e-8153-4203-bd0f-d0e4340f7848 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:21:04.780712 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-953bc64e-8153-4203-bd0f-d0e4340f7848 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:21:04.781371 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-953bc64e-8153-4203-bd0f-d0e4340f7848 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:21:04.782664 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-953bc64e-8153-4203-bd0f-d0e4340f7848 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:21:04.783648 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-953bc64e-8153-4203-bd0f-d0e4340f7848 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:21:04.784189 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-953bc64e-8153-4203-bd0f-d0e4340f7848 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:21:04.789584 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell1:SELECT=94 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:21:05.049348 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-953bc64e-8153-4203-bd0f-d0e4340f7848 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c85602851244d4a632b9c861eb4416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45cb377c6a9a43b3b91c99a64e37f1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:21:05.059554 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-953bc64e-8153-4203-bd0f-d0e4340f7848 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "GET /compute/v2.1/servers/ec15d899-3167-4bce-9b78-f8d8b15455b3" status: 200 len: 1510 microversion: 2.1 time: 0.298603 Oct 22 21:21:05.061292 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2736/5457] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:21:04 2022] GET /compute/v2.1/servers/ec15d899-3167-4bce-9b78-f8d8b15455b3 => generated 1510 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:21:06.085375 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-dd3f9e1f-eb54-4b7f-a6c3-e0862478e968 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:21:06.086799 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-dd3f9e1f-eb54-4b7f-a6c3-e0862478e968 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: ec15d899-3167-4bce-9b78-f8d8b15455b3] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:21:06.094661 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:21:06.110588 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-dd3f9e1f-eb54-4b7f-a6c3-e0862478e968 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:21:06.112503 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-dd3f9e1f-eb54-4b7f-a6c3-e0862478e968 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:21:06.113142 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-dd3f9e1f-eb54-4b7f-a6c3-e0862478e968 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:21:06.115652 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-dd3f9e1f-eb54-4b7f-a6c3-e0862478e968 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:21:06.116414 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-dd3f9e1f-eb54-4b7f-a6c3-e0862478e968 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:21:06.118899 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-dd3f9e1f-eb54-4b7f-a6c3-e0862478e968 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:21:06.487806 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-dd3f9e1f-eb54-4b7f-a6c3-e0862478e968 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c85602851244d4a632b9c861eb4416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45cb377c6a9a43b3b91c99a64e37f1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:21:06.502996 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-dd3f9e1f-eb54-4b7f-a6c3-e0862478e968 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "GET /compute/v2.1/servers/ec15d899-3167-4bce-9b78-f8d8b15455b3" status: 200 len: 1510 microversion: 2.1 time: 0.422331 Oct 22 21:21:06.518903 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2722/5458] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:21:06 2022] GET /compute/v2.1/servers/ec15d899-3167-4bce-9b78-f8d8b15455b3 => generated 1510 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:21:07.544957 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-befc52b0-c55a-4bcb-bc4a-dda18c2dedf6 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:21:07.546403 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-befc52b0-c55a-4bcb-bc4a-dda18c2dedf6 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: ec15d899-3167-4bce-9b78-f8d8b15455b3] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:21:07.549787 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_api:SELECT=28 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:21:07.557852 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-befc52b0-c55a-4bcb-bc4a-dda18c2dedf6 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:21:07.558825 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-befc52b0-c55a-4bcb-bc4a-dda18c2dedf6 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:21:07.559458 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-befc52b0-c55a-4bcb-bc4a-dda18c2dedf6 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:21:07.560411 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-befc52b0-c55a-4bcb-bc4a-dda18c2dedf6 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:21:07.561045 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-befc52b0-c55a-4bcb-bc4a-dda18c2dedf6 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:21:07.561636 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-befc52b0-c55a-4bcb-bc4a-dda18c2dedf6 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:21:07.956805 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-befc52b0-c55a-4bcb-bc4a-dda18c2dedf6 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c85602851244d4a632b9c861eb4416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45cb377c6a9a43b3b91c99a64e37f1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:21:07.972511 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-befc52b0-c55a-4bcb-bc4a-dda18c2dedf6 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "GET /compute/v2.1/servers/ec15d899-3167-4bce-9b78-f8d8b15455b3" status: 200 len: 1510 microversion: 2.1 time: 0.431528 Oct 22 21:21:07.988432 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2737/5459] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:21:07 2022] GET /compute/v2.1/servers/ec15d899-3167-4bce-9b78-f8d8b15455b3 => generated 1510 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:21:09.003119 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-3eb991f0-990e-4bb5-b992-c6428487633c tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:21:09.003941 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-3eb991f0-990e-4bb5-b992-c6428487633c tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: ec15d899-3167-4bce-9b78-f8d8b15455b3] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:21:09.018699 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3eb991f0-990e-4bb5-b992-c6428487633c tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:21:09.021779 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3eb991f0-990e-4bb5-b992-c6428487633c tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:21:09.023136 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3eb991f0-990e-4bb5-b992-c6428487633c tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:21:09.026274 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3eb991f0-990e-4bb5-b992-c6428487633c tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:21:09.028035 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3eb991f0-990e-4bb5-b992-c6428487633c tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:21:09.030729 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3eb991f0-990e-4bb5-b992-c6428487633c tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:21:09.331146 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-3eb991f0-990e-4bb5-b992-c6428487633c tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c85602851244d4a632b9c861eb4416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45cb377c6a9a43b3b91c99a64e37f1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:21:09.342515 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-3eb991f0-990e-4bb5-b992-c6428487633c tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "GET /compute/v2.1/servers/ec15d899-3167-4bce-9b78-f8d8b15455b3" status: 200 len: 1510 microversion: 2.1 time: 0.343603 Oct 22 21:21:09.345142 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2723/5460] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:21:08 2022] GET /compute/v2.1/servers/ec15d899-3167-4bce-9b78-f8d8b15455b3 => generated 1510 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:21:09.908020 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-3abc6a2a-5d44-4a0a-af07-d8dde7b49d7e tempest-TestAggregatesBasicOps-351840247 tempest-TestAggregatesBasicOps-351840247-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-aggregate-scenario-2055616535", "availability_zone": "foo_zone"}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:21:09.913316 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.objects.aggregate [None req-3abc6a2a-5d44-4a0a-af07-d8dde7b49d7e tempest-TestAggregatesBasicOps-351840247 tempest-TestAggregatesBasicOps-351840247-project-admin] Generated uuid 31d02a0f-b6a6-4b89-a502-2d6a743ad665 for aggregate {{(pid=138745) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 22 21:21:09.920493 ncdv-master-1 devstack@n-api.service[138745]: ERROR oslo.messaging._drivers.impl_rabbit [None req-3abc6a2a-5d44-4a0a-af07-d8dde7b49d7e tempest-TestAggregatesBasicOps-351840247 tempest-TestAggregatesBasicOps-351840247-project-admin] [fdffe6b9-9d4b-45b8-9714-1ef9d5132dcd] AMQP server on 10.222.0.18:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 22 21:21:10.371562 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-be131f1e-b879-4554-b770-dac1c2acd82a tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:21:10.372910 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-be131f1e-b879-4554-b770-dac1c2acd82a tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: ec15d899-3167-4bce-9b78-f8d8b15455b3] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:21:10.379990 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-be131f1e-b879-4554-b770-dac1c2acd82a tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:21:10.380479 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-be131f1e-b879-4554-b770-dac1c2acd82a tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:21:10.380915 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-be131f1e-b879-4554-b770-dac1c2acd82a tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:21:10.381979 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-be131f1e-b879-4554-b770-dac1c2acd82a tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:21:10.382632 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-be131f1e-b879-4554-b770-dac1c2acd82a tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:21:10.383054 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-be131f1e-b879-4554-b770-dac1c2acd82a tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:21:10.614322 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-be131f1e-b879-4554-b770-dac1c2acd82a tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c85602851244d4a632b9c861eb4416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45cb377c6a9a43b3b91c99a64e37f1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:21:10.626425 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-be131f1e-b879-4554-b770-dac1c2acd82a tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "GET /compute/v2.1/servers/ec15d899-3167-4bce-9b78-f8d8b15455b3" status: 200 len: 1510 microversion: 2.1 time: 0.258507 Oct 22 21:21:10.627836 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2724/5461] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:21:10 2022] GET /compute/v2.1/servers/ec15d899-3167-4bce-9b78-f8d8b15455b3 => generated 1510 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:21:10.937998 ncdv-master-1 devstack@n-api.service[138745]: INFO oslo.messaging._drivers.impl_rabbit [None req-3abc6a2a-5d44-4a0a-af07-d8dde7b49d7e tempest-TestAggregatesBasicOps-351840247 tempest-TestAggregatesBasicOps-351840247-project-admin] [fdffe6b9-9d4b-45b8-9714-1ef9d5132dcd] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 53890. Oct 22 21:21:10.973612 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-3abc6a2a-5d44-4a0a-af07-d8dde7b49d7e tempest-TestAggregatesBasicOps-351840247 tempest-TestAggregatesBasicOps-351840247-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates" status: 200 len: 209 microversion: 2.1 time: 1.319123 Oct 22 21:21:10.981040 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2738/5462] 10.222.0.18 () {60 vars in 1164 bytes} [Sat Oct 22 21:21:09 2022] POST /compute/v2.1/os-aggregates => generated 209 bytes in 1321 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:21:10.986258 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-15259b65-e71e-48c9-a65e-d36a587783b0 tempest-TestAggregatesBasicOps-351840247 tempest-TestAggregatesBasicOps-351840247-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"meta_key": "meta_value"}}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:21:11.023970 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-15259b65-e71e-48c9-a65e-d36a587783b0 tempest-TestAggregatesBasicOps-351840247 tempest-TestAggregatesBasicOps-351840247-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 319 microversion: 2.1 time: 0.041256 Oct 22 21:21:11.025573 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2725/5463] 10.222.0.18 () {60 vars in 1194 bytes} [Sat Oct 22 21:21:10 2022] POST /compute/v2.1/os-aggregates/19/action => generated 319 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:21:11.037800 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-12b8e420-fed9-443c-a8c8-634cea012c97 tempest-TestAggregatesBasicOps-351840247 tempest-TestAggregatesBasicOps-351840247-project-admin] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:21:11.041597 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-12b8e420-fed9-443c-a8c8-634cea012c97 tempest-TestAggregatesBasicOps-351840247 tempest-TestAggregatesBasicOps-351840247-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:21:11.042276 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-12b8e420-fed9-443c-a8c8-634cea012c97 tempest-TestAggregatesBasicOps-351840247 tempest-TestAggregatesBasicOps-351840247-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:21:11.042739 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-12b8e420-fed9-443c-a8c8-634cea012c97 tempest-TestAggregatesBasicOps-351840247 tempest-TestAggregatesBasicOps-351840247-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:21:11.043530 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-12b8e420-fed9-443c-a8c8-634cea012c97 tempest-TestAggregatesBasicOps-351840247 tempest-TestAggregatesBasicOps-351840247-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:21:11.044045 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-12b8e420-fed9-443c-a8c8-634cea012c97 tempest-TestAggregatesBasicOps-351840247 tempest-TestAggregatesBasicOps-351840247-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:21:11.044730 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-12b8e420-fed9-443c-a8c8-634cea012c97 tempest-TestAggregatesBasicOps-351840247 tempest-TestAggregatesBasicOps-351840247-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:21:11.076865 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-12b8e420-fed9-443c-a8c8-634cea012c97 tempest-TestAggregatesBasicOps-351840247 tempest-TestAggregatesBasicOps-351840247-project-admin] 10.222.0.18 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.043311 Oct 22 21:21:11.084473 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2739/5464] 10.222.0.18 () {58 vars in 1176 bytes} [Sat Oct 22 21:21:11 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:21:11.089779 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-9a63feb1-021e-40e0-8e31-4bdcfe1e6c23 tempest-TestAggregatesBasicOps-351840247 tempest-TestAggregatesBasicOps-351840247-project-admin] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:21:11.105173 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-9a63feb1-021e-40e0-8e31-4bdcfe1e6c23 tempest-TestAggregatesBasicOps-351840247 tempest-TestAggregatesBasicOps-351840247-project-admin] 10.222.0.18 "GET /compute/v2.1/os-aggregates" status: 200 len: 298 microversion: 2.1 time: 0.019599 Oct 22 21:21:11.106121 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2726/5465] 10.222.0.18 () {58 vars in 1143 bytes} [Sat Oct 22 21:21:11 2022] GET /compute/v2.1/os-aggregates => generated 298 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 21:21:11.120910 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-6faceb41-0b52-48c5-b33c-f71a707dd277 tempest-TestAggregatesBasicOps-351840247 tempest-TestAggregatesBasicOps-351840247-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch2-master-1"}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:21:11.133148 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6faceb41-0b52-48c5-b33c-f71a707dd277 tempest-TestAggregatesBasicOps-351840247 tempest-TestAggregatesBasicOps-351840247-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:21:11.133659 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6faceb41-0b52-48c5-b33c-f71a707dd277 tempest-TestAggregatesBasicOps-351840247 tempest-TestAggregatesBasicOps-351840247-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:21:11.134141 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6faceb41-0b52-48c5-b33c-f71a707dd277 tempest-TestAggregatesBasicOps-351840247 tempest-TestAggregatesBasicOps-351840247-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:21:11.489211 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-6faceb41-0b52-48c5-b33c-f71a707dd277 tempest-TestAggregatesBasicOps-351840247 tempest-TestAggregatesBasicOps-351840247-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 310 microversion: 2.1 time: 0.373778 Oct 22 21:21:11.489799 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2740/5466] 10.222.0.18 () {60 vars in 1194 bytes} [Sat Oct 22 21:21:11 2022] POST /compute/v2.1/os-aggregates/19/action => generated 310 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:21:11.502623 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-9d51362e-4fe9-4c90-bd47-0a76280e1f3c tempest-TestAggregatesBasicOps-351840247 tempest-TestAggregatesBasicOps-351840247-project-admin] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:21:11.512833 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-9d51362e-4fe9-4c90-bd47-0a76280e1f3c tempest-TestAggregatesBasicOps-351840247 tempest-TestAggregatesBasicOps-351840247-project-admin] 10.222.0.18 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 310 microversion: 2.1 time: 0.013940 Oct 22 21:21:11.513458 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2727/5467] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Oct 22 21:21:11 2022] GET /compute/v2.1/os-aggregates/19 => generated 310 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:21:11.529006 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-bb1efdb3-1aad-41e4-938b-3c9d55d34aac tempest-TestAggregatesBasicOps-351840247 tempest-TestAggregatesBasicOps-351840247-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-renamed-aggregate-scenario-424425263", "availability_zone": "foo_zone"}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:21:11.575024 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-bb1efdb3-1aad-41e4-938b-3c9d55d34aac tempest-TestAggregatesBasicOps-351840247 tempest-TestAggregatesBasicOps-351840247-project-admin] 10.222.0.18 "PUT /compute/v2.1/os-aggregates/19" status: 200 len: 341 microversion: 2.1 time: 0.050175 Oct 22 21:21:11.576012 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2741/5468] 10.222.0.18 () {60 vars in 1173 bytes} [Sat Oct 22 21:21:11 2022] PUT /compute/v2.1/os-aggregates/19 => generated 341 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:21:11.587723 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-59668552-326f-4d1e-821e-ebc8f46f6d6f tempest-TestAggregatesBasicOps-351840247 tempest-TestAggregatesBasicOps-351840247-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"foo": "bar"}}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:21:11.614154 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-59668552-326f-4d1e-821e-ebc8f46f6d6f tempest-TestAggregatesBasicOps-351840247 tempest-TestAggregatesBasicOps-351840247-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 355 microversion: 2.1 time: 0.030468 Oct 22 21:21:11.615313 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2728/5469] 10.222.0.18 () {60 vars in 1194 bytes} [Sat Oct 22 21:21:11 2022] POST /compute/v2.1/os-aggregates/19/action => generated 355 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:21:11.627212 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-69168dcc-2b85-4049-88d1-4c85b9c070b5 tempest-TestAggregatesBasicOps-351840247 tempest-TestAggregatesBasicOps-351840247-project-admin] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:21:11.641831 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-69168dcc-2b85-4049-88d1-4c85b9c070b5 tempest-TestAggregatesBasicOps-351840247 tempest-TestAggregatesBasicOps-351840247-project-admin] 10.222.0.18 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 355 microversion: 2.1 time: 0.018912 Oct 22 21:21:11.642428 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2742/5470] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Oct 22 21:21:11 2022] GET /compute/v2.1/os-aggregates/19 => generated 355 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:21:11.651968 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-2ef4bc8b-b181-4a66-90f7-6fdc8f106ac4 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:21:11.652595 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-2ef4bc8b-b181-4a66-90f7-6fdc8f106ac4 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: ec15d899-3167-4bce-9b78-f8d8b15455b3] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:21:11.660305 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-feccfb4c-9c48-4da7-bc63-c870de7a9f00 tempest-TestAggregatesBasicOps-351840247 tempest-TestAggregatesBasicOps-351840247-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch2-master-1"}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:21:11.665030 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2ef4bc8b-b181-4a66-90f7-6fdc8f106ac4 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:21:11.665770 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2ef4bc8b-b181-4a66-90f7-6fdc8f106ac4 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:21:11.666480 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2ef4bc8b-b181-4a66-90f7-6fdc8f106ac4 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:21:11.667230 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2ef4bc8b-b181-4a66-90f7-6fdc8f106ac4 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:21:11.667879 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2ef4bc8b-b181-4a66-90f7-6fdc8f106ac4 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:21:11.668316 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2ef4bc8b-b181-4a66-90f7-6fdc8f106ac4 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:21:11.672494 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-feccfb4c-9c48-4da7-bc63-c870de7a9f00 tempest-TestAggregatesBasicOps-351840247 tempest-TestAggregatesBasicOps-351840247-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:21:11.673008 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-feccfb4c-9c48-4da7-bc63-c870de7a9f00 tempest-TestAggregatesBasicOps-351840247 tempest-TestAggregatesBasicOps-351840247-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:21:11.673467 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-feccfb4c-9c48-4da7-bc63-c870de7a9f00 tempest-TestAggregatesBasicOps-351840247 tempest-TestAggregatesBasicOps-351840247-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:21:11.856805 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-feccfb4c-9c48-4da7-bc63-c870de7a9f00 tempest-TestAggregatesBasicOps-351840247 tempest-TestAggregatesBasicOps-351840247-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 340 microversion: 2.1 time: 0.200020 Oct 22 21:21:11.857698 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2743/5471] 10.222.0.18 () {60 vars in 1194 bytes} [Sat Oct 22 21:21:11 2022] POST /compute/v2.1/os-aggregates/19/action => generated 340 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:21:11.873053 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-f02170ed-d825-4ada-baa4-dafffa6cbe0d tempest-TestAggregatesBasicOps-351840247 tempest-TestAggregatesBasicOps-351840247-project-admin] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:21:11.907468 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-2ef4bc8b-b181-4a66-90f7-6fdc8f106ac4 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c85602851244d4a632b9c861eb4416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45cb377c6a9a43b3b91c99a64e37f1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:21:11.910234 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-f02170ed-d825-4ada-baa4-dafffa6cbe0d tempest-TestAggregatesBasicOps-351840247 tempest-TestAggregatesBasicOps-351840247-project-admin] 10.222.0.18 "DELETE /compute/v2.1/os-aggregates/19" status: 200 len: 0 microversion: 2.1 time: 0.044292 Oct 22 21:21:11.911026 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2744/5472] 10.222.0.18 () {58 vars in 1155 bytes} [Sat Oct 22 21:21:11 2022] DELETE /compute/v2.1/os-aggregates/19 => generated 0 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Oct 22 21:21:11.918989 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-2ef4bc8b-b181-4a66-90f7-6fdc8f106ac4 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "GET /compute/v2.1/servers/ec15d899-3167-4bce-9b78-f8d8b15455b3" status: 200 len: 1514 microversion: 2.1 time: 0.271799 Oct 22 21:21:11.919844 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2729/5473] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:21:11 2022] GET /compute/v2.1/servers/ec15d899-3167-4bce-9b78-f8d8b15455b3 => generated 1514 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:21:12.944319 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-5472a267-136b-49d6-ad09-00a21fe1cca6 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:21:12.944958 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-5472a267-136b-49d6-ad09-00a21fe1cca6 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: ec15d899-3167-4bce-9b78-f8d8b15455b3] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:21:12.951999 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5472a267-136b-49d6-ad09-00a21fe1cca6 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:21:12.952571 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5472a267-136b-49d6-ad09-00a21fe1cca6 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:21:12.953220 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5472a267-136b-49d6-ad09-00a21fe1cca6 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:21:12.954122 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5472a267-136b-49d6-ad09-00a21fe1cca6 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:21:12.954757 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5472a267-136b-49d6-ad09-00a21fe1cca6 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:21:12.955391 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5472a267-136b-49d6-ad09-00a21fe1cca6 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:21:13.129978 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-5472a267-136b-49d6-ad09-00a21fe1cca6 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c85602851244d4a632b9c861eb4416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45cb377c6a9a43b3b91c99a64e37f1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:21:13.138872 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-5472a267-136b-49d6-ad09-00a21fe1cca6 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "GET /compute/v2.1/servers/ec15d899-3167-4bce-9b78-f8d8b15455b3" status: 200 len: 1510 microversion: 2.1 time: 0.199311 Oct 22 21:21:13.139802 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2745/5474] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:21:12 2022] GET /compute/v2.1/servers/ec15d899-3167-4bce-9b78-f8d8b15455b3 => generated 1510 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:21:14.167628 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-75894734-b075-4116-a6dc-9b4bde958731 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:21:14.168512 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-75894734-b075-4116-a6dc-9b4bde958731 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: ec15d899-3167-4bce-9b78-f8d8b15455b3] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:21:14.188204 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-75894734-b075-4116-a6dc-9b4bde958731 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:21:14.189750 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-75894734-b075-4116-a6dc-9b4bde958731 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:21:14.192656 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-75894734-b075-4116-a6dc-9b4bde958731 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:21:14.194089 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-75894734-b075-4116-a6dc-9b4bde958731 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:21:14.194909 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-75894734-b075-4116-a6dc-9b4bde958731 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:21:14.195876 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-75894734-b075-4116-a6dc-9b4bde958731 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:21:15.106623 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-75894734-b075-4116-a6dc-9b4bde958731 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c85602851244d4a632b9c861eb4416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45cb377c6a9a43b3b91c99a64e37f1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:21:15.117727 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-75894734-b075-4116-a6dc-9b4bde958731 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "GET /compute/v2.1/servers/ec15d899-3167-4bce-9b78-f8d8b15455b3" status: 200 len: 1510 microversion: 2.1 time: 0.956627 Oct 22 21:21:15.137003 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2730/5475] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:21:14 2022] GET /compute/v2.1/servers/ec15d899-3167-4bce-9b78-f8d8b15455b3 => generated 1510 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:21:16.145552 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-cf791029-58ca-4d5c-b466-9080d0232679 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:21:16.146107 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-cf791029-58ca-4d5c-b466-9080d0232679 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: ec15d899-3167-4bce-9b78-f8d8b15455b3] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:21:16.182879 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cf791029-58ca-4d5c-b466-9080d0232679 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:21:16.183559 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cf791029-58ca-4d5c-b466-9080d0232679 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:21:16.184026 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cf791029-58ca-4d5c-b466-9080d0232679 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:21:16.185011 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cf791029-58ca-4d5c-b466-9080d0232679 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:21:16.185932 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cf791029-58ca-4d5c-b466-9080d0232679 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:21:16.186279 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cf791029-58ca-4d5c-b466-9080d0232679 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:21:16.579192 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-cf791029-58ca-4d5c-b466-9080d0232679 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c85602851244d4a632b9c861eb4416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45cb377c6a9a43b3b91c99a64e37f1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:21:16.596521 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-cf791029-58ca-4d5c-b466-9080d0232679 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "GET /compute/v2.1/servers/ec15d899-3167-4bce-9b78-f8d8b15455b3" status: 200 len: 1510 microversion: 2.1 time: 0.455475 Oct 22 21:21:16.597117 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2746/5476] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:21:16 2022] GET /compute/v2.1/servers/ec15d899-3167-4bce-9b78-f8d8b15455b3 => generated 1510 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:21:17.621473 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-243155ad-1de6-4712-961f-3f35e1018852 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:21:17.622305 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-243155ad-1de6-4712-961f-3f35e1018852 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: ec15d899-3167-4bce-9b78-f8d8b15455b3] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:21:17.630482 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-243155ad-1de6-4712-961f-3f35e1018852 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:21:17.631263 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-243155ad-1de6-4712-961f-3f35e1018852 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:21:17.631864 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-243155ad-1de6-4712-961f-3f35e1018852 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:21:17.632657 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-243155ad-1de6-4712-961f-3f35e1018852 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:21:17.633228 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-243155ad-1de6-4712-961f-3f35e1018852 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:21:17.633872 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-243155ad-1de6-4712-961f-3f35e1018852 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:21:17.829609 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-243155ad-1de6-4712-961f-3f35e1018852 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c85602851244d4a632b9c861eb4416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45cb377c6a9a43b3b91c99a64e37f1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:21:17.841038 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-243155ad-1de6-4712-961f-3f35e1018852 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "GET /compute/v2.1/servers/ec15d899-3167-4bce-9b78-f8d8b15455b3" status: 200 len: 1487 microversion: 2.1 time: 0.222209 Oct 22 21:21:17.851969 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2731/5477] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:21:17 2022] GET /compute/v2.1/servers/ec15d899-3167-4bce-9b78-f8d8b15455b3 => generated 1487 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:21:17.866949 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-58aef62c-db3f-4d57-9497-bee004fe1a13 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:21:17.871755 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-58aef62c-db3f-4d57-9497-bee004fe1a13 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: 20d90b58-3fad-4a44-b6bf-4ef0cc587def] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:21:17.883650 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-58aef62c-db3f-4d57-9497-bee004fe1a13 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:21:17.887309 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-58aef62c-db3f-4d57-9497-bee004fe1a13 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:21:17.888040 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-58aef62c-db3f-4d57-9497-bee004fe1a13 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:21:17.891031 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-58aef62c-db3f-4d57-9497-bee004fe1a13 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:21:17.891802 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-58aef62c-db3f-4d57-9497-bee004fe1a13 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:21:17.892421 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-58aef62c-db3f-4d57-9497-bee004fe1a13 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:21:17.969720 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-58aef62c-db3f-4d57-9497-bee004fe1a13 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "POST /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def/action" status: 200 len: 131 microversion: 2.1 time: 0.106491 Oct 22 21:21:17.971131 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2747/5478] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 21:21:17 2022] POST /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def/action => generated 131 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:21:17.981495 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-6dff1f92-1dc8-4da0-b4e2-7be895ed369c tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:21:17.982128 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-6dff1f92-1dc8-4da0-b4e2-7be895ed369c tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: 20d90b58-3fad-4a44-b6bf-4ef0cc587def] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:21:17.994267 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6dff1f92-1dc8-4da0-b4e2-7be895ed369c tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:21:17.996543 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6dff1f92-1dc8-4da0-b4e2-7be895ed369c tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:21:17.997814 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6dff1f92-1dc8-4da0-b4e2-7be895ed369c tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:21:17.998766 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6dff1f92-1dc8-4da0-b4e2-7be895ed369c tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:21:18.000554 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6dff1f92-1dc8-4da0-b4e2-7be895ed369c tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:21:18.001335 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6dff1f92-1dc8-4da0-b4e2-7be895ed369c tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:21:18.184320 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-6dff1f92-1dc8-4da0-b4e2-7be895ed369c tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c85602851244d4a632b9c861eb4416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45cb377c6a9a43b3b91c99a64e37f1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:21:18.192418 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-6dff1f92-1dc8-4da0-b4e2-7be895ed369c tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def" status: 200 len: 1669 microversion: 2.1 time: 0.214932 Oct 22 21:21:18.193284 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2732/5479] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:21:17 2022] GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def => generated 1669 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:21:18.227121 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-f2a37c87-ba62-456d-8923-f3d0c1b2322c tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:21:18.228230 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-f2a37c87-ba62-456d-8923-f3d0c1b2322c tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: 20d90b58-3fad-4a44-b6bf-4ef0cc587def] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:21:18.240569 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f2a37c87-ba62-456d-8923-f3d0c1b2322c tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:21:18.241228 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f2a37c87-ba62-456d-8923-f3d0c1b2322c tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:21:18.241683 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f2a37c87-ba62-456d-8923-f3d0c1b2322c tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:21:18.242708 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f2a37c87-ba62-456d-8923-f3d0c1b2322c tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:21:18.243539 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f2a37c87-ba62-456d-8923-f3d0c1b2322c tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:21:18.244114 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f2a37c87-ba62-456d-8923-f3d0c1b2322c tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:21:18.458697 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-f2a37c87-ba62-456d-8923-f3d0c1b2322c tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c85602851244d4a632b9c861eb4416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45cb377c6a9a43b3b91c99a64e37f1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:21:18.484545 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-f2a37c87-ba62-456d-8923-f3d0c1b2322c tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def" status: 200 len: 1669 microversion: 2.1 time: 0.265041 Oct 22 21:21:18.485143 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2748/5480] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:21:18 2022] GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def => generated 1669 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:21:18.507674 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-f4785ab2-4735-4fed-b09c-633649891a59 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:21:18.508570 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-f4785ab2-4735-4fed-b09c-633649891a59 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: 20d90b58-3fad-4a44-b6bf-4ef0cc587def] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:21:18.516593 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f4785ab2-4735-4fed-b09c-633649891a59 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:21:18.517391 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f4785ab2-4735-4fed-b09c-633649891a59 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:21:18.520158 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f4785ab2-4735-4fed-b09c-633649891a59 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:21:18.522586 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f4785ab2-4735-4fed-b09c-633649891a59 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:21:18.523079 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f4785ab2-4735-4fed-b09c-633649891a59 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:21:18.523556 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f4785ab2-4735-4fed-b09c-633649891a59 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:21:18.701837 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-f4785ab2-4735-4fed-b09c-633649891a59 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c85602851244d4a632b9c861eb4416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45cb377c6a9a43b3b91c99a64e37f1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:21:18.711977 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-f4785ab2-4735-4fed-b09c-633649891a59 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def" status: 200 len: 1669 microversion: 2.1 time: 0.208060 Oct 22 21:21:18.713704 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2733/5481] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:21:18 2022] GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def => generated 1669 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:21:18.738333 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-5eb72fd6-0d48-4733-894e-8310c2365c18 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:21:18.739331 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-5eb72fd6-0d48-4733-894e-8310c2365c18 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: 20d90b58-3fad-4a44-b6bf-4ef0cc587def] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:21:18.750950 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5eb72fd6-0d48-4733-894e-8310c2365c18 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:21:18.751650 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5eb72fd6-0d48-4733-894e-8310c2365c18 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:21:18.752203 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5eb72fd6-0d48-4733-894e-8310c2365c18 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:21:18.753117 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5eb72fd6-0d48-4733-894e-8310c2365c18 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:21:18.753694 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5eb72fd6-0d48-4733-894e-8310c2365c18 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:21:18.754231 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5eb72fd6-0d48-4733-894e-8310c2365c18 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:21:18.920584 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-5eb72fd6-0d48-4733-894e-8310c2365c18 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c85602851244d4a632b9c861eb4416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45cb377c6a9a43b3b91c99a64e37f1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:21:18.932539 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-5eb72fd6-0d48-4733-894e-8310c2365c18 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def" status: 200 len: 1669 microversion: 2.1 time: 0.199663 Oct 22 21:21:18.933611 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2749/5482] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:21:18 2022] GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def => generated 1669 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:21:19.095109 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-abbe65b4-dd39-47bb-869a-844794b6b275 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-726616197", "imageRef": "085e4478-6edc-4a69-8e08-f9831713eb65", "flavorRef": "452", "networks": [{"uuid": "8c5a5758-cdfc-480f-aa56-074dfadd0152"}]}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:21:19.178329 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.network.neutron [None req-abbe65b4-dd39-47bb-869a-844794b6b275 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] validate_networks() for [('8c5a5758-cdfc-480f-aa56-074dfadd0152', None, None, None, None, None)] {{(pid=138744) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 21:21:20.232551 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-abbe65b4-dd39-47bb-869a-844794b6b275 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Flavor limits 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 21:21:20.233278 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-abbe65b4-dd39-47bb-869a-844794b6b275 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Image limits 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 21:21:20.233523 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-abbe65b4-dd39-47bb-869a-844794b6b275 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Flavor pref 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 21:21:20.234032 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-abbe65b4-dd39-47bb-869a-844794b6b275 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Image pref 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 21:21:20.234654 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-abbe65b4-dd39-47bb-869a-844794b6b275 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 21:21:20.251197 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-abbe65b4-dd39-47bb-869a-844794b6b275 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:21:20.251804 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-abbe65b4-dd39-47bb-869a-844794b6b275 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:21:20.252263 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-abbe65b4-dd39-47bb-869a-844794b6b275 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:21:20.253014 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-abbe65b4-dd39-47bb-869a-844794b6b275 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:21:20.253544 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-abbe65b4-dd39-47bb-869a-844794b6b275 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:21:20.253972 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-abbe65b4-dd39-47bb-869a-844794b6b275 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:21:20.305127 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-abbe65b4-dd39-47bb-869a-844794b6b275 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Getting quotas for project 45cb377c6a9a43b3b91c99a64e37f1eb. Resources: {'cores', 'instances', 'ram'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 21:21:20.307313 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-abbe65b4-dd39-47bb-869a-844794b6b275 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Getting quotas for user c9c85602851244d4a632b9c861eb4416 and project 45cb377c6a9a43b3b91c99a64e37f1eb. Resources: {'cores', 'instances', 'ram'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 21:21:20.321819 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-abbe65b4-dd39-47bb-869a-844794b6b275 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Going to run 1 instances... {{(pid=138744) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 21:21:20.324192 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-abbe65b4-dd39-47bb-869a-844794b6b275 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: cd1499ac-bb25-4ccd-8991-4d884118c0a7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='085e4478-6edc-4a69-8e08-f9831713eb65',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138744) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 21:21:20.388954 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-abbe65b4-dd39-47bb-869a-844794b6b275 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.297226 Oct 22 21:21:20.398316 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2734/5483] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Oct 22 21:21:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 1307 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 21:21:20.405430 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-12e5f7e4-aa79-4e17-95ac-b93c7a3ef5e4 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:21:20.406076 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-12e5f7e4-aa79-4e17-95ac-b93c7a3ef5e4 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: cd1499ac-bb25-4ccd-8991-4d884118c0a7] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:21:20.537587 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-12e5f7e4-aa79-4e17-95ac-b93c7a3ef5e4 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c85602851244d4a632b9c861eb4416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45cb377c6a9a43b3b91c99a64e37f1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:21:20.548444 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-12e5f7e4-aa79-4e17-95ac-b93c7a3ef5e4 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "GET /compute/v2.1/servers/cd1499ac-bb25-4ccd-8991-4d884118c0a7" status: 200 len: 1214 microversion: 2.1 time: 0.150908 Oct 22 21:21:20.549113 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2750/5484] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:21:20 2022] GET /compute/v2.1/servers/cd1499ac-bb25-4ccd-8991-4d884118c0a7 => generated 1214 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:21:21.574837 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-8e43143d-918d-42b4-8f73-7dd9d3bcc5f8 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:21:21.576256 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-8e43143d-918d-42b4-8f73-7dd9d3bcc5f8 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: cd1499ac-bb25-4ccd-8991-4d884118c0a7] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:21:21.584462 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8e43143d-918d-42b4-8f73-7dd9d3bcc5f8 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:21:21.585302 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8e43143d-918d-42b4-8f73-7dd9d3bcc5f8 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:21:21.586018 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8e43143d-918d-42b4-8f73-7dd9d3bcc5f8 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:21:21.586961 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8e43143d-918d-42b4-8f73-7dd9d3bcc5f8 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:21:21.587413 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8e43143d-918d-42b4-8f73-7dd9d3bcc5f8 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:21:21.588056 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8e43143d-918d-42b4-8f73-7dd9d3bcc5f8 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:21:21.697796 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-8e43143d-918d-42b4-8f73-7dd9d3bcc5f8 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c85602851244d4a632b9c861eb4416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45cb377c6a9a43b3b91c99a64e37f1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:21:21.708639 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-8e43143d-918d-42b4-8f73-7dd9d3bcc5f8 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "GET /compute/v2.1/servers/cd1499ac-bb25-4ccd-8991-4d884118c0a7" status: 200 len: 1266 microversion: 2.1 time: 0.139985 Oct 22 21:21:21.709640 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2735/5485] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:21:21 2022] GET /compute/v2.1/servers/cd1499ac-bb25-4ccd-8991-4d884118c0a7 => generated 1266 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:21:22.733062 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-e628033b-b336-41a9-8289-ded6670c6ea9 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:21:22.733835 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-e628033b-b336-41a9-8289-ded6670c6ea9 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: cd1499ac-bb25-4ccd-8991-4d884118c0a7] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:21:22.736712 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell0:SELECT=2 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:21:22.753985 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e628033b-b336-41a9-8289-ded6670c6ea9 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:21:22.756933 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e628033b-b336-41a9-8289-ded6670c6ea9 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:21:22.759546 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e628033b-b336-41a9-8289-ded6670c6ea9 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:21:22.760667 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e628033b-b336-41a9-8289-ded6670c6ea9 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:21:22.761342 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e628033b-b336-41a9-8289-ded6670c6ea9 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:21:22.762671 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e628033b-b336-41a9-8289-ded6670c6ea9 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:21:23.083215 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-e628033b-b336-41a9-8289-ded6670c6ea9 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c85602851244d4a632b9c861eb4416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45cb377c6a9a43b3b91c99a64e37f1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:21:23.096278 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-e628033b-b336-41a9-8289-ded6670c6ea9 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "GET /compute/v2.1/servers/cd1499ac-bb25-4ccd-8991-4d884118c0a7" status: 200 len: 1314 microversion: 2.1 time: 0.367512 Oct 22 21:21:23.097762 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2751/5486] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:21:22 2022] GET /compute/v2.1/servers/cd1499ac-bb25-4ccd-8991-4d884118c0a7 => generated 1314 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:21:24.126679 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-2e32aaeb-4ec7-4174-8998-8f9528ed7ccc tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:21:24.127461 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-2e32aaeb-4ec7-4174-8998-8f9528ed7ccc tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: cd1499ac-bb25-4ccd-8991-4d884118c0a7] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:21:24.142004 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2e32aaeb-4ec7-4174-8998-8f9528ed7ccc tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:21:24.145783 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2e32aaeb-4ec7-4174-8998-8f9528ed7ccc tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:21:24.146428 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2e32aaeb-4ec7-4174-8998-8f9528ed7ccc tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:21:24.148367 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2e32aaeb-4ec7-4174-8998-8f9528ed7ccc tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:21:24.150485 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2e32aaeb-4ec7-4174-8998-8f9528ed7ccc tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:21:24.154338 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2e32aaeb-4ec7-4174-8998-8f9528ed7ccc tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:21:24.185413 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-2ab27eda-033d-4ff0-8c63-b5cbc22d7cf3 req-2b8a5614-364e-4d87-8d72-19ae8e7075e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd1499ac-bb25-4ccd-8991-4d884118c0a7", "tag": "6c894d02-6239-4821-8b25-505edeb5c42c"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:21:24.211480 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-2ab27eda-033d-4ff0-8c63-b5cbc22d7cf3 req-2b8a5614-364e-4d87-8d72-19ae8e7075e9 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:21:24.212085 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-2ab27eda-033d-4ff0-8c63-b5cbc22d7cf3 req-2b8a5614-364e-4d87-8d72-19ae8e7075e9 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:21:24.212896 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-2ab27eda-033d-4ff0-8c63-b5cbc22d7cf3 req-2b8a5614-364e-4d87-8d72-19ae8e7075e9 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:21:24.233854 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-2ab27eda-033d-4ff0-8c63-b5cbc22d7cf3 req-2b8a5614-364e-4d87-8d72-19ae8e7075e9 service nova] Creating event network-changed:6c894d02-6239-4821-8b25-505edeb5c42c for instance cd1499ac-bb25-4ccd-8991-4d884118c0a7 on nch1-master-1 Oct 22 21:21:24.239540 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-2ab27eda-033d-4ff0-8c63-b5cbc22d7cf3 req-2b8a5614-364e-4d87-8d72-19ae8e7075e9 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060301 Oct 22 21:21:24.241342 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2752/5487] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:21:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:21:24.529208 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-2e32aaeb-4ec7-4174-8998-8f9528ed7ccc tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c85602851244d4a632b9c861eb4416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45cb377c6a9a43b3b91c99a64e37f1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:21:24.538218 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-2e32aaeb-4ec7-4174-8998-8f9528ed7ccc tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "GET /compute/v2.1/servers/cd1499ac-bb25-4ccd-8991-4d884118c0a7" status: 200 len: 1314 microversion: 2.1 time: 0.420931 Oct 22 21:21:24.538987 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2736/5488] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:21:24 2022] GET /compute/v2.1/servers/cd1499ac-bb25-4ccd-8991-4d884118c0a7 => generated 1314 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:21:25.565376 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-8de0c3bf-fcff-4d2d-90e1-f251dcf808d7 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:21:25.566240 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-8de0c3bf-fcff-4d2d-90e1-f251dcf808d7 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: cd1499ac-bb25-4ccd-8991-4d884118c0a7] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:21:25.579998 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8de0c3bf-fcff-4d2d-90e1-f251dcf808d7 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:21:25.581006 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8de0c3bf-fcff-4d2d-90e1-f251dcf808d7 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:21:25.582547 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8de0c3bf-fcff-4d2d-90e1-f251dcf808d7 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:21:25.583456 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8de0c3bf-fcff-4d2d-90e1-f251dcf808d7 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:21:25.585398 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8de0c3bf-fcff-4d2d-90e1-f251dcf808d7 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:21:25.587433 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8de0c3bf-fcff-4d2d-90e1-f251dcf808d7 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:21:25.811828 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-8de0c3bf-fcff-4d2d-90e1-f251dcf808d7 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c85602851244d4a632b9c861eb4416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45cb377c6a9a43b3b91c99a64e37f1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:21:25.825559 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-8de0c3bf-fcff-4d2d-90e1-f251dcf808d7 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "GET /compute/v2.1/servers/cd1499ac-bb25-4ccd-8991-4d884118c0a7" status: 200 len: 1314 microversion: 2.1 time: 0.264363 Oct 22 21:21:25.826641 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2753/5489] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:21:25 2022] GET /compute/v2.1/servers/cd1499ac-bb25-4ccd-8991-4d884118c0a7 => generated 1314 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:21:26.860147 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-12b82f36-5280-481c-b6a9-7edbd835a02f tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:21:26.860760 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-12b82f36-5280-481c-b6a9-7edbd835a02f tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: cd1499ac-bb25-4ccd-8991-4d884118c0a7] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:21:26.869190 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-12b82f36-5280-481c-b6a9-7edbd835a02f tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:21:26.869699 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-12b82f36-5280-481c-b6a9-7edbd835a02f tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:21:26.870144 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-12b82f36-5280-481c-b6a9-7edbd835a02f tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:21:26.870869 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-12b82f36-5280-481c-b6a9-7edbd835a02f tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:21:26.872014 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-12b82f36-5280-481c-b6a9-7edbd835a02f tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:21:26.872685 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-12b82f36-5280-481c-b6a9-7edbd835a02f tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:21:27.211202 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-12b82f36-5280-481c-b6a9-7edbd835a02f tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c85602851244d4a632b9c861eb4416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45cb377c6a9a43b3b91c99a64e37f1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:21:27.226770 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-12b82f36-5280-481c-b6a9-7edbd835a02f tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "GET /compute/v2.1/servers/cd1499ac-bb25-4ccd-8991-4d884118c0a7" status: 200 len: 1314 microversion: 2.1 time: 0.370905 Oct 22 21:21:27.227922 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2737/5490] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:21:26 2022] GET /compute/v2.1/servers/cd1499ac-bb25-4ccd-8991-4d884118c0a7 => generated 1314 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:21:28.250418 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-e8af092c-3a41-462e-913d-8d402b952710 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:21:28.260750 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-e8af092c-3a41-462e-913d-8d402b952710 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: cd1499ac-bb25-4ccd-8991-4d884118c0a7] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:21:28.269554 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e8af092c-3a41-462e-913d-8d402b952710 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:21:28.270083 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e8af092c-3a41-462e-913d-8d402b952710 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:21:28.270806 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e8af092c-3a41-462e-913d-8d402b952710 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:21:28.271830 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e8af092c-3a41-462e-913d-8d402b952710 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:21:28.272560 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e8af092c-3a41-462e-913d-8d402b952710 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:21:28.273169 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e8af092c-3a41-462e-913d-8d402b952710 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:21:28.627902 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-e8af092c-3a41-462e-913d-8d402b952710 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c85602851244d4a632b9c861eb4416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45cb377c6a9a43b3b91c99a64e37f1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:21:28.640768 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-e8af092c-3a41-462e-913d-8d402b952710 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "GET /compute/v2.1/servers/cd1499ac-bb25-4ccd-8991-4d884118c0a7" status: 200 len: 1314 microversion: 2.1 time: 0.394311 Oct 22 21:21:28.641898 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2754/5491] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:21:28 2022] GET /compute/v2.1/servers/cd1499ac-bb25-4ccd-8991-4d884118c0a7 => generated 1314 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:21:29.668531 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-2391377f-2e78-41c7-b795-d74316d19713 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:21:29.669428 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-2391377f-2e78-41c7-b795-d74316d19713 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: cd1499ac-bb25-4ccd-8991-4d884118c0a7] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:21:29.690210 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2391377f-2e78-41c7-b795-d74316d19713 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:21:29.692073 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2391377f-2e78-41c7-b795-d74316d19713 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:21:29.694649 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2391377f-2e78-41c7-b795-d74316d19713 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:21:29.695928 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2391377f-2e78-41c7-b795-d74316d19713 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:21:29.697770 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2391377f-2e78-41c7-b795-d74316d19713 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:21:29.698366 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2391377f-2e78-41c7-b795-d74316d19713 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:21:29.883486 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-ffada944-ab7d-40b2-b9dd-1c1fe6f6d873 tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerAdvancedOps-server-1845956965", "imageRef": "085e4478-6edc-4a69-8e08-f9831713eb65", "flavorRef": "452", "networks": [{"uuid": "4068454b-1759-4ccb-bd6f-a00a0e9b3345"}]}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:21:29.957183 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.network.neutron [None req-ffada944-ab7d-40b2-b9dd-1c1fe6f6d873 tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] validate_networks() for [('4068454b-1759-4ccb-bd6f-a00a0e9b3345', None, None, None, None, None)] {{(pid=138744) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 21:21:30.086161 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-2391377f-2e78-41c7-b795-d74316d19713 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c85602851244d4a632b9c861eb4416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45cb377c6a9a43b3b91c99a64e37f1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:21:30.102107 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-2391377f-2e78-41c7-b795-d74316d19713 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "GET /compute/v2.1/servers/cd1499ac-bb25-4ccd-8991-4d884118c0a7" status: 200 len: 1314 microversion: 2.1 time: 0.437255 Oct 22 21:21:30.120829 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2755/5492] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:21:29 2022] GET /compute/v2.1/servers/cd1499ac-bb25-4ccd-8991-4d884118c0a7 => generated 1314 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:21:30.271803 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell0:SELECT=2 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:21:30.317928 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell0:SELECT=6 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:21:30.927243 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-ffada944-ab7d-40b2-b9dd-1c1fe6f6d873 tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Flavor limits 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 21:21:30.929970 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-ffada944-ab7d-40b2-b9dd-1c1fe6f6d873 tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Image limits 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 21:21:30.930550 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-ffada944-ab7d-40b2-b9dd-1c1fe6f6d873 tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Flavor pref 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 21:21:30.931222 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-ffada944-ab7d-40b2-b9dd-1c1fe6f6d873 tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Image pref 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 21:21:30.931680 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-ffada944-ab7d-40b2-b9dd-1c1fe6f6d873 tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 21:21:30.948138 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ffada944-ab7d-40b2-b9dd-1c1fe6f6d873 tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:21:30.951486 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ffada944-ab7d-40b2-b9dd-1c1fe6f6d873 tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:21:30.951986 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ffada944-ab7d-40b2-b9dd-1c1fe6f6d873 tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:21:30.955052 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ffada944-ab7d-40b2-b9dd-1c1fe6f6d873 tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:21:30.955608 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ffada944-ab7d-40b2-b9dd-1c1fe6f6d873 tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:21:30.956492 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ffada944-ab7d-40b2-b9dd-1c1fe6f6d873 tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:21:30.989300 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-ffada944-ab7d-40b2-b9dd-1c1fe6f6d873 tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Getting quotas for project c0b96ff22c5544c187ad917f367d9c28. Resources: {'cores', 'instances', 'ram'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 21:21:30.996769 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-ffada944-ab7d-40b2-b9dd-1c1fe6f6d873 tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Getting quotas for user ba127731b60241debcb374ac2e39c891 and project c0b96ff22c5544c187ad917f367d9c28. Resources: {'cores', 'instances', 'ram'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 21:21:31.011699 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-ffada944-ab7d-40b2-b9dd-1c1fe6f6d873 tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Going to run 1 instances... {{(pid=138744) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 21:21:31.014558 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-ffada944-ab7d-40b2-b9dd-1c1fe6f6d873 tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] [instance: 624cfc5a-03de-4c2b-9de5-bcd2d272aced] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='085e4478-6edc-4a69-8e08-f9831713eb65',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138744) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 21:21:31.076385 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-ffada944-ab7d-40b2-b9dd-1c1fe6f6d873 tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.590868 Oct 22 21:21:31.077582 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2738/5493] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Oct 22 21:21:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 1593 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 21:21:31.089699 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-d92fdb4d-77bb-4a3d-9024-ccdde50da782 tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:21:31.092053 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-d92fdb4d-77bb-4a3d-9024-ccdde50da782 tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] [instance: 624cfc5a-03de-4c2b-9de5-bcd2d272aced] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:21:31.101670 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell0:SELECT=2 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:21:31.127196 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-d4a31622-45f2-4681-ab9a-d8e42131c7fe tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:21:31.127905 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-d4a31622-45f2-4681-ab9a-d8e42131c7fe tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: cd1499ac-bb25-4ccd-8991-4d884118c0a7] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:21:31.140318 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d4a31622-45f2-4681-ab9a-d8e42131c7fe tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:21:31.140833 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d4a31622-45f2-4681-ab9a-d8e42131c7fe tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:21:31.141290 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d4a31622-45f2-4681-ab9a-d8e42131c7fe tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:21:31.142028 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d4a31622-45f2-4681-ab9a-d8e42131c7fe tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:21:31.146617 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d4a31622-45f2-4681-ab9a-d8e42131c7fe tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:21:31.147162 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d4a31622-45f2-4681-ab9a-d8e42131c7fe tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:21:31.158056 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:SELECT=82 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:21:31.523326 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-d92fdb4d-77bb-4a3d-9024-ccdde50da782 tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba127731b60241debcb374ac2e39c891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0b96ff22c5544c187ad917f367d9c28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:21:31.544168 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-d92fdb4d-77bb-4a3d-9024-ccdde50da782 tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] 10.222.0.18 "GET /compute/v2.1/servers/624cfc5a-03de-4c2b-9de5-bcd2d272aced" status: 200 len: 1215 microversion: 2.1 time: 0.445952 Oct 22 21:21:31.544882 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2756/5494] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:21:31 2022] GET /compute/v2.1/servers/624cfc5a-03de-4c2b-9de5-bcd2d272aced => generated 1215 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:21:31.716025 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-d4a31622-45f2-4681-ab9a-d8e42131c7fe tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c85602851244d4a632b9c861eb4416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45cb377c6a9a43b3b91c99a64e37f1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:21:31.736232 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-d4a31622-45f2-4681-ab9a-d8e42131c7fe tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "GET /compute/v2.1/servers/cd1499ac-bb25-4ccd-8991-4d884118c0a7" status: 200 len: 1314 microversion: 2.1 time: 0.613219 Oct 22 21:21:31.736849 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2739/5495] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:21:31 2022] GET /compute/v2.1/servers/cd1499ac-bb25-4ccd-8991-4d884118c0a7 => generated 1314 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:21:32.111891 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-0d93fc4a-8628-4c28-9301-82c72184a263 req-72fd7d25-075d-4362-96e0-a0c785f6ea0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd1499ac-bb25-4ccd-8991-4d884118c0a7", "name": "network-vif-plugged", "status": "completed", "tag": "6c894d02-6239-4821-8b25-505edeb5c42c"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:21:32.131929 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-0d93fc4a-8628-4c28-9301-82c72184a263 req-72fd7d25-075d-4362-96e0-a0c785f6ea0e service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:21:32.132434 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-0d93fc4a-8628-4c28-9301-82c72184a263 req-72fd7d25-075d-4362-96e0-a0c785f6ea0e service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:21:32.132884 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-0d93fc4a-8628-4c28-9301-82c72184a263 req-72fd7d25-075d-4362-96e0-a0c785f6ea0e service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:21:32.167640 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-0d93fc4a-8628-4c28-9301-82c72184a263 req-72fd7d25-075d-4362-96e0-a0c785f6ea0e service nova] Creating event network-vif-plugged:6c894d02-6239-4821-8b25-505edeb5c42c for instance cd1499ac-bb25-4ccd-8991-4d884118c0a7 on nch1-master-1 Oct 22 21:21:32.179912 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-0d93fc4a-8628-4c28-9301-82c72184a263 req-72fd7d25-075d-4362-96e0-a0c785f6ea0e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070271 Oct 22 21:21:32.181962 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2757/5496] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:21:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:21:32.570973 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-f080ef96-ebc8-4587-8042-f4a67f64c804 tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:21:32.572312 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-f080ef96-ebc8-4587-8042-f4a67f64c804 tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] [instance: 624cfc5a-03de-4c2b-9de5-bcd2d272aced] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:21:32.592818 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f080ef96-ebc8-4587-8042-f4a67f64c804 tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:21:32.593916 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f080ef96-ebc8-4587-8042-f4a67f64c804 tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:21:32.596902 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f080ef96-ebc8-4587-8042-f4a67f64c804 tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:21:32.597991 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f080ef96-ebc8-4587-8042-f4a67f64c804 tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:21:32.598486 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f080ef96-ebc8-4587-8042-f4a67f64c804 tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:21:32.598925 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f080ef96-ebc8-4587-8042-f4a67f64c804 tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:21:32.747243 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-f080ef96-ebc8-4587-8042-f4a67f64c804 tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba127731b60241debcb374ac2e39c891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0b96ff22c5544c187ad917f367d9c28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:21:32.759304 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-f080ef96-ebc8-4587-8042-f4a67f64c804 tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] 10.222.0.18 "GET /compute/v2.1/servers/624cfc5a-03de-4c2b-9de5-bcd2d272aced" status: 200 len: 1267 microversion: 2.1 time: 0.194008 Oct 22 21:21:32.759927 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2740/5497] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:21:32 2022] GET /compute/v2.1/servers/624cfc5a-03de-4c2b-9de5-bcd2d272aced => generated 1267 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:21:32.776542 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-336283c8-0449-4bca-b621-34210274ea17 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:21:32.777283 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-336283c8-0449-4bca-b621-34210274ea17 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: cd1499ac-bb25-4ccd-8991-4d884118c0a7] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:21:32.788218 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-336283c8-0449-4bca-b621-34210274ea17 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:21:32.789234 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-336283c8-0449-4bca-b621-34210274ea17 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:21:32.789881 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-336283c8-0449-4bca-b621-34210274ea17 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:21:32.790813 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-336283c8-0449-4bca-b621-34210274ea17 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:21:32.791242 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-336283c8-0449-4bca-b621-34210274ea17 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:21:32.791716 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-336283c8-0449-4bca-b621-34210274ea17 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:21:32.985584 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-336283c8-0449-4bca-b621-34210274ea17 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c85602851244d4a632b9c861eb4416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45cb377c6a9a43b3b91c99a64e37f1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:21:32.994109 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-336283c8-0449-4bca-b621-34210274ea17 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "GET /compute/v2.1/servers/cd1499ac-bb25-4ccd-8991-4d884118c0a7" status: 200 len: 1314 microversion: 2.1 time: 0.227643 Oct 22 21:21:33.010468 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2758/5498] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:21:32 2022] GET /compute/v2.1/servers/cd1499ac-bb25-4ccd-8991-4d884118c0a7 => generated 1314 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:21:33.784738 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-a55c6b50-f916-4498-93b5-d1fd76e88a15 tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:21:33.785484 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-a55c6b50-f916-4498-93b5-d1fd76e88a15 tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] [instance: 624cfc5a-03de-4c2b-9de5-bcd2d272aced] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:21:33.802008 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a55c6b50-f916-4498-93b5-d1fd76e88a15 tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:21:33.802727 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a55c6b50-f916-4498-93b5-d1fd76e88a15 tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:21:33.803542 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a55c6b50-f916-4498-93b5-d1fd76e88a15 tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:21:33.805348 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a55c6b50-f916-4498-93b5-d1fd76e88a15 tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:21:33.805833 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a55c6b50-f916-4498-93b5-d1fd76e88a15 tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:21:33.806793 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a55c6b50-f916-4498-93b5-d1fd76e88a15 tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:21:33.957869 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-a55c6b50-f916-4498-93b5-d1fd76e88a15 tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba127731b60241debcb374ac2e39c891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0b96ff22c5544c187ad917f367d9c28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:21:33.969091 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-a55c6b50-f916-4498-93b5-d1fd76e88a15 tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] 10.222.0.18 "GET /compute/v2.1/servers/624cfc5a-03de-4c2b-9de5-bcd2d272aced" status: 200 len: 1273 microversion: 2.1 time: 0.189771 Oct 22 21:21:33.970286 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2741/5499] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:21:33 2022] GET /compute/v2.1/servers/624cfc5a-03de-4c2b-9de5-bcd2d272aced => generated 1273 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:21:34.022334 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-7b99a37b-f055-448b-a23b-0445aa5c4f41 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:21:34.023854 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-7b99a37b-f055-448b-a23b-0445aa5c4f41 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: cd1499ac-bb25-4ccd-8991-4d884118c0a7] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:21:34.032099 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7b99a37b-f055-448b-a23b-0445aa5c4f41 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:21:34.033022 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7b99a37b-f055-448b-a23b-0445aa5c4f41 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:21:34.033898 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7b99a37b-f055-448b-a23b-0445aa5c4f41 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:21:34.034875 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7b99a37b-f055-448b-a23b-0445aa5c4f41 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:21:34.035537 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7b99a37b-f055-448b-a23b-0445aa5c4f41 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:21:34.036207 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7b99a37b-f055-448b-a23b-0445aa5c4f41 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:21:34.378663 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-7b99a37b-f055-448b-a23b-0445aa5c4f41 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c85602851244d4a632b9c861eb4416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45cb377c6a9a43b3b91c99a64e37f1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:21:34.393062 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-7b99a37b-f055-448b-a23b-0445aa5c4f41 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "GET /compute/v2.1/servers/cd1499ac-bb25-4ccd-8991-4d884118c0a7" status: 200 len: 1501 microversion: 2.1 time: 0.378509 Oct 22 21:21:34.395016 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2759/5500] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:21:34 2022] GET /compute/v2.1/servers/cd1499ac-bb25-4ccd-8991-4d884118c0a7 => generated 1501 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:21:34.427278 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-50e6820a-fb0e-4041-a8dc-7e946bdbfbe0 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:21:34.430287 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-50e6820a-fb0e-4041-a8dc-7e946bdbfbe0 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: cd1499ac-bb25-4ccd-8991-4d884118c0a7] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:21:34.460357 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-50e6820a-fb0e-4041-a8dc-7e946bdbfbe0 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:21:34.462669 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-50e6820a-fb0e-4041-a8dc-7e946bdbfbe0 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:21:34.463395 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-50e6820a-fb0e-4041-a8dc-7e946bdbfbe0 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:21:34.469494 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-50e6820a-fb0e-4041-a8dc-7e946bdbfbe0 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:21:34.473888 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-50e6820a-fb0e-4041-a8dc-7e946bdbfbe0 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:21:34.476282 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-50e6820a-fb0e-4041-a8dc-7e946bdbfbe0 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:21:34.563196 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-50e6820a-fb0e-4041-a8dc-7e946bdbfbe0 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "POST /compute/v2.1/servers/cd1499ac-bb25-4ccd-8991-4d884118c0a7/action" status: 200 len: 14 microversion: 2.1 time: 0.146856 Oct 22 21:21:34.564645 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2742/5501] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 21:21:34 2022] POST /compute/v2.1/servers/cd1499ac-bb25-4ccd-8991-4d884118c0a7/action => generated 14 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 22 21:21:34.996846 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-51234860-2ad1-4e13-bcba-687eb1129795 tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:21:34.997819 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-51234860-2ad1-4e13-bcba-687eb1129795 tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] [instance: 624cfc5a-03de-4c2b-9de5-bcd2d272aced] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:21:35.008474 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-51234860-2ad1-4e13-bcba-687eb1129795 tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:21:35.008988 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-51234860-2ad1-4e13-bcba-687eb1129795 tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:21:35.011913 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-51234860-2ad1-4e13-bcba-687eb1129795 tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:21:35.014894 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-51234860-2ad1-4e13-bcba-687eb1129795 tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:21:35.019114 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-51234860-2ad1-4e13-bcba-687eb1129795 tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:21:35.021409 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-51234860-2ad1-4e13-bcba-687eb1129795 tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:21:35.038460 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell1:SELECT=90 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:21:35.389670 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-51234860-2ad1-4e13-bcba-687eb1129795 tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba127731b60241debcb374ac2e39c891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0b96ff22c5544c187ad917f367d9c28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:21:35.397964 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-51234860-2ad1-4e13-bcba-687eb1129795 tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] 10.222.0.18 "GET /compute/v2.1/servers/624cfc5a-03de-4c2b-9de5-bcd2d272aced" status: 200 len: 1315 microversion: 2.1 time: 0.406183 Oct 22 21:21:35.406776 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2760/5502] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:21:34 2022] GET /compute/v2.1/servers/624cfc5a-03de-4c2b-9de5-bcd2d272aced => generated 1315 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:21:35.587842 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-ef278ba1-3cb0-473f-a0d5-f6a317ee873c tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:21:35.594686 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-ef278ba1-3cb0-473f-a0d5-f6a317ee873c tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: cd1499ac-bb25-4ccd-8991-4d884118c0a7] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:21:35.631912 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ef278ba1-3cb0-473f-a0d5-f6a317ee873c tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:21:35.638728 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ef278ba1-3cb0-473f-a0d5-f6a317ee873c tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:21:35.642756 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ef278ba1-3cb0-473f-a0d5-f6a317ee873c tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:21:35.672477 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ef278ba1-3cb0-473f-a0d5-f6a317ee873c tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:21:35.673084 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ef278ba1-3cb0-473f-a0d5-f6a317ee873c tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:21:35.673548 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ef278ba1-3cb0-473f-a0d5-f6a317ee873c tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:21:35.730302 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-ef278ba1-3cb0-473f-a0d5-f6a317ee873c tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "POST /compute/v2.1/servers/cd1499ac-bb25-4ccd-8991-4d884118c0a7/action" status: 200 len: 14 microversion: 2.1 time: 0.155984 Oct 22 21:21:35.736986 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2743/5503] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 21:21:35 2022] POST /compute/v2.1/servers/cd1499ac-bb25-4ccd-8991-4d884118c0a7/action => generated 14 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 22 21:21:36.122221 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-2d5aeb2a-f3b6-4c9a-ba89-13c646209961 req-e12d05b0-a903-41e6-9dd3-dfd6c307175b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "624cfc5a-03de-4c2b-9de5-bcd2d272aced", "tag": "48737af2-dc1c-4965-a93e-24b25f6f4aa2"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:21:36.144730 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-2d5aeb2a-f3b6-4c9a-ba89-13c646209961 req-e12d05b0-a903-41e6-9dd3-dfd6c307175b service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:21:36.150792 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-2d5aeb2a-f3b6-4c9a-ba89-13c646209961 req-e12d05b0-a903-41e6-9dd3-dfd6c307175b service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:21:36.151577 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-2d5aeb2a-f3b6-4c9a-ba89-13c646209961 req-e12d05b0-a903-41e6-9dd3-dfd6c307175b service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:21:36.178387 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-2d5aeb2a-f3b6-4c9a-ba89-13c646209961 req-e12d05b0-a903-41e6-9dd3-dfd6c307175b service nova] Creating event network-changed:48737af2-dc1c-4965-a93e-24b25f6f4aa2 for instance 624cfc5a-03de-4c2b-9de5-bcd2d272aced on nch2-master-1 Oct 22 21:21:36.192646 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-2d5aeb2a-f3b6-4c9a-ba89-13c646209961 req-e12d05b0-a903-41e6-9dd3-dfd6c307175b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074113 Oct 22 21:21:36.193273 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2761/5504] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:21:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:21:36.438764 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-93fc420c-2f96-435c-80b7-2ceac2dc2401 tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:21:36.440047 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-93fc420c-2f96-435c-80b7-2ceac2dc2401 tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] [instance: 624cfc5a-03de-4c2b-9de5-bcd2d272aced] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:21:36.453983 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=8 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:21:36.460039 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-93fc420c-2f96-435c-80b7-2ceac2dc2401 tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:21:36.460732 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-93fc420c-2f96-435c-80b7-2ceac2dc2401 tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:21:36.462802 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-93fc420c-2f96-435c-80b7-2ceac2dc2401 tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:21:36.464108 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-93fc420c-2f96-435c-80b7-2ceac2dc2401 tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:21:36.465141 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-93fc420c-2f96-435c-80b7-2ceac2dc2401 tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:21:36.468890 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-93fc420c-2f96-435c-80b7-2ceac2dc2401 tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:21:36.768687 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-3041d96d-65f7-45ad-a105-6810d4757f79 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:21:36.775268 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-3041d96d-65f7-45ad-a105-6810d4757f79 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: cd1499ac-bb25-4ccd-8991-4d884118c0a7] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:21:36.795192 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3041d96d-65f7-45ad-a105-6810d4757f79 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:21:36.796046 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3041d96d-65f7-45ad-a105-6810d4757f79 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:21:36.797108 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3041d96d-65f7-45ad-a105-6810d4757f79 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:21:36.798082 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3041d96d-65f7-45ad-a105-6810d4757f79 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:21:36.798742 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3041d96d-65f7-45ad-a105-6810d4757f79 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:21:36.799812 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3041d96d-65f7-45ad-a105-6810d4757f79 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:21:36.874313 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-93fc420c-2f96-435c-80b7-2ceac2dc2401 tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba127731b60241debcb374ac2e39c891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0b96ff22c5544c187ad917f367d9c28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:21:36.901266 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-93fc420c-2f96-435c-80b7-2ceac2dc2401 tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] 10.222.0.18 "GET /compute/v2.1/servers/624cfc5a-03de-4c2b-9de5-bcd2d272aced" status: 200 len: 1315 microversion: 2.1 time: 0.483652 Oct 22 21:21:36.901692 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2744/5505] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:21:36 2022] GET /compute/v2.1/servers/624cfc5a-03de-4c2b-9de5-bcd2d272aced => generated 1315 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:21:36.959425 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-3041d96d-65f7-45ad-a105-6810d4757f79 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "POST /compute/v2.1/servers/cd1499ac-bb25-4ccd-8991-4d884118c0a7/action" status: 200 len: 14 microversion: 2.1 time: 0.218436 Oct 22 21:21:36.960079 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2762/5506] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 21:21:36 2022] POST /compute/v2.1/servers/cd1499ac-bb25-4ccd-8991-4d884118c0a7/action => generated 14 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 22 21:21:37.928284 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-9237b1f4-7c9e-43a4-9216-06386f6ca58a tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:21:37.929000 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-9237b1f4-7c9e-43a4-9216-06386f6ca58a tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] [instance: 624cfc5a-03de-4c2b-9de5-bcd2d272aced] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:21:37.945112 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9237b1f4-7c9e-43a4-9216-06386f6ca58a tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:21:37.946856 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9237b1f4-7c9e-43a4-9216-06386f6ca58a tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:21:37.950325 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9237b1f4-7c9e-43a4-9216-06386f6ca58a tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:21:37.953987 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9237b1f4-7c9e-43a4-9216-06386f6ca58a tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:21:37.955387 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9237b1f4-7c9e-43a4-9216-06386f6ca58a tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:21:37.956066 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9237b1f4-7c9e-43a4-9216-06386f6ca58a tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:21:37.976056 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-ce0004fb-0229-4b8d-8c2d-01d91a26937f tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:21:37.983959 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-ce0004fb-0229-4b8d-8c2d-01d91a26937f tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: cd1499ac-bb25-4ccd-8991-4d884118c0a7] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:21:37.996481 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=3 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:21:38.000027 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ce0004fb-0229-4b8d-8c2d-01d91a26937f tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:21:38.000945 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ce0004fb-0229-4b8d-8c2d-01d91a26937f tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:21:38.003262 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ce0004fb-0229-4b8d-8c2d-01d91a26937f tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:21:38.004080 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ce0004fb-0229-4b8d-8c2d-01d91a26937f tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:21:38.004754 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ce0004fb-0229-4b8d-8c2d-01d91a26937f tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:21:38.005447 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ce0004fb-0229-4b8d-8c2d-01d91a26937f tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:21:38.061226 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-ce0004fb-0229-4b8d-8c2d-01d91a26937f tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "POST /compute/v2.1/servers/cd1499ac-bb25-4ccd-8991-4d884118c0a7/action" status: 200 len: 14 microversion: 2.1 time: 0.093163 Oct 22 21:21:38.062287 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2763/5507] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 21:21:37 2022] POST /compute/v2.1/servers/cd1499ac-bb25-4ccd-8991-4d884118c0a7/action => generated 14 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 22 21:21:38.185055 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-9237b1f4-7c9e-43a4-9216-06386f6ca58a tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba127731b60241debcb374ac2e39c891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0b96ff22c5544c187ad917f367d9c28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:21:38.205478 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-9237b1f4-7c9e-43a4-9216-06386f6ca58a tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] 10.222.0.18 "GET /compute/v2.1/servers/624cfc5a-03de-4c2b-9de5-bcd2d272aced" status: 200 len: 1315 microversion: 2.1 time: 0.280471 Oct 22 21:21:38.206982 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2745/5508] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:21:37 2022] GET /compute/v2.1/servers/624cfc5a-03de-4c2b-9de5-bcd2d272aced => generated 1315 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:21:39.074292 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-2960a073-5bad-4680-8516-af2548411c18 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:21:39.076692 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-2960a073-5bad-4680-8516-af2548411c18 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: cd1499ac-bb25-4ccd-8991-4d884118c0a7] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:21:39.095746 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2960a073-5bad-4680-8516-af2548411c18 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:21:39.096510 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2960a073-5bad-4680-8516-af2548411c18 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:21:39.097133 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2960a073-5bad-4680-8516-af2548411c18 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:21:39.098382 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2960a073-5bad-4680-8516-af2548411c18 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:21:39.099076 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2960a073-5bad-4680-8516-af2548411c18 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:21:39.100092 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2960a073-5bad-4680-8516-af2548411c18 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:21:39.142589 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-2960a073-5bad-4680-8516-af2548411c18 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "POST /compute/v2.1/servers/cd1499ac-bb25-4ccd-8991-4d884118c0a7/action" status: 200 len: 14 microversion: 2.1 time: 0.072646 Oct 22 21:21:39.143424 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2764/5509] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 21:21:39 2022] POST /compute/v2.1/servers/cd1499ac-bb25-4ccd-8991-4d884118c0a7/action => generated 14 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 22 21:21:39.230805 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-252e15b4-747b-4d19-95c9-7804c5c9a148 tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:21:39.231594 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-252e15b4-747b-4d19-95c9-7804c5c9a148 tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] [instance: 624cfc5a-03de-4c2b-9de5-bcd2d272aced] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:21:39.239584 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-252e15b4-747b-4d19-95c9-7804c5c9a148 tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:21:39.240476 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-252e15b4-747b-4d19-95c9-7804c5c9a148 tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:21:39.241168 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-252e15b4-747b-4d19-95c9-7804c5c9a148 tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:21:39.242494 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-252e15b4-747b-4d19-95c9-7804c5c9a148 tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:21:39.243689 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-252e15b4-747b-4d19-95c9-7804c5c9a148 tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:21:39.244366 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-252e15b4-747b-4d19-95c9-7804c5c9a148 tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:21:39.505691 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-252e15b4-747b-4d19-95c9-7804c5c9a148 tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba127731b60241debcb374ac2e39c891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0b96ff22c5544c187ad917f367d9c28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:21:39.531297 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-252e15b4-747b-4d19-95c9-7804c5c9a148 tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] 10.222.0.18 "GET /compute/v2.1/servers/624cfc5a-03de-4c2b-9de5-bcd2d272aced" status: 200 len: 1315 microversion: 2.1 time: 0.304359 Oct 22 21:21:39.551999 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2746/5510] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:21:39 2022] GET /compute/v2.1/servers/624cfc5a-03de-4c2b-9de5-bcd2d272aced => generated 1315 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:21:40.161166 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-a2093c77-ba46-4b58-85a2-ca6f14d88e3e tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:21:40.165649 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-a2093c77-ba46-4b58-85a2-ca6f14d88e3e tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: cd1499ac-bb25-4ccd-8991-4d884118c0a7] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:21:40.190824 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a2093c77-ba46-4b58-85a2-ca6f14d88e3e tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:21:40.191379 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a2093c77-ba46-4b58-85a2-ca6f14d88e3e tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:21:40.191831 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a2093c77-ba46-4b58-85a2-ca6f14d88e3e tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:21:40.192574 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a2093c77-ba46-4b58-85a2-ca6f14d88e3e tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:21:40.193034 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a2093c77-ba46-4b58-85a2-ca6f14d88e3e tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:21:40.193471 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a2093c77-ba46-4b58-85a2-ca6f14d88e3e tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:21:40.268940 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-a2093c77-ba46-4b58-85a2-ca6f14d88e3e tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "POST /compute/v2.1/servers/cd1499ac-bb25-4ccd-8991-4d884118c0a7/action" status: 200 len: 14 microversion: 2.1 time: 0.118055 Oct 22 21:21:40.273733 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2747/5511] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 21:21:40 2022] POST /compute/v2.1/servers/cd1499ac-bb25-4ccd-8991-4d884118c0a7/action => generated 14 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 22 21:21:40.439944 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-f4f7792f-ad4d-4b5a-80f0-bf3410afd2c2 tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] Action: 'create', calling method: .version_select at 0x7fd39c413f70>, body: {"keypair": {"name": "tempest-TestServerBasicOps-143095622", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAzwixA33+KIbCFkaVpWGB3KSJNmfS7apTy+3spdQNrCZvbZpPwP2LoBly+jHa9LrANNRjvzXG03f/JeXT6JEbafgMN7WKyRuy6Smvy0ZES4k8mOFKXCDqevKS5r9e30Lw=="}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:21:40.472150 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-f4f7792f-ad4d-4b5a-80f0-bf3410afd2c2 tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] Getting quotas for project bc27a2de57354aa2a6d698b8b7b0094b. Resources: {'key_pairs'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 21:21:40.478256 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-f4f7792f-ad4d-4b5a-80f0-bf3410afd2c2 tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] Getting quotas for user a56d59cd5ede44edaba68a0d74e195ff and project bc27a2de57354aa2a6d698b8b7b0094b. Resources: {'key_pairs'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 21:21:40.561346 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-58df62df-325d-44ef-a751-014c9ca14486 tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:21:40.562195 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-58df62df-325d-44ef-a751-014c9ca14486 tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] [instance: 624cfc5a-03de-4c2b-9de5-bcd2d272aced] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:21:40.565128 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-f4f7792f-ad4d-4b5a-80f0-bf3410afd2c2 tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.422931 Oct 22 21:21:40.578429 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-58df62df-325d-44ef-a751-014c9ca14486 tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:21:40.579044 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-58df62df-325d-44ef-a751-014c9ca14486 tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:21:40.579550 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-58df62df-325d-44ef-a751-014c9ca14486 tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:21:40.580350 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-58df62df-325d-44ef-a751-014c9ca14486 tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:21:40.580747 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-58df62df-325d-44ef-a751-014c9ca14486 tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:21:40.581186 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-58df62df-325d-44ef-a751-014c9ca14486 tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:21:40.587056 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2765/5512] 10.222.0.18 () {60 vars in 1159 bytes} [Sat Oct 22 21:21:40 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:21:40.980280 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell0:SELECT=2 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:21:41.007068 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell0:SELECT=6 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:21:41.030408 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-58df62df-325d-44ef-a751-014c9ca14486 tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba127731b60241debcb374ac2e39c891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0b96ff22c5544c187ad917f367d9c28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:21:41.049974 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-58df62df-325d-44ef-a751-014c9ca14486 tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] 10.222.0.18 "GET /compute/v2.1/servers/624cfc5a-03de-4c2b-9de5-bcd2d272aced" status: 200 len: 1315 microversion: 2.1 time: 0.493724 Oct 22 21:21:41.051030 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2748/5513] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:21:40 2022] GET /compute/v2.1/servers/624cfc5a-03de-4c2b-9de5-bcd2d272aced => generated 1315 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:21:41.295804 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-5a78ce6e-2af6-4d3f-95fa-5bd913c10fd0 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:21:41.305795 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-5a78ce6e-2af6-4d3f-95fa-5bd913c10fd0 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: cd1499ac-bb25-4ccd-8991-4d884118c0a7] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:21:41.316131 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5a78ce6e-2af6-4d3f-95fa-5bd913c10fd0 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:21:41.319549 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5a78ce6e-2af6-4d3f-95fa-5bd913c10fd0 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:21:41.320475 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5a78ce6e-2af6-4d3f-95fa-5bd913c10fd0 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:21:41.324970 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5a78ce6e-2af6-4d3f-95fa-5bd913c10fd0 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:21:41.325762 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5a78ce6e-2af6-4d3f-95fa-5bd913c10fd0 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:21:41.326417 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5a78ce6e-2af6-4d3f-95fa-5bd913c10fd0 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:21:41.371227 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-4cae7a37-71ae-4604-8967-ba449662cdb5 req-ba57ee5c-2162-4acb-bdc7-0f6e5daf01f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "624cfc5a-03de-4c2b-9de5-bcd2d272aced", "name": "network-vif-plugged", "status": "completed", "tag": "48737af2-dc1c-4965-a93e-24b25f6f4aa2"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:21:41.409679 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-4cae7a37-71ae-4604-8967-ba449662cdb5 req-ba57ee5c-2162-4acb-bdc7-0f6e5daf01f2 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:21:41.411334 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-4cae7a37-71ae-4604-8967-ba449662cdb5 req-ba57ee5c-2162-4acb-bdc7-0f6e5daf01f2 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:21:41.412200 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-4cae7a37-71ae-4604-8967-ba449662cdb5 req-ba57ee5c-2162-4acb-bdc7-0f6e5daf01f2 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:21:41.432582 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-5a78ce6e-2af6-4d3f-95fa-5bd913c10fd0 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "POST /compute/v2.1/servers/cd1499ac-bb25-4ccd-8991-4d884118c0a7/action" status: 200 len: 14 microversion: 2.1 time: 0.154383 Oct 22 21:21:41.434099 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2766/5514] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 21:21:41 2022] POST /compute/v2.1/servers/cd1499ac-bb25-4ccd-8991-4d884118c0a7/action => generated 14 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 22 21:21:41.444311 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-4cae7a37-71ae-4604-8967-ba449662cdb5 req-ba57ee5c-2162-4acb-bdc7-0f6e5daf01f2 service nova] Creating event network-vif-plugged:48737af2-dc1c-4965-a93e-24b25f6f4aa2 for instance 624cfc5a-03de-4c2b-9de5-bcd2d272aced on nch2-master-1 Oct 22 21:21:41.451220 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-4cae7a37-71ae-4604-8967-ba449662cdb5 req-ba57ee5c-2162-4acb-bdc7-0f6e5daf01f2 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085247 Oct 22 21:21:41.453300 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2749/5515] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:21:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:21:42.073942 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-b5d425fa-71c9-45c7-97c3-1d9567910617 tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:21:42.076194 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-b5d425fa-71c9-45c7-97c3-1d9567910617 tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] [instance: 624cfc5a-03de-4c2b-9de5-bcd2d272aced] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:21:42.089355 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b5d425fa-71c9-45c7-97c3-1d9567910617 tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:21:42.089866 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b5d425fa-71c9-45c7-97c3-1d9567910617 tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:21:42.090358 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b5d425fa-71c9-45c7-97c3-1d9567910617 tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:21:42.091140 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b5d425fa-71c9-45c7-97c3-1d9567910617 tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:21:42.091645 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b5d425fa-71c9-45c7-97c3-1d9567910617 tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:21:42.096531 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b5d425fa-71c9-45c7-97c3-1d9567910617 tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:21:42.216871 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-43f10161-8d4d-4e19-af7d-0fd70cda46ec tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerBasicOps-server-1819706675", "imageRef": "085e4478-6edc-4a69-8e08-f9831713eb65", "flavorRef": "452", "key_name": "tempest-TestServerBasicOps-143095622", "security_groups": [{"name": "tempest-secgroup-smoke-1440069562"}], "config_drive": true, "metadata": {"meta1": "data1", "meta2": "data2", "metaN": "dataN"}, "networks": [{"uuid": "076fea02-1272-4c10-989d-2f1ad31b3a17"}]}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:21:42.437977 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-b5d425fa-71c9-45c7-97c3-1d9567910617 tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba127731b60241debcb374ac2e39c891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0b96ff22c5544c187ad917f367d9c28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:21:42.449248 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-b5d425fa-71c9-45c7-97c3-1d9567910617 tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] 10.222.0.18 "GET /compute/v2.1/servers/624cfc5a-03de-4c2b-9de5-bcd2d272aced" status: 200 len: 1315 microversion: 2.1 time: 0.379307 Oct 22 21:21:42.450962 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2767/5516] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:21:42 2022] GET /compute/v2.1/servers/624cfc5a-03de-4c2b-9de5-bcd2d272aced => generated 1315 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:21:42.454257 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.network.neutron [None req-43f10161-8d4d-4e19-af7d-0fd70cda46ec tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] validate_networks() for [('076fea02-1272-4c10-989d-2f1ad31b3a17', None, None, None, None, None)] {{(pid=138744) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 21:21:42.466820 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-837f5492-881d-4215-a4cf-7b2fb3e8025f tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:21:42.469889 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-837f5492-881d-4215-a4cf-7b2fb3e8025f tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: cd1499ac-bb25-4ccd-8991-4d884118c0a7] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:21:42.480392 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-837f5492-881d-4215-a4cf-7b2fb3e8025f tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:21:42.481442 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-837f5492-881d-4215-a4cf-7b2fb3e8025f tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:21:42.482016 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-837f5492-881d-4215-a4cf-7b2fb3e8025f tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:21:42.483276 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-837f5492-881d-4215-a4cf-7b2fb3e8025f tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:21:42.483479 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-837f5492-881d-4215-a4cf-7b2fb3e8025f tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:21:42.483937 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-837f5492-881d-4215-a4cf-7b2fb3e8025f tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:21:42.531122 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-837f5492-881d-4215-a4cf-7b2fb3e8025f tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "POST /compute/v2.1/servers/cd1499ac-bb25-4ccd-8991-4d884118c0a7/action" status: 200 len: 14 microversion: 2.1 time: 0.068903 Oct 22 21:21:42.532422 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2768/5517] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 21:21:42 2022] POST /compute/v2.1/servers/cd1499ac-bb25-4ccd-8991-4d884118c0a7/action => generated 14 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 22 21:21:43.123780 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-43f10161-8d4d-4e19-af7d-0fd70cda46ec tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] Getting quotas for project bc27a2de57354aa2a6d698b8b7b0094b. Resources: dict_keys(['metadata_items']) {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 21:21:43.130107 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-43f10161-8d4d-4e19-af7d-0fd70cda46ec tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] Getting quotas for user a56d59cd5ede44edaba68a0d74e195ff and project bc27a2de57354aa2a6d698b8b7b0094b. Resources: dict_keys(['metadata_items']) {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 21:21:43.146229 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-43f10161-8d4d-4e19-af7d-0fd70cda46ec tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] Flavor limits 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 21:21:43.146768 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-43f10161-8d4d-4e19-af7d-0fd70cda46ec tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] Image limits 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 21:21:43.147317 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-43f10161-8d4d-4e19-af7d-0fd70cda46ec tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] Flavor pref 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 21:21:43.147843 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-43f10161-8d4d-4e19-af7d-0fd70cda46ec tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] Image pref 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 21:21:43.148338 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-43f10161-8d4d-4e19-af7d-0fd70cda46ec tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 21:21:43.159265 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-43f10161-8d4d-4e19-af7d-0fd70cda46ec tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:21:43.160001 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-43f10161-8d4d-4e19-af7d-0fd70cda46ec tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:21:43.160516 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-43f10161-8d4d-4e19-af7d-0fd70cda46ec tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:21:43.161371 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-43f10161-8d4d-4e19-af7d-0fd70cda46ec tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:21:43.161827 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-43f10161-8d4d-4e19-af7d-0fd70cda46ec tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:21:43.162464 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-43f10161-8d4d-4e19-af7d-0fd70cda46ec tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:21:43.185155 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-43f10161-8d4d-4e19-af7d-0fd70cda46ec tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] Getting quotas for project bc27a2de57354aa2a6d698b8b7b0094b. Resources: {'cores', 'instances', 'ram'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 21:21:43.191317 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-43f10161-8d4d-4e19-af7d-0fd70cda46ec tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] Getting quotas for user a56d59cd5ede44edaba68a0d74e195ff and project bc27a2de57354aa2a6d698b8b7b0094b. Resources: {'cores', 'instances', 'ram'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 21:21:43.208601 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-43f10161-8d4d-4e19-af7d-0fd70cda46ec tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] Going to run 1 instances... {{(pid=138744) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 21:21:43.211501 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-43f10161-8d4d-4e19-af7d-0fd70cda46ec tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] [instance: 8dfe8aae-f5eb-4fcc-b801-7957bc9d608a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='085e4478-6edc-4a69-8e08-f9831713eb65',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138744) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 21:21:43.273356 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-43f10161-8d4d-4e19-af7d-0fd70cda46ec tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.061892 Oct 22 21:21:43.275491 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2750/5518] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Oct 22 21:21:42 2022] POST /compute/v2.1/servers => generated 406 bytes in 1065 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 22 21:21:43.286521 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-c77f3daf-4b42-4916-bc74-aaf528db6df8 tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:21:43.287250 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-c77f3daf-4b42-4916-bc74-aaf528db6df8 tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] [instance: 8dfe8aae-f5eb-4fcc-b801-7957bc9d608a] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:21:43.368662 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-c77f3daf-4b42-4916-bc74-aaf528db6df8 tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a56d59cd5ede44edaba68a0d74e195ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc27a2de57354aa2a6d698b8b7b0094b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:21:43.376760 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-c77f3daf-4b42-4916-bc74-aaf528db6df8 tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] 10.222.0.18 "GET /compute/v2.1/servers/8dfe8aae-f5eb-4fcc-b801-7957bc9d608a" status: 200 len: 1302 microversion: 2.1 time: 0.094587 Oct 22 21:21:43.380111 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2769/5519] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:21:43 2022] GET /compute/v2.1/servers/8dfe8aae-f5eb-4fcc-b801-7957bc9d608a => generated 1302 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:21:43.478277 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-45f9e08e-42cb-47a5-a7bd-51c28c2e1aa8 tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:21:43.479896 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-45f9e08e-42cb-47a5-a7bd-51c28c2e1aa8 tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] [instance: 624cfc5a-03de-4c2b-9de5-bcd2d272aced] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:21:43.490492 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-45f9e08e-42cb-47a5-a7bd-51c28c2e1aa8 tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:21:43.491681 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-45f9e08e-42cb-47a5-a7bd-51c28c2e1aa8 tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:21:43.492787 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-45f9e08e-42cb-47a5-a7bd-51c28c2e1aa8 tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:21:43.494342 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-45f9e08e-42cb-47a5-a7bd-51c28c2e1aa8 tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:21:43.494980 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-45f9e08e-42cb-47a5-a7bd-51c28c2e1aa8 tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:21:43.495332 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-45f9e08e-42cb-47a5-a7bd-51c28c2e1aa8 tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:21:43.543783 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-2d719532-f6ef-49f0-8c67-ba8cc7b6461c tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:21:43.546287 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-2d719532-f6ef-49f0-8c67-ba8cc7b6461c tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: cd1499ac-bb25-4ccd-8991-4d884118c0a7] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:21:43.563744 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2d719532-f6ef-49f0-8c67-ba8cc7b6461c tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:21:43.564259 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2d719532-f6ef-49f0-8c67-ba8cc7b6461c tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:21:43.564715 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2d719532-f6ef-49f0-8c67-ba8cc7b6461c tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:21:43.565449 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2d719532-f6ef-49f0-8c67-ba8cc7b6461c tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:21:43.565923 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2d719532-f6ef-49f0-8c67-ba8cc7b6461c tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:21:43.566369 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2d719532-f6ef-49f0-8c67-ba8cc7b6461c tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:21:43.608230 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-2d719532-f6ef-49f0-8c67-ba8cc7b6461c tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "POST /compute/v2.1/servers/cd1499ac-bb25-4ccd-8991-4d884118c0a7/action" status: 200 len: 14 microversion: 2.1 time: 0.068545 Oct 22 21:21:43.609447 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2770/5520] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 21:21:43 2022] POST /compute/v2.1/servers/cd1499ac-bb25-4ccd-8991-4d884118c0a7/action => generated 14 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 22 21:21:43.660126 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-45f9e08e-42cb-47a5-a7bd-51c28c2e1aa8 tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba127731b60241debcb374ac2e39c891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0b96ff22c5544c187ad917f367d9c28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:21:43.669657 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-45f9e08e-42cb-47a5-a7bd-51c28c2e1aa8 tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] 10.222.0.18 "GET /compute/v2.1/servers/624cfc5a-03de-4c2b-9de5-bcd2d272aced" status: 200 len: 1500 microversion: 2.1 time: 0.196929 Oct 22 21:21:43.670540 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2751/5521] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:21:43 2022] GET /compute/v2.1/servers/624cfc5a-03de-4c2b-9de5-bcd2d272aced => generated 1500 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:21:43.694747 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-92950272-6383-4b7a-9cbb-c950c9ed47d5 tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:21:43.695676 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-92950272-6383-4b7a-9cbb-c950c9ed47d5 tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] [instance: 624cfc5a-03de-4c2b-9de5-bcd2d272aced] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:21:43.703233 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-92950272-6383-4b7a-9cbb-c950c9ed47d5 tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:21:43.704464 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-92950272-6383-4b7a-9cbb-c950c9ed47d5 tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:21:43.705123 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-92950272-6383-4b7a-9cbb-c950c9ed47d5 tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:21:43.706197 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-92950272-6383-4b7a-9cbb-c950c9ed47d5 tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:21:43.706840 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-92950272-6383-4b7a-9cbb-c950c9ed47d5 tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:21:43.707483 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-92950272-6383-4b7a-9cbb-c950c9ed47d5 tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:21:43.902324 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-92950272-6383-4b7a-9cbb-c950c9ed47d5 tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba127731b60241debcb374ac2e39c891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0b96ff22c5544c187ad917f367d9c28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:21:43.911630 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-92950272-6383-4b7a-9cbb-c950c9ed47d5 tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] 10.222.0.18 "GET /compute/v2.1/servers/624cfc5a-03de-4c2b-9de5-bcd2d272aced" status: 200 len: 1500 microversion: 2.1 time: 0.221107 Oct 22 21:21:43.913030 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2771/5522] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:21:43 2022] GET /compute/v2.1/servers/624cfc5a-03de-4c2b-9de5-bcd2d272aced => generated 1500 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:21:43.938066 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-c776e373-b39d-480c-ab62-fb473349b79f tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:21:43.938906 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-c776e373-b39d-480c-ab62-fb473349b79f tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] [instance: 624cfc5a-03de-4c2b-9de5-bcd2d272aced] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:21:43.951087 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c776e373-b39d-480c-ab62-fb473349b79f tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:21:43.952164 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c776e373-b39d-480c-ab62-fb473349b79f tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:21:43.953126 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c776e373-b39d-480c-ab62-fb473349b79f tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:21:43.954281 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c776e373-b39d-480c-ab62-fb473349b79f tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:21:43.954995 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c776e373-b39d-480c-ab62-fb473349b79f tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:21:43.955579 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c776e373-b39d-480c-ab62-fb473349b79f tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:21:43.989583 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.objects.instance [None req-c776e373-b39d-480c-ab62-fb473349b79f tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Lazy-loading 'flavor' on Instance uuid 624cfc5a-03de-4c2b-9de5-bcd2d272aced {{(pid=138744) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 21:21:44.108227 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-c776e373-b39d-480c-ab62-fb473349b79f tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] 10.222.0.18 "POST /compute/v2.1/servers/624cfc5a-03de-4c2b-9de5-bcd2d272aced/action" status: 202 len: 0 microversion: 2.1 time: 0.173820 Oct 22 21:21:44.109902 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2752/5523] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 21:21:43 2022] POST /compute/v2.1/servers/624cfc5a-03de-4c2b-9de5-bcd2d272aced/action => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 21:21:44.127655 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-019740c0-8d71-41c6-96f8-926410ad8dab tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:21:44.131044 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-019740c0-8d71-41c6-96f8-926410ad8dab tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] [instance: 624cfc5a-03de-4c2b-9de5-bcd2d272aced] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:21:44.146447 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-019740c0-8d71-41c6-96f8-926410ad8dab tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:21:44.147865 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-019740c0-8d71-41c6-96f8-926410ad8dab tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:21:44.148584 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-019740c0-8d71-41c6-96f8-926410ad8dab tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:21:44.149336 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-019740c0-8d71-41c6-96f8-926410ad8dab tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:21:44.150040 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-019740c0-8d71-41c6-96f8-926410ad8dab tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:21:44.150504 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-019740c0-8d71-41c6-96f8-926410ad8dab tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:21:44.337025 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-019740c0-8d71-41c6-96f8-926410ad8dab tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba127731b60241debcb374ac2e39c891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0b96ff22c5544c187ad917f367d9c28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:21:44.346004 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-019740c0-8d71-41c6-96f8-926410ad8dab tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] 10.222.0.18 "GET /compute/v2.1/servers/624cfc5a-03de-4c2b-9de5-bcd2d272aced" status: 200 len: 1508 microversion: 2.1 time: 0.230921 Oct 22 21:21:44.346751 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2772/5524] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:21:44 2022] GET /compute/v2.1/servers/624cfc5a-03de-4c2b-9de5-bcd2d272aced => generated 1508 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:21:44.400945 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-0d0a9d49-861b-4f12-9a20-4f3b7a6280ae tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:21:44.401933 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-0d0a9d49-861b-4f12-9a20-4f3b7a6280ae tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] [instance: 8dfe8aae-f5eb-4fcc-b801-7957bc9d608a] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:21:44.409160 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0d0a9d49-861b-4f12-9a20-4f3b7a6280ae tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:21:44.409928 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0d0a9d49-861b-4f12-9a20-4f3b7a6280ae tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:21:44.410381 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0d0a9d49-861b-4f12-9a20-4f3b7a6280ae tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:21:44.411102 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0d0a9d49-861b-4f12-9a20-4f3b7a6280ae tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:21:44.411598 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0d0a9d49-861b-4f12-9a20-4f3b7a6280ae tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:21:44.412035 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0d0a9d49-861b-4f12-9a20-4f3b7a6280ae tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:21:44.495976 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-0d0a9d49-861b-4f12-9a20-4f3b7a6280ae tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a56d59cd5ede44edaba68a0d74e195ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc27a2de57354aa2a6d698b8b7b0094b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:21:44.505020 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-0d0a9d49-861b-4f12-9a20-4f3b7a6280ae tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] 10.222.0.18 "GET /compute/v2.1/servers/8dfe8aae-f5eb-4fcc-b801-7957bc9d608a" status: 200 len: 1298 microversion: 2.1 time: 0.108454 Oct 22 21:21:44.520398 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2753/5525] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:21:44 2022] GET /compute/v2.1/servers/8dfe8aae-f5eb-4fcc-b801-7957bc9d608a => generated 1298 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:21:44.620669 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-9a314459-79c8-40b3-8841-e8a3771506e6 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:21:44.623756 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-9a314459-79c8-40b3-8841-e8a3771506e6 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: cd1499ac-bb25-4ccd-8991-4d884118c0a7] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:21:44.640987 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9a314459-79c8-40b3-8841-e8a3771506e6 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:21:44.641411 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9a314459-79c8-40b3-8841-e8a3771506e6 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:21:44.647896 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9a314459-79c8-40b3-8841-e8a3771506e6 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:21:44.649560 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9a314459-79c8-40b3-8841-e8a3771506e6 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:21:44.649772 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9a314459-79c8-40b3-8841-e8a3771506e6 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:21:44.650230 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9a314459-79c8-40b3-8841-e8a3771506e6 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:21:44.704613 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-9a314459-79c8-40b3-8841-e8a3771506e6 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "POST /compute/v2.1/servers/cd1499ac-bb25-4ccd-8991-4d884118c0a7/action" status: 200 len: 14 microversion: 2.1 time: 0.088113 Oct 22 21:21:44.709544 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2773/5526] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 21:21:44 2022] POST /compute/v2.1/servers/cd1499ac-bb25-4ccd-8991-4d884118c0a7/action => generated 14 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 22 21:21:45.370921 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-89935c0d-bc70-477f-83f4-78eb2c360d30 tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:21:45.372453 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-89935c0d-bc70-477f-83f4-78eb2c360d30 tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] [instance: 624cfc5a-03de-4c2b-9de5-bcd2d272aced] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:21:45.382324 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-89935c0d-bc70-477f-83f4-78eb2c360d30 tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:21:45.383365 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-89935c0d-bc70-477f-83f4-78eb2c360d30 tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:21:45.383994 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-89935c0d-bc70-477f-83f4-78eb2c360d30 tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:21:45.385492 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-89935c0d-bc70-477f-83f4-78eb2c360d30 tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:21:45.385952 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-89935c0d-bc70-477f-83f4-78eb2c360d30 tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:21:45.386525 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-89935c0d-bc70-477f-83f4-78eb2c360d30 tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:21:45.531648 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-90cc0fa7-8414-4a83-bf40-71d81b7576f7 tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:21:45.533068 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-90cc0fa7-8414-4a83-bf40-71d81b7576f7 tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] [instance: 8dfe8aae-f5eb-4fcc-b801-7957bc9d608a] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:21:45.548364 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-90cc0fa7-8414-4a83-bf40-71d81b7576f7 tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:21:45.549058 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-90cc0fa7-8414-4a83-bf40-71d81b7576f7 tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:21:45.549733 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-90cc0fa7-8414-4a83-bf40-71d81b7576f7 tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:21:45.555851 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-90cc0fa7-8414-4a83-bf40-71d81b7576f7 tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:21:45.556678 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-90cc0fa7-8414-4a83-bf40-71d81b7576f7 tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:21:45.557161 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-90cc0fa7-8414-4a83-bf40-71d81b7576f7 tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:21:45.604127 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-89935c0d-bc70-477f-83f4-78eb2c360d30 tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba127731b60241debcb374ac2e39c891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0b96ff22c5544c187ad917f367d9c28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:21:45.612062 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-89935c0d-bc70-477f-83f4-78eb2c360d30 tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] 10.222.0.18 "GET /compute/v2.1/servers/624cfc5a-03de-4c2b-9de5-bcd2d272aced" status: 200 len: 1491 microversion: 2.1 time: 0.245583 Oct 22 21:21:45.612638 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2754/5527] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:21:45 2022] GET /compute/v2.1/servers/624cfc5a-03de-4c2b-9de5-bcd2d272aced => generated 1491 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:21:45.643505 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-793511dd-3547-486c-b87e-0ad7a30ca04d tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:21:45.646848 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-793511dd-3547-486c-b87e-0ad7a30ca04d tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] [instance: 624cfc5a-03de-4c2b-9de5-bcd2d272aced] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:21:45.657386 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-793511dd-3547-486c-b87e-0ad7a30ca04d tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:21:45.658155 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-793511dd-3547-486c-b87e-0ad7a30ca04d tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:21:45.658797 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-793511dd-3547-486c-b87e-0ad7a30ca04d tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:21:45.659554 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-793511dd-3547-486c-b87e-0ad7a30ca04d tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:21:45.660199 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-793511dd-3547-486c-b87e-0ad7a30ca04d tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:21:45.660804 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-793511dd-3547-486c-b87e-0ad7a30ca04d tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:21:45.683105 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-90cc0fa7-8414-4a83-bf40-71d81b7576f7 tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a56d59cd5ede44edaba68a0d74e195ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc27a2de57354aa2a6d698b8b7b0094b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:21:45.693724 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-90cc0fa7-8414-4a83-bf40-71d81b7576f7 tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] 10.222.0.18 "GET /compute/v2.1/servers/8dfe8aae-f5eb-4fcc-b801-7957bc9d608a" status: 200 len: 1354 microversion: 2.1 time: 0.166986 Oct 22 21:21:45.694327 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2774/5528] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:21:45 2022] GET /compute/v2.1/servers/8dfe8aae-f5eb-4fcc-b801-7957bc9d608a => generated 1354 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:21:45.714430 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:21:45.726483 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-b240b942-3569-4d42-9084-211ea171e863 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:21:45.736439 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-b240b942-3569-4d42-9084-211ea171e863 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: cd1499ac-bb25-4ccd-8991-4d884118c0a7] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:21:45.743315 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-793511dd-3547-486c-b87e-0ad7a30ca04d tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] 10.222.0.18 "POST /compute/v2.1/servers/624cfc5a-03de-4c2b-9de5-bcd2d272aced/action" status: 202 len: 0 microversion: 2.1 time: 0.103414 Oct 22 21:21:45.744275 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b240b942-3569-4d42-9084-211ea171e863 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:21:45.744638 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b240b942-3569-4d42-9084-211ea171e863 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:21:45.745092 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b240b942-3569-4d42-9084-211ea171e863 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:21:45.750687 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b240b942-3569-4d42-9084-211ea171e863 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:21:45.751577 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2755/5529] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 21:21:45 2022] POST /compute/v2.1/servers/624cfc5a-03de-4c2b-9de5-bcd2d272aced/action => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 21:21:45.759287 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-5da81670-57a8-4646-b5db-98e058b46f5c tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:21:45.760166 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-5da81670-57a8-4646-b5db-98e058b46f5c tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] [instance: 624cfc5a-03de-4c2b-9de5-bcd2d272aced] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:21:45.770143 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5da81670-57a8-4646-b5db-98e058b46f5c tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:21:45.770527 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5da81670-57a8-4646-b5db-98e058b46f5c tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:21:45.770975 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5da81670-57a8-4646-b5db-98e058b46f5c tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:21:45.771733 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5da81670-57a8-4646-b5db-98e058b46f5c tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:21:45.777238 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5da81670-57a8-4646-b5db-98e058b46f5c tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:21:45.777423 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b240b942-3569-4d42-9084-211ea171e863 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.027s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:21:45.777976 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b240b942-3569-4d42-9084-211ea171e863 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:21:45.778988 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5da81670-57a8-4646-b5db-98e058b46f5c tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:21:45.890009 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-b240b942-3569-4d42-9084-211ea171e863 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "POST /compute/v2.1/servers/cd1499ac-bb25-4ccd-8991-4d884118c0a7/action" status: 200 len: 14 microversion: 2.1 time: 0.170946 Oct 22 21:21:45.890992 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2775/5530] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 21:21:45 2022] POST /compute/v2.1/servers/cd1499ac-bb25-4ccd-8991-4d884118c0a7/action => generated 14 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 22 21:21:46.075377 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-5da81670-57a8-4646-b5db-98e058b46f5c tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba127731b60241debcb374ac2e39c891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0b96ff22c5544c187ad917f367d9c28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:21:46.085407 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-5da81670-57a8-4646-b5db-98e058b46f5c tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] 10.222.0.18 "GET /compute/v2.1/servers/624cfc5a-03de-4c2b-9de5-bcd2d272aced" status: 200 len: 1497 microversion: 2.1 time: 0.331571 Oct 22 21:21:46.093575 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2756/5531] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:21:45 2022] GET /compute/v2.1/servers/624cfc5a-03de-4c2b-9de5-bcd2d272aced => generated 1497 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:21:46.720381 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-cd6d3e23-8f7a-4b54-b993-9ab468bce9d8 tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:21:46.721401 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-cd6d3e23-8f7a-4b54-b993-9ab468bce9d8 tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] [instance: 8dfe8aae-f5eb-4fcc-b801-7957bc9d608a] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:21:46.751660 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cd6d3e23-8f7a-4b54-b993-9ab468bce9d8 tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:21:46.752182 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cd6d3e23-8f7a-4b54-b993-9ab468bce9d8 tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:21:46.753214 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cd6d3e23-8f7a-4b54-b993-9ab468bce9d8 tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:21:46.754678 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cd6d3e23-8f7a-4b54-b993-9ab468bce9d8 tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:21:46.755431 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cd6d3e23-8f7a-4b54-b993-9ab468bce9d8 tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:21:46.756312 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cd6d3e23-8f7a-4b54-b993-9ab468bce9d8 tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:21:46.870471 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-cd6d3e23-8f7a-4b54-b993-9ab468bce9d8 tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a56d59cd5ede44edaba68a0d74e195ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc27a2de57354aa2a6d698b8b7b0094b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:21:46.888435 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-cd6d3e23-8f7a-4b54-b993-9ab468bce9d8 tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] 10.222.0.18 "GET /compute/v2.1/servers/8dfe8aae-f5eb-4fcc-b801-7957bc9d608a" status: 200 len: 1360 microversion: 2.1 time: 0.173575 Oct 22 21:21:46.889527 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2776/5532] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:21:46 2022] GET /compute/v2.1/servers/8dfe8aae-f5eb-4fcc-b801-7957bc9d608a => generated 1360 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:21:46.905585 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-81a1d89c-cfa3-444c-85fc-c34080035225 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:21:46.908961 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-81a1d89c-cfa3-444c-85fc-c34080035225 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: cd1499ac-bb25-4ccd-8991-4d884118c0a7] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:21:46.916571 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-81a1d89c-cfa3-444c-85fc-c34080035225 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:21:46.918269 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-81a1d89c-cfa3-444c-85fc-c34080035225 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:21:46.919024 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-81a1d89c-cfa3-444c-85fc-c34080035225 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:21:46.919957 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-81a1d89c-cfa3-444c-85fc-c34080035225 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:21:46.920574 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-81a1d89c-cfa3-444c-85fc-c34080035225 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:21:46.921161 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-81a1d89c-cfa3-444c-85fc-c34080035225 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:21:46.986183 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-81a1d89c-cfa3-444c-85fc-c34080035225 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "POST /compute/v2.1/servers/cd1499ac-bb25-4ccd-8991-4d884118c0a7/action" status: 200 len: 8207 microversion: 2.1 time: 0.086613 Oct 22 21:21:46.991429 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2757/5533] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 21:21:46 2022] POST /compute/v2.1/servers/cd1499ac-bb25-4ccd-8991-4d884118c0a7/action => generated 8207 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:21:47.000487 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-6cfde27e-3c52-47f9-a852-4fb2dc589e7a tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:21:47.001206 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-6cfde27e-3c52-47f9-a852-4fb2dc589e7a tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: 20d90b58-3fad-4a44-b6bf-4ef0cc587def] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:21:47.008512 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6cfde27e-3c52-47f9-a852-4fb2dc589e7a tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:21:47.009023 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6cfde27e-3c52-47f9-a852-4fb2dc589e7a tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:21:47.009473 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6cfde27e-3c52-47f9-a852-4fb2dc589e7a tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:21:47.010197 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6cfde27e-3c52-47f9-a852-4fb2dc589e7a tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:21:47.010662 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6cfde27e-3c52-47f9-a852-4fb2dc589e7a tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:21:47.011259 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6cfde27e-3c52-47f9-a852-4fb2dc589e7a tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:21:47.119300 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-92f5fab8-9a05-473c-9366-f8fbd15bed54 tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:21:47.120042 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-92f5fab8-9a05-473c-9366-f8fbd15bed54 tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] [instance: 624cfc5a-03de-4c2b-9de5-bcd2d272aced] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:21:47.127412 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-92f5fab8-9a05-473c-9366-f8fbd15bed54 tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:21:47.128171 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-92f5fab8-9a05-473c-9366-f8fbd15bed54 tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:21:47.129051 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-92f5fab8-9a05-473c-9366-f8fbd15bed54 tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:21:47.129925 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-92f5fab8-9a05-473c-9366-f8fbd15bed54 tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:21:47.131555 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-92f5fab8-9a05-473c-9366-f8fbd15bed54 tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:21:47.131844 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-92f5fab8-9a05-473c-9366-f8fbd15bed54 tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:21:47.467161 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-6cfde27e-3c52-47f9-a852-4fb2dc589e7a tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c85602851244d4a632b9c861eb4416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45cb377c6a9a43b3b91c99a64e37f1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:21:47.476359 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-6cfde27e-3c52-47f9-a852-4fb2dc589e7a tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def" status: 200 len: 1669 microversion: 2.1 time: 0.482285 Oct 22 21:21:47.476930 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2777/5534] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:21:46 2022] GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def => generated 1669 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:21:47.502087 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-06e278e2-6c1b-4e3e-8817-1cd4243f2c76 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:21:47.502729 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-06e278e2-6c1b-4e3e-8817-1cd4243f2c76 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: 20d90b58-3fad-4a44-b6bf-4ef0cc587def] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:21:47.509460 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-06e278e2-6c1b-4e3e-8817-1cd4243f2c76 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:21:47.509934 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-06e278e2-6c1b-4e3e-8817-1cd4243f2c76 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:21:47.510600 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-06e278e2-6c1b-4e3e-8817-1cd4243f2c76 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:21:47.511589 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-06e278e2-6c1b-4e3e-8817-1cd4243f2c76 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:21:47.512435 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-06e278e2-6c1b-4e3e-8817-1cd4243f2c76 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:21:47.513106 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-06e278e2-6c1b-4e3e-8817-1cd4243f2c76 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:21:47.524089 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-92f5fab8-9a05-473c-9366-f8fbd15bed54 tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba127731b60241debcb374ac2e39c891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0b96ff22c5544c187ad917f367d9c28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:21:47.538019 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-92f5fab8-9a05-473c-9366-f8fbd15bed54 tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] 10.222.0.18 "GET /compute/v2.1/servers/624cfc5a-03de-4c2b-9de5-bcd2d272aced" status: 200 len: 1497 microversion: 2.1 time: 0.424210 Oct 22 21:21:47.539333 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2758/5535] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:21:47 2022] GET /compute/v2.1/servers/624cfc5a-03de-4c2b-9de5-bcd2d272aced => generated 1497 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:21:47.736438 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-06e278e2-6c1b-4e3e-8817-1cd4243f2c76 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c85602851244d4a632b9c861eb4416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45cb377c6a9a43b3b91c99a64e37f1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:21:47.745379 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-06e278e2-6c1b-4e3e-8817-1cd4243f2c76 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def" status: 200 len: 1669 microversion: 2.1 time: 0.247358 Oct 22 21:21:47.746339 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2778/5536] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:21:47 2022] GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def => generated 1669 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:21:47.770234 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-fb2eeb5a-788d-4313-b7fc-3a30abec35d1 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:21:47.770940 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-fb2eeb5a-788d-4313-b7fc-3a30abec35d1 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: 20d90b58-3fad-4a44-b6bf-4ef0cc587def] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:21:47.784683 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fb2eeb5a-788d-4313-b7fc-3a30abec35d1 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:21:47.785547 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fb2eeb5a-788d-4313-b7fc-3a30abec35d1 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:21:47.786175 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fb2eeb5a-788d-4313-b7fc-3a30abec35d1 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:21:47.787934 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fb2eeb5a-788d-4313-b7fc-3a30abec35d1 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:21:47.790506 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fb2eeb5a-788d-4313-b7fc-3a30abec35d1 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:21:47.792137 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fb2eeb5a-788d-4313-b7fc-3a30abec35d1 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:21:47.917385 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-3be2d5da-dced-4552-8cca-017a9a8ac82e tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:21:47.918019 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-3be2d5da-dced-4552-8cca-017a9a8ac82e tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] [instance: 8dfe8aae-f5eb-4fcc-b801-7957bc9d608a] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:21:47.931580 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3be2d5da-dced-4552-8cca-017a9a8ac82e tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:21:47.932095 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3be2d5da-dced-4552-8cca-017a9a8ac82e tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:21:47.932548 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3be2d5da-dced-4552-8cca-017a9a8ac82e tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:21:47.933378 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3be2d5da-dced-4552-8cca-017a9a8ac82e tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:21:47.933737 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3be2d5da-dced-4552-8cca-017a9a8ac82e tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:21:47.942023 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3be2d5da-dced-4552-8cca-017a9a8ac82e tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:21:48.096719 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-fb2eeb5a-788d-4313-b7fc-3a30abec35d1 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c85602851244d4a632b9c861eb4416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45cb377c6a9a43b3b91c99a64e37f1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:21:48.112642 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-fb2eeb5a-788d-4313-b7fc-3a30abec35d1 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def" status: 200 len: 1669 microversion: 2.1 time: 0.347418 Oct 22 21:21:48.113262 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2759/5537] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:21:47 2022] GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def => generated 1669 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:21:48.141191 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-65ef24da-8694-4c35-9ecf-7d65aaf7efa6 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:21:48.141815 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-65ef24da-8694-4c35-9ecf-7d65aaf7efa6 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: 20d90b58-3fad-4a44-b6bf-4ef0cc587def] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:21:48.150755 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-65ef24da-8694-4c35-9ecf-7d65aaf7efa6 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:21:48.151265 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-65ef24da-8694-4c35-9ecf-7d65aaf7efa6 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:21:48.151754 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-65ef24da-8694-4c35-9ecf-7d65aaf7efa6 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:21:48.152463 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-65ef24da-8694-4c35-9ecf-7d65aaf7efa6 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:21:48.153049 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-65ef24da-8694-4c35-9ecf-7d65aaf7efa6 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:21:48.153486 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-65ef24da-8694-4c35-9ecf-7d65aaf7efa6 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:21:48.702489 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-3be2d5da-dced-4552-8cca-017a9a8ac82e tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a56d59cd5ede44edaba68a0d74e195ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc27a2de57354aa2a6d698b8b7b0094b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:21:48.711416 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-3be2d5da-dced-4552-8cca-017a9a8ac82e tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] 10.222.0.18 "GET /compute/v2.1/servers/8dfe8aae-f5eb-4fcc-b801-7957bc9d608a" status: 200 len: 1428 microversion: 2.1 time: 0.798369 Oct 22 21:21:48.712560 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2779/5538] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:21:47 2022] GET /compute/v2.1/servers/8dfe8aae-f5eb-4fcc-b801-7957bc9d608a => generated 1428 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:21:48.717658 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-b15c3f61-7e61-48ad-9b65-d0a8380ab87e tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:21:48.718451 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-b15c3f61-7e61-48ad-9b65-d0a8380ab87e tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] [instance: 624cfc5a-03de-4c2b-9de5-bcd2d272aced] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:21:48.733355 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b15c3f61-7e61-48ad-9b65-d0a8380ab87e tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:21:48.734272 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b15c3f61-7e61-48ad-9b65-d0a8380ab87e tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:21:48.734731 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b15c3f61-7e61-48ad-9b65-d0a8380ab87e tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:21:48.735484 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b15c3f61-7e61-48ad-9b65-d0a8380ab87e tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:21:48.736006 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b15c3f61-7e61-48ad-9b65-d0a8380ab87e tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:21:48.736451 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b15c3f61-7e61-48ad-9b65-d0a8380ab87e tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:21:48.866997 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-65ef24da-8694-4c35-9ecf-7d65aaf7efa6 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c85602851244d4a632b9c861eb4416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45cb377c6a9a43b3b91c99a64e37f1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:21:48.879048 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-65ef24da-8694-4c35-9ecf-7d65aaf7efa6 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def" status: 200 len: 1669 microversion: 2.1 time: 0.742065 Oct 22 21:21:48.885957 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2760/5539] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:21:48 2022] GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def => generated 1669 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:21:48.901813 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-d4d6e1bd-e655-49bc-8a7f-ce14d2db119c tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Action: 'action', calling method: >, body: {"lock": {}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:21:48.902652 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-d4d6e1bd-e655-49bc-8a7f-ce14d2db119c tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: 20d90b58-3fad-4a44-b6bf-4ef0cc587def] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:21:48.909708 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d4d6e1bd-e655-49bc-8a7f-ce14d2db119c tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:21:48.910395 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d4d6e1bd-e655-49bc-8a7f-ce14d2db119c tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:21:48.910836 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d4d6e1bd-e655-49bc-8a7f-ce14d2db119c tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:21:48.911578 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d4d6e1bd-e655-49bc-8a7f-ce14d2db119c tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:21:48.912200 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d4d6e1bd-e655-49bc-8a7f-ce14d2db119c tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:21:48.912810 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d4d6e1bd-e655-49bc-8a7f-ce14d2db119c tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:21:48.957772 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-d4d6e1bd-e655-49bc-8a7f-ce14d2db119c tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: 20d90b58-3fad-4a44-b6bf-4ef0cc587def] Locking {{(pid=138744) lock /opt/stack/nova/nova/compute/api.py:4845}} Oct 22 21:21:49.004331 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-b15c3f61-7e61-48ad-9b65-d0a8380ab87e tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba127731b60241debcb374ac2e39c891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0b96ff22c5544c187ad917f367d9c28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:21:49.017196 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-b15c3f61-7e61-48ad-9b65-d0a8380ab87e tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] 10.222.0.18 "GET /compute/v2.1/servers/624cfc5a-03de-4c2b-9de5-bcd2d272aced" status: 200 len: 1500 microversion: 2.1 time: 0.302966 Oct 22 21:21:49.019117 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2780/5540] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:21:48 2022] GET /compute/v2.1/servers/624cfc5a-03de-4c2b-9de5-bcd2d272aced => generated 1500 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:21:49.020670 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-d4d6e1bd-e655-49bc-8a7f-ce14d2db119c tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "POST /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def/action" status: 202 len: 0 microversion: 2.1 time: 0.122718 Oct 22 21:21:49.021779 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2761/5541] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 21:21:48 2022] POST /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def/action => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 22 21:21:49.045484 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-0b57a9f9-d27a-43f3-ad48-cb2e6bfa2276 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:21:49.046373 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-0b57a9f9-d27a-43f3-ad48-cb2e6bfa2276 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: 20d90b58-3fad-4a44-b6bf-4ef0cc587def] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:21:49.052319 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-6f7d9a9d-f1de-4bee-8bd8-7ca1f6adfbdf tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:21:49.053313 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-6f7d9a9d-f1de-4bee-8bd8-7ca1f6adfbdf tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] [instance: 624cfc5a-03de-4c2b-9de5-bcd2d272aced] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:21:49.056131 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0b57a9f9-d27a-43f3-ad48-cb2e6bfa2276 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:21:49.057068 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0b57a9f9-d27a-43f3-ad48-cb2e6bfa2276 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:21:49.057725 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0b57a9f9-d27a-43f3-ad48-cb2e6bfa2276 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:21:49.059154 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0b57a9f9-d27a-43f3-ad48-cb2e6bfa2276 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:21:49.059863 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0b57a9f9-d27a-43f3-ad48-cb2e6bfa2276 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:21:49.060313 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0b57a9f9-d27a-43f3-ad48-cb2e6bfa2276 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:21:49.065222 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6f7d9a9d-f1de-4bee-8bd8-7ca1f6adfbdf tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:21:49.065742 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6f7d9a9d-f1de-4bee-8bd8-7ca1f6adfbdf tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:21:49.066302 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6f7d9a9d-f1de-4bee-8bd8-7ca1f6adfbdf tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:21:49.067119 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6f7d9a9d-f1de-4bee-8bd8-7ca1f6adfbdf tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:21:49.067795 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6f7d9a9d-f1de-4bee-8bd8-7ca1f6adfbdf tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:21:49.068377 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6f7d9a9d-f1de-4bee-8bd8-7ca1f6adfbdf tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:21:49.092741 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.objects.instance [None req-6f7d9a9d-f1de-4bee-8bd8-7ca1f6adfbdf tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Lazy-loading 'flavor' on Instance uuid 624cfc5a-03de-4c2b-9de5-bcd2d272aced {{(pid=138744) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 21:21:49.166451 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-6f7d9a9d-f1de-4bee-8bd8-7ca1f6adfbdf tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] 10.222.0.18 "POST /compute/v2.1/servers/624cfc5a-03de-4c2b-9de5-bcd2d272aced/action" status: 202 len: 0 microversion: 2.1 time: 0.121965 Oct 22 21:21:49.170649 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2762/5542] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 21:21:49 2022] POST /compute/v2.1/servers/624cfc5a-03de-4c2b-9de5-bcd2d272aced/action => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 22 21:21:49.176132 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-5f571f79-6a4d-448b-aa72-f9ec3779a85e tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:21:49.177248 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-5f571f79-6a4d-448b-aa72-f9ec3779a85e tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] [instance: 624cfc5a-03de-4c2b-9de5-bcd2d272aced] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:21:49.183268 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5f571f79-6a4d-448b-aa72-f9ec3779a85e tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:21:49.183949 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5f571f79-6a4d-448b-aa72-f9ec3779a85e tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:21:49.184394 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5f571f79-6a4d-448b-aa72-f9ec3779a85e tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:21:49.185189 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5f571f79-6a4d-448b-aa72-f9ec3779a85e tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:21:49.185643 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5f571f79-6a4d-448b-aa72-f9ec3779a85e tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:21:49.186070 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5f571f79-6a4d-448b-aa72-f9ec3779a85e tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:21:49.451730 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-0b57a9f9-d27a-43f3-ad48-cb2e6bfa2276 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c85602851244d4a632b9c861eb4416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45cb377c6a9a43b3b91c99a64e37f1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:21:49.459741 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-0b57a9f9-d27a-43f3-ad48-cb2e6bfa2276 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def" status: 200 len: 1669 microversion: 2.1 time: 0.422136 Oct 22 21:21:49.460492 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2781/5543] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:21:49 2022] GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def => generated 1669 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:21:49.483551 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-cf1a5afb-6601-497b-b815-746fc3225c4c tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:21:49.489755 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cf1a5afb-6601-497b-b815-746fc3225c4c tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:21:49.490264 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cf1a5afb-6601-497b-b815-746fc3225c4c tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:21:49.490717 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cf1a5afb-6601-497b-b815-746fc3225c4c tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:21:49.494467 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell1:SELECT=100 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:21:49.515266 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.wsgi [None req-cf1a5afb-6601-497b-b815-746fc3225c4c tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] HTTP exception thrown: Instance 20d90b58-3fad-4a44-b6bf-4ef0cc587def is locked Oct 22 21:21:49.517035 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-cf1a5afb-6601-497b-b815-746fc3225c4c tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Request method failure captured: Oct 22 21:21:49.517035 ncdv-master-1 devstack@n-api.service[138745]: request: POST /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def/action HTTP/1.1 Oct 22 21:21:49.517035 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 21:21:49.517035 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 21:21:49.517035 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 21:21:49.517035 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 15 Oct 22 21:21:49.517035 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 21:21:49.517035 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 21:21:49.517035 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 21:21:49.517035 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 21:21:49.517035 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVF3y1V_7LM2bhyK99NoBFe-giEKTnFpuE3vTdYnEguljVUwfbfRxJXkNvk85nVw_XeG4HF30bHcflxpdsNI0PNyKAune8z480A5-3qJ8_UazcBtA79by1AUQbwspb5BhIfKTMrxZg2NgkizpxDUW1lw64wnpVqXMU0a0fzQqvfH1TU4 Oct 22 21:21:49.517035 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 21:21:49.517035 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 21:21:49.517035 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 21:21:49.517035 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 21:21:49.517035 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 21:21:49.517035 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 21:21:49.517035 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: 45cb377c6a9a43b3b91c99a64e37f1eb Oct 22 21:21:49.517035 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-ServerActionsTestJSON-274049943 Oct 22 21:21:49.517035 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 21:21:49.517035 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 21:21:49.517035 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_45cb377c6a9a43b3b91c99a64e37f1eb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/45cb377c6a9a43b3b91c99a64e37f1eb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/45cb377c6a9a43b3b91c99a64e37f1eb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/45cb377c6a9a43b3b91c99a64e37f1eb"}]}] Oct 22 21:21:49.517035 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-ServerActionsTestJSON-274049943 Oct 22 21:21:49.517035 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: 45cb377c6a9a43b3b91c99a64e37f1eb Oct 22 21:21:49.517035 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-ServerActionsTestJSON-274049943 Oct 22 21:21:49.517035 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-ServerActionsTestJSON-274049943-project Oct 22 21:21:49.517035 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 21:21:49.517035 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 21:21:49.517035 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: c9c85602851244d4a632b9c861eb4416 Oct 22 21:21:49.517035 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-ServerActionsTestJSON-274049943-project Oct 22 21:21:49.517035 ncdv-master-1 devstack@n-api.service[138745]: Oct 22 21:21:49.517035 ncdv-master-1 devstack@n-api.service[138745]: {"os-stop": {}} Oct 22 21:21:49.517035 ncdv-master-1 devstack@n-api.service[138745]: method: > Oct 22 21:21:49.517035 ncdv-master-1 devstack@n-api.service[138745]: exception: Instance 20d90b58-3fad-4a44-b6bf-4ef0cc587def is locked Oct 22 21:21:49.517035 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'id': '20d90b58-3fad-4a44-b6bf-4ef0cc587def', 'body': {'os-stop': {}}} Oct 22 21:21:49.517035 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:21:49.517035 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:21:49.517035 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1449, in _stop_server Oct 22 21:21:49.517035 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi self.compute_api.stop(context, instance) Oct 22 21:21:49.517035 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 240, in inner Oct 22 21:21:49.517035 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.InstanceIsLocked(instance_uuid=instance.uuid) Oct 22 21:21:49.517035 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceIsLocked: Instance 20d90b58-3fad-4a44-b6bf-4ef0cc587def is locked Oct 22 21:21:49.517035 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:21:49.517035 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:21:49.517035 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:21:49.517035 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:21:49.517035 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:21:49.517035 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:21:49.517035 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:21:49.517035 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:21:49.517035 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:21:49.517035 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:21:49.517035 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1451, in _stop_server Oct 22 21:21:49.517035 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=e.format_message()) Oct 22 21:21:49.517035 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Instance 20d90b58-3fad-4a44-b6bf-4ef0cc587def is locked Oct 22 21:21:49.517035 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:21:49.517035 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:21:49.517035 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:21:49.517035 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:21:49.517035 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:21:49.517035 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:21:49.517035 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:21:49.517035 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:21:49.517035 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20d90b58-3fad-4a44-b6bf-4ef0cc587def is locked Oct 22 21:21:49.517035 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:21:49.522713 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-cf1a5afb-6601-497b-b815-746fc3225c4c tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Returning 409 to user: Instance 20d90b58-3fad-4a44-b6bf-4ef0cc587def is locked {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:21:49.522713 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-cf1a5afb-6601-497b-b815-746fc3225c4c tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "POST /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def/action" status: 409 len: 107 microversion: 2.1 time: 0.039192 Oct 22 21:21:49.522713 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2782/5544] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 21:21:49 2022] POST /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def/action => generated 107 bytes in 40 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 22 21:21:49.531288 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-23598707-4151-436b-91f2-a0f761f3cf4f tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:21:49.531902 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-23598707-4151-436b-91f2-a0f761f3cf4f tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: 20d90b58-3fad-4a44-b6bf-4ef0cc587def] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:21:49.538083 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-23598707-4151-436b-91f2-a0f761f3cf4f tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:21:49.538586 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-23598707-4151-436b-91f2-a0f761f3cf4f tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:21:49.539041 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-23598707-4151-436b-91f2-a0f761f3cf4f tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:21:49.539768 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-23598707-4151-436b-91f2-a0f761f3cf4f tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:21:49.540237 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-23598707-4151-436b-91f2-a0f761f3cf4f tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:21:49.540677 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-23598707-4151-436b-91f2-a0f761f3cf4f tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:21:49.547220 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-5f571f79-6a4d-448b-aa72-f9ec3779a85e tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba127731b60241debcb374ac2e39c891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0b96ff22c5544c187ad917f367d9c28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:21:49.555475 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-5f571f79-6a4d-448b-aa72-f9ec3779a85e tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] 10.222.0.18 "GET /compute/v2.1/servers/624cfc5a-03de-4c2b-9de5-bcd2d272aced" status: 200 len: 1508 microversion: 2.1 time: 0.383616 Oct 22 21:21:49.556354 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2763/5545] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:21:49 2022] GET /compute/v2.1/servers/624cfc5a-03de-4c2b-9de5-bcd2d272aced => generated 1508 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:21:49.588699 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-23598707-4151-436b-91f2-a0f761f3cf4f tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: 20d90b58-3fad-4a44-b6bf-4ef0cc587def] Unlocking {{(pid=138745) unlock /opt/stack/nova/nova/compute/api.py:4874}} Oct 22 21:21:49.640999 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-23598707-4151-436b-91f2-a0f761f3cf4f tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "POST /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def/action" status: 202 len: 0 microversion: 2.1 time: 0.113393 Oct 22 21:21:49.645607 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2783/5546] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 21:21:49 2022] POST /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def/action => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 22 21:21:49.651642 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-70ec7eb9-ce3b-4ba7-8c6e-068791a45acd tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:21:49.659423 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-70ec7eb9-ce3b-4ba7-8c6e-068791a45acd tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:21:49.659924 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-70ec7eb9-ce3b-4ba7-8c6e-068791a45acd tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:21:49.660367 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-70ec7eb9-ce3b-4ba7-8c6e-068791a45acd tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:21:49.684645 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-70ec7eb9-ce3b-4ba7-8c6e-068791a45acd tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: 20d90b58-3fad-4a44-b6bf-4ef0cc587def] Going to try to stop instance {{(pid=138744) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 22 21:21:49.735527 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-24250670-2d49-4375-8c63-a82e2a42fe32 tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:21:49.736433 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-24250670-2d49-4375-8c63-a82e2a42fe32 tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] [instance: 8dfe8aae-f5eb-4fcc-b801-7957bc9d608a] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:21:49.744244 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-24250670-2d49-4375-8c63-a82e2a42fe32 tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:21:49.745617 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-24250670-2d49-4375-8c63-a82e2a42fe32 tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:21:49.746582 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-24250670-2d49-4375-8c63-a82e2a42fe32 tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:21:49.747769 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-24250670-2d49-4375-8c63-a82e2a42fe32 tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:21:49.748364 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-24250670-2d49-4375-8c63-a82e2a42fe32 tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:21:49.748849 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-24250670-2d49-4375-8c63-a82e2a42fe32 tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:21:49.753516 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-70ec7eb9-ce3b-4ba7-8c6e-068791a45acd tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "POST /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def/action" status: 202 len: 0 microversion: 2.1 time: 0.105350 Oct 22 21:21:49.757309 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2764/5547] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 21:21:49 2022] POST /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def/action => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 21:21:49.774043 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-f2d336d8-2843-431b-9175-163172083257 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:21:49.774886 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-f2d336d8-2843-431b-9175-163172083257 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: 20d90b58-3fad-4a44-b6bf-4ef0cc587def] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:21:49.782797 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f2d336d8-2843-431b-9175-163172083257 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:21:49.783306 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f2d336d8-2843-431b-9175-163172083257 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:21:49.784244 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f2d336d8-2843-431b-9175-163172083257 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:21:49.785049 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f2d336d8-2843-431b-9175-163172083257 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:21:49.785526 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f2d336d8-2843-431b-9175-163172083257 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:21:49.785967 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f2d336d8-2843-431b-9175-163172083257 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:21:50.153368 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-24250670-2d49-4375-8c63-a82e2a42fe32 tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a56d59cd5ede44edaba68a0d74e195ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc27a2de57354aa2a6d698b8b7b0094b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:21:50.159976 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-f2d336d8-2843-431b-9175-163172083257 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c85602851244d4a632b9c861eb4416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45cb377c6a9a43b3b91c99a64e37f1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:21:50.161959 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-24250670-2d49-4375-8c63-a82e2a42fe32 tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] 10.222.0.18 "GET /compute/v2.1/servers/8dfe8aae-f5eb-4fcc-b801-7957bc9d608a" status: 200 len: 1428 microversion: 2.1 time: 0.430325 Oct 22 21:21:50.162730 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2784/5548] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:21:49 2022] GET /compute/v2.1/servers/8dfe8aae-f5eb-4fcc-b801-7957bc9d608a => generated 1428 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:21:50.168132 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-474f17e4-f416-40f4-9291-f46bf8e06f02 req-7ce6cfa0-21f5-4082-b91b-c3ce980ae186 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8dfe8aae-f5eb-4fcc-b801-7957bc9d608a", "tag": "bea8849c-39df-4cf8-8128-de57a272b0dc"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:21:50.169405 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-f2d336d8-2843-431b-9175-163172083257 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def" status: 200 len: 1679 microversion: 2.1 time: 0.399155 Oct 22 21:21:50.179500 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-474f17e4-f416-40f4-9291-f46bf8e06f02 req-7ce6cfa0-21f5-4082-b91b-c3ce980ae186 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:21:50.180208 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-474f17e4-f416-40f4-9291-f46bf8e06f02 req-7ce6cfa0-21f5-4082-b91b-c3ce980ae186 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:21:50.180802 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-474f17e4-f416-40f4-9291-f46bf8e06f02 req-7ce6cfa0-21f5-4082-b91b-c3ce980ae186 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:21:50.180967 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2765/5549] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:21:49 2022] GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def => generated 1679 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:21:50.193724 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-474f17e4-f416-40f4-9291-f46bf8e06f02 req-7ce6cfa0-21f5-4082-b91b-c3ce980ae186 service nova] Creating event network-changed:bea8849c-39df-4cf8-8128-de57a272b0dc for instance 8dfe8aae-f5eb-4fcc-b801-7957bc9d608a on nch1-master-1 Oct 22 21:21:50.198936 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-474f17e4-f416-40f4-9291-f46bf8e06f02 req-7ce6cfa0-21f5-4082-b91b-c3ce980ae186 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034539 Oct 22 21:21:50.199884 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2785/5550] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:21:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:21:50.578573 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-c050c0f3-cb1b-44b8-86a2-c64c22e4a4c8 tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:21:50.579398 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-c050c0f3-cb1b-44b8-86a2-c64c22e4a4c8 tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] [instance: 624cfc5a-03de-4c2b-9de5-bcd2d272aced] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:21:50.586545 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c050c0f3-cb1b-44b8-86a2-c64c22e4a4c8 tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:21:50.587304 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c050c0f3-cb1b-44b8-86a2-c64c22e4a4c8 tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:21:50.588023 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c050c0f3-cb1b-44b8-86a2-c64c22e4a4c8 tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:21:50.589013 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c050c0f3-cb1b-44b8-86a2-c64c22e4a4c8 tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:21:50.589471 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c050c0f3-cb1b-44b8-86a2-c64c22e4a4c8 tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:21:50.589897 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c050c0f3-cb1b-44b8-86a2-c64c22e4a4c8 tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:21:50.847920 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-c050c0f3-cb1b-44b8-86a2-c64c22e4a4c8 tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba127731b60241debcb374ac2e39c891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0b96ff22c5544c187ad917f367d9c28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:21:50.857497 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-c050c0f3-cb1b-44b8-86a2-c64c22e4a4c8 tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] 10.222.0.18 "GET /compute/v2.1/servers/624cfc5a-03de-4c2b-9de5-bcd2d272aced" status: 200 len: 1491 microversion: 2.1 time: 0.282975 Oct 22 21:21:50.858294 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2766/5551] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:21:50 2022] GET /compute/v2.1/servers/624cfc5a-03de-4c2b-9de5-bcd2d272aced => generated 1491 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:21:50.881795 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-cc3ea974-e6c3-4690-952f-dee13cb297c8 tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:21:50.882443 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-cc3ea974-e6c3-4690-952f-dee13cb297c8 tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] [instance: 624cfc5a-03de-4c2b-9de5-bcd2d272aced] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:21:50.889517 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cc3ea974-e6c3-4690-952f-dee13cb297c8 tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:21:50.890024 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cc3ea974-e6c3-4690-952f-dee13cb297c8 tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:21:50.890483 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cc3ea974-e6c3-4690-952f-dee13cb297c8 tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:21:50.891208 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cc3ea974-e6c3-4690-952f-dee13cb297c8 tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:21:50.891724 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cc3ea974-e6c3-4690-952f-dee13cb297c8 tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:21:50.892175 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cc3ea974-e6c3-4690-952f-dee13cb297c8 tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:21:50.968383 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-cc3ea974-e6c3-4690-952f-dee13cb297c8 tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] 10.222.0.18 "POST /compute/v2.1/servers/624cfc5a-03de-4c2b-9de5-bcd2d272aced/action" status: 202 len: 0 microversion: 2.1 time: 0.090088 Oct 22 21:21:50.972321 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2786/5552] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 21:21:50 2022] POST /compute/v2.1/servers/624cfc5a-03de-4c2b-9de5-bcd2d272aced/action => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 21:21:50.982346 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-45dbe7a9-b778-4657-b2bd-1b111e2d5034 tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:21:50.983067 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-45dbe7a9-b778-4657-b2bd-1b111e2d5034 tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] [instance: 624cfc5a-03de-4c2b-9de5-bcd2d272aced] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:21:50.991653 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-45dbe7a9-b778-4657-b2bd-1b111e2d5034 tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:21:50.992193 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-45dbe7a9-b778-4657-b2bd-1b111e2d5034 tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:21:50.992654 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-45dbe7a9-b778-4657-b2bd-1b111e2d5034 tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:21:50.993369 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-45dbe7a9-b778-4657-b2bd-1b111e2d5034 tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:21:50.993946 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-45dbe7a9-b778-4657-b2bd-1b111e2d5034 tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:21:50.994625 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-45dbe7a9-b778-4657-b2bd-1b111e2d5034 tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:21:51.000981 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:SELECT=88,nova_cell1:INSERT=5,nova_cell1:UPDATE=7 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:21:51.187147 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-7ddba068-f503-41fc-8a29-7433e2db9cce tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:21:51.188016 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-7ddba068-f503-41fc-8a29-7433e2db9cce tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] [instance: 8dfe8aae-f5eb-4fcc-b801-7957bc9d608a] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:21:51.195419 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7ddba068-f503-41fc-8a29-7433e2db9cce tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:21:51.195921 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7ddba068-f503-41fc-8a29-7433e2db9cce tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:21:51.196652 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7ddba068-f503-41fc-8a29-7433e2db9cce tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:21:51.197408 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7ddba068-f503-41fc-8a29-7433e2db9cce tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:21:51.197917 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7ddba068-f503-41fc-8a29-7433e2db9cce tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:21:51.198408 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7ddba068-f503-41fc-8a29-7433e2db9cce tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:21:51.223540 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-45dbe7a9-b778-4657-b2bd-1b111e2d5034 tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba127731b60241debcb374ac2e39c891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0b96ff22c5544c187ad917f367d9c28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:21:51.236174 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-45dbe7a9-b778-4657-b2bd-1b111e2d5034 tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] 10.222.0.18 "GET /compute/v2.1/servers/624cfc5a-03de-4c2b-9de5-bcd2d272aced" status: 200 len: 1497 microversion: 2.1 time: 0.261589 Oct 22 21:21:51.236862 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2767/5553] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:21:50 2022] GET /compute/v2.1/servers/624cfc5a-03de-4c2b-9de5-bcd2d272aced => generated 1497 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:21:51.245973 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-fc79ebb0-d963-4a75-86ee-5647c3cd5596 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:21:51.247707 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-fc79ebb0-d963-4a75-86ee-5647c3cd5596 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: 20d90b58-3fad-4a44-b6bf-4ef0cc587def] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:21:51.256711 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fc79ebb0-d963-4a75-86ee-5647c3cd5596 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:21:51.257287 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fc79ebb0-d963-4a75-86ee-5647c3cd5596 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:21:51.257791 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fc79ebb0-d963-4a75-86ee-5647c3cd5596 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:21:51.258605 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fc79ebb0-d963-4a75-86ee-5647c3cd5596 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:21:51.259123 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fc79ebb0-d963-4a75-86ee-5647c3cd5596 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:21:51.259805 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fc79ebb0-d963-4a75-86ee-5647c3cd5596 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:21:51.546137 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-7ddba068-f503-41fc-8a29-7433e2db9cce tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a56d59cd5ede44edaba68a0d74e195ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc27a2de57354aa2a6d698b8b7b0094b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:21:51.551733 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-fc79ebb0-d963-4a75-86ee-5647c3cd5596 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c85602851244d4a632b9c861eb4416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45cb377c6a9a43b3b91c99a64e37f1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:21:51.555693 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-7ddba068-f503-41fc-8a29-7433e2db9cce tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] 10.222.0.18 "GET /compute/v2.1/servers/8dfe8aae-f5eb-4fcc-b801-7957bc9d608a" status: 200 len: 1428 microversion: 2.1 time: 0.373859 Oct 22 21:21:51.556927 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2787/5554] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:21:51 2022] GET /compute/v2.1/servers/8dfe8aae-f5eb-4fcc-b801-7957bc9d608a => generated 1428 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:21:51.563474 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-fc79ebb0-d963-4a75-86ee-5647c3cd5596 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def" status: 200 len: 1679 microversion: 2.1 time: 0.324983 Oct 22 21:21:51.581213 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2768/5555] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:21:51 2022] GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def => generated 1679 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:21:52.260676 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-b8e4bdd1-c419-46f9-b4ea-864aace183b4 tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:21:52.261761 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-b8e4bdd1-c419-46f9-b4ea-864aace183b4 tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] [instance: 624cfc5a-03de-4c2b-9de5-bcd2d272aced] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:21:52.268965 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b8e4bdd1-c419-46f9-b4ea-864aace183b4 tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:21:52.269815 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b8e4bdd1-c419-46f9-b4ea-864aace183b4 tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:21:52.270796 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b8e4bdd1-c419-46f9-b4ea-864aace183b4 tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:21:52.271540 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b8e4bdd1-c419-46f9-b4ea-864aace183b4 tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:21:52.272029 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b8e4bdd1-c419-46f9-b4ea-864aace183b4 tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:21:52.272465 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b8e4bdd1-c419-46f9-b4ea-864aace183b4 tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:21:52.421010 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-b8e4bdd1-c419-46f9-b4ea-864aace183b4 tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba127731b60241debcb374ac2e39c891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0b96ff22c5544c187ad917f367d9c28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:21:52.429236 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-b8e4bdd1-c419-46f9-b4ea-864aace183b4 tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] 10.222.0.18 "GET /compute/v2.1/servers/624cfc5a-03de-4c2b-9de5-bcd2d272aced" status: 200 len: 1497 microversion: 2.1 time: 0.172639 Oct 22 21:21:52.429895 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2788/5556] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:21:52 2022] GET /compute/v2.1/servers/624cfc5a-03de-4c2b-9de5-bcd2d272aced => generated 1497 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:21:52.581115 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-7d3d7c81-22c3-49b4-8c98-e1289b1df180 tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:21:52.581854 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-7d3d7c81-22c3-49b4-8c98-e1289b1df180 tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] [instance: 8dfe8aae-f5eb-4fcc-b801-7957bc9d608a] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:21:52.588283 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-5554c674-c2a5-43e3-b238-f5533b093d4e tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:21:52.588788 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-5554c674-c2a5-43e3-b238-f5533b093d4e tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: 20d90b58-3fad-4a44-b6bf-4ef0cc587def] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:21:52.590926 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7d3d7c81-22c3-49b4-8c98-e1289b1df180 tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:21:52.591658 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7d3d7c81-22c3-49b4-8c98-e1289b1df180 tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:21:52.592229 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7d3d7c81-22c3-49b4-8c98-e1289b1df180 tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:21:52.592939 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7d3d7c81-22c3-49b4-8c98-e1289b1df180 tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:21:52.593394 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7d3d7c81-22c3-49b4-8c98-e1289b1df180 tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:21:52.594386 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7d3d7c81-22c3-49b4-8c98-e1289b1df180 tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:21:52.595934 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5554c674-c2a5-43e3-b238-f5533b093d4e tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:21:52.596435 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5554c674-c2a5-43e3-b238-f5533b093d4e tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:21:52.597293 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5554c674-c2a5-43e3-b238-f5533b093d4e tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:21:52.598212 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5554c674-c2a5-43e3-b238-f5533b093d4e tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:21:52.598695 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5554c674-c2a5-43e3-b238-f5533b093d4e tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:21:52.599131 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5554c674-c2a5-43e3-b238-f5533b093d4e tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:21:52.804770 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-5554c674-c2a5-43e3-b238-f5533b093d4e tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c85602851244d4a632b9c861eb4416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45cb377c6a9a43b3b91c99a64e37f1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:21:52.810624 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-7d3d7c81-22c3-49b4-8c98-e1289b1df180 tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a56d59cd5ede44edaba68a0d74e195ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc27a2de57354aa2a6d698b8b7b0094b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:21:52.813747 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-5554c674-c2a5-43e3-b238-f5533b093d4e tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def" status: 200 len: 1679 microversion: 2.1 time: 0.229926 Oct 22 21:21:52.815117 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2789/5557] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:21:52 2022] GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def => generated 1679 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:21:52.820700 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-7d3d7c81-22c3-49b4-8c98-e1289b1df180 tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] 10.222.0.18 "GET /compute/v2.1/servers/8dfe8aae-f5eb-4fcc-b801-7957bc9d608a" status: 200 len: 1428 microversion: 2.1 time: 0.243490 Oct 22 21:21:52.836284 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2769/5558] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:21:52 2022] GET /compute/v2.1/servers/8dfe8aae-f5eb-4fcc-b801-7957bc9d608a => generated 1428 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:21:53.452665 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-d70ca079-e9cb-46cf-bb86-314b83af5219 tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:21:53.453332 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-d70ca079-e9cb-46cf-bb86-314b83af5219 tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] [instance: 624cfc5a-03de-4c2b-9de5-bcd2d272aced] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:21:53.456097 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell0:SELECT=8 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:21:53.461731 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d70ca079-e9cb-46cf-bb86-314b83af5219 tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:21:53.462246 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d70ca079-e9cb-46cf-bb86-314b83af5219 tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:21:53.462702 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d70ca079-e9cb-46cf-bb86-314b83af5219 tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:21:53.463639 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d70ca079-e9cb-46cf-bb86-314b83af5219 tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:21:53.463921 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d70ca079-e9cb-46cf-bb86-314b83af5219 tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:21:53.464365 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d70ca079-e9cb-46cf-bb86-314b83af5219 tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:21:53.661657 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-d70ca079-e9cb-46cf-bb86-314b83af5219 tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba127731b60241debcb374ac2e39c891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0b96ff22c5544c187ad917f367d9c28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:21:53.672935 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-d70ca079-e9cb-46cf-bb86-314b83af5219 tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] 10.222.0.18 "GET /compute/v2.1/servers/624cfc5a-03de-4c2b-9de5-bcd2d272aced" status: 200 len: 1500 microversion: 2.1 time: 0.224246 Oct 22 21:21:53.688250 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2790/5559] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:21:53 2022] GET /compute/v2.1/servers/624cfc5a-03de-4c2b-9de5-bcd2d272aced => generated 1500 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:21:53.697345 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-744b183a-7938-4830-bc0e-f0c1ff726fa3 tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:21:53.698498 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-744b183a-7938-4830-bc0e-f0c1ff726fa3 tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] [instance: 624cfc5a-03de-4c2b-9de5-bcd2d272aced] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:21:53.701568 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell0:SELECT=2 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:21:53.702606 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell0:SELECT=10 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:21:53.709822 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-744b183a-7938-4830-bc0e-f0c1ff726fa3 tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:21:53.710345 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-744b183a-7938-4830-bc0e-f0c1ff726fa3 tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:21:53.710938 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-744b183a-7938-4830-bc0e-f0c1ff726fa3 tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:21:53.711743 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-744b183a-7938-4830-bc0e-f0c1ff726fa3 tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:21:53.712197 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-744b183a-7938-4830-bc0e-f0c1ff726fa3 tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:21:53.712652 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-744b183a-7938-4830-bc0e-f0c1ff726fa3 tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:21:53.740451 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-744b183a-7938-4830-bc0e-f0c1ff726fa3 tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] [instance: 624cfc5a-03de-4c2b-9de5-bcd2d272aced] Going to try to terminate instance {{(pid=138744) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 21:21:53.838491 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-e8abef4e-74e1-4315-8d6b-9fbf84cde790 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:21:53.839111 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-744b183a-7938-4830-bc0e-f0c1ff726fa3 tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] 10.222.0.18 "DELETE /compute/v2.1/servers/624cfc5a-03de-4c2b-9de5-bcd2d272aced" status: 204 len: 0 microversion: 2.1 time: 0.144345 Oct 22 21:21:53.839449 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-e8abef4e-74e1-4315-8d6b-9fbf84cde790 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: 20d90b58-3fad-4a44-b6bf-4ef0cc587def] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:21:53.843062 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2770/5560] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 21:21:53 2022] DELETE /compute/v2.1/servers/624cfc5a-03de-4c2b-9de5-bcd2d272aced => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 21:21:53.846433 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e8abef4e-74e1-4315-8d6b-9fbf84cde790 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:21:53.846942 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e8abef4e-74e1-4315-8d6b-9fbf84cde790 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:21:53.847426 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e8abef4e-74e1-4315-8d6b-9fbf84cde790 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:21:53.848359 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e8abef4e-74e1-4315-8d6b-9fbf84cde790 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:21:53.848530 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-544e70ae-b98f-4678-b102-8971a35744f1 tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:21:53.849003 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e8abef4e-74e1-4315-8d6b-9fbf84cde790 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:21:53.849245 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-544e70ae-b98f-4678-b102-8971a35744f1 tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] [instance: 8dfe8aae-f5eb-4fcc-b801-7957bc9d608a] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:21:53.849447 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e8abef4e-74e1-4315-8d6b-9fbf84cde790 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:21:53.855810 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-544e70ae-b98f-4678-b102-8971a35744f1 tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:21:53.856404 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-544e70ae-b98f-4678-b102-8971a35744f1 tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:21:53.856858 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-544e70ae-b98f-4678-b102-8971a35744f1 tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:21:53.857573 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-544e70ae-b98f-4678-b102-8971a35744f1 tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:21:53.858026 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-544e70ae-b98f-4678-b102-8971a35744f1 tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:21:53.859054 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-544e70ae-b98f-4678-b102-8971a35744f1 tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:21:54.056386 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-e8abef4e-74e1-4315-8d6b-9fbf84cde790 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c85602851244d4a632b9c861eb4416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45cb377c6a9a43b3b91c99a64e37f1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:21:54.065726 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-e8abef4e-74e1-4315-8d6b-9fbf84cde790 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def" status: 200 len: 1679 microversion: 2.1 time: 0.231222 Oct 22 21:21:54.065905 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-544e70ae-b98f-4678-b102-8971a35744f1 tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a56d59cd5ede44edaba68a0d74e195ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc27a2de57354aa2a6d698b8b7b0094b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:21:54.066315 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2791/5561] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:21:53 2022] GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def => generated 1679 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:21:54.071229 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-b467a5be-0b13-4b27-848f-0584070a0022 tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:21:54.072099 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-b467a5be-0b13-4b27-848f-0584070a0022 tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] [instance: 624cfc5a-03de-4c2b-9de5-bcd2d272aced] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:21:54.074053 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-544e70ae-b98f-4678-b102-8971a35744f1 tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] 10.222.0.18 "GET /compute/v2.1/servers/8dfe8aae-f5eb-4fcc-b801-7957bc9d608a" status: 200 len: 1428 microversion: 2.1 time: 0.229679 Oct 22 21:21:54.075115 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2771/5562] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:21:53 2022] GET /compute/v2.1/servers/8dfe8aae-f5eb-4fcc-b801-7957bc9d608a => generated 1428 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:21:54.079252 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b467a5be-0b13-4b27-848f-0584070a0022 tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:21:54.079784 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b467a5be-0b13-4b27-848f-0584070a0022 tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:21:54.080235 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b467a5be-0b13-4b27-848f-0584070a0022 tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:21:54.080958 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b467a5be-0b13-4b27-848f-0584070a0022 tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:21:54.081429 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b467a5be-0b13-4b27-848f-0584070a0022 tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:21:54.081871 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b467a5be-0b13-4b27-848f-0584070a0022 tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:21:54.221513 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-b467a5be-0b13-4b27-848f-0584070a0022 tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba127731b60241debcb374ac2e39c891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0b96ff22c5544c187ad917f367d9c28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:21:54.230269 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-b467a5be-0b13-4b27-848f-0584070a0022 tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] 10.222.0.18 "GET /compute/v2.1/servers/624cfc5a-03de-4c2b-9de5-bcd2d272aced" status: 200 len: 1506 microversion: 2.1 time: 0.162733 Oct 22 21:21:54.230911 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2792/5563] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:21:54 2022] GET /compute/v2.1/servers/624cfc5a-03de-4c2b-9de5-bcd2d272aced => generated 1506 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:21:55.091509 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-445709e9-4a4a-47f6-96a8-32ff175cd148 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:21:55.092147 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-445709e9-4a4a-47f6-96a8-32ff175cd148 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: 20d90b58-3fad-4a44-b6bf-4ef0cc587def] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:21:55.098353 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-533d56db-1aba-44a2-a9f7-b07e3c063a8c tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:21:55.099163 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-445709e9-4a4a-47f6-96a8-32ff175cd148 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:21:55.100032 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-445709e9-4a4a-47f6-96a8-32ff175cd148 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:21:55.100492 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-445709e9-4a4a-47f6-96a8-32ff175cd148 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:21:55.100738 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-533d56db-1aba-44a2-a9f7-b07e3c063a8c tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] [instance: 8dfe8aae-f5eb-4fcc-b801-7957bc9d608a] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:21:55.101183 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-445709e9-4a4a-47f6-96a8-32ff175cd148 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:21:55.101660 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-445709e9-4a4a-47f6-96a8-32ff175cd148 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:21:55.102140 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-445709e9-4a4a-47f6-96a8-32ff175cd148 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:21:55.108159 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-533d56db-1aba-44a2-a9f7-b07e3c063a8c tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:21:55.108650 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-533d56db-1aba-44a2-a9f7-b07e3c063a8c tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:21:55.109104 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-533d56db-1aba-44a2-a9f7-b07e3c063a8c tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:21:55.109877 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-533d56db-1aba-44a2-a9f7-b07e3c063a8c tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:21:55.110346 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-533d56db-1aba-44a2-a9f7-b07e3c063a8c tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:21:55.110787 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-533d56db-1aba-44a2-a9f7-b07e3c063a8c tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:21:55.385744 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-445709e9-4a4a-47f6-96a8-32ff175cd148 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c85602851244d4a632b9c861eb4416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45cb377c6a9a43b3b91c99a64e37f1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:21:55.394159 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-445709e9-4a4a-47f6-96a8-32ff175cd148 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def" status: 200 len: 1679 microversion: 2.1 time: 0.306638 Oct 22 21:21:55.407236 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2772/5564] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:21:55 2022] GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def => generated 1679 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:21:55.407527 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-533d56db-1aba-44a2-a9f7-b07e3c063a8c tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a56d59cd5ede44edaba68a0d74e195ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc27a2de57354aa2a6d698b8b7b0094b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:21:55.407665 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-4ffef79e-1b0d-4688-a5db-c8b7e0669e21 tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:21:55.407665 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-4ffef79e-1b0d-4688-a5db-c8b7e0669e21 tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] [instance: 624cfc5a-03de-4c2b-9de5-bcd2d272aced] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:21:55.407847 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-533d56db-1aba-44a2-a9f7-b07e3c063a8c tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] 10.222.0.18 "GET /compute/v2.1/servers/8dfe8aae-f5eb-4fcc-b801-7957bc9d608a" status: 200 len: 1428 microversion: 2.1 time: 0.311407 Oct 22 21:21:55.407943 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4ffef79e-1b0d-4688-a5db-c8b7e0669e21 tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:21:55.407943 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4ffef79e-1b0d-4688-a5db-c8b7e0669e21 tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:21:55.407943 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4ffef79e-1b0d-4688-a5db-c8b7e0669e21 tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:21:55.408214 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4ffef79e-1b0d-4688-a5db-c8b7e0669e21 tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:21:55.408637 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4ffef79e-1b0d-4688-a5db-c8b7e0669e21 tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:21:55.408871 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2793/5565] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:21:55 2022] GET /compute/v2.1/servers/8dfe8aae-f5eb-4fcc-b801-7957bc9d608a => generated 1428 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:21:55.409428 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4ffef79e-1b0d-4688-a5db-c8b7e0669e21 tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:21:55.598171 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-4ffef79e-1b0d-4688-a5db-c8b7e0669e21 tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba127731b60241debcb374ac2e39c891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0b96ff22c5544c187ad917f367d9c28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:21:55.606736 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-4ffef79e-1b0d-4688-a5db-c8b7e0669e21 tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] 10.222.0.18 "GET /compute/v2.1/servers/624cfc5a-03de-4c2b-9de5-bcd2d272aced" status: 200 len: 1506 microversion: 2.1 time: 0.210590 Oct 22 21:21:55.607422 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2773/5566] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:21:55 2022] GET /compute/v2.1/servers/624cfc5a-03de-4c2b-9de5-bcd2d272aced => generated 1506 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:21:56.420981 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-d8a2e28a-84a4-4b74-bebd-d63d6f7d2717 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:21:56.422325 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-d8a2e28a-84a4-4b74-bebd-d63d6f7d2717 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: 20d90b58-3fad-4a44-b6bf-4ef0cc587def] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:21:56.429536 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-a90285d8-7816-4a5b-bf0e-8c123a0d1d3d tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:21:56.430716 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-a90285d8-7816-4a5b-bf0e-8c123a0d1d3d tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] [instance: 8dfe8aae-f5eb-4fcc-b801-7957bc9d608a] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:21:56.441463 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d8a2e28a-84a4-4b74-bebd-d63d6f7d2717 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:21:56.441971 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d8a2e28a-84a4-4b74-bebd-d63d6f7d2717 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:21:56.442419 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d8a2e28a-84a4-4b74-bebd-d63d6f7d2717 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:21:56.443138 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d8a2e28a-84a4-4b74-bebd-d63d6f7d2717 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:21:56.443635 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d8a2e28a-84a4-4b74-bebd-d63d6f7d2717 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:21:56.444070 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d8a2e28a-84a4-4b74-bebd-d63d6f7d2717 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:21:56.451041 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a90285d8-7816-4a5b-bf0e-8c123a0d1d3d tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:21:56.451576 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a90285d8-7816-4a5b-bf0e-8c123a0d1d3d tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:21:56.452010 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a90285d8-7816-4a5b-bf0e-8c123a0d1d3d tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:21:56.452715 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a90285d8-7816-4a5b-bf0e-8c123a0d1d3d tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:21:56.453165 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a90285d8-7816-4a5b-bf0e-8c123a0d1d3d tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:21:56.453928 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a90285d8-7816-4a5b-bf0e-8c123a0d1d3d tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:21:56.838992 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-a90285d8-7816-4a5b-bf0e-8c123a0d1d3d tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a56d59cd5ede44edaba68a0d74e195ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc27a2de57354aa2a6d698b8b7b0094b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:21:56.847911 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-a90285d8-7816-4a5b-bf0e-8c123a0d1d3d tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] 10.222.0.18 "GET /compute/v2.1/servers/8dfe8aae-f5eb-4fcc-b801-7957bc9d608a" status: 200 len: 1428 microversion: 2.1 time: 0.422638 Oct 22 21:21:56.853132 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2774/5567] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:21:56 2022] GET /compute/v2.1/servers/8dfe8aae-f5eb-4fcc-b801-7957bc9d608a => generated 1428 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:21:56.872119 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-d8a2e28a-84a4-4b74-bebd-d63d6f7d2717 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c85602851244d4a632b9c861eb4416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45cb377c6a9a43b3b91c99a64e37f1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:21:56.880484 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-8aa20f96-fdac-45ad-8e07-1776232aa5c3 tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:21:56.881175 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-8aa20f96-fdac-45ad-8e07-1776232aa5c3 tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] [instance: 624cfc5a-03de-4c2b-9de5-bcd2d272aced] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:21:56.904045 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-d8a2e28a-84a4-4b74-bebd-d63d6f7d2717 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def" status: 200 len: 1679 microversion: 2.1 time: 0.488597 Oct 22 21:21:56.905339 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2794/5568] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:21:56 2022] GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def => generated 1679 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:21:56.912263 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-5373daec-a80c-4693-998a-d441eba8371a req-dbea2914-dff2-4bc3-8f28-87a383a6c2ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "624cfc5a-03de-4c2b-9de5-bcd2d272aced", "name": "network-vif-deleted", "tag": "48737af2-dc1c-4965-a93e-24b25f6f4aa2"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:21:56.921808 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8aa20f96-fdac-45ad-8e07-1776232aa5c3 tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:21:56.922526 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8aa20f96-fdac-45ad-8e07-1776232aa5c3 tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:21:56.925213 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8aa20f96-fdac-45ad-8e07-1776232aa5c3 tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:21:56.925981 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8aa20f96-fdac-45ad-8e07-1776232aa5c3 tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:21:56.926451 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8aa20f96-fdac-45ad-8e07-1776232aa5c3 tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:21:56.926883 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8aa20f96-fdac-45ad-8e07-1776232aa5c3 tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:21:56.927288 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-5373daec-a80c-4693-998a-d441eba8371a req-dbea2914-dff2-4bc3-8f28-87a383a6c2ee service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:21:56.927944 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-5373daec-a80c-4693-998a-d441eba8371a req-dbea2914-dff2-4bc3-8f28-87a383a6c2ee service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:21:56.928374 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-5373daec-a80c-4693-998a-d441eba8371a req-dbea2914-dff2-4bc3-8f28-87a383a6c2ee service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:21:56.940903 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-5373daec-a80c-4693-998a-d441eba8371a req-dbea2914-dff2-4bc3-8f28-87a383a6c2ee service nova] Creating event network-vif-deleted:48737af2-dc1c-4965-a93e-24b25f6f4aa2 for instance 624cfc5a-03de-4c2b-9de5-bcd2d272aced on nch2-master-1 Oct 22 21:21:56.946405 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-5373daec-a80c-4693-998a-d441eba8371a req-dbea2914-dff2-4bc3-8f28-87a383a6c2ee service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039536 Oct 22 21:21:56.948180 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2795/5569] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:21:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:21:57.007085 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8aa20f96-fdac-45ad-8e07-1776232aa5c3 tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:21:57.007661 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8aa20f96-fdac-45ad-8e07-1776232aa5c3 tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:21:57.008110 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8aa20f96-fdac-45ad-8e07-1776232aa5c3 tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:21:57.008729 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.objects.instance [None req-8aa20f96-fdac-45ad-8e07-1776232aa5c3 tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Lazy-loading 'fault' on Instance uuid 624cfc5a-03de-4c2b-9de5-bcd2d272aced {{(pid=138744) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 21:21:57.051713 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-8aa20f96-fdac-45ad-8e07-1776232aa5c3 tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba127731b60241debcb374ac2e39c891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0b96ff22c5544c187ad917f367d9c28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:21:57.060851 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-8aa20f96-fdac-45ad-8e07-1776232aa5c3 tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] 10.222.0.18 "GET /compute/v2.1/servers/624cfc5a-03de-4c2b-9de5-bcd2d272aced" status: 200 len: 1305 microversion: 2.1 time: 0.205772 Oct 22 21:21:57.063682 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2775/5570] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:21:56 2022] GET /compute/v2.1/servers/624cfc5a-03de-4c2b-9de5-bcd2d272aced => generated 1305 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:21:57.875953 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-6a981099-645f-4cb2-9acc-b6c4d5a74295 tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:21:57.876673 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-6a981099-645f-4cb2-9acc-b6c4d5a74295 tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] [instance: 8dfe8aae-f5eb-4fcc-b801-7957bc9d608a] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:21:57.884244 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6a981099-645f-4cb2-9acc-b6c4d5a74295 tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:21:57.884739 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6a981099-645f-4cb2-9acc-b6c4d5a74295 tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:21:57.885182 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6a981099-645f-4cb2-9acc-b6c4d5a74295 tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:21:57.885892 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6a981099-645f-4cb2-9acc-b6c4d5a74295 tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:21:57.886358 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6a981099-645f-4cb2-9acc-b6c4d5a74295 tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:21:57.886794 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6a981099-645f-4cb2-9acc-b6c4d5a74295 tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:21:57.932500 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-1aa9c044-e2ef-4f90-8254-73fbe5a0e599 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:21:57.933308 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-1aa9c044-e2ef-4f90-8254-73fbe5a0e599 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: 20d90b58-3fad-4a44-b6bf-4ef0cc587def] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:21:57.940870 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1aa9c044-e2ef-4f90-8254-73fbe5a0e599 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:21:57.941574 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1aa9c044-e2ef-4f90-8254-73fbe5a0e599 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:21:57.942209 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1aa9c044-e2ef-4f90-8254-73fbe5a0e599 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:21:57.943053 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1aa9c044-e2ef-4f90-8254-73fbe5a0e599 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:21:57.943785 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1aa9c044-e2ef-4f90-8254-73fbe5a0e599 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:21:57.944455 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1aa9c044-e2ef-4f90-8254-73fbe5a0e599 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:21:58.107913 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-6a981099-645f-4cb2-9acc-b6c4d5a74295 tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a56d59cd5ede44edaba68a0d74e195ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc27a2de57354aa2a6d698b8b7b0094b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:21:58.111940 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:21:58.117602 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-6a981099-645f-4cb2-9acc-b6c4d5a74295 tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] 10.222.0.18 "GET /compute/v2.1/servers/8dfe8aae-f5eb-4fcc-b801-7957bc9d608a" status: 200 len: 1428 microversion: 2.1 time: 0.246150 Oct 22 21:21:58.119843 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2796/5571] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:21:57 2022] GET /compute/v2.1/servers/8dfe8aae-f5eb-4fcc-b801-7957bc9d608a => generated 1428 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:21:58.129296 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-7fe32b22-1a86-4f18-b4d8-914a3550281e tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:21:58.131171 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-7fe32b22-1a86-4f18-b4d8-914a3550281e tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] [instance: 624cfc5a-03de-4c2b-9de5-bcd2d272aced] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:21:58.142955 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7fe32b22-1a86-4f18-b4d8-914a3550281e tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:21:58.144340 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7fe32b22-1a86-4f18-b4d8-914a3550281e tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:21:58.145661 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7fe32b22-1a86-4f18-b4d8-914a3550281e tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:21:58.147805 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7fe32b22-1a86-4f18-b4d8-914a3550281e tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:21:58.148610 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7fe32b22-1a86-4f18-b4d8-914a3550281e tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:21:58.149829 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7fe32b22-1a86-4f18-b4d8-914a3550281e tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:21:58.161324 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-1aa9c044-e2ef-4f90-8254-73fbe5a0e599 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c85602851244d4a632b9c861eb4416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45cb377c6a9a43b3b91c99a64e37f1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:21:58.172043 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-1aa9c044-e2ef-4f90-8254-73fbe5a0e599 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def" status: 200 len: 1679 microversion: 2.1 time: 0.243412 Oct 22 21:21:58.173835 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.wsgi [None req-7fe32b22-1a86-4f18-b4d8-914a3550281e tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] HTTP exception thrown: Instance 624cfc5a-03de-4c2b-9de5-bcd2d272aced could not be found. Oct 22 21:21:58.174238 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2776/5572] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:21:57 2022] GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def => generated 1679 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:21:58.179511 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-7fe32b22-1a86-4f18-b4d8-914a3550281e tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Request method failure captured: Oct 22 21:21:58.179511 ncdv-master-1 devstack@n-api.service[138745]: request: GET /compute/v2.1/servers/624cfc5a-03de-4c2b-9de5-bcd2d272aced HTTP/1.1 Oct 22 21:21:58.179511 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 21:21:58.179511 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 21:21:58.179511 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 21:21:58.179511 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 0 Oct 22 21:21:58.179511 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 21:21:58.179511 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 21:21:58.179511 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 21:21:58.179511 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 21:21:58.179511 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVF7XskXG-9Eyfp0-eDWshLVw6fO0fssMa2rRq1dSVzpe_ndiQvS84J696w8mNH0wY3KJm-BSqPqN7i8b7gbB-GjKL31mGb0F_7Rkc1tjikIEAwtNQmws53xV5Qn3OxmBFBih0oaneXxOJ_t5WLalmtJhRCa1Rtpn91jpMGr-MODefiQ Oct 22 21:21:58.179511 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 21:21:58.179511 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 21:21:58.179511 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 21:21:58.179511 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 21:21:58.179511 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 21:21:58.179511 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 21:21:58.179511 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: c0b96ff22c5544c187ad917f367d9c28 Oct 22 21:21:58.179511 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-TestServerAdvancedOps-1401339547 Oct 22 21:21:58.179511 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 21:21:58.179511 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 21:21:58.179511 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_c0b96ff22c5544c187ad917f367d9c28"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c0b96ff22c5544c187ad917f367d9c28"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/c0b96ff22c5544c187ad917f367d9c28"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c0b96ff22c5544c187ad917f367d9c28"}]}] Oct 22 21:21:58.179511 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-TestServerAdvancedOps-1401339547 Oct 22 21:21:58.179511 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: c0b96ff22c5544c187ad917f367d9c28 Oct 22 21:21:58.179511 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-TestServerAdvancedOps-1401339547 Oct 22 21:21:58.179511 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-TestServerAdvancedOps-1401339547-project Oct 22 21:21:58.179511 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 21:21:58.179511 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 21:21:58.179511 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: ba127731b60241debcb374ac2e39c891 Oct 22 21:21:58.179511 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-TestServerAdvancedOps-1401339547-project Oct 22 21:21:58.179511 ncdv-master-1 devstack@n-api.service[138745]: method: > Oct 22 21:21:58.179511 ncdv-master-1 devstack@n-api.service[138745]: exception: Instance 624cfc5a-03de-4c2b-9de5-bcd2d272aced could not be found. Oct 22 21:21:58.179511 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'id': '624cfc5a-03de-4c2b-9de5-bcd2d272aced'} Oct 22 21:21:58.179511 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:21:58.179511 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:21:58.179511 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 21:21:58.179511 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 21:21:58.179511 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 21:21:58.179511 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 21:21:58.179511 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 21:21:58.179511 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 21:21:58.179511 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 21:21:58.179511 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 21:21:58.179511 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 624cfc5a-03de-4c2b-9de5-bcd2d272aced could not be found. Oct 22 21:21:58.179511 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:21:58.179511 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:21:58.179511 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:21:58.179511 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:21:58.179511 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:21:58.179511 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:21:58.179511 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:21:58.179511 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:21:58.179511 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:21:58.179511 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:21:58.179511 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 21:21:58.179511 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 21:21:58.179511 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 21:21:58.179511 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 21:21:58.179511 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 21:21:58.179511 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:21:58.179511 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 624cfc5a-03de-4c2b-9de5-bcd2d272aced could not be found. Oct 22 21:21:58.179511 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:21:58.179511 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:21:58.179511 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:21:58.184420 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:21:58.184420 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:21:58.184420 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:21:58.184420 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:21:58.184420 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:21:58.184420 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 624cfc5a-03de-4c2b-9de5-bcd2d272aced could not be found. Oct 22 21:21:58.184420 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:21:58.184420 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-7fe32b22-1a86-4f18-b4d8-914a3550281e tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] Returning 404 to user: Instance 624cfc5a-03de-4c2b-9de5-bcd2d272aced could not be found. {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:21:58.184420 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-7fe32b22-1a86-4f18-b4d8-914a3550281e tempest-TestServerAdvancedOps-1401339547 tempest-TestServerAdvancedOps-1401339547-project] 10.222.0.18 "GET /compute/v2.1/servers/624cfc5a-03de-4c2b-9de5-bcd2d272aced" status: 404 len: 111 microversion: 2.1 time: 0.056764 Oct 22 21:21:58.184420 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2797/5573] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:21:58 2022] GET /compute/v2.1/servers/624cfc5a-03de-4c2b-9de5-bcd2d272aced => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 21:21:58.241919 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-608fdb74-6534-4555-952d-095172e59abf req-7629180a-d163-4bb9-b08f-b5add1a02907 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8dfe8aae-f5eb-4fcc-b801-7957bc9d608a", "name": "network-vif-plugged", "status": "completed", "tag": "bea8849c-39df-4cf8-8128-de57a272b0dc"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:21:58.276721 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-608fdb74-6534-4555-952d-095172e59abf req-7629180a-d163-4bb9-b08f-b5add1a02907 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:21:58.277478 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-608fdb74-6534-4555-952d-095172e59abf req-7629180a-d163-4bb9-b08f-b5add1a02907 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:21:58.278241 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-608fdb74-6534-4555-952d-095172e59abf req-7629180a-d163-4bb9-b08f-b5add1a02907 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:21:58.306256 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-608fdb74-6534-4555-952d-095172e59abf req-7629180a-d163-4bb9-b08f-b5add1a02907 service nova] Creating event network-vif-plugged:bea8849c-39df-4cf8-8128-de57a272b0dc for instance 8dfe8aae-f5eb-4fcc-b801-7957bc9d608a on nch1-master-1 Oct 22 21:21:58.314090 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-608fdb74-6534-4555-952d-095172e59abf req-7629180a-d163-4bb9-b08f-b5add1a02907 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075887 Oct 22 21:21:58.316241 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2798/5574] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:21:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:21:59.144634 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-4391b80b-65f0-4fec-a23b-8ba77030c433 tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:21:59.145327 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-4391b80b-65f0-4fec-a23b-8ba77030c433 tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] [instance: 8dfe8aae-f5eb-4fcc-b801-7957bc9d608a] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:21:59.153313 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4391b80b-65f0-4fec-a23b-8ba77030c433 tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:21:59.153811 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4391b80b-65f0-4fec-a23b-8ba77030c433 tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:21:59.154251 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4391b80b-65f0-4fec-a23b-8ba77030c433 tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:21:59.154969 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4391b80b-65f0-4fec-a23b-8ba77030c433 tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:21:59.155464 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4391b80b-65f0-4fec-a23b-8ba77030c433 tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:21:59.155894 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4391b80b-65f0-4fec-a23b-8ba77030c433 tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:21:59.199277 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-97747cfe-de29-4d0a-9f67-1cc7ad8d1c03 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:21:59.200963 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-97747cfe-de29-4d0a-9f67-1cc7ad8d1c03 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: 20d90b58-3fad-4a44-b6bf-4ef0cc587def] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:21:59.208163 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-97747cfe-de29-4d0a-9f67-1cc7ad8d1c03 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:21:59.208798 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-97747cfe-de29-4d0a-9f67-1cc7ad8d1c03 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:21:59.209332 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-97747cfe-de29-4d0a-9f67-1cc7ad8d1c03 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:21:59.210121 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-97747cfe-de29-4d0a-9f67-1cc7ad8d1c03 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:21:59.210662 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-97747cfe-de29-4d0a-9f67-1cc7ad8d1c03 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:21:59.211181 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-97747cfe-de29-4d0a-9f67-1cc7ad8d1c03 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:21:59.680938 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-4391b80b-65f0-4fec-a23b-8ba77030c433 tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a56d59cd5ede44edaba68a0d74e195ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc27a2de57354aa2a6d698b8b7b0094b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:21:59.689387 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-4391b80b-65f0-4fec-a23b-8ba77030c433 tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] 10.222.0.18 "GET /compute/v2.1/servers/8dfe8aae-f5eb-4fcc-b801-7957bc9d608a" status: 200 len: 1428 microversion: 2.1 time: 0.548708 Oct 22 21:21:59.690200 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2777/5575] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:21:59 2022] GET /compute/v2.1/servers/8dfe8aae-f5eb-4fcc-b801-7957bc9d608a => generated 1428 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:21:59.705802 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-97747cfe-de29-4d0a-9f67-1cc7ad8d1c03 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c85602851244d4a632b9c861eb4416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45cb377c6a9a43b3b91c99a64e37f1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:21:59.717922 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-97747cfe-de29-4d0a-9f67-1cc7ad8d1c03 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def" status: 200 len: 1679 microversion: 2.1 time: 0.523886 Oct 22 21:21:59.731361 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2799/5576] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:21:59 2022] GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def => generated 1679 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:22:00.718070 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-035c5f2c-0055-452e-a5f9-e6160257219c tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:22:00.718698 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-035c5f2c-0055-452e-a5f9-e6160257219c tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] [instance: 8dfe8aae-f5eb-4fcc-b801-7957bc9d608a] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:22:00.721738 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:22:00.729418 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-035c5f2c-0055-452e-a5f9-e6160257219c tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:22:00.730167 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-035c5f2c-0055-452e-a5f9-e6160257219c tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:22:00.730822 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-035c5f2c-0055-452e-a5f9-e6160257219c tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:22:00.731820 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-035c5f2c-0055-452e-a5f9-e6160257219c tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:22:00.732817 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-035c5f2c-0055-452e-a5f9-e6160257219c tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:22:00.733248 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-035c5f2c-0055-452e-a5f9-e6160257219c tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:22:00.742150 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-f9794fd3-0d0e-4327-8fc7-6c43b8b6537f tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:22:00.742847 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-f9794fd3-0d0e-4327-8fc7-6c43b8b6537f tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: 20d90b58-3fad-4a44-b6bf-4ef0cc587def] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:22:00.755241 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f9794fd3-0d0e-4327-8fc7-6c43b8b6537f tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:22:00.756276 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f9794fd3-0d0e-4327-8fc7-6c43b8b6537f tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:22:00.758120 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f9794fd3-0d0e-4327-8fc7-6c43b8b6537f tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:22:00.759829 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f9794fd3-0d0e-4327-8fc7-6c43b8b6537f tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:22:00.760309 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f9794fd3-0d0e-4327-8fc7-6c43b8b6537f tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:22:00.763184 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f9794fd3-0d0e-4327-8fc7-6c43b8b6537f tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:22:00.972759 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-f9794fd3-0d0e-4327-8fc7-6c43b8b6537f tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c85602851244d4a632b9c861eb4416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45cb377c6a9a43b3b91c99a64e37f1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:22:00.984261 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-f9794fd3-0d0e-4327-8fc7-6c43b8b6537f tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def" status: 200 len: 1656 microversion: 2.1 time: 0.245900 Oct 22 21:22:00.985482 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2800/5577] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:22:00 2022] GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def => generated 1656 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:22:00.989864 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-035c5f2c-0055-452e-a5f9-e6160257219c tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a56d59cd5ede44edaba68a0d74e195ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc27a2de57354aa2a6d698b8b7b0094b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:22:01.001996 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-035c5f2c-0055-452e-a5f9-e6160257219c tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] 10.222.0.18 "GET /compute/v2.1/servers/8dfe8aae-f5eb-4fcc-b801-7957bc9d608a" status: 200 len: 1607 microversion: 2.1 time: 0.290699 Oct 22 21:22:01.007943 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2778/5578] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:22:00 2022] GET /compute/v2.1/servers/8dfe8aae-f5eb-4fcc-b801-7957bc9d608a => generated 1607 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:22:01.010865 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-f30f519f-b78b-4707-bcec-fa076d278719 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:22:01.017934 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f30f519f-b78b-4707-bcec-fa076d278719 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:22:01.018527 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f30f519f-b78b-4707-bcec-fa076d278719 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:22:01.019085 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f30f519f-b78b-4707-bcec-fa076d278719 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:22:01.031968 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-e70c1407-a4ad-42f1-86b4-50247c0ac941 tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:22:01.032766 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-e70c1407-a4ad-42f1-86b4-50247c0ac941 tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] [instance: 8dfe8aae-f5eb-4fcc-b801-7957bc9d608a] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:22:01.040819 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e70c1407-a4ad-42f1-86b4-50247c0ac941 tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:22:01.042150 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e70c1407-a4ad-42f1-86b4-50247c0ac941 tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:22:01.043256 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e70c1407-a4ad-42f1-86b4-50247c0ac941 tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:22:01.046193 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e70c1407-a4ad-42f1-86b4-50247c0ac941 tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:22:01.046857 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e70c1407-a4ad-42f1-86b4-50247c0ac941 tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:22:01.047303 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e70c1407-a4ad-42f1-86b4-50247c0ac941 tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:22:01.052800 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-f30f519f-b78b-4707-bcec-fa076d278719 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: 20d90b58-3fad-4a44-b6bf-4ef0cc587def] Going to try to start instance {{(pid=138745) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 22 21:22:01.111638 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-f30f519f-b78b-4707-bcec-fa076d278719 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "POST /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def/action" status: 202 len: 0 microversion: 2.1 time: 0.105701 Oct 22 21:22:01.112504 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2801/5579] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 21:22:01 2022] POST /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def/action => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 21:22:01.121521 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-e1ebdbea-4d0d-47fe-b6b1-839056f57e7e tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:22:01.122248 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-e1ebdbea-4d0d-47fe-b6b1-839056f57e7e tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: 20d90b58-3fad-4a44-b6bf-4ef0cc587def] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:22:01.129191 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e1ebdbea-4d0d-47fe-b6b1-839056f57e7e tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:22:01.129850 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e1ebdbea-4d0d-47fe-b6b1-839056f57e7e tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:22:01.130312 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e1ebdbea-4d0d-47fe-b6b1-839056f57e7e tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:22:01.131042 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e1ebdbea-4d0d-47fe-b6b1-839056f57e7e tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:22:01.131550 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e1ebdbea-4d0d-47fe-b6b1-839056f57e7e tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:22:01.131993 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e1ebdbea-4d0d-47fe-b6b1-839056f57e7e tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:22:01.363283 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-e70c1407-a4ad-42f1-86b4-50247c0ac941 tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a56d59cd5ede44edaba68a0d74e195ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc27a2de57354aa2a6d698b8b7b0094b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:22:01.374238 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-e70c1407-a4ad-42f1-86b4-50247c0ac941 tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] 10.222.0.18 "GET /compute/v2.1/servers/8dfe8aae-f5eb-4fcc-b801-7957bc9d608a" status: 200 len: 1607 microversion: 2.1 time: 0.347316 Oct 22 21:22:01.375038 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2779/5580] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:22:01 2022] GET /compute/v2.1/servers/8dfe8aae-f5eb-4fcc-b801-7957bc9d608a => generated 1607 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:22:01.397201 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-58783546-b6e0-4f9b-9287-296f50664007 tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:22:01.397902 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-58783546-b6e0-4f9b-9287-296f50664007 tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] [instance: 8dfe8aae-f5eb-4fcc-b801-7957bc9d608a] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:22:01.404368 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-58783546-b6e0-4f9b-9287-296f50664007 tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:22:01.405120 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-58783546-b6e0-4f9b-9287-296f50664007 tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:22:01.405727 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-58783546-b6e0-4f9b-9287-296f50664007 tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:22:01.406600 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-58783546-b6e0-4f9b-9287-296f50664007 tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:22:01.407216 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-58783546-b6e0-4f9b-9287-296f50664007 tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:22:01.407831 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-58783546-b6e0-4f9b-9287-296f50664007 tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:22:01.452240 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-e1ebdbea-4d0d-47fe-b6b1-839056f57e7e tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c85602851244d4a632b9c861eb4416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45cb377c6a9a43b3b91c99a64e37f1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:22:01.461172 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-e1ebdbea-4d0d-47fe-b6b1-839056f57e7e tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def" status: 200 len: 1665 microversion: 2.1 time: 0.344257 Oct 22 21:22:01.479539 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2802/5581] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:22:01 2022] GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def => generated 1665 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:22:01.639120 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-58783546-b6e0-4f9b-9287-296f50664007 tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a56d59cd5ede44edaba68a0d74e195ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc27a2de57354aa2a6d698b8b7b0094b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:22:01.649703 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-58783546-b6e0-4f9b-9287-296f50664007 tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] 10.222.0.18 "GET /compute/v2.1/servers/8dfe8aae-f5eb-4fcc-b801-7957bc9d608a" status: 200 len: 1607 microversion: 2.1 time: 0.256781 Oct 22 21:22:01.650298 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2780/5582] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:22:01 2022] GET /compute/v2.1/servers/8dfe8aae-f5eb-4fcc-b801-7957bc9d608a => generated 1607 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:22:02.486093 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-64f8ca77-2b20-46e8-8f30-0bb34bf51235 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:22:02.486709 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-64f8ca77-2b20-46e8-8f30-0bb34bf51235 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: 20d90b58-3fad-4a44-b6bf-4ef0cc587def] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:22:02.493722 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-64f8ca77-2b20-46e8-8f30-0bb34bf51235 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:22:02.494221 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-64f8ca77-2b20-46e8-8f30-0bb34bf51235 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:22:02.494671 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-64f8ca77-2b20-46e8-8f30-0bb34bf51235 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:22:02.495418 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-64f8ca77-2b20-46e8-8f30-0bb34bf51235 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:22:02.495891 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-64f8ca77-2b20-46e8-8f30-0bb34bf51235 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:22:02.496330 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-64f8ca77-2b20-46e8-8f30-0bb34bf51235 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:22:02.765372 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-64f8ca77-2b20-46e8-8f30-0bb34bf51235 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c85602851244d4a632b9c861eb4416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45cb377c6a9a43b3b91c99a64e37f1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:22:02.774257 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-64f8ca77-2b20-46e8-8f30-0bb34bf51235 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def" status: 200 len: 1665 microversion: 2.1 time: 0.292046 Oct 22 21:22:02.775031 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2803/5583] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:22:02 2022] GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def => generated 1665 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:22:03.799598 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-c536b2aa-1bc7-444f-a252-3ad38b633c5a tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:22:03.800967 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-c536b2aa-1bc7-444f-a252-3ad38b633c5a tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: 20d90b58-3fad-4a44-b6bf-4ef0cc587def] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:22:03.808924 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c536b2aa-1bc7-444f-a252-3ad38b633c5a tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:22:03.809776 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c536b2aa-1bc7-444f-a252-3ad38b633c5a tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:22:03.810297 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c536b2aa-1bc7-444f-a252-3ad38b633c5a tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:22:03.811048 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c536b2aa-1bc7-444f-a252-3ad38b633c5a tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:22:03.811540 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c536b2aa-1bc7-444f-a252-3ad38b633c5a tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:22:03.811967 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c536b2aa-1bc7-444f-a252-3ad38b633c5a tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:22:03.982276 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-1d124d64-5941-4283-af1e-d06b2ecb9157 req-8072fd67-74d3-48e9-af1e-b36b5cd3fc63 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8dfe8aae-f5eb-4fcc-b801-7957bc9d608a", "tag": "bea8849c-39df-4cf8-8128-de57a272b0dc"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:22:03.993793 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-1d124d64-5941-4283-af1e-d06b2ecb9157 req-8072fd67-74d3-48e9-af1e-b36b5cd3fc63 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:22:03.994583 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-1d124d64-5941-4283-af1e-d06b2ecb9157 req-8072fd67-74d3-48e9-af1e-b36b5cd3fc63 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:22:03.995210 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-1d124d64-5941-4283-af1e-d06b2ecb9157 req-8072fd67-74d3-48e9-af1e-b36b5cd3fc63 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:22:04.007611 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-c536b2aa-1bc7-444f-a252-3ad38b633c5a tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c85602851244d4a632b9c861eb4416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45cb377c6a9a43b3b91c99a64e37f1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:22:04.013521 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:22:04.021659 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-c536b2aa-1bc7-444f-a252-3ad38b633c5a tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def" status: 200 len: 1669 microversion: 2.1 time: 0.225999 Oct 22 21:22:04.023502 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2781/5584] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:22:03 2022] GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def => generated 1669 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:22:04.050717 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-19ea6ce7-ef7e-4b8f-a27b-61e821df6b18 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:22:04.051852 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-19ea6ce7-ef7e-4b8f-a27b-61e821df6b18 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: 20d90b58-3fad-4a44-b6bf-4ef0cc587def] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:22:04.064284 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-19ea6ce7-ef7e-4b8f-a27b-61e821df6b18 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:22:04.065728 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-19ea6ce7-ef7e-4b8f-a27b-61e821df6b18 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:22:04.067507 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-19ea6ce7-ef7e-4b8f-a27b-61e821df6b18 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:22:04.068707 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-19ea6ce7-ef7e-4b8f-a27b-61e821df6b18 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:22:04.069877 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-19ea6ce7-ef7e-4b8f-a27b-61e821df6b18 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:22:04.070837 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-19ea6ce7-ef7e-4b8f-a27b-61e821df6b18 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:22:04.253714 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-19ea6ce7-ef7e-4b8f-a27b-61e821df6b18 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c85602851244d4a632b9c861eb4416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45cb377c6a9a43b3b91c99a64e37f1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:22:04.265741 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-19ea6ce7-ef7e-4b8f-a27b-61e821df6b18 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def" status: 200 len: 1669 microversion: 2.1 time: 0.221343 Oct 22 21:22:04.267391 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2782/5585] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:22:04 2022] GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def => generated 1669 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:22:04.289841 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-63e1fcce-6da7-4b6f-acc5-831d7c8bac05 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:22:04.290502 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-63e1fcce-6da7-4b6f-acc5-831d7c8bac05 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: 20d90b58-3fad-4a44-b6bf-4ef0cc587def] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:22:04.298965 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-63e1fcce-6da7-4b6f-acc5-831d7c8bac05 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:22:04.300045 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-63e1fcce-6da7-4b6f-acc5-831d7c8bac05 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:22:04.300045 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-63e1fcce-6da7-4b6f-acc5-831d7c8bac05 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:22:04.300642 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-63e1fcce-6da7-4b6f-acc5-831d7c8bac05 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:22:04.301106 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-63e1fcce-6da7-4b6f-acc5-831d7c8bac05 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:22:04.301536 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-63e1fcce-6da7-4b6f-acc5-831d7c8bac05 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:22:04.326522 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-1d124d64-5941-4283-af1e-d06b2ecb9157 req-8072fd67-74d3-48e9-af1e-b36b5cd3fc63 service nova] Creating event network-changed:bea8849c-39df-4cf8-8128-de57a272b0dc for instance 8dfe8aae-f5eb-4fcc-b801-7957bc9d608a on nch1-master-1 Oct 22 21:22:04.332105 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-1d124d64-5941-4283-af1e-d06b2ecb9157 req-8072fd67-74d3-48e9-af1e-b36b5cd3fc63 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.353571 Oct 22 21:22:04.333329 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2804/5586] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:22:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 21:22:04.377080 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-63e1fcce-6da7-4b6f-acc5-831d7c8bac05 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: 20d90b58-3fad-4a44-b6bf-4ef0cc587def] Unlocking {{(pid=138744) unlock /opt/stack/nova/nova/compute/api.py:4874}} Oct 22 21:22:04.456504 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-63e1fcce-6da7-4b6f-acc5-831d7c8bac05 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "POST /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def/action" status: 202 len: 0 microversion: 2.1 time: 0.169889 Oct 22 21:22:04.457807 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2783/5587] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 21:22:04 2022] POST /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def/action => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 21:22:04.473577 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-69a9b635-6833-4c6f-8ed1-b2063e5331f1 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:22:04.474468 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-69a9b635-6833-4c6f-8ed1-b2063e5331f1 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: 20d90b58-3fad-4a44-b6bf-4ef0cc587def] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:22:04.486789 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-69a9b635-6833-4c6f-8ed1-b2063e5331f1 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:22:04.488293 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-69a9b635-6833-4c6f-8ed1-b2063e5331f1 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:22:04.488969 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-69a9b635-6833-4c6f-8ed1-b2063e5331f1 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:22:04.491190 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-69a9b635-6833-4c6f-8ed1-b2063e5331f1 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:22:04.491719 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-69a9b635-6833-4c6f-8ed1-b2063e5331f1 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:22:04.492417 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-69a9b635-6833-4c6f-8ed1-b2063e5331f1 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:22:04.739820 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-69a9b635-6833-4c6f-8ed1-b2063e5331f1 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c85602851244d4a632b9c861eb4416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45cb377c6a9a43b3b91c99a64e37f1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:22:04.750636 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-69a9b635-6833-4c6f-8ed1-b2063e5331f1 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def" status: 200 len: 1669 microversion: 2.1 time: 0.284570 Oct 22 21:22:04.753018 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2805/5588] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:22:04 2022] GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def => generated 1669 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:22:04.775759 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-4004398a-12ad-4cd5-b7b3-eb6285d5520b tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:22:04.776789 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-4004398a-12ad-4cd5-b7b3-eb6285d5520b tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: 20d90b58-3fad-4a44-b6bf-4ef0cc587def] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:22:04.784002 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4004398a-12ad-4cd5-b7b3-eb6285d5520b tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:22:04.784702 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4004398a-12ad-4cd5-b7b3-eb6285d5520b tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:22:04.785373 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4004398a-12ad-4cd5-b7b3-eb6285d5520b tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:22:04.786264 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4004398a-12ad-4cd5-b7b3-eb6285d5520b tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:22:04.786925 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4004398a-12ad-4cd5-b7b3-eb6285d5520b tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:22:04.787625 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4004398a-12ad-4cd5-b7b3-eb6285d5520b tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:22:05.353588 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-4004398a-12ad-4cd5-b7b3-eb6285d5520b tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c85602851244d4a632b9c861eb4416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45cb377c6a9a43b3b91c99a64e37f1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:22:05.362276 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-4004398a-12ad-4cd5-b7b3-eb6285d5520b tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def" status: 200 len: 1669 microversion: 2.1 time: 0.591640 Oct 22 21:22:05.362823 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2784/5589] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:22:04 2022] GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def => generated 1669 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:22:05.385557 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-4dc7e0ff-90d2-4478-b4d1-27442cab1924 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:22:05.386198 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-4dc7e0ff-90d2-4478-b4d1-27442cab1924 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: 20d90b58-3fad-4a44-b6bf-4ef0cc587def] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:22:05.393310 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4dc7e0ff-90d2-4478-b4d1-27442cab1924 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:22:05.394044 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4dc7e0ff-90d2-4478-b4d1-27442cab1924 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:22:05.394508 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4dc7e0ff-90d2-4478-b4d1-27442cab1924 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:22:05.395237 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4dc7e0ff-90d2-4478-b4d1-27442cab1924 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:22:05.395906 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4dc7e0ff-90d2-4478-b4d1-27442cab1924 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:22:05.396363 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4dc7e0ff-90d2-4478-b4d1-27442cab1924 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:22:05.543495 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-4dc7e0ff-90d2-4478-b4d1-27442cab1924 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c85602851244d4a632b9c861eb4416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45cb377c6a9a43b3b91c99a64e37f1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:22:05.554276 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-4dc7e0ff-90d2-4478-b4d1-27442cab1924 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def" status: 200 len: 1669 microversion: 2.1 time: 0.172621 Oct 22 21:22:05.554978 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2806/5590] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:22:05 2022] GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def => generated 1669 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:22:05.577030 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-3d4f189e-aa70-423d-8cee-c53fd953c02b tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:22:05.577694 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-3d4f189e-aa70-423d-8cee-c53fd953c02b tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: 20d90b58-3fad-4a44-b6bf-4ef0cc587def] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:22:05.589936 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3d4f189e-aa70-423d-8cee-c53fd953c02b tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:22:05.591071 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3d4f189e-aa70-423d-8cee-c53fd953c02b tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:22:05.591910 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3d4f189e-aa70-423d-8cee-c53fd953c02b tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:22:05.592904 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3d4f189e-aa70-423d-8cee-c53fd953c02b tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:22:05.593575 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3d4f189e-aa70-423d-8cee-c53fd953c02b tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:22:05.594215 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3d4f189e-aa70-423d-8cee-c53fd953c02b tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:22:05.672077 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-3d4f189e-aa70-423d-8cee-c53fd953c02b tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "POST /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def/action" status: 202 len: 0 microversion: 2.1 time: 0.098962 Oct 22 21:22:05.672736 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2785/5591] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 21:22:05 2022] POST /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def/action => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 21:22:05.681189 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-9e4aa363-5b83-49f0-bb8e-a6c18924224a tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:22:05.681607 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-9e4aa363-5b83-49f0-bb8e-a6c18924224a tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: 20d90b58-3fad-4a44-b6bf-4ef0cc587def] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:22:05.683668 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:22:05.689302 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9e4aa363-5b83-49f0-bb8e-a6c18924224a tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:22:05.690055 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9e4aa363-5b83-49f0-bb8e-a6c18924224a tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:22:05.690514 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9e4aa363-5b83-49f0-bb8e-a6c18924224a tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:22:05.691242 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9e4aa363-5b83-49f0-bb8e-a6c18924224a tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:22:05.691917 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9e4aa363-5b83-49f0-bb8e-a6c18924224a tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:22:05.692363 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9e4aa363-5b83-49f0-bb8e-a6c18924224a tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:22:05.837728 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-9e4aa363-5b83-49f0-bb8e-a6c18924224a tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c85602851244d4a632b9c861eb4416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45cb377c6a9a43b3b91c99a64e37f1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:22:05.846203 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-9e4aa363-5b83-49f0-bb8e-a6c18924224a tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def" status: 200 len: 1674 microversion: 2.1 time: 0.169041 Oct 22 21:22:05.847465 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2807/5592] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:22:05 2022] GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def => generated 1674 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:22:06.872064 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-5b4e7283-08eb-4cb6-9834-c7f5491c5455 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:22:06.875763 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-5b4e7283-08eb-4cb6-9834-c7f5491c5455 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: 20d90b58-3fad-4a44-b6bf-4ef0cc587def] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:22:06.880611 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5b4e7283-08eb-4cb6-9834-c7f5491c5455 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:22:06.881189 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5b4e7283-08eb-4cb6-9834-c7f5491c5455 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:22:06.881718 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5b4e7283-08eb-4cb6-9834-c7f5491c5455 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:22:06.882695 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5b4e7283-08eb-4cb6-9834-c7f5491c5455 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:22:06.883215 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5b4e7283-08eb-4cb6-9834-c7f5491c5455 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:22:06.883722 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5b4e7283-08eb-4cb6-9834-c7f5491c5455 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:22:07.016509 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-5b4e7283-08eb-4cb6-9834-c7f5491c5455 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c85602851244d4a632b9c861eb4416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45cb377c6a9a43b3b91c99a64e37f1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:22:07.025077 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-5b4e7283-08eb-4cb6-9834-c7f5491c5455 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def" status: 200 len: 1654 microversion: 2.1 time: 0.158336 Oct 22 21:22:07.025742 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2786/5593] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:22:06 2022] GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def => generated 1654 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:22:07.048441 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-60aaf499-710e-4ec5-b514-dd9104743afa tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:22:07.049001 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-60aaf499-710e-4ec5-b514-dd9104743afa tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: 20d90b58-3fad-4a44-b6bf-4ef0cc587def] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:22:07.060643 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-60aaf499-710e-4ec5-b514-dd9104743afa tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:22:07.061303 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-60aaf499-710e-4ec5-b514-dd9104743afa tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:22:07.061892 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-60aaf499-710e-4ec5-b514-dd9104743afa tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:22:07.062612 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-60aaf499-710e-4ec5-b514-dd9104743afa tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:22:07.063099 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-60aaf499-710e-4ec5-b514-dd9104743afa tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:22:07.064076 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-60aaf499-710e-4ec5-b514-dd9104743afa tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:22:07.140516 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-60aaf499-710e-4ec5-b514-dd9104743afa tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "POST /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def/action" status: 202 len: 0 microversion: 2.1 time: 0.095829 Oct 22 21:22:07.144323 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2808/5594] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 21:22:07 2022] POST /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def/action => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 22 21:22:07.151873 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-d70b569c-93ea-458c-a6a4-5d4251baabc7 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:22:07.152620 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-d70b569c-93ea-458c-a6a4-5d4251baabc7 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: 20d90b58-3fad-4a44-b6bf-4ef0cc587def] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:22:07.160115 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d70b569c-93ea-458c-a6a4-5d4251baabc7 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:22:07.160613 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d70b569c-93ea-458c-a6a4-5d4251baabc7 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:22:07.161245 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d70b569c-93ea-458c-a6a4-5d4251baabc7 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:22:07.162422 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d70b569c-93ea-458c-a6a4-5d4251baabc7 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:22:07.163020 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d70b569c-93ea-458c-a6a4-5d4251baabc7 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:22:07.163484 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d70b569c-93ea-458c-a6a4-5d4251baabc7 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:22:07.306614 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-d70b569c-93ea-458c-a6a4-5d4251baabc7 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c85602851244d4a632b9c861eb4416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45cb377c6a9a43b3b91c99a64e37f1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:22:07.314859 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-d70b569c-93ea-458c-a6a4-5d4251baabc7 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def" status: 200 len: 1661 microversion: 2.1 time: 0.168819 Oct 22 21:22:07.315798 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2787/5595] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:22:07 2022] GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def => generated 1661 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:22:08.339974 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-bf3bb637-d118-4058-aee1-9f12738e4a44 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:22:08.340830 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-bf3bb637-d118-4058-aee1-9f12738e4a44 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: 20d90b58-3fad-4a44-b6bf-4ef0cc587def] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:22:08.347089 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bf3bb637-d118-4058-aee1-9f12738e4a44 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:22:08.347628 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bf3bb637-d118-4058-aee1-9f12738e4a44 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:22:08.348083 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bf3bb637-d118-4058-aee1-9f12738e4a44 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:22:08.348797 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bf3bb637-d118-4058-aee1-9f12738e4a44 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:22:08.349270 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bf3bb637-d118-4058-aee1-9f12738e4a44 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:22:08.350065 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bf3bb637-d118-4058-aee1-9f12738e4a44 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:22:08.485516 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-bf3bb637-d118-4058-aee1-9f12738e4a44 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c85602851244d4a632b9c861eb4416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45cb377c6a9a43b3b91c99a64e37f1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:22:08.493722 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-bf3bb637-d118-4058-aee1-9f12738e4a44 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def" status: 200 len: 1669 microversion: 2.1 time: 0.159018 Oct 22 21:22:08.494306 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2809/5596] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:22:08 2022] GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def => generated 1669 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:22:08.516515 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-79bc6e0a-2648-442e-bdbd-85445a4f72f4 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:22:08.517241 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-79bc6e0a-2648-442e-bdbd-85445a4f72f4 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: 20d90b58-3fad-4a44-b6bf-4ef0cc587def] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:22:08.524474 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-79bc6e0a-2648-442e-bdbd-85445a4f72f4 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:22:08.524975 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-79bc6e0a-2648-442e-bdbd-85445a4f72f4 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:22:08.525482 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-79bc6e0a-2648-442e-bdbd-85445a4f72f4 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:22:08.526310 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-79bc6e0a-2648-442e-bdbd-85445a4f72f4 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:22:08.526775 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-79bc6e0a-2648-442e-bdbd-85445a4f72f4 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:22:08.527214 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-79bc6e0a-2648-442e-bdbd-85445a4f72f4 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:22:08.660362 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-79bc6e0a-2648-442e-bdbd-85445a4f72f4 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c85602851244d4a632b9c861eb4416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45cb377c6a9a43b3b91c99a64e37f1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:22:08.669739 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-79bc6e0a-2648-442e-bdbd-85445a4f72f4 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def" status: 200 len: 1669 microversion: 2.1 time: 0.156894 Oct 22 21:22:08.670515 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2788/5597] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:22:08 2022] GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def => generated 1669 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:22:08.694476 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-1bfe9d43-76de-4955-87b6-a2ac27a69455 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:22:08.695115 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-1bfe9d43-76de-4955-87b6-a2ac27a69455 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: 20d90b58-3fad-4a44-b6bf-4ef0cc587def] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:22:08.701758 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1bfe9d43-76de-4955-87b6-a2ac27a69455 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:22:08.702265 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1bfe9d43-76de-4955-87b6-a2ac27a69455 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:22:08.702723 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1bfe9d43-76de-4955-87b6-a2ac27a69455 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:22:08.703470 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1bfe9d43-76de-4955-87b6-a2ac27a69455 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:22:08.703949 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1bfe9d43-76de-4955-87b6-a2ac27a69455 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:22:08.704395 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1bfe9d43-76de-4955-87b6-a2ac27a69455 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:22:08.844180 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-1bfe9d43-76de-4955-87b6-a2ac27a69455 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c85602851244d4a632b9c861eb4416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45cb377c6a9a43b3b91c99a64e37f1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:22:08.853057 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-1bfe9d43-76de-4955-87b6-a2ac27a69455 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def" status: 200 len: 1669 microversion: 2.1 time: 0.162648 Oct 22 21:22:08.854309 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2810/5598] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:22:08 2022] GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def => generated 1669 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:22:08.876403 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-314ba0a5-9508-4e93-9608-5ac182d3c479 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:22:08.877037 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-314ba0a5-9508-4e93-9608-5ac182d3c479 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: 20d90b58-3fad-4a44-b6bf-4ef0cc587def] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:22:08.883037 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-314ba0a5-9508-4e93-9608-5ac182d3c479 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:22:08.883557 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-314ba0a5-9508-4e93-9608-5ac182d3c479 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:22:08.883986 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-314ba0a5-9508-4e93-9608-5ac182d3c479 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:22:08.884684 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-314ba0a5-9508-4e93-9608-5ac182d3c479 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:22:08.885138 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-314ba0a5-9508-4e93-9608-5ac182d3c479 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:22:08.885563 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-314ba0a5-9508-4e93-9608-5ac182d3c479 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:22:09.019182 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-314ba0a5-9508-4e93-9608-5ac182d3c479 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c85602851244d4a632b9c861eb4416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45cb377c6a9a43b3b91c99a64e37f1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:22:09.027514 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-314ba0a5-9508-4e93-9608-5ac182d3c479 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def" status: 200 len: 1669 microversion: 2.1 time: 0.155099 Oct 22 21:22:09.028106 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2789/5599] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:22:08 2022] GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def => generated 1669 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:22:09.050814 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-e16ff6b6-10a6-48ff-b291-a252eafde976 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:22:09.051584 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-e16ff6b6-10a6-48ff-b291-a252eafde976 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: 20d90b58-3fad-4a44-b6bf-4ef0cc587def] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:22:09.057621 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e16ff6b6-10a6-48ff-b291-a252eafde976 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:22:09.058114 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e16ff6b6-10a6-48ff-b291-a252eafde976 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:22:09.058577 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e16ff6b6-10a6-48ff-b291-a252eafde976 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:22:09.059303 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e16ff6b6-10a6-48ff-b291-a252eafde976 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:22:09.060017 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e16ff6b6-10a6-48ff-b291-a252eafde976 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:22:09.060654 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e16ff6b6-10a6-48ff-b291-a252eafde976 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:22:09.203594 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-e16ff6b6-10a6-48ff-b291-a252eafde976 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c85602851244d4a632b9c861eb4416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45cb377c6a9a43b3b91c99a64e37f1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:22:09.213335 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-e16ff6b6-10a6-48ff-b291-a252eafde976 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def" status: 200 len: 1669 microversion: 2.1 time: 0.166486 Oct 22 21:22:09.213922 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2811/5600] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:22:09 2022] GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def => generated 1669 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:22:09.237011 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-51d7de5c-25c6-460f-834a-db805ad5abb3 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:22:09.237763 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-51d7de5c-25c6-460f-834a-db805ad5abb3 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: 20d90b58-3fad-4a44-b6bf-4ef0cc587def] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:22:09.244191 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-51d7de5c-25c6-460f-834a-db805ad5abb3 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:22:09.244688 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-51d7de5c-25c6-460f-834a-db805ad5abb3 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:22:09.245167 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-51d7de5c-25c6-460f-834a-db805ad5abb3 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:22:09.245870 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-51d7de5c-25c6-460f-834a-db805ad5abb3 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:22:09.246333 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-51d7de5c-25c6-460f-834a-db805ad5abb3 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:22:09.246766 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-51d7de5c-25c6-460f-834a-db805ad5abb3 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:22:09.378972 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-51d7de5c-25c6-460f-834a-db805ad5abb3 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c85602851244d4a632b9c861eb4416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45cb377c6a9a43b3b91c99a64e37f1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:22:09.387347 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-51d7de5c-25c6-460f-834a-db805ad5abb3 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def" status: 200 len: 1669 microversion: 2.1 time: 0.154407 Oct 22 21:22:09.388143 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2790/5601] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:22:09 2022] GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def => generated 1669 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:23:04.551773 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_api:SELECT=9 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:23:04.552506 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:23:04.721684 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-ef2b4104-1a7a-435d-8bda-fad695df79c5 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:23:04.724215 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-ef2b4104-1a7a-435d-8bda-fad695df79c5 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: 20d90b58-3fad-4a44-b6bf-4ef0cc587def] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:23:04.731668 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ef2b4104-1a7a-435d-8bda-fad695df79c5 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:23:04.732263 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ef2b4104-1a7a-435d-8bda-fad695df79c5 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:23:04.732794 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ef2b4104-1a7a-435d-8bda-fad695df79c5 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:23:04.733591 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ef2b4104-1a7a-435d-8bda-fad695df79c5 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:23:04.734128 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ef2b4104-1a7a-435d-8bda-fad695df79c5 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:23:04.734675 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ef2b4104-1a7a-435d-8bda-fad695df79c5 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:23:04.813421 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-ef2b4104-1a7a-435d-8bda-fad695df79c5 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "POST /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def/action" status: 202 len: 0 microversion: 2.1 time: 0.266974 Oct 22 21:23:04.813983 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2812/5602] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 21:23:04 2022] POST /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def/action => generated 0 bytes in 269 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 21:23:04.823713 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-865b465d-b8b3-4185-986c-f0af47a4c87c tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:23:04.824373 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-865b465d-b8b3-4185-986c-f0af47a4c87c tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: 20d90b58-3fad-4a44-b6bf-4ef0cc587def] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:23:04.830864 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_api:SELECT=25 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:23:04.832233 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:SELECT=67,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:23:04.833983 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-865b465d-b8b3-4185-986c-f0af47a4c87c tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:23:04.834502 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-865b465d-b8b3-4185-986c-f0af47a4c87c tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:23:04.834907 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-865b465d-b8b3-4185-986c-f0af47a4c87c tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:23:04.835668 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-865b465d-b8b3-4185-986c-f0af47a4c87c tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:23:04.836125 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-865b465d-b8b3-4185-986c-f0af47a4c87c tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:23:04.836549 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-865b465d-b8b3-4185-986c-f0af47a4c87c tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:23:05.058379 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-865b465d-b8b3-4185-986c-f0af47a4c87c tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c85602851244d4a632b9c861eb4416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45cb377c6a9a43b3b91c99a64e37f1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:23:05.066977 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-865b465d-b8b3-4185-986c-f0af47a4c87c tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def" status: 200 len: 1671 microversion: 2.1 time: 0.248059 Oct 22 21:23:05.067606 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2791/5603] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:23:04 2022] GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def => generated 1671 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:23:06.092202 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-416dbd9f-5b34-4573-8ba8-7589bff41c93 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:23:06.093054 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-416dbd9f-5b34-4573-8ba8-7589bff41c93 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: 20d90b58-3fad-4a44-b6bf-4ef0cc587def] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:23:06.100493 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-416dbd9f-5b34-4573-8ba8-7589bff41c93 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:23:06.101070 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-416dbd9f-5b34-4573-8ba8-7589bff41c93 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:23:06.101613 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-416dbd9f-5b34-4573-8ba8-7589bff41c93 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:23:06.102576 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-416dbd9f-5b34-4573-8ba8-7589bff41c93 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:23:06.103093 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-416dbd9f-5b34-4573-8ba8-7589bff41c93 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:23:06.103581 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-416dbd9f-5b34-4573-8ba8-7589bff41c93 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:23:06.235123 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-416dbd9f-5b34-4573-8ba8-7589bff41c93 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c85602851244d4a632b9c861eb4416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45cb377c6a9a43b3b91c99a64e37f1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:23:06.243956 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-416dbd9f-5b34-4573-8ba8-7589bff41c93 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def" status: 200 len: 1669 microversion: 2.1 time: 0.157278 Oct 22 21:23:06.244535 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2813/5604] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:23:06 2022] GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def => generated 1669 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:23:21.292959 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-ceb2b25e-7e62-46bc-be9b-66ddb4a22600 tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:23:21.294324 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-ceb2b25e-7e62-46bc-be9b-66ddb4a22600 tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] [instance: 8dfe8aae-f5eb-4fcc-b801-7957bc9d608a] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:23:21.303010 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_api:SELECT=2 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:23:21.303892 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:SELECT=6 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:23:21.306221 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ceb2b25e-7e62-46bc-be9b-66ddb4a22600 tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:23:21.306797 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ceb2b25e-7e62-46bc-be9b-66ddb4a22600 tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:23:21.307301 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ceb2b25e-7e62-46bc-be9b-66ddb4a22600 tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:23:21.308448 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ceb2b25e-7e62-46bc-be9b-66ddb4a22600 tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:23:21.309034 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ceb2b25e-7e62-46bc-be9b-66ddb4a22600 tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:23:21.309534 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ceb2b25e-7e62-46bc-be9b-66ddb4a22600 tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:23:21.341170 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-ceb2b25e-7e62-46bc-be9b-66ddb4a22600 tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] 10.222.0.18 "GET /compute/v2.1/servers/8dfe8aae-f5eb-4fcc-b801-7957bc9d608a/os-server-password" status: 200 len: 116 microversion: 2.1 time: 0.054263 Oct 22 21:23:21.341765 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2792/5605] 10.222.0.18 () {58 vars in 1293 bytes} [Sat Oct 22 21:23:21 2022] GET /compute/v2.1/servers/8dfe8aae-f5eb-4fcc-b801-7957bc9d608a/os-server-password => generated 116 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:24:09.400327 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_api:SELECT=4 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:24:09.402139 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell1:SELECT=16,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:24:09.403428 ncdv-master-1 devstack@n-api.service[138745]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 22 21:24:09.404374 ncdv-master-1 devstack@n-api.service[138745]: Sat Oct 22 21:24:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def (ip 10.222.0.18) !!! Oct 22 21:24:09.410617 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-4d8ebabc-ffe7-4c41-9429-84bef79a0b02 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:24:09.412145 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-4d8ebabc-ffe7-4c41-9429-84bef79a0b02 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: 20d90b58-3fad-4a44-b6bf-4ef0cc587def] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:24:09.422805 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4d8ebabc-ffe7-4c41-9429-84bef79a0b02 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:24:09.423849 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4d8ebabc-ffe7-4c41-9429-84bef79a0b02 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:24:09.428927 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4d8ebabc-ffe7-4c41-9429-84bef79a0b02 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:24:09.430641 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4d8ebabc-ffe7-4c41-9429-84bef79a0b02 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:24:09.431265 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4d8ebabc-ffe7-4c41-9429-84bef79a0b02 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:24:09.431842 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4d8ebabc-ffe7-4c41-9429-84bef79a0b02 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:24:09.947597 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-4d8ebabc-ffe7-4c41-9429-84bef79a0b02 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c85602851244d4a632b9c861eb4416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45cb377c6a9a43b3b91c99a64e37f1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:24:09.963171 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-4d8ebabc-ffe7-4c41-9429-84bef79a0b02 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def" status: 200 len: 1669 microversion: 2.1 time: 0.560340 Oct 22 21:24:09.965122 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2814/5606] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:24:09 2022] GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def => generated 1669 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:24:09.995915 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-e50d3b2f-91b8-4f6e-a78c-80c883787a99 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:24:09.996817 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-e50d3b2f-91b8-4f6e-a78c-80c883787a99 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: 20d90b58-3fad-4a44-b6bf-4ef0cc587def] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:24:09.999045 ncdv-master-1 devstack@n-api.service[138744]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 22 21:24:09.999216 ncdv-master-1 devstack@n-api.service[138744]: Sat Oct 22 21:24:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def (ip 10.222.0.18) !!! Oct 22 21:24:10.001836 ncdv-master-1 devstack@n-api.service[138744]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Oct 22 21:24:10.003082 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_api:SELECT=2 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:24:10.004531 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:SELECT=4 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:24:10.015823 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e50d3b2f-91b8-4f6e-a78c-80c883787a99 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:24:10.016527 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e50d3b2f-91b8-4f6e-a78c-80c883787a99 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:24:10.017177 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e50d3b2f-91b8-4f6e-a78c-80c883787a99 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:24:10.018233 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e50d3b2f-91b8-4f6e-a78c-80c883787a99 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:24:10.018868 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e50d3b2f-91b8-4f6e-a78c-80c883787a99 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:24:10.019522 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e50d3b2f-91b8-4f6e-a78c-80c883787a99 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:24:10.314593 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-e50d3b2f-91b8-4f6e-a78c-80c883787a99 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c85602851244d4a632b9c861eb4416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45cb377c6a9a43b3b91c99a64e37f1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:24:10.324089 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-e50d3b2f-91b8-4f6e-a78c-80c883787a99 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def" status: 200 len: 1669 microversion: 2.1 time: 0.332773 Oct 22 21:24:10.325399 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2793/5607] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:24:09 2022] GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def => generated 1669 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:24:10.350431 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-84e8b7e6-be73-4b20-b431-75f486a248bd tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:24:10.352661 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-84e8b7e6-be73-4b20-b431-75f486a248bd tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: 20d90b58-3fad-4a44-b6bf-4ef0cc587def] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:24:10.359161 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-84e8b7e6-be73-4b20-b431-75f486a248bd tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:24:10.359698 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-84e8b7e6-be73-4b20-b431-75f486a248bd tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:24:10.360148 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-84e8b7e6-be73-4b20-b431-75f486a248bd tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:24:10.361337 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-84e8b7e6-be73-4b20-b431-75f486a248bd tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:24:10.362009 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-84e8b7e6-be73-4b20-b431-75f486a248bd tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:24:10.365283 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-84e8b7e6-be73-4b20-b431-75f486a248bd tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:24:10.594256 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-84e8b7e6-be73-4b20-b431-75f486a248bd tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c85602851244d4a632b9c861eb4416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45cb377c6a9a43b3b91c99a64e37f1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:24:10.606283 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-84e8b7e6-be73-4b20-b431-75f486a248bd tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def" status: 200 len: 1669 microversion: 2.1 time: 0.260736 Oct 22 21:24:10.608199 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2815/5608] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:24:10 2022] GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def => generated 1669 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:24:10.630879 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-aaff4e17-502c-4d91-9857-9e41c23a0563 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:24:10.631874 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-aaff4e17-502c-4d91-9857-9e41c23a0563 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: 20d90b58-3fad-4a44-b6bf-4ef0cc587def] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:24:10.641930 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-aaff4e17-502c-4d91-9857-9e41c23a0563 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:24:10.642760 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-aaff4e17-502c-4d91-9857-9e41c23a0563 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:24:10.643467 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-aaff4e17-502c-4d91-9857-9e41c23a0563 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:24:10.644484 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-aaff4e17-502c-4d91-9857-9e41c23a0563 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:24:10.645253 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-aaff4e17-502c-4d91-9857-9e41c23a0563 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:24:10.646201 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-aaff4e17-502c-4d91-9857-9e41c23a0563 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:24:10.825797 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-aaff4e17-502c-4d91-9857-9e41c23a0563 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c85602851244d4a632b9c861eb4416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45cb377c6a9a43b3b91c99a64e37f1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:24:10.835982 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-aaff4e17-502c-4d91-9857-9e41c23a0563 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def" status: 200 len: 1669 microversion: 2.1 time: 0.209444 Oct 22 21:24:10.836635 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2794/5609] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:24:10 2022] GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def => generated 1669 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:24:10.982737 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-157f11ed-f028-4ff6-b94f-82903c771d23 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-950569097", "imageRef": "085e4478-6edc-4a69-8e08-f9831713eb65", "flavorRef": "452", "networks": [{"uuid": "8c5a5758-cdfc-480f-aa56-074dfadd0152"}]}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:24:11.054023 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.network.neutron [None req-157f11ed-f028-4ff6-b94f-82903c771d23 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] validate_networks() for [('8c5a5758-cdfc-480f-aa56-074dfadd0152', None, None, None, None, None)] {{(pid=138745) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 21:24:11.725703 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-157f11ed-f028-4ff6-b94f-82903c771d23 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Flavor limits 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 21:24:11.728078 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-157f11ed-f028-4ff6-b94f-82903c771d23 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Image limits 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 21:24:11.728836 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-157f11ed-f028-4ff6-b94f-82903c771d23 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Flavor pref 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 21:24:11.729752 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-157f11ed-f028-4ff6-b94f-82903c771d23 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Image pref 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 21:24:11.731261 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-157f11ed-f028-4ff6-b94f-82903c771d23 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 21:24:11.744229 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-157f11ed-f028-4ff6-b94f-82903c771d23 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:24:11.745165 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-157f11ed-f028-4ff6-b94f-82903c771d23 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:24:11.745909 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-157f11ed-f028-4ff6-b94f-82903c771d23 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:24:11.746914 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-157f11ed-f028-4ff6-b94f-82903c771d23 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:24:11.747723 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-157f11ed-f028-4ff6-b94f-82903c771d23 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:24:11.748492 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-157f11ed-f028-4ff6-b94f-82903c771d23 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:24:11.773220 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-157f11ed-f028-4ff6-b94f-82903c771d23 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Getting quotas for project 45cb377c6a9a43b3b91c99a64e37f1eb. Resources: {'cores', 'instances', 'ram'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 21:24:11.781773 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-157f11ed-f028-4ff6-b94f-82903c771d23 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Getting quotas for user c9c85602851244d4a632b9c861eb4416 and project 45cb377c6a9a43b3b91c99a64e37f1eb. Resources: {'cores', 'instances', 'ram'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 21:24:11.801656 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-157f11ed-f028-4ff6-b94f-82903c771d23 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Going to run 1 instances... {{(pid=138745) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 21:24:11.805869 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-157f11ed-f028-4ff6-b94f-82903c771d23 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: 61b522d6-fcd9-4bd7-bc4e-0459f0fcc6db] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='085e4478-6edc-4a69-8e08-f9831713eb65',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138745) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 21:24:11.890564 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-157f11ed-f028-4ff6-b94f-82903c771d23 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.911853 Oct 22 21:24:11.892065 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2816/5610] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Oct 22 21:24:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 914 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 21:24:11.903378 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-5effa080-69d8-43ca-b247-5d9c8ec80026 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:24:11.904047 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-5effa080-69d8-43ca-b247-5d9c8ec80026 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: 61b522d6-fcd9-4bd7-bc4e-0459f0fcc6db] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:24:12.028004 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-5effa080-69d8-43ca-b247-5d9c8ec80026 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c85602851244d4a632b9c861eb4416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45cb377c6a9a43b3b91c99a64e37f1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:24:12.036286 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-5effa080-69d8-43ca-b247-5d9c8ec80026 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "GET /compute/v2.1/servers/61b522d6-fcd9-4bd7-bc4e-0459f0fcc6db" status: 200 len: 1214 microversion: 2.1 time: 0.136966 Oct 22 21:24:12.040777 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2795/5611] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:24:11 2022] GET /compute/v2.1/servers/61b522d6-fcd9-4bd7-bc4e-0459f0fcc6db => generated 1214 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:24:13.074906 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-429e236c-6bca-4a2d-902d-d2cbf3a76a2d tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:24:13.075714 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-429e236c-6bca-4a2d-902d-d2cbf3a76a2d tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: 61b522d6-fcd9-4bd7-bc4e-0459f0fcc6db] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:24:13.086702 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-429e236c-6bca-4a2d-902d-d2cbf3a76a2d tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:24:13.087212 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-429e236c-6bca-4a2d-902d-d2cbf3a76a2d tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:24:13.087690 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-429e236c-6bca-4a2d-902d-d2cbf3a76a2d tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:24:13.088421 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-429e236c-6bca-4a2d-902d-d2cbf3a76a2d tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:24:13.088887 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-429e236c-6bca-4a2d-902d-d2cbf3a76a2d tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:24:13.089326 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-429e236c-6bca-4a2d-902d-d2cbf3a76a2d tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:24:13.165912 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-429e236c-6bca-4a2d-902d-d2cbf3a76a2d tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c85602851244d4a632b9c861eb4416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45cb377c6a9a43b3b91c99a64e37f1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:24:13.174018 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-429e236c-6bca-4a2d-902d-d2cbf3a76a2d tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "GET /compute/v2.1/servers/61b522d6-fcd9-4bd7-bc4e-0459f0fcc6db" status: 200 len: 1266 microversion: 2.1 time: 0.106035 Oct 22 21:24:13.174716 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2817/5612] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:24:13 2022] GET /compute/v2.1/servers/61b522d6-fcd9-4bd7-bc4e-0459f0fcc6db => generated 1266 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:24:14.198981 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-2a369a96-6f45-4a03-be12-41f804d8ea2d tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:24:14.199741 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-2a369a96-6f45-4a03-be12-41f804d8ea2d tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: 61b522d6-fcd9-4bd7-bc4e-0459f0fcc6db] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:24:14.215315 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2a369a96-6f45-4a03-be12-41f804d8ea2d tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:24:14.217249 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2a369a96-6f45-4a03-be12-41f804d8ea2d tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:24:14.217791 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2a369a96-6f45-4a03-be12-41f804d8ea2d tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:24:14.219928 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2a369a96-6f45-4a03-be12-41f804d8ea2d tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:24:14.220487 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2a369a96-6f45-4a03-be12-41f804d8ea2d tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:24:14.221151 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2a369a96-6f45-4a03-be12-41f804d8ea2d tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:24:14.324392 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-2a369a96-6f45-4a03-be12-41f804d8ea2d tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c85602851244d4a632b9c861eb4416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45cb377c6a9a43b3b91c99a64e37f1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:24:14.347855 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-2a369a96-6f45-4a03-be12-41f804d8ea2d tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "GET /compute/v2.1/servers/61b522d6-fcd9-4bd7-bc4e-0459f0fcc6db" status: 200 len: 1272 microversion: 2.1 time: 0.152287 Oct 22 21:24:14.350366 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2796/5613] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:24:14 2022] GET /compute/v2.1/servers/61b522d6-fcd9-4bd7-bc4e-0459f0fcc6db => generated 1272 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:24:15.374754 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-562cd1e4-cbd4-4bb0-8f9e-ca2d42b423df tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:24:15.375630 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-562cd1e4-cbd4-4bb0-8f9e-ca2d42b423df tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: 61b522d6-fcd9-4bd7-bc4e-0459f0fcc6db] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:24:15.386568 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-562cd1e4-cbd4-4bb0-8f9e-ca2d42b423df tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:24:15.387456 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-562cd1e4-cbd4-4bb0-8f9e-ca2d42b423df tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:24:15.388129 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-562cd1e4-cbd4-4bb0-8f9e-ca2d42b423df tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:24:15.389286 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-562cd1e4-cbd4-4bb0-8f9e-ca2d42b423df tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:24:15.389985 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-562cd1e4-cbd4-4bb0-8f9e-ca2d42b423df tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:24:15.391226 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-562cd1e4-cbd4-4bb0-8f9e-ca2d42b423df tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:24:15.561736 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-88055ee6-563e-42ed-aeff-08d8843df769 req-466ef9b0-5d9e-4049-9cb7-746f7793e24d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "61b522d6-fcd9-4bd7-bc4e-0459f0fcc6db", "tag": "0ac720b0-9841-46d5-83c3-934d01828bc7"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:24:15.604229 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-88055ee6-563e-42ed-aeff-08d8843df769 req-466ef9b0-5d9e-4049-9cb7-746f7793e24d service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:24:15.605048 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-88055ee6-563e-42ed-aeff-08d8843df769 req-466ef9b0-5d9e-4049-9cb7-746f7793e24d service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:24:15.607003 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-88055ee6-563e-42ed-aeff-08d8843df769 req-466ef9b0-5d9e-4049-9cb7-746f7793e24d service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:24:15.662128 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-88055ee6-563e-42ed-aeff-08d8843df769 req-466ef9b0-5d9e-4049-9cb7-746f7793e24d service nova] Creating event network-changed:0ac720b0-9841-46d5-83c3-934d01828bc7 for instance 61b522d6-fcd9-4bd7-bc4e-0459f0fcc6db on nch2-master-1 Oct 22 21:24:15.673310 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-88055ee6-563e-42ed-aeff-08d8843df769 req-466ef9b0-5d9e-4049-9cb7-746f7793e24d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116964 Oct 22 21:24:15.674046 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2797/5614] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:24:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 21:24:15.782934 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-562cd1e4-cbd4-4bb0-8f9e-ca2d42b423df tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c85602851244d4a632b9c861eb4416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45cb377c6a9a43b3b91c99a64e37f1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:24:15.791954 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-562cd1e4-cbd4-4bb0-8f9e-ca2d42b423df tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "GET /compute/v2.1/servers/61b522d6-fcd9-4bd7-bc4e-0459f0fcc6db" status: 200 len: 1314 microversion: 2.1 time: 0.422268 Oct 22 21:24:15.809764 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2818/5615] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:24:15 2022] GET /compute/v2.1/servers/61b522d6-fcd9-4bd7-bc4e-0459f0fcc6db => generated 1314 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:24:16.818886 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-e7c36381-1173-49af-8cb1-0ac19700283f tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:24:16.820329 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-e7c36381-1173-49af-8cb1-0ac19700283f tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: 61b522d6-fcd9-4bd7-bc4e-0459f0fcc6db] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:24:16.827515 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e7c36381-1173-49af-8cb1-0ac19700283f tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:24:16.828232 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e7c36381-1173-49af-8cb1-0ac19700283f tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:24:16.828897 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e7c36381-1173-49af-8cb1-0ac19700283f tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:24:16.829622 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e7c36381-1173-49af-8cb1-0ac19700283f tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:24:16.830297 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e7c36381-1173-49af-8cb1-0ac19700283f tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:24:16.831069 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e7c36381-1173-49af-8cb1-0ac19700283f tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:24:16.974113 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-e7c36381-1173-49af-8cb1-0ac19700283f tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c85602851244d4a632b9c861eb4416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45cb377c6a9a43b3b91c99a64e37f1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:24:16.982774 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-e7c36381-1173-49af-8cb1-0ac19700283f tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "GET /compute/v2.1/servers/61b522d6-fcd9-4bd7-bc4e-0459f0fcc6db" status: 200 len: 1314 microversion: 2.1 time: 0.168616 Oct 22 21:24:16.983406 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2798/5616] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:24:16 2022] GET /compute/v2.1/servers/61b522d6-fcd9-4bd7-bc4e-0459f0fcc6db => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:24:18.005962 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-3a02d8c6-6a6d-4769-87b7-ffd99a959fb9 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:24:18.007191 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-3a02d8c6-6a6d-4769-87b7-ffd99a959fb9 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: 61b522d6-fcd9-4bd7-bc4e-0459f0fcc6db] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:24:18.014981 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3a02d8c6-6a6d-4769-87b7-ffd99a959fb9 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:24:18.015794 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3a02d8c6-6a6d-4769-87b7-ffd99a959fb9 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:24:18.016451 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3a02d8c6-6a6d-4769-87b7-ffd99a959fb9 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:24:18.017371 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3a02d8c6-6a6d-4769-87b7-ffd99a959fb9 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:24:18.018026 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3a02d8c6-6a6d-4769-87b7-ffd99a959fb9 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:24:18.018634 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3a02d8c6-6a6d-4769-87b7-ffd99a959fb9 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:24:18.329403 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-3a02d8c6-6a6d-4769-87b7-ffd99a959fb9 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c85602851244d4a632b9c861eb4416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45cb377c6a9a43b3b91c99a64e37f1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:24:18.337778 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-3a02d8c6-6a6d-4769-87b7-ffd99a959fb9 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "GET /compute/v2.1/servers/61b522d6-fcd9-4bd7-bc4e-0459f0fcc6db" status: 200 len: 1314 microversion: 2.1 time: 0.335921 Oct 22 21:24:18.338363 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2819/5617] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:24:18 2022] GET /compute/v2.1/servers/61b522d6-fcd9-4bd7-bc4e-0459f0fcc6db => generated 1314 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:24:19.362083 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-87020801-8f5a-44e1-9f17-9977eb03556d tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:24:19.363392 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-87020801-8f5a-44e1-9f17-9977eb03556d tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: 61b522d6-fcd9-4bd7-bc4e-0459f0fcc6db] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:24:19.372383 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-87020801-8f5a-44e1-9f17-9977eb03556d tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:24:19.372876 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-87020801-8f5a-44e1-9f17-9977eb03556d tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:24:19.373316 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-87020801-8f5a-44e1-9f17-9977eb03556d tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:24:19.374038 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-87020801-8f5a-44e1-9f17-9977eb03556d tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:24:19.374494 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-87020801-8f5a-44e1-9f17-9977eb03556d tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:24:19.374927 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-87020801-8f5a-44e1-9f17-9977eb03556d tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:24:19.624453 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-87020801-8f5a-44e1-9f17-9977eb03556d tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c85602851244d4a632b9c861eb4416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45cb377c6a9a43b3b91c99a64e37f1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:24:19.634078 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-87020801-8f5a-44e1-9f17-9977eb03556d tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "GET /compute/v2.1/servers/61b522d6-fcd9-4bd7-bc4e-0459f0fcc6db" status: 200 len: 1314 microversion: 2.1 time: 0.275811 Oct 22 21:24:19.649926 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2799/5618] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:24:19 2022] GET /compute/v2.1/servers/61b522d6-fcd9-4bd7-bc4e-0459f0fcc6db => generated 1314 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:24:20.658783 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-c942b9c3-7d39-40ea-98a1-533aa322e7a3 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:24:20.660184 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-c942b9c3-7d39-40ea-98a1-533aa322e7a3 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: 61b522d6-fcd9-4bd7-bc4e-0459f0fcc6db] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:24:20.668311 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c942b9c3-7d39-40ea-98a1-533aa322e7a3 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:24:20.669034 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c942b9c3-7d39-40ea-98a1-533aa322e7a3 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:24:20.669900 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c942b9c3-7d39-40ea-98a1-533aa322e7a3 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:24:20.670872 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c942b9c3-7d39-40ea-98a1-533aa322e7a3 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:24:20.672362 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c942b9c3-7d39-40ea-98a1-533aa322e7a3 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:24:20.673084 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c942b9c3-7d39-40ea-98a1-533aa322e7a3 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:24:20.920514 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-c942b9c3-7d39-40ea-98a1-533aa322e7a3 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c85602851244d4a632b9c861eb4416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45cb377c6a9a43b3b91c99a64e37f1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:24:20.929236 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-c942b9c3-7d39-40ea-98a1-533aa322e7a3 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "GET /compute/v2.1/servers/61b522d6-fcd9-4bd7-bc4e-0459f0fcc6db" status: 200 len: 1314 microversion: 2.1 time: 0.275172 Oct 22 21:24:20.930060 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2820/5619] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:24:20 2022] GET /compute/v2.1/servers/61b522d6-fcd9-4bd7-bc4e-0459f0fcc6db => generated 1314 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:24:21.646865 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-c405b25e-9972-4302-9c39-7e2e8dfb2ce9 req-4602aff9-e891-4a3c-925b-3b8e9f53bde2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61b522d6-fcd9-4bd7-bc4e-0459f0fcc6db", "name": "network-vif-plugged", "status": "completed", "tag": "0ac720b0-9841-46d5-83c3-934d01828bc7"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:24:21.659811 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-c405b25e-9972-4302-9c39-7e2e8dfb2ce9 req-4602aff9-e891-4a3c-925b-3b8e9f53bde2 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:24:21.660633 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-c405b25e-9972-4302-9c39-7e2e8dfb2ce9 req-4602aff9-e891-4a3c-925b-3b8e9f53bde2 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:24:21.661101 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-c405b25e-9972-4302-9c39-7e2e8dfb2ce9 req-4602aff9-e891-4a3c-925b-3b8e9f53bde2 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:24:21.674613 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-c405b25e-9972-4302-9c39-7e2e8dfb2ce9 req-4602aff9-e891-4a3c-925b-3b8e9f53bde2 service nova] Creating event network-vif-plugged:0ac720b0-9841-46d5-83c3-934d01828bc7 for instance 61b522d6-fcd9-4bd7-bc4e-0459f0fcc6db on nch2-master-1 Oct 22 21:24:21.680374 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-c405b25e-9972-4302-9c39-7e2e8dfb2ce9 req-4602aff9-e891-4a3c-925b-3b8e9f53bde2 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037515 Oct 22 21:24:21.681296 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2800/5620] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:24:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:24:21.956230 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-d481a1f7-602c-4adf-96ad-72dde6a7cbc8 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:24:21.957098 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-d481a1f7-602c-4adf-96ad-72dde6a7cbc8 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: 61b522d6-fcd9-4bd7-bc4e-0459f0fcc6db] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:24:21.959963 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell0:SELECT=2 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:24:21.961073 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell0:SELECT=6 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:24:21.967231 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d481a1f7-602c-4adf-96ad-72dde6a7cbc8 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:24:21.967768 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d481a1f7-602c-4adf-96ad-72dde6a7cbc8 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:24:21.968221 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d481a1f7-602c-4adf-96ad-72dde6a7cbc8 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:24:21.968954 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d481a1f7-602c-4adf-96ad-72dde6a7cbc8 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:24:21.969406 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d481a1f7-602c-4adf-96ad-72dde6a7cbc8 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:24:21.969845 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d481a1f7-602c-4adf-96ad-72dde6a7cbc8 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:24:22.194083 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-d481a1f7-602c-4adf-96ad-72dde6a7cbc8 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c85602851244d4a632b9c861eb4416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45cb377c6a9a43b3b91c99a64e37f1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:24:22.202727 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-d481a1f7-602c-4adf-96ad-72dde6a7cbc8 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "GET /compute/v2.1/servers/61b522d6-fcd9-4bd7-bc4e-0459f0fcc6db" status: 200 len: 1314 microversion: 2.1 time: 0.252829 Oct 22 21:24:22.203663 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2821/5621] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:24:21 2022] GET /compute/v2.1/servers/61b522d6-fcd9-4bd7-bc4e-0459f0fcc6db => generated 1314 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:24:23.239678 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-22fbc3d5-f248-420f-b976-d627607b052f tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:24:23.241250 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-22fbc3d5-f248-420f-b976-d627607b052f tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: 61b522d6-fcd9-4bd7-bc4e-0459f0fcc6db] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:24:23.248421 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell0:SELECT=2 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:24:23.262538 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-22fbc3d5-f248-420f-b976-d627607b052f tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:24:23.263905 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-22fbc3d5-f248-420f-b976-d627607b052f tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:24:23.266726 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-22fbc3d5-f248-420f-b976-d627607b052f tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:24:23.268500 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-22fbc3d5-f248-420f-b976-d627607b052f tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:24:23.269082 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-22fbc3d5-f248-420f-b976-d627607b052f tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:24:23.269538 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-22fbc3d5-f248-420f-b976-d627607b052f tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:24:23.454726 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-22fbc3d5-f248-420f-b976-d627607b052f tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c85602851244d4a632b9c861eb4416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45cb377c6a9a43b3b91c99a64e37f1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:24:23.468079 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-22fbc3d5-f248-420f-b976-d627607b052f tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "GET /compute/v2.1/servers/61b522d6-fcd9-4bd7-bc4e-0459f0fcc6db" status: 200 len: 1500 microversion: 2.1 time: 0.240281 Oct 22 21:24:23.470366 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2801/5622] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:24:23 2022] GET /compute/v2.1/servers/61b522d6-fcd9-4bd7-bc4e-0459f0fcc6db => generated 1500 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:24:23.492521 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-372a5b32-9b97-495a-aee4-d9cf3698d137 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "default"}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:24:23.493109 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-372a5b32-9b97-495a-aee4-d9cf3698d137 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: 61b522d6-fcd9-4bd7-bc4e-0459f0fcc6db] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:24:23.506579 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-372a5b32-9b97-495a-aee4-d9cf3698d137 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:24:23.507525 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-372a5b32-9b97-495a-aee4-d9cf3698d137 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:24:23.508189 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-372a5b32-9b97-495a-aee4-d9cf3698d137 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:24:23.509146 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-372a5b32-9b97-495a-aee4-d9cf3698d137 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:24:23.509838 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-372a5b32-9b97-495a-aee4-d9cf3698d137 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:24:23.510500 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-372a5b32-9b97-495a-aee4-d9cf3698d137 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:24:23.755804 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.network.security_group_api [None req-372a5b32-9b97-495a-aee4-d9cf3698d137 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Removing security group e9222b01-1f1d-48c6-b410-1799b27a0b44 from port 0ac720b0-9841-46d5-83c3-934d01828bc7 Oct 22 21:24:24.293947 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-372a5b32-9b97-495a-aee4-d9cf3698d137 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "POST /compute/v2.1/servers/61b522d6-fcd9-4bd7-bc4e-0459f0fcc6db/action" status: 202 len: 0 microversion: 2.1 time: 0.805633 Oct 22 21:24:24.294573 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2822/5623] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 21:24:23 2022] POST /compute/v2.1/servers/61b522d6-fcd9-4bd7-bc4e-0459f0fcc6db/action => generated 0 bytes in 807 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 21:24:24.303615 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-290bc384-6eaf-4846-a6b8-630416a6cc49 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:24:24.304251 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-290bc384-6eaf-4846-a6b8-630416a6cc49 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: 61b522d6-fcd9-4bd7-bc4e-0459f0fcc6db] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:24:24.305768 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-bf1556df-a68a-4383-9ea0-d606d3a4bdd8 req-75f38bff-9ada-4d2d-94e8-7aa2cdaab18c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "61b522d6-fcd9-4bd7-bc4e-0459f0fcc6db", "tag": "0ac720b0-9841-46d5-83c3-934d01828bc7"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:24:24.316516 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-bf1556df-a68a-4383-9ea0-d606d3a4bdd8 req-75f38bff-9ada-4d2d-94e8-7aa2cdaab18c service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:24:24.317009 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-bf1556df-a68a-4383-9ea0-d606d3a4bdd8 req-75f38bff-9ada-4d2d-94e8-7aa2cdaab18c service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:24:24.317904 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-bf1556df-a68a-4383-9ea0-d606d3a4bdd8 req-75f38bff-9ada-4d2d-94e8-7aa2cdaab18c service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:24:24.318767 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-290bc384-6eaf-4846-a6b8-630416a6cc49 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:24:24.319127 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-290bc384-6eaf-4846-a6b8-630416a6cc49 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:24:24.319793 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-290bc384-6eaf-4846-a6b8-630416a6cc49 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:24:24.320829 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-290bc384-6eaf-4846-a6b8-630416a6cc49 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:24:24.321288 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-290bc384-6eaf-4846-a6b8-630416a6cc49 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:24:24.321725 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-290bc384-6eaf-4846-a6b8-630416a6cc49 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:24:24.334929 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-bf1556df-a68a-4383-9ea0-d606d3a4bdd8 req-75f38bff-9ada-4d2d-94e8-7aa2cdaab18c service nova] Creating event network-changed:0ac720b0-9841-46d5-83c3-934d01828bc7 for instance 61b522d6-fcd9-4bd7-bc4e-0459f0fcc6db on nch2-master-1 Oct 22 21:24:24.343585 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-bf1556df-a68a-4383-9ea0-d606d3a4bdd8 req-75f38bff-9ada-4d2d-94e8-7aa2cdaab18c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040596 Oct 22 21:24:24.344338 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2823/5624] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:24:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:24:24.880821 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-290bc384-6eaf-4846-a6b8-630416a6cc49 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c85602851244d4a632b9c861eb4416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45cb377c6a9a43b3b91c99a64e37f1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:24:24.891302 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-290bc384-6eaf-4846-a6b8-630416a6cc49 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "GET /compute/v2.1/servers/61b522d6-fcd9-4bd7-bc4e-0459f0fcc6db" status: 200 len: 1458 microversion: 2.1 time: 0.592360 Oct 22 21:24:24.892174 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2802/5625] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:24:24 2022] GET /compute/v2.1/servers/61b522d6-fcd9-4bd7-bc4e-0459f0fcc6db => generated 1458 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:24:24.919089 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-cf7a27c9-ab5c-467e-8fbd-84ff3d66eb8e tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:24:24.921696 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-cf7a27c9-ab5c-467e-8fbd-84ff3d66eb8e tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: 20d90b58-3fad-4a44-b6bf-4ef0cc587def] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:24:24.928845 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cf7a27c9-ab5c-467e-8fbd-84ff3d66eb8e tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:24:24.929468 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cf7a27c9-ab5c-467e-8fbd-84ff3d66eb8e tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:24:24.929983 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cf7a27c9-ab5c-467e-8fbd-84ff3d66eb8e tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:24:24.930781 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cf7a27c9-ab5c-467e-8fbd-84ff3d66eb8e tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:24:24.931313 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cf7a27c9-ab5c-467e-8fbd-84ff3d66eb8e tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:24:24.931845 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cf7a27c9-ab5c-467e-8fbd-84ff3d66eb8e tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:24:25.146766 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-cf7a27c9-ab5c-467e-8fbd-84ff3d66eb8e tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c85602851244d4a632b9c861eb4416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45cb377c6a9a43b3b91c99a64e37f1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:24:25.155025 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-cf7a27c9-ab5c-467e-8fbd-84ff3d66eb8e tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def" status: 200 len: 1669 microversion: 2.1 time: 0.244122 Oct 22 21:24:25.155787 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2824/5626] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:24:24 2022] GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def => generated 1669 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:24:25.181045 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-02350c9e-08b1-4b55-90a7-186ac8e0cde7 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:24:25.181660 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-02350c9e-08b1-4b55-90a7-186ac8e0cde7 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: 20d90b58-3fad-4a44-b6bf-4ef0cc587def] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:24:25.187931 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-02350c9e-08b1-4b55-90a7-186ac8e0cde7 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:24:25.188672 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-02350c9e-08b1-4b55-90a7-186ac8e0cde7 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:24:25.189116 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-02350c9e-08b1-4b55-90a7-186ac8e0cde7 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:24:25.190272 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-02350c9e-08b1-4b55-90a7-186ac8e0cde7 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:24:25.190410 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-02350c9e-08b1-4b55-90a7-186ac8e0cde7 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:24:25.190719 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-02350c9e-08b1-4b55-90a7-186ac8e0cde7 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:24:25.420766 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-02350c9e-08b1-4b55-90a7-186ac8e0cde7 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c85602851244d4a632b9c861eb4416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45cb377c6a9a43b3b91c99a64e37f1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:24:25.429486 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-02350c9e-08b1-4b55-90a7-186ac8e0cde7 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def" status: 200 len: 1669 microversion: 2.1 time: 0.252498 Oct 22 21:24:25.430354 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2803/5627] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:24:25 2022] GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def => generated 1669 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:24:25.452470 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-e0262c32-e94b-4d9a-97bc-42dfffd59183 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:24:25.453567 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-e0262c32-e94b-4d9a-97bc-42dfffd59183 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: 20d90b58-3fad-4a44-b6bf-4ef0cc587def] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:24:25.460471 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e0262c32-e94b-4d9a-97bc-42dfffd59183 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:24:25.461204 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e0262c32-e94b-4d9a-97bc-42dfffd59183 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:24:25.461665 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e0262c32-e94b-4d9a-97bc-42dfffd59183 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:24:25.462393 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e0262c32-e94b-4d9a-97bc-42dfffd59183 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:24:25.462853 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e0262c32-e94b-4d9a-97bc-42dfffd59183 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:24:25.463646 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e0262c32-e94b-4d9a-97bc-42dfffd59183 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:24:25.606920 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-e0262c32-e94b-4d9a-97bc-42dfffd59183 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c85602851244d4a632b9c861eb4416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45cb377c6a9a43b3b91c99a64e37f1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:24:25.615882 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-e0262c32-e94b-4d9a-97bc-42dfffd59183 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def" status: 200 len: 1669 microversion: 2.1 time: 0.166962 Oct 22 21:24:25.616493 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2825/5628] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:24:25 2022] GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def => generated 1669 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:24:25.639491 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-3a8de425-68e6-4f7d-b170-bc3fe5965ce0 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:24:25.640117 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-3a8de425-68e6-4f7d-b170-bc3fe5965ce0 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: 20d90b58-3fad-4a44-b6bf-4ef0cc587def] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:24:25.646523 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3a8de425-68e6-4f7d-b170-bc3fe5965ce0 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:24:25.647388 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3a8de425-68e6-4f7d-b170-bc3fe5965ce0 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:24:25.648086 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3a8de425-68e6-4f7d-b170-bc3fe5965ce0 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:24:25.648859 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3a8de425-68e6-4f7d-b170-bc3fe5965ce0 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:24:25.649543 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3a8de425-68e6-4f7d-b170-bc3fe5965ce0 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:24:25.650840 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3a8de425-68e6-4f7d-b170-bc3fe5965ce0 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:24:25.787562 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-3a8de425-68e6-4f7d-b170-bc3fe5965ce0 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c85602851244d4a632b9c861eb4416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45cb377c6a9a43b3b91c99a64e37f1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:24:25.795759 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-3a8de425-68e6-4f7d-b170-bc3fe5965ce0 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def" status: 200 len: 1669 microversion: 2.1 time: 0.160611 Oct 22 21:24:25.796552 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2804/5629] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:24:25 2022] GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def => generated 1669 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:24:25.866725 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-a7645739-715f-49da-945d-aab304fe231a tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1347027541", "imageRef": "085e4478-6edc-4a69-8e08-f9831713eb65", "flavorRef": "452", "networks": [{"uuid": "8c5a5758-cdfc-480f-aa56-074dfadd0152"}]}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:24:25.939740 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.network.neutron [None req-a7645739-715f-49da-945d-aab304fe231a tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] validate_networks() for [('8c5a5758-cdfc-480f-aa56-074dfadd0152', None, None, None, None, None)] {{(pid=138745) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 21:24:26.356394 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-a7645739-715f-49da-945d-aab304fe231a tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Flavor limits 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 21:24:26.356835 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-a7645739-715f-49da-945d-aab304fe231a tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Image limits 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 21:24:26.357336 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-a7645739-715f-49da-945d-aab304fe231a tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Flavor pref 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 21:24:26.357765 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-a7645739-715f-49da-945d-aab304fe231a tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Image pref 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 21:24:26.358607 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-a7645739-715f-49da-945d-aab304fe231a tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 21:24:26.368129 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a7645739-715f-49da-945d-aab304fe231a tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:24:26.368639 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a7645739-715f-49da-945d-aab304fe231a tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:24:26.369847 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a7645739-715f-49da-945d-aab304fe231a tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:24:26.370537 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a7645739-715f-49da-945d-aab304fe231a tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:24:26.371224 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a7645739-715f-49da-945d-aab304fe231a tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:24:26.371703 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a7645739-715f-49da-945d-aab304fe231a tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:24:26.390173 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-a7645739-715f-49da-945d-aab304fe231a tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Getting quotas for project 45cb377c6a9a43b3b91c99a64e37f1eb. Resources: {'cores', 'instances', 'ram'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 21:24:26.395977 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-a7645739-715f-49da-945d-aab304fe231a tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Getting quotas for user c9c85602851244d4a632b9c861eb4416 and project 45cb377c6a9a43b3b91c99a64e37f1eb. Resources: {'cores', 'instances', 'ram'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 21:24:26.409189 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-a7645739-715f-49da-945d-aab304fe231a tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Going to run 1 instances... {{(pid=138745) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 21:24:26.411919 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-a7645739-715f-49da-945d-aab304fe231a tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: edcbe825-78fa-4a69-bd00-65e531a5c411] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='085e4478-6edc-4a69-8e08-f9831713eb65',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138745) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 21:24:26.466919 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-a7645739-715f-49da-945d-aab304fe231a tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.604062 Oct 22 21:24:26.467800 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2826/5630] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Oct 22 21:24:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 606 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 21:24:26.480308 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-1f9257ea-1f19-407e-a43c-e12c9c91d40e tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:24:26.480958 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-1f9257ea-1f19-407e-a43c-e12c9c91d40e tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: edcbe825-78fa-4a69-bd00-65e531a5c411] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:24:26.579054 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-1f9257ea-1f19-407e-a43c-e12c9c91d40e tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c85602851244d4a632b9c861eb4416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45cb377c6a9a43b3b91c99a64e37f1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:24:26.590400 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-1f9257ea-1f19-407e-a43c-e12c9c91d40e tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "GET /compute/v2.1/servers/edcbe825-78fa-4a69-bd00-65e531a5c411" status: 200 len: 1215 microversion: 2.1 time: 0.114269 Oct 22 21:24:26.591643 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2805/5631] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:24:26 2022] GET /compute/v2.1/servers/edcbe825-78fa-4a69-bd00-65e531a5c411 => generated 1215 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:24:27.616028 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-69b69d66-e4af-4e25-b7f1-ae921911f082 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:24:27.616693 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-69b69d66-e4af-4e25-b7f1-ae921911f082 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: edcbe825-78fa-4a69-bd00-65e531a5c411] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:24:27.625100 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-69b69d66-e4af-4e25-b7f1-ae921911f082 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:24:27.625611 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-69b69d66-e4af-4e25-b7f1-ae921911f082 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:24:27.626052 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-69b69d66-e4af-4e25-b7f1-ae921911f082 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:24:27.626779 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-69b69d66-e4af-4e25-b7f1-ae921911f082 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:24:27.627253 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-69b69d66-e4af-4e25-b7f1-ae921911f082 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:24:27.627802 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-69b69d66-e4af-4e25-b7f1-ae921911f082 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:24:27.746705 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-69b69d66-e4af-4e25-b7f1-ae921911f082 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c85602851244d4a632b9c861eb4416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45cb377c6a9a43b3b91c99a64e37f1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:24:27.756279 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-69b69d66-e4af-4e25-b7f1-ae921911f082 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "GET /compute/v2.1/servers/edcbe825-78fa-4a69-bd00-65e531a5c411" status: 200 len: 1267 microversion: 2.1 time: 0.144386 Oct 22 21:24:27.757201 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2827/5632] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:24:27 2022] GET /compute/v2.1/servers/edcbe825-78fa-4a69-bd00-65e531a5c411 => generated 1267 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:24:28.780940 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-a1d45371-c19e-4748-987a-5bef504788a6 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:24:28.781554 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-a1d45371-c19e-4748-987a-5bef504788a6 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: edcbe825-78fa-4a69-bd00-65e531a5c411] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:24:28.794322 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a1d45371-c19e-4748-987a-5bef504788a6 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:24:28.795210 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a1d45371-c19e-4748-987a-5bef504788a6 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:24:28.795861 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a1d45371-c19e-4748-987a-5bef504788a6 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:24:28.796738 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a1d45371-c19e-4748-987a-5bef504788a6 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:24:28.797336 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a1d45371-c19e-4748-987a-5bef504788a6 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:24:28.797926 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a1d45371-c19e-4748-987a-5bef504788a6 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:24:29.065416 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-a1d45371-c19e-4748-987a-5bef504788a6 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c85602851244d4a632b9c861eb4416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45cb377c6a9a43b3b91c99a64e37f1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:24:29.074257 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-a1d45371-c19e-4748-987a-5bef504788a6 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "GET /compute/v2.1/servers/edcbe825-78fa-4a69-bd00-65e531a5c411" status: 200 len: 1315 microversion: 2.1 time: 0.297144 Oct 22 21:24:29.088549 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2806/5633] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:24:28 2022] GET /compute/v2.1/servers/edcbe825-78fa-4a69-bd00-65e531a5c411 => generated 1315 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:24:30.100531 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-7f5716bd-7d90-43b1-9710-fc5583d953d3 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:24:30.101072 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-7f5716bd-7d90-43b1-9710-fc5583d953d3 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: edcbe825-78fa-4a69-bd00-65e531a5c411] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:24:30.110455 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7f5716bd-7d90-43b1-9710-fc5583d953d3 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:24:30.110975 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7f5716bd-7d90-43b1-9710-fc5583d953d3 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:24:30.111439 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7f5716bd-7d90-43b1-9710-fc5583d953d3 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:24:30.112313 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7f5716bd-7d90-43b1-9710-fc5583d953d3 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:24:30.112992 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7f5716bd-7d90-43b1-9710-fc5583d953d3 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:24:30.113505 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7f5716bd-7d90-43b1-9710-fc5583d953d3 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:24:30.405035 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-7f5716bd-7d90-43b1-9710-fc5583d953d3 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c85602851244d4a632b9c861eb4416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45cb377c6a9a43b3b91c99a64e37f1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:24:30.415538 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-7f5716bd-7d90-43b1-9710-fc5583d953d3 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "GET /compute/v2.1/servers/edcbe825-78fa-4a69-bd00-65e531a5c411" status: 200 len: 1315 microversion: 2.1 time: 0.319548 Oct 22 21:24:30.416502 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2828/5634] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:24:30 2022] GET /compute/v2.1/servers/edcbe825-78fa-4a69-bd00-65e531a5c411 => generated 1315 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:24:30.525762 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-b65bd898-0f65-4727-abcc-b8c21aad664a req-7797343e-91ad-43d8-8818-4ec9662d8f84 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "edcbe825-78fa-4a69-bd00-65e531a5c411", "tag": "063f1f1f-3195-453e-b747-a0d74f337166"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:24:30.561271 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-b65bd898-0f65-4727-abcc-b8c21aad664a req-7797343e-91ad-43d8-8818-4ec9662d8f84 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:24:30.562121 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-b65bd898-0f65-4727-abcc-b8c21aad664a req-7797343e-91ad-43d8-8818-4ec9662d8f84 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:24:30.562696 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-b65bd898-0f65-4727-abcc-b8c21aad664a req-7797343e-91ad-43d8-8818-4ec9662d8f84 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:24:30.581786 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-b65bd898-0f65-4727-abcc-b8c21aad664a req-7797343e-91ad-43d8-8818-4ec9662d8f84 service nova] Creating event network-changed:063f1f1f-3195-453e-b747-a0d74f337166 for instance edcbe825-78fa-4a69-bd00-65e531a5c411 on nch1-master-1 Oct 22 21:24:30.587904 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-b65bd898-0f65-4727-abcc-b8c21aad664a req-7797343e-91ad-43d8-8818-4ec9662d8f84 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065657 Oct 22 21:24:30.589526 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2807/5635] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:24:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:24:31.438334 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-71b7d7e3-b924-4022-bb4d-af6943a243ea tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:24:31.438950 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-71b7d7e3-b924-4022-bb4d-af6943a243ea tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: edcbe825-78fa-4a69-bd00-65e531a5c411] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:24:31.446797 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-71b7d7e3-b924-4022-bb4d-af6943a243ea tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:24:31.447566 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-71b7d7e3-b924-4022-bb4d-af6943a243ea tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:24:31.448019 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-71b7d7e3-b924-4022-bb4d-af6943a243ea tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:24:31.448910 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-71b7d7e3-b924-4022-bb4d-af6943a243ea tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:24:31.449378 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-71b7d7e3-b924-4022-bb4d-af6943a243ea tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:24:31.449848 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-71b7d7e3-b924-4022-bb4d-af6943a243ea tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:24:31.583436 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-71b7d7e3-b924-4022-bb4d-af6943a243ea tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c85602851244d4a632b9c861eb4416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45cb377c6a9a43b3b91c99a64e37f1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:24:31.591478 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-71b7d7e3-b924-4022-bb4d-af6943a243ea tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "GET /compute/v2.1/servers/edcbe825-78fa-4a69-bd00-65e531a5c411" status: 200 len: 1315 microversion: 2.1 time: 0.157113 Oct 22 21:24:31.592054 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2829/5636] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:24:31 2022] GET /compute/v2.1/servers/edcbe825-78fa-4a69-bd00-65e531a5c411 => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:24:32.616285 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-572345d8-08ac-4e8f-9edf-be44eca98074 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:24:32.617095 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-572345d8-08ac-4e8f-9edf-be44eca98074 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: edcbe825-78fa-4a69-bd00-65e531a5c411] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:24:32.624759 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-572345d8-08ac-4e8f-9edf-be44eca98074 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:24:32.625252 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-572345d8-08ac-4e8f-9edf-be44eca98074 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:24:32.625697 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-572345d8-08ac-4e8f-9edf-be44eca98074 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:24:32.626414 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-572345d8-08ac-4e8f-9edf-be44eca98074 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:24:32.626872 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-572345d8-08ac-4e8f-9edf-be44eca98074 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:24:32.627309 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-572345d8-08ac-4e8f-9edf-be44eca98074 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:24:32.764194 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-572345d8-08ac-4e8f-9edf-be44eca98074 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c85602851244d4a632b9c861eb4416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45cb377c6a9a43b3b91c99a64e37f1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:24:32.772546 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-572345d8-08ac-4e8f-9edf-be44eca98074 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "GET /compute/v2.1/servers/edcbe825-78fa-4a69-bd00-65e531a5c411" status: 200 len: 1315 microversion: 2.1 time: 0.161174 Oct 22 21:24:32.773246 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2808/5637] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:24:32 2022] GET /compute/v2.1/servers/edcbe825-78fa-4a69-bd00-65e531a5c411 => generated 1315 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:24:33.796037 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-7d6e31ff-79cd-4dea-9366-0499e2085072 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:24:33.796700 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-7d6e31ff-79cd-4dea-9366-0499e2085072 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: edcbe825-78fa-4a69-bd00-65e531a5c411] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:24:33.805751 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7d6e31ff-79cd-4dea-9366-0499e2085072 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:24:33.806244 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7d6e31ff-79cd-4dea-9366-0499e2085072 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:24:33.807134 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7d6e31ff-79cd-4dea-9366-0499e2085072 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:24:33.808146 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7d6e31ff-79cd-4dea-9366-0499e2085072 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:24:33.808798 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7d6e31ff-79cd-4dea-9366-0499e2085072 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:24:33.809430 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7d6e31ff-79cd-4dea-9366-0499e2085072 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:24:34.051794 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-7d6e31ff-79cd-4dea-9366-0499e2085072 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c85602851244d4a632b9c861eb4416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45cb377c6a9a43b3b91c99a64e37f1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:24:34.060458 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-7d6e31ff-79cd-4dea-9366-0499e2085072 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "GET /compute/v2.1/servers/edcbe825-78fa-4a69-bd00-65e531a5c411" status: 200 len: 1315 microversion: 2.1 time: 0.268063 Oct 22 21:24:34.061032 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2830/5638] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:24:33 2022] GET /compute/v2.1/servers/edcbe825-78fa-4a69-bd00-65e531a5c411 => generated 1315 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:24:35.084015 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-49442dea-fd0f-49c2-afa0-3275e4751752 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:24:35.084638 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-49442dea-fd0f-49c2-afa0-3275e4751752 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: edcbe825-78fa-4a69-bd00-65e531a5c411] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:24:35.092501 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-49442dea-fd0f-49c2-afa0-3275e4751752 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:24:35.093074 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-49442dea-fd0f-49c2-afa0-3275e4751752 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:24:35.093530 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-49442dea-fd0f-49c2-afa0-3275e4751752 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:24:35.094265 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-49442dea-fd0f-49c2-afa0-3275e4751752 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:24:35.094730 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-49442dea-fd0f-49c2-afa0-3275e4751752 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:24:35.095372 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-49442dea-fd0f-49c2-afa0-3275e4751752 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:24:35.247043 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-49442dea-fd0f-49c2-afa0-3275e4751752 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c85602851244d4a632b9c861eb4416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45cb377c6a9a43b3b91c99a64e37f1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:24:35.255733 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-49442dea-fd0f-49c2-afa0-3275e4751752 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "GET /compute/v2.1/servers/edcbe825-78fa-4a69-bd00-65e531a5c411" status: 200 len: 1315 microversion: 2.1 time: 0.176024 Oct 22 21:24:35.256341 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2809/5639] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:24:35 2022] GET /compute/v2.1/servers/edcbe825-78fa-4a69-bd00-65e531a5c411 => generated 1315 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:24:36.279457 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-117ac5a5-b618-4022-8af8-8a3216379cab tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:24:36.280105 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-117ac5a5-b618-4022-8af8-8a3216379cab tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: edcbe825-78fa-4a69-bd00-65e531a5c411] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:24:36.287295 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-117ac5a5-b618-4022-8af8-8a3216379cab tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:24:36.287837 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-117ac5a5-b618-4022-8af8-8a3216379cab tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:24:36.288294 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-117ac5a5-b618-4022-8af8-8a3216379cab tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:24:36.289024 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-117ac5a5-b618-4022-8af8-8a3216379cab tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:24:36.289492 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-117ac5a5-b618-4022-8af8-8a3216379cab tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:24:36.289940 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-117ac5a5-b618-4022-8af8-8a3216379cab tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:24:36.379508 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell0:SELECT=2 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:24:36.404363 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell0:SELECT=6 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:24:36.424759 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-117ac5a5-b618-4022-8af8-8a3216379cab tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c85602851244d4a632b9c861eb4416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45cb377c6a9a43b3b91c99a64e37f1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:24:36.433321 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-117ac5a5-b618-4022-8af8-8a3216379cab tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "GET /compute/v2.1/servers/edcbe825-78fa-4a69-bd00-65e531a5c411" status: 200 len: 1315 microversion: 2.1 time: 0.157794 Oct 22 21:24:36.433946 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2831/5640] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:24:36 2022] GET /compute/v2.1/servers/edcbe825-78fa-4a69-bd00-65e531a5c411 => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:24:37.034623 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-49f24034-8b76-4592-8aa2-5fce4161b342 req-886d3dd2-c7af-419c-8723-e1c1cc352754 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "edcbe825-78fa-4a69-bd00-65e531a5c411", "name": "network-vif-plugged", "status": "completed", "tag": "063f1f1f-3195-453e-b747-a0d74f337166"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:24:37.041552 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell0:SELECT=2 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:24:37.060753 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-49f24034-8b76-4592-8aa2-5fce4161b342 req-886d3dd2-c7af-419c-8723-e1c1cc352754 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:24:37.061448 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-49f24034-8b76-4592-8aa2-5fce4161b342 req-886d3dd2-c7af-419c-8723-e1c1cc352754 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:24:37.062975 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-49f24034-8b76-4592-8aa2-5fce4161b342 req-886d3dd2-c7af-419c-8723-e1c1cc352754 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:24:37.080043 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-49f24034-8b76-4592-8aa2-5fce4161b342 req-886d3dd2-c7af-419c-8723-e1c1cc352754 service nova] Creating event network-vif-plugged:063f1f1f-3195-453e-b747-a0d74f337166 for instance edcbe825-78fa-4a69-bd00-65e531a5c411 on nch1-master-1 Oct 22 21:24:37.085952 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-49f24034-8b76-4592-8aa2-5fce4161b342 req-886d3dd2-c7af-419c-8723-e1c1cc352754 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054621 Oct 22 21:24:37.086713 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2810/5641] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:24:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 21:24:37.457506 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-7538620d-e2cf-4f6c-b933-c97d6b594931 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:24:37.458477 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-7538620d-e2cf-4f6c-b933-c97d6b594931 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: edcbe825-78fa-4a69-bd00-65e531a5c411] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:24:37.465719 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7538620d-e2cf-4f6c-b933-c97d6b594931 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:24:37.466233 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7538620d-e2cf-4f6c-b933-c97d6b594931 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:24:37.466695 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7538620d-e2cf-4f6c-b933-c97d6b594931 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:24:37.467446 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7538620d-e2cf-4f6c-b933-c97d6b594931 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:24:37.468050 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7538620d-e2cf-4f6c-b933-c97d6b594931 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:24:37.468495 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7538620d-e2cf-4f6c-b933-c97d6b594931 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:24:37.604074 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-7538620d-e2cf-4f6c-b933-c97d6b594931 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c85602851244d4a632b9c861eb4416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45cb377c6a9a43b3b91c99a64e37f1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:24:37.607719 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell1:SELECT=100 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:24:37.613733 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-7538620d-e2cf-4f6c-b933-c97d6b594931 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "GET /compute/v2.1/servers/edcbe825-78fa-4a69-bd00-65e531a5c411" status: 200 len: 1315 microversion: 2.1 time: 0.160303 Oct 22 21:24:37.614481 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2832/5642] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:24:37 2022] GET /compute/v2.1/servers/edcbe825-78fa-4a69-bd00-65e531a5c411 => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:24:38.639679 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-036c3a15-74d5-4fee-8e18-4f565744671d tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:24:38.640323 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-036c3a15-74d5-4fee-8e18-4f565744671d tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: edcbe825-78fa-4a69-bd00-65e531a5c411] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:24:38.648076 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-036c3a15-74d5-4fee-8e18-4f565744671d tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:24:38.648593 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-036c3a15-74d5-4fee-8e18-4f565744671d tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:24:38.649026 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-036c3a15-74d5-4fee-8e18-4f565744671d tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:24:38.649806 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-036c3a15-74d5-4fee-8e18-4f565744671d tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:24:38.650283 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-036c3a15-74d5-4fee-8e18-4f565744671d tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:24:38.650759 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-036c3a15-74d5-4fee-8e18-4f565744671d tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:24:38.787749 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-036c3a15-74d5-4fee-8e18-4f565744671d tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c85602851244d4a632b9c861eb4416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45cb377c6a9a43b3b91c99a64e37f1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:24:38.795733 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-036c3a15-74d5-4fee-8e18-4f565744671d tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "GET /compute/v2.1/servers/edcbe825-78fa-4a69-bd00-65e531a5c411" status: 200 len: 1501 microversion: 2.1 time: 0.161422 Oct 22 21:24:38.796331 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2811/5643] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:24:38 2022] GET /compute/v2.1/servers/edcbe825-78fa-4a69-bd00-65e531a5c411 => generated 1501 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:24:38.820550 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-b682b712-bdcd-4266-8968-d5f4063d87ac tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:24:38.821065 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-b682b712-bdcd-4266-8968-d5f4063d87ac tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: edcbe825-78fa-4a69-bd00-65e531a5c411] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:24:38.828640 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b682b712-bdcd-4266-8968-d5f4063d87ac tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:24:38.829162 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b682b712-bdcd-4266-8968-d5f4063d87ac tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:24:38.829624 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b682b712-bdcd-4266-8968-d5f4063d87ac tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:24:38.830340 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b682b712-bdcd-4266-8968-d5f4063d87ac tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:24:38.830805 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b682b712-bdcd-4266-8968-d5f4063d87ac tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:24:38.831248 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b682b712-bdcd-4266-8968-d5f4063d87ac tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:24:38.908025 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-b682b712-bdcd-4266-8968-d5f4063d87ac tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "POST /compute/v2.1/servers/edcbe825-78fa-4a69-bd00-65e531a5c411/action" status: 202 len: 0 microversion: 2.1 time: 0.092124 Oct 22 21:24:38.908719 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2833/5644] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 21:24:38 2022] POST /compute/v2.1/servers/edcbe825-78fa-4a69-bd00-65e531a5c411/action => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 21:24:38.917436 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-479349f3-828d-436a-a333-bf41c9c5e6f6 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:24:38.918176 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-479349f3-828d-436a-a333-bf41c9c5e6f6 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: edcbe825-78fa-4a69-bd00-65e531a5c411] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:24:38.924649 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-479349f3-828d-436a-a333-bf41c9c5e6f6 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:24:38.925111 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-479349f3-828d-436a-a333-bf41c9c5e6f6 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:24:38.925578 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-479349f3-828d-436a-a333-bf41c9c5e6f6 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:24:38.926245 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-479349f3-828d-436a-a333-bf41c9c5e6f6 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:24:38.926700 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-479349f3-828d-436a-a333-bf41c9c5e6f6 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:24:38.927120 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-479349f3-828d-436a-a333-bf41c9c5e6f6 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:24:39.066490 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-479349f3-828d-436a-a333-bf41c9c5e6f6 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c85602851244d4a632b9c861eb4416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45cb377c6a9a43b3b91c99a64e37f1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:24:39.075487 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-479349f3-828d-436a-a333-bf41c9c5e6f6 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "GET /compute/v2.1/servers/edcbe825-78fa-4a69-bd00-65e531a5c411" status: 200 len: 1506 microversion: 2.1 time: 0.161990 Oct 22 21:24:39.076085 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2812/5645] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:24:38 2022] GET /compute/v2.1/servers/edcbe825-78fa-4a69-bd00-65e531a5c411 => generated 1506 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:24:40.102711 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-0568af72-29e0-41dc-9943-8eabec8c7076 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:24:40.103305 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-0568af72-29e0-41dc-9943-8eabec8c7076 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: edcbe825-78fa-4a69-bd00-65e531a5c411] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:24:40.105630 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=6 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:24:40.111385 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0568af72-29e0-41dc-9943-8eabec8c7076 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:24:40.111907 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0568af72-29e0-41dc-9943-8eabec8c7076 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:24:40.112358 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0568af72-29e0-41dc-9943-8eabec8c7076 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:24:40.113074 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0568af72-29e0-41dc-9943-8eabec8c7076 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:24:40.113547 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0568af72-29e0-41dc-9943-8eabec8c7076 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:24:40.113991 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0568af72-29e0-41dc-9943-8eabec8c7076 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:24:40.251652 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-0568af72-29e0-41dc-9943-8eabec8c7076 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c85602851244d4a632b9c861eb4416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45cb377c6a9a43b3b91c99a64e37f1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:24:40.259741 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-0568af72-29e0-41dc-9943-8eabec8c7076 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "GET /compute/v2.1/servers/edcbe825-78fa-4a69-bd00-65e531a5c411" status: 200 len: 1486 microversion: 2.1 time: 0.162798 Oct 22 21:24:40.260307 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2834/5646] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:24:40 2022] GET /compute/v2.1/servers/edcbe825-78fa-4a69-bd00-65e531a5c411 => generated 1486 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:24:40.282184 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-e80eef92-9368-41ac-b9d3-89b0c9d8b73c tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:24:40.282715 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-e80eef92-9368-41ac-b9d3-89b0c9d8b73c tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: edcbe825-78fa-4a69-bd00-65e531a5c411] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:24:40.285661 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_api:SELECT=45 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:24:40.291326 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e80eef92-9368-41ac-b9d3-89b0c9d8b73c tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:24:40.291861 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e80eef92-9368-41ac-b9d3-89b0c9d8b73c tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:24:40.292312 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e80eef92-9368-41ac-b9d3-89b0c9d8b73c tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:24:40.293016 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e80eef92-9368-41ac-b9d3-89b0c9d8b73c tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:24:40.293478 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e80eef92-9368-41ac-b9d3-89b0c9d8b73c tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:24:40.293907 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e80eef92-9368-41ac-b9d3-89b0c9d8b73c tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:24:40.296447 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:SELECT=93 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:24:40.318189 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.objects.instance [None req-e80eef92-9368-41ac-b9d3-89b0c9d8b73c tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lazy-loading 'flavor' on Instance uuid edcbe825-78fa-4a69-bd00-65e531a5c411 {{(pid=138744) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 21:24:40.517146 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-e80eef92-9368-41ac-b9d3-89b0c9d8b73c tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "POST /compute/v2.1/servers/edcbe825-78fa-4a69-bd00-65e531a5c411/action" status: 202 len: 0 microversion: 2.1 time: 0.238859 Oct 22 21:24:40.517767 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2813/5647] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 21:24:40 2022] POST /compute/v2.1/servers/edcbe825-78fa-4a69-bd00-65e531a5c411/action => generated 0 bytes in 240 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 21:24:40.526369 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-9b558aec-133a-42e4-8c1f-38f898927f3d tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:24:40.527013 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-9b558aec-133a-42e4-8c1f-38f898927f3d tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: edcbe825-78fa-4a69-bd00-65e531a5c411] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:24:40.533277 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9b558aec-133a-42e4-8c1f-38f898927f3d tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:24:40.533809 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9b558aec-133a-42e4-8c1f-38f898927f3d tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:24:40.534248 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9b558aec-133a-42e4-8c1f-38f898927f3d tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:24:40.534996 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9b558aec-133a-42e4-8c1f-38f898927f3d tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:24:40.535466 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9b558aec-133a-42e4-8c1f-38f898927f3d tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:24:40.535912 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9b558aec-133a-42e4-8c1f-38f898927f3d tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:24:40.671801 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-9b558aec-133a-42e4-8c1f-38f898927f3d tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c85602851244d4a632b9c861eb4416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45cb377c6a9a43b3b91c99a64e37f1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:24:40.680198 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-9b558aec-133a-42e4-8c1f-38f898927f3d tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "GET /compute/v2.1/servers/edcbe825-78fa-4a69-bd00-65e531a5c411" status: 200 len: 1492 microversion: 2.1 time: 0.158014 Oct 22 21:24:40.680760 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2835/5648] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:24:40 2022] GET /compute/v2.1/servers/edcbe825-78fa-4a69-bd00-65e531a5c411 => generated 1492 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:24:41.710139 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-d5bc6bf3-953b-4690-a5ef-791204dda5f2 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:24:41.711314 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-d5bc6bf3-953b-4690-a5ef-791204dda5f2 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: edcbe825-78fa-4a69-bd00-65e531a5c411] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:24:41.724060 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d5bc6bf3-953b-4690-a5ef-791204dda5f2 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:24:41.725271 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d5bc6bf3-953b-4690-a5ef-791204dda5f2 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:24:41.726029 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d5bc6bf3-953b-4690-a5ef-791204dda5f2 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:24:41.727195 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d5bc6bf3-953b-4690-a5ef-791204dda5f2 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:24:41.727971 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d5bc6bf3-953b-4690-a5ef-791204dda5f2 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:24:41.728487 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d5bc6bf3-953b-4690-a5ef-791204dda5f2 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:24:41.862814 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-d5bc6bf3-953b-4690-a5ef-791204dda5f2 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c85602851244d4a632b9c861eb4416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45cb377c6a9a43b3b91c99a64e37f1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:24:41.871094 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-d5bc6bf3-953b-4690-a5ef-791204dda5f2 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "GET /compute/v2.1/servers/edcbe825-78fa-4a69-bd00-65e531a5c411" status: 200 len: 1492 microversion: 2.1 time: 0.169836 Oct 22 21:24:41.871714 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2814/5649] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:24:41 2022] GET /compute/v2.1/servers/edcbe825-78fa-4a69-bd00-65e531a5c411 => generated 1492 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:24:42.894790 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-29710691-aade-48e7-9d5a-5ee9c953450c tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:24:42.895318 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-29710691-aade-48e7-9d5a-5ee9c953450c tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: edcbe825-78fa-4a69-bd00-65e531a5c411] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:24:42.902761 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-29710691-aade-48e7-9d5a-5ee9c953450c tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:24:42.903266 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-29710691-aade-48e7-9d5a-5ee9c953450c tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:24:42.903759 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-29710691-aade-48e7-9d5a-5ee9c953450c tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:24:42.904474 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-29710691-aade-48e7-9d5a-5ee9c953450c tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:24:42.904942 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-29710691-aade-48e7-9d5a-5ee9c953450c tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:24:42.905383 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-29710691-aade-48e7-9d5a-5ee9c953450c tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:24:43.044701 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-29710691-aade-48e7-9d5a-5ee9c953450c tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c85602851244d4a632b9c861eb4416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45cb377c6a9a43b3b91c99a64e37f1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:24:43.053173 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-29710691-aade-48e7-9d5a-5ee9c953450c tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "GET /compute/v2.1/servers/edcbe825-78fa-4a69-bd00-65e531a5c411" status: 200 len: 1513 microversion: 2.1 time: 0.162582 Oct 22 21:24:43.053764 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2836/5650] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:24:42 2022] GET /compute/v2.1/servers/edcbe825-78fa-4a69-bd00-65e531a5c411 => generated 1513 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:24:44.080724 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-fd2dd914-4519-4a4a-8ac0-aa0024b2781a tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:24:44.081358 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-fd2dd914-4519-4a4a-8ac0-aa0024b2781a tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: edcbe825-78fa-4a69-bd00-65e531a5c411] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:24:44.092392 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fd2dd914-4519-4a4a-8ac0-aa0024b2781a tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:24:44.093139 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fd2dd914-4519-4a4a-8ac0-aa0024b2781a tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:24:44.093809 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fd2dd914-4519-4a4a-8ac0-aa0024b2781a tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:24:44.094841 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fd2dd914-4519-4a4a-8ac0-aa0024b2781a tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:24:44.095402 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fd2dd914-4519-4a4a-8ac0-aa0024b2781a tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:24:44.096104 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fd2dd914-4519-4a4a-8ac0-aa0024b2781a tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:24:44.238350 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-fd2dd914-4519-4a4a-8ac0-aa0024b2781a tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c85602851244d4a632b9c861eb4416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45cb377c6a9a43b3b91c99a64e37f1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:24:44.246602 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-fd2dd914-4519-4a4a-8ac0-aa0024b2781a tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "GET /compute/v2.1/servers/edcbe825-78fa-4a69-bd00-65e531a5c411" status: 200 len: 1513 microversion: 2.1 time: 0.172036 Oct 22 21:24:44.247174 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2815/5651] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:24:44 2022] GET /compute/v2.1/servers/edcbe825-78fa-4a69-bd00-65e531a5c411 => generated 1513 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:24:45.270343 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-6a6b7f97-21a3-48c7-ba96-06dc594bc57b tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:24:45.271093 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-6a6b7f97-21a3-48c7-ba96-06dc594bc57b tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: edcbe825-78fa-4a69-bd00-65e531a5c411] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:24:45.279153 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6a6b7f97-21a3-48c7-ba96-06dc594bc57b tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:24:45.280811 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6a6b7f97-21a3-48c7-ba96-06dc594bc57b tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:24:45.281436 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6a6b7f97-21a3-48c7-ba96-06dc594bc57b tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:24:45.282645 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6a6b7f97-21a3-48c7-ba96-06dc594bc57b tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:24:45.283279 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6a6b7f97-21a3-48c7-ba96-06dc594bc57b tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:24:45.283902 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6a6b7f97-21a3-48c7-ba96-06dc594bc57b tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:24:45.445687 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-6a6b7f97-21a3-48c7-ba96-06dc594bc57b tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c85602851244d4a632b9c861eb4416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45cb377c6a9a43b3b91c99a64e37f1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:24:45.456053 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-6a6b7f97-21a3-48c7-ba96-06dc594bc57b tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "GET /compute/v2.1/servers/edcbe825-78fa-4a69-bd00-65e531a5c411" status: 200 len: 1513 microversion: 2.1 time: 0.190279 Oct 22 21:24:45.457899 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2837/5652] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:24:45 2022] GET /compute/v2.1/servers/edcbe825-78fa-4a69-bd00-65e531a5c411 => generated 1513 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:24:46.486576 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-ea96ca00-8d25-4258-a302-42c83149ad1a tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:24:46.487080 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-ea96ca00-8d25-4258-a302-42c83149ad1a tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: edcbe825-78fa-4a69-bd00-65e531a5c411] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:24:46.493935 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ea96ca00-8d25-4258-a302-42c83149ad1a tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:24:46.494877 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ea96ca00-8d25-4258-a302-42c83149ad1a tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:24:46.495307 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ea96ca00-8d25-4258-a302-42c83149ad1a tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:24:46.496048 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ea96ca00-8d25-4258-a302-42c83149ad1a tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:24:46.496497 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ea96ca00-8d25-4258-a302-42c83149ad1a tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:24:46.496923 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ea96ca00-8d25-4258-a302-42c83149ad1a tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:24:46.701201 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-ea96ca00-8d25-4258-a302-42c83149ad1a tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c85602851244d4a632b9c861eb4416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45cb377c6a9a43b3b91c99a64e37f1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:24:46.714294 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-ea96ca00-8d25-4258-a302-42c83149ad1a tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "GET /compute/v2.1/servers/edcbe825-78fa-4a69-bd00-65e531a5c411" status: 200 len: 1508 microversion: 2.1 time: 0.230815 Oct 22 21:24:46.716008 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2816/5653] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:24:46 2022] GET /compute/v2.1/servers/edcbe825-78fa-4a69-bd00-65e531a5c411 => generated 1508 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:24:47.195468 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-710185c6-cb02-495e-91c3-a7c7f6093448 req-6b689dbe-c745-4b76-a7c8-4af2a85a1412 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "edcbe825-78fa-4a69-bd00-65e531a5c411", "name": "network-vif-plugged", "status": "completed", "tag": "063f1f1f-3195-453e-b747-a0d74f337166"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:24:47.214048 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-710185c6-cb02-495e-91c3-a7c7f6093448 req-6b689dbe-c745-4b76-a7c8-4af2a85a1412 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:24:47.214789 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-710185c6-cb02-495e-91c3-a7c7f6093448 req-6b689dbe-c745-4b76-a7c8-4af2a85a1412 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:24:47.216367 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-710185c6-cb02-495e-91c3-a7c7f6093448 req-6b689dbe-c745-4b76-a7c8-4af2a85a1412 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:24:47.232155 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-710185c6-cb02-495e-91c3-a7c7f6093448 req-6b689dbe-c745-4b76-a7c8-4af2a85a1412 service nova] Creating event network-vif-plugged:063f1f1f-3195-453e-b747-a0d74f337166 for instance edcbe825-78fa-4a69-bd00-65e531a5c411 on nch1-master-1 Oct 22 21:24:47.239789 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-710185c6-cb02-495e-91c3-a7c7f6093448 req-6b689dbe-c745-4b76-a7c8-4af2a85a1412 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048018 Oct 22 21:24:47.242282 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2838/5654] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:24:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:24:47.740590 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-b92e22a3-1bc6-437b-9a57-497092c53eca tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:24:47.741644 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-b92e22a3-1bc6-437b-9a57-497092c53eca tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: edcbe825-78fa-4a69-bd00-65e531a5c411] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:24:47.749969 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b92e22a3-1bc6-437b-9a57-497092c53eca tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:24:47.750787 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b92e22a3-1bc6-437b-9a57-497092c53eca tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:24:47.751704 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b92e22a3-1bc6-437b-9a57-497092c53eca tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:24:47.752623 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b92e22a3-1bc6-437b-9a57-497092c53eca tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:24:47.753187 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b92e22a3-1bc6-437b-9a57-497092c53eca tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:24:47.753715 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b92e22a3-1bc6-437b-9a57-497092c53eca tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:24:47.917625 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-b92e22a3-1bc6-437b-9a57-497092c53eca tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c85602851244d4a632b9c861eb4416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45cb377c6a9a43b3b91c99a64e37f1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:24:47.926355 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-b92e22a3-1bc6-437b-9a57-497092c53eca tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "GET /compute/v2.1/servers/edcbe825-78fa-4a69-bd00-65e531a5c411" status: 200 len: 1508 microversion: 2.1 time: 0.189710 Oct 22 21:24:47.926942 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2817/5655] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:24:47 2022] GET /compute/v2.1/servers/edcbe825-78fa-4a69-bd00-65e531a5c411 => generated 1508 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:24:48.952071 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-14c9e64b-e038-4c33-b87a-65a1334c5292 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:24:48.952808 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-14c9e64b-e038-4c33-b87a-65a1334c5292 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: edcbe825-78fa-4a69-bd00-65e531a5c411] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:24:48.960723 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-14c9e64b-e038-4c33-b87a-65a1334c5292 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:24:48.961282 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-14c9e64b-e038-4c33-b87a-65a1334c5292 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:24:48.977855 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-14c9e64b-e038-4c33-b87a-65a1334c5292 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:24:48.977855 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-14c9e64b-e038-4c33-b87a-65a1334c5292 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:24:48.977855 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-14c9e64b-e038-4c33-b87a-65a1334c5292 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:24:48.977855 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-14c9e64b-e038-4c33-b87a-65a1334c5292 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:24:49.108945 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-14c9e64b-e038-4c33-b87a-65a1334c5292 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c85602851244d4a632b9c861eb4416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45cb377c6a9a43b3b91c99a64e37f1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:24:49.120401 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-14c9e64b-e038-4c33-b87a-65a1334c5292 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "GET /compute/v2.1/servers/edcbe825-78fa-4a69-bd00-65e531a5c411" status: 200 len: 1508 microversion: 2.1 time: 0.173515 Oct 22 21:24:49.120988 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2839/5656] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:24:48 2022] GET /compute/v2.1/servers/edcbe825-78fa-4a69-bd00-65e531a5c411 => generated 1508 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:24:50.144602 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-c4be9240-5bae-4d67-9435-54f6dbc72bba tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:24:50.149227 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-c4be9240-5bae-4d67-9435-54f6dbc72bba tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: edcbe825-78fa-4a69-bd00-65e531a5c411] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:24:50.160001 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c4be9240-5bae-4d67-9435-54f6dbc72bba tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:24:50.160670 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c4be9240-5bae-4d67-9435-54f6dbc72bba tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:24:50.161211 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c4be9240-5bae-4d67-9435-54f6dbc72bba tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:24:50.162026 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c4be9240-5bae-4d67-9435-54f6dbc72bba tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:24:50.162614 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c4be9240-5bae-4d67-9435-54f6dbc72bba tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:24:50.163117 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c4be9240-5bae-4d67-9435-54f6dbc72bba tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:24:50.310875 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-c4be9240-5bae-4d67-9435-54f6dbc72bba tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c85602851244d4a632b9c861eb4416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45cb377c6a9a43b3b91c99a64e37f1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:24:50.321298 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-c4be9240-5bae-4d67-9435-54f6dbc72bba tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "GET /compute/v2.1/servers/edcbe825-78fa-4a69-bd00-65e531a5c411" status: 200 len: 1508 microversion: 2.1 time: 0.181191 Oct 22 21:24:50.322458 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2818/5657] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:24:50 2022] GET /compute/v2.1/servers/edcbe825-78fa-4a69-bd00-65e531a5c411 => generated 1508 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:24:51.345445 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-e185062b-2ef0-427a-8e97-d148943af56e tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:24:51.345995 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-e185062b-2ef0-427a-8e97-d148943af56e tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: edcbe825-78fa-4a69-bd00-65e531a5c411] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:24:51.353959 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e185062b-2ef0-427a-8e97-d148943af56e tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:24:51.354500 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e185062b-2ef0-427a-8e97-d148943af56e tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:24:51.355096 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e185062b-2ef0-427a-8e97-d148943af56e tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:24:51.356233 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e185062b-2ef0-427a-8e97-d148943af56e tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:24:51.356865 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e185062b-2ef0-427a-8e97-d148943af56e tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:24:51.357713 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e185062b-2ef0-427a-8e97-d148943af56e tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:24:51.511618 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-e185062b-2ef0-427a-8e97-d148943af56e tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c85602851244d4a632b9c861eb4416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45cb377c6a9a43b3b91c99a64e37f1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:24:51.523691 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-e185062b-2ef0-427a-8e97-d148943af56e tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "GET /compute/v2.1/servers/edcbe825-78fa-4a69-bd00-65e531a5c411" status: 200 len: 1508 microversion: 2.1 time: 0.182376 Oct 22 21:24:51.524608 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2840/5658] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:24:51 2022] GET /compute/v2.1/servers/edcbe825-78fa-4a69-bd00-65e531a5c411 => generated 1508 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:24:52.550529 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-fcec5732-08e1-416e-bf57-df8753c74c3e tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:24:52.551786 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-fcec5732-08e1-416e-bf57-df8753c74c3e tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: edcbe825-78fa-4a69-bd00-65e531a5c411] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:24:52.559739 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fcec5732-08e1-416e-bf57-df8753c74c3e tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:24:52.560204 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fcec5732-08e1-416e-bf57-df8753c74c3e tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:24:52.560794 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fcec5732-08e1-416e-bf57-df8753c74c3e tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:24:52.561655 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fcec5732-08e1-416e-bf57-df8753c74c3e tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:24:52.562258 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fcec5732-08e1-416e-bf57-df8753c74c3e tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:24:52.562834 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fcec5732-08e1-416e-bf57-df8753c74c3e tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:24:52.709309 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-fcec5732-08e1-416e-bf57-df8753c74c3e tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c85602851244d4a632b9c861eb4416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45cb377c6a9a43b3b91c99a64e37f1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:24:52.718710 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-fcec5732-08e1-416e-bf57-df8753c74c3e tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "GET /compute/v2.1/servers/edcbe825-78fa-4a69-bd00-65e531a5c411" status: 200 len: 1508 microversion: 2.1 time: 0.172117 Oct 22 21:24:52.735375 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2819/5659] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:24:52 2022] GET /compute/v2.1/servers/edcbe825-78fa-4a69-bd00-65e531a5c411 => generated 1508 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:24:53.743186 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-da0e61fd-0aac-4b59-81aa-a2836e2da285 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:24:53.744040 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-da0e61fd-0aac-4b59-81aa-a2836e2da285 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: edcbe825-78fa-4a69-bd00-65e531a5c411] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:24:53.751585 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-da0e61fd-0aac-4b59-81aa-a2836e2da285 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:24:53.752093 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-da0e61fd-0aac-4b59-81aa-a2836e2da285 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:24:53.752549 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-da0e61fd-0aac-4b59-81aa-a2836e2da285 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:24:53.753318 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-da0e61fd-0aac-4b59-81aa-a2836e2da285 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:24:53.753792 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-da0e61fd-0aac-4b59-81aa-a2836e2da285 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:24:53.754245 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-da0e61fd-0aac-4b59-81aa-a2836e2da285 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:24:53.901389 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-da0e61fd-0aac-4b59-81aa-a2836e2da285 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c85602851244d4a632b9c861eb4416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45cb377c6a9a43b3b91c99a64e37f1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:24:53.910452 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-da0e61fd-0aac-4b59-81aa-a2836e2da285 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "GET /compute/v2.1/servers/edcbe825-78fa-4a69-bd00-65e531a5c411" status: 200 len: 1508 microversion: 2.1 time: 0.171402 Oct 22 21:24:53.923969 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2841/5660] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:24:53 2022] GET /compute/v2.1/servers/edcbe825-78fa-4a69-bd00-65e531a5c411 => generated 1508 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:24:54.934618 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-17bf5227-7727-42b8-9a93-11d3bb11900a tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:24:54.935897 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-17bf5227-7727-42b8-9a93-11d3bb11900a tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: edcbe825-78fa-4a69-bd00-65e531a5c411] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:24:54.943837 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-17bf5227-7727-42b8-9a93-11d3bb11900a tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:24:54.944499 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-17bf5227-7727-42b8-9a93-11d3bb11900a tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:24:54.945085 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-17bf5227-7727-42b8-9a93-11d3bb11900a tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:24:54.945934 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-17bf5227-7727-42b8-9a93-11d3bb11900a tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:24:54.946556 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-17bf5227-7727-42b8-9a93-11d3bb11900a tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:24:54.947218 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-17bf5227-7727-42b8-9a93-11d3bb11900a tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:24:55.114263 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-17bf5227-7727-42b8-9a93-11d3bb11900a tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c85602851244d4a632b9c861eb4416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45cb377c6a9a43b3b91c99a64e37f1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:24:55.122904 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-17bf5227-7727-42b8-9a93-11d3bb11900a tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "GET /compute/v2.1/servers/edcbe825-78fa-4a69-bd00-65e531a5c411" status: 200 len: 1508 microversion: 2.1 time: 0.192499 Oct 22 21:24:55.131829 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2820/5661] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:24:54 2022] GET /compute/v2.1/servers/edcbe825-78fa-4a69-bd00-65e531a5c411 => generated 1508 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:24:56.146426 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-4c8a50a9-1fff-4b1d-a118-e0a65bd5b3e0 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:24:56.147772 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-4c8a50a9-1fff-4b1d-a118-e0a65bd5b3e0 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: edcbe825-78fa-4a69-bd00-65e531a5c411] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:24:56.155437 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4c8a50a9-1fff-4b1d-a118-e0a65bd5b3e0 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:24:56.156257 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4c8a50a9-1fff-4b1d-a118-e0a65bd5b3e0 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:24:56.157031 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4c8a50a9-1fff-4b1d-a118-e0a65bd5b3e0 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:24:56.157952 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4c8a50a9-1fff-4b1d-a118-e0a65bd5b3e0 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:24:56.158610 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4c8a50a9-1fff-4b1d-a118-e0a65bd5b3e0 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:24:56.159243 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4c8a50a9-1fff-4b1d-a118-e0a65bd5b3e0 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:24:56.379540 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-4c8a50a9-1fff-4b1d-a118-e0a65bd5b3e0 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c85602851244d4a632b9c861eb4416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45cb377c6a9a43b3b91c99a64e37f1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:24:56.388162 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-4c8a50a9-1fff-4b1d-a118-e0a65bd5b3e0 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "GET /compute/v2.1/servers/edcbe825-78fa-4a69-bd00-65e531a5c411" status: 200 len: 1505 microversion: 2.1 time: 0.245792 Oct 22 21:24:56.388752 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2842/5662] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:24:56 2022] GET /compute/v2.1/servers/edcbe825-78fa-4a69-bd00-65e531a5c411 => generated 1505 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:24:57.412436 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-e397104b-b50e-461b-92e5-f3cf033be8d0 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:24:57.413109 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-e397104b-b50e-461b-92e5-f3cf033be8d0 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: edcbe825-78fa-4a69-bd00-65e531a5c411] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:24:57.420818 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e397104b-b50e-461b-92e5-f3cf033be8d0 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:24:57.421316 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e397104b-b50e-461b-92e5-f3cf033be8d0 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:24:57.421764 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e397104b-b50e-461b-92e5-f3cf033be8d0 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:24:57.422472 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e397104b-b50e-461b-92e5-f3cf033be8d0 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:24:57.422954 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e397104b-b50e-461b-92e5-f3cf033be8d0 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:24:57.423434 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e397104b-b50e-461b-92e5-f3cf033be8d0 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:24:57.568100 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-e397104b-b50e-461b-92e5-f3cf033be8d0 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c85602851244d4a632b9c861eb4416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45cb377c6a9a43b3b91c99a64e37f1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:24:57.576556 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-e397104b-b50e-461b-92e5-f3cf033be8d0 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "GET /compute/v2.1/servers/edcbe825-78fa-4a69-bd00-65e531a5c411" status: 200 len: 1505 microversion: 2.1 time: 0.168588 Oct 22 21:24:57.577136 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2821/5663] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:24:57 2022] GET /compute/v2.1/servers/edcbe825-78fa-4a69-bd00-65e531a5c411 => generated 1505 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:24:58.600887 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-1abdbbb4-5054-4481-be77-096eca5a63c1 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:24:58.601540 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-1abdbbb4-5054-4481-be77-096eca5a63c1 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: edcbe825-78fa-4a69-bd00-65e531a5c411] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:24:58.609800 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1abdbbb4-5054-4481-be77-096eca5a63c1 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:24:58.610311 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1abdbbb4-5054-4481-be77-096eca5a63c1 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:24:58.610761 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1abdbbb4-5054-4481-be77-096eca5a63c1 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:24:58.611517 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1abdbbb4-5054-4481-be77-096eca5a63c1 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:24:58.611986 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1abdbbb4-5054-4481-be77-096eca5a63c1 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:24:58.612425 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1abdbbb4-5054-4481-be77-096eca5a63c1 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:24:58.749293 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-1abdbbb4-5054-4481-be77-096eca5a63c1 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c85602851244d4a632b9c861eb4416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45cb377c6a9a43b3b91c99a64e37f1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:24:58.761380 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-1abdbbb4-5054-4481-be77-096eca5a63c1 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "GET /compute/v2.1/servers/edcbe825-78fa-4a69-bd00-65e531a5c411" status: 200 len: 1448 microversion: 2.1 time: 0.165091 Oct 22 21:24:58.762105 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2843/5664] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:24:58 2022] GET /compute/v2.1/servers/edcbe825-78fa-4a69-bd00-65e531a5c411 => generated 1448 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:24:58.784296 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-97459720-62e1-4a32-9170-379d60e5e00d tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:24:58.784965 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-97459720-62e1-4a32-9170-379d60e5e00d tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: 20d90b58-3fad-4a44-b6bf-4ef0cc587def] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:24:58.792596 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-97459720-62e1-4a32-9170-379d60e5e00d tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:24:58.793088 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-97459720-62e1-4a32-9170-379d60e5e00d tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:24:58.793530 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-97459720-62e1-4a32-9170-379d60e5e00d tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:24:58.794234 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-97459720-62e1-4a32-9170-379d60e5e00d tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:24:58.794696 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-97459720-62e1-4a32-9170-379d60e5e00d tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:24:58.795130 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-97459720-62e1-4a32-9170-379d60e5e00d tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:24:58.939374 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-97459720-62e1-4a32-9170-379d60e5e00d tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c85602851244d4a632b9c861eb4416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45cb377c6a9a43b3b91c99a64e37f1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:24:58.948370 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-97459720-62e1-4a32-9170-379d60e5e00d tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def" status: 200 len: 1669 microversion: 2.1 time: 0.167900 Oct 22 21:24:58.948976 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2822/5665] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:24:58 2022] GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def => generated 1669 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:24:58.975283 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-be5134d0-46ba-4ea5-b885-f5433742e61f tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:24:58.975834 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-be5134d0-46ba-4ea5-b885-f5433742e61f tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: 20d90b58-3fad-4a44-b6bf-4ef0cc587def] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:24:58.982167 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-be5134d0-46ba-4ea5-b885-f5433742e61f tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:24:58.982708 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-be5134d0-46ba-4ea5-b885-f5433742e61f tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:24:58.983165 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-be5134d0-46ba-4ea5-b885-f5433742e61f tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:24:58.983922 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-be5134d0-46ba-4ea5-b885-f5433742e61f tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:24:58.984393 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-be5134d0-46ba-4ea5-b885-f5433742e61f tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:24:58.984843 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-be5134d0-46ba-4ea5-b885-f5433742e61f tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:24:59.134509 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-be5134d0-46ba-4ea5-b885-f5433742e61f tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c85602851244d4a632b9c861eb4416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45cb377c6a9a43b3b91c99a64e37f1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:24:59.145516 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-be5134d0-46ba-4ea5-b885-f5433742e61f tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def" status: 200 len: 1669 microversion: 2.1 time: 0.174675 Oct 22 21:24:59.146571 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2844/5666] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:24:58 2022] GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def => generated 1669 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:24:59.169125 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-6b63c3d8-3d08-43c9-b1d2-86b2a4e0b143 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:24:59.169748 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-6b63c3d8-3d08-43c9-b1d2-86b2a4e0b143 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: 20d90b58-3fad-4a44-b6bf-4ef0cc587def] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:24:59.176255 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6b63c3d8-3d08-43c9-b1d2-86b2a4e0b143 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:24:59.176686 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6b63c3d8-3d08-43c9-b1d2-86b2a4e0b143 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:24:59.177137 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6b63c3d8-3d08-43c9-b1d2-86b2a4e0b143 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:24:59.177851 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6b63c3d8-3d08-43c9-b1d2-86b2a4e0b143 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:24:59.178517 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6b63c3d8-3d08-43c9-b1d2-86b2a4e0b143 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:24:59.178953 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6b63c3d8-3d08-43c9-b1d2-86b2a4e0b143 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:24:59.198356 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-2dc40fc2-1548-4651-ac31-a0b05b18ddf1 req-ccc1b663-ba17-4b93-862c-4fd90ac0f192 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "edcbe825-78fa-4a69-bd00-65e531a5c411", "name": "network-vif-unplugged", "status": "completed", "tag": "063f1f1f-3195-453e-b747-a0d74f337166"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:24:59.210906 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-2dc40fc2-1548-4651-ac31-a0b05b18ddf1 req-ccc1b663-ba17-4b93-862c-4fd90ac0f192 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:24:59.211896 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-2dc40fc2-1548-4651-ac31-a0b05b18ddf1 req-ccc1b663-ba17-4b93-862c-4fd90ac0f192 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:24:59.212582 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-2dc40fc2-1548-4651-ac31-a0b05b18ddf1 req-ccc1b663-ba17-4b93-862c-4fd90ac0f192 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:24:59.230930 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.compute.server_external_events [req-2dc40fc2-1548-4651-ac31-a0b05b18ddf1 req-ccc1b663-ba17-4b93-862c-4fd90ac0f192 service nova] Unable to find a host for instance edcbe825-78fa-4a69-bd00-65e531a5c411. Dropping event network-vif-unplugged {{(pid=138745) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 22 21:24:59.232301 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-2dc40fc2-1548-4651-ac31-a0b05b18ddf1 req-ccc1b663-ba17-4b93-862c-4fd90ac0f192 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.040831 Oct 22 21:24:59.233427 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2845/5667] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:24:59 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 42 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 22 21:24:59.328482 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-6b63c3d8-3d08-43c9-b1d2-86b2a4e0b143 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c85602851244d4a632b9c861eb4416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45cb377c6a9a43b3b91c99a64e37f1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:24:59.336568 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-6b63c3d8-3d08-43c9-b1d2-86b2a4e0b143 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def" status: 200 len: 1669 microversion: 2.1 time: 0.171542 Oct 22 21:24:59.337146 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2823/5668] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:24:59 2022] GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def => generated 1669 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:24:59.359538 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-1ee47c75-7695-44a8-be8a-5bb7a7ecc44e tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:24:59.360177 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-1ee47c75-7695-44a8-be8a-5bb7a7ecc44e tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: 20d90b58-3fad-4a44-b6bf-4ef0cc587def] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:24:59.366703 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1ee47c75-7695-44a8-be8a-5bb7a7ecc44e tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:24:59.367210 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1ee47c75-7695-44a8-be8a-5bb7a7ecc44e tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:24:59.367698 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1ee47c75-7695-44a8-be8a-5bb7a7ecc44e tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:24:59.368418 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1ee47c75-7695-44a8-be8a-5bb7a7ecc44e tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:24:59.368892 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1ee47c75-7695-44a8-be8a-5bb7a7ecc44e tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:24:59.369372 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1ee47c75-7695-44a8-be8a-5bb7a7ecc44e tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:24:59.508530 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-1ee47c75-7695-44a8-be8a-5bb7a7ecc44e tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c85602851244d4a632b9c861eb4416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45cb377c6a9a43b3b91c99a64e37f1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:24:59.517226 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-1ee47c75-7695-44a8-be8a-5bb7a7ecc44e tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def" status: 200 len: 1669 microversion: 2.1 time: 0.161824 Oct 22 21:24:59.517800 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2846/5669] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:24:59 2022] GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def => generated 1669 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:24:59.542417 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-ded16f70-2226-4ee9-b19c-24e33d9d61a3 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:24:59.548906 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ded16f70-2226-4ee9-b19c-24e33d9d61a3 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:24:59.549382 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ded16f70-2226-4ee9-b19c-24e33d9d61a3 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:24:59.549827 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ded16f70-2226-4ee9-b19c-24e33d9d61a3 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:24:59.573097 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-ded16f70-2226-4ee9-b19c-24e33d9d61a3 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: 20d90b58-3fad-4a44-b6bf-4ef0cc587def] Going to try to stop instance {{(pid=138744) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 22 21:24:59.618686 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-ded16f70-2226-4ee9-b19c-24e33d9d61a3 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "POST /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def/action" status: 202 len: 0 microversion: 2.1 time: 0.082063 Oct 22 21:24:59.619414 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2824/5670] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 21:24:59 2022] POST /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 21:24:59.628312 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-17f9cd83-f2b2-4749-88a3-38b63709751c tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:24:59.629560 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-17f9cd83-f2b2-4749-88a3-38b63709751c tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: 20d90b58-3fad-4a44-b6bf-4ef0cc587def] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:24:59.637386 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-17f9cd83-f2b2-4749-88a3-38b63709751c tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:24:59.638076 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-17f9cd83-f2b2-4749-88a3-38b63709751c tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:24:59.638571 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-17f9cd83-f2b2-4749-88a3-38b63709751c tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:24:59.639297 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-17f9cd83-f2b2-4749-88a3-38b63709751c tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:24:59.639788 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-17f9cd83-f2b2-4749-88a3-38b63709751c tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:24:59.640422 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-17f9cd83-f2b2-4749-88a3-38b63709751c tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:24:59.778710 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-17f9cd83-f2b2-4749-88a3-38b63709751c tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c85602851244d4a632b9c861eb4416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45cb377c6a9a43b3b91c99a64e37f1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:24:59.787074 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-17f9cd83-f2b2-4749-88a3-38b63709751c tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def" status: 200 len: 1679 microversion: 2.1 time: 0.162969 Oct 22 21:24:59.787695 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2847/5671] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:24:59 2022] GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def => generated 1679 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:25:00.816580 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-76f2260f-9b35-4218-baf0-083800811a10 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:25:00.817566 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-76f2260f-9b35-4218-baf0-083800811a10 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: 20d90b58-3fad-4a44-b6bf-4ef0cc587def] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:25:00.827577 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-76f2260f-9b35-4218-baf0-083800811a10 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:25:00.828316 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-76f2260f-9b35-4218-baf0-083800811a10 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:25:00.828998 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-76f2260f-9b35-4218-baf0-083800811a10 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:25:00.830199 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-76f2260f-9b35-4218-baf0-083800811a10 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:25:00.830891 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-76f2260f-9b35-4218-baf0-083800811a10 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:25:00.831580 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-76f2260f-9b35-4218-baf0-083800811a10 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:25:00.975716 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-76f2260f-9b35-4218-baf0-083800811a10 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c85602851244d4a632b9c861eb4416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45cb377c6a9a43b3b91c99a64e37f1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:25:00.985773 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-76f2260f-9b35-4218-baf0-083800811a10 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def" status: 200 len: 1679 microversion: 2.1 time: 0.177303 Oct 22 21:25:00.986367 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2825/5672] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:25:00 2022] GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def => generated 1679 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:25:02.013710 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-102210f5-f597-4915-ba83-95c1c5bc4198 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:25:02.014339 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-102210f5-f597-4915-ba83-95c1c5bc4198 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: 20d90b58-3fad-4a44-b6bf-4ef0cc587def] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:25:02.021856 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-102210f5-f597-4915-ba83-95c1c5bc4198 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:25:02.022364 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-102210f5-f597-4915-ba83-95c1c5bc4198 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:25:02.022823 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-102210f5-f597-4915-ba83-95c1c5bc4198 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:25:02.023588 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-102210f5-f597-4915-ba83-95c1c5bc4198 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:25:02.024066 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-102210f5-f597-4915-ba83-95c1c5bc4198 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:25:02.024515 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-102210f5-f597-4915-ba83-95c1c5bc4198 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:25:02.162700 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-102210f5-f597-4915-ba83-95c1c5bc4198 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c85602851244d4a632b9c861eb4416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45cb377c6a9a43b3b91c99a64e37f1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:25:02.175047 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-102210f5-f597-4915-ba83-95c1c5bc4198 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def" status: 200 len: 1679 microversion: 2.1 time: 0.167595 Oct 22 21:25:02.176002 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2848/5673] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:25:02 2022] GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def => generated 1679 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:25:03.203125 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-f21eae24-4067-4a3a-88b6-e85d8b5b9a4e tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:25:03.204243 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-f21eae24-4067-4a3a-88b6-e85d8b5b9a4e tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: 20d90b58-3fad-4a44-b6bf-4ef0cc587def] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:25:03.211650 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f21eae24-4067-4a3a-88b6-e85d8b5b9a4e tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:25:03.212149 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f21eae24-4067-4a3a-88b6-e85d8b5b9a4e tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:25:03.212619 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f21eae24-4067-4a3a-88b6-e85d8b5b9a4e tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:25:03.213425 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f21eae24-4067-4a3a-88b6-e85d8b5b9a4e tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:25:03.213885 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f21eae24-4067-4a3a-88b6-e85d8b5b9a4e tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:25:03.214405 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f21eae24-4067-4a3a-88b6-e85d8b5b9a4e tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:25:03.350032 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-f21eae24-4067-4a3a-88b6-e85d8b5b9a4e tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c85602851244d4a632b9c861eb4416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45cb377c6a9a43b3b91c99a64e37f1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:25:03.352433 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:25:03.360236 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-f21eae24-4067-4a3a-88b6-e85d8b5b9a4e tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def" status: 200 len: 1679 microversion: 2.1 time: 0.162739 Oct 22 21:25:03.360829 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2826/5674] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:25:03 2022] GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def => generated 1679 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:25:04.383929 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-e2267ad8-9ef0-440b-9060-fdc9a12c4aa8 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:25:04.385195 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-e2267ad8-9ef0-440b-9060-fdc9a12c4aa8 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: 20d90b58-3fad-4a44-b6bf-4ef0cc587def] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:25:04.392398 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e2267ad8-9ef0-440b-9060-fdc9a12c4aa8 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:25:04.392887 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e2267ad8-9ef0-440b-9060-fdc9a12c4aa8 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:25:04.393532 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e2267ad8-9ef0-440b-9060-fdc9a12c4aa8 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:25:04.394266 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e2267ad8-9ef0-440b-9060-fdc9a12c4aa8 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:25:04.394739 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e2267ad8-9ef0-440b-9060-fdc9a12c4aa8 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:25:04.395168 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e2267ad8-9ef0-440b-9060-fdc9a12c4aa8 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:25:04.539864 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-e2267ad8-9ef0-440b-9060-fdc9a12c4aa8 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c85602851244d4a632b9c861eb4416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45cb377c6a9a43b3b91c99a64e37f1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:25:04.543681 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:25:04.549397 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-e2267ad8-9ef0-440b-9060-fdc9a12c4aa8 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def" status: 200 len: 1679 microversion: 2.1 time: 0.169663 Oct 22 21:25:04.550013 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2849/5675] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:25:04 2022] GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def => generated 1679 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:25:05.573788 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-4b297099-850f-4044-b9e1-180ccb1593a5 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:25:05.574259 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-4b297099-850f-4044-b9e1-180ccb1593a5 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: 20d90b58-3fad-4a44-b6bf-4ef0cc587def] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:25:05.582763 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4b297099-850f-4044-b9e1-180ccb1593a5 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:25:05.583253 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4b297099-850f-4044-b9e1-180ccb1593a5 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:25:05.583909 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4b297099-850f-4044-b9e1-180ccb1593a5 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:25:05.585645 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4b297099-850f-4044-b9e1-180ccb1593a5 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:25:05.586118 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4b297099-850f-4044-b9e1-180ccb1593a5 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:25:05.586550 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4b297099-850f-4044-b9e1-180ccb1593a5 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:25:05.726348 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-4b297099-850f-4044-b9e1-180ccb1593a5 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c85602851244d4a632b9c861eb4416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45cb377c6a9a43b3b91c99a64e37f1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:25:05.734358 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-4b297099-850f-4044-b9e1-180ccb1593a5 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def" status: 200 len: 1679 microversion: 2.1 time: 0.164939 Oct 22 21:25:05.734930 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2827/5676] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:25:05 2022] GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def => generated 1679 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:25:06.759623 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-048f42b6-c03b-4e70-9087-56794b9bb6cb tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:25:06.760255 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-048f42b6-c03b-4e70-9087-56794b9bb6cb tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: 20d90b58-3fad-4a44-b6bf-4ef0cc587def] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:25:06.768266 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-048f42b6-c03b-4e70-9087-56794b9bb6cb tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:25:06.768806 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-048f42b6-c03b-4e70-9087-56794b9bb6cb tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:25:06.769263 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-048f42b6-c03b-4e70-9087-56794b9bb6cb tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:25:06.769977 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-048f42b6-c03b-4e70-9087-56794b9bb6cb tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:25:06.770450 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-048f42b6-c03b-4e70-9087-56794b9bb6cb tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:25:06.770892 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-048f42b6-c03b-4e70-9087-56794b9bb6cb tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:25:06.908293 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-048f42b6-c03b-4e70-9087-56794b9bb6cb tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c85602851244d4a632b9c861eb4416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45cb377c6a9a43b3b91c99a64e37f1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:25:06.916696 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-048f42b6-c03b-4e70-9087-56794b9bb6cb tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def" status: 200 len: 1679 microversion: 2.1 time: 0.162603 Oct 22 21:25:06.917295 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2850/5677] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:25:06 2022] GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def => generated 1679 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:25:07.940725 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-520296d3-357a-4b09-a7a8-04efdddf711f tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:25:07.941634 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-520296d3-357a-4b09-a7a8-04efdddf711f tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: 20d90b58-3fad-4a44-b6bf-4ef0cc587def] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:25:07.948749 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-520296d3-357a-4b09-a7a8-04efdddf711f tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:25:07.949278 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-520296d3-357a-4b09-a7a8-04efdddf711f tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:25:07.949631 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-520296d3-357a-4b09-a7a8-04efdddf711f tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:25:07.950328 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-520296d3-357a-4b09-a7a8-04efdddf711f tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:25:07.950847 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-520296d3-357a-4b09-a7a8-04efdddf711f tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:25:07.951269 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-520296d3-357a-4b09-a7a8-04efdddf711f tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:25:08.085572 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-520296d3-357a-4b09-a7a8-04efdddf711f tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c85602851244d4a632b9c861eb4416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45cb377c6a9a43b3b91c99a64e37f1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:25:08.093776 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-520296d3-357a-4b09-a7a8-04efdddf711f tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def" status: 200 len: 1679 microversion: 2.1 time: 0.157031 Oct 22 21:25:08.094371 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2828/5678] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:25:07 2022] GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def => generated 1679 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:25:09.119426 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-495c9459-d494-4657-8538-91314b6bb795 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:25:09.120062 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-495c9459-d494-4657-8538-91314b6bb795 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: 20d90b58-3fad-4a44-b6bf-4ef0cc587def] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:25:09.127613 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-495c9459-d494-4657-8538-91314b6bb795 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:25:09.128124 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-495c9459-d494-4657-8538-91314b6bb795 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:25:09.128603 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-495c9459-d494-4657-8538-91314b6bb795 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:25:09.129327 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-495c9459-d494-4657-8538-91314b6bb795 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:25:09.129831 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-495c9459-d494-4657-8538-91314b6bb795 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:25:09.130276 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-495c9459-d494-4657-8538-91314b6bb795 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:25:09.275654 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-495c9459-d494-4657-8538-91314b6bb795 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c85602851244d4a632b9c861eb4416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45cb377c6a9a43b3b91c99a64e37f1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:25:09.283907 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-495c9459-d494-4657-8538-91314b6bb795 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def" status: 200 len: 1679 microversion: 2.1 time: 0.168605 Oct 22 21:25:09.284490 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2851/5679] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:25:09 2022] GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def => generated 1679 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:25:10.311543 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-38fde79c-925a-480f-a4ed-364617a0b8bd tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:25:10.312157 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-38fde79c-925a-480f-a4ed-364617a0b8bd tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: 20d90b58-3fad-4a44-b6bf-4ef0cc587def] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:25:10.315238 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_api:SELECT=32 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:25:10.320803 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-38fde79c-925a-480f-a4ed-364617a0b8bd tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:25:10.321300 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-38fde79c-925a-480f-a4ed-364617a0b8bd tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:25:10.321748 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-38fde79c-925a-480f-a4ed-364617a0b8bd tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:25:10.322458 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-38fde79c-925a-480f-a4ed-364617a0b8bd tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:25:10.322946 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-38fde79c-925a-480f-a4ed-364617a0b8bd tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:25:10.323383 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-38fde79c-925a-480f-a4ed-364617a0b8bd tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:25:10.459495 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-38fde79c-925a-480f-a4ed-364617a0b8bd tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c85602851244d4a632b9c861eb4416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45cb377c6a9a43b3b91c99a64e37f1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:25:10.467831 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-38fde79c-925a-480f-a4ed-364617a0b8bd tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def" status: 200 len: 1656 microversion: 2.1 time: 0.160371 Oct 22 21:25:10.468476 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2829/5680] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:25:10 2022] GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def => generated 1656 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:25:10.491689 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-487b9611-a093-4c78-9c2a-c0d6e1c3d732 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:25:10.494739 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_api:SELECT=36 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:25:10.500749 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-487b9611-a093-4c78-9c2a-c0d6e1c3d732 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:25:10.501253 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-487b9611-a093-4c78-9c2a-c0d6e1c3d732 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:25:10.501709 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-487b9611-a093-4c78-9c2a-c0d6e1c3d732 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:25:10.524802 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-487b9611-a093-4c78-9c2a-c0d6e1c3d732 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: 20d90b58-3fad-4a44-b6bf-4ef0cc587def] Going to try to start instance {{(pid=138745) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 22 21:25:10.572635 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-487b9611-a093-4c78-9c2a-c0d6e1c3d732 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "POST /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def/action" status: 202 len: 0 microversion: 2.1 time: 0.084907 Oct 22 21:25:10.573317 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2852/5681] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 21:25:10 2022] POST /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 21:25:10.582003 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-4a95f87c-fdda-466e-8f2a-e8dfdde6f134 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:25:10.582652 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-4a95f87c-fdda-466e-8f2a-e8dfdde6f134 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: 20d90b58-3fad-4a44-b6bf-4ef0cc587def] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:25:10.590693 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4a95f87c-fdda-466e-8f2a-e8dfdde6f134 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:25:10.591304 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4a95f87c-fdda-466e-8f2a-e8dfdde6f134 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:25:10.591982 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4a95f87c-fdda-466e-8f2a-e8dfdde6f134 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:25:10.592800 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4a95f87c-fdda-466e-8f2a-e8dfdde6f134 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:25:10.593417 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4a95f87c-fdda-466e-8f2a-e8dfdde6f134 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:25:10.593864 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4a95f87c-fdda-466e-8f2a-e8dfdde6f134 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:25:10.813006 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-4a95f87c-fdda-466e-8f2a-e8dfdde6f134 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c85602851244d4a632b9c861eb4416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45cb377c6a9a43b3b91c99a64e37f1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:25:10.821372 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-4a95f87c-fdda-466e-8f2a-e8dfdde6f134 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def" status: 200 len: 1665 microversion: 2.1 time: 0.243325 Oct 22 21:25:10.822058 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2830/5682] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:25:10 2022] GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def => generated 1665 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:25:11.849964 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-89d7d8fe-f51b-46ad-b29d-c0c305a9d7ce tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:25:11.851428 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-89d7d8fe-f51b-46ad-b29d-c0c305a9d7ce tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: 20d90b58-3fad-4a44-b6bf-4ef0cc587def] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:25:11.860981 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-89d7d8fe-f51b-46ad-b29d-c0c305a9d7ce tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:25:11.861927 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-89d7d8fe-f51b-46ad-b29d-c0c305a9d7ce tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:25:11.862100 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-89d7d8fe-f51b-46ad-b29d-c0c305a9d7ce tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:25:11.862989 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-89d7d8fe-f51b-46ad-b29d-c0c305a9d7ce tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:25:11.863617 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-89d7d8fe-f51b-46ad-b29d-c0c305a9d7ce tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:25:11.864060 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-89d7d8fe-f51b-46ad-b29d-c0c305a9d7ce tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:25:12.346553 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-89d7d8fe-f51b-46ad-b29d-c0c305a9d7ce tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c85602851244d4a632b9c861eb4416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45cb377c6a9a43b3b91c99a64e37f1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:25:12.356507 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-89d7d8fe-f51b-46ad-b29d-c0c305a9d7ce tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def" status: 200 len: 1669 microversion: 2.1 time: 0.513454 Oct 22 21:25:12.357172 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2853/5683] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:25:11 2022] GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def => generated 1669 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:25:12.379417 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-5d7ea313-0a75-4f13-8693-8036e738a35b tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:25:12.380013 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-5d7ea313-0a75-4f13-8693-8036e738a35b tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: 20d90b58-3fad-4a44-b6bf-4ef0cc587def] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:25:12.389270 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5d7ea313-0a75-4f13-8693-8036e738a35b tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:25:12.389808 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5d7ea313-0a75-4f13-8693-8036e738a35b tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:25:12.390272 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5d7ea313-0a75-4f13-8693-8036e738a35b tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:25:12.391124 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5d7ea313-0a75-4f13-8693-8036e738a35b tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:25:12.391606 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5d7ea313-0a75-4f13-8693-8036e738a35b tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:25:12.392844 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5d7ea313-0a75-4f13-8693-8036e738a35b tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:25:12.527187 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-5d7ea313-0a75-4f13-8693-8036e738a35b tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c85602851244d4a632b9c861eb4416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45cb377c6a9a43b3b91c99a64e37f1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:25:12.537430 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-5d7ea313-0a75-4f13-8693-8036e738a35b tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def" status: 200 len: 1669 microversion: 2.1 time: 0.161908 Oct 22 21:25:12.539386 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2831/5684] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:25:12 2022] GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def => generated 1669 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:25:12.562046 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-7aae2084-42e0-4167-be0b-647267ffaff9 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:25:12.562680 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-7aae2084-42e0-4167-be0b-647267ffaff9 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: 20d90b58-3fad-4a44-b6bf-4ef0cc587def] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:25:12.568937 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7aae2084-42e0-4167-be0b-647267ffaff9 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:25:12.569445 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7aae2084-42e0-4167-be0b-647267ffaff9 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:25:12.569899 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7aae2084-42e0-4167-be0b-647267ffaff9 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:25:12.570619 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7aae2084-42e0-4167-be0b-647267ffaff9 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:25:12.571085 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7aae2084-42e0-4167-be0b-647267ffaff9 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:25:12.571560 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7aae2084-42e0-4167-be0b-647267ffaff9 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:25:12.733524 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-7aae2084-42e0-4167-be0b-647267ffaff9 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c85602851244d4a632b9c861eb4416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45cb377c6a9a43b3b91c99a64e37f1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:25:12.742017 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-7aae2084-42e0-4167-be0b-647267ffaff9 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def" status: 200 len: 1669 microversion: 2.1 time: 0.184046 Oct 22 21:25:12.742597 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2854/5685] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:25:12 2022] GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def => generated 1669 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:25:12.765870 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-c38fcae0-a76c-4679-af72-354c3ebe5881 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:25:12.766495 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-c38fcae0-a76c-4679-af72-354c3ebe5881 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: 20d90b58-3fad-4a44-b6bf-4ef0cc587def] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:25:12.773994 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c38fcae0-a76c-4679-af72-354c3ebe5881 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:25:12.774503 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c38fcae0-a76c-4679-af72-354c3ebe5881 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:25:12.774924 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c38fcae0-a76c-4679-af72-354c3ebe5881 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:25:12.775811 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c38fcae0-a76c-4679-af72-354c3ebe5881 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:25:12.776531 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c38fcae0-a76c-4679-af72-354c3ebe5881 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:25:12.777029 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c38fcae0-a76c-4679-af72-354c3ebe5881 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:25:12.924810 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-c38fcae0-a76c-4679-af72-354c3ebe5881 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c85602851244d4a632b9c861eb4416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45cb377c6a9a43b3b91c99a64e37f1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:25:12.932735 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-c38fcae0-a76c-4679-af72-354c3ebe5881 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def" status: 200 len: 1669 microversion: 2.1 time: 0.171118 Oct 22 21:25:12.933287 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2832/5686] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:25:12 2022] GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def => generated 1669 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:25:12.955823 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-d1ecf62c-0b73-4e95-828f-43357a5d1f0c tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:25:12.956461 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-d1ecf62c-0b73-4e95-828f-43357a5d1f0c tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: 20d90b58-3fad-4a44-b6bf-4ef0cc587def] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:25:12.963592 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d1ecf62c-0b73-4e95-828f-43357a5d1f0c tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:25:12.964353 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d1ecf62c-0b73-4e95-828f-43357a5d1f0c tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:25:12.964806 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d1ecf62c-0b73-4e95-828f-43357a5d1f0c tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:25:12.965524 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d1ecf62c-0b73-4e95-828f-43357a5d1f0c tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:25:12.966527 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d1ecf62c-0b73-4e95-828f-43357a5d1f0c tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:25:12.967002 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d1ecf62c-0b73-4e95-828f-43357a5d1f0c tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:25:13.100591 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-d1ecf62c-0b73-4e95-828f-43357a5d1f0c tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c85602851244d4a632b9c861eb4416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45cb377c6a9a43b3b91c99a64e37f1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:25:13.108910 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-d1ecf62c-0b73-4e95-828f-43357a5d1f0c tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def" status: 200 len: 1669 microversion: 2.1 time: 0.157219 Oct 22 21:25:13.109501 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2855/5687] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:25:12 2022] GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def => generated 1669 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:25:13.131512 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-913c0bc4-d79a-4089-aa03-1dba5e2048e8 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:25:13.132072 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-913c0bc4-d79a-4089-aa03-1dba5e2048e8 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: 20d90b58-3fad-4a44-b6bf-4ef0cc587def] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:25:13.138462 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-913c0bc4-d79a-4089-aa03-1dba5e2048e8 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:25:13.139008 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-913c0bc4-d79a-4089-aa03-1dba5e2048e8 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:25:13.139701 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-913c0bc4-d79a-4089-aa03-1dba5e2048e8 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:25:13.140495 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-913c0bc4-d79a-4089-aa03-1dba5e2048e8 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:25:13.140930 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-913c0bc4-d79a-4089-aa03-1dba5e2048e8 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:25:13.141461 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-913c0bc4-d79a-4089-aa03-1dba5e2048e8 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:25:13.165971 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.objects.instance [None req-913c0bc4-d79a-4089-aa03-1dba5e2048e8 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lazy-loading 'flavor' on Instance uuid 20d90b58-3fad-4a44-b6bf-4ef0cc587def {{(pid=138744) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 21:25:13.244489 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-913c0bc4-d79a-4089-aa03-1dba5e2048e8 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "POST /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def/action" status: 202 len: 0 microversion: 2.1 time: 0.116469 Oct 22 21:25:13.245312 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2833/5688] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 21:25:13 2022] POST /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def/action => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 22 21:25:13.253742 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-4569286d-4a54-4df8-8539-bc727a9f64ab tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:25:13.262099 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-4569286d-4a54-4df8-8539-bc727a9f64ab tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: 20d90b58-3fad-4a44-b6bf-4ef0cc587def] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:25:13.269126 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4569286d-4a54-4df8-8539-bc727a9f64ab tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:25:13.269649 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4569286d-4a54-4df8-8539-bc727a9f64ab tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:25:13.270179 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4569286d-4a54-4df8-8539-bc727a9f64ab tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:25:13.270886 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4569286d-4a54-4df8-8539-bc727a9f64ab tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:25:13.271330 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4569286d-4a54-4df8-8539-bc727a9f64ab tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:25:13.271989 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4569286d-4a54-4df8-8539-bc727a9f64ab tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:25:13.414303 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-4569286d-4a54-4df8-8539-bc727a9f64ab tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c85602851244d4a632b9c861eb4416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45cb377c6a9a43b3b91c99a64e37f1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:25:13.422480 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-4569286d-4a54-4df8-8539-bc727a9f64ab tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def" status: 200 len: 1677 microversion: 2.1 time: 0.172978 Oct 22 21:25:13.422994 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2856/5689] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:25:13 2022] GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def => generated 1677 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:25:14.447874 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-0c4a8638-888a-4849-b124-8698ef729423 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:25:14.448594 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-0c4a8638-888a-4849-b124-8698ef729423 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: 20d90b58-3fad-4a44-b6bf-4ef0cc587def] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:25:14.455661 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0c4a8638-888a-4849-b124-8698ef729423 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:25:14.456201 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0c4a8638-888a-4849-b124-8698ef729423 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:25:14.456646 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0c4a8638-888a-4849-b124-8698ef729423 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:25:14.457360 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0c4a8638-888a-4849-b124-8698ef729423 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:25:14.457805 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0c4a8638-888a-4849-b124-8698ef729423 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:25:14.458242 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0c4a8638-888a-4849-b124-8698ef729423 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:25:14.599860 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-0c4a8638-888a-4849-b124-8698ef729423 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c85602851244d4a632b9c861eb4416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45cb377c6a9a43b3b91c99a64e37f1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:25:14.607738 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-0c4a8638-888a-4849-b124-8698ef729423 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def" status: 200 len: 1660 microversion: 2.1 time: 0.165184 Oct 22 21:25:14.608313 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2834/5690] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:25:14 2022] GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def => generated 1660 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:25:14.631297 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-e49f308b-99c7-40cb-9b80-e2186e4e36d1 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:25:14.632173 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-e49f308b-99c7-40cb-9b80-e2186e4e36d1 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: 20d90b58-3fad-4a44-b6bf-4ef0cc587def] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:25:14.640738 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e49f308b-99c7-40cb-9b80-e2186e4e36d1 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:25:14.641446 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e49f308b-99c7-40cb-9b80-e2186e4e36d1 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:25:14.642060 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e49f308b-99c7-40cb-9b80-e2186e4e36d1 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:25:14.642810 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e49f308b-99c7-40cb-9b80-e2186e4e36d1 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:25:14.643490 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e49f308b-99c7-40cb-9b80-e2186e4e36d1 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:25:14.644039 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e49f308b-99c7-40cb-9b80-e2186e4e36d1 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:25:14.720708 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-e49f308b-99c7-40cb-9b80-e2186e4e36d1 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "POST /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def/action" status: 202 len: 0 microversion: 2.1 time: 0.093307 Oct 22 21:25:14.721340 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2857/5691] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 21:25:14 2022] POST /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def/action => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 21:25:14.730748 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-7972bd73-ed43-4d15-840f-f624c9aefc84 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:25:14.732649 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-7972bd73-ed43-4d15-840f-f624c9aefc84 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: 20d90b58-3fad-4a44-b6bf-4ef0cc587def] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:25:14.740088 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7972bd73-ed43-4d15-840f-f624c9aefc84 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:25:14.740581 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7972bd73-ed43-4d15-840f-f624c9aefc84 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:25:14.741205 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7972bd73-ed43-4d15-840f-f624c9aefc84 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:25:14.742215 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7972bd73-ed43-4d15-840f-f624c9aefc84 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:25:14.742762 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7972bd73-ed43-4d15-840f-f624c9aefc84 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:25:14.743331 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7972bd73-ed43-4d15-840f-f624c9aefc84 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:25:14.988988 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-7972bd73-ed43-4d15-840f-f624c9aefc84 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c85602851244d4a632b9c861eb4416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45cb377c6a9a43b3b91c99a64e37f1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:25:14.999460 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-7972bd73-ed43-4d15-840f-f624c9aefc84 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def" status: 200 len: 1666 microversion: 2.1 time: 0.272661 Oct 22 21:25:15.000454 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2835/5692] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:25:14 2022] GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def => generated 1666 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:25:16.026023 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-e0a7dd7a-363d-4a71-897c-db461fa76c4e tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:25:16.026787 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-e0a7dd7a-363d-4a71-897c-db461fa76c4e tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: 20d90b58-3fad-4a44-b6bf-4ef0cc587def] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:25:16.033620 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e0a7dd7a-363d-4a71-897c-db461fa76c4e tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:25:16.034129 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e0a7dd7a-363d-4a71-897c-db461fa76c4e tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:25:16.034593 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e0a7dd7a-363d-4a71-897c-db461fa76c4e tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:25:16.035370 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e0a7dd7a-363d-4a71-897c-db461fa76c4e tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:25:16.036028 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e0a7dd7a-363d-4a71-897c-db461fa76c4e tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:25:16.036293 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e0a7dd7a-363d-4a71-897c-db461fa76c4e tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:25:16.181185 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-e0a7dd7a-363d-4a71-897c-db461fa76c4e tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c85602851244d4a632b9c861eb4416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45cb377c6a9a43b3b91c99a64e37f1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:25:16.189255 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-e0a7dd7a-363d-4a71-897c-db461fa76c4e tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def" status: 200 len: 1666 microversion: 2.1 time: 0.168773 Oct 22 21:25:16.189856 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2858/5693] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:25:16 2022] GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def => generated 1666 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:25:17.213801 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-321e0a15-2606-4fd6-a941-c48cb9e69af9 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:25:17.214437 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-321e0a15-2606-4fd6-a941-c48cb9e69af9 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: 20d90b58-3fad-4a44-b6bf-4ef0cc587def] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:25:17.222209 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-321e0a15-2606-4fd6-a941-c48cb9e69af9 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:25:17.222705 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-321e0a15-2606-4fd6-a941-c48cb9e69af9 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:25:17.223150 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-321e0a15-2606-4fd6-a941-c48cb9e69af9 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:25:17.223890 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-321e0a15-2606-4fd6-a941-c48cb9e69af9 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:25:17.224351 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-321e0a15-2606-4fd6-a941-c48cb9e69af9 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:25:17.225263 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-321e0a15-2606-4fd6-a941-c48cb9e69af9 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:25:17.364597 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-321e0a15-2606-4fd6-a941-c48cb9e69af9 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c85602851244d4a632b9c861eb4416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45cb377c6a9a43b3b91c99a64e37f1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:25:17.373022 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-321e0a15-2606-4fd6-a941-c48cb9e69af9 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def" status: 200 len: 1669 microversion: 2.1 time: 0.163350 Oct 22 21:25:17.373605 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2836/5694] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:25:17 2022] GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def => generated 1669 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:25:17.396736 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-e981f29d-7612-41b6-a2bd-a0c26c34c4ca tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:25:17.397373 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-e981f29d-7612-41b6-a2bd-a0c26c34c4ca tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: 20d90b58-3fad-4a44-b6bf-4ef0cc587def] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:25:17.404771 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e981f29d-7612-41b6-a2bd-a0c26c34c4ca tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:25:17.405485 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e981f29d-7612-41b6-a2bd-a0c26c34c4ca tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:25:17.406257 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e981f29d-7612-41b6-a2bd-a0c26c34c4ca tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:25:17.407156 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e981f29d-7612-41b6-a2bd-a0c26c34c4ca tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:25:17.407662 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e981f29d-7612-41b6-a2bd-a0c26c34c4ca tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:25:17.408111 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e981f29d-7612-41b6-a2bd-a0c26c34c4ca tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:25:17.546446 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-e981f29d-7612-41b6-a2bd-a0c26c34c4ca tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c85602851244d4a632b9c861eb4416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45cb377c6a9a43b3b91c99a64e37f1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:25:17.555028 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-e981f29d-7612-41b6-a2bd-a0c26c34c4ca tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def" status: 200 len: 1669 microversion: 2.1 time: 0.162649 Oct 22 21:25:17.555650 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2859/5695] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:25:17 2022] GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def => generated 1669 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:25:17.578838 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-8a6949b0-da50-4aad-a85c-afc8d124aac3 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:25:17.579358 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-8a6949b0-da50-4aad-a85c-afc8d124aac3 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: edcbe825-78fa-4a69-bd00-65e531a5c411] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:25:17.585841 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8a6949b0-da50-4aad-a85c-afc8d124aac3 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:25:17.586334 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8a6949b0-da50-4aad-a85c-afc8d124aac3 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:25:17.586776 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8a6949b0-da50-4aad-a85c-afc8d124aac3 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:25:17.587508 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8a6949b0-da50-4aad-a85c-afc8d124aac3 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:25:17.587976 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8a6949b0-da50-4aad-a85c-afc8d124aac3 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:25:17.588411 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8a6949b0-da50-4aad-a85c-afc8d124aac3 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:25:17.614302 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-8a6949b0-da50-4aad-a85c-afc8d124aac3 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: edcbe825-78fa-4a69-bd00-65e531a5c411] Going to try to terminate instance {{(pid=138744) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 21:25:17.620611 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.compute.api [None req-8a6949b0-da50-4aad-a85c-afc8d124aac3 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: edcbe825-78fa-4a69-bd00-65e531a5c411] Working on deleting snapshot 38e0bab7-dde8-4246-8284-f69874215823 from shelved instance... Oct 22 21:25:18.225117 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-8a6949b0-da50-4aad-a85c-afc8d124aac3 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: edcbe825-78fa-4a69-bd00-65e531a5c411] Doing local delete in cell 5972cb63-1ab7-4825-b0ae-86c7acab764c(cell1) {{(pid=138744) _delete /opt/stack/nova/nova/compute/api.py:2546}} Oct 22 21:25:18.225953 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8a6949b0-da50-4aad-a85c-afc8d124aac3 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:25:18.226446 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8a6949b0-da50-4aad-a85c-afc8d124aac3 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:25:18.226894 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8a6949b0-da50-4aad-a85c-afc8d124aac3 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:25:18.227303 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.compute.api [None req-8a6949b0-da50-4aad-a85c-afc8d124aac3 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: edcbe825-78fa-4a69-bd00-65e531a5c411] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Oct 22 21:25:18.233879 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.network.neutron [None req-8a6949b0-da50-4aad-a85c-afc8d124aac3 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: edcbe825-78fa-4a69-bd00-65e531a5c411] deallocate_for_instance() {{(pid=138744) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1780}} Oct 22 21:25:18.729784 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.network.neutron [None req-8a6949b0-da50-4aad-a85c-afc8d124aac3 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: edcbe825-78fa-4a69-bd00-65e531a5c411] Updating instance_info_cache with network_info: [] {{(pid=138744) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 22 21:25:18.907593 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-d46b0e10-9014-4089-bd42-40db18e9161e req-fc3f949e-ffcc-4a43-a6ad-19dade691bfd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "edcbe825-78fa-4a69-bd00-65e531a5c411", "name": "network-vif-deleted", "tag": "063f1f1f-3195-453e-b747-a0d74f337166"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:25:18.918087 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-d46b0e10-9014-4089-bd42-40db18e9161e req-fc3f949e-ffcc-4a43-a6ad-19dade691bfd service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:25:18.918593 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-d46b0e10-9014-4089-bd42-40db18e9161e req-fc3f949e-ffcc-4a43-a6ad-19dade691bfd service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:25:18.919432 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-d46b0e10-9014-4089-bd42-40db18e9161e req-fc3f949e-ffcc-4a43-a6ad-19dade691bfd service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:25:18.933031 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.compute.server_external_events [req-d46b0e10-9014-4089-bd42-40db18e9161e req-fc3f949e-ffcc-4a43-a6ad-19dade691bfd service nova] Unable to find a host for instance edcbe825-78fa-4a69-bd00-65e531a5c411. Dropping event network-vif-deleted {{(pid=138745) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 22 21:25:18.934199 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-d46b0e10-9014-4089-bd42-40db18e9161e req-fc3f949e-ffcc-4a43-a6ad-19dade691bfd service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.211621 Oct 22 21:25:18.945526 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2860/5696] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:25:18 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 224 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 22 21:25:19.002345 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=7,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:25:19.061176 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-8a6949b0-da50-4aad-a85c-afc8d124aac3 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "DELETE /compute/v2.1/servers/edcbe825-78fa-4a69-bd00-65e531a5c411" status: 204 len: 0 microversion: 2.1 time: 1.486466 Oct 22 21:25:19.061691 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2837/5697] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 21:25:17 2022] DELETE /compute/v2.1/servers/edcbe825-78fa-4a69-bd00-65e531a5c411 => generated 0 bytes in 1488 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 21:25:19.070132 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-be129666-d02a-44d3-83fe-d47d1021523a tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:25:19.070769 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-be129666-d02a-44d3-83fe-d47d1021523a tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: edcbe825-78fa-4a69-bd00-65e531a5c411] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:25:19.077098 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-be129666-d02a-44d3-83fe-d47d1021523a tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:25:19.077653 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-be129666-d02a-44d3-83fe-d47d1021523a tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:25:19.078107 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-be129666-d02a-44d3-83fe-d47d1021523a tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:25:19.078828 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-be129666-d02a-44d3-83fe-d47d1021523a tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:25:19.079303 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-be129666-d02a-44d3-83fe-d47d1021523a tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:25:19.079813 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-be129666-d02a-44d3-83fe-d47d1021523a tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:25:19.094053 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.wsgi [None req-be129666-d02a-44d3-83fe-d47d1021523a tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] HTTP exception thrown: Instance edcbe825-78fa-4a69-bd00-65e531a5c411 could not be found. Oct 22 21:25:19.096043 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-be129666-d02a-44d3-83fe-d47d1021523a tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Request method failure captured: Oct 22 21:25:19.096043 ncdv-master-1 devstack@n-api.service[138745]: request: GET /compute/v2.1/servers/edcbe825-78fa-4a69-bd00-65e531a5c411 HTTP/1.1 Oct 22 21:25:19.096043 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 21:25:19.096043 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 21:25:19.096043 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 21:25:19.096043 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 0 Oct 22 21:25:19.096043 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 21:25:19.096043 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 21:25:19.096043 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 21:25:19.096043 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 21:25:19.096043 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVF3y1V_7LM2bhyK99NoBFe-giEKTnFpuE3vTdYnEguljVUwfbfRxJXkNvk85nVw_XeG4HF30bHcflxpdsNI0PNyKAune8z480A5-3qJ8_UazcBtA79by1AUQbwspb5BhIfKTMrxZg2NgkizpxDUW1lw64wnpVqXMU0a0fzQqvfH1TU4 Oct 22 21:25:19.096043 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 21:25:19.096043 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 21:25:19.096043 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 21:25:19.096043 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 21:25:19.096043 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 21:25:19.096043 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 21:25:19.096043 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: 45cb377c6a9a43b3b91c99a64e37f1eb Oct 22 21:25:19.096043 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-ServerActionsTestJSON-274049943 Oct 22 21:25:19.096043 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 21:25:19.096043 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 21:25:19.096043 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_45cb377c6a9a43b3b91c99a64e37f1eb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/45cb377c6a9a43b3b91c99a64e37f1eb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/45cb377c6a9a43b3b91c99a64e37f1eb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/45cb377c6a9a43b3b91c99a64e37f1eb"}]}] Oct 22 21:25:19.096043 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-ServerActionsTestJSON-274049943 Oct 22 21:25:19.096043 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: 45cb377c6a9a43b3b91c99a64e37f1eb Oct 22 21:25:19.096043 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-ServerActionsTestJSON-274049943 Oct 22 21:25:19.096043 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-ServerActionsTestJSON-274049943-project Oct 22 21:25:19.096043 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 21:25:19.096043 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 21:25:19.096043 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: c9c85602851244d4a632b9c861eb4416 Oct 22 21:25:19.096043 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-ServerActionsTestJSON-274049943-project Oct 22 21:25:19.096043 ncdv-master-1 devstack@n-api.service[138745]: method: > Oct 22 21:25:19.096043 ncdv-master-1 devstack@n-api.service[138745]: exception: Instance edcbe825-78fa-4a69-bd00-65e531a5c411 could not be found. Oct 22 21:25:19.096043 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'id': 'edcbe825-78fa-4a69-bd00-65e531a5c411'} Oct 22 21:25:19.096043 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:25:19.096043 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:25:19.096043 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 21:25:19.096043 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 21:25:19.096043 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 21:25:19.096043 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 21:25:19.096043 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 21:25:19.096043 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 21:25:19.096043 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 21:25:19.096043 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 21:25:19.096043 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance edcbe825-78fa-4a69-bd00-65e531a5c411 could not be found. Oct 22 21:25:19.096043 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:25:19.096043 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:25:19.096043 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:25:19.096043 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:25:19.096043 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:25:19.096043 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:25:19.096043 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:25:19.096043 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:25:19.096043 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:25:19.096043 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:25:19.096043 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 21:25:19.096043 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 21:25:19.096043 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 21:25:19.096043 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 21:25:19.096043 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 21:25:19.096043 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:25:19.096043 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance edcbe825-78fa-4a69-bd00-65e531a5c411 could not be found. Oct 22 21:25:19.096043 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:25:19.096043 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:25:19.096043 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:25:19.100784 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:25:19.100784 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:25:19.100784 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:25:19.100784 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:25:19.100784 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:25:19.100784 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance edcbe825-78fa-4a69-bd00-65e531a5c411 could not be found. Oct 22 21:25:19.100784 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:25:19.100784 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-be129666-d02a-44d3-83fe-d47d1021523a tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Returning 404 to user: Instance edcbe825-78fa-4a69-bd00-65e531a5c411 could not be found. {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:25:19.100784 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-be129666-d02a-44d3-83fe-d47d1021523a tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "GET /compute/v2.1/servers/edcbe825-78fa-4a69-bd00-65e531a5c411" status: 404 len: 111 microversion: 2.1 time: 0.031504 Oct 22 21:25:19.101715 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2861/5698] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:25:19 2022] GET /compute/v2.1/servers/edcbe825-78fa-4a69-bd00-65e531a5c411 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 21:25:19.107112 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-62e71a9a-d933-4063-99a4-561433c77e77 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:25:19.107644 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-62e71a9a-d933-4063-99a4-561433c77e77 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: 61b522d6-fcd9-4bd7-bc4e-0459f0fcc6db] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:25:19.113975 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-62e71a9a-d933-4063-99a4-561433c77e77 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:25:19.114458 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-62e71a9a-d933-4063-99a4-561433c77e77 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:25:19.114894 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-62e71a9a-d933-4063-99a4-561433c77e77 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:25:19.115628 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-62e71a9a-d933-4063-99a4-561433c77e77 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:25:19.116086 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-62e71a9a-d933-4063-99a4-561433c77e77 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:25:19.116512 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-62e71a9a-d933-4063-99a4-561433c77e77 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:25:19.142781 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-62e71a9a-d933-4063-99a4-561433c77e77 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: 61b522d6-fcd9-4bd7-bc4e-0459f0fcc6db] Going to try to terminate instance {{(pid=138744) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 21:25:19.226616 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-62e71a9a-d933-4063-99a4-561433c77e77 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "DELETE /compute/v2.1/servers/61b522d6-fcd9-4bd7-bc4e-0459f0fcc6db" status: 204 len: 0 microversion: 2.1 time: 0.122938 Oct 22 21:25:19.227685 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2838/5699] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 21:25:19 2022] DELETE /compute/v2.1/servers/61b522d6-fcd9-4bd7-bc4e-0459f0fcc6db => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 21:25:19.236270 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-ef181438-a8b7-4971-863f-b3650b337906 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:25:19.237236 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-ef181438-a8b7-4971-863f-b3650b337906 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: 61b522d6-fcd9-4bd7-bc4e-0459f0fcc6db] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:25:19.243994 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ef181438-a8b7-4971-863f-b3650b337906 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:25:19.244499 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ef181438-a8b7-4971-863f-b3650b337906 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:25:19.244945 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ef181438-a8b7-4971-863f-b3650b337906 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:25:19.245941 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ef181438-a8b7-4971-863f-b3650b337906 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:25:19.246423 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ef181438-a8b7-4971-863f-b3650b337906 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:25:19.246892 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ef181438-a8b7-4971-863f-b3650b337906 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:25:19.334956 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-ef181438-a8b7-4971-863f-b3650b337906 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c85602851244d4a632b9c861eb4416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45cb377c6a9a43b3b91c99a64e37f1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:25:19.344969 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-ef181438-a8b7-4971-863f-b3650b337906 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "GET /compute/v2.1/servers/61b522d6-fcd9-4bd7-bc4e-0459f0fcc6db" status: 200 len: 1464 microversion: 2.1 time: 0.113096 Oct 22 21:25:19.347462 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2862/5700] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:25:19 2022] GET /compute/v2.1/servers/61b522d6-fcd9-4bd7-bc4e-0459f0fcc6db => generated 1464 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:25:20.374261 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-98e66312-fc3e-4538-a928-7febe3e57bb2 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:25:20.375234 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-98e66312-fc3e-4538-a928-7febe3e57bb2 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: 61b522d6-fcd9-4bd7-bc4e-0459f0fcc6db] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:25:20.383903 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-98e66312-fc3e-4538-a928-7febe3e57bb2 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:25:20.384454 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-98e66312-fc3e-4538-a928-7febe3e57bb2 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:25:20.384886 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-98e66312-fc3e-4538-a928-7febe3e57bb2 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:25:20.385598 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-98e66312-fc3e-4538-a928-7febe3e57bb2 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:25:20.386089 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-98e66312-fc3e-4538-a928-7febe3e57bb2 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:25:20.386519 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-98e66312-fc3e-4538-a928-7febe3e57bb2 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:25:20.469195 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-98e66312-fc3e-4538-a928-7febe3e57bb2 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c85602851244d4a632b9c861eb4416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45cb377c6a9a43b3b91c99a64e37f1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:25:20.477683 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-98e66312-fc3e-4538-a928-7febe3e57bb2 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "GET /compute/v2.1/servers/61b522d6-fcd9-4bd7-bc4e-0459f0fcc6db" status: 200 len: 1464 microversion: 2.1 time: 0.110244 Oct 22 21:25:20.478250 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2839/5701] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:25:20 2022] GET /compute/v2.1/servers/61b522d6-fcd9-4bd7-bc4e-0459f0fcc6db => generated 1464 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:25:21.250889 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-3a82a697-be05-480e-aff9-59bef1b884ec req-7a910e10-4de3-44d3-afca-85e2a8aaed95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61b522d6-fcd9-4bd7-bc4e-0459f0fcc6db", "name": "network-vif-deleted", "tag": "0ac720b0-9841-46d5-83c3-934d01828bc7"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:25:21.261847 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-3a82a697-be05-480e-aff9-59bef1b884ec req-7a910e10-4de3-44d3-afca-85e2a8aaed95 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:25:21.262377 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-3a82a697-be05-480e-aff9-59bef1b884ec req-7a910e10-4de3-44d3-afca-85e2a8aaed95 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:25:21.262810 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-3a82a697-be05-480e-aff9-59bef1b884ec req-7a910e10-4de3-44d3-afca-85e2a8aaed95 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:25:21.275136 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-3a82a697-be05-480e-aff9-59bef1b884ec req-7a910e10-4de3-44d3-afca-85e2a8aaed95 service nova] Creating event network-vif-deleted:0ac720b0-9841-46d5-83c3-934d01828bc7 for instance 61b522d6-fcd9-4bd7-bc4e-0459f0fcc6db on nch2-master-1 Oct 22 21:25:21.280939 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-3a82a697-be05-480e-aff9-59bef1b884ec req-7a910e10-4de3-44d3-afca-85e2a8aaed95 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033938 Oct 22 21:25:21.281897 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2863/5702] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:25:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:25:21.502653 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-91c609c0-446f-4f96-8e49-a254518fd320 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:25:21.503246 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-91c609c0-446f-4f96-8e49-a254518fd320 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: 61b522d6-fcd9-4bd7-bc4e-0459f0fcc6db] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:25:21.510390 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-91c609c0-446f-4f96-8e49-a254518fd320 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:25:21.510878 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-91c609c0-446f-4f96-8e49-a254518fd320 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:25:21.511350 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-91c609c0-446f-4f96-8e49-a254518fd320 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:25:21.512189 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-91c609c0-446f-4f96-8e49-a254518fd320 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:25:21.512747 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-91c609c0-446f-4f96-8e49-a254518fd320 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:25:21.513183 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-91c609c0-446f-4f96-8e49-a254518fd320 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:25:21.550929 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-91c609c0-446f-4f96-8e49-a254518fd320 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:25:21.551701 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-91c609c0-446f-4f96-8e49-a254518fd320 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:25:21.552317 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-91c609c0-446f-4f96-8e49-a254518fd320 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:25:21.553028 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.objects.instance [None req-91c609c0-446f-4f96-8e49-a254518fd320 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lazy-loading 'fault' on Instance uuid 61b522d6-fcd9-4bd7-bc4e-0459f0fcc6db {{(pid=138744) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 21:25:21.607034 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-91c609c0-446f-4f96-8e49-a254518fd320 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c85602851244d4a632b9c861eb4416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45cb377c6a9a43b3b91c99a64e37f1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:25:21.615132 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-91c609c0-446f-4f96-8e49-a254518fd320 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "GET /compute/v2.1/servers/61b522d6-fcd9-4bd7-bc4e-0459f0fcc6db" status: 200 len: 1304 microversion: 2.1 time: 0.116401 Oct 22 21:25:21.615749 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2840/5703] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:25:21 2022] GET /compute/v2.1/servers/61b522d6-fcd9-4bd7-bc4e-0459f0fcc6db => generated 1304 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:25:22.643452 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-3b4550eb-7acf-4dbe-b9e2-1858c95ccf76 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:25:22.644144 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-3b4550eb-7acf-4dbe-b9e2-1858c95ccf76 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: 61b522d6-fcd9-4bd7-bc4e-0459f0fcc6db] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:25:22.650944 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3b4550eb-7acf-4dbe-b9e2-1858c95ccf76 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:25:22.651634 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3b4550eb-7acf-4dbe-b9e2-1858c95ccf76 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:25:22.651926 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3b4550eb-7acf-4dbe-b9e2-1858c95ccf76 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:25:22.652649 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3b4550eb-7acf-4dbe-b9e2-1858c95ccf76 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:25:22.653129 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3b4550eb-7acf-4dbe-b9e2-1858c95ccf76 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:25:22.653572 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3b4550eb-7acf-4dbe-b9e2-1858c95ccf76 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:25:22.667774 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.wsgi [None req-3b4550eb-7acf-4dbe-b9e2-1858c95ccf76 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] HTTP exception thrown: Instance 61b522d6-fcd9-4bd7-bc4e-0459f0fcc6db could not be found. Oct 22 21:25:22.669482 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-3b4550eb-7acf-4dbe-b9e2-1858c95ccf76 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Request method failure captured: Oct 22 21:25:22.669482 ncdv-master-1 devstack@n-api.service[138745]: request: GET /compute/v2.1/servers/61b522d6-fcd9-4bd7-bc4e-0459f0fcc6db HTTP/1.1 Oct 22 21:25:22.669482 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 21:25:22.669482 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 21:25:22.669482 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 21:25:22.669482 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 0 Oct 22 21:25:22.669482 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 21:25:22.669482 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 21:25:22.669482 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 21:25:22.669482 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 21:25:22.669482 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVF3y1V_7LM2bhyK99NoBFe-giEKTnFpuE3vTdYnEguljVUwfbfRxJXkNvk85nVw_XeG4HF30bHcflxpdsNI0PNyKAune8z480A5-3qJ8_UazcBtA79by1AUQbwspb5BhIfKTMrxZg2NgkizpxDUW1lw64wnpVqXMU0a0fzQqvfH1TU4 Oct 22 21:25:22.669482 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 21:25:22.669482 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 21:25:22.669482 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 21:25:22.669482 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 21:25:22.669482 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 21:25:22.669482 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 21:25:22.669482 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: 45cb377c6a9a43b3b91c99a64e37f1eb Oct 22 21:25:22.669482 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-ServerActionsTestJSON-274049943 Oct 22 21:25:22.669482 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 21:25:22.669482 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 21:25:22.669482 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_45cb377c6a9a43b3b91c99a64e37f1eb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/45cb377c6a9a43b3b91c99a64e37f1eb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/45cb377c6a9a43b3b91c99a64e37f1eb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/45cb377c6a9a43b3b91c99a64e37f1eb"}]}] Oct 22 21:25:22.669482 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-ServerActionsTestJSON-274049943 Oct 22 21:25:22.669482 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: 45cb377c6a9a43b3b91c99a64e37f1eb Oct 22 21:25:22.669482 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-ServerActionsTestJSON-274049943 Oct 22 21:25:22.669482 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-ServerActionsTestJSON-274049943-project Oct 22 21:25:22.669482 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 21:25:22.669482 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 21:25:22.669482 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: c9c85602851244d4a632b9c861eb4416 Oct 22 21:25:22.669482 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-ServerActionsTestJSON-274049943-project Oct 22 21:25:22.669482 ncdv-master-1 devstack@n-api.service[138745]: method: > Oct 22 21:25:22.669482 ncdv-master-1 devstack@n-api.service[138745]: exception: Instance 61b522d6-fcd9-4bd7-bc4e-0459f0fcc6db could not be found. Oct 22 21:25:22.669482 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'id': '61b522d6-fcd9-4bd7-bc4e-0459f0fcc6db'} Oct 22 21:25:22.669482 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:25:22.669482 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:25:22.669482 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 21:25:22.669482 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 21:25:22.669482 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 21:25:22.669482 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 21:25:22.669482 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 21:25:22.669482 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 21:25:22.669482 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 21:25:22.669482 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 21:25:22.669482 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 61b522d6-fcd9-4bd7-bc4e-0459f0fcc6db could not be found. Oct 22 21:25:22.669482 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:25:22.669482 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:25:22.669482 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:25:22.669482 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:25:22.669482 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:25:22.669482 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:25:22.669482 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:25:22.669482 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:25:22.669482 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:25:22.669482 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:25:22.669482 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 21:25:22.669482 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 21:25:22.669482 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 21:25:22.669482 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 21:25:22.669482 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 21:25:22.669482 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:25:22.669482 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 61b522d6-fcd9-4bd7-bc4e-0459f0fcc6db could not be found. Oct 22 21:25:22.669482 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:25:22.669482 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:25:22.669482 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:25:22.673496 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:25:22.673496 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:25:22.673496 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:25:22.673496 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:25:22.673496 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:25:22.673496 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 61b522d6-fcd9-4bd7-bc4e-0459f0fcc6db could not be found. Oct 22 21:25:22.673496 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:25:22.673496 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-3b4550eb-7acf-4dbe-b9e2-1858c95ccf76 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Returning 404 to user: Instance 61b522d6-fcd9-4bd7-bc4e-0459f0fcc6db could not be found. {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:25:22.673496 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-3b4550eb-7acf-4dbe-b9e2-1858c95ccf76 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "GET /compute/v2.1/servers/61b522d6-fcd9-4bd7-bc4e-0459f0fcc6db" status: 404 len: 111 microversion: 2.1 time: 0.034941 Oct 22 21:25:22.673496 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2864/5704] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:25:22 2022] GET /compute/v2.1/servers/61b522d6-fcd9-4bd7-bc4e-0459f0fcc6db => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 21:25:22.680001 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-83aff095-0aed-4609-ae3d-d23ec295013f tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:25:22.680468 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-83aff095-0aed-4609-ae3d-d23ec295013f tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: cd1499ac-bb25-4ccd-8991-4d884118c0a7] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:25:22.687965 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-83aff095-0aed-4609-ae3d-d23ec295013f tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:25:22.688472 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-83aff095-0aed-4609-ae3d-d23ec295013f tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:25:22.688906 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-83aff095-0aed-4609-ae3d-d23ec295013f tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:25:22.689609 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-83aff095-0aed-4609-ae3d-d23ec295013f tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:25:22.690064 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-83aff095-0aed-4609-ae3d-d23ec295013f tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:25:22.690518 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-83aff095-0aed-4609-ae3d-d23ec295013f tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:25:22.717431 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-83aff095-0aed-4609-ae3d-d23ec295013f tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: cd1499ac-bb25-4ccd-8991-4d884118c0a7] Going to try to terminate instance {{(pid=138744) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 21:25:22.803666 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-83aff095-0aed-4609-ae3d-d23ec295013f tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "DELETE /compute/v2.1/servers/cd1499ac-bb25-4ccd-8991-4d884118c0a7" status: 204 len: 0 microversion: 2.1 time: 0.127233 Oct 22 21:25:22.804449 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2841/5705] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 21:25:22 2022] DELETE /compute/v2.1/servers/cd1499ac-bb25-4ccd-8991-4d884118c0a7 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 21:25:22.814807 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-bcf2a211-cf48-4701-b84e-505b4ab36ffd tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:25:22.815810 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-bcf2a211-cf48-4701-b84e-505b4ab36ffd tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: cd1499ac-bb25-4ccd-8991-4d884118c0a7] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:25:22.828700 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bcf2a211-cf48-4701-b84e-505b4ab36ffd tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:25:22.829223 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bcf2a211-cf48-4701-b84e-505b4ab36ffd tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:25:22.829651 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bcf2a211-cf48-4701-b84e-505b4ab36ffd tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:25:22.830378 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bcf2a211-cf48-4701-b84e-505b4ab36ffd tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:25:22.830853 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bcf2a211-cf48-4701-b84e-505b4ab36ffd tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:25:22.831295 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bcf2a211-cf48-4701-b84e-505b4ab36ffd tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:25:22.973901 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-bcf2a211-cf48-4701-b84e-505b4ab36ffd tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c85602851244d4a632b9c861eb4416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45cb377c6a9a43b3b91c99a64e37f1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:25:22.982330 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-bcf2a211-cf48-4701-b84e-505b4ab36ffd tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "GET /compute/v2.1/servers/cd1499ac-bb25-4ccd-8991-4d884118c0a7" status: 200 len: 1507 microversion: 2.1 time: 0.173689 Oct 22 21:25:22.982893 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2865/5706] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:25:22 2022] GET /compute/v2.1/servers/cd1499ac-bb25-4ccd-8991-4d884118c0a7 => generated 1507 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:25:24.008066 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-d10db278-c41b-49c4-8d3d-aa336748f99f tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:25:24.008889 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-d10db278-c41b-49c4-8d3d-aa336748f99f tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: cd1499ac-bb25-4ccd-8991-4d884118c0a7] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:25:24.017730 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d10db278-c41b-49c4-8d3d-aa336748f99f tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:25:24.018298 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d10db278-c41b-49c4-8d3d-aa336748f99f tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:25:24.018811 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d10db278-c41b-49c4-8d3d-aa336748f99f tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:25:24.019670 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d10db278-c41b-49c4-8d3d-aa336748f99f tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:25:24.020204 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d10db278-c41b-49c4-8d3d-aa336748f99f tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:25:24.020702 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d10db278-c41b-49c4-8d3d-aa336748f99f tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:25:24.162394 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-d10db278-c41b-49c4-8d3d-aa336748f99f tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c85602851244d4a632b9c861eb4416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45cb377c6a9a43b3b91c99a64e37f1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:25:24.170789 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-d10db278-c41b-49c4-8d3d-aa336748f99f tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "GET /compute/v2.1/servers/cd1499ac-bb25-4ccd-8991-4d884118c0a7" status: 200 len: 1507 microversion: 2.1 time: 0.167912 Oct 22 21:25:24.171404 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2842/5707] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:25:24 2022] GET /compute/v2.1/servers/cd1499ac-bb25-4ccd-8991-4d884118c0a7 => generated 1507 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:25:24.940755 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-d8084e4e-d6fa-4840-9670-4c3450392fea req-631ed052-a0e2-4db6-8bf4-b7a2f7bd86e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd1499ac-bb25-4ccd-8991-4d884118c0a7", "name": "network-vif-deleted", "tag": "6c894d02-6239-4821-8b25-505edeb5c42c"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:25:24.951759 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-d8084e4e-d6fa-4840-9670-4c3450392fea req-631ed052-a0e2-4db6-8bf4-b7a2f7bd86e0 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:25:24.952268 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-d8084e4e-d6fa-4840-9670-4c3450392fea req-631ed052-a0e2-4db6-8bf4-b7a2f7bd86e0 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:25:24.952738 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-d8084e4e-d6fa-4840-9670-4c3450392fea req-631ed052-a0e2-4db6-8bf4-b7a2f7bd86e0 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:25:24.968237 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-d8084e4e-d6fa-4840-9670-4c3450392fea req-631ed052-a0e2-4db6-8bf4-b7a2f7bd86e0 service nova] Creating event network-vif-deleted:6c894d02-6239-4821-8b25-505edeb5c42c for instance cd1499ac-bb25-4ccd-8991-4d884118c0a7 on nch1-master-1 Oct 22 21:25:24.973722 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-d8084e4e-d6fa-4840-9670-4c3450392fea req-631ed052-a0e2-4db6-8bf4-b7a2f7bd86e0 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036983 Oct 22 21:25:24.974343 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2866/5708] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:25:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:25:25.194427 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-0442770a-ed6e-4cd9-8483-92a628b6100d tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:25:25.195041 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-0442770a-ed6e-4cd9-8483-92a628b6100d tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: cd1499ac-bb25-4ccd-8991-4d884118c0a7] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:25:25.202853 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0442770a-ed6e-4cd9-8483-92a628b6100d tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:25:25.203317 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0442770a-ed6e-4cd9-8483-92a628b6100d tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:25:25.203877 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0442770a-ed6e-4cd9-8483-92a628b6100d tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:25:25.204614 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0442770a-ed6e-4cd9-8483-92a628b6100d tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:25:25.205075 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0442770a-ed6e-4cd9-8483-92a628b6100d tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:25:25.205513 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0442770a-ed6e-4cd9-8483-92a628b6100d tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:25:25.240177 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0442770a-ed6e-4cd9-8483-92a628b6100d tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:25:25.240389 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0442770a-ed6e-4cd9-8483-92a628b6100d tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:25:25.240894 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0442770a-ed6e-4cd9-8483-92a628b6100d tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:25:25.241358 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.objects.instance [None req-0442770a-ed6e-4cd9-8483-92a628b6100d tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lazy-loading 'fault' on Instance uuid cd1499ac-bb25-4ccd-8991-4d884118c0a7 {{(pid=138744) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 21:25:25.292097 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-0442770a-ed6e-4cd9-8483-92a628b6100d tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c85602851244d4a632b9c861eb4416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45cb377c6a9a43b3b91c99a64e37f1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:25:25.302307 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-0442770a-ed6e-4cd9-8483-92a628b6100d tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "GET /compute/v2.1/servers/cd1499ac-bb25-4ccd-8991-4d884118c0a7" status: 200 len: 1304 microversion: 2.1 time: 0.111705 Oct 22 21:25:25.303143 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2843/5709] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:25:25 2022] GET /compute/v2.1/servers/cd1499ac-bb25-4ccd-8991-4d884118c0a7 => generated 1304 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:25:26.332964 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-0dfbe3c3-0ae1-4082-b600-1512b3435e6e tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:25:26.333920 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-0dfbe3c3-0ae1-4082-b600-1512b3435e6e tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: cd1499ac-bb25-4ccd-8991-4d884118c0a7] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:25:26.344508 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0dfbe3c3-0ae1-4082-b600-1512b3435e6e tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:25:26.345529 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0dfbe3c3-0ae1-4082-b600-1512b3435e6e tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:25:26.346129 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0dfbe3c3-0ae1-4082-b600-1512b3435e6e tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:25:26.346863 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0dfbe3c3-0ae1-4082-b600-1512b3435e6e tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:25:26.347368 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0dfbe3c3-0ae1-4082-b600-1512b3435e6e tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:25:26.347821 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0dfbe3c3-0ae1-4082-b600-1512b3435e6e tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:25:26.362710 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.wsgi [None req-0dfbe3c3-0ae1-4082-b600-1512b3435e6e tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] HTTP exception thrown: Instance cd1499ac-bb25-4ccd-8991-4d884118c0a7 could not be found. Oct 22 21:25:26.364424 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-0dfbe3c3-0ae1-4082-b600-1512b3435e6e tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Request method failure captured: Oct 22 21:25:26.364424 ncdv-master-1 devstack@n-api.service[138745]: request: GET /compute/v2.1/servers/cd1499ac-bb25-4ccd-8991-4d884118c0a7 HTTP/1.1 Oct 22 21:25:26.364424 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 21:25:26.364424 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 21:25:26.364424 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 21:25:26.364424 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 0 Oct 22 21:25:26.364424 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 21:25:26.364424 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 21:25:26.364424 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 21:25:26.364424 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 21:25:26.364424 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVF3y1V_7LM2bhyK99NoBFe-giEKTnFpuE3vTdYnEguljVUwfbfRxJXkNvk85nVw_XeG4HF30bHcflxpdsNI0PNyKAune8z480A5-3qJ8_UazcBtA79by1AUQbwspb5BhIfKTMrxZg2NgkizpxDUW1lw64wnpVqXMU0a0fzQqvfH1TU4 Oct 22 21:25:26.364424 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 21:25:26.364424 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 21:25:26.364424 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 21:25:26.364424 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 21:25:26.364424 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 21:25:26.364424 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 21:25:26.364424 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: 45cb377c6a9a43b3b91c99a64e37f1eb Oct 22 21:25:26.364424 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-ServerActionsTestJSON-274049943 Oct 22 21:25:26.364424 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 21:25:26.364424 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 21:25:26.364424 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_45cb377c6a9a43b3b91c99a64e37f1eb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/45cb377c6a9a43b3b91c99a64e37f1eb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/45cb377c6a9a43b3b91c99a64e37f1eb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/45cb377c6a9a43b3b91c99a64e37f1eb"}]}] Oct 22 21:25:26.364424 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-ServerActionsTestJSON-274049943 Oct 22 21:25:26.364424 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: 45cb377c6a9a43b3b91c99a64e37f1eb Oct 22 21:25:26.364424 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-ServerActionsTestJSON-274049943 Oct 22 21:25:26.364424 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-ServerActionsTestJSON-274049943-project Oct 22 21:25:26.364424 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 21:25:26.364424 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 21:25:26.364424 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: c9c85602851244d4a632b9c861eb4416 Oct 22 21:25:26.364424 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-ServerActionsTestJSON-274049943-project Oct 22 21:25:26.364424 ncdv-master-1 devstack@n-api.service[138745]: method: > Oct 22 21:25:26.364424 ncdv-master-1 devstack@n-api.service[138745]: exception: Instance cd1499ac-bb25-4ccd-8991-4d884118c0a7 could not be found. Oct 22 21:25:26.364424 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'id': 'cd1499ac-bb25-4ccd-8991-4d884118c0a7'} Oct 22 21:25:26.364424 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:25:26.364424 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:25:26.364424 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 21:25:26.364424 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 21:25:26.364424 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 21:25:26.364424 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 21:25:26.364424 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 21:25:26.364424 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 21:25:26.364424 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 21:25:26.364424 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 21:25:26.364424 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd1499ac-bb25-4ccd-8991-4d884118c0a7 could not be found. Oct 22 21:25:26.364424 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:25:26.364424 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:25:26.364424 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:25:26.364424 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:25:26.364424 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:25:26.364424 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:25:26.364424 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:25:26.364424 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:25:26.364424 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:25:26.364424 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:25:26.364424 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 21:25:26.364424 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 21:25:26.364424 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 21:25:26.364424 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 21:25:26.364424 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 21:25:26.364424 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:25:26.364424 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd1499ac-bb25-4ccd-8991-4d884118c0a7 could not be found. Oct 22 21:25:26.364424 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:25:26.364424 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:25:26.364424 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:25:26.368276 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:25:26.368276 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:25:26.368276 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:25:26.368276 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:25:26.368276 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:25:26.368276 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd1499ac-bb25-4ccd-8991-4d884118c0a7 could not be found. Oct 22 21:25:26.368276 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:25:26.368276 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-0dfbe3c3-0ae1-4082-b600-1512b3435e6e tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Returning 404 to user: Instance cd1499ac-bb25-4ccd-8991-4d884118c0a7 could not be found. {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:25:26.368276 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-0dfbe3c3-0ae1-4082-b600-1512b3435e6e tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "GET /compute/v2.1/servers/cd1499ac-bb25-4ccd-8991-4d884118c0a7" status: 404 len: 111 microversion: 2.1 time: 0.041213 Oct 22 21:25:26.368276 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2867/5710] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:25:26 2022] GET /compute/v2.1/servers/cd1499ac-bb25-4ccd-8991-4d884118c0a7 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 21:25:26.374771 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-d9768220-0fc4-4408-a673-11772dc23636 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:25:26.375248 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-d9768220-0fc4-4408-a673-11772dc23636 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: ec15d899-3167-4bce-9b78-f8d8b15455b3] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:25:26.382766 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d9768220-0fc4-4408-a673-11772dc23636 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:25:26.383287 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d9768220-0fc4-4408-a673-11772dc23636 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:25:26.383752 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d9768220-0fc4-4408-a673-11772dc23636 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:25:26.384451 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d9768220-0fc4-4408-a673-11772dc23636 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:25:26.384907 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d9768220-0fc4-4408-a673-11772dc23636 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:25:26.385337 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d9768220-0fc4-4408-a673-11772dc23636 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:25:26.411129 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-d9768220-0fc4-4408-a673-11772dc23636 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: ec15d899-3167-4bce-9b78-f8d8b15455b3] Going to try to terminate instance {{(pid=138744) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 21:25:26.499199 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-d9768220-0fc4-4408-a673-11772dc23636 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "DELETE /compute/v2.1/servers/ec15d899-3167-4bce-9b78-f8d8b15455b3" status: 204 len: 0 microversion: 2.1 time: 0.128104 Oct 22 21:25:26.499913 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2844/5711] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 21:25:26 2022] DELETE /compute/v2.1/servers/ec15d899-3167-4bce-9b78-f8d8b15455b3 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 21:25:26.509068 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-7d869a12-000e-4b8b-98d9-897a88c79d52 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:25:26.509688 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-7d869a12-000e-4b8b-98d9-897a88c79d52 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: ec15d899-3167-4bce-9b78-f8d8b15455b3] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:25:26.516020 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7d869a12-000e-4b8b-98d9-897a88c79d52 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:25:26.516530 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7d869a12-000e-4b8b-98d9-897a88c79d52 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:25:26.517035 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7d869a12-000e-4b8b-98d9-897a88c79d52 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:25:26.517756 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7d869a12-000e-4b8b-98d9-897a88c79d52 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:25:26.518234 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7d869a12-000e-4b8b-98d9-897a88c79d52 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:25:26.518709 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7d869a12-000e-4b8b-98d9-897a88c79d52 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:25:26.537371 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:25:26.671290 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-7d869a12-000e-4b8b-98d9-897a88c79d52 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c85602851244d4a632b9c861eb4416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45cb377c6a9a43b3b91c99a64e37f1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:25:26.679860 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-7d869a12-000e-4b8b-98d9-897a88c79d52 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "GET /compute/v2.1/servers/ec15d899-3167-4bce-9b78-f8d8b15455b3" status: 200 len: 1493 microversion: 2.1 time: 0.175493 Oct 22 21:25:26.680453 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2868/5712] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:25:26 2022] GET /compute/v2.1/servers/ec15d899-3167-4bce-9b78-f8d8b15455b3 => generated 1493 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:25:27.707397 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-977ba3cf-dc6c-4a2e-b4f1-3e2b35f010c0 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:25:27.708313 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-977ba3cf-dc6c-4a2e-b4f1-3e2b35f010c0 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: ec15d899-3167-4bce-9b78-f8d8b15455b3] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:25:27.718390 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-977ba3cf-dc6c-4a2e-b4f1-3e2b35f010c0 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:25:27.719148 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-977ba3cf-dc6c-4a2e-b4f1-3e2b35f010c0 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:25:27.719961 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-977ba3cf-dc6c-4a2e-b4f1-3e2b35f010c0 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:25:27.720694 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-977ba3cf-dc6c-4a2e-b4f1-3e2b35f010c0 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:25:27.721151 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-977ba3cf-dc6c-4a2e-b4f1-3e2b35f010c0 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:25:27.721545 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-977ba3cf-dc6c-4a2e-b4f1-3e2b35f010c0 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:25:27.870365 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-977ba3cf-dc6c-4a2e-b4f1-3e2b35f010c0 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c85602851244d4a632b9c861eb4416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45cb377c6a9a43b3b91c99a64e37f1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:25:27.879857 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-977ba3cf-dc6c-4a2e-b4f1-3e2b35f010c0 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "GET /compute/v2.1/servers/ec15d899-3167-4bce-9b78-f8d8b15455b3" status: 200 len: 1493 microversion: 2.1 time: 0.178550 Oct 22 21:25:27.880448 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2845/5713] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:25:27 2022] GET /compute/v2.1/servers/ec15d899-3167-4bce-9b78-f8d8b15455b3 => generated 1493 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:25:28.415017 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-4152a863-5292-41ca-80b0-e8360144b24e req-6d77b8fe-fa4e-414f-9be5-166ffcc19c0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec15d899-3167-4bce-9b78-f8d8b15455b3", "name": "network-vif-deleted", "tag": "ac7f29a5-7912-4f95-b7f3-24677fd1743d"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:25:28.426816 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-4152a863-5292-41ca-80b0-e8360144b24e req-6d77b8fe-fa4e-414f-9be5-166ffcc19c0e service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:25:28.427685 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-4152a863-5292-41ca-80b0-e8360144b24e req-6d77b8fe-fa4e-414f-9be5-166ffcc19c0e service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:25:28.428341 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-4152a863-5292-41ca-80b0-e8360144b24e req-6d77b8fe-fa4e-414f-9be5-166ffcc19c0e service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:25:28.445622 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-4152a863-5292-41ca-80b0-e8360144b24e req-6d77b8fe-fa4e-414f-9be5-166ffcc19c0e service nova] Creating event network-vif-deleted:ac7f29a5-7912-4f95-b7f3-24677fd1743d for instance ec15d899-3167-4bce-9b78-f8d8b15455b3 on nch2-master-1 Oct 22 21:25:28.456420 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-4152a863-5292-41ca-80b0-e8360144b24e req-6d77b8fe-fa4e-414f-9be5-166ffcc19c0e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040009 Oct 22 21:25:28.457581 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2869/5714] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:25:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:25:28.903611 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-0b92634b-25d2-46d5-a605-e2de3c7dabb2 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:25:28.904221 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-0b92634b-25d2-46d5-a605-e2de3c7dabb2 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: ec15d899-3167-4bce-9b78-f8d8b15455b3] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:25:28.910516 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0b92634b-25d2-46d5-a605-e2de3c7dabb2 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:25:28.911007 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0b92634b-25d2-46d5-a605-e2de3c7dabb2 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:25:28.911840 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0b92634b-25d2-46d5-a605-e2de3c7dabb2 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:25:28.912148 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0b92634b-25d2-46d5-a605-e2de3c7dabb2 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:25:28.912657 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0b92634b-25d2-46d5-a605-e2de3c7dabb2 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:25:28.913086 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0b92634b-25d2-46d5-a605-e2de3c7dabb2 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:25:28.929802 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=14,nova_cell1:DELETE=2,nova_cell1:INSERT=3 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:25:28.951775 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0b92634b-25d2-46d5-a605-e2de3c7dabb2 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:25:28.952276 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0b92634b-25d2-46d5-a605-e2de3c7dabb2 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:25:28.952711 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0b92634b-25d2-46d5-a605-e2de3c7dabb2 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:25:28.953162 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.objects.instance [None req-0b92634b-25d2-46d5-a605-e2de3c7dabb2 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lazy-loading 'fault' on Instance uuid ec15d899-3167-4bce-9b78-f8d8b15455b3 {{(pid=138744) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 21:25:29.001540 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-0b92634b-25d2-46d5-a605-e2de3c7dabb2 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c85602851244d4a632b9c861eb4416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45cb377c6a9a43b3b91c99a64e37f1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:25:29.010027 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-0b92634b-25d2-46d5-a605-e2de3c7dabb2 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "GET /compute/v2.1/servers/ec15d899-3167-4bce-9b78-f8d8b15455b3" status: 200 len: 1304 microversion: 2.1 time: 0.111363 Oct 22 21:25:29.010581 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2846/5715] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:25:28 2022] GET /compute/v2.1/servers/ec15d899-3167-4bce-9b78-f8d8b15455b3 => generated 1304 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:25:30.035149 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-e6152f38-45e4-44a8-9986-ee0e1e2f7b75 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:25:30.035911 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-e6152f38-45e4-44a8-9986-ee0e1e2f7b75 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: ec15d899-3167-4bce-9b78-f8d8b15455b3] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:25:30.042344 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e6152f38-45e4-44a8-9986-ee0e1e2f7b75 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:25:30.042854 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e6152f38-45e4-44a8-9986-ee0e1e2f7b75 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:25:30.043311 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e6152f38-45e4-44a8-9986-ee0e1e2f7b75 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:25:30.044058 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e6152f38-45e4-44a8-9986-ee0e1e2f7b75 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:25:30.044536 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e6152f38-45e4-44a8-9986-ee0e1e2f7b75 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:25:30.044984 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e6152f38-45e4-44a8-9986-ee0e1e2f7b75 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:25:30.058943 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.wsgi [None req-e6152f38-45e4-44a8-9986-ee0e1e2f7b75 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] HTTP exception thrown: Instance ec15d899-3167-4bce-9b78-f8d8b15455b3 could not be found. Oct 22 21:25:30.060643 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-e6152f38-45e4-44a8-9986-ee0e1e2f7b75 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Request method failure captured: Oct 22 21:25:30.060643 ncdv-master-1 devstack@n-api.service[138745]: request: GET /compute/v2.1/servers/ec15d899-3167-4bce-9b78-f8d8b15455b3 HTTP/1.1 Oct 22 21:25:30.060643 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 21:25:30.060643 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 21:25:30.060643 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 21:25:30.060643 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 0 Oct 22 21:25:30.060643 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 21:25:30.060643 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 21:25:30.060643 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 21:25:30.060643 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 21:25:30.060643 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVF3y1V_7LM2bhyK99NoBFe-giEKTnFpuE3vTdYnEguljVUwfbfRxJXkNvk85nVw_XeG4HF30bHcflxpdsNI0PNyKAune8z480A5-3qJ8_UazcBtA79by1AUQbwspb5BhIfKTMrxZg2NgkizpxDUW1lw64wnpVqXMU0a0fzQqvfH1TU4 Oct 22 21:25:30.060643 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 21:25:30.060643 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 21:25:30.060643 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 21:25:30.060643 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 21:25:30.060643 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 21:25:30.060643 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 21:25:30.060643 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: 45cb377c6a9a43b3b91c99a64e37f1eb Oct 22 21:25:30.060643 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-ServerActionsTestJSON-274049943 Oct 22 21:25:30.060643 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 21:25:30.060643 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 21:25:30.060643 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_45cb377c6a9a43b3b91c99a64e37f1eb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/45cb377c6a9a43b3b91c99a64e37f1eb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/45cb377c6a9a43b3b91c99a64e37f1eb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/45cb377c6a9a43b3b91c99a64e37f1eb"}]}] Oct 22 21:25:30.060643 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-ServerActionsTestJSON-274049943 Oct 22 21:25:30.060643 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: 45cb377c6a9a43b3b91c99a64e37f1eb Oct 22 21:25:30.060643 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-ServerActionsTestJSON-274049943 Oct 22 21:25:30.060643 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-ServerActionsTestJSON-274049943-project Oct 22 21:25:30.060643 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 21:25:30.060643 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 21:25:30.060643 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: c9c85602851244d4a632b9c861eb4416 Oct 22 21:25:30.060643 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-ServerActionsTestJSON-274049943-project Oct 22 21:25:30.060643 ncdv-master-1 devstack@n-api.service[138745]: method: > Oct 22 21:25:30.060643 ncdv-master-1 devstack@n-api.service[138745]: exception: Instance ec15d899-3167-4bce-9b78-f8d8b15455b3 could not be found. Oct 22 21:25:30.060643 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'id': 'ec15d899-3167-4bce-9b78-f8d8b15455b3'} Oct 22 21:25:30.060643 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:25:30.060643 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:25:30.060643 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 21:25:30.060643 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 21:25:30.060643 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 21:25:30.060643 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 21:25:30.060643 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 21:25:30.060643 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 21:25:30.060643 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 21:25:30.060643 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 21:25:30.060643 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec15d899-3167-4bce-9b78-f8d8b15455b3 could not be found. Oct 22 21:25:30.060643 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:25:30.060643 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:25:30.060643 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:25:30.060643 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:25:30.060643 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:25:30.060643 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:25:30.060643 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:25:30.060643 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:25:30.060643 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:25:30.060643 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:25:30.060643 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 21:25:30.060643 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 21:25:30.060643 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 21:25:30.060643 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 21:25:30.060643 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 21:25:30.060643 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:25:30.060643 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec15d899-3167-4bce-9b78-f8d8b15455b3 could not be found. Oct 22 21:25:30.060643 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:25:30.060643 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:25:30.060643 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:25:30.068854 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:25:30.068854 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:25:30.068854 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:25:30.068854 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:25:30.068854 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:25:30.068854 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec15d899-3167-4bce-9b78-f8d8b15455b3 could not be found. Oct 22 21:25:30.068854 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:25:30.068854 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-e6152f38-45e4-44a8-9986-ee0e1e2f7b75 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Returning 404 to user: Instance ec15d899-3167-4bce-9b78-f8d8b15455b3 could not be found. {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:25:30.068854 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-e6152f38-45e4-44a8-9986-ee0e1e2f7b75 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "GET /compute/v2.1/servers/ec15d899-3167-4bce-9b78-f8d8b15455b3" status: 404 len: 111 microversion: 2.1 time: 0.032518 Oct 22 21:25:30.068854 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2870/5716] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:25:30 2022] GET /compute/v2.1/servers/ec15d899-3167-4bce-9b78-f8d8b15455b3 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 21:25:30.070864 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-daaa4418-957f-4883-a9c2-a2489da38a8d tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:25:30.071479 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-daaa4418-957f-4883-a9c2-a2489da38a8d tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: 20d90b58-3fad-4a44-b6bf-4ef0cc587def] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:25:30.078644 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-daaa4418-957f-4883-a9c2-a2489da38a8d tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:25:30.079267 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-daaa4418-957f-4883-a9c2-a2489da38a8d tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:25:30.079734 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-daaa4418-957f-4883-a9c2-a2489da38a8d tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:25:30.080455 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-daaa4418-957f-4883-a9c2-a2489da38a8d tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:25:30.081020 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-daaa4418-957f-4883-a9c2-a2489da38a8d tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:25:30.081370 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-daaa4418-957f-4883-a9c2-a2489da38a8d tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:25:30.113492 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-daaa4418-957f-4883-a9c2-a2489da38a8d tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: 20d90b58-3fad-4a44-b6bf-4ef0cc587def] Going to try to terminate instance {{(pid=138744) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 21:25:30.199775 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-daaa4418-957f-4883-a9c2-a2489da38a8d tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "DELETE /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def" status: 204 len: 0 microversion: 2.1 time: 0.132382 Oct 22 21:25:30.201567 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2847/5717] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 21:25:30 2022] DELETE /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 22 21:25:30.210028 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-7d85345a-ca3b-40c6-911e-05f5178d3b49 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:25:30.210663 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-7d85345a-ca3b-40c6-911e-05f5178d3b49 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: 20d90b58-3fad-4a44-b6bf-4ef0cc587def] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:25:30.217068 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7d85345a-ca3b-40c6-911e-05f5178d3b49 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:25:30.217571 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7d85345a-ca3b-40c6-911e-05f5178d3b49 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:25:30.218027 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7d85345a-ca3b-40c6-911e-05f5178d3b49 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:25:30.218742 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7d85345a-ca3b-40c6-911e-05f5178d3b49 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:25:30.219217 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7d85345a-ca3b-40c6-911e-05f5178d3b49 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:25:30.219689 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7d85345a-ca3b-40c6-911e-05f5178d3b49 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:25:30.359122 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-7d85345a-ca3b-40c6-911e-05f5178d3b49 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c85602851244d4a632b9c861eb4416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45cb377c6a9a43b3b91c99a64e37f1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:25:30.367876 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-7d85345a-ca3b-40c6-911e-05f5178d3b49 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def" status: 200 len: 1675 microversion: 2.1 time: 0.161967 Oct 22 21:25:30.368428 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2871/5718] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:25:30 2022] GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def => generated 1675 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:25:31.392379 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-cd97918c-e28e-48fb-aa98-3db547c50c5d tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:25:31.392947 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-cd97918c-e28e-48fb-aa98-3db547c50c5d tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: 20d90b58-3fad-4a44-b6bf-4ef0cc587def] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:25:31.400460 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cd97918c-e28e-48fb-aa98-3db547c50c5d tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:25:31.400946 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cd97918c-e28e-48fb-aa98-3db547c50c5d tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:25:31.401391 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cd97918c-e28e-48fb-aa98-3db547c50c5d tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:25:31.402092 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cd97918c-e28e-48fb-aa98-3db547c50c5d tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:25:31.402541 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cd97918c-e28e-48fb-aa98-3db547c50c5d tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:25:31.402976 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cd97918c-e28e-48fb-aa98-3db547c50c5d tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:25:31.548437 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-cd97918c-e28e-48fb-aa98-3db547c50c5d tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c85602851244d4a632b9c861eb4416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45cb377c6a9a43b3b91c99a64e37f1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:25:31.557002 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-cd97918c-e28e-48fb-aa98-3db547c50c5d tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def" status: 200 len: 1675 microversion: 2.1 time: 0.169043 Oct 22 21:25:31.557594 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2848/5719] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:25:31 2022] GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def => generated 1675 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:25:32.581450 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-a27d50f0-e1e9-4f56-993e-32894cac39ea tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:25:32.582105 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-a27d50f0-e1e9-4f56-993e-32894cac39ea tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: 20d90b58-3fad-4a44-b6bf-4ef0cc587def] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:25:32.589709 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a27d50f0-e1e9-4f56-993e-32894cac39ea tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:25:32.590235 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a27d50f0-e1e9-4f56-993e-32894cac39ea tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:25:32.590689 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a27d50f0-e1e9-4f56-993e-32894cac39ea tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:25:32.591445 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a27d50f0-e1e9-4f56-993e-32894cac39ea tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:25:32.591921 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a27d50f0-e1e9-4f56-993e-32894cac39ea tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:25:32.592358 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a27d50f0-e1e9-4f56-993e-32894cac39ea tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:25:32.661841 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-a27d50f0-e1e9-4f56-993e-32894cac39ea tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c85602851244d4a632b9c861eb4416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45cb377c6a9a43b3b91c99a64e37f1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:25:32.670581 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-a27d50f0-e1e9-4f56-993e-32894cac39ea tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def" status: 200 len: 1607 microversion: 2.1 time: 0.093310 Oct 22 21:25:32.671437 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2872/5720] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:25:32 2022] GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def => generated 1607 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:25:32.722229 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-674b47b5-d8a0-4b2d-803f-c2d83cd7a7a7 req-ade6e884-8fcb-459d-b7ac-09e1df277b71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20d90b58-3fad-4a44-b6bf-4ef0cc587def", "name": "network-vif-deleted", "tag": "7ef4550f-d128-432a-9dbc-ce1802e6c6da"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:25:32.733628 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-674b47b5-d8a0-4b2d-803f-c2d83cd7a7a7 req-ade6e884-8fcb-459d-b7ac-09e1df277b71 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:25:32.734115 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-674b47b5-d8a0-4b2d-803f-c2d83cd7a7a7 req-ade6e884-8fcb-459d-b7ac-09e1df277b71 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:25:32.734552 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-674b47b5-d8a0-4b2d-803f-c2d83cd7a7a7 req-ade6e884-8fcb-459d-b7ac-09e1df277b71 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:25:32.746591 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-674b47b5-d8a0-4b2d-803f-c2d83cd7a7a7 req-ade6e884-8fcb-459d-b7ac-09e1df277b71 service nova] Creating event network-vif-deleted:7ef4550f-d128-432a-9dbc-ce1802e6c6da for instance 20d90b58-3fad-4a44-b6bf-4ef0cc587def on nch1-master-1 Oct 22 21:25:32.751818 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-674b47b5-d8a0-4b2d-803f-c2d83cd7a7a7 req-ade6e884-8fcb-459d-b7ac-09e1df277b71 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033317 Oct 22 21:25:32.752574 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2849/5721] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:25:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:25:33.694868 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-1a2b7b61-8953-443a-81cf-7ad58f6a3301 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:25:33.695552 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-1a2b7b61-8953-443a-81cf-7ad58f6a3301 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] [instance: 20d90b58-3fad-4a44-b6bf-4ef0cc587def] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:25:33.703067 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1a2b7b61-8953-443a-81cf-7ad58f6a3301 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:25:33.703620 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1a2b7b61-8953-443a-81cf-7ad58f6a3301 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:25:33.704079 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1a2b7b61-8953-443a-81cf-7ad58f6a3301 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:25:33.704803 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1a2b7b61-8953-443a-81cf-7ad58f6a3301 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:25:33.705450 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1a2b7b61-8953-443a-81cf-7ad58f6a3301 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:25:33.705943 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1a2b7b61-8953-443a-81cf-7ad58f6a3301 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:25:33.721015 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.wsgi [None req-1a2b7b61-8953-443a-81cf-7ad58f6a3301 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] HTTP exception thrown: Instance 20d90b58-3fad-4a44-b6bf-4ef0cc587def could not be found. Oct 22 21:25:33.722714 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-1a2b7b61-8953-443a-81cf-7ad58f6a3301 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Request method failure captured: Oct 22 21:25:33.722714 ncdv-master-1 devstack@n-api.service[138745]: request: GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def HTTP/1.1 Oct 22 21:25:33.722714 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 21:25:33.722714 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 21:25:33.722714 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 21:25:33.722714 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 0 Oct 22 21:25:33.722714 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 21:25:33.722714 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 21:25:33.722714 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 21:25:33.722714 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 21:25:33.722714 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVF3y1V_7LM2bhyK99NoBFe-giEKTnFpuE3vTdYnEguljVUwfbfRxJXkNvk85nVw_XeG4HF30bHcflxpdsNI0PNyKAune8z480A5-3qJ8_UazcBtA79by1AUQbwspb5BhIfKTMrxZg2NgkizpxDUW1lw64wnpVqXMU0a0fzQqvfH1TU4 Oct 22 21:25:33.722714 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 21:25:33.722714 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 21:25:33.722714 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 21:25:33.722714 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 21:25:33.722714 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 21:25:33.722714 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 21:25:33.722714 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: 45cb377c6a9a43b3b91c99a64e37f1eb Oct 22 21:25:33.722714 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-ServerActionsTestJSON-274049943 Oct 22 21:25:33.722714 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 21:25:33.722714 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 21:25:33.722714 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_45cb377c6a9a43b3b91c99a64e37f1eb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/45cb377c6a9a43b3b91c99a64e37f1eb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/45cb377c6a9a43b3b91c99a64e37f1eb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/45cb377c6a9a43b3b91c99a64e37f1eb"}]}] Oct 22 21:25:33.722714 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-ServerActionsTestJSON-274049943 Oct 22 21:25:33.722714 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: 45cb377c6a9a43b3b91c99a64e37f1eb Oct 22 21:25:33.722714 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-ServerActionsTestJSON-274049943 Oct 22 21:25:33.722714 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-ServerActionsTestJSON-274049943-project Oct 22 21:25:33.722714 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 21:25:33.722714 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 21:25:33.722714 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: c9c85602851244d4a632b9c861eb4416 Oct 22 21:25:33.722714 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-ServerActionsTestJSON-274049943-project Oct 22 21:25:33.722714 ncdv-master-1 devstack@n-api.service[138745]: method: > Oct 22 21:25:33.722714 ncdv-master-1 devstack@n-api.service[138745]: exception: Instance 20d90b58-3fad-4a44-b6bf-4ef0cc587def could not be found. Oct 22 21:25:33.722714 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'id': '20d90b58-3fad-4a44-b6bf-4ef0cc587def'} Oct 22 21:25:33.722714 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:25:33.722714 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:25:33.722714 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 21:25:33.722714 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 21:25:33.722714 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 21:25:33.722714 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 21:25:33.722714 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 21:25:33.722714 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 21:25:33.722714 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 21:25:33.722714 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 21:25:33.722714 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20d90b58-3fad-4a44-b6bf-4ef0cc587def could not be found. Oct 22 21:25:33.722714 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:25:33.722714 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:25:33.722714 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:25:33.722714 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:25:33.722714 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:25:33.722714 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:25:33.722714 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:25:33.722714 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:25:33.722714 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:25:33.722714 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:25:33.722714 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 21:25:33.722714 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 21:25:33.722714 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 21:25:33.722714 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 21:25:33.722714 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 21:25:33.722714 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:25:33.722714 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20d90b58-3fad-4a44-b6bf-4ef0cc587def could not be found. Oct 22 21:25:33.722714 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:25:33.722714 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:25:33.722714 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:25:33.726677 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:25:33.726677 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:25:33.726677 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:25:33.726677 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:25:33.726677 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:25:33.726677 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20d90b58-3fad-4a44-b6bf-4ef0cc587def could not be found. Oct 22 21:25:33.726677 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:25:33.726677 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-1a2b7b61-8953-443a-81cf-7ad58f6a3301 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Returning 404 to user: Instance 20d90b58-3fad-4a44-b6bf-4ef0cc587def could not be found. {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:25:33.726677 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-1a2b7b61-8953-443a-81cf-7ad58f6a3301 tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def" status: 404 len: 111 microversion: 2.1 time: 0.033779 Oct 22 21:25:33.726677 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2873/5722] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:25:33 2022] GET /compute/v2.1/servers/20d90b58-3fad-4a44-b6bf-4ef0cc587def => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 21:25:33.735032 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-6a1cb877-8030-4060-b152-fde1cfe4878d tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] Calling method '.version_select at 0x7fd39eadd040>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:25:33.757427 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-6a1cb877-8030-4060-b152-fde1cfe4878d tempest-ServerActionsTestJSON-274049943 tempest-ServerActionsTestJSON-274049943-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-486334743" status: 202 len: 0 microversion: 2.1 time: 0.027458 Oct 22 21:25:33.758050 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2850/5723] 10.222.0.18 () {58 vars in 1218 bytes} [Sat Oct 22 21:25:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-486334743 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 21:25:39.765747 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-fbb2900a-af5b-4f1f-bb51-e70765242bdc tempest-ServersAaction247Test-219674733 tempest-ServersAaction247Test-219674733-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAaction247Test-server-2002458271", "imageRef": "085e4478-6edc-4a69-8e08-f9831713eb65", "flavorRef": "452", "networks": "none"}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:25:39.819642 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-fbb2900a-af5b-4f1f-bb51-e70765242bdc tempest-ServersAaction247Test-219674733 tempest-ServersAaction247Test-219674733-project] Flavor limits 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 21:25:39.820081 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-fbb2900a-af5b-4f1f-bb51-e70765242bdc tempest-ServersAaction247Test-219674733 tempest-ServersAaction247Test-219674733-project] Image limits 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 21:25:39.820571 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-fbb2900a-af5b-4f1f-bb51-e70765242bdc tempest-ServersAaction247Test-219674733 tempest-ServersAaction247Test-219674733-project] Flavor pref 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 21:25:39.820994 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-fbb2900a-af5b-4f1f-bb51-e70765242bdc tempest-ServersAaction247Test-219674733 tempest-ServersAaction247Test-219674733-project] Image pref 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 21:25:39.821428 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-fbb2900a-af5b-4f1f-bb51-e70765242bdc tempest-ServersAaction247Test-219674733 tempest-ServersAaction247Test-219674733-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 21:25:39.830901 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fbb2900a-af5b-4f1f-bb51-e70765242bdc tempest-ServersAaction247Test-219674733 tempest-ServersAaction247Test-219674733-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:25:39.831436 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fbb2900a-af5b-4f1f-bb51-e70765242bdc tempest-ServersAaction247Test-219674733 tempest-ServersAaction247Test-219674733-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:25:39.831897 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fbb2900a-af5b-4f1f-bb51-e70765242bdc tempest-ServersAaction247Test-219674733 tempest-ServersAaction247Test-219674733-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:25:39.832642 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fbb2900a-af5b-4f1f-bb51-e70765242bdc tempest-ServersAaction247Test-219674733 tempest-ServersAaction247Test-219674733-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:25:39.833110 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fbb2900a-af5b-4f1f-bb51-e70765242bdc tempest-ServersAaction247Test-219674733 tempest-ServersAaction247Test-219674733-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:25:39.833550 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fbb2900a-af5b-4f1f-bb51-e70765242bdc tempest-ServersAaction247Test-219674733 tempest-ServersAaction247Test-219674733-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:25:39.851854 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-fbb2900a-af5b-4f1f-bb51-e70765242bdc tempest-ServersAaction247Test-219674733 tempest-ServersAaction247Test-219674733-project] Getting quotas for project f8a90c9a54ef46b9833bb9ce3ba90f39. Resources: {'cores', 'instances', 'ram'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 21:25:39.857258 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-fbb2900a-af5b-4f1f-bb51-e70765242bdc tempest-ServersAaction247Test-219674733 tempest-ServersAaction247Test-219674733-project] Getting quotas for user b5898783a6b54016a531694cb8cd9bd4 and project f8a90c9a54ef46b9833bb9ce3ba90f39. Resources: {'cores', 'instances', 'ram'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 21:25:39.870482 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-fbb2900a-af5b-4f1f-bb51-e70765242bdc tempest-ServersAaction247Test-219674733 tempest-ServersAaction247Test-219674733-project] Going to run 1 instances... {{(pid=138745) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 21:25:39.872874 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-fbb2900a-af5b-4f1f-bb51-e70765242bdc tempest-ServersAaction247Test-219674733 tempest-ServersAaction247Test-219674733-project] [instance: a85afe84-3861-4939-9aeb-5b1184e3e9f8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='085e4478-6edc-4a69-8e08-f9831713eb65',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138745) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 21:25:39.919426 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-fbb2900a-af5b-4f1f-bb51-e70765242bdc tempest-ServersAaction247Test-219674733 tempest-ServersAaction247Test-219674733-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.275251 Oct 22 21:25:39.920113 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2874/5724] 10.222.0.18 () {62 vars in 1188 bytes} [Sat Oct 22 21:25:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 277 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Oct 22 21:25:39.933345 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-cdd4e33b-57f6-47a2-bbf1-2ddcbbecd2f7 tempest-ServersAaction247Test-219674733 tempest-ServersAaction247Test-219674733-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:25:39.934089 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-cdd4e33b-57f6-47a2-bbf1-2ddcbbecd2f7 tempest-ServersAaction247Test-219674733 tempest-ServersAaction247Test-219674733-project] [instance: a85afe84-3861-4939-9aeb-5b1184e3e9f8] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:25:39.994905 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-cdd4e33b-57f6-47a2-bbf1-2ddcbbecd2f7 tempest-ServersAaction247Test-219674733 tempest-ServersAaction247Test-219674733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5898783a6b54016a531694cb8cd9bd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8a90c9a54ef46b9833bb9ce3ba90f39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:25:40.003316 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-cdd4e33b-57f6-47a2-bbf1-2ddcbbecd2f7 tempest-ServersAaction247Test-219674733 tempest-ServersAaction247Test-219674733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5898783a6b54016a531694cb8cd9bd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8a90c9a54ef46b9833bb9ce3ba90f39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:25:40.005459 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-cdd4e33b-57f6-47a2-bbf1-2ddcbbecd2f7 tempest-ServersAaction247Test-219674733 tempest-ServersAaction247Test-219674733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5898783a6b54016a531694cb8cd9bd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8a90c9a54ef46b9833bb9ce3ba90f39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:25:40.006615 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-cdd4e33b-57f6-47a2-bbf1-2ddcbbecd2f7 tempest-ServersAaction247Test-219674733 tempest-ServersAaction247Test-219674733-project] 10.222.0.18 "GET /compute/v2.1/servers/a85afe84-3861-4939-9aeb-5b1184e3e9f8" status: 200 len: 1281 microversion: 2.47 time: 0.078771 Oct 22 21:25:40.007173 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2851/5725] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:25:39 2022] GET /compute/v2.1/servers/a85afe84-3861-4939-9aeb-5b1184e3e9f8 => generated 1281 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:25:41.036362 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-66fd2f0f-06e0-437d-bd00-84392ef3f3ac tempest-ServersAaction247Test-219674733 tempest-ServersAaction247Test-219674733-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:25:41.036918 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-66fd2f0f-06e0-437d-bd00-84392ef3f3ac tempest-ServersAaction247Test-219674733 tempest-ServersAaction247Test-219674733-project] [instance: a85afe84-3861-4939-9aeb-5b1184e3e9f8] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:25:41.042607 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=3 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:25:41.048740 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-66fd2f0f-06e0-437d-bd00-84392ef3f3ac tempest-ServersAaction247Test-219674733 tempest-ServersAaction247Test-219674733-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:25:41.049367 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-66fd2f0f-06e0-437d-bd00-84392ef3f3ac tempest-ServersAaction247Test-219674733 tempest-ServersAaction247Test-219674733-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:25:41.049848 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-66fd2f0f-06e0-437d-bd00-84392ef3f3ac tempest-ServersAaction247Test-219674733 tempest-ServersAaction247Test-219674733-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:25:41.050763 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-66fd2f0f-06e0-437d-bd00-84392ef3f3ac tempest-ServersAaction247Test-219674733 tempest-ServersAaction247Test-219674733-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:25:41.051176 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-66fd2f0f-06e0-437d-bd00-84392ef3f3ac tempest-ServersAaction247Test-219674733 tempest-ServersAaction247Test-219674733-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:25:41.051646 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-66fd2f0f-06e0-437d-bd00-84392ef3f3ac tempest-ServersAaction247Test-219674733 tempest-ServersAaction247Test-219674733-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:25:41.116714 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-66fd2f0f-06e0-437d-bd00-84392ef3f3ac tempest-ServersAaction247Test-219674733 tempest-ServersAaction247Test-219674733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5898783a6b54016a531694cb8cd9bd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8a90c9a54ef46b9833bb9ce3ba90f39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:25:41.125091 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-66fd2f0f-06e0-437d-bd00-84392ef3f3ac tempest-ServersAaction247Test-219674733 tempest-ServersAaction247Test-219674733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5898783a6b54016a531694cb8cd9bd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8a90c9a54ef46b9833bb9ce3ba90f39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:25:41.126553 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-66fd2f0f-06e0-437d-bd00-84392ef3f3ac tempest-ServersAaction247Test-219674733 tempest-ServersAaction247Test-219674733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5898783a6b54016a531694cb8cd9bd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8a90c9a54ef46b9833bb9ce3ba90f39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:25:41.127737 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-66fd2f0f-06e0-437d-bd00-84392ef3f3ac tempest-ServersAaction247Test-219674733 tempest-ServersAaction247Test-219674733-project] 10.222.0.18 "GET /compute/v2.1/servers/a85afe84-3861-4939-9aeb-5b1184e3e9f8" status: 200 len: 1333 microversion: 2.47 time: 0.098149 Oct 22 21:25:41.128372 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2875/5726] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:25:41 2022] GET /compute/v2.1/servers/a85afe84-3861-4939-9aeb-5b1184e3e9f8 => generated 1333 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:25:42.156048 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-96d6250c-2d2f-4acc-a7b8-5b41cb43f0ed tempest-ServersAaction247Test-219674733 tempest-ServersAaction247Test-219674733-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:25:42.156784 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-96d6250c-2d2f-4acc-a7b8-5b41cb43f0ed tempest-ServersAaction247Test-219674733 tempest-ServersAaction247Test-219674733-project] [instance: a85afe84-3861-4939-9aeb-5b1184e3e9f8] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:25:42.160525 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_api:SELECT=82,nova_api:UPDATE=5,nova_api:DELETE=1 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:25:42.167371 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-96d6250c-2d2f-4acc-a7b8-5b41cb43f0ed tempest-ServersAaction247Test-219674733 tempest-ServersAaction247Test-219674733-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:25:42.167977 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-96d6250c-2d2f-4acc-a7b8-5b41cb43f0ed tempest-ServersAaction247Test-219674733 tempest-ServersAaction247Test-219674733-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:25:42.168564 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-96d6250c-2d2f-4acc-a7b8-5b41cb43f0ed tempest-ServersAaction247Test-219674733 tempest-ServersAaction247Test-219674733-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:25:42.169430 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-96d6250c-2d2f-4acc-a7b8-5b41cb43f0ed tempest-ServersAaction247Test-219674733 tempest-ServersAaction247Test-219674733-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:25:42.169998 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-96d6250c-2d2f-4acc-a7b8-5b41cb43f0ed tempest-ServersAaction247Test-219674733 tempest-ServersAaction247Test-219674733-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:25:42.170531 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-96d6250c-2d2f-4acc-a7b8-5b41cb43f0ed tempest-ServersAaction247Test-219674733 tempest-ServersAaction247Test-219674733-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:25:42.238887 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-96d6250c-2d2f-4acc-a7b8-5b41cb43f0ed tempest-ServersAaction247Test-219674733 tempest-ServersAaction247Test-219674733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5898783a6b54016a531694cb8cd9bd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8a90c9a54ef46b9833bb9ce3ba90f39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:25:42.247797 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-96d6250c-2d2f-4acc-a7b8-5b41cb43f0ed tempest-ServersAaction247Test-219674733 tempest-ServersAaction247Test-219674733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5898783a6b54016a531694cb8cd9bd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8a90c9a54ef46b9833bb9ce3ba90f39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:25:42.249898 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-96d6250c-2d2f-4acc-a7b8-5b41cb43f0ed tempest-ServersAaction247Test-219674733 tempest-ServersAaction247Test-219674733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5898783a6b54016a531694cb8cd9bd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8a90c9a54ef46b9833bb9ce3ba90f39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:25:42.251031 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-96d6250c-2d2f-4acc-a7b8-5b41cb43f0ed tempest-ServersAaction247Test-219674733 tempest-ServersAaction247Test-219674733-project] 10.222.0.18 "GET /compute/v2.1/servers/a85afe84-3861-4939-9aeb-5b1184e3e9f8" status: 200 len: 1339 microversion: 2.47 time: 0.100055 Oct 22 21:25:42.251624 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2852/5727] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:25:42 2022] GET /compute/v2.1/servers/a85afe84-3861-4939-9aeb-5b1184e3e9f8 => generated 1339 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:25:43.288025 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-59525c3c-1744-4245-939e-abd8ac0ece93 tempest-ServersAaction247Test-219674733 tempest-ServersAaction247Test-219674733-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:25:43.288691 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-59525c3c-1744-4245-939e-abd8ac0ece93 tempest-ServersAaction247Test-219674733 tempest-ServersAaction247Test-219674733-project] [instance: a85afe84-3861-4939-9aeb-5b1184e3e9f8] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:25:43.296492 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-59525c3c-1744-4245-939e-abd8ac0ece93 tempest-ServersAaction247Test-219674733 tempest-ServersAaction247Test-219674733-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:25:43.297014 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-59525c3c-1744-4245-939e-abd8ac0ece93 tempest-ServersAaction247Test-219674733 tempest-ServersAaction247Test-219674733-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:25:43.297488 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-59525c3c-1744-4245-939e-abd8ac0ece93 tempest-ServersAaction247Test-219674733 tempest-ServersAaction247Test-219674733-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:25:43.298241 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-59525c3c-1744-4245-939e-abd8ac0ece93 tempest-ServersAaction247Test-219674733 tempest-ServersAaction247Test-219674733-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:25:43.298738 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-59525c3c-1744-4245-939e-abd8ac0ece93 tempest-ServersAaction247Test-219674733 tempest-ServersAaction247Test-219674733-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:25:43.299206 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-59525c3c-1744-4245-939e-abd8ac0ece93 tempest-ServersAaction247Test-219674733 tempest-ServersAaction247Test-219674733-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:25:43.368338 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-59525c3c-1744-4245-939e-abd8ac0ece93 tempest-ServersAaction247Test-219674733 tempest-ServersAaction247Test-219674733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5898783a6b54016a531694cb8cd9bd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8a90c9a54ef46b9833bb9ce3ba90f39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:25:43.376754 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-59525c3c-1744-4245-939e-abd8ac0ece93 tempest-ServersAaction247Test-219674733 tempest-ServersAaction247Test-219674733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5898783a6b54016a531694cb8cd9bd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8a90c9a54ef46b9833bb9ce3ba90f39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:25:43.378334 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-59525c3c-1744-4245-939e-abd8ac0ece93 tempest-ServersAaction247Test-219674733 tempest-ServersAaction247Test-219674733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5898783a6b54016a531694cb8cd9bd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8a90c9a54ef46b9833bb9ce3ba90f39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:25:43.379656 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-59525c3c-1744-4245-939e-abd8ac0ece93 tempest-ServersAaction247Test-219674733 tempest-ServersAaction247Test-219674733-project] 10.222.0.18 "GET /compute/v2.1/servers/a85afe84-3861-4939-9aeb-5b1184e3e9f8" status: 200 len: 1339 microversion: 2.47 time: 0.097191 Oct 22 21:25:43.380216 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2876/5728] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:25:43 2022] GET /compute/v2.1/servers/a85afe84-3861-4939-9aeb-5b1184e3e9f8 => generated 1339 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:25:44.406905 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-9969405b-dd5b-4694-8276-514894b831dc tempest-ServersAaction247Test-219674733 tempest-ServersAaction247Test-219674733-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:25:44.407615 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-9969405b-dd5b-4694-8276-514894b831dc tempest-ServersAaction247Test-219674733 tempest-ServersAaction247Test-219674733-project] [instance: a85afe84-3861-4939-9aeb-5b1184e3e9f8] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:25:44.415593 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9969405b-dd5b-4694-8276-514894b831dc tempest-ServersAaction247Test-219674733 tempest-ServersAaction247Test-219674733-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:25:44.416114 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9969405b-dd5b-4694-8276-514894b831dc tempest-ServersAaction247Test-219674733 tempest-ServersAaction247Test-219674733-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:25:44.416621 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9969405b-dd5b-4694-8276-514894b831dc tempest-ServersAaction247Test-219674733 tempest-ServersAaction247Test-219674733-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:25:44.417391 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9969405b-dd5b-4694-8276-514894b831dc tempest-ServersAaction247Test-219674733 tempest-ServersAaction247Test-219674733-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:25:44.417896 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9969405b-dd5b-4694-8276-514894b831dc tempest-ServersAaction247Test-219674733 tempest-ServersAaction247Test-219674733-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:25:44.418381 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9969405b-dd5b-4694-8276-514894b831dc tempest-ServersAaction247Test-219674733 tempest-ServersAaction247Test-219674733-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:25:44.485167 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-9969405b-dd5b-4694-8276-514894b831dc tempest-ServersAaction247Test-219674733 tempest-ServersAaction247Test-219674733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5898783a6b54016a531694cb8cd9bd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8a90c9a54ef46b9833bb9ce3ba90f39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:25:44.494172 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-9969405b-dd5b-4694-8276-514894b831dc tempest-ServersAaction247Test-219674733 tempest-ServersAaction247Test-219674733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5898783a6b54016a531694cb8cd9bd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8a90c9a54ef46b9833bb9ce3ba90f39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:25:44.495665 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-9969405b-dd5b-4694-8276-514894b831dc tempest-ServersAaction247Test-219674733 tempest-ServersAaction247Test-219674733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5898783a6b54016a531694cb8cd9bd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8a90c9a54ef46b9833bb9ce3ba90f39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:25:44.496823 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-9969405b-dd5b-4694-8276-514894b831dc tempest-ServersAaction247Test-219674733 tempest-ServersAaction247Test-219674733-project] 10.222.0.18 "GET /compute/v2.1/servers/a85afe84-3861-4939-9aeb-5b1184e3e9f8" status: 200 len: 1360 microversion: 2.47 time: 0.094362 Oct 22 21:25:44.497377 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2853/5729] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:25:44 2022] GET /compute/v2.1/servers/a85afe84-3861-4939-9aeb-5b1184e3e9f8 => generated 1360 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:25:44.522677 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-58c71d76-eb02-463d-83e1-511e403be431 tempest-ServersAaction247Test-219674733 tempest-ServersAaction247Test-219674733-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-820138545"}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:25:44.525395 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-58c71d76-eb02-463d-83e1-511e403be431 tempest-ServersAaction247Test-219674733 tempest-ServersAaction247Test-219674733-project] [instance: a85afe84-3861-4939-9aeb-5b1184e3e9f8] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:25:44.532609 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-58c71d76-eb02-463d-83e1-511e403be431 tempest-ServersAaction247Test-219674733 tempest-ServersAaction247Test-219674733-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:25:44.533111 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-58c71d76-eb02-463d-83e1-511e403be431 tempest-ServersAaction247Test-219674733 tempest-ServersAaction247Test-219674733-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:25:44.533562 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-58c71d76-eb02-463d-83e1-511e403be431 tempest-ServersAaction247Test-219674733 tempest-ServersAaction247Test-219674733-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:25:44.534278 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-58c71d76-eb02-463d-83e1-511e403be431 tempest-ServersAaction247Test-219674733 tempest-ServersAaction247Test-219674733-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:25:44.534743 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-58c71d76-eb02-463d-83e1-511e403be431 tempest-ServersAaction247Test-219674733 tempest-ServersAaction247Test-219674733-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:25:44.535181 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-58c71d76-eb02-463d-83e1-511e403be431 tempest-ServersAaction247Test-219674733 tempest-ServersAaction247Test-219674733-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:25:44.738053 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-58c71d76-eb02-463d-83e1-511e403be431 tempest-ServersAaction247Test-219674733 tempest-ServersAaction247Test-219674733-project] 10.222.0.18 "POST /compute/v2.1/servers/a85afe84-3861-4939-9aeb-5b1184e3e9f8/action" status: 202 len: 52 microversion: 2.47 time: 0.219317 Oct 22 21:25:44.738699 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2877/5730] 10.222.0.18 () {62 vars in 1319 bytes} [Sat Oct 22 21:25:44 2022] POST /compute/v2.1/servers/a85afe84-3861-4939-9aeb-5b1184e3e9f8/action => generated 52 bytes in 221 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Oct 22 21:25:44.750301 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-91b16306-6657-4872-b280-c636200b8072 tempest-ServersAaction247Test-219674733 tempest-ServersAaction247Test-219674733-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:25:44.750805 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-91b16306-6657-4872-b280-c636200b8072 tempest-ServersAaction247Test-219674733 tempest-ServersAaction247Test-219674733-project] [instance: a85afe84-3861-4939-9aeb-5b1184e3e9f8] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:25:44.757785 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-91b16306-6657-4872-b280-c636200b8072 tempest-ServersAaction247Test-219674733 tempest-ServersAaction247Test-219674733-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:25:44.758266 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-91b16306-6657-4872-b280-c636200b8072 tempest-ServersAaction247Test-219674733 tempest-ServersAaction247Test-219674733-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:25:44.758889 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-91b16306-6657-4872-b280-c636200b8072 tempest-ServersAaction247Test-219674733 tempest-ServersAaction247Test-219674733-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:25:44.759631 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-91b16306-6657-4872-b280-c636200b8072 tempest-ServersAaction247Test-219674733 tempest-ServersAaction247Test-219674733-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:25:44.760090 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-91b16306-6657-4872-b280-c636200b8072 tempest-ServersAaction247Test-219674733 tempest-ServersAaction247Test-219674733-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:25:44.760525 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-91b16306-6657-4872-b280-c636200b8072 tempest-ServersAaction247Test-219674733 tempest-ServersAaction247Test-219674733-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:25:44.785737 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-91b16306-6657-4872-b280-c636200b8072 tempest-ServersAaction247Test-219674733 tempest-ServersAaction247Test-219674733-project] [instance: a85afe84-3861-4939-9aeb-5b1184e3e9f8] Going to try to terminate instance {{(pid=138744) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 21:25:44.866509 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-91b16306-6657-4872-b280-c636200b8072 tempest-ServersAaction247Test-219674733 tempest-ServersAaction247Test-219674733-project] 10.222.0.18 "DELETE /compute/v2.1/servers/a85afe84-3861-4939-9aeb-5b1184e3e9f8" status: 204 len: 0 microversion: 2.47 time: 0.119851 Oct 22 21:25:44.867313 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2854/5731] 10.222.0.18 () {60 vars in 1280 bytes} [Sat Oct 22 21:25:44 2022] DELETE /compute/v2.1/servers/a85afe84-3861-4939-9aeb-5b1184e3e9f8 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 22 21:25:44.876078 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-b46f977a-4b60-40ef-9ff5-84037063ae6d tempest-ServersAaction247Test-219674733 tempest-ServersAaction247Test-219674733-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:25:44.876804 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-b46f977a-4b60-40ef-9ff5-84037063ae6d tempest-ServersAaction247Test-219674733 tempest-ServersAaction247Test-219674733-project] [instance: a85afe84-3861-4939-9aeb-5b1184e3e9f8] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:25:44.883568 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b46f977a-4b60-40ef-9ff5-84037063ae6d tempest-ServersAaction247Test-219674733 tempest-ServersAaction247Test-219674733-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:25:44.884094 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b46f977a-4b60-40ef-9ff5-84037063ae6d tempest-ServersAaction247Test-219674733 tempest-ServersAaction247Test-219674733-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:25:44.884549 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b46f977a-4b60-40ef-9ff5-84037063ae6d tempest-ServersAaction247Test-219674733 tempest-ServersAaction247Test-219674733-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:25:44.885282 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b46f977a-4b60-40ef-9ff5-84037063ae6d tempest-ServersAaction247Test-219674733 tempest-ServersAaction247Test-219674733-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:25:44.885783 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b46f977a-4b60-40ef-9ff5-84037063ae6d tempest-ServersAaction247Test-219674733 tempest-ServersAaction247Test-219674733-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:25:44.886588 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b46f977a-4b60-40ef-9ff5-84037063ae6d tempest-ServersAaction247Test-219674733 tempest-ServersAaction247Test-219674733-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:25:44.954231 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-b46f977a-4b60-40ef-9ff5-84037063ae6d tempest-ServersAaction247Test-219674733 tempest-ServersAaction247Test-219674733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5898783a6b54016a531694cb8cd9bd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8a90c9a54ef46b9833bb9ce3ba90f39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:25:44.965583 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-b46f977a-4b60-40ef-9ff5-84037063ae6d tempest-ServersAaction247Test-219674733 tempest-ServersAaction247Test-219674733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5898783a6b54016a531694cb8cd9bd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8a90c9a54ef46b9833bb9ce3ba90f39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:25:44.967044 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-b46f977a-4b60-40ef-9ff5-84037063ae6d tempest-ServersAaction247Test-219674733 tempest-ServersAaction247Test-219674733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5898783a6b54016a531694cb8cd9bd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8a90c9a54ef46b9833bb9ce3ba90f39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:25:44.968288 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-b46f977a-4b60-40ef-9ff5-84037063ae6d tempest-ServersAaction247Test-219674733 tempest-ServersAaction247Test-219674733-project] 10.222.0.18 "GET /compute/v2.1/servers/a85afe84-3861-4939-9aeb-5b1184e3e9f8" status: 200 len: 1366 microversion: 2.47 time: 0.096761 Oct 22 21:25:44.968855 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2878/5732] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:25:44 2022] GET /compute/v2.1/servers/a85afe84-3861-4939-9aeb-5b1184e3e9f8 => generated 1366 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 22 21:25:45.997639 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-bf7b799d-8c49-4428-a2cf-3a34d90e3675 tempest-ServersAaction247Test-219674733 tempest-ServersAaction247Test-219674733-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:25:45.998374 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-bf7b799d-8c49-4428-a2cf-3a34d90e3675 tempest-ServersAaction247Test-219674733 tempest-ServersAaction247Test-219674733-project] [instance: a85afe84-3861-4939-9aeb-5b1184e3e9f8] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:25:46.006128 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bf7b799d-8c49-4428-a2cf-3a34d90e3675 tempest-ServersAaction247Test-219674733 tempest-ServersAaction247Test-219674733-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:25:46.006644 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bf7b799d-8c49-4428-a2cf-3a34d90e3675 tempest-ServersAaction247Test-219674733 tempest-ServersAaction247Test-219674733-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:25:46.007104 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bf7b799d-8c49-4428-a2cf-3a34d90e3675 tempest-ServersAaction247Test-219674733 tempest-ServersAaction247Test-219674733-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:25:46.007880 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bf7b799d-8c49-4428-a2cf-3a34d90e3675 tempest-ServersAaction247Test-219674733 tempest-ServersAaction247Test-219674733-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:25:46.008366 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bf7b799d-8c49-4428-a2cf-3a34d90e3675 tempest-ServersAaction247Test-219674733 tempest-ServersAaction247Test-219674733-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:25:46.008819 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bf7b799d-8c49-4428-a2cf-3a34d90e3675 tempest-ServersAaction247Test-219674733 tempest-ServersAaction247Test-219674733-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:25:46.077168 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-bf7b799d-8c49-4428-a2cf-3a34d90e3675 tempest-ServersAaction247Test-219674733 tempest-ServersAaction247Test-219674733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5898783a6b54016a531694cb8cd9bd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8a90c9a54ef46b9833bb9ce3ba90f39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:25:46.085899 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-bf7b799d-8c49-4428-a2cf-3a34d90e3675 tempest-ServersAaction247Test-219674733 tempest-ServersAaction247Test-219674733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5898783a6b54016a531694cb8cd9bd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8a90c9a54ef46b9833bb9ce3ba90f39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:25:46.087325 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-bf7b799d-8c49-4428-a2cf-3a34d90e3675 tempest-ServersAaction247Test-219674733 tempest-ServersAaction247Test-219674733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5898783a6b54016a531694cb8cd9bd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8a90c9a54ef46b9833bb9ce3ba90f39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:25:46.088514 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-bf7b799d-8c49-4428-a2cf-3a34d90e3675 tempest-ServersAaction247Test-219674733 tempest-ServersAaction247Test-219674733-project] 10.222.0.18 "GET /compute/v2.1/servers/a85afe84-3861-4939-9aeb-5b1184e3e9f8" status: 200 len: 1366 microversion: 2.47 time: 0.095547 Oct 22 21:25:46.089077 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2855/5733] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:25:45 2022] GET /compute/v2.1/servers/a85afe84-3861-4939-9aeb-5b1184e3e9f8 => generated 1366 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:25:47.114421 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-69413441-461a-47e0-a0a6-171120918399 tempest-ServersAaction247Test-219674733 tempest-ServersAaction247Test-219674733-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:25:47.115037 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-69413441-461a-47e0-a0a6-171120918399 tempest-ServersAaction247Test-219674733 tempest-ServersAaction247Test-219674733-project] [instance: a85afe84-3861-4939-9aeb-5b1184e3e9f8] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:25:47.123212 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-69413441-461a-47e0-a0a6-171120918399 tempest-ServersAaction247Test-219674733 tempest-ServersAaction247Test-219674733-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:25:47.123365 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-69413441-461a-47e0-a0a6-171120918399 tempest-ServersAaction247Test-219674733 tempest-ServersAaction247Test-219674733-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:25:47.123858 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-69413441-461a-47e0-a0a6-171120918399 tempest-ServersAaction247Test-219674733 tempest-ServersAaction247Test-219674733-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:25:47.124614 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-69413441-461a-47e0-a0a6-171120918399 tempest-ServersAaction247Test-219674733 tempest-ServersAaction247Test-219674733-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:25:47.125082 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-69413441-461a-47e0-a0a6-171120918399 tempest-ServersAaction247Test-219674733 tempest-ServersAaction247Test-219674733-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:25:47.125531 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-69413441-461a-47e0-a0a6-171120918399 tempest-ServersAaction247Test-219674733 tempest-ServersAaction247Test-219674733-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:25:47.191571 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-69413441-461a-47e0-a0a6-171120918399 tempest-ServersAaction247Test-219674733 tempest-ServersAaction247Test-219674733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5898783a6b54016a531694cb8cd9bd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8a90c9a54ef46b9833bb9ce3ba90f39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:25:47.200385 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-69413441-461a-47e0-a0a6-171120918399 tempest-ServersAaction247Test-219674733 tempest-ServersAaction247Test-219674733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5898783a6b54016a531694cb8cd9bd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8a90c9a54ef46b9833bb9ce3ba90f39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:25:47.201845 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-69413441-461a-47e0-a0a6-171120918399 tempest-ServersAaction247Test-219674733 tempest-ServersAaction247Test-219674733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5898783a6b54016a531694cb8cd9bd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8a90c9a54ef46b9833bb9ce3ba90f39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:25:47.203267 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-69413441-461a-47e0-a0a6-171120918399 tempest-ServersAaction247Test-219674733 tempest-ServersAaction247Test-219674733-project] 10.222.0.18 "GET /compute/v2.1/servers/a85afe84-3861-4939-9aeb-5b1184e3e9f8" status: 200 len: 1366 microversion: 2.47 time: 0.092946 Oct 22 21:25:47.203881 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2879/5734] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:25:47 2022] GET /compute/v2.1/servers/a85afe84-3861-4939-9aeb-5b1184e3e9f8 => generated 1366 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 21:25:48.229104 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-6cae216c-ea58-4e0f-99e0-f8f1dd3a58ee tempest-ServersAaction247Test-219674733 tempest-ServersAaction247Test-219674733-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:25:48.229674 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-6cae216c-ea58-4e0f-99e0-f8f1dd3a58ee tempest-ServersAaction247Test-219674733 tempest-ServersAaction247Test-219674733-project] [instance: a85afe84-3861-4939-9aeb-5b1184e3e9f8] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:25:48.237361 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6cae216c-ea58-4e0f-99e0-f8f1dd3a58ee tempest-ServersAaction247Test-219674733 tempest-ServersAaction247Test-219674733-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:25:48.237859 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6cae216c-ea58-4e0f-99e0-f8f1dd3a58ee tempest-ServersAaction247Test-219674733 tempest-ServersAaction247Test-219674733-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:25:48.238304 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6cae216c-ea58-4e0f-99e0-f8f1dd3a58ee tempest-ServersAaction247Test-219674733 tempest-ServersAaction247Test-219674733-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:25:48.239010 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6cae216c-ea58-4e0f-99e0-f8f1dd3a58ee tempest-ServersAaction247Test-219674733 tempest-ServersAaction247Test-219674733-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:25:48.239505 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6cae216c-ea58-4e0f-99e0-f8f1dd3a58ee tempest-ServersAaction247Test-219674733 tempest-ServersAaction247Test-219674733-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:25:48.239938 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6cae216c-ea58-4e0f-99e0-f8f1dd3a58ee tempest-ServersAaction247Test-219674733 tempest-ServersAaction247Test-219674733-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:25:48.255008 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-6cae216c-ea58-4e0f-99e0-f8f1dd3a58ee tempest-ServersAaction247Test-219674733 tempest-ServersAaction247Test-219674733-project] HTTP exception thrown: Instance a85afe84-3861-4939-9aeb-5b1184e3e9f8 could not be found. Oct 22 21:25:48.256707 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-6cae216c-ea58-4e0f-99e0-f8f1dd3a58ee tempest-ServersAaction247Test-219674733 tempest-ServersAaction247Test-219674733-project] Request method failure captured: Oct 22 21:25:48.256707 ncdv-master-1 devstack@n-api.service[138744]: request: GET /compute/v2.1/servers/a85afe84-3861-4939-9aeb-5b1184e3e9f8 HTTP/1.1 Oct 22 21:25:48.256707 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 21:25:48.256707 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 21:25:48.256707 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 21:25:48.256707 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 0 Oct 22 21:25:48.256707 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 21:25:48.256707 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 21:25:48.256707 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 21:25:48.256707 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 21:25:48.256707 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVF_TUI8ocjxolW2TdcIY1egcNBgilhMAz3JR9iVA7X7gw2RN6Gs5tgPNs0jLgVcvRd-jQzo59WmjyXPGjUj165RxYIdble8ryEQsQjifclFliQAPCCT4eiqjKkNHaoyrikz6uj0SKm7EBhBL562K5fG7EOqpT--Yy6Z2IfZcCryh8aE Oct 22 21:25:48.256707 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 21:25:48.256707 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 21:25:48.256707 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 21:25:48.256707 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 21:25:48.256707 ncdv-master-1 devstack@n-api.service[138744]: X-Openstack-Nova-Api-Version: 2.47 Oct 22 21:25:48.256707 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 21:25:48.256707 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 21:25:48.256707 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: f8a90c9a54ef46b9833bb9ce3ba90f39 Oct 22 21:25:48.256707 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-ServersAaction247Test-219674733 Oct 22 21:25:48.256707 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 21:25:48.256707 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 21:25:48.256707 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_f8a90c9a54ef46b9833bb9ce3ba90f39"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f8a90c9a54ef46b9833bb9ce3ba90f39"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/f8a90c9a54ef46b9833bb9ce3ba90f39"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f8a90c9a54ef46b9833bb9ce3ba90f39"}]}] Oct 22 21:25:48.256707 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-ServersAaction247Test-219674733 Oct 22 21:25:48.256707 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: f8a90c9a54ef46b9833bb9ce3ba90f39 Oct 22 21:25:48.256707 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-ServersAaction247Test-219674733 Oct 22 21:25:48.256707 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-ServersAaction247Test-219674733-project Oct 22 21:25:48.256707 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 21:25:48.256707 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 21:25:48.256707 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: b5898783a6b54016a531694cb8cd9bd4 Oct 22 21:25:48.256707 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-ServersAaction247Test-219674733-project Oct 22 21:25:48.256707 ncdv-master-1 devstack@n-api.service[138744]: method: > Oct 22 21:25:48.256707 ncdv-master-1 devstack@n-api.service[138744]: exception: Instance a85afe84-3861-4939-9aeb-5b1184e3e9f8 could not be found. Oct 22 21:25:48.256707 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': 'a85afe84-3861-4939-9aeb-5b1184e3e9f8'} Oct 22 21:25:48.256707 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:25:48.256707 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:25:48.256707 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 21:25:48.256707 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 21:25:48.256707 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 21:25:48.256707 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 21:25:48.256707 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 21:25:48.256707 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 21:25:48.256707 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 21:25:48.256707 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 21:25:48.256707 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a85afe84-3861-4939-9aeb-5b1184e3e9f8 could not be found. Oct 22 21:25:48.256707 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:25:48.256707 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:25:48.256707 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:25:48.256707 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:25:48.256707 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:25:48.256707 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:25:48.256707 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:25:48.256707 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:25:48.256707 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:25:48.256707 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:25:48.256707 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 21:25:48.256707 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 21:25:48.256707 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 21:25:48.256707 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 21:25:48.256707 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 21:25:48.256707 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:25:48.256707 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a85afe84-3861-4939-9aeb-5b1184e3e9f8 could not be found. Oct 22 21:25:48.256707 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:25:48.256707 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:25:48.256707 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:25:48.261228 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:25:48.261228 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:25:48.261228 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:25:48.261228 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:25:48.261228 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:25:48.261228 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a85afe84-3861-4939-9aeb-5b1184e3e9f8 could not be found. Oct 22 21:25:48.261228 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:25:48.261228 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-6cae216c-ea58-4e0f-99e0-f8f1dd3a58ee tempest-ServersAaction247Test-219674733 tempest-ServersAaction247Test-219674733-project] Returning 404 to user: Instance a85afe84-3861-4939-9aeb-5b1184e3e9f8 could not be found. {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:25:48.261228 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-6cae216c-ea58-4e0f-99e0-f8f1dd3a58ee tempest-ServersAaction247Test-219674733 tempest-ServersAaction247Test-219674733-project] 10.222.0.18 "GET /compute/v2.1/servers/a85afe84-3861-4939-9aeb-5b1184e3e9f8" status: 404 len: 111 microversion: 2.47 time: 0.033598 Oct 22 21:25:48.261228 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2856/5735] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Oct 22 21:25:48 2022] GET /compute/v2.1/servers/a85afe84-3861-4939-9aeb-5b1184e3e9f8 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 22 21:25:53.955080 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell0:SELECT=2 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:25:53.956403 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell0:SELECT=6 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:25:54.096645 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-d1692986-5054-4bf5-9aee-6b245de5fe2b tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Action: 'create', calling method: .version_select at 0x7fd39ef6faf0>, body: {"keypair": {"name": "tempest-keypair-1776102286", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFc3Atp1DomcGyjGIdTpkNBsY3EWwtvLhct3FcnPn3ZbnYipPGYB7JLImWKrMDACKEzYiZINiCsQ3/V85B2ZyBPayszplozihCKyBLW7VXI0tltZZeMSXFmwI8F4b7cADw=="}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:25:54.115311 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-d1692986-5054-4bf5-9aee-6b245de5fe2b tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Getting quotas for project 435c26b86be44362be1bd042a5cb4c1f. Resources: {'key_pairs'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 21:25:54.122460 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-d1692986-5054-4bf5-9aee-6b245de5fe2b tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Getting quotas for user 8e102b243ece4d66bf042337324b04b0 and project 435c26b86be44362be1bd042a5cb4c1f. Resources: {'key_pairs'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 21:25:54.157047 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-d1692986-5054-4bf5-9aee-6b245de5fe2b tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.207849 Oct 22 21:25:54.158007 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2880/5736] 10.222.0.18 () {60 vars in 1159 bytes} [Sat Oct 22 21:25:53 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 21:25:55.494470 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-987c5d90-8917-4a18-bf9e-b49d4d7f2374 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-766333449", "imageRef": "085e4478-6edc-4a69-8e08-f9831713eb65", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "198587bc-1a83-4ec0-b59a-75cdfe081c8b"}], "security_groups": [{"name": "tempest-securitygroup--1810315060"}], "key_name": "tempest-keypair-1776102286", "user_data": "}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:25:55.503974 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell0:SELECT=2 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:25:55.605260 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.network.neutron [None req-987c5d90-8917-4a18-bf9e-b49d4d7f2374 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] validate_networks() for [('198587bc-1a83-4ec0-b59a-75cdfe081c8b', None, None, None, None, None)] {{(pid=138744) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 21:25:56.052170 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-987c5d90-8917-4a18-bf9e-b49d4d7f2374 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Flavor limits 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 21:25:56.052855 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-987c5d90-8917-4a18-bf9e-b49d4d7f2374 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Image limits 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 21:25:56.053337 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-987c5d90-8917-4a18-bf9e-b49d4d7f2374 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Flavor pref 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 21:25:56.053949 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-987c5d90-8917-4a18-bf9e-b49d4d7f2374 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Image pref 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 21:25:56.054369 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-987c5d90-8917-4a18-bf9e-b49d4d7f2374 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 21:25:56.063835 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-987c5d90-8917-4a18-bf9e-b49d4d7f2374 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:25:56.064300 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-987c5d90-8917-4a18-bf9e-b49d4d7f2374 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:25:56.064771 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-987c5d90-8917-4a18-bf9e-b49d4d7f2374 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:25:56.065504 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-987c5d90-8917-4a18-bf9e-b49d4d7f2374 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:25:56.065963 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-987c5d90-8917-4a18-bf9e-b49d4d7f2374 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:25:56.066384 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-987c5d90-8917-4a18-bf9e-b49d4d7f2374 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:25:56.084042 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-987c5d90-8917-4a18-bf9e-b49d4d7f2374 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Getting quotas for project 435c26b86be44362be1bd042a5cb4c1f. Resources: {'cores', 'instances', 'ram'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 21:25:56.089554 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-987c5d90-8917-4a18-bf9e-b49d4d7f2374 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Getting quotas for user 8e102b243ece4d66bf042337324b04b0 and project 435c26b86be44362be1bd042a5cb4c1f. Resources: {'cores', 'instances', 'ram'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 21:25:56.103288 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-987c5d90-8917-4a18-bf9e-b49d4d7f2374 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Going to run 1 instances... {{(pid=138744) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 21:25:56.105472 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-987c5d90-8917-4a18-bf9e-b49d4d7f2374 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] [instance: 5454c3bf-7239-4b6f-b542-0d6a8df40222] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='085e4478-6edc-4a69-8e08-f9831713eb65',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138744) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 21:25:56.161568 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-987c5d90-8917-4a18-bf9e-b49d4d7f2374 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.671555 Oct 22 21:25:56.162513 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2857/5737] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Oct 22 21:25:55 2022] POST /compute/v2.1/servers => generated 402 bytes in 673 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 21:25:56.176201 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-848eda5c-54ed-4f6d-81a2-bcb82564fb70 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:25:56.176839 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-848eda5c-54ed-4f6d-81a2-bcb82564fb70 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] [instance: 5454c3bf-7239-4b6f-b542-0d6a8df40222] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:25:56.234084 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-848eda5c-54ed-4f6d-81a2-bcb82564fb70 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e102b243ece4d66bf042337324b04b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435c26b86be44362be1bd042a5cb4c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:25:56.241695 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-848eda5c-54ed-4f6d-81a2-bcb82564fb70 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] 10.222.0.18 "GET /compute/v2.1/servers/5454c3bf-7239-4b6f-b542-0d6a8df40222" status: 200 len: 1241 microversion: 2.1 time: 0.070498 Oct 22 21:25:56.247402 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2881/5738] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:25:56 2022] GET /compute/v2.1/servers/5454c3bf-7239-4b6f-b542-0d6a8df40222 => generated 1241 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:25:57.266557 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-e61c6c13-30b4-406d-ac8f-85acd8458e0c tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:25:57.267361 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-e61c6c13-30b4-406d-ac8f-85acd8458e0c tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] [instance: 5454c3bf-7239-4b6f-b542-0d6a8df40222] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:25:57.275004 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e61c6c13-30b4-406d-ac8f-85acd8458e0c tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:25:57.275707 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e61c6c13-30b4-406d-ac8f-85acd8458e0c tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:25:57.276239 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e61c6c13-30b4-406d-ac8f-85acd8458e0c tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:25:57.277097 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e61c6c13-30b4-406d-ac8f-85acd8458e0c tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:25:57.277615 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e61c6c13-30b4-406d-ac8f-85acd8458e0c tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:25:57.278158 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e61c6c13-30b4-406d-ac8f-85acd8458e0c tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:25:57.362589 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-e61c6c13-30b4-406d-ac8f-85acd8458e0c tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e102b243ece4d66bf042337324b04b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435c26b86be44362be1bd042a5cb4c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:25:57.377646 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-e61c6c13-30b4-406d-ac8f-85acd8458e0c tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] 10.222.0.18 "GET /compute/v2.1/servers/5454c3bf-7239-4b6f-b542-0d6a8df40222" status: 200 len: 1293 microversion: 2.1 time: 0.115835 Oct 22 21:25:57.378225 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2858/5739] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:25:57 2022] GET /compute/v2.1/servers/5454c3bf-7239-4b6f-b542-0d6a8df40222 => generated 1293 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:25:58.402486 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-f90b26a3-9570-4a05-98f8-bebece484529 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:25:58.403355 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-f90b26a3-9570-4a05-98f8-bebece484529 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] [instance: 5454c3bf-7239-4b6f-b542-0d6a8df40222] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:25:58.407258 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:25:58.412146 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f90b26a3-9570-4a05-98f8-bebece484529 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:25:58.414225 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f90b26a3-9570-4a05-98f8-bebece484529 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:25:58.414700 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f90b26a3-9570-4a05-98f8-bebece484529 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:25:58.415969 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f90b26a3-9570-4a05-98f8-bebece484529 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:25:58.416446 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f90b26a3-9570-4a05-98f8-bebece484529 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:25:58.416913 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f90b26a3-9570-4a05-98f8-bebece484529 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:25:58.620469 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-f90b26a3-9570-4a05-98f8-bebece484529 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e102b243ece4d66bf042337324b04b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435c26b86be44362be1bd042a5cb4c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:25:58.628997 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-f90b26a3-9570-4a05-98f8-bebece484529 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] 10.222.0.18 "GET /compute/v2.1/servers/5454c3bf-7239-4b6f-b542-0d6a8df40222" status: 200 len: 1367 microversion: 2.1 time: 0.230641 Oct 22 21:25:58.629588 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2882/5740] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:25:58 2022] GET /compute/v2.1/servers/5454c3bf-7239-4b6f-b542-0d6a8df40222 => generated 1367 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:25:58.923313 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-40b536a8-2eb1-4eb8-8cb3-f23ab7b3c1a2 req-e22c1944-5d02-461b-b30d-a728fd98ed4f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5454c3bf-7239-4b6f-b542-0d6a8df40222", "tag": "00632b98-a2d8-4c3f-a4fb-7873273c0933"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:25:58.934889 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-40b536a8-2eb1-4eb8-8cb3-f23ab7b3c1a2 req-e22c1944-5d02-461b-b30d-a728fd98ed4f service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:25:58.935401 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-40b536a8-2eb1-4eb8-8cb3-f23ab7b3c1a2 req-e22c1944-5d02-461b-b30d-a728fd98ed4f service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:25:58.935947 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-40b536a8-2eb1-4eb8-8cb3-f23ab7b3c1a2 req-e22c1944-5d02-461b-b30d-a728fd98ed4f service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:25:58.947839 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-40b536a8-2eb1-4eb8-8cb3-f23ab7b3c1a2 req-e22c1944-5d02-461b-b30d-a728fd98ed4f service nova] Creating event network-changed:00632b98-a2d8-4c3f-a4fb-7873273c0933 for instance 5454c3bf-7239-4b6f-b542-0d6a8df40222 on nch2-master-1 Oct 22 21:25:58.952883 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-40b536a8-2eb1-4eb8-8cb3-f23ab7b3c1a2 req-e22c1944-5d02-461b-b30d-a728fd98ed4f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034048 Oct 22 21:25:58.953497 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2859/5741] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:25:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:25:59.654266 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-07dd9331-3fc2-4140-985e-1a62652f7435 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:25:59.655002 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-07dd9331-3fc2-4140-985e-1a62652f7435 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] [instance: 5454c3bf-7239-4b6f-b542-0d6a8df40222] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:25:59.663848 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-07dd9331-3fc2-4140-985e-1a62652f7435 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:25:59.664441 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-07dd9331-3fc2-4140-985e-1a62652f7435 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:25:59.664975 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-07dd9331-3fc2-4140-985e-1a62652f7435 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:25:59.665840 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-07dd9331-3fc2-4140-985e-1a62652f7435 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:25:59.666309 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-07dd9331-3fc2-4140-985e-1a62652f7435 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:25:59.666772 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-07dd9331-3fc2-4140-985e-1a62652f7435 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:25:59.814886 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-07dd9331-3fc2-4140-985e-1a62652f7435 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e102b243ece4d66bf042337324b04b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435c26b86be44362be1bd042a5cb4c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:25:59.823470 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-07dd9331-3fc2-4140-985e-1a62652f7435 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] 10.222.0.18 "GET /compute/v2.1/servers/5454c3bf-7239-4b6f-b542-0d6a8df40222" status: 200 len: 1367 microversion: 2.1 time: 0.173914 Oct 22 21:25:59.824027 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2883/5742] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:25:59 2022] GET /compute/v2.1/servers/5454c3bf-7239-4b6f-b542-0d6a8df40222 => generated 1367 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:26:00.848505 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-37a4c6ef-0bcf-4181-bed8-ce73b7c90e74 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:26:00.849215 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-37a4c6ef-0bcf-4181-bed8-ce73b7c90e74 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] [instance: 5454c3bf-7239-4b6f-b542-0d6a8df40222] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:26:00.856480 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-37a4c6ef-0bcf-4181-bed8-ce73b7c90e74 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:26:00.856989 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-37a4c6ef-0bcf-4181-bed8-ce73b7c90e74 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:26:00.857436 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-37a4c6ef-0bcf-4181-bed8-ce73b7c90e74 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:26:00.858149 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-37a4c6ef-0bcf-4181-bed8-ce73b7c90e74 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:26:00.858607 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-37a4c6ef-0bcf-4181-bed8-ce73b7c90e74 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:26:00.859044 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-37a4c6ef-0bcf-4181-bed8-ce73b7c90e74 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:26:00.863438 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:26:00.992170 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-37a4c6ef-0bcf-4181-bed8-ce73b7c90e74 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e102b243ece4d66bf042337324b04b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435c26b86be44362be1bd042a5cb4c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:26:01.000439 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-37a4c6ef-0bcf-4181-bed8-ce73b7c90e74 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] 10.222.0.18 "GET /compute/v2.1/servers/5454c3bf-7239-4b6f-b542-0d6a8df40222" status: 200 len: 1367 microversion: 2.1 time: 0.157293 Oct 22 21:26:01.000969 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2860/5743] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:26:00 2022] GET /compute/v2.1/servers/5454c3bf-7239-4b6f-b542-0d6a8df40222 => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:26:02.023689 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-8ad7876e-412c-4eab-a7b0-5e4e4a486cad tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:26:02.024315 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-8ad7876e-412c-4eab-a7b0-5e4e4a486cad tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] [instance: 5454c3bf-7239-4b6f-b542-0d6a8df40222] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:26:02.032132 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8ad7876e-412c-4eab-a7b0-5e4e4a486cad tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:26:02.032633 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8ad7876e-412c-4eab-a7b0-5e4e4a486cad tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:26:02.033082 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8ad7876e-412c-4eab-a7b0-5e4e4a486cad tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:26:02.033798 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8ad7876e-412c-4eab-a7b0-5e4e4a486cad tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:26:02.034264 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8ad7876e-412c-4eab-a7b0-5e4e4a486cad tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:26:02.034707 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8ad7876e-412c-4eab-a7b0-5e4e4a486cad tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:26:02.165880 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-8ad7876e-412c-4eab-a7b0-5e4e4a486cad tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e102b243ece4d66bf042337324b04b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435c26b86be44362be1bd042a5cb4c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:26:02.173888 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-8ad7876e-412c-4eab-a7b0-5e4e4a486cad tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] 10.222.0.18 "GET /compute/v2.1/servers/5454c3bf-7239-4b6f-b542-0d6a8df40222" status: 200 len: 1367 microversion: 2.1 time: 0.154270 Oct 22 21:26:02.174393 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2884/5744] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:26:02 2022] GET /compute/v2.1/servers/5454c3bf-7239-4b6f-b542-0d6a8df40222 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:26:03.201693 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-8d3d0f93-4d1b-4ee5-aa0e-453fbfa70ace tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:26:03.202695 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-8d3d0f93-4d1b-4ee5-aa0e-453fbfa70ace tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] [instance: 5454c3bf-7239-4b6f-b542-0d6a8df40222] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:26:03.213832 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8d3d0f93-4d1b-4ee5-aa0e-453fbfa70ace tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:26:03.214335 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8d3d0f93-4d1b-4ee5-aa0e-453fbfa70ace tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:26:03.214783 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8d3d0f93-4d1b-4ee5-aa0e-453fbfa70ace tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:26:03.215667 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8d3d0f93-4d1b-4ee5-aa0e-453fbfa70ace tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:26:03.216141 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8d3d0f93-4d1b-4ee5-aa0e-453fbfa70ace tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:26:03.216574 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8d3d0f93-4d1b-4ee5-aa0e-453fbfa70ace tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:26:03.361579 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-8d3d0f93-4d1b-4ee5-aa0e-453fbfa70ace tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e102b243ece4d66bf042337324b04b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435c26b86be44362be1bd042a5cb4c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:26:03.370094 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-8d3d0f93-4d1b-4ee5-aa0e-453fbfa70ace tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] 10.222.0.18 "GET /compute/v2.1/servers/5454c3bf-7239-4b6f-b542-0d6a8df40222" status: 200 len: 1367 microversion: 2.1 time: 0.175234 Oct 22 21:26:03.370647 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2861/5745] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:26:03 2022] GET /compute/v2.1/servers/5454c3bf-7239-4b6f-b542-0d6a8df40222 => generated 1367 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:26:04.071615 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-16c91c18-2d8b-4617-b310-175b94d2bb5e req-961d31c5-3c14-4289-aac4-a4661ae4651c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5454c3bf-7239-4b6f-b542-0d6a8df40222", "name": "network-vif-plugged", "status": "completed", "tag": "00632b98-a2d8-4c3f-a4fb-7873273c0933"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:26:04.081973 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-16c91c18-2d8b-4617-b310-175b94d2bb5e req-961d31c5-3c14-4289-aac4-a4661ae4651c service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:26:04.082464 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-16c91c18-2d8b-4617-b310-175b94d2bb5e req-961d31c5-3c14-4289-aac4-a4661ae4651c service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:26:04.082911 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-16c91c18-2d8b-4617-b310-175b94d2bb5e req-961d31c5-3c14-4289-aac4-a4661ae4651c service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:26:04.094150 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-16c91c18-2d8b-4617-b310-175b94d2bb5e req-961d31c5-3c14-4289-aac4-a4661ae4651c service nova] Creating event network-vif-plugged:00632b98-a2d8-4c3f-a4fb-7873273c0933 for instance 5454c3bf-7239-4b6f-b542-0d6a8df40222 on nch2-master-1 Oct 22 21:26:04.099299 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-16c91c18-2d8b-4617-b310-175b94d2bb5e req-961d31c5-3c14-4289-aac4-a4661ae4651c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100828 Oct 22 21:26:04.100462 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2885/5746] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:26:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:26:04.394410 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-2c20aed4-ba95-48f3-adb3-0ddcc0df7d40 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:26:04.395013 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-2c20aed4-ba95-48f3-adb3-0ddcc0df7d40 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] [instance: 5454c3bf-7239-4b6f-b542-0d6a8df40222] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:26:04.402896 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2c20aed4-ba95-48f3-adb3-0ddcc0df7d40 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:26:04.403424 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2c20aed4-ba95-48f3-adb3-0ddcc0df7d40 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:26:04.403870 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2c20aed4-ba95-48f3-adb3-0ddcc0df7d40 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:26:04.404574 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2c20aed4-ba95-48f3-adb3-0ddcc0df7d40 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:26:04.405043 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2c20aed4-ba95-48f3-adb3-0ddcc0df7d40 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:26:04.405477 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2c20aed4-ba95-48f3-adb3-0ddcc0df7d40 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:26:04.549736 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-2c20aed4-ba95-48f3-adb3-0ddcc0df7d40 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e102b243ece4d66bf042337324b04b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435c26b86be44362be1bd042a5cb4c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:26:04.558111 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-2c20aed4-ba95-48f3-adb3-0ddcc0df7d40 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] 10.222.0.18 "GET /compute/v2.1/servers/5454c3bf-7239-4b6f-b542-0d6a8df40222" status: 200 len: 1367 microversion: 2.1 time: 0.167925 Oct 22 21:26:04.558696 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2862/5747] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:26:04 2022] GET /compute/v2.1/servers/5454c3bf-7239-4b6f-b542-0d6a8df40222 => generated 1367 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:26:05.591206 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-e7094d52-71b7-4a70-8691-02a8ac290b6e tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:26:05.591961 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-e7094d52-71b7-4a70-8691-02a8ac290b6e tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] [instance: 5454c3bf-7239-4b6f-b542-0d6a8df40222] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:26:05.600534 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e7094d52-71b7-4a70-8691-02a8ac290b6e tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:26:05.601039 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e7094d52-71b7-4a70-8691-02a8ac290b6e tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:26:05.601493 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e7094d52-71b7-4a70-8691-02a8ac290b6e tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:26:05.602224 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e7094d52-71b7-4a70-8691-02a8ac290b6e tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:26:05.602729 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e7094d52-71b7-4a70-8691-02a8ac290b6e tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:26:05.603155 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e7094d52-71b7-4a70-8691-02a8ac290b6e tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:26:05.740432 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-e7094d52-71b7-4a70-8691-02a8ac290b6e tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e102b243ece4d66bf042337324b04b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435c26b86be44362be1bd042a5cb4c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:26:05.748871 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-e7094d52-71b7-4a70-8691-02a8ac290b6e tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] 10.222.0.18 "GET /compute/v2.1/servers/5454c3bf-7239-4b6f-b542-0d6a8df40222" status: 200 len: 1557 microversion: 2.1 time: 0.162144 Oct 22 21:26:05.749448 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2886/5748] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:26:05 2022] GET /compute/v2.1/servers/5454c3bf-7239-4b6f-b542-0d6a8df40222 => generated 1557 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:26:05.771375 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-f4d2e17e-9be1-48b9-8d27-273a816c36e7 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:26:05.771904 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-f4d2e17e-9be1-48b9-8d27-273a816c36e7 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] [instance: 5454c3bf-7239-4b6f-b542-0d6a8df40222] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:26:05.778984 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f4d2e17e-9be1-48b9-8d27-273a816c36e7 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:26:05.779508 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f4d2e17e-9be1-48b9-8d27-273a816c36e7 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:26:05.779954 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f4d2e17e-9be1-48b9-8d27-273a816c36e7 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:26:05.780656 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f4d2e17e-9be1-48b9-8d27-273a816c36e7 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:26:05.781116 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f4d2e17e-9be1-48b9-8d27-273a816c36e7 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:26:05.781546 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f4d2e17e-9be1-48b9-8d27-273a816c36e7 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:26:05.865014 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-f4d2e17e-9be1-48b9-8d27-273a816c36e7 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] 10.222.0.18 "GET /compute/v2.1/servers/5454c3bf-7239-4b6f-b542-0d6a8df40222/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.097491 Oct 22 21:26:05.865657 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2863/5749] 10.222.0.18 () {58 vars in 1275 bytes} [Sat Oct 22 21:26:05 2022] GET /compute/v2.1/servers/5454c3bf-7239-4b6f-b542-0d6a8df40222/os-interface => generated 284 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:26:07.188083 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-f694c0cd-8667-4ac2-a366-0bc39edc9eae req-121da00b-0fde-40d8-b675-88ac4f3daf58 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5454c3bf-7239-4b6f-b542-0d6a8df40222", "tag": "00632b98-a2d8-4c3f-a4fb-7873273c0933"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:26:07.193431 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell0:SELECT=6 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:26:07.201007 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-f694c0cd-8667-4ac2-a366-0bc39edc9eae req-121da00b-0fde-40d8-b675-88ac4f3daf58 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:26:07.201500 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-f694c0cd-8667-4ac2-a366-0bc39edc9eae req-121da00b-0fde-40d8-b675-88ac4f3daf58 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:26:07.201945 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-f694c0cd-8667-4ac2-a366-0bc39edc9eae req-121da00b-0fde-40d8-b675-88ac4f3daf58 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:26:07.215793 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-f694c0cd-8667-4ac2-a366-0bc39edc9eae req-121da00b-0fde-40d8-b675-88ac4f3daf58 service nova] Creating event network-changed:00632b98-a2d8-4c3f-a4fb-7873273c0933 for instance 5454c3bf-7239-4b6f-b542-0d6a8df40222 on nch2-master-1 Oct 22 21:26:07.220965 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-f694c0cd-8667-4ac2-a366-0bc39edc9eae req-121da00b-0fde-40d8-b675-88ac4f3daf58 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036669 Oct 22 21:26:07.221587 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2887/5750] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:26:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:26:43.090626 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell0:SELECT=2 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:26:43.092269 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell0:SELECT=6 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:26:43.095325 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:26:43.096399 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:SELECT=21 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:26:43.103252 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-fb87732c-7cdc-4498-aa0d-b22216bf7a02 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:26:43.104117 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-fb87732c-7cdc-4498-aa0d-b22216bf7a02 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] [instance: 5454c3bf-7239-4b6f-b542-0d6a8df40222] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:26:43.114001 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fb87732c-7cdc-4498-aa0d-b22216bf7a02 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:26:43.114520 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fb87732c-7cdc-4498-aa0d-b22216bf7a02 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:26:43.115105 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fb87732c-7cdc-4498-aa0d-b22216bf7a02 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:26:43.115733 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fb87732c-7cdc-4498-aa0d-b22216bf7a02 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:26:43.116195 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fb87732c-7cdc-4498-aa0d-b22216bf7a02 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:26:43.116652 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fb87732c-7cdc-4498-aa0d-b22216bf7a02 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:26:43.141743 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-fb87732c-7cdc-4498-aa0d-b22216bf7a02 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] 10.222.0.18 "GET /compute/v2.1/servers/5454c3bf-7239-4b6f-b542-0d6a8df40222/ips" status: 200 len: 149 microversion: 2.1 time: 0.052489 Oct 22 21:26:43.142313 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2864/5751] 10.222.0.18 () {58 vars in 1248 bytes} [Sat Oct 22 21:26:43 2022] GET /compute/v2.1/servers/5454c3bf-7239-4b6f-b542-0d6a8df40222/ips => generated 149 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:26:44.534406 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-45b2a525-061d-4acb-af60-fcbaa577c028 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "59e7c6e3-0443-462a-9aa6-f22804ff91a8"}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:26:44.536920 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-45b2a525-061d-4acb-af60-fcbaa577c028 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] [instance: 5454c3bf-7239-4b6f-b542-0d6a8df40222] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:26:44.539134 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=1 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:26:44.539860 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell1:SELECT=28 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:26:44.546697 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-45b2a525-061d-4acb-af60-fcbaa577c028 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:26:44.547245 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-45b2a525-061d-4acb-af60-fcbaa577c028 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:26:44.547728 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-45b2a525-061d-4acb-af60-fcbaa577c028 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:26:44.548479 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-45b2a525-061d-4acb-af60-fcbaa577c028 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:26:44.548964 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-45b2a525-061d-4acb-af60-fcbaa577c028 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:26:44.549377 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-45b2a525-061d-4acb-af60-fcbaa577c028 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:26:44.816543 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-45b2a525-061d-4acb-af60-fcbaa577c028 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] 10.222.0.18 "POST /compute/v2.1/servers/5454c3bf-7239-4b6f-b542-0d6a8df40222/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.286717 Oct 22 21:26:44.817182 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2888/5752] 10.222.0.18 () {60 vars in 1323 bytes} [Sat Oct 22 21:26:44 2022] POST /compute/v2.1/servers/5454c3bf-7239-4b6f-b542-0d6a8df40222/os-volume_attachments => generated 194 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:26:48.146664 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-bc2f740a-a3fd-47ae-8cb9-1cf36156ed20 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Action: 'create', calling method: .version_select at 0x7fd39eadfee0>, body: {"keypair": {"name": "tempest-keypair-383296525", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLY0mVBO9BmL+QEeo9PiEGrhDZLRNDN07AsLwK8NqsKay59STIM4yk2l6e4Gcy4qtaIBOS+q3w2uAxTfZDXPoLJB1UTBBn1Cub6DQaxAfwKrf8U3Nwf+/rO9bMcPJkRQww=="}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:26:48.163843 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-bc2f740a-a3fd-47ae-8cb9-1cf36156ed20 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Getting quotas for project 435c26b86be44362be1bd042a5cb4c1f. Resources: {'key_pairs'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 21:26:48.169848 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-bc2f740a-a3fd-47ae-8cb9-1cf36156ed20 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Getting quotas for user 8e102b243ece4d66bf042337324b04b0 and project 435c26b86be44362be1bd042a5cb4c1f. Resources: {'key_pairs'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 21:26:48.197752 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-bc2f740a-a3fd-47ae-8cb9-1cf36156ed20 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.055050 Oct 22 21:26:48.198346 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2865/5753] 10.222.0.18 () {60 vars in 1159 bytes} [Sat Oct 22 21:26:48 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 21:26:49.480062 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-867d7cc0-f4cd-4b8f-a656-cb3a87479eaf tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1705468526", "imageRef": "085e4478-6edc-4a69-8e08-f9831713eb65", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "198587bc-1a83-4ec0-b59a-75cdfe081c8b"}], "security_groups": [{"name": "tempest-securitygroup--1455490223"}], "key_name": "tempest-keypair-383296525", "user_data": "}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:26:49.594771 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.network.neutron [None req-867d7cc0-f4cd-4b8f-a656-cb3a87479eaf tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] validate_networks() for [('198587bc-1a83-4ec0-b59a-75cdfe081c8b', None, None, None, None, None)] {{(pid=138745) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 21:26:49.971930 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-867d7cc0-f4cd-4b8f-a656-cb3a87479eaf tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Flavor limits 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 21:26:49.972383 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-867d7cc0-f4cd-4b8f-a656-cb3a87479eaf tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Image limits 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 21:26:49.972884 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-867d7cc0-f4cd-4b8f-a656-cb3a87479eaf tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Flavor pref 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 21:26:49.973351 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-867d7cc0-f4cd-4b8f-a656-cb3a87479eaf tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Image pref 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 21:26:49.973784 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-867d7cc0-f4cd-4b8f-a656-cb3a87479eaf tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 21:26:49.984243 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-867d7cc0-f4cd-4b8f-a656-cb3a87479eaf tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:26:49.984754 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-867d7cc0-f4cd-4b8f-a656-cb3a87479eaf tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:26:49.985216 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-867d7cc0-f4cd-4b8f-a656-cb3a87479eaf tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:26:49.985978 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-867d7cc0-f4cd-4b8f-a656-cb3a87479eaf tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:26:49.986462 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-867d7cc0-f4cd-4b8f-a656-cb3a87479eaf tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:26:49.986913 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-867d7cc0-f4cd-4b8f-a656-cb3a87479eaf tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:26:50.005886 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-867d7cc0-f4cd-4b8f-a656-cb3a87479eaf tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Getting quotas for project 435c26b86be44362be1bd042a5cb4c1f. Resources: {'cores', 'instances', 'ram'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 21:26:50.011695 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-867d7cc0-f4cd-4b8f-a656-cb3a87479eaf tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Getting quotas for user 8e102b243ece4d66bf042337324b04b0 and project 435c26b86be44362be1bd042a5cb4c1f. Resources: {'cores', 'instances', 'ram'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 21:26:50.024891 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-867d7cc0-f4cd-4b8f-a656-cb3a87479eaf tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Going to run 1 instances... {{(pid=138745) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 21:26:50.027362 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-867d7cc0-f4cd-4b8f-a656-cb3a87479eaf tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] [instance: 8f964e3b-227a-4946-af30-9700da302ade] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='085e4478-6edc-4a69-8e08-f9831713eb65',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138745) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 21:26:50.076887 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-867d7cc0-f4cd-4b8f-a656-cb3a87479eaf tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.602874 Oct 22 21:26:50.077569 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2889/5754] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Oct 22 21:26:49 2022] POST /compute/v2.1/servers => generated 402 bytes in 605 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 21:26:50.089702 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-ed6006b7-01a2-415e-96c5-a93b4418ca13 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:26:50.090296 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-ed6006b7-01a2-415e-96c5-a93b4418ca13 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] [instance: 8f964e3b-227a-4946-af30-9700da302ade] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:26:50.150789 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-ed6006b7-01a2-415e-96c5-a93b4418ca13 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e102b243ece4d66bf042337324b04b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435c26b86be44362be1bd042a5cb4c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:26:50.158722 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-ed6006b7-01a2-415e-96c5-a93b4418ca13 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] 10.222.0.18 "GET /compute/v2.1/servers/8f964e3b-227a-4946-af30-9700da302ade" status: 200 len: 1241 microversion: 2.1 time: 0.073755 Oct 22 21:26:50.159291 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2866/5755] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:26:50 2022] GET /compute/v2.1/servers/8f964e3b-227a-4946-af30-9700da302ade => generated 1241 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:26:51.183658 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-ed59a5e0-b679-4e79-abe8-c5e210d254c1 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:26:51.185030 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-ed59a5e0-b679-4e79-abe8-c5e210d254c1 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] [instance: 8f964e3b-227a-4946-af30-9700da302ade] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:26:51.191953 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ed59a5e0-b679-4e79-abe8-c5e210d254c1 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:26:51.192537 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ed59a5e0-b679-4e79-abe8-c5e210d254c1 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:26:51.193081 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ed59a5e0-b679-4e79-abe8-c5e210d254c1 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:26:51.193873 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ed59a5e0-b679-4e79-abe8-c5e210d254c1 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:26:51.194390 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ed59a5e0-b679-4e79-abe8-c5e210d254c1 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:26:51.195639 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ed59a5e0-b679-4e79-abe8-c5e210d254c1 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:26:51.281584 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-ed59a5e0-b679-4e79-abe8-c5e210d254c1 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e102b243ece4d66bf042337324b04b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435c26b86be44362be1bd042a5cb4c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:26:51.289906 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-ed59a5e0-b679-4e79-abe8-c5e210d254c1 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] 10.222.0.18 "GET /compute/v2.1/servers/8f964e3b-227a-4946-af30-9700da302ade" status: 200 len: 1301 microversion: 2.1 time: 0.111159 Oct 22 21:26:51.290467 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2890/5756] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:26:51 2022] GET /compute/v2.1/servers/8f964e3b-227a-4946-af30-9700da302ade => generated 1301 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:26:52.314682 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-028a2809-ce2f-43d1-a249-cd79687932ce tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:26:52.315290 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-028a2809-ce2f-43d1-a249-cd79687932ce tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] [instance: 8f964e3b-227a-4946-af30-9700da302ade] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:26:52.323092 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-028a2809-ce2f-43d1-a249-cd79687932ce tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:26:52.323621 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-028a2809-ce2f-43d1-a249-cd79687932ce tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:26:52.324061 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-028a2809-ce2f-43d1-a249-cd79687932ce tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:26:52.324762 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-028a2809-ce2f-43d1-a249-cd79687932ce tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:26:52.325217 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-028a2809-ce2f-43d1-a249-cd79687932ce tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:26:52.325644 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-028a2809-ce2f-43d1-a249-cd79687932ce tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:26:52.546642 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-028a2809-ce2f-43d1-a249-cd79687932ce tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e102b243ece4d66bf042337324b04b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435c26b86be44362be1bd042a5cb4c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:26:52.555558 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-028a2809-ce2f-43d1-a249-cd79687932ce tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] 10.222.0.18 "GET /compute/v2.1/servers/8f964e3b-227a-4946-af30-9700da302ade" status: 200 len: 1367 microversion: 2.1 time: 0.244976 Oct 22 21:26:52.556118 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2867/5757] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:26:52 2022] GET /compute/v2.1/servers/8f964e3b-227a-4946-af30-9700da302ade => generated 1367 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:26:52.695230 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-39d536c7-33f5-4393-8a23-770165e112d6 req-9c68b0b1-bfb5-437f-a530-5e884f231b24 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f964e3b-227a-4946-af30-9700da302ade", "tag": "c79333eb-014e-4fc8-9b7f-fbf2e3b78c19"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:26:52.714454 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-39d536c7-33f5-4393-8a23-770165e112d6 req-9c68b0b1-bfb5-437f-a530-5e884f231b24 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:26:52.714957 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-39d536c7-33f5-4393-8a23-770165e112d6 req-9c68b0b1-bfb5-437f-a530-5e884f231b24 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:26:52.715429 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-39d536c7-33f5-4393-8a23-770165e112d6 req-9c68b0b1-bfb5-437f-a530-5e884f231b24 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:26:52.731107 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-39d536c7-33f5-4393-8a23-770165e112d6 req-9c68b0b1-bfb5-437f-a530-5e884f231b24 service nova] Creating event network-changed:c79333eb-014e-4fc8-9b7f-fbf2e3b78c19 for instance 8f964e3b-227a-4946-af30-9700da302ade on nch1-master-1 Oct 22 21:26:52.736379 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-39d536c7-33f5-4393-8a23-770165e112d6 req-9c68b0b1-bfb5-437f-a530-5e884f231b24 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045249 Oct 22 21:26:52.736992 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2891/5758] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:26:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:26:53.582122 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-dadcf48d-9c01-4302-8b89-1bbbaa0cf726 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:26:53.582831 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-dadcf48d-9c01-4302-8b89-1bbbaa0cf726 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] [instance: 8f964e3b-227a-4946-af30-9700da302ade] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:26:53.591943 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-dadcf48d-9c01-4302-8b89-1bbbaa0cf726 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:26:53.592551 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-dadcf48d-9c01-4302-8b89-1bbbaa0cf726 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:26:53.593069 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-dadcf48d-9c01-4302-8b89-1bbbaa0cf726 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:26:53.594054 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-dadcf48d-9c01-4302-8b89-1bbbaa0cf726 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:26:53.594623 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-dadcf48d-9c01-4302-8b89-1bbbaa0cf726 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:26:53.595198 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-dadcf48d-9c01-4302-8b89-1bbbaa0cf726 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:26:54.091004 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-dadcf48d-9c01-4302-8b89-1bbbaa0cf726 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e102b243ece4d66bf042337324b04b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435c26b86be44362be1bd042a5cb4c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:26:54.099290 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-dadcf48d-9c01-4302-8b89-1bbbaa0cf726 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] 10.222.0.18 "GET /compute/v2.1/servers/8f964e3b-227a-4946-af30-9700da302ade" status: 200 len: 1367 microversion: 2.1 time: 0.522763 Oct 22 21:26:54.100252 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2868/5759] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:26:53 2022] GET /compute/v2.1/servers/8f964e3b-227a-4946-af30-9700da302ade => generated 1367 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:26:55.124815 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-94dc08e3-ef88-4d9d-964a-aa860c639dc5 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:26:55.125551 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-94dc08e3-ef88-4d9d-964a-aa860c639dc5 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] [instance: 8f964e3b-227a-4946-af30-9700da302ade] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:26:55.132625 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-94dc08e3-ef88-4d9d-964a-aa860c639dc5 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:26:55.133222 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-94dc08e3-ef88-4d9d-964a-aa860c639dc5 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:26:55.133869 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-94dc08e3-ef88-4d9d-964a-aa860c639dc5 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:26:55.134632 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-94dc08e3-ef88-4d9d-964a-aa860c639dc5 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:26:55.135112 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-94dc08e3-ef88-4d9d-964a-aa860c639dc5 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:26:55.135579 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-94dc08e3-ef88-4d9d-964a-aa860c639dc5 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:26:55.357526 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-94dc08e3-ef88-4d9d-964a-aa860c639dc5 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e102b243ece4d66bf042337324b04b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435c26b86be44362be1bd042a5cb4c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:26:55.365993 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-94dc08e3-ef88-4d9d-964a-aa860c639dc5 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] 10.222.0.18 "GET /compute/v2.1/servers/8f964e3b-227a-4946-af30-9700da302ade" status: 200 len: 1367 microversion: 2.1 time: 0.246683 Oct 22 21:26:55.366587 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2892/5760] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:26:55 2022] GET /compute/v2.1/servers/8f964e3b-227a-4946-af30-9700da302ade => generated 1367 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:26:56.393010 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-934b240d-6df3-48a7-8d5f-101759bf795f tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:26:56.393646 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-934b240d-6df3-48a7-8d5f-101759bf795f tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] [instance: 8f964e3b-227a-4946-af30-9700da302ade] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:26:56.403701 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-934b240d-6df3-48a7-8d5f-101759bf795f tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:26:56.404274 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-934b240d-6df3-48a7-8d5f-101759bf795f tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:26:56.404774 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-934b240d-6df3-48a7-8d5f-101759bf795f tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:26:56.405732 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-934b240d-6df3-48a7-8d5f-101759bf795f tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:26:56.406503 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-934b240d-6df3-48a7-8d5f-101759bf795f tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:26:56.407078 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-934b240d-6df3-48a7-8d5f-101759bf795f tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:26:56.560591 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-934b240d-6df3-48a7-8d5f-101759bf795f tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e102b243ece4d66bf042337324b04b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435c26b86be44362be1bd042a5cb4c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:26:56.569730 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-934b240d-6df3-48a7-8d5f-101759bf795f tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] 10.222.0.18 "GET /compute/v2.1/servers/8f964e3b-227a-4946-af30-9700da302ade" status: 200 len: 1367 microversion: 2.1 time: 0.182652 Oct 22 21:26:56.570296 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2869/5761] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:26:56 2022] GET /compute/v2.1/servers/8f964e3b-227a-4946-af30-9700da302ade => generated 1367 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:26:57.598006 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-83acb530-5f4f-4825-97b3-cab600fcab1c tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:26:57.598704 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-83acb530-5f4f-4825-97b3-cab600fcab1c tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] [instance: 8f964e3b-227a-4946-af30-9700da302ade] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:26:57.608072 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-83acb530-5f4f-4825-97b3-cab600fcab1c tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:26:57.608670 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-83acb530-5f4f-4825-97b3-cab600fcab1c tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:26:57.609211 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-83acb530-5f4f-4825-97b3-cab600fcab1c tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:26:57.610061 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-83acb530-5f4f-4825-97b3-cab600fcab1c tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:26:57.610704 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-83acb530-5f4f-4825-97b3-cab600fcab1c tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:26:57.611157 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-83acb530-5f4f-4825-97b3-cab600fcab1c tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:26:57.751316 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-83acb530-5f4f-4825-97b3-cab600fcab1c tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e102b243ece4d66bf042337324b04b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435c26b86be44362be1bd042a5cb4c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:26:57.761430 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-83acb530-5f4f-4825-97b3-cab600fcab1c tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] 10.222.0.18 "GET /compute/v2.1/servers/8f964e3b-227a-4946-af30-9700da302ade" status: 200 len: 1367 microversion: 2.1 time: 0.170467 Oct 22 21:26:57.762023 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2893/5762] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:26:57 2022] GET /compute/v2.1/servers/8f964e3b-227a-4946-af30-9700da302ade => generated 1367 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:26:58.788376 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-1b646fdd-084b-4650-a848-a673de11e500 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:26:58.789199 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-1b646fdd-084b-4650-a848-a673de11e500 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] [instance: 8f964e3b-227a-4946-af30-9700da302ade] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:26:58.800602 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1b646fdd-084b-4650-a848-a673de11e500 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:26:58.801101 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1b646fdd-084b-4650-a848-a673de11e500 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:26:58.801547 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1b646fdd-084b-4650-a848-a673de11e500 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:26:58.802250 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1b646fdd-084b-4650-a848-a673de11e500 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:26:58.802711 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1b646fdd-084b-4650-a848-a673de11e500 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:26:58.803148 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1b646fdd-084b-4650-a848-a673de11e500 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:26:58.946659 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-1b646fdd-084b-4650-a848-a673de11e500 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e102b243ece4d66bf042337324b04b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435c26b86be44362be1bd042a5cb4c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:26:58.954966 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-1b646fdd-084b-4650-a848-a673de11e500 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] 10.222.0.18 "GET /compute/v2.1/servers/8f964e3b-227a-4946-af30-9700da302ade" status: 200 len: 1367 microversion: 2.1 time: 0.173438 Oct 22 21:26:58.955614 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2870/5763] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:26:58 2022] GET /compute/v2.1/servers/8f964e3b-227a-4946-af30-9700da302ade => generated 1367 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:26:59.823369 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-a0979070-8b7a-4dda-bc3a-35fa38ecc998 req-58a26a72-1933-4fd3-b9cd-cd3e45fb265d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f964e3b-227a-4946-af30-9700da302ade", "name": "network-vif-plugged", "status": "completed", "tag": "c79333eb-014e-4fc8-9b7f-fbf2e3b78c19"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:26:59.834194 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-a0979070-8b7a-4dda-bc3a-35fa38ecc998 req-58a26a72-1933-4fd3-b9cd-cd3e45fb265d service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:26:59.835153 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-a0979070-8b7a-4dda-bc3a-35fa38ecc998 req-58a26a72-1933-4fd3-b9cd-cd3e45fb265d service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:26:59.835271 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-a0979070-8b7a-4dda-bc3a-35fa38ecc998 req-58a26a72-1933-4fd3-b9cd-cd3e45fb265d service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:26:59.847366 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-a0979070-8b7a-4dda-bc3a-35fa38ecc998 req-58a26a72-1933-4fd3-b9cd-cd3e45fb265d service nova] Creating event network-vif-plugged:c79333eb-014e-4fc8-9b7f-fbf2e3b78c19 for instance 8f964e3b-227a-4946-af30-9700da302ade on nch1-master-1 Oct 22 21:26:59.853230 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-a0979070-8b7a-4dda-bc3a-35fa38ecc998 req-58a26a72-1933-4fd3-b9cd-cd3e45fb265d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033664 Oct 22 21:26:59.853864 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2894/5764] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:26:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:26:59.978748 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-f59ee613-8e8c-4312-9651-a4d432625c78 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:26:59.979976 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-f59ee613-8e8c-4312-9651-a4d432625c78 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] [instance: 8f964e3b-227a-4946-af30-9700da302ade] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:26:59.987015 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f59ee613-8e8c-4312-9651-a4d432625c78 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:26:59.987578 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f59ee613-8e8c-4312-9651-a4d432625c78 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:26:59.988049 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f59ee613-8e8c-4312-9651-a4d432625c78 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:26:59.989072 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f59ee613-8e8c-4312-9651-a4d432625c78 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:26:59.989541 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f59ee613-8e8c-4312-9651-a4d432625c78 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:26:59.989995 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f59ee613-8e8c-4312-9651-a4d432625c78 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:27:00.131482 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-f59ee613-8e8c-4312-9651-a4d432625c78 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e102b243ece4d66bf042337324b04b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435c26b86be44362be1bd042a5cb4c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:27:00.143494 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-f59ee613-8e8c-4312-9651-a4d432625c78 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] 10.222.0.18 "GET /compute/v2.1/servers/8f964e3b-227a-4946-af30-9700da302ade" status: 200 len: 1367 microversion: 2.1 time: 0.168609 Oct 22 21:27:00.144349 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2871/5765] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:26:59 2022] GET /compute/v2.1/servers/8f964e3b-227a-4946-af30-9700da302ade => generated 1367 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:27:01.165308 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell0:SELECT=2 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:27:01.166110 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell0:SELECT=6 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:27:01.171925 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-ef72467a-56df-48fb-a7da-ae165a456769 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:27:01.172719 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-ef72467a-56df-48fb-a7da-ae165a456769 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] [instance: 8f964e3b-227a-4946-af30-9700da302ade] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:27:01.180682 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ef72467a-56df-48fb-a7da-ae165a456769 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:27:01.181237 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ef72467a-56df-48fb-a7da-ae165a456769 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:27:01.181738 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ef72467a-56df-48fb-a7da-ae165a456769 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:27:01.182521 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ef72467a-56df-48fb-a7da-ae165a456769 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:27:01.183040 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ef72467a-56df-48fb-a7da-ae165a456769 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:27:01.183573 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ef72467a-56df-48fb-a7da-ae165a456769 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:27:01.322431 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-ef72467a-56df-48fb-a7da-ae165a456769 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e102b243ece4d66bf042337324b04b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435c26b86be44362be1bd042a5cb4c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:27:01.330753 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-ef72467a-56df-48fb-a7da-ae165a456769 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] 10.222.0.18 "GET /compute/v2.1/servers/8f964e3b-227a-4946-af30-9700da302ade" status: 200 len: 1367 microversion: 2.1 time: 0.166707 Oct 22 21:27:01.331330 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2895/5766] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:27:01 2022] GET /compute/v2.1/servers/8f964e3b-227a-4946-af30-9700da302ade => generated 1367 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:27:02.355656 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-3994b77e-8525-4877-80ed-0a5d24423c8a tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:27:02.356294 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-3994b77e-8525-4877-80ed-0a5d24423c8a tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] [instance: 8f964e3b-227a-4946-af30-9700da302ade] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:27:02.358451 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell0:SELECT=6 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:27:02.365814 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3994b77e-8525-4877-80ed-0a5d24423c8a tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:27:02.366337 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3994b77e-8525-4877-80ed-0a5d24423c8a tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:27:02.366787 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3994b77e-8525-4877-80ed-0a5d24423c8a tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:27:02.367518 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3994b77e-8525-4877-80ed-0a5d24423c8a tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:27:02.367979 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3994b77e-8525-4877-80ed-0a5d24423c8a tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:27:02.368390 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3994b77e-8525-4877-80ed-0a5d24423c8a tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:27:02.501644 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-3994b77e-8525-4877-80ed-0a5d24423c8a tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e102b243ece4d66bf042337324b04b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435c26b86be44362be1bd042a5cb4c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:27:02.513666 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-3994b77e-8525-4877-80ed-0a5d24423c8a tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] 10.222.0.18 "GET /compute/v2.1/servers/8f964e3b-227a-4946-af30-9700da302ade" status: 200 len: 1558 microversion: 2.1 time: 0.162568 Oct 22 21:27:02.514341 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2872/5767] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:27:02 2022] GET /compute/v2.1/servers/8f964e3b-227a-4946-af30-9700da302ade => generated 1558 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:27:02.538409 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-c23a2ec2-9f1b-4b1f-aac5-130e088a53f5 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:27:02.538968 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-c23a2ec2-9f1b-4b1f-aac5-130e088a53f5 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] [instance: 8f964e3b-227a-4946-af30-9700da302ade] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:27:02.546405 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c23a2ec2-9f1b-4b1f-aac5-130e088a53f5 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:27:02.546910 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c23a2ec2-9f1b-4b1f-aac5-130e088a53f5 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:27:02.547360 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c23a2ec2-9f1b-4b1f-aac5-130e088a53f5 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:27:02.548320 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c23a2ec2-9f1b-4b1f-aac5-130e088a53f5 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:27:02.548797 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c23a2ec2-9f1b-4b1f-aac5-130e088a53f5 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:27:02.549241 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c23a2ec2-9f1b-4b1f-aac5-130e088a53f5 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:27:02.634004 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-c23a2ec2-9f1b-4b1f-aac5-130e088a53f5 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] 10.222.0.18 "GET /compute/v2.1/servers/8f964e3b-227a-4946-af30-9700da302ade/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.099475 Oct 22 21:27:02.634868 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2896/5768] 10.222.0.18 () {58 vars in 1275 bytes} [Sat Oct 22 21:27:02 2022] GET /compute/v2.1/servers/8f964e3b-227a-4946-af30-9700da302ade/os-interface => generated 285 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:27:03.593999 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-b5bbaba8-c927-4d4e-9d51-a8566781d321 req-f38a6e23-a1d6-4278-83ff-6dd229d61ee8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f964e3b-227a-4946-af30-9700da302ade", "tag": "c79333eb-014e-4fc8-9b7f-fbf2e3b78c19"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:27:03.605043 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-b5bbaba8-c927-4d4e-9d51-a8566781d321 req-f38a6e23-a1d6-4278-83ff-6dd229d61ee8 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:27:03.605523 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-b5bbaba8-c927-4d4e-9d51-a8566781d321 req-f38a6e23-a1d6-4278-83ff-6dd229d61ee8 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:27:03.605958 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-b5bbaba8-c927-4d4e-9d51-a8566781d321 req-f38a6e23-a1d6-4278-83ff-6dd229d61ee8 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:27:03.617751 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-b5bbaba8-c927-4d4e-9d51-a8566781d321 req-f38a6e23-a1d6-4278-83ff-6dd229d61ee8 service nova] Creating event network-changed:c79333eb-014e-4fc8-9b7f-fbf2e3b78c19 for instance 8f964e3b-227a-4946-af30-9700da302ade on nch1-master-1 Oct 22 21:27:03.623293 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-b5bbaba8-c927-4d4e-9d51-a8566781d321 req-f38a6e23-a1d6-4278-83ff-6dd229d61ee8 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033050 Oct 22 21:27:03.624088 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2873/5769] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:27:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:27:24.990318 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:27:24.991117 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell1:SELECT=45,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:27:25.120471 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-39f9c60b-a79c-4c5b-8ec1-ed8a95871a55 tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:27:25.120991 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-39f9c60b-a79c-4c5b-8ec1-ed8a95871a55 tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] [instance: 8dfe8aae-f5eb-4fcc-b801-7957bc9d608a] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:27:25.127303 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-39f9c60b-a79c-4c5b-8ec1-ed8a95871a55 tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:27:25.127988 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-39f9c60b-a79c-4c5b-8ec1-ed8a95871a55 tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:27:25.128598 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-39f9c60b-a79c-4c5b-8ec1-ed8a95871a55 tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:27:25.129310 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-39f9c60b-a79c-4c5b-8ec1-ed8a95871a55 tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:27:25.129812 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-39f9c60b-a79c-4c5b-8ec1-ed8a95871a55 tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:27:25.130262 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-39f9c60b-a79c-4c5b-8ec1-ed8a95871a55 tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:27:25.157448 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-39f9c60b-a79c-4c5b-8ec1-ed8a95871a55 tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] [instance: 8dfe8aae-f5eb-4fcc-b801-7957bc9d608a] Going to try to terminate instance {{(pid=138745) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 21:27:25.257170 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-39f9c60b-a79c-4c5b-8ec1-ed8a95871a55 tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] 10.222.0.18 "DELETE /compute/v2.1/servers/8dfe8aae-f5eb-4fcc-b801-7957bc9d608a" status: 204 len: 0 microversion: 2.1 time: 0.268527 Oct 22 21:27:25.257798 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2897/5770] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 21:27:24 2022] DELETE /compute/v2.1/servers/8dfe8aae-f5eb-4fcc-b801-7957bc9d608a => generated 0 bytes in 270 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 21:27:25.264348 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=1 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:27:25.265117 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:SELECT=42 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:27:25.269240 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-344b53ea-ae18-4290-a434-34d6384b9890 tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:27:25.269957 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-344b53ea-ae18-4290-a434-34d6384b9890 tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] [instance: 8dfe8aae-f5eb-4fcc-b801-7957bc9d608a] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:27:25.277518 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-344b53ea-ae18-4290-a434-34d6384b9890 tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:27:25.278008 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-344b53ea-ae18-4290-a434-34d6384b9890 tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:27:25.278449 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-344b53ea-ae18-4290-a434-34d6384b9890 tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:27:25.279152 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-344b53ea-ae18-4290-a434-34d6384b9890 tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:27:25.279657 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-344b53ea-ae18-4290-a434-34d6384b9890 tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:27:25.280089 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-344b53ea-ae18-4290-a434-34d6384b9890 tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:27:25.431264 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-344b53ea-ae18-4290-a434-34d6384b9890 tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a56d59cd5ede44edaba68a0d74e195ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc27a2de57354aa2a6d698b8b7b0094b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:27:25.439795 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-344b53ea-ae18-4290-a434-34d6384b9890 tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] 10.222.0.18 "GET /compute/v2.1/servers/8dfe8aae-f5eb-4fcc-b801-7957bc9d608a" status: 200 len: 1732 microversion: 2.1 time: 0.177414 Oct 22 21:27:25.440387 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2874/5771] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:27:25 2022] GET /compute/v2.1/servers/8dfe8aae-f5eb-4fcc-b801-7957bc9d608a => generated 1732 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:27:26.464220 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-6e1b26b9-102d-4702-87fc-b1c1f410bd9c tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:27:26.465973 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-6e1b26b9-102d-4702-87fc-b1c1f410bd9c tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] [instance: 8dfe8aae-f5eb-4fcc-b801-7957bc9d608a] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:27:26.473601 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6e1b26b9-102d-4702-87fc-b1c1f410bd9c tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:27:26.474122 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6e1b26b9-102d-4702-87fc-b1c1f410bd9c tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:27:26.474956 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6e1b26b9-102d-4702-87fc-b1c1f410bd9c tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:27:26.475722 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6e1b26b9-102d-4702-87fc-b1c1f410bd9c tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:27:26.476199 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6e1b26b9-102d-4702-87fc-b1c1f410bd9c tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:27:26.476650 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6e1b26b9-102d-4702-87fc-b1c1f410bd9c tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:27:26.545797 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-6e1b26b9-102d-4702-87fc-b1c1f410bd9c tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a56d59cd5ede44edaba68a0d74e195ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc27a2de57354aa2a6d698b8b7b0094b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:27:26.553877 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-6e1b26b9-102d-4702-87fc-b1c1f410bd9c tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] 10.222.0.18 "GET /compute/v2.1/servers/8dfe8aae-f5eb-4fcc-b801-7957bc9d608a" status: 200 len: 1664 microversion: 2.1 time: 0.095270 Oct 22 21:27:26.554572 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2898/5772] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:27:26 2022] GET /compute/v2.1/servers/8dfe8aae-f5eb-4fcc-b801-7957bc9d608a => generated 1664 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:27:26.711659 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-e1333726-8abd-4866-9460-7d496f8f811b req-41c21fe2-1646-43af-bc4c-3cb1e36ae289 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8dfe8aae-f5eb-4fcc-b801-7957bc9d608a", "name": "network-vif-deleted", "tag": "bea8849c-39df-4cf8-8128-de57a272b0dc"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:27:26.722230 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-e1333726-8abd-4866-9460-7d496f8f811b req-41c21fe2-1646-43af-bc4c-3cb1e36ae289 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:27:26.722711 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-e1333726-8abd-4866-9460-7d496f8f811b req-41c21fe2-1646-43af-bc4c-3cb1e36ae289 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:27:26.723140 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-e1333726-8abd-4866-9460-7d496f8f811b req-41c21fe2-1646-43af-bc4c-3cb1e36ae289 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:27:26.736434 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-e1333726-8abd-4866-9460-7d496f8f811b req-41c21fe2-1646-43af-bc4c-3cb1e36ae289 service nova] Creating event network-vif-deleted:bea8849c-39df-4cf8-8128-de57a272b0dc for instance 8dfe8aae-f5eb-4fcc-b801-7957bc9d608a on nch1-master-1 Oct 22 21:27:26.741525 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-e1333726-8abd-4866-9460-7d496f8f811b req-41c21fe2-1646-43af-bc4c-3cb1e36ae289 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033525 Oct 22 21:27:26.742434 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2875/5773] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:27:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:27:27.578591 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-c3ddbea4-0029-481e-a6b6-a384c5b96194 tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:27:27.579250 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-c3ddbea4-0029-481e-a6b6-a384c5b96194 tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] [instance: 8dfe8aae-f5eb-4fcc-b801-7957bc9d608a] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:27:27.586888 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c3ddbea4-0029-481e-a6b6-a384c5b96194 tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:27:27.587395 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c3ddbea4-0029-481e-a6b6-a384c5b96194 tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:27:27.587942 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c3ddbea4-0029-481e-a6b6-a384c5b96194 tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:27:27.588700 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c3ddbea4-0029-481e-a6b6-a384c5b96194 tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:27:27.589166 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c3ddbea4-0029-481e-a6b6-a384c5b96194 tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:27:27.589599 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c3ddbea4-0029-481e-a6b6-a384c5b96194 tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:27:27.605870 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.wsgi [None req-c3ddbea4-0029-481e-a6b6-a384c5b96194 tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] HTTP exception thrown: Instance 8dfe8aae-f5eb-4fcc-b801-7957bc9d608a could not be found. Oct 22 21:27:27.607709 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-c3ddbea4-0029-481e-a6b6-a384c5b96194 tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] Request method failure captured: Oct 22 21:27:27.607709 ncdv-master-1 devstack@n-api.service[138745]: request: GET /compute/v2.1/servers/8dfe8aae-f5eb-4fcc-b801-7957bc9d608a HTTP/1.1 Oct 22 21:27:27.607709 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 21:27:27.607709 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 21:27:27.607709 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 21:27:27.607709 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 0 Oct 22 21:27:27.607709 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 21:27:27.607709 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 21:27:27.607709 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 21:27:27.607709 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 21:27:27.607709 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVF7bY0DErSwgmBZjdwVwQOTZTdK4SDGbUmhNaQh834n8J6mnITuFql3x0V6JAbIh9J15scPt5gKDbKQ7JbcBS6yx5iWIDhlJA8Bec3GMZ9lmBCxTsAw29cfEAQSBehtXOBt3unu9G1I-E__dNKgBeYEpcbQoSJ8htr2DsuvhvAmXAdw Oct 22 21:27:27.607709 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 21:27:27.607709 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 21:27:27.607709 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 21:27:27.607709 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 21:27:27.607709 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 21:27:27.607709 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 21:27:27.607709 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: bc27a2de57354aa2a6d698b8b7b0094b Oct 22 21:27:27.607709 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-TestServerBasicOps-685385557 Oct 22 21:27:27.607709 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 21:27:27.607709 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 21:27:27.607709 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_bc27a2de57354aa2a6d698b8b7b0094b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/bc27a2de57354aa2a6d698b8b7b0094b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/bc27a2de57354aa2a6d698b8b7b0094b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/bc27a2de57354aa2a6d698b8b7b0094b"}]}] Oct 22 21:27:27.607709 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-TestServerBasicOps-685385557 Oct 22 21:27:27.607709 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: bc27a2de57354aa2a6d698b8b7b0094b Oct 22 21:27:27.607709 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-TestServerBasicOps-685385557 Oct 22 21:27:27.607709 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-TestServerBasicOps-685385557-project Oct 22 21:27:27.607709 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 21:27:27.607709 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 21:27:27.607709 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: a56d59cd5ede44edaba68a0d74e195ff Oct 22 21:27:27.607709 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-TestServerBasicOps-685385557-project Oct 22 21:27:27.607709 ncdv-master-1 devstack@n-api.service[138745]: method: > Oct 22 21:27:27.607709 ncdv-master-1 devstack@n-api.service[138745]: exception: Instance 8dfe8aae-f5eb-4fcc-b801-7957bc9d608a could not be found. Oct 22 21:27:27.607709 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'id': '8dfe8aae-f5eb-4fcc-b801-7957bc9d608a'} Oct 22 21:27:27.607709 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:27:27.607709 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:27:27.607709 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 21:27:27.607709 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 21:27:27.607709 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 21:27:27.607709 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 21:27:27.607709 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 21:27:27.607709 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 21:27:27.607709 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 21:27:27.607709 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 21:27:27.607709 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8dfe8aae-f5eb-4fcc-b801-7957bc9d608a could not be found. Oct 22 21:27:27.607709 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:27:27.607709 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:27:27.607709 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:27:27.607709 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:27:27.607709 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:27:27.607709 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:27:27.607709 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:27:27.607709 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:27:27.607709 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:27:27.607709 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:27:27.607709 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 21:27:27.607709 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 21:27:27.607709 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 21:27:27.607709 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 21:27:27.607709 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 21:27:27.607709 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:27:27.607709 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8dfe8aae-f5eb-4fcc-b801-7957bc9d608a could not be found. Oct 22 21:27:27.607709 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:27:27.607709 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:27:27.607709 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:27:27.612072 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:27:27.612072 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:27:27.612072 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:27:27.612072 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:27:27.612072 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:27:27.612072 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8dfe8aae-f5eb-4fcc-b801-7957bc9d608a could not be found. Oct 22 21:27:27.612072 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:27:27.612072 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-c3ddbea4-0029-481e-a6b6-a384c5b96194 tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] Returning 404 to user: Instance 8dfe8aae-f5eb-4fcc-b801-7957bc9d608a could not be found. {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:27:27.612072 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-c3ddbea4-0029-481e-a6b6-a384c5b96194 tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] 10.222.0.18 "GET /compute/v2.1/servers/8dfe8aae-f5eb-4fcc-b801-7957bc9d608a" status: 404 len: 111 microversion: 2.1 time: 0.034836 Oct 22 21:27:27.612072 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2899/5774] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:27:27 2022] GET /compute/v2.1/servers/8dfe8aae-f5eb-4fcc-b801-7957bc9d608a => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 21:27:28.063806 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-1fd70ceb-8017-4279-8f69-c6b3d7119927 tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:27:28.064352 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-1fd70ceb-8017-4279-8f69-c6b3d7119927 tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] [instance: 8dfe8aae-f5eb-4fcc-b801-7957bc9d608a] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:27:28.070986 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1fd70ceb-8017-4279-8f69-c6b3d7119927 tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:27:28.071500 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1fd70ceb-8017-4279-8f69-c6b3d7119927 tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:27:28.071968 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1fd70ceb-8017-4279-8f69-c6b3d7119927 tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:27:28.072669 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1fd70ceb-8017-4279-8f69-c6b3d7119927 tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:27:28.073116 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1fd70ceb-8017-4279-8f69-c6b3d7119927 tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:27:28.073537 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1fd70ceb-8017-4279-8f69-c6b3d7119927 tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:27:28.087284 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-1fd70ceb-8017-4279-8f69-c6b3d7119927 tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] HTTP exception thrown: Instance 8dfe8aae-f5eb-4fcc-b801-7957bc9d608a could not be found. Oct 22 21:27:28.088962 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-1fd70ceb-8017-4279-8f69-c6b3d7119927 tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] Request method failure captured: Oct 22 21:27:28.088962 ncdv-master-1 devstack@n-api.service[138744]: request: DELETE /compute/v2.1/servers/8dfe8aae-f5eb-4fcc-b801-7957bc9d608a HTTP/1.1 Oct 22 21:27:28.088962 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 21:27:28.088962 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 21:27:28.088962 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 21:27:28.088962 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 0 Oct 22 21:27:28.088962 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 21:27:28.088962 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 21:27:28.088962 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 21:27:28.088962 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 21:27:28.088962 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVF7bY0DErSwgmBZjdwVwQOTZTdK4SDGbUmhNaQh834n8J6mnITuFql3x0V6JAbIh9J15scPt5gKDbKQ7JbcBS6yx5iWIDhlJA8Bec3GMZ9lmBCxTsAw29cfEAQSBehtXOBt3unu9G1I-E__dNKgBeYEpcbQoSJ8htr2DsuvhvAmXAdw Oct 22 21:27:28.088962 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 21:27:28.088962 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 21:27:28.088962 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 21:27:28.088962 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 21:27:28.088962 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 21:27:28.088962 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 21:27:28.088962 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: bc27a2de57354aa2a6d698b8b7b0094b Oct 22 21:27:28.088962 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-TestServerBasicOps-685385557 Oct 22 21:27:28.088962 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 21:27:28.088962 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 21:27:28.088962 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_bc27a2de57354aa2a6d698b8b7b0094b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/bc27a2de57354aa2a6d698b8b7b0094b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/bc27a2de57354aa2a6d698b8b7b0094b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/bc27a2de57354aa2a6d698b8b7b0094b"}]}] Oct 22 21:27:28.088962 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-TestServerBasicOps-685385557 Oct 22 21:27:28.088962 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: bc27a2de57354aa2a6d698b8b7b0094b Oct 22 21:27:28.088962 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-TestServerBasicOps-685385557 Oct 22 21:27:28.088962 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-TestServerBasicOps-685385557-project Oct 22 21:27:28.088962 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 21:27:28.088962 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 21:27:28.088962 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: a56d59cd5ede44edaba68a0d74e195ff Oct 22 21:27:28.088962 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-TestServerBasicOps-685385557-project Oct 22 21:27:28.088962 ncdv-master-1 devstack@n-api.service[138744]: method: > Oct 22 21:27:28.088962 ncdv-master-1 devstack@n-api.service[138744]: exception: Instance 8dfe8aae-f5eb-4fcc-b801-7957bc9d608a could not be found. Oct 22 21:27:28.088962 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': '8dfe8aae-f5eb-4fcc-b801-7957bc9d608a'} Oct 22 21:27:28.088962 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:27:28.088962 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:27:28.088962 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 21:27:28.088962 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 21:27:28.088962 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 21:27:28.088962 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 21:27:28.088962 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 21:27:28.088962 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 21:27:28.088962 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 21:27:28.088962 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 21:27:28.088962 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8dfe8aae-f5eb-4fcc-b801-7957bc9d608a could not be found. Oct 22 21:27:28.088962 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:27:28.088962 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:27:28.088962 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:27:28.088962 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:27:28.088962 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:27:28.088962 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:27:28.088962 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:27:28.088962 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:27:28.088962 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:27:28.088962 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:27:28.088962 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 22 21:27:28.088962 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 22 21:27:28.088962 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 22 21:27:28.088962 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 22 21:27:28.088962 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 21:27:28.088962 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 21:27:28.088962 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 21:27:28.088962 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:27:28.092487 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8dfe8aae-f5eb-4fcc-b801-7957bc9d608a could not be found. Oct 22 21:27:28.092487 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:27:28.092487 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:27:28.092487 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:27:28.092487 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:27:28.092487 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:27:28.092487 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:27:28.092487 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:27:28.092487 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:27:28.092487 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8dfe8aae-f5eb-4fcc-b801-7957bc9d608a could not be found. Oct 22 21:27:28.092487 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:27:28.092487 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-1fd70ceb-8017-4279-8f69-c6b3d7119927 tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] Returning 404 to user: Instance 8dfe8aae-f5eb-4fcc-b801-7957bc9d608a could not be found. {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:27:28.092487 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-1fd70ceb-8017-4279-8f69-c6b3d7119927 tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] 10.222.0.18 "DELETE /compute/v2.1/servers/8dfe8aae-f5eb-4fcc-b801-7957bc9d608a" status: 404 len: 111 microversion: 2.1 time: 0.031784 Oct 22 21:27:28.092487 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2876/5775] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 21:27:28 2022] DELETE /compute/v2.1/servers/8dfe8aae-f5eb-4fcc-b801-7957bc9d608a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 21:27:28.099826 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-48bec069-e321-4afc-b8a1-091404d1d8f4 tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:27:28.100503 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-48bec069-e321-4afc-b8a1-091404d1d8f4 tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] [instance: 8dfe8aae-f5eb-4fcc-b801-7957bc9d608a] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:27:28.107140 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-48bec069-e321-4afc-b8a1-091404d1d8f4 tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:27:28.107679 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-48bec069-e321-4afc-b8a1-091404d1d8f4 tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:27:28.108203 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-48bec069-e321-4afc-b8a1-091404d1d8f4 tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:27:28.108937 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-48bec069-e321-4afc-b8a1-091404d1d8f4 tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:27:28.109420 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-48bec069-e321-4afc-b8a1-091404d1d8f4 tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:27:28.109903 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-48bec069-e321-4afc-b8a1-091404d1d8f4 tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:27:28.124826 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.wsgi [None req-48bec069-e321-4afc-b8a1-091404d1d8f4 tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] HTTP exception thrown: Instance 8dfe8aae-f5eb-4fcc-b801-7957bc9d608a could not be found. Oct 22 21:27:28.126400 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-48bec069-e321-4afc-b8a1-091404d1d8f4 tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] Request method failure captured: Oct 22 21:27:28.126400 ncdv-master-1 devstack@n-api.service[138745]: request: GET /compute/v2.1/servers/8dfe8aae-f5eb-4fcc-b801-7957bc9d608a HTTP/1.1 Oct 22 21:27:28.126400 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 21:27:28.126400 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 21:27:28.126400 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 21:27:28.126400 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 0 Oct 22 21:27:28.126400 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 21:27:28.126400 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 21:27:28.126400 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 21:27:28.126400 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 21:27:28.126400 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVF7bY0DErSwgmBZjdwVwQOTZTdK4SDGbUmhNaQh834n8J6mnITuFql3x0V6JAbIh9J15scPt5gKDbKQ7JbcBS6yx5iWIDhlJA8Bec3GMZ9lmBCxTsAw29cfEAQSBehtXOBt3unu9G1I-E__dNKgBeYEpcbQoSJ8htr2DsuvhvAmXAdw Oct 22 21:27:28.126400 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 21:27:28.126400 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 21:27:28.126400 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 21:27:28.126400 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 21:27:28.126400 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 21:27:28.126400 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 21:27:28.126400 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: bc27a2de57354aa2a6d698b8b7b0094b Oct 22 21:27:28.126400 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-TestServerBasicOps-685385557 Oct 22 21:27:28.126400 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 21:27:28.126400 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 21:27:28.126400 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_bc27a2de57354aa2a6d698b8b7b0094b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/bc27a2de57354aa2a6d698b8b7b0094b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/bc27a2de57354aa2a6d698b8b7b0094b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/bc27a2de57354aa2a6d698b8b7b0094b"}]}] Oct 22 21:27:28.126400 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-TestServerBasicOps-685385557 Oct 22 21:27:28.126400 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: bc27a2de57354aa2a6d698b8b7b0094b Oct 22 21:27:28.126400 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-TestServerBasicOps-685385557 Oct 22 21:27:28.126400 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-TestServerBasicOps-685385557-project Oct 22 21:27:28.126400 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 21:27:28.126400 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 21:27:28.126400 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: a56d59cd5ede44edaba68a0d74e195ff Oct 22 21:27:28.126400 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-TestServerBasicOps-685385557-project Oct 22 21:27:28.126400 ncdv-master-1 devstack@n-api.service[138745]: method: > Oct 22 21:27:28.126400 ncdv-master-1 devstack@n-api.service[138745]: exception: Instance 8dfe8aae-f5eb-4fcc-b801-7957bc9d608a could not be found. Oct 22 21:27:28.126400 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'id': '8dfe8aae-f5eb-4fcc-b801-7957bc9d608a'} Oct 22 21:27:28.126400 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:27:28.126400 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:27:28.126400 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 21:27:28.126400 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 21:27:28.126400 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 21:27:28.126400 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 21:27:28.126400 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 21:27:28.126400 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 21:27:28.126400 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 21:27:28.126400 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 21:27:28.126400 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8dfe8aae-f5eb-4fcc-b801-7957bc9d608a could not be found. Oct 22 21:27:28.126400 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:27:28.126400 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:27:28.126400 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:27:28.126400 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:27:28.126400 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:27:28.126400 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:27:28.126400 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:27:28.126400 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:27:28.126400 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:27:28.126400 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:27:28.126400 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 21:27:28.126400 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 21:27:28.126400 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 21:27:28.126400 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 21:27:28.126400 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 21:27:28.126400 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:27:28.126400 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8dfe8aae-f5eb-4fcc-b801-7957bc9d608a could not be found. Oct 22 21:27:28.126400 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:27:28.126400 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:27:28.126400 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:27:28.129948 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:27:28.129948 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:27:28.129948 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:27:28.129948 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:27:28.129948 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:27:28.129948 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8dfe8aae-f5eb-4fcc-b801-7957bc9d608a could not be found. Oct 22 21:27:28.129948 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:27:28.129948 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-48bec069-e321-4afc-b8a1-091404d1d8f4 tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] Returning 404 to user: Instance 8dfe8aae-f5eb-4fcc-b801-7957bc9d608a could not be found. {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:27:28.129948 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-48bec069-e321-4afc-b8a1-091404d1d8f4 tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] 10.222.0.18 "GET /compute/v2.1/servers/8dfe8aae-f5eb-4fcc-b801-7957bc9d608a" status: 404 len: 111 microversion: 2.1 time: 0.032981 Oct 22 21:27:28.129948 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2900/5776] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:27:28 2022] GET /compute/v2.1/servers/8dfe8aae-f5eb-4fcc-b801-7957bc9d608a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 21:27:28.297698 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-bdad0650-d3ff-4133-9298-32f8ef9814ad tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] Calling method '.version_select at 0x7fd39eb67ca0>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:27:28.321972 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-bdad0650-d3ff-4133-9298-32f8ef9814ad tempest-TestServerBasicOps-685385557 tempest-TestServerBasicOps-685385557-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-143095622" status: 202 len: 0 microversion: 2.1 time: 0.028129 Oct 22 21:27:28.328537 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2877/5777] 10.222.0.18 () {58 vars in 1251 bytes} [Sat Oct 22 21:27:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-143095622 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 21:28:08.129581 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-0f75c2be-17c9-4536-b9ec-d3ffb7e89221 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:28:08.130435 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-0f75c2be-17c9-4536-b9ec-d3ffb7e89221 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] [instance: 8f964e3b-227a-4946-af30-9700da302ade] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:28:08.134705 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:28:08.135767 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:28:08.145392 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0f75c2be-17c9-4536-b9ec-d3ffb7e89221 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:28:08.145994 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0f75c2be-17c9-4536-b9ec-d3ffb7e89221 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:28:08.146505 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0f75c2be-17c9-4536-b9ec-d3ffb7e89221 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:28:08.147229 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0f75c2be-17c9-4536-b9ec-d3ffb7e89221 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:28:08.147732 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0f75c2be-17c9-4536-b9ec-d3ffb7e89221 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:28:08.148183 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0f75c2be-17c9-4536-b9ec-d3ffb7e89221 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:28:08.174149 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-0f75c2be-17c9-4536-b9ec-d3ffb7e89221 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] 10.222.0.18 "GET /compute/v2.1/servers/8f964e3b-227a-4946-af30-9700da302ade/ips" status: 200 len: 149 microversion: 2.1 time: 0.051426 Oct 22 21:28:08.174722 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2901/5778] 10.222.0.18 () {58 vars in 1248 bytes} [Sat Oct 22 21:28:08 2022] GET /compute/v2.1/servers/8f964e3b-227a-4946-af30-9700da302ade/ips => generated 149 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:28:08.190897 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:SELECT=10 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:28:08.192306 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_api:SELECT=9,nova_api:DELETE=1 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:28:08.199171 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-41e44546-5e42-452e-8f02-f230c82443a5 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "59e7c6e3-0443-462a-9aa6-f22804ff91a8"}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:28:08.202756 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-41e44546-5e42-452e-8f02-f230c82443a5 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] [instance: 8f964e3b-227a-4946-af30-9700da302ade] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:28:08.212107 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-41e44546-5e42-452e-8f02-f230c82443a5 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:28:08.212536 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-41e44546-5e42-452e-8f02-f230c82443a5 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:28:08.212978 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-41e44546-5e42-452e-8f02-f230c82443a5 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:28:08.213668 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-41e44546-5e42-452e-8f02-f230c82443a5 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:28:08.214129 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-41e44546-5e42-452e-8f02-f230c82443a5 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:28:08.214566 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-41e44546-5e42-452e-8f02-f230c82443a5 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:28:08.300724 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-41e44546-5e42-452e-8f02-f230c82443a5 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] HTTP exception thrown: Invalid volume: volume 59e7c6e3-0443-462a-9aa6-f22804ff91a8 is already attached to instances: 5454c3bf-7239-4b6f-b542-0d6a8df40222 Oct 22 21:28:08.302353 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-41e44546-5e42-452e-8f02-f230c82443a5 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Request method failure captured: Oct 22 21:28:08.302353 ncdv-master-1 devstack@n-api.service[138744]: request: POST /compute/v2.1/servers/8f964e3b-227a-4946-af30-9700da302ade/os-volume_attachments HTTP/1.1 Oct 22 21:28:08.302353 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 21:28:08.302353 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 21:28:08.302353 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 21:28:08.302353 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 74 Oct 22 21:28:08.302353 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 21:28:08.302353 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 21:28:08.302353 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 21:28:08.302353 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 21:28:08.302353 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVF_hsf3rUCViRBfvA8CnH-TfW5QSO0kevoFTs6KZljnXJUDSecsBecVt0lVrzkUSJspjAD2JsdbiZFAxQsXXsicbWy7V3pWMCwro31w9Ltc_BWmw3Yz3d34h_3OjHVQwWdhhFE9pmgJSX-JnVswRY3vnqUmGtZuFzhOlkkg5YLCVC2I Oct 22 21:28:08.302353 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 21:28:08.302353 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 21:28:08.302353 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 21:28:08.302353 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 21:28:08.302353 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 21:28:08.302353 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 21:28:08.302353 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: 435c26b86be44362be1bd042a5cb4c1f Oct 22 21:28:08.302353 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-AttachVolumeNegativeTest-80303400 Oct 22 21:28:08.302353 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 21:28:08.302353 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 21:28:08.302353 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_435c26b86be44362be1bd042a5cb4c1f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/435c26b86be44362be1bd042a5cb4c1f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/435c26b86be44362be1bd042a5cb4c1f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/435c26b86be44362be1bd042a5cb4c1f"}]}] Oct 22 21:28:08.302353 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-AttachVolumeNegativeTest-80303400 Oct 22 21:28:08.302353 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: 435c26b86be44362be1bd042a5cb4c1f Oct 22 21:28:08.302353 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-80303400 Oct 22 21:28:08.302353 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-AttachVolumeNegativeTest-80303400-project Oct 22 21:28:08.302353 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 21:28:08.302353 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 21:28:08.302353 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: 8e102b243ece4d66bf042337324b04b0 Oct 22 21:28:08.302353 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-AttachVolumeNegativeTest-80303400-project Oct 22 21:28:08.302353 ncdv-master-1 devstack@n-api.service[138744]: Oct 22 21:28:08.302353 ncdv-master-1 devstack@n-api.service[138744]: {"volumeAttachment": {"volumeId": "59e7c6e3-0443-462a-9aa6-f22804ff91a8"}} Oct 22 21:28:08.302353 ncdv-master-1 devstack@n-api.service[138744]: method: > Oct 22 21:28:08.302353 ncdv-master-1 devstack@n-api.service[138744]: exception: Invalid volume: volume 59e7c6e3-0443-462a-9aa6-f22804ff91a8 is already attached to instances: 5454c3bf-7239-4b6f-b542-0d6a8df40222 Oct 22 21:28:08.302353 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'server_id': '8f964e3b-227a-4946-af30-9700da302ade', 'body': {'volumeAttachment': {'volumeId': '59e7c6e3-0443-462a-9aa6-f22804ff91a8'}}} Oct 22 21:28:08.302353 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:28:08.302353 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:28:08.302353 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 22 21:28:08.302353 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 22 21:28:08.302353 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 22 21:28:08.302353 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 22 21:28:08.302353 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 22 21:28:08.302353 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 22 21:28:08.302353 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 22 21:28:08.302353 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 22 21:28:08.302353 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 22 21:28:08.302353 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 22 21:28:08.302353 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 59e7c6e3-0443-462a-9aa6-f22804ff91a8 is already attached to instances: 5454c3bf-7239-4b6f-b542-0d6a8df40222 Oct 22 21:28:08.302353 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:28:08.302353 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:28:08.302353 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:28:08.302353 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:28:08.302353 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:28:08.302353 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:28:08.302353 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:28:08.302353 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:28:08.302353 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:28:08.302353 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:28:08.302353 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 21:28:08.302353 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 21:28:08.302353 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 21:28:08.302353 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 21:28:08.306387 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 21:28:08.306387 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 21:28:08.306387 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 22 21:28:08.306387 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 22 21:28:08.306387 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 59e7c6e3-0443-462a-9aa6-f22804ff91a8 is already attached to instances: 5454c3bf-7239-4b6f-b542-0d6a8df40222 Oct 22 21:28:08.306387 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:28:08.306387 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:28:08.306387 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:28:08.306387 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:28:08.306387 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:28:08.306387 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:28:08.306387 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:28:08.306387 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:28:08.306387 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 59e7c6e3-0443-462a-9aa6-f22804ff91a8 is already attached to instances: 5454c3bf-7239-4b6f-b542-0d6a8df40222 Oct 22 21:28:08.306387 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:28:08.306387 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-41e44546-5e42-452e-8f02-f230c82443a5 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Returning 400 to user: Invalid volume: volume 59e7c6e3-0443-462a-9aa6-f22804ff91a8 is already attached to instances: 5454c3bf-7239-4b6f-b542-0d6a8df40222 {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:28:08.306387 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-41e44546-5e42-452e-8f02-f230c82443a5 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] 10.222.0.18 "POST /compute/v2.1/servers/8f964e3b-227a-4946-af30-9700da302ade/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.117165 Oct 22 21:28:08.306387 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2878/5779] 10.222.0.18 () {60 vars in 1323 bytes} [Sat Oct 22 21:28:08 2022] POST /compute/v2.1/servers/8f964e3b-227a-4946-af30-9700da302ade/os-volume_attachments => generated 174 bytes in 119 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 22 21:28:08.312804 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-5971d7ca-83a1-488d-b243-3d3ef3cdd9d2 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:28:08.313331 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-5971d7ca-83a1-488d-b243-3d3ef3cdd9d2 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] [instance: 8f964e3b-227a-4946-af30-9700da302ade] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:28:08.319844 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5971d7ca-83a1-488d-b243-3d3ef3cdd9d2 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:28:08.320351 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5971d7ca-83a1-488d-b243-3d3ef3cdd9d2 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:28:08.320831 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5971d7ca-83a1-488d-b243-3d3ef3cdd9d2 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:28:08.321533 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5971d7ca-83a1-488d-b243-3d3ef3cdd9d2 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:28:08.322007 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5971d7ca-83a1-488d-b243-3d3ef3cdd9d2 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:28:08.322503 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5971d7ca-83a1-488d-b243-3d3ef3cdd9d2 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:28:08.348104 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-5971d7ca-83a1-488d-b243-3d3ef3cdd9d2 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] [instance: 8f964e3b-227a-4946-af30-9700da302ade] Going to try to terminate instance {{(pid=138745) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 21:28:08.433491 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-5971d7ca-83a1-488d-b243-3d3ef3cdd9d2 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] 10.222.0.18 "DELETE /compute/v2.1/servers/8f964e3b-227a-4946-af30-9700da302ade" status: 204 len: 0 microversion: 2.1 time: 0.124341 Oct 22 21:28:08.434076 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2902/5780] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 21:28:08 2022] DELETE /compute/v2.1/servers/8f964e3b-227a-4946-af30-9700da302ade => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 21:28:08.443084 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-457b1651-3a24-4fe0-aaff-131183730262 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:28:08.443738 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-457b1651-3a24-4fe0-aaff-131183730262 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] [instance: 8f964e3b-227a-4946-af30-9700da302ade] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:28:08.449990 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-457b1651-3a24-4fe0-aaff-131183730262 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:28:08.450487 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-457b1651-3a24-4fe0-aaff-131183730262 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:28:08.450932 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-457b1651-3a24-4fe0-aaff-131183730262 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:28:08.451725 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-457b1651-3a24-4fe0-aaff-131183730262 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:28:08.452185 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-457b1651-3a24-4fe0-aaff-131183730262 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:28:08.452617 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-457b1651-3a24-4fe0-aaff-131183730262 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:28:08.595078 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-457b1651-3a24-4fe0-aaff-131183730262 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e102b243ece4d66bf042337324b04b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435c26b86be44362be1bd042a5cb4c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:28:08.604023 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-457b1651-3a24-4fe0-aaff-131183730262 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] 10.222.0.18 "GET /compute/v2.1/servers/8f964e3b-227a-4946-af30-9700da302ade" status: 200 len: 1681 microversion: 2.1 time: 0.165364 Oct 22 21:28:08.604612 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2879/5781] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:28:08 2022] GET /compute/v2.1/servers/8f964e3b-227a-4946-af30-9700da302ade => generated 1681 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:28:09.632810 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-0e7d2b41-511c-4d17-b6fe-f789c857eb5d tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:28:09.633644 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-0e7d2b41-511c-4d17-b6fe-f789c857eb5d tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] [instance: 8f964e3b-227a-4946-af30-9700da302ade] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:28:09.641551 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0e7d2b41-511c-4d17-b6fe-f789c857eb5d tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:28:09.642123 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0e7d2b41-511c-4d17-b6fe-f789c857eb5d tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:28:09.642611 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0e7d2b41-511c-4d17-b6fe-f789c857eb5d tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:28:09.643374 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0e7d2b41-511c-4d17-b6fe-f789c857eb5d tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:28:09.643908 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0e7d2b41-511c-4d17-b6fe-f789c857eb5d tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:28:09.644383 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0e7d2b41-511c-4d17-b6fe-f789c857eb5d tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:28:09.778230 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-0e7d2b41-511c-4d17-b6fe-f789c857eb5d tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e102b243ece4d66bf042337324b04b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435c26b86be44362be1bd042a5cb4c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:28:09.786410 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-0e7d2b41-511c-4d17-b6fe-f789c857eb5d tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] 10.222.0.18 "GET /compute/v2.1/servers/8f964e3b-227a-4946-af30-9700da302ade" status: 200 len: 1681 microversion: 2.1 time: 0.159545 Oct 22 21:28:09.787092 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2903/5782] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:28:09 2022] GET /compute/v2.1/servers/8f964e3b-227a-4946-af30-9700da302ade => generated 1681 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:28:10.810321 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-3fb17ddb-c103-4084-9ebc-f15e4aa28d4e tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:28:10.811029 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-3fb17ddb-c103-4084-9ebc-f15e4aa28d4e tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] [instance: 8f964e3b-227a-4946-af30-9700da302ade] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:28:10.818672 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3fb17ddb-c103-4084-9ebc-f15e4aa28d4e tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:28:10.819271 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3fb17ddb-c103-4084-9ebc-f15e4aa28d4e tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:28:10.819831 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3fb17ddb-c103-4084-9ebc-f15e4aa28d4e tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:28:10.820624 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3fb17ddb-c103-4084-9ebc-f15e4aa28d4e tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:28:10.821089 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3fb17ddb-c103-4084-9ebc-f15e4aa28d4e tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:28:10.821519 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3fb17ddb-c103-4084-9ebc-f15e4aa28d4e tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:28:10.922128 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-3fb17ddb-c103-4084-9ebc-f15e4aa28d4e tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e102b243ece4d66bf042337324b04b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435c26b86be44362be1bd042a5cb4c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:28:10.930838 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-3fb17ddb-c103-4084-9ebc-f15e4aa28d4e tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] 10.222.0.18 "GET /compute/v2.1/servers/8f964e3b-227a-4946-af30-9700da302ade" status: 200 len: 1613 microversion: 2.1 time: 0.124421 Oct 22 21:28:10.931705 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2880/5783] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:28:10 2022] GET /compute/v2.1/servers/8f964e3b-227a-4946-af30-9700da302ade => generated 1613 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:28:11.150690 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-82466b48-abd8-49f1-a774-0f547144eb0d req-5d5f7d5c-11a3-4d27-a764-844687ac1668 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f964e3b-227a-4946-af30-9700da302ade", "name": "network-vif-deleted", "tag": "c79333eb-014e-4fc8-9b7f-fbf2e3b78c19"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:28:11.161734 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-82466b48-abd8-49f1-a774-0f547144eb0d req-5d5f7d5c-11a3-4d27-a764-844687ac1668 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:28:11.162347 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-82466b48-abd8-49f1-a774-0f547144eb0d req-5d5f7d5c-11a3-4d27-a764-844687ac1668 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:28:11.162810 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-82466b48-abd8-49f1-a774-0f547144eb0d req-5d5f7d5c-11a3-4d27-a764-844687ac1668 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:28:11.178107 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-82466b48-abd8-49f1-a774-0f547144eb0d req-5d5f7d5c-11a3-4d27-a764-844687ac1668 service nova] Creating event network-vif-deleted:c79333eb-014e-4fc8-9b7f-fbf2e3b78c19 for instance 8f964e3b-227a-4946-af30-9700da302ade on nch1-master-1 Oct 22 21:28:11.185964 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-82466b48-abd8-49f1-a774-0f547144eb0d req-5d5f7d5c-11a3-4d27-a764-844687ac1668 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038936 Oct 22 21:28:11.186593 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2904/5784] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:28:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:28:11.954712 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-51b67b3f-c004-40e7-8741-7e85ce77eb5e tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:28:11.955298 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-51b67b3f-c004-40e7-8741-7e85ce77eb5e tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] [instance: 8f964e3b-227a-4946-af30-9700da302ade] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:28:11.963276 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-51b67b3f-c004-40e7-8741-7e85ce77eb5e tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:28:11.964144 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-51b67b3f-c004-40e7-8741-7e85ce77eb5e tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:28:11.964235 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-51b67b3f-c004-40e7-8741-7e85ce77eb5e tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:28:11.965058 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-51b67b3f-c004-40e7-8741-7e85ce77eb5e tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:28:11.965534 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-51b67b3f-c004-40e7-8741-7e85ce77eb5e tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:28:11.965973 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-51b67b3f-c004-40e7-8741-7e85ce77eb5e tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:28:11.981504 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-51b67b3f-c004-40e7-8741-7e85ce77eb5e tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] HTTP exception thrown: Instance 8f964e3b-227a-4946-af30-9700da302ade could not be found. Oct 22 21:28:11.983084 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-51b67b3f-c004-40e7-8741-7e85ce77eb5e tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Request method failure captured: Oct 22 21:28:11.983084 ncdv-master-1 devstack@n-api.service[138744]: request: GET /compute/v2.1/servers/8f964e3b-227a-4946-af30-9700da302ade HTTP/1.1 Oct 22 21:28:11.983084 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 21:28:11.983084 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 21:28:11.983084 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 21:28:11.983084 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 0 Oct 22 21:28:11.983084 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 21:28:11.983084 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 21:28:11.983084 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 21:28:11.983084 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 21:28:11.983084 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVF_hsf3rUCViRBfvA8CnH-TfW5QSO0kevoFTs6KZljnXJUDSecsBecVt0lVrzkUSJspjAD2JsdbiZFAxQsXXsicbWy7V3pWMCwro31w9Ltc_BWmw3Yz3d34h_3OjHVQwWdhhFE9pmgJSX-JnVswRY3vnqUmGtZuFzhOlkkg5YLCVC2I Oct 22 21:28:11.983084 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 21:28:11.983084 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 21:28:11.983084 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 21:28:11.983084 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 21:28:11.983084 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 21:28:11.983084 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 21:28:11.983084 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: 435c26b86be44362be1bd042a5cb4c1f Oct 22 21:28:11.983084 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-AttachVolumeNegativeTest-80303400 Oct 22 21:28:11.983084 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 21:28:11.983084 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 21:28:11.983084 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_435c26b86be44362be1bd042a5cb4c1f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/435c26b86be44362be1bd042a5cb4c1f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/435c26b86be44362be1bd042a5cb4c1f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/435c26b86be44362be1bd042a5cb4c1f"}]}] Oct 22 21:28:11.983084 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-AttachVolumeNegativeTest-80303400 Oct 22 21:28:11.983084 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: 435c26b86be44362be1bd042a5cb4c1f Oct 22 21:28:11.983084 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-80303400 Oct 22 21:28:11.983084 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-AttachVolumeNegativeTest-80303400-project Oct 22 21:28:11.983084 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 21:28:11.983084 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 21:28:11.983084 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: 8e102b243ece4d66bf042337324b04b0 Oct 22 21:28:11.983084 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-AttachVolumeNegativeTest-80303400-project Oct 22 21:28:11.983084 ncdv-master-1 devstack@n-api.service[138744]: method: > Oct 22 21:28:11.983084 ncdv-master-1 devstack@n-api.service[138744]: exception: Instance 8f964e3b-227a-4946-af30-9700da302ade could not be found. Oct 22 21:28:11.983084 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': '8f964e3b-227a-4946-af30-9700da302ade'} Oct 22 21:28:11.983084 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:28:11.983084 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:28:11.983084 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 21:28:11.983084 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 21:28:11.983084 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 21:28:11.983084 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 21:28:11.983084 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 21:28:11.983084 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 21:28:11.983084 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 21:28:11.983084 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 21:28:11.983084 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f964e3b-227a-4946-af30-9700da302ade could not be found. Oct 22 21:28:11.983084 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:28:11.983084 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:28:11.983084 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:28:11.983084 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:28:11.983084 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:28:11.983084 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:28:11.983084 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:28:11.983084 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:28:11.983084 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:28:11.983084 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:28:11.983084 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 21:28:11.983084 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 21:28:11.983084 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 21:28:11.983084 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 21:28:11.983084 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 21:28:11.983084 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:28:11.983084 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f964e3b-227a-4946-af30-9700da302ade could not be found. Oct 22 21:28:11.983084 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:28:11.983084 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:28:11.983084 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:28:11.987289 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:28:11.987289 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:28:11.987289 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:28:11.987289 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:28:11.987289 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:28:11.987289 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f964e3b-227a-4946-af30-9700da302ade could not be found. Oct 22 21:28:11.987289 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:28:11.987289 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-51b67b3f-c004-40e7-8741-7e85ce77eb5e tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Returning 404 to user: Instance 8f964e3b-227a-4946-af30-9700da302ade could not be found. {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:28:11.987289 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-51b67b3f-c004-40e7-8741-7e85ce77eb5e tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] 10.222.0.18 "GET /compute/v2.1/servers/8f964e3b-227a-4946-af30-9700da302ade" status: 404 len: 111 microversion: 2.1 time: 0.033920 Oct 22 21:28:11.987289 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2881/5785] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:28:11 2022] GET /compute/v2.1/servers/8f964e3b-227a-4946-af30-9700da302ade => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 21:28:11.994381 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-54583ffc-3e62-457f-8548-f02d4b26d94f tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Calling method '.version_select at 0x7fd39ef77790>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:28:11.999138 ncdv-master-1 devstack@n-api.service[138745]: ERROR oslo.messaging._drivers.impl_rabbit [None req-54583ffc-3e62-457f-8548-f02d4b26d94f tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] [fdffe6b9-9d4b-45b8-9714-1ef9d5132dcd] AMQP server on 10.222.0.18:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 22 21:28:13.011387 ncdv-master-1 devstack@n-api.service[138745]: INFO oslo.messaging._drivers.impl_rabbit [None req-54583ffc-3e62-457f-8548-f02d4b26d94f tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] [fdffe6b9-9d4b-45b8-9714-1ef9d5132dcd] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 58422. Oct 22 21:28:13.037149 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-54583ffc-3e62-457f-8548-f02d4b26d94f tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-383296525" status: 202 len: 0 microversion: 2.1 time: 1.047096 Oct 22 21:28:13.037970 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2905/5786] 10.222.0.18 () {58 vars in 1218 bytes} [Sat Oct 22 21:28:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-383296525 => generated 0 bytes in 1049 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 22 21:28:13.748700 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-2473b6f4-074f-4a98-adcb-24ef6d03ae4b tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:28:13.749249 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-2473b6f4-074f-4a98-adcb-24ef6d03ae4b tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] [instance: 5454c3bf-7239-4b6f-b542-0d6a8df40222] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:28:13.756444 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2473b6f4-074f-4a98-adcb-24ef6d03ae4b tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:28:13.757031 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2473b6f4-074f-4a98-adcb-24ef6d03ae4b tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:28:13.757474 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2473b6f4-074f-4a98-adcb-24ef6d03ae4b tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:28:13.758168 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2473b6f4-074f-4a98-adcb-24ef6d03ae4b tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:28:13.758618 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2473b6f4-074f-4a98-adcb-24ef6d03ae4b tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:28:13.759041 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2473b6f4-074f-4a98-adcb-24ef6d03ae4b tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:28:13.842692 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.objects.instance [None req-2473b6f4-074f-4a98-adcb-24ef6d03ae4b tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lazy-loading 'services' on Instance uuid 5454c3bf-7239-4b6f-b542-0d6a8df40222 {{(pid=138744) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 21:28:13.921122 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-2473b6f4-074f-4a98-adcb-24ef6d03ae4b tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] 10.222.0.18 "DELETE /compute/v2.1/servers/5454c3bf-7239-4b6f-b542-0d6a8df40222/os-volume_attachments/59e7c6e3-0443-462a-9aa6-f22804ff91a8" status: 202 len: 0 microversion: 2.1 time: 0.176232 Oct 22 21:28:13.921727 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2882/5787] 10.222.0.18 () {58 vars in 1416 bytes} [Sat Oct 22 21:28:13 2022] DELETE /compute/v2.1/servers/5454c3bf-7239-4b6f-b542-0d6a8df40222/os-volume_attachments/59e7c6e3-0443-462a-9aa6-f22804ff91a8 => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 21:28:13.932481 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-551ee9c3-6704-4adc-bc6d-96029d2ee589 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:28:13.935447 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-551ee9c3-6704-4adc-bc6d-96029d2ee589 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] [instance: 5454c3bf-7239-4b6f-b542-0d6a8df40222] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:28:13.941890 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-551ee9c3-6704-4adc-bc6d-96029d2ee589 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:28:13.942355 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-551ee9c3-6704-4adc-bc6d-96029d2ee589 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:28:13.942840 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-551ee9c3-6704-4adc-bc6d-96029d2ee589 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:28:13.943663 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-551ee9c3-6704-4adc-bc6d-96029d2ee589 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:28:13.944068 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-551ee9c3-6704-4adc-bc6d-96029d2ee589 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:28:13.944510 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-551ee9c3-6704-4adc-bc6d-96029d2ee589 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:28:13.980461 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-551ee9c3-6704-4adc-bc6d-96029d2ee589 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] 10.222.0.18 "GET /compute/v2.1/servers/5454c3bf-7239-4b6f-b542-0d6a8df40222/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053992 Oct 22 21:28:13.981075 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2906/5788] 10.222.0.18 () {58 vars in 1302 bytes} [Sat Oct 22 21:28:13 2022] GET /compute/v2.1/servers/5454c3bf-7239-4b6f-b542-0d6a8df40222/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:28:14.995764 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-52a046be-e951-40ee-a384-2d789cda8751 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:28:14.998178 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-52a046be-e951-40ee-a384-2d789cda8751 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] [instance: 5454c3bf-7239-4b6f-b542-0d6a8df40222] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:28:15.005098 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-52a046be-e951-40ee-a384-2d789cda8751 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:28:15.005596 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-52a046be-e951-40ee-a384-2d789cda8751 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:28:15.006037 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-52a046be-e951-40ee-a384-2d789cda8751 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:28:15.006739 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-52a046be-e951-40ee-a384-2d789cda8751 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:28:15.007195 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-52a046be-e951-40ee-a384-2d789cda8751 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:28:15.007654 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-52a046be-e951-40ee-a384-2d789cda8751 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:28:15.038578 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-52a046be-e951-40ee-a384-2d789cda8751 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] 10.222.0.18 "GET /compute/v2.1/servers/5454c3bf-7239-4b6f-b542-0d6a8df40222/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048174 Oct 22 21:28:15.039137 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2883/5789] 10.222.0.18 () {58 vars in 1302 bytes} [Sat Oct 22 21:28:14 2022] GET /compute/v2.1/servers/5454c3bf-7239-4b6f-b542-0d6a8df40222/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 22 21:28:15.104455 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-ae13dfe1-73f9-43b6-8e5f-ecb85d1fcc86 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:28:15.104989 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-ae13dfe1-73f9-43b6-8e5f-ecb85d1fcc86 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] [instance: 5454c3bf-7239-4b6f-b542-0d6a8df40222] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:28:15.112293 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ae13dfe1-73f9-43b6-8e5f-ecb85d1fcc86 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:28:15.112776 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ae13dfe1-73f9-43b6-8e5f-ecb85d1fcc86 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:28:15.113226 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ae13dfe1-73f9-43b6-8e5f-ecb85d1fcc86 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:28:15.113941 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ae13dfe1-73f9-43b6-8e5f-ecb85d1fcc86 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:28:15.114412 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ae13dfe1-73f9-43b6-8e5f-ecb85d1fcc86 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:28:15.114850 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ae13dfe1-73f9-43b6-8e5f-ecb85d1fcc86 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:28:15.140979 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-ae13dfe1-73f9-43b6-8e5f-ecb85d1fcc86 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] [instance: 5454c3bf-7239-4b6f-b542-0d6a8df40222] Going to try to terminate instance {{(pid=138745) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 21:28:15.235234 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-ae13dfe1-73f9-43b6-8e5f-ecb85d1fcc86 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] 10.222.0.18 "DELETE /compute/v2.1/servers/5454c3bf-7239-4b6f-b542-0d6a8df40222" status: 204 len: 0 microversion: 2.1 time: 0.134493 Oct 22 21:28:15.238290 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2907/5790] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 21:28:15 2022] DELETE /compute/v2.1/servers/5454c3bf-7239-4b6f-b542-0d6a8df40222 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 21:28:15.247211 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-be1341e5-c719-47a9-a70e-2888a142d399 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:28:15.247761 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-be1341e5-c719-47a9-a70e-2888a142d399 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] [instance: 5454c3bf-7239-4b6f-b542-0d6a8df40222] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:28:15.255946 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-be1341e5-c719-47a9-a70e-2888a142d399 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:28:15.256660 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-be1341e5-c719-47a9-a70e-2888a142d399 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:28:15.257309 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-be1341e5-c719-47a9-a70e-2888a142d399 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:28:15.258322 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-be1341e5-c719-47a9-a70e-2888a142d399 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:28:15.258973 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-be1341e5-c719-47a9-a70e-2888a142d399 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:28:15.259616 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-be1341e5-c719-47a9-a70e-2888a142d399 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:28:15.404955 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-be1341e5-c719-47a9-a70e-2888a142d399 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e102b243ece4d66bf042337324b04b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435c26b86be44362be1bd042a5cb4c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:28:15.413293 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-be1341e5-c719-47a9-a70e-2888a142d399 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] 10.222.0.18 "GET /compute/v2.1/servers/5454c3bf-7239-4b6f-b542-0d6a8df40222" status: 200 len: 1681 microversion: 2.1 time: 0.170255 Oct 22 21:28:15.413879 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2884/5791] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:28:15 2022] GET /compute/v2.1/servers/5454c3bf-7239-4b6f-b542-0d6a8df40222 => generated 1681 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:28:16.442511 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-a0c75235-1686-4c81-8269-b2bf18dc6039 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:28:16.443771 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-a0c75235-1686-4c81-8269-b2bf18dc6039 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] [instance: 5454c3bf-7239-4b6f-b542-0d6a8df40222] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:28:16.456033 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a0c75235-1686-4c81-8269-b2bf18dc6039 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:28:16.456860 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a0c75235-1686-4c81-8269-b2bf18dc6039 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:28:16.457668 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a0c75235-1686-4c81-8269-b2bf18dc6039 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:28:16.458864 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a0c75235-1686-4c81-8269-b2bf18dc6039 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:28:16.459714 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a0c75235-1686-4c81-8269-b2bf18dc6039 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:28:16.460489 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a0c75235-1686-4c81-8269-b2bf18dc6039 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:28:16.600866 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-a0c75235-1686-4c81-8269-b2bf18dc6039 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e102b243ece4d66bf042337324b04b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435c26b86be44362be1bd042a5cb4c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:28:16.613313 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-a0c75235-1686-4c81-8269-b2bf18dc6039 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] 10.222.0.18 "GET /compute/v2.1/servers/5454c3bf-7239-4b6f-b542-0d6a8df40222" status: 200 len: 1681 microversion: 2.1 time: 0.177877 Oct 22 21:28:16.614023 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2908/5792] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:28:16 2022] GET /compute/v2.1/servers/5454c3bf-7239-4b6f-b542-0d6a8df40222 => generated 1681 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:28:17.638033 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-bf43232f-c915-49d3-92e4-8fd16bd38a44 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:28:17.638629 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-bf43232f-c915-49d3-92e4-8fd16bd38a44 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] [instance: 5454c3bf-7239-4b6f-b542-0d6a8df40222] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:28:17.646344 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bf43232f-c915-49d3-92e4-8fd16bd38a44 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:28:17.647130 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bf43232f-c915-49d3-92e4-8fd16bd38a44 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:28:17.647817 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bf43232f-c915-49d3-92e4-8fd16bd38a44 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:28:17.648561 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bf43232f-c915-49d3-92e4-8fd16bd38a44 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:28:17.649030 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bf43232f-c915-49d3-92e4-8fd16bd38a44 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:28:17.649770 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bf43232f-c915-49d3-92e4-8fd16bd38a44 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:28:17.733208 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-bf43232f-c915-49d3-92e4-8fd16bd38a44 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e102b243ece4d66bf042337324b04b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435c26b86be44362be1bd042a5cb4c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:28:17.741290 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-bf43232f-c915-49d3-92e4-8fd16bd38a44 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] 10.222.0.18 "GET /compute/v2.1/servers/5454c3bf-7239-4b6f-b542-0d6a8df40222" status: 200 len: 1613 microversion: 2.1 time: 0.107268 Oct 22 21:28:17.741845 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2885/5793] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:28:17 2022] GET /compute/v2.1/servers/5454c3bf-7239-4b6f-b542-0d6a8df40222 => generated 1613 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:28:17.815223 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-5a2df8e6-fbb2-447b-9f22-bc5d27d87587 req-706bf5ed-7f81-4153-8d0c-9c4b5b35fdef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5454c3bf-7239-4b6f-b542-0d6a8df40222", "name": "network-vif-deleted", "tag": "00632b98-a2d8-4c3f-a4fb-7873273c0933"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:28:17.825746 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-5a2df8e6-fbb2-447b-9f22-bc5d27d87587 req-706bf5ed-7f81-4153-8d0c-9c4b5b35fdef service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:28:17.826249 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-5a2df8e6-fbb2-447b-9f22-bc5d27d87587 req-706bf5ed-7f81-4153-8d0c-9c4b5b35fdef service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:28:17.826663 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-5a2df8e6-fbb2-447b-9f22-bc5d27d87587 req-706bf5ed-7f81-4153-8d0c-9c4b5b35fdef service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:28:17.841621 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-5a2df8e6-fbb2-447b-9f22-bc5d27d87587 req-706bf5ed-7f81-4153-8d0c-9c4b5b35fdef service nova] Creating event network-vif-deleted:00632b98-a2d8-4c3f-a4fb-7873273c0933 for instance 5454c3bf-7239-4b6f-b542-0d6a8df40222 on nch2-master-1 Oct 22 21:28:17.848118 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-5a2df8e6-fbb2-447b-9f22-bc5d27d87587 req-706bf5ed-7f81-4153-8d0c-9c4b5b35fdef service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037200 Oct 22 21:28:17.848713 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2909/5794] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:28:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:28:18.765262 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-ede30b44-5261-4b93-ac74-d3ceaf7830ce tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:28:18.765885 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-ede30b44-5261-4b93-ac74-d3ceaf7830ce tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] [instance: 5454c3bf-7239-4b6f-b542-0d6a8df40222] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:28:18.773631 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ede30b44-5261-4b93-ac74-d3ceaf7830ce tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:28:18.774120 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ede30b44-5261-4b93-ac74-d3ceaf7830ce tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:28:18.774598 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ede30b44-5261-4b93-ac74-d3ceaf7830ce tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:28:18.775393 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ede30b44-5261-4b93-ac74-d3ceaf7830ce tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:28:18.775877 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ede30b44-5261-4b93-ac74-d3ceaf7830ce tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:28:18.776310 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ede30b44-5261-4b93-ac74-d3ceaf7830ce tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:28:18.792894 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-ede30b44-5261-4b93-ac74-d3ceaf7830ce tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] HTTP exception thrown: Instance 5454c3bf-7239-4b6f-b542-0d6a8df40222 could not be found. Oct 22 21:28:18.794500 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-ede30b44-5261-4b93-ac74-d3ceaf7830ce tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Request method failure captured: Oct 22 21:28:18.794500 ncdv-master-1 devstack@n-api.service[138744]: request: GET /compute/v2.1/servers/5454c3bf-7239-4b6f-b542-0d6a8df40222 HTTP/1.1 Oct 22 21:28:18.794500 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 21:28:18.794500 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 21:28:18.794500 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 21:28:18.794500 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 0 Oct 22 21:28:18.794500 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 21:28:18.794500 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 21:28:18.794500 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 21:28:18.794500 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 21:28:18.794500 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVF_hsf3rUCViRBfvA8CnH-TfW5QSO0kevoFTs6KZljnXJUDSecsBecVt0lVrzkUSJspjAD2JsdbiZFAxQsXXsicbWy7V3pWMCwro31w9Ltc_BWmw3Yz3d34h_3OjHVQwWdhhFE9pmgJSX-JnVswRY3vnqUmGtZuFzhOlkkg5YLCVC2I Oct 22 21:28:18.794500 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 21:28:18.794500 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 21:28:18.794500 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 21:28:18.794500 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 21:28:18.794500 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 21:28:18.794500 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 21:28:18.794500 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: 435c26b86be44362be1bd042a5cb4c1f Oct 22 21:28:18.794500 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-AttachVolumeNegativeTest-80303400 Oct 22 21:28:18.794500 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 21:28:18.794500 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 21:28:18.794500 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_435c26b86be44362be1bd042a5cb4c1f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/435c26b86be44362be1bd042a5cb4c1f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/435c26b86be44362be1bd042a5cb4c1f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/435c26b86be44362be1bd042a5cb4c1f"}]}] Oct 22 21:28:18.794500 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-AttachVolumeNegativeTest-80303400 Oct 22 21:28:18.794500 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: 435c26b86be44362be1bd042a5cb4c1f Oct 22 21:28:18.794500 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-80303400 Oct 22 21:28:18.794500 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-AttachVolumeNegativeTest-80303400-project Oct 22 21:28:18.794500 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 21:28:18.794500 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 21:28:18.794500 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: 8e102b243ece4d66bf042337324b04b0 Oct 22 21:28:18.794500 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-AttachVolumeNegativeTest-80303400-project Oct 22 21:28:18.794500 ncdv-master-1 devstack@n-api.service[138744]: method: > Oct 22 21:28:18.794500 ncdv-master-1 devstack@n-api.service[138744]: exception: Instance 5454c3bf-7239-4b6f-b542-0d6a8df40222 could not be found. Oct 22 21:28:18.794500 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': '5454c3bf-7239-4b6f-b542-0d6a8df40222'} Oct 22 21:28:18.794500 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:28:18.794500 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:28:18.794500 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 21:28:18.794500 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 21:28:18.794500 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 21:28:18.794500 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 21:28:18.794500 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 21:28:18.794500 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 21:28:18.794500 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 21:28:18.794500 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 21:28:18.794500 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5454c3bf-7239-4b6f-b542-0d6a8df40222 could not be found. Oct 22 21:28:18.794500 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:28:18.794500 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:28:18.794500 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:28:18.794500 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:28:18.794500 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:28:18.794500 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:28:18.794500 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:28:18.794500 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:28:18.794500 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:28:18.794500 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:28:18.794500 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 21:28:18.794500 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 21:28:18.794500 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 21:28:18.794500 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 21:28:18.794500 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 21:28:18.794500 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:28:18.794500 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5454c3bf-7239-4b6f-b542-0d6a8df40222 could not be found. Oct 22 21:28:18.794500 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:28:18.794500 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:28:18.794500 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:28:18.798435 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:28:18.798435 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:28:18.798435 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:28:18.798435 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:28:18.798435 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:28:18.798435 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5454c3bf-7239-4b6f-b542-0d6a8df40222 could not be found. Oct 22 21:28:18.798435 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:28:18.798435 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-ede30b44-5261-4b93-ac74-d3ceaf7830ce tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Returning 404 to user: Instance 5454c3bf-7239-4b6f-b542-0d6a8df40222 could not be found. {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:28:18.798435 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-ede30b44-5261-4b93-ac74-d3ceaf7830ce tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] 10.222.0.18 "GET /compute/v2.1/servers/5454c3bf-7239-4b6f-b542-0d6a8df40222" status: 404 len: 111 microversion: 2.1 time: 0.034833 Oct 22 21:28:18.798435 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2886/5795] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:28:18 2022] GET /compute/v2.1/servers/5454c3bf-7239-4b6f-b542-0d6a8df40222 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 21:28:18.805869 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-d0a92f18-9879-41ac-b3b8-d4d5d4534694 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Calling method '.version_select at 0x7fd39c59aaf0>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:28:18.828144 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-d0a92f18-9879-41ac-b3b8-d4d5d4534694 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1776102286" status: 202 len: 0 microversion: 2.1 time: 0.026389 Oct 22 21:28:18.828773 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2910/5796] 10.222.0.18 () {58 vars in 1221 bytes} [Sat Oct 22 21:28:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1776102286 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 21:28:19.458139 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-6643cb4d-4164-439e-9836-7c3531d30745 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Action: 'create', calling method: .version_select at 0x7fd39ebbdf70>, body: {"keypair": {"name": "tempest-keypair-188161220", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLe5BL/5POrBDtZYl+kLDPWTKQ0pXNOJXqoEaUQOzgI5kFIiUZYEZfQtq3vCypYL4Yadf29Wolm0uNdFh79jrmHq7anhsteCJDZ0MoD4bCEAP3hhTVL/zFaesJh5XpQbpg=="}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:28:19.476046 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-6643cb4d-4164-439e-9836-7c3531d30745 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Getting quotas for project 435c26b86be44362be1bd042a5cb4c1f. Resources: {'key_pairs'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 21:28:19.483519 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-6643cb4d-4164-439e-9836-7c3531d30745 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Getting quotas for user 8e102b243ece4d66bf042337324b04b0 and project 435c26b86be44362be1bd042a5cb4c1f. Resources: {'key_pairs'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 21:28:19.513388 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-6643cb4d-4164-439e-9836-7c3531d30745 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.061875 Oct 22 21:28:19.513983 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2887/5797] 10.222.0.18 () {60 vars in 1159 bytes} [Sat Oct 22 21:28:19 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:28:20.845598 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-71ba7593-e655-4adf-b35a-a4fcef948b27 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-673166709", "imageRef": "085e4478-6edc-4a69-8e08-f9831713eb65", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "198587bc-1a83-4ec0-b59a-75cdfe081c8b"}], "security_groups": [{"name": "tempest-securitygroup--1260084139"}], "key_name": "tempest-keypair-188161220", "user_data": "}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:28:20.956159 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.network.neutron [None req-71ba7593-e655-4adf-b35a-a4fcef948b27 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] validate_networks() for [('198587bc-1a83-4ec0-b59a-75cdfe081c8b', None, None, None, None, None)] {{(pid=138745) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 21:28:21.358384 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-71ba7593-e655-4adf-b35a-a4fcef948b27 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Flavor limits 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 21:28:21.358826 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-71ba7593-e655-4adf-b35a-a4fcef948b27 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Image limits 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 21:28:21.359321 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-71ba7593-e655-4adf-b35a-a4fcef948b27 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Flavor pref 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 21:28:21.359772 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-71ba7593-e655-4adf-b35a-a4fcef948b27 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Image pref 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 21:28:21.360194 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-71ba7593-e655-4adf-b35a-a4fcef948b27 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 21:28:21.369461 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-71ba7593-e655-4adf-b35a-a4fcef948b27 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:28:21.369931 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-71ba7593-e655-4adf-b35a-a4fcef948b27 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:28:21.370380 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-71ba7593-e655-4adf-b35a-a4fcef948b27 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:28:21.371122 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-71ba7593-e655-4adf-b35a-a4fcef948b27 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:28:21.371615 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-71ba7593-e655-4adf-b35a-a4fcef948b27 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:28:21.372057 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-71ba7593-e655-4adf-b35a-a4fcef948b27 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:28:21.389895 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-71ba7593-e655-4adf-b35a-a4fcef948b27 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Getting quotas for project 435c26b86be44362be1bd042a5cb4c1f. Resources: {'cores', 'instances', 'ram'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 21:28:21.395399 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-71ba7593-e655-4adf-b35a-a4fcef948b27 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Getting quotas for user 8e102b243ece4d66bf042337324b04b0 and project 435c26b86be44362be1bd042a5cb4c1f. Resources: {'cores', 'instances', 'ram'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 21:28:21.408333 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-71ba7593-e655-4adf-b35a-a4fcef948b27 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Going to run 1 instances... {{(pid=138745) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 21:28:21.410776 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-71ba7593-e655-4adf-b35a-a4fcef948b27 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] [instance: 8ea439b7-9b3c-4521-a266-d4baa48c6308] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='085e4478-6edc-4a69-8e08-f9831713eb65',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138745) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 21:28:21.461425 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-71ba7593-e655-4adf-b35a-a4fcef948b27 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.620294 Oct 22 21:28:21.462116 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2911/5798] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Oct 22 21:28:20 2022] POST /compute/v2.1/servers => generated 402 bytes in 622 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 21:28:21.474727 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-c85ac44e-1ddd-4166-a461-893997e32fb8 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:28:21.475366 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-c85ac44e-1ddd-4166-a461-893997e32fb8 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] [instance: 8ea439b7-9b3c-4521-a266-d4baa48c6308] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:28:21.842594 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-c85ac44e-1ddd-4166-a461-893997e32fb8 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e102b243ece4d66bf042337324b04b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435c26b86be44362be1bd042a5cb4c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:28:21.850271 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-c85ac44e-1ddd-4166-a461-893997e32fb8 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] 10.222.0.18 "GET /compute/v2.1/servers/8ea439b7-9b3c-4521-a266-d4baa48c6308" status: 200 len: 1240 microversion: 2.1 time: 0.380723 Oct 22 21:28:21.850941 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2888/5799] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:28:21 2022] GET /compute/v2.1/servers/8ea439b7-9b3c-4521-a266-d4baa48c6308 => generated 1240 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:28:22.875024 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-87822021-f2f0-49cf-87d5-225d2d0761d7 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:28:22.875741 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-87822021-f2f0-49cf-87d5-225d2d0761d7 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] [instance: 8ea439b7-9b3c-4521-a266-d4baa48c6308] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:28:22.886536 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-87822021-f2f0-49cf-87d5-225d2d0761d7 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:28:22.887039 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-87822021-f2f0-49cf-87d5-225d2d0761d7 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:28:22.887525 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-87822021-f2f0-49cf-87d5-225d2d0761d7 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:28:22.888437 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-87822021-f2f0-49cf-87d5-225d2d0761d7 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:28:22.888728 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-87822021-f2f0-49cf-87d5-225d2d0761d7 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:28:22.889160 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-87822021-f2f0-49cf-87d5-225d2d0761d7 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:28:22.971125 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-87822021-f2f0-49cf-87d5-225d2d0761d7 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e102b243ece4d66bf042337324b04b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435c26b86be44362be1bd042a5cb4c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:28:22.980203 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-87822021-f2f0-49cf-87d5-225d2d0761d7 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] 10.222.0.18 "GET /compute/v2.1/servers/8ea439b7-9b3c-4521-a266-d4baa48c6308" status: 200 len: 1298 microversion: 2.1 time: 0.110158 Oct 22 21:28:22.980801 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2912/5800] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:28:22 2022] GET /compute/v2.1/servers/8ea439b7-9b3c-4521-a266-d4baa48c6308 => generated 1298 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:28:23.917973 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-659ef5c3-917f-4a45-9438-769b5081f252 req-336dff6e-f151-4ccd-8e50-c5c590d66694 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ea439b7-9b3c-4521-a266-d4baa48c6308", "tag": "e173a80d-8b8c-4ef6-8f43-90d0d2047707"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:28:23.933633 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-659ef5c3-917f-4a45-9438-769b5081f252 req-336dff6e-f151-4ccd-8e50-c5c590d66694 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:28:23.934407 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-659ef5c3-917f-4a45-9438-769b5081f252 req-336dff6e-f151-4ccd-8e50-c5c590d66694 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:28:23.934946 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-659ef5c3-917f-4a45-9438-769b5081f252 req-336dff6e-f151-4ccd-8e50-c5c590d66694 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:28:23.948222 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-659ef5c3-917f-4a45-9438-769b5081f252 req-336dff6e-f151-4ccd-8e50-c5c590d66694 service nova] Creating event network-changed:e173a80d-8b8c-4ef6-8f43-90d0d2047707 for instance 8ea439b7-9b3c-4521-a266-d4baa48c6308 on nch1-master-1 Oct 22 21:28:23.953653 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-659ef5c3-917f-4a45-9438-769b5081f252 req-336dff6e-f151-4ccd-8e50-c5c590d66694 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040033 Oct 22 21:28:23.954264 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2889/5801] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:28:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 21:28:24.005470 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-bf350075-2065-4614-b441-6c4fc4b0736e tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:28:24.006308 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-bf350075-2065-4614-b441-6c4fc4b0736e tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] [instance: 8ea439b7-9b3c-4521-a266-d4baa48c6308] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:28:24.014453 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bf350075-2065-4614-b441-6c4fc4b0736e tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:28:24.014969 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bf350075-2065-4614-b441-6c4fc4b0736e tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:28:24.015454 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bf350075-2065-4614-b441-6c4fc4b0736e tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:28:24.016224 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bf350075-2065-4614-b441-6c4fc4b0736e tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:28:24.016701 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bf350075-2065-4614-b441-6c4fc4b0736e tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:28:24.017155 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bf350075-2065-4614-b441-6c4fc4b0736e tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:28:24.214731 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-bf350075-2065-4614-b441-6c4fc4b0736e tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e102b243ece4d66bf042337324b04b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435c26b86be44362be1bd042a5cb4c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:28:24.223085 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-bf350075-2065-4614-b441-6c4fc4b0736e tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] 10.222.0.18 "GET /compute/v2.1/servers/8ea439b7-9b3c-4521-a266-d4baa48c6308" status: 200 len: 1366 microversion: 2.1 time: 0.222782 Oct 22 21:28:24.223716 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2913/5802] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:28:23 2022] GET /compute/v2.1/servers/8ea439b7-9b3c-4521-a266-d4baa48c6308 => generated 1366 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:28:25.251462 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-1bd01be6-4ae3-4422-9dbc-66af0b723682 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:28:25.252719 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-1bd01be6-4ae3-4422-9dbc-66af0b723682 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] [instance: 8ea439b7-9b3c-4521-a266-d4baa48c6308] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:28:25.263171 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1bd01be6-4ae3-4422-9dbc-66af0b723682 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:28:25.263685 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1bd01be6-4ae3-4422-9dbc-66af0b723682 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:28:25.264126 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1bd01be6-4ae3-4422-9dbc-66af0b723682 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:28:25.264825 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1bd01be6-4ae3-4422-9dbc-66af0b723682 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:28:25.265277 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1bd01be6-4ae3-4422-9dbc-66af0b723682 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:28:25.265707 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1bd01be6-4ae3-4422-9dbc-66af0b723682 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:28:25.412030 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-1bd01be6-4ae3-4422-9dbc-66af0b723682 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e102b243ece4d66bf042337324b04b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435c26b86be44362be1bd042a5cb4c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:28:25.420199 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-1bd01be6-4ae3-4422-9dbc-66af0b723682 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] 10.222.0.18 "GET /compute/v2.1/servers/8ea439b7-9b3c-4521-a266-d4baa48c6308" status: 200 len: 1366 microversion: 2.1 time: 0.175932 Oct 22 21:28:25.420760 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2890/5803] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:28:25 2022] GET /compute/v2.1/servers/8ea439b7-9b3c-4521-a266-d4baa48c6308 => generated 1366 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:28:26.452567 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-4d9f1769-491b-41a5-8ae9-dd789ab0d15b tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:28:26.453551 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-4d9f1769-491b-41a5-8ae9-dd789ab0d15b tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] [instance: 8ea439b7-9b3c-4521-a266-d4baa48c6308] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:28:26.464790 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4d9f1769-491b-41a5-8ae9-dd789ab0d15b tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:28:26.465319 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4d9f1769-491b-41a5-8ae9-dd789ab0d15b tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:28:26.465774 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4d9f1769-491b-41a5-8ae9-dd789ab0d15b tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:28:26.466490 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4d9f1769-491b-41a5-8ae9-dd789ab0d15b tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:28:26.466972 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4d9f1769-491b-41a5-8ae9-dd789ab0d15b tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:28:26.467459 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4d9f1769-491b-41a5-8ae9-dd789ab0d15b tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:28:26.609553 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-4d9f1769-491b-41a5-8ae9-dd789ab0d15b tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e102b243ece4d66bf042337324b04b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435c26b86be44362be1bd042a5cb4c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:28:26.622047 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-4d9f1769-491b-41a5-8ae9-dd789ab0d15b tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] 10.222.0.18 "GET /compute/v2.1/servers/8ea439b7-9b3c-4521-a266-d4baa48c6308" status: 200 len: 1366 microversion: 2.1 time: 0.176682 Oct 22 21:28:26.622805 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2914/5804] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:28:26 2022] GET /compute/v2.1/servers/8ea439b7-9b3c-4521-a266-d4baa48c6308 => generated 1366 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:28:27.652562 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-8c45fcd9-97cd-45a0-9c48-24e8210991c4 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:28:27.653133 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-8c45fcd9-97cd-45a0-9c48-24e8210991c4 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] [instance: 8ea439b7-9b3c-4521-a266-d4baa48c6308] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:28:27.660618 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8c45fcd9-97cd-45a0-9c48-24e8210991c4 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:28:27.661111 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8c45fcd9-97cd-45a0-9c48-24e8210991c4 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:28:27.661556 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8c45fcd9-97cd-45a0-9c48-24e8210991c4 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:28:27.662265 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8c45fcd9-97cd-45a0-9c48-24e8210991c4 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:28:27.662717 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8c45fcd9-97cd-45a0-9c48-24e8210991c4 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:28:27.663154 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8c45fcd9-97cd-45a0-9c48-24e8210991c4 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:28:27.802499 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-8c45fcd9-97cd-45a0-9c48-24e8210991c4 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e102b243ece4d66bf042337324b04b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435c26b86be44362be1bd042a5cb4c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:28:27.810757 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-8c45fcd9-97cd-45a0-9c48-24e8210991c4 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] 10.222.0.18 "GET /compute/v2.1/servers/8ea439b7-9b3c-4521-a266-d4baa48c6308" status: 200 len: 1366 microversion: 2.1 time: 0.164955 Oct 22 21:28:27.811318 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2891/5805] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:28:27 2022] GET /compute/v2.1/servers/8ea439b7-9b3c-4521-a266-d4baa48c6308 => generated 1366 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:28:28.837582 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-68f439d2-558a-4bf9-a5df-3b5c022a3aca tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:28:28.838397 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-68f439d2-558a-4bf9-a5df-3b5c022a3aca tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] [instance: 8ea439b7-9b3c-4521-a266-d4baa48c6308] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:28:28.850321 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-68f439d2-558a-4bf9-a5df-3b5c022a3aca tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:28:28.851079 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-68f439d2-558a-4bf9-a5df-3b5c022a3aca tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:28:28.851847 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-68f439d2-558a-4bf9-a5df-3b5c022a3aca tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:28:28.852952 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-68f439d2-558a-4bf9-a5df-3b5c022a3aca tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:28:28.853705 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-68f439d2-558a-4bf9-a5df-3b5c022a3aca tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:28:28.854537 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-68f439d2-558a-4bf9-a5df-3b5c022a3aca tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:28:28.986605 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-68f439d2-558a-4bf9-a5df-3b5c022a3aca tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e102b243ece4d66bf042337324b04b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435c26b86be44362be1bd042a5cb4c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:28:28.994724 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-68f439d2-558a-4bf9-a5df-3b5c022a3aca tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] 10.222.0.18 "GET /compute/v2.1/servers/8ea439b7-9b3c-4521-a266-d4baa48c6308" status: 200 len: 1366 microversion: 2.1 time: 0.163581 Oct 22 21:28:28.995404 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2915/5806] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:28:28 2022] GET /compute/v2.1/servers/8ea439b7-9b3c-4521-a266-d4baa48c6308 => generated 1366 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:28:30.018144 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-9842d6cf-5a72-418b-818a-44d69c3e5237 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:28:30.018780 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-9842d6cf-5a72-418b-818a-44d69c3e5237 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] [instance: 8ea439b7-9b3c-4521-a266-d4baa48c6308] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:28:30.026099 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9842d6cf-5a72-418b-818a-44d69c3e5237 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:28:30.026581 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9842d6cf-5a72-418b-818a-44d69c3e5237 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:28:30.027313 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9842d6cf-5a72-418b-818a-44d69c3e5237 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:28:30.028166 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9842d6cf-5a72-418b-818a-44d69c3e5237 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:28:30.028641 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9842d6cf-5a72-418b-818a-44d69c3e5237 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:28:30.029083 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9842d6cf-5a72-418b-818a-44d69c3e5237 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:28:30.173617 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-9842d6cf-5a72-418b-818a-44d69c3e5237 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e102b243ece4d66bf042337324b04b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435c26b86be44362be1bd042a5cb4c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:28:30.181651 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-9842d6cf-5a72-418b-818a-44d69c3e5237 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] 10.222.0.18 "GET /compute/v2.1/servers/8ea439b7-9b3c-4521-a266-d4baa48c6308" status: 200 len: 1366 microversion: 2.1 time: 0.167380 Oct 22 21:28:30.182283 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2892/5807] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:28:30 2022] GET /compute/v2.1/servers/8ea439b7-9b3c-4521-a266-d4baa48c6308 => generated 1366 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:28:30.257352 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-cba61fa1-fcd8-456c-8192-2c42f02f2892 req-e2979889-da90-40a1-bc35-4308c9bbdbfd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ea439b7-9b3c-4521-a266-d4baa48c6308", "name": "network-vif-plugged", "status": "completed", "tag": "e173a80d-8b8c-4ef6-8f43-90d0d2047707"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:28:30.274114 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-cba61fa1-fcd8-456c-8192-2c42f02f2892 req-e2979889-da90-40a1-bc35-4308c9bbdbfd service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:28:30.274913 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-cba61fa1-fcd8-456c-8192-2c42f02f2892 req-e2979889-da90-40a1-bc35-4308c9bbdbfd service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:28:30.275476 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-cba61fa1-fcd8-456c-8192-2c42f02f2892 req-e2979889-da90-40a1-bc35-4308c9bbdbfd service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:28:30.289876 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-cba61fa1-fcd8-456c-8192-2c42f02f2892 req-e2979889-da90-40a1-bc35-4308c9bbdbfd service nova] Creating event network-vif-plugged:e173a80d-8b8c-4ef6-8f43-90d0d2047707 for instance 8ea439b7-9b3c-4521-a266-d4baa48c6308 on nch1-master-1 Oct 22 21:28:30.295374 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-cba61fa1-fcd8-456c-8192-2c42f02f2892 req-e2979889-da90-40a1-bc35-4308c9bbdbfd service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043420 Oct 22 21:28:30.296016 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2916/5808] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:28:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:28:31.209063 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-9b119d8c-822e-4824-af4b-01373b437ff9 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:28:31.210120 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-9b119d8c-822e-4824-af4b-01373b437ff9 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] [instance: 8ea439b7-9b3c-4521-a266-d4baa48c6308] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:28:31.221964 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9b119d8c-822e-4824-af4b-01373b437ff9 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:28:31.222826 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9b119d8c-822e-4824-af4b-01373b437ff9 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:28:31.223609 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9b119d8c-822e-4824-af4b-01373b437ff9 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:28:31.225354 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9b119d8c-822e-4824-af4b-01373b437ff9 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:28:31.226110 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9b119d8c-822e-4824-af4b-01373b437ff9 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:28:31.226839 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9b119d8c-822e-4824-af4b-01373b437ff9 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:28:31.359461 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-9b119d8c-822e-4824-af4b-01373b437ff9 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e102b243ece4d66bf042337324b04b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435c26b86be44362be1bd042a5cb4c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:28:31.372092 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-9b119d8c-822e-4824-af4b-01373b437ff9 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] 10.222.0.18 "GET /compute/v2.1/servers/8ea439b7-9b3c-4521-a266-d4baa48c6308" status: 200 len: 1366 microversion: 2.1 time: 0.169040 Oct 22 21:28:31.372747 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2893/5809] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:28:31 2022] GET /compute/v2.1/servers/8ea439b7-9b3c-4521-a266-d4baa48c6308 => generated 1366 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:28:32.394117 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell0:SELECT=2 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:28:32.394977 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell0:SELECT=6 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:28:32.401598 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-f556284d-d433-4691-a08c-b302d7c9a90a tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:28:32.402785 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-f556284d-d433-4691-a08c-b302d7c9a90a tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] [instance: 8ea439b7-9b3c-4521-a266-d4baa48c6308] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:28:32.410762 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f556284d-d433-4691-a08c-b302d7c9a90a tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:28:32.411256 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f556284d-d433-4691-a08c-b302d7c9a90a tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:28:32.411735 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f556284d-d433-4691-a08c-b302d7c9a90a tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:28:32.412439 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f556284d-d433-4691-a08c-b302d7c9a90a tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:28:32.412888 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f556284d-d433-4691-a08c-b302d7c9a90a tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:28:32.413339 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f556284d-d433-4691-a08c-b302d7c9a90a tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:28:32.556233 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-f556284d-d433-4691-a08c-b302d7c9a90a tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e102b243ece4d66bf042337324b04b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435c26b86be44362be1bd042a5cb4c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:28:32.568398 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-f556284d-d433-4691-a08c-b302d7c9a90a tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] 10.222.0.18 "GET /compute/v2.1/servers/8ea439b7-9b3c-4521-a266-d4baa48c6308" status: 200 len: 1556 microversion: 2.1 time: 0.176332 Oct 22 21:28:32.569275 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2917/5810] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:28:32 2022] GET /compute/v2.1/servers/8ea439b7-9b3c-4521-a266-d4baa48c6308 => generated 1556 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:28:32.592575 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-84aa4690-a9c1-4e23-88db-26e8cf594980 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:28:32.593212 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-84aa4690-a9c1-4e23-88db-26e8cf594980 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] [instance: 8ea439b7-9b3c-4521-a266-d4baa48c6308] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:28:32.595066 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell0:SELECT=6 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:28:32.602040 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-84aa4690-a9c1-4e23-88db-26e8cf594980 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:28:32.602528 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-84aa4690-a9c1-4e23-88db-26e8cf594980 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:28:32.602974 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-84aa4690-a9c1-4e23-88db-26e8cf594980 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:28:32.603710 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-84aa4690-a9c1-4e23-88db-26e8cf594980 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:28:32.604170 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-84aa4690-a9c1-4e23-88db-26e8cf594980 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:28:32.604602 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-84aa4690-a9c1-4e23-88db-26e8cf594980 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:28:32.686292 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-84aa4690-a9c1-4e23-88db-26e8cf594980 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] 10.222.0.18 "GET /compute/v2.1/servers/8ea439b7-9b3c-4521-a266-d4baa48c6308/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.097639 Oct 22 21:28:32.686887 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2894/5811] 10.222.0.18 () {58 vars in 1275 bytes} [Sat Oct 22 21:28:32 2022] GET /compute/v2.1/servers/8ea439b7-9b3c-4521-a266-d4baa48c6308/os-interface => generated 284 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:28:33.659081 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-b2307421-fe0e-48e7-804f-7e0b5b728288 req-d894102e-476f-430d-a9f4-d46072d459e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ea439b7-9b3c-4521-a266-d4baa48c6308", "tag": "e173a80d-8b8c-4ef6-8f43-90d0d2047707"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:28:33.670150 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-b2307421-fe0e-48e7-804f-7e0b5b728288 req-d894102e-476f-430d-a9f4-d46072d459e9 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:28:33.670651 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-b2307421-fe0e-48e7-804f-7e0b5b728288 req-d894102e-476f-430d-a9f4-d46072d459e9 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:28:33.671067 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-b2307421-fe0e-48e7-804f-7e0b5b728288 req-d894102e-476f-430d-a9f4-d46072d459e9 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:28:33.682832 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-b2307421-fe0e-48e7-804f-7e0b5b728288 req-d894102e-476f-430d-a9f4-d46072d459e9 service nova] Creating event network-changed:e173a80d-8b8c-4ef6-8f43-90d0d2047707 for instance 8ea439b7-9b3c-4521-a266-d4baa48c6308 on nch1-master-1 Oct 22 21:28:33.689239 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-b2307421-fe0e-48e7-804f-7e0b5b728288 req-d894102e-476f-430d-a9f4-d46072d459e9 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034610 Oct 22 21:28:33.689816 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2918/5812] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:28:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:29:37.062979 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=1 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:29:37.063925 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:SELECT=79,nova_cell1:INSERT=1 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:29:37.069037 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-0f95eb43-5879-4852-8a98-cf56cbd4dc5e tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:29:37.069592 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-0f95eb43-5879-4852-8a98-cf56cbd4dc5e tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] [instance: 8ea439b7-9b3c-4521-a266-d4baa48c6308] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:29:37.078780 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0f95eb43-5879-4852-8a98-cf56cbd4dc5e tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:29:37.079319 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0f95eb43-5879-4852-8a98-cf56cbd4dc5e tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:29:37.079841 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0f95eb43-5879-4852-8a98-cf56cbd4dc5e tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:29:37.080594 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0f95eb43-5879-4852-8a98-cf56cbd4dc5e tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:29:37.081095 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0f95eb43-5879-4852-8a98-cf56cbd4dc5e tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:29:37.081569 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0f95eb43-5879-4852-8a98-cf56cbd4dc5e tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:29:37.107381 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-0f95eb43-5879-4852-8a98-cf56cbd4dc5e tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] 10.222.0.18 "GET /compute/v2.1/servers/8ea439b7-9b3c-4521-a266-d4baa48c6308/ips" status: 200 len: 149 microversion: 2.1 time: 0.049750 Oct 22 21:29:37.107970 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2895/5813] 10.222.0.18 () {58 vars in 1248 bytes} [Sat Oct 22 21:29:37 2022] GET /compute/v2.1/servers/8ea439b7-9b3c-4521-a266-d4baa48c6308/ips => generated 149 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:29:38.487356 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=2,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:29:38.488160 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:29:38.492900 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-2643ef04-08b0-45a3-8ec3-fb6a5a33d18e tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "27da303b-f9e4-42d2-b1f6-d01ef39bb876"}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:29:38.495406 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-2643ef04-08b0-45a3-8ec3-fb6a5a33d18e tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] [instance: 8ea439b7-9b3c-4521-a266-d4baa48c6308] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:29:38.503523 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2643ef04-08b0-45a3-8ec3-fb6a5a33d18e tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:29:38.504032 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2643ef04-08b0-45a3-8ec3-fb6a5a33d18e tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:29:38.504492 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2643ef04-08b0-45a3-8ec3-fb6a5a33d18e tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:29:38.505215 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2643ef04-08b0-45a3-8ec3-fb6a5a33d18e tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:29:38.505685 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2643ef04-08b0-45a3-8ec3-fb6a5a33d18e tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:29:38.506129 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2643ef04-08b0-45a3-8ec3-fb6a5a33d18e tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:29:38.991817 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-2643ef04-08b0-45a3-8ec3-fb6a5a33d18e tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] 10.222.0.18 "POST /compute/v2.1/servers/8ea439b7-9b3c-4521-a266-d4baa48c6308/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.506748 Oct 22 21:29:38.992523 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2919/5814] 10.222.0.18 () {60 vars in 1323 bytes} [Sat Oct 22 21:29:38 2022] POST /compute/v2.1/servers/8ea439b7-9b3c-4521-a266-d4baa48c6308/os-volume_attachments => generated 194 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:29:42.333321 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-83d3414c-5f42-401c-b003-4c44c1483070 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "27da303b-f9e4-42d2-b1f6-d01ef39bb876"}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:29:42.335748 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-83d3414c-5f42-401c-b003-4c44c1483070 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] [instance: 8ea439b7-9b3c-4521-a266-d4baa48c6308] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:29:42.342954 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-83d3414c-5f42-401c-b003-4c44c1483070 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:29:42.343495 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-83d3414c-5f42-401c-b003-4c44c1483070 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:29:42.343981 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-83d3414c-5f42-401c-b003-4c44c1483070 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:29:42.344685 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-83d3414c-5f42-401c-b003-4c44c1483070 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:29:42.345219 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-83d3414c-5f42-401c-b003-4c44c1483070 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:29:42.345742 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-83d3414c-5f42-401c-b003-4c44c1483070 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:29:42.500260 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-83d3414c-5f42-401c-b003-4c44c1483070 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] HTTP exception thrown: Invalid volume: volume 27da303b-f9e4-42d2-b1f6-d01ef39bb876 is already attached to instances: 8ea439b7-9b3c-4521-a266-d4baa48c6308 Oct 22 21:29:42.502160 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-83d3414c-5f42-401c-b003-4c44c1483070 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Request method failure captured: Oct 22 21:29:42.502160 ncdv-master-1 devstack@n-api.service[138744]: request: POST /compute/v2.1/servers/8ea439b7-9b3c-4521-a266-d4baa48c6308/os-volume_attachments HTTP/1.1 Oct 22 21:29:42.502160 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 21:29:42.502160 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 21:29:42.502160 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 21:29:42.502160 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 74 Oct 22 21:29:42.502160 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 21:29:42.502160 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 21:29:42.502160 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 21:29:42.502160 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 21:29:42.502160 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVF_hsf3rUCViRBfvA8CnH-TfW5QSO0kevoFTs6KZljnXJUDSecsBecVt0lVrzkUSJspjAD2JsdbiZFAxQsXXsicbWy7V3pWMCwro31w9Ltc_BWmw3Yz3d34h_3OjHVQwWdhhFE9pmgJSX-JnVswRY3vnqUmGtZuFzhOlkkg5YLCVC2I Oct 22 21:29:42.502160 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 21:29:42.502160 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 21:29:42.502160 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 21:29:42.502160 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 21:29:42.502160 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 21:29:42.502160 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 21:29:42.502160 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: 435c26b86be44362be1bd042a5cb4c1f Oct 22 21:29:42.502160 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-AttachVolumeNegativeTest-80303400 Oct 22 21:29:42.502160 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 21:29:42.502160 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 21:29:42.502160 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_435c26b86be44362be1bd042a5cb4c1f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/435c26b86be44362be1bd042a5cb4c1f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/435c26b86be44362be1bd042a5cb4c1f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/435c26b86be44362be1bd042a5cb4c1f"}]}] Oct 22 21:29:42.502160 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-AttachVolumeNegativeTest-80303400 Oct 22 21:29:42.502160 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: 435c26b86be44362be1bd042a5cb4c1f Oct 22 21:29:42.502160 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-80303400 Oct 22 21:29:42.502160 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-AttachVolumeNegativeTest-80303400-project Oct 22 21:29:42.502160 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 21:29:42.502160 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 21:29:42.502160 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: 8e102b243ece4d66bf042337324b04b0 Oct 22 21:29:42.502160 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-AttachVolumeNegativeTest-80303400-project Oct 22 21:29:42.502160 ncdv-master-1 devstack@n-api.service[138744]: Oct 22 21:29:42.502160 ncdv-master-1 devstack@n-api.service[138744]: {"volumeAttachment": {"volumeId": "27da303b-f9e4-42d2-b1f6-d01ef39bb876"}} Oct 22 21:29:42.502160 ncdv-master-1 devstack@n-api.service[138744]: method: > Oct 22 21:29:42.502160 ncdv-master-1 devstack@n-api.service[138744]: exception: Invalid volume: volume 27da303b-f9e4-42d2-b1f6-d01ef39bb876 is already attached to instances: 8ea439b7-9b3c-4521-a266-d4baa48c6308 Oct 22 21:29:42.502160 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'server_id': '8ea439b7-9b3c-4521-a266-d4baa48c6308', 'body': {'volumeAttachment': {'volumeId': '27da303b-f9e4-42d2-b1f6-d01ef39bb876'}}} Oct 22 21:29:42.502160 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:29:42.502160 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:29:42.502160 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 22 21:29:42.502160 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 22 21:29:42.502160 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 22 21:29:42.502160 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 22 21:29:42.502160 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 22 21:29:42.502160 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 22 21:29:42.502160 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 22 21:29:42.502160 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 22 21:29:42.502160 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 22 21:29:42.502160 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 22 21:29:42.502160 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 27da303b-f9e4-42d2-b1f6-d01ef39bb876 is already attached to instances: 8ea439b7-9b3c-4521-a266-d4baa48c6308 Oct 22 21:29:42.502160 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:29:42.502160 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:29:42.502160 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:29:42.502160 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:29:42.502160 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:29:42.502160 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:29:42.502160 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:29:42.502160 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:29:42.502160 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:29:42.502160 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:29:42.502160 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 21:29:42.502160 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 21:29:42.502160 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 21:29:42.502160 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 21:29:42.506146 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 21:29:42.506146 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 21:29:42.506146 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 22 21:29:42.506146 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 22 21:29:42.506146 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 27da303b-f9e4-42d2-b1f6-d01ef39bb876 is already attached to instances: 8ea439b7-9b3c-4521-a266-d4baa48c6308 Oct 22 21:29:42.506146 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:29:42.506146 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:29:42.506146 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:29:42.506146 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:29:42.506146 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:29:42.506146 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:29:42.506146 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:29:42.506146 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:29:42.506146 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 27da303b-f9e4-42d2-b1f6-d01ef39bb876 is already attached to instances: 8ea439b7-9b3c-4521-a266-d4baa48c6308 Oct 22 21:29:42.506146 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:29:42.506146 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-83d3414c-5f42-401c-b003-4c44c1483070 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Returning 400 to user: Invalid volume: volume 27da303b-f9e4-42d2-b1f6-d01ef39bb876 is already attached to instances: 8ea439b7-9b3c-4521-a266-d4baa48c6308 {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:29:42.506146 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-83d3414c-5f42-401c-b003-4c44c1483070 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] 10.222.0.18 "POST /compute/v2.1/servers/8ea439b7-9b3c-4521-a266-d4baa48c6308/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.174899 Oct 22 21:29:42.506146 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2896/5815] 10.222.0.18 () {60 vars in 1323 bytes} [Sat Oct 22 21:29:42 2022] POST /compute/v2.1/servers/8ea439b7-9b3c-4521-a266-d4baa48c6308/os-volume_attachments => generated 174 bytes in 176 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 22 21:29:42.575710 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-5e56bf0e-c466-4f65-8c01-3dd8533d72a7 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:29:42.576335 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-5e56bf0e-c466-4f65-8c01-3dd8533d72a7 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] [instance: 8ea439b7-9b3c-4521-a266-d4baa48c6308] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:29:42.584292 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5e56bf0e-c466-4f65-8c01-3dd8533d72a7 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:29:42.584799 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5e56bf0e-c466-4f65-8c01-3dd8533d72a7 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:29:42.585255 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5e56bf0e-c466-4f65-8c01-3dd8533d72a7 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:29:42.585985 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5e56bf0e-c466-4f65-8c01-3dd8533d72a7 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:29:42.586465 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5e56bf0e-c466-4f65-8c01-3dd8533d72a7 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:29:42.586884 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5e56bf0e-c466-4f65-8c01-3dd8533d72a7 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:29:42.676110 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.objects.instance [None req-5e56bf0e-c466-4f65-8c01-3dd8533d72a7 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lazy-loading 'services' on Instance uuid 8ea439b7-9b3c-4521-a266-d4baa48c6308 {{(pid=138745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 21:29:42.752960 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-5e56bf0e-c466-4f65-8c01-3dd8533d72a7 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] 10.222.0.18 "DELETE /compute/v2.1/servers/8ea439b7-9b3c-4521-a266-d4baa48c6308/os-volume_attachments/27da303b-f9e4-42d2-b1f6-d01ef39bb876" status: 202 len: 0 microversion: 2.1 time: 0.185715 Oct 22 21:29:42.753546 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2920/5816] 10.222.0.18 () {58 vars in 1416 bytes} [Sat Oct 22 21:29:42 2022] DELETE /compute/v2.1/servers/8ea439b7-9b3c-4521-a266-d4baa48c6308/os-volume_attachments/27da303b-f9e4-42d2-b1f6-d01ef39bb876 => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 21:29:42.762289 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-8874171a-2f87-41b9-8b0e-1a451158d151 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:29:42.764755 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-8874171a-2f87-41b9-8b0e-1a451158d151 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] [instance: 8ea439b7-9b3c-4521-a266-d4baa48c6308] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:29:42.771218 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8874171a-2f87-41b9-8b0e-1a451158d151 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:29:42.771769 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8874171a-2f87-41b9-8b0e-1a451158d151 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:29:42.772252 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8874171a-2f87-41b9-8b0e-1a451158d151 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:29:42.772994 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8874171a-2f87-41b9-8b0e-1a451158d151 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:29:42.773457 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8874171a-2f87-41b9-8b0e-1a451158d151 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:29:42.773893 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8874171a-2f87-41b9-8b0e-1a451158d151 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:29:42.806300 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-8874171a-2f87-41b9-8b0e-1a451158d151 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] 10.222.0.18 "GET /compute/v2.1/servers/8ea439b7-9b3c-4521-a266-d4baa48c6308/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048145 Oct 22 21:29:42.806854 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2897/5817] 10.222.0.18 () {58 vars in 1302 bytes} [Sat Oct 22 21:29:42 2022] GET /compute/v2.1/servers/8ea439b7-9b3c-4521-a266-d4baa48c6308/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:29:43.826182 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-941d1d15-8f79-4c3b-aa59-f861584e4d8c tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:29:43.830374 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-941d1d15-8f79-4c3b-aa59-f861584e4d8c tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] [instance: 8ea439b7-9b3c-4521-a266-d4baa48c6308] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:29:43.841647 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-941d1d15-8f79-4c3b-aa59-f861584e4d8c tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:29:43.842485 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-941d1d15-8f79-4c3b-aa59-f861584e4d8c tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:29:43.843252 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-941d1d15-8f79-4c3b-aa59-f861584e4d8c tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:29:43.844546 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-941d1d15-8f79-4c3b-aa59-f861584e4d8c tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:29:43.845595 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-941d1d15-8f79-4c3b-aa59-f861584e4d8c tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:29:43.846035 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-941d1d15-8f79-4c3b-aa59-f861584e4d8c tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:29:43.877836 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-941d1d15-8f79-4c3b-aa59-f861584e4d8c tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] 10.222.0.18 "GET /compute/v2.1/servers/8ea439b7-9b3c-4521-a266-d4baa48c6308/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.060552 Oct 22 21:29:43.878409 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2921/5818] 10.222.0.18 () {58 vars in 1302 bytes} [Sat Oct 22 21:29:43 2022] GET /compute/v2.1/servers/8ea439b7-9b3c-4521-a266-d4baa48c6308/os-volume_attachments => generated 25 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 22 21:29:43.942566 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-b5cea851-3727-43bf-badb-ff7ff0b0a8bf tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:29:43.943127 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-b5cea851-3727-43bf-badb-ff7ff0b0a8bf tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] [instance: 8ea439b7-9b3c-4521-a266-d4baa48c6308] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:29:43.950207 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b5cea851-3727-43bf-badb-ff7ff0b0a8bf tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:29:43.950712 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b5cea851-3727-43bf-badb-ff7ff0b0a8bf tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:29:43.951157 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b5cea851-3727-43bf-badb-ff7ff0b0a8bf tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:29:43.951890 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b5cea851-3727-43bf-badb-ff7ff0b0a8bf tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:29:43.952349 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b5cea851-3727-43bf-badb-ff7ff0b0a8bf tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:29:43.952782 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b5cea851-3727-43bf-badb-ff7ff0b0a8bf tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:29:43.979969 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-b5cea851-3727-43bf-badb-ff7ff0b0a8bf tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] [instance: 8ea439b7-9b3c-4521-a266-d4baa48c6308] Going to try to terminate instance {{(pid=138744) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 21:29:44.062369 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-b5cea851-3727-43bf-badb-ff7ff0b0a8bf tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] 10.222.0.18 "DELETE /compute/v2.1/servers/8ea439b7-9b3c-4521-a266-d4baa48c6308" status: 204 len: 0 microversion: 2.1 time: 0.123594 Oct 22 21:29:44.063286 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2898/5819] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 21:29:43 2022] DELETE /compute/v2.1/servers/8ea439b7-9b3c-4521-a266-d4baa48c6308 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 21:29:44.071975 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-99ca0888-39d1-4a2b-a609-9ce3b34f7dfe tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:29:44.072644 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-99ca0888-39d1-4a2b-a609-9ce3b34f7dfe tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] [instance: 8ea439b7-9b3c-4521-a266-d4baa48c6308] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:29:44.079143 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-99ca0888-39d1-4a2b-a609-9ce3b34f7dfe tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:29:44.079719 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-99ca0888-39d1-4a2b-a609-9ce3b34f7dfe tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:29:44.080201 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-99ca0888-39d1-4a2b-a609-9ce3b34f7dfe tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:29:44.080938 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-99ca0888-39d1-4a2b-a609-9ce3b34f7dfe tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:29:44.081402 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-99ca0888-39d1-4a2b-a609-9ce3b34f7dfe tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:29:44.081871 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-99ca0888-39d1-4a2b-a609-9ce3b34f7dfe tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:29:44.232163 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-99ca0888-39d1-4a2b-a609-9ce3b34f7dfe tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e102b243ece4d66bf042337324b04b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435c26b86be44362be1bd042a5cb4c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:29:44.240371 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-99ca0888-39d1-4a2b-a609-9ce3b34f7dfe tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] 10.222.0.18 "GET /compute/v2.1/servers/8ea439b7-9b3c-4521-a266-d4baa48c6308" status: 200 len: 1680 microversion: 2.1 time: 0.172504 Oct 22 21:29:44.240948 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2922/5820] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:29:44 2022] GET /compute/v2.1/servers/8ea439b7-9b3c-4521-a266-d4baa48c6308 => generated 1680 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:29:45.279095 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-096435a3-815f-4279-b746-73f4a07e8feb tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:29:45.280362 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-096435a3-815f-4279-b746-73f4a07e8feb tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] [instance: 8ea439b7-9b3c-4521-a266-d4baa48c6308] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:29:45.288973 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-096435a3-815f-4279-b746-73f4a07e8feb tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:29:45.289480 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-096435a3-815f-4279-b746-73f4a07e8feb tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:29:45.289933 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-096435a3-815f-4279-b746-73f4a07e8feb tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:29:45.290649 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-096435a3-815f-4279-b746-73f4a07e8feb tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:29:45.291119 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-096435a3-815f-4279-b746-73f4a07e8feb tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:29:45.291595 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-096435a3-815f-4279-b746-73f4a07e8feb tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:29:45.427128 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-096435a3-815f-4279-b746-73f4a07e8feb tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e102b243ece4d66bf042337324b04b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435c26b86be44362be1bd042a5cb4c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:29:45.435253 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-096435a3-815f-4279-b746-73f4a07e8feb tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] 10.222.0.18 "GET /compute/v2.1/servers/8ea439b7-9b3c-4521-a266-d4baa48c6308" status: 200 len: 1680 microversion: 2.1 time: 0.163791 Oct 22 21:29:45.435869 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2899/5821] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:29:45 2022] GET /compute/v2.1/servers/8ea439b7-9b3c-4521-a266-d4baa48c6308 => generated 1680 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:29:46.462272 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-6952f74b-7220-4d9e-8d3a-88c1f3154fb9 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:29:46.462896 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-6952f74b-7220-4d9e-8d3a-88c1f3154fb9 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] [instance: 8ea439b7-9b3c-4521-a266-d4baa48c6308] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:29:46.470826 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6952f74b-7220-4d9e-8d3a-88c1f3154fb9 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:29:46.471249 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6952f74b-7220-4d9e-8d3a-88c1f3154fb9 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:29:46.471747 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6952f74b-7220-4d9e-8d3a-88c1f3154fb9 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:29:46.472716 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6952f74b-7220-4d9e-8d3a-88c1f3154fb9 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:29:46.472994 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6952f74b-7220-4d9e-8d3a-88c1f3154fb9 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:29:46.473776 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6952f74b-7220-4d9e-8d3a-88c1f3154fb9 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:29:46.815058 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-6952f74b-7220-4d9e-8d3a-88c1f3154fb9 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e102b243ece4d66bf042337324b04b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435c26b86be44362be1bd042a5cb4c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:29:46.823379 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-6952f74b-7220-4d9e-8d3a-88c1f3154fb9 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] 10.222.0.18 "GET /compute/v2.1/servers/8ea439b7-9b3c-4521-a266-d4baa48c6308" status: 200 len: 1612 microversion: 2.1 time: 0.365138 Oct 22 21:29:46.824220 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2923/5822] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:29:46 2022] GET /compute/v2.1/servers/8ea439b7-9b3c-4521-a266-d4baa48c6308 => generated 1612 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:29:46.932923 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-b556c010-3124-4e10-9450-f9d89d219782 req-694fcc3e-b5e5-4047-81e6-071ba9928664 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ea439b7-9b3c-4521-a266-d4baa48c6308", "name": "network-vif-deleted", "tag": "e173a80d-8b8c-4ef6-8f43-90d0d2047707"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:29:46.943401 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-b556c010-3124-4e10-9450-f9d89d219782 req-694fcc3e-b5e5-4047-81e6-071ba9928664 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:29:46.943914 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-b556c010-3124-4e10-9450-f9d89d219782 req-694fcc3e-b5e5-4047-81e6-071ba9928664 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:29:46.944334 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-b556c010-3124-4e10-9450-f9d89d219782 req-694fcc3e-b5e5-4047-81e6-071ba9928664 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:29:46.956810 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-b556c010-3124-4e10-9450-f9d89d219782 req-694fcc3e-b5e5-4047-81e6-071ba9928664 service nova] Creating event network-vif-deleted:e173a80d-8b8c-4ef6-8f43-90d0d2047707 for instance 8ea439b7-9b3c-4521-a266-d4baa48c6308 on nch1-master-1 Oct 22 21:29:46.961914 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-b556c010-3124-4e10-9450-f9d89d219782 req-694fcc3e-b5e5-4047-81e6-071ba9928664 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032811 Oct 22 21:29:46.962527 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2900/5823] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:29:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:29:47.848217 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-93e5c495-c469-437f-9bc8-7d8ceea0ff52 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:29:47.849138 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-93e5c495-c469-437f-9bc8-7d8ceea0ff52 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] [instance: 8ea439b7-9b3c-4521-a266-d4baa48c6308] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:29:47.856930 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-93e5c495-c469-437f-9bc8-7d8ceea0ff52 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:29:47.857939 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-93e5c495-c469-437f-9bc8-7d8ceea0ff52 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:29:47.857939 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-93e5c495-c469-437f-9bc8-7d8ceea0ff52 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:29:47.858595 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-93e5c495-c469-437f-9bc8-7d8ceea0ff52 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:29:47.859060 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-93e5c495-c469-437f-9bc8-7d8ceea0ff52 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:29:47.859561 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-93e5c495-c469-437f-9bc8-7d8ceea0ff52 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:29:47.878751 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.wsgi [None req-93e5c495-c469-437f-9bc8-7d8ceea0ff52 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] HTTP exception thrown: Instance 8ea439b7-9b3c-4521-a266-d4baa48c6308 could not be found. Oct 22 21:29:47.880588 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-93e5c495-c469-437f-9bc8-7d8ceea0ff52 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Request method failure captured: Oct 22 21:29:47.880588 ncdv-master-1 devstack@n-api.service[138745]: request: GET /compute/v2.1/servers/8ea439b7-9b3c-4521-a266-d4baa48c6308 HTTP/1.1 Oct 22 21:29:47.880588 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 21:29:47.880588 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 21:29:47.880588 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 21:29:47.880588 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 0 Oct 22 21:29:47.880588 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 21:29:47.880588 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 21:29:47.880588 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 21:29:47.880588 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 21:29:47.880588 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVF_hsf3rUCViRBfvA8CnH-TfW5QSO0kevoFTs6KZljnXJUDSecsBecVt0lVrzkUSJspjAD2JsdbiZFAxQsXXsicbWy7V3pWMCwro31w9Ltc_BWmw3Yz3d34h_3OjHVQwWdhhFE9pmgJSX-JnVswRY3vnqUmGtZuFzhOlkkg5YLCVC2I Oct 22 21:29:47.880588 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 21:29:47.880588 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 21:29:47.880588 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 21:29:47.880588 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 21:29:47.880588 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 21:29:47.880588 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 21:29:47.880588 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: 435c26b86be44362be1bd042a5cb4c1f Oct 22 21:29:47.880588 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-AttachVolumeNegativeTest-80303400 Oct 22 21:29:47.880588 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 21:29:47.880588 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 21:29:47.880588 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_435c26b86be44362be1bd042a5cb4c1f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/435c26b86be44362be1bd042a5cb4c1f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/435c26b86be44362be1bd042a5cb4c1f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/435c26b86be44362be1bd042a5cb4c1f"}]}] Oct 22 21:29:47.880588 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-AttachVolumeNegativeTest-80303400 Oct 22 21:29:47.880588 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: 435c26b86be44362be1bd042a5cb4c1f Oct 22 21:29:47.880588 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-80303400 Oct 22 21:29:47.880588 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-AttachVolumeNegativeTest-80303400-project Oct 22 21:29:47.880588 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 21:29:47.880588 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 21:29:47.880588 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: 8e102b243ece4d66bf042337324b04b0 Oct 22 21:29:47.880588 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-AttachVolumeNegativeTest-80303400-project Oct 22 21:29:47.880588 ncdv-master-1 devstack@n-api.service[138745]: method: > Oct 22 21:29:47.880588 ncdv-master-1 devstack@n-api.service[138745]: exception: Instance 8ea439b7-9b3c-4521-a266-d4baa48c6308 could not be found. Oct 22 21:29:47.880588 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'id': '8ea439b7-9b3c-4521-a266-d4baa48c6308'} Oct 22 21:29:47.880588 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:29:47.880588 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:29:47.880588 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 21:29:47.880588 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 21:29:47.880588 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 21:29:47.880588 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 21:29:47.880588 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 21:29:47.880588 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 21:29:47.880588 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 21:29:47.880588 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 21:29:47.880588 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ea439b7-9b3c-4521-a266-d4baa48c6308 could not be found. Oct 22 21:29:47.880588 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:29:47.880588 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:29:47.880588 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:29:47.880588 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:29:47.880588 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:29:47.880588 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:29:47.880588 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:29:47.880588 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:29:47.880588 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:29:47.880588 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:29:47.880588 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 21:29:47.880588 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 21:29:47.880588 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 21:29:47.880588 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 21:29:47.880588 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 21:29:47.880588 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:29:47.880588 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ea439b7-9b3c-4521-a266-d4baa48c6308 could not be found. Oct 22 21:29:47.880588 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:29:47.880588 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:29:47.880588 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:29:47.885039 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:29:47.885039 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:29:47.885039 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:29:47.885039 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:29:47.885039 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:29:47.885039 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ea439b7-9b3c-4521-a266-d4baa48c6308 could not be found. Oct 22 21:29:47.885039 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:29:47.885039 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-93e5c495-c469-437f-9bc8-7d8ceea0ff52 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Returning 404 to user: Instance 8ea439b7-9b3c-4521-a266-d4baa48c6308 could not be found. {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:29:47.885039 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-93e5c495-c469-437f-9bc8-7d8ceea0ff52 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] 10.222.0.18 "GET /compute/v2.1/servers/8ea439b7-9b3c-4521-a266-d4baa48c6308" status: 404 len: 111 microversion: 2.1 time: 0.038227 Oct 22 21:29:47.886323 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2924/5824] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:29:47 2022] GET /compute/v2.1/servers/8ea439b7-9b3c-4521-a266-d4baa48c6308 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 21:29:47.892183 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-7f6305a5-8d46-467b-9c12-37bb2bdfe2e4 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Calling method '.version_select at 0x7fd39ee62700>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:29:47.913926 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-7f6305a5-8d46-467b-9c12-37bb2bdfe2e4 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-188161220" status: 202 len: 0 microversion: 2.1 time: 0.026242 Oct 22 21:29:47.914525 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2901/5825] 10.222.0.18 () {58 vars in 1218 bytes} [Sat Oct 22 21:29:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-188161220 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 22 21:29:48.545519 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-683b6af1-6738-47ea-9227-c8bb9e44843d tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Action: 'create', calling method: .version_select at 0x7fd39ef6f8b0>, body: {"keypair": {"name": "tempest-keypair-1430372656", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBsKSGj4CZX9cEdHN2MTjbhyMz8nlKAkIImthK2y+SXhJRsvH1V1EKOeu5DQrlKiFiMMCjN3OxJcuLnHLPYfZNZjJJ6evUZNKIL9oZVjTOWhIYNhIDt+FncFLYQWT3qORg=="}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:29:48.563172 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-683b6af1-6738-47ea-9227-c8bb9e44843d tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Getting quotas for project 435c26b86be44362be1bd042a5cb4c1f. Resources: {'key_pairs'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 21:29:48.569775 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-683b6af1-6738-47ea-9227-c8bb9e44843d tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Getting quotas for user 8e102b243ece4d66bf042337324b04b0 and project 435c26b86be44362be1bd042a5cb4c1f. Resources: {'key_pairs'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 21:29:48.596270 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-683b6af1-6738-47ea-9227-c8bb9e44843d tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.055220 Oct 22 21:29:48.596852 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2925/5826] 10.222.0.18 () {60 vars in 1159 bytes} [Sat Oct 22 21:29:48 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:29:49.891738 ncdv-master-1 devstack@n-api.service[138744]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 22 21:29:49.892253 ncdv-master-1 devstack@n-api.service[138744]: Sat Oct 22 21:29:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.18) !!! Oct 22 21:29:49.896852 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-ab9a7e3b-ea03-4020-95ba-eb1fe2aae492 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-90337607", "imageRef": "085e4478-6edc-4a69-8e08-f9831713eb65", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "198587bc-1a83-4ec0-b59a-75cdfe081c8b"}], "security_groups": [{"name": "tempest-securitygroup--2124975528"}], "key_name": "tempest-keypair-1430372656", "user_data": "}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:29:50.010157 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.network.neutron [None req-ab9a7e3b-ea03-4020-95ba-eb1fe2aae492 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] validate_networks() for [('198587bc-1a83-4ec0-b59a-75cdfe081c8b', None, None, None, None, None)] {{(pid=138744) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 21:29:50.407909 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-ab9a7e3b-ea03-4020-95ba-eb1fe2aae492 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Flavor limits 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 21:29:50.408341 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-ab9a7e3b-ea03-4020-95ba-eb1fe2aae492 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Image limits 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 21:29:50.408887 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-ab9a7e3b-ea03-4020-95ba-eb1fe2aae492 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Flavor pref 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 21:29:50.409303 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-ab9a7e3b-ea03-4020-95ba-eb1fe2aae492 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Image pref 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 21:29:50.409751 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-ab9a7e3b-ea03-4020-95ba-eb1fe2aae492 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 21:29:50.419604 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ab9a7e3b-ea03-4020-95ba-eb1fe2aae492 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:29:50.420095 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ab9a7e3b-ea03-4020-95ba-eb1fe2aae492 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:29:50.420539 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ab9a7e3b-ea03-4020-95ba-eb1fe2aae492 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:29:50.421275 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ab9a7e3b-ea03-4020-95ba-eb1fe2aae492 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:29:50.421740 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ab9a7e3b-ea03-4020-95ba-eb1fe2aae492 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:29:50.422180 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ab9a7e3b-ea03-4020-95ba-eb1fe2aae492 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:29:50.441881 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-ab9a7e3b-ea03-4020-95ba-eb1fe2aae492 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Getting quotas for project 435c26b86be44362be1bd042a5cb4c1f. Resources: {'cores', 'instances', 'ram'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 21:29:50.447879 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-ab9a7e3b-ea03-4020-95ba-eb1fe2aae492 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Getting quotas for user 8e102b243ece4d66bf042337324b04b0 and project 435c26b86be44362be1bd042a5cb4c1f. Resources: {'cores', 'instances', 'ram'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 21:29:50.462385 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-ab9a7e3b-ea03-4020-95ba-eb1fe2aae492 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Going to run 1 instances... {{(pid=138744) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 21:29:50.464888 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-ab9a7e3b-ea03-4020-95ba-eb1fe2aae492 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] [instance: 46c37125-ca0d-4f11-a44d-67178c850c9c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='085e4478-6edc-4a69-8e08-f9831713eb65',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138744) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 21:29:50.516201 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-ab9a7e3b-ea03-4020-95ba-eb1fe2aae492 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.626427 Oct 22 21:29:50.516880 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2902/5827] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Oct 22 21:29:49 2022] POST /compute/v2.1/servers => generated 402 bytes in 628 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 21:29:50.529948 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-21c63402-a627-472c-83b4-a31ccffa496e tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:29:50.530659 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-21c63402-a627-472c-83b4-a31ccffa496e tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] [instance: 46c37125-ca0d-4f11-a44d-67178c850c9c] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:29:50.592692 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-21c63402-a627-472c-83b4-a31ccffa496e tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e102b243ece4d66bf042337324b04b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435c26b86be44362be1bd042a5cb4c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:29:50.601991 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-21c63402-a627-472c-83b4-a31ccffa496e tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] 10.222.0.18 "GET /compute/v2.1/servers/46c37125-ca0d-4f11-a44d-67178c850c9c" status: 200 len: 1240 microversion: 2.1 time: 0.077151 Oct 22 21:29:50.602576 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2926/5828] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:29:50 2022] GET /compute/v2.1/servers/46c37125-ca0d-4f11-a44d-67178c850c9c => generated 1240 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:29:51.625958 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-46e3fc2a-f58c-4207-90da-6aa1ffe7f616 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:29:51.626607 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-46e3fc2a-f58c-4207-90da-6aa1ffe7f616 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] [instance: 46c37125-ca0d-4f11-a44d-67178c850c9c] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:29:51.684438 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-46e3fc2a-f58c-4207-90da-6aa1ffe7f616 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e102b243ece4d66bf042337324b04b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435c26b86be44362be1bd042a5cb4c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:29:51.692033 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-46e3fc2a-f58c-4207-90da-6aa1ffe7f616 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] 10.222.0.18 "GET /compute/v2.1/servers/46c37125-ca0d-4f11-a44d-67178c850c9c" status: 200 len: 1240 microversion: 2.1 time: 0.070974 Oct 22 21:29:51.692616 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2903/5829] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:29:51 2022] GET /compute/v2.1/servers/46c37125-ca0d-4f11-a44d-67178c850c9c => generated 1240 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:29:52.716366 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-4ded3d99-879a-4f34-b7ae-92beb9834bb7 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:29:52.716738 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-4ded3d99-879a-4f34-b7ae-92beb9834bb7 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] [instance: 46c37125-ca0d-4f11-a44d-67178c850c9c] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:29:52.773764 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-4ded3d99-879a-4f34-b7ae-92beb9834bb7 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e102b243ece4d66bf042337324b04b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435c26b86be44362be1bd042a5cb4c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:29:52.781128 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-4ded3d99-879a-4f34-b7ae-92beb9834bb7 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] 10.222.0.18 "GET /compute/v2.1/servers/46c37125-ca0d-4f11-a44d-67178c850c9c" status: 200 len: 1240 microversion: 2.1 time: 0.069652 Oct 22 21:29:52.781830 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2927/5830] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:29:52 2022] GET /compute/v2.1/servers/46c37125-ca0d-4f11-a44d-67178c850c9c => generated 1240 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:29:53.809408 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-247f2e93-d08d-4fdf-8b11-9d165f1a21f8 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:29:53.810268 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-247f2e93-d08d-4fdf-8b11-9d165f1a21f8 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] [instance: 46c37125-ca0d-4f11-a44d-67178c850c9c] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:29:53.879428 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-247f2e93-d08d-4fdf-8b11-9d165f1a21f8 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e102b243ece4d66bf042337324b04b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435c26b86be44362be1bd042a5cb4c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:29:53.886923 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-247f2e93-d08d-4fdf-8b11-9d165f1a21f8 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] 10.222.0.18 "GET /compute/v2.1/servers/46c37125-ca0d-4f11-a44d-67178c850c9c" status: 200 len: 1240 microversion: 2.1 time: 0.084275 Oct 22 21:29:53.887542 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2904/5831] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:29:53 2022] GET /compute/v2.1/servers/46c37125-ca0d-4f11-a44d-67178c850c9c => generated 1240 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:29:54.910831 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-7a3fe388-6f7e-4333-9844-37fdf3fa1c96 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:29:54.911429 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-7a3fe388-6f7e-4333-9844-37fdf3fa1c96 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] [instance: 46c37125-ca0d-4f11-a44d-67178c850c9c] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:29:54.918893 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7a3fe388-6f7e-4333-9844-37fdf3fa1c96 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:29:54.919406 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7a3fe388-6f7e-4333-9844-37fdf3fa1c96 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:29:54.919895 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7a3fe388-6f7e-4333-9844-37fdf3fa1c96 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:29:54.920615 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7a3fe388-6f7e-4333-9844-37fdf3fa1c96 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:29:54.921064 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7a3fe388-6f7e-4333-9844-37fdf3fa1c96 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:29:54.921540 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7a3fe388-6f7e-4333-9844-37fdf3fa1c96 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:29:54.985222 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-7a3fe388-6f7e-4333-9844-37fdf3fa1c96 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e102b243ece4d66bf042337324b04b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435c26b86be44362be1bd042a5cb4c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:29:54.993265 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-7a3fe388-6f7e-4333-9844-37fdf3fa1c96 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] 10.222.0.18 "GET /compute/v2.1/servers/46c37125-ca0d-4f11-a44d-67178c850c9c" status: 200 len: 1244 microversion: 2.1 time: 0.086819 Oct 22 21:29:54.993852 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2928/5832] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:29:54 2022] GET /compute/v2.1/servers/46c37125-ca0d-4f11-a44d-67178c850c9c => generated 1244 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:29:56.018112 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-145710e0-1662-4ec5-84f2-1b1771330380 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:29:56.018872 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-145710e0-1662-4ec5-84f2-1b1771330380 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] [instance: 46c37125-ca0d-4f11-a44d-67178c850c9c] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:29:56.028148 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-145710e0-1662-4ec5-84f2-1b1771330380 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:29:56.028687 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-145710e0-1662-4ec5-84f2-1b1771330380 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:29:56.029120 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-145710e0-1662-4ec5-84f2-1b1771330380 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:29:56.029847 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-145710e0-1662-4ec5-84f2-1b1771330380 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:29:56.030336 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-145710e0-1662-4ec5-84f2-1b1771330380 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:29:56.030768 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-145710e0-1662-4ec5-84f2-1b1771330380 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:29:56.133753 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-145710e0-1662-4ec5-84f2-1b1771330380 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e102b243ece4d66bf042337324b04b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435c26b86be44362be1bd042a5cb4c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:29:56.142183 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-145710e0-1662-4ec5-84f2-1b1771330380 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] 10.222.0.18 "GET /compute/v2.1/servers/46c37125-ca0d-4f11-a44d-67178c850c9c" status: 200 len: 1298 microversion: 2.1 time: 0.129263 Oct 22 21:29:56.142761 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2905/5833] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:29:56 2022] GET /compute/v2.1/servers/46c37125-ca0d-4f11-a44d-67178c850c9c => generated 1298 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:29:57.028429 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-290de808-f625-4b80-b841-9b3ef2acb944 req-24c4a82a-c42d-4222-a351-aeff896e52bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46c37125-ca0d-4f11-a44d-67178c850c9c", "tag": "187c9659-e760-4a55-b3db-90bdca28e1a1"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:29:57.040745 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-290de808-f625-4b80-b841-9b3ef2acb944 req-24c4a82a-c42d-4222-a351-aeff896e52bb service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:29:57.041855 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-290de808-f625-4b80-b841-9b3ef2acb944 req-24c4a82a-c42d-4222-a351-aeff896e52bb service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:29:57.042404 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-290de808-f625-4b80-b841-9b3ef2acb944 req-24c4a82a-c42d-4222-a351-aeff896e52bb service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:29:57.055178 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-290de808-f625-4b80-b841-9b3ef2acb944 req-24c4a82a-c42d-4222-a351-aeff896e52bb service nova] Creating event network-changed:187c9659-e760-4a55-b3db-90bdca28e1a1 for instance 46c37125-ca0d-4f11-a44d-67178c850c9c on nch1-master-1 Oct 22 21:29:57.060473 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-290de808-f625-4b80-b841-9b3ef2acb944 req-24c4a82a-c42d-4222-a351-aeff896e52bb service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036128 Oct 22 21:29:57.061087 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2929/5834] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:29:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 21:29:57.166388 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-ad50b50b-76f5-4fab-833d-9e61df70b899 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:29:57.167137 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-ad50b50b-76f5-4fab-833d-9e61df70b899 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] [instance: 46c37125-ca0d-4f11-a44d-67178c850c9c] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:29:57.174851 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ad50b50b-76f5-4fab-833d-9e61df70b899 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:29:57.175171 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ad50b50b-76f5-4fab-833d-9e61df70b899 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:29:57.175762 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ad50b50b-76f5-4fab-833d-9e61df70b899 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:29:57.176482 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ad50b50b-76f5-4fab-833d-9e61df70b899 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:29:57.176981 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ad50b50b-76f5-4fab-833d-9e61df70b899 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:29:57.177413 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ad50b50b-76f5-4fab-833d-9e61df70b899 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:29:57.387794 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-ad50b50b-76f5-4fab-833d-9e61df70b899 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e102b243ece4d66bf042337324b04b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435c26b86be44362be1bd042a5cb4c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:29:57.396399 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-ad50b50b-76f5-4fab-833d-9e61df70b899 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] 10.222.0.18 "GET /compute/v2.1/servers/46c37125-ca0d-4f11-a44d-67178c850c9c" status: 200 len: 1366 microversion: 2.1 time: 0.234102 Oct 22 21:29:57.396984 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2906/5835] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:29:57 2022] GET /compute/v2.1/servers/46c37125-ca0d-4f11-a44d-67178c850c9c => generated 1366 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:29:58.425676 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-3a3d58af-f739-4d2c-838a-cff51b6669ed tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:29:58.426489 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-3a3d58af-f739-4d2c-838a-cff51b6669ed tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] [instance: 46c37125-ca0d-4f11-a44d-67178c850c9c] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:29:58.434167 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3a3d58af-f739-4d2c-838a-cff51b6669ed tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:29:58.434676 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3a3d58af-f739-4d2c-838a-cff51b6669ed tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:29:58.435133 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3a3d58af-f739-4d2c-838a-cff51b6669ed tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:29:58.435887 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3a3d58af-f739-4d2c-838a-cff51b6669ed tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:29:58.436364 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3a3d58af-f739-4d2c-838a-cff51b6669ed tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:29:58.436806 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3a3d58af-f739-4d2c-838a-cff51b6669ed tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:29:58.582997 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-3a3d58af-f739-4d2c-838a-cff51b6669ed tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e102b243ece4d66bf042337324b04b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435c26b86be44362be1bd042a5cb4c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:29:58.594975 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-3a3d58af-f739-4d2c-838a-cff51b6669ed tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] 10.222.0.18 "GET /compute/v2.1/servers/46c37125-ca0d-4f11-a44d-67178c850c9c" status: 200 len: 1366 microversion: 2.1 time: 0.176429 Oct 22 21:29:58.595733 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2930/5836] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:29:58 2022] GET /compute/v2.1/servers/46c37125-ca0d-4f11-a44d-67178c850c9c => generated 1366 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:29:59.618771 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-7fd922ff-2d93-49e6-851b-98166bcc8fd4 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:29:59.619626 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-7fd922ff-2d93-49e6-851b-98166bcc8fd4 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] [instance: 46c37125-ca0d-4f11-a44d-67178c850c9c] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:29:59.626334 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7fd922ff-2d93-49e6-851b-98166bcc8fd4 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:29:59.626821 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7fd922ff-2d93-49e6-851b-98166bcc8fd4 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:29:59.627264 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7fd922ff-2d93-49e6-851b-98166bcc8fd4 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:29:59.628026 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7fd922ff-2d93-49e6-851b-98166bcc8fd4 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:29:59.628622 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7fd922ff-2d93-49e6-851b-98166bcc8fd4 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:29:59.629039 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7fd922ff-2d93-49e6-851b-98166bcc8fd4 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:29:59.850607 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-7fd922ff-2d93-49e6-851b-98166bcc8fd4 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e102b243ece4d66bf042337324b04b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435c26b86be44362be1bd042a5cb4c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:29:59.861327 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-7fd922ff-2d93-49e6-851b-98166bcc8fd4 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] 10.222.0.18 "GET /compute/v2.1/servers/46c37125-ca0d-4f11-a44d-67178c850c9c" status: 200 len: 1366 microversion: 2.1 time: 0.246626 Oct 22 21:29:59.861907 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2907/5837] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:29:59 2022] GET /compute/v2.1/servers/46c37125-ca0d-4f11-a44d-67178c850c9c => generated 1366 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:30:00.887555 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-c9465eac-a326-45ab-9953-89e20cc1cf22 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:30:00.888176 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-c9465eac-a326-45ab-9953-89e20cc1cf22 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] [instance: 46c37125-ca0d-4f11-a44d-67178c850c9c] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:30:00.896231 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c9465eac-a326-45ab-9953-89e20cc1cf22 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:30:00.896766 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c9465eac-a326-45ab-9953-89e20cc1cf22 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:30:00.897249 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c9465eac-a326-45ab-9953-89e20cc1cf22 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:30:00.898012 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c9465eac-a326-45ab-9953-89e20cc1cf22 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:30:00.898512 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c9465eac-a326-45ab-9953-89e20cc1cf22 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:30:00.898988 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c9465eac-a326-45ab-9953-89e20cc1cf22 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:30:01.032941 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-c9465eac-a326-45ab-9953-89e20cc1cf22 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e102b243ece4d66bf042337324b04b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435c26b86be44362be1bd042a5cb4c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:30:01.041310 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-c9465eac-a326-45ab-9953-89e20cc1cf22 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] 10.222.0.18 "GET /compute/v2.1/servers/46c37125-ca0d-4f11-a44d-67178c850c9c" status: 200 len: 1366 microversion: 2.1 time: 0.157998 Oct 22 21:30:01.041929 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2931/5838] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:30:00 2022] GET /compute/v2.1/servers/46c37125-ca0d-4f11-a44d-67178c850c9c => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:30:02.064756 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-fbbb3520-3449-4761-a942-ad0a79978fef tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:30:02.065370 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-fbbb3520-3449-4761-a942-ad0a79978fef tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] [instance: 46c37125-ca0d-4f11-a44d-67178c850c9c] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:30:02.067474 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell0:SELECT=2 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:30:02.074022 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fbbb3520-3449-4761-a942-ad0a79978fef tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:30:02.074520 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fbbb3520-3449-4761-a942-ad0a79978fef tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:30:02.074993 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fbbb3520-3449-4761-a942-ad0a79978fef tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:30:02.075734 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fbbb3520-3449-4761-a942-ad0a79978fef tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:30:02.076200 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fbbb3520-3449-4761-a942-ad0a79978fef tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:30:02.076638 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fbbb3520-3449-4761-a942-ad0a79978fef tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:30:02.208058 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-fbbb3520-3449-4761-a942-ad0a79978fef tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e102b243ece4d66bf042337324b04b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435c26b86be44362be1bd042a5cb4c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:30:02.219850 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-fbbb3520-3449-4761-a942-ad0a79978fef tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] 10.222.0.18 "GET /compute/v2.1/servers/46c37125-ca0d-4f11-a44d-67178c850c9c" status: 200 len: 1366 microversion: 2.1 time: 0.158773 Oct 22 21:30:02.220599 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2908/5839] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:30:02 2022] GET /compute/v2.1/servers/46c37125-ca0d-4f11-a44d-67178c850c9c => generated 1366 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:30:02.602466 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-c5e28a52-4873-4b06-8fb9-a52f25a1aa8b req-1613d087-e0af-4c83-bbdc-8dcd5164b365 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46c37125-ca0d-4f11-a44d-67178c850c9c", "name": "network-vif-plugged", "status": "completed", "tag": "187c9659-e760-4a55-b3db-90bdca28e1a1"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:30:02.614109 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-c5e28a52-4873-4b06-8fb9-a52f25a1aa8b req-1613d087-e0af-4c83-bbdc-8dcd5164b365 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:30:02.614549 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-c5e28a52-4873-4b06-8fb9-a52f25a1aa8b req-1613d087-e0af-4c83-bbdc-8dcd5164b365 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:30:02.615038 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-c5e28a52-4873-4b06-8fb9-a52f25a1aa8b req-1613d087-e0af-4c83-bbdc-8dcd5164b365 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:30:02.626794 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-c5e28a52-4873-4b06-8fb9-a52f25a1aa8b req-1613d087-e0af-4c83-bbdc-8dcd5164b365 service nova] Creating event network-vif-plugged:187c9659-e760-4a55-b3db-90bdca28e1a1 for instance 46c37125-ca0d-4f11-a44d-67178c850c9c on nch1-master-1 Oct 22 21:30:02.632075 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-c5e28a52-4873-4b06-8fb9-a52f25a1aa8b req-1613d087-e0af-4c83-bbdc-8dcd5164b365 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034559 Oct 22 21:30:02.632986 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2932/5840] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:30:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:30:03.253528 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-5400c782-3d6a-4d30-8589-f97f482d7e52 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:30:03.254169 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-5400c782-3d6a-4d30-8589-f97f482d7e52 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] [instance: 46c37125-ca0d-4f11-a44d-67178c850c9c] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:30:03.261905 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5400c782-3d6a-4d30-8589-f97f482d7e52 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:30:03.262418 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5400c782-3d6a-4d30-8589-f97f482d7e52 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:30:03.262889 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5400c782-3d6a-4d30-8589-f97f482d7e52 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:30:03.263661 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5400c782-3d6a-4d30-8589-f97f482d7e52 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:30:03.264149 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5400c782-3d6a-4d30-8589-f97f482d7e52 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:30:03.264600 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5400c782-3d6a-4d30-8589-f97f482d7e52 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:30:03.407161 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-5400c782-3d6a-4d30-8589-f97f482d7e52 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e102b243ece4d66bf042337324b04b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435c26b86be44362be1bd042a5cb4c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:30:03.419072 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-5400c782-3d6a-4d30-8589-f97f482d7e52 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] 10.222.0.18 "GET /compute/v2.1/servers/46c37125-ca0d-4f11-a44d-67178c850c9c" status: 200 len: 1366 microversion: 2.1 time: 0.171962 Oct 22 21:30:03.419908 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2909/5841] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:30:03 2022] GET /compute/v2.1/servers/46c37125-ca0d-4f11-a44d-67178c850c9c => generated 1366 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:30:04.443739 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell0:SELECT=8 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:30:04.452717 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-beaed47c-d2aa-4a25-a0e0-ec778168b26b tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:30:04.453932 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-beaed47c-d2aa-4a25-a0e0-ec778168b26b tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] [instance: 46c37125-ca0d-4f11-a44d-67178c850c9c] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:30:04.462650 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-beaed47c-d2aa-4a25-a0e0-ec778168b26b tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:30:04.463161 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-beaed47c-d2aa-4a25-a0e0-ec778168b26b tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:30:04.463661 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-beaed47c-d2aa-4a25-a0e0-ec778168b26b tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:30:04.464392 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-beaed47c-d2aa-4a25-a0e0-ec778168b26b tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:30:04.464871 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-beaed47c-d2aa-4a25-a0e0-ec778168b26b tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:30:04.465323 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-beaed47c-d2aa-4a25-a0e0-ec778168b26b tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:30:04.609099 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-beaed47c-d2aa-4a25-a0e0-ec778168b26b tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e102b243ece4d66bf042337324b04b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435c26b86be44362be1bd042a5cb4c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:30:04.621861 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-beaed47c-d2aa-4a25-a0e0-ec778168b26b tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] 10.222.0.18 "GET /compute/v2.1/servers/46c37125-ca0d-4f11-a44d-67178c850c9c" status: 200 len: 1556 microversion: 2.1 time: 0.179935 Oct 22 21:30:04.622585 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2933/5842] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:30:04 2022] GET /compute/v2.1/servers/46c37125-ca0d-4f11-a44d-67178c850c9c => generated 1556 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:30:04.644945 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-c94b5a73-dbc7-4c37-8b6c-19e9f18d2886 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:30:04.645510 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-c94b5a73-dbc7-4c37-8b6c-19e9f18d2886 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] [instance: 46c37125-ca0d-4f11-a44d-67178c850c9c] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:30:04.647382 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell0:SELECT=10 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:30:04.653817 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c94b5a73-dbc7-4c37-8b6c-19e9f18d2886 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:30:04.654317 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c94b5a73-dbc7-4c37-8b6c-19e9f18d2886 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:30:04.654760 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c94b5a73-dbc7-4c37-8b6c-19e9f18d2886 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:30:04.655496 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c94b5a73-dbc7-4c37-8b6c-19e9f18d2886 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:30:04.655957 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c94b5a73-dbc7-4c37-8b6c-19e9f18d2886 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:30:04.656394 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c94b5a73-dbc7-4c37-8b6c-19e9f18d2886 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:30:04.734826 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-c94b5a73-dbc7-4c37-8b6c-19e9f18d2886 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] 10.222.0.18 "GET /compute/v2.1/servers/46c37125-ca0d-4f11-a44d-67178c850c9c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093916 Oct 22 21:30:04.735456 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2910/5843] 10.222.0.18 () {58 vars in 1275 bytes} [Sat Oct 22 21:30:04 2022] GET /compute/v2.1/servers/46c37125-ca0d-4f11-a44d-67178c850c9c/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:30:06.021663 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-d8e32d0d-fbdb-4821-bdda-88d0f3969727 req-e82516b3-246c-4620-93af-c9985068bd51 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46c37125-ca0d-4f11-a44d-67178c850c9c", "tag": "187c9659-e760-4a55-b3db-90bdca28e1a1"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:30:06.031569 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-d8e32d0d-fbdb-4821-bdda-88d0f3969727 req-e82516b3-246c-4620-93af-c9985068bd51 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:30:06.032067 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-d8e32d0d-fbdb-4821-bdda-88d0f3969727 req-e82516b3-246c-4620-93af-c9985068bd51 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:30:06.032516 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-d8e32d0d-fbdb-4821-bdda-88d0f3969727 req-e82516b3-246c-4620-93af-c9985068bd51 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:30:06.044328 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-d8e32d0d-fbdb-4821-bdda-88d0f3969727 req-e82516b3-246c-4620-93af-c9985068bd51 service nova] Creating event network-changed:187c9659-e760-4a55-b3db-90bdca28e1a1 for instance 46c37125-ca0d-4f11-a44d-67178c850c9c on nch1-master-1 Oct 22 21:30:06.049768 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-d8e32d0d-fbdb-4821-bdda-88d0f3969727 req-e82516b3-246c-4620-93af-c9985068bd51 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098637 Oct 22 21:30:06.051385 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2934/5844] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:30:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:31:10.309585 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:31:10.310867 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:31:10.400723 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-b12ba33c-1d91-4f28-8a39-699af5393b8b tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:31:10.401314 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-b12ba33c-1d91-4f28-8a39-699af5393b8b tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] [instance: 46c37125-ca0d-4f11-a44d-67178c850c9c] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:31:10.407571 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b12ba33c-1d91-4f28-8a39-699af5393b8b tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:31:10.408067 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b12ba33c-1d91-4f28-8a39-699af5393b8b tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:31:10.408515 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b12ba33c-1d91-4f28-8a39-699af5393b8b tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:31:10.409224 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b12ba33c-1d91-4f28-8a39-699af5393b8b tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:31:10.409688 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b12ba33c-1d91-4f28-8a39-699af5393b8b tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:31:10.410121 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b12ba33c-1d91-4f28-8a39-699af5393b8b tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:31:10.434330 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-b12ba33c-1d91-4f28-8a39-699af5393b8b tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] 10.222.0.18 "GET /compute/v2.1/servers/46c37125-ca0d-4f11-a44d-67178c850c9c/ips" status: 200 len: 150 microversion: 2.1 time: 0.129278 Oct 22 21:31:10.434882 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2911/5845] 10.222.0.18 () {58 vars in 1248 bytes} [Sat Oct 22 21:31:10 2022] GET /compute/v2.1/servers/46c37125-ca0d-4f11-a44d-67178c850c9c/ips => generated 150 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:31:11.802856 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=1 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:31:11.803814 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:31:11.808578 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-7ce6d0ee-37c0-4cd9-aae1-179cdf702331 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4a610bf5-5949-4ccb-8b42-27f77570dcf0"}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:31:11.811093 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-7ce6d0ee-37c0-4cd9-aae1-179cdf702331 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] [instance: 46c37125-ca0d-4f11-a44d-67178c850c9c] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:31:11.819104 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7ce6d0ee-37c0-4cd9-aae1-179cdf702331 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:31:11.819690 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7ce6d0ee-37c0-4cd9-aae1-179cdf702331 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:31:11.820149 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7ce6d0ee-37c0-4cd9-aae1-179cdf702331 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:31:11.820880 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7ce6d0ee-37c0-4cd9-aae1-179cdf702331 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:31:11.821350 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7ce6d0ee-37c0-4cd9-aae1-179cdf702331 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:31:11.821801 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7ce6d0ee-37c0-4cd9-aae1-179cdf702331 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:31:12.099266 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-7ce6d0ee-37c0-4cd9-aae1-179cdf702331 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] 10.222.0.18 "POST /compute/v2.1/servers/46c37125-ca0d-4f11-a44d-67178c850c9c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.298914 Oct 22 21:31:12.099999 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2935/5846] 10.222.0.18 () {60 vars in 1323 bytes} [Sat Oct 22 21:31:11 2022] POST /compute/v2.1/servers/46c37125-ca0d-4f11-a44d-67178c850c9c/os-volume_attachments => generated 194 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:31:15.544786 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-a5edaf68-a676-44e3-aa19-a5bcba6e0d58 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:31:15.545436 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-a5edaf68-a676-44e3-aa19-a5bcba6e0d58 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] [instance: 46c37125-ca0d-4f11-a44d-67178c850c9c] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:31:15.553138 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a5edaf68-a676-44e3-aa19-a5bcba6e0d58 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:31:15.553566 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a5edaf68-a676-44e3-aa19-a5bcba6e0d58 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:31:15.554014 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a5edaf68-a676-44e3-aa19-a5bcba6e0d58 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:31:15.554718 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a5edaf68-a676-44e3-aa19-a5bcba6e0d58 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:31:15.555182 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a5edaf68-a676-44e3-aa19-a5bcba6e0d58 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:31:15.555751 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a5edaf68-a676-44e3-aa19-a5bcba6e0d58 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:31:15.650979 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.objects.instance [None req-a5edaf68-a676-44e3-aa19-a5bcba6e0d58 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lazy-loading 'services' on Instance uuid 46c37125-ca0d-4f11-a44d-67178c850c9c {{(pid=138744) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 21:31:15.727410 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-a5edaf68-a676-44e3-aa19-a5bcba6e0d58 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] 10.222.0.18 "DELETE /compute/v2.1/servers/46c37125-ca0d-4f11-a44d-67178c850c9c/os-volume_attachments/4a610bf5-5949-4ccb-8b42-27f77570dcf0" status: 202 len: 0 microversion: 2.1 time: 0.186618 Oct 22 21:31:15.728268 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2912/5847] 10.222.0.18 () {58 vars in 1416 bytes} [Sat Oct 22 21:31:15 2022] DELETE /compute/v2.1/servers/46c37125-ca0d-4f11-a44d-67178c850c9c/os-volume_attachments/4a610bf5-5949-4ccb-8b42-27f77570dcf0 => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 21:31:15.738352 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-9a9c4dba-e7c2-4dd4-8f7d-d0d7404b16bb tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:31:15.740924 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-9a9c4dba-e7c2-4dd4-8f7d-d0d7404b16bb tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] [instance: 46c37125-ca0d-4f11-a44d-67178c850c9c] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:31:15.748649 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9a9c4dba-e7c2-4dd4-8f7d-d0d7404b16bb tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:31:15.748862 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9a9c4dba-e7c2-4dd4-8f7d-d0d7404b16bb tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:31:15.749283 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9a9c4dba-e7c2-4dd4-8f7d-d0d7404b16bb tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:31:15.750117 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9a9c4dba-e7c2-4dd4-8f7d-d0d7404b16bb tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:31:15.750661 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9a9c4dba-e7c2-4dd4-8f7d-d0d7404b16bb tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:31:15.751104 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9a9c4dba-e7c2-4dd4-8f7d-d0d7404b16bb tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:31:15.784671 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-9a9c4dba-e7c2-4dd4-8f7d-d0d7404b16bb tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] 10.222.0.18 "GET /compute/v2.1/servers/46c37125-ca0d-4f11-a44d-67178c850c9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051621 Oct 22 21:31:15.785385 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2936/5848] 10.222.0.18 () {58 vars in 1302 bytes} [Sat Oct 22 21:31:15 2022] GET /compute/v2.1/servers/46c37125-ca0d-4f11-a44d-67178c850c9c/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:31:16.798291 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-2d06792d-0042-4482-8d5d-5ac096f3578e tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:31:16.800748 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-2d06792d-0042-4482-8d5d-5ac096f3578e tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] [instance: 46c37125-ca0d-4f11-a44d-67178c850c9c] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:31:16.808389 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2d06792d-0042-4482-8d5d-5ac096f3578e tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:31:16.808881 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2d06792d-0042-4482-8d5d-5ac096f3578e tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:31:16.809362 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2d06792d-0042-4482-8d5d-5ac096f3578e tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:31:16.810051 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2d06792d-0042-4482-8d5d-5ac096f3578e tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:31:16.810541 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2d06792d-0042-4482-8d5d-5ac096f3578e tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:31:16.810971 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2d06792d-0042-4482-8d5d-5ac096f3578e tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:31:16.843676 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-2d06792d-0042-4482-8d5d-5ac096f3578e tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] 10.222.0.18 "GET /compute/v2.1/servers/46c37125-ca0d-4f11-a44d-67178c850c9c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049753 Oct 22 21:31:16.844277 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2913/5849] 10.222.0.18 () {58 vars in 1302 bytes} [Sat Oct 22 21:31:16 2022] GET /compute/v2.1/servers/46c37125-ca0d-4f11-a44d-67178c850c9c/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 22 21:31:16.912161 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-88f729ad-7cb8-457e-b740-f406c7f44f9f tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:31:16.912686 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-88f729ad-7cb8-457e-b740-f406c7f44f9f tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] [instance: 46c37125-ca0d-4f11-a44d-67178c850c9c] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:31:16.920021 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-88f729ad-7cb8-457e-b740-f406c7f44f9f tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:31:16.920530 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-88f729ad-7cb8-457e-b740-f406c7f44f9f tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:31:16.920996 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-88f729ad-7cb8-457e-b740-f406c7f44f9f tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:31:16.921717 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-88f729ad-7cb8-457e-b740-f406c7f44f9f tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:31:16.922194 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-88f729ad-7cb8-457e-b740-f406c7f44f9f tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:31:16.922640 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-88f729ad-7cb8-457e-b740-f406c7f44f9f tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:31:16.948786 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-88f729ad-7cb8-457e-b740-f406c7f44f9f tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] [instance: 46c37125-ca0d-4f11-a44d-67178c850c9c] Going to try to terminate instance {{(pid=138745) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 21:31:17.030922 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-88f729ad-7cb8-457e-b740-f406c7f44f9f tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] 10.222.0.18 "DELETE /compute/v2.1/servers/46c37125-ca0d-4f11-a44d-67178c850c9c" status: 204 len: 0 microversion: 2.1 time: 0.122455 Oct 22 21:31:17.031880 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2937/5850] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 21:31:16 2022] DELETE /compute/v2.1/servers/46c37125-ca0d-4f11-a44d-67178c850c9c => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 21:31:17.040816 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-396ab090-714f-4c1a-ac33-4196fdb984ce tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:31:17.041425 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-396ab090-714f-4c1a-ac33-4196fdb984ce tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] [instance: 46c37125-ca0d-4f11-a44d-67178c850c9c] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:31:17.047815 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-396ab090-714f-4c1a-ac33-4196fdb984ce tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:31:17.048332 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-396ab090-714f-4c1a-ac33-4196fdb984ce tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:31:17.048798 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-396ab090-714f-4c1a-ac33-4196fdb984ce tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:31:17.049498 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-396ab090-714f-4c1a-ac33-4196fdb984ce tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:31:17.049959 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-396ab090-714f-4c1a-ac33-4196fdb984ce tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:31:17.050397 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-396ab090-714f-4c1a-ac33-4196fdb984ce tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:31:17.181862 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-396ab090-714f-4c1a-ac33-4196fdb984ce tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e102b243ece4d66bf042337324b04b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435c26b86be44362be1bd042a5cb4c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:31:17.190858 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-396ab090-714f-4c1a-ac33-4196fdb984ce tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] 10.222.0.18 "GET /compute/v2.1/servers/46c37125-ca0d-4f11-a44d-67178c850c9c" status: 200 len: 1681 microversion: 2.1 time: 0.154233 Oct 22 21:31:17.191469 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2914/5851] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:31:17 2022] GET /compute/v2.1/servers/46c37125-ca0d-4f11-a44d-67178c850c9c => generated 1681 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:31:18.219995 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-46d71e7e-e2a4-4032-a6e7-9cde9689160e tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:31:18.221140 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-46d71e7e-e2a4-4032-a6e7-9cde9689160e tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] [instance: 46c37125-ca0d-4f11-a44d-67178c850c9c] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:31:18.232335 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-46d71e7e-e2a4-4032-a6e7-9cde9689160e tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:31:18.232834 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-46d71e7e-e2a4-4032-a6e7-9cde9689160e tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:31:18.233288 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-46d71e7e-e2a4-4032-a6e7-9cde9689160e tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:31:18.234004 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-46d71e7e-e2a4-4032-a6e7-9cde9689160e tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:31:18.234476 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-46d71e7e-e2a4-4032-a6e7-9cde9689160e tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:31:18.234909 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-46d71e7e-e2a4-4032-a6e7-9cde9689160e tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:31:18.371395 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-46d71e7e-e2a4-4032-a6e7-9cde9689160e tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e102b243ece4d66bf042337324b04b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435c26b86be44362be1bd042a5cb4c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:31:18.383735 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-46d71e7e-e2a4-4032-a6e7-9cde9689160e tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] 10.222.0.18 "GET /compute/v2.1/servers/46c37125-ca0d-4f11-a44d-67178c850c9c" status: 200 len: 1681 microversion: 2.1 time: 0.170709 Oct 22 21:31:18.384528 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2938/5852] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:31:18 2022] GET /compute/v2.1/servers/46c37125-ca0d-4f11-a44d-67178c850c9c => generated 1681 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:31:19.407529 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-77945d45-147e-4095-ab7e-fe2327ef5079 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:31:19.408292 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-77945d45-147e-4095-ab7e-fe2327ef5079 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] [instance: 46c37125-ca0d-4f11-a44d-67178c850c9c] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:31:19.415672 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-77945d45-147e-4095-ab7e-fe2327ef5079 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:31:19.416098 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-77945d45-147e-4095-ab7e-fe2327ef5079 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:31:19.416538 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-77945d45-147e-4095-ab7e-fe2327ef5079 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:31:19.417669 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-77945d45-147e-4095-ab7e-fe2327ef5079 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:31:19.417669 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-77945d45-147e-4095-ab7e-fe2327ef5079 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:31:19.418284 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-77945d45-147e-4095-ab7e-fe2327ef5079 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:31:19.516544 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-77945d45-147e-4095-ab7e-fe2327ef5079 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e102b243ece4d66bf042337324b04b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435c26b86be44362be1bd042a5cb4c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:31:19.525554 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-77945d45-147e-4095-ab7e-fe2327ef5079 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] 10.222.0.18 "GET /compute/v2.1/servers/46c37125-ca0d-4f11-a44d-67178c850c9c" status: 200 len: 1613 microversion: 2.1 time: 0.122091 Oct 22 21:31:19.526479 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2915/5853] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:31:19 2022] GET /compute/v2.1/servers/46c37125-ca0d-4f11-a44d-67178c850c9c => generated 1613 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:31:19.749426 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-1344b2da-ee27-44c9-be07-fa2c64bdd818 req-52f77f17-af98-49eb-bf3f-e24a9fb11dd1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46c37125-ca0d-4f11-a44d-67178c850c9c", "name": "network-vif-deleted", "tag": "187c9659-e760-4a55-b3db-90bdca28e1a1"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:31:19.760677 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-1344b2da-ee27-44c9-be07-fa2c64bdd818 req-52f77f17-af98-49eb-bf3f-e24a9fb11dd1 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:31:19.761181 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-1344b2da-ee27-44c9-be07-fa2c64bdd818 req-52f77f17-af98-49eb-bf3f-e24a9fb11dd1 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:31:19.761932 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-1344b2da-ee27-44c9-be07-fa2c64bdd818 req-52f77f17-af98-49eb-bf3f-e24a9fb11dd1 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:31:19.774419 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-1344b2da-ee27-44c9-be07-fa2c64bdd818 req-52f77f17-af98-49eb-bf3f-e24a9fb11dd1 service nova] Creating event network-vif-deleted:187c9659-e760-4a55-b3db-90bdca28e1a1 for instance 46c37125-ca0d-4f11-a44d-67178c850c9c on nch1-master-1 Oct 22 21:31:19.787871 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-1344b2da-ee27-44c9-be07-fa2c64bdd818 req-52f77f17-af98-49eb-bf3f-e24a9fb11dd1 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.145473 Oct 22 21:31:19.789086 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2939/5854] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:31:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:31:20.549812 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-b7199f74-ce71-4912-aa38-245c5b142157 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:31:20.550456 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-b7199f74-ce71-4912-aa38-245c5b142157 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] [instance: 46c37125-ca0d-4f11-a44d-67178c850c9c] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:31:20.558378 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b7199f74-ce71-4912-aa38-245c5b142157 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:31:20.559193 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b7199f74-ce71-4912-aa38-245c5b142157 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:31:20.559697 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b7199f74-ce71-4912-aa38-245c5b142157 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:31:20.560550 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b7199f74-ce71-4912-aa38-245c5b142157 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:31:20.561016 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b7199f74-ce71-4912-aa38-245c5b142157 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:31:20.561445 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b7199f74-ce71-4912-aa38-245c5b142157 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:31:20.576911 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-b7199f74-ce71-4912-aa38-245c5b142157 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] HTTP exception thrown: Instance 46c37125-ca0d-4f11-a44d-67178c850c9c could not be found. Oct 22 21:31:20.578709 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-b7199f74-ce71-4912-aa38-245c5b142157 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Request method failure captured: Oct 22 21:31:20.578709 ncdv-master-1 devstack@n-api.service[138744]: request: GET /compute/v2.1/servers/46c37125-ca0d-4f11-a44d-67178c850c9c HTTP/1.1 Oct 22 21:31:20.578709 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 21:31:20.578709 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 21:31:20.578709 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 21:31:20.578709 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 0 Oct 22 21:31:20.578709 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 21:31:20.578709 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 21:31:20.578709 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 21:31:20.578709 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 21:31:20.578709 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVF_hsf3rUCViRBfvA8CnH-TfW5QSO0kevoFTs6KZljnXJUDSecsBecVt0lVrzkUSJspjAD2JsdbiZFAxQsXXsicbWy7V3pWMCwro31w9Ltc_BWmw3Yz3d34h_3OjHVQwWdhhFE9pmgJSX-JnVswRY3vnqUmGtZuFzhOlkkg5YLCVC2I Oct 22 21:31:20.578709 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 21:31:20.578709 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 21:31:20.578709 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 21:31:20.578709 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 21:31:20.578709 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 21:31:20.578709 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 21:31:20.578709 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: 435c26b86be44362be1bd042a5cb4c1f Oct 22 21:31:20.578709 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-AttachVolumeNegativeTest-80303400 Oct 22 21:31:20.578709 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 21:31:20.578709 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 21:31:20.578709 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_435c26b86be44362be1bd042a5cb4c1f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/435c26b86be44362be1bd042a5cb4c1f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/435c26b86be44362be1bd042a5cb4c1f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/435c26b86be44362be1bd042a5cb4c1f"}]}] Oct 22 21:31:20.578709 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-AttachVolumeNegativeTest-80303400 Oct 22 21:31:20.578709 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: 435c26b86be44362be1bd042a5cb4c1f Oct 22 21:31:20.578709 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-80303400 Oct 22 21:31:20.578709 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-AttachVolumeNegativeTest-80303400-project Oct 22 21:31:20.578709 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 21:31:20.578709 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 21:31:20.578709 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: 8e102b243ece4d66bf042337324b04b0 Oct 22 21:31:20.578709 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-AttachVolumeNegativeTest-80303400-project Oct 22 21:31:20.578709 ncdv-master-1 devstack@n-api.service[138744]: method: > Oct 22 21:31:20.578709 ncdv-master-1 devstack@n-api.service[138744]: exception: Instance 46c37125-ca0d-4f11-a44d-67178c850c9c could not be found. Oct 22 21:31:20.578709 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': '46c37125-ca0d-4f11-a44d-67178c850c9c'} Oct 22 21:31:20.578709 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:31:20.578709 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:31:20.578709 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 21:31:20.578709 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 21:31:20.578709 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 21:31:20.578709 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 21:31:20.578709 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 21:31:20.578709 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 21:31:20.578709 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 21:31:20.578709 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 21:31:20.578709 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 46c37125-ca0d-4f11-a44d-67178c850c9c could not be found. Oct 22 21:31:20.578709 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:31:20.578709 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:31:20.578709 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:31:20.578709 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:31:20.578709 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:31:20.578709 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:31:20.578709 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:31:20.578709 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:31:20.578709 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:31:20.578709 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:31:20.578709 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 21:31:20.578709 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 21:31:20.578709 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 21:31:20.578709 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 21:31:20.578709 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 21:31:20.578709 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:31:20.578709 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 46c37125-ca0d-4f11-a44d-67178c850c9c could not be found. Oct 22 21:31:20.578709 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:31:20.578709 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:31:20.578709 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:31:20.583270 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:31:20.583270 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:31:20.583270 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:31:20.583270 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:31:20.583270 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:31:20.583270 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 46c37125-ca0d-4f11-a44d-67178c850c9c could not be found. Oct 22 21:31:20.583270 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:31:20.583270 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-b7199f74-ce71-4912-aa38-245c5b142157 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Returning 404 to user: Instance 46c37125-ca0d-4f11-a44d-67178c850c9c could not be found. {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:31:20.583270 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-b7199f74-ce71-4912-aa38-245c5b142157 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] 10.222.0.18 "GET /compute/v2.1/servers/46c37125-ca0d-4f11-a44d-67178c850c9c" status: 404 len: 111 microversion: 2.1 time: 0.036533 Oct 22 21:31:20.584248 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2916/5855] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:31:20 2022] GET /compute/v2.1/servers/46c37125-ca0d-4f11-a44d-67178c850c9c => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 21:31:20.593848 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-f0a544d1-91df-4d85-8c9a-41cf3c49f5a5 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Calling method '.version_select at 0x7fd39c59aa60>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:31:20.616881 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-f0a544d1-91df-4d85-8c9a-41cf3c49f5a5 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1430372656" status: 202 len: 0 microversion: 2.1 time: 0.027424 Oct 22 21:31:20.617753 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2940/5856] 10.222.0.18 () {58 vars in 1221 bytes} [Sat Oct 22 21:31:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1430372656 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 21:31:22.752241 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-b2c316c4-8dc9-4ca9-9ca7-205b6ac43b8c tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:31:22.752796 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-b2c316c4-8dc9-4ca9-9ca7-205b6ac43b8c tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] [instance: 46c37125-ca0d-4f11-a44d-67178c850c9c] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:31:22.759690 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b2c316c4-8dc9-4ca9-9ca7-205b6ac43b8c tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:31:22.760183 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b2c316c4-8dc9-4ca9-9ca7-205b6ac43b8c tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:31:22.760629 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b2c316c4-8dc9-4ca9-9ca7-205b6ac43b8c tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:31:22.761368 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b2c316c4-8dc9-4ca9-9ca7-205b6ac43b8c tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:31:22.761830 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b2c316c4-8dc9-4ca9-9ca7-205b6ac43b8c tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:31:22.762259 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b2c316c4-8dc9-4ca9-9ca7-205b6ac43b8c tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:31:22.778724 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-b2c316c4-8dc9-4ca9-9ca7-205b6ac43b8c tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] HTTP exception thrown: Instance 46c37125-ca0d-4f11-a44d-67178c850c9c could not be found. Oct 22 21:31:22.780222 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-b2c316c4-8dc9-4ca9-9ca7-205b6ac43b8c tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Request method failure captured: Oct 22 21:31:22.780222 ncdv-master-1 devstack@n-api.service[138744]: request: DELETE /compute/v2.1/servers/46c37125-ca0d-4f11-a44d-67178c850c9c HTTP/1.1 Oct 22 21:31:22.780222 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 21:31:22.780222 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 21:31:22.780222 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 21:31:22.780222 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 0 Oct 22 21:31:22.780222 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 21:31:22.780222 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 21:31:22.780222 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 21:31:22.780222 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 21:31:22.780222 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVF_hsf3rUCViRBfvA8CnH-TfW5QSO0kevoFTs6KZljnXJUDSecsBecVt0lVrzkUSJspjAD2JsdbiZFAxQsXXsicbWy7V3pWMCwro31w9Ltc_BWmw3Yz3d34h_3OjHVQwWdhhFE9pmgJSX-JnVswRY3vnqUmGtZuFzhOlkkg5YLCVC2I Oct 22 21:31:22.780222 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 21:31:22.780222 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 21:31:22.780222 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 21:31:22.780222 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 21:31:22.780222 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 21:31:22.780222 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 21:31:22.780222 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: 435c26b86be44362be1bd042a5cb4c1f Oct 22 21:31:22.780222 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-AttachVolumeNegativeTest-80303400 Oct 22 21:31:22.780222 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 21:31:22.780222 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 21:31:22.780222 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_435c26b86be44362be1bd042a5cb4c1f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/435c26b86be44362be1bd042a5cb4c1f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/435c26b86be44362be1bd042a5cb4c1f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/435c26b86be44362be1bd042a5cb4c1f"}]}] Oct 22 21:31:22.780222 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-AttachVolumeNegativeTest-80303400 Oct 22 21:31:22.780222 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: 435c26b86be44362be1bd042a5cb4c1f Oct 22 21:31:22.780222 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-80303400 Oct 22 21:31:22.780222 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-AttachVolumeNegativeTest-80303400-project Oct 22 21:31:22.780222 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 21:31:22.780222 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 21:31:22.780222 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: 8e102b243ece4d66bf042337324b04b0 Oct 22 21:31:22.780222 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-AttachVolumeNegativeTest-80303400-project Oct 22 21:31:22.780222 ncdv-master-1 devstack@n-api.service[138744]: method: > Oct 22 21:31:22.780222 ncdv-master-1 devstack@n-api.service[138744]: exception: Instance 46c37125-ca0d-4f11-a44d-67178c850c9c could not be found. Oct 22 21:31:22.780222 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': '46c37125-ca0d-4f11-a44d-67178c850c9c'} Oct 22 21:31:22.780222 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:31:22.780222 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:31:22.780222 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 21:31:22.780222 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 21:31:22.780222 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 21:31:22.780222 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 21:31:22.780222 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 21:31:22.780222 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 21:31:22.780222 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 21:31:22.780222 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 21:31:22.780222 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 46c37125-ca0d-4f11-a44d-67178c850c9c could not be found. Oct 22 21:31:22.780222 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:31:22.780222 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:31:22.780222 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:31:22.780222 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:31:22.780222 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:31:22.780222 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:31:22.780222 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:31:22.780222 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:31:22.780222 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:31:22.780222 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:31:22.780222 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 22 21:31:22.780222 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 22 21:31:22.780222 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 22 21:31:22.780222 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 22 21:31:22.780222 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 21:31:22.780222 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 21:31:22.780222 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 21:31:22.780222 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:31:22.784489 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 46c37125-ca0d-4f11-a44d-67178c850c9c could not be found. Oct 22 21:31:22.784489 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:31:22.784489 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:31:22.784489 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:31:22.784489 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:31:22.784489 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:31:22.784489 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:31:22.784489 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:31:22.784489 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:31:22.784489 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 46c37125-ca0d-4f11-a44d-67178c850c9c could not be found. Oct 22 21:31:22.784489 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:31:22.784489 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-b2c316c4-8dc9-4ca9-9ca7-205b6ac43b8c tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Returning 404 to user: Instance 46c37125-ca0d-4f11-a44d-67178c850c9c could not be found. {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:31:22.784489 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-b2c316c4-8dc9-4ca9-9ca7-205b6ac43b8c tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] 10.222.0.18 "DELETE /compute/v2.1/servers/46c37125-ca0d-4f11-a44d-67178c850c9c" status: 404 len: 111 microversion: 2.1 time: 0.033760 Oct 22 21:31:22.784489 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2917/5857] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 21:31:22 2022] DELETE /compute/v2.1/servers/46c37125-ca0d-4f11-a44d-67178c850c9c => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 21:31:22.791497 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-e8c9e790-ed04-45b6-bc07-062dc641b369 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:31:22.792259 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-e8c9e790-ed04-45b6-bc07-062dc641b369 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] [instance: 46c37125-ca0d-4f11-a44d-67178c850c9c] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:31:22.802712 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e8c9e790-ed04-45b6-bc07-062dc641b369 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:31:22.803205 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e8c9e790-ed04-45b6-bc07-062dc641b369 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:31:22.803691 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e8c9e790-ed04-45b6-bc07-062dc641b369 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:31:22.804404 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e8c9e790-ed04-45b6-bc07-062dc641b369 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:31:22.804873 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e8c9e790-ed04-45b6-bc07-062dc641b369 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:31:22.805311 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e8c9e790-ed04-45b6-bc07-062dc641b369 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:31:22.819125 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.wsgi [None req-e8c9e790-ed04-45b6-bc07-062dc641b369 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] HTTP exception thrown: Instance 46c37125-ca0d-4f11-a44d-67178c850c9c could not be found. Oct 22 21:31:22.820912 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-e8c9e790-ed04-45b6-bc07-062dc641b369 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Request method failure captured: Oct 22 21:31:22.820912 ncdv-master-1 devstack@n-api.service[138745]: request: GET /compute/v2.1/servers/46c37125-ca0d-4f11-a44d-67178c850c9c HTTP/1.1 Oct 22 21:31:22.820912 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 21:31:22.820912 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 21:31:22.820912 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 21:31:22.820912 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 0 Oct 22 21:31:22.820912 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 21:31:22.820912 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 21:31:22.820912 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 21:31:22.820912 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 21:31:22.820912 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVF_hsf3rUCViRBfvA8CnH-TfW5QSO0kevoFTs6KZljnXJUDSecsBecVt0lVrzkUSJspjAD2JsdbiZFAxQsXXsicbWy7V3pWMCwro31w9Ltc_BWmw3Yz3d34h_3OjHVQwWdhhFE9pmgJSX-JnVswRY3vnqUmGtZuFzhOlkkg5YLCVC2I Oct 22 21:31:22.820912 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 21:31:22.820912 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 21:31:22.820912 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 21:31:22.820912 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 21:31:22.820912 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 21:31:22.820912 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 21:31:22.820912 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: 435c26b86be44362be1bd042a5cb4c1f Oct 22 21:31:22.820912 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-AttachVolumeNegativeTest-80303400 Oct 22 21:31:22.820912 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 21:31:22.820912 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 21:31:22.820912 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_435c26b86be44362be1bd042a5cb4c1f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/435c26b86be44362be1bd042a5cb4c1f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/435c26b86be44362be1bd042a5cb4c1f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/435c26b86be44362be1bd042a5cb4c1f"}]}] Oct 22 21:31:22.820912 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-AttachVolumeNegativeTest-80303400 Oct 22 21:31:22.820912 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: 435c26b86be44362be1bd042a5cb4c1f Oct 22 21:31:22.820912 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-80303400 Oct 22 21:31:22.820912 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-AttachVolumeNegativeTest-80303400-project Oct 22 21:31:22.820912 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 21:31:22.820912 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 21:31:22.820912 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: 8e102b243ece4d66bf042337324b04b0 Oct 22 21:31:22.820912 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-AttachVolumeNegativeTest-80303400-project Oct 22 21:31:22.820912 ncdv-master-1 devstack@n-api.service[138745]: method: > Oct 22 21:31:22.820912 ncdv-master-1 devstack@n-api.service[138745]: exception: Instance 46c37125-ca0d-4f11-a44d-67178c850c9c could not be found. Oct 22 21:31:22.820912 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'id': '46c37125-ca0d-4f11-a44d-67178c850c9c'} Oct 22 21:31:22.820912 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:31:22.820912 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:31:22.820912 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 21:31:22.820912 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 21:31:22.820912 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 21:31:22.820912 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 21:31:22.820912 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 21:31:22.820912 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 21:31:22.820912 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 21:31:22.820912 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 21:31:22.820912 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 46c37125-ca0d-4f11-a44d-67178c850c9c could not be found. Oct 22 21:31:22.820912 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:31:22.820912 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:31:22.820912 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:31:22.820912 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:31:22.820912 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:31:22.820912 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:31:22.820912 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:31:22.820912 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:31:22.820912 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:31:22.820912 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:31:22.820912 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 21:31:22.820912 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 21:31:22.820912 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 21:31:22.820912 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 21:31:22.820912 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 21:31:22.820912 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:31:22.820912 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 46c37125-ca0d-4f11-a44d-67178c850c9c could not be found. Oct 22 21:31:22.820912 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:31:22.820912 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:31:22.820912 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:31:22.825111 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:31:22.825111 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:31:22.825111 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:31:22.825111 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:31:22.825111 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:31:22.825111 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 46c37125-ca0d-4f11-a44d-67178c850c9c could not be found. Oct 22 21:31:22.825111 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:31:22.825111 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-e8c9e790-ed04-45b6-bc07-062dc641b369 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Returning 404 to user: Instance 46c37125-ca0d-4f11-a44d-67178c850c9c could not be found. {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:31:22.825111 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-e8c9e790-ed04-45b6-bc07-062dc641b369 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] 10.222.0.18 "GET /compute/v2.1/servers/46c37125-ca0d-4f11-a44d-67178c850c9c" status: 404 len: 111 microversion: 2.1 time: 0.035973 Oct 22 21:31:22.825111 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2941/5858] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:31:22 2022] GET /compute/v2.1/servers/46c37125-ca0d-4f11-a44d-67178c850c9c => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 21:31:23.980873 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-6eebb8ed-d829-4f8a-a866-393d0c6d43b5 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:31:23.981392 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-6eebb8ed-d829-4f8a-a866-393d0c6d43b5 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] [instance: 8ea439b7-9b3c-4521-a266-d4baa48c6308] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:31:23.988960 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6eebb8ed-d829-4f8a-a866-393d0c6d43b5 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:31:23.989450 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6eebb8ed-d829-4f8a-a866-393d0c6d43b5 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:31:23.989894 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6eebb8ed-d829-4f8a-a866-393d0c6d43b5 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:31:23.990600 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6eebb8ed-d829-4f8a-a866-393d0c6d43b5 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:31:23.991060 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6eebb8ed-d829-4f8a-a866-393d0c6d43b5 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:31:23.991531 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6eebb8ed-d829-4f8a-a866-393d0c6d43b5 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:31:24.005672 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-6eebb8ed-d829-4f8a-a866-393d0c6d43b5 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] HTTP exception thrown: Instance 8ea439b7-9b3c-4521-a266-d4baa48c6308 could not be found. Oct 22 21:31:24.007231 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-6eebb8ed-d829-4f8a-a866-393d0c6d43b5 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Request method failure captured: Oct 22 21:31:24.007231 ncdv-master-1 devstack@n-api.service[138744]: request: DELETE /compute/v2.1/servers/8ea439b7-9b3c-4521-a266-d4baa48c6308 HTTP/1.1 Oct 22 21:31:24.007231 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 21:31:24.007231 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 21:31:24.007231 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 21:31:24.007231 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 0 Oct 22 21:31:24.007231 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 21:31:24.007231 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 21:31:24.007231 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 21:31:24.007231 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 21:31:24.007231 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVF_hsf3rUCViRBfvA8CnH-TfW5QSO0kevoFTs6KZljnXJUDSecsBecVt0lVrzkUSJspjAD2JsdbiZFAxQsXXsicbWy7V3pWMCwro31w9Ltc_BWmw3Yz3d34h_3OjHVQwWdhhFE9pmgJSX-JnVswRY3vnqUmGtZuFzhOlkkg5YLCVC2I Oct 22 21:31:24.007231 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 21:31:24.007231 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 21:31:24.007231 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 21:31:24.007231 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 21:31:24.007231 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 21:31:24.007231 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 21:31:24.007231 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: 435c26b86be44362be1bd042a5cb4c1f Oct 22 21:31:24.007231 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-AttachVolumeNegativeTest-80303400 Oct 22 21:31:24.007231 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 21:31:24.007231 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 21:31:24.007231 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_435c26b86be44362be1bd042a5cb4c1f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/435c26b86be44362be1bd042a5cb4c1f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/435c26b86be44362be1bd042a5cb4c1f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/435c26b86be44362be1bd042a5cb4c1f"}]}] Oct 22 21:31:24.007231 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-AttachVolumeNegativeTest-80303400 Oct 22 21:31:24.007231 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: 435c26b86be44362be1bd042a5cb4c1f Oct 22 21:31:24.007231 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-80303400 Oct 22 21:31:24.007231 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-AttachVolumeNegativeTest-80303400-project Oct 22 21:31:24.007231 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 21:31:24.007231 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 21:31:24.007231 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: 8e102b243ece4d66bf042337324b04b0 Oct 22 21:31:24.007231 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-AttachVolumeNegativeTest-80303400-project Oct 22 21:31:24.007231 ncdv-master-1 devstack@n-api.service[138744]: method: > Oct 22 21:31:24.007231 ncdv-master-1 devstack@n-api.service[138744]: exception: Instance 8ea439b7-9b3c-4521-a266-d4baa48c6308 could not be found. Oct 22 21:31:24.007231 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': '8ea439b7-9b3c-4521-a266-d4baa48c6308'} Oct 22 21:31:24.007231 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:31:24.007231 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:31:24.007231 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 21:31:24.007231 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 21:31:24.007231 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 21:31:24.007231 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 21:31:24.007231 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 21:31:24.007231 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 21:31:24.007231 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 21:31:24.007231 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 21:31:24.007231 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ea439b7-9b3c-4521-a266-d4baa48c6308 could not be found. Oct 22 21:31:24.007231 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:31:24.007231 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:31:24.007231 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:31:24.007231 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:31:24.007231 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:31:24.007231 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:31:24.007231 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:31:24.007231 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:31:24.007231 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:31:24.007231 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:31:24.007231 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 22 21:31:24.007231 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 22 21:31:24.007231 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 22 21:31:24.007231 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 22 21:31:24.007231 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 21:31:24.007231 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 21:31:24.007231 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 21:31:24.007231 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:31:24.011483 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ea439b7-9b3c-4521-a266-d4baa48c6308 could not be found. Oct 22 21:31:24.011483 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:31:24.011483 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:31:24.011483 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:31:24.011483 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:31:24.011483 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:31:24.011483 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:31:24.011483 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:31:24.011483 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:31:24.011483 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ea439b7-9b3c-4521-a266-d4baa48c6308 could not be found. Oct 22 21:31:24.011483 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:31:24.011483 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-6eebb8ed-d829-4f8a-a866-393d0c6d43b5 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Returning 404 to user: Instance 8ea439b7-9b3c-4521-a266-d4baa48c6308 could not be found. {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:31:24.011483 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-6eebb8ed-d829-4f8a-a866-393d0c6d43b5 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] 10.222.0.18 "DELETE /compute/v2.1/servers/8ea439b7-9b3c-4521-a266-d4baa48c6308" status: 404 len: 111 microversion: 2.1 time: 0.031777 Oct 22 21:31:24.011483 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2918/5859] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 21:31:23 2022] DELETE /compute/v2.1/servers/8ea439b7-9b3c-4521-a266-d4baa48c6308 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 21:31:24.020617 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-011ecc2a-ea0e-46cb-9fdd-0bb040961b81 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:31:24.021337 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-011ecc2a-ea0e-46cb-9fdd-0bb040961b81 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] [instance: 8ea439b7-9b3c-4521-a266-d4baa48c6308] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:31:24.031808 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-011ecc2a-ea0e-46cb-9fdd-0bb040961b81 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:31:24.032307 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-011ecc2a-ea0e-46cb-9fdd-0bb040961b81 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:31:24.032763 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-011ecc2a-ea0e-46cb-9fdd-0bb040961b81 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:31:24.033472 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-011ecc2a-ea0e-46cb-9fdd-0bb040961b81 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:31:24.033941 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-011ecc2a-ea0e-46cb-9fdd-0bb040961b81 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:31:24.034379 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-011ecc2a-ea0e-46cb-9fdd-0bb040961b81 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:31:24.048341 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.wsgi [None req-011ecc2a-ea0e-46cb-9fdd-0bb040961b81 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] HTTP exception thrown: Instance 8ea439b7-9b3c-4521-a266-d4baa48c6308 could not be found. Oct 22 21:31:24.049920 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-011ecc2a-ea0e-46cb-9fdd-0bb040961b81 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Request method failure captured: Oct 22 21:31:24.049920 ncdv-master-1 devstack@n-api.service[138745]: request: GET /compute/v2.1/servers/8ea439b7-9b3c-4521-a266-d4baa48c6308 HTTP/1.1 Oct 22 21:31:24.049920 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 21:31:24.049920 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 21:31:24.049920 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 21:31:24.049920 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 0 Oct 22 21:31:24.049920 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 21:31:24.049920 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 21:31:24.049920 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 21:31:24.049920 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 21:31:24.049920 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVF_hsf3rUCViRBfvA8CnH-TfW5QSO0kevoFTs6KZljnXJUDSecsBecVt0lVrzkUSJspjAD2JsdbiZFAxQsXXsicbWy7V3pWMCwro31w9Ltc_BWmw3Yz3d34h_3OjHVQwWdhhFE9pmgJSX-JnVswRY3vnqUmGtZuFzhOlkkg5YLCVC2I Oct 22 21:31:24.049920 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 21:31:24.049920 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 21:31:24.049920 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 21:31:24.049920 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 21:31:24.049920 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 21:31:24.049920 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 21:31:24.049920 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: 435c26b86be44362be1bd042a5cb4c1f Oct 22 21:31:24.049920 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-AttachVolumeNegativeTest-80303400 Oct 22 21:31:24.049920 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 21:31:24.049920 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 21:31:24.049920 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_435c26b86be44362be1bd042a5cb4c1f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/435c26b86be44362be1bd042a5cb4c1f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/435c26b86be44362be1bd042a5cb4c1f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/435c26b86be44362be1bd042a5cb4c1f"}]}] Oct 22 21:31:24.049920 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-AttachVolumeNegativeTest-80303400 Oct 22 21:31:24.049920 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: 435c26b86be44362be1bd042a5cb4c1f Oct 22 21:31:24.049920 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-80303400 Oct 22 21:31:24.049920 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-AttachVolumeNegativeTest-80303400-project Oct 22 21:31:24.049920 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 21:31:24.049920 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 21:31:24.049920 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: 8e102b243ece4d66bf042337324b04b0 Oct 22 21:31:24.049920 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-AttachVolumeNegativeTest-80303400-project Oct 22 21:31:24.049920 ncdv-master-1 devstack@n-api.service[138745]: method: > Oct 22 21:31:24.049920 ncdv-master-1 devstack@n-api.service[138745]: exception: Instance 8ea439b7-9b3c-4521-a266-d4baa48c6308 could not be found. Oct 22 21:31:24.049920 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'id': '8ea439b7-9b3c-4521-a266-d4baa48c6308'} Oct 22 21:31:24.049920 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:31:24.049920 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:31:24.049920 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 21:31:24.049920 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 21:31:24.049920 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 21:31:24.049920 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 21:31:24.049920 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 21:31:24.049920 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 21:31:24.049920 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 21:31:24.049920 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 21:31:24.049920 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ea439b7-9b3c-4521-a266-d4baa48c6308 could not be found. Oct 22 21:31:24.049920 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:31:24.049920 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:31:24.049920 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:31:24.049920 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:31:24.049920 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:31:24.049920 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:31:24.049920 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:31:24.049920 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:31:24.049920 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:31:24.049920 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:31:24.049920 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 21:31:24.049920 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 21:31:24.049920 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 21:31:24.049920 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 21:31:24.049920 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 21:31:24.049920 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:31:24.049920 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ea439b7-9b3c-4521-a266-d4baa48c6308 could not be found. Oct 22 21:31:24.049920 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:31:24.049920 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:31:24.049920 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:31:24.054315 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:31:24.054315 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:31:24.054315 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:31:24.054315 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:31:24.054315 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:31:24.054315 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ea439b7-9b3c-4521-a266-d4baa48c6308 could not be found. Oct 22 21:31:24.054315 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:31:24.054315 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-011ecc2a-ea0e-46cb-9fdd-0bb040961b81 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Returning 404 to user: Instance 8ea439b7-9b3c-4521-a266-d4baa48c6308 could not be found. {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:31:24.054315 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-011ecc2a-ea0e-46cb-9fdd-0bb040961b81 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] 10.222.0.18 "GET /compute/v2.1/servers/8ea439b7-9b3c-4521-a266-d4baa48c6308" status: 404 len: 111 microversion: 2.1 time: 0.037631 Oct 22 21:31:24.054315 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2942/5860] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:31:24 2022] GET /compute/v2.1/servers/8ea439b7-9b3c-4521-a266-d4baa48c6308 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 21:31:24.060177 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-bdbd46f1-883e-4f2b-9ea6-e10be2ae2c2f tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:31:24.060682 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-bdbd46f1-883e-4f2b-9ea6-e10be2ae2c2f tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] [instance: 8f964e3b-227a-4946-af30-9700da302ade] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:31:24.066929 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bdbd46f1-883e-4f2b-9ea6-e10be2ae2c2f tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:31:24.067427 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bdbd46f1-883e-4f2b-9ea6-e10be2ae2c2f tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:31:24.067873 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bdbd46f1-883e-4f2b-9ea6-e10be2ae2c2f tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:31:24.068615 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bdbd46f1-883e-4f2b-9ea6-e10be2ae2c2f tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:31:24.069045 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bdbd46f1-883e-4f2b-9ea6-e10be2ae2c2f tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:31:24.069477 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bdbd46f1-883e-4f2b-9ea6-e10be2ae2c2f tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:31:24.083908 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-bdbd46f1-883e-4f2b-9ea6-e10be2ae2c2f tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] HTTP exception thrown: Instance 8f964e3b-227a-4946-af30-9700da302ade could not be found. Oct 22 21:31:24.085750 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-bdbd46f1-883e-4f2b-9ea6-e10be2ae2c2f tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Request method failure captured: Oct 22 21:31:24.085750 ncdv-master-1 devstack@n-api.service[138744]: request: DELETE /compute/v2.1/servers/8f964e3b-227a-4946-af30-9700da302ade HTTP/1.1 Oct 22 21:31:24.085750 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 21:31:24.085750 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 21:31:24.085750 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 21:31:24.085750 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 0 Oct 22 21:31:24.085750 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 21:31:24.085750 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 21:31:24.085750 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 21:31:24.085750 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 21:31:24.085750 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVF_hsf3rUCViRBfvA8CnH-TfW5QSO0kevoFTs6KZljnXJUDSecsBecVt0lVrzkUSJspjAD2JsdbiZFAxQsXXsicbWy7V3pWMCwro31w9Ltc_BWmw3Yz3d34h_3OjHVQwWdhhFE9pmgJSX-JnVswRY3vnqUmGtZuFzhOlkkg5YLCVC2I Oct 22 21:31:24.085750 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 21:31:24.085750 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 21:31:24.085750 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 21:31:24.085750 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 21:31:24.085750 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 21:31:24.085750 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 21:31:24.085750 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: 435c26b86be44362be1bd042a5cb4c1f Oct 22 21:31:24.085750 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-AttachVolumeNegativeTest-80303400 Oct 22 21:31:24.085750 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 21:31:24.085750 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 21:31:24.085750 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_435c26b86be44362be1bd042a5cb4c1f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/435c26b86be44362be1bd042a5cb4c1f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/435c26b86be44362be1bd042a5cb4c1f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/435c26b86be44362be1bd042a5cb4c1f"}]}] Oct 22 21:31:24.085750 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-AttachVolumeNegativeTest-80303400 Oct 22 21:31:24.085750 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: 435c26b86be44362be1bd042a5cb4c1f Oct 22 21:31:24.085750 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-80303400 Oct 22 21:31:24.085750 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-AttachVolumeNegativeTest-80303400-project Oct 22 21:31:24.085750 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 21:31:24.085750 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 21:31:24.085750 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: 8e102b243ece4d66bf042337324b04b0 Oct 22 21:31:24.085750 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-AttachVolumeNegativeTest-80303400-project Oct 22 21:31:24.085750 ncdv-master-1 devstack@n-api.service[138744]: method: > Oct 22 21:31:24.085750 ncdv-master-1 devstack@n-api.service[138744]: exception: Instance 8f964e3b-227a-4946-af30-9700da302ade could not be found. Oct 22 21:31:24.085750 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': '8f964e3b-227a-4946-af30-9700da302ade'} Oct 22 21:31:24.085750 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:31:24.085750 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:31:24.085750 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 21:31:24.085750 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 21:31:24.085750 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 21:31:24.085750 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 21:31:24.085750 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 21:31:24.085750 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 21:31:24.085750 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 21:31:24.085750 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 21:31:24.085750 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f964e3b-227a-4946-af30-9700da302ade could not be found. Oct 22 21:31:24.085750 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:31:24.085750 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:31:24.085750 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:31:24.085750 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:31:24.085750 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:31:24.085750 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:31:24.085750 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:31:24.085750 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:31:24.085750 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:31:24.085750 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:31:24.085750 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 22 21:31:24.085750 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 22 21:31:24.085750 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 22 21:31:24.085750 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 22 21:31:24.085750 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 21:31:24.085750 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 21:31:24.085750 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 21:31:24.085750 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:31:24.089927 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f964e3b-227a-4946-af30-9700da302ade could not be found. Oct 22 21:31:24.089927 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:31:24.089927 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:31:24.089927 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:31:24.089927 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:31:24.089927 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:31:24.089927 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:31:24.089927 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:31:24.089927 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:31:24.089927 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f964e3b-227a-4946-af30-9700da302ade could not be found. Oct 22 21:31:24.089927 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:31:24.089927 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-bdbd46f1-883e-4f2b-9ea6-e10be2ae2c2f tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Returning 404 to user: Instance 8f964e3b-227a-4946-af30-9700da302ade could not be found. {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:31:24.089927 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-bdbd46f1-883e-4f2b-9ea6-e10be2ae2c2f tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] 10.222.0.18 "DELETE /compute/v2.1/servers/8f964e3b-227a-4946-af30-9700da302ade" status: 404 len: 111 microversion: 2.1 time: 0.031025 Oct 22 21:31:24.089927 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2919/5861] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 21:31:24 2022] DELETE /compute/v2.1/servers/8f964e3b-227a-4946-af30-9700da302ade => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 21:31:24.096145 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-0c0eae42-5d5f-4312-8a78-d8638b53f160 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:31:24.096778 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-0c0eae42-5d5f-4312-8a78-d8638b53f160 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] [instance: 8f964e3b-227a-4946-af30-9700da302ade] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:31:24.103670 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0c0eae42-5d5f-4312-8a78-d8638b53f160 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:31:24.104171 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0c0eae42-5d5f-4312-8a78-d8638b53f160 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:31:24.104662 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0c0eae42-5d5f-4312-8a78-d8638b53f160 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:31:24.105373 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0c0eae42-5d5f-4312-8a78-d8638b53f160 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:31:24.105837 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0c0eae42-5d5f-4312-8a78-d8638b53f160 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:31:24.106249 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0c0eae42-5d5f-4312-8a78-d8638b53f160 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:31:24.120496 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.wsgi [None req-0c0eae42-5d5f-4312-8a78-d8638b53f160 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] HTTP exception thrown: Instance 8f964e3b-227a-4946-af30-9700da302ade could not be found. Oct 22 21:31:24.122059 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-0c0eae42-5d5f-4312-8a78-d8638b53f160 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Request method failure captured: Oct 22 21:31:24.122059 ncdv-master-1 devstack@n-api.service[138745]: request: GET /compute/v2.1/servers/8f964e3b-227a-4946-af30-9700da302ade HTTP/1.1 Oct 22 21:31:24.122059 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 21:31:24.122059 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 21:31:24.122059 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 21:31:24.122059 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 0 Oct 22 21:31:24.122059 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 21:31:24.122059 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 21:31:24.122059 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 21:31:24.122059 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 21:31:24.122059 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVF_hsf3rUCViRBfvA8CnH-TfW5QSO0kevoFTs6KZljnXJUDSecsBecVt0lVrzkUSJspjAD2JsdbiZFAxQsXXsicbWy7V3pWMCwro31w9Ltc_BWmw3Yz3d34h_3OjHVQwWdhhFE9pmgJSX-JnVswRY3vnqUmGtZuFzhOlkkg5YLCVC2I Oct 22 21:31:24.122059 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 21:31:24.122059 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 21:31:24.122059 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 21:31:24.122059 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 21:31:24.122059 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 21:31:24.122059 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 21:31:24.122059 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: 435c26b86be44362be1bd042a5cb4c1f Oct 22 21:31:24.122059 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-AttachVolumeNegativeTest-80303400 Oct 22 21:31:24.122059 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 21:31:24.122059 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 21:31:24.122059 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_435c26b86be44362be1bd042a5cb4c1f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/435c26b86be44362be1bd042a5cb4c1f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/435c26b86be44362be1bd042a5cb4c1f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/435c26b86be44362be1bd042a5cb4c1f"}]}] Oct 22 21:31:24.122059 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-AttachVolumeNegativeTest-80303400 Oct 22 21:31:24.122059 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: 435c26b86be44362be1bd042a5cb4c1f Oct 22 21:31:24.122059 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-80303400 Oct 22 21:31:24.122059 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-AttachVolumeNegativeTest-80303400-project Oct 22 21:31:24.122059 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 21:31:24.122059 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 21:31:24.122059 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: 8e102b243ece4d66bf042337324b04b0 Oct 22 21:31:24.122059 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-AttachVolumeNegativeTest-80303400-project Oct 22 21:31:24.122059 ncdv-master-1 devstack@n-api.service[138745]: method: > Oct 22 21:31:24.122059 ncdv-master-1 devstack@n-api.service[138745]: exception: Instance 8f964e3b-227a-4946-af30-9700da302ade could not be found. Oct 22 21:31:24.122059 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'id': '8f964e3b-227a-4946-af30-9700da302ade'} Oct 22 21:31:24.122059 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:31:24.122059 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:31:24.122059 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 21:31:24.122059 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 21:31:24.122059 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 21:31:24.122059 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 21:31:24.122059 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 21:31:24.122059 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 21:31:24.122059 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 21:31:24.122059 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 21:31:24.122059 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f964e3b-227a-4946-af30-9700da302ade could not be found. Oct 22 21:31:24.122059 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:31:24.122059 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:31:24.122059 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:31:24.122059 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:31:24.122059 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:31:24.122059 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:31:24.122059 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:31:24.122059 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:31:24.122059 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:31:24.122059 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:31:24.122059 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 21:31:24.122059 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 21:31:24.122059 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 21:31:24.122059 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 21:31:24.122059 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 21:31:24.122059 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:31:24.122059 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f964e3b-227a-4946-af30-9700da302ade could not be found. Oct 22 21:31:24.122059 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:31:24.122059 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:31:24.122059 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:31:24.127147 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:31:24.127147 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:31:24.127147 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:31:24.127147 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:31:24.127147 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:31:24.127147 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f964e3b-227a-4946-af30-9700da302ade could not be found. Oct 22 21:31:24.127147 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:31:24.127147 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-0c0eae42-5d5f-4312-8a78-d8638b53f160 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Returning 404 to user: Instance 8f964e3b-227a-4946-af30-9700da302ade could not be found. {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:31:24.127147 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-0c0eae42-5d5f-4312-8a78-d8638b53f160 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] 10.222.0.18 "GET /compute/v2.1/servers/8f964e3b-227a-4946-af30-9700da302ade" status: 404 len: 111 microversion: 2.1 time: 0.031360 Oct 22 21:31:24.127147 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2943/5862] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:31:24 2022] GET /compute/v2.1/servers/8f964e3b-227a-4946-af30-9700da302ade => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 21:31:25.293747 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-628afb3e-011d-453a-a7e1-5996b2081a6f tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:31:25.294277 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-628afb3e-011d-453a-a7e1-5996b2081a6f tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] [instance: 5454c3bf-7239-4b6f-b542-0d6a8df40222] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:31:25.305145 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-628afb3e-011d-453a-a7e1-5996b2081a6f tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:31:25.305800 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-628afb3e-011d-453a-a7e1-5996b2081a6f tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:31:25.306398 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-628afb3e-011d-453a-a7e1-5996b2081a6f tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:31:25.307420 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-628afb3e-011d-453a-a7e1-5996b2081a6f tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:31:25.308011 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-628afb3e-011d-453a-a7e1-5996b2081a6f tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:31:25.308591 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-628afb3e-011d-453a-a7e1-5996b2081a6f tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:31:25.324356 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-628afb3e-011d-453a-a7e1-5996b2081a6f tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] HTTP exception thrown: Instance 5454c3bf-7239-4b6f-b542-0d6a8df40222 could not be found. Oct 22 21:31:25.325917 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-628afb3e-011d-453a-a7e1-5996b2081a6f tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Request method failure captured: Oct 22 21:31:25.325917 ncdv-master-1 devstack@n-api.service[138744]: request: DELETE /compute/v2.1/servers/5454c3bf-7239-4b6f-b542-0d6a8df40222 HTTP/1.1 Oct 22 21:31:25.325917 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 21:31:25.325917 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 21:31:25.325917 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 21:31:25.325917 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 0 Oct 22 21:31:25.325917 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 21:31:25.325917 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 21:31:25.325917 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 21:31:25.325917 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 21:31:25.325917 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVF_hsf3rUCViRBfvA8CnH-TfW5QSO0kevoFTs6KZljnXJUDSecsBecVt0lVrzkUSJspjAD2JsdbiZFAxQsXXsicbWy7V3pWMCwro31w9Ltc_BWmw3Yz3d34h_3OjHVQwWdhhFE9pmgJSX-JnVswRY3vnqUmGtZuFzhOlkkg5YLCVC2I Oct 22 21:31:25.325917 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 21:31:25.325917 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 21:31:25.325917 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 21:31:25.325917 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 21:31:25.325917 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 21:31:25.325917 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 21:31:25.325917 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: 435c26b86be44362be1bd042a5cb4c1f Oct 22 21:31:25.325917 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-AttachVolumeNegativeTest-80303400 Oct 22 21:31:25.325917 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 21:31:25.325917 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 21:31:25.325917 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_435c26b86be44362be1bd042a5cb4c1f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/435c26b86be44362be1bd042a5cb4c1f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/435c26b86be44362be1bd042a5cb4c1f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/435c26b86be44362be1bd042a5cb4c1f"}]}] Oct 22 21:31:25.325917 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-AttachVolumeNegativeTest-80303400 Oct 22 21:31:25.325917 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: 435c26b86be44362be1bd042a5cb4c1f Oct 22 21:31:25.325917 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-80303400 Oct 22 21:31:25.325917 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-AttachVolumeNegativeTest-80303400-project Oct 22 21:31:25.325917 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 21:31:25.325917 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 21:31:25.325917 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: 8e102b243ece4d66bf042337324b04b0 Oct 22 21:31:25.325917 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-AttachVolumeNegativeTest-80303400-project Oct 22 21:31:25.325917 ncdv-master-1 devstack@n-api.service[138744]: method: > Oct 22 21:31:25.325917 ncdv-master-1 devstack@n-api.service[138744]: exception: Instance 5454c3bf-7239-4b6f-b542-0d6a8df40222 could not be found. Oct 22 21:31:25.325917 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': '5454c3bf-7239-4b6f-b542-0d6a8df40222'} Oct 22 21:31:25.325917 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:31:25.325917 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:31:25.325917 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 21:31:25.325917 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 21:31:25.325917 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 21:31:25.325917 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 21:31:25.325917 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 21:31:25.325917 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 21:31:25.325917 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 21:31:25.325917 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 21:31:25.325917 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5454c3bf-7239-4b6f-b542-0d6a8df40222 could not be found. Oct 22 21:31:25.325917 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:31:25.325917 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:31:25.325917 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:31:25.325917 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:31:25.325917 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:31:25.325917 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:31:25.325917 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:31:25.325917 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:31:25.325917 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:31:25.325917 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:31:25.325917 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 22 21:31:25.325917 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 22 21:31:25.325917 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 22 21:31:25.325917 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 22 21:31:25.325917 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 21:31:25.325917 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 21:31:25.325917 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 21:31:25.325917 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:31:25.329665 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5454c3bf-7239-4b6f-b542-0d6a8df40222 could not be found. Oct 22 21:31:25.329665 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:31:25.329665 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:31:25.329665 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:31:25.329665 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:31:25.329665 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:31:25.329665 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:31:25.329665 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:31:25.329665 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:31:25.329665 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5454c3bf-7239-4b6f-b542-0d6a8df40222 could not be found. Oct 22 21:31:25.329665 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:31:25.329665 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-628afb3e-011d-453a-a7e1-5996b2081a6f tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Returning 404 to user: Instance 5454c3bf-7239-4b6f-b542-0d6a8df40222 could not be found. {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:31:25.329665 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-628afb3e-011d-453a-a7e1-5996b2081a6f tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] 10.222.0.18 "DELETE /compute/v2.1/servers/5454c3bf-7239-4b6f-b542-0d6a8df40222" status: 404 len: 111 microversion: 2.1 time: 0.039991 Oct 22 21:31:25.329665 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2920/5863] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 21:31:25 2022] DELETE /compute/v2.1/servers/5454c3bf-7239-4b6f-b542-0d6a8df40222 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 21:31:25.336356 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-dbf8c5bb-b18e-4b7a-9e9a-4aae07d53044 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:31:25.336987 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-dbf8c5bb-b18e-4b7a-9e9a-4aae07d53044 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] [instance: 5454c3bf-7239-4b6f-b542-0d6a8df40222] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:31:25.344401 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-dbf8c5bb-b18e-4b7a-9e9a-4aae07d53044 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:31:25.344834 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-dbf8c5bb-b18e-4b7a-9e9a-4aae07d53044 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:31:25.345315 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-dbf8c5bb-b18e-4b7a-9e9a-4aae07d53044 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:31:25.346033 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-dbf8c5bb-b18e-4b7a-9e9a-4aae07d53044 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:31:25.346509 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-dbf8c5bb-b18e-4b7a-9e9a-4aae07d53044 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:31:25.346952 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-dbf8c5bb-b18e-4b7a-9e9a-4aae07d53044 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:31:25.361441 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.wsgi [None req-dbf8c5bb-b18e-4b7a-9e9a-4aae07d53044 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] HTTP exception thrown: Instance 5454c3bf-7239-4b6f-b542-0d6a8df40222 could not be found. Oct 22 21:31:25.363000 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-dbf8c5bb-b18e-4b7a-9e9a-4aae07d53044 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Request method failure captured: Oct 22 21:31:25.363000 ncdv-master-1 devstack@n-api.service[138745]: request: GET /compute/v2.1/servers/5454c3bf-7239-4b6f-b542-0d6a8df40222 HTTP/1.1 Oct 22 21:31:25.363000 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 21:31:25.363000 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 21:31:25.363000 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 21:31:25.363000 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 0 Oct 22 21:31:25.363000 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 21:31:25.363000 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 21:31:25.363000 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 21:31:25.363000 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 21:31:25.363000 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVF_hsf3rUCViRBfvA8CnH-TfW5QSO0kevoFTs6KZljnXJUDSecsBecVt0lVrzkUSJspjAD2JsdbiZFAxQsXXsicbWy7V3pWMCwro31w9Ltc_BWmw3Yz3d34h_3OjHVQwWdhhFE9pmgJSX-JnVswRY3vnqUmGtZuFzhOlkkg5YLCVC2I Oct 22 21:31:25.363000 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 21:31:25.363000 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 21:31:25.363000 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 21:31:25.363000 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 21:31:25.363000 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 21:31:25.363000 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 21:31:25.363000 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: 435c26b86be44362be1bd042a5cb4c1f Oct 22 21:31:25.363000 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-AttachVolumeNegativeTest-80303400 Oct 22 21:31:25.363000 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 21:31:25.363000 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 21:31:25.363000 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_435c26b86be44362be1bd042a5cb4c1f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/435c26b86be44362be1bd042a5cb4c1f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/435c26b86be44362be1bd042a5cb4c1f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/435c26b86be44362be1bd042a5cb4c1f"}]}] Oct 22 21:31:25.363000 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-AttachVolumeNegativeTest-80303400 Oct 22 21:31:25.363000 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: 435c26b86be44362be1bd042a5cb4c1f Oct 22 21:31:25.363000 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-80303400 Oct 22 21:31:25.363000 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-AttachVolumeNegativeTest-80303400-project Oct 22 21:31:25.363000 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 21:31:25.363000 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 21:31:25.363000 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: 8e102b243ece4d66bf042337324b04b0 Oct 22 21:31:25.363000 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-AttachVolumeNegativeTest-80303400-project Oct 22 21:31:25.363000 ncdv-master-1 devstack@n-api.service[138745]: method: > Oct 22 21:31:25.363000 ncdv-master-1 devstack@n-api.service[138745]: exception: Instance 5454c3bf-7239-4b6f-b542-0d6a8df40222 could not be found. Oct 22 21:31:25.363000 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'id': '5454c3bf-7239-4b6f-b542-0d6a8df40222'} Oct 22 21:31:25.363000 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:31:25.363000 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:31:25.363000 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 21:31:25.363000 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 21:31:25.363000 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 21:31:25.363000 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 21:31:25.363000 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 21:31:25.363000 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 21:31:25.363000 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 21:31:25.363000 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 21:31:25.363000 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5454c3bf-7239-4b6f-b542-0d6a8df40222 could not be found. Oct 22 21:31:25.363000 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:31:25.363000 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:31:25.363000 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:31:25.363000 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:31:25.363000 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:31:25.363000 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:31:25.363000 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:31:25.363000 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:31:25.363000 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:31:25.363000 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:31:25.363000 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 21:31:25.363000 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 21:31:25.363000 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 21:31:25.363000 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 21:31:25.363000 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 21:31:25.363000 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:31:25.363000 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5454c3bf-7239-4b6f-b542-0d6a8df40222 could not be found. Oct 22 21:31:25.363000 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:31:25.363000 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:31:25.363000 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:31:25.366785 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:31:25.366785 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:31:25.366785 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:31:25.366785 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:31:25.366785 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:31:25.366785 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5454c3bf-7239-4b6f-b542-0d6a8df40222 could not be found. Oct 22 21:31:25.366785 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:31:25.366785 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-dbf8c5bb-b18e-4b7a-9e9a-4aae07d53044 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] Returning 404 to user: Instance 5454c3bf-7239-4b6f-b542-0d6a8df40222 could not be found. {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:31:25.366785 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-dbf8c5bb-b18e-4b7a-9e9a-4aae07d53044 tempest-AttachVolumeNegativeTest-80303400 tempest-AttachVolumeNegativeTest-80303400-project] 10.222.0.18 "GET /compute/v2.1/servers/5454c3bf-7239-4b6f-b542-0d6a8df40222" status: 404 len: 111 microversion: 2.1 time: 0.032140 Oct 22 21:31:25.366785 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2944/5864] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:31:25 2022] GET /compute/v2.1/servers/5454c3bf-7239-4b6f-b542-0d6a8df40222 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 21:32:56.731512 ncdv-master-1 devstack@n-api.service[138744]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 22 21:32:56.732069 ncdv-master-1 devstack@n-api.service[138744]: Sat Oct 22 21:32:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.18) !!! Oct 22 21:32:56.733166 ncdv-master-1 devstack@n-api.service[138744]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 22 21:32:56.733282 ncdv-master-1 devstack@n-api.service[138744]: Sat Oct 22 21:32:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.18) !!! Oct 22 21:32:56.734211 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_api:SELECT=20 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:32:56.734958 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:SELECT=41,nova_cell1:INSERT=1 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:32:56.927995 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-77ec57f0-a5ca-4a0b-bd78-6a792ec4d425 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Action: 'create', calling method: .version_select at 0x7fd39eeb0dc0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-890296864", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDmYrDKe84k0ueDNi4JyKWtb0Vye2jMLI3N7smz+IopbtUlXcguNmJrJe/Bk0OZU9nUm7YFouwx65+p8RzpccoZ1/HUeh4wJdNae7Z00jcXWlhz+qCJkDPT0fa2EaoZ+gg=="}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:32:56.945157 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-77ec57f0-a5ca-4a0b-bd78-6a792ec4d425 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Getting quotas for project 42f9c508b2164653997b36431bb589b8. Resources: {'key_pairs'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 21:32:56.950472 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-77ec57f0-a5ca-4a0b-bd78-6a792ec4d425 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Getting quotas for user ce13ae25b8cc4c32a66a2bcc536a3fd6 and project 42f9c508b2164653997b36431bb589b8. Resources: {'key_pairs'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 21:32:56.982033 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-77ec57f0-a5ca-4a0b-bd78-6a792ec4d425 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.252833 Oct 22 21:32:56.982675 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2921/5865] 10.222.0.18 () {60 vars in 1159 bytes} [Sat Oct 22 21:32:56 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:33:03.298326 ncdv-master-1 devstack@n-api.service[138745]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 22 21:33:03.298859 ncdv-master-1 devstack@n-api.service[138745]: Sat Oct 22 21:33:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.18) !!! Oct 22 21:33:03.299601 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:33:03.300964 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell1:SELECT=47,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:33:03.306532 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-9409f802-9e7f-4757-974b-cb367ac1513a tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-785504394", "imageRef": "085e4478-6edc-4a69-8e08-f9831713eb65", "flavorRef": "452", "networks": [{"uuid": "608e5af4-889b-418c-97f9-af7aea494b9c"}], "key_name": "tempest-TestNetworkAdvancedServerOps-890296864", "security_groups": [{"name": "tempest-secgroup-smoke-948981039"}]}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:33:03.419690 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.network.neutron [None req-9409f802-9e7f-4757-974b-cb367ac1513a tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] validate_networks() for [('608e5af4-889b-418c-97f9-af7aea494b9c', None, None, None, None, None)] {{(pid=138745) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 21:33:03.901215 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-9409f802-9e7f-4757-974b-cb367ac1513a tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Flavor limits 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 21:33:03.901657 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-9409f802-9e7f-4757-974b-cb367ac1513a tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Image limits 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 21:33:03.902207 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-9409f802-9e7f-4757-974b-cb367ac1513a tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Flavor pref 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 21:33:03.902635 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-9409f802-9e7f-4757-974b-cb367ac1513a tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Image pref 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 21:33:03.903234 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-9409f802-9e7f-4757-974b-cb367ac1513a tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 21:33:03.913930 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9409f802-9e7f-4757-974b-cb367ac1513a tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:33:03.914590 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9409f802-9e7f-4757-974b-cb367ac1513a tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:33:03.915239 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9409f802-9e7f-4757-974b-cb367ac1513a tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:33:03.916269 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9409f802-9e7f-4757-974b-cb367ac1513a tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:33:03.916913 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9409f802-9e7f-4757-974b-cb367ac1513a tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:33:03.917401 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9409f802-9e7f-4757-974b-cb367ac1513a tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:33:03.938653 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-9409f802-9e7f-4757-974b-cb367ac1513a tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Getting quotas for project 42f9c508b2164653997b36431bb589b8. Resources: {'cores', 'instances', 'ram'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 21:33:03.944323 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-9409f802-9e7f-4757-974b-cb367ac1513a tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Getting quotas for user ce13ae25b8cc4c32a66a2bcc536a3fd6 and project 42f9c508b2164653997b36431bb589b8. Resources: {'cores', 'instances', 'ram'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 21:33:03.960469 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-9409f802-9e7f-4757-974b-cb367ac1513a tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Going to run 1 instances... {{(pid=138745) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 21:33:03.963753 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-9409f802-9e7f-4757-974b-cb367ac1513a tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] [instance: b124ddce-db8e-4eb7-9363-62a47f8431d0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='085e4478-6edc-4a69-8e08-f9831713eb65',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138745) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 21:33:04.023534 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-9409f802-9e7f-4757-974b-cb367ac1513a tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.727752 Oct 22 21:33:04.030600 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2945/5866] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Oct 22 21:33:03 2022] POST /compute/v2.1/servers => generated 405 bytes in 729 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 21:33:04.037578 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-40ea90d6-674f-4a91-a19e-4bcb3d5abe6c tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:33:04.038188 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-40ea90d6-674f-4a91-a19e-4bcb3d5abe6c tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] [instance: b124ddce-db8e-4eb7-9363-62a47f8431d0] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:33:04.112660 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-40ea90d6-674f-4a91-a19e-4bcb3d5abe6c tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce13ae25b8cc4c32a66a2bcc536a3fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f9c508b2164653997b36431bb589b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:33:04.120664 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-40ea90d6-674f-4a91-a19e-4bcb3d5abe6c tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] 10.222.0.18 "GET /compute/v2.1/servers/b124ddce-db8e-4eb7-9363-62a47f8431d0" status: 200 len: 1265 microversion: 2.1 time: 0.088514 Oct 22 21:33:04.134530 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2922/5867] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:33:04 2022] GET /compute/v2.1/servers/b124ddce-db8e-4eb7-9363-62a47f8431d0 => generated 1265 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:33:05.164027 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-336413e4-b70e-4550-93dc-a1e23a278265 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:33:05.165242 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-336413e4-b70e-4550-93dc-a1e23a278265 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] [instance: b124ddce-db8e-4eb7-9363-62a47f8431d0] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:33:05.223491 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-336413e4-b70e-4550-93dc-a1e23a278265 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce13ae25b8cc4c32a66a2bcc536a3fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f9c508b2164653997b36431bb589b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:33:05.231493 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-336413e4-b70e-4550-93dc-a1e23a278265 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] 10.222.0.18 "GET /compute/v2.1/servers/b124ddce-db8e-4eb7-9363-62a47f8431d0" status: 200 len: 1265 microversion: 2.1 time: 0.073547 Oct 22 21:33:05.232489 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2946/5868] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:33:05 2022] GET /compute/v2.1/servers/b124ddce-db8e-4eb7-9363-62a47f8431d0 => generated 1265 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:33:06.254839 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-b25aba9d-380e-4a3e-9112-ae72cc9f15a1 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:33:06.255515 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-b25aba9d-380e-4a3e-9112-ae72cc9f15a1 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] [instance: b124ddce-db8e-4eb7-9363-62a47f8431d0] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:33:06.309878 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-b25aba9d-380e-4a3e-9112-ae72cc9f15a1 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce13ae25b8cc4c32a66a2bcc536a3fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f9c508b2164653997b36431bb589b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:33:06.317409 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-b25aba9d-380e-4a3e-9112-ae72cc9f15a1 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] 10.222.0.18 "GET /compute/v2.1/servers/b124ddce-db8e-4eb7-9363-62a47f8431d0" status: 200 len: 1265 microversion: 2.1 time: 0.066950 Oct 22 21:33:06.318177 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2923/5869] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:33:06 2022] GET /compute/v2.1/servers/b124ddce-db8e-4eb7-9363-62a47f8431d0 => generated 1265 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:33:07.345496 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-15d76149-baa9-4a97-bd90-7e602dbaa170 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:33:07.346613 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-15d76149-baa9-4a97-bd90-7e602dbaa170 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] [instance: b124ddce-db8e-4eb7-9363-62a47f8431d0] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:33:07.408509 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-15d76149-baa9-4a97-bd90-7e602dbaa170 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce13ae25b8cc4c32a66a2bcc536a3fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f9c508b2164653997b36431bb589b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:33:07.415955 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-15d76149-baa9-4a97-bd90-7e602dbaa170 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] 10.222.0.18 "GET /compute/v2.1/servers/b124ddce-db8e-4eb7-9363-62a47f8431d0" status: 200 len: 1265 microversion: 2.1 time: 0.077227 Oct 22 21:33:07.416526 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2947/5870] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:33:07 2022] GET /compute/v2.1/servers/b124ddce-db8e-4eb7-9363-62a47f8431d0 => generated 1265 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:33:08.442491 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-6e8133f9-9d41-4d47-831a-e894cc46e4a8 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:33:08.443544 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-6e8133f9-9d41-4d47-831a-e894cc46e4a8 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] [instance: b124ddce-db8e-4eb7-9363-62a47f8431d0] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:33:08.452425 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6e8133f9-9d41-4d47-831a-e894cc46e4a8 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:33:08.452915 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6e8133f9-9d41-4d47-831a-e894cc46e4a8 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:33:08.453361 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6e8133f9-9d41-4d47-831a-e894cc46e4a8 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:33:08.454063 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6e8133f9-9d41-4d47-831a-e894cc46e4a8 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:33:08.454567 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6e8133f9-9d41-4d47-831a-e894cc46e4a8 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:33:08.454988 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6e8133f9-9d41-4d47-831a-e894cc46e4a8 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:33:08.518870 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-6e8133f9-9d41-4d47-831a-e894cc46e4a8 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce13ae25b8cc4c32a66a2bcc536a3fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f9c508b2164653997b36431bb589b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:33:08.527446 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-6e8133f9-9d41-4d47-831a-e894cc46e4a8 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] 10.222.0.18 "GET /compute/v2.1/servers/b124ddce-db8e-4eb7-9363-62a47f8431d0" status: 200 len: 1269 microversion: 2.1 time: 0.091628 Oct 22 21:33:08.528034 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2924/5871] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:33:08 2022] GET /compute/v2.1/servers/b124ddce-db8e-4eb7-9363-62a47f8431d0 => generated 1269 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:33:09.550617 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-a6b94c9b-4832-44ff-881d-afa26cac158d tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:33:09.551248 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-a6b94c9b-4832-44ff-881d-afa26cac158d tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] [instance: b124ddce-db8e-4eb7-9363-62a47f8431d0] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:33:09.559883 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a6b94c9b-4832-44ff-881d-afa26cac158d tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:33:09.560397 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a6b94c9b-4832-44ff-881d-afa26cac158d tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:33:09.560935 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a6b94c9b-4832-44ff-881d-afa26cac158d tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:33:09.561881 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a6b94c9b-4832-44ff-881d-afa26cac158d tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:33:09.562415 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a6b94c9b-4832-44ff-881d-afa26cac158d tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:33:09.563017 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a6b94c9b-4832-44ff-881d-afa26cac158d tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:33:09.658477 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-a6b94c9b-4832-44ff-881d-afa26cac158d tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce13ae25b8cc4c32a66a2bcc536a3fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f9c508b2164653997b36431bb589b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:33:09.667232 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-a6b94c9b-4832-44ff-881d-afa26cac158d tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] 10.222.0.18 "GET /compute/v2.1/servers/b124ddce-db8e-4eb7-9363-62a47f8431d0" status: 200 len: 1323 microversion: 2.1 time: 0.120596 Oct 22 21:33:09.667880 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2948/5872] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:33:09 2022] GET /compute/v2.1/servers/b124ddce-db8e-4eb7-9363-62a47f8431d0 => generated 1323 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:33:10.691016 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-9db5cac2-f0a0-41a4-a16f-3999de490efd tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:33:10.691776 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-9db5cac2-f0a0-41a4-a16f-3999de490efd tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] [instance: b124ddce-db8e-4eb7-9363-62a47f8431d0] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:33:10.699114 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9db5cac2-f0a0-41a4-a16f-3999de490efd tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:33:10.699644 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9db5cac2-f0a0-41a4-a16f-3999de490efd tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:33:10.700090 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9db5cac2-f0a0-41a4-a16f-3999de490efd tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:33:10.700799 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9db5cac2-f0a0-41a4-a16f-3999de490efd tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:33:10.701257 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9db5cac2-f0a0-41a4-a16f-3999de490efd tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:33:10.702001 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9db5cac2-f0a0-41a4-a16f-3999de490efd tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:33:10.708686 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-1806588b-cef2-49bd-b805-0b6af236d77f req-c94b6ba5-ed01-4f09-a25f-4231c81788d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b124ddce-db8e-4eb7-9363-62a47f8431d0", "tag": "fd60d85c-f534-4103-a056-e380f01bc8f0"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:33:10.723909 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-1806588b-cef2-49bd-b805-0b6af236d77f req-c94b6ba5-ed01-4f09-a25f-4231c81788d4 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:33:10.724407 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-1806588b-cef2-49bd-b805-0b6af236d77f req-c94b6ba5-ed01-4f09-a25f-4231c81788d4 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:33:10.725041 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-1806588b-cef2-49bd-b805-0b6af236d77f req-c94b6ba5-ed01-4f09-a25f-4231c81788d4 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:33:10.739838 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-1806588b-cef2-49bd-b805-0b6af236d77f req-c94b6ba5-ed01-4f09-a25f-4231c81788d4 service nova] Creating event network-changed:fd60d85c-f534-4103-a056-e380f01bc8f0 for instance b124ddce-db8e-4eb7-9363-62a47f8431d0 on nch1-master-1 Oct 22 21:33:10.747934 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-1806588b-cef2-49bd-b805-0b6af236d77f req-c94b6ba5-ed01-4f09-a25f-4231c81788d4 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042825 Oct 22 21:33:10.748810 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2949/5873] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:33:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:33:11.212050 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-9db5cac2-f0a0-41a4-a16f-3999de490efd tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce13ae25b8cc4c32a66a2bcc536a3fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f9c508b2164653997b36431bb589b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:33:11.222351 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-9db5cac2-f0a0-41a4-a16f-3999de490efd tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] 10.222.0.18 "GET /compute/v2.1/servers/b124ddce-db8e-4eb7-9363-62a47f8431d0" status: 200 len: 1390 microversion: 2.1 time: 0.534987 Oct 22 21:33:11.222933 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2925/5874] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:33:10 2022] GET /compute/v2.1/servers/b124ddce-db8e-4eb7-9363-62a47f8431d0 => generated 1390 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:33:12.248152 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-f70604ea-9a8b-42d0-ba01-0af885c37bbc tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:33:12.248878 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-f70604ea-9a8b-42d0-ba01-0af885c37bbc tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] [instance: b124ddce-db8e-4eb7-9363-62a47f8431d0] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:33:12.256940 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f70604ea-9a8b-42d0-ba01-0af885c37bbc tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:33:12.257433 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f70604ea-9a8b-42d0-ba01-0af885c37bbc tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:33:12.257891 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f70604ea-9a8b-42d0-ba01-0af885c37bbc tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:33:12.258608 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f70604ea-9a8b-42d0-ba01-0af885c37bbc tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:33:12.259082 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f70604ea-9a8b-42d0-ba01-0af885c37bbc tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:33:12.259577 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f70604ea-9a8b-42d0-ba01-0af885c37bbc tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:33:12.401528 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-f70604ea-9a8b-42d0-ba01-0af885c37bbc tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce13ae25b8cc4c32a66a2bcc536a3fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f9c508b2164653997b36431bb589b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:33:12.409796 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-f70604ea-9a8b-42d0-ba01-0af885c37bbc tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] 10.222.0.18 "GET /compute/v2.1/servers/b124ddce-db8e-4eb7-9363-62a47f8431d0" status: 200 len: 1390 microversion: 2.1 time: 0.166821 Oct 22 21:33:12.410375 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2950/5875] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:33:12 2022] GET /compute/v2.1/servers/b124ddce-db8e-4eb7-9363-62a47f8431d0 => generated 1390 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:33:13.441789 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-4cb3b60d-2b45-4761-a5b0-c433db93a048 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:33:13.442387 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-4cb3b60d-2b45-4761-a5b0-c433db93a048 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] [instance: b124ddce-db8e-4eb7-9363-62a47f8431d0] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:33:13.460160 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4cb3b60d-2b45-4761-a5b0-c433db93a048 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:33:13.460726 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4cb3b60d-2b45-4761-a5b0-c433db93a048 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:33:13.461206 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4cb3b60d-2b45-4761-a5b0-c433db93a048 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:33:13.462076 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4cb3b60d-2b45-4761-a5b0-c433db93a048 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:33:13.462576 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4cb3b60d-2b45-4761-a5b0-c433db93a048 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:33:13.463202 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4cb3b60d-2b45-4761-a5b0-c433db93a048 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:33:13.694979 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-4cb3b60d-2b45-4761-a5b0-c433db93a048 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce13ae25b8cc4c32a66a2bcc536a3fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f9c508b2164653997b36431bb589b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:33:13.703442 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-4cb3b60d-2b45-4761-a5b0-c433db93a048 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] 10.222.0.18 "GET /compute/v2.1/servers/b124ddce-db8e-4eb7-9363-62a47f8431d0" status: 200 len: 1390 microversion: 2.1 time: 0.265512 Oct 22 21:33:13.704003 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2926/5876] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:33:13 2022] GET /compute/v2.1/servers/b124ddce-db8e-4eb7-9363-62a47f8431d0 => generated 1390 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:33:14.727432 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-0c2f5a9d-ea5e-4329-888e-61f90c9536fc tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:33:14.728021 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-0c2f5a9d-ea5e-4329-888e-61f90c9536fc tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] [instance: b124ddce-db8e-4eb7-9363-62a47f8431d0] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:33:14.730999 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell0:SELECT=2 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:33:14.737057 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0c2f5a9d-ea5e-4329-888e-61f90c9536fc tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:33:14.737581 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0c2f5a9d-ea5e-4329-888e-61f90c9536fc tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:33:14.738037 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0c2f5a9d-ea5e-4329-888e-61f90c9536fc tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:33:14.738750 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0c2f5a9d-ea5e-4329-888e-61f90c9536fc tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:33:14.739229 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0c2f5a9d-ea5e-4329-888e-61f90c9536fc tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:33:14.739703 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0c2f5a9d-ea5e-4329-888e-61f90c9536fc tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:33:14.882789 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-0c2f5a9d-ea5e-4329-888e-61f90c9536fc tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce13ae25b8cc4c32a66a2bcc536a3fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f9c508b2164653997b36431bb589b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:33:14.891679 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-0c2f5a9d-ea5e-4329-888e-61f90c9536fc tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] 10.222.0.18 "GET /compute/v2.1/servers/b124ddce-db8e-4eb7-9363-62a47f8431d0" status: 200 len: 1390 microversion: 2.1 time: 0.168163 Oct 22 21:33:14.892273 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2951/5877] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:33:14 2022] GET /compute/v2.1/servers/b124ddce-db8e-4eb7-9363-62a47f8431d0 => generated 1390 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:33:15.535212 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-7d0021f2-9888-4070-b6b3-636e3add44f6 req-68dfa4e7-1261-437d-a250-5f5b1b36e128 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b124ddce-db8e-4eb7-9363-62a47f8431d0", "name": "network-vif-plugged", "status": "completed", "tag": "fd60d85c-f534-4103-a056-e380f01bc8f0"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:33:15.546676 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-7d0021f2-9888-4070-b6b3-636e3add44f6 req-68dfa4e7-1261-437d-a250-5f5b1b36e128 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:33:15.547193 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-7d0021f2-9888-4070-b6b3-636e3add44f6 req-68dfa4e7-1261-437d-a250-5f5b1b36e128 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:33:15.547666 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-7d0021f2-9888-4070-b6b3-636e3add44f6 req-68dfa4e7-1261-437d-a250-5f5b1b36e128 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:33:15.562229 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-7d0021f2-9888-4070-b6b3-636e3add44f6 req-68dfa4e7-1261-437d-a250-5f5b1b36e128 service nova] Creating event network-vif-plugged:fd60d85c-f534-4103-a056-e380f01bc8f0 for instance b124ddce-db8e-4eb7-9363-62a47f8431d0 on nch1-master-1 Oct 22 21:33:15.568218 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-7d0021f2-9888-4070-b6b3-636e3add44f6 req-68dfa4e7-1261-437d-a250-5f5b1b36e128 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103186 Oct 22 21:33:15.568825 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2927/5878] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:33:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:33:15.916870 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-12a56c42-f28d-4454-b897-2f4ac20e26f5 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:33:15.917502 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-12a56c42-f28d-4454-b897-2f4ac20e26f5 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] [instance: b124ddce-db8e-4eb7-9363-62a47f8431d0] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:33:15.924962 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-12a56c42-f28d-4454-b897-2f4ac20e26f5 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:33:15.925468 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-12a56c42-f28d-4454-b897-2f4ac20e26f5 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:33:15.925920 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-12a56c42-f28d-4454-b897-2f4ac20e26f5 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:33:15.926644 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-12a56c42-f28d-4454-b897-2f4ac20e26f5 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:33:15.927113 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-12a56c42-f28d-4454-b897-2f4ac20e26f5 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:33:15.927560 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-12a56c42-f28d-4454-b897-2f4ac20e26f5 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:33:16.065317 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-12a56c42-f28d-4454-b897-2f4ac20e26f5 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce13ae25b8cc4c32a66a2bcc536a3fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f9c508b2164653997b36431bb589b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:33:16.073994 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-12a56c42-f28d-4454-b897-2f4ac20e26f5 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] 10.222.0.18 "GET /compute/v2.1/servers/b124ddce-db8e-4eb7-9363-62a47f8431d0" status: 200 len: 1390 microversion: 2.1 time: 0.162390 Oct 22 21:33:16.074572 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2952/5879] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:33:15 2022] GET /compute/v2.1/servers/b124ddce-db8e-4eb7-9363-62a47f8431d0 => generated 1390 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:33:17.100510 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-7d03b153-dc45-4487-a7f3-f62c3d6b03bf tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:33:17.101198 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-7d03b153-dc45-4487-a7f3-f62c3d6b03bf tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] [instance: b124ddce-db8e-4eb7-9363-62a47f8431d0] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:33:17.103598 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell0:SELECT=8 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:33:17.110459 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7d03b153-dc45-4487-a7f3-f62c3d6b03bf tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:33:17.110952 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7d03b153-dc45-4487-a7f3-f62c3d6b03bf tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:33:17.111390 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7d03b153-dc45-4487-a7f3-f62c3d6b03bf tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:33:17.112099 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7d03b153-dc45-4487-a7f3-f62c3d6b03bf tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:33:17.112588 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7d03b153-dc45-4487-a7f3-f62c3d6b03bf tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:33:17.113011 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7d03b153-dc45-4487-a7f3-f62c3d6b03bf tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:33:17.254855 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-7d03b153-dc45-4487-a7f3-f62c3d6b03bf tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce13ae25b8cc4c32a66a2bcc536a3fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f9c508b2164653997b36431bb589b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:33:17.263123 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-7d03b153-dc45-4487-a7f3-f62c3d6b03bf tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] 10.222.0.18 "GET /compute/v2.1/servers/b124ddce-db8e-4eb7-9363-62a47f8431d0" status: 200 len: 1562 microversion: 2.1 time: 0.168670 Oct 22 21:33:17.263753 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2928/5880] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:33:17 2022] GET /compute/v2.1/servers/b124ddce-db8e-4eb7-9363-62a47f8431d0 => generated 1562 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:33:17.286028 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-7036bf9b-c334-4b3b-b62a-99cf0db5b9bf tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:33:17.286655 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-7036bf9b-c334-4b3b-b62a-99cf0db5b9bf tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] [instance: b124ddce-db8e-4eb7-9363-62a47f8431d0] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:33:17.294859 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7036bf9b-c334-4b3b-b62a-99cf0db5b9bf tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:33:17.295385 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7036bf9b-c334-4b3b-b62a-99cf0db5b9bf tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:33:17.295863 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7036bf9b-c334-4b3b-b62a-99cf0db5b9bf tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:33:17.296577 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7036bf9b-c334-4b3b-b62a-99cf0db5b9bf tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:33:17.297043 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7036bf9b-c334-4b3b-b62a-99cf0db5b9bf tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:33:17.297485 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7036bf9b-c334-4b3b-b62a-99cf0db5b9bf tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:33:17.413083 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell0:SELECT=10 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:33:17.442304 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-7036bf9b-c334-4b3b-b62a-99cf0db5b9bf tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce13ae25b8cc4c32a66a2bcc536a3fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f9c508b2164653997b36431bb589b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:33:17.450460 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-7036bf9b-c334-4b3b-b62a-99cf0db5b9bf tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] 10.222.0.18 "GET /compute/v2.1/servers/b124ddce-db8e-4eb7-9363-62a47f8431d0" status: 200 len: 1562 microversion: 2.1 time: 0.168402 Oct 22 21:33:17.451042 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2953/5881] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:33:17 2022] GET /compute/v2.1/servers/b124ddce-db8e-4eb7-9363-62a47f8431d0 => generated 1562 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:33:19.355701 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-5a276014-7623-4d58-a14a-d713d44b1352 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:33:19.356287 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-5a276014-7623-4d58-a14a-d713d44b1352 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] [instance: b124ddce-db8e-4eb7-9363-62a47f8431d0] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:33:19.358754 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-dcd969b1-b162-4386-8126-fd025cb64365 req-9e520954-0c66-4a5c-9380-975690f47866 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b124ddce-db8e-4eb7-9363-62a47f8431d0", "tag": "fd60d85c-f534-4103-a056-e380f01bc8f0"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:33:19.363501 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5a276014-7623-4d58-a14a-d713d44b1352 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:33:19.363998 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5a276014-7623-4d58-a14a-d713d44b1352 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:33:19.364426 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5a276014-7623-4d58-a14a-d713d44b1352 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:33:19.365378 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5a276014-7623-4d58-a14a-d713d44b1352 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:33:19.365830 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5a276014-7623-4d58-a14a-d713d44b1352 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:33:19.366485 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5a276014-7623-4d58-a14a-d713d44b1352 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:33:19.370375 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-dcd969b1-b162-4386-8126-fd025cb64365 req-9e520954-0c66-4a5c-9380-975690f47866 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:33:19.370894 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-dcd969b1-b162-4386-8126-fd025cb64365 req-9e520954-0c66-4a5c-9380-975690f47866 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:33:19.371299 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-dcd969b1-b162-4386-8126-fd025cb64365 req-9e520954-0c66-4a5c-9380-975690f47866 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:33:19.383358 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-dcd969b1-b162-4386-8126-fd025cb64365 req-9e520954-0c66-4a5c-9380-975690f47866 service nova] Creating event network-changed:fd60d85c-f534-4103-a056-e380f01bc8f0 for instance b124ddce-db8e-4eb7-9363-62a47f8431d0 on nch1-master-1 Oct 22 21:33:19.389410 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-dcd969b1-b162-4386-8126-fd025cb64365 req-9e520954-0c66-4a5c-9380-975690f47866 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034929 Oct 22 21:33:19.390438 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2954/5882] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:33:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:33:19.589280 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-5a276014-7623-4d58-a14a-d713d44b1352 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce13ae25b8cc4c32a66a2bcc536a3fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f9c508b2164653997b36431bb589b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:33:19.597715 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-5a276014-7623-4d58-a14a-d713d44b1352 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] 10.222.0.18 "GET /compute/v2.1/servers/b124ddce-db8e-4eb7-9363-62a47f8431d0" status: 200 len: 1562 microversion: 2.1 time: 0.245708 Oct 22 21:33:19.598299 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2929/5883] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:33:19 2022] GET /compute/v2.1/servers/b124ddce-db8e-4eb7-9363-62a47f8431d0 => generated 1562 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:33:50.939493 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-410fcbd9-c94a-438b-a9f2-e939445b8a49 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:33:50.941922 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-410fcbd9-c94a-438b-a9f2-e939445b8a49 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] [instance: b124ddce-db8e-4eb7-9363-62a47f8431d0] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:33:50.944404 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:33:50.945065 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell1:SELECT=36 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:33:50.951979 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-410fcbd9-c94a-438b-a9f2-e939445b8a49 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:33:50.952482 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-410fcbd9-c94a-438b-a9f2-e939445b8a49 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:33:50.952935 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-410fcbd9-c94a-438b-a9f2-e939445b8a49 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:33:50.953636 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-410fcbd9-c94a-438b-a9f2-e939445b8a49 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:33:50.954099 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-410fcbd9-c94a-438b-a9f2-e939445b8a49 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:33:50.954536 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-410fcbd9-c94a-438b-a9f2-e939445b8a49 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:33:51.019627 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-410fcbd9-c94a-438b-a9f2-e939445b8a49 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] 10.222.0.18 "POST /compute/v2.1/servers/b124ddce-db8e-4eb7-9363-62a47f8431d0/action" status: 200 len: 24565 microversion: 2.1 time: 0.084004 Oct 22 21:33:51.020391 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2955/5884] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 21:33:50 2022] POST /compute/v2.1/servers/b124ddce-db8e-4eb7-9363-62a47f8431d0/action => generated 24565 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 22 21:34:21.412871 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=1 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:34:21.414073 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:SELECT=32 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:34:21.421516 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-632ca04f-687f-4e4c-9244-b6a92631f75a tempest-TestNetworkAdvancedServerOps-1033830903 tempest-TestNetworkAdvancedServerOps-1033830903-project-admin] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:34:21.422183 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-632ca04f-687f-4e4c-9244-b6a92631f75a tempest-TestNetworkAdvancedServerOps-1033830903 tempest-TestNetworkAdvancedServerOps-1033830903-project-admin] [instance: b124ddce-db8e-4eb7-9363-62a47f8431d0] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:34:21.429657 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-632ca04f-687f-4e4c-9244-b6a92631f75a tempest-TestNetworkAdvancedServerOps-1033830903 tempest-TestNetworkAdvancedServerOps-1033830903-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:34:21.430135 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-632ca04f-687f-4e4c-9244-b6a92631f75a tempest-TestNetworkAdvancedServerOps-1033830903 tempest-TestNetworkAdvancedServerOps-1033830903-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:34:21.430573 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-632ca04f-687f-4e4c-9244-b6a92631f75a tempest-TestNetworkAdvancedServerOps-1033830903 tempest-TestNetworkAdvancedServerOps-1033830903-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:34:21.431273 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-632ca04f-687f-4e4c-9244-b6a92631f75a tempest-TestNetworkAdvancedServerOps-1033830903 tempest-TestNetworkAdvancedServerOps-1033830903-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:34:21.431745 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-632ca04f-687f-4e4c-9244-b6a92631f75a tempest-TestNetworkAdvancedServerOps-1033830903 tempest-TestNetworkAdvancedServerOps-1033830903-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:34:21.432176 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-632ca04f-687f-4e4c-9244-b6a92631f75a tempest-TestNetworkAdvancedServerOps-1033830903 tempest-TestNetworkAdvancedServerOps-1033830903-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:34:21.671839 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-632ca04f-687f-4e4c-9244-b6a92631f75a tempest-TestNetworkAdvancedServerOps-1033830903 tempest-TestNetworkAdvancedServerOps-1033830903-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/b124ddce-db8e-4eb7-9363-62a47f8431d0" status: 200 len: 1832 microversion: 2.1 time: 0.262257 Oct 22 21:34:21.672350 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2930/5885] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:34:21 2022] GET /compute/v2.1/servers/b124ddce-db8e-4eb7-9363-62a47f8431d0 => generated 1832 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:34:21.695266 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-f89d067d-164c-4937-999f-c5be1cb2eb74 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:34:21.696029 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-f89d067d-164c-4937-999f-c5be1cb2eb74 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] [instance: b124ddce-db8e-4eb7-9363-62a47f8431d0] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:34:21.698774 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_api:SELECT=2 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:34:21.699535 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell1:SELECT=4 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:34:21.705560 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f89d067d-164c-4937-999f-c5be1cb2eb74 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:34:21.706057 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f89d067d-164c-4937-999f-c5be1cb2eb74 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:34:21.706507 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f89d067d-164c-4937-999f-c5be1cb2eb74 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:34:21.707250 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f89d067d-164c-4937-999f-c5be1cb2eb74 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:34:21.707743 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f89d067d-164c-4937-999f-c5be1cb2eb74 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:34:21.708184 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f89d067d-164c-4937-999f-c5be1cb2eb74 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:34:21.851837 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-f89d067d-164c-4937-999f-c5be1cb2eb74 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce13ae25b8cc4c32a66a2bcc536a3fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f9c508b2164653997b36431bb589b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:34:21.860116 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-f89d067d-164c-4937-999f-c5be1cb2eb74 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] 10.222.0.18 "GET /compute/v2.1/servers/b124ddce-db8e-4eb7-9363-62a47f8431d0" status: 200 len: 1681 microversion: 2.1 time: 0.169173 Oct 22 21:34:21.860697 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2956/5886] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:34:21 2022] GET /compute/v2.1/servers/b124ddce-db8e-4eb7-9363-62a47f8431d0 => generated 1681 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:34:21.960297 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-31681d8c-da03-4bdc-962b-2464abc33665 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:34:21.962579 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-31681d8c-da03-4bdc-962b-2464abc33665 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] [instance: b124ddce-db8e-4eb7-9363-62a47f8431d0] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:34:21.968975 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-31681d8c-da03-4bdc-962b-2464abc33665 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:34:21.969467 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-31681d8c-da03-4bdc-962b-2464abc33665 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:34:21.969912 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-31681d8c-da03-4bdc-962b-2464abc33665 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:34:21.970609 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-31681d8c-da03-4bdc-962b-2464abc33665 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:34:21.971068 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-31681d8c-da03-4bdc-962b-2464abc33665 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:34:21.971883 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-31681d8c-da03-4bdc-962b-2464abc33665 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:34:22.025552 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-31681d8c-da03-4bdc-962b-2464abc33665 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] 10.222.0.18 "POST /compute/v2.1/servers/b124ddce-db8e-4eb7-9363-62a47f8431d0/action" status: 200 len: 32639 microversion: 2.1 time: 0.069187 Oct 22 21:34:22.026205 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2931/5887] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 21:34:21 2022] POST /compute/v2.1/servers/b124ddce-db8e-4eb7-9363-62a47f8431d0/action => generated 32639 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 22 21:34:22.193560 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-62c363d1-bdf4-40db-bf81-7ca7cb052c43 tempest-TestNetworkAdvancedServerOps-1033830903 tempest-TestNetworkAdvancedServerOps-1033830903-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:34:22.194087 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-62c363d1-bdf4-40db-bf81-7ca7cb052c43 tempest-TestNetworkAdvancedServerOps-1033830903 tempest-TestNetworkAdvancedServerOps-1033830903-project-admin] [instance: b124ddce-db8e-4eb7-9363-62a47f8431d0] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:34:22.201223 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-62c363d1-bdf4-40db-bf81-7ca7cb052c43 tempest-TestNetworkAdvancedServerOps-1033830903 tempest-TestNetworkAdvancedServerOps-1033830903-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:34:22.201719 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-62c363d1-bdf4-40db-bf81-7ca7cb052c43 tempest-TestNetworkAdvancedServerOps-1033830903 tempest-TestNetworkAdvancedServerOps-1033830903-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:34:22.202169 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-62c363d1-bdf4-40db-bf81-7ca7cb052c43 tempest-TestNetworkAdvancedServerOps-1033830903 tempest-TestNetworkAdvancedServerOps-1033830903-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:34:22.202992 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-62c363d1-bdf4-40db-bf81-7ca7cb052c43 tempest-TestNetworkAdvancedServerOps-1033830903 tempest-TestNetworkAdvancedServerOps-1033830903-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:34:22.203527 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-62c363d1-bdf4-40db-bf81-7ca7cb052c43 tempest-TestNetworkAdvancedServerOps-1033830903 tempest-TestNetworkAdvancedServerOps-1033830903-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:34:22.203966 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-62c363d1-bdf4-40db-bf81-7ca7cb052c43 tempest-TestNetworkAdvancedServerOps-1033830903 tempest-TestNetworkAdvancedServerOps-1033830903-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:34:22.247186 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-62c363d1-bdf4-40db-bf81-7ca7cb052c43 tempest-TestNetworkAdvancedServerOps-1033830903 tempest-TestNetworkAdvancedServerOps-1033830903-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '8062c6bcb7e94f89912f950f038f2d06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df62f4c34cc4f75833795a8b03df66c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:34:22.247834 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-62c363d1-bdf4-40db-bf81-7ca7cb052c43 tempest-TestNetworkAdvancedServerOps-1033830903 tempest-TestNetworkAdvancedServerOps-1033830903-project-admin] [instance: b124ddce-db8e-4eb7-9363-62a47f8431d0] flavor_id is None. Assuming migration. {{(pid=138745) resize /opt/stack/nova/nova/compute/api.py:4196}} Oct 22 21:34:22.248295 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-62c363d1-bdf4-40db-bf81-7ca7cb052c43 tempest-TestNetworkAdvancedServerOps-1033830903 tempest-TestNetworkAdvancedServerOps-1033830903-project-admin] [instance: b124ddce-db8e-4eb7-9363-62a47f8431d0] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=138745) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 22 21:34:22.447702 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-62c363d1-bdf4-40db-bf81-7ca7cb052c43 tempest-TestNetworkAdvancedServerOps-1033830903 tempest-TestNetworkAdvancedServerOps-1033830903-project-admin] 10.222.0.18 "POST /compute/v2.1/servers/b124ddce-db8e-4eb7-9363-62a47f8431d0/action" status: 202 len: 0 microversion: 2.1 time: 0.257919 Oct 22 21:34:22.448452 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2957/5888] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 21:34:22 2022] POST /compute/v2.1/servers/b124ddce-db8e-4eb7-9363-62a47f8431d0/action => generated 0 bytes in 260 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 21:34:22.457354 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-5de2014f-5626-4628-85e0-d8d26edf2db3 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:34:22.458070 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-5de2014f-5626-4628-85e0-d8d26edf2db3 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] [instance: b124ddce-db8e-4eb7-9363-62a47f8431d0] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:34:22.465652 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5de2014f-5626-4628-85e0-d8d26edf2db3 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:34:22.466143 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5de2014f-5626-4628-85e0-d8d26edf2db3 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:34:22.466585 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5de2014f-5626-4628-85e0-d8d26edf2db3 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:34:22.467288 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5de2014f-5626-4628-85e0-d8d26edf2db3 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:34:22.467770 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5de2014f-5626-4628-85e0-d8d26edf2db3 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:34:22.468436 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5de2014f-5626-4628-85e0-d8d26edf2db3 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:34:22.605624 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-5de2014f-5626-4628-85e0-d8d26edf2db3 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce13ae25b8cc4c32a66a2bcc536a3fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f9c508b2164653997b36431bb589b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:34:22.613816 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-5de2014f-5626-4628-85e0-d8d26edf2db3 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] 10.222.0.18 "GET /compute/v2.1/servers/b124ddce-db8e-4eb7-9363-62a47f8431d0" status: 200 len: 1690 microversion: 2.1 time: 0.160968 Oct 22 21:34:22.614411 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2932/5889] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:34:22 2022] GET /compute/v2.1/servers/b124ddce-db8e-4eb7-9363-62a47f8431d0 => generated 1690 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:34:23.642954 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-3a2d5965-6b3c-4785-b8f5-55edd72861a3 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:34:23.643606 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-3a2d5965-6b3c-4785-b8f5-55edd72861a3 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] [instance: b124ddce-db8e-4eb7-9363-62a47f8431d0] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:34:23.651608 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3a2d5965-6b3c-4785-b8f5-55edd72861a3 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:34:23.652103 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3a2d5965-6b3c-4785-b8f5-55edd72861a3 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:34:23.652562 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3a2d5965-6b3c-4785-b8f5-55edd72861a3 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:34:23.653289 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3a2d5965-6b3c-4785-b8f5-55edd72861a3 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:34:23.653767 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3a2d5965-6b3c-4785-b8f5-55edd72861a3 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:34:23.654215 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3a2d5965-6b3c-4785-b8f5-55edd72861a3 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:34:23.795932 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-3a2d5965-6b3c-4785-b8f5-55edd72861a3 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce13ae25b8cc4c32a66a2bcc536a3fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f9c508b2164653997b36431bb589b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:34:23.808974 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-3a2d5965-6b3c-4785-b8f5-55edd72861a3 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] 10.222.0.18 "GET /compute/v2.1/servers/b124ddce-db8e-4eb7-9363-62a47f8431d0" status: 200 len: 1690 microversion: 2.1 time: 0.173228 Oct 22 21:34:23.809863 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2958/5890] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:34:23 2022] GET /compute/v2.1/servers/b124ddce-db8e-4eb7-9363-62a47f8431d0 => generated 1690 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:34:24.837690 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-54ce43ad-d7ef-452b-8b0d-4e3b73461276 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:34:24.838711 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-54ce43ad-d7ef-452b-8b0d-4e3b73461276 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] [instance: b124ddce-db8e-4eb7-9363-62a47f8431d0] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:34:24.848493 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-54ce43ad-d7ef-452b-8b0d-4e3b73461276 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:34:24.848984 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-54ce43ad-d7ef-452b-8b0d-4e3b73461276 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:34:24.849431 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-54ce43ad-d7ef-452b-8b0d-4e3b73461276 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:34:24.850141 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-54ce43ad-d7ef-452b-8b0d-4e3b73461276 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:34:24.850605 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-54ce43ad-d7ef-452b-8b0d-4e3b73461276 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:34:24.851062 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-54ce43ad-d7ef-452b-8b0d-4e3b73461276 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:34:24.985350 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-54ce43ad-d7ef-452b-8b0d-4e3b73461276 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce13ae25b8cc4c32a66a2bcc536a3fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f9c508b2164653997b36431bb589b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:34:24.993675 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-54ce43ad-d7ef-452b-8b0d-4e3b73461276 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] 10.222.0.18 "GET /compute/v2.1/servers/b124ddce-db8e-4eb7-9363-62a47f8431d0" status: 200 len: 1690 microversion: 2.1 time: 0.162785 Oct 22 21:34:24.994246 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2933/5891] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:34:24 2022] GET /compute/v2.1/servers/b124ddce-db8e-4eb7-9363-62a47f8431d0 => generated 1690 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:34:26.020300 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-760da105-b202-48ba-b811-333f464de7e4 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:34:26.021090 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-760da105-b202-48ba-b811-333f464de7e4 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] [instance: b124ddce-db8e-4eb7-9363-62a47f8431d0] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:34:26.031875 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-760da105-b202-48ba-b811-333f464de7e4 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:34:26.032357 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-760da105-b202-48ba-b811-333f464de7e4 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:34:26.032812 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-760da105-b202-48ba-b811-333f464de7e4 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:34:26.033530 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-760da105-b202-48ba-b811-333f464de7e4 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:34:26.034003 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-760da105-b202-48ba-b811-333f464de7e4 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:34:26.034443 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-760da105-b202-48ba-b811-333f464de7e4 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:34:26.173018 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-760da105-b202-48ba-b811-333f464de7e4 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce13ae25b8cc4c32a66a2bcc536a3fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f9c508b2164653997b36431bb589b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:34:26.181429 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-760da105-b202-48ba-b811-333f464de7e4 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] 10.222.0.18 "GET /compute/v2.1/servers/b124ddce-db8e-4eb7-9363-62a47f8431d0" status: 200 len: 1690 microversion: 2.1 time: 0.166473 Oct 22 21:34:26.181981 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2959/5892] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:34:26 2022] GET /compute/v2.1/servers/b124ddce-db8e-4eb7-9363-62a47f8431d0 => generated 1690 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:34:27.207989 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-4a1df2a7-291a-4f1c-ab80-e307c5ee062c tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:34:27.208702 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-4a1df2a7-291a-4f1c-ab80-e307c5ee062c tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] [instance: b124ddce-db8e-4eb7-9363-62a47f8431d0] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:34:27.217244 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4a1df2a7-291a-4f1c-ab80-e307c5ee062c tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:34:27.217833 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4a1df2a7-291a-4f1c-ab80-e307c5ee062c tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:34:27.218361 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4a1df2a7-291a-4f1c-ab80-e307c5ee062c tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:34:27.219194 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4a1df2a7-291a-4f1c-ab80-e307c5ee062c tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:34:27.219779 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4a1df2a7-291a-4f1c-ab80-e307c5ee062c tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:34:27.220316 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4a1df2a7-291a-4f1c-ab80-e307c5ee062c tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:34:27.361160 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-4a1df2a7-291a-4f1c-ab80-e307c5ee062c tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce13ae25b8cc4c32a66a2bcc536a3fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f9c508b2164653997b36431bb589b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:34:27.369396 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-4a1df2a7-291a-4f1c-ab80-e307c5ee062c tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] 10.222.0.18 "GET /compute/v2.1/servers/b124ddce-db8e-4eb7-9363-62a47f8431d0" status: 200 len: 1690 microversion: 2.1 time: 0.166953 Oct 22 21:34:27.369959 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2934/5893] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:34:27 2022] GET /compute/v2.1/servers/b124ddce-db8e-4eb7-9363-62a47f8431d0 => generated 1690 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:34:28.393705 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-c22e01ef-1258-490f-a051-7c2b55800b29 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:34:28.394583 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-c22e01ef-1258-490f-a051-7c2b55800b29 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] [instance: b124ddce-db8e-4eb7-9363-62a47f8431d0] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:34:28.402000 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c22e01ef-1258-490f-a051-7c2b55800b29 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:34:28.402520 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c22e01ef-1258-490f-a051-7c2b55800b29 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:34:28.403012 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c22e01ef-1258-490f-a051-7c2b55800b29 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:34:28.403785 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c22e01ef-1258-490f-a051-7c2b55800b29 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:34:28.404269 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c22e01ef-1258-490f-a051-7c2b55800b29 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:34:28.404720 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c22e01ef-1258-490f-a051-7c2b55800b29 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:34:28.561991 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-c22e01ef-1258-490f-a051-7c2b55800b29 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce13ae25b8cc4c32a66a2bcc536a3fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f9c508b2164653997b36431bb589b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:34:28.570278 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-c22e01ef-1258-490f-a051-7c2b55800b29 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] 10.222.0.18 "GET /compute/v2.1/servers/b124ddce-db8e-4eb7-9363-62a47f8431d0" status: 200 len: 1690 microversion: 2.1 time: 0.180771 Oct 22 21:34:28.570865 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2960/5894] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:34:28 2022] GET /compute/v2.1/servers/b124ddce-db8e-4eb7-9363-62a47f8431d0 => generated 1690 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:34:29.599005 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-5f707386-5511-40d8-8af3-ff6a18fca2c2 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:34:29.600016 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-5f707386-5511-40d8-8af3-ff6a18fca2c2 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] [instance: b124ddce-db8e-4eb7-9363-62a47f8431d0] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:34:29.611898 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5f707386-5511-40d8-8af3-ff6a18fca2c2 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:34:29.612721 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5f707386-5511-40d8-8af3-ff6a18fca2c2 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:34:29.613642 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5f707386-5511-40d8-8af3-ff6a18fca2c2 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:34:29.614373 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5f707386-5511-40d8-8af3-ff6a18fca2c2 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:34:29.614870 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5f707386-5511-40d8-8af3-ff6a18fca2c2 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:34:29.615315 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5f707386-5511-40d8-8af3-ff6a18fca2c2 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:34:29.757881 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-5f707386-5511-40d8-8af3-ff6a18fca2c2 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce13ae25b8cc4c32a66a2bcc536a3fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f9c508b2164653997b36431bb589b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:34:29.766243 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-5f707386-5511-40d8-8af3-ff6a18fca2c2 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] 10.222.0.18 "GET /compute/v2.1/servers/b124ddce-db8e-4eb7-9363-62a47f8431d0" status: 200 len: 1695 microversion: 2.1 time: 0.174268 Oct 22 21:34:29.766820 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2935/5895] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:34:29 2022] GET /compute/v2.1/servers/b124ddce-db8e-4eb7-9363-62a47f8431d0 => generated 1695 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:34:30.802327 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-2405cebe-a7a7-4900-b53a-4822e4ab39a4 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:34:30.802898 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-2405cebe-a7a7-4900-b53a-4822e4ab39a4 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] [instance: b124ddce-db8e-4eb7-9363-62a47f8431d0] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:34:30.810369 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2405cebe-a7a7-4900-b53a-4822e4ab39a4 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:34:30.810876 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2405cebe-a7a7-4900-b53a-4822e4ab39a4 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:34:30.811364 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2405cebe-a7a7-4900-b53a-4822e4ab39a4 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:34:30.812089 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2405cebe-a7a7-4900-b53a-4822e4ab39a4 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:34:30.812570 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2405cebe-a7a7-4900-b53a-4822e4ab39a4 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:34:30.813015 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2405cebe-a7a7-4900-b53a-4822e4ab39a4 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:34:30.950553 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-2405cebe-a7a7-4900-b53a-4822e4ab39a4 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce13ae25b8cc4c32a66a2bcc536a3fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f9c508b2164653997b36431bb589b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:34:30.958791 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-2405cebe-a7a7-4900-b53a-4822e4ab39a4 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] 10.222.0.18 "GET /compute/v2.1/servers/b124ddce-db8e-4eb7-9363-62a47f8431d0" status: 200 len: 1695 microversion: 2.1 time: 0.163305 Oct 22 21:34:30.959505 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2961/5896] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:34:30 2022] GET /compute/v2.1/servers/b124ddce-db8e-4eb7-9363-62a47f8431d0 => generated 1695 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:34:31.984630 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-d3e864a1-ff46-48b8-bdc7-c581ae381812 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:34:31.986198 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-d3e864a1-ff46-48b8-bdc7-c581ae381812 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] [instance: b124ddce-db8e-4eb7-9363-62a47f8431d0] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:34:31.995616 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d3e864a1-ff46-48b8-bdc7-c581ae381812 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:34:31.996235 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d3e864a1-ff46-48b8-bdc7-c581ae381812 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:34:31.996795 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d3e864a1-ff46-48b8-bdc7-c581ae381812 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:34:31.997673 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d3e864a1-ff46-48b8-bdc7-c581ae381812 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:34:31.998246 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d3e864a1-ff46-48b8-bdc7-c581ae381812 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:34:31.998790 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d3e864a1-ff46-48b8-bdc7-c581ae381812 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:34:32.141791 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-d3e864a1-ff46-48b8-bdc7-c581ae381812 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce13ae25b8cc4c32a66a2bcc536a3fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f9c508b2164653997b36431bb589b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:34:32.153968 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-d3e864a1-ff46-48b8-bdc7-c581ae381812 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] 10.222.0.18 "GET /compute/v2.1/servers/b124ddce-db8e-4eb7-9363-62a47f8431d0" status: 200 len: 1695 microversion: 2.1 time: 0.173961 Oct 22 21:34:32.154878 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2936/5897] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:34:31 2022] GET /compute/v2.1/servers/b124ddce-db8e-4eb7-9363-62a47f8431d0 => generated 1695 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:34:33.181653 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-a7f9c056-0170-431b-bf54-eac01e9a0040 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:34:33.182325 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-a7f9c056-0170-431b-bf54-eac01e9a0040 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] [instance: b124ddce-db8e-4eb7-9363-62a47f8431d0] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:34:33.190373 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a7f9c056-0170-431b-bf54-eac01e9a0040 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:34:33.190899 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a7f9c056-0170-431b-bf54-eac01e9a0040 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:34:33.191380 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a7f9c056-0170-431b-bf54-eac01e9a0040 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:34:33.192410 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a7f9c056-0170-431b-bf54-eac01e9a0040 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:34:33.192905 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a7f9c056-0170-431b-bf54-eac01e9a0040 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:34:33.193370 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a7f9c056-0170-431b-bf54-eac01e9a0040 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:34:33.327638 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-a7f9c056-0170-431b-bf54-eac01e9a0040 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce13ae25b8cc4c32a66a2bcc536a3fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f9c508b2164653997b36431bb589b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:34:33.338855 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-a7f9c056-0170-431b-bf54-eac01e9a0040 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] 10.222.0.18 "GET /compute/v2.1/servers/b124ddce-db8e-4eb7-9363-62a47f8431d0" status: 200 len: 1695 microversion: 2.1 time: 0.161379 Oct 22 21:34:33.339692 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2962/5898] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:34:33 2022] GET /compute/v2.1/servers/b124ddce-db8e-4eb7-9363-62a47f8431d0 => generated 1695 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:34:34.368210 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-5105c44a-726b-4e1b-95b8-a1a8063a9903 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:34:34.369151 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-5105c44a-726b-4e1b-95b8-a1a8063a9903 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] [instance: b124ddce-db8e-4eb7-9363-62a47f8431d0] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:34:34.380953 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5105c44a-726b-4e1b-95b8-a1a8063a9903 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:34:34.381774 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5105c44a-726b-4e1b-95b8-a1a8063a9903 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:34:34.382520 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5105c44a-726b-4e1b-95b8-a1a8063a9903 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:34:34.383499 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5105c44a-726b-4e1b-95b8-a1a8063a9903 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:34:34.383998 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5105c44a-726b-4e1b-95b8-a1a8063a9903 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:34:34.384425 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5105c44a-726b-4e1b-95b8-a1a8063a9903 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:34:34.530652 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-5105c44a-726b-4e1b-95b8-a1a8063a9903 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce13ae25b8cc4c32a66a2bcc536a3fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f9c508b2164653997b36431bb589b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:34:34.539125 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-5105c44a-726b-4e1b-95b8-a1a8063a9903 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] 10.222.0.18 "GET /compute/v2.1/servers/b124ddce-db8e-4eb7-9363-62a47f8431d0" status: 200 len: 1695 microversion: 2.1 time: 0.177591 Oct 22 21:34:34.539838 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2937/5899] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:34:34 2022] GET /compute/v2.1/servers/b124ddce-db8e-4eb7-9363-62a47f8431d0 => generated 1695 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:34:35.567409 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-06c959ab-4b05-446d-a85f-1cf88e25da53 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:34:35.568509 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-06c959ab-4b05-446d-a85f-1cf88e25da53 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] [instance: b124ddce-db8e-4eb7-9363-62a47f8431d0] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:34:35.576969 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-06c959ab-4b05-446d-a85f-1cf88e25da53 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:34:35.577481 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-06c959ab-4b05-446d-a85f-1cf88e25da53 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:34:35.577944 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-06c959ab-4b05-446d-a85f-1cf88e25da53 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:34:35.578669 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-06c959ab-4b05-446d-a85f-1cf88e25da53 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:34:35.579152 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-06c959ab-4b05-446d-a85f-1cf88e25da53 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:34:35.579635 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-06c959ab-4b05-446d-a85f-1cf88e25da53 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:34:35.722519 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-06c959ab-4b05-446d-a85f-1cf88e25da53 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce13ae25b8cc4c32a66a2bcc536a3fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f9c508b2164653997b36431bb589b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:34:35.730988 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-06c959ab-4b05-446d-a85f-1cf88e25da53 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] 10.222.0.18 "GET /compute/v2.1/servers/b124ddce-db8e-4eb7-9363-62a47f8431d0" status: 200 len: 1695 microversion: 2.1 time: 0.170285 Oct 22 21:34:35.731640 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2963/5900] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:34:35 2022] GET /compute/v2.1/servers/b124ddce-db8e-4eb7-9363-62a47f8431d0 => generated 1695 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:34:36.759826 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-c01ba06f-73b8-4584-b349-1a418d43bfe5 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:34:36.760939 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-c01ba06f-73b8-4584-b349-1a418d43bfe5 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] [instance: b124ddce-db8e-4eb7-9363-62a47f8431d0] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:34:36.772994 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c01ba06f-73b8-4584-b349-1a418d43bfe5 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:34:36.773982 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c01ba06f-73b8-4584-b349-1a418d43bfe5 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:34:36.774741 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c01ba06f-73b8-4584-b349-1a418d43bfe5 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:34:36.775501 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c01ba06f-73b8-4584-b349-1a418d43bfe5 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:34:36.775969 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c01ba06f-73b8-4584-b349-1a418d43bfe5 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:34:36.776408 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c01ba06f-73b8-4584-b349-1a418d43bfe5 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:34:36.913122 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-c01ba06f-73b8-4584-b349-1a418d43bfe5 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce13ae25b8cc4c32a66a2bcc536a3fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f9c508b2164653997b36431bb589b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:34:36.921344 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-c01ba06f-73b8-4584-b349-1a418d43bfe5 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] 10.222.0.18 "GET /compute/v2.1/servers/b124ddce-db8e-4eb7-9363-62a47f8431d0" status: 200 len: 1695 microversion: 2.1 time: 0.168912 Oct 22 21:34:36.921917 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2938/5901] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:34:36 2022] GET /compute/v2.1/servers/b124ddce-db8e-4eb7-9363-62a47f8431d0 => generated 1695 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:34:37.945777 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-9093b4ba-1b34-40a7-b9fd-1735e97d1c34 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:34:37.946442 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-9093b4ba-1b34-40a7-b9fd-1735e97d1c34 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] [instance: b124ddce-db8e-4eb7-9363-62a47f8431d0] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:34:37.954585 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9093b4ba-1b34-40a7-b9fd-1735e97d1c34 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:34:37.955120 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9093b4ba-1b34-40a7-b9fd-1735e97d1c34 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:34:37.955737 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9093b4ba-1b34-40a7-b9fd-1735e97d1c34 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:34:37.956638 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9093b4ba-1b34-40a7-b9fd-1735e97d1c34 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:34:37.957117 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9093b4ba-1b34-40a7-b9fd-1735e97d1c34 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:34:37.957566 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9093b4ba-1b34-40a7-b9fd-1735e97d1c34 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:34:38.179516 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-9093b4ba-1b34-40a7-b9fd-1735e97d1c34 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce13ae25b8cc4c32a66a2bcc536a3fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f9c508b2164653997b36431bb589b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:34:38.188917 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-9093b4ba-1b34-40a7-b9fd-1735e97d1c34 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] 10.222.0.18 "GET /compute/v2.1/servers/b124ddce-db8e-4eb7-9363-62a47f8431d0" status: 200 len: 1695 microversion: 2.1 time: 0.247343 Oct 22 21:34:38.189499 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2964/5902] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:34:37 2022] GET /compute/v2.1/servers/b124ddce-db8e-4eb7-9363-62a47f8431d0 => generated 1695 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:34:39.216738 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-2571bbb8-f939-480f-833b-e8047c9e5472 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:34:39.217781 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-2571bbb8-f939-480f-833b-e8047c9e5472 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] [instance: b124ddce-db8e-4eb7-9363-62a47f8431d0] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:34:39.229750 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2571bbb8-f939-480f-833b-e8047c9e5472 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:34:39.230248 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2571bbb8-f939-480f-833b-e8047c9e5472 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:34:39.230658 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2571bbb8-f939-480f-833b-e8047c9e5472 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:34:39.231396 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2571bbb8-f939-480f-833b-e8047c9e5472 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:34:39.231886 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2571bbb8-f939-480f-833b-e8047c9e5472 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:34:39.232319 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2571bbb8-f939-480f-833b-e8047c9e5472 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:34:39.367323 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-2571bbb8-f939-480f-833b-e8047c9e5472 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce13ae25b8cc4c32a66a2bcc536a3fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f9c508b2164653997b36431bb589b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:34:39.376185 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-2571bbb8-f939-480f-833b-e8047c9e5472 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] 10.222.0.18 "GET /compute/v2.1/servers/b124ddce-db8e-4eb7-9363-62a47f8431d0" status: 200 len: 1695 microversion: 2.1 time: 0.166222 Oct 22 21:34:39.376736 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2939/5903] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:34:39 2022] GET /compute/v2.1/servers/b124ddce-db8e-4eb7-9363-62a47f8431d0 => generated 1695 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:34:40.404142 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-47928d6f-509e-4bcd-b832-8c69761cba11 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:34:40.404995 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-47928d6f-509e-4bcd-b832-8c69761cba11 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] [instance: b124ddce-db8e-4eb7-9363-62a47f8431d0] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:34:40.414648 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-47928d6f-509e-4bcd-b832-8c69761cba11 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:34:40.415325 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-47928d6f-509e-4bcd-b832-8c69761cba11 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:34:40.415984 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-47928d6f-509e-4bcd-b832-8c69761cba11 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:34:40.416938 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-47928d6f-509e-4bcd-b832-8c69761cba11 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:34:40.417794 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-47928d6f-509e-4bcd-b832-8c69761cba11 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:34:40.418391 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-47928d6f-509e-4bcd-b832-8c69761cba11 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:34:40.560679 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-47928d6f-509e-4bcd-b832-8c69761cba11 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce13ae25b8cc4c32a66a2bcc536a3fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f9c508b2164653997b36431bb589b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:34:40.569252 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-47928d6f-509e-4bcd-b832-8c69761cba11 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] 10.222.0.18 "GET /compute/v2.1/servers/b124ddce-db8e-4eb7-9363-62a47f8431d0" status: 200 len: 1695 microversion: 2.1 time: 0.171640 Oct 22 21:34:40.569811 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2965/5904] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:34:40 2022] GET /compute/v2.1/servers/b124ddce-db8e-4eb7-9363-62a47f8431d0 => generated 1695 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:34:41.605215 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-d2a8a6a4-9c6f-46b2-8d8d-bf2b1ad2a588 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:34:41.605951 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-d2a8a6a4-9c6f-46b2-8d8d-bf2b1ad2a588 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] [instance: b124ddce-db8e-4eb7-9363-62a47f8431d0] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:34:41.615164 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d2a8a6a4-9c6f-46b2-8d8d-bf2b1ad2a588 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:34:41.615825 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d2a8a6a4-9c6f-46b2-8d8d-bf2b1ad2a588 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:34:41.616380 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d2a8a6a4-9c6f-46b2-8d8d-bf2b1ad2a588 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:34:41.617254 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d2a8a6a4-9c6f-46b2-8d8d-bf2b1ad2a588 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:34:41.617832 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d2a8a6a4-9c6f-46b2-8d8d-bf2b1ad2a588 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:34:41.618375 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d2a8a6a4-9c6f-46b2-8d8d-bf2b1ad2a588 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:34:41.822427 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-d2a8a6a4-9c6f-46b2-8d8d-bf2b1ad2a588 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce13ae25b8cc4c32a66a2bcc536a3fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f9c508b2164653997b36431bb589b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:34:41.831184 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-d2a8a6a4-9c6f-46b2-8d8d-bf2b1ad2a588 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] 10.222.0.18 "GET /compute/v2.1/servers/b124ddce-db8e-4eb7-9363-62a47f8431d0" status: 200 len: 1695 microversion: 2.1 time: 0.232560 Oct 22 21:34:41.831780 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2940/5905] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:34:41 2022] GET /compute/v2.1/servers/b124ddce-db8e-4eb7-9363-62a47f8431d0 => generated 1695 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:34:42.855663 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-79f835e5-e950-44b8-9359-5e4f39273a1b tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:34:42.856263 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-79f835e5-e950-44b8-9359-5e4f39273a1b tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] [instance: b124ddce-db8e-4eb7-9363-62a47f8431d0] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:34:42.863687 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-79f835e5-e950-44b8-9359-5e4f39273a1b tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:34:42.864206 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-79f835e5-e950-44b8-9359-5e4f39273a1b tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:34:42.864659 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-79f835e5-e950-44b8-9359-5e4f39273a1b tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:34:42.865383 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-79f835e5-e950-44b8-9359-5e4f39273a1b tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:34:42.865856 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-79f835e5-e950-44b8-9359-5e4f39273a1b tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:34:42.866298 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-79f835e5-e950-44b8-9359-5e4f39273a1b tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:34:43.006040 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-79f835e5-e950-44b8-9359-5e4f39273a1b tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce13ae25b8cc4c32a66a2bcc536a3fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f9c508b2164653997b36431bb589b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:34:43.014622 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-79f835e5-e950-44b8-9359-5e4f39273a1b tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] 10.222.0.18 "GET /compute/v2.1/servers/b124ddce-db8e-4eb7-9363-62a47f8431d0" status: 200 len: 1695 microversion: 2.1 time: 0.162998 Oct 22 21:34:43.015195 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2966/5906] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:34:42 2022] GET /compute/v2.1/servers/b124ddce-db8e-4eb7-9363-62a47f8431d0 => generated 1695 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:34:44.038457 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-25451d24-d8d2-4931-b9d8-5a2c2cde78bc tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:34:44.039104 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-25451d24-d8d2-4931-b9d8-5a2c2cde78bc tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] [instance: b124ddce-db8e-4eb7-9363-62a47f8431d0] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:34:44.046492 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-25451d24-d8d2-4931-b9d8-5a2c2cde78bc tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:34:44.046994 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-25451d24-d8d2-4931-b9d8-5a2c2cde78bc tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:34:44.047465 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-25451d24-d8d2-4931-b9d8-5a2c2cde78bc tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:34:44.048190 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-25451d24-d8d2-4931-b9d8-5a2c2cde78bc tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:34:44.048647 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-25451d24-d8d2-4931-b9d8-5a2c2cde78bc tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:34:44.049140 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-25451d24-d8d2-4931-b9d8-5a2c2cde78bc tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:34:44.198684 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-25451d24-d8d2-4931-b9d8-5a2c2cde78bc tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce13ae25b8cc4c32a66a2bcc536a3fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f9c508b2164653997b36431bb589b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:34:44.206954 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-25451d24-d8d2-4931-b9d8-5a2c2cde78bc tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] 10.222.0.18 "GET /compute/v2.1/servers/b124ddce-db8e-4eb7-9363-62a47f8431d0" status: 200 len: 1695 microversion: 2.1 time: 0.172559 Oct 22 21:34:44.207523 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2941/5907] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:34:44 2022] GET /compute/v2.1/servers/b124ddce-db8e-4eb7-9363-62a47f8431d0 => generated 1695 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:34:45.232396 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-28f06e18-ae05-4b40-a66c-65398fedb901 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:34:45.233125 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-28f06e18-ae05-4b40-a66c-65398fedb901 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] [instance: b124ddce-db8e-4eb7-9363-62a47f8431d0] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:34:45.235717 ncdv-master-1 devstack@n-api.service[138745]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 22 21:34:45.235929 ncdv-master-1 devstack@n-api.service[138745]: Sat Oct 22 21:34:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b124ddce-db8e-4eb7-9363-62a47f8431d0 (ip 10.222.0.18) !!! Oct 22 21:34:45.245042 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-28f06e18-ae05-4b40-a66c-65398fedb901 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:34:45.245622 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-28f06e18-ae05-4b40-a66c-65398fedb901 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:34:45.246164 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-28f06e18-ae05-4b40-a66c-65398fedb901 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:34:45.247044 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-28f06e18-ae05-4b40-a66c-65398fedb901 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:34:45.247616 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-28f06e18-ae05-4b40-a66c-65398fedb901 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:34:45.248136 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-28f06e18-ae05-4b40-a66c-65398fedb901 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:34:45.392954 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-28f06e18-ae05-4b40-a66c-65398fedb901 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce13ae25b8cc4c32a66a2bcc536a3fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f9c508b2164653997b36431bb589b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:34:45.405569 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-28f06e18-ae05-4b40-a66c-65398fedb901 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] 10.222.0.18 "GET /compute/v2.1/servers/b124ddce-db8e-4eb7-9363-62a47f8431d0" status: 200 len: 1695 microversion: 2.1 time: 0.177785 Oct 22 21:34:45.406323 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2967/5908] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:34:45 2022] GET /compute/v2.1/servers/b124ddce-db8e-4eb7-9363-62a47f8431d0 => generated 1695 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:34:46.251180 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-9d266465-3753-4c2c-b9e0-743c9d96fd12 req-3a809714-413b-4ef3-97c6-1d791e20068f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b124ddce-db8e-4eb7-9363-62a47f8431d0", "name": "network-vif-unplugged", "status": "completed", "tag": "fd60d85c-f534-4103-a056-e380f01bc8f0"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:34:46.263820 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-9d266465-3753-4c2c-b9e0-743c9d96fd12 req-3a809714-413b-4ef3-97c6-1d791e20068f service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:34:46.264883 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-9d266465-3753-4c2c-b9e0-743c9d96fd12 req-3a809714-413b-4ef3-97c6-1d791e20068f service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:34:46.265477 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-9d266465-3753-4c2c-b9e0-743c9d96fd12 req-3a809714-413b-4ef3-97c6-1d791e20068f service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:34:46.279866 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-9d266465-3753-4c2c-b9e0-743c9d96fd12 req-3a809714-413b-4ef3-97c6-1d791e20068f service nova] Creating event network-vif-unplugged:fd60d85c-f534-4103-a056-e380f01bc8f0 for instance b124ddce-db8e-4eb7-9363-62a47f8431d0 on nch2-master-1 Oct 22 21:34:46.286523 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [req-9d266465-3753-4c2c-b9e0-743c9d96fd12 req-3a809714-413b-4ef3-97c6-1d791e20068f service nova] Instance b124ddce-db8e-4eb7-9363-62a47f8431d0 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=138744) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 22 21:34:46.299285 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-9d266465-3753-4c2c-b9e0-743c9d96fd12 req-3a809714-413b-4ef3-97c6-1d791e20068f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.052757 Oct 22 21:34:46.300014 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2942/5909] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:34:46 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 21:34:46.434207 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-82aaa2a8-5802-4b37-b152-3ef9e38204d8 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:34:46.435502 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-82aaa2a8-5802-4b37-b152-3ef9e38204d8 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] [instance: b124ddce-db8e-4eb7-9363-62a47f8431d0] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:34:46.442948 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-82aaa2a8-5802-4b37-b152-3ef9e38204d8 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:34:46.443495 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-82aaa2a8-5802-4b37-b152-3ef9e38204d8 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:34:46.443971 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-82aaa2a8-5802-4b37-b152-3ef9e38204d8 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:34:46.444798 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-82aaa2a8-5802-4b37-b152-3ef9e38204d8 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:34:46.445274 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-82aaa2a8-5802-4b37-b152-3ef9e38204d8 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:34:46.445724 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-82aaa2a8-5802-4b37-b152-3ef9e38204d8 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:34:46.897143 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-82aaa2a8-5802-4b37-b152-3ef9e38204d8 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce13ae25b8cc4c32a66a2bcc536a3fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f9c508b2164653997b36431bb589b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:34:46.906203 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-82aaa2a8-5802-4b37-b152-3ef9e38204d8 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] 10.222.0.18 "GET /compute/v2.1/servers/b124ddce-db8e-4eb7-9363-62a47f8431d0" status: 200 len: 1694 microversion: 2.1 time: 0.476077 Oct 22 21:34:46.906821 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2968/5910] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:34:46 2022] GET /compute/v2.1/servers/b124ddce-db8e-4eb7-9363-62a47f8431d0 => generated 1694 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:34:47.933980 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-b8ff2c63-6088-4f62-806d-1b04a89259ce tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:34:47.934741 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-b8ff2c63-6088-4f62-806d-1b04a89259ce tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] [instance: b124ddce-db8e-4eb7-9363-62a47f8431d0] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:34:47.942318 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b8ff2c63-6088-4f62-806d-1b04a89259ce tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:34:47.942806 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b8ff2c63-6088-4f62-806d-1b04a89259ce tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:34:47.943274 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b8ff2c63-6088-4f62-806d-1b04a89259ce tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:34:47.943987 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b8ff2c63-6088-4f62-806d-1b04a89259ce tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:34:47.944440 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b8ff2c63-6088-4f62-806d-1b04a89259ce tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:34:47.944873 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b8ff2c63-6088-4f62-806d-1b04a89259ce tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:34:48.084381 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-b8ff2c63-6088-4f62-806d-1b04a89259ce tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce13ae25b8cc4c32a66a2bcc536a3fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f9c508b2164653997b36431bb589b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:34:48.093032 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-b8ff2c63-6088-4f62-806d-1b04a89259ce tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] 10.222.0.18 "GET /compute/v2.1/servers/b124ddce-db8e-4eb7-9363-62a47f8431d0" status: 200 len: 1692 microversion: 2.1 time: 0.165947 Oct 22 21:34:48.093616 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2943/5911] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:34:47 2022] GET /compute/v2.1/servers/b124ddce-db8e-4eb7-9363-62a47f8431d0 => generated 1692 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:34:48.337112 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-e632c8a9-6667-4f63-a552-f0eb5da37e31 req-4b15f7b4-a96b-4a32-9e29-2e9ea0bf482d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b124ddce-db8e-4eb7-9363-62a47f8431d0", "tag": "fd60d85c-f534-4103-a056-e380f01bc8f0"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:34:48.356876 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-e632c8a9-6667-4f63-a552-f0eb5da37e31 req-4b15f7b4-a96b-4a32-9e29-2e9ea0bf482d service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:34:48.357563 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-e632c8a9-6667-4f63-a552-f0eb5da37e31 req-4b15f7b4-a96b-4a32-9e29-2e9ea0bf482d service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:34:48.360466 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-e632c8a9-6667-4f63-a552-f0eb5da37e31 req-4b15f7b4-a96b-4a32-9e29-2e9ea0bf482d service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:34:48.373388 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-e632c8a9-6667-4f63-a552-f0eb5da37e31 req-4b15f7b4-a96b-4a32-9e29-2e9ea0bf482d service nova] Creating event network-changed:fd60d85c-f534-4103-a056-e380f01bc8f0 for instance b124ddce-db8e-4eb7-9363-62a47f8431d0 on nch2-master-1 Oct 22 21:34:48.379278 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [req-e632c8a9-6667-4f63-a552-f0eb5da37e31 req-4b15f7b4-a96b-4a32-9e29-2e9ea0bf482d service nova] Instance b124ddce-db8e-4eb7-9363-62a47f8431d0 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=138745) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 22 21:34:48.390811 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-e632c8a9-6667-4f63-a552-f0eb5da37e31 req-4b15f7b4-a96b-4a32-9e29-2e9ea0bf482d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060184 Oct 22 21:34:48.391491 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2969/5912] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:34:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:34:49.121783 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-964cecc4-a5dc-4acb-9c08-50632b520716 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:34:49.122710 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-964cecc4-a5dc-4acb-9c08-50632b520716 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] [instance: b124ddce-db8e-4eb7-9363-62a47f8431d0] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:34:49.135889 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-964cecc4-a5dc-4acb-9c08-50632b520716 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:34:49.136749 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-964cecc4-a5dc-4acb-9c08-50632b520716 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:34:49.137522 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-964cecc4-a5dc-4acb-9c08-50632b520716 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:34:49.138789 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-964cecc4-a5dc-4acb-9c08-50632b520716 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:34:49.140528 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-964cecc4-a5dc-4acb-9c08-50632b520716 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:34:49.141024 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-964cecc4-a5dc-4acb-9c08-50632b520716 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:34:49.349357 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-964cecc4-a5dc-4acb-9c08-50632b520716 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce13ae25b8cc4c32a66a2bcc536a3fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f9c508b2164653997b36431bb589b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:34:49.357797 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-964cecc4-a5dc-4acb-9c08-50632b520716 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] 10.222.0.18 "GET /compute/v2.1/servers/b124ddce-db8e-4eb7-9363-62a47f8431d0" status: 200 len: 1692 microversion: 2.1 time: 0.242862 Oct 22 21:34:49.358665 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2944/5913] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:34:49 2022] GET /compute/v2.1/servers/b124ddce-db8e-4eb7-9363-62a47f8431d0 => generated 1692 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:34:50.384487 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-0e522035-eae0-4eea-b8f0-c9592eda583d tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:34:50.385207 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-0e522035-eae0-4eea-b8f0-c9592eda583d tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] [instance: b124ddce-db8e-4eb7-9363-62a47f8431d0] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:34:50.391662 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0e522035-eae0-4eea-b8f0-c9592eda583d tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:34:50.392247 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0e522035-eae0-4eea-b8f0-c9592eda583d tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:34:50.392589 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0e522035-eae0-4eea-b8f0-c9592eda583d tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:34:50.393303 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0e522035-eae0-4eea-b8f0-c9592eda583d tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:34:50.393845 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0e522035-eae0-4eea-b8f0-c9592eda583d tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:34:50.394193 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0e522035-eae0-4eea-b8f0-c9592eda583d tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:34:50.535725 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-0e522035-eae0-4eea-b8f0-c9592eda583d tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce13ae25b8cc4c32a66a2bcc536a3fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f9c508b2164653997b36431bb589b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:34:50.544097 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-0e522035-eae0-4eea-b8f0-c9592eda583d tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] 10.222.0.18 "GET /compute/v2.1/servers/b124ddce-db8e-4eb7-9363-62a47f8431d0" status: 200 len: 1689 microversion: 2.1 time: 0.164813 Oct 22 21:34:50.544682 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2970/5914] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:34:50 2022] GET /compute/v2.1/servers/b124ddce-db8e-4eb7-9363-62a47f8431d0 => generated 1689 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:34:50.567098 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-1bb4beed-450b-4347-99db-89f577763901 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:34:50.567657 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-1bb4beed-450b-4347-99db-89f577763901 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] [instance: b124ddce-db8e-4eb7-9363-62a47f8431d0] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:34:50.574562 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1bb4beed-450b-4347-99db-89f577763901 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:34:50.575046 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1bb4beed-450b-4347-99db-89f577763901 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:34:50.575517 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1bb4beed-450b-4347-99db-89f577763901 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:34:50.576251 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1bb4beed-450b-4347-99db-89f577763901 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:34:50.576712 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1bb4beed-450b-4347-99db-89f577763901 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:34:50.577144 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1bb4beed-450b-4347-99db-89f577763901 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:34:50.641041 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-1bb4beed-450b-4347-99db-89f577763901 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] 10.222.0.18 "POST /compute/v2.1/servers/b124ddce-db8e-4eb7-9363-62a47f8431d0/action" status: 204 len: 0 microversion: 2.1 time: 0.077626 Oct 22 21:34:50.641572 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2945/5915] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 21:34:50 2022] POST /compute/v2.1/servers/b124ddce-db8e-4eb7-9363-62a47f8431d0/action => generated 0 bytes in 79 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 21:34:50.655221 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-fe4b4b0a-2700-44b1-95da-29304de42a99 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:34:50.655889 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-fe4b4b0a-2700-44b1-95da-29304de42a99 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] [instance: b124ddce-db8e-4eb7-9363-62a47f8431d0] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:34:50.663776 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fe4b4b0a-2700-44b1-95da-29304de42a99 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:34:50.664351 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fe4b4b0a-2700-44b1-95da-29304de42a99 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:34:50.665147 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fe4b4b0a-2700-44b1-95da-29304de42a99 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:34:50.666024 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fe4b4b0a-2700-44b1-95da-29304de42a99 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:34:50.666572 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fe4b4b0a-2700-44b1-95da-29304de42a99 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:34:50.666978 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fe4b4b0a-2700-44b1-95da-29304de42a99 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:34:50.673766 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:34:50.919331 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-fe4b4b0a-2700-44b1-95da-29304de42a99 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce13ae25b8cc4c32a66a2bcc536a3fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f9c508b2164653997b36431bb589b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:34:50.927782 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-fe4b4b0a-2700-44b1-95da-29304de42a99 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] 10.222.0.18 "GET /compute/v2.1/servers/b124ddce-db8e-4eb7-9363-62a47f8431d0" status: 200 len: 1689 microversion: 2.1 time: 0.277588 Oct 22 21:34:50.928346 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2971/5916] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:34:50 2022] GET /compute/v2.1/servers/b124ddce-db8e-4eb7-9363-62a47f8431d0 => generated 1689 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:34:51.953071 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-15cef9e7-f40a-477f-83e3-e23265fd5d65 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:34:51.953966 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-15cef9e7-f40a-477f-83e3-e23265fd5d65 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] [instance: b124ddce-db8e-4eb7-9363-62a47f8431d0] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:34:51.955927 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_api:SELECT=33 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:34:51.961640 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-15cef9e7-f40a-477f-83e3-e23265fd5d65 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:34:51.962239 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-15cef9e7-f40a-477f-83e3-e23265fd5d65 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:34:51.962687 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-15cef9e7-f40a-477f-83e3-e23265fd5d65 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:34:51.963443 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-15cef9e7-f40a-477f-83e3-e23265fd5d65 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:34:51.963903 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-15cef9e7-f40a-477f-83e3-e23265fd5d65 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:34:51.964344 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-15cef9e7-f40a-477f-83e3-e23265fd5d65 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:34:51.967085 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:34:52.104397 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-15cef9e7-f40a-477f-83e3-e23265fd5d65 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce13ae25b8cc4c32a66a2bcc536a3fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f9c508b2164653997b36431bb589b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:34:52.112760 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-15cef9e7-f40a-477f-83e3-e23265fd5d65 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] 10.222.0.18 "GET /compute/v2.1/servers/b124ddce-db8e-4eb7-9363-62a47f8431d0" status: 200 len: 1681 microversion: 2.1 time: 0.164821 Oct 22 21:34:52.113345 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2946/5917] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:34:51 2022] GET /compute/v2.1/servers/b124ddce-db8e-4eb7-9363-62a47f8431d0 => generated 1681 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:34:52.335105 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-7f1e8e32-05b4-48f1-bedb-6e14ab0b9817 req-5d1b03bc-ca8f-4ede-ba29-54bc7d0d60dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b124ddce-db8e-4eb7-9363-62a47f8431d0", "name": "network-vif-plugged", "status": "completed", "tag": "fd60d85c-f534-4103-a056-e380f01bc8f0"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:34:52.341182 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_api:SELECT=35 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:34:52.348828 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-7f1e8e32-05b4-48f1-bedb-6e14ab0b9817 req-5d1b03bc-ca8f-4ede-ba29-54bc7d0d60dc service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:34:52.349329 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-7f1e8e32-05b4-48f1-bedb-6e14ab0b9817 req-5d1b03bc-ca8f-4ede-ba29-54bc7d0d60dc service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:34:52.349789 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-7f1e8e32-05b4-48f1-bedb-6e14ab0b9817 req-5d1b03bc-ca8f-4ede-ba29-54bc7d0d60dc service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:34:52.361738 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-7f1e8e32-05b4-48f1-bedb-6e14ab0b9817 req-5d1b03bc-ca8f-4ede-ba29-54bc7d0d60dc service nova] Creating event network-vif-plugged:fd60d85c-f534-4103-a056-e380f01bc8f0 for instance b124ddce-db8e-4eb7-9363-62a47f8431d0 on nch2-master-1 Oct 22 21:34:52.366879 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-7f1e8e32-05b4-48f1-bedb-6e14ab0b9817 req-5d1b03bc-ca8f-4ede-ba29-54bc7d0d60dc service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035628 Oct 22 21:34:52.367725 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2972/5918] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:34:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:35:16.356878 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-53df6f88-ea06-4256-8e42-bb72dcefaa0c tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:35:16.359135 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-53df6f88-ea06-4256-8e42-bb72dcefaa0c tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] [instance: b124ddce-db8e-4eb7-9363-62a47f8431d0] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:35:16.362771 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_api:SELECT=1 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:35:16.363452 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:SELECT=5 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:35:16.369637 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-53df6f88-ea06-4256-8e42-bb72dcefaa0c tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:35:16.370157 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-53df6f88-ea06-4256-8e42-bb72dcefaa0c tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:35:16.370612 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-53df6f88-ea06-4256-8e42-bb72dcefaa0c tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:35:16.371753 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-53df6f88-ea06-4256-8e42-bb72dcefaa0c tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:35:16.371883 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-53df6f88-ea06-4256-8e42-bb72dcefaa0c tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:35:16.372342 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-53df6f88-ea06-4256-8e42-bb72dcefaa0c tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:35:16.433554 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-53df6f88-ea06-4256-8e42-bb72dcefaa0c tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] 10.222.0.18 "POST /compute/v2.1/servers/b124ddce-db8e-4eb7-9363-62a47f8431d0/action" status: 200 len: 24578 microversion: 2.1 time: 0.082340 Oct 22 21:35:16.434235 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2947/5919] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 21:35:16 2022] POST /compute/v2.1/servers/b124ddce-db8e-4eb7-9363-62a47f8431d0/action => generated 24578 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 22 21:35:22.644952 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_api:SELECT=1 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:35:22.646055 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell1:SELECT=6 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:35:22.652834 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-bc2cb6b7-c221-4ac4-a140-286572702c78 tempest-TestNetworkAdvancedServerOps-1033830903 tempest-TestNetworkAdvancedServerOps-1033830903-project-admin] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:35:22.654073 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-bc2cb6b7-c221-4ac4-a140-286572702c78 tempest-TestNetworkAdvancedServerOps-1033830903 tempest-TestNetworkAdvancedServerOps-1033830903-project-admin] [instance: b124ddce-db8e-4eb7-9363-62a47f8431d0] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:35:22.662519 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bc2cb6b7-c221-4ac4-a140-286572702c78 tempest-TestNetworkAdvancedServerOps-1033830903 tempest-TestNetworkAdvancedServerOps-1033830903-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:35:22.663049 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bc2cb6b7-c221-4ac4-a140-286572702c78 tempest-TestNetworkAdvancedServerOps-1033830903 tempest-TestNetworkAdvancedServerOps-1033830903-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:35:22.663531 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bc2cb6b7-c221-4ac4-a140-286572702c78 tempest-TestNetworkAdvancedServerOps-1033830903 tempest-TestNetworkAdvancedServerOps-1033830903-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:35:22.664237 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bc2cb6b7-c221-4ac4-a140-286572702c78 tempest-TestNetworkAdvancedServerOps-1033830903 tempest-TestNetworkAdvancedServerOps-1033830903-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:35:22.664706 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bc2cb6b7-c221-4ac4-a140-286572702c78 tempest-TestNetworkAdvancedServerOps-1033830903 tempest-TestNetworkAdvancedServerOps-1033830903-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:35:22.665146 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bc2cb6b7-c221-4ac4-a140-286572702c78 tempest-TestNetworkAdvancedServerOps-1033830903 tempest-TestNetworkAdvancedServerOps-1033830903-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:35:22.800724 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-bc2cb6b7-c221-4ac4-a140-286572702c78 tempest-TestNetworkAdvancedServerOps-1033830903 tempest-TestNetworkAdvancedServerOps-1033830903-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/b124ddce-db8e-4eb7-9363-62a47f8431d0" status: 200 len: 1832 microversion: 2.1 time: 0.160042 Oct 22 21:35:22.801467 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2973/5920] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:35:22 2022] GET /compute/v2.1/servers/b124ddce-db8e-4eb7-9363-62a47f8431d0 => generated 1832 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:35:23.702154 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-73ddeb38-dda4-4093-8376-4cee762bec1a tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:35:23.702763 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-73ddeb38-dda4-4093-8376-4cee762bec1a tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] [instance: b124ddce-db8e-4eb7-9363-62a47f8431d0] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:35:23.711394 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-73ddeb38-dda4-4093-8376-4cee762bec1a tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:35:23.711889 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-73ddeb38-dda4-4093-8376-4cee762bec1a tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:35:23.712345 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-73ddeb38-dda4-4093-8376-4cee762bec1a tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:35:23.713071 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-73ddeb38-dda4-4093-8376-4cee762bec1a tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:35:23.713691 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-73ddeb38-dda4-4093-8376-4cee762bec1a tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:35:23.714165 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-73ddeb38-dda4-4093-8376-4cee762bec1a tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:35:23.743672 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-73ddeb38-dda4-4093-8376-4cee762bec1a tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] [instance: b124ddce-db8e-4eb7-9363-62a47f8431d0] Going to try to terminate instance {{(pid=138744) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 21:35:23.777793 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-68e91823-e929-4954-8b7d-add7d6644d8d req-747b6422-4ab3-474d-b78a-8f4f63d4aea3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b124ddce-db8e-4eb7-9363-62a47f8431d0", "tag": "fd60d85c-f534-4103-a056-e380f01bc8f0"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:35:23.788777 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-68e91823-e929-4954-8b7d-add7d6644d8d req-747b6422-4ab3-474d-b78a-8f4f63d4aea3 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:35:23.789270 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-68e91823-e929-4954-8b7d-add7d6644d8d req-747b6422-4ab3-474d-b78a-8f4f63d4aea3 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:35:23.789712 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-68e91823-e929-4954-8b7d-add7d6644d8d req-747b6422-4ab3-474d-b78a-8f4f63d4aea3 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:35:23.801884 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-68e91823-e929-4954-8b7d-add7d6644d8d req-747b6422-4ab3-474d-b78a-8f4f63d4aea3 service nova] Creating event network-changed:fd60d85c-f534-4103-a056-e380f01bc8f0 for instance b124ddce-db8e-4eb7-9363-62a47f8431d0 on nch2-master-1 Oct 22 21:35:23.807181 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-68e91823-e929-4954-8b7d-add7d6644d8d req-747b6422-4ab3-474d-b78a-8f4f63d4aea3 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106965 Oct 22 21:35:23.808042 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2974/5921] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:35:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:35:23.840185 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-73ddeb38-dda4-4093-8376-4cee762bec1a tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] 10.222.0.18 "DELETE /compute/v2.1/servers/b124ddce-db8e-4eb7-9363-62a47f8431d0" status: 204 len: 0 microversion: 2.1 time: 0.141866 Oct 22 21:35:23.840877 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2948/5922] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 21:35:23 2022] DELETE /compute/v2.1/servers/b124ddce-db8e-4eb7-9363-62a47f8431d0 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 21:35:23.851132 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-16d1c237-6789-42eb-96bf-35a1b3c853a6 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:35:23.851996 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-16d1c237-6789-42eb-96bf-35a1b3c853a6 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] [instance: b124ddce-db8e-4eb7-9363-62a47f8431d0] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:35:23.858649 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-16d1c237-6789-42eb-96bf-35a1b3c853a6 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:35:23.859241 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-16d1c237-6789-42eb-96bf-35a1b3c853a6 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:35:23.859827 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-16d1c237-6789-42eb-96bf-35a1b3c853a6 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:35:23.860736 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-16d1c237-6789-42eb-96bf-35a1b3c853a6 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:35:23.861237 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-16d1c237-6789-42eb-96bf-35a1b3c853a6 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:35:23.861753 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-16d1c237-6789-42eb-96bf-35a1b3c853a6 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:35:23.997727 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-16d1c237-6789-42eb-96bf-35a1b3c853a6 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce13ae25b8cc4c32a66a2bcc536a3fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f9c508b2164653997b36431bb589b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:35:24.006098 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-16d1c237-6789-42eb-96bf-35a1b3c853a6 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] 10.222.0.18 "GET /compute/v2.1/servers/b124ddce-db8e-4eb7-9363-62a47f8431d0" status: 200 len: 1687 microversion: 2.1 time: 0.159712 Oct 22 21:35:24.006714 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2975/5923] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:35:23 2022] GET /compute/v2.1/servers/b124ddce-db8e-4eb7-9363-62a47f8431d0 => generated 1687 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:35:25.033617 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-ef7c80d0-bceb-471f-92e6-ec12eae538da tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:35:25.034309 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-ef7c80d0-bceb-471f-92e6-ec12eae538da tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] [instance: b124ddce-db8e-4eb7-9363-62a47f8431d0] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:35:25.042551 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ef7c80d0-bceb-471f-92e6-ec12eae538da tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:35:25.043176 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ef7c80d0-bceb-471f-92e6-ec12eae538da tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:35:25.043743 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ef7c80d0-bceb-471f-92e6-ec12eae538da tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:35:25.044449 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ef7c80d0-bceb-471f-92e6-ec12eae538da tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:35:25.044916 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ef7c80d0-bceb-471f-92e6-ec12eae538da tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:35:25.045351 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ef7c80d0-bceb-471f-92e6-ec12eae538da tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:35:25.223559 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-ef7c80d0-bceb-471f-92e6-ec12eae538da tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce13ae25b8cc4c32a66a2bcc536a3fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f9c508b2164653997b36431bb589b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:35:25.235382 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-ef7c80d0-bceb-471f-92e6-ec12eae538da tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] 10.222.0.18 "GET /compute/v2.1/servers/b124ddce-db8e-4eb7-9363-62a47f8431d0" status: 200 len: 1687 microversion: 2.1 time: 0.207921 Oct 22 21:35:25.236224 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2949/5924] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:35:25 2022] GET /compute/v2.1/servers/b124ddce-db8e-4eb7-9363-62a47f8431d0 => generated 1687 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:35:26.260212 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-b020bca9-7051-4d78-9075-300ac02c7c14 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:35:26.260849 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-b020bca9-7051-4d78-9075-300ac02c7c14 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] [instance: b124ddce-db8e-4eb7-9363-62a47f8431d0] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:35:26.266594 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-07265a0a-d308-437b-a910-938b71cde1ce req-7b6553df-c4e8-4932-803b-690ade76747f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b124ddce-db8e-4eb7-9363-62a47f8431d0", "name": "network-vif-deleted", "tag": "fd60d85c-f534-4103-a056-e380f01bc8f0"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:35:26.268444 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b020bca9-7051-4d78-9075-300ac02c7c14 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:35:26.269787 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b020bca9-7051-4d78-9075-300ac02c7c14 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:35:26.270263 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b020bca9-7051-4d78-9075-300ac02c7c14 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:35:26.270997 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b020bca9-7051-4d78-9075-300ac02c7c14 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:35:26.271493 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b020bca9-7051-4d78-9075-300ac02c7c14 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:35:26.271982 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b020bca9-7051-4d78-9075-300ac02c7c14 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:35:26.278573 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-07265a0a-d308-437b-a910-938b71cde1ce req-7b6553df-c4e8-4932-803b-690ade76747f service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:35:26.279059 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-07265a0a-d308-437b-a910-938b71cde1ce req-7b6553df-c4e8-4932-803b-690ade76747f service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:35:26.279543 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-07265a0a-d308-437b-a910-938b71cde1ce req-7b6553df-c4e8-4932-803b-690ade76747f service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:35:26.292316 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-07265a0a-d308-437b-a910-938b71cde1ce req-7b6553df-c4e8-4932-803b-690ade76747f service nova] Creating event network-vif-deleted:fd60d85c-f534-4103-a056-e380f01bc8f0 for instance b124ddce-db8e-4eb7-9363-62a47f8431d0 on nch2-master-1 Oct 22 21:35:26.297435 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-07265a0a-d308-437b-a910-938b71cde1ce req-7b6553df-c4e8-4932-803b-690ade76747f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034652 Oct 22 21:35:26.299521 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2950/5925] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:35:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 21:35:26.342515 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-b020bca9-7051-4d78-9075-300ac02c7c14 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce13ae25b8cc4c32a66a2bcc536a3fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f9c508b2164653997b36431bb589b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:35:26.352151 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-b020bca9-7051-4d78-9075-300ac02c7c14 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] 10.222.0.18 "GET /compute/v2.1/servers/b124ddce-db8e-4eb7-9363-62a47f8431d0" status: 200 len: 1501 microversion: 2.1 time: 0.095914 Oct 22 21:35:26.352745 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2976/5926] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:35:26 2022] GET /compute/v2.1/servers/b124ddce-db8e-4eb7-9363-62a47f8431d0 => generated 1501 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:35:27.382552 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-73adeccd-d0b6-4f61-87dc-2031085464e8 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:35:27.383769 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-73adeccd-d0b6-4f61-87dc-2031085464e8 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] [instance: b124ddce-db8e-4eb7-9363-62a47f8431d0] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:35:27.394292 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-73adeccd-d0b6-4f61-87dc-2031085464e8 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:35:27.394787 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-73adeccd-d0b6-4f61-87dc-2031085464e8 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:35:27.395234 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-73adeccd-d0b6-4f61-87dc-2031085464e8 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:35:27.395963 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-73adeccd-d0b6-4f61-87dc-2031085464e8 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:35:27.396423 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-73adeccd-d0b6-4f61-87dc-2031085464e8 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:35:27.396854 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-73adeccd-d0b6-4f61-87dc-2031085464e8 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:35:27.411359 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-73adeccd-d0b6-4f61-87dc-2031085464e8 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] HTTP exception thrown: Instance b124ddce-db8e-4eb7-9363-62a47f8431d0 could not be found. Oct 22 21:35:27.413059 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-73adeccd-d0b6-4f61-87dc-2031085464e8 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Request method failure captured: Oct 22 21:35:27.413059 ncdv-master-1 devstack@n-api.service[138744]: request: GET /compute/v2.1/servers/b124ddce-db8e-4eb7-9363-62a47f8431d0 HTTP/1.1 Oct 22 21:35:27.413059 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 21:35:27.413059 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 21:35:27.413059 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 21:35:27.413059 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 0 Oct 22 21:35:27.413059 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 21:35:27.413059 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 21:35:27.413059 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 21:35:27.413059 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 21:35:27.413059 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVGGILX10s2dIgDgVZo2IQgnPiDYDu9a3ft4OAGis05yO8BrPDQHvhvjIr_WfblUYdacpoCBNulloRKj8k-zduRl3WptOsWJtL3dswrAo60x20bp_MtWiCHhhHG9kPBkPEvIy-4T7Hm5YfPQsiEPV_Ld77h47ySD3KCZYLji1QhcSMDE Oct 22 21:35:27.413059 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 21:35:27.413059 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 21:35:27.413059 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 21:35:27.413059 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 21:35:27.413059 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 21:35:27.413059 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 21:35:27.413059 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: 42f9c508b2164653997b36431bb589b8 Oct 22 21:35:27.413059 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1810030830 Oct 22 21:35:27.413059 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 21:35:27.413059 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 21:35:27.413059 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_42f9c508b2164653997b36431bb589b8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/42f9c508b2164653997b36431bb589b8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/42f9c508b2164653997b36431bb589b8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/42f9c508b2164653997b36431bb589b8"}]}] Oct 22 21:35:27.413059 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1810030830 Oct 22 21:35:27.413059 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: 42f9c508b2164653997b36431bb589b8 Oct 22 21:35:27.413059 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1810030830 Oct 22 21:35:27.413059 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-TestNetworkAdvancedServerOps-1810030830-project Oct 22 21:35:27.413059 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 21:35:27.413059 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 21:35:27.413059 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: ce13ae25b8cc4c32a66a2bcc536a3fd6 Oct 22 21:35:27.413059 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1810030830-project Oct 22 21:35:27.413059 ncdv-master-1 devstack@n-api.service[138744]: method: > Oct 22 21:35:27.413059 ncdv-master-1 devstack@n-api.service[138744]: exception: Instance b124ddce-db8e-4eb7-9363-62a47f8431d0 could not be found. Oct 22 21:35:27.413059 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': 'b124ddce-db8e-4eb7-9363-62a47f8431d0'} Oct 22 21:35:27.413059 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:35:27.413059 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:35:27.413059 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 21:35:27.413059 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 21:35:27.413059 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 21:35:27.413059 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 21:35:27.413059 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 21:35:27.413059 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 21:35:27.413059 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 21:35:27.413059 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 21:35:27.413059 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b124ddce-db8e-4eb7-9363-62a47f8431d0 could not be found. Oct 22 21:35:27.413059 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:35:27.413059 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:35:27.413059 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:35:27.413059 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:35:27.413059 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:35:27.413059 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:35:27.413059 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:35:27.413059 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:35:27.413059 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:35:27.413059 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:35:27.413059 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 21:35:27.413059 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 21:35:27.413059 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 21:35:27.413059 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 21:35:27.413059 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 21:35:27.413059 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:35:27.413059 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b124ddce-db8e-4eb7-9363-62a47f8431d0 could not be found. Oct 22 21:35:27.413059 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:35:27.413059 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:35:27.418727 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:35:27.418727 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:35:27.418727 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:35:27.418727 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:35:27.418727 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:35:27.418727 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:35:27.418727 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b124ddce-db8e-4eb7-9363-62a47f8431d0 could not be found. Oct 22 21:35:27.418727 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:35:27.418727 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-73adeccd-d0b6-4f61-87dc-2031085464e8 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Returning 404 to user: Instance b124ddce-db8e-4eb7-9363-62a47f8431d0 could not be found. {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:35:27.418727 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-73adeccd-d0b6-4f61-87dc-2031085464e8 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] 10.222.0.18 "GET /compute/v2.1/servers/b124ddce-db8e-4eb7-9363-62a47f8431d0" status: 404 len: 111 microversion: 2.1 time: 0.040878 Oct 22 21:35:27.418727 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2951/5927] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:35:27 2022] GET /compute/v2.1/servers/b124ddce-db8e-4eb7-9363-62a47f8431d0 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 21:35:30.448249 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-a87617fa-2b72-4e66-94b3-30ea10c746f2 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Calling method '.version_select at 0x7fd39fde08b0>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:35:30.480032 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-a87617fa-2b72-4e66-94b3-30ea10c746f2 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-890296864" status: 202 len: 0 microversion: 2.1 time: 0.035435 Oct 22 21:35:30.481166 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2977/5928] 10.222.0.18 () {58 vars in 1281 bytes} [Sat Oct 22 21:35:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-890296864 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 21:35:30.511525 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-a4fbe68c-64fc-414e-b49e-12b5b6a74c85 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Action: 'create', calling method: .version_select at 0x7fd39f077310>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-204411941", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGYx4GDpHU9joxF958I0sa96m31vhVOJpOugzdtYcWnm8fo7a4GqbeMaIJxg9m8f0z+CaJqKxmPS6nJBSmly+eLOGAz9+OpAJwEunH8LWrm9MmBkwxcDO+MwTtbmOefdKw=="}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:35:30.530935 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-a4fbe68c-64fc-414e-b49e-12b5b6a74c85 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Getting quotas for project 42f9c508b2164653997b36431bb589b8. Resources: {'key_pairs'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 21:35:30.537078 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-a4fbe68c-64fc-414e-b49e-12b5b6a74c85 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Getting quotas for user ce13ae25b8cc4c32a66a2bcc536a3fd6 and project 42f9c508b2164653997b36431bb589b8. Resources: {'key_pairs'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 21:35:30.568820 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-a4fbe68c-64fc-414e-b49e-12b5b6a74c85 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.061197 Oct 22 21:35:30.569620 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2952/5929] 10.222.0.18 () {60 vars in 1159 bytes} [Sat Oct 22 21:35:30 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 21:35:36.312169 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-3db22827-88ed-4c25-bd85-10be7e1172d2 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-501243264", "imageRef": "085e4478-6edc-4a69-8e08-f9831713eb65", "flavorRef": "452", "networks": [{"uuid": "e5b4890e-cfdc-4a0c-ad32-e3da2118ecc2"}], "key_name": "tempest-TestNetworkAdvancedServerOps-204411941", "security_groups": [{"name": "tempest-secgroup-smoke-127124931"}]}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:35:36.348122 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell1:SELECT=20 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:35:36.457439 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.network.neutron [None req-3db22827-88ed-4c25-bd85-10be7e1172d2 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] validate_networks() for [('e5b4890e-cfdc-4a0c-ad32-e3da2118ecc2', None, None, None, None, None)] {{(pid=138745) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 21:35:36.888660 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-3db22827-88ed-4c25-bd85-10be7e1172d2 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Flavor limits 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 21:35:36.889651 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-3db22827-88ed-4c25-bd85-10be7e1172d2 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Image limits 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 21:35:36.890374 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-3db22827-88ed-4c25-bd85-10be7e1172d2 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Flavor pref 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 21:35:36.891023 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-3db22827-88ed-4c25-bd85-10be7e1172d2 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Image pref 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 21:35:36.891808 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-3db22827-88ed-4c25-bd85-10be7e1172d2 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 21:35:36.903726 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3db22827-88ed-4c25-bd85-10be7e1172d2 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:35:36.904318 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3db22827-88ed-4c25-bd85-10be7e1172d2 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:35:36.904876 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3db22827-88ed-4c25-bd85-10be7e1172d2 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:35:36.905694 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3db22827-88ed-4c25-bd85-10be7e1172d2 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:35:36.906179 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3db22827-88ed-4c25-bd85-10be7e1172d2 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:35:36.906750 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3db22827-88ed-4c25-bd85-10be7e1172d2 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:35:36.925263 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-3db22827-88ed-4c25-bd85-10be7e1172d2 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Getting quotas for project 42f9c508b2164653997b36431bb589b8. Resources: {'cores', 'instances', 'ram'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 21:35:36.930950 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-3db22827-88ed-4c25-bd85-10be7e1172d2 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Getting quotas for user ce13ae25b8cc4c32a66a2bcc536a3fd6 and project 42f9c508b2164653997b36431bb589b8. Resources: {'cores', 'instances', 'ram'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 21:35:36.944185 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-3db22827-88ed-4c25-bd85-10be7e1172d2 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Going to run 1 instances... {{(pid=138745) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 21:35:36.946598 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-3db22827-88ed-4c25-bd85-10be7e1172d2 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] [instance: 89a66831-cf82-4816-a69d-49ea892727cf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='085e4478-6edc-4a69-8e08-f9831713eb65',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138745) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 21:35:36.996236 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-3db22827-88ed-4c25-bd85-10be7e1172d2 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.688436 Oct 22 21:35:36.997332 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2978/5930] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Oct 22 21:35:36 2022] POST /compute/v2.1/servers => generated 405 bytes in 690 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 21:35:37.010334 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-2b74c2ea-211c-4014-81c9-34b983a6ea87 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:35:37.010998 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-2b74c2ea-211c-4014-81c9-34b983a6ea87 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] [instance: 89a66831-cf82-4816-a69d-49ea892727cf] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:35:37.071735 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-2b74c2ea-211c-4014-81c9-34b983a6ea87 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce13ae25b8cc4c32a66a2bcc536a3fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f9c508b2164653997b36431bb589b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:35:37.079882 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-2b74c2ea-211c-4014-81c9-34b983a6ea87 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] 10.222.0.18 "GET /compute/v2.1/servers/89a66831-cf82-4816-a69d-49ea892727cf" status: 200 len: 1265 microversion: 2.1 time: 0.074428 Oct 22 21:35:37.080549 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2953/5931] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:35:37 2022] GET /compute/v2.1/servers/89a66831-cf82-4816-a69d-49ea892727cf => generated 1265 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:35:38.107734 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-aadabbbb-2216-4015-b7a2-0cc353f8bd5d tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:35:38.109167 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-aadabbbb-2216-4015-b7a2-0cc353f8bd5d tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] [instance: 89a66831-cf82-4816-a69d-49ea892727cf] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:35:38.118378 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-aadabbbb-2216-4015-b7a2-0cc353f8bd5d tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:35:38.119026 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-aadabbbb-2216-4015-b7a2-0cc353f8bd5d tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:35:38.119781 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-aadabbbb-2216-4015-b7a2-0cc353f8bd5d tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:35:38.120594 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-aadabbbb-2216-4015-b7a2-0cc353f8bd5d tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:35:38.121135 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-aadabbbb-2216-4015-b7a2-0cc353f8bd5d tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:35:38.121650 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-aadabbbb-2216-4015-b7a2-0cc353f8bd5d tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:35:38.226423 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-aadabbbb-2216-4015-b7a2-0cc353f8bd5d tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce13ae25b8cc4c32a66a2bcc536a3fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f9c508b2164653997b36431bb589b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:35:38.236481 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-aadabbbb-2216-4015-b7a2-0cc353f8bd5d tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] 10.222.0.18 "GET /compute/v2.1/servers/89a66831-cf82-4816-a69d-49ea892727cf" status: 200 len: 1335 microversion: 2.1 time: 0.136217 Oct 22 21:35:38.237497 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2979/5932] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:35:38 2022] GET /compute/v2.1/servers/89a66831-cf82-4816-a69d-49ea892727cf => generated 1335 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:35:39.261780 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-bc016117-66d3-4694-89ac-0db72947ce07 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:35:39.262408 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-bc016117-66d3-4694-89ac-0db72947ce07 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] [instance: 89a66831-cf82-4816-a69d-49ea892727cf] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:35:39.265914 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:35:39.275194 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bc016117-66d3-4694-89ac-0db72947ce07 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:35:39.275771 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bc016117-66d3-4694-89ac-0db72947ce07 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:35:39.276251 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bc016117-66d3-4694-89ac-0db72947ce07 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:35:39.277000 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bc016117-66d3-4694-89ac-0db72947ce07 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:35:39.277613 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bc016117-66d3-4694-89ac-0db72947ce07 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:35:39.278055 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bc016117-66d3-4694-89ac-0db72947ce07 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:35:39.688433 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-bc016117-66d3-4694-89ac-0db72947ce07 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce13ae25b8cc4c32a66a2bcc536a3fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f9c508b2164653997b36431bb589b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:35:39.696562 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-bc016117-66d3-4694-89ac-0db72947ce07 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] 10.222.0.18 "GET /compute/v2.1/servers/89a66831-cf82-4816-a69d-49ea892727cf" status: 200 len: 1390 microversion: 2.1 time: 0.438896 Oct 22 21:35:39.697377 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2954/5933] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:35:39 2022] GET /compute/v2.1/servers/89a66831-cf82-4816-a69d-49ea892727cf => generated 1390 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:35:40.010958 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-766fb880-68fb-486c-8bd6-a5ecf1dc35e5 req-2cdb6882-49c2-46c7-bdc7-55cc6d16665d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89a66831-cf82-4816-a69d-49ea892727cf", "tag": "b526b777-89ea-4d89-8b97-a4d98f42d570"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:35:40.024153 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-766fb880-68fb-486c-8bd6-a5ecf1dc35e5 req-2cdb6882-49c2-46c7-bdc7-55cc6d16665d service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:35:40.024737 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-766fb880-68fb-486c-8bd6-a5ecf1dc35e5 req-2cdb6882-49c2-46c7-bdc7-55cc6d16665d service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:35:40.025287 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-766fb880-68fb-486c-8bd6-a5ecf1dc35e5 req-2cdb6882-49c2-46c7-bdc7-55cc6d16665d service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:35:40.040046 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-766fb880-68fb-486c-8bd6-a5ecf1dc35e5 req-2cdb6882-49c2-46c7-bdc7-55cc6d16665d service nova] Creating event network-changed:b526b777-89ea-4d89-8b97-a4d98f42d570 for instance 89a66831-cf82-4816-a69d-49ea892727cf on nch1-master-1 Oct 22 21:35:40.046278 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-766fb880-68fb-486c-8bd6-a5ecf1dc35e5 req-2cdb6882-49c2-46c7-bdc7-55cc6d16665d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039086 Oct 22 21:35:40.047865 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2980/5934] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:35:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:35:40.720756 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-de937dd3-ea7b-43e1-95c8-829f928c8843 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:35:40.721699 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-de937dd3-ea7b-43e1-95c8-829f928c8843 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] [instance: 89a66831-cf82-4816-a69d-49ea892727cf] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:35:40.729315 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-de937dd3-ea7b-43e1-95c8-829f928c8843 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:35:40.729829 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-de937dd3-ea7b-43e1-95c8-829f928c8843 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:35:40.730272 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-de937dd3-ea7b-43e1-95c8-829f928c8843 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:35:40.730975 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-de937dd3-ea7b-43e1-95c8-829f928c8843 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:35:40.731476 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-de937dd3-ea7b-43e1-95c8-829f928c8843 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:35:40.731911 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-de937dd3-ea7b-43e1-95c8-829f928c8843 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:35:40.871334 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-de937dd3-ea7b-43e1-95c8-829f928c8843 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce13ae25b8cc4c32a66a2bcc536a3fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f9c508b2164653997b36431bb589b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:35:40.879719 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-de937dd3-ea7b-43e1-95c8-829f928c8843 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] 10.222.0.18 "GET /compute/v2.1/servers/89a66831-cf82-4816-a69d-49ea892727cf" status: 200 len: 1390 microversion: 2.1 time: 0.162812 Oct 22 21:35:40.880303 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2955/5935] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:35:40 2022] GET /compute/v2.1/servers/89a66831-cf82-4816-a69d-49ea892727cf => generated 1390 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:35:41.907407 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-bf0218b9-c87f-4748-8228-609195175692 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:35:41.908986 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-bf0218b9-c87f-4748-8228-609195175692 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] [instance: 89a66831-cf82-4816-a69d-49ea892727cf] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:35:41.921769 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bf0218b9-c87f-4748-8228-609195175692 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:35:41.922608 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bf0218b9-c87f-4748-8228-609195175692 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:35:41.923418 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bf0218b9-c87f-4748-8228-609195175692 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:35:41.924695 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bf0218b9-c87f-4748-8228-609195175692 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:35:41.925399 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bf0218b9-c87f-4748-8228-609195175692 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:35:41.925846 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bf0218b9-c87f-4748-8228-609195175692 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:35:42.064469 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-bf0218b9-c87f-4748-8228-609195175692 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce13ae25b8cc4c32a66a2bcc536a3fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f9c508b2164653997b36431bb589b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:35:42.076989 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-bf0218b9-c87f-4748-8228-609195175692 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] 10.222.0.18 "GET /compute/v2.1/servers/89a66831-cf82-4816-a69d-49ea892727cf" status: 200 len: 1390 microversion: 2.1 time: 0.176769 Oct 22 21:35:42.092651 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2981/5936] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:35:41 2022] GET /compute/v2.1/servers/89a66831-cf82-4816-a69d-49ea892727cf => generated 1390 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:35:43.105358 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-bf3de426-9f3f-4947-bc50-6a6a3b3570f7 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:35:43.106362 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-bf3de426-9f3f-4947-bc50-6a6a3b3570f7 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] [instance: 89a66831-cf82-4816-a69d-49ea892727cf] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:35:43.116309 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bf3de426-9f3f-4947-bc50-6a6a3b3570f7 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:35:43.116802 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bf3de426-9f3f-4947-bc50-6a6a3b3570f7 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:35:43.117247 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bf3de426-9f3f-4947-bc50-6a6a3b3570f7 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:35:43.117947 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bf3de426-9f3f-4947-bc50-6a6a3b3570f7 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:35:43.118403 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bf3de426-9f3f-4947-bc50-6a6a3b3570f7 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:35:43.118832 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bf3de426-9f3f-4947-bc50-6a6a3b3570f7 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:35:43.258212 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-bf3de426-9f3f-4947-bc50-6a6a3b3570f7 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce13ae25b8cc4c32a66a2bcc536a3fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f9c508b2164653997b36431bb589b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:35:43.266243 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-bf3de426-9f3f-4947-bc50-6a6a3b3570f7 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] 10.222.0.18 "GET /compute/v2.1/servers/89a66831-cf82-4816-a69d-49ea892727cf" status: 200 len: 1390 microversion: 2.1 time: 0.167572 Oct 22 21:35:43.266791 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2956/5937] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:35:43 2022] GET /compute/v2.1/servers/89a66831-cf82-4816-a69d-49ea892727cf => generated 1390 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:35:44.185632 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-2c2dd3cb-9e87-4842-aa2c-60f23da42282 req-b76d321e-ccfe-445f-850f-38078c6f16a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89a66831-cf82-4816-a69d-49ea892727cf", "name": "network-vif-plugged", "status": "completed", "tag": "b526b777-89ea-4d89-8b97-a4d98f42d570"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:35:44.196551 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-2c2dd3cb-9e87-4842-aa2c-60f23da42282 req-b76d321e-ccfe-445f-850f-38078c6f16a2 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:35:44.197090 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-2c2dd3cb-9e87-4842-aa2c-60f23da42282 req-b76d321e-ccfe-445f-850f-38078c6f16a2 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:35:44.197480 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-2c2dd3cb-9e87-4842-aa2c-60f23da42282 req-b76d321e-ccfe-445f-850f-38078c6f16a2 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:35:44.209521 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-2c2dd3cb-9e87-4842-aa2c-60f23da42282 req-b76d321e-ccfe-445f-850f-38078c6f16a2 service nova] Creating event network-vif-plugged:b526b777-89ea-4d89-8b97-a4d98f42d570 for instance 89a66831-cf82-4816-a69d-49ea892727cf on nch1-master-1 Oct 22 21:35:44.214547 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-2c2dd3cb-9e87-4842-aa2c-60f23da42282 req-b76d321e-ccfe-445f-850f-38078c6f16a2 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032794 Oct 22 21:35:44.215323 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2982/5938] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:35:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:35:44.289748 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-f6fd4b8f-bb13-4d9e-9a58-81641c9ea5e0 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:35:44.290371 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-f6fd4b8f-bb13-4d9e-9a58-81641c9ea5e0 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] [instance: 89a66831-cf82-4816-a69d-49ea892727cf] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:35:44.297653 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f6fd4b8f-bb13-4d9e-9a58-81641c9ea5e0 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:35:44.298153 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f6fd4b8f-bb13-4d9e-9a58-81641c9ea5e0 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:35:44.298600 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f6fd4b8f-bb13-4d9e-9a58-81641c9ea5e0 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:35:44.299318 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f6fd4b8f-bb13-4d9e-9a58-81641c9ea5e0 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:35:44.299933 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f6fd4b8f-bb13-4d9e-9a58-81641c9ea5e0 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:35:44.300502 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f6fd4b8f-bb13-4d9e-9a58-81641c9ea5e0 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:35:44.463877 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-f6fd4b8f-bb13-4d9e-9a58-81641c9ea5e0 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce13ae25b8cc4c32a66a2bcc536a3fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f9c508b2164653997b36431bb589b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:35:44.473850 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-f6fd4b8f-bb13-4d9e-9a58-81641c9ea5e0 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] 10.222.0.18 "GET /compute/v2.1/servers/89a66831-cf82-4816-a69d-49ea892727cf" status: 200 len: 1390 microversion: 2.1 time: 0.188201 Oct 22 21:35:44.474432 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2957/5939] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:35:44 2022] GET /compute/v2.1/servers/89a66831-cf82-4816-a69d-49ea892727cf => generated 1390 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:35:45.502723 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-5404a4ed-3147-4e6c-b8af-1f4b9afb45e3 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:35:45.503366 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-5404a4ed-3147-4e6c-b8af-1f4b9afb45e3 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] [instance: 89a66831-cf82-4816-a69d-49ea892727cf] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:35:45.512568 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5404a4ed-3147-4e6c-b8af-1f4b9afb45e3 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:35:45.513291 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5404a4ed-3147-4e6c-b8af-1f4b9afb45e3 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:35:45.513941 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5404a4ed-3147-4e6c-b8af-1f4b9afb45e3 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:35:45.515044 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5404a4ed-3147-4e6c-b8af-1f4b9afb45e3 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:35:45.515754 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5404a4ed-3147-4e6c-b8af-1f4b9afb45e3 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:35:45.516391 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5404a4ed-3147-4e6c-b8af-1f4b9afb45e3 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:35:45.658979 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-5404a4ed-3147-4e6c-b8af-1f4b9afb45e3 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce13ae25b8cc4c32a66a2bcc536a3fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f9c508b2164653997b36431bb589b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:35:45.667255 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-5404a4ed-3147-4e6c-b8af-1f4b9afb45e3 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] 10.222.0.18 "GET /compute/v2.1/servers/89a66831-cf82-4816-a69d-49ea892727cf" status: 200 len: 1390 microversion: 2.1 time: 0.172890 Oct 22 21:35:45.667912 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2983/5940] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:35:45 2022] GET /compute/v2.1/servers/89a66831-cf82-4816-a69d-49ea892727cf => generated 1390 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:35:46.692420 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-c3b241a2-826d-4924-aea6-b18ee3de2853 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:35:46.693023 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-c3b241a2-826d-4924-aea6-b18ee3de2853 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] [instance: 89a66831-cf82-4816-a69d-49ea892727cf] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:35:46.695818 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:35:46.701387 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c3b241a2-826d-4924-aea6-b18ee3de2853 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:35:46.701872 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c3b241a2-826d-4924-aea6-b18ee3de2853 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:35:46.702466 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c3b241a2-826d-4924-aea6-b18ee3de2853 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:35:46.703175 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c3b241a2-826d-4924-aea6-b18ee3de2853 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:35:46.703663 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c3b241a2-826d-4924-aea6-b18ee3de2853 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:35:46.704105 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c3b241a2-826d-4924-aea6-b18ee3de2853 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:35:46.846793 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-c3b241a2-826d-4924-aea6-b18ee3de2853 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce13ae25b8cc4c32a66a2bcc536a3fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f9c508b2164653997b36431bb589b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:35:46.859625 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-c3b241a2-826d-4924-aea6-b18ee3de2853 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] 10.222.0.18 "GET /compute/v2.1/servers/89a66831-cf82-4816-a69d-49ea892727cf" status: 200 len: 1563 microversion: 2.1 time: 0.170948 Oct 22 21:35:46.860447 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2958/5941] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:35:46 2022] GET /compute/v2.1/servers/89a66831-cf82-4816-a69d-49ea892727cf => generated 1563 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:35:46.885619 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-47ed84e0-5c52-46e4-987d-d588bfa22b29 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:35:46.886293 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-47ed84e0-5c52-46e4-987d-d588bfa22b29 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] [instance: 89a66831-cf82-4816-a69d-49ea892727cf] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:35:46.894307 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-47ed84e0-5c52-46e4-987d-d588bfa22b29 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:35:46.894870 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-47ed84e0-5c52-46e4-987d-d588bfa22b29 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:35:46.895319 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-47ed84e0-5c52-46e4-987d-d588bfa22b29 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:35:46.896180 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-47ed84e0-5c52-46e4-987d-d588bfa22b29 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:35:46.896660 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-47ed84e0-5c52-46e4-987d-d588bfa22b29 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:35:46.897137 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-47ed84e0-5c52-46e4-987d-d588bfa22b29 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:35:46.917683 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell0:SELECT=2 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:35:46.937740 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell0:SELECT=6 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:35:47.048022 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-47ed84e0-5c52-46e4-987d-d588bfa22b29 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce13ae25b8cc4c32a66a2bcc536a3fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f9c508b2164653997b36431bb589b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:35:47.056458 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-47ed84e0-5c52-46e4-987d-d588bfa22b29 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] 10.222.0.18 "GET /compute/v2.1/servers/89a66831-cf82-4816-a69d-49ea892727cf" status: 200 len: 1563 microversion: 2.1 time: 0.177105 Oct 22 21:35:47.057067 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2984/5942] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:35:46 2022] GET /compute/v2.1/servers/89a66831-cf82-4816-a69d-49ea892727cf => generated 1563 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:35:48.716389 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-67f668d4-d6d7-4958-a841-ea2277c17328 req-1490fb29-7d02-471f-bb05-c934d8346e31 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89a66831-cf82-4816-a69d-49ea892727cf", "tag": "b526b777-89ea-4d89-8b97-a4d98f42d570"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:35:48.719756 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-842f86ce-053d-4adf-9faf-ad14c06d2d13 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:35:48.720464 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-842f86ce-053d-4adf-9faf-ad14c06d2d13 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] [instance: 89a66831-cf82-4816-a69d-49ea892727cf] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:35:48.723913 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell0:SELECT=6 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:35:48.728641 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-67f668d4-d6d7-4958-a841-ea2277c17328 req-1490fb29-7d02-471f-bb05-c934d8346e31 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:35:48.729154 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-67f668d4-d6d7-4958-a841-ea2277c17328 req-1490fb29-7d02-471f-bb05-c934d8346e31 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:35:48.729435 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-842f86ce-053d-4adf-9faf-ad14c06d2d13 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:35:48.729757 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-67f668d4-d6d7-4958-a841-ea2277c17328 req-1490fb29-7d02-471f-bb05-c934d8346e31 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:35:48.730079 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-842f86ce-053d-4adf-9faf-ad14c06d2d13 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:35:48.730522 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-842f86ce-053d-4adf-9faf-ad14c06d2d13 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:35:48.731230 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-842f86ce-053d-4adf-9faf-ad14c06d2d13 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:35:48.731716 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-842f86ce-053d-4adf-9faf-ad14c06d2d13 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:35:48.732142 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-842f86ce-053d-4adf-9faf-ad14c06d2d13 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:35:48.745315 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-67f668d4-d6d7-4958-a841-ea2277c17328 req-1490fb29-7d02-471f-bb05-c934d8346e31 service nova] Creating event network-changed:b526b777-89ea-4d89-8b97-a4d98f42d570 for instance 89a66831-cf82-4816-a69d-49ea892727cf on nch1-master-1 Oct 22 21:35:48.750626 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-67f668d4-d6d7-4958-a841-ea2277c17328 req-1490fb29-7d02-471f-bb05-c934d8346e31 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037670 Oct 22 21:35:48.755213 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2985/5943] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:35:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:35:48.953349 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-842f86ce-053d-4adf-9faf-ad14c06d2d13 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce13ae25b8cc4c32a66a2bcc536a3fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f9c508b2164653997b36431bb589b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:35:48.961953 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-842f86ce-053d-4adf-9faf-ad14c06d2d13 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] 10.222.0.18 "GET /compute/v2.1/servers/89a66831-cf82-4816-a69d-49ea892727cf" status: 200 len: 1563 microversion: 2.1 time: 0.254467 Oct 22 21:35:48.962535 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2959/5944] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:35:48 2022] GET /compute/v2.1/servers/89a66831-cf82-4816-a69d-49ea892727cf => generated 1563 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:36:22.361204 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_api:SELECT=40,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:36:22.362346 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell1:SELECT=32 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:36:22.366911 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-d7445f87-1455-45c7-aa28-3194bca4d044 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:36:22.369254 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-d7445f87-1455-45c7-aa28-3194bca4d044 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] [instance: 89a66831-cf82-4816-a69d-49ea892727cf] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:36:22.376724 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d7445f87-1455-45c7-aa28-3194bca4d044 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:36:22.377250 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d7445f87-1455-45c7-aa28-3194bca4d044 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:36:22.377784 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d7445f87-1455-45c7-aa28-3194bca4d044 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:36:22.378498 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d7445f87-1455-45c7-aa28-3194bca4d044 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:36:22.378970 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d7445f87-1455-45c7-aa28-3194bca4d044 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:36:22.379444 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d7445f87-1455-45c7-aa28-3194bca4d044 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:36:22.431729 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-d7445f87-1455-45c7-aa28-3194bca4d044 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] 10.222.0.18 "POST /compute/v2.1/servers/89a66831-cf82-4816-a69d-49ea892727cf/action" status: 200 len: 24568 microversion: 2.1 time: 0.073791 Oct 22 21:36:22.432426 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2986/5945] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 21:36:22 2022] POST /compute/v2.1/servers/89a66831-cf82-4816-a69d-49ea892727cf/action => generated 24568 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 22 21:36:52.854312 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_api:SELECT=3 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:36:52.855147 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:SELECT=36 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:36:52.856460 ncdv-master-1 devstack@n-api.service[138744]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 22 21:36:52.856598 ncdv-master-1 devstack@n-api.service[138744]: Sat Oct 22 21:36:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/89a66831-cf82-4816-a69d-49ea892727cf (ip 10.222.0.18) !!! Oct 22 21:36:52.861186 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-09a9bdcc-b5eb-4efa-96dc-1edf81885940 tempest-TestNetworkAdvancedServerOps-1033830903 tempest-TestNetworkAdvancedServerOps-1033830903-project-admin] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:36:52.861798 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-09a9bdcc-b5eb-4efa-96dc-1edf81885940 tempest-TestNetworkAdvancedServerOps-1033830903 tempest-TestNetworkAdvancedServerOps-1033830903-project-admin] [instance: 89a66831-cf82-4816-a69d-49ea892727cf] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:36:52.870542 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-09a9bdcc-b5eb-4efa-96dc-1edf81885940 tempest-TestNetworkAdvancedServerOps-1033830903 tempest-TestNetworkAdvancedServerOps-1033830903-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:36:52.871048 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-09a9bdcc-b5eb-4efa-96dc-1edf81885940 tempest-TestNetworkAdvancedServerOps-1033830903 tempest-TestNetworkAdvancedServerOps-1033830903-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:36:52.871588 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-09a9bdcc-b5eb-4efa-96dc-1edf81885940 tempest-TestNetworkAdvancedServerOps-1033830903 tempest-TestNetworkAdvancedServerOps-1033830903-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:36:52.872306 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-09a9bdcc-b5eb-4efa-96dc-1edf81885940 tempest-TestNetworkAdvancedServerOps-1033830903 tempest-TestNetworkAdvancedServerOps-1033830903-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:36:52.872789 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-09a9bdcc-b5eb-4efa-96dc-1edf81885940 tempest-TestNetworkAdvancedServerOps-1033830903 tempest-TestNetworkAdvancedServerOps-1033830903-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:36:52.873232 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-09a9bdcc-b5eb-4efa-96dc-1edf81885940 tempest-TestNetworkAdvancedServerOps-1033830903 tempest-TestNetworkAdvancedServerOps-1033830903-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:36:53.020330 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-09a9bdcc-b5eb-4efa-96dc-1edf81885940 tempest-TestNetworkAdvancedServerOps-1033830903 tempest-TestNetworkAdvancedServerOps-1033830903-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/89a66831-cf82-4816-a69d-49ea892727cf" status: 200 len: 1833 microversion: 2.1 time: 0.167427 Oct 22 21:36:53.021114 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2960/5946] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:36:52 2022] GET /compute/v2.1/servers/89a66831-cf82-4816-a69d-49ea892727cf => generated 1833 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:36:53.044893 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-92331c85-4ad3-4561-9691-1ec05e7e36a4 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:36:53.045620 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-92331c85-4ad3-4561-9691-1ec05e7e36a4 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] [instance: 89a66831-cf82-4816-a69d-49ea892727cf] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:36:53.049074 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_api:SELECT=2 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:36:53.049753 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell1:SELECT=4 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:36:53.056705 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-92331c85-4ad3-4561-9691-1ec05e7e36a4 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:36:53.057211 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-92331c85-4ad3-4561-9691-1ec05e7e36a4 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:36:53.057658 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-92331c85-4ad3-4561-9691-1ec05e7e36a4 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:36:53.058414 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-92331c85-4ad3-4561-9691-1ec05e7e36a4 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:36:53.058887 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-92331c85-4ad3-4561-9691-1ec05e7e36a4 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:36:53.059368 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-92331c85-4ad3-4561-9691-1ec05e7e36a4 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:36:53.202714 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-92331c85-4ad3-4561-9691-1ec05e7e36a4 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce13ae25b8cc4c32a66a2bcc536a3fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f9c508b2164653997b36431bb589b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:36:53.211053 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-92331c85-4ad3-4561-9691-1ec05e7e36a4 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] 10.222.0.18 "GET /compute/v2.1/servers/89a66831-cf82-4816-a69d-49ea892727cf" status: 200 len: 1682 microversion: 2.1 time: 0.170526 Oct 22 21:36:53.211743 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2987/5947] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:36:53 2022] GET /compute/v2.1/servers/89a66831-cf82-4816-a69d-49ea892727cf => generated 1682 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:36:53.321938 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-9a3ce2e0-6f23-477d-be98-892c39717a45 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:36:53.324306 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-9a3ce2e0-6f23-477d-be98-892c39717a45 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] [instance: 89a66831-cf82-4816-a69d-49ea892727cf] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:36:53.331054 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9a3ce2e0-6f23-477d-be98-892c39717a45 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:36:53.331594 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9a3ce2e0-6f23-477d-be98-892c39717a45 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:36:53.332053 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9a3ce2e0-6f23-477d-be98-892c39717a45 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:36:53.332775 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9a3ce2e0-6f23-477d-be98-892c39717a45 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:36:53.333245 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9a3ce2e0-6f23-477d-be98-892c39717a45 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:36:53.333722 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9a3ce2e0-6f23-477d-be98-892c39717a45 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:36:53.399870 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-9a3ce2e0-6f23-477d-be98-892c39717a45 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] 10.222.0.18 "POST /compute/v2.1/servers/89a66831-cf82-4816-a69d-49ea892727cf/action" status: 200 len: 32639 microversion: 2.1 time: 0.081661 Oct 22 21:36:53.400505 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2961/5948] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 21:36:53 2022] POST /compute/v2.1/servers/89a66831-cf82-4816-a69d-49ea892727cf/action => generated 32639 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 22 21:36:53.606995 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-a9d4a710-5ca3-4690-a9ce-2d874b4a9e03 tempest-TestNetworkAdvancedServerOps-1033830903 tempest-TestNetworkAdvancedServerOps-1033830903-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:36:53.607808 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-a9d4a710-5ca3-4690-a9ce-2d874b4a9e03 tempest-TestNetworkAdvancedServerOps-1033830903 tempest-TestNetworkAdvancedServerOps-1033830903-project-admin] [instance: 89a66831-cf82-4816-a69d-49ea892727cf] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:36:53.618368 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a9d4a710-5ca3-4690-a9ce-2d874b4a9e03 tempest-TestNetworkAdvancedServerOps-1033830903 tempest-TestNetworkAdvancedServerOps-1033830903-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:36:53.618867 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a9d4a710-5ca3-4690-a9ce-2d874b4a9e03 tempest-TestNetworkAdvancedServerOps-1033830903 tempest-TestNetworkAdvancedServerOps-1033830903-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:36:53.619323 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a9d4a710-5ca3-4690-a9ce-2d874b4a9e03 tempest-TestNetworkAdvancedServerOps-1033830903 tempest-TestNetworkAdvancedServerOps-1033830903-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:36:53.620081 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a9d4a710-5ca3-4690-a9ce-2d874b4a9e03 tempest-TestNetworkAdvancedServerOps-1033830903 tempest-TestNetworkAdvancedServerOps-1033830903-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:36:53.620561 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a9d4a710-5ca3-4690-a9ce-2d874b4a9e03 tempest-TestNetworkAdvancedServerOps-1033830903 tempest-TestNetworkAdvancedServerOps-1033830903-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:36:53.621006 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a9d4a710-5ca3-4690-a9ce-2d874b4a9e03 tempest-TestNetworkAdvancedServerOps-1033830903 tempest-TestNetworkAdvancedServerOps-1033830903-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:36:53.649407 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-a9d4a710-5ca3-4690-a9ce-2d874b4a9e03 tempest-TestNetworkAdvancedServerOps-1033830903 tempest-TestNetworkAdvancedServerOps-1033830903-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '8062c6bcb7e94f89912f950f038f2d06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df62f4c34cc4f75833795a8b03df66c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:36:53.650212 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-a9d4a710-5ca3-4690-a9ce-2d874b4a9e03 tempest-TestNetworkAdvancedServerOps-1033830903 tempest-TestNetworkAdvancedServerOps-1033830903-project-admin] [instance: 89a66831-cf82-4816-a69d-49ea892727cf] flavor_id is None. Assuming migration. {{(pid=138745) resize /opt/stack/nova/nova/compute/api.py:4196}} Oct 22 21:36:53.650459 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-a9d4a710-5ca3-4690-a9ce-2d874b4a9e03 tempest-TestNetworkAdvancedServerOps-1033830903 tempest-TestNetworkAdvancedServerOps-1033830903-project-admin] [instance: 89a66831-cf82-4816-a69d-49ea892727cf] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=138745) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 22 21:36:53.767951 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-a9d4a710-5ca3-4690-a9ce-2d874b4a9e03 tempest-TestNetworkAdvancedServerOps-1033830903 tempest-TestNetworkAdvancedServerOps-1033830903-project-admin] 10.222.0.18 "POST /compute/v2.1/servers/89a66831-cf82-4816-a69d-49ea892727cf/action" status: 202 len: 0 microversion: 2.1 time: 0.166899 Oct 22 21:36:53.768570 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2988/5949] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 21:36:53 2022] POST /compute/v2.1/servers/89a66831-cf82-4816-a69d-49ea892727cf/action => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 21:36:53.777861 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-b9dceaf9-2439-47d3-8f5d-47dc67800508 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:36:53.778576 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-b9dceaf9-2439-47d3-8f5d-47dc67800508 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] [instance: 89a66831-cf82-4816-a69d-49ea892727cf] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:36:53.786163 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b9dceaf9-2439-47d3-8f5d-47dc67800508 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:36:53.786698 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b9dceaf9-2439-47d3-8f5d-47dc67800508 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:36:53.787168 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b9dceaf9-2439-47d3-8f5d-47dc67800508 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:36:53.787914 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b9dceaf9-2439-47d3-8f5d-47dc67800508 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:36:53.788377 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b9dceaf9-2439-47d3-8f5d-47dc67800508 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:36:53.788808 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b9dceaf9-2439-47d3-8f5d-47dc67800508 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:36:53.927898 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-b9dceaf9-2439-47d3-8f5d-47dc67800508 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce13ae25b8cc4c32a66a2bcc536a3fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f9c508b2164653997b36431bb589b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:36:53.936022 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-b9dceaf9-2439-47d3-8f5d-47dc67800508 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] 10.222.0.18 "GET /compute/v2.1/servers/89a66831-cf82-4816-a69d-49ea892727cf" status: 200 len: 1691 microversion: 2.1 time: 0.162676 Oct 22 21:36:53.936612 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2962/5950] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:36:53 2022] GET /compute/v2.1/servers/89a66831-cf82-4816-a69d-49ea892727cf => generated 1691 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:36:54.960231 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-473012ce-e70b-473b-a17b-d1313b7a90c9 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:36:54.960795 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-473012ce-e70b-473b-a17b-d1313b7a90c9 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] [instance: 89a66831-cf82-4816-a69d-49ea892727cf] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:36:54.969542 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-473012ce-e70b-473b-a17b-d1313b7a90c9 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:36:54.970048 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-473012ce-e70b-473b-a17b-d1313b7a90c9 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:36:54.970502 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-473012ce-e70b-473b-a17b-d1313b7a90c9 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:36:54.971581 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-473012ce-e70b-473b-a17b-d1313b7a90c9 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:36:54.972048 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-473012ce-e70b-473b-a17b-d1313b7a90c9 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:36:54.972488 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-473012ce-e70b-473b-a17b-d1313b7a90c9 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:36:55.110333 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-473012ce-e70b-473b-a17b-d1313b7a90c9 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce13ae25b8cc4c32a66a2bcc536a3fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f9c508b2164653997b36431bb589b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:36:55.118651 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-473012ce-e70b-473b-a17b-d1313b7a90c9 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] 10.222.0.18 "GET /compute/v2.1/servers/89a66831-cf82-4816-a69d-49ea892727cf" status: 200 len: 1691 microversion: 2.1 time: 0.162888 Oct 22 21:36:55.119232 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2989/5951] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:36:54 2022] GET /compute/v2.1/servers/89a66831-cf82-4816-a69d-49ea892727cf => generated 1691 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:36:56.146609 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-d181f843-ac63-4b69-8317-c7ad41ef5e5a tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:36:56.147721 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-d181f843-ac63-4b69-8317-c7ad41ef5e5a tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] [instance: 89a66831-cf82-4816-a69d-49ea892727cf] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:36:56.160850 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d181f843-ac63-4b69-8317-c7ad41ef5e5a tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:36:56.161702 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d181f843-ac63-4b69-8317-c7ad41ef5e5a tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:36:56.162404 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d181f843-ac63-4b69-8317-c7ad41ef5e5a tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:36:56.163613 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d181f843-ac63-4b69-8317-c7ad41ef5e5a tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:36:56.164376 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d181f843-ac63-4b69-8317-c7ad41ef5e5a tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:36:56.165097 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d181f843-ac63-4b69-8317-c7ad41ef5e5a tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:36:56.311735 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-d181f843-ac63-4b69-8317-c7ad41ef5e5a tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce13ae25b8cc4c32a66a2bcc536a3fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f9c508b2164653997b36431bb589b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:36:56.319965 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-d181f843-ac63-4b69-8317-c7ad41ef5e5a tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] 10.222.0.18 "GET /compute/v2.1/servers/89a66831-cf82-4816-a69d-49ea892727cf" status: 200 len: 1696 microversion: 2.1 time: 0.179987 Oct 22 21:36:56.320537 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2963/5952] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:36:56 2022] GET /compute/v2.1/servers/89a66831-cf82-4816-a69d-49ea892727cf => generated 1696 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:36:57.347601 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-1babb3a6-0abc-449e-b384-1b04ca0841b2 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:36:57.348622 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-1babb3a6-0abc-449e-b384-1b04ca0841b2 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] [instance: 89a66831-cf82-4816-a69d-49ea892727cf] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:36:57.360466 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1babb3a6-0abc-449e-b384-1b04ca0841b2 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:36:57.361229 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1babb3a6-0abc-449e-b384-1b04ca0841b2 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:36:57.361899 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1babb3a6-0abc-449e-b384-1b04ca0841b2 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:36:57.363029 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1babb3a6-0abc-449e-b384-1b04ca0841b2 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:36:57.363815 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1babb3a6-0abc-449e-b384-1b04ca0841b2 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:36:57.364409 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1babb3a6-0abc-449e-b384-1b04ca0841b2 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:36:57.517671 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-1babb3a6-0abc-449e-b384-1b04ca0841b2 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce13ae25b8cc4c32a66a2bcc536a3fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f9c508b2164653997b36431bb589b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:36:57.525747 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-1babb3a6-0abc-449e-b384-1b04ca0841b2 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] 10.222.0.18 "GET /compute/v2.1/servers/89a66831-cf82-4816-a69d-49ea892727cf" status: 200 len: 1696 microversion: 2.1 time: 0.185595 Oct 22 21:36:57.526344 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2990/5953] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:36:57 2022] GET /compute/v2.1/servers/89a66831-cf82-4816-a69d-49ea892727cf => generated 1696 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:36:58.554004 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-c8d63ffc-f8fb-41a1-b80e-6e563958daed tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:36:58.554842 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-c8d63ffc-f8fb-41a1-b80e-6e563958daed tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] [instance: 89a66831-cf82-4816-a69d-49ea892727cf] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:36:58.566524 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c8d63ffc-f8fb-41a1-b80e-6e563958daed tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:36:58.567333 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c8d63ffc-f8fb-41a1-b80e-6e563958daed tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:36:58.568128 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c8d63ffc-f8fb-41a1-b80e-6e563958daed tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:36:58.569366 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c8d63ffc-f8fb-41a1-b80e-6e563958daed tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:36:58.570141 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c8d63ffc-f8fb-41a1-b80e-6e563958daed tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:36:58.570870 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c8d63ffc-f8fb-41a1-b80e-6e563958daed tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:36:58.708802 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-c8d63ffc-f8fb-41a1-b80e-6e563958daed tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce13ae25b8cc4c32a66a2bcc536a3fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f9c508b2164653997b36431bb589b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:36:58.717244 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-c8d63ffc-f8fb-41a1-b80e-6e563958daed tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] 10.222.0.18 "GET /compute/v2.1/servers/89a66831-cf82-4816-a69d-49ea892727cf" status: 200 len: 1696 microversion: 2.1 time: 0.170075 Oct 22 21:36:58.717791 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2964/5954] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:36:58 2022] GET /compute/v2.1/servers/89a66831-cf82-4816-a69d-49ea892727cf => generated 1696 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:36:59.744186 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-3de8bec0-364c-49aa-a6f2-9ea416603c7d tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:36:59.745030 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-3de8bec0-364c-49aa-a6f2-9ea416603c7d tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] [instance: 89a66831-cf82-4816-a69d-49ea892727cf] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:36:59.753117 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3de8bec0-364c-49aa-a6f2-9ea416603c7d tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:36:59.753616 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3de8bec0-364c-49aa-a6f2-9ea416603c7d tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:36:59.754069 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3de8bec0-364c-49aa-a6f2-9ea416603c7d tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:36:59.754786 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3de8bec0-364c-49aa-a6f2-9ea416603c7d tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:36:59.755252 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3de8bec0-364c-49aa-a6f2-9ea416603c7d tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:36:59.755733 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3de8bec0-364c-49aa-a6f2-9ea416603c7d tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:36:59.897739 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-3de8bec0-364c-49aa-a6f2-9ea416603c7d tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce13ae25b8cc4c32a66a2bcc536a3fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f9c508b2164653997b36431bb589b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:36:59.906234 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-3de8bec0-364c-49aa-a6f2-9ea416603c7d tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] 10.222.0.18 "GET /compute/v2.1/servers/89a66831-cf82-4816-a69d-49ea892727cf" status: 200 len: 1696 microversion: 2.1 time: 0.167745 Oct 22 21:36:59.906745 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2991/5955] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:36:59 2022] GET /compute/v2.1/servers/89a66831-cf82-4816-a69d-49ea892727cf => generated 1696 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:37:00.934492 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-80322b35-b883-4817-877f-a76329267277 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:37:00.935200 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-80322b35-b883-4817-877f-a76329267277 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] [instance: 89a66831-cf82-4816-a69d-49ea892727cf] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:37:00.942705 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-80322b35-b883-4817-877f-a76329267277 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:37:00.943202 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-80322b35-b883-4817-877f-a76329267277 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:37:00.943692 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-80322b35-b883-4817-877f-a76329267277 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:37:00.944400 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-80322b35-b883-4817-877f-a76329267277 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:37:00.944863 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-80322b35-b883-4817-877f-a76329267277 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:37:00.945301 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-80322b35-b883-4817-877f-a76329267277 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:37:01.081027 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-80322b35-b883-4817-877f-a76329267277 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce13ae25b8cc4c32a66a2bcc536a3fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f9c508b2164653997b36431bb589b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:37:01.090177 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-80322b35-b883-4817-877f-a76329267277 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] 10.222.0.18 "GET /compute/v2.1/servers/89a66831-cf82-4816-a69d-49ea892727cf" status: 200 len: 1696 microversion: 2.1 time: 0.162447 Oct 22 21:37:01.090811 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2965/5956] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:37:00 2022] GET /compute/v2.1/servers/89a66831-cf82-4816-a69d-49ea892727cf => generated 1696 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:37:02.116935 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-5bb14011-072c-4576-a72a-2d49056ef5b6 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:37:02.117559 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-5bb14011-072c-4576-a72a-2d49056ef5b6 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] [instance: 89a66831-cf82-4816-a69d-49ea892727cf] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:37:02.128175 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5bb14011-072c-4576-a72a-2d49056ef5b6 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:37:02.128851 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5bb14011-072c-4576-a72a-2d49056ef5b6 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:37:02.129388 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5bb14011-072c-4576-a72a-2d49056ef5b6 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:37:02.130427 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5bb14011-072c-4576-a72a-2d49056ef5b6 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:37:02.131022 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5bb14011-072c-4576-a72a-2d49056ef5b6 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:37:02.131700 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5bb14011-072c-4576-a72a-2d49056ef5b6 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:37:02.277792 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-5bb14011-072c-4576-a72a-2d49056ef5b6 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce13ae25b8cc4c32a66a2bcc536a3fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f9c508b2164653997b36431bb589b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:37:02.290838 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-5bb14011-072c-4576-a72a-2d49056ef5b6 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] 10.222.0.18 "GET /compute/v2.1/servers/89a66831-cf82-4816-a69d-49ea892727cf" status: 200 len: 1696 microversion: 2.1 time: 0.179995 Oct 22 21:37:02.291798 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2992/5957] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:37:02 2022] GET /compute/v2.1/servers/89a66831-cf82-4816-a69d-49ea892727cf => generated 1696 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:37:03.320678 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-7849be21-6ef9-4a6d-93ca-156253aef07e tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:37:03.321563 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-7849be21-6ef9-4a6d-93ca-156253aef07e tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] [instance: 89a66831-cf82-4816-a69d-49ea892727cf] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:37:03.333883 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7849be21-6ef9-4a6d-93ca-156253aef07e tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:37:03.334694 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7849be21-6ef9-4a6d-93ca-156253aef07e tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:37:03.335489 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7849be21-6ef9-4a6d-93ca-156253aef07e tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:37:03.336642 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7849be21-6ef9-4a6d-93ca-156253aef07e tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:37:03.337388 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7849be21-6ef9-4a6d-93ca-156253aef07e tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:37:03.338116 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7849be21-6ef9-4a6d-93ca-156253aef07e tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:37:03.476705 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-7849be21-6ef9-4a6d-93ca-156253aef07e tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce13ae25b8cc4c32a66a2bcc536a3fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f9c508b2164653997b36431bb589b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:37:03.485110 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-7849be21-6ef9-4a6d-93ca-156253aef07e tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] 10.222.0.18 "GET /compute/v2.1/servers/89a66831-cf82-4816-a69d-49ea892727cf" status: 200 len: 1696 microversion: 2.1 time: 0.171434 Oct 22 21:37:03.485656 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2966/5958] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:37:03 2022] GET /compute/v2.1/servers/89a66831-cf82-4816-a69d-49ea892727cf => generated 1696 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:37:04.513213 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-ef024620-9aef-469d-b2f5-2eb7ab96d76d tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:37:04.514187 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-ef024620-9aef-469d-b2f5-2eb7ab96d76d tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] [instance: 89a66831-cf82-4816-a69d-49ea892727cf] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:37:04.522288 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ef024620-9aef-469d-b2f5-2eb7ab96d76d tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:37:04.522795 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ef024620-9aef-469d-b2f5-2eb7ab96d76d tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:37:04.523251 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ef024620-9aef-469d-b2f5-2eb7ab96d76d tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:37:04.524007 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ef024620-9aef-469d-b2f5-2eb7ab96d76d tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:37:04.524485 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ef024620-9aef-469d-b2f5-2eb7ab96d76d tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:37:04.524934 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ef024620-9aef-469d-b2f5-2eb7ab96d76d tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:37:04.670981 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-ef024620-9aef-469d-b2f5-2eb7ab96d76d tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce13ae25b8cc4c32a66a2bcc536a3fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f9c508b2164653997b36431bb589b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:37:04.679129 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-ef024620-9aef-469d-b2f5-2eb7ab96d76d tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] 10.222.0.18 "GET /compute/v2.1/servers/89a66831-cf82-4816-a69d-49ea892727cf" status: 200 len: 1696 microversion: 2.1 time: 0.172830 Oct 22 21:37:04.679719 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2993/5959] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:37:04 2022] GET /compute/v2.1/servers/89a66831-cf82-4816-a69d-49ea892727cf => generated 1696 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:37:05.705743 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-85794b50-77e0-4a7a-9205-58c3ded884a7 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:37:05.706366 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-85794b50-77e0-4a7a-9205-58c3ded884a7 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] [instance: 89a66831-cf82-4816-a69d-49ea892727cf] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:37:05.714199 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-85794b50-77e0-4a7a-9205-58c3ded884a7 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:37:05.714515 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-85794b50-77e0-4a7a-9205-58c3ded884a7 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:37:05.714963 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-85794b50-77e0-4a7a-9205-58c3ded884a7 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:37:05.715703 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-85794b50-77e0-4a7a-9205-58c3ded884a7 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:37:05.716165 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-85794b50-77e0-4a7a-9205-58c3ded884a7 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:37:05.716598 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-85794b50-77e0-4a7a-9205-58c3ded884a7 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:37:05.868135 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-85794b50-77e0-4a7a-9205-58c3ded884a7 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce13ae25b8cc4c32a66a2bcc536a3fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f9c508b2164653997b36431bb589b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:37:05.880868 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-85794b50-77e0-4a7a-9205-58c3ded884a7 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] 10.222.0.18 "GET /compute/v2.1/servers/89a66831-cf82-4816-a69d-49ea892727cf" status: 200 len: 1696 microversion: 2.1 time: 0.180144 Oct 22 21:37:05.881632 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2967/5960] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:37:05 2022] GET /compute/v2.1/servers/89a66831-cf82-4816-a69d-49ea892727cf => generated 1696 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:37:06.910059 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-0cb2095d-73bd-48c6-b081-483aee2e8333 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:37:06.910648 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-0cb2095d-73bd-48c6-b081-483aee2e8333 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] [instance: 89a66831-cf82-4816-a69d-49ea892727cf] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:37:06.918051 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0cb2095d-73bd-48c6-b081-483aee2e8333 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:37:06.918559 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0cb2095d-73bd-48c6-b081-483aee2e8333 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:37:06.919064 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0cb2095d-73bd-48c6-b081-483aee2e8333 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:37:06.919890 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0cb2095d-73bd-48c6-b081-483aee2e8333 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:37:06.920363 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0cb2095d-73bd-48c6-b081-483aee2e8333 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:37:06.920805 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0cb2095d-73bd-48c6-b081-483aee2e8333 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:37:07.056588 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-0cb2095d-73bd-48c6-b081-483aee2e8333 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce13ae25b8cc4c32a66a2bcc536a3fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f9c508b2164653997b36431bb589b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:37:07.065081 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-0cb2095d-73bd-48c6-b081-483aee2e8333 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] 10.222.0.18 "GET /compute/v2.1/servers/89a66831-cf82-4816-a69d-49ea892727cf" status: 200 len: 1696 microversion: 2.1 time: 0.160391 Oct 22 21:37:07.065674 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2994/5961] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:37:06 2022] GET /compute/v2.1/servers/89a66831-cf82-4816-a69d-49ea892727cf => generated 1696 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:37:08.089423 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-f92fa8d9-ab50-4fe4-abb1-d5bfff5928c4 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:37:08.090078 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-f92fa8d9-ab50-4fe4-abb1-d5bfff5928c4 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] [instance: 89a66831-cf82-4816-a69d-49ea892727cf] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:37:08.097504 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f92fa8d9-ab50-4fe4-abb1-d5bfff5928c4 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:37:08.097975 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f92fa8d9-ab50-4fe4-abb1-d5bfff5928c4 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:37:08.098419 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f92fa8d9-ab50-4fe4-abb1-d5bfff5928c4 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:37:08.099124 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f92fa8d9-ab50-4fe4-abb1-d5bfff5928c4 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:37:08.099622 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f92fa8d9-ab50-4fe4-abb1-d5bfff5928c4 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:37:08.100055 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f92fa8d9-ab50-4fe4-abb1-d5bfff5928c4 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:37:08.342745 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-f92fa8d9-ab50-4fe4-abb1-d5bfff5928c4 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce13ae25b8cc4c32a66a2bcc536a3fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f9c508b2164653997b36431bb589b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:37:08.351828 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-f92fa8d9-ab50-4fe4-abb1-d5bfff5928c4 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] 10.222.0.18 "GET /compute/v2.1/servers/89a66831-cf82-4816-a69d-49ea892727cf" status: 200 len: 1695 microversion: 2.1 time: 0.266530 Oct 22 21:37:08.352395 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2968/5962] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:37:08 2022] GET /compute/v2.1/servers/89a66831-cf82-4816-a69d-49ea892727cf => generated 1695 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:37:08.572394 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-6d289290-91c8-400e-8794-16d641551f51 req-955116f9-6630-46f3-9f70-ccc33a2cf1ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89a66831-cf82-4816-a69d-49ea892727cf", "name": "network-vif-unplugged", "status": "completed", "tag": "b526b777-89ea-4d89-8b97-a4d98f42d570"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:37:08.583078 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-6d289290-91c8-400e-8794-16d641551f51 req-955116f9-6630-46f3-9f70-ccc33a2cf1ec service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:37:08.583471 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-6d289290-91c8-400e-8794-16d641551f51 req-955116f9-6630-46f3-9f70-ccc33a2cf1ec service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:37:08.583921 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-6d289290-91c8-400e-8794-16d641551f51 req-955116f9-6630-46f3-9f70-ccc33a2cf1ec service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:37:08.596861 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-6d289290-91c8-400e-8794-16d641551f51 req-955116f9-6630-46f3-9f70-ccc33a2cf1ec service nova] Creating event network-vif-unplugged:b526b777-89ea-4d89-8b97-a4d98f42d570 for instance 89a66831-cf82-4816-a69d-49ea892727cf on nch2-master-1 Oct 22 21:37:08.602595 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [req-6d289290-91c8-400e-8794-16d641551f51 req-955116f9-6630-46f3-9f70-ccc33a2cf1ec service nova] Instance 89a66831-cf82-4816-a69d-49ea892727cf is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=138745) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 22 21:37:08.614161 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-6d289290-91c8-400e-8794-16d641551f51 req-955116f9-6630-46f3-9f70-ccc33a2cf1ec service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.111563 Oct 22 21:37:08.614793 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2995/5963] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:37:08 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:37:09.376765 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-b4f42633-64b2-4aef-a168-3d92ab7940f9 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:37:09.377524 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-b4f42633-64b2-4aef-a168-3d92ab7940f9 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] [instance: 89a66831-cf82-4816-a69d-49ea892727cf] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:37:09.384875 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b4f42633-64b2-4aef-a168-3d92ab7940f9 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:37:09.385382 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b4f42633-64b2-4aef-a168-3d92ab7940f9 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:37:09.385835 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b4f42633-64b2-4aef-a168-3d92ab7940f9 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:37:09.386557 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b4f42633-64b2-4aef-a168-3d92ab7940f9 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:37:09.387022 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b4f42633-64b2-4aef-a168-3d92ab7940f9 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:37:09.387514 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b4f42633-64b2-4aef-a168-3d92ab7940f9 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:37:09.602814 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-b4f42633-64b2-4aef-a168-3d92ab7940f9 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce13ae25b8cc4c32a66a2bcc536a3fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f9c508b2164653997b36431bb589b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:37:09.611246 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-b4f42633-64b2-4aef-a168-3d92ab7940f9 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] 10.222.0.18 "GET /compute/v2.1/servers/89a66831-cf82-4816-a69d-49ea892727cf" status: 200 len: 1695 microversion: 2.1 time: 0.238686 Oct 22 21:37:09.611864 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2969/5964] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:37:09 2022] GET /compute/v2.1/servers/89a66831-cf82-4816-a69d-49ea892727cf => generated 1695 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:37:10.637024 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-0eb5699f-11c5-4529-9573-57a93698943e tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:37:10.638697 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-0eb5699f-11c5-4529-9573-57a93698943e tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] [instance: 89a66831-cf82-4816-a69d-49ea892727cf] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:37:10.641410 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-fa94800d-e1a8-453b-9fcc-a4b1faffde9f req-2c8a47dc-14a3-42a7-ba54-9a38f304d5a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89a66831-cf82-4816-a69d-49ea892727cf", "tag": "b526b777-89ea-4d89-8b97-a4d98f42d570"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:37:10.648596 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0eb5699f-11c5-4529-9573-57a93698943e tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:37:10.649220 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0eb5699f-11c5-4529-9573-57a93698943e tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:37:10.649822 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0eb5699f-11c5-4529-9573-57a93698943e tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:37:10.650725 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0eb5699f-11c5-4529-9573-57a93698943e tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:37:10.651315 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0eb5699f-11c5-4529-9573-57a93698943e tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:37:10.651915 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0eb5699f-11c5-4529-9573-57a93698943e tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:37:10.654408 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-fa94800d-e1a8-453b-9fcc-a4b1faffde9f req-2c8a47dc-14a3-42a7-ba54-9a38f304d5a1 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:37:10.655035 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-fa94800d-e1a8-453b-9fcc-a4b1faffde9f req-2c8a47dc-14a3-42a7-ba54-9a38f304d5a1 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:37:10.655630 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-fa94800d-e1a8-453b-9fcc-a4b1faffde9f req-2c8a47dc-14a3-42a7-ba54-9a38f304d5a1 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:37:10.668950 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-fa94800d-e1a8-453b-9fcc-a4b1faffde9f req-2c8a47dc-14a3-42a7-ba54-9a38f304d5a1 service nova] Creating event network-changed:b526b777-89ea-4d89-8b97-a4d98f42d570 for instance 89a66831-cf82-4816-a69d-49ea892727cf on nch2-master-1 Oct 22 21:37:10.674601 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [req-fa94800d-e1a8-453b-9fcc-a4b1faffde9f req-2c8a47dc-14a3-42a7-ba54-9a38f304d5a1 service nova] Instance 89a66831-cf82-4816-a69d-49ea892727cf is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=138744) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 22 21:37:10.685585 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-fa94800d-e1a8-453b-9fcc-a4b1faffde9f req-2c8a47dc-14a3-42a7-ba54-9a38f304d5a1 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051632 Oct 22 21:37:10.686192 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2970/5965] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:37:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:37:10.872202 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-0eb5699f-11c5-4529-9573-57a93698943e tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce13ae25b8cc4c32a66a2bcc536a3fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f9c508b2164653997b36431bb589b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:37:10.880301 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-0eb5699f-11c5-4529-9573-57a93698943e tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] 10.222.0.18 "GET /compute/v2.1/servers/89a66831-cf82-4816-a69d-49ea892727cf" status: 200 len: 1693 microversion: 2.1 time: 0.248559 Oct 22 21:37:10.880999 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2996/5966] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:37:10 2022] GET /compute/v2.1/servers/89a66831-cf82-4816-a69d-49ea892727cf => generated 1693 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:37:11.911739 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-67fbd1b8-dc59-4eb8-a87a-eb3db5143644 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:37:11.912710 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-67fbd1b8-dc59-4eb8-a87a-eb3db5143644 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] [instance: 89a66831-cf82-4816-a69d-49ea892727cf] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:37:11.924182 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-67fbd1b8-dc59-4eb8-a87a-eb3db5143644 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:37:11.924836 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-67fbd1b8-dc59-4eb8-a87a-eb3db5143644 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:37:11.925280 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-67fbd1b8-dc59-4eb8-a87a-eb3db5143644 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:37:11.925993 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-67fbd1b8-dc59-4eb8-a87a-eb3db5143644 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:37:11.926455 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-67fbd1b8-dc59-4eb8-a87a-eb3db5143644 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:37:11.926892 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-67fbd1b8-dc59-4eb8-a87a-eb3db5143644 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:37:12.067032 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-67fbd1b8-dc59-4eb8-a87a-eb3db5143644 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce13ae25b8cc4c32a66a2bcc536a3fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f9c508b2164653997b36431bb589b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:37:12.075163 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-67fbd1b8-dc59-4eb8-a87a-eb3db5143644 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] 10.222.0.18 "GET /compute/v2.1/servers/89a66831-cf82-4816-a69d-49ea892727cf" status: 200 len: 1690 microversion: 2.1 time: 0.172681 Oct 22 21:37:12.075781 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2971/5967] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:37:11 2022] GET /compute/v2.1/servers/89a66831-cf82-4816-a69d-49ea892727cf => generated 1690 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:37:12.100595 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-429ba066-c259-4d90-80b2-0953b515ab44 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:37:12.101162 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-429ba066-c259-4d90-80b2-0953b515ab44 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] [instance: 89a66831-cf82-4816-a69d-49ea892727cf] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:37:12.108551 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-429ba066-c259-4d90-80b2-0953b515ab44 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:37:12.109051 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-429ba066-c259-4d90-80b2-0953b515ab44 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:37:12.109505 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-429ba066-c259-4d90-80b2-0953b515ab44 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:37:12.110212 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-429ba066-c259-4d90-80b2-0953b515ab44 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:37:12.110684 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-429ba066-c259-4d90-80b2-0953b515ab44 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:37:12.111124 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-429ba066-c259-4d90-80b2-0953b515ab44 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:37:12.237036 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-429ba066-c259-4d90-80b2-0953b515ab44 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] 10.222.0.18 "POST /compute/v2.1/servers/89a66831-cf82-4816-a69d-49ea892727cf/action" status: 202 len: 0 microversion: 2.1 time: 0.141406 Oct 22 21:37:12.237673 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2997/5968] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 21:37:12 2022] POST /compute/v2.1/servers/89a66831-cf82-4816-a69d-49ea892727cf/action => generated 0 bytes in 143 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 21:37:12.245999 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-6787323c-9da5-4d72-8823-e600d9c91a13 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:37:12.246625 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-6787323c-9da5-4d72-8823-e600d9c91a13 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] [instance: 89a66831-cf82-4816-a69d-49ea892727cf] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:37:12.253058 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6787323c-9da5-4d72-8823-e600d9c91a13 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:37:12.253590 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6787323c-9da5-4d72-8823-e600d9c91a13 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:37:12.254037 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6787323c-9da5-4d72-8823-e600d9c91a13 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:37:12.254752 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6787323c-9da5-4d72-8823-e600d9c91a13 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:37:12.255214 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6787323c-9da5-4d72-8823-e600d9c91a13 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:37:12.255647 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6787323c-9da5-4d72-8823-e600d9c91a13 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:37:12.452576 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-6787323c-9da5-4d72-8823-e600d9c91a13 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce13ae25b8cc4c32a66a2bcc536a3fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f9c508b2164653997b36431bb589b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:37:12.461510 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-6787323c-9da5-4d72-8823-e600d9c91a13 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] 10.222.0.18 "GET /compute/v2.1/servers/89a66831-cf82-4816-a69d-49ea892727cf" status: 200 len: 1689 microversion: 2.1 time: 0.219429 Oct 22 21:37:12.462104 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2972/5969] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:37:12 2022] GET /compute/v2.1/servers/89a66831-cf82-4816-a69d-49ea892727cf => generated 1689 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:37:13.490829 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-3ff924b4-a5f9-437f-9beb-99780a7676e8 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:37:13.491545 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-3ff924b4-a5f9-437f-9beb-99780a7676e8 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] [instance: 89a66831-cf82-4816-a69d-49ea892727cf] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:37:13.498369 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3ff924b4-a5f9-437f-9beb-99780a7676e8 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:37:13.498871 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3ff924b4-a5f9-437f-9beb-99780a7676e8 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:37:13.499321 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3ff924b4-a5f9-437f-9beb-99780a7676e8 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:37:13.500053 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3ff924b4-a5f9-437f-9beb-99780a7676e8 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:37:13.500524 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3ff924b4-a5f9-437f-9beb-99780a7676e8 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:37:13.500964 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3ff924b4-a5f9-437f-9beb-99780a7676e8 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:37:13.641251 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-3ff924b4-a5f9-437f-9beb-99780a7676e8 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce13ae25b8cc4c32a66a2bcc536a3fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f9c508b2164653997b36431bb589b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:37:13.649809 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-3ff924b4-a5f9-437f-9beb-99780a7676e8 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] 10.222.0.18 "GET /compute/v2.1/servers/89a66831-cf82-4816-a69d-49ea892727cf" status: 200 len: 1689 microversion: 2.1 time: 0.165841 Oct 22 21:37:13.650405 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2998/5970] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:37:13 2022] GET /compute/v2.1/servers/89a66831-cf82-4816-a69d-49ea892727cf => generated 1689 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:37:14.673904 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-9c12de15-81e9-43bf-a265-b2e39d78b174 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:37:14.674720 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-9c12de15-81e9-43bf-a265-b2e39d78b174 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] [instance: 89a66831-cf82-4816-a69d-49ea892727cf] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:37:14.682242 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9c12de15-81e9-43bf-a265-b2e39d78b174 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:37:14.682765 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9c12de15-81e9-43bf-a265-b2e39d78b174 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:37:14.683213 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9c12de15-81e9-43bf-a265-b2e39d78b174 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:37:14.683953 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9c12de15-81e9-43bf-a265-b2e39d78b174 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:37:14.684417 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9c12de15-81e9-43bf-a265-b2e39d78b174 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:37:14.684860 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9c12de15-81e9-43bf-a265-b2e39d78b174 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:37:14.833260 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-9c12de15-81e9-43bf-a265-b2e39d78b174 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce13ae25b8cc4c32a66a2bcc536a3fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f9c508b2164653997b36431bb589b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:37:14.841769 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-9c12de15-81e9-43bf-a265-b2e39d78b174 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] 10.222.0.18 "GET /compute/v2.1/servers/89a66831-cf82-4816-a69d-49ea892727cf" status: 200 len: 1689 microversion: 2.1 time: 0.172008 Oct 22 21:37:14.843325 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2973/5971] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:37:14 2022] GET /compute/v2.1/servers/89a66831-cf82-4816-a69d-49ea892727cf => generated 1689 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:37:14.954585 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-50008a95-ea11-47a0-b93d-f8f466495c7a req-8b73c614-a1a8-4ce7-a392-e4679188c2a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89a66831-cf82-4816-a69d-49ea892727cf", "name": "network-vif-plugged", "status": "completed", "tag": "b526b777-89ea-4d89-8b97-a4d98f42d570"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:37:14.965656 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-50008a95-ea11-47a0-b93d-f8f466495c7a req-8b73c614-a1a8-4ce7-a392-e4679188c2a8 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:37:14.966186 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-50008a95-ea11-47a0-b93d-f8f466495c7a req-8b73c614-a1a8-4ce7-a392-e4679188c2a8 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:37:14.966597 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-50008a95-ea11-47a0-b93d-f8f466495c7a req-8b73c614-a1a8-4ce7-a392-e4679188c2a8 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:37:14.979623 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-50008a95-ea11-47a0-b93d-f8f466495c7a req-8b73c614-a1a8-4ce7-a392-e4679188c2a8 service nova] Creating event network-vif-plugged:b526b777-89ea-4d89-8b97-a4d98f42d570 for instance 89a66831-cf82-4816-a69d-49ea892727cf on nch2-master-1 Oct 22 21:37:14.985378 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [req-50008a95-ea11-47a0-b93d-f8f466495c7a req-8b73c614-a1a8-4ce7-a392-e4679188c2a8 service nova] Instance 89a66831-cf82-4816-a69d-49ea892727cf is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=138745) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 22 21:37:14.997286 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-50008a95-ea11-47a0-b93d-f8f466495c7a req-8b73c614-a1a8-4ce7-a392-e4679188c2a8 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047194 Oct 22 21:37:14.998131 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 2999/5972] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:37:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:37:15.827088 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-6b3427a7-02d4-4465-a559-d2aa177cdfbf req-1daa2ce6-63e1-44af-913e-cb2337c2ebca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89a66831-cf82-4816-a69d-49ea892727cf", "name": "network-vif-unplugged", "status": "completed", "tag": "b526b777-89ea-4d89-8b97-a4d98f42d570"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:37:15.838153 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-6b3427a7-02d4-4465-a559-d2aa177cdfbf req-1daa2ce6-63e1-44af-913e-cb2337c2ebca service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:37:15.838657 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-6b3427a7-02d4-4465-a559-d2aa177cdfbf req-1daa2ce6-63e1-44af-913e-cb2337c2ebca service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:37:15.839103 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-6b3427a7-02d4-4465-a559-d2aa177cdfbf req-1daa2ce6-63e1-44af-913e-cb2337c2ebca service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:37:15.852869 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-6b3427a7-02d4-4465-a559-d2aa177cdfbf req-1daa2ce6-63e1-44af-913e-cb2337c2ebca service nova] Creating event network-vif-unplugged:b526b777-89ea-4d89-8b97-a4d98f42d570 for instance 89a66831-cf82-4816-a69d-49ea892727cf on nch1-master-1 Oct 22 21:37:15.858568 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [req-6b3427a7-02d4-4465-a559-d2aa177cdfbf req-1daa2ce6-63e1-44af-913e-cb2337c2ebca service nova] Instance 89a66831-cf82-4816-a69d-49ea892727cf is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=138744) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 22 21:37:15.867570 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-e9bcb44f-ea0a-4731-ace5-17e9d76ede8c tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:37:15.868380 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-e9bcb44f-ea0a-4731-ace5-17e9d76ede8c tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] [instance: 89a66831-cf82-4816-a69d-49ea892727cf] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:37:15.870113 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-6b3427a7-02d4-4465-a559-d2aa177cdfbf req-1daa2ce6-63e1-44af-913e-cb2337c2ebca service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046643 Oct 22 21:37:15.870794 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2974/5973] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:37:15 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:37:15.875636 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e9bcb44f-ea0a-4731-ace5-17e9d76ede8c tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:37:15.876082 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e9bcb44f-ea0a-4731-ace5-17e9d76ede8c tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:37:15.876534 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e9bcb44f-ea0a-4731-ace5-17e9d76ede8c tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:37:15.877488 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e9bcb44f-ea0a-4731-ace5-17e9d76ede8c tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:37:15.877958 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e9bcb44f-ea0a-4731-ace5-17e9d76ede8c tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:37:15.878404 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e9bcb44f-ea0a-4731-ace5-17e9d76ede8c tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:37:16.093826 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-e9bcb44f-ea0a-4731-ace5-17e9d76ede8c tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce13ae25b8cc4c32a66a2bcc536a3fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f9c508b2164653997b36431bb589b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:37:16.096888 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:37:16.104060 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-e9bcb44f-ea0a-4731-ace5-17e9d76ede8c tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] 10.222.0.18 "GET /compute/v2.1/servers/89a66831-cf82-4816-a69d-49ea892727cf" status: 200 len: 1689 microversion: 2.1 time: 0.241183 Oct 22 21:37:16.104645 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3000/5974] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:37:15 2022] GET /compute/v2.1/servers/89a66831-cf82-4816-a69d-49ea892727cf => generated 1689 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:37:17.134059 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-90768264-a77b-4f78-bed7-55b64d149712 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:37:17.135187 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-90768264-a77b-4f78-bed7-55b64d149712 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] [instance: 89a66831-cf82-4816-a69d-49ea892727cf] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:37:17.144233 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-90768264-a77b-4f78-bed7-55b64d149712 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:37:17.144725 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-90768264-a77b-4f78-bed7-55b64d149712 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:37:17.145166 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-90768264-a77b-4f78-bed7-55b64d149712 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:37:17.145876 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-90768264-a77b-4f78-bed7-55b64d149712 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:37:17.146331 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-90768264-a77b-4f78-bed7-55b64d149712 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:37:17.146764 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-90768264-a77b-4f78-bed7-55b64d149712 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:37:17.296476 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-90768264-a77b-4f78-bed7-55b64d149712 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce13ae25b8cc4c32a66a2bcc536a3fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f9c508b2164653997b36431bb589b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:37:17.308677 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-90768264-a77b-4f78-bed7-55b64d149712 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] 10.222.0.18 "GET /compute/v2.1/servers/89a66831-cf82-4816-a69d-49ea892727cf" status: 200 len: 1689 microversion: 2.1 time: 0.183220 Oct 22 21:37:17.309443 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2975/5975] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:37:17 2022] GET /compute/v2.1/servers/89a66831-cf82-4816-a69d-49ea892727cf => generated 1689 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:37:17.894062 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-5379935c-0e0b-44c1-9f1f-f8a312d8ae4c req-ae997b41-1774-469a-9a00-4632bd568983 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89a66831-cf82-4816-a69d-49ea892727cf", "tag": "b526b777-89ea-4d89-8b97-a4d98f42d570"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:37:17.905253 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-5379935c-0e0b-44c1-9f1f-f8a312d8ae4c req-ae997b41-1774-469a-9a00-4632bd568983 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:37:17.905678 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-5379935c-0e0b-44c1-9f1f-f8a312d8ae4c req-ae997b41-1774-469a-9a00-4632bd568983 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:37:17.906128 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-5379935c-0e0b-44c1-9f1f-f8a312d8ae4c req-ae997b41-1774-469a-9a00-4632bd568983 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:37:17.918928 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-5379935c-0e0b-44c1-9f1f-f8a312d8ae4c req-ae997b41-1774-469a-9a00-4632bd568983 service nova] Creating event network-changed:b526b777-89ea-4d89-8b97-a4d98f42d570 for instance 89a66831-cf82-4816-a69d-49ea892727cf on nch1-master-1 Oct 22 21:37:17.924981 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [req-5379935c-0e0b-44c1-9f1f-f8a312d8ae4c req-ae997b41-1774-469a-9a00-4632bd568983 service nova] Instance 89a66831-cf82-4816-a69d-49ea892727cf is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=138745) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 22 21:37:17.935659 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-5379935c-0e0b-44c1-9f1f-f8a312d8ae4c req-ae997b41-1774-469a-9a00-4632bd568983 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047367 Oct 22 21:37:17.936259 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3001/5976] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:37:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:37:18.334619 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-787ab7e2-be01-44be-953e-e59f340ec0c4 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:37:18.335221 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-787ab7e2-be01-44be-953e-e59f340ec0c4 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] [instance: 89a66831-cf82-4816-a69d-49ea892727cf] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:37:18.342580 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-787ab7e2-be01-44be-953e-e59f340ec0c4 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:37:18.343083 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-787ab7e2-be01-44be-953e-e59f340ec0c4 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:37:18.343573 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-787ab7e2-be01-44be-953e-e59f340ec0c4 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:37:18.344291 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-787ab7e2-be01-44be-953e-e59f340ec0c4 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:37:18.344760 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-787ab7e2-be01-44be-953e-e59f340ec0c4 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:37:18.345199 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-787ab7e2-be01-44be-953e-e59f340ec0c4 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:37:18.551485 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-787ab7e2-be01-44be-953e-e59f340ec0c4 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce13ae25b8cc4c32a66a2bcc536a3fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f9c508b2164653997b36431bb589b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:37:18.560004 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-787ab7e2-be01-44be-953e-e59f340ec0c4 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] 10.222.0.18 "GET /compute/v2.1/servers/89a66831-cf82-4816-a69d-49ea892727cf" status: 200 len: 1689 microversion: 2.1 time: 0.229431 Oct 22 21:37:18.560557 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2976/5977] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:37:18 2022] GET /compute/v2.1/servers/89a66831-cf82-4816-a69d-49ea892727cf => generated 1689 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:37:19.585598 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-71c590cf-2959-4e7a-a19a-80032e08cdd7 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:37:19.586311 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-71c590cf-2959-4e7a-a19a-80032e08cdd7 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] [instance: 89a66831-cf82-4816-a69d-49ea892727cf] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:37:19.594481 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-71c590cf-2959-4e7a-a19a-80032e08cdd7 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:37:19.594966 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-71c590cf-2959-4e7a-a19a-80032e08cdd7 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:37:19.595455 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-71c590cf-2959-4e7a-a19a-80032e08cdd7 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:37:19.596894 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-71c590cf-2959-4e7a-a19a-80032e08cdd7 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:37:19.597364 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-71c590cf-2959-4e7a-a19a-80032e08cdd7 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:37:19.597855 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-71c590cf-2959-4e7a-a19a-80032e08cdd7 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:37:19.776156 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-71c590cf-2959-4e7a-a19a-80032e08cdd7 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce13ae25b8cc4c32a66a2bcc536a3fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f9c508b2164653997b36431bb589b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:37:19.786090 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-71c590cf-2959-4e7a-a19a-80032e08cdd7 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] 10.222.0.18 "GET /compute/v2.1/servers/89a66831-cf82-4816-a69d-49ea892727cf" status: 200 len: 1689 microversion: 2.1 time: 0.205746 Oct 22 21:37:19.786681 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3002/5978] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:37:19 2022] GET /compute/v2.1/servers/89a66831-cf82-4816-a69d-49ea892727cf => generated 1689 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:37:20.810261 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-851a697c-7d5d-4a28-a599-dc69fb5cd3c3 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:37:20.810892 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-851a697c-7d5d-4a28-a599-dc69fb5cd3c3 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] [instance: 89a66831-cf82-4816-a69d-49ea892727cf] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:37:20.818348 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-851a697c-7d5d-4a28-a599-dc69fb5cd3c3 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:37:20.818843 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-851a697c-7d5d-4a28-a599-dc69fb5cd3c3 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:37:20.819289 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-851a697c-7d5d-4a28-a599-dc69fb5cd3c3 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:37:20.820048 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-851a697c-7d5d-4a28-a599-dc69fb5cd3c3 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:37:20.820510 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-851a697c-7d5d-4a28-a599-dc69fb5cd3c3 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:37:20.820945 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-851a697c-7d5d-4a28-a599-dc69fb5cd3c3 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:37:20.841355 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:SELECT=100 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:37:20.957399 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-851a697c-7d5d-4a28-a599-dc69fb5cd3c3 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce13ae25b8cc4c32a66a2bcc536a3fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f9c508b2164653997b36431bb589b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:37:20.965473 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-851a697c-7d5d-4a28-a599-dc69fb5cd3c3 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] 10.222.0.18 "GET /compute/v2.1/servers/89a66831-cf82-4816-a69d-49ea892727cf" status: 200 len: 1682 microversion: 2.1 time: 0.159230 Oct 22 21:37:20.966101 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2977/5979] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:37:20 2022] GET /compute/v2.1/servers/89a66831-cf82-4816-a69d-49ea892727cf => generated 1682 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:37:22.721559 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-2d35f3cb-b0e8-4693-b7b7-e67d309daf15 req-ae2e2887-b6c2-4237-a481-b2dfc9e2e529 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89a66831-cf82-4816-a69d-49ea892727cf", "name": "network-vif-plugged", "status": "completed", "tag": "b526b777-89ea-4d89-8b97-a4d98f42d570"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:37:22.732381 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-2d35f3cb-b0e8-4693-b7b7-e67d309daf15 req-ae2e2887-b6c2-4237-a481-b2dfc9e2e529 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:37:22.732885 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-2d35f3cb-b0e8-4693-b7b7-e67d309daf15 req-ae2e2887-b6c2-4237-a481-b2dfc9e2e529 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:37:22.733335 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-2d35f3cb-b0e8-4693-b7b7-e67d309daf15 req-ae2e2887-b6c2-4237-a481-b2dfc9e2e529 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:37:22.745084 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-2d35f3cb-b0e8-4693-b7b7-e67d309daf15 req-ae2e2887-b6c2-4237-a481-b2dfc9e2e529 service nova] Creating event network-vif-plugged:b526b777-89ea-4d89-8b97-a4d98f42d570 for instance 89a66831-cf82-4816-a69d-49ea892727cf on nch1-master-1 Oct 22 21:37:22.750125 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-2d35f3cb-b0e8-4693-b7b7-e67d309daf15 req-ae2e2887-b6c2-4237-a481-b2dfc9e2e529 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032853 Oct 22 21:37:22.750726 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3003/5980] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:37:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:37:53.259386 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-a6bde954-a3b3-4977-b9f3-8b444b2acdab tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:37:53.261702 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-a6bde954-a3b3-4977-b9f3-8b444b2acdab tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] [instance: 89a66831-cf82-4816-a69d-49ea892727cf] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:37:53.264169 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_api:SELECT=36 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:37:53.264835 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:SELECT=2 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:37:53.270259 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a6bde954-a3b3-4977-b9f3-8b444b2acdab tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:37:53.270754 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a6bde954-a3b3-4977-b9f3-8b444b2acdab tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:37:53.271200 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a6bde954-a3b3-4977-b9f3-8b444b2acdab tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:37:53.271936 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a6bde954-a3b3-4977-b9f3-8b444b2acdab tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:37:53.272400 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a6bde954-a3b3-4977-b9f3-8b444b2acdab tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:37:53.272843 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a6bde954-a3b3-4977-b9f3-8b444b2acdab tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:37:53.328812 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-a6bde954-a3b3-4977-b9f3-8b444b2acdab tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] 10.222.0.18 "POST /compute/v2.1/servers/89a66831-cf82-4816-a69d-49ea892727cf/action" status: 200 len: 63061 microversion: 2.1 time: 0.076276 Oct 22 21:37:53.329486 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2978/5981] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 21:37:53 2022] POST /compute/v2.1/servers/89a66831-cf82-4816-a69d-49ea892727cf/action => generated 63061 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 22 21:38:16.395434 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_api:SELECT=40 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:38:16.396187 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell1:SELECT=13 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:38:16.459640 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-94ae1086-8ffb-411f-b002-cd87a061242a tempest-TestNetworkAdvancedServerOps-1033830903 tempest-TestNetworkAdvancedServerOps-1033830903-project-admin] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:38:16.460366 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-94ae1086-8ffb-411f-b002-cd87a061242a tempest-TestNetworkAdvancedServerOps-1033830903 tempest-TestNetworkAdvancedServerOps-1033830903-project-admin] [instance: 89a66831-cf82-4816-a69d-49ea892727cf] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:38:16.466817 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-94ae1086-8ffb-411f-b002-cd87a061242a tempest-TestNetworkAdvancedServerOps-1033830903 tempest-TestNetworkAdvancedServerOps-1033830903-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:38:16.467333 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-94ae1086-8ffb-411f-b002-cd87a061242a tempest-TestNetworkAdvancedServerOps-1033830903 tempest-TestNetworkAdvancedServerOps-1033830903-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:38:16.467787 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-94ae1086-8ffb-411f-b002-cd87a061242a tempest-TestNetworkAdvancedServerOps-1033830903 tempest-TestNetworkAdvancedServerOps-1033830903-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:38:16.468489 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-94ae1086-8ffb-411f-b002-cd87a061242a tempest-TestNetworkAdvancedServerOps-1033830903 tempest-TestNetworkAdvancedServerOps-1033830903-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:38:16.468953 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-94ae1086-8ffb-411f-b002-cd87a061242a tempest-TestNetworkAdvancedServerOps-1033830903 tempest-TestNetworkAdvancedServerOps-1033830903-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:38:16.469390 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-94ae1086-8ffb-411f-b002-cd87a061242a tempest-TestNetworkAdvancedServerOps-1033830903 tempest-TestNetworkAdvancedServerOps-1033830903-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:38:16.605232 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-94ae1086-8ffb-411f-b002-cd87a061242a tempest-TestNetworkAdvancedServerOps-1033830903 tempest-TestNetworkAdvancedServerOps-1033830903-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/89a66831-cf82-4816-a69d-49ea892727cf" status: 200 len: 1833 microversion: 2.1 time: 0.211923 Oct 22 21:38:16.605819 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3004/5982] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:38:16 2022] GET /compute/v2.1/servers/89a66831-cf82-4816-a69d-49ea892727cf => generated 1833 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:38:17.924469 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-85714d46-eb23-48e1-b01b-504cf4dcdf7c tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:38:17.925222 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-85714d46-eb23-48e1-b01b-504cf4dcdf7c tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] [instance: 89a66831-cf82-4816-a69d-49ea892727cf] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:38:17.926571 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-0c81e0b7-a66c-45ed-bb06-7101a3017c76 req-b80751eb-22f6-45f7-b992-b4000826121a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89a66831-cf82-4816-a69d-49ea892727cf", "tag": "b526b777-89ea-4d89-8b97-a4d98f42d570"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:38:17.929289 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_api:SELECT=2 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:38:17.930330 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:SELECT=4 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:38:17.935383 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-85714d46-eb23-48e1-b01b-504cf4dcdf7c tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:38:17.935886 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-85714d46-eb23-48e1-b01b-504cf4dcdf7c tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:38:17.936337 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-85714d46-eb23-48e1-b01b-504cf4dcdf7c tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:38:17.937055 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-85714d46-eb23-48e1-b01b-504cf4dcdf7c tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:38:17.937549 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-85714d46-eb23-48e1-b01b-504cf4dcdf7c tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:38:17.937987 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-85714d46-eb23-48e1-b01b-504cf4dcdf7c tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:38:17.939168 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-0c81e0b7-a66c-45ed-bb06-7101a3017c76 req-b80751eb-22f6-45f7-b992-b4000826121a service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:38:17.939754 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-0c81e0b7-a66c-45ed-bb06-7101a3017c76 req-b80751eb-22f6-45f7-b992-b4000826121a service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:38:17.940478 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-0c81e0b7-a66c-45ed-bb06-7101a3017c76 req-b80751eb-22f6-45f7-b992-b4000826121a service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:38:17.955935 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-0c81e0b7-a66c-45ed-bb06-7101a3017c76 req-b80751eb-22f6-45f7-b992-b4000826121a service nova] Creating event network-changed:b526b777-89ea-4d89-8b97-a4d98f42d570 for instance 89a66831-cf82-4816-a69d-49ea892727cf on nch1-master-1 Oct 22 21:38:17.961892 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-0c81e0b7-a66c-45ed-bb06-7101a3017c76 req-b80751eb-22f6-45f7-b992-b4000826121a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039914 Oct 22 21:38:17.962518 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3005/5983] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:38:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:38:17.967272 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-85714d46-eb23-48e1-b01b-504cf4dcdf7c tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] [instance: 89a66831-cf82-4816-a69d-49ea892727cf] Going to try to terminate instance {{(pid=138744) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 21:38:18.061343 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-85714d46-eb23-48e1-b01b-504cf4dcdf7c tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] 10.222.0.18 "DELETE /compute/v2.1/servers/89a66831-cf82-4816-a69d-49ea892727cf" status: 204 len: 0 microversion: 2.1 time: 0.141123 Oct 22 21:38:18.062677 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2979/5984] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 21:38:17 2022] DELETE /compute/v2.1/servers/89a66831-cf82-4816-a69d-49ea892727cf => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 21:38:18.073077 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-b6bf0ec6-2d30-482f-bec3-63dd704d6e0f tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:38:18.073839 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-b6bf0ec6-2d30-482f-bec3-63dd704d6e0f tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] [instance: 89a66831-cf82-4816-a69d-49ea892727cf] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:38:18.081273 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b6bf0ec6-2d30-482f-bec3-63dd704d6e0f tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:38:18.081865 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b6bf0ec6-2d30-482f-bec3-63dd704d6e0f tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:38:18.082388 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b6bf0ec6-2d30-482f-bec3-63dd704d6e0f tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:38:18.083522 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b6bf0ec6-2d30-482f-bec3-63dd704d6e0f tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:38:18.083852 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b6bf0ec6-2d30-482f-bec3-63dd704d6e0f tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:38:18.084300 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b6bf0ec6-2d30-482f-bec3-63dd704d6e0f tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:38:18.245532 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-b6bf0ec6-2d30-482f-bec3-63dd704d6e0f tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce13ae25b8cc4c32a66a2bcc536a3fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f9c508b2164653997b36431bb589b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:38:18.253772 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-b6bf0ec6-2d30-482f-bec3-63dd704d6e0f tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] 10.222.0.18 "GET /compute/v2.1/servers/89a66831-cf82-4816-a69d-49ea892727cf" status: 200 len: 1688 microversion: 2.1 time: 0.185740 Oct 22 21:38:18.254373 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3006/5985] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:38:18 2022] GET /compute/v2.1/servers/89a66831-cf82-4816-a69d-49ea892727cf => generated 1688 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:38:19.279089 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-470ee68c-6ec1-4554-8703-3a0c85869c61 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:38:19.279777 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-470ee68c-6ec1-4554-8703-3a0c85869c61 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] [instance: 89a66831-cf82-4816-a69d-49ea892727cf] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:38:19.288026 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-470ee68c-6ec1-4554-8703-3a0c85869c61 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:38:19.288430 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-470ee68c-6ec1-4554-8703-3a0c85869c61 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:38:19.288878 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-470ee68c-6ec1-4554-8703-3a0c85869c61 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:38:19.289589 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-470ee68c-6ec1-4554-8703-3a0c85869c61 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:38:19.290053 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-470ee68c-6ec1-4554-8703-3a0c85869c61 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:38:19.290487 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-470ee68c-6ec1-4554-8703-3a0c85869c61 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:38:19.477945 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-470ee68c-6ec1-4554-8703-3a0c85869c61 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce13ae25b8cc4c32a66a2bcc536a3fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f9c508b2164653997b36431bb589b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:38:19.486058 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-470ee68c-6ec1-4554-8703-3a0c85869c61 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] 10.222.0.18 "GET /compute/v2.1/servers/89a66831-cf82-4816-a69d-49ea892727cf" status: 200 len: 1688 microversion: 2.1 time: 0.211516 Oct 22 21:38:19.486626 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2980/5986] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:38:19 2022] GET /compute/v2.1/servers/89a66831-cf82-4816-a69d-49ea892727cf => generated 1688 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:38:20.042653 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-50f19088-82fd-4304-8ee7-4491fb652536 req-31c36a5a-6124-4934-ab83-eb5c985f0b4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89a66831-cf82-4816-a69d-49ea892727cf", "name": "network-vif-deleted", "tag": "b526b777-89ea-4d89-8b97-a4d98f42d570"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:38:20.053225 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-50f19088-82fd-4304-8ee7-4491fb652536 req-31c36a5a-6124-4934-ab83-eb5c985f0b4a service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:38:20.053721 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-50f19088-82fd-4304-8ee7-4491fb652536 req-31c36a5a-6124-4934-ab83-eb5c985f0b4a service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:38:20.054179 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-50f19088-82fd-4304-8ee7-4491fb652536 req-31c36a5a-6124-4934-ab83-eb5c985f0b4a service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:38:20.066140 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-50f19088-82fd-4304-8ee7-4491fb652536 req-31c36a5a-6124-4934-ab83-eb5c985f0b4a service nova] Creating event network-vif-deleted:b526b777-89ea-4d89-8b97-a4d98f42d570 for instance 89a66831-cf82-4816-a69d-49ea892727cf on nch1-master-1 Oct 22 21:38:20.071797 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-50f19088-82fd-4304-8ee7-4491fb652536 req-31c36a5a-6124-4934-ab83-eb5c985f0b4a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034408 Oct 22 21:38:20.072406 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3007/5987] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:38:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:38:20.515254 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-f4ab7f6d-dfc1-4613-b913-ca0e85791d7c tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:38:20.515902 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-f4ab7f6d-dfc1-4613-b913-ca0e85791d7c tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] [instance: 89a66831-cf82-4816-a69d-49ea892727cf] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:38:20.523011 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f4ab7f6d-dfc1-4613-b913-ca0e85791d7c tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:38:20.523547 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f4ab7f6d-dfc1-4613-b913-ca0e85791d7c tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:38:20.523991 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f4ab7f6d-dfc1-4613-b913-ca0e85791d7c tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:38:20.524706 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f4ab7f6d-dfc1-4613-b913-ca0e85791d7c tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:38:20.525169 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f4ab7f6d-dfc1-4613-b913-ca0e85791d7c tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:38:20.525600 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f4ab7f6d-dfc1-4613-b913-ca0e85791d7c tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:38:20.563876 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f4ab7f6d-dfc1-4613-b913-ca0e85791d7c tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:38:20.564360 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f4ab7f6d-dfc1-4613-b913-ca0e85791d7c tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:38:20.564803 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f4ab7f6d-dfc1-4613-b913-ca0e85791d7c tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:38:20.565694 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.objects.instance [None req-f4ab7f6d-dfc1-4613-b913-ca0e85791d7c tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lazy-loading 'fault' on Instance uuid 89a66831-cf82-4816-a69d-49ea892727cf {{(pid=138744) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 21:38:20.610449 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-f4ab7f6d-dfc1-4613-b913-ca0e85791d7c tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce13ae25b8cc4c32a66a2bcc536a3fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f9c508b2164653997b36431bb589b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:38:20.618254 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-f4ab7f6d-dfc1-4613-b913-ca0e85791d7c tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] 10.222.0.18 "GET /compute/v2.1/servers/89a66831-cf82-4816-a69d-49ea892727cf" status: 200 len: 1355 microversion: 2.1 time: 0.106952 Oct 22 21:38:20.618832 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2981/5988] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:38:20 2022] GET /compute/v2.1/servers/89a66831-cf82-4816-a69d-49ea892727cf => generated 1355 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:38:21.646047 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-523cb3bb-507a-48cc-a60f-185e9077dc19 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:38:21.646771 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-523cb3bb-507a-48cc-a60f-185e9077dc19 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] [instance: 89a66831-cf82-4816-a69d-49ea892727cf] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:38:21.653675 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-523cb3bb-507a-48cc-a60f-185e9077dc19 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:38:21.654185 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-523cb3bb-507a-48cc-a60f-185e9077dc19 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:38:21.654649 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-523cb3bb-507a-48cc-a60f-185e9077dc19 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:38:21.655383 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-523cb3bb-507a-48cc-a60f-185e9077dc19 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:38:21.655890 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-523cb3bb-507a-48cc-a60f-185e9077dc19 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:38:21.656322 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-523cb3bb-507a-48cc-a60f-185e9077dc19 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:38:21.670594 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.wsgi [None req-523cb3bb-507a-48cc-a60f-185e9077dc19 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] HTTP exception thrown: Instance 89a66831-cf82-4816-a69d-49ea892727cf could not be found. Oct 22 21:38:21.672355 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-523cb3bb-507a-48cc-a60f-185e9077dc19 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Request method failure captured: Oct 22 21:38:21.672355 ncdv-master-1 devstack@n-api.service[138745]: request: GET /compute/v2.1/servers/89a66831-cf82-4816-a69d-49ea892727cf HTTP/1.1 Oct 22 21:38:21.672355 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 21:38:21.672355 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 21:38:21.672355 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 21:38:21.672355 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 0 Oct 22 21:38:21.672355 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 21:38:21.672355 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 21:38:21.672355 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 21:38:21.672355 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 21:38:21.672355 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVGGILX10s2dIgDgVZo2IQgnPiDYDu9a3ft4OAGis05yO8BrPDQHvhvjIr_WfblUYdacpoCBNulloRKj8k-zduRl3WptOsWJtL3dswrAo60x20bp_MtWiCHhhHG9kPBkPEvIy-4T7Hm5YfPQsiEPV_Ld77h47ySD3KCZYLji1QhcSMDE Oct 22 21:38:21.672355 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 21:38:21.672355 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 21:38:21.672355 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 21:38:21.672355 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 21:38:21.672355 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 21:38:21.672355 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 21:38:21.672355 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: 42f9c508b2164653997b36431bb589b8 Oct 22 21:38:21.672355 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1810030830 Oct 22 21:38:21.672355 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 21:38:21.672355 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 21:38:21.672355 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_42f9c508b2164653997b36431bb589b8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/42f9c508b2164653997b36431bb589b8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/42f9c508b2164653997b36431bb589b8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/42f9c508b2164653997b36431bb589b8"}]}] Oct 22 21:38:21.672355 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1810030830 Oct 22 21:38:21.672355 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: 42f9c508b2164653997b36431bb589b8 Oct 22 21:38:21.672355 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1810030830 Oct 22 21:38:21.672355 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-TestNetworkAdvancedServerOps-1810030830-project Oct 22 21:38:21.672355 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 21:38:21.672355 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 21:38:21.672355 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: ce13ae25b8cc4c32a66a2bcc536a3fd6 Oct 22 21:38:21.672355 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1810030830-project Oct 22 21:38:21.672355 ncdv-master-1 devstack@n-api.service[138745]: method: > Oct 22 21:38:21.672355 ncdv-master-1 devstack@n-api.service[138745]: exception: Instance 89a66831-cf82-4816-a69d-49ea892727cf could not be found. Oct 22 21:38:21.672355 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'id': '89a66831-cf82-4816-a69d-49ea892727cf'} Oct 22 21:38:21.672355 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:38:21.672355 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:38:21.672355 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 21:38:21.672355 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 21:38:21.672355 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 21:38:21.672355 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 21:38:21.672355 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 21:38:21.672355 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 21:38:21.672355 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 21:38:21.672355 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 21:38:21.672355 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 89a66831-cf82-4816-a69d-49ea892727cf could not be found. Oct 22 21:38:21.672355 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:38:21.672355 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:38:21.672355 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:38:21.672355 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:38:21.672355 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:38:21.672355 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:38:21.672355 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:38:21.672355 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:38:21.672355 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:38:21.672355 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:38:21.672355 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 21:38:21.672355 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 21:38:21.672355 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 21:38:21.672355 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 21:38:21.672355 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 21:38:21.672355 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:38:21.672355 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 89a66831-cf82-4816-a69d-49ea892727cf could not be found. Oct 22 21:38:21.672355 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:38:21.672355 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:38:21.676566 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:38:21.676566 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:38:21.676566 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:38:21.676566 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:38:21.676566 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:38:21.676566 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:38:21.676566 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 89a66831-cf82-4816-a69d-49ea892727cf could not be found. Oct 22 21:38:21.676566 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:38:21.676566 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-523cb3bb-507a-48cc-a60f-185e9077dc19 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Returning 404 to user: Instance 89a66831-cf82-4816-a69d-49ea892727cf could not be found. {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:38:21.676566 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-523cb3bb-507a-48cc-a60f-185e9077dc19 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] 10.222.0.18 "GET /compute/v2.1/servers/89a66831-cf82-4816-a69d-49ea892727cf" status: 404 len: 111 microversion: 2.1 time: 0.034741 Oct 22 21:38:21.676566 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3008/5989] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:38:21 2022] GET /compute/v2.1/servers/89a66831-cf82-4816-a69d-49ea892727cf => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 21:38:25.021822 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-3e004804-314d-4c75-8612-1f66de7b3e8a tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Calling method '.version_select at 0x7fd39f030af0>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:38:25.026443 ncdv-master-1 devstack@n-api.service[138744]: ERROR oslo.messaging._drivers.impl_rabbit [None req-3e004804-314d-4c75-8612-1f66de7b3e8a tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] [1e95764d-9b00-41e5-9238-ea25707eb673] AMQP server on 10.222.0.18:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 22 21:38:26.039392 ncdv-master-1 devstack@n-api.service[138744]: INFO oslo.messaging._drivers.impl_rabbit [None req-3e004804-314d-4c75-8612-1f66de7b3e8a tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] [1e95764d-9b00-41e5-9238-ea25707eb673] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 33436. Oct 22 21:38:26.069532 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-3e004804-314d-4c75-8612-1f66de7b3e8a tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-204411941" status: 202 len: 0 microversion: 2.1 time: 1.051972 Oct 22 21:38:26.070122 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2982/5990] 10.222.0.18 () {58 vars in 1281 bytes} [Sat Oct 22 21:38:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-204411941 => generated 0 bytes in 1053 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 21:38:26.106311 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-a0cdb476-47c1-4d83-8c36-1f2f5b1e2b23 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Action: 'create', calling method: .version_select at 0x7fd3a44a4e50>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-34623591", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPrR0Zv31paelsRoMWyoy5pk/hBp0RSSTbtQohOQTkeKeE49j1ohK7JUOuceJSLxlTygSAvm3p+fNerWne5Ntsz4dnStQmozYvucGwHLact0SG19kBD/M7C4hW34A1TYfg=="}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:38:26.123850 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-a0cdb476-47c1-4d83-8c36-1f2f5b1e2b23 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Getting quotas for project 42f9c508b2164653997b36431bb589b8. Resources: {'key_pairs'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 21:38:26.130362 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-a0cdb476-47c1-4d83-8c36-1f2f5b1e2b23 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Getting quotas for user ce13ae25b8cc4c32a66a2bcc536a3fd6 and project 42f9c508b2164653997b36431bb589b8. Resources: {'key_pairs'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 21:38:26.144856 ncdv-master-1 devstack@n-api.service[138745]: ERROR oslo.messaging._drivers.impl_rabbit [None req-a0cdb476-47c1-4d83-8c36-1f2f5b1e2b23 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] [fdffe6b9-9d4b-45b8-9714-1ef9d5132dcd] AMQP server on 10.222.0.18:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 22 21:38:27.158007 ncdv-master-1 devstack@n-api.service[138745]: INFO oslo.messaging._drivers.impl_rabbit [None req-a0cdb476-47c1-4d83-8c36-1f2f5b1e2b23 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] [fdffe6b9-9d4b-45b8-9714-1ef9d5132dcd] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 33442. Oct 22 21:38:27.177744 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-a0cdb476-47c1-4d83-8c36-1f2f5b1e2b23 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 1.075509 Oct 22 21:38:27.178354 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3009/5991] 10.222.0.18 () {60 vars in 1159 bytes} [Sat Oct 22 21:38:26 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 1077 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:38:32.668816 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:38:32.673813 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-70abcbf7-a2e4-4083-b5a3-e7b31b7370c5 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-792309175", "imageRef": "085e4478-6edc-4a69-8e08-f9831713eb65", "flavorRef": "452", "networks": [{"uuid": "665f525d-f013-42b9-b6e1-58f4af13c0fb"}], "key_name": "tempest-TestNetworkAdvancedServerOps-34623591", "security_groups": [{"name": "tempest-secgroup-smoke-493982847"}]}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:38:32.785799 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.network.neutron [None req-70abcbf7-a2e4-4083-b5a3-e7b31b7370c5 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] validate_networks() for [('665f525d-f013-42b9-b6e1-58f4af13c0fb', None, None, None, None, None)] {{(pid=138744) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 21:38:33.268442 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-70abcbf7-a2e4-4083-b5a3-e7b31b7370c5 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Flavor limits 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 21:38:33.268918 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-70abcbf7-a2e4-4083-b5a3-e7b31b7370c5 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Image limits 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 21:38:33.269407 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-70abcbf7-a2e4-4083-b5a3-e7b31b7370c5 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Flavor pref 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 21:38:33.269829 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-70abcbf7-a2e4-4083-b5a3-e7b31b7370c5 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Image pref 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 21:38:33.270229 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-70abcbf7-a2e4-4083-b5a3-e7b31b7370c5 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 21:38:33.280444 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-70abcbf7-a2e4-4083-b5a3-e7b31b7370c5 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:38:33.280946 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-70abcbf7-a2e4-4083-b5a3-e7b31b7370c5 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:38:33.281398 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-70abcbf7-a2e4-4083-b5a3-e7b31b7370c5 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:38:33.282152 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-70abcbf7-a2e4-4083-b5a3-e7b31b7370c5 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:38:33.282635 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-70abcbf7-a2e4-4083-b5a3-e7b31b7370c5 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:38:33.283073 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-70abcbf7-a2e4-4083-b5a3-e7b31b7370c5 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:38:33.301494 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-70abcbf7-a2e4-4083-b5a3-e7b31b7370c5 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Getting quotas for project 42f9c508b2164653997b36431bb589b8. Resources: {'cores', 'instances', 'ram'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 21:38:33.307804 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-70abcbf7-a2e4-4083-b5a3-e7b31b7370c5 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Getting quotas for user ce13ae25b8cc4c32a66a2bcc536a3fd6 and project 42f9c508b2164653997b36431bb589b8. Resources: {'cores', 'instances', 'ram'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 21:38:33.321904 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-70abcbf7-a2e4-4083-b5a3-e7b31b7370c5 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Going to run 1 instances... {{(pid=138744) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 21:38:33.324229 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-70abcbf7-a2e4-4083-b5a3-e7b31b7370c5 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] [instance: d6e33e0a-dbea-4fff-9cc8-d5a7afe5ec62] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='085e4478-6edc-4a69-8e08-f9831713eb65',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138744) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 21:38:33.376939 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-70abcbf7-a2e4-4083-b5a3-e7b31b7370c5 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.709941 Oct 22 21:38:33.377957 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2983/5992] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Oct 22 21:38:32 2022] POST /compute/v2.1/servers => generated 405 bytes in 712 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 21:38:33.387071 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell1:SELECT=18 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:38:33.392121 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-6cce85ab-80bc-4025-9335-0bce6879931e tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:38:33.392884 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-6cce85ab-80bc-4025-9335-0bce6879931e tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] [instance: d6e33e0a-dbea-4fff-9cc8-d5a7afe5ec62] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:38:33.453706 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-6cce85ab-80bc-4025-9335-0bce6879931e tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce13ae25b8cc4c32a66a2bcc536a3fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f9c508b2164653997b36431bb589b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:38:33.462328 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-6cce85ab-80bc-4025-9335-0bce6879931e tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] 10.222.0.18 "GET /compute/v2.1/servers/d6e33e0a-dbea-4fff-9cc8-d5a7afe5ec62" status: 200 len: 1264 microversion: 2.1 time: 0.076978 Oct 22 21:38:33.463930 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3010/5993] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:38:33 2022] GET /compute/v2.1/servers/d6e33e0a-dbea-4fff-9cc8-d5a7afe5ec62 => generated 1264 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:38:34.487532 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-9a22508a-80be-4b76-8cd0-f808bc43961a tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:38:34.488656 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-9a22508a-80be-4b76-8cd0-f808bc43961a tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] [instance: d6e33e0a-dbea-4fff-9cc8-d5a7afe5ec62] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:38:34.498674 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9a22508a-80be-4b76-8cd0-f808bc43961a tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:38:34.499161 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9a22508a-80be-4b76-8cd0-f808bc43961a tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:38:34.500239 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9a22508a-80be-4b76-8cd0-f808bc43961a tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:38:34.501155 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9a22508a-80be-4b76-8cd0-f808bc43961a tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:38:34.502151 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9a22508a-80be-4b76-8cd0-f808bc43961a tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:38:34.502759 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9a22508a-80be-4b76-8cd0-f808bc43961a tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:38:34.569748 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-9a22508a-80be-4b76-8cd0-f808bc43961a tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce13ae25b8cc4c32a66a2bcc536a3fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f9c508b2164653997b36431bb589b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:38:34.579439 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-9a22508a-80be-4b76-8cd0-f808bc43961a tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] 10.222.0.18 "GET /compute/v2.1/servers/d6e33e0a-dbea-4fff-9cc8-d5a7afe5ec62" status: 200 len: 1316 microversion: 2.1 time: 0.096857 Oct 22 21:38:34.591841 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2984/5994] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:38:34 2022] GET /compute/v2.1/servers/d6e33e0a-dbea-4fff-9cc8-d5a7afe5ec62 => generated 1316 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:38:35.605558 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-0b30b890-5f46-4504-98aa-796010486d94 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:38:35.607087 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-0b30b890-5f46-4504-98aa-796010486d94 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] [instance: d6e33e0a-dbea-4fff-9cc8-d5a7afe5ec62] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:38:35.618633 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0b30b890-5f46-4504-98aa-796010486d94 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:38:35.619630 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0b30b890-5f46-4504-98aa-796010486d94 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:38:35.620422 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0b30b890-5f46-4504-98aa-796010486d94 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:38:35.621398 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0b30b890-5f46-4504-98aa-796010486d94 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:38:35.622081 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0b30b890-5f46-4504-98aa-796010486d94 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:38:35.622736 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0b30b890-5f46-4504-98aa-796010486d94 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:38:35.847194 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-0b30b890-5f46-4504-98aa-796010486d94 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce13ae25b8cc4c32a66a2bcc536a3fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f9c508b2164653997b36431bb589b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:38:35.855736 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-0b30b890-5f46-4504-98aa-796010486d94 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] 10.222.0.18 "GET /compute/v2.1/servers/d6e33e0a-dbea-4fff-9cc8-d5a7afe5ec62" status: 200 len: 1389 microversion: 2.1 time: 0.254874 Oct 22 21:38:35.856351 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3011/5995] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:38:35 2022] GET /compute/v2.1/servers/d6e33e0a-dbea-4fff-9cc8-d5a7afe5ec62 => generated 1389 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:38:36.254093 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-ea2c6709-1bae-434f-bc8b-729d9b999c55 req-825c564c-5ec2-41b8-acb3-538a2d2ea616 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d6e33e0a-dbea-4fff-9cc8-d5a7afe5ec62", "tag": "bba3cfae-6ea7-4b33-980e-666db653ae9a"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:38:36.268184 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-ea2c6709-1bae-434f-bc8b-729d9b999c55 req-825c564c-5ec2-41b8-acb3-538a2d2ea616 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:38:36.268969 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-ea2c6709-1bae-434f-bc8b-729d9b999c55 req-825c564c-5ec2-41b8-acb3-538a2d2ea616 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:38:36.272507 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-ea2c6709-1bae-434f-bc8b-729d9b999c55 req-825c564c-5ec2-41b8-acb3-538a2d2ea616 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:38:36.285539 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-ea2c6709-1bae-434f-bc8b-729d9b999c55 req-825c564c-5ec2-41b8-acb3-538a2d2ea616 service nova] Creating event network-changed:bba3cfae-6ea7-4b33-980e-666db653ae9a for instance d6e33e0a-dbea-4fff-9cc8-d5a7afe5ec62 on nch1-master-1 Oct 22 21:38:36.290827 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-ea2c6709-1bae-434f-bc8b-729d9b999c55 req-825c564c-5ec2-41b8-acb3-538a2d2ea616 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044682 Oct 22 21:38:36.292319 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2985/5996] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:38:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:38:36.879310 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-819ed4d8-b01d-4483-b60d-54b09eb953ee tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:38:36.880208 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-819ed4d8-b01d-4483-b60d-54b09eb953ee tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] [instance: d6e33e0a-dbea-4fff-9cc8-d5a7afe5ec62] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:38:36.888093 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-819ed4d8-b01d-4483-b60d-54b09eb953ee tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:38:36.888598 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-819ed4d8-b01d-4483-b60d-54b09eb953ee tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:38:36.889049 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-819ed4d8-b01d-4483-b60d-54b09eb953ee tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:38:36.889763 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-819ed4d8-b01d-4483-b60d-54b09eb953ee tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:38:36.890250 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-819ed4d8-b01d-4483-b60d-54b09eb953ee tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:38:36.890697 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-819ed4d8-b01d-4483-b60d-54b09eb953ee tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:38:37.085804 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-819ed4d8-b01d-4483-b60d-54b09eb953ee tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce13ae25b8cc4c32a66a2bcc536a3fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f9c508b2164653997b36431bb589b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:38:37.094894 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-819ed4d8-b01d-4483-b60d-54b09eb953ee tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] 10.222.0.18 "GET /compute/v2.1/servers/d6e33e0a-dbea-4fff-9cc8-d5a7afe5ec62" status: 200 len: 1389 microversion: 2.1 time: 0.219833 Oct 22 21:38:37.095849 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3012/5997] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:38:36 2022] GET /compute/v2.1/servers/d6e33e0a-dbea-4fff-9cc8-d5a7afe5ec62 => generated 1389 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:38:38.125024 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-fa9fa6b4-a144-4345-ab06-6194e0376d3f tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:38:38.126166 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-fa9fa6b4-a144-4345-ab06-6194e0376d3f tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] [instance: d6e33e0a-dbea-4fff-9cc8-d5a7afe5ec62] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:38:38.135843 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fa9fa6b4-a144-4345-ab06-6194e0376d3f tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:38:38.136335 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fa9fa6b4-a144-4345-ab06-6194e0376d3f tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:38:38.136771 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fa9fa6b4-a144-4345-ab06-6194e0376d3f tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:38:38.137470 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fa9fa6b4-a144-4345-ab06-6194e0376d3f tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:38:38.137929 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fa9fa6b4-a144-4345-ab06-6194e0376d3f tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:38:38.138361 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fa9fa6b4-a144-4345-ab06-6194e0376d3f tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:38:38.284454 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-fa9fa6b4-a144-4345-ab06-6194e0376d3f tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce13ae25b8cc4c32a66a2bcc536a3fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f9c508b2164653997b36431bb589b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:38:38.293030 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-fa9fa6b4-a144-4345-ab06-6194e0376d3f tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] 10.222.0.18 "GET /compute/v2.1/servers/d6e33e0a-dbea-4fff-9cc8-d5a7afe5ec62" status: 200 len: 1389 microversion: 2.1 time: 0.176706 Oct 22 21:38:38.293607 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2986/5998] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:38:38 2022] GET /compute/v2.1/servers/d6e33e0a-dbea-4fff-9cc8-d5a7afe5ec62 => generated 1389 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:38:39.316416 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-3a086caf-c7b1-42ae-94be-e06efe53252f tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:38:39.317069 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-3a086caf-c7b1-42ae-94be-e06efe53252f tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] [instance: d6e33e0a-dbea-4fff-9cc8-d5a7afe5ec62] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:38:39.326113 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3a086caf-c7b1-42ae-94be-e06efe53252f tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:38:39.326817 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3a086caf-c7b1-42ae-94be-e06efe53252f tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:38:39.327385 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3a086caf-c7b1-42ae-94be-e06efe53252f tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:38:39.328720 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3a086caf-c7b1-42ae-94be-e06efe53252f tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:38:39.329339 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3a086caf-c7b1-42ae-94be-e06efe53252f tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:38:39.329908 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3a086caf-c7b1-42ae-94be-e06efe53252f tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:38:39.557647 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-3a086caf-c7b1-42ae-94be-e06efe53252f tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce13ae25b8cc4c32a66a2bcc536a3fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f9c508b2164653997b36431bb589b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:38:39.566160 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-3a086caf-c7b1-42ae-94be-e06efe53252f tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] 10.222.0.18 "GET /compute/v2.1/servers/d6e33e0a-dbea-4fff-9cc8-d5a7afe5ec62" status: 200 len: 1389 microversion: 2.1 time: 0.253750 Oct 22 21:38:39.566763 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3013/5999] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:38:39 2022] GET /compute/v2.1/servers/d6e33e0a-dbea-4fff-9cc8-d5a7afe5ec62 => generated 1389 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:38:40.597310 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-64f18fcc-6845-4db9-93cb-64fe3b445ed3 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:38:40.598195 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-64f18fcc-6845-4db9-93cb-64fe3b445ed3 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] [instance: d6e33e0a-dbea-4fff-9cc8-d5a7afe5ec62] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:38:40.608162 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-64f18fcc-6845-4db9-93cb-64fe3b445ed3 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:38:40.608661 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-64f18fcc-6845-4db9-93cb-64fe3b445ed3 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:38:40.609108 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-64f18fcc-6845-4db9-93cb-64fe3b445ed3 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:38:40.609797 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-64f18fcc-6845-4db9-93cb-64fe3b445ed3 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:38:40.610721 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-64f18fcc-6845-4db9-93cb-64fe3b445ed3 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:38:40.610721 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-64f18fcc-6845-4db9-93cb-64fe3b445ed3 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:38:40.748271 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-64f18fcc-6845-4db9-93cb-64fe3b445ed3 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce13ae25b8cc4c32a66a2bcc536a3fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f9c508b2164653997b36431bb589b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:38:40.758234 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-64f18fcc-6845-4db9-93cb-64fe3b445ed3 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] 10.222.0.18 "GET /compute/v2.1/servers/d6e33e0a-dbea-4fff-9cc8-d5a7afe5ec62" status: 200 len: 1389 microversion: 2.1 time: 0.169911 Oct 22 21:38:40.759036 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2987/6000] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:38:40 2022] GET /compute/v2.1/servers/d6e33e0a-dbea-4fff-9cc8-d5a7afe5ec62 => generated 1389 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:38:41.786748 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-4b7aceda-9358-4862-abf2-048bcb7e75a2 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:38:41.787607 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-4b7aceda-9358-4862-abf2-048bcb7e75a2 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] [instance: d6e33e0a-dbea-4fff-9cc8-d5a7afe5ec62] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:38:41.794452 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4b7aceda-9358-4862-abf2-048bcb7e75a2 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:38:41.795216 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4b7aceda-9358-4862-abf2-048bcb7e75a2 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:38:41.795884 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4b7aceda-9358-4862-abf2-048bcb7e75a2 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:38:41.796773 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4b7aceda-9358-4862-abf2-048bcb7e75a2 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:38:41.797250 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4b7aceda-9358-4862-abf2-048bcb7e75a2 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:38:41.797699 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4b7aceda-9358-4862-abf2-048bcb7e75a2 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:38:41.937059 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-4b7aceda-9358-4862-abf2-048bcb7e75a2 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce13ae25b8cc4c32a66a2bcc536a3fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f9c508b2164653997b36431bb589b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:38:41.945041 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-4b7aceda-9358-4862-abf2-048bcb7e75a2 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] 10.222.0.18 "GET /compute/v2.1/servers/d6e33e0a-dbea-4fff-9cc8-d5a7afe5ec62" status: 200 len: 1389 microversion: 2.1 time: 0.162746 Oct 22 21:38:41.945618 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3014/6001] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:38:41 2022] GET /compute/v2.1/servers/d6e33e0a-dbea-4fff-9cc8-d5a7afe5ec62 => generated 1389 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:38:42.967797 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-77e2184a-9037-4021-ad31-2718f61c0a39 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:38:42.968395 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-77e2184a-9037-4021-ad31-2718f61c0a39 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] [instance: d6e33e0a-dbea-4fff-9cc8-d5a7afe5ec62] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:38:42.976163 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-77e2184a-9037-4021-ad31-2718f61c0a39 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:38:42.976693 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-77e2184a-9037-4021-ad31-2718f61c0a39 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:38:42.977150 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-77e2184a-9037-4021-ad31-2718f61c0a39 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:38:42.977858 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-77e2184a-9037-4021-ad31-2718f61c0a39 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:38:42.978324 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-77e2184a-9037-4021-ad31-2718f61c0a39 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:38:42.978762 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-77e2184a-9037-4021-ad31-2718f61c0a39 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:38:43.124235 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-77e2184a-9037-4021-ad31-2718f61c0a39 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce13ae25b8cc4c32a66a2bcc536a3fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f9c508b2164653997b36431bb589b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:38:43.132236 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-77e2184a-9037-4021-ad31-2718f61c0a39 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] 10.222.0.18 "GET /compute/v2.1/servers/d6e33e0a-dbea-4fff-9cc8-d5a7afe5ec62" status: 200 len: 1389 microversion: 2.1 time: 0.168526 Oct 22 21:38:43.132799 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2988/6002] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:38:42 2022] GET /compute/v2.1/servers/d6e33e0a-dbea-4fff-9cc8-d5a7afe5ec62 => generated 1389 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:38:43.272195 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-eea726ef-1e56-4291-a2ba-62601378a448 req-5a787573-c8e2-4fe6-9d9e-ebefff54b3c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6e33e0a-dbea-4fff-9cc8-d5a7afe5ec62", "name": "network-vif-plugged", "status": "completed", "tag": "bba3cfae-6ea7-4b33-980e-666db653ae9a"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:38:43.282220 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-eea726ef-1e56-4291-a2ba-62601378a448 req-5a787573-c8e2-4fe6-9d9e-ebefff54b3c6 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:38:43.282715 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-eea726ef-1e56-4291-a2ba-62601378a448 req-5a787573-c8e2-4fe6-9d9e-ebefff54b3c6 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:38:43.283163 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-eea726ef-1e56-4291-a2ba-62601378a448 req-5a787573-c8e2-4fe6-9d9e-ebefff54b3c6 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:38:43.294386 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-eea726ef-1e56-4291-a2ba-62601378a448 req-5a787573-c8e2-4fe6-9d9e-ebefff54b3c6 service nova] Creating event network-vif-plugged:bba3cfae-6ea7-4b33-980e-666db653ae9a for instance d6e33e0a-dbea-4fff-9cc8-d5a7afe5ec62 on nch1-master-1 Oct 22 21:38:43.299612 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-eea726ef-1e56-4291-a2ba-62601378a448 req-5a787573-c8e2-4fe6-9d9e-ebefff54b3c6 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094114 Oct 22 21:38:43.300194 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3015/6003] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:38:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:38:44.160242 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-0f706230-4447-4524-92b1-aeef148d935e tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:38:44.161515 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-0f706230-4447-4524-92b1-aeef148d935e tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] [instance: d6e33e0a-dbea-4fff-9cc8-d5a7afe5ec62] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:38:44.164826 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell0:SELECT=2 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:38:44.165930 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell0:SELECT=6 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:38:44.177353 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0f706230-4447-4524-92b1-aeef148d935e tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:38:44.178166 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0f706230-4447-4524-92b1-aeef148d935e tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:38:44.178895 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0f706230-4447-4524-92b1-aeef148d935e tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:38:44.180109 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0f706230-4447-4524-92b1-aeef148d935e tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:38:44.180870 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0f706230-4447-4524-92b1-aeef148d935e tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:38:44.181612 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0f706230-4447-4524-92b1-aeef148d935e tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:38:44.328328 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-0f706230-4447-4524-92b1-aeef148d935e tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce13ae25b8cc4c32a66a2bcc536a3fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f9c508b2164653997b36431bb589b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:38:44.336908 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-0f706230-4447-4524-92b1-aeef148d935e tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] 10.222.0.18 "GET /compute/v2.1/servers/d6e33e0a-dbea-4fff-9cc8-d5a7afe5ec62" status: 200 len: 1389 microversion: 2.1 time: 0.183540 Oct 22 21:38:44.337468 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2989/6004] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:38:44 2022] GET /compute/v2.1/servers/d6e33e0a-dbea-4fff-9cc8-d5a7afe5ec62 => generated 1389 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:38:45.359468 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell0:SELECT=6 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:38:45.365980 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-d5d25c8f-c806-482b-b16f-1f75ae3b9a7a tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:38:45.366927 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-d5d25c8f-c806-482b-b16f-1f75ae3b9a7a tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] [instance: d6e33e0a-dbea-4fff-9cc8-d5a7afe5ec62] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:38:45.375359 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d5d25c8f-c806-482b-b16f-1f75ae3b9a7a tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:38:45.376053 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d5d25c8f-c806-482b-b16f-1f75ae3b9a7a tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:38:45.376642 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d5d25c8f-c806-482b-b16f-1f75ae3b9a7a tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:38:45.377582 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d5d25c8f-c806-482b-b16f-1f75ae3b9a7a tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:38:45.378193 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d5d25c8f-c806-482b-b16f-1f75ae3b9a7a tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:38:45.378771 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d5d25c8f-c806-482b-b16f-1f75ae3b9a7a tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:38:45.522201 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-d5d25c8f-c806-482b-b16f-1f75ae3b9a7a tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce13ae25b8cc4c32a66a2bcc536a3fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f9c508b2164653997b36431bb589b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:38:45.532034 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-d5d25c8f-c806-482b-b16f-1f75ae3b9a7a tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] 10.222.0.18 "GET /compute/v2.1/servers/d6e33e0a-dbea-4fff-9cc8-d5a7afe5ec62" status: 200 len: 1560 microversion: 2.1 time: 0.173982 Oct 22 21:38:45.532618 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3016/6005] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:38:45 2022] GET /compute/v2.1/servers/d6e33e0a-dbea-4fff-9cc8-d5a7afe5ec62 => generated 1560 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:38:45.566138 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-24b04fd4-ed23-443d-869f-be634dfb4ca1 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:38:45.566843 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-24b04fd4-ed23-443d-869f-be634dfb4ca1 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] [instance: d6e33e0a-dbea-4fff-9cc8-d5a7afe5ec62] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:38:45.577601 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-24b04fd4-ed23-443d-869f-be634dfb4ca1 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:38:45.578296 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-24b04fd4-ed23-443d-869f-be634dfb4ca1 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:38:45.578871 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-24b04fd4-ed23-443d-869f-be634dfb4ca1 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:38:45.580005 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-24b04fd4-ed23-443d-869f-be634dfb4ca1 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:38:45.580619 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-24b04fd4-ed23-443d-869f-be634dfb4ca1 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:38:45.581213 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-24b04fd4-ed23-443d-869f-be634dfb4ca1 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:38:45.724195 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-24b04fd4-ed23-443d-869f-be634dfb4ca1 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce13ae25b8cc4c32a66a2bcc536a3fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f9c508b2164653997b36431bb589b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:38:45.732718 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-24b04fd4-ed23-443d-869f-be634dfb4ca1 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] 10.222.0.18 "GET /compute/v2.1/servers/d6e33e0a-dbea-4fff-9cc8-d5a7afe5ec62" status: 200 len: 1560 microversion: 2.1 time: 0.172144 Oct 22 21:38:45.733324 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2990/6006] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:38:45 2022] GET /compute/v2.1/servers/d6e33e0a-dbea-4fff-9cc8-d5a7afe5ec62 => generated 1560 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:38:47.701671 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-524d4270-a7ef-45c4-ad0a-080809df88bf tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:38:47.702303 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-524d4270-a7ef-45c4-ad0a-080809df88bf tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] [instance: d6e33e0a-dbea-4fff-9cc8-d5a7afe5ec62] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:38:47.705044 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=1 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:38:47.712428 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-74e77ba2-f258-4418-8523-bbfba2acf1a7 req-dffd2bf2-e403-4aa7-9b22-e48dea976edd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d6e33e0a-dbea-4fff-9cc8-d5a7afe5ec62", "tag": "bba3cfae-6ea7-4b33-980e-666db653ae9a"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:38:47.724078 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-524d4270-a7ef-45c4-ad0a-080809df88bf tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:38:47.728280 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-524d4270-a7ef-45c4-ad0a-080809df88bf tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:38:47.728692 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-524d4270-a7ef-45c4-ad0a-080809df88bf tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:38:47.729524 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-524d4270-a7ef-45c4-ad0a-080809df88bf tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:38:47.730001 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-524d4270-a7ef-45c4-ad0a-080809df88bf tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:38:47.730454 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-524d4270-a7ef-45c4-ad0a-080809df88bf tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:38:47.732185 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-74e77ba2-f258-4418-8523-bbfba2acf1a7 req-dffd2bf2-e403-4aa7-9b22-e48dea976edd service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:38:47.738050 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-74e77ba2-f258-4418-8523-bbfba2acf1a7 req-dffd2bf2-e403-4aa7-9b22-e48dea976edd service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:38:47.738705 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-74e77ba2-f258-4418-8523-bbfba2acf1a7 req-dffd2bf2-e403-4aa7-9b22-e48dea976edd service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:38:47.754977 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-74e77ba2-f258-4418-8523-bbfba2acf1a7 req-dffd2bf2-e403-4aa7-9b22-e48dea976edd service nova] Creating event network-changed:bba3cfae-6ea7-4b33-980e-666db653ae9a for instance d6e33e0a-dbea-4fff-9cc8-d5a7afe5ec62 on nch1-master-1 Oct 22 21:38:47.760930 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-74e77ba2-f258-4418-8523-bbfba2acf1a7 req-dffd2bf2-e403-4aa7-9b22-e48dea976edd service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052005 Oct 22 21:38:47.762252 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2991/6007] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:38:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 21:38:47.960900 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-524d4270-a7ef-45c4-ad0a-080809df88bf tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce13ae25b8cc4c32a66a2bcc536a3fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f9c508b2164653997b36431bb589b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:38:47.969453 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-524d4270-a7ef-45c4-ad0a-080809df88bf tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] 10.222.0.18 "GET /compute/v2.1/servers/d6e33e0a-dbea-4fff-9cc8-d5a7afe5ec62" status: 200 len: 1560 microversion: 2.1 time: 0.272173 Oct 22 21:38:47.975547 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3017/6008] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:38:47 2022] GET /compute/v2.1/servers/d6e33e0a-dbea-4fff-9cc8-d5a7afe5ec62 => generated 1560 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:39:19.361408 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:39:19.362422 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:SELECT=42 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:39:19.368202 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-1938496e-1d52-467d-86f1-0e89895f9000 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:39:19.371223 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-1938496e-1d52-467d-86f1-0e89895f9000 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] [instance: d6e33e0a-dbea-4fff-9cc8-d5a7afe5ec62] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:39:19.378854 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1938496e-1d52-467d-86f1-0e89895f9000 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:39:19.379368 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1938496e-1d52-467d-86f1-0e89895f9000 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:39:19.379824 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1938496e-1d52-467d-86f1-0e89895f9000 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:39:19.380532 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1938496e-1d52-467d-86f1-0e89895f9000 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:39:19.380992 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1938496e-1d52-467d-86f1-0e89895f9000 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:39:19.381427 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1938496e-1d52-467d-86f1-0e89895f9000 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:39:19.436564 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-1938496e-1d52-467d-86f1-0e89895f9000 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] 10.222.0.18 "POST /compute/v2.1/servers/d6e33e0a-dbea-4fff-9cc8-d5a7afe5ec62/action" status: 200 len: 24566 microversion: 2.1 time: 0.077927 Oct 22 21:39:19.437229 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2992/6009] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 21:39:19 2022] POST /compute/v2.1/servers/d6e33e0a-dbea-4fff-9cc8-d5a7afe5ec62/action => generated 24566 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 22 21:39:49.821448 ncdv-master-1 devstack@n-api.service[138745]: ERROR oslo.messaging._drivers.impl_rabbit [-] [dbe685c1-0e25-4156-906e-a0926e5c28f4] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 22 21:39:49.823057 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_api:SELECT=1 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:39:49.824313 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell1:SELECT=38 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:39:49.830950 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-e8cb2c3b-ac62-4aee-82b7-25b9eb5b4581 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:39:49.832093 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-e8cb2c3b-ac62-4aee-82b7-25b9eb5b4581 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] [instance: d6e33e0a-dbea-4fff-9cc8-d5a7afe5ec62] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:39:49.843940 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e8cb2c3b-ac62-4aee-82b7-25b9eb5b4581 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:39:49.844834 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e8cb2c3b-ac62-4aee-82b7-25b9eb5b4581 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:39:49.845935 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e8cb2c3b-ac62-4aee-82b7-25b9eb5b4581 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:39:49.846983 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e8cb2c3b-ac62-4aee-82b7-25b9eb5b4581 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:39:49.847482 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e8cb2c3b-ac62-4aee-82b7-25b9eb5b4581 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:39:49.847929 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e8cb2c3b-ac62-4aee-82b7-25b9eb5b4581 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:39:50.044940 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-e8cb2c3b-ac62-4aee-82b7-25b9eb5b4581 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce13ae25b8cc4c32a66a2bcc536a3fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f9c508b2164653997b36431bb589b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:39:50.053209 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-e8cb2c3b-ac62-4aee-82b7-25b9eb5b4581 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] 10.222.0.18 "GET /compute/v2.1/servers/d6e33e0a-dbea-4fff-9cc8-d5a7afe5ec62" status: 200 len: 1677 microversion: 2.1 time: 0.235110 Oct 22 21:39:50.054000 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3018/6010] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:39:49 2022] GET /compute/v2.1/servers/d6e33e0a-dbea-4fff-9cc8-d5a7afe5ec62 => generated 1677 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:39:50.157617 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-d16741eb-b62e-4030-a71a-1b0810109226 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:39:50.159996 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-d16741eb-b62e-4030-a71a-1b0810109226 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] [instance: d6e33e0a-dbea-4fff-9cc8-d5a7afe5ec62] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:39:50.162771 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:SELECT=4 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:39:50.163443 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_api:SELECT=2 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:39:50.169787 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d16741eb-b62e-4030-a71a-1b0810109226 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:39:50.170252 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d16741eb-b62e-4030-a71a-1b0810109226 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:39:50.170694 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d16741eb-b62e-4030-a71a-1b0810109226 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:39:50.171392 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d16741eb-b62e-4030-a71a-1b0810109226 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:39:50.171880 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d16741eb-b62e-4030-a71a-1b0810109226 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:39:50.172310 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d16741eb-b62e-4030-a71a-1b0810109226 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:39:50.226963 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-d16741eb-b62e-4030-a71a-1b0810109226 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] 10.222.0.18 "POST /compute/v2.1/servers/d6e33e0a-dbea-4fff-9cc8-d5a7afe5ec62/action" status: 200 len: 32639 microversion: 2.1 time: 0.073593 Oct 22 21:39:50.227676 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2993/6011] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 21:39:50 2022] POST /compute/v2.1/servers/d6e33e0a-dbea-4fff-9cc8-d5a7afe5ec62/action => generated 32639 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 22 21:39:50.398466 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-2f526825-b4c9-45c6-94cc-a6e44ef7e047 tempest-TestNetworkAdvancedServerOps-1033830903 tempest-TestNetworkAdvancedServerOps-1033830903-project-admin] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:39:50.399093 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-2f526825-b4c9-45c6-94cc-a6e44ef7e047 tempest-TestNetworkAdvancedServerOps-1033830903 tempest-TestNetworkAdvancedServerOps-1033830903-project-admin] [instance: d6e33e0a-dbea-4fff-9cc8-d5a7afe5ec62] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:39:50.405803 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2f526825-b4c9-45c6-94cc-a6e44ef7e047 tempest-TestNetworkAdvancedServerOps-1033830903 tempest-TestNetworkAdvancedServerOps-1033830903-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:39:50.406306 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2f526825-b4c9-45c6-94cc-a6e44ef7e047 tempest-TestNetworkAdvancedServerOps-1033830903 tempest-TestNetworkAdvancedServerOps-1033830903-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:39:50.406756 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2f526825-b4c9-45c6-94cc-a6e44ef7e047 tempest-TestNetworkAdvancedServerOps-1033830903 tempest-TestNetworkAdvancedServerOps-1033830903-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:39:50.407499 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2f526825-b4c9-45c6-94cc-a6e44ef7e047 tempest-TestNetworkAdvancedServerOps-1033830903 tempest-TestNetworkAdvancedServerOps-1033830903-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:39:50.408035 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2f526825-b4c9-45c6-94cc-a6e44ef7e047 tempest-TestNetworkAdvancedServerOps-1033830903 tempest-TestNetworkAdvancedServerOps-1033830903-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:39:50.408394 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2f526825-b4c9-45c6-94cc-a6e44ef7e047 tempest-TestNetworkAdvancedServerOps-1033830903 tempest-TestNetworkAdvancedServerOps-1033830903-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:39:50.538316 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-2f526825-b4c9-45c6-94cc-a6e44ef7e047 tempest-TestNetworkAdvancedServerOps-1033830903 tempest-TestNetworkAdvancedServerOps-1033830903-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/d6e33e0a-dbea-4fff-9cc8-d5a7afe5ec62" status: 200 len: 1828 microversion: 2.1 time: 0.143724 Oct 22 21:39:50.538930 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3019/6012] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:39:50 2022] GET /compute/v2.1/servers/d6e33e0a-dbea-4fff-9cc8-d5a7afe5ec62 => generated 1828 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:39:50.568810 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-70881570-9cba-47b7-b73e-f643dad93d79 tempest-TestNetworkAdvancedServerOps-1033830903 tempest-TestNetworkAdvancedServerOps-1033830903-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": null, "block_migration": true, "disk_over_commit": false}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:39:50.571476 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-70881570-9cba-47b7-b73e-f643dad93d79 tempest-TestNetworkAdvancedServerOps-1033830903 tempest-TestNetworkAdvancedServerOps-1033830903-project-admin] [instance: d6e33e0a-dbea-4fff-9cc8-d5a7afe5ec62] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:39:50.579054 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-70881570-9cba-47b7-b73e-f643dad93d79 tempest-TestNetworkAdvancedServerOps-1033830903 tempest-TestNetworkAdvancedServerOps-1033830903-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:39:50.579642 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-70881570-9cba-47b7-b73e-f643dad93d79 tempest-TestNetworkAdvancedServerOps-1033830903 tempest-TestNetworkAdvancedServerOps-1033830903-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:39:50.580095 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-70881570-9cba-47b7-b73e-f643dad93d79 tempest-TestNetworkAdvancedServerOps-1033830903 tempest-TestNetworkAdvancedServerOps-1033830903-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:39:50.580925 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-70881570-9cba-47b7-b73e-f643dad93d79 tempest-TestNetworkAdvancedServerOps-1033830903 tempest-TestNetworkAdvancedServerOps-1033830903-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:39:50.581414 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-70881570-9cba-47b7-b73e-f643dad93d79 tempest-TestNetworkAdvancedServerOps-1033830903 tempest-TestNetworkAdvancedServerOps-1033830903-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:39:50.581857 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-70881570-9cba-47b7-b73e-f643dad93d79 tempest-TestNetworkAdvancedServerOps-1033830903 tempest-TestNetworkAdvancedServerOps-1033830903-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:39:50.620731 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.objects.instance [None req-70881570-9cba-47b7-b73e-f643dad93d79 tempest-TestNetworkAdvancedServerOps-1033830903 tempest-TestNetworkAdvancedServerOps-1033830903-project-admin] Lazy-loading 'flavor' on Instance uuid d6e33e0a-dbea-4fff-9cc8-d5a7afe5ec62 {{(pid=138744) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 21:39:50.635741 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-70881570-9cba-47b7-b73e-f643dad93d79 tempest-TestNetworkAdvancedServerOps-1033830903 tempest-TestNetworkAdvancedServerOps-1033830903-project-admin] [instance: d6e33e0a-dbea-4fff-9cc8-d5a7afe5ec62] Going to try to live migrate instance to another host {{(pid=138744) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 22 21:39:56.207513 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-70881570-9cba-47b7-b73e-f643dad93d79 tempest-TestNetworkAdvancedServerOps-1033830903 tempest-TestNetworkAdvancedServerOps-1033830903-project-admin] 10.222.0.18 "POST /compute/v2.1/servers/d6e33e0a-dbea-4fff-9cc8-d5a7afe5ec62/action" status: 202 len: 0 microversion: 2.1 time: 5.642958 Oct 22 21:39:56.208261 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2994/6013] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 21:39:50 2022] POST /compute/v2.1/servers/d6e33e0a-dbea-4fff-9cc8-d5a7afe5ec62/action => generated 0 bytes in 5645 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 21:39:56.218129 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-bcc0476d-d21a-4f00-970d-2abd7cdb6810 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:39:56.218756 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-bcc0476d-d21a-4f00-970d-2abd7cdb6810 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] [instance: d6e33e0a-dbea-4fff-9cc8-d5a7afe5ec62] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:39:56.229290 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bcc0476d-d21a-4f00-970d-2abd7cdb6810 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:39:56.229796 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bcc0476d-d21a-4f00-970d-2abd7cdb6810 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:39:56.230245 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bcc0476d-d21a-4f00-970d-2abd7cdb6810 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:39:56.230975 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bcc0476d-d21a-4f00-970d-2abd7cdb6810 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:39:56.231539 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bcc0476d-d21a-4f00-970d-2abd7cdb6810 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:39:56.231989 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bcc0476d-d21a-4f00-970d-2abd7cdb6810 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:39:56.238045 ncdv-master-1 devstack@n-api.service[138745]: INFO oslo.messaging._drivers.impl_rabbit [-] [dbe685c1-0e25-4156-906e-a0926e5c28f4] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 33672. Oct 22 21:39:56.380642 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-bcc0476d-d21a-4f00-970d-2abd7cdb6810 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce13ae25b8cc4c32a66a2bcc536a3fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f9c508b2164653997b36431bb589b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:39:56.389157 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-bcc0476d-d21a-4f00-970d-2abd7cdb6810 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] 10.222.0.18 "GET /compute/v2.1/servers/d6e33e0a-dbea-4fff-9cc8-d5a7afe5ec62" status: 200 len: 1687 microversion: 2.1 time: 0.175501 Oct 22 21:39:56.390171 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3020/6014] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:39:56 2022] GET /compute/v2.1/servers/d6e33e0a-dbea-4fff-9cc8-d5a7afe5ec62 => generated 1687 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:39:57.394855 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-3a1575a0-8e4d-483d-b060-a616665d853c req-71462281-d08a-4c0d-b91e-02626ceb44d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6e33e0a-dbea-4fff-9cc8-d5a7afe5ec62", "name": "network-vif-unplugged", "status": "completed", "tag": "bba3cfae-6ea7-4b33-980e-666db653ae9a"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:39:57.410078 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-3a1575a0-8e4d-483d-b060-a616665d853c req-71462281-d08a-4c0d-b91e-02626ceb44d8 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:39:57.410557 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-3a1575a0-8e4d-483d-b060-a616665d853c req-71462281-d08a-4c0d-b91e-02626ceb44d8 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:39:57.410997 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-3a1575a0-8e4d-483d-b060-a616665d853c req-71462281-d08a-4c0d-b91e-02626ceb44d8 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:39:57.414116 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-f32d2148-8b75-43d3-8a25-3a59bd1866a8 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:39:57.415095 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-f32d2148-8b75-43d3-8a25-3a59bd1866a8 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] [instance: d6e33e0a-dbea-4fff-9cc8-d5a7afe5ec62] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:39:57.422173 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f32d2148-8b75-43d3-8a25-3a59bd1866a8 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:39:57.422682 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f32d2148-8b75-43d3-8a25-3a59bd1866a8 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:39:57.423382 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f32d2148-8b75-43d3-8a25-3a59bd1866a8 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:39:57.423504 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-3a1575a0-8e4d-483d-b060-a616665d853c req-71462281-d08a-4c0d-b91e-02626ceb44d8 service nova] Creating event network-vif-unplugged:bba3cfae-6ea7-4b33-980e-666db653ae9a for instance d6e33e0a-dbea-4fff-9cc8-d5a7afe5ec62 on nch1-master-1 Oct 22 21:39:57.425061 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f32d2148-8b75-43d3-8a25-3a59bd1866a8 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:39:57.425061 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f32d2148-8b75-43d3-8a25-3a59bd1866a8 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:39:57.425061 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f32d2148-8b75-43d3-8a25-3a59bd1866a8 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:39:57.428768 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-3a1575a0-8e4d-483d-b060-a616665d853c req-71462281-d08a-4c0d-b91e-02626ceb44d8 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.039168 Oct 22 21:39:57.429394 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2995/6015] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:39:57 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:39:57.662555 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-f32d2148-8b75-43d3-8a25-3a59bd1866a8 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce13ae25b8cc4c32a66a2bcc536a3fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f9c508b2164653997b36431bb589b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:39:57.670723 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-f32d2148-8b75-43d3-8a25-3a59bd1866a8 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] 10.222.0.18 "GET /compute/v2.1/servers/d6e33e0a-dbea-4fff-9cc8-d5a7afe5ec62" status: 200 len: 1687 microversion: 2.1 time: 0.260573 Oct 22 21:39:57.671312 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3021/6016] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:39:57 2022] GET /compute/v2.1/servers/d6e33e0a-dbea-4fff-9cc8-d5a7afe5ec62 => generated 1687 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:39:58.698027 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-fbfe069f-047b-44bb-91d1-f5aa0f8725dc tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:39:58.698916 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-fbfe069f-047b-44bb-91d1-f5aa0f8725dc tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] [instance: d6e33e0a-dbea-4fff-9cc8-d5a7afe5ec62] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:39:58.707406 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fbfe069f-047b-44bb-91d1-f5aa0f8725dc tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:39:58.708058 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fbfe069f-047b-44bb-91d1-f5aa0f8725dc tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:39:58.708620 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fbfe069f-047b-44bb-91d1-f5aa0f8725dc tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:39:58.709510 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fbfe069f-047b-44bb-91d1-f5aa0f8725dc tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:39:58.710085 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fbfe069f-047b-44bb-91d1-f5aa0f8725dc tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:39:58.710647 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fbfe069f-047b-44bb-91d1-f5aa0f8725dc tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:39:58.906956 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-fbfe069f-047b-44bb-91d1-f5aa0f8725dc tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce13ae25b8cc4c32a66a2bcc536a3fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f9c508b2164653997b36431bb589b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:39:58.916054 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-fbfe069f-047b-44bb-91d1-f5aa0f8725dc tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] 10.222.0.18 "GET /compute/v2.1/servers/d6e33e0a-dbea-4fff-9cc8-d5a7afe5ec62" status: 200 len: 1687 microversion: 2.1 time: 0.224489 Oct 22 21:39:58.916605 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2996/6017] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:39:58 2022] GET /compute/v2.1/servers/d6e33e0a-dbea-4fff-9cc8-d5a7afe5ec62 => generated 1687 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:39:59.474104 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-64d1f077-0b62-4aa1-beab-1034f82b221a req-e1a58eeb-2bd2-4969-bbb9-e4f993252a0b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d6e33e0a-dbea-4fff-9cc8-d5a7afe5ec62", "tag": "bba3cfae-6ea7-4b33-980e-666db653ae9a"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:39:59.484980 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-64d1f077-0b62-4aa1-beab-1034f82b221a req-e1a58eeb-2bd2-4969-bbb9-e4f993252a0b service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:39:59.485485 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-64d1f077-0b62-4aa1-beab-1034f82b221a req-e1a58eeb-2bd2-4969-bbb9-e4f993252a0b service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:39:59.485966 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-64d1f077-0b62-4aa1-beab-1034f82b221a req-e1a58eeb-2bd2-4969-bbb9-e4f993252a0b service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:39:59.497929 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-64d1f077-0b62-4aa1-beab-1034f82b221a req-e1a58eeb-2bd2-4969-bbb9-e4f993252a0b service nova] Creating event network-changed:bba3cfae-6ea7-4b33-980e-666db653ae9a for instance d6e33e0a-dbea-4fff-9cc8-d5a7afe5ec62 on nch1-master-1 Oct 22 21:39:59.503201 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-64d1f077-0b62-4aa1-beab-1034f82b221a req-e1a58eeb-2bd2-4969-bbb9-e4f993252a0b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034946 Oct 22 21:39:59.503916 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3022/6018] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:39:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:39:59.943517 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-0bc47cb9-6672-4ee5-924a-767adec03f2b tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:39:59.944126 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-0bc47cb9-6672-4ee5-924a-767adec03f2b tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] [instance: d6e33e0a-dbea-4fff-9cc8-d5a7afe5ec62] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:39:59.951785 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0bc47cb9-6672-4ee5-924a-767adec03f2b tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:39:59.952282 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0bc47cb9-6672-4ee5-924a-767adec03f2b tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:39:59.952749 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0bc47cb9-6672-4ee5-924a-767adec03f2b tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:39:59.953461 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0bc47cb9-6672-4ee5-924a-767adec03f2b tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:39:59.953919 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0bc47cb9-6672-4ee5-924a-767adec03f2b tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:39:59.954354 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0bc47cb9-6672-4ee5-924a-767adec03f2b tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:40:00.139599 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-0bc47cb9-6672-4ee5-924a-767adec03f2b tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce13ae25b8cc4c32a66a2bcc536a3fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f9c508b2164653997b36431bb589b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:40:00.147874 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-0bc47cb9-6672-4ee5-924a-767adec03f2b tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] 10.222.0.18 "GET /compute/v2.1/servers/d6e33e0a-dbea-4fff-9cc8-d5a7afe5ec62" status: 200 len: 1687 microversion: 2.1 time: 0.208812 Oct 22 21:40:00.148458 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2997/6019] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:39:59 2022] GET /compute/v2.1/servers/d6e33e0a-dbea-4fff-9cc8-d5a7afe5ec62 => generated 1687 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:40:01.178356 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-2450b903-7f4f-4c0b-85cb-790134e47ae9 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:40:01.179052 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-2450b903-7f4f-4c0b-85cb-790134e47ae9 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] [instance: d6e33e0a-dbea-4fff-9cc8-d5a7afe5ec62] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:40:01.186091 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2450b903-7f4f-4c0b-85cb-790134e47ae9 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:40:01.186580 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2450b903-7f4f-4c0b-85cb-790134e47ae9 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:40:01.187038 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2450b903-7f4f-4c0b-85cb-790134e47ae9 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:40:01.187832 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2450b903-7f4f-4c0b-85cb-790134e47ae9 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:40:01.188321 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2450b903-7f4f-4c0b-85cb-790134e47ae9 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:40:01.188758 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2450b903-7f4f-4c0b-85cb-790134e47ae9 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:40:01.346452 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-2450b903-7f4f-4c0b-85cb-790134e47ae9 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce13ae25b8cc4c32a66a2bcc536a3fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f9c508b2164653997b36431bb589b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:40:01.356986 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-2450b903-7f4f-4c0b-85cb-790134e47ae9 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] 10.222.0.18 "GET /compute/v2.1/servers/d6e33e0a-dbea-4fff-9cc8-d5a7afe5ec62" status: 200 len: 1687 microversion: 2.1 time: 0.186227 Oct 22 21:40:01.357783 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3023/6020] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:40:01 2022] GET /compute/v2.1/servers/d6e33e0a-dbea-4fff-9cc8-d5a7afe5ec62 => generated 1687 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:40:02.384560 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-3782d9e9-aa51-42f4-9e75-744ef73fabb0 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:40:02.385204 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-3782d9e9-aa51-42f4-9e75-744ef73fabb0 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] [instance: d6e33e0a-dbea-4fff-9cc8-d5a7afe5ec62] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:40:02.393070 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3782d9e9-aa51-42f4-9e75-744ef73fabb0 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:40:02.393587 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3782d9e9-aa51-42f4-9e75-744ef73fabb0 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:40:02.394054 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3782d9e9-aa51-42f4-9e75-744ef73fabb0 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:40:02.394769 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3782d9e9-aa51-42f4-9e75-744ef73fabb0 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:40:02.395306 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3782d9e9-aa51-42f4-9e75-744ef73fabb0 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:40:02.395779 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3782d9e9-aa51-42f4-9e75-744ef73fabb0 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:40:02.541234 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-3782d9e9-aa51-42f4-9e75-744ef73fabb0 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce13ae25b8cc4c32a66a2bcc536a3fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f9c508b2164653997b36431bb589b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:40:02.549417 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-3782d9e9-aa51-42f4-9e75-744ef73fabb0 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] 10.222.0.18 "GET /compute/v2.1/servers/d6e33e0a-dbea-4fff-9cc8-d5a7afe5ec62" status: 200 len: 1687 microversion: 2.1 time: 0.169665 Oct 22 21:40:02.549996 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2998/6021] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:40:02 2022] GET /compute/v2.1/servers/d6e33e0a-dbea-4fff-9cc8-d5a7afe5ec62 => generated 1687 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:40:03.572948 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-442c84c2-76b6-4d1c-b43e-b8cc2905ed99 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:40:03.573555 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-442c84c2-76b6-4d1c-b43e-b8cc2905ed99 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] [instance: d6e33e0a-dbea-4fff-9cc8-d5a7afe5ec62] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:40:03.581401 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-442c84c2-76b6-4d1c-b43e-b8cc2905ed99 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:40:03.582216 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-442c84c2-76b6-4d1c-b43e-b8cc2905ed99 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:40:03.582419 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-442c84c2-76b6-4d1c-b43e-b8cc2905ed99 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:40:03.583191 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-442c84c2-76b6-4d1c-b43e-b8cc2905ed99 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:40:03.583703 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-442c84c2-76b6-4d1c-b43e-b8cc2905ed99 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:40:03.584150 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-442c84c2-76b6-4d1c-b43e-b8cc2905ed99 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:40:03.801043 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-442c84c2-76b6-4d1c-b43e-b8cc2905ed99 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce13ae25b8cc4c32a66a2bcc536a3fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f9c508b2164653997b36431bb589b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:40:03.809475 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-442c84c2-76b6-4d1c-b43e-b8cc2905ed99 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] 10.222.0.18 "GET /compute/v2.1/servers/d6e33e0a-dbea-4fff-9cc8-d5a7afe5ec62" status: 200 len: 1687 microversion: 2.1 time: 0.240506 Oct 22 21:40:03.810267 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3024/6022] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:40:03 2022] GET /compute/v2.1/servers/d6e33e0a-dbea-4fff-9cc8-d5a7afe5ec62 => generated 1687 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:40:04.833690 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-e876c242-1bbb-4b8f-93ea-8ca8288f8827 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:40:04.834303 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-e876c242-1bbb-4b8f-93ea-8ca8288f8827 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] [instance: d6e33e0a-dbea-4fff-9cc8-d5a7afe5ec62] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:40:04.841643 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e876c242-1bbb-4b8f-93ea-8ca8288f8827 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:40:04.842146 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e876c242-1bbb-4b8f-93ea-8ca8288f8827 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:40:04.842592 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e876c242-1bbb-4b8f-93ea-8ca8288f8827 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:40:04.843312 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e876c242-1bbb-4b8f-93ea-8ca8288f8827 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:40:04.843813 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e876c242-1bbb-4b8f-93ea-8ca8288f8827 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:40:04.844248 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e876c242-1bbb-4b8f-93ea-8ca8288f8827 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:40:05.032358 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-e876c242-1bbb-4b8f-93ea-8ca8288f8827 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce13ae25b8cc4c32a66a2bcc536a3fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f9c508b2164653997b36431bb589b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:40:05.040688 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-e876c242-1bbb-4b8f-93ea-8ca8288f8827 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] 10.222.0.18 "GET /compute/v2.1/servers/d6e33e0a-dbea-4fff-9cc8-d5a7afe5ec62" status: 200 len: 1687 microversion: 2.1 time: 0.211359 Oct 22 21:40:05.041383 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 2999/6023] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:40:04 2022] GET /compute/v2.1/servers/d6e33e0a-dbea-4fff-9cc8-d5a7afe5ec62 => generated 1687 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:40:06.069583 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-683d0afd-1270-4d7b-aa86-c06167407614 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:40:06.070263 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-683d0afd-1270-4d7b-aa86-c06167407614 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] [instance: d6e33e0a-dbea-4fff-9cc8-d5a7afe5ec62] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:40:06.078359 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-683d0afd-1270-4d7b-aa86-c06167407614 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:40:06.078925 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-683d0afd-1270-4d7b-aa86-c06167407614 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:40:06.079480 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-683d0afd-1270-4d7b-aa86-c06167407614 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:40:06.080367 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-683d0afd-1270-4d7b-aa86-c06167407614 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:40:06.080917 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-683d0afd-1270-4d7b-aa86-c06167407614 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:40:06.081433 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-683d0afd-1270-4d7b-aa86-c06167407614 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:40:06.223992 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-683d0afd-1270-4d7b-aa86-c06167407614 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce13ae25b8cc4c32a66a2bcc536a3fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f9c508b2164653997b36431bb589b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:40:06.232304 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-683d0afd-1270-4d7b-aa86-c06167407614 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] 10.222.0.18 "GET /compute/v2.1/servers/d6e33e0a-dbea-4fff-9cc8-d5a7afe5ec62" status: 200 len: 1677 microversion: 2.1 time: 0.168504 Oct 22 21:40:06.232848 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3025/6024] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:40:06 2022] GET /compute/v2.1/servers/d6e33e0a-dbea-4fff-9cc8-d5a7afe5ec62 => generated 1677 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:40:06.255299 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-882ce83c-2691-4434-bf4b-7248f2d647ee tempest-TestNetworkAdvancedServerOps-1033830903 tempest-TestNetworkAdvancedServerOps-1033830903-project-admin] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:40:06.255976 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-882ce83c-2691-4434-bf4b-7248f2d647ee tempest-TestNetworkAdvancedServerOps-1033830903 tempest-TestNetworkAdvancedServerOps-1033830903-project-admin] [instance: d6e33e0a-dbea-4fff-9cc8-d5a7afe5ec62] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:40:06.263009 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-882ce83c-2691-4434-bf4b-7248f2d647ee tempest-TestNetworkAdvancedServerOps-1033830903 tempest-TestNetworkAdvancedServerOps-1033830903-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:40:06.263755 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-882ce83c-2691-4434-bf4b-7248f2d647ee tempest-TestNetworkAdvancedServerOps-1033830903 tempest-TestNetworkAdvancedServerOps-1033830903-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:40:06.264197 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-882ce83c-2691-4434-bf4b-7248f2d647ee tempest-TestNetworkAdvancedServerOps-1033830903 tempest-TestNetworkAdvancedServerOps-1033830903-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:40:06.264900 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-882ce83c-2691-4434-bf4b-7248f2d647ee tempest-TestNetworkAdvancedServerOps-1033830903 tempest-TestNetworkAdvancedServerOps-1033830903-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:40:06.265355 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-882ce83c-2691-4434-bf4b-7248f2d647ee tempest-TestNetworkAdvancedServerOps-1033830903 tempest-TestNetworkAdvancedServerOps-1033830903-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:40:06.265783 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-882ce83c-2691-4434-bf4b-7248f2d647ee tempest-TestNetworkAdvancedServerOps-1033830903 tempest-TestNetworkAdvancedServerOps-1033830903-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:40:06.399706 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-882ce83c-2691-4434-bf4b-7248f2d647ee tempest-TestNetworkAdvancedServerOps-1033830903 tempest-TestNetworkAdvancedServerOps-1033830903-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/d6e33e0a-dbea-4fff-9cc8-d5a7afe5ec62" status: 200 len: 1828 microversion: 2.1 time: 0.148234 Oct 22 21:40:06.400284 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3000/6025] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:40:06 2022] GET /compute/v2.1/servers/d6e33e0a-dbea-4fff-9cc8-d5a7afe5ec62 => generated 1828 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:40:06.424091 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-79653cd7-7e1f-451f-a513-c6db416c71da tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:40:06.424722 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-79653cd7-7e1f-451f-a513-c6db416c71da tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] [instance: d6e33e0a-dbea-4fff-9cc8-d5a7afe5ec62] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:40:06.431211 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-79653cd7-7e1f-451f-a513-c6db416c71da tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:40:06.431808 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-79653cd7-7e1f-451f-a513-c6db416c71da tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:40:06.433493 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-79653cd7-7e1f-451f-a513-c6db416c71da tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:40:06.434292 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-79653cd7-7e1f-451f-a513-c6db416c71da tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:40:06.434794 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-79653cd7-7e1f-451f-a513-c6db416c71da tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:40:06.435245 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-79653cd7-7e1f-451f-a513-c6db416c71da tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:40:06.583187 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-79653cd7-7e1f-451f-a513-c6db416c71da tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce13ae25b8cc4c32a66a2bcc536a3fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f9c508b2164653997b36431bb589b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:40:06.591435 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-79653cd7-7e1f-451f-a513-c6db416c71da tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] 10.222.0.18 "GET /compute/v2.1/servers/d6e33e0a-dbea-4fff-9cc8-d5a7afe5ec62" status: 200 len: 1677 microversion: 2.1 time: 0.171367 Oct 22 21:40:06.591939 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3026/6026] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:40:06 2022] GET /compute/v2.1/servers/d6e33e0a-dbea-4fff-9cc8-d5a7afe5ec62 => generated 1677 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:40:06.693898 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-48114efa-32ad-48da-a3e6-99df8018cebc tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:40:06.696215 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-48114efa-32ad-48da-a3e6-99df8018cebc tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] [instance: d6e33e0a-dbea-4fff-9cc8-d5a7afe5ec62] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:40:06.702629 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-48114efa-32ad-48da-a3e6-99df8018cebc tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:40:06.703134 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-48114efa-32ad-48da-a3e6-99df8018cebc tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:40:06.703607 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-48114efa-32ad-48da-a3e6-99df8018cebc tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:40:06.704318 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-48114efa-32ad-48da-a3e6-99df8018cebc tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:40:06.704782 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-48114efa-32ad-48da-a3e6-99df8018cebc tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:40:06.705220 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-48114efa-32ad-48da-a3e6-99df8018cebc tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:40:06.771593 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-48114efa-32ad-48da-a3e6-99df8018cebc tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] 10.222.0.18 "POST /compute/v2.1/servers/d6e33e0a-dbea-4fff-9cc8-d5a7afe5ec62/action" status: 200 len: 38662 microversion: 2.1 time: 0.081551 Oct 22 21:40:06.772263 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3001/6027] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 21:40:06 2022] POST /compute/v2.1/servers/d6e33e0a-dbea-4fff-9cc8-d5a7afe5ec62/action => generated 38662 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 22 21:40:07.827748 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-49c0b0f8-10f6-4886-bae7-c38f97c0d4ef tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:40:07.828341 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-49c0b0f8-10f6-4886-bae7-c38f97c0d4ef tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] [instance: d6e33e0a-dbea-4fff-9cc8-d5a7afe5ec62] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:40:07.830311 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-f54426ae-386c-48e1-8af7-abb4fe84d1fa req-d7642bc2-c077-440b-9e28-dd4d22bad6a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d6e33e0a-dbea-4fff-9cc8-d5a7afe5ec62", "tag": "bba3cfae-6ea7-4b33-980e-666db653ae9a"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:40:07.836816 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-49c0b0f8-10f6-4886-bae7-c38f97c0d4ef tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:40:07.837396 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-49c0b0f8-10f6-4886-bae7-c38f97c0d4ef tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:40:07.837918 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-49c0b0f8-10f6-4886-bae7-c38f97c0d4ef tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:40:07.838709 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-49c0b0f8-10f6-4886-bae7-c38f97c0d4ef tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:40:07.839250 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-49c0b0f8-10f6-4886-bae7-c38f97c0d4ef tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:40:07.839812 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-49c0b0f8-10f6-4886-bae7-c38f97c0d4ef tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:40:07.842209 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-f54426ae-386c-48e1-8af7-abb4fe84d1fa req-d7642bc2-c077-440b-9e28-dd4d22bad6a5 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:40:07.842925 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-f54426ae-386c-48e1-8af7-abb4fe84d1fa req-d7642bc2-c077-440b-9e28-dd4d22bad6a5 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:40:07.843461 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-f54426ae-386c-48e1-8af7-abb4fe84d1fa req-d7642bc2-c077-440b-9e28-dd4d22bad6a5 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:40:07.856555 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-f54426ae-386c-48e1-8af7-abb4fe84d1fa req-d7642bc2-c077-440b-9e28-dd4d22bad6a5 service nova] Creating event network-changed:bba3cfae-6ea7-4b33-980e-666db653ae9a for instance d6e33e0a-dbea-4fff-9cc8-d5a7afe5ec62 on nch2-master-1 Oct 22 21:40:07.862016 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-f54426ae-386c-48e1-8af7-abb4fe84d1fa req-d7642bc2-c077-440b-9e28-dd4d22bad6a5 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036319 Oct 22 21:40:07.862992 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3002/6028] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:40:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:40:07.871692 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-49c0b0f8-10f6-4886-bae7-c38f97c0d4ef tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] [instance: d6e33e0a-dbea-4fff-9cc8-d5a7afe5ec62] Going to try to terminate instance {{(pid=138745) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 21:40:07.962369 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-49c0b0f8-10f6-4886-bae7-c38f97c0d4ef tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] 10.222.0.18 "DELETE /compute/v2.1/servers/d6e33e0a-dbea-4fff-9cc8-d5a7afe5ec62" status: 204 len: 0 microversion: 2.1 time: 0.138606 Oct 22 21:40:07.967427 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3027/6029] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 21:40:07 2022] DELETE /compute/v2.1/servers/d6e33e0a-dbea-4fff-9cc8-d5a7afe5ec62 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 21:40:07.973825 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-7eb20f0c-ce09-480e-8442-15f9030e37d1 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:40:07.975385 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-7eb20f0c-ce09-480e-8442-15f9030e37d1 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] [instance: d6e33e0a-dbea-4fff-9cc8-d5a7afe5ec62] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:40:07.983200 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7eb20f0c-ce09-480e-8442-15f9030e37d1 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:40:07.983713 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7eb20f0c-ce09-480e-8442-15f9030e37d1 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:40:07.984167 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7eb20f0c-ce09-480e-8442-15f9030e37d1 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:40:07.984888 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7eb20f0c-ce09-480e-8442-15f9030e37d1 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:40:07.985529 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7eb20f0c-ce09-480e-8442-15f9030e37d1 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:40:07.986136 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7eb20f0c-ce09-480e-8442-15f9030e37d1 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:40:08.150314 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-7eb20f0c-ce09-480e-8442-15f9030e37d1 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce13ae25b8cc4c32a66a2bcc536a3fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f9c508b2164653997b36431bb589b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:40:08.158240 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-7eb20f0c-ce09-480e-8442-15f9030e37d1 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] 10.222.0.18 "GET /compute/v2.1/servers/d6e33e0a-dbea-4fff-9cc8-d5a7afe5ec62" status: 200 len: 1683 microversion: 2.1 time: 0.190274 Oct 22 21:40:08.158811 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3003/6030] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:40:07 2022] GET /compute/v2.1/servers/d6e33e0a-dbea-4fff-9cc8-d5a7afe5ec62 => generated 1683 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:40:09.031719 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-3b5691ea-e424-4706-aede-df5a0401a39f req-86e45211-e8cb-4ffb-b97a-db0d571c7d61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6e33e0a-dbea-4fff-9cc8-d5a7afe5ec62", "name": "network-vif-deleted", "tag": "bba3cfae-6ea7-4b33-980e-666db653ae9a"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:40:09.043064 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-3b5691ea-e424-4706-aede-df5a0401a39f req-86e45211-e8cb-4ffb-b97a-db0d571c7d61 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:40:09.043604 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-3b5691ea-e424-4706-aede-df5a0401a39f req-86e45211-e8cb-4ffb-b97a-db0d571c7d61 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:40:09.044055 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-3b5691ea-e424-4706-aede-df5a0401a39f req-86e45211-e8cb-4ffb-b97a-db0d571c7d61 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:40:09.055262 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-3b5691ea-e424-4706-aede-df5a0401a39f req-86e45211-e8cb-4ffb-b97a-db0d571c7d61 service nova] Creating event network-vif-deleted:bba3cfae-6ea7-4b33-980e-666db653ae9a for instance d6e33e0a-dbea-4fff-9cc8-d5a7afe5ec62 on nch2-master-1 Oct 22 21:40:09.060633 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-3b5691ea-e424-4706-aede-df5a0401a39f req-86e45211-e8cb-4ffb-b97a-db0d571c7d61 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033068 Oct 22 21:40:09.061639 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3028/6031] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:40:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:40:09.182403 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-8d62bd6f-e169-4eb3-bb9d-8cb624cf1a30 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:40:09.182985 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-8d62bd6f-e169-4eb3-bb9d-8cb624cf1a30 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] [instance: d6e33e0a-dbea-4fff-9cc8-d5a7afe5ec62] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:40:09.190408 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8d62bd6f-e169-4eb3-bb9d-8cb624cf1a30 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:40:09.190905 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8d62bd6f-e169-4eb3-bb9d-8cb624cf1a30 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:40:09.191386 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8d62bd6f-e169-4eb3-bb9d-8cb624cf1a30 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:40:09.192189 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8d62bd6f-e169-4eb3-bb9d-8cb624cf1a30 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:40:09.192963 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8d62bd6f-e169-4eb3-bb9d-8cb624cf1a30 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:40:09.193438 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8d62bd6f-e169-4eb3-bb9d-8cb624cf1a30 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:40:09.227631 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8d62bd6f-e169-4eb3-bb9d-8cb624cf1a30 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:40:09.228129 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8d62bd6f-e169-4eb3-bb9d-8cb624cf1a30 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:40:09.228591 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8d62bd6f-e169-4eb3-bb9d-8cb624cf1a30 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:40:09.229042 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.objects.instance [None req-8d62bd6f-e169-4eb3-bb9d-8cb624cf1a30 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lazy-loading 'fault' on Instance uuid d6e33e0a-dbea-4fff-9cc8-d5a7afe5ec62 {{(pid=138744) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 21:40:09.275525 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-8d62bd6f-e169-4eb3-bb9d-8cb624cf1a30 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce13ae25b8cc4c32a66a2bcc536a3fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f9c508b2164653997b36431bb589b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:40:09.282928 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-8d62bd6f-e169-4eb3-bb9d-8cb624cf1a30 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] 10.222.0.18 "GET /compute/v2.1/servers/d6e33e0a-dbea-4fff-9cc8-d5a7afe5ec62" status: 200 len: 1354 microversion: 2.1 time: 0.104544 Oct 22 21:40:09.283540 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3004/6032] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:40:09 2022] GET /compute/v2.1/servers/d6e33e0a-dbea-4fff-9cc8-d5a7afe5ec62 => generated 1354 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:40:10.311276 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-cb75f7c8-7534-4940-b631-2d76675504ea tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:40:10.312272 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-cb75f7c8-7534-4940-b631-2d76675504ea tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] [instance: d6e33e0a-dbea-4fff-9cc8-d5a7afe5ec62] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:40:10.321223 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cb75f7c8-7534-4940-b631-2d76675504ea tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:40:10.321894 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cb75f7c8-7534-4940-b631-2d76675504ea tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:40:10.322471 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cb75f7c8-7534-4940-b631-2d76675504ea tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:40:10.323483 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cb75f7c8-7534-4940-b631-2d76675504ea tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:40:10.324092 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cb75f7c8-7534-4940-b631-2d76675504ea tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:40:10.324651 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cb75f7c8-7534-4940-b631-2d76675504ea tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:40:10.340959 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.wsgi [None req-cb75f7c8-7534-4940-b631-2d76675504ea tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] HTTP exception thrown: Instance d6e33e0a-dbea-4fff-9cc8-d5a7afe5ec62 could not be found. Oct 22 21:40:10.342608 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-cb75f7c8-7534-4940-b631-2d76675504ea tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Request method failure captured: Oct 22 21:40:10.342608 ncdv-master-1 devstack@n-api.service[138745]: request: GET /compute/v2.1/servers/d6e33e0a-dbea-4fff-9cc8-d5a7afe5ec62 HTTP/1.1 Oct 22 21:40:10.342608 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 21:40:10.342608 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 21:40:10.342608 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 21:40:10.342608 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 0 Oct 22 21:40:10.342608 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 21:40:10.342608 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 21:40:10.342608 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 21:40:10.342608 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 21:40:10.342608 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVGGILX10s2dIgDgVZo2IQgnPiDYDu9a3ft4OAGis05yO8BrPDQHvhvjIr_WfblUYdacpoCBNulloRKj8k-zduRl3WptOsWJtL3dswrAo60x20bp_MtWiCHhhHG9kPBkPEvIy-4T7Hm5YfPQsiEPV_Ld77h47ySD3KCZYLji1QhcSMDE Oct 22 21:40:10.342608 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 21:40:10.342608 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 21:40:10.342608 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 21:40:10.342608 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 21:40:10.342608 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 21:40:10.342608 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 21:40:10.342608 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: 42f9c508b2164653997b36431bb589b8 Oct 22 21:40:10.342608 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1810030830 Oct 22 21:40:10.342608 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 21:40:10.342608 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 21:40:10.342608 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_42f9c508b2164653997b36431bb589b8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/42f9c508b2164653997b36431bb589b8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/42f9c508b2164653997b36431bb589b8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/42f9c508b2164653997b36431bb589b8"}]}] Oct 22 21:40:10.342608 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1810030830 Oct 22 21:40:10.342608 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: 42f9c508b2164653997b36431bb589b8 Oct 22 21:40:10.342608 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1810030830 Oct 22 21:40:10.342608 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-TestNetworkAdvancedServerOps-1810030830-project Oct 22 21:40:10.342608 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 21:40:10.342608 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 21:40:10.342608 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: ce13ae25b8cc4c32a66a2bcc536a3fd6 Oct 22 21:40:10.342608 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1810030830-project Oct 22 21:40:10.342608 ncdv-master-1 devstack@n-api.service[138745]: method: > Oct 22 21:40:10.342608 ncdv-master-1 devstack@n-api.service[138745]: exception: Instance d6e33e0a-dbea-4fff-9cc8-d5a7afe5ec62 could not be found. Oct 22 21:40:10.342608 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'id': 'd6e33e0a-dbea-4fff-9cc8-d5a7afe5ec62'} Oct 22 21:40:10.342608 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:40:10.342608 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:40:10.342608 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 21:40:10.342608 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 21:40:10.342608 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 21:40:10.342608 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 21:40:10.342608 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 21:40:10.342608 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 21:40:10.342608 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 21:40:10.342608 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 21:40:10.342608 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d6e33e0a-dbea-4fff-9cc8-d5a7afe5ec62 could not be found. Oct 22 21:40:10.342608 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:40:10.342608 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:40:10.342608 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:40:10.342608 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:40:10.342608 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:40:10.342608 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:40:10.342608 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:40:10.342608 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:40:10.342608 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:40:10.342608 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:40:10.342608 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 21:40:10.342608 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 21:40:10.342608 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 21:40:10.342608 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 21:40:10.342608 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 21:40:10.342608 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:40:10.342608 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d6e33e0a-dbea-4fff-9cc8-d5a7afe5ec62 could not be found. Oct 22 21:40:10.342608 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:40:10.342608 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:40:10.347785 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:40:10.347785 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:40:10.347785 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:40:10.347785 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:40:10.347785 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:40:10.347785 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:40:10.347785 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d6e33e0a-dbea-4fff-9cc8-d5a7afe5ec62 could not be found. Oct 22 21:40:10.347785 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:40:10.347785 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-cb75f7c8-7534-4940-b631-2d76675504ea tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Returning 404 to user: Instance d6e33e0a-dbea-4fff-9cc8-d5a7afe5ec62 could not be found. {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:40:10.347785 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-cb75f7c8-7534-4940-b631-2d76675504ea tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] 10.222.0.18 "GET /compute/v2.1/servers/d6e33e0a-dbea-4fff-9cc8-d5a7afe5ec62" status: 404 len: 111 microversion: 2.1 time: 0.039708 Oct 22 21:40:10.347785 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3029/6033] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:40:10 2022] GET /compute/v2.1/servers/d6e33e0a-dbea-4fff-9cc8-d5a7afe5ec62 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 21:40:13.627414 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-70e06217-1f22-45a6-9e10-97b346385413 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Calling method '.version_select at 0x7fd3a8b26820>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:40:13.652590 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-70e06217-1f22-45a6-9e10-97b346385413 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-34623591" status: 202 len: 0 microversion: 2.1 time: 0.028185 Oct 22 21:40:13.653359 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3005/6034] 10.222.0.18 () {58 vars in 1278 bytes} [Sat Oct 22 21:40:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-34623591 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 21:40:13.683066 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-ab7c709a-a25c-4b09-b8b6-0a595b3a0549 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Action: 'create', calling method: .version_select at 0x7fd3a47860d0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-527986074", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJbEbJGx6YZ8gS45VjaE8oSiegd9BGI7kGRW+TKdWeHHBWXWAc66bYWsltaW9xk0ohJIcJriOJjS2jy0w5brB5rqy02Sorq9vqHHG0VNDvmpcdjhcU3DNVtTEIcE3l0Cwg=="}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:40:13.689690 ncdv-master-1 devstack@n-api.service[138745]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 22 21:40:13.689843 ncdv-master-1 devstack@n-api.service[138745]: Sat Oct 22 21:40:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.18) !!! Oct 22 21:40:13.707756 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-ab7c709a-a25c-4b09-b8b6-0a595b3a0549 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Getting quotas for project 42f9c508b2164653997b36431bb589b8. Resources: {'key_pairs'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 21:40:13.713718 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-ab7c709a-a25c-4b09-b8b6-0a595b3a0549 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Getting quotas for user ce13ae25b8cc4c32a66a2bcc536a3fd6 and project 42f9c508b2164653997b36431bb589b8. Resources: {'key_pairs'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 21:40:13.741468 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-ab7c709a-a25c-4b09-b8b6-0a595b3a0549 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.062361 Oct 22 21:40:13.742249 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3030/6035] 10.222.0.18 () {60 vars in 1159 bytes} [Sat Oct 22 21:40:13 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:40:19.599982 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:SELECT=69,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:40:19.604918 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-3948941d-7b8b-4920-ab91-c6c1742e6c98 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1432173524", "imageRef": "085e4478-6edc-4a69-8e08-f9831713eb65", "flavorRef": "452", "networks": [{"uuid": "1453d055-4538-4391-8f01-5f0af1327f0f"}], "key_name": "tempest-TestNetworkAdvancedServerOps-527986074", "security_groups": [{"name": "tempest-secgroup-smoke-1226768160"}]}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:40:19.730891 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.network.neutron [None req-3948941d-7b8b-4920-ab91-c6c1742e6c98 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] validate_networks() for [('1453d055-4538-4391-8f01-5f0af1327f0f', None, None, None, None, None)] {{(pid=138744) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 21:40:20.136155 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-3948941d-7b8b-4920-ab91-c6c1742e6c98 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Flavor limits 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 21:40:20.136594 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-3948941d-7b8b-4920-ab91-c6c1742e6c98 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Image limits 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 21:40:20.137079 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-3948941d-7b8b-4920-ab91-c6c1742e6c98 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Flavor pref 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 21:40:20.137498 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-3948941d-7b8b-4920-ab91-c6c1742e6c98 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Image pref 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 21:40:20.137926 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-3948941d-7b8b-4920-ab91-c6c1742e6c98 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 21:40:20.148379 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3948941d-7b8b-4920-ab91-c6c1742e6c98 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:40:20.148882 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3948941d-7b8b-4920-ab91-c6c1742e6c98 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:40:20.149333 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3948941d-7b8b-4920-ab91-c6c1742e6c98 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:40:20.150077 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3948941d-7b8b-4920-ab91-c6c1742e6c98 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:40:20.150542 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3948941d-7b8b-4920-ab91-c6c1742e6c98 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:40:20.150984 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3948941d-7b8b-4920-ab91-c6c1742e6c98 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:40:20.171249 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-3948941d-7b8b-4920-ab91-c6c1742e6c98 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Getting quotas for project 42f9c508b2164653997b36431bb589b8. Resources: {'cores', 'instances', 'ram'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 21:40:20.176975 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-3948941d-7b8b-4920-ab91-c6c1742e6c98 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Getting quotas for user ce13ae25b8cc4c32a66a2bcc536a3fd6 and project 42f9c508b2164653997b36431bb589b8. Resources: {'cores', 'instances', 'ram'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 21:40:20.178699 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_api:SELECT=42,nova_api:DELETE=1 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:40:20.193489 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-3948941d-7b8b-4920-ab91-c6c1742e6c98 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Going to run 1 instances... {{(pid=138744) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 21:40:20.195922 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-3948941d-7b8b-4920-ab91-c6c1742e6c98 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] [instance: ac2dd9d9-7ac0-45be-afc6-2ac26c42a7b4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='085e4478-6edc-4a69-8e08-f9831713eb65',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138744) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 21:40:20.248050 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-3948941d-7b8b-4920-ab91-c6c1742e6c98 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.649681 Oct 22 21:40:20.248920 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3006/6036] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Oct 22 21:40:19 2022] POST /compute/v2.1/servers => generated 406 bytes in 651 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 21:40:20.260755 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-5a291d66-5d54-46bf-bfc9-7fa8a7eccebd tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:40:20.261596 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-5a291d66-5d54-46bf-bfc9-7fa8a7eccebd tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] [instance: ac2dd9d9-7ac0-45be-afc6-2ac26c42a7b4] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:40:20.265990 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:40:20.326751 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-5a291d66-5d54-46bf-bfc9-7fa8a7eccebd tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce13ae25b8cc4c32a66a2bcc536a3fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f9c508b2164653997b36431bb589b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:40:20.333718 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:40:20.335686 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-5a291d66-5d54-46bf-bfc9-7fa8a7eccebd tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] 10.222.0.18 "GET /compute/v2.1/servers/ac2dd9d9-7ac0-45be-afc6-2ac26c42a7b4" status: 200 len: 1266 microversion: 2.1 time: 0.079253 Oct 22 21:40:20.336505 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3031/6037] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:40:20 2022] GET /compute/v2.1/servers/ac2dd9d9-7ac0-45be-afc6-2ac26c42a7b4 => generated 1266 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:40:21.359879 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-b9f7578c-d6e7-4797-9d95-856056003eb2 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:40:21.361200 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-b9f7578c-d6e7-4797-9d95-856056003eb2 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] [instance: ac2dd9d9-7ac0-45be-afc6-2ac26c42a7b4] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:40:21.368999 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b9f7578c-d6e7-4797-9d95-856056003eb2 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:40:21.369878 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b9f7578c-d6e7-4797-9d95-856056003eb2 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:40:21.370552 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b9f7578c-d6e7-4797-9d95-856056003eb2 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:40:21.371510 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b9f7578c-d6e7-4797-9d95-856056003eb2 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:40:21.372175 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b9f7578c-d6e7-4797-9d95-856056003eb2 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:40:21.372930 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b9f7578c-d6e7-4797-9d95-856056003eb2 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:40:21.457316 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-b9f7578c-d6e7-4797-9d95-856056003eb2 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce13ae25b8cc4c32a66a2bcc536a3fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f9c508b2164653997b36431bb589b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:40:21.465662 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-b9f7578c-d6e7-4797-9d95-856056003eb2 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] 10.222.0.18 "GET /compute/v2.1/servers/ac2dd9d9-7ac0-45be-afc6-2ac26c42a7b4" status: 200 len: 1336 microversion: 2.1 time: 0.109788 Oct 22 21:40:21.466964 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3007/6038] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:40:21 2022] GET /compute/v2.1/servers/ac2dd9d9-7ac0-45be-afc6-2ac26c42a7b4 => generated 1336 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:40:22.491028 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-edb658d0-53c5-49c4-b45c-84fe88fb36a4 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:40:22.492455 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-edb658d0-53c5-49c4-b45c-84fe88fb36a4 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] [instance: ac2dd9d9-7ac0-45be-afc6-2ac26c42a7b4] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:40:22.506264 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-edb658d0-53c5-49c4-b45c-84fe88fb36a4 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:40:22.507089 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-edb658d0-53c5-49c4-b45c-84fe88fb36a4 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:40:22.508201 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-edb658d0-53c5-49c4-b45c-84fe88fb36a4 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:40:22.509300 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-edb658d0-53c5-49c4-b45c-84fe88fb36a4 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:40:22.509776 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-edb658d0-53c5-49c4-b45c-84fe88fb36a4 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:40:22.510397 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-edb658d0-53c5-49c4-b45c-84fe88fb36a4 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:40:22.772623 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-edb658d0-53c5-49c4-b45c-84fe88fb36a4 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce13ae25b8cc4c32a66a2bcc536a3fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f9c508b2164653997b36431bb589b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:40:22.780926 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-edb658d0-53c5-49c4-b45c-84fe88fb36a4 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] 10.222.0.18 "GET /compute/v2.1/servers/ac2dd9d9-7ac0-45be-afc6-2ac26c42a7b4" status: 200 len: 1392 microversion: 2.1 time: 0.294448 Oct 22 21:40:22.781374 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3032/6039] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:40:22 2022] GET /compute/v2.1/servers/ac2dd9d9-7ac0-45be-afc6-2ac26c42a7b4 => generated 1392 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:40:22.925631 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-58a827d7-fe4d-4d15-87b4-5a3e748f9eb4 req-711270e5-0675-4281-8ca0-2cb56c268571 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac2dd9d9-7ac0-45be-afc6-2ac26c42a7b4", "tag": "fafcf8de-27d1-4d6c-aeb1-4b2604664d68"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:40:22.937246 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-58a827d7-fe4d-4d15-87b4-5a3e748f9eb4 req-711270e5-0675-4281-8ca0-2cb56c268571 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:40:22.937725 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-58a827d7-fe4d-4d15-87b4-5a3e748f9eb4 req-711270e5-0675-4281-8ca0-2cb56c268571 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:40:22.938163 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-58a827d7-fe4d-4d15-87b4-5a3e748f9eb4 req-711270e5-0675-4281-8ca0-2cb56c268571 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:40:22.951423 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-58a827d7-fe4d-4d15-87b4-5a3e748f9eb4 req-711270e5-0675-4281-8ca0-2cb56c268571 service nova] Creating event network-changed:fafcf8de-27d1-4d6c-aeb1-4b2604664d68 for instance ac2dd9d9-7ac0-45be-afc6-2ac26c42a7b4 on nch1-master-1 Oct 22 21:40:22.956568 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-58a827d7-fe4d-4d15-87b4-5a3e748f9eb4 req-711270e5-0675-4281-8ca0-2cb56c268571 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034857 Oct 22 21:40:22.957252 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3008/6040] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:40:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 21:40:23.809888 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-f924d1f0-0d44-4c2e-9d29-20529c3a512f tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:40:23.810981 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-f924d1f0-0d44-4c2e-9d29-20529c3a512f tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] [instance: ac2dd9d9-7ac0-45be-afc6-2ac26c42a7b4] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:40:23.821241 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f924d1f0-0d44-4c2e-9d29-20529c3a512f tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:40:23.821742 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f924d1f0-0d44-4c2e-9d29-20529c3a512f tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:40:23.822221 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f924d1f0-0d44-4c2e-9d29-20529c3a512f tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:40:23.822942 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f924d1f0-0d44-4c2e-9d29-20529c3a512f tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:40:23.823449 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f924d1f0-0d44-4c2e-9d29-20529c3a512f tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:40:23.823900 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f924d1f0-0d44-4c2e-9d29-20529c3a512f tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:40:23.965802 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-f924d1f0-0d44-4c2e-9d29-20529c3a512f tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce13ae25b8cc4c32a66a2bcc536a3fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f9c508b2164653997b36431bb589b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:40:23.976142 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-f924d1f0-0d44-4c2e-9d29-20529c3a512f tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] 10.222.0.18 "GET /compute/v2.1/servers/ac2dd9d9-7ac0-45be-afc6-2ac26c42a7b4" status: 200 len: 1392 microversion: 2.1 time: 0.173501 Oct 22 21:40:23.976884 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3033/6041] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:40:23 2022] GET /compute/v2.1/servers/ac2dd9d9-7ac0-45be-afc6-2ac26c42a7b4 => generated 1392 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:40:25.005620 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-7f099fad-2074-4e99-a66b-8e48a457cccb tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:40:25.006343 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-7f099fad-2074-4e99-a66b-8e48a457cccb tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] [instance: ac2dd9d9-7ac0-45be-afc6-2ac26c42a7b4] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:40:25.013025 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7f099fad-2074-4e99-a66b-8e48a457cccb tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:40:25.013550 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7f099fad-2074-4e99-a66b-8e48a457cccb tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:40:25.014000 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7f099fad-2074-4e99-a66b-8e48a457cccb tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:40:25.014704 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7f099fad-2074-4e99-a66b-8e48a457cccb tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:40:25.015181 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7f099fad-2074-4e99-a66b-8e48a457cccb tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:40:25.015627 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7f099fad-2074-4e99-a66b-8e48a457cccb tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:40:25.154223 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-7f099fad-2074-4e99-a66b-8e48a457cccb tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce13ae25b8cc4c32a66a2bcc536a3fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f9c508b2164653997b36431bb589b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:40:25.162252 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-7f099fad-2074-4e99-a66b-8e48a457cccb tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] 10.222.0.18 "GET /compute/v2.1/servers/ac2dd9d9-7ac0-45be-afc6-2ac26c42a7b4" status: 200 len: 1392 microversion: 2.1 time: 0.161876 Oct 22 21:40:25.162834 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3009/6042] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:40:24 2022] GET /compute/v2.1/servers/ac2dd9d9-7ac0-45be-afc6-2ac26c42a7b4 => generated 1392 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:40:26.187309 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-17519ea5-0caa-4af5-bdf0-6333c5573518 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:40:26.188199 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-17519ea5-0caa-4af5-bdf0-6333c5573518 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] [instance: ac2dd9d9-7ac0-45be-afc6-2ac26c42a7b4] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:40:26.197807 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-17519ea5-0caa-4af5-bdf0-6333c5573518 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:40:26.198469 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-17519ea5-0caa-4af5-bdf0-6333c5573518 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:40:26.199067 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-17519ea5-0caa-4af5-bdf0-6333c5573518 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:40:26.200079 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-17519ea5-0caa-4af5-bdf0-6333c5573518 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:40:26.200715 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-17519ea5-0caa-4af5-bdf0-6333c5573518 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:40:26.201304 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-17519ea5-0caa-4af5-bdf0-6333c5573518 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:40:26.350734 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-17519ea5-0caa-4af5-bdf0-6333c5573518 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce13ae25b8cc4c32a66a2bcc536a3fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f9c508b2164653997b36431bb589b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:40:26.363277 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-17519ea5-0caa-4af5-bdf0-6333c5573518 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] 10.222.0.18 "GET /compute/v2.1/servers/ac2dd9d9-7ac0-45be-afc6-2ac26c42a7b4" status: 200 len: 1392 microversion: 2.1 time: 0.181039 Oct 22 21:40:26.364189 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3034/6043] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:40:26 2022] GET /compute/v2.1/servers/ac2dd9d9-7ac0-45be-afc6-2ac26c42a7b4 => generated 1392 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:40:27.389696 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-341f0fc2-62e6-48cc-ab12-2e5332a071e3 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:40:27.390466 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-341f0fc2-62e6-48cc-ab12-2e5332a071e3 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] [instance: ac2dd9d9-7ac0-45be-afc6-2ac26c42a7b4] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:40:27.401126 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-341f0fc2-62e6-48cc-ab12-2e5332a071e3 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:40:27.401884 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-341f0fc2-62e6-48cc-ab12-2e5332a071e3 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:40:27.402531 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-341f0fc2-62e6-48cc-ab12-2e5332a071e3 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:40:27.403591 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-341f0fc2-62e6-48cc-ab12-2e5332a071e3 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:40:27.404260 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-341f0fc2-62e6-48cc-ab12-2e5332a071e3 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:40:27.404889 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-341f0fc2-62e6-48cc-ab12-2e5332a071e3 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:40:27.545613 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-341f0fc2-62e6-48cc-ab12-2e5332a071e3 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce13ae25b8cc4c32a66a2bcc536a3fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f9c508b2164653997b36431bb589b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:40:27.557651 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-341f0fc2-62e6-48cc-ab12-2e5332a071e3 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] 10.222.0.18 "GET /compute/v2.1/servers/ac2dd9d9-7ac0-45be-afc6-2ac26c42a7b4" status: 200 len: 1392 microversion: 2.1 time: 0.173661 Oct 22 21:40:27.558405 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3010/6044] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:40:27 2022] GET /compute/v2.1/servers/ac2dd9d9-7ac0-45be-afc6-2ac26c42a7b4 => generated 1392 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:40:28.584959 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-c4eda684-1e13-4bed-b868-076906daa6ac tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:40:28.585922 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-c4eda684-1e13-4bed-b868-076906daa6ac tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] [instance: ac2dd9d9-7ac0-45be-afc6-2ac26c42a7b4] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:40:28.593821 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c4eda684-1e13-4bed-b868-076906daa6ac tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:40:28.594316 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c4eda684-1e13-4bed-b868-076906daa6ac tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:40:28.594767 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c4eda684-1e13-4bed-b868-076906daa6ac tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:40:28.595864 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c4eda684-1e13-4bed-b868-076906daa6ac tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:40:28.596367 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c4eda684-1e13-4bed-b868-076906daa6ac tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:40:28.596807 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c4eda684-1e13-4bed-b868-076906daa6ac tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:40:28.737535 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-c4eda684-1e13-4bed-b868-076906daa6ac tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce13ae25b8cc4c32a66a2bcc536a3fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f9c508b2164653997b36431bb589b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:40:28.746039 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-c4eda684-1e13-4bed-b868-076906daa6ac tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] 10.222.0.18 "GET /compute/v2.1/servers/ac2dd9d9-7ac0-45be-afc6-2ac26c42a7b4" status: 200 len: 1392 microversion: 2.1 time: 0.167204 Oct 22 21:40:28.746630 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3035/6045] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:40:28 2022] GET /compute/v2.1/servers/ac2dd9d9-7ac0-45be-afc6-2ac26c42a7b4 => generated 1392 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:40:29.770258 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-cb8f8425-133b-4921-b984-23ff8a75ee3d tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:40:29.770909 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-cb8f8425-133b-4921-b984-23ff8a75ee3d tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] [instance: ac2dd9d9-7ac0-45be-afc6-2ac26c42a7b4] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:40:29.778952 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cb8f8425-133b-4921-b984-23ff8a75ee3d tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:40:29.779474 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cb8f8425-133b-4921-b984-23ff8a75ee3d tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:40:29.780180 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cb8f8425-133b-4921-b984-23ff8a75ee3d tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:40:29.780978 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cb8f8425-133b-4921-b984-23ff8a75ee3d tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:40:29.781443 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cb8f8425-133b-4921-b984-23ff8a75ee3d tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:40:29.781980 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cb8f8425-133b-4921-b984-23ff8a75ee3d tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:40:29.797644 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-4257d126-893c-4c3f-acf3-9ed8b2fd242a req-d3764923-1a36-42d6-bad2-947bc4b9e004 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac2dd9d9-7ac0-45be-afc6-2ac26c42a7b4", "name": "network-vif-plugged", "status": "completed", "tag": "fafcf8de-27d1-4d6c-aeb1-4b2604664d68"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:40:29.810177 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-4257d126-893c-4c3f-acf3-9ed8b2fd242a req-d3764923-1a36-42d6-bad2-947bc4b9e004 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:40:29.811066 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-4257d126-893c-4c3f-acf3-9ed8b2fd242a req-d3764923-1a36-42d6-bad2-947bc4b9e004 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:40:29.811066 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-4257d126-893c-4c3f-acf3-9ed8b2fd242a req-d3764923-1a36-42d6-bad2-947bc4b9e004 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:40:29.824216 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-4257d126-893c-4c3f-acf3-9ed8b2fd242a req-d3764923-1a36-42d6-bad2-947bc4b9e004 service nova] Creating event network-vif-plugged:fafcf8de-27d1-4d6c-aeb1-4b2604664d68 for instance ac2dd9d9-7ac0-45be-afc6-2ac26c42a7b4 on nch1-master-1 Oct 22 21:40:29.831301 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-4257d126-893c-4c3f-acf3-9ed8b2fd242a req-d3764923-1a36-42d6-bad2-947bc4b9e004 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036133 Oct 22 21:40:29.831301 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3036/6046] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:40:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:40:29.951997 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-cb8f8425-133b-4921-b984-23ff8a75ee3d tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce13ae25b8cc4c32a66a2bcc536a3fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f9c508b2164653997b36431bb589b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:40:29.962132 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-cb8f8425-133b-4921-b984-23ff8a75ee3d tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] 10.222.0.18 "GET /compute/v2.1/servers/ac2dd9d9-7ac0-45be-afc6-2ac26c42a7b4" status: 200 len: 1392 microversion: 2.1 time: 0.196233 Oct 22 21:40:29.962718 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3011/6047] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:40:29 2022] GET /compute/v2.1/servers/ac2dd9d9-7ac0-45be-afc6-2ac26c42a7b4 => generated 1392 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:40:30.985295 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell0:SELECT=6 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:40:30.992022 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-61afa9c6-f9f5-44b5-be4e-7e1bf7809cfd tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:40:30.993128 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-61afa9c6-f9f5-44b5-be4e-7e1bf7809cfd tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] [instance: ac2dd9d9-7ac0-45be-afc6-2ac26c42a7b4] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:40:30.999865 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-61afa9c6-f9f5-44b5-be4e-7e1bf7809cfd tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:40:31.000368 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-61afa9c6-f9f5-44b5-be4e-7e1bf7809cfd tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:40:31.000831 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-61afa9c6-f9f5-44b5-be4e-7e1bf7809cfd tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:40:31.001545 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-61afa9c6-f9f5-44b5-be4e-7e1bf7809cfd tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:40:31.002021 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-61afa9c6-f9f5-44b5-be4e-7e1bf7809cfd tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:40:31.002466 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-61afa9c6-f9f5-44b5-be4e-7e1bf7809cfd tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:40:31.145571 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-61afa9c6-f9f5-44b5-be4e-7e1bf7809cfd tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce13ae25b8cc4c32a66a2bcc536a3fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f9c508b2164653997b36431bb589b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:40:31.156845 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-61afa9c6-f9f5-44b5-be4e-7e1bf7809cfd tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] 10.222.0.18 "GET /compute/v2.1/servers/ac2dd9d9-7ac0-45be-afc6-2ac26c42a7b4" status: 200 len: 1392 microversion: 2.1 time: 0.172988 Oct 22 21:40:31.157429 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3037/6048] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:40:30 2022] GET /compute/v2.1/servers/ac2dd9d9-7ac0-45be-afc6-2ac26c42a7b4 => generated 1392 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:40:32.181905 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-6fc49038-be23-4983-9cbf-1f05b138eeed tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:40:32.182555 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-6fc49038-be23-4983-9cbf-1f05b138eeed tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] [instance: ac2dd9d9-7ac0-45be-afc6-2ac26c42a7b4] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:40:32.184595 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell0:SELECT=2 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:40:32.185278 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell0:SELECT=6 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:40:32.191946 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6fc49038-be23-4983-9cbf-1f05b138eeed tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:40:32.192441 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6fc49038-be23-4983-9cbf-1f05b138eeed tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:40:32.192884 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6fc49038-be23-4983-9cbf-1f05b138eeed tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:40:32.193591 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6fc49038-be23-4983-9cbf-1f05b138eeed tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:40:32.194050 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6fc49038-be23-4983-9cbf-1f05b138eeed tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:40:32.194487 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6fc49038-be23-4983-9cbf-1f05b138eeed tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:40:32.328554 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-6fc49038-be23-4983-9cbf-1f05b138eeed tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce13ae25b8cc4c32a66a2bcc536a3fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f9c508b2164653997b36431bb589b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:40:32.336922 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-6fc49038-be23-4983-9cbf-1f05b138eeed tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] 10.222.0.18 "GET /compute/v2.1/servers/ac2dd9d9-7ac0-45be-afc6-2ac26c42a7b4" status: 200 len: 1563 microversion: 2.1 time: 0.159915 Oct 22 21:40:32.337506 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3012/6049] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:40:32 2022] GET /compute/v2.1/servers/ac2dd9d9-7ac0-45be-afc6-2ac26c42a7b4 => generated 1563 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:40:32.359801 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-00a7dfcf-a803-4657-abf8-535a11f1f8b2 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:40:32.360433 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-00a7dfcf-a803-4657-abf8-535a11f1f8b2 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] [instance: ac2dd9d9-7ac0-45be-afc6-2ac26c42a7b4] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:40:32.367970 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-00a7dfcf-a803-4657-abf8-535a11f1f8b2 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:40:32.368470 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-00a7dfcf-a803-4657-abf8-535a11f1f8b2 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:40:32.368922 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-00a7dfcf-a803-4657-abf8-535a11f1f8b2 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:40:32.369633 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-00a7dfcf-a803-4657-abf8-535a11f1f8b2 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:40:32.370104 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-00a7dfcf-a803-4657-abf8-535a11f1f8b2 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:40:32.370545 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-00a7dfcf-a803-4657-abf8-535a11f1f8b2 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:40:32.514493 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-00a7dfcf-a803-4657-abf8-535a11f1f8b2 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce13ae25b8cc4c32a66a2bcc536a3fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f9c508b2164653997b36431bb589b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:40:32.526471 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-00a7dfcf-a803-4657-abf8-535a11f1f8b2 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] 10.222.0.18 "GET /compute/v2.1/servers/ac2dd9d9-7ac0-45be-afc6-2ac26c42a7b4" status: 200 len: 1563 microversion: 2.1 time: 0.170418 Oct 22 21:40:32.527253 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3038/6050] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:40:32 2022] GET /compute/v2.1/servers/ac2dd9d9-7ac0-45be-afc6-2ac26c42a7b4 => generated 1563 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:40:34.150396 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-88d1ba55-5578-46ba-ba31-0812ec2ff514 req-bb227ae8-d912-4e19-9219-8910e2720a0e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac2dd9d9-7ac0-45be-afc6-2ac26c42a7b4", "tag": "fafcf8de-27d1-4d6c-aeb1-4b2604664d68"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:40:34.153344 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-64cea568-ff6e-4b72-a3f6-6c60c6f30d58 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:40:34.160739 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-64cea568-ff6e-4b72-a3f6-6c60c6f30d58 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] [instance: ac2dd9d9-7ac0-45be-afc6-2ac26c42a7b4] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:40:34.168061 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-64cea568-ff6e-4b72-a3f6-6c60c6f30d58 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:40:34.168654 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-64cea568-ff6e-4b72-a3f6-6c60c6f30d58 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:40:34.169164 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-64cea568-ff6e-4b72-a3f6-6c60c6f30d58 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:40:34.169955 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-64cea568-ff6e-4b72-a3f6-6c60c6f30d58 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:40:34.170124 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-88d1ba55-5578-46ba-ba31-0812ec2ff514 req-bb227ae8-d912-4e19-9219-8910e2720a0e service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:40:34.170552 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-64cea568-ff6e-4b72-a3f6-6c60c6f30d58 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:40:34.170678 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-88d1ba55-5578-46ba-ba31-0812ec2ff514 req-bb227ae8-d912-4e19-9219-8910e2720a0e service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:40:34.171063 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-88d1ba55-5578-46ba-ba31-0812ec2ff514 req-bb227ae8-d912-4e19-9219-8910e2720a0e service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:40:34.171192 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-64cea568-ff6e-4b72-a3f6-6c60c6f30d58 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:40:34.184389 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-88d1ba55-5578-46ba-ba31-0812ec2ff514 req-bb227ae8-d912-4e19-9219-8910e2720a0e service nova] Creating event network-changed:fafcf8de-27d1-4d6c-aeb1-4b2604664d68 for instance ac2dd9d9-7ac0-45be-afc6-2ac26c42a7b4 on nch1-master-1 Oct 22 21:40:34.189782 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-88d1ba55-5578-46ba-ba31-0812ec2ff514 req-bb227ae8-d912-4e19-9219-8910e2720a0e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043285 Oct 22 21:40:34.190394 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3039/6051] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:40:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:40:34.396658 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-64cea568-ff6e-4b72-a3f6-6c60c6f30d58 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce13ae25b8cc4c32a66a2bcc536a3fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f9c508b2164653997b36431bb589b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:40:34.409730 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-64cea568-ff6e-4b72-a3f6-6c60c6f30d58 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] 10.222.0.18 "GET /compute/v2.1/servers/ac2dd9d9-7ac0-45be-afc6-2ac26c42a7b4" status: 200 len: 1563 microversion: 2.1 time: 0.266744 Oct 22 21:40:34.410798 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3013/6052] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:40:34 2022] GET /compute/v2.1/servers/ac2dd9d9-7ac0-45be-afc6-2ac26c42a7b4 => generated 1563 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:41:05.746658 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_api:SELECT=19 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:41:05.747540 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell1:SELECT=40 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:41:05.752256 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-80643220-7658-4af6-aee8-87668d48f23c tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:41:05.754791 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-80643220-7658-4af6-aee8-87668d48f23c tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] [instance: ac2dd9d9-7ac0-45be-afc6-2ac26c42a7b4] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:41:05.762503 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-80643220-7658-4af6-aee8-87668d48f23c tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:41:05.763040 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-80643220-7658-4af6-aee8-87668d48f23c tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:41:05.763532 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-80643220-7658-4af6-aee8-87668d48f23c tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:41:05.764232 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-80643220-7658-4af6-aee8-87668d48f23c tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:41:05.764705 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-80643220-7658-4af6-aee8-87668d48f23c tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:41:05.765149 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-80643220-7658-4af6-aee8-87668d48f23c tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:41:05.818454 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-80643220-7658-4af6-aee8-87668d48f23c tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] 10.222.0.18 "POST /compute/v2.1/servers/ac2dd9d9-7ac0-45be-afc6-2ac26c42a7b4/action" status: 200 len: 24567 microversion: 2.1 time: 0.074058 Oct 22 21:41:05.819186 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3040/6053] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 21:41:05 2022] POST /compute/v2.1/servers/ac2dd9d9-7ac0-45be-afc6-2ac26c42a7b4/action => generated 24567 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 22 21:41:36.196796 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_api:SELECT=18,nova_api:INSERT=3 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:41:36.198044 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:SELECT=40 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:41:36.205289 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-a1629ef2-cec2-49f8-a446-81942cbfa2ce tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "085e4478-6edc-4a69-8e08-f9831713eb65"}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:41:36.208159 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-a1629ef2-cec2-49f8-a446-81942cbfa2ce tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] [instance: ac2dd9d9-7ac0-45be-afc6-2ac26c42a7b4] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:41:36.215931 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a1629ef2-cec2-49f8-a446-81942cbfa2ce tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:41:36.216422 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a1629ef2-cec2-49f8-a446-81942cbfa2ce tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:41:36.216865 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a1629ef2-cec2-49f8-a446-81942cbfa2ce tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:41:36.217564 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a1629ef2-cec2-49f8-a446-81942cbfa2ce tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:41:36.218024 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a1629ef2-cec2-49f8-a446-81942cbfa2ce tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:41:36.218458 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a1629ef2-cec2-49f8-a446-81942cbfa2ce tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:41:36.307177 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-a1629ef2-cec2-49f8-a446-81942cbfa2ce tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Flavor limits 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 21:41:36.307643 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-a1629ef2-cec2-49f8-a446-81942cbfa2ce tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Image limits 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 21:41:36.308131 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-a1629ef2-cec2-49f8-a446-81942cbfa2ce tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Flavor pref 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 21:41:36.308554 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-a1629ef2-cec2-49f8-a446-81942cbfa2ce tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Image pref 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 21:41:36.308979 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-a1629ef2-cec2-49f8-a446-81942cbfa2ce tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 21:41:36.373645 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-a1629ef2-cec2-49f8-a446-81942cbfa2ce tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] [instance: ac2dd9d9-7ac0-45be-afc6-2ac26c42a7b4] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:41:36.379601 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a1629ef2-cec2-49f8-a446-81942cbfa2ce tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:41:36.380093 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a1629ef2-cec2-49f8-a446-81942cbfa2ce tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:41:36.380544 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a1629ef2-cec2-49f8-a446-81942cbfa2ce tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:41:36.381257 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a1629ef2-cec2-49f8-a446-81942cbfa2ce tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:41:36.381720 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a1629ef2-cec2-49f8-a446-81942cbfa2ce tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:41:36.382164 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a1629ef2-cec2-49f8-a446-81942cbfa2ce tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:41:36.413179 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-a1629ef2-cec2-49f8-a446-81942cbfa2ce tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] 10.222.0.18 "POST /compute/v2.1/servers/ac2dd9d9-7ac0-45be-afc6-2ac26c42a7b4/action" status: 202 len: 1137 microversion: 2.1 time: 0.219796 Oct 22 21:41:36.415772 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3014/6054] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 21:41:36 2022] POST /compute/v2.1/servers/ac2dd9d9-7ac0-45be-afc6-2ac26c42a7b4/action => generated 1137 bytes in 222 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 22 21:41:36.434468 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-03e8679b-2691-4c0f-991b-055ec2e17b45 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:41:36.435175 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-03e8679b-2691-4c0f-991b-055ec2e17b45 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] [instance: ac2dd9d9-7ac0-45be-afc6-2ac26c42a7b4] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:41:36.439276 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_api:SELECT=2 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:41:36.440322 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell1:SELECT=4 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:41:36.444693 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-03e8679b-2691-4c0f-991b-055ec2e17b45 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:41:36.445198 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-03e8679b-2691-4c0f-991b-055ec2e17b45 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:41:36.445692 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-03e8679b-2691-4c0f-991b-055ec2e17b45 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:41:36.446379 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-03e8679b-2691-4c0f-991b-055ec2e17b45 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:41:36.446902 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-03e8679b-2691-4c0f-991b-055ec2e17b45 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:41:36.447298 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-03e8679b-2691-4c0f-991b-055ec2e17b45 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:41:36.585013 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-03e8679b-2691-4c0f-991b-055ec2e17b45 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce13ae25b8cc4c32a66a2bcc536a3fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f9c508b2164653997b36431bb589b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:41:36.593343 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-03e8679b-2691-4c0f-991b-055ec2e17b45 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] 10.222.0.18 "GET /compute/v2.1/servers/ac2dd9d9-7ac0-45be-afc6-2ac26c42a7b4" status: 200 len: 1691 microversion: 2.1 time: 0.163081 Oct 22 21:41:36.593913 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3041/6055] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:41:36 2022] GET /compute/v2.1/servers/ac2dd9d9-7ac0-45be-afc6-2ac26c42a7b4 => generated 1691 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:41:37.619154 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-3a636630-151a-43a2-9b30-23d401e45d85 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:41:37.619824 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-3a636630-151a-43a2-9b30-23d401e45d85 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] [instance: ac2dd9d9-7ac0-45be-afc6-2ac26c42a7b4] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:41:37.627913 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3a636630-151a-43a2-9b30-23d401e45d85 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:41:37.628385 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3a636630-151a-43a2-9b30-23d401e45d85 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:41:37.628985 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3a636630-151a-43a2-9b30-23d401e45d85 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:41:37.629727 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3a636630-151a-43a2-9b30-23d401e45d85 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:41:37.630218 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3a636630-151a-43a2-9b30-23d401e45d85 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:41:37.630678 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3a636630-151a-43a2-9b30-23d401e45d85 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:41:37.776462 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-3a636630-151a-43a2-9b30-23d401e45d85 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce13ae25b8cc4c32a66a2bcc536a3fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f9c508b2164653997b36431bb589b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:41:37.784786 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-3a636630-151a-43a2-9b30-23d401e45d85 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] 10.222.0.18 "GET /compute/v2.1/servers/ac2dd9d9-7ac0-45be-afc6-2ac26c42a7b4" status: 200 len: 1691 microversion: 2.1 time: 0.170087 Oct 22 21:41:37.785438 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3015/6056] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:41:37 2022] GET /compute/v2.1/servers/ac2dd9d9-7ac0-45be-afc6-2ac26c42a7b4 => generated 1691 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:41:38.808085 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-64447b4c-7b0a-4187-86b2-8a83d7551bbe tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:41:38.808657 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-64447b4c-7b0a-4187-86b2-8a83d7551bbe tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] [instance: ac2dd9d9-7ac0-45be-afc6-2ac26c42a7b4] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:41:38.816928 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-64447b4c-7b0a-4187-86b2-8a83d7551bbe tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:41:38.817432 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-64447b4c-7b0a-4187-86b2-8a83d7551bbe tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:41:38.817893 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-64447b4c-7b0a-4187-86b2-8a83d7551bbe tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:41:38.818609 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-64447b4c-7b0a-4187-86b2-8a83d7551bbe tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:41:38.819081 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-64447b4c-7b0a-4187-86b2-8a83d7551bbe tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:41:38.819644 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-64447b4c-7b0a-4187-86b2-8a83d7551bbe tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:41:38.962531 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-64447b4c-7b0a-4187-86b2-8a83d7551bbe tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce13ae25b8cc4c32a66a2bcc536a3fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f9c508b2164653997b36431bb589b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:41:38.971127 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-64447b4c-7b0a-4187-86b2-8a83d7551bbe tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] 10.222.0.18 "GET /compute/v2.1/servers/ac2dd9d9-7ac0-45be-afc6-2ac26c42a7b4" status: 200 len: 1691 microversion: 2.1 time: 0.167227 Oct 22 21:41:38.971721 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3042/6057] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:41:38 2022] GET /compute/v2.1/servers/ac2dd9d9-7ac0-45be-afc6-2ac26c42a7b4 => generated 1691 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:41:39.999127 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-71e46b20-1868-48e3-9a90-f26e704c124e tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:41:40.000150 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-71e46b20-1868-48e3-9a90-f26e704c124e tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] [instance: ac2dd9d9-7ac0-45be-afc6-2ac26c42a7b4] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:41:40.011204 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-71e46b20-1868-48e3-9a90-f26e704c124e tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:41:40.012016 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-71e46b20-1868-48e3-9a90-f26e704c124e tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:41:40.012711 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-71e46b20-1868-48e3-9a90-f26e704c124e tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:41:40.013790 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-71e46b20-1868-48e3-9a90-f26e704c124e tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:41:40.014522 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-71e46b20-1868-48e3-9a90-f26e704c124e tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:41:40.015200 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-71e46b20-1868-48e3-9a90-f26e704c124e tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:41:40.159621 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-71e46b20-1868-48e3-9a90-f26e704c124e tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce13ae25b8cc4c32a66a2bcc536a3fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f9c508b2164653997b36431bb589b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:41:40.168254 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-71e46b20-1868-48e3-9a90-f26e704c124e tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] 10.222.0.18 "GET /compute/v2.1/servers/ac2dd9d9-7ac0-45be-afc6-2ac26c42a7b4" status: 200 len: 1691 microversion: 2.1 time: 0.175256 Oct 22 21:41:40.168835 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3016/6058] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:41:39 2022] GET /compute/v2.1/servers/ac2dd9d9-7ac0-45be-afc6-2ac26c42a7b4 => generated 1691 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:41:41.196840 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-47dc88ca-99ad-4214-86b9-c4e07eecce32 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:41:41.197870 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-47dc88ca-99ad-4214-86b9-c4e07eecce32 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] [instance: ac2dd9d9-7ac0-45be-afc6-2ac26c42a7b4] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:41:41.208854 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-47dc88ca-99ad-4214-86b9-c4e07eecce32 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:41:41.209395 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-47dc88ca-99ad-4214-86b9-c4e07eecce32 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:41:41.209850 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-47dc88ca-99ad-4214-86b9-c4e07eecce32 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:41:41.210602 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-47dc88ca-99ad-4214-86b9-c4e07eecce32 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:41:41.211074 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-47dc88ca-99ad-4214-86b9-c4e07eecce32 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:41:41.211561 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-47dc88ca-99ad-4214-86b9-c4e07eecce32 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:41:41.363410 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-47dc88ca-99ad-4214-86b9-c4e07eecce32 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce13ae25b8cc4c32a66a2bcc536a3fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f9c508b2164653997b36431bb589b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:41:41.372129 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-47dc88ca-99ad-4214-86b9-c4e07eecce32 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] 10.222.0.18 "GET /compute/v2.1/servers/ac2dd9d9-7ac0-45be-afc6-2ac26c42a7b4" status: 200 len: 1691 microversion: 2.1 time: 0.182136 Oct 22 21:41:41.372688 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3043/6059] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:41:41 2022] GET /compute/v2.1/servers/ac2dd9d9-7ac0-45be-afc6-2ac26c42a7b4 => generated 1691 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:41:42.400063 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-7a3a453e-d0de-4609-b458-dc851049635e tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:41:42.401128 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-7a3a453e-d0de-4609-b458-dc851049635e tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] [instance: ac2dd9d9-7ac0-45be-afc6-2ac26c42a7b4] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:41:42.412227 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7a3a453e-d0de-4609-b458-dc851049635e tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:41:42.412696 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7a3a453e-d0de-4609-b458-dc851049635e tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:41:42.413139 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7a3a453e-d0de-4609-b458-dc851049635e tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:41:42.413861 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7a3a453e-d0de-4609-b458-dc851049635e tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:41:42.414319 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7a3a453e-d0de-4609-b458-dc851049635e tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:41:42.414753 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7a3a453e-d0de-4609-b458-dc851049635e tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:41:42.554979 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-7a3a453e-d0de-4609-b458-dc851049635e tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce13ae25b8cc4c32a66a2bcc536a3fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f9c508b2164653997b36431bb589b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:41:42.563239 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-7a3a453e-d0de-4609-b458-dc851049635e tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] 10.222.0.18 "GET /compute/v2.1/servers/ac2dd9d9-7ac0-45be-afc6-2ac26c42a7b4" status: 200 len: 1691 microversion: 2.1 time: 0.169986 Oct 22 21:41:42.564072 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3017/6060] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:41:42 2022] GET /compute/v2.1/servers/ac2dd9d9-7ac0-45be-afc6-2ac26c42a7b4 => generated 1691 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:41:43.588061 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-d16113a9-38f7-4eb1-81a7-a33bb067a274 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:41:43.588653 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-d16113a9-38f7-4eb1-81a7-a33bb067a274 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] [instance: ac2dd9d9-7ac0-45be-afc6-2ac26c42a7b4] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:41:43.596422 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d16113a9-38f7-4eb1-81a7-a33bb067a274 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:41:43.596931 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d16113a9-38f7-4eb1-81a7-a33bb067a274 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:41:43.597429 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d16113a9-38f7-4eb1-81a7-a33bb067a274 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:41:43.598149 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d16113a9-38f7-4eb1-81a7-a33bb067a274 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:41:43.598621 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d16113a9-38f7-4eb1-81a7-a33bb067a274 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:41:43.599065 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d16113a9-38f7-4eb1-81a7-a33bb067a274 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:41:43.734871 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-d16113a9-38f7-4eb1-81a7-a33bb067a274 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce13ae25b8cc4c32a66a2bcc536a3fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f9c508b2164653997b36431bb589b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:41:43.746506 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-d16113a9-38f7-4eb1-81a7-a33bb067a274 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] 10.222.0.18 "GET /compute/v2.1/servers/ac2dd9d9-7ac0-45be-afc6-2ac26c42a7b4" status: 200 len: 1691 microversion: 2.1 time: 0.162242 Oct 22 21:41:43.747279 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3044/6061] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:41:43 2022] GET /compute/v2.1/servers/ac2dd9d9-7ac0-45be-afc6-2ac26c42a7b4 => generated 1691 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:41:44.778018 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-dfdae16a-03fc-4a10-9e56-6527746b2ccd tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:41:44.778850 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-dfdae16a-03fc-4a10-9e56-6527746b2ccd tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] [instance: ac2dd9d9-7ac0-45be-afc6-2ac26c42a7b4] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:41:44.786911 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-dfdae16a-03fc-4a10-9e56-6527746b2ccd tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:41:44.787444 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-dfdae16a-03fc-4a10-9e56-6527746b2ccd tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:41:44.787897 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-dfdae16a-03fc-4a10-9e56-6527746b2ccd tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:41:44.788625 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-dfdae16a-03fc-4a10-9e56-6527746b2ccd tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:41:44.789085 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-dfdae16a-03fc-4a10-9e56-6527746b2ccd tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:41:44.789524 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-dfdae16a-03fc-4a10-9e56-6527746b2ccd tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:41:44.933854 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-dfdae16a-03fc-4a10-9e56-6527746b2ccd tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce13ae25b8cc4c32a66a2bcc536a3fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f9c508b2164653997b36431bb589b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:41:44.944143 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-dfdae16a-03fc-4a10-9e56-6527746b2ccd tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] 10.222.0.18 "GET /compute/v2.1/servers/ac2dd9d9-7ac0-45be-afc6-2ac26c42a7b4" status: 200 len: 1691 microversion: 2.1 time: 0.170892 Oct 22 21:41:44.944706 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3018/6062] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:41:44 2022] GET /compute/v2.1/servers/ac2dd9d9-7ac0-45be-afc6-2ac26c42a7b4 => generated 1691 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:41:45.974568 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-b7fa842f-e61d-4d64-bf8b-b83b15c4f435 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:41:45.975296 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-b7fa842f-e61d-4d64-bf8b-b83b15c4f435 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] [instance: ac2dd9d9-7ac0-45be-afc6-2ac26c42a7b4] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:41:45.984027 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b7fa842f-e61d-4d64-bf8b-b83b15c4f435 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:41:45.984626 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b7fa842f-e61d-4d64-bf8b-b83b15c4f435 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:41:45.985172 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b7fa842f-e61d-4d64-bf8b-b83b15c4f435 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:41:45.986018 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b7fa842f-e61d-4d64-bf8b-b83b15c4f435 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:41:45.986584 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b7fa842f-e61d-4d64-bf8b-b83b15c4f435 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:41:45.987121 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b7fa842f-e61d-4d64-bf8b-b83b15c4f435 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:41:46.124905 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-b7fa842f-e61d-4d64-bf8b-b83b15c4f435 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce13ae25b8cc4c32a66a2bcc536a3fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f9c508b2164653997b36431bb589b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:41:46.133072 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-b7fa842f-e61d-4d64-bf8b-b83b15c4f435 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] 10.222.0.18 "GET /compute/v2.1/servers/ac2dd9d9-7ac0-45be-afc6-2ac26c42a7b4" status: 200 len: 1691 microversion: 2.1 time: 0.163729 Oct 22 21:41:46.133692 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3045/6063] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:41:45 2022] GET /compute/v2.1/servers/ac2dd9d9-7ac0-45be-afc6-2ac26c42a7b4 => generated 1691 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:41:47.169668 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-dfac2039-6c01-4987-944b-b5ee5911a3ad tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:41:47.170620 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-dfac2039-6c01-4987-944b-b5ee5911a3ad tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] [instance: ac2dd9d9-7ac0-45be-afc6-2ac26c42a7b4] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:41:47.180327 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-dfac2039-6c01-4987-944b-b5ee5911a3ad tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:41:47.180821 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-dfac2039-6c01-4987-944b-b5ee5911a3ad tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:41:47.181270 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-dfac2039-6c01-4987-944b-b5ee5911a3ad tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:41:47.181983 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-dfac2039-6c01-4987-944b-b5ee5911a3ad tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:41:47.182449 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-dfac2039-6c01-4987-944b-b5ee5911a3ad tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:41:47.182894 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-dfac2039-6c01-4987-944b-b5ee5911a3ad tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:41:47.319743 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-dfac2039-6c01-4987-944b-b5ee5911a3ad tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce13ae25b8cc4c32a66a2bcc536a3fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f9c508b2164653997b36431bb589b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:41:47.331818 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-dfac2039-6c01-4987-944b-b5ee5911a3ad tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] 10.222.0.18 "GET /compute/v2.1/servers/ac2dd9d9-7ac0-45be-afc6-2ac26c42a7b4" status: 200 len: 1691 microversion: 2.1 time: 0.168389 Oct 22 21:41:47.332412 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3019/6064] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:41:47 2022] GET /compute/v2.1/servers/ac2dd9d9-7ac0-45be-afc6-2ac26c42a7b4 => generated 1691 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:41:48.360270 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-d1a79af6-a903-48d5-a32e-1ff67f860748 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:41:48.361140 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-d1a79af6-a903-48d5-a32e-1ff67f860748 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] [instance: ac2dd9d9-7ac0-45be-afc6-2ac26c42a7b4] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:41:48.373878 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d1a79af6-a903-48d5-a32e-1ff67f860748 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:41:48.374726 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d1a79af6-a903-48d5-a32e-1ff67f860748 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:41:48.375539 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d1a79af6-a903-48d5-a32e-1ff67f860748 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:41:48.376867 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d1a79af6-a903-48d5-a32e-1ff67f860748 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:41:48.377674 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d1a79af6-a903-48d5-a32e-1ff67f860748 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:41:48.378428 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d1a79af6-a903-48d5-a32e-1ff67f860748 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:41:48.528220 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-d1a79af6-a903-48d5-a32e-1ff67f860748 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce13ae25b8cc4c32a66a2bcc536a3fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f9c508b2164653997b36431bb589b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:41:48.536951 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-d1a79af6-a903-48d5-a32e-1ff67f860748 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] 10.222.0.18 "GET /compute/v2.1/servers/ac2dd9d9-7ac0-45be-afc6-2ac26c42a7b4" status: 200 len: 1697 microversion: 2.1 time: 0.183770 Oct 22 21:41:48.537526 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3046/6065] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:41:48 2022] GET /compute/v2.1/servers/ac2dd9d9-7ac0-45be-afc6-2ac26c42a7b4 => generated 1697 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:41:49.563024 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-68c9aa87-afba-4ced-83a1-1c895485dd74 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:41:49.563943 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-68c9aa87-afba-4ced-83a1-1c895485dd74 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] [instance: ac2dd9d9-7ac0-45be-afc6-2ac26c42a7b4] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:41:49.574444 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-68c9aa87-afba-4ced-83a1-1c895485dd74 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:41:49.575145 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-68c9aa87-afba-4ced-83a1-1c895485dd74 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:41:49.575966 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-68c9aa87-afba-4ced-83a1-1c895485dd74 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:41:49.577033 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-68c9aa87-afba-4ced-83a1-1c895485dd74 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:41:49.577695 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-68c9aa87-afba-4ced-83a1-1c895485dd74 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:41:49.578321 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-68c9aa87-afba-4ced-83a1-1c895485dd74 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:41:49.726974 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-68c9aa87-afba-4ced-83a1-1c895485dd74 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce13ae25b8cc4c32a66a2bcc536a3fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f9c508b2164653997b36431bb589b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:41:49.738647 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-68c9aa87-afba-4ced-83a1-1c895485dd74 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] 10.222.0.18 "GET /compute/v2.1/servers/ac2dd9d9-7ac0-45be-afc6-2ac26c42a7b4" status: 200 len: 1697 microversion: 2.1 time: 0.181181 Oct 22 21:41:49.739309 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3020/6066] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:41:49 2022] GET /compute/v2.1/servers/ac2dd9d9-7ac0-45be-afc6-2ac26c42a7b4 => generated 1697 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:41:50.763062 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-7ae9c921-ff86-40f0-a663-9ee213fc413e tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:41:50.763062 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-7ae9c921-ff86-40f0-a663-9ee213fc413e tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] [instance: ac2dd9d9-7ac0-45be-afc6-2ac26c42a7b4] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:41:50.770266 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7ae9c921-ff86-40f0-a663-9ee213fc413e tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:41:50.770769 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7ae9c921-ff86-40f0-a663-9ee213fc413e tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:41:50.771224 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7ae9c921-ff86-40f0-a663-9ee213fc413e tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:41:50.771977 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7ae9c921-ff86-40f0-a663-9ee213fc413e tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:41:50.772446 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7ae9c921-ff86-40f0-a663-9ee213fc413e tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:41:50.772889 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7ae9c921-ff86-40f0-a663-9ee213fc413e tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:41:50.908299 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-7ae9c921-ff86-40f0-a663-9ee213fc413e tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce13ae25b8cc4c32a66a2bcc536a3fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f9c508b2164653997b36431bb589b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:41:50.919802 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-7ae9c921-ff86-40f0-a663-9ee213fc413e tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] 10.222.0.18 "GET /compute/v2.1/servers/ac2dd9d9-7ac0-45be-afc6-2ac26c42a7b4" status: 200 len: 1697 microversion: 2.1 time: 0.161187 Oct 22 21:41:50.920438 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3047/6067] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:41:50 2022] GET /compute/v2.1/servers/ac2dd9d9-7ac0-45be-afc6-2ac26c42a7b4 => generated 1697 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:41:51.944315 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-51488e03-d133-414c-824a-59664396ad14 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:41:51.944935 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-51488e03-d133-414c-824a-59664396ad14 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] [instance: ac2dd9d9-7ac0-45be-afc6-2ac26c42a7b4] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:41:51.952499 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-51488e03-d133-414c-824a-59664396ad14 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:41:51.953243 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-51488e03-d133-414c-824a-59664396ad14 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:41:51.953912 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-51488e03-d133-414c-824a-59664396ad14 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:41:51.954933 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-51488e03-d133-414c-824a-59664396ad14 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:41:51.955613 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-51488e03-d133-414c-824a-59664396ad14 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:41:51.956040 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-51488e03-d133-414c-824a-59664396ad14 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:41:52.101840 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-51488e03-d133-414c-824a-59664396ad14 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce13ae25b8cc4c32a66a2bcc536a3fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f9c508b2164653997b36431bb589b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:41:52.109890 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-51488e03-d133-414c-824a-59664396ad14 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] 10.222.0.18 "GET /compute/v2.1/servers/ac2dd9d9-7ac0-45be-afc6-2ac26c42a7b4" status: 200 len: 1682 microversion: 2.1 time: 0.169670 Oct 22 21:41:52.110436 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3021/6068] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:41:51 2022] GET /compute/v2.1/servers/ac2dd9d9-7ac0-45be-afc6-2ac26c42a7b4 => generated 1682 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:41:52.233925 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-a49b15ae-e2f3-4d29-be28-adf73afbfb03 req-a534a4dc-d897-4a90-b73c-846c9e72c4b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac2dd9d9-7ac0-45be-afc6-2ac26c42a7b4", "name": "network-vif-unplugged", "status": "completed", "tag": "fafcf8de-27d1-4d6c-aeb1-4b2604664d68"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:41:52.244257 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-a49b15ae-e2f3-4d29-be28-adf73afbfb03 req-a534a4dc-d897-4a90-b73c-846c9e72c4b0 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:41:52.244778 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-a49b15ae-e2f3-4d29-be28-adf73afbfb03 req-a534a4dc-d897-4a90-b73c-846c9e72c4b0 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:41:52.245200 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-a49b15ae-e2f3-4d29-be28-adf73afbfb03 req-a534a4dc-d897-4a90-b73c-846c9e72c4b0 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:41:52.257035 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-a49b15ae-e2f3-4d29-be28-adf73afbfb03 req-a534a4dc-d897-4a90-b73c-846c9e72c4b0 service nova] Creating event network-vif-unplugged:fafcf8de-27d1-4d6c-aeb1-4b2604664d68 for instance ac2dd9d9-7ac0-45be-afc6-2ac26c42a7b4 on nch1-master-1 Oct 22 21:41:52.262486 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-a49b15ae-e2f3-4d29-be28-adf73afbfb03 req-a534a4dc-d897-4a90-b73c-846c9e72c4b0 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032113 Oct 22 21:41:52.263268 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3048/6069] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:41:52 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:41:54.283585 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-3ae92b1a-606e-4d03-8bb0-c6cd4f2dab7e req-ef31a048-296c-48bc-974b-3ef4be464a87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac2dd9d9-7ac0-45be-afc6-2ac26c42a7b4", "name": "network-vif-plugged", "status": "completed", "tag": "fafcf8de-27d1-4d6c-aeb1-4b2604664d68"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:41:54.294794 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-3ae92b1a-606e-4d03-8bb0-c6cd4f2dab7e req-ef31a048-296c-48bc-974b-3ef4be464a87 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:41:54.295273 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-3ae92b1a-606e-4d03-8bb0-c6cd4f2dab7e req-ef31a048-296c-48bc-974b-3ef4be464a87 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:41:54.295743 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-3ae92b1a-606e-4d03-8bb0-c6cd4f2dab7e req-ef31a048-296c-48bc-974b-3ef4be464a87 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:41:54.307192 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-3ae92b1a-606e-4d03-8bb0-c6cd4f2dab7e req-ef31a048-296c-48bc-974b-3ef4be464a87 service nova] Creating event network-vif-plugged:fafcf8de-27d1-4d6c-aeb1-4b2604664d68 for instance ac2dd9d9-7ac0-45be-afc6-2ac26c42a7b4 on nch1-master-1 Oct 22 21:41:54.312783 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-3ae92b1a-606e-4d03-8bb0-c6cd4f2dab7e req-ef31a048-296c-48bc-974b-3ef4be464a87 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034355 Oct 22 21:41:54.313725 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3022/6070] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:41:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:42:26.411089 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_api:SELECT=16 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:42:26.411918 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell1:SELECT=44 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:42:26.416292 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-c5b0171d-2fdb-4402-bead-8f225cf0368f tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:42:26.418575 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-c5b0171d-2fdb-4402-bead-8f225cf0368f tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] [instance: ac2dd9d9-7ac0-45be-afc6-2ac26c42a7b4] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:42:26.429690 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c5b0171d-2fdb-4402-bead-8f225cf0368f tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:42:26.430189 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c5b0171d-2fdb-4402-bead-8f225cf0368f tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:42:26.430644 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c5b0171d-2fdb-4402-bead-8f225cf0368f tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:42:26.431384 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c5b0171d-2fdb-4402-bead-8f225cf0368f tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:42:26.431859 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c5b0171d-2fdb-4402-bead-8f225cf0368f tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:42:26.432343 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c5b0171d-2fdb-4402-bead-8f225cf0368f tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:42:26.482676 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-c5b0171d-2fdb-4402-bead-8f225cf0368f tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] 10.222.0.18 "POST /compute/v2.1/servers/ac2dd9d9-7ac0-45be-afc6-2ac26c42a7b4/action" status: 200 len: 24570 microversion: 2.1 time: 0.074303 Oct 22 21:42:26.483383 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3049/6071] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 21:42:26 2022] POST /compute/v2.1/servers/ac2dd9d9-7ac0-45be-afc6-2ac26c42a7b4/action => generated 24570 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 22 21:42:57.745996 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_api:SELECT=22 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:42:57.746842 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:42:57.751759 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-d3aa9836-457e-4095-ace6-4b9603ec8c01 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:42:57.752332 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_api:SELECT=2 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:42:57.752755 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-d3aa9836-457e-4095-ace6-4b9603ec8c01 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] [instance: ac2dd9d9-7ac0-45be-afc6-2ac26c42a7b4] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:42:57.753448 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell1:SELECT=4 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:42:57.764213 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d3aa9836-457e-4095-ace6-4b9603ec8c01 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:42:57.764718 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d3aa9836-457e-4095-ace6-4b9603ec8c01 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:42:57.765340 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d3aa9836-457e-4095-ace6-4b9603ec8c01 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:42:57.766541 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d3aa9836-457e-4095-ace6-4b9603ec8c01 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:42:57.767017 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d3aa9836-457e-4095-ace6-4b9603ec8c01 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:42:57.767494 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d3aa9836-457e-4095-ace6-4b9603ec8c01 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:42:57.796394 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-d3aa9836-457e-4095-ace6-4b9603ec8c01 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] [instance: ac2dd9d9-7ac0-45be-afc6-2ac26c42a7b4] Going to try to terminate instance {{(pid=138744) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 21:42:57.890176 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-d3aa9836-457e-4095-ace6-4b9603ec8c01 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] 10.222.0.18 "DELETE /compute/v2.1/servers/ac2dd9d9-7ac0-45be-afc6-2ac26c42a7b4" status: 204 len: 0 microversion: 2.1 time: 0.146436 Oct 22 21:42:57.891762 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3023/6072] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 21:42:57 2022] DELETE /compute/v2.1/servers/ac2dd9d9-7ac0-45be-afc6-2ac26c42a7b4 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 21:42:57.905744 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-556887de-4299-4ce6-a146-30b9624d5aed req-2804db61-7993-4408-a2bf-6ee6ff16480b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac2dd9d9-7ac0-45be-afc6-2ac26c42a7b4", "tag": "fafcf8de-27d1-4d6c-aeb1-4b2604664d68"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:42:57.906456 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-38fc9c88-6386-4323-b19e-4fa60fbdb8db tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:42:57.907365 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-38fc9c88-6386-4323-b19e-4fa60fbdb8db tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] [instance: ac2dd9d9-7ac0-45be-afc6-2ac26c42a7b4] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:42:57.914024 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-38fc9c88-6386-4323-b19e-4fa60fbdb8db tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:42:57.915387 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-38fc9c88-6386-4323-b19e-4fa60fbdb8db tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:42:57.916067 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-38fc9c88-6386-4323-b19e-4fa60fbdb8db tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:42:57.917131 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-556887de-4299-4ce6-a146-30b9624d5aed req-2804db61-7993-4408-a2bf-6ee6ff16480b service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:42:57.917349 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-38fc9c88-6386-4323-b19e-4fa60fbdb8db tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:42:57.917634 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-556887de-4299-4ce6-a146-30b9624d5aed req-2804db61-7993-4408-a2bf-6ee6ff16480b service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:42:57.918036 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-38fc9c88-6386-4323-b19e-4fa60fbdb8db tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:42:57.918161 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-556887de-4299-4ce6-a146-30b9624d5aed req-2804db61-7993-4408-a2bf-6ee6ff16480b service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:42:57.918655 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-38fc9c88-6386-4323-b19e-4fa60fbdb8db tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:42:57.930895 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-556887de-4299-4ce6-a146-30b9624d5aed req-2804db61-7993-4408-a2bf-6ee6ff16480b service nova] Creating event network-changed:fafcf8de-27d1-4d6c-aeb1-4b2604664d68 for instance ac2dd9d9-7ac0-45be-afc6-2ac26c42a7b4 on nch1-master-1 Oct 22 21:42:57.936319 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-556887de-4299-4ce6-a146-30b9624d5aed req-2804db61-7993-4408-a2bf-6ee6ff16480b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.190554 Oct 22 21:42:57.937302 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3050/6073] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:42:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:42:58.061519 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-38fc9c88-6386-4323-b19e-4fa60fbdb8db tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce13ae25b8cc4c32a66a2bcc536a3fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f9c508b2164653997b36431bb589b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:42:58.069412 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-38fc9c88-6386-4323-b19e-4fa60fbdb8db tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] 10.222.0.18 "GET /compute/v2.1/servers/ac2dd9d9-7ac0-45be-afc6-2ac26c42a7b4" status: 200 len: 1688 microversion: 2.1 time: 0.173030 Oct 22 21:42:58.069993 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3024/6074] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:42:57 2022] GET /compute/v2.1/servers/ac2dd9d9-7ac0-45be-afc6-2ac26c42a7b4 => generated 1688 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:42:59.098470 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-913db846-f8f5-484d-97a4-5684a0fef6a9 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:42:59.099313 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-913db846-f8f5-484d-97a4-5684a0fef6a9 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] [instance: ac2dd9d9-7ac0-45be-afc6-2ac26c42a7b4] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:42:59.107264 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-913db846-f8f5-484d-97a4-5684a0fef6a9 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:42:59.107792 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-913db846-f8f5-484d-97a4-5684a0fef6a9 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:42:59.108245 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-913db846-f8f5-484d-97a4-5684a0fef6a9 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:42:59.108966 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-913db846-f8f5-484d-97a4-5684a0fef6a9 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:42:59.109436 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-913db846-f8f5-484d-97a4-5684a0fef6a9 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:42:59.109875 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-913db846-f8f5-484d-97a4-5684a0fef6a9 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:42:59.277203 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-913db846-f8f5-484d-97a4-5684a0fef6a9 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce13ae25b8cc4c32a66a2bcc536a3fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f9c508b2164653997b36431bb589b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:42:59.285689 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-913db846-f8f5-484d-97a4-5684a0fef6a9 tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] 10.222.0.18 "GET /compute/v2.1/servers/ac2dd9d9-7ac0-45be-afc6-2ac26c42a7b4" status: 200 len: 1688 microversion: 2.1 time: 0.194813 Oct 22 21:42:59.286320 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3051/6075] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:42:59 2022] GET /compute/v2.1/servers/ac2dd9d9-7ac0-45be-afc6-2ac26c42a7b4 => generated 1688 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:43:00.170549 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-2f96daf3-44a8-437a-ad5f-32d69dc653cc req-b1ea5073-cbb0-4311-ac3c-5c82826d2bf5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac2dd9d9-7ac0-45be-afc6-2ac26c42a7b4", "name": "network-vif-deleted", "tag": "fafcf8de-27d1-4d6c-aeb1-4b2604664d68"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:43:00.181643 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-2f96daf3-44a8-437a-ad5f-32d69dc653cc req-b1ea5073-cbb0-4311-ac3c-5c82826d2bf5 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:43:00.182444 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-2f96daf3-44a8-437a-ad5f-32d69dc653cc req-b1ea5073-cbb0-4311-ac3c-5c82826d2bf5 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:43:00.182972 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-2f96daf3-44a8-437a-ad5f-32d69dc653cc req-b1ea5073-cbb0-4311-ac3c-5c82826d2bf5 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:43:00.195749 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-2f96daf3-44a8-437a-ad5f-32d69dc653cc req-b1ea5073-cbb0-4311-ac3c-5c82826d2bf5 service nova] Creating event network-vif-deleted:fafcf8de-27d1-4d6c-aeb1-4b2604664d68 for instance ac2dd9d9-7ac0-45be-afc6-2ac26c42a7b4 on nch1-master-1 Oct 22 21:43:00.201204 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-2f96daf3-44a8-437a-ad5f-32d69dc653cc req-b1ea5073-cbb0-4311-ac3c-5c82826d2bf5 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119650 Oct 22 21:43:00.201926 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3025/6076] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:43:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:43:00.310378 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-7cf51ccc-5d3b-4c01-9ceb-6af9390021df tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:43:00.310902 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-7cf51ccc-5d3b-4c01-9ceb-6af9390021df tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] [instance: ac2dd9d9-7ac0-45be-afc6-2ac26c42a7b4] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:43:00.318724 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7cf51ccc-5d3b-4c01-9ceb-6af9390021df tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:43:00.319221 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7cf51ccc-5d3b-4c01-9ceb-6af9390021df tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:43:00.319710 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7cf51ccc-5d3b-4c01-9ceb-6af9390021df tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:43:00.320424 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7cf51ccc-5d3b-4c01-9ceb-6af9390021df tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:43:00.320892 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7cf51ccc-5d3b-4c01-9ceb-6af9390021df tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:43:00.321367 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7cf51ccc-5d3b-4c01-9ceb-6af9390021df tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:43:00.355567 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7cf51ccc-5d3b-4c01-9ceb-6af9390021df tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:43:00.356190 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7cf51ccc-5d3b-4c01-9ceb-6af9390021df tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:43:00.356517 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7cf51ccc-5d3b-4c01-9ceb-6af9390021df tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:43:00.356985 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.objects.instance [None req-7cf51ccc-5d3b-4c01-9ceb-6af9390021df tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lazy-loading 'fault' on Instance uuid ac2dd9d9-7ac0-45be-afc6-2ac26c42a7b4 {{(pid=138745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 21:43:00.403682 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-7cf51ccc-5d3b-4c01-9ceb-6af9390021df tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce13ae25b8cc4c32a66a2bcc536a3fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f9c508b2164653997b36431bb589b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:43:00.412171 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-7cf51ccc-5d3b-4c01-9ceb-6af9390021df tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] 10.222.0.18 "GET /compute/v2.1/servers/ac2dd9d9-7ac0-45be-afc6-2ac26c42a7b4" status: 200 len: 1356 microversion: 2.1 time: 0.105873 Oct 22 21:43:00.412743 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3052/6077] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:43:00 2022] GET /compute/v2.1/servers/ac2dd9d9-7ac0-45be-afc6-2ac26c42a7b4 => generated 1356 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:43:01.440309 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-c5569e50-eee1-46b5-bfc6-25b2748524ad tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:43:01.441488 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-c5569e50-eee1-46b5-bfc6-25b2748524ad tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] [instance: ac2dd9d9-7ac0-45be-afc6-2ac26c42a7b4] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:43:01.453837 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c5569e50-eee1-46b5-bfc6-25b2748524ad tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:43:01.454655 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c5569e50-eee1-46b5-bfc6-25b2748524ad tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:43:01.455435 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c5569e50-eee1-46b5-bfc6-25b2748524ad tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:43:01.456634 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c5569e50-eee1-46b5-bfc6-25b2748524ad tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:43:01.457414 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c5569e50-eee1-46b5-bfc6-25b2748524ad tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:43:01.458154 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c5569e50-eee1-46b5-bfc6-25b2748524ad tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:43:01.475136 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-c5569e50-eee1-46b5-bfc6-25b2748524ad tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] HTTP exception thrown: Instance ac2dd9d9-7ac0-45be-afc6-2ac26c42a7b4 could not be found. Oct 22 21:43:01.476927 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-c5569e50-eee1-46b5-bfc6-25b2748524ad tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Request method failure captured: Oct 22 21:43:01.476927 ncdv-master-1 devstack@n-api.service[138744]: request: GET /compute/v2.1/servers/ac2dd9d9-7ac0-45be-afc6-2ac26c42a7b4 HTTP/1.1 Oct 22 21:43:01.476927 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 21:43:01.476927 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 21:43:01.476927 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 21:43:01.476927 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 0 Oct 22 21:43:01.476927 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 21:43:01.476927 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 21:43:01.476927 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 21:43:01.476927 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 21:43:01.476927 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVGGILX10s2dIgDgVZo2IQgnPiDYDu9a3ft4OAGis05yO8BrPDQHvhvjIr_WfblUYdacpoCBNulloRKj8k-zduRl3WptOsWJtL3dswrAo60x20bp_MtWiCHhhHG9kPBkPEvIy-4T7Hm5YfPQsiEPV_Ld77h47ySD3KCZYLji1QhcSMDE Oct 22 21:43:01.476927 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 21:43:01.476927 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 21:43:01.476927 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 21:43:01.476927 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 21:43:01.476927 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 21:43:01.476927 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 21:43:01.476927 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: 42f9c508b2164653997b36431bb589b8 Oct 22 21:43:01.476927 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1810030830 Oct 22 21:43:01.476927 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 21:43:01.476927 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 21:43:01.476927 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_42f9c508b2164653997b36431bb589b8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/42f9c508b2164653997b36431bb589b8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/42f9c508b2164653997b36431bb589b8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/42f9c508b2164653997b36431bb589b8"}]}] Oct 22 21:43:01.476927 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1810030830 Oct 22 21:43:01.476927 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: 42f9c508b2164653997b36431bb589b8 Oct 22 21:43:01.476927 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1810030830 Oct 22 21:43:01.476927 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-TestNetworkAdvancedServerOps-1810030830-project Oct 22 21:43:01.476927 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 21:43:01.476927 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 21:43:01.476927 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: ce13ae25b8cc4c32a66a2bcc536a3fd6 Oct 22 21:43:01.476927 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1810030830-project Oct 22 21:43:01.476927 ncdv-master-1 devstack@n-api.service[138744]: method: > Oct 22 21:43:01.476927 ncdv-master-1 devstack@n-api.service[138744]: exception: Instance ac2dd9d9-7ac0-45be-afc6-2ac26c42a7b4 could not be found. Oct 22 21:43:01.476927 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': 'ac2dd9d9-7ac0-45be-afc6-2ac26c42a7b4'} Oct 22 21:43:01.476927 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:43:01.476927 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:43:01.476927 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 21:43:01.476927 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 21:43:01.476927 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 21:43:01.476927 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 21:43:01.476927 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 21:43:01.476927 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 21:43:01.476927 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 21:43:01.476927 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 21:43:01.476927 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac2dd9d9-7ac0-45be-afc6-2ac26c42a7b4 could not be found. Oct 22 21:43:01.476927 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:43:01.476927 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:43:01.476927 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:43:01.476927 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:43:01.476927 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:43:01.476927 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:43:01.476927 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:43:01.476927 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:43:01.476927 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:43:01.476927 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:43:01.476927 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 21:43:01.476927 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 21:43:01.476927 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 21:43:01.476927 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 21:43:01.476927 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 21:43:01.476927 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:43:01.476927 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac2dd9d9-7ac0-45be-afc6-2ac26c42a7b4 could not be found. Oct 22 21:43:01.476927 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:43:01.476927 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:43:01.481132 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:43:01.481132 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:43:01.481132 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:43:01.481132 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:43:01.481132 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:43:01.481132 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:43:01.481132 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac2dd9d9-7ac0-45be-afc6-2ac26c42a7b4 could not be found. Oct 22 21:43:01.481132 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:43:01.481132 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-c5569e50-eee1-46b5-bfc6-25b2748524ad tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Returning 404 to user: Instance ac2dd9d9-7ac0-45be-afc6-2ac26c42a7b4 could not be found. {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:43:01.481132 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-c5569e50-eee1-46b5-bfc6-25b2748524ad tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] 10.222.0.18 "GET /compute/v2.1/servers/ac2dd9d9-7ac0-45be-afc6-2ac26c42a7b4" status: 404 len: 111 microversion: 2.1 time: 0.045281 Oct 22 21:43:01.481132 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3026/6078] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:43:01 2022] GET /compute/v2.1/servers/ac2dd9d9-7ac0-45be-afc6-2ac26c42a7b4 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 21:43:04.859197 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-d6af5576-734c-4ebc-8414-798974b8054c tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] Calling method '.version_select at 0x7fd39fd83c10>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:43:04.865051 ncdv-master-1 devstack@n-api.service[138745]: ERROR oslo.messaging._drivers.impl_rabbit [None req-d6af5576-734c-4ebc-8414-798974b8054c tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] [fdffe6b9-9d4b-45b8-9714-1ef9d5132dcd] AMQP server on 10.222.0.18:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 22 21:43:05.876458 ncdv-master-1 devstack@n-api.service[138745]: INFO oslo.messaging._drivers.impl_rabbit [None req-d6af5576-734c-4ebc-8414-798974b8054c tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] [fdffe6b9-9d4b-45b8-9714-1ef9d5132dcd] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 34022. Oct 22 21:43:05.901820 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-d6af5576-734c-4ebc-8414-798974b8054c tempest-TestNetworkAdvancedServerOps-1810030830 tempest-TestNetworkAdvancedServerOps-1810030830-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-527986074" status: 202 len: 0 microversion: 2.1 time: 1.047320 Oct 22 21:43:05.902344 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3053/6079] 10.222.0.18 () {58 vars in 1281 bytes} [Sat Oct 22 21:43:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-527986074 => generated 0 bytes in 1049 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 21:43:13.678734 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-e96f10d7-1706-4502-9f06-1d10c28c76b2 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Action: 'create', calling method: .version_select at 0x7fd3a4564040>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-2082764247", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFBtO4xL0qkh0Ejxwfki9268+Jx4AhX8HJBL8ssKlmYSiQ+v9120viTUijUf17+7Mm2/g51bkZ7IOUAYnya1GWYEUz98ociby5LhViBH00xemBpp4r+zuLCepvEgb5/mgA=="}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:43:13.686801 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:43:13.687889 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:43:13.706707 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-e96f10d7-1706-4502-9f06-1d10c28c76b2 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Getting quotas for project 03adeffad1764ecf83ff0dd066814749. Resources: {'key_pairs'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 21:43:13.712606 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-e96f10d7-1706-4502-9f06-1d10c28c76b2 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Getting quotas for user be3ea0672cee498ebffe3190962df106 and project 03adeffad1764ecf83ff0dd066814749. Resources: {'key_pairs'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 21:43:13.731205 ncdv-master-1 devstack@n-api.service[138744]: ERROR oslo.messaging._drivers.impl_rabbit [None req-e96f10d7-1706-4502-9f06-1d10c28c76b2 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] [1e95764d-9b00-41e5-9238-ea25707eb673] AMQP server on 10.222.0.18:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 22 21:43:14.740096 ncdv-master-1 devstack@n-api.service[138744]: INFO oslo.messaging._drivers.impl_rabbit [None req-e96f10d7-1706-4502-9f06-1d10c28c76b2 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] [1e95764d-9b00-41e5-9238-ea25707eb673] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 34102. Oct 22 21:43:14.757589 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-e96f10d7-1706-4502-9f06-1d10c28c76b2 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 1.083993 Oct 22 21:43:14.758568 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3027/6080] 10.222.0.18 () {60 vars in 1159 bytes} [Sat Oct 22 21:43:13 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 1085 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:43:16.142030 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell1:SELECT=16 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:43:16.142829 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_api:SELECT=11,nova_api:DELETE=1 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:43:16.147430 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-1cd51cf2-32da-45f9-88f7-c63dc2ccfc9e tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-2014863342", "imageRef": "085e4478-6edc-4a69-8e08-f9831713eb65", "flavorRef": "452", "networks": [{"uuid": "ade26f99-76e9-4aec-832e-0775c9b00415"}], "key_name": "tempest-TestNetworkBasicOps-2082764247", "security_groups": [{"name": "tempest-secgroup-smoke-22325791"}]}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:43:16.262204 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.network.neutron [None req-1cd51cf2-32da-45f9-88f7-c63dc2ccfc9e tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] validate_networks() for [('ade26f99-76e9-4aec-832e-0775c9b00415', None, None, None, None, None)] {{(pid=138745) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 21:43:16.737627 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-1cd51cf2-32da-45f9-88f7-c63dc2ccfc9e tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Flavor limits 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 21:43:16.738020 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-1cd51cf2-32da-45f9-88f7-c63dc2ccfc9e tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Image limits 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 21:43:16.738521 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-1cd51cf2-32da-45f9-88f7-c63dc2ccfc9e tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Flavor pref 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 21:43:16.739315 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-1cd51cf2-32da-45f9-88f7-c63dc2ccfc9e tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Image pref 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 21:43:16.739800 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-1cd51cf2-32da-45f9-88f7-c63dc2ccfc9e tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 21:43:16.749495 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1cd51cf2-32da-45f9-88f7-c63dc2ccfc9e tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:43:16.750003 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1cd51cf2-32da-45f9-88f7-c63dc2ccfc9e tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:43:16.750491 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1cd51cf2-32da-45f9-88f7-c63dc2ccfc9e tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:43:16.751243 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1cd51cf2-32da-45f9-88f7-c63dc2ccfc9e tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:43:16.751741 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1cd51cf2-32da-45f9-88f7-c63dc2ccfc9e tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:43:16.752217 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1cd51cf2-32da-45f9-88f7-c63dc2ccfc9e tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:43:16.769527 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-1cd51cf2-32da-45f9-88f7-c63dc2ccfc9e tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Getting quotas for project 03adeffad1764ecf83ff0dd066814749. Resources: {'cores', 'instances', 'ram'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 21:43:16.775107 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-1cd51cf2-32da-45f9-88f7-c63dc2ccfc9e tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Getting quotas for user be3ea0672cee498ebffe3190962df106 and project 03adeffad1764ecf83ff0dd066814749. Resources: {'cores', 'instances', 'ram'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 21:43:16.787876 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-1cd51cf2-32da-45f9-88f7-c63dc2ccfc9e tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Going to run 1 instances... {{(pid=138745) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 21:43:16.790231 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-1cd51cf2-32da-45f9-88f7-c63dc2ccfc9e tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] [instance: c24f5240-f803-4796-b4c1-e8899b62ad75] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='085e4478-6edc-4a69-8e08-f9831713eb65',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138745) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 21:43:16.838090 ncdv-master-1 devstack@n-api.service[138745]: ERROR oslo.messaging._drivers.impl_rabbit [None req-1cd51cf2-32da-45f9-88f7-c63dc2ccfc9e tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] [56d69d84-d163-4032-a20a-431de1095b7a] AMQP server on 10.222.0.18:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 22 21:43:17.850534 ncdv-master-1 devstack@n-api.service[138745]: INFO oslo.messaging._drivers.impl_rabbit [None req-1cd51cf2-32da-45f9-88f7-c63dc2ccfc9e tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] [56d69d84-d163-4032-a20a-431de1095b7a] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 34136. Oct 22 21:43:17.857976 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-1cd51cf2-32da-45f9-88f7-c63dc2ccfc9e tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.717345 Oct 22 21:43:17.859229 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3054/6081] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Oct 22 21:43:16 2022] POST /compute/v2.1/servers => generated 404 bytes in 1720 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 21:43:17.875880 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-61c8b813-c680-4184-8e73-52b555d61f86 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:43:17.876494 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-61c8b813-c680-4184-8e73-52b555d61f86 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] [instance: c24f5240-f803-4796-b4c1-e8899b62ad75] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:43:17.932502 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-61c8b813-c680-4184-8e73-52b555d61f86 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3ea0672cee498ebffe3190962df106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03adeffad1764ecf83ff0dd066814749', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:43:17.941043 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-61c8b813-c680-4184-8e73-52b555d61f86 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] 10.222.0.18 "GET /compute/v2.1/servers/c24f5240-f803-4796-b4c1-e8899b62ad75" status: 200 len: 1249 microversion: 2.1 time: 0.070093 Oct 22 21:43:17.941614 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3028/6082] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:43:17 2022] GET /compute/v2.1/servers/c24f5240-f803-4796-b4c1-e8899b62ad75 => generated 1249 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:43:18.965043 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-5b1661ca-4a5e-4c68-a2c1-b90cab7adb6b tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:43:18.966518 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-5b1661ca-4a5e-4c68-a2c1-b90cab7adb6b tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] [instance: c24f5240-f803-4796-b4c1-e8899b62ad75] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:43:19.020725 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-5b1661ca-4a5e-4c68-a2c1-b90cab7adb6b tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3ea0672cee498ebffe3190962df106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03adeffad1764ecf83ff0dd066814749', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:43:19.028053 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-5b1661ca-4a5e-4c68-a2c1-b90cab7adb6b tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] 10.222.0.18 "GET /compute/v2.1/servers/c24f5240-f803-4796-b4c1-e8899b62ad75" status: 200 len: 1249 microversion: 2.1 time: 0.068721 Oct 22 21:43:19.028645 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3055/6083] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:43:18 2022] GET /compute/v2.1/servers/c24f5240-f803-4796-b4c1-e8899b62ad75 => generated 1249 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:43:20.054731 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-fb038857-0a93-4aa0-bfae-9a5d65b8fa0c tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:43:20.055662 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-fb038857-0a93-4aa0-bfae-9a5d65b8fa0c tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] [instance: c24f5240-f803-4796-b4c1-e8899b62ad75] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:43:20.064947 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fb038857-0a93-4aa0-bfae-9a5d65b8fa0c tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:43:20.065442 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fb038857-0a93-4aa0-bfae-9a5d65b8fa0c tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:43:20.065879 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fb038857-0a93-4aa0-bfae-9a5d65b8fa0c tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:43:20.066587 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fb038857-0a93-4aa0-bfae-9a5d65b8fa0c tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:43:20.067057 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fb038857-0a93-4aa0-bfae-9a5d65b8fa0c tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:43:20.067491 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fb038857-0a93-4aa0-bfae-9a5d65b8fa0c tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:43:20.132819 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-fb038857-0a93-4aa0-bfae-9a5d65b8fa0c tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3ea0672cee498ebffe3190962df106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03adeffad1764ecf83ff0dd066814749', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:43:20.143540 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-fb038857-0a93-4aa0-bfae-9a5d65b8fa0c tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] 10.222.0.18 "GET /compute/v2.1/servers/c24f5240-f803-4796-b4c1-e8899b62ad75" status: 200 len: 1253 microversion: 2.1 time: 0.095294 Oct 22 21:43:20.144533 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3029/6084] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:43:20 2022] GET /compute/v2.1/servers/c24f5240-f803-4796-b4c1-e8899b62ad75 => generated 1253 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:43:21.166379 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-b2b413d2-e0b2-48b3-902f-958a06bda8ec tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:43:21.167466 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-b2b413d2-e0b2-48b3-902f-958a06bda8ec tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] [instance: c24f5240-f803-4796-b4c1-e8899b62ad75] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:43:21.177184 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b2b413d2-e0b2-48b3-902f-958a06bda8ec tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:43:21.177770 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b2b413d2-e0b2-48b3-902f-958a06bda8ec tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:43:21.178296 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b2b413d2-e0b2-48b3-902f-958a06bda8ec tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:43:21.179098 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b2b413d2-e0b2-48b3-902f-958a06bda8ec tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:43:21.179669 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b2b413d2-e0b2-48b3-902f-958a06bda8ec tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:43:21.180212 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b2b413d2-e0b2-48b3-902f-958a06bda8ec tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:43:21.250379 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-b2b413d2-e0b2-48b3-902f-958a06bda8ec tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3ea0672cee498ebffe3190962df106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03adeffad1764ecf83ff0dd066814749', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:43:21.258406 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-b2b413d2-e0b2-48b3-902f-958a06bda8ec tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] 10.222.0.18 "GET /compute/v2.1/servers/c24f5240-f803-4796-b4c1-e8899b62ad75" status: 200 len: 1319 microversion: 2.1 time: 0.096026 Oct 22 21:43:21.267440 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3056/6085] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:43:21 2022] GET /compute/v2.1/servers/c24f5240-f803-4796-b4c1-e8899b62ad75 => generated 1319 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:43:22.282905 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-146febc9-3ebf-4068-b4e4-8380520d3581 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:43:22.283624 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-146febc9-3ebf-4068-b4e4-8380520d3581 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] [instance: c24f5240-f803-4796-b4c1-e8899b62ad75] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:43:22.290804 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-146febc9-3ebf-4068-b4e4-8380520d3581 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:43:22.291299 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-146febc9-3ebf-4068-b4e4-8380520d3581 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:43:22.291811 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-146febc9-3ebf-4068-b4e4-8380520d3581 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:43:22.292556 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-146febc9-3ebf-4068-b4e4-8380520d3581 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:43:22.293020 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-146febc9-3ebf-4068-b4e4-8380520d3581 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:43:22.293455 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-146febc9-3ebf-4068-b4e4-8380520d3581 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:43:22.489411 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-146febc9-3ebf-4068-b4e4-8380520d3581 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3ea0672cee498ebffe3190962df106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03adeffad1764ecf83ff0dd066814749', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:43:22.498058 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-146febc9-3ebf-4068-b4e4-8380520d3581 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] 10.222.0.18 "GET /compute/v2.1/servers/c24f5240-f803-4796-b4c1-e8899b62ad75" status: 200 len: 1373 microversion: 2.1 time: 0.219391 Oct 22 21:43:22.501466 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3030/6086] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:43:22 2022] GET /compute/v2.1/servers/c24f5240-f803-4796-b4c1-e8899b62ad75 => generated 1373 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:43:22.590611 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-ceee76a0-7f40-45bc-8551-7ef82ed49a72 req-f44c1a8e-a71f-4868-95ea-0ab0690c1b48 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c24f5240-f803-4796-b4c1-e8899b62ad75", "tag": "bc3a1f90-b4d4-4d69-842e-8276a4598001"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:43:22.605723 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-ceee76a0-7f40-45bc-8551-7ef82ed49a72 req-f44c1a8e-a71f-4868-95ea-0ab0690c1b48 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:43:22.606214 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-ceee76a0-7f40-45bc-8551-7ef82ed49a72 req-f44c1a8e-a71f-4868-95ea-0ab0690c1b48 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:43:22.616646 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-ceee76a0-7f40-45bc-8551-7ef82ed49a72 req-f44c1a8e-a71f-4868-95ea-0ab0690c1b48 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:43:22.632640 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-ceee76a0-7f40-45bc-8551-7ef82ed49a72 req-f44c1a8e-a71f-4868-95ea-0ab0690c1b48 service nova] Creating event network-changed:bc3a1f90-b4d4-4d69-842e-8276a4598001 for instance c24f5240-f803-4796-b4c1-e8899b62ad75 on nch1-master-1 Oct 22 21:43:22.641751 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-ceee76a0-7f40-45bc-8551-7ef82ed49a72 req-f44c1a8e-a71f-4868-95ea-0ab0690c1b48 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054874 Oct 22 21:43:22.643104 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3057/6087] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:43:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:43:23.524010 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-e30153af-b121-491b-ab43-e96682ec7b66 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:43:23.524836 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-e30153af-b121-491b-ab43-e96682ec7b66 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] [instance: c24f5240-f803-4796-b4c1-e8899b62ad75] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:43:23.534859 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e30153af-b121-491b-ab43-e96682ec7b66 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:43:23.535563 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e30153af-b121-491b-ab43-e96682ec7b66 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:43:23.536162 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e30153af-b121-491b-ab43-e96682ec7b66 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:43:23.537083 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e30153af-b121-491b-ab43-e96682ec7b66 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:43:23.537742 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e30153af-b121-491b-ab43-e96682ec7b66 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:43:23.538326 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e30153af-b121-491b-ab43-e96682ec7b66 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:43:23.684767 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-e30153af-b121-491b-ab43-e96682ec7b66 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3ea0672cee498ebffe3190962df106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03adeffad1764ecf83ff0dd066814749', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:43:23.693246 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-e30153af-b121-491b-ab43-e96682ec7b66 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] 10.222.0.18 "GET /compute/v2.1/servers/c24f5240-f803-4796-b4c1-e8899b62ad75" status: 200 len: 1373 microversion: 2.1 time: 0.174655 Oct 22 21:43:23.693861 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3031/6088] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:43:23 2022] GET /compute/v2.1/servers/c24f5240-f803-4796-b4c1-e8899b62ad75 => generated 1373 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:43:24.721080 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-010afc71-c7f5-4abe-8ed7-77e9ba183984 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:43:24.721831 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-010afc71-c7f5-4abe-8ed7-77e9ba183984 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] [instance: c24f5240-f803-4796-b4c1-e8899b62ad75] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:43:24.728873 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-010afc71-c7f5-4abe-8ed7-77e9ba183984 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:43:24.729355 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-010afc71-c7f5-4abe-8ed7-77e9ba183984 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:43:24.729847 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-010afc71-c7f5-4abe-8ed7-77e9ba183984 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:43:24.730566 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-010afc71-c7f5-4abe-8ed7-77e9ba183984 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:43:24.731052 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-010afc71-c7f5-4abe-8ed7-77e9ba183984 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:43:24.731534 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-010afc71-c7f5-4abe-8ed7-77e9ba183984 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:43:24.871651 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-010afc71-c7f5-4abe-8ed7-77e9ba183984 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3ea0672cee498ebffe3190962df106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03adeffad1764ecf83ff0dd066814749', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:43:24.883673 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-010afc71-c7f5-4abe-8ed7-77e9ba183984 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] 10.222.0.18 "GET /compute/v2.1/servers/c24f5240-f803-4796-b4c1-e8899b62ad75" status: 200 len: 1373 microversion: 2.1 time: 0.169436 Oct 22 21:43:24.884671 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3058/6089] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:43:24 2022] GET /compute/v2.1/servers/c24f5240-f803-4796-b4c1-e8899b62ad75 => generated 1373 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:43:25.909142 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-13850039-9c96-4cd0-91f9-bd4ed2812dc2 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:43:25.909963 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-13850039-9c96-4cd0-91f9-bd4ed2812dc2 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] [instance: c24f5240-f803-4796-b4c1-e8899b62ad75] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:43:25.919126 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-13850039-9c96-4cd0-91f9-bd4ed2812dc2 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:43:25.919786 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-13850039-9c96-4cd0-91f9-bd4ed2812dc2 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:43:25.920344 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-13850039-9c96-4cd0-91f9-bd4ed2812dc2 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:43:25.921223 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-13850039-9c96-4cd0-91f9-bd4ed2812dc2 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:43:25.921913 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-13850039-9c96-4cd0-91f9-bd4ed2812dc2 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:43:25.922354 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-13850039-9c96-4cd0-91f9-bd4ed2812dc2 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:43:26.072655 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-13850039-9c96-4cd0-91f9-bd4ed2812dc2 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3ea0672cee498ebffe3190962df106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03adeffad1764ecf83ff0dd066814749', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:43:26.081183 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-13850039-9c96-4cd0-91f9-bd4ed2812dc2 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] 10.222.0.18 "GET /compute/v2.1/servers/c24f5240-f803-4796-b4c1-e8899b62ad75" status: 200 len: 1373 microversion: 2.1 time: 0.177131 Oct 22 21:43:26.081801 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3032/6090] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:43:25 2022] GET /compute/v2.1/servers/c24f5240-f803-4796-b4c1-e8899b62ad75 => generated 1373 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:43:27.108644 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-65c7d014-c72a-4c80-a762-d6d9eae33970 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:43:27.109416 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-65c7d014-c72a-4c80-a762-d6d9eae33970 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] [instance: c24f5240-f803-4796-b4c1-e8899b62ad75] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:43:27.111931 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell0:SELECT=2 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:43:27.117180 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-65c7d014-c72a-4c80-a762-d6d9eae33970 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:43:27.117659 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-65c7d014-c72a-4c80-a762-d6d9eae33970 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:43:27.118111 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-65c7d014-c72a-4c80-a762-d6d9eae33970 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:43:27.118831 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-65c7d014-c72a-4c80-a762-d6d9eae33970 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:43:27.119305 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-65c7d014-c72a-4c80-a762-d6d9eae33970 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:43:27.119774 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-65c7d014-c72a-4c80-a762-d6d9eae33970 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:43:27.252817 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-65c7d014-c72a-4c80-a762-d6d9eae33970 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3ea0672cee498ebffe3190962df106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03adeffad1764ecf83ff0dd066814749', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:43:27.260874 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-65c7d014-c72a-4c80-a762-d6d9eae33970 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] 10.222.0.18 "GET /compute/v2.1/servers/c24f5240-f803-4796-b4c1-e8899b62ad75" status: 200 len: 1373 microversion: 2.1 time: 0.159070 Oct 22 21:43:27.261455 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3059/6091] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:43:27 2022] GET /compute/v2.1/servers/c24f5240-f803-4796-b4c1-e8899b62ad75 => generated 1373 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:43:28.289997 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-87e676e9-c54a-429b-aa91-9643dec7fb72 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:43:28.291087 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-87e676e9-c54a-429b-aa91-9643dec7fb72 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] [instance: c24f5240-f803-4796-b4c1-e8899b62ad75] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:43:28.295593 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell0:SELECT=6 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:43:28.304593 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-87e676e9-c54a-429b-aa91-9643dec7fb72 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:43:28.305408 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-87e676e9-c54a-429b-aa91-9643dec7fb72 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:43:28.306143 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-87e676e9-c54a-429b-aa91-9643dec7fb72 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:43:28.307389 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-87e676e9-c54a-429b-aa91-9643dec7fb72 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:43:28.308148 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-87e676e9-c54a-429b-aa91-9643dec7fb72 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:43:28.308867 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-87e676e9-c54a-429b-aa91-9643dec7fb72 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:43:28.450275 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-87e676e9-c54a-429b-aa91-9643dec7fb72 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3ea0672cee498ebffe3190962df106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03adeffad1764ecf83ff0dd066814749', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:43:28.458452 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-87e676e9-c54a-429b-aa91-9643dec7fb72 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] 10.222.0.18 "GET /compute/v2.1/servers/c24f5240-f803-4796-b4c1-e8899b62ad75" status: 200 len: 1373 microversion: 2.1 time: 0.175158 Oct 22 21:43:28.459041 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3033/6092] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:43:28 2022] GET /compute/v2.1/servers/c24f5240-f803-4796-b4c1-e8899b62ad75 => generated 1373 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:43:28.541847 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-6b404029-2b36-4e39-aa45-850dd62b6ed9 req-cd453dcb-c41a-402f-affe-5be503810f56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c24f5240-f803-4796-b4c1-e8899b62ad75", "name": "network-vif-plugged", "status": "completed", "tag": "bc3a1f90-b4d4-4d69-842e-8276a4598001"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:43:28.554097 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-6b404029-2b36-4e39-aa45-850dd62b6ed9 req-cd453dcb-c41a-402f-affe-5be503810f56 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:43:28.554945 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-6b404029-2b36-4e39-aa45-850dd62b6ed9 req-cd453dcb-c41a-402f-affe-5be503810f56 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:43:28.555179 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-6b404029-2b36-4e39-aa45-850dd62b6ed9 req-cd453dcb-c41a-402f-affe-5be503810f56 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:43:28.567399 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-6b404029-2b36-4e39-aa45-850dd62b6ed9 req-cd453dcb-c41a-402f-affe-5be503810f56 service nova] Creating event network-vif-plugged:bc3a1f90-b4d4-4d69-842e-8276a4598001 for instance c24f5240-f803-4796-b4c1-e8899b62ad75 on nch1-master-1 Oct 22 21:43:28.572579 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-6b404029-2b36-4e39-aa45-850dd62b6ed9 req-cd453dcb-c41a-402f-affe-5be503810f56 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034776 Oct 22 21:43:28.573324 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3060/6093] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:43:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:43:29.484684 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-0f52520f-d584-4662-bf90-337755983610 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:43:29.485350 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-0f52520f-d584-4662-bf90-337755983610 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] [instance: c24f5240-f803-4796-b4c1-e8899b62ad75] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:43:29.492967 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0f52520f-d584-4662-bf90-337755983610 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:43:29.493492 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0f52520f-d584-4662-bf90-337755983610 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:43:29.493937 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0f52520f-d584-4662-bf90-337755983610 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:43:29.494640 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0f52520f-d584-4662-bf90-337755983610 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:43:29.495103 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0f52520f-d584-4662-bf90-337755983610 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:43:29.495601 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0f52520f-d584-4662-bf90-337755983610 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:43:29.630852 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-0f52520f-d584-4662-bf90-337755983610 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3ea0672cee498ebffe3190962df106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03adeffad1764ecf83ff0dd066814749', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:43:29.639191 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-0f52520f-d584-4662-bf90-337755983610 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] 10.222.0.18 "GET /compute/v2.1/servers/c24f5240-f803-4796-b4c1-e8899b62ad75" status: 200 len: 1373 microversion: 2.1 time: 0.160487 Oct 22 21:43:29.639784 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3034/6094] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:43:29 2022] GET /compute/v2.1/servers/c24f5240-f803-4796-b4c1-e8899b62ad75 => generated 1373 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:43:30.659816 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell0:SELECT=8 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:43:30.665157 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-44101f29-634e-4efc-a078-33b693258897 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:43:30.665906 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-44101f29-634e-4efc-a078-33b693258897 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] [instance: c24f5240-f803-4796-b4c1-e8899b62ad75] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:43:30.672877 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-44101f29-634e-4efc-a078-33b693258897 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:43:30.673440 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-44101f29-634e-4efc-a078-33b693258897 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:43:30.673935 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-44101f29-634e-4efc-a078-33b693258897 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:43:30.674777 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-44101f29-634e-4efc-a078-33b693258897 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:43:30.675277 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-44101f29-634e-4efc-a078-33b693258897 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:43:30.675753 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-44101f29-634e-4efc-a078-33b693258897 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:43:30.818201 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-44101f29-634e-4efc-a078-33b693258897 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3ea0672cee498ebffe3190962df106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03adeffad1764ecf83ff0dd066814749', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:43:30.826599 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-44101f29-634e-4efc-a078-33b693258897 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] 10.222.0.18 "GET /compute/v2.1/servers/c24f5240-f803-4796-b4c1-e8899b62ad75" status: 200 len: 1545 microversion: 2.1 time: 0.167891 Oct 22 21:43:30.827200 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3061/6095] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:43:30 2022] GET /compute/v2.1/servers/c24f5240-f803-4796-b4c1-e8899b62ad75 => generated 1545 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:43:30.849643 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-36a0c64a-8ccd-455e-b920-c83a4e916d03 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:43:30.850223 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-36a0c64a-8ccd-455e-b920-c83a4e916d03 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] [instance: c24f5240-f803-4796-b4c1-e8899b62ad75] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:43:30.857474 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-36a0c64a-8ccd-455e-b920-c83a4e916d03 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:43:30.857968 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-36a0c64a-8ccd-455e-b920-c83a4e916d03 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:43:30.858411 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-36a0c64a-8ccd-455e-b920-c83a4e916d03 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:43:30.859115 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-36a0c64a-8ccd-455e-b920-c83a4e916d03 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:43:30.859624 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-36a0c64a-8ccd-455e-b920-c83a4e916d03 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:43:30.860057 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-36a0c64a-8ccd-455e-b920-c83a4e916d03 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:43:31.006750 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-36a0c64a-8ccd-455e-b920-c83a4e916d03 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3ea0672cee498ebffe3190962df106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03adeffad1764ecf83ff0dd066814749', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:43:31.015295 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-36a0c64a-8ccd-455e-b920-c83a4e916d03 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] 10.222.0.18 "GET /compute/v2.1/servers/c24f5240-f803-4796-b4c1-e8899b62ad75" status: 200 len: 1545 microversion: 2.1 time: 0.169596 Oct 22 21:43:31.015846 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3035/6096] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:43:30 2022] GET /compute/v2.1/servers/c24f5240-f803-4796-b4c1-e8899b62ad75 => generated 1545 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:43:32.688218 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-3b27dfba-b9dc-456a-bfac-84f33ee782e3 req-fb93b5fe-cea2-4c97-9cc7-c7cd90edba65 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c24f5240-f803-4796-b4c1-e8899b62ad75", "tag": "bc3a1f90-b4d4-4d69-842e-8276a4598001"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:43:32.703918 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-3b27dfba-b9dc-456a-bfac-84f33ee782e3 req-fb93b5fe-cea2-4c97-9cc7-c7cd90edba65 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:43:32.704408 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-3b27dfba-b9dc-456a-bfac-84f33ee782e3 req-fb93b5fe-cea2-4c97-9cc7-c7cd90edba65 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:43:32.705086 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-3b27dfba-b9dc-456a-bfac-84f33ee782e3 req-fb93b5fe-cea2-4c97-9cc7-c7cd90edba65 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:43:32.717174 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-3b27dfba-b9dc-456a-bfac-84f33ee782e3 req-fb93b5fe-cea2-4c97-9cc7-c7cd90edba65 service nova] Creating event network-changed:bc3a1f90-b4d4-4d69-842e-8276a4598001 for instance c24f5240-f803-4796-b4c1-e8899b62ad75 on nch1-master-1 Oct 22 21:43:32.722841 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-3b27dfba-b9dc-456a-bfac-84f33ee782e3 req-fb93b5fe-cea2-4c97-9cc7-c7cd90edba65 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038482 Oct 22 21:43:32.723723 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3062/6097] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:43:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:44:06.013767 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-d9073273-88e8-4d9e-a0f1-2c1545c28b86 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:44:06.016484 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-d9073273-88e8-4d9e-a0f1-2c1545c28b86 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] [instance: c24f5240-f803-4796-b4c1-e8899b62ad75] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:44:06.019045 ncdv-master-1 devstack@n-api.service[138744]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 22 21:44:06.019203 ncdv-master-1 devstack@n-api.service[138744]: Sat Oct 22 21:44:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c24f5240-f803-4796-b4c1-e8899b62ad75/action (ip 10.222.0.18) !!! Oct 22 21:44:06.020441 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:44:06.021088 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:SELECT=42 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:44:06.028322 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d9073273-88e8-4d9e-a0f1-2c1545c28b86 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:44:06.028821 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d9073273-88e8-4d9e-a0f1-2c1545c28b86 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:44:06.029265 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d9073273-88e8-4d9e-a0f1-2c1545c28b86 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:44:06.029983 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d9073273-88e8-4d9e-a0f1-2c1545c28b86 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:44:06.030446 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d9073273-88e8-4d9e-a0f1-2c1545c28b86 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:44:06.031054 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d9073273-88e8-4d9e-a0f1-2c1545c28b86 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:44:06.090730 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-d9073273-88e8-4d9e-a0f1-2c1545c28b86 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] 10.222.0.18 "POST /compute/v2.1/servers/c24f5240-f803-4796-b4c1-e8899b62ad75/action" status: 200 len: 24562 microversion: 2.1 time: 0.081068 Oct 22 21:44:06.091366 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3036/6098] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 21:44:06 2022] POST /compute/v2.1/servers/c24f5240-f803-4796-b4c1-e8899b62ad75/action => generated 24562 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 22 21:44:40.921668 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:44:40.922448 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell1:SELECT=32 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:44:40.927968 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-01fd13c5-4ea6-48bd-9557-abbc65edfd1c tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Action: 'create', calling method: .version_select at 0x7fd3a45113a0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-461289642", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPUgb60nZ3a/84NJFSrZ3MUmFCkuCUONTLh0PnwsE0jHJvv55LMIOXDbBUAs0su8+8XABibND81s3B+uTbVKUp7z9nKwqvcZtcFK3D2O5b6jm0N/M5gvSGFbPhldZKKRCg=="}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:44:40.946025 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-01fd13c5-4ea6-48bd-9557-abbc65edfd1c tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Getting quotas for project 03adeffad1764ecf83ff0dd066814749. Resources: {'key_pairs'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 21:44:40.951578 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-01fd13c5-4ea6-48bd-9557-abbc65edfd1c tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Getting quotas for user be3ea0672cee498ebffe3190962df106 and project 03adeffad1764ecf83ff0dd066814749. Resources: {'key_pairs'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 21:44:40.978962 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-01fd13c5-4ea6-48bd-9557-abbc65edfd1c tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.059873 Oct 22 21:44:40.979704 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3063/6099] 10.222.0.18 () {60 vars in 1159 bytes} [Sat Oct 22 21:44:40 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:44:42.015144 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-49519310-0bc2-4bc3-800b-5900f0ab3e92 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1627572265", "imageRef": "085e4478-6edc-4a69-8e08-f9831713eb65", "flavorRef": "452", "networks": [{"uuid": "b30b7e26-31bd-45b2-8fa9-a651e55ea1d5"}], "key_name": "tempest-TestNetworkBasicOps-461289642", "security_groups": [{"name": "tempest-secgroup-smoke-1147121452"}]}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:44:42.024932 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_api:SELECT=2 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:44:42.025644 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:SELECT=4 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:44:42.126278 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.network.neutron [None req-49519310-0bc2-4bc3-800b-5900f0ab3e92 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] validate_networks() for [('b30b7e26-31bd-45b2-8fa9-a651e55ea1d5', None, None, None, None, None)] {{(pid=138744) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 21:44:42.938414 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-49519310-0bc2-4bc3-800b-5900f0ab3e92 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Flavor limits 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 21:44:42.938853 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-49519310-0bc2-4bc3-800b-5900f0ab3e92 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Image limits 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 21:44:42.939592 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-49519310-0bc2-4bc3-800b-5900f0ab3e92 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Flavor pref 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 21:44:42.940242 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-49519310-0bc2-4bc3-800b-5900f0ab3e92 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Image pref 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 21:44:42.940817 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-49519310-0bc2-4bc3-800b-5900f0ab3e92 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 21:44:42.952364 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-49519310-0bc2-4bc3-800b-5900f0ab3e92 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:44:42.952887 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-49519310-0bc2-4bc3-800b-5900f0ab3e92 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:44:42.953290 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-49519310-0bc2-4bc3-800b-5900f0ab3e92 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:44:42.954026 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-49519310-0bc2-4bc3-800b-5900f0ab3e92 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:44:42.954493 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-49519310-0bc2-4bc3-800b-5900f0ab3e92 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:44:42.954929 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-49519310-0bc2-4bc3-800b-5900f0ab3e92 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:44:42.973152 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-49519310-0bc2-4bc3-800b-5900f0ab3e92 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Getting quotas for project 03adeffad1764ecf83ff0dd066814749. Resources: {'cores', 'instances', 'ram'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 21:44:42.978617 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-49519310-0bc2-4bc3-800b-5900f0ab3e92 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Getting quotas for user be3ea0672cee498ebffe3190962df106 and project 03adeffad1764ecf83ff0dd066814749. Resources: {'cores', 'instances', 'ram'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 21:44:42.991316 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-49519310-0bc2-4bc3-800b-5900f0ab3e92 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Going to run 1 instances... {{(pid=138744) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 21:44:42.993815 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-49519310-0bc2-4bc3-800b-5900f0ab3e92 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] [instance: f09ecdcf-eb9b-44f8-a0e1-2d328ace9e56] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='085e4478-6edc-4a69-8e08-f9831713eb65',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138744) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 21:44:43.044413 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-49519310-0bc2-4bc3-800b-5900f0ab3e92 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.033524 Oct 22 21:44:43.045271 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3037/6100] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Oct 22 21:44:42 2022] POST /compute/v2.1/servers => generated 406 bytes in 1035 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 21:44:43.057723 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-c7bc9c8e-7dd4-459d-a684-65d1a82c4056 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:44:43.058618 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-c7bc9c8e-7dd4-459d-a684-65d1a82c4056 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] [instance: f09ecdcf-eb9b-44f8-a0e1-2d328ace9e56] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:44:43.118330 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-c7bc9c8e-7dd4-459d-a684-65d1a82c4056 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3ea0672cee498ebffe3190962df106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03adeffad1764ecf83ff0dd066814749', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:44:43.126138 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-c7bc9c8e-7dd4-459d-a684-65d1a82c4056 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] 10.222.0.18 "GET /compute/v2.1/servers/f09ecdcf-eb9b-44f8-a0e1-2d328ace9e56" status: 200 len: 1248 microversion: 2.1 time: 0.073411 Oct 22 21:44:43.126716 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3064/6101] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:44:43 2022] GET /compute/v2.1/servers/f09ecdcf-eb9b-44f8-a0e1-2d328ace9e56 => generated 1248 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:44:44.150882 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-28fcf51e-38cf-411f-9e6a-9d6d4174ca25 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:44:44.151651 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-28fcf51e-38cf-411f-9e6a-9d6d4174ca25 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] [instance: f09ecdcf-eb9b-44f8-a0e1-2d328ace9e56] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:44:44.209746 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-28fcf51e-38cf-411f-9e6a-9d6d4174ca25 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3ea0672cee498ebffe3190962df106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03adeffad1764ecf83ff0dd066814749', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:44:44.217099 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-28fcf51e-38cf-411f-9e6a-9d6d4174ca25 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] 10.222.0.18 "GET /compute/v2.1/servers/f09ecdcf-eb9b-44f8-a0e1-2d328ace9e56" status: 200 len: 1248 microversion: 2.1 time: 0.071072 Oct 22 21:44:44.217675 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3038/6102] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:44:44 2022] GET /compute/v2.1/servers/f09ecdcf-eb9b-44f8-a0e1-2d328ace9e56 => generated 1248 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:44:45.241241 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-a16ce3d1-c080-4a10-bfa7-8536549c1798 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:44:45.241796 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-a16ce3d1-c080-4a10-bfa7-8536549c1798 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] [instance: f09ecdcf-eb9b-44f8-a0e1-2d328ace9e56] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:44:45.250197 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a16ce3d1-c080-4a10-bfa7-8536549c1798 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:44:45.250709 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a16ce3d1-c080-4a10-bfa7-8536549c1798 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:44:45.251173 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a16ce3d1-c080-4a10-bfa7-8536549c1798 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:44:45.252000 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a16ce3d1-c080-4a10-bfa7-8536549c1798 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:44:45.252523 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a16ce3d1-c080-4a10-bfa7-8536549c1798 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:44:45.252973 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a16ce3d1-c080-4a10-bfa7-8536549c1798 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:44:45.317341 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-a16ce3d1-c080-4a10-bfa7-8536549c1798 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3ea0672cee498ebffe3190962df106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03adeffad1764ecf83ff0dd066814749', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:44:45.326198 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-a16ce3d1-c080-4a10-bfa7-8536549c1798 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] 10.222.0.18 "GET /compute/v2.1/servers/f09ecdcf-eb9b-44f8-a0e1-2d328ace9e56" status: 200 len: 1300 microversion: 2.1 time: 0.089073 Oct 22 21:44:45.326776 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3065/6103] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:44:45 2022] GET /compute/v2.1/servers/f09ecdcf-eb9b-44f8-a0e1-2d328ace9e56 => generated 1300 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:44:46.350873 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-cf4264e4-9295-4179-b650-8842d5d6aca0 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:44:46.351565 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-cf4264e4-9295-4179-b650-8842d5d6aca0 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] [instance: f09ecdcf-eb9b-44f8-a0e1-2d328ace9e56] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:44:46.360370 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cf4264e4-9295-4179-b650-8842d5d6aca0 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:44:46.360946 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cf4264e4-9295-4179-b650-8842d5d6aca0 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:44:46.361669 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cf4264e4-9295-4179-b650-8842d5d6aca0 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:44:46.362352 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cf4264e4-9295-4179-b650-8842d5d6aca0 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:44:46.362805 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cf4264e4-9295-4179-b650-8842d5d6aca0 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:44:46.363280 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cf4264e4-9295-4179-b650-8842d5d6aca0 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:44:46.646157 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-cf4264e4-9295-4179-b650-8842d5d6aca0 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3ea0672cee498ebffe3190962df106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03adeffad1764ecf83ff0dd066814749', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:44:46.656322 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-cf4264e4-9295-4179-b650-8842d5d6aca0 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] 10.222.0.18 "GET /compute/v2.1/servers/f09ecdcf-eb9b-44f8-a0e1-2d328ace9e56" status: 200 len: 1374 microversion: 2.1 time: 0.309883 Oct 22 21:44:46.657082 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3039/6104] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:44:46 2022] GET /compute/v2.1/servers/f09ecdcf-eb9b-44f8-a0e1-2d328ace9e56 => generated 1374 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:44:47.063661 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-c374344e-ba14-414a-990b-33d487ecd515 req-31f32356-4754-426d-bef0-d7254238fcb1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f09ecdcf-eb9b-44f8-a0e1-2d328ace9e56", "tag": "facddf6c-81b9-4ac7-8d54-4a292e890e7e"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:44:47.080028 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-c374344e-ba14-414a-990b-33d487ecd515 req-31f32356-4754-426d-bef0-d7254238fcb1 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:44:47.080483 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-c374344e-ba14-414a-990b-33d487ecd515 req-31f32356-4754-426d-bef0-d7254238fcb1 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:44:47.080932 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-c374344e-ba14-414a-990b-33d487ecd515 req-31f32356-4754-426d-bef0-d7254238fcb1 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:44:47.097847 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-c374344e-ba14-414a-990b-33d487ecd515 req-31f32356-4754-426d-bef0-d7254238fcb1 service nova] Creating event network-changed:facddf6c-81b9-4ac7-8d54-4a292e890e7e for instance f09ecdcf-eb9b-44f8-a0e1-2d328ace9e56 on nch2-master-1 Oct 22 21:44:47.102755 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-c374344e-ba14-414a-990b-33d487ecd515 req-31f32356-4754-426d-bef0-d7254238fcb1 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043012 Oct 22 21:44:47.103471 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3066/6105] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:44:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:44:47.680579 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-febf142e-c300-4507-a4c3-923fae1ca393 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:44:47.681208 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-febf142e-c300-4507-a4c3-923fae1ca393 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] [instance: f09ecdcf-eb9b-44f8-a0e1-2d328ace9e56] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:44:47.688872 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-febf142e-c300-4507-a4c3-923fae1ca393 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:44:47.689365 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-febf142e-c300-4507-a4c3-923fae1ca393 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:44:47.689815 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-febf142e-c300-4507-a4c3-923fae1ca393 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:44:47.690520 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-febf142e-c300-4507-a4c3-923fae1ca393 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:44:47.690987 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-febf142e-c300-4507-a4c3-923fae1ca393 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:44:47.691455 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-febf142e-c300-4507-a4c3-923fae1ca393 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:44:47.829547 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-febf142e-c300-4507-a4c3-923fae1ca393 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3ea0672cee498ebffe3190962df106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03adeffad1764ecf83ff0dd066814749', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:44:47.841582 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-febf142e-c300-4507-a4c3-923fae1ca393 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] 10.222.0.18 "GET /compute/v2.1/servers/f09ecdcf-eb9b-44f8-a0e1-2d328ace9e56" status: 200 len: 1374 microversion: 2.1 time: 0.164779 Oct 22 21:44:47.842336 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3040/6106] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:44:47 2022] GET /compute/v2.1/servers/f09ecdcf-eb9b-44f8-a0e1-2d328ace9e56 => generated 1374 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:44:48.871803 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-42e707a5-20c0-4eda-b4f5-a2faacbeac71 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:44:48.872675 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-42e707a5-20c0-4eda-b4f5-a2faacbeac71 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] [instance: f09ecdcf-eb9b-44f8-a0e1-2d328ace9e56] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:44:48.881157 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-42e707a5-20c0-4eda-b4f5-a2faacbeac71 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:44:48.881662 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-42e707a5-20c0-4eda-b4f5-a2faacbeac71 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:44:48.882109 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-42e707a5-20c0-4eda-b4f5-a2faacbeac71 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:44:48.882835 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-42e707a5-20c0-4eda-b4f5-a2faacbeac71 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:44:48.883299 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-42e707a5-20c0-4eda-b4f5-a2faacbeac71 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:44:48.883769 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-42e707a5-20c0-4eda-b4f5-a2faacbeac71 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:44:49.104724 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-42e707a5-20c0-4eda-b4f5-a2faacbeac71 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3ea0672cee498ebffe3190962df106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03adeffad1764ecf83ff0dd066814749', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:44:49.112901 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-42e707a5-20c0-4eda-b4f5-a2faacbeac71 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] 10.222.0.18 "GET /compute/v2.1/servers/f09ecdcf-eb9b-44f8-a0e1-2d328ace9e56" status: 200 len: 1374 microversion: 2.1 time: 0.246903 Oct 22 21:44:49.113490 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3067/6107] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:44:48 2022] GET /compute/v2.1/servers/f09ecdcf-eb9b-44f8-a0e1-2d328ace9e56 => generated 1374 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:44:50.142944 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-909e60ab-22d2-41ba-b788-526ccf2a8f1a tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:44:50.143989 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-909e60ab-22d2-41ba-b788-526ccf2a8f1a tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] [instance: f09ecdcf-eb9b-44f8-a0e1-2d328ace9e56] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:44:50.154333 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-909e60ab-22d2-41ba-b788-526ccf2a8f1a tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:44:50.154839 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-909e60ab-22d2-41ba-b788-526ccf2a8f1a tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:44:50.155282 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-909e60ab-22d2-41ba-b788-526ccf2a8f1a tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:44:50.156029 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-909e60ab-22d2-41ba-b788-526ccf2a8f1a tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:44:50.156487 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-909e60ab-22d2-41ba-b788-526ccf2a8f1a tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:44:50.157030 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-909e60ab-22d2-41ba-b788-526ccf2a8f1a tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:44:50.293891 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-909e60ab-22d2-41ba-b788-526ccf2a8f1a tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3ea0672cee498ebffe3190962df106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03adeffad1764ecf83ff0dd066814749', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:44:50.302039 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-909e60ab-22d2-41ba-b788-526ccf2a8f1a tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] 10.222.0.18 "GET /compute/v2.1/servers/f09ecdcf-eb9b-44f8-a0e1-2d328ace9e56" status: 200 len: 1374 microversion: 2.1 time: 0.165704 Oct 22 21:44:50.302617 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3041/6108] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:44:50 2022] GET /compute/v2.1/servers/f09ecdcf-eb9b-44f8-a0e1-2d328ace9e56 => generated 1374 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:44:51.010549 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-48229460-4964-40ab-a537-d3498cc1e5d6 req-255f9c3c-f01b-4793-8f81-89751b69fd78 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f09ecdcf-eb9b-44f8-a0e1-2d328ace9e56", "name": "network-vif-plugged", "status": "completed", "tag": "facddf6c-81b9-4ac7-8d54-4a292e890e7e"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:44:51.020716 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-48229460-4964-40ab-a537-d3498cc1e5d6 req-255f9c3c-f01b-4793-8f81-89751b69fd78 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:44:51.021225 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-48229460-4964-40ab-a537-d3498cc1e5d6 req-255f9c3c-f01b-4793-8f81-89751b69fd78 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:44:51.021682 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-48229460-4964-40ab-a537-d3498cc1e5d6 req-255f9c3c-f01b-4793-8f81-89751b69fd78 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:44:51.033382 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-48229460-4964-40ab-a537-d3498cc1e5d6 req-255f9c3c-f01b-4793-8f81-89751b69fd78 service nova] Creating event network-vif-plugged:facddf6c-81b9-4ac7-8d54-4a292e890e7e for instance f09ecdcf-eb9b-44f8-a0e1-2d328ace9e56 on nch2-master-1 Oct 22 21:44:51.038665 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-48229460-4964-40ab-a537-d3498cc1e5d6 req-255f9c3c-f01b-4793-8f81-89751b69fd78 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.161694 Oct 22 21:44:51.039318 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3068/6109] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:44:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:44:51.328135 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-8744a414-5473-4056-af4d-58b3170bb0f6 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:44:51.328840 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-8744a414-5473-4056-af4d-58b3170bb0f6 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] [instance: f09ecdcf-eb9b-44f8-a0e1-2d328ace9e56] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:44:51.337386 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8744a414-5473-4056-af4d-58b3170bb0f6 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:44:51.337974 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8744a414-5473-4056-af4d-58b3170bb0f6 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:44:51.338504 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8744a414-5473-4056-af4d-58b3170bb0f6 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:44:51.339366 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8744a414-5473-4056-af4d-58b3170bb0f6 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:44:51.340122 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8744a414-5473-4056-af4d-58b3170bb0f6 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:44:51.340645 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8744a414-5473-4056-af4d-58b3170bb0f6 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:44:51.481381 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-8744a414-5473-4056-af4d-58b3170bb0f6 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3ea0672cee498ebffe3190962df106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03adeffad1764ecf83ff0dd066814749', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:44:51.489823 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-8744a414-5473-4056-af4d-58b3170bb0f6 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] 10.222.0.18 "GET /compute/v2.1/servers/f09ecdcf-eb9b-44f8-a0e1-2d328ace9e56" status: 200 len: 1374 microversion: 2.1 time: 0.167265 Oct 22 21:44:51.490419 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3042/6110] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:44:51 2022] GET /compute/v2.1/servers/f09ecdcf-eb9b-44f8-a0e1-2d328ace9e56 => generated 1374 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:44:52.513889 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-dbed7bb3-7a8d-448f-af0b-2e8340a6671c tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:44:52.514610 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-dbed7bb3-7a8d-448f-af0b-2e8340a6671c tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] [instance: f09ecdcf-eb9b-44f8-a0e1-2d328ace9e56] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:44:52.522014 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-dbed7bb3-7a8d-448f-af0b-2e8340a6671c tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:44:52.522514 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-dbed7bb3-7a8d-448f-af0b-2e8340a6671c tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:44:52.522972 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-dbed7bb3-7a8d-448f-af0b-2e8340a6671c tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:44:52.523713 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-dbed7bb3-7a8d-448f-af0b-2e8340a6671c tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:44:52.524183 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-dbed7bb3-7a8d-448f-af0b-2e8340a6671c tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:44:52.524627 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-dbed7bb3-7a8d-448f-af0b-2e8340a6671c tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:44:52.786228 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-dbed7bb3-7a8d-448f-af0b-2e8340a6671c tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3ea0672cee498ebffe3190962df106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03adeffad1764ecf83ff0dd066814749', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:44:52.794934 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-dbed7bb3-7a8d-448f-af0b-2e8340a6671c tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] 10.222.0.18 "GET /compute/v2.1/servers/f09ecdcf-eb9b-44f8-a0e1-2d328ace9e56" status: 200 len: 1546 microversion: 2.1 time: 0.285261 Oct 22 21:44:52.795543 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3069/6111] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:44:52 2022] GET /compute/v2.1/servers/f09ecdcf-eb9b-44f8-a0e1-2d328ace9e56 => generated 1546 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:44:52.818625 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-b0910424-8b8d-47c1-9813-5e59b46cda22 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:44:52.819251 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-b0910424-8b8d-47c1-9813-5e59b46cda22 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] [instance: f09ecdcf-eb9b-44f8-a0e1-2d328ace9e56] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:44:52.826918 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b0910424-8b8d-47c1-9813-5e59b46cda22 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:44:52.827449 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b0910424-8b8d-47c1-9813-5e59b46cda22 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:44:52.827997 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b0910424-8b8d-47c1-9813-5e59b46cda22 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:44:52.828714 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b0910424-8b8d-47c1-9813-5e59b46cda22 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:44:52.829178 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b0910424-8b8d-47c1-9813-5e59b46cda22 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:44:52.829622 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b0910424-8b8d-47c1-9813-5e59b46cda22 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:44:52.962671 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell0:SELECT=2 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:44:53.046781 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-b0910424-8b8d-47c1-9813-5e59b46cda22 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3ea0672cee498ebffe3190962df106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03adeffad1764ecf83ff0dd066814749', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:44:53.055264 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-b0910424-8b8d-47c1-9813-5e59b46cda22 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] 10.222.0.18 "GET /compute/v2.1/servers/f09ecdcf-eb9b-44f8-a0e1-2d328ace9e56" status: 200 len: 1546 microversion: 2.1 time: 0.240775 Oct 22 21:44:53.055918 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3043/6112] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:44:52 2022] GET /compute/v2.1/servers/f09ecdcf-eb9b-44f8-a0e1-2d328ace9e56 => generated 1546 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:45:20.912358 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-70d17eaf-0e6b-4625-8414-02b7bcb5bbf1 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:45:20.912980 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-70d17eaf-0e6b-4625-8414-02b7bcb5bbf1 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] [instance: f09ecdcf-eb9b-44f8-a0e1-2d328ace9e56] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:45:20.916656 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell0:SELECT=6 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:45:20.918026 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_api:SELECT=25,nova_api:INSERT=1 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:45:20.918656 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell1:SELECT=22 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:45:20.923107 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-70d17eaf-0e6b-4625-8414-02b7bcb5bbf1 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:45:20.923678 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-70d17eaf-0e6b-4625-8414-02b7bcb5bbf1 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:45:20.924077 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-70d17eaf-0e6b-4625-8414-02b7bcb5bbf1 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:45:20.924798 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-70d17eaf-0e6b-4625-8414-02b7bcb5bbf1 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:45:20.925469 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-70d17eaf-0e6b-4625-8414-02b7bcb5bbf1 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:45:20.926131 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-70d17eaf-0e6b-4625-8414-02b7bcb5bbf1 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:45:20.962866 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-70d17eaf-0e6b-4625-8414-02b7bcb5bbf1 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] [instance: f09ecdcf-eb9b-44f8-a0e1-2d328ace9e56] Going to try to terminate instance {{(pid=138745) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 21:45:21.048384 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-70d17eaf-0e6b-4625-8414-02b7bcb5bbf1 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] 10.222.0.18 "DELETE /compute/v2.1/servers/f09ecdcf-eb9b-44f8-a0e1-2d328ace9e56" status: 204 len: 0 microversion: 2.1 time: 0.139796 Oct 22 21:45:21.049139 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3070/6113] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 21:45:20 2022] DELETE /compute/v2.1/servers/f09ecdcf-eb9b-44f8-a0e1-2d328ace9e56 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 21:45:21.057803 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-d0d196f8-7886-4a40-95e6-4977379b76f7 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:45:21.058525 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-d0d196f8-7886-4a40-95e6-4977379b76f7 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] [instance: f09ecdcf-eb9b-44f8-a0e1-2d328ace9e56] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:45:21.061153 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell0:SELECT=8 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:45:21.061927 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:45:21.062708 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:SELECT=32 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:45:21.068557 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d0d196f8-7886-4a40-95e6-4977379b76f7 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:45:21.069216 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d0d196f8-7886-4a40-95e6-4977379b76f7 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:45:21.069764 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d0d196f8-7886-4a40-95e6-4977379b76f7 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:45:21.070663 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d0d196f8-7886-4a40-95e6-4977379b76f7 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:45:21.071227 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d0d196f8-7886-4a40-95e6-4977379b76f7 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:45:21.071764 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d0d196f8-7886-4a40-95e6-4977379b76f7 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:45:21.274058 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-d0d196f8-7886-4a40-95e6-4977379b76f7 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3ea0672cee498ebffe3190962df106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03adeffad1764ecf83ff0dd066814749', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:45:21.283134 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-d0d196f8-7886-4a40-95e6-4977379b76f7 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] 10.222.0.18 "GET /compute/v2.1/servers/f09ecdcf-eb9b-44f8-a0e1-2d328ace9e56" status: 200 len: 1552 microversion: 2.1 time: 0.229433 Oct 22 21:45:21.283791 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3044/6114] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:45:21 2022] GET /compute/v2.1/servers/f09ecdcf-eb9b-44f8-a0e1-2d328ace9e56 => generated 1552 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:45:22.308097 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-164395ab-9313-4c6d-9ae6-ca193079024c tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:45:22.308891 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-164395ab-9313-4c6d-9ae6-ca193079024c tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] [instance: f09ecdcf-eb9b-44f8-a0e1-2d328ace9e56] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:45:22.316168 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-164395ab-9313-4c6d-9ae6-ca193079024c tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:45:22.316671 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-164395ab-9313-4c6d-9ae6-ca193079024c tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:45:22.317130 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-164395ab-9313-4c6d-9ae6-ca193079024c tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:45:22.317855 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-164395ab-9313-4c6d-9ae6-ca193079024c tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:45:22.318361 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-164395ab-9313-4c6d-9ae6-ca193079024c tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:45:22.318807 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-164395ab-9313-4c6d-9ae6-ca193079024c tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:45:22.454997 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-164395ab-9313-4c6d-9ae6-ca193079024c tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3ea0672cee498ebffe3190962df106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03adeffad1764ecf83ff0dd066814749', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:45:22.463980 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-164395ab-9313-4c6d-9ae6-ca193079024c tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] 10.222.0.18 "GET /compute/v2.1/servers/f09ecdcf-eb9b-44f8-a0e1-2d328ace9e56" status: 200 len: 1552 microversion: 2.1 time: 0.160867 Oct 22 21:45:22.464571 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3071/6115] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:45:22 2022] GET /compute/v2.1/servers/f09ecdcf-eb9b-44f8-a0e1-2d328ace9e56 => generated 1552 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:45:22.967241 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-95d47eef-f8f4-4c64-bbb4-26538ba6e59c req-50f815ea-2e7f-441b-bcf4-87e6b03d7213 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f09ecdcf-eb9b-44f8-a0e1-2d328ace9e56", "name": "network-vif-deleted", "tag": "facddf6c-81b9-4ac7-8d54-4a292e890e7e"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:45:22.978745 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-95d47eef-f8f4-4c64-bbb4-26538ba6e59c req-50f815ea-2e7f-441b-bcf4-87e6b03d7213 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:45:22.979138 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-95d47eef-f8f4-4c64-bbb4-26538ba6e59c req-50f815ea-2e7f-441b-bcf4-87e6b03d7213 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:45:22.979682 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-95d47eef-f8f4-4c64-bbb4-26538ba6e59c req-50f815ea-2e7f-441b-bcf4-87e6b03d7213 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:45:22.991944 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-95d47eef-f8f4-4c64-bbb4-26538ba6e59c req-50f815ea-2e7f-441b-bcf4-87e6b03d7213 service nova] Creating event network-vif-deleted:facddf6c-81b9-4ac7-8d54-4a292e890e7e for instance f09ecdcf-eb9b-44f8-a0e1-2d328ace9e56 on nch2-master-1 Oct 22 21:45:22.997379 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-95d47eef-f8f4-4c64-bbb4-26538ba6e59c req-50f815ea-2e7f-441b-bcf4-87e6b03d7213 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033957 Oct 22 21:45:22.997993 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3045/6116] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:45:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:45:23.491247 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-84d64fa3-6d60-405a-b86e-5635de5e36b9 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:45:23.491855 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-84d64fa3-6d60-405a-b86e-5635de5e36b9 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] [instance: f09ecdcf-eb9b-44f8-a0e1-2d328ace9e56] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:45:23.500164 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-84d64fa3-6d60-405a-b86e-5635de5e36b9 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:45:23.500672 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-84d64fa3-6d60-405a-b86e-5635de5e36b9 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:45:23.501121 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-84d64fa3-6d60-405a-b86e-5635de5e36b9 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:45:23.501839 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-84d64fa3-6d60-405a-b86e-5635de5e36b9 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:45:23.503216 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-84d64fa3-6d60-405a-b86e-5635de5e36b9 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:45:23.503760 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-84d64fa3-6d60-405a-b86e-5635de5e36b9 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:45:23.537045 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-84d64fa3-6d60-405a-b86e-5635de5e36b9 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:45:23.537550 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-84d64fa3-6d60-405a-b86e-5635de5e36b9 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:45:23.538007 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-84d64fa3-6d60-405a-b86e-5635de5e36b9 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:45:23.538480 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.objects.instance [None req-84d64fa3-6d60-405a-b86e-5635de5e36b9 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Lazy-loading 'fault' on Instance uuid f09ecdcf-eb9b-44f8-a0e1-2d328ace9e56 {{(pid=138745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 21:45:23.583925 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-84d64fa3-6d60-405a-b86e-5635de5e36b9 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3ea0672cee498ebffe3190962df106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03adeffad1764ecf83ff0dd066814749', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:45:23.592631 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-84d64fa3-6d60-405a-b86e-5635de5e36b9 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] 10.222.0.18 "GET /compute/v2.1/servers/f09ecdcf-eb9b-44f8-a0e1-2d328ace9e56" status: 200 len: 1338 microversion: 2.1 time: 0.106133 Oct 22 21:45:23.593517 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3072/6117] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:45:23 2022] GET /compute/v2.1/servers/f09ecdcf-eb9b-44f8-a0e1-2d328ace9e56 => generated 1338 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:45:24.621188 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-d63c1917-e7af-431f-bc27-7fc75ffbd6ca tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:45:24.621893 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-d63c1917-e7af-431f-bc27-7fc75ffbd6ca tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] [instance: f09ecdcf-eb9b-44f8-a0e1-2d328ace9e56] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:45:24.628598 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d63c1917-e7af-431f-bc27-7fc75ffbd6ca tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:45:24.629103 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d63c1917-e7af-431f-bc27-7fc75ffbd6ca tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:45:24.629558 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d63c1917-e7af-431f-bc27-7fc75ffbd6ca tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:45:24.630264 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d63c1917-e7af-431f-bc27-7fc75ffbd6ca tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:45:24.630728 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d63c1917-e7af-431f-bc27-7fc75ffbd6ca tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:45:24.631157 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d63c1917-e7af-431f-bc27-7fc75ffbd6ca tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:45:24.645525 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-d63c1917-e7af-431f-bc27-7fc75ffbd6ca tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] HTTP exception thrown: Instance f09ecdcf-eb9b-44f8-a0e1-2d328ace9e56 could not be found. Oct 22 21:45:24.647200 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-d63c1917-e7af-431f-bc27-7fc75ffbd6ca tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Request method failure captured: Oct 22 21:45:24.647200 ncdv-master-1 devstack@n-api.service[138744]: request: GET /compute/v2.1/servers/f09ecdcf-eb9b-44f8-a0e1-2d328ace9e56 HTTP/1.1 Oct 22 21:45:24.647200 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 21:45:24.647200 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 21:45:24.647200 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 21:45:24.647200 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 0 Oct 22 21:45:24.647200 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 21:45:24.647200 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 21:45:24.647200 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 21:45:24.647200 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 21:45:24.647200 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVGPrLjPbNQGgVSGKyCQK8QodVfI3TxOkAe11wAc-BUZLns60KyHU-HfACChYFfEO0026x9uyDDNBPDi7ErMlVmSJOLTzU0fTlwG-dU6BQCDTuzrV7zMacsAa8GKPjChtr060h6ENejugzGGz8iAOSM7ty4HA-R6xTxW6N6hJpw9z0f8 Oct 22 21:45:24.647200 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 21:45:24.647200 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 21:45:24.647200 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 21:45:24.647200 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 21:45:24.647200 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 21:45:24.647200 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 21:45:24.647200 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: 03adeffad1764ecf83ff0dd066814749 Oct 22 21:45:24.647200 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-TestNetworkBasicOps-1900775247 Oct 22 21:45:24.647200 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 21:45:24.647200 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 21:45:24.647200 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_03adeffad1764ecf83ff0dd066814749"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/03adeffad1764ecf83ff0dd066814749"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/03adeffad1764ecf83ff0dd066814749"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/03adeffad1764ecf83ff0dd066814749"}]}] Oct 22 21:45:24.647200 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-TestNetworkBasicOps-1900775247 Oct 22 21:45:24.647200 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: 03adeffad1764ecf83ff0dd066814749 Oct 22 21:45:24.647200 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-TestNetworkBasicOps-1900775247 Oct 22 21:45:24.647200 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-TestNetworkBasicOps-1900775247-project Oct 22 21:45:24.647200 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 21:45:24.647200 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 21:45:24.647200 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: be3ea0672cee498ebffe3190962df106 Oct 22 21:45:24.647200 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-TestNetworkBasicOps-1900775247-project Oct 22 21:45:24.647200 ncdv-master-1 devstack@n-api.service[138744]: method: > Oct 22 21:45:24.647200 ncdv-master-1 devstack@n-api.service[138744]: exception: Instance f09ecdcf-eb9b-44f8-a0e1-2d328ace9e56 could not be found. Oct 22 21:45:24.647200 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': 'f09ecdcf-eb9b-44f8-a0e1-2d328ace9e56'} Oct 22 21:45:24.647200 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:45:24.647200 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:45:24.647200 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 21:45:24.647200 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 21:45:24.647200 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 21:45:24.647200 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 21:45:24.647200 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 21:45:24.647200 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 21:45:24.647200 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 21:45:24.647200 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 21:45:24.647200 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f09ecdcf-eb9b-44f8-a0e1-2d328ace9e56 could not be found. Oct 22 21:45:24.647200 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:45:24.647200 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:45:24.647200 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:45:24.647200 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:45:24.647200 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:45:24.647200 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:45:24.647200 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:45:24.647200 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:45:24.647200 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:45:24.647200 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:45:24.647200 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 21:45:24.647200 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 21:45:24.647200 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 21:45:24.647200 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 21:45:24.647200 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 21:45:24.647200 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:45:24.647200 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f09ecdcf-eb9b-44f8-a0e1-2d328ace9e56 could not be found. Oct 22 21:45:24.647200 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:45:24.647200 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:45:24.647200 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:45:24.652759 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:45:24.652759 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:45:24.652759 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:45:24.652759 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:45:24.652759 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:45:24.652759 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f09ecdcf-eb9b-44f8-a0e1-2d328ace9e56 could not be found. Oct 22 21:45:24.652759 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:45:24.652759 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-d63c1917-e7af-431f-bc27-7fc75ffbd6ca tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Returning 404 to user: Instance f09ecdcf-eb9b-44f8-a0e1-2d328ace9e56 could not be found. {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:45:24.652759 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-d63c1917-e7af-431f-bc27-7fc75ffbd6ca tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] 10.222.0.18 "GET /compute/v2.1/servers/f09ecdcf-eb9b-44f8-a0e1-2d328ace9e56" status: 404 len: 111 microversion: 2.1 time: 0.033071 Oct 22 21:45:24.652759 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3046/6118] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:45:24 2022] GET /compute/v2.1/servers/f09ecdcf-eb9b-44f8-a0e1-2d328ace9e56 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 21:45:24.827128 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-f68dc7c6-d3ca-4c7a-aa46-36cb9f212684 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Calling method '.version_select at 0x7fd3a47e6430>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:45:24.854628 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-f68dc7c6-d3ca-4c7a-aa46-36cb9f212684 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-461289642" status: 202 len: 0 microversion: 2.1 time: 0.032993 Oct 22 21:45:24.855222 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3073/6119] 10.222.0.18 () {58 vars in 1254 bytes} [Sat Oct 22 21:45:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-461289642 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 22 21:45:26.570518 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-05599995-6027-40a6-ae17-21d9d5a7ca58 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:45:26.571031 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-05599995-6027-40a6-ae17-21d9d5a7ca58 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] [instance: c24f5240-f803-4796-b4c1-e8899b62ad75] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:45:26.573428 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-298377b5-3993-4e18-8319-1c5ff4ca30bf req-d6454c83-28c2-437b-a0ec-acf1849a3567 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c24f5240-f803-4796-b4c1-e8899b62ad75", "tag": "bc3a1f90-b4d4-4d69-842e-8276a4598001"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:45:26.579610 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-05599995-6027-40a6-ae17-21d9d5a7ca58 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:45:26.580172 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-05599995-6027-40a6-ae17-21d9d5a7ca58 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:45:26.580790 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-05599995-6027-40a6-ae17-21d9d5a7ca58 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:45:26.581554 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-05599995-6027-40a6-ae17-21d9d5a7ca58 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:45:26.582070 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-05599995-6027-40a6-ae17-21d9d5a7ca58 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:45:26.582569 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-05599995-6027-40a6-ae17-21d9d5a7ca58 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:45:26.596246 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-298377b5-3993-4e18-8319-1c5ff4ca30bf req-d6454c83-28c2-437b-a0ec-acf1849a3567 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:45:26.596878 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-298377b5-3993-4e18-8319-1c5ff4ca30bf req-d6454c83-28c2-437b-a0ec-acf1849a3567 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:45:26.597423 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-298377b5-3993-4e18-8319-1c5ff4ca30bf req-d6454c83-28c2-437b-a0ec-acf1849a3567 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:45:26.613435 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-298377b5-3993-4e18-8319-1c5ff4ca30bf req-d6454c83-28c2-437b-a0ec-acf1849a3567 service nova] Creating event network-changed:bc3a1f90-b4d4-4d69-842e-8276a4598001 for instance c24f5240-f803-4796-b4c1-e8899b62ad75 on nch1-master-1 Oct 22 21:45:26.617750 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-05599995-6027-40a6-ae17-21d9d5a7ca58 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] [instance: c24f5240-f803-4796-b4c1-e8899b62ad75] Going to try to terminate instance {{(pid=138744) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 21:45:26.620219 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-298377b5-3993-4e18-8319-1c5ff4ca30bf req-d6454c83-28c2-437b-a0ec-acf1849a3567 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050975 Oct 22 21:45:26.621345 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3074/6120] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:45:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:45:26.724732 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-05599995-6027-40a6-ae17-21d9d5a7ca58 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] 10.222.0.18 "DELETE /compute/v2.1/servers/c24f5240-f803-4796-b4c1-e8899b62ad75" status: 204 len: 0 microversion: 2.1 time: 0.157907 Oct 22 21:45:26.725790 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3047/6121] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 21:45:26 2022] DELETE /compute/v2.1/servers/c24f5240-f803-4796-b4c1-e8899b62ad75 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 21:45:26.735918 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-499cfb62-792f-47c8-9a23-29b597d539c1 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:45:26.736990 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-499cfb62-792f-47c8-9a23-29b597d539c1 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] [instance: c24f5240-f803-4796-b4c1-e8899b62ad75] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:45:26.743927 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-499cfb62-792f-47c8-9a23-29b597d539c1 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:45:26.744443 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-499cfb62-792f-47c8-9a23-29b597d539c1 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:45:26.744891 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-499cfb62-792f-47c8-9a23-29b597d539c1 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:45:26.745645 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-499cfb62-792f-47c8-9a23-29b597d539c1 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:45:26.746107 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-499cfb62-792f-47c8-9a23-29b597d539c1 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:45:26.746543 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-499cfb62-792f-47c8-9a23-29b597d539c1 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:45:26.917475 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-499cfb62-792f-47c8-9a23-29b597d539c1 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3ea0672cee498ebffe3190962df106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03adeffad1764ecf83ff0dd066814749', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:45:26.926367 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-499cfb62-792f-47c8-9a23-29b597d539c1 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] 10.222.0.18 "GET /compute/v2.1/servers/c24f5240-f803-4796-b4c1-e8899b62ad75" status: 200 len: 1670 microversion: 2.1 time: 0.195275 Oct 22 21:45:26.927232 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3075/6122] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:45:26 2022] GET /compute/v2.1/servers/c24f5240-f803-4796-b4c1-e8899b62ad75 => generated 1670 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:45:27.951084 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-90fc62f0-0ad6-4b62-8386-f39de0ca8a5b tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:45:27.951834 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-90fc62f0-0ad6-4b62-8386-f39de0ca8a5b tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] [instance: c24f5240-f803-4796-b4c1-e8899b62ad75] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:45:27.959125 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-90fc62f0-0ad6-4b62-8386-f39de0ca8a5b tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:45:27.959649 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-90fc62f0-0ad6-4b62-8386-f39de0ca8a5b tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:45:27.960101 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-90fc62f0-0ad6-4b62-8386-f39de0ca8a5b tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:45:27.960818 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-90fc62f0-0ad6-4b62-8386-f39de0ca8a5b tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:45:27.961280 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-90fc62f0-0ad6-4b62-8386-f39de0ca8a5b tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:45:27.961717 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-90fc62f0-0ad6-4b62-8386-f39de0ca8a5b tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:45:28.468771 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-90fc62f0-0ad6-4b62-8386-f39de0ca8a5b tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3ea0672cee498ebffe3190962df106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03adeffad1764ecf83ff0dd066814749', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:45:28.477673 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-90fc62f0-0ad6-4b62-8386-f39de0ca8a5b tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] 10.222.0.18 "GET /compute/v2.1/servers/c24f5240-f803-4796-b4c1-e8899b62ad75" status: 200 len: 1670 microversion: 2.1 time: 0.531235 Oct 22 21:45:28.478327 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3048/6123] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:45:27 2022] GET /compute/v2.1/servers/c24f5240-f803-4796-b4c1-e8899b62ad75 => generated 1670 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:45:28.744145 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-99e41521-4596-4475-95a7-88575d708cf6 req-0095b94a-0c9f-4d91-acd4-f2c59e54165f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c24f5240-f803-4796-b4c1-e8899b62ad75", "name": "network-vif-deleted", "tag": "bc3a1f90-b4d4-4d69-842e-8276a4598001"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:45:28.764306 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-99e41521-4596-4475-95a7-88575d708cf6 req-0095b94a-0c9f-4d91-acd4-f2c59e54165f service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:45:28.764837 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-99e41521-4596-4475-95a7-88575d708cf6 req-0095b94a-0c9f-4d91-acd4-f2c59e54165f service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:45:28.765272 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-99e41521-4596-4475-95a7-88575d708cf6 req-0095b94a-0c9f-4d91-acd4-f2c59e54165f service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:45:28.777829 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-99e41521-4596-4475-95a7-88575d708cf6 req-0095b94a-0c9f-4d91-acd4-f2c59e54165f service nova] Creating event network-vif-deleted:bc3a1f90-b4d4-4d69-842e-8276a4598001 for instance c24f5240-f803-4796-b4c1-e8899b62ad75 on nch1-master-1 Oct 22 21:45:28.782728 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-99e41521-4596-4475-95a7-88575d708cf6 req-0095b94a-0c9f-4d91-acd4-f2c59e54165f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042634 Oct 22 21:45:28.783320 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3076/6124] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:45:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:45:29.506881 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-af30cae9-f729-4924-bec8-6fecc05f9ab6 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:45:29.508004 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-af30cae9-f729-4924-bec8-6fecc05f9ab6 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] [instance: c24f5240-f803-4796-b4c1-e8899b62ad75] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:45:29.519175 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-af30cae9-f729-4924-bec8-6fecc05f9ab6 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:45:29.520051 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-af30cae9-f729-4924-bec8-6fecc05f9ab6 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:45:29.520792 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-af30cae9-f729-4924-bec8-6fecc05f9ab6 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:45:29.522000 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-af30cae9-f729-4924-bec8-6fecc05f9ab6 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:45:29.522774 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-af30cae9-f729-4924-bec8-6fecc05f9ab6 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:45:29.523543 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-af30cae9-f729-4924-bec8-6fecc05f9ab6 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:45:29.548974 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-af30cae9-f729-4924-bec8-6fecc05f9ab6 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] HTTP exception thrown: Instance c24f5240-f803-4796-b4c1-e8899b62ad75 could not be found. Oct 22 21:45:29.551379 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-af30cae9-f729-4924-bec8-6fecc05f9ab6 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Request method failure captured: Oct 22 21:45:29.551379 ncdv-master-1 devstack@n-api.service[138744]: request: GET /compute/v2.1/servers/c24f5240-f803-4796-b4c1-e8899b62ad75 HTTP/1.1 Oct 22 21:45:29.551379 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 21:45:29.551379 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 21:45:29.551379 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 21:45:29.551379 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 0 Oct 22 21:45:29.551379 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 21:45:29.551379 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 21:45:29.551379 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 21:45:29.551379 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 21:45:29.551379 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVGPrLjPbNQGgVSGKyCQK8QodVfI3TxOkAe11wAc-BUZLns60KyHU-HfACChYFfEO0026x9uyDDNBPDi7ErMlVmSJOLTzU0fTlwG-dU6BQCDTuzrV7zMacsAa8GKPjChtr060h6ENejugzGGz8iAOSM7ty4HA-R6xTxW6N6hJpw9z0f8 Oct 22 21:45:29.551379 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 21:45:29.551379 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 21:45:29.551379 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 21:45:29.551379 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 21:45:29.551379 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 21:45:29.551379 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 21:45:29.551379 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: 03adeffad1764ecf83ff0dd066814749 Oct 22 21:45:29.551379 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-TestNetworkBasicOps-1900775247 Oct 22 21:45:29.551379 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 21:45:29.551379 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 21:45:29.551379 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_03adeffad1764ecf83ff0dd066814749"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/03adeffad1764ecf83ff0dd066814749"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/03adeffad1764ecf83ff0dd066814749"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/03adeffad1764ecf83ff0dd066814749"}]}] Oct 22 21:45:29.551379 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-TestNetworkBasicOps-1900775247 Oct 22 21:45:29.551379 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: 03adeffad1764ecf83ff0dd066814749 Oct 22 21:45:29.551379 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-TestNetworkBasicOps-1900775247 Oct 22 21:45:29.551379 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-TestNetworkBasicOps-1900775247-project Oct 22 21:45:29.551379 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 21:45:29.551379 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 21:45:29.551379 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: be3ea0672cee498ebffe3190962df106 Oct 22 21:45:29.551379 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-TestNetworkBasicOps-1900775247-project Oct 22 21:45:29.551379 ncdv-master-1 devstack@n-api.service[138744]: method: > Oct 22 21:45:29.551379 ncdv-master-1 devstack@n-api.service[138744]: exception: Instance c24f5240-f803-4796-b4c1-e8899b62ad75 could not be found. Oct 22 21:45:29.551379 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': 'c24f5240-f803-4796-b4c1-e8899b62ad75'} Oct 22 21:45:29.551379 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:45:29.551379 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:45:29.551379 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 21:45:29.551379 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 21:45:29.551379 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 21:45:29.551379 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 21:45:29.551379 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 21:45:29.551379 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 21:45:29.551379 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 21:45:29.551379 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 21:45:29.551379 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c24f5240-f803-4796-b4c1-e8899b62ad75 could not be found. Oct 22 21:45:29.551379 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:45:29.551379 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:45:29.551379 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:45:29.551379 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:45:29.551379 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:45:29.551379 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:45:29.551379 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:45:29.551379 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:45:29.551379 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:45:29.551379 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:45:29.551379 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 21:45:29.551379 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 21:45:29.551379 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 21:45:29.551379 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 21:45:29.551379 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 21:45:29.551379 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:45:29.551379 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c24f5240-f803-4796-b4c1-e8899b62ad75 could not be found. Oct 22 21:45:29.551379 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:45:29.551379 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:45:29.551379 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:45:29.556272 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:45:29.556272 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:45:29.556272 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:45:29.556272 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:45:29.556272 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:45:29.556272 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c24f5240-f803-4796-b4c1-e8899b62ad75 could not be found. Oct 22 21:45:29.556272 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:45:29.556272 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-af30cae9-f729-4924-bec8-6fecc05f9ab6 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Returning 404 to user: Instance c24f5240-f803-4796-b4c1-e8899b62ad75 could not be found. {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:45:29.556272 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-af30cae9-f729-4924-bec8-6fecc05f9ab6 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] 10.222.0.18 "GET /compute/v2.1/servers/c24f5240-f803-4796-b4c1-e8899b62ad75" status: 404 len: 111 microversion: 2.1 time: 0.052823 Oct 22 21:45:29.556272 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3049/6125] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:45:29 2022] GET /compute/v2.1/servers/c24f5240-f803-4796-b4c1-e8899b62ad75 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 21:45:29.733876 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-666df596-05a7-4e12-bd2e-dff4780d03eb tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Calling method '.version_select at 0x7fd39fcd88b0>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:45:29.754660 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-666df596-05a7-4e12-bd2e-dff4780d03eb tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-2082764247" status: 202 len: 0 microversion: 2.1 time: 0.025507 Oct 22 21:45:29.758710 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3077/6126] 10.222.0.18 () {58 vars in 1257 bytes} [Sat Oct 22 21:45:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-2082764247 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 21:45:38.018825 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-66bf33d0-3fe5-4075-847a-232686f378ed tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Action: 'create', calling method: .version_select at 0x7fd39fee34c0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-765654562", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD10nttPbLi11Ctq5eI5mCi2njTjpJ5lt52b/DhCd/QwegLj60aOU08qsRFjnTJUaz2HEc0U+gpVvNao3Pf0CKUEb+u4LE/0GrQy56Dxh9L5yZBBwugFXQHyoi+EUT56SQ=="}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:45:38.035673 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-66bf33d0-3fe5-4075-847a-232686f378ed tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Getting quotas for project 03adeffad1764ecf83ff0dd066814749. Resources: {'key_pairs'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 21:45:38.040960 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-66bf33d0-3fe5-4075-847a-232686f378ed tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Getting quotas for user be3ea0672cee498ebffe3190962df106 and project 03adeffad1764ecf83ff0dd066814749. Resources: {'key_pairs'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 21:45:38.070457 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-66bf33d0-3fe5-4075-847a-232686f378ed tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.055778 Oct 22 21:45:38.071174 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3050/6127] 10.222.0.18 () {60 vars in 1159 bytes} [Sat Oct 22 21:45:38 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:45:39.073966 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell1:SELECT=38,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:45:39.078700 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-2fde1fc4-02f8-42f4-b6ab-3baa88ecaf25 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-450472243", "imageRef": "085e4478-6edc-4a69-8e08-f9831713eb65", "flavorRef": "452", "networks": [{"uuid": "a4f9c299-5f74-4cb5-ace2-5e1a3010ab5b"}], "key_name": "tempest-TestNetworkBasicOps-765654562", "security_groups": [{"name": "tempest-secgroup-smoke-1602617402"}]}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:45:39.188440 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.network.neutron [None req-2fde1fc4-02f8-42f4-b6ab-3baa88ecaf25 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] validate_networks() for [('a4f9c299-5f74-4cb5-ace2-5e1a3010ab5b', None, None, None, None, None)] {{(pid=138745) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 21:45:39.603721 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-2fde1fc4-02f8-42f4-b6ab-3baa88ecaf25 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Flavor limits 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 21:45:39.604414 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-2fde1fc4-02f8-42f4-b6ab-3baa88ecaf25 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Image limits 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 21:45:39.605568 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-2fde1fc4-02f8-42f4-b6ab-3baa88ecaf25 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Flavor pref 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 21:45:39.606091 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-2fde1fc4-02f8-42f4-b6ab-3baa88ecaf25 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Image pref 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 21:45:39.606656 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-2fde1fc4-02f8-42f4-b6ab-3baa88ecaf25 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 21:45:39.618088 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2fde1fc4-02f8-42f4-b6ab-3baa88ecaf25 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:45:39.618586 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2fde1fc4-02f8-42f4-b6ab-3baa88ecaf25 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:45:39.619044 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2fde1fc4-02f8-42f4-b6ab-3baa88ecaf25 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:45:39.620064 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2fde1fc4-02f8-42f4-b6ab-3baa88ecaf25 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:45:39.620808 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2fde1fc4-02f8-42f4-b6ab-3baa88ecaf25 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:45:39.621267 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2fde1fc4-02f8-42f4-b6ab-3baa88ecaf25 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:45:39.641298 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-2fde1fc4-02f8-42f4-b6ab-3baa88ecaf25 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Getting quotas for project 03adeffad1764ecf83ff0dd066814749. Resources: {'cores', 'instances', 'ram'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 21:45:39.647052 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-2fde1fc4-02f8-42f4-b6ab-3baa88ecaf25 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Getting quotas for user be3ea0672cee498ebffe3190962df106 and project 03adeffad1764ecf83ff0dd066814749. Resources: {'cores', 'instances', 'ram'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 21:45:39.660549 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-2fde1fc4-02f8-42f4-b6ab-3baa88ecaf25 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Going to run 1 instances... {{(pid=138745) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 21:45:39.663025 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-2fde1fc4-02f8-42f4-b6ab-3baa88ecaf25 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] [instance: adb0f6f3-66e2-4b3f-86d5-3b8b2ad9499f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='085e4478-6edc-4a69-8e08-f9831713eb65',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138745) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 21:45:39.713238 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-2fde1fc4-02f8-42f4-b6ab-3baa88ecaf25 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.641169 Oct 22 21:45:39.714310 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3078/6128] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Oct 22 21:45:39 2022] POST /compute/v2.1/servers => generated 406 bytes in 643 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 21:45:39.723669 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:SELECT=32,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:45:39.734118 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-a4c1c7db-6e8b-43ef-b4b1-f9063fa6221c tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:45:39.735493 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-a4c1c7db-6e8b-43ef-b4b1-f9063fa6221c tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] [instance: adb0f6f3-66e2-4b3f-86d5-3b8b2ad9499f] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:45:39.811754 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-a4c1c7db-6e8b-43ef-b4b1-f9063fa6221c tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3ea0672cee498ebffe3190962df106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03adeffad1764ecf83ff0dd066814749', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:45:39.819251 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-a4c1c7db-6e8b-43ef-b4b1-f9063fa6221c tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] 10.222.0.18 "GET /compute/v2.1/servers/adb0f6f3-66e2-4b3f-86d5-3b8b2ad9499f" status: 200 len: 1247 microversion: 2.1 time: 0.097342 Oct 22 21:45:39.820180 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3051/6129] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:45:39 2022] GET /compute/v2.1/servers/adb0f6f3-66e2-4b3f-86d5-3b8b2ad9499f => generated 1247 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:45:40.844444 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-6f8307ac-4d5a-4abe-8e31-3dec493b248d tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:45:40.845680 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-6f8307ac-4d5a-4abe-8e31-3dec493b248d tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] [instance: adb0f6f3-66e2-4b3f-86d5-3b8b2ad9499f] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:45:40.859636 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6f8307ac-4d5a-4abe-8e31-3dec493b248d tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:45:40.861877 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6f8307ac-4d5a-4abe-8e31-3dec493b248d tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:45:40.865600 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6f8307ac-4d5a-4abe-8e31-3dec493b248d tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:45:40.868297 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6f8307ac-4d5a-4abe-8e31-3dec493b248d tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:45:40.868990 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6f8307ac-4d5a-4abe-8e31-3dec493b248d tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:45:40.872301 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6f8307ac-4d5a-4abe-8e31-3dec493b248d tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:45:40.940226 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-6f8307ac-4d5a-4abe-8e31-3dec493b248d tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3ea0672cee498ebffe3190962df106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03adeffad1764ecf83ff0dd066814749', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:45:40.948644 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-6f8307ac-4d5a-4abe-8e31-3dec493b248d tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] 10.222.0.18 "GET /compute/v2.1/servers/adb0f6f3-66e2-4b3f-86d5-3b8b2ad9499f" status: 200 len: 1317 microversion: 2.1 time: 0.110181 Oct 22 21:45:40.949252 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3079/6130] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:45:40 2022] GET /compute/v2.1/servers/adb0f6f3-66e2-4b3f-86d5-3b8b2ad9499f => generated 1317 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:45:41.972763 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-df75e2af-f9cf-4b9e-8bb7-dd8bd2d53375 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:45:41.973390 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-df75e2af-f9cf-4b9e-8bb7-dd8bd2d53375 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] [instance: adb0f6f3-66e2-4b3f-86d5-3b8b2ad9499f] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:45:41.980764 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-df75e2af-f9cf-4b9e-8bb7-dd8bd2d53375 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:45:41.981278 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-df75e2af-f9cf-4b9e-8bb7-dd8bd2d53375 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:45:41.981880 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-df75e2af-f9cf-4b9e-8bb7-dd8bd2d53375 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:45:41.982599 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-df75e2af-f9cf-4b9e-8bb7-dd8bd2d53375 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:45:41.983060 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-df75e2af-f9cf-4b9e-8bb7-dd8bd2d53375 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:45:41.983527 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-df75e2af-f9cf-4b9e-8bb7-dd8bd2d53375 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:45:42.118885 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-df75e2af-f9cf-4b9e-8bb7-dd8bd2d53375 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3ea0672cee498ebffe3190962df106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03adeffad1764ecf83ff0dd066814749', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:45:42.127262 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-df75e2af-f9cf-4b9e-8bb7-dd8bd2d53375 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] 10.222.0.18 "GET /compute/v2.1/servers/adb0f6f3-66e2-4b3f-86d5-3b8b2ad9499f" status: 200 len: 1373 microversion: 2.1 time: 0.158916 Oct 22 21:45:42.139563 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3052/6131] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:45:41 2022] GET /compute/v2.1/servers/adb0f6f3-66e2-4b3f-86d5-3b8b2ad9499f => generated 1373 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:45:42.328806 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-b533b2fe-18f7-41e8-ae69-97fed93a623d req-b0965710-9319-4456-948e-e18e5a941917 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "adb0f6f3-66e2-4b3f-86d5-3b8b2ad9499f", "tag": "9c353d5b-98f0-4138-ba9e-c7207797cc2b"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:45:42.342479 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-b533b2fe-18f7-41e8-ae69-97fed93a623d req-b0965710-9319-4456-948e-e18e5a941917 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:45:42.342993 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-b533b2fe-18f7-41e8-ae69-97fed93a623d req-b0965710-9319-4456-948e-e18e5a941917 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:45:42.343475 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-b533b2fe-18f7-41e8-ae69-97fed93a623d req-b0965710-9319-4456-948e-e18e5a941917 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:45:42.358214 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-b533b2fe-18f7-41e8-ae69-97fed93a623d req-b0965710-9319-4456-948e-e18e5a941917 service nova] Creating event network-changed:9c353d5b-98f0-4138-ba9e-c7207797cc2b for instance adb0f6f3-66e2-4b3f-86d5-3b8b2ad9499f on nch1-master-1 Oct 22 21:45:42.363817 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-b533b2fe-18f7-41e8-ae69-97fed93a623d req-b0965710-9319-4456-948e-e18e5a941917 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038825 Oct 22 21:45:42.364447 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3080/6132] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:45:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:45:43.151142 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-cda637e2-108a-4acd-bb3e-a23e79d3e76b tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:45:43.151873 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-cda637e2-108a-4acd-bb3e-a23e79d3e76b tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] [instance: adb0f6f3-66e2-4b3f-86d5-3b8b2ad9499f] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:45:43.159176 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cda637e2-108a-4acd-bb3e-a23e79d3e76b tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:45:43.159710 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cda637e2-108a-4acd-bb3e-a23e79d3e76b tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:45:43.160154 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cda637e2-108a-4acd-bb3e-a23e79d3e76b tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:45:43.160837 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cda637e2-108a-4acd-bb3e-a23e79d3e76b tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:45:43.161319 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cda637e2-108a-4acd-bb3e-a23e79d3e76b tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:45:43.161754 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cda637e2-108a-4acd-bb3e-a23e79d3e76b tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:45:43.309521 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-cda637e2-108a-4acd-bb3e-a23e79d3e76b tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3ea0672cee498ebffe3190962df106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03adeffad1764ecf83ff0dd066814749', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:45:43.318085 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-cda637e2-108a-4acd-bb3e-a23e79d3e76b tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] 10.222.0.18 "GET /compute/v2.1/servers/adb0f6f3-66e2-4b3f-86d5-3b8b2ad9499f" status: 200 len: 1373 microversion: 2.1 time: 0.171031 Oct 22 21:45:43.318665 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3053/6133] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:45:43 2022] GET /compute/v2.1/servers/adb0f6f3-66e2-4b3f-86d5-3b8b2ad9499f => generated 1373 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:45:44.348180 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-cb4424d6-c928-42c3-b822-27c7ecf9cdb8 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:45:44.349561 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-cb4424d6-c928-42c3-b822-27c7ecf9cdb8 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] [instance: adb0f6f3-66e2-4b3f-86d5-3b8b2ad9499f] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:45:44.359790 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cb4424d6-c928-42c3-b822-27c7ecf9cdb8 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:45:44.360285 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cb4424d6-c928-42c3-b822-27c7ecf9cdb8 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:45:44.360737 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cb4424d6-c928-42c3-b822-27c7ecf9cdb8 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:45:44.361445 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cb4424d6-c928-42c3-b822-27c7ecf9cdb8 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:45:44.361914 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cb4424d6-c928-42c3-b822-27c7ecf9cdb8 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:45:44.362365 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cb4424d6-c928-42c3-b822-27c7ecf9cdb8 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:45:44.505148 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-cb4424d6-c928-42c3-b822-27c7ecf9cdb8 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3ea0672cee498ebffe3190962df106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03adeffad1764ecf83ff0dd066814749', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:45:44.513429 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-cb4424d6-c928-42c3-b822-27c7ecf9cdb8 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] 10.222.0.18 "GET /compute/v2.1/servers/adb0f6f3-66e2-4b3f-86d5-3b8b2ad9499f" status: 200 len: 1373 microversion: 2.1 time: 0.173128 Oct 22 21:45:44.514017 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3081/6134] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:45:44 2022] GET /compute/v2.1/servers/adb0f6f3-66e2-4b3f-86d5-3b8b2ad9499f => generated 1373 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:45:45.537198 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-138b6dd2-a423-4281-9126-8522ec30e2b9 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:45:45.537920 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-138b6dd2-a423-4281-9126-8522ec30e2b9 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] [instance: adb0f6f3-66e2-4b3f-86d5-3b8b2ad9499f] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:45:45.546485 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-138b6dd2-a423-4281-9126-8522ec30e2b9 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:45:45.546979 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-138b6dd2-a423-4281-9126-8522ec30e2b9 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:45:45.547458 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-138b6dd2-a423-4281-9126-8522ec30e2b9 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:45:45.548159 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-138b6dd2-a423-4281-9126-8522ec30e2b9 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:45:45.548615 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-138b6dd2-a423-4281-9126-8522ec30e2b9 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:45:45.549042 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-138b6dd2-a423-4281-9126-8522ec30e2b9 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:45:45.691565 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-138b6dd2-a423-4281-9126-8522ec30e2b9 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3ea0672cee498ebffe3190962df106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03adeffad1764ecf83ff0dd066814749', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:45:45.700109 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-138b6dd2-a423-4281-9126-8522ec30e2b9 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] 10.222.0.18 "GET /compute/v2.1/servers/adb0f6f3-66e2-4b3f-86d5-3b8b2ad9499f" status: 200 len: 1373 microversion: 2.1 time: 0.166969 Oct 22 21:45:45.700652 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3054/6135] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:45:45 2022] GET /compute/v2.1/servers/adb0f6f3-66e2-4b3f-86d5-3b8b2ad9499f => generated 1373 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:45:46.727676 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-e37cfc60-e53e-45ae-84ad-728a965414cb tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:45:46.728580 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-e37cfc60-e53e-45ae-84ad-728a965414cb tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] [instance: adb0f6f3-66e2-4b3f-86d5-3b8b2ad9499f] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:45:46.739406 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e37cfc60-e53e-45ae-84ad-728a965414cb tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:45:46.740183 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e37cfc60-e53e-45ae-84ad-728a965414cb tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:45:46.740875 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e37cfc60-e53e-45ae-84ad-728a965414cb tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:45:46.741961 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e37cfc60-e53e-45ae-84ad-728a965414cb tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:45:46.742681 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e37cfc60-e53e-45ae-84ad-728a965414cb tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:45:46.743394 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e37cfc60-e53e-45ae-84ad-728a965414cb tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:45:46.882377 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-e37cfc60-e53e-45ae-84ad-728a965414cb tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3ea0672cee498ebffe3190962df106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03adeffad1764ecf83ff0dd066814749', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:45:46.894675 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-e37cfc60-e53e-45ae-84ad-728a965414cb tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] 10.222.0.18 "GET /compute/v2.1/servers/adb0f6f3-66e2-4b3f-86d5-3b8b2ad9499f" status: 200 len: 1373 microversion: 2.1 time: 0.173123 Oct 22 21:45:46.895475 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3082/6136] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:45:46 2022] GET /compute/v2.1/servers/adb0f6f3-66e2-4b3f-86d5-3b8b2ad9499f => generated 1373 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:45:47.921311 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-0f98e016-69fa-4869-aef8-206fcc664374 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:45:47.921903 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-0f98e016-69fa-4869-aef8-206fcc664374 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] [instance: adb0f6f3-66e2-4b3f-86d5-3b8b2ad9499f] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:45:47.929924 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0f98e016-69fa-4869-aef8-206fcc664374 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:45:47.930420 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0f98e016-69fa-4869-aef8-206fcc664374 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:45:47.930872 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0f98e016-69fa-4869-aef8-206fcc664374 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:45:47.931623 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0f98e016-69fa-4869-aef8-206fcc664374 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:45:47.932091 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0f98e016-69fa-4869-aef8-206fcc664374 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:45:47.932527 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0f98e016-69fa-4869-aef8-206fcc664374 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:45:48.071529 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-0f98e016-69fa-4869-aef8-206fcc664374 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3ea0672cee498ebffe3190962df106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03adeffad1764ecf83ff0dd066814749', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:45:48.080007 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-0f98e016-69fa-4869-aef8-206fcc664374 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] 10.222.0.18 "GET /compute/v2.1/servers/adb0f6f3-66e2-4b3f-86d5-3b8b2ad9499f" status: 200 len: 1373 microversion: 2.1 time: 0.163057 Oct 22 21:45:48.080585 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3055/6137] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:45:47 2022] GET /compute/v2.1/servers/adb0f6f3-66e2-4b3f-86d5-3b8b2ad9499f => generated 1373 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:45:49.106709 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-5c5854ba-ffa7-4554-b93e-97954534afe4 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:45:49.107375 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-5c5854ba-ffa7-4554-b93e-97954534afe4 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] [instance: adb0f6f3-66e2-4b3f-86d5-3b8b2ad9499f] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:45:49.117566 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5c5854ba-ffa7-4554-b93e-97954534afe4 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:45:49.118115 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5c5854ba-ffa7-4554-b93e-97954534afe4 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:45:49.118755 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5c5854ba-ffa7-4554-b93e-97954534afe4 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:45:49.119628 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5c5854ba-ffa7-4554-b93e-97954534afe4 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:45:49.120143 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5c5854ba-ffa7-4554-b93e-97954534afe4 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:45:49.120842 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5c5854ba-ffa7-4554-b93e-97954534afe4 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:45:49.267416 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-5c5854ba-ffa7-4554-b93e-97954534afe4 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3ea0672cee498ebffe3190962df106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03adeffad1764ecf83ff0dd066814749', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:45:49.275429 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-5c5854ba-ffa7-4554-b93e-97954534afe4 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] 10.222.0.18 "GET /compute/v2.1/servers/adb0f6f3-66e2-4b3f-86d5-3b8b2ad9499f" status: 200 len: 1373 microversion: 2.1 time: 0.175408 Oct 22 21:45:49.276071 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3083/6138] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:45:49 2022] GET /compute/v2.1/servers/adb0f6f3-66e2-4b3f-86d5-3b8b2ad9499f => generated 1373 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:45:49.313253 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-fe9561e8-66bc-42eb-be1a-4cac59426a7d req-4e1dee29-96ab-455e-9fef-475b635789cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "adb0f6f3-66e2-4b3f-86d5-3b8b2ad9499f", "name": "network-vif-plugged", "status": "completed", "tag": "9c353d5b-98f0-4138-ba9e-c7207797cc2b"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:45:49.323920 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-fe9561e8-66bc-42eb-be1a-4cac59426a7d req-4e1dee29-96ab-455e-9fef-475b635789cf service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:45:49.324372 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-fe9561e8-66bc-42eb-be1a-4cac59426a7d req-4e1dee29-96ab-455e-9fef-475b635789cf service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:45:49.324800 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-fe9561e8-66bc-42eb-be1a-4cac59426a7d req-4e1dee29-96ab-455e-9fef-475b635789cf service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:45:49.336723 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-fe9561e8-66bc-42eb-be1a-4cac59426a7d req-4e1dee29-96ab-455e-9fef-475b635789cf service nova] Creating event network-vif-plugged:9c353d5b-98f0-4138-ba9e-c7207797cc2b for instance adb0f6f3-66e2-4b3f-86d5-3b8b2ad9499f on nch1-master-1 Oct 22 21:45:49.341755 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-fe9561e8-66bc-42eb-be1a-4cac59426a7d req-4e1dee29-96ab-455e-9fef-475b635789cf service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032394 Oct 22 21:45:49.342596 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3056/6139] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:45:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:45:50.299579 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-4c3ea9f6-dfe5-478a-b914-1cb45fc894a7 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:45:50.300182 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-4c3ea9f6-dfe5-478a-b914-1cb45fc894a7 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] [instance: adb0f6f3-66e2-4b3f-86d5-3b8b2ad9499f] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:45:50.302255 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell0:SELECT=2 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:45:50.303045 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell0:SELECT=6 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:45:50.309651 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4c3ea9f6-dfe5-478a-b914-1cb45fc894a7 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:45:50.310162 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4c3ea9f6-dfe5-478a-b914-1cb45fc894a7 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:45:50.310596 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4c3ea9f6-dfe5-478a-b914-1cb45fc894a7 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:45:50.311306 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4c3ea9f6-dfe5-478a-b914-1cb45fc894a7 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:45:50.311804 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4c3ea9f6-dfe5-478a-b914-1cb45fc894a7 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:45:50.312232 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4c3ea9f6-dfe5-478a-b914-1cb45fc894a7 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:45:50.453174 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-4c3ea9f6-dfe5-478a-b914-1cb45fc894a7 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3ea0672cee498ebffe3190962df106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03adeffad1764ecf83ff0dd066814749', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:45:50.463615 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-4c3ea9f6-dfe5-478a-b914-1cb45fc894a7 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] 10.222.0.18 "GET /compute/v2.1/servers/adb0f6f3-66e2-4b3f-86d5-3b8b2ad9499f" status: 200 len: 1373 microversion: 2.1 time: 0.168006 Oct 22 21:45:50.464203 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3084/6140] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:45:50 2022] GET /compute/v2.1/servers/adb0f6f3-66e2-4b3f-86d5-3b8b2ad9499f => generated 1373 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:45:51.485955 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell0:SELECT=6 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:45:51.494110 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-a78a8d55-af62-4cbb-a624-0c0104544d59 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:45:51.495271 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-a78a8d55-af62-4cbb-a624-0c0104544d59 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] [instance: adb0f6f3-66e2-4b3f-86d5-3b8b2ad9499f] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:45:51.498003 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:45:51.504358 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a78a8d55-af62-4cbb-a624-0c0104544d59 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:45:51.504859 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a78a8d55-af62-4cbb-a624-0c0104544d59 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:45:51.505289 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a78a8d55-af62-4cbb-a624-0c0104544d59 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:45:51.505988 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a78a8d55-af62-4cbb-a624-0c0104544d59 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:45:51.506446 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a78a8d55-af62-4cbb-a624-0c0104544d59 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:45:51.506879 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a78a8d55-af62-4cbb-a624-0c0104544d59 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:45:51.648678 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-a78a8d55-af62-4cbb-a624-0c0104544d59 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3ea0672cee498ebffe3190962df106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03adeffad1764ecf83ff0dd066814749', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:45:51.657240 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-a78a8d55-af62-4cbb-a624-0c0104544d59 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] 10.222.0.18 "GET /compute/v2.1/servers/adb0f6f3-66e2-4b3f-86d5-3b8b2ad9499f" status: 200 len: 1544 microversion: 2.1 time: 0.173080 Oct 22 21:45:51.657849 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3057/6141] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:45:51 2022] GET /compute/v2.1/servers/adb0f6f3-66e2-4b3f-86d5-3b8b2ad9499f => generated 1544 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:45:51.679627 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-fd4a5872-db57-48ac-80f7-3886158f1007 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:45:51.680294 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-fd4a5872-db57-48ac-80f7-3886158f1007 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] [instance: adb0f6f3-66e2-4b3f-86d5-3b8b2ad9499f] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:45:51.683146 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:45:51.689193 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fd4a5872-db57-48ac-80f7-3886158f1007 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:45:51.689695 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fd4a5872-db57-48ac-80f7-3886158f1007 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:45:51.690162 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fd4a5872-db57-48ac-80f7-3886158f1007 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:45:51.690880 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fd4a5872-db57-48ac-80f7-3886158f1007 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:45:51.691372 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fd4a5872-db57-48ac-80f7-3886158f1007 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:45:51.691819 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fd4a5872-db57-48ac-80f7-3886158f1007 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:45:51.826551 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-fd4a5872-db57-48ac-80f7-3886158f1007 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3ea0672cee498ebffe3190962df106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03adeffad1764ecf83ff0dd066814749', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:45:51.835043 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-fd4a5872-db57-48ac-80f7-3886158f1007 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] 10.222.0.18 "GET /compute/v2.1/servers/adb0f6f3-66e2-4b3f-86d5-3b8b2ad9499f" status: 200 len: 1544 microversion: 2.1 time: 0.159416 Oct 22 21:45:51.835667 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3085/6142] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:45:51 2022] GET /compute/v2.1/servers/adb0f6f3-66e2-4b3f-86d5-3b8b2ad9499f => generated 1544 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:45:53.482761 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-42994820-2db0-4ec7-944a-23b88a91581a req-c91e5a2f-d404-443d-a4a5-3326561dcaa1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "adb0f6f3-66e2-4b3f-86d5-3b8b2ad9499f", "tag": "9c353d5b-98f0-4138-ba9e-c7207797cc2b"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:45:53.493406 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-42994820-2db0-4ec7-944a-23b88a91581a req-c91e5a2f-d404-443d-a4a5-3326561dcaa1 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:45:53.493899 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-42994820-2db0-4ec7-944a-23b88a91581a req-c91e5a2f-d404-443d-a4a5-3326561dcaa1 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:45:53.494331 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-42994820-2db0-4ec7-944a-23b88a91581a req-c91e5a2f-d404-443d-a4a5-3326561dcaa1 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:45:53.506601 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-42994820-2db0-4ec7-944a-23b88a91581a req-c91e5a2f-d404-443d-a4a5-3326561dcaa1 service nova] Creating event network-changed:9c353d5b-98f0-4138-ba9e-c7207797cc2b for instance adb0f6f3-66e2-4b3f-86d5-3b8b2ad9499f on nch1-master-1 Oct 22 21:45:53.512326 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-42994820-2db0-4ec7-944a-23b88a91581a req-c91e5a2f-d404-443d-a4a5-3326561dcaa1 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033178 Oct 22 21:45:53.513085 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3058/6143] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:45:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:46:25.887927 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-9cf06dcd-5c6f-48ba-b26e-d8b7481b2c6d tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:46:25.891063 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-9cf06dcd-5c6f-48ba-b26e-d8b7481b2c6d tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] [instance: adb0f6f3-66e2-4b3f-86d5-3b8b2ad9499f] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:46:25.895939 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_api:SELECT=1 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:46:25.895939 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell1:SELECT=40 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:46:25.904293 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9cf06dcd-5c6f-48ba-b26e-d8b7481b2c6d tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:46:25.904800 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9cf06dcd-5c6f-48ba-b26e-d8b7481b2c6d tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:46:25.905313 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9cf06dcd-5c6f-48ba-b26e-d8b7481b2c6d tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:46:25.905994 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9cf06dcd-5c6f-48ba-b26e-d8b7481b2c6d tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:46:25.906467 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9cf06dcd-5c6f-48ba-b26e-d8b7481b2c6d tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:46:25.906910 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9cf06dcd-5c6f-48ba-b26e-d8b7481b2c6d tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:46:25.965850 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-9cf06dcd-5c6f-48ba-b26e-d8b7481b2c6d tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] 10.222.0.18 "POST /compute/v2.1/servers/adb0f6f3-66e2-4b3f-86d5-3b8b2ad9499f/action" status: 200 len: 24569 microversion: 2.1 time: 0.083999 Oct 22 21:46:25.966498 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3086/6144] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 21:46:25 2022] POST /compute/v2.1/servers/adb0f6f3-66e2-4b3f-86d5-3b8b2ad9499f/action => generated 24569 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 22 21:46:56.451413 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-c2e3ef10-ccdf-46dc-a3b1-f995ccac35d8 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:46:56.453734 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-c2e3ef10-ccdf-46dc-a3b1-f995ccac35d8 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] [instance: adb0f6f3-66e2-4b3f-86d5-3b8b2ad9499f] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:46:56.455943 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_api:SELECT=3 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:46:56.456604 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:SELECT=34 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:46:56.462616 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c2e3ef10-ccdf-46dc-a3b1-f995ccac35d8 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:46:56.463113 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c2e3ef10-ccdf-46dc-a3b1-f995ccac35d8 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:46:56.463582 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c2e3ef10-ccdf-46dc-a3b1-f995ccac35d8 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:46:56.464302 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c2e3ef10-ccdf-46dc-a3b1-f995ccac35d8 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:46:56.464762 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c2e3ef10-ccdf-46dc-a3b1-f995ccac35d8 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:46:56.465200 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c2e3ef10-ccdf-46dc-a3b1-f995ccac35d8 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:46:56.520871 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-c2e3ef10-ccdf-46dc-a3b1-f995ccac35d8 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] 10.222.0.18 "POST /compute/v2.1/servers/adb0f6f3-66e2-4b3f-86d5-3b8b2ad9499f/action" status: 200 len: 32642 microversion: 2.1 time: 0.074316 Oct 22 21:46:56.521642 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3059/6145] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 21:46:56 2022] POST /compute/v2.1/servers/adb0f6f3-66e2-4b3f-86d5-3b8b2ad9499f/action => generated 32642 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 22 21:46:57.574886 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-4e733ad1-1bcc-48c4-9eee-b202239f43c9 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:46:57.575498 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-4e733ad1-1bcc-48c4-9eee-b202239f43c9 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] [instance: adb0f6f3-66e2-4b3f-86d5-3b8b2ad9499f] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:46:57.582057 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_api:SELECT=2 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:46:57.583153 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell1:SELECT=4 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:46:57.585829 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4e733ad1-1bcc-48c4-9eee-b202239f43c9 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:46:57.586674 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4e733ad1-1bcc-48c4-9eee-b202239f43c9 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:46:57.587193 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4e733ad1-1bcc-48c4-9eee-b202239f43c9 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:46:57.588219 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4e733ad1-1bcc-48c4-9eee-b202239f43c9 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:46:57.588700 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4e733ad1-1bcc-48c4-9eee-b202239f43c9 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:46:57.589149 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4e733ad1-1bcc-48c4-9eee-b202239f43c9 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:46:57.619075 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-4e733ad1-1bcc-48c4-9eee-b202239f43c9 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] [instance: adb0f6f3-66e2-4b3f-86d5-3b8b2ad9499f] Going to try to terminate instance {{(pid=138745) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 21:46:57.726811 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-4e733ad1-1bcc-48c4-9eee-b202239f43c9 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] 10.222.0.18 "DELETE /compute/v2.1/servers/adb0f6f3-66e2-4b3f-86d5-3b8b2ad9499f" status: 204 len: 0 microversion: 2.1 time: 0.155903 Oct 22 21:46:57.731195 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3087/6146] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 21:46:57 2022] DELETE /compute/v2.1/servers/adb0f6f3-66e2-4b3f-86d5-3b8b2ad9499f => generated 0 bytes in 158 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 21:46:57.740758 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-fbfc4d5a-c3fe-45cf-89aa-eac1de3415ee tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:46:57.741985 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-fbfc4d5a-c3fe-45cf-89aa-eac1de3415ee tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] [instance: adb0f6f3-66e2-4b3f-86d5-3b8b2ad9499f] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:46:57.748257 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fbfc4d5a-c3fe-45cf-89aa-eac1de3415ee tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:46:57.748836 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fbfc4d5a-c3fe-45cf-89aa-eac1de3415ee tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:46:57.749387 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fbfc4d5a-c3fe-45cf-89aa-eac1de3415ee tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:46:57.750180 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fbfc4d5a-c3fe-45cf-89aa-eac1de3415ee tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:46:57.750724 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fbfc4d5a-c3fe-45cf-89aa-eac1de3415ee tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:46:57.751238 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fbfc4d5a-c3fe-45cf-89aa-eac1de3415ee tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:46:57.752619 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-41e69188-f449-4b48-8e01-0d56e0f7fe42 req-28584de0-db34-49a2-a1b5-8d3813057dc5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "adb0f6f3-66e2-4b3f-86d5-3b8b2ad9499f", "tag": "9c353d5b-98f0-4138-ba9e-c7207797cc2b"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:46:57.764373 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-41e69188-f449-4b48-8e01-0d56e0f7fe42 req-28584de0-db34-49a2-a1b5-8d3813057dc5 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:46:57.765025 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-41e69188-f449-4b48-8e01-0d56e0f7fe42 req-28584de0-db34-49a2-a1b5-8d3813057dc5 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:46:57.765472 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-41e69188-f449-4b48-8e01-0d56e0f7fe42 req-28584de0-db34-49a2-a1b5-8d3813057dc5 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:46:57.776999 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-41e69188-f449-4b48-8e01-0d56e0f7fe42 req-28584de0-db34-49a2-a1b5-8d3813057dc5 service nova] Creating event network-changed:9c353d5b-98f0-4138-ba9e-c7207797cc2b for instance adb0f6f3-66e2-4b3f-86d5-3b8b2ad9499f on nch1-master-1 Oct 22 21:46:57.782369 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-41e69188-f449-4b48-8e01-0d56e0f7fe42 req-28584de0-db34-49a2-a1b5-8d3813057dc5 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.145595 Oct 22 21:46:57.782983 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3060/6147] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:46:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:46:58.014610 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-fbfc4d5a-c3fe-45cf-89aa-eac1de3415ee tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3ea0672cee498ebffe3190962df106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03adeffad1764ecf83ff0dd066814749', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:46:58.022962 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-fbfc4d5a-c3fe-45cf-89aa-eac1de3415ee tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] 10.222.0.18 "GET /compute/v2.1/servers/adb0f6f3-66e2-4b3f-86d5-3b8b2ad9499f" status: 200 len: 1669 microversion: 2.1 time: 0.290140 Oct 22 21:46:58.023577 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3088/6148] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:46:57 2022] GET /compute/v2.1/servers/adb0f6f3-66e2-4b3f-86d5-3b8b2ad9499f => generated 1669 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:46:59.048784 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-9c246e60-efc9-4930-9c39-c40e5f522fc8 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:46:59.049466 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-9c246e60-efc9-4930-9c39-c40e5f522fc8 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] [instance: adb0f6f3-66e2-4b3f-86d5-3b8b2ad9499f] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:46:59.056285 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9c246e60-efc9-4930-9c39-c40e5f522fc8 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:46:59.056710 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9c246e60-efc9-4930-9c39-c40e5f522fc8 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:46:59.057152 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9c246e60-efc9-4930-9c39-c40e5f522fc8 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:46:59.057867 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9c246e60-efc9-4930-9c39-c40e5f522fc8 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:46:59.058325 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9c246e60-efc9-4930-9c39-c40e5f522fc8 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:46:59.058745 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9c246e60-efc9-4930-9c39-c40e5f522fc8 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:46:59.375372 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-9c246e60-efc9-4930-9c39-c40e5f522fc8 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3ea0672cee498ebffe3190962df106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03adeffad1764ecf83ff0dd066814749', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:46:59.384253 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-9c246e60-efc9-4930-9c39-c40e5f522fc8 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] 10.222.0.18 "GET /compute/v2.1/servers/adb0f6f3-66e2-4b3f-86d5-3b8b2ad9499f" status: 200 len: 1669 microversion: 2.1 time: 0.340747 Oct 22 21:46:59.385036 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3061/6149] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:46:59 2022] GET /compute/v2.1/servers/adb0f6f3-66e2-4b3f-86d5-3b8b2ad9499f => generated 1669 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:46:59.797507 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-46c9f775-8338-45c7-96c2-12763bd88354 req-7579caa1-b288-437f-a3af-5403200f0725 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "adb0f6f3-66e2-4b3f-86d5-3b8b2ad9499f", "name": "network-vif-deleted", "tag": "9c353d5b-98f0-4138-ba9e-c7207797cc2b"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:46:59.808462 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-46c9f775-8338-45c7-96c2-12763bd88354 req-7579caa1-b288-437f-a3af-5403200f0725 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:46:59.808948 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-46c9f775-8338-45c7-96c2-12763bd88354 req-7579caa1-b288-437f-a3af-5403200f0725 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:46:59.809397 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-46c9f775-8338-45c7-96c2-12763bd88354 req-7579caa1-b288-437f-a3af-5403200f0725 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:46:59.824755 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-46c9f775-8338-45c7-96c2-12763bd88354 req-7579caa1-b288-437f-a3af-5403200f0725 service nova] Creating event network-vif-deleted:9c353d5b-98f0-4138-ba9e-c7207797cc2b for instance adb0f6f3-66e2-4b3f-86d5-3b8b2ad9499f on nch1-master-1 Oct 22 21:46:59.829593 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-46c9f775-8338-45c7-96c2-12763bd88354 req-7579caa1-b288-437f-a3af-5403200f0725 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036036 Oct 22 21:46:59.830214 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3089/6150] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:46:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:47:00.413229 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-3c7e168b-8166-427c-b054-0deb4c7bb315 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:47:00.414111 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-3c7e168b-8166-427c-b054-0deb4c7bb315 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] [instance: adb0f6f3-66e2-4b3f-86d5-3b8b2ad9499f] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:47:00.425826 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3c7e168b-8166-427c-b054-0deb4c7bb315 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:47:00.426668 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3c7e168b-8166-427c-b054-0deb4c7bb315 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:47:00.427128 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3c7e168b-8166-427c-b054-0deb4c7bb315 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:47:00.427921 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3c7e168b-8166-427c-b054-0deb4c7bb315 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:47:00.428385 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3c7e168b-8166-427c-b054-0deb4c7bb315 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:47:00.428821 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3c7e168b-8166-427c-b054-0deb4c7bb315 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:47:00.443001 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-3c7e168b-8166-427c-b054-0deb4c7bb315 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] HTTP exception thrown: Instance adb0f6f3-66e2-4b3f-86d5-3b8b2ad9499f could not be found. Oct 22 21:47:00.444697 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-3c7e168b-8166-427c-b054-0deb4c7bb315 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Request method failure captured: Oct 22 21:47:00.444697 ncdv-master-1 devstack@n-api.service[138744]: request: GET /compute/v2.1/servers/adb0f6f3-66e2-4b3f-86d5-3b8b2ad9499f HTTP/1.1 Oct 22 21:47:00.444697 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 21:47:00.444697 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 21:47:00.444697 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 21:47:00.444697 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 0 Oct 22 21:47:00.444697 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 21:47:00.444697 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 21:47:00.444697 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 21:47:00.444697 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 21:47:00.444697 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVGPrLjPbNQGgVSGKyCQK8QodVfI3TxOkAe11wAc-BUZLns60KyHU-HfACChYFfEO0026x9uyDDNBPDi7ErMlVmSJOLTzU0fTlwG-dU6BQCDTuzrV7zMacsAa8GKPjChtr060h6ENejugzGGz8iAOSM7ty4HA-R6xTxW6N6hJpw9z0f8 Oct 22 21:47:00.444697 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 21:47:00.444697 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 21:47:00.444697 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 21:47:00.444697 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 21:47:00.444697 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 21:47:00.444697 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 21:47:00.444697 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: 03adeffad1764ecf83ff0dd066814749 Oct 22 21:47:00.444697 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-TestNetworkBasicOps-1900775247 Oct 22 21:47:00.444697 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 21:47:00.444697 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 21:47:00.444697 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_03adeffad1764ecf83ff0dd066814749"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/03adeffad1764ecf83ff0dd066814749"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/03adeffad1764ecf83ff0dd066814749"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/03adeffad1764ecf83ff0dd066814749"}]}] Oct 22 21:47:00.444697 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-TestNetworkBasicOps-1900775247 Oct 22 21:47:00.444697 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: 03adeffad1764ecf83ff0dd066814749 Oct 22 21:47:00.444697 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-TestNetworkBasicOps-1900775247 Oct 22 21:47:00.444697 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-TestNetworkBasicOps-1900775247-project Oct 22 21:47:00.444697 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 21:47:00.444697 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 21:47:00.444697 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: be3ea0672cee498ebffe3190962df106 Oct 22 21:47:00.444697 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-TestNetworkBasicOps-1900775247-project Oct 22 21:47:00.444697 ncdv-master-1 devstack@n-api.service[138744]: method: > Oct 22 21:47:00.444697 ncdv-master-1 devstack@n-api.service[138744]: exception: Instance adb0f6f3-66e2-4b3f-86d5-3b8b2ad9499f could not be found. Oct 22 21:47:00.444697 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': 'adb0f6f3-66e2-4b3f-86d5-3b8b2ad9499f'} Oct 22 21:47:00.444697 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:47:00.444697 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:47:00.444697 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 21:47:00.444697 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 21:47:00.444697 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 21:47:00.444697 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 21:47:00.444697 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 21:47:00.444697 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 21:47:00.444697 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 21:47:00.444697 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 21:47:00.444697 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance adb0f6f3-66e2-4b3f-86d5-3b8b2ad9499f could not be found. Oct 22 21:47:00.444697 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:47:00.444697 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:47:00.444697 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:47:00.444697 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:47:00.444697 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:47:00.444697 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:47:00.444697 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:47:00.444697 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:47:00.444697 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:47:00.444697 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:47:00.444697 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 21:47:00.444697 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 21:47:00.444697 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 21:47:00.444697 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 21:47:00.444697 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 21:47:00.444697 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:47:00.444697 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance adb0f6f3-66e2-4b3f-86d5-3b8b2ad9499f could not be found. Oct 22 21:47:00.444697 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:47:00.444697 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:47:00.444697 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:47:00.449648 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:47:00.449648 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:47:00.449648 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:47:00.449648 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:47:00.449648 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:47:00.449648 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance adb0f6f3-66e2-4b3f-86d5-3b8b2ad9499f could not be found. Oct 22 21:47:00.449648 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:47:00.449648 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-3c7e168b-8166-427c-b054-0deb4c7bb315 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Returning 404 to user: Instance adb0f6f3-66e2-4b3f-86d5-3b8b2ad9499f could not be found. {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:47:00.449648 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-3c7e168b-8166-427c-b054-0deb4c7bb315 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] 10.222.0.18 "GET /compute/v2.1/servers/adb0f6f3-66e2-4b3f-86d5-3b8b2ad9499f" status: 404 len: 111 microversion: 2.1 time: 0.039924 Oct 22 21:47:00.449648 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3062/6151] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:47:00 2022] GET /compute/v2.1/servers/adb0f6f3-66e2-4b3f-86d5-3b8b2ad9499f => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 21:47:00.618388 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-e57eaee7-0cbd-4ee1-b4c3-f91adf1bbc83 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] Calling method '.version_select at 0x7fd39fbfec10>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:47:00.645885 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-e57eaee7-0cbd-4ee1-b4c3-f91adf1bbc83 tempest-TestNetworkBasicOps-1900775247 tempest-TestNetworkBasicOps-1900775247-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-765654562" status: 202 len: 0 microversion: 2.1 time: 0.032000 Oct 22 21:47:00.646624 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3090/6152] 10.222.0.18 () {58 vars in 1254 bytes} [Sat Oct 22 21:47:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-765654562 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 21:47:06.996289 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-00ae8499-4a71-4be5-9d18-d0488f5a30d4 tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Action: 'create', calling method: .version_select at 0x7fd39f077040>, body: {"keypair": {"name": "tempest-TestSecurityGroupsBasicOps-865037689", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP+ih0m+LP6ymvFJBf7uabS4NYhDIXrQ643Yg4x7rVQahxVvdL5VNMGH0YOZyqLs9xrs+YIfaAyfQpMHHQc2MHvS/GLSJLg/DwIuDbiocRX+YGS0jCJHUd1J5/2+O6Um8A=="}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:47:07.013070 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-00ae8499-4a71-4be5-9d18-d0488f5a30d4 tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Getting quotas for project 18d8b2319f2f43a7aef198279bd348fe. Resources: {'key_pairs'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 21:47:07.019477 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-00ae8499-4a71-4be5-9d18-d0488f5a30d4 tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Getting quotas for user 81c625b34f1a41739399ed62cf9a9412 and project 18d8b2319f2f43a7aef198279bd348fe. Resources: {'key_pairs'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 21:47:07.046943 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-00ae8499-4a71-4be5-9d18-d0488f5a30d4 tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.220711 Oct 22 21:47:07.047589 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3063/6153] 10.222.0.18 () {60 vars in 1159 bytes} [Sat Oct 22 21:47:06 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:47:12.533388 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:47:12.534461 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_api:SELECT=14,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:47:12.539069 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-08e3aaab-06b9-444a-a84c-58ddd1987969 tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-tempest-TestSecurityGroupsBasicOps-1194797901-access_point-1196286114", "imageRef": "085e4478-6edc-4a69-8e08-f9831713eb65", "flavorRef": "452", "networks": [{"uuid": "3e38bb31-a468-4769-a862-b98446a172fe"}], "key_name": "tempest-TestSecurityGroupsBasicOps-865037689", "security_groups": [{"name": "tempest-secgroup_access--1998727090"}, {"name": "tempest-secgroup_general--832459883"}]}, "os:scheduler_hints": {"different_host": []}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:47:12.766776 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.network.neutron [None req-08e3aaab-06b9-444a-a84c-58ddd1987969 tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] validate_networks() for [('3e38bb31-a468-4769-a862-b98446a172fe', None, None, None, None, None)] {{(pid=138745) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 21:47:13.184744 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-08e3aaab-06b9-444a-a84c-58ddd1987969 tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Flavor limits 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 21:47:13.185154 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-08e3aaab-06b9-444a-a84c-58ddd1987969 tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Image limits 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 21:47:13.185640 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-08e3aaab-06b9-444a-a84c-58ddd1987969 tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Flavor pref 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 21:47:13.186064 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-08e3aaab-06b9-444a-a84c-58ddd1987969 tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Image pref 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 21:47:13.186528 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-08e3aaab-06b9-444a-a84c-58ddd1987969 tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 21:47:13.196295 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-08e3aaab-06b9-444a-a84c-58ddd1987969 tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:47:13.196771 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-08e3aaab-06b9-444a-a84c-58ddd1987969 tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:47:13.197228 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-08e3aaab-06b9-444a-a84c-58ddd1987969 tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:47:13.197972 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-08e3aaab-06b9-444a-a84c-58ddd1987969 tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:47:13.198440 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-08e3aaab-06b9-444a-a84c-58ddd1987969 tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:47:13.198880 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-08e3aaab-06b9-444a-a84c-58ddd1987969 tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:47:13.217773 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-08e3aaab-06b9-444a-a84c-58ddd1987969 tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Getting quotas for project 18d8b2319f2f43a7aef198279bd348fe. Resources: {'cores', 'instances', 'ram'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 21:47:13.225709 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-08e3aaab-06b9-444a-a84c-58ddd1987969 tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Getting quotas for user 81c625b34f1a41739399ed62cf9a9412 and project 18d8b2319f2f43a7aef198279bd348fe. Resources: {'cores', 'instances', 'ram'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 21:47:13.238980 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-08e3aaab-06b9-444a-a84c-58ddd1987969 tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Going to run 1 instances... {{(pid=138745) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 21:47:13.241247 ncdv-master-1 devstack@n-api.service[138745]: WARNING nova.utils [None req-08e3aaab-06b9-444a-a84c-58ddd1987969 tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Hostname tempest-server-tempest-TestSecurityGroupsBasicOps-1194797901-access_point-1196286114 is longer than 63, truncate it to tempest-server-tempest-TestSecurityGroupsBasicOps-1194797901-ac Oct 22 21:47:13.242122 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-08e3aaab-06b9-444a-a84c-58ddd1987969 tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] [instance: 63289da2-fe8a-4a50-af8c-6b48d23b8c94] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='085e4478-6edc-4a69-8e08-f9831713eb65',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138745) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 21:47:13.292131 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-08e3aaab-06b9-444a-a84c-58ddd1987969 tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 457 microversion: 2.1 time: 0.760565 Oct 22 21:47:13.292971 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3091/6154] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Oct 22 21:47:12 2022] POST /compute/v2.1/servers => generated 457 bytes in 762 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 22 21:47:13.303107 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:SELECT=14 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:47:13.308835 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-4dee95e6-bcb0-4d97-87f7-311b239f0c44 tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:47:13.309894 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-4dee95e6-bcb0-4d97-87f7-311b239f0c44 tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] [instance: 63289da2-fe8a-4a50-af8c-6b48d23b8c94] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:47:13.372917 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-4dee95e6-bcb0-4d97-87f7-311b239f0c44 tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81c625b34f1a41739399ed62cf9a9412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d8b2319f2f43a7aef198279bd348fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:47:13.381219 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-4dee95e6-bcb0-4d97-87f7-311b239f0c44 tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] 10.222.0.18 "GET /compute/v2.1/servers/63289da2-fe8a-4a50-af8c-6b48d23b8c94" status: 200 len: 1294 microversion: 2.1 time: 0.080056 Oct 22 21:47:13.381828 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3064/6155] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:47:13 2022] GET /compute/v2.1/servers/63289da2-fe8a-4a50-af8c-6b48d23b8c94 => generated 1294 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:47:14.405549 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-04bf112e-4077-447a-80e2-e5e2e026493a tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:47:14.406122 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-04bf112e-4077-447a-80e2-e5e2e026493a tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] [instance: 63289da2-fe8a-4a50-af8c-6b48d23b8c94] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:47:14.414263 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-04bf112e-4077-447a-80e2-e5e2e026493a tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:47:14.414799 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-04bf112e-4077-447a-80e2-e5e2e026493a tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:47:14.415251 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-04bf112e-4077-447a-80e2-e5e2e026493a tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:47:14.416048 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-04bf112e-4077-447a-80e2-e5e2e026493a tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:47:14.416515 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-04bf112e-4077-447a-80e2-e5e2e026493a tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:47:14.416955 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-04bf112e-4077-447a-80e2-e5e2e026493a tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:47:14.499806 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-04bf112e-4077-447a-80e2-e5e2e026493a tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81c625b34f1a41739399ed62cf9a9412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d8b2319f2f43a7aef198279bd348fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:47:14.509406 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-04bf112e-4077-447a-80e2-e5e2e026493a tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] 10.222.0.18 "GET /compute/v2.1/servers/63289da2-fe8a-4a50-af8c-6b48d23b8c94" status: 200 len: 1346 microversion: 2.1 time: 0.107884 Oct 22 21:47:14.510114 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3092/6156] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:47:14 2022] GET /compute/v2.1/servers/63289da2-fe8a-4a50-af8c-6b48d23b8c94 => generated 1346 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:47:15.534242 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-3394deb5-ae09-418a-8df7-8b789b8263e0 tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:47:15.534868 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-3394deb5-ae09-418a-8df7-8b789b8263e0 tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] [instance: 63289da2-fe8a-4a50-af8c-6b48d23b8c94] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:47:15.542867 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3394deb5-ae09-418a-8df7-8b789b8263e0 tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:47:15.543683 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3394deb5-ae09-418a-8df7-8b789b8263e0 tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:47:15.544314 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3394deb5-ae09-418a-8df7-8b789b8263e0 tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:47:15.545147 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3394deb5-ae09-418a-8df7-8b789b8263e0 tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:47:15.545767 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3394deb5-ae09-418a-8df7-8b789b8263e0 tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:47:15.546354 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3394deb5-ae09-418a-8df7-8b789b8263e0 tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:47:16.184173 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-3394deb5-ae09-418a-8df7-8b789b8263e0 tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81c625b34f1a41739399ed62cf9a9412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d8b2319f2f43a7aef198279bd348fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:47:16.192938 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-3394deb5-ae09-418a-8df7-8b789b8263e0 tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] 10.222.0.18 "GET /compute/v2.1/servers/63289da2-fe8a-4a50-af8c-6b48d23b8c94" status: 200 len: 1471 microversion: 2.1 time: 0.662510 Oct 22 21:47:16.193810 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3065/6157] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:47:15 2022] GET /compute/v2.1/servers/63289da2-fe8a-4a50-af8c-6b48d23b8c94 => generated 1471 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:47:16.585894 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-1671e00c-e174-491e-b073-b5d77febb811 req-7f1ed88a-e018-421b-bba9-a257de52f15e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "63289da2-fe8a-4a50-af8c-6b48d23b8c94", "tag": "4fcf64c3-d3bc-4f93-99c2-d0fab64676c7"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:47:16.599711 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-1671e00c-e174-491e-b073-b5d77febb811 req-7f1ed88a-e018-421b-bba9-a257de52f15e service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:47:16.601007 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-1671e00c-e174-491e-b073-b5d77febb811 req-7f1ed88a-e018-421b-bba9-a257de52f15e service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:47:16.601520 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-1671e00c-e174-491e-b073-b5d77febb811 req-7f1ed88a-e018-421b-bba9-a257de52f15e service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:47:16.615161 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-1671e00c-e174-491e-b073-b5d77febb811 req-7f1ed88a-e018-421b-bba9-a257de52f15e service nova] Creating event network-changed:4fcf64c3-d3bc-4f93-99c2-d0fab64676c7 for instance 63289da2-fe8a-4a50-af8c-6b48d23b8c94 on nch1-master-1 Oct 22 21:47:16.621197 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-1671e00c-e174-491e-b073-b5d77febb811 req-7f1ed88a-e018-421b-bba9-a257de52f15e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039067 Oct 22 21:47:16.621804 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3093/6158] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:47:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:47:17.221518 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-c7a4f4d3-9972-45f1-a620-ce8662780698 tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:47:17.222478 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-c7a4f4d3-9972-45f1-a620-ce8662780698 tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] [instance: 63289da2-fe8a-4a50-af8c-6b48d23b8c94] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:47:17.230756 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c7a4f4d3-9972-45f1-a620-ce8662780698 tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:47:17.231281 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c7a4f4d3-9972-45f1-a620-ce8662780698 tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:47:17.231762 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c7a4f4d3-9972-45f1-a620-ce8662780698 tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:47:17.232504 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c7a4f4d3-9972-45f1-a620-ce8662780698 tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:47:17.232969 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c7a4f4d3-9972-45f1-a620-ce8662780698 tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:47:17.233407 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c7a4f4d3-9972-45f1-a620-ce8662780698 tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:47:17.376836 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-c7a4f4d3-9972-45f1-a620-ce8662780698 tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81c625b34f1a41739399ed62cf9a9412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d8b2319f2f43a7aef198279bd348fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:47:17.385420 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-c7a4f4d3-9972-45f1-a620-ce8662780698 tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] 10.222.0.18 "GET /compute/v2.1/servers/63289da2-fe8a-4a50-af8c-6b48d23b8c94" status: 200 len: 1471 microversion: 2.1 time: 0.170898 Oct 22 21:47:17.385999 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3066/6159] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:47:17 2022] GET /compute/v2.1/servers/63289da2-fe8a-4a50-af8c-6b48d23b8c94 => generated 1471 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:47:18.414086 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-144f6769-4cc0-41c0-9109-82eaf10d4dbf tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:47:18.415133 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-144f6769-4cc0-41c0-9109-82eaf10d4dbf tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] [instance: 63289da2-fe8a-4a50-af8c-6b48d23b8c94] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:47:18.427701 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-144f6769-4cc0-41c0-9109-82eaf10d4dbf tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:47:18.428223 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-144f6769-4cc0-41c0-9109-82eaf10d4dbf tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:47:18.428678 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-144f6769-4cc0-41c0-9109-82eaf10d4dbf tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:47:18.429384 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-144f6769-4cc0-41c0-9109-82eaf10d4dbf tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:47:18.429851 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-144f6769-4cc0-41c0-9109-82eaf10d4dbf tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:47:18.430292 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-144f6769-4cc0-41c0-9109-82eaf10d4dbf tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:47:18.582638 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-144f6769-4cc0-41c0-9109-82eaf10d4dbf tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81c625b34f1a41739399ed62cf9a9412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d8b2319f2f43a7aef198279bd348fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:47:18.590852 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-144f6769-4cc0-41c0-9109-82eaf10d4dbf tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] 10.222.0.18 "GET /compute/v2.1/servers/63289da2-fe8a-4a50-af8c-6b48d23b8c94" status: 200 len: 1471 microversion: 2.1 time: 0.184448 Oct 22 21:47:18.591461 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3094/6160] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:47:18 2022] GET /compute/v2.1/servers/63289da2-fe8a-4a50-af8c-6b48d23b8c94 => generated 1471 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:47:19.617570 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-b3e439f8-da97-48d5-bac5-cbf02232960f tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:47:19.618426 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-b3e439f8-da97-48d5-bac5-cbf02232960f tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] [instance: 63289da2-fe8a-4a50-af8c-6b48d23b8c94] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:47:19.628662 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b3e439f8-da97-48d5-bac5-cbf02232960f tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:47:19.629413 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b3e439f8-da97-48d5-bac5-cbf02232960f tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:47:19.630074 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b3e439f8-da97-48d5-bac5-cbf02232960f tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:47:19.631080 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b3e439f8-da97-48d5-bac5-cbf02232960f tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:47:19.631912 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b3e439f8-da97-48d5-bac5-cbf02232960f tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:47:19.632349 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b3e439f8-da97-48d5-bac5-cbf02232960f tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:47:19.778240 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-b3e439f8-da97-48d5-bac5-cbf02232960f tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81c625b34f1a41739399ed62cf9a9412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d8b2319f2f43a7aef198279bd348fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:47:19.786275 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-b3e439f8-da97-48d5-bac5-cbf02232960f tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] 10.222.0.18 "GET /compute/v2.1/servers/63289da2-fe8a-4a50-af8c-6b48d23b8c94" status: 200 len: 1471 microversion: 2.1 time: 0.174903 Oct 22 21:47:19.786871 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3067/6161] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:47:19 2022] GET /compute/v2.1/servers/63289da2-fe8a-4a50-af8c-6b48d23b8c94 => generated 1471 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:47:20.809505 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-b8a2ecd7-8da8-4588-bf28-b4a6887c7c5d tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:47:20.810201 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-b8a2ecd7-8da8-4588-bf28-b4a6887c7c5d tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] [instance: 63289da2-fe8a-4a50-af8c-6b48d23b8c94] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:47:20.817732 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b8a2ecd7-8da8-4588-bf28-b4a6887c7c5d tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:47:20.818233 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b8a2ecd7-8da8-4588-bf28-b4a6887c7c5d tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:47:20.818687 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b8a2ecd7-8da8-4588-bf28-b4a6887c7c5d tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:47:20.819519 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b8a2ecd7-8da8-4588-bf28-b4a6887c7c5d tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:47:20.820071 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b8a2ecd7-8da8-4588-bf28-b4a6887c7c5d tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:47:20.820518 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b8a2ecd7-8da8-4588-bf28-b4a6887c7c5d tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:47:20.966868 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-b8a2ecd7-8da8-4588-bf28-b4a6887c7c5d tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81c625b34f1a41739399ed62cf9a9412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d8b2319f2f43a7aef198279bd348fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:47:20.977857 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-b8a2ecd7-8da8-4588-bf28-b4a6887c7c5d tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] 10.222.0.18 "GET /compute/v2.1/servers/63289da2-fe8a-4a50-af8c-6b48d23b8c94" status: 200 len: 1471 microversion: 2.1 time: 0.172474 Oct 22 21:47:20.978436 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3095/6162] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:47:20 2022] GET /compute/v2.1/servers/63289da2-fe8a-4a50-af8c-6b48d23b8c94 => generated 1471 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:47:22.002014 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-b57ff2d0-5053-4c9b-873b-5875b296e05d tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:47:22.002631 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-b57ff2d0-5053-4c9b-873b-5875b296e05d tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] [instance: 63289da2-fe8a-4a50-af8c-6b48d23b8c94] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:47:22.010556 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b57ff2d0-5053-4c9b-873b-5875b296e05d tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:47:22.011055 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b57ff2d0-5053-4c9b-873b-5875b296e05d tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:47:22.011534 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b57ff2d0-5053-4c9b-873b-5875b296e05d tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:47:22.012250 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b57ff2d0-5053-4c9b-873b-5875b296e05d tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:47:22.012708 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b57ff2d0-5053-4c9b-873b-5875b296e05d tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:47:22.013142 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b57ff2d0-5053-4c9b-873b-5875b296e05d tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:47:22.160984 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-b57ff2d0-5053-4c9b-873b-5875b296e05d tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81c625b34f1a41739399ed62cf9a9412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d8b2319f2f43a7aef198279bd348fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:47:22.173093 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-b57ff2d0-5053-4c9b-873b-5875b296e05d tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] 10.222.0.18 "GET /compute/v2.1/servers/63289da2-fe8a-4a50-af8c-6b48d23b8c94" status: 200 len: 1471 microversion: 2.1 time: 0.174811 Oct 22 21:47:22.173923 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3068/6163] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:47:21 2022] GET /compute/v2.1/servers/63289da2-fe8a-4a50-af8c-6b48d23b8c94 => generated 1471 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:47:23.201286 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-c7c82e8f-2f89-4018-96f4-ce1729fdcb12 tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:47:23.202895 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-c7c82e8f-2f89-4018-96f4-ce1729fdcb12 tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] [instance: 63289da2-fe8a-4a50-af8c-6b48d23b8c94] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:47:23.207551 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell0:SELECT=2 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:47:23.212970 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c7c82e8f-2f89-4018-96f4-ce1729fdcb12 tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:47:23.213790 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c7c82e8f-2f89-4018-96f4-ce1729fdcb12 tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:47:23.214466 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c7c82e8f-2f89-4018-96f4-ce1729fdcb12 tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:47:23.215391 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c7c82e8f-2f89-4018-96f4-ce1729fdcb12 tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:47:23.216090 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c7c82e8f-2f89-4018-96f4-ce1729fdcb12 tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:47:23.216654 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c7c82e8f-2f89-4018-96f4-ce1729fdcb12 tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:47:23.235804 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell0:SELECT=6 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:47:23.369476 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-c7c82e8f-2f89-4018-96f4-ce1729fdcb12 tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81c625b34f1a41739399ed62cf9a9412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d8b2319f2f43a7aef198279bd348fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:47:23.377783 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-c7c82e8f-2f89-4018-96f4-ce1729fdcb12 tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] 10.222.0.18 "GET /compute/v2.1/servers/63289da2-fe8a-4a50-af8c-6b48d23b8c94" status: 200 len: 1471 microversion: 2.1 time: 0.182349 Oct 22 21:47:23.378367 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3096/6164] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:47:23 2022] GET /compute/v2.1/servers/63289da2-fe8a-4a50-af8c-6b48d23b8c94 => generated 1471 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:47:23.684120 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell0:SELECT=6 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:47:23.734374 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-53b2391d-9a23-46ae-a7cf-cd12d62e6c25 req-f03df174-9196-405d-984c-ae69766c75d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63289da2-fe8a-4a50-af8c-6b48d23b8c94", "name": "network-vif-plugged", "status": "completed", "tag": "4fcf64c3-d3bc-4f93-99c2-d0fab64676c7"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:47:23.744385 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-53b2391d-9a23-46ae-a7cf-cd12d62e6c25 req-f03df174-9196-405d-984c-ae69766c75d4 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:47:23.744870 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-53b2391d-9a23-46ae-a7cf-cd12d62e6c25 req-f03df174-9196-405d-984c-ae69766c75d4 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:47:23.745313 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-53b2391d-9a23-46ae-a7cf-cd12d62e6c25 req-f03df174-9196-405d-984c-ae69766c75d4 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:47:23.756660 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-53b2391d-9a23-46ae-a7cf-cd12d62e6c25 req-f03df174-9196-405d-984c-ae69766c75d4 service nova] Creating event network-vif-plugged:4fcf64c3-d3bc-4f93-99c2-d0fab64676c7 for instance 63289da2-fe8a-4a50-af8c-6b48d23b8c94 on nch1-master-1 Oct 22 21:47:23.761770 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-53b2391d-9a23-46ae-a7cf-cd12d62e6c25 req-f03df174-9196-405d-984c-ae69766c75d4 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083061 Oct 22 21:47:23.762336 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3069/6165] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:47:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:47:24.403199 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-adf537f3-14ce-4069-b8ca-f5eb3a8d8015 tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:47:24.403906 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-adf537f3-14ce-4069-b8ca-f5eb3a8d8015 tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] [instance: 63289da2-fe8a-4a50-af8c-6b48d23b8c94] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:47:24.411324 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-adf537f3-14ce-4069-b8ca-f5eb3a8d8015 tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:47:24.411891 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-adf537f3-14ce-4069-b8ca-f5eb3a8d8015 tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:47:24.412362 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-adf537f3-14ce-4069-b8ca-f5eb3a8d8015 tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:47:24.413110 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-adf537f3-14ce-4069-b8ca-f5eb3a8d8015 tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:47:24.413578 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-adf537f3-14ce-4069-b8ca-f5eb3a8d8015 tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:47:24.414026 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-adf537f3-14ce-4069-b8ca-f5eb3a8d8015 tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:47:24.560405 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-adf537f3-14ce-4069-b8ca-f5eb3a8d8015 tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81c625b34f1a41739399ed62cf9a9412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d8b2319f2f43a7aef198279bd348fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:47:24.572185 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-adf537f3-14ce-4069-b8ca-f5eb3a8d8015 tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] 10.222.0.18 "GET /compute/v2.1/servers/63289da2-fe8a-4a50-af8c-6b48d23b8c94" status: 200 len: 1471 microversion: 2.1 time: 0.173253 Oct 22 21:47:24.572773 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3097/6166] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:47:24 2022] GET /compute/v2.1/servers/63289da2-fe8a-4a50-af8c-6b48d23b8c94 => generated 1471 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:47:25.602988 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-af320d37-344a-40d6-b3f7-ed88e256a812 tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:47:25.603904 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-af320d37-344a-40d6-b3f7-ed88e256a812 tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] [instance: 63289da2-fe8a-4a50-af8c-6b48d23b8c94] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:47:25.611052 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-af320d37-344a-40d6-b3f7-ed88e256a812 tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:47:25.611585 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-af320d37-344a-40d6-b3f7-ed88e256a812 tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:47:25.612026 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-af320d37-344a-40d6-b3f7-ed88e256a812 tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:47:25.612829 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-af320d37-344a-40d6-b3f7-ed88e256a812 tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:47:25.613352 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-af320d37-344a-40d6-b3f7-ed88e256a812 tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:47:25.613796 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-af320d37-344a-40d6-b3f7-ed88e256a812 tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:47:25.759231 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-af320d37-344a-40d6-b3f7-ed88e256a812 tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81c625b34f1a41739399ed62cf9a9412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d8b2319f2f43a7aef198279bd348fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:47:25.773089 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-af320d37-344a-40d6-b3f7-ed88e256a812 tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] 10.222.0.18 "GET /compute/v2.1/servers/63289da2-fe8a-4a50-af8c-6b48d23b8c94" status: 200 len: 1642 microversion: 2.1 time: 0.179266 Oct 22 21:47:25.774015 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3070/6167] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:47:25 2022] GET /compute/v2.1/servers/63289da2-fe8a-4a50-af8c-6b48d23b8c94 => generated 1642 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:47:25.796460 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-fb906b6c-0cef-40ff-a144-92466691732a tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:47:25.797778 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-fb906b6c-0cef-40ff-a144-92466691732a tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] [instance: 63289da2-fe8a-4a50-af8c-6b48d23b8c94] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:47:25.805899 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fb906b6c-0cef-40ff-a144-92466691732a tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:47:25.806652 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fb906b6c-0cef-40ff-a144-92466691732a tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:47:25.807205 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fb906b6c-0cef-40ff-a144-92466691732a tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:47:25.808126 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fb906b6c-0cef-40ff-a144-92466691732a tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:47:25.808728 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fb906b6c-0cef-40ff-a144-92466691732a tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:47:25.809177 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fb906b6c-0cef-40ff-a144-92466691732a tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:47:25.965630 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-fb906b6c-0cef-40ff-a144-92466691732a tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81c625b34f1a41739399ed62cf9a9412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d8b2319f2f43a7aef198279bd348fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:47:25.974148 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-fb906b6c-0cef-40ff-a144-92466691732a tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] 10.222.0.18 "GET /compute/v2.1/servers/63289da2-fe8a-4a50-af8c-6b48d23b8c94" status: 200 len: 1642 microversion: 2.1 time: 0.181651 Oct 22 21:47:25.974778 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3098/6168] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:47:25 2022] GET /compute/v2.1/servers/63289da2-fe8a-4a50-af8c-6b48d23b8c94 => generated 1642 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:47:25.998528 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-afd4022b-49a8-4d6a-af38-375bb3e04b7b tempest-TestSecurityGroupsBasicOps-290685534 tempest-TestSecurityGroupsBasicOps-290685534-project-admin] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:47:25.999135 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-afd4022b-49a8-4d6a-af38-375bb3e04b7b tempest-TestSecurityGroupsBasicOps-290685534 tempest-TestSecurityGroupsBasicOps-290685534-project-admin] [instance: 63289da2-fe8a-4a50-af8c-6b48d23b8c94] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:47:26.005410 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-afd4022b-49a8-4d6a-af38-375bb3e04b7b tempest-TestSecurityGroupsBasicOps-290685534 tempest-TestSecurityGroupsBasicOps-290685534-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:47:26.005901 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-afd4022b-49a8-4d6a-af38-375bb3e04b7b tempest-TestSecurityGroupsBasicOps-290685534 tempest-TestSecurityGroupsBasicOps-290685534-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:47:26.006350 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-afd4022b-49a8-4d6a-af38-375bb3e04b7b tempest-TestSecurityGroupsBasicOps-290685534 tempest-TestSecurityGroupsBasicOps-290685534-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:47:26.007053 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-afd4022b-49a8-4d6a-af38-375bb3e04b7b tempest-TestSecurityGroupsBasicOps-290685534 tempest-TestSecurityGroupsBasicOps-290685534-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:47:26.007553 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-afd4022b-49a8-4d6a-af38-375bb3e04b7b tempest-TestSecurityGroupsBasicOps-290685534 tempest-TestSecurityGroupsBasicOps-290685534-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:47:26.007986 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-afd4022b-49a8-4d6a-af38-375bb3e04b7b tempest-TestSecurityGroupsBasicOps-290685534 tempest-TestSecurityGroupsBasicOps-290685534-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:47:26.251616 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-afd4022b-49a8-4d6a-af38-375bb3e04b7b tempest-TestSecurityGroupsBasicOps-290685534 tempest-TestSecurityGroupsBasicOps-290685534-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/63289da2-fe8a-4a50-af8c-6b48d23b8c94" status: 200 len: 1793 microversion: 2.1 time: 0.257103 Oct 22 21:47:26.252200 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3071/6169] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:47:25 2022] GET /compute/v2.1/servers/63289da2-fe8a-4a50-af8c-6b48d23b8c94 => generated 1793 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:47:27.990779 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-8783d6ad-ee35-4ce3-ae7a-2294fa6494fd req-ca5e7eb5-43d0-4f56-93d5-f944437f3404 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "63289da2-fe8a-4a50-af8c-6b48d23b8c94", "tag": "4fcf64c3-d3bc-4f93-99c2-d0fab64676c7"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:47:28.002977 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-8783d6ad-ee35-4ce3-ae7a-2294fa6494fd req-ca5e7eb5-43d0-4f56-93d5-f944437f3404 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:47:28.004114 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-8783d6ad-ee35-4ce3-ae7a-2294fa6494fd req-ca5e7eb5-43d0-4f56-93d5-f944437f3404 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:47:28.005116 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-8783d6ad-ee35-4ce3-ae7a-2294fa6494fd req-ca5e7eb5-43d0-4f56-93d5-f944437f3404 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:47:28.019845 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-8783d6ad-ee35-4ce3-ae7a-2294fa6494fd req-ca5e7eb5-43d0-4f56-93d5-f944437f3404 service nova] Creating event network-changed:4fcf64c3-d3bc-4f93-99c2-d0fab64676c7 for instance 63289da2-fe8a-4a50-af8c-6b48d23b8c94 on nch1-master-1 Oct 22 21:47:28.025386 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-8783d6ad-ee35-4ce3-ae7a-2294fa6494fd req-ca5e7eb5-43d0-4f56-93d5-f944437f3404 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101609 Oct 22 21:47:28.026743 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3099/6170] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:47:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:48:38.281883 ncdv-master-1 devstack@n-api.service[138744]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 22 21:48:38.282392 ncdv-master-1 devstack@n-api.service[138744]: Sat Oct 22 21:48:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.18) !!! Oct 22 21:48:38.283204 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=1 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:48:38.283984 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:SELECT=38 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:48:38.288811 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-30ac3107-dd15-486a-817f-04686075410f tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-smoke-398977470", "imageRef": "085e4478-6edc-4a69-8e08-f9831713eb65", "flavorRef": "452", "networks": [{"uuid": "87971596-48c2-4005-a29e-22b756db9aff"}], "key_name": "tempest-TestSecurityGroupsBasicOps-865037689", "security_groups": []}, "os:scheduler_hints": {"different_host": ["63289da2-fe8a-4a50-af8c-6b48d23b8c94"]}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:48:38.350710 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.network.neutron [None req-30ac3107-dd15-486a-817f-04686075410f tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] validate_networks() for [('87971596-48c2-4005-a29e-22b756db9aff', None, None, None, None, None)] {{(pid=138744) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 21:48:39.374121 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-30ac3107-dd15-486a-817f-04686075410f tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Flavor limits 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 21:48:39.374802 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-30ac3107-dd15-486a-817f-04686075410f tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Image limits 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 21:48:39.375025 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-30ac3107-dd15-486a-817f-04686075410f tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Flavor pref 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 21:48:39.375476 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-30ac3107-dd15-486a-817f-04686075410f tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Image pref 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 21:48:39.375906 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-30ac3107-dd15-486a-817f-04686075410f tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 21:48:39.393332 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-30ac3107-dd15-486a-817f-04686075410f tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:48:39.393926 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-30ac3107-dd15-486a-817f-04686075410f tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:48:39.394961 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-30ac3107-dd15-486a-817f-04686075410f tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:48:39.395938 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-30ac3107-dd15-486a-817f-04686075410f tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:48:39.396472 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-30ac3107-dd15-486a-817f-04686075410f tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:48:39.396975 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-30ac3107-dd15-486a-817f-04686075410f tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:48:39.444647 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-30ac3107-dd15-486a-817f-04686075410f tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Getting quotas for project 18d8b2319f2f43a7aef198279bd348fe. Resources: {'cores', 'instances', 'ram'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 21:48:39.454039 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-30ac3107-dd15-486a-817f-04686075410f tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Getting quotas for user 81c625b34f1a41739399ed62cf9a9412 and project 18d8b2319f2f43a7aef198279bd348fe. Resources: {'cores', 'instances', 'ram'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 21:48:39.470468 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-30ac3107-dd15-486a-817f-04686075410f tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Going to run 1 instances... {{(pid=138744) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 21:48:39.473330 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-30ac3107-dd15-486a-817f-04686075410f tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] [instance: 942a73a8-318d-457b-a494-e73b5f69f018] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='085e4478-6edc-4a69-8e08-f9831713eb65',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138744) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 21:48:39.529454 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-30ac3107-dd15-486a-817f-04686075410f tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 361 microversion: 2.1 time: 1.250073 Oct 22 21:48:39.530351 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3072/6171] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Oct 22 21:48:38 2022] POST /compute/v2.1/servers => generated 361 bytes in 1252 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 22 21:48:39.541228 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:48:39.542299 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell1:SELECT=42 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:48:39.549167 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-3bab0528-94c7-4f8d-b5e2-a4249a26dea3 tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:48:39.551232 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-3bab0528-94c7-4f8d-b5e2-a4249a26dea3 tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] [instance: 942a73a8-318d-457b-a494-e73b5f69f018] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:48:39.645271 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-3bab0528-94c7-4f8d-b5e2-a4249a26dea3 tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81c625b34f1a41739399ed62cf9a9412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d8b2319f2f43a7aef198279bd348fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:48:39.660300 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-3bab0528-94c7-4f8d-b5e2-a4249a26dea3 tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] 10.222.0.18 "GET /compute/v2.1/servers/942a73a8-318d-457b-a494-e73b5f69f018" status: 200 len: 1240 microversion: 2.1 time: 0.122140 Oct 22 21:48:39.661549 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3100/6172] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:48:39 2022] GET /compute/v2.1/servers/942a73a8-318d-457b-a494-e73b5f69f018 => generated 1240 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:48:40.685553 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-e035f3a4-1510-4e26-a7ea-890ba20e7acf tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:48:40.686160 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-e035f3a4-1510-4e26-a7ea-890ba20e7acf tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] [instance: 942a73a8-318d-457b-a494-e73b5f69f018] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:48:40.693127 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e035f3a4-1510-4e26-a7ea-890ba20e7acf tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:48:40.693623 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e035f3a4-1510-4e26-a7ea-890ba20e7acf tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:48:40.694062 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e035f3a4-1510-4e26-a7ea-890ba20e7acf tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:48:40.694777 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e035f3a4-1510-4e26-a7ea-890ba20e7acf tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:48:40.695228 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e035f3a4-1510-4e26-a7ea-890ba20e7acf tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:48:40.695686 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e035f3a4-1510-4e26-a7ea-890ba20e7acf tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:48:40.774341 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-e035f3a4-1510-4e26-a7ea-890ba20e7acf tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81c625b34f1a41739399ed62cf9a9412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d8b2319f2f43a7aef198279bd348fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:48:40.783266 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-e035f3a4-1510-4e26-a7ea-890ba20e7acf tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] 10.222.0.18 "GET /compute/v2.1/servers/942a73a8-318d-457b-a494-e73b5f69f018" status: 200 len: 1292 microversion: 2.1 time: 0.102707 Oct 22 21:48:40.784634 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3073/6173] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:48:40 2022] GET /compute/v2.1/servers/942a73a8-318d-457b-a494-e73b5f69f018 => generated 1292 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:48:41.808127 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-082b6007-ca60-47d5-a71c-a510be9493a9 tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:48:41.808752 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-082b6007-ca60-47d5-a71c-a510be9493a9 tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] [instance: 942a73a8-318d-457b-a494-e73b5f69f018] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:48:41.817032 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-082b6007-ca60-47d5-a71c-a510be9493a9 tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:48:41.817536 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-082b6007-ca60-47d5-a71c-a510be9493a9 tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:48:41.817980 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-082b6007-ca60-47d5-a71c-a510be9493a9 tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:48:41.818702 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-082b6007-ca60-47d5-a71c-a510be9493a9 tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:48:41.819355 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-082b6007-ca60-47d5-a71c-a510be9493a9 tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:48:41.819810 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-082b6007-ca60-47d5-a71c-a510be9493a9 tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:48:41.958632 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-082b6007-ca60-47d5-a71c-a510be9493a9 tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81c625b34f1a41739399ed62cf9a9412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d8b2319f2f43a7aef198279bd348fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:48:41.967077 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-082b6007-ca60-47d5-a71c-a510be9493a9 tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] 10.222.0.18 "GET /compute/v2.1/servers/942a73a8-318d-457b-a494-e73b5f69f018" status: 200 len: 1298 microversion: 2.1 time: 0.162944 Oct 22 21:48:41.967740 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3101/6174] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:48:41 2022] GET /compute/v2.1/servers/942a73a8-318d-457b-a494-e73b5f69f018 => generated 1298 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:48:42.449290 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-add60636-9bdf-4dc3-97c8-aeba8e637050 req-b816d2df-b1ee-4fb9-b095-fb897045a08a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "942a73a8-318d-457b-a494-e73b5f69f018", "tag": "463dfb1d-4628-4fe5-9ad7-a267facb3857"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:48:42.460650 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-add60636-9bdf-4dc3-97c8-aeba8e637050 req-b816d2df-b1ee-4fb9-b095-fb897045a08a service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:48:42.461139 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-add60636-9bdf-4dc3-97c8-aeba8e637050 req-b816d2df-b1ee-4fb9-b095-fb897045a08a service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:48:42.461581 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-add60636-9bdf-4dc3-97c8-aeba8e637050 req-b816d2df-b1ee-4fb9-b095-fb897045a08a service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:48:42.477589 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-add60636-9bdf-4dc3-97c8-aeba8e637050 req-b816d2df-b1ee-4fb9-b095-fb897045a08a service nova] Creating event network-changed:463dfb1d-4628-4fe5-9ad7-a267facb3857 for instance 942a73a8-318d-457b-a494-e73b5f69f018 on nch2-master-1 Oct 22 21:48:42.482547 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-add60636-9bdf-4dc3-97c8-aeba8e637050 req-b816d2df-b1ee-4fb9-b095-fb897045a08a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037004 Oct 22 21:48:42.483159 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3074/6175] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:48:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:48:42.990977 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-55239195-cd70-4a82-a560-1b7afaf29593 tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:48:42.991642 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-55239195-cd70-4a82-a560-1b7afaf29593 tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] [instance: 942a73a8-318d-457b-a494-e73b5f69f018] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:48:42.999240 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-55239195-cd70-4a82-a560-1b7afaf29593 tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:48:42.999811 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-55239195-cd70-4a82-a560-1b7afaf29593 tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:48:43.000401 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-55239195-cd70-4a82-a560-1b7afaf29593 tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:48:43.001162 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-55239195-cd70-4a82-a560-1b7afaf29593 tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:48:43.001792 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-55239195-cd70-4a82-a560-1b7afaf29593 tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:48:43.002454 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-55239195-cd70-4a82-a560-1b7afaf29593 tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:48:43.094404 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-55239195-cd70-4a82-a560-1b7afaf29593 tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81c625b34f1a41739399ed62cf9a9412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d8b2319f2f43a7aef198279bd348fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:48:43.103292 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-55239195-cd70-4a82-a560-1b7afaf29593 tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] 10.222.0.18 "GET /compute/v2.1/servers/942a73a8-318d-457b-a494-e73b5f69f018" status: 200 len: 1298 microversion: 2.1 time: 0.116867 Oct 22 21:48:43.103912 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3102/6176] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:48:42 2022] GET /compute/v2.1/servers/942a73a8-318d-457b-a494-e73b5f69f018 => generated 1298 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:48:44.129057 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-1b2ab719-91e4-45e4-809c-13563d57f604 tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:48:44.130289 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-1b2ab719-91e4-45e4-809c-13563d57f604 tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] [instance: 942a73a8-318d-457b-a494-e73b5f69f018] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:48:44.137810 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1b2ab719-91e4-45e4-809c-13563d57f604 tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:48:44.138326 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1b2ab719-91e4-45e4-809c-13563d57f604 tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:48:44.138765 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1b2ab719-91e4-45e4-809c-13563d57f604 tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:48:44.139499 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1b2ab719-91e4-45e4-809c-13563d57f604 tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:48:44.139961 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1b2ab719-91e4-45e4-809c-13563d57f604 tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:48:44.140388 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1b2ab719-91e4-45e4-809c-13563d57f604 tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:48:44.262305 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-1b2ab719-91e4-45e4-809c-13563d57f604 tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81c625b34f1a41739399ed62cf9a9412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d8b2319f2f43a7aef198279bd348fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:48:44.278311 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-1b2ab719-91e4-45e4-809c-13563d57f604 tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] 10.222.0.18 "GET /compute/v2.1/servers/942a73a8-318d-457b-a494-e73b5f69f018" status: 200 len: 1298 microversion: 2.1 time: 0.155391 Oct 22 21:48:44.278918 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3075/6177] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:48:44 2022] GET /compute/v2.1/servers/942a73a8-318d-457b-a494-e73b5f69f018 => generated 1298 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:48:45.302261 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-220bba7b-74e5-4929-af8e-6404f857f9cf tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:48:45.302885 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-220bba7b-74e5-4929-af8e-6404f857f9cf tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] [instance: 942a73a8-318d-457b-a494-e73b5f69f018] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:48:45.310432 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-220bba7b-74e5-4929-af8e-6404f857f9cf tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:48:45.310929 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-220bba7b-74e5-4929-af8e-6404f857f9cf tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:48:45.311374 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-220bba7b-74e5-4929-af8e-6404f857f9cf tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:48:45.312128 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-220bba7b-74e5-4929-af8e-6404f857f9cf tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:48:45.312596 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-220bba7b-74e5-4929-af8e-6404f857f9cf tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:48:45.313034 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-220bba7b-74e5-4929-af8e-6404f857f9cf tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:48:45.398254 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-220bba7b-74e5-4929-af8e-6404f857f9cf tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81c625b34f1a41739399ed62cf9a9412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d8b2319f2f43a7aef198279bd348fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:48:45.406497 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-220bba7b-74e5-4929-af8e-6404f857f9cf tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] 10.222.0.18 "GET /compute/v2.1/servers/942a73a8-318d-457b-a494-e73b5f69f018" status: 200 len: 1298 microversion: 2.1 time: 0.108283 Oct 22 21:48:45.407304 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3103/6178] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:48:45 2022] GET /compute/v2.1/servers/942a73a8-318d-457b-a494-e73b5f69f018 => generated 1298 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:48:46.434450 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-07434537-f360-4c98-a9d5-db4ee4341ff6 tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:48:46.435533 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-07434537-f360-4c98-a9d5-db4ee4341ff6 tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] [instance: 942a73a8-318d-457b-a494-e73b5f69f018] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:48:46.447121 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-07434537-f360-4c98-a9d5-db4ee4341ff6 tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:48:46.448113 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-07434537-f360-4c98-a9d5-db4ee4341ff6 tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:48:46.448712 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-07434537-f360-4c98-a9d5-db4ee4341ff6 tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:48:46.450123 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-07434537-f360-4c98-a9d5-db4ee4341ff6 tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:48:46.450608 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-07434537-f360-4c98-a9d5-db4ee4341ff6 tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:48:46.451326 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-07434537-f360-4c98-a9d5-db4ee4341ff6 tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:48:46.541163 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-07434537-f360-4c98-a9d5-db4ee4341ff6 tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81c625b34f1a41739399ed62cf9a9412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d8b2319f2f43a7aef198279bd348fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:48:46.549314 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-07434537-f360-4c98-a9d5-db4ee4341ff6 tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] 10.222.0.18 "GET /compute/v2.1/servers/942a73a8-318d-457b-a494-e73b5f69f018" status: 200 len: 1298 microversion: 2.1 time: 0.121468 Oct 22 21:48:46.550148 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3076/6179] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:48:46 2022] GET /compute/v2.1/servers/942a73a8-318d-457b-a494-e73b5f69f018 => generated 1298 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:48:47.573005 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-3ef7ac98-6ecd-4e3f-b1ef-a2bba43f3f6d tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:48:47.573675 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-3ef7ac98-6ecd-4e3f-b1ef-a2bba43f3f6d tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] [instance: 942a73a8-318d-457b-a494-e73b5f69f018] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:48:47.580952 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3ef7ac98-6ecd-4e3f-b1ef-a2bba43f3f6d tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:48:47.581458 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3ef7ac98-6ecd-4e3f-b1ef-a2bba43f3f6d tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:48:47.581913 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3ef7ac98-6ecd-4e3f-b1ef-a2bba43f3f6d tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:48:47.582633 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3ef7ac98-6ecd-4e3f-b1ef-a2bba43f3f6d tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:48:47.583109 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3ef7ac98-6ecd-4e3f-b1ef-a2bba43f3f6d tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:48:47.583592 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3ef7ac98-6ecd-4e3f-b1ef-a2bba43f3f6d tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:48:47.671499 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-3ef7ac98-6ecd-4e3f-b1ef-a2bba43f3f6d tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81c625b34f1a41739399ed62cf9a9412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d8b2319f2f43a7aef198279bd348fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:48:47.679707 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-3ef7ac98-6ecd-4e3f-b1ef-a2bba43f3f6d tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] 10.222.0.18 "GET /compute/v2.1/servers/942a73a8-318d-457b-a494-e73b5f69f018" status: 200 len: 1298 microversion: 2.1 time: 0.110708 Oct 22 21:48:47.680303 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3104/6180] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:48:47 2022] GET /compute/v2.1/servers/942a73a8-318d-457b-a494-e73b5f69f018 => generated 1298 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:48:47.765142 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-b6958b91-07cc-450f-83f0-99cd4d0f4d8d req-e385fedb-c2df-457e-af9c-ce36ef2d3725 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "942a73a8-318d-457b-a494-e73b5f69f018", "name": "network-vif-plugged", "status": "completed", "tag": "463dfb1d-4628-4fe5-9ad7-a267facb3857"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:48:47.776664 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-b6958b91-07cc-450f-83f0-99cd4d0f4d8d req-e385fedb-c2df-457e-af9c-ce36ef2d3725 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:48:47.777185 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-b6958b91-07cc-450f-83f0-99cd4d0f4d8d req-e385fedb-c2df-457e-af9c-ce36ef2d3725 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:48:47.777625 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-b6958b91-07cc-450f-83f0-99cd4d0f4d8d req-e385fedb-c2df-457e-af9c-ce36ef2d3725 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:48:47.789638 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-b6958b91-07cc-450f-83f0-99cd4d0f4d8d req-e385fedb-c2df-457e-af9c-ce36ef2d3725 service nova] Creating event network-vif-plugged:463dfb1d-4628-4fe5-9ad7-a267facb3857 for instance 942a73a8-318d-457b-a494-e73b5f69f018 on nch2-master-1 Oct 22 21:48:47.794784 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-b6958b91-07cc-450f-83f0-99cd4d0f4d8d req-e385fedb-c2df-457e-af9c-ce36ef2d3725 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033566 Oct 22 21:48:47.795637 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3077/6181] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:48:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:48:48.703375 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-72d18ee3-cd7f-43e5-a973-678325d025d1 tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:48:48.704035 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-72d18ee3-cd7f-43e5-a973-678325d025d1 tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] [instance: 942a73a8-318d-457b-a494-e73b5f69f018] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:48:48.711453 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-72d18ee3-cd7f-43e5-a973-678325d025d1 tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:48:48.711966 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-72d18ee3-cd7f-43e5-a973-678325d025d1 tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:48:48.712435 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-72d18ee3-cd7f-43e5-a973-678325d025d1 tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:48:48.713150 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-72d18ee3-cd7f-43e5-a973-678325d025d1 tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:48:48.713620 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-72d18ee3-cd7f-43e5-a973-678325d025d1 tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:48:48.714061 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-72d18ee3-cd7f-43e5-a973-678325d025d1 tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:48:48.799054 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-72d18ee3-cd7f-43e5-a973-678325d025d1 tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81c625b34f1a41739399ed62cf9a9412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d8b2319f2f43a7aef198279bd348fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:48:48.811333 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-72d18ee3-cd7f-43e5-a973-678325d025d1 tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] 10.222.0.18 "GET /compute/v2.1/servers/942a73a8-318d-457b-a494-e73b5f69f018" status: 200 len: 1298 microversion: 2.1 time: 0.111683 Oct 22 21:48:48.812191 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3105/6182] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:48:48 2022] GET /compute/v2.1/servers/942a73a8-318d-457b-a494-e73b5f69f018 => generated 1298 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:48:49.835479 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell0:SELECT=2 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:48:49.836302 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell0:SELECT=6 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:48:49.840386 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-856f7012-5d41-4231-ae4e-30a9a38ffcf9 tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:48:49.841145 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-856f7012-5d41-4231-ae4e-30a9a38ffcf9 tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] [instance: 942a73a8-318d-457b-a494-e73b5f69f018] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:48:49.848921 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-856f7012-5d41-4231-ae4e-30a9a38ffcf9 tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:48:49.849412 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-856f7012-5d41-4231-ae4e-30a9a38ffcf9 tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:48:49.849839 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-856f7012-5d41-4231-ae4e-30a9a38ffcf9 tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:48:49.850544 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-856f7012-5d41-4231-ae4e-30a9a38ffcf9 tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:48:49.851011 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-856f7012-5d41-4231-ae4e-30a9a38ffcf9 tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:48:49.851471 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-856f7012-5d41-4231-ae4e-30a9a38ffcf9 tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:48:49.934877 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-856f7012-5d41-4231-ae4e-30a9a38ffcf9 tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81c625b34f1a41739399ed62cf9a9412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d8b2319f2f43a7aef198279bd348fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:48:49.943584 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-856f7012-5d41-4231-ae4e-30a9a38ffcf9 tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] 10.222.0.18 "GET /compute/v2.1/servers/942a73a8-318d-457b-a494-e73b5f69f018" status: 200 len: 1470 microversion: 2.1 time: 0.109932 Oct 22 21:48:49.944174 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3078/6183] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:48:49 2022] GET /compute/v2.1/servers/942a73a8-318d-457b-a494-e73b5f69f018 => generated 1470 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:48:49.966381 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-a3e509bb-4c57-464c-ba48-f3b7053213c4 tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:48:49.966998 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-a3e509bb-4c57-464c-ba48-f3b7053213c4 tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] [instance: 942a73a8-318d-457b-a494-e73b5f69f018] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:48:49.969421 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell0:SELECT=2 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:48:49.975775 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a3e509bb-4c57-464c-ba48-f3b7053213c4 tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:48:49.976306 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a3e509bb-4c57-464c-ba48-f3b7053213c4 tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:48:49.976755 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a3e509bb-4c57-464c-ba48-f3b7053213c4 tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:48:49.977465 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a3e509bb-4c57-464c-ba48-f3b7053213c4 tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:48:49.977999 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a3e509bb-4c57-464c-ba48-f3b7053213c4 tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:48:49.978377 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a3e509bb-4c57-464c-ba48-f3b7053213c4 tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:48:50.063427 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-a3e509bb-4c57-464c-ba48-f3b7053213c4 tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81c625b34f1a41739399ed62cf9a9412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d8b2319f2f43a7aef198279bd348fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:48:50.075574 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-a3e509bb-4c57-464c-ba48-f3b7053213c4 tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] 10.222.0.18 "GET /compute/v2.1/servers/942a73a8-318d-457b-a494-e73b5f69f018" status: 200 len: 1470 microversion: 2.1 time: 0.112861 Oct 22 21:48:50.076313 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3106/6184] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:48:49 2022] GET /compute/v2.1/servers/942a73a8-318d-457b-a494-e73b5f69f018 => generated 1470 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:48:50.100194 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-c4d83a9d-bdeb-441f-a9ea-0436ead3ceac tempest-TestSecurityGroupsBasicOps-290685534 tempest-TestSecurityGroupsBasicOps-290685534-project-admin] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:48:50.100816 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-c4d83a9d-bdeb-441f-a9ea-0436ead3ceac tempest-TestSecurityGroupsBasicOps-290685534 tempest-TestSecurityGroupsBasicOps-290685534-project-admin] [instance: 942a73a8-318d-457b-a494-e73b5f69f018] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:48:50.107532 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c4d83a9d-bdeb-441f-a9ea-0436ead3ceac tempest-TestSecurityGroupsBasicOps-290685534 tempest-TestSecurityGroupsBasicOps-290685534-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:48:50.108053 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c4d83a9d-bdeb-441f-a9ea-0436ead3ceac tempest-TestSecurityGroupsBasicOps-290685534 tempest-TestSecurityGroupsBasicOps-290685534-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:48:50.108497 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c4d83a9d-bdeb-441f-a9ea-0436ead3ceac tempest-TestSecurityGroupsBasicOps-290685534 tempest-TestSecurityGroupsBasicOps-290685534-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:48:50.109203 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c4d83a9d-bdeb-441f-a9ea-0436ead3ceac tempest-TestSecurityGroupsBasicOps-290685534 tempest-TestSecurityGroupsBasicOps-290685534-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:48:50.109660 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c4d83a9d-bdeb-441f-a9ea-0436ead3ceac tempest-TestSecurityGroupsBasicOps-290685534 tempest-TestSecurityGroupsBasicOps-290685534-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:48:50.110096 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c4d83a9d-bdeb-441f-a9ea-0436ead3ceac tempest-TestSecurityGroupsBasicOps-290685534 tempest-TestSecurityGroupsBasicOps-290685534-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:48:50.197492 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-c4d83a9d-bdeb-441f-a9ea-0436ead3ceac tempest-TestSecurityGroupsBasicOps-290685534 tempest-TestSecurityGroupsBasicOps-290685534-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/942a73a8-318d-457b-a494-e73b5f69f018" status: 200 len: 1621 microversion: 2.1 time: 0.101200 Oct 22 21:48:50.198064 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3079/6185] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:48:50 2022] GET /compute/v2.1/servers/942a73a8-318d-457b-a494-e73b5f69f018 => generated 1621 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:48:50.219977 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-fc1ff754-b798-4deb-b1b8-49702fdc01d6 tempest-TestSecurityGroupsBasicOps-290685534 tempest-TestSecurityGroupsBasicOps-290685534-project-admin] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:48:50.220640 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-fc1ff754-b798-4deb-b1b8-49702fdc01d6 tempest-TestSecurityGroupsBasicOps-290685534 tempest-TestSecurityGroupsBasicOps-290685534-project-admin] [instance: 63289da2-fe8a-4a50-af8c-6b48d23b8c94] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:48:50.227397 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fc1ff754-b798-4deb-b1b8-49702fdc01d6 tempest-TestSecurityGroupsBasicOps-290685534 tempest-TestSecurityGroupsBasicOps-290685534-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:48:50.228078 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fc1ff754-b798-4deb-b1b8-49702fdc01d6 tempest-TestSecurityGroupsBasicOps-290685534 tempest-TestSecurityGroupsBasicOps-290685534-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:48:50.228527 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fc1ff754-b798-4deb-b1b8-49702fdc01d6 tempest-TestSecurityGroupsBasicOps-290685534 tempest-TestSecurityGroupsBasicOps-290685534-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:48:50.229250 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fc1ff754-b798-4deb-b1b8-49702fdc01d6 tempest-TestSecurityGroupsBasicOps-290685534 tempest-TestSecurityGroupsBasicOps-290685534-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:48:50.229717 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fc1ff754-b798-4deb-b1b8-49702fdc01d6 tempest-TestSecurityGroupsBasicOps-290685534 tempest-TestSecurityGroupsBasicOps-290685534-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:48:50.230164 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fc1ff754-b798-4deb-b1b8-49702fdc01d6 tempest-TestSecurityGroupsBasicOps-290685534 tempest-TestSecurityGroupsBasicOps-290685534-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:48:50.369470 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-fc1ff754-b798-4deb-b1b8-49702fdc01d6 tempest-TestSecurityGroupsBasicOps-290685534 tempest-TestSecurityGroupsBasicOps-290685534-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/63289da2-fe8a-4a50-af8c-6b48d23b8c94" status: 200 len: 1912 microversion: 2.1 time: 0.153564 Oct 22 21:48:50.370050 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3107/6186] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:48:50 2022] GET /compute/v2.1/servers/63289da2-fe8a-4a50-af8c-6b48d23b8c94 => generated 1912 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:48:50.453504 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-d0d18b19-ff02-4c8e-adef-34ca9bc3a8bd tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:48:50.454010 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-d0d18b19-ff02-4c8e-adef-34ca9bc3a8bd tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] [instance: 942a73a8-318d-457b-a494-e73b5f69f018] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:48:50.460320 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d0d18b19-ff02-4c8e-adef-34ca9bc3a8bd tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:48:50.460809 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d0d18b19-ff02-4c8e-adef-34ca9bc3a8bd tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:48:50.461242 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d0d18b19-ff02-4c8e-adef-34ca9bc3a8bd tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:48:50.461927 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d0d18b19-ff02-4c8e-adef-34ca9bc3a8bd tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:48:50.462382 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d0d18b19-ff02-4c8e-adef-34ca9bc3a8bd tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:48:50.462807 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d0d18b19-ff02-4c8e-adef-34ca9bc3a8bd tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:48:50.489036 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-d0d18b19-ff02-4c8e-adef-34ca9bc3a8bd tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] [instance: 942a73a8-318d-457b-a494-e73b5f69f018] Going to try to terminate instance {{(pid=138744) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 21:48:50.571327 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-d0d18b19-ff02-4c8e-adef-34ca9bc3a8bd tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] 10.222.0.18 "DELETE /compute/v2.1/servers/942a73a8-318d-457b-a494-e73b5f69f018" status: 204 len: 0 microversion: 2.1 time: 0.121494 Oct 22 21:48:50.572003 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3080/6187] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 21:48:50 2022] DELETE /compute/v2.1/servers/942a73a8-318d-457b-a494-e73b5f69f018 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 21:48:50.582301 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-e79c2caf-9eda-4225-8f56-8d301b59b2e1 tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:48:50.582932 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-e79c2caf-9eda-4225-8f56-8d301b59b2e1 tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] [instance: 942a73a8-318d-457b-a494-e73b5f69f018] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:48:50.589298 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e79c2caf-9eda-4225-8f56-8d301b59b2e1 tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:48:50.589805 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e79c2caf-9eda-4225-8f56-8d301b59b2e1 tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:48:50.590260 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e79c2caf-9eda-4225-8f56-8d301b59b2e1 tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:48:50.590975 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e79c2caf-9eda-4225-8f56-8d301b59b2e1 tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:48:50.591477 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e79c2caf-9eda-4225-8f56-8d301b59b2e1 tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:48:50.591920 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e79c2caf-9eda-4225-8f56-8d301b59b2e1 tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:48:50.685695 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-e79c2caf-9eda-4225-8f56-8d301b59b2e1 tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81c625b34f1a41739399ed62cf9a9412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d8b2319f2f43a7aef198279bd348fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:48:50.694418 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-e79c2caf-9eda-4225-8f56-8d301b59b2e1 tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] 10.222.0.18 "GET /compute/v2.1/servers/942a73a8-318d-457b-a494-e73b5f69f018" status: 200 len: 1476 microversion: 2.1 time: 0.117848 Oct 22 21:48:50.694898 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3108/6188] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:48:50 2022] GET /compute/v2.1/servers/942a73a8-318d-457b-a494-e73b5f69f018 => generated 1476 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:48:51.723910 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-c74166ee-5113-4a7b-9443-7ad1ef48e8be tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:48:51.725094 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-c74166ee-5113-4a7b-9443-7ad1ef48e8be tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] [instance: 942a73a8-318d-457b-a494-e73b5f69f018] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:48:51.736834 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c74166ee-5113-4a7b-9443-7ad1ef48e8be tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:48:51.737641 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c74166ee-5113-4a7b-9443-7ad1ef48e8be tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:48:51.738382 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c74166ee-5113-4a7b-9443-7ad1ef48e8be tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:48:51.739576 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c74166ee-5113-4a7b-9443-7ad1ef48e8be tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:48:51.740340 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c74166ee-5113-4a7b-9443-7ad1ef48e8be tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:48:51.741163 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c74166ee-5113-4a7b-9443-7ad1ef48e8be tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:48:51.837862 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-c74166ee-5113-4a7b-9443-7ad1ef48e8be tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81c625b34f1a41739399ed62cf9a9412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d8b2319f2f43a7aef198279bd348fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:48:51.846690 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-c74166ee-5113-4a7b-9443-7ad1ef48e8be tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] 10.222.0.18 "GET /compute/v2.1/servers/942a73a8-318d-457b-a494-e73b5f69f018" status: 200 len: 1476 microversion: 2.1 time: 0.130944 Oct 22 21:48:51.847247 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3081/6189] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:48:51 2022] GET /compute/v2.1/servers/942a73a8-318d-457b-a494-e73b5f69f018 => generated 1476 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:48:52.447581 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-6282a8d8-a47a-4358-bde6-f5ebae1c9246 req-5c8ab06e-12d9-4253-a5a6-02fd86c49fbe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "942a73a8-318d-457b-a494-e73b5f69f018", "name": "network-vif-deleted", "tag": "463dfb1d-4628-4fe5-9ad7-a267facb3857"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:48:52.458363 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-6282a8d8-a47a-4358-bde6-f5ebae1c9246 req-5c8ab06e-12d9-4253-a5a6-02fd86c49fbe service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:48:52.458869 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-6282a8d8-a47a-4358-bde6-f5ebae1c9246 req-5c8ab06e-12d9-4253-a5a6-02fd86c49fbe service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:48:52.459321 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-6282a8d8-a47a-4358-bde6-f5ebae1c9246 req-5c8ab06e-12d9-4253-a5a6-02fd86c49fbe service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:48:52.472350 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-6282a8d8-a47a-4358-bde6-f5ebae1c9246 req-5c8ab06e-12d9-4253-a5a6-02fd86c49fbe service nova] Creating event network-vif-deleted:463dfb1d-4628-4fe5-9ad7-a267facb3857 for instance 942a73a8-318d-457b-a494-e73b5f69f018 on nch2-master-1 Oct 22 21:48:52.477932 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-6282a8d8-a47a-4358-bde6-f5ebae1c9246 req-5c8ab06e-12d9-4253-a5a6-02fd86c49fbe service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034184 Oct 22 21:48:52.479527 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3109/6190] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:48:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:48:52.874408 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-613168f5-03cf-45f7-b70a-e9adb56dadf2 tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:48:52.875420 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-613168f5-03cf-45f7-b70a-e9adb56dadf2 tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] [instance: 942a73a8-318d-457b-a494-e73b5f69f018] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:48:52.885148 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-613168f5-03cf-45f7-b70a-e9adb56dadf2 tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:48:52.885582 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-613168f5-03cf-45f7-b70a-e9adb56dadf2 tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:48:52.886018 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-613168f5-03cf-45f7-b70a-e9adb56dadf2 tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:48:52.886722 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-613168f5-03cf-45f7-b70a-e9adb56dadf2 tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:48:52.887178 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-613168f5-03cf-45f7-b70a-e9adb56dadf2 tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:48:52.887645 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-613168f5-03cf-45f7-b70a-e9adb56dadf2 tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:48:52.921859 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-613168f5-03cf-45f7-b70a-e9adb56dadf2 tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:48:52.922213 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-613168f5-03cf-45f7-b70a-e9adb56dadf2 tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:48:52.922618 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-613168f5-03cf-45f7-b70a-e9adb56dadf2 tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:48:52.923069 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.objects.instance [None req-613168f5-03cf-45f7-b70a-e9adb56dadf2 tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Lazy-loading 'fault' on Instance uuid 942a73a8-318d-457b-a494-e73b5f69f018 {{(pid=138744) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 21:48:52.968827 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-613168f5-03cf-45f7-b70a-e9adb56dadf2 tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81c625b34f1a41739399ed62cf9a9412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d8b2319f2f43a7aef198279bd348fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:48:52.977455 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-613168f5-03cf-45f7-b70a-e9adb56dadf2 tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] 10.222.0.18 "GET /compute/v2.1/servers/942a73a8-318d-457b-a494-e73b5f69f018" status: 200 len: 1330 microversion: 2.1 time: 0.109666 Oct 22 21:48:52.978073 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3082/6191] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:48:52 2022] GET /compute/v2.1/servers/942a73a8-318d-457b-a494-e73b5f69f018 => generated 1330 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:48:54.007969 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-dcb1af63-e2ee-493d-a767-65677794d20e tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:48:54.009145 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-dcb1af63-e2ee-493d-a767-65677794d20e tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] [instance: 942a73a8-318d-457b-a494-e73b5f69f018] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:48:54.019694 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-dcb1af63-e2ee-493d-a767-65677794d20e tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:48:54.020570 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-dcb1af63-e2ee-493d-a767-65677794d20e tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:48:54.021324 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-dcb1af63-e2ee-493d-a767-65677794d20e tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:48:54.022702 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-dcb1af63-e2ee-493d-a767-65677794d20e tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:48:54.023176 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-dcb1af63-e2ee-493d-a767-65677794d20e tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:48:54.023681 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-dcb1af63-e2ee-493d-a767-65677794d20e tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:48:54.037589 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.wsgi [None req-dcb1af63-e2ee-493d-a767-65677794d20e tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] HTTP exception thrown: Instance 942a73a8-318d-457b-a494-e73b5f69f018 could not be found. Oct 22 21:48:54.039498 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-dcb1af63-e2ee-493d-a767-65677794d20e tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Request method failure captured: Oct 22 21:48:54.039498 ncdv-master-1 devstack@n-api.service[138745]: request: GET /compute/v2.1/servers/942a73a8-318d-457b-a494-e73b5f69f018 HTTP/1.1 Oct 22 21:48:54.039498 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 21:48:54.039498 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 21:48:54.039498 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 21:48:54.039498 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 0 Oct 22 21:48:54.039498 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 21:48:54.039498 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 21:48:54.039498 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 21:48:54.039498 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 21:48:54.039498 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVGTZTvSwz5SB9GQigffIWH6TNzIzJ0eUAaYuREhq0odHdz0CHKk43BB6DV9S8Iza0ClkKnQ0lalncV7KGYpFdKvSaphuGTa1KzkC53B8o-JdiKyu5zK9b7shfRfqXZgngZo8oqAfgfy9DCnhKU34Iz2xKZqPQZlvYZoPGNiMvUt6-Ds Oct 22 21:48:54.039498 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 21:48:54.039498 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 21:48:54.039498 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 21:48:54.039498 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 21:48:54.039498 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 21:48:54.039498 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 21:48:54.039498 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: 18d8b2319f2f43a7aef198279bd348fe Oct 22 21:48:54.039498 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-1194797901 Oct 22 21:48:54.039498 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 21:48:54.039498 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 21:48:54.039498 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_18d8b2319f2f43a7aef198279bd348fe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/18d8b2319f2f43a7aef198279bd348fe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/18d8b2319f2f43a7aef198279bd348fe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/18d8b2319f2f43a7aef198279bd348fe"}]}] Oct 22 21:48:54.039498 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-TestSecurityGroupsBasicOps-1194797901 Oct 22 21:48:54.039498 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: 18d8b2319f2f43a7aef198279bd348fe Oct 22 21:48:54.039498 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-1194797901 Oct 22 21:48:54.039498 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-TestSecurityGroupsBasicOps-1194797901-project Oct 22 21:48:54.039498 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 21:48:54.039498 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 21:48:54.039498 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: 81c625b34f1a41739399ed62cf9a9412 Oct 22 21:48:54.039498 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-TestSecurityGroupsBasicOps-1194797901-project Oct 22 21:48:54.039498 ncdv-master-1 devstack@n-api.service[138745]: method: > Oct 22 21:48:54.039498 ncdv-master-1 devstack@n-api.service[138745]: exception: Instance 942a73a8-318d-457b-a494-e73b5f69f018 could not be found. Oct 22 21:48:54.039498 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'id': '942a73a8-318d-457b-a494-e73b5f69f018'} Oct 22 21:48:54.039498 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:48:54.039498 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:48:54.039498 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 21:48:54.039498 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 21:48:54.039498 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 21:48:54.039498 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 21:48:54.039498 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 21:48:54.039498 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 21:48:54.039498 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 21:48:54.039498 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 21:48:54.039498 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 942a73a8-318d-457b-a494-e73b5f69f018 could not be found. Oct 22 21:48:54.039498 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:48:54.039498 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:48:54.039498 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:48:54.039498 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:48:54.039498 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:48:54.039498 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:48:54.039498 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:48:54.039498 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:48:54.039498 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:48:54.039498 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:48:54.039498 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 21:48:54.039498 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 21:48:54.039498 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 21:48:54.039498 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 21:48:54.039498 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 21:48:54.039498 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:48:54.039498 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 942a73a8-318d-457b-a494-e73b5f69f018 could not be found. Oct 22 21:48:54.039498 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:48:54.039498 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:48:54.043947 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:48:54.043947 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:48:54.043947 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:48:54.043947 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:48:54.043947 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:48:54.043947 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:48:54.043947 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 942a73a8-318d-457b-a494-e73b5f69f018 could not be found. Oct 22 21:48:54.043947 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:48:54.043947 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-dcb1af63-e2ee-493d-a767-65677794d20e tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Returning 404 to user: Instance 942a73a8-318d-457b-a494-e73b5f69f018 could not be found. {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:48:54.043947 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-dcb1af63-e2ee-493d-a767-65677794d20e tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] 10.222.0.18 "GET /compute/v2.1/servers/942a73a8-318d-457b-a494-e73b5f69f018" status: 404 len: 111 microversion: 2.1 time: 0.041783 Oct 22 21:48:54.043947 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3110/6192] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:48:53 2022] GET /compute/v2.1/servers/942a73a8-318d-457b-a494-e73b5f69f018 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 21:48:58.248624 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-f7fe28be-a334-4413-8e3f-aead06d40c81 tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:48:58.249164 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-f7fe28be-a334-4413-8e3f-aead06d40c81 tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] [instance: 63289da2-fe8a-4a50-af8c-6b48d23b8c94] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:48:58.250831 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-4192a35c-d0a3-434f-ae26-714544d16575 req-835635e0-96e5-4d67-91d4-ba8f605fa18d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "63289da2-fe8a-4a50-af8c-6b48d23b8c94", "tag": "4fcf64c3-d3bc-4f93-99c2-d0fab64676c7"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:48:58.256503 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f7fe28be-a334-4413-8e3f-aead06d40c81 tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:48:58.256999 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f7fe28be-a334-4413-8e3f-aead06d40c81 tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:48:58.257509 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f7fe28be-a334-4413-8e3f-aead06d40c81 tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:48:58.258419 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f7fe28be-a334-4413-8e3f-aead06d40c81 tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:48:58.258878 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f7fe28be-a334-4413-8e3f-aead06d40c81 tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:48:58.259310 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f7fe28be-a334-4413-8e3f-aead06d40c81 tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:48:58.261805 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-4192a35c-d0a3-434f-ae26-714544d16575 req-835635e0-96e5-4d67-91d4-ba8f605fa18d service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:48:58.262585 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-4192a35c-d0a3-434f-ae26-714544d16575 req-835635e0-96e5-4d67-91d4-ba8f605fa18d service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:48:58.263261 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-4192a35c-d0a3-434f-ae26-714544d16575 req-835635e0-96e5-4d67-91d4-ba8f605fa18d service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:48:58.275952 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-4192a35c-d0a3-434f-ae26-714544d16575 req-835635e0-96e5-4d67-91d4-ba8f605fa18d service nova] Creating event network-changed:4fcf64c3-d3bc-4f93-99c2-d0fab64676c7 for instance 63289da2-fe8a-4a50-af8c-6b48d23b8c94 on nch1-master-1 Oct 22 21:48:58.282116 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-4192a35c-d0a3-434f-ae26-714544d16575 req-835635e0-96e5-4d67-91d4-ba8f605fa18d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034930 Oct 22 21:48:58.283803 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3111/6193] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:48:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:48:58.288288 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-f7fe28be-a334-4413-8e3f-aead06d40c81 tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] [instance: 63289da2-fe8a-4a50-af8c-6b48d23b8c94] Going to try to terminate instance {{(pid=138744) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 21:48:58.386745 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-f7fe28be-a334-4413-8e3f-aead06d40c81 tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] 10.222.0.18 "DELETE /compute/v2.1/servers/63289da2-fe8a-4a50-af8c-6b48d23b8c94" status: 204 len: 0 microversion: 2.1 time: 0.142051 Oct 22 21:48:58.391390 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3083/6194] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 21:48:58 2022] DELETE /compute/v2.1/servers/63289da2-fe8a-4a50-af8c-6b48d23b8c94 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 21:48:58.398174 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-6173d42b-9147-4b1b-9952-2e3f99c8bb69 tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:48:58.402368 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-6173d42b-9147-4b1b-9952-2e3f99c8bb69 tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] [instance: 63289da2-fe8a-4a50-af8c-6b48d23b8c94] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:48:58.410203 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6173d42b-9147-4b1b-9952-2e3f99c8bb69 tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:48:58.411028 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6173d42b-9147-4b1b-9952-2e3f99c8bb69 tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:48:58.411519 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6173d42b-9147-4b1b-9952-2e3f99c8bb69 tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:48:58.412543 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6173d42b-9147-4b1b-9952-2e3f99c8bb69 tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:48:58.413023 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6173d42b-9147-4b1b-9952-2e3f99c8bb69 tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:48:58.413498 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6173d42b-9147-4b1b-9952-2e3f99c8bb69 tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:48:58.812851 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-6173d42b-9147-4b1b-9952-2e3f99c8bb69 tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81c625b34f1a41739399ed62cf9a9412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d8b2319f2f43a7aef198279bd348fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:48:58.821283 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-6173d42b-9147-4b1b-9952-2e3f99c8bb69 tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] 10.222.0.18 "GET /compute/v2.1/servers/63289da2-fe8a-4a50-af8c-6b48d23b8c94" status: 200 len: 1767 microversion: 2.1 time: 0.428171 Oct 22 21:48:58.821875 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3112/6195] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:48:58 2022] GET /compute/v2.1/servers/63289da2-fe8a-4a50-af8c-6b48d23b8c94 => generated 1767 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:48:59.848884 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-23f0679e-0a17-45d0-896a-3a0b438c9cf7 tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:48:59.849786 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-23f0679e-0a17-45d0-896a-3a0b438c9cf7 tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] [instance: 63289da2-fe8a-4a50-af8c-6b48d23b8c94] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:48:59.857385 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-23f0679e-0a17-45d0-896a-3a0b438c9cf7 tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:48:59.857870 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-23f0679e-0a17-45d0-896a-3a0b438c9cf7 tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:48:59.858312 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-23f0679e-0a17-45d0-896a-3a0b438c9cf7 tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:48:59.859040 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-23f0679e-0a17-45d0-896a-3a0b438c9cf7 tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:48:59.859545 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-23f0679e-0a17-45d0-896a-3a0b438c9cf7 tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:48:59.859977 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-23f0679e-0a17-45d0-896a-3a0b438c9cf7 tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:49:00.070465 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-23f0679e-0a17-45d0-896a-3a0b438c9cf7 tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81c625b34f1a41739399ed62cf9a9412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d8b2319f2f43a7aef198279bd348fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:49:00.078856 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-23f0679e-0a17-45d0-896a-3a0b438c9cf7 tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] 10.222.0.18 "GET /compute/v2.1/servers/63289da2-fe8a-4a50-af8c-6b48d23b8c94" status: 200 len: 1767 microversion: 2.1 time: 0.236127 Oct 22 21:49:00.079819 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3084/6196] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:48:59 2022] GET /compute/v2.1/servers/63289da2-fe8a-4a50-af8c-6b48d23b8c94 => generated 1767 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:49:00.396013 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-a4723ce0-f28e-4efe-bca1-9b801ddfc4ca req-e102db97-99ec-48ae-bcc2-65b29c8fe5e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63289da2-fe8a-4a50-af8c-6b48d23b8c94", "name": "network-vif-deleted", "tag": "4fcf64c3-d3bc-4f93-99c2-d0fab64676c7"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:49:00.407086 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-a4723ce0-f28e-4efe-bca1-9b801ddfc4ca req-e102db97-99ec-48ae-bcc2-65b29c8fe5e0 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:49:00.407604 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-a4723ce0-f28e-4efe-bca1-9b801ddfc4ca req-e102db97-99ec-48ae-bcc2-65b29c8fe5e0 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:49:00.408082 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-a4723ce0-f28e-4efe-bca1-9b801ddfc4ca req-e102db97-99ec-48ae-bcc2-65b29c8fe5e0 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:49:00.422613 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-a4723ce0-f28e-4efe-bca1-9b801ddfc4ca req-e102db97-99ec-48ae-bcc2-65b29c8fe5e0 service nova] Creating event network-vif-deleted:4fcf64c3-d3bc-4f93-99c2-d0fab64676c7 for instance 63289da2-fe8a-4a50-af8c-6b48d23b8c94 on nch1-master-1 Oct 22 21:49:00.427582 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-a4723ce0-f28e-4efe-bca1-9b801ddfc4ca req-e102db97-99ec-48ae-bcc2-65b29c8fe5e0 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035323 Oct 22 21:49:00.428195 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3113/6197] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:49:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:49:01.108028 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-3bce00cf-1b12-429f-80c9-1b8858d50e05 tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:49:01.108853 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-3bce00cf-1b12-429f-80c9-1b8858d50e05 tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] [instance: 63289da2-fe8a-4a50-af8c-6b48d23b8c94] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:49:01.119778 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3bce00cf-1b12-429f-80c9-1b8858d50e05 tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:49:01.120526 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3bce00cf-1b12-429f-80c9-1b8858d50e05 tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:49:01.121208 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3bce00cf-1b12-429f-80c9-1b8858d50e05 tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:49:01.122273 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3bce00cf-1b12-429f-80c9-1b8858d50e05 tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:49:01.122989 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3bce00cf-1b12-429f-80c9-1b8858d50e05 tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:49:01.123708 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3bce00cf-1b12-429f-80c9-1b8858d50e05 tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:49:01.141261 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-3bce00cf-1b12-429f-80c9-1b8858d50e05 tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] HTTP exception thrown: Instance 63289da2-fe8a-4a50-af8c-6b48d23b8c94 could not be found. Oct 22 21:49:01.142957 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-3bce00cf-1b12-429f-80c9-1b8858d50e05 tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Request method failure captured: Oct 22 21:49:01.142957 ncdv-master-1 devstack@n-api.service[138744]: request: GET /compute/v2.1/servers/63289da2-fe8a-4a50-af8c-6b48d23b8c94 HTTP/1.1 Oct 22 21:49:01.142957 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 21:49:01.142957 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 21:49:01.142957 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 21:49:01.142957 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 0 Oct 22 21:49:01.142957 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 21:49:01.142957 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 21:49:01.142957 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 21:49:01.142957 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 21:49:01.142957 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVGTZTvSwz5SB9GQigffIWH6TNzIzJ0eUAaYuREhq0odHdz0CHKk43BB6DV9S8Iza0ClkKnQ0lalncV7KGYpFdKvSaphuGTa1KzkC53B8o-JdiKyu5zK9b7shfRfqXZgngZo8oqAfgfy9DCnhKU34Iz2xKZqPQZlvYZoPGNiMvUt6-Ds Oct 22 21:49:01.142957 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 21:49:01.142957 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 21:49:01.142957 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 21:49:01.142957 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 21:49:01.142957 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 21:49:01.142957 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 21:49:01.142957 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: 18d8b2319f2f43a7aef198279bd348fe Oct 22 21:49:01.142957 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-1194797901 Oct 22 21:49:01.142957 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 21:49:01.142957 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 21:49:01.142957 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_18d8b2319f2f43a7aef198279bd348fe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/18d8b2319f2f43a7aef198279bd348fe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/18d8b2319f2f43a7aef198279bd348fe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/18d8b2319f2f43a7aef198279bd348fe"}]}] Oct 22 21:49:01.142957 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-TestSecurityGroupsBasicOps-1194797901 Oct 22 21:49:01.142957 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: 18d8b2319f2f43a7aef198279bd348fe Oct 22 21:49:01.142957 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-1194797901 Oct 22 21:49:01.142957 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-TestSecurityGroupsBasicOps-1194797901-project Oct 22 21:49:01.142957 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 21:49:01.142957 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 21:49:01.142957 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: 81c625b34f1a41739399ed62cf9a9412 Oct 22 21:49:01.142957 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-TestSecurityGroupsBasicOps-1194797901-project Oct 22 21:49:01.142957 ncdv-master-1 devstack@n-api.service[138744]: method: > Oct 22 21:49:01.142957 ncdv-master-1 devstack@n-api.service[138744]: exception: Instance 63289da2-fe8a-4a50-af8c-6b48d23b8c94 could not be found. Oct 22 21:49:01.142957 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': '63289da2-fe8a-4a50-af8c-6b48d23b8c94'} Oct 22 21:49:01.142957 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:49:01.142957 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:49:01.142957 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 21:49:01.142957 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 21:49:01.142957 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 21:49:01.142957 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 21:49:01.142957 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 21:49:01.142957 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 21:49:01.142957 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 21:49:01.142957 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 21:49:01.142957 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 63289da2-fe8a-4a50-af8c-6b48d23b8c94 could not be found. Oct 22 21:49:01.142957 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:49:01.142957 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:49:01.142957 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:49:01.142957 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:49:01.142957 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:49:01.142957 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:49:01.142957 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:49:01.142957 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:49:01.142957 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:49:01.142957 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:49:01.142957 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 21:49:01.142957 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 21:49:01.142957 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 21:49:01.142957 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 21:49:01.142957 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 21:49:01.142957 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:49:01.142957 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 63289da2-fe8a-4a50-af8c-6b48d23b8c94 could not be found. Oct 22 21:49:01.142957 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:49:01.142957 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:49:01.147164 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:49:01.147164 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:49:01.147164 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:49:01.147164 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:49:01.147164 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:49:01.147164 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:49:01.147164 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 63289da2-fe8a-4a50-af8c-6b48d23b8c94 could not be found. Oct 22 21:49:01.147164 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:49:01.147164 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-3bce00cf-1b12-429f-80c9-1b8858d50e05 tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Returning 404 to user: Instance 63289da2-fe8a-4a50-af8c-6b48d23b8c94 could not be found. {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:49:01.147164 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-3bce00cf-1b12-429f-80c9-1b8858d50e05 tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] 10.222.0.18 "GET /compute/v2.1/servers/63289da2-fe8a-4a50-af8c-6b48d23b8c94" status: 404 len: 111 microversion: 2.1 time: 0.043157 Oct 22 21:49:01.147164 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3085/6198] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:49:01 2022] GET /compute/v2.1/servers/63289da2-fe8a-4a50-af8c-6b48d23b8c94 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 21:49:04.380390 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-bf74dff1-1bbf-4af5-bb7b-e5724bb7462b tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] Calling method '.version_select at 0x7fd3a412f310>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:49:04.404742 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-bf74dff1-1bbf-4af5-bb7b-e5724bb7462b tempest-TestSecurityGroupsBasicOps-1194797901 tempest-TestSecurityGroupsBasicOps-1194797901-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-865037689" status: 202 len: 0 microversion: 2.1 time: 0.029476 Oct 22 21:49:04.405347 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3114/6199] 10.222.0.18 () {58 vars in 1275 bytes} [Sat Oct 22 21:49:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-865037689 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 21:49:18.123844 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:49:18.124597 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:49:18.253694 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-0df0ae4b-e0ce-43ea-8a49-0b99dcfe5683 tempest-ServersAdminNegativeTestJSON-1402685182 tempest-ServersAdminNegativeTestJSON-1402685182-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1025749548", "imageRef": "085e4478-6edc-4a69-8e08-f9831713eb65", "flavorRef": "452"}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:49:18.311989 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.network.neutron [None req-0df0ae4b-e0ce-43ea-8a49-0b99dcfe5683 tempest-ServersAdminNegativeTestJSON-1402685182 tempest-ServersAdminNegativeTestJSON-1402685182-project] validate_networks() for None {{(pid=138744) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 21:49:18.587367 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-0df0ae4b-e0ce-43ea-8a49-0b99dcfe5683 tempest-ServersAdminNegativeTestJSON-1402685182 tempest-ServersAdminNegativeTestJSON-1402685182-project] Flavor limits 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 21:49:18.587826 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-0df0ae4b-e0ce-43ea-8a49-0b99dcfe5683 tempest-ServersAdminNegativeTestJSON-1402685182 tempest-ServersAdminNegativeTestJSON-1402685182-project] Image limits 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 21:49:18.588306 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-0df0ae4b-e0ce-43ea-8a49-0b99dcfe5683 tempest-ServersAdminNegativeTestJSON-1402685182 tempest-ServersAdminNegativeTestJSON-1402685182-project] Flavor pref 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 21:49:18.588732 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-0df0ae4b-e0ce-43ea-8a49-0b99dcfe5683 tempest-ServersAdminNegativeTestJSON-1402685182 tempest-ServersAdminNegativeTestJSON-1402685182-project] Image pref 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 21:49:18.589146 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-0df0ae4b-e0ce-43ea-8a49-0b99dcfe5683 tempest-ServersAdminNegativeTestJSON-1402685182 tempest-ServersAdminNegativeTestJSON-1402685182-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 21:49:18.599213 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0df0ae4b-e0ce-43ea-8a49-0b99dcfe5683 tempest-ServersAdminNegativeTestJSON-1402685182 tempest-ServersAdminNegativeTestJSON-1402685182-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:49:18.599855 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0df0ae4b-e0ce-43ea-8a49-0b99dcfe5683 tempest-ServersAdminNegativeTestJSON-1402685182 tempest-ServersAdminNegativeTestJSON-1402685182-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:49:18.600302 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0df0ae4b-e0ce-43ea-8a49-0b99dcfe5683 tempest-ServersAdminNegativeTestJSON-1402685182 tempest-ServersAdminNegativeTestJSON-1402685182-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:49:18.601034 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0df0ae4b-e0ce-43ea-8a49-0b99dcfe5683 tempest-ServersAdminNegativeTestJSON-1402685182 tempest-ServersAdminNegativeTestJSON-1402685182-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:49:18.601493 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0df0ae4b-e0ce-43ea-8a49-0b99dcfe5683 tempest-ServersAdminNegativeTestJSON-1402685182 tempest-ServersAdminNegativeTestJSON-1402685182-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:49:18.601922 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0df0ae4b-e0ce-43ea-8a49-0b99dcfe5683 tempest-ServersAdminNegativeTestJSON-1402685182 tempest-ServersAdminNegativeTestJSON-1402685182-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:49:18.619182 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-0df0ae4b-e0ce-43ea-8a49-0b99dcfe5683 tempest-ServersAdminNegativeTestJSON-1402685182 tempest-ServersAdminNegativeTestJSON-1402685182-project] Getting quotas for project 56a206d602a04e9ba0177c29ed5fc5cb. Resources: {'cores', 'instances', 'ram'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 21:49:18.624380 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-0df0ae4b-e0ce-43ea-8a49-0b99dcfe5683 tempest-ServersAdminNegativeTestJSON-1402685182 tempest-ServersAdminNegativeTestJSON-1402685182-project] Getting quotas for user b001f26443084425ac1cc716a8acac55 and project 56a206d602a04e9ba0177c29ed5fc5cb. Resources: {'cores', 'instances', 'ram'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 21:49:18.637225 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-0df0ae4b-e0ce-43ea-8a49-0b99dcfe5683 tempest-ServersAdminNegativeTestJSON-1402685182 tempest-ServersAdminNegativeTestJSON-1402685182-project] Going to run 1 instances... {{(pid=138744) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 21:49:18.639646 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-0df0ae4b-e0ce-43ea-8a49-0b99dcfe5683 tempest-ServersAdminNegativeTestJSON-1402685182 tempest-ServersAdminNegativeTestJSON-1402685182-project] [instance: e30325c5-f0df-4a39-8441-930f2460ccd8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='085e4478-6edc-4a69-8e08-f9831713eb65',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138744) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 21:49:18.706196 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-0df0ae4b-e0ce-43ea-8a49-0b99dcfe5683 tempest-ServersAdminNegativeTestJSON-1402685182 tempest-ServersAdminNegativeTestJSON-1402685182-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.587446 Oct 22 21:49:18.707200 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3086/6200] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Oct 22 21:49:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 589 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 21:49:18.719994 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell1:SELECT=62 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:49:18.721372 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_api:SELECT=33,nova_api:DELETE=1 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:49:18.726222 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-fe2eb273-4f15-4350-be15-ec75981d8b57 tempest-ServersAdminNegativeTestJSON-1402685182 tempest-ServersAdminNegativeTestJSON-1402685182-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:49:18.727186 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-fe2eb273-4f15-4350-be15-ec75981d8b57 tempest-ServersAdminNegativeTestJSON-1402685182 tempest-ServersAdminNegativeTestJSON-1402685182-project] [instance: e30325c5-f0df-4a39-8441-930f2460ccd8] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:49:18.788289 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-fe2eb273-4f15-4350-be15-ec75981d8b57 tempest-ServersAdminNegativeTestJSON-1402685182 tempest-ServersAdminNegativeTestJSON-1402685182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b001f26443084425ac1cc716a8acac55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56a206d602a04e9ba0177c29ed5fc5cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:49:18.795576 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-fe2eb273-4f15-4350-be15-ec75981d8b57 tempest-ServersAdminNegativeTestJSON-1402685182 tempest-ServersAdminNegativeTestJSON-1402685182-project] 10.222.0.18 "GET /compute/v2.1/servers/e30325c5-f0df-4a39-8441-930f2460ccd8" status: 200 len: 1222 microversion: 2.1 time: 0.079232 Oct 22 21:49:18.796139 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3115/6201] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:49:18 2022] GET /compute/v2.1/servers/e30325c5-f0df-4a39-8441-930f2460ccd8 => generated 1222 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:49:19.818703 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-5b14cb44-1e3e-4674-b3f7-46603eafa465 tempest-ServersAdminNegativeTestJSON-1402685182 tempest-ServersAdminNegativeTestJSON-1402685182-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:49:19.819414 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-5b14cb44-1e3e-4674-b3f7-46603eafa465 tempest-ServersAdminNegativeTestJSON-1402685182 tempest-ServersAdminNegativeTestJSON-1402685182-project] [instance: e30325c5-f0df-4a39-8441-930f2460ccd8] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:49:19.828220 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5b14cb44-1e3e-4674-b3f7-46603eafa465 tempest-ServersAdminNegativeTestJSON-1402685182 tempest-ServersAdminNegativeTestJSON-1402685182-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:49:19.828865 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5b14cb44-1e3e-4674-b3f7-46603eafa465 tempest-ServersAdminNegativeTestJSON-1402685182 tempest-ServersAdminNegativeTestJSON-1402685182-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:49:19.829552 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5b14cb44-1e3e-4674-b3f7-46603eafa465 tempest-ServersAdminNegativeTestJSON-1402685182 tempest-ServersAdminNegativeTestJSON-1402685182-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:49:19.830367 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5b14cb44-1e3e-4674-b3f7-46603eafa465 tempest-ServersAdminNegativeTestJSON-1402685182 tempest-ServersAdminNegativeTestJSON-1402685182-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:49:19.830901 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5b14cb44-1e3e-4674-b3f7-46603eafa465 tempest-ServersAdminNegativeTestJSON-1402685182 tempest-ServersAdminNegativeTestJSON-1402685182-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:49:19.831440 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5b14cb44-1e3e-4674-b3f7-46603eafa465 tempest-ServersAdminNegativeTestJSON-1402685182 tempest-ServersAdminNegativeTestJSON-1402685182-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:49:19.897457 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-5b14cb44-1e3e-4674-b3f7-46603eafa465 tempest-ServersAdminNegativeTestJSON-1402685182 tempest-ServersAdminNegativeTestJSON-1402685182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b001f26443084425ac1cc716a8acac55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56a206d602a04e9ba0177c29ed5fc5cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:49:19.905357 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-5b14cb44-1e3e-4674-b3f7-46603eafa465 tempest-ServersAdminNegativeTestJSON-1402685182 tempest-ServersAdminNegativeTestJSON-1402685182-project] 10.222.0.18 "GET /compute/v2.1/servers/e30325c5-f0df-4a39-8441-930f2460ccd8" status: 200 len: 1292 microversion: 2.1 time: 0.090873 Oct 22 21:49:19.905933 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3087/6202] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:49:19 2022] GET /compute/v2.1/servers/e30325c5-f0df-4a39-8441-930f2460ccd8 => generated 1292 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:49:20.929694 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-e9f69cf2-452e-48b0-83e2-573077633535 tempest-ServersAdminNegativeTestJSON-1402685182 tempest-ServersAdminNegativeTestJSON-1402685182-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:49:20.930468 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-e9f69cf2-452e-48b0-83e2-573077633535 tempest-ServersAdminNegativeTestJSON-1402685182 tempest-ServersAdminNegativeTestJSON-1402685182-project] [instance: e30325c5-f0df-4a39-8441-930f2460ccd8] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:49:20.939308 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e9f69cf2-452e-48b0-83e2-573077633535 tempest-ServersAdminNegativeTestJSON-1402685182 tempest-ServersAdminNegativeTestJSON-1402685182-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:49:20.940090 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e9f69cf2-452e-48b0-83e2-573077633535 tempest-ServersAdminNegativeTestJSON-1402685182 tempest-ServersAdminNegativeTestJSON-1402685182-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:49:20.940552 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e9f69cf2-452e-48b0-83e2-573077633535 tempest-ServersAdminNegativeTestJSON-1402685182 tempest-ServersAdminNegativeTestJSON-1402685182-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:49:20.941289 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e9f69cf2-452e-48b0-83e2-573077633535 tempest-ServersAdminNegativeTestJSON-1402685182 tempest-ServersAdminNegativeTestJSON-1402685182-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:49:20.941763 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e9f69cf2-452e-48b0-83e2-573077633535 tempest-ServersAdminNegativeTestJSON-1402685182 tempest-ServersAdminNegativeTestJSON-1402685182-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:49:20.942207 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e9f69cf2-452e-48b0-83e2-573077633535 tempest-ServersAdminNegativeTestJSON-1402685182 tempest-ServersAdminNegativeTestJSON-1402685182-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:49:21.074176 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-e9f69cf2-452e-48b0-83e2-573077633535 tempest-ServersAdminNegativeTestJSON-1402685182 tempest-ServersAdminNegativeTestJSON-1402685182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b001f26443084425ac1cc716a8acac55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56a206d602a04e9ba0177c29ed5fc5cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:49:21.082505 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-e9f69cf2-452e-48b0-83e2-573077633535 tempest-ServersAdminNegativeTestJSON-1402685182 tempest-ServersAdminNegativeTestJSON-1402685182-project] 10.222.0.18 "GET /compute/v2.1/servers/e30325c5-f0df-4a39-8441-930f2460ccd8" status: 200 len: 1322 microversion: 2.1 time: 0.157019 Oct 22 21:49:21.083093 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3116/6203] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:49:20 2022] GET /compute/v2.1/servers/e30325c5-f0df-4a39-8441-930f2460ccd8 => generated 1322 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:49:21.336148 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-28cd45f3-1a02-4df0-add8-2ee56f288f80 req-2e23dd44-15ea-4bf7-8079-45b4cf2bc9fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e30325c5-f0df-4a39-8441-930f2460ccd8", "tag": "9bf16fac-f1d8-4d6d-965a-cf21999c4333"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:49:21.348532 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-28cd45f3-1a02-4df0-add8-2ee56f288f80 req-2e23dd44-15ea-4bf7-8079-45b4cf2bc9fe service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:49:21.349027 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-28cd45f3-1a02-4df0-add8-2ee56f288f80 req-2e23dd44-15ea-4bf7-8079-45b4cf2bc9fe service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:49:21.349471 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-28cd45f3-1a02-4df0-add8-2ee56f288f80 req-2e23dd44-15ea-4bf7-8079-45b4cf2bc9fe service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:49:21.365237 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-28cd45f3-1a02-4df0-add8-2ee56f288f80 req-2e23dd44-15ea-4bf7-8079-45b4cf2bc9fe service nova] Creating event network-changed:9bf16fac-f1d8-4d6d-965a-cf21999c4333 for instance e30325c5-f0df-4a39-8441-930f2460ccd8 on nch1-master-1 Oct 22 21:49:21.371209 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-28cd45f3-1a02-4df0-add8-2ee56f288f80 req-2e23dd44-15ea-4bf7-8079-45b4cf2bc9fe service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038855 Oct 22 21:49:21.371868 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3088/6204] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:49:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:49:22.110787 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-bcf2bc7c-b63e-44aa-9e03-e22668155e4f tempest-ServersAdminNegativeTestJSON-1402685182 tempest-ServersAdminNegativeTestJSON-1402685182-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:49:22.111899 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-bcf2bc7c-b63e-44aa-9e03-e22668155e4f tempest-ServersAdminNegativeTestJSON-1402685182 tempest-ServersAdminNegativeTestJSON-1402685182-project] [instance: e30325c5-f0df-4a39-8441-930f2460ccd8] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:49:22.120080 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bcf2bc7c-b63e-44aa-9e03-e22668155e4f tempest-ServersAdminNegativeTestJSON-1402685182 tempest-ServersAdminNegativeTestJSON-1402685182-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:49:22.120641 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bcf2bc7c-b63e-44aa-9e03-e22668155e4f tempest-ServersAdminNegativeTestJSON-1402685182 tempest-ServersAdminNegativeTestJSON-1402685182-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:49:22.121152 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bcf2bc7c-b63e-44aa-9e03-e22668155e4f tempest-ServersAdminNegativeTestJSON-1402685182 tempest-ServersAdminNegativeTestJSON-1402685182-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:49:22.121950 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bcf2bc7c-b63e-44aa-9e03-e22668155e4f tempest-ServersAdminNegativeTestJSON-1402685182 tempest-ServersAdminNegativeTestJSON-1402685182-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:49:22.122479 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bcf2bc7c-b63e-44aa-9e03-e22668155e4f tempest-ServersAdminNegativeTestJSON-1402685182 tempest-ServersAdminNegativeTestJSON-1402685182-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:49:22.122976 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bcf2bc7c-b63e-44aa-9e03-e22668155e4f tempest-ServersAdminNegativeTestJSON-1402685182 tempest-ServersAdminNegativeTestJSON-1402685182-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:49:22.260472 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-bcf2bc7c-b63e-44aa-9e03-e22668155e4f tempest-ServersAdminNegativeTestJSON-1402685182 tempest-ServersAdminNegativeTestJSON-1402685182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b001f26443084425ac1cc716a8acac55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56a206d602a04e9ba0177c29ed5fc5cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:49:22.272329 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-bcf2bc7c-b63e-44aa-9e03-e22668155e4f tempest-ServersAdminNegativeTestJSON-1402685182 tempest-ServersAdminNegativeTestJSON-1402685182-project] 10.222.0.18 "GET /compute/v2.1/servers/e30325c5-f0df-4a39-8441-930f2460ccd8" status: 200 len: 1322 microversion: 2.1 time: 0.168118 Oct 22 21:49:22.273007 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3117/6205] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:49:22 2022] GET /compute/v2.1/servers/e30325c5-f0df-4a39-8441-930f2460ccd8 => generated 1322 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:49:23.297630 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-1e014a69-4207-4c49-a9b2-266b675679c6 tempest-ServersAdminNegativeTestJSON-1402685182 tempest-ServersAdminNegativeTestJSON-1402685182-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:49:23.298303 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-1e014a69-4207-4c49-a9b2-266b675679c6 tempest-ServersAdminNegativeTestJSON-1402685182 tempest-ServersAdminNegativeTestJSON-1402685182-project] [instance: e30325c5-f0df-4a39-8441-930f2460ccd8] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:49:23.307695 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1e014a69-4207-4c49-a9b2-266b675679c6 tempest-ServersAdminNegativeTestJSON-1402685182 tempest-ServersAdminNegativeTestJSON-1402685182-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:49:23.308185 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1e014a69-4207-4c49-a9b2-266b675679c6 tempest-ServersAdminNegativeTestJSON-1402685182 tempest-ServersAdminNegativeTestJSON-1402685182-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:49:23.308631 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1e014a69-4207-4c49-a9b2-266b675679c6 tempest-ServersAdminNegativeTestJSON-1402685182 tempest-ServersAdminNegativeTestJSON-1402685182-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:49:23.309327 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1e014a69-4207-4c49-a9b2-266b675679c6 tempest-ServersAdminNegativeTestJSON-1402685182 tempest-ServersAdminNegativeTestJSON-1402685182-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:49:23.309792 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1e014a69-4207-4c49-a9b2-266b675679c6 tempest-ServersAdminNegativeTestJSON-1402685182 tempest-ServersAdminNegativeTestJSON-1402685182-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:49:23.310224 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1e014a69-4207-4c49-a9b2-266b675679c6 tempest-ServersAdminNegativeTestJSON-1402685182 tempest-ServersAdminNegativeTestJSON-1402685182-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:49:23.449347 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-1e014a69-4207-4c49-a9b2-266b675679c6 tempest-ServersAdminNegativeTestJSON-1402685182 tempest-ServersAdminNegativeTestJSON-1402685182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b001f26443084425ac1cc716a8acac55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56a206d602a04e9ba0177c29ed5fc5cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:49:23.457739 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-1e014a69-4207-4c49-a9b2-266b675679c6 tempest-ServersAdminNegativeTestJSON-1402685182 tempest-ServersAdminNegativeTestJSON-1402685182-project] 10.222.0.18 "GET /compute/v2.1/servers/e30325c5-f0df-4a39-8441-930f2460ccd8" status: 200 len: 1322 microversion: 2.1 time: 0.165298 Oct 22 21:49:23.458322 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3089/6206] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:49:23 2022] GET /compute/v2.1/servers/e30325c5-f0df-4a39-8441-930f2460ccd8 => generated 1322 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:49:24.492534 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-546e18ea-2642-47ee-8db1-1239c3db907d tempest-ServersAdminNegativeTestJSON-1402685182 tempest-ServersAdminNegativeTestJSON-1402685182-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:49:24.493444 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-546e18ea-2642-47ee-8db1-1239c3db907d tempest-ServersAdminNegativeTestJSON-1402685182 tempest-ServersAdminNegativeTestJSON-1402685182-project] [instance: e30325c5-f0df-4a39-8441-930f2460ccd8] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:49:24.504049 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-546e18ea-2642-47ee-8db1-1239c3db907d tempest-ServersAdminNegativeTestJSON-1402685182 tempest-ServersAdminNegativeTestJSON-1402685182-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:49:24.504546 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-546e18ea-2642-47ee-8db1-1239c3db907d tempest-ServersAdminNegativeTestJSON-1402685182 tempest-ServersAdminNegativeTestJSON-1402685182-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:49:24.504993 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-546e18ea-2642-47ee-8db1-1239c3db907d tempest-ServersAdminNegativeTestJSON-1402685182 tempest-ServersAdminNegativeTestJSON-1402685182-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:49:24.505710 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-546e18ea-2642-47ee-8db1-1239c3db907d tempest-ServersAdminNegativeTestJSON-1402685182 tempest-ServersAdminNegativeTestJSON-1402685182-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:49:24.506211 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-546e18ea-2642-47ee-8db1-1239c3db907d tempest-ServersAdminNegativeTestJSON-1402685182 tempest-ServersAdminNegativeTestJSON-1402685182-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:49:24.506646 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-546e18ea-2642-47ee-8db1-1239c3db907d tempest-ServersAdminNegativeTestJSON-1402685182 tempest-ServersAdminNegativeTestJSON-1402685182-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:49:24.639115 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-546e18ea-2642-47ee-8db1-1239c3db907d tempest-ServersAdminNegativeTestJSON-1402685182 tempest-ServersAdminNegativeTestJSON-1402685182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b001f26443084425ac1cc716a8acac55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56a206d602a04e9ba0177c29ed5fc5cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:49:24.647248 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-546e18ea-2642-47ee-8db1-1239c3db907d tempest-ServersAdminNegativeTestJSON-1402685182 tempest-ServersAdminNegativeTestJSON-1402685182-project] 10.222.0.18 "GET /compute/v2.1/servers/e30325c5-f0df-4a39-8441-930f2460ccd8" status: 200 len: 1322 microversion: 2.1 time: 0.161655 Oct 22 21:49:24.647928 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3118/6207] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:49:24 2022] GET /compute/v2.1/servers/e30325c5-f0df-4a39-8441-930f2460ccd8 => generated 1322 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:49:25.674151 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-72cdd45c-a910-48e9-87ff-0ba16a1876b6 tempest-ServersAdminNegativeTestJSON-1402685182 tempest-ServersAdminNegativeTestJSON-1402685182-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:49:25.675172 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-72cdd45c-a910-48e9-87ff-0ba16a1876b6 tempest-ServersAdminNegativeTestJSON-1402685182 tempest-ServersAdminNegativeTestJSON-1402685182-project] [instance: e30325c5-f0df-4a39-8441-930f2460ccd8] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:49:25.682564 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-72cdd45c-a910-48e9-87ff-0ba16a1876b6 tempest-ServersAdminNegativeTestJSON-1402685182 tempest-ServersAdminNegativeTestJSON-1402685182-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:49:25.683050 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-72cdd45c-a910-48e9-87ff-0ba16a1876b6 tempest-ServersAdminNegativeTestJSON-1402685182 tempest-ServersAdminNegativeTestJSON-1402685182-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:49:25.683532 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-72cdd45c-a910-48e9-87ff-0ba16a1876b6 tempest-ServersAdminNegativeTestJSON-1402685182 tempest-ServersAdminNegativeTestJSON-1402685182-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:49:25.684240 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-72cdd45c-a910-48e9-87ff-0ba16a1876b6 tempest-ServersAdminNegativeTestJSON-1402685182 tempest-ServersAdminNegativeTestJSON-1402685182-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:49:25.684697 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-72cdd45c-a910-48e9-87ff-0ba16a1876b6 tempest-ServersAdminNegativeTestJSON-1402685182 tempest-ServersAdminNegativeTestJSON-1402685182-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:49:25.685125 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-72cdd45c-a910-48e9-87ff-0ba16a1876b6 tempest-ServersAdminNegativeTestJSON-1402685182 tempest-ServersAdminNegativeTestJSON-1402685182-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:49:25.823206 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-72cdd45c-a910-48e9-87ff-0ba16a1876b6 tempest-ServersAdminNegativeTestJSON-1402685182 tempest-ServersAdminNegativeTestJSON-1402685182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b001f26443084425ac1cc716a8acac55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56a206d602a04e9ba0177c29ed5fc5cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:49:25.831377 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-72cdd45c-a910-48e9-87ff-0ba16a1876b6 tempest-ServersAdminNegativeTestJSON-1402685182 tempest-ServersAdminNegativeTestJSON-1402685182-project] 10.222.0.18 "GET /compute/v2.1/servers/e30325c5-f0df-4a39-8441-930f2460ccd8" status: 200 len: 1322 microversion: 2.1 time: 0.163616 Oct 22 21:49:25.831974 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3090/6208] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:49:25 2022] GET /compute/v2.1/servers/e30325c5-f0df-4a39-8441-930f2460ccd8 => generated 1322 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:49:26.859206 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-6bde7f9f-7aee-420e-8571-091dc477f88d tempest-ServersAdminNegativeTestJSON-1402685182 tempest-ServersAdminNegativeTestJSON-1402685182-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:49:26.860118 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-6bde7f9f-7aee-420e-8571-091dc477f88d tempest-ServersAdminNegativeTestJSON-1402685182 tempest-ServersAdminNegativeTestJSON-1402685182-project] [instance: e30325c5-f0df-4a39-8441-930f2460ccd8] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:49:26.871789 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6bde7f9f-7aee-420e-8571-091dc477f88d tempest-ServersAdminNegativeTestJSON-1402685182 tempest-ServersAdminNegativeTestJSON-1402685182-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:49:26.872628 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6bde7f9f-7aee-420e-8571-091dc477f88d tempest-ServersAdminNegativeTestJSON-1402685182 tempest-ServersAdminNegativeTestJSON-1402685182-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:49:26.873382 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6bde7f9f-7aee-420e-8571-091dc477f88d tempest-ServersAdminNegativeTestJSON-1402685182 tempest-ServersAdminNegativeTestJSON-1402685182-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:49:26.874559 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6bde7f9f-7aee-420e-8571-091dc477f88d tempest-ServersAdminNegativeTestJSON-1402685182 tempest-ServersAdminNegativeTestJSON-1402685182-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:49:26.875374 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6bde7f9f-7aee-420e-8571-091dc477f88d tempest-ServersAdminNegativeTestJSON-1402685182 tempest-ServersAdminNegativeTestJSON-1402685182-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:49:26.876129 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6bde7f9f-7aee-420e-8571-091dc477f88d tempest-ServersAdminNegativeTestJSON-1402685182 tempest-ServersAdminNegativeTestJSON-1402685182-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:49:27.024708 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-6bde7f9f-7aee-420e-8571-091dc477f88d tempest-ServersAdminNegativeTestJSON-1402685182 tempest-ServersAdminNegativeTestJSON-1402685182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b001f26443084425ac1cc716a8acac55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56a206d602a04e9ba0177c29ed5fc5cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:49:27.032946 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-6bde7f9f-7aee-420e-8571-091dc477f88d tempest-ServersAdminNegativeTestJSON-1402685182 tempest-ServersAdminNegativeTestJSON-1402685182-project] 10.222.0.18 "GET /compute/v2.1/servers/e30325c5-f0df-4a39-8441-930f2460ccd8" status: 200 len: 1322 microversion: 2.1 time: 0.180551 Oct 22 21:49:27.033495 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3119/6209] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:49:26 2022] GET /compute/v2.1/servers/e30325c5-f0df-4a39-8441-930f2460ccd8 => generated 1322 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:49:28.056437 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-b1661260-43f2-4370-9e99-541991a71de4 tempest-ServersAdminNegativeTestJSON-1402685182 tempest-ServersAdminNegativeTestJSON-1402685182-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:49:28.057407 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-b1661260-43f2-4370-9e99-541991a71de4 tempest-ServersAdminNegativeTestJSON-1402685182 tempest-ServersAdminNegativeTestJSON-1402685182-project] [instance: e30325c5-f0df-4a39-8441-930f2460ccd8] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:49:28.064968 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b1661260-43f2-4370-9e99-541991a71de4 tempest-ServersAdminNegativeTestJSON-1402685182 tempest-ServersAdminNegativeTestJSON-1402685182-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:49:28.065637 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b1661260-43f2-4370-9e99-541991a71de4 tempest-ServersAdminNegativeTestJSON-1402685182 tempest-ServersAdminNegativeTestJSON-1402685182-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:49:28.066171 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b1661260-43f2-4370-9e99-541991a71de4 tempest-ServersAdminNegativeTestJSON-1402685182 tempest-ServersAdminNegativeTestJSON-1402685182-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:49:28.066993 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b1661260-43f2-4370-9e99-541991a71de4 tempest-ServersAdminNegativeTestJSON-1402685182 tempest-ServersAdminNegativeTestJSON-1402685182-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:49:28.067757 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b1661260-43f2-4370-9e99-541991a71de4 tempest-ServersAdminNegativeTestJSON-1402685182 tempest-ServersAdminNegativeTestJSON-1402685182-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:49:28.068405 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b1661260-43f2-4370-9e99-541991a71de4 tempest-ServersAdminNegativeTestJSON-1402685182 tempest-ServersAdminNegativeTestJSON-1402685182-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:49:28.167762 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-db7aff67-820f-4d20-bf90-6c39b0ec43c5 req-b789b17c-348a-494c-bb72-e2ffc20b44f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e30325c5-f0df-4a39-8441-930f2460ccd8", "name": "network-vif-plugged", "status": "completed", "tag": "9bf16fac-f1d8-4d6d-965a-cf21999c4333"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:49:28.185717 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-db7aff67-820f-4d20-bf90-6c39b0ec43c5 req-b789b17c-348a-494c-bb72-e2ffc20b44f0 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:49:28.186444 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-db7aff67-820f-4d20-bf90-6c39b0ec43c5 req-b789b17c-348a-494c-bb72-e2ffc20b44f0 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:49:28.186896 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-db7aff67-820f-4d20-bf90-6c39b0ec43c5 req-b789b17c-348a-494c-bb72-e2ffc20b44f0 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:49:28.200050 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-db7aff67-820f-4d20-bf90-6c39b0ec43c5 req-b789b17c-348a-494c-bb72-e2ffc20b44f0 service nova] Creating event network-vif-plugged:9bf16fac-f1d8-4d6d-965a-cf21999c4333 for instance e30325c5-f0df-4a39-8441-930f2460ccd8 on nch1-master-1 Oct 22 21:49:28.205639 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-db7aff67-820f-4d20-bf90-6c39b0ec43c5 req-b789b17c-348a-494c-bb72-e2ffc20b44f0 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042789 Oct 22 21:49:28.206501 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3120/6210] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:49:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:49:28.232093 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-b1661260-43f2-4370-9e99-541991a71de4 tempest-ServersAdminNegativeTestJSON-1402685182 tempest-ServersAdminNegativeTestJSON-1402685182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b001f26443084425ac1cc716a8acac55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56a206d602a04e9ba0177c29ed5fc5cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:49:28.240662 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-b1661260-43f2-4370-9e99-541991a71de4 tempest-ServersAdminNegativeTestJSON-1402685182 tempest-ServersAdminNegativeTestJSON-1402685182-project] 10.222.0.18 "GET /compute/v2.1/servers/e30325c5-f0df-4a39-8441-930f2460ccd8" status: 200 len: 1322 microversion: 2.1 time: 0.188442 Oct 22 21:49:28.241432 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3091/6211] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:49:28 2022] GET /compute/v2.1/servers/e30325c5-f0df-4a39-8441-930f2460ccd8 => generated 1322 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:49:29.263000 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell0:SELECT=2 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:49:29.270630 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-f1a13cb7-45e2-44f2-a773-db9222ff7ab2 tempest-ServersAdminNegativeTestJSON-1402685182 tempest-ServersAdminNegativeTestJSON-1402685182-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:49:29.271366 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-f1a13cb7-45e2-44f2-a773-db9222ff7ab2 tempest-ServersAdminNegativeTestJSON-1402685182 tempest-ServersAdminNegativeTestJSON-1402685182-project] [instance: e30325c5-f0df-4a39-8441-930f2460ccd8] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:49:29.278313 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f1a13cb7-45e2-44f2-a773-db9222ff7ab2 tempest-ServersAdminNegativeTestJSON-1402685182 tempest-ServersAdminNegativeTestJSON-1402685182-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:49:29.278815 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f1a13cb7-45e2-44f2-a773-db9222ff7ab2 tempest-ServersAdminNegativeTestJSON-1402685182 tempest-ServersAdminNegativeTestJSON-1402685182-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:49:29.279275 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f1a13cb7-45e2-44f2-a773-db9222ff7ab2 tempest-ServersAdminNegativeTestJSON-1402685182 tempest-ServersAdminNegativeTestJSON-1402685182-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:49:29.280037 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f1a13cb7-45e2-44f2-a773-db9222ff7ab2 tempest-ServersAdminNegativeTestJSON-1402685182 tempest-ServersAdminNegativeTestJSON-1402685182-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:49:29.280515 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f1a13cb7-45e2-44f2-a773-db9222ff7ab2 tempest-ServersAdminNegativeTestJSON-1402685182 tempest-ServersAdminNegativeTestJSON-1402685182-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:49:29.280959 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f1a13cb7-45e2-44f2-a773-db9222ff7ab2 tempest-ServersAdminNegativeTestJSON-1402685182 tempest-ServersAdminNegativeTestJSON-1402685182-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:49:29.418084 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-f1a13cb7-45e2-44f2-a773-db9222ff7ab2 tempest-ServersAdminNegativeTestJSON-1402685182 tempest-ServersAdminNegativeTestJSON-1402685182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b001f26443084425ac1cc716a8acac55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56a206d602a04e9ba0177c29ed5fc5cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:49:29.426563 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-f1a13cb7-45e2-44f2-a773-db9222ff7ab2 tempest-ServersAdminNegativeTestJSON-1402685182 tempest-ServersAdminNegativeTestJSON-1402685182-project] 10.222.0.18 "GET /compute/v2.1/servers/e30325c5-f0df-4a39-8441-930f2460ccd8" status: 200 len: 1322 microversion: 2.1 time: 0.165470 Oct 22 21:49:29.427166 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3121/6212] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:49:29 2022] GET /compute/v2.1/servers/e30325c5-f0df-4a39-8441-930f2460ccd8 => generated 1322 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:49:30.454654 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-61aee534-5612-4aa4-b165-f234a49b8d23 tempest-ServersAdminNegativeTestJSON-1402685182 tempest-ServersAdminNegativeTestJSON-1402685182-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:49:30.455780 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-61aee534-5612-4aa4-b165-f234a49b8d23 tempest-ServersAdminNegativeTestJSON-1402685182 tempest-ServersAdminNegativeTestJSON-1402685182-project] [instance: e30325c5-f0df-4a39-8441-930f2460ccd8] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:49:30.459009 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell0:SELECT=2 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:49:30.460118 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell0:SELECT=6 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:49:30.471212 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-61aee534-5612-4aa4-b165-f234a49b8d23 tempest-ServersAdminNegativeTestJSON-1402685182 tempest-ServersAdminNegativeTestJSON-1402685182-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:49:30.472140 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-61aee534-5612-4aa4-b165-f234a49b8d23 tempest-ServersAdminNegativeTestJSON-1402685182 tempest-ServersAdminNegativeTestJSON-1402685182-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:49:30.472773 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-61aee534-5612-4aa4-b165-f234a49b8d23 tempest-ServersAdminNegativeTestJSON-1402685182 tempest-ServersAdminNegativeTestJSON-1402685182-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:49:30.473486 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-61aee534-5612-4aa4-b165-f234a49b8d23 tempest-ServersAdminNegativeTestJSON-1402685182 tempest-ServersAdminNegativeTestJSON-1402685182-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:49:30.473949 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-61aee534-5612-4aa4-b165-f234a49b8d23 tempest-ServersAdminNegativeTestJSON-1402685182 tempest-ServersAdminNegativeTestJSON-1402685182-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:49:30.474384 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-61aee534-5612-4aa4-b165-f234a49b8d23 tempest-ServersAdminNegativeTestJSON-1402685182 tempest-ServersAdminNegativeTestJSON-1402685182-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:49:30.627599 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-61aee534-5612-4aa4-b165-f234a49b8d23 tempest-ServersAdminNegativeTestJSON-1402685182 tempest-ServersAdminNegativeTestJSON-1402685182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b001f26443084425ac1cc716a8acac55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56a206d602a04e9ba0177c29ed5fc5cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:49:30.636268 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-61aee534-5612-4aa4-b165-f234a49b8d23 tempest-ServersAdminNegativeTestJSON-1402685182 tempest-ServersAdminNegativeTestJSON-1402685182-project] 10.222.0.18 "GET /compute/v2.1/servers/e30325c5-f0df-4a39-8441-930f2460ccd8" status: 200 len: 1471 microversion: 2.1 time: 0.188476 Oct 22 21:49:30.636821 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3092/6213] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:49:30 2022] GET /compute/v2.1/servers/e30325c5-f0df-4a39-8441-930f2460ccd8 => generated 1471 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:49:30.717301 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-f16c5884-ac67-403e-b59b-6f3c20f6d871 tempest-ServersAdminNegativeTestJSON-143110569 tempest-ServersAdminNegativeTestJSON-143110569-project-admin] Calling method '.version_select at 0x7fd39ef775e0>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:49:30.788839 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-f16c5884-ac67-403e-b59b-6f3c20f6d871 tempest-ServersAdminNegativeTestJSON-143110569 tempest-ServersAdminNegativeTestJSON-143110569-project-admin] 10.222.0.18 "GET /compute/v2.1/os-quota-sets/c6a41a1389e0435a8e306f3d0e90a65d" status: 200 len: 371 microversion: 2.1 time: 0.130918 Oct 22 21:49:30.789330 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3122/6214] 10.222.0.18 () {58 vars in 1242 bytes} [Sat Oct 22 21:49:30 2022] GET /compute/v2.1/os-quota-sets/c6a41a1389e0435a8e306f3d0e90a65d => generated 371 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:49:30.801671 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-4df1c79f-46af-4ccf-8657-85f3dcf5b112 tempest-ServersAdminNegativeTestJSON-143110569 tempest-ServersAdminNegativeTestJSON-143110569-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 51201, "vcpus": 1, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-1055970423", "id": 1979239188, "os-flavor-access:is_public": "True"}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:49:30.822376 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-4df1c79f-46af-4ccf-8657-85f3dcf5b112 tempest-ServersAdminNegativeTestJSON-143110569 tempest-ServersAdminNegativeTestJSON-143110569-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.024722 Oct 22 21:49:30.822945 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3093/6215] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Oct 22 21:49:30 2022] POST /compute/v2.1/flavors => generated 438 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:49:30.835616 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-7d0d1295-33e0-4b8f-a2ae-7638db4e487c tempest-ServersAdminNegativeTestJSON-143110569 tempest-ServersAdminNegativeTestJSON-143110569-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "1979239188"}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:49:30.837922 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-7d0d1295-33e0-4b8f-a2ae-7638db4e487c tempest-ServersAdminNegativeTestJSON-143110569 tempest-ServersAdminNegativeTestJSON-143110569-project-admin] [instance: e30325c5-f0df-4a39-8441-930f2460ccd8] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:49:30.844673 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7d0d1295-33e0-4b8f-a2ae-7638db4e487c tempest-ServersAdminNegativeTestJSON-143110569 tempest-ServersAdminNegativeTestJSON-143110569-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:49:30.845174 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7d0d1295-33e0-4b8f-a2ae-7638db4e487c tempest-ServersAdminNegativeTestJSON-143110569 tempest-ServersAdminNegativeTestJSON-143110569-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:49:30.845640 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7d0d1295-33e0-4b8f-a2ae-7638db4e487c tempest-ServersAdminNegativeTestJSON-143110569 tempest-ServersAdminNegativeTestJSON-143110569-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:49:30.846342 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7d0d1295-33e0-4b8f-a2ae-7638db4e487c tempest-ServersAdminNegativeTestJSON-143110569 tempest-ServersAdminNegativeTestJSON-143110569-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:49:30.846838 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7d0d1295-33e0-4b8f-a2ae-7638db4e487c tempest-ServersAdminNegativeTestJSON-143110569 tempest-ServersAdminNegativeTestJSON-143110569-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:49:30.847312 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7d0d1295-33e0-4b8f-a2ae-7638db4e487c tempest-ServersAdminNegativeTestJSON-143110569 tempest-ServersAdminNegativeTestJSON-143110569-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:49:31.082739 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-7d0d1295-33e0-4b8f-a2ae-7638db4e487c tempest-ServersAdminNegativeTestJSON-143110569 tempest-ServersAdminNegativeTestJSON-143110569-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '9c88e1f590ab46378ff959fff9c799f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6a41a1389e0435a8e306f3d0e90a65d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:49:31.089477 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-7d0d1295-33e0-4b8f-a2ae-7638db4e487c tempest-ServersAdminNegativeTestJSON-143110569 tempest-ServersAdminNegativeTestJSON-143110569-project-admin] [instance: e30325c5-f0df-4a39-8441-930f2460ccd8] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-1055970423 {{(pid=138745) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 22 21:49:31.097573 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7d0d1295-33e0-4b8f-a2ae-7638db4e487c tempest-ServersAdminNegativeTestJSON-143110569 tempest-ServersAdminNegativeTestJSON-143110569-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:49:31.098077 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7d0d1295-33e0-4b8f-a2ae-7638db4e487c tempest-ServersAdminNegativeTestJSON-143110569 tempest-ServersAdminNegativeTestJSON-143110569-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:49:31.098521 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7d0d1295-33e0-4b8f-a2ae-7638db4e487c tempest-ServersAdminNegativeTestJSON-143110569 tempest-ServersAdminNegativeTestJSON-143110569-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:49:31.099272 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7d0d1295-33e0-4b8f-a2ae-7638db4e487c tempest-ServersAdminNegativeTestJSON-143110569 tempest-ServersAdminNegativeTestJSON-143110569-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:49:31.099781 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7d0d1295-33e0-4b8f-a2ae-7638db4e487c tempest-ServersAdminNegativeTestJSON-143110569 tempest-ServersAdminNegativeTestJSON-143110569-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:49:31.100227 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7d0d1295-33e0-4b8f-a2ae-7638db4e487c tempest-ServersAdminNegativeTestJSON-143110569 tempest-ServersAdminNegativeTestJSON-143110569-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:49:31.123685 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-7d0d1295-33e0-4b8f-a2ae-7638db4e487c tempest-ServersAdminNegativeTestJSON-143110569 tempest-ServersAdminNegativeTestJSON-143110569-project-admin] Getting quotas for project 56a206d602a04e9ba0177c29ed5fc5cb. Resources: {'ram', 'cores'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 21:49:31.128929 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-7d0d1295-33e0-4b8f-a2ae-7638db4e487c tempest-ServersAdminNegativeTestJSON-143110569 tempest-ServersAdminNegativeTestJSON-143110569-project-admin] Getting quotas for user b001f26443084425ac1cc716a8acac55 and project 56a206d602a04e9ba0177c29ed5fc5cb. Resources: {'ram', 'cores'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 21:49:31.141308 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.compute.api [None req-7d0d1295-33e0-4b8f-a2ae-7638db4e487c tempest-ServersAdminNegativeTestJSON-143110569 tempest-ServersAdminNegativeTestJSON-143110569-project-admin] ram quota exceeded for c6a41a1389e0435a8e306f3d0e90a65d, tried to resize instance. Oct 22 21:49:31.141870 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.wsgi [None req-7d0d1295-33e0-4b8f-a2ae-7638db4e487c tempest-ServersAdminNegativeTestJSON-143110569 tempest-ServersAdminNegativeTestJSON-143110569-project-admin] HTTP exception thrown: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 22 21:49:31.146885 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-7d0d1295-33e0-4b8f-a2ae-7638db4e487c tempest-ServersAdminNegativeTestJSON-143110569 tempest-ServersAdminNegativeTestJSON-143110569-project-admin] Request method failure captured: Oct 22 21:49:31.146885 ncdv-master-1 devstack@n-api.service[138745]: request: POST /compute/v2.1/servers/e30325c5-f0df-4a39-8441-930f2460ccd8/action HTTP/1.1 Oct 22 21:49:31.146885 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 21:49:31.146885 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 21:49:31.146885 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 21:49:31.146885 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 39 Oct 22 21:49:31.146885 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 21:49:31.146885 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 21:49:31.146885 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 21:49:31.146885 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 21:49:31.146885 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVGVdJP92eGBY7PicyHj8NIykEEaGvxM5AoQ90mTfHrg5gsY7RPIgYbxPeR_HybuMxK48BGVymQHa_J62RLZcpvU-TJ_7xw0vh9BYvgZ8j1Rtjd4tyW6v_dHaN2WfoywSXcBeF5WIEy-4FZ3op9Cy8xqAYj6si5kSLbdi1f4R_p6dZRI Oct 22 21:49:31.146885 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 21:49:31.146885 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 21:49:31.146885 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 21:49:31.146885 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 21:49:31.146885 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 21:49:31.146885 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 21:49:31.146885 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: c6a41a1389e0435a8e306f3d0e90a65d Oct 22 21:49:31.146885 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-143110569 Oct 22 21:49:31.146885 ncdv-master-1 devstack@n-api.service[138745]: X-Role: admin,member,reader Oct 22 21:49:31.146885 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: admin,member,reader Oct 22 21:49:31.146885 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_c6a41a1389e0435a8e306f3d0e90a65d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c6a41a1389e0435a8e306f3d0e90a65d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/c6a41a1389e0435a8e306f3d0e90a65d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c6a41a1389e0435a8e306f3d0e90a65d"}]}] Oct 22 21:49:31.146885 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-ServersAdminNegativeTestJSON-143110569 Oct 22 21:49:31.146885 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: c6a41a1389e0435a8e306f3d0e90a65d Oct 22 21:49:31.146885 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-143110569 Oct 22 21:49:31.146885 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-ServersAdminNegativeTestJSON-143110569-project-admin Oct 22 21:49:31.146885 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 21:49:31.146885 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 21:49:31.146885 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: 9c88e1f590ab46378ff959fff9c799f5 Oct 22 21:49:31.146885 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-ServersAdminNegativeTestJSON-143110569-project-admin Oct 22 21:49:31.146885 ncdv-master-1 devstack@n-api.service[138745]: Oct 22 21:49:31.146885 ncdv-master-1 devstack@n-api.service[138745]: {"resize": {"flavorRef": "1979239188"}} Oct 22 21:49:31.146885 ncdv-master-1 devstack@n-api.service[138745]: method: > Oct 22 21:49:31.146885 ncdv-master-1 devstack@n-api.service[138745]: exception: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 22 21:49:31.146885 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'id': 'e30325c5-f0df-4a39-8441-930f2460ccd8', 'body': {'resize': {'flavorRef': '1979239188'}}} Oct 22 21:49:31.146885 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:49:31.146885 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:49:31.146885 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3878, in _check_quota_for_upsize Oct 22 21:49:31.146885 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Oct 22 21:49:31.146885 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 22 21:49:31.146885 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 22 21:49:31.146885 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 22 21:49:31.146885 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exc Oct 22 21:49:31.146885 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 22 21:49:31.146885 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 22 21:49:31.146885 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 22 21:49:31.146885 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 22 21:49:31.146885 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 22 21:49:31.146885 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 22 21:49:31.146885 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 22 21:49:31.146885 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 22 21:49:31.146885 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Oct 22 21:49:31.146885 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 22 21:49:31.146885 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Oct 22 21:49:31.146885 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:49:31.146885 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:49:31.146885 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:49:31.146885 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:49:31.146885 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Oct 22 21:49:31.146885 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Oct 22 21:49:31.146885 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 22 21:49:31.146885 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 22 21:49:31.146885 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 22 21:49:31.151019 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 22 21:49:31.151019 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 22 21:49:31.151019 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 22 21:49:31.151019 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 22 21:49:31.151019 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 22 21:49:31.151019 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 22 21:49:31.151019 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 22 21:49:31.151019 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Oct 22 21:49:31.151019 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 22 21:49:31.151019 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4244, in resize Oct 22 21:49:31.151019 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Oct 22 21:49:31.151019 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3896, in _check_quota_for_upsize Oct 22 21:49:31.151019 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 22 21:49:31.151019 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 22 21:49:31.151019 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:49:31.151019 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:49:31.151019 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:49:31.151019 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:49:31.151019 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:49:31.151019 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:49:31.151019 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:49:31.151019 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:49:31.151019 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:49:31.151019 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:49:31.151019 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 21:49:31.151019 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 21:49:31.151019 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 22 21:49:31.151019 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 22 21:49:31.151019 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Oct 22 21:49:31.151019 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 22 21:49:31.151019 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 22 21:49:31.151019 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:49:31.151019 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:49:31.151019 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:49:31.151019 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:49:31.151019 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:49:31.151019 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:49:31.151019 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:49:31.151019 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:49:31.151019 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 22 21:49:31.151019 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:49:31.151019 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-7d0d1295-33e0-4b8f-a2ae-7638db4e487c tempest-ServersAdminNegativeTestJSON-143110569 tempest-ServersAdminNegativeTestJSON-143110569-project-admin] Returning 403 to user: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:49:31.151019 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-7d0d1295-33e0-4b8f-a2ae-7638db4e487c tempest-ServersAdminNegativeTestJSON-143110569 tempest-ServersAdminNegativeTestJSON-143110569-project-admin] 10.222.0.18 "POST /compute/v2.1/servers/e30325c5-f0df-4a39-8441-930f2460ccd8/action" status: 403 len: 118 microversion: 2.1 time: 0.316950 Oct 22 21:49:31.151019 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3123/6216] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 21:49:30 2022] POST /compute/v2.1/servers/e30325c5-f0df-4a39-8441-930f2460ccd8/action => generated 118 bytes in 318 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 22 21:49:31.158808 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-b9a7db2b-8e59-489e-888d-5a51dceb556c tempest-ServersAdminNegativeTestJSON-143110569 tempest-ServersAdminNegativeTestJSON-143110569-project-admin] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:49:31.179093 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-b9a7db2b-8e59-489e-888d-5a51dceb556c tempest-ServersAdminNegativeTestJSON-143110569 tempest-ServersAdminNegativeTestJSON-143110569-project-admin] 10.222.0.18 "DELETE /compute/v2.1/flavors/1979239188" status: 202 len: 0 microversion: 2.1 time: 0.024020 Oct 22 21:49:31.179713 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3094/6217] 10.222.0.18 () {58 vars in 1161 bytes} [Sat Oct 22 21:49:31 2022] DELETE /compute/v2.1/flavors/1979239188 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 21:49:31.188355 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-4353359c-0de1-4496-a2fe-852efd48712e tempest-ServersAdminNegativeTestJSON-143110569 tempest-ServersAdminNegativeTestJSON-143110569-project-admin] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:49:31.209883 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-4353359c-0de1-4496-a2fe-852efd48712e tempest-ServersAdminNegativeTestJSON-143110569 tempest-ServersAdminNegativeTestJSON-143110569-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.025316 Oct 22 21:49:31.210437 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3124/6218] 10.222.0.18 () {58 vars in 1146 bytes} [Sat Oct 22 21:49:31 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:49:31.231644 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-c2732b8f-a7e6-419e-a975-dfb068514473 tempest-ServersAdminNegativeTestJSON-143110569 tempest-ServersAdminNegativeTestJSON-143110569-project-admin] Calling method '.version_select at 0x7fd3a8bbdd30>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:49:31.301865 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-c2732b8f-a7e6-419e-a975-dfb068514473 tempest-ServersAdminNegativeTestJSON-143110569 tempest-ServersAdminNegativeTestJSON-143110569-project-admin] 10.222.0.18 "GET /compute/v2.1/os-quota-sets/c6a41a1389e0435a8e306f3d0e90a65d" status: 200 len: 371 microversion: 2.1 time: 0.073985 Oct 22 21:49:31.302359 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3095/6219] 10.222.0.18 () {58 vars in 1242 bytes} [Sat Oct 22 21:49:31 2022] GET /compute/v2.1/os-quota-sets/c6a41a1389e0435a8e306f3d0e90a65d => generated 371 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 21:49:31.314392 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-709deb6d-01ab-452c-aa6b-2c4b8cc7ddfe tempest-ServersAdminNegativeTestJSON-143110569 tempest-ServersAdminNegativeTestJSON-143110569-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 21, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-588102282", "id": 28482127, "os-flavor-access:is_public": "True"}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:49:31.335094 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-709deb6d-01ab-452c-aa6b-2c4b8cc7ddfe tempest-ServersAdminNegativeTestJSON-143110569 tempest-ServersAdminNegativeTestJSON-143110569-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 430 microversion: 2.1 time: 0.024569 Oct 22 21:49:31.335747 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3125/6220] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Oct 22 21:49:31 2022] POST /compute/v2.1/flavors => generated 430 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:49:31.348593 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-189487bd-7ce7-4947-b47a-58b9eb0c158c tempest-ServersAdminNegativeTestJSON-143110569 tempest-ServersAdminNegativeTestJSON-143110569-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "28482127"}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:49:31.351173 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-189487bd-7ce7-4947-b47a-58b9eb0c158c tempest-ServersAdminNegativeTestJSON-143110569 tempest-ServersAdminNegativeTestJSON-143110569-project-admin] [instance: e30325c5-f0df-4a39-8441-930f2460ccd8] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:49:31.357760 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-189487bd-7ce7-4947-b47a-58b9eb0c158c tempest-ServersAdminNegativeTestJSON-143110569 tempest-ServersAdminNegativeTestJSON-143110569-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:49:31.358239 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-189487bd-7ce7-4947-b47a-58b9eb0c158c tempest-ServersAdminNegativeTestJSON-143110569 tempest-ServersAdminNegativeTestJSON-143110569-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:49:31.358682 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-189487bd-7ce7-4947-b47a-58b9eb0c158c tempest-ServersAdminNegativeTestJSON-143110569 tempest-ServersAdminNegativeTestJSON-143110569-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:49:31.359419 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-189487bd-7ce7-4947-b47a-58b9eb0c158c tempest-ServersAdminNegativeTestJSON-143110569 tempest-ServersAdminNegativeTestJSON-143110569-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:49:31.359987 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-189487bd-7ce7-4947-b47a-58b9eb0c158c tempest-ServersAdminNegativeTestJSON-143110569 tempest-ServersAdminNegativeTestJSON-143110569-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:49:31.360315 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-189487bd-7ce7-4947-b47a-58b9eb0c158c tempest-ServersAdminNegativeTestJSON-143110569 tempest-ServersAdminNegativeTestJSON-143110569-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:49:31.451374 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-189487bd-7ce7-4947-b47a-58b9eb0c158c tempest-ServersAdminNegativeTestJSON-143110569 tempest-ServersAdminNegativeTestJSON-143110569-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '9c88e1f590ab46378ff959fff9c799f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6a41a1389e0435a8e306f3d0e90a65d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:49:31.458441 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-189487bd-7ce7-4947-b47a-58b9eb0c158c tempest-ServersAdminNegativeTestJSON-143110569 tempest-ServersAdminNegativeTestJSON-143110569-project-admin] [instance: e30325c5-f0df-4a39-8441-930f2460ccd8] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-588102282 {{(pid=138744) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 22 21:49:31.465688 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-189487bd-7ce7-4947-b47a-58b9eb0c158c tempest-ServersAdminNegativeTestJSON-143110569 tempest-ServersAdminNegativeTestJSON-143110569-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:49:31.466176 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-189487bd-7ce7-4947-b47a-58b9eb0c158c tempest-ServersAdminNegativeTestJSON-143110569 tempest-ServersAdminNegativeTestJSON-143110569-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:49:31.466615 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-189487bd-7ce7-4947-b47a-58b9eb0c158c tempest-ServersAdminNegativeTestJSON-143110569 tempest-ServersAdminNegativeTestJSON-143110569-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:49:31.467355 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-189487bd-7ce7-4947-b47a-58b9eb0c158c tempest-ServersAdminNegativeTestJSON-143110569 tempest-ServersAdminNegativeTestJSON-143110569-project-admin] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:49:31.467832 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-189487bd-7ce7-4947-b47a-58b9eb0c158c tempest-ServersAdminNegativeTestJSON-143110569 tempest-ServersAdminNegativeTestJSON-143110569-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:49:31.468619 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-189487bd-7ce7-4947-b47a-58b9eb0c158c tempest-ServersAdminNegativeTestJSON-143110569 tempest-ServersAdminNegativeTestJSON-143110569-project-admin] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:49:31.496377 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-189487bd-7ce7-4947-b47a-58b9eb0c158c tempest-ServersAdminNegativeTestJSON-143110569 tempest-ServersAdminNegativeTestJSON-143110569-project-admin] Getting quotas for project 56a206d602a04e9ba0177c29ed5fc5cb. Resources: {'ram', 'cores'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 21:49:31.502179 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-189487bd-7ce7-4947-b47a-58b9eb0c158c tempest-ServersAdminNegativeTestJSON-143110569 tempest-ServersAdminNegativeTestJSON-143110569-project-admin] Getting quotas for user b001f26443084425ac1cc716a8acac55 and project 56a206d602a04e9ba0177c29ed5fc5cb. Resources: {'ram', 'cores'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 21:49:31.516713 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.compute.api [None req-189487bd-7ce7-4947-b47a-58b9eb0c158c tempest-ServersAdminNegativeTestJSON-143110569 tempest-ServersAdminNegativeTestJSON-143110569-project-admin] cores quota exceeded for c6a41a1389e0435a8e306f3d0e90a65d, tried to resize instance. Oct 22 21:49:31.517254 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-189487bd-7ce7-4947-b47a-58b9eb0c158c tempest-ServersAdminNegativeTestJSON-143110569 tempest-ServersAdminNegativeTestJSON-143110569-project-admin] HTTP exception thrown: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 22 21:49:31.519475 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-189487bd-7ce7-4947-b47a-58b9eb0c158c tempest-ServersAdminNegativeTestJSON-143110569 tempest-ServersAdminNegativeTestJSON-143110569-project-admin] Request method failure captured: Oct 22 21:49:31.519475 ncdv-master-1 devstack@n-api.service[138744]: request: POST /compute/v2.1/servers/e30325c5-f0df-4a39-8441-930f2460ccd8/action HTTP/1.1 Oct 22 21:49:31.519475 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 21:49:31.519475 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 21:49:31.519475 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 21:49:31.519475 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 37 Oct 22 21:49:31.519475 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 21:49:31.519475 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 21:49:31.519475 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 21:49:31.519475 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 21:49:31.519475 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVGVdJP92eGBY7PicyHj8NIykEEaGvxM5AoQ90mTfHrg5gsY7RPIgYbxPeR_HybuMxK48BGVymQHa_J62RLZcpvU-TJ_7xw0vh9BYvgZ8j1Rtjd4tyW6v_dHaN2WfoywSXcBeF5WIEy-4FZ3op9Cy8xqAYj6si5kSLbdi1f4R_p6dZRI Oct 22 21:49:31.519475 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 21:49:31.519475 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 21:49:31.519475 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 21:49:31.519475 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 21:49:31.519475 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 21:49:31.519475 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 21:49:31.519475 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: c6a41a1389e0435a8e306f3d0e90a65d Oct 22 21:49:31.519475 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-143110569 Oct 22 21:49:31.519475 ncdv-master-1 devstack@n-api.service[138744]: X-Role: admin,member,reader Oct 22 21:49:31.519475 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: admin,member,reader Oct 22 21:49:31.519475 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_c6a41a1389e0435a8e306f3d0e90a65d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c6a41a1389e0435a8e306f3d0e90a65d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/c6a41a1389e0435a8e306f3d0e90a65d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c6a41a1389e0435a8e306f3d0e90a65d"}]}] Oct 22 21:49:31.519475 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-ServersAdminNegativeTestJSON-143110569 Oct 22 21:49:31.519475 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: c6a41a1389e0435a8e306f3d0e90a65d Oct 22 21:49:31.519475 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-143110569 Oct 22 21:49:31.519475 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-ServersAdminNegativeTestJSON-143110569-project-admin Oct 22 21:49:31.519475 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 21:49:31.519475 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 21:49:31.519475 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: 9c88e1f590ab46378ff959fff9c799f5 Oct 22 21:49:31.519475 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-ServersAdminNegativeTestJSON-143110569-project-admin Oct 22 21:49:31.519475 ncdv-master-1 devstack@n-api.service[138744]: Oct 22 21:49:31.519475 ncdv-master-1 devstack@n-api.service[138744]: {"resize": {"flavorRef": "28482127"}} Oct 22 21:49:31.519475 ncdv-master-1 devstack@n-api.service[138744]: method: > Oct 22 21:49:31.519475 ncdv-master-1 devstack@n-api.service[138744]: exception: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 22 21:49:31.519475 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': 'e30325c5-f0df-4a39-8441-930f2460ccd8', 'body': {'resize': {'flavorRef': '28482127'}}} Oct 22 21:49:31.519475 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:49:31.519475 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:49:31.519475 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3878, in _check_quota_for_upsize Oct 22 21:49:31.519475 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Oct 22 21:49:31.519475 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 22 21:49:31.519475 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 22 21:49:31.519475 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 22 21:49:31.519475 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc Oct 22 21:49:31.519475 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 22 21:49:31.519475 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 22 21:49:31.519475 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 22 21:49:31.519475 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 22 21:49:31.519475 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 22 21:49:31.519475 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 22 21:49:31.519475 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 22 21:49:31.519475 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 22 21:49:31.519475 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Oct 22 21:49:31.519475 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 22 21:49:31.519475 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Oct 22 21:49:31.519475 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:49:31.519475 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:49:31.519475 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:49:31.519475 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:49:31.519475 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Oct 22 21:49:31.519475 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Oct 22 21:49:31.519475 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 22 21:49:31.519475 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 22 21:49:31.519475 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 22 21:49:31.523564 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 22 21:49:31.523564 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 22 21:49:31.523564 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 22 21:49:31.523564 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 22 21:49:31.523564 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 22 21:49:31.523564 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 22 21:49:31.523564 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 22 21:49:31.523564 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Oct 22 21:49:31.523564 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 22 21:49:31.523564 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4244, in resize Oct 22 21:49:31.523564 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Oct 22 21:49:31.523564 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3896, in _check_quota_for_upsize Oct 22 21:49:31.523564 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 22 21:49:31.523564 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 22 21:49:31.523564 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:49:31.523564 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:49:31.523564 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:49:31.523564 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:49:31.523564 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:49:31.523564 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:49:31.523564 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:49:31.523564 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:49:31.523564 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:49:31.523564 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:49:31.523564 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 21:49:31.523564 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 21:49:31.523564 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 22 21:49:31.523564 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 22 21:49:31.523564 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Oct 22 21:49:31.523564 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 22 21:49:31.523564 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 22 21:49:31.523564 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:49:31.523564 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:49:31.523564 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:49:31.523564 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:49:31.523564 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:49:31.523564 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:49:31.523564 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:49:31.523564 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:49:31.523564 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 22 21:49:31.523564 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:49:31.523564 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-189487bd-7ce7-4947-b47a-58b9eb0c158c tempest-ServersAdminNegativeTestJSON-143110569 tempest-ServersAdminNegativeTestJSON-143110569-project-admin] Returning 403 to user: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:49:31.523564 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-189487bd-7ce7-4947-b47a-58b9eb0c158c tempest-ServersAdminNegativeTestJSON-143110569 tempest-ServersAdminNegativeTestJSON-143110569-project-admin] 10.222.0.18 "POST /compute/v2.1/servers/e30325c5-f0df-4a39-8441-930f2460ccd8/action" status: 403 len: 113 microversion: 2.1 time: 0.176485 Oct 22 21:49:31.523564 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3096/6221] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 21:49:31 2022] POST /compute/v2.1/servers/e30325c5-f0df-4a39-8441-930f2460ccd8/action => generated 113 bytes in 178 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 22 21:49:31.530032 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-ac92e2aa-5df4-41a9-8382-f773ec0cea87 tempest-ServersAdminNegativeTestJSON-143110569 tempest-ServersAdminNegativeTestJSON-143110569-project-admin] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:49:31.551969 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-ac92e2aa-5df4-41a9-8382-f773ec0cea87 tempest-ServersAdminNegativeTestJSON-143110569 tempest-ServersAdminNegativeTestJSON-143110569-project-admin] 10.222.0.18 "DELETE /compute/v2.1/flavors/28482127" status: 202 len: 0 microversion: 2.1 time: 0.025721 Oct 22 21:49:31.552450 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3126/6222] 10.222.0.18 () {58 vars in 1155 bytes} [Sat Oct 22 21:49:31 2022] DELETE /compute/v2.1/flavors/28482127 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 21:49:31.563169 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-411a34a3-4618-4f80-93a3-973fdc042af6 tempest-ServersAdminNegativeTestJSON-143110569 tempest-ServersAdminNegativeTestJSON-143110569-project-admin] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:49:31.590407 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-411a34a3-4618-4f80-93a3-973fdc042af6 tempest-ServersAdminNegativeTestJSON-143110569 tempest-ServersAdminNegativeTestJSON-143110569-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.033148 Oct 22 21:49:31.590973 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3097/6223] 10.222.0.18 () {58 vars in 1146 bytes} [Sat Oct 22 21:49:31 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:49:31.612684 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-019337a3-c18d-44d7-bb0b-6a01885f5112 tempest-ServersAdminNegativeTestJSON-1402685182 tempest-ServersAdminNegativeTestJSON-1402685182-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:49:31.613210 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-019337a3-c18d-44d7-bb0b-6a01885f5112 tempest-ServersAdminNegativeTestJSON-1402685182 tempest-ServersAdminNegativeTestJSON-1402685182-project] [instance: e30325c5-f0df-4a39-8441-930f2460ccd8] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:49:31.619696 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-019337a3-c18d-44d7-bb0b-6a01885f5112 tempest-ServersAdminNegativeTestJSON-1402685182 tempest-ServersAdminNegativeTestJSON-1402685182-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:49:31.620204 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-019337a3-c18d-44d7-bb0b-6a01885f5112 tempest-ServersAdminNegativeTestJSON-1402685182 tempest-ServersAdminNegativeTestJSON-1402685182-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:49:31.620664 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-019337a3-c18d-44d7-bb0b-6a01885f5112 tempest-ServersAdminNegativeTestJSON-1402685182 tempest-ServersAdminNegativeTestJSON-1402685182-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:49:31.621359 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-019337a3-c18d-44d7-bb0b-6a01885f5112 tempest-ServersAdminNegativeTestJSON-1402685182 tempest-ServersAdminNegativeTestJSON-1402685182-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:49:31.621832 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-019337a3-c18d-44d7-bb0b-6a01885f5112 tempest-ServersAdminNegativeTestJSON-1402685182 tempest-ServersAdminNegativeTestJSON-1402685182-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:49:31.622274 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-019337a3-c18d-44d7-bb0b-6a01885f5112 tempest-ServersAdminNegativeTestJSON-1402685182 tempest-ServersAdminNegativeTestJSON-1402685182-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:49:31.649264 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-019337a3-c18d-44d7-bb0b-6a01885f5112 tempest-ServersAdminNegativeTestJSON-1402685182 tempest-ServersAdminNegativeTestJSON-1402685182-project] [instance: e30325c5-f0df-4a39-8441-930f2460ccd8] Going to try to terminate instance {{(pid=138745) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 21:49:31.734714 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-019337a3-c18d-44d7-bb0b-6a01885f5112 tempest-ServersAdminNegativeTestJSON-1402685182 tempest-ServersAdminNegativeTestJSON-1402685182-project] 10.222.0.18 "DELETE /compute/v2.1/servers/e30325c5-f0df-4a39-8441-930f2460ccd8" status: 204 len: 0 microversion: 2.1 time: 0.125620 Oct 22 21:49:31.735480 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3127/6224] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 21:49:31 2022] DELETE /compute/v2.1/servers/e30325c5-f0df-4a39-8441-930f2460ccd8 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 21:49:31.743710 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-88ab0f53-1003-4a0d-9ac4-838621bea950 tempest-ServersAdminNegativeTestJSON-1402685182 tempest-ServersAdminNegativeTestJSON-1402685182-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:49:31.744320 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-88ab0f53-1003-4a0d-9ac4-838621bea950 tempest-ServersAdminNegativeTestJSON-1402685182 tempest-ServersAdminNegativeTestJSON-1402685182-project] [instance: e30325c5-f0df-4a39-8441-930f2460ccd8] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:49:31.750520 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-88ab0f53-1003-4a0d-9ac4-838621bea950 tempest-ServersAdminNegativeTestJSON-1402685182 tempest-ServersAdminNegativeTestJSON-1402685182-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:49:31.751032 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-88ab0f53-1003-4a0d-9ac4-838621bea950 tempest-ServersAdminNegativeTestJSON-1402685182 tempest-ServersAdminNegativeTestJSON-1402685182-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:49:31.751504 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-88ab0f53-1003-4a0d-9ac4-838621bea950 tempest-ServersAdminNegativeTestJSON-1402685182 tempest-ServersAdminNegativeTestJSON-1402685182-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:49:31.752198 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-88ab0f53-1003-4a0d-9ac4-838621bea950 tempest-ServersAdminNegativeTestJSON-1402685182 tempest-ServersAdminNegativeTestJSON-1402685182-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:49:31.752651 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-88ab0f53-1003-4a0d-9ac4-838621bea950 tempest-ServersAdminNegativeTestJSON-1402685182 tempest-ServersAdminNegativeTestJSON-1402685182-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:49:31.753080 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-88ab0f53-1003-4a0d-9ac4-838621bea950 tempest-ServersAdminNegativeTestJSON-1402685182 tempest-ServersAdminNegativeTestJSON-1402685182-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:49:31.886121 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-88ab0f53-1003-4a0d-9ac4-838621bea950 tempest-ServersAdminNegativeTestJSON-1402685182 tempest-ServersAdminNegativeTestJSON-1402685182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b001f26443084425ac1cc716a8acac55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56a206d602a04e9ba0177c29ed5fc5cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:49:31.894190 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-88ab0f53-1003-4a0d-9ac4-838621bea950 tempest-ServersAdminNegativeTestJSON-1402685182 tempest-ServersAdminNegativeTestJSON-1402685182-project] 10.222.0.18 "GET /compute/v2.1/servers/e30325c5-f0df-4a39-8441-930f2460ccd8" status: 200 len: 1477 microversion: 2.1 time: 0.154549 Oct 22 21:49:31.894766 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3098/6225] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:49:31 2022] GET /compute/v2.1/servers/e30325c5-f0df-4a39-8441-930f2460ccd8 => generated 1477 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:49:32.921345 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-a19cade3-0290-41db-a71b-52f379796551 tempest-ServersAdminNegativeTestJSON-1402685182 tempest-ServersAdminNegativeTestJSON-1402685182-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:49:32.922450 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-a19cade3-0290-41db-a71b-52f379796551 tempest-ServersAdminNegativeTestJSON-1402685182 tempest-ServersAdminNegativeTestJSON-1402685182-project] [instance: e30325c5-f0df-4a39-8441-930f2460ccd8] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:49:32.933170 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a19cade3-0290-41db-a71b-52f379796551 tempest-ServersAdminNegativeTestJSON-1402685182 tempest-ServersAdminNegativeTestJSON-1402685182-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:49:32.933847 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a19cade3-0290-41db-a71b-52f379796551 tempest-ServersAdminNegativeTestJSON-1402685182 tempest-ServersAdminNegativeTestJSON-1402685182-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:49:32.934464 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a19cade3-0290-41db-a71b-52f379796551 tempest-ServersAdminNegativeTestJSON-1402685182 tempest-ServersAdminNegativeTestJSON-1402685182-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:49:32.935473 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a19cade3-0290-41db-a71b-52f379796551 tempest-ServersAdminNegativeTestJSON-1402685182 tempest-ServersAdminNegativeTestJSON-1402685182-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:49:32.936153 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a19cade3-0290-41db-a71b-52f379796551 tempest-ServersAdminNegativeTestJSON-1402685182 tempest-ServersAdminNegativeTestJSON-1402685182-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:49:32.936754 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a19cade3-0290-41db-a71b-52f379796551 tempest-ServersAdminNegativeTestJSON-1402685182 tempest-ServersAdminNegativeTestJSON-1402685182-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:49:33.075176 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-a19cade3-0290-41db-a71b-52f379796551 tempest-ServersAdminNegativeTestJSON-1402685182 tempest-ServersAdminNegativeTestJSON-1402685182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b001f26443084425ac1cc716a8acac55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56a206d602a04e9ba0177c29ed5fc5cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:49:33.083407 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-a19cade3-0290-41db-a71b-52f379796551 tempest-ServersAdminNegativeTestJSON-1402685182 tempest-ServersAdminNegativeTestJSON-1402685182-project] 10.222.0.18 "GET /compute/v2.1/servers/e30325c5-f0df-4a39-8441-930f2460ccd8" status: 200 len: 1477 microversion: 2.1 time: 0.168407 Oct 22 21:49:33.083962 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3128/6226] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:49:32 2022] GET /compute/v2.1/servers/e30325c5-f0df-4a39-8441-930f2460ccd8 => generated 1477 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:49:33.618916 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-e9ac48cb-4e9d-4a92-b956-862003128422 req-4a3e5164-1edd-41bc-8508-80d28858865a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e30325c5-f0df-4a39-8441-930f2460ccd8", "name": "network-vif-deleted", "tag": "9bf16fac-f1d8-4d6d-965a-cf21999c4333"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:49:33.630220 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-e9ac48cb-4e9d-4a92-b956-862003128422 req-4a3e5164-1edd-41bc-8508-80d28858865a service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:49:33.630706 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-e9ac48cb-4e9d-4a92-b956-862003128422 req-4a3e5164-1edd-41bc-8508-80d28858865a service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:49:33.631159 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-e9ac48cb-4e9d-4a92-b956-862003128422 req-4a3e5164-1edd-41bc-8508-80d28858865a service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:49:33.649066 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-e9ac48cb-4e9d-4a92-b956-862003128422 req-4a3e5164-1edd-41bc-8508-80d28858865a service nova] Creating event network-vif-deleted:9bf16fac-f1d8-4d6d-965a-cf21999c4333 for instance e30325c5-f0df-4a39-8441-930f2460ccd8 on nch1-master-1 Oct 22 21:49:33.654474 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-e9ac48cb-4e9d-4a92-b956-862003128422 req-4a3e5164-1edd-41bc-8508-80d28858865a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039216 Oct 22 21:49:33.655305 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3099/6227] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:49:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:49:34.106742 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-b4c13418-8d9e-48b9-a9ff-7e694473af0a tempest-ServersAdminNegativeTestJSON-1402685182 tempest-ServersAdminNegativeTestJSON-1402685182-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:49:34.107418 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-b4c13418-8d9e-48b9-a9ff-7e694473af0a tempest-ServersAdminNegativeTestJSON-1402685182 tempest-ServersAdminNegativeTestJSON-1402685182-project] [instance: e30325c5-f0df-4a39-8441-930f2460ccd8] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:49:34.115501 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b4c13418-8d9e-48b9-a9ff-7e694473af0a tempest-ServersAdminNegativeTestJSON-1402685182 tempest-ServersAdminNegativeTestJSON-1402685182-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:49:34.116066 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b4c13418-8d9e-48b9-a9ff-7e694473af0a tempest-ServersAdminNegativeTestJSON-1402685182 tempest-ServersAdminNegativeTestJSON-1402685182-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:49:34.116533 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b4c13418-8d9e-48b9-a9ff-7e694473af0a tempest-ServersAdminNegativeTestJSON-1402685182 tempest-ServersAdminNegativeTestJSON-1402685182-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:49:34.117264 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b4c13418-8d9e-48b9-a9ff-7e694473af0a tempest-ServersAdminNegativeTestJSON-1402685182 tempest-ServersAdminNegativeTestJSON-1402685182-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:49:34.117865 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b4c13418-8d9e-48b9-a9ff-7e694473af0a tempest-ServersAdminNegativeTestJSON-1402685182 tempest-ServersAdminNegativeTestJSON-1402685182-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:49:34.118350 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b4c13418-8d9e-48b9-a9ff-7e694473af0a tempest-ServersAdminNegativeTestJSON-1402685182 tempest-ServersAdminNegativeTestJSON-1402685182-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:49:34.157840 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b4c13418-8d9e-48b9-a9ff-7e694473af0a tempest-ServersAdminNegativeTestJSON-1402685182 tempest-ServersAdminNegativeTestJSON-1402685182-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:49:34.158634 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b4c13418-8d9e-48b9-a9ff-7e694473af0a tempest-ServersAdminNegativeTestJSON-1402685182 tempest-ServersAdminNegativeTestJSON-1402685182-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:49:34.159060 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b4c13418-8d9e-48b9-a9ff-7e694473af0a tempest-ServersAdminNegativeTestJSON-1402685182 tempest-ServersAdminNegativeTestJSON-1402685182-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:49:34.159579 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.objects.instance [None req-b4c13418-8d9e-48b9-a9ff-7e694473af0a tempest-ServersAdminNegativeTestJSON-1402685182 tempest-ServersAdminNegativeTestJSON-1402685182-project] Lazy-loading 'fault' on Instance uuid e30325c5-f0df-4a39-8441-930f2460ccd8 {{(pid=138745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 21:49:34.200613 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-b4c13418-8d9e-48b9-a9ff-7e694473af0a tempest-ServersAdminNegativeTestJSON-1402685182 tempest-ServersAdminNegativeTestJSON-1402685182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b001f26443084425ac1cc716a8acac55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56a206d602a04e9ba0177c29ed5fc5cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:49:34.208013 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-b4c13418-8d9e-48b9-a9ff-7e694473af0a tempest-ServersAdminNegativeTestJSON-1402685182 tempest-ServersAdminNegativeTestJSON-1402685182-project] 10.222.0.18 "GET /compute/v2.1/servers/e30325c5-f0df-4a39-8441-930f2460ccd8" status: 200 len: 1312 microversion: 2.1 time: 0.105580 Oct 22 21:49:34.208586 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3129/6228] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:49:34 2022] GET /compute/v2.1/servers/e30325c5-f0df-4a39-8441-930f2460ccd8 => generated 1312 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:49:35.238352 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-699d0a75-b01e-40d0-9e74-6dc485750d35 tempest-ServersAdminNegativeTestJSON-1402685182 tempest-ServersAdminNegativeTestJSON-1402685182-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:49:35.239592 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-699d0a75-b01e-40d0-9e74-6dc485750d35 tempest-ServersAdminNegativeTestJSON-1402685182 tempest-ServersAdminNegativeTestJSON-1402685182-project] [instance: e30325c5-f0df-4a39-8441-930f2460ccd8] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:49:35.246329 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-699d0a75-b01e-40d0-9e74-6dc485750d35 tempest-ServersAdminNegativeTestJSON-1402685182 tempest-ServersAdminNegativeTestJSON-1402685182-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:49:35.246819 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-699d0a75-b01e-40d0-9e74-6dc485750d35 tempest-ServersAdminNegativeTestJSON-1402685182 tempest-ServersAdminNegativeTestJSON-1402685182-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:49:35.247262 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-699d0a75-b01e-40d0-9e74-6dc485750d35 tempest-ServersAdminNegativeTestJSON-1402685182 tempest-ServersAdminNegativeTestJSON-1402685182-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:49:35.248031 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-699d0a75-b01e-40d0-9e74-6dc485750d35 tempest-ServersAdminNegativeTestJSON-1402685182 tempest-ServersAdminNegativeTestJSON-1402685182-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:49:35.248487 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-699d0a75-b01e-40d0-9e74-6dc485750d35 tempest-ServersAdminNegativeTestJSON-1402685182 tempest-ServersAdminNegativeTestJSON-1402685182-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:49:35.248917 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-699d0a75-b01e-40d0-9e74-6dc485750d35 tempest-ServersAdminNegativeTestJSON-1402685182 tempest-ServersAdminNegativeTestJSON-1402685182-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:49:35.262835 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-699d0a75-b01e-40d0-9e74-6dc485750d35 tempest-ServersAdminNegativeTestJSON-1402685182 tempest-ServersAdminNegativeTestJSON-1402685182-project] HTTP exception thrown: Instance e30325c5-f0df-4a39-8441-930f2460ccd8 could not be found. Oct 22 21:49:35.264513 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-699d0a75-b01e-40d0-9e74-6dc485750d35 tempest-ServersAdminNegativeTestJSON-1402685182 tempest-ServersAdminNegativeTestJSON-1402685182-project] Request method failure captured: Oct 22 21:49:35.264513 ncdv-master-1 devstack@n-api.service[138744]: request: GET /compute/v2.1/servers/e30325c5-f0df-4a39-8441-930f2460ccd8 HTTP/1.1 Oct 22 21:49:35.264513 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 21:49:35.264513 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 21:49:35.264513 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 21:49:35.264513 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 0 Oct 22 21:49:35.264513 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 21:49:35.264513 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 21:49:35.264513 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 21:49:35.264513 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 21:49:35.264513 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVGVdnVMbRzcnZXtUq8nMyz5QnLnMlQHx7WGF1NrmpkSUVJinTD2Abyh33NCuOKcNQ0EiIynWvd9U9bvBSQ0vjMYM94BK2WzcuuHHZcyyYnIc7jXbK6nxRBScAhnkTF5aJm2mj7jHJp_f3p6m9vDNZXctgfF9NZYRvci_warhi6EunZE Oct 22 21:49:35.264513 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 21:49:35.264513 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 21:49:35.264513 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 21:49:35.264513 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 21:49:35.264513 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 21:49:35.264513 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 21:49:35.264513 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: 56a206d602a04e9ba0177c29ed5fc5cb Oct 22 21:49:35.264513 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1402685182 Oct 22 21:49:35.264513 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 21:49:35.264513 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 21:49:35.264513 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_56a206d602a04e9ba0177c29ed5fc5cb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/56a206d602a04e9ba0177c29ed5fc5cb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/56a206d602a04e9ba0177c29ed5fc5cb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/56a206d602a04e9ba0177c29ed5fc5cb"}]}] Oct 22 21:49:35.264513 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1402685182 Oct 22 21:49:35.264513 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: 56a206d602a04e9ba0177c29ed5fc5cb Oct 22 21:49:35.264513 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1402685182 Oct 22 21:49:35.264513 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-ServersAdminNegativeTestJSON-1402685182-project Oct 22 21:49:35.264513 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 21:49:35.264513 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 21:49:35.264513 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: b001f26443084425ac1cc716a8acac55 Oct 22 21:49:35.264513 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1402685182-project Oct 22 21:49:35.264513 ncdv-master-1 devstack@n-api.service[138744]: method: > Oct 22 21:49:35.264513 ncdv-master-1 devstack@n-api.service[138744]: exception: Instance e30325c5-f0df-4a39-8441-930f2460ccd8 could not be found. Oct 22 21:49:35.264513 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': 'e30325c5-f0df-4a39-8441-930f2460ccd8'} Oct 22 21:49:35.264513 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:49:35.264513 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:49:35.264513 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 21:49:35.264513 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 21:49:35.264513 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 21:49:35.264513 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 21:49:35.264513 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 21:49:35.264513 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 21:49:35.264513 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 21:49:35.264513 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 21:49:35.264513 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e30325c5-f0df-4a39-8441-930f2460ccd8 could not be found. Oct 22 21:49:35.264513 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:49:35.264513 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:49:35.264513 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:49:35.264513 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:49:35.264513 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:49:35.264513 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:49:35.264513 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:49:35.264513 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:49:35.264513 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:49:35.264513 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:49:35.264513 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 21:49:35.264513 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 21:49:35.264513 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 21:49:35.264513 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 21:49:35.264513 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 21:49:35.264513 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:49:35.264513 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e30325c5-f0df-4a39-8441-930f2460ccd8 could not be found. Oct 22 21:49:35.264513 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:49:35.264513 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:49:35.268929 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:49:35.268929 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:49:35.268929 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:49:35.268929 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:49:35.268929 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:49:35.268929 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:49:35.268929 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e30325c5-f0df-4a39-8441-930f2460ccd8 could not be found. Oct 22 21:49:35.268929 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:49:35.268929 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-699d0a75-b01e-40d0-9e74-6dc485750d35 tempest-ServersAdminNegativeTestJSON-1402685182 tempest-ServersAdminNegativeTestJSON-1402685182-project] Returning 404 to user: Instance e30325c5-f0df-4a39-8441-930f2460ccd8 could not be found. {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:49:35.268929 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-699d0a75-b01e-40d0-9e74-6dc485750d35 tempest-ServersAdminNegativeTestJSON-1402685182 tempest-ServersAdminNegativeTestJSON-1402685182-project] 10.222.0.18 "GET /compute/v2.1/servers/e30325c5-f0df-4a39-8441-930f2460ccd8" status: 404 len: 111 microversion: 2.1 time: 0.036404 Oct 22 21:49:35.268929 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3100/6229] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:49:35 2022] GET /compute/v2.1/servers/e30325c5-f0df-4a39-8441-930f2460ccd8 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 21:49:41.450876 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell0:SELECT=2 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:49:41.452219 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell0:SELECT=3 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:49:41.592969 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-1bcc1762-8d46-42ac-928d-8d1087bae5b3 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1517986213", "imageRef": "085e4478-6edc-4a69-8e08-f9831713eb65", "flavorRef": "452", "networks": [{"uuid": "ebea2c4c-2b4e-47fc-b606-d510dcca6748"}]}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:49:41.656159 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.network.neutron [None req-1bcc1762-8d46-42ac-928d-8d1087bae5b3 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] validate_networks() for [('ebea2c4c-2b4e-47fc-b606-d510dcca6748', None, None, None, None, None)] {{(pid=138745) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 21:49:42.053664 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-1bcc1762-8d46-42ac-928d-8d1087bae5b3 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Flavor limits 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 21:49:42.054766 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-1bcc1762-8d46-42ac-928d-8d1087bae5b3 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Image limits 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 21:49:42.055433 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-1bcc1762-8d46-42ac-928d-8d1087bae5b3 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Flavor pref 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 21:49:42.055940 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-1bcc1762-8d46-42ac-928d-8d1087bae5b3 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Image pref 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 21:49:42.056442 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-1bcc1762-8d46-42ac-928d-8d1087bae5b3 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 21:49:42.066633 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1bcc1762-8d46-42ac-928d-8d1087bae5b3 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:49:42.067180 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1bcc1762-8d46-42ac-928d-8d1087bae5b3 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:49:42.067674 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1bcc1762-8d46-42ac-928d-8d1087bae5b3 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:49:42.068703 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1bcc1762-8d46-42ac-928d-8d1087bae5b3 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:49:42.069179 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1bcc1762-8d46-42ac-928d-8d1087bae5b3 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:49:42.069622 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1bcc1762-8d46-42ac-928d-8d1087bae5b3 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:49:42.087964 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-1bcc1762-8d46-42ac-928d-8d1087bae5b3 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Getting quotas for project 92d1643804cc4a989c2bb72c2c416b10. Resources: {'cores', 'instances', 'ram'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 21:49:42.093922 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-1bcc1762-8d46-42ac-928d-8d1087bae5b3 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Getting quotas for user 82c7a7d9566c4f0eb585c9bcb042f3cf and project 92d1643804cc4a989c2bb72c2c416b10. Resources: {'cores', 'instances', 'ram'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 21:49:42.107215 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-1bcc1762-8d46-42ac-928d-8d1087bae5b3 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Going to run 1 instances... {{(pid=138745) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 21:49:42.109656 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-1bcc1762-8d46-42ac-928d-8d1087bae5b3 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] [instance: 776793d3-dc28-4511-a3d2-efe2f7f88c6f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='085e4478-6edc-4a69-8e08-f9831713eb65',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138745) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 21:49:42.155868 ncdv-master-1 devstack@n-api.service[138745]: ERROR oslo.messaging._drivers.impl_rabbit [None req-1bcc1762-8d46-42ac-928d-8d1087bae5b3 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] [56d69d84-d163-4032-a20a-431de1095b7a] AMQP server on 10.222.0.18:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 22 21:49:43.164374 ncdv-master-1 devstack@n-api.service[138745]: INFO oslo.messaging._drivers.impl_rabbit [None req-1bcc1762-8d46-42ac-928d-8d1087bae5b3 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] [56d69d84-d163-4032-a20a-431de1095b7a] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 35350. Oct 22 21:49:43.169408 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-1bcc1762-8d46-42ac-928d-8d1087bae5b3 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.724158 Oct 22 21:49:43.170171 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3130/6230] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Oct 22 21:49:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 1726 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 21:49:43.182483 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-dbf0dedd-97bf-4ba7-9af2-6fe9090252e2 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:49:43.183177 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-dbf0dedd-97bf-4ba7-9af2-6fe9090252e2 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] [instance: 776793d3-dc28-4511-a3d2-efe2f7f88c6f] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:49:43.187429 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell0:SELECT=2 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:49:43.188117 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell0:SELECT=3 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:49:43.257051 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-dbf0dedd-97bf-4ba7-9af2-6fe9090252e2 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c7a7d9566c4f0eb585c9bcb042f3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d1643804cc4a989c2bb72c2c416b10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:49:43.264797 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-dbf0dedd-97bf-4ba7-9af2-6fe9090252e2 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] 10.222.0.18 "GET /compute/v2.1/servers/776793d3-dc28-4511-a3d2-efe2f7f88c6f" status: 200 len: 1215 microversion: 2.1 time: 0.086336 Oct 22 21:49:43.265413 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3101/6231] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:49:43 2022] GET /compute/v2.1/servers/776793d3-dc28-4511-a3d2-efe2f7f88c6f => generated 1215 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:49:44.288467 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-22eb8b26-dd77-4bad-bf8b-df54e7c13025 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:49:44.289350 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-22eb8b26-dd77-4bad-bf8b-df54e7c13025 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] [instance: 776793d3-dc28-4511-a3d2-efe2f7f88c6f] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:49:44.296369 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-22eb8b26-dd77-4bad-bf8b-df54e7c13025 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:49:44.296956 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-22eb8b26-dd77-4bad-bf8b-df54e7c13025 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:49:44.297602 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-22eb8b26-dd77-4bad-bf8b-df54e7c13025 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:49:44.298329 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-22eb8b26-dd77-4bad-bf8b-df54e7c13025 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:49:44.299146 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-22eb8b26-dd77-4bad-bf8b-df54e7c13025 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:49:44.299597 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-22eb8b26-dd77-4bad-bf8b-df54e7c13025 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:49:44.376190 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-22eb8b26-dd77-4bad-bf8b-df54e7c13025 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c7a7d9566c4f0eb585c9bcb042f3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d1643804cc4a989c2bb72c2c416b10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:49:44.387904 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-22eb8b26-dd77-4bad-bf8b-df54e7c13025 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] 10.222.0.18 "GET /compute/v2.1/servers/776793d3-dc28-4511-a3d2-efe2f7f88c6f" status: 200 len: 1275 microversion: 2.1 time: 0.104480 Oct 22 21:49:44.392873 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3131/6232] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:49:44 2022] GET /compute/v2.1/servers/776793d3-dc28-4511-a3d2-efe2f7f88c6f => generated 1275 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:49:45.412717 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-6ff80209-b4b5-44cb-b989-f3074c208d36 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:49:45.413438 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-6ff80209-b4b5-44cb-b989-f3074c208d36 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] [instance: 776793d3-dc28-4511-a3d2-efe2f7f88c6f] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:49:45.417952 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:SELECT=57 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:49:45.425388 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6ff80209-b4b5-44cb-b989-f3074c208d36 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:49:45.426162 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6ff80209-b4b5-44cb-b989-f3074c208d36 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:49:45.426785 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6ff80209-b4b5-44cb-b989-f3074c208d36 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:49:45.427903 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6ff80209-b4b5-44cb-b989-f3074c208d36 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:49:45.428572 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6ff80209-b4b5-44cb-b989-f3074c208d36 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:49:45.429207 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6ff80209-b4b5-44cb-b989-f3074c208d36 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:49:45.586662 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-6ff80209-b4b5-44cb-b989-f3074c208d36 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c7a7d9566c4f0eb585c9bcb042f3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d1643804cc4a989c2bb72c2c416b10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:49:45.595628 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-6ff80209-b4b5-44cb-b989-f3074c208d36 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] 10.222.0.18 "GET /compute/v2.1/servers/776793d3-dc28-4511-a3d2-efe2f7f88c6f" status: 200 len: 1315 microversion: 2.1 time: 0.187922 Oct 22 21:49:45.596157 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3102/6233] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:49:45 2022] GET /compute/v2.1/servers/776793d3-dc28-4511-a3d2-efe2f7f88c6f => generated 1315 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:49:46.123382 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-1068cd3b-341e-4419-b683-95f365d5226c req-3cf589bf-1a35-48bc-bdf7-0c4a1d144004 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "776793d3-dc28-4511-a3d2-efe2f7f88c6f", "tag": "8bd64564-8ebe-4198-8fac-2bd7697fb396"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:49:46.134953 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-1068cd3b-341e-4419-b683-95f365d5226c req-3cf589bf-1a35-48bc-bdf7-0c4a1d144004 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:49:46.135475 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-1068cd3b-341e-4419-b683-95f365d5226c req-3cf589bf-1a35-48bc-bdf7-0c4a1d144004 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:49:46.135944 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-1068cd3b-341e-4419-b683-95f365d5226c req-3cf589bf-1a35-48bc-bdf7-0c4a1d144004 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:49:46.148935 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-1068cd3b-341e-4419-b683-95f365d5226c req-3cf589bf-1a35-48bc-bdf7-0c4a1d144004 service nova] Creating event network-changed:8bd64564-8ebe-4198-8fac-2bd7697fb396 for instance 776793d3-dc28-4511-a3d2-efe2f7f88c6f on nch1-master-1 Oct 22 21:49:46.154528 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-1068cd3b-341e-4419-b683-95f365d5226c req-3cf589bf-1a35-48bc-bdf7-0c4a1d144004 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034996 Oct 22 21:49:46.155380 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3132/6234] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:49:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:49:46.618610 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-dee374d1-04bb-4f6b-bfe5-c3e2453d4ec1 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:49:46.619258 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-dee374d1-04bb-4f6b-bfe5-c3e2453d4ec1 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] [instance: 776793d3-dc28-4511-a3d2-efe2f7f88c6f] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:49:46.626732 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-dee374d1-04bb-4f6b-bfe5-c3e2453d4ec1 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:49:46.627231 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-dee374d1-04bb-4f6b-bfe5-c3e2453d4ec1 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:49:46.627783 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-dee374d1-04bb-4f6b-bfe5-c3e2453d4ec1 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:49:46.628519 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-dee374d1-04bb-4f6b-bfe5-c3e2453d4ec1 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:49:46.628979 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-dee374d1-04bb-4f6b-bfe5-c3e2453d4ec1 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:49:46.629413 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-dee374d1-04bb-4f6b-bfe5-c3e2453d4ec1 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:49:46.764285 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-dee374d1-04bb-4f6b-bfe5-c3e2453d4ec1 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c7a7d9566c4f0eb585c9bcb042f3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d1643804cc4a989c2bb72c2c416b10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:49:46.772800 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-dee374d1-04bb-4f6b-bfe5-c3e2453d4ec1 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] 10.222.0.18 "GET /compute/v2.1/servers/776793d3-dc28-4511-a3d2-efe2f7f88c6f" status: 200 len: 1315 microversion: 2.1 time: 0.158192 Oct 22 21:49:46.773698 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3103/6235] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:49:46 2022] GET /compute/v2.1/servers/776793d3-dc28-4511-a3d2-efe2f7f88c6f => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:49:47.801560 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-e4b38ef8-0bce-4952-822b-5cffe0f9c0fc tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:49:47.802654 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-e4b38ef8-0bce-4952-822b-5cffe0f9c0fc tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] [instance: 776793d3-dc28-4511-a3d2-efe2f7f88c6f] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:49:47.812646 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e4b38ef8-0bce-4952-822b-5cffe0f9c0fc tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:49:47.813408 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e4b38ef8-0bce-4952-822b-5cffe0f9c0fc tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:49:47.814107 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e4b38ef8-0bce-4952-822b-5cffe0f9c0fc tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:49:47.815189 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e4b38ef8-0bce-4952-822b-5cffe0f9c0fc tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:49:47.815969 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e4b38ef8-0bce-4952-822b-5cffe0f9c0fc tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:49:47.816657 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e4b38ef8-0bce-4952-822b-5cffe0f9c0fc tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:49:47.951531 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-e4b38ef8-0bce-4952-822b-5cffe0f9c0fc tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c7a7d9566c4f0eb585c9bcb042f3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d1643804cc4a989c2bb72c2c416b10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:49:47.959734 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-e4b38ef8-0bce-4952-822b-5cffe0f9c0fc tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] 10.222.0.18 "GET /compute/v2.1/servers/776793d3-dc28-4511-a3d2-efe2f7f88c6f" status: 200 len: 1315 microversion: 2.1 time: 0.166568 Oct 22 21:49:47.960313 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3133/6236] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:49:47 2022] GET /compute/v2.1/servers/776793d3-dc28-4511-a3d2-efe2f7f88c6f => generated 1315 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:49:48.992723 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-493b99f1-003a-4add-a374-cc1df7f3876d tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:49:48.993354 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-493b99f1-003a-4add-a374-cc1df7f3876d tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] [instance: 776793d3-dc28-4511-a3d2-efe2f7f88c6f] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:49:48.996443 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=4,nova_api:DELETE=3 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:49:49.002643 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-493b99f1-003a-4add-a374-cc1df7f3876d tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:49:49.003316 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-493b99f1-003a-4add-a374-cc1df7f3876d tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:49:49.003771 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-493b99f1-003a-4add-a374-cc1df7f3876d tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:49:49.004649 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-493b99f1-003a-4add-a374-cc1df7f3876d tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:49:49.006053 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-493b99f1-003a-4add-a374-cc1df7f3876d tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:49:49.006506 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-493b99f1-003a-4add-a374-cc1df7f3876d tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:49:49.150679 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-493b99f1-003a-4add-a374-cc1df7f3876d tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c7a7d9566c4f0eb585c9bcb042f3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d1643804cc4a989c2bb72c2c416b10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:49:49.158882 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-493b99f1-003a-4add-a374-cc1df7f3876d tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] 10.222.0.18 "GET /compute/v2.1/servers/776793d3-dc28-4511-a3d2-efe2f7f88c6f" status: 200 len: 1315 microversion: 2.1 time: 0.170392 Oct 22 21:49:49.159468 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3104/6237] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:49:48 2022] GET /compute/v2.1/servers/776793d3-dc28-4511-a3d2-efe2f7f88c6f => generated 1315 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:49:50.182549 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-d5eb91e6-d2b9-4568-81fa-3f3335731b61 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:49:50.183137 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-d5eb91e6-d2b9-4568-81fa-3f3335731b61 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] [instance: 776793d3-dc28-4511-a3d2-efe2f7f88c6f] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:49:50.186150 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=4,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:49:50.191908 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d5eb91e6-d2b9-4568-81fa-3f3335731b61 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:49:50.192440 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d5eb91e6-d2b9-4568-81fa-3f3335731b61 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:49:50.192933 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d5eb91e6-d2b9-4568-81fa-3f3335731b61 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:49:50.193635 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d5eb91e6-d2b9-4568-81fa-3f3335731b61 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:49:50.194101 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d5eb91e6-d2b9-4568-81fa-3f3335731b61 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:49:50.194538 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d5eb91e6-d2b9-4568-81fa-3f3335731b61 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:49:50.198334 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:49:50.340142 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-d5eb91e6-d2b9-4568-81fa-3f3335731b61 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c7a7d9566c4f0eb585c9bcb042f3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d1643804cc4a989c2bb72c2c416b10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:49:50.348678 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-d5eb91e6-d2b9-4568-81fa-3f3335731b61 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] 10.222.0.18 "GET /compute/v2.1/servers/776793d3-dc28-4511-a3d2-efe2f7f88c6f" status: 200 len: 1315 microversion: 2.1 time: 0.170159 Oct 22 21:49:50.349293 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3134/6238] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:49:50 2022] GET /compute/v2.1/servers/776793d3-dc28-4511-a3d2-efe2f7f88c6f => generated 1315 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:49:51.376836 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-d739d1bd-8496-42ba-b14f-d57f99469b63 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:49:51.377750 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-d739d1bd-8496-42ba-b14f-d57f99469b63 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] [instance: 776793d3-dc28-4511-a3d2-efe2f7f88c6f] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:49:51.386779 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d739d1bd-8496-42ba-b14f-d57f99469b63 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:49:51.387269 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d739d1bd-8496-42ba-b14f-d57f99469b63 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:49:51.387744 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d739d1bd-8496-42ba-b14f-d57f99469b63 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:49:51.388468 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d739d1bd-8496-42ba-b14f-d57f99469b63 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:49:51.388910 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d739d1bd-8496-42ba-b14f-d57f99469b63 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:49:51.389347 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d739d1bd-8496-42ba-b14f-d57f99469b63 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:49:51.535159 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-d739d1bd-8496-42ba-b14f-d57f99469b63 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c7a7d9566c4f0eb585c9bcb042f3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d1643804cc4a989c2bb72c2c416b10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:49:51.543609 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-d739d1bd-8496-42ba-b14f-d57f99469b63 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] 10.222.0.18 "GET /compute/v2.1/servers/776793d3-dc28-4511-a3d2-efe2f7f88c6f" status: 200 len: 1315 microversion: 2.1 time: 0.173582 Oct 22 21:49:51.544182 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3105/6239] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:49:51 2022] GET /compute/v2.1/servers/776793d3-dc28-4511-a3d2-efe2f7f88c6f => generated 1315 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:49:52.285614 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-eddcf1d6-fe91-412b-80e2-6bc2633eb028 req-4fe54ab8-f406-44a2-9f47-14e23d08a454 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "776793d3-dc28-4511-a3d2-efe2f7f88c6f", "name": "network-vif-plugged", "status": "completed", "tag": "8bd64564-8ebe-4198-8fac-2bd7697fb396"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:49:52.293238 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell0:SELECT=2 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:49:52.293963 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell0:SELECT=6 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:49:52.299993 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-eddcf1d6-fe91-412b-80e2-6bc2633eb028 req-4fe54ab8-f406-44a2-9f47-14e23d08a454 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:49:52.301759 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-eddcf1d6-fe91-412b-80e2-6bc2633eb028 req-4fe54ab8-f406-44a2-9f47-14e23d08a454 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:49:52.301759 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-eddcf1d6-fe91-412b-80e2-6bc2633eb028 req-4fe54ab8-f406-44a2-9f47-14e23d08a454 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:49:52.313911 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-eddcf1d6-fe91-412b-80e2-6bc2633eb028 req-4fe54ab8-f406-44a2-9f47-14e23d08a454 service nova] Creating event network-vif-plugged:8bd64564-8ebe-4198-8fac-2bd7697fb396 for instance 776793d3-dc28-4511-a3d2-efe2f7f88c6f on nch1-master-1 Oct 22 21:49:52.319028 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-eddcf1d6-fe91-412b-80e2-6bc2633eb028 req-4fe54ab8-f406-44a2-9f47-14e23d08a454 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037297 Oct 22 21:49:52.320053 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3135/6240] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:49:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:49:52.570522 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-d71b3f22-74cc-4795-940f-28f45c73ccd7 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:49:52.571619 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-d71b3f22-74cc-4795-940f-28f45c73ccd7 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] [instance: 776793d3-dc28-4511-a3d2-efe2f7f88c6f] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:49:52.583258 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d71b3f22-74cc-4795-940f-28f45c73ccd7 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:49:52.584130 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d71b3f22-74cc-4795-940f-28f45c73ccd7 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:49:52.584874 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d71b3f22-74cc-4795-940f-28f45c73ccd7 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:49:52.585778 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d71b3f22-74cc-4795-940f-28f45c73ccd7 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:49:52.586246 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d71b3f22-74cc-4795-940f-28f45c73ccd7 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:49:52.586681 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d71b3f22-74cc-4795-940f-28f45c73ccd7 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:49:52.719837 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-d71b3f22-74cc-4795-940f-28f45c73ccd7 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c7a7d9566c4f0eb585c9bcb042f3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d1643804cc4a989c2bb72c2c416b10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:49:52.728424 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-d71b3f22-74cc-4795-940f-28f45c73ccd7 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] 10.222.0.18 "GET /compute/v2.1/servers/776793d3-dc28-4511-a3d2-efe2f7f88c6f" status: 200 len: 1315 microversion: 2.1 time: 0.164600 Oct 22 21:49:52.728976 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3106/6241] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:49:52 2022] GET /compute/v2.1/servers/776793d3-dc28-4511-a3d2-efe2f7f88c6f => generated 1315 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:49:53.754658 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-b2058d56-d6ab-4e7b-9657-7d3d48230ddc tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:49:53.755417 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-b2058d56-d6ab-4e7b-9657-7d3d48230ddc tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] [instance: 776793d3-dc28-4511-a3d2-efe2f7f88c6f] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:49:53.762141 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b2058d56-d6ab-4e7b-9657-7d3d48230ddc tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:49:53.762651 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b2058d56-d6ab-4e7b-9657-7d3d48230ddc tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:49:53.763109 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b2058d56-d6ab-4e7b-9657-7d3d48230ddc tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:49:53.763869 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b2058d56-d6ab-4e7b-9657-7d3d48230ddc tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:49:53.764348 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b2058d56-d6ab-4e7b-9657-7d3d48230ddc tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:49:53.764797 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b2058d56-d6ab-4e7b-9657-7d3d48230ddc tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:49:53.908079 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-b2058d56-d6ab-4e7b-9657-7d3d48230ddc tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c7a7d9566c4f0eb585c9bcb042f3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d1643804cc4a989c2bb72c2c416b10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:49:53.916580 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-b2058d56-d6ab-4e7b-9657-7d3d48230ddc tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] 10.222.0.18 "GET /compute/v2.1/servers/776793d3-dc28-4511-a3d2-efe2f7f88c6f" status: 200 len: 1501 microversion: 2.1 time: 0.168650 Oct 22 21:49:53.917172 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3136/6242] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:49:53 2022] GET /compute/v2.1/servers/776793d3-dc28-4511-a3d2-efe2f7f88c6f => generated 1501 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:49:53.939120 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-f73a6b4f-006c-405b-8220-9ac12e883c9f tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:49:53.941437 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-f73a6b4f-006c-405b-8220-9ac12e883c9f tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] [instance: 776793d3-dc28-4511-a3d2-efe2f7f88c6f] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:49:53.943447 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell0:SELECT=2 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:49:53.949925 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f73a6b4f-006c-405b-8220-9ac12e883c9f tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:49:53.950424 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f73a6b4f-006c-405b-8220-9ac12e883c9f tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:49:53.950869 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f73a6b4f-006c-405b-8220-9ac12e883c9f tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:49:53.951606 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f73a6b4f-006c-405b-8220-9ac12e883c9f tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:49:53.952067 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f73a6b4f-006c-405b-8220-9ac12e883c9f tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:49:53.952481 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f73a6b4f-006c-405b-8220-9ac12e883c9f tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:49:53.981621 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-f73a6b4f-006c-405b-8220-9ac12e883c9f tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '82c7a7d9566c4f0eb585c9bcb042f3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d1643804cc4a989c2bb72c2c416b10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:49:53.987379 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-f73a6b4f-006c-405b-8220-9ac12e883c9f tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] [instance: 776793d3-dc28-4511-a3d2-efe2f7f88c6f] Old instance type m1.heat2, new instance type m1.heat {{(pid=138744) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 22 21:49:53.994426 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-f73a6b4f-006c-405b-8220-9ac12e883c9f tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Flavor limits 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 21:49:53.994850 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-f73a6b4f-006c-405b-8220-9ac12e883c9f tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Image limits 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 21:49:53.995374 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-f73a6b4f-006c-405b-8220-9ac12e883c9f tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Flavor pref 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 21:49:53.995782 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-f73a6b4f-006c-405b-8220-9ac12e883c9f tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Image pref 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 21:49:53.996197 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-f73a6b4f-006c-405b-8220-9ac12e883c9f tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 21:49:54.063816 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-f73a6b4f-006c-405b-8220-9ac12e883c9f tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] 10.222.0.18 "POST /compute/v2.1/servers/776793d3-dc28-4511-a3d2-efe2f7f88c6f/action" status: 202 len: 0 microversion: 2.1 time: 0.128547 Oct 22 21:49:54.064431 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3107/6243] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 21:49:53 2022] POST /compute/v2.1/servers/776793d3-dc28-4511-a3d2-efe2f7f88c6f/action => generated 0 bytes in 130 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 21:49:54.072811 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-398d519f-47ff-4185-b3ac-6a6d081344a6 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:49:54.073442 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-398d519f-47ff-4185-b3ac-6a6d081344a6 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] [instance: 776793d3-dc28-4511-a3d2-efe2f7f88c6f] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:49:54.079793 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-398d519f-47ff-4185-b3ac-6a6d081344a6 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:49:54.080295 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-398d519f-47ff-4185-b3ac-6a6d081344a6 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:49:54.080743 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-398d519f-47ff-4185-b3ac-6a6d081344a6 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:49:54.081458 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-398d519f-47ff-4185-b3ac-6a6d081344a6 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:49:54.081921 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-398d519f-47ff-4185-b3ac-6a6d081344a6 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:49:54.082364 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-398d519f-47ff-4185-b3ac-6a6d081344a6 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:49:54.217317 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-398d519f-47ff-4185-b3ac-6a6d081344a6 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c7a7d9566c4f0eb585c9bcb042f3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d1643804cc4a989c2bb72c2c416b10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:49:54.226159 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-398d519f-47ff-4185-b3ac-6a6d081344a6 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] 10.222.0.18 "GET /compute/v2.1/servers/776793d3-dc28-4511-a3d2-efe2f7f88c6f" status: 200 len: 1510 microversion: 2.1 time: 0.157162 Oct 22 21:49:54.226789 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3137/6244] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:49:54 2022] GET /compute/v2.1/servers/776793d3-dc28-4511-a3d2-efe2f7f88c6f => generated 1510 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:49:55.250812 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-7d67d6c2-7659-433e-a306-673cfa0c3689 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:49:55.251397 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-7d67d6c2-7659-433e-a306-673cfa0c3689 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] [instance: 776793d3-dc28-4511-a3d2-efe2f7f88c6f] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:49:55.258859 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7d67d6c2-7659-433e-a306-673cfa0c3689 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:49:55.259384 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7d67d6c2-7659-433e-a306-673cfa0c3689 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:49:55.259867 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7d67d6c2-7659-433e-a306-673cfa0c3689 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:49:55.260546 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7d67d6c2-7659-433e-a306-673cfa0c3689 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:49:55.261023 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7d67d6c2-7659-433e-a306-673cfa0c3689 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:49:55.261459 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7d67d6c2-7659-433e-a306-673cfa0c3689 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:49:55.401566 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-7d67d6c2-7659-433e-a306-673cfa0c3689 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c7a7d9566c4f0eb585c9bcb042f3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d1643804cc4a989c2bb72c2c416b10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:49:55.409818 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-7d67d6c2-7659-433e-a306-673cfa0c3689 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] 10.222.0.18 "GET /compute/v2.1/servers/776793d3-dc28-4511-a3d2-efe2f7f88c6f" status: 200 len: 1510 microversion: 2.1 time: 0.164168 Oct 22 21:49:55.410498 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3108/6245] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:49:55 2022] GET /compute/v2.1/servers/776793d3-dc28-4511-a3d2-efe2f7f88c6f => generated 1510 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:49:56.435075 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-5119cf84-8eab-4a0a-9617-5737908486c0 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:49:56.435719 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-5119cf84-8eab-4a0a-9617-5737908486c0 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] [instance: 776793d3-dc28-4511-a3d2-efe2f7f88c6f] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:49:56.442966 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5119cf84-8eab-4a0a-9617-5737908486c0 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:49:56.443509 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5119cf84-8eab-4a0a-9617-5737908486c0 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:49:56.443973 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5119cf84-8eab-4a0a-9617-5737908486c0 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:49:56.444683 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5119cf84-8eab-4a0a-9617-5737908486c0 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:49:56.445150 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5119cf84-8eab-4a0a-9617-5737908486c0 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:49:56.445589 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5119cf84-8eab-4a0a-9617-5737908486c0 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:49:56.595366 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-5119cf84-8eab-4a0a-9617-5737908486c0 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c7a7d9566c4f0eb585c9bcb042f3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d1643804cc4a989c2bb72c2c416b10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:49:56.604003 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-5119cf84-8eab-4a0a-9617-5737908486c0 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] 10.222.0.18 "GET /compute/v2.1/servers/776793d3-dc28-4511-a3d2-efe2f7f88c6f" status: 200 len: 1515 microversion: 2.1 time: 0.173112 Oct 22 21:49:56.604596 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3138/6246] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:49:56 2022] GET /compute/v2.1/servers/776793d3-dc28-4511-a3d2-efe2f7f88c6f => generated 1515 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:49:57.636436 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-98423854-5792-49f1-958b-9cdbd049eae8 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:49:57.637140 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-98423854-5792-49f1-958b-9cdbd049eae8 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] [instance: 776793d3-dc28-4511-a3d2-efe2f7f88c6f] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:49:57.644731 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-98423854-5792-49f1-958b-9cdbd049eae8 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:49:57.645230 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-98423854-5792-49f1-958b-9cdbd049eae8 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:49:57.645676 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-98423854-5792-49f1-958b-9cdbd049eae8 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:49:57.646394 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-98423854-5792-49f1-958b-9cdbd049eae8 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:49:57.646859 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-98423854-5792-49f1-958b-9cdbd049eae8 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:49:57.647299 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-98423854-5792-49f1-958b-9cdbd049eae8 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:49:57.786762 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-98423854-5792-49f1-958b-9cdbd049eae8 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c7a7d9566c4f0eb585c9bcb042f3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d1643804cc4a989c2bb72c2c416b10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:49:57.794929 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-98423854-5792-49f1-958b-9cdbd049eae8 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] 10.222.0.18 "GET /compute/v2.1/servers/776793d3-dc28-4511-a3d2-efe2f7f88c6f" status: 200 len: 1515 microversion: 2.1 time: 0.162663 Oct 22 21:49:57.795549 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3109/6247] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:49:57 2022] GET /compute/v2.1/servers/776793d3-dc28-4511-a3d2-efe2f7f88c6f => generated 1515 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:49:58.817826 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-85245925-f3f8-4c5d-b969-d3d9585afff8 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:49:58.818456 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-85245925-f3f8-4c5d-b969-d3d9585afff8 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] [instance: 776793d3-dc28-4511-a3d2-efe2f7f88c6f] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:49:58.827463 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-85245925-f3f8-4c5d-b969-d3d9585afff8 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:49:58.828097 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-85245925-f3f8-4c5d-b969-d3d9585afff8 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:49:58.828582 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-85245925-f3f8-4c5d-b969-d3d9585afff8 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:49:58.829339 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-85245925-f3f8-4c5d-b969-d3d9585afff8 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:49:58.829840 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-85245925-f3f8-4c5d-b969-d3d9585afff8 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:49:58.830288 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-85245925-f3f8-4c5d-b969-d3d9585afff8 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:49:58.966357 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-85245925-f3f8-4c5d-b969-d3d9585afff8 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c7a7d9566c4f0eb585c9bcb042f3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d1643804cc4a989c2bb72c2c416b10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:49:58.975226 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-85245925-f3f8-4c5d-b969-d3d9585afff8 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] 10.222.0.18 "GET /compute/v2.1/servers/776793d3-dc28-4511-a3d2-efe2f7f88c6f" status: 200 len: 1515 microversion: 2.1 time: 0.161427 Oct 22 21:49:58.975852 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3139/6248] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:49:58 2022] GET /compute/v2.1/servers/776793d3-dc28-4511-a3d2-efe2f7f88c6f => generated 1515 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:50:00.003039 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-b1af3bf0-402c-47da-881d-a8301de1d784 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:50:00.004142 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-b1af3bf0-402c-47da-881d-a8301de1d784 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] [instance: 776793d3-dc28-4511-a3d2-efe2f7f88c6f] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:50:00.016038 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b1af3bf0-402c-47da-881d-a8301de1d784 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:50:00.016863 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b1af3bf0-402c-47da-881d-a8301de1d784 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:50:00.017794 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b1af3bf0-402c-47da-881d-a8301de1d784 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:50:00.019067 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b1af3bf0-402c-47da-881d-a8301de1d784 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:50:00.019931 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b1af3bf0-402c-47da-881d-a8301de1d784 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:50:00.020652 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b1af3bf0-402c-47da-881d-a8301de1d784 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:50:00.169250 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-b1af3bf0-402c-47da-881d-a8301de1d784 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c7a7d9566c4f0eb585c9bcb042f3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d1643804cc4a989c2bb72c2c416b10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:50:00.177435 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-b1af3bf0-402c-47da-881d-a8301de1d784 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] 10.222.0.18 "GET /compute/v2.1/servers/776793d3-dc28-4511-a3d2-efe2f7f88c6f" status: 200 len: 1515 microversion: 2.1 time: 0.181273 Oct 22 21:50:00.178012 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3110/6249] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:49:59 2022] GET /compute/v2.1/servers/776793d3-dc28-4511-a3d2-efe2f7f88c6f => generated 1515 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:50:01.205192 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-927791c3-c738-4d67-937b-3ca33e5835a1 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:50:01.206196 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-927791c3-c738-4d67-937b-3ca33e5835a1 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] [instance: 776793d3-dc28-4511-a3d2-efe2f7f88c6f] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:50:01.218806 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-927791c3-c738-4d67-937b-3ca33e5835a1 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:50:01.219745 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-927791c3-c738-4d67-937b-3ca33e5835a1 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:50:01.220643 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-927791c3-c738-4d67-937b-3ca33e5835a1 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:50:01.221877 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-927791c3-c738-4d67-937b-3ca33e5835a1 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:50:01.222815 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-927791c3-c738-4d67-937b-3ca33e5835a1 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:50:01.223638 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-927791c3-c738-4d67-937b-3ca33e5835a1 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:50:01.369695 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-927791c3-c738-4d67-937b-3ca33e5835a1 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c7a7d9566c4f0eb585c9bcb042f3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d1643804cc4a989c2bb72c2c416b10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:50:01.378733 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-927791c3-c738-4d67-937b-3ca33e5835a1 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] 10.222.0.18 "GET /compute/v2.1/servers/776793d3-dc28-4511-a3d2-efe2f7f88c6f" status: 200 len: 1515 microversion: 2.1 time: 0.180384 Oct 22 21:50:01.379489 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3140/6250] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:50:01 2022] GET /compute/v2.1/servers/776793d3-dc28-4511-a3d2-efe2f7f88c6f => generated 1515 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:50:02.402552 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-a56c74c1-791e-4ff3-8ade-8e5b494e43a3 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:50:02.403719 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-a56c74c1-791e-4ff3-8ade-8e5b494e43a3 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] [instance: 776793d3-dc28-4511-a3d2-efe2f7f88c6f] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:50:02.410822 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a56c74c1-791e-4ff3-8ade-8e5b494e43a3 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:50:02.411312 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a56c74c1-791e-4ff3-8ade-8e5b494e43a3 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:50:02.411790 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a56c74c1-791e-4ff3-8ade-8e5b494e43a3 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:50:02.412485 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a56c74c1-791e-4ff3-8ade-8e5b494e43a3 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:50:02.412938 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a56c74c1-791e-4ff3-8ade-8e5b494e43a3 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:50:02.413352 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a56c74c1-791e-4ff3-8ade-8e5b494e43a3 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:50:02.553694 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-a56c74c1-791e-4ff3-8ade-8e5b494e43a3 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c7a7d9566c4f0eb585c9bcb042f3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d1643804cc4a989c2bb72c2c416b10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:50:02.565908 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-a56c74c1-791e-4ff3-8ade-8e5b494e43a3 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] 10.222.0.18 "GET /compute/v2.1/servers/776793d3-dc28-4511-a3d2-efe2f7f88c6f" status: 200 len: 1515 microversion: 2.1 time: 0.167361 Oct 22 21:50:02.566704 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3111/6251] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:50:02 2022] GET /compute/v2.1/servers/776793d3-dc28-4511-a3d2-efe2f7f88c6f => generated 1515 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:50:03.592333 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-0535b59f-f644-474c-991f-b3832a48cb08 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:50:03.592948 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-0535b59f-f644-474c-991f-b3832a48cb08 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] [instance: 776793d3-dc28-4511-a3d2-efe2f7f88c6f] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:50:03.601108 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0535b59f-f644-474c-991f-b3832a48cb08 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:50:03.601651 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0535b59f-f644-474c-991f-b3832a48cb08 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:50:03.602207 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0535b59f-f644-474c-991f-b3832a48cb08 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:50:03.603054 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0535b59f-f644-474c-991f-b3832a48cb08 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:50:03.603595 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0535b59f-f644-474c-991f-b3832a48cb08 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:50:03.604069 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0535b59f-f644-474c-991f-b3832a48cb08 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:50:03.748330 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-0535b59f-f644-474c-991f-b3832a48cb08 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c7a7d9566c4f0eb585c9bcb042f3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d1643804cc4a989c2bb72c2c416b10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:50:03.756956 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-0535b59f-f644-474c-991f-b3832a48cb08 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] 10.222.0.18 "GET /compute/v2.1/servers/776793d3-dc28-4511-a3d2-efe2f7f88c6f" status: 200 len: 1515 microversion: 2.1 time: 0.168939 Oct 22 21:50:03.757531 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3141/6252] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:50:03 2022] GET /compute/v2.1/servers/776793d3-dc28-4511-a3d2-efe2f7f88c6f => generated 1515 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:50:04.787524 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-4f27fec9-1064-4834-900e-76e7440def60 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:50:04.788158 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-4f27fec9-1064-4834-900e-76e7440def60 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] [instance: 776793d3-dc28-4511-a3d2-efe2f7f88c6f] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:50:04.795760 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4f27fec9-1064-4834-900e-76e7440def60 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:50:04.796259 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4f27fec9-1064-4834-900e-76e7440def60 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:50:04.796706 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4f27fec9-1064-4834-900e-76e7440def60 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:50:04.797408 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4f27fec9-1064-4834-900e-76e7440def60 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:50:04.797848 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4f27fec9-1064-4834-900e-76e7440def60 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:50:04.798309 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4f27fec9-1064-4834-900e-76e7440def60 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:50:04.935207 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-4f27fec9-1064-4834-900e-76e7440def60 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c7a7d9566c4f0eb585c9bcb042f3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d1643804cc4a989c2bb72c2c416b10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:50:04.943462 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-4f27fec9-1064-4834-900e-76e7440def60 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] 10.222.0.18 "GET /compute/v2.1/servers/776793d3-dc28-4511-a3d2-efe2f7f88c6f" status: 200 len: 1515 microversion: 2.1 time: 0.159933 Oct 22 21:50:04.944051 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3112/6253] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:50:04 2022] GET /compute/v2.1/servers/776793d3-dc28-4511-a3d2-efe2f7f88c6f => generated 1515 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:50:05.967261 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-e13180a6-d4bc-4b67-abed-733a0629e083 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:50:05.967918 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-e13180a6-d4bc-4b67-abed-733a0629e083 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] [instance: 776793d3-dc28-4511-a3d2-efe2f7f88c6f] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:50:05.975793 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e13180a6-d4bc-4b67-abed-733a0629e083 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:50:05.976299 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e13180a6-d4bc-4b67-abed-733a0629e083 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:50:05.976759 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e13180a6-d4bc-4b67-abed-733a0629e083 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:50:05.977480 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e13180a6-d4bc-4b67-abed-733a0629e083 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:50:05.977955 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e13180a6-d4bc-4b67-abed-733a0629e083 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:50:05.978402 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e13180a6-d4bc-4b67-abed-733a0629e083 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:50:06.126083 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-e13180a6-d4bc-4b67-abed-733a0629e083 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c7a7d9566c4f0eb585c9bcb042f3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d1643804cc4a989c2bb72c2c416b10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:50:06.134291 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-e13180a6-d4bc-4b67-abed-733a0629e083 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] 10.222.0.18 "GET /compute/v2.1/servers/776793d3-dc28-4511-a3d2-efe2f7f88c6f" status: 200 len: 1515 microversion: 2.1 time: 0.171084 Oct 22 21:50:06.134869 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3142/6254] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:50:05 2022] GET /compute/v2.1/servers/776793d3-dc28-4511-a3d2-efe2f7f88c6f => generated 1515 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:50:07.161808 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-3b6e413d-17fc-4746-b8bd-7b48a5826675 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:50:07.162800 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-3b6e413d-17fc-4746-b8bd-7b48a5826675 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] [instance: 776793d3-dc28-4511-a3d2-efe2f7f88c6f] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:50:07.170899 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3b6e413d-17fc-4746-b8bd-7b48a5826675 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:50:07.171445 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3b6e413d-17fc-4746-b8bd-7b48a5826675 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:50:07.171911 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3b6e413d-17fc-4746-b8bd-7b48a5826675 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:50:07.172644 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3b6e413d-17fc-4746-b8bd-7b48a5826675 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:50:07.173101 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3b6e413d-17fc-4746-b8bd-7b48a5826675 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:50:07.173530 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3b6e413d-17fc-4746-b8bd-7b48a5826675 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:50:07.325263 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-3b6e413d-17fc-4746-b8bd-7b48a5826675 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c7a7d9566c4f0eb585c9bcb042f3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d1643804cc4a989c2bb72c2c416b10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:50:07.337539 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-3b6e413d-17fc-4746-b8bd-7b48a5826675 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] 10.222.0.18 "GET /compute/v2.1/servers/776793d3-dc28-4511-a3d2-efe2f7f88c6f" status: 200 len: 1515 microversion: 2.1 time: 0.182106 Oct 22 21:50:07.338141 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3113/6255] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:50:07 2022] GET /compute/v2.1/servers/776793d3-dc28-4511-a3d2-efe2f7f88c6f => generated 1515 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:50:08.365365 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-58795274-8b1e-43f2-b78f-e736f3607629 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:50:08.366350 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-58795274-8b1e-43f2-b78f-e736f3607629 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] [instance: 776793d3-dc28-4511-a3d2-efe2f7f88c6f] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:50:08.374396 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-58795274-8b1e-43f2-b78f-e736f3607629 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:50:08.374894 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-58795274-8b1e-43f2-b78f-e736f3607629 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:50:08.375372 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-58795274-8b1e-43f2-b78f-e736f3607629 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:50:08.376077 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-58795274-8b1e-43f2-b78f-e736f3607629 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:50:08.376548 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-58795274-8b1e-43f2-b78f-e736f3607629 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:50:08.376985 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-58795274-8b1e-43f2-b78f-e736f3607629 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:50:08.518492 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-58795274-8b1e-43f2-b78f-e736f3607629 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c7a7d9566c4f0eb585c9bcb042f3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d1643804cc4a989c2bb72c2c416b10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:50:08.526710 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-58795274-8b1e-43f2-b78f-e736f3607629 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] 10.222.0.18 "GET /compute/v2.1/servers/776793d3-dc28-4511-a3d2-efe2f7f88c6f" status: 200 len: 1515 microversion: 2.1 time: 0.168008 Oct 22 21:50:08.527287 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3143/6256] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:50:08 2022] GET /compute/v2.1/servers/776793d3-dc28-4511-a3d2-efe2f7f88c6f => generated 1515 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:50:09.554190 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-20abf4f2-4873-4b29-869a-980046ff8dcc tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:50:09.556300 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-20abf4f2-4873-4b29-869a-980046ff8dcc tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] [instance: 776793d3-dc28-4511-a3d2-efe2f7f88c6f] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:50:09.564216 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-20abf4f2-4873-4b29-869a-980046ff8dcc tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:50:09.564884 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-20abf4f2-4873-4b29-869a-980046ff8dcc tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:50:09.565504 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-20abf4f2-4873-4b29-869a-980046ff8dcc tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:50:09.566884 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-20abf4f2-4873-4b29-869a-980046ff8dcc tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:50:09.567500 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-20abf4f2-4873-4b29-869a-980046ff8dcc tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:50:09.568132 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-20abf4f2-4873-4b29-869a-980046ff8dcc tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:50:09.727714 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-20abf4f2-4873-4b29-869a-980046ff8dcc tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c7a7d9566c4f0eb585c9bcb042f3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d1643804cc4a989c2bb72c2c416b10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:50:09.739303 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-20abf4f2-4873-4b29-869a-980046ff8dcc tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] 10.222.0.18 "GET /compute/v2.1/servers/776793d3-dc28-4511-a3d2-efe2f7f88c6f" status: 200 len: 1515 microversion: 2.1 time: 0.191590 Oct 22 21:50:09.739942 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3114/6257] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:50:09 2022] GET /compute/v2.1/servers/776793d3-dc28-4511-a3d2-efe2f7f88c6f => generated 1515 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:50:10.765257 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-2e031c6e-67fa-4f2a-b47d-dffaa281639a tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:50:10.765897 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-2e031c6e-67fa-4f2a-b47d-dffaa281639a tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] [instance: 776793d3-dc28-4511-a3d2-efe2f7f88c6f] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:50:10.773440 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2e031c6e-67fa-4f2a-b47d-dffaa281639a tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:50:10.773950 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2e031c6e-67fa-4f2a-b47d-dffaa281639a tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:50:10.774406 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2e031c6e-67fa-4f2a-b47d-dffaa281639a tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:50:10.775251 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2e031c6e-67fa-4f2a-b47d-dffaa281639a tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:50:10.775938 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2e031c6e-67fa-4f2a-b47d-dffaa281639a tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:50:10.776391 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2e031c6e-67fa-4f2a-b47d-dffaa281639a tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:50:10.916439 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-2e031c6e-67fa-4f2a-b47d-dffaa281639a tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c7a7d9566c4f0eb585c9bcb042f3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d1643804cc4a989c2bb72c2c416b10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:50:10.924953 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-2e031c6e-67fa-4f2a-b47d-dffaa281639a tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] 10.222.0.18 "GET /compute/v2.1/servers/776793d3-dc28-4511-a3d2-efe2f7f88c6f" status: 200 len: 1515 microversion: 2.1 time: 0.163951 Oct 22 21:50:10.925578 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3144/6258] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:50:10 2022] GET /compute/v2.1/servers/776793d3-dc28-4511-a3d2-efe2f7f88c6f => generated 1515 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:50:11.960923 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-348be3e0-839e-4a2b-be06-04233286e85b tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:50:11.961928 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-348be3e0-839e-4a2b-be06-04233286e85b tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] [instance: 776793d3-dc28-4511-a3d2-efe2f7f88c6f] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:50:11.970131 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-348be3e0-839e-4a2b-be06-04233286e85b tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:50:11.970615 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-348be3e0-839e-4a2b-be06-04233286e85b tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:50:11.971053 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-348be3e0-839e-4a2b-be06-04233286e85b tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:50:11.971811 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-348be3e0-839e-4a2b-be06-04233286e85b tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:50:11.972267 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-348be3e0-839e-4a2b-be06-04233286e85b tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:50:11.972710 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-348be3e0-839e-4a2b-be06-04233286e85b tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:50:12.105808 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-348be3e0-839e-4a2b-be06-04233286e85b tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c7a7d9566c4f0eb585c9bcb042f3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d1643804cc4a989c2bb72c2c416b10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:50:12.113773 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-348be3e0-839e-4a2b-be06-04233286e85b tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] 10.222.0.18 "GET /compute/v2.1/servers/776793d3-dc28-4511-a3d2-efe2f7f88c6f" status: 200 len: 1515 microversion: 2.1 time: 0.159398 Oct 22 21:50:12.114350 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3115/6259] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:50:11 2022] GET /compute/v2.1/servers/776793d3-dc28-4511-a3d2-efe2f7f88c6f => generated 1515 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:50:13.141768 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-b37d4c67-5f9c-43ea-9275-266e9e715dfc tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:50:13.142670 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-b37d4c67-5f9c-43ea-9275-266e9e715dfc tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] [instance: 776793d3-dc28-4511-a3d2-efe2f7f88c6f] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:50:13.154596 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b37d4c67-5f9c-43ea-9275-266e9e715dfc tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:50:13.155464 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b37d4c67-5f9c-43ea-9275-266e9e715dfc tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:50:13.156243 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b37d4c67-5f9c-43ea-9275-266e9e715dfc tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:50:13.157417 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b37d4c67-5f9c-43ea-9275-266e9e715dfc tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:50:13.158204 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b37d4c67-5f9c-43ea-9275-266e9e715dfc tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:50:13.158946 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b37d4c67-5f9c-43ea-9275-266e9e715dfc tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:50:13.306770 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-b37d4c67-5f9c-43ea-9275-266e9e715dfc tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c7a7d9566c4f0eb585c9bcb042f3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d1643804cc4a989c2bb72c2c416b10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:50:13.315194 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-b37d4c67-5f9c-43ea-9275-266e9e715dfc tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] 10.222.0.18 "GET /compute/v2.1/servers/776793d3-dc28-4511-a3d2-efe2f7f88c6f" status: 200 len: 1515 microversion: 2.1 time: 0.180552 Oct 22 21:50:13.315813 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3145/6260] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:50:13 2022] GET /compute/v2.1/servers/776793d3-dc28-4511-a3d2-efe2f7f88c6f => generated 1515 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:50:14.343572 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-d69bf90f-7022-4921-a7f7-1b399250768e tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:50:14.344562 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-d69bf90f-7022-4921-a7f7-1b399250768e tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] [instance: 776793d3-dc28-4511-a3d2-efe2f7f88c6f] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:50:14.356414 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d69bf90f-7022-4921-a7f7-1b399250768e tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:50:14.357221 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d69bf90f-7022-4921-a7f7-1b399250768e tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:50:14.358204 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d69bf90f-7022-4921-a7f7-1b399250768e tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:50:14.359406 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d69bf90f-7022-4921-a7f7-1b399250768e tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:50:14.360155 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d69bf90f-7022-4921-a7f7-1b399250768e tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:50:14.360846 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d69bf90f-7022-4921-a7f7-1b399250768e tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:50:14.503088 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-d69bf90f-7022-4921-a7f7-1b399250768e tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c7a7d9566c4f0eb585c9bcb042f3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d1643804cc4a989c2bb72c2c416b10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:50:14.511779 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-d69bf90f-7022-4921-a7f7-1b399250768e tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] 10.222.0.18 "GET /compute/v2.1/servers/776793d3-dc28-4511-a3d2-efe2f7f88c6f" status: 200 len: 1515 microversion: 2.1 time: 0.175171 Oct 22 21:50:14.512353 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3116/6261] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:50:14 2022] GET /compute/v2.1/servers/776793d3-dc28-4511-a3d2-efe2f7f88c6f => generated 1515 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:50:15.537762 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-dfb4cdd8-1f50-4b1d-9851-ced1b7ea6d89 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:50:15.538460 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-dfb4cdd8-1f50-4b1d-9851-ced1b7ea6d89 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] [instance: 776793d3-dc28-4511-a3d2-efe2f7f88c6f] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:50:15.546739 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-dfb4cdd8-1f50-4b1d-9851-ced1b7ea6d89 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:50:15.547291 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-dfb4cdd8-1f50-4b1d-9851-ced1b7ea6d89 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:50:15.547837 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-dfb4cdd8-1f50-4b1d-9851-ced1b7ea6d89 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:50:15.548626 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-dfb4cdd8-1f50-4b1d-9851-ced1b7ea6d89 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:50:15.549152 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-dfb4cdd8-1f50-4b1d-9851-ced1b7ea6d89 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:50:15.549644 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-dfb4cdd8-1f50-4b1d-9851-ced1b7ea6d89 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:50:15.695674 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-dfb4cdd8-1f50-4b1d-9851-ced1b7ea6d89 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c7a7d9566c4f0eb585c9bcb042f3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d1643804cc4a989c2bb72c2c416b10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:50:15.707576 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-dfb4cdd8-1f50-4b1d-9851-ced1b7ea6d89 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] 10.222.0.18 "GET /compute/v2.1/servers/776793d3-dc28-4511-a3d2-efe2f7f88c6f" status: 200 len: 1515 microversion: 2.1 time: 0.174559 Oct 22 21:50:15.708232 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3146/6262] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:50:15 2022] GET /compute/v2.1/servers/776793d3-dc28-4511-a3d2-efe2f7f88c6f => generated 1515 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:50:16.739327 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-0fab1fbe-b327-422a-963f-654810a8bc59 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:50:16.740576 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-0fab1fbe-b327-422a-963f-654810a8bc59 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] [instance: 776793d3-dc28-4511-a3d2-efe2f7f88c6f] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:50:16.751676 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0fab1fbe-b327-422a-963f-654810a8bc59 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:50:16.752316 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0fab1fbe-b327-422a-963f-654810a8bc59 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:50:16.753000 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0fab1fbe-b327-422a-963f-654810a8bc59 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:50:16.754065 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0fab1fbe-b327-422a-963f-654810a8bc59 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:50:16.755490 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0fab1fbe-b327-422a-963f-654810a8bc59 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:50:16.755490 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0fab1fbe-b327-422a-963f-654810a8bc59 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:50:16.759491 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:50:16.900681 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-0fab1fbe-b327-422a-963f-654810a8bc59 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c7a7d9566c4f0eb585c9bcb042f3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d1643804cc4a989c2bb72c2c416b10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:50:16.909207 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-0fab1fbe-b327-422a-963f-654810a8bc59 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] 10.222.0.18 "GET /compute/v2.1/servers/776793d3-dc28-4511-a3d2-efe2f7f88c6f" status: 200 len: 1515 microversion: 2.1 time: 0.175943 Oct 22 21:50:16.909764 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3117/6263] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:50:16 2022] GET /compute/v2.1/servers/776793d3-dc28-4511-a3d2-efe2f7f88c6f => generated 1515 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:50:17.934603 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-2e1c8f78-8793-48ca-b7a0-e7fbda696101 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:50:17.935311 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-2e1c8f78-8793-48ca-b7a0-e7fbda696101 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] [instance: 776793d3-dc28-4511-a3d2-efe2f7f88c6f] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:50:17.942787 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2e1c8f78-8793-48ca-b7a0-e7fbda696101 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:50:17.943329 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2e1c8f78-8793-48ca-b7a0-e7fbda696101 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:50:17.943813 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2e1c8f78-8793-48ca-b7a0-e7fbda696101 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:50:17.944558 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2e1c8f78-8793-48ca-b7a0-e7fbda696101 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:50:17.945040 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2e1c8f78-8793-48ca-b7a0-e7fbda696101 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:50:17.945482 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2e1c8f78-8793-48ca-b7a0-e7fbda696101 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:50:18.081523 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-2e1c8f78-8793-48ca-b7a0-e7fbda696101 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c7a7d9566c4f0eb585c9bcb042f3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d1643804cc4a989c2bb72c2c416b10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:50:18.089573 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-2e1c8f78-8793-48ca-b7a0-e7fbda696101 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] 10.222.0.18 "GET /compute/v2.1/servers/776793d3-dc28-4511-a3d2-efe2f7f88c6f" status: 200 len: 1515 microversion: 2.1 time: 0.159159 Oct 22 21:50:18.090145 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3147/6264] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:50:17 2022] GET /compute/v2.1/servers/776793d3-dc28-4511-a3d2-efe2f7f88c6f => generated 1515 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:50:19.114381 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-30cf6a91-08cd-4e4b-a033-3df65a52753f tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:50:19.115059 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-30cf6a91-08cd-4e4b-a033-3df65a52753f tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] [instance: 776793d3-dc28-4511-a3d2-efe2f7f88c6f] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:50:19.119143 ncdv-master-1 devstack@n-api.service[138744]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 22 21:50:19.119327 ncdv-master-1 devstack@n-api.service[138744]: Sat Oct 22 21:50:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/776793d3-dc28-4511-a3d2-efe2f7f88c6f (ip 10.222.0.18) !!! Oct 22 21:50:19.120694 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_api:SELECT=32 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:50:19.129841 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-30cf6a91-08cd-4e4b-a033-3df65a52753f tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:50:19.130505 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-30cf6a91-08cd-4e4b-a033-3df65a52753f tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:50:19.131111 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-30cf6a91-08cd-4e4b-a033-3df65a52753f tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:50:19.132122 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-30cf6a91-08cd-4e4b-a033-3df65a52753f tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:50:19.132749 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-30cf6a91-08cd-4e4b-a033-3df65a52753f tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:50:19.133346 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-30cf6a91-08cd-4e4b-a033-3df65a52753f tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:50:19.267820 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-30cf6a91-08cd-4e4b-a033-3df65a52753f tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c7a7d9566c4f0eb585c9bcb042f3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d1643804cc4a989c2bb72c2c416b10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:50:19.276126 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-30cf6a91-08cd-4e4b-a033-3df65a52753f tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] 10.222.0.18 "GET /compute/v2.1/servers/776793d3-dc28-4511-a3d2-efe2f7f88c6f" status: 200 len: 1515 microversion: 2.1 time: 0.167072 Oct 22 21:50:19.276727 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3118/6265] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:50:19 2022] GET /compute/v2.1/servers/776793d3-dc28-4511-a3d2-efe2f7f88c6f => generated 1515 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:50:20.302441 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-657e73bd-b5da-4313-9dc2-2d30c84cb9da tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:50:20.303140 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-657e73bd-b5da-4313-9dc2-2d30c84cb9da tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] [instance: 776793d3-dc28-4511-a3d2-efe2f7f88c6f] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:50:20.308449 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_api:SELECT=28 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:50:20.315385 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-657e73bd-b5da-4313-9dc2-2d30c84cb9da tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:50:20.315906 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-657e73bd-b5da-4313-9dc2-2d30c84cb9da tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:50:20.316355 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-657e73bd-b5da-4313-9dc2-2d30c84cb9da tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:50:20.317256 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-657e73bd-b5da-4313-9dc2-2d30c84cb9da tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:50:20.317729 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-657e73bd-b5da-4313-9dc2-2d30c84cb9da tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:50:20.318170 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-657e73bd-b5da-4313-9dc2-2d30c84cb9da tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:50:20.321026 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell1:SELECT=80 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:50:20.459079 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-657e73bd-b5da-4313-9dc2-2d30c84cb9da tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c7a7d9566c4f0eb585c9bcb042f3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d1643804cc4a989c2bb72c2c416b10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:50:20.472034 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-657e73bd-b5da-4313-9dc2-2d30c84cb9da tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] 10.222.0.18 "GET /compute/v2.1/servers/776793d3-dc28-4511-a3d2-efe2f7f88c6f" status: 200 len: 1515 microversion: 2.1 time: 0.175282 Oct 22 21:50:20.472834 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3148/6266] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:50:20 2022] GET /compute/v2.1/servers/776793d3-dc28-4511-a3d2-efe2f7f88c6f => generated 1515 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:50:21.501324 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-60eba845-7e1f-442b-9bb2-2f478f53e542 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:50:21.501967 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-60eba845-7e1f-442b-9bb2-2f478f53e542 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] [instance: 776793d3-dc28-4511-a3d2-efe2f7f88c6f] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:50:21.509819 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-60eba845-7e1f-442b-9bb2-2f478f53e542 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:50:21.510340 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-60eba845-7e1f-442b-9bb2-2f478f53e542 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:50:21.510803 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-60eba845-7e1f-442b-9bb2-2f478f53e542 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:50:21.511572 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-60eba845-7e1f-442b-9bb2-2f478f53e542 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:50:21.512083 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-60eba845-7e1f-442b-9bb2-2f478f53e542 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:50:21.512542 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-60eba845-7e1f-442b-9bb2-2f478f53e542 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:50:21.998571 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-60eba845-7e1f-442b-9bb2-2f478f53e542 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c7a7d9566c4f0eb585c9bcb042f3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d1643804cc4a989c2bb72c2c416b10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:50:22.007215 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-60eba845-7e1f-442b-9bb2-2f478f53e542 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] 10.222.0.18 "GET /compute/v2.1/servers/776793d3-dc28-4511-a3d2-efe2f7f88c6f" status: 200 len: 1515 microversion: 2.1 time: 0.510864 Oct 22 21:50:22.007835 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3119/6267] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:50:21 2022] GET /compute/v2.1/servers/776793d3-dc28-4511-a3d2-efe2f7f88c6f => generated 1515 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:50:23.033147 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-64f7d1fc-8804-4904-ad63-5dd2779a3361 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:50:23.033784 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-64f7d1fc-8804-4904-ad63-5dd2779a3361 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] [instance: 776793d3-dc28-4511-a3d2-efe2f7f88c6f] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:50:23.040582 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-64f7d1fc-8804-4904-ad63-5dd2779a3361 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:50:23.041078 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-64f7d1fc-8804-4904-ad63-5dd2779a3361 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:50:23.041557 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-64f7d1fc-8804-4904-ad63-5dd2779a3361 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:50:23.042226 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-64f7d1fc-8804-4904-ad63-5dd2779a3361 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:50:23.042725 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-64f7d1fc-8804-4904-ad63-5dd2779a3361 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:50:23.043157 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-64f7d1fc-8804-4904-ad63-5dd2779a3361 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:50:23.175107 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-64f7d1fc-8804-4904-ad63-5dd2779a3361 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c7a7d9566c4f0eb585c9bcb042f3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d1643804cc4a989c2bb72c2c416b10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:50:23.183171 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-64f7d1fc-8804-4904-ad63-5dd2779a3361 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] 10.222.0.18 "GET /compute/v2.1/servers/776793d3-dc28-4511-a3d2-efe2f7f88c6f" status: 200 len: 1515 microversion: 2.1 time: 0.154572 Oct 22 21:50:23.183782 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3149/6268] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:50:23 2022] GET /compute/v2.1/servers/776793d3-dc28-4511-a3d2-efe2f7f88c6f => generated 1515 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:50:23.753359 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-bf9c902b-6945-4952-8365-c7a880b1248f req-42db7325-18b7-4515-af54-389bb760567b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "776793d3-dc28-4511-a3d2-efe2f7f88c6f", "name": "network-vif-unplugged", "status": "completed", "tag": "8bd64564-8ebe-4198-8fac-2bd7697fb396"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:50:23.764224 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-bf9c902b-6945-4952-8365-c7a880b1248f req-42db7325-18b7-4515-af54-389bb760567b service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:50:23.764905 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-bf9c902b-6945-4952-8365-c7a880b1248f req-42db7325-18b7-4515-af54-389bb760567b service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:50:23.765403 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-bf9c902b-6945-4952-8365-c7a880b1248f req-42db7325-18b7-4515-af54-389bb760567b service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:50:23.778867 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-bf9c902b-6945-4952-8365-c7a880b1248f req-42db7325-18b7-4515-af54-389bb760567b service nova] Creating event network-vif-unplugged:8bd64564-8ebe-4198-8fac-2bd7697fb396 for instance 776793d3-dc28-4511-a3d2-efe2f7f88c6f on nch2-master-1 Oct 22 21:50:23.786067 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [req-bf9c902b-6945-4952-8365-c7a880b1248f req-42db7325-18b7-4515-af54-389bb760567b service nova] Instance 776793d3-dc28-4511-a3d2-efe2f7f88c6f is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=138744) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 22 21:50:23.799071 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-bf9c902b-6945-4952-8365-c7a880b1248f req-42db7325-18b7-4515-af54-389bb760567b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049465 Oct 22 21:50:23.799723 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3120/6269] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:50:23 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:50:24.207641 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-73289a0d-33ed-4635-be7a-da15d8c49cf9 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:50:24.208269 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-73289a0d-33ed-4635-be7a-da15d8c49cf9 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] [instance: 776793d3-dc28-4511-a3d2-efe2f7f88c6f] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:50:24.215652 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-73289a0d-33ed-4635-be7a-da15d8c49cf9 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:50:24.216210 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-73289a0d-33ed-4635-be7a-da15d8c49cf9 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:50:24.216888 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-73289a0d-33ed-4635-be7a-da15d8c49cf9 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:50:24.217715 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-73289a0d-33ed-4635-be7a-da15d8c49cf9 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:50:24.218541 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-73289a0d-33ed-4635-be7a-da15d8c49cf9 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:50:24.218992 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-73289a0d-33ed-4635-be7a-da15d8c49cf9 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:50:24.446808 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-73289a0d-33ed-4635-be7a-da15d8c49cf9 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c7a7d9566c4f0eb585c9bcb042f3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d1643804cc4a989c2bb72c2c416b10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:50:24.455189 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-73289a0d-33ed-4635-be7a-da15d8c49cf9 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] 10.222.0.18 "GET /compute/v2.1/servers/776793d3-dc28-4511-a3d2-efe2f7f88c6f" status: 200 len: 1514 microversion: 2.1 time: 0.251572 Oct 22 21:50:24.456149 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3150/6270] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:50:24 2022] GET /compute/v2.1/servers/776793d3-dc28-4511-a3d2-efe2f7f88c6f => generated 1514 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:50:25.484094 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-cab543b8-a963-4fb2-9f1b-558f7dfa3740 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:50:25.484820 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-cab543b8-a963-4fb2-9f1b-558f7dfa3740 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] [instance: 776793d3-dc28-4511-a3d2-efe2f7f88c6f] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:50:25.492424 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cab543b8-a963-4fb2-9f1b-558f7dfa3740 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:50:25.492895 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cab543b8-a963-4fb2-9f1b-558f7dfa3740 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:50:25.493359 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cab543b8-a963-4fb2-9f1b-558f7dfa3740 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:50:25.494058 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cab543b8-a963-4fb2-9f1b-558f7dfa3740 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:50:25.494518 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cab543b8-a963-4fb2-9f1b-558f7dfa3740 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:50:25.494956 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cab543b8-a963-4fb2-9f1b-558f7dfa3740 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:50:25.631086 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-cab543b8-a963-4fb2-9f1b-558f7dfa3740 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c7a7d9566c4f0eb585c9bcb042f3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d1643804cc4a989c2bb72c2c416b10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:50:25.639302 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-cab543b8-a963-4fb2-9f1b-558f7dfa3740 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] 10.222.0.18 "GET /compute/v2.1/servers/776793d3-dc28-4511-a3d2-efe2f7f88c6f" status: 200 len: 1512 microversion: 2.1 time: 0.162366 Oct 22 21:50:25.640271 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3121/6271] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:50:25 2022] GET /compute/v2.1/servers/776793d3-dc28-4511-a3d2-efe2f7f88c6f => generated 1512 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:50:25.826040 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-fad6ddc6-9fa7-4754-97a6-3ee24ce6f81d req-971cbba1-06b7-466a-b039-fb74a357ed63 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "776793d3-dc28-4511-a3d2-efe2f7f88c6f", "tag": "8bd64564-8ebe-4198-8fac-2bd7697fb396"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:50:25.837017 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-fad6ddc6-9fa7-4754-97a6-3ee24ce6f81d req-971cbba1-06b7-466a-b039-fb74a357ed63 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:50:25.837511 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-fad6ddc6-9fa7-4754-97a6-3ee24ce6f81d req-971cbba1-06b7-466a-b039-fb74a357ed63 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:50:25.837949 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-fad6ddc6-9fa7-4754-97a6-3ee24ce6f81d req-971cbba1-06b7-466a-b039-fb74a357ed63 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:50:25.850653 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-fad6ddc6-9fa7-4754-97a6-3ee24ce6f81d req-971cbba1-06b7-466a-b039-fb74a357ed63 service nova] Creating event network-changed:8bd64564-8ebe-4198-8fac-2bd7697fb396 for instance 776793d3-dc28-4511-a3d2-efe2f7f88c6f on nch2-master-1 Oct 22 21:50:25.857006 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [req-fad6ddc6-9fa7-4754-97a6-3ee24ce6f81d req-971cbba1-06b7-466a-b039-fb74a357ed63 service nova] Instance 776793d3-dc28-4511-a3d2-efe2f7f88c6f is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=138745) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 22 21:50:25.869057 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-fad6ddc6-9fa7-4754-97a6-3ee24ce6f81d req-971cbba1-06b7-466a-b039-fb74a357ed63 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046760 Oct 22 21:50:25.869659 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3151/6272] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:50:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:50:26.663262 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-55af7a94-36d4-45a1-acd2-69cc92b6a547 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:50:26.663945 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-55af7a94-36d4-45a1-acd2-69cc92b6a547 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] [instance: 776793d3-dc28-4511-a3d2-efe2f7f88c6f] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:50:26.671534 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-55af7a94-36d4-45a1-acd2-69cc92b6a547 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:50:26.672163 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-55af7a94-36d4-45a1-acd2-69cc92b6a547 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:50:26.672597 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-55af7a94-36d4-45a1-acd2-69cc92b6a547 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:50:26.673324 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-55af7a94-36d4-45a1-acd2-69cc92b6a547 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:50:26.673782 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-55af7a94-36d4-45a1-acd2-69cc92b6a547 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:50:26.674231 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-55af7a94-36d4-45a1-acd2-69cc92b6a547 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:50:26.818870 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-55af7a94-36d4-45a1-acd2-69cc92b6a547 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c7a7d9566c4f0eb585c9bcb042f3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d1643804cc4a989c2bb72c2c416b10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:50:26.829571 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-55af7a94-36d4-45a1-acd2-69cc92b6a547 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] 10.222.0.18 "GET /compute/v2.1/servers/776793d3-dc28-4511-a3d2-efe2f7f88c6f" status: 200 len: 1509 microversion: 2.1 time: 0.170391 Oct 22 21:50:26.830151 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3122/6273] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:50:26 2022] GET /compute/v2.1/servers/776793d3-dc28-4511-a3d2-efe2f7f88c6f => generated 1509 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:50:26.853844 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-57e8f341-c5f3-4efa-8cd0-bdde28a94185 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:50:26.854466 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-57e8f341-c5f3-4efa-8cd0-bdde28a94185 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] [instance: 776793d3-dc28-4511-a3d2-efe2f7f88c6f] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:50:26.861405 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-57e8f341-c5f3-4efa-8cd0-bdde28a94185 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:50:26.861908 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-57e8f341-c5f3-4efa-8cd0-bdde28a94185 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:50:26.862371 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-57e8f341-c5f3-4efa-8cd0-bdde28a94185 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:50:26.863090 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-57e8f341-c5f3-4efa-8cd0-bdde28a94185 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:50:26.863609 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-57e8f341-c5f3-4efa-8cd0-bdde28a94185 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:50:26.864053 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-57e8f341-c5f3-4efa-8cd0-bdde28a94185 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:50:26.890764 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-57e8f341-c5f3-4efa-8cd0-bdde28a94185 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] [instance: 776793d3-dc28-4511-a3d2-efe2f7f88c6f] Going to try to terminate instance {{(pid=138745) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 21:50:26.943911 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.compute.api [None req-57e8f341-c5f3-4efa-8cd0-bdde28a94185 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] [instance: 776793d3-dc28-4511-a3d2-efe2f7f88c6f] Found an unconfirmed migration during delete, id: 16, status: finished Oct 22 21:50:28.416038 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-57e8f341-c5f3-4efa-8cd0-bdde28a94185 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] 10.222.0.18 "DELETE /compute/v2.1/servers/776793d3-dc28-4511-a3d2-efe2f7f88c6f" status: 204 len: 0 microversion: 2.1 time: 1.566987 Oct 22 21:50:28.416966 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3152/6274] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 21:50:26 2022] DELETE /compute/v2.1/servers/776793d3-dc28-4511-a3d2-efe2f7f88c6f => generated 0 bytes in 1569 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 21:50:28.426535 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-a299344c-8784-4255-baf9-094efa860394 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:50:28.427418 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-a299344c-8784-4255-baf9-094efa860394 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] [instance: 776793d3-dc28-4511-a3d2-efe2f7f88c6f] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:50:28.435018 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a299344c-8784-4255-baf9-094efa860394 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:50:28.435801 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a299344c-8784-4255-baf9-094efa860394 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:50:28.436250 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a299344c-8784-4255-baf9-094efa860394 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:50:28.436960 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a299344c-8784-4255-baf9-094efa860394 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:50:28.437753 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a299344c-8784-4255-baf9-094efa860394 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:50:28.438193 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a299344c-8784-4255-baf9-094efa860394 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:50:28.578862 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-a299344c-8784-4255-baf9-094efa860394 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c7a7d9566c4f0eb585c9bcb042f3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d1643804cc4a989c2bb72c2c416b10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:50:28.587302 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-a299344c-8784-4255-baf9-094efa860394 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] 10.222.0.18 "GET /compute/v2.1/servers/776793d3-dc28-4511-a3d2-efe2f7f88c6f" status: 200 len: 1501 microversion: 2.1 time: 0.166172 Oct 22 21:50:28.587940 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3123/6275] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:50:28 2022] GET /compute/v2.1/servers/776793d3-dc28-4511-a3d2-efe2f7f88c6f => generated 1501 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:50:29.612811 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-b06bb702-0295-4869-8f3b-dae11dbb80f9 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:50:29.613549 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-b06bb702-0295-4869-8f3b-dae11dbb80f9 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] [instance: 776793d3-dc28-4511-a3d2-efe2f7f88c6f] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:50:29.620922 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b06bb702-0295-4869-8f3b-dae11dbb80f9 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:50:29.621455 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b06bb702-0295-4869-8f3b-dae11dbb80f9 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:50:29.621908 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b06bb702-0295-4869-8f3b-dae11dbb80f9 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:50:29.622622 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b06bb702-0295-4869-8f3b-dae11dbb80f9 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:50:29.623097 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b06bb702-0295-4869-8f3b-dae11dbb80f9 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:50:29.623587 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b06bb702-0295-4869-8f3b-dae11dbb80f9 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:50:29.762472 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-b06bb702-0295-4869-8f3b-dae11dbb80f9 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c7a7d9566c4f0eb585c9bcb042f3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d1643804cc4a989c2bb72c2c416b10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:50:29.771483 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-b06bb702-0295-4869-8f3b-dae11dbb80f9 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] 10.222.0.18 "GET /compute/v2.1/servers/776793d3-dc28-4511-a3d2-efe2f7f88c6f" status: 200 len: 1501 microversion: 2.1 time: 0.163171 Oct 22 21:50:29.772059 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3153/6276] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:50:29 2022] GET /compute/v2.1/servers/776793d3-dc28-4511-a3d2-efe2f7f88c6f => generated 1501 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:50:30.275359 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-6b2e5ed3-aec5-4317-a04f-75f9df043407 req-0da037bc-e1c5-4084-8f9b-851c0d57e93b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "776793d3-dc28-4511-a3d2-efe2f7f88c6f", "name": "network-vif-deleted", "tag": "8bd64564-8ebe-4198-8fac-2bd7697fb396"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:50:30.286239 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-6b2e5ed3-aec5-4317-a04f-75f9df043407 req-0da037bc-e1c5-4084-8f9b-851c0d57e93b service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:50:30.286725 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-6b2e5ed3-aec5-4317-a04f-75f9df043407 req-0da037bc-e1c5-4084-8f9b-851c0d57e93b service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:50:30.287272 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-6b2e5ed3-aec5-4317-a04f-75f9df043407 req-0da037bc-e1c5-4084-8f9b-851c0d57e93b service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:50:30.299447 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-6b2e5ed3-aec5-4317-a04f-75f9df043407 req-0da037bc-e1c5-4084-8f9b-851c0d57e93b service nova] Creating event network-vif-deleted:8bd64564-8ebe-4198-8fac-2bd7697fb396 for instance 776793d3-dc28-4511-a3d2-efe2f7f88c6f on nch2-master-1 Oct 22 21:50:30.304869 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-6b2e5ed3-aec5-4317-a04f-75f9df043407 req-0da037bc-e1c5-4084-8f9b-851c0d57e93b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033179 Oct 22 21:50:30.308466 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3124/6277] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:50:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:50:30.794594 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-c2891aa7-4167-4ff6-95ec-04e5c708c80b tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:50:30.795214 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-c2891aa7-4167-4ff6-95ec-04e5c708c80b tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] [instance: 776793d3-dc28-4511-a3d2-efe2f7f88c6f] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:50:30.802666 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c2891aa7-4167-4ff6-95ec-04e5c708c80b tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:50:30.803160 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c2891aa7-4167-4ff6-95ec-04e5c708c80b tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:50:30.803649 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c2891aa7-4167-4ff6-95ec-04e5c708c80b tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:50:30.804356 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c2891aa7-4167-4ff6-95ec-04e5c708c80b tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:50:30.804822 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c2891aa7-4167-4ff6-95ec-04e5c708c80b tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:50:30.805257 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c2891aa7-4167-4ff6-95ec-04e5c708c80b tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:50:30.822061 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.wsgi [None req-c2891aa7-4167-4ff6-95ec-04e5c708c80b tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] HTTP exception thrown: Instance 776793d3-dc28-4511-a3d2-efe2f7f88c6f could not be found. Oct 22 21:50:30.823759 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-c2891aa7-4167-4ff6-95ec-04e5c708c80b tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Request method failure captured: Oct 22 21:50:30.823759 ncdv-master-1 devstack@n-api.service[138745]: request: GET /compute/v2.1/servers/776793d3-dc28-4511-a3d2-efe2f7f88c6f HTTP/1.1 Oct 22 21:50:30.823759 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 21:50:30.823759 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 21:50:30.823759 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 21:50:30.823759 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 0 Oct 22 21:50:30.823759 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 21:50:30.823759 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 21:50:30.823759 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 21:50:30.823759 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 21:50:30.823759 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVGV1-PKlMoK-0sljDI4zUvqn6RPgd88kDmWaxJEgQi-_cY_Ng5HU-1bVU5DcwIhtGKjs_7AtrNSv9935Wj3UiWlRuWsfvQ3Kgtjv_kZbntel13sPQGHIBRJ-mWB4l0PEkGptEkc6KyD__9wgywDVv-Ug5VItCLh7AJu593e1uIqMHCo Oct 22 21:50:30.823759 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 21:50:30.823759 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 21:50:30.823759 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 21:50:30.823759 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 21:50:30.823759 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 21:50:30.823759 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 21:50:30.823759 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: 92d1643804cc4a989c2bb72c2c416b10 Oct 22 21:50:30.823759 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-DeleteServersTestJSON-1111640194 Oct 22 21:50:30.823759 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 21:50:30.823759 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 21:50:30.823759 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_92d1643804cc4a989c2bb72c2c416b10"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/92d1643804cc4a989c2bb72c2c416b10"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/92d1643804cc4a989c2bb72c2c416b10"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/92d1643804cc4a989c2bb72c2c416b10"}]}] Oct 22 21:50:30.823759 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-DeleteServersTestJSON-1111640194 Oct 22 21:50:30.823759 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: 92d1643804cc4a989c2bb72c2c416b10 Oct 22 21:50:30.823759 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-DeleteServersTestJSON-1111640194 Oct 22 21:50:30.823759 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-DeleteServersTestJSON-1111640194-project Oct 22 21:50:30.823759 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 21:50:30.823759 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 21:50:30.823759 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: 82c7a7d9566c4f0eb585c9bcb042f3cf Oct 22 21:50:30.823759 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-DeleteServersTestJSON-1111640194-project Oct 22 21:50:30.823759 ncdv-master-1 devstack@n-api.service[138745]: method: > Oct 22 21:50:30.823759 ncdv-master-1 devstack@n-api.service[138745]: exception: Instance 776793d3-dc28-4511-a3d2-efe2f7f88c6f could not be found. Oct 22 21:50:30.823759 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'id': '776793d3-dc28-4511-a3d2-efe2f7f88c6f'} Oct 22 21:50:30.823759 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:50:30.823759 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:50:30.823759 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 21:50:30.823759 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 21:50:30.823759 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 21:50:30.823759 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 21:50:30.823759 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 21:50:30.823759 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 21:50:30.823759 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 21:50:30.823759 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 21:50:30.823759 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 776793d3-dc28-4511-a3d2-efe2f7f88c6f could not be found. Oct 22 21:50:30.823759 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:50:30.823759 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:50:30.823759 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:50:30.823759 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:50:30.823759 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:50:30.823759 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:50:30.823759 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:50:30.823759 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:50:30.823759 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:50:30.823759 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:50:30.823759 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 21:50:30.823759 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 21:50:30.823759 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 21:50:30.823759 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 21:50:30.823759 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 21:50:30.823759 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:50:30.823759 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 776793d3-dc28-4511-a3d2-efe2f7f88c6f could not be found. Oct 22 21:50:30.823759 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:50:30.823759 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:50:30.823759 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:50:30.828587 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:50:30.828587 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:50:30.828587 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:50:30.828587 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:50:30.828587 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:50:30.828587 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 776793d3-dc28-4511-a3d2-efe2f7f88c6f could not be found. Oct 22 21:50:30.828587 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:50:30.828587 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-c2891aa7-4167-4ff6-95ec-04e5c708c80b tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Returning 404 to user: Instance 776793d3-dc28-4511-a3d2-efe2f7f88c6f could not be found. {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:50:30.828587 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-c2891aa7-4167-4ff6-95ec-04e5c708c80b tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] 10.222.0.18 "GET /compute/v2.1/servers/776793d3-dc28-4511-a3d2-efe2f7f88c6f" status: 404 len: 111 microversion: 2.1 time: 0.034718 Oct 22 21:50:30.828587 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3154/6278] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:50:30 2022] GET /compute/v2.1/servers/776793d3-dc28-4511-a3d2-efe2f7f88c6f => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 21:50:30.839583 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-2f827c0c-c184-4bf7-8e79-ac339d90ccf5 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:50:30.840191 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-2f827c0c-c184-4bf7-8e79-ac339d90ccf5 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] [instance: 776793d3-dc28-4511-a3d2-efe2f7f88c6f] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:50:30.847662 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2f827c0c-c184-4bf7-8e79-ac339d90ccf5 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:50:30.848144 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2f827c0c-c184-4bf7-8e79-ac339d90ccf5 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:50:30.848584 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2f827c0c-c184-4bf7-8e79-ac339d90ccf5 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:50:30.849273 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2f827c0c-c184-4bf7-8e79-ac339d90ccf5 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:50:30.849877 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2f827c0c-c184-4bf7-8e79-ac339d90ccf5 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:50:30.850305 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2f827c0c-c184-4bf7-8e79-ac339d90ccf5 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:50:30.864435 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-2f827c0c-c184-4bf7-8e79-ac339d90ccf5 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] HTTP exception thrown: Instance 776793d3-dc28-4511-a3d2-efe2f7f88c6f could not be found. Oct 22 21:50:30.866112 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-2f827c0c-c184-4bf7-8e79-ac339d90ccf5 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Request method failure captured: Oct 22 21:50:30.866112 ncdv-master-1 devstack@n-api.service[138744]: request: DELETE /compute/v2.1/servers/776793d3-dc28-4511-a3d2-efe2f7f88c6f HTTP/1.1 Oct 22 21:50:30.866112 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 21:50:30.866112 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 21:50:30.866112 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 21:50:30.866112 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 0 Oct 22 21:50:30.866112 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 21:50:30.866112 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 21:50:30.866112 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 21:50:30.866112 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 21:50:30.866112 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVGV1-PKlMoK-0sljDI4zUvqn6RPgd88kDmWaxJEgQi-_cY_Ng5HU-1bVU5DcwIhtGKjs_7AtrNSv9935Wj3UiWlRuWsfvQ3Kgtjv_kZbntel13sPQGHIBRJ-mWB4l0PEkGptEkc6KyD__9wgywDVv-Ug5VItCLh7AJu593e1uIqMHCo Oct 22 21:50:30.866112 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 21:50:30.866112 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 21:50:30.866112 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 21:50:30.866112 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 21:50:30.866112 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 21:50:30.866112 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 21:50:30.866112 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: 92d1643804cc4a989c2bb72c2c416b10 Oct 22 21:50:30.866112 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-DeleteServersTestJSON-1111640194 Oct 22 21:50:30.866112 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 21:50:30.866112 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 21:50:30.866112 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_92d1643804cc4a989c2bb72c2c416b10"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/92d1643804cc4a989c2bb72c2c416b10"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/92d1643804cc4a989c2bb72c2c416b10"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/92d1643804cc4a989c2bb72c2c416b10"}]}] Oct 22 21:50:30.866112 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-DeleteServersTestJSON-1111640194 Oct 22 21:50:30.866112 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: 92d1643804cc4a989c2bb72c2c416b10 Oct 22 21:50:30.866112 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-DeleteServersTestJSON-1111640194 Oct 22 21:50:30.866112 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-DeleteServersTestJSON-1111640194-project Oct 22 21:50:30.866112 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 21:50:30.866112 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 21:50:30.866112 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: 82c7a7d9566c4f0eb585c9bcb042f3cf Oct 22 21:50:30.866112 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-DeleteServersTestJSON-1111640194-project Oct 22 21:50:30.866112 ncdv-master-1 devstack@n-api.service[138744]: method: > Oct 22 21:50:30.866112 ncdv-master-1 devstack@n-api.service[138744]: exception: Instance 776793d3-dc28-4511-a3d2-efe2f7f88c6f could not be found. Oct 22 21:50:30.866112 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': '776793d3-dc28-4511-a3d2-efe2f7f88c6f'} Oct 22 21:50:30.866112 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:50:30.866112 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:50:30.866112 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 21:50:30.866112 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 21:50:30.866112 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 21:50:30.866112 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 21:50:30.866112 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 21:50:30.866112 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 21:50:30.866112 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 21:50:30.866112 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 21:50:30.866112 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 776793d3-dc28-4511-a3d2-efe2f7f88c6f could not be found. Oct 22 21:50:30.866112 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:50:30.866112 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:50:30.866112 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:50:30.866112 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:50:30.866112 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:50:30.866112 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:50:30.866112 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:50:30.866112 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:50:30.866112 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:50:30.866112 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:50:30.866112 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 22 21:50:30.866112 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 22 21:50:30.866112 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 22 21:50:30.866112 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 22 21:50:30.866112 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 21:50:30.866112 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 21:50:30.866112 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 21:50:30.866112 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:50:30.870913 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 776793d3-dc28-4511-a3d2-efe2f7f88c6f could not be found. Oct 22 21:50:30.870913 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:50:30.870913 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:50:30.870913 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:50:30.870913 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:50:30.870913 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:50:30.870913 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:50:30.870913 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:50:30.870913 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:50:30.870913 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 776793d3-dc28-4511-a3d2-efe2f7f88c6f could not be found. Oct 22 21:50:30.870913 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:50:30.870913 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-2f827c0c-c184-4bf7-8e79-ac339d90ccf5 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Returning 404 to user: Instance 776793d3-dc28-4511-a3d2-efe2f7f88c6f could not be found. {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:50:30.870913 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-2f827c0c-c184-4bf7-8e79-ac339d90ccf5 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] 10.222.0.18 "DELETE /compute/v2.1/servers/776793d3-dc28-4511-a3d2-efe2f7f88c6f" status: 404 len: 111 microversion: 2.1 time: 0.032562 Oct 22 21:50:30.870913 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3125/6279] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 21:50:30 2022] DELETE /compute/v2.1/servers/776793d3-dc28-4511-a3d2-efe2f7f88c6f => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 21:50:30.876339 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-2d084b22-692b-4ad6-bb79-7d43d63e4a78 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:50:30.876967 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-2d084b22-692b-4ad6-bb79-7d43d63e4a78 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] [instance: 776793d3-dc28-4511-a3d2-efe2f7f88c6f] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:50:30.883400 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2d084b22-692b-4ad6-bb79-7d43d63e4a78 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:50:30.883925 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2d084b22-692b-4ad6-bb79-7d43d63e4a78 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:50:30.884376 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2d084b22-692b-4ad6-bb79-7d43d63e4a78 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:50:30.885080 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2d084b22-692b-4ad6-bb79-7d43d63e4a78 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:50:30.885545 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2d084b22-692b-4ad6-bb79-7d43d63e4a78 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:50:30.885985 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2d084b22-692b-4ad6-bb79-7d43d63e4a78 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:50:30.899676 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.wsgi [None req-2d084b22-692b-4ad6-bb79-7d43d63e4a78 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] HTTP exception thrown: Instance 776793d3-dc28-4511-a3d2-efe2f7f88c6f could not be found. Oct 22 21:50:30.901203 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-2d084b22-692b-4ad6-bb79-7d43d63e4a78 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Request method failure captured: Oct 22 21:50:30.901203 ncdv-master-1 devstack@n-api.service[138745]: request: GET /compute/v2.1/servers/776793d3-dc28-4511-a3d2-efe2f7f88c6f HTTP/1.1 Oct 22 21:50:30.901203 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 21:50:30.901203 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 21:50:30.901203 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 21:50:30.901203 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 0 Oct 22 21:50:30.901203 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 21:50:30.901203 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 21:50:30.901203 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 21:50:30.901203 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 21:50:30.901203 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVGV1-PKlMoK-0sljDI4zUvqn6RPgd88kDmWaxJEgQi-_cY_Ng5HU-1bVU5DcwIhtGKjs_7AtrNSv9935Wj3UiWlRuWsfvQ3Kgtjv_kZbntel13sPQGHIBRJ-mWB4l0PEkGptEkc6KyD__9wgywDVv-Ug5VItCLh7AJu593e1uIqMHCo Oct 22 21:50:30.901203 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 21:50:30.901203 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 21:50:30.901203 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 21:50:30.901203 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 21:50:30.901203 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 21:50:30.901203 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 21:50:30.901203 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: 92d1643804cc4a989c2bb72c2c416b10 Oct 22 21:50:30.901203 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-DeleteServersTestJSON-1111640194 Oct 22 21:50:30.901203 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 21:50:30.901203 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 21:50:30.901203 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_92d1643804cc4a989c2bb72c2c416b10"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/92d1643804cc4a989c2bb72c2c416b10"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/92d1643804cc4a989c2bb72c2c416b10"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/92d1643804cc4a989c2bb72c2c416b10"}]}] Oct 22 21:50:30.901203 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-DeleteServersTestJSON-1111640194 Oct 22 21:50:30.901203 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: 92d1643804cc4a989c2bb72c2c416b10 Oct 22 21:50:30.901203 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-DeleteServersTestJSON-1111640194 Oct 22 21:50:30.901203 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-DeleteServersTestJSON-1111640194-project Oct 22 21:50:30.901203 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 21:50:30.901203 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 21:50:30.901203 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: 82c7a7d9566c4f0eb585c9bcb042f3cf Oct 22 21:50:30.901203 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-DeleteServersTestJSON-1111640194-project Oct 22 21:50:30.901203 ncdv-master-1 devstack@n-api.service[138745]: method: > Oct 22 21:50:30.901203 ncdv-master-1 devstack@n-api.service[138745]: exception: Instance 776793d3-dc28-4511-a3d2-efe2f7f88c6f could not be found. Oct 22 21:50:30.901203 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'id': '776793d3-dc28-4511-a3d2-efe2f7f88c6f'} Oct 22 21:50:30.901203 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:50:30.901203 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:50:30.901203 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 21:50:30.901203 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 21:50:30.901203 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 21:50:30.901203 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 21:50:30.901203 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 21:50:30.901203 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 21:50:30.901203 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 21:50:30.901203 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 21:50:30.901203 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 776793d3-dc28-4511-a3d2-efe2f7f88c6f could not be found. Oct 22 21:50:30.901203 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:50:30.901203 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:50:30.901203 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:50:30.901203 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:50:30.901203 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:50:30.901203 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:50:30.901203 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:50:30.901203 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:50:30.901203 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:50:30.901203 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:50:30.901203 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 21:50:30.901203 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 21:50:30.901203 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 21:50:30.901203 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 21:50:30.901203 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 21:50:30.901203 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:50:30.901203 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 776793d3-dc28-4511-a3d2-efe2f7f88c6f could not be found. Oct 22 21:50:30.901203 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:50:30.901203 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:50:30.901203 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:50:30.905940 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:50:30.905940 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:50:30.905940 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:50:30.905940 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:50:30.905940 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:50:30.905940 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 776793d3-dc28-4511-a3d2-efe2f7f88c6f could not be found. Oct 22 21:50:30.905940 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:50:30.905940 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-2d084b22-692b-4ad6-bb79-7d43d63e4a78 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] Returning 404 to user: Instance 776793d3-dc28-4511-a3d2-efe2f7f88c6f could not be found. {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:50:30.905940 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-2d084b22-692b-4ad6-bb79-7d43d63e4a78 tempest-DeleteServersTestJSON-1111640194 tempest-DeleteServersTestJSON-1111640194-project] 10.222.0.18 "GET /compute/v2.1/servers/776793d3-dc28-4511-a3d2-efe2f7f88c6f" status: 404 len: 111 microversion: 2.1 time: 0.030290 Oct 22 21:50:30.905940 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3155/6280] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:50:30 2022] GET /compute/v2.1/servers/776793d3-dc28-4511-a3d2-efe2f7f88c6f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 22 21:50:39.822890 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-0da9aa03-503c-4ffd-9a59-79e9a667c2a2 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-804835096", "imageRef": "085e4478-6edc-4a69-8e08-f9831713eb65", "flavorRef": "452", "networks": [{"uuid": "94b61302-e551-4df3-bdc0-86d30fc73cf4"}]}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:50:39.880236 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.network.neutron [None req-0da9aa03-503c-4ffd-9a59-79e9a667c2a2 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] validate_networks() for [('94b61302-e551-4df3-bdc0-86d30fc73cf4', None, None, None, None, None)] {{(pid=138744) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 21:50:40.270716 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-0da9aa03-503c-4ffd-9a59-79e9a667c2a2 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Flavor limits 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 21:50:40.271148 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-0da9aa03-503c-4ffd-9a59-79e9a667c2a2 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Image limits 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 21:50:40.271675 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-0da9aa03-503c-4ffd-9a59-79e9a667c2a2 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Flavor pref 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 21:50:40.272098 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-0da9aa03-503c-4ffd-9a59-79e9a667c2a2 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Image pref 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 21:50:40.272552 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-0da9aa03-503c-4ffd-9a59-79e9a667c2a2 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 21:50:40.282011 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0da9aa03-503c-4ffd-9a59-79e9a667c2a2 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:50:40.282586 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0da9aa03-503c-4ffd-9a59-79e9a667c2a2 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:50:40.283045 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0da9aa03-503c-4ffd-9a59-79e9a667c2a2 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:50:40.283820 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0da9aa03-503c-4ffd-9a59-79e9a667c2a2 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:50:40.284253 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0da9aa03-503c-4ffd-9a59-79e9a667c2a2 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:50:40.284690 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0da9aa03-503c-4ffd-9a59-79e9a667c2a2 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:50:40.302088 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-0da9aa03-503c-4ffd-9a59-79e9a667c2a2 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Getting quotas for project f4cf4cd612f04e91b3be2e7ca5658b97. Resources: {'cores', 'instances', 'ram'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 21:50:40.307602 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-0da9aa03-503c-4ffd-9a59-79e9a667c2a2 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Getting quotas for user 22419916fc2641f88bfbdf103e7c3ee6 and project f4cf4cd612f04e91b3be2e7ca5658b97. Resources: {'cores', 'instances', 'ram'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 21:50:40.321381 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-0da9aa03-503c-4ffd-9a59-79e9a667c2a2 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Going to run 1 instances... {{(pid=138744) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 21:50:40.323804 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-0da9aa03-503c-4ffd-9a59-79e9a667c2a2 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] [instance: e3f9f3ab-26f2-427b-9dc5-bfc007cdef20] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='085e4478-6edc-4a69-8e08-f9831713eb65',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138744) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 21:50:40.373102 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-0da9aa03-503c-4ffd-9a59-79e9a667c2a2 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.675370 Oct 22 21:50:40.380199 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3126/6281] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Oct 22 21:50:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 677 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 22 21:50:40.385600 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-38fb6a37-feb7-4713-a732-acadf22958fd tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:50:40.386368 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-38fb6a37-feb7-4713-a732-acadf22958fd tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] [instance: e3f9f3ab-26f2-427b-9dc5-bfc007cdef20] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:50:40.442468 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-38fb6a37-feb7-4713-a732-acadf22958fd tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22419916fc2641f88bfbdf103e7c3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf4cd612f04e91b3be2e7ca5658b97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:50:40.449775 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-38fb6a37-feb7-4713-a732-acadf22958fd tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] 10.222.0.18 "GET /compute/v2.1/servers/e3f9f3ab-26f2-427b-9dc5-bfc007cdef20" status: 200 len: 1217 microversion: 2.1 time: 0.068140 Oct 22 21:50:40.450349 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3156/6282] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:50:40 2022] GET /compute/v2.1/servers/e3f9f3ab-26f2-427b-9dc5-bfc007cdef20 => generated 1217 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:50:41.473793 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-02d5a4c0-e354-42d5-b364-e381e1fdfd62 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:50:41.475153 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-02d5a4c0-e354-42d5-b364-e381e1fdfd62 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] [instance: e3f9f3ab-26f2-427b-9dc5-bfc007cdef20] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:50:41.483209 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-02d5a4c0-e354-42d5-b364-e381e1fdfd62 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:50:41.483761 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-02d5a4c0-e354-42d5-b364-e381e1fdfd62 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:50:41.484207 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-02d5a4c0-e354-42d5-b364-e381e1fdfd62 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:50:41.485005 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-02d5a4c0-e354-42d5-b364-e381e1fdfd62 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:50:41.485558 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-02d5a4c0-e354-42d5-b364-e381e1fdfd62 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:50:41.486008 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-02d5a4c0-e354-42d5-b364-e381e1fdfd62 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:50:41.554539 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-02d5a4c0-e354-42d5-b364-e381e1fdfd62 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22419916fc2641f88bfbdf103e7c3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf4cd612f04e91b3be2e7ca5658b97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:50:41.565548 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-02d5a4c0-e354-42d5-b364-e381e1fdfd62 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] 10.222.0.18 "GET /compute/v2.1/servers/e3f9f3ab-26f2-427b-9dc5-bfc007cdef20" status: 200 len: 1269 microversion: 2.1 time: 0.095748 Oct 22 21:50:41.566515 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3127/6283] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:50:41 2022] GET /compute/v2.1/servers/e3f9f3ab-26f2-427b-9dc5-bfc007cdef20 => generated 1269 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:50:42.589715 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-c46f5643-ab28-444c-bfc9-23939b6965c5 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:50:42.593939 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-c46f5643-ab28-444c-bfc9-23939b6965c5 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] [instance: e3f9f3ab-26f2-427b-9dc5-bfc007cdef20] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:50:42.595621 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell1:SELECT=48,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:50:42.604171 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c46f5643-ab28-444c-bfc9-23939b6965c5 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:50:42.604695 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c46f5643-ab28-444c-bfc9-23939b6965c5 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:50:42.605134 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c46f5643-ab28-444c-bfc9-23939b6965c5 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:50:42.605851 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c46f5643-ab28-444c-bfc9-23939b6965c5 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:50:42.606319 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c46f5643-ab28-444c-bfc9-23939b6965c5 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:50:42.606763 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c46f5643-ab28-444c-bfc9-23939b6965c5 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:50:42.826054 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-c46f5643-ab28-444c-bfc9-23939b6965c5 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22419916fc2641f88bfbdf103e7c3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf4cd612f04e91b3be2e7ca5658b97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:50:42.837159 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-c46f5643-ab28-444c-bfc9-23939b6965c5 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] 10.222.0.18 "GET /compute/v2.1/servers/e3f9f3ab-26f2-427b-9dc5-bfc007cdef20" status: 200 len: 1317 microversion: 2.1 time: 0.250962 Oct 22 21:50:42.838370 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3157/6284] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:50:42 2022] GET /compute/v2.1/servers/e3f9f3ab-26f2-427b-9dc5-bfc007cdef20 => generated 1317 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:50:43.242452 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-7d1ba814-a138-4d21-98ba-300a060b223f req-e9d7ecb4-de83-4ec2-81c3-2c71b616ccba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3f9f3ab-26f2-427b-9dc5-bfc007cdef20", "tag": "b734f414-d5bc-4142-b5a0-68e23fd574a8"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:50:43.266158 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-7d1ba814-a138-4d21-98ba-300a060b223f req-e9d7ecb4-de83-4ec2-81c3-2c71b616ccba service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:50:43.267278 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-7d1ba814-a138-4d21-98ba-300a060b223f req-e9d7ecb4-de83-4ec2-81c3-2c71b616ccba service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:50:43.267967 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-7d1ba814-a138-4d21-98ba-300a060b223f req-e9d7ecb4-de83-4ec2-81c3-2c71b616ccba service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:50:43.281549 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-7d1ba814-a138-4d21-98ba-300a060b223f req-e9d7ecb4-de83-4ec2-81c3-2c71b616ccba service nova] Creating event network-changed:b734f414-d5bc-4142-b5a0-68e23fd574a8 for instance e3f9f3ab-26f2-427b-9dc5-bfc007cdef20 on nch2-master-1 Oct 22 21:50:43.288931 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-7d1ba814-a138-4d21-98ba-300a060b223f req-e9d7ecb4-de83-4ec2-81c3-2c71b616ccba service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050298 Oct 22 21:50:43.290457 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3128/6285] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:50:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:50:43.862911 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-ec5de73c-2368-4288-b0b7-8c31e2e171a1 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:50:43.863552 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-ec5de73c-2368-4288-b0b7-8c31e2e171a1 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] [instance: e3f9f3ab-26f2-427b-9dc5-bfc007cdef20] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:50:43.870751 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ec5de73c-2368-4288-b0b7-8c31e2e171a1 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:50:43.871256 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ec5de73c-2368-4288-b0b7-8c31e2e171a1 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:50:43.871725 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ec5de73c-2368-4288-b0b7-8c31e2e171a1 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:50:43.872432 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ec5de73c-2368-4288-b0b7-8c31e2e171a1 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:50:43.872898 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ec5de73c-2368-4288-b0b7-8c31e2e171a1 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:50:43.873335 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ec5de73c-2368-4288-b0b7-8c31e2e171a1 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:50:44.029051 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-ec5de73c-2368-4288-b0b7-8c31e2e171a1 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22419916fc2641f88bfbdf103e7c3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf4cd612f04e91b3be2e7ca5658b97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:50:44.037291 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-ec5de73c-2368-4288-b0b7-8c31e2e171a1 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] 10.222.0.18 "GET /compute/v2.1/servers/e3f9f3ab-26f2-427b-9dc5-bfc007cdef20" status: 200 len: 1317 microversion: 2.1 time: 0.178725 Oct 22 21:50:44.037875 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3158/6286] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:50:43 2022] GET /compute/v2.1/servers/e3f9f3ab-26f2-427b-9dc5-bfc007cdef20 => generated 1317 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:50:45.061129 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-b44132e7-da90-4da0-a11f-15411f22c823 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:50:45.061870 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-b44132e7-da90-4da0-a11f-15411f22c823 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] [instance: e3f9f3ab-26f2-427b-9dc5-bfc007cdef20] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:50:45.069354 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b44132e7-da90-4da0-a11f-15411f22c823 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:50:45.069831 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b44132e7-da90-4da0-a11f-15411f22c823 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:50:45.070267 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b44132e7-da90-4da0-a11f-15411f22c823 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:50:45.070967 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b44132e7-da90-4da0-a11f-15411f22c823 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:50:45.071462 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b44132e7-da90-4da0-a11f-15411f22c823 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:50:45.071892 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b44132e7-da90-4da0-a11f-15411f22c823 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:50:45.273249 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-b44132e7-da90-4da0-a11f-15411f22c823 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22419916fc2641f88bfbdf103e7c3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf4cd612f04e91b3be2e7ca5658b97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:50:45.281475 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-b44132e7-da90-4da0-a11f-15411f22c823 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] 10.222.0.18 "GET /compute/v2.1/servers/e3f9f3ab-26f2-427b-9dc5-bfc007cdef20" status: 200 len: 1317 microversion: 2.1 time: 0.224841 Oct 22 21:50:45.282429 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3129/6287] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:50:45 2022] GET /compute/v2.1/servers/e3f9f3ab-26f2-427b-9dc5-bfc007cdef20 => generated 1317 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:50:46.305138 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-d3d38cc1-de9f-4258-ac59-8dee7eae2ce9 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:50:46.305713 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-d3d38cc1-de9f-4258-ac59-8dee7eae2ce9 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] [instance: e3f9f3ab-26f2-427b-9dc5-bfc007cdef20] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:50:46.313264 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d3d38cc1-de9f-4258-ac59-8dee7eae2ce9 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:50:46.314049 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d3d38cc1-de9f-4258-ac59-8dee7eae2ce9 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:50:46.314503 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d3d38cc1-de9f-4258-ac59-8dee7eae2ce9 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:50:46.315217 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d3d38cc1-de9f-4258-ac59-8dee7eae2ce9 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:50:46.315714 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d3d38cc1-de9f-4258-ac59-8dee7eae2ce9 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:50:46.316154 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d3d38cc1-de9f-4258-ac59-8dee7eae2ce9 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:50:46.448340 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-d3d38cc1-de9f-4258-ac59-8dee7eae2ce9 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22419916fc2641f88bfbdf103e7c3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf4cd612f04e91b3be2e7ca5658b97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:50:46.456766 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-d3d38cc1-de9f-4258-ac59-8dee7eae2ce9 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] 10.222.0.18 "GET /compute/v2.1/servers/e3f9f3ab-26f2-427b-9dc5-bfc007cdef20" status: 200 len: 1317 microversion: 2.1 time: 0.155693 Oct 22 21:50:46.457359 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3159/6288] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:50:46 2022] GET /compute/v2.1/servers/e3f9f3ab-26f2-427b-9dc5-bfc007cdef20 => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:50:47.480690 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-64db79d7-b920-47b7-b85b-fa2a42025046 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:50:47.481287 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-64db79d7-b920-47b7-b85b-fa2a42025046 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] [instance: e3f9f3ab-26f2-427b-9dc5-bfc007cdef20] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:50:47.489308 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-64db79d7-b920-47b7-b85b-fa2a42025046 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:50:47.489862 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-64db79d7-b920-47b7-b85b-fa2a42025046 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:50:47.490323 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-64db79d7-b920-47b7-b85b-fa2a42025046 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:50:47.491058 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-64db79d7-b920-47b7-b85b-fa2a42025046 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:50:47.491581 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-64db79d7-b920-47b7-b85b-fa2a42025046 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:50:47.492033 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-64db79d7-b920-47b7-b85b-fa2a42025046 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:50:47.494884 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:SELECT=60 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:50:47.631981 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-64db79d7-b920-47b7-b85b-fa2a42025046 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22419916fc2641f88bfbdf103e7c3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf4cd612f04e91b3be2e7ca5658b97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:50:47.640160 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-64db79d7-b920-47b7-b85b-fa2a42025046 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] 10.222.0.18 "GET /compute/v2.1/servers/e3f9f3ab-26f2-427b-9dc5-bfc007cdef20" status: 200 len: 1317 microversion: 2.1 time: 0.163573 Oct 22 21:50:47.640717 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3130/6289] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:50:47 2022] GET /compute/v2.1/servers/e3f9f3ab-26f2-427b-9dc5-bfc007cdef20 => generated 1317 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:50:48.432845 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-23c465f1-b345-44ad-98be-f83105f72e09 req-ef77d27f-41df-46ea-a8de-157391e38995 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3f9f3ab-26f2-427b-9dc5-bfc007cdef20", "name": "network-vif-plugged", "status": "completed", "tag": "b734f414-d5bc-4142-b5a0-68e23fd574a8"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:50:48.444126 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-23c465f1-b345-44ad-98be-f83105f72e09 req-ef77d27f-41df-46ea-a8de-157391e38995 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:50:48.444619 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-23c465f1-b345-44ad-98be-f83105f72e09 req-ef77d27f-41df-46ea-a8de-157391e38995 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:50:48.445062 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-23c465f1-b345-44ad-98be-f83105f72e09 req-ef77d27f-41df-46ea-a8de-157391e38995 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:50:48.456750 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-23c465f1-b345-44ad-98be-f83105f72e09 req-ef77d27f-41df-46ea-a8de-157391e38995 service nova] Creating event network-vif-plugged:b734f414-d5bc-4142-b5a0-68e23fd574a8 for instance e3f9f3ab-26f2-427b-9dc5-bfc007cdef20 on nch2-master-1 Oct 22 21:50:48.461992 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-23c465f1-b345-44ad-98be-f83105f72e09 req-ef77d27f-41df-46ea-a8de-157391e38995 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032856 Oct 22 21:50:48.462597 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3160/6290] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:50:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:50:48.662906 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-133ea4ae-da81-4e4d-8526-accb91e29efd tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:50:48.663545 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-133ea4ae-da81-4e4d-8526-accb91e29efd tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] [instance: e3f9f3ab-26f2-427b-9dc5-bfc007cdef20] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:50:48.671046 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-133ea4ae-da81-4e4d-8526-accb91e29efd tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:50:48.671582 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-133ea4ae-da81-4e4d-8526-accb91e29efd tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:50:48.672027 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-133ea4ae-da81-4e4d-8526-accb91e29efd tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:50:48.673041 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-133ea4ae-da81-4e4d-8526-accb91e29efd tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:50:48.673545 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-133ea4ae-da81-4e4d-8526-accb91e29efd tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:50:48.673964 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-133ea4ae-da81-4e4d-8526-accb91e29efd tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:50:48.828279 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-133ea4ae-da81-4e4d-8526-accb91e29efd tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22419916fc2641f88bfbdf103e7c3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf4cd612f04e91b3be2e7ca5658b97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:50:48.838056 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-133ea4ae-da81-4e4d-8526-accb91e29efd tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] 10.222.0.18 "GET /compute/v2.1/servers/e3f9f3ab-26f2-427b-9dc5-bfc007cdef20" status: 200 len: 1317 microversion: 2.1 time: 0.179029 Oct 22 21:50:48.838867 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3131/6291] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:50:48 2022] GET /compute/v2.1/servers/e3f9f3ab-26f2-427b-9dc5-bfc007cdef20 => generated 1317 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:50:49.867622 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-c74d29c2-6c67-4831-87f7-080a6f34dc28 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:50:49.868342 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-c74d29c2-6c67-4831-87f7-080a6f34dc28 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] [instance: e3f9f3ab-26f2-427b-9dc5-bfc007cdef20] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:50:49.874833 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c74d29c2-6c67-4831-87f7-080a6f34dc28 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:50:49.875356 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c74d29c2-6c67-4831-87f7-080a6f34dc28 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:50:49.876086 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c74d29c2-6c67-4831-87f7-080a6f34dc28 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:50:49.876797 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c74d29c2-6c67-4831-87f7-080a6f34dc28 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:50:49.877268 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c74d29c2-6c67-4831-87f7-080a6f34dc28 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:50:49.877713 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c74d29c2-6c67-4831-87f7-080a6f34dc28 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:50:50.018811 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-c74d29c2-6c67-4831-87f7-080a6f34dc28 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22419916fc2641f88bfbdf103e7c3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf4cd612f04e91b3be2e7ca5658b97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:50:50.027172 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-c74d29c2-6c67-4831-87f7-080a6f34dc28 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] 10.222.0.18 "GET /compute/v2.1/servers/e3f9f3ab-26f2-427b-9dc5-bfc007cdef20" status: 200 len: 1508 microversion: 2.1 time: 0.164794 Oct 22 21:50:50.027888 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3161/6292] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:50:49 2022] GET /compute/v2.1/servers/e3f9f3ab-26f2-427b-9dc5-bfc007cdef20 => generated 1508 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:50:50.049791 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-7ad2f40b-1c65-4be3-9c3c-2bce3498c1de tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:50:50.050409 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-7ad2f40b-1c65-4be3-9c3c-2bce3498c1de tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] [instance: e3f9f3ab-26f2-427b-9dc5-bfc007cdef20] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:50:50.053495 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:50:50.059828 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7ad2f40b-1c65-4be3-9c3c-2bce3498c1de tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:50:50.060324 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7ad2f40b-1c65-4be3-9c3c-2bce3498c1de tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:50:50.060767 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7ad2f40b-1c65-4be3-9c3c-2bce3498c1de tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:50:50.061481 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7ad2f40b-1c65-4be3-9c3c-2bce3498c1de tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:50:50.061938 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7ad2f40b-1c65-4be3-9c3c-2bce3498c1de tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:50:50.062427 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7ad2f40b-1c65-4be3-9c3c-2bce3498c1de tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:50:50.207189 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-7ad2f40b-1c65-4be3-9c3c-2bce3498c1de tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22419916fc2641f88bfbdf103e7c3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf4cd612f04e91b3be2e7ca5658b97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:50:50.215569 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-7ad2f40b-1c65-4be3-9c3c-2bce3498c1de tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] 10.222.0.18 "GET /compute/v2.1/servers/e3f9f3ab-26f2-427b-9dc5-bfc007cdef20" status: 200 len: 1508 microversion: 2.1 time: 0.169722 Oct 22 21:50:50.216116 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3132/6293] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:50:50 2022] GET /compute/v2.1/servers/e3f9f3ab-26f2-427b-9dc5-bfc007cdef20 => generated 1508 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:50:50.239909 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-acc3b07b-77d1-4267-83ab-c69016cb8b03 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:50:50.242785 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-acc3b07b-77d1-4267-83ab-c69016cb8b03 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] [instance: e3f9f3ab-26f2-427b-9dc5-bfc007cdef20] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:50:50.249062 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-acc3b07b-77d1-4267-83ab-c69016cb8b03 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:50:50.249562 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-acc3b07b-77d1-4267-83ab-c69016cb8b03 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:50:50.250014 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-acc3b07b-77d1-4267-83ab-c69016cb8b03 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:50:50.250734 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-acc3b07b-77d1-4267-83ab-c69016cb8b03 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:50:50.251318 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-acc3b07b-77d1-4267-83ab-c69016cb8b03 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:50:50.251790 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-acc3b07b-77d1-4267-83ab-c69016cb8b03 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:50:50.320692 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-acc3b07b-77d1-4267-83ab-c69016cb8b03 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] 10.222.0.18 "PUT /compute/v2.1/servers/e3f9f3ab-26f2-427b-9dc5-bfc007cdef20" status: 200 len: 1080 microversion: 2.1 time: 0.085106 Oct 22 21:50:50.321702 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3162/6294] 10.222.0.18 () {60 vars in 1256 bytes} [Sat Oct 22 21:50:50 2022] PUT /compute/v2.1/servers/e3f9f3ab-26f2-427b-9dc5-bfc007cdef20 => generated 1080 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:50:50.339973 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-78d36251-3111-471d-9add-81dfdb78009c tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:50:50.340603 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-78d36251-3111-471d-9add-81dfdb78009c tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] [instance: e3f9f3ab-26f2-427b-9dc5-bfc007cdef20] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:50:50.342606 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell0:SELECT=2 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:50:50.343632 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell0:SELECT=6 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:50:50.349795 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-78d36251-3111-471d-9add-81dfdb78009c tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:50:50.350289 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-78d36251-3111-471d-9add-81dfdb78009c tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:50:50.350733 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-78d36251-3111-471d-9add-81dfdb78009c tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:50:50.351462 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-78d36251-3111-471d-9add-81dfdb78009c tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:50:50.351926 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-78d36251-3111-471d-9add-81dfdb78009c tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:50:50.352364 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-78d36251-3111-471d-9add-81dfdb78009c tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:50:50.494941 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-78d36251-3111-471d-9add-81dfdb78009c tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22419916fc2641f88bfbdf103e7c3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf4cd612f04e91b3be2e7ca5658b97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:50:50.503034 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-78d36251-3111-471d-9add-81dfdb78009c tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] 10.222.0.18 "GET /compute/v2.1/servers/e3f9f3ab-26f2-427b-9dc5-bfc007cdef20" status: 200 len: 1506 microversion: 2.1 time: 0.167050 Oct 22 21:50:50.503665 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3133/6295] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:50:50 2022] GET /compute/v2.1/servers/e3f9f3ab-26f2-427b-9dc5-bfc007cdef20 => generated 1506 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:50:50.525492 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-4c8c181f-9044-4e6f-ae3c-db3d84baa270 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:50:50.526127 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-4c8c181f-9044-4e6f-ae3c-db3d84baa270 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] [instance: e3f9f3ab-26f2-427b-9dc5-bfc007cdef20] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:50:50.528348 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell0:SELECT=2 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:50:50.529033 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:50:50.534940 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4c8c181f-9044-4e6f-ae3c-db3d84baa270 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:50:50.535462 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4c8c181f-9044-4e6f-ae3c-db3d84baa270 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:50:50.535920 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4c8c181f-9044-4e6f-ae3c-db3d84baa270 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:50:50.536635 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4c8c181f-9044-4e6f-ae3c-db3d84baa270 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:50:50.537090 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4c8c181f-9044-4e6f-ae3c-db3d84baa270 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:50:50.537532 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4c8c181f-9044-4e6f-ae3c-db3d84baa270 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:50:50.674378 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-4c8c181f-9044-4e6f-ae3c-db3d84baa270 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22419916fc2641f88bfbdf103e7c3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf4cd612f04e91b3be2e7ca5658b97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:50:50.682783 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-4c8c181f-9044-4e6f-ae3c-db3d84baa270 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] 10.222.0.18 "GET /compute/v2.1/servers/e3f9f3ab-26f2-427b-9dc5-bfc007cdef20" status: 200 len: 1506 microversion: 2.1 time: 0.161346 Oct 22 21:50:50.683358 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3163/6296] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:50:50 2022] GET /compute/v2.1/servers/e3f9f3ab-26f2-427b-9dc5-bfc007cdef20 => generated 1506 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:50:50.705758 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-2250b5d7-2097-4555-ab28-2baddf61a5d8 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:50:50.708109 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-2250b5d7-2097-4555-ab28-2baddf61a5d8 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] [instance: e3f9f3ab-26f2-427b-9dc5-bfc007cdef20] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:50:50.714500 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2250b5d7-2097-4555-ab28-2baddf61a5d8 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:50:50.714992 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2250b5d7-2097-4555-ab28-2baddf61a5d8 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:50:50.715472 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2250b5d7-2097-4555-ab28-2baddf61a5d8 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:50:50.716181 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2250b5d7-2097-4555-ab28-2baddf61a5d8 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:50:50.716644 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2250b5d7-2097-4555-ab28-2baddf61a5d8 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:50:50.717081 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2250b5d7-2097-4555-ab28-2baddf61a5d8 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:50:50.746393 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-2250b5d7-2097-4555-ab28-2baddf61a5d8 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '22419916fc2641f88bfbdf103e7c3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf4cd612f04e91b3be2e7ca5658b97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:50:50.752165 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-2250b5d7-2097-4555-ab28-2baddf61a5d8 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] [instance: e3f9f3ab-26f2-427b-9dc5-bfc007cdef20] Old instance type m1.heat2, new instance type m1.heat {{(pid=138744) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 22 21:50:50.759389 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-2250b5d7-2097-4555-ab28-2baddf61a5d8 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Flavor limits 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 21:50:50.759847 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-2250b5d7-2097-4555-ab28-2baddf61a5d8 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Image limits 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 21:50:50.760328 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-2250b5d7-2097-4555-ab28-2baddf61a5d8 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Flavor pref 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 21:50:50.760743 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-2250b5d7-2097-4555-ab28-2baddf61a5d8 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Image pref 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 21:50:50.761161 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-2250b5d7-2097-4555-ab28-2baddf61a5d8 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 21:50:50.829493 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-2250b5d7-2097-4555-ab28-2baddf61a5d8 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] 10.222.0.18 "POST /compute/v2.1/servers/e3f9f3ab-26f2-427b-9dc5-bfc007cdef20/action" status: 202 len: 0 microversion: 2.1 time: 0.127849 Oct 22 21:50:50.830509 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3134/6297] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 21:50:50 2022] POST /compute/v2.1/servers/e3f9f3ab-26f2-427b-9dc5-bfc007cdef20/action => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 21:50:50.838899 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-1e2e2d6a-0564-4f69-ab18-0b2f9b409c5e tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:50:50.839778 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-1e2e2d6a-0564-4f69-ab18-0b2f9b409c5e tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] [instance: e3f9f3ab-26f2-427b-9dc5-bfc007cdef20] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:50:50.848140 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1e2e2d6a-0564-4f69-ab18-0b2f9b409c5e tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:50:50.848649 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1e2e2d6a-0564-4f69-ab18-0b2f9b409c5e tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:50:50.849190 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1e2e2d6a-0564-4f69-ab18-0b2f9b409c5e tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:50:50.849957 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1e2e2d6a-0564-4f69-ab18-0b2f9b409c5e tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:50:50.850521 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1e2e2d6a-0564-4f69-ab18-0b2f9b409c5e tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:50:50.851074 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1e2e2d6a-0564-4f69-ab18-0b2f9b409c5e tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:50:51.004531 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-1e2e2d6a-0564-4f69-ab18-0b2f9b409c5e tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22419916fc2641f88bfbdf103e7c3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf4cd612f04e91b3be2e7ca5658b97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:50:51.013762 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-1e2e2d6a-0564-4f69-ab18-0b2f9b409c5e tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] 10.222.0.18 "GET /compute/v2.1/servers/e3f9f3ab-26f2-427b-9dc5-bfc007cdef20" status: 200 len: 1517 microversion: 2.1 time: 0.179022 Oct 22 21:50:51.014476 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3164/6298] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:50:50 2022] GET /compute/v2.1/servers/e3f9f3ab-26f2-427b-9dc5-bfc007cdef20 => generated 1517 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:50:52.038345 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-bc1e3196-969a-4929-8d6c-2d3f9089fb6f tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:50:52.039124 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-bc1e3196-969a-4929-8d6c-2d3f9089fb6f tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] [instance: e3f9f3ab-26f2-427b-9dc5-bfc007cdef20] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:50:52.046354 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bc1e3196-969a-4929-8d6c-2d3f9089fb6f tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:50:52.046847 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bc1e3196-969a-4929-8d6c-2d3f9089fb6f tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:50:52.047298 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bc1e3196-969a-4929-8d6c-2d3f9089fb6f tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:50:52.048066 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bc1e3196-969a-4929-8d6c-2d3f9089fb6f tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:50:52.048558 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bc1e3196-969a-4929-8d6c-2d3f9089fb6f tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:50:52.049183 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bc1e3196-969a-4929-8d6c-2d3f9089fb6f tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:50:52.258619 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-bc1e3196-969a-4929-8d6c-2d3f9089fb6f tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22419916fc2641f88bfbdf103e7c3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf4cd612f04e91b3be2e7ca5658b97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:50:52.267129 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-bc1e3196-969a-4929-8d6c-2d3f9089fb6f tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] 10.222.0.18 "GET /compute/v2.1/servers/e3f9f3ab-26f2-427b-9dc5-bfc007cdef20" status: 200 len: 1517 microversion: 2.1 time: 0.233686 Oct 22 21:50:52.267770 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3135/6299] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:50:52 2022] GET /compute/v2.1/servers/e3f9f3ab-26f2-427b-9dc5-bfc007cdef20 => generated 1517 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:50:53.296825 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-94b73766-780a-4ba5-ab87-019ca6618f95 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:50:53.297838 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-94b73766-780a-4ba5-ab87-019ca6618f95 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] [instance: e3f9f3ab-26f2-427b-9dc5-bfc007cdef20] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:50:53.310213 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-94b73766-780a-4ba5-ab87-019ca6618f95 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:50:53.311046 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-94b73766-780a-4ba5-ab87-019ca6618f95 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:50:53.311845 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-94b73766-780a-4ba5-ab87-019ca6618f95 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:50:53.313034 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-94b73766-780a-4ba5-ab87-019ca6618f95 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:50:53.313813 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-94b73766-780a-4ba5-ab87-019ca6618f95 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:50:53.314715 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-94b73766-780a-4ba5-ab87-019ca6618f95 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:50:53.455968 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-94b73766-780a-4ba5-ab87-019ca6618f95 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22419916fc2641f88bfbdf103e7c3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf4cd612f04e91b3be2e7ca5658b97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:50:53.468868 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-94b73766-780a-4ba5-ab87-019ca6618f95 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] 10.222.0.18 "GET /compute/v2.1/servers/e3f9f3ab-26f2-427b-9dc5-bfc007cdef20" status: 200 len: 1522 microversion: 2.1 time: 0.179409 Oct 22 21:50:53.469664 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3165/6300] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:50:53 2022] GET /compute/v2.1/servers/e3f9f3ab-26f2-427b-9dc5-bfc007cdef20 => generated 1522 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:50:54.497519 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-723a3ac1-e629-431f-aa30-005999e6b66b tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:50:54.498625 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-723a3ac1-e629-431f-aa30-005999e6b66b tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] [instance: e3f9f3ab-26f2-427b-9dc5-bfc007cdef20] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:50:54.510680 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-723a3ac1-e629-431f-aa30-005999e6b66b tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:50:54.511548 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-723a3ac1-e629-431f-aa30-005999e6b66b tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:50:54.512289 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-723a3ac1-e629-431f-aa30-005999e6b66b tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:50:54.513455 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-723a3ac1-e629-431f-aa30-005999e6b66b tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:50:54.514231 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-723a3ac1-e629-431f-aa30-005999e6b66b tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:50:54.514945 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-723a3ac1-e629-431f-aa30-005999e6b66b tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:50:54.649816 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-723a3ac1-e629-431f-aa30-005999e6b66b tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22419916fc2641f88bfbdf103e7c3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf4cd612f04e91b3be2e7ca5658b97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:50:54.658202 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-723a3ac1-e629-431f-aa30-005999e6b66b tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] 10.222.0.18 "GET /compute/v2.1/servers/e3f9f3ab-26f2-427b-9dc5-bfc007cdef20" status: 200 len: 1522 microversion: 2.1 time: 0.167405 Oct 22 21:50:54.658825 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3136/6301] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:50:54 2022] GET /compute/v2.1/servers/e3f9f3ab-26f2-427b-9dc5-bfc007cdef20 => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:50:55.682089 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-84e77cff-1d58-48e6-a444-fc31767dab86 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:50:55.682740 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-84e77cff-1d58-48e6-a444-fc31767dab86 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] [instance: e3f9f3ab-26f2-427b-9dc5-bfc007cdef20] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:50:55.690295 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-84e77cff-1d58-48e6-a444-fc31767dab86 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:50:55.690783 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-84e77cff-1d58-48e6-a444-fc31767dab86 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:50:55.691261 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-84e77cff-1d58-48e6-a444-fc31767dab86 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:50:55.692024 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-84e77cff-1d58-48e6-a444-fc31767dab86 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:50:55.692469 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-84e77cff-1d58-48e6-a444-fc31767dab86 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:50:55.692907 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-84e77cff-1d58-48e6-a444-fc31767dab86 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:50:55.840029 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-84e77cff-1d58-48e6-a444-fc31767dab86 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22419916fc2641f88bfbdf103e7c3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf4cd612f04e91b3be2e7ca5658b97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:50:55.848561 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-84e77cff-1d58-48e6-a444-fc31767dab86 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] 10.222.0.18 "GET /compute/v2.1/servers/e3f9f3ab-26f2-427b-9dc5-bfc007cdef20" status: 200 len: 1522 microversion: 2.1 time: 0.170503 Oct 22 21:50:55.849133 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3166/6302] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:50:55 2022] GET /compute/v2.1/servers/e3f9f3ab-26f2-427b-9dc5-bfc007cdef20 => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:50:56.875097 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-6770304e-066d-4151-87a5-88a926ea3d90 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:50:56.876129 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-6770304e-066d-4151-87a5-88a926ea3d90 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] [instance: e3f9f3ab-26f2-427b-9dc5-bfc007cdef20] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:50:56.887107 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6770304e-066d-4151-87a5-88a926ea3d90 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:50:56.887909 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6770304e-066d-4151-87a5-88a926ea3d90 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:50:56.888600 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6770304e-066d-4151-87a5-88a926ea3d90 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:50:56.889655 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6770304e-066d-4151-87a5-88a926ea3d90 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:50:56.890439 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6770304e-066d-4151-87a5-88a926ea3d90 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:50:56.891061 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6770304e-066d-4151-87a5-88a926ea3d90 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:50:57.036721 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-6770304e-066d-4151-87a5-88a926ea3d90 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22419916fc2641f88bfbdf103e7c3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf4cd612f04e91b3be2e7ca5658b97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:50:57.045121 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-6770304e-066d-4151-87a5-88a926ea3d90 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] 10.222.0.18 "GET /compute/v2.1/servers/e3f9f3ab-26f2-427b-9dc5-bfc007cdef20" status: 200 len: 1522 microversion: 2.1 time: 0.175995 Oct 22 21:50:57.045692 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3137/6303] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:50:56 2022] GET /compute/v2.1/servers/e3f9f3ab-26f2-427b-9dc5-bfc007cdef20 => generated 1522 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:50:58.073497 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-1ec8c3bc-0687-4113-90e5-931f91e74d22 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:50:58.074508 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-1ec8c3bc-0687-4113-90e5-931f91e74d22 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] [instance: e3f9f3ab-26f2-427b-9dc5-bfc007cdef20] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:50:58.084397 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1ec8c3bc-0687-4113-90e5-931f91e74d22 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:50:58.084903 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1ec8c3bc-0687-4113-90e5-931f91e74d22 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:50:58.085362 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1ec8c3bc-0687-4113-90e5-931f91e74d22 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:50:58.086080 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1ec8c3bc-0687-4113-90e5-931f91e74d22 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:50:58.086552 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1ec8c3bc-0687-4113-90e5-931f91e74d22 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:50:58.086997 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1ec8c3bc-0687-4113-90e5-931f91e74d22 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:50:58.219757 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-1ec8c3bc-0687-4113-90e5-931f91e74d22 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22419916fc2641f88bfbdf103e7c3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf4cd612f04e91b3be2e7ca5658b97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:50:58.228002 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-1ec8c3bc-0687-4113-90e5-931f91e74d22 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] 10.222.0.18 "GET /compute/v2.1/servers/e3f9f3ab-26f2-427b-9dc5-bfc007cdef20" status: 200 len: 1522 microversion: 2.1 time: 0.161237 Oct 22 21:50:58.228582 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3167/6304] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:50:58 2022] GET /compute/v2.1/servers/e3f9f3ab-26f2-427b-9dc5-bfc007cdef20 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:50:59.254920 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-eadaec61-35b5-4567-8191-d7802341f4d6 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:50:59.255513 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-eadaec61-35b5-4567-8191-d7802341f4d6 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] [instance: e3f9f3ab-26f2-427b-9dc5-bfc007cdef20] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:50:59.262616 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-eadaec61-35b5-4567-8191-d7802341f4d6 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:50:59.263118 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-eadaec61-35b5-4567-8191-d7802341f4d6 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:50:59.263599 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-eadaec61-35b5-4567-8191-d7802341f4d6 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:50:59.264308 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-eadaec61-35b5-4567-8191-d7802341f4d6 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:50:59.264765 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-eadaec61-35b5-4567-8191-d7802341f4d6 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:50:59.265182 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-eadaec61-35b5-4567-8191-d7802341f4d6 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:50:59.407046 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-eadaec61-35b5-4567-8191-d7802341f4d6 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22419916fc2641f88bfbdf103e7c3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf4cd612f04e91b3be2e7ca5658b97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:50:59.415452 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-eadaec61-35b5-4567-8191-d7802341f4d6 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] 10.222.0.18 "GET /compute/v2.1/servers/e3f9f3ab-26f2-427b-9dc5-bfc007cdef20" status: 200 len: 1522 microversion: 2.1 time: 0.166482 Oct 22 21:50:59.416037 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3138/6305] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:50:59 2022] GET /compute/v2.1/servers/e3f9f3ab-26f2-427b-9dc5-bfc007cdef20 => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:51:00.442923 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-16ef4e1d-b19a-4755-99f3-e1a9fa0393d0 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:51:00.443992 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-16ef4e1d-b19a-4755-99f3-e1a9fa0393d0 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] [instance: e3f9f3ab-26f2-427b-9dc5-bfc007cdef20] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:51:00.456323 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-16ef4e1d-b19a-4755-99f3-e1a9fa0393d0 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:51:00.456818 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-16ef4e1d-b19a-4755-99f3-e1a9fa0393d0 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:51:00.457266 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-16ef4e1d-b19a-4755-99f3-e1a9fa0393d0 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:51:00.457974 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-16ef4e1d-b19a-4755-99f3-e1a9fa0393d0 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:51:00.458476 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-16ef4e1d-b19a-4755-99f3-e1a9fa0393d0 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:51:00.458918 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-16ef4e1d-b19a-4755-99f3-e1a9fa0393d0 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:51:00.604959 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-16ef4e1d-b19a-4755-99f3-e1a9fa0393d0 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22419916fc2641f88bfbdf103e7c3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf4cd612f04e91b3be2e7ca5658b97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:51:00.613412 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-16ef4e1d-b19a-4755-99f3-e1a9fa0393d0 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] 10.222.0.18 "GET /compute/v2.1/servers/e3f9f3ab-26f2-427b-9dc5-bfc007cdef20" status: 200 len: 1522 microversion: 2.1 time: 0.177158 Oct 22 21:51:00.614007 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3168/6306] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:51:00 2022] GET /compute/v2.1/servers/e3f9f3ab-26f2-427b-9dc5-bfc007cdef20 => generated 1522 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:51:01.641282 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-39943b3d-b525-471c-a49f-8817c3635031 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:51:01.642126 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-39943b3d-b525-471c-a49f-8817c3635031 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] [instance: e3f9f3ab-26f2-427b-9dc5-bfc007cdef20] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:51:01.654863 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-39943b3d-b525-471c-a49f-8817c3635031 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:51:01.655376 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-39943b3d-b525-471c-a49f-8817c3635031 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:51:01.656139 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-39943b3d-b525-471c-a49f-8817c3635031 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:51:01.657322 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-39943b3d-b525-471c-a49f-8817c3635031 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:51:01.658100 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-39943b3d-b525-471c-a49f-8817c3635031 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:51:01.659127 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-39943b3d-b525-471c-a49f-8817c3635031 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:51:01.803132 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-39943b3d-b525-471c-a49f-8817c3635031 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22419916fc2641f88bfbdf103e7c3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf4cd612f04e91b3be2e7ca5658b97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:51:01.811843 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-39943b3d-b525-471c-a49f-8817c3635031 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] 10.222.0.18 "GET /compute/v2.1/servers/e3f9f3ab-26f2-427b-9dc5-bfc007cdef20" status: 200 len: 1522 microversion: 2.1 time: 0.177302 Oct 22 21:51:01.812411 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3139/6307] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:51:01 2022] GET /compute/v2.1/servers/e3f9f3ab-26f2-427b-9dc5-bfc007cdef20 => generated 1522 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:51:02.834678 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-e592e2dc-07be-44f1-ab8e-9f46b1b1ba13 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:51:02.835307 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-e592e2dc-07be-44f1-ab8e-9f46b1b1ba13 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] [instance: e3f9f3ab-26f2-427b-9dc5-bfc007cdef20] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:51:02.842742 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e592e2dc-07be-44f1-ab8e-9f46b1b1ba13 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:51:02.843629 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e592e2dc-07be-44f1-ab8e-9f46b1b1ba13 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:51:02.844090 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e592e2dc-07be-44f1-ab8e-9f46b1b1ba13 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:51:02.844802 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e592e2dc-07be-44f1-ab8e-9f46b1b1ba13 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:51:02.845272 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e592e2dc-07be-44f1-ab8e-9f46b1b1ba13 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:51:02.845716 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e592e2dc-07be-44f1-ab8e-9f46b1b1ba13 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:51:02.981346 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-e592e2dc-07be-44f1-ab8e-9f46b1b1ba13 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22419916fc2641f88bfbdf103e7c3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf4cd612f04e91b3be2e7ca5658b97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:51:02.993081 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-e592e2dc-07be-44f1-ab8e-9f46b1b1ba13 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] 10.222.0.18 "GET /compute/v2.1/servers/e3f9f3ab-26f2-427b-9dc5-bfc007cdef20" status: 200 len: 1522 microversion: 2.1 time: 0.162287 Oct 22 21:51:02.993853 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3169/6308] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:51:02 2022] GET /compute/v2.1/servers/e3f9f3ab-26f2-427b-9dc5-bfc007cdef20 => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:51:04.023809 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-085e4547-96e1-479f-81c2-4a513d0057a7 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:51:04.024869 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-085e4547-96e1-479f-81c2-4a513d0057a7 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] [instance: e3f9f3ab-26f2-427b-9dc5-bfc007cdef20] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:51:04.035678 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-085e4547-96e1-479f-81c2-4a513d0057a7 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:51:04.036164 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-085e4547-96e1-479f-81c2-4a513d0057a7 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:51:04.036605 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-085e4547-96e1-479f-81c2-4a513d0057a7 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:51:04.037295 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-085e4547-96e1-479f-81c2-4a513d0057a7 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:51:04.037747 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-085e4547-96e1-479f-81c2-4a513d0057a7 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:51:04.038175 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-085e4547-96e1-479f-81c2-4a513d0057a7 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:51:04.173054 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-085e4547-96e1-479f-81c2-4a513d0057a7 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22419916fc2641f88bfbdf103e7c3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf4cd612f04e91b3be2e7ca5658b97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:51:04.181657 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-085e4547-96e1-479f-81c2-4a513d0057a7 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] 10.222.0.18 "GET /compute/v2.1/servers/e3f9f3ab-26f2-427b-9dc5-bfc007cdef20" status: 200 len: 1522 microversion: 2.1 time: 0.165318 Oct 22 21:51:04.182240 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3140/6309] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:51:04 2022] GET /compute/v2.1/servers/e3f9f3ab-26f2-427b-9dc5-bfc007cdef20 => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:51:05.209566 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-faf157bb-85c9-4e2c-a247-00ca7fcf4450 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:51:05.210521 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-faf157bb-85c9-4e2c-a247-00ca7fcf4450 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] [instance: e3f9f3ab-26f2-427b-9dc5-bfc007cdef20] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:51:05.222581 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-faf157bb-85c9-4e2c-a247-00ca7fcf4450 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:51:05.223089 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-faf157bb-85c9-4e2c-a247-00ca7fcf4450 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:51:05.223588 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-faf157bb-85c9-4e2c-a247-00ca7fcf4450 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:51:05.224309 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-faf157bb-85c9-4e2c-a247-00ca7fcf4450 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:51:05.224793 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-faf157bb-85c9-4e2c-a247-00ca7fcf4450 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:51:05.225233 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-faf157bb-85c9-4e2c-a247-00ca7fcf4450 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:51:05.356281 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-faf157bb-85c9-4e2c-a247-00ca7fcf4450 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22419916fc2641f88bfbdf103e7c3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf4cd612f04e91b3be2e7ca5658b97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:51:05.364606 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-faf157bb-85c9-4e2c-a247-00ca7fcf4450 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] 10.222.0.18 "GET /compute/v2.1/servers/e3f9f3ab-26f2-427b-9dc5-bfc007cdef20" status: 200 len: 1522 microversion: 2.1 time: 0.161866 Oct 22 21:51:05.365185 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3170/6310] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:51:05 2022] GET /compute/v2.1/servers/e3f9f3ab-26f2-427b-9dc5-bfc007cdef20 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:51:06.392698 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-2d67f10b-5b0c-44df-be20-114f42190922 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:51:06.393740 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-2d67f10b-5b0c-44df-be20-114f42190922 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] [instance: e3f9f3ab-26f2-427b-9dc5-bfc007cdef20] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:51:06.401057 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2d67f10b-5b0c-44df-be20-114f42190922 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:51:06.401555 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2d67f10b-5b0c-44df-be20-114f42190922 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:51:06.402006 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2d67f10b-5b0c-44df-be20-114f42190922 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:51:06.402714 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2d67f10b-5b0c-44df-be20-114f42190922 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:51:06.403182 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2d67f10b-5b0c-44df-be20-114f42190922 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:51:06.403653 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2d67f10b-5b0c-44df-be20-114f42190922 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:51:06.545936 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-2d67f10b-5b0c-44df-be20-114f42190922 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22419916fc2641f88bfbdf103e7c3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf4cd612f04e91b3be2e7ca5658b97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:51:06.557922 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-2d67f10b-5b0c-44df-be20-114f42190922 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] 10.222.0.18 "GET /compute/v2.1/servers/e3f9f3ab-26f2-427b-9dc5-bfc007cdef20" status: 200 len: 1522 microversion: 2.1 time: 0.171864 Oct 22 21:51:06.558720 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3141/6311] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:51:06 2022] GET /compute/v2.1/servers/e3f9f3ab-26f2-427b-9dc5-bfc007cdef20 => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:51:07.596390 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-453e2916-2544-48cb-83fe-664114c263a3 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:51:07.597634 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-453e2916-2544-48cb-83fe-664114c263a3 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] [instance: e3f9f3ab-26f2-427b-9dc5-bfc007cdef20] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:51:07.604849 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-453e2916-2544-48cb-83fe-664114c263a3 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:51:07.605347 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-453e2916-2544-48cb-83fe-664114c263a3 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:51:07.605798 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-453e2916-2544-48cb-83fe-664114c263a3 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:51:07.606537 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-453e2916-2544-48cb-83fe-664114c263a3 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:51:07.607007 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-453e2916-2544-48cb-83fe-664114c263a3 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:51:07.607469 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-453e2916-2544-48cb-83fe-664114c263a3 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:51:07.745107 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-453e2916-2544-48cb-83fe-664114c263a3 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22419916fc2641f88bfbdf103e7c3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf4cd612f04e91b3be2e7ca5658b97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:51:07.753618 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-453e2916-2544-48cb-83fe-664114c263a3 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] 10.222.0.18 "GET /compute/v2.1/servers/e3f9f3ab-26f2-427b-9dc5-bfc007cdef20" status: 200 len: 1522 microversion: 2.1 time: 0.165699 Oct 22 21:51:07.754195 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3171/6312] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:51:07 2022] GET /compute/v2.1/servers/e3f9f3ab-26f2-427b-9dc5-bfc007cdef20 => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:51:08.780880 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-9386ed64-de28-4af3-9df5-41d72d9a7cd5 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:51:08.781825 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-9386ed64-de28-4af3-9df5-41d72d9a7cd5 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] [instance: e3f9f3ab-26f2-427b-9dc5-bfc007cdef20] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:51:08.793694 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9386ed64-de28-4af3-9df5-41d72d9a7cd5 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:51:08.794532 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9386ed64-de28-4af3-9df5-41d72d9a7cd5 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:51:08.795267 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9386ed64-de28-4af3-9df5-41d72d9a7cd5 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:51:08.796522 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9386ed64-de28-4af3-9df5-41d72d9a7cd5 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:51:08.797282 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9386ed64-de28-4af3-9df5-41d72d9a7cd5 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:51:08.798006 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9386ed64-de28-4af3-9df5-41d72d9a7cd5 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:51:08.941563 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-9386ed64-de28-4af3-9df5-41d72d9a7cd5 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22419916fc2641f88bfbdf103e7c3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf4cd612f04e91b3be2e7ca5658b97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:51:08.949724 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-9386ed64-de28-4af3-9df5-41d72d9a7cd5 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] 10.222.0.18 "GET /compute/v2.1/servers/e3f9f3ab-26f2-427b-9dc5-bfc007cdef20" status: 200 len: 1522 microversion: 2.1 time: 0.175518 Oct 22 21:51:08.950313 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3142/6313] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:51:08 2022] GET /compute/v2.1/servers/e3f9f3ab-26f2-427b-9dc5-bfc007cdef20 => generated 1522 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:51:09.975984 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-1caa9dc3-14d5-4f80-be85-2d2c4907db7f tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:51:09.976787 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-1caa9dc3-14d5-4f80-be85-2d2c4907db7f tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] [instance: e3f9f3ab-26f2-427b-9dc5-bfc007cdef20] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:51:09.984209 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1caa9dc3-14d5-4f80-be85-2d2c4907db7f tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:51:09.984710 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1caa9dc3-14d5-4f80-be85-2d2c4907db7f tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:51:09.985156 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1caa9dc3-14d5-4f80-be85-2d2c4907db7f tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:51:09.985871 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1caa9dc3-14d5-4f80-be85-2d2c4907db7f tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:51:09.986365 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1caa9dc3-14d5-4f80-be85-2d2c4907db7f tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:51:09.986802 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1caa9dc3-14d5-4f80-be85-2d2c4907db7f tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:51:10.131043 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-1caa9dc3-14d5-4f80-be85-2d2c4907db7f tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22419916fc2641f88bfbdf103e7c3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf4cd612f04e91b3be2e7ca5658b97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:51:10.142854 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-1caa9dc3-14d5-4f80-be85-2d2c4907db7f tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] 10.222.0.18 "GET /compute/v2.1/servers/e3f9f3ab-26f2-427b-9dc5-bfc007cdef20" status: 200 len: 1522 microversion: 2.1 time: 0.171827 Oct 22 21:51:10.143684 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3172/6314] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:51:09 2022] GET /compute/v2.1/servers/e3f9f3ab-26f2-427b-9dc5-bfc007cdef20 => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:51:11.166469 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-d44de7ff-bb19-4535-b93a-1ef70f985cf3 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:51:11.167100 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-d44de7ff-bb19-4535-b93a-1ef70f985cf3 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] [instance: e3f9f3ab-26f2-427b-9dc5-bfc007cdef20] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:51:11.174566 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d44de7ff-bb19-4535-b93a-1ef70f985cf3 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:51:11.175055 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d44de7ff-bb19-4535-b93a-1ef70f985cf3 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:51:11.175534 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d44de7ff-bb19-4535-b93a-1ef70f985cf3 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:51:11.176238 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d44de7ff-bb19-4535-b93a-1ef70f985cf3 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:51:11.176691 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d44de7ff-bb19-4535-b93a-1ef70f985cf3 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:51:11.177117 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d44de7ff-bb19-4535-b93a-1ef70f985cf3 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:51:11.381087 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-d44de7ff-bb19-4535-b93a-1ef70f985cf3 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22419916fc2641f88bfbdf103e7c3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf4cd612f04e91b3be2e7ca5658b97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:51:11.389651 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-d44de7ff-bb19-4535-b93a-1ef70f985cf3 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] 10.222.0.18 "GET /compute/v2.1/servers/e3f9f3ab-26f2-427b-9dc5-bfc007cdef20" status: 200 len: 1522 microversion: 2.1 time: 0.227319 Oct 22 21:51:11.390230 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3143/6315] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:51:11 2022] GET /compute/v2.1/servers/e3f9f3ab-26f2-427b-9dc5-bfc007cdef20 => generated 1522 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:51:12.417698 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-defcb40e-d72e-4e6d-b705-54168819c14b tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:51:12.418670 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-defcb40e-d72e-4e6d-b705-54168819c14b tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] [instance: e3f9f3ab-26f2-427b-9dc5-bfc007cdef20] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:51:12.429862 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-defcb40e-d72e-4e6d-b705-54168819c14b tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:51:12.430367 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-defcb40e-d72e-4e6d-b705-54168819c14b tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:51:12.430825 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-defcb40e-d72e-4e6d-b705-54168819c14b tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:51:12.431593 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-defcb40e-d72e-4e6d-b705-54168819c14b tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:51:12.432065 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-defcb40e-d72e-4e6d-b705-54168819c14b tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:51:12.432545 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-defcb40e-d72e-4e6d-b705-54168819c14b tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:51:12.451494 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:51:12.566249 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-defcb40e-d72e-4e6d-b705-54168819c14b tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22419916fc2641f88bfbdf103e7c3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf4cd612f04e91b3be2e7ca5658b97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:51:12.574289 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-defcb40e-d72e-4e6d-b705-54168819c14b tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] 10.222.0.18 "GET /compute/v2.1/servers/e3f9f3ab-26f2-427b-9dc5-bfc007cdef20" status: 200 len: 1522 microversion: 2.1 time: 0.163405 Oct 22 21:51:12.574883 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3173/6316] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:51:12 2022] GET /compute/v2.1/servers/e3f9f3ab-26f2-427b-9dc5-bfc007cdef20 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:51:13.598814 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-9298c13f-f13d-44f5-a74c-db912b1f791e tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:51:13.599485 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-9298c13f-f13d-44f5-a74c-db912b1f791e tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] [instance: e3f9f3ab-26f2-427b-9dc5-bfc007cdef20] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:51:13.607453 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9298c13f-f13d-44f5-a74c-db912b1f791e tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:51:13.607948 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9298c13f-f13d-44f5-a74c-db912b1f791e tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:51:13.608394 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9298c13f-f13d-44f5-a74c-db912b1f791e tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:51:13.609100 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9298c13f-f13d-44f5-a74c-db912b1f791e tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:51:13.609561 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9298c13f-f13d-44f5-a74c-db912b1f791e tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:51:13.609994 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9298c13f-f13d-44f5-a74c-db912b1f791e tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:51:13.747098 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-9298c13f-f13d-44f5-a74c-db912b1f791e tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22419916fc2641f88bfbdf103e7c3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf4cd612f04e91b3be2e7ca5658b97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:51:13.755133 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-9298c13f-f13d-44f5-a74c-db912b1f791e tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] 10.222.0.18 "GET /compute/v2.1/servers/e3f9f3ab-26f2-427b-9dc5-bfc007cdef20" status: 200 len: 1522 microversion: 2.1 time: 0.160772 Oct 22 21:51:13.755769 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3144/6317] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:51:13 2022] GET /compute/v2.1/servers/e3f9f3ab-26f2-427b-9dc5-bfc007cdef20 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:51:14.778736 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-1a8c3877-a109-4c6b-9724-99b2c322f380 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:51:14.779334 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-1a8c3877-a109-4c6b-9724-99b2c322f380 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] [instance: e3f9f3ab-26f2-427b-9dc5-bfc007cdef20] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:51:14.786677 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1a8c3877-a109-4c6b-9724-99b2c322f380 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:51:14.787226 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1a8c3877-a109-4c6b-9724-99b2c322f380 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:51:14.787740 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1a8c3877-a109-4c6b-9724-99b2c322f380 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:51:14.788466 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1a8c3877-a109-4c6b-9724-99b2c322f380 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:51:14.788968 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1a8c3877-a109-4c6b-9724-99b2c322f380 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:51:14.789402 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1a8c3877-a109-4c6b-9724-99b2c322f380 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:51:14.928545 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-1a8c3877-a109-4c6b-9724-99b2c322f380 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22419916fc2641f88bfbdf103e7c3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf4cd612f04e91b3be2e7ca5658b97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:51:14.940608 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-1a8c3877-a109-4c6b-9724-99b2c322f380 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] 10.222.0.18 "GET /compute/v2.1/servers/e3f9f3ab-26f2-427b-9dc5-bfc007cdef20" status: 200 len: 1522 microversion: 2.1 time: 0.165616 Oct 22 21:51:14.941387 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3174/6318] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:51:14 2022] GET /compute/v2.1/servers/e3f9f3ab-26f2-427b-9dc5-bfc007cdef20 => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:51:15.965693 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-740b7d21-1f37-4437-b2b1-d34a4f6f2b85 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:51:15.966358 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-740b7d21-1f37-4437-b2b1-d34a4f6f2b85 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] [instance: e3f9f3ab-26f2-427b-9dc5-bfc007cdef20] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:51:15.974876 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-740b7d21-1f37-4437-b2b1-d34a4f6f2b85 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:51:15.975451 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-740b7d21-1f37-4437-b2b1-d34a4f6f2b85 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:51:15.976078 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-740b7d21-1f37-4437-b2b1-d34a4f6f2b85 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:51:15.976776 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-740b7d21-1f37-4437-b2b1-d34a4f6f2b85 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:51:15.977230 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-740b7d21-1f37-4437-b2b1-d34a4f6f2b85 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:51:15.977659 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-740b7d21-1f37-4437-b2b1-d34a4f6f2b85 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:51:15.992818 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:51:16.115283 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-740b7d21-1f37-4437-b2b1-d34a4f6f2b85 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22419916fc2641f88bfbdf103e7c3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf4cd612f04e91b3be2e7ca5658b97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:51:16.124072 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-740b7d21-1f37-4437-b2b1-d34a4f6f2b85 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] 10.222.0.18 "GET /compute/v2.1/servers/e3f9f3ab-26f2-427b-9dc5-bfc007cdef20" status: 200 len: 1522 microversion: 2.1 time: 0.162771 Oct 22 21:51:16.124649 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3145/6319] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:51:15 2022] GET /compute/v2.1/servers/e3f9f3ab-26f2-427b-9dc5-bfc007cdef20 => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:51:17.150972 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-39ffc61d-a108-4a33-b478-0227899f62fa tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:51:17.151664 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-39ffc61d-a108-4a33-b478-0227899f62fa tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] [instance: e3f9f3ab-26f2-427b-9dc5-bfc007cdef20] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:51:17.159724 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-39ffc61d-a108-4a33-b478-0227899f62fa tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:51:17.160280 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-39ffc61d-a108-4a33-b478-0227899f62fa tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:51:17.160803 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-39ffc61d-a108-4a33-b478-0227899f62fa tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:51:17.161593 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-39ffc61d-a108-4a33-b478-0227899f62fa tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:51:17.162111 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-39ffc61d-a108-4a33-b478-0227899f62fa tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:51:17.162621 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-39ffc61d-a108-4a33-b478-0227899f62fa tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:51:17.311051 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-39ffc61d-a108-4a33-b478-0227899f62fa tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22419916fc2641f88bfbdf103e7c3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf4cd612f04e91b3be2e7ca5658b97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:51:17.324134 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-39ffc61d-a108-4a33-b478-0227899f62fa tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] 10.222.0.18 "GET /compute/v2.1/servers/e3f9f3ab-26f2-427b-9dc5-bfc007cdef20" status: 200 len: 1522 microversion: 2.1 time: 0.178129 Oct 22 21:51:17.324901 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3175/6320] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:51:17 2022] GET /compute/v2.1/servers/e3f9f3ab-26f2-427b-9dc5-bfc007cdef20 => generated 1522 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:51:18.356153 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-618d15b2-aa21-4ebe-a646-b51363a84fef tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:51:18.356829 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-618d15b2-aa21-4ebe-a646-b51363a84fef tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] [instance: e3f9f3ab-26f2-427b-9dc5-bfc007cdef20] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:51:18.365353 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-618d15b2-aa21-4ebe-a646-b51363a84fef tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:51:18.365930 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-618d15b2-aa21-4ebe-a646-b51363a84fef tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:51:18.366449 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-618d15b2-aa21-4ebe-a646-b51363a84fef tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:51:18.367278 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-618d15b2-aa21-4ebe-a646-b51363a84fef tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:51:18.367854 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-618d15b2-aa21-4ebe-a646-b51363a84fef tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:51:18.368365 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-618d15b2-aa21-4ebe-a646-b51363a84fef tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:51:18.506315 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-618d15b2-aa21-4ebe-a646-b51363a84fef tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22419916fc2641f88bfbdf103e7c3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf4cd612f04e91b3be2e7ca5658b97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:51:18.514739 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-618d15b2-aa21-4ebe-a646-b51363a84fef tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] 10.222.0.18 "GET /compute/v2.1/servers/e3f9f3ab-26f2-427b-9dc5-bfc007cdef20" status: 200 len: 1522 microversion: 2.1 time: 0.164503 Oct 22 21:51:18.515323 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3146/6321] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:51:18 2022] GET /compute/v2.1/servers/e3f9f3ab-26f2-427b-9dc5-bfc007cdef20 => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:51:19.542752 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-27ce69fb-d1cb-4078-a4cc-fe4602e0f1d2 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:51:19.543786 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-27ce69fb-d1cb-4078-a4cc-fe4602e0f1d2 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] [instance: e3f9f3ab-26f2-427b-9dc5-bfc007cdef20] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:51:19.555601 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-27ce69fb-d1cb-4078-a4cc-fe4602e0f1d2 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:51:19.556402 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-27ce69fb-d1cb-4078-a4cc-fe4602e0f1d2 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:51:19.556886 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-27ce69fb-d1cb-4078-a4cc-fe4602e0f1d2 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:51:19.557615 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-27ce69fb-d1cb-4078-a4cc-fe4602e0f1d2 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:51:19.558092 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-27ce69fb-d1cb-4078-a4cc-fe4602e0f1d2 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:51:19.558544 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-27ce69fb-d1cb-4078-a4cc-fe4602e0f1d2 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:51:19.704153 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-27ce69fb-d1cb-4078-a4cc-fe4602e0f1d2 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22419916fc2641f88bfbdf103e7c3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf4cd612f04e91b3be2e7ca5658b97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:51:19.716823 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-27ce69fb-d1cb-4078-a4cc-fe4602e0f1d2 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] 10.222.0.18 "GET /compute/v2.1/servers/e3f9f3ab-26f2-427b-9dc5-bfc007cdef20" status: 200 len: 1522 microversion: 2.1 time: 0.180742 Oct 22 21:51:19.717634 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3176/6322] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:51:19 2022] GET /compute/v2.1/servers/e3f9f3ab-26f2-427b-9dc5-bfc007cdef20 => generated 1522 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:51:20.470809 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-a6e23359-770d-4331-8e34-5661db2421f9 req-28c60c1c-1201-4883-ae3e-483ea74dec25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3f9f3ab-26f2-427b-9dc5-bfc007cdef20", "name": "network-vif-unplugged", "status": "completed", "tag": "b734f414-d5bc-4142-b5a0-68e23fd574a8"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:51:20.476661 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_api:SELECT=34 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:51:20.483077 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-a6e23359-770d-4331-8e34-5661db2421f9 req-28c60c1c-1201-4883-ae3e-483ea74dec25 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:51:20.483606 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-a6e23359-770d-4331-8e34-5661db2421f9 req-28c60c1c-1201-4883-ae3e-483ea74dec25 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:51:20.484059 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-a6e23359-770d-4331-8e34-5661db2421f9 req-28c60c1c-1201-4883-ae3e-483ea74dec25 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:51:20.497564 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-a6e23359-770d-4331-8e34-5661db2421f9 req-28c60c1c-1201-4883-ae3e-483ea74dec25 service nova] Creating event network-vif-unplugged:b734f414-d5bc-4142-b5a0-68e23fd574a8 for instance e3f9f3ab-26f2-427b-9dc5-bfc007cdef20 on nch1-master-1 Oct 22 21:51:20.503406 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [req-a6e23359-770d-4331-8e34-5661db2421f9 req-28c60c1c-1201-4883-ae3e-483ea74dec25 service nova] Instance e3f9f3ab-26f2-427b-9dc5-bfc007cdef20 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=138744) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 22 21:51:20.514747 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-a6e23359-770d-4331-8e34-5661db2421f9 req-28c60c1c-1201-4883-ae3e-483ea74dec25 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048644 Oct 22 21:51:20.515566 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3147/6323] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:51:20 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:51:20.745753 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-5d97db17-398b-45b9-ab64-8b7e7b5f7530 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:51:20.746385 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-5d97db17-398b-45b9-ab64-8b7e7b5f7530 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] [instance: e3f9f3ab-26f2-427b-9dc5-bfc007cdef20] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:51:20.749989 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_api:SELECT=28 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:51:20.756494 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5d97db17-398b-45b9-ab64-8b7e7b5f7530 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:51:20.756994 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5d97db17-398b-45b9-ab64-8b7e7b5f7530 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:51:20.757576 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5d97db17-398b-45b9-ab64-8b7e7b5f7530 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:51:20.758288 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5d97db17-398b-45b9-ab64-8b7e7b5f7530 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:51:20.758794 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5d97db17-398b-45b9-ab64-8b7e7b5f7530 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:51:20.759241 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5d97db17-398b-45b9-ab64-8b7e7b5f7530 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:51:20.902887 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-5d97db17-398b-45b9-ab64-8b7e7b5f7530 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22419916fc2641f88bfbdf103e7c3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf4cd612f04e91b3be2e7ca5658b97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:51:20.911425 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-5d97db17-398b-45b9-ab64-8b7e7b5f7530 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] 10.222.0.18 "GET /compute/v2.1/servers/e3f9f3ab-26f2-427b-9dc5-bfc007cdef20" status: 200 len: 1521 microversion: 2.1 time: 0.169801 Oct 22 21:51:20.912037 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3177/6324] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:51:20 2022] GET /compute/v2.1/servers/e3f9f3ab-26f2-427b-9dc5-bfc007cdef20 => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:51:21.937282 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-fa9360d6-a077-4a14-956a-a6b699a8cec7 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:51:21.938042 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-fa9360d6-a077-4a14-956a-a6b699a8cec7 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] [instance: e3f9f3ab-26f2-427b-9dc5-bfc007cdef20] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:51:21.944742 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fa9360d6-a077-4a14-956a-a6b699a8cec7 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:51:21.945228 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fa9360d6-a077-4a14-956a-a6b699a8cec7 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:51:21.945669 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fa9360d6-a077-4a14-956a-a6b699a8cec7 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:51:21.946372 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fa9360d6-a077-4a14-956a-a6b699a8cec7 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:51:21.946853 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fa9360d6-a077-4a14-956a-a6b699a8cec7 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:51:21.947599 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fa9360d6-a077-4a14-956a-a6b699a8cec7 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:51:22.079631 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-fa9360d6-a077-4a14-956a-a6b699a8cec7 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22419916fc2641f88bfbdf103e7c3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf4cd612f04e91b3be2e7ca5658b97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:51:22.088303 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-fa9360d6-a077-4a14-956a-a6b699a8cec7 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] 10.222.0.18 "GET /compute/v2.1/servers/e3f9f3ab-26f2-427b-9dc5-bfc007cdef20" status: 200 len: 1519 microversion: 2.1 time: 0.156254 Oct 22 21:51:22.088878 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3148/6325] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:51:21 2022] GET /compute/v2.1/servers/e3f9f3ab-26f2-427b-9dc5-bfc007cdef20 => generated 1519 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:51:22.534375 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-4a9becb5-b56f-416c-b517-27a4e6824a43 req-94862cea-5502-45e6-bdac-4c58e5308e1b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3f9f3ab-26f2-427b-9dc5-bfc007cdef20", "tag": "b734f414-d5bc-4142-b5a0-68e23fd574a8"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:51:22.545372 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-4a9becb5-b56f-416c-b517-27a4e6824a43 req-94862cea-5502-45e6-bdac-4c58e5308e1b service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:51:22.546003 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-4a9becb5-b56f-416c-b517-27a4e6824a43 req-94862cea-5502-45e6-bdac-4c58e5308e1b service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:51:22.546456 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-4a9becb5-b56f-416c-b517-27a4e6824a43 req-94862cea-5502-45e6-bdac-4c58e5308e1b service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:51:22.559084 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-4a9becb5-b56f-416c-b517-27a4e6824a43 req-94862cea-5502-45e6-bdac-4c58e5308e1b service nova] Creating event network-changed:b734f414-d5bc-4142-b5a0-68e23fd574a8 for instance e3f9f3ab-26f2-427b-9dc5-bfc007cdef20 on nch1-master-1 Oct 22 21:51:22.565346 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [req-4a9becb5-b56f-416c-b517-27a4e6824a43 req-94862cea-5502-45e6-bdac-4c58e5308e1b service nova] Instance e3f9f3ab-26f2-427b-9dc5-bfc007cdef20 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=138745) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 22 21:51:22.576264 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-4a9becb5-b56f-416c-b517-27a4e6824a43 req-94862cea-5502-45e6-bdac-4c58e5308e1b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045698 Oct 22 21:51:22.576883 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3178/6326] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:51:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:51:23.115038 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-f78b8970-778c-4170-9ddb-0ce17e7ac6bd tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:51:23.116244 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-f78b8970-778c-4170-9ddb-0ce17e7ac6bd tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] [instance: e3f9f3ab-26f2-427b-9dc5-bfc007cdef20] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:51:23.123732 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f78b8970-778c-4170-9ddb-0ce17e7ac6bd tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:51:23.124257 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f78b8970-778c-4170-9ddb-0ce17e7ac6bd tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:51:23.124676 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f78b8970-778c-4170-9ddb-0ce17e7ac6bd tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:51:23.125690 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f78b8970-778c-4170-9ddb-0ce17e7ac6bd tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:51:23.126182 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f78b8970-778c-4170-9ddb-0ce17e7ac6bd tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:51:23.126606 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f78b8970-778c-4170-9ddb-0ce17e7ac6bd tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:51:23.319955 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-f78b8970-778c-4170-9ddb-0ce17e7ac6bd tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22419916fc2641f88bfbdf103e7c3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf4cd612f04e91b3be2e7ca5658b97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:51:23.329245 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-f78b8970-778c-4170-9ddb-0ce17e7ac6bd tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] 10.222.0.18 "GET /compute/v2.1/servers/e3f9f3ab-26f2-427b-9dc5-bfc007cdef20" status: 200 len: 1519 microversion: 2.1 time: 0.219686 Oct 22 21:51:23.330647 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3149/6327] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:51:23 2022] GET /compute/v2.1/servers/e3f9f3ab-26f2-427b-9dc5-bfc007cdef20 => generated 1519 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:51:24.357035 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-4cad88be-b4ba-49ab-93b3-5242fd159e18 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:51:24.357757 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-4cad88be-b4ba-49ab-93b3-5242fd159e18 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] [instance: e3f9f3ab-26f2-427b-9dc5-bfc007cdef20] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:51:24.364770 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4cad88be-b4ba-49ab-93b3-5242fd159e18 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:51:24.365266 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4cad88be-b4ba-49ab-93b3-5242fd159e18 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:51:24.365744 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4cad88be-b4ba-49ab-93b3-5242fd159e18 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:51:24.366454 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4cad88be-b4ba-49ab-93b3-5242fd159e18 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:51:24.366919 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4cad88be-b4ba-49ab-93b3-5242fd159e18 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:51:24.367378 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4cad88be-b4ba-49ab-93b3-5242fd159e18 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:51:24.513153 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-4cad88be-b4ba-49ab-93b3-5242fd159e18 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22419916fc2641f88bfbdf103e7c3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf4cd612f04e91b3be2e7ca5658b97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:51:24.523792 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-4cad88be-b4ba-49ab-93b3-5242fd159e18 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] 10.222.0.18 "GET /compute/v2.1/servers/e3f9f3ab-26f2-427b-9dc5-bfc007cdef20" status: 200 len: 1519 microversion: 2.1 time: 0.173116 Oct 22 21:51:24.524835 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3179/6328] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:51:24 2022] GET /compute/v2.1/servers/e3f9f3ab-26f2-427b-9dc5-bfc007cdef20 => generated 1519 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:51:25.553062 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-675e8cfc-d51e-4b16-827c-e61507da866c tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:51:25.554067 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-675e8cfc-d51e-4b16-827c-e61507da866c tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] [instance: e3f9f3ab-26f2-427b-9dc5-bfc007cdef20] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:51:25.562787 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-675e8cfc-d51e-4b16-827c-e61507da866c tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:51:25.563273 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-675e8cfc-d51e-4b16-827c-e61507da866c tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:51:25.563743 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-675e8cfc-d51e-4b16-827c-e61507da866c tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:51:25.564442 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-675e8cfc-d51e-4b16-827c-e61507da866c tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:51:25.564894 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-675e8cfc-d51e-4b16-827c-e61507da866c tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:51:25.565320 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-675e8cfc-d51e-4b16-827c-e61507da866c tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:51:25.704100 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-675e8cfc-d51e-4b16-827c-e61507da866c tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22419916fc2641f88bfbdf103e7c3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf4cd612f04e91b3be2e7ca5658b97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:51:25.712229 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-675e8cfc-d51e-4b16-827c-e61507da866c tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] 10.222.0.18 "GET /compute/v2.1/servers/e3f9f3ab-26f2-427b-9dc5-bfc007cdef20" status: 200 len: 1516 microversion: 2.1 time: 0.165772 Oct 22 21:51:25.712870 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3150/6329] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:51:25 2022] GET /compute/v2.1/servers/e3f9f3ab-26f2-427b-9dc5-bfc007cdef20 => generated 1516 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:51:25.735258 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-1373967c-e066-4de1-949d-5c8aeed45c49 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:51:25.735858 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-1373967c-e066-4de1-949d-5c8aeed45c49 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] [instance: e3f9f3ab-26f2-427b-9dc5-bfc007cdef20] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:51:25.743143 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1373967c-e066-4de1-949d-5c8aeed45c49 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:51:25.743702 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1373967c-e066-4de1-949d-5c8aeed45c49 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:51:25.744273 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1373967c-e066-4de1-949d-5c8aeed45c49 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:51:25.744983 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1373967c-e066-4de1-949d-5c8aeed45c49 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:51:25.745448 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1373967c-e066-4de1-949d-5c8aeed45c49 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:51:25.745885 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1373967c-e066-4de1-949d-5c8aeed45c49 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:51:25.818413 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-1373967c-e066-4de1-949d-5c8aeed45c49 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] 10.222.0.18 "POST /compute/v2.1/servers/e3f9f3ab-26f2-427b-9dc5-bfc007cdef20/action" status: 204 len: 0 microversion: 2.1 time: 0.086387 Oct 22 21:51:25.819260 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3180/6330] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 21:51:25 2022] POST /compute/v2.1/servers/e3f9f3ab-26f2-427b-9dc5-bfc007cdef20/action => generated 0 bytes in 89 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 21:51:25.831991 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-4bd41686-3745-42aa-9df5-e137f03a51e6 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:51:25.832706 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-4bd41686-3745-42aa-9df5-e137f03a51e6 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] [instance: e3f9f3ab-26f2-427b-9dc5-bfc007cdef20] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:51:25.839109 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4bd41686-3745-42aa-9df5-e137f03a51e6 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:51:25.839714 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4bd41686-3745-42aa-9df5-e137f03a51e6 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:51:25.840270 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4bd41686-3745-42aa-9df5-e137f03a51e6 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:51:25.841088 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4bd41686-3745-42aa-9df5-e137f03a51e6 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:51:25.841678 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4bd41686-3745-42aa-9df5-e137f03a51e6 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:51:25.842218 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4bd41686-3745-42aa-9df5-e137f03a51e6 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:51:26.048222 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-4bd41686-3745-42aa-9df5-e137f03a51e6 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22419916fc2641f88bfbdf103e7c3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf4cd612f04e91b3be2e7ca5658b97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:51:26.056295 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-4bd41686-3745-42aa-9df5-e137f03a51e6 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] 10.222.0.18 "GET /compute/v2.1/servers/e3f9f3ab-26f2-427b-9dc5-bfc007cdef20" status: 200 len: 1516 microversion: 2.1 time: 0.230216 Oct 22 21:51:26.056989 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3151/6331] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:51:25 2022] GET /compute/v2.1/servers/e3f9f3ab-26f2-427b-9dc5-bfc007cdef20 => generated 1516 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:51:26.762745 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-e69d134e-dfcd-420d-bcc0-a11dced87383 req-d7c9beff-9560-4034-8275-e4858b8b7f02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3f9f3ab-26f2-427b-9dc5-bfc007cdef20", "name": "network-vif-plugged", "status": "completed", "tag": "b734f414-d5bc-4142-b5a0-68e23fd574a8"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:51:26.774108 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-e69d134e-dfcd-420d-bcc0-a11dced87383 req-d7c9beff-9560-4034-8275-e4858b8b7f02 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:51:26.774815 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-e69d134e-dfcd-420d-bcc0-a11dced87383 req-d7c9beff-9560-4034-8275-e4858b8b7f02 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:51:26.775726 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-e69d134e-dfcd-420d-bcc0-a11dced87383 req-d7c9beff-9560-4034-8275-e4858b8b7f02 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:51:26.792034 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-e69d134e-dfcd-420d-bcc0-a11dced87383 req-d7c9beff-9560-4034-8275-e4858b8b7f02 service nova] Creating event network-vif-plugged:b734f414-d5bc-4142-b5a0-68e23fd574a8 for instance e3f9f3ab-26f2-427b-9dc5-bfc007cdef20 on nch1-master-1 Oct 22 21:51:26.797835 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [req-e69d134e-dfcd-420d-bcc0-a11dced87383 req-d7c9beff-9560-4034-8275-e4858b8b7f02 service nova] Instance e3f9f3ab-26f2-427b-9dc5-bfc007cdef20 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=138745) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 22 21:51:26.810076 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-e69d134e-dfcd-420d-bcc0-a11dced87383 req-d7c9beff-9560-4034-8275-e4858b8b7f02 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051332 Oct 22 21:51:26.810670 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3181/6332] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:51:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:51:27.080038 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-fb74270e-5434-41cd-8986-a4bf29deb560 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:51:27.080635 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-fb74270e-5434-41cd-8986-a4bf29deb560 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] [instance: e3f9f3ab-26f2-427b-9dc5-bfc007cdef20] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:51:27.087694 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fb74270e-5434-41cd-8986-a4bf29deb560 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:51:27.088258 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fb74270e-5434-41cd-8986-a4bf29deb560 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:51:27.088906 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fb74270e-5434-41cd-8986-a4bf29deb560 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:51:27.089591 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fb74270e-5434-41cd-8986-a4bf29deb560 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:51:27.090235 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fb74270e-5434-41cd-8986-a4bf29deb560 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:51:27.090673 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fb74270e-5434-41cd-8986-a4bf29deb560 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:51:27.232822 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-fb74270e-5434-41cd-8986-a4bf29deb560 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22419916fc2641f88bfbdf103e7c3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf4cd612f04e91b3be2e7ca5658b97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:51:27.241398 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-fb74270e-5434-41cd-8986-a4bf29deb560 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] 10.222.0.18 "GET /compute/v2.1/servers/e3f9f3ab-26f2-427b-9dc5-bfc007cdef20" status: 200 len: 1516 microversion: 2.1 time: 0.165458 Oct 22 21:51:27.242114 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3152/6333] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:51:27 2022] GET /compute/v2.1/servers/e3f9f3ab-26f2-427b-9dc5-bfc007cdef20 => generated 1516 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:51:28.267230 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-d40de0ec-648b-4824-bcd8-02f2e3ad46b6 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:51:28.268048 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-d40de0ec-648b-4824-bcd8-02f2e3ad46b6 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] [instance: e3f9f3ab-26f2-427b-9dc5-bfc007cdef20] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:51:28.276284 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d40de0ec-648b-4824-bcd8-02f2e3ad46b6 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:51:28.276790 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d40de0ec-648b-4824-bcd8-02f2e3ad46b6 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:51:28.277251 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d40de0ec-648b-4824-bcd8-02f2e3ad46b6 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:51:28.277983 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d40de0ec-648b-4824-bcd8-02f2e3ad46b6 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:51:28.278481 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d40de0ec-648b-4824-bcd8-02f2e3ad46b6 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:51:28.278930 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d40de0ec-648b-4824-bcd8-02f2e3ad46b6 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:51:28.425921 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-d40de0ec-648b-4824-bcd8-02f2e3ad46b6 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22419916fc2641f88bfbdf103e7c3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf4cd612f04e91b3be2e7ca5658b97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:51:28.434625 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-d40de0ec-648b-4824-bcd8-02f2e3ad46b6 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] 10.222.0.18 "GET /compute/v2.1/servers/e3f9f3ab-26f2-427b-9dc5-bfc007cdef20" status: 200 len: 1508 microversion: 2.1 time: 0.172589 Oct 22 21:51:28.435209 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3182/6334] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:51:28 2022] GET /compute/v2.1/servers/e3f9f3ab-26f2-427b-9dc5-bfc007cdef20 => generated 1508 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:51:28.459703 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-0647bfaa-5bb3-4bcb-8f8a-567b5e4a3055 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:51:28.460351 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-0647bfaa-5bb3-4bcb-8f8a-567b5e4a3055 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] [instance: e3f9f3ab-26f2-427b-9dc5-bfc007cdef20] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:51:28.468839 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0647bfaa-5bb3-4bcb-8f8a-567b5e4a3055 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:51:28.469388 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0647bfaa-5bb3-4bcb-8f8a-567b5e4a3055 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:51:28.469836 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0647bfaa-5bb3-4bcb-8f8a-567b5e4a3055 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:51:28.470547 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0647bfaa-5bb3-4bcb-8f8a-567b5e4a3055 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:51:28.471009 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0647bfaa-5bb3-4bcb-8f8a-567b5e4a3055 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:51:28.471473 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0647bfaa-5bb3-4bcb-8f8a-567b5e4a3055 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:51:28.619107 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-0647bfaa-5bb3-4bcb-8f8a-567b5e4a3055 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22419916fc2641f88bfbdf103e7c3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf4cd612f04e91b3be2e7ca5658b97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:51:28.627124 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-0647bfaa-5bb3-4bcb-8f8a-567b5e4a3055 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] 10.222.0.18 "GET /compute/v2.1/servers/e3f9f3ab-26f2-427b-9dc5-bfc007cdef20" status: 200 len: 1508 microversion: 2.1 time: 0.173770 Oct 22 21:51:28.627722 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3153/6335] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:51:28 2022] GET /compute/v2.1/servers/e3f9f3ab-26f2-427b-9dc5-bfc007cdef20 => generated 1508 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:51:28.654319 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-98a6b2c6-a563-4dca-81f3-b12ca5cd34c0 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Action: 'create', calling method: .version_select at 0x7fd39ef77790>, body: {"keypair": {"name": "tempest-keypair-1601736271", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGH/D5bcRooX/O0TEaWM/mzGXh1P8i9+YWrVC/TvRcrsdgJSzS2eyam6KIpqNT7CL+TG6BEdNhtvJ24QhsxkmmO356GG4f0/73NZCsSTrMShjFg5Ass9/QGqQfeALtwr9A=="}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:51:28.671965 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-98a6b2c6-a563-4dca-81f3-b12ca5cd34c0 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Getting quotas for project f4cf4cd612f04e91b3be2e7ca5658b97. Resources: {'key_pairs'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 21:51:28.677627 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-98a6b2c6-a563-4dca-81f3-b12ca5cd34c0 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Getting quotas for user 22419916fc2641f88bfbdf103e7c3ee6 and project f4cf4cd612f04e91b3be2e7ca5658b97. Resources: {'key_pairs'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 21:51:28.692360 ncdv-master-1 devstack@n-api.service[138745]: ERROR oslo.messaging._drivers.impl_rabbit [None req-98a6b2c6-a563-4dca-81f3-b12ca5cd34c0 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] [fdffe6b9-9d4b-45b8-9714-1ef9d5132dcd] AMQP server on 10.222.0.18:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 22 21:51:29.700891 ncdv-master-1 devstack@n-api.service[138745]: INFO oslo.messaging._drivers.impl_rabbit [None req-98a6b2c6-a563-4dca-81f3-b12ca5cd34c0 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] [fdffe6b9-9d4b-45b8-9714-1ef9d5132dcd] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 35720. Oct 22 21:51:29.719632 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-98a6b2c6-a563-4dca-81f3-b12ca5cd34c0 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.070026 Oct 22 21:51:29.720252 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3183/6336] 10.222.0.18 () {60 vars in 1159 bytes} [Sat Oct 22 21:51:28 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:51:30.964315 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-882aa98d-2d5b-4e19-b40d-f906a9cee1f3 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:51:30.964935 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-882aa98d-2d5b-4e19-b40d-f906a9cee1f3 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] [instance: e3f9f3ab-26f2-427b-9dc5-bfc007cdef20] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:51:30.972264 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-882aa98d-2d5b-4e19-b40d-f906a9cee1f3 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:51:30.972749 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-882aa98d-2d5b-4e19-b40d-f906a9cee1f3 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:51:30.973189 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-882aa98d-2d5b-4e19-b40d-f906a9cee1f3 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:51:30.974245 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-882aa98d-2d5b-4e19-b40d-f906a9cee1f3 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:51:30.974707 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-882aa98d-2d5b-4e19-b40d-f906a9cee1f3 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:51:30.975135 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-882aa98d-2d5b-4e19-b40d-f906a9cee1f3 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:51:31.117356 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-882aa98d-2d5b-4e19-b40d-f906a9cee1f3 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22419916fc2641f88bfbdf103e7c3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf4cd612f04e91b3be2e7ca5658b97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:51:31.128672 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-882aa98d-2d5b-4e19-b40d-f906a9cee1f3 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] 10.222.0.18 "GET /compute/v2.1/servers/e3f9f3ab-26f2-427b-9dc5-bfc007cdef20" status: 200 len: 1508 microversion: 2.1 time: 0.168291 Oct 22 21:51:31.129307 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3154/6337] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:51:30 2022] GET /compute/v2.1/servers/e3f9f3ab-26f2-427b-9dc5-bfc007cdef20 => generated 1508 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:51:31.155521 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-3154d619-8e83-43ee-8f4d-f8913d534523 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:51:31.156082 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-3154d619-8e83-43ee-8f4d-f8913d534523 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] [instance: e3f9f3ab-26f2-427b-9dc5-bfc007cdef20] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:51:31.162326 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3154d619-8e83-43ee-8f4d-f8913d534523 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:51:31.162834 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3154d619-8e83-43ee-8f4d-f8913d534523 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:51:31.163291 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3154d619-8e83-43ee-8f4d-f8913d534523 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:51:31.164030 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3154d619-8e83-43ee-8f4d-f8913d534523 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:51:31.164514 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3154d619-8e83-43ee-8f4d-f8913d534523 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:51:31.164963 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3154d619-8e83-43ee-8f4d-f8913d534523 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:51:31.191733 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-3154d619-8e83-43ee-8f4d-f8913d534523 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] [instance: e3f9f3ab-26f2-427b-9dc5-bfc007cdef20] Going to try to terminate instance {{(pid=138745) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 21:51:31.275916 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-3154d619-8e83-43ee-8f4d-f8913d534523 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] 10.222.0.18 "DELETE /compute/v2.1/servers/e3f9f3ab-26f2-427b-9dc5-bfc007cdef20" status: 204 len: 0 microversion: 2.1 time: 0.125800 Oct 22 21:51:31.276669 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3184/6338] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 21:51:31 2022] DELETE /compute/v2.1/servers/e3f9f3ab-26f2-427b-9dc5-bfc007cdef20 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 22 21:51:31.337606 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-170e5632-e395-4155-a009-56ae53f817a6 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1701663742", "imageRef": "085e4478-6edc-4a69-8e08-f9831713eb65", "flavorRef": "452", "networks": [{"uuid": "94b61302-e551-4df3-bdc0-86d30fc73cf4"}]}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:51:31.391522 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.network.neutron [None req-170e5632-e395-4155-a009-56ae53f817a6 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] validate_networks() for [('94b61302-e551-4df3-bdc0-86d30fc73cf4', None, None, None, None, None)] {{(pid=138744) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 21:51:31.773719 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-170e5632-e395-4155-a009-56ae53f817a6 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Flavor limits 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 21:51:31.774149 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-170e5632-e395-4155-a009-56ae53f817a6 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Image limits 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 21:51:31.774632 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-170e5632-e395-4155-a009-56ae53f817a6 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Flavor pref 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 21:51:31.775046 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-170e5632-e395-4155-a009-56ae53f817a6 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Image pref 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 21:51:31.775494 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-170e5632-e395-4155-a009-56ae53f817a6 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 21:51:31.785666 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-170e5632-e395-4155-a009-56ae53f817a6 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:51:31.786155 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-170e5632-e395-4155-a009-56ae53f817a6 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:51:31.786594 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-170e5632-e395-4155-a009-56ae53f817a6 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:51:31.787325 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-170e5632-e395-4155-a009-56ae53f817a6 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:51:31.787824 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-170e5632-e395-4155-a009-56ae53f817a6 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:51:31.788258 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-170e5632-e395-4155-a009-56ae53f817a6 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:51:31.806359 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-170e5632-e395-4155-a009-56ae53f817a6 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Getting quotas for project f4cf4cd612f04e91b3be2e7ca5658b97. Resources: {'cores', 'instances', 'ram'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 21:51:31.812008 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-170e5632-e395-4155-a009-56ae53f817a6 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Getting quotas for user 22419916fc2641f88bfbdf103e7c3ee6 and project f4cf4cd612f04e91b3be2e7ca5658b97. Resources: {'cores', 'instances', 'ram'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 21:51:31.825189 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-170e5632-e395-4155-a009-56ae53f817a6 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Going to run 1 instances... {{(pid=138744) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 21:51:31.827637 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-170e5632-e395-4155-a009-56ae53f817a6 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] [instance: a9c8b45a-14b4-4562-b7bb-32eb89263331] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='085e4478-6edc-4a69-8e08-f9831713eb65',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138744) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 21:51:31.878062 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-170e5632-e395-4155-a009-56ae53f817a6 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.544366 Oct 22 21:51:31.878719 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3155/6339] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Oct 22 21:51:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 546 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 21:51:31.891481 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-636fc282-1413-4fc4-9e36-27d7b4050c59 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:51:31.892236 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-636fc282-1413-4fc4-9e36-27d7b4050c59 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] [instance: a9c8b45a-14b4-4562-b7bb-32eb89263331] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:51:31.952151 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-636fc282-1413-4fc4-9e36-27d7b4050c59 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22419916fc2641f88bfbdf103e7c3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf4cd612f04e91b3be2e7ca5658b97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:51:31.959820 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-636fc282-1413-4fc4-9e36-27d7b4050c59 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] 10.222.0.18 "GET /compute/v2.1/servers/a9c8b45a-14b4-4562-b7bb-32eb89263331" status: 200 len: 1218 microversion: 2.1 time: 0.073100 Oct 22 21:51:31.960625 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3185/6340] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:51:31 2022] GET /compute/v2.1/servers/a9c8b45a-14b4-4562-b7bb-32eb89263331 => generated 1218 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:51:32.985023 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-a4cf9805-9e6c-4abf-8193-8b62ef932cb3 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:51:32.985641 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-a4cf9805-9e6c-4abf-8193-8b62ef932cb3 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] [instance: a9c8b45a-14b4-4562-b7bb-32eb89263331] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:51:32.993272 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a4cf9805-9e6c-4abf-8193-8b62ef932cb3 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:51:32.994457 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a4cf9805-9e6c-4abf-8193-8b62ef932cb3 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:51:32.994712 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a4cf9805-9e6c-4abf-8193-8b62ef932cb3 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:51:32.995461 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a4cf9805-9e6c-4abf-8193-8b62ef932cb3 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:51:32.996691 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a4cf9805-9e6c-4abf-8193-8b62ef932cb3 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:51:32.997144 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a4cf9805-9e6c-4abf-8193-8b62ef932cb3 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:51:33.082787 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-a4cf9805-9e6c-4abf-8193-8b62ef932cb3 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22419916fc2641f88bfbdf103e7c3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf4cd612f04e91b3be2e7ca5658b97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:51:33.091964 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-a4cf9805-9e6c-4abf-8193-8b62ef932cb3 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] 10.222.0.18 "GET /compute/v2.1/servers/a9c8b45a-14b4-4562-b7bb-32eb89263331" status: 200 len: 1270 microversion: 2.1 time: 0.112142 Oct 22 21:51:33.092541 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3156/6341] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:51:32 2022] GET /compute/v2.1/servers/a9c8b45a-14b4-4562-b7bb-32eb89263331 => generated 1270 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:51:33.187060 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-d54c19ec-200f-4937-9fd3-1f2045e5b283 req-10a016de-f35b-49e4-b044-6d8d325d9922 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3f9f3ab-26f2-427b-9dc5-bfc007cdef20", "name": "network-vif-deleted", "tag": "b734f414-d5bc-4142-b5a0-68e23fd574a8"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:51:33.199087 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-d54c19ec-200f-4937-9fd3-1f2045e5b283 req-10a016de-f35b-49e4-b044-6d8d325d9922 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:51:33.199621 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-d54c19ec-200f-4937-9fd3-1f2045e5b283 req-10a016de-f35b-49e4-b044-6d8d325d9922 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:51:33.200329 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-d54c19ec-200f-4937-9fd3-1f2045e5b283 req-10a016de-f35b-49e4-b044-6d8d325d9922 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:51:33.212956 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-d54c19ec-200f-4937-9fd3-1f2045e5b283 req-10a016de-f35b-49e4-b044-6d8d325d9922 service nova] Creating event network-vif-deleted:b734f414-d5bc-4142-b5a0-68e23fd574a8 for instance e3f9f3ab-26f2-427b-9dc5-bfc007cdef20 on nch1-master-1 Oct 22 21:51:33.219365 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-d54c19ec-200f-4937-9fd3-1f2045e5b283 req-10a016de-f35b-49e4-b044-6d8d325d9922 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037411 Oct 22 21:51:33.220170 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3186/6342] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:51:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 21:51:34.117170 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-8533f2a7-b34b-4432-8a5f-cd46e809d261 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:51:34.117791 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-8533f2a7-b34b-4432-8a5f-cd46e809d261 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] [instance: a9c8b45a-14b4-4562-b7bb-32eb89263331] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:51:34.126791 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8533f2a7-b34b-4432-8a5f-cd46e809d261 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:51:34.127285 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8533f2a7-b34b-4432-8a5f-cd46e809d261 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:51:34.127818 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8533f2a7-b34b-4432-8a5f-cd46e809d261 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:51:34.128531 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8533f2a7-b34b-4432-8a5f-cd46e809d261 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:51:34.129166 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8533f2a7-b34b-4432-8a5f-cd46e809d261 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:51:34.129786 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8533f2a7-b34b-4432-8a5f-cd46e809d261 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:51:34.369746 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-8533f2a7-b34b-4432-8a5f-cd46e809d261 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22419916fc2641f88bfbdf103e7c3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf4cd612f04e91b3be2e7ca5658b97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:51:34.379185 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-8533f2a7-b34b-4432-8a5f-cd46e809d261 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] 10.222.0.18 "GET /compute/v2.1/servers/a9c8b45a-14b4-4562-b7bb-32eb89263331" status: 200 len: 1318 microversion: 2.1 time: 0.266088 Oct 22 21:51:34.379953 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3157/6343] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:51:34 2022] GET /compute/v2.1/servers/a9c8b45a-14b4-4562-b7bb-32eb89263331 => generated 1318 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:51:34.578630 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-a74059a0-55e3-4373-9e9b-beb8a610a0ad req-0895f0f1-7908-4038-8a89-8cc62d590f48 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a9c8b45a-14b4-4562-b7bb-32eb89263331", "tag": "a48a360a-0eb4-446e-9f55-64c247abc4f2"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:51:34.592196 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-a74059a0-55e3-4373-9e9b-beb8a610a0ad req-0895f0f1-7908-4038-8a89-8cc62d590f48 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:51:34.592698 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-a74059a0-55e3-4373-9e9b-beb8a610a0ad req-0895f0f1-7908-4038-8a89-8cc62d590f48 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:51:34.593497 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-a74059a0-55e3-4373-9e9b-beb8a610a0ad req-0895f0f1-7908-4038-8a89-8cc62d590f48 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:51:34.611765 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-a74059a0-55e3-4373-9e9b-beb8a610a0ad req-0895f0f1-7908-4038-8a89-8cc62d590f48 service nova] Creating event network-changed:a48a360a-0eb4-446e-9f55-64c247abc4f2 for instance a9c8b45a-14b4-4562-b7bb-32eb89263331 on nch1-master-1 Oct 22 21:51:34.617007 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-a74059a0-55e3-4373-9e9b-beb8a610a0ad req-0895f0f1-7908-4038-8a89-8cc62d590f48 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043478 Oct 22 21:51:34.617599 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3187/6344] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:51:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:51:35.406614 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-3b3a7da3-fd89-4860-ae62-e37f9815cfe7 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:51:35.407616 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-3b3a7da3-fd89-4860-ae62-e37f9815cfe7 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] [instance: a9c8b45a-14b4-4562-b7bb-32eb89263331] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:51:35.418368 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3b3a7da3-fd89-4860-ae62-e37f9815cfe7 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:51:35.418890 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3b3a7da3-fd89-4860-ae62-e37f9815cfe7 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:51:35.419304 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3b3a7da3-fd89-4860-ae62-e37f9815cfe7 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:51:35.420075 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3b3a7da3-fd89-4860-ae62-e37f9815cfe7 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:51:35.420534 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3b3a7da3-fd89-4860-ae62-e37f9815cfe7 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:51:35.420965 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3b3a7da3-fd89-4860-ae62-e37f9815cfe7 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:51:35.562146 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-3b3a7da3-fd89-4860-ae62-e37f9815cfe7 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22419916fc2641f88bfbdf103e7c3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf4cd612f04e91b3be2e7ca5658b97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:51:35.570385 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-3b3a7da3-fd89-4860-ae62-e37f9815cfe7 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] 10.222.0.18 "GET /compute/v2.1/servers/a9c8b45a-14b4-4562-b7bb-32eb89263331" status: 200 len: 1318 microversion: 2.1 time: 0.170622 Oct 22 21:51:35.570968 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3158/6345] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:51:35 2022] GET /compute/v2.1/servers/a9c8b45a-14b4-4562-b7bb-32eb89263331 => generated 1318 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:51:36.599617 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-6364e584-9adc-470c-acfc-78e05b7ed76c tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:51:36.600823 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-6364e584-9adc-470c-acfc-78e05b7ed76c tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] [instance: a9c8b45a-14b4-4562-b7bb-32eb89263331] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:51:36.611894 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6364e584-9adc-470c-acfc-78e05b7ed76c tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:51:36.612711 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6364e584-9adc-470c-acfc-78e05b7ed76c tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:51:36.613461 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6364e584-9adc-470c-acfc-78e05b7ed76c tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:51:36.614628 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6364e584-9adc-470c-acfc-78e05b7ed76c tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:51:36.615407 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6364e584-9adc-470c-acfc-78e05b7ed76c tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:51:36.616193 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6364e584-9adc-470c-acfc-78e05b7ed76c tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:51:36.755724 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-6364e584-9adc-470c-acfc-78e05b7ed76c tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22419916fc2641f88bfbdf103e7c3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf4cd612f04e91b3be2e7ca5658b97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:51:36.767210 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-6364e584-9adc-470c-acfc-78e05b7ed76c tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] 10.222.0.18 "GET /compute/v2.1/servers/a9c8b45a-14b4-4562-b7bb-32eb89263331" status: 200 len: 1318 microversion: 2.1 time: 0.176403 Oct 22 21:51:36.767869 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3188/6346] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:51:36 2022] GET /compute/v2.1/servers/a9c8b45a-14b4-4562-b7bb-32eb89263331 => generated 1318 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:51:37.795163 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-6beabb8d-996c-4a5f-81f8-ffdee2337244 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:51:37.795812 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-6beabb8d-996c-4a5f-81f8-ffdee2337244 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] [instance: a9c8b45a-14b4-4562-b7bb-32eb89263331] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:51:37.802856 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6beabb8d-996c-4a5f-81f8-ffdee2337244 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:51:37.803372 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6beabb8d-996c-4a5f-81f8-ffdee2337244 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:51:37.803821 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6beabb8d-996c-4a5f-81f8-ffdee2337244 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:51:37.804508 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6beabb8d-996c-4a5f-81f8-ffdee2337244 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:51:37.804959 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6beabb8d-996c-4a5f-81f8-ffdee2337244 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:51:37.805387 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6beabb8d-996c-4a5f-81f8-ffdee2337244 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:51:37.942489 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-6beabb8d-996c-4a5f-81f8-ffdee2337244 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22419916fc2641f88bfbdf103e7c3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf4cd612f04e91b3be2e7ca5658b97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:51:37.951159 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-6beabb8d-996c-4a5f-81f8-ffdee2337244 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] 10.222.0.18 "GET /compute/v2.1/servers/a9c8b45a-14b4-4562-b7bb-32eb89263331" status: 200 len: 1318 microversion: 2.1 time: 0.161739 Oct 22 21:51:37.951778 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3159/6347] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:51:37 2022] GET /compute/v2.1/servers/a9c8b45a-14b4-4562-b7bb-32eb89263331 => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:51:38.977658 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-d76e66d0-febe-45fa-8a46-cb771d21a75e tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:51:38.978546 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-d76e66d0-febe-45fa-8a46-cb771d21a75e tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] [instance: a9c8b45a-14b4-4562-b7bb-32eb89263331] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:51:38.989156 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d76e66d0-febe-45fa-8a46-cb771d21a75e tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:51:38.989868 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d76e66d0-febe-45fa-8a46-cb771d21a75e tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:51:38.990518 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d76e66d0-febe-45fa-8a46-cb771d21a75e tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:51:38.991586 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d76e66d0-febe-45fa-8a46-cb771d21a75e tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:51:38.992262 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d76e66d0-febe-45fa-8a46-cb771d21a75e tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:51:38.992912 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d76e66d0-febe-45fa-8a46-cb771d21a75e tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:51:39.131171 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-d76e66d0-febe-45fa-8a46-cb771d21a75e tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22419916fc2641f88bfbdf103e7c3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf4cd612f04e91b3be2e7ca5658b97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:51:39.139626 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-d76e66d0-febe-45fa-8a46-cb771d21a75e tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] 10.222.0.18 "GET /compute/v2.1/servers/a9c8b45a-14b4-4562-b7bb-32eb89263331" status: 200 len: 1318 microversion: 2.1 time: 0.167758 Oct 22 21:51:39.140102 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3189/6348] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:51:38 2022] GET /compute/v2.1/servers/a9c8b45a-14b4-4562-b7bb-32eb89263331 => generated 1318 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:51:40.166869 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-809cae82-7478-4b98-8b5e-247df45d0176 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:51:40.167962 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-809cae82-7478-4b98-8b5e-247df45d0176 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] [instance: a9c8b45a-14b4-4562-b7bb-32eb89263331] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:51:40.175761 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-809cae82-7478-4b98-8b5e-247df45d0176 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:51:40.176247 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-809cae82-7478-4b98-8b5e-247df45d0176 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:51:40.176690 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-809cae82-7478-4b98-8b5e-247df45d0176 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:51:40.177383 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-809cae82-7478-4b98-8b5e-247df45d0176 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:51:40.177836 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-809cae82-7478-4b98-8b5e-247df45d0176 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:51:40.178261 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-809cae82-7478-4b98-8b5e-247df45d0176 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:51:40.314126 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-809cae82-7478-4b98-8b5e-247df45d0176 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22419916fc2641f88bfbdf103e7c3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf4cd612f04e91b3be2e7ca5658b97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:51:40.322619 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-809cae82-7478-4b98-8b5e-247df45d0176 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] 10.222.0.18 "GET /compute/v2.1/servers/a9c8b45a-14b4-4562-b7bb-32eb89263331" status: 200 len: 1318 microversion: 2.1 time: 0.162736 Oct 22 21:51:40.323216 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3160/6349] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:51:40 2022] GET /compute/v2.1/servers/a9c8b45a-14b4-4562-b7bb-32eb89263331 => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:51:40.813005 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-4c24631f-1fde-455a-bcfb-091798345ee1 req-d7fe687a-5db7-4b68-96ce-c40146b68bfa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9c8b45a-14b4-4562-b7bb-32eb89263331", "name": "network-vif-plugged", "status": "completed", "tag": "a48a360a-0eb4-446e-9f55-64c247abc4f2"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:51:40.823834 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-4c24631f-1fde-455a-bcfb-091798345ee1 req-d7fe687a-5db7-4b68-96ce-c40146b68bfa service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:51:40.824413 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-4c24631f-1fde-455a-bcfb-091798345ee1 req-d7fe687a-5db7-4b68-96ce-c40146b68bfa service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:51:40.824925 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-4c24631f-1fde-455a-bcfb-091798345ee1 req-d7fe687a-5db7-4b68-96ce-c40146b68bfa service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:51:40.839775 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-4c24631f-1fde-455a-bcfb-091798345ee1 req-d7fe687a-5db7-4b68-96ce-c40146b68bfa service nova] Creating event network-vif-plugged:a48a360a-0eb4-446e-9f55-64c247abc4f2 for instance a9c8b45a-14b4-4562-b7bb-32eb89263331 on nch1-master-1 Oct 22 21:51:40.845523 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-4c24631f-1fde-455a-bcfb-091798345ee1 req-d7fe687a-5db7-4b68-96ce-c40146b68bfa service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036789 Oct 22 21:51:40.846233 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3190/6350] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:51:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:51:41.345956 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-c8d34413-00ff-430c-a542-19f114e288bf tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:51:41.346568 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-c8d34413-00ff-430c-a542-19f114e288bf tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] [instance: a9c8b45a-14b4-4562-b7bb-32eb89263331] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:51:41.354405 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c8d34413-00ff-430c-a542-19f114e288bf tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:51:41.354944 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c8d34413-00ff-430c-a542-19f114e288bf tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:51:41.355406 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c8d34413-00ff-430c-a542-19f114e288bf tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:51:41.356222 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c8d34413-00ff-430c-a542-19f114e288bf tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:51:41.356784 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c8d34413-00ff-430c-a542-19f114e288bf tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:51:41.357215 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c8d34413-00ff-430c-a542-19f114e288bf tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:51:41.493397 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-c8d34413-00ff-430c-a542-19f114e288bf tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22419916fc2641f88bfbdf103e7c3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf4cd612f04e91b3be2e7ca5658b97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:51:41.505187 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-c8d34413-00ff-430c-a542-19f114e288bf tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] 10.222.0.18 "GET /compute/v2.1/servers/a9c8b45a-14b4-4562-b7bb-32eb89263331" status: 200 len: 1318 microversion: 2.1 time: 0.163421 Oct 22 21:51:41.505767 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3161/6351] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:51:41 2022] GET /compute/v2.1/servers/a9c8b45a-14b4-4562-b7bb-32eb89263331 => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:51:42.528560 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell0:SELECT=6 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:51:42.533206 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-af416107-cb9a-48d6-b8af-4c4694d6a0d0 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:51:42.533929 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-af416107-cb9a-48d6-b8af-4c4694d6a0d0 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] [instance: a9c8b45a-14b4-4562-b7bb-32eb89263331] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:51:42.540745 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-af416107-cb9a-48d6-b8af-4c4694d6a0d0 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:51:42.541181 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-af416107-cb9a-48d6-b8af-4c4694d6a0d0 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:51:42.541662 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-af416107-cb9a-48d6-b8af-4c4694d6a0d0 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:51:42.542376 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-af416107-cb9a-48d6-b8af-4c4694d6a0d0 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:51:42.542848 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-af416107-cb9a-48d6-b8af-4c4694d6a0d0 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:51:42.543296 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-af416107-cb9a-48d6-b8af-4c4694d6a0d0 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:51:42.546033 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:51:42.688524 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-af416107-cb9a-48d6-b8af-4c4694d6a0d0 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22419916fc2641f88bfbdf103e7c3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf4cd612f04e91b3be2e7ca5658b97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:51:42.696794 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-af416107-cb9a-48d6-b8af-4c4694d6a0d0 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] 10.222.0.18 "GET /compute/v2.1/servers/a9c8b45a-14b4-4562-b7bb-32eb89263331" status: 200 len: 1508 microversion: 2.1 time: 0.171287 Oct 22 21:51:42.697379 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3191/6352] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:51:42 2022] GET /compute/v2.1/servers/a9c8b45a-14b4-4562-b7bb-32eb89263331 => generated 1508 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:51:42.719920 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-43d1bf82-b3db-480b-ac8e-5977151cef9f tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:51:42.720542 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-43d1bf82-b3db-480b-ac8e-5977151cef9f tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] [instance: a9c8b45a-14b4-4562-b7bb-32eb89263331] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:51:42.722627 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell0:SELECT=2 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:51:42.723288 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell0:SELECT=6 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:51:42.730625 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-43d1bf82-b3db-480b-ac8e-5977151cef9f tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:51:42.731119 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-43d1bf82-b3db-480b-ac8e-5977151cef9f tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:51:42.731594 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-43d1bf82-b3db-480b-ac8e-5977151cef9f tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:51:42.732330 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-43d1bf82-b3db-480b-ac8e-5977151cef9f tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:51:42.732889 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-43d1bf82-b3db-480b-ac8e-5977151cef9f tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:51:42.733330 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-43d1bf82-b3db-480b-ac8e-5977151cef9f tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:51:42.875134 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-43d1bf82-b3db-480b-ac8e-5977151cef9f tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22419916fc2641f88bfbdf103e7c3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf4cd612f04e91b3be2e7ca5658b97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:51:42.883873 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-43d1bf82-b3db-480b-ac8e-5977151cef9f tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] 10.222.0.18 "GET /compute/v2.1/servers/a9c8b45a-14b4-4562-b7bb-32eb89263331" status: 200 len: 1508 microversion: 2.1 time: 0.168192 Oct 22 21:51:42.884432 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3162/6353] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:51:42 2022] GET /compute/v2.1/servers/a9c8b45a-14b4-4562-b7bb-32eb89263331 => generated 1508 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:51:42.906204 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-255dab05-0378-42be-b926-30ccd1133083 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "AUTO"}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:51:42.908631 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-255dab05-0378-42be-b926-30ccd1133083 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] [instance: a9c8b45a-14b4-4562-b7bb-32eb89263331] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:51:42.915043 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-255dab05-0378-42be-b926-30ccd1133083 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:51:42.915581 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-255dab05-0378-42be-b926-30ccd1133083 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:51:42.916035 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-255dab05-0378-42be-b926-30ccd1133083 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:51:42.916794 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-255dab05-0378-42be-b926-30ccd1133083 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:51:42.917261 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-255dab05-0378-42be-b926-30ccd1133083 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:51:42.917703 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-255dab05-0378-42be-b926-30ccd1133083 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:51:42.947062 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-255dab05-0378-42be-b926-30ccd1133083 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '22419916fc2641f88bfbdf103e7c3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf4cd612f04e91b3be2e7ca5658b97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:51:42.953085 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-255dab05-0378-42be-b926-30ccd1133083 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] [instance: a9c8b45a-14b4-4562-b7bb-32eb89263331] Old instance type m1.heat2, new instance type m1.heat {{(pid=138745) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 22 21:51:42.960048 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-255dab05-0378-42be-b926-30ccd1133083 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Flavor limits 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 21:51:42.960503 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-255dab05-0378-42be-b926-30ccd1133083 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Image limits 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 21:51:42.960988 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-255dab05-0378-42be-b926-30ccd1133083 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Flavor pref 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 21:51:42.961408 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-255dab05-0378-42be-b926-30ccd1133083 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Image pref 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 21:51:42.961832 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-255dab05-0378-42be-b926-30ccd1133083 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 21:51:43.028502 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-255dab05-0378-42be-b926-30ccd1133083 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] 10.222.0.18 "POST /compute/v2.1/servers/a9c8b45a-14b4-4562-b7bb-32eb89263331/action" status: 202 len: 0 microversion: 2.1 time: 0.126243 Oct 22 21:51:43.029146 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3192/6354] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 21:51:42 2022] POST /compute/v2.1/servers/a9c8b45a-14b4-4562-b7bb-32eb89263331/action => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 21:51:43.037640 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-40443045-cc24-4857-8c0c-e43c229ef0b0 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:51:43.038433 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-40443045-cc24-4857-8c0c-e43c229ef0b0 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] [instance: a9c8b45a-14b4-4562-b7bb-32eb89263331] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:51:43.044779 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-40443045-cc24-4857-8c0c-e43c229ef0b0 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:51:43.045507 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-40443045-cc24-4857-8c0c-e43c229ef0b0 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:51:43.045970 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-40443045-cc24-4857-8c0c-e43c229ef0b0 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:51:43.046695 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-40443045-cc24-4857-8c0c-e43c229ef0b0 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:51:43.047164 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-40443045-cc24-4857-8c0c-e43c229ef0b0 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:51:43.047632 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-40443045-cc24-4857-8c0c-e43c229ef0b0 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:51:43.050495 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:SELECT=100 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:51:43.191955 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-40443045-cc24-4857-8c0c-e43c229ef0b0 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22419916fc2641f88bfbdf103e7c3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf4cd612f04e91b3be2e7ca5658b97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:51:43.200406 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-40443045-cc24-4857-8c0c-e43c229ef0b0 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] 10.222.0.18 "GET /compute/v2.1/servers/a9c8b45a-14b4-4562-b7bb-32eb89263331" status: 200 len: 1515 microversion: 2.1 time: 0.166800 Oct 22 21:51:43.200966 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3163/6355] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:51:43 2022] GET /compute/v2.1/servers/a9c8b45a-14b4-4562-b7bb-32eb89263331 => generated 1515 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:51:44.228534 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-88d5f93a-18b4-4f18-817e-223fe5930939 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:51:44.229359 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-88d5f93a-18b4-4f18-817e-223fe5930939 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] [instance: a9c8b45a-14b4-4562-b7bb-32eb89263331] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:51:44.240479 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-88d5f93a-18b4-4f18-817e-223fe5930939 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:51:44.241254 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-88d5f93a-18b4-4f18-817e-223fe5930939 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:51:44.241964 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-88d5f93a-18b4-4f18-817e-223fe5930939 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:51:44.243061 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-88d5f93a-18b4-4f18-817e-223fe5930939 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:51:44.243858 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-88d5f93a-18b4-4f18-817e-223fe5930939 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:51:44.244519 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-88d5f93a-18b4-4f18-817e-223fe5930939 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:51:44.451718 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-88d5f93a-18b4-4f18-817e-223fe5930939 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22419916fc2641f88bfbdf103e7c3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf4cd612f04e91b3be2e7ca5658b97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:51:44.460136 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-88d5f93a-18b4-4f18-817e-223fe5930939 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] 10.222.0.18 "GET /compute/v2.1/servers/a9c8b45a-14b4-4562-b7bb-32eb89263331" status: 200 len: 1515 microversion: 2.1 time: 0.239401 Oct 22 21:51:44.460805 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3193/6356] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:51:44 2022] GET /compute/v2.1/servers/a9c8b45a-14b4-4562-b7bb-32eb89263331 => generated 1515 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:51:45.487921 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-8b9a13a5-4274-4bbb-972e-cd9cc0558ca2 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:51:45.488864 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-8b9a13a5-4274-4bbb-972e-cd9cc0558ca2 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] [instance: a9c8b45a-14b4-4562-b7bb-32eb89263331] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:51:45.500078 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8b9a13a5-4274-4bbb-972e-cd9cc0558ca2 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:51:45.500572 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8b9a13a5-4274-4bbb-972e-cd9cc0558ca2 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:51:45.501016 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8b9a13a5-4274-4bbb-972e-cd9cc0558ca2 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:51:45.501717 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8b9a13a5-4274-4bbb-972e-cd9cc0558ca2 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:51:45.502177 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8b9a13a5-4274-4bbb-972e-cd9cc0558ca2 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:51:45.502613 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8b9a13a5-4274-4bbb-972e-cd9cc0558ca2 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:51:45.642104 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-8b9a13a5-4274-4bbb-972e-cd9cc0558ca2 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22419916fc2641f88bfbdf103e7c3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf4cd612f04e91b3be2e7ca5658b97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:51:45.650363 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-8b9a13a5-4274-4bbb-972e-cd9cc0558ca2 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] 10.222.0.18 "GET /compute/v2.1/servers/a9c8b45a-14b4-4562-b7bb-32eb89263331" status: 200 len: 1520 microversion: 2.1 time: 0.169011 Oct 22 21:51:45.650808 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3164/6357] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:51:45 2022] GET /compute/v2.1/servers/a9c8b45a-14b4-4562-b7bb-32eb89263331 => generated 1520 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:51:46.675055 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-fa10a3a2-8e68-49aa-903a-5a097c346ec6 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:51:46.675743 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-fa10a3a2-8e68-49aa-903a-5a097c346ec6 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] [instance: a9c8b45a-14b4-4562-b7bb-32eb89263331] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:51:46.683151 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fa10a3a2-8e68-49aa-903a-5a097c346ec6 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:51:46.683707 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fa10a3a2-8e68-49aa-903a-5a097c346ec6 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:51:46.684166 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fa10a3a2-8e68-49aa-903a-5a097c346ec6 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:51:46.684873 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fa10a3a2-8e68-49aa-903a-5a097c346ec6 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:51:46.685349 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fa10a3a2-8e68-49aa-903a-5a097c346ec6 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:51:46.685801 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fa10a3a2-8e68-49aa-903a-5a097c346ec6 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:51:47.180460 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-fa10a3a2-8e68-49aa-903a-5a097c346ec6 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22419916fc2641f88bfbdf103e7c3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf4cd612f04e91b3be2e7ca5658b97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:51:47.189049 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-fa10a3a2-8e68-49aa-903a-5a097c346ec6 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] 10.222.0.18 "GET /compute/v2.1/servers/a9c8b45a-14b4-4562-b7bb-32eb89263331" status: 200 len: 1520 microversion: 2.1 time: 0.518818 Oct 22 21:51:47.189752 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3194/6358] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:51:46 2022] GET /compute/v2.1/servers/a9c8b45a-14b4-4562-b7bb-32eb89263331 => generated 1520 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:51:48.212833 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-4678e0c0-a760-4965-b6bc-f7fe74d9fe19 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:51:48.213437 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-4678e0c0-a760-4965-b6bc-f7fe74d9fe19 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] [instance: a9c8b45a-14b4-4562-b7bb-32eb89263331] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:51:48.221251 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4678e0c0-a760-4965-b6bc-f7fe74d9fe19 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:51:48.221741 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4678e0c0-a760-4965-b6bc-f7fe74d9fe19 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:51:48.222165 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4678e0c0-a760-4965-b6bc-f7fe74d9fe19 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:51:48.222875 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4678e0c0-a760-4965-b6bc-f7fe74d9fe19 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:51:48.223329 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4678e0c0-a760-4965-b6bc-f7fe74d9fe19 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:51:48.223798 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4678e0c0-a760-4965-b6bc-f7fe74d9fe19 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:51:48.356520 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-4678e0c0-a760-4965-b6bc-f7fe74d9fe19 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22419916fc2641f88bfbdf103e7c3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf4cd612f04e91b3be2e7ca5658b97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:51:48.365113 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-4678e0c0-a760-4965-b6bc-f7fe74d9fe19 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] 10.222.0.18 "GET /compute/v2.1/servers/a9c8b45a-14b4-4562-b7bb-32eb89263331" status: 200 len: 1520 microversion: 2.1 time: 0.156335 Oct 22 21:51:48.365682 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3165/6359] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:51:48 2022] GET /compute/v2.1/servers/a9c8b45a-14b4-4562-b7bb-32eb89263331 => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:51:49.392010 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-0a964778-b0f1-4909-ad0e-2a61befded25 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:51:49.392939 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-0a964778-b0f1-4909-ad0e-2a61befded25 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] [instance: a9c8b45a-14b4-4562-b7bb-32eb89263331] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:51:49.404781 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0a964778-b0f1-4909-ad0e-2a61befded25 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:51:49.405614 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0a964778-b0f1-4909-ad0e-2a61befded25 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:51:49.406489 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0a964778-b0f1-4909-ad0e-2a61befded25 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:51:49.407213 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0a964778-b0f1-4909-ad0e-2a61befded25 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:51:49.407716 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0a964778-b0f1-4909-ad0e-2a61befded25 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:51:49.408160 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0a964778-b0f1-4909-ad0e-2a61befded25 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:51:49.546046 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-0a964778-b0f1-4909-ad0e-2a61befded25 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22419916fc2641f88bfbdf103e7c3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf4cd612f04e91b3be2e7ca5658b97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:51:49.554359 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-0a964778-b0f1-4909-ad0e-2a61befded25 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] 10.222.0.18 "GET /compute/v2.1/servers/a9c8b45a-14b4-4562-b7bb-32eb89263331" status: 200 len: 1520 microversion: 2.1 time: 0.169300 Oct 22 21:51:49.554938 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3195/6360] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:51:49 2022] GET /compute/v2.1/servers/a9c8b45a-14b4-4562-b7bb-32eb89263331 => generated 1520 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:51:50.581602 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-eb9b91e6-d306-474b-aa9f-b5741c944f40 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:51:50.582302 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-eb9b91e6-d306-474b-aa9f-b5741c944f40 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] [instance: a9c8b45a-14b4-4562-b7bb-32eb89263331] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:51:50.585893 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:51:50.593573 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-eb9b91e6-d306-474b-aa9f-b5741c944f40 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:51:50.594188 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-eb9b91e6-d306-474b-aa9f-b5741c944f40 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:51:50.594683 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-eb9b91e6-d306-474b-aa9f-b5741c944f40 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:51:50.595404 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-eb9b91e6-d306-474b-aa9f-b5741c944f40 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:51:50.595863 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-eb9b91e6-d306-474b-aa9f-b5741c944f40 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:51:50.596290 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-eb9b91e6-d306-474b-aa9f-b5741c944f40 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:51:50.737658 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-eb9b91e6-d306-474b-aa9f-b5741c944f40 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22419916fc2641f88bfbdf103e7c3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf4cd612f04e91b3be2e7ca5658b97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:51:50.745932 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-eb9b91e6-d306-474b-aa9f-b5741c944f40 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] 10.222.0.18 "GET /compute/v2.1/servers/a9c8b45a-14b4-4562-b7bb-32eb89263331" status: 200 len: 1520 microversion: 2.1 time: 0.170478 Oct 22 21:51:50.746513 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3166/6361] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:51:50 2022] GET /compute/v2.1/servers/a9c8b45a-14b4-4562-b7bb-32eb89263331 => generated 1520 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:51:51.770897 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-9a889cf5-4221-44b1-8ce2-86bff011fadb tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:51:51.771511 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-9a889cf5-4221-44b1-8ce2-86bff011fadb tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] [instance: a9c8b45a-14b4-4562-b7bb-32eb89263331] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:51:51.774308 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:51:51.780874 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9a889cf5-4221-44b1-8ce2-86bff011fadb tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:51:51.781658 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9a889cf5-4221-44b1-8ce2-86bff011fadb tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:51:51.782273 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9a889cf5-4221-44b1-8ce2-86bff011fadb tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:51:51.783110 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9a889cf5-4221-44b1-8ce2-86bff011fadb tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:51:51.783697 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9a889cf5-4221-44b1-8ce2-86bff011fadb tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:51:51.784218 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9a889cf5-4221-44b1-8ce2-86bff011fadb tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:51:51.933341 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-9a889cf5-4221-44b1-8ce2-86bff011fadb tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22419916fc2641f88bfbdf103e7c3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf4cd612f04e91b3be2e7ca5658b97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:51:51.945343 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-9a889cf5-4221-44b1-8ce2-86bff011fadb tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] 10.222.0.18 "GET /compute/v2.1/servers/a9c8b45a-14b4-4562-b7bb-32eb89263331" status: 200 len: 1520 microversion: 2.1 time: 0.178139 Oct 22 21:51:51.946077 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3196/6362] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:51:51 2022] GET /compute/v2.1/servers/a9c8b45a-14b4-4562-b7bb-32eb89263331 => generated 1520 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:51:52.972572 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-970a0e42-8cf7-4c15-83d8-35ee07267358 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:51:52.973394 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-970a0e42-8cf7-4c15-83d8-35ee07267358 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] [instance: a9c8b45a-14b4-4562-b7bb-32eb89263331] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:51:52.982524 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-970a0e42-8cf7-4c15-83d8-35ee07267358 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:51:52.983099 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-970a0e42-8cf7-4c15-83d8-35ee07267358 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:51:52.983758 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-970a0e42-8cf7-4c15-83d8-35ee07267358 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:51:52.984628 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-970a0e42-8cf7-4c15-83d8-35ee07267358 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:51:52.985196 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-970a0e42-8cf7-4c15-83d8-35ee07267358 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:51:52.985734 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-970a0e42-8cf7-4c15-83d8-35ee07267358 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:51:53.125401 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-970a0e42-8cf7-4c15-83d8-35ee07267358 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22419916fc2641f88bfbdf103e7c3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf4cd612f04e91b3be2e7ca5658b97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:51:53.133648 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-970a0e42-8cf7-4c15-83d8-35ee07267358 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] 10.222.0.18 "GET /compute/v2.1/servers/a9c8b45a-14b4-4562-b7bb-32eb89263331" status: 200 len: 1520 microversion: 2.1 time: 0.167095 Oct 22 21:51:53.134384 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3167/6363] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:51:52 2022] GET /compute/v2.1/servers/a9c8b45a-14b4-4562-b7bb-32eb89263331 => generated 1520 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:51:54.161177 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-667b44b2-f3d1-413b-9b67-b93d976899de tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:51:54.162204 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-667b44b2-f3d1-413b-9b67-b93d976899de tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] [instance: a9c8b45a-14b4-4562-b7bb-32eb89263331] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:51:54.173072 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-667b44b2-f3d1-413b-9b67-b93d976899de tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:51:54.173568 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-667b44b2-f3d1-413b-9b67-b93d976899de tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:51:54.174072 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-667b44b2-f3d1-413b-9b67-b93d976899de tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:51:54.174783 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-667b44b2-f3d1-413b-9b67-b93d976899de tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:51:54.175251 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-667b44b2-f3d1-413b-9b67-b93d976899de tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:51:54.175731 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-667b44b2-f3d1-413b-9b67-b93d976899de tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:51:54.316223 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-667b44b2-f3d1-413b-9b67-b93d976899de tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22419916fc2641f88bfbdf103e7c3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf4cd612f04e91b3be2e7ca5658b97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:51:54.324258 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-667b44b2-f3d1-413b-9b67-b93d976899de tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] 10.222.0.18 "GET /compute/v2.1/servers/a9c8b45a-14b4-4562-b7bb-32eb89263331" status: 200 len: 1520 microversion: 2.1 time: 0.169834 Oct 22 21:51:54.324845 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3197/6364] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:51:54 2022] GET /compute/v2.1/servers/a9c8b45a-14b4-4562-b7bb-32eb89263331 => generated 1520 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:51:55.352519 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-90494b95-4365-4419-b858-390ed7b4bc4e tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:51:55.353368 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-90494b95-4365-4419-b858-390ed7b4bc4e tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] [instance: a9c8b45a-14b4-4562-b7bb-32eb89263331] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:51:55.365258 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-90494b95-4365-4419-b858-390ed7b4bc4e tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:51:55.366094 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-90494b95-4365-4419-b858-390ed7b4bc4e tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:51:55.366829 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-90494b95-4365-4419-b858-390ed7b4bc4e tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:51:55.368051 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-90494b95-4365-4419-b858-390ed7b4bc4e tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:51:55.368862 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-90494b95-4365-4419-b858-390ed7b4bc4e tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:51:55.369634 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-90494b95-4365-4419-b858-390ed7b4bc4e tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:51:55.514148 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-90494b95-4365-4419-b858-390ed7b4bc4e tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22419916fc2641f88bfbdf103e7c3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf4cd612f04e91b3be2e7ca5658b97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:51:55.522824 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-90494b95-4365-4419-b858-390ed7b4bc4e tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] 10.222.0.18 "GET /compute/v2.1/servers/a9c8b45a-14b4-4562-b7bb-32eb89263331" status: 200 len: 1520 microversion: 2.1 time: 0.177120 Oct 22 21:51:55.523435 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3168/6365] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:51:55 2022] GET /compute/v2.1/servers/a9c8b45a-14b4-4562-b7bb-32eb89263331 => generated 1520 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:51:56.549004 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-862570c3-5eb1-4bf8-ae76-1409793d48dd tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:51:56.549646 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-862570c3-5eb1-4bf8-ae76-1409793d48dd tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] [instance: a9c8b45a-14b4-4562-b7bb-32eb89263331] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:51:56.556827 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-862570c3-5eb1-4bf8-ae76-1409793d48dd tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:51:56.557326 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-862570c3-5eb1-4bf8-ae76-1409793d48dd tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:51:56.557773 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-862570c3-5eb1-4bf8-ae76-1409793d48dd tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:51:56.558482 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-862570c3-5eb1-4bf8-ae76-1409793d48dd tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:51:56.558949 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-862570c3-5eb1-4bf8-ae76-1409793d48dd tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:51:56.559451 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-862570c3-5eb1-4bf8-ae76-1409793d48dd tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:51:56.744105 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-862570c3-5eb1-4bf8-ae76-1409793d48dd tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22419916fc2641f88bfbdf103e7c3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf4cd612f04e91b3be2e7ca5658b97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:51:56.752716 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-862570c3-5eb1-4bf8-ae76-1409793d48dd tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] 10.222.0.18 "GET /compute/v2.1/servers/a9c8b45a-14b4-4562-b7bb-32eb89263331" status: 200 len: 1520 microversion: 2.1 time: 0.209398 Oct 22 21:51:56.753293 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3198/6366] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:51:56 2022] GET /compute/v2.1/servers/a9c8b45a-14b4-4562-b7bb-32eb89263331 => generated 1520 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:51:57.779833 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-588ec138-15fb-416a-9ca2-ff85fc52a369 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:51:57.780660 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-588ec138-15fb-416a-9ca2-ff85fc52a369 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] [instance: a9c8b45a-14b4-4562-b7bb-32eb89263331] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:51:57.788930 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-588ec138-15fb-416a-9ca2-ff85fc52a369 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:51:57.789421 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-588ec138-15fb-416a-9ca2-ff85fc52a369 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:51:57.789858 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-588ec138-15fb-416a-9ca2-ff85fc52a369 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:51:57.790554 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-588ec138-15fb-416a-9ca2-ff85fc52a369 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:51:57.791008 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-588ec138-15fb-416a-9ca2-ff85fc52a369 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:51:57.791478 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-588ec138-15fb-416a-9ca2-ff85fc52a369 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:51:57.933126 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-588ec138-15fb-416a-9ca2-ff85fc52a369 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22419916fc2641f88bfbdf103e7c3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf4cd612f04e91b3be2e7ca5658b97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:51:57.941374 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-588ec138-15fb-416a-9ca2-ff85fc52a369 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] 10.222.0.18 "GET /compute/v2.1/servers/a9c8b45a-14b4-4562-b7bb-32eb89263331" status: 200 len: 1520 microversion: 2.1 time: 0.167865 Oct 22 21:51:57.941994 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3169/6367] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:51:57 2022] GET /compute/v2.1/servers/a9c8b45a-14b4-4562-b7bb-32eb89263331 => generated 1520 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:51:58.970747 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-92d1ec27-e68e-4c54-9baf-190bb4a12ac2 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:51:58.971927 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-92d1ec27-e68e-4c54-9baf-190bb4a12ac2 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] [instance: a9c8b45a-14b4-4562-b7bb-32eb89263331] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:51:58.983424 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-92d1ec27-e68e-4c54-9baf-190bb4a12ac2 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:51:58.984409 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-92d1ec27-e68e-4c54-9baf-190bb4a12ac2 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:51:58.985158 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-92d1ec27-e68e-4c54-9baf-190bb4a12ac2 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:51:58.986297 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-92d1ec27-e68e-4c54-9baf-190bb4a12ac2 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:51:58.986763 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-92d1ec27-e68e-4c54-9baf-190bb4a12ac2 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:51:58.987205 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-92d1ec27-e68e-4c54-9baf-190bb4a12ac2 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:51:59.120499 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-92d1ec27-e68e-4c54-9baf-190bb4a12ac2 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22419916fc2641f88bfbdf103e7c3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf4cd612f04e91b3be2e7ca5658b97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:51:59.132476 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-92d1ec27-e68e-4c54-9baf-190bb4a12ac2 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] 10.222.0.18 "GET /compute/v2.1/servers/a9c8b45a-14b4-4562-b7bb-32eb89263331" status: 200 len: 1520 microversion: 2.1 time: 0.169146 Oct 22 21:51:59.133267 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3199/6368] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:51:58 2022] GET /compute/v2.1/servers/a9c8b45a-14b4-4562-b7bb-32eb89263331 => generated 1520 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:52:00.161912 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-55cba328-4af0-4e06-8250-8d2dacbbaf97 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:52:00.162641 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-55cba328-4af0-4e06-8250-8d2dacbbaf97 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] [instance: a9c8b45a-14b4-4562-b7bb-32eb89263331] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:52:00.172145 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-55cba328-4af0-4e06-8250-8d2dacbbaf97 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:52:00.172761 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-55cba328-4af0-4e06-8250-8d2dacbbaf97 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:52:00.173511 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-55cba328-4af0-4e06-8250-8d2dacbbaf97 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:52:00.174396 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-55cba328-4af0-4e06-8250-8d2dacbbaf97 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:52:00.175016 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-55cba328-4af0-4e06-8250-8d2dacbbaf97 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:52:00.175612 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-55cba328-4af0-4e06-8250-8d2dacbbaf97 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:52:00.375380 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-55cba328-4af0-4e06-8250-8d2dacbbaf97 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22419916fc2641f88bfbdf103e7c3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf4cd612f04e91b3be2e7ca5658b97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:52:00.384395 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-55cba328-4af0-4e06-8250-8d2dacbbaf97 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] 10.222.0.18 "GET /compute/v2.1/servers/a9c8b45a-14b4-4562-b7bb-32eb89263331" status: 200 len: 1520 microversion: 2.1 time: 0.228018 Oct 22 21:52:00.385051 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3170/6369] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:52:00 2022] GET /compute/v2.1/servers/a9c8b45a-14b4-4562-b7bb-32eb89263331 => generated 1520 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:52:01.408222 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-909f5955-6180-42a7-a203-683acc34f03c tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:52:01.408883 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-909f5955-6180-42a7-a203-683acc34f03c tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] [instance: a9c8b45a-14b4-4562-b7bb-32eb89263331] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:52:01.416807 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-909f5955-6180-42a7-a203-683acc34f03c tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:52:01.417305 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-909f5955-6180-42a7-a203-683acc34f03c tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:52:01.417760 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-909f5955-6180-42a7-a203-683acc34f03c tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:52:01.418482 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-909f5955-6180-42a7-a203-683acc34f03c tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:52:01.418956 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-909f5955-6180-42a7-a203-683acc34f03c tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:52:01.419429 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-909f5955-6180-42a7-a203-683acc34f03c tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:52:01.560773 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-909f5955-6180-42a7-a203-683acc34f03c tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22419916fc2641f88bfbdf103e7c3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf4cd612f04e91b3be2e7ca5658b97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:52:01.569252 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-909f5955-6180-42a7-a203-683acc34f03c tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] 10.222.0.18 "GET /compute/v2.1/servers/a9c8b45a-14b4-4562-b7bb-32eb89263331" status: 200 len: 1520 microversion: 2.1 time: 0.165080 Oct 22 21:52:01.569849 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3200/6370] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:52:01 2022] GET /compute/v2.1/servers/a9c8b45a-14b4-4562-b7bb-32eb89263331 => generated 1520 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:52:02.595865 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-1ff3a45e-4b29-4e13-9cc5-6ff092f53700 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:52:02.596564 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-1ff3a45e-4b29-4e13-9cc5-6ff092f53700 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] [instance: a9c8b45a-14b4-4562-b7bb-32eb89263331] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:52:02.607274 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1ff3a45e-4b29-4e13-9cc5-6ff092f53700 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:52:02.607946 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1ff3a45e-4b29-4e13-9cc5-6ff092f53700 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:52:02.608562 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1ff3a45e-4b29-4e13-9cc5-6ff092f53700 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:52:02.609593 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1ff3a45e-4b29-4e13-9cc5-6ff092f53700 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:52:02.610222 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1ff3a45e-4b29-4e13-9cc5-6ff092f53700 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:52:02.610786 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1ff3a45e-4b29-4e13-9cc5-6ff092f53700 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:52:02.751962 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-1ff3a45e-4b29-4e13-9cc5-6ff092f53700 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22419916fc2641f88bfbdf103e7c3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf4cd612f04e91b3be2e7ca5658b97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:52:02.760521 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-1ff3a45e-4b29-4e13-9cc5-6ff092f53700 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] 10.222.0.18 "GET /compute/v2.1/servers/a9c8b45a-14b4-4562-b7bb-32eb89263331" status: 200 len: 1520 microversion: 2.1 time: 0.171350 Oct 22 21:52:02.761097 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3171/6371] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:52:02 2022] GET /compute/v2.1/servers/a9c8b45a-14b4-4562-b7bb-32eb89263331 => generated 1520 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:52:03.787321 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-da08d2d5-cb9c-4964-b007-a431808bdb49 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:52:03.788080 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-da08d2d5-cb9c-4964-b007-a431808bdb49 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] [instance: a9c8b45a-14b4-4562-b7bb-32eb89263331] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:52:03.796549 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-da08d2d5-cb9c-4964-b007-a431808bdb49 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:52:03.797135 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-da08d2d5-cb9c-4964-b007-a431808bdb49 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:52:03.797664 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-da08d2d5-cb9c-4964-b007-a431808bdb49 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:52:03.798493 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-da08d2d5-cb9c-4964-b007-a431808bdb49 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:52:03.799048 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-da08d2d5-cb9c-4964-b007-a431808bdb49 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:52:03.799601 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-da08d2d5-cb9c-4964-b007-a431808bdb49 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:52:03.953394 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-da08d2d5-cb9c-4964-b007-a431808bdb49 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22419916fc2641f88bfbdf103e7c3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf4cd612f04e91b3be2e7ca5658b97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:52:03.965236 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-da08d2d5-cb9c-4964-b007-a431808bdb49 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] 10.222.0.18 "GET /compute/v2.1/servers/a9c8b45a-14b4-4562-b7bb-32eb89263331" status: 200 len: 1520 microversion: 2.1 time: 0.183935 Oct 22 21:52:03.966179 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3201/6372] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:52:03 2022] GET /compute/v2.1/servers/a9c8b45a-14b4-4562-b7bb-32eb89263331 => generated 1520 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:52:04.991866 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-be78373d-d20a-4eaf-b5d6-72aa48055830 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:52:04.992462 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-be78373d-d20a-4eaf-b5d6-72aa48055830 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] [instance: a9c8b45a-14b4-4562-b7bb-32eb89263331] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:52:04.999538 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-be78373d-d20a-4eaf-b5d6-72aa48055830 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:52:05.000022 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-be78373d-d20a-4eaf-b5d6-72aa48055830 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:52:05.000458 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-be78373d-d20a-4eaf-b5d6-72aa48055830 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:52:05.001202 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-be78373d-d20a-4eaf-b5d6-72aa48055830 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:52:05.001660 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-be78373d-d20a-4eaf-b5d6-72aa48055830 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:52:05.002084 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-be78373d-d20a-4eaf-b5d6-72aa48055830 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:52:05.134909 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-be78373d-d20a-4eaf-b5d6-72aa48055830 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22419916fc2641f88bfbdf103e7c3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf4cd612f04e91b3be2e7ca5658b97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:52:05.143183 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-be78373d-d20a-4eaf-b5d6-72aa48055830 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] 10.222.0.18 "GET /compute/v2.1/servers/a9c8b45a-14b4-4562-b7bb-32eb89263331" status: 200 len: 1520 microversion: 2.1 time: 0.155618 Oct 22 21:52:05.144311 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3172/6373] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:52:04 2022] GET /compute/v2.1/servers/a9c8b45a-14b4-4562-b7bb-32eb89263331 => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:52:06.176957 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-4e550095-f0d0-4b0a-bc57-55d1ced7c270 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:52:06.177945 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-4e550095-f0d0-4b0a-bc57-55d1ced7c270 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] [instance: a9c8b45a-14b4-4562-b7bb-32eb89263331] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:52:06.190081 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4e550095-f0d0-4b0a-bc57-55d1ced7c270 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:52:06.190969 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4e550095-f0d0-4b0a-bc57-55d1ced7c270 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:52:06.191870 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4e550095-f0d0-4b0a-bc57-55d1ced7c270 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:52:06.193065 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4e550095-f0d0-4b0a-bc57-55d1ced7c270 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:52:06.193769 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4e550095-f0d0-4b0a-bc57-55d1ced7c270 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:52:06.194247 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4e550095-f0d0-4b0a-bc57-55d1ced7c270 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:52:06.330526 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-4e550095-f0d0-4b0a-bc57-55d1ced7c270 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22419916fc2641f88bfbdf103e7c3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf4cd612f04e91b3be2e7ca5658b97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:52:06.339502 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-4e550095-f0d0-4b0a-bc57-55d1ced7c270 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] 10.222.0.18 "GET /compute/v2.1/servers/a9c8b45a-14b4-4562-b7bb-32eb89263331" status: 200 len: 1520 microversion: 2.1 time: 0.169049 Oct 22 21:52:06.340094 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3202/6374] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:52:06 2022] GET /compute/v2.1/servers/a9c8b45a-14b4-4562-b7bb-32eb89263331 => generated 1520 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:52:07.367944 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-ef1a5095-8bc3-4455-b977-10bcd654be30 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:52:07.368810 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-ef1a5095-8bc3-4455-b977-10bcd654be30 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] [instance: a9c8b45a-14b4-4562-b7bb-32eb89263331] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:52:07.380832 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ef1a5095-8bc3-4455-b977-10bcd654be30 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:52:07.381420 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ef1a5095-8bc3-4455-b977-10bcd654be30 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:52:07.381864 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ef1a5095-8bc3-4455-b977-10bcd654be30 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:52:07.382566 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ef1a5095-8bc3-4455-b977-10bcd654be30 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:52:07.383046 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ef1a5095-8bc3-4455-b977-10bcd654be30 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:52:07.383508 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ef1a5095-8bc3-4455-b977-10bcd654be30 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:52:07.532379 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-ef1a5095-8bc3-4455-b977-10bcd654be30 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22419916fc2641f88bfbdf103e7c3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf4cd612f04e91b3be2e7ca5658b97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:52:07.541396 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-ef1a5095-8bc3-4455-b977-10bcd654be30 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] 10.222.0.18 "GET /compute/v2.1/servers/a9c8b45a-14b4-4562-b7bb-32eb89263331" status: 200 len: 1520 microversion: 2.1 time: 0.180259 Oct 22 21:52:07.541961 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3173/6375] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:52:07 2022] GET /compute/v2.1/servers/a9c8b45a-14b4-4562-b7bb-32eb89263331 => generated 1520 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:52:08.565591 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-2850e597-d9c4-4e36-b2f7-3e65169e7f10 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:52:08.566373 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-2850e597-d9c4-4e36-b2f7-3e65169e7f10 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] [instance: a9c8b45a-14b4-4562-b7bb-32eb89263331] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:52:08.574739 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2850e597-d9c4-4e36-b2f7-3e65169e7f10 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:52:08.575302 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2850e597-d9c4-4e36-b2f7-3e65169e7f10 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:52:08.575843 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2850e597-d9c4-4e36-b2f7-3e65169e7f10 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:52:08.576638 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2850e597-d9c4-4e36-b2f7-3e65169e7f10 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:52:08.577162 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2850e597-d9c4-4e36-b2f7-3e65169e7f10 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:52:08.577658 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2850e597-d9c4-4e36-b2f7-3e65169e7f10 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:52:08.716027 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-2850e597-d9c4-4e36-b2f7-3e65169e7f10 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22419916fc2641f88bfbdf103e7c3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf4cd612f04e91b3be2e7ca5658b97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:52:08.724930 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-2850e597-d9c4-4e36-b2f7-3e65169e7f10 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] 10.222.0.18 "GET /compute/v2.1/servers/a9c8b45a-14b4-4562-b7bb-32eb89263331" status: 200 len: 1520 microversion: 2.1 time: 0.163694 Oct 22 21:52:08.725538 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3203/6376] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:52:08 2022] GET /compute/v2.1/servers/a9c8b45a-14b4-4562-b7bb-32eb89263331 => generated 1520 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:52:09.752841 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-9e5ea563-5701-427e-a7c3-829790c7c33f tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:52:09.753797 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-9e5ea563-5701-427e-a7c3-829790c7c33f tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] [instance: a9c8b45a-14b4-4562-b7bb-32eb89263331] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:52:09.762147 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9e5ea563-5701-427e-a7c3-829790c7c33f tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:52:09.762631 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9e5ea563-5701-427e-a7c3-829790c7c33f tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:52:09.763079 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9e5ea563-5701-427e-a7c3-829790c7c33f tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:52:09.763826 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9e5ea563-5701-427e-a7c3-829790c7c33f tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:52:09.764292 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9e5ea563-5701-427e-a7c3-829790c7c33f tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:52:09.764727 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9e5ea563-5701-427e-a7c3-829790c7c33f tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:52:09.901457 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-9e5ea563-5701-427e-a7c3-829790c7c33f tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22419916fc2641f88bfbdf103e7c3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf4cd612f04e91b3be2e7ca5658b97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:52:09.912775 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-9e5ea563-5701-427e-a7c3-829790c7c33f tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] 10.222.0.18 "GET /compute/v2.1/servers/a9c8b45a-14b4-4562-b7bb-32eb89263331" status: 200 len: 1520 microversion: 2.1 time: 0.166637 Oct 22 21:52:09.913361 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3174/6377] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:52:09 2022] GET /compute/v2.1/servers/a9c8b45a-14b4-4562-b7bb-32eb89263331 => generated 1520 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:52:10.940365 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-4376c69e-98b2-4446-81f6-48c9dc19a691 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:52:10.941389 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-4376c69e-98b2-4446-81f6-48c9dc19a691 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] [instance: a9c8b45a-14b4-4562-b7bb-32eb89263331] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:52:10.953009 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4376c69e-98b2-4446-81f6-48c9dc19a691 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:52:10.953832 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4376c69e-98b2-4446-81f6-48c9dc19a691 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:52:10.954579 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4376c69e-98b2-4446-81f6-48c9dc19a691 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:52:10.955820 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4376c69e-98b2-4446-81f6-48c9dc19a691 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:52:10.956586 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4376c69e-98b2-4446-81f6-48c9dc19a691 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:52:10.957317 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4376c69e-98b2-4446-81f6-48c9dc19a691 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:52:11.090729 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-4376c69e-98b2-4446-81f6-48c9dc19a691 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22419916fc2641f88bfbdf103e7c3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf4cd612f04e91b3be2e7ca5658b97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:52:11.099517 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-4376c69e-98b2-4446-81f6-48c9dc19a691 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] 10.222.0.18 "GET /compute/v2.1/servers/a9c8b45a-14b4-4562-b7bb-32eb89263331" status: 200 len: 1520 microversion: 2.1 time: 0.165675 Oct 22 21:52:11.100287 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3204/6378] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:52:10 2022] GET /compute/v2.1/servers/a9c8b45a-14b4-4562-b7bb-32eb89263331 => generated 1520 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:52:12.123368 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-98155324-4a0d-47d9-9c6c-1170181954c3 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:52:12.124030 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-98155324-4a0d-47d9-9c6c-1170181954c3 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] [instance: a9c8b45a-14b4-4562-b7bb-32eb89263331] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:52:12.132566 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-98155324-4a0d-47d9-9c6c-1170181954c3 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:52:12.133061 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-98155324-4a0d-47d9-9c6c-1170181954c3 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:52:12.133504 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-98155324-4a0d-47d9-9c6c-1170181954c3 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:52:12.134220 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-98155324-4a0d-47d9-9c6c-1170181954c3 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:52:12.134680 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-98155324-4a0d-47d9-9c6c-1170181954c3 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:52:12.135116 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-98155324-4a0d-47d9-9c6c-1170181954c3 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:52:12.295668 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-1a40d222-9382-420f-a16d-f654f9faee1f req-42ce8dac-e52e-4df8-a145-5c63ab861b5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9c8b45a-14b4-4562-b7bb-32eb89263331", "name": "network-vif-unplugged", "status": "completed", "tag": "a48a360a-0eb4-446e-9f55-64c247abc4f2"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:52:12.306171 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-1a40d222-9382-420f-a16d-f654f9faee1f req-42ce8dac-e52e-4df8-a145-5c63ab861b5e service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:52:12.306823 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-1a40d222-9382-420f-a16d-f654f9faee1f req-42ce8dac-e52e-4df8-a145-5c63ab861b5e service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:52:12.307307 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-1a40d222-9382-420f-a16d-f654f9faee1f req-42ce8dac-e52e-4df8-a145-5c63ab861b5e service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:52:12.319435 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-1a40d222-9382-420f-a16d-f654f9faee1f req-42ce8dac-e52e-4df8-a145-5c63ab861b5e service nova] Creating event network-vif-unplugged:a48a360a-0eb4-446e-9f55-64c247abc4f2 for instance a9c8b45a-14b4-4562-b7bb-32eb89263331 on nch2-master-1 Oct 22 21:52:12.325049 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [req-1a40d222-9382-420f-a16d-f654f9faee1f req-42ce8dac-e52e-4df8-a145-5c63ab861b5e service nova] Instance a9c8b45a-14b4-4562-b7bb-32eb89263331 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=138745) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 22 21:52:12.336483 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-1a40d222-9382-420f-a16d-f654f9faee1f req-42ce8dac-e52e-4df8-a145-5c63ab861b5e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.105999 Oct 22 21:52:12.337100 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3205/6379] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:52:12 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:52:12.379616 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-98155324-4a0d-47d9-9c6c-1170181954c3 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22419916fc2641f88bfbdf103e7c3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf4cd612f04e91b3be2e7ca5658b97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:52:12.388572 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-98155324-4a0d-47d9-9c6c-1170181954c3 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] 10.222.0.18 "GET /compute/v2.1/servers/a9c8b45a-14b4-4562-b7bb-32eb89263331" status: 200 len: 1519 microversion: 2.1 time: 0.269436 Oct 22 21:52:12.389183 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3175/6380] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:52:12 2022] GET /compute/v2.1/servers/a9c8b45a-14b4-4562-b7bb-32eb89263331 => generated 1519 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:52:13.418550 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-1f30f993-534a-4797-b363-40056f543095 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:52:13.419784 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-1f30f993-534a-4797-b363-40056f543095 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] [instance: a9c8b45a-14b4-4562-b7bb-32eb89263331] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:52:13.430638 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1f30f993-534a-4797-b363-40056f543095 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:52:13.431527 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1f30f993-534a-4797-b363-40056f543095 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:52:13.432296 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1f30f993-534a-4797-b363-40056f543095 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:52:13.433483 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1f30f993-534a-4797-b363-40056f543095 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:52:13.434272 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1f30f993-534a-4797-b363-40056f543095 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:52:13.435020 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1f30f993-534a-4797-b363-40056f543095 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:52:13.439576 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:52:13.570436 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-1f30f993-534a-4797-b363-40056f543095 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22419916fc2641f88bfbdf103e7c3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf4cd612f04e91b3be2e7ca5658b97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:52:13.578433 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-1f30f993-534a-4797-b363-40056f543095 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] 10.222.0.18 "GET /compute/v2.1/servers/a9c8b45a-14b4-4562-b7bb-32eb89263331" status: 200 len: 1517 microversion: 2.1 time: 0.168588 Oct 22 21:52:13.579003 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3206/6381] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:52:13 2022] GET /compute/v2.1/servers/a9c8b45a-14b4-4562-b7bb-32eb89263331 => generated 1517 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:52:14.362549 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-e8048c63-4ee7-430d-ade1-146b50db7b62 req-9a477329-40c9-47be-b94d-5e90614ebc4e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a9c8b45a-14b4-4562-b7bb-32eb89263331", "tag": "a48a360a-0eb4-446e-9f55-64c247abc4f2"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:52:14.379917 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-e8048c63-4ee7-430d-ade1-146b50db7b62 req-9a477329-40c9-47be-b94d-5e90614ebc4e service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:52:14.380930 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-e8048c63-4ee7-430d-ade1-146b50db7b62 req-9a477329-40c9-47be-b94d-5e90614ebc4e service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:52:14.381420 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-e8048c63-4ee7-430d-ade1-146b50db7b62 req-9a477329-40c9-47be-b94d-5e90614ebc4e service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:52:14.383994 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:SELECT=78 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:52:14.394413 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-e8048c63-4ee7-430d-ade1-146b50db7b62 req-9a477329-40c9-47be-b94d-5e90614ebc4e service nova] Creating event network-changed:a48a360a-0eb4-446e-9f55-64c247abc4f2 for instance a9c8b45a-14b4-4562-b7bb-32eb89263331 on nch2-master-1 Oct 22 21:52:14.400189 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [req-e8048c63-4ee7-430d-ade1-146b50db7b62 req-9a477329-40c9-47be-b94d-5e90614ebc4e service nova] Instance a9c8b45a-14b4-4562-b7bb-32eb89263331 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=138744) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 22 21:52:14.411381 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-e8048c63-4ee7-430d-ade1-146b50db7b62 req-9a477329-40c9-47be-b94d-5e90614ebc4e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055160 Oct 22 21:52:14.412076 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3176/6382] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:52:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:52:14.602598 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-4b0b6d53-6239-4e87-b927-35eb695d3a80 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:52:14.603206 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-4b0b6d53-6239-4e87-b927-35eb695d3a80 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] [instance: a9c8b45a-14b4-4562-b7bb-32eb89263331] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:52:14.610700 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4b0b6d53-6239-4e87-b927-35eb695d3a80 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:52:14.611219 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4b0b6d53-6239-4e87-b927-35eb695d3a80 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:52:14.611699 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4b0b6d53-6239-4e87-b927-35eb695d3a80 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:52:14.612626 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4b0b6d53-6239-4e87-b927-35eb695d3a80 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:52:14.613151 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4b0b6d53-6239-4e87-b927-35eb695d3a80 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:52:14.613624 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4b0b6d53-6239-4e87-b927-35eb695d3a80 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:52:14.956204 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-4b0b6d53-6239-4e87-b927-35eb695d3a80 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22419916fc2641f88bfbdf103e7c3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf4cd612f04e91b3be2e7ca5658b97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:52:14.967027 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-4b0b6d53-6239-4e87-b927-35eb695d3a80 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] 10.222.0.18 "GET /compute/v2.1/servers/a9c8b45a-14b4-4562-b7bb-32eb89263331" status: 200 len: 1517 microversion: 2.1 time: 0.368353 Oct 22 21:52:14.979588 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3207/6383] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:52:14 2022] GET /compute/v2.1/servers/a9c8b45a-14b4-4562-b7bb-32eb89263331 => generated 1517 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:52:15.995575 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-28075860-f0cd-4bc4-bde5-b85c0852f85d tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:52:15.996307 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-28075860-f0cd-4bc4-bde5-b85c0852f85d tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] [instance: a9c8b45a-14b4-4562-b7bb-32eb89263331] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:52:16.003374 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-28075860-f0cd-4bc4-bde5-b85c0852f85d tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:52:16.003989 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-28075860-f0cd-4bc4-bde5-b85c0852f85d tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:52:16.004458 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-28075860-f0cd-4bc4-bde5-b85c0852f85d tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:52:16.005188 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-28075860-f0cd-4bc4-bde5-b85c0852f85d tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:52:16.005663 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-28075860-f0cd-4bc4-bde5-b85c0852f85d tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:52:16.006115 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-28075860-f0cd-4bc4-bde5-b85c0852f85d tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:52:16.146489 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-28075860-f0cd-4bc4-bde5-b85c0852f85d tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22419916fc2641f88bfbdf103e7c3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf4cd612f04e91b3be2e7ca5658b97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:52:16.155290 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-28075860-f0cd-4bc4-bde5-b85c0852f85d tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] 10.222.0.18 "GET /compute/v2.1/servers/a9c8b45a-14b4-4562-b7bb-32eb89263331" status: 200 len: 1514 microversion: 2.1 time: 0.166045 Oct 22 21:52:16.155924 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3177/6384] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:52:15 2022] GET /compute/v2.1/servers/a9c8b45a-14b4-4562-b7bb-32eb89263331 => generated 1514 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:52:16.179249 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-33b3d847-a235-4cbc-8cfa-4a11797b405f tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:52:16.179848 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-33b3d847-a235-4cbc-8cfa-4a11797b405f tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] [instance: a9c8b45a-14b4-4562-b7bb-32eb89263331] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:52:16.187034 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-33b3d847-a235-4cbc-8cfa-4a11797b405f tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:52:16.187578 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-33b3d847-a235-4cbc-8cfa-4a11797b405f tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:52:16.188029 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-33b3d847-a235-4cbc-8cfa-4a11797b405f tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:52:16.188738 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-33b3d847-a235-4cbc-8cfa-4a11797b405f tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:52:16.189209 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-33b3d847-a235-4cbc-8cfa-4a11797b405f tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:52:16.189650 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-33b3d847-a235-4cbc-8cfa-4a11797b405f tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:52:16.256142 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-33b3d847-a235-4cbc-8cfa-4a11797b405f tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] 10.222.0.18 "POST /compute/v2.1/servers/a9c8b45a-14b4-4562-b7bb-32eb89263331/action" status: 204 len: 0 microversion: 2.1 time: 0.080624 Oct 22 21:52:16.256687 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3208/6385] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 21:52:16 2022] POST /compute/v2.1/servers/a9c8b45a-14b4-4562-b7bb-32eb89263331/action => generated 0 bytes in 82 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 21:52:16.266549 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-c774a650-2409-4936-bff0-3d2012e68796 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:52:16.267167 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-c774a650-2409-4936-bff0-3d2012e68796 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] [instance: a9c8b45a-14b4-4562-b7bb-32eb89263331] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:52:16.273441 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c774a650-2409-4936-bff0-3d2012e68796 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:52:16.273942 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c774a650-2409-4936-bff0-3d2012e68796 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:52:16.274394 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c774a650-2409-4936-bff0-3d2012e68796 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:52:16.275070 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c774a650-2409-4936-bff0-3d2012e68796 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:52:16.275568 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c774a650-2409-4936-bff0-3d2012e68796 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:52:16.275975 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c774a650-2409-4936-bff0-3d2012e68796 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:52:16.507709 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-c774a650-2409-4936-bff0-3d2012e68796 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22419916fc2641f88bfbdf103e7c3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf4cd612f04e91b3be2e7ca5658b97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:52:16.515786 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-c774a650-2409-4936-bff0-3d2012e68796 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] 10.222.0.18 "GET /compute/v2.1/servers/a9c8b45a-14b4-4562-b7bb-32eb89263331" status: 200 len: 1514 microversion: 2.1 time: 0.254627 Oct 22 21:52:16.516370 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3178/6386] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:52:16 2022] GET /compute/v2.1/servers/a9c8b45a-14b4-4562-b7bb-32eb89263331 => generated 1514 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:52:16.815119 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-980194e3-b030-4f86-ac47-b09fb9f6d28f req-6fa49a21-2bec-44bc-a894-fe5530352608 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9c8b45a-14b4-4562-b7bb-32eb89263331", "name": "network-vif-plugged", "status": "completed", "tag": "a48a360a-0eb4-446e-9f55-64c247abc4f2"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:52:16.825386 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-980194e3-b030-4f86-ac47-b09fb9f6d28f req-6fa49a21-2bec-44bc-a894-fe5530352608 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:52:16.825943 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-980194e3-b030-4f86-ac47-b09fb9f6d28f req-6fa49a21-2bec-44bc-a894-fe5530352608 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:52:16.826428 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-980194e3-b030-4f86-ac47-b09fb9f6d28f req-6fa49a21-2bec-44bc-a894-fe5530352608 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:52:16.841178 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-980194e3-b030-4f86-ac47-b09fb9f6d28f req-6fa49a21-2bec-44bc-a894-fe5530352608 service nova] Creating event network-vif-plugged:a48a360a-0eb4-446e-9f55-64c247abc4f2 for instance a9c8b45a-14b4-4562-b7bb-32eb89263331 on nch2-master-1 Oct 22 21:52:16.847285 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [req-980194e3-b030-4f86-ac47-b09fb9f6d28f req-6fa49a21-2bec-44bc-a894-fe5530352608 service nova] Instance a9c8b45a-14b4-4562-b7bb-32eb89263331 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=138745) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 22 21:52:16.860158 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-980194e3-b030-4f86-ac47-b09fb9f6d28f req-6fa49a21-2bec-44bc-a894-fe5530352608 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049210 Oct 22 21:52:16.860883 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3209/6387] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:52:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:52:17.541671 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-fa41cc64-25a0-4ace-a22f-63431337945e tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:52:17.542347 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-fa41cc64-25a0-4ace-a22f-63431337945e tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] [instance: a9c8b45a-14b4-4562-b7bb-32eb89263331] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:52:17.550932 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fa41cc64-25a0-4ace-a22f-63431337945e tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:52:17.551561 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fa41cc64-25a0-4ace-a22f-63431337945e tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:52:17.552072 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fa41cc64-25a0-4ace-a22f-63431337945e tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:52:17.552902 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fa41cc64-25a0-4ace-a22f-63431337945e tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:52:17.553443 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fa41cc64-25a0-4ace-a22f-63431337945e tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:52:17.553954 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fa41cc64-25a0-4ace-a22f-63431337945e tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:52:17.701497 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-fa41cc64-25a0-4ace-a22f-63431337945e tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22419916fc2641f88bfbdf103e7c3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf4cd612f04e91b3be2e7ca5658b97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:52:17.709955 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-fa41cc64-25a0-4ace-a22f-63431337945e tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] 10.222.0.18 "GET /compute/v2.1/servers/a9c8b45a-14b4-4562-b7bb-32eb89263331" status: 200 len: 1514 microversion: 2.1 time: 0.174299 Oct 22 21:52:17.710533 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3179/6388] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:52:17 2022] GET /compute/v2.1/servers/a9c8b45a-14b4-4562-b7bb-32eb89263331 => generated 1514 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:52:18.735354 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-fdc85801-401d-45c3-83da-945826473fac tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:52:18.736072 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-fdc85801-401d-45c3-83da-945826473fac tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] [instance: a9c8b45a-14b4-4562-b7bb-32eb89263331] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:52:18.742849 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fdc85801-401d-45c3-83da-945826473fac tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:52:18.743362 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fdc85801-401d-45c3-83da-945826473fac tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:52:18.743822 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fdc85801-401d-45c3-83da-945826473fac tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:52:18.744611 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fdc85801-401d-45c3-83da-945826473fac tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:52:18.745078 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fdc85801-401d-45c3-83da-945826473fac tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:52:18.745521 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fdc85801-401d-45c3-83da-945826473fac tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:52:18.879634 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-fdc85801-401d-45c3-83da-945826473fac tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22419916fc2641f88bfbdf103e7c3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf4cd612f04e91b3be2e7ca5658b97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:52:18.889947 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-fdc85801-401d-45c3-83da-945826473fac tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] 10.222.0.18 "GET /compute/v2.1/servers/a9c8b45a-14b4-4562-b7bb-32eb89263331" status: 200 len: 1506 microversion: 2.1 time: 0.159856 Oct 22 21:52:18.890548 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3210/6389] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:52:18 2022] GET /compute/v2.1/servers/a9c8b45a-14b4-4562-b7bb-32eb89263331 => generated 1506 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:52:18.916595 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-47d5bf8b-c8fc-4c57-b141-35834cec69cd tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:52:18.917164 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-47d5bf8b-c8fc-4c57-b141-35834cec69cd tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] [instance: a9c8b45a-14b4-4562-b7bb-32eb89263331] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:52:18.924666 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-47d5bf8b-c8fc-4c57-b141-35834cec69cd tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:52:18.925150 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-47d5bf8b-c8fc-4c57-b141-35834cec69cd tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:52:18.925587 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-47d5bf8b-c8fc-4c57-b141-35834cec69cd tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:52:18.926315 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-47d5bf8b-c8fc-4c57-b141-35834cec69cd tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:52:18.926768 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-47d5bf8b-c8fc-4c57-b141-35834cec69cd tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:52:18.927194 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-47d5bf8b-c8fc-4c57-b141-35834cec69cd tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:52:19.061543 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-47d5bf8b-c8fc-4c57-b141-35834cec69cd tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22419916fc2641f88bfbdf103e7c3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf4cd612f04e91b3be2e7ca5658b97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:52:19.070188 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-47d5bf8b-c8fc-4c57-b141-35834cec69cd tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] 10.222.0.18 "GET /compute/v2.1/servers/a9c8b45a-14b4-4562-b7bb-32eb89263331" status: 200 len: 1506 microversion: 2.1 time: 0.157793 Oct 22 21:52:19.070764 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3180/6390] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:52:18 2022] GET /compute/v2.1/servers/a9c8b45a-14b4-4562-b7bb-32eb89263331 => generated 1506 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:52:19.093290 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-174431f9-9af5-49db-bae4-9d01441dfc32 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:52:19.093926 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-174431f9-9af5-49db-bae4-9d01441dfc32 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] [instance: a9c8b45a-14b4-4562-b7bb-32eb89263331] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:52:19.100519 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-174431f9-9af5-49db-bae4-9d01441dfc32 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:52:19.101028 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-174431f9-9af5-49db-bae4-9d01441dfc32 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:52:19.101492 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-174431f9-9af5-49db-bae4-9d01441dfc32 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:52:19.102211 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-174431f9-9af5-49db-bae4-9d01441dfc32 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:52:19.102688 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-174431f9-9af5-49db-bae4-9d01441dfc32 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:52:19.103138 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-174431f9-9af5-49db-bae4-9d01441dfc32 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:52:19.252996 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-174431f9-9af5-49db-bae4-9d01441dfc32 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22419916fc2641f88bfbdf103e7c3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf4cd612f04e91b3be2e7ca5658b97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:52:19.261725 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-174431f9-9af5-49db-bae4-9d01441dfc32 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] 10.222.0.18 "GET /compute/v2.1/servers/a9c8b45a-14b4-4562-b7bb-32eb89263331" status: 200 len: 1506 microversion: 2.1 time: 0.172740 Oct 22 21:52:19.262380 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3211/6391] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:52:19 2022] GET /compute/v2.1/servers/a9c8b45a-14b4-4562-b7bb-32eb89263331 => generated 1506 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:52:19.284401 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-fecb254b-bb7d-4466-b8c0-1dfe7d16ab4c tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:52:19.284911 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-fecb254b-bb7d-4466-b8c0-1dfe7d16ab4c tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] [instance: a9c8b45a-14b4-4562-b7bb-32eb89263331] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:52:19.291382 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fecb254b-bb7d-4466-b8c0-1dfe7d16ab4c tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:52:19.291902 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fecb254b-bb7d-4466-b8c0-1dfe7d16ab4c tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:52:19.292344 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fecb254b-bb7d-4466-b8c0-1dfe7d16ab4c tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:52:19.293070 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fecb254b-bb7d-4466-b8c0-1dfe7d16ab4c tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:52:19.293530 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fecb254b-bb7d-4466-b8c0-1dfe7d16ab4c tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:52:19.293960 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fecb254b-bb7d-4466-b8c0-1dfe7d16ab4c tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:52:19.321284 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-fecb254b-bb7d-4466-b8c0-1dfe7d16ab4c tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] [instance: a9c8b45a-14b4-4562-b7bb-32eb89263331] Going to try to terminate instance {{(pid=138744) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 21:52:19.404902 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-fecb254b-bb7d-4466-b8c0-1dfe7d16ab4c tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] 10.222.0.18 "DELETE /compute/v2.1/servers/a9c8b45a-14b4-4562-b7bb-32eb89263331" status: 204 len: 0 microversion: 2.1 time: 0.124234 Oct 22 21:52:19.405490 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3181/6392] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 21:52:19 2022] DELETE /compute/v2.1/servers/a9c8b45a-14b4-4562-b7bb-32eb89263331 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 21:52:19.421663 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-dcdf562b-e86d-4bed-bc47-af8eabf8d6ed tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:52:19.422302 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-dcdf562b-e86d-4bed-bc47-af8eabf8d6ed tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] [instance: a9c8b45a-14b4-4562-b7bb-32eb89263331] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:52:19.428760 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-dcdf562b-e86d-4bed-bc47-af8eabf8d6ed tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:52:19.429261 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-dcdf562b-e86d-4bed-bc47-af8eabf8d6ed tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:52:19.429721 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-dcdf562b-e86d-4bed-bc47-af8eabf8d6ed tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:52:19.430432 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-dcdf562b-e86d-4bed-bc47-af8eabf8d6ed tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:52:19.430915 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-dcdf562b-e86d-4bed-bc47-af8eabf8d6ed tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:52:19.431384 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-dcdf562b-e86d-4bed-bc47-af8eabf8d6ed tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:52:19.459752 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-dcdf562b-e86d-4bed-bc47-af8eabf8d6ed tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] [instance: a9c8b45a-14b4-4562-b7bb-32eb89263331] Going to try to terminate instance {{(pid=138745) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 21:52:19.509701 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.compute.api [None req-dcdf562b-e86d-4bed-bc47-af8eabf8d6ed tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] [instance: a9c8b45a-14b4-4562-b7bb-32eb89263331] Instance is already in deleting state, ignoring this request Oct 22 21:52:19.510569 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-dcdf562b-e86d-4bed-bc47-af8eabf8d6ed tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] 10.222.0.18 "DELETE /compute/v2.1/servers/a9c8b45a-14b4-4562-b7bb-32eb89263331" status: 204 len: 0 microversion: 2.1 time: 0.093004 Oct 22 21:52:19.511149 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3212/6393] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 21:52:19 2022] DELETE /compute/v2.1/servers/a9c8b45a-14b4-4562-b7bb-32eb89263331 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 21:52:19.520024 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-592f158b-7057-4335-979a-c590ebce48b9 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:52:19.520937 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-592f158b-7057-4335-979a-c590ebce48b9 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] [instance: a9c8b45a-14b4-4562-b7bb-32eb89263331] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:52:19.527712 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-592f158b-7057-4335-979a-c590ebce48b9 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:52:19.528217 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-592f158b-7057-4335-979a-c590ebce48b9 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:52:19.528662 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-592f158b-7057-4335-979a-c590ebce48b9 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:52:19.529370 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-592f158b-7057-4335-979a-c590ebce48b9 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:52:19.529826 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-592f158b-7057-4335-979a-c590ebce48b9 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:52:19.530264 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-592f158b-7057-4335-979a-c590ebce48b9 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:52:19.665152 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-592f158b-7057-4335-979a-c590ebce48b9 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22419916fc2641f88bfbdf103e7c3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf4cd612f04e91b3be2e7ca5658b97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:52:19.674037 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-592f158b-7057-4335-979a-c590ebce48b9 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] 10.222.0.18 "GET /compute/v2.1/servers/a9c8b45a-14b4-4562-b7bb-32eb89263331" status: 200 len: 1512 microversion: 2.1 time: 0.158337 Oct 22 21:52:19.674615 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3182/6394] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:52:19 2022] GET /compute/v2.1/servers/a9c8b45a-14b4-4562-b7bb-32eb89263331 => generated 1512 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:52:20.697888 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-1bfe866c-5abb-4b99-8598-c64c32ef3aa5 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:52:20.698499 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-1bfe866c-5abb-4b99-8598-c64c32ef3aa5 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] [instance: a9c8b45a-14b4-4562-b7bb-32eb89263331] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:52:20.705887 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1bfe866c-5abb-4b99-8598-c64c32ef3aa5 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:52:20.706391 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1bfe866c-5abb-4b99-8598-c64c32ef3aa5 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:52:20.706869 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1bfe866c-5abb-4b99-8598-c64c32ef3aa5 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:52:20.707663 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1bfe866c-5abb-4b99-8598-c64c32ef3aa5 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:52:20.708119 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1bfe866c-5abb-4b99-8598-c64c32ef3aa5 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:52:20.708596 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1bfe866c-5abb-4b99-8598-c64c32ef3aa5 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:52:20.875632 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-1bfe866c-5abb-4b99-8598-c64c32ef3aa5 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22419916fc2641f88bfbdf103e7c3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf4cd612f04e91b3be2e7ca5658b97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:52:20.884049 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-1bfe866c-5abb-4b99-8598-c64c32ef3aa5 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] 10.222.0.18 "GET /compute/v2.1/servers/a9c8b45a-14b4-4562-b7bb-32eb89263331" status: 200 len: 1512 microversion: 2.1 time: 0.190305 Oct 22 21:52:20.884633 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3213/6395] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:52:20 2022] GET /compute/v2.1/servers/a9c8b45a-14b4-4562-b7bb-32eb89263331 => generated 1512 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:52:21.314045 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-6c631cab-939c-4848-af3a-3ff24e986d4e req-2ac54d1f-182a-46de-b52f-317cb047b56a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9c8b45a-14b4-4562-b7bb-32eb89263331", "name": "network-vif-deleted", "tag": "a48a360a-0eb4-446e-9f55-64c247abc4f2"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:52:21.320407 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:52:21.328422 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-6c631cab-939c-4848-af3a-3ff24e986d4e req-2ac54d1f-182a-46de-b52f-317cb047b56a service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:52:21.328906 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-6c631cab-939c-4848-af3a-3ff24e986d4e req-2ac54d1f-182a-46de-b52f-317cb047b56a service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:52:21.329341 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-6c631cab-939c-4848-af3a-3ff24e986d4e req-2ac54d1f-182a-46de-b52f-317cb047b56a service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:52:21.343836 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-6c631cab-939c-4848-af3a-3ff24e986d4e req-2ac54d1f-182a-46de-b52f-317cb047b56a service nova] Creating event network-vif-deleted:a48a360a-0eb4-446e-9f55-64c247abc4f2 for instance a9c8b45a-14b4-4562-b7bb-32eb89263331 on nch2-master-1 Oct 22 21:52:21.349914 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-6c631cab-939c-4848-af3a-3ff24e986d4e req-2ac54d1f-182a-46de-b52f-317cb047b56a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041289 Oct 22 21:52:21.350707 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3183/6396] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:52:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:52:21.910932 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-1581d537-a64c-43c5-81f8-67edb2dd4e35 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:52:21.911856 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-1581d537-a64c-43c5-81f8-67edb2dd4e35 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] [instance: a9c8b45a-14b4-4562-b7bb-32eb89263331] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:52:21.916627 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_api:SELECT=36 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:52:21.922281 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1581d537-a64c-43c5-81f8-67edb2dd4e35 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:52:21.922786 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1581d537-a64c-43c5-81f8-67edb2dd4e35 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:52:21.923242 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1581d537-a64c-43c5-81f8-67edb2dd4e35 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:52:21.923992 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1581d537-a64c-43c5-81f8-67edb2dd4e35 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:52:21.924467 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1581d537-a64c-43c5-81f8-67edb2dd4e35 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:52:21.924911 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1581d537-a64c-43c5-81f8-67edb2dd4e35 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:52:21.938983 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.wsgi [None req-1581d537-a64c-43c5-81f8-67edb2dd4e35 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] HTTP exception thrown: Instance a9c8b45a-14b4-4562-b7bb-32eb89263331 could not be found. Oct 22 21:52:21.940734 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-1581d537-a64c-43c5-81f8-67edb2dd4e35 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Request method failure captured: Oct 22 21:52:21.940734 ncdv-master-1 devstack@n-api.service[138745]: request: GET /compute/v2.1/servers/a9c8b45a-14b4-4562-b7bb-32eb89263331 HTTP/1.1 Oct 22 21:52:21.940734 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 21:52:21.940734 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 21:52:21.940734 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 21:52:21.940734 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 0 Oct 22 21:52:21.940734 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 21:52:21.940734 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 21:52:21.940734 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 21:52:21.940734 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 21:52:21.940734 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVGWv_MYBjcXE2YFfZAuyoDkZvd59-LYnCZeIeReqXLjCbzyEC9_cDDcsYEBHR5gXwa_yRqLqc-BlNYQJYb9qhgOARTEK7bQiXl3hxmvwrTDEMf2aot6Cbx7IbjvwWrfwUS1LGLKGQ_r0mQh_AHRHxf9jI8D1_Y_L8UK2lQXYypJp3-s Oct 22 21:52:21.940734 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 21:52:21.940734 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 21:52:21.940734 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 21:52:21.940734 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 21:52:21.940734 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 21:52:21.940734 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 21:52:21.940734 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: f4cf4cd612f04e91b3be2e7ca5658b97 Oct 22 21:52:21.940734 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1974046167 Oct 22 21:52:21.940734 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 21:52:21.940734 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 21:52:21.940734 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_f4cf4cd612f04e91b3be2e7ca5658b97"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f4cf4cd612f04e91b3be2e7ca5658b97"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/f4cf4cd612f04e91b3be2e7ca5658b97"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f4cf4cd612f04e91b3be2e7ca5658b97"}]}] Oct 22 21:52:21.940734 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-ServerDiskConfigTestJSON-1974046167 Oct 22 21:52:21.940734 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: f4cf4cd612f04e91b3be2e7ca5658b97 Oct 22 21:52:21.940734 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1974046167 Oct 22 21:52:21.940734 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-ServerDiskConfigTestJSON-1974046167-project Oct 22 21:52:21.940734 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 21:52:21.940734 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 21:52:21.940734 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: 22419916fc2641f88bfbdf103e7c3ee6 Oct 22 21:52:21.940734 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-ServerDiskConfigTestJSON-1974046167-project Oct 22 21:52:21.940734 ncdv-master-1 devstack@n-api.service[138745]: method: > Oct 22 21:52:21.940734 ncdv-master-1 devstack@n-api.service[138745]: exception: Instance a9c8b45a-14b4-4562-b7bb-32eb89263331 could not be found. Oct 22 21:52:21.940734 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'id': 'a9c8b45a-14b4-4562-b7bb-32eb89263331'} Oct 22 21:52:21.940734 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:52:21.940734 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:52:21.940734 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 21:52:21.940734 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 21:52:21.940734 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 21:52:21.940734 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 21:52:21.940734 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 21:52:21.940734 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 21:52:21.940734 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 21:52:21.940734 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 21:52:21.940734 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a9c8b45a-14b4-4562-b7bb-32eb89263331 could not be found. Oct 22 21:52:21.940734 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:52:21.940734 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:52:21.940734 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:52:21.940734 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:52:21.940734 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:52:21.940734 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:52:21.940734 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:52:21.940734 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:52:21.940734 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:52:21.940734 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:52:21.940734 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 21:52:21.940734 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 21:52:21.940734 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 21:52:21.940734 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 21:52:21.940734 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 21:52:21.940734 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:52:21.940734 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a9c8b45a-14b4-4562-b7bb-32eb89263331 could not be found. Oct 22 21:52:21.940734 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:52:21.940734 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:52:21.940734 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:52:21.946151 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:52:21.946151 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:52:21.946151 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:52:21.946151 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:52:21.946151 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:52:21.946151 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a9c8b45a-14b4-4562-b7bb-32eb89263331 could not be found. Oct 22 21:52:21.946151 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:52:21.946151 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-1581d537-a64c-43c5-81f8-67edb2dd4e35 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Returning 404 to user: Instance a9c8b45a-14b4-4562-b7bb-32eb89263331 could not be found. {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:52:21.946151 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-1581d537-a64c-43c5-81f8-67edb2dd4e35 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] 10.222.0.18 "GET /compute/v2.1/servers/a9c8b45a-14b4-4562-b7bb-32eb89263331" status: 404 len: 111 microversion: 2.1 time: 0.037978 Oct 22 21:52:21.946151 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3214/6397] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:52:21 2022] GET /compute/v2.1/servers/a9c8b45a-14b4-4562-b7bb-32eb89263331 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 21:52:21.951794 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-57de1687-cfc2-402f-8f96-2f1bb3c3cfd3 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Calling method '.version_select at 0x7fd39f25e160>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:52:21.979487 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-57de1687-cfc2-402f-8f96-2f1bb3c3cfd3 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1601736271" status: 202 len: 0 microversion: 2.1 time: 0.032073 Oct 22 21:52:21.980074 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3184/6398] 10.222.0.18 () {58 vars in 1221 bytes} [Sat Oct 22 21:52:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1601736271 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 21:52:22.596712 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-f2dedcce-2a64-4983-8c2b-3844dabafe07 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:52:22.597436 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-f2dedcce-2a64-4983-8c2b-3844dabafe07 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] [instance: e3f9f3ab-26f2-427b-9dc5-bfc007cdef20] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:52:22.606269 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f2dedcce-2a64-4983-8c2b-3844dabafe07 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:52:22.606979 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f2dedcce-2a64-4983-8c2b-3844dabafe07 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:52:22.607688 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f2dedcce-2a64-4983-8c2b-3844dabafe07 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:52:22.608769 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f2dedcce-2a64-4983-8c2b-3844dabafe07 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:52:22.609415 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f2dedcce-2a64-4983-8c2b-3844dabafe07 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:52:22.610096 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f2dedcce-2a64-4983-8c2b-3844dabafe07 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:52:22.626936 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.wsgi [None req-f2dedcce-2a64-4983-8c2b-3844dabafe07 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] HTTP exception thrown: Instance e3f9f3ab-26f2-427b-9dc5-bfc007cdef20 could not be found. Oct 22 21:52:22.628522 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-f2dedcce-2a64-4983-8c2b-3844dabafe07 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Request method failure captured: Oct 22 21:52:22.628522 ncdv-master-1 devstack@n-api.service[138745]: request: DELETE /compute/v2.1/servers/e3f9f3ab-26f2-427b-9dc5-bfc007cdef20 HTTP/1.1 Oct 22 21:52:22.628522 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 21:52:22.628522 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 21:52:22.628522 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 21:52:22.628522 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 0 Oct 22 21:52:22.628522 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 21:52:22.628522 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 21:52:22.628522 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 21:52:22.628522 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 21:52:22.628522 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVGWv_MYBjcXE2YFfZAuyoDkZvd59-LYnCZeIeReqXLjCbzyEC9_cDDcsYEBHR5gXwa_yRqLqc-BlNYQJYb9qhgOARTEK7bQiXl3hxmvwrTDEMf2aot6Cbx7IbjvwWrfwUS1LGLKGQ_r0mQh_AHRHxf9jI8D1_Y_L8UK2lQXYypJp3-s Oct 22 21:52:22.628522 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 21:52:22.628522 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 21:52:22.628522 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 21:52:22.628522 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 21:52:22.628522 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 21:52:22.628522 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 21:52:22.628522 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: f4cf4cd612f04e91b3be2e7ca5658b97 Oct 22 21:52:22.628522 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1974046167 Oct 22 21:52:22.628522 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 21:52:22.628522 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 21:52:22.628522 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_f4cf4cd612f04e91b3be2e7ca5658b97"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f4cf4cd612f04e91b3be2e7ca5658b97"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/f4cf4cd612f04e91b3be2e7ca5658b97"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f4cf4cd612f04e91b3be2e7ca5658b97"}]}] Oct 22 21:52:22.628522 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-ServerDiskConfigTestJSON-1974046167 Oct 22 21:52:22.628522 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: f4cf4cd612f04e91b3be2e7ca5658b97 Oct 22 21:52:22.628522 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1974046167 Oct 22 21:52:22.628522 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-ServerDiskConfigTestJSON-1974046167-project Oct 22 21:52:22.628522 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 21:52:22.628522 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 21:52:22.628522 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: 22419916fc2641f88bfbdf103e7c3ee6 Oct 22 21:52:22.628522 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-ServerDiskConfigTestJSON-1974046167-project Oct 22 21:52:22.628522 ncdv-master-1 devstack@n-api.service[138745]: method: > Oct 22 21:52:22.628522 ncdv-master-1 devstack@n-api.service[138745]: exception: Instance e3f9f3ab-26f2-427b-9dc5-bfc007cdef20 could not be found. Oct 22 21:52:22.628522 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'id': 'e3f9f3ab-26f2-427b-9dc5-bfc007cdef20'} Oct 22 21:52:22.628522 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:52:22.628522 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:52:22.628522 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 21:52:22.628522 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 21:52:22.628522 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 21:52:22.628522 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 21:52:22.628522 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 21:52:22.628522 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 21:52:22.628522 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 21:52:22.628522 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 21:52:22.628522 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3f9f3ab-26f2-427b-9dc5-bfc007cdef20 could not be found. Oct 22 21:52:22.628522 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:52:22.628522 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:52:22.628522 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:52:22.628522 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:52:22.628522 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:52:22.628522 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:52:22.628522 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:52:22.628522 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:52:22.628522 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:52:22.628522 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:52:22.628522 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 22 21:52:22.628522 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 22 21:52:22.628522 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 22 21:52:22.628522 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 22 21:52:22.628522 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 21:52:22.628522 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 21:52:22.628522 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 21:52:22.628522 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:52:22.633274 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3f9f3ab-26f2-427b-9dc5-bfc007cdef20 could not be found. Oct 22 21:52:22.633274 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:52:22.633274 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:52:22.633274 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:52:22.633274 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:52:22.633274 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:52:22.633274 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:52:22.633274 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:52:22.633274 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:52:22.633274 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3f9f3ab-26f2-427b-9dc5-bfc007cdef20 could not be found. Oct 22 21:52:22.633274 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:52:22.633274 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-f2dedcce-2a64-4983-8c2b-3844dabafe07 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Returning 404 to user: Instance e3f9f3ab-26f2-427b-9dc5-bfc007cdef20 could not be found. {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:52:22.633274 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-f2dedcce-2a64-4983-8c2b-3844dabafe07 tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] 10.222.0.18 "DELETE /compute/v2.1/servers/e3f9f3ab-26f2-427b-9dc5-bfc007cdef20" status: 404 len: 111 microversion: 2.1 time: 0.039747 Oct 22 21:52:22.633274 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3215/6399] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 21:52:22 2022] DELETE /compute/v2.1/servers/e3f9f3ab-26f2-427b-9dc5-bfc007cdef20 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 21:52:22.640039 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-3d18f49d-fec2-4f9c-9a3f-23145fe01b2b tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:52:22.640785 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-3d18f49d-fec2-4f9c-9a3f-23145fe01b2b tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] [instance: e3f9f3ab-26f2-427b-9dc5-bfc007cdef20] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:52:22.647878 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3d18f49d-fec2-4f9c-9a3f-23145fe01b2b tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:52:22.648360 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3d18f49d-fec2-4f9c-9a3f-23145fe01b2b tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:52:22.648769 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3d18f49d-fec2-4f9c-9a3f-23145fe01b2b tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:52:22.649699 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3d18f49d-fec2-4f9c-9a3f-23145fe01b2b tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:52:22.649967 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3d18f49d-fec2-4f9c-9a3f-23145fe01b2b tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:52:22.650389 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3d18f49d-fec2-4f9c-9a3f-23145fe01b2b tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:52:22.664316 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-3d18f49d-fec2-4f9c-9a3f-23145fe01b2b tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] HTTP exception thrown: Instance e3f9f3ab-26f2-427b-9dc5-bfc007cdef20 could not be found. Oct 22 21:52:22.665966 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-3d18f49d-fec2-4f9c-9a3f-23145fe01b2b tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Request method failure captured: Oct 22 21:52:22.665966 ncdv-master-1 devstack@n-api.service[138744]: request: GET /compute/v2.1/servers/e3f9f3ab-26f2-427b-9dc5-bfc007cdef20 HTTP/1.1 Oct 22 21:52:22.665966 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 21:52:22.665966 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 21:52:22.665966 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 21:52:22.665966 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 0 Oct 22 21:52:22.665966 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 21:52:22.665966 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 21:52:22.665966 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 21:52:22.665966 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 21:52:22.665966 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVGWv_MYBjcXE2YFfZAuyoDkZvd59-LYnCZeIeReqXLjCbzyEC9_cDDcsYEBHR5gXwa_yRqLqc-BlNYQJYb9qhgOARTEK7bQiXl3hxmvwrTDEMf2aot6Cbx7IbjvwWrfwUS1LGLKGQ_r0mQh_AHRHxf9jI8D1_Y_L8UK2lQXYypJp3-s Oct 22 21:52:22.665966 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 21:52:22.665966 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 21:52:22.665966 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 21:52:22.665966 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 21:52:22.665966 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 21:52:22.665966 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 21:52:22.665966 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: f4cf4cd612f04e91b3be2e7ca5658b97 Oct 22 21:52:22.665966 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1974046167 Oct 22 21:52:22.665966 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 21:52:22.665966 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 21:52:22.665966 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_f4cf4cd612f04e91b3be2e7ca5658b97"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f4cf4cd612f04e91b3be2e7ca5658b97"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/f4cf4cd612f04e91b3be2e7ca5658b97"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f4cf4cd612f04e91b3be2e7ca5658b97"}]}] Oct 22 21:52:22.665966 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-ServerDiskConfigTestJSON-1974046167 Oct 22 21:52:22.665966 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: f4cf4cd612f04e91b3be2e7ca5658b97 Oct 22 21:52:22.665966 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1974046167 Oct 22 21:52:22.665966 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-ServerDiskConfigTestJSON-1974046167-project Oct 22 21:52:22.665966 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 21:52:22.665966 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 21:52:22.665966 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: 22419916fc2641f88bfbdf103e7c3ee6 Oct 22 21:52:22.665966 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-ServerDiskConfigTestJSON-1974046167-project Oct 22 21:52:22.665966 ncdv-master-1 devstack@n-api.service[138744]: method: > Oct 22 21:52:22.665966 ncdv-master-1 devstack@n-api.service[138744]: exception: Instance e3f9f3ab-26f2-427b-9dc5-bfc007cdef20 could not be found. Oct 22 21:52:22.665966 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': 'e3f9f3ab-26f2-427b-9dc5-bfc007cdef20'} Oct 22 21:52:22.665966 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:52:22.665966 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:52:22.665966 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 21:52:22.665966 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 21:52:22.665966 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 21:52:22.665966 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 21:52:22.665966 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 21:52:22.665966 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 21:52:22.665966 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 21:52:22.665966 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 21:52:22.665966 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3f9f3ab-26f2-427b-9dc5-bfc007cdef20 could not be found. Oct 22 21:52:22.665966 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:52:22.665966 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:52:22.665966 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:52:22.665966 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:52:22.665966 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:52:22.665966 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:52:22.665966 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:52:22.665966 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:52:22.665966 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:52:22.665966 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:52:22.665966 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 21:52:22.665966 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 21:52:22.665966 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 21:52:22.665966 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 21:52:22.665966 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 21:52:22.665966 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:52:22.665966 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3f9f3ab-26f2-427b-9dc5-bfc007cdef20 could not be found. Oct 22 21:52:22.665966 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:52:22.665966 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:52:22.665966 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:52:22.670760 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:52:22.670760 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:52:22.670760 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:52:22.670760 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:52:22.670760 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:52:22.670760 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3f9f3ab-26f2-427b-9dc5-bfc007cdef20 could not be found. Oct 22 21:52:22.670760 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:52:22.670760 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-3d18f49d-fec2-4f9c-9a3f-23145fe01b2b tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] Returning 404 to user: Instance e3f9f3ab-26f2-427b-9dc5-bfc007cdef20 could not be found. {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:52:22.670760 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-3d18f49d-fec2-4f9c-9a3f-23145fe01b2b tempest-ServerDiskConfigTestJSON-1974046167 tempest-ServerDiskConfigTestJSON-1974046167-project] 10.222.0.18 "GET /compute/v2.1/servers/e3f9f3ab-26f2-427b-9dc5-bfc007cdef20" status: 404 len: 111 microversion: 2.1 time: 0.032508 Oct 22 21:52:22.670760 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3185/6400] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:52:22 2022] GET /compute/v2.1/servers/e3f9f3ab-26f2-427b-9dc5-bfc007cdef20 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 21:52:31.500339 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-d39e9755-9157-45d3-90b4-1f421a4192d2 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Action: 'create', calling method: .version_select at 0x7fd39c4b4dc0>, body: {"keypair": {"name": "tempest-keypair-52095379", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHf6jivaKHAuV/mvjytn03Y3JPq39qoVRMSeeBXno5ya36fhwhJFqEW/GdvXNeXrDoJ6GZOjSFueCt5v52zDm+hY+kf/Ovm+LYpHASsUdIUqKa3gCmIbAofpyJncHrsYcA=="}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:52:31.517290 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-d39e9755-9157-45d3-90b4-1f421a4192d2 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Getting quotas for project 17135327e2d14c4bbe4c7b242f9fda48. Resources: {'key_pairs'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 21:52:31.523019 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-d39e9755-9157-45d3-90b4-1f421a4192d2 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Getting quotas for user ce1a4da366004680b7330a8e9f43f945 and project 17135327e2d14c4bbe4c7b242f9fda48. Resources: {'key_pairs'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 21:52:31.554730 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-d39e9755-9157-45d3-90b4-1f421a4192d2 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.200679 Oct 22 21:52:31.555384 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3216/6401] 10.222.0.18 () {60 vars in 1159 bytes} [Sat Oct 22 21:52:31 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:52:32.915190 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-0e04be2a-9dc1-4315-81f6-0ba6e73b3958 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-175292271", "imageRef": "085e4478-6edc-4a69-8e08-f9831713eb65", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c97efc9f-8481-439f-aa41-fc8c07627ab3"}], "security_groups": [{"name": "tempest-securitygroup--1780263140"}], "key_name": "tempest-keypair-52095379", "user_data": "}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:52:32.924810 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_api:SELECT=6,nova_api:DELETE=1 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:52:32.925465 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:52:33.035765 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.network.neutron [None req-0e04be2a-9dc1-4315-81f6-0ba6e73b3958 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] validate_networks() for [('c97efc9f-8481-439f-aa41-fc8c07627ab3', None, None, None, None, None)] {{(pid=138744) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 21:52:33.441940 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-0e04be2a-9dc1-4315-81f6-0ba6e73b3958 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Flavor limits 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 21:52:33.442643 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-0e04be2a-9dc1-4315-81f6-0ba6e73b3958 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Image limits 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 21:52:33.443207 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-0e04be2a-9dc1-4315-81f6-0ba6e73b3958 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Flavor pref 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 21:52:33.443835 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-0e04be2a-9dc1-4315-81f6-0ba6e73b3958 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Image pref 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 21:52:33.444320 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-0e04be2a-9dc1-4315-81f6-0ba6e73b3958 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 21:52:33.454192 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0e04be2a-9dc1-4315-81f6-0ba6e73b3958 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:52:33.454803 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0e04be2a-9dc1-4315-81f6-0ba6e73b3958 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:52:33.455315 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0e04be2a-9dc1-4315-81f6-0ba6e73b3958 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:52:33.456196 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0e04be2a-9dc1-4315-81f6-0ba6e73b3958 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:52:33.456656 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0e04be2a-9dc1-4315-81f6-0ba6e73b3958 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:52:33.457086 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0e04be2a-9dc1-4315-81f6-0ba6e73b3958 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:52:33.475920 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-0e04be2a-9dc1-4315-81f6-0ba6e73b3958 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Getting quotas for project 17135327e2d14c4bbe4c7b242f9fda48. Resources: {'cores', 'instances', 'ram'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 21:52:33.482054 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-0e04be2a-9dc1-4315-81f6-0ba6e73b3958 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Getting quotas for user ce1a4da366004680b7330a8e9f43f945 and project 17135327e2d14c4bbe4c7b242f9fda48. Resources: {'cores', 'instances', 'ram'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 21:52:33.495821 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-0e04be2a-9dc1-4315-81f6-0ba6e73b3958 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Going to run 1 instances... {{(pid=138744) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 21:52:33.498199 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-0e04be2a-9dc1-4315-81f6-0ba6e73b3958 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] [instance: e8b43f72-f51e-4ed8-809f-f04c3c67a192] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='085e4478-6edc-4a69-8e08-f9831713eb65',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138744) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 21:52:33.546915 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-0e04be2a-9dc1-4315-81f6-0ba6e73b3958 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.636241 Oct 22 21:52:33.547818 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3186/6402] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Oct 22 21:52:32 2022] POST /compute/v2.1/servers => generated 409 bytes in 638 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 21:52:33.556512 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell1:SELECT=61,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:52:33.560972 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-efd5baa0-8262-49fa-adbe-f44711dac9c0 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:52:33.561607 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-efd5baa0-8262-49fa-adbe-f44711dac9c0 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] [instance: e8b43f72-f51e-4ed8-809f-f04c3c67a192] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:52:33.627254 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-efd5baa0-8262-49fa-adbe-f44711dac9c0 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1a4da366004680b7330a8e9f43f945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17135327e2d14c4bbe4c7b242f9fda48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:52:33.635210 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-efd5baa0-8262-49fa-adbe-f44711dac9c0 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] 10.222.0.18 "GET /compute/v2.1/servers/e8b43f72-f51e-4ed8-809f-f04c3c67a192" status: 200 len: 1236 microversion: 2.1 time: 0.080350 Oct 22 21:52:33.636437 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3217/6403] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:52:33 2022] GET /compute/v2.1/servers/e8b43f72-f51e-4ed8-809f-f04c3c67a192 => generated 1236 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:52:34.665356 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-3ef13c0e-a690-4d5d-ab90-034983076be6 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:52:34.666766 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-3ef13c0e-a690-4d5d-ab90-034983076be6 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] [instance: e8b43f72-f51e-4ed8-809f-f04c3c67a192] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:52:34.676659 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3ef13c0e-a690-4d5d-ab90-034983076be6 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:52:34.677572 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3ef13c0e-a690-4d5d-ab90-034983076be6 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:52:34.678231 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3ef13c0e-a690-4d5d-ab90-034983076be6 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:52:34.681235 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3ef13c0e-a690-4d5d-ab90-034983076be6 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:52:34.682132 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3ef13c0e-a690-4d5d-ab90-034983076be6 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:52:34.684081 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3ef13c0e-a690-4d5d-ab90-034983076be6 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:52:34.769069 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-3ef13c0e-a690-4d5d-ab90-034983076be6 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1a4da366004680b7330a8e9f43f945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17135327e2d14c4bbe4c7b242f9fda48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:52:34.779949 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-3ef13c0e-a690-4d5d-ab90-034983076be6 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] 10.222.0.18 "GET /compute/v2.1/servers/e8b43f72-f51e-4ed8-809f-f04c3c67a192" status: 200 len: 1306 microversion: 2.1 time: 0.124824 Oct 22 21:52:34.780823 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3187/6404] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:52:34 2022] GET /compute/v2.1/servers/e8b43f72-f51e-4ed8-809f-f04c3c67a192 => generated 1306 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:52:35.803787 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-f5287730-06ae-4cf9-a8b6-561b70718d0e tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:52:35.804421 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-f5287730-06ae-4cf9-a8b6-561b70718d0e tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] [instance: e8b43f72-f51e-4ed8-809f-f04c3c67a192] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:52:35.811879 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f5287730-06ae-4cf9-a8b6-561b70718d0e tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:52:35.812431 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f5287730-06ae-4cf9-a8b6-561b70718d0e tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:52:35.812894 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f5287730-06ae-4cf9-a8b6-561b70718d0e tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:52:35.813614 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f5287730-06ae-4cf9-a8b6-561b70718d0e tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:52:35.814088 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f5287730-06ae-4cf9-a8b6-561b70718d0e tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:52:35.814536 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f5287730-06ae-4cf9-a8b6-561b70718d0e tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:52:36.040937 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-f5287730-06ae-4cf9-a8b6-561b70718d0e tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1a4da366004680b7330a8e9f43f945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17135327e2d14c4bbe4c7b242f9fda48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:52:36.049344 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-f5287730-06ae-4cf9-a8b6-561b70718d0e tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] 10.222.0.18 "GET /compute/v2.1/servers/e8b43f72-f51e-4ed8-809f-f04c3c67a192" status: 200 len: 1362 microversion: 2.1 time: 0.249610 Oct 22 21:52:36.049914 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3218/6405] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:52:35 2022] GET /compute/v2.1/servers/e8b43f72-f51e-4ed8-809f-f04c3c67a192 => generated 1362 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:52:36.231923 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-1faa171a-2822-4b9f-887b-15e86f7e69ab req-aec1e78d-deda-422f-a812-b2335ed7f1bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8b43f72-f51e-4ed8-809f-f04c3c67a192", "tag": "365fe87e-cc8b-459e-bbf5-96851ef521b7"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:52:36.245102 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-1faa171a-2822-4b9f-887b-15e86f7e69ab req-aec1e78d-deda-422f-a812-b2335ed7f1bd service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:52:36.245890 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-1faa171a-2822-4b9f-887b-15e86f7e69ab req-aec1e78d-deda-422f-a812-b2335ed7f1bd service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:52:36.246601 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-1faa171a-2822-4b9f-887b-15e86f7e69ab req-aec1e78d-deda-422f-a812-b2335ed7f1bd service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:52:36.262198 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-1faa171a-2822-4b9f-887b-15e86f7e69ab req-aec1e78d-deda-422f-a812-b2335ed7f1bd service nova] Creating event network-changed:365fe87e-cc8b-459e-bbf5-96851ef521b7 for instance e8b43f72-f51e-4ed8-809f-f04c3c67a192 on nch1-master-1 Oct 22 21:52:36.267545 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-1faa171a-2822-4b9f-887b-15e86f7e69ab req-aec1e78d-deda-422f-a812-b2335ed7f1bd service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039897 Oct 22 21:52:36.268538 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3188/6406] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:52:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:52:37.073883 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-870fea96-2d92-4eed-b40c-f2ce60d6222e tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:52:37.074530 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-870fea96-2d92-4eed-b40c-f2ce60d6222e tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] [instance: e8b43f72-f51e-4ed8-809f-f04c3c67a192] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:52:37.081954 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-870fea96-2d92-4eed-b40c-f2ce60d6222e tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:52:37.082453 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-870fea96-2d92-4eed-b40c-f2ce60d6222e tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:52:37.082906 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-870fea96-2d92-4eed-b40c-f2ce60d6222e tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:52:37.083654 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-870fea96-2d92-4eed-b40c-f2ce60d6222e tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:52:37.084125 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-870fea96-2d92-4eed-b40c-f2ce60d6222e tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:52:37.084569 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-870fea96-2d92-4eed-b40c-f2ce60d6222e tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:52:37.224958 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-870fea96-2d92-4eed-b40c-f2ce60d6222e tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1a4da366004680b7330a8e9f43f945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17135327e2d14c4bbe4c7b242f9fda48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:52:37.237119 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-870fea96-2d92-4eed-b40c-f2ce60d6222e tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] 10.222.0.18 "GET /compute/v2.1/servers/e8b43f72-f51e-4ed8-809f-f04c3c67a192" status: 200 len: 1362 microversion: 2.1 time: 0.167349 Oct 22 21:52:37.237927 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3219/6407] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:52:37 2022] GET /compute/v2.1/servers/e8b43f72-f51e-4ed8-809f-f04c3c67a192 => generated 1362 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:52:38.265454 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-deebefbc-f389-4716-af8f-d96a36d71759 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:52:38.266224 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-deebefbc-f389-4716-af8f-d96a36d71759 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] [instance: e8b43f72-f51e-4ed8-809f-f04c3c67a192] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:52:38.272927 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-deebefbc-f389-4716-af8f-d96a36d71759 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:52:38.273354 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-deebefbc-f389-4716-af8f-d96a36d71759 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:52:38.273799 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-deebefbc-f389-4716-af8f-d96a36d71759 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:52:38.274469 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-deebefbc-f389-4716-af8f-d96a36d71759 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:52:38.274963 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-deebefbc-f389-4716-af8f-d96a36d71759 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:52:38.275392 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-deebefbc-f389-4716-af8f-d96a36d71759 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:52:38.410415 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-deebefbc-f389-4716-af8f-d96a36d71759 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1a4da366004680b7330a8e9f43f945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17135327e2d14c4bbe4c7b242f9fda48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:52:38.419017 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-deebefbc-f389-4716-af8f-d96a36d71759 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] 10.222.0.18 "GET /compute/v2.1/servers/e8b43f72-f51e-4ed8-809f-f04c3c67a192" status: 200 len: 1362 microversion: 2.1 time: 0.161004 Oct 22 21:52:38.419648 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3189/6408] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:52:38 2022] GET /compute/v2.1/servers/e8b43f72-f51e-4ed8-809f-f04c3c67a192 => generated 1362 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:52:39.442490 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-d5108e8b-1b1f-4b08-9b8a-7aec6c2cc6f8 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:52:39.443117 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-d5108e8b-1b1f-4b08-9b8a-7aec6c2cc6f8 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] [instance: e8b43f72-f51e-4ed8-809f-f04c3c67a192] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:52:39.450899 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d5108e8b-1b1f-4b08-9b8a-7aec6c2cc6f8 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:52:39.451431 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d5108e8b-1b1f-4b08-9b8a-7aec6c2cc6f8 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:52:39.451883 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d5108e8b-1b1f-4b08-9b8a-7aec6c2cc6f8 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:52:39.452669 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d5108e8b-1b1f-4b08-9b8a-7aec6c2cc6f8 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:52:39.453145 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d5108e8b-1b1f-4b08-9b8a-7aec6c2cc6f8 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:52:39.453614 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d5108e8b-1b1f-4b08-9b8a-7aec6c2cc6f8 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:52:39.591740 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-d5108e8b-1b1f-4b08-9b8a-7aec6c2cc6f8 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1a4da366004680b7330a8e9f43f945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17135327e2d14c4bbe4c7b242f9fda48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:52:39.601263 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-d5108e8b-1b1f-4b08-9b8a-7aec6c2cc6f8 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] 10.222.0.18 "GET /compute/v2.1/servers/e8b43f72-f51e-4ed8-809f-f04c3c67a192" status: 200 len: 1362 microversion: 2.1 time: 0.162789 Oct 22 21:52:39.601866 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3220/6409] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:52:39 2022] GET /compute/v2.1/servers/e8b43f72-f51e-4ed8-809f-f04c3c67a192 => generated 1362 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:52:40.626991 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-7c90f9f8-9f5c-40e4-ac73-b7a994e4eb77 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:52:40.627839 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-7c90f9f8-9f5c-40e4-ac73-b7a994e4eb77 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] [instance: e8b43f72-f51e-4ed8-809f-f04c3c67a192] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:52:40.636229 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7c90f9f8-9f5c-40e4-ac73-b7a994e4eb77 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:52:40.636780 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7c90f9f8-9f5c-40e4-ac73-b7a994e4eb77 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:52:40.637263 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7c90f9f8-9f5c-40e4-ac73-b7a994e4eb77 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:52:40.638073 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7c90f9f8-9f5c-40e4-ac73-b7a994e4eb77 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:52:40.638576 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7c90f9f8-9f5c-40e4-ac73-b7a994e4eb77 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:52:40.639055 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7c90f9f8-9f5c-40e4-ac73-b7a994e4eb77 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:52:40.777981 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-7c90f9f8-9f5c-40e4-ac73-b7a994e4eb77 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1a4da366004680b7330a8e9f43f945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17135327e2d14c4bbe4c7b242f9fda48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:52:40.786499 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-7c90f9f8-9f5c-40e4-ac73-b7a994e4eb77 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] 10.222.0.18 "GET /compute/v2.1/servers/e8b43f72-f51e-4ed8-809f-f04c3c67a192" status: 200 len: 1362 microversion: 2.1 time: 0.165131 Oct 22 21:52:40.787051 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3190/6410] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:52:40 2022] GET /compute/v2.1/servers/e8b43f72-f51e-4ed8-809f-f04c3c67a192 => generated 1362 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:52:41.229786 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-487a1ceb-7142-4ff1-9f01-f673be4fa811 req-2003e8af-6d49-41a3-8c58-b88b5c2c64d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8b43f72-f51e-4ed8-809f-f04c3c67a192", "name": "network-vif-plugged", "status": "completed", "tag": "365fe87e-cc8b-459e-bbf5-96851ef521b7"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:52:41.241507 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-487a1ceb-7142-4ff1-9f01-f673be4fa811 req-2003e8af-6d49-41a3-8c58-b88b5c2c64d8 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:52:41.241998 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-487a1ceb-7142-4ff1-9f01-f673be4fa811 req-2003e8af-6d49-41a3-8c58-b88b5c2c64d8 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:52:41.242441 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-487a1ceb-7142-4ff1-9f01-f673be4fa811 req-2003e8af-6d49-41a3-8c58-b88b5c2c64d8 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:52:41.254285 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-487a1ceb-7142-4ff1-9f01-f673be4fa811 req-2003e8af-6d49-41a3-8c58-b88b5c2c64d8 service nova] Creating event network-vif-plugged:365fe87e-cc8b-459e-bbf5-96851ef521b7 for instance e8b43f72-f51e-4ed8-809f-f04c3c67a192 on nch1-master-1 Oct 22 21:52:41.259835 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-487a1ceb-7142-4ff1-9f01-f673be4fa811 req-2003e8af-6d49-41a3-8c58-b88b5c2c64d8 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092776 Oct 22 21:52:41.260423 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3221/6411] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:52:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:52:41.813758 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-2cf3f171-5a08-4e23-83f2-3843402e68c5 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:52:41.814712 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-2cf3f171-5a08-4e23-83f2-3843402e68c5 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] [instance: e8b43f72-f51e-4ed8-809f-f04c3c67a192] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:52:41.826678 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2cf3f171-5a08-4e23-83f2-3843402e68c5 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:52:41.827637 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2cf3f171-5a08-4e23-83f2-3843402e68c5 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:52:41.828391 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2cf3f171-5a08-4e23-83f2-3843402e68c5 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:52:41.829495 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2cf3f171-5a08-4e23-83f2-3843402e68c5 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:52:41.829952 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2cf3f171-5a08-4e23-83f2-3843402e68c5 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:52:41.830386 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2cf3f171-5a08-4e23-83f2-3843402e68c5 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:52:41.973062 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-2cf3f171-5a08-4e23-83f2-3843402e68c5 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1a4da366004680b7330a8e9f43f945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17135327e2d14c4bbe4c7b242f9fda48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:52:41.981353 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-2cf3f171-5a08-4e23-83f2-3843402e68c5 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] 10.222.0.18 "GET /compute/v2.1/servers/e8b43f72-f51e-4ed8-809f-f04c3c67a192" status: 200 len: 1362 microversion: 2.1 time: 0.174379 Oct 22 21:52:41.981919 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3191/6412] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:52:41 2022] GET /compute/v2.1/servers/e8b43f72-f51e-4ed8-809f-f04c3c67a192 => generated 1362 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:52:43.005320 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-fc1d1f2e-a34f-4469-a583-ac17ec5ff8b1 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:52:43.006046 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-fc1d1f2e-a34f-4469-a583-ac17ec5ff8b1 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] [instance: e8b43f72-f51e-4ed8-809f-f04c3c67a192] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:52:43.013866 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fc1d1f2e-a34f-4469-a583-ac17ec5ff8b1 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:52:43.014371 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fc1d1f2e-a34f-4469-a583-ac17ec5ff8b1 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:52:43.014834 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fc1d1f2e-a34f-4469-a583-ac17ec5ff8b1 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:52:43.015675 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fc1d1f2e-a34f-4469-a583-ac17ec5ff8b1 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:52:43.016154 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fc1d1f2e-a34f-4469-a583-ac17ec5ff8b1 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:52:43.016604 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fc1d1f2e-a34f-4469-a583-ac17ec5ff8b1 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:52:43.164250 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-fc1d1f2e-a34f-4469-a583-ac17ec5ff8b1 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1a4da366004680b7330a8e9f43f945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17135327e2d14c4bbe4c7b242f9fda48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:52:43.176014 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-fc1d1f2e-a34f-4469-a583-ac17ec5ff8b1 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] 10.222.0.18 "GET /compute/v2.1/servers/e8b43f72-f51e-4ed8-809f-f04c3c67a192" status: 200 len: 1549 microversion: 2.1 time: 0.175189 Oct 22 21:52:43.176573 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3222/6413] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:52:42 2022] GET /compute/v2.1/servers/e8b43f72-f51e-4ed8-809f-f04c3c67a192 => generated 1549 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:52:43.199090 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-1010333e-3630-4b4f-9da6-03a08e58eb5b tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:52:43.199664 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-1010333e-3630-4b4f-9da6-03a08e58eb5b tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] [instance: e8b43f72-f51e-4ed8-809f-f04c3c67a192] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:52:43.207160 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1010333e-3630-4b4f-9da6-03a08e58eb5b tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:52:43.207651 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1010333e-3630-4b4f-9da6-03a08e58eb5b tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:52:43.208090 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1010333e-3630-4b4f-9da6-03a08e58eb5b tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:52:43.208795 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1010333e-3630-4b4f-9da6-03a08e58eb5b tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:52:43.209249 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1010333e-3630-4b4f-9da6-03a08e58eb5b tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:52:43.209679 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1010333e-3630-4b4f-9da6-03a08e58eb5b tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:52:43.300053 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-1010333e-3630-4b4f-9da6-03a08e58eb5b tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] 10.222.0.18 "GET /compute/v2.1/servers/e8b43f72-f51e-4ed8-809f-f04c3c67a192/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.104839 Oct 22 21:52:43.300664 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3192/6414] 10.222.0.18 () {58 vars in 1275 bytes} [Sat Oct 22 21:52:43 2022] GET /compute/v2.1/servers/e8b43f72-f51e-4ed8-809f-f04c3c67a192/os-interface => generated 284 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:52:44.274172 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell0:SELECT=6 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:52:44.334120 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-3ef03607-1e9a-4ca5-b317-504cbdbacb3e req-e655117a-a581-40c4-a143-97540e56da4d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8b43f72-f51e-4ed8-809f-f04c3c67a192", "tag": "365fe87e-cc8b-459e-bbf5-96851ef521b7"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:52:44.344516 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-3ef03607-1e9a-4ca5-b317-504cbdbacb3e req-e655117a-a581-40c4-a143-97540e56da4d service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:52:44.345340 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-3ef03607-1e9a-4ca5-b317-504cbdbacb3e req-e655117a-a581-40c4-a143-97540e56da4d service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:52:44.345839 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-3ef03607-1e9a-4ca5-b317-504cbdbacb3e req-e655117a-a581-40c4-a143-97540e56da4d service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:52:44.357547 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-3ef03607-1e9a-4ca5-b317-504cbdbacb3e req-e655117a-a581-40c4-a143-97540e56da4d service nova] Creating event network-changed:365fe87e-cc8b-459e-bbf5-96851ef521b7 for instance e8b43f72-f51e-4ed8-809f-f04c3c67a192 on nch1-master-1 Oct 22 21:52:44.363925 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-3ef03607-1e9a-4ca5-b317-504cbdbacb3e req-e655117a-a581-40c4-a143-97540e56da4d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093467 Oct 22 21:52:44.364530 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3223/6415] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:52:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:53:48.766872 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell0:SELECT=2 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:53:48.768178 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell0:SELECT=6 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:53:48.771283 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:53:48.772374 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:SELECT=32 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:53:48.782552 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-4a95dc9a-dd99-4558-bf6a-3fa3a3499620 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:53:48.783158 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-4a95dc9a-dd99-4558-bf6a-3fa3a3499620 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] [instance: e8b43f72-f51e-4ed8-809f-f04c3c67a192] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:53:48.790484 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4a95dc9a-dd99-4558-bf6a-3fa3a3499620 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:53:48.790968 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4a95dc9a-dd99-4558-bf6a-3fa3a3499620 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:53:48.791419 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4a95dc9a-dd99-4558-bf6a-3fa3a3499620 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:53:48.792112 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4a95dc9a-dd99-4558-bf6a-3fa3a3499620 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:53:48.792559 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4a95dc9a-dd99-4558-bf6a-3fa3a3499620 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:53:48.793014 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4a95dc9a-dd99-4558-bf6a-3fa3a3499620 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:53:48.926879 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-4a95dc9a-dd99-4558-bf6a-3fa3a3499620 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1a4da366004680b7330a8e9f43f945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17135327e2d14c4bbe4c7b242f9fda48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:53:48.935049 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-4a95dc9a-dd99-4558-bf6a-3fa3a3499620 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] 10.222.0.18 "GET /compute/v2.1/servers/e8b43f72-f51e-4ed8-809f-f04c3c67a192" status: 200 len: 1668 microversion: 2.1 time: 0.170350 Oct 22 21:53:48.935663 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3193/6416] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:53:48 2022] GET /compute/v2.1/servers/e8b43f72-f51e-4ed8-809f-f04c3c67a192 => generated 1668 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:53:48.956871 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=1 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:53:48.957647 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell1:SELECT=28 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:53:48.958910 ncdv-master-1 devstack@n-api.service[138745]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 22 21:53:48.959061 ncdv-master-1 devstack@n-api.service[138745]: Sat Oct 22 21:53:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e8b43f72-f51e-4ed8-809f-f04c3c67a192 (ip 10.222.0.18) !!! Oct 22 21:53:48.963879 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-adb5ab50-f5d0-4b70-9b5b-5fa75364fe6e tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:53:48.964611 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-adb5ab50-f5d0-4b70-9b5b-5fa75364fe6e tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] [instance: e8b43f72-f51e-4ed8-809f-f04c3c67a192] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:53:48.974070 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-adb5ab50-f5d0-4b70-9b5b-5fa75364fe6e tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:53:48.974554 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-adb5ab50-f5d0-4b70-9b5b-5fa75364fe6e tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:53:48.975028 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-adb5ab50-f5d0-4b70-9b5b-5fa75364fe6e tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:53:48.975783 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-adb5ab50-f5d0-4b70-9b5b-5fa75364fe6e tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:53:48.976248 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-adb5ab50-f5d0-4b70-9b5b-5fa75364fe6e tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:53:48.976688 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-adb5ab50-f5d0-4b70-9b5b-5fa75364fe6e tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:53:49.120118 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-adb5ab50-f5d0-4b70-9b5b-5fa75364fe6e tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1a4da366004680b7330a8e9f43f945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17135327e2d14c4bbe4c7b242f9fda48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:53:49.132527 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-adb5ab50-f5d0-4b70-9b5b-5fa75364fe6e tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] 10.222.0.18 "GET /compute/v2.1/servers/e8b43f72-f51e-4ed8-809f-f04c3c67a192" status: 200 len: 1668 microversion: 2.1 time: 0.177614 Oct 22 21:53:49.133254 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3224/6417] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:53:48 2022] GET /compute/v2.1/servers/e8b43f72-f51e-4ed8-809f-f04c3c67a192 => generated 1668 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:53:49.155291 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-6c4e0bd0-7821-4040-a633-2dd81a3f87ce tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:53:49.155938 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-6c4e0bd0-7821-4040-a633-2dd81a3f87ce tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] [instance: e8b43f72-f51e-4ed8-809f-f04c3c67a192] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:53:49.162235 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6c4e0bd0-7821-4040-a633-2dd81a3f87ce tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:53:49.162720 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6c4e0bd0-7821-4040-a633-2dd81a3f87ce tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:53:49.163163 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6c4e0bd0-7821-4040-a633-2dd81a3f87ce tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:53:49.163893 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6c4e0bd0-7821-4040-a633-2dd81a3f87ce tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:53:49.164344 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6c4e0bd0-7821-4040-a633-2dd81a3f87ce tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:53:49.164775 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6c4e0bd0-7821-4040-a633-2dd81a3f87ce tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:53:49.298940 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-6c4e0bd0-7821-4040-a633-2dd81a3f87ce tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1a4da366004680b7330a8e9f43f945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17135327e2d14c4bbe4c7b242f9fda48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:53:49.307020 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-6c4e0bd0-7821-4040-a633-2dd81a3f87ce tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] 10.222.0.18 "GET /compute/v2.1/servers/e8b43f72-f51e-4ed8-809f-f04c3c67a192" status: 200 len: 1668 microversion: 2.1 time: 0.155662 Oct 22 21:53:49.307639 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3194/6418] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:53:49 2022] GET /compute/v2.1/servers/e8b43f72-f51e-4ed8-809f-f04c3c67a192 => generated 1668 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:53:49.329750 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-939e1a70-8e96-4369-b9c7-3ee47dd50703 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:53:49.332095 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-939e1a70-8e96-4369-b9c7-3ee47dd50703 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] [instance: e8b43f72-f51e-4ed8-809f-f04c3c67a192] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:53:49.338458 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-939e1a70-8e96-4369-b9c7-3ee47dd50703 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:53:49.338952 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-939e1a70-8e96-4369-b9c7-3ee47dd50703 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:53:49.339431 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-939e1a70-8e96-4369-b9c7-3ee47dd50703 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:53:49.340143 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-939e1a70-8e96-4369-b9c7-3ee47dd50703 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:53:49.340604 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-939e1a70-8e96-4369-b9c7-3ee47dd50703 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:53:49.341024 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-939e1a70-8e96-4369-b9c7-3ee47dd50703 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:53:49.370987 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-939e1a70-8e96-4369-b9c7-3ee47dd50703 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'ce1a4da366004680b7330a8e9f43f945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17135327e2d14c4bbe4c7b242f9fda48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:53:49.377006 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-939e1a70-8e96-4369-b9c7-3ee47dd50703 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] [instance: e8b43f72-f51e-4ed8-809f-f04c3c67a192] Old instance type m1.heat2, new instance type m1.heat {{(pid=138745) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 22 21:53:49.383719 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-939e1a70-8e96-4369-b9c7-3ee47dd50703 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Flavor limits 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 21:53:49.384160 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-939e1a70-8e96-4369-b9c7-3ee47dd50703 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Image limits 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 21:53:49.384671 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-939e1a70-8e96-4369-b9c7-3ee47dd50703 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Flavor pref 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 21:53:49.385088 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-939e1a70-8e96-4369-b9c7-3ee47dd50703 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Image pref 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 21:53:49.385504 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-939e1a70-8e96-4369-b9c7-3ee47dd50703 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 21:53:49.454902 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-939e1a70-8e96-4369-b9c7-3ee47dd50703 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] 10.222.0.18 "POST /compute/v2.1/servers/e8b43f72-f51e-4ed8-809f-f04c3c67a192/action" status: 202 len: 0 microversion: 2.1 time: 0.129158 Oct 22 21:53:49.455680 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3225/6419] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 21:53:49 2022] POST /compute/v2.1/servers/e8b43f72-f51e-4ed8-809f-f04c3c67a192/action => generated 0 bytes in 131 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 21:53:49.464437 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-4e7fe564-2230-4a1e-8212-9a5de06150dc tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:53:49.465738 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-4e7fe564-2230-4a1e-8212-9a5de06150dc tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] [instance: e8b43f72-f51e-4ed8-809f-f04c3c67a192] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:53:49.472854 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4e7fe564-2230-4a1e-8212-9a5de06150dc tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:53:49.473400 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4e7fe564-2230-4a1e-8212-9a5de06150dc tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:53:49.473877 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4e7fe564-2230-4a1e-8212-9a5de06150dc tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:53:49.474573 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4e7fe564-2230-4a1e-8212-9a5de06150dc tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:53:49.475140 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4e7fe564-2230-4a1e-8212-9a5de06150dc tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:53:49.475604 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4e7fe564-2230-4a1e-8212-9a5de06150dc tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:53:49.609925 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-4e7fe564-2230-4a1e-8212-9a5de06150dc tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1a4da366004680b7330a8e9f43f945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17135327e2d14c4bbe4c7b242f9fda48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:53:49.618206 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-4e7fe564-2230-4a1e-8212-9a5de06150dc tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] 10.222.0.18 "GET /compute/v2.1/servers/e8b43f72-f51e-4ed8-809f-f04c3c67a192" status: 200 len: 1677 microversion: 2.1 time: 0.157792 Oct 22 21:53:49.618854 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3195/6420] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:53:49 2022] GET /compute/v2.1/servers/e8b43f72-f51e-4ed8-809f-f04c3c67a192 => generated 1677 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:53:50.645360 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-072eaac1-545e-41a2-8c29-d622727ad238 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:53:50.645939 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-072eaac1-545e-41a2-8c29-d622727ad238 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] [instance: e8b43f72-f51e-4ed8-809f-f04c3c67a192] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:53:50.653615 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-072eaac1-545e-41a2-8c29-d622727ad238 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:53:50.654114 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-072eaac1-545e-41a2-8c29-d622727ad238 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:53:50.654566 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-072eaac1-545e-41a2-8c29-d622727ad238 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:53:50.655278 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-072eaac1-545e-41a2-8c29-d622727ad238 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:53:50.655785 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-072eaac1-545e-41a2-8c29-d622727ad238 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:53:50.656224 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-072eaac1-545e-41a2-8c29-d622727ad238 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:53:50.796852 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-072eaac1-545e-41a2-8c29-d622727ad238 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1a4da366004680b7330a8e9f43f945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17135327e2d14c4bbe4c7b242f9fda48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:53:50.807104 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-072eaac1-545e-41a2-8c29-d622727ad238 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] 10.222.0.18 "GET /compute/v2.1/servers/e8b43f72-f51e-4ed8-809f-f04c3c67a192" status: 200 len: 1677 microversion: 2.1 time: 0.167500 Oct 22 21:53:50.807741 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3226/6421] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:53:50 2022] GET /compute/v2.1/servers/e8b43f72-f51e-4ed8-809f-f04c3c67a192 => generated 1677 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:53:51.832218 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-735103e4-0881-4e9f-b391-d02a088d73f3 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:53:51.832997 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-735103e4-0881-4e9f-b391-d02a088d73f3 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] [instance: e8b43f72-f51e-4ed8-809f-f04c3c67a192] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:53:51.840129 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-735103e4-0881-4e9f-b391-d02a088d73f3 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:53:51.840620 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-735103e4-0881-4e9f-b391-d02a088d73f3 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:53:51.841085 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-735103e4-0881-4e9f-b391-d02a088d73f3 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:53:51.841792 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-735103e4-0881-4e9f-b391-d02a088d73f3 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:53:51.842249 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-735103e4-0881-4e9f-b391-d02a088d73f3 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:53:51.843010 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-735103e4-0881-4e9f-b391-d02a088d73f3 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:53:51.979311 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-735103e4-0881-4e9f-b391-d02a088d73f3 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1a4da366004680b7330a8e9f43f945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17135327e2d14c4bbe4c7b242f9fda48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:53:51.988010 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-735103e4-0881-4e9f-b391-d02a088d73f3 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] 10.222.0.18 "GET /compute/v2.1/servers/e8b43f72-f51e-4ed8-809f-f04c3c67a192" status: 200 len: 1682 microversion: 2.1 time: 0.160733 Oct 22 21:53:51.988594 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3196/6422] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:53:51 2022] GET /compute/v2.1/servers/e8b43f72-f51e-4ed8-809f-f04c3c67a192 => generated 1682 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:53:53.015414 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-609405e0-b52a-42c4-a9c9-970665cdbed0 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:53:53.016417 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-609405e0-b52a-42c4-a9c9-970665cdbed0 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] [instance: e8b43f72-f51e-4ed8-809f-f04c3c67a192] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:53:53.028025 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-609405e0-b52a-42c4-a9c9-970665cdbed0 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:53:53.029056 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-609405e0-b52a-42c4-a9c9-970665cdbed0 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:53:53.029851 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-609405e0-b52a-42c4-a9c9-970665cdbed0 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:53:53.031024 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-609405e0-b52a-42c4-a9c9-970665cdbed0 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:53:53.031969 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-609405e0-b52a-42c4-a9c9-970665cdbed0 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:53:53.032681 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-609405e0-b52a-42c4-a9c9-970665cdbed0 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:53:53.166865 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-609405e0-b52a-42c4-a9c9-970665cdbed0 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1a4da366004680b7330a8e9f43f945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17135327e2d14c4bbe4c7b242f9fda48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:53:53.175164 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-609405e0-b52a-42c4-a9c9-970665cdbed0 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] 10.222.0.18 "GET /compute/v2.1/servers/e8b43f72-f51e-4ed8-809f-f04c3c67a192" status: 200 len: 1682 microversion: 2.1 time: 0.166572 Oct 22 21:53:53.175789 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3227/6423] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:53:53 2022] GET /compute/v2.1/servers/e8b43f72-f51e-4ed8-809f-f04c3c67a192 => generated 1682 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:53:54.200785 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-e9b30820-3b58-495a-b94b-c5487086a316 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:53:54.201411 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-e9b30820-3b58-495a-b94b-c5487086a316 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] [instance: e8b43f72-f51e-4ed8-809f-f04c3c67a192] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:53:54.210303 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e9b30820-3b58-495a-b94b-c5487086a316 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:53:54.210831 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e9b30820-3b58-495a-b94b-c5487086a316 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:53:54.211362 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e9b30820-3b58-495a-b94b-c5487086a316 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:53:54.212075 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e9b30820-3b58-495a-b94b-c5487086a316 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:53:54.212536 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e9b30820-3b58-495a-b94b-c5487086a316 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:53:54.213002 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e9b30820-3b58-495a-b94b-c5487086a316 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:53:54.364112 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-e9b30820-3b58-495a-b94b-c5487086a316 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1a4da366004680b7330a8e9f43f945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17135327e2d14c4bbe4c7b242f9fda48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:53:54.372454 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-e9b30820-3b58-495a-b94b-c5487086a316 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] 10.222.0.18 "GET /compute/v2.1/servers/e8b43f72-f51e-4ed8-809f-f04c3c67a192" status: 200 len: 1682 microversion: 2.1 time: 0.175871 Oct 22 21:53:54.373062 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3197/6424] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:53:54 2022] GET /compute/v2.1/servers/e8b43f72-f51e-4ed8-809f-f04c3c67a192 => generated 1682 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:53:55.400087 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-d31f5597-4f3c-4a18-9d06-a30efd5fd1e4 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:53:55.401145 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-d31f5597-4f3c-4a18-9d06-a30efd5fd1e4 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] [instance: e8b43f72-f51e-4ed8-809f-f04c3c67a192] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:53:55.411623 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d31f5597-4f3c-4a18-9d06-a30efd5fd1e4 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:53:55.412127 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d31f5597-4f3c-4a18-9d06-a30efd5fd1e4 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:53:55.412574 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d31f5597-4f3c-4a18-9d06-a30efd5fd1e4 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:53:55.413285 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d31f5597-4f3c-4a18-9d06-a30efd5fd1e4 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:53:55.413746 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d31f5597-4f3c-4a18-9d06-a30efd5fd1e4 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:53:55.414191 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d31f5597-4f3c-4a18-9d06-a30efd5fd1e4 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:53:55.557695 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-d31f5597-4f3c-4a18-9d06-a30efd5fd1e4 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1a4da366004680b7330a8e9f43f945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17135327e2d14c4bbe4c7b242f9fda48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:53:55.566528 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-d31f5597-4f3c-4a18-9d06-a30efd5fd1e4 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] 10.222.0.18 "GET /compute/v2.1/servers/e8b43f72-f51e-4ed8-809f-f04c3c67a192" status: 200 len: 1682 microversion: 2.1 time: 0.173067 Oct 22 21:53:55.567105 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3228/6425] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:53:55 2022] GET /compute/v2.1/servers/e8b43f72-f51e-4ed8-809f-f04c3c67a192 => generated 1682 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:53:56.590311 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-6a31eb9a-a179-4cd4-a9ee-0d60a5b479b2 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:53:56.590900 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-6a31eb9a-a179-4cd4-a9ee-0d60a5b479b2 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] [instance: e8b43f72-f51e-4ed8-809f-f04c3c67a192] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:53:56.598647 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6a31eb9a-a179-4cd4-a9ee-0d60a5b479b2 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:53:56.599146 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6a31eb9a-a179-4cd4-a9ee-0d60a5b479b2 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:53:56.599619 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6a31eb9a-a179-4cd4-a9ee-0d60a5b479b2 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:53:56.600321 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6a31eb9a-a179-4cd4-a9ee-0d60a5b479b2 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:53:56.600775 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6a31eb9a-a179-4cd4-a9ee-0d60a5b479b2 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:53:56.601208 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6a31eb9a-a179-4cd4-a9ee-0d60a5b479b2 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:53:56.745243 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-6a31eb9a-a179-4cd4-a9ee-0d60a5b479b2 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1a4da366004680b7330a8e9f43f945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17135327e2d14c4bbe4c7b242f9fda48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:53:56.753438 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-6a31eb9a-a179-4cd4-a9ee-0d60a5b479b2 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] 10.222.0.18 "GET /compute/v2.1/servers/e8b43f72-f51e-4ed8-809f-f04c3c67a192" status: 200 len: 1682 microversion: 2.1 time: 0.167139 Oct 22 21:53:56.754020 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3198/6426] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:53:56 2022] GET /compute/v2.1/servers/e8b43f72-f51e-4ed8-809f-f04c3c67a192 => generated 1682 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:53:57.780483 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-cb190fb0-71ef-4164-b154-ceffe9164880 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:53:57.781516 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-cb190fb0-71ef-4164-b154-ceffe9164880 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] [instance: e8b43f72-f51e-4ed8-809f-f04c3c67a192] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:53:57.792847 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cb190fb0-71ef-4164-b154-ceffe9164880 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:53:57.793655 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cb190fb0-71ef-4164-b154-ceffe9164880 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:53:57.794404 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cb190fb0-71ef-4164-b154-ceffe9164880 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:53:57.795616 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cb190fb0-71ef-4164-b154-ceffe9164880 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:53:57.796396 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cb190fb0-71ef-4164-b154-ceffe9164880 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:53:57.797125 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cb190fb0-71ef-4164-b154-ceffe9164880 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:53:57.937503 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-cb190fb0-71ef-4164-b154-ceffe9164880 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1a4da366004680b7330a8e9f43f945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17135327e2d14c4bbe4c7b242f9fda48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:53:57.950063 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-cb190fb0-71ef-4164-b154-ceffe9164880 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] 10.222.0.18 "GET /compute/v2.1/servers/e8b43f72-f51e-4ed8-809f-f04c3c67a192" status: 200 len: 1682 microversion: 2.1 time: 0.175995 Oct 22 21:53:57.950849 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3229/6427] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:53:57 2022] GET /compute/v2.1/servers/e8b43f72-f51e-4ed8-809f-f04c3c67a192 => generated 1682 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:53:58.978956 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-23a3dc18-c7b9-460b-ac27-17121d10f89b tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:53:58.979609 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-23a3dc18-c7b9-460b-ac27-17121d10f89b tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] [instance: e8b43f72-f51e-4ed8-809f-f04c3c67a192] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:53:58.986686 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-23a3dc18-c7b9-460b-ac27-17121d10f89b tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:53:58.987165 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-23a3dc18-c7b9-460b-ac27-17121d10f89b tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:53:58.987634 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-23a3dc18-c7b9-460b-ac27-17121d10f89b tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:53:58.988327 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-23a3dc18-c7b9-460b-ac27-17121d10f89b tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:53:58.988781 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-23a3dc18-c7b9-460b-ac27-17121d10f89b tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:53:58.989204 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-23a3dc18-c7b9-460b-ac27-17121d10f89b tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:53:59.130772 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-23a3dc18-c7b9-460b-ac27-17121d10f89b tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1a4da366004680b7330a8e9f43f945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17135327e2d14c4bbe4c7b242f9fda48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:53:59.139539 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-23a3dc18-c7b9-460b-ac27-17121d10f89b tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] 10.222.0.18 "GET /compute/v2.1/servers/e8b43f72-f51e-4ed8-809f-f04c3c67a192" status: 200 len: 1682 microversion: 2.1 time: 0.165762 Oct 22 21:53:59.140089 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3199/6428] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:53:58 2022] GET /compute/v2.1/servers/e8b43f72-f51e-4ed8-809f-f04c3c67a192 => generated 1682 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:54:00.163022 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-19cf6355-55be-4fab-a3f3-70ce132d70e6 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:54:00.163729 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-19cf6355-55be-4fab-a3f3-70ce132d70e6 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] [instance: e8b43f72-f51e-4ed8-809f-f04c3c67a192] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:54:00.171627 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-19cf6355-55be-4fab-a3f3-70ce132d70e6 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:54:00.172141 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-19cf6355-55be-4fab-a3f3-70ce132d70e6 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:54:00.172625 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-19cf6355-55be-4fab-a3f3-70ce132d70e6 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:54:00.173348 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-19cf6355-55be-4fab-a3f3-70ce132d70e6 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:54:00.173816 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-19cf6355-55be-4fab-a3f3-70ce132d70e6 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:54:00.174265 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-19cf6355-55be-4fab-a3f3-70ce132d70e6 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:54:00.314279 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-19cf6355-55be-4fab-a3f3-70ce132d70e6 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1a4da366004680b7330a8e9f43f945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17135327e2d14c4bbe4c7b242f9fda48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:54:00.323272 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-19cf6355-55be-4fab-a3f3-70ce132d70e6 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] 10.222.0.18 "GET /compute/v2.1/servers/e8b43f72-f51e-4ed8-809f-f04c3c67a192" status: 200 len: 1682 microversion: 2.1 time: 0.164258 Oct 22 21:54:00.323882 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3230/6429] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:54:00 2022] GET /compute/v2.1/servers/e8b43f72-f51e-4ed8-809f-f04c3c67a192 => generated 1682 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:54:01.350759 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-8faaaaab-4ccc-4261-a037-e4be61e1ea2a tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:54:01.351716 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-8faaaaab-4ccc-4261-a037-e4be61e1ea2a tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] [instance: e8b43f72-f51e-4ed8-809f-f04c3c67a192] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:54:01.359108 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8faaaaab-4ccc-4261-a037-e4be61e1ea2a tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:54:01.359639 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8faaaaab-4ccc-4261-a037-e4be61e1ea2a tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:54:01.360083 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8faaaaab-4ccc-4261-a037-e4be61e1ea2a tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:54:01.360784 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8faaaaab-4ccc-4261-a037-e4be61e1ea2a tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:54:01.361244 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8faaaaab-4ccc-4261-a037-e4be61e1ea2a tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:54:01.361648 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8faaaaab-4ccc-4261-a037-e4be61e1ea2a tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:54:01.500350 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-8faaaaab-4ccc-4261-a037-e4be61e1ea2a tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1a4da366004680b7330a8e9f43f945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17135327e2d14c4bbe4c7b242f9fda48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:54:01.508428 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-8faaaaab-4ccc-4261-a037-e4be61e1ea2a tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] 10.222.0.18 "GET /compute/v2.1/servers/e8b43f72-f51e-4ed8-809f-f04c3c67a192" status: 200 len: 1682 microversion: 2.1 time: 0.164285 Oct 22 21:54:01.509003 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3200/6430] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:54:01 2022] GET /compute/v2.1/servers/e8b43f72-f51e-4ed8-809f-f04c3c67a192 => generated 1682 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:54:02.536066 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-7286dd88-3d15-42d3-ac85-fda6c3815dde tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:54:02.537060 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-7286dd88-3d15-42d3-ac85-fda6c3815dde tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] [instance: e8b43f72-f51e-4ed8-809f-f04c3c67a192] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:54:02.545264 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7286dd88-3d15-42d3-ac85-fda6c3815dde tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:54:02.545769 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7286dd88-3d15-42d3-ac85-fda6c3815dde tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:54:02.546231 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7286dd88-3d15-42d3-ac85-fda6c3815dde tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:54:02.546950 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7286dd88-3d15-42d3-ac85-fda6c3815dde tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:54:02.547467 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7286dd88-3d15-42d3-ac85-fda6c3815dde tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:54:02.547908 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7286dd88-3d15-42d3-ac85-fda6c3815dde tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:54:02.684300 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-7286dd88-3d15-42d3-ac85-fda6c3815dde tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1a4da366004680b7330a8e9f43f945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17135327e2d14c4bbe4c7b242f9fda48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:54:02.692689 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-7286dd88-3d15-42d3-ac85-fda6c3815dde tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] 10.222.0.18 "GET /compute/v2.1/servers/e8b43f72-f51e-4ed8-809f-f04c3c67a192" status: 200 len: 1682 microversion: 2.1 time: 0.163307 Oct 22 21:54:02.693268 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3231/6431] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:54:02 2022] GET /compute/v2.1/servers/e8b43f72-f51e-4ed8-809f-f04c3c67a192 => generated 1682 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:54:03.717082 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-02f65329-1506-40a3-a7a0-158dec5e338e tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:54:03.718029 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-02f65329-1506-40a3-a7a0-158dec5e338e tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] [instance: e8b43f72-f51e-4ed8-809f-f04c3c67a192] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:54:03.727566 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-02f65329-1506-40a3-a7a0-158dec5e338e tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:54:03.728445 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-02f65329-1506-40a3-a7a0-158dec5e338e tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:54:03.729163 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-02f65329-1506-40a3-a7a0-158dec5e338e tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:54:03.730036 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-02f65329-1506-40a3-a7a0-158dec5e338e tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:54:03.730511 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-02f65329-1506-40a3-a7a0-158dec5e338e tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:54:03.730950 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-02f65329-1506-40a3-a7a0-158dec5e338e tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:54:03.933740 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-02f65329-1506-40a3-a7a0-158dec5e338e tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1a4da366004680b7330a8e9f43f945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17135327e2d14c4bbe4c7b242f9fda48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:54:03.941721 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-02f65329-1506-40a3-a7a0-158dec5e338e tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] 10.222.0.18 "GET /compute/v2.1/servers/e8b43f72-f51e-4ed8-809f-f04c3c67a192" status: 200 len: 1681 microversion: 2.1 time: 0.228597 Oct 22 21:54:03.942313 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3201/6432] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:54:03 2022] GET /compute/v2.1/servers/e8b43f72-f51e-4ed8-809f-f04c3c67a192 => generated 1681 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:54:03.964918 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-d4b447aa-9327-4db3-8d23-1619c8356cf8 req-cfa457ed-db4c-42f1-a2b2-e896af6d74e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8b43f72-f51e-4ed8-809f-f04c3c67a192", "name": "network-vif-unplugged", "status": "completed", "tag": "365fe87e-cc8b-459e-bbf5-96851ef521b7"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:54:03.976455 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-d4b447aa-9327-4db3-8d23-1619c8356cf8 req-cfa457ed-db4c-42f1-a2b2-e896af6d74e4 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:54:03.976980 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-d4b447aa-9327-4db3-8d23-1619c8356cf8 req-cfa457ed-db4c-42f1-a2b2-e896af6d74e4 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:54:03.977428 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-d4b447aa-9327-4db3-8d23-1619c8356cf8 req-cfa457ed-db4c-42f1-a2b2-e896af6d74e4 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:54:03.989960 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-d4b447aa-9327-4db3-8d23-1619c8356cf8 req-cfa457ed-db4c-42f1-a2b2-e896af6d74e4 service nova] Creating event network-vif-unplugged:365fe87e-cc8b-459e-bbf5-96851ef521b7 for instance e8b43f72-f51e-4ed8-809f-f04c3c67a192 on nch2-master-1 Oct 22 21:54:03.995833 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [req-d4b447aa-9327-4db3-8d23-1619c8356cf8 req-cfa457ed-db4c-42f1-a2b2-e896af6d74e4 service nova] Instance e8b43f72-f51e-4ed8-809f-f04c3c67a192 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=138745) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 22 21:54:04.007177 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-d4b447aa-9327-4db3-8d23-1619c8356cf8 req-cfa457ed-db4c-42f1-a2b2-e896af6d74e4 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047741 Oct 22 21:54:04.007979 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3232/6433] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:54:03 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:54:04.965779 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-b095869f-6d6b-4104-8ae1-b9f5faf3c72c tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:54:04.966440 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-b095869f-6d6b-4104-8ae1-b9f5faf3c72c tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] [instance: e8b43f72-f51e-4ed8-809f-f04c3c67a192] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:54:04.974081 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b095869f-6d6b-4104-8ae1-b9f5faf3c72c tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:54:04.974638 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b095869f-6d6b-4104-8ae1-b9f5faf3c72c tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:54:04.975035 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b095869f-6d6b-4104-8ae1-b9f5faf3c72c tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:54:04.975787 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b095869f-6d6b-4104-8ae1-b9f5faf3c72c tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:54:04.976377 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b095869f-6d6b-4104-8ae1-b9f5faf3c72c tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:54:04.976906 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b095869f-6d6b-4104-8ae1-b9f5faf3c72c tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:54:05.113258 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-b095869f-6d6b-4104-8ae1-b9f5faf3c72c tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1a4da366004680b7330a8e9f43f945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17135327e2d14c4bbe4c7b242f9fda48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:54:05.121412 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-b095869f-6d6b-4104-8ae1-b9f5faf3c72c tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] 10.222.0.18 "GET /compute/v2.1/servers/e8b43f72-f51e-4ed8-809f-f04c3c67a192" status: 200 len: 1681 microversion: 2.1 time: 0.159715 Oct 22 21:54:05.121995 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3202/6434] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:54:04 2022] GET /compute/v2.1/servers/e8b43f72-f51e-4ed8-809f-f04c3c67a192 => generated 1681 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:54:06.028738 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-2cc3d360-cf26-4c33-a927-0db575b8ee47 req-0cbe764a-739e-45ad-9cb5-76075b8a8b75 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8b43f72-f51e-4ed8-809f-f04c3c67a192", "tag": "365fe87e-cc8b-459e-bbf5-96851ef521b7"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:54:06.039049 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-2cc3d360-cf26-4c33-a927-0db575b8ee47 req-0cbe764a-739e-45ad-9cb5-76075b8a8b75 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:54:06.039641 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-2cc3d360-cf26-4c33-a927-0db575b8ee47 req-0cbe764a-739e-45ad-9cb5-76075b8a8b75 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:54:06.040117 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-2cc3d360-cf26-4c33-a927-0db575b8ee47 req-0cbe764a-739e-45ad-9cb5-76075b8a8b75 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:54:06.051995 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-2cc3d360-cf26-4c33-a927-0db575b8ee47 req-0cbe764a-739e-45ad-9cb5-76075b8a8b75 service nova] Creating event network-changed:365fe87e-cc8b-459e-bbf5-96851ef521b7 for instance e8b43f72-f51e-4ed8-809f-f04c3c67a192 on nch2-master-1 Oct 22 21:54:06.057924 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [req-2cc3d360-cf26-4c33-a927-0db575b8ee47 req-0cbe764a-739e-45ad-9cb5-76075b8a8b75 service nova] Instance e8b43f72-f51e-4ed8-809f-f04c3c67a192 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=138745) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 22 21:54:06.068962 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-2cc3d360-cf26-4c33-a927-0db575b8ee47 req-0cbe764a-739e-45ad-9cb5-76075b8a8b75 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045386 Oct 22 21:54:06.069555 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3233/6435] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:54:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:54:06.149087 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-1472c309-cd83-4322-a728-e248aaf5fa67 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:54:06.149693 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-1472c309-cd83-4322-a728-e248aaf5fa67 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] [instance: e8b43f72-f51e-4ed8-809f-f04c3c67a192] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:54:06.157128 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1472c309-cd83-4322-a728-e248aaf5fa67 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:54:06.157624 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1472c309-cd83-4322-a728-e248aaf5fa67 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:54:06.158071 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1472c309-cd83-4322-a728-e248aaf5fa67 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:54:06.158781 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1472c309-cd83-4322-a728-e248aaf5fa67 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:54:06.159245 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1472c309-cd83-4322-a728-e248aaf5fa67 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:54:06.159708 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1472c309-cd83-4322-a728-e248aaf5fa67 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:54:06.302008 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-1472c309-cd83-4322-a728-e248aaf5fa67 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1a4da366004680b7330a8e9f43f945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17135327e2d14c4bbe4c7b242f9fda48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:54:06.310430 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-1472c309-cd83-4322-a728-e248aaf5fa67 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] 10.222.0.18 "GET /compute/v2.1/servers/e8b43f72-f51e-4ed8-809f-f04c3c67a192" status: 200 len: 1679 microversion: 2.1 time: 0.167632 Oct 22 21:54:06.311012 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3203/6436] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:54:06 2022] GET /compute/v2.1/servers/e8b43f72-f51e-4ed8-809f-f04c3c67a192 => generated 1679 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:54:07.335664 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-d2108642-8593-4528-a242-6c8edf61cdc6 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:54:07.336482 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-d2108642-8593-4528-a242-6c8edf61cdc6 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] [instance: e8b43f72-f51e-4ed8-809f-f04c3c67a192] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:54:07.343932 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d2108642-8593-4528-a242-6c8edf61cdc6 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:54:07.344456 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d2108642-8593-4528-a242-6c8edf61cdc6 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:54:07.344934 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d2108642-8593-4528-a242-6c8edf61cdc6 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:54:07.345682 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d2108642-8593-4528-a242-6c8edf61cdc6 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:54:07.346179 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d2108642-8593-4528-a242-6c8edf61cdc6 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:54:07.346646 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d2108642-8593-4528-a242-6c8edf61cdc6 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:54:07.486927 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-d2108642-8593-4528-a242-6c8edf61cdc6 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1a4da366004680b7330a8e9f43f945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17135327e2d14c4bbe4c7b242f9fda48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:54:07.495598 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-d2108642-8593-4528-a242-6c8edf61cdc6 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] 10.222.0.18 "GET /compute/v2.1/servers/e8b43f72-f51e-4ed8-809f-f04c3c67a192" status: 200 len: 1676 microversion: 2.1 time: 0.165456 Oct 22 21:54:07.496215 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3234/6437] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:54:07 2022] GET /compute/v2.1/servers/e8b43f72-f51e-4ed8-809f-f04c3c67a192 => generated 1676 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:54:07.518378 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-47f094c2-d181-4803-bc7a-9604f76c3f33 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:54:07.518978 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-47f094c2-d181-4803-bc7a-9604f76c3f33 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] [instance: e8b43f72-f51e-4ed8-809f-f04c3c67a192] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:54:07.526815 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-47f094c2-d181-4803-bc7a-9604f76c3f33 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:54:07.527305 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-47f094c2-d181-4803-bc7a-9604f76c3f33 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:54:07.528009 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-47f094c2-d181-4803-bc7a-9604f76c3f33 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:54:07.528691 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-47f094c2-d181-4803-bc7a-9604f76c3f33 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:54:07.529155 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-47f094c2-d181-4803-bc7a-9604f76c3f33 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:54:07.529588 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-47f094c2-d181-4803-bc7a-9604f76c3f33 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:54:07.608433 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-47f094c2-d181-4803-bc7a-9604f76c3f33 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] 10.222.0.18 "POST /compute/v2.1/servers/e8b43f72-f51e-4ed8-809f-f04c3c67a192/action" status: 204 len: 0 microversion: 2.1 time: 0.093650 Oct 22 21:54:07.609217 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3204/6438] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 21:54:07 2022] POST /compute/v2.1/servers/e8b43f72-f51e-4ed8-809f-f04c3c67a192/action => generated 0 bytes in 96 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 21:54:07.617851 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-4beea4c2-5a65-4001-9cf2-68d8d93acafc tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:54:07.618494 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-4beea4c2-5a65-4001-9cf2-68d8d93acafc tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] [instance: e8b43f72-f51e-4ed8-809f-f04c3c67a192] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:54:07.624799 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4beea4c2-5a65-4001-9cf2-68d8d93acafc tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:54:07.625314 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4beea4c2-5a65-4001-9cf2-68d8d93acafc tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:54:07.625804 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4beea4c2-5a65-4001-9cf2-68d8d93acafc tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:54:07.626517 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4beea4c2-5a65-4001-9cf2-68d8d93acafc tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:54:07.626990 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4beea4c2-5a65-4001-9cf2-68d8d93acafc tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:54:07.627450 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4beea4c2-5a65-4001-9cf2-68d8d93acafc tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:54:07.764168 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-4beea4c2-5a65-4001-9cf2-68d8d93acafc tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1a4da366004680b7330a8e9f43f945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17135327e2d14c4bbe4c7b242f9fda48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:54:07.772731 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-4beea4c2-5a65-4001-9cf2-68d8d93acafc tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] 10.222.0.18 "GET /compute/v2.1/servers/e8b43f72-f51e-4ed8-809f-f04c3c67a192" status: 200 len: 1676 microversion: 2.1 time: 0.158966 Oct 22 21:54:07.773634 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3235/6439] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:54:07 2022] GET /compute/v2.1/servers/e8b43f72-f51e-4ed8-809f-f04c3c67a192 => generated 1676 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:54:08.798611 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-f63ed46a-4328-44c6-8eff-ebe188471632 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:54:08.799405 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-f63ed46a-4328-44c6-8eff-ebe188471632 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] [instance: e8b43f72-f51e-4ed8-809f-f04c3c67a192] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:54:08.806335 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f63ed46a-4328-44c6-8eff-ebe188471632 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:54:08.806826 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f63ed46a-4328-44c6-8eff-ebe188471632 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:54:08.807321 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f63ed46a-4328-44c6-8eff-ebe188471632 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:54:08.808071 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f63ed46a-4328-44c6-8eff-ebe188471632 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:54:08.808535 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f63ed46a-4328-44c6-8eff-ebe188471632 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:54:08.808968 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f63ed46a-4328-44c6-8eff-ebe188471632 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:54:08.953072 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-f63ed46a-4328-44c6-8eff-ebe188471632 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1a4da366004680b7330a8e9f43f945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17135327e2d14c4bbe4c7b242f9fda48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:54:08.961568 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-f63ed46a-4328-44c6-8eff-ebe188471632 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] 10.222.0.18 "GET /compute/v2.1/servers/e8b43f72-f51e-4ed8-809f-f04c3c67a192" status: 200 len: 1676 microversion: 2.1 time: 0.168569 Oct 22 21:54:08.962223 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3205/6440] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:54:08 2022] GET /compute/v2.1/servers/e8b43f72-f51e-4ed8-809f-f04c3c67a192 => generated 1676 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:54:09.990080 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-d19a57d7-496e-47a2-967b-ee913654878b tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:54:09.991066 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-d19a57d7-496e-47a2-967b-ee913654878b tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] [instance: e8b43f72-f51e-4ed8-809f-f04c3c67a192] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:54:09.999612 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d19a57d7-496e-47a2-967b-ee913654878b tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:54:10.000113 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d19a57d7-496e-47a2-967b-ee913654878b tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:54:10.000563 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d19a57d7-496e-47a2-967b-ee913654878b tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:54:10.001280 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d19a57d7-496e-47a2-967b-ee913654878b tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:54:10.001754 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d19a57d7-496e-47a2-967b-ee913654878b tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:54:10.002189 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d19a57d7-496e-47a2-967b-ee913654878b tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:54:10.136763 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-d19a57d7-496e-47a2-967b-ee913654878b tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1a4da366004680b7330a8e9f43f945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17135327e2d14c4bbe4c7b242f9fda48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:54:10.145005 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-d19a57d7-496e-47a2-967b-ee913654878b tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] 10.222.0.18 "GET /compute/v2.1/servers/e8b43f72-f51e-4ed8-809f-f04c3c67a192" status: 200 len: 1668 microversion: 2.1 time: 0.161659 Oct 22 21:54:10.145603 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3236/6441] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:54:09 2022] GET /compute/v2.1/servers/e8b43f72-f51e-4ed8-809f-f04c3c67a192 => generated 1668 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:54:10.167320 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-b6861023-d1bd-42b4-bdf9-afe0c8ed4fc0 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:54:10.167912 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-b6861023-d1bd-42b4-bdf9-afe0c8ed4fc0 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] [instance: e8b43f72-f51e-4ed8-809f-f04c3c67a192] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:54:10.175322 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b6861023-d1bd-42b4-bdf9-afe0c8ed4fc0 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:54:10.175849 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b6861023-d1bd-42b4-bdf9-afe0c8ed4fc0 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:54:10.176295 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b6861023-d1bd-42b4-bdf9-afe0c8ed4fc0 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:54:10.177009 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b6861023-d1bd-42b4-bdf9-afe0c8ed4fc0 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:54:10.177470 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b6861023-d1bd-42b4-bdf9-afe0c8ed4fc0 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:54:10.177904 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b6861023-d1bd-42b4-bdf9-afe0c8ed4fc0 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:54:10.309849 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-b6861023-d1bd-42b4-bdf9-afe0c8ed4fc0 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1a4da366004680b7330a8e9f43f945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17135327e2d14c4bbe4c7b242f9fda48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:54:10.318112 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-b6861023-d1bd-42b4-bdf9-afe0c8ed4fc0 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] 10.222.0.18 "GET /compute/v2.1/servers/e8b43f72-f51e-4ed8-809f-f04c3c67a192" status: 200 len: 1668 microversion: 2.1 time: 0.154810 Oct 22 21:54:10.318710 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3206/6442] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:54:10 2022] GET /compute/v2.1/servers/e8b43f72-f51e-4ed8-809f-f04c3c67a192 => generated 1668 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:54:10.340724 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-80357864-9408-479b-a136-72ab87f2643a tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:54:10.341348 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-80357864-9408-479b-a136-72ab87f2643a tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] [instance: e8b43f72-f51e-4ed8-809f-f04c3c67a192] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:54:10.348393 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-80357864-9408-479b-a136-72ab87f2643a tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:54:10.348894 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-80357864-9408-479b-a136-72ab87f2643a tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:54:10.349378 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-80357864-9408-479b-a136-72ab87f2643a tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:54:10.350099 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-80357864-9408-479b-a136-72ab87f2643a tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:54:10.350550 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-80357864-9408-479b-a136-72ab87f2643a tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:54:10.350993 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-80357864-9408-479b-a136-72ab87f2643a tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:54:10.488475 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-80357864-9408-479b-a136-72ab87f2643a tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1a4da366004680b7330a8e9f43f945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17135327e2d14c4bbe4c7b242f9fda48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:54:10.496804 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-80357864-9408-479b-a136-72ab87f2643a tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] 10.222.0.18 "GET /compute/v2.1/servers/e8b43f72-f51e-4ed8-809f-f04c3c67a192" status: 200 len: 1668 microversion: 2.1 time: 0.160099 Oct 22 21:54:10.497384 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3237/6443] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:54:10 2022] GET /compute/v2.1/servers/e8b43f72-f51e-4ed8-809f-f04c3c67a192 => generated 1668 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:54:10.519200 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-2779be44-083d-4526-b9f8-f933ad491e39 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:54:10.519669 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-2779be44-083d-4526-b9f8-f933ad491e39 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] [instance: e8b43f72-f51e-4ed8-809f-f04c3c67a192] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:54:10.526089 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2779be44-083d-4526-b9f8-f933ad491e39 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:54:10.526577 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2779be44-083d-4526-b9f8-f933ad491e39 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:54:10.527016 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2779be44-083d-4526-b9f8-f933ad491e39 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:54:10.527797 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2779be44-083d-4526-b9f8-f933ad491e39 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:54:10.528256 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2779be44-083d-4526-b9f8-f933ad491e39 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:54:10.528684 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2779be44-083d-4526-b9f8-f933ad491e39 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:54:10.554326 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-2779be44-083d-4526-b9f8-f933ad491e39 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] [instance: e8b43f72-f51e-4ed8-809f-f04c3c67a192] Going to try to terminate instance {{(pid=138744) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 21:54:10.578737 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:54:10.639892 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-2779be44-083d-4526-b9f8-f933ad491e39 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] 10.222.0.18 "DELETE /compute/v2.1/servers/e8b43f72-f51e-4ed8-809f-f04c3c67a192" status: 204 len: 0 microversion: 2.1 time: 0.124399 Oct 22 21:54:10.642620 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3207/6444] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 21:54:10 2022] DELETE /compute/v2.1/servers/e8b43f72-f51e-4ed8-809f-f04c3c67a192 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 21:54:10.652731 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-b8920be5-fb7c-48df-886f-d50d964250a9 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:54:10.653366 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-b8920be5-fb7c-48df-886f-d50d964250a9 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] [instance: e8b43f72-f51e-4ed8-809f-f04c3c67a192] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:54:10.660179 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b8920be5-fb7c-48df-886f-d50d964250a9 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:54:10.660679 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b8920be5-fb7c-48df-886f-d50d964250a9 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:54:10.661214 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b8920be5-fb7c-48df-886f-d50d964250a9 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:54:10.662041 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b8920be5-fb7c-48df-886f-d50d964250a9 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:54:10.662515 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b8920be5-fb7c-48df-886f-d50d964250a9 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:54:10.662957 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b8920be5-fb7c-48df-886f-d50d964250a9 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:54:10.799828 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-b8920be5-fb7c-48df-886f-d50d964250a9 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1a4da366004680b7330a8e9f43f945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17135327e2d14c4bbe4c7b242f9fda48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:54:10.811956 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-b8920be5-fb7c-48df-886f-d50d964250a9 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] 10.222.0.18 "GET /compute/v2.1/servers/e8b43f72-f51e-4ed8-809f-f04c3c67a192" status: 200 len: 1674 microversion: 2.1 time: 0.163167 Oct 22 21:54:10.812720 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3238/6445] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:54:10 2022] GET /compute/v2.1/servers/e8b43f72-f51e-4ed8-809f-f04c3c67a192 => generated 1674 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:54:11.253522 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-092a3242-e306-407d-97ff-358e32621bb3 req-0a9d4247-2198-4f45-9205-a989e99777c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8b43f72-f51e-4ed8-809f-f04c3c67a192", "name": "network-vif-plugged", "status": "completed", "tag": "365fe87e-cc8b-459e-bbf5-96851ef521b7"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:54:11.264955 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-092a3242-e306-407d-97ff-358e32621bb3 req-0a9d4247-2198-4f45-9205-a989e99777c2 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:54:11.265446 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-092a3242-e306-407d-97ff-358e32621bb3 req-0a9d4247-2198-4f45-9205-a989e99777c2 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:54:11.265885 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-092a3242-e306-407d-97ff-358e32621bb3 req-0a9d4247-2198-4f45-9205-a989e99777c2 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:54:11.278506 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-092a3242-e306-407d-97ff-358e32621bb3 req-0a9d4247-2198-4f45-9205-a989e99777c2 service nova] Creating event network-vif-plugged:365fe87e-cc8b-459e-bbf5-96851ef521b7 for instance e8b43f72-f51e-4ed8-809f-f04c3c67a192 on nch2-master-1 Oct 22 21:54:11.283725 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-092a3242-e306-407d-97ff-358e32621bb3 req-0a9d4247-2198-4f45-9205-a989e99777c2 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034436 Oct 22 21:54:11.284306 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3208/6446] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:54:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:54:11.841199 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-762b54b4-cc62-4b34-b266-8a2ec2da0569 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:54:11.841852 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-762b54b4-cc62-4b34-b266-8a2ec2da0569 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] [instance: e8b43f72-f51e-4ed8-809f-f04c3c67a192] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:54:11.853078 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-762b54b4-cc62-4b34-b266-8a2ec2da0569 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:54:11.853772 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-762b54b4-cc62-4b34-b266-8a2ec2da0569 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:54:11.854256 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-762b54b4-cc62-4b34-b266-8a2ec2da0569 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:54:11.855089 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-762b54b4-cc62-4b34-b266-8a2ec2da0569 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:54:11.855636 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-762b54b4-cc62-4b34-b266-8a2ec2da0569 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:54:11.856070 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-762b54b4-cc62-4b34-b266-8a2ec2da0569 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:54:11.989709 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-762b54b4-cc62-4b34-b266-8a2ec2da0569 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1a4da366004680b7330a8e9f43f945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17135327e2d14c4bbe4c7b242f9fda48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:54:11.993466 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:54:11.998803 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-762b54b4-cc62-4b34-b266-8a2ec2da0569 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] 10.222.0.18 "GET /compute/v2.1/servers/e8b43f72-f51e-4ed8-809f-f04c3c67a192" status: 200 len: 1674 microversion: 2.1 time: 0.164139 Oct 22 21:54:11.999374 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3239/6447] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:54:11 2022] GET /compute/v2.1/servers/e8b43f72-f51e-4ed8-809f-f04c3c67a192 => generated 1674 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:54:13.024213 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-af94a7a2-9e8e-4b71-9582-da34eddc5329 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:54:13.024860 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-af94a7a2-9e8e-4b71-9582-da34eddc5329 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] [instance: e8b43f72-f51e-4ed8-809f-f04c3c67a192] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:54:13.032936 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-af94a7a2-9e8e-4b71-9582-da34eddc5329 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:54:13.033408 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-af94a7a2-9e8e-4b71-9582-da34eddc5329 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:54:13.034247 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-af94a7a2-9e8e-4b71-9582-da34eddc5329 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:54:13.035129 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-af94a7a2-9e8e-4b71-9582-da34eddc5329 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:54:13.035663 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-af94a7a2-9e8e-4b71-9582-da34eddc5329 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:54:13.036145 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-af94a7a2-9e8e-4b71-9582-da34eddc5329 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:54:13.162757 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-af94a7a2-9e8e-4b71-9582-da34eddc5329 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1a4da366004680b7330a8e9f43f945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17135327e2d14c4bbe4c7b242f9fda48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:54:13.171550 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-af94a7a2-9e8e-4b71-9582-da34eddc5329 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] 10.222.0.18 "GET /compute/v2.1/servers/e8b43f72-f51e-4ed8-809f-f04c3c67a192" status: 200 len: 1606 microversion: 2.1 time: 0.152622 Oct 22 21:54:13.172132 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3209/6448] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:54:13 2022] GET /compute/v2.1/servers/e8b43f72-f51e-4ed8-809f-f04c3c67a192 => generated 1606 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:54:13.341393 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-eb520d84-c5da-410d-8a5b-162583253fe1 req-9ca31db1-7e54-416e-b89f-421eabf94a71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8b43f72-f51e-4ed8-809f-f04c3c67a192", "name": "network-vif-deleted", "tag": "365fe87e-cc8b-459e-bbf5-96851ef521b7"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:54:13.357671 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-eb520d84-c5da-410d-8a5b-162583253fe1 req-9ca31db1-7e54-416e-b89f-421eabf94a71 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:54:13.358703 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-eb520d84-c5da-410d-8a5b-162583253fe1 req-9ca31db1-7e54-416e-b89f-421eabf94a71 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:54:13.359248 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-eb520d84-c5da-410d-8a5b-162583253fe1 req-9ca31db1-7e54-416e-b89f-421eabf94a71 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:54:13.374364 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-eb520d84-c5da-410d-8a5b-162583253fe1 req-9ca31db1-7e54-416e-b89f-421eabf94a71 service nova] Creating event network-vif-deleted:365fe87e-cc8b-459e-bbf5-96851ef521b7 for instance e8b43f72-f51e-4ed8-809f-f04c3c67a192 on nch2-master-1 Oct 22 21:54:13.380261 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-eb520d84-c5da-410d-8a5b-162583253fe1 req-9ca31db1-7e54-416e-b89f-421eabf94a71 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042844 Oct 22 21:54:13.381353 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3240/6449] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:54:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:54:14.194478 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-9ee6855e-7c09-4807-a039-b0ea5ea31597 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:54:14.195115 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-9ee6855e-7c09-4807-a039-b0ea5ea31597 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] [instance: e8b43f72-f51e-4ed8-809f-f04c3c67a192] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:54:14.203047 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9ee6855e-7c09-4807-a039-b0ea5ea31597 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:54:14.203609 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9ee6855e-7c09-4807-a039-b0ea5ea31597 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:54:14.204056 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9ee6855e-7c09-4807-a039-b0ea5ea31597 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:54:14.204779 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9ee6855e-7c09-4807-a039-b0ea5ea31597 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:54:14.205241 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9ee6855e-7c09-4807-a039-b0ea5ea31597 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:54:14.205714 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9ee6855e-7c09-4807-a039-b0ea5ea31597 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:54:14.220856 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-9ee6855e-7c09-4807-a039-b0ea5ea31597 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] HTTP exception thrown: Instance e8b43f72-f51e-4ed8-809f-f04c3c67a192 could not be found. Oct 22 21:54:14.222559 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-9ee6855e-7c09-4807-a039-b0ea5ea31597 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Request method failure captured: Oct 22 21:54:14.222559 ncdv-master-1 devstack@n-api.service[138744]: request: GET /compute/v2.1/servers/e8b43f72-f51e-4ed8-809f-f04c3c67a192 HTTP/1.1 Oct 22 21:54:14.222559 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 21:54:14.222559 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 21:54:14.222559 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 21:54:14.222559 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 0 Oct 22 21:54:14.222559 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 21:54:14.222559 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 21:54:14.222559 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 21:54:14.222559 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 21:54:14.222559 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVGYfDlcA9KGX2QlEp4u0j0Sc-lLfggp70EjXb3-sPhTyz6zB5UiJn8D5kqopVhrN_VN9rM0kOlrwARqwadQ16Olp9k3UgVUKiPcvbjWntYV4vZGIhwWOxDtvedxf_ou8I06I86O9hYoH_RNiO9r53LOOM9uLYhVbGc37T_1RXkzoTZs Oct 22 21:54:14.222559 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 21:54:14.222559 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 21:54:14.222559 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 21:54:14.222559 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 21:54:14.222559 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 21:54:14.222559 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 21:54:14.222559 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: 17135327e2d14c4bbe4c7b242f9fda48 Oct 22 21:54:14.222559 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-ServerActionsTestJSON-1985295999 Oct 22 21:54:14.222559 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 21:54:14.222559 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 21:54:14.222559 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_17135327e2d14c4bbe4c7b242f9fda48"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/17135327e2d14c4bbe4c7b242f9fda48"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/17135327e2d14c4bbe4c7b242f9fda48"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/17135327e2d14c4bbe4c7b242f9fda48"}]}] Oct 22 21:54:14.222559 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-ServerActionsTestJSON-1985295999 Oct 22 21:54:14.222559 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: 17135327e2d14c4bbe4c7b242f9fda48 Oct 22 21:54:14.222559 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-ServerActionsTestJSON-1985295999 Oct 22 21:54:14.222559 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-ServerActionsTestJSON-1985295999-project Oct 22 21:54:14.222559 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 21:54:14.222559 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 21:54:14.222559 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: ce1a4da366004680b7330a8e9f43f945 Oct 22 21:54:14.222559 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-ServerActionsTestJSON-1985295999-project Oct 22 21:54:14.222559 ncdv-master-1 devstack@n-api.service[138744]: method: > Oct 22 21:54:14.222559 ncdv-master-1 devstack@n-api.service[138744]: exception: Instance e8b43f72-f51e-4ed8-809f-f04c3c67a192 could not be found. Oct 22 21:54:14.222559 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': 'e8b43f72-f51e-4ed8-809f-f04c3c67a192'} Oct 22 21:54:14.222559 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:54:14.222559 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:54:14.222559 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 21:54:14.222559 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 21:54:14.222559 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 21:54:14.222559 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 21:54:14.222559 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 21:54:14.222559 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 21:54:14.222559 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 21:54:14.222559 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 21:54:14.222559 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e8b43f72-f51e-4ed8-809f-f04c3c67a192 could not be found. Oct 22 21:54:14.222559 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:54:14.222559 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:54:14.222559 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:54:14.222559 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:54:14.222559 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:54:14.222559 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:54:14.222559 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:54:14.222559 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:54:14.222559 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:54:14.222559 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:54:14.222559 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 21:54:14.222559 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 21:54:14.222559 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 21:54:14.222559 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 21:54:14.222559 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 21:54:14.222559 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:54:14.222559 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e8b43f72-f51e-4ed8-809f-f04c3c67a192 could not be found. Oct 22 21:54:14.222559 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:54:14.222559 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:54:14.222559 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:54:14.227972 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:54:14.227972 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:54:14.227972 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:54:14.227972 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:54:14.227972 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:54:14.227972 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e8b43f72-f51e-4ed8-809f-f04c3c67a192 could not be found. Oct 22 21:54:14.227972 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:54:14.227972 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-9ee6855e-7c09-4807-a039-b0ea5ea31597 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Returning 404 to user: Instance e8b43f72-f51e-4ed8-809f-f04c3c67a192 could not be found. {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:54:14.227972 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-9ee6855e-7c09-4807-a039-b0ea5ea31597 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] 10.222.0.18 "GET /compute/v2.1/servers/e8b43f72-f51e-4ed8-809f-f04c3c67a192" status: 404 len: 111 microversion: 2.1 time: 0.033607 Oct 22 21:54:14.227972 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3210/6450] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:54:14 2022] GET /compute/v2.1/servers/e8b43f72-f51e-4ed8-809f-f04c3c67a192 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 21:54:14.239082 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-3e9d7f11-64f3-47e9-9600-b96521d7a2b9 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:54:14.239859 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-3e9d7f11-64f3-47e9-9600-b96521d7a2b9 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] [instance: e8b43f72-f51e-4ed8-809f-f04c3c67a192] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:54:14.246939 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3e9d7f11-64f3-47e9-9600-b96521d7a2b9 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:54:14.247474 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3e9d7f11-64f3-47e9-9600-b96521d7a2b9 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:54:14.247937 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3e9d7f11-64f3-47e9-9600-b96521d7a2b9 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:54:14.248650 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3e9d7f11-64f3-47e9-9600-b96521d7a2b9 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:54:14.249146 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3e9d7f11-64f3-47e9-9600-b96521d7a2b9 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:54:14.249585 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3e9d7f11-64f3-47e9-9600-b96521d7a2b9 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:54:14.264320 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.wsgi [None req-3e9d7f11-64f3-47e9-9600-b96521d7a2b9 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] HTTP exception thrown: Instance e8b43f72-f51e-4ed8-809f-f04c3c67a192 could not be found. Oct 22 21:54:14.265982 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-3e9d7f11-64f3-47e9-9600-b96521d7a2b9 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Request method failure captured: Oct 22 21:54:14.265982 ncdv-master-1 devstack@n-api.service[138745]: request: GET /compute/v2.1/servers/e8b43f72-f51e-4ed8-809f-f04c3c67a192 HTTP/1.1 Oct 22 21:54:14.265982 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 21:54:14.265982 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 21:54:14.265982 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 21:54:14.265982 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 0 Oct 22 21:54:14.265982 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 21:54:14.265982 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 21:54:14.265982 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 21:54:14.265982 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 21:54:14.265982 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVGYfDlcA9KGX2QlEp4u0j0Sc-lLfggp70EjXb3-sPhTyz6zB5UiJn8D5kqopVhrN_VN9rM0kOlrwARqwadQ16Olp9k3UgVUKiPcvbjWntYV4vZGIhwWOxDtvedxf_ou8I06I86O9hYoH_RNiO9r53LOOM9uLYhVbGc37T_1RXkzoTZs Oct 22 21:54:14.265982 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 21:54:14.265982 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 21:54:14.265982 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 21:54:14.265982 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 21:54:14.265982 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 21:54:14.265982 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 21:54:14.265982 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: 17135327e2d14c4bbe4c7b242f9fda48 Oct 22 21:54:14.265982 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-ServerActionsTestJSON-1985295999 Oct 22 21:54:14.265982 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 21:54:14.265982 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 21:54:14.265982 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_17135327e2d14c4bbe4c7b242f9fda48"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/17135327e2d14c4bbe4c7b242f9fda48"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/17135327e2d14c4bbe4c7b242f9fda48"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/17135327e2d14c4bbe4c7b242f9fda48"}]}] Oct 22 21:54:14.265982 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-ServerActionsTestJSON-1985295999 Oct 22 21:54:14.265982 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: 17135327e2d14c4bbe4c7b242f9fda48 Oct 22 21:54:14.265982 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-ServerActionsTestJSON-1985295999 Oct 22 21:54:14.265982 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-ServerActionsTestJSON-1985295999-project Oct 22 21:54:14.265982 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 21:54:14.265982 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 21:54:14.265982 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: ce1a4da366004680b7330a8e9f43f945 Oct 22 21:54:14.265982 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-ServerActionsTestJSON-1985295999-project Oct 22 21:54:14.265982 ncdv-master-1 devstack@n-api.service[138745]: method: > Oct 22 21:54:14.265982 ncdv-master-1 devstack@n-api.service[138745]: exception: Instance e8b43f72-f51e-4ed8-809f-f04c3c67a192 could not be found. Oct 22 21:54:14.265982 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'id': 'e8b43f72-f51e-4ed8-809f-f04c3c67a192'} Oct 22 21:54:14.265982 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:54:14.265982 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:54:14.265982 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 21:54:14.265982 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 21:54:14.265982 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 21:54:14.265982 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 21:54:14.265982 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 21:54:14.265982 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 21:54:14.265982 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 21:54:14.265982 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 21:54:14.265982 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e8b43f72-f51e-4ed8-809f-f04c3c67a192 could not be found. Oct 22 21:54:14.265982 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:54:14.265982 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:54:14.265982 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:54:14.265982 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:54:14.265982 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:54:14.265982 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:54:14.265982 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:54:14.265982 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:54:14.265982 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:54:14.265982 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:54:14.265982 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 21:54:14.265982 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 21:54:14.265982 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 21:54:14.265982 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 21:54:14.265982 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 21:54:14.265982 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:54:14.265982 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e8b43f72-f51e-4ed8-809f-f04c3c67a192 could not be found. Oct 22 21:54:14.265982 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:54:14.265982 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:54:14.265982 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:54:14.270442 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:54:14.270442 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:54:14.270442 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:54:14.270442 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:54:14.270442 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:54:14.270442 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e8b43f72-f51e-4ed8-809f-f04c3c67a192 could not be found. Oct 22 21:54:14.270442 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:54:14.270442 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-3e9d7f11-64f3-47e9-9600-b96521d7a2b9 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Returning 404 to user: Instance e8b43f72-f51e-4ed8-809f-f04c3c67a192 could not be found. {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:54:14.270442 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-3e9d7f11-64f3-47e9-9600-b96521d7a2b9 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] 10.222.0.18 "GET /compute/v2.1/servers/e8b43f72-f51e-4ed8-809f-f04c3c67a192" status: 404 len: 111 microversion: 2.1 time: 0.032770 Oct 22 21:54:14.270442 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3241/6451] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:54:14 2022] GET /compute/v2.1/servers/e8b43f72-f51e-4ed8-809f-f04c3c67a192 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 21:54:14.334764 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-c75c5cf9-012a-4760-9e26-c93372fb7da5 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-399858241", "imageRef": "085e4478-6edc-4a69-8e08-f9831713eb65", "flavorRef": "452", "networks": [{"uuid": "c97efc9f-8481-439f-aa41-fc8c07627ab3"}], "security_groups": [{"name": "tempest-securitygroup--1780263140"}], "key_name": "tempest-keypair-52095379", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:54:14.443918 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.network.neutron [None req-c75c5cf9-012a-4760-9e26-c93372fb7da5 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] validate_networks() for [('c97efc9f-8481-439f-aa41-fc8c07627ab3', None, None, None, None, None)] {{(pid=138744) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 21:54:14.881211 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-c75c5cf9-012a-4760-9e26-c93372fb7da5 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Flavor limits 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 21:54:14.881802 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-c75c5cf9-012a-4760-9e26-c93372fb7da5 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Image limits 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 21:54:14.882376 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-c75c5cf9-012a-4760-9e26-c93372fb7da5 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Flavor pref 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 21:54:14.882881 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-c75c5cf9-012a-4760-9e26-c93372fb7da5 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Image pref 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 21:54:14.883480 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-c75c5cf9-012a-4760-9e26-c93372fb7da5 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 21:54:14.897641 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c75c5cf9-012a-4760-9e26-c93372fb7da5 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:54:14.898456 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c75c5cf9-012a-4760-9e26-c93372fb7da5 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:54:14.899216 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c75c5cf9-012a-4760-9e26-c93372fb7da5 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:54:14.900066 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c75c5cf9-012a-4760-9e26-c93372fb7da5 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:54:14.900706 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c75c5cf9-012a-4760-9e26-c93372fb7da5 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:54:14.901299 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c75c5cf9-012a-4760-9e26-c93372fb7da5 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:54:14.918989 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-c75c5cf9-012a-4760-9e26-c93372fb7da5 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Getting quotas for project 17135327e2d14c4bbe4c7b242f9fda48. Resources: {'cores', 'instances', 'ram'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 21:54:14.924566 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-c75c5cf9-012a-4760-9e26-c93372fb7da5 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Getting quotas for user ce1a4da366004680b7330a8e9f43f945 and project 17135327e2d14c4bbe4c7b242f9fda48. Resources: {'cores', 'instances', 'ram'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 21:54:14.938257 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-c75c5cf9-012a-4760-9e26-c93372fb7da5 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Going to run 1 instances... {{(pid=138744) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 21:54:14.940681 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-c75c5cf9-012a-4760-9e26-c93372fb7da5 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] [instance: d8a6a01e-c590-4005-8892-4bd894964374] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='085e4478-6edc-4a69-8e08-f9831713eb65',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138744) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 21:54:14.989660 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-c75c5cf9-012a-4760-9e26-c93372fb7da5 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.658845 Oct 22 21:54:14.990334 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3211/6452] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Oct 22 21:54:14 2022] POST /compute/v2.1/servers => generated 406 bytes in 660 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 21:54:15.002190 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-374f5912-7e87-4f03-8104-a4f4203f2587 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:54:15.002818 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-374f5912-7e87-4f03-8104-a4f4203f2587 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] [instance: d8a6a01e-c590-4005-8892-4bd894964374] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:54:15.060727 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-374f5912-7e87-4f03-8104-a4f4203f2587 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1a4da366004680b7330a8e9f43f945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17135327e2d14c4bbe4c7b242f9fda48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:54:15.068944 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-374f5912-7e87-4f03-8104-a4f4203f2587 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] 10.222.0.18 "GET /compute/v2.1/servers/d8a6a01e-c590-4005-8892-4bd894964374" status: 200 len: 1236 microversion: 2.1 time: 0.070648 Oct 22 21:54:15.069548 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3242/6453] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:54:14 2022] GET /compute/v2.1/servers/d8a6a01e-c590-4005-8892-4bd894964374 => generated 1236 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:54:16.094274 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-05d51d28-b028-4d5d-b3d9-89631604e0e8 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:54:16.094930 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-05d51d28-b028-4d5d-b3d9-89631604e0e8 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] [instance: d8a6a01e-c590-4005-8892-4bd894964374] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:54:16.101395 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-05d51d28-b028-4d5d-b3d9-89631604e0e8 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:54:16.101889 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-05d51d28-b028-4d5d-b3d9-89631604e0e8 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:54:16.102325 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-05d51d28-b028-4d5d-b3d9-89631604e0e8 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:54:16.103034 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-05d51d28-b028-4d5d-b3d9-89631604e0e8 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:54:16.103681 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-05d51d28-b028-4d5d-b3d9-89631604e0e8 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:54:16.104118 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-05d51d28-b028-4d5d-b3d9-89631604e0e8 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:54:16.182268 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-05d51d28-b028-4d5d-b3d9-89631604e0e8 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1a4da366004680b7330a8e9f43f945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17135327e2d14c4bbe4c7b242f9fda48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:54:16.194382 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-05d51d28-b028-4d5d-b3d9-89631604e0e8 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] 10.222.0.18 "GET /compute/v2.1/servers/d8a6a01e-c590-4005-8892-4bd894964374" status: 200 len: 1296 microversion: 2.1 time: 0.105279 Oct 22 21:54:16.196084 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3212/6454] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:54:16 2022] GET /compute/v2.1/servers/d8a6a01e-c590-4005-8892-4bd894964374 => generated 1296 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:54:17.220857 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-70d0f6cc-5574-4d7c-999e-4c2041f02716 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:54:17.221610 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-70d0f6cc-5574-4d7c-999e-4c2041f02716 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] [instance: d8a6a01e-c590-4005-8892-4bd894964374] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:54:17.231229 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-70d0f6cc-5574-4d7c-999e-4c2041f02716 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:54:17.231992 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-70d0f6cc-5574-4d7c-999e-4c2041f02716 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:54:17.232697 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-70d0f6cc-5574-4d7c-999e-4c2041f02716 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:54:17.233840 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-70d0f6cc-5574-4d7c-999e-4c2041f02716 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:54:17.234586 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-70d0f6cc-5574-4d7c-999e-4c2041f02716 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:54:17.235256 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-70d0f6cc-5574-4d7c-999e-4c2041f02716 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:54:17.374198 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-70d0f6cc-5574-4d7c-999e-4c2041f02716 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1a4da366004680b7330a8e9f43f945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17135327e2d14c4bbe4c7b242f9fda48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:54:17.382698 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-70d0f6cc-5574-4d7c-999e-4c2041f02716 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] 10.222.0.18 "GET /compute/v2.1/servers/d8a6a01e-c590-4005-8892-4bd894964374" status: 200 len: 1362 microversion: 2.1 time: 0.166319 Oct 22 21:54:17.383273 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3243/6455] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:54:17 2022] GET /compute/v2.1/servers/d8a6a01e-c590-4005-8892-4bd894964374 => generated 1362 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:54:17.605823 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-4757bd43-53f1-4307-9c23-f557bda51aec req-925c68e6-60f5-4883-8995-15792c88e5fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d8a6a01e-c590-4005-8892-4bd894964374", "tag": "af9d2bc9-5f04-460a-a416-edac9d0849f5"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:54:17.619914 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-4757bd43-53f1-4307-9c23-f557bda51aec req-925c68e6-60f5-4883-8995-15792c88e5fc service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:54:17.619914 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-4757bd43-53f1-4307-9c23-f557bda51aec req-925c68e6-60f5-4883-8995-15792c88e5fc service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:54:17.620300 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-4757bd43-53f1-4307-9c23-f557bda51aec req-925c68e6-60f5-4883-8995-15792c88e5fc service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:54:17.641213 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-4757bd43-53f1-4307-9c23-f557bda51aec req-925c68e6-60f5-4883-8995-15792c88e5fc service nova] Creating event network-changed:af9d2bc9-5f04-460a-a416-edac9d0849f5 for instance d8a6a01e-c590-4005-8892-4bd894964374 on nch1-master-1 Oct 22 21:54:17.647333 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-4757bd43-53f1-4307-9c23-f557bda51aec req-925c68e6-60f5-4883-8995-15792c88e5fc service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049661 Oct 22 21:54:17.648158 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3213/6456] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:54:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:54:18.406565 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-291572d6-bf36-474b-b7bb-863e57fb64f9 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:54:18.407191 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-291572d6-bf36-474b-b7bb-863e57fb64f9 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] [instance: d8a6a01e-c590-4005-8892-4bd894964374] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:54:18.414591 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-291572d6-bf36-474b-b7bb-863e57fb64f9 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:54:18.415104 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-291572d6-bf36-474b-b7bb-863e57fb64f9 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:54:18.415593 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-291572d6-bf36-474b-b7bb-863e57fb64f9 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:54:18.416355 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-291572d6-bf36-474b-b7bb-863e57fb64f9 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:54:18.416833 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-291572d6-bf36-474b-b7bb-863e57fb64f9 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:54:18.417282 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-291572d6-bf36-474b-b7bb-863e57fb64f9 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:54:18.550831 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-291572d6-bf36-474b-b7bb-863e57fb64f9 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1a4da366004680b7330a8e9f43f945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17135327e2d14c4bbe4c7b242f9fda48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:54:18.562528 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-291572d6-bf36-474b-b7bb-863e57fb64f9 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] 10.222.0.18 "GET /compute/v2.1/servers/d8a6a01e-c590-4005-8892-4bd894964374" status: 200 len: 1362 microversion: 2.1 time: 0.159738 Oct 22 21:54:18.563301 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3244/6457] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:54:18 2022] GET /compute/v2.1/servers/d8a6a01e-c590-4005-8892-4bd894964374 => generated 1362 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:54:19.595103 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-f86dbc5c-5305-4002-8dec-31ee5b9c1273 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:54:19.596075 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-f86dbc5c-5305-4002-8dec-31ee5b9c1273 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] [instance: d8a6a01e-c590-4005-8892-4bd894964374] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:54:19.599937 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:54:19.608767 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f86dbc5c-5305-4002-8dec-31ee5b9c1273 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:54:19.609547 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f86dbc5c-5305-4002-8dec-31ee5b9c1273 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:54:19.610150 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f86dbc5c-5305-4002-8dec-31ee5b9c1273 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:54:19.611083 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f86dbc5c-5305-4002-8dec-31ee5b9c1273 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:54:19.611726 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f86dbc5c-5305-4002-8dec-31ee5b9c1273 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:54:19.612306 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f86dbc5c-5305-4002-8dec-31ee5b9c1273 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:54:19.760241 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-f86dbc5c-5305-4002-8dec-31ee5b9c1273 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1a4da366004680b7330a8e9f43f945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17135327e2d14c4bbe4c7b242f9fda48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:54:19.768690 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-f86dbc5c-5305-4002-8dec-31ee5b9c1273 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] 10.222.0.18 "GET /compute/v2.1/servers/d8a6a01e-c590-4005-8892-4bd894964374" status: 200 len: 1362 microversion: 2.1 time: 0.180282 Oct 22 21:54:19.769267 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3214/6458] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:54:19 2022] GET /compute/v2.1/servers/d8a6a01e-c590-4005-8892-4bd894964374 => generated 1362 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:54:20.792897 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-d4fdf2fc-4b41-4266-86e9-e86cdf03fc84 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:54:20.793473 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-d4fdf2fc-4b41-4266-86e9-e86cdf03fc84 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] [instance: d8a6a01e-c590-4005-8892-4bd894964374] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:54:20.796518 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_api:SELECT=49 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:54:20.802061 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d4fdf2fc-4b41-4266-86e9-e86cdf03fc84 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:54:20.802565 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d4fdf2fc-4b41-4266-86e9-e86cdf03fc84 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:54:20.803048 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d4fdf2fc-4b41-4266-86e9-e86cdf03fc84 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:54:20.803791 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d4fdf2fc-4b41-4266-86e9-e86cdf03fc84 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:54:20.804262 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d4fdf2fc-4b41-4266-86e9-e86cdf03fc84 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:54:20.804708 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d4fdf2fc-4b41-4266-86e9-e86cdf03fc84 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:54:20.953747 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-d4fdf2fc-4b41-4266-86e9-e86cdf03fc84 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1a4da366004680b7330a8e9f43f945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17135327e2d14c4bbe4c7b242f9fda48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:54:20.961888 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-d4fdf2fc-4b41-4266-86e9-e86cdf03fc84 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] 10.222.0.18 "GET /compute/v2.1/servers/d8a6a01e-c590-4005-8892-4bd894964374" status: 200 len: 1362 microversion: 2.1 time: 0.173202 Oct 22 21:54:20.962481 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3245/6459] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:54:20 2022] GET /compute/v2.1/servers/d8a6a01e-c590-4005-8892-4bd894964374 => generated 1362 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:54:21.989502 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-2e548575-6b69-4611-9406-44f5c2176de8 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:54:21.990287 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-2e548575-6b69-4611-9406-44f5c2176de8 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] [instance: d8a6a01e-c590-4005-8892-4bd894964374] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:54:22.001730 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2e548575-6b69-4611-9406-44f5c2176de8 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:54:22.002677 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2e548575-6b69-4611-9406-44f5c2176de8 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:54:22.003267 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2e548575-6b69-4611-9406-44f5c2176de8 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:54:22.004254 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2e548575-6b69-4611-9406-44f5c2176de8 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:54:22.004859 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2e548575-6b69-4611-9406-44f5c2176de8 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:54:22.005586 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2e548575-6b69-4611-9406-44f5c2176de8 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:54:22.147964 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-2e548575-6b69-4611-9406-44f5c2176de8 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1a4da366004680b7330a8e9f43f945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17135327e2d14c4bbe4c7b242f9fda48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:54:22.156192 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-2e548575-6b69-4611-9406-44f5c2176de8 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] 10.222.0.18 "GET /compute/v2.1/servers/d8a6a01e-c590-4005-8892-4bd894964374" status: 200 len: 1362 microversion: 2.1 time: 0.172968 Oct 22 21:54:22.156761 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3215/6460] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:54:21 2022] GET /compute/v2.1/servers/d8a6a01e-c590-4005-8892-4bd894964374 => generated 1362 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:54:23.183115 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-0b53376c-e662-40a8-b914-aeeb5c11f11b tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:54:23.183771 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-0b53376c-e662-40a8-b914-aeeb5c11f11b tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] [instance: d8a6a01e-c590-4005-8892-4bd894964374] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:54:23.190622 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0b53376c-e662-40a8-b914-aeeb5c11f11b tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:54:23.191127 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0b53376c-e662-40a8-b914-aeeb5c11f11b tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:54:23.191618 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0b53376c-e662-40a8-b914-aeeb5c11f11b tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:54:23.192342 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0b53376c-e662-40a8-b914-aeeb5c11f11b tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:54:23.192814 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0b53376c-e662-40a8-b914-aeeb5c11f11b tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:54:23.193261 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0b53376c-e662-40a8-b914-aeeb5c11f11b tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:54:23.329619 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-0b53376c-e662-40a8-b914-aeeb5c11f11b tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1a4da366004680b7330a8e9f43f945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17135327e2d14c4bbe4c7b242f9fda48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:54:23.337828 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-0b53376c-e662-40a8-b914-aeeb5c11f11b tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] 10.222.0.18 "GET /compute/v2.1/servers/d8a6a01e-c590-4005-8892-4bd894964374" status: 200 len: 1362 microversion: 2.1 time: 0.161319 Oct 22 21:54:23.338489 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3246/6461] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:54:23 2022] GET /compute/v2.1/servers/d8a6a01e-c590-4005-8892-4bd894964374 => generated 1362 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:54:23.773683 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-e0c8c2a0-6362-476a-b295-68f4f153aa06 req-03701b98-ba1b-4c67-b3b2-2e13cd648ecc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8a6a01e-c590-4005-8892-4bd894964374", "name": "network-vif-plugged", "status": "completed", "tag": "af9d2bc9-5f04-460a-a416-edac9d0849f5"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:54:23.785471 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-e0c8c2a0-6362-476a-b295-68f4f153aa06 req-03701b98-ba1b-4c67-b3b2-2e13cd648ecc service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:54:23.786115 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-e0c8c2a0-6362-476a-b295-68f4f153aa06 req-03701b98-ba1b-4c67-b3b2-2e13cd648ecc service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:54:23.786550 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-e0c8c2a0-6362-476a-b295-68f4f153aa06 req-03701b98-ba1b-4c67-b3b2-2e13cd648ecc service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:54:23.798216 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-e0c8c2a0-6362-476a-b295-68f4f153aa06 req-03701b98-ba1b-4c67-b3b2-2e13cd648ecc service nova] Creating event network-vif-plugged:af9d2bc9-5f04-460a-a416-edac9d0849f5 for instance d8a6a01e-c590-4005-8892-4bd894964374 on nch1-master-1 Oct 22 21:54:23.803434 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-e0c8c2a0-6362-476a-b295-68f4f153aa06 req-03701b98-ba1b-4c67-b3b2-2e13cd648ecc service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033834 Oct 22 21:54:23.804122 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3216/6462] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:54:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:54:24.366210 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-4fd6310e-f022-4d79-b8fd-ed8141838aad tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:54:24.367284 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-4fd6310e-f022-4d79-b8fd-ed8141838aad tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] [instance: d8a6a01e-c590-4005-8892-4bd894964374] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:54:24.379850 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4fd6310e-f022-4d79-b8fd-ed8141838aad tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:54:24.380687 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4fd6310e-f022-4d79-b8fd-ed8141838aad tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:54:24.381443 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4fd6310e-f022-4d79-b8fd-ed8141838aad tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:54:24.382646 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4fd6310e-f022-4d79-b8fd-ed8141838aad tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:54:24.383530 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4fd6310e-f022-4d79-b8fd-ed8141838aad tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:54:24.384505 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4fd6310e-f022-4d79-b8fd-ed8141838aad tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:54:24.515752 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-4fd6310e-f022-4d79-b8fd-ed8141838aad tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1a4da366004680b7330a8e9f43f945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17135327e2d14c4bbe4c7b242f9fda48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:54:24.528718 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-4fd6310e-f022-4d79-b8fd-ed8141838aad tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] 10.222.0.18 "GET /compute/v2.1/servers/d8a6a01e-c590-4005-8892-4bd894964374" status: 200 len: 1362 microversion: 2.1 time: 0.169022 Oct 22 21:54:24.529345 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3247/6463] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:54:24 2022] GET /compute/v2.1/servers/d8a6a01e-c590-4005-8892-4bd894964374 => generated 1362 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:54:25.554945 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell0:SELECT=2 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:54:25.555772 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell0:SELECT=6 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:54:25.560084 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-823eaac5-fe04-4ffa-8bee-962421917dc1 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:54:25.560859 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-823eaac5-fe04-4ffa-8bee-962421917dc1 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] [instance: d8a6a01e-c590-4005-8892-4bd894964374] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:54:25.568007 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-823eaac5-fe04-4ffa-8bee-962421917dc1 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:54:25.568492 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-823eaac5-fe04-4ffa-8bee-962421917dc1 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:54:25.568925 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-823eaac5-fe04-4ffa-8bee-962421917dc1 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:54:25.569612 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-823eaac5-fe04-4ffa-8bee-962421917dc1 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:54:25.570061 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-823eaac5-fe04-4ffa-8bee-962421917dc1 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:54:25.570518 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-823eaac5-fe04-4ffa-8bee-962421917dc1 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:54:25.713356 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-823eaac5-fe04-4ffa-8bee-962421917dc1 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1a4da366004680b7330a8e9f43f945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17135327e2d14c4bbe4c7b242f9fda48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:54:25.721729 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-823eaac5-fe04-4ffa-8bee-962421917dc1 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] 10.222.0.18 "GET /compute/v2.1/servers/d8a6a01e-c590-4005-8892-4bd894964374" status: 200 len: 1550 microversion: 2.1 time: 0.168619 Oct 22 21:54:25.722309 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3217/6464] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:54:25 2022] GET /compute/v2.1/servers/d8a6a01e-c590-4005-8892-4bd894964374 => generated 1550 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:54:25.747446 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-b1b32853-fb78-46c2-ae55-cc83e8ab92df tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:54:25.748279 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-b1b32853-fb78-46c2-ae55-cc83e8ab92df tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] [instance: d8a6a01e-c590-4005-8892-4bd894964374] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:54:25.750967 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell0:SELECT=2 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:54:25.760068 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b1b32853-fb78-46c2-ae55-cc83e8ab92df tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:54:25.760526 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b1b32853-fb78-46c2-ae55-cc83e8ab92df tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:54:25.760982 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b1b32853-fb78-46c2-ae55-cc83e8ab92df tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:54:25.761722 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b1b32853-fb78-46c2-ae55-cc83e8ab92df tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:54:25.762201 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b1b32853-fb78-46c2-ae55-cc83e8ab92df tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:54:25.762641 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b1b32853-fb78-46c2-ae55-cc83e8ab92df tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:54:25.844904 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-b1b32853-fb78-46c2-ae55-cc83e8ab92df tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] 10.222.0.18 "GET /compute/v2.1/servers/d8a6a01e-c590-4005-8892-4bd894964374/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.103398 Oct 22 21:54:25.845991 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3248/6465] 10.222.0.18 () {58 vars in 1275 bytes} [Sat Oct 22 21:54:25 2022] GET /compute/v2.1/servers/d8a6a01e-c590-4005-8892-4bd894964374/os-interface => generated 285 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:54:26.824675 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-c7ca4da0-86f0-482e-8257-15f4a78201f6 req-fe126ee7-766b-4ea1-a1ad-946df404b55f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d8a6a01e-c590-4005-8892-4bd894964374", "tag": "af9d2bc9-5f04-460a-a416-edac9d0849f5"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:54:26.835151 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-c7ca4da0-86f0-482e-8257-15f4a78201f6 req-fe126ee7-766b-4ea1-a1ad-946df404b55f service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:54:26.835655 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-c7ca4da0-86f0-482e-8257-15f4a78201f6 req-fe126ee7-766b-4ea1-a1ad-946df404b55f service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:54:26.836093 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-c7ca4da0-86f0-482e-8257-15f4a78201f6 req-fe126ee7-766b-4ea1-a1ad-946df404b55f service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:54:26.848024 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-c7ca4da0-86f0-482e-8257-15f4a78201f6 req-fe126ee7-766b-4ea1-a1ad-946df404b55f service nova] Creating event network-changed:af9d2bc9-5f04-460a-a416-edac9d0849f5 for instance d8a6a01e-c590-4005-8892-4bd894964374 on nch1-master-1 Oct 22 21:54:26.853166 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-c7ca4da0-86f0-482e-8257-15f4a78201f6 req-fe126ee7-766b-4ea1-a1ad-946df404b55f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032406 Oct 22 21:54:26.853931 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3218/6466] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:54:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 21:55:28.565105 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_api:SELECT=7 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:55:28.566411 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell1:SELECT=38 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:55:28.573972 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-0d6fd154-fb72-47ad-87e5-13534ba66636 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:55:28.585757 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0d6fd154-fb72-47ad-87e5-13534ba66636 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:55:28.586549 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0d6fd154-fb72-47ad-87e5-13534ba66636 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:55:28.587392 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0d6fd154-fb72-47ad-87e5-13534ba66636 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:55:28.611372 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-0d6fd154-fb72-47ad-87e5-13534ba66636 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] [instance: d8a6a01e-c590-4005-8892-4bd894964374] Going to try to stop instance {{(pid=138745) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 22 21:55:28.658856 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-0d6fd154-fb72-47ad-87e5-13534ba66636 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] 10.222.0.18 "POST /compute/v2.1/servers/d8a6a01e-c590-4005-8892-4bd894964374/action" status: 202 len: 0 microversion: 2.1 time: 0.098953 Oct 22 21:55:28.659486 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3249/6467] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 21:55:28 2022] POST /compute/v2.1/servers/d8a6a01e-c590-4005-8892-4bd894964374/action => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 21:55:28.667187 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_api:SELECT=9 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:55:28.667994 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:SELECT=47,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:55:28.672800 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-f3c95e85-b09d-4c02-b749-b5e509c49ca7 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:55:28.673539 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-f3c95e85-b09d-4c02-b749-b5e509c49ca7 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] [instance: d8a6a01e-c590-4005-8892-4bd894964374] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:55:28.681421 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f3c95e85-b09d-4c02-b749-b5e509c49ca7 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:55:28.682059 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f3c95e85-b09d-4c02-b749-b5e509c49ca7 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:55:28.682507 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f3c95e85-b09d-4c02-b749-b5e509c49ca7 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:55:28.683226 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f3c95e85-b09d-4c02-b749-b5e509c49ca7 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:55:28.683711 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f3c95e85-b09d-4c02-b749-b5e509c49ca7 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:55:28.684148 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f3c95e85-b09d-4c02-b749-b5e509c49ca7 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:55:28.777524 ncdv-master-1 devstack@n-api.service[138744]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 22 21:55:28.777725 ncdv-master-1 devstack@n-api.service[138744]: Sat Oct 22 21:55:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d8a6a01e-c590-4005-8892-4bd894964374 (ip 10.222.0.18) !!! Oct 22 21:55:28.820721 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-f3c95e85-b09d-4c02-b749-b5e509c49ca7 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1a4da366004680b7330a8e9f43f945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17135327e2d14c4bbe4c7b242f9fda48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:55:28.829293 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-f3c95e85-b09d-4c02-b749-b5e509c49ca7 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] 10.222.0.18 "GET /compute/v2.1/servers/d8a6a01e-c590-4005-8892-4bd894964374" status: 200 len: 1679 microversion: 2.1 time: 0.165195 Oct 22 21:55:28.829864 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3219/6468] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:55:28 2022] GET /compute/v2.1/servers/d8a6a01e-c590-4005-8892-4bd894964374 => generated 1679 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:55:29.853998 ncdv-master-1 devstack@n-api.service[138745]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 22 21:55:29.854875 ncdv-master-1 devstack@n-api.service[138745]: Sat Oct 22 21:55:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d8a6a01e-c590-4005-8892-4bd894964374 (ip 10.222.0.18) !!! Oct 22 21:55:29.863189 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-ad04c02a-281b-405b-9eef-03e29d48621c tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:55:29.864420 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-ad04c02a-281b-405b-9eef-03e29d48621c tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] [instance: d8a6a01e-c590-4005-8892-4bd894964374] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:55:29.875729 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ad04c02a-281b-405b-9eef-03e29d48621c tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:55:29.876239 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ad04c02a-281b-405b-9eef-03e29d48621c tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:55:29.876693 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ad04c02a-281b-405b-9eef-03e29d48621c tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:55:29.877418 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ad04c02a-281b-405b-9eef-03e29d48621c tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:55:29.877894 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ad04c02a-281b-405b-9eef-03e29d48621c tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:55:29.878334 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ad04c02a-281b-405b-9eef-03e29d48621c tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:55:30.009581 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-ad04c02a-281b-405b-9eef-03e29d48621c tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1a4da366004680b7330a8e9f43f945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17135327e2d14c4bbe4c7b242f9fda48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:55:30.018372 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-ad04c02a-281b-405b-9eef-03e29d48621c tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] 10.222.0.18 "GET /compute/v2.1/servers/d8a6a01e-c590-4005-8892-4bd894964374" status: 200 len: 1679 microversion: 2.1 time: 0.166631 Oct 22 21:55:30.018956 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3250/6469] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:55:29 2022] GET /compute/v2.1/servers/d8a6a01e-c590-4005-8892-4bd894964374 => generated 1679 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:55:31.047321 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-4826b865-2317-45f4-ac87-d05df0a364dd tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:55:31.047917 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-4826b865-2317-45f4-ac87-d05df0a364dd tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] [instance: d8a6a01e-c590-4005-8892-4bd894964374] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:55:31.054868 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4826b865-2317-45f4-ac87-d05df0a364dd tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:55:31.055371 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4826b865-2317-45f4-ac87-d05df0a364dd tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:55:31.055853 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4826b865-2317-45f4-ac87-d05df0a364dd tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:55:31.056568 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4826b865-2317-45f4-ac87-d05df0a364dd tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:55:31.056985 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4826b865-2317-45f4-ac87-d05df0a364dd tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:55:31.057432 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4826b865-2317-45f4-ac87-d05df0a364dd tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:55:31.197045 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-4826b865-2317-45f4-ac87-d05df0a364dd tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1a4da366004680b7330a8e9f43f945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17135327e2d14c4bbe4c7b242f9fda48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:55:31.207649 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-4826b865-2317-45f4-ac87-d05df0a364dd tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] 10.222.0.18 "GET /compute/v2.1/servers/d8a6a01e-c590-4005-8892-4bd894964374" status: 200 len: 1679 microversion: 2.1 time: 0.164249 Oct 22 21:55:31.208437 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3220/6470] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:55:31 2022] GET /compute/v2.1/servers/d8a6a01e-c590-4005-8892-4bd894964374 => generated 1679 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:55:32.237953 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-5bcc597e-7bd3-4b17-8130-b58a12c9dc27 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:55:32.238950 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-5bcc597e-7bd3-4b17-8130-b58a12c9dc27 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] [instance: d8a6a01e-c590-4005-8892-4bd894964374] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:55:32.248494 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5bcc597e-7bd3-4b17-8130-b58a12c9dc27 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:55:32.248994 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5bcc597e-7bd3-4b17-8130-b58a12c9dc27 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:55:32.249451 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5bcc597e-7bd3-4b17-8130-b58a12c9dc27 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:55:32.250169 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5bcc597e-7bd3-4b17-8130-b58a12c9dc27 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:55:32.250632 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5bcc597e-7bd3-4b17-8130-b58a12c9dc27 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:55:32.251073 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5bcc597e-7bd3-4b17-8130-b58a12c9dc27 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:55:32.386634 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-5bcc597e-7bd3-4b17-8130-b58a12c9dc27 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1a4da366004680b7330a8e9f43f945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17135327e2d14c4bbe4c7b242f9fda48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:55:32.395046 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-5bcc597e-7bd3-4b17-8130-b58a12c9dc27 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] 10.222.0.18 "GET /compute/v2.1/servers/d8a6a01e-c590-4005-8892-4bd894964374" status: 200 len: 1679 microversion: 2.1 time: 0.166058 Oct 22 21:55:32.395638 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3251/6471] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:55:32 2022] GET /compute/v2.1/servers/d8a6a01e-c590-4005-8892-4bd894964374 => generated 1679 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:55:33.423264 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-61377988-24d9-4dab-8cae-b81107ae4957 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:55:33.424299 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-61377988-24d9-4dab-8cae-b81107ae4957 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] [instance: d8a6a01e-c590-4005-8892-4bd894964374] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:55:33.436312 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-61377988-24d9-4dab-8cae-b81107ae4957 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:55:33.437120 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-61377988-24d9-4dab-8cae-b81107ae4957 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:55:33.437855 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-61377988-24d9-4dab-8cae-b81107ae4957 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:55:33.439012 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-61377988-24d9-4dab-8cae-b81107ae4957 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:55:33.439821 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-61377988-24d9-4dab-8cae-b81107ae4957 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:55:33.440549 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-61377988-24d9-4dab-8cae-b81107ae4957 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:55:33.588045 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-61377988-24d9-4dab-8cae-b81107ae4957 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1a4da366004680b7330a8e9f43f945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17135327e2d14c4bbe4c7b242f9fda48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:55:33.597166 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-61377988-24d9-4dab-8cae-b81107ae4957 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] 10.222.0.18 "GET /compute/v2.1/servers/d8a6a01e-c590-4005-8892-4bd894964374" status: 200 len: 1679 microversion: 2.1 time: 0.180828 Oct 22 21:55:33.597747 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3221/6472] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:55:33 2022] GET /compute/v2.1/servers/d8a6a01e-c590-4005-8892-4bd894964374 => generated 1679 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:55:34.625222 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-15cfc081-864e-4698-a185-de6a3448641b tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:55:34.626132 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-15cfc081-864e-4698-a185-de6a3448641b tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] [instance: d8a6a01e-c590-4005-8892-4bd894964374] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:55:34.637972 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-15cfc081-864e-4698-a185-de6a3448641b tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:55:34.638846 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-15cfc081-864e-4698-a185-de6a3448641b tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:55:34.639649 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-15cfc081-864e-4698-a185-de6a3448641b tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:55:34.640872 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-15cfc081-864e-4698-a185-de6a3448641b tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:55:34.641651 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-15cfc081-864e-4698-a185-de6a3448641b tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:55:34.642434 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-15cfc081-864e-4698-a185-de6a3448641b tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:55:34.785412 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-15cfc081-864e-4698-a185-de6a3448641b tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1a4da366004680b7330a8e9f43f945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17135327e2d14c4bbe4c7b242f9fda48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:55:34.793908 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-15cfc081-864e-4698-a185-de6a3448641b tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] 10.222.0.18 "GET /compute/v2.1/servers/d8a6a01e-c590-4005-8892-4bd894964374" status: 200 len: 1679 microversion: 2.1 time: 0.175492 Oct 22 21:55:34.794508 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3252/6473] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:55:34 2022] GET /compute/v2.1/servers/d8a6a01e-c590-4005-8892-4bd894964374 => generated 1679 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:55:35.821189 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-3704fa87-f685-47f3-8542-aa5d97848791 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:55:35.822225 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-3704fa87-f685-47f3-8542-aa5d97848791 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] [instance: d8a6a01e-c590-4005-8892-4bd894964374] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:55:35.833945 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3704fa87-f685-47f3-8542-aa5d97848791 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:55:35.834748 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3704fa87-f685-47f3-8542-aa5d97848791 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:55:35.835517 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3704fa87-f685-47f3-8542-aa5d97848791 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:55:35.836659 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3704fa87-f685-47f3-8542-aa5d97848791 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:55:35.837415 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3704fa87-f685-47f3-8542-aa5d97848791 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:55:35.838141 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3704fa87-f685-47f3-8542-aa5d97848791 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:55:35.974983 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-3704fa87-f685-47f3-8542-aa5d97848791 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1a4da366004680b7330a8e9f43f945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17135327e2d14c4bbe4c7b242f9fda48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:55:35.983288 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-3704fa87-f685-47f3-8542-aa5d97848791 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] 10.222.0.18 "GET /compute/v2.1/servers/d8a6a01e-c590-4005-8892-4bd894964374" status: 200 len: 1679 microversion: 2.1 time: 0.168709 Oct 22 21:55:35.983873 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3222/6474] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:55:35 2022] GET /compute/v2.1/servers/d8a6a01e-c590-4005-8892-4bd894964374 => generated 1679 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:55:37.006549 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-c9a7be38-c3bb-479e-a192-f1119ab0abaa tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:55:37.007178 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-c9a7be38-c3bb-479e-a192-f1119ab0abaa tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] [instance: d8a6a01e-c590-4005-8892-4bd894964374] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:55:37.014778 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c9a7be38-c3bb-479e-a192-f1119ab0abaa tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:55:37.015285 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c9a7be38-c3bb-479e-a192-f1119ab0abaa tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:55:37.015773 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c9a7be38-c3bb-479e-a192-f1119ab0abaa tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:55:37.016491 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c9a7be38-c3bb-479e-a192-f1119ab0abaa tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:55:37.016965 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c9a7be38-c3bb-479e-a192-f1119ab0abaa tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:55:37.017409 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c9a7be38-c3bb-479e-a192-f1119ab0abaa tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:55:37.152040 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-c9a7be38-c3bb-479e-a192-f1119ab0abaa tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1a4da366004680b7330a8e9f43f945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17135327e2d14c4bbe4c7b242f9fda48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:55:37.160731 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-c9a7be38-c3bb-479e-a192-f1119ab0abaa tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] 10.222.0.18 "GET /compute/v2.1/servers/d8a6a01e-c590-4005-8892-4bd894964374" status: 200 len: 1679 microversion: 2.1 time: 0.158259 Oct 22 21:55:37.161310 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3253/6475] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:55:37 2022] GET /compute/v2.1/servers/d8a6a01e-c590-4005-8892-4bd894964374 => generated 1679 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:55:38.188514 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-2c0a962b-fb25-4884-a173-425157e50d39 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:55:38.189664 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-2c0a962b-fb25-4884-a173-425157e50d39 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] [instance: d8a6a01e-c590-4005-8892-4bd894964374] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:55:38.201245 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2c0a962b-fb25-4884-a173-425157e50d39 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:55:38.202049 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2c0a962b-fb25-4884-a173-425157e50d39 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:55:38.202784 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2c0a962b-fb25-4884-a173-425157e50d39 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:55:38.203993 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2c0a962b-fb25-4884-a173-425157e50d39 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:55:38.204807 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2c0a962b-fb25-4884-a173-425157e50d39 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:55:38.205526 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2c0a962b-fb25-4884-a173-425157e50d39 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:55:38.350729 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-2c0a962b-fb25-4884-a173-425157e50d39 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1a4da366004680b7330a8e9f43f945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17135327e2d14c4bbe4c7b242f9fda48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:55:38.363016 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-2c0a962b-fb25-4884-a173-425157e50d39 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] 10.222.0.18 "GET /compute/v2.1/servers/d8a6a01e-c590-4005-8892-4bd894964374" status: 200 len: 1679 microversion: 2.1 time: 0.180846 Oct 22 21:55:38.363810 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3223/6476] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:55:38 2022] GET /compute/v2.1/servers/d8a6a01e-c590-4005-8892-4bd894964374 => generated 1679 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:55:39.393668 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-96923390-c38d-419a-a394-1a19671528fc tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:55:39.394538 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-96923390-c38d-419a-a394-1a19671528fc tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] [instance: d8a6a01e-c590-4005-8892-4bd894964374] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:55:39.406494 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-96923390-c38d-419a-a394-1a19671528fc tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:55:39.407330 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-96923390-c38d-419a-a394-1a19671528fc tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:55:39.408144 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-96923390-c38d-419a-a394-1a19671528fc tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:55:39.409320 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-96923390-c38d-419a-a394-1a19671528fc tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:55:39.410118 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-96923390-c38d-419a-a394-1a19671528fc tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:55:39.410858 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-96923390-c38d-419a-a394-1a19671528fc tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:55:39.558515 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-96923390-c38d-419a-a394-1a19671528fc tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1a4da366004680b7330a8e9f43f945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17135327e2d14c4bbe4c7b242f9fda48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:55:39.566702 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-96923390-c38d-419a-a394-1a19671528fc tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] 10.222.0.18 "GET /compute/v2.1/servers/d8a6a01e-c590-4005-8892-4bd894964374" status: 200 len: 1656 microversion: 2.1 time: 0.179854 Oct 22 21:55:39.567284 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3254/6477] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:55:39 2022] GET /compute/v2.1/servers/d8a6a01e-c590-4005-8892-4bd894964374 => generated 1656 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:55:39.590020 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-b4a17aa9-9d01-4562-b516-d8b1b143d87a tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:55:39.592775 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-b4a17aa9-9d01-4562-b516-d8b1b143d87a tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] [instance: d8a6a01e-c590-4005-8892-4bd894964374] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:55:39.600420 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b4a17aa9-9d01-4562-b516-d8b1b143d87a tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:55:39.600943 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b4a17aa9-9d01-4562-b516-d8b1b143d87a tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:55:39.601382 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b4a17aa9-9d01-4562-b516-d8b1b143d87a tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:55:39.602078 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b4a17aa9-9d01-4562-b516-d8b1b143d87a tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:55:39.602530 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b4a17aa9-9d01-4562-b516-d8b1b143d87a tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:55:39.602955 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b4a17aa9-9d01-4562-b516-d8b1b143d87a tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:55:39.636987 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-b4a17aa9-9d01-4562-b516-d8b1b143d87a tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'ce1a4da366004680b7330a8e9f43f945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17135327e2d14c4bbe4c7b242f9fda48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:55:39.644366 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-b4a17aa9-9d01-4562-b516-d8b1b143d87a tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] [instance: d8a6a01e-c590-4005-8892-4bd894964374] Old instance type m1.heat2, new instance type m1.heat {{(pid=138744) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 22 21:55:39.652197 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-b4a17aa9-9d01-4562-b516-d8b1b143d87a tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Flavor limits 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 21:55:39.652624 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-b4a17aa9-9d01-4562-b516-d8b1b143d87a tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Image limits 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 21:55:39.653111 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-b4a17aa9-9d01-4562-b516-d8b1b143d87a tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Flavor pref 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 21:55:39.653530 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-b4a17aa9-9d01-4562-b516-d8b1b143d87a tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Image pref 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 21:55:39.653954 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-b4a17aa9-9d01-4562-b516-d8b1b143d87a tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 21:55:39.725855 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-b4a17aa9-9d01-4562-b516-d8b1b143d87a tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] 10.222.0.18 "POST /compute/v2.1/servers/d8a6a01e-c590-4005-8892-4bd894964374/action" status: 202 len: 0 microversion: 2.1 time: 0.140045 Oct 22 21:55:39.726506 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3224/6478] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 21:55:39 2022] POST /compute/v2.1/servers/d8a6a01e-c590-4005-8892-4bd894964374/action => generated 0 bytes in 141 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 21:55:39.734989 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-b89223e8-4afc-4c43-83cb-a87993250675 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:55:39.735767 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-b89223e8-4afc-4c43-83cb-a87993250675 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] [instance: d8a6a01e-c590-4005-8892-4bd894964374] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:55:39.742408 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b89223e8-4afc-4c43-83cb-a87993250675 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:55:39.742993 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b89223e8-4afc-4c43-83cb-a87993250675 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:55:39.743583 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b89223e8-4afc-4c43-83cb-a87993250675 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:55:39.744357 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b89223e8-4afc-4c43-83cb-a87993250675 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:55:39.745148 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b89223e8-4afc-4c43-83cb-a87993250675 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:55:39.745823 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b89223e8-4afc-4c43-83cb-a87993250675 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:55:39.880017 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-b89223e8-4afc-4c43-83cb-a87993250675 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1a4da366004680b7330a8e9f43f945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17135327e2d14c4bbe4c7b242f9fda48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:55:39.888264 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-b89223e8-4afc-4c43-83cb-a87993250675 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] 10.222.0.18 "GET /compute/v2.1/servers/d8a6a01e-c590-4005-8892-4bd894964374" status: 200 len: 1679 microversion: 2.1 time: 0.157246 Oct 22 21:55:39.889079 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3255/6479] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:55:39 2022] GET /compute/v2.1/servers/d8a6a01e-c590-4005-8892-4bd894964374 => generated 1679 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:55:40.913453 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-912f7129-f124-404e-ae52-81d4f7eeb3e5 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:55:40.914072 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-912f7129-f124-404e-ae52-81d4f7eeb3e5 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] [instance: d8a6a01e-c590-4005-8892-4bd894964374] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:55:40.921638 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-912f7129-f124-404e-ae52-81d4f7eeb3e5 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:55:40.922138 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-912f7129-f124-404e-ae52-81d4f7eeb3e5 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:55:40.922579 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-912f7129-f124-404e-ae52-81d4f7eeb3e5 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:55:40.923295 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-912f7129-f124-404e-ae52-81d4f7eeb3e5 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:55:40.923773 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-912f7129-f124-404e-ae52-81d4f7eeb3e5 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:55:40.924260 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-912f7129-f124-404e-ae52-81d4f7eeb3e5 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:55:41.071846 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-912f7129-f124-404e-ae52-81d4f7eeb3e5 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1a4da366004680b7330a8e9f43f945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17135327e2d14c4bbe4c7b242f9fda48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:55:41.079963 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-912f7129-f124-404e-ae52-81d4f7eeb3e5 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] 10.222.0.18 "GET /compute/v2.1/servers/d8a6a01e-c590-4005-8892-4bd894964374" status: 200 len: 1679 microversion: 2.1 time: 0.171456 Oct 22 21:55:41.080561 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3225/6480] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:55:40 2022] GET /compute/v2.1/servers/d8a6a01e-c590-4005-8892-4bd894964374 => generated 1679 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:55:42.108580 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-92e6a578-494e-400e-92e6-7e7a2529a79b tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:55:42.109435 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-92e6a578-494e-400e-92e6-7e7a2529a79b tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] [instance: d8a6a01e-c590-4005-8892-4bd894964374] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:55:42.120959 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-92e6a578-494e-400e-92e6-7e7a2529a79b tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:55:42.121488 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-92e6a578-494e-400e-92e6-7e7a2529a79b tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:55:42.121942 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-92e6a578-494e-400e-92e6-7e7a2529a79b tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:55:42.122656 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-92e6a578-494e-400e-92e6-7e7a2529a79b tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:55:42.123134 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-92e6a578-494e-400e-92e6-7e7a2529a79b tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:55:42.123621 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-92e6a578-494e-400e-92e6-7e7a2529a79b tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:55:42.265798 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-92e6a578-494e-400e-92e6-7e7a2529a79b tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1a4da366004680b7330a8e9f43f945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17135327e2d14c4bbe4c7b242f9fda48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:55:42.274166 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-92e6a578-494e-400e-92e6-7e7a2529a79b tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] 10.222.0.18 "GET /compute/v2.1/servers/d8a6a01e-c590-4005-8892-4bd894964374" status: 200 len: 1684 microversion: 2.1 time: 0.172613 Oct 22 21:55:42.274748 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3256/6481] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:55:42 2022] GET /compute/v2.1/servers/d8a6a01e-c590-4005-8892-4bd894964374 => generated 1684 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:55:43.302701 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-e7cd831e-7696-436a-ace1-c3bb25f0bdf9 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:55:43.303812 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-e7cd831e-7696-436a-ace1-c3bb25f0bdf9 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] [instance: d8a6a01e-c590-4005-8892-4bd894964374] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:55:43.312662 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e7cd831e-7696-436a-ace1-c3bb25f0bdf9 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:55:43.313153 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e7cd831e-7696-436a-ace1-c3bb25f0bdf9 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:55:43.313599 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e7cd831e-7696-436a-ace1-c3bb25f0bdf9 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:55:43.314312 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e7cd831e-7696-436a-ace1-c3bb25f0bdf9 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:55:43.314743 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e7cd831e-7696-436a-ace1-c3bb25f0bdf9 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:55:43.315210 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e7cd831e-7696-436a-ace1-c3bb25f0bdf9 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:55:43.454775 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-e7cd831e-7696-436a-ace1-c3bb25f0bdf9 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1a4da366004680b7330a8e9f43f945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17135327e2d14c4bbe4c7b242f9fda48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:55:43.463051 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-e7cd831e-7696-436a-ace1-c3bb25f0bdf9 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] 10.222.0.18 "GET /compute/v2.1/servers/d8a6a01e-c590-4005-8892-4bd894964374" status: 200 len: 1684 microversion: 2.1 time: 0.167070 Oct 22 21:55:43.463665 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3226/6482] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:55:43 2022] GET /compute/v2.1/servers/d8a6a01e-c590-4005-8892-4bd894964374 => generated 1684 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:55:44.349999 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-29e1e47b-dfff-4dc9-b554-5ed478d2c748 req-f537548a-8264-4887-bae9-9f969c84fad4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8a6a01e-c590-4005-8892-4bd894964374", "name": "network-vif-unplugged", "status": "completed", "tag": "af9d2bc9-5f04-460a-a416-edac9d0849f5"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:55:44.360790 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-29e1e47b-dfff-4dc9-b554-5ed478d2c748 req-f537548a-8264-4887-bae9-9f969c84fad4 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:55:44.361103 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-29e1e47b-dfff-4dc9-b554-5ed478d2c748 req-f537548a-8264-4887-bae9-9f969c84fad4 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:55:44.361549 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-29e1e47b-dfff-4dc9-b554-5ed478d2c748 req-f537548a-8264-4887-bae9-9f969c84fad4 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:55:44.373942 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-29e1e47b-dfff-4dc9-b554-5ed478d2c748 req-f537548a-8264-4887-bae9-9f969c84fad4 service nova] Creating event network-vif-unplugged:af9d2bc9-5f04-460a-a416-edac9d0849f5 for instance d8a6a01e-c590-4005-8892-4bd894964374 on nch2-master-1 Oct 22 21:55:44.379572 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [req-29e1e47b-dfff-4dc9-b554-5ed478d2c748 req-f537548a-8264-4887-bae9-9f969c84fad4 service nova] Instance d8a6a01e-c590-4005-8892-4bd894964374 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=138745) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 22 21:55:44.390982 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-29e1e47b-dfff-4dc9-b554-5ed478d2c748 req-f537548a-8264-4887-bae9-9f969c84fad4 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044738 Oct 22 21:55:44.391679 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3257/6483] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:55:44 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:55:44.486869 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-93d40115-4bdc-4256-96ba-0d16a5d8c1dd tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:55:44.487532 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-93d40115-4bdc-4256-96ba-0d16a5d8c1dd tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] [instance: d8a6a01e-c590-4005-8892-4bd894964374] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:55:44.494923 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-93d40115-4bdc-4256-96ba-0d16a5d8c1dd tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:55:44.495544 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-93d40115-4bdc-4256-96ba-0d16a5d8c1dd tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:55:44.496201 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-93d40115-4bdc-4256-96ba-0d16a5d8c1dd tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:55:44.496887 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-93d40115-4bdc-4256-96ba-0d16a5d8c1dd tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:55:44.497376 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-93d40115-4bdc-4256-96ba-0d16a5d8c1dd tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:55:44.497820 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-93d40115-4bdc-4256-96ba-0d16a5d8c1dd tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:55:44.722052 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-93d40115-4bdc-4256-96ba-0d16a5d8c1dd tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1a4da366004680b7330a8e9f43f945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17135327e2d14c4bbe4c7b242f9fda48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:55:44.730693 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-93d40115-4bdc-4256-96ba-0d16a5d8c1dd tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] 10.222.0.18 "GET /compute/v2.1/servers/d8a6a01e-c590-4005-8892-4bd894964374" status: 200 len: 1683 microversion: 2.1 time: 0.247845 Oct 22 21:55:44.731290 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3227/6484] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:55:44 2022] GET /compute/v2.1/servers/d8a6a01e-c590-4005-8892-4bd894964374 => generated 1683 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:55:45.760131 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-024657a1-e290-42a0-beaa-04f4cb6177d4 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:55:45.760780 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-024657a1-e290-42a0-beaa-04f4cb6177d4 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] [instance: d8a6a01e-c590-4005-8892-4bd894964374] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:55:45.769448 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-024657a1-e290-42a0-beaa-04f4cb6177d4 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:55:45.770026 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-024657a1-e290-42a0-beaa-04f4cb6177d4 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:55:45.770478 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-024657a1-e290-42a0-beaa-04f4cb6177d4 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:55:45.771172 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-024657a1-e290-42a0-beaa-04f4cb6177d4 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:55:45.771675 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-024657a1-e290-42a0-beaa-04f4cb6177d4 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:55:45.772118 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-024657a1-e290-42a0-beaa-04f4cb6177d4 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:55:45.916293 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-024657a1-e290-42a0-beaa-04f4cb6177d4 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1a4da366004680b7330a8e9f43f945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17135327e2d14c4bbe4c7b242f9fda48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:55:45.924616 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-024657a1-e290-42a0-beaa-04f4cb6177d4 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] 10.222.0.18 "GET /compute/v2.1/servers/d8a6a01e-c590-4005-8892-4bd894964374" status: 200 len: 1681 microversion: 2.1 time: 0.172974 Oct 22 21:55:45.925264 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3258/6485] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:55:45 2022] GET /compute/v2.1/servers/d8a6a01e-c590-4005-8892-4bd894964374 => generated 1681 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:55:46.429888 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-9fc0e28e-9cde-4cc1-ab07-a976cd6edab1 req-da7eeb9c-e2b1-468e-a046-ac4d1825c236 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d8a6a01e-c590-4005-8892-4bd894964374", "tag": "af9d2bc9-5f04-460a-a416-edac9d0849f5"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:55:46.442016 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-9fc0e28e-9cde-4cc1-ab07-a976cd6edab1 req-da7eeb9c-e2b1-468e-a046-ac4d1825c236 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:55:46.442495 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-9fc0e28e-9cde-4cc1-ab07-a976cd6edab1 req-da7eeb9c-e2b1-468e-a046-ac4d1825c236 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:55:46.442948 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-9fc0e28e-9cde-4cc1-ab07-a976cd6edab1 req-da7eeb9c-e2b1-468e-a046-ac4d1825c236 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:55:46.455014 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-9fc0e28e-9cde-4cc1-ab07-a976cd6edab1 req-da7eeb9c-e2b1-468e-a046-ac4d1825c236 service nova] Creating event network-changed:af9d2bc9-5f04-460a-a416-edac9d0849f5 for instance d8a6a01e-c590-4005-8892-4bd894964374 on nch2-master-1 Oct 22 21:55:46.460922 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [req-9fc0e28e-9cde-4cc1-ab07-a976cd6edab1 req-da7eeb9c-e2b1-468e-a046-ac4d1825c236 service nova] Instance d8a6a01e-c590-4005-8892-4bd894964374 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=138744) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 22 21:55:46.473195 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-9fc0e28e-9cde-4cc1-ab07-a976cd6edab1 req-da7eeb9c-e2b1-468e-a046-ac4d1825c236 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049723 Oct 22 21:55:46.473791 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3228/6486] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:55:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:55:46.948555 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-c382c98d-f68b-423a-a776-3f184459f2a4 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:55:46.949424 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-c382c98d-f68b-423a-a776-3f184459f2a4 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] [instance: d8a6a01e-c590-4005-8892-4bd894964374] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:55:46.959947 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c382c98d-f68b-423a-a776-3f184459f2a4 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:55:46.961917 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c382c98d-f68b-423a-a776-3f184459f2a4 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:55:46.962961 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c382c98d-f68b-423a-a776-3f184459f2a4 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:55:46.963730 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c382c98d-f68b-423a-a776-3f184459f2a4 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:55:46.964239 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c382c98d-f68b-423a-a776-3f184459f2a4 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:55:46.964647 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c382c98d-f68b-423a-a776-3f184459f2a4 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:55:47.551272 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-c382c98d-f68b-423a-a776-3f184459f2a4 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1a4da366004680b7330a8e9f43f945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17135327e2d14c4bbe4c7b242f9fda48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:55:47.560277 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-c382c98d-f68b-423a-a776-3f184459f2a4 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] 10.222.0.18 "GET /compute/v2.1/servers/d8a6a01e-c590-4005-8892-4bd894964374" status: 200 len: 1677 microversion: 2.1 time: 0.615743 Oct 22 21:55:47.560864 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3259/6487] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:55:46 2022] GET /compute/v2.1/servers/d8a6a01e-c590-4005-8892-4bd894964374 => generated 1677 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:55:47.588909 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-3c2e4e17-1c83-4558-a300-5e29045a49fe tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:55:47.589576 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-3c2e4e17-1c83-4558-a300-5e29045a49fe tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] [instance: d8a6a01e-c590-4005-8892-4bd894964374] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:55:47.596712 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3c2e4e17-1c83-4558-a300-5e29045a49fe tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:55:47.597204 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3c2e4e17-1c83-4558-a300-5e29045a49fe tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:55:47.597642 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3c2e4e17-1c83-4558-a300-5e29045a49fe tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:55:47.598349 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3c2e4e17-1c83-4558-a300-5e29045a49fe tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:55:47.598802 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3c2e4e17-1c83-4558-a300-5e29045a49fe tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:55:47.599233 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3c2e4e17-1c83-4558-a300-5e29045a49fe tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:55:47.666372 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-3c2e4e17-1c83-4558-a300-5e29045a49fe tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] 10.222.0.18 "POST /compute/v2.1/servers/d8a6a01e-c590-4005-8892-4bd894964374/action" status: 204 len: 0 microversion: 2.1 time: 0.082398 Oct 22 21:55:47.666968 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3229/6488] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 21:55:47 2022] POST /compute/v2.1/servers/d8a6a01e-c590-4005-8892-4bd894964374/action => generated 0 bytes in 84 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 21:55:47.675572 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-1d66ab4e-8fbd-4ee7-960f-384e00a766c1 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:55:47.676207 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-1d66ab4e-8fbd-4ee7-960f-384e00a766c1 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] [instance: d8a6a01e-c590-4005-8892-4bd894964374] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:55:47.682545 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1d66ab4e-8fbd-4ee7-960f-384e00a766c1 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:55:47.683508 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1d66ab4e-8fbd-4ee7-960f-384e00a766c1 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:55:47.683963 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1d66ab4e-8fbd-4ee7-960f-384e00a766c1 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:55:47.684894 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1d66ab4e-8fbd-4ee7-960f-384e00a766c1 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:55:47.685394 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1d66ab4e-8fbd-4ee7-960f-384e00a766c1 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:55:47.686012 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1d66ab4e-8fbd-4ee7-960f-384e00a766c1 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:55:47.878394 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-1d66ab4e-8fbd-4ee7-960f-384e00a766c1 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1a4da366004680b7330a8e9f43f945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17135327e2d14c4bbe4c7b242f9fda48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:55:47.886808 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-1d66ab4e-8fbd-4ee7-960f-384e00a766c1 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] 10.222.0.18 "GET /compute/v2.1/servers/d8a6a01e-c590-4005-8892-4bd894964374" status: 200 len: 1677 microversion: 2.1 time: 0.215094 Oct 22 21:55:47.887420 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3260/6489] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:55:47 2022] GET /compute/v2.1/servers/d8a6a01e-c590-4005-8892-4bd894964374 => generated 1677 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:55:48.911683 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-8ce1bc96-69ba-431c-a238-0b6571a9dcc8 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:55:48.912389 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-8ce1bc96-69ba-431c-a238-0b6571a9dcc8 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] [instance: d8a6a01e-c590-4005-8892-4bd894964374] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:55:48.918802 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8ce1bc96-69ba-431c-a238-0b6571a9dcc8 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:55:48.919296 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8ce1bc96-69ba-431c-a238-0b6571a9dcc8 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:55:48.919803 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8ce1bc96-69ba-431c-a238-0b6571a9dcc8 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:55:48.920510 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8ce1bc96-69ba-431c-a238-0b6571a9dcc8 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:55:48.920934 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8ce1bc96-69ba-431c-a238-0b6571a9dcc8 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:55:48.921369 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8ce1bc96-69ba-431c-a238-0b6571a9dcc8 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:55:49.059230 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-8ce1bc96-69ba-431c-a238-0b6571a9dcc8 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1a4da366004680b7330a8e9f43f945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17135327e2d14c4bbe4c7b242f9fda48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:55:49.067261 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-8ce1bc96-69ba-431c-a238-0b6571a9dcc8 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] 10.222.0.18 "GET /compute/v2.1/servers/d8a6a01e-c590-4005-8892-4bd894964374" status: 200 len: 1656 microversion: 2.1 time: 0.160877 Oct 22 21:55:49.067868 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3230/6490] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:55:48 2022] GET /compute/v2.1/servers/d8a6a01e-c590-4005-8892-4bd894964374 => generated 1656 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:55:49.089860 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-9a6ee9de-59b7-4d80-baad-5542f7754fd5 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:55:49.090554 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-9a6ee9de-59b7-4d80-baad-5542f7754fd5 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] [instance: d8a6a01e-c590-4005-8892-4bd894964374] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:55:49.098021 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9a6ee9de-59b7-4d80-baad-5542f7754fd5 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:55:49.098484 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9a6ee9de-59b7-4d80-baad-5542f7754fd5 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:55:49.098926 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9a6ee9de-59b7-4d80-baad-5542f7754fd5 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:55:49.099677 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9a6ee9de-59b7-4d80-baad-5542f7754fd5 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:55:49.100158 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9a6ee9de-59b7-4d80-baad-5542f7754fd5 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:55:49.100605 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9a6ee9de-59b7-4d80-baad-5542f7754fd5 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:55:49.238295 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-9a6ee9de-59b7-4d80-baad-5542f7754fd5 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1a4da366004680b7330a8e9f43f945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17135327e2d14c4bbe4c7b242f9fda48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:55:49.246756 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-9a6ee9de-59b7-4d80-baad-5542f7754fd5 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] 10.222.0.18 "GET /compute/v2.1/servers/d8a6a01e-c590-4005-8892-4bd894964374" status: 200 len: 1656 microversion: 2.1 time: 0.160881 Oct 22 21:55:49.247382 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3261/6491] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:55:49 2022] GET /compute/v2.1/servers/d8a6a01e-c590-4005-8892-4bd894964374 => generated 1656 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:55:49.277473 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-d9d5b486-2623-4b71-bac5-8a9078fedfac tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:55:49.284194 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d9d5b486-2623-4b71-bac5-8a9078fedfac tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:55:49.284688 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d9d5b486-2623-4b71-bac5-8a9078fedfac tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:55:49.285128 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d9d5b486-2623-4b71-bac5-8a9078fedfac tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:55:49.309556 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-d9d5b486-2623-4b71-bac5-8a9078fedfac tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] [instance: d8a6a01e-c590-4005-8892-4bd894964374] Going to try to start instance {{(pid=138744) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 22 21:55:49.359969 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-d9d5b486-2623-4b71-bac5-8a9078fedfac tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] 10.222.0.18 "POST /compute/v2.1/servers/d8a6a01e-c590-4005-8892-4bd894964374/action" status: 202 len: 0 microversion: 2.1 time: 0.088674 Oct 22 21:55:49.360558 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3231/6492] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 21:55:49 2022] POST /compute/v2.1/servers/d8a6a01e-c590-4005-8892-4bd894964374/action => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 21:55:49.370584 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-55a0d143-2ed2-4d11-8a87-d659c786d66f tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:55:49.371840 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-55a0d143-2ed2-4d11-8a87-d659c786d66f tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] [instance: d8a6a01e-c590-4005-8892-4bd894964374] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:55:49.378463 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-55a0d143-2ed2-4d11-8a87-d659c786d66f tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:55:49.378974 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-55a0d143-2ed2-4d11-8a87-d659c786d66f tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:55:49.379474 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-55a0d143-2ed2-4d11-8a87-d659c786d66f tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:55:49.380267 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-55a0d143-2ed2-4d11-8a87-d659c786d66f tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:55:49.380757 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-55a0d143-2ed2-4d11-8a87-d659c786d66f tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:55:49.381208 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-55a0d143-2ed2-4d11-8a87-d659c786d66f tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:55:49.553105 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-55a0d143-2ed2-4d11-8a87-d659c786d66f tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1a4da366004680b7330a8e9f43f945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17135327e2d14c4bbe4c7b242f9fda48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:55:49.561902 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-55a0d143-2ed2-4d11-8a87-d659c786d66f tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] 10.222.0.18 "GET /compute/v2.1/servers/d8a6a01e-c590-4005-8892-4bd894964374" status: 200 len: 1665 microversion: 2.1 time: 0.195236 Oct 22 21:55:49.563095 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3262/6493] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:55:49 2022] GET /compute/v2.1/servers/d8a6a01e-c590-4005-8892-4bd894964374 => generated 1665 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:55:50.590643 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-72a8cb92-1daa-4cf2-92aa-ea7050521d3c tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:55:50.591555 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-72a8cb92-1daa-4cf2-92aa-ea7050521d3c tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] [instance: d8a6a01e-c590-4005-8892-4bd894964374] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:55:50.601652 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-72a8cb92-1daa-4cf2-92aa-ea7050521d3c tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:55:50.602391 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-72a8cb92-1daa-4cf2-92aa-ea7050521d3c tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:55:50.603060 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-72a8cb92-1daa-4cf2-92aa-ea7050521d3c tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:55:50.604371 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-72a8cb92-1daa-4cf2-92aa-ea7050521d3c tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:55:50.605078 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-72a8cb92-1daa-4cf2-92aa-ea7050521d3c tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:55:50.605785 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-72a8cb92-1daa-4cf2-92aa-ea7050521d3c tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:55:50.624732 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:55:50.747522 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-72a8cb92-1daa-4cf2-92aa-ea7050521d3c tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1a4da366004680b7330a8e9f43f945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17135327e2d14c4bbe4c7b242f9fda48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:55:50.756012 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-72a8cb92-1daa-4cf2-92aa-ea7050521d3c tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] 10.222.0.18 "GET /compute/v2.1/servers/d8a6a01e-c590-4005-8892-4bd894964374" status: 200 len: 1669 microversion: 2.1 time: 0.173684 Oct 22 21:55:50.756600 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3232/6494] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:55:50 2022] GET /compute/v2.1/servers/d8a6a01e-c590-4005-8892-4bd894964374 => generated 1669 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:55:50.778865 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-28a864de-673d-4e59-abde-d78b0daefa10 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:55:50.779413 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-28a864de-673d-4e59-abde-d78b0daefa10 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] [instance: d8a6a01e-c590-4005-8892-4bd894964374] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:55:50.786939 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-28a864de-673d-4e59-abde-d78b0daefa10 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:55:50.787518 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-28a864de-673d-4e59-abde-d78b0daefa10 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:55:50.787979 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-28a864de-673d-4e59-abde-d78b0daefa10 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:55:50.788707 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-28a864de-673d-4e59-abde-d78b0daefa10 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:55:50.789190 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-28a864de-673d-4e59-abde-d78b0daefa10 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:55:50.789642 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-28a864de-673d-4e59-abde-d78b0daefa10 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:55:50.817811 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-28a864de-673d-4e59-abde-d78b0daefa10 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] [instance: d8a6a01e-c590-4005-8892-4bd894964374] Going to try to terminate instance {{(pid=138745) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 21:55:50.852381 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:55:50.902619 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-28a864de-673d-4e59-abde-d78b0daefa10 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] 10.222.0.18 "DELETE /compute/v2.1/servers/d8a6a01e-c590-4005-8892-4bd894964374" status: 204 len: 0 microversion: 2.1 time: 0.127525 Oct 22 21:55:50.903264 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3263/6495] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 21:55:50 2022] DELETE /compute/v2.1/servers/d8a6a01e-c590-4005-8892-4bd894964374 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 21:55:50.911875 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-f27e29bd-4165-4bba-85b1-ce5cea4b5337 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:55:50.912485 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-f27e29bd-4165-4bba-85b1-ce5cea4b5337 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] [instance: d8a6a01e-c590-4005-8892-4bd894964374] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:55:50.918593 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f27e29bd-4165-4bba-85b1-ce5cea4b5337 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:55:50.919103 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f27e29bd-4165-4bba-85b1-ce5cea4b5337 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:55:50.919645 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f27e29bd-4165-4bba-85b1-ce5cea4b5337 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:55:50.920368 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f27e29bd-4165-4bba-85b1-ce5cea4b5337 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:55:50.920819 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f27e29bd-4165-4bba-85b1-ce5cea4b5337 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:55:50.921245 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f27e29bd-4165-4bba-85b1-ce5cea4b5337 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:55:51.051686 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-f27e29bd-4165-4bba-85b1-ce5cea4b5337 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1a4da366004680b7330a8e9f43f945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17135327e2d14c4bbe4c7b242f9fda48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:55:51.059982 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-f27e29bd-4165-4bba-85b1-ce5cea4b5337 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] 10.222.0.18 "GET /compute/v2.1/servers/d8a6a01e-c590-4005-8892-4bd894964374" status: 200 len: 1675 microversion: 2.1 time: 0.151931 Oct 22 21:55:51.060542 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3233/6496] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:55:50 2022] GET /compute/v2.1/servers/d8a6a01e-c590-4005-8892-4bd894964374 => generated 1675 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:55:51.974942 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-43261e9b-3103-444d-ae1a-d2a18eeaec63 req-edfcd2d7-940a-4299-888e-d7a9cb88a706 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8a6a01e-c590-4005-8892-4bd894964374", "name": "network-vif-plugged", "status": "completed", "tag": "af9d2bc9-5f04-460a-a416-edac9d0849f5"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:55:51.986267 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-43261e9b-3103-444d-ae1a-d2a18eeaec63 req-edfcd2d7-940a-4299-888e-d7a9cb88a706 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:55:51.986804 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-43261e9b-3103-444d-ae1a-d2a18eeaec63 req-edfcd2d7-940a-4299-888e-d7a9cb88a706 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:55:51.987251 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-43261e9b-3103-444d-ae1a-d2a18eeaec63 req-edfcd2d7-940a-4299-888e-d7a9cb88a706 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:55:51.999681 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-43261e9b-3103-444d-ae1a-d2a18eeaec63 req-edfcd2d7-940a-4299-888e-d7a9cb88a706 service nova] Creating event network-vif-plugged:af9d2bc9-5f04-460a-a416-edac9d0849f5 for instance d8a6a01e-c590-4005-8892-4bd894964374 on nch2-master-1 Oct 22 21:55:52.005504 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-43261e9b-3103-444d-ae1a-d2a18eeaec63 req-edfcd2d7-940a-4299-888e-d7a9cb88a706 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034521 Oct 22 21:55:52.006446 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3264/6497] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:55:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:55:52.083992 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-54c56c0f-235b-4830-bc3c-f0d401538fb5 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:55:52.084608 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-54c56c0f-235b-4830-bc3c-f0d401538fb5 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] [instance: d8a6a01e-c590-4005-8892-4bd894964374] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:55:52.091807 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-54c56c0f-235b-4830-bc3c-f0d401538fb5 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:55:52.092638 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-54c56c0f-235b-4830-bc3c-f0d401538fb5 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:55:52.093087 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-54c56c0f-235b-4830-bc3c-f0d401538fb5 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:55:52.093784 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-54c56c0f-235b-4830-bc3c-f0d401538fb5 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:55:52.094242 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-54c56c0f-235b-4830-bc3c-f0d401538fb5 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:55:52.094673 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-54c56c0f-235b-4830-bc3c-f0d401538fb5 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:55:52.228628 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-54c56c0f-235b-4830-bc3c-f0d401538fb5 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1a4da366004680b7330a8e9f43f945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17135327e2d14c4bbe4c7b242f9fda48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:55:52.236908 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-54c56c0f-235b-4830-bc3c-f0d401538fb5 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] 10.222.0.18 "GET /compute/v2.1/servers/d8a6a01e-c590-4005-8892-4bd894964374" status: 200 len: 1675 microversion: 2.1 time: 0.156972 Oct 22 21:55:52.237517 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3234/6498] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:55:52 2022] GET /compute/v2.1/servers/d8a6a01e-c590-4005-8892-4bd894964374 => generated 1675 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:55:53.237350 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-d0d695c6-af47-4a11-ac5f-820f5950c14c req-aba665c0-2789-4b9a-abce-98ba1d175783 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8a6a01e-c590-4005-8892-4bd894964374", "name": "network-vif-deleted", "tag": "af9d2bc9-5f04-460a-a416-edac9d0849f5"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:55:53.250246 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-d0d695c6-af47-4a11-ac5f-820f5950c14c req-aba665c0-2789-4b9a-abce-98ba1d175783 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:55:53.251209 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-d0d695c6-af47-4a11-ac5f-820f5950c14c req-aba665c0-2789-4b9a-abce-98ba1d175783 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:55:53.251796 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-d0d695c6-af47-4a11-ac5f-820f5950c14c req-aba665c0-2789-4b9a-abce-98ba1d175783 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:55:53.262052 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-0e0a5f89-d8a0-42c4-ad6e-bf3aa71b9f7f tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:55:53.262746 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-0e0a5f89-d8a0-42c4-ad6e-bf3aa71b9f7f tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] [instance: d8a6a01e-c590-4005-8892-4bd894964374] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:55:53.270710 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0e0a5f89-d8a0-42c4-ad6e-bf3aa71b9f7f tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:55:53.271241 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0e0a5f89-d8a0-42c4-ad6e-bf3aa71b9f7f tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:55:53.272077 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0e0a5f89-d8a0-42c4-ad6e-bf3aa71b9f7f tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:55:53.272873 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0e0a5f89-d8a0-42c4-ad6e-bf3aa71b9f7f tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:55:53.273381 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0e0a5f89-d8a0-42c4-ad6e-bf3aa71b9f7f tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:55:53.273523 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-d0d695c6-af47-4a11-ac5f-820f5950c14c req-aba665c0-2789-4b9a-abce-98ba1d175783 service nova] Creating event network-vif-deleted:af9d2bc9-5f04-460a-a416-edac9d0849f5 for instance d8a6a01e-c590-4005-8892-4bd894964374 on nch2-master-1 Oct 22 21:55:53.273995 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0e0a5f89-d8a0-42c4-ad6e-bf3aa71b9f7f tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:55:53.281031 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-d0d695c6-af47-4a11-ac5f-820f5950c14c req-aba665c0-2789-4b9a-abce-98ba1d175783 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048522 Oct 22 21:55:53.282525 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3265/6499] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:55:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:55:53.345967 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-0e0a5f89-d8a0-42c4-ad6e-bf3aa71b9f7f tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1a4da366004680b7330a8e9f43f945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17135327e2d14c4bbe4c7b242f9fda48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:55:53.354738 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-0e0a5f89-d8a0-42c4-ad6e-bf3aa71b9f7f tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] 10.222.0.18 "GET /compute/v2.1/servers/d8a6a01e-c590-4005-8892-4bd894964374" status: 200 len: 1321 microversion: 2.1 time: 0.098099 Oct 22 21:55:53.355315 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3235/6500] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:55:53 2022] GET /compute/v2.1/servers/d8a6a01e-c590-4005-8892-4bd894964374 => generated 1321 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:55:54.384915 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-546b5e63-9bfc-4512-ab12-6c1d443e40dd tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:55:54.385894 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-546b5e63-9bfc-4512-ab12-6c1d443e40dd tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] [instance: d8a6a01e-c590-4005-8892-4bd894964374] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:55:54.393397 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-546b5e63-9bfc-4512-ab12-6c1d443e40dd tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:55:54.393894 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-546b5e63-9bfc-4512-ab12-6c1d443e40dd tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:55:54.394342 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-546b5e63-9bfc-4512-ab12-6c1d443e40dd tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:55:54.395046 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-546b5e63-9bfc-4512-ab12-6c1d443e40dd tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:55:54.395561 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-546b5e63-9bfc-4512-ab12-6c1d443e40dd tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:55:54.396004 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-546b5e63-9bfc-4512-ab12-6c1d443e40dd tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:55:54.412718 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.wsgi [None req-546b5e63-9bfc-4512-ab12-6c1d443e40dd tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] HTTP exception thrown: Instance d8a6a01e-c590-4005-8892-4bd894964374 could not be found. Oct 22 21:55:54.414346 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-546b5e63-9bfc-4512-ab12-6c1d443e40dd tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Request method failure captured: Oct 22 21:55:54.414346 ncdv-master-1 devstack@n-api.service[138745]: request: GET /compute/v2.1/servers/d8a6a01e-c590-4005-8892-4bd894964374 HTTP/1.1 Oct 22 21:55:54.414346 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 21:55:54.414346 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 21:55:54.414346 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 21:55:54.414346 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 0 Oct 22 21:55:54.414346 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 21:55:54.414346 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 21:55:54.414346 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 21:55:54.414346 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 21:55:54.414346 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVGYfDlcA9KGX2QlEp4u0j0Sc-lLfggp70EjXb3-sPhTyz6zB5UiJn8D5kqopVhrN_VN9rM0kOlrwARqwadQ16Olp9k3UgVUKiPcvbjWntYV4vZGIhwWOxDtvedxf_ou8I06I86O9hYoH_RNiO9r53LOOM9uLYhVbGc37T_1RXkzoTZs Oct 22 21:55:54.414346 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 21:55:54.414346 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 21:55:54.414346 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 21:55:54.414346 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 21:55:54.414346 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 21:55:54.414346 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 21:55:54.414346 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: 17135327e2d14c4bbe4c7b242f9fda48 Oct 22 21:55:54.414346 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-ServerActionsTestJSON-1985295999 Oct 22 21:55:54.414346 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 21:55:54.414346 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 21:55:54.414346 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_17135327e2d14c4bbe4c7b242f9fda48"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/17135327e2d14c4bbe4c7b242f9fda48"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/17135327e2d14c4bbe4c7b242f9fda48"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/17135327e2d14c4bbe4c7b242f9fda48"}]}] Oct 22 21:55:54.414346 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-ServerActionsTestJSON-1985295999 Oct 22 21:55:54.414346 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: 17135327e2d14c4bbe4c7b242f9fda48 Oct 22 21:55:54.414346 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-ServerActionsTestJSON-1985295999 Oct 22 21:55:54.414346 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-ServerActionsTestJSON-1985295999-project Oct 22 21:55:54.414346 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 21:55:54.414346 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 21:55:54.414346 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: ce1a4da366004680b7330a8e9f43f945 Oct 22 21:55:54.414346 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-ServerActionsTestJSON-1985295999-project Oct 22 21:55:54.414346 ncdv-master-1 devstack@n-api.service[138745]: method: > Oct 22 21:55:54.414346 ncdv-master-1 devstack@n-api.service[138745]: exception: Instance d8a6a01e-c590-4005-8892-4bd894964374 could not be found. Oct 22 21:55:54.414346 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'id': 'd8a6a01e-c590-4005-8892-4bd894964374'} Oct 22 21:55:54.414346 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:55:54.414346 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:55:54.414346 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 21:55:54.414346 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 21:55:54.414346 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 21:55:54.414346 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 21:55:54.414346 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 21:55:54.414346 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 21:55:54.414346 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 21:55:54.414346 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 21:55:54.414346 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d8a6a01e-c590-4005-8892-4bd894964374 could not be found. Oct 22 21:55:54.414346 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:55:54.414346 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:55:54.414346 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:55:54.414346 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:55:54.414346 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:55:54.414346 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:55:54.414346 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:55:54.414346 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:55:54.414346 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:55:54.414346 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:55:54.414346 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 21:55:54.414346 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 21:55:54.414346 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 21:55:54.414346 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 21:55:54.414346 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 21:55:54.414346 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:55:54.414346 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d8a6a01e-c590-4005-8892-4bd894964374 could not be found. Oct 22 21:55:54.414346 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:55:54.414346 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:55:54.414346 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:55:54.419598 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:55:54.419598 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:55:54.419598 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:55:54.419598 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:55:54.419598 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:55:54.419598 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d8a6a01e-c590-4005-8892-4bd894964374 could not be found. Oct 22 21:55:54.419598 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:55:54.419598 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-546b5e63-9bfc-4512-ab12-6c1d443e40dd tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Returning 404 to user: Instance d8a6a01e-c590-4005-8892-4bd894964374 could not be found. {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:55:54.419598 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-546b5e63-9bfc-4512-ab12-6c1d443e40dd tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] 10.222.0.18 "GET /compute/v2.1/servers/d8a6a01e-c590-4005-8892-4bd894964374" status: 404 len: 111 microversion: 2.1 time: 0.039727 Oct 22 21:55:54.419598 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3266/6501] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:55:54 2022] GET /compute/v2.1/servers/d8a6a01e-c590-4005-8892-4bd894964374 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 21:55:54.433198 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-49d71c81-a8e3-45ad-bf0a-3a90a1288b95 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:55:54.433813 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-49d71c81-a8e3-45ad-bf0a-3a90a1288b95 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] [instance: d8a6a01e-c590-4005-8892-4bd894964374] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:55:54.441373 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-49d71c81-a8e3-45ad-bf0a-3a90a1288b95 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:55:54.441877 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-49d71c81-a8e3-45ad-bf0a-3a90a1288b95 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:55:54.442285 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-49d71c81-a8e3-45ad-bf0a-3a90a1288b95 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:55:54.442991 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-49d71c81-a8e3-45ad-bf0a-3a90a1288b95 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:55:54.443539 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-49d71c81-a8e3-45ad-bf0a-3a90a1288b95 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:55:54.443976 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-49d71c81-a8e3-45ad-bf0a-3a90a1288b95 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:55:54.458458 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-49d71c81-a8e3-45ad-bf0a-3a90a1288b95 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] HTTP exception thrown: Instance d8a6a01e-c590-4005-8892-4bd894964374 could not be found. Oct 22 21:55:54.460154 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-49d71c81-a8e3-45ad-bf0a-3a90a1288b95 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Request method failure captured: Oct 22 21:55:54.460154 ncdv-master-1 devstack@n-api.service[138744]: request: GET /compute/v2.1/servers/d8a6a01e-c590-4005-8892-4bd894964374 HTTP/1.1 Oct 22 21:55:54.460154 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 21:55:54.460154 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 21:55:54.460154 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 21:55:54.460154 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 0 Oct 22 21:55:54.460154 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 21:55:54.460154 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 21:55:54.460154 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 21:55:54.460154 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 21:55:54.460154 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVGYfDlcA9KGX2QlEp4u0j0Sc-lLfggp70EjXb3-sPhTyz6zB5UiJn8D5kqopVhrN_VN9rM0kOlrwARqwadQ16Olp9k3UgVUKiPcvbjWntYV4vZGIhwWOxDtvedxf_ou8I06I86O9hYoH_RNiO9r53LOOM9uLYhVbGc37T_1RXkzoTZs Oct 22 21:55:54.460154 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 21:55:54.460154 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 21:55:54.460154 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 21:55:54.460154 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 21:55:54.460154 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 21:55:54.460154 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 21:55:54.460154 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: 17135327e2d14c4bbe4c7b242f9fda48 Oct 22 21:55:54.460154 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-ServerActionsTestJSON-1985295999 Oct 22 21:55:54.460154 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 21:55:54.460154 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 21:55:54.460154 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_17135327e2d14c4bbe4c7b242f9fda48"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/17135327e2d14c4bbe4c7b242f9fda48"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/17135327e2d14c4bbe4c7b242f9fda48"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/17135327e2d14c4bbe4c7b242f9fda48"}]}] Oct 22 21:55:54.460154 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-ServerActionsTestJSON-1985295999 Oct 22 21:55:54.460154 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: 17135327e2d14c4bbe4c7b242f9fda48 Oct 22 21:55:54.460154 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-ServerActionsTestJSON-1985295999 Oct 22 21:55:54.460154 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-ServerActionsTestJSON-1985295999-project Oct 22 21:55:54.460154 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 21:55:54.460154 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 21:55:54.460154 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: ce1a4da366004680b7330a8e9f43f945 Oct 22 21:55:54.460154 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-ServerActionsTestJSON-1985295999-project Oct 22 21:55:54.460154 ncdv-master-1 devstack@n-api.service[138744]: method: > Oct 22 21:55:54.460154 ncdv-master-1 devstack@n-api.service[138744]: exception: Instance d8a6a01e-c590-4005-8892-4bd894964374 could not be found. Oct 22 21:55:54.460154 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': 'd8a6a01e-c590-4005-8892-4bd894964374'} Oct 22 21:55:54.460154 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:55:54.460154 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:55:54.460154 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 21:55:54.460154 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 21:55:54.460154 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 21:55:54.460154 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 21:55:54.460154 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 21:55:54.460154 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 21:55:54.460154 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 21:55:54.460154 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 21:55:54.460154 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d8a6a01e-c590-4005-8892-4bd894964374 could not be found. Oct 22 21:55:54.460154 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:55:54.460154 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:55:54.460154 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:55:54.460154 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:55:54.460154 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:55:54.460154 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:55:54.460154 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:55:54.460154 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:55:54.460154 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:55:54.460154 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:55:54.460154 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 21:55:54.460154 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 21:55:54.460154 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 21:55:54.460154 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 21:55:54.460154 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 21:55:54.460154 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:55:54.460154 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d8a6a01e-c590-4005-8892-4bd894964374 could not be found. Oct 22 21:55:54.460154 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:55:54.460154 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:55:54.460154 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:55:54.465159 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:55:54.465159 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:55:54.465159 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:55:54.465159 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:55:54.465159 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:55:54.465159 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d8a6a01e-c590-4005-8892-4bd894964374 could not be found. Oct 22 21:55:54.465159 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:55:54.465159 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-49d71c81-a8e3-45ad-bf0a-3a90a1288b95 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Returning 404 to user: Instance d8a6a01e-c590-4005-8892-4bd894964374 could not be found. {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:55:54.465159 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-49d71c81-a8e3-45ad-bf0a-3a90a1288b95 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] 10.222.0.18 "GET /compute/v2.1/servers/d8a6a01e-c590-4005-8892-4bd894964374" status: 404 len: 111 microversion: 2.1 time: 0.032496 Oct 22 21:55:54.465159 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3236/6502] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:55:54 2022] GET /compute/v2.1/servers/d8a6a01e-c590-4005-8892-4bd894964374 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 21:55:54.513584 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-0162e9b9-f893-449e-9a34-eaf34e11fb90 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-20446640", "imageRef": "085e4478-6edc-4a69-8e08-f9831713eb65", "flavorRef": "452", "networks": [{"uuid": "c97efc9f-8481-439f-aa41-fc8c07627ab3"}], "security_groups": [{"name": "tempest-securitygroup--1780263140"}], "key_name": "tempest-keypair-52095379", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:55:54.621531 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.network.neutron [None req-0162e9b9-f893-449e-9a34-eaf34e11fb90 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] validate_networks() for [('c97efc9f-8481-439f-aa41-fc8c07627ab3', None, None, None, None, None)] {{(pid=138745) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 21:55:55.073353 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-0162e9b9-f893-449e-9a34-eaf34e11fb90 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Flavor limits 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 21:55:55.073773 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-0162e9b9-f893-449e-9a34-eaf34e11fb90 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Image limits 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 21:55:55.074264 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-0162e9b9-f893-449e-9a34-eaf34e11fb90 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Flavor pref 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 21:55:55.074687 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-0162e9b9-f893-449e-9a34-eaf34e11fb90 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Image pref 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 21:55:55.075112 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-0162e9b9-f893-449e-9a34-eaf34e11fb90 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 21:55:55.084707 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0162e9b9-f893-449e-9a34-eaf34e11fb90 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:55:55.085204 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0162e9b9-f893-449e-9a34-eaf34e11fb90 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:55:55.085659 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0162e9b9-f893-449e-9a34-eaf34e11fb90 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:55:55.086401 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0162e9b9-f893-449e-9a34-eaf34e11fb90 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:55:55.086873 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0162e9b9-f893-449e-9a34-eaf34e11fb90 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:55:55.087314 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0162e9b9-f893-449e-9a34-eaf34e11fb90 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:55:55.105041 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-0162e9b9-f893-449e-9a34-eaf34e11fb90 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Getting quotas for project 17135327e2d14c4bbe4c7b242f9fda48. Resources: {'cores', 'instances', 'ram'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 21:55:55.110431 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-0162e9b9-f893-449e-9a34-eaf34e11fb90 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Getting quotas for user ce1a4da366004680b7330a8e9f43f945 and project 17135327e2d14c4bbe4c7b242f9fda48. Resources: {'cores', 'instances', 'ram'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 21:55:55.123073 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-0162e9b9-f893-449e-9a34-eaf34e11fb90 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Going to run 1 instances... {{(pid=138745) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 21:55:55.125640 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-0162e9b9-f893-449e-9a34-eaf34e11fb90 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] [instance: 7c3f6786-1255-40f9-b54a-3e42c7799c4e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='085e4478-6edc-4a69-8e08-f9831713eb65',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138745) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 21:55:55.181323 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-0162e9b9-f893-449e-9a34-eaf34e11fb90 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.671725 Oct 22 21:55:55.181975 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3267/6503] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Oct 22 21:55:54 2022] POST /compute/v2.1/servers => generated 406 bytes in 673 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 21:55:55.193628 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-00e291b8-3bd5-4598-b40c-2b6d6ae2ae5d tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:55:55.194246 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-00e291b8-3bd5-4598-b40c-2b6d6ae2ae5d tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] [instance: 7c3f6786-1255-40f9-b54a-3e42c7799c4e] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:55:55.255195 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-00e291b8-3bd5-4598-b40c-2b6d6ae2ae5d tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1a4da366004680b7330a8e9f43f945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17135327e2d14c4bbe4c7b242f9fda48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:55:55.262656 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-00e291b8-3bd5-4598-b40c-2b6d6ae2ae5d tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] 10.222.0.18 "GET /compute/v2.1/servers/7c3f6786-1255-40f9-b54a-3e42c7799c4e" status: 200 len: 1235 microversion: 2.1 time: 0.072912 Oct 22 21:55:55.263229 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3237/6504] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:55:55 2022] GET /compute/v2.1/servers/7c3f6786-1255-40f9-b54a-3e42c7799c4e => generated 1235 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:55:56.287828 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-6a73c578-c4ef-487d-9046-f95c837608ec tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:55:56.288658 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-6a73c578-c4ef-487d-9046-f95c837608ec tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] [instance: 7c3f6786-1255-40f9-b54a-3e42c7799c4e] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:55:56.296270 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6a73c578-c4ef-487d-9046-f95c837608ec tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:55:56.297002 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6a73c578-c4ef-487d-9046-f95c837608ec tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:55:56.297642 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6a73c578-c4ef-487d-9046-f95c837608ec tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:55:56.298538 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6a73c578-c4ef-487d-9046-f95c837608ec tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:55:56.299124 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6a73c578-c4ef-487d-9046-f95c837608ec tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:55:56.299703 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6a73c578-c4ef-487d-9046-f95c837608ec tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:55:56.369410 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-6a73c578-c4ef-487d-9046-f95c837608ec tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1a4da366004680b7330a8e9f43f945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17135327e2d14c4bbe4c7b242f9fda48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:55:56.377572 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-6a73c578-c4ef-487d-9046-f95c837608ec tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] 10.222.0.18 "GET /compute/v2.1/servers/7c3f6786-1255-40f9-b54a-3e42c7799c4e" status: 200 len: 1305 microversion: 2.1 time: 0.095341 Oct 22 21:55:56.378367 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3268/6505] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:55:56 2022] GET /compute/v2.1/servers/7c3f6786-1255-40f9-b54a-3e42c7799c4e => generated 1305 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:55:57.402425 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-07b5d99e-f5c5-4a36-b109-99086b92192f tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:55:57.403113 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-07b5d99e-f5c5-4a36-b109-99086b92192f tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] [instance: 7c3f6786-1255-40f9-b54a-3e42c7799c4e] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:55:57.412415 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-07b5d99e-f5c5-4a36-b109-99086b92192f tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:55:57.412950 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-07b5d99e-f5c5-4a36-b109-99086b92192f tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:55:57.413631 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-07b5d99e-f5c5-4a36-b109-99086b92192f tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:55:57.414517 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-07b5d99e-f5c5-4a36-b109-99086b92192f tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:55:57.415027 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-07b5d99e-f5c5-4a36-b109-99086b92192f tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:55:57.415486 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-07b5d99e-f5c5-4a36-b109-99086b92192f tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:55:57.547857 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-07b5d99e-f5c5-4a36-b109-99086b92192f tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1a4da366004680b7330a8e9f43f945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17135327e2d14c4bbe4c7b242f9fda48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:55:57.556003 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-07b5d99e-f5c5-4a36-b109-99086b92192f tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] 10.222.0.18 "GET /compute/v2.1/servers/7c3f6786-1255-40f9-b54a-3e42c7799c4e" status: 200 len: 1361 microversion: 2.1 time: 0.158466 Oct 22 21:55:57.556641 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3238/6506] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:55:57 2022] GET /compute/v2.1/servers/7c3f6786-1255-40f9-b54a-3e42c7799c4e => generated 1361 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:55:57.959298 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-66b426f8-e14c-4851-b71b-8546ca0ddafb req-c5956799-2695-4733-8cf0-3a944ed8083e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c3f6786-1255-40f9-b54a-3e42c7799c4e", "tag": "a30cb8aa-b665-4130-906a-6253e52bf9b0"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:55:57.984657 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-66b426f8-e14c-4851-b71b-8546ca0ddafb req-c5956799-2695-4733-8cf0-3a944ed8083e service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:55:57.985500 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-66b426f8-e14c-4851-b71b-8546ca0ddafb req-c5956799-2695-4733-8cf0-3a944ed8083e service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:55:57.986254 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-66b426f8-e14c-4851-b71b-8546ca0ddafb req-c5956799-2695-4733-8cf0-3a944ed8083e service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:55:58.002312 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-66b426f8-e14c-4851-b71b-8546ca0ddafb req-c5956799-2695-4733-8cf0-3a944ed8083e service nova] Creating event network-changed:a30cb8aa-b665-4130-906a-6253e52bf9b0 for instance 7c3f6786-1255-40f9-b54a-3e42c7799c4e on nch1-master-1 Oct 22 21:55:58.007295 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-66b426f8-e14c-4851-b71b-8546ca0ddafb req-c5956799-2695-4733-8cf0-3a944ed8083e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052191 Oct 22 21:55:58.008307 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3269/6507] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:55:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:55:58.581269 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-bc93c761-9b40-48a1-a5f4-1aaf0f4b6df6 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:55:58.581944 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-bc93c761-9b40-48a1-a5f4-1aaf0f4b6df6 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] [instance: 7c3f6786-1255-40f9-b54a-3e42c7799c4e] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:55:58.589407 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bc93c761-9b40-48a1-a5f4-1aaf0f4b6df6 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:55:58.590162 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bc93c761-9b40-48a1-a5f4-1aaf0f4b6df6 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:55:58.590606 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bc93c761-9b40-48a1-a5f4-1aaf0f4b6df6 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:55:58.591278 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bc93c761-9b40-48a1-a5f4-1aaf0f4b6df6 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:55:58.591771 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bc93c761-9b40-48a1-a5f4-1aaf0f4b6df6 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:55:58.592543 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bc93c761-9b40-48a1-a5f4-1aaf0f4b6df6 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:55:58.746278 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-bc93c761-9b40-48a1-a5f4-1aaf0f4b6df6 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1a4da366004680b7330a8e9f43f945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17135327e2d14c4bbe4c7b242f9fda48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:55:58.754633 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-bc93c761-9b40-48a1-a5f4-1aaf0f4b6df6 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] 10.222.0.18 "GET /compute/v2.1/servers/7c3f6786-1255-40f9-b54a-3e42c7799c4e" status: 200 len: 1361 microversion: 2.1 time: 0.177816 Oct 22 21:55:58.755205 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3239/6508] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:55:58 2022] GET /compute/v2.1/servers/7c3f6786-1255-40f9-b54a-3e42c7799c4e => generated 1361 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:55:59.783644 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-c358e4df-aae2-4b07-b2b9-87810910063a tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:55:59.784400 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-c358e4df-aae2-4b07-b2b9-87810910063a tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] [instance: 7c3f6786-1255-40f9-b54a-3e42c7799c4e] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:55:59.786436 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:55:59.792192 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c358e4df-aae2-4b07-b2b9-87810910063a tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:55:59.792695 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c358e4df-aae2-4b07-b2b9-87810910063a tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:55:59.793146 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c358e4df-aae2-4b07-b2b9-87810910063a tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:55:59.793863 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c358e4df-aae2-4b07-b2b9-87810910063a tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:55:59.794333 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c358e4df-aae2-4b07-b2b9-87810910063a tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:55:59.794777 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c358e4df-aae2-4b07-b2b9-87810910063a tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:55:59.930143 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-c358e4df-aae2-4b07-b2b9-87810910063a tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1a4da366004680b7330a8e9f43f945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17135327e2d14c4bbe4c7b242f9fda48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:55:59.938507 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-c358e4df-aae2-4b07-b2b9-87810910063a tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] 10.222.0.18 "GET /compute/v2.1/servers/7c3f6786-1255-40f9-b54a-3e42c7799c4e" status: 200 len: 1361 microversion: 2.1 time: 0.162343 Oct 22 21:55:59.939091 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3270/6509] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:55:59 2022] GET /compute/v2.1/servers/7c3f6786-1255-40f9-b54a-3e42c7799c4e => generated 1361 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:56:00.976761 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-f568b30f-0a28-4738-bcbd-182dd3ef36c9 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:56:00.978504 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-f568b30f-0a28-4738-bcbd-182dd3ef36c9 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] [instance: 7c3f6786-1255-40f9-b54a-3e42c7799c4e] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:56:00.982954 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_api:SELECT=49 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:56:00.990109 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f568b30f-0a28-4738-bcbd-182dd3ef36c9 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:56:00.990606 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f568b30f-0a28-4738-bcbd-182dd3ef36c9 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:56:00.991026 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f568b30f-0a28-4738-bcbd-182dd3ef36c9 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:56:00.991782 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f568b30f-0a28-4738-bcbd-182dd3ef36c9 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:56:00.992225 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f568b30f-0a28-4738-bcbd-182dd3ef36c9 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:56:00.992665 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f568b30f-0a28-4738-bcbd-182dd3ef36c9 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:56:01.125107 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-f568b30f-0a28-4738-bcbd-182dd3ef36c9 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1a4da366004680b7330a8e9f43f945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17135327e2d14c4bbe4c7b242f9fda48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:56:01.134690 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-f568b30f-0a28-4738-bcbd-182dd3ef36c9 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] 10.222.0.18 "GET /compute/v2.1/servers/7c3f6786-1255-40f9-b54a-3e42c7799c4e" status: 200 len: 1361 microversion: 2.1 time: 0.164937 Oct 22 21:56:01.135266 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3240/6510] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:56:00 2022] GET /compute/v2.1/servers/7c3f6786-1255-40f9-b54a-3e42c7799c4e => generated 1361 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:56:02.166560 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-418316c6-3c5f-478b-8569-93c886b3810e tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:56:02.167304 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-418316c6-3c5f-478b-8569-93c886b3810e tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] [instance: 7c3f6786-1255-40f9-b54a-3e42c7799c4e] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:56:02.175058 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-418316c6-3c5f-478b-8569-93c886b3810e tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:56:02.175722 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-418316c6-3c5f-478b-8569-93c886b3810e tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:56:02.176082 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-418316c6-3c5f-478b-8569-93c886b3810e tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:56:02.176881 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-418316c6-3c5f-478b-8569-93c886b3810e tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:56:02.177401 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-418316c6-3c5f-478b-8569-93c886b3810e tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:56:02.177848 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-418316c6-3c5f-478b-8569-93c886b3810e tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:56:02.317778 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-418316c6-3c5f-478b-8569-93c886b3810e tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1a4da366004680b7330a8e9f43f945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17135327e2d14c4bbe4c7b242f9fda48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:56:02.325901 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-418316c6-3c5f-478b-8569-93c886b3810e tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] 10.222.0.18 "GET /compute/v2.1/servers/7c3f6786-1255-40f9-b54a-3e42c7799c4e" status: 200 len: 1361 microversion: 2.1 time: 0.163386 Oct 22 21:56:02.326486 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3271/6511] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:56:02 2022] GET /compute/v2.1/servers/7c3f6786-1255-40f9-b54a-3e42c7799c4e => generated 1361 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:56:03.352432 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-2abd9301-ef24-4eb5-8278-7fe6f30610e1 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:56:03.353093 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-2abd9301-ef24-4eb5-8278-7fe6f30610e1 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] [instance: 7c3f6786-1255-40f9-b54a-3e42c7799c4e] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:56:03.361713 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2abd9301-ef24-4eb5-8278-7fe6f30610e1 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:56:03.362294 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2abd9301-ef24-4eb5-8278-7fe6f30610e1 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:56:03.362889 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2abd9301-ef24-4eb5-8278-7fe6f30610e1 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:56:03.363881 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2abd9301-ef24-4eb5-8278-7fe6f30610e1 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:56:03.364426 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2abd9301-ef24-4eb5-8278-7fe6f30610e1 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:56:03.364936 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2abd9301-ef24-4eb5-8278-7fe6f30610e1 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:56:03.503067 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-2abd9301-ef24-4eb5-8278-7fe6f30610e1 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1a4da366004680b7330a8e9f43f945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17135327e2d14c4bbe4c7b242f9fda48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:56:03.511594 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-2abd9301-ef24-4eb5-8278-7fe6f30610e1 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] 10.222.0.18 "GET /compute/v2.1/servers/7c3f6786-1255-40f9-b54a-3e42c7799c4e" status: 200 len: 1361 microversion: 2.1 time: 0.164104 Oct 22 21:56:03.512213 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3241/6512] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:56:03 2022] GET /compute/v2.1/servers/7c3f6786-1255-40f9-b54a-3e42c7799c4e => generated 1361 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:56:04.244758 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-53dbfb0e-1921-4c2c-a3b8-8ea5d72246d2 req-40ac1909-27cd-4f23-b9af-fbe443635152 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c3f6786-1255-40f9-b54a-3e42c7799c4e", "name": "network-vif-plugged", "status": "completed", "tag": "a30cb8aa-b665-4130-906a-6253e52bf9b0"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:56:04.256147 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-53dbfb0e-1921-4c2c-a3b8-8ea5d72246d2 req-40ac1909-27cd-4f23-b9af-fbe443635152 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:56:04.257068 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-53dbfb0e-1921-4c2c-a3b8-8ea5d72246d2 req-40ac1909-27cd-4f23-b9af-fbe443635152 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:56:04.257248 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-53dbfb0e-1921-4c2c-a3b8-8ea5d72246d2 req-40ac1909-27cd-4f23-b9af-fbe443635152 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:56:04.269088 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-53dbfb0e-1921-4c2c-a3b8-8ea5d72246d2 req-40ac1909-27cd-4f23-b9af-fbe443635152 service nova] Creating event network-vif-plugged:a30cb8aa-b665-4130-906a-6253e52bf9b0 for instance 7c3f6786-1255-40f9-b54a-3e42c7799c4e on nch1-master-1 Oct 22 21:56:04.274378 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-53dbfb0e-1921-4c2c-a3b8-8ea5d72246d2 req-40ac1909-27cd-4f23-b9af-fbe443635152 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033238 Oct 22 21:56:04.274985 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3272/6513] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:56:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:56:04.535016 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-49897391-7083-45b2-989c-e6f6225df768 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:56:04.535809 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-49897391-7083-45b2-989c-e6f6225df768 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] [instance: 7c3f6786-1255-40f9-b54a-3e42c7799c4e] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:56:04.543640 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-49897391-7083-45b2-989c-e6f6225df768 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:56:04.544162 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-49897391-7083-45b2-989c-e6f6225df768 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:56:04.544636 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-49897391-7083-45b2-989c-e6f6225df768 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:56:04.545385 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-49897391-7083-45b2-989c-e6f6225df768 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:56:04.545873 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-49897391-7083-45b2-989c-e6f6225df768 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:56:04.546339 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-49897391-7083-45b2-989c-e6f6225df768 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:56:04.685205 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-49897391-7083-45b2-989c-e6f6225df768 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1a4da366004680b7330a8e9f43f945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17135327e2d14c4bbe4c7b242f9fda48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:56:04.693362 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-49897391-7083-45b2-989c-e6f6225df768 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] 10.222.0.18 "GET /compute/v2.1/servers/7c3f6786-1255-40f9-b54a-3e42c7799c4e" status: 200 len: 1361 microversion: 2.1 time: 0.162818 Oct 22 21:56:04.693907 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3242/6514] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:56:04 2022] GET /compute/v2.1/servers/7c3f6786-1255-40f9-b54a-3e42c7799c4e => generated 1361 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:56:05.716791 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell0:SELECT=2 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:56:05.718520 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell0:SELECT=6 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:56:05.725333 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-1fdfe22e-bc4e-48f3-adf6-cab404f804d9 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:56:05.726067 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-1fdfe22e-bc4e-48f3-adf6-cab404f804d9 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] [instance: 7c3f6786-1255-40f9-b54a-3e42c7799c4e] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:56:05.733832 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1fdfe22e-bc4e-48f3-adf6-cab404f804d9 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:56:05.734335 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1fdfe22e-bc4e-48f3-adf6-cab404f804d9 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:56:05.734792 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1fdfe22e-bc4e-48f3-adf6-cab404f804d9 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:56:05.735549 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1fdfe22e-bc4e-48f3-adf6-cab404f804d9 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:56:05.736021 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1fdfe22e-bc4e-48f3-adf6-cab404f804d9 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:56:05.736463 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1fdfe22e-bc4e-48f3-adf6-cab404f804d9 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:56:05.871468 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-1fdfe22e-bc4e-48f3-adf6-cab404f804d9 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1a4da366004680b7330a8e9f43f945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17135327e2d14c4bbe4c7b242f9fda48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:56:05.879452 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-1fdfe22e-bc4e-48f3-adf6-cab404f804d9 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] 10.222.0.18 "GET /compute/v2.1/servers/7c3f6786-1255-40f9-b54a-3e42c7799c4e" status: 200 len: 1361 microversion: 2.1 time: 0.164388 Oct 22 21:56:05.880032 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3273/6515] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:56:05 2022] GET /compute/v2.1/servers/7c3f6786-1255-40f9-b54a-3e42c7799c4e => generated 1361 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:56:06.906664 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-f5a169f0-6686-4969-91c7-7f2c0feee0e0 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:56:06.907630 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-f5a169f0-6686-4969-91c7-7f2c0feee0e0 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] [instance: 7c3f6786-1255-40f9-b54a-3e42c7799c4e] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:56:06.910693 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell0:SELECT=2 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:56:06.921203 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f5a169f0-6686-4969-91c7-7f2c0feee0e0 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:56:06.922011 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f5a169f0-6686-4969-91c7-7f2c0feee0e0 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:56:06.922810 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f5a169f0-6686-4969-91c7-7f2c0feee0e0 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:56:06.924020 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f5a169f0-6686-4969-91c7-7f2c0feee0e0 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:56:06.924780 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f5a169f0-6686-4969-91c7-7f2c0feee0e0 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:56:06.925580 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f5a169f0-6686-4969-91c7-7f2c0feee0e0 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:56:07.063431 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-f5a169f0-6686-4969-91c7-7f2c0feee0e0 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1a4da366004680b7330a8e9f43f945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17135327e2d14c4bbe4c7b242f9fda48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:56:07.072115 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-f5a169f0-6686-4969-91c7-7f2c0feee0e0 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] 10.222.0.18 "GET /compute/v2.1/servers/7c3f6786-1255-40f9-b54a-3e42c7799c4e" status: 200 len: 1548 microversion: 2.1 time: 0.172468 Oct 22 21:56:07.072709 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3243/6516] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:56:06 2022] GET /compute/v2.1/servers/7c3f6786-1255-40f9-b54a-3e42c7799c4e => generated 1548 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:56:07.095418 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-ac2112f0-5d16-4a93-a16b-658985d57e02 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:56:07.095949 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-ac2112f0-5d16-4a93-a16b-658985d57e02 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] [instance: 7c3f6786-1255-40f9-b54a-3e42c7799c4e] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:56:07.103606 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ac2112f0-5d16-4a93-a16b-658985d57e02 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:56:07.104112 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ac2112f0-5d16-4a93-a16b-658985d57e02 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:56:07.104578 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ac2112f0-5d16-4a93-a16b-658985d57e02 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:56:07.105303 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ac2112f0-5d16-4a93-a16b-658985d57e02 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:56:07.105776 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ac2112f0-5d16-4a93-a16b-658985d57e02 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:56:07.106227 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ac2112f0-5d16-4a93-a16b-658985d57e02 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:56:07.187375 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-ac2112f0-5d16-4a93-a16b-658985d57e02 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] 10.222.0.18 "GET /compute/v2.1/servers/7c3f6786-1255-40f9-b54a-3e42c7799c4e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.096224 Oct 22 21:56:07.188020 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3274/6517] 10.222.0.18 () {58 vars in 1275 bytes} [Sat Oct 22 21:56:07 2022] GET /compute/v2.1/servers/7c3f6786-1255-40f9-b54a-3e42c7799c4e/os-interface => generated 284 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:56:08.156099 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-171a99ea-3a64-4868-a399-605dcb62512a req-1d828314-f79b-486c-b2cf-24da3256a318 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c3f6786-1255-40f9-b54a-3e42c7799c4e", "tag": "a30cb8aa-b665-4130-906a-6253e52bf9b0"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:56:08.166625 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-171a99ea-3a64-4868-a399-605dcb62512a req-1d828314-f79b-486c-b2cf-24da3256a318 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:56:08.167103 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-171a99ea-3a64-4868-a399-605dcb62512a req-1d828314-f79b-486c-b2cf-24da3256a318 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:56:08.167574 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-171a99ea-3a64-4868-a399-605dcb62512a req-1d828314-f79b-486c-b2cf-24da3256a318 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:56:08.179367 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-171a99ea-3a64-4868-a399-605dcb62512a req-1d828314-f79b-486c-b2cf-24da3256a318 service nova] Creating event network-changed:a30cb8aa-b665-4130-906a-6253e52bf9b0 for instance 7c3f6786-1255-40f9-b54a-3e42c7799c4e on nch1-master-1 Oct 22 21:56:08.184703 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-171a99ea-3a64-4868-a399-605dcb62512a req-1d828314-f79b-486c-b2cf-24da3256a318 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032311 Oct 22 21:56:08.185636 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3244/6518] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:56:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:57:09.652086 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_api:SELECT=9 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:57:09.653042 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell1:SELECT=43,nova_cell1:INSERT=1 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:57:09.658439 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-d3853fd4-bd49-49aa-96ab-7d5755924338 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:57:09.661208 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-d3853fd4-bd49-49aa-96ab-7d5755924338 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] [instance: 7c3f6786-1255-40f9-b54a-3e42c7799c4e] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:57:09.669622 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d3853fd4-bd49-49aa-96ab-7d5755924338 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:57:09.670120 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d3853fd4-bd49-49aa-96ab-7d5755924338 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:57:09.670575 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d3853fd4-bd49-49aa-96ab-7d5755924338 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:57:09.671286 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d3853fd4-bd49-49aa-96ab-7d5755924338 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:57:09.671798 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d3853fd4-bd49-49aa-96ab-7d5755924338 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:57:09.672297 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d3853fd4-bd49-49aa-96ab-7d5755924338 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:57:09.701320 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-d3853fd4-bd49-49aa-96ab-7d5755924338 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'ce1a4da366004680b7330a8e9f43f945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17135327e2d14c4bbe4c7b242f9fda48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:57:09.706902 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-d3853fd4-bd49-49aa-96ab-7d5755924338 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] [instance: 7c3f6786-1255-40f9-b54a-3e42c7799c4e] Old instance type m1.heat2, new instance type m1.heat {{(pid=138745) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 22 21:57:09.713707 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-d3853fd4-bd49-49aa-96ab-7d5755924338 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Flavor limits 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 21:57:09.714142 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-d3853fd4-bd49-49aa-96ab-7d5755924338 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Image limits 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 21:57:09.714632 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-d3853fd4-bd49-49aa-96ab-7d5755924338 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Flavor pref 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 21:57:09.715058 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-d3853fd4-bd49-49aa-96ab-7d5755924338 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Image pref 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 21:57:09.715524 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-d3853fd4-bd49-49aa-96ab-7d5755924338 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 21:57:09.784223 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-d3853fd4-bd49-49aa-96ab-7d5755924338 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] 10.222.0.18 "POST /compute/v2.1/servers/7c3f6786-1255-40f9-b54a-3e42c7799c4e/action" status: 202 len: 0 microversion: 2.1 time: 0.135449 Oct 22 21:57:09.784837 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3275/6519] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 21:57:09 2022] POST /compute/v2.1/servers/7c3f6786-1255-40f9-b54a-3e42c7799c4e/action => generated 0 bytes in 137 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 21:57:09.792303 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_api:SELECT=9 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:57:09.793088 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:SELECT=61 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:57:09.798279 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-7259c125-5e59-4df6-b019-e704e62a6c56 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:57:09.798992 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-7259c125-5e59-4df6-b019-e704e62a6c56 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] [instance: 7c3f6786-1255-40f9-b54a-3e42c7799c4e] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:57:09.807045 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7259c125-5e59-4df6-b019-e704e62a6c56 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:57:09.807605 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7259c125-5e59-4df6-b019-e704e62a6c56 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:57:09.808038 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7259c125-5e59-4df6-b019-e704e62a6c56 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:57:09.808749 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7259c125-5e59-4df6-b019-e704e62a6c56 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:57:09.809435 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7259c125-5e59-4df6-b019-e704e62a6c56 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:57:09.810198 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7259c125-5e59-4df6-b019-e704e62a6c56 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:57:09.999304 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-7259c125-5e59-4df6-b019-e704e62a6c56 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1a4da366004680b7330a8e9f43f945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17135327e2d14c4bbe4c7b242f9fda48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:57:10.007521 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-7259c125-5e59-4df6-b019-e704e62a6c56 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] 10.222.0.18 "GET /compute/v2.1/servers/7c3f6786-1255-40f9-b54a-3e42c7799c4e" status: 200 len: 1676 microversion: 2.1 time: 0.218170 Oct 22 21:57:10.008181 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3245/6520] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:57:09 2022] GET /compute/v2.1/servers/7c3f6786-1255-40f9-b54a-3e42c7799c4e => generated 1676 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:57:11.033114 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-8ff3e21d-752b-41d3-9930-b60e9880f794 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:57:11.033880 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-8ff3e21d-752b-41d3-9930-b60e9880f794 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] [instance: 7c3f6786-1255-40f9-b54a-3e42c7799c4e] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:57:11.041875 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8ff3e21d-752b-41d3-9930-b60e9880f794 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:57:11.042395 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8ff3e21d-752b-41d3-9930-b60e9880f794 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:57:11.042851 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8ff3e21d-752b-41d3-9930-b60e9880f794 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:57:11.043623 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8ff3e21d-752b-41d3-9930-b60e9880f794 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:57:11.044143 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8ff3e21d-752b-41d3-9930-b60e9880f794 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:57:11.044533 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8ff3e21d-752b-41d3-9930-b60e9880f794 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:57:11.226307 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-8ff3e21d-752b-41d3-9930-b60e9880f794 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1a4da366004680b7330a8e9f43f945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17135327e2d14c4bbe4c7b242f9fda48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:57:11.235043 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-8ff3e21d-752b-41d3-9930-b60e9880f794 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] 10.222.0.18 "GET /compute/v2.1/servers/7c3f6786-1255-40f9-b54a-3e42c7799c4e" status: 200 len: 1676 microversion: 2.1 time: 0.207582 Oct 22 21:57:11.235638 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3276/6521] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:57:11 2022] GET /compute/v2.1/servers/7c3f6786-1255-40f9-b54a-3e42c7799c4e => generated 1676 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:57:12.268100 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-cc73b57b-00a5-407a-be5b-70ce80a71898 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:57:12.268707 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-cc73b57b-00a5-407a-be5b-70ce80a71898 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] [instance: 7c3f6786-1255-40f9-b54a-3e42c7799c4e] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:57:12.276180 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cc73b57b-00a5-407a-be5b-70ce80a71898 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:57:12.276674 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cc73b57b-00a5-407a-be5b-70ce80a71898 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:57:12.277101 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cc73b57b-00a5-407a-be5b-70ce80a71898 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:57:12.277812 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cc73b57b-00a5-407a-be5b-70ce80a71898 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:57:12.278270 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cc73b57b-00a5-407a-be5b-70ce80a71898 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:57:12.278701 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cc73b57b-00a5-407a-be5b-70ce80a71898 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:57:12.413360 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-cc73b57b-00a5-407a-be5b-70ce80a71898 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1a4da366004680b7330a8e9f43f945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17135327e2d14c4bbe4c7b242f9fda48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:57:12.421665 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-cc73b57b-00a5-407a-be5b-70ce80a71898 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] 10.222.0.18 "GET /compute/v2.1/servers/7c3f6786-1255-40f9-b54a-3e42c7799c4e" status: 200 len: 1676 microversion: 2.1 time: 0.157631 Oct 22 21:57:12.422255 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3246/6522] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:57:12 2022] GET /compute/v2.1/servers/7c3f6786-1255-40f9-b54a-3e42c7799c4e => generated 1676 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:57:13.448637 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-1661e358-5823-4376-8b60-edd820da45db tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:57:13.449328 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-1661e358-5823-4376-8b60-edd820da45db tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] [instance: 7c3f6786-1255-40f9-b54a-3e42c7799c4e] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:57:13.457563 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1661e358-5823-4376-8b60-edd820da45db tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:57:13.458126 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1661e358-5823-4376-8b60-edd820da45db tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:57:13.458635 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1661e358-5823-4376-8b60-edd820da45db tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:57:13.459471 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1661e358-5823-4376-8b60-edd820da45db tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:57:13.460005 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1661e358-5823-4376-8b60-edd820da45db tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:57:13.460520 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1661e358-5823-4376-8b60-edd820da45db tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:57:13.601821 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-1661e358-5823-4376-8b60-edd820da45db tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1a4da366004680b7330a8e9f43f945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17135327e2d14c4bbe4c7b242f9fda48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:57:13.610718 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-1661e358-5823-4376-8b60-edd820da45db tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] 10.222.0.18 "GET /compute/v2.1/servers/7c3f6786-1255-40f9-b54a-3e42c7799c4e" status: 200 len: 1681 microversion: 2.1 time: 0.167871 Oct 22 21:57:13.611303 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3277/6523] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:57:13 2022] GET /compute/v2.1/servers/7c3f6786-1255-40f9-b54a-3e42c7799c4e => generated 1681 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:57:14.638757 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-3049585c-5949-481a-bd23-5d0799c6d7e7 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:57:14.639769 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-3049585c-5949-481a-bd23-5d0799c6d7e7 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] [instance: 7c3f6786-1255-40f9-b54a-3e42c7799c4e] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:57:14.650810 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3049585c-5949-481a-bd23-5d0799c6d7e7 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:57:14.651309 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3049585c-5949-481a-bd23-5d0799c6d7e7 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:57:14.651783 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3049585c-5949-481a-bd23-5d0799c6d7e7 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:57:14.652754 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3049585c-5949-481a-bd23-5d0799c6d7e7 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:57:14.652940 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3049585c-5949-481a-bd23-5d0799c6d7e7 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:57:14.653377 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3049585c-5949-481a-bd23-5d0799c6d7e7 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:57:14.792425 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-3049585c-5949-481a-bd23-5d0799c6d7e7 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1a4da366004680b7330a8e9f43f945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17135327e2d14c4bbe4c7b242f9fda48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:57:14.802013 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-3049585c-5949-481a-bd23-5d0799c6d7e7 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] 10.222.0.18 "GET /compute/v2.1/servers/7c3f6786-1255-40f9-b54a-3e42c7799c4e" status: 200 len: 1681 microversion: 2.1 time: 0.170048 Oct 22 21:57:14.802598 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3247/6524] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:57:14 2022] GET /compute/v2.1/servers/7c3f6786-1255-40f9-b54a-3e42c7799c4e => generated 1681 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:57:15.830309 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-ebdb88b1-d5e8-4a0d-8b3b-368d34d60c26 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:57:15.831472 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-ebdb88b1-d5e8-4a0d-8b3b-368d34d60c26 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] [instance: 7c3f6786-1255-40f9-b54a-3e42c7799c4e] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:57:15.843764 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ebdb88b1-d5e8-4a0d-8b3b-368d34d60c26 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:57:15.844600 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ebdb88b1-d5e8-4a0d-8b3b-368d34d60c26 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:57:15.845356 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ebdb88b1-d5e8-4a0d-8b3b-368d34d60c26 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:57:15.846530 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ebdb88b1-d5e8-4a0d-8b3b-368d34d60c26 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:57:15.847317 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ebdb88b1-d5e8-4a0d-8b3b-368d34d60c26 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:57:15.848106 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ebdb88b1-d5e8-4a0d-8b3b-368d34d60c26 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:57:15.986237 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-ebdb88b1-d5e8-4a0d-8b3b-368d34d60c26 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1a4da366004680b7330a8e9f43f945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17135327e2d14c4bbe4c7b242f9fda48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:57:15.995898 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-ebdb88b1-d5e8-4a0d-8b3b-368d34d60c26 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] 10.222.0.18 "GET /compute/v2.1/servers/7c3f6786-1255-40f9-b54a-3e42c7799c4e" status: 200 len: 1681 microversion: 2.1 time: 0.172114 Oct 22 21:57:15.996683 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3278/6525] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:57:15 2022] GET /compute/v2.1/servers/7c3f6786-1255-40f9-b54a-3e42c7799c4e => generated 1681 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:57:17.022308 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-e716aaf7-6eae-4070-a9f9-836b66fcc2d9 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:57:17.023198 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-e716aaf7-6eae-4070-a9f9-836b66fcc2d9 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] [instance: 7c3f6786-1255-40f9-b54a-3e42c7799c4e] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:57:17.031181 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e716aaf7-6eae-4070-a9f9-836b66fcc2d9 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:57:17.031703 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e716aaf7-6eae-4070-a9f9-836b66fcc2d9 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:57:17.032144 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e716aaf7-6eae-4070-a9f9-836b66fcc2d9 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:57:17.032850 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e716aaf7-6eae-4070-a9f9-836b66fcc2d9 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:57:17.033306 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e716aaf7-6eae-4070-a9f9-836b66fcc2d9 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:57:17.033738 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e716aaf7-6eae-4070-a9f9-836b66fcc2d9 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:57:17.169053 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-e716aaf7-6eae-4070-a9f9-836b66fcc2d9 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1a4da366004680b7330a8e9f43f945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17135327e2d14c4bbe4c7b242f9fda48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:57:17.177092 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-e716aaf7-6eae-4070-a9f9-836b66fcc2d9 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] 10.222.0.18 "GET /compute/v2.1/servers/7c3f6786-1255-40f9-b54a-3e42c7799c4e" status: 200 len: 1681 microversion: 2.1 time: 0.160532 Oct 22 21:57:17.177677 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3248/6526] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:57:17 2022] GET /compute/v2.1/servers/7c3f6786-1255-40f9-b54a-3e42c7799c4e => generated 1681 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:57:18.201116 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-e1172f8c-865c-41ec-8af5-c100c2be415d tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:57:18.201755 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-e1172f8c-865c-41ec-8af5-c100c2be415d tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] [instance: 7c3f6786-1255-40f9-b54a-3e42c7799c4e] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:57:18.208859 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e1172f8c-865c-41ec-8af5-c100c2be415d tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:57:18.209380 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e1172f8c-865c-41ec-8af5-c100c2be415d tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:57:18.209834 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e1172f8c-865c-41ec-8af5-c100c2be415d tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:57:18.210555 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e1172f8c-865c-41ec-8af5-c100c2be415d tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:57:18.211026 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e1172f8c-865c-41ec-8af5-c100c2be415d tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:57:18.211640 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e1172f8c-865c-41ec-8af5-c100c2be415d tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:57:18.352640 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-e1172f8c-865c-41ec-8af5-c100c2be415d tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1a4da366004680b7330a8e9f43f945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17135327e2d14c4bbe4c7b242f9fda48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:57:18.360789 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-e1172f8c-865c-41ec-8af5-c100c2be415d tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] 10.222.0.18 "GET /compute/v2.1/servers/7c3f6786-1255-40f9-b54a-3e42c7799c4e" status: 200 len: 1681 microversion: 2.1 time: 0.163756 Oct 22 21:57:18.361380 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3279/6527] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:57:18 2022] GET /compute/v2.1/servers/7c3f6786-1255-40f9-b54a-3e42c7799c4e => generated 1681 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:57:19.385052 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-9dcfccf3-7d32-4a5d-9a4c-86d438ec6ca9 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:57:19.385623 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-9dcfccf3-7d32-4a5d-9a4c-86d438ec6ca9 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] [instance: 7c3f6786-1255-40f9-b54a-3e42c7799c4e] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:57:19.393063 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9dcfccf3-7d32-4a5d-9a4c-86d438ec6ca9 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:57:19.393549 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9dcfccf3-7d32-4a5d-9a4c-86d438ec6ca9 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:57:19.393988 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9dcfccf3-7d32-4a5d-9a4c-86d438ec6ca9 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:57:19.394681 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9dcfccf3-7d32-4a5d-9a4c-86d438ec6ca9 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:57:19.395136 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9dcfccf3-7d32-4a5d-9a4c-86d438ec6ca9 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:57:19.395610 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9dcfccf3-7d32-4a5d-9a4c-86d438ec6ca9 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:57:19.530259 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-9dcfccf3-7d32-4a5d-9a4c-86d438ec6ca9 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1a4da366004680b7330a8e9f43f945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17135327e2d14c4bbe4c7b242f9fda48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:57:19.538550 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-9dcfccf3-7d32-4a5d-9a4c-86d438ec6ca9 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] 10.222.0.18 "GET /compute/v2.1/servers/7c3f6786-1255-40f9-b54a-3e42c7799c4e" status: 200 len: 1681 microversion: 2.1 time: 0.157939 Oct 22 21:57:19.539121 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3249/6528] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:57:19 2022] GET /compute/v2.1/servers/7c3f6786-1255-40f9-b54a-3e42c7799c4e => generated 1681 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:57:20.566747 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-b34ac214-5c55-4abb-8d79-cf650cdd060a tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:57:20.567647 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-b34ac214-5c55-4abb-8d79-cf650cdd060a tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] [instance: 7c3f6786-1255-40f9-b54a-3e42c7799c4e] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:57:20.579592 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b34ac214-5c55-4abb-8d79-cf650cdd060a tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:57:20.580431 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b34ac214-5c55-4abb-8d79-cf650cdd060a tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:57:20.581188 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b34ac214-5c55-4abb-8d79-cf650cdd060a tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:57:20.582449 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b34ac214-5c55-4abb-8d79-cf650cdd060a tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:57:20.583189 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b34ac214-5c55-4abb-8d79-cf650cdd060a tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:57:20.584049 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b34ac214-5c55-4abb-8d79-cf650cdd060a tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:57:20.728465 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-b34ac214-5c55-4abb-8d79-cf650cdd060a tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1a4da366004680b7330a8e9f43f945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17135327e2d14c4bbe4c7b242f9fda48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:57:20.736903 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-b34ac214-5c55-4abb-8d79-cf650cdd060a tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] 10.222.0.18 "GET /compute/v2.1/servers/7c3f6786-1255-40f9-b54a-3e42c7799c4e" status: 200 len: 1681 microversion: 2.1 time: 0.177191 Oct 22 21:57:20.737481 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3280/6529] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:57:20 2022] GET /compute/v2.1/servers/7c3f6786-1255-40f9-b54a-3e42c7799c4e => generated 1681 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:57:21.763583 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-2fe02910-0c54-4f55-a678-c4de3b6c438d tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:57:21.764271 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-2fe02910-0c54-4f55-a678-c4de3b6c438d tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] [instance: 7c3f6786-1255-40f9-b54a-3e42c7799c4e] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:57:21.773276 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2fe02910-0c54-4f55-a678-c4de3b6c438d tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:57:21.773848 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2fe02910-0c54-4f55-a678-c4de3b6c438d tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:57:21.774364 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2fe02910-0c54-4f55-a678-c4de3b6c438d tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:57:21.775162 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2fe02910-0c54-4f55-a678-c4de3b6c438d tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:57:21.775763 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2fe02910-0c54-4f55-a678-c4de3b6c438d tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:57:21.776273 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2fe02910-0c54-4f55-a678-c4de3b6c438d tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:57:21.919050 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-2fe02910-0c54-4f55-a678-c4de3b6c438d tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1a4da366004680b7330a8e9f43f945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17135327e2d14c4bbe4c7b242f9fda48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:57:21.927127 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-2fe02910-0c54-4f55-a678-c4de3b6c438d tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] 10.222.0.18 "GET /compute/v2.1/servers/7c3f6786-1255-40f9-b54a-3e42c7799c4e" status: 200 len: 1681 microversion: 2.1 time: 0.169654 Oct 22 21:57:21.927766 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3250/6530] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:57:21 2022] GET /compute/v2.1/servers/7c3f6786-1255-40f9-b54a-3e42c7799c4e => generated 1681 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:57:22.951671 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-9c150987-3e5e-4604-b678-387f05129268 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:57:22.952302 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-9c150987-3e5e-4604-b678-387f05129268 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] [instance: 7c3f6786-1255-40f9-b54a-3e42c7799c4e] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:57:22.961801 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9c150987-3e5e-4604-b678-387f05129268 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:57:22.962519 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9c150987-3e5e-4604-b678-387f05129268 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:57:22.963122 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9c150987-3e5e-4604-b678-387f05129268 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:57:22.964321 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9c150987-3e5e-4604-b678-387f05129268 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:57:22.965003 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9c150987-3e5e-4604-b678-387f05129268 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:57:22.965584 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9c150987-3e5e-4604-b678-387f05129268 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:57:23.106517 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-9c150987-3e5e-4604-b678-387f05129268 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1a4da366004680b7330a8e9f43f945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17135327e2d14c4bbe4c7b242f9fda48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:57:23.117110 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-9c150987-3e5e-4604-b678-387f05129268 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] 10.222.0.18 "GET /compute/v2.1/servers/7c3f6786-1255-40f9-b54a-3e42c7799c4e" status: 200 len: 1681 microversion: 2.1 time: 0.169949 Oct 22 21:57:23.117703 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3281/6531] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:57:22 2022] GET /compute/v2.1/servers/7c3f6786-1255-40f9-b54a-3e42c7799c4e => generated 1681 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:57:24.141304 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-3bc430f1-d7a9-4823-9d09-a6d8a7665a77 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:57:24.141926 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-3bc430f1-d7a9-4823-9d09-a6d8a7665a77 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] [instance: 7c3f6786-1255-40f9-b54a-3e42c7799c4e] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:57:24.149516 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3bc430f1-d7a9-4823-9d09-a6d8a7665a77 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:57:24.150058 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3bc430f1-d7a9-4823-9d09-a6d8a7665a77 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:57:24.150573 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3bc430f1-d7a9-4823-9d09-a6d8a7665a77 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:57:24.151289 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3bc430f1-d7a9-4823-9d09-a6d8a7665a77 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:57:24.151777 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3bc430f1-d7a9-4823-9d09-a6d8a7665a77 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:57:24.152212 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3bc430f1-d7a9-4823-9d09-a6d8a7665a77 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:57:24.297804 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-3bc430f1-d7a9-4823-9d09-a6d8a7665a77 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1a4da366004680b7330a8e9f43f945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17135327e2d14c4bbe4c7b242f9fda48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:57:24.306332 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-3bc430f1-d7a9-4823-9d09-a6d8a7665a77 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] 10.222.0.18 "GET /compute/v2.1/servers/7c3f6786-1255-40f9-b54a-3e42c7799c4e" status: 200 len: 1681 microversion: 2.1 time: 0.169242 Oct 22 21:57:24.306892 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3251/6532] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:57:24 2022] GET /compute/v2.1/servers/7c3f6786-1255-40f9-b54a-3e42c7799c4e => generated 1681 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:57:24.754894 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-4041a330-d9bb-49d6-b0d6-5fbef4383542 req-c28d6771-c1d8-4816-987f-ac93ad9c8258 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c3f6786-1255-40f9-b54a-3e42c7799c4e", "name": "network-vif-unplugged", "status": "completed", "tag": "a30cb8aa-b665-4130-906a-6253e52bf9b0"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:57:24.764941 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-4041a330-d9bb-49d6-b0d6-5fbef4383542 req-c28d6771-c1d8-4816-987f-ac93ad9c8258 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:57:24.765433 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-4041a330-d9bb-49d6-b0d6-5fbef4383542 req-c28d6771-c1d8-4816-987f-ac93ad9c8258 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:57:24.765882 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-4041a330-d9bb-49d6-b0d6-5fbef4383542 req-c28d6771-c1d8-4816-987f-ac93ad9c8258 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:57:24.778540 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-4041a330-d9bb-49d6-b0d6-5fbef4383542 req-c28d6771-c1d8-4816-987f-ac93ad9c8258 service nova] Creating event network-vif-unplugged:a30cb8aa-b665-4130-906a-6253e52bf9b0 for instance 7c3f6786-1255-40f9-b54a-3e42c7799c4e on nch2-master-1 Oct 22 21:57:24.784278 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [req-4041a330-d9bb-49d6-b0d6-5fbef4383542 req-c28d6771-c1d8-4816-987f-ac93ad9c8258 service nova] Instance 7c3f6786-1255-40f9-b54a-3e42c7799c4e is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=138745) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 22 21:57:24.796114 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-4041a330-d9bb-49d6-b0d6-5fbef4383542 req-c28d6771-c1d8-4816-987f-ac93ad9c8258 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.100151 Oct 22 21:57:24.796771 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3282/6533] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:57:24 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 21:57:25.330583 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-bf436f3a-62e7-4cb6-8ce0-de32fb4d2aad tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:57:25.331237 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-bf436f3a-62e7-4cb6-8ce0-de32fb4d2aad tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] [instance: 7c3f6786-1255-40f9-b54a-3e42c7799c4e] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:57:25.338513 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bf436f3a-62e7-4cb6-8ce0-de32fb4d2aad tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:57:25.339011 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bf436f3a-62e7-4cb6-8ce0-de32fb4d2aad tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:57:25.339489 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bf436f3a-62e7-4cb6-8ce0-de32fb4d2aad tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:57:25.340208 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bf436f3a-62e7-4cb6-8ce0-de32fb4d2aad tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:57:25.340671 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bf436f3a-62e7-4cb6-8ce0-de32fb4d2aad tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:57:25.341106 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bf436f3a-62e7-4cb6-8ce0-de32fb4d2aad tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:57:25.545743 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-bf436f3a-62e7-4cb6-8ce0-de32fb4d2aad tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1a4da366004680b7330a8e9f43f945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17135327e2d14c4bbe4c7b242f9fda48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:57:25.553930 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-bf436f3a-62e7-4cb6-8ce0-de32fb4d2aad tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] 10.222.0.18 "GET /compute/v2.1/servers/7c3f6786-1255-40f9-b54a-3e42c7799c4e" status: 200 len: 1680 microversion: 2.1 time: 0.227749 Oct 22 21:57:25.554523 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3252/6534] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:57:25 2022] GET /compute/v2.1/servers/7c3f6786-1255-40f9-b54a-3e42c7799c4e => generated 1680 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:57:26.583912 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-76b91220-6dbc-48f4-85c9-5445619ba216 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:57:26.584972 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-76b91220-6dbc-48f4-85c9-5445619ba216 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] [instance: 7c3f6786-1255-40f9-b54a-3e42c7799c4e] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:57:26.594779 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-76b91220-6dbc-48f4-85c9-5445619ba216 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:57:26.595280 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-76b91220-6dbc-48f4-85c9-5445619ba216 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:57:26.595771 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-76b91220-6dbc-48f4-85c9-5445619ba216 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:57:26.596489 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-76b91220-6dbc-48f4-85c9-5445619ba216 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:57:26.596963 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-76b91220-6dbc-48f4-85c9-5445619ba216 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:57:26.597442 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-76b91220-6dbc-48f4-85c9-5445619ba216 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:57:26.733912 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-76b91220-6dbc-48f4-85c9-5445619ba216 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1a4da366004680b7330a8e9f43f945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17135327e2d14c4bbe4c7b242f9fda48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:57:26.742487 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-76b91220-6dbc-48f4-85c9-5445619ba216 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] 10.222.0.18 "GET /compute/v2.1/servers/7c3f6786-1255-40f9-b54a-3e42c7799c4e" status: 200 len: 1678 microversion: 2.1 time: 0.166542 Oct 22 21:57:26.743062 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3283/6535] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:57:26 2022] GET /compute/v2.1/servers/7c3f6786-1255-40f9-b54a-3e42c7799c4e => generated 1678 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:57:26.819324 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-8781ae9f-5c32-453c-b639-be11ad74534b req-6c801d87-92a0-4d98-8400-1f0849e8c8bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c3f6786-1255-40f9-b54a-3e42c7799c4e", "tag": "a30cb8aa-b665-4130-906a-6253e52bf9b0"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:57:26.832838 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-8781ae9f-5c32-453c-b639-be11ad74534b req-6c801d87-92a0-4d98-8400-1f0849e8c8bc service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:57:26.833325 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-8781ae9f-5c32-453c-b639-be11ad74534b req-6c801d87-92a0-4d98-8400-1f0849e8c8bc service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:57:26.833759 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-8781ae9f-5c32-453c-b639-be11ad74534b req-6c801d87-92a0-4d98-8400-1f0849e8c8bc service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:57:26.849581 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-8781ae9f-5c32-453c-b639-be11ad74534b req-6c801d87-92a0-4d98-8400-1f0849e8c8bc service nova] Creating event network-changed:a30cb8aa-b665-4130-906a-6253e52bf9b0 for instance 7c3f6786-1255-40f9-b54a-3e42c7799c4e on nch2-master-1 Oct 22 21:57:26.855594 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [req-8781ae9f-5c32-453c-b639-be11ad74534b req-6c801d87-92a0-4d98-8400-1f0849e8c8bc service nova] Instance 7c3f6786-1255-40f9-b54a-3e42c7799c4e is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=138744) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 22 21:57:26.866619 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-8781ae9f-5c32-453c-b639-be11ad74534b req-6c801d87-92a0-4d98-8400-1f0849e8c8bc service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053456 Oct 22 21:57:26.867222 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3253/6536] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:57:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:57:27.766014 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-db99f029-8874-4207-b9c5-48d342e07d61 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:57:27.766644 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-db99f029-8874-4207-b9c5-48d342e07d61 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] [instance: 7c3f6786-1255-40f9-b54a-3e42c7799c4e] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:57:27.773818 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-db99f029-8874-4207-b9c5-48d342e07d61 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:57:27.774322 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-db99f029-8874-4207-b9c5-48d342e07d61 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:57:27.774778 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-db99f029-8874-4207-b9c5-48d342e07d61 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:57:27.775535 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-db99f029-8874-4207-b9c5-48d342e07d61 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:57:27.776010 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-db99f029-8874-4207-b9c5-48d342e07d61 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:57:27.776487 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-db99f029-8874-4207-b9c5-48d342e07d61 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:57:27.959840 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-db99f029-8874-4207-b9c5-48d342e07d61 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1a4da366004680b7330a8e9f43f945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17135327e2d14c4bbe4c7b242f9fda48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:57:27.968358 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-db99f029-8874-4207-b9c5-48d342e07d61 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] 10.222.0.18 "GET /compute/v2.1/servers/7c3f6786-1255-40f9-b54a-3e42c7799c4e" status: 200 len: 1678 microversion: 2.1 time: 0.206591 Oct 22 21:57:27.969265 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3284/6537] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:57:27 2022] GET /compute/v2.1/servers/7c3f6786-1255-40f9-b54a-3e42c7799c4e => generated 1678 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:57:28.999735 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-bc6499bb-6bae-400a-abd9-937ee909a4ab tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:57:29.000881 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-bc6499bb-6bae-400a-abd9-937ee909a4ab tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] [instance: 7c3f6786-1255-40f9-b54a-3e42c7799c4e] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:57:29.011659 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bc6499bb-6bae-400a-abd9-937ee909a4ab tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:57:29.012674 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bc6499bb-6bae-400a-abd9-937ee909a4ab tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:57:29.013059 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bc6499bb-6bae-400a-abd9-937ee909a4ab tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:57:29.013811 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bc6499bb-6bae-400a-abd9-937ee909a4ab tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:57:29.014273 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bc6499bb-6bae-400a-abd9-937ee909a4ab tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:57:29.014706 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bc6499bb-6bae-400a-abd9-937ee909a4ab tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:57:29.153467 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-bc6499bb-6bae-400a-abd9-937ee909a4ab tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1a4da366004680b7330a8e9f43f945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17135327e2d14c4bbe4c7b242f9fda48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:57:29.167960 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-bc6499bb-6bae-400a-abd9-937ee909a4ab tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] 10.222.0.18 "GET /compute/v2.1/servers/7c3f6786-1255-40f9-b54a-3e42c7799c4e" status: 200 len: 1675 microversion: 2.1 time: 0.176963 Oct 22 21:57:29.168741 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3254/6538] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:57:28 2022] GET /compute/v2.1/servers/7c3f6786-1255-40f9-b54a-3e42c7799c4e => generated 1675 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:57:29.190770 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-37485c1b-bced-49f9-84a3-53085839da52 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:57:29.191321 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-37485c1b-bced-49f9-84a3-53085839da52 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] [instance: 7c3f6786-1255-40f9-b54a-3e42c7799c4e] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:57:29.198854 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-37485c1b-bced-49f9-84a3-53085839da52 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:57:29.199368 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-37485c1b-bced-49f9-84a3-53085839da52 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:57:29.199823 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-37485c1b-bced-49f9-84a3-53085839da52 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:57:29.200789 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-37485c1b-bced-49f9-84a3-53085839da52 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:57:29.201296 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-37485c1b-bced-49f9-84a3-53085839da52 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:57:29.201708 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-37485c1b-bced-49f9-84a3-53085839da52 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:57:29.240341 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-37485c1b-bced-49f9-84a3-53085839da52 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:57:29.240834 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-37485c1b-bced-49f9-84a3-53085839da52 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:57:29.241283 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-37485c1b-bced-49f9-84a3-53085839da52 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:57:29.242048 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-37485c1b-bced-49f9-84a3-53085839da52 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:57:29.242511 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-37485c1b-bced-49f9-84a3-53085839da52 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:57:29.242953 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-37485c1b-bced-49f9-84a3-53085839da52 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:57:29.264175 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-37485c1b-bced-49f9-84a3-53085839da52 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Getting quotas for project 17135327e2d14c4bbe4c7b242f9fda48. Resources: {'ram', 'cores'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 21:57:29.269465 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-37485c1b-bced-49f9-84a3-53085839da52 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Getting quotas for user ce1a4da366004680b7330a8e9f43f945 and project 17135327e2d14c4bbe4c7b242f9fda48. Resources: {'ram', 'cores'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 21:57:29.377745 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-37485c1b-bced-49f9-84a3-53085839da52 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] 10.222.0.18 "POST /compute/v2.1/servers/7c3f6786-1255-40f9-b54a-3e42c7799c4e/action" status: 202 len: 0 microversion: 2.1 time: 0.190798 Oct 22 21:57:29.378408 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3285/6539] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 21:57:29 2022] POST /compute/v2.1/servers/7c3f6786-1255-40f9-b54a-3e42c7799c4e/action => generated 0 bytes in 192 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 21:57:29.386960 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-1e61d89f-61ca-458a-b9a2-da402f044d78 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:57:29.387854 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-1e61d89f-61ca-458a-b9a2-da402f044d78 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] [instance: 7c3f6786-1255-40f9-b54a-3e42c7799c4e] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:57:29.394075 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1e61d89f-61ca-458a-b9a2-da402f044d78 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:57:29.394584 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1e61d89f-61ca-458a-b9a2-da402f044d78 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:57:29.395060 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1e61d89f-61ca-458a-b9a2-da402f044d78 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:57:29.395804 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1e61d89f-61ca-458a-b9a2-da402f044d78 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:57:29.396265 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1e61d89f-61ca-458a-b9a2-da402f044d78 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:57:29.396697 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1e61d89f-61ca-458a-b9a2-da402f044d78 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:57:29.593325 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-1e61d89f-61ca-458a-b9a2-da402f044d78 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1a4da366004680b7330a8e9f43f945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17135327e2d14c4bbe4c7b242f9fda48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:57:29.604425 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-1e61d89f-61ca-458a-b9a2-da402f044d78 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] 10.222.0.18 "GET /compute/v2.1/servers/7c3f6786-1255-40f9-b54a-3e42c7799c4e" status: 200 len: 1674 microversion: 2.1 time: 0.221429 Oct 22 21:57:29.605042 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3255/6540] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:57:29 2022] GET /compute/v2.1/servers/7c3f6786-1255-40f9-b54a-3e42c7799c4e => generated 1674 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:57:30.282620 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-b0972951-59ba-45bb-8bef-0f6176590c83 req-cce14bf5-a34c-4e45-bcf5-26758d2547af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c3f6786-1255-40f9-b54a-3e42c7799c4e", "name": "network-vif-plugged", "status": "completed", "tag": "a30cb8aa-b665-4130-906a-6253e52bf9b0"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:57:30.296864 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-b0972951-59ba-45bb-8bef-0f6176590c83 req-cce14bf5-a34c-4e45-bcf5-26758d2547af service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:57:30.297350 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-b0972951-59ba-45bb-8bef-0f6176590c83 req-cce14bf5-a34c-4e45-bcf5-26758d2547af service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:57:30.297791 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-b0972951-59ba-45bb-8bef-0f6176590c83 req-cce14bf5-a34c-4e45-bcf5-26758d2547af service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:57:30.309401 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-b0972951-59ba-45bb-8bef-0f6176590c83 req-cce14bf5-a34c-4e45-bcf5-26758d2547af service nova] Creating event network-vif-plugged:a30cb8aa-b665-4130-906a-6253e52bf9b0 for instance 7c3f6786-1255-40f9-b54a-3e42c7799c4e on nch2-master-1 Oct 22 21:57:30.315049 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [req-b0972951-59ba-45bb-8bef-0f6176590c83 req-cce14bf5-a34c-4e45-bcf5-26758d2547af service nova] Instance 7c3f6786-1255-40f9-b54a-3e42c7799c4e is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=138745) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 22 21:57:30.326316 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-b0972951-59ba-45bb-8bef-0f6176590c83 req-cce14bf5-a34c-4e45-bcf5-26758d2547af service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049890 Oct 22 21:57:30.326971 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3286/6541] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:57:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:57:30.629465 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-8fdd450f-c065-4231-b9aa-4e4610d2de55 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:57:30.630078 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-8fdd450f-c065-4231-b9aa-4e4610d2de55 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] [instance: 7c3f6786-1255-40f9-b54a-3e42c7799c4e] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:57:30.637669 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8fdd450f-c065-4231-b9aa-4e4610d2de55 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:57:30.638303 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8fdd450f-c065-4231-b9aa-4e4610d2de55 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:57:30.638762 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8fdd450f-c065-4231-b9aa-4e4610d2de55 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:57:30.639508 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8fdd450f-c065-4231-b9aa-4e4610d2de55 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:57:30.639967 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8fdd450f-c065-4231-b9aa-4e4610d2de55 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:57:30.640378 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8fdd450f-c065-4231-b9aa-4e4610d2de55 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:57:30.775485 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-8fdd450f-c065-4231-b9aa-4e4610d2de55 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1a4da366004680b7330a8e9f43f945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17135327e2d14c4bbe4c7b242f9fda48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:57:30.787048 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-8fdd450f-c065-4231-b9aa-4e4610d2de55 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] 10.222.0.18 "GET /compute/v2.1/servers/7c3f6786-1255-40f9-b54a-3e42c7799c4e" status: 200 len: 1674 microversion: 2.1 time: 0.161278 Oct 22 21:57:30.787727 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3256/6542] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:57:30 2022] GET /compute/v2.1/servers/7c3f6786-1255-40f9-b54a-3e42c7799c4e => generated 1674 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:57:31.862142 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-6fa8b3f8-e4e2-4449-9782-05e820fd9bea tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:57:31.862895 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-6fa8b3f8-e4e2-4449-9782-05e820fd9bea tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] [instance: 7c3f6786-1255-40f9-b54a-3e42c7799c4e] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:57:31.869403 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6fa8b3f8-e4e2-4449-9782-05e820fd9bea tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:57:31.869905 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6fa8b3f8-e4e2-4449-9782-05e820fd9bea tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:57:31.870358 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6fa8b3f8-e4e2-4449-9782-05e820fd9bea tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:57:31.871062 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6fa8b3f8-e4e2-4449-9782-05e820fd9bea tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:57:31.871580 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6fa8b3f8-e4e2-4449-9782-05e820fd9bea tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:57:31.872129 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6fa8b3f8-e4e2-4449-9782-05e820fd9bea tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:57:32.013773 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-6fa8b3f8-e4e2-4449-9782-05e820fd9bea tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1a4da366004680b7330a8e9f43f945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17135327e2d14c4bbe4c7b242f9fda48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:57:32.017480 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:57:32.022457 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-6fa8b3f8-e4e2-4449-9782-05e820fd9bea tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] 10.222.0.18 "GET /compute/v2.1/servers/7c3f6786-1255-40f9-b54a-3e42c7799c4e" status: 200 len: 1674 microversion: 2.1 time: 0.213420 Oct 22 21:57:32.023265 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3287/6543] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:57:31 2022] GET /compute/v2.1/servers/7c3f6786-1255-40f9-b54a-3e42c7799c4e => generated 1674 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:57:32.862175 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-6f983edc-8af4-4d73-9899-30519fd593b9 req-6224712c-e903-41f3-b406-eec0d5322ecd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c3f6786-1255-40f9-b54a-3e42c7799c4e", "name": "network-vif-unplugged", "status": "completed", "tag": "a30cb8aa-b665-4130-906a-6253e52bf9b0"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:57:32.873191 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-6f983edc-8af4-4d73-9899-30519fd593b9 req-6224712c-e903-41f3-b406-eec0d5322ecd service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:57:32.873696 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-6f983edc-8af4-4d73-9899-30519fd593b9 req-6224712c-e903-41f3-b406-eec0d5322ecd service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:57:32.874161 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-6f983edc-8af4-4d73-9899-30519fd593b9 req-6224712c-e903-41f3-b406-eec0d5322ecd service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:57:32.886697 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-6f983edc-8af4-4d73-9899-30519fd593b9 req-6224712c-e903-41f3-b406-eec0d5322ecd service nova] Creating event network-vif-unplugged:a30cb8aa-b665-4130-906a-6253e52bf9b0 for instance 7c3f6786-1255-40f9-b54a-3e42c7799c4e on nch1-master-1 Oct 22 21:57:32.892668 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [req-6f983edc-8af4-4d73-9899-30519fd593b9 req-6224712c-e903-41f3-b406-eec0d5322ecd service nova] Instance 7c3f6786-1255-40f9-b54a-3e42c7799c4e is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=138744) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 22 21:57:32.903857 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-6f983edc-8af4-4d73-9899-30519fd593b9 req-6224712c-e903-41f3-b406-eec0d5322ecd service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045417 Oct 22 21:57:32.904472 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3257/6544] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:57:32 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:57:33.046605 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-ad316f9b-abed-418e-bf66-0d7644aedfda tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:57:33.047258 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-ad316f9b-abed-418e-bf66-0d7644aedfda tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] [instance: 7c3f6786-1255-40f9-b54a-3e42c7799c4e] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:57:33.055188 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ad316f9b-abed-418e-bf66-0d7644aedfda tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:57:33.055729 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ad316f9b-abed-418e-bf66-0d7644aedfda tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:57:33.056227 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ad316f9b-abed-418e-bf66-0d7644aedfda tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:57:33.056953 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ad316f9b-abed-418e-bf66-0d7644aedfda tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:57:33.057427 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ad316f9b-abed-418e-bf66-0d7644aedfda tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:57:33.057853 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ad316f9b-abed-418e-bf66-0d7644aedfda tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:57:33.193657 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-ad316f9b-abed-418e-bf66-0d7644aedfda tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1a4da366004680b7330a8e9f43f945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17135327e2d14c4bbe4c7b242f9fda48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:57:33.201957 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-ad316f9b-abed-418e-bf66-0d7644aedfda tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] 10.222.0.18 "GET /compute/v2.1/servers/7c3f6786-1255-40f9-b54a-3e42c7799c4e" status: 200 len: 1674 microversion: 2.1 time: 0.159507 Oct 22 21:57:33.202555 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3288/6545] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:57:33 2022] GET /compute/v2.1/servers/7c3f6786-1255-40f9-b54a-3e42c7799c4e => generated 1674 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:57:34.227934 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-fa274c63-ccee-4486-b53d-36dde6084738 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:57:34.228641 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-fa274c63-ccee-4486-b53d-36dde6084738 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] [instance: 7c3f6786-1255-40f9-b54a-3e42c7799c4e] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:57:34.235505 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fa274c63-ccee-4486-b53d-36dde6084738 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:57:34.235999 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fa274c63-ccee-4486-b53d-36dde6084738 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:57:34.236432 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fa274c63-ccee-4486-b53d-36dde6084738 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:57:34.237125 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fa274c63-ccee-4486-b53d-36dde6084738 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:57:34.237660 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fa274c63-ccee-4486-b53d-36dde6084738 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:57:34.238003 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fa274c63-ccee-4486-b53d-36dde6084738 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:57:34.378849 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-fa274c63-ccee-4486-b53d-36dde6084738 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1a4da366004680b7330a8e9f43f945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17135327e2d14c4bbe4c7b242f9fda48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:57:34.390245 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-fa274c63-ccee-4486-b53d-36dde6084738 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] 10.222.0.18 "GET /compute/v2.1/servers/7c3f6786-1255-40f9-b54a-3e42c7799c4e" status: 200 len: 1674 microversion: 2.1 time: 0.167716 Oct 22 21:57:34.390795 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3258/6546] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:57:34 2022] GET /compute/v2.1/servers/7c3f6786-1255-40f9-b54a-3e42c7799c4e => generated 1674 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:57:34.922829 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-82d93ec7-bffe-4725-853d-2928563ffca7 req-a3cacf1d-9409-4da5-be54-a671b27814f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c3f6786-1255-40f9-b54a-3e42c7799c4e", "tag": "a30cb8aa-b665-4130-906a-6253e52bf9b0"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:57:34.933637 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-82d93ec7-bffe-4725-853d-2928563ffca7 req-a3cacf1d-9409-4da5-be54-a671b27814f9 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:57:34.934125 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-82d93ec7-bffe-4725-853d-2928563ffca7 req-a3cacf1d-9409-4da5-be54-a671b27814f9 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:57:34.934567 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-82d93ec7-bffe-4725-853d-2928563ffca7 req-a3cacf1d-9409-4da5-be54-a671b27814f9 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:57:34.946849 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-82d93ec7-bffe-4725-853d-2928563ffca7 req-a3cacf1d-9409-4da5-be54-a671b27814f9 service nova] Creating event network-changed:a30cb8aa-b665-4130-906a-6253e52bf9b0 for instance 7c3f6786-1255-40f9-b54a-3e42c7799c4e on nch1-master-1 Oct 22 21:57:34.953013 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [req-82d93ec7-bffe-4725-853d-2928563ffca7 req-a3cacf1d-9409-4da5-be54-a671b27814f9 service nova] Instance 7c3f6786-1255-40f9-b54a-3e42c7799c4e is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=138745) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 22 21:57:34.965361 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-82d93ec7-bffe-4725-853d-2928563ffca7 req-a3cacf1d-9409-4da5-be54-a671b27814f9 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047061 Oct 22 21:57:34.966329 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3289/6547] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:57:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:57:35.414365 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-c22aa63b-720c-4b79-8207-c7e097dc9764 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:57:35.414998 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-c22aa63b-720c-4b79-8207-c7e097dc9764 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] [instance: 7c3f6786-1255-40f9-b54a-3e42c7799c4e] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:57:35.421985 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c22aa63b-720c-4b79-8207-c7e097dc9764 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:57:35.422474 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c22aa63b-720c-4b79-8207-c7e097dc9764 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:57:35.422923 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c22aa63b-720c-4b79-8207-c7e097dc9764 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:57:35.423671 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c22aa63b-720c-4b79-8207-c7e097dc9764 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:57:35.424141 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c22aa63b-720c-4b79-8207-c7e097dc9764 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:57:35.424693 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c22aa63b-720c-4b79-8207-c7e097dc9764 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:57:35.619153 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-c22aa63b-720c-4b79-8207-c7e097dc9764 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1a4da366004680b7330a8e9f43f945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17135327e2d14c4bbe4c7b242f9fda48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:57:35.629327 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-c22aa63b-720c-4b79-8207-c7e097dc9764 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] 10.222.0.18 "GET /compute/v2.1/servers/7c3f6786-1255-40f9-b54a-3e42c7799c4e" status: 200 len: 1674 microversion: 2.1 time: 0.219299 Oct 22 21:57:35.629898 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3259/6548] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:57:35 2022] GET /compute/v2.1/servers/7c3f6786-1255-40f9-b54a-3e42c7799c4e => generated 1674 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:57:36.659348 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-1d3d1de1-dbda-469d-8113-dabe3c11e10c tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:57:36.660930 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-1d3d1de1-dbda-469d-8113-dabe3c11e10c tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] [instance: 7c3f6786-1255-40f9-b54a-3e42c7799c4e] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:57:36.669359 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1d3d1de1-dbda-469d-8113-dabe3c11e10c tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:57:36.670412 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1d3d1de1-dbda-469d-8113-dabe3c11e10c tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:57:36.671107 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1d3d1de1-dbda-469d-8113-dabe3c11e10c tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:57:36.672071 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1d3d1de1-dbda-469d-8113-dabe3c11e10c tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:57:36.672703 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1d3d1de1-dbda-469d-8113-dabe3c11e10c tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:57:36.673305 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1d3d1de1-dbda-469d-8113-dabe3c11e10c tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:57:36.843910 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-1d3d1de1-dbda-469d-8113-dabe3c11e10c tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1a4da366004680b7330a8e9f43f945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17135327e2d14c4bbe4c7b242f9fda48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:57:36.853381 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-1d3d1de1-dbda-469d-8113-dabe3c11e10c tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] 10.222.0.18 "GET /compute/v2.1/servers/7c3f6786-1255-40f9-b54a-3e42c7799c4e" status: 200 len: 1674 microversion: 2.1 time: 0.200747 Oct 22 21:57:36.853967 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3290/6549] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:57:36 2022] GET /compute/v2.1/servers/7c3f6786-1255-40f9-b54a-3e42c7799c4e => generated 1674 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:57:37.879929 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-eeadcf6d-b83d-4b61-a8b8-b3454f159551 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:57:37.880681 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-eeadcf6d-b83d-4b61-a8b8-b3454f159551 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] [instance: 7c3f6786-1255-40f9-b54a-3e42c7799c4e] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:57:37.889614 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-eeadcf6d-b83d-4b61-a8b8-b3454f159551 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:57:37.890326 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-eeadcf6d-b83d-4b61-a8b8-b3454f159551 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:57:37.890809 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-eeadcf6d-b83d-4b61-a8b8-b3454f159551 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:57:37.891561 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-eeadcf6d-b83d-4b61-a8b8-b3454f159551 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:57:37.892026 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-eeadcf6d-b83d-4b61-a8b8-b3454f159551 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:57:37.892530 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-eeadcf6d-b83d-4b61-a8b8-b3454f159551 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:57:38.040823 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-eeadcf6d-b83d-4b61-a8b8-b3454f159551 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1a4da366004680b7330a8e9f43f945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17135327e2d14c4bbe4c7b242f9fda48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:57:38.049219 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-eeadcf6d-b83d-4b61-a8b8-b3454f159551 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] 10.222.0.18 "GET /compute/v2.1/servers/7c3f6786-1255-40f9-b54a-3e42c7799c4e" status: 200 len: 1667 microversion: 2.1 time: 0.174953 Oct 22 21:57:38.049830 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3260/6550] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:57:37 2022] GET /compute/v2.1/servers/7c3f6786-1255-40f9-b54a-3e42c7799c4e => generated 1667 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:57:38.071736 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-0a444b3c-b4e0-4828-bdb1-83948ea84f2f tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:57:38.072340 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-0a444b3c-b4e0-4828-bdb1-83948ea84f2f tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] [instance: 7c3f6786-1255-40f9-b54a-3e42c7799c4e] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:57:38.080061 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0a444b3c-b4e0-4828-bdb1-83948ea84f2f tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:57:38.080557 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0a444b3c-b4e0-4828-bdb1-83948ea84f2f tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:57:38.081005 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0a444b3c-b4e0-4828-bdb1-83948ea84f2f tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:57:38.081714 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0a444b3c-b4e0-4828-bdb1-83948ea84f2f tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:57:38.082172 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0a444b3c-b4e0-4828-bdb1-83948ea84f2f tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:57:38.082606 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0a444b3c-b4e0-4828-bdb1-83948ea84f2f tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:57:38.228363 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-0a444b3c-b4e0-4828-bdb1-83948ea84f2f tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1a4da366004680b7330a8e9f43f945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17135327e2d14c4bbe4c7b242f9fda48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:57:38.236763 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-0a444b3c-b4e0-4828-bdb1-83948ea84f2f tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] 10.222.0.18 "GET /compute/v2.1/servers/7c3f6786-1255-40f9-b54a-3e42c7799c4e" status: 200 len: 1667 microversion: 2.1 time: 0.169115 Oct 22 21:57:38.237339 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3291/6551] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:57:38 2022] GET /compute/v2.1/servers/7c3f6786-1255-40f9-b54a-3e42c7799c4e => generated 1667 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:57:38.265069 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-6950c5f4-8be7-4b50-afc8-f9f96703d728 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:57:38.265894 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-6950c5f4-8be7-4b50-afc8-f9f96703d728 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] [instance: 7c3f6786-1255-40f9-b54a-3e42c7799c4e] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:57:38.272514 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6950c5f4-8be7-4b50-afc8-f9f96703d728 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:57:38.273009 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6950c5f4-8be7-4b50-afc8-f9f96703d728 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:57:38.273468 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6950c5f4-8be7-4b50-afc8-f9f96703d728 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:57:38.274526 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6950c5f4-8be7-4b50-afc8-f9f96703d728 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:57:38.274984 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6950c5f4-8be7-4b50-afc8-f9f96703d728 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:57:38.275441 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6950c5f4-8be7-4b50-afc8-f9f96703d728 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:57:38.413743 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-6950c5f4-8be7-4b50-afc8-f9f96703d728 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1a4da366004680b7330a8e9f43f945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17135327e2d14c4bbe4c7b242f9fda48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:57:38.426280 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-6950c5f4-8be7-4b50-afc8-f9f96703d728 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] 10.222.0.18 "GET /compute/v2.1/servers/7c3f6786-1255-40f9-b54a-3e42c7799c4e" status: 200 len: 1667 microversion: 2.1 time: 0.164776 Oct 22 21:57:38.426960 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3261/6552] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:57:38 2022] GET /compute/v2.1/servers/7c3f6786-1255-40f9-b54a-3e42c7799c4e => generated 1667 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:57:38.452930 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-70b9662e-fefe-4109-9571-702dc4208c83 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:57:38.453346 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-70b9662e-fefe-4109-9571-702dc4208c83 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] [instance: 7c3f6786-1255-40f9-b54a-3e42c7799c4e] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:57:38.459911 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-70b9662e-fefe-4109-9571-702dc4208c83 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:57:38.460425 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-70b9662e-fefe-4109-9571-702dc4208c83 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:57:38.460870 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-70b9662e-fefe-4109-9571-702dc4208c83 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:57:38.461581 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-70b9662e-fefe-4109-9571-702dc4208c83 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:57:38.462110 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-70b9662e-fefe-4109-9571-702dc4208c83 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:57:38.462552 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-70b9662e-fefe-4109-9571-702dc4208c83 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:57:38.497542 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-70b9662e-fefe-4109-9571-702dc4208c83 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] [instance: 7c3f6786-1255-40f9-b54a-3e42c7799c4e] Going to try to terminate instance {{(pid=138745) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 21:57:38.586586 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-70b9662e-fefe-4109-9571-702dc4208c83 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] 10.222.0.18 "DELETE /compute/v2.1/servers/7c3f6786-1255-40f9-b54a-3e42c7799c4e" status: 204 len: 0 microversion: 2.1 time: 0.137480 Oct 22 21:57:38.587426 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3292/6553] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 21:57:38 2022] DELETE /compute/v2.1/servers/7c3f6786-1255-40f9-b54a-3e42c7799c4e => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 21:57:38.596700 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-b629a006-65b3-42ef-b0e4-0fe5bd2209c5 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:57:38.597320 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-b629a006-65b3-42ef-b0e4-0fe5bd2209c5 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] [instance: 7c3f6786-1255-40f9-b54a-3e42c7799c4e] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:57:38.603671 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b629a006-65b3-42ef-b0e4-0fe5bd2209c5 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:57:38.604163 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b629a006-65b3-42ef-b0e4-0fe5bd2209c5 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:57:38.604605 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b629a006-65b3-42ef-b0e4-0fe5bd2209c5 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:57:38.605306 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b629a006-65b3-42ef-b0e4-0fe5bd2209c5 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:57:38.605849 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b629a006-65b3-42ef-b0e4-0fe5bd2209c5 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:57:38.606288 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b629a006-65b3-42ef-b0e4-0fe5bd2209c5 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:57:38.611387 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:SELECT=100 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:57:38.744437 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-b629a006-65b3-42ef-b0e4-0fe5bd2209c5 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1a4da366004680b7330a8e9f43f945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17135327e2d14c4bbe4c7b242f9fda48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:57:38.753473 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-b629a006-65b3-42ef-b0e4-0fe5bd2209c5 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] 10.222.0.18 "GET /compute/v2.1/servers/7c3f6786-1255-40f9-b54a-3e42c7799c4e" status: 200 len: 1673 microversion: 2.1 time: 0.161428 Oct 22 21:57:38.754049 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3262/6554] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:57:38 2022] GET /compute/v2.1/servers/7c3f6786-1255-40f9-b54a-3e42c7799c4e => generated 1673 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:57:38.764305 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-2de76f8a-965a-474b-a008-7f3ec96fdccd req-db00de17-ef26-4550-9410-40ceb04c77e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c3f6786-1255-40f9-b54a-3e42c7799c4e", "name": "network-vif-plugged", "status": "completed", "tag": "a30cb8aa-b665-4130-906a-6253e52bf9b0"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:57:38.774471 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-2de76f8a-965a-474b-a008-7f3ec96fdccd req-db00de17-ef26-4550-9410-40ceb04c77e0 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:57:38.775001 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-2de76f8a-965a-474b-a008-7f3ec96fdccd req-db00de17-ef26-4550-9410-40ceb04c77e0 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:57:38.775505 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-2de76f8a-965a-474b-a008-7f3ec96fdccd req-db00de17-ef26-4550-9410-40ceb04c77e0 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:57:38.787704 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-2de76f8a-965a-474b-a008-7f3ec96fdccd req-db00de17-ef26-4550-9410-40ceb04c77e0 service nova] Creating event network-vif-plugged:a30cb8aa-b665-4130-906a-6253e52bf9b0 for instance 7c3f6786-1255-40f9-b54a-3e42c7799c4e on nch1-master-1 Oct 22 21:57:38.792515 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-2de76f8a-965a-474b-a008-7f3ec96fdccd req-db00de17-ef26-4550-9410-40ceb04c77e0 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032342 Oct 22 21:57:38.793116 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3293/6555] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:57:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:57:39.780546 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-e7d1bb7b-871c-406e-8627-3d66103efbde tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:57:39.781241 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-e7d1bb7b-871c-406e-8627-3d66103efbde tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] [instance: 7c3f6786-1255-40f9-b54a-3e42c7799c4e] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:57:39.788572 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e7d1bb7b-871c-406e-8627-3d66103efbde tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:57:39.789063 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e7d1bb7b-871c-406e-8627-3d66103efbde tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:57:39.789512 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e7d1bb7b-871c-406e-8627-3d66103efbde tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:57:39.790212 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e7d1bb7b-871c-406e-8627-3d66103efbde tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:57:39.790669 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e7d1bb7b-871c-406e-8627-3d66103efbde tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:57:39.791099 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e7d1bb7b-871c-406e-8627-3d66103efbde tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:57:39.924855 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-e7d1bb7b-871c-406e-8627-3d66103efbde tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1a4da366004680b7330a8e9f43f945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17135327e2d14c4bbe4c7b242f9fda48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:57:39.933208 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-e7d1bb7b-871c-406e-8627-3d66103efbde tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] 10.222.0.18 "GET /compute/v2.1/servers/7c3f6786-1255-40f9-b54a-3e42c7799c4e" status: 200 len: 1673 microversion: 2.1 time: 0.158981 Oct 22 21:57:39.933764 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3263/6556] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:57:39 2022] GET /compute/v2.1/servers/7c3f6786-1255-40f9-b54a-3e42c7799c4e => generated 1673 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:57:40.838184 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell0:SELECT=3 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:57:40.843005 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-6b88fb55-91ba-4961-8def-5cb3f4fb012a req-0688f124-d2a5-446b-a247-657258773a18 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c3f6786-1255-40f9-b54a-3e42c7799c4e", "name": "network-vif-deleted", "tag": "a30cb8aa-b665-4130-906a-6253e52bf9b0"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:57:40.848696 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=2 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:57:40.856617 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-6b88fb55-91ba-4961-8def-5cb3f4fb012a req-0688f124-d2a5-446b-a247-657258773a18 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:57:40.857361 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-6b88fb55-91ba-4961-8def-5cb3f4fb012a req-0688f124-d2a5-446b-a247-657258773a18 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:57:40.858216 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-6b88fb55-91ba-4961-8def-5cb3f4fb012a req-0688f124-d2a5-446b-a247-657258773a18 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:57:40.871068 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-6b88fb55-91ba-4961-8def-5cb3f4fb012a req-0688f124-d2a5-446b-a247-657258773a18 service nova] Creating event network-vif-deleted:a30cb8aa-b665-4130-906a-6253e52bf9b0 for instance 7c3f6786-1255-40f9-b54a-3e42c7799c4e on nch1-master-1 Oct 22 21:57:40.876719 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-6b88fb55-91ba-4961-8def-5cb3f4fb012a req-0688f124-d2a5-446b-a247-657258773a18 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040179 Oct 22 21:57:40.877354 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3294/6557] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:57:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:57:40.959895 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-e4e4929e-6726-4864-bbb9-fb04c529277b tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:57:40.961132 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-e4e4929e-6726-4864-bbb9-fb04c529277b tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] [instance: 7c3f6786-1255-40f9-b54a-3e42c7799c4e] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:57:40.964313 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_api:SELECT=39 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:57:40.970395 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e4e4929e-6726-4864-bbb9-fb04c529277b tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:57:40.970900 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e4e4929e-6726-4864-bbb9-fb04c529277b tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:57:40.971308 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e4e4929e-6726-4864-bbb9-fb04c529277b tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:57:40.972181 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e4e4929e-6726-4864-bbb9-fb04c529277b tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:57:40.972720 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e4e4929e-6726-4864-bbb9-fb04c529277b tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:57:40.973087 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e4e4929e-6726-4864-bbb9-fb04c529277b tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:57:41.008799 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e4e4929e-6726-4864-bbb9-fb04c529277b tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:57:41.009291 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e4e4929e-6726-4864-bbb9-fb04c529277b tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:57:41.009732 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e4e4929e-6726-4864-bbb9-fb04c529277b tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:57:41.010186 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.objects.instance [None req-e4e4929e-6726-4864-bbb9-fb04c529277b tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lazy-loading 'fault' on Instance uuid 7c3f6786-1255-40f9-b54a-3e42c7799c4e {{(pid=138744) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 21:57:41.063975 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-e4e4929e-6726-4864-bbb9-fb04c529277b tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1a4da366004680b7330a8e9f43f945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17135327e2d14c4bbe4c7b242f9fda48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:57:41.073478 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-e4e4929e-6726-4864-bbb9-fb04c529277b tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] 10.222.0.18 "GET /compute/v2.1/servers/7c3f6786-1255-40f9-b54a-3e42c7799c4e" status: 200 len: 1325 microversion: 2.1 time: 0.120336 Oct 22 21:57:41.074081 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3264/6558] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:57:40 2022] GET /compute/v2.1/servers/7c3f6786-1255-40f9-b54a-3e42c7799c4e => generated 1325 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:57:42.099825 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-40800f6f-d823-4001-b46f-3ba6d5b4b4a3 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:57:42.100448 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-40800f6f-d823-4001-b46f-3ba6d5b4b4a3 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] [instance: 7c3f6786-1255-40f9-b54a-3e42c7799c4e] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:57:42.107289 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-40800f6f-d823-4001-b46f-3ba6d5b4b4a3 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:57:42.107786 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-40800f6f-d823-4001-b46f-3ba6d5b4b4a3 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:57:42.108269 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-40800f6f-d823-4001-b46f-3ba6d5b4b4a3 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:57:42.108975 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-40800f6f-d823-4001-b46f-3ba6d5b4b4a3 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:57:42.109445 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-40800f6f-d823-4001-b46f-3ba6d5b4b4a3 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:57:42.109884 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-40800f6f-d823-4001-b46f-3ba6d5b4b4a3 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:57:42.123883 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.wsgi [None req-40800f6f-d823-4001-b46f-3ba6d5b4b4a3 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] HTTP exception thrown: Instance 7c3f6786-1255-40f9-b54a-3e42c7799c4e could not be found. Oct 22 21:57:42.125610 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-40800f6f-d823-4001-b46f-3ba6d5b4b4a3 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Request method failure captured: Oct 22 21:57:42.125610 ncdv-master-1 devstack@n-api.service[138745]: request: GET /compute/v2.1/servers/7c3f6786-1255-40f9-b54a-3e42c7799c4e HTTP/1.1 Oct 22 21:57:42.125610 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 21:57:42.125610 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 21:57:42.125610 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 21:57:42.125610 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 0 Oct 22 21:57:42.125610 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 21:57:42.125610 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 21:57:42.125610 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 21:57:42.125610 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 21:57:42.125610 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVGYfDlcA9KGX2QlEp4u0j0Sc-lLfggp70EjXb3-sPhTyz6zB5UiJn8D5kqopVhrN_VN9rM0kOlrwARqwadQ16Olp9k3UgVUKiPcvbjWntYV4vZGIhwWOxDtvedxf_ou8I06I86O9hYoH_RNiO9r53LOOM9uLYhVbGc37T_1RXkzoTZs Oct 22 21:57:42.125610 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 21:57:42.125610 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 21:57:42.125610 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 21:57:42.125610 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 21:57:42.125610 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 21:57:42.125610 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 21:57:42.125610 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: 17135327e2d14c4bbe4c7b242f9fda48 Oct 22 21:57:42.125610 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-ServerActionsTestJSON-1985295999 Oct 22 21:57:42.125610 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 21:57:42.125610 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 21:57:42.125610 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_17135327e2d14c4bbe4c7b242f9fda48"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/17135327e2d14c4bbe4c7b242f9fda48"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/17135327e2d14c4bbe4c7b242f9fda48"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/17135327e2d14c4bbe4c7b242f9fda48"}]}] Oct 22 21:57:42.125610 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-ServerActionsTestJSON-1985295999 Oct 22 21:57:42.125610 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: 17135327e2d14c4bbe4c7b242f9fda48 Oct 22 21:57:42.125610 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-ServerActionsTestJSON-1985295999 Oct 22 21:57:42.125610 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-ServerActionsTestJSON-1985295999-project Oct 22 21:57:42.125610 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 21:57:42.125610 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 21:57:42.125610 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: ce1a4da366004680b7330a8e9f43f945 Oct 22 21:57:42.125610 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-ServerActionsTestJSON-1985295999-project Oct 22 21:57:42.125610 ncdv-master-1 devstack@n-api.service[138745]: method: > Oct 22 21:57:42.125610 ncdv-master-1 devstack@n-api.service[138745]: exception: Instance 7c3f6786-1255-40f9-b54a-3e42c7799c4e could not be found. Oct 22 21:57:42.125610 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'id': '7c3f6786-1255-40f9-b54a-3e42c7799c4e'} Oct 22 21:57:42.125610 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:57:42.125610 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:57:42.125610 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 21:57:42.125610 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 21:57:42.125610 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 21:57:42.125610 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 21:57:42.125610 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 21:57:42.125610 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 21:57:42.125610 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 21:57:42.125610 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 21:57:42.125610 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c3f6786-1255-40f9-b54a-3e42c7799c4e could not be found. Oct 22 21:57:42.125610 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:57:42.125610 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:57:42.125610 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:57:42.125610 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:57:42.125610 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:57:42.125610 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:57:42.125610 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:57:42.125610 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:57:42.125610 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:57:42.125610 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:57:42.125610 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 21:57:42.125610 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 21:57:42.125610 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 21:57:42.125610 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 21:57:42.125610 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 21:57:42.125610 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:57:42.125610 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c3f6786-1255-40f9-b54a-3e42c7799c4e could not be found. Oct 22 21:57:42.125610 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:57:42.125610 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:57:42.125610 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:57:42.130231 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:57:42.130231 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:57:42.130231 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:57:42.130231 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:57:42.130231 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:57:42.130231 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c3f6786-1255-40f9-b54a-3e42c7799c4e could not be found. Oct 22 21:57:42.130231 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:57:42.130231 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-40800f6f-d823-4001-b46f-3ba6d5b4b4a3 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Returning 404 to user: Instance 7c3f6786-1255-40f9-b54a-3e42c7799c4e could not be found. {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:57:42.130231 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-40800f6f-d823-4001-b46f-3ba6d5b4b4a3 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] 10.222.0.18 "GET /compute/v2.1/servers/7c3f6786-1255-40f9-b54a-3e42c7799c4e" status: 404 len: 111 microversion: 2.1 time: 0.032701 Oct 22 21:57:42.130231 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3295/6559] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:57:42 2022] GET /compute/v2.1/servers/7c3f6786-1255-40f9-b54a-3e42c7799c4e => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 21:57:42.144829 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-b44ca985-3672-4395-a559-10a40162b085 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:57:42.145608 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-b44ca985-3672-4395-a559-10a40162b085 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] [instance: 7c3f6786-1255-40f9-b54a-3e42c7799c4e] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:57:42.156220 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b44ca985-3672-4395-a559-10a40162b085 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:57:42.156834 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b44ca985-3672-4395-a559-10a40162b085 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:57:42.157261 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b44ca985-3672-4395-a559-10a40162b085 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:57:42.157968 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b44ca985-3672-4395-a559-10a40162b085 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:57:42.158426 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b44ca985-3672-4395-a559-10a40162b085 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:57:42.158860 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b44ca985-3672-4395-a559-10a40162b085 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:57:42.172637 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-b44ca985-3672-4395-a559-10a40162b085 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] HTTP exception thrown: Instance 7c3f6786-1255-40f9-b54a-3e42c7799c4e could not be found. Oct 22 21:57:42.174297 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-b44ca985-3672-4395-a559-10a40162b085 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Request method failure captured: Oct 22 21:57:42.174297 ncdv-master-1 devstack@n-api.service[138744]: request: GET /compute/v2.1/servers/7c3f6786-1255-40f9-b54a-3e42c7799c4e HTTP/1.1 Oct 22 21:57:42.174297 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 21:57:42.174297 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 21:57:42.174297 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 21:57:42.174297 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 0 Oct 22 21:57:42.174297 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 21:57:42.174297 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 21:57:42.174297 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 21:57:42.174297 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 21:57:42.174297 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVGYfDlcA9KGX2QlEp4u0j0Sc-lLfggp70EjXb3-sPhTyz6zB5UiJn8D5kqopVhrN_VN9rM0kOlrwARqwadQ16Olp9k3UgVUKiPcvbjWntYV4vZGIhwWOxDtvedxf_ou8I06I86O9hYoH_RNiO9r53LOOM9uLYhVbGc37T_1RXkzoTZs Oct 22 21:57:42.174297 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 21:57:42.174297 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 21:57:42.174297 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 21:57:42.174297 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 21:57:42.174297 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 21:57:42.174297 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 21:57:42.174297 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: 17135327e2d14c4bbe4c7b242f9fda48 Oct 22 21:57:42.174297 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-ServerActionsTestJSON-1985295999 Oct 22 21:57:42.174297 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 21:57:42.174297 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 21:57:42.174297 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_17135327e2d14c4bbe4c7b242f9fda48"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/17135327e2d14c4bbe4c7b242f9fda48"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/17135327e2d14c4bbe4c7b242f9fda48"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/17135327e2d14c4bbe4c7b242f9fda48"}]}] Oct 22 21:57:42.174297 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-ServerActionsTestJSON-1985295999 Oct 22 21:57:42.174297 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: 17135327e2d14c4bbe4c7b242f9fda48 Oct 22 21:57:42.174297 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-ServerActionsTestJSON-1985295999 Oct 22 21:57:42.174297 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-ServerActionsTestJSON-1985295999-project Oct 22 21:57:42.174297 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 21:57:42.174297 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 21:57:42.174297 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: ce1a4da366004680b7330a8e9f43f945 Oct 22 21:57:42.174297 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-ServerActionsTestJSON-1985295999-project Oct 22 21:57:42.174297 ncdv-master-1 devstack@n-api.service[138744]: method: > Oct 22 21:57:42.174297 ncdv-master-1 devstack@n-api.service[138744]: exception: Instance 7c3f6786-1255-40f9-b54a-3e42c7799c4e could not be found. Oct 22 21:57:42.174297 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': '7c3f6786-1255-40f9-b54a-3e42c7799c4e'} Oct 22 21:57:42.174297 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:57:42.174297 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:57:42.174297 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 21:57:42.174297 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 21:57:42.174297 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 21:57:42.174297 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 21:57:42.174297 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 21:57:42.174297 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 21:57:42.174297 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 21:57:42.174297 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 21:57:42.174297 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c3f6786-1255-40f9-b54a-3e42c7799c4e could not be found. Oct 22 21:57:42.174297 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:57:42.174297 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:57:42.174297 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:57:42.174297 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:57:42.174297 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:57:42.174297 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:57:42.174297 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:57:42.174297 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:57:42.174297 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:57:42.174297 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:57:42.174297 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 21:57:42.174297 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 21:57:42.174297 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 21:57:42.174297 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 21:57:42.174297 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 21:57:42.174297 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:57:42.174297 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c3f6786-1255-40f9-b54a-3e42c7799c4e could not be found. Oct 22 21:57:42.174297 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:57:42.174297 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:57:42.174297 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:57:42.178526 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:57:42.178526 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:57:42.178526 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:57:42.178526 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:57:42.178526 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:57:42.178526 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c3f6786-1255-40f9-b54a-3e42c7799c4e could not be found. Oct 22 21:57:42.178526 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:57:42.178526 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-b44ca985-3672-4395-a559-10a40162b085 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Returning 404 to user: Instance 7c3f6786-1255-40f9-b54a-3e42c7799c4e could not be found. {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:57:42.178526 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-b44ca985-3672-4395-a559-10a40162b085 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] 10.222.0.18 "GET /compute/v2.1/servers/7c3f6786-1255-40f9-b54a-3e42c7799c4e" status: 404 len: 111 microversion: 2.1 time: 0.036311 Oct 22 21:57:42.178526 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3265/6560] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:57:42 2022] GET /compute/v2.1/servers/7c3f6786-1255-40f9-b54a-3e42c7799c4e => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 21:57:42.226179 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-3ed4a42b-cef6-4263-9419-adeb54789626 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-141543821", "imageRef": "085e4478-6edc-4a69-8e08-f9831713eb65", "flavorRef": "452", "networks": [{"uuid": "c97efc9f-8481-439f-aa41-fc8c07627ab3"}], "security_groups": [{"name": "tempest-securitygroup--1780263140"}], "key_name": "tempest-keypair-52095379", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:57:42.336598 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.network.neutron [None req-3ed4a42b-cef6-4263-9419-adeb54789626 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] validate_networks() for [('c97efc9f-8481-439f-aa41-fc8c07627ab3', None, None, None, None, None)] {{(pid=138745) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 21:57:42.725057 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-3ed4a42b-cef6-4263-9419-adeb54789626 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Flavor limits 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 21:57:42.725488 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-3ed4a42b-cef6-4263-9419-adeb54789626 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Image limits 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 21:57:42.725986 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-3ed4a42b-cef6-4263-9419-adeb54789626 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Flavor pref 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 21:57:42.726404 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-3ed4a42b-cef6-4263-9419-adeb54789626 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Image pref 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 21:57:42.726822 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-3ed4a42b-cef6-4263-9419-adeb54789626 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 21:57:42.735858 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3ed4a42b-cef6-4263-9419-adeb54789626 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:57:42.736348 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3ed4a42b-cef6-4263-9419-adeb54789626 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:57:42.736811 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3ed4a42b-cef6-4263-9419-adeb54789626 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:57:42.737523 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3ed4a42b-cef6-4263-9419-adeb54789626 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:57:42.737985 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3ed4a42b-cef6-4263-9419-adeb54789626 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:57:42.738420 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3ed4a42b-cef6-4263-9419-adeb54789626 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:57:42.755564 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-3ed4a42b-cef6-4263-9419-adeb54789626 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Getting quotas for project 17135327e2d14c4bbe4c7b242f9fda48. Resources: {'cores', 'instances', 'ram'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 21:57:42.760972 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-3ed4a42b-cef6-4263-9419-adeb54789626 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Getting quotas for user ce1a4da366004680b7330a8e9f43f945 and project 17135327e2d14c4bbe4c7b242f9fda48. Resources: {'cores', 'instances', 'ram'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 21:57:42.774076 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-3ed4a42b-cef6-4263-9419-adeb54789626 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Going to run 1 instances... {{(pid=138745) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 21:57:42.776478 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-3ed4a42b-cef6-4263-9419-adeb54789626 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] [instance: c7b1f93e-a960-4f71-aaf5-4416cca1d22b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='085e4478-6edc-4a69-8e08-f9831713eb65',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138745) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 21:57:42.826352 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-3ed4a42b-cef6-4263-9419-adeb54789626 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.604111 Oct 22 21:57:42.827013 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3296/6561] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Oct 22 21:57:42 2022] POST /compute/v2.1/servers => generated 406 bytes in 605 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 21:57:42.838474 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-85988a5d-704c-4b0e-86f8-b5be2ba2e41b tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:57:42.839093 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-85988a5d-704c-4b0e-86f8-b5be2ba2e41b tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] [instance: c7b1f93e-a960-4f71-aaf5-4416cca1d22b] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:57:42.894455 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-85988a5d-704c-4b0e-86f8-b5be2ba2e41b tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1a4da366004680b7330a8e9f43f945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17135327e2d14c4bbe4c7b242f9fda48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:57:42.901504 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-85988a5d-704c-4b0e-86f8-b5be2ba2e41b tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] 10.222.0.18 "GET /compute/v2.1/servers/c7b1f93e-a960-4f71-aaf5-4416cca1d22b" status: 200 len: 1236 microversion: 2.1 time: 0.066963 Oct 22 21:57:42.902087 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3266/6562] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:57:42 2022] GET /compute/v2.1/servers/c7b1f93e-a960-4f71-aaf5-4416cca1d22b => generated 1236 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:57:43.925042 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-bde912d9-ff80-4e03-b68b-02e5fab66a85 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:57:43.925906 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-bde912d9-ff80-4e03-b68b-02e5fab66a85 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] [instance: c7b1f93e-a960-4f71-aaf5-4416cca1d22b] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:57:43.941081 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bde912d9-ff80-4e03-b68b-02e5fab66a85 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:57:43.941581 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bde912d9-ff80-4e03-b68b-02e5fab66a85 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:57:43.942075 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bde912d9-ff80-4e03-b68b-02e5fab66a85 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:57:43.942788 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bde912d9-ff80-4e03-b68b-02e5fab66a85 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:57:43.943265 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bde912d9-ff80-4e03-b68b-02e5fab66a85 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:57:43.943743 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bde912d9-ff80-4e03-b68b-02e5fab66a85 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:57:44.021619 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-bde912d9-ff80-4e03-b68b-02e5fab66a85 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1a4da366004680b7330a8e9f43f945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17135327e2d14c4bbe4c7b242f9fda48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:57:44.030296 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-bde912d9-ff80-4e03-b68b-02e5fab66a85 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] 10.222.0.18 "GET /compute/v2.1/servers/c7b1f93e-a960-4f71-aaf5-4416cca1d22b" status: 200 len: 1296 microversion: 2.1 time: 0.109323 Oct 22 21:57:44.031371 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3297/6563] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:57:43 2022] GET /compute/v2.1/servers/c7b1f93e-a960-4f71-aaf5-4416cca1d22b => generated 1296 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:57:45.054205 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-d61c5240-9757-46c7-a1c1-f9de60d5a83b tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:57:45.054791 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-d61c5240-9757-46c7-a1c1-f9de60d5a83b tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] [instance: c7b1f93e-a960-4f71-aaf5-4416cca1d22b] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:57:45.064168 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d61c5240-9757-46c7-a1c1-f9de60d5a83b tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:57:45.064911 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d61c5240-9757-46c7-a1c1-f9de60d5a83b tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:57:45.065352 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d61c5240-9757-46c7-a1c1-f9de60d5a83b tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:57:45.066064 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d61c5240-9757-46c7-a1c1-f9de60d5a83b tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:57:45.066517 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d61c5240-9757-46c7-a1c1-f9de60d5a83b tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:57:45.066944 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d61c5240-9757-46c7-a1c1-f9de60d5a83b tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:57:45.289765 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-d61c5240-9757-46c7-a1c1-f9de60d5a83b tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1a4da366004680b7330a8e9f43f945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17135327e2d14c4bbe4c7b242f9fda48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:57:45.298500 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-d61c5240-9757-46c7-a1c1-f9de60d5a83b tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] 10.222.0.18 "GET /compute/v2.1/servers/c7b1f93e-a960-4f71-aaf5-4416cca1d22b" status: 200 len: 1362 microversion: 2.1 time: 0.248212 Oct 22 21:57:45.299320 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3267/6564] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:57:45 2022] GET /compute/v2.1/servers/c7b1f93e-a960-4f71-aaf5-4416cca1d22b => generated 1362 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:57:45.479997 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-eda8a922-965e-499c-811b-3373a172c776 req-36e991d2-552d-4d61-b316-5ee9c117ca83 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7b1f93e-a960-4f71-aaf5-4416cca1d22b", "tag": "5467bf4d-26fd-4b2c-8fc7-4e47f53c767f"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:57:45.493034 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-eda8a922-965e-499c-811b-3373a172c776 req-36e991d2-552d-4d61-b316-5ee9c117ca83 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:57:45.493644 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-eda8a922-965e-499c-811b-3373a172c776 req-36e991d2-552d-4d61-b316-5ee9c117ca83 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:57:45.494182 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-eda8a922-965e-499c-811b-3373a172c776 req-36e991d2-552d-4d61-b316-5ee9c117ca83 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:57:45.506752 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-eda8a922-965e-499c-811b-3373a172c776 req-36e991d2-552d-4d61-b316-5ee9c117ca83 service nova] Creating event network-changed:5467bf4d-26fd-4b2c-8fc7-4e47f53c767f for instance c7b1f93e-a960-4f71-aaf5-4416cca1d22b on nch2-master-1 Oct 22 21:57:45.511990 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-eda8a922-965e-499c-811b-3373a172c776 req-36e991d2-552d-4d61-b316-5ee9c117ca83 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035839 Oct 22 21:57:45.512718 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3298/6565] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:57:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:57:46.326636 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-4da50b45-120f-4cff-a8f9-e17efb1b4d6c tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:57:46.328000 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-4da50b45-120f-4cff-a8f9-e17efb1b4d6c tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] [instance: c7b1f93e-a960-4f71-aaf5-4416cca1d22b] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:57:46.335273 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4da50b45-120f-4cff-a8f9-e17efb1b4d6c tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:57:46.335799 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4da50b45-120f-4cff-a8f9-e17efb1b4d6c tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:57:46.336239 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4da50b45-120f-4cff-a8f9-e17efb1b4d6c tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:57:46.336936 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4da50b45-120f-4cff-a8f9-e17efb1b4d6c tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:57:46.337390 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4da50b45-120f-4cff-a8f9-e17efb1b4d6c tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:57:46.337819 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4da50b45-120f-4cff-a8f9-e17efb1b4d6c tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:57:46.482621 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-4da50b45-120f-4cff-a8f9-e17efb1b4d6c tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1a4da366004680b7330a8e9f43f945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17135327e2d14c4bbe4c7b242f9fda48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:57:46.491080 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-4da50b45-120f-4cff-a8f9-e17efb1b4d6c tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] 10.222.0.18 "GET /compute/v2.1/servers/c7b1f93e-a960-4f71-aaf5-4416cca1d22b" status: 200 len: 1362 microversion: 2.1 time: 0.171046 Oct 22 21:57:46.491717 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3268/6566] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:57:46 2022] GET /compute/v2.1/servers/c7b1f93e-a960-4f71-aaf5-4416cca1d22b => generated 1362 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:57:47.520212 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-5aec7765-7ed7-47ad-b72e-a2d4ef0c1b7c tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:57:47.520914 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-5aec7765-7ed7-47ad-b72e-a2d4ef0c1b7c tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] [instance: c7b1f93e-a960-4f71-aaf5-4416cca1d22b] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:57:47.529480 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5aec7765-7ed7-47ad-b72e-a2d4ef0c1b7c tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:57:47.530155 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5aec7765-7ed7-47ad-b72e-a2d4ef0c1b7c tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:57:47.530762 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5aec7765-7ed7-47ad-b72e-a2d4ef0c1b7c tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:57:47.531864 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5aec7765-7ed7-47ad-b72e-a2d4ef0c1b7c tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:57:47.532380 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5aec7765-7ed7-47ad-b72e-a2d4ef0c1b7c tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:57:47.533074 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5aec7765-7ed7-47ad-b72e-a2d4ef0c1b7c tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:57:47.675952 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-5aec7765-7ed7-47ad-b72e-a2d4ef0c1b7c tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1a4da366004680b7330a8e9f43f945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17135327e2d14c4bbe4c7b242f9fda48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:57:47.683871 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-5aec7765-7ed7-47ad-b72e-a2d4ef0c1b7c tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] 10.222.0.18 "GET /compute/v2.1/servers/c7b1f93e-a960-4f71-aaf5-4416cca1d22b" status: 200 len: 1362 microversion: 2.1 time: 0.172108 Oct 22 21:57:47.684438 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3299/6567] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:57:47 2022] GET /compute/v2.1/servers/c7b1f93e-a960-4f71-aaf5-4416cca1d22b => generated 1362 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:57:48.707905 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-efd4af24-18a3-4a43-9d73-321eb731bffa tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:57:48.708540 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-efd4af24-18a3-4a43-9d73-321eb731bffa tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] [instance: c7b1f93e-a960-4f71-aaf5-4416cca1d22b] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:57:48.715937 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-efd4af24-18a3-4a43-9d73-321eb731bffa tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:57:48.716427 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-efd4af24-18a3-4a43-9d73-321eb731bffa tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:57:48.716867 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-efd4af24-18a3-4a43-9d73-321eb731bffa tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:57:48.717911 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-efd4af24-18a3-4a43-9d73-321eb731bffa tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:57:48.718331 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-efd4af24-18a3-4a43-9d73-321eb731bffa tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:57:48.718794 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-efd4af24-18a3-4a43-9d73-321eb731bffa tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:57:48.852706 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-efd4af24-18a3-4a43-9d73-321eb731bffa tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1a4da366004680b7330a8e9f43f945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17135327e2d14c4bbe4c7b242f9fda48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:57:48.864711 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-efd4af24-18a3-4a43-9d73-321eb731bffa tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] 10.222.0.18 "GET /compute/v2.1/servers/c7b1f93e-a960-4f71-aaf5-4416cca1d22b" status: 200 len: 1362 microversion: 2.1 time: 0.160597 Oct 22 21:57:48.865457 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3269/6568] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:57:48 2022] GET /compute/v2.1/servers/c7b1f93e-a960-4f71-aaf5-4416cca1d22b => generated 1362 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:57:49.888340 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-fa403706-d386-4b45-ae96-4fea1b9fcb85 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:57:49.889001 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-fa403706-d386-4b45-ae96-4fea1b9fcb85 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] [instance: c7b1f93e-a960-4f71-aaf5-4416cca1d22b] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:57:49.896586 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fa403706-d386-4b45-ae96-4fea1b9fcb85 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:57:49.897085 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fa403706-d386-4b45-ae96-4fea1b9fcb85 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:57:49.897537 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fa403706-d386-4b45-ae96-4fea1b9fcb85 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:57:49.898251 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fa403706-d386-4b45-ae96-4fea1b9fcb85 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:57:49.898716 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fa403706-d386-4b45-ae96-4fea1b9fcb85 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:57:49.899157 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fa403706-d386-4b45-ae96-4fea1b9fcb85 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:57:50.040597 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-fa403706-d386-4b45-ae96-4fea1b9fcb85 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1a4da366004680b7330a8e9f43f945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17135327e2d14c4bbe4c7b242f9fda48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:57:50.048997 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-fa403706-d386-4b45-ae96-4fea1b9fcb85 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] 10.222.0.18 "GET /compute/v2.1/servers/c7b1f93e-a960-4f71-aaf5-4416cca1d22b" status: 200 len: 1362 microversion: 2.1 time: 0.164425 Oct 22 21:57:50.050195 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3300/6569] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:57:49 2022] GET /compute/v2.1/servers/c7b1f93e-a960-4f71-aaf5-4416cca1d22b => generated 1362 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:57:50.457504 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-257bef1a-f982-47b2-8a22-ea848a3bd7fc req-688d2916-cc33-4dad-aebc-5f908cd1662e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7b1f93e-a960-4f71-aaf5-4416cca1d22b", "name": "network-vif-plugged", "status": "completed", "tag": "5467bf4d-26fd-4b2c-8fc7-4e47f53c767f"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:57:50.467792 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-257bef1a-f982-47b2-8a22-ea848a3bd7fc req-688d2916-cc33-4dad-aebc-5f908cd1662e service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:57:50.468268 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-257bef1a-f982-47b2-8a22-ea848a3bd7fc req-688d2916-cc33-4dad-aebc-5f908cd1662e service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:57:50.468696 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-257bef1a-f982-47b2-8a22-ea848a3bd7fc req-688d2916-cc33-4dad-aebc-5f908cd1662e service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:57:50.480700 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-257bef1a-f982-47b2-8a22-ea848a3bd7fc req-688d2916-cc33-4dad-aebc-5f908cd1662e service nova] Creating event network-vif-plugged:5467bf4d-26fd-4b2c-8fc7-4e47f53c767f for instance c7b1f93e-a960-4f71-aaf5-4416cca1d22b on nch2-master-1 Oct 22 21:57:50.486037 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-257bef1a-f982-47b2-8a22-ea848a3bd7fc req-688d2916-cc33-4dad-aebc-5f908cd1662e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091786 Oct 22 21:57:50.486669 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3270/6570] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:57:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:57:51.073496 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-c9bccad3-a446-4fc6-af10-c62c3c2b282f tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:57:51.074099 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-c9bccad3-a446-4fc6-af10-c62c3c2b282f tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] [instance: c7b1f93e-a960-4f71-aaf5-4416cca1d22b] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:57:51.081584 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c9bccad3-a446-4fc6-af10-c62c3c2b282f tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:57:51.082130 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c9bccad3-a446-4fc6-af10-c62c3c2b282f tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:57:51.082593 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c9bccad3-a446-4fc6-af10-c62c3c2b282f tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:57:51.083316 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c9bccad3-a446-4fc6-af10-c62c3c2b282f tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:57:51.083822 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c9bccad3-a446-4fc6-af10-c62c3c2b282f tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:57:51.084272 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c9bccad3-a446-4fc6-af10-c62c3c2b282f tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:57:51.222774 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-c9bccad3-a446-4fc6-af10-c62c3c2b282f tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1a4da366004680b7330a8e9f43f945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17135327e2d14c4bbe4c7b242f9fda48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:57:51.231083 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-c9bccad3-a446-4fc6-af10-c62c3c2b282f tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] 10.222.0.18 "GET /compute/v2.1/servers/c7b1f93e-a960-4f71-aaf5-4416cca1d22b" status: 200 len: 1362 microversion: 2.1 time: 0.161664 Oct 22 21:57:51.231717 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3301/6571] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:57:51 2022] GET /compute/v2.1/servers/c7b1f93e-a960-4f71-aaf5-4416cca1d22b => generated 1362 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:57:52.257794 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-720376c1-c398-40b8-a356-fe09747f83a6 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:57:52.258725 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-720376c1-c398-40b8-a356-fe09747f83a6 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] [instance: c7b1f93e-a960-4f71-aaf5-4416cca1d22b] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:57:52.267305 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-720376c1-c398-40b8-a356-fe09747f83a6 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:57:52.267964 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-720376c1-c398-40b8-a356-fe09747f83a6 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:57:52.268468 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-720376c1-c398-40b8-a356-fe09747f83a6 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:57:52.269419 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-720376c1-c398-40b8-a356-fe09747f83a6 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:57:52.269910 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-720376c1-c398-40b8-a356-fe09747f83a6 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:57:52.270339 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-720376c1-c398-40b8-a356-fe09747f83a6 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:57:52.408998 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-720376c1-c398-40b8-a356-fe09747f83a6 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1a4da366004680b7330a8e9f43f945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17135327e2d14c4bbe4c7b242f9fda48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:57:52.417506 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-720376c1-c398-40b8-a356-fe09747f83a6 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] 10.222.0.18 "GET /compute/v2.1/servers/c7b1f93e-a960-4f71-aaf5-4416cca1d22b" status: 200 len: 1550 microversion: 2.1 time: 0.166364 Oct 22 21:57:52.418055 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3271/6572] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:57:52 2022] GET /compute/v2.1/servers/c7b1f93e-a960-4f71-aaf5-4416cca1d22b => generated 1550 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:57:52.450087 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-5cb4fa4c-8fa3-4fd0-92cf-a4c7a85fc3d7 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:57:52.450618 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-5cb4fa4c-8fa3-4fd0-92cf-a4c7a85fc3d7 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] [instance: c7b1f93e-a960-4f71-aaf5-4416cca1d22b] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:57:52.458126 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5cb4fa4c-8fa3-4fd0-92cf-a4c7a85fc3d7 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:57:52.458630 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5cb4fa4c-8fa3-4fd0-92cf-a4c7a85fc3d7 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:57:52.459088 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5cb4fa4c-8fa3-4fd0-92cf-a4c7a85fc3d7 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:57:52.459844 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5cb4fa4c-8fa3-4fd0-92cf-a4c7a85fc3d7 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:57:52.460321 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5cb4fa4c-8fa3-4fd0-92cf-a4c7a85fc3d7 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:57:52.460769 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5cb4fa4c-8fa3-4fd0-92cf-a4c7a85fc3d7 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:57:52.540877 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-5cb4fa4c-8fa3-4fd0-92cf-a4c7a85fc3d7 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] 10.222.0.18 "GET /compute/v2.1/servers/c7b1f93e-a960-4f71-aaf5-4416cca1d22b/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.094416 Oct 22 21:57:52.541660 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3302/6573] 10.222.0.18 () {58 vars in 1275 bytes} [Sat Oct 22 21:57:52 2022] GET /compute/v2.1/servers/c7b1f93e-a960-4f71-aaf5-4416cca1d22b/os-interface => generated 285 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:57:53.860417 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-6a18f84b-8206-483c-9662-fe089503c71b req-75f0f3bc-cf43-4580-8b82-b527ebf83440 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7b1f93e-a960-4f71-aaf5-4416cca1d22b", "tag": "5467bf4d-26fd-4b2c-8fc7-4e47f53c767f"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:57:53.865592 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell0:SELECT=2 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:57:53.872680 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-6a18f84b-8206-483c-9662-fe089503c71b req-75f0f3bc-cf43-4580-8b82-b527ebf83440 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:57:53.873170 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-6a18f84b-8206-483c-9662-fe089503c71b req-75f0f3bc-cf43-4580-8b82-b527ebf83440 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:57:53.873608 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-6a18f84b-8206-483c-9662-fe089503c71b req-75f0f3bc-cf43-4580-8b82-b527ebf83440 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:57:53.886182 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-6a18f84b-8206-483c-9662-fe089503c71b req-75f0f3bc-cf43-4580-8b82-b527ebf83440 service nova] Creating event network-changed:5467bf4d-26fd-4b2c-8fc7-4e47f53c767f for instance c7b1f93e-a960-4f71-aaf5-4416cca1d22b on nch2-master-1 Oct 22 21:57:53.891659 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-6a18f84b-8206-483c-9662-fe089503c71b req-75f0f3bc-cf43-4580-8b82-b527ebf83440 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034756 Oct 22 21:57:53.892590 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3272/6574] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:57:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:58:30.450501 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell0:SELECT=2 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:58:30.451467 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell0:SELECT=6 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:58:30.453472 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=3 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:58:30.454147 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:58:30.458554 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-6ce8750a-a2ca-422e-8b61-3c3725c2a49c tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:58:30.459189 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-6ce8750a-a2ca-422e-8b61-3c3725c2a49c tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] [instance: c7b1f93e-a960-4f71-aaf5-4416cca1d22b] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:58:30.468024 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6ce8750a-a2ca-422e-8b61-3c3725c2a49c tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:58:30.468563 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6ce8750a-a2ca-422e-8b61-3c3725c2a49c tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:58:30.469017 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6ce8750a-a2ca-422e-8b61-3c3725c2a49c tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:58:30.469732 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6ce8750a-a2ca-422e-8b61-3c3725c2a49c tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:58:30.470204 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6ce8750a-a2ca-422e-8b61-3c3725c2a49c tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:58:30.470647 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6ce8750a-a2ca-422e-8b61-3c3725c2a49c tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:58:30.609392 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-6ce8750a-a2ca-422e-8b61-3c3725c2a49c tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1a4da366004680b7330a8e9f43f945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17135327e2d14c4bbe4c7b242f9fda48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:58:30.617429 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-6ce8750a-a2ca-422e-8b61-3c3725c2a49c tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] 10.222.0.18 "GET /compute/v2.1/servers/c7b1f93e-a960-4f71-aaf5-4416cca1d22b" status: 200 len: 1669 microversion: 2.1 time: 0.167830 Oct 22 21:58:30.618002 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3303/6575] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:58:30 2022] GET /compute/v2.1/servers/c7b1f93e-a960-4f71-aaf5-4416cca1d22b => generated 1669 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:58:30.638051 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_api:SELECT=21 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:58:30.639011 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:SELECT=48 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:58:30.643216 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-558e39df-f82b-4e6f-81af-3e8c7962341b tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e6e7bd9a-7612-4fa7-a406-9bde82990183"}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:58:30.645742 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-558e39df-f82b-4e6f-81af-3e8c7962341b tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] [instance: c7b1f93e-a960-4f71-aaf5-4416cca1d22b] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:58:30.653023 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-558e39df-f82b-4e6f-81af-3e8c7962341b tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:58:30.653509 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-558e39df-f82b-4e6f-81af-3e8c7962341b tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:58:30.653947 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-558e39df-f82b-4e6f-81af-3e8c7962341b tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:58:30.654652 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-558e39df-f82b-4e6f-81af-3e8c7962341b tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:58:30.655103 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-558e39df-f82b-4e6f-81af-3e8c7962341b tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:58:30.655573 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-558e39df-f82b-4e6f-81af-3e8c7962341b tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:58:30.936746 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-558e39df-f82b-4e6f-81af-3e8c7962341b tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] 10.222.0.18 "POST /compute/v2.1/servers/c7b1f93e-a960-4f71-aaf5-4416cca1d22b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.300397 Oct 22 21:58:30.937526 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3273/6576] 10.222.0.18 () {60 vars in 1323 bytes} [Sat Oct 22 21:58:30 2022] POST /compute/v2.1/servers/c7b1f93e-a960-4f71-aaf5-4416cca1d22b/os-volume_attachments => generated 194 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:58:34.262049 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-b8216ed4-33b2-4a2b-953b-564e23cfd889 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:58:34.264893 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-b8216ed4-33b2-4a2b-953b-564e23cfd889 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] [instance: c7b1f93e-a960-4f71-aaf5-4416cca1d22b] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:58:34.273816 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b8216ed4-33b2-4a2b-953b-564e23cfd889 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:58:34.274326 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b8216ed4-33b2-4a2b-953b-564e23cfd889 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:58:34.274785 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b8216ed4-33b2-4a2b-953b-564e23cfd889 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:58:34.275571 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b8216ed4-33b2-4a2b-953b-564e23cfd889 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:58:34.276048 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b8216ed4-33b2-4a2b-953b-564e23cfd889 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:58:34.276535 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b8216ed4-33b2-4a2b-953b-564e23cfd889 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:58:34.305924 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-b8216ed4-33b2-4a2b-953b-564e23cfd889 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'ce1a4da366004680b7330a8e9f43f945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17135327e2d14c4bbe4c7b242f9fda48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:58:34.312244 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-b8216ed4-33b2-4a2b-953b-564e23cfd889 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] [instance: c7b1f93e-a960-4f71-aaf5-4416cca1d22b] Old instance type m1.heat2, new instance type m1.heat {{(pid=138745) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 22 21:58:34.319981 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-b8216ed4-33b2-4a2b-953b-564e23cfd889 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Flavor limits 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 21:58:34.320426 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-b8216ed4-33b2-4a2b-953b-564e23cfd889 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Image limits 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 21:58:34.320922 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-b8216ed4-33b2-4a2b-953b-564e23cfd889 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Flavor pref 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 21:58:34.321351 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-b8216ed4-33b2-4a2b-953b-564e23cfd889 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Image pref 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 21:58:34.321778 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-b8216ed4-33b2-4a2b-953b-564e23cfd889 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 21:58:34.391711 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-b8216ed4-33b2-4a2b-953b-564e23cfd889 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] 10.222.0.18 "POST /compute/v2.1/servers/c7b1f93e-a960-4f71-aaf5-4416cca1d22b/action" status: 202 len: 0 microversion: 2.1 time: 0.135696 Oct 22 21:58:34.392200 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3304/6577] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 21:58:34 2022] POST /compute/v2.1/servers/c7b1f93e-a960-4f71-aaf5-4416cca1d22b/action => generated 0 bytes in 137 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 21:58:34.401271 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-f9b2b832-7f50-4edc-b2c6-2d82f6bff6d9 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:58:34.402049 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-f9b2b832-7f50-4edc-b2c6-2d82f6bff6d9 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] [instance: c7b1f93e-a960-4f71-aaf5-4416cca1d22b] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:58:34.409485 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f9b2b832-7f50-4edc-b2c6-2d82f6bff6d9 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:58:34.409974 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f9b2b832-7f50-4edc-b2c6-2d82f6bff6d9 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:58:34.410452 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f9b2b832-7f50-4edc-b2c6-2d82f6bff6d9 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:58:34.411157 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f9b2b832-7f50-4edc-b2c6-2d82f6bff6d9 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:58:34.411639 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f9b2b832-7f50-4edc-b2c6-2d82f6bff6d9 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:58:34.412049 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f9b2b832-7f50-4edc-b2c6-2d82f6bff6d9 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:58:34.549611 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-f9b2b832-7f50-4edc-b2c6-2d82f6bff6d9 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1a4da366004680b7330a8e9f43f945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17135327e2d14c4bbe4c7b242f9fda48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:58:34.558576 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-f9b2b832-7f50-4edc-b2c6-2d82f6bff6d9 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] 10.222.0.18 "GET /compute/v2.1/servers/c7b1f93e-a960-4f71-aaf5-4416cca1d22b" status: 200 len: 1724 microversion: 2.1 time: 0.161753 Oct 22 21:58:34.559231 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3274/6578] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:58:34 2022] GET /compute/v2.1/servers/c7b1f93e-a960-4f71-aaf5-4416cca1d22b => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:58:35.583862 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-b1443d51-3ce1-45b8-8bda-7adb28e38fff tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:58:35.584438 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-b1443d51-3ce1-45b8-8bda-7adb28e38fff tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] [instance: c7b1f93e-a960-4f71-aaf5-4416cca1d22b] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:58:35.592256 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b1443d51-3ce1-45b8-8bda-7adb28e38fff tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:58:35.592773 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b1443d51-3ce1-45b8-8bda-7adb28e38fff tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:58:35.593233 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b1443d51-3ce1-45b8-8bda-7adb28e38fff tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:58:35.593955 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b1443d51-3ce1-45b8-8bda-7adb28e38fff tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:58:35.594430 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b1443d51-3ce1-45b8-8bda-7adb28e38fff tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:58:35.594881 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b1443d51-3ce1-45b8-8bda-7adb28e38fff tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:58:35.738292 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-b1443d51-3ce1-45b8-8bda-7adb28e38fff tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1a4da366004680b7330a8e9f43f945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17135327e2d14c4bbe4c7b242f9fda48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:58:35.747260 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-b1443d51-3ce1-45b8-8bda-7adb28e38fff tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] 10.222.0.18 "GET /compute/v2.1/servers/c7b1f93e-a960-4f71-aaf5-4416cca1d22b" status: 200 len: 1724 microversion: 2.1 time: 0.168614 Oct 22 21:58:35.748433 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3305/6579] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:58:35 2022] GET /compute/v2.1/servers/c7b1f93e-a960-4f71-aaf5-4416cca1d22b => generated 1724 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:58:36.771078 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-dcd556f3-bb9e-4656-adc7-ed4a45ca2a5c tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:58:36.771908 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-dcd556f3-bb9e-4656-adc7-ed4a45ca2a5c tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] [instance: c7b1f93e-a960-4f71-aaf5-4416cca1d22b] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:58:36.779620 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-dcd556f3-bb9e-4656-adc7-ed4a45ca2a5c tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:58:36.780155 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-dcd556f3-bb9e-4656-adc7-ed4a45ca2a5c tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:58:36.780648 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-dcd556f3-bb9e-4656-adc7-ed4a45ca2a5c tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:58:36.781421 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-dcd556f3-bb9e-4656-adc7-ed4a45ca2a5c tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:58:36.781920 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-dcd556f3-bb9e-4656-adc7-ed4a45ca2a5c tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:58:36.782397 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-dcd556f3-bb9e-4656-adc7-ed4a45ca2a5c tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:58:36.923518 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-dcd556f3-bb9e-4656-adc7-ed4a45ca2a5c tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1a4da366004680b7330a8e9f43f945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17135327e2d14c4bbe4c7b242f9fda48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:58:36.933677 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-dcd556f3-bb9e-4656-adc7-ed4a45ca2a5c tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] 10.222.0.18 "GET /compute/v2.1/servers/c7b1f93e-a960-4f71-aaf5-4416cca1d22b" status: 200 len: 1729 microversion: 2.1 time: 0.167015 Oct 22 21:58:36.934254 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3275/6580] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:58:36 2022] GET /compute/v2.1/servers/c7b1f93e-a960-4f71-aaf5-4416cca1d22b => generated 1729 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:58:37.960922 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-f9ae03e5-eece-45e7-acd1-92042a7205d9 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:58:37.961585 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-f9ae03e5-eece-45e7-acd1-92042a7205d9 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] [instance: c7b1f93e-a960-4f71-aaf5-4416cca1d22b] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:58:37.970128 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f9ae03e5-eece-45e7-acd1-92042a7205d9 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:58:37.970686 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f9ae03e5-eece-45e7-acd1-92042a7205d9 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:58:37.971192 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f9ae03e5-eece-45e7-acd1-92042a7205d9 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:58:37.972030 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f9ae03e5-eece-45e7-acd1-92042a7205d9 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:58:37.972553 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f9ae03e5-eece-45e7-acd1-92042a7205d9 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:58:37.973048 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f9ae03e5-eece-45e7-acd1-92042a7205d9 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:58:38.110899 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-f9ae03e5-eece-45e7-acd1-92042a7205d9 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1a4da366004680b7330a8e9f43f945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17135327e2d14c4bbe4c7b242f9fda48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:58:38.120013 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-f9ae03e5-eece-45e7-acd1-92042a7205d9 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] 10.222.0.18 "GET /compute/v2.1/servers/c7b1f93e-a960-4f71-aaf5-4416cca1d22b" status: 200 len: 1729 microversion: 2.1 time: 0.165262 Oct 22 21:58:38.120618 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3306/6581] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:58:37 2022] GET /compute/v2.1/servers/c7b1f93e-a960-4f71-aaf5-4416cca1d22b => generated 1729 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:58:39.148703 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-92db7998-ab93-4614-b701-1ae05db9e1b4 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:58:39.149309 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-92db7998-ab93-4614-b701-1ae05db9e1b4 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] [instance: c7b1f93e-a960-4f71-aaf5-4416cca1d22b] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:58:39.156991 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-92db7998-ab93-4614-b701-1ae05db9e1b4 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:58:39.157483 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-92db7998-ab93-4614-b701-1ae05db9e1b4 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:58:39.157954 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-92db7998-ab93-4614-b701-1ae05db9e1b4 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:58:39.158659 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-92db7998-ab93-4614-b701-1ae05db9e1b4 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:58:39.159119 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-92db7998-ab93-4614-b701-1ae05db9e1b4 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:58:39.159591 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-92db7998-ab93-4614-b701-1ae05db9e1b4 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:58:39.299244 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-92db7998-ab93-4614-b701-1ae05db9e1b4 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1a4da366004680b7330a8e9f43f945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17135327e2d14c4bbe4c7b242f9fda48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:58:39.309406 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-92db7998-ab93-4614-b701-1ae05db9e1b4 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] 10.222.0.18 "GET /compute/v2.1/servers/c7b1f93e-a960-4f71-aaf5-4416cca1d22b" status: 200 len: 1729 microversion: 2.1 time: 0.164721 Oct 22 21:58:39.309896 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3276/6582] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:58:39 2022] GET /compute/v2.1/servers/c7b1f93e-a960-4f71-aaf5-4416cca1d22b => generated 1729 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:58:40.346631 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-904fd851-8338-49c1-a2be-e1c43cd51262 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:58:40.347634 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-904fd851-8338-49c1-a2be-e1c43cd51262 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] [instance: c7b1f93e-a960-4f71-aaf5-4416cca1d22b] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:58:40.356171 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-904fd851-8338-49c1-a2be-e1c43cd51262 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:58:40.356667 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-904fd851-8338-49c1-a2be-e1c43cd51262 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:58:40.357197 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-904fd851-8338-49c1-a2be-e1c43cd51262 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:58:40.357907 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-904fd851-8338-49c1-a2be-e1c43cd51262 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:58:40.358376 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-904fd851-8338-49c1-a2be-e1c43cd51262 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:58:40.358816 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-904fd851-8338-49c1-a2be-e1c43cd51262 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:58:40.495691 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-904fd851-8338-49c1-a2be-e1c43cd51262 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1a4da366004680b7330a8e9f43f945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17135327e2d14c4bbe4c7b242f9fda48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:58:40.508052 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-904fd851-8338-49c1-a2be-e1c43cd51262 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] 10.222.0.18 "GET /compute/v2.1/servers/c7b1f93e-a960-4f71-aaf5-4416cca1d22b" status: 200 len: 1729 microversion: 2.1 time: 0.167995 Oct 22 21:58:40.508641 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3307/6583] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:58:40 2022] GET /compute/v2.1/servers/c7b1f93e-a960-4f71-aaf5-4416cca1d22b => generated 1729 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:58:41.536540 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-8dea9003-cd16-43db-894c-427e981bb5a0 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:58:41.537630 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-8dea9003-cd16-43db-894c-427e981bb5a0 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] [instance: c7b1f93e-a960-4f71-aaf5-4416cca1d22b] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:58:41.549649 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8dea9003-cd16-43db-894c-427e981bb5a0 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:58:41.550508 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8dea9003-cd16-43db-894c-427e981bb5a0 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:58:41.551285 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8dea9003-cd16-43db-894c-427e981bb5a0 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:58:41.552457 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8dea9003-cd16-43db-894c-427e981bb5a0 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:58:41.553222 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8dea9003-cd16-43db-894c-427e981bb5a0 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:58:41.554017 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8dea9003-cd16-43db-894c-427e981bb5a0 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:58:41.693305 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-8dea9003-cd16-43db-894c-427e981bb5a0 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1a4da366004680b7330a8e9f43f945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17135327e2d14c4bbe4c7b242f9fda48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:58:41.702222 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-8dea9003-cd16-43db-894c-427e981bb5a0 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] 10.222.0.18 "GET /compute/v2.1/servers/c7b1f93e-a960-4f71-aaf5-4416cca1d22b" status: 200 len: 1729 microversion: 2.1 time: 0.172408 Oct 22 21:58:41.702809 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3277/6584] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:58:41 2022] GET /compute/v2.1/servers/c7b1f93e-a960-4f71-aaf5-4416cca1d22b => generated 1729 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:58:42.726765 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-59d7f2df-cd45-470c-8b3a-6f8d2210f937 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:58:42.727476 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-59d7f2df-cd45-470c-8b3a-6f8d2210f937 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] [instance: c7b1f93e-a960-4f71-aaf5-4416cca1d22b] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:58:42.734764 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-59d7f2df-cd45-470c-8b3a-6f8d2210f937 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:58:42.735268 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-59d7f2df-cd45-470c-8b3a-6f8d2210f937 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:58:42.735839 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-59d7f2df-cd45-470c-8b3a-6f8d2210f937 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:58:42.736553 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-59d7f2df-cd45-470c-8b3a-6f8d2210f937 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:58:42.737026 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-59d7f2df-cd45-470c-8b3a-6f8d2210f937 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:58:42.737488 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-59d7f2df-cd45-470c-8b3a-6f8d2210f937 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:58:42.869849 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-59d7f2df-cd45-470c-8b3a-6f8d2210f937 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1a4da366004680b7330a8e9f43f945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17135327e2d14c4bbe4c7b242f9fda48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:58:42.878399 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-59d7f2df-cd45-470c-8b3a-6f8d2210f937 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] 10.222.0.18 "GET /compute/v2.1/servers/c7b1f93e-a960-4f71-aaf5-4416cca1d22b" status: 200 len: 1729 microversion: 2.1 time: 0.155879 Oct 22 21:58:42.878972 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3308/6585] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:58:42 2022] GET /compute/v2.1/servers/c7b1f93e-a960-4f71-aaf5-4416cca1d22b => generated 1729 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:58:43.906448 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-32ee53d8-97f4-4aac-90d8-4820625d00c4 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:58:43.907411 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-32ee53d8-97f4-4aac-90d8-4820625d00c4 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] [instance: c7b1f93e-a960-4f71-aaf5-4416cca1d22b] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:58:43.919333 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-32ee53d8-97f4-4aac-90d8-4820625d00c4 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:58:43.920247 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-32ee53d8-97f4-4aac-90d8-4820625d00c4 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:58:43.921009 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-32ee53d8-97f4-4aac-90d8-4820625d00c4 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:58:43.922155 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-32ee53d8-97f4-4aac-90d8-4820625d00c4 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:58:43.922946 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-32ee53d8-97f4-4aac-90d8-4820625d00c4 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:58:43.923725 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-32ee53d8-97f4-4aac-90d8-4820625d00c4 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:58:44.065437 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-32ee53d8-97f4-4aac-90d8-4820625d00c4 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1a4da366004680b7330a8e9f43f945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17135327e2d14c4bbe4c7b242f9fda48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:58:44.074434 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-32ee53d8-97f4-4aac-90d8-4820625d00c4 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] 10.222.0.18 "GET /compute/v2.1/servers/c7b1f93e-a960-4f71-aaf5-4416cca1d22b" status: 200 len: 1729 microversion: 2.1 time: 0.174817 Oct 22 21:58:44.074997 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3278/6586] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:58:43 2022] GET /compute/v2.1/servers/c7b1f93e-a960-4f71-aaf5-4416cca1d22b => generated 1729 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:58:45.100940 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-7d6aca63-19f1-4f5e-8c43-563d5d7a7b1a tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:58:45.101554 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-7d6aca63-19f1-4f5e-8c43-563d5d7a7b1a tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] [instance: c7b1f93e-a960-4f71-aaf5-4416cca1d22b] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:58:45.109317 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7d6aca63-19f1-4f5e-8c43-563d5d7a7b1a tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:58:45.109824 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7d6aca63-19f1-4f5e-8c43-563d5d7a7b1a tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:58:45.110287 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7d6aca63-19f1-4f5e-8c43-563d5d7a7b1a tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:58:45.111011 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7d6aca63-19f1-4f5e-8c43-563d5d7a7b1a tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:58:45.111522 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7d6aca63-19f1-4f5e-8c43-563d5d7a7b1a tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:58:45.111956 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7d6aca63-19f1-4f5e-8c43-563d5d7a7b1a tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:58:45.249384 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-7d6aca63-19f1-4f5e-8c43-563d5d7a7b1a tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1a4da366004680b7330a8e9f43f945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17135327e2d14c4bbe4c7b242f9fda48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:58:45.261665 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-7d6aca63-19f1-4f5e-8c43-563d5d7a7b1a tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] 10.222.0.18 "GET /compute/v2.1/servers/c7b1f93e-a960-4f71-aaf5-4416cca1d22b" status: 200 len: 1729 microversion: 2.1 time: 0.167059 Oct 22 21:58:45.262524 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3309/6587] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:58:45 2022] GET /compute/v2.1/servers/c7b1f93e-a960-4f71-aaf5-4416cca1d22b => generated 1729 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:58:46.292355 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-2ed1a38a-c448-4d32-a095-854b4c9c29ce tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:58:46.292948 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-2ed1a38a-c448-4d32-a095-854b4c9c29ce tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] [instance: c7b1f93e-a960-4f71-aaf5-4416cca1d22b] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:58:46.300438 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2ed1a38a-c448-4d32-a095-854b4c9c29ce tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:58:46.300934 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2ed1a38a-c448-4d32-a095-854b4c9c29ce tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:58:46.301383 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2ed1a38a-c448-4d32-a095-854b4c9c29ce tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:58:46.302093 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2ed1a38a-c448-4d32-a095-854b4c9c29ce tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:58:46.302559 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2ed1a38a-c448-4d32-a095-854b4c9c29ce tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:58:46.302996 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2ed1a38a-c448-4d32-a095-854b4c9c29ce tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:58:46.439574 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-2ed1a38a-c448-4d32-a095-854b4c9c29ce tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1a4da366004680b7330a8e9f43f945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17135327e2d14c4bbe4c7b242f9fda48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:58:46.448162 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-2ed1a38a-c448-4d32-a095-854b4c9c29ce tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] 10.222.0.18 "GET /compute/v2.1/servers/c7b1f93e-a960-4f71-aaf5-4416cca1d22b" status: 200 len: 1729 microversion: 2.1 time: 0.161981 Oct 22 21:58:46.448748 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3279/6588] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:58:46 2022] GET /compute/v2.1/servers/c7b1f93e-a960-4f71-aaf5-4416cca1d22b => generated 1729 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:58:47.476722 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-b4f1b5b6-0aac-4a7c-bb3d-8cca8703af7b tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:58:47.477837 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-b4f1b5b6-0aac-4a7c-bb3d-8cca8703af7b tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] [instance: c7b1f93e-a960-4f71-aaf5-4416cca1d22b] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:58:47.489367 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b4f1b5b6-0aac-4a7c-bb3d-8cca8703af7b tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:58:47.490239 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b4f1b5b6-0aac-4a7c-bb3d-8cca8703af7b tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:58:47.490994 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b4f1b5b6-0aac-4a7c-bb3d-8cca8703af7b tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:58:47.492202 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b4f1b5b6-0aac-4a7c-bb3d-8cca8703af7b tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:58:47.493002 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b4f1b5b6-0aac-4a7c-bb3d-8cca8703af7b tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:58:47.493766 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b4f1b5b6-0aac-4a7c-bb3d-8cca8703af7b tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:58:47.638317 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-b4f1b5b6-0aac-4a7c-bb3d-8cca8703af7b tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1a4da366004680b7330a8e9f43f945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17135327e2d14c4bbe4c7b242f9fda48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:58:47.647078 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-b4f1b5b6-0aac-4a7c-bb3d-8cca8703af7b tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] 10.222.0.18 "GET /compute/v2.1/servers/c7b1f93e-a960-4f71-aaf5-4416cca1d22b" status: 200 len: 1729 microversion: 2.1 time: 0.177004 Oct 22 21:58:47.647683 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3310/6589] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:58:47 2022] GET /compute/v2.1/servers/c7b1f93e-a960-4f71-aaf5-4416cca1d22b => generated 1729 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:58:48.670740 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-9ec318d0-ebbb-4ee1-80fa-e6c160e4f1a0 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:58:48.671587 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-9ec318d0-ebbb-4ee1-80fa-e6c160e4f1a0 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] [instance: c7b1f93e-a960-4f71-aaf5-4416cca1d22b] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:58:48.678918 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9ec318d0-ebbb-4ee1-80fa-e6c160e4f1a0 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:58:48.679428 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9ec318d0-ebbb-4ee1-80fa-e6c160e4f1a0 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:58:48.679864 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9ec318d0-ebbb-4ee1-80fa-e6c160e4f1a0 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:58:48.680559 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9ec318d0-ebbb-4ee1-80fa-e6c160e4f1a0 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:58:48.681013 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9ec318d0-ebbb-4ee1-80fa-e6c160e4f1a0 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:58:48.681438 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9ec318d0-ebbb-4ee1-80fa-e6c160e4f1a0 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:58:48.817714 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-9ec318d0-ebbb-4ee1-80fa-e6c160e4f1a0 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1a4da366004680b7330a8e9f43f945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17135327e2d14c4bbe4c7b242f9fda48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:58:48.826958 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-9ec318d0-ebbb-4ee1-80fa-e6c160e4f1a0 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] 10.222.0.18 "GET /compute/v2.1/servers/c7b1f93e-a960-4f71-aaf5-4416cca1d22b" status: 200 len: 1729 microversion: 2.1 time: 0.160433 Oct 22 21:58:48.827888 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3280/6590] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:58:48 2022] GET /compute/v2.1/servers/c7b1f93e-a960-4f71-aaf5-4416cca1d22b => generated 1729 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:58:49.855170 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-e7c96069-1e5a-48b8-8c8f-79d7e52ae6b3 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:58:49.856213 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-e7c96069-1e5a-48b8-8c8f-79d7e52ae6b3 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] [instance: c7b1f93e-a960-4f71-aaf5-4416cca1d22b] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:58:49.867880 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e7c96069-1e5a-48b8-8c8f-79d7e52ae6b3 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:58:49.868714 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e7c96069-1e5a-48b8-8c8f-79d7e52ae6b3 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:58:49.869590 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e7c96069-1e5a-48b8-8c8f-79d7e52ae6b3 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:58:49.870781 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e7c96069-1e5a-48b8-8c8f-79d7e52ae6b3 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:58:49.871565 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e7c96069-1e5a-48b8-8c8f-79d7e52ae6b3 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:58:49.872090 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e7c96069-1e5a-48b8-8c8f-79d7e52ae6b3 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:58:50.013044 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-e7c96069-1e5a-48b8-8c8f-79d7e52ae6b3 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1a4da366004680b7330a8e9f43f945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17135327e2d14c4bbe4c7b242f9fda48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:58:50.021764 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-e7c96069-1e5a-48b8-8c8f-79d7e52ae6b3 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] 10.222.0.18 "GET /compute/v2.1/servers/c7b1f93e-a960-4f71-aaf5-4416cca1d22b" status: 200 len: 1729 microversion: 2.1 time: 0.173222 Oct 22 21:58:50.022344 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3311/6591] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:58:49 2022] GET /compute/v2.1/servers/c7b1f93e-a960-4f71-aaf5-4416cca1d22b => generated 1729 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:58:51.050026 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-eb347f04-7b57-43e9-b154-be0f7f2222db tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:58:51.051014 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-eb347f04-7b57-43e9-b154-be0f7f2222db tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] [instance: c7b1f93e-a960-4f71-aaf5-4416cca1d22b] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:58:51.056051 ncdv-master-1 devstack@n-api.service[138744]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 22 21:58:51.056336 ncdv-master-1 devstack@n-api.service[138744]: Sat Oct 22 21:58:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c7b1f93e-a960-4f71-aaf5-4416cca1d22b (ip 10.222.0.18) !!! Oct 22 21:58:51.057859 ncdv-master-1 devstack@n-api.service[138744]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 22 21:58:51.058103 ncdv-master-1 devstack@n-api.service[138744]: Sat Oct 22 21:58:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c7b1f93e-a960-4f71-aaf5-4416cca1d22b (ip 10.222.0.18) !!! Oct 22 21:58:51.066277 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-eb347f04-7b57-43e9-b154-be0f7f2222db tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:58:51.066925 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-eb347f04-7b57-43e9-b154-be0f7f2222db tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:58:51.067228 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-eb347f04-7b57-43e9-b154-be0f7f2222db tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:58:51.068003 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-eb347f04-7b57-43e9-b154-be0f7f2222db tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:58:51.068467 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-eb347f04-7b57-43e9-b154-be0f7f2222db tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:58:51.068959 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-eb347f04-7b57-43e9-b154-be0f7f2222db tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:58:51.201965 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-eb347f04-7b57-43e9-b154-be0f7f2222db tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1a4da366004680b7330a8e9f43f945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17135327e2d14c4bbe4c7b242f9fda48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:58:51.210737 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-eb347f04-7b57-43e9-b154-be0f7f2222db tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] 10.222.0.18 "GET /compute/v2.1/servers/c7b1f93e-a960-4f71-aaf5-4416cca1d22b" status: 200 len: 1729 microversion: 2.1 time: 0.167449 Oct 22 21:58:51.211325 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3281/6592] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:58:51 2022] GET /compute/v2.1/servers/c7b1f93e-a960-4f71-aaf5-4416cca1d22b => generated 1729 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:58:52.239013 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-8752ce18-fe67-45a6-9506-1b8efb9537df tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:58:52.240136 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-8752ce18-fe67-45a6-9506-1b8efb9537df tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] [instance: c7b1f93e-a960-4f71-aaf5-4416cca1d22b] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:58:52.245384 ncdv-master-1 devstack@n-api.service[138745]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 22 21:58:52.245647 ncdv-master-1 devstack@n-api.service[138745]: Sat Oct 22 21:58:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c7b1f93e-a960-4f71-aaf5-4416cca1d22b (ip 10.222.0.18) !!! Oct 22 21:58:52.259913 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8752ce18-fe67-45a6-9506-1b8efb9537df tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:58:52.260847 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8752ce18-fe67-45a6-9506-1b8efb9537df tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:58:52.261562 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8752ce18-fe67-45a6-9506-1b8efb9537df tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:58:52.262803 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8752ce18-fe67-45a6-9506-1b8efb9537df tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:58:52.263596 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8752ce18-fe67-45a6-9506-1b8efb9537df tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:58:52.264256 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8752ce18-fe67-45a6-9506-1b8efb9537df tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:58:52.403390 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-8752ce18-fe67-45a6-9506-1b8efb9537df tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1a4da366004680b7330a8e9f43f945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17135327e2d14c4bbe4c7b242f9fda48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:58:52.416104 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-8752ce18-fe67-45a6-9506-1b8efb9537df tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] 10.222.0.18 "GET /compute/v2.1/servers/c7b1f93e-a960-4f71-aaf5-4416cca1d22b" status: 200 len: 1729 microversion: 2.1 time: 0.183825 Oct 22 21:58:52.416840 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3312/6593] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:58:52 2022] GET /compute/v2.1/servers/c7b1f93e-a960-4f71-aaf5-4416cca1d22b => generated 1729 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:58:53.444722 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-358090c0-4497-4efc-b5ba-ddcbdd0b55ce tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:58:53.445716 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-358090c0-4497-4efc-b5ba-ddcbdd0b55ce tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] [instance: c7b1f93e-a960-4f71-aaf5-4416cca1d22b] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:58:53.457699 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-358090c0-4497-4efc-b5ba-ddcbdd0b55ce tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:58:53.458523 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-358090c0-4497-4efc-b5ba-ddcbdd0b55ce tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:58:53.459267 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-358090c0-4497-4efc-b5ba-ddcbdd0b55ce tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:58:53.460486 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-358090c0-4497-4efc-b5ba-ddcbdd0b55ce tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:58:53.461260 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-358090c0-4497-4efc-b5ba-ddcbdd0b55ce tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:58:53.461988 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-358090c0-4497-4efc-b5ba-ddcbdd0b55ce tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:58:53.609713 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-358090c0-4497-4efc-b5ba-ddcbdd0b55ce tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1a4da366004680b7330a8e9f43f945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17135327e2d14c4bbe4c7b242f9fda48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:58:53.618378 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-358090c0-4497-4efc-b5ba-ddcbdd0b55ce tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] 10.222.0.18 "GET /compute/v2.1/servers/c7b1f93e-a960-4f71-aaf5-4416cca1d22b" status: 200 len: 1729 microversion: 2.1 time: 0.180425 Oct 22 21:58:53.618973 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3282/6594] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:58:53 2022] GET /compute/v2.1/servers/c7b1f93e-a960-4f71-aaf5-4416cca1d22b => generated 1729 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:58:54.642477 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-70f93565-fcae-406a-9009-43929e301fc4 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:58:54.643372 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-70f93565-fcae-406a-9009-43929e301fc4 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] [instance: c7b1f93e-a960-4f71-aaf5-4416cca1d22b] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:58:54.651306 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-70f93565-fcae-406a-9009-43929e301fc4 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:58:54.651838 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-70f93565-fcae-406a-9009-43929e301fc4 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:58:54.652291 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-70f93565-fcae-406a-9009-43929e301fc4 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:58:54.653010 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-70f93565-fcae-406a-9009-43929e301fc4 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:58:54.653531 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-70f93565-fcae-406a-9009-43929e301fc4 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:58:54.654016 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-70f93565-fcae-406a-9009-43929e301fc4 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:58:54.793256 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-70f93565-fcae-406a-9009-43929e301fc4 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1a4da366004680b7330a8e9f43f945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17135327e2d14c4bbe4c7b242f9fda48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:58:54.801886 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-70f93565-fcae-406a-9009-43929e301fc4 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] 10.222.0.18 "GET /compute/v2.1/servers/c7b1f93e-a960-4f71-aaf5-4416cca1d22b" status: 200 len: 1728 microversion: 2.1 time: 0.163700 Oct 22 21:58:54.802519 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3313/6595] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:58:54 2022] GET /compute/v2.1/servers/c7b1f93e-a960-4f71-aaf5-4416cca1d22b => generated 1728 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:58:55.090836 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-a1e9bc48-da10-463a-b435-ddfb0e9fb512 req-adebc847-0e1e-4e20-82ac-4062f582e788 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7b1f93e-a960-4f71-aaf5-4416cca1d22b", "name": "network-vif-unplugged", "status": "completed", "tag": "5467bf4d-26fd-4b2c-8fc7-4e47f53c767f"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:58:55.101124 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-a1e9bc48-da10-463a-b435-ddfb0e9fb512 req-adebc847-0e1e-4e20-82ac-4062f582e788 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:58:55.101612 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-a1e9bc48-da10-463a-b435-ddfb0e9fb512 req-adebc847-0e1e-4e20-82ac-4062f582e788 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:58:55.102047 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-a1e9bc48-da10-463a-b435-ddfb0e9fb512 req-adebc847-0e1e-4e20-82ac-4062f582e788 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:58:55.115117 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-a1e9bc48-da10-463a-b435-ddfb0e9fb512 req-adebc847-0e1e-4e20-82ac-4062f582e788 service nova] Creating event network-vif-unplugged:5467bf4d-26fd-4b2c-8fc7-4e47f53c767f for instance c7b1f93e-a960-4f71-aaf5-4416cca1d22b on nch1-master-1 Oct 22 21:58:55.120634 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [req-a1e9bc48-da10-463a-b435-ddfb0e9fb512 req-adebc847-0e1e-4e20-82ac-4062f582e788 service nova] Instance c7b1f93e-a960-4f71-aaf5-4416cca1d22b is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=138744) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 22 21:58:55.133595 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-a1e9bc48-da10-463a-b435-ddfb0e9fb512 req-adebc847-0e1e-4e20-82ac-4062f582e788 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.098298 Oct 22 21:58:55.134350 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3283/6596] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:58:55 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:58:55.826795 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-6116bebf-d449-411b-bb6e-66112ef1d3ce tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:58:55.827712 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-6116bebf-d449-411b-bb6e-66112ef1d3ce tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] [instance: c7b1f93e-a960-4f71-aaf5-4416cca1d22b] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:58:55.836579 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6116bebf-d449-411b-bb6e-66112ef1d3ce tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:58:55.837099 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6116bebf-d449-411b-bb6e-66112ef1d3ce tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:58:55.837556 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6116bebf-d449-411b-bb6e-66112ef1d3ce tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:58:55.838468 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6116bebf-d449-411b-bb6e-66112ef1d3ce tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:58:55.839118 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6116bebf-d449-411b-bb6e-66112ef1d3ce tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:58:55.839597 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6116bebf-d449-411b-bb6e-66112ef1d3ce tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:58:55.978391 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-6116bebf-d449-411b-bb6e-66112ef1d3ce tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1a4da366004680b7330a8e9f43f945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17135327e2d14c4bbe4c7b242f9fda48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:58:55.987081 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-6116bebf-d449-411b-bb6e-66112ef1d3ce tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] 10.222.0.18 "GET /compute/v2.1/servers/c7b1f93e-a960-4f71-aaf5-4416cca1d22b" status: 200 len: 1728 microversion: 2.1 time: 0.164514 Oct 22 21:58:55.987928 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3314/6597] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:58:55 2022] GET /compute/v2.1/servers/c7b1f93e-a960-4f71-aaf5-4416cca1d22b => generated 1728 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:58:57.011291 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-f024cc0a-a805-4968-84d2-bdf929d55ecf tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:58:57.011931 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-f024cc0a-a805-4968-84d2-bdf929d55ecf tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] [instance: c7b1f93e-a960-4f71-aaf5-4416cca1d22b] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:58:57.019631 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f024cc0a-a805-4968-84d2-bdf929d55ecf tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:58:57.020124 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f024cc0a-a805-4968-84d2-bdf929d55ecf tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:58:57.020569 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f024cc0a-a805-4968-84d2-bdf929d55ecf tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:58:57.021326 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f024cc0a-a805-4968-84d2-bdf929d55ecf tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:58:57.021774 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f024cc0a-a805-4968-84d2-bdf929d55ecf tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:58:57.022213 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f024cc0a-a805-4968-84d2-bdf929d55ecf tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:58:57.152837 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-d9db2de3-60b7-4a5b-a3a6-c2f4ece0759a req-6f4220ce-6ac9-4d57-b5db-f72f56d75340 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7b1f93e-a960-4f71-aaf5-4416cca1d22b", "tag": "5467bf4d-26fd-4b2c-8fc7-4e47f53c767f"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:58:57.164581 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-d9db2de3-60b7-4a5b-a3a6-c2f4ece0759a req-6f4220ce-6ac9-4d57-b5db-f72f56d75340 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:58:57.165142 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-d9db2de3-60b7-4a5b-a3a6-c2f4ece0759a req-6f4220ce-6ac9-4d57-b5db-f72f56d75340 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:58:57.165330 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-f024cc0a-a805-4968-84d2-bdf929d55ecf tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1a4da366004680b7330a8e9f43f945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17135327e2d14c4bbe4c7b242f9fda48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:58:57.165810 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-d9db2de3-60b7-4a5b-a3a6-c2f4ece0759a req-6f4220ce-6ac9-4d57-b5db-f72f56d75340 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:58:57.175083 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-f024cc0a-a805-4968-84d2-bdf929d55ecf tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] 10.222.0.18 "GET /compute/v2.1/servers/c7b1f93e-a960-4f71-aaf5-4416cca1d22b" status: 200 len: 1726 microversion: 2.1 time: 0.168372 Oct 22 21:58:57.175843 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3284/6598] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:58:57 2022] GET /compute/v2.1/servers/c7b1f93e-a960-4f71-aaf5-4416cca1d22b => generated 1726 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:58:57.182169 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-d9db2de3-60b7-4a5b-a3a6-c2f4ece0759a req-6f4220ce-6ac9-4d57-b5db-f72f56d75340 service nova] Creating event network-changed:5467bf4d-26fd-4b2c-8fc7-4e47f53c767f for instance c7b1f93e-a960-4f71-aaf5-4416cca1d22b on nch1-master-1 Oct 22 21:58:57.189001 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [req-d9db2de3-60b7-4a5b-a3a6-c2f4ece0759a req-6f4220ce-6ac9-4d57-b5db-f72f56d75340 service nova] Instance c7b1f93e-a960-4f71-aaf5-4416cca1d22b is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=138745) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 22 21:58:57.200160 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-d9db2de3-60b7-4a5b-a3a6-c2f4ece0759a req-6f4220ce-6ac9-4d57-b5db-f72f56d75340 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051642 Oct 22 21:58:57.200777 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3315/6599] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:58:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:58:58.203410 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-d146f11a-ac41-487e-899e-a386d04938b8 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:58:58.204407 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-d146f11a-ac41-487e-899e-a386d04938b8 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] [instance: c7b1f93e-a960-4f71-aaf5-4416cca1d22b] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:58:58.212302 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d146f11a-ac41-487e-899e-a386d04938b8 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:58:58.212789 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d146f11a-ac41-487e-899e-a386d04938b8 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:58:58.213229 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d146f11a-ac41-487e-899e-a386d04938b8 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:58:58.213928 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d146f11a-ac41-487e-899e-a386d04938b8 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:58:58.214378 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d146f11a-ac41-487e-899e-a386d04938b8 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:58:58.214808 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d146f11a-ac41-487e-899e-a386d04938b8 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:58:58.347072 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-d146f11a-ac41-487e-899e-a386d04938b8 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1a4da366004680b7330a8e9f43f945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17135327e2d14c4bbe4c7b242f9fda48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:58:58.355620 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-d146f11a-ac41-487e-899e-a386d04938b8 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] 10.222.0.18 "GET /compute/v2.1/servers/c7b1f93e-a960-4f71-aaf5-4416cca1d22b" status: 200 len: 1726 microversion: 2.1 time: 0.158791 Oct 22 21:58:58.356194 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3285/6600] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:58:58 2022] GET /compute/v2.1/servers/c7b1f93e-a960-4f71-aaf5-4416cca1d22b => generated 1726 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:58:59.381338 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-1408c9ea-3ca1-4dfd-860a-b8d4763ff26b tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:58:59.381916 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-1408c9ea-3ca1-4dfd-860a-b8d4763ff26b tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] [instance: c7b1f93e-a960-4f71-aaf5-4416cca1d22b] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:58:59.389351 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1408c9ea-3ca1-4dfd-860a-b8d4763ff26b tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:58:59.389889 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1408c9ea-3ca1-4dfd-860a-b8d4763ff26b tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:58:59.390338 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1408c9ea-3ca1-4dfd-860a-b8d4763ff26b tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:58:59.391102 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1408c9ea-3ca1-4dfd-860a-b8d4763ff26b tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:58:59.391599 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1408c9ea-3ca1-4dfd-860a-b8d4763ff26b tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:58:59.392036 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1408c9ea-3ca1-4dfd-860a-b8d4763ff26b tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:58:59.540691 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-1408c9ea-3ca1-4dfd-860a-b8d4763ff26b tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1a4da366004680b7330a8e9f43f945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17135327e2d14c4bbe4c7b242f9fda48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:58:59.549838 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-1408c9ea-3ca1-4dfd-860a-b8d4763ff26b tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] 10.222.0.18 "GET /compute/v2.1/servers/c7b1f93e-a960-4f71-aaf5-4416cca1d22b" status: 200 len: 1726 microversion: 2.1 time: 0.174111 Oct 22 21:58:59.550449 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3316/6601] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:58:59 2022] GET /compute/v2.1/servers/c7b1f93e-a960-4f71-aaf5-4416cca1d22b => generated 1726 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:59:00.574664 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-d03bd4bd-18f7-4fe9-91a0-159dbe412239 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:59:00.575257 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-d03bd4bd-18f7-4fe9-91a0-159dbe412239 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] [instance: c7b1f93e-a960-4f71-aaf5-4416cca1d22b] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:59:00.583023 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d03bd4bd-18f7-4fe9-91a0-159dbe412239 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:59:00.583541 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d03bd4bd-18f7-4fe9-91a0-159dbe412239 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:59:00.583982 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d03bd4bd-18f7-4fe9-91a0-159dbe412239 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:59:00.584679 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d03bd4bd-18f7-4fe9-91a0-159dbe412239 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:59:00.585137 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d03bd4bd-18f7-4fe9-91a0-159dbe412239 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:59:00.585562 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d03bd4bd-18f7-4fe9-91a0-159dbe412239 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:59:00.724466 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-d03bd4bd-18f7-4fe9-91a0-159dbe412239 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1a4da366004680b7330a8e9f43f945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17135327e2d14c4bbe4c7b242f9fda48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:59:00.727862 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:59:00.737854 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-d03bd4bd-18f7-4fe9-91a0-159dbe412239 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] 10.222.0.18 "GET /compute/v2.1/servers/c7b1f93e-a960-4f71-aaf5-4416cca1d22b" status: 200 len: 1726 microversion: 2.1 time: 0.167088 Oct 22 21:59:00.738621 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3286/6602] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:59:00 2022] GET /compute/v2.1/servers/c7b1f93e-a960-4f71-aaf5-4416cca1d22b => generated 1726 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:59:01.763048 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-377a0cb5-eec8-4b39-9fe4-e087410b45cc tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:59:01.763832 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-377a0cb5-eec8-4b39-9fe4-e087410b45cc tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] [instance: c7b1f93e-a960-4f71-aaf5-4416cca1d22b] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:59:01.767226 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_api:SELECT=33 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:59:01.773292 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-377a0cb5-eec8-4b39-9fe4-e087410b45cc tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:59:01.773801 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-377a0cb5-eec8-4b39-9fe4-e087410b45cc tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:59:01.774255 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-377a0cb5-eec8-4b39-9fe4-e087410b45cc tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:59:01.774972 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-377a0cb5-eec8-4b39-9fe4-e087410b45cc tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:59:01.775474 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-377a0cb5-eec8-4b39-9fe4-e087410b45cc tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:59:01.775919 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-377a0cb5-eec8-4b39-9fe4-e087410b45cc tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:59:01.778601 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:59:01.912401 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-377a0cb5-eec8-4b39-9fe4-e087410b45cc tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1a4da366004680b7330a8e9f43f945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17135327e2d14c4bbe4c7b242f9fda48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:59:01.924825 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-377a0cb5-eec8-4b39-9fe4-e087410b45cc tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] 10.222.0.18 "GET /compute/v2.1/servers/c7b1f93e-a960-4f71-aaf5-4416cca1d22b" status: 200 len: 1726 microversion: 2.1 time: 0.166364 Oct 22 21:59:01.925641 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3317/6603] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:59:01 2022] GET /compute/v2.1/servers/c7b1f93e-a960-4f71-aaf5-4416cca1d22b => generated 1726 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:59:02.953390 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-83308c61-41f5-4264-bb88-a503a0d8b664 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:59:02.954326 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-83308c61-41f5-4264-bb88-a503a0d8b664 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] [instance: c7b1f93e-a960-4f71-aaf5-4416cca1d22b] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:59:02.958641 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_api:SELECT=29 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:59:02.968804 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-83308c61-41f5-4264-bb88-a503a0d8b664 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:59:02.969602 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-83308c61-41f5-4264-bb88-a503a0d8b664 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:59:02.970337 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-83308c61-41f5-4264-bb88-a503a0d8b664 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:59:02.971412 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-83308c61-41f5-4264-bb88-a503a0d8b664 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:59:02.971873 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-83308c61-41f5-4264-bb88-a503a0d8b664 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:59:02.972297 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-83308c61-41f5-4264-bb88-a503a0d8b664 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:59:03.112342 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-83308c61-41f5-4264-bb88-a503a0d8b664 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1a4da366004680b7330a8e9f43f945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17135327e2d14c4bbe4c7b242f9fda48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:59:03.120862 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-83308c61-41f5-4264-bb88-a503a0d8b664 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] 10.222.0.18 "GET /compute/v2.1/servers/c7b1f93e-a960-4f71-aaf5-4416cca1d22b" status: 200 len: 1723 microversion: 2.1 time: 0.174941 Oct 22 21:59:03.121475 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3287/6604] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:59:02 2022] GET /compute/v2.1/servers/c7b1f93e-a960-4f71-aaf5-4416cca1d22b => generated 1723 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:59:03.143577 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-55459375-79f6-4727-9ff2-b8abdd880e62 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:59:03.144184 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-55459375-79f6-4727-9ff2-b8abdd880e62 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] [instance: c7b1f93e-a960-4f71-aaf5-4416cca1d22b] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:59:03.151176 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-55459375-79f6-4727-9ff2-b8abdd880e62 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:59:03.151730 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-55459375-79f6-4727-9ff2-b8abdd880e62 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:59:03.152169 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-55459375-79f6-4727-9ff2-b8abdd880e62 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:59:03.152916 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-55459375-79f6-4727-9ff2-b8abdd880e62 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:59:03.153364 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-55459375-79f6-4727-9ff2-b8abdd880e62 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:59:03.153775 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-55459375-79f6-4727-9ff2-b8abdd880e62 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:59:03.192455 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-55459375-79f6-4727-9ff2-b8abdd880e62 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:59:03.192952 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-55459375-79f6-4727-9ff2-b8abdd880e62 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:59:03.193410 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-55459375-79f6-4727-9ff2-b8abdd880e62 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:59:03.194147 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-55459375-79f6-4727-9ff2-b8abdd880e62 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:59:03.194612 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-55459375-79f6-4727-9ff2-b8abdd880e62 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:59:03.195048 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-55459375-79f6-4727-9ff2-b8abdd880e62 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:59:03.215994 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-55459375-79f6-4727-9ff2-b8abdd880e62 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Getting quotas for project 17135327e2d14c4bbe4c7b242f9fda48. Resources: {'ram', 'cores'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 21:59:03.221536 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-55459375-79f6-4727-9ff2-b8abdd880e62 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Getting quotas for user ce1a4da366004680b7330a8e9f43f945 and project 17135327e2d14c4bbe4c7b242f9fda48. Resources: {'ram', 'cores'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 21:59:03.333677 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-55459375-79f6-4727-9ff2-b8abdd880e62 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] 10.222.0.18 "POST /compute/v2.1/servers/c7b1f93e-a960-4f71-aaf5-4416cca1d22b/action" status: 202 len: 0 microversion: 2.1 time: 0.194009 Oct 22 21:59:03.334318 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3318/6605] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 21:59:03 2022] POST /compute/v2.1/servers/c7b1f93e-a960-4f71-aaf5-4416cca1d22b/action => generated 0 bytes in 196 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 21:59:03.342734 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-60ab50dd-5b4c-4379-9525-97b2290fcb98 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:59:03.343366 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-60ab50dd-5b4c-4379-9525-97b2290fcb98 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] [instance: c7b1f93e-a960-4f71-aaf5-4416cca1d22b] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:59:03.349611 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-60ab50dd-5b4c-4379-9525-97b2290fcb98 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:59:03.350100 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-60ab50dd-5b4c-4379-9525-97b2290fcb98 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:59:03.350543 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-60ab50dd-5b4c-4379-9525-97b2290fcb98 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:59:03.351241 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-60ab50dd-5b4c-4379-9525-97b2290fcb98 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:59:03.351732 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-60ab50dd-5b4c-4379-9525-97b2290fcb98 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:59:03.352161 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-60ab50dd-5b4c-4379-9525-97b2290fcb98 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:59:03.484477 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-60ab50dd-5b4c-4379-9525-97b2290fcb98 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1a4da366004680b7330a8e9f43f945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17135327e2d14c4bbe4c7b242f9fda48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:59:03.499583 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-60ab50dd-5b4c-4379-9525-97b2290fcb98 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] 10.222.0.18 "GET /compute/v2.1/servers/c7b1f93e-a960-4f71-aaf5-4416cca1d22b" status: 200 len: 1722 microversion: 2.1 time: 0.160840 Oct 22 21:59:03.501124 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3288/6606] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:59:03 2022] GET /compute/v2.1/servers/c7b1f93e-a960-4f71-aaf5-4416cca1d22b => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:59:04.526221 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-bc057472-c193-4d1a-ab1e-4529df07b49c tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:59:04.527097 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-bc057472-c193-4d1a-ab1e-4529df07b49c tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] [instance: c7b1f93e-a960-4f71-aaf5-4416cca1d22b] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:59:04.536088 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bc057472-c193-4d1a-ab1e-4529df07b49c tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:59:04.536585 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bc057472-c193-4d1a-ab1e-4529df07b49c tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:59:04.537033 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bc057472-c193-4d1a-ab1e-4529df07b49c tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:59:04.537738 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bc057472-c193-4d1a-ab1e-4529df07b49c tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:59:04.538202 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bc057472-c193-4d1a-ab1e-4529df07b49c tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:59:04.538646 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bc057472-c193-4d1a-ab1e-4529df07b49c tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:59:04.676603 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-bc057472-c193-4d1a-ab1e-4529df07b49c tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1a4da366004680b7330a8e9f43f945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17135327e2d14c4bbe4c7b242f9fda48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:59:04.685201 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-bc057472-c193-4d1a-ab1e-4529df07b49c tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] 10.222.0.18 "GET /compute/v2.1/servers/c7b1f93e-a960-4f71-aaf5-4416cca1d22b" status: 200 len: 1722 microversion: 2.1 time: 0.165532 Oct 22 21:59:04.685818 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3319/6607] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:59:04 2022] GET /compute/v2.1/servers/c7b1f93e-a960-4f71-aaf5-4416cca1d22b => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:59:05.161431 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-09b80872-d6ac-42ec-8252-99acf78a0b55 req-0f46a426-450a-4a0a-a817-cb0cae4d2b1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7b1f93e-a960-4f71-aaf5-4416cca1d22b", "name": "network-vif-plugged", "status": "completed", "tag": "5467bf4d-26fd-4b2c-8fc7-4e47f53c767f"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:59:05.172036 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-09b80872-d6ac-42ec-8252-99acf78a0b55 req-0f46a426-450a-4a0a-a817-cb0cae4d2b1f service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:59:05.172406 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-09b80872-d6ac-42ec-8252-99acf78a0b55 req-0f46a426-450a-4a0a-a817-cb0cae4d2b1f service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:59:05.172840 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-09b80872-d6ac-42ec-8252-99acf78a0b55 req-0f46a426-450a-4a0a-a817-cb0cae4d2b1f service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:59:05.185442 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-09b80872-d6ac-42ec-8252-99acf78a0b55 req-0f46a426-450a-4a0a-a817-cb0cae4d2b1f service nova] Creating event network-vif-plugged:5467bf4d-26fd-4b2c-8fc7-4e47f53c767f for instance c7b1f93e-a960-4f71-aaf5-4416cca1d22b on nch1-master-1 Oct 22 21:59:05.191384 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [req-09b80872-d6ac-42ec-8252-99acf78a0b55 req-0f46a426-450a-4a0a-a817-cb0cae4d2b1f service nova] Instance c7b1f93e-a960-4f71-aaf5-4416cca1d22b is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=138744) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 22 21:59:05.202802 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-09b80872-d6ac-42ec-8252-99acf78a0b55 req-0f46a426-450a-4a0a-a817-cb0cae4d2b1f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045334 Oct 22 21:59:05.203427 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3289/6608] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:59:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:59:05.709487 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-072a5c54-ff82-49a0-83a9-6f10866d562e tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:59:05.710122 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-072a5c54-ff82-49a0-83a9-6f10866d562e tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] [instance: c7b1f93e-a960-4f71-aaf5-4416cca1d22b] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:59:05.717801 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-072a5c54-ff82-49a0-83a9-6f10866d562e tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:59:05.718303 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-072a5c54-ff82-49a0-83a9-6f10866d562e tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:59:05.718755 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-072a5c54-ff82-49a0-83a9-6f10866d562e tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:59:05.719519 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-072a5c54-ff82-49a0-83a9-6f10866d562e tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:59:05.719989 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-072a5c54-ff82-49a0-83a9-6f10866d562e tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:59:05.720434 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-072a5c54-ff82-49a0-83a9-6f10866d562e tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:59:05.861638 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-072a5c54-ff82-49a0-83a9-6f10866d562e tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1a4da366004680b7330a8e9f43f945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17135327e2d14c4bbe4c7b242f9fda48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:59:05.870967 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-072a5c54-ff82-49a0-83a9-6f10866d562e tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] 10.222.0.18 "GET /compute/v2.1/servers/c7b1f93e-a960-4f71-aaf5-4416cca1d22b" status: 200 len: 1722 microversion: 2.1 time: 0.165588 Oct 22 21:59:05.891718 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3320/6609] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:59:05 2022] GET /compute/v2.1/servers/c7b1f93e-a960-4f71-aaf5-4416cca1d22b => generated 1722 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:59:06.895936 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-f5d09c87-2d60-40d1-99be-2945e4036815 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:59:06.896532 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-f5d09c87-2d60-40d1-99be-2945e4036815 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] [instance: c7b1f93e-a960-4f71-aaf5-4416cca1d22b] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:59:06.903256 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f5d09c87-2d60-40d1-99be-2945e4036815 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:59:06.903847 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f5d09c87-2d60-40d1-99be-2945e4036815 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:59:06.904409 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f5d09c87-2d60-40d1-99be-2945e4036815 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:59:06.905235 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f5d09c87-2d60-40d1-99be-2945e4036815 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:59:06.905699 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f5d09c87-2d60-40d1-99be-2945e4036815 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:59:06.906127 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f5d09c87-2d60-40d1-99be-2945e4036815 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:59:07.126722 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-f5d09c87-2d60-40d1-99be-2945e4036815 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1a4da366004680b7330a8e9f43f945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17135327e2d14c4bbe4c7b242f9fda48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:59:07.135543 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-f5d09c87-2d60-40d1-99be-2945e4036815 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] 10.222.0.18 "GET /compute/v2.1/servers/c7b1f93e-a960-4f71-aaf5-4416cca1d22b" status: 200 len: 1722 microversion: 2.1 time: 0.245001 Oct 22 21:59:07.136037 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3290/6610] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:59:06 2022] GET /compute/v2.1/servers/c7b1f93e-a960-4f71-aaf5-4416cca1d22b => generated 1722 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:59:07.379724 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-b29e6a93-09a7-463c-b799-98ea32d67960 req-c193f831-9185-44cf-bc5f-0d79cc3cddb2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7b1f93e-a960-4f71-aaf5-4416cca1d22b", "name": "network-vif-unplugged", "status": "completed", "tag": "5467bf4d-26fd-4b2c-8fc7-4e47f53c767f"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:59:07.390570 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-b29e6a93-09a7-463c-b799-98ea32d67960 req-c193f831-9185-44cf-bc5f-0d79cc3cddb2 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:59:07.391073 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-b29e6a93-09a7-463c-b799-98ea32d67960 req-c193f831-9185-44cf-bc5f-0d79cc3cddb2 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:59:07.391559 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-b29e6a93-09a7-463c-b799-98ea32d67960 req-c193f831-9185-44cf-bc5f-0d79cc3cddb2 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:59:07.404019 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-b29e6a93-09a7-463c-b799-98ea32d67960 req-c193f831-9185-44cf-bc5f-0d79cc3cddb2 service nova] Creating event network-vif-unplugged:5467bf4d-26fd-4b2c-8fc7-4e47f53c767f for instance c7b1f93e-a960-4f71-aaf5-4416cca1d22b on nch2-master-1 Oct 22 21:59:07.409774 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [req-b29e6a93-09a7-463c-b799-98ea32d67960 req-c193f831-9185-44cf-bc5f-0d79cc3cddb2 service nova] Instance c7b1f93e-a960-4f71-aaf5-4416cca1d22b is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=138745) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 22 21:59:07.421176 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-b29e6a93-09a7-463c-b799-98ea32d67960 req-c193f831-9185-44cf-bc5f-0d79cc3cddb2 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045329 Oct 22 21:59:07.421794 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3321/6611] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:59:07 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:59:08.160666 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-e863c88e-8343-476f-8439-aadf1d0d22fa tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:59:08.161220 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-e863c88e-8343-476f-8439-aadf1d0d22fa tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] [instance: c7b1f93e-a960-4f71-aaf5-4416cca1d22b] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:59:08.168573 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e863c88e-8343-476f-8439-aadf1d0d22fa tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:59:08.169071 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e863c88e-8343-476f-8439-aadf1d0d22fa tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:59:08.169499 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e863c88e-8343-476f-8439-aadf1d0d22fa tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:59:08.170211 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e863c88e-8343-476f-8439-aadf1d0d22fa tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:59:08.170672 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e863c88e-8343-476f-8439-aadf1d0d22fa tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:59:08.171109 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e863c88e-8343-476f-8439-aadf1d0d22fa tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:59:08.754178 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-e863c88e-8343-476f-8439-aadf1d0d22fa tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1a4da366004680b7330a8e9f43f945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17135327e2d14c4bbe4c7b242f9fda48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:59:08.762983 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-e863c88e-8343-476f-8439-aadf1d0d22fa tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] 10.222.0.18 "GET /compute/v2.1/servers/c7b1f93e-a960-4f71-aaf5-4416cca1d22b" status: 200 len: 1722 microversion: 2.1 time: 0.608117 Oct 22 21:59:08.763583 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3291/6612] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:59:08 2022] GET /compute/v2.1/servers/c7b1f93e-a960-4f71-aaf5-4416cca1d22b => generated 1722 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:59:09.462396 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-81f11327-3a2a-48ed-ba17-a42b22405005 req-f1814d96-4bed-467d-b49d-813e37332fa0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7b1f93e-a960-4f71-aaf5-4416cca1d22b", "tag": "5467bf4d-26fd-4b2c-8fc7-4e47f53c767f"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:59:09.473252 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-81f11327-3a2a-48ed-ba17-a42b22405005 req-f1814d96-4bed-467d-b49d-813e37332fa0 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:59:09.473749 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-81f11327-3a2a-48ed-ba17-a42b22405005 req-f1814d96-4bed-467d-b49d-813e37332fa0 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:59:09.474375 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-81f11327-3a2a-48ed-ba17-a42b22405005 req-f1814d96-4bed-467d-b49d-813e37332fa0 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:59:09.486881 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-81f11327-3a2a-48ed-ba17-a42b22405005 req-f1814d96-4bed-467d-b49d-813e37332fa0 service nova] Creating event network-changed:5467bf4d-26fd-4b2c-8fc7-4e47f53c767f for instance c7b1f93e-a960-4f71-aaf5-4416cca1d22b on nch2-master-1 Oct 22 21:59:09.492617 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [req-81f11327-3a2a-48ed-ba17-a42b22405005 req-f1814d96-4bed-467d-b49d-813e37332fa0 service nova] Instance c7b1f93e-a960-4f71-aaf5-4416cca1d22b is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=138745) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 22 21:59:09.503502 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-81f11327-3a2a-48ed-ba17-a42b22405005 req-f1814d96-4bed-467d-b49d-813e37332fa0 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046157 Oct 22 21:59:09.504109 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3322/6613] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:59:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:59:09.787415 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-9d90a158-1e79-4523-97b6-7c67c0ab52eb tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:59:09.789263 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-9d90a158-1e79-4523-97b6-7c67c0ab52eb tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] [instance: c7b1f93e-a960-4f71-aaf5-4416cca1d22b] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:59:09.798899 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9d90a158-1e79-4523-97b6-7c67c0ab52eb tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:59:09.800429 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9d90a158-1e79-4523-97b6-7c67c0ab52eb tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:59:09.801260 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9d90a158-1e79-4523-97b6-7c67c0ab52eb tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:59:09.802450 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9d90a158-1e79-4523-97b6-7c67c0ab52eb tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:59:09.803400 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9d90a158-1e79-4523-97b6-7c67c0ab52eb tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:59:09.804667 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9d90a158-1e79-4523-97b6-7c67c0ab52eb tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:59:09.965464 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-9d90a158-1e79-4523-97b6-7c67c0ab52eb tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1a4da366004680b7330a8e9f43f945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17135327e2d14c4bbe4c7b242f9fda48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:59:09.974786 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-9d90a158-1e79-4523-97b6-7c67c0ab52eb tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] 10.222.0.18 "GET /compute/v2.1/servers/c7b1f93e-a960-4f71-aaf5-4416cca1d22b" status: 200 len: 1722 microversion: 2.1 time: 0.192012 Oct 22 21:59:09.975402 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3292/6614] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:59:09 2022] GET /compute/v2.1/servers/c7b1f93e-a960-4f71-aaf5-4416cca1d22b => generated 1722 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:59:11.001152 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-f198eb03-9e85-4821-bbc7-7a4837467c1e tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:59:11.002087 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-f198eb03-9e85-4821-bbc7-7a4837467c1e tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] [instance: c7b1f93e-a960-4f71-aaf5-4416cca1d22b] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:59:11.009944 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f198eb03-9e85-4821-bbc7-7a4837467c1e tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:59:11.010558 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f198eb03-9e85-4821-bbc7-7a4837467c1e tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:59:11.011104 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f198eb03-9e85-4821-bbc7-7a4837467c1e tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:59:11.012012 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f198eb03-9e85-4821-bbc7-7a4837467c1e tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:59:11.012590 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f198eb03-9e85-4821-bbc7-7a4837467c1e tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:59:11.013061 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f198eb03-9e85-4821-bbc7-7a4837467c1e tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:59:11.151555 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-f198eb03-9e85-4821-bbc7-7a4837467c1e tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1a4da366004680b7330a8e9f43f945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17135327e2d14c4bbe4c7b242f9fda48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:59:11.162703 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-f198eb03-9e85-4821-bbc7-7a4837467c1e tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] 10.222.0.18 "GET /compute/v2.1/servers/c7b1f93e-a960-4f71-aaf5-4416cca1d22b" status: 200 len: 1722 microversion: 2.1 time: 0.167669 Oct 22 21:59:11.163284 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3323/6615] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:59:10 2022] GET /compute/v2.1/servers/c7b1f93e-a960-4f71-aaf5-4416cca1d22b => generated 1722 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:59:12.191022 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-86e131ea-3f94-4b09-a34e-b621c4d6c436 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:59:12.191684 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-86e131ea-3f94-4b09-a34e-b621c4d6c436 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] [instance: c7b1f93e-a960-4f71-aaf5-4416cca1d22b] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:59:12.199088 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-86e131ea-3f94-4b09-a34e-b621c4d6c436 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:59:12.199615 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-86e131ea-3f94-4b09-a34e-b621c4d6c436 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:59:12.200055 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-86e131ea-3f94-4b09-a34e-b621c4d6c436 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:59:12.200749 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-86e131ea-3f94-4b09-a34e-b621c4d6c436 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:59:12.201204 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-86e131ea-3f94-4b09-a34e-b621c4d6c436 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:59:12.201630 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-86e131ea-3f94-4b09-a34e-b621c4d6c436 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:59:12.347162 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-86e131ea-3f94-4b09-a34e-b621c4d6c436 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1a4da366004680b7330a8e9f43f945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17135327e2d14c4bbe4c7b242f9fda48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:59:12.355847 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-86e131ea-3f94-4b09-a34e-b621c4d6c436 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] 10.222.0.18 "GET /compute/v2.1/servers/c7b1f93e-a960-4f71-aaf5-4416cca1d22b" status: 200 len: 1722 microversion: 2.1 time: 0.171091 Oct 22 21:59:12.356390 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3293/6616] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:59:12 2022] GET /compute/v2.1/servers/c7b1f93e-a960-4f71-aaf5-4416cca1d22b => generated 1722 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:59:13.380801 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-e0429411-d660-4b63-9a9d-41903c6a23d5 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:59:13.381494 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-e0429411-d660-4b63-9a9d-41903c6a23d5 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] [instance: c7b1f93e-a960-4f71-aaf5-4416cca1d22b] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:59:13.385098 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell0:SELECT=3 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:59:13.391285 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e0429411-d660-4b63-9a9d-41903c6a23d5 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:59:13.391987 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e0429411-d660-4b63-9a9d-41903c6a23d5 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:59:13.392543 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e0429411-d660-4b63-9a9d-41903c6a23d5 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:59:13.393400 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e0429411-d660-4b63-9a9d-41903c6a23d5 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:59:13.393955 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e0429411-d660-4b63-9a9d-41903c6a23d5 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:59:13.394458 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e0429411-d660-4b63-9a9d-41903c6a23d5 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:59:13.533648 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-e0429411-d660-4b63-9a9d-41903c6a23d5 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1a4da366004680b7330a8e9f43f945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17135327e2d14c4bbe4c7b242f9fda48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:59:13.542691 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-e0429411-d660-4b63-9a9d-41903c6a23d5 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] 10.222.0.18 "GET /compute/v2.1/servers/c7b1f93e-a960-4f71-aaf5-4416cca1d22b" status: 200 len: 1715 microversion: 2.1 time: 0.166786 Oct 22 21:59:13.543478 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3324/6617] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:59:13 2022] GET /compute/v2.1/servers/c7b1f93e-a960-4f71-aaf5-4416cca1d22b => generated 1715 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:59:13.565162 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-d5652917-55ee-413e-9c61-01dcaa233feb tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:59:13.565726 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-d5652917-55ee-413e-9c61-01dcaa233feb tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] [instance: c7b1f93e-a960-4f71-aaf5-4416cca1d22b] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:59:13.573136 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d5652917-55ee-413e-9c61-01dcaa233feb tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:59:13.573621 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d5652917-55ee-413e-9c61-01dcaa233feb tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:59:13.574064 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d5652917-55ee-413e-9c61-01dcaa233feb tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:59:13.574759 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d5652917-55ee-413e-9c61-01dcaa233feb tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:59:13.575216 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d5652917-55ee-413e-9c61-01dcaa233feb tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:59:13.575678 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d5652917-55ee-413e-9c61-01dcaa233feb tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:59:13.711619 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-d5652917-55ee-413e-9c61-01dcaa233feb tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1a4da366004680b7330a8e9f43f945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17135327e2d14c4bbe4c7b242f9fda48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:59:13.724409 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-d5652917-55ee-413e-9c61-01dcaa233feb tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] 10.222.0.18 "GET /compute/v2.1/servers/c7b1f93e-a960-4f71-aaf5-4416cca1d22b" status: 200 len: 1715 microversion: 2.1 time: 0.162869 Oct 22 21:59:13.725304 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3294/6618] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:59:13 2022] GET /compute/v2.1/servers/c7b1f93e-a960-4f71-aaf5-4416cca1d22b => generated 1715 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:59:13.751581 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-6e86c684-7f4a-44a9-acec-bf4a4ce6c00d tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:59:13.752226 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-6e86c684-7f4a-44a9-acec-bf4a4ce6c00d tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] [instance: c7b1f93e-a960-4f71-aaf5-4416cca1d22b] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:59:13.758479 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6e86c684-7f4a-44a9-acec-bf4a4ce6c00d tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:59:13.758957 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6e86c684-7f4a-44a9-acec-bf4a4ce6c00d tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:59:13.759440 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6e86c684-7f4a-44a9-acec-bf4a4ce6c00d tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:59:13.760153 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6e86c684-7f4a-44a9-acec-bf4a4ce6c00d tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:59:13.760621 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6e86c684-7f4a-44a9-acec-bf4a4ce6c00d tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:59:13.761064 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6e86c684-7f4a-44a9-acec-bf4a4ce6c00d tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:59:13.904479 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-6e86c684-7f4a-44a9-acec-bf4a4ce6c00d tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1a4da366004680b7330a8e9f43f945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17135327e2d14c4bbe4c7b242f9fda48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:59:13.913456 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-6e86c684-7f4a-44a9-acec-bf4a4ce6c00d tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] 10.222.0.18 "GET /compute/v2.1/servers/c7b1f93e-a960-4f71-aaf5-4416cca1d22b" status: 200 len: 1715 microversion: 2.1 time: 0.165786 Oct 22 21:59:13.914040 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3325/6619] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:59:13 2022] GET /compute/v2.1/servers/c7b1f93e-a960-4f71-aaf5-4416cca1d22b => generated 1715 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:59:13.935712 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-2277fca3-5c3d-427f-ab9b-97261a067b88 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:59:13.936222 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-2277fca3-5c3d-427f-ab9b-97261a067b88 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] [instance: c7b1f93e-a960-4f71-aaf5-4416cca1d22b] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:59:13.942681 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2277fca3-5c3d-427f-ab9b-97261a067b88 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:59:13.943171 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2277fca3-5c3d-427f-ab9b-97261a067b88 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:59:13.943641 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2277fca3-5c3d-427f-ab9b-97261a067b88 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:59:13.944349 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2277fca3-5c3d-427f-ab9b-97261a067b88 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:59:13.944803 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2277fca3-5c3d-427f-ab9b-97261a067b88 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:59:13.945237 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2277fca3-5c3d-427f-ab9b-97261a067b88 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:59:13.975175 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-2277fca3-5c3d-427f-ab9b-97261a067b88 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] [instance: c7b1f93e-a960-4f71-aaf5-4416cca1d22b] Going to try to terminate instance {{(pid=138744) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 21:59:14.061504 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-2277fca3-5c3d-427f-ab9b-97261a067b88 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] 10.222.0.18 "DELETE /compute/v2.1/servers/c7b1f93e-a960-4f71-aaf5-4416cca1d22b" status: 204 len: 0 microversion: 2.1 time: 0.129103 Oct 22 21:59:14.062435 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3295/6620] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 21:59:13 2022] DELETE /compute/v2.1/servers/c7b1f93e-a960-4f71-aaf5-4416cca1d22b => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 21:59:14.071100 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-632934be-a480-4e7d-8e94-9ef1141a8bc0 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:59:14.071790 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-632934be-a480-4e7d-8e94-9ef1141a8bc0 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] [instance: c7b1f93e-a960-4f71-aaf5-4416cca1d22b] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:59:14.077989 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-632934be-a480-4e7d-8e94-9ef1141a8bc0 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:59:14.078504 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-632934be-a480-4e7d-8e94-9ef1141a8bc0 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:59:14.078961 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-632934be-a480-4e7d-8e94-9ef1141a8bc0 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:59:14.079700 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-632934be-a480-4e7d-8e94-9ef1141a8bc0 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:59:14.080174 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-632934be-a480-4e7d-8e94-9ef1141a8bc0 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:59:14.080620 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-632934be-a480-4e7d-8e94-9ef1141a8bc0 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:59:14.213210 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-632934be-a480-4e7d-8e94-9ef1141a8bc0 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1a4da366004680b7330a8e9f43f945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17135327e2d14c4bbe4c7b242f9fda48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:59:14.222194 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-632934be-a480-4e7d-8e94-9ef1141a8bc0 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] 10.222.0.18 "GET /compute/v2.1/servers/c7b1f93e-a960-4f71-aaf5-4416cca1d22b" status: 200 len: 1721 microversion: 2.1 time: 0.155216 Oct 22 21:59:14.222877 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3326/6621] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:59:14 2022] GET /compute/v2.1/servers/c7b1f93e-a960-4f71-aaf5-4416cca1d22b => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:59:14.822574 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-2d0752be-97d0-4c3d-85be-deb46a2e7b0b req-7abd9a3d-0430-429b-8a25-4cef3f73fe3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7b1f93e-a960-4f71-aaf5-4416cca1d22b", "name": "network-vif-plugged", "status": "completed", "tag": "5467bf4d-26fd-4b2c-8fc7-4e47f53c767f"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:59:14.838325 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-2d0752be-97d0-4c3d-85be-deb46a2e7b0b req-7abd9a3d-0430-429b-8a25-4cef3f73fe3f service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:59:14.838924 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-2d0752be-97d0-4c3d-85be-deb46a2e7b0b req-7abd9a3d-0430-429b-8a25-4cef3f73fe3f service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:59:14.839397 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-2d0752be-97d0-4c3d-85be-deb46a2e7b0b req-7abd9a3d-0430-429b-8a25-4cef3f73fe3f service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:59:14.854550 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-2d0752be-97d0-4c3d-85be-deb46a2e7b0b req-7abd9a3d-0430-429b-8a25-4cef3f73fe3f service nova] Creating event network-vif-plugged:5467bf4d-26fd-4b2c-8fc7-4e47f53c767f for instance c7b1f93e-a960-4f71-aaf5-4416cca1d22b on nch2-master-1 Oct 22 21:59:14.859088 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-2d0752be-97d0-4c3d-85be-deb46a2e7b0b req-7abd9a3d-0430-429b-8a25-4cef3f73fe3f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040977 Oct 22 21:59:14.859754 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3296/6622] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:59:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:59:15.247573 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-816ef470-8f8e-49db-aeef-512c37a7fefe tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:59:15.248293 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-816ef470-8f8e-49db-aeef-512c37a7fefe tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] [instance: c7b1f93e-a960-4f71-aaf5-4416cca1d22b] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:59:15.257762 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-816ef470-8f8e-49db-aeef-512c37a7fefe tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:59:15.258387 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-816ef470-8f8e-49db-aeef-512c37a7fefe tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:59:15.258949 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-816ef470-8f8e-49db-aeef-512c37a7fefe tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:59:15.259885 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-816ef470-8f8e-49db-aeef-512c37a7fefe tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:59:15.260506 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-816ef470-8f8e-49db-aeef-512c37a7fefe tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:59:15.261064 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-816ef470-8f8e-49db-aeef-512c37a7fefe tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:59:15.406947 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-816ef470-8f8e-49db-aeef-512c37a7fefe tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1a4da366004680b7330a8e9f43f945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17135327e2d14c4bbe4c7b242f9fda48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:59:15.416053 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-816ef470-8f8e-49db-aeef-512c37a7fefe tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] 10.222.0.18 "GET /compute/v2.1/servers/c7b1f93e-a960-4f71-aaf5-4416cca1d22b" status: 200 len: 1721 microversion: 2.1 time: 0.173500 Oct 22 21:59:15.416651 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3327/6623] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:59:15 2022] GET /compute/v2.1/servers/c7b1f93e-a960-4f71-aaf5-4416cca1d22b => generated 1721 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:59:16.446878 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-07fc8fd2-585c-4008-8cbd-0ef14a4c0a23 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:59:16.447728 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-07fc8fd2-585c-4008-8cbd-0ef14a4c0a23 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] [instance: c7b1f93e-a960-4f71-aaf5-4416cca1d22b] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:59:16.456717 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-07fc8fd2-585c-4008-8cbd-0ef14a4c0a23 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:59:16.457811 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-07fc8fd2-585c-4008-8cbd-0ef14a4c0a23 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:59:16.458265 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-07fc8fd2-585c-4008-8cbd-0ef14a4c0a23 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:59:16.459558 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-07fc8fd2-585c-4008-8cbd-0ef14a4c0a23 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:59:16.460240 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-07fc8fd2-585c-4008-8cbd-0ef14a4c0a23 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:59:16.461019 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-07fc8fd2-585c-4008-8cbd-0ef14a4c0a23 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:59:16.548543 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-07fc8fd2-585c-4008-8cbd-0ef14a4c0a23 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1a4da366004680b7330a8e9f43f945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17135327e2d14c4bbe4c7b242f9fda48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:59:16.561768 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-07fc8fd2-585c-4008-8cbd-0ef14a4c0a23 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] 10.222.0.18 "GET /compute/v2.1/servers/c7b1f93e-a960-4f71-aaf5-4416cca1d22b" status: 200 len: 1653 microversion: 2.1 time: 0.120933 Oct 22 21:59:16.562703 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3297/6624] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:59:16 2022] GET /compute/v2.1/servers/c7b1f93e-a960-4f71-aaf5-4416cca1d22b => generated 1653 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:59:16.751453 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-8ab8c335-4df6-4021-a4e7-1775f047008f req-eb50a7a8-e381-45cd-bcd0-631a419706b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7b1f93e-a960-4f71-aaf5-4416cca1d22b", "name": "network-vif-deleted", "tag": "5467bf4d-26fd-4b2c-8fc7-4e47f53c767f"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:59:16.761956 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-8ab8c335-4df6-4021-a4e7-1775f047008f req-eb50a7a8-e381-45cd-bcd0-631a419706b0 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:59:16.762434 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-8ab8c335-4df6-4021-a4e7-1775f047008f req-eb50a7a8-e381-45cd-bcd0-631a419706b0 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:59:16.762882 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-8ab8c335-4df6-4021-a4e7-1775f047008f req-eb50a7a8-e381-45cd-bcd0-631a419706b0 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:59:16.774877 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-8ab8c335-4df6-4021-a4e7-1775f047008f req-eb50a7a8-e381-45cd-bcd0-631a419706b0 service nova] Creating event network-vif-deleted:5467bf4d-26fd-4b2c-8fc7-4e47f53c767f for instance c7b1f93e-a960-4f71-aaf5-4416cca1d22b on nch2-master-1 Oct 22 21:59:16.780003 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-8ab8c335-4df6-4021-a4e7-1775f047008f req-eb50a7a8-e381-45cd-bcd0-631a419706b0 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032334 Oct 22 21:59:16.783552 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3328/6625] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:59:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:59:17.588366 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-154dbd8f-701b-4201-b25f-f75676340bf1 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:59:17.588949 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-154dbd8f-701b-4201-b25f-f75676340bf1 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] [instance: c7b1f93e-a960-4f71-aaf5-4416cca1d22b] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:59:17.597353 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-154dbd8f-701b-4201-b25f-f75676340bf1 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:59:17.598126 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-154dbd8f-701b-4201-b25f-f75676340bf1 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:59:17.598660 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-154dbd8f-701b-4201-b25f-f75676340bf1 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:59:17.599466 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-154dbd8f-701b-4201-b25f-f75676340bf1 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:59:17.599936 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-154dbd8f-701b-4201-b25f-f75676340bf1 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:59:17.600372 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-154dbd8f-701b-4201-b25f-f75676340bf1 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:59:17.615686 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-154dbd8f-701b-4201-b25f-f75676340bf1 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] HTTP exception thrown: Instance c7b1f93e-a960-4f71-aaf5-4416cca1d22b could not be found. Oct 22 21:59:17.617410 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-154dbd8f-701b-4201-b25f-f75676340bf1 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Request method failure captured: Oct 22 21:59:17.617410 ncdv-master-1 devstack@n-api.service[138744]: request: GET /compute/v2.1/servers/c7b1f93e-a960-4f71-aaf5-4416cca1d22b HTTP/1.1 Oct 22 21:59:17.617410 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 21:59:17.617410 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 21:59:17.617410 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 21:59:17.617410 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 0 Oct 22 21:59:17.617410 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 21:59:17.617410 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 21:59:17.617410 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 21:59:17.617410 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 21:59:17.617410 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVGYfDlcA9KGX2QlEp4u0j0Sc-lLfggp70EjXb3-sPhTyz6zB5UiJn8D5kqopVhrN_VN9rM0kOlrwARqwadQ16Olp9k3UgVUKiPcvbjWntYV4vZGIhwWOxDtvedxf_ou8I06I86O9hYoH_RNiO9r53LOOM9uLYhVbGc37T_1RXkzoTZs Oct 22 21:59:17.617410 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 21:59:17.617410 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 21:59:17.617410 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 21:59:17.617410 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 21:59:17.617410 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 21:59:17.617410 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 21:59:17.617410 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: 17135327e2d14c4bbe4c7b242f9fda48 Oct 22 21:59:17.617410 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-ServerActionsTestJSON-1985295999 Oct 22 21:59:17.617410 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 21:59:17.617410 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 21:59:17.617410 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_17135327e2d14c4bbe4c7b242f9fda48"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/17135327e2d14c4bbe4c7b242f9fda48"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/17135327e2d14c4bbe4c7b242f9fda48"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/17135327e2d14c4bbe4c7b242f9fda48"}]}] Oct 22 21:59:17.617410 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-ServerActionsTestJSON-1985295999 Oct 22 21:59:17.617410 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: 17135327e2d14c4bbe4c7b242f9fda48 Oct 22 21:59:17.617410 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-ServerActionsTestJSON-1985295999 Oct 22 21:59:17.617410 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-ServerActionsTestJSON-1985295999-project Oct 22 21:59:17.617410 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 21:59:17.617410 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 21:59:17.617410 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: ce1a4da366004680b7330a8e9f43f945 Oct 22 21:59:17.617410 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-ServerActionsTestJSON-1985295999-project Oct 22 21:59:17.617410 ncdv-master-1 devstack@n-api.service[138744]: method: > Oct 22 21:59:17.617410 ncdv-master-1 devstack@n-api.service[138744]: exception: Instance c7b1f93e-a960-4f71-aaf5-4416cca1d22b could not be found. Oct 22 21:59:17.617410 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': 'c7b1f93e-a960-4f71-aaf5-4416cca1d22b'} Oct 22 21:59:17.617410 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:59:17.617410 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:59:17.617410 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 21:59:17.617410 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 21:59:17.617410 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 21:59:17.617410 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 21:59:17.617410 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 21:59:17.617410 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 21:59:17.617410 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 21:59:17.617410 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 21:59:17.617410 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c7b1f93e-a960-4f71-aaf5-4416cca1d22b could not be found. Oct 22 21:59:17.617410 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:59:17.617410 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:59:17.617410 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:59:17.617410 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:59:17.617410 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:59:17.617410 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:59:17.617410 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:59:17.617410 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:59:17.617410 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:59:17.617410 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:59:17.617410 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 21:59:17.617410 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 21:59:17.617410 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 21:59:17.617410 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 21:59:17.617410 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 21:59:17.617410 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:59:17.617410 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c7b1f93e-a960-4f71-aaf5-4416cca1d22b could not be found. Oct 22 21:59:17.617410 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:59:17.617410 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:59:17.617410 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:59:17.622626 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:59:17.622626 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:59:17.622626 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:59:17.622626 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:59:17.622626 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:59:17.622626 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c7b1f93e-a960-4f71-aaf5-4416cca1d22b could not be found. Oct 22 21:59:17.622626 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:59:17.622626 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-154dbd8f-701b-4201-b25f-f75676340bf1 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Returning 404 to user: Instance c7b1f93e-a960-4f71-aaf5-4416cca1d22b could not be found. {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:59:17.622626 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-154dbd8f-701b-4201-b25f-f75676340bf1 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] 10.222.0.18 "GET /compute/v2.1/servers/c7b1f93e-a960-4f71-aaf5-4416cca1d22b" status: 404 len: 111 microversion: 2.1 time: 0.036134 Oct 22 21:59:17.622626 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3298/6626] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:59:17 2022] GET /compute/v2.1/servers/c7b1f93e-a960-4f71-aaf5-4416cca1d22b => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 21:59:17.689052 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-891f71a9-8f69-4333-b384-69dc28804ac7 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:59:17.692255 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-891f71a9-8f69-4333-b384-69dc28804ac7 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] [instance: c7b1f93e-a960-4f71-aaf5-4416cca1d22b] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:59:17.700848 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-891f71a9-8f69-4333-b384-69dc28804ac7 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:59:17.701451 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-891f71a9-8f69-4333-b384-69dc28804ac7 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:59:17.702009 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-891f71a9-8f69-4333-b384-69dc28804ac7 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:59:17.702837 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-891f71a9-8f69-4333-b384-69dc28804ac7 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:59:17.703394 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-891f71a9-8f69-4333-b384-69dc28804ac7 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:59:17.703898 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-891f71a9-8f69-4333-b384-69dc28804ac7 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:59:17.719139 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.wsgi [None req-891f71a9-8f69-4333-b384-69dc28804ac7 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] HTTP exception thrown: Instance c7b1f93e-a960-4f71-aaf5-4416cca1d22b could not be found. Oct 22 21:59:17.720921 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-891f71a9-8f69-4333-b384-69dc28804ac7 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Request method failure captured: Oct 22 21:59:17.720921 ncdv-master-1 devstack@n-api.service[138745]: request: GET /compute/v2.1/servers/c7b1f93e-a960-4f71-aaf5-4416cca1d22b/os-volume_attachments HTTP/1.1 Oct 22 21:59:17.720921 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 21:59:17.720921 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 21:59:17.720921 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 21:59:17.720921 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 0 Oct 22 21:59:17.720921 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 21:59:17.720921 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 21:59:17.720921 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 21:59:17.720921 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 21:59:17.720921 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVGYfDlcA9KGX2QlEp4u0j0Sc-lLfggp70EjXb3-sPhTyz6zB5UiJn8D5kqopVhrN_VN9rM0kOlrwARqwadQ16Olp9k3UgVUKiPcvbjWntYV4vZGIhwWOxDtvedxf_ou8I06I86O9hYoH_RNiO9r53LOOM9uLYhVbGc37T_1RXkzoTZs Oct 22 21:59:17.720921 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 21:59:17.720921 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 21:59:17.720921 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 21:59:17.720921 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 21:59:17.720921 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 21:59:17.720921 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 21:59:17.720921 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: 17135327e2d14c4bbe4c7b242f9fda48 Oct 22 21:59:17.720921 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-ServerActionsTestJSON-1985295999 Oct 22 21:59:17.720921 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 21:59:17.720921 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 21:59:17.720921 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_17135327e2d14c4bbe4c7b242f9fda48"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/17135327e2d14c4bbe4c7b242f9fda48"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/17135327e2d14c4bbe4c7b242f9fda48"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/17135327e2d14c4bbe4c7b242f9fda48"}]}] Oct 22 21:59:17.720921 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-ServerActionsTestJSON-1985295999 Oct 22 21:59:17.720921 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: 17135327e2d14c4bbe4c7b242f9fda48 Oct 22 21:59:17.720921 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-ServerActionsTestJSON-1985295999 Oct 22 21:59:17.720921 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-ServerActionsTestJSON-1985295999-project Oct 22 21:59:17.720921 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 21:59:17.720921 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 21:59:17.720921 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: ce1a4da366004680b7330a8e9f43f945 Oct 22 21:59:17.720921 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-ServerActionsTestJSON-1985295999-project Oct 22 21:59:17.720921 ncdv-master-1 devstack@n-api.service[138745]: method: > Oct 22 21:59:17.720921 ncdv-master-1 devstack@n-api.service[138745]: exception: Instance c7b1f93e-a960-4f71-aaf5-4416cca1d22b could not be found. Oct 22 21:59:17.720921 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'server_id': 'c7b1f93e-a960-4f71-aaf5-4416cca1d22b'} Oct 22 21:59:17.720921 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:59:17.720921 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:59:17.720921 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 21:59:17.720921 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 21:59:17.720921 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 21:59:17.720921 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 21:59:17.720921 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 21:59:17.720921 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 21:59:17.720921 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 21:59:17.720921 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 21:59:17.720921 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c7b1f93e-a960-4f71-aaf5-4416cca1d22b could not be found. Oct 22 21:59:17.720921 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:59:17.720921 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:59:17.720921 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:59:17.720921 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:59:17.720921 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:59:17.720921 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:59:17.720921 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:59:17.720921 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:59:17.720921 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:59:17.720921 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:59:17.720921 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 22 21:59:17.720921 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 21:59:17.720921 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 22 21:59:17.720921 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 21:59:17.720921 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Oct 22 21:59:17.720921 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Oct 22 21:59:17.720921 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 21:59:17.720921 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:59:17.725904 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c7b1f93e-a960-4f71-aaf5-4416cca1d22b could not be found. Oct 22 21:59:17.725904 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:59:17.725904 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:59:17.725904 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:59:17.725904 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:59:17.725904 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:59:17.725904 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:59:17.725904 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:59:17.725904 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:59:17.725904 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c7b1f93e-a960-4f71-aaf5-4416cca1d22b could not be found. Oct 22 21:59:17.725904 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:59:17.725904 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-891f71a9-8f69-4333-b384-69dc28804ac7 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Returning 404 to user: Instance c7b1f93e-a960-4f71-aaf5-4416cca1d22b could not be found. {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:59:17.725904 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-891f71a9-8f69-4333-b384-69dc28804ac7 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] 10.222.0.18 "GET /compute/v2.1/servers/c7b1f93e-a960-4f71-aaf5-4416cca1d22b/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.038644 Oct 22 21:59:17.725904 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3329/6627] 10.222.0.18 () {58 vars in 1302 bytes} [Sat Oct 22 21:59:17 2022] GET /compute/v2.1/servers/c7b1f93e-a960-4f71-aaf5-4416cca1d22b/os-volume_attachments => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 21:59:18.957519 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-382a5466-960a-464e-8bd0-97b331232ac9 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:59:18.958465 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-382a5466-960a-464e-8bd0-97b331232ac9 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] [instance: c7b1f93e-a960-4f71-aaf5-4416cca1d22b] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:59:18.965356 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-382a5466-960a-464e-8bd0-97b331232ac9 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:59:18.965858 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-382a5466-960a-464e-8bd0-97b331232ac9 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:59:18.966303 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-382a5466-960a-464e-8bd0-97b331232ac9 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:59:18.967360 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-382a5466-960a-464e-8bd0-97b331232ac9 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:59:18.967843 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-382a5466-960a-464e-8bd0-97b331232ac9 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:59:18.968289 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-382a5466-960a-464e-8bd0-97b331232ac9 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:59:18.982635 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-382a5466-960a-464e-8bd0-97b331232ac9 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] HTTP exception thrown: Instance c7b1f93e-a960-4f71-aaf5-4416cca1d22b could not be found. Oct 22 21:59:18.984276 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-382a5466-960a-464e-8bd0-97b331232ac9 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Request method failure captured: Oct 22 21:59:18.984276 ncdv-master-1 devstack@n-api.service[138744]: request: DELETE /compute/v2.1/servers/c7b1f93e-a960-4f71-aaf5-4416cca1d22b HTTP/1.1 Oct 22 21:59:18.984276 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 21:59:18.984276 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 21:59:18.984276 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 21:59:18.984276 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 0 Oct 22 21:59:18.984276 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 21:59:18.984276 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 21:59:18.984276 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 21:59:18.984276 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 21:59:18.984276 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVGYfDlcA9KGX2QlEp4u0j0Sc-lLfggp70EjXb3-sPhTyz6zB5UiJn8D5kqopVhrN_VN9rM0kOlrwARqwadQ16Olp9k3UgVUKiPcvbjWntYV4vZGIhwWOxDtvedxf_ou8I06I86O9hYoH_RNiO9r53LOOM9uLYhVbGc37T_1RXkzoTZs Oct 22 21:59:18.984276 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 21:59:18.984276 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 21:59:18.984276 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 21:59:18.984276 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 21:59:18.984276 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 21:59:18.984276 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 21:59:18.984276 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: 17135327e2d14c4bbe4c7b242f9fda48 Oct 22 21:59:18.984276 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-ServerActionsTestJSON-1985295999 Oct 22 21:59:18.984276 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 21:59:18.984276 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 21:59:18.984276 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_17135327e2d14c4bbe4c7b242f9fda48"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/17135327e2d14c4bbe4c7b242f9fda48"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/17135327e2d14c4bbe4c7b242f9fda48"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/17135327e2d14c4bbe4c7b242f9fda48"}]}] Oct 22 21:59:18.984276 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-ServerActionsTestJSON-1985295999 Oct 22 21:59:18.984276 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: 17135327e2d14c4bbe4c7b242f9fda48 Oct 22 21:59:18.984276 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-ServerActionsTestJSON-1985295999 Oct 22 21:59:18.984276 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-ServerActionsTestJSON-1985295999-project Oct 22 21:59:18.984276 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 21:59:18.984276 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 21:59:18.984276 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: ce1a4da366004680b7330a8e9f43f945 Oct 22 21:59:18.984276 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-ServerActionsTestJSON-1985295999-project Oct 22 21:59:18.984276 ncdv-master-1 devstack@n-api.service[138744]: method: > Oct 22 21:59:18.984276 ncdv-master-1 devstack@n-api.service[138744]: exception: Instance c7b1f93e-a960-4f71-aaf5-4416cca1d22b could not be found. Oct 22 21:59:18.984276 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': 'c7b1f93e-a960-4f71-aaf5-4416cca1d22b'} Oct 22 21:59:18.984276 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:59:18.984276 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:59:18.984276 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 21:59:18.984276 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 21:59:18.984276 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 21:59:18.984276 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 21:59:18.984276 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 21:59:18.984276 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 21:59:18.984276 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 21:59:18.984276 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 21:59:18.984276 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c7b1f93e-a960-4f71-aaf5-4416cca1d22b could not be found. Oct 22 21:59:18.984276 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:59:18.984276 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:59:18.984276 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:59:18.984276 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:59:18.984276 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:59:18.984276 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:59:18.984276 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:59:18.984276 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:59:18.984276 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:59:18.984276 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:59:18.984276 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 22 21:59:18.984276 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 22 21:59:18.984276 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 22 21:59:18.984276 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 22 21:59:18.984276 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 21:59:18.984276 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 21:59:18.984276 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 21:59:18.984276 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:59:18.989617 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c7b1f93e-a960-4f71-aaf5-4416cca1d22b could not be found. Oct 22 21:59:18.989617 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:59:18.989617 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:59:18.989617 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:59:18.989617 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:59:18.989617 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:59:18.989617 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:59:18.989617 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:59:18.989617 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:59:18.989617 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c7b1f93e-a960-4f71-aaf5-4416cca1d22b could not be found. Oct 22 21:59:18.989617 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:59:18.989617 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-382a5466-960a-464e-8bd0-97b331232ac9 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Returning 404 to user: Instance c7b1f93e-a960-4f71-aaf5-4416cca1d22b could not be found. {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:59:18.989617 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-382a5466-960a-464e-8bd0-97b331232ac9 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] 10.222.0.18 "DELETE /compute/v2.1/servers/c7b1f93e-a960-4f71-aaf5-4416cca1d22b" status: 404 len: 111 microversion: 2.1 time: 0.032270 Oct 22 21:59:18.989617 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3299/6628] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 21:59:18 2022] DELETE /compute/v2.1/servers/c7b1f93e-a960-4f71-aaf5-4416cca1d22b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 21:59:18.994704 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-7a006cbd-8ce4-4d95-bba4-694f7d4e687c tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:59:18.995352 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-7a006cbd-8ce4-4d95-bba4-694f7d4e687c tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] [instance: c7b1f93e-a960-4f71-aaf5-4416cca1d22b] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:59:19.002142 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7a006cbd-8ce4-4d95-bba4-694f7d4e687c tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:59:19.002645 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7a006cbd-8ce4-4d95-bba4-694f7d4e687c tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:59:19.003098 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7a006cbd-8ce4-4d95-bba4-694f7d4e687c tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:59:19.003872 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7a006cbd-8ce4-4d95-bba4-694f7d4e687c tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:59:19.004354 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7a006cbd-8ce4-4d95-bba4-694f7d4e687c tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:59:19.004927 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7a006cbd-8ce4-4d95-bba4-694f7d4e687c tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:59:19.018882 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.wsgi [None req-7a006cbd-8ce4-4d95-bba4-694f7d4e687c tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] HTTP exception thrown: Instance c7b1f93e-a960-4f71-aaf5-4416cca1d22b could not be found. Oct 22 21:59:19.020843 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-7a006cbd-8ce4-4d95-bba4-694f7d4e687c tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Request method failure captured: Oct 22 21:59:19.020843 ncdv-master-1 devstack@n-api.service[138745]: request: GET /compute/v2.1/servers/c7b1f93e-a960-4f71-aaf5-4416cca1d22b HTTP/1.1 Oct 22 21:59:19.020843 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 21:59:19.020843 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 21:59:19.020843 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 21:59:19.020843 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 0 Oct 22 21:59:19.020843 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 21:59:19.020843 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 21:59:19.020843 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 21:59:19.020843 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 21:59:19.020843 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVGYfDlcA9KGX2QlEp4u0j0Sc-lLfggp70EjXb3-sPhTyz6zB5UiJn8D5kqopVhrN_VN9rM0kOlrwARqwadQ16Olp9k3UgVUKiPcvbjWntYV4vZGIhwWOxDtvedxf_ou8I06I86O9hYoH_RNiO9r53LOOM9uLYhVbGc37T_1RXkzoTZs Oct 22 21:59:19.020843 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 21:59:19.020843 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 21:59:19.020843 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 21:59:19.020843 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 21:59:19.020843 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 21:59:19.020843 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 21:59:19.020843 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: 17135327e2d14c4bbe4c7b242f9fda48 Oct 22 21:59:19.020843 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-ServerActionsTestJSON-1985295999 Oct 22 21:59:19.020843 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 21:59:19.020843 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 21:59:19.020843 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_17135327e2d14c4bbe4c7b242f9fda48"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/17135327e2d14c4bbe4c7b242f9fda48"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/17135327e2d14c4bbe4c7b242f9fda48"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/17135327e2d14c4bbe4c7b242f9fda48"}]}] Oct 22 21:59:19.020843 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-ServerActionsTestJSON-1985295999 Oct 22 21:59:19.020843 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: 17135327e2d14c4bbe4c7b242f9fda48 Oct 22 21:59:19.020843 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-ServerActionsTestJSON-1985295999 Oct 22 21:59:19.020843 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-ServerActionsTestJSON-1985295999-project Oct 22 21:59:19.020843 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 21:59:19.020843 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 21:59:19.020843 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: ce1a4da366004680b7330a8e9f43f945 Oct 22 21:59:19.020843 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-ServerActionsTestJSON-1985295999-project Oct 22 21:59:19.020843 ncdv-master-1 devstack@n-api.service[138745]: method: > Oct 22 21:59:19.020843 ncdv-master-1 devstack@n-api.service[138745]: exception: Instance c7b1f93e-a960-4f71-aaf5-4416cca1d22b could not be found. Oct 22 21:59:19.020843 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'id': 'c7b1f93e-a960-4f71-aaf5-4416cca1d22b'} Oct 22 21:59:19.020843 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:59:19.020843 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:59:19.020843 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 21:59:19.020843 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 21:59:19.020843 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 21:59:19.020843 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 21:59:19.020843 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 21:59:19.020843 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 21:59:19.020843 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 21:59:19.020843 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 21:59:19.020843 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c7b1f93e-a960-4f71-aaf5-4416cca1d22b could not be found. Oct 22 21:59:19.020843 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:59:19.020843 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:59:19.020843 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:59:19.020843 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:59:19.020843 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:59:19.020843 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:59:19.020843 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:59:19.020843 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:59:19.020843 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:59:19.020843 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:59:19.020843 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 21:59:19.020843 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 21:59:19.020843 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 21:59:19.020843 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 21:59:19.020843 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 21:59:19.020843 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:59:19.020843 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c7b1f93e-a960-4f71-aaf5-4416cca1d22b could not be found. Oct 22 21:59:19.020843 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:59:19.020843 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:59:19.020843 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:59:19.025739 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:59:19.025739 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:59:19.025739 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:59:19.025739 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:59:19.025739 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:59:19.025739 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c7b1f93e-a960-4f71-aaf5-4416cca1d22b could not be found. Oct 22 21:59:19.025739 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:59:19.025739 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-7a006cbd-8ce4-4d95-bba4-694f7d4e687c tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Returning 404 to user: Instance c7b1f93e-a960-4f71-aaf5-4416cca1d22b could not be found. {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:59:19.025739 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-7a006cbd-8ce4-4d95-bba4-694f7d4e687c tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] 10.222.0.18 "GET /compute/v2.1/servers/c7b1f93e-a960-4f71-aaf5-4416cca1d22b" status: 404 len: 111 microversion: 2.1 time: 0.031611 Oct 22 21:59:19.025739 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3330/6629] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:59:18 2022] GET /compute/v2.1/servers/c7b1f93e-a960-4f71-aaf5-4416cca1d22b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 21:59:19.031846 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-a532c813-61c0-46ee-9319-e24488c68603 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:59:19.032349 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-a532c813-61c0-46ee-9319-e24488c68603 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] [instance: 7c3f6786-1255-40f9-b54a-3e42c7799c4e] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:59:19.038507 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a532c813-61c0-46ee-9319-e24488c68603 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:59:19.038987 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a532c813-61c0-46ee-9319-e24488c68603 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:59:19.039462 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a532c813-61c0-46ee-9319-e24488c68603 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:59:19.040157 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a532c813-61c0-46ee-9319-e24488c68603 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:59:19.040616 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a532c813-61c0-46ee-9319-e24488c68603 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:59:19.041053 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a532c813-61c0-46ee-9319-e24488c68603 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:59:19.054813 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-a532c813-61c0-46ee-9319-e24488c68603 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] HTTP exception thrown: Instance 7c3f6786-1255-40f9-b54a-3e42c7799c4e could not be found. Oct 22 21:59:19.056388 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-a532c813-61c0-46ee-9319-e24488c68603 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Request method failure captured: Oct 22 21:59:19.056388 ncdv-master-1 devstack@n-api.service[138744]: request: DELETE /compute/v2.1/servers/7c3f6786-1255-40f9-b54a-3e42c7799c4e HTTP/1.1 Oct 22 21:59:19.056388 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 21:59:19.056388 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 21:59:19.056388 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 21:59:19.056388 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 0 Oct 22 21:59:19.056388 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 21:59:19.056388 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 21:59:19.056388 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 21:59:19.056388 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 21:59:19.056388 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVGYfDlcA9KGX2QlEp4u0j0Sc-lLfggp70EjXb3-sPhTyz6zB5UiJn8D5kqopVhrN_VN9rM0kOlrwARqwadQ16Olp9k3UgVUKiPcvbjWntYV4vZGIhwWOxDtvedxf_ou8I06I86O9hYoH_RNiO9r53LOOM9uLYhVbGc37T_1RXkzoTZs Oct 22 21:59:19.056388 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 21:59:19.056388 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 21:59:19.056388 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 21:59:19.056388 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 21:59:19.056388 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 21:59:19.056388 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 21:59:19.056388 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: 17135327e2d14c4bbe4c7b242f9fda48 Oct 22 21:59:19.056388 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-ServerActionsTestJSON-1985295999 Oct 22 21:59:19.056388 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 21:59:19.056388 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 21:59:19.056388 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_17135327e2d14c4bbe4c7b242f9fda48"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/17135327e2d14c4bbe4c7b242f9fda48"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/17135327e2d14c4bbe4c7b242f9fda48"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/17135327e2d14c4bbe4c7b242f9fda48"}]}] Oct 22 21:59:19.056388 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-ServerActionsTestJSON-1985295999 Oct 22 21:59:19.056388 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: 17135327e2d14c4bbe4c7b242f9fda48 Oct 22 21:59:19.056388 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-ServerActionsTestJSON-1985295999 Oct 22 21:59:19.056388 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-ServerActionsTestJSON-1985295999-project Oct 22 21:59:19.056388 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 21:59:19.056388 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 21:59:19.056388 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: ce1a4da366004680b7330a8e9f43f945 Oct 22 21:59:19.056388 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-ServerActionsTestJSON-1985295999-project Oct 22 21:59:19.056388 ncdv-master-1 devstack@n-api.service[138744]: method: > Oct 22 21:59:19.056388 ncdv-master-1 devstack@n-api.service[138744]: exception: Instance 7c3f6786-1255-40f9-b54a-3e42c7799c4e could not be found. Oct 22 21:59:19.056388 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': '7c3f6786-1255-40f9-b54a-3e42c7799c4e'} Oct 22 21:59:19.056388 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:59:19.056388 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:59:19.056388 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 21:59:19.056388 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 21:59:19.056388 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 21:59:19.056388 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 21:59:19.056388 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 21:59:19.056388 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 21:59:19.056388 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 21:59:19.056388 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 21:59:19.056388 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c3f6786-1255-40f9-b54a-3e42c7799c4e could not be found. Oct 22 21:59:19.056388 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:59:19.056388 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:59:19.056388 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:59:19.056388 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:59:19.056388 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:59:19.056388 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:59:19.056388 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:59:19.056388 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:59:19.056388 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:59:19.056388 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:59:19.056388 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 22 21:59:19.056388 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 22 21:59:19.056388 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 22 21:59:19.056388 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 22 21:59:19.056388 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 21:59:19.056388 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 21:59:19.056388 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 21:59:19.056388 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:59:19.061082 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c3f6786-1255-40f9-b54a-3e42c7799c4e could not be found. Oct 22 21:59:19.061082 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:59:19.061082 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:59:19.061082 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:59:19.061082 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:59:19.061082 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:59:19.061082 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:59:19.061082 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:59:19.061082 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:59:19.061082 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c3f6786-1255-40f9-b54a-3e42c7799c4e could not be found. Oct 22 21:59:19.061082 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:59:19.061082 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-a532c813-61c0-46ee-9319-e24488c68603 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Returning 404 to user: Instance 7c3f6786-1255-40f9-b54a-3e42c7799c4e could not be found. {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:59:19.061082 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-a532c813-61c0-46ee-9319-e24488c68603 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] 10.222.0.18 "DELETE /compute/v2.1/servers/7c3f6786-1255-40f9-b54a-3e42c7799c4e" status: 404 len: 111 microversion: 2.1 time: 0.030003 Oct 22 21:59:19.061082 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3300/6630] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 21:59:19 2022] DELETE /compute/v2.1/servers/7c3f6786-1255-40f9-b54a-3e42c7799c4e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 21:59:19.066544 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-22ad6d03-43a6-4b7b-a1e1-315303c1fa05 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:59:19.067481 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-22ad6d03-43a6-4b7b-a1e1-315303c1fa05 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] [instance: 7c3f6786-1255-40f9-b54a-3e42c7799c4e] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:59:19.074878 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-22ad6d03-43a6-4b7b-a1e1-315303c1fa05 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:59:19.075504 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-22ad6d03-43a6-4b7b-a1e1-315303c1fa05 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:59:19.075972 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-22ad6d03-43a6-4b7b-a1e1-315303c1fa05 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:59:19.076814 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-22ad6d03-43a6-4b7b-a1e1-315303c1fa05 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:59:19.077660 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-22ad6d03-43a6-4b7b-a1e1-315303c1fa05 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:59:19.077660 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-22ad6d03-43a6-4b7b-a1e1-315303c1fa05 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:59:19.092290 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.wsgi [None req-22ad6d03-43a6-4b7b-a1e1-315303c1fa05 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] HTTP exception thrown: Instance 7c3f6786-1255-40f9-b54a-3e42c7799c4e could not be found. Oct 22 21:59:19.093849 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-22ad6d03-43a6-4b7b-a1e1-315303c1fa05 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Request method failure captured: Oct 22 21:59:19.093849 ncdv-master-1 devstack@n-api.service[138745]: request: GET /compute/v2.1/servers/7c3f6786-1255-40f9-b54a-3e42c7799c4e HTTP/1.1 Oct 22 21:59:19.093849 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 21:59:19.093849 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 21:59:19.093849 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 21:59:19.093849 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 0 Oct 22 21:59:19.093849 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 21:59:19.093849 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 21:59:19.093849 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 21:59:19.093849 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 21:59:19.093849 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVGYfDlcA9KGX2QlEp4u0j0Sc-lLfggp70EjXb3-sPhTyz6zB5UiJn8D5kqopVhrN_VN9rM0kOlrwARqwadQ16Olp9k3UgVUKiPcvbjWntYV4vZGIhwWOxDtvedxf_ou8I06I86O9hYoH_RNiO9r53LOOM9uLYhVbGc37T_1RXkzoTZs Oct 22 21:59:19.093849 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 21:59:19.093849 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 21:59:19.093849 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 21:59:19.093849 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 21:59:19.093849 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 21:59:19.093849 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 21:59:19.093849 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: 17135327e2d14c4bbe4c7b242f9fda48 Oct 22 21:59:19.093849 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-ServerActionsTestJSON-1985295999 Oct 22 21:59:19.093849 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 21:59:19.093849 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 21:59:19.093849 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_17135327e2d14c4bbe4c7b242f9fda48"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/17135327e2d14c4bbe4c7b242f9fda48"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/17135327e2d14c4bbe4c7b242f9fda48"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/17135327e2d14c4bbe4c7b242f9fda48"}]}] Oct 22 21:59:19.093849 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-ServerActionsTestJSON-1985295999 Oct 22 21:59:19.093849 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: 17135327e2d14c4bbe4c7b242f9fda48 Oct 22 21:59:19.093849 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-ServerActionsTestJSON-1985295999 Oct 22 21:59:19.093849 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-ServerActionsTestJSON-1985295999-project Oct 22 21:59:19.093849 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 21:59:19.093849 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 21:59:19.093849 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: ce1a4da366004680b7330a8e9f43f945 Oct 22 21:59:19.093849 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-ServerActionsTestJSON-1985295999-project Oct 22 21:59:19.093849 ncdv-master-1 devstack@n-api.service[138745]: method: > Oct 22 21:59:19.093849 ncdv-master-1 devstack@n-api.service[138745]: exception: Instance 7c3f6786-1255-40f9-b54a-3e42c7799c4e could not be found. Oct 22 21:59:19.093849 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'id': '7c3f6786-1255-40f9-b54a-3e42c7799c4e'} Oct 22 21:59:19.093849 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:59:19.093849 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:59:19.093849 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 21:59:19.093849 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 21:59:19.093849 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 21:59:19.093849 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 21:59:19.093849 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 21:59:19.093849 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 21:59:19.093849 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 21:59:19.093849 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 21:59:19.093849 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c3f6786-1255-40f9-b54a-3e42c7799c4e could not be found. Oct 22 21:59:19.093849 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:59:19.093849 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:59:19.093849 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:59:19.093849 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:59:19.093849 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:59:19.093849 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:59:19.093849 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:59:19.093849 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:59:19.093849 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:59:19.093849 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:59:19.093849 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 21:59:19.093849 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 21:59:19.093849 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 21:59:19.093849 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 21:59:19.093849 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 21:59:19.093849 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:59:19.093849 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c3f6786-1255-40f9-b54a-3e42c7799c4e could not be found. Oct 22 21:59:19.093849 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:59:19.093849 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:59:19.093849 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:59:19.098795 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:59:19.098795 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:59:19.098795 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:59:19.098795 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:59:19.098795 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:59:19.098795 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c3f6786-1255-40f9-b54a-3e42c7799c4e could not be found. Oct 22 21:59:19.098795 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:59:19.098795 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-22ad6d03-43a6-4b7b-a1e1-315303c1fa05 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Returning 404 to user: Instance 7c3f6786-1255-40f9-b54a-3e42c7799c4e could not be found. {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:59:19.098795 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-22ad6d03-43a6-4b7b-a1e1-315303c1fa05 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] 10.222.0.18 "GET /compute/v2.1/servers/7c3f6786-1255-40f9-b54a-3e42c7799c4e" status: 404 len: 111 microversion: 2.1 time: 0.032739 Oct 22 21:59:19.098795 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3331/6631] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:59:19 2022] GET /compute/v2.1/servers/7c3f6786-1255-40f9-b54a-3e42c7799c4e => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 21:59:19.104257 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-13b2e5cc-04c0-43c4-9804-1965e72ddd46 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:59:19.104765 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-13b2e5cc-04c0-43c4-9804-1965e72ddd46 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] [instance: d8a6a01e-c590-4005-8892-4bd894964374] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:59:19.111042 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-13b2e5cc-04c0-43c4-9804-1965e72ddd46 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:59:19.111583 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-13b2e5cc-04c0-43c4-9804-1965e72ddd46 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:59:19.112024 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-13b2e5cc-04c0-43c4-9804-1965e72ddd46 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:59:19.112717 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-13b2e5cc-04c0-43c4-9804-1965e72ddd46 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:59:19.113174 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-13b2e5cc-04c0-43c4-9804-1965e72ddd46 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:59:19.113599 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-13b2e5cc-04c0-43c4-9804-1965e72ddd46 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:59:19.127692 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-13b2e5cc-04c0-43c4-9804-1965e72ddd46 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] HTTP exception thrown: Instance d8a6a01e-c590-4005-8892-4bd894964374 could not be found. Oct 22 21:59:19.129350 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-13b2e5cc-04c0-43c4-9804-1965e72ddd46 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Request method failure captured: Oct 22 21:59:19.129350 ncdv-master-1 devstack@n-api.service[138744]: request: DELETE /compute/v2.1/servers/d8a6a01e-c590-4005-8892-4bd894964374 HTTP/1.1 Oct 22 21:59:19.129350 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 21:59:19.129350 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 21:59:19.129350 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 21:59:19.129350 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 0 Oct 22 21:59:19.129350 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 21:59:19.129350 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 21:59:19.129350 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 21:59:19.129350 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 21:59:19.129350 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVGYfDlcA9KGX2QlEp4u0j0Sc-lLfggp70EjXb3-sPhTyz6zB5UiJn8D5kqopVhrN_VN9rM0kOlrwARqwadQ16Olp9k3UgVUKiPcvbjWntYV4vZGIhwWOxDtvedxf_ou8I06I86O9hYoH_RNiO9r53LOOM9uLYhVbGc37T_1RXkzoTZs Oct 22 21:59:19.129350 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 21:59:19.129350 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 21:59:19.129350 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 21:59:19.129350 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 21:59:19.129350 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 21:59:19.129350 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 21:59:19.129350 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: 17135327e2d14c4bbe4c7b242f9fda48 Oct 22 21:59:19.129350 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-ServerActionsTestJSON-1985295999 Oct 22 21:59:19.129350 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 21:59:19.129350 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 21:59:19.129350 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_17135327e2d14c4bbe4c7b242f9fda48"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/17135327e2d14c4bbe4c7b242f9fda48"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/17135327e2d14c4bbe4c7b242f9fda48"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/17135327e2d14c4bbe4c7b242f9fda48"}]}] Oct 22 21:59:19.129350 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-ServerActionsTestJSON-1985295999 Oct 22 21:59:19.129350 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: 17135327e2d14c4bbe4c7b242f9fda48 Oct 22 21:59:19.129350 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-ServerActionsTestJSON-1985295999 Oct 22 21:59:19.129350 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-ServerActionsTestJSON-1985295999-project Oct 22 21:59:19.129350 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 21:59:19.129350 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 21:59:19.129350 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: ce1a4da366004680b7330a8e9f43f945 Oct 22 21:59:19.129350 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-ServerActionsTestJSON-1985295999-project Oct 22 21:59:19.129350 ncdv-master-1 devstack@n-api.service[138744]: method: > Oct 22 21:59:19.129350 ncdv-master-1 devstack@n-api.service[138744]: exception: Instance d8a6a01e-c590-4005-8892-4bd894964374 could not be found. Oct 22 21:59:19.129350 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': 'd8a6a01e-c590-4005-8892-4bd894964374'} Oct 22 21:59:19.129350 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:59:19.129350 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:59:19.129350 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 21:59:19.129350 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 21:59:19.129350 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 21:59:19.129350 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 21:59:19.129350 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 21:59:19.129350 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 21:59:19.129350 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 21:59:19.129350 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 21:59:19.129350 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d8a6a01e-c590-4005-8892-4bd894964374 could not be found. Oct 22 21:59:19.129350 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:59:19.129350 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:59:19.129350 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:59:19.129350 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:59:19.129350 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:59:19.129350 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:59:19.129350 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:59:19.129350 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:59:19.129350 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:59:19.129350 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:59:19.129350 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 22 21:59:19.129350 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 22 21:59:19.129350 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 22 21:59:19.129350 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 22 21:59:19.129350 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 21:59:19.129350 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 21:59:19.129350 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 21:59:19.129350 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:59:19.134337 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d8a6a01e-c590-4005-8892-4bd894964374 could not be found. Oct 22 21:59:19.134337 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:59:19.134337 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:59:19.134337 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:59:19.134337 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:59:19.134337 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:59:19.134337 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:59:19.134337 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:59:19.134337 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:59:19.134337 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d8a6a01e-c590-4005-8892-4bd894964374 could not be found. Oct 22 21:59:19.134337 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:59:19.134337 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-13b2e5cc-04c0-43c4-9804-1965e72ddd46 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Returning 404 to user: Instance d8a6a01e-c590-4005-8892-4bd894964374 could not be found. {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:59:19.134337 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-13b2e5cc-04c0-43c4-9804-1965e72ddd46 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] 10.222.0.18 "DELETE /compute/v2.1/servers/d8a6a01e-c590-4005-8892-4bd894964374" status: 404 len: 111 microversion: 2.1 time: 0.030501 Oct 22 21:59:19.134337 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3301/6632] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 21:59:19 2022] DELETE /compute/v2.1/servers/d8a6a01e-c590-4005-8892-4bd894964374 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 21:59:19.139381 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-96e6ec32-e25d-4c8d-94ea-081513a92d17 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:59:19.140005 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-96e6ec32-e25d-4c8d-94ea-081513a92d17 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] [instance: d8a6a01e-c590-4005-8892-4bd894964374] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:59:19.146570 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-96e6ec32-e25d-4c8d-94ea-081513a92d17 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:59:19.147078 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-96e6ec32-e25d-4c8d-94ea-081513a92d17 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:59:19.147576 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-96e6ec32-e25d-4c8d-94ea-081513a92d17 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:59:19.148290 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-96e6ec32-e25d-4c8d-94ea-081513a92d17 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:59:19.148767 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-96e6ec32-e25d-4c8d-94ea-081513a92d17 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:59:19.149193 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-96e6ec32-e25d-4c8d-94ea-081513a92d17 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:59:19.163376 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.wsgi [None req-96e6ec32-e25d-4c8d-94ea-081513a92d17 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] HTTP exception thrown: Instance d8a6a01e-c590-4005-8892-4bd894964374 could not be found. Oct 22 21:59:19.164960 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-96e6ec32-e25d-4c8d-94ea-081513a92d17 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Request method failure captured: Oct 22 21:59:19.164960 ncdv-master-1 devstack@n-api.service[138745]: request: GET /compute/v2.1/servers/d8a6a01e-c590-4005-8892-4bd894964374 HTTP/1.1 Oct 22 21:59:19.164960 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 21:59:19.164960 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 21:59:19.164960 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 21:59:19.164960 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 0 Oct 22 21:59:19.164960 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 21:59:19.164960 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 21:59:19.164960 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 21:59:19.164960 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 21:59:19.164960 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVGYfDlcA9KGX2QlEp4u0j0Sc-lLfggp70EjXb3-sPhTyz6zB5UiJn8D5kqopVhrN_VN9rM0kOlrwARqwadQ16Olp9k3UgVUKiPcvbjWntYV4vZGIhwWOxDtvedxf_ou8I06I86O9hYoH_RNiO9r53LOOM9uLYhVbGc37T_1RXkzoTZs Oct 22 21:59:19.164960 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 21:59:19.164960 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 21:59:19.164960 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 21:59:19.164960 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 21:59:19.164960 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 21:59:19.164960 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 21:59:19.164960 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: 17135327e2d14c4bbe4c7b242f9fda48 Oct 22 21:59:19.164960 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-ServerActionsTestJSON-1985295999 Oct 22 21:59:19.164960 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 21:59:19.164960 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 21:59:19.164960 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_17135327e2d14c4bbe4c7b242f9fda48"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/17135327e2d14c4bbe4c7b242f9fda48"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/17135327e2d14c4bbe4c7b242f9fda48"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/17135327e2d14c4bbe4c7b242f9fda48"}]}] Oct 22 21:59:19.164960 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-ServerActionsTestJSON-1985295999 Oct 22 21:59:19.164960 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: 17135327e2d14c4bbe4c7b242f9fda48 Oct 22 21:59:19.164960 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-ServerActionsTestJSON-1985295999 Oct 22 21:59:19.164960 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-ServerActionsTestJSON-1985295999-project Oct 22 21:59:19.164960 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 21:59:19.164960 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 21:59:19.164960 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: ce1a4da366004680b7330a8e9f43f945 Oct 22 21:59:19.164960 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-ServerActionsTestJSON-1985295999-project Oct 22 21:59:19.164960 ncdv-master-1 devstack@n-api.service[138745]: method: > Oct 22 21:59:19.164960 ncdv-master-1 devstack@n-api.service[138745]: exception: Instance d8a6a01e-c590-4005-8892-4bd894964374 could not be found. Oct 22 21:59:19.164960 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'id': 'd8a6a01e-c590-4005-8892-4bd894964374'} Oct 22 21:59:19.164960 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:59:19.164960 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:59:19.164960 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 21:59:19.164960 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 21:59:19.164960 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 21:59:19.164960 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 21:59:19.164960 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 21:59:19.164960 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 21:59:19.164960 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 21:59:19.164960 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 21:59:19.164960 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d8a6a01e-c590-4005-8892-4bd894964374 could not be found. Oct 22 21:59:19.164960 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:59:19.164960 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:59:19.164960 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:59:19.164960 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:59:19.164960 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:59:19.164960 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:59:19.164960 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:59:19.164960 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:59:19.164960 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:59:19.164960 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:59:19.164960 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 21:59:19.164960 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 21:59:19.164960 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 21:59:19.164960 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 21:59:19.164960 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 21:59:19.164960 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:59:19.164960 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d8a6a01e-c590-4005-8892-4bd894964374 could not be found. Oct 22 21:59:19.164960 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:59:19.164960 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:59:19.164960 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:59:19.169457 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:59:19.169457 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:59:19.169457 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:59:19.169457 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:59:19.169457 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:59:19.169457 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d8a6a01e-c590-4005-8892-4bd894964374 could not be found. Oct 22 21:59:19.169457 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:59:19.169457 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-96e6ec32-e25d-4c8d-94ea-081513a92d17 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Returning 404 to user: Instance d8a6a01e-c590-4005-8892-4bd894964374 could not be found. {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:59:19.169457 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-96e6ec32-e25d-4c8d-94ea-081513a92d17 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] 10.222.0.18 "GET /compute/v2.1/servers/d8a6a01e-c590-4005-8892-4bd894964374" status: 404 len: 111 microversion: 2.1 time: 0.030997 Oct 22 21:59:19.169457 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3332/6633] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:59:19 2022] GET /compute/v2.1/servers/d8a6a01e-c590-4005-8892-4bd894964374 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 21:59:19.175146 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-74c0a370-abe1-4ff8-bbbf-7a946b6908c1 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:59:19.175609 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-74c0a370-abe1-4ff8-bbbf-7a946b6908c1 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] [instance: e8b43f72-f51e-4ed8-809f-f04c3c67a192] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:59:19.181958 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-74c0a370-abe1-4ff8-bbbf-7a946b6908c1 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:59:19.182452 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-74c0a370-abe1-4ff8-bbbf-7a946b6908c1 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:59:19.182887 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-74c0a370-abe1-4ff8-bbbf-7a946b6908c1 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:59:19.183613 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-74c0a370-abe1-4ff8-bbbf-7a946b6908c1 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:59:19.184070 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-74c0a370-abe1-4ff8-bbbf-7a946b6908c1 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:59:19.184505 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-74c0a370-abe1-4ff8-bbbf-7a946b6908c1 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:59:19.198360 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-74c0a370-abe1-4ff8-bbbf-7a946b6908c1 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] HTTP exception thrown: Instance e8b43f72-f51e-4ed8-809f-f04c3c67a192 could not be found. Oct 22 21:59:19.199968 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-74c0a370-abe1-4ff8-bbbf-7a946b6908c1 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Request method failure captured: Oct 22 21:59:19.199968 ncdv-master-1 devstack@n-api.service[138744]: request: DELETE /compute/v2.1/servers/e8b43f72-f51e-4ed8-809f-f04c3c67a192 HTTP/1.1 Oct 22 21:59:19.199968 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 21:59:19.199968 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 21:59:19.199968 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 21:59:19.199968 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 0 Oct 22 21:59:19.199968 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 21:59:19.199968 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 21:59:19.199968 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 21:59:19.199968 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 21:59:19.199968 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVGYfDlcA9KGX2QlEp4u0j0Sc-lLfggp70EjXb3-sPhTyz6zB5UiJn8D5kqopVhrN_VN9rM0kOlrwARqwadQ16Olp9k3UgVUKiPcvbjWntYV4vZGIhwWOxDtvedxf_ou8I06I86O9hYoH_RNiO9r53LOOM9uLYhVbGc37T_1RXkzoTZs Oct 22 21:59:19.199968 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 21:59:19.199968 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 21:59:19.199968 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 21:59:19.199968 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 21:59:19.199968 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 21:59:19.199968 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 21:59:19.199968 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: 17135327e2d14c4bbe4c7b242f9fda48 Oct 22 21:59:19.199968 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-ServerActionsTestJSON-1985295999 Oct 22 21:59:19.199968 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 21:59:19.199968 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 21:59:19.199968 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_17135327e2d14c4bbe4c7b242f9fda48"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/17135327e2d14c4bbe4c7b242f9fda48"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/17135327e2d14c4bbe4c7b242f9fda48"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/17135327e2d14c4bbe4c7b242f9fda48"}]}] Oct 22 21:59:19.199968 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-ServerActionsTestJSON-1985295999 Oct 22 21:59:19.199968 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: 17135327e2d14c4bbe4c7b242f9fda48 Oct 22 21:59:19.199968 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-ServerActionsTestJSON-1985295999 Oct 22 21:59:19.199968 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-ServerActionsTestJSON-1985295999-project Oct 22 21:59:19.199968 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 21:59:19.199968 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 21:59:19.199968 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: ce1a4da366004680b7330a8e9f43f945 Oct 22 21:59:19.199968 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-ServerActionsTestJSON-1985295999-project Oct 22 21:59:19.199968 ncdv-master-1 devstack@n-api.service[138744]: method: > Oct 22 21:59:19.199968 ncdv-master-1 devstack@n-api.service[138744]: exception: Instance e8b43f72-f51e-4ed8-809f-f04c3c67a192 could not be found. Oct 22 21:59:19.199968 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': 'e8b43f72-f51e-4ed8-809f-f04c3c67a192'} Oct 22 21:59:19.199968 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:59:19.199968 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:59:19.199968 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 21:59:19.199968 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 21:59:19.199968 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 21:59:19.199968 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 21:59:19.199968 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 21:59:19.199968 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 21:59:19.199968 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 21:59:19.199968 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 21:59:19.199968 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e8b43f72-f51e-4ed8-809f-f04c3c67a192 could not be found. Oct 22 21:59:19.199968 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:59:19.199968 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:59:19.199968 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:59:19.199968 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:59:19.199968 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:59:19.199968 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:59:19.199968 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:59:19.199968 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:59:19.199968 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:59:19.199968 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:59:19.199968 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 22 21:59:19.199968 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 22 21:59:19.199968 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 22 21:59:19.199968 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 22 21:59:19.199968 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 21:59:19.199968 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 21:59:19.199968 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 21:59:19.199968 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:59:19.204771 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e8b43f72-f51e-4ed8-809f-f04c3c67a192 could not be found. Oct 22 21:59:19.204771 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:59:19.204771 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:59:19.204771 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:59:19.204771 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:59:19.204771 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:59:19.204771 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:59:19.204771 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:59:19.204771 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:59:19.204771 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e8b43f72-f51e-4ed8-809f-f04c3c67a192 could not be found. Oct 22 21:59:19.204771 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:59:19.204771 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-74c0a370-abe1-4ff8-bbbf-7a946b6908c1 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Returning 404 to user: Instance e8b43f72-f51e-4ed8-809f-f04c3c67a192 could not be found. {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:59:19.204771 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-74c0a370-abe1-4ff8-bbbf-7a946b6908c1 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] 10.222.0.18 "DELETE /compute/v2.1/servers/e8b43f72-f51e-4ed8-809f-f04c3c67a192" status: 404 len: 111 microversion: 2.1 time: 0.030252 Oct 22 21:59:19.204771 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3302/6634] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 21:59:19 2022] DELETE /compute/v2.1/servers/e8b43f72-f51e-4ed8-809f-f04c3c67a192 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 21:59:19.210375 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-5b198c80-8ea2-4e97-810f-e2bdd18dd5a3 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:59:19.211016 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-5b198c80-8ea2-4e97-810f-e2bdd18dd5a3 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] [instance: e8b43f72-f51e-4ed8-809f-f04c3c67a192] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:59:19.217627 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5b198c80-8ea2-4e97-810f-e2bdd18dd5a3 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:59:19.218130 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5b198c80-8ea2-4e97-810f-e2bdd18dd5a3 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:59:19.218579 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5b198c80-8ea2-4e97-810f-e2bdd18dd5a3 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:59:19.219290 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5b198c80-8ea2-4e97-810f-e2bdd18dd5a3 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:59:19.219836 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5b198c80-8ea2-4e97-810f-e2bdd18dd5a3 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:59:19.220280 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5b198c80-8ea2-4e97-810f-e2bdd18dd5a3 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:59:19.234417 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.wsgi [None req-5b198c80-8ea2-4e97-810f-e2bdd18dd5a3 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] HTTP exception thrown: Instance e8b43f72-f51e-4ed8-809f-f04c3c67a192 could not be found. Oct 22 21:59:19.235998 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-5b198c80-8ea2-4e97-810f-e2bdd18dd5a3 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Request method failure captured: Oct 22 21:59:19.235998 ncdv-master-1 devstack@n-api.service[138745]: request: GET /compute/v2.1/servers/e8b43f72-f51e-4ed8-809f-f04c3c67a192 HTTP/1.1 Oct 22 21:59:19.235998 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 21:59:19.235998 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 21:59:19.235998 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 21:59:19.235998 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 0 Oct 22 21:59:19.235998 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 21:59:19.235998 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 21:59:19.235998 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 21:59:19.235998 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 21:59:19.235998 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVGYfDlcA9KGX2QlEp4u0j0Sc-lLfggp70EjXb3-sPhTyz6zB5UiJn8D5kqopVhrN_VN9rM0kOlrwARqwadQ16Olp9k3UgVUKiPcvbjWntYV4vZGIhwWOxDtvedxf_ou8I06I86O9hYoH_RNiO9r53LOOM9uLYhVbGc37T_1RXkzoTZs Oct 22 21:59:19.235998 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 21:59:19.235998 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 21:59:19.235998 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 21:59:19.235998 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 21:59:19.235998 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 21:59:19.235998 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 21:59:19.235998 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: 17135327e2d14c4bbe4c7b242f9fda48 Oct 22 21:59:19.235998 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-ServerActionsTestJSON-1985295999 Oct 22 21:59:19.235998 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 21:59:19.235998 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 21:59:19.235998 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_17135327e2d14c4bbe4c7b242f9fda48"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/17135327e2d14c4bbe4c7b242f9fda48"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/17135327e2d14c4bbe4c7b242f9fda48"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/17135327e2d14c4bbe4c7b242f9fda48"}]}] Oct 22 21:59:19.235998 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-ServerActionsTestJSON-1985295999 Oct 22 21:59:19.235998 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: 17135327e2d14c4bbe4c7b242f9fda48 Oct 22 21:59:19.235998 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-ServerActionsTestJSON-1985295999 Oct 22 21:59:19.235998 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-ServerActionsTestJSON-1985295999-project Oct 22 21:59:19.235998 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 21:59:19.235998 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 21:59:19.235998 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: ce1a4da366004680b7330a8e9f43f945 Oct 22 21:59:19.235998 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-ServerActionsTestJSON-1985295999-project Oct 22 21:59:19.235998 ncdv-master-1 devstack@n-api.service[138745]: method: > Oct 22 21:59:19.235998 ncdv-master-1 devstack@n-api.service[138745]: exception: Instance e8b43f72-f51e-4ed8-809f-f04c3c67a192 could not be found. Oct 22 21:59:19.235998 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'id': 'e8b43f72-f51e-4ed8-809f-f04c3c67a192'} Oct 22 21:59:19.235998 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:59:19.235998 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:59:19.235998 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 21:59:19.235998 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 21:59:19.235998 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 21:59:19.235998 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 21:59:19.235998 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 21:59:19.235998 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 21:59:19.235998 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 21:59:19.235998 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 21:59:19.235998 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e8b43f72-f51e-4ed8-809f-f04c3c67a192 could not be found. Oct 22 21:59:19.235998 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:59:19.235998 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:59:19.235998 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:59:19.235998 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:59:19.235998 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:59:19.235998 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:59:19.235998 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:59:19.235998 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:59:19.235998 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:59:19.235998 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:59:19.235998 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 21:59:19.235998 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 21:59:19.235998 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 21:59:19.235998 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 21:59:19.235998 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 21:59:19.235998 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:59:19.235998 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e8b43f72-f51e-4ed8-809f-f04c3c67a192 could not be found. Oct 22 21:59:19.235998 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:59:19.235998 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:59:19.235998 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:59:19.241270 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:59:19.241270 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:59:19.241270 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:59:19.241270 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:59:19.241270 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:59:19.241270 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e8b43f72-f51e-4ed8-809f-f04c3c67a192 could not be found. Oct 22 21:59:19.241270 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:59:19.241270 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-5b198c80-8ea2-4e97-810f-e2bdd18dd5a3 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Returning 404 to user: Instance e8b43f72-f51e-4ed8-809f-f04c3c67a192 could not be found. {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:59:19.241270 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-5b198c80-8ea2-4e97-810f-e2bdd18dd5a3 tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] 10.222.0.18 "GET /compute/v2.1/servers/e8b43f72-f51e-4ed8-809f-f04c3c67a192" status: 404 len: 111 microversion: 2.1 time: 0.031468 Oct 22 21:59:19.241270 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3333/6635] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:59:19 2022] GET /compute/v2.1/servers/e8b43f72-f51e-4ed8-809f-f04c3c67a192 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 21:59:19.248899 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-88ae7c7d-b2fc-4675-b92d-6d5efa61691d tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] Calling method '.version_select at 0x7fd3a8bc1940>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:59:19.281563 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-88ae7c7d-b2fc-4675-b92d-6d5efa61691d tempest-ServerActionsTestJSON-1985295999 tempest-ServerActionsTestJSON-1985295999-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-52095379" status: 202 len: 0 microversion: 2.1 time: 0.038814 Oct 22 21:59:19.282140 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3303/6636] 10.222.0.18 () {58 vars in 1215 bytes} [Sat Oct 22 21:59:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-52095379 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 21:59:28.984168 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-211f52cc-5b94-43f4-8387-da01254407e5 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2061995688", "imageRef": "085e4478-6edc-4a69-8e08-f9831713eb65", "flavorRef": "452", "networks": [{"uuid": "bfb3c278-2229-4f73-9262-c21a81cae6af"}]}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:59:29.041890 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.network.neutron [None req-211f52cc-5b94-43f4-8387-da01254407e5 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] validate_networks() for [('bfb3c278-2229-4f73-9262-c21a81cae6af', None, None, None, None, None)] {{(pid=138745) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 21:59:29.225125 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:59:29.431576 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-211f52cc-5b94-43f4-8387-da01254407e5 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Flavor limits 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 21:59:29.431694 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-211f52cc-5b94-43f4-8387-da01254407e5 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Image limits 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 21:59:29.432341 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-211f52cc-5b94-43f4-8387-da01254407e5 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Flavor pref 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 21:59:29.432966 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-211f52cc-5b94-43f4-8387-da01254407e5 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Image pref 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 21:59:29.433402 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-211f52cc-5b94-43f4-8387-da01254407e5 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 21:59:29.455590 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-211f52cc-5b94-43f4-8387-da01254407e5 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:59:29.456103 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-211f52cc-5b94-43f4-8387-da01254407e5 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:59:29.456561 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-211f52cc-5b94-43f4-8387-da01254407e5 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:59:29.458466 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-211f52cc-5b94-43f4-8387-da01254407e5 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:59:29.459082 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-211f52cc-5b94-43f4-8387-da01254407e5 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:59:29.459485 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-211f52cc-5b94-43f4-8387-da01254407e5 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:59:29.478422 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-211f52cc-5b94-43f4-8387-da01254407e5 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Getting quotas for project d680f69971c745029f0f85e9d3dcb2e9. Resources: {'cores', 'instances', 'ram'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 21:59:29.483916 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-211f52cc-5b94-43f4-8387-da01254407e5 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Getting quotas for user e8fc72f4915c43a0b1a287e24bf72b83 and project d680f69971c745029f0f85e9d3dcb2e9. Resources: {'cores', 'instances', 'ram'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 21:59:29.496831 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-211f52cc-5b94-43f4-8387-da01254407e5 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Going to run 1 instances... {{(pid=138745) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 21:59:29.499235 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-211f52cc-5b94-43f4-8387-da01254407e5 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] [instance: 347f4dea-4bac-4e96-a8e3-92396045052c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='085e4478-6edc-4a69-8e08-f9831713eb65',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138745) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 21:59:29.550289 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-211f52cc-5b94-43f4-8387-da01254407e5 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.691693 Oct 22 21:59:29.550944 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3334/6637] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Oct 22 21:59:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 693 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 21:59:29.562296 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-59be7c99-eda0-4d13-bc78-637c552afb49 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:59:29.562910 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-59be7c99-eda0-4d13-bc78-637c552afb49 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] [instance: 347f4dea-4bac-4e96-a8e3-92396045052c] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:59:29.565786 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:59:29.566445 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:59:29.631661 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-59be7c99-eda0-4d13-bc78-637c552afb49 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fc72f4915c43a0b1a287e24bf72b83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd680f69971c745029f0f85e9d3dcb2e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:59:29.638927 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-59be7c99-eda0-4d13-bc78-637c552afb49 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] 10.222.0.18 "GET /compute/v2.1/servers/347f4dea-4bac-4e96-a8e3-92396045052c" status: 200 len: 1217 microversion: 2.1 time: 0.080568 Oct 22 21:59:29.651525 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3304/6638] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:59:29 2022] GET /compute/v2.1/servers/347f4dea-4bac-4e96-a8e3-92396045052c => generated 1217 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:59:30.663546 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-2efac953-f484-4e30-9e74-a94db8b5c1e8 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:59:30.664827 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-2efac953-f484-4e30-9e74-a94db8b5c1e8 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] [instance: 347f4dea-4bac-4e96-a8e3-92396045052c] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:59:30.672597 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2efac953-f484-4e30-9e74-a94db8b5c1e8 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:59:30.673325 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2efac953-f484-4e30-9e74-a94db8b5c1e8 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:59:30.673960 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2efac953-f484-4e30-9e74-a94db8b5c1e8 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:59:30.674853 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2efac953-f484-4e30-9e74-a94db8b5c1e8 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:59:30.675514 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2efac953-f484-4e30-9e74-a94db8b5c1e8 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:59:30.676119 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2efac953-f484-4e30-9e74-a94db8b5c1e8 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:59:30.749872 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-2efac953-f484-4e30-9e74-a94db8b5c1e8 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fc72f4915c43a0b1a287e24bf72b83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd680f69971c745029f0f85e9d3dcb2e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:59:30.759384 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-2efac953-f484-4e30-9e74-a94db8b5c1e8 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] 10.222.0.18 "GET /compute/v2.1/servers/347f4dea-4bac-4e96-a8e3-92396045052c" status: 200 len: 1277 microversion: 2.1 time: 0.101081 Oct 22 21:59:30.760581 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3335/6639] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:59:30 2022] GET /compute/v2.1/servers/347f4dea-4bac-4e96-a8e3-92396045052c => generated 1277 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:59:31.782809 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-7af50577-7d57-4982-a474-7d62cd713bfe tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:59:31.784197 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-7af50577-7d57-4982-a474-7d62cd713bfe tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] [instance: 347f4dea-4bac-4e96-a8e3-92396045052c] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:59:31.792917 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7af50577-7d57-4982-a474-7d62cd713bfe tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:59:31.793508 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7af50577-7d57-4982-a474-7d62cd713bfe tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:59:31.794012 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7af50577-7d57-4982-a474-7d62cd713bfe tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:59:31.794792 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7af50577-7d57-4982-a474-7d62cd713bfe tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:59:31.795493 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7af50577-7d57-4982-a474-7d62cd713bfe tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:59:31.795993 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7af50577-7d57-4982-a474-7d62cd713bfe tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:59:31.952431 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-7af50577-7d57-4982-a474-7d62cd713bfe tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fc72f4915c43a0b1a287e24bf72b83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd680f69971c745029f0f85e9d3dcb2e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:59:31.961581 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-7af50577-7d57-4982-a474-7d62cd713bfe tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] 10.222.0.18 "GET /compute/v2.1/servers/347f4dea-4bac-4e96-a8e3-92396045052c" status: 200 len: 1317 microversion: 2.1 time: 0.182714 Oct 22 21:59:31.962277 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3305/6640] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:59:31 2022] GET /compute/v2.1/servers/347f4dea-4bac-4e96-a8e3-92396045052c => generated 1317 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:59:32.179376 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-d5447d4f-c77b-47e4-807e-8188eb8813f6 req-48662565-3333-4245-abc2-f2b0ee8177ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "347f4dea-4bac-4e96-a8e3-92396045052c", "tag": "ee6a403a-121b-4c73-be1f-26a52f89b6f1"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:59:32.185713 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:59:32.194721 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-d5447d4f-c77b-47e4-807e-8188eb8813f6 req-48662565-3333-4245-abc2-f2b0ee8177ce service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:59:32.195228 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-d5447d4f-c77b-47e4-807e-8188eb8813f6 req-48662565-3333-4245-abc2-f2b0ee8177ce service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:59:32.196052 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-d5447d4f-c77b-47e4-807e-8188eb8813f6 req-48662565-3333-4245-abc2-f2b0ee8177ce service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:59:32.211732 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-d5447d4f-c77b-47e4-807e-8188eb8813f6 req-48662565-3333-4245-abc2-f2b0ee8177ce service nova] Creating event network-changed:ee6a403a-121b-4c73-be1f-26a52f89b6f1 for instance 347f4dea-4bac-4e96-a8e3-92396045052c on nch1-master-1 Oct 22 21:59:32.219281 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-d5447d4f-c77b-47e4-807e-8188eb8813f6 req-48662565-3333-4245-abc2-f2b0ee8177ce service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043217 Oct 22 21:59:32.220204 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3336/6641] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:59:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:59:32.989851 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-e32eafc6-5b62-4faa-8b73-d613e20da4ce tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:59:32.990433 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-e32eafc6-5b62-4faa-8b73-d613e20da4ce tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] [instance: 347f4dea-4bac-4e96-a8e3-92396045052c] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:59:32.997744 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e32eafc6-5b62-4faa-8b73-d613e20da4ce tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:59:32.998237 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e32eafc6-5b62-4faa-8b73-d613e20da4ce tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:59:32.998677 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e32eafc6-5b62-4faa-8b73-d613e20da4ce tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:59:32.999373 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e32eafc6-5b62-4faa-8b73-d613e20da4ce tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:59:32.999855 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e32eafc6-5b62-4faa-8b73-d613e20da4ce tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:59:33.000286 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e32eafc6-5b62-4faa-8b73-d613e20da4ce tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:59:33.146304 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-e32eafc6-5b62-4faa-8b73-d613e20da4ce tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fc72f4915c43a0b1a287e24bf72b83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd680f69971c745029f0f85e9d3dcb2e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:59:33.154525 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-e32eafc6-5b62-4faa-8b73-d613e20da4ce tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] 10.222.0.18 "GET /compute/v2.1/servers/347f4dea-4bac-4e96-a8e3-92396045052c" status: 200 len: 1317 microversion: 2.1 time: 0.168894 Oct 22 21:59:33.155103 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3306/6642] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:59:32 2022] GET /compute/v2.1/servers/347f4dea-4bac-4e96-a8e3-92396045052c => generated 1317 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:59:34.180958 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-910efc7d-3f27-4386-ac07-86a16b6431ce tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:59:34.181357 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-910efc7d-3f27-4386-ac07-86a16b6431ce tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] [instance: 347f4dea-4bac-4e96-a8e3-92396045052c] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:59:34.189061 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-910efc7d-3f27-4386-ac07-86a16b6431ce tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:59:34.189563 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-910efc7d-3f27-4386-ac07-86a16b6431ce tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:59:34.190011 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-910efc7d-3f27-4386-ac07-86a16b6431ce tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:59:34.190728 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-910efc7d-3f27-4386-ac07-86a16b6431ce tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:59:34.191201 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-910efc7d-3f27-4386-ac07-86a16b6431ce tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:59:34.191685 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-910efc7d-3f27-4386-ac07-86a16b6431ce tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:59:34.327756 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-910efc7d-3f27-4386-ac07-86a16b6431ce tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fc72f4915c43a0b1a287e24bf72b83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd680f69971c745029f0f85e9d3dcb2e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:59:34.336010 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-910efc7d-3f27-4386-ac07-86a16b6431ce tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] 10.222.0.18 "GET /compute/v2.1/servers/347f4dea-4bac-4e96-a8e3-92396045052c" status: 200 len: 1317 microversion: 2.1 time: 0.161383 Oct 22 21:59:34.336592 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3337/6643] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:59:34 2022] GET /compute/v2.1/servers/347f4dea-4bac-4e96-a8e3-92396045052c => generated 1317 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:59:35.363468 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-d2ad1061-bec8-4574-b7b2-09d412468bd0 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:59:35.364715 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-d2ad1061-bec8-4574-b7b2-09d412468bd0 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] [instance: 347f4dea-4bac-4e96-a8e3-92396045052c] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:59:35.375887 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d2ad1061-bec8-4574-b7b2-09d412468bd0 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:59:35.376641 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d2ad1061-bec8-4574-b7b2-09d412468bd0 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:59:35.377327 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d2ad1061-bec8-4574-b7b2-09d412468bd0 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:59:35.378366 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d2ad1061-bec8-4574-b7b2-09d412468bd0 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:59:35.379091 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d2ad1061-bec8-4574-b7b2-09d412468bd0 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:59:35.379810 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d2ad1061-bec8-4574-b7b2-09d412468bd0 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:59:35.521156 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-d2ad1061-bec8-4574-b7b2-09d412468bd0 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fc72f4915c43a0b1a287e24bf72b83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd680f69971c745029f0f85e9d3dcb2e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:59:35.529596 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-d2ad1061-bec8-4574-b7b2-09d412468bd0 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] 10.222.0.18 "GET /compute/v2.1/servers/347f4dea-4bac-4e96-a8e3-92396045052c" status: 200 len: 1317 microversion: 2.1 time: 0.173076 Oct 22 21:59:35.530174 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3307/6644] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:59:35 2022] GET /compute/v2.1/servers/347f4dea-4bac-4e96-a8e3-92396045052c => generated 1317 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:59:36.554278 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-bee85f82-9120-4a2f-b750-8c238baa2456 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:59:36.554979 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-bee85f82-9120-4a2f-b750-8c238baa2456 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] [instance: 347f4dea-4bac-4e96-a8e3-92396045052c] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:59:36.562531 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bee85f82-9120-4a2f-b750-8c238baa2456 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:59:36.563058 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bee85f82-9120-4a2f-b750-8c238baa2456 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:59:36.563531 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bee85f82-9120-4a2f-b750-8c238baa2456 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:59:36.564247 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bee85f82-9120-4a2f-b750-8c238baa2456 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:59:36.564728 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bee85f82-9120-4a2f-b750-8c238baa2456 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:59:36.565178 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bee85f82-9120-4a2f-b750-8c238baa2456 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:59:36.701074 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-bee85f82-9120-4a2f-b750-8c238baa2456 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fc72f4915c43a0b1a287e24bf72b83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd680f69971c745029f0f85e9d3dcb2e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:59:36.709685 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-bee85f82-9120-4a2f-b750-8c238baa2456 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] 10.222.0.18 "GET /compute/v2.1/servers/347f4dea-4bac-4e96-a8e3-92396045052c" status: 200 len: 1317 microversion: 2.1 time: 0.159664 Oct 22 21:59:36.710296 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3338/6645] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:59:36 2022] GET /compute/v2.1/servers/347f4dea-4bac-4e96-a8e3-92396045052c => generated 1317 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:59:37.733282 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-bf7c6b3b-0d1a-439b-bca2-232030e2ed7a tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:59:37.733895 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-bf7c6b3b-0d1a-439b-bca2-232030e2ed7a tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] [instance: 347f4dea-4bac-4e96-a8e3-92396045052c] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:59:37.741930 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bf7c6b3b-0d1a-439b-bca2-232030e2ed7a tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:59:37.742592 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bf7c6b3b-0d1a-439b-bca2-232030e2ed7a tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:59:37.743028 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bf7c6b3b-0d1a-439b-bca2-232030e2ed7a tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:59:37.743835 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bf7c6b3b-0d1a-439b-bca2-232030e2ed7a tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:59:37.744291 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bf7c6b3b-0d1a-439b-bca2-232030e2ed7a tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:59:37.744716 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bf7c6b3b-0d1a-439b-bca2-232030e2ed7a tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:59:37.878212 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-bf7c6b3b-0d1a-439b-bca2-232030e2ed7a tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fc72f4915c43a0b1a287e24bf72b83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd680f69971c745029f0f85e9d3dcb2e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:59:37.887914 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-bf7c6b3b-0d1a-439b-bca2-232030e2ed7a tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] 10.222.0.18 "GET /compute/v2.1/servers/347f4dea-4bac-4e96-a8e3-92396045052c" status: 200 len: 1317 microversion: 2.1 time: 0.158606 Oct 22 21:59:37.888490 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3308/6646] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:59:37 2022] GET /compute/v2.1/servers/347f4dea-4bac-4e96-a8e3-92396045052c => generated 1317 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:59:38.915517 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-18a14413-7b10-40fe-851d-a2320a3966d8 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:59:38.916418 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-18a14413-7b10-40fe-851d-a2320a3966d8 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] [instance: 347f4dea-4bac-4e96-a8e3-92396045052c] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:59:38.924325 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-18a14413-7b10-40fe-851d-a2320a3966d8 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:59:38.924856 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-18a14413-7b10-40fe-851d-a2320a3966d8 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:59:38.925311 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-18a14413-7b10-40fe-851d-a2320a3966d8 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:59:38.926032 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-18a14413-7b10-40fe-851d-a2320a3966d8 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:59:38.926598 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-18a14413-7b10-40fe-851d-a2320a3966d8 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:59:38.927069 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-18a14413-7b10-40fe-851d-a2320a3966d8 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:59:39.064721 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-18a14413-7b10-40fe-851d-a2320a3966d8 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fc72f4915c43a0b1a287e24bf72b83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd680f69971c745029f0f85e9d3dcb2e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:59:39.074856 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-18a14413-7b10-40fe-851d-a2320a3966d8 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] 10.222.0.18 "GET /compute/v2.1/servers/347f4dea-4bac-4e96-a8e3-92396045052c" status: 200 len: 1317 microversion: 2.1 time: 0.165904 Oct 22 21:59:39.075545 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3339/6647] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:59:38 2022] GET /compute/v2.1/servers/347f4dea-4bac-4e96-a8e3-92396045052c => generated 1317 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:59:39.306583 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-b646659a-4eaf-4c2d-80ce-658141a861bb req-89ad336c-6589-4543-8de5-4610fa4d1249 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "347f4dea-4bac-4e96-a8e3-92396045052c", "name": "network-vif-plugged", "status": "completed", "tag": "ee6a403a-121b-4c73-be1f-26a52f89b6f1"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:59:39.318191 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-b646659a-4eaf-4c2d-80ce-658141a861bb req-89ad336c-6589-4543-8de5-4610fa4d1249 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:59:39.318682 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-b646659a-4eaf-4c2d-80ce-658141a861bb req-89ad336c-6589-4543-8de5-4610fa4d1249 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:59:39.319104 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-b646659a-4eaf-4c2d-80ce-658141a861bb req-89ad336c-6589-4543-8de5-4610fa4d1249 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:59:39.331004 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-b646659a-4eaf-4c2d-80ce-658141a861bb req-89ad336c-6589-4543-8de5-4610fa4d1249 service nova] Creating event network-vif-plugged:ee6a403a-121b-4c73-be1f-26a52f89b6f1 for instance 347f4dea-4bac-4e96-a8e3-92396045052c on nch1-master-1 Oct 22 21:59:39.336155 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-b646659a-4eaf-4c2d-80ce-658141a861bb req-89ad336c-6589-4543-8de5-4610fa4d1249 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033597 Oct 22 21:59:39.336761 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3309/6648] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:59:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:59:40.102255 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-54c4a348-98cb-4af9-8a77-b27bc4ec6e9e tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:59:40.102888 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-54c4a348-98cb-4af9-8a77-b27bc4ec6e9e tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] [instance: 347f4dea-4bac-4e96-a8e3-92396045052c] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:59:40.104973 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell0:SELECT=2 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:59:40.105656 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell0:SELECT=6 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:59:40.112270 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-54c4a348-98cb-4af9-8a77-b27bc4ec6e9e tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:59:40.112772 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-54c4a348-98cb-4af9-8a77-b27bc4ec6e9e tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:59:40.113228 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-54c4a348-98cb-4af9-8a77-b27bc4ec6e9e tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:59:40.113944 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-54c4a348-98cb-4af9-8a77-b27bc4ec6e9e tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:59:40.114412 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-54c4a348-98cb-4af9-8a77-b27bc4ec6e9e tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:59:40.114855 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-54c4a348-98cb-4af9-8a77-b27bc4ec6e9e tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:59:40.247254 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-54c4a348-98cb-4af9-8a77-b27bc4ec6e9e tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fc72f4915c43a0b1a287e24bf72b83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd680f69971c745029f0f85e9d3dcb2e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:59:40.255301 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-54c4a348-98cb-4af9-8a77-b27bc4ec6e9e tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] 10.222.0.18 "GET /compute/v2.1/servers/347f4dea-4bac-4e96-a8e3-92396045052c" status: 200 len: 1317 microversion: 2.1 time: 0.157028 Oct 22 21:59:40.255902 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3340/6649] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:59:40 2022] GET /compute/v2.1/servers/347f4dea-4bac-4e96-a8e3-92396045052c => generated 1317 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:59:41.277820 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell0:SELECT=2 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:59:41.284492 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-a6c3e867-ae30-4477-a256-2a9dbac6d2ee tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:59:41.285333 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-a6c3e867-ae30-4477-a256-2a9dbac6d2ee tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] [instance: 347f4dea-4bac-4e96-a8e3-92396045052c] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:59:41.292054 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a6c3e867-ae30-4477-a256-2a9dbac6d2ee tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:59:41.292549 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a6c3e867-ae30-4477-a256-2a9dbac6d2ee tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:59:41.293020 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a6c3e867-ae30-4477-a256-2a9dbac6d2ee tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:59:41.293728 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a6c3e867-ae30-4477-a256-2a9dbac6d2ee tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:59:41.294498 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a6c3e867-ae30-4477-a256-2a9dbac6d2ee tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:59:41.294877 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a6c3e867-ae30-4477-a256-2a9dbac6d2ee tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:59:41.427540 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-a6c3e867-ae30-4477-a256-2a9dbac6d2ee tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fc72f4915c43a0b1a287e24bf72b83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd680f69971c745029f0f85e9d3dcb2e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:59:41.435813 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-a6c3e867-ae30-4477-a256-2a9dbac6d2ee tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] 10.222.0.18 "GET /compute/v2.1/servers/347f4dea-4bac-4e96-a8e3-92396045052c" status: 200 len: 1505 microversion: 2.1 time: 0.159704 Oct 22 21:59:41.436396 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3310/6650] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:59:41 2022] GET /compute/v2.1/servers/347f4dea-4bac-4e96-a8e3-92396045052c => generated 1505 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:59:41.501140 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-e9568413-30d5-4fb7-90db-16fafc655e64 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-345211617", "imageRef": "085e4478-6edc-4a69-8e08-f9831713eb65", "flavorRef": "452", "networks": [{"uuid": "bfb3c278-2229-4f73-9262-c21a81cae6af"}]}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:59:41.557918 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.network.neutron [None req-e9568413-30d5-4fb7-90db-16fafc655e64 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] validate_networks() for [('bfb3c278-2229-4f73-9262-c21a81cae6af', None, None, None, None, None)] {{(pid=138745) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 21:59:41.943117 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-e9568413-30d5-4fb7-90db-16fafc655e64 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Flavor limits 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 21:59:41.943606 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-e9568413-30d5-4fb7-90db-16fafc655e64 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Image limits 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 21:59:41.944102 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-e9568413-30d5-4fb7-90db-16fafc655e64 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Flavor pref 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 21:59:41.944530 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-e9568413-30d5-4fb7-90db-16fafc655e64 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Image pref 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 21:59:41.944960 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-e9568413-30d5-4fb7-90db-16fafc655e64 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 21:59:41.958759 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e9568413-30d5-4fb7-90db-16fafc655e64 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:59:41.959494 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e9568413-30d5-4fb7-90db-16fafc655e64 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:59:41.960091 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e9568413-30d5-4fb7-90db-16fafc655e64 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:59:41.961301 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e9568413-30d5-4fb7-90db-16fafc655e64 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:59:41.962042 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e9568413-30d5-4fb7-90db-16fafc655e64 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:59:41.962738 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e9568413-30d5-4fb7-90db-16fafc655e64 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:59:41.982840 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-e9568413-30d5-4fb7-90db-16fafc655e64 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Getting quotas for project d680f69971c745029f0f85e9d3dcb2e9. Resources: {'cores', 'instances', 'ram'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 21:59:41.989062 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-e9568413-30d5-4fb7-90db-16fafc655e64 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Getting quotas for user e8fc72f4915c43a0b1a287e24bf72b83 and project d680f69971c745029f0f85e9d3dcb2e9. Resources: {'cores', 'instances', 'ram'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 21:59:42.002501 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-e9568413-30d5-4fb7-90db-16fafc655e64 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Going to run 1 instances... {{(pid=138745) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 21:59:42.004950 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-e9568413-30d5-4fb7-90db-16fafc655e64 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] [instance: c2d05fca-cb18-4999-8e19-b2bbb4b95bf1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='085e4478-6edc-4a69-8e08-f9831713eb65',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138745) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 21:59:42.051898 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-e9568413-30d5-4fb7-90db-16fafc655e64 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.554697 Oct 22 21:59:42.058733 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3341/6651] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Oct 22 21:59:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 556 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 21:59:42.064347 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-7f988558-2652-47dc-a74a-c561c2500173 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:59:42.065099 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-7f988558-2652-47dc-a74a-c561c2500173 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] [instance: c2d05fca-cb18-4999-8e19-b2bbb4b95bf1] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:59:42.122074 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-7f988558-2652-47dc-a74a-c561c2500173 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fc72f4915c43a0b1a287e24bf72b83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd680f69971c745029f0f85e9d3dcb2e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:59:42.129387 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-7f988558-2652-47dc-a74a-c561c2500173 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] 10.222.0.18 "GET /compute/v2.1/servers/c2d05fca-cb18-4999-8e19-b2bbb4b95bf1" status: 200 len: 1216 microversion: 2.1 time: 0.069447 Oct 22 21:59:42.129972 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3311/6652] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:59:42 2022] GET /compute/v2.1/servers/c2d05fca-cb18-4999-8e19-b2bbb4b95bf1 => generated 1216 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:59:43.154232 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-6219186c-0b7c-43c4-b15c-bba3a49d7bde tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:59:43.154859 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-6219186c-0b7c-43c4-b15c-bba3a49d7bde tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] [instance: c2d05fca-cb18-4999-8e19-b2bbb4b95bf1] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:59:43.161486 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6219186c-0b7c-43c4-b15c-bba3a49d7bde tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:59:43.162025 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6219186c-0b7c-43c4-b15c-bba3a49d7bde tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:59:43.162475 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6219186c-0b7c-43c4-b15c-bba3a49d7bde tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:59:43.163198 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6219186c-0b7c-43c4-b15c-bba3a49d7bde tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:59:43.163696 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6219186c-0b7c-43c4-b15c-bba3a49d7bde tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:59:43.164140 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6219186c-0b7c-43c4-b15c-bba3a49d7bde tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:59:43.244122 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-6219186c-0b7c-43c4-b15c-bba3a49d7bde tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fc72f4915c43a0b1a287e24bf72b83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd680f69971c745029f0f85e9d3dcb2e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:59:43.252664 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-6219186c-0b7c-43c4-b15c-bba3a49d7bde tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] 10.222.0.18 "GET /compute/v2.1/servers/c2d05fca-cb18-4999-8e19-b2bbb4b95bf1" status: 200 len: 1268 microversion: 2.1 time: 0.103271 Oct 22 21:59:43.253838 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3342/6653] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:59:43 2022] GET /compute/v2.1/servers/c2d05fca-cb18-4999-8e19-b2bbb4b95bf1 => generated 1268 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:59:44.276484 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-304cb6cc-bd14-48f0-9e7d-271ca01672f8 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:59:44.277097 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-304cb6cc-bd14-48f0-9e7d-271ca01672f8 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] [instance: c2d05fca-cb18-4999-8e19-b2bbb4b95bf1] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:59:44.285029 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-304cb6cc-bd14-48f0-9e7d-271ca01672f8 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:59:44.285516 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-304cb6cc-bd14-48f0-9e7d-271ca01672f8 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:59:44.285951 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-304cb6cc-bd14-48f0-9e7d-271ca01672f8 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:59:44.286672 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-304cb6cc-bd14-48f0-9e7d-271ca01672f8 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:59:44.287128 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-304cb6cc-bd14-48f0-9e7d-271ca01672f8 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:59:44.287594 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-304cb6cc-bd14-48f0-9e7d-271ca01672f8 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:59:44.514026 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-304cb6cc-bd14-48f0-9e7d-271ca01672f8 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fc72f4915c43a0b1a287e24bf72b83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd680f69971c745029f0f85e9d3dcb2e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:59:44.522570 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-304cb6cc-bd14-48f0-9e7d-271ca01672f8 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] 10.222.0.18 "GET /compute/v2.1/servers/c2d05fca-cb18-4999-8e19-b2bbb4b95bf1" status: 200 len: 1316 microversion: 2.1 time: 0.249887 Oct 22 21:59:44.523079 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3312/6654] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:59:44 2022] GET /compute/v2.1/servers/c2d05fca-cb18-4999-8e19-b2bbb4b95bf1 => generated 1316 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:59:44.666519 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-2bfbd4c3-b2e4-47f9-88c3-eee628f668fe req-71d6144c-d69f-46bb-817b-783c77d52f42 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c2d05fca-cb18-4999-8e19-b2bbb4b95bf1", "tag": "e5640ad9-0977-42a1-af35-96f38df93c6e"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:59:44.677913 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-2bfbd4c3-b2e4-47f9-88c3-eee628f668fe req-71d6144c-d69f-46bb-817b-783c77d52f42 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:59:44.678508 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-2bfbd4c3-b2e4-47f9-88c3-eee628f668fe req-71d6144c-d69f-46bb-817b-783c77d52f42 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:59:44.679020 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-2bfbd4c3-b2e4-47f9-88c3-eee628f668fe req-71d6144c-d69f-46bb-817b-783c77d52f42 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:59:44.690806 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-2bfbd4c3-b2e4-47f9-88c3-eee628f668fe req-71d6144c-d69f-46bb-817b-783c77d52f42 service nova] Creating event network-changed:e5640ad9-0977-42a1-af35-96f38df93c6e for instance c2d05fca-cb18-4999-8e19-b2bbb4b95bf1 on nch2-master-1 Oct 22 21:59:44.695952 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-2bfbd4c3-b2e4-47f9-88c3-eee628f668fe req-71d6144c-d69f-46bb-817b-783c77d52f42 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033119 Oct 22 21:59:44.696600 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3343/6655] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:59:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:59:45.545483 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-b6eb241c-ae42-4788-9392-657920991aeb tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:59:45.546078 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-b6eb241c-ae42-4788-9392-657920991aeb tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] [instance: c2d05fca-cb18-4999-8e19-b2bbb4b95bf1] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:59:45.556565 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b6eb241c-ae42-4788-9392-657920991aeb tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:59:45.557079 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b6eb241c-ae42-4788-9392-657920991aeb tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:59:45.557525 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b6eb241c-ae42-4788-9392-657920991aeb tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:59:45.558237 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b6eb241c-ae42-4788-9392-657920991aeb tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:59:45.558702 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b6eb241c-ae42-4788-9392-657920991aeb tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:59:45.559139 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b6eb241c-ae42-4788-9392-657920991aeb tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:59:45.704462 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-b6eb241c-ae42-4788-9392-657920991aeb tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fc72f4915c43a0b1a287e24bf72b83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd680f69971c745029f0f85e9d3dcb2e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:59:45.713175 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-b6eb241c-ae42-4788-9392-657920991aeb tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] 10.222.0.18 "GET /compute/v2.1/servers/c2d05fca-cb18-4999-8e19-b2bbb4b95bf1" status: 200 len: 1316 microversion: 2.1 time: 0.171679 Oct 22 21:59:45.713758 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3313/6656] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:59:45 2022] GET /compute/v2.1/servers/c2d05fca-cb18-4999-8e19-b2bbb4b95bf1 => generated 1316 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:59:46.740621 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-5220044f-9c77-47a1-a73f-c76c9eec0a75 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:59:46.741342 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-5220044f-9c77-47a1-a73f-c76c9eec0a75 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] [instance: c2d05fca-cb18-4999-8e19-b2bbb4b95bf1] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:59:46.748250 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5220044f-9c77-47a1-a73f-c76c9eec0a75 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:59:46.748756 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5220044f-9c77-47a1-a73f-c76c9eec0a75 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:59:46.749205 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5220044f-9c77-47a1-a73f-c76c9eec0a75 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:59:46.749900 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5220044f-9c77-47a1-a73f-c76c9eec0a75 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:59:46.750398 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5220044f-9c77-47a1-a73f-c76c9eec0a75 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:59:46.750828 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5220044f-9c77-47a1-a73f-c76c9eec0a75 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:59:46.890812 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-5220044f-9c77-47a1-a73f-c76c9eec0a75 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fc72f4915c43a0b1a287e24bf72b83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd680f69971c745029f0f85e9d3dcb2e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:59:46.899098 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-5220044f-9c77-47a1-a73f-c76c9eec0a75 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] 10.222.0.18 "GET /compute/v2.1/servers/c2d05fca-cb18-4999-8e19-b2bbb4b95bf1" status: 200 len: 1316 microversion: 2.1 time: 0.165438 Oct 22 21:59:46.899715 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3344/6657] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:59:46 2022] GET /compute/v2.1/servers/c2d05fca-cb18-4999-8e19-b2bbb4b95bf1 => generated 1316 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:59:47.926033 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-6a0a8d0c-8baf-41da-b9ba-8d6c7746a704 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:59:47.927261 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-6a0a8d0c-8baf-41da-b9ba-8d6c7746a704 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] [instance: c2d05fca-cb18-4999-8e19-b2bbb4b95bf1] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:59:47.939274 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6a0a8d0c-8baf-41da-b9ba-8d6c7746a704 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:59:47.939873 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6a0a8d0c-8baf-41da-b9ba-8d6c7746a704 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:59:47.940324 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6a0a8d0c-8baf-41da-b9ba-8d6c7746a704 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:59:47.941028 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6a0a8d0c-8baf-41da-b9ba-8d6c7746a704 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:59:47.941487 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6a0a8d0c-8baf-41da-b9ba-8d6c7746a704 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:59:47.941920 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6a0a8d0c-8baf-41da-b9ba-8d6c7746a704 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:59:48.087387 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-6a0a8d0c-8baf-41da-b9ba-8d6c7746a704 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fc72f4915c43a0b1a287e24bf72b83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd680f69971c745029f0f85e9d3dcb2e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:59:48.095811 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-6a0a8d0c-8baf-41da-b9ba-8d6c7746a704 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] 10.222.0.18 "GET /compute/v2.1/servers/c2d05fca-cb18-4999-8e19-b2bbb4b95bf1" status: 200 len: 1316 microversion: 2.1 time: 0.176533 Oct 22 21:59:48.096388 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3314/6658] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:59:47 2022] GET /compute/v2.1/servers/c2d05fca-cb18-4999-8e19-b2bbb4b95bf1 => generated 1316 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:59:48.935802 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-6661380a-6b32-420a-9ce6-87b139e663f7 req-55119107-1892-43f1-a260-c319def58e87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2d05fca-cb18-4999-8e19-b2bbb4b95bf1", "name": "network-vif-plugged", "status": "completed", "tag": "e5640ad9-0977-42a1-af35-96f38df93c6e"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:59:48.946390 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-6661380a-6b32-420a-9ce6-87b139e663f7 req-55119107-1892-43f1-a260-c319def58e87 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:59:48.946842 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-6661380a-6b32-420a-9ce6-87b139e663f7 req-55119107-1892-43f1-a260-c319def58e87 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:59:48.947284 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-6661380a-6b32-420a-9ce6-87b139e663f7 req-55119107-1892-43f1-a260-c319def58e87 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:59:48.960094 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-6661380a-6b32-420a-9ce6-87b139e663f7 req-55119107-1892-43f1-a260-c319def58e87 service nova] Creating event network-vif-plugged:e5640ad9-0977-42a1-af35-96f38df93c6e for instance c2d05fca-cb18-4999-8e19-b2bbb4b95bf1 on nch2-master-1 Oct 22 21:59:48.965029 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-6661380a-6b32-420a-9ce6-87b139e663f7 req-55119107-1892-43f1-a260-c319def58e87 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033146 Oct 22 21:59:48.965657 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3345/6659] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:59:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:59:49.119881 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-05e4dda3-6ac7-4813-8f0a-9395168ac780 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:59:49.120627 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-05e4dda3-6ac7-4813-8f0a-9395168ac780 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] [instance: c2d05fca-cb18-4999-8e19-b2bbb4b95bf1] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:59:49.128179 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-05e4dda3-6ac7-4813-8f0a-9395168ac780 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:59:49.128691 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-05e4dda3-6ac7-4813-8f0a-9395168ac780 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:59:49.129166 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-05e4dda3-6ac7-4813-8f0a-9395168ac780 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:59:49.129879 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-05e4dda3-6ac7-4813-8f0a-9395168ac780 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:59:49.130341 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-05e4dda3-6ac7-4813-8f0a-9395168ac780 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:59:49.130775 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-05e4dda3-6ac7-4813-8f0a-9395168ac780 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:59:49.265151 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-05e4dda3-6ac7-4813-8f0a-9395168ac780 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fc72f4915c43a0b1a287e24bf72b83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd680f69971c745029f0f85e9d3dcb2e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:59:49.273625 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-05e4dda3-6ac7-4813-8f0a-9395168ac780 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] 10.222.0.18 "GET /compute/v2.1/servers/c2d05fca-cb18-4999-8e19-b2bbb4b95bf1" status: 200 len: 1316 microversion: 2.1 time: 0.157842 Oct 22 21:59:49.274397 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3315/6660] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:59:49 2022] GET /compute/v2.1/servers/c2d05fca-cb18-4999-8e19-b2bbb4b95bf1 => generated 1316 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:59:50.299045 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-3efa4570-4e7c-43e0-a05b-1b62246fa6d1 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:59:50.299810 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-3efa4570-4e7c-43e0-a05b-1b62246fa6d1 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] [instance: c2d05fca-cb18-4999-8e19-b2bbb4b95bf1] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:59:50.306464 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3efa4570-4e7c-43e0-a05b-1b62246fa6d1 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:59:50.306963 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3efa4570-4e7c-43e0-a05b-1b62246fa6d1 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:59:50.307447 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3efa4570-4e7c-43e0-a05b-1b62246fa6d1 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:59:50.308162 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3efa4570-4e7c-43e0-a05b-1b62246fa6d1 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:59:50.308630 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3efa4570-4e7c-43e0-a05b-1b62246fa6d1 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:59:50.309100 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3efa4570-4e7c-43e0-a05b-1b62246fa6d1 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:59:50.448797 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-3efa4570-4e7c-43e0-a05b-1b62246fa6d1 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fc72f4915c43a0b1a287e24bf72b83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd680f69971c745029f0f85e9d3dcb2e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:59:50.461059 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-3efa4570-4e7c-43e0-a05b-1b62246fa6d1 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] 10.222.0.18 "GET /compute/v2.1/servers/c2d05fca-cb18-4999-8e19-b2bbb4b95bf1" status: 200 len: 1316 microversion: 2.1 time: 0.167986 Oct 22 21:59:50.461676 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3346/6661] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:59:50 2022] GET /compute/v2.1/servers/c2d05fca-cb18-4999-8e19-b2bbb4b95bf1 => generated 1316 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:59:51.488518 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-16dc8a11-0aa3-40fb-a8ea-62cf4106b79c tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:59:51.489138 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-16dc8a11-0aa3-40fb-a8ea-62cf4106b79c tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] [instance: c2d05fca-cb18-4999-8e19-b2bbb4b95bf1] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:59:51.496567 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-16dc8a11-0aa3-40fb-a8ea-62cf4106b79c tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:59:51.497053 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-16dc8a11-0aa3-40fb-a8ea-62cf4106b79c tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:59:51.497491 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-16dc8a11-0aa3-40fb-a8ea-62cf4106b79c tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:59:51.498186 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-16dc8a11-0aa3-40fb-a8ea-62cf4106b79c tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:59:51.498639 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-16dc8a11-0aa3-40fb-a8ea-62cf4106b79c tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:59:51.499068 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-16dc8a11-0aa3-40fb-a8ea-62cf4106b79c tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:59:51.635737 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-16dc8a11-0aa3-40fb-a8ea-62cf4106b79c tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fc72f4915c43a0b1a287e24bf72b83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd680f69971c745029f0f85e9d3dcb2e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:59:51.643778 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-16dc8a11-0aa3-40fb-a8ea-62cf4106b79c tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] 10.222.0.18 "GET /compute/v2.1/servers/c2d05fca-cb18-4999-8e19-b2bbb4b95bf1" status: 200 len: 1504 microversion: 2.1 time: 0.160564 Oct 22 21:59:51.644365 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3316/6662] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:59:51 2022] GET /compute/v2.1/servers/c2d05fca-cb18-4999-8e19-b2bbb4b95bf1 => generated 1504 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:59:51.669569 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-3e8c59fb-39d7-420a-bf70-8662fbfd2e48 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:59:51.670066 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-3e8c59fb-39d7-420a-bf70-8662fbfd2e48 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] [instance: c2d05fca-cb18-4999-8e19-b2bbb4b95bf1] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:59:51.677321 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3e8c59fb-39d7-420a-bf70-8662fbfd2e48 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:59:51.677817 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3e8c59fb-39d7-420a-bf70-8662fbfd2e48 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:59:51.678281 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3e8c59fb-39d7-420a-bf70-8662fbfd2e48 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:59:51.679024 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3e8c59fb-39d7-420a-bf70-8662fbfd2e48 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:59:51.679530 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3e8c59fb-39d7-420a-bf70-8662fbfd2e48 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:59:51.679978 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3e8c59fb-39d7-420a-bf70-8662fbfd2e48 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:59:51.705780 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-3e8c59fb-39d7-420a-bf70-8662fbfd2e48 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] [instance: c2d05fca-cb18-4999-8e19-b2bbb4b95bf1] Going to try to terminate instance {{(pid=138745) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 21:59:51.792285 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-3e8c59fb-39d7-420a-bf70-8662fbfd2e48 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] 10.222.0.18 "DELETE /compute/v2.1/servers/c2d05fca-cb18-4999-8e19-b2bbb4b95bf1" status: 204 len: 0 microversion: 2.1 time: 0.126089 Oct 22 21:59:51.792867 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3347/6663] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 21:59:51 2022] DELETE /compute/v2.1/servers/c2d05fca-cb18-4999-8e19-b2bbb4b95bf1 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 21:59:51.800910 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-2133ba18-ccb1-4747-a6f8-fb026937d1ef tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:59:51.801525 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-2133ba18-ccb1-4747-a6f8-fb026937d1ef tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] [instance: c2d05fca-cb18-4999-8e19-b2bbb4b95bf1] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:59:51.807782 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2133ba18-ccb1-4747-a6f8-fb026937d1ef tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:59:51.808271 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2133ba18-ccb1-4747-a6f8-fb026937d1ef tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:59:51.808708 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2133ba18-ccb1-4747-a6f8-fb026937d1ef tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:59:51.809431 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2133ba18-ccb1-4747-a6f8-fb026937d1ef tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:59:51.809897 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2133ba18-ccb1-4747-a6f8-fb026937d1ef tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:59:51.810313 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2133ba18-ccb1-4747-a6f8-fb026937d1ef tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:59:51.949720 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-2133ba18-ccb1-4747-a6f8-fb026937d1ef tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fc72f4915c43a0b1a287e24bf72b83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd680f69971c745029f0f85e9d3dcb2e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:59:51.957936 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-2133ba18-ccb1-4747-a6f8-fb026937d1ef tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] 10.222.0.18 "GET /compute/v2.1/servers/c2d05fca-cb18-4999-8e19-b2bbb4b95bf1" status: 200 len: 1510 microversion: 2.1 time: 0.160981 Oct 22 21:59:51.958490 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3317/6664] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:59:51 2022] GET /compute/v2.1/servers/c2d05fca-cb18-4999-8e19-b2bbb4b95bf1 => generated 1510 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:59:52.986664 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-2619eecb-5071-43e2-b2e6-686d5014c481 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:59:52.987876 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-2619eecb-5071-43e2-b2e6-686d5014c481 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] [instance: c2d05fca-cb18-4999-8e19-b2bbb4b95bf1] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:59:52.990536 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell0:SELECT=2 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:59:52.991222 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell0:SELECT=6 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:59:52.997679 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2619eecb-5071-43e2-b2e6-686d5014c481 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:59:52.998175 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2619eecb-5071-43e2-b2e6-686d5014c481 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:59:52.998642 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2619eecb-5071-43e2-b2e6-686d5014c481 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:59:52.999440 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2619eecb-5071-43e2-b2e6-686d5014c481 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:59:52.999853 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2619eecb-5071-43e2-b2e6-686d5014c481 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:59:53.000286 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2619eecb-5071-43e2-b2e6-686d5014c481 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:59:53.143150 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-2619eecb-5071-43e2-b2e6-686d5014c481 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fc72f4915c43a0b1a287e24bf72b83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd680f69971c745029f0f85e9d3dcb2e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:59:53.151580 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-2619eecb-5071-43e2-b2e6-686d5014c481 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] 10.222.0.18 "GET /compute/v2.1/servers/c2d05fca-cb18-4999-8e19-b2bbb4b95bf1" status: 200 len: 1510 microversion: 2.1 time: 0.172088 Oct 22 21:59:53.152161 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3348/6665] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:59:52 2022] GET /compute/v2.1/servers/c2d05fca-cb18-4999-8e19-b2bbb4b95bf1 => generated 1510 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:59:53.666511 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-4d85ae6a-62d1-4ec1-a1c9-0a00a2e9e843 req-6c6887e5-5997-4fd1-8145-27f12ec3a492 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2d05fca-cb18-4999-8e19-b2bbb4b95bf1", "name": "network-vif-deleted", "tag": "e5640ad9-0977-42a1-af35-96f38df93c6e"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:59:53.675909 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell0:SELECT=2 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:59:53.683174 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-4d85ae6a-62d1-4ec1-a1c9-0a00a2e9e843 req-6c6887e5-5997-4fd1-8145-27f12ec3a492 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:59:53.683696 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-4d85ae6a-62d1-4ec1-a1c9-0a00a2e9e843 req-6c6887e5-5997-4fd1-8145-27f12ec3a492 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:59:53.684132 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-4d85ae6a-62d1-4ec1-a1c9-0a00a2e9e843 req-6c6887e5-5997-4fd1-8145-27f12ec3a492 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:59:53.703223 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-4d85ae6a-62d1-4ec1-a1c9-0a00a2e9e843 req-6c6887e5-5997-4fd1-8145-27f12ec3a492 service nova] Creating event network-vif-deleted:e5640ad9-0977-42a1-af35-96f38df93c6e for instance c2d05fca-cb18-4999-8e19-b2bbb4b95bf1 on nch2-master-1 Oct 22 21:59:53.709193 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-4d85ae6a-62d1-4ec1-a1c9-0a00a2e9e843 req-6c6887e5-5997-4fd1-8145-27f12ec3a492 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046533 Oct 22 21:59:53.710636 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3318/6666] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:59:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:59:54.178799 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-35c7d59b-6719-419f-adfe-97914a505c5c tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:59:54.179537 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-35c7d59b-6719-419f-adfe-97914a505c5c tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] [instance: c2d05fca-cb18-4999-8e19-b2bbb4b95bf1] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:59:54.186114 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-35c7d59b-6719-419f-adfe-97914a505c5c tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:59:54.186700 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-35c7d59b-6719-419f-adfe-97914a505c5c tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:59:54.187230 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-35c7d59b-6719-419f-adfe-97914a505c5c tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:59:54.187989 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-35c7d59b-6719-419f-adfe-97914a505c5c tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:59:54.188443 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-35c7d59b-6719-419f-adfe-97914a505c5c tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:59:54.188885 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-35c7d59b-6719-419f-adfe-97914a505c5c tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:59:54.222602 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-35c7d59b-6719-419f-adfe-97914a505c5c tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:59:54.223422 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-35c7d59b-6719-419f-adfe-97914a505c5c tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:59:54.224009 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-35c7d59b-6719-419f-adfe-97914a505c5c tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:59:54.224404 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.objects.instance [None req-35c7d59b-6719-419f-adfe-97914a505c5c tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Lazy-loading 'fault' on Instance uuid c2d05fca-cb18-4999-8e19-b2bbb4b95bf1 {{(pid=138745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 21:59:54.270056 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-35c7d59b-6719-419f-adfe-97914a505c5c tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fc72f4915c43a0b1a287e24bf72b83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd680f69971c745029f0f85e9d3dcb2e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:59:54.278999 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-35c7d59b-6719-419f-adfe-97914a505c5c tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] 10.222.0.18 "GET /compute/v2.1/servers/c2d05fca-cb18-4999-8e19-b2bbb4b95bf1" status: 200 len: 1306 microversion: 2.1 time: 0.105467 Oct 22 21:59:54.279625 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3349/6667] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:59:54 2022] GET /compute/v2.1/servers/c2d05fca-cb18-4999-8e19-b2bbb4b95bf1 => generated 1306 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:59:55.308901 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-f7be3c23-e9e5-4236-b670-d98ca3916d61 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:59:55.310029 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-f7be3c23-e9e5-4236-b670-d98ca3916d61 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] [instance: c2d05fca-cb18-4999-8e19-b2bbb4b95bf1] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:59:55.320550 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f7be3c23-e9e5-4236-b670-d98ca3916d61 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:59:55.321065 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f7be3c23-e9e5-4236-b670-d98ca3916d61 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:59:55.321470 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f7be3c23-e9e5-4236-b670-d98ca3916d61 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:59:55.322159 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f7be3c23-e9e5-4236-b670-d98ca3916d61 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:59:55.322643 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f7be3c23-e9e5-4236-b670-d98ca3916d61 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:59:55.323065 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f7be3c23-e9e5-4236-b670-d98ca3916d61 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:59:55.336920 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-f7be3c23-e9e5-4236-b670-d98ca3916d61 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] HTTP exception thrown: Instance c2d05fca-cb18-4999-8e19-b2bbb4b95bf1 could not be found. Oct 22 21:59:55.338579 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-f7be3c23-e9e5-4236-b670-d98ca3916d61 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Request method failure captured: Oct 22 21:59:55.338579 ncdv-master-1 devstack@n-api.service[138744]: request: GET /compute/v2.1/servers/c2d05fca-cb18-4999-8e19-b2bbb4b95bf1 HTTP/1.1 Oct 22 21:59:55.338579 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 21:59:55.338579 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 21:59:55.338579 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 21:59:55.338579 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 0 Oct 22 21:59:55.338579 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 21:59:55.338579 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 21:59:55.338579 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 21:59:55.338579 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 21:59:55.338579 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVGfASW9QdZCgX_5b3JZE7PaWxKvTyV3a-ju24MiXjJ2zc6YLMJ6aBka2_lJTasUXtojwbrp4vlhJHxqOekT04XphuA3YV3AYq6AKDy4ryqvhjsxAlIW8YLWMGCx40f4jLA3MrfDbQRSDgbrcsEytxcQnasDW4ujsofsuUOGU8SilXFM Oct 22 21:59:55.338579 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 21:59:55.338579 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 21:59:55.338579 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 21:59:55.338579 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 21:59:55.338579 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 21:59:55.338579 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 21:59:55.338579 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: d680f69971c745029f0f85e9d3dcb2e9 Oct 22 21:59:55.338579 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-ServersNegativeTestJSON-1724436144 Oct 22 21:59:55.338579 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 21:59:55.338579 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 21:59:55.338579 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_d680f69971c745029f0f85e9d3dcb2e9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d680f69971c745029f0f85e9d3dcb2e9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/d680f69971c745029f0f85e9d3dcb2e9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d680f69971c745029f0f85e9d3dcb2e9"}]}] Oct 22 21:59:55.338579 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-ServersNegativeTestJSON-1724436144 Oct 22 21:59:55.338579 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: d680f69971c745029f0f85e9d3dcb2e9 Oct 22 21:59:55.338579 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1724436144 Oct 22 21:59:55.338579 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-ServersNegativeTestJSON-1724436144-project Oct 22 21:59:55.338579 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 21:59:55.338579 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 21:59:55.338579 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: e8fc72f4915c43a0b1a287e24bf72b83 Oct 22 21:59:55.338579 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-ServersNegativeTestJSON-1724436144-project Oct 22 21:59:55.338579 ncdv-master-1 devstack@n-api.service[138744]: method: > Oct 22 21:59:55.338579 ncdv-master-1 devstack@n-api.service[138744]: exception: Instance c2d05fca-cb18-4999-8e19-b2bbb4b95bf1 could not be found. Oct 22 21:59:55.338579 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': 'c2d05fca-cb18-4999-8e19-b2bbb4b95bf1'} Oct 22 21:59:55.338579 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:59:55.338579 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:59:55.338579 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 21:59:55.338579 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 21:59:55.338579 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 21:59:55.338579 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 21:59:55.338579 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 21:59:55.338579 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 21:59:55.338579 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 21:59:55.338579 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 21:59:55.338579 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c2d05fca-cb18-4999-8e19-b2bbb4b95bf1 could not be found. Oct 22 21:59:55.338579 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:59:55.338579 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:59:55.338579 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:59:55.338579 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:59:55.338579 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:59:55.338579 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:59:55.338579 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:59:55.338579 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:59:55.338579 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:59:55.338579 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:59:55.338579 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 21:59:55.338579 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 21:59:55.338579 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 21:59:55.338579 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 21:59:55.338579 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 21:59:55.338579 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:59:55.338579 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c2d05fca-cb18-4999-8e19-b2bbb4b95bf1 could not be found. Oct 22 21:59:55.338579 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:59:55.338579 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:59:55.338579 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:59:55.343814 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:59:55.343814 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:59:55.343814 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:59:55.343814 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:59:55.343814 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:59:55.343814 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c2d05fca-cb18-4999-8e19-b2bbb4b95bf1 could not be found. Oct 22 21:59:55.343814 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:59:55.343814 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-f7be3c23-e9e5-4236-b670-d98ca3916d61 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Returning 404 to user: Instance c2d05fca-cb18-4999-8e19-b2bbb4b95bf1 could not be found. {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:59:55.343814 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-f7be3c23-e9e5-4236-b670-d98ca3916d61 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] 10.222.0.18 "GET /compute/v2.1/servers/c2d05fca-cb18-4999-8e19-b2bbb4b95bf1" status: 404 len: 111 microversion: 2.1 time: 0.039752 Oct 22 21:59:55.343814 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3319/6668] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:59:55 2022] GET /compute/v2.1/servers/c2d05fca-cb18-4999-8e19-b2bbb4b95bf1 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 21:59:55.349722 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-95c40576-05a9-45ca-9b2a-052573189e5b tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:59:55.350350 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-95c40576-05a9-45ca-9b2a-052573189e5b tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] [instance: 347f4dea-4bac-4e96-a8e3-92396045052c] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:59:55.357625 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-95c40576-05a9-45ca-9b2a-052573189e5b tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:59:55.358120 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-95c40576-05a9-45ca-9b2a-052573189e5b tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:59:55.358569 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-95c40576-05a9-45ca-9b2a-052573189e5b tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:59:55.359297 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-95c40576-05a9-45ca-9b2a-052573189e5b tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:59:55.359795 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-95c40576-05a9-45ca-9b2a-052573189e5b tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:59:55.360230 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-95c40576-05a9-45ca-9b2a-052573189e5b tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:59:55.500932 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-95c40576-05a9-45ca-9b2a-052573189e5b tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fc72f4915c43a0b1a287e24bf72b83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd680f69971c745029f0f85e9d3dcb2e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:59:55.509530 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-95c40576-05a9-45ca-9b2a-052573189e5b tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] 10.222.0.18 "GET /compute/v2.1/servers/347f4dea-4bac-4e96-a8e3-92396045052c" status: 200 len: 1505 microversion: 2.1 time: 0.163749 Oct 22 21:59:55.510103 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3350/6669] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:59:55 2022] GET /compute/v2.1/servers/347f4dea-4bac-4e96-a8e3-92396045052c => generated 1505 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 21:59:55.534582 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-604fc879-54e9-4d50-bab6-b3a2c473013d tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "452"}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:59:55.537915 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-604fc879-54e9-4d50-bab6-b3a2c473013d tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] [instance: 03bf2b70-37cd-40e5-b984-8ba24c923204] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:59:55.544218 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-604fc879-54e9-4d50-bab6-b3a2c473013d tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] HTTP exception thrown: Instance 03bf2b70-37cd-40e5-b984-8ba24c923204 could not be found. Oct 22 21:59:55.545777 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-604fc879-54e9-4d50-bab6-b3a2c473013d tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Request method failure captured: Oct 22 21:59:55.545777 ncdv-master-1 devstack@n-api.service[138744]: request: POST /compute/v2.1/servers/03bf2b70-37cd-40e5-b984-8ba24c923204/action HTTP/1.1 Oct 22 21:59:55.545777 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 21:59:55.545777 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 21:59:55.545777 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 21:59:55.545777 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 32 Oct 22 21:59:55.545777 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 21:59:55.545777 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 21:59:55.545777 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 21:59:55.545777 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 21:59:55.545777 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVGfASW9QdZCgX_5b3JZE7PaWxKvTyV3a-ju24MiXjJ2zc6YLMJ6aBka2_lJTasUXtojwbrp4vlhJHxqOekT04XphuA3YV3AYq6AKDy4ryqvhjsxAlIW8YLWMGCx40f4jLA3MrfDbQRSDgbrcsEytxcQnasDW4ujsofsuUOGU8SilXFM Oct 22 21:59:55.545777 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 21:59:55.545777 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 21:59:55.545777 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 21:59:55.545777 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 21:59:55.545777 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 21:59:55.545777 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 21:59:55.545777 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: d680f69971c745029f0f85e9d3dcb2e9 Oct 22 21:59:55.545777 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-ServersNegativeTestJSON-1724436144 Oct 22 21:59:55.545777 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 21:59:55.545777 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 21:59:55.545777 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_d680f69971c745029f0f85e9d3dcb2e9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d680f69971c745029f0f85e9d3dcb2e9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/d680f69971c745029f0f85e9d3dcb2e9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d680f69971c745029f0f85e9d3dcb2e9"}]}] Oct 22 21:59:55.545777 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-ServersNegativeTestJSON-1724436144 Oct 22 21:59:55.545777 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: d680f69971c745029f0f85e9d3dcb2e9 Oct 22 21:59:55.545777 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1724436144 Oct 22 21:59:55.545777 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-ServersNegativeTestJSON-1724436144-project Oct 22 21:59:55.545777 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 21:59:55.545777 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 21:59:55.545777 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: e8fc72f4915c43a0b1a287e24bf72b83 Oct 22 21:59:55.545777 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-ServersNegativeTestJSON-1724436144-project Oct 22 21:59:55.545777 ncdv-master-1 devstack@n-api.service[138744]: Oct 22 21:59:55.545777 ncdv-master-1 devstack@n-api.service[138744]: {"resize": {"flavorRef": "452"}} Oct 22 21:59:55.545777 ncdv-master-1 devstack@n-api.service[138744]: method: > Oct 22 21:59:55.545777 ncdv-master-1 devstack@n-api.service[138744]: exception: Instance 03bf2b70-37cd-40e5-b984-8ba24c923204 could not be found. Oct 22 21:59:55.545777 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': '03bf2b70-37cd-40e5-b984-8ba24c923204', 'body': {'resize': {'flavorRef': '452'}}} Oct 22 21:59:55.545777 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:59:55.545777 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:59:55.545777 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 21:59:55.545777 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 21:59:55.545777 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 21:59:55.545777 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 21:59:55.545777 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 22 21:59:55.545777 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 22 21:59:55.545777 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03bf2b70-37cd-40e5-b984-8ba24c923204 could not be found. Oct 22 21:59:55.545777 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:59:55.545777 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:59:55.545777 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:59:55.545777 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:59:55.545777 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:59:55.545777 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:59:55.545777 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:59:55.545777 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:59:55.545777 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:59:55.545777 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:59:55.545777 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 21:59:55.545777 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 21:59:55.545777 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 22 21:59:55.545777 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 22 21:59:55.545777 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1046, in _resize Oct 22 21:59:55.545777 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_id, Oct 22 21:59:55.545777 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 21:59:55.545777 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 21:59:55.545777 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 21:59:55.545777 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:59:55.550581 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03bf2b70-37cd-40e5-b984-8ba24c923204 could not be found. Oct 22 21:59:55.550581 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:59:55.550581 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:59:55.550581 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:59:55.550581 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:59:55.550581 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:59:55.550581 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:59:55.550581 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:59:55.550581 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:59:55.550581 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03bf2b70-37cd-40e5-b984-8ba24c923204 could not be found. Oct 22 21:59:55.550581 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:59:55.550581 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-604fc879-54e9-4d50-bab6-b3a2c473013d tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Returning 404 to user: Instance 03bf2b70-37cd-40e5-b984-8ba24c923204 could not be found. {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:59:55.550581 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-604fc879-54e9-4d50-bab6-b3a2c473013d tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] 10.222.0.18 "POST /compute/v2.1/servers/03bf2b70-37cd-40e5-b984-8ba24c923204/action" status: 404 len: 111 microversion: 2.1 time: 0.019198 Oct 22 21:59:55.550581 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3320/6670] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 21:59:55 2022] POST /compute/v2.1/servers/03bf2b70-37cd-40e5-b984-8ba24c923204/action => generated 111 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 21:59:55.556055 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-3f866909-8283-4a60-9fd9-e7b225b3ab69 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:59:55.556687 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-3f866909-8283-4a60-9fd9-e7b225b3ab69 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] [instance: 347f4dea-4bac-4e96-a8e3-92396045052c] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:59:55.563160 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3f866909-8283-4a60-9fd9-e7b225b3ab69 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:59:55.563692 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3f866909-8283-4a60-9fd9-e7b225b3ab69 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:59:55.564152 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3f866909-8283-4a60-9fd9-e7b225b3ab69 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:59:55.564859 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3f866909-8283-4a60-9fd9-e7b225b3ab69 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:59:55.565326 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3f866909-8283-4a60-9fd9-e7b225b3ab69 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:59:55.565765 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3f866909-8283-4a60-9fd9-e7b225b3ab69 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:59:55.709651 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-3f866909-8283-4a60-9fd9-e7b225b3ab69 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fc72f4915c43a0b1a287e24bf72b83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd680f69971c745029f0f85e9d3dcb2e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:59:55.713288 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:59:55.718506 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-3f866909-8283-4a60-9fd9-e7b225b3ab69 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] 10.222.0.18 "GET /compute/v2.1/servers/347f4dea-4bac-4e96-a8e3-92396045052c" status: 200 len: 1505 microversion: 2.1 time: 0.166343 Oct 22 21:59:55.719078 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3351/6671] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:59:55 2022] GET /compute/v2.1/servers/347f4dea-4bac-4e96-a8e3-92396045052c => generated 1505 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:59:55.741901 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-c2ec6a98-f49c-4dae-a32d-65c7704ae167 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:59:55.742497 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-c2ec6a98-f49c-4dae-a32d-65c7704ae167 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] [instance: 347f4dea-4bac-4e96-a8e3-92396045052c] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:59:55.749677 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c2ec6a98-f49c-4dae-a32d-65c7704ae167 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:59:55.750159 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c2ec6a98-f49c-4dae-a32d-65c7704ae167 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:59:55.750625 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c2ec6a98-f49c-4dae-a32d-65c7704ae167 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:59:55.751321 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c2ec6a98-f49c-4dae-a32d-65c7704ae167 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:59:55.751817 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c2ec6a98-f49c-4dae-a32d-65c7704ae167 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:59:55.752248 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c2ec6a98-f49c-4dae-a32d-65c7704ae167 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:59:55.893239 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-c2ec6a98-f49c-4dae-a32d-65c7704ae167 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fc72f4915c43a0b1a287e24bf72b83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd680f69971c745029f0f85e9d3dcb2e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:59:55.902593 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-c2ec6a98-f49c-4dae-a32d-65c7704ae167 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] 10.222.0.18 "GET /compute/v2.1/servers/347f4dea-4bac-4e96-a8e3-92396045052c" status: 200 len: 1505 microversion: 2.1 time: 0.164559 Oct 22 21:59:55.903132 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3321/6672] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:59:55 2022] GET /compute/v2.1/servers/347f4dea-4bac-4e96-a8e3-92396045052c => generated 1505 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:59:55.926217 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-a06ae7a9-6cb5-457c-badd-2ed50f3daed5 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "681b4614-823d-4351-b47a-7e7d5fc28171"}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:59:55.928557 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-a06ae7a9-6cb5-457c-badd-2ed50f3daed5 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] [instance: 347f4dea-4bac-4e96-a8e3-92396045052c] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:59:55.935362 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a06ae7a9-6cb5-457c-badd-2ed50f3daed5 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:59:55.935889 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a06ae7a9-6cb5-457c-badd-2ed50f3daed5 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:59:55.936336 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a06ae7a9-6cb5-457c-badd-2ed50f3daed5 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:59:55.937042 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a06ae7a9-6cb5-457c-badd-2ed50f3daed5 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:59:55.937507 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a06ae7a9-6cb5-457c-badd-2ed50f3daed5 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:59:55.937945 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a06ae7a9-6cb5-457c-badd-2ed50f3daed5 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:59:55.978538 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-a06ae7a9-6cb5-457c-badd-2ed50f3daed5 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'e8fc72f4915c43a0b1a287e24bf72b83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd680f69971c745029f0f85e9d3dcb2e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:59:55.984208 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.wsgi [None req-a06ae7a9-6cb5-457c-badd-2ed50f3daed5 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] HTTP exception thrown: Flavor 681b4614-823d-4351-b47a-7e7d5fc28171 could not be found. Oct 22 21:59:55.986158 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-a06ae7a9-6cb5-457c-badd-2ed50f3daed5 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Request method failure captured: Oct 22 21:59:55.986158 ncdv-master-1 devstack@n-api.service[138745]: request: POST /compute/v2.1/servers/347f4dea-4bac-4e96-a8e3-92396045052c/action HTTP/1.1 Oct 22 21:59:55.986158 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 21:59:55.986158 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 21:59:55.986158 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 21:59:55.986158 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 65 Oct 22 21:59:55.986158 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 21:59:55.986158 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 21:59:55.986158 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 21:59:55.986158 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 21:59:55.986158 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVGfASW9QdZCgX_5b3JZE7PaWxKvTyV3a-ju24MiXjJ2zc6YLMJ6aBka2_lJTasUXtojwbrp4vlhJHxqOekT04XphuA3YV3AYq6AKDy4ryqvhjsxAlIW8YLWMGCx40f4jLA3MrfDbQRSDgbrcsEytxcQnasDW4ujsofsuUOGU8SilXFM Oct 22 21:59:55.986158 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 21:59:55.986158 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 21:59:55.986158 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 21:59:55.986158 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 21:59:55.986158 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 21:59:55.986158 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 21:59:55.986158 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: d680f69971c745029f0f85e9d3dcb2e9 Oct 22 21:59:55.986158 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-ServersNegativeTestJSON-1724436144 Oct 22 21:59:55.986158 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 21:59:55.986158 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 21:59:55.986158 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_d680f69971c745029f0f85e9d3dcb2e9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d680f69971c745029f0f85e9d3dcb2e9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/d680f69971c745029f0f85e9d3dcb2e9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d680f69971c745029f0f85e9d3dcb2e9"}]}] Oct 22 21:59:55.986158 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-ServersNegativeTestJSON-1724436144 Oct 22 21:59:55.986158 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: d680f69971c745029f0f85e9d3dcb2e9 Oct 22 21:59:55.986158 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1724436144 Oct 22 21:59:55.986158 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-ServersNegativeTestJSON-1724436144-project Oct 22 21:59:55.986158 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 21:59:55.986158 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 21:59:55.986158 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: e8fc72f4915c43a0b1a287e24bf72b83 Oct 22 21:59:55.986158 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-ServersNegativeTestJSON-1724436144-project Oct 22 21:59:55.986158 ncdv-master-1 devstack@n-api.service[138745]: Oct 22 21:59:55.986158 ncdv-master-1 devstack@n-api.service[138745]: {"resize": {"flavorRef": "681b4614-823d-4351-b47a-7e7d5fc28171"}} Oct 22 21:59:55.986158 ncdv-master-1 devstack@n-api.service[138745]: method: > Oct 22 21:59:55.986158 ncdv-master-1 devstack@n-api.service[138745]: exception: Flavor 681b4614-823d-4351-b47a-7e7d5fc28171 could not be found. Oct 22 21:59:55.986158 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'id': '347f4dea-4bac-4e96-a8e3-92396045052c', 'body': {'resize': {'flavorRef': '681b4614-823d-4351-b47a-7e7d5fc28171'}}} Oct 22 21:59:55.986158 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:59:55.986158 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:59:55.986158 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Oct 22 21:59:55.986158 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Oct 22 21:59:55.986158 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 22 21:59:55.986158 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 22 21:59:55.986158 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 22 21:59:55.986158 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 22 21:59:55.986158 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 22 21:59:55.986158 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 22 21:59:55.986158 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 22 21:59:55.986158 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 22 21:59:55.986158 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 22 21:59:55.986158 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 22 21:59:55.986158 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Oct 22 21:59:55.986158 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 22 21:59:55.986158 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4200, in resize Oct 22 21:59:55.986158 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi new_flavor = flavors.get_flavor_by_flavor_id( Oct 22 21:59:55.986158 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 22 21:59:55.986158 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 22 21:59:55.986158 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 22 21:59:55.986158 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 22 21:59:55.986158 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 22 21:59:55.986158 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 22 21:59:55.986158 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 22 21:59:55.986158 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:59:55.986158 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 22 21:59:55.991649 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 22 21:59:55.991649 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 681b4614-823d-4351-b47a-7e7d5fc28171 could not be found. Oct 22 21:59:55.991649 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:59:55.991649 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:59:55.991649 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:59:55.991649 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:59:55.991649 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:59:55.991649 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:59:55.991649 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:59:55.991649 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:59:55.991649 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:59:55.991649 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:59:55.991649 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 21:59:55.991649 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 21:59:55.991649 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 22 21:59:55.991649 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 22 21:59:55.991649 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1083, in _resize Oct 22 21:59:55.991649 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 22 21:59:55.991649 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 681b4614-823d-4351-b47a-7e7d5fc28171 could not be found. Oct 22 21:59:55.991649 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:59:55.991649 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:59:55.991649 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:59:55.991649 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:59:55.991649 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:59:55.991649 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:59:55.991649 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:59:55.991649 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:59:55.991649 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 681b4614-823d-4351-b47a-7e7d5fc28171 could not be found. Oct 22 21:59:55.991649 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:59:55.991649 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-a06ae7a9-6cb5-457c-badd-2ed50f3daed5 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Returning 400 to user: Flavor 681b4614-823d-4351-b47a-7e7d5fc28171 could not be found. {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:59:55.991649 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-a06ae7a9-6cb5-457c-badd-2ed50f3daed5 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] 10.222.0.18 "POST /compute/v2.1/servers/347f4dea-4bac-4e96-a8e3-92396045052c/action" status: 400 len: 107 microversion: 2.1 time: 0.065627 Oct 22 21:59:55.991649 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3352/6673] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 21:59:55 2022] POST /compute/v2.1/servers/347f4dea-4bac-4e96-a8e3-92396045052c/action => generated 107 bytes in 67 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 22 21:59:55.998066 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-7f51e35f-bd51-4300-8560-4aa81ae96e48 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:59:55.998991 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-7f51e35f-bd51-4300-8560-4aa81ae96e48 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] [instance: 347f4dea-4bac-4e96-a8e3-92396045052c] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:59:56.008341 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7f51e35f-bd51-4300-8560-4aa81ae96e48 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:59:56.008834 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7f51e35f-bd51-4300-8560-4aa81ae96e48 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:59:56.009277 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7f51e35f-bd51-4300-8560-4aa81ae96e48 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:59:56.009973 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7f51e35f-bd51-4300-8560-4aa81ae96e48 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:59:56.010429 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7f51e35f-bd51-4300-8560-4aa81ae96e48 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:59:56.010860 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7f51e35f-bd51-4300-8560-4aa81ae96e48 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:59:56.149442 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-7f51e35f-bd51-4300-8560-4aa81ae96e48 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fc72f4915c43a0b1a287e24bf72b83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd680f69971c745029f0f85e9d3dcb2e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:59:56.157878 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-7f51e35f-bd51-4300-8560-4aa81ae96e48 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] 10.222.0.18 "GET /compute/v2.1/servers/347f4dea-4bac-4e96-a8e3-92396045052c" status: 200 len: 1505 microversion: 2.1 time: 0.165080 Oct 22 21:59:56.158379 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3322/6674] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:59:55 2022] GET /compute/v2.1/servers/347f4dea-4bac-4e96-a8e3-92396045052c => generated 1505 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:59:56.181019 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-b6ba2407-6c35-4492-ae5b-65f65802d54a tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:59:56.181680 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-b6ba2407-6c35-4492-ae5b-65f65802d54a tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] [instance: 347f4dea-4bac-4e96-a8e3-92396045052c] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:59:56.187965 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b6ba2407-6c35-4492-ae5b-65f65802d54a tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:59:56.188454 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b6ba2407-6c35-4492-ae5b-65f65802d54a tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:59:56.188898 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b6ba2407-6c35-4492-ae5b-65f65802d54a tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:59:56.189600 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b6ba2407-6c35-4492-ae5b-65f65802d54a tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:59:56.190060 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b6ba2407-6c35-4492-ae5b-65f65802d54a tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:59:56.190495 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b6ba2407-6c35-4492-ae5b-65f65802d54a tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:59:56.324416 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-b6ba2407-6c35-4492-ae5b-65f65802d54a tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fc72f4915c43a0b1a287e24bf72b83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd680f69971c745029f0f85e9d3dcb2e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:59:56.336205 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-b6ba2407-6c35-4492-ae5b-65f65802d54a tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] 10.222.0.18 "GET /compute/v2.1/servers/347f4dea-4bac-4e96-a8e3-92396045052c" status: 200 len: 1505 microversion: 2.1 time: 0.159048 Oct 22 21:59:56.336769 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3353/6675] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:59:56 2022] GET /compute/v2.1/servers/347f4dea-4bac-4e96-a8e3-92396045052c => generated 1505 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:59:56.358955 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-0e6f26b5-730c-4e63-86b3-81795cf5c66f tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": ""}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:59:56.362643 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-0e6f26b5-730c-4e63-86b3-81795cf5c66f tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Request method failure captured: Oct 22 21:59:56.362643 ncdv-master-1 devstack@n-api.service[138744]: request: POST /compute/v2.1/servers/347f4dea-4bac-4e96-a8e3-92396045052c/action HTTP/1.1 Oct 22 21:59:56.362643 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 21:59:56.362643 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 21:59:56.362643 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 21:59:56.362643 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 29 Oct 22 21:59:56.362643 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 21:59:56.362643 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 21:59:56.362643 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 21:59:56.362643 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 21:59:56.362643 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVGfASW9QdZCgX_5b3JZE7PaWxKvTyV3a-ju24MiXjJ2zc6YLMJ6aBka2_lJTasUXtojwbrp4vlhJHxqOekT04XphuA3YV3AYq6AKDy4ryqvhjsxAlIW8YLWMGCx40f4jLA3MrfDbQRSDgbrcsEytxcQnasDW4ujsofsuUOGU8SilXFM Oct 22 21:59:56.362643 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 21:59:56.362643 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 21:59:56.362643 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 21:59:56.362643 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 21:59:56.362643 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 21:59:56.362643 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 21:59:56.362643 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: d680f69971c745029f0f85e9d3dcb2e9 Oct 22 21:59:56.362643 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-ServersNegativeTestJSON-1724436144 Oct 22 21:59:56.362643 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 21:59:56.362643 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 21:59:56.362643 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_d680f69971c745029f0f85e9d3dcb2e9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d680f69971c745029f0f85e9d3dcb2e9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/d680f69971c745029f0f85e9d3dcb2e9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d680f69971c745029f0f85e9d3dcb2e9"}]}] Oct 22 21:59:56.362643 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-ServersNegativeTestJSON-1724436144 Oct 22 21:59:56.362643 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: d680f69971c745029f0f85e9d3dcb2e9 Oct 22 21:59:56.362643 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1724436144 Oct 22 21:59:56.362643 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-ServersNegativeTestJSON-1724436144-project Oct 22 21:59:56.362643 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 21:59:56.362643 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 21:59:56.362643 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: e8fc72f4915c43a0b1a287e24bf72b83 Oct 22 21:59:56.362643 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-ServersNegativeTestJSON-1724436144-project Oct 22 21:59:56.362643 ncdv-master-1 devstack@n-api.service[138744]: Oct 22 21:59:56.362643 ncdv-master-1 devstack@n-api.service[138744]: {"resize": {"flavorRef": ""}} Oct 22 21:59:56.362643 ncdv-master-1 devstack@n-api.service[138744]: method: > Oct 22 21:59:56.362643 ncdv-master-1 devstack@n-api.service[138744]: exception: Invalid input for field/attribute flavorRef. Value: . '' is too short Oct 22 21:59:56.362643 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': '347f4dea-4bac-4e96-a8e3-92396045052c', 'body': {'resize': {'flavorRef': ''}}} Oct 22 21:59:56.362643 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:59:56.362643 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:59:56.362643 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 22 21:59:56.362643 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 22 21:59:56.362643 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 22 21:59:56.362643 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise error Oct 22 21:59:56.362643 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 22 21:59:56.362643 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:59:56.362643 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['resize']['properties']['flavorRef']: Oct 22 21:59:56.362643 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi {'minLength': 1, 'type': ['string', 'integer']} Oct 22 21:59:56.362643 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:59:56.362643 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi On instance['resize']: Oct 22 21:59:56.362643 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi '' Oct 22 21:59:56.362643 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:59:56.362643 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:59:56.362643 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:59:56.362643 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:59:56.362643 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:59:56.362643 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:59:56.362643 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:59:56.362643 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:59:56.362643 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:59:56.362643 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:59:56.362643 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 22 21:59:56.362643 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 22 21:59:56.362643 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 22 21:59:56.362643 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 22 21:59:56.362643 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 22 21:59:56.362643 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 22 21:59:56.362643 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute flavorRef. Value: . '' is too short Oct 22 21:59:56.362643 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:59:56.362643 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:59:56.367801 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:59:56.367801 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:59:56.367801 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:59:56.367801 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:59:56.367801 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 22 21:59:56.367801 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 22 21:59:56.367801 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute flavorRef. Value: . '' is too short Oct 22 21:59:56.367801 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:59:56.367801 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-0e6f26b5-730c-4e63-86b3-81795cf5c66f tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Returning 400 to user: Invalid input for field/attribute flavorRef. Value: . '' is too short {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:59:56.367801 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-0e6f26b5-730c-4e63-86b3-81795cf5c66f tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] 10.222.0.18 "POST /compute/v2.1/servers/347f4dea-4bac-4e96-a8e3-92396045052c/action" status: 400 len: 113 microversion: 2.1 time: 0.009172 Oct 22 21:59:56.367801 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3323/6676] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 21:59:56 2022] POST /compute/v2.1/servers/347f4dea-4bac-4e96-a8e3-92396045052c/action => generated 113 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 22 21:59:56.373354 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-75dc6a59-05a7-446c-a868-bad626102076 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:59:56.374012 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-75dc6a59-05a7-446c-a868-bad626102076 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] [instance: 347f4dea-4bac-4e96-a8e3-92396045052c] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:59:56.380961 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-75dc6a59-05a7-446c-a868-bad626102076 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:59:56.381456 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-75dc6a59-05a7-446c-a868-bad626102076 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:59:56.381948 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-75dc6a59-05a7-446c-a868-bad626102076 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:59:56.382667 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-75dc6a59-05a7-446c-a868-bad626102076 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:59:56.383131 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-75dc6a59-05a7-446c-a868-bad626102076 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:59:56.383630 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-75dc6a59-05a7-446c-a868-bad626102076 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:59:56.529468 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-75dc6a59-05a7-446c-a868-bad626102076 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fc72f4915c43a0b1a287e24bf72b83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd680f69971c745029f0f85e9d3dcb2e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:59:56.537975 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-75dc6a59-05a7-446c-a868-bad626102076 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] 10.222.0.18 "GET /compute/v2.1/servers/347f4dea-4bac-4e96-a8e3-92396045052c" status: 200 len: 1505 microversion: 2.1 time: 0.168561 Oct 22 21:59:56.538571 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3354/6677] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:59:56 2022] GET /compute/v2.1/servers/347f4dea-4bac-4e96-a8e3-92396045052c => generated 1505 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:59:56.564578 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-6001c2d2-e22c-4b8e-87b7-5d89ce648adb tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:59:56.565090 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-6001c2d2-e22c-4b8e-87b7-5d89ce648adb tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] [instance: c2d05fca-cb18-4999-8e19-b2bbb4b95bf1] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:59:56.575174 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6001c2d2-e22c-4b8e-87b7-5d89ce648adb tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:59:56.575830 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6001c2d2-e22c-4b8e-87b7-5d89ce648adb tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:59:56.576251 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6001c2d2-e22c-4b8e-87b7-5d89ce648adb tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:59:56.576973 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6001c2d2-e22c-4b8e-87b7-5d89ce648adb tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:59:56.577430 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6001c2d2-e22c-4b8e-87b7-5d89ce648adb tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:59:56.577855 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6001c2d2-e22c-4b8e-87b7-5d89ce648adb tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:59:56.592330 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-6001c2d2-e22c-4b8e-87b7-5d89ce648adb tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] HTTP exception thrown: Instance c2d05fca-cb18-4999-8e19-b2bbb4b95bf1 could not be found. Oct 22 21:59:56.593887 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-6001c2d2-e22c-4b8e-87b7-5d89ce648adb tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Request method failure captured: Oct 22 21:59:56.593887 ncdv-master-1 devstack@n-api.service[138744]: request: DELETE /compute/v2.1/servers/c2d05fca-cb18-4999-8e19-b2bbb4b95bf1 HTTP/1.1 Oct 22 21:59:56.593887 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 21:59:56.593887 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 21:59:56.593887 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 21:59:56.593887 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 0 Oct 22 21:59:56.593887 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 21:59:56.593887 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 21:59:56.593887 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 21:59:56.593887 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 21:59:56.593887 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVGfASW9QdZCgX_5b3JZE7PaWxKvTyV3a-ju24MiXjJ2zc6YLMJ6aBka2_lJTasUXtojwbrp4vlhJHxqOekT04XphuA3YV3AYq6AKDy4ryqvhjsxAlIW8YLWMGCx40f4jLA3MrfDbQRSDgbrcsEytxcQnasDW4ujsofsuUOGU8SilXFM Oct 22 21:59:56.593887 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 21:59:56.593887 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 21:59:56.593887 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 21:59:56.593887 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 21:59:56.593887 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 21:59:56.593887 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 21:59:56.593887 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: d680f69971c745029f0f85e9d3dcb2e9 Oct 22 21:59:56.593887 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-ServersNegativeTestJSON-1724436144 Oct 22 21:59:56.593887 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 21:59:56.593887 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 21:59:56.593887 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_d680f69971c745029f0f85e9d3dcb2e9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d680f69971c745029f0f85e9d3dcb2e9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/d680f69971c745029f0f85e9d3dcb2e9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d680f69971c745029f0f85e9d3dcb2e9"}]}] Oct 22 21:59:56.593887 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-ServersNegativeTestJSON-1724436144 Oct 22 21:59:56.593887 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: d680f69971c745029f0f85e9d3dcb2e9 Oct 22 21:59:56.593887 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1724436144 Oct 22 21:59:56.593887 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-ServersNegativeTestJSON-1724436144-project Oct 22 21:59:56.593887 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 21:59:56.593887 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 21:59:56.593887 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: e8fc72f4915c43a0b1a287e24bf72b83 Oct 22 21:59:56.593887 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-ServersNegativeTestJSON-1724436144-project Oct 22 21:59:56.593887 ncdv-master-1 devstack@n-api.service[138744]: method: > Oct 22 21:59:56.593887 ncdv-master-1 devstack@n-api.service[138744]: exception: Instance c2d05fca-cb18-4999-8e19-b2bbb4b95bf1 could not be found. Oct 22 21:59:56.593887 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': 'c2d05fca-cb18-4999-8e19-b2bbb4b95bf1'} Oct 22 21:59:56.593887 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:59:56.593887 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:59:56.593887 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 21:59:56.593887 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 21:59:56.593887 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 21:59:56.593887 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 21:59:56.593887 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 21:59:56.593887 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 21:59:56.593887 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 21:59:56.593887 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 21:59:56.593887 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c2d05fca-cb18-4999-8e19-b2bbb4b95bf1 could not be found. Oct 22 21:59:56.593887 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:59:56.593887 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:59:56.593887 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:59:56.593887 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:59:56.593887 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:59:56.593887 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:59:56.593887 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:59:56.593887 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:59:56.593887 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:59:56.593887 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:59:56.593887 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 22 21:59:56.593887 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 22 21:59:56.593887 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 22 21:59:56.593887 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 22 21:59:56.593887 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 21:59:56.593887 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 21:59:56.593887 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 21:59:56.593887 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:59:56.598961 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c2d05fca-cb18-4999-8e19-b2bbb4b95bf1 could not be found. Oct 22 21:59:56.598961 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:59:56.598961 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:59:56.598961 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:59:56.598961 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:59:56.598961 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:59:56.598961 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:59:56.598961 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:59:56.598961 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:59:56.598961 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c2d05fca-cb18-4999-8e19-b2bbb4b95bf1 could not be found. Oct 22 21:59:56.598961 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 21:59:56.598961 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-6001c2d2-e22c-4b8e-87b7-5d89ce648adb tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Returning 404 to user: Instance c2d05fca-cb18-4999-8e19-b2bbb4b95bf1 could not be found. {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:59:56.598961 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-6001c2d2-e22c-4b8e-87b7-5d89ce648adb tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] 10.222.0.18 "DELETE /compute/v2.1/servers/c2d05fca-cb18-4999-8e19-b2bbb4b95bf1" status: 404 len: 111 microversion: 2.1 time: 0.035535 Oct 22 21:59:56.598961 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3324/6678] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 21:59:56 2022] DELETE /compute/v2.1/servers/c2d05fca-cb18-4999-8e19-b2bbb4b95bf1 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 21:59:56.604333 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-ecdd6c12-9924-43a7-8b8a-77a31e5845b0 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:59:56.604968 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-ecdd6c12-9924-43a7-8b8a-77a31e5845b0 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] [instance: c2d05fca-cb18-4999-8e19-b2bbb4b95bf1] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:59:56.611448 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ecdd6c12-9924-43a7-8b8a-77a31e5845b0 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:59:56.611943 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ecdd6c12-9924-43a7-8b8a-77a31e5845b0 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:59:56.612396 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ecdd6c12-9924-43a7-8b8a-77a31e5845b0 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:59:56.613100 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ecdd6c12-9924-43a7-8b8a-77a31e5845b0 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:59:56.613569 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ecdd6c12-9924-43a7-8b8a-77a31e5845b0 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:59:56.614016 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ecdd6c12-9924-43a7-8b8a-77a31e5845b0 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:59:56.627863 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.wsgi [None req-ecdd6c12-9924-43a7-8b8a-77a31e5845b0 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] HTTP exception thrown: Instance c2d05fca-cb18-4999-8e19-b2bbb4b95bf1 could not be found. Oct 22 21:59:56.629428 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-ecdd6c12-9924-43a7-8b8a-77a31e5845b0 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Request method failure captured: Oct 22 21:59:56.629428 ncdv-master-1 devstack@n-api.service[138745]: request: GET /compute/v2.1/servers/c2d05fca-cb18-4999-8e19-b2bbb4b95bf1 HTTP/1.1 Oct 22 21:59:56.629428 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 21:59:56.629428 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 21:59:56.629428 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 21:59:56.629428 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 0 Oct 22 21:59:56.629428 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 21:59:56.629428 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 21:59:56.629428 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 21:59:56.629428 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 21:59:56.629428 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVGfASW9QdZCgX_5b3JZE7PaWxKvTyV3a-ju24MiXjJ2zc6YLMJ6aBka2_lJTasUXtojwbrp4vlhJHxqOekT04XphuA3YV3AYq6AKDy4ryqvhjsxAlIW8YLWMGCx40f4jLA3MrfDbQRSDgbrcsEytxcQnasDW4ujsofsuUOGU8SilXFM Oct 22 21:59:56.629428 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 21:59:56.629428 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 21:59:56.629428 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 21:59:56.629428 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 21:59:56.629428 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 21:59:56.629428 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 21:59:56.629428 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: d680f69971c745029f0f85e9d3dcb2e9 Oct 22 21:59:56.629428 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-ServersNegativeTestJSON-1724436144 Oct 22 21:59:56.629428 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 21:59:56.629428 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 21:59:56.629428 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_d680f69971c745029f0f85e9d3dcb2e9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d680f69971c745029f0f85e9d3dcb2e9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/d680f69971c745029f0f85e9d3dcb2e9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d680f69971c745029f0f85e9d3dcb2e9"}]}] Oct 22 21:59:56.629428 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-ServersNegativeTestJSON-1724436144 Oct 22 21:59:56.629428 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: d680f69971c745029f0f85e9d3dcb2e9 Oct 22 21:59:56.629428 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1724436144 Oct 22 21:59:56.629428 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-ServersNegativeTestJSON-1724436144-project Oct 22 21:59:56.629428 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 21:59:56.629428 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 21:59:56.629428 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: e8fc72f4915c43a0b1a287e24bf72b83 Oct 22 21:59:56.629428 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-ServersNegativeTestJSON-1724436144-project Oct 22 21:59:56.629428 ncdv-master-1 devstack@n-api.service[138745]: method: > Oct 22 21:59:56.629428 ncdv-master-1 devstack@n-api.service[138745]: exception: Instance c2d05fca-cb18-4999-8e19-b2bbb4b95bf1 could not be found. Oct 22 21:59:56.629428 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'id': 'c2d05fca-cb18-4999-8e19-b2bbb4b95bf1'} Oct 22 21:59:56.629428 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 21:59:56.629428 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:59:56.629428 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 21:59:56.629428 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 21:59:56.629428 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 21:59:56.629428 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 21:59:56.629428 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 21:59:56.629428 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 21:59:56.629428 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 21:59:56.629428 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 21:59:56.629428 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c2d05fca-cb18-4999-8e19-b2bbb4b95bf1 could not be found. Oct 22 21:59:56.629428 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:59:56.629428 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:59:56.629428 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:59:56.629428 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:59:56.629428 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:59:56.629428 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:59:56.629428 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 21:59:56.629428 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 21:59:56.629428 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 21:59:56.629428 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 21:59:56.629428 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 21:59:56.629428 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 21:59:56.629428 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 21:59:56.629428 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 21:59:56.629428 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 21:59:56.629428 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 21:59:56.629428 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c2d05fca-cb18-4999-8e19-b2bbb4b95bf1 could not be found. Oct 22 21:59:56.629428 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:59:56.629428 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 21:59:56.629428 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:59:56.639975 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 21:59:56.639975 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 21:59:56.639975 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 21:59:56.639975 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 21:59:56.639975 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 21:59:56.639975 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c2d05fca-cb18-4999-8e19-b2bbb4b95bf1 could not be found. Oct 22 21:59:56.639975 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 21:59:56.639975 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-ecdd6c12-9924-43a7-8b8a-77a31e5845b0 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Returning 404 to user: Instance c2d05fca-cb18-4999-8e19-b2bbb4b95bf1 could not be found. {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 21:59:56.639975 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-ecdd6c12-9924-43a7-8b8a-77a31e5845b0 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] 10.222.0.18 "GET /compute/v2.1/servers/c2d05fca-cb18-4999-8e19-b2bbb4b95bf1" status: 404 len: 111 microversion: 2.1 time: 0.030607 Oct 22 21:59:56.639975 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3355/6679] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:59:56 2022] GET /compute/v2.1/servers/c2d05fca-cb18-4999-8e19-b2bbb4b95bf1 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 21:59:56.640825 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-765e2b80-7ed3-4554-9f26-d7c1db8a042e tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:59:56.640825 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-765e2b80-7ed3-4554-9f26-d7c1db8a042e tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] [instance: 347f4dea-4bac-4e96-a8e3-92396045052c] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:59:56.646803 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-765e2b80-7ed3-4554-9f26-d7c1db8a042e tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:59:56.647287 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-765e2b80-7ed3-4554-9f26-d7c1db8a042e tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:59:56.647746 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-765e2b80-7ed3-4554-9f26-d7c1db8a042e tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:59:56.648543 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-765e2b80-7ed3-4554-9f26-d7c1db8a042e tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:59:56.649046 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-765e2b80-7ed3-4554-9f26-d7c1db8a042e tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:59:56.649471 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-765e2b80-7ed3-4554-9f26-d7c1db8a042e tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:59:56.675671 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-765e2b80-7ed3-4554-9f26-d7c1db8a042e tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] [instance: 347f4dea-4bac-4e96-a8e3-92396045052c] Going to try to terminate instance {{(pid=138744) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 21:59:56.724577 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:59:56.760843 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-765e2b80-7ed3-4554-9f26-d7c1db8a042e tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] 10.222.0.18 "DELETE /compute/v2.1/servers/347f4dea-4bac-4e96-a8e3-92396045052c" status: 204 len: 0 microversion: 2.1 time: 0.124698 Oct 22 21:59:56.761570 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3325/6680] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 21:59:56 2022] DELETE /compute/v2.1/servers/347f4dea-4bac-4e96-a8e3-92396045052c => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 21:59:56.769965 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-83b23896-27df-4ecc-b1b4-53e0c3aad494 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:59:56.770594 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-83b23896-27df-4ecc-b1b4-53e0c3aad494 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] [instance: 347f4dea-4bac-4e96-a8e3-92396045052c] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:59:56.776972 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-83b23896-27df-4ecc-b1b4-53e0c3aad494 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:59:56.777478 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-83b23896-27df-4ecc-b1b4-53e0c3aad494 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:59:56.778173 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-83b23896-27df-4ecc-b1b4-53e0c3aad494 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:59:56.778881 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-83b23896-27df-4ecc-b1b4-53e0c3aad494 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:59:56.779376 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-83b23896-27df-4ecc-b1b4-53e0c3aad494 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:59:56.779826 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-83b23896-27df-4ecc-b1b4-53e0c3aad494 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:59:56.914032 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-83b23896-27df-4ecc-b1b4-53e0c3aad494 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fc72f4915c43a0b1a287e24bf72b83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd680f69971c745029f0f85e9d3dcb2e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:59:56.922592 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-83b23896-27df-4ecc-b1b4-53e0c3aad494 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] 10.222.0.18 "GET /compute/v2.1/servers/347f4dea-4bac-4e96-a8e3-92396045052c" status: 200 len: 1511 microversion: 2.1 time: 0.156593 Oct 22 21:59:56.923160 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3356/6681] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:59:56 2022] GET /compute/v2.1/servers/347f4dea-4bac-4e96-a8e3-92396045052c => generated 1511 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:59:57.951596 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-46916fa1-1c19-4cc0-9668-b8df40b32283 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:59:57.952747 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-46916fa1-1c19-4cc0-9668-b8df40b32283 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] [instance: 347f4dea-4bac-4e96-a8e3-92396045052c] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:59:57.963284 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-46916fa1-1c19-4cc0-9668-b8df40b32283 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:59:57.963773 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-46916fa1-1c19-4cc0-9668-b8df40b32283 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:59:57.964241 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-46916fa1-1c19-4cc0-9668-b8df40b32283 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:59:57.964949 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-46916fa1-1c19-4cc0-9668-b8df40b32283 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:59:57.965404 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-46916fa1-1c19-4cc0-9668-b8df40b32283 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:59:57.965836 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-46916fa1-1c19-4cc0-9668-b8df40b32283 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:59:58.102965 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-46916fa1-1c19-4cc0-9668-b8df40b32283 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fc72f4915c43a0b1a287e24bf72b83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd680f69971c745029f0f85e9d3dcb2e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:59:58.111191 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-46916fa1-1c19-4cc0-9668-b8df40b32283 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] 10.222.0.18 "GET /compute/v2.1/servers/347f4dea-4bac-4e96-a8e3-92396045052c" status: 200 len: 1511 microversion: 2.1 time: 0.167112 Oct 22 21:59:58.111842 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3326/6682] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:59:57 2022] GET /compute/v2.1/servers/347f4dea-4bac-4e96-a8e3-92396045052c => generated 1511 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 21:59:58.693998 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-1e07552c-e58d-43b7-a94b-5caa8f45f9fe req-b74a9ca7-517b-4133-9cda-1e9576305a12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "347f4dea-4bac-4e96-a8e3-92396045052c", "name": "network-vif-deleted", "tag": "ee6a403a-121b-4c73-be1f-26a52f89b6f1"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 21:59:58.705039 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-1e07552c-e58d-43b7-a94b-5caa8f45f9fe req-b74a9ca7-517b-4133-9cda-1e9576305a12 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:59:58.705524 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-1e07552c-e58d-43b7-a94b-5caa8f45f9fe req-b74a9ca7-517b-4133-9cda-1e9576305a12 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:59:58.705978 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-1e07552c-e58d-43b7-a94b-5caa8f45f9fe req-b74a9ca7-517b-4133-9cda-1e9576305a12 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:59:59.003398 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-1e07552c-e58d-43b7-a94b-5caa8f45f9fe req-b74a9ca7-517b-4133-9cda-1e9576305a12 service nova] Creating event network-vif-deleted:ee6a403a-121b-4c73-be1f-26a52f89b6f1 for instance 347f4dea-4bac-4e96-a8e3-92396045052c on nch1-master-1 Oct 22 21:59:59.008705 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-1e07552c-e58d-43b7-a94b-5caa8f45f9fe req-b74a9ca7-517b-4133-9cda-1e9576305a12 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.318515 Oct 22 21:59:59.009697 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3357/6683] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 21:59:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 21:59:59.138362 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-492870a2-d462-4242-8ab8-8077e7b2d1f5 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 21:59:59.139677 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-492870a2-d462-4242-8ab8-8077e7b2d1f5 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] [instance: 347f4dea-4bac-4e96-a8e3-92396045052c] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 21:59:59.151736 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-492870a2-d462-4242-8ab8-8077e7b2d1f5 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:59:59.152317 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-492870a2-d462-4242-8ab8-8077e7b2d1f5 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:59:59.152992 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-492870a2-d462-4242-8ab8-8077e7b2d1f5 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:59:59.153899 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-492870a2-d462-4242-8ab8-8077e7b2d1f5 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:59:59.154370 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-492870a2-d462-4242-8ab8-8077e7b2d1f5 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:59:59.154819 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-492870a2-d462-4242-8ab8-8077e7b2d1f5 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:59:59.191196 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-492870a2-d462-4242-8ab8-8077e7b2d1f5 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 21:59:59.191711 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-492870a2-d462-4242-8ab8-8077e7b2d1f5 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 21:59:59.192155 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-492870a2-d462-4242-8ab8-8077e7b2d1f5 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 21:59:59.192609 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.objects.instance [None req-492870a2-d462-4242-8ab8-8077e7b2d1f5 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Lazy-loading 'fault' on Instance uuid 347f4dea-4bac-4e96-a8e3-92396045052c {{(pid=138744) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 21:59:59.234271 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-492870a2-d462-4242-8ab8-8077e7b2d1f5 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fc72f4915c43a0b1a287e24bf72b83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd680f69971c745029f0f85e9d3dcb2e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 21:59:59.242413 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-492870a2-d462-4242-8ab8-8077e7b2d1f5 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] 10.222.0.18 "GET /compute/v2.1/servers/347f4dea-4bac-4e96-a8e3-92396045052c" status: 200 len: 1307 microversion: 2.1 time: 0.110379 Oct 22 21:59:59.242995 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3327/6684] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 21:59:59 2022] GET /compute/v2.1/servers/347f4dea-4bac-4e96-a8e3-92396045052c => generated 1307 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:00:00.273063 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-a2198df3-942b-4dc5-a020-9dd81ff42c29 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:00:00.274399 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-a2198df3-942b-4dc5-a020-9dd81ff42c29 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] [instance: 347f4dea-4bac-4e96-a8e3-92396045052c] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:00:00.281355 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a2198df3-942b-4dc5-a020-9dd81ff42c29 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:00:00.281909 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a2198df3-942b-4dc5-a020-9dd81ff42c29 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:00:00.282387 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a2198df3-942b-4dc5-a020-9dd81ff42c29 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:00:00.283278 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a2198df3-942b-4dc5-a020-9dd81ff42c29 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:00:00.283786 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a2198df3-942b-4dc5-a020-9dd81ff42c29 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:00:00.284242 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a2198df3-942b-4dc5-a020-9dd81ff42c29 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:00:00.298447 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.wsgi [None req-a2198df3-942b-4dc5-a020-9dd81ff42c29 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] HTTP exception thrown: Instance 347f4dea-4bac-4e96-a8e3-92396045052c could not be found. Oct 22 22:00:00.300155 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-a2198df3-942b-4dc5-a020-9dd81ff42c29 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Request method failure captured: Oct 22 22:00:00.300155 ncdv-master-1 devstack@n-api.service[138745]: request: GET /compute/v2.1/servers/347f4dea-4bac-4e96-a8e3-92396045052c HTTP/1.1 Oct 22 22:00:00.300155 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 22:00:00.300155 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 22:00:00.300155 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 22:00:00.300155 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 0 Oct 22 22:00:00.300155 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 22:00:00.300155 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 22:00:00.300155 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 22:00:00.300155 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 22:00:00.300155 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVGfASW9QdZCgX_5b3JZE7PaWxKvTyV3a-ju24MiXjJ2zc6YLMJ6aBka2_lJTasUXtojwbrp4vlhJHxqOekT04XphuA3YV3AYq6AKDy4ryqvhjsxAlIW8YLWMGCx40f4jLA3MrfDbQRSDgbrcsEytxcQnasDW4ujsofsuUOGU8SilXFM Oct 22 22:00:00.300155 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 22:00:00.300155 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 22:00:00.300155 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 22:00:00.300155 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 22:00:00.300155 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 22:00:00.300155 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 22:00:00.300155 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: d680f69971c745029f0f85e9d3dcb2e9 Oct 22 22:00:00.300155 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-ServersNegativeTestJSON-1724436144 Oct 22 22:00:00.300155 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 22:00:00.300155 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 22:00:00.300155 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_d680f69971c745029f0f85e9d3dcb2e9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d680f69971c745029f0f85e9d3dcb2e9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/d680f69971c745029f0f85e9d3dcb2e9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d680f69971c745029f0f85e9d3dcb2e9"}]}] Oct 22 22:00:00.300155 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-ServersNegativeTestJSON-1724436144 Oct 22 22:00:00.300155 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: d680f69971c745029f0f85e9d3dcb2e9 Oct 22 22:00:00.300155 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1724436144 Oct 22 22:00:00.300155 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-ServersNegativeTestJSON-1724436144-project Oct 22 22:00:00.300155 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 22:00:00.300155 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 22:00:00.300155 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: e8fc72f4915c43a0b1a287e24bf72b83 Oct 22 22:00:00.300155 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-ServersNegativeTestJSON-1724436144-project Oct 22 22:00:00.300155 ncdv-master-1 devstack@n-api.service[138745]: method: > Oct 22 22:00:00.300155 ncdv-master-1 devstack@n-api.service[138745]: exception: Instance 347f4dea-4bac-4e96-a8e3-92396045052c could not be found. Oct 22 22:00:00.300155 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'id': '347f4dea-4bac-4e96-a8e3-92396045052c'} Oct 22 22:00:00.300155 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 22:00:00.300155 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 22:00:00.300155 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 22:00:00.300155 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 22:00:00.300155 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 22:00:00.300155 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 22:00:00.300155 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 22:00:00.300155 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 22:00:00.300155 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 22:00:00.300155 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 22:00:00.300155 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 347f4dea-4bac-4e96-a8e3-92396045052c could not be found. Oct 22 22:00:00.300155 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 22:00:00.300155 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 22:00:00.300155 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 22:00:00.300155 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 22:00:00.300155 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 22:00:00.300155 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 22:00:00.300155 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 22:00:00.300155 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 22:00:00.300155 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 22:00:00.300155 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 22:00:00.300155 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 22:00:00.300155 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 22:00:00.300155 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 22:00:00.300155 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 22:00:00.300155 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 22:00:00.300155 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 22:00:00.300155 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 347f4dea-4bac-4e96-a8e3-92396045052c could not be found. Oct 22 22:00:00.300155 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 22:00:00.300155 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 22:00:00.300155 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 22:00:00.305154 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 22:00:00.305154 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 22:00:00.305154 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 22:00:00.305154 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 22:00:00.305154 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 22:00:00.305154 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 347f4dea-4bac-4e96-a8e3-92396045052c could not be found. Oct 22 22:00:00.305154 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 22:00:00.305154 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-a2198df3-942b-4dc5-a020-9dd81ff42c29 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] Returning 404 to user: Instance 347f4dea-4bac-4e96-a8e3-92396045052c could not be found. {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 22:00:00.305154 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-a2198df3-942b-4dc5-a020-9dd81ff42c29 tempest-ServersNegativeTestJSON-1724436144 tempest-ServersNegativeTestJSON-1724436144-project] 10.222.0.18 "GET /compute/v2.1/servers/347f4dea-4bac-4e96-a8e3-92396045052c" status: 404 len: 111 microversion: 2.1 time: 0.037262 Oct 22 22:00:00.305154 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3358/6685] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:00:00 2022] GET /compute/v2.1/servers/347f4dea-4bac-4e96-a8e3-92396045052c => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 22:00:41.325179 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-2794d2d6-7db8-4d36-b080-f47724e12dcc tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Action: 'create', calling method: .version_select at 0x7fd39eda91f0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-402786637", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDFumueiXUcdoSqfSGeCTMRJKy1VMUlzC6e341m+pxN/S+sEsZtiUOGJVhtvVMXQ8vGkZfsJa1MyXPihQkpk6Xrl1dhqOegUnlHrcIRVuS8qLk2gI/fywWMGR3ophXPNLw=="}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 22:00:41.331540 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:00:41.332208 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:SELECT=15,nova_cell1:INSERT=1 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:00:41.347673 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-2794d2d6-7db8-4d36-b080-f47724e12dcc tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Getting quotas for project aa75a4498a814ecc86698d0ddac01c2f. Resources: {'key_pairs'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 22:00:41.353398 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-2794d2d6-7db8-4d36-b080-f47724e12dcc tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Getting quotas for user 9adcc8a95203462ea78164d4db440351 and project aa75a4498a814ecc86698d0ddac01c2f. Resources: {'key_pairs'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 22:00:41.380841 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-2794d2d6-7db8-4d36-b080-f47724e12dcc tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.059597 Oct 22 22:00:41.381396 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3328/6686] 10.222.0.18 () {60 vars in 1159 bytes} [Sat Oct 22 22:00:41 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 22:00:41.448366 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-5463afd0-905a-48d2-abef-ec00af237391 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1912287690", "imageRef": "2e05de9e-5ad5-4d53-849c-d00e56c723b9", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-402786637", "networks": [{"uuid": "20f4a418-66b7-42d9-9ee5-f0791ece1b14"}]}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 22:00:41.457856 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:00:41.458515 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell1:SELECT=28 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:00:41.504122 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.network.neutron [None req-5463afd0-905a-48d2-abef-ec00af237391 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] validate_networks() for [('20f4a418-66b7-42d9-9ee5-f0791ece1b14', None, None, None, None, None)] {{(pid=138745) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 22:00:41.891882 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-5463afd0-905a-48d2-abef-ec00af237391 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Flavor limits 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 22:00:41.892384 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-5463afd0-905a-48d2-abef-ec00af237391 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Image limits 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 22:00:41.892884 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-5463afd0-905a-48d2-abef-ec00af237391 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Flavor pref 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 22:00:41.893423 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-5463afd0-905a-48d2-abef-ec00af237391 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Image pref 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 22:00:41.894147 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-5463afd0-905a-48d2-abef-ec00af237391 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 22:00:41.910107 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5463afd0-905a-48d2-abef-ec00af237391 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:00:41.910794 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5463afd0-905a-48d2-abef-ec00af237391 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:00:41.911405 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5463afd0-905a-48d2-abef-ec00af237391 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:00:41.912421 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5463afd0-905a-48d2-abef-ec00af237391 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:00:41.913097 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5463afd0-905a-48d2-abef-ec00af237391 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:00:41.913731 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5463afd0-905a-48d2-abef-ec00af237391 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:00:41.932687 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-5463afd0-905a-48d2-abef-ec00af237391 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Getting quotas for project aa75a4498a814ecc86698d0ddac01c2f. Resources: {'cores', 'instances', 'ram'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 22:00:41.938399 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-5463afd0-905a-48d2-abef-ec00af237391 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Getting quotas for user 9adcc8a95203462ea78164d4db440351 and project aa75a4498a814ecc86698d0ddac01c2f. Resources: {'cores', 'instances', 'ram'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 22:00:41.951790 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-5463afd0-905a-48d2-abef-ec00af237391 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Going to run 1 instances... {{(pid=138745) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 22:00:41.954086 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-5463afd0-905a-48d2-abef-ec00af237391 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] [instance: 7c7999e0-b905-49f8-9f2b-436ef72096da] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2e05de9e-5ad5-4d53-849c-d00e56c723b9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138745) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 22:00:42.011465 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-5463afd0-905a-48d2-abef-ec00af237391 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.567308 Oct 22 22:00:42.012112 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3359/6687] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Oct 22 22:00:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 569 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 22:00:42.023171 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-9ccd264a-8e05-4d3a-8eaf-416ff9859a18 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:00:42.023830 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-9ccd264a-8e05-4d3a-8eaf-416ff9859a18 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] [instance: 7c7999e0-b905-49f8-9f2b-436ef72096da] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:00:42.088133 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-9ccd264a-8e05-4d3a-8eaf-416ff9859a18 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9adcc8a95203462ea78164d4db440351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa75a4498a814ecc86698d0ddac01c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:00:42.095827 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-9ccd264a-8e05-4d3a-8eaf-416ff9859a18 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] 10.222.0.18 "GET /compute/v2.1/servers/7c7999e0-b905-49f8-9f2b-436ef72096da" status: 200 len: 1258 microversion: 2.1 time: 0.076577 Oct 22 22:00:42.096601 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3329/6688] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:00:42 2022] GET /compute/v2.1/servers/7c7999e0-b905-49f8-9f2b-436ef72096da => generated 1258 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:00:43.122737 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-34dbbebe-3eea-4336-9216-9dcb62f3a2b9 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:00:43.124097 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-34dbbebe-3eea-4336-9216-9dcb62f3a2b9 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] [instance: 7c7999e0-b905-49f8-9f2b-436ef72096da] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:00:43.131308 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-34dbbebe-3eea-4336-9216-9dcb62f3a2b9 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:00:43.132168 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-34dbbebe-3eea-4336-9216-9dcb62f3a2b9 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:00:43.132680 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-34dbbebe-3eea-4336-9216-9dcb62f3a2b9 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:00:43.133467 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-34dbbebe-3eea-4336-9216-9dcb62f3a2b9 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:00:43.134019 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-34dbbebe-3eea-4336-9216-9dcb62f3a2b9 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:00:43.134465 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-34dbbebe-3eea-4336-9216-9dcb62f3a2b9 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:00:43.197395 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-34dbbebe-3eea-4336-9216-9dcb62f3a2b9 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9adcc8a95203462ea78164d4db440351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa75a4498a814ecc86698d0ddac01c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:00:43.205905 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-34dbbebe-3eea-4336-9216-9dcb62f3a2b9 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] 10.222.0.18 "GET /compute/v2.1/servers/7c7999e0-b905-49f8-9f2b-436ef72096da" status: 200 len: 1328 microversion: 2.1 time: 0.089006 Oct 22 22:00:43.206592 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3360/6689] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:00:43 2022] GET /compute/v2.1/servers/7c7999e0-b905-49f8-9f2b-436ef72096da => generated 1328 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:00:44.230071 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-c6fbb97f-3b5b-451a-881d-14f295a65baf tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:00:44.230843 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-c6fbb97f-3b5b-451a-881d-14f295a65baf tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] [instance: 7c7999e0-b905-49f8-9f2b-436ef72096da] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:00:44.242535 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c6fbb97f-3b5b-451a-881d-14f295a65baf tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:00:44.243656 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c6fbb97f-3b5b-451a-881d-14f295a65baf tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:00:44.244747 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c6fbb97f-3b5b-451a-881d-14f295a65baf tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:00:44.245772 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c6fbb97f-3b5b-451a-881d-14f295a65baf tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:00:44.246458 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c6fbb97f-3b5b-451a-881d-14f295a65baf tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:00:44.247121 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c6fbb97f-3b5b-451a-881d-14f295a65baf tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:00:44.401023 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-c6fbb97f-3b5b-451a-881d-14f295a65baf tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9adcc8a95203462ea78164d4db440351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa75a4498a814ecc86698d0ddac01c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:00:44.409248 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-c6fbb97f-3b5b-451a-881d-14f295a65baf tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] 10.222.0.18 "GET /compute/v2.1/servers/7c7999e0-b905-49f8-9f2b-436ef72096da" status: 200 len: 1358 microversion: 2.1 time: 0.183315 Oct 22 22:00:44.410170 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3330/6690] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:00:44 2022] GET /compute/v2.1/servers/7c7999e0-b905-49f8-9f2b-436ef72096da => generated 1358 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:00:45.433692 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-9154ee56-bb39-41f2-84bd-86f54c7b693b tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:00:45.434369 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-9154ee56-bb39-41f2-84bd-86f54c7b693b tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] [instance: 7c7999e0-b905-49f8-9f2b-436ef72096da] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:00:45.441785 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9154ee56-bb39-41f2-84bd-86f54c7b693b tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:00:45.442305 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9154ee56-bb39-41f2-84bd-86f54c7b693b tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:00:45.442767 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9154ee56-bb39-41f2-84bd-86f54c7b693b tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:00:45.443545 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9154ee56-bb39-41f2-84bd-86f54c7b693b tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:00:45.443988 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9154ee56-bb39-41f2-84bd-86f54c7b693b tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:00:45.444655 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9154ee56-bb39-41f2-84bd-86f54c7b693b tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:00:45.591054 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-9154ee56-bb39-41f2-84bd-86f54c7b693b tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9adcc8a95203462ea78164d4db440351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa75a4498a814ecc86698d0ddac01c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:00:45.600065 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-9154ee56-bb39-41f2-84bd-86f54c7b693b tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] 10.222.0.18 "GET /compute/v2.1/servers/7c7999e0-b905-49f8-9f2b-436ef72096da" status: 200 len: 1358 microversion: 2.1 time: 0.170358 Oct 22 22:00:45.601386 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3361/6691] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:00:45 2022] GET /compute/v2.1/servers/7c7999e0-b905-49f8-9f2b-436ef72096da => generated 1358 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:00:46.623108 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-1a35ca83-1175-4fe7-ac0a-13b8e4c57411 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:00:46.623956 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-1a35ca83-1175-4fe7-ac0a-13b8e4c57411 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] [instance: 7c7999e0-b905-49f8-9f2b-436ef72096da] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:00:46.631509 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1a35ca83-1175-4fe7-ac0a-13b8e4c57411 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:00:46.632091 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1a35ca83-1175-4fe7-ac0a-13b8e4c57411 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:00:46.632614 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1a35ca83-1175-4fe7-ac0a-13b8e4c57411 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:00:46.633388 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1a35ca83-1175-4fe7-ac0a-13b8e4c57411 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:00:46.633861 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1a35ca83-1175-4fe7-ac0a-13b8e4c57411 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:00:46.634403 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1a35ca83-1175-4fe7-ac0a-13b8e4c57411 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:00:46.784354 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-1a35ca83-1175-4fe7-ac0a-13b8e4c57411 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9adcc8a95203462ea78164d4db440351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa75a4498a814ecc86698d0ddac01c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:00:46.792579 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-1a35ca83-1175-4fe7-ac0a-13b8e4c57411 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] 10.222.0.18 "GET /compute/v2.1/servers/7c7999e0-b905-49f8-9f2b-436ef72096da" status: 200 len: 1358 microversion: 2.1 time: 0.173513 Oct 22 22:00:46.793246 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3331/6692] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:00:46 2022] GET /compute/v2.1/servers/7c7999e0-b905-49f8-9f2b-436ef72096da => generated 1358 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:00:47.816362 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-758c82c7-432f-414c-ab19-8fc570267834 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:00:47.818275 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-758c82c7-432f-414c-ab19-8fc570267834 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] [instance: 7c7999e0-b905-49f8-9f2b-436ef72096da] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:00:47.826851 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-758c82c7-432f-414c-ab19-8fc570267834 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:00:47.828212 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-758c82c7-432f-414c-ab19-8fc570267834 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:00:47.828933 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-758c82c7-432f-414c-ab19-8fc570267834 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:00:47.830133 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-758c82c7-432f-414c-ab19-8fc570267834 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:00:47.830704 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-758c82c7-432f-414c-ab19-8fc570267834 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:00:47.831218 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-758c82c7-432f-414c-ab19-8fc570267834 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:00:47.967947 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-758c82c7-432f-414c-ab19-8fc570267834 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9adcc8a95203462ea78164d4db440351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa75a4498a814ecc86698d0ddac01c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:00:47.978933 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-758c82c7-432f-414c-ab19-8fc570267834 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] 10.222.0.18 "GET /compute/v2.1/servers/7c7999e0-b905-49f8-9f2b-436ef72096da" status: 200 len: 1358 microversion: 2.1 time: 0.166597 Oct 22 22:00:47.979808 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3362/6693] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:00:47 2022] GET /compute/v2.1/servers/7c7999e0-b905-49f8-9f2b-436ef72096da => generated 1358 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:00:49.002266 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-ffe863e9-026c-4a66-bcaa-4eed6b98139f tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:00:49.002923 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-ffe863e9-026c-4a66-bcaa-4eed6b98139f tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] [instance: 7c7999e0-b905-49f8-9f2b-436ef72096da] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:00:49.010066 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ffe863e9-026c-4a66-bcaa-4eed6b98139f tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:00:49.010558 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ffe863e9-026c-4a66-bcaa-4eed6b98139f tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:00:49.010995 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ffe863e9-026c-4a66-bcaa-4eed6b98139f tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:00:49.011744 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ffe863e9-026c-4a66-bcaa-4eed6b98139f tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:00:49.012199 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ffe863e9-026c-4a66-bcaa-4eed6b98139f tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:00:49.012728 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ffe863e9-026c-4a66-bcaa-4eed6b98139f tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:00:49.158459 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-ffe863e9-026c-4a66-bcaa-4eed6b98139f tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9adcc8a95203462ea78164d4db440351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa75a4498a814ecc86698d0ddac01c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:00:49.169275 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-ffe863e9-026c-4a66-bcaa-4eed6b98139f tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] 10.222.0.18 "GET /compute/v2.1/servers/7c7999e0-b905-49f8-9f2b-436ef72096da" status: 200 len: 1358 microversion: 2.1 time: 0.170707 Oct 22 22:00:49.170338 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3332/6694] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:00:48 2022] GET /compute/v2.1/servers/7c7999e0-b905-49f8-9f2b-436ef72096da => generated 1358 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:00:50.192478 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-e2463f8b-74f0-46e7-8842-762d995dd4e4 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:00:50.193228 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-e2463f8b-74f0-46e7-8842-762d995dd4e4 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] [instance: 7c7999e0-b905-49f8-9f2b-436ef72096da] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:00:50.200165 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e2463f8b-74f0-46e7-8842-762d995dd4e4 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:00:50.200662 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e2463f8b-74f0-46e7-8842-762d995dd4e4 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:00:50.201345 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e2463f8b-74f0-46e7-8842-762d995dd4e4 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:00:50.201868 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e2463f8b-74f0-46e7-8842-762d995dd4e4 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:00:50.202310 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e2463f8b-74f0-46e7-8842-762d995dd4e4 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:00:50.202792 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e2463f8b-74f0-46e7-8842-762d995dd4e4 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:00:50.340080 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-e2463f8b-74f0-46e7-8842-762d995dd4e4 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9adcc8a95203462ea78164d4db440351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa75a4498a814ecc86698d0ddac01c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:00:50.348434 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-e2463f8b-74f0-46e7-8842-762d995dd4e4 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] 10.222.0.18 "GET /compute/v2.1/servers/7c7999e0-b905-49f8-9f2b-436ef72096da" status: 200 len: 1358 microversion: 2.1 time: 0.159883 Oct 22 22:00:50.349221 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3363/6695] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:00:50 2022] GET /compute/v2.1/servers/7c7999e0-b905-49f8-9f2b-436ef72096da => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:00:51.375083 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-c35d186b-1de8-4d80-a9a8-26d1d2ca844f tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:00:51.376167 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-c35d186b-1de8-4d80-a9a8-26d1d2ca844f tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] [instance: 7c7999e0-b905-49f8-9f2b-436ef72096da] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:00:51.386652 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c35d186b-1de8-4d80-a9a8-26d1d2ca844f tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:00:51.387142 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c35d186b-1de8-4d80-a9a8-26d1d2ca844f tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:00:51.387614 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c35d186b-1de8-4d80-a9a8-26d1d2ca844f tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:00:51.388313 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c35d186b-1de8-4d80-a9a8-26d1d2ca844f tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:00:51.388765 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c35d186b-1de8-4d80-a9a8-26d1d2ca844f tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:00:51.389198 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c35d186b-1de8-4d80-a9a8-26d1d2ca844f tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:00:51.534662 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-c35d186b-1de8-4d80-a9a8-26d1d2ca844f tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9adcc8a95203462ea78164d4db440351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa75a4498a814ecc86698d0ddac01c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:00:51.543990 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-c35d186b-1de8-4d80-a9a8-26d1d2ca844f tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] 10.222.0.18 "GET /compute/v2.1/servers/7c7999e0-b905-49f8-9f2b-436ef72096da" status: 200 len: 1358 microversion: 2.1 time: 0.175652 Oct 22 22:00:51.544582 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3333/6696] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:00:51 2022] GET /compute/v2.1/servers/7c7999e0-b905-49f8-9f2b-436ef72096da => generated 1358 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:00:52.572075 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-39933fcf-4157-4b09-95cf-03de36d95594 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:00:52.573257 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-39933fcf-4157-4b09-95cf-03de36d95594 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] [instance: 7c7999e0-b905-49f8-9f2b-436ef72096da] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:00:52.577506 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell0:SELECT=2 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:00:52.578846 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell0:SELECT=6 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:00:52.588379 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-39933fcf-4157-4b09-95cf-03de36d95594 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:00:52.588893 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-39933fcf-4157-4b09-95cf-03de36d95594 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:00:52.589349 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-39933fcf-4157-4b09-95cf-03de36d95594 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:00:52.590078 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-39933fcf-4157-4b09-95cf-03de36d95594 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:00:52.590556 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-39933fcf-4157-4b09-95cf-03de36d95594 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:00:52.591010 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-39933fcf-4157-4b09-95cf-03de36d95594 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:00:52.730177 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-39933fcf-4157-4b09-95cf-03de36d95594 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9adcc8a95203462ea78164d4db440351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa75a4498a814ecc86698d0ddac01c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:00:52.738463 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-39933fcf-4157-4b09-95cf-03de36d95594 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] 10.222.0.18 "GET /compute/v2.1/servers/7c7999e0-b905-49f8-9f2b-436ef72096da" status: 200 len: 1358 microversion: 2.1 time: 0.173047 Oct 22 22:00:52.739079 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3364/6697] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:00:52 2022] GET /compute/v2.1/servers/7c7999e0-b905-49f8-9f2b-436ef72096da => generated 1358 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:00:53.762330 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-05635d98-8a19-40e6-a00b-e9c200a03786 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:00:53.762936 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-05635d98-8a19-40e6-a00b-e9c200a03786 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] [instance: 7c7999e0-b905-49f8-9f2b-436ef72096da] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:00:53.764936 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell0:SELECT=6 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:00:53.771020 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-05635d98-8a19-40e6-a00b-e9c200a03786 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:00:53.771535 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-05635d98-8a19-40e6-a00b-e9c200a03786 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:00:53.771987 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-05635d98-8a19-40e6-a00b-e9c200a03786 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:00:53.772728 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-05635d98-8a19-40e6-a00b-e9c200a03786 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:00:53.773176 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-05635d98-8a19-40e6-a00b-e9c200a03786 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:00:53.773677 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-05635d98-8a19-40e6-a00b-e9c200a03786 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:00:53.913922 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-05635d98-8a19-40e6-a00b-e9c200a03786 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9adcc8a95203462ea78164d4db440351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa75a4498a814ecc86698d0ddac01c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:00:53.922225 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-05635d98-8a19-40e6-a00b-e9c200a03786 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] 10.222.0.18 "GET /compute/v2.1/servers/7c7999e0-b905-49f8-9f2b-436ef72096da" status: 200 len: 1358 microversion: 2.1 time: 0.163907 Oct 22 22:00:53.922996 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3334/6698] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:00:53 2022] GET /compute/v2.1/servers/7c7999e0-b905-49f8-9f2b-436ef72096da => generated 1358 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:00:54.163498 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-9355599b-3d0d-4f2b-bcc7-b31663702fff req-b9f4c97b-be9a-435e-9408-c2dd3db1f985 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c7999e0-b905-49f8-9f2b-436ef72096da", "tag": "e2c82c04-c60d-4fab-a4bd-5b0f1148a4c4"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 22:00:54.174505 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-9355599b-3d0d-4f2b-bcc7-b31663702fff req-b9f4c97b-be9a-435e-9408-c2dd3db1f985 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:00:54.174983 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-9355599b-3d0d-4f2b-bcc7-b31663702fff req-b9f4c97b-be9a-435e-9408-c2dd3db1f985 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:00:54.175492 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-9355599b-3d0d-4f2b-bcc7-b31663702fff req-b9f4c97b-be9a-435e-9408-c2dd3db1f985 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:00:54.186966 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-9355599b-3d0d-4f2b-bcc7-b31663702fff req-b9f4c97b-be9a-435e-9408-c2dd3db1f985 service nova] Creating event network-changed:e2c82c04-c60d-4fab-a4bd-5b0f1148a4c4 for instance 7c7999e0-b905-49f8-9f2b-436ef72096da on nch1-master-1 Oct 22 22:00:54.192236 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-9355599b-3d0d-4f2b-bcc7-b31663702fff req-b9f4c97b-be9a-435e-9408-c2dd3db1f985 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032574 Oct 22 22:00:54.193061 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3365/6699] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 22:00:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 22:00:54.949380 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-f97efc60-5ff8-4d37-bb0c-85d63c4b6249 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:00:54.951743 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-f97efc60-5ff8-4d37-bb0c-85d63c4b6249 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] [instance: 7c7999e0-b905-49f8-9f2b-436ef72096da] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:00:54.963724 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f97efc60-5ff8-4d37-bb0c-85d63c4b6249 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:00:54.964398 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f97efc60-5ff8-4d37-bb0c-85d63c4b6249 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:00:54.964857 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f97efc60-5ff8-4d37-bb0c-85d63c4b6249 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:00:54.965573 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f97efc60-5ff8-4d37-bb0c-85d63c4b6249 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:00:54.966037 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f97efc60-5ff8-4d37-bb0c-85d63c4b6249 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:00:54.966815 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f97efc60-5ff8-4d37-bb0c-85d63c4b6249 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:00:55.101355 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-f97efc60-5ff8-4d37-bb0c-85d63c4b6249 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9adcc8a95203462ea78164d4db440351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa75a4498a814ecc86698d0ddac01c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:00:55.109384 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-f97efc60-5ff8-4d37-bb0c-85d63c4b6249 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] 10.222.0.18 "GET /compute/v2.1/servers/7c7999e0-b905-49f8-9f2b-436ef72096da" status: 200 len: 1358 microversion: 2.1 time: 0.166860 Oct 22 22:00:55.109953 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3335/6700] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:00:54 2022] GET /compute/v2.1/servers/7c7999e0-b905-49f8-9f2b-436ef72096da => generated 1358 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:00:56.134205 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-1544b0f1-50c2-4ac4-a7e5-00bea056b504 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:00:56.134923 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-1544b0f1-50c2-4ac4-a7e5-00bea056b504 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] [instance: 7c7999e0-b905-49f8-9f2b-436ef72096da] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:00:56.141830 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1544b0f1-50c2-4ac4-a7e5-00bea056b504 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:00:56.142333 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1544b0f1-50c2-4ac4-a7e5-00bea056b504 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:00:56.142784 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1544b0f1-50c2-4ac4-a7e5-00bea056b504 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:00:56.143519 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1544b0f1-50c2-4ac4-a7e5-00bea056b504 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:00:56.143991 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1544b0f1-50c2-4ac4-a7e5-00bea056b504 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:00:56.144478 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1544b0f1-50c2-4ac4-a7e5-00bea056b504 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:00:56.278400 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-1544b0f1-50c2-4ac4-a7e5-00bea056b504 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9adcc8a95203462ea78164d4db440351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa75a4498a814ecc86698d0ddac01c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:00:56.286611 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-1544b0f1-50c2-4ac4-a7e5-00bea056b504 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] 10.222.0.18 "GET /compute/v2.1/servers/7c7999e0-b905-49f8-9f2b-436ef72096da" status: 200 len: 1358 microversion: 2.1 time: 0.157649 Oct 22 22:00:56.287186 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3366/6701] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:00:56 2022] GET /compute/v2.1/servers/7c7999e0-b905-49f8-9f2b-436ef72096da => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:00:57.312664 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-cffbe0e1-7c1a-4947-a097-0a2cb85e8108 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:00:57.313604 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-cffbe0e1-7c1a-4947-a097-0a2cb85e8108 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] [instance: 7c7999e0-b905-49f8-9f2b-436ef72096da] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:00:57.323891 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cffbe0e1-7c1a-4947-a097-0a2cb85e8108 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:00:57.324596 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cffbe0e1-7c1a-4947-a097-0a2cb85e8108 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:00:57.325217 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cffbe0e1-7c1a-4947-a097-0a2cb85e8108 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:00:57.326354 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cffbe0e1-7c1a-4947-a097-0a2cb85e8108 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:00:57.326855 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cffbe0e1-7c1a-4947-a097-0a2cb85e8108 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:00:57.327288 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cffbe0e1-7c1a-4947-a097-0a2cb85e8108 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:00:57.472777 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-cffbe0e1-7c1a-4947-a097-0a2cb85e8108 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9adcc8a95203462ea78164d4db440351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa75a4498a814ecc86698d0ddac01c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:00:57.484324 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-cffbe0e1-7c1a-4947-a097-0a2cb85e8108 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] 10.222.0.18 "GET /compute/v2.1/servers/7c7999e0-b905-49f8-9f2b-436ef72096da" status: 200 len: 1358 microversion: 2.1 time: 0.177350 Oct 22 22:00:57.484905 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3336/6702] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:00:57 2022] GET /compute/v2.1/servers/7c7999e0-b905-49f8-9f2b-436ef72096da => generated 1358 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:00:58.512067 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-6707ccd1-71fc-4a9f-90d8-c2247195aae9 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:00:58.513038 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-6707ccd1-71fc-4a9f-90d8-c2247195aae9 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] [instance: 7c7999e0-b905-49f8-9f2b-436ef72096da] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:00:58.525818 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6707ccd1-71fc-4a9f-90d8-c2247195aae9 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:00:58.526698 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6707ccd1-71fc-4a9f-90d8-c2247195aae9 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:00:58.527507 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6707ccd1-71fc-4a9f-90d8-c2247195aae9 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:00:58.528794 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6707ccd1-71fc-4a9f-90d8-c2247195aae9 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:00:58.529586 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6707ccd1-71fc-4a9f-90d8-c2247195aae9 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:00:58.530330 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6707ccd1-71fc-4a9f-90d8-c2247195aae9 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:00:58.669846 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-6707ccd1-71fc-4a9f-90d8-c2247195aae9 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9adcc8a95203462ea78164d4db440351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa75a4498a814ecc86698d0ddac01c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:00:58.678040 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-6707ccd1-71fc-4a9f-90d8-c2247195aae9 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] 10.222.0.18 "GET /compute/v2.1/servers/7c7999e0-b905-49f8-9f2b-436ef72096da" status: 200 len: 1358 microversion: 2.1 time: 0.173008 Oct 22 22:00:58.678610 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3367/6703] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:00:58 2022] GET /compute/v2.1/servers/7c7999e0-b905-49f8-9f2b-436ef72096da => generated 1358 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:00:59.701493 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-190f85fc-3d44-4c26-bde4-b538f4e715ff tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:00:59.702065 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-190f85fc-3d44-4c26-bde4-b538f4e715ff tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] [instance: 7c7999e0-b905-49f8-9f2b-436ef72096da] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:00:59.709408 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-190f85fc-3d44-4c26-bde4-b538f4e715ff tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:00:59.709896 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-190f85fc-3d44-4c26-bde4-b538f4e715ff tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:00:59.710336 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-190f85fc-3d44-4c26-bde4-b538f4e715ff tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:00:59.711066 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-190f85fc-3d44-4c26-bde4-b538f4e715ff tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:00:59.711539 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-190f85fc-3d44-4c26-bde4-b538f4e715ff tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:00:59.711966 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-190f85fc-3d44-4c26-bde4-b538f4e715ff tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:00:59.852448 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-190f85fc-3d44-4c26-bde4-b538f4e715ff tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9adcc8a95203462ea78164d4db440351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa75a4498a814ecc86698d0ddac01c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:00:59.862588 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-190f85fc-3d44-4c26-bde4-b538f4e715ff tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] 10.222.0.18 "GET /compute/v2.1/servers/7c7999e0-b905-49f8-9f2b-436ef72096da" status: 200 len: 1358 microversion: 2.1 time: 0.165069 Oct 22 22:00:59.863186 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3337/6704] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:00:59 2022] GET /compute/v2.1/servers/7c7999e0-b905-49f8-9f2b-436ef72096da => generated 1358 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:01:00.886962 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-f78bc3e7-2bdc-4e4e-8494-a7e3c2729d48 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:01:00.887886 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-f78bc3e7-2bdc-4e4e-8494-a7e3c2729d48 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] [instance: 7c7999e0-b905-49f8-9f2b-436ef72096da] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:01:00.895302 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f78bc3e7-2bdc-4e4e-8494-a7e3c2729d48 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:01:00.895830 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f78bc3e7-2bdc-4e4e-8494-a7e3c2729d48 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:01:00.896281 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f78bc3e7-2bdc-4e4e-8494-a7e3c2729d48 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:01:00.896981 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f78bc3e7-2bdc-4e4e-8494-a7e3c2729d48 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:01:00.897447 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f78bc3e7-2bdc-4e4e-8494-a7e3c2729d48 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:01:00.897908 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f78bc3e7-2bdc-4e4e-8494-a7e3c2729d48 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:01:01.056313 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-f78bc3e7-2bdc-4e4e-8494-a7e3c2729d48 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9adcc8a95203462ea78164d4db440351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa75a4498a814ecc86698d0ddac01c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:01:01.066124 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-f78bc3e7-2bdc-4e4e-8494-a7e3c2729d48 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] 10.222.0.18 "GET /compute/v2.1/servers/7c7999e0-b905-49f8-9f2b-436ef72096da" status: 200 len: 1358 microversion: 2.1 time: 0.182801 Oct 22 22:01:01.066770 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3368/6705] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:01:00 2022] GET /compute/v2.1/servers/7c7999e0-b905-49f8-9f2b-436ef72096da => generated 1358 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:01:01.639783 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-a462ebf0-53da-47a6-9595-cf4ea0e1e1d1 req-e4402ff5-bcf2-4b71-96de-268736707bef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c7999e0-b905-49f8-9f2b-436ef72096da", "name": "network-vif-plugged", "status": "completed", "tag": "e2c82c04-c60d-4fab-a4bd-5b0f1148a4c4"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 22:01:01.651639 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-a462ebf0-53da-47a6-9595-cf4ea0e1e1d1 req-e4402ff5-bcf2-4b71-96de-268736707bef service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:01:01.652265 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-a462ebf0-53da-47a6-9595-cf4ea0e1e1d1 req-e4402ff5-bcf2-4b71-96de-268736707bef service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:01:01.652565 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-a462ebf0-53da-47a6-9595-cf4ea0e1e1d1 req-e4402ff5-bcf2-4b71-96de-268736707bef service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:01:01.664896 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-a462ebf0-53da-47a6-9595-cf4ea0e1e1d1 req-e4402ff5-bcf2-4b71-96de-268736707bef service nova] Creating event network-vif-plugged:e2c82c04-c60d-4fab-a4bd-5b0f1148a4c4 for instance 7c7999e0-b905-49f8-9f2b-436ef72096da on nch1-master-1 Oct 22 22:01:01.670365 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-a462ebf0-53da-47a6-9595-cf4ea0e1e1d1 req-e4402ff5-bcf2-4b71-96de-268736707bef service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034568 Oct 22 22:01:01.670927 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3338/6706] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 22:01:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 22:01:02.096925 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-12ae3b2f-c9ce-494d-ae90-9ab6fb5ee9c3 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:01:02.097859 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-12ae3b2f-c9ce-494d-ae90-9ab6fb5ee9c3 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] [instance: 7c7999e0-b905-49f8-9f2b-436ef72096da] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:01:02.110055 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-12ae3b2f-c9ce-494d-ae90-9ab6fb5ee9c3 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:01:02.110586 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-12ae3b2f-c9ce-494d-ae90-9ab6fb5ee9c3 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:01:02.111037 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-12ae3b2f-c9ce-494d-ae90-9ab6fb5ee9c3 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:01:02.111800 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-12ae3b2f-c9ce-494d-ae90-9ab6fb5ee9c3 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:01:02.112303 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-12ae3b2f-c9ce-494d-ae90-9ab6fb5ee9c3 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:01:02.112729 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-12ae3b2f-c9ce-494d-ae90-9ab6fb5ee9c3 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:01:02.244870 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-12ae3b2f-c9ce-494d-ae90-9ab6fb5ee9c3 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9adcc8a95203462ea78164d4db440351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa75a4498a814ecc86698d0ddac01c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:01:02.253029 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-12ae3b2f-c9ce-494d-ae90-9ab6fb5ee9c3 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] 10.222.0.18 "GET /compute/v2.1/servers/7c7999e0-b905-49f8-9f2b-436ef72096da" status: 200 len: 1358 microversion: 2.1 time: 0.165043 Oct 22 22:01:02.253653 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3369/6707] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:01:02 2022] GET /compute/v2.1/servers/7c7999e0-b905-49f8-9f2b-436ef72096da => generated 1358 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:01:03.290358 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-fa1795fc-8570-46b6-82d3-03793c2aa783 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:01:03.291162 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-fa1795fc-8570-46b6-82d3-03793c2aa783 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] [instance: 7c7999e0-b905-49f8-9f2b-436ef72096da] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:01:03.300417 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fa1795fc-8570-46b6-82d3-03793c2aa783 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:01:03.300902 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fa1795fc-8570-46b6-82d3-03793c2aa783 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:01:03.301377 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fa1795fc-8570-46b6-82d3-03793c2aa783 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:01:03.302084 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fa1795fc-8570-46b6-82d3-03793c2aa783 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:01:03.302541 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fa1795fc-8570-46b6-82d3-03793c2aa783 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:01:03.302974 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fa1795fc-8570-46b6-82d3-03793c2aa783 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:01:03.436623 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-fa1795fc-8570-46b6-82d3-03793c2aa783 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9adcc8a95203462ea78164d4db440351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa75a4498a814ecc86698d0ddac01c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:01:03.446496 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-fa1795fc-8570-46b6-82d3-03793c2aa783 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] 10.222.0.18 "GET /compute/v2.1/servers/7c7999e0-b905-49f8-9f2b-436ef72096da" status: 200 len: 1548 microversion: 2.1 time: 0.164584 Oct 22 22:01:03.447080 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3339/6708] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:01:03 2022] GET /compute/v2.1/servers/7c7999e0-b905-49f8-9f2b-436ef72096da => generated 1548 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:01:03.470302 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-a27f69fa-d889-4d50-8ed4-bfc8fe044983 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:01:03.470956 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-a27f69fa-d889-4d50-8ed4-bfc8fe044983 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] [instance: 7c7999e0-b905-49f8-9f2b-436ef72096da] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:01:03.478252 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a27f69fa-d889-4d50-8ed4-bfc8fe044983 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:01:03.478759 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a27f69fa-d889-4d50-8ed4-bfc8fe044983 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:01:03.479220 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a27f69fa-d889-4d50-8ed4-bfc8fe044983 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:01:03.480114 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a27f69fa-d889-4d50-8ed4-bfc8fe044983 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:01:03.480586 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a27f69fa-d889-4d50-8ed4-bfc8fe044983 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:01:03.481028 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a27f69fa-d889-4d50-8ed4-bfc8fe044983 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:01:03.622567 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-a27f69fa-d889-4d50-8ed4-bfc8fe044983 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9adcc8a95203462ea78164d4db440351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa75a4498a814ecc86698d0ddac01c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:01:03.632667 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-a27f69fa-d889-4d50-8ed4-bfc8fe044983 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] 10.222.0.18 "GET /compute/v2.1/servers/7c7999e0-b905-49f8-9f2b-436ef72096da" status: 200 len: 1548 microversion: 2.1 time: 0.166728 Oct 22 22:01:03.633251 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3370/6709] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:01:03 2022] GET /compute/v2.1/servers/7c7999e0-b905-49f8-9f2b-436ef72096da => generated 1548 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:01:03.655157 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-2833780e-4949-4bfe-8a32-58966cc07090 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:01:03.660244 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-2833780e-4949-4bfe-8a32-58966cc07090 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9adcc8a95203462ea78164d4db440351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa75a4498a814ecc86698d0ddac01c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:01:03.661326 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-2833780e-4949-4bfe-8a32-58966cc07090 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Searching by: {'deleted': False, 'project_id': 'aa75a4498a814ecc86698d0ddac01c2f'} {{(pid=138744) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 22 22:01:03.667233 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2833780e-4949-4bfe-8a32-58966cc07090 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:01:03.667760 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2833780e-4949-4bfe-8a32-58966cc07090 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:01:03.668203 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2833780e-4949-4bfe-8a32-58966cc07090 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:01:03.668939 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2833780e-4949-4bfe-8a32-58966cc07090 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:01:03.669406 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2833780e-4949-4bfe-8a32-58966cc07090 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:01:03.669844 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2833780e-4949-4bfe-8a32-58966cc07090 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:01:03.696645 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.multi_cell_list [None req-2833780e-4949-4bfe-8a32-58966cc07090 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=138744) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 22 22:01:03.725153 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-2833780e-4949-4bfe-8a32-58966cc07090 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] 10.222.0.18 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.074049 Oct 22 22:01:03.725747 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3340/6710] 10.222.0.18 () {58 vars in 1125 bytes} [Sat Oct 22 22:01:03 2022] GET /compute/v2.1/servers => generated 343 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 22:01:03.738090 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-6ff5e8e3-8566-480c-ad49-083a8c50d8ce tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:01:03.738714 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-6ff5e8e3-8566-480c-ad49-083a8c50d8ce tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] [instance: 7c7999e0-b905-49f8-9f2b-436ef72096da] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:01:03.745201 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6ff5e8e3-8566-480c-ad49-083a8c50d8ce tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:01:03.745707 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6ff5e8e3-8566-480c-ad49-083a8c50d8ce tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:01:03.746164 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6ff5e8e3-8566-480c-ad49-083a8c50d8ce tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:01:03.746875 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6ff5e8e3-8566-480c-ad49-083a8c50d8ce tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:01:03.747372 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6ff5e8e3-8566-480c-ad49-083a8c50d8ce tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:01:03.747829 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6ff5e8e3-8566-480c-ad49-083a8c50d8ce tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:01:04.249703 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-6ff5e8e3-8566-480c-ad49-083a8c50d8ce tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9adcc8a95203462ea78164d4db440351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa75a4498a814ecc86698d0ddac01c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:01:04.257680 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-6ff5e8e3-8566-480c-ad49-083a8c50d8ce tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] 10.222.0.18 "GET /compute/v2.1/servers/7c7999e0-b905-49f8-9f2b-436ef72096da" status: 200 len: 1548 microversion: 2.1 time: 0.523529 Oct 22 22:01:04.258263 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3371/6711] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:01:03 2022] GET /compute/v2.1/servers/7c7999e0-b905-49f8-9f2b-436ef72096da => generated 1548 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:01:05.850720 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-4d0352a4-cf9c-4dcb-b9f6-9cf91a0b9bc5 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c149a5fd-4d51-459c-80f2-03423713f913"}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 22:01:05.853122 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-4d0352a4-cf9c-4dcb-b9f6-9cf91a0b9bc5 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] [instance: 7c7999e0-b905-49f8-9f2b-436ef72096da] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:01:05.860324 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4d0352a4-cf9c-4dcb-b9f6-9cf91a0b9bc5 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:01:05.860743 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4d0352a4-cf9c-4dcb-b9f6-9cf91a0b9bc5 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:01:05.861191 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4d0352a4-cf9c-4dcb-b9f6-9cf91a0b9bc5 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:01:05.861893 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4d0352a4-cf9c-4dcb-b9f6-9cf91a0b9bc5 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:01:05.862532 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4d0352a4-cf9c-4dcb-b9f6-9cf91a0b9bc5 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:01:05.862960 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4d0352a4-cf9c-4dcb-b9f6-9cf91a0b9bc5 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:01:06.128621 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-4d0352a4-cf9c-4dcb-b9f6-9cf91a0b9bc5 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] 10.222.0.18 "POST /compute/v2.1/servers/7c7999e0-b905-49f8-9f2b-436ef72096da/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.281792 Oct 22 22:01:06.129229 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3341/6712] 10.222.0.18 () {60 vars in 1323 bytes} [Sat Oct 22 22:01:05 2022] POST /compute/v2.1/servers/7c7999e0-b905-49f8-9f2b-436ef72096da/os-volume_attachments => generated 194 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 22:01:10.781683 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-b8ee3711-a8cf-4ad3-ab50-b1c46f19157a tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:01:10.782342 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-b8ee3711-a8cf-4ad3-ab50-b1c46f19157a tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] [instance: 7c7999e0-b905-49f8-9f2b-436ef72096da] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:01:10.790078 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b8ee3711-a8cf-4ad3-ab50-b1c46f19157a tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:01:10.790591 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b8ee3711-a8cf-4ad3-ab50-b1c46f19157a tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:01:10.791055 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b8ee3711-a8cf-4ad3-ab50-b1c46f19157a tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:01:10.791818 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b8ee3711-a8cf-4ad3-ab50-b1c46f19157a tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:01:10.792295 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b8ee3711-a8cf-4ad3-ab50-b1c46f19157a tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:01:10.792743 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b8ee3711-a8cf-4ad3-ab50-b1c46f19157a tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:01:10.929065 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-b8ee3711-a8cf-4ad3-ab50-b1c46f19157a tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9adcc8a95203462ea78164d4db440351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa75a4498a814ecc86698d0ddac01c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:01:10.937911 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-b8ee3711-a8cf-4ad3-ab50-b1c46f19157a tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] 10.222.0.18 "GET /compute/v2.1/servers/7c7999e0-b905-49f8-9f2b-436ef72096da" status: 200 len: 1594 microversion: 2.1 time: 0.160196 Oct 22 22:01:10.938524 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3372/6713] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:01:10 2022] GET /compute/v2.1/servers/7c7999e0-b905-49f8-9f2b-436ef72096da => generated 1594 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:01:12.706400 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-5428476d-a3c5-49c2-aaf7-143f9ebb1c0f req-27714626-8450-42de-9711-d79a41ab498e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c7999e0-b905-49f8-9f2b-436ef72096da", "tag": "e2c82c04-c60d-4fab-a4bd-5b0f1148a4c4"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 22:01:12.712114 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=1 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:01:12.723405 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-5428476d-a3c5-49c2-aaf7-143f9ebb1c0f req-27714626-8450-42de-9711-d79a41ab498e service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:01:12.724360 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-5428476d-a3c5-49c2-aaf7-143f9ebb1c0f req-27714626-8450-42de-9711-d79a41ab498e service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:01:12.724743 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-5428476d-a3c5-49c2-aaf7-143f9ebb1c0f req-27714626-8450-42de-9711-d79a41ab498e service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:01:12.728275 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:01:12.739609 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-5428476d-a3c5-49c2-aaf7-143f9ebb1c0f req-27714626-8450-42de-9711-d79a41ab498e service nova] Creating event network-changed:e2c82c04-c60d-4fab-a4bd-5b0f1148a4c4 for instance 7c7999e0-b905-49f8-9f2b-436ef72096da on nch1-master-1 Oct 22 22:01:12.745879 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-5428476d-a3c5-49c2-aaf7-143f9ebb1c0f req-27714626-8450-42de-9711-d79a41ab498e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044439 Oct 22 22:01:12.746717 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3342/6714] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 22:01:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 22:01:13.788478 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-776d8202-f4f2-4787-8ec3-04b7039e59b6 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-312318979"}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 22:01:13.789286 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-776d8202-f4f2-4787-8ec3-04b7039e59b6 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] [instance: 7c7999e0-b905-49f8-9f2b-436ef72096da] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:01:13.793771 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=3 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:01:13.799934 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-776d8202-f4f2-4787-8ec3-04b7039e59b6 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:01:13.800455 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-776d8202-f4f2-4787-8ec3-04b7039e59b6 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:01:13.800913 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-776d8202-f4f2-4787-8ec3-04b7039e59b6 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:01:13.801652 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-776d8202-f4f2-4787-8ec3-04b7039e59b6 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:01:13.802123 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-776d8202-f4f2-4787-8ec3-04b7039e59b6 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:01:13.802572 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-776d8202-f4f2-4787-8ec3-04b7039e59b6 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:01:13.811048 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell1:SELECT=77 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:01:13.946335 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.network.security_group_api [None req-776d8202-f4f2-4787-8ec3-04b7039e59b6 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Adding security group 2f1e82be-f474-4075-89d6-b21a7ecfcd63 to port e2c82c04-c60d-4fab-a4bd-5b0f1148a4c4 Oct 22 22:01:14.286410 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-776d8202-f4f2-4787-8ec3-04b7039e59b6 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] 10.222.0.18 "POST /compute/v2.1/servers/7c7999e0-b905-49f8-9f2b-436ef72096da/action" status: 202 len: 0 microversion: 2.1 time: 0.502422 Oct 22 22:01:14.287674 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3373/6715] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 22:01:13 2022] POST /compute/v2.1/servers/7c7999e0-b905-49f8-9f2b-436ef72096da/action => generated 0 bytes in 504 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 22:01:14.293409 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell0:SELECT=2 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:01:14.298733 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-589805fd-89cd-456f-927c-6a31c94287ff tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:01:14.299511 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-589805fd-89cd-456f-927c-6a31c94287ff tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] [instance: 7c7999e0-b905-49f8-9f2b-436ef72096da] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:01:14.307412 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-589805fd-89cd-456f-927c-6a31c94287ff tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:01:14.308179 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-589805fd-89cd-456f-927c-6a31c94287ff tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:01:14.308813 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-589805fd-89cd-456f-927c-6a31c94287ff tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:01:14.309707 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-589805fd-89cd-456f-927c-6a31c94287ff tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:01:14.310409 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-589805fd-89cd-456f-927c-6a31c94287ff tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:01:14.311080 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-589805fd-89cd-456f-927c-6a31c94287ff tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:01:14.471585 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-589805fd-89cd-456f-927c-6a31c94287ff tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9adcc8a95203462ea78164d4db440351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa75a4498a814ecc86698d0ddac01c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:01:14.480407 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-589805fd-89cd-456f-927c-6a31c94287ff tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] 10.222.0.18 "GET /compute/v2.1/servers/7c7999e0-b905-49f8-9f2b-436ef72096da" status: 200 len: 1757 microversion: 2.1 time: 0.188421 Oct 22 22:01:14.481121 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3343/6716] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:01:14 2022] GET /compute/v2.1/servers/7c7999e0-b905-49f8-9f2b-436ef72096da => generated 1757 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:01:14.762571 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-cb39e4ea-e91e-4ee8-8806-23bda51912a7 req-a031b86f-ec70-4d41-ae07-49d3eb56ff2b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c7999e0-b905-49f8-9f2b-436ef72096da", "tag": "e2c82c04-c60d-4fab-a4bd-5b0f1148a4c4"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 22:01:14.772866 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-cb39e4ea-e91e-4ee8-8806-23bda51912a7 req-a031b86f-ec70-4d41-ae07-49d3eb56ff2b service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:01:14.773362 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-cb39e4ea-e91e-4ee8-8806-23bda51912a7 req-a031b86f-ec70-4d41-ae07-49d3eb56ff2b service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:01:14.773934 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-cb39e4ea-e91e-4ee8-8806-23bda51912a7 req-a031b86f-ec70-4d41-ae07-49d3eb56ff2b service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:01:14.786483 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-cb39e4ea-e91e-4ee8-8806-23bda51912a7 req-a031b86f-ec70-4d41-ae07-49d3eb56ff2b service nova] Creating event network-changed:e2c82c04-c60d-4fab-a4bd-5b0f1148a4c4 for instance 7c7999e0-b905-49f8-9f2b-436ef72096da on nch1-master-1 Oct 22 22:01:14.791932 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-cb39e4ea-e91e-4ee8-8806-23bda51912a7 req-a031b86f-ec70-4d41-ae07-49d3eb56ff2b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034685 Oct 22 22:01:14.792639 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3374/6717] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 22:01:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 22:04:07.651950 ncdv-master-1 devstack@n-api.service[138744]: ERROR oslo.messaging._drivers.impl_rabbit [-] [04d2594c-31df-45b7-a94b-e87da15c0f2c] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 22 22:04:07.652990 ncdv-master-1 devstack@n-api.service[138744]: ERROR oslo.messaging._drivers.impl_rabbit [-] [81790953-1e28-46a4-954d-7f89676de4fb] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 22 22:04:07.653468 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_api:SELECT=3 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:04:07.654431 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:SELECT=7 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:04:07.655309 ncdv-master-1 devstack@n-api.service[138744]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 22 22:04:07.655506 ncdv-master-1 devstack@n-api.service[138744]: Sat Oct 22 22:04:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7c7999e0-b905-49f8-9f2b-436ef72096da/action (ip 10.222.0.18) !!! Oct 22 22:04:07.656972 ncdv-master-1 devstack@n-api.service[138744]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 22 22:04:07.657109 ncdv-master-1 devstack@n-api.service[138744]: Sat Oct 22 22:04:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7c7999e0-b905-49f8-9f2b-436ef72096da/action (ip 10.222.0.18) !!! Oct 22 22:04:07.658462 ncdv-master-1 devstack@n-api.service[138744]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 22 22:04:07.658661 ncdv-master-1 devstack@n-api.service[138744]: Sat Oct 22 22:04:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7c7999e0-b905-49f8-9f2b-436ef72096da/action (ip 10.222.0.18) !!! Oct 22 22:04:07.663651 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-5e251194-a752-4310-ae0c-5ca7f598e18e tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 22:04:07.665890 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-5e251194-a752-4310-ae0c-5ca7f598e18e tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] [instance: 7c7999e0-b905-49f8-9f2b-436ef72096da] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:04:07.684302 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5e251194-a752-4310-ae0c-5ca7f598e18e tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:04:07.684794 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5e251194-a752-4310-ae0c-5ca7f598e18e tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:04:07.685228 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5e251194-a752-4310-ae0c-5ca7f598e18e tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:04:07.686034 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5e251194-a752-4310-ae0c-5ca7f598e18e tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:04:07.686415 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5e251194-a752-4310-ae0c-5ca7f598e18e tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:04:07.686879 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5e251194-a752-4310-ae0c-5ca7f598e18e tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:04:07.773888 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-5e251194-a752-4310-ae0c-5ca7f598e18e tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] 10.222.0.18 "POST /compute/v2.1/servers/7c7999e0-b905-49f8-9f2b-436ef72096da/action" status: 202 len: 0 microversion: 2.1 time: 0.123939 Oct 22 22:04:07.774550 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3344/6718] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 22:04:07 2022] POST /compute/v2.1/servers/7c7999e0-b905-49f8-9f2b-436ef72096da/action => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 22:04:07.781090 ncdv-master-1 devstack@n-api.service[138745]: ERROR oslo.messaging._drivers.impl_rabbit [-] [82d96799-6494-46cc-9c4c-c1ce995f6091] AMQP server on 10.222.0.18:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 22 22:04:07.782200 ncdv-master-1 devstack@n-api.service[138745]: ERROR oslo.messaging._drivers.impl_rabbit [-] [dbe685c1-0e25-4156-906e-a0926e5c28f4] AMQP server on 10.222.0.18:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 22 22:04:07.782999 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_api:SELECT=3 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:04:07.784091 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell1:SELECT=5 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:04:07.785281 ncdv-master-1 devstack@n-api.service[138745]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 22 22:04:07.785441 ncdv-master-1 devstack@n-api.service[138745]: Sat Oct 22 22:04:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7c7999e0-b905-49f8-9f2b-436ef72096da (ip 10.222.0.18) !!! Oct 22 22:04:07.786839 ncdv-master-1 devstack@n-api.service[138745]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 22 22:04:07.786995 ncdv-master-1 devstack@n-api.service[138745]: Sat Oct 22 22:04:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7c7999e0-b905-49f8-9f2b-436ef72096da (ip 10.222.0.18) !!! Oct 22 22:04:07.787883 ncdv-master-1 devstack@n-api.service[138745]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 22 22:04:07.788009 ncdv-master-1 devstack@n-api.service[138745]: Sat Oct 22 22:04:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7c7999e0-b905-49f8-9f2b-436ef72096da (ip 10.222.0.18) !!! Oct 22 22:04:07.794380 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-6f4764f8-af18-4f56-8868-a75b4f688467 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:04:07.795671 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-6f4764f8-af18-4f56-8868-a75b4f688467 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] [instance: 7c7999e0-b905-49f8-9f2b-436ef72096da] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:04:07.807001 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6f4764f8-af18-4f56-8868-a75b4f688467 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:04:07.807581 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6f4764f8-af18-4f56-8868-a75b4f688467 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:04:07.808044 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6f4764f8-af18-4f56-8868-a75b4f688467 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:04:07.808780 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6f4764f8-af18-4f56-8868-a75b4f688467 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:04:07.809259 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6f4764f8-af18-4f56-8868-a75b4f688467 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:04:07.809708 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6f4764f8-af18-4f56-8868-a75b4f688467 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:04:08.109788 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-6f4764f8-af18-4f56-8868-a75b4f688467 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9adcc8a95203462ea78164d4db440351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa75a4498a814ecc86698d0ddac01c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:04:08.118937 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-6f4764f8-af18-4f56-8868-a75b4f688467 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] 10.222.0.18 "GET /compute/v2.1/servers/7c7999e0-b905-49f8-9f2b-436ef72096da" status: 200 len: 1759 microversion: 2.1 time: 0.339763 Oct 22 22:04:08.119558 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3375/6719] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:04:07 2022] GET /compute/v2.1/servers/7c7999e0-b905-49f8-9f2b-436ef72096da => generated 1759 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:04:09.145068 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-88915c43-48d3-4179-838c-25b4b27fdd9c tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:04:09.145768 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-88915c43-48d3-4179-838c-25b4b27fdd9c tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] [instance: 7c7999e0-b905-49f8-9f2b-436ef72096da] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:04:09.154580 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-88915c43-48d3-4179-838c-25b4b27fdd9c tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:04:09.155064 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-88915c43-48d3-4179-838c-25b4b27fdd9c tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:04:09.155632 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-88915c43-48d3-4179-838c-25b4b27fdd9c tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:04:09.156311 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-88915c43-48d3-4179-838c-25b4b27fdd9c tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:04:09.156800 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-88915c43-48d3-4179-838c-25b4b27fdd9c tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:04:09.157228 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-88915c43-48d3-4179-838c-25b4b27fdd9c tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:04:09.161495 ncdv-master-1 devstack@n-api.service[138744]: INFO oslo.messaging._drivers.impl_rabbit [-] [04d2594c-31df-45b7-a94b-e87da15c0f2c] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 37926. Oct 22 22:04:09.165431 ncdv-master-1 devstack@n-api.service[138744]: INFO oslo.messaging._drivers.impl_rabbit [-] [81790953-1e28-46a4-954d-7f89676de4fb] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 37928. Oct 22 22:04:09.409627 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-88915c43-48d3-4179-838c-25b4b27fdd9c tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9adcc8a95203462ea78164d4db440351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa75a4498a814ecc86698d0ddac01c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:04:09.418178 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-88915c43-48d3-4179-838c-25b4b27fdd9c tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] 10.222.0.18 "GET /compute/v2.1/servers/7c7999e0-b905-49f8-9f2b-436ef72096da" status: 200 len: 1764 microversion: 2.1 time: 0.279481 Oct 22 22:04:09.418745 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3345/6720] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:04:09 2022] GET /compute/v2.1/servers/7c7999e0-b905-49f8-9f2b-436ef72096da => generated 1764 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:04:10.443442 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-b472288d-3a6e-42b4-9074-801c906ef3f8 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:04:10.444091 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-b472288d-3a6e-42b4-9074-801c906ef3f8 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] [instance: 7c7999e0-b905-49f8-9f2b-436ef72096da] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:04:10.453115 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b472288d-3a6e-42b4-9074-801c906ef3f8 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:04:10.453616 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b472288d-3a6e-42b4-9074-801c906ef3f8 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:04:10.454065 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b472288d-3a6e-42b4-9074-801c906ef3f8 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:04:10.454893 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b472288d-3a6e-42b4-9074-801c906ef3f8 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:04:10.455375 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b472288d-3a6e-42b4-9074-801c906ef3f8 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:04:10.455805 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b472288d-3a6e-42b4-9074-801c906ef3f8 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:04:10.463062 ncdv-master-1 devstack@n-api.service[138745]: INFO oslo.messaging._drivers.impl_rabbit [-] [82d96799-6494-46cc-9c4c-c1ce995f6091] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 37934. Oct 22 22:04:10.475055 ncdv-master-1 devstack@n-api.service[138745]: INFO oslo.messaging._drivers.impl_rabbit [-] [dbe685c1-0e25-4156-906e-a0926e5c28f4] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 37936. Oct 22 22:04:10.611076 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-b472288d-3a6e-42b4-9074-801c906ef3f8 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9adcc8a95203462ea78164d4db440351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa75a4498a814ecc86698d0ddac01c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:04:10.620232 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-b472288d-3a6e-42b4-9074-801c906ef3f8 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] 10.222.0.18 "GET /compute/v2.1/servers/7c7999e0-b905-49f8-9f2b-436ef72096da" status: 200 len: 1757 microversion: 2.1 time: 0.180795 Oct 22 22:04:10.620844 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3376/6721] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:04:10 2022] GET /compute/v2.1/servers/7c7999e0-b905-49f8-9f2b-436ef72096da => generated 1757 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:05:40.552095 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_api:SELECT=4 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:05:40.553105 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:SELECT=16,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:05:40.635880 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-2ea02d3d-69e5-44d6-97b8-c3f247036d3c tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-312318979"}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 22:05:40.636429 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-2ea02d3d-69e5-44d6-97b8-c3f247036d3c tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] [instance: 7c7999e0-b905-49f8-9f2b-436ef72096da] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:05:40.642873 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2ea02d3d-69e5-44d6-97b8-c3f247036d3c tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:05:40.643373 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2ea02d3d-69e5-44d6-97b8-c3f247036d3c tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:05:40.643837 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2ea02d3d-69e5-44d6-97b8-c3f247036d3c tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:05:40.644531 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2ea02d3d-69e5-44d6-97b8-c3f247036d3c tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:05:40.645007 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2ea02d3d-69e5-44d6-97b8-c3f247036d3c tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:05:40.645440 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2ea02d3d-69e5-44d6-97b8-c3f247036d3c tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:05:40.778937 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.network.security_group_api [None req-2ea02d3d-69e5-44d6-97b8-c3f247036d3c tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Removing security group 2f1e82be-f474-4075-89d6-b21a7ecfcd63 from port e2c82c04-c60d-4fab-a4bd-5b0f1148a4c4 Oct 22 22:05:41.086280 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-2ea02d3d-69e5-44d6-97b8-c3f247036d3c tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] 10.222.0.18 "POST /compute/v2.1/servers/7c7999e0-b905-49f8-9f2b-436ef72096da/action" status: 202 len: 0 microversion: 2.1 time: 0.538370 Oct 22 22:05:41.087316 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3346/6722] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 22:05:40 2022] POST /compute/v2.1/servers/7c7999e0-b905-49f8-9f2b-436ef72096da/action => generated 0 bytes in 540 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 22:05:41.094204 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_api:SELECT=4 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:05:41.097269 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell1:SELECT=12 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:05:41.186835 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-57112f0d-d738-490d-b75e-6e02298d58ce req-66a0cdde-3a7c-44fd-ad18-2c6631d24aa8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c7999e0-b905-49f8-9f2b-436ef72096da", "tag": "e2c82c04-c60d-4fab-a4bd-5b0f1148a4c4"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 22:05:41.196571 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-57112f0d-d738-490d-b75e-6e02298d58ce req-66a0cdde-3a7c-44fd-ad18-2c6631d24aa8 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:05:41.197069 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-57112f0d-d738-490d-b75e-6e02298d58ce req-66a0cdde-3a7c-44fd-ad18-2c6631d24aa8 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:05:41.197520 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-57112f0d-d738-490d-b75e-6e02298d58ce req-66a0cdde-3a7c-44fd-ad18-2c6631d24aa8 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:05:41.209678 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-57112f0d-d738-490d-b75e-6e02298d58ce req-66a0cdde-3a7c-44fd-ad18-2c6631d24aa8 service nova] Creating event network-changed:e2c82c04-c60d-4fab-a4bd-5b0f1148a4c4 for instance 7c7999e0-b905-49f8-9f2b-436ef72096da on nch1-master-1 Oct 22 22:05:41.217200 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-57112f0d-d738-490d-b75e-6e02298d58ce req-66a0cdde-3a7c-44fd-ad18-2c6631d24aa8 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.126275 Oct 22 22:05:41.217918 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3377/6723] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 22:05:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 22:05:42.196161 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-77707ddc-f675-47bd-8089-dedb30a88e37 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:05:42.196703 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-77707ddc-f675-47bd-8089-dedb30a88e37 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] [instance: 7c7999e0-b905-49f8-9f2b-436ef72096da] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:05:42.203169 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-77707ddc-f675-47bd-8089-dedb30a88e37 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:05:42.203701 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-77707ddc-f675-47bd-8089-dedb30a88e37 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:05:42.204150 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-77707ddc-f675-47bd-8089-dedb30a88e37 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:05:42.204858 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-77707ddc-f675-47bd-8089-dedb30a88e37 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:05:42.205319 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-77707ddc-f675-47bd-8089-dedb30a88e37 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:05:42.205758 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-77707ddc-f675-47bd-8089-dedb30a88e37 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:05:42.289050 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.objects.instance [None req-77707ddc-f675-47bd-8089-dedb30a88e37 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lazy-loading 'services' on Instance uuid 7c7999e0-b905-49f8-9f2b-436ef72096da {{(pid=138744) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 22:05:42.364885 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-77707ddc-f675-47bd-8089-dedb30a88e37 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] 10.222.0.18 "DELETE /compute/v2.1/servers/7c7999e0-b905-49f8-9f2b-436ef72096da/os-volume_attachments/c149a5fd-4d51-459c-80f2-03423713f913" status: 202 len: 0 microversion: 2.1 time: 0.173558 Oct 22 22:05:42.365492 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3347/6724] 10.222.0.18 () {58 vars in 1416 bytes} [Sat Oct 22 22:05:42 2022] DELETE /compute/v2.1/servers/7c7999e0-b905-49f8-9f2b-436ef72096da/os-volume_attachments/c149a5fd-4d51-459c-80f2-03423713f913 => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 22:05:42.374864 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-c32506ef-508b-4956-8275-362e5fb9c81a tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:05:42.378226 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-c32506ef-508b-4956-8275-362e5fb9c81a tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] [instance: 7c7999e0-b905-49f8-9f2b-436ef72096da] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:05:42.386013 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c32506ef-508b-4956-8275-362e5fb9c81a tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:05:42.387061 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c32506ef-508b-4956-8275-362e5fb9c81a tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:05:42.387807 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c32506ef-508b-4956-8275-362e5fb9c81a tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:05:42.388770 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c32506ef-508b-4956-8275-362e5fb9c81a tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:05:42.389423 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c32506ef-508b-4956-8275-362e5fb9c81a tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:05:42.389880 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c32506ef-508b-4956-8275-362e5fb9c81a tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:05:42.430886 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-c32506ef-508b-4956-8275-362e5fb9c81a tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] 10.222.0.18 "GET /compute/v2.1/servers/7c7999e0-b905-49f8-9f2b-436ef72096da/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060391 Oct 22 22:05:42.431650 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3378/6725] 10.222.0.18 () {58 vars in 1302 bytes} [Sat Oct 22 22:05:42 2022] GET /compute/v2.1/servers/7c7999e0-b905-49f8-9f2b-436ef72096da/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 22:05:43.236810 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-fe3ff9b9-1456-4f36-bf72-e994d326ce9b req-b37be830-6810-40f0-b2e6-f4e7c876d11f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c7999e0-b905-49f8-9f2b-436ef72096da", "tag": "e2c82c04-c60d-4fab-a4bd-5b0f1148a4c4"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 22:05:43.247218 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-fe3ff9b9-1456-4f36-bf72-e994d326ce9b req-b37be830-6810-40f0-b2e6-f4e7c876d11f service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:05:43.247769 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-fe3ff9b9-1456-4f36-bf72-e994d326ce9b req-b37be830-6810-40f0-b2e6-f4e7c876d11f service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:05:43.248206 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-fe3ff9b9-1456-4f36-bf72-e994d326ce9b req-b37be830-6810-40f0-b2e6-f4e7c876d11f service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:05:43.259634 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-fe3ff9b9-1456-4f36-bf72-e994d326ce9b req-b37be830-6810-40f0-b2e6-f4e7c876d11f service nova] Creating event network-changed:e2c82c04-c60d-4fab-a4bd-5b0f1148a4c4 for instance 7c7999e0-b905-49f8-9f2b-436ef72096da on nch1-master-1 Oct 22 22:05:43.265046 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-fe3ff9b9-1456-4f36-bf72-e994d326ce9b req-b37be830-6810-40f0-b2e6-f4e7c876d11f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033410 Oct 22 22:05:43.265594 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3348/6726] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 22:05:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 22:05:43.444884 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-bd86ed8a-d5f4-43b5-853e-e020f9fba828 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:05:43.447155 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-bd86ed8a-d5f4-43b5-853e-e020f9fba828 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] [instance: 7c7999e0-b905-49f8-9f2b-436ef72096da] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:05:43.454481 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bd86ed8a-d5f4-43b5-853e-e020f9fba828 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:05:43.455071 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bd86ed8a-d5f4-43b5-853e-e020f9fba828 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:05:43.455633 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bd86ed8a-d5f4-43b5-853e-e020f9fba828 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:05:43.456425 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bd86ed8a-d5f4-43b5-853e-e020f9fba828 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:05:43.456965 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bd86ed8a-d5f4-43b5-853e-e020f9fba828 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:05:43.457399 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bd86ed8a-d5f4-43b5-853e-e020f9fba828 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:05:43.487783 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-bd86ed8a-d5f4-43b5-853e-e020f9fba828 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] 10.222.0.18 "GET /compute/v2.1/servers/7c7999e0-b905-49f8-9f2b-436ef72096da/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047001 Oct 22 22:05:43.488597 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3379/6727] 10.222.0.18 () {58 vars in 1302 bytes} [Sat Oct 22 22:05:43 2022] GET /compute/v2.1/servers/7c7999e0-b905-49f8-9f2b-436ef72096da/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 22 22:05:43.500057 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-07e692ee-4816-490a-be95-58f6cfd4c11a tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:05:43.500649 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-07e692ee-4816-490a-be95-58f6cfd4c11a tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] [instance: 7c7999e0-b905-49f8-9f2b-436ef72096da] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:05:43.507381 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-07e692ee-4816-490a-be95-58f6cfd4c11a tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:05:43.507887 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-07e692ee-4816-490a-be95-58f6cfd4c11a tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:05:43.508331 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-07e692ee-4816-490a-be95-58f6cfd4c11a tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:05:43.509032 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-07e692ee-4816-490a-be95-58f6cfd4c11a tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:05:43.509493 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-07e692ee-4816-490a-be95-58f6cfd4c11a tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:05:43.509924 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-07e692ee-4816-490a-be95-58f6cfd4c11a tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:05:43.586366 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-07e692ee-4816-490a-be95-58f6cfd4c11a tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] HTTP exception thrown: Instance 7c7999e0-b905-49f8-9f2b-436ef72096da is not attached to volume c149a5fd-4d51-459c-80f2-03423713f913 Oct 22 22:05:43.597203 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-07e692ee-4816-490a-be95-58f6cfd4c11a tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Request method failure captured: Oct 22 22:05:43.597203 ncdv-master-1 devstack@n-api.service[138744]: request: DELETE /compute/v2.1/servers/7c7999e0-b905-49f8-9f2b-436ef72096da/os-volume_attachments/c149a5fd-4d51-459c-80f2-03423713f913 HTTP/1.1 Oct 22 22:05:43.597203 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 22:05:43.597203 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 22:05:43.597203 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 22:05:43.597203 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 0 Oct 22 22:05:43.597203 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 22:05:43.597203 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 22:05:43.597203 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 22:05:43.597203 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 22:05:43.597203 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVGf6nsO7KO_P-Lv7m3kWPRG3fXIwCVOUKQ790BCXFliAeAjYLh22C4q6qivMuSAWDCdan3UiFR_BSQTf0fiIJIM3wLmd2DDMOEjq3DJYBmyB2pVkQQKvY_YorpV4dvrzUOJCwETiDbxSXD-pOY8GGBhu2TFWDQCefkXetugM6fmfT9I Oct 22 22:05:43.597203 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 22:05:43.597203 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 22:05:43.597203 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 22:05:43.597203 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 22:05:43.597203 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 22:05:43.597203 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 22:05:43.597203 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: aa75a4498a814ecc86698d0ddac01c2f Oct 22 22:05:43.597203 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-TestMinimumBasicScenario-1689753837 Oct 22 22:05:43.597203 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 22:05:43.597203 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 22:05:43.597203 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_aa75a4498a814ecc86698d0ddac01c2f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/aa75a4498a814ecc86698d0ddac01c2f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/aa75a4498a814ecc86698d0ddac01c2f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/aa75a4498a814ecc86698d0ddac01c2f"}]}] Oct 22 22:05:43.597203 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-TestMinimumBasicScenario-1689753837 Oct 22 22:05:43.597203 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: aa75a4498a814ecc86698d0ddac01c2f Oct 22 22:05:43.597203 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1689753837 Oct 22 22:05:43.597203 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-TestMinimumBasicScenario-1689753837-project Oct 22 22:05:43.597203 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 22:05:43.597203 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 22:05:43.597203 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: 9adcc8a95203462ea78164d4db440351 Oct 22 22:05:43.597203 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-TestMinimumBasicScenario-1689753837-project Oct 22 22:05:43.597203 ncdv-master-1 devstack@n-api.service[138744]: method: > Oct 22 22:05:43.597203 ncdv-master-1 devstack@n-api.service[138744]: exception: Instance 7c7999e0-b905-49f8-9f2b-436ef72096da is not attached to volume c149a5fd-4d51-459c-80f2-03423713f913 Oct 22 22:05:43.597203 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'server_id': '7c7999e0-b905-49f8-9f2b-436ef72096da', 'id': 'c149a5fd-4d51-459c-80f2-03423713f913'} Oct 22 22:05:43.597203 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 22:05:43.597203 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 22:05:43.597203 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 22 22:05:43.597203 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 22 22:05:43.597203 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 22 22:05:43.597203 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 22 22:05:43.597203 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 22 22:05:43.597203 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 22 22:05:43.597203 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id c149a5fd-4d51-459c-80f2-03423713f913. Oct 22 22:05:43.597203 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 22:05:43.597203 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 22:05:43.597203 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 22:05:43.597203 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 22:05:43.597203 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 22:05:43.597203 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 22:05:43.597203 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 22:05:43.597203 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 22:05:43.597203 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 22:05:43.597203 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 22:05:43.597203 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 22 22:05:43.597203 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 22 22:05:43.597203 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c7999e0-b905-49f8-9f2b-436ef72096da is not attached to volume c149a5fd-4d51-459c-80f2-03423713f913 Oct 22 22:05:43.597203 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 22:05:43.597203 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 22:05:43.597203 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 22:05:43.597203 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 22:05:43.597203 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 22:05:43.597203 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 22:05:43.603595 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 22:05:43.603595 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 22:05:43.603595 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c7999e0-b905-49f8-9f2b-436ef72096da is not attached to volume c149a5fd-4d51-459c-80f2-03423713f913 Oct 22 22:05:43.603595 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 22:05:43.603595 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-07e692ee-4816-490a-be95-58f6cfd4c11a tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Returning 404 to user: Instance 7c7999e0-b905-49f8-9f2b-436ef72096da is not attached to volume c149a5fd-4d51-459c-80f2-03423713f913 {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 22:05:43.603595 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-07e692ee-4816-490a-be95-58f6cfd4c11a tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] 10.222.0.18 "DELETE /compute/v2.1/servers/7c7999e0-b905-49f8-9f2b-436ef72096da/os-volume_attachments/c149a5fd-4d51-459c-80f2-03423713f913" status: 404 len: 154 microversion: 2.1 time: 0.103439 Oct 22 22:05:43.603595 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3349/6728] 10.222.0.18 () {58 vars in 1416 bytes} [Sat Oct 22 22:05:43 2022] DELETE /compute/v2.1/servers/7c7999e0-b905-49f8-9f2b-436ef72096da/os-volume_attachments/c149a5fd-4d51-459c-80f2-03423713f913 => generated 154 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 22:05:44.764585 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-96c920ab-1135-400b-9175-a9b48498683a tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:05:44.765142 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-96c920ab-1135-400b-9175-a9b48498683a tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] [instance: 7c7999e0-b905-49f8-9f2b-436ef72096da] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:05:44.772430 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-96c920ab-1135-400b-9175-a9b48498683a tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:05:44.772935 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-96c920ab-1135-400b-9175-a9b48498683a tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:05:44.773392 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-96c920ab-1135-400b-9175-a9b48498683a tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:05:44.774131 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-96c920ab-1135-400b-9175-a9b48498683a tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:05:44.774602 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-96c920ab-1135-400b-9175-a9b48498683a tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:05:44.775046 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-96c920ab-1135-400b-9175-a9b48498683a tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:05:44.802131 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-96c920ab-1135-400b-9175-a9b48498683a tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] [instance: 7c7999e0-b905-49f8-9f2b-436ef72096da] Going to try to terminate instance {{(pid=138745) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 22:05:44.883078 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-96c920ab-1135-400b-9175-a9b48498683a tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] 10.222.0.18 "DELETE /compute/v2.1/servers/7c7999e0-b905-49f8-9f2b-436ef72096da" status: 204 len: 0 microversion: 2.1 time: 0.123301 Oct 22 22:05:44.883988 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3380/6729] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 22:05:44 2022] DELETE /compute/v2.1/servers/7c7999e0-b905-49f8-9f2b-436ef72096da => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 22:05:44.893602 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-06131c6f-3d58-4001-9b51-b5e2e9aaab4c tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:05:44.894206 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-06131c6f-3d58-4001-9b51-b5e2e9aaab4c tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] [instance: 7c7999e0-b905-49f8-9f2b-436ef72096da] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:05:44.901195 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-06131c6f-3d58-4001-9b51-b5e2e9aaab4c tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:05:44.901678 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-06131c6f-3d58-4001-9b51-b5e2e9aaab4c tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:05:44.902176 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-06131c6f-3d58-4001-9b51-b5e2e9aaab4c tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:05:44.902817 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-06131c6f-3d58-4001-9b51-b5e2e9aaab4c tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:05:44.903272 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-06131c6f-3d58-4001-9b51-b5e2e9aaab4c tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:05:44.903732 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-06131c6f-3d58-4001-9b51-b5e2e9aaab4c tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:05:45.043510 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-06131c6f-3d58-4001-9b51-b5e2e9aaab4c tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9adcc8a95203462ea78164d4db440351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa75a4498a814ecc86698d0ddac01c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:05:45.055318 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-06131c6f-3d58-4001-9b51-b5e2e9aaab4c tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] 10.222.0.18 "GET /compute/v2.1/servers/7c7999e0-b905-49f8-9f2b-436ef72096da" status: 200 len: 1554 microversion: 2.1 time: 0.166332 Oct 22 22:05:45.056175 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3350/6730] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:05:44 2022] GET /compute/v2.1/servers/7c7999e0-b905-49f8-9f2b-436ef72096da => generated 1554 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:05:46.084472 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-96d07f34-1792-4c10-a3fe-60adc9e72935 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:05:46.085637 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-96d07f34-1792-4c10-a3fe-60adc9e72935 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] [instance: 7c7999e0-b905-49f8-9f2b-436ef72096da] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:05:46.096465 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-96d07f34-1792-4c10-a3fe-60adc9e72935 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:05:46.096972 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-96d07f34-1792-4c10-a3fe-60adc9e72935 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:05:46.097432 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-96d07f34-1792-4c10-a3fe-60adc9e72935 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:05:46.098166 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-96d07f34-1792-4c10-a3fe-60adc9e72935 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:05:46.098643 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-96d07f34-1792-4c10-a3fe-60adc9e72935 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:05:46.099093 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-96d07f34-1792-4c10-a3fe-60adc9e72935 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:05:46.232893 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-96d07f34-1792-4c10-a3fe-60adc9e72935 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9adcc8a95203462ea78164d4db440351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa75a4498a814ecc86698d0ddac01c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:05:46.241100 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-96d07f34-1792-4c10-a3fe-60adc9e72935 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] 10.222.0.18 "GET /compute/v2.1/servers/7c7999e0-b905-49f8-9f2b-436ef72096da" status: 200 len: 1554 microversion: 2.1 time: 0.164110 Oct 22 22:05:46.241652 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3381/6731] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:05:46 2022] GET /compute/v2.1/servers/7c7999e0-b905-49f8-9f2b-436ef72096da => generated 1554 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:05:47.173229 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-b5b49ebb-11ff-4514-bb82-18c20f5b4527 req-9f92abd4-96d4-46a0-98b7-955550a4f021 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c7999e0-b905-49f8-9f2b-436ef72096da", "name": "network-vif-deleted", "tag": "e2c82c04-c60d-4fab-a4bd-5b0f1148a4c4"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 22:05:47.182764 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-b5b49ebb-11ff-4514-bb82-18c20f5b4527 req-9f92abd4-96d4-46a0-98b7-955550a4f021 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:05:47.183225 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-b5b49ebb-11ff-4514-bb82-18c20f5b4527 req-9f92abd4-96d4-46a0-98b7-955550a4f021 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:05:47.183820 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-b5b49ebb-11ff-4514-bb82-18c20f5b4527 req-9f92abd4-96d4-46a0-98b7-955550a4f021 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:05:47.198261 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-b5b49ebb-11ff-4514-bb82-18c20f5b4527 req-9f92abd4-96d4-46a0-98b7-955550a4f021 service nova] Creating event network-vif-deleted:e2c82c04-c60d-4fab-a4bd-5b0f1148a4c4 for instance 7c7999e0-b905-49f8-9f2b-436ef72096da on nch1-master-1 Oct 22 22:05:47.204050 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-b5b49ebb-11ff-4514-bb82-18c20f5b4527 req-9f92abd4-96d4-46a0-98b7-955550a4f021 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092963 Oct 22 22:05:47.204685 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3351/6732] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 22:05:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 22:05:47.264250 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-b2d783b4-dafc-4235-85d4-c7b31c2b6f22 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:05:47.264882 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-b2d783b4-dafc-4235-85d4-c7b31c2b6f22 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] [instance: 7c7999e0-b905-49f8-9f2b-436ef72096da] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:05:47.272505 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b2d783b4-dafc-4235-85d4-c7b31c2b6f22 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:05:47.273077 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b2d783b4-dafc-4235-85d4-c7b31c2b6f22 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:05:47.273541 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b2d783b4-dafc-4235-85d4-c7b31c2b6f22 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:05:47.274271 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b2d783b4-dafc-4235-85d4-c7b31c2b6f22 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:05:47.274768 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b2d783b4-dafc-4235-85d4-c7b31c2b6f22 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:05:47.275218 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b2d783b4-dafc-4235-85d4-c7b31c2b6f22 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:05:47.309293 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b2d783b4-dafc-4235-85d4-c7b31c2b6f22 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:05:47.309811 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b2d783b4-dafc-4235-85d4-c7b31c2b6f22 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:05:47.310277 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b2d783b4-dafc-4235-85d4-c7b31c2b6f22 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:05:47.310763 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.objects.instance [None req-b2d783b4-dafc-4235-85d4-c7b31c2b6f22 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lazy-loading 'fault' on Instance uuid 7c7999e0-b905-49f8-9f2b-436ef72096da {{(pid=138745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 22:05:47.353271 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-b2d783b4-dafc-4235-85d4-c7b31c2b6f22 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9adcc8a95203462ea78164d4db440351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa75a4498a814ecc86698d0ddac01c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:05:47.361394 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-b2d783b4-dafc-4235-85d4-c7b31c2b6f22 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] 10.222.0.18 "GET /compute/v2.1/servers/7c7999e0-b905-49f8-9f2b-436ef72096da" status: 200 len: 1348 microversion: 2.1 time: 0.101103 Oct 22 22:05:47.361971 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3382/6733] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:05:47 2022] GET /compute/v2.1/servers/7c7999e0-b905-49f8-9f2b-436ef72096da => generated 1348 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:05:48.391224 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-371bb2aa-c9e2-427b-8acb-f5493741094c tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:05:48.391859 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-371bb2aa-c9e2-427b-8acb-f5493741094c tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] [instance: 7c7999e0-b905-49f8-9f2b-436ef72096da] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:05:48.398854 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-371bb2aa-c9e2-427b-8acb-f5493741094c tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:05:48.399356 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-371bb2aa-c9e2-427b-8acb-f5493741094c tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:05:48.399823 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-371bb2aa-c9e2-427b-8acb-f5493741094c tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:05:48.400530 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-371bb2aa-c9e2-427b-8acb-f5493741094c tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:05:48.401008 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-371bb2aa-c9e2-427b-8acb-f5493741094c tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:05:48.401418 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-371bb2aa-c9e2-427b-8acb-f5493741094c tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:05:48.415327 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-371bb2aa-c9e2-427b-8acb-f5493741094c tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] HTTP exception thrown: Instance 7c7999e0-b905-49f8-9f2b-436ef72096da could not be found. Oct 22 22:05:48.416984 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-371bb2aa-c9e2-427b-8acb-f5493741094c tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Request method failure captured: Oct 22 22:05:48.416984 ncdv-master-1 devstack@n-api.service[138744]: request: GET /compute/v2.1/servers/7c7999e0-b905-49f8-9f2b-436ef72096da HTTP/1.1 Oct 22 22:05:48.416984 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 22:05:48.416984 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 22:05:48.416984 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 22:05:48.416984 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 0 Oct 22 22:05:48.416984 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 22:05:48.416984 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 22:05:48.416984 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 22:05:48.416984 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 22:05:48.416984 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVGf6nsO7KO_P-Lv7m3kWPRG3fXIwCVOUKQ790BCXFliAeAjYLh22C4q6qivMuSAWDCdan3UiFR_BSQTf0fiIJIM3wLmd2DDMOEjq3DJYBmyB2pVkQQKvY_YorpV4dvrzUOJCwETiDbxSXD-pOY8GGBhu2TFWDQCefkXetugM6fmfT9I Oct 22 22:05:48.416984 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 22:05:48.416984 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 22:05:48.416984 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 22:05:48.416984 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 22:05:48.416984 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 22:05:48.416984 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 22:05:48.416984 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: aa75a4498a814ecc86698d0ddac01c2f Oct 22 22:05:48.416984 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-TestMinimumBasicScenario-1689753837 Oct 22 22:05:48.416984 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 22:05:48.416984 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 22:05:48.416984 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_aa75a4498a814ecc86698d0ddac01c2f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/aa75a4498a814ecc86698d0ddac01c2f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/aa75a4498a814ecc86698d0ddac01c2f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/aa75a4498a814ecc86698d0ddac01c2f"}]}] Oct 22 22:05:48.416984 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-TestMinimumBasicScenario-1689753837 Oct 22 22:05:48.416984 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: aa75a4498a814ecc86698d0ddac01c2f Oct 22 22:05:48.416984 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1689753837 Oct 22 22:05:48.416984 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-TestMinimumBasicScenario-1689753837-project Oct 22 22:05:48.416984 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 22:05:48.416984 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 22:05:48.416984 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: 9adcc8a95203462ea78164d4db440351 Oct 22 22:05:48.416984 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-TestMinimumBasicScenario-1689753837-project Oct 22 22:05:48.416984 ncdv-master-1 devstack@n-api.service[138744]: method: > Oct 22 22:05:48.416984 ncdv-master-1 devstack@n-api.service[138744]: exception: Instance 7c7999e0-b905-49f8-9f2b-436ef72096da could not be found. Oct 22 22:05:48.416984 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': '7c7999e0-b905-49f8-9f2b-436ef72096da'} Oct 22 22:05:48.416984 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 22:05:48.416984 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 22:05:48.416984 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 22:05:48.416984 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 22:05:48.416984 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 22:05:48.416984 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 22:05:48.416984 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 22:05:48.416984 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 22:05:48.416984 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 22:05:48.416984 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 22:05:48.416984 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c7999e0-b905-49f8-9f2b-436ef72096da could not be found. Oct 22 22:05:48.416984 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 22:05:48.416984 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 22:05:48.416984 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 22:05:48.416984 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 22:05:48.416984 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 22:05:48.416984 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 22:05:48.416984 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 22:05:48.416984 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 22:05:48.416984 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 22:05:48.416984 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 22:05:48.416984 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 22:05:48.416984 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 22:05:48.416984 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 22:05:48.416984 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 22:05:48.416984 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 22:05:48.416984 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 22:05:48.416984 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c7999e0-b905-49f8-9f2b-436ef72096da could not be found. Oct 22 22:05:48.416984 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 22:05:48.416984 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 22:05:48.416984 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 22:05:48.422499 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 22:05:48.422499 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 22:05:48.422499 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 22:05:48.422499 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 22:05:48.422499 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 22:05:48.422499 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c7999e0-b905-49f8-9f2b-436ef72096da could not be found. Oct 22 22:05:48.422499 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 22:05:48.422499 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-371bb2aa-c9e2-427b-8acb-f5493741094c tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Returning 404 to user: Instance 7c7999e0-b905-49f8-9f2b-436ef72096da could not be found. {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 22:05:48.422499 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-371bb2aa-c9e2-427b-8acb-f5493741094c tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] 10.222.0.18 "GET /compute/v2.1/servers/7c7999e0-b905-49f8-9f2b-436ef72096da" status: 404 len: 111 microversion: 2.1 time: 0.036112 Oct 22 22:05:48.422499 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3352/6734] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:05:48 2022] GET /compute/v2.1/servers/7c7999e0-b905-49f8-9f2b-436ef72096da => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 22:05:48.429563 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-ad7acb2e-7482-44f4-957d-3ee141f58cca tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Calling method '.version_select at 0x7fd39c31ba60>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:05:48.460463 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-ad7acb2e-7482-44f4-957d-3ee141f58cca tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-402786637" status: 202 len: 0 microversion: 2.1 time: 0.036724 Oct 22 22:05:48.461040 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3383/6735] 10.222.0.18 () {58 vars in 1269 bytes} [Sat Oct 22 22:05:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-402786637 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 22:05:57.609848 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-d2cb1f62-3bb4-4c57-9008-8fe2a031af2a tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Action: 'create', calling method: .version_select at 0x7fd39eb4bd30>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1779957509", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMZAP/9D3RyomSpOtOfWUQMVe+kwwCgI99Uyg9xlo2TbeLTAP47YyO3pZ/RGqFCQ/3beBMh6n6MJ6EN8CVvfQmDp8yMKv16cIZZ9Mw6FnjKnBLdh1sBwV5o2fmgTZkPIJg=="}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 22:05:57.627067 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-d2cb1f62-3bb4-4c57-9008-8fe2a031af2a tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Getting quotas for project aa75a4498a814ecc86698d0ddac01c2f. Resources: {'key_pairs'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 22:05:57.633276 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-d2cb1f62-3bb4-4c57-9008-8fe2a031af2a tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Getting quotas for user 9adcc8a95203462ea78164d4db440351 and project aa75a4498a814ecc86698d0ddac01c2f. Resources: {'key_pairs'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 22:05:57.663490 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-d2cb1f62-3bb4-4c57-9008-8fe2a031af2a tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.057601 Oct 22 22:05:57.664096 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3353/6736] 10.222.0.18 () {60 vars in 1159 bytes} [Sat Oct 22 22:05:57 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 22:05:57.714363 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell1:SELECT=42,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:05:57.719368 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-0b3117a8-e833-4a2b-8382-2040d8e4fd29 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1709827547", "imageRef": "2df47481-54bc-44b9-bd38-edebd4e03e5c", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1779957509", "networks": [{"uuid": "20f4a418-66b7-42d9-9ee5-f0791ece1b14"}]}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 22:05:57.772996 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.network.neutron [None req-0b3117a8-e833-4a2b-8382-2040d8e4fd29 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] validate_networks() for [('20f4a418-66b7-42d9-9ee5-f0791ece1b14', None, None, None, None, None)] {{(pid=138745) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 22:05:58.231466 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-0b3117a8-e833-4a2b-8382-2040d8e4fd29 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Flavor limits 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 22:05:58.231911 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-0b3117a8-e833-4a2b-8382-2040d8e4fd29 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Image limits 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 22:05:58.232405 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-0b3117a8-e833-4a2b-8382-2040d8e4fd29 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Flavor pref 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 22:05:58.232834 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-0b3117a8-e833-4a2b-8382-2040d8e4fd29 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Image pref 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 22:05:58.233263 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-0b3117a8-e833-4a2b-8382-2040d8e4fd29 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 22:05:58.242703 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0b3117a8-e833-4a2b-8382-2040d8e4fd29 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:05:58.243202 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0b3117a8-e833-4a2b-8382-2040d8e4fd29 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:05:58.243766 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0b3117a8-e833-4a2b-8382-2040d8e4fd29 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:05:58.244513 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0b3117a8-e833-4a2b-8382-2040d8e4fd29 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:05:58.244978 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0b3117a8-e833-4a2b-8382-2040d8e4fd29 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:05:58.245424 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0b3117a8-e833-4a2b-8382-2040d8e4fd29 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:05:58.262446 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-0b3117a8-e833-4a2b-8382-2040d8e4fd29 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Getting quotas for project aa75a4498a814ecc86698d0ddac01c2f. Resources: {'cores', 'instances', 'ram'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 22:05:58.268043 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-0b3117a8-e833-4a2b-8382-2040d8e4fd29 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Getting quotas for user 9adcc8a95203462ea78164d4db440351 and project aa75a4498a814ecc86698d0ddac01c2f. Resources: {'cores', 'instances', 'ram'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 22:05:58.281709 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-0b3117a8-e833-4a2b-8382-2040d8e4fd29 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Going to run 1 instances... {{(pid=138745) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 22:05:58.284069 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-0b3117a8-e833-4a2b-8382-2040d8e4fd29 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] [instance: e2939456-8793-4020-8eeb-cdd31cdde758] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2df47481-54bc-44b9-bd38-edebd4e03e5c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138745) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 22:05:58.334491 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-0b3117a8-e833-4a2b-8382-2040d8e4fd29 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.621808 Oct 22 22:05:58.335165 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3384/6737] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Oct 22 22:05:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 623 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 22:05:58.347000 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-1c662882-3c07-45c3-a0c1-8f866809abdf tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:05:58.347735 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-1c662882-3c07-45c3-a0c1-8f866809abdf tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] [instance: e2939456-8793-4020-8eeb-cdd31cdde758] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:05:58.407275 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-1c662882-3c07-45c3-a0c1-8f866809abdf tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9adcc8a95203462ea78164d4db440351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa75a4498a814ecc86698d0ddac01c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:05:58.409798 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:SELECT=31,nova_cell1:INSERT=1 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:05:58.416307 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-1c662882-3c07-45c3-a0c1-8f866809abdf tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] 10.222.0.18 "GET /compute/v2.1/servers/e2939456-8793-4020-8eeb-cdd31cdde758" status: 200 len: 1259 microversion: 2.1 time: 0.073415 Oct 22 22:05:58.416899 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3354/6738] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:05:58 2022] GET /compute/v2.1/servers/e2939456-8793-4020-8eeb-cdd31cdde758 => generated 1259 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:05:59.440197 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-7cf7a732-b29c-4169-8a57-c5b4a73ac6fa tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:05:59.441008 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-7cf7a732-b29c-4169-8a57-c5b4a73ac6fa tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] [instance: e2939456-8793-4020-8eeb-cdd31cdde758] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:05:59.449182 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7cf7a732-b29c-4169-8a57-c5b4a73ac6fa tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:05:59.449685 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7cf7a732-b29c-4169-8a57-c5b4a73ac6fa tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:05:59.450158 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7cf7a732-b29c-4169-8a57-c5b4a73ac6fa tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:05:59.450892 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7cf7a732-b29c-4169-8a57-c5b4a73ac6fa tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:05:59.451510 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7cf7a732-b29c-4169-8a57-c5b4a73ac6fa tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:05:59.452170 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7cf7a732-b29c-4169-8a57-c5b4a73ac6fa tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:05:59.523563 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-7cf7a732-b29c-4169-8a57-c5b4a73ac6fa tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9adcc8a95203462ea78164d4db440351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa75a4498a814ecc86698d0ddac01c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:05:59.532159 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-7cf7a732-b29c-4169-8a57-c5b4a73ac6fa tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] 10.222.0.18 "GET /compute/v2.1/servers/e2939456-8793-4020-8eeb-cdd31cdde758" status: 200 len: 1319 microversion: 2.1 time: 0.097630 Oct 22 22:05:59.533199 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3385/6739] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:05:59 2022] GET /compute/v2.1/servers/e2939456-8793-4020-8eeb-cdd31cdde758 => generated 1319 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:06:00.555812 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-9d2317c5-dd65-487c-a484-9f3442b8b128 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:06:00.558217 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-9d2317c5-dd65-487c-a484-9f3442b8b128 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] [instance: e2939456-8793-4020-8eeb-cdd31cdde758] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:06:00.566905 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9d2317c5-dd65-487c-a484-9f3442b8b128 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:06:00.567431 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9d2317c5-dd65-487c-a484-9f3442b8b128 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:06:00.567938 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9d2317c5-dd65-487c-a484-9f3442b8b128 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:06:00.568654 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9d2317c5-dd65-487c-a484-9f3442b8b128 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:06:00.569113 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9d2317c5-dd65-487c-a484-9f3442b8b128 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:06:00.569547 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9d2317c5-dd65-487c-a484-9f3442b8b128 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:06:00.712970 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-9d2317c5-dd65-487c-a484-9f3442b8b128 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9adcc8a95203462ea78164d4db440351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa75a4498a814ecc86698d0ddac01c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:06:00.728959 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-9d2317c5-dd65-487c-a484-9f3442b8b128 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] 10.222.0.18 "GET /compute/v2.1/servers/e2939456-8793-4020-8eeb-cdd31cdde758" status: 200 len: 1359 microversion: 2.1 time: 0.177218 Oct 22 22:06:00.730434 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3355/6740] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:06:00 2022] GET /compute/v2.1/servers/e2939456-8793-4020-8eeb-cdd31cdde758 => generated 1359 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:06:01.752750 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-1754ca10-fca7-4314-b221-399ff538e229 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:06:01.753338 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-1754ca10-fca7-4314-b221-399ff538e229 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] [instance: e2939456-8793-4020-8eeb-cdd31cdde758] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:06:01.760951 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1754ca10-fca7-4314-b221-399ff538e229 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:06:01.761484 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1754ca10-fca7-4314-b221-399ff538e229 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:06:01.761932 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1754ca10-fca7-4314-b221-399ff538e229 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:06:01.762673 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1754ca10-fca7-4314-b221-399ff538e229 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:06:01.763134 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1754ca10-fca7-4314-b221-399ff538e229 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:06:01.763989 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1754ca10-fca7-4314-b221-399ff538e229 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:06:01.908400 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-1754ca10-fca7-4314-b221-399ff538e229 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9adcc8a95203462ea78164d4db440351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa75a4498a814ecc86698d0ddac01c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:06:01.917513 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-1754ca10-fca7-4314-b221-399ff538e229 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] 10.222.0.18 "GET /compute/v2.1/servers/e2939456-8793-4020-8eeb-cdd31cdde758" status: 200 len: 1359 microversion: 2.1 time: 0.168164 Oct 22 22:06:01.918623 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3386/6741] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:06:01 2022] GET /compute/v2.1/servers/e2939456-8793-4020-8eeb-cdd31cdde758 => generated 1359 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:06:02.942167 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-4aaae0bf-4e2a-4aeb-828c-d7f24cf1a5a1 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:06:02.943256 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-4aaae0bf-4e2a-4aeb-828c-d7f24cf1a5a1 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] [instance: e2939456-8793-4020-8eeb-cdd31cdde758] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:06:02.949661 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4aaae0bf-4e2a-4aeb-828c-d7f24cf1a5a1 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:06:02.950137 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4aaae0bf-4e2a-4aeb-828c-d7f24cf1a5a1 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:06:02.950577 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4aaae0bf-4e2a-4aeb-828c-d7f24cf1a5a1 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:06:02.951292 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4aaae0bf-4e2a-4aeb-828c-d7f24cf1a5a1 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:06:02.951800 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4aaae0bf-4e2a-4aeb-828c-d7f24cf1a5a1 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:06:02.952233 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4aaae0bf-4e2a-4aeb-828c-d7f24cf1a5a1 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:06:03.096093 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-4aaae0bf-4e2a-4aeb-828c-d7f24cf1a5a1 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9adcc8a95203462ea78164d4db440351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa75a4498a814ecc86698d0ddac01c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:06:03.104125 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-4aaae0bf-4e2a-4aeb-828c-d7f24cf1a5a1 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] 10.222.0.18 "GET /compute/v2.1/servers/e2939456-8793-4020-8eeb-cdd31cdde758" status: 200 len: 1359 microversion: 2.1 time: 0.166921 Oct 22 22:06:03.104700 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3356/6742] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:06:02 2022] GET /compute/v2.1/servers/e2939456-8793-4020-8eeb-cdd31cdde758 => generated 1359 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:06:04.132430 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-2abc9eb6-6121-4867-877e-54d311f90b07 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:06:04.132430 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-2abc9eb6-6121-4867-877e-54d311f90b07 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] [instance: e2939456-8793-4020-8eeb-cdd31cdde758] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:06:04.132430 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2abc9eb6-6121-4867-877e-54d311f90b07 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:06:04.132430 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2abc9eb6-6121-4867-877e-54d311f90b07 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:06:04.132430 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2abc9eb6-6121-4867-877e-54d311f90b07 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:06:04.132430 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2abc9eb6-6121-4867-877e-54d311f90b07 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:06:04.132430 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2abc9eb6-6121-4867-877e-54d311f90b07 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:06:04.132430 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2abc9eb6-6121-4867-877e-54d311f90b07 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:06:04.296851 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-2abc9eb6-6121-4867-877e-54d311f90b07 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9adcc8a95203462ea78164d4db440351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa75a4498a814ecc86698d0ddac01c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:06:04.305749 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-2abc9eb6-6121-4867-877e-54d311f90b07 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] 10.222.0.18 "GET /compute/v2.1/servers/e2939456-8793-4020-8eeb-cdd31cdde758" status: 200 len: 1359 microversion: 2.1 time: 0.179842 Oct 22 22:06:04.306536 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3387/6743] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:06:04 2022] GET /compute/v2.1/servers/e2939456-8793-4020-8eeb-cdd31cdde758 => generated 1359 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:06:05.330019 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-ab13333d-7673-4851-bb30-01b5d9cbaf32 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:06:05.330675 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-ab13333d-7673-4851-bb30-01b5d9cbaf32 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] [instance: e2939456-8793-4020-8eeb-cdd31cdde758] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:06:05.338898 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ab13333d-7673-4851-bb30-01b5d9cbaf32 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:06:05.339411 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ab13333d-7673-4851-bb30-01b5d9cbaf32 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:06:05.339897 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ab13333d-7673-4851-bb30-01b5d9cbaf32 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:06:05.340624 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ab13333d-7673-4851-bb30-01b5d9cbaf32 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:06:05.341082 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ab13333d-7673-4851-bb30-01b5d9cbaf32 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:06:05.341857 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ab13333d-7673-4851-bb30-01b5d9cbaf32 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:06:05.523359 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-ab13333d-7673-4851-bb30-01b5d9cbaf32 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9adcc8a95203462ea78164d4db440351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa75a4498a814ecc86698d0ddac01c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:06:05.531899 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-ab13333d-7673-4851-bb30-01b5d9cbaf32 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] 10.222.0.18 "GET /compute/v2.1/servers/e2939456-8793-4020-8eeb-cdd31cdde758" status: 200 len: 1359 microversion: 2.1 time: 0.205857 Oct 22 22:06:05.532476 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3357/6744] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:06:05 2022] GET /compute/v2.1/servers/e2939456-8793-4020-8eeb-cdd31cdde758 => generated 1359 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:06:06.558566 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-83db560e-3291-4144-9aa4-fd09e41d16e4 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:06:06.560021 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-83db560e-3291-4144-9aa4-fd09e41d16e4 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] [instance: e2939456-8793-4020-8eeb-cdd31cdde758] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:06:06.568953 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-83db560e-3291-4144-9aa4-fd09e41d16e4 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:06:06.569470 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-83db560e-3291-4144-9aa4-fd09e41d16e4 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:06:06.569927 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-83db560e-3291-4144-9aa4-fd09e41d16e4 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:06:06.570655 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-83db560e-3291-4144-9aa4-fd09e41d16e4 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:06:06.571188 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-83db560e-3291-4144-9aa4-fd09e41d16e4 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:06:06.571608 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-83db560e-3291-4144-9aa4-fd09e41d16e4 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:06:06.706214 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-83db560e-3291-4144-9aa4-fd09e41d16e4 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9adcc8a95203462ea78164d4db440351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa75a4498a814ecc86698d0ddac01c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:06:06.714487 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-83db560e-3291-4144-9aa4-fd09e41d16e4 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] 10.222.0.18 "GET /compute/v2.1/servers/e2939456-8793-4020-8eeb-cdd31cdde758" status: 200 len: 1359 microversion: 2.1 time: 0.159962 Oct 22 22:06:06.715301 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3388/6745] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:06:06 2022] GET /compute/v2.1/servers/e2939456-8793-4020-8eeb-cdd31cdde758 => generated 1359 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:06:07.742850 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-92317a38-a9c4-4ea6-a1e3-60204e8d0124 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:06:07.743959 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-92317a38-a9c4-4ea6-a1e3-60204e8d0124 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] [instance: e2939456-8793-4020-8eeb-cdd31cdde758] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:06:07.753804 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-92317a38-a9c4-4ea6-a1e3-60204e8d0124 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:06:07.754295 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-92317a38-a9c4-4ea6-a1e3-60204e8d0124 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:06:07.754733 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-92317a38-a9c4-4ea6-a1e3-60204e8d0124 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:06:07.755475 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-92317a38-a9c4-4ea6-a1e3-60204e8d0124 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:06:07.755930 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-92317a38-a9c4-4ea6-a1e3-60204e8d0124 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:06:07.756359 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-92317a38-a9c4-4ea6-a1e3-60204e8d0124 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:06:07.895114 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-92317a38-a9c4-4ea6-a1e3-60204e8d0124 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9adcc8a95203462ea78164d4db440351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa75a4498a814ecc86698d0ddac01c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:06:07.903169 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-92317a38-a9c4-4ea6-a1e3-60204e8d0124 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] 10.222.0.18 "GET /compute/v2.1/servers/e2939456-8793-4020-8eeb-cdd31cdde758" status: 200 len: 1359 microversion: 2.1 time: 0.166929 Oct 22 22:06:07.903686 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3358/6746] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:06:07 2022] GET /compute/v2.1/servers/e2939456-8793-4020-8eeb-cdd31cdde758 => generated 1359 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:06:08.930200 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-67836674-a9d6-4c70-9883-297915f85e53 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:06:08.931138 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-67836674-a9d6-4c70-9883-297915f85e53 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] [instance: e2939456-8793-4020-8eeb-cdd31cdde758] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:06:08.935403 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell0:SELECT=2 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:06:08.936488 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell0:SELECT=6 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:06:08.945702 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-67836674-a9d6-4c70-9883-297915f85e53 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:06:08.946430 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-67836674-a9d6-4c70-9883-297915f85e53 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:06:08.947118 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-67836674-a9d6-4c70-9883-297915f85e53 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:06:08.948218 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-67836674-a9d6-4c70-9883-297915f85e53 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:06:08.948886 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-67836674-a9d6-4c70-9883-297915f85e53 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:06:08.949512 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-67836674-a9d6-4c70-9883-297915f85e53 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:06:09.094764 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-67836674-a9d6-4c70-9883-297915f85e53 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9adcc8a95203462ea78164d4db440351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa75a4498a814ecc86698d0ddac01c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:06:09.103289 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-67836674-a9d6-4c70-9883-297915f85e53 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] 10.222.0.18 "GET /compute/v2.1/servers/e2939456-8793-4020-8eeb-cdd31cdde758" status: 200 len: 1359 microversion: 2.1 time: 0.179383 Oct 22 22:06:09.103908 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3389/6747] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:06:08 2022] GET /compute/v2.1/servers/e2939456-8793-4020-8eeb-cdd31cdde758 => generated 1359 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:06:10.131026 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-b7426eba-fbdc-498b-ac76-3e0dcf332c03 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:06:10.131969 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-b7426eba-fbdc-498b-ac76-3e0dcf332c03 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] [instance: e2939456-8793-4020-8eeb-cdd31cdde758] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:06:10.135804 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell0:SELECT=6 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:06:10.143671 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b7426eba-fbdc-498b-ac76-3e0dcf332c03 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:06:10.144955 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b7426eba-fbdc-498b-ac76-3e0dcf332c03 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:06:10.144955 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b7426eba-fbdc-498b-ac76-3e0dcf332c03 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:06:10.145595 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b7426eba-fbdc-498b-ac76-3e0dcf332c03 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:06:10.146032 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b7426eba-fbdc-498b-ac76-3e0dcf332c03 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:06:10.146936 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b7426eba-fbdc-498b-ac76-3e0dcf332c03 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:06:10.281631 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-b7426eba-fbdc-498b-ac76-3e0dcf332c03 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9adcc8a95203462ea78164d4db440351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa75a4498a814ecc86698d0ddac01c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:06:10.293721 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-b7426eba-fbdc-498b-ac76-3e0dcf332c03 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] 10.222.0.18 "GET /compute/v2.1/servers/e2939456-8793-4020-8eeb-cdd31cdde758" status: 200 len: 1359 microversion: 2.1 time: 0.169482 Oct 22 22:06:10.294318 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3359/6748] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:06:10 2022] GET /compute/v2.1/servers/e2939456-8793-4020-8eeb-cdd31cdde758 => generated 1359 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:06:10.812823 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-9fdb0be6-4d48-4b6a-8b45-8d5fdf6018e0 req-2d5436c1-91ed-4024-8479-b0179b4c8634 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2939456-8793-4020-8eeb-cdd31cdde758", "tag": "0f3bf0de-aade-4c8b-b6e4-7651ff9d7a43"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 22:06:10.824228 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-9fdb0be6-4d48-4b6a-8b45-8d5fdf6018e0 req-2d5436c1-91ed-4024-8479-b0179b4c8634 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:06:10.824760 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-9fdb0be6-4d48-4b6a-8b45-8d5fdf6018e0 req-2d5436c1-91ed-4024-8479-b0179b4c8634 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:06:10.825201 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-9fdb0be6-4d48-4b6a-8b45-8d5fdf6018e0 req-2d5436c1-91ed-4024-8479-b0179b4c8634 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:06:10.837276 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-9fdb0be6-4d48-4b6a-8b45-8d5fdf6018e0 req-2d5436c1-91ed-4024-8479-b0179b4c8634 service nova] Creating event network-changed:0f3bf0de-aade-4c8b-b6e4-7651ff9d7a43 for instance e2939456-8793-4020-8eeb-cdd31cdde758 on nch1-master-1 Oct 22 22:06:10.843089 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-9fdb0be6-4d48-4b6a-8b45-8d5fdf6018e0 req-2d5436c1-91ed-4024-8479-b0179b4c8634 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033831 Oct 22 22:06:10.843606 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3390/6749] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 22:06:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 22:06:11.317704 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-ff883881-6766-4736-ba64-184da0c05b19 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:06:11.318343 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-ff883881-6766-4736-ba64-184da0c05b19 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] [instance: e2939456-8793-4020-8eeb-cdd31cdde758] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:06:11.321207 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=1 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:06:11.327766 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ff883881-6766-4736-ba64-184da0c05b19 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:06:11.328366 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ff883881-6766-4736-ba64-184da0c05b19 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:06:11.328943 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ff883881-6766-4736-ba64-184da0c05b19 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:06:11.329662 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ff883881-6766-4736-ba64-184da0c05b19 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:06:11.330127 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ff883881-6766-4736-ba64-184da0c05b19 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:06:11.330560 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ff883881-6766-4736-ba64-184da0c05b19 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:06:11.465390 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-ff883881-6766-4736-ba64-184da0c05b19 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9adcc8a95203462ea78164d4db440351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa75a4498a814ecc86698d0ddac01c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:06:11.474038 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-ff883881-6766-4736-ba64-184da0c05b19 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] 10.222.0.18 "GET /compute/v2.1/servers/e2939456-8793-4020-8eeb-cdd31cdde758" status: 200 len: 1359 microversion: 2.1 time: 0.160488 Oct 22 22:06:11.474637 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3360/6750] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:06:11 2022] GET /compute/v2.1/servers/e2939456-8793-4020-8eeb-cdd31cdde758 => generated 1359 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:06:12.512393 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-f8954381-562e-4a03-87d6-f3c9d3d577ed tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:06:12.513576 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-f8954381-562e-4a03-87d6-f3c9d3d577ed tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] [instance: e2939456-8793-4020-8eeb-cdd31cdde758] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:06:12.516504 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:06:12.522220 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f8954381-562e-4a03-87d6-f3c9d3d577ed tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:06:12.522719 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f8954381-562e-4a03-87d6-f3c9d3d577ed tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:06:12.523171 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f8954381-562e-4a03-87d6-f3c9d3d577ed tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:06:12.523912 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f8954381-562e-4a03-87d6-f3c9d3d577ed tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:06:12.524377 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f8954381-562e-4a03-87d6-f3c9d3d577ed tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:06:12.524816 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f8954381-562e-4a03-87d6-f3c9d3d577ed tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:06:12.660360 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-f8954381-562e-4a03-87d6-f3c9d3d577ed tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9adcc8a95203462ea78164d4db440351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa75a4498a814ecc86698d0ddac01c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:06:12.668663 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-f8954381-562e-4a03-87d6-f3c9d3d577ed tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] 10.222.0.18 "GET /compute/v2.1/servers/e2939456-8793-4020-8eeb-cdd31cdde758" status: 200 len: 1359 microversion: 2.1 time: 0.164854 Oct 22 22:06:12.669234 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3391/6751] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:06:12 2022] GET /compute/v2.1/servers/e2939456-8793-4020-8eeb-cdd31cdde758 => generated 1359 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:06:13.692369 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-e3d6a687-387d-4ce4-b367-8463b8647477 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:06:13.692989 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-e3d6a687-387d-4ce4-b367-8463b8647477 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] [instance: e2939456-8793-4020-8eeb-cdd31cdde758] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:06:13.700383 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e3d6a687-387d-4ce4-b367-8463b8647477 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:06:13.700877 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e3d6a687-387d-4ce4-b367-8463b8647477 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:06:13.701319 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e3d6a687-387d-4ce4-b367-8463b8647477 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:06:13.702020 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e3d6a687-387d-4ce4-b367-8463b8647477 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:06:13.702479 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e3d6a687-387d-4ce4-b367-8463b8647477 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:06:13.702914 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e3d6a687-387d-4ce4-b367-8463b8647477 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:06:13.846825 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-e3d6a687-387d-4ce4-b367-8463b8647477 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9adcc8a95203462ea78164d4db440351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa75a4498a814ecc86698d0ddac01c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:06:13.858494 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-e3d6a687-387d-4ce4-b367-8463b8647477 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] 10.222.0.18 "GET /compute/v2.1/servers/e2939456-8793-4020-8eeb-cdd31cdde758" status: 200 len: 1359 microversion: 2.1 time: 0.169816 Oct 22 22:06:13.859579 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3361/6752] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:06:13 2022] GET /compute/v2.1/servers/e2939456-8793-4020-8eeb-cdd31cdde758 => generated 1359 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:06:14.886576 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-fc953319-7eba-40b3-af8d-eab0ee0a92f7 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:06:14.887725 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-fc953319-7eba-40b3-af8d-eab0ee0a92f7 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] [instance: e2939456-8793-4020-8eeb-cdd31cdde758] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:06:14.896339 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fc953319-7eba-40b3-af8d-eab0ee0a92f7 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:06:14.896846 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fc953319-7eba-40b3-af8d-eab0ee0a92f7 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:06:14.897307 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fc953319-7eba-40b3-af8d-eab0ee0a92f7 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:06:14.898033 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fc953319-7eba-40b3-af8d-eab0ee0a92f7 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:06:14.898504 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fc953319-7eba-40b3-af8d-eab0ee0a92f7 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:06:14.898956 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fc953319-7eba-40b3-af8d-eab0ee0a92f7 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:06:15.037056 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-fc953319-7eba-40b3-af8d-eab0ee0a92f7 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9adcc8a95203462ea78164d4db440351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa75a4498a814ecc86698d0ddac01c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:06:15.045078 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-fc953319-7eba-40b3-af8d-eab0ee0a92f7 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] 10.222.0.18 "GET /compute/v2.1/servers/e2939456-8793-4020-8eeb-cdd31cdde758" status: 200 len: 1359 microversion: 2.1 time: 0.165594 Oct 22 22:06:15.045665 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3392/6753] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:06:14 2022] GET /compute/v2.1/servers/e2939456-8793-4020-8eeb-cdd31cdde758 => generated 1359 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:06:16.068653 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-c7faae36-4b81-4ce9-915c-de52e6607e14 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:06:16.069324 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-c7faae36-4b81-4ce9-915c-de52e6607e14 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] [instance: e2939456-8793-4020-8eeb-cdd31cdde758] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:06:16.077472 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c7faae36-4b81-4ce9-915c-de52e6607e14 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:06:16.078017 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c7faae36-4b81-4ce9-915c-de52e6607e14 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:06:16.078513 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c7faae36-4b81-4ce9-915c-de52e6607e14 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:06:16.079404 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c7faae36-4b81-4ce9-915c-de52e6607e14 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:06:16.079888 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c7faae36-4b81-4ce9-915c-de52e6607e14 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:06:16.080326 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c7faae36-4b81-4ce9-915c-de52e6607e14 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:06:16.225884 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-c7faae36-4b81-4ce9-915c-de52e6607e14 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9adcc8a95203462ea78164d4db440351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa75a4498a814ecc86698d0ddac01c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:06:16.237227 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-c7faae36-4b81-4ce9-915c-de52e6607e14 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] 10.222.0.18 "GET /compute/v2.1/servers/e2939456-8793-4020-8eeb-cdd31cdde758" status: 200 len: 1359 microversion: 2.1 time: 0.173101 Oct 22 22:06:16.237802 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3362/6754] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:06:16 2022] GET /compute/v2.1/servers/e2939456-8793-4020-8eeb-cdd31cdde758 => generated 1359 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:06:17.260955 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-54ac1ad8-3d24-4bcf-a46b-a9c387705952 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:06:17.261592 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-54ac1ad8-3d24-4bcf-a46b-a9c387705952 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] [instance: e2939456-8793-4020-8eeb-cdd31cdde758] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:06:17.269574 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-54ac1ad8-3d24-4bcf-a46b-a9c387705952 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:06:17.270094 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-54ac1ad8-3d24-4bcf-a46b-a9c387705952 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:06:17.270566 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-54ac1ad8-3d24-4bcf-a46b-a9c387705952 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:06:17.271311 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-54ac1ad8-3d24-4bcf-a46b-a9c387705952 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:06:17.271946 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-54ac1ad8-3d24-4bcf-a46b-a9c387705952 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:06:17.272498 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-54ac1ad8-3d24-4bcf-a46b-a9c387705952 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:06:17.405129 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-54ac1ad8-3d24-4bcf-a46b-a9c387705952 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9adcc8a95203462ea78164d4db440351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa75a4498a814ecc86698d0ddac01c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:06:17.413710 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-54ac1ad8-3d24-4bcf-a46b-a9c387705952 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] 10.222.0.18 "GET /compute/v2.1/servers/e2939456-8793-4020-8eeb-cdd31cdde758" status: 200 len: 1359 microversion: 2.1 time: 0.156793 Oct 22 22:06:17.414378 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3393/6755] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:06:17 2022] GET /compute/v2.1/servers/e2939456-8793-4020-8eeb-cdd31cdde758 => generated 1359 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:06:17.502815 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-693985d6-c985-47ce-a388-266df2879e88 req-2f271737-1e99-4356-a756-26a455a2ca36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2939456-8793-4020-8eeb-cdd31cdde758", "name": "network-vif-plugged", "status": "completed", "tag": "0f3bf0de-aade-4c8b-b6e4-7651ff9d7a43"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 22:06:17.513710 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-693985d6-c985-47ce-a388-266df2879e88 req-2f271737-1e99-4356-a756-26a455a2ca36 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:06:17.514381 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-693985d6-c985-47ce-a388-266df2879e88 req-2f271737-1e99-4356-a756-26a455a2ca36 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:06:17.514862 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-693985d6-c985-47ce-a388-266df2879e88 req-2f271737-1e99-4356-a756-26a455a2ca36 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:06:17.526644 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-693985d6-c985-47ce-a388-266df2879e88 req-2f271737-1e99-4356-a756-26a455a2ca36 service nova] Creating event network-vif-plugged:0f3bf0de-aade-4c8b-b6e4-7651ff9d7a43 for instance e2939456-8793-4020-8eeb-cdd31cdde758 on nch1-master-1 Oct 22 22:06:17.532160 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-693985d6-c985-47ce-a388-266df2879e88 req-2f271737-1e99-4356-a756-26a455a2ca36 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094529 Oct 22 22:06:17.533015 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3363/6756] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 22:06:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 22:06:18.442695 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-469ab6d9-d1a6-4f28-b82e-b67f9eeffe9b tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:06:18.443838 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-469ab6d9-d1a6-4f28-b82e-b67f9eeffe9b tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] [instance: e2939456-8793-4020-8eeb-cdd31cdde758] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:06:18.455564 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-469ab6d9-d1a6-4f28-b82e-b67f9eeffe9b tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:06:18.456078 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-469ab6d9-d1a6-4f28-b82e-b67f9eeffe9b tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:06:18.456545 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-469ab6d9-d1a6-4f28-b82e-b67f9eeffe9b tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:06:18.457273 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-469ab6d9-d1a6-4f28-b82e-b67f9eeffe9b tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:06:18.457746 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-469ab6d9-d1a6-4f28-b82e-b67f9eeffe9b tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:06:18.458197 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-469ab6d9-d1a6-4f28-b82e-b67f9eeffe9b tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:06:18.586683 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-469ab6d9-d1a6-4f28-b82e-b67f9eeffe9b tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9adcc8a95203462ea78164d4db440351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa75a4498a814ecc86698d0ddac01c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:06:18.595070 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-469ab6d9-d1a6-4f28-b82e-b67f9eeffe9b tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] 10.222.0.18 "GET /compute/v2.1/servers/e2939456-8793-4020-8eeb-cdd31cdde758" status: 200 len: 1359 microversion: 2.1 time: 0.159404 Oct 22 22:06:18.595886 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3394/6757] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:06:18 2022] GET /compute/v2.1/servers/e2939456-8793-4020-8eeb-cdd31cdde758 => generated 1359 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:06:19.627123 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-f5b22c2b-da11-4a6c-9717-fc0088660a39 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:06:19.627757 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-f5b22c2b-da11-4a6c-9717-fc0088660a39 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] [instance: e2939456-8793-4020-8eeb-cdd31cdde758] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:06:19.635417 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f5b22c2b-da11-4a6c-9717-fc0088660a39 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:06:19.635929 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f5b22c2b-da11-4a6c-9717-fc0088660a39 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:06:19.636369 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f5b22c2b-da11-4a6c-9717-fc0088660a39 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:06:19.637076 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f5b22c2b-da11-4a6c-9717-fc0088660a39 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:06:19.637527 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f5b22c2b-da11-4a6c-9717-fc0088660a39 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:06:19.637948 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f5b22c2b-da11-4a6c-9717-fc0088660a39 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:06:19.774439 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-f5b22c2b-da11-4a6c-9717-fc0088660a39 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9adcc8a95203462ea78164d4db440351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa75a4498a814ecc86698d0ddac01c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:06:19.782759 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-f5b22c2b-da11-4a6c-9717-fc0088660a39 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] 10.222.0.18 "GET /compute/v2.1/servers/e2939456-8793-4020-8eeb-cdd31cdde758" status: 200 len: 1549 microversion: 2.1 time: 0.163220 Oct 22 22:06:19.783375 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3364/6758] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:06:19 2022] GET /compute/v2.1/servers/e2939456-8793-4020-8eeb-cdd31cdde758 => generated 1549 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:06:19.805870 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-51d15309-3840-401e-b915-d01f79ca5cc6 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:06:19.806483 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-51d15309-3840-401e-b915-d01f79ca5cc6 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] [instance: e2939456-8793-4020-8eeb-cdd31cdde758] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:06:19.813864 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-51d15309-3840-401e-b915-d01f79ca5cc6 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:06:19.814395 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-51d15309-3840-401e-b915-d01f79ca5cc6 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:06:19.814859 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-51d15309-3840-401e-b915-d01f79ca5cc6 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:06:19.815615 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-51d15309-3840-401e-b915-d01f79ca5cc6 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:06:19.816090 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-51d15309-3840-401e-b915-d01f79ca5cc6 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:06:19.816539 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-51d15309-3840-401e-b915-d01f79ca5cc6 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:06:19.962832 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-51d15309-3840-401e-b915-d01f79ca5cc6 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9adcc8a95203462ea78164d4db440351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa75a4498a814ecc86698d0ddac01c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:06:19.971567 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-51d15309-3840-401e-b915-d01f79ca5cc6 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] 10.222.0.18 "GET /compute/v2.1/servers/e2939456-8793-4020-8eeb-cdd31cdde758" status: 200 len: 1549 microversion: 2.1 time: 0.169613 Oct 22 22:06:19.972148 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3395/6759] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:06:19 2022] GET /compute/v2.1/servers/e2939456-8793-4020-8eeb-cdd31cdde758 => generated 1549 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:06:19.996128 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-399fb53d-587c-40dc-a20a-e2ba3f5bad1a tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:06:20.003858 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-399fb53d-587c-40dc-a20a-e2ba3f5bad1a tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9adcc8a95203462ea78164d4db440351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa75a4498a814ecc86698d0ddac01c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:06:20.005124 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-399fb53d-587c-40dc-a20a-e2ba3f5bad1a tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Searching by: {'deleted': False, 'project_id': 'aa75a4498a814ecc86698d0ddac01c2f'} {{(pid=138744) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 22 22:06:20.013559 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-399fb53d-587c-40dc-a20a-e2ba3f5bad1a tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:06:20.014345 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-399fb53d-587c-40dc-a20a-e2ba3f5bad1a tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:06:20.015062 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-399fb53d-587c-40dc-a20a-e2ba3f5bad1a tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:06:20.016297 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-399fb53d-587c-40dc-a20a-e2ba3f5bad1a tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:06:20.017054 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-399fb53d-587c-40dc-a20a-e2ba3f5bad1a tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:06:20.017922 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-399fb53d-587c-40dc-a20a-e2ba3f5bad1a tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:06:20.042160 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.multi_cell_list [None req-399fb53d-587c-40dc-a20a-e2ba3f5bad1a tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=138744) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 22 22:06:20.069287 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-399fb53d-587c-40dc-a20a-e2ba3f5bad1a tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] 10.222.0.18 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.078837 Oct 22 22:06:20.069875 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3365/6760] 10.222.0.18 () {58 vars in 1125 bytes} [Sat Oct 22 22:06:19 2022] GET /compute/v2.1/servers => generated 343 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 22:06:20.082160 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-33d5f3df-1c97-49b6-ac45-f6a69972e420 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:06:20.082792 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-33d5f3df-1c97-49b6-ac45-f6a69972e420 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] [instance: e2939456-8793-4020-8eeb-cdd31cdde758] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:06:20.089266 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-33d5f3df-1c97-49b6-ac45-f6a69972e420 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:06:20.089755 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-33d5f3df-1c97-49b6-ac45-f6a69972e420 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:06:20.090214 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-33d5f3df-1c97-49b6-ac45-f6a69972e420 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:06:20.090931 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-33d5f3df-1c97-49b6-ac45-f6a69972e420 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:06:20.091786 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-33d5f3df-1c97-49b6-ac45-f6a69972e420 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:06:20.092232 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-33d5f3df-1c97-49b6-ac45-f6a69972e420 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:06:20.229272 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-33d5f3df-1c97-49b6-ac45-f6a69972e420 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9adcc8a95203462ea78164d4db440351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa75a4498a814ecc86698d0ddac01c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:06:20.237663 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-33d5f3df-1c97-49b6-ac45-f6a69972e420 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] 10.222.0.18 "GET /compute/v2.1/servers/e2939456-8793-4020-8eeb-cdd31cdde758" status: 200 len: 1549 microversion: 2.1 time: 0.159582 Oct 22 22:06:20.238253 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3396/6761] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:06:20 2022] GET /compute/v2.1/servers/e2939456-8793-4020-8eeb-cdd31cdde758 => generated 1549 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:06:21.796531 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-ea492a8f-764e-46a7-8e4c-1221e14a3d34 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "84e9205b-2498-48cc-a7ff-baf3221bc72d"}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 22:06:21.799014 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-ea492a8f-764e-46a7-8e4c-1221e14a3d34 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] [instance: e2939456-8793-4020-8eeb-cdd31cdde758] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:06:21.806273 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ea492a8f-764e-46a7-8e4c-1221e14a3d34 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:06:21.806772 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ea492a8f-764e-46a7-8e4c-1221e14a3d34 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:06:21.807220 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ea492a8f-764e-46a7-8e4c-1221e14a3d34 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:06:21.807959 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ea492a8f-764e-46a7-8e4c-1221e14a3d34 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:06:21.808423 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ea492a8f-764e-46a7-8e4c-1221e14a3d34 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:06:21.808858 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ea492a8f-764e-46a7-8e4c-1221e14a3d34 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:06:22.084363 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-ea492a8f-764e-46a7-8e4c-1221e14a3d34 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] 10.222.0.18 "POST /compute/v2.1/servers/e2939456-8793-4020-8eeb-cdd31cdde758/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.291871 Oct 22 22:06:22.085016 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3366/6762] 10.222.0.18 () {60 vars in 1323 bytes} [Sat Oct 22 22:06:21 2022] POST /compute/v2.1/servers/e2939456-8793-4020-8eeb-cdd31cdde758/os-volume_attachments => generated 194 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 22:06:25.482120 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-0ffba302-4cfd-425a-b0b8-72d5e801720e tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:06:25.482713 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-0ffba302-4cfd-425a-b0b8-72d5e801720e tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] [instance: e2939456-8793-4020-8eeb-cdd31cdde758] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:06:25.490118 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0ffba302-4cfd-425a-b0b8-72d5e801720e tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:06:25.490631 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0ffba302-4cfd-425a-b0b8-72d5e801720e tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:06:25.491096 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0ffba302-4cfd-425a-b0b8-72d5e801720e tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:06:25.491864 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0ffba302-4cfd-425a-b0b8-72d5e801720e tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:06:25.492345 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0ffba302-4cfd-425a-b0b8-72d5e801720e tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:06:25.492797 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0ffba302-4cfd-425a-b0b8-72d5e801720e tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:06:25.625855 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-0ffba302-4cfd-425a-b0b8-72d5e801720e tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9adcc8a95203462ea78164d4db440351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa75a4498a814ecc86698d0ddac01c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:06:25.635133 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-0ffba302-4cfd-425a-b0b8-72d5e801720e tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] 10.222.0.18 "GET /compute/v2.1/servers/e2939456-8793-4020-8eeb-cdd31cdde758" status: 200 len: 1595 microversion: 2.1 time: 0.156966 Oct 22 22:06:25.635844 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3397/6763] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:06:25 2022] GET /compute/v2.1/servers/e2939456-8793-4020-8eeb-cdd31cdde758 => generated 1595 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:06:27.615871 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-17f0a6dc-9a28-4f64-afa1-f1963bc9b564 req-bd839a54-bd14-47ff-a7f0-debd98485f40 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2939456-8793-4020-8eeb-cdd31cdde758", "tag": "0f3bf0de-aade-4c8b-b6e4-7651ff9d7a43"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 22:06:27.626075 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-17f0a6dc-9a28-4f64-afa1-f1963bc9b564 req-bd839a54-bd14-47ff-a7f0-debd98485f40 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:06:27.626994 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-17f0a6dc-9a28-4f64-afa1-f1963bc9b564 req-bd839a54-bd14-47ff-a7f0-debd98485f40 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:06:27.627561 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-17f0a6dc-9a28-4f64-afa1-f1963bc9b564 req-bd839a54-bd14-47ff-a7f0-debd98485f40 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:06:27.652802 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-17f0a6dc-9a28-4f64-afa1-f1963bc9b564 req-bd839a54-bd14-47ff-a7f0-debd98485f40 service nova] Creating event network-changed:0f3bf0de-aade-4c8b-b6e4-7651ff9d7a43 for instance e2939456-8793-4020-8eeb-cdd31cdde758 on nch1-master-1 Oct 22 22:06:27.658863 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-17f0a6dc-9a28-4f64-afa1-f1963bc9b564 req-bd839a54-bd14-47ff-a7f0-debd98485f40 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047991 Oct 22 22:06:27.659863 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3367/6764] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 22:06:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 22:06:28.750512 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-cb9d875c-acc6-4882-9a07-c4ebadcc0210 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1656699178"}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 22:06:28.751073 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-cb9d875c-acc6-4882-9a07-c4ebadcc0210 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] [instance: e2939456-8793-4020-8eeb-cdd31cdde758] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:06:28.758528 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cb9d875c-acc6-4882-9a07-c4ebadcc0210 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:06:28.758999 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cb9d875c-acc6-4882-9a07-c4ebadcc0210 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:06:28.759482 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cb9d875c-acc6-4882-9a07-c4ebadcc0210 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:06:28.760194 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cb9d875c-acc6-4882-9a07-c4ebadcc0210 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:06:28.760663 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cb9d875c-acc6-4882-9a07-c4ebadcc0210 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:06:28.761103 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cb9d875c-acc6-4882-9a07-c4ebadcc0210 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:06:28.764790 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell1:SELECT=77 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:06:28.890827 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.network.security_group_api [None req-cb9d875c-acc6-4882-9a07-c4ebadcc0210 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Adding security group 3f122fc7-4972-46ed-9ee0-23df2d127ea4 to port 0f3bf0de-aade-4c8b-b6e4-7651ff9d7a43 Oct 22 22:06:29.206519 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-cb9d875c-acc6-4882-9a07-c4ebadcc0210 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] 10.222.0.18 "POST /compute/v2.1/servers/e2939456-8793-4020-8eeb-cdd31cdde758/action" status: 202 len: 0 microversion: 2.1 time: 0.459971 Oct 22 22:06:29.207647 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3398/6765] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 22:06:28 2022] POST /compute/v2.1/servers/e2939456-8793-4020-8eeb-cdd31cdde758/action => generated 0 bytes in 462 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 22 22:06:29.217460 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-69c40477-b75e-4f0f-bbe3-842b90c3a218 req-6748e8ae-9f6d-4bb9-8bd1-dab7bb7b5c6a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2939456-8793-4020-8eeb-cdd31cdde758", "tag": "0f3bf0de-aade-4c8b-b6e4-7651ff9d7a43"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 22:06:29.223732 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-ff56f00a-fb59-4401-9277-54974393a088 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:06:29.229475 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-ff56f00a-fb59-4401-9277-54974393a088 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] [instance: e2939456-8793-4020-8eeb-cdd31cdde758] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:06:29.237525 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-69c40477-b75e-4f0f-bbe3-842b90c3a218 req-6748e8ae-9f6d-4bb9-8bd1-dab7bb7b5c6a service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:06:29.240135 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-69c40477-b75e-4f0f-bbe3-842b90c3a218 req-6748e8ae-9f6d-4bb9-8bd1-dab7bb7b5c6a service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:06:29.240565 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-69c40477-b75e-4f0f-bbe3-842b90c3a218 req-6748e8ae-9f6d-4bb9-8bd1-dab7bb7b5c6a service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:06:29.244757 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ff56f00a-fb59-4401-9277-54974393a088 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:06:29.245248 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ff56f00a-fb59-4401-9277-54974393a088 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:06:29.245918 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ff56f00a-fb59-4401-9277-54974393a088 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:06:29.246659 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ff56f00a-fb59-4401-9277-54974393a088 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:06:29.247121 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ff56f00a-fb59-4401-9277-54974393a088 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:06:29.247585 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ff56f00a-fb59-4401-9277-54974393a088 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:06:29.261970 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-69c40477-b75e-4f0f-bbe3-842b90c3a218 req-6748e8ae-9f6d-4bb9-8bd1-dab7bb7b5c6a service nova] Creating event network-changed:0f3bf0de-aade-4c8b-b6e4-7651ff9d7a43 for instance e2939456-8793-4020-8eeb-cdd31cdde758 on nch1-master-1 Oct 22 22:06:29.273811 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-69c40477-b75e-4f0f-bbe3-842b90c3a218 req-6748e8ae-9f6d-4bb9-8bd1-dab7bb7b5c6a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061456 Oct 22 22:06:29.278290 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3368/6766] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 22:06:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 22:06:29.414182 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-ff56f00a-fb59-4401-9277-54974393a088 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9adcc8a95203462ea78164d4db440351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa75a4498a814ecc86698d0ddac01c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:06:29.423844 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-ff56f00a-fb59-4401-9277-54974393a088 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] 10.222.0.18 "GET /compute/v2.1/servers/e2939456-8793-4020-8eeb-cdd31cdde758" status: 200 len: 1761 microversion: 2.1 time: 0.203997 Oct 22 22:06:29.424447 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3399/6767] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:06:29 2022] GET /compute/v2.1/servers/e2939456-8793-4020-8eeb-cdd31cdde758 => generated 1761 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:07:29.926233 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell0:SELECT=2 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:07:29.928665 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_api:SELECT=17 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:07:29.929696 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:07:29.931029 ncdv-master-1 devstack@n-api.service[138744]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 22 22:07:29.931291 ncdv-master-1 devstack@n-api.service[138744]: Sat Oct 22 22:07:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e2939456-8793-4020-8eeb-cdd31cdde758/action (ip 10.222.0.18) !!! Oct 22 22:07:29.940820 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-90544743-f075-404c-bc33-eee6234124b0 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 22:07:29.943122 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-90544743-f075-404c-bc33-eee6234124b0 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] [instance: e2939456-8793-4020-8eeb-cdd31cdde758] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:07:29.953124 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-90544743-f075-404c-bc33-eee6234124b0 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:07:29.953612 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-90544743-f075-404c-bc33-eee6234124b0 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:07:29.954052 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-90544743-f075-404c-bc33-eee6234124b0 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:07:29.954730 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-90544743-f075-404c-bc33-eee6234124b0 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:07:29.955238 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-90544743-f075-404c-bc33-eee6234124b0 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:07:29.955756 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-90544743-f075-404c-bc33-eee6234124b0 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:07:30.039690 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-90544743-f075-404c-bc33-eee6234124b0 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] 10.222.0.18 "POST /compute/v2.1/servers/e2939456-8793-4020-8eeb-cdd31cdde758/action" status: 202 len: 0 microversion: 2.1 time: 0.116743 Oct 22 22:07:30.040372 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3369/6768] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 22:07:29 2022] POST /compute/v2.1/servers/e2939456-8793-4020-8eeb-cdd31cdde758/action => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 22:07:30.046863 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_api:SELECT=17 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:07:30.047793 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell1:SELECT=9 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:07:30.052716 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-a6f63f22-1ef0-44e8-a404-6070097bc284 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:07:30.053422 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-a6f63f22-1ef0-44e8-a404-6070097bc284 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] [instance: e2939456-8793-4020-8eeb-cdd31cdde758] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:07:30.061501 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a6f63f22-1ef0-44e8-a404-6070097bc284 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:07:30.062030 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a6f63f22-1ef0-44e8-a404-6070097bc284 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:07:30.062516 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a6f63f22-1ef0-44e8-a404-6070097bc284 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:07:30.063313 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a6f63f22-1ef0-44e8-a404-6070097bc284 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:07:30.063834 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a6f63f22-1ef0-44e8-a404-6070097bc284 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:07:30.064278 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a6f63f22-1ef0-44e8-a404-6070097bc284 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:07:30.218093 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-a6f63f22-1ef0-44e8-a404-6070097bc284 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9adcc8a95203462ea78164d4db440351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa75a4498a814ecc86698d0ddac01c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:07:30.226936 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-a6f63f22-1ef0-44e8-a404-6070097bc284 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] 10.222.0.18 "GET /compute/v2.1/servers/e2939456-8793-4020-8eeb-cdd31cdde758" status: 200 len: 1753 microversion: 2.1 time: 0.182050 Oct 22 22:07:30.227819 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3400/6769] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:07:30 2022] GET /compute/v2.1/servers/e2939456-8793-4020-8eeb-cdd31cdde758 => generated 1753 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:07:31.254996 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-ced49047-cc4d-483a-a503-cd5edbacf660 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:07:31.255965 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-ced49047-cc4d-483a-a503-cd5edbacf660 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] [instance: e2939456-8793-4020-8eeb-cdd31cdde758] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:07:31.264869 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ced49047-cc4d-483a-a503-cd5edbacf660 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:07:31.265359 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ced49047-cc4d-483a-a503-cd5edbacf660 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:07:31.265949 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ced49047-cc4d-483a-a503-cd5edbacf660 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:07:31.267019 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ced49047-cc4d-483a-a503-cd5edbacf660 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:07:31.267576 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ced49047-cc4d-483a-a503-cd5edbacf660 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:07:31.268018 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ced49047-cc4d-483a-a503-cd5edbacf660 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:07:31.429013 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-ced49047-cc4d-483a-a503-cd5edbacf660 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9adcc8a95203462ea78164d4db440351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa75a4498a814ecc86698d0ddac01c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:07:31.437541 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-ced49047-cc4d-483a-a503-cd5edbacf660 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] 10.222.0.18 "GET /compute/v2.1/servers/e2939456-8793-4020-8eeb-cdd31cdde758" status: 200 len: 1758 microversion: 2.1 time: 0.190059 Oct 22 22:07:31.438226 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3370/6770] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:07:31 2022] GET /compute/v2.1/servers/e2939456-8793-4020-8eeb-cdd31cdde758 => generated 1758 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:07:32.466432 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-4588fde2-df15-4046-97f7-46fe4f298d3f tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:07:32.467682 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-4588fde2-df15-4046-97f7-46fe4f298d3f tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] [instance: e2939456-8793-4020-8eeb-cdd31cdde758] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:07:32.476166 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4588fde2-df15-4046-97f7-46fe4f298d3f tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:07:32.476638 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4588fde2-df15-4046-97f7-46fe4f298d3f tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:07:32.477127 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4588fde2-df15-4046-97f7-46fe4f298d3f tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:07:32.477850 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4588fde2-df15-4046-97f7-46fe4f298d3f tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:07:32.478326 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4588fde2-df15-4046-97f7-46fe4f298d3f tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:07:32.478774 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4588fde2-df15-4046-97f7-46fe4f298d3f tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:07:32.632898 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-4588fde2-df15-4046-97f7-46fe4f298d3f tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9adcc8a95203462ea78164d4db440351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa75a4498a814ecc86698d0ddac01c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:07:32.642347 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-4588fde2-df15-4046-97f7-46fe4f298d3f tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] 10.222.0.18 "GET /compute/v2.1/servers/e2939456-8793-4020-8eeb-cdd31cdde758" status: 200 len: 1758 microversion: 2.1 time: 0.182642 Oct 22 22:07:32.642962 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3401/6771] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:07:32 2022] GET /compute/v2.1/servers/e2939456-8793-4020-8eeb-cdd31cdde758 => generated 1758 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:07:33.669094 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-8c40bf76-dcf7-4d6e-b43c-2e64f2a0e5af tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:07:33.669719 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-8c40bf76-dcf7-4d6e-b43c-2e64f2a0e5af tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] [instance: e2939456-8793-4020-8eeb-cdd31cdde758] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:07:33.680928 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8c40bf76-dcf7-4d6e-b43c-2e64f2a0e5af tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:07:33.681507 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8c40bf76-dcf7-4d6e-b43c-2e64f2a0e5af tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:07:33.682050 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8c40bf76-dcf7-4d6e-b43c-2e64f2a0e5af tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:07:33.683094 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8c40bf76-dcf7-4d6e-b43c-2e64f2a0e5af tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:07:33.683724 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8c40bf76-dcf7-4d6e-b43c-2e64f2a0e5af tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:07:33.684748 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8c40bf76-dcf7-4d6e-b43c-2e64f2a0e5af tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:07:33.833704 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-8c40bf76-dcf7-4d6e-b43c-2e64f2a0e5af tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9adcc8a95203462ea78164d4db440351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa75a4498a814ecc86698d0ddac01c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:07:33.842753 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-8c40bf76-dcf7-4d6e-b43c-2e64f2a0e5af tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] 10.222.0.18 "GET /compute/v2.1/servers/e2939456-8793-4020-8eeb-cdd31cdde758" status: 200 len: 1758 microversion: 2.1 time: 0.180064 Oct 22 22:07:33.843378 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3371/6772] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:07:33 2022] GET /compute/v2.1/servers/e2939456-8793-4020-8eeb-cdd31cdde758 => generated 1758 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:07:34.870376 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-aa23d779-bf85-4278-aef7-700f7010d4ae tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:07:34.871494 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-aa23d779-bf85-4278-aef7-700f7010d4ae tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] [instance: e2939456-8793-4020-8eeb-cdd31cdde758] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:07:34.883247 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-aa23d779-bf85-4278-aef7-700f7010d4ae tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:07:34.884158 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-aa23d779-bf85-4278-aef7-700f7010d4ae tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:07:34.884940 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-aa23d779-bf85-4278-aef7-700f7010d4ae tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:07:34.886137 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-aa23d779-bf85-4278-aef7-700f7010d4ae tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:07:34.886924 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-aa23d779-bf85-4278-aef7-700f7010d4ae tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:07:34.887743 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-aa23d779-bf85-4278-aef7-700f7010d4ae tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:07:35.040575 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-aa23d779-bf85-4278-aef7-700f7010d4ae tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9adcc8a95203462ea78164d4db440351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa75a4498a814ecc86698d0ddac01c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:07:35.049604 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-aa23d779-bf85-4278-aef7-700f7010d4ae tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] 10.222.0.18 "GET /compute/v2.1/servers/e2939456-8793-4020-8eeb-cdd31cdde758" status: 200 len: 1758 microversion: 2.1 time: 0.185998 Oct 22 22:07:35.050196 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3402/6773] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:07:34 2022] GET /compute/v2.1/servers/e2939456-8793-4020-8eeb-cdd31cdde758 => generated 1758 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:07:36.086956 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-7313d095-370e-4888-890d-d713debd1b42 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:07:36.088000 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-7313d095-370e-4888-890d-d713debd1b42 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] [instance: e2939456-8793-4020-8eeb-cdd31cdde758] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:07:36.098880 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7313d095-370e-4888-890d-d713debd1b42 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:07:36.099376 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7313d095-370e-4888-890d-d713debd1b42 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:07:36.099846 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7313d095-370e-4888-890d-d713debd1b42 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:07:36.100548 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7313d095-370e-4888-890d-d713debd1b42 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:07:36.101002 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7313d095-370e-4888-890d-d713debd1b42 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:07:36.101430 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7313d095-370e-4888-890d-d713debd1b42 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:07:36.256715 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-7313d095-370e-4888-890d-d713debd1b42 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9adcc8a95203462ea78164d4db440351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa75a4498a814ecc86698d0ddac01c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:07:36.267824 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-7313d095-370e-4888-890d-d713debd1b42 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] 10.222.0.18 "GET /compute/v2.1/servers/e2939456-8793-4020-8eeb-cdd31cdde758" status: 200 len: 1758 microversion: 2.1 time: 0.187434 Oct 22 22:07:36.268422 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3372/6774] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:07:36 2022] GET /compute/v2.1/servers/e2939456-8793-4020-8eeb-cdd31cdde758 => generated 1758 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:07:37.295596 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-ea3d2f33-2854-4d6f-9542-726d9f75c6e0 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:07:37.296691 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-ea3d2f33-2854-4d6f-9542-726d9f75c6e0 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] [instance: e2939456-8793-4020-8eeb-cdd31cdde758] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:07:37.304351 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ea3d2f33-2854-4d6f-9542-726d9f75c6e0 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:07:37.304865 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ea3d2f33-2854-4d6f-9542-726d9f75c6e0 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:07:37.305327 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ea3d2f33-2854-4d6f-9542-726d9f75c6e0 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:07:37.306043 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ea3d2f33-2854-4d6f-9542-726d9f75c6e0 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:07:37.306518 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ea3d2f33-2854-4d6f-9542-726d9f75c6e0 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:07:37.306964 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ea3d2f33-2854-4d6f-9542-726d9f75c6e0 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:07:37.454504 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-ea3d2f33-2854-4d6f-9542-726d9f75c6e0 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9adcc8a95203462ea78164d4db440351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa75a4498a814ecc86698d0ddac01c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:07:37.463772 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-ea3d2f33-2854-4d6f-9542-726d9f75c6e0 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] 10.222.0.18 "GET /compute/v2.1/servers/e2939456-8793-4020-8eeb-cdd31cdde758" status: 200 len: 1758 microversion: 2.1 time: 0.174880 Oct 22 22:07:37.464388 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3403/6775] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:07:37 2022] GET /compute/v2.1/servers/e2939456-8793-4020-8eeb-cdd31cdde758 => generated 1758 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:07:38.490941 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-615d286c-502a-44dc-ab33-532ba1c6f02f tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:07:38.491759 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-615d286c-502a-44dc-ab33-532ba1c6f02f tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] [instance: e2939456-8793-4020-8eeb-cdd31cdde758] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:07:38.500636 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-615d286c-502a-44dc-ab33-532ba1c6f02f tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:07:38.501555 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-615d286c-502a-44dc-ab33-532ba1c6f02f tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:07:38.502203 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-615d286c-502a-44dc-ab33-532ba1c6f02f tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:07:38.503079 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-615d286c-502a-44dc-ab33-532ba1c6f02f tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:07:38.503688 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-615d286c-502a-44dc-ab33-532ba1c6f02f tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:07:38.504226 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-615d286c-502a-44dc-ab33-532ba1c6f02f tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:07:39.005971 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-615d286c-502a-44dc-ab33-532ba1c6f02f tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9adcc8a95203462ea78164d4db440351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa75a4498a814ecc86698d0ddac01c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:07:39.014847 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-615d286c-502a-44dc-ab33-532ba1c6f02f tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] 10.222.0.18 "GET /compute/v2.1/servers/e2939456-8793-4020-8eeb-cdd31cdde758" status: 200 len: 1758 microversion: 2.1 time: 0.529443 Oct 22 22:07:39.015444 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3373/6776] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:07:38 2022] GET /compute/v2.1/servers/e2939456-8793-4020-8eeb-cdd31cdde758 => generated 1758 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:07:40.041427 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-8cb31ff7-2645-4187-bb82-196787e7570f tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:07:40.042339 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-8cb31ff7-2645-4187-bb82-196787e7570f tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] [instance: e2939456-8793-4020-8eeb-cdd31cdde758] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:07:40.051672 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8cb31ff7-2645-4187-bb82-196787e7570f tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:07:40.052180 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8cb31ff7-2645-4187-bb82-196787e7570f tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:07:40.052631 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8cb31ff7-2645-4187-bb82-196787e7570f tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:07:40.053394 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8cb31ff7-2645-4187-bb82-196787e7570f tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:07:40.053869 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8cb31ff7-2645-4187-bb82-196787e7570f tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:07:40.054316 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8cb31ff7-2645-4187-bb82-196787e7570f tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:07:40.215668 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-8cb31ff7-2645-4187-bb82-196787e7570f tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9adcc8a95203462ea78164d4db440351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa75a4498a814ecc86698d0ddac01c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:07:40.227942 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-8cb31ff7-2645-4187-bb82-196787e7570f tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] 10.222.0.18 "GET /compute/v2.1/servers/e2939456-8793-4020-8eeb-cdd31cdde758" status: 200 len: 1758 microversion: 2.1 time: 0.193114 Oct 22 22:07:40.228897 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3404/6777] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:07:40 2022] GET /compute/v2.1/servers/e2939456-8793-4020-8eeb-cdd31cdde758 => generated 1758 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:07:41.256835 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-2c1b5b78-1baf-4bb6-b836-c9f46a6c9f1b tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:07:41.257506 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-2c1b5b78-1baf-4bb6-b836-c9f46a6c9f1b tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] [instance: e2939456-8793-4020-8eeb-cdd31cdde758] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:07:41.264630 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2c1b5b78-1baf-4bb6-b836-c9f46a6c9f1b tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:07:41.265124 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2c1b5b78-1baf-4bb6-b836-c9f46a6c9f1b tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:07:41.265566 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2c1b5b78-1baf-4bb6-b836-c9f46a6c9f1b tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:07:41.266842 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2c1b5b78-1baf-4bb6-b836-c9f46a6c9f1b tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:07:41.267318 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2c1b5b78-1baf-4bb6-b836-c9f46a6c9f1b tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:07:41.267938 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2c1b5b78-1baf-4bb6-b836-c9f46a6c9f1b tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:07:41.415130 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-2c1b5b78-1baf-4bb6-b836-c9f46a6c9f1b tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9adcc8a95203462ea78164d4db440351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa75a4498a814ecc86698d0ddac01c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:07:41.428748 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-2c1b5b78-1baf-4bb6-b836-c9f46a6c9f1b tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] 10.222.0.18 "GET /compute/v2.1/servers/e2939456-8793-4020-8eeb-cdd31cdde758" status: 200 len: 1758 microversion: 2.1 time: 0.176907 Oct 22 22:07:41.429524 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3374/6778] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:07:41 2022] GET /compute/v2.1/servers/e2939456-8793-4020-8eeb-cdd31cdde758 => generated 1758 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:07:42.459218 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-164006f1-42c9-497c-b55c-f936505a5d3c tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:07:42.460066 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-164006f1-42c9-497c-b55c-f936505a5d3c tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] [instance: e2939456-8793-4020-8eeb-cdd31cdde758] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:07:42.468932 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-164006f1-42c9-497c-b55c-f936505a5d3c tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:07:42.469602 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-164006f1-42c9-497c-b55c-f936505a5d3c tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:07:42.470301 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-164006f1-42c9-497c-b55c-f936505a5d3c tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:07:42.471248 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-164006f1-42c9-497c-b55c-f936505a5d3c tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:07:42.471912 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-164006f1-42c9-497c-b55c-f936505a5d3c tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:07:42.472510 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-164006f1-42c9-497c-b55c-f936505a5d3c tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:07:42.621468 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-164006f1-42c9-497c-b55c-f936505a5d3c tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9adcc8a95203462ea78164d4db440351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa75a4498a814ecc86698d0ddac01c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:07:42.632199 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-164006f1-42c9-497c-b55c-f936505a5d3c tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] 10.222.0.18 "GET /compute/v2.1/servers/e2939456-8793-4020-8eeb-cdd31cdde758" status: 200 len: 1758 microversion: 2.1 time: 0.178999 Oct 22 22:07:42.632792 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3405/6779] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:07:42 2022] GET /compute/v2.1/servers/e2939456-8793-4020-8eeb-cdd31cdde758 => generated 1758 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:07:43.656019 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-42b80bf5-d783-437c-a6f4-e0ec0e80414c tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:07:43.656644 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-42b80bf5-d783-437c-a6f4-e0ec0e80414c tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] [instance: e2939456-8793-4020-8eeb-cdd31cdde758] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:07:43.664508 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-42b80bf5-d783-437c-a6f4-e0ec0e80414c tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:07:43.664994 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-42b80bf5-d783-437c-a6f4-e0ec0e80414c tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:07:43.665496 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-42b80bf5-d783-437c-a6f4-e0ec0e80414c tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:07:43.666195 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-42b80bf5-d783-437c-a6f4-e0ec0e80414c tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:07:43.666651 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-42b80bf5-d783-437c-a6f4-e0ec0e80414c tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:07:43.667077 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-42b80bf5-d783-437c-a6f4-e0ec0e80414c tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:07:43.818833 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-42b80bf5-d783-437c-a6f4-e0ec0e80414c tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9adcc8a95203462ea78164d4db440351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa75a4498a814ecc86698d0ddac01c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:07:43.830895 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-42b80bf5-d783-437c-a6f4-e0ec0e80414c tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] 10.222.0.18 "GET /compute/v2.1/servers/e2939456-8793-4020-8eeb-cdd31cdde758" status: 200 len: 1758 microversion: 2.1 time: 0.179348 Oct 22 22:07:43.831463 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3375/6780] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:07:43 2022] GET /compute/v2.1/servers/e2939456-8793-4020-8eeb-cdd31cdde758 => generated 1758 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:07:44.855207 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-430b47dd-ae33-42d3-a92e-e8db4d1b6cbf tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:07:44.855907 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-430b47dd-ae33-42d3-a92e-e8db4d1b6cbf tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] [instance: e2939456-8793-4020-8eeb-cdd31cdde758] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:07:44.863449 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-430b47dd-ae33-42d3-a92e-e8db4d1b6cbf tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:07:44.864010 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-430b47dd-ae33-42d3-a92e-e8db4d1b6cbf tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:07:44.864476 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-430b47dd-ae33-42d3-a92e-e8db4d1b6cbf tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:07:44.865203 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-430b47dd-ae33-42d3-a92e-e8db4d1b6cbf tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:07:44.865680 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-430b47dd-ae33-42d3-a92e-e8db4d1b6cbf tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:07:44.866132 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-430b47dd-ae33-42d3-a92e-e8db4d1b6cbf tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:07:45.018022 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-430b47dd-ae33-42d3-a92e-e8db4d1b6cbf tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9adcc8a95203462ea78164d4db440351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa75a4498a814ecc86698d0ddac01c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:07:45.026752 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-430b47dd-ae33-42d3-a92e-e8db4d1b6cbf tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] 10.222.0.18 "GET /compute/v2.1/servers/e2939456-8793-4020-8eeb-cdd31cdde758" status: 200 len: 1758 microversion: 2.1 time: 0.175606 Oct 22 22:07:45.027383 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3406/6781] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:07:44 2022] GET /compute/v2.1/servers/e2939456-8793-4020-8eeb-cdd31cdde758 => generated 1758 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:07:46.052282 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-72f81b09-4473-486e-a4d2-43cfca9186a1 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:07:46.052951 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-72f81b09-4473-486e-a4d2-43cfca9186a1 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] [instance: e2939456-8793-4020-8eeb-cdd31cdde758] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:07:46.060553 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-72f81b09-4473-486e-a4d2-43cfca9186a1 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:07:46.061059 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-72f81b09-4473-486e-a4d2-43cfca9186a1 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:07:46.061473 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-72f81b09-4473-486e-a4d2-43cfca9186a1 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:07:46.062186 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-72f81b09-4473-486e-a4d2-43cfca9186a1 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:07:46.062640 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-72f81b09-4473-486e-a4d2-43cfca9186a1 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:07:46.063073 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-72f81b09-4473-486e-a4d2-43cfca9186a1 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:07:46.225156 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-72f81b09-4473-486e-a4d2-43cfca9186a1 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9adcc8a95203462ea78164d4db440351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa75a4498a814ecc86698d0ddac01c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:07:46.237399 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-72f81b09-4473-486e-a4d2-43cfca9186a1 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] 10.222.0.18 "GET /compute/v2.1/servers/e2939456-8793-4020-8eeb-cdd31cdde758" status: 200 len: 1758 microversion: 2.1 time: 0.189805 Oct 22 22:07:46.237969 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3376/6782] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:07:46 2022] GET /compute/v2.1/servers/e2939456-8793-4020-8eeb-cdd31cdde758 => generated 1758 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:07:47.260198 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-a9289c71-8cf3-41eb-b70a-946c6b66ffb1 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:07:47.260871 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-a9289c71-8cf3-41eb-b70a-946c6b66ffb1 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] [instance: e2939456-8793-4020-8eeb-cdd31cdde758] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:07:47.267805 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a9289c71-8cf3-41eb-b70a-946c6b66ffb1 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:07:47.268331 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a9289c71-8cf3-41eb-b70a-946c6b66ffb1 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:07:47.268783 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a9289c71-8cf3-41eb-b70a-946c6b66ffb1 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:07:47.269504 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a9289c71-8cf3-41eb-b70a-946c6b66ffb1 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:07:47.269978 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a9289c71-8cf3-41eb-b70a-946c6b66ffb1 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:07:47.270426 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a9289c71-8cf3-41eb-b70a-946c6b66ffb1 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:07:47.416426 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-a9289c71-8cf3-41eb-b70a-946c6b66ffb1 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9adcc8a95203462ea78164d4db440351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa75a4498a814ecc86698d0ddac01c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:07:47.426336 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-a9289c71-8cf3-41eb-b70a-946c6b66ffb1 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] 10.222.0.18 "GET /compute/v2.1/servers/e2939456-8793-4020-8eeb-cdd31cdde758" status: 200 len: 1761 microversion: 2.1 time: 0.170228 Oct 22 22:07:47.426915 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3407/6783] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:07:47 2022] GET /compute/v2.1/servers/e2939456-8793-4020-8eeb-cdd31cdde758 => generated 1761 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:08:42.267906 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-82c2b015-132e-4aa3-974b-72c213871f04 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1656699178"}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 22:08:42.268601 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-82c2b015-132e-4aa3-974b-72c213871f04 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] [instance: e2939456-8793-4020-8eeb-cdd31cdde758] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:08:42.270677 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_api:SELECT=16 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:08:42.271372 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:08:42.277284 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-82c2b015-132e-4aa3-974b-72c213871f04 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:08:42.277775 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-82c2b015-132e-4aa3-974b-72c213871f04 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:08:42.278218 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-82c2b015-132e-4aa3-974b-72c213871f04 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:08:42.278924 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-82c2b015-132e-4aa3-974b-72c213871f04 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:08:42.279452 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-82c2b015-132e-4aa3-974b-72c213871f04 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:08:42.279891 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-82c2b015-132e-4aa3-974b-72c213871f04 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:08:42.414683 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.network.security_group_api [None req-82c2b015-132e-4aa3-974b-72c213871f04 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Removing security group 3f122fc7-4972-46ed-9ee0-23df2d127ea4 from port 0f3bf0de-aade-4c8b-b6e4-7651ff9d7a43 Oct 22 22:08:42.726942 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-82c2b015-132e-4aa3-974b-72c213871f04 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] 10.222.0.18 "POST /compute/v2.1/servers/e2939456-8793-4020-8eeb-cdd31cdde758/action" status: 202 len: 0 microversion: 2.1 time: 0.460125 Oct 22 22:08:42.726942 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3377/6784] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 22:08:42 2022] POST /compute/v2.1/servers/e2939456-8793-4020-8eeb-cdd31cdde758/action => generated 0 bytes in 462 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 22:08:42.738363 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-9b5557a1-9bf4-410c-8889-8a426133b705 req-dc5f02f1-c0d6-4a18-8896-dd45d65fac9c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2939456-8793-4020-8eeb-cdd31cdde758", "tag": "0f3bf0de-aade-4c8b-b6e4-7651ff9d7a43"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 22:08:42.752084 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_api:SELECT=16 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:08:42.752975 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell1:SELECT=48 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:08:42.766079 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-9b5557a1-9bf4-410c-8889-8a426133b705 req-dc5f02f1-c0d6-4a18-8896-dd45d65fac9c service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:08:42.766602 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-9b5557a1-9bf4-410c-8889-8a426133b705 req-dc5f02f1-c0d6-4a18-8896-dd45d65fac9c service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:08:42.767054 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-9b5557a1-9bf4-410c-8889-8a426133b705 req-dc5f02f1-c0d6-4a18-8896-dd45d65fac9c service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:08:42.796198 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-9b5557a1-9bf4-410c-8889-8a426133b705 req-dc5f02f1-c0d6-4a18-8896-dd45d65fac9c service nova] Creating event network-changed:0f3bf0de-aade-4c8b-b6e4-7651ff9d7a43 for instance e2939456-8793-4020-8eeb-cdd31cdde758 on nch1-master-1 Oct 22 22:08:42.801560 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-9b5557a1-9bf4-410c-8889-8a426133b705 req-dc5f02f1-c0d6-4a18-8896-dd45d65fac9c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072836 Oct 22 22:08:42.802492 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3408/6785] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 22:08:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 22:08:43.939175 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-2048c39b-0033-44bc-b0d2-c50ece52c99d tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:08:43.939873 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-2048c39b-0033-44bc-b0d2-c50ece52c99d tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] [instance: e2939456-8793-4020-8eeb-cdd31cdde758] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:08:43.946185 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2048c39b-0033-44bc-b0d2-c50ece52c99d tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:08:43.946679 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2048c39b-0033-44bc-b0d2-c50ece52c99d tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:08:43.947119 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2048c39b-0033-44bc-b0d2-c50ece52c99d tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:08:43.947862 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2048c39b-0033-44bc-b0d2-c50ece52c99d tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:08:43.948318 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2048c39b-0033-44bc-b0d2-c50ece52c99d tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:08:43.948743 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2048c39b-0033-44bc-b0d2-c50ece52c99d tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:08:44.032412 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.objects.instance [None req-2048c39b-0033-44bc-b0d2-c50ece52c99d tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lazy-loading 'services' on Instance uuid e2939456-8793-4020-8eeb-cdd31cdde758 {{(pid=138744) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 22:08:44.111055 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-2048c39b-0033-44bc-b0d2-c50ece52c99d tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] 10.222.0.18 "DELETE /compute/v2.1/servers/e2939456-8793-4020-8eeb-cdd31cdde758/os-volume_attachments/84e9205b-2498-48cc-a7ff-baf3221bc72d" status: 202 len: 0 microversion: 2.1 time: 0.176807 Oct 22 22:08:44.112035 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3378/6786] 10.222.0.18 () {58 vars in 1416 bytes} [Sat Oct 22 22:08:43 2022] DELETE /compute/v2.1/servers/e2939456-8793-4020-8eeb-cdd31cdde758/os-volume_attachments/84e9205b-2498-48cc-a7ff-baf3221bc72d => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 22:08:44.122646 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-c045a143-2691-4cb9-934e-58fe88cf4d2c tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:08:44.125256 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-c045a143-2691-4cb9-934e-58fe88cf4d2c tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] [instance: e2939456-8793-4020-8eeb-cdd31cdde758] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:08:44.132205 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c045a143-2691-4cb9-934e-58fe88cf4d2c tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:08:44.133040 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c045a143-2691-4cb9-934e-58fe88cf4d2c tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:08:44.133508 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c045a143-2691-4cb9-934e-58fe88cf4d2c tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:08:44.134246 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c045a143-2691-4cb9-934e-58fe88cf4d2c tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:08:44.134716 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c045a143-2691-4cb9-934e-58fe88cf4d2c tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:08:44.135159 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c045a143-2691-4cb9-934e-58fe88cf4d2c tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:08:44.170030 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-c045a143-2691-4cb9-934e-58fe88cf4d2c tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] 10.222.0.18 "GET /compute/v2.1/servers/e2939456-8793-4020-8eeb-cdd31cdde758/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052997 Oct 22 22:08:44.170700 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3409/6787] 10.222.0.18 () {58 vars in 1302 bytes} [Sat Oct 22 22:08:44 2022] GET /compute/v2.1/servers/e2939456-8793-4020-8eeb-cdd31cdde758/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 22:08:44.819670 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-b4aa7b91-ee7d-4206-8dac-db9996cf4f53 req-c0f30240-2c5d-491a-ab76-75d19e06e288 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2939456-8793-4020-8eeb-cdd31cdde758", "tag": "0f3bf0de-aade-4c8b-b6e4-7651ff9d7a43"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 22:08:44.833245 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-b4aa7b91-ee7d-4206-8dac-db9996cf4f53 req-c0f30240-2c5d-491a-ab76-75d19e06e288 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:08:44.833830 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-b4aa7b91-ee7d-4206-8dac-db9996cf4f53 req-c0f30240-2c5d-491a-ab76-75d19e06e288 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:08:44.834409 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-b4aa7b91-ee7d-4206-8dac-db9996cf4f53 req-c0f30240-2c5d-491a-ab76-75d19e06e288 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:08:44.850994 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-b4aa7b91-ee7d-4206-8dac-db9996cf4f53 req-c0f30240-2c5d-491a-ab76-75d19e06e288 service nova] Creating event network-changed:0f3bf0de-aade-4c8b-b6e4-7651ff9d7a43 for instance e2939456-8793-4020-8eeb-cdd31cdde758 on nch1-master-1 Oct 22 22:08:44.856732 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-b4aa7b91-ee7d-4206-8dac-db9996cf4f53 req-c0f30240-2c5d-491a-ab76-75d19e06e288 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041362 Oct 22 22:08:44.857492 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3379/6788] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 22:08:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 22:08:45.183855 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-79b5445a-9f99-4736-a11d-e1c6767a0b90 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:08:45.186294 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-79b5445a-9f99-4736-a11d-e1c6767a0b90 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] [instance: e2939456-8793-4020-8eeb-cdd31cdde758] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:08:45.193860 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-79b5445a-9f99-4736-a11d-e1c6767a0b90 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:08:45.194396 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-79b5445a-9f99-4736-a11d-e1c6767a0b90 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:08:45.194841 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-79b5445a-9f99-4736-a11d-e1c6767a0b90 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:08:45.195609 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-79b5445a-9f99-4736-a11d-e1c6767a0b90 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:08:45.196104 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-79b5445a-9f99-4736-a11d-e1c6767a0b90 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:08:45.196537 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-79b5445a-9f99-4736-a11d-e1c6767a0b90 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:08:45.227167 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-79b5445a-9f99-4736-a11d-e1c6767a0b90 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] 10.222.0.18 "GET /compute/v2.1/servers/e2939456-8793-4020-8eeb-cdd31cdde758/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047388 Oct 22 22:08:45.227959 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3410/6789] 10.222.0.18 () {58 vars in 1302 bytes} [Sat Oct 22 22:08:45 2022] GET /compute/v2.1/servers/e2939456-8793-4020-8eeb-cdd31cdde758/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 22 22:08:45.240373 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-12cae283-acbc-4160-a9f0-d1ccf0b76925 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:08:45.240948 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-12cae283-acbc-4160-a9f0-d1ccf0b76925 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] [instance: e2939456-8793-4020-8eeb-cdd31cdde758] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:08:45.247233 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-12cae283-acbc-4160-a9f0-d1ccf0b76925 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:08:45.247767 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-12cae283-acbc-4160-a9f0-d1ccf0b76925 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:08:45.248547 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-12cae283-acbc-4160-a9f0-d1ccf0b76925 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:08:45.249545 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-12cae283-acbc-4160-a9f0-d1ccf0b76925 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:08:45.250098 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-12cae283-acbc-4160-a9f0-d1ccf0b76925 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:08:45.250542 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-12cae283-acbc-4160-a9f0-d1ccf0b76925 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:08:45.329926 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-12cae283-acbc-4160-a9f0-d1ccf0b76925 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] HTTP exception thrown: Instance e2939456-8793-4020-8eeb-cdd31cdde758 is not attached to volume 84e9205b-2498-48cc-a7ff-baf3221bc72d Oct 22 22:08:45.331602 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-12cae283-acbc-4160-a9f0-d1ccf0b76925 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Request method failure captured: Oct 22 22:08:45.331602 ncdv-master-1 devstack@n-api.service[138744]: request: DELETE /compute/v2.1/servers/e2939456-8793-4020-8eeb-cdd31cdde758/os-volume_attachments/84e9205b-2498-48cc-a7ff-baf3221bc72d HTTP/1.1 Oct 22 22:08:45.331602 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 22:08:45.331602 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 22:08:45.331602 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 22:08:45.331602 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 0 Oct 22 22:08:45.331602 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 22:08:45.331602 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 22:08:45.331602 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 22:08:45.331602 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 22:08:45.331602 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVGf6nsO7KO_P-Lv7m3kWPRG3fXIwCVOUKQ790BCXFliAeAjYLh22C4q6qivMuSAWDCdan3UiFR_BSQTf0fiIJIM3wLmd2DDMOEjq3DJYBmyB2pVkQQKvY_YorpV4dvrzUOJCwETiDbxSXD-pOY8GGBhu2TFWDQCefkXetugM6fmfT9I Oct 22 22:08:45.331602 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 22:08:45.331602 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 22:08:45.331602 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 22:08:45.331602 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 22:08:45.331602 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 22:08:45.331602 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 22:08:45.331602 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: aa75a4498a814ecc86698d0ddac01c2f Oct 22 22:08:45.331602 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-TestMinimumBasicScenario-1689753837 Oct 22 22:08:45.331602 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 22:08:45.331602 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 22:08:45.331602 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_aa75a4498a814ecc86698d0ddac01c2f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/aa75a4498a814ecc86698d0ddac01c2f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/aa75a4498a814ecc86698d0ddac01c2f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/aa75a4498a814ecc86698d0ddac01c2f"}]}] Oct 22 22:08:45.331602 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-TestMinimumBasicScenario-1689753837 Oct 22 22:08:45.331602 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: aa75a4498a814ecc86698d0ddac01c2f Oct 22 22:08:45.331602 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1689753837 Oct 22 22:08:45.331602 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-TestMinimumBasicScenario-1689753837-project Oct 22 22:08:45.331602 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 22:08:45.331602 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 22:08:45.331602 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: 9adcc8a95203462ea78164d4db440351 Oct 22 22:08:45.331602 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-TestMinimumBasicScenario-1689753837-project Oct 22 22:08:45.331602 ncdv-master-1 devstack@n-api.service[138744]: method: > Oct 22 22:08:45.331602 ncdv-master-1 devstack@n-api.service[138744]: exception: Instance e2939456-8793-4020-8eeb-cdd31cdde758 is not attached to volume 84e9205b-2498-48cc-a7ff-baf3221bc72d Oct 22 22:08:45.331602 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'server_id': 'e2939456-8793-4020-8eeb-cdd31cdde758', 'id': '84e9205b-2498-48cc-a7ff-baf3221bc72d'} Oct 22 22:08:45.331602 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 22:08:45.331602 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 22:08:45.331602 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 22 22:08:45.331602 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 22 22:08:45.331602 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 22 22:08:45.331602 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 22 22:08:45.331602 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 22 22:08:45.331602 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 22 22:08:45.331602 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 84e9205b-2498-48cc-a7ff-baf3221bc72d. Oct 22 22:08:45.331602 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 22:08:45.331602 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 22:08:45.331602 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 22:08:45.331602 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 22:08:45.331602 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 22:08:45.331602 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 22:08:45.331602 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 22:08:45.331602 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 22:08:45.331602 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 22:08:45.331602 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 22:08:45.331602 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 22 22:08:45.331602 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 22 22:08:45.331602 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e2939456-8793-4020-8eeb-cdd31cdde758 is not attached to volume 84e9205b-2498-48cc-a7ff-baf3221bc72d Oct 22 22:08:45.331602 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 22:08:45.331602 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 22:08:45.331602 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 22:08:45.331602 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 22:08:45.331602 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 22:08:45.331602 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 22:08:45.336567 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 22:08:45.336567 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 22:08:45.336567 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e2939456-8793-4020-8eeb-cdd31cdde758 is not attached to volume 84e9205b-2498-48cc-a7ff-baf3221bc72d Oct 22 22:08:45.336567 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 22:08:45.336567 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-12cae283-acbc-4160-a9f0-d1ccf0b76925 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Returning 404 to user: Instance e2939456-8793-4020-8eeb-cdd31cdde758 is not attached to volume 84e9205b-2498-48cc-a7ff-baf3221bc72d {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 22:08:45.336567 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-12cae283-acbc-4160-a9f0-d1ccf0b76925 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] 10.222.0.18 "DELETE /compute/v2.1/servers/e2939456-8793-4020-8eeb-cdd31cdde758/os-volume_attachments/84e9205b-2498-48cc-a7ff-baf3221bc72d" status: 404 len: 154 microversion: 2.1 time: 0.097975 Oct 22 22:08:45.336567 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3380/6790] 10.222.0.18 () {58 vars in 1416 bytes} [Sat Oct 22 22:08:45 2022] DELETE /compute/v2.1/servers/e2939456-8793-4020-8eeb-cdd31cdde758/os-volume_attachments/84e9205b-2498-48cc-a7ff-baf3221bc72d => generated 154 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 22:08:46.508327 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-2b93886b-1ff1-44c9-8265-d3c29a143864 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:08:46.508884 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-2b93886b-1ff1-44c9-8265-d3c29a143864 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] [instance: e2939456-8793-4020-8eeb-cdd31cdde758] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:08:46.516220 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2b93886b-1ff1-44c9-8265-d3c29a143864 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:08:46.516720 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2b93886b-1ff1-44c9-8265-d3c29a143864 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:08:46.517186 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2b93886b-1ff1-44c9-8265-d3c29a143864 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:08:46.517903 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2b93886b-1ff1-44c9-8265-d3c29a143864 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:08:46.518381 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2b93886b-1ff1-44c9-8265-d3c29a143864 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:08:46.518826 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2b93886b-1ff1-44c9-8265-d3c29a143864 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:08:46.544558 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-2b93886b-1ff1-44c9-8265-d3c29a143864 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] [instance: e2939456-8793-4020-8eeb-cdd31cdde758] Going to try to terminate instance {{(pid=138745) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 22:08:46.634296 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-2b93886b-1ff1-44c9-8265-d3c29a143864 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] 10.222.0.18 "DELETE /compute/v2.1/servers/e2939456-8793-4020-8eeb-cdd31cdde758" status: 204 len: 0 microversion: 2.1 time: 0.129075 Oct 22 22:08:46.634296 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3411/6791] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 22:08:46 2022] DELETE /compute/v2.1/servers/e2939456-8793-4020-8eeb-cdd31cdde758 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 22:08:46.643008 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-942b087c-8833-443c-ad4f-731ccfdd0b85 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:08:46.643777 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-942b087c-8833-443c-ad4f-731ccfdd0b85 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] [instance: e2939456-8793-4020-8eeb-cdd31cdde758] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:08:46.651851 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-942b087c-8833-443c-ad4f-731ccfdd0b85 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:08:46.652418 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-942b087c-8833-443c-ad4f-731ccfdd0b85 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:08:46.652894 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-942b087c-8833-443c-ad4f-731ccfdd0b85 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:08:46.653700 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-942b087c-8833-443c-ad4f-731ccfdd0b85 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:08:46.654165 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-942b087c-8833-443c-ad4f-731ccfdd0b85 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:08:46.654602 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-942b087c-8833-443c-ad4f-731ccfdd0b85 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:08:46.798846 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-942b087c-8833-443c-ad4f-731ccfdd0b85 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9adcc8a95203462ea78164d4db440351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa75a4498a814ecc86698d0ddac01c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:08:46.810865 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-942b087c-8833-443c-ad4f-731ccfdd0b85 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] 10.222.0.18 "GET /compute/v2.1/servers/e2939456-8793-4020-8eeb-cdd31cdde758" status: 200 len: 1555 microversion: 2.1 time: 0.171567 Oct 22 22:08:46.811718 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3381/6792] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:08:46 2022] GET /compute/v2.1/servers/e2939456-8793-4020-8eeb-cdd31cdde758 => generated 1555 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:08:47.839045 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-90071075-1bfb-4b31-a050-a818b9f7b54a tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:08:47.840187 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-90071075-1bfb-4b31-a050-a818b9f7b54a tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] [instance: e2939456-8793-4020-8eeb-cdd31cdde758] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:08:47.849605 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-90071075-1bfb-4b31-a050-a818b9f7b54a tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:08:47.850103 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-90071075-1bfb-4b31-a050-a818b9f7b54a tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:08:47.850556 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-90071075-1bfb-4b31-a050-a818b9f7b54a tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:08:47.851270 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-90071075-1bfb-4b31-a050-a818b9f7b54a tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:08:47.851780 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-90071075-1bfb-4b31-a050-a818b9f7b54a tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:08:47.852223 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-90071075-1bfb-4b31-a050-a818b9f7b54a tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:08:47.986941 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-90071075-1bfb-4b31-a050-a818b9f7b54a tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9adcc8a95203462ea78164d4db440351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa75a4498a814ecc86698d0ddac01c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:08:47.995107 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-90071075-1bfb-4b31-a050-a818b9f7b54a tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] 10.222.0.18 "GET /compute/v2.1/servers/e2939456-8793-4020-8eeb-cdd31cdde758" status: 200 len: 1555 microversion: 2.1 time: 0.162787 Oct 22 22:08:47.995720 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3412/6793] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:08:47 2022] GET /compute/v2.1/servers/e2939456-8793-4020-8eeb-cdd31cdde758 => generated 1555 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:08:48.860490 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-ffbac669-8fb0-4bfc-a3f4-5e864bdc37ae req-9205c44a-2a67-49db-abc0-8ecb66f96bec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2939456-8793-4020-8eeb-cdd31cdde758", "name": "network-vif-deleted", "tag": "0f3bf0de-aade-4c8b-b6e4-7651ff9d7a43"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 22:08:48.872393 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-ffbac669-8fb0-4bfc-a3f4-5e864bdc37ae req-9205c44a-2a67-49db-abc0-8ecb66f96bec service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:08:48.872886 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-ffbac669-8fb0-4bfc-a3f4-5e864bdc37ae req-9205c44a-2a67-49db-abc0-8ecb66f96bec service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:08:48.873326 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-ffbac669-8fb0-4bfc-a3f4-5e864bdc37ae req-9205c44a-2a67-49db-abc0-8ecb66f96bec service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:08:48.885991 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-ffbac669-8fb0-4bfc-a3f4-5e864bdc37ae req-9205c44a-2a67-49db-abc0-8ecb66f96bec service nova] Creating event network-vif-deleted:0f3bf0de-aade-4c8b-b6e4-7651ff9d7a43 for instance e2939456-8793-4020-8eeb-cdd31cdde758 on nch1-master-1 Oct 22 22:08:48.892403 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-ffbac669-8fb0-4bfc-a3f4-5e864bdc37ae req-9205c44a-2a67-49db-abc0-8ecb66f96bec service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035474 Oct 22 22:08:48.893001 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3382/6794] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 22:08:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 22:08:49.018603 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-14dce1b3-bcff-4173-a702-137bdb643f59 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:08:49.019593 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-14dce1b3-bcff-4173-a702-137bdb643f59 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] [instance: e2939456-8793-4020-8eeb-cdd31cdde758] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:08:49.027109 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-14dce1b3-bcff-4173-a702-137bdb643f59 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:08:49.028074 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-14dce1b3-bcff-4173-a702-137bdb643f59 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:08:49.028573 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-14dce1b3-bcff-4173-a702-137bdb643f59 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:08:49.029276 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-14dce1b3-bcff-4173-a702-137bdb643f59 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:08:49.029919 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-14dce1b3-bcff-4173-a702-137bdb643f59 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:08:49.030543 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-14dce1b3-bcff-4173-a702-137bdb643f59 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:08:49.066692 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-14dce1b3-bcff-4173-a702-137bdb643f59 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:08:49.067215 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-14dce1b3-bcff-4173-a702-137bdb643f59 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:08:49.067686 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-14dce1b3-bcff-4173-a702-137bdb643f59 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:08:49.068128 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.objects.instance [None req-14dce1b3-bcff-4173-a702-137bdb643f59 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lazy-loading 'fault' on Instance uuid e2939456-8793-4020-8eeb-cdd31cdde758 {{(pid=138745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 22:08:49.123892 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-14dce1b3-bcff-4173-a702-137bdb643f59 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9adcc8a95203462ea78164d4db440351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa75a4498a814ecc86698d0ddac01c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:08:49.132528 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-14dce1b3-bcff-4173-a702-137bdb643f59 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] 10.222.0.18 "GET /compute/v2.1/servers/e2939456-8793-4020-8eeb-cdd31cdde758" status: 200 len: 1349 microversion: 2.1 time: 0.118207 Oct 22 22:08:49.133128 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3413/6795] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:08:49 2022] GET /compute/v2.1/servers/e2939456-8793-4020-8eeb-cdd31cdde758 => generated 1349 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:08:50.158752 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-47c460c2-03f0-4236-a448-6fc329fcc131 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:08:50.159643 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-47c460c2-03f0-4236-a448-6fc329fcc131 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] [instance: e2939456-8793-4020-8eeb-cdd31cdde758] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:08:50.168156 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-47c460c2-03f0-4236-a448-6fc329fcc131 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:08:50.168642 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-47c460c2-03f0-4236-a448-6fc329fcc131 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:08:50.169092 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-47c460c2-03f0-4236-a448-6fc329fcc131 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:08:50.169832 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-47c460c2-03f0-4236-a448-6fc329fcc131 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:08:50.170366 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-47c460c2-03f0-4236-a448-6fc329fcc131 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:08:50.170849 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-47c460c2-03f0-4236-a448-6fc329fcc131 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:08:50.185436 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-47c460c2-03f0-4236-a448-6fc329fcc131 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] HTTP exception thrown: Instance e2939456-8793-4020-8eeb-cdd31cdde758 could not be found. Oct 22 22:08:50.187334 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-47c460c2-03f0-4236-a448-6fc329fcc131 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Request method failure captured: Oct 22 22:08:50.187334 ncdv-master-1 devstack@n-api.service[138744]: request: GET /compute/v2.1/servers/e2939456-8793-4020-8eeb-cdd31cdde758 HTTP/1.1 Oct 22 22:08:50.187334 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 22:08:50.187334 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 22:08:50.187334 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 22:08:50.187334 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 0 Oct 22 22:08:50.187334 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 22:08:50.187334 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 22:08:50.187334 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 22:08:50.187334 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 22:08:50.187334 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVGf6nsO7KO_P-Lv7m3kWPRG3fXIwCVOUKQ790BCXFliAeAjYLh22C4q6qivMuSAWDCdan3UiFR_BSQTf0fiIJIM3wLmd2DDMOEjq3DJYBmyB2pVkQQKvY_YorpV4dvrzUOJCwETiDbxSXD-pOY8GGBhu2TFWDQCefkXetugM6fmfT9I Oct 22 22:08:50.187334 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 22:08:50.187334 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 22:08:50.187334 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 22:08:50.187334 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 22:08:50.187334 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 22:08:50.187334 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 22:08:50.187334 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: aa75a4498a814ecc86698d0ddac01c2f Oct 22 22:08:50.187334 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-TestMinimumBasicScenario-1689753837 Oct 22 22:08:50.187334 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 22:08:50.187334 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 22:08:50.187334 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_aa75a4498a814ecc86698d0ddac01c2f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/aa75a4498a814ecc86698d0ddac01c2f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/aa75a4498a814ecc86698d0ddac01c2f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/aa75a4498a814ecc86698d0ddac01c2f"}]}] Oct 22 22:08:50.187334 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-TestMinimumBasicScenario-1689753837 Oct 22 22:08:50.187334 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: aa75a4498a814ecc86698d0ddac01c2f Oct 22 22:08:50.187334 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1689753837 Oct 22 22:08:50.187334 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-TestMinimumBasicScenario-1689753837-project Oct 22 22:08:50.187334 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 22:08:50.187334 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 22:08:50.187334 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: 9adcc8a95203462ea78164d4db440351 Oct 22 22:08:50.187334 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-TestMinimumBasicScenario-1689753837-project Oct 22 22:08:50.187334 ncdv-master-1 devstack@n-api.service[138744]: method: > Oct 22 22:08:50.187334 ncdv-master-1 devstack@n-api.service[138744]: exception: Instance e2939456-8793-4020-8eeb-cdd31cdde758 could not be found. Oct 22 22:08:50.187334 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': 'e2939456-8793-4020-8eeb-cdd31cdde758'} Oct 22 22:08:50.187334 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 22:08:50.187334 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 22:08:50.187334 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 22:08:50.187334 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 22:08:50.187334 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 22:08:50.187334 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 22:08:50.187334 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 22:08:50.187334 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 22:08:50.187334 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 22:08:50.187334 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 22:08:50.187334 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e2939456-8793-4020-8eeb-cdd31cdde758 could not be found. Oct 22 22:08:50.187334 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 22:08:50.187334 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 22:08:50.187334 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 22:08:50.187334 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 22:08:50.187334 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 22:08:50.187334 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 22:08:50.187334 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 22:08:50.187334 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 22:08:50.187334 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 22:08:50.187334 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 22:08:50.187334 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 22:08:50.187334 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 22:08:50.187334 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 22:08:50.187334 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 22:08:50.187334 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 22:08:50.187334 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 22:08:50.187334 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e2939456-8793-4020-8eeb-cdd31cdde758 could not be found. Oct 22 22:08:50.187334 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 22:08:50.187334 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 22:08:50.187334 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 22:08:50.192962 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 22:08:50.192962 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 22:08:50.192962 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 22:08:50.192962 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 22:08:50.192962 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 22:08:50.192962 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e2939456-8793-4020-8eeb-cdd31cdde758 could not be found. Oct 22 22:08:50.192962 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 22:08:50.192962 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-47c460c2-03f0-4236-a448-6fc329fcc131 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Returning 404 to user: Instance e2939456-8793-4020-8eeb-cdd31cdde758 could not be found. {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 22:08:50.192962 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-47c460c2-03f0-4236-a448-6fc329fcc131 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] 10.222.0.18 "GET /compute/v2.1/servers/e2939456-8793-4020-8eeb-cdd31cdde758" status: 404 len: 111 microversion: 2.1 time: 0.035591 Oct 22 22:08:50.192962 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3383/6796] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:08:50 2022] GET /compute/v2.1/servers/e2939456-8793-4020-8eeb-cdd31cdde758 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 22:08:50.197993 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-205329a0-0b58-4038-81bd-b533a1752370 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] Calling method '.version_select at 0x7fd39fd30940>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:08:50.202503 ncdv-master-1 devstack@n-api.service[138745]: ERROR oslo.messaging._drivers.impl_rabbit [None req-205329a0-0b58-4038-81bd-b533a1752370 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] [fdffe6b9-9d4b-45b8-9714-1ef9d5132dcd] AMQP server on 10.222.0.18:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 22 22:08:51.213670 ncdv-master-1 devstack@n-api.service[138745]: INFO oslo.messaging._drivers.impl_rabbit [None req-205329a0-0b58-4038-81bd-b533a1752370 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] [fdffe6b9-9d4b-45b8-9714-1ef9d5132dcd] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 38570. Oct 22 22:08:51.241087 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-205329a0-0b58-4038-81bd-b533a1752370 tempest-TestMinimumBasicScenario-1689753837 tempest-TestMinimumBasicScenario-1689753837-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1779957509" status: 202 len: 0 microversion: 2.1 time: 1.046700 Oct 22 22:08:51.241853 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3414/6797] 10.222.0.18 () {58 vars in 1272 bytes} [Sat Oct 22 22:08:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1779957509 => generated 0 bytes in 1049 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 22 22:09:00.407874 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_api:SELECT=14 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:09:00.408690 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:SELECT=31,nova_cell1:INSERT=1 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:09:00.577119 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-e78df4a5-86a3-49d3-99a8-64ac7712f959 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Action: 'create', calling method: .version_select at 0x7fd39ea624c0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-24858116", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK1DxAmYvaCt/jWb19V+zBIbbjksk5+0OLFwHdjUupedENuh9ZxyAfcvQANg7vfvIxuF5fiNVFBxFaquwn0qUW282kVfhPf1nR5SQ5yBYCAb+JgbGAXNN1NMAa8kOU7+iQ=="}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 22:09:00.595882 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-e78df4a5-86a3-49d3-99a8-64ac7712f959 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Getting quotas for project 2463781199104e15aea02b6280ceaacf. Resources: {'key_pairs'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 22:09:00.601754 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-e78df4a5-86a3-49d3-99a8-64ac7712f959 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Getting quotas for user e3841796765145e1876ddee315b81bea and project 2463781199104e15aea02b6280ceaacf. Resources: {'key_pairs'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 22:09:00.617263 ncdv-master-1 devstack@n-api.service[138744]: ERROR oslo.messaging._drivers.impl_rabbit [None req-e78df4a5-86a3-49d3-99a8-64ac7712f959 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] [1e95764d-9b00-41e5-9238-ea25707eb673] AMQP server on 10.222.0.18:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 22 22:09:01.628489 ncdv-master-1 devstack@n-api.service[138744]: INFO oslo.messaging._drivers.impl_rabbit [None req-e78df4a5-86a3-49d3-99a8-64ac7712f959 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] [1e95764d-9b00-41e5-9238-ea25707eb673] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 38698. Oct 22 22:09:01.652472 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-e78df4a5-86a3-49d3-99a8-64ac7712f959 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 1.250263 Oct 22 22:09:01.653092 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3384/6798] 10.222.0.18 () {60 vars in 1159 bytes} [Sat Oct 22 22:09:00 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 1252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 22:09:07.300201 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell1:SELECT=42,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:09:07.301230 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:09:07.305874 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-1a410a2e-1965-4c78-84bc-3e87d3c18aad tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-95227520", "imageRef": "085e4478-6edc-4a69-8e08-f9831713eb65", "flavorRef": "452", "networks": [{"uuid": "cafb1acd-b2c9-4bba-b4c7-ef3502ebb5d0"}], "key_name": "tempest-TestNetworkAdvancedServerOps-24858116", "security_groups": [{"name": "tempest-secgroup-smoke-64954561"}]}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 22:09:07.597936 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.network.neutron [None req-1a410a2e-1965-4c78-84bc-3e87d3c18aad tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] validate_networks() for [('cafb1acd-b2c9-4bba-b4c7-ef3502ebb5d0', None, None, None, None, None)] {{(pid=138745) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 22:09:08.087906 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-1a410a2e-1965-4c78-84bc-3e87d3c18aad tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Flavor limits 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 22:09:08.088351 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-1a410a2e-1965-4c78-84bc-3e87d3c18aad tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Image limits 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 22:09:08.089067 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-1a410a2e-1965-4c78-84bc-3e87d3c18aad tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Flavor pref 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 22:09:08.089499 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-1a410a2e-1965-4c78-84bc-3e87d3c18aad tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Image pref 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 22:09:08.089930 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-1a410a2e-1965-4c78-84bc-3e87d3c18aad tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 22:09:08.101377 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1a410a2e-1965-4c78-84bc-3e87d3c18aad tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:09:08.102277 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1a410a2e-1965-4c78-84bc-3e87d3c18aad tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:09:08.102963 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1a410a2e-1965-4c78-84bc-3e87d3c18aad tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:09:08.104512 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1a410a2e-1965-4c78-84bc-3e87d3c18aad tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:09:08.105243 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1a410a2e-1965-4c78-84bc-3e87d3c18aad tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:09:08.106967 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1a410a2e-1965-4c78-84bc-3e87d3c18aad tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:09:08.132687 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-1a410a2e-1965-4c78-84bc-3e87d3c18aad tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Getting quotas for project 2463781199104e15aea02b6280ceaacf. Resources: {'cores', 'instances', 'ram'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 22:09:08.140564 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-1a410a2e-1965-4c78-84bc-3e87d3c18aad tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Getting quotas for user e3841796765145e1876ddee315b81bea and project 2463781199104e15aea02b6280ceaacf. Resources: {'cores', 'instances', 'ram'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 22:09:08.158420 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-1a410a2e-1965-4c78-84bc-3e87d3c18aad tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Going to run 1 instances... {{(pid=138745) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 22:09:08.161244 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-1a410a2e-1965-4c78-84bc-3e87d3c18aad tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] [instance: 5eea1266-1e9b-46de-8837-65dc5b4f9119] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='085e4478-6edc-4a69-8e08-f9831713eb65',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138745) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 22:09:08.216701 ncdv-master-1 devstack@n-api.service[138745]: ERROR oslo.messaging._drivers.impl_rabbit [None req-1a410a2e-1965-4c78-84bc-3e87d3c18aad tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] [56d69d84-d163-4032-a20a-431de1095b7a] AMQP server on 10.222.0.18:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 22 22:09:09.229349 ncdv-master-1 devstack@n-api.service[138745]: INFO oslo.messaging._drivers.impl_rabbit [None req-1a410a2e-1965-4c78-84bc-3e87d3c18aad tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] [56d69d84-d163-4032-a20a-431de1095b7a] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 38746. Oct 22 22:09:09.234303 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-1a410a2e-1965-4c78-84bc-3e87d3c18aad tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.935888 Oct 22 22:09:09.235085 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3415/6799] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Oct 22 22:09:07 2022] POST /compute/v2.1/servers => generated 404 bytes in 1938 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 22 22:09:09.248295 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-34b4aa67-dc1f-4540-9c00-17a6cbe9363d tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:09:09.249596 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-34b4aa67-dc1f-4540-9c00-17a6cbe9363d tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] [instance: 5eea1266-1e9b-46de-8837-65dc5b4f9119] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:09:09.388291 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-34b4aa67-dc1f-4540-9c00-17a6cbe9363d tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3841796765145e1876ddee315b81bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2463781199104e15aea02b6280ceaacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:09:09.412165 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-34b4aa67-dc1f-4540-9c00-17a6cbe9363d tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] 10.222.0.18 "GET /compute/v2.1/servers/5eea1266-1e9b-46de-8837-65dc5b4f9119" status: 200 len: 1263 microversion: 2.1 time: 0.169105 Oct 22 22:09:09.412760 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3385/6800] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:09:09 2022] GET /compute/v2.1/servers/5eea1266-1e9b-46de-8837-65dc5b4f9119 => generated 1263 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:09:10.439933 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-30fc4540-1212-4465-9ed6-19a74a35be49 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:09:10.440700 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-30fc4540-1212-4465-9ed6-19a74a35be49 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] [instance: 5eea1266-1e9b-46de-8837-65dc5b4f9119] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:09:10.448173 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-30fc4540-1212-4465-9ed6-19a74a35be49 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:09:10.448709 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-30fc4540-1212-4465-9ed6-19a74a35be49 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:09:10.449166 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-30fc4540-1212-4465-9ed6-19a74a35be49 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:09:10.449919 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-30fc4540-1212-4465-9ed6-19a74a35be49 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:09:10.450403 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-30fc4540-1212-4465-9ed6-19a74a35be49 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:09:10.450846 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-30fc4540-1212-4465-9ed6-19a74a35be49 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:09:10.879404 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-30fc4540-1212-4465-9ed6-19a74a35be49 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3841796765145e1876ddee315b81bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2463781199104e15aea02b6280ceaacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:09:10.887525 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-30fc4540-1212-4465-9ed6-19a74a35be49 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] 10.222.0.18 "GET /compute/v2.1/servers/5eea1266-1e9b-46de-8837-65dc5b4f9119" status: 200 len: 1315 microversion: 2.1 time: 0.453197 Oct 22 22:09:10.888219 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3416/6801] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:09:10 2022] GET /compute/v2.1/servers/5eea1266-1e9b-46de-8837-65dc5b4f9119 => generated 1315 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:09:11.912856 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-2c7eef6d-d4a8-4cd1-860e-36059020edbd tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:09:11.913461 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-2c7eef6d-d4a8-4cd1-860e-36059020edbd tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] [instance: 5eea1266-1e9b-46de-8837-65dc5b4f9119] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:09:11.921279 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2c7eef6d-d4a8-4cd1-860e-36059020edbd tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:09:11.921764 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2c7eef6d-d4a8-4cd1-860e-36059020edbd tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:09:11.922209 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2c7eef6d-d4a8-4cd1-860e-36059020edbd tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:09:11.922922 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2c7eef6d-d4a8-4cd1-860e-36059020edbd tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:09:11.923389 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2c7eef6d-d4a8-4cd1-860e-36059020edbd tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:09:11.923905 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2c7eef6d-d4a8-4cd1-860e-36059020edbd tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:09:12.060239 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-2c7eef6d-d4a8-4cd1-860e-36059020edbd tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3841796765145e1876ddee315b81bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2463781199104e15aea02b6280ceaacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:09:12.068265 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-2c7eef6d-d4a8-4cd1-860e-36059020edbd tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] 10.222.0.18 "GET /compute/v2.1/servers/5eea1266-1e9b-46de-8837-65dc5b4f9119" status: 200 len: 1387 microversion: 2.1 time: 0.160604 Oct 22 22:09:12.068846 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3386/6802] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:09:11 2022] GET /compute/v2.1/servers/5eea1266-1e9b-46de-8837-65dc5b4f9119 => generated 1387 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:09:12.112470 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-545084b0-e3c0-4078-9b19-04d948ed5416 req-f2fa7333-7299-4f9c-88b7-80d2ede34155 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5eea1266-1e9b-46de-8837-65dc5b4f9119", "tag": "6340a394-97b0-4f32-8dbf-480982198bd2"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 22:09:12.126188 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-545084b0-e3c0-4078-9b19-04d948ed5416 req-f2fa7333-7299-4f9c-88b7-80d2ede34155 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:09:12.126795 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-545084b0-e3c0-4078-9b19-04d948ed5416 req-f2fa7333-7299-4f9c-88b7-80d2ede34155 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:09:12.127579 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-545084b0-e3c0-4078-9b19-04d948ed5416 req-f2fa7333-7299-4f9c-88b7-80d2ede34155 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:09:12.141677 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-545084b0-e3c0-4078-9b19-04d948ed5416 req-f2fa7333-7299-4f9c-88b7-80d2ede34155 service nova] Creating event network-changed:6340a394-97b0-4f32-8dbf-480982198bd2 for instance 5eea1266-1e9b-46de-8837-65dc5b4f9119 on nch1-master-1 Oct 22 22:09:12.147346 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-545084b0-e3c0-4078-9b19-04d948ed5416 req-f2fa7333-7299-4f9c-88b7-80d2ede34155 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038879 Oct 22 22:09:12.148393 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3417/6803] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 22:09:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 22:09:13.092464 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-48e29b37-a6dd-4b3e-a790-1aeba55c11b9 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:09:13.092997 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-48e29b37-a6dd-4b3e-a790-1aeba55c11b9 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] [instance: 5eea1266-1e9b-46de-8837-65dc5b4f9119] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:09:13.100621 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-48e29b37-a6dd-4b3e-a790-1aeba55c11b9 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:09:13.101142 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-48e29b37-a6dd-4b3e-a790-1aeba55c11b9 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:09:13.101582 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-48e29b37-a6dd-4b3e-a790-1aeba55c11b9 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:09:13.102287 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-48e29b37-a6dd-4b3e-a790-1aeba55c11b9 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:09:13.102745 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-48e29b37-a6dd-4b3e-a790-1aeba55c11b9 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:09:13.103181 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-48e29b37-a6dd-4b3e-a790-1aeba55c11b9 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:09:13.253805 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-48e29b37-a6dd-4b3e-a790-1aeba55c11b9 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3841796765145e1876ddee315b81bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2463781199104e15aea02b6280ceaacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:09:13.261937 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-48e29b37-a6dd-4b3e-a790-1aeba55c11b9 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] 10.222.0.18 "GET /compute/v2.1/servers/5eea1266-1e9b-46de-8837-65dc5b4f9119" status: 200 len: 1387 microversion: 2.1 time: 0.173919 Oct 22 22:09:13.262498 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3387/6804] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:09:13 2022] GET /compute/v2.1/servers/5eea1266-1e9b-46de-8837-65dc5b4f9119 => generated 1387 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:09:14.288209 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-780b711c-7c1d-4ad1-9ce1-712a06e41491 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:09:14.288971 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-780b711c-7c1d-4ad1-9ce1-712a06e41491 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] [instance: 5eea1266-1e9b-46de-8837-65dc5b4f9119] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:09:14.296944 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-780b711c-7c1d-4ad1-9ce1-712a06e41491 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:09:14.297444 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-780b711c-7c1d-4ad1-9ce1-712a06e41491 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:09:14.297922 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-780b711c-7c1d-4ad1-9ce1-712a06e41491 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:09:14.298671 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-780b711c-7c1d-4ad1-9ce1-712a06e41491 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:09:14.299213 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-780b711c-7c1d-4ad1-9ce1-712a06e41491 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:09:14.299718 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-780b711c-7c1d-4ad1-9ce1-712a06e41491 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:09:14.439033 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-780b711c-7c1d-4ad1-9ce1-712a06e41491 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3841796765145e1876ddee315b81bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2463781199104e15aea02b6280ceaacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:09:14.451641 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-780b711c-7c1d-4ad1-9ce1-712a06e41491 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] 10.222.0.18 "GET /compute/v2.1/servers/5eea1266-1e9b-46de-8837-65dc5b4f9119" status: 200 len: 1387 microversion: 2.1 time: 0.168089 Oct 22 22:09:14.452423 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3418/6805] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:09:14 2022] GET /compute/v2.1/servers/5eea1266-1e9b-46de-8837-65dc5b4f9119 => generated 1387 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:09:15.475575 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-834f82dd-bd78-4308-8fda-1400f64042bc tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:09:15.476134 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-834f82dd-bd78-4308-8fda-1400f64042bc tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] [instance: 5eea1266-1e9b-46de-8837-65dc5b4f9119] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:09:15.483547 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-834f82dd-bd78-4308-8fda-1400f64042bc tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:09:15.484011 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-834f82dd-bd78-4308-8fda-1400f64042bc tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:09:15.484448 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-834f82dd-bd78-4308-8fda-1400f64042bc tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:09:15.485138 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-834f82dd-bd78-4308-8fda-1400f64042bc tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:09:15.485593 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-834f82dd-bd78-4308-8fda-1400f64042bc tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:09:15.486017 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-834f82dd-bd78-4308-8fda-1400f64042bc tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:09:15.632827 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-834f82dd-bd78-4308-8fda-1400f64042bc tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3841796765145e1876ddee315b81bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2463781199104e15aea02b6280ceaacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:09:15.642735 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-834f82dd-bd78-4308-8fda-1400f64042bc tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] 10.222.0.18 "GET /compute/v2.1/servers/5eea1266-1e9b-46de-8837-65dc5b4f9119" status: 200 len: 1387 microversion: 2.1 time: 0.170840 Oct 22 22:09:15.643671 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3388/6806] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:09:15 2022] GET /compute/v2.1/servers/5eea1266-1e9b-46de-8837-65dc5b4f9119 => generated 1387 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:09:16.666410 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-58a1c8fd-581d-4ebe-9f9b-b27f6a326713 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:09:16.667132 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-58a1c8fd-581d-4ebe-9f9b-b27f6a326713 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] [instance: 5eea1266-1e9b-46de-8837-65dc5b4f9119] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:09:16.674183 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-58a1c8fd-581d-4ebe-9f9b-b27f6a326713 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:09:16.674688 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-58a1c8fd-581d-4ebe-9f9b-b27f6a326713 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:09:16.675199 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-58a1c8fd-581d-4ebe-9f9b-b27f6a326713 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:09:16.675959 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-58a1c8fd-581d-4ebe-9f9b-b27f6a326713 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:09:16.676443 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-58a1c8fd-581d-4ebe-9f9b-b27f6a326713 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:09:16.676890 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-58a1c8fd-581d-4ebe-9f9b-b27f6a326713 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:09:16.814399 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-58a1c8fd-581d-4ebe-9f9b-b27f6a326713 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3841796765145e1876ddee315b81bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2463781199104e15aea02b6280ceaacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:09:16.826662 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-58a1c8fd-581d-4ebe-9f9b-b27f6a326713 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] 10.222.0.18 "GET /compute/v2.1/servers/5eea1266-1e9b-46de-8837-65dc5b4f9119" status: 200 len: 1387 microversion: 2.1 time: 0.163911 Oct 22 22:09:16.827426 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3419/6807] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:09:16 2022] GET /compute/v2.1/servers/5eea1266-1e9b-46de-8837-65dc5b4f9119 => generated 1387 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:09:17.853994 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-1eaeea1b-efc1-4506-9417-0d0b4d5da200 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:09:17.854639 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-1eaeea1b-efc1-4506-9417-0d0b4d5da200 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] [instance: 5eea1266-1e9b-46de-8837-65dc5b4f9119] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:09:17.863269 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1eaeea1b-efc1-4506-9417-0d0b4d5da200 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:09:17.863913 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1eaeea1b-efc1-4506-9417-0d0b4d5da200 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:09:17.864435 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1eaeea1b-efc1-4506-9417-0d0b4d5da200 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:09:17.865345 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1eaeea1b-efc1-4506-9417-0d0b4d5da200 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:09:17.865882 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1eaeea1b-efc1-4506-9417-0d0b4d5da200 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:09:17.866399 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1eaeea1b-efc1-4506-9417-0d0b4d5da200 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:09:18.005633 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-1eaeea1b-efc1-4506-9417-0d0b4d5da200 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3841796765145e1876ddee315b81bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2463781199104e15aea02b6280ceaacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:09:18.016451 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-1eaeea1b-efc1-4506-9417-0d0b4d5da200 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] 10.222.0.18 "GET /compute/v2.1/servers/5eea1266-1e9b-46de-8837-65dc5b4f9119" status: 200 len: 1387 microversion: 2.1 time: 0.167255 Oct 22 22:09:18.017201 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3389/6808] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:09:17 2022] GET /compute/v2.1/servers/5eea1266-1e9b-46de-8837-65dc5b4f9119 => generated 1387 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:09:18.297467 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-6ee4e71f-60b3-4312-9cd5-1623cfabce53 req-8580cf22-eb06-45f2-a962-16699455d57f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5eea1266-1e9b-46de-8837-65dc5b4f9119", "name": "network-vif-plugged", "status": "completed", "tag": "6340a394-97b0-4f32-8dbf-480982198bd2"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 22:09:18.303526 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell0:SELECT=2 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:09:18.304222 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell0:SELECT=6 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:09:18.310386 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-6ee4e71f-60b3-4312-9cd5-1623cfabce53 req-8580cf22-eb06-45f2-a962-16699455d57f service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:09:18.310909 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-6ee4e71f-60b3-4312-9cd5-1623cfabce53 req-8580cf22-eb06-45f2-a962-16699455d57f service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:09:18.311373 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-6ee4e71f-60b3-4312-9cd5-1623cfabce53 req-8580cf22-eb06-45f2-a962-16699455d57f service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:09:18.323641 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-6ee4e71f-60b3-4312-9cd5-1623cfabce53 req-8580cf22-eb06-45f2-a962-16699455d57f service nova] Creating event network-vif-plugged:6340a394-97b0-4f32-8dbf-480982198bd2 for instance 5eea1266-1e9b-46de-8837-65dc5b4f9119 on nch1-master-1 Oct 22 22:09:18.328759 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-6ee4e71f-60b3-4312-9cd5-1623cfabce53 req-8580cf22-eb06-45f2-a962-16699455d57f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035131 Oct 22 22:09:18.329539 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3420/6809] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 22:09:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 22:09:19.041518 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-b89b145f-33d9-4808-ab80-93c0b096c561 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:09:19.042122 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-b89b145f-33d9-4808-ab80-93c0b096c561 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] [instance: 5eea1266-1e9b-46de-8837-65dc5b4f9119] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:09:19.048593 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b89b145f-33d9-4808-ab80-93c0b096c561 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:09:19.049085 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b89b145f-33d9-4808-ab80-93c0b096c561 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:09:19.049532 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b89b145f-33d9-4808-ab80-93c0b096c561 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:09:19.050231 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b89b145f-33d9-4808-ab80-93c0b096c561 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:09:19.050685 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b89b145f-33d9-4808-ab80-93c0b096c561 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:09:19.051124 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b89b145f-33d9-4808-ab80-93c0b096c561 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:09:19.188460 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-b89b145f-33d9-4808-ab80-93c0b096c561 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3841796765145e1876ddee315b81bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2463781199104e15aea02b6280ceaacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:09:19.198253 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-b89b145f-33d9-4808-ab80-93c0b096c561 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] 10.222.0.18 "GET /compute/v2.1/servers/5eea1266-1e9b-46de-8837-65dc5b4f9119" status: 200 len: 1387 microversion: 2.1 time: 0.162003 Oct 22 22:09:19.198835 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3390/6810] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:09:19 2022] GET /compute/v2.1/servers/5eea1266-1e9b-46de-8837-65dc5b4f9119 => generated 1387 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:09:20.223758 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-3d6498f4-df0b-4fce-98bf-e155ab5f6a74 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:09:20.224481 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-3d6498f4-df0b-4fce-98bf-e155ab5f6a74 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] [instance: 5eea1266-1e9b-46de-8837-65dc5b4f9119] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:09:20.231058 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3d6498f4-df0b-4fce-98bf-e155ab5f6a74 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:09:20.231597 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3d6498f4-df0b-4fce-98bf-e155ab5f6a74 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:09:20.232064 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3d6498f4-df0b-4fce-98bf-e155ab5f6a74 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:09:20.232787 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3d6498f4-df0b-4fce-98bf-e155ab5f6a74 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:09:20.233262 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3d6498f4-df0b-4fce-98bf-e155ab5f6a74 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:09:20.233713 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3d6498f4-df0b-4fce-98bf-e155ab5f6a74 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:09:20.370021 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-3d6498f4-df0b-4fce-98bf-e155ab5f6a74 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3841796765145e1876ddee315b81bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2463781199104e15aea02b6280ceaacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:09:20.378373 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-3d6498f4-df0b-4fce-98bf-e155ab5f6a74 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] 10.222.0.18 "GET /compute/v2.1/servers/5eea1266-1e9b-46de-8837-65dc5b4f9119" status: 200 len: 1559 microversion: 2.1 time: 0.159911 Oct 22 22:09:20.378878 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3421/6811] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:09:20 2022] GET /compute/v2.1/servers/5eea1266-1e9b-46de-8837-65dc5b4f9119 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:09:20.400979 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-5240fb26-dee9-4af5-a79f-b6e43bb27e04 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:09:20.401568 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-5240fb26-dee9-4af5-a79f-b6e43bb27e04 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] [instance: 5eea1266-1e9b-46de-8837-65dc5b4f9119] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:09:20.403539 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell0:SELECT=6 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:09:20.410104 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5240fb26-dee9-4af5-a79f-b6e43bb27e04 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:09:20.410591 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5240fb26-dee9-4af5-a79f-b6e43bb27e04 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:09:20.411033 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5240fb26-dee9-4af5-a79f-b6e43bb27e04 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:09:20.411775 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5240fb26-dee9-4af5-a79f-b6e43bb27e04 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:09:20.412210 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5240fb26-dee9-4af5-a79f-b6e43bb27e04 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:09:20.412705 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5240fb26-dee9-4af5-a79f-b6e43bb27e04 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:09:20.570992 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-5240fb26-dee9-4af5-a79f-b6e43bb27e04 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3841796765145e1876ddee315b81bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2463781199104e15aea02b6280ceaacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:09:20.578964 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-5240fb26-dee9-4af5-a79f-b6e43bb27e04 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] 10.222.0.18 "GET /compute/v2.1/servers/5eea1266-1e9b-46de-8837-65dc5b4f9119" status: 200 len: 1559 microversion: 2.1 time: 0.182014 Oct 22 22:09:20.579576 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3391/6812] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:09:20 2022] GET /compute/v2.1/servers/5eea1266-1e9b-46de-8837-65dc5b4f9119 => generated 1559 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:09:22.239254 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-b4e8839b-1dff-459c-9423-1444bd6d27b9 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:09:22.240072 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-b4e8839b-1dff-459c-9423-1444bd6d27b9 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] [instance: 5eea1266-1e9b-46de-8837-65dc5b4f9119] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:09:22.241217 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-6560f349-d5eb-410c-94f7-79402d4c87e6 req-a239db37-fbe2-49d3-b0b6-aac7d89ebca9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5eea1266-1e9b-46de-8837-65dc5b4f9119", "tag": "6340a394-97b0-4f32-8dbf-480982198bd2"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 22:09:22.247644 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b4e8839b-1dff-459c-9423-1444bd6d27b9 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:09:22.248162 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b4e8839b-1dff-459c-9423-1444bd6d27b9 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:09:22.248627 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b4e8839b-1dff-459c-9423-1444bd6d27b9 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:09:22.249361 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b4e8839b-1dff-459c-9423-1444bd6d27b9 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:09:22.249946 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b4e8839b-1dff-459c-9423-1444bd6d27b9 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:09:22.250392 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b4e8839b-1dff-459c-9423-1444bd6d27b9 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:09:22.252917 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-6560f349-d5eb-410c-94f7-79402d4c87e6 req-a239db37-fbe2-49d3-b0b6-aac7d89ebca9 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:09:22.253473 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-6560f349-d5eb-410c-94f7-79402d4c87e6 req-a239db37-fbe2-49d3-b0b6-aac7d89ebca9 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:09:22.254155 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-6560f349-d5eb-410c-94f7-79402d4c87e6 req-a239db37-fbe2-49d3-b0b6-aac7d89ebca9 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:09:22.266383 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-6560f349-d5eb-410c-94f7-79402d4c87e6 req-a239db37-fbe2-49d3-b0b6-aac7d89ebca9 service nova] Creating event network-changed:6340a394-97b0-4f32-8dbf-480982198bd2 for instance 5eea1266-1e9b-46de-8837-65dc5b4f9119 on nch1-master-1 Oct 22 22:09:22.272183 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-6560f349-d5eb-410c-94f7-79402d4c87e6 req-a239db37-fbe2-49d3-b0b6-aac7d89ebca9 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034932 Oct 22 22:09:22.273312 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3392/6813] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 22:09:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 22:09:22.390924 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-b4e8839b-1dff-459c-9423-1444bd6d27b9 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3841796765145e1876ddee315b81bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2463781199104e15aea02b6280ceaacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:09:22.399192 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-b4e8839b-1dff-459c-9423-1444bd6d27b9 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] 10.222.0.18 "GET /compute/v2.1/servers/5eea1266-1e9b-46de-8837-65dc5b4f9119" status: 200 len: 1559 microversion: 2.1 time: 0.164456 Oct 22 22:09:22.399823 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3422/6814] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:09:22 2022] GET /compute/v2.1/servers/5eea1266-1e9b-46de-8837-65dc5b4f9119 => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:09:55.752375 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:09:55.753109 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:SELECT=38 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:09:55.757747 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-5e27b66b-3af1-4325-97a3-952945cc8974 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 22:09:55.760305 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-5e27b66b-3af1-4325-97a3-952945cc8974 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] [instance: 5eea1266-1e9b-46de-8837-65dc5b4f9119] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:09:55.769023 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5e27b66b-3af1-4325-97a3-952945cc8974 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:09:55.769562 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5e27b66b-3af1-4325-97a3-952945cc8974 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:09:55.770053 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5e27b66b-3af1-4325-97a3-952945cc8974 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:09:55.770818 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5e27b66b-3af1-4325-97a3-952945cc8974 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:09:55.771317 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5e27b66b-3af1-4325-97a3-952945cc8974 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:09:55.771838 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5e27b66b-3af1-4325-97a3-952945cc8974 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:09:55.826588 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-5e27b66b-3af1-4325-97a3-952945cc8974 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] 10.222.0.18 "POST /compute/v2.1/servers/5eea1266-1e9b-46de-8837-65dc5b4f9119/action" status: 200 len: 24566 microversion: 2.1 time: 0.076230 Oct 22 22:09:55.827441 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3393/6815] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 22:09:55 2022] POST /compute/v2.1/servers/5eea1266-1e9b-46de-8837-65dc5b4f9119/action => generated 24566 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 22 22:10:26.068699 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:10:26.069481 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell1:SELECT=36 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:10:26.074132 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-6bc4fe6f-5ffa-4611-87d5-8e574eee20e0 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 22:10:26.074767 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-6bc4fe6f-5ffa-4611-87d5-8e574eee20e0 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] [instance: 5eea1266-1e9b-46de-8837-65dc5b4f9119] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:10:26.082726 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6bc4fe6f-5ffa-4611-87d5-8e574eee20e0 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:10:26.083225 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6bc4fe6f-5ffa-4611-87d5-8e574eee20e0 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:10:26.083775 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6bc4fe6f-5ffa-4611-87d5-8e574eee20e0 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:10:26.084667 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6bc4fe6f-5ffa-4611-87d5-8e574eee20e0 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:10:26.085178 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6bc4fe6f-5ffa-4611-87d5-8e574eee20e0 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:10:26.085625 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6bc4fe6f-5ffa-4611-87d5-8e574eee20e0 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:10:26.165098 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-6bc4fe6f-5ffa-4611-87d5-8e574eee20e0 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] 10.222.0.18 "POST /compute/v2.1/servers/5eea1266-1e9b-46de-8837-65dc5b4f9119/action" status: 202 len: 0 microversion: 2.1 time: 0.098374 Oct 22 22:10:26.165747 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3423/6816] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 22:10:26 2022] POST /compute/v2.1/servers/5eea1266-1e9b-46de-8837-65dc5b4f9119/action => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 22:10:26.175732 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-8304574e-1f9c-4b7f-9342-a2aae65353a7 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:10:26.176466 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-8304574e-1f9c-4b7f-9342-a2aae65353a7 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] [instance: 5eea1266-1e9b-46de-8837-65dc5b4f9119] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:10:26.179278 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_api:SELECT=2 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:10:26.179949 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:SELECT=4 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:10:26.186159 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8304574e-1f9c-4b7f-9342-a2aae65353a7 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:10:26.186815 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8304574e-1f9c-4b7f-9342-a2aae65353a7 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:10:26.187389 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8304574e-1f9c-4b7f-9342-a2aae65353a7 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:10:26.188319 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8304574e-1f9c-4b7f-9342-a2aae65353a7 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:10:26.188844 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8304574e-1f9c-4b7f-9342-a2aae65353a7 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:10:26.190194 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8304574e-1f9c-4b7f-9342-a2aae65353a7 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:10:26.645661 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-8304574e-1f9c-4b7f-9342-a2aae65353a7 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3841796765145e1876ddee315b81bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2463781199104e15aea02b6280ceaacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:10:26.656426 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-8304574e-1f9c-4b7f-9342-a2aae65353a7 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] 10.222.0.18 "GET /compute/v2.1/servers/5eea1266-1e9b-46de-8837-65dc5b4f9119" status: 200 len: 1683 microversion: 2.1 time: 0.484701 Oct 22 22:10:26.657177 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3394/6817] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:10:26 2022] GET /compute/v2.1/servers/5eea1266-1e9b-46de-8837-65dc5b4f9119 => generated 1683 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:10:27.683604 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-dbf1d0b3-193d-41dd-aee9-9b9b02e5cff9 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:10:27.684328 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-dbf1d0b3-193d-41dd-aee9-9b9b02e5cff9 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] [instance: 5eea1266-1e9b-46de-8837-65dc5b4f9119] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:10:27.691158 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-dbf1d0b3-193d-41dd-aee9-9b9b02e5cff9 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:10:27.691716 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-dbf1d0b3-193d-41dd-aee9-9b9b02e5cff9 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:10:27.692161 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-dbf1d0b3-193d-41dd-aee9-9b9b02e5cff9 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:10:27.692954 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-dbf1d0b3-193d-41dd-aee9-9b9b02e5cff9 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:10:27.693433 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-dbf1d0b3-193d-41dd-aee9-9b9b02e5cff9 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:10:27.693877 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-dbf1d0b3-193d-41dd-aee9-9b9b02e5cff9 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:10:27.834466 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-dbf1d0b3-193d-41dd-aee9-9b9b02e5cff9 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3841796765145e1876ddee315b81bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2463781199104e15aea02b6280ceaacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:10:27.843637 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-dbf1d0b3-193d-41dd-aee9-9b9b02e5cff9 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] 10.222.0.18 "GET /compute/v2.1/servers/5eea1266-1e9b-46de-8837-65dc5b4f9119" status: 200 len: 1663 microversion: 2.1 time: 0.165542 Oct 22 22:10:27.844215 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3424/6818] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:10:27 2022] GET /compute/v2.1/servers/5eea1266-1e9b-46de-8837-65dc5b4f9119 => generated 1663 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:10:28.951178 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-63acf79a-ba98-4e80-a943-616d60c748d5 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 22:10:28.953750 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-63acf79a-ba98-4e80-a943-616d60c748d5 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] [instance: 5eea1266-1e9b-46de-8837-65dc5b4f9119] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:10:28.962726 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-63acf79a-ba98-4e80-a943-616d60c748d5 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:10:28.963219 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-63acf79a-ba98-4e80-a943-616d60c748d5 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:10:28.963696 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-63acf79a-ba98-4e80-a943-616d60c748d5 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:10:28.964399 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-63acf79a-ba98-4e80-a943-616d60c748d5 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:10:28.964851 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-63acf79a-ba98-4e80-a943-616d60c748d5 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:10:28.965275 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-63acf79a-ba98-4e80-a943-616d60c748d5 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:10:29.016830 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-63acf79a-ba98-4e80-a943-616d60c748d5 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] 10.222.0.18 "POST /compute/v2.1/servers/5eea1266-1e9b-46de-8837-65dc5b4f9119/action" status: 200 len: 32639 microversion: 2.1 time: 0.070076 Oct 22 22:10:29.017424 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3395/6819] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 22:10:28 2022] POST /compute/v2.1/servers/5eea1266-1e9b-46de-8837-65dc5b4f9119/action => generated 32639 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 22 22:10:29.029604 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-9deee6d3-bc74-4240-a2ce-c6e0f3b34cf3 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 22:10:29.030177 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-9deee6d3-bc74-4240-a2ce-c6e0f3b34cf3 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] [instance: 5eea1266-1e9b-46de-8837-65dc5b4f9119] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:10:29.037878 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9deee6d3-bc74-4240-a2ce-c6e0f3b34cf3 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:10:29.038393 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9deee6d3-bc74-4240-a2ce-c6e0f3b34cf3 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:10:29.038858 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9deee6d3-bc74-4240-a2ce-c6e0f3b34cf3 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:10:29.039630 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9deee6d3-bc74-4240-a2ce-c6e0f3b34cf3 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:10:29.040109 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9deee6d3-bc74-4240-a2ce-c6e0f3b34cf3 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:10:29.040595 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9deee6d3-bc74-4240-a2ce-c6e0f3b34cf3 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:10:29.116671 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-9deee6d3-bc74-4240-a2ce-c6e0f3b34cf3 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] 10.222.0.18 "POST /compute/v2.1/servers/5eea1266-1e9b-46de-8837-65dc5b4f9119/action" status: 202 len: 0 microversion: 2.1 time: 0.090731 Oct 22 22:10:29.117793 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3425/6820] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 22:10:29 2022] POST /compute/v2.1/servers/5eea1266-1e9b-46de-8837-65dc5b4f9119/action => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 22:10:29.126896 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-619a3760-2cb2-4f54-a252-ca6c33d7bc78 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:10:29.128039 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-619a3760-2cb2-4f54-a252-ca6c33d7bc78 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] [instance: 5eea1266-1e9b-46de-8837-65dc5b4f9119] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:10:29.135786 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-619a3760-2cb2-4f54-a252-ca6c33d7bc78 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:10:29.136415 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-619a3760-2cb2-4f54-a252-ca6c33d7bc78 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:10:29.136887 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-619a3760-2cb2-4f54-a252-ca6c33d7bc78 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:10:29.137855 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-619a3760-2cb2-4f54-a252-ca6c33d7bc78 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:10:29.138355 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-619a3760-2cb2-4f54-a252-ca6c33d7bc78 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:10:29.138789 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-619a3760-2cb2-4f54-a252-ca6c33d7bc78 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:10:29.273619 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-619a3760-2cb2-4f54-a252-ca6c33d7bc78 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3841796765145e1876ddee315b81bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2463781199104e15aea02b6280ceaacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:10:29.282318 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-619a3760-2cb2-4f54-a252-ca6c33d7bc78 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] 10.222.0.18 "GET /compute/v2.1/servers/5eea1266-1e9b-46de-8837-65dc5b4f9119" status: 200 len: 1670 microversion: 2.1 time: 0.159852 Oct 22 22:10:29.282907 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3396/6821] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:10:29 2022] GET /compute/v2.1/servers/5eea1266-1e9b-46de-8837-65dc5b4f9119 => generated 1670 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:10:30.315267 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-799ebfd2-3f12-439e-9ce9-25bb9315f0a0 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:10:30.317559 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-799ebfd2-3f12-439e-9ce9-25bb9315f0a0 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] [instance: 5eea1266-1e9b-46de-8837-65dc5b4f9119] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:10:30.324825 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-799ebfd2-3f12-439e-9ce9-25bb9315f0a0 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:10:30.325377 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-799ebfd2-3f12-439e-9ce9-25bb9315f0a0 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:10:30.325835 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-799ebfd2-3f12-439e-9ce9-25bb9315f0a0 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:10:30.326565 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-799ebfd2-3f12-439e-9ce9-25bb9315f0a0 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:10:30.327053 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-799ebfd2-3f12-439e-9ce9-25bb9315f0a0 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:10:30.327598 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-799ebfd2-3f12-439e-9ce9-25bb9315f0a0 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:10:30.471488 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-799ebfd2-3f12-439e-9ce9-25bb9315f0a0 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3841796765145e1876ddee315b81bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2463781199104e15aea02b6280ceaacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:10:30.480136 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-799ebfd2-3f12-439e-9ce9-25bb9315f0a0 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] 10.222.0.18 "GET /compute/v2.1/servers/5eea1266-1e9b-46de-8837-65dc5b4f9119" status: 200 len: 1678 microversion: 2.1 time: 0.174077 Oct 22 22:10:30.480709 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3426/6822] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:10:30 2022] GET /compute/v2.1/servers/5eea1266-1e9b-46de-8837-65dc5b4f9119 => generated 1678 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:10:30.576293 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-e0e1a202-9aac-46d7-b8a4-b508e3e183c5 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 22:10:30.578491 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-e0e1a202-9aac-46d7-b8a4-b508e3e183c5 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] [instance: 5eea1266-1e9b-46de-8837-65dc5b4f9119] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:10:30.587234 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e0e1a202-9aac-46d7-b8a4-b508e3e183c5 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:10:30.587790 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e0e1a202-9aac-46d7-b8a4-b508e3e183c5 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:10:30.588249 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e0e1a202-9aac-46d7-b8a4-b508e3e183c5 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:10:30.589034 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e0e1a202-9aac-46d7-b8a4-b508e3e183c5 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:10:30.589504 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e0e1a202-9aac-46d7-b8a4-b508e3e183c5 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:10:30.589943 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e0e1a202-9aac-46d7-b8a4-b508e3e183c5 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:10:30.642777 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-e0e1a202-9aac-46d7-b8a4-b508e3e183c5 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] 10.222.0.18 "POST /compute/v2.1/servers/5eea1266-1e9b-46de-8837-65dc5b4f9119/action" status: 200 len: 38360 microversion: 2.1 time: 0.070338 Oct 22 22:10:30.643594 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3397/6823] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 22:10:30 2022] POST /compute/v2.1/servers/5eea1266-1e9b-46de-8837-65dc5b4f9119/action => generated 38360 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 22 22:10:31.638548 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-f94fdaeb-e85f-4f69-b1f9-a0028b7db995 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:10:31.639130 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-f94fdaeb-e85f-4f69-b1f9-a0028b7db995 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] [instance: 5eea1266-1e9b-46de-8837-65dc5b4f9119] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:10:31.640206 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-2c772523-96b5-452c-81dd-4a471e857819 req-f9a43736-8b03-4e1a-a29f-c34db7d3c75d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5eea1266-1e9b-46de-8837-65dc5b4f9119", "tag": "6340a394-97b0-4f32-8dbf-480982198bd2"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 22:10:31.646522 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f94fdaeb-e85f-4f69-b1f9-a0028b7db995 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:10:31.647165 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f94fdaeb-e85f-4f69-b1f9-a0028b7db995 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:10:31.647721 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f94fdaeb-e85f-4f69-b1f9-a0028b7db995 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:10:31.648459 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f94fdaeb-e85f-4f69-b1f9-a0028b7db995 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:10:31.648938 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f94fdaeb-e85f-4f69-b1f9-a0028b7db995 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:10:31.649380 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f94fdaeb-e85f-4f69-b1f9-a0028b7db995 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:10:31.656782 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-2c772523-96b5-452c-81dd-4a471e857819 req-f9a43736-8b03-4e1a-a29f-c34db7d3c75d service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:10:31.657193 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-2c772523-96b5-452c-81dd-4a471e857819 req-f9a43736-8b03-4e1a-a29f-c34db7d3c75d service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:10:31.657656 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-2c772523-96b5-452c-81dd-4a471e857819 req-f9a43736-8b03-4e1a-a29f-c34db7d3c75d service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:10:31.672712 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-2c772523-96b5-452c-81dd-4a471e857819 req-f9a43736-8b03-4e1a-a29f-c34db7d3c75d service nova] Creating event network-changed:6340a394-97b0-4f32-8dbf-480982198bd2 for instance 5eea1266-1e9b-46de-8837-65dc5b4f9119 on nch1-master-1 Oct 22 22:10:31.676966 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-f94fdaeb-e85f-4f69-b1f9-a0028b7db995 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] [instance: 5eea1266-1e9b-46de-8837-65dc5b4f9119] Going to try to terminate instance {{(pid=138745) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 22:10:31.678711 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-2c772523-96b5-452c-81dd-4a471e857819 req-f9a43736-8b03-4e1a-a29f-c34db7d3c75d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042336 Oct 22 22:10:31.680633 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3398/6824] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 22:10:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 22:10:31.771471 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-f94fdaeb-e85f-4f69-b1f9-a0028b7db995 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] 10.222.0.18 "DELETE /compute/v2.1/servers/5eea1266-1e9b-46de-8837-65dc5b4f9119" status: 204 len: 0 microversion: 2.1 time: 0.134239 Oct 22 22:10:31.773156 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3427/6825] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 22:10:31 2022] DELETE /compute/v2.1/servers/5eea1266-1e9b-46de-8837-65dc5b4f9119 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 22:10:31.782849 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-0f89d447-652a-48e6-8d39-970405fd1974 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:10:31.783747 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-0f89d447-652a-48e6-8d39-970405fd1974 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] [instance: 5eea1266-1e9b-46de-8837-65dc5b4f9119] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:10:31.792305 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0f89d447-652a-48e6-8d39-970405fd1974 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:10:31.793181 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0f89d447-652a-48e6-8d39-970405fd1974 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:10:31.793702 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0f89d447-652a-48e6-8d39-970405fd1974 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:10:31.794494 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0f89d447-652a-48e6-8d39-970405fd1974 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:10:31.795045 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0f89d447-652a-48e6-8d39-970405fd1974 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:10:31.795592 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0f89d447-652a-48e6-8d39-970405fd1974 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:10:31.937569 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-0f89d447-652a-48e6-8d39-970405fd1974 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3841796765145e1876ddee315b81bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2463781199104e15aea02b6280ceaacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:10:31.945719 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-0f89d447-652a-48e6-8d39-970405fd1974 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] 10.222.0.18 "GET /compute/v2.1/servers/5eea1266-1e9b-46de-8837-65dc5b4f9119" status: 200 len: 1684 microversion: 2.1 time: 0.167609 Oct 22 22:10:31.946536 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3399/6826] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:10:31 2022] GET /compute/v2.1/servers/5eea1266-1e9b-46de-8837-65dc5b4f9119 => generated 1684 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:10:32.975790 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-7e95d1d6-3d5e-4ff7-bbca-1b75de9bfad9 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:10:32.978008 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-7e95d1d6-3d5e-4ff7-bbca-1b75de9bfad9 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] [instance: 5eea1266-1e9b-46de-8837-65dc5b4f9119] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:10:32.990873 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7e95d1d6-3d5e-4ff7-bbca-1b75de9bfad9 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:10:32.991699 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7e95d1d6-3d5e-4ff7-bbca-1b75de9bfad9 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:10:32.992163 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7e95d1d6-3d5e-4ff7-bbca-1b75de9bfad9 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:10:32.994124 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7e95d1d6-3d5e-4ff7-bbca-1b75de9bfad9 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:10:32.994652 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7e95d1d6-3d5e-4ff7-bbca-1b75de9bfad9 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:10:32.995108 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7e95d1d6-3d5e-4ff7-bbca-1b75de9bfad9 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:10:33.145971 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-7e95d1d6-3d5e-4ff7-bbca-1b75de9bfad9 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3841796765145e1876ddee315b81bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2463781199104e15aea02b6280ceaacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:10:33.154130 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-7e95d1d6-3d5e-4ff7-bbca-1b75de9bfad9 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] 10.222.0.18 "GET /compute/v2.1/servers/5eea1266-1e9b-46de-8837-65dc5b4f9119" status: 200 len: 1684 microversion: 2.1 time: 0.185801 Oct 22 22:10:33.154712 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3428/6827] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:10:32 2022] GET /compute/v2.1/servers/5eea1266-1e9b-46de-8837-65dc5b4f9119 => generated 1684 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:10:34.022631 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-d2412374-bd45-4d54-b90d-013dab2131e2 req-8367c434-3e77-430c-b9a9-44b71cbc5ba8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5eea1266-1e9b-46de-8837-65dc5b4f9119", "name": "network-vif-deleted", "tag": "6340a394-97b0-4f32-8dbf-480982198bd2"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 22:10:34.035646 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-d2412374-bd45-4d54-b90d-013dab2131e2 req-8367c434-3e77-430c-b9a9-44b71cbc5ba8 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:10:34.036128 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-d2412374-bd45-4d54-b90d-013dab2131e2 req-8367c434-3e77-430c-b9a9-44b71cbc5ba8 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:10:34.036568 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-d2412374-bd45-4d54-b90d-013dab2131e2 req-8367c434-3e77-430c-b9a9-44b71cbc5ba8 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:10:34.048788 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-d2412374-bd45-4d54-b90d-013dab2131e2 req-8367c434-3e77-430c-b9a9-44b71cbc5ba8 service nova] Creating event network-vif-deleted:6340a394-97b0-4f32-8dbf-480982198bd2 for instance 5eea1266-1e9b-46de-8837-65dc5b4f9119 on nch1-master-1 Oct 22 22:10:34.055242 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-d2412374-bd45-4d54-b90d-013dab2131e2 req-8367c434-3e77-430c-b9a9-44b71cbc5ba8 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036484 Oct 22 22:10:34.055872 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3400/6828] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 22:10:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 22:10:34.178574 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-2c4419ba-959b-4bb3-9d79-390a5882e893 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:10:34.179550 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-2c4419ba-959b-4bb3-9d79-390a5882e893 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] [instance: 5eea1266-1e9b-46de-8837-65dc5b4f9119] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:10:34.186986 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2c4419ba-959b-4bb3-9d79-390a5882e893 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:10:34.187564 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2c4419ba-959b-4bb3-9d79-390a5882e893 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:10:34.188009 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2c4419ba-959b-4bb3-9d79-390a5882e893 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:10:34.188749 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2c4419ba-959b-4bb3-9d79-390a5882e893 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:10:34.189242 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2c4419ba-959b-4bb3-9d79-390a5882e893 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:10:34.189699 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2c4419ba-959b-4bb3-9d79-390a5882e893 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:10:34.224009 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2c4419ba-959b-4bb3-9d79-390a5882e893 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:10:34.224388 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2c4419ba-959b-4bb3-9d79-390a5882e893 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:10:34.224865 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2c4419ba-959b-4bb3-9d79-390a5882e893 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:10:34.225330 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.objects.instance [None req-2c4419ba-959b-4bb3-9d79-390a5882e893 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lazy-loading 'fault' on Instance uuid 5eea1266-1e9b-46de-8837-65dc5b4f9119 {{(pid=138745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 22:10:34.267039 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-2c4419ba-959b-4bb3-9d79-390a5882e893 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3841796765145e1876ddee315b81bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2463781199104e15aea02b6280ceaacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:10:34.275627 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-2c4419ba-959b-4bb3-9d79-390a5882e893 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] 10.222.0.18 "GET /compute/v2.1/servers/5eea1266-1e9b-46de-8837-65dc5b4f9119" status: 200 len: 1353 microversion: 2.1 time: 0.101153 Oct 22 22:10:34.276202 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3429/6829] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:10:34 2022] GET /compute/v2.1/servers/5eea1266-1e9b-46de-8837-65dc5b4f9119 => generated 1353 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:10:35.305148 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-45044aab-29b7-4d01-8fec-b99a48e0f437 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:10:35.305881 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-45044aab-29b7-4d01-8fec-b99a48e0f437 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] [instance: 5eea1266-1e9b-46de-8837-65dc5b4f9119] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:10:35.313684 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-45044aab-29b7-4d01-8fec-b99a48e0f437 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:10:35.314189 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-45044aab-29b7-4d01-8fec-b99a48e0f437 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:10:35.314646 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-45044aab-29b7-4d01-8fec-b99a48e0f437 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:10:35.315394 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-45044aab-29b7-4d01-8fec-b99a48e0f437 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:10:35.315879 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-45044aab-29b7-4d01-8fec-b99a48e0f437 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:10:35.316366 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-45044aab-29b7-4d01-8fec-b99a48e0f437 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:10:35.332328 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-45044aab-29b7-4d01-8fec-b99a48e0f437 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] HTTP exception thrown: Instance 5eea1266-1e9b-46de-8837-65dc5b4f9119 could not be found. Oct 22 22:10:35.333317 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-45044aab-29b7-4d01-8fec-b99a48e0f437 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Request method failure captured: Oct 22 22:10:35.333317 ncdv-master-1 devstack@n-api.service[138744]: request: GET /compute/v2.1/servers/5eea1266-1e9b-46de-8837-65dc5b4f9119 HTTP/1.1 Oct 22 22:10:35.333317 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 22:10:35.333317 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 22:10:35.333317 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 22:10:35.333317 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 0 Oct 22 22:10:35.333317 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 22:10:35.333317 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 22:10:35.333317 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 22:10:35.333317 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 22:10:35.333317 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVGn7_hWur8olMNvqY1ci34dTO2aMHkwF2Arh7Vhu0pKEfAIdjPeIgFR3M850xL8FpTR9mXeTguII0a2O-HdxsJf8qZBcfSziKEpwyhdPF7DkzW4kQj6-KDf_OfkhNJyBC-6JgZCrm8JmrvBF_CtA7k23ekrHWftWnFXpuRzAvhnMWRA Oct 22 22:10:35.333317 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 22:10:35.333317 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 22:10:35.333317 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 22:10:35.333317 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 22:10:35.333317 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 22:10:35.333317 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 22:10:35.333317 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: 2463781199104e15aea02b6280ceaacf Oct 22 22:10:35.333317 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-703320975 Oct 22 22:10:35.333317 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 22:10:35.333317 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 22:10:35.333317 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_2463781199104e15aea02b6280ceaacf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2463781199104e15aea02b6280ceaacf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/2463781199104e15aea02b6280ceaacf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2463781199104e15aea02b6280ceaacf"}]}] Oct 22 22:10:35.333317 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-TestNetworkAdvancedServerOps-703320975 Oct 22 22:10:35.333317 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: 2463781199104e15aea02b6280ceaacf Oct 22 22:10:35.333317 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-703320975 Oct 22 22:10:35.333317 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-TestNetworkAdvancedServerOps-703320975-project Oct 22 22:10:35.333317 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 22:10:35.333317 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 22:10:35.333317 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: e3841796765145e1876ddee315b81bea Oct 22 22:10:35.333317 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-TestNetworkAdvancedServerOps-703320975-project Oct 22 22:10:35.333317 ncdv-master-1 devstack@n-api.service[138744]: method: > Oct 22 22:10:35.333317 ncdv-master-1 devstack@n-api.service[138744]: exception: Instance 5eea1266-1e9b-46de-8837-65dc5b4f9119 could not be found. Oct 22 22:10:35.333317 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': '5eea1266-1e9b-46de-8837-65dc5b4f9119'} Oct 22 22:10:35.333317 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 22:10:35.333317 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 22:10:35.333317 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 22:10:35.333317 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 22:10:35.333317 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 22:10:35.333317 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 22:10:35.333317 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 22:10:35.333317 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 22:10:35.333317 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 22:10:35.333317 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 22:10:35.333317 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5eea1266-1e9b-46de-8837-65dc5b4f9119 could not be found. Oct 22 22:10:35.333317 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 22:10:35.333317 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 22:10:35.333317 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 22:10:35.333317 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 22:10:35.333317 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 22:10:35.333317 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 22:10:35.333317 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 22:10:35.333317 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 22:10:35.333317 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 22:10:35.333317 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 22:10:35.333317 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 22:10:35.333317 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 22:10:35.333317 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 22:10:35.333317 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 22:10:35.333317 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 22:10:35.333317 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 22:10:35.333317 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5eea1266-1e9b-46de-8837-65dc5b4f9119 could not be found. Oct 22 22:10:35.333317 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 22:10:35.333317 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 22:10:35.339136 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 22:10:35.339136 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 22:10:35.339136 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 22:10:35.339136 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 22:10:35.339136 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 22:10:35.339136 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 22:10:35.339136 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5eea1266-1e9b-46de-8837-65dc5b4f9119 could not be found. Oct 22 22:10:35.339136 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 22:10:35.339136 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-45044aab-29b7-4d01-8fec-b99a48e0f437 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Returning 404 to user: Instance 5eea1266-1e9b-46de-8837-65dc5b4f9119 could not be found. {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 22:10:35.339136 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-45044aab-29b7-4d01-8fec-b99a48e0f437 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] 10.222.0.18 "GET /compute/v2.1/servers/5eea1266-1e9b-46de-8837-65dc5b4f9119" status: 404 len: 111 microversion: 2.1 time: 0.037743 Oct 22 22:10:35.339136 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3401/6830] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:10:35 2022] GET /compute/v2.1/servers/5eea1266-1e9b-46de-8837-65dc5b4f9119 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 22:10:38.747889 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-4f791e94-be9f-4365-bf30-553e52bcf141 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Calling method '.version_select at 0x7fd39fd304c0>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:10:38.771199 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-4f791e94-be9f-4365-bf30-553e52bcf141 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-24858116" status: 202 len: 0 microversion: 2.1 time: 0.027617 Oct 22 22:10:38.771870 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3430/6831] 10.222.0.18 () {58 vars in 1278 bytes} [Sat Oct 22 22:10:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-24858116 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 22:10:38.801888 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-ad53d8cd-c87b-4f46-9909-99ce6ae942b1 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Action: 'create', calling method: .version_select at 0x7fd39ec0b310>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-312205082", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLxEhUeBSqN1s1OCh99oYuoytKpqEHv9iYHxfNL2fGJTUkpVOdoNQ5gmkPaZXGlMFQkIJkWYECz52nvJSwvVJmtARBwZ21FWv5SywzZYSLZvwuHxH9pVQTohccgqwhycDg=="}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 22:10:38.822644 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-ad53d8cd-c87b-4f46-9909-99ce6ae942b1 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Getting quotas for project 2463781199104e15aea02b6280ceaacf. Resources: {'key_pairs'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 22:10:38.827852 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-ad53d8cd-c87b-4f46-9909-99ce6ae942b1 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Getting quotas for user e3841796765145e1876ddee315b81bea and project 2463781199104e15aea02b6280ceaacf. Resources: {'key_pairs'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 22:10:38.853034 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-ad53d8cd-c87b-4f46-9909-99ce6ae942b1 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.055133 Oct 22 22:10:38.853693 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3402/6832] 10.222.0.18 () {60 vars in 1159 bytes} [Sat Oct 22 22:10:38 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 22:10:44.581892 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:10:44.587293 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-4b6d43a8-145e-42b6-b551-47af24f85ecc tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-799913054", "imageRef": "085e4478-6edc-4a69-8e08-f9831713eb65", "flavorRef": "452", "networks": [{"uuid": "61b86e98-2f06-4046-9fbb-702b1ba064ed"}], "key_name": "tempest-TestNetworkAdvancedServerOps-312205082", "security_groups": [{"name": "tempest-secgroup-smoke-828179291"}]}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 22:10:44.703038 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.network.neutron [None req-4b6d43a8-145e-42b6-b551-47af24f85ecc tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] validate_networks() for [('61b86e98-2f06-4046-9fbb-702b1ba064ed', None, None, None, None, None)] {{(pid=138745) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 22:10:45.129226 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-4b6d43a8-145e-42b6-b551-47af24f85ecc tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Flavor limits 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 22:10:45.129679 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-4b6d43a8-145e-42b6-b551-47af24f85ecc tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Image limits 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 22:10:45.130181 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-4b6d43a8-145e-42b6-b551-47af24f85ecc tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Flavor pref 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 22:10:45.130652 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-4b6d43a8-145e-42b6-b551-47af24f85ecc tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Image pref 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 22:10:45.131181 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-4b6d43a8-145e-42b6-b551-47af24f85ecc tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 22:10:45.140495 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4b6d43a8-145e-42b6-b551-47af24f85ecc tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:10:45.141011 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4b6d43a8-145e-42b6-b551-47af24f85ecc tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:10:45.141474 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4b6d43a8-145e-42b6-b551-47af24f85ecc tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:10:45.142235 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4b6d43a8-145e-42b6-b551-47af24f85ecc tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:10:45.142716 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4b6d43a8-145e-42b6-b551-47af24f85ecc tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:10:45.143168 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4b6d43a8-145e-42b6-b551-47af24f85ecc tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:10:45.161812 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-4b6d43a8-145e-42b6-b551-47af24f85ecc tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Getting quotas for project 2463781199104e15aea02b6280ceaacf. Resources: {'cores', 'instances', 'ram'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 22:10:45.167331 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-4b6d43a8-145e-42b6-b551-47af24f85ecc tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Getting quotas for user e3841796765145e1876ddee315b81bea and project 2463781199104e15aea02b6280ceaacf. Resources: {'cores', 'instances', 'ram'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 22:10:45.180693 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-4b6d43a8-145e-42b6-b551-47af24f85ecc tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Going to run 1 instances... {{(pid=138745) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 22:10:45.183095 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-4b6d43a8-145e-42b6-b551-47af24f85ecc tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] [instance: 5db2a714-d522-4113-909a-463a28828a90] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='085e4478-6edc-4a69-8e08-f9831713eb65',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138745) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 22:10:45.232271 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-4b6d43a8-145e-42b6-b551-47af24f85ecc tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.652286 Oct 22 22:10:45.232862 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3431/6833] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Oct 22 22:10:44 2022] POST /compute/v2.1/servers => generated 405 bytes in 654 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 22:10:45.245765 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-58a657dc-fc09-4abd-9ffa-6fcae7f7e637 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:10:45.246391 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-58a657dc-fc09-4abd-9ffa-6fcae7f7e637 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] [instance: 5db2a714-d522-4113-909a-463a28828a90] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:10:45.327161 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:SELECT=32 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:10:45.332103 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-58a657dc-fc09-4abd-9ffa-6fcae7f7e637 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3841796765145e1876ddee315b81bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2463781199104e15aea02b6280ceaacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:10:45.340369 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-58a657dc-fc09-4abd-9ffa-6fcae7f7e637 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] 10.222.0.18 "GET /compute/v2.1/servers/5db2a714-d522-4113-909a-463a28828a90" status: 200 len: 1265 microversion: 2.1 time: 0.099879 Oct 22 22:10:45.343382 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3403/6834] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:10:45 2022] GET /compute/v2.1/servers/5db2a714-d522-4113-909a-463a28828a90 => generated 1265 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:10:46.366064 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-a256da2c-c5ed-47c7-89dd-0a1c1f940f54 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:10:46.366833 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-a256da2c-c5ed-47c7-89dd-0a1c1f940f54 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] [instance: 5db2a714-d522-4113-909a-463a28828a90] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:10:46.378490 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a256da2c-c5ed-47c7-89dd-0a1c1f940f54 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:10:46.379289 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a256da2c-c5ed-47c7-89dd-0a1c1f940f54 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:10:46.379784 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a256da2c-c5ed-47c7-89dd-0a1c1f940f54 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:10:46.380544 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a256da2c-c5ed-47c7-89dd-0a1c1f940f54 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:10:46.381071 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a256da2c-c5ed-47c7-89dd-0a1c1f940f54 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:10:46.381521 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a256da2c-c5ed-47c7-89dd-0a1c1f940f54 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:10:46.449595 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-a256da2c-c5ed-47c7-89dd-0a1c1f940f54 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3841796765145e1876ddee315b81bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2463781199104e15aea02b6280ceaacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:10:46.458636 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-a256da2c-c5ed-47c7-89dd-0a1c1f940f54 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] 10.222.0.18 "GET /compute/v2.1/servers/5db2a714-d522-4113-909a-463a28828a90" status: 200 len: 1335 microversion: 2.1 time: 0.097501 Oct 22 22:10:46.460256 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3432/6835] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:10:46 2022] GET /compute/v2.1/servers/5db2a714-d522-4113-909a-463a28828a90 => generated 1335 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:10:47.484158 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-779fa7ca-d4e4-4ee5-97ad-88b0c4bcd5aa tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:10:47.484780 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-779fa7ca-d4e4-4ee5-97ad-88b0c4bcd5aa tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] [instance: 5db2a714-d522-4113-909a-463a28828a90] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:10:47.494033 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-779fa7ca-d4e4-4ee5-97ad-88b0c4bcd5aa tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:10:47.494554 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-779fa7ca-d4e4-4ee5-97ad-88b0c4bcd5aa tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:10:47.494999 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-779fa7ca-d4e4-4ee5-97ad-88b0c4bcd5aa tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:10:47.495729 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-779fa7ca-d4e4-4ee5-97ad-88b0c4bcd5aa tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:10:47.496378 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-779fa7ca-d4e4-4ee5-97ad-88b0c4bcd5aa tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:10:47.497056 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-779fa7ca-d4e4-4ee5-97ad-88b0c4bcd5aa tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:10:47.699739 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-779fa7ca-d4e4-4ee5-97ad-88b0c4bcd5aa tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3841796765145e1876ddee315b81bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2463781199104e15aea02b6280ceaacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:10:47.713296 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-779fa7ca-d4e4-4ee5-97ad-88b0c4bcd5aa tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] 10.222.0.18 "GET /compute/v2.1/servers/5db2a714-d522-4113-909a-463a28828a90" status: 200 len: 1390 microversion: 2.1 time: 0.233612 Oct 22 22:10:47.714815 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3404/6836] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:10:47 2022] GET /compute/v2.1/servers/5db2a714-d522-4113-909a-463a28828a90 => generated 1390 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:10:47.930747 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-1a25d3c3-af5f-40d6-b33e-a72a60bbdcf8 req-fe6ce54e-fdc0-4061-873b-160b9b1857d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5db2a714-d522-4113-909a-463a28828a90", "tag": "44b5b814-5112-4b40-9432-da274c6c79fc"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 22:10:47.942377 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-1a25d3c3-af5f-40d6-b33e-a72a60bbdcf8 req-fe6ce54e-fdc0-4061-873b-160b9b1857d1 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:10:47.942879 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-1a25d3c3-af5f-40d6-b33e-a72a60bbdcf8 req-fe6ce54e-fdc0-4061-873b-160b9b1857d1 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:10:47.943510 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-1a25d3c3-af5f-40d6-b33e-a72a60bbdcf8 req-fe6ce54e-fdc0-4061-873b-160b9b1857d1 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:10:47.956384 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-1a25d3c3-af5f-40d6-b33e-a72a60bbdcf8 req-fe6ce54e-fdc0-4061-873b-160b9b1857d1 service nova] Creating event network-changed:44b5b814-5112-4b40-9432-da274c6c79fc for instance 5db2a714-d522-4113-909a-463a28828a90 on nch1-master-1 Oct 22 22:10:47.961840 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-1a25d3c3-af5f-40d6-b33e-a72a60bbdcf8 req-fe6ce54e-fdc0-4061-873b-160b9b1857d1 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.132177 Oct 22 22:10:47.962440 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3433/6837] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 22:10:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 22:10:48.738535 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-f7f6ae3c-377e-411c-95f0-caf4d7a76138 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:10:48.739160 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-f7f6ae3c-377e-411c-95f0-caf4d7a76138 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] [instance: 5db2a714-d522-4113-909a-463a28828a90] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:10:48.746853 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f7f6ae3c-377e-411c-95f0-caf4d7a76138 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:10:48.747375 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f7f6ae3c-377e-411c-95f0-caf4d7a76138 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:10:48.747827 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f7f6ae3c-377e-411c-95f0-caf4d7a76138 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:10:48.748533 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f7f6ae3c-377e-411c-95f0-caf4d7a76138 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:10:48.748992 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f7f6ae3c-377e-411c-95f0-caf4d7a76138 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:10:48.749431 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f7f6ae3c-377e-411c-95f0-caf4d7a76138 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:10:48.887059 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-f7f6ae3c-377e-411c-95f0-caf4d7a76138 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3841796765145e1876ddee315b81bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2463781199104e15aea02b6280ceaacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:10:48.895152 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-f7f6ae3c-377e-411c-95f0-caf4d7a76138 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] 10.222.0.18 "GET /compute/v2.1/servers/5db2a714-d522-4113-909a-463a28828a90" status: 200 len: 1390 microversion: 2.1 time: 0.160683 Oct 22 22:10:48.895825 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3405/6838] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:10:48 2022] GET /compute/v2.1/servers/5db2a714-d522-4113-909a-463a28828a90 => generated 1390 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:10:49.920300 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-433460d4-2f6f-496e-9894-18cc258e9907 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:10:49.921032 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-433460d4-2f6f-496e-9894-18cc258e9907 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] [instance: 5db2a714-d522-4113-909a-463a28828a90] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:10:49.927719 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-433460d4-2f6f-496e-9894-18cc258e9907 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:10:49.928229 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-433460d4-2f6f-496e-9894-18cc258e9907 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:10:49.928815 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-433460d4-2f6f-496e-9894-18cc258e9907 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:10:49.929565 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-433460d4-2f6f-496e-9894-18cc258e9907 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:10:49.930047 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-433460d4-2f6f-496e-9894-18cc258e9907 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:10:49.930496 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-433460d4-2f6f-496e-9894-18cc258e9907 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:10:50.075725 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-433460d4-2f6f-496e-9894-18cc258e9907 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3841796765145e1876ddee315b81bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2463781199104e15aea02b6280ceaacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:10:50.083926 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-433460d4-2f6f-496e-9894-18cc258e9907 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] 10.222.0.18 "GET /compute/v2.1/servers/5db2a714-d522-4113-909a-463a28828a90" status: 200 len: 1390 microversion: 2.1 time: 0.168958 Oct 22 22:10:50.084510 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3434/6839] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:10:49 2022] GET /compute/v2.1/servers/5db2a714-d522-4113-909a-463a28828a90 => generated 1390 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:10:51.109702 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-d7018fed-c76a-4478-8e5b-8c473903dad5 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:10:51.110289 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-d7018fed-c76a-4478-8e5b-8c473903dad5 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] [instance: 5db2a714-d522-4113-909a-463a28828a90] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:10:51.117980 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d7018fed-c76a-4478-8e5b-8c473903dad5 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:10:51.118479 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d7018fed-c76a-4478-8e5b-8c473903dad5 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:10:51.118923 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d7018fed-c76a-4478-8e5b-8c473903dad5 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:10:51.119673 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d7018fed-c76a-4478-8e5b-8c473903dad5 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:10:51.120136 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d7018fed-c76a-4478-8e5b-8c473903dad5 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:10:51.120564 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d7018fed-c76a-4478-8e5b-8c473903dad5 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:10:51.255734 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-d7018fed-c76a-4478-8e5b-8c473903dad5 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3841796765145e1876ddee315b81bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2463781199104e15aea02b6280ceaacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:10:51.263870 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-d7018fed-c76a-4478-8e5b-8c473903dad5 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] 10.222.0.18 "GET /compute/v2.1/servers/5db2a714-d522-4113-909a-463a28828a90" status: 200 len: 1390 microversion: 2.1 time: 0.158650 Oct 22 22:10:51.264452 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3406/6840] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:10:51 2022] GET /compute/v2.1/servers/5db2a714-d522-4113-909a-463a28828a90 => generated 1390 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:10:52.291131 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-88418c9d-431f-4499-a034-dcb330fe4a99 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:10:52.292295 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-88418c9d-431f-4499-a034-dcb330fe4a99 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] [instance: 5db2a714-d522-4113-909a-463a28828a90] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:10:52.304849 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-88418c9d-431f-4499-a034-dcb330fe4a99 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:10:52.305384 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-88418c9d-431f-4499-a034-dcb330fe4a99 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:10:52.305825 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-88418c9d-431f-4499-a034-dcb330fe4a99 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:10:52.306574 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-88418c9d-431f-4499-a034-dcb330fe4a99 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:10:52.307048 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-88418c9d-431f-4499-a034-dcb330fe4a99 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:10:52.307549 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-88418c9d-431f-4499-a034-dcb330fe4a99 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:10:52.447332 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-88418c9d-431f-4499-a034-dcb330fe4a99 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3841796765145e1876ddee315b81bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2463781199104e15aea02b6280ceaacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:10:52.455676 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-88418c9d-431f-4499-a034-dcb330fe4a99 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] 10.222.0.18 "GET /compute/v2.1/servers/5db2a714-d522-4113-909a-463a28828a90" status: 200 len: 1390 microversion: 2.1 time: 0.171158 Oct 22 22:10:52.456251 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3435/6841] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:10:52 2022] GET /compute/v2.1/servers/5db2a714-d522-4113-909a-463a28828a90 => generated 1390 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:10:52.789946 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-ee597e6b-7ed5-4227-b99b-d143bfe9efcf req-f519bc19-2a68-41fe-8d2f-18d3c72bf072 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5db2a714-d522-4113-909a-463a28828a90", "name": "network-vif-plugged", "status": "completed", "tag": "44b5b814-5112-4b40-9432-da274c6c79fc"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 22:10:52.796443 ncdv-master-1 devstack@n-api.service[138744]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 22 22:10:52.796621 ncdv-master-1 devstack@n-api.service[138744]: Sat Oct 22 22:10:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.18) !!! Oct 22 22:10:52.802178 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-ee597e6b-7ed5-4227-b99b-d143bfe9efcf req-f519bc19-2a68-41fe-8d2f-18d3c72bf072 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:10:52.802983 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-ee597e6b-7ed5-4227-b99b-d143bfe9efcf req-f519bc19-2a68-41fe-8d2f-18d3c72bf072 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:10:52.803325 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-ee597e6b-7ed5-4227-b99b-d143bfe9efcf req-f519bc19-2a68-41fe-8d2f-18d3c72bf072 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:10:52.815750 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-ee597e6b-7ed5-4227-b99b-d143bfe9efcf req-f519bc19-2a68-41fe-8d2f-18d3c72bf072 service nova] Creating event network-vif-plugged:44b5b814-5112-4b40-9432-da274c6c79fc for instance 5db2a714-d522-4113-909a-463a28828a90 on nch1-master-1 Oct 22 22:10:52.821201 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-ee597e6b-7ed5-4227-b99b-d143bfe9efcf req-f519bc19-2a68-41fe-8d2f-18d3c72bf072 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035012 Oct 22 22:10:52.821839 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3407/6842] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 22:10:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 22:10:53.478713 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-d138f708-f44e-476e-9c87-d84d9be2f7e5 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:10:53.479367 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-d138f708-f44e-476e-9c87-d84d9be2f7e5 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] [instance: 5db2a714-d522-4113-909a-463a28828a90] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:10:53.486814 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d138f708-f44e-476e-9c87-d84d9be2f7e5 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:10:53.487321 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d138f708-f44e-476e-9c87-d84d9be2f7e5 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:10:53.487811 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d138f708-f44e-476e-9c87-d84d9be2f7e5 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:10:53.488536 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d138f708-f44e-476e-9c87-d84d9be2f7e5 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:10:53.489018 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d138f708-f44e-476e-9c87-d84d9be2f7e5 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:10:53.489473 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d138f708-f44e-476e-9c87-d84d9be2f7e5 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:10:53.627629 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-d138f708-f44e-476e-9c87-d84d9be2f7e5 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3841796765145e1876ddee315b81bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2463781199104e15aea02b6280ceaacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:10:53.635809 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-d138f708-f44e-476e-9c87-d84d9be2f7e5 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] 10.222.0.18 "GET /compute/v2.1/servers/5db2a714-d522-4113-909a-463a28828a90" status: 200 len: 1390 microversion: 2.1 time: 0.161256 Oct 22 22:10:53.636374 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3436/6843] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:10:53 2022] GET /compute/v2.1/servers/5db2a714-d522-4113-909a-463a28828a90 => generated 1390 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:10:54.660192 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-ccddc634-1c70-4c43-b2b7-8666bc1d07e7 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:10:54.660886 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-ccddc634-1c70-4c43-b2b7-8666bc1d07e7 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] [instance: 5db2a714-d522-4113-909a-463a28828a90] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:10:54.667847 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ccddc634-1c70-4c43-b2b7-8666bc1d07e7 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:10:54.668331 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ccddc634-1c70-4c43-b2b7-8666bc1d07e7 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:10:54.668770 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ccddc634-1c70-4c43-b2b7-8666bc1d07e7 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:10:54.669491 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ccddc634-1c70-4c43-b2b7-8666bc1d07e7 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:10:54.669948 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ccddc634-1c70-4c43-b2b7-8666bc1d07e7 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:10:54.670372 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ccddc634-1c70-4c43-b2b7-8666bc1d07e7 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:10:54.808052 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-ccddc634-1c70-4c43-b2b7-8666bc1d07e7 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3841796765145e1876ddee315b81bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2463781199104e15aea02b6280ceaacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:10:54.816339 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-ccddc634-1c70-4c43-b2b7-8666bc1d07e7 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] 10.222.0.18 "GET /compute/v2.1/servers/5db2a714-d522-4113-909a-463a28828a90" status: 200 len: 1562 microversion: 2.1 time: 0.161711 Oct 22 22:10:54.816918 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3408/6844] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:10:54 2022] GET /compute/v2.1/servers/5db2a714-d522-4113-909a-463a28828a90 => generated 1562 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:10:54.838896 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-17ab8d0d-0107-4e8a-b9d1-7a03e056ba9e tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:10:54.839538 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-17ab8d0d-0107-4e8a-b9d1-7a03e056ba9e tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] [instance: 5db2a714-d522-4113-909a-463a28828a90] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:10:54.847062 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-17ab8d0d-0107-4e8a-b9d1-7a03e056ba9e tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:10:54.847612 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-17ab8d0d-0107-4e8a-b9d1-7a03e056ba9e tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:10:54.848073 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-17ab8d0d-0107-4e8a-b9d1-7a03e056ba9e tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:10:54.848797 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-17ab8d0d-0107-4e8a-b9d1-7a03e056ba9e tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:10:54.849269 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-17ab8d0d-0107-4e8a-b9d1-7a03e056ba9e tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:10:54.849713 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-17ab8d0d-0107-4e8a-b9d1-7a03e056ba9e tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:10:54.985523 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-17ab8d0d-0107-4e8a-b9d1-7a03e056ba9e tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3841796765145e1876ddee315b81bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2463781199104e15aea02b6280ceaacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:10:54.997449 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-17ab8d0d-0107-4e8a-b9d1-7a03e056ba9e tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] 10.222.0.18 "GET /compute/v2.1/servers/5db2a714-d522-4113-909a-463a28828a90" status: 200 len: 1562 microversion: 2.1 time: 0.162196 Oct 22 22:10:54.998283 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3437/6845] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:10:54 2022] GET /compute/v2.1/servers/5db2a714-d522-4113-909a-463a28828a90 => generated 1562 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:10:56.652958 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-1a035ebe-1c72-48d3-9967-62165602d9fb req-9d06e6de-0b6c-4573-afcd-5fc4990702fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5db2a714-d522-4113-909a-463a28828a90", "tag": "44b5b814-5112-4b40-9432-da274c6c79fc"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 22:10:56.655593 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-655aaef8-ee23-4bee-9a4a-97b78956b6c2 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:10:56.656549 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-655aaef8-ee23-4bee-9a4a-97b78956b6c2 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] [instance: 5db2a714-d522-4113-909a-463a28828a90] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:10:56.659673 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell0:SELECT=6 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:10:56.661264 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=1 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:10:56.667083 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell0:SELECT=2 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:10:56.667765 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell0:SELECT=6 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:10:56.672835 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:10:56.678751 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-655aaef8-ee23-4bee-9a4a-97b78956b6c2 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:10:56.679263 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-655aaef8-ee23-4bee-9a4a-97b78956b6c2 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:10:56.679857 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-655aaef8-ee23-4bee-9a4a-97b78956b6c2 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:10:56.680759 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-655aaef8-ee23-4bee-9a4a-97b78956b6c2 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:10:56.681219 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-655aaef8-ee23-4bee-9a4a-97b78956b6c2 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:10:56.681650 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-655aaef8-ee23-4bee-9a4a-97b78956b6c2 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:10:56.687796 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-1a035ebe-1c72-48d3-9967-62165602d9fb req-9d06e6de-0b6c-4573-afcd-5fc4990702fd service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:10:56.688332 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-1a035ebe-1c72-48d3-9967-62165602d9fb req-9d06e6de-0b6c-4573-afcd-5fc4990702fd service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:10:56.688785 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-1a035ebe-1c72-48d3-9967-62165602d9fb req-9d06e6de-0b6c-4573-afcd-5fc4990702fd service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:10:56.704802 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-1a035ebe-1c72-48d3-9967-62165602d9fb req-9d06e6de-0b6c-4573-afcd-5fc4990702fd service nova] Creating event network-changed:44b5b814-5112-4b40-9432-da274c6c79fc for instance 5db2a714-d522-4113-909a-463a28828a90 on nch1-master-1 Oct 22 22:10:56.710804 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-1a035ebe-1c72-48d3-9967-62165602d9fb req-9d06e6de-0b6c-4573-afcd-5fc4990702fd service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064710 Oct 22 22:10:56.712105 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3438/6846] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 22:10:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 22:10:56.828835 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-655aaef8-ee23-4bee-9a4a-97b78956b6c2 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3841796765145e1876ddee315b81bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2463781199104e15aea02b6280ceaacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:10:56.837753 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-655aaef8-ee23-4bee-9a4a-97b78956b6c2 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] 10.222.0.18 "GET /compute/v2.1/servers/5db2a714-d522-4113-909a-463a28828a90" status: 200 len: 1562 microversion: 2.1 time: 0.194396 Oct 22 22:10:56.838942 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3409/6847] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:10:56 2022] GET /compute/v2.1/servers/5db2a714-d522-4113-909a-463a28828a90 => generated 1562 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:11:28.173682 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-3fd58972-e872-43df-ab42-9c127b26a222 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 22:11:28.176567 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-3fd58972-e872-43df-ab42-9c127b26a222 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] [instance: 5db2a714-d522-4113-909a-463a28828a90] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:11:28.179414 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell1:SELECT=36 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:11:28.185761 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3fd58972-e872-43df-ab42-9c127b26a222 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:11:28.186273 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3fd58972-e872-43df-ab42-9c127b26a222 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:11:28.186734 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3fd58972-e872-43df-ab42-9c127b26a222 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:11:28.187477 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3fd58972-e872-43df-ab42-9c127b26a222 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:11:28.187952 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3fd58972-e872-43df-ab42-9c127b26a222 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:11:28.188403 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3fd58972-e872-43df-ab42-9c127b26a222 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:11:28.244097 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-3fd58972-e872-43df-ab42-9c127b26a222 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] 10.222.0.18 "POST /compute/v2.1/servers/5db2a714-d522-4113-909a-463a28828a90/action" status: 200 len: 24569 microversion: 2.1 time: 0.075183 Oct 22 22:11:28.244740 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3439/6848] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 22:11:28 2022] POST /compute/v2.1/servers/5db2a714-d522-4113-909a-463a28828a90/action => generated 24569 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 22 22:11:58.458979 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_api:SELECT=1 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:11:58.460190 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:SELECT=32 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:11:58.467320 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-18165c93-dd21-42b8-8105-6dcc861aed42 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 22:11:58.470320 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-18165c93-dd21-42b8-8105-6dcc861aed42 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] [instance: 5db2a714-d522-4113-909a-463a28828a90] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:11:58.477536 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-18165c93-dd21-42b8-8105-6dcc861aed42 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:11:58.478032 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-18165c93-dd21-42b8-8105-6dcc861aed42 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:11:58.478518 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-18165c93-dd21-42b8-8105-6dcc861aed42 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:11:58.479224 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-18165c93-dd21-42b8-8105-6dcc861aed42 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:11:58.479720 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-18165c93-dd21-42b8-8105-6dcc861aed42 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:11:58.480161 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-18165c93-dd21-42b8-8105-6dcc861aed42 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:11:58.566043 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-18165c93-dd21-42b8-8105-6dcc861aed42 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] 10.222.0.18 "POST /compute/v2.1/servers/5db2a714-d522-4113-909a-463a28828a90/action" status: 202 len: 0 microversion: 2.1 time: 0.110371 Oct 22 22:11:58.566856 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3410/6849] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 22:11:58 2022] POST /compute/v2.1/servers/5db2a714-d522-4113-909a-463a28828a90/action => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 22:11:58.576931 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-c24e18be-6b58-4df3-9d74-4e76d96296d8 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:11:58.577738 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-c24e18be-6b58-4df3-9d74-4e76d96296d8 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] [instance: 5db2a714-d522-4113-909a-463a28828a90] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:11:58.580543 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_api:SELECT=3 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:11:58.581214 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell1:SELECT=4 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:11:58.587139 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c24e18be-6b58-4df3-9d74-4e76d96296d8 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:11:58.587729 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c24e18be-6b58-4df3-9d74-4e76d96296d8 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:11:58.588290 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c24e18be-6b58-4df3-9d74-4e76d96296d8 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:11:58.589038 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c24e18be-6b58-4df3-9d74-4e76d96296d8 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:11:58.590394 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c24e18be-6b58-4df3-9d74-4e76d96296d8 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:11:58.591901 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c24e18be-6b58-4df3-9d74-4e76d96296d8 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:11:58.741981 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-c24e18be-6b58-4df3-9d74-4e76d96296d8 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3841796765145e1876ddee315b81bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2463781199104e15aea02b6280ceaacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:11:58.750301 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-c24e18be-6b58-4df3-9d74-4e76d96296d8 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] 10.222.0.18 "GET /compute/v2.1/servers/5db2a714-d522-4113-909a-463a28828a90" status: 200 len: 1672 microversion: 2.1 time: 0.177996 Oct 22 22:11:58.750891 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3440/6850] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:11:58 2022] GET /compute/v2.1/servers/5db2a714-d522-4113-909a-463a28828a90 => generated 1672 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:11:59.781395 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-36654fdc-1a62-4d41-943e-eadddb1e7c5c tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:11:59.782482 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-36654fdc-1a62-4d41-943e-eadddb1e7c5c tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] [instance: 5db2a714-d522-4113-909a-463a28828a90] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:11:59.792817 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-36654fdc-1a62-4d41-943e-eadddb1e7c5c tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:11:59.793630 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-36654fdc-1a62-4d41-943e-eadddb1e7c5c tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:11:59.794345 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-36654fdc-1a62-4d41-943e-eadddb1e7c5c tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:11:59.795568 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-36654fdc-1a62-4d41-943e-eadddb1e7c5c tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:11:59.796309 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-36654fdc-1a62-4d41-943e-eadddb1e7c5c tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:11:59.797288 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-36654fdc-1a62-4d41-943e-eadddb1e7c5c tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:11:59.938439 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-36654fdc-1a62-4d41-943e-eadddb1e7c5c tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3841796765145e1876ddee315b81bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2463781199104e15aea02b6280ceaacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:11:59.946907 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-36654fdc-1a62-4d41-943e-eadddb1e7c5c tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] 10.222.0.18 "GET /compute/v2.1/servers/5db2a714-d522-4113-909a-463a28828a90" status: 200 len: 1677 microversion: 2.1 time: 0.174662 Oct 22 22:11:59.947486 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3411/6851] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:11:59 2022] GET /compute/v2.1/servers/5db2a714-d522-4113-909a-463a28828a90 => generated 1677 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:12:00.976546 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-9b0044f5-a3b5-4379-a840-78ae6de0da49 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:12:00.977507 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-9b0044f5-a3b5-4379-a840-78ae6de0da49 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] [instance: 5db2a714-d522-4113-909a-463a28828a90] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:12:00.987791 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9b0044f5-a3b5-4379-a840-78ae6de0da49 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:12:00.988292 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9b0044f5-a3b5-4379-a840-78ae6de0da49 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:12:00.988750 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9b0044f5-a3b5-4379-a840-78ae6de0da49 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:12:00.989469 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9b0044f5-a3b5-4379-a840-78ae6de0da49 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:12:00.989940 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9b0044f5-a3b5-4379-a840-78ae6de0da49 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:12:00.990382 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9b0044f5-a3b5-4379-a840-78ae6de0da49 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:12:01.126291 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-9b0044f5-a3b5-4379-a840-78ae6de0da49 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3841796765145e1876ddee315b81bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2463781199104e15aea02b6280ceaacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:12:01.134955 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-9b0044f5-a3b5-4379-a840-78ae6de0da49 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] 10.222.0.18 "GET /compute/v2.1/servers/5db2a714-d522-4113-909a-463a28828a90" status: 200 len: 1677 microversion: 2.1 time: 0.165171 Oct 22 22:12:01.135582 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3441/6852] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:12:00 2022] GET /compute/v2.1/servers/5db2a714-d522-4113-909a-463a28828a90 => generated 1677 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:12:02.161872 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-2374d3f1-cbf1-493c-9868-ce3f9f90a30d tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:12:02.162670 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-2374d3f1-cbf1-493c-9868-ce3f9f90a30d tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] [instance: 5db2a714-d522-4113-909a-463a28828a90] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:12:02.172421 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2374d3f1-cbf1-493c-9868-ce3f9f90a30d tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:12:02.173070 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2374d3f1-cbf1-493c-9868-ce3f9f90a30d tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:12:02.173657 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2374d3f1-cbf1-493c-9868-ce3f9f90a30d tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:12:02.174587 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2374d3f1-cbf1-493c-9868-ce3f9f90a30d tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:12:02.175192 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2374d3f1-cbf1-493c-9868-ce3f9f90a30d tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:12:02.175801 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2374d3f1-cbf1-493c-9868-ce3f9f90a30d tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:12:02.324348 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-2374d3f1-cbf1-493c-9868-ce3f9f90a30d tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3841796765145e1876ddee315b81bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2463781199104e15aea02b6280ceaacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:12:02.332412 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-2374d3f1-cbf1-493c-9868-ce3f9f90a30d tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] 10.222.0.18 "GET /compute/v2.1/servers/5db2a714-d522-4113-909a-463a28828a90" status: 200 len: 1677 microversion: 2.1 time: 0.176115 Oct 22 22:12:02.332984 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3412/6853] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:12:02 2022] GET /compute/v2.1/servers/5db2a714-d522-4113-909a-463a28828a90 => generated 1677 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:12:03.363132 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-5f4f508f-b1d3-4742-842a-8e140c175a42 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:12:03.363845 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-5f4f508f-b1d3-4742-842a-8e140c175a42 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] [instance: 5db2a714-d522-4113-909a-463a28828a90] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:12:03.371595 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5f4f508f-b1d3-4742-842a-8e140c175a42 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:12:03.372132 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5f4f508f-b1d3-4742-842a-8e140c175a42 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:12:03.372619 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5f4f508f-b1d3-4742-842a-8e140c175a42 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:12:03.373400 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5f4f508f-b1d3-4742-842a-8e140c175a42 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:12:03.373888 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5f4f508f-b1d3-4742-842a-8e140c175a42 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:12:03.374362 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5f4f508f-b1d3-4742-842a-8e140c175a42 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:12:03.514062 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-5f4f508f-b1d3-4742-842a-8e140c175a42 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3841796765145e1876ddee315b81bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2463781199104e15aea02b6280ceaacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:12:03.522747 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-5f4f508f-b1d3-4742-842a-8e140c175a42 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] 10.222.0.18 "GET /compute/v2.1/servers/5db2a714-d522-4113-909a-463a28828a90" status: 200 len: 1677 microversion: 2.1 time: 0.164805 Oct 22 22:12:03.523301 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3442/6854] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:12:03 2022] GET /compute/v2.1/servers/5db2a714-d522-4113-909a-463a28828a90 => generated 1677 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:12:04.554011 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-90ea9dc0-53f9-44b6-a1b1-e97893d6c9d5 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:12:04.554761 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-90ea9dc0-53f9-44b6-a1b1-e97893d6c9d5 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] [instance: 5db2a714-d522-4113-909a-463a28828a90] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:12:04.563381 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-90ea9dc0-53f9-44b6-a1b1-e97893d6c9d5 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:12:04.563867 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-90ea9dc0-53f9-44b6-a1b1-e97893d6c9d5 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:12:04.564324 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-90ea9dc0-53f9-44b6-a1b1-e97893d6c9d5 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:12:04.565027 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-90ea9dc0-53f9-44b6-a1b1-e97893d6c9d5 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:12:04.565478 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-90ea9dc0-53f9-44b6-a1b1-e97893d6c9d5 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:12:04.565915 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-90ea9dc0-53f9-44b6-a1b1-e97893d6c9d5 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:12:04.705301 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-90ea9dc0-53f9-44b6-a1b1-e97893d6c9d5 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3841796765145e1876ddee315b81bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2463781199104e15aea02b6280ceaacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:12:04.713727 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-90ea9dc0-53f9-44b6-a1b1-e97893d6c9d5 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] 10.222.0.18 "GET /compute/v2.1/servers/5db2a714-d522-4113-909a-463a28828a90" status: 200 len: 1677 microversion: 2.1 time: 0.164536 Oct 22 22:12:04.714302 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3413/6855] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:12:04 2022] GET /compute/v2.1/servers/5db2a714-d522-4113-909a-463a28828a90 => generated 1677 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:12:05.737943 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-fb7dc076-e851-4f1b-aa54-edb738035695 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:12:05.738555 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-fb7dc076-e851-4f1b-aa54-edb738035695 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] [instance: 5db2a714-d522-4113-909a-463a28828a90] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:12:05.745920 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fb7dc076-e851-4f1b-aa54-edb738035695 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:12:05.746432 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fb7dc076-e851-4f1b-aa54-edb738035695 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:12:05.746891 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fb7dc076-e851-4f1b-aa54-edb738035695 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:12:05.747650 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fb7dc076-e851-4f1b-aa54-edb738035695 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:12:05.748129 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fb7dc076-e851-4f1b-aa54-edb738035695 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:12:05.748582 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fb7dc076-e851-4f1b-aa54-edb738035695 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:12:05.891117 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-fb7dc076-e851-4f1b-aa54-edb738035695 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3841796765145e1876ddee315b81bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2463781199104e15aea02b6280ceaacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:12:05.903976 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-fb7dc076-e851-4f1b-aa54-edb738035695 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] 10.222.0.18 "GET /compute/v2.1/servers/5db2a714-d522-4113-909a-463a28828a90" status: 200 len: 1677 microversion: 2.1 time: 0.170276 Oct 22 22:12:05.904949 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3443/6856] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:12:05 2022] GET /compute/v2.1/servers/5db2a714-d522-4113-909a-463a28828a90 => generated 1677 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:12:06.937489 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-4ba33cba-68f1-4068-a515-a0105f3214f7 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:12:06.938193 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-4ba33cba-68f1-4068-a515-a0105f3214f7 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] [instance: 5db2a714-d522-4113-909a-463a28828a90] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:12:06.945508 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4ba33cba-68f1-4068-a515-a0105f3214f7 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:12:06.946039 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4ba33cba-68f1-4068-a515-a0105f3214f7 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:12:06.946483 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4ba33cba-68f1-4068-a515-a0105f3214f7 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:12:06.947192 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4ba33cba-68f1-4068-a515-a0105f3214f7 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:12:06.947772 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4ba33cba-68f1-4068-a515-a0105f3214f7 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:12:06.948208 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4ba33cba-68f1-4068-a515-a0105f3214f7 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:12:07.085416 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-4ba33cba-68f1-4068-a515-a0105f3214f7 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3841796765145e1876ddee315b81bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2463781199104e15aea02b6280ceaacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:12:07.094492 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-4ba33cba-68f1-4068-a515-a0105f3214f7 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] 10.222.0.18 "GET /compute/v2.1/servers/5db2a714-d522-4113-909a-463a28828a90" status: 200 len: 1677 microversion: 2.1 time: 0.161014 Oct 22 22:12:07.095068 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3414/6857] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:12:06 2022] GET /compute/v2.1/servers/5db2a714-d522-4113-909a-463a28828a90 => generated 1677 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:12:08.128957 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-30609569-f45d-40d1-8960-9227709968da tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:12:08.130019 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-30609569-f45d-40d1-8960-9227709968da tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] [instance: 5db2a714-d522-4113-909a-463a28828a90] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:12:08.142888 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-30609569-f45d-40d1-8960-9227709968da tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:12:08.143422 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-30609569-f45d-40d1-8960-9227709968da tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:12:08.143899 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-30609569-f45d-40d1-8960-9227709968da tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:12:08.144654 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-30609569-f45d-40d1-8960-9227709968da tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:12:08.145137 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-30609569-f45d-40d1-8960-9227709968da tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:12:08.145617 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-30609569-f45d-40d1-8960-9227709968da tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:12:08.281125 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-30609569-f45d-40d1-8960-9227709968da tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3841796765145e1876ddee315b81bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2463781199104e15aea02b6280ceaacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:12:08.294193 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-30609569-f45d-40d1-8960-9227709968da tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] 10.222.0.18 "GET /compute/v2.1/servers/5db2a714-d522-4113-909a-463a28828a90" status: 200 len: 1677 microversion: 2.1 time: 0.171894 Oct 22 22:12:08.295033 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3444/6858] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:12:08 2022] GET /compute/v2.1/servers/5db2a714-d522-4113-909a-463a28828a90 => generated 1677 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:12:09.321389 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-2d2a6dc5-717e-4d89-b0f0-105f6c614848 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:12:09.322267 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-2d2a6dc5-717e-4d89-b0f0-105f6c614848 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] [instance: 5db2a714-d522-4113-909a-463a28828a90] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:12:09.331937 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2d2a6dc5-717e-4d89-b0f0-105f6c614848 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:12:09.332603 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2d2a6dc5-717e-4d89-b0f0-105f6c614848 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:12:09.333221 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2d2a6dc5-717e-4d89-b0f0-105f6c614848 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:12:09.334221 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2d2a6dc5-717e-4d89-b0f0-105f6c614848 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:12:09.334836 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2d2a6dc5-717e-4d89-b0f0-105f6c614848 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:12:09.335366 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2d2a6dc5-717e-4d89-b0f0-105f6c614848 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:12:09.477817 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-2d2a6dc5-717e-4d89-b0f0-105f6c614848 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3841796765145e1876ddee315b81bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2463781199104e15aea02b6280ceaacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:12:09.486206 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-2d2a6dc5-717e-4d89-b0f0-105f6c614848 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] 10.222.0.18 "GET /compute/v2.1/servers/5db2a714-d522-4113-909a-463a28828a90" status: 200 len: 1677 microversion: 2.1 time: 0.170879 Oct 22 22:12:09.486875 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3415/6859] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:12:09 2022] GET /compute/v2.1/servers/5db2a714-d522-4113-909a-463a28828a90 => generated 1677 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:12:10.524254 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-4a2ad0ed-f315-4b35-9687-fc2de4273e2c tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:12:10.525210 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-4a2ad0ed-f315-4b35-9687-fc2de4273e2c tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] [instance: 5db2a714-d522-4113-909a-463a28828a90] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:12:10.535230 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4a2ad0ed-f315-4b35-9687-fc2de4273e2c tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:12:10.535775 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4a2ad0ed-f315-4b35-9687-fc2de4273e2c tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:12:10.536237 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4a2ad0ed-f315-4b35-9687-fc2de4273e2c tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:12:10.536962 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4a2ad0ed-f315-4b35-9687-fc2de4273e2c tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:12:10.537442 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4a2ad0ed-f315-4b35-9687-fc2de4273e2c tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:12:10.537890 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4a2ad0ed-f315-4b35-9687-fc2de4273e2c tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:12:10.693009 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-4a2ad0ed-f315-4b35-9687-fc2de4273e2c tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3841796765145e1876ddee315b81bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2463781199104e15aea02b6280ceaacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:12:10.702435 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-4a2ad0ed-f315-4b35-9687-fc2de4273e2c tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] 10.222.0.18 "GET /compute/v2.1/servers/5db2a714-d522-4113-909a-463a28828a90" status: 200 len: 1680 microversion: 2.1 time: 0.184505 Oct 22 22:12:10.703030 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3445/6860] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:12:10 2022] GET /compute/v2.1/servers/5db2a714-d522-4113-909a-463a28828a90 => generated 1680 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:12:40.967574 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-f01d3300-bb13-4fab-8e10-b8979c6f75ca tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 22:12:40.970329 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-f01d3300-bb13-4fab-8e10-b8979c6f75ca tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] [instance: 5db2a714-d522-4113-909a-463a28828a90] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:12:40.972782 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_api:SELECT=12 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:12:40.973572 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:12:40.981520 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f01d3300-bb13-4fab-8e10-b8979c6f75ca tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:12:40.982018 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f01d3300-bb13-4fab-8e10-b8979c6f75ca tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:12:40.982471 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f01d3300-bb13-4fab-8e10-b8979c6f75ca tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:12:40.983466 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f01d3300-bb13-4fab-8e10-b8979c6f75ca tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:12:40.983927 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f01d3300-bb13-4fab-8e10-b8979c6f75ca tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:12:40.984365 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f01d3300-bb13-4fab-8e10-b8979c6f75ca tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:12:41.043101 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-f01d3300-bb13-4fab-8e10-b8979c6f75ca tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] 10.222.0.18 "POST /compute/v2.1/servers/5db2a714-d522-4113-909a-463a28828a90/action" status: 200 len: 69127 microversion: 2.1 time: 0.080838 Oct 22 22:12:41.043770 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3416/6861] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 22:12:40 2022] POST /compute/v2.1/servers/5db2a714-d522-4113-909a-463a28828a90/action => generated 69127 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 22 22:12:58.407326 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-cac690ac-c851-43ab-b019-4d287a340204 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:12:58.408162 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-cac690ac-c851-43ab-b019-4d287a340204 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] [instance: 5db2a714-d522-4113-909a-463a28828a90] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:12:58.409220 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-c9401123-4cd3-4ac3-8e15-a9a62290dcf6 req-d7fc699b-8d5a-4f2e-bae6-4aa37129a2cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5db2a714-d522-4113-909a-463a28828a90", "tag": "44b5b814-5112-4b40-9432-da274c6c79fc"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 22:12:58.413643 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_api:SELECT=12 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:12:58.414318 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell1:SELECT=36 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:12:58.415805 ncdv-master-1 devstack@n-api.service[138745]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Oct 22 22:12:58.417505 ncdv-master-1 devstack@n-api.service[138745]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 22 22:12:58.417854 ncdv-master-1 devstack@n-api.service[138745]: Sat Oct 22 22:12:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5db2a714-d522-4113-909a-463a28828a90 (ip 10.222.0.18) !!! Oct 22 22:12:58.417995 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_api:SELECT=2 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:12:58.421474 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:SELECT=4 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:12:58.425569 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cac690ac-c851-43ab-b019-4d287a340204 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:12:58.426099 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cac690ac-c851-43ab-b019-4d287a340204 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:12:58.426637 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cac690ac-c851-43ab-b019-4d287a340204 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:12:58.427327 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cac690ac-c851-43ab-b019-4d287a340204 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:12:58.428008 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cac690ac-c851-43ab-b019-4d287a340204 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:12:58.428424 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-c9401123-4cd3-4ac3-8e15-a9a62290dcf6 req-d7fc699b-8d5a-4f2e-bae6-4aa37129a2cc service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:12:58.428565 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cac690ac-c851-43ab-b019-4d287a340204 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:12:58.428912 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-c9401123-4cd3-4ac3-8e15-a9a62290dcf6 req-d7fc699b-8d5a-4f2e-bae6-4aa37129a2cc service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:12:58.430415 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-c9401123-4cd3-4ac3-8e15-a9a62290dcf6 req-d7fc699b-8d5a-4f2e-bae6-4aa37129a2cc service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:12:58.444124 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-c9401123-4cd3-4ac3-8e15-a9a62290dcf6 req-d7fc699b-8d5a-4f2e-bae6-4aa37129a2cc service nova] Creating event network-changed:44b5b814-5112-4b40-9432-da274c6c79fc for instance 5db2a714-d522-4113-909a-463a28828a90 on nch1-master-1 Oct 22 22:12:58.449885 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-c9401123-4cd3-4ac3-8e15-a9a62290dcf6 req-d7fc699b-8d5a-4f2e-bae6-4aa37129a2cc service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044709 Oct 22 22:12:58.450584 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3417/6862] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 22:12:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 22:12:58.458558 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-cac690ac-c851-43ab-b019-4d287a340204 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] [instance: 5db2a714-d522-4113-909a-463a28828a90] Going to try to terminate instance {{(pid=138745) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 22:12:58.554410 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-cac690ac-c851-43ab-b019-4d287a340204 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] 10.222.0.18 "DELETE /compute/v2.1/servers/5db2a714-d522-4113-909a-463a28828a90" status: 204 len: 0 microversion: 2.1 time: 0.151449 Oct 22 22:12:58.558606 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3446/6863] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 22:12:58 2022] DELETE /compute/v2.1/servers/5db2a714-d522-4113-909a-463a28828a90 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 22:12:58.567711 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-41479f53-763c-45f5-804e-fa90d6ab351e tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:12:58.568562 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-41479f53-763c-45f5-804e-fa90d6ab351e tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] [instance: 5db2a714-d522-4113-909a-463a28828a90] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:12:58.576079 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-41479f53-763c-45f5-804e-fa90d6ab351e tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:12:58.576651 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-41479f53-763c-45f5-804e-fa90d6ab351e tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:12:58.577156 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-41479f53-763c-45f5-804e-fa90d6ab351e tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:12:58.577954 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-41479f53-763c-45f5-804e-fa90d6ab351e tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:12:58.578477 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-41479f53-763c-45f5-804e-fa90d6ab351e tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:12:58.578987 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-41479f53-763c-45f5-804e-fa90d6ab351e tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:12:58.716743 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-41479f53-763c-45f5-804e-fa90d6ab351e tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3841796765145e1876ddee315b81bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2463781199104e15aea02b6280ceaacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:12:58.725019 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-41479f53-763c-45f5-804e-fa90d6ab351e tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] 10.222.0.18 "GET /compute/v2.1/servers/5db2a714-d522-4113-909a-463a28828a90" status: 200 len: 1686 microversion: 2.1 time: 0.161735 Oct 22 22:12:58.725805 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3418/6864] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:12:58 2022] GET /compute/v2.1/servers/5db2a714-d522-4113-909a-463a28828a90 => generated 1686 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 22:12:59.754233 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-82974a42-207f-47df-9a67-9982599f856d tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:12:59.756534 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-82974a42-207f-47df-9a67-9982599f856d tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] [instance: 5db2a714-d522-4113-909a-463a28828a90] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:12:59.766268 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-82974a42-207f-47df-9a67-9982599f856d tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:12:59.766784 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-82974a42-207f-47df-9a67-9982599f856d tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:12:59.767228 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-82974a42-207f-47df-9a67-9982599f856d tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:12:59.768044 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-82974a42-207f-47df-9a67-9982599f856d tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:12:59.768527 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-82974a42-207f-47df-9a67-9982599f856d tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:12:59.768981 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-82974a42-207f-47df-9a67-9982599f856d tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:12:59.909018 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-82974a42-207f-47df-9a67-9982599f856d tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3841796765145e1876ddee315b81bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2463781199104e15aea02b6280ceaacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:12:59.917412 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-82974a42-207f-47df-9a67-9982599f856d tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] 10.222.0.18 "GET /compute/v2.1/servers/5db2a714-d522-4113-909a-463a28828a90" status: 200 len: 1686 microversion: 2.1 time: 0.170640 Oct 22 22:12:59.917996 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3447/6865] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:12:59 2022] GET /compute/v2.1/servers/5db2a714-d522-4113-909a-463a28828a90 => generated 1686 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:13:00.759864 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-3819d79d-60ca-45c5-9c48-0e6618083175 req-e5409301-59d3-4632-9896-421261b603f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5db2a714-d522-4113-909a-463a28828a90", "name": "network-vif-deleted", "tag": "44b5b814-5112-4b40-9432-da274c6c79fc"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 22:13:00.770304 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-3819d79d-60ca-45c5-9c48-0e6618083175 req-e5409301-59d3-4632-9896-421261b603f6 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:13:00.770787 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-3819d79d-60ca-45c5-9c48-0e6618083175 req-e5409301-59d3-4632-9896-421261b603f6 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:13:00.771224 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-3819d79d-60ca-45c5-9c48-0e6618083175 req-e5409301-59d3-4632-9896-421261b603f6 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:13:00.783024 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-3819d79d-60ca-45c5-9c48-0e6618083175 req-e5409301-59d3-4632-9896-421261b603f6 service nova] Creating event network-vif-deleted:44b5b814-5112-4b40-9432-da274c6c79fc for instance 5db2a714-d522-4113-909a-463a28828a90 on nch1-master-1 Oct 22 22:13:00.788382 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-3819d79d-60ca-45c5-9c48-0e6618083175 req-e5409301-59d3-4632-9896-421261b603f6 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032188 Oct 22 22:13:00.788959 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3419/6866] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 22:13:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 22:13:00.940884 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-24bbb2b7-e2aa-4118-8f81-7fc94a78ff0a tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:13:00.941479 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-24bbb2b7-e2aa-4118-8f81-7fc94a78ff0a tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] [instance: 5db2a714-d522-4113-909a-463a28828a90] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:13:00.948827 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-24bbb2b7-e2aa-4118-8f81-7fc94a78ff0a tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:13:00.949346 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-24bbb2b7-e2aa-4118-8f81-7fc94a78ff0a tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:13:00.949808 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-24bbb2b7-e2aa-4118-8f81-7fc94a78ff0a tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:13:00.950567 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-24bbb2b7-e2aa-4118-8f81-7fc94a78ff0a tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:13:00.951246 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-24bbb2b7-e2aa-4118-8f81-7fc94a78ff0a tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:13:00.951738 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-24bbb2b7-e2aa-4118-8f81-7fc94a78ff0a tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:13:00.985459 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-24bbb2b7-e2aa-4118-8f81-7fc94a78ff0a tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:13:00.985974 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-24bbb2b7-e2aa-4118-8f81-7fc94a78ff0a tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:13:00.986436 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-24bbb2b7-e2aa-4118-8f81-7fc94a78ff0a tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:13:00.986914 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.objects.instance [None req-24bbb2b7-e2aa-4118-8f81-7fc94a78ff0a tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lazy-loading 'fault' on Instance uuid 5db2a714-d522-4113-909a-463a28828a90 {{(pid=138745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 22:13:01.028789 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-24bbb2b7-e2aa-4118-8f81-7fc94a78ff0a tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3841796765145e1876ddee315b81bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2463781199104e15aea02b6280ceaacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:13:01.036916 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-24bbb2b7-e2aa-4118-8f81-7fc94a78ff0a tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] 10.222.0.18 "GET /compute/v2.1/servers/5db2a714-d522-4113-909a-463a28828a90" status: 200 len: 1355 microversion: 2.1 time: 0.100073 Oct 22 22:13:01.037524 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3448/6867] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:13:00 2022] GET /compute/v2.1/servers/5db2a714-d522-4113-909a-463a28828a90 => generated 1355 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:13:02.067142 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-0a485fb8-c6e2-411c-a6bf-9ac5f8ece188 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:13:02.068352 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-0a485fb8-c6e2-411c-a6bf-9ac5f8ece188 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] [instance: 5db2a714-d522-4113-909a-463a28828a90] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:13:02.078062 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0a485fb8-c6e2-411c-a6bf-9ac5f8ece188 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:13:02.078559 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0a485fb8-c6e2-411c-a6bf-9ac5f8ece188 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:13:02.079006 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0a485fb8-c6e2-411c-a6bf-9ac5f8ece188 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:13:02.079747 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0a485fb8-c6e2-411c-a6bf-9ac5f8ece188 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:13:02.080218 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0a485fb8-c6e2-411c-a6bf-9ac5f8ece188 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:13:02.080655 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0a485fb8-c6e2-411c-a6bf-9ac5f8ece188 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:13:02.095218 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-0a485fb8-c6e2-411c-a6bf-9ac5f8ece188 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] HTTP exception thrown: Instance 5db2a714-d522-4113-909a-463a28828a90 could not be found. Oct 22 22:13:02.096923 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-0a485fb8-c6e2-411c-a6bf-9ac5f8ece188 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Request method failure captured: Oct 22 22:13:02.096923 ncdv-master-1 devstack@n-api.service[138744]: request: GET /compute/v2.1/servers/5db2a714-d522-4113-909a-463a28828a90 HTTP/1.1 Oct 22 22:13:02.096923 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 22:13:02.096923 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 22:13:02.096923 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 22:13:02.096923 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 0 Oct 22 22:13:02.096923 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 22:13:02.096923 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 22:13:02.096923 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 22:13:02.096923 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 22:13:02.096923 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVGn7_hWur8olMNvqY1ci34dTO2aMHkwF2Arh7Vhu0pKEfAIdjPeIgFR3M850xL8FpTR9mXeTguII0a2O-HdxsJf8qZBcfSziKEpwyhdPF7DkzW4kQj6-KDf_OfkhNJyBC-6JgZCrm8JmrvBF_CtA7k23ekrHWftWnFXpuRzAvhnMWRA Oct 22 22:13:02.096923 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 22:13:02.096923 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 22:13:02.096923 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 22:13:02.096923 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 22:13:02.096923 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 22:13:02.096923 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 22:13:02.096923 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: 2463781199104e15aea02b6280ceaacf Oct 22 22:13:02.096923 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-703320975 Oct 22 22:13:02.096923 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 22:13:02.096923 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 22:13:02.096923 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_2463781199104e15aea02b6280ceaacf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2463781199104e15aea02b6280ceaacf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/2463781199104e15aea02b6280ceaacf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2463781199104e15aea02b6280ceaacf"}]}] Oct 22 22:13:02.096923 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-TestNetworkAdvancedServerOps-703320975 Oct 22 22:13:02.096923 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: 2463781199104e15aea02b6280ceaacf Oct 22 22:13:02.096923 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-703320975 Oct 22 22:13:02.096923 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-TestNetworkAdvancedServerOps-703320975-project Oct 22 22:13:02.096923 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 22:13:02.096923 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 22:13:02.096923 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: e3841796765145e1876ddee315b81bea Oct 22 22:13:02.096923 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-TestNetworkAdvancedServerOps-703320975-project Oct 22 22:13:02.096923 ncdv-master-1 devstack@n-api.service[138744]: method: > Oct 22 22:13:02.096923 ncdv-master-1 devstack@n-api.service[138744]: exception: Instance 5db2a714-d522-4113-909a-463a28828a90 could not be found. Oct 22 22:13:02.096923 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': '5db2a714-d522-4113-909a-463a28828a90'} Oct 22 22:13:02.096923 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 22:13:02.096923 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 22:13:02.096923 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 22:13:02.096923 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 22:13:02.096923 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 22:13:02.096923 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 22:13:02.096923 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 22:13:02.096923 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 22:13:02.096923 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 22:13:02.096923 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 22:13:02.096923 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5db2a714-d522-4113-909a-463a28828a90 could not be found. Oct 22 22:13:02.096923 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 22:13:02.096923 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 22:13:02.096923 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 22:13:02.096923 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 22:13:02.096923 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 22:13:02.096923 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 22:13:02.096923 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 22:13:02.096923 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 22:13:02.096923 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 22:13:02.096923 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 22:13:02.096923 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 22:13:02.096923 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 22:13:02.096923 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 22:13:02.096923 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 22:13:02.096923 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 22:13:02.096923 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 22:13:02.096923 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5db2a714-d522-4113-909a-463a28828a90 could not be found. Oct 22 22:13:02.096923 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 22:13:02.096923 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 22:13:02.102418 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 22:13:02.102418 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 22:13:02.102418 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 22:13:02.102418 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 22:13:02.102418 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 22:13:02.102418 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 22:13:02.102418 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5db2a714-d522-4113-909a-463a28828a90 could not be found. Oct 22 22:13:02.102418 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 22:13:02.102418 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-0a485fb8-c6e2-411c-a6bf-9ac5f8ece188 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Returning 404 to user: Instance 5db2a714-d522-4113-909a-463a28828a90 could not be found. {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 22:13:02.102418 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-0a485fb8-c6e2-411c-a6bf-9ac5f8ece188 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] 10.222.0.18 "GET /compute/v2.1/servers/5db2a714-d522-4113-909a-463a28828a90" status: 404 len: 111 microversion: 2.1 time: 0.039831 Oct 22 22:13:02.102418 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3420/6868] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:13:02 2022] GET /compute/v2.1/servers/5db2a714-d522-4113-909a-463a28828a90 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 22:13:05.209773 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-be76e282-1344-4e03-8d55-4ef7baf9ac98 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Calling method '.version_select at 0x7fd39ee1e430>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:13:05.249820 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-be76e282-1344-4e03-8d55-4ef7baf9ac98 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-312205082" status: 202 len: 0 microversion: 2.1 time: 0.044007 Oct 22 22:13:05.250470 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3449/6869] 10.222.0.18 () {58 vars in 1281 bytes} [Sat Oct 22 22:13:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-312205082 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 22:13:05.280132 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-6bef450e-bef6-4359-b49d-8b977f2a717a tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Action: 'create', calling method: .version_select at 0x7fd39ec14040>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-861352624", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFhQ1yaKe9gccBzH0h5j3hfCY8mA+GjWwYcg3l4dWACWBFBjz4vj+pHGdDtDWJj2hijEF6GDfPjrIuvne01SUCcVuUczs0h0N+zIFQvYntcslpmAzVKTJrAnRAf5uLnUig=="}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 22:13:05.298296 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-6bef450e-bef6-4359-b49d-8b977f2a717a tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Getting quotas for project 2463781199104e15aea02b6280ceaacf. Resources: {'key_pairs'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 22:13:05.304677 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-6bef450e-bef6-4359-b49d-8b977f2a717a tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Getting quotas for user e3841796765145e1876ddee315b81bea and project 2463781199104e15aea02b6280ceaacf. Resources: {'key_pairs'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 22:13:05.331448 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-6bef450e-bef6-4359-b49d-8b977f2a717a tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.055623 Oct 22 22:13:05.332063 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3421/6870] 10.222.0.18 () {60 vars in 1159 bytes} [Sat Oct 22 22:13:05 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 22:13:11.207680 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-59ebfca3-dc5e-4777-9945-688beb89828b tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-516414311", "imageRef": "085e4478-6edc-4a69-8e08-f9831713eb65", "flavorRef": "452", "networks": [{"uuid": "d923acd4-a9cc-4feb-861c-27a7cd16821b"}], "key_name": "tempest-TestNetworkAdvancedServerOps-861352624", "security_groups": [{"name": "tempest-secgroup-smoke-1836771881"}]}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 22:13:11.217956 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:13:11.326873 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.network.neutron [None req-59ebfca3-dc5e-4777-9945-688beb89828b tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] validate_networks() for [('d923acd4-a9cc-4feb-861c-27a7cd16821b', None, None, None, None, None)] {{(pid=138745) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 22:13:11.808876 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-59ebfca3-dc5e-4777-9945-688beb89828b tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Flavor limits 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 22:13:11.809523 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-59ebfca3-dc5e-4777-9945-688beb89828b tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Image limits 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 22:13:11.810374 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-59ebfca3-dc5e-4777-9945-688beb89828b tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Flavor pref 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 22:13:11.810986 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-59ebfca3-dc5e-4777-9945-688beb89828b tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Image pref 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 22:13:11.811446 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-59ebfca3-dc5e-4777-9945-688beb89828b tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 22:13:11.823673 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-59ebfca3-dc5e-4777-9945-688beb89828b tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:13:11.824180 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-59ebfca3-dc5e-4777-9945-688beb89828b tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:13:11.824892 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-59ebfca3-dc5e-4777-9945-688beb89828b tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:13:11.826444 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-59ebfca3-dc5e-4777-9945-688beb89828b tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:13:11.826927 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-59ebfca3-dc5e-4777-9945-688beb89828b tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:13:11.827409 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-59ebfca3-dc5e-4777-9945-688beb89828b tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:13:11.846493 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-59ebfca3-dc5e-4777-9945-688beb89828b tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Getting quotas for project 2463781199104e15aea02b6280ceaacf. Resources: {'cores', 'instances', 'ram'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 22:13:11.852193 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-59ebfca3-dc5e-4777-9945-688beb89828b tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Getting quotas for user e3841796765145e1876ddee315b81bea and project 2463781199104e15aea02b6280ceaacf. Resources: {'cores', 'instances', 'ram'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 22:13:11.866706 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-59ebfca3-dc5e-4777-9945-688beb89828b tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Going to run 1 instances... {{(pid=138745) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 22:13:11.869137 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-59ebfca3-dc5e-4777-9945-688beb89828b tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] [instance: 2fd8449a-4228-460f-a415-93a33721c464] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='085e4478-6edc-4a69-8e08-f9831713eb65',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138745) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 22:13:11.929682 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-59ebfca3-dc5e-4777-9945-688beb89828b tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.726156 Oct 22 22:13:11.930366 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3450/6871] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Oct 22 22:13:11 2022] POST /compute/v2.1/servers => generated 406 bytes in 728 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 22:13:11.943751 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-5ad48e7c-a771-4459-88f6-9a0b82020a37 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:13:11.944378 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-5ad48e7c-a771-4459-88f6-9a0b82020a37 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] [instance: 2fd8449a-4228-460f-a415-93a33721c464] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:13:12.055632 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-5ad48e7c-a771-4459-88f6-9a0b82020a37 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3841796765145e1876ddee315b81bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2463781199104e15aea02b6280ceaacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:13:12.066180 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-5ad48e7c-a771-4459-88f6-9a0b82020a37 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] 10.222.0.18 "GET /compute/v2.1/servers/2fd8449a-4228-460f-a415-93a33721c464" status: 200 len: 1265 microversion: 2.1 time: 0.127864 Oct 22 22:13:12.068508 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3422/6872] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:13:11 2022] GET /compute/v2.1/servers/2fd8449a-4228-460f-a415-93a33721c464 => generated 1265 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:13:13.096486 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-5aa177a5-5546-4b8e-9491-15271afaa549 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:13:13.097334 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-5aa177a5-5546-4b8e-9491-15271afaa549 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] [instance: 2fd8449a-4228-460f-a415-93a33721c464] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:13:13.104528 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5aa177a5-5546-4b8e-9491-15271afaa549 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:13:13.105239 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5aa177a5-5546-4b8e-9491-15271afaa549 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:13:13.105769 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5aa177a5-5546-4b8e-9491-15271afaa549 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:13:13.106701 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5aa177a5-5546-4b8e-9491-15271afaa549 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:13:13.107249 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5aa177a5-5546-4b8e-9491-15271afaa549 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:13:13.107797 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5aa177a5-5546-4b8e-9491-15271afaa549 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:13:13.193485 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-5aa177a5-5546-4b8e-9491-15271afaa549 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3841796765145e1876ddee315b81bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2463781199104e15aea02b6280ceaacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:13:13.210666 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-5aa177a5-5546-4b8e-9491-15271afaa549 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] 10.222.0.18 "GET /compute/v2.1/servers/2fd8449a-4228-460f-a415-93a33721c464" status: 200 len: 1317 microversion: 2.1 time: 0.119312 Oct 22 22:13:13.226915 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3451/6873] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:13:13 2022] GET /compute/v2.1/servers/2fd8449a-4228-460f-a415-93a33721c464 => generated 1317 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:13:14.243471 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-444eb4a1-127f-431d-b3c1-c69de9fdc207 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:13:14.244916 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-444eb4a1-127f-431d-b3c1-c69de9fdc207 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] [instance: 2fd8449a-4228-460f-a415-93a33721c464] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:13:14.256912 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:SELECT=12 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:13:14.267167 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-444eb4a1-127f-431d-b3c1-c69de9fdc207 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:13:14.268055 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-444eb4a1-127f-431d-b3c1-c69de9fdc207 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:13:14.268699 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-444eb4a1-127f-431d-b3c1-c69de9fdc207 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:13:14.269683 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-444eb4a1-127f-431d-b3c1-c69de9fdc207 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:13:14.270352 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-444eb4a1-127f-431d-b3c1-c69de9fdc207 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:13:14.270975 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-444eb4a1-127f-431d-b3c1-c69de9fdc207 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:13:14.453814 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-444eb4a1-127f-431d-b3c1-c69de9fdc207 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3841796765145e1876ddee315b81bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2463781199104e15aea02b6280ceaacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:13:14.462896 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-444eb4a1-127f-431d-b3c1-c69de9fdc207 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] 10.222.0.18 "GET /compute/v2.1/servers/2fd8449a-4228-460f-a415-93a33721c464" status: 200 len: 1391 microversion: 2.1 time: 0.228515 Oct 22 22:13:14.463515 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3423/6874] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:13:14 2022] GET /compute/v2.1/servers/2fd8449a-4228-460f-a415-93a33721c464 => generated 1391 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:13:14.910516 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-a4ca388a-381f-4708-86b4-1ef7e00a1480 req-f4cc977f-4669-4f1e-a349-7dfddff3f39b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2fd8449a-4228-460f-a415-93a33721c464", "tag": "effec4ee-f9fd-4b0b-a205-49368c3b90a4"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 22:13:14.923044 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-a4ca388a-381f-4708-86b4-1ef7e00a1480 req-f4cc977f-4669-4f1e-a349-7dfddff3f39b service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:13:14.923723 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-a4ca388a-381f-4708-86b4-1ef7e00a1480 req-f4cc977f-4669-4f1e-a349-7dfddff3f39b service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:13:14.924283 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-a4ca388a-381f-4708-86b4-1ef7e00a1480 req-f4cc977f-4669-4f1e-a349-7dfddff3f39b service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:13:14.941447 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-a4ca388a-381f-4708-86b4-1ef7e00a1480 req-f4cc977f-4669-4f1e-a349-7dfddff3f39b service nova] Creating event network-changed:effec4ee-f9fd-4b0b-a205-49368c3b90a4 for instance 2fd8449a-4228-460f-a415-93a33721c464 on nch1-master-1 Oct 22 22:13:14.946538 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-a4ca388a-381f-4708-86b4-1ef7e00a1480 req-f4cc977f-4669-4f1e-a349-7dfddff3f39b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039944 Oct 22 22:13:14.947168 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3452/6875] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 22:13:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 22:13:15.487068 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-ba9ea5dc-bb6d-49ae-8f04-0805cd4336f2 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:13:15.487741 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-ba9ea5dc-bb6d-49ae-8f04-0805cd4336f2 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] [instance: 2fd8449a-4228-460f-a415-93a33721c464] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:13:15.495177 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ba9ea5dc-bb6d-49ae-8f04-0805cd4336f2 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:13:15.495702 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ba9ea5dc-bb6d-49ae-8f04-0805cd4336f2 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:13:15.496147 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ba9ea5dc-bb6d-49ae-8f04-0805cd4336f2 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:13:15.496892 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ba9ea5dc-bb6d-49ae-8f04-0805cd4336f2 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:13:15.497350 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ba9ea5dc-bb6d-49ae-8f04-0805cd4336f2 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:13:15.497781 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ba9ea5dc-bb6d-49ae-8f04-0805cd4336f2 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:13:15.633568 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-ba9ea5dc-bb6d-49ae-8f04-0805cd4336f2 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3841796765145e1876ddee315b81bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2463781199104e15aea02b6280ceaacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:13:15.642004 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-ba9ea5dc-bb6d-49ae-8f04-0805cd4336f2 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] 10.222.0.18 "GET /compute/v2.1/servers/2fd8449a-4228-460f-a415-93a33721c464" status: 200 len: 1391 microversion: 2.1 time: 0.158898 Oct 22 22:13:15.642926 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3424/6876] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:13:15 2022] GET /compute/v2.1/servers/2fd8449a-4228-460f-a415-93a33721c464 => generated 1391 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:13:16.667437 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-feffbb7a-931a-4427-a0e0-93c1e5a2d6b8 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:13:16.668145 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-feffbb7a-931a-4427-a0e0-93c1e5a2d6b8 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] [instance: 2fd8449a-4228-460f-a415-93a33721c464] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:13:16.674725 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-feffbb7a-931a-4427-a0e0-93c1e5a2d6b8 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:13:16.675234 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-feffbb7a-931a-4427-a0e0-93c1e5a2d6b8 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:13:16.675723 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-feffbb7a-931a-4427-a0e0-93c1e5a2d6b8 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:13:16.676449 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-feffbb7a-931a-4427-a0e0-93c1e5a2d6b8 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:13:16.676939 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-feffbb7a-931a-4427-a0e0-93c1e5a2d6b8 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:13:16.677397 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-feffbb7a-931a-4427-a0e0-93c1e5a2d6b8 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:13:16.827028 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-feffbb7a-931a-4427-a0e0-93c1e5a2d6b8 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3841796765145e1876ddee315b81bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2463781199104e15aea02b6280ceaacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:13:16.835406 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-feffbb7a-931a-4427-a0e0-93c1e5a2d6b8 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] 10.222.0.18 "GET /compute/v2.1/servers/2fd8449a-4228-460f-a415-93a33721c464" status: 200 len: 1391 microversion: 2.1 time: 0.173229 Oct 22 22:13:16.836060 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3453/6877] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:13:16 2022] GET /compute/v2.1/servers/2fd8449a-4228-460f-a415-93a33721c464 => generated 1391 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:13:17.858800 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-5eb32f5f-bbe7-4a1b-b46b-db296dafd6f0 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:13:17.859749 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-5eb32f5f-bbe7-4a1b-b46b-db296dafd6f0 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] [instance: 2fd8449a-4228-460f-a415-93a33721c464] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:13:17.866987 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5eb32f5f-bbe7-4a1b-b46b-db296dafd6f0 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:13:17.867518 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5eb32f5f-bbe7-4a1b-b46b-db296dafd6f0 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:13:17.867966 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5eb32f5f-bbe7-4a1b-b46b-db296dafd6f0 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:13:17.868671 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5eb32f5f-bbe7-4a1b-b46b-db296dafd6f0 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:13:17.869109 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5eb32f5f-bbe7-4a1b-b46b-db296dafd6f0 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:13:17.869564 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5eb32f5f-bbe7-4a1b-b46b-db296dafd6f0 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:13:18.006550 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-5eb32f5f-bbe7-4a1b-b46b-db296dafd6f0 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3841796765145e1876ddee315b81bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2463781199104e15aea02b6280ceaacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:13:18.014582 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-5eb32f5f-bbe7-4a1b-b46b-db296dafd6f0 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] 10.222.0.18 "GET /compute/v2.1/servers/2fd8449a-4228-460f-a415-93a33721c464" status: 200 len: 1391 microversion: 2.1 time: 0.159832 Oct 22 22:13:18.015167 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3425/6878] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:13:17 2022] GET /compute/v2.1/servers/2fd8449a-4228-460f-a415-93a33721c464 => generated 1391 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:13:19.038260 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-f686bfc9-ea2c-4665-92c4-c21175afe3cd tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:13:19.039040 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-f686bfc9-ea2c-4665-92c4-c21175afe3cd tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] [instance: 2fd8449a-4228-460f-a415-93a33721c464] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:13:19.046752 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f686bfc9-ea2c-4665-92c4-c21175afe3cd tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:13:19.047261 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f686bfc9-ea2c-4665-92c4-c21175afe3cd tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:13:19.047759 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f686bfc9-ea2c-4665-92c4-c21175afe3cd tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:13:19.048583 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f686bfc9-ea2c-4665-92c4-c21175afe3cd tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:13:19.049055 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f686bfc9-ea2c-4665-92c4-c21175afe3cd tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:13:19.049534 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f686bfc9-ea2c-4665-92c4-c21175afe3cd tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:13:19.182026 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-f686bfc9-ea2c-4665-92c4-c21175afe3cd tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3841796765145e1876ddee315b81bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2463781199104e15aea02b6280ceaacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:13:19.190134 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-f686bfc9-ea2c-4665-92c4-c21175afe3cd tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] 10.222.0.18 "GET /compute/v2.1/servers/2fd8449a-4228-460f-a415-93a33721c464" status: 200 len: 1391 microversion: 2.1 time: 0.155907 Oct 22 22:13:19.190696 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3454/6879] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:13:19 2022] GET /compute/v2.1/servers/2fd8449a-4228-460f-a415-93a33721c464 => generated 1391 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:13:19.592762 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-0f12dc6e-a966-4311-aa1b-b5b6955d55d1 req-4c87db99-1264-4666-861e-750be05b6f66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2fd8449a-4228-460f-a415-93a33721c464", "name": "network-vif-plugged", "status": "completed", "tag": "effec4ee-f9fd-4b0b-a205-49368c3b90a4"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 22:13:19.603522 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-0f12dc6e-a966-4311-aa1b-b5b6955d55d1 req-4c87db99-1264-4666-861e-750be05b6f66 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:13:19.604255 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-0f12dc6e-a966-4311-aa1b-b5b6955d55d1 req-4c87db99-1264-4666-861e-750be05b6f66 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:13:19.604678 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-0f12dc6e-a966-4311-aa1b-b5b6955d55d1 req-4c87db99-1264-4666-861e-750be05b6f66 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:13:19.616175 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-0f12dc6e-a966-4311-aa1b-b5b6955d55d1 req-4c87db99-1264-4666-861e-750be05b6f66 service nova] Creating event network-vif-plugged:effec4ee-f9fd-4b0b-a205-49368c3b90a4 for instance 2fd8449a-4228-460f-a415-93a33721c464 on nch1-master-1 Oct 22 22:13:19.621156 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-0f12dc6e-a966-4311-aa1b-b5b6955d55d1 req-4c87db99-1264-4666-861e-750be05b6f66 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089474 Oct 22 22:13:19.621752 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3426/6880] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 22:13:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 22:13:20.217114 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-44a2c51a-1b81-489d-b2b1-3bdac1861dd9 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:13:20.217873 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-44a2c51a-1b81-489d-b2b1-3bdac1861dd9 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] [instance: 2fd8449a-4228-460f-a415-93a33721c464] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:13:20.225477 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-44a2c51a-1b81-489d-b2b1-3bdac1861dd9 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:13:20.225982 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-44a2c51a-1b81-489d-b2b1-3bdac1861dd9 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:13:20.226439 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-44a2c51a-1b81-489d-b2b1-3bdac1861dd9 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:13:20.227163 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-44a2c51a-1b81-489d-b2b1-3bdac1861dd9 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:13:20.227865 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-44a2c51a-1b81-489d-b2b1-3bdac1861dd9 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:13:20.228313 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-44a2c51a-1b81-489d-b2b1-3bdac1861dd9 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:13:20.367422 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-44a2c51a-1b81-489d-b2b1-3bdac1861dd9 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3841796765145e1876ddee315b81bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2463781199104e15aea02b6280ceaacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:13:20.375812 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-44a2c51a-1b81-489d-b2b1-3bdac1861dd9 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] 10.222.0.18 "GET /compute/v2.1/servers/2fd8449a-4228-460f-a415-93a33721c464" status: 200 len: 1391 microversion: 2.1 time: 0.165745 Oct 22 22:13:20.376399 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3455/6881] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:13:20 2022] GET /compute/v2.1/servers/2fd8449a-4228-460f-a415-93a33721c464 => generated 1391 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:13:21.404237 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-a5a75f03-d527-4351-8236-eadc91cb3e29 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:13:21.405153 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-a5a75f03-d527-4351-8236-eadc91cb3e29 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] [instance: 2fd8449a-4228-460f-a415-93a33721c464] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:13:21.415406 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a5a75f03-d527-4351-8236-eadc91cb3e29 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:13:21.416156 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a5a75f03-d527-4351-8236-eadc91cb3e29 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:13:21.416834 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a5a75f03-d527-4351-8236-eadc91cb3e29 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:13:21.417935 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a5a75f03-d527-4351-8236-eadc91cb3e29 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:13:21.418592 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a5a75f03-d527-4351-8236-eadc91cb3e29 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:13:21.419248 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a5a75f03-d527-4351-8236-eadc91cb3e29 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:13:21.561086 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-a5a75f03-d527-4351-8236-eadc91cb3e29 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3841796765145e1876ddee315b81bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2463781199104e15aea02b6280ceaacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:13:21.573199 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-a5a75f03-d527-4351-8236-eadc91cb3e29 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] 10.222.0.18 "GET /compute/v2.1/servers/2fd8449a-4228-460f-a415-93a33721c464" status: 200 len: 1564 microversion: 2.1 time: 0.176578 Oct 22 22:13:21.573974 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3427/6882] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:13:21 2022] GET /compute/v2.1/servers/2fd8449a-4228-460f-a415-93a33721c464 => generated 1564 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:13:21.598625 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-f706fd67-49e0-4c4e-b40b-39688d8ca8bf tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:13:21.599288 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-f706fd67-49e0-4c4e-b40b-39688d8ca8bf tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] [instance: 2fd8449a-4228-460f-a415-93a33721c464] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:13:21.606699 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f706fd67-49e0-4c4e-b40b-39688d8ca8bf tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:13:21.607200 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f706fd67-49e0-4c4e-b40b-39688d8ca8bf tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:13:21.607732 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f706fd67-49e0-4c4e-b40b-39688d8ca8bf tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:13:21.608635 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f706fd67-49e0-4c4e-b40b-39688d8ca8bf tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:13:21.609107 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f706fd67-49e0-4c4e-b40b-39688d8ca8bf tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:13:21.609551 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f706fd67-49e0-4c4e-b40b-39688d8ca8bf tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:13:21.758343 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-f706fd67-49e0-4c4e-b40b-39688d8ca8bf tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3841796765145e1876ddee315b81bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2463781199104e15aea02b6280ceaacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:13:21.770949 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-f706fd67-49e0-4c4e-b40b-39688d8ca8bf tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] 10.222.0.18 "GET /compute/v2.1/servers/2fd8449a-4228-460f-a415-93a33721c464" status: 200 len: 1564 microversion: 2.1 time: 0.176188 Oct 22 22:13:21.771859 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3456/6883] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:13:21 2022] GET /compute/v2.1/servers/2fd8449a-4228-460f-a415-93a33721c464 => generated 1564 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:13:23.750992 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-97887958-ac8b-4bd0-b47f-9b08c7efccfe tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:13:23.752260 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-97887958-ac8b-4bd0-b47f-9b08c7efccfe tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] [instance: 2fd8449a-4228-460f-a415-93a33721c464] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:13:23.754385 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell0:SELECT=6 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:13:23.755461 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell0:SELECT=2 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:13:23.756461 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell0:SELECT=6 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:13:23.761413 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-97887958-ac8b-4bd0-b47f-9b08c7efccfe tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:13:23.762552 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-97887958-ac8b-4bd0-b47f-9b08c7efccfe tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:13:23.763182 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-97887958-ac8b-4bd0-b47f-9b08c7efccfe tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:13:23.764143 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-97887958-ac8b-4bd0-b47f-9b08c7efccfe tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:13:23.764605 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-97887958-ac8b-4bd0-b47f-9b08c7efccfe tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:13:23.765031 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-97887958-ac8b-4bd0-b47f-9b08c7efccfe tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:13:23.822707 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-3f0a56b1-7c50-4f08-83ce-9b0cab598a06 req-80019dde-b7ec-411a-b5e9-e8b6d7f77aa3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2fd8449a-4228-460f-a415-93a33721c464", "tag": "effec4ee-f9fd-4b0b-a205-49368c3b90a4"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 22:13:23.841072 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-3f0a56b1-7c50-4f08-83ce-9b0cab598a06 req-80019dde-b7ec-411a-b5e9-e8b6d7f77aa3 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:13:23.841932 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-3f0a56b1-7c50-4f08-83ce-9b0cab598a06 req-80019dde-b7ec-411a-b5e9-e8b6d7f77aa3 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:13:23.842790 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-3f0a56b1-7c50-4f08-83ce-9b0cab598a06 req-80019dde-b7ec-411a-b5e9-e8b6d7f77aa3 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:13:23.856603 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-3f0a56b1-7c50-4f08-83ce-9b0cab598a06 req-80019dde-b7ec-411a-b5e9-e8b6d7f77aa3 service nova] Creating event network-changed:effec4ee-f9fd-4b0b-a205-49368c3b90a4 for instance 2fd8449a-4228-460f-a415-93a33721c464 on nch1-master-1 Oct 22 22:13:23.863590 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-3f0a56b1-7c50-4f08-83ce-9b0cab598a06 req-80019dde-b7ec-411a-b5e9-e8b6d7f77aa3 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113492 Oct 22 22:13:23.864774 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3457/6884] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 22:13:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 22:13:23.912296 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-97887958-ac8b-4bd0-b47f-9b08c7efccfe tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3841796765145e1876ddee315b81bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2463781199104e15aea02b6280ceaacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:13:23.921365 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-97887958-ac8b-4bd0-b47f-9b08c7efccfe tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] 10.222.0.18 "GET /compute/v2.1/servers/2fd8449a-4228-460f-a415-93a33721c464" status: 200 len: 1564 microversion: 2.1 time: 0.174384 Oct 22 22:13:23.922119 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3428/6885] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:13:23 2022] GET /compute/v2.1/servers/2fd8449a-4228-460f-a415-93a33721c464 => generated 1564 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:13:55.250207 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-5ba4a101-fadc-4eb9-8998-0bd13e074234 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 22:13:55.252710 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-5ba4a101-fadc-4eb9-8998-0bd13e074234 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] [instance: 2fd8449a-4228-460f-a415-93a33721c464] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:13:55.254952 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:13:55.255656 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell1:SELECT=36 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:13:55.262804 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5ba4a101-fadc-4eb9-8998-0bd13e074234 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:13:55.263312 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5ba4a101-fadc-4eb9-8998-0bd13e074234 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:13:55.263799 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5ba4a101-fadc-4eb9-8998-0bd13e074234 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:13:55.264536 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5ba4a101-fadc-4eb9-8998-0bd13e074234 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:13:55.265006 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5ba4a101-fadc-4eb9-8998-0bd13e074234 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:13:55.265515 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5ba4a101-fadc-4eb9-8998-0bd13e074234 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:13:55.317553 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-5ba4a101-fadc-4eb9-8998-0bd13e074234 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] 10.222.0.18 "POST /compute/v2.1/servers/2fd8449a-4228-460f-a415-93a33721c464/action" status: 200 len: 24573 microversion: 2.1 time: 0.072146 Oct 22 22:13:55.318236 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3458/6886] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 22:13:55 2022] POST /compute/v2.1/servers/2fd8449a-4228-460f-a415-93a33721c464/action => generated 24573 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 22 22:14:25.765661 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=1 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:14:25.767009 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:SELECT=32 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:14:25.769212 ncdv-master-1 devstack@n-api.service[138744]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 22 22:14:25.769712 ncdv-master-1 devstack@n-api.service[138744]: Sat Oct 22 22:14:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2fd8449a-4228-460f-a415-93a33721c464/action (ip 10.222.0.18) !!! Oct 22 22:14:25.841786 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-8ec20f4c-4994-4f6a-8181-b71e2f3cd5a2 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 22:14:25.844280 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-8ec20f4c-4994-4f6a-8181-b71e2f3cd5a2 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] [instance: 2fd8449a-4228-460f-a415-93a33721c464] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:14:25.850947 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8ec20f4c-4994-4f6a-8181-b71e2f3cd5a2 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:14:25.851471 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8ec20f4c-4994-4f6a-8181-b71e2f3cd5a2 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:14:25.851913 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8ec20f4c-4994-4f6a-8181-b71e2f3cd5a2 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:14:25.852592 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8ec20f4c-4994-4f6a-8181-b71e2f3cd5a2 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:14:25.853046 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8ec20f4c-4994-4f6a-8181-b71e2f3cd5a2 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:14:25.853472 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8ec20f4c-4994-4f6a-8181-b71e2f3cd5a2 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:14:25.989355 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-8ec20f4c-4994-4f6a-8181-b71e2f3cd5a2 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'e3841796765145e1876ddee315b81bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2463781199104e15aea02b6280ceaacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:14:25.995814 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-8ec20f4c-4994-4f6a-8181-b71e2f3cd5a2 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] [instance: 2fd8449a-4228-460f-a415-93a33721c464] Old instance type m1.heat2, new instance type m1.heat {{(pid=138744) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 22 22:14:26.002587 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-8ec20f4c-4994-4f6a-8181-b71e2f3cd5a2 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Flavor limits 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 22:14:26.003014 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-8ec20f4c-4994-4f6a-8181-b71e2f3cd5a2 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Image limits 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 22:14:26.003525 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-8ec20f4c-4994-4f6a-8181-b71e2f3cd5a2 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Flavor pref 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 22:14:26.003947 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-8ec20f4c-4994-4f6a-8181-b71e2f3cd5a2 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Image pref 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 22:14:26.004357 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-8ec20f4c-4994-4f6a-8181-b71e2f3cd5a2 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 22:14:26.073325 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-8ec20f4c-4994-4f6a-8181-b71e2f3cd5a2 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] 10.222.0.18 "POST /compute/v2.1/servers/2fd8449a-4228-460f-a415-93a33721c464/action" status: 202 len: 0 microversion: 2.1 time: 0.310877 Oct 22 22:14:26.073932 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3429/6887] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 22:14:25 2022] POST /compute/v2.1/servers/2fd8449a-4228-460f-a415-93a33721c464/action => generated 0 bytes in 313 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 22:14:26.083196 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-6d8a08a3-89b2-406b-b953-56d9ead3bee4 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:14:26.083971 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-6d8a08a3-89b2-406b-b953-56d9ead3bee4 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] [instance: 2fd8449a-4228-460f-a415-93a33721c464] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:14:26.087116 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell1:SELECT=4 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:14:26.087953 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_api:SELECT=2 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:14:26.094449 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6d8a08a3-89b2-406b-b953-56d9ead3bee4 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:14:26.094975 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6d8a08a3-89b2-406b-b953-56d9ead3bee4 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:14:26.095501 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6d8a08a3-89b2-406b-b953-56d9ead3bee4 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:14:26.096320 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6d8a08a3-89b2-406b-b953-56d9ead3bee4 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:14:26.096989 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6d8a08a3-89b2-406b-b953-56d9ead3bee4 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:14:26.097486 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6d8a08a3-89b2-406b-b953-56d9ead3bee4 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:14:26.294363 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-6d8a08a3-89b2-406b-b953-56d9ead3bee4 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3841796765145e1876ddee315b81bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2463781199104e15aea02b6280ceaacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:14:26.302689 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-6d8a08a3-89b2-406b-b953-56d9ead3bee4 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] 10.222.0.18 "GET /compute/v2.1/servers/2fd8449a-4228-460f-a415-93a33721c464" status: 200 len: 1692 microversion: 2.1 time: 0.223973 Oct 22 22:14:26.316399 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3459/6888] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:14:26 2022] GET /compute/v2.1/servers/2fd8449a-4228-460f-a415-93a33721c464 => generated 1692 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:14:27.333849 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-bfa13846-0cce-4409-b754-82dc119d8154 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:14:27.334754 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-bfa13846-0cce-4409-b754-82dc119d8154 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] [instance: 2fd8449a-4228-460f-a415-93a33721c464] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:14:27.347245 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bfa13846-0cce-4409-b754-82dc119d8154 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:14:27.348147 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bfa13846-0cce-4409-b754-82dc119d8154 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:14:27.348859 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bfa13846-0cce-4409-b754-82dc119d8154 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:14:27.350035 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bfa13846-0cce-4409-b754-82dc119d8154 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:14:27.350849 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bfa13846-0cce-4409-b754-82dc119d8154 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:14:27.351595 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bfa13846-0cce-4409-b754-82dc119d8154 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:14:27.533171 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-bfa13846-0cce-4409-b754-82dc119d8154 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3841796765145e1876ddee315b81bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2463781199104e15aea02b6280ceaacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:14:27.541801 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-bfa13846-0cce-4409-b754-82dc119d8154 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] 10.222.0.18 "GET /compute/v2.1/servers/2fd8449a-4228-460f-a415-93a33721c464" status: 200 len: 1692 microversion: 2.1 time: 0.216702 Oct 22 22:14:27.542374 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3430/6889] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:14:27 2022] GET /compute/v2.1/servers/2fd8449a-4228-460f-a415-93a33721c464 => generated 1692 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:14:28.570782 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-fde98a44-e4ef-4c32-86ff-187d0e4d710d tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:14:28.571440 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-fde98a44-e4ef-4c32-86ff-187d0e4d710d tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] [instance: 2fd8449a-4228-460f-a415-93a33721c464] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:14:28.578962 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fde98a44-e4ef-4c32-86ff-187d0e4d710d tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:14:28.579504 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fde98a44-e4ef-4c32-86ff-187d0e4d710d tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:14:28.579964 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fde98a44-e4ef-4c32-86ff-187d0e4d710d tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:14:28.580690 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fde98a44-e4ef-4c32-86ff-187d0e4d710d tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:14:28.581166 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fde98a44-e4ef-4c32-86ff-187d0e4d710d tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:14:28.581620 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fde98a44-e4ef-4c32-86ff-187d0e4d710d tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:14:28.727701 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-fde98a44-e4ef-4c32-86ff-187d0e4d710d tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3841796765145e1876ddee315b81bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2463781199104e15aea02b6280ceaacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:14:28.735988 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-fde98a44-e4ef-4c32-86ff-187d0e4d710d tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] 10.222.0.18 "GET /compute/v2.1/servers/2fd8449a-4228-460f-a415-93a33721c464" status: 200 len: 1697 microversion: 2.1 time: 0.172028 Oct 22 22:14:28.736564 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3460/6890] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:14:28 2022] GET /compute/v2.1/servers/2fd8449a-4228-460f-a415-93a33721c464 => generated 1697 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:14:29.772365 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-5f7a21a0-97d1-4f05-8f2d-614501f87678 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:14:29.773398 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-5f7a21a0-97d1-4f05-8f2d-614501f87678 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] [instance: 2fd8449a-4228-460f-a415-93a33721c464] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:14:29.781360 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5f7a21a0-97d1-4f05-8f2d-614501f87678 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:14:29.781875 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5f7a21a0-97d1-4f05-8f2d-614501f87678 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:14:29.782324 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5f7a21a0-97d1-4f05-8f2d-614501f87678 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:14:29.783036 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5f7a21a0-97d1-4f05-8f2d-614501f87678 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:14:29.783541 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5f7a21a0-97d1-4f05-8f2d-614501f87678 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:14:29.783984 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5f7a21a0-97d1-4f05-8f2d-614501f87678 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:14:29.933551 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-5f7a21a0-97d1-4f05-8f2d-614501f87678 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3841796765145e1876ddee315b81bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2463781199104e15aea02b6280ceaacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:14:29.942296 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-5f7a21a0-97d1-4f05-8f2d-614501f87678 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] 10.222.0.18 "GET /compute/v2.1/servers/2fd8449a-4228-460f-a415-93a33721c464" status: 200 len: 1697 microversion: 2.1 time: 0.176636 Oct 22 22:14:29.942873 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3431/6891] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:14:29 2022] GET /compute/v2.1/servers/2fd8449a-4228-460f-a415-93a33721c464 => generated 1697 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:14:30.966736 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-705b840a-9d98-4143-be89-7512fa6d868f tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:14:30.967397 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-705b840a-9d98-4143-be89-7512fa6d868f tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] [instance: 2fd8449a-4228-460f-a415-93a33721c464] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:14:30.974967 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-705b840a-9d98-4143-be89-7512fa6d868f tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:14:30.975492 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-705b840a-9d98-4143-be89-7512fa6d868f tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:14:30.975952 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-705b840a-9d98-4143-be89-7512fa6d868f tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:14:30.976664 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-705b840a-9d98-4143-be89-7512fa6d868f tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:14:30.977145 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-705b840a-9d98-4143-be89-7512fa6d868f tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:14:30.977590 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-705b840a-9d98-4143-be89-7512fa6d868f tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:14:31.115044 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-705b840a-9d98-4143-be89-7512fa6d868f tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3841796765145e1876ddee315b81bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2463781199104e15aea02b6280ceaacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:14:31.123146 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-705b840a-9d98-4143-be89-7512fa6d868f tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] 10.222.0.18 "GET /compute/v2.1/servers/2fd8449a-4228-460f-a415-93a33721c464" status: 200 len: 1697 microversion: 2.1 time: 0.160930 Oct 22 22:14:31.123985 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3461/6892] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:14:30 2022] GET /compute/v2.1/servers/2fd8449a-4228-460f-a415-93a33721c464 => generated 1697 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:14:32.150599 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-7b94df2e-d160-4930-b384-cdfa6f6753ca tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:14:32.151706 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-7b94df2e-d160-4930-b384-cdfa6f6753ca tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] [instance: 2fd8449a-4228-460f-a415-93a33721c464] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:14:32.159157 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7b94df2e-d160-4930-b384-cdfa6f6753ca tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:14:32.159686 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7b94df2e-d160-4930-b384-cdfa6f6753ca tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:14:32.160448 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7b94df2e-d160-4930-b384-cdfa6f6753ca tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:14:32.160813 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7b94df2e-d160-4930-b384-cdfa6f6753ca tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:14:32.161277 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7b94df2e-d160-4930-b384-cdfa6f6753ca tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:14:32.161711 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7b94df2e-d160-4930-b384-cdfa6f6753ca tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:14:32.298968 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-7b94df2e-d160-4930-b384-cdfa6f6753ca tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3841796765145e1876ddee315b81bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2463781199104e15aea02b6280ceaacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:14:32.307022 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-7b94df2e-d160-4930-b384-cdfa6f6753ca tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] 10.222.0.18 "GET /compute/v2.1/servers/2fd8449a-4228-460f-a415-93a33721c464" status: 200 len: 1697 microversion: 2.1 time: 0.163115 Oct 22 22:14:32.307634 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3432/6893] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:14:32 2022] GET /compute/v2.1/servers/2fd8449a-4228-460f-a415-93a33721c464 => generated 1697 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:14:33.335602 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-d5371f9f-4672-4612-ad2d-0fde142ba4f1 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:14:33.336498 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-d5371f9f-4672-4612-ad2d-0fde142ba4f1 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] [instance: 2fd8449a-4228-460f-a415-93a33721c464] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:14:33.345452 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d5371f9f-4672-4612-ad2d-0fde142ba4f1 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:14:33.345961 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d5371f9f-4672-4612-ad2d-0fde142ba4f1 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:14:33.346428 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d5371f9f-4672-4612-ad2d-0fde142ba4f1 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:14:33.347159 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d5371f9f-4672-4612-ad2d-0fde142ba4f1 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:14:33.347671 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d5371f9f-4672-4612-ad2d-0fde142ba4f1 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:14:33.348131 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d5371f9f-4672-4612-ad2d-0fde142ba4f1 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:14:33.482581 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-d5371f9f-4672-4612-ad2d-0fde142ba4f1 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3841796765145e1876ddee315b81bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2463781199104e15aea02b6280ceaacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:14:33.495435 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-d5371f9f-4672-4612-ad2d-0fde142ba4f1 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] 10.222.0.18 "GET /compute/v2.1/servers/2fd8449a-4228-460f-a415-93a33721c464" status: 200 len: 1697 microversion: 2.1 time: 0.166324 Oct 22 22:14:33.496070 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3462/6894] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:14:33 2022] GET /compute/v2.1/servers/2fd8449a-4228-460f-a415-93a33721c464 => generated 1697 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:14:34.518582 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-b835e848-fa60-4de9-b81d-7e2d8b9b0751 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:14:34.519200 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-b835e848-fa60-4de9-b81d-7e2d8b9b0751 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] [instance: 2fd8449a-4228-460f-a415-93a33721c464] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:14:34.526640 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b835e848-fa60-4de9-b81d-7e2d8b9b0751 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:14:34.527140 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b835e848-fa60-4de9-b81d-7e2d8b9b0751 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:14:34.527661 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b835e848-fa60-4de9-b81d-7e2d8b9b0751 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:14:34.528368 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b835e848-fa60-4de9-b81d-7e2d8b9b0751 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:14:34.528828 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b835e848-fa60-4de9-b81d-7e2d8b9b0751 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:14:34.529264 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b835e848-fa60-4de9-b81d-7e2d8b9b0751 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:14:34.667839 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-b835e848-fa60-4de9-b81d-7e2d8b9b0751 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3841796765145e1876ddee315b81bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2463781199104e15aea02b6280ceaacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:14:34.676075 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-b835e848-fa60-4de9-b81d-7e2d8b9b0751 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] 10.222.0.18 "GET /compute/v2.1/servers/2fd8449a-4228-460f-a415-93a33721c464" status: 200 len: 1697 microversion: 2.1 time: 0.161630 Oct 22 22:14:34.676649 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3433/6895] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:14:34 2022] GET /compute/v2.1/servers/2fd8449a-4228-460f-a415-93a33721c464 => generated 1697 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:14:35.703922 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-71249a46-e0b9-49ff-987f-39a6be03d36a tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:14:35.704972 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-71249a46-e0b9-49ff-987f-39a6be03d36a tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] [instance: 2fd8449a-4228-460f-a415-93a33721c464] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:14:35.716845 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-71249a46-e0b9-49ff-987f-39a6be03d36a tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:14:35.717361 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-71249a46-e0b9-49ff-987f-39a6be03d36a tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:14:35.717823 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-71249a46-e0b9-49ff-987f-39a6be03d36a tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:14:35.718552 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-71249a46-e0b9-49ff-987f-39a6be03d36a tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:14:35.719033 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-71249a46-e0b9-49ff-987f-39a6be03d36a tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:14:35.719515 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-71249a46-e0b9-49ff-987f-39a6be03d36a tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:14:35.853714 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-71249a46-e0b9-49ff-987f-39a6be03d36a tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3841796765145e1876ddee315b81bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2463781199104e15aea02b6280ceaacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:14:35.862871 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-71249a46-e0b9-49ff-987f-39a6be03d36a tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] 10.222.0.18 "GET /compute/v2.1/servers/2fd8449a-4228-460f-a415-93a33721c464" status: 200 len: 1697 microversion: 2.1 time: 0.165919 Oct 22 22:14:35.863562 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3463/6896] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:14:35 2022] GET /compute/v2.1/servers/2fd8449a-4228-460f-a415-93a33721c464 => generated 1697 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:14:36.889628 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-2b2a802a-a838-43d3-846f-79c39186ed4c tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:14:36.890406 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-2b2a802a-a838-43d3-846f-79c39186ed4c tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] [instance: 2fd8449a-4228-460f-a415-93a33721c464] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:14:36.900193 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2b2a802a-a838-43d3-846f-79c39186ed4c tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:14:36.900923 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2b2a802a-a838-43d3-846f-79c39186ed4c tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:14:36.901427 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2b2a802a-a838-43d3-846f-79c39186ed4c tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:14:36.902324 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2b2a802a-a838-43d3-846f-79c39186ed4c tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:14:36.902956 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2b2a802a-a838-43d3-846f-79c39186ed4c tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:14:36.903589 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2b2a802a-a838-43d3-846f-79c39186ed4c tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:14:37.049369 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-2b2a802a-a838-43d3-846f-79c39186ed4c tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3841796765145e1876ddee315b81bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2463781199104e15aea02b6280ceaacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:14:37.060645 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-2b2a802a-a838-43d3-846f-79c39186ed4c tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] 10.222.0.18 "GET /compute/v2.1/servers/2fd8449a-4228-460f-a415-93a33721c464" status: 200 len: 1697 microversion: 2.1 time: 0.177220 Oct 22 22:14:37.061222 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3434/6897] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:14:36 2022] GET /compute/v2.1/servers/2fd8449a-4228-460f-a415-93a33721c464 => generated 1697 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:14:38.089380 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-03fa76d2-9886-487e-bcab-2abf0c10ea3b tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:14:38.090290 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-03fa76d2-9886-487e-bcab-2abf0c10ea3b tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] [instance: 2fd8449a-4228-460f-a415-93a33721c464] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:14:38.098640 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-03fa76d2-9886-487e-bcab-2abf0c10ea3b tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:14:38.099134 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-03fa76d2-9886-487e-bcab-2abf0c10ea3b tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:14:38.099639 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-03fa76d2-9886-487e-bcab-2abf0c10ea3b tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:14:38.100479 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-03fa76d2-9886-487e-bcab-2abf0c10ea3b tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:14:38.100968 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-03fa76d2-9886-487e-bcab-2abf0c10ea3b tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:14:38.101411 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-03fa76d2-9886-487e-bcab-2abf0c10ea3b tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:14:38.240002 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-03fa76d2-9886-487e-bcab-2abf0c10ea3b tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3841796765145e1876ddee315b81bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2463781199104e15aea02b6280ceaacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:14:38.248247 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-03fa76d2-9886-487e-bcab-2abf0c10ea3b tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] 10.222.0.18 "GET /compute/v2.1/servers/2fd8449a-4228-460f-a415-93a33721c464" status: 200 len: 1697 microversion: 2.1 time: 0.166228 Oct 22 22:14:38.248858 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3464/6898] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:14:38 2022] GET /compute/v2.1/servers/2fd8449a-4228-460f-a415-93a33721c464 => generated 1697 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:14:39.276550 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-2d78e6b4-900a-4664-abb8-9aa9aa117162 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:14:39.277602 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-2d78e6b4-900a-4664-abb8-9aa9aa117162 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] [instance: 2fd8449a-4228-460f-a415-93a33721c464] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:14:39.285050 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2d78e6b4-900a-4664-abb8-9aa9aa117162 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:14:39.285542 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2d78e6b4-900a-4664-abb8-9aa9aa117162 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:14:39.285991 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2d78e6b4-900a-4664-abb8-9aa9aa117162 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:14:39.286702 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2d78e6b4-900a-4664-abb8-9aa9aa117162 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:14:39.287162 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2d78e6b4-900a-4664-abb8-9aa9aa117162 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:14:39.287634 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2d78e6b4-900a-4664-abb8-9aa9aa117162 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:14:39.426482 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-2d78e6b4-900a-4664-abb8-9aa9aa117162 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3841796765145e1876ddee315b81bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2463781199104e15aea02b6280ceaacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:14:39.436435 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-2d78e6b4-900a-4664-abb8-9aa9aa117162 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] 10.222.0.18 "GET /compute/v2.1/servers/2fd8449a-4228-460f-a415-93a33721c464" status: 200 len: 1697 microversion: 2.1 time: 0.166943 Oct 22 22:14:39.437024 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3435/6899] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:14:39 2022] GET /compute/v2.1/servers/2fd8449a-4228-460f-a415-93a33721c464 => generated 1697 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:14:40.460739 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-571bbb62-59a2-4f00-9758-3902eb299516 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:14:40.461470 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-571bbb62-59a2-4f00-9758-3902eb299516 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] [instance: 2fd8449a-4228-460f-a415-93a33721c464] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:14:40.474450 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-571bbb62-59a2-4f00-9758-3902eb299516 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:14:40.474969 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-571bbb62-59a2-4f00-9758-3902eb299516 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:14:40.475455 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-571bbb62-59a2-4f00-9758-3902eb299516 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:14:40.476291 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-571bbb62-59a2-4f00-9758-3902eb299516 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:14:40.477123 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-571bbb62-59a2-4f00-9758-3902eb299516 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:14:40.477580 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-571bbb62-59a2-4f00-9758-3902eb299516 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:14:40.697317 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-571bbb62-59a2-4f00-9758-3902eb299516 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3841796765145e1876ddee315b81bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2463781199104e15aea02b6280ceaacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:14:40.705727 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-571bbb62-59a2-4f00-9758-3902eb299516 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] 10.222.0.18 "GET /compute/v2.1/servers/2fd8449a-4228-460f-a415-93a33721c464" status: 200 len: 1696 microversion: 2.1 time: 0.249123 Oct 22 22:14:40.706339 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3465/6900] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:14:40 2022] GET /compute/v2.1/servers/2fd8449a-4228-460f-a415-93a33721c464 => generated 1696 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:14:40.743999 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-f169b925-c87a-41d2-a70d-3310b03675ed req-0edf5290-b9c5-4670-a51b-49f3394eb74d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2fd8449a-4228-460f-a415-93a33721c464", "name": "network-vif-unplugged", "status": "completed", "tag": "effec4ee-f9fd-4b0b-a205-49368c3b90a4"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 22:14:40.754916 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-f169b925-c87a-41d2-a70d-3310b03675ed req-0edf5290-b9c5-4670-a51b-49f3394eb74d service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:14:40.755426 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-f169b925-c87a-41d2-a70d-3310b03675ed req-0edf5290-b9c5-4670-a51b-49f3394eb74d service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:14:40.755856 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-f169b925-c87a-41d2-a70d-3310b03675ed req-0edf5290-b9c5-4670-a51b-49f3394eb74d service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:14:40.768998 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-f169b925-c87a-41d2-a70d-3310b03675ed req-0edf5290-b9c5-4670-a51b-49f3394eb74d service nova] Creating event network-vif-unplugged:effec4ee-f9fd-4b0b-a205-49368c3b90a4 for instance 2fd8449a-4228-460f-a415-93a33721c464 on nch2-master-1 Oct 22 22:14:40.774990 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [req-f169b925-c87a-41d2-a70d-3310b03675ed req-0edf5290-b9c5-4670-a51b-49f3394eb74d service nova] Instance 2fd8449a-4228-460f-a415-93a33721c464 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=138744) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 22 22:14:40.786368 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-f169b925-c87a-41d2-a70d-3310b03675ed req-0edf5290-b9c5-4670-a51b-49f3394eb74d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046293 Oct 22 22:14:40.787168 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3436/6901] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 22:14:40 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 22:14:41.730402 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-6e1e861c-0c36-4a9f-9d9f-3f71523fe369 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:14:41.731158 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-6e1e861c-0c36-4a9f-9d9f-3f71523fe369 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] [instance: 2fd8449a-4228-460f-a415-93a33721c464] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:14:41.738645 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6e1e861c-0c36-4a9f-9d9f-3f71523fe369 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:14:41.739263 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6e1e861c-0c36-4a9f-9d9f-3f71523fe369 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:14:41.739756 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6e1e861c-0c36-4a9f-9d9f-3f71523fe369 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:14:41.740492 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6e1e861c-0c36-4a9f-9d9f-3f71523fe369 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:14:41.740969 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6e1e861c-0c36-4a9f-9d9f-3f71523fe369 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:14:41.741417 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6e1e861c-0c36-4a9f-9d9f-3f71523fe369 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:14:41.887625 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-6e1e861c-0c36-4a9f-9d9f-3f71523fe369 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3841796765145e1876ddee315b81bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2463781199104e15aea02b6280ceaacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:14:41.896198 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-6e1e861c-0c36-4a9f-9d9f-3f71523fe369 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] 10.222.0.18 "GET /compute/v2.1/servers/2fd8449a-4228-460f-a415-93a33721c464" status: 200 len: 1696 microversion: 2.1 time: 0.169767 Oct 22 22:14:41.896804 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3466/6902] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:14:41 2022] GET /compute/v2.1/servers/2fd8449a-4228-460f-a415-93a33721c464 => generated 1696 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:14:42.806068 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-8733c1f0-f80b-445b-8362-8c8e97f1755f req-3361fb34-210e-4907-91bf-e7d5a994d055 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2fd8449a-4228-460f-a415-93a33721c464", "tag": "effec4ee-f9fd-4b0b-a205-49368c3b90a4"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 22:14:42.817932 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-8733c1f0-f80b-445b-8362-8c8e97f1755f req-3361fb34-210e-4907-91bf-e7d5a994d055 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:14:42.818490 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-8733c1f0-f80b-445b-8362-8c8e97f1755f req-3361fb34-210e-4907-91bf-e7d5a994d055 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:14:42.818999 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-8733c1f0-f80b-445b-8362-8c8e97f1755f req-3361fb34-210e-4907-91bf-e7d5a994d055 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:14:42.832448 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-8733c1f0-f80b-445b-8362-8c8e97f1755f req-3361fb34-210e-4907-91bf-e7d5a994d055 service nova] Creating event network-changed:effec4ee-f9fd-4b0b-a205-49368c3b90a4 for instance 2fd8449a-4228-460f-a415-93a33721c464 on nch2-master-1 Oct 22 22:14:42.838148 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [req-8733c1f0-f80b-445b-8362-8c8e97f1755f req-3361fb34-210e-4907-91bf-e7d5a994d055 service nova] Instance 2fd8449a-4228-460f-a415-93a33721c464 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=138744) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 22 22:14:42.850584 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-8733c1f0-f80b-445b-8362-8c8e97f1755f req-3361fb34-210e-4907-91bf-e7d5a994d055 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050637 Oct 22 22:14:42.851176 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3437/6903] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 22:14:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 22:14:42.919924 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-315cf3da-0cb1-4c1b-97b8-df1d55f0916b tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:14:42.920562 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-315cf3da-0cb1-4c1b-97b8-df1d55f0916b tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] [instance: 2fd8449a-4228-460f-a415-93a33721c464] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:14:42.928087 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-315cf3da-0cb1-4c1b-97b8-df1d55f0916b tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:14:42.928605 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-315cf3da-0cb1-4c1b-97b8-df1d55f0916b tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:14:42.929061 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-315cf3da-0cb1-4c1b-97b8-df1d55f0916b tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:14:42.929796 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-315cf3da-0cb1-4c1b-97b8-df1d55f0916b tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:14:42.930273 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-315cf3da-0cb1-4c1b-97b8-df1d55f0916b tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:14:42.930721 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-315cf3da-0cb1-4c1b-97b8-df1d55f0916b tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:14:43.070559 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-315cf3da-0cb1-4c1b-97b8-df1d55f0916b tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3841796765145e1876ddee315b81bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2463781199104e15aea02b6280ceaacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:14:43.079768 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-315cf3da-0cb1-4c1b-97b8-df1d55f0916b tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] 10.222.0.18 "GET /compute/v2.1/servers/2fd8449a-4228-460f-a415-93a33721c464" status: 200 len: 1694 microversion: 2.1 time: 0.163986 Oct 22 22:14:43.080460 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3467/6904] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:14:42 2022] GET /compute/v2.1/servers/2fd8449a-4228-460f-a415-93a33721c464 => generated 1694 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:14:44.109404 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-578641a7-5838-4cab-bd7a-f89a2b3dbb76 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:14:44.110013 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-578641a7-5838-4cab-bd7a-f89a2b3dbb76 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] [instance: 2fd8449a-4228-460f-a415-93a33721c464] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:14:44.116882 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-578641a7-5838-4cab-bd7a-f89a2b3dbb76 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:14:44.117351 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-578641a7-5838-4cab-bd7a-f89a2b3dbb76 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:14:44.117811 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-578641a7-5838-4cab-bd7a-f89a2b3dbb76 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:14:44.118504 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-578641a7-5838-4cab-bd7a-f89a2b3dbb76 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:14:44.119074 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-578641a7-5838-4cab-bd7a-f89a2b3dbb76 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:14:44.119537 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-578641a7-5838-4cab-bd7a-f89a2b3dbb76 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:14:44.267165 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-578641a7-5838-4cab-bd7a-f89a2b3dbb76 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3841796765145e1876ddee315b81bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2463781199104e15aea02b6280ceaacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:14:44.275531 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-578641a7-5838-4cab-bd7a-f89a2b3dbb76 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] 10.222.0.18 "GET /compute/v2.1/servers/2fd8449a-4228-460f-a415-93a33721c464" status: 200 len: 1691 microversion: 2.1 time: 0.173909 Oct 22 22:14:44.276112 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3438/6905] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:14:44 2022] GET /compute/v2.1/servers/2fd8449a-4228-460f-a415-93a33721c464 => generated 1691 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:14:44.298403 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-6357cc2a-661b-47a8-af2d-7345e22b1412 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 22:14:44.298984 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-6357cc2a-661b-47a8-af2d-7345e22b1412 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] [instance: 2fd8449a-4228-460f-a415-93a33721c464] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:14:44.306330 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6357cc2a-661b-47a8-af2d-7345e22b1412 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:14:44.306836 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6357cc2a-661b-47a8-af2d-7345e22b1412 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:14:44.307275 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6357cc2a-661b-47a8-af2d-7345e22b1412 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:14:44.308047 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6357cc2a-661b-47a8-af2d-7345e22b1412 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:14:44.308513 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6357cc2a-661b-47a8-af2d-7345e22b1412 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:14:44.308959 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6357cc2a-661b-47a8-af2d-7345e22b1412 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:14:44.373500 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-6357cc2a-661b-47a8-af2d-7345e22b1412 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] 10.222.0.18 "POST /compute/v2.1/servers/2fd8449a-4228-460f-a415-93a33721c464/action" status: 204 len: 0 microversion: 2.1 time: 0.078986 Oct 22 22:14:44.374142 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3468/6906] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 22:14:44 2022] POST /compute/v2.1/servers/2fd8449a-4228-460f-a415-93a33721c464/action => generated 0 bytes in 81 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 22:14:44.382539 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-fa4f7b05-8901-4966-ac27-4efddad1c141 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:14:44.383259 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-fa4f7b05-8901-4966-ac27-4efddad1c141 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] [instance: 2fd8449a-4228-460f-a415-93a33721c464] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:14:44.389973 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fa4f7b05-8901-4966-ac27-4efddad1c141 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:14:44.390597 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fa4f7b05-8901-4966-ac27-4efddad1c141 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:14:44.391052 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fa4f7b05-8901-4966-ac27-4efddad1c141 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:14:44.391885 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fa4f7b05-8901-4966-ac27-4efddad1c141 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:14:44.392350 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fa4f7b05-8901-4966-ac27-4efddad1c141 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:14:44.392780 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fa4f7b05-8901-4966-ac27-4efddad1c141 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:14:44.532152 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-fa4f7b05-8901-4966-ac27-4efddad1c141 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3841796765145e1876ddee315b81bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2463781199104e15aea02b6280ceaacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:14:44.540194 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-fa4f7b05-8901-4966-ac27-4efddad1c141 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] 10.222.0.18 "GET /compute/v2.1/servers/2fd8449a-4228-460f-a415-93a33721c464" status: 200 len: 1691 microversion: 2.1 time: 0.161719 Oct 22 22:14:44.540797 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3439/6907] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:14:44 2022] GET /compute/v2.1/servers/2fd8449a-4228-460f-a415-93a33721c464 => generated 1691 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:14:44.564197 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-c5344922-8467-4204-a11e-a5e48bb862a9 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:14:44.564924 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-c5344922-8467-4204-a11e-a5e48bb862a9 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] [instance: 2fd8449a-4228-460f-a415-93a33721c464] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:14:44.571302 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c5344922-8467-4204-a11e-a5e48bb862a9 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:14:44.571838 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c5344922-8467-4204-a11e-a5e48bb862a9 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:14:44.572298 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c5344922-8467-4204-a11e-a5e48bb862a9 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:14:44.573005 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c5344922-8467-4204-a11e-a5e48bb862a9 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:14:44.573676 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c5344922-8467-4204-a11e-a5e48bb862a9 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:14:44.574141 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c5344922-8467-4204-a11e-a5e48bb862a9 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:14:44.713323 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-c5344922-8467-4204-a11e-a5e48bb862a9 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3841796765145e1876ddee315b81bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2463781199104e15aea02b6280ceaacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:14:44.722447 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-c5344922-8467-4204-a11e-a5e48bb862a9 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] 10.222.0.18 "GET /compute/v2.1/servers/2fd8449a-4228-460f-a415-93a33721c464" status: 200 len: 1691 microversion: 2.1 time: 0.163455 Oct 22 22:14:44.723031 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3469/6908] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:14:44 2022] GET /compute/v2.1/servers/2fd8449a-4228-460f-a415-93a33721c464 => generated 1691 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:14:45.204326 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-435f0b7a-004e-4cd2-9347-a135fb1e0df8 req-d395993d-829f-44be-8143-fa83805adea8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2fd8449a-4228-460f-a415-93a33721c464", "name": "network-vif-plugged", "status": "completed", "tag": "effec4ee-f9fd-4b0b-a205-49368c3b90a4"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 22:14:45.221575 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-435f0b7a-004e-4cd2-9347-a135fb1e0df8 req-d395993d-829f-44be-8143-fa83805adea8 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:14:45.222205 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-435f0b7a-004e-4cd2-9347-a135fb1e0df8 req-d395993d-829f-44be-8143-fa83805adea8 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:14:45.222884 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-435f0b7a-004e-4cd2-9347-a135fb1e0df8 req-d395993d-829f-44be-8143-fa83805adea8 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:14:45.236642 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-435f0b7a-004e-4cd2-9347-a135fb1e0df8 req-d395993d-829f-44be-8143-fa83805adea8 service nova] Creating event network-vif-plugged:effec4ee-f9fd-4b0b-a205-49368c3b90a4 for instance 2fd8449a-4228-460f-a415-93a33721c464 on nch2-master-1 Oct 22 22:14:45.243077 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [req-435f0b7a-004e-4cd2-9347-a135fb1e0df8 req-d395993d-829f-44be-8143-fa83805adea8 service nova] Instance 2fd8449a-4228-460f-a415-93a33721c464 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=138744) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 22 22:14:45.254461 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-435f0b7a-004e-4cd2-9347-a135fb1e0df8 req-d395993d-829f-44be-8143-fa83805adea8 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054036 Oct 22 22:14:45.255181 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3440/6909] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 22:14:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 22:14:45.747005 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-7d38af57-bf99-4161-bafb-1362aa6d2ba0 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:14:45.747689 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-7d38af57-bf99-4161-bafb-1362aa6d2ba0 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] [instance: 2fd8449a-4228-460f-a415-93a33721c464] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:14:45.755033 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7d38af57-bf99-4161-bafb-1362aa6d2ba0 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:14:45.755587 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7d38af57-bf99-4161-bafb-1362aa6d2ba0 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:14:45.756056 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7d38af57-bf99-4161-bafb-1362aa6d2ba0 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:14:45.756787 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7d38af57-bf99-4161-bafb-1362aa6d2ba0 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:14:45.757267 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7d38af57-bf99-4161-bafb-1362aa6d2ba0 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:14:45.757722 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7d38af57-bf99-4161-bafb-1362aa6d2ba0 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:14:45.894726 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-7d38af57-bf99-4161-bafb-1362aa6d2ba0 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3841796765145e1876ddee315b81bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2463781199104e15aea02b6280ceaacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:14:45.903320 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-7d38af57-bf99-4161-bafb-1362aa6d2ba0 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] 10.222.0.18 "GET /compute/v2.1/servers/2fd8449a-4228-460f-a415-93a33721c464" status: 200 len: 1683 microversion: 2.1 time: 0.160402 Oct 22 22:14:45.903926 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3470/6910] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:14:45 2022] GET /compute/v2.1/servers/2fd8449a-4228-460f-a415-93a33721c464 => generated 1683 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:15:10.142918 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_api:SELECT=28 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:15:10.144216 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:15:10.150683 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-9ba0672c-bd9e-4bb5-bc57-6cf80a8c7bed tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 22:15:10.153014 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-9ba0672c-bd9e-4bb5-bc57-6cf80a8c7bed tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] [instance: 2fd8449a-4228-460f-a415-93a33721c464] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:15:10.162172 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9ba0672c-bd9e-4bb5-bc57-6cf80a8c7bed tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:15:10.162702 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9ba0672c-bd9e-4bb5-bc57-6cf80a8c7bed tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:15:10.163148 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9ba0672c-bd9e-4bb5-bc57-6cf80a8c7bed tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:15:10.164265 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9ba0672c-bd9e-4bb5-bc57-6cf80a8c7bed tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:15:10.164739 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9ba0672c-bd9e-4bb5-bc57-6cf80a8c7bed tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:15:10.165161 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9ba0672c-bd9e-4bb5-bc57-6cf80a8c7bed tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:15:10.226628 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-9ba0672c-bd9e-4bb5-bc57-6cf80a8c7bed tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] 10.222.0.18 "POST /compute/v2.1/servers/2fd8449a-4228-460f-a415-93a33721c464/action" status: 200 len: 24570 microversion: 2.1 time: 0.086715 Oct 22 22:15:10.227451 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3441/6911] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 22:15:10 2022] POST /compute/v2.1/servers/2fd8449a-4228-460f-a415-93a33721c464/action => generated 24570 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 22 22:15:17.304916 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-6851b841-af90-4e03-9dd8-c252a9d8c1d6 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:15:17.305605 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-6851b841-af90-4e03-9dd8-c252a9d8c1d6 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] [instance: 2fd8449a-4228-460f-a415-93a33721c464] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:15:17.307835 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_api:SELECT=24 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:15:17.308227 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-891c7e82-60de-4a33-970c-687523e3f9ad req-588645ca-37c4-4f36-b5b1-85a68106916a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2fd8449a-4228-460f-a415-93a33721c464", "tag": "effec4ee-f9fd-4b0b-a205-49368c3b90a4"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 22:15:17.308965 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:15:17.320202 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-891c7e82-60de-4a33-970c-687523e3f9ad req-588645ca-37c4-4f36-b5b1-85a68106916a service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:15:17.320782 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-891c7e82-60de-4a33-970c-687523e3f9ad req-588645ca-37c4-4f36-b5b1-85a68106916a service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:15:17.321204 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-891c7e82-60de-4a33-970c-687523e3f9ad req-588645ca-37c4-4f36-b5b1-85a68106916a service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:15:17.331779 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6851b841-af90-4e03-9dd8-c252a9d8c1d6 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:15:17.332364 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6851b841-af90-4e03-9dd8-c252a9d8c1d6 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:15:17.332837 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6851b841-af90-4e03-9dd8-c252a9d8c1d6 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:15:17.333245 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-891c7e82-60de-4a33-970c-687523e3f9ad req-588645ca-37c4-4f36-b5b1-85a68106916a service nova] Creating event network-changed:effec4ee-f9fd-4b0b-a205-49368c3b90a4 for instance 2fd8449a-4228-460f-a415-93a33721c464 on nch2-master-1 Oct 22 22:15:17.333602 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6851b841-af90-4e03-9dd8-c252a9d8c1d6 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:15:17.334090 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6851b841-af90-4e03-9dd8-c252a9d8c1d6 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:15:17.334540 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6851b841-af90-4e03-9dd8-c252a9d8c1d6 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:15:17.338648 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-891c7e82-60de-4a33-970c-687523e3f9ad req-588645ca-37c4-4f36-b5b1-85a68106916a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034841 Oct 22 22:15:17.343203 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3442/6912] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 22:15:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 22:15:17.365279 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-6851b841-af90-4e03-9dd8-c252a9d8c1d6 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] [instance: 2fd8449a-4228-460f-a415-93a33721c464] Going to try to terminate instance {{(pid=138745) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 22:15:17.457693 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-6851b841-af90-4e03-9dd8-c252a9d8c1d6 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] 10.222.0.18 "DELETE /compute/v2.1/servers/2fd8449a-4228-460f-a415-93a33721c464" status: 204 len: 0 microversion: 2.1 time: 0.156668 Oct 22 22:15:17.462637 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3471/6913] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 22:15:17 2022] DELETE /compute/v2.1/servers/2fd8449a-4228-460f-a415-93a33721c464 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 22:15:17.471483 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-75af6204-153e-4fd2-8a63-9372c6ba5c55 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:15:17.472382 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-75af6204-153e-4fd2-8a63-9372c6ba5c55 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] [instance: 2fd8449a-4228-460f-a415-93a33721c464] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:15:17.479227 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-75af6204-153e-4fd2-8a63-9372c6ba5c55 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:15:17.479874 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-75af6204-153e-4fd2-8a63-9372c6ba5c55 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:15:17.480422 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-75af6204-153e-4fd2-8a63-9372c6ba5c55 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:15:17.481237 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-75af6204-153e-4fd2-8a63-9372c6ba5c55 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:15:17.481935 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-75af6204-153e-4fd2-8a63-9372c6ba5c55 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:15:17.482469 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-75af6204-153e-4fd2-8a63-9372c6ba5c55 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:15:17.629784 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-75af6204-153e-4fd2-8a63-9372c6ba5c55 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3841796765145e1876ddee315b81bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2463781199104e15aea02b6280ceaacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:15:17.639289 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-75af6204-153e-4fd2-8a63-9372c6ba5c55 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] 10.222.0.18 "GET /compute/v2.1/servers/2fd8449a-4228-460f-a415-93a33721c464" status: 200 len: 1689 microversion: 2.1 time: 0.174278 Oct 22 22:15:17.640288 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3443/6914] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:15:17 2022] GET /compute/v2.1/servers/2fd8449a-4228-460f-a415-93a33721c464 => generated 1689 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 22:15:18.663067 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-6bf9dc8c-971d-477c-a6a7-0ffa4300c267 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:15:18.663830 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-6bf9dc8c-971d-477c-a6a7-0ffa4300c267 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] [instance: 2fd8449a-4228-460f-a415-93a33721c464] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:15:18.671937 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6bf9dc8c-971d-477c-a6a7-0ffa4300c267 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:15:18.672421 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6bf9dc8c-971d-477c-a6a7-0ffa4300c267 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:15:18.672864 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6bf9dc8c-971d-477c-a6a7-0ffa4300c267 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:15:18.673929 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6bf9dc8c-971d-477c-a6a7-0ffa4300c267 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:15:18.674129 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6bf9dc8c-971d-477c-a6a7-0ffa4300c267 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:15:18.674569 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6bf9dc8c-971d-477c-a6a7-0ffa4300c267 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:15:18.826910 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-6bf9dc8c-971d-477c-a6a7-0ffa4300c267 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3841796765145e1876ddee315b81bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2463781199104e15aea02b6280ceaacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:15:18.835952 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-6bf9dc8c-971d-477c-a6a7-0ffa4300c267 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] 10.222.0.18 "GET /compute/v2.1/servers/2fd8449a-4228-460f-a415-93a33721c464" status: 200 len: 1689 microversion: 2.1 time: 0.177166 Oct 22 22:15:18.836694 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3472/6915] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:15:18 2022] GET /compute/v2.1/servers/2fd8449a-4228-460f-a415-93a33721c464 => generated 1689 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:15:19.476159 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-e64e7c61-df6b-4e84-870b-ea7166e99c5d req-4e1cee8b-f9d8-4c47-8cbf-0cb1033a64e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2fd8449a-4228-460f-a415-93a33721c464", "name": "network-vif-deleted", "tag": "effec4ee-f9fd-4b0b-a205-49368c3b90a4"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 22:15:19.488232 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-e64e7c61-df6b-4e84-870b-ea7166e99c5d req-4e1cee8b-f9d8-4c47-8cbf-0cb1033a64e7 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:15:19.488714 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-e64e7c61-df6b-4e84-870b-ea7166e99c5d req-4e1cee8b-f9d8-4c47-8cbf-0cb1033a64e7 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:15:19.489152 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-e64e7c61-df6b-4e84-870b-ea7166e99c5d req-4e1cee8b-f9d8-4c47-8cbf-0cb1033a64e7 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:15:19.502157 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-e64e7c61-df6b-4e84-870b-ea7166e99c5d req-4e1cee8b-f9d8-4c47-8cbf-0cb1033a64e7 service nova] Creating event network-vif-deleted:effec4ee-f9fd-4b0b-a205-49368c3b90a4 for instance 2fd8449a-4228-460f-a415-93a33721c464 on nch2-master-1 Oct 22 22:15:19.509009 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-e64e7c61-df6b-4e84-870b-ea7166e99c5d req-4e1cee8b-f9d8-4c47-8cbf-0cb1033a64e7 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036146 Oct 22 22:15:19.509663 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3444/6916] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 22:15:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 22:15:19.860606 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-3a020d82-a95c-4781-975c-c3114abd76d2 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:15:19.861349 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-3a020d82-a95c-4781-975c-c3114abd76d2 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] [instance: 2fd8449a-4228-460f-a415-93a33721c464] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:15:19.869258 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3a020d82-a95c-4781-975c-c3114abd76d2 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:15:19.869821 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3a020d82-a95c-4781-975c-c3114abd76d2 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:15:19.870281 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3a020d82-a95c-4781-975c-c3114abd76d2 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:15:19.871021 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3a020d82-a95c-4781-975c-c3114abd76d2 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:15:19.871574 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3a020d82-a95c-4781-975c-c3114abd76d2 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:15:19.872081 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3a020d82-a95c-4781-975c-c3114abd76d2 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:15:19.887114 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.wsgi [None req-3a020d82-a95c-4781-975c-c3114abd76d2 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] HTTP exception thrown: Instance 2fd8449a-4228-460f-a415-93a33721c464 could not be found. Oct 22 22:15:19.888901 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-3a020d82-a95c-4781-975c-c3114abd76d2 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Request method failure captured: Oct 22 22:15:19.888901 ncdv-master-1 devstack@n-api.service[138745]: request: GET /compute/v2.1/servers/2fd8449a-4228-460f-a415-93a33721c464 HTTP/1.1 Oct 22 22:15:19.888901 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 22:15:19.888901 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 22:15:19.888901 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 22:15:19.888901 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 0 Oct 22 22:15:19.888901 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 22:15:19.888901 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 22:15:19.888901 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 22:15:19.888901 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 22:15:19.888901 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVGn7_hWur8olMNvqY1ci34dTO2aMHkwF2Arh7Vhu0pKEfAIdjPeIgFR3M850xL8FpTR9mXeTguII0a2O-HdxsJf8qZBcfSziKEpwyhdPF7DkzW4kQj6-KDf_OfkhNJyBC-6JgZCrm8JmrvBF_CtA7k23ekrHWftWnFXpuRzAvhnMWRA Oct 22 22:15:19.888901 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 22:15:19.888901 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 22:15:19.888901 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 22:15:19.888901 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 22:15:19.888901 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 22:15:19.888901 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 22:15:19.888901 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: 2463781199104e15aea02b6280ceaacf Oct 22 22:15:19.888901 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-703320975 Oct 22 22:15:19.888901 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 22:15:19.888901 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 22:15:19.888901 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_2463781199104e15aea02b6280ceaacf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2463781199104e15aea02b6280ceaacf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/2463781199104e15aea02b6280ceaacf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2463781199104e15aea02b6280ceaacf"}]}] Oct 22 22:15:19.888901 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-TestNetworkAdvancedServerOps-703320975 Oct 22 22:15:19.888901 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: 2463781199104e15aea02b6280ceaacf Oct 22 22:15:19.888901 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-703320975 Oct 22 22:15:19.888901 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-TestNetworkAdvancedServerOps-703320975-project Oct 22 22:15:19.888901 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 22:15:19.888901 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 22:15:19.888901 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: e3841796765145e1876ddee315b81bea Oct 22 22:15:19.888901 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-TestNetworkAdvancedServerOps-703320975-project Oct 22 22:15:19.888901 ncdv-master-1 devstack@n-api.service[138745]: method: > Oct 22 22:15:19.888901 ncdv-master-1 devstack@n-api.service[138745]: exception: Instance 2fd8449a-4228-460f-a415-93a33721c464 could not be found. Oct 22 22:15:19.888901 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'id': '2fd8449a-4228-460f-a415-93a33721c464'} Oct 22 22:15:19.888901 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 22:15:19.888901 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 22:15:19.888901 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 22:15:19.888901 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 22:15:19.888901 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 22:15:19.888901 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 22:15:19.888901 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 22:15:19.888901 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 22:15:19.888901 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 22:15:19.888901 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 22:15:19.888901 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2fd8449a-4228-460f-a415-93a33721c464 could not be found. Oct 22 22:15:19.888901 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 22:15:19.888901 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 22:15:19.888901 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 22:15:19.888901 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 22:15:19.888901 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 22:15:19.888901 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 22:15:19.888901 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 22:15:19.888901 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 22:15:19.888901 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 22:15:19.888901 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 22:15:19.888901 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 22:15:19.888901 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 22:15:19.888901 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 22:15:19.888901 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 22:15:19.888901 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 22:15:19.888901 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 22:15:19.888901 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2fd8449a-4228-460f-a415-93a33721c464 could not be found. Oct 22 22:15:19.888901 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 22:15:19.888901 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 22:15:19.897384 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 22:15:19.897384 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 22:15:19.897384 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 22:15:19.897384 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 22:15:19.897384 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 22:15:19.897384 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 22:15:19.897384 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2fd8449a-4228-460f-a415-93a33721c464 could not be found. Oct 22 22:15:19.897384 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 22:15:19.897384 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-3a020d82-a95c-4781-975c-c3114abd76d2 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Returning 404 to user: Instance 2fd8449a-4228-460f-a415-93a33721c464 could not be found. {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 22:15:19.897384 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-3a020d82-a95c-4781-975c-c3114abd76d2 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] 10.222.0.18 "GET /compute/v2.1/servers/2fd8449a-4228-460f-a415-93a33721c464" status: 404 len: 111 microversion: 2.1 time: 0.033758 Oct 22 22:15:19.897384 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3473/6917] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:15:19 2022] GET /compute/v2.1/servers/2fd8449a-4228-460f-a415-93a33721c464 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 22:15:23.320938 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-891cc430-a73c-4f05-9006-31c844d5267e tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Calling method '.version_select at 0x7fd39eab4670>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:15:23.345472 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-891cc430-a73c-4f05-9006-31c844d5267e tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-861352624" status: 202 len: 0 microversion: 2.1 time: 0.028766 Oct 22 22:15:23.346068 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3445/6918] 10.222.0.18 () {58 vars in 1281 bytes} [Sat Oct 22 22:15:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-861352624 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 22 22:15:23.372135 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-bf7a60d3-952f-4ade-8f56-03cea9f4dfeb tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Action: 'create', calling method: .version_select at 0x7fd3a44c5550>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1711707143", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKqpmPLCCJR+LxIS1tIzeq1EjRCAZ491pqsD4TLr00WUe+tCfg3DFVmyNevaMKM3QP36iDCGpyttqN65XTFOXFpKW4gniByA3ie1JXCEBc7F5tjPmueCdtjQH7bub7AfAw=="}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 22:15:23.389754 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-bf7a60d3-952f-4ade-8f56-03cea9f4dfeb tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Getting quotas for project 2463781199104e15aea02b6280ceaacf. Resources: {'key_pairs'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 22:15:23.395363 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-bf7a60d3-952f-4ade-8f56-03cea9f4dfeb tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Getting quotas for user e3841796765145e1876ddee315b81bea and project 2463781199104e15aea02b6280ceaacf. Resources: {'key_pairs'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 22:15:23.420965 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-bf7a60d3-952f-4ade-8f56-03cea9f4dfeb tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.053181 Oct 22 22:15:23.421599 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3474/6919] 10.222.0.18 () {60 vars in 1159 bytes} [Sat Oct 22 22:15:23 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 22:15:29.042209 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-78731d8e-b9c1-4e67-95e9-64c3daa8a84f tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1539254235", "imageRef": "085e4478-6edc-4a69-8e08-f9831713eb65", "flavorRef": "452", "networks": [{"uuid": "d987cdd9-c235-456b-9a8f-dc3dec031040"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1711707143", "security_groups": [{"name": "tempest-secgroup-smoke-1346590323"}]}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 22:15:29.183599 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.network.neutron [None req-78731d8e-b9c1-4e67-95e9-64c3daa8a84f tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] validate_networks() for [('d987cdd9-c235-456b-9a8f-dc3dec031040', None, None, None, None, None)] {{(pid=138744) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 22:15:29.494900 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:SELECT=14 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:15:29.638052 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-78731d8e-b9c1-4e67-95e9-64c3daa8a84f tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Flavor limits 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 22:15:29.638595 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-78731d8e-b9c1-4e67-95e9-64c3daa8a84f tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Image limits 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 22:15:29.639186 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-78731d8e-b9c1-4e67-95e9-64c3daa8a84f tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Flavor pref 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 22:15:29.640135 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-78731d8e-b9c1-4e67-95e9-64c3daa8a84f tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Image pref 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 22:15:29.640786 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-78731d8e-b9c1-4e67-95e9-64c3daa8a84f tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 22:15:29.653502 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-78731d8e-b9c1-4e67-95e9-64c3daa8a84f tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:15:29.654011 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-78731d8e-b9c1-4e67-95e9-64c3daa8a84f tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:15:29.654458 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-78731d8e-b9c1-4e67-95e9-64c3daa8a84f tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:15:29.655200 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-78731d8e-b9c1-4e67-95e9-64c3daa8a84f tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:15:29.655684 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-78731d8e-b9c1-4e67-95e9-64c3daa8a84f tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:15:29.656458 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-78731d8e-b9c1-4e67-95e9-64c3daa8a84f tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:15:29.694280 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-78731d8e-b9c1-4e67-95e9-64c3daa8a84f tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Getting quotas for project 2463781199104e15aea02b6280ceaacf. Resources: {'cores', 'instances', 'ram'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 22:15:29.713515 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-78731d8e-b9c1-4e67-95e9-64c3daa8a84f tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Getting quotas for user e3841796765145e1876ddee315b81bea and project 2463781199104e15aea02b6280ceaacf. Resources: {'cores', 'instances', 'ram'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 22:15:29.735528 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-78731d8e-b9c1-4e67-95e9-64c3daa8a84f tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Going to run 1 instances... {{(pid=138744) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 22:15:29.738088 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-78731d8e-b9c1-4e67-95e9-64c3daa8a84f tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] [instance: 2e93f0d1-8d36-4917-8e63-5a86c424ae7d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='085e4478-6edc-4a69-8e08-f9831713eb65',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138744) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 22:15:29.806705 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-78731d8e-b9c1-4e67-95e9-64c3daa8a84f tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.769922 Oct 22 22:15:29.807776 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3446/6920] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Oct 22 22:15:29 2022] POST /compute/v2.1/servers => generated 406 bytes in 771 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 22:15:29.820343 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-d4c875e4-861e-4802-8ba2-329bd05f6329 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:15:29.820975 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-d4c875e4-861e-4802-8ba2-329bd05f6329 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] [instance: 2e93f0d1-8d36-4917-8e63-5a86c424ae7d] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:15:29.877973 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:15:29.893124 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-d4c875e4-861e-4802-8ba2-329bd05f6329 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3841796765145e1876ddee315b81bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2463781199104e15aea02b6280ceaacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:15:29.906310 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-d4c875e4-861e-4802-8ba2-329bd05f6329 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] 10.222.0.18 "GET /compute/v2.1/servers/2e93f0d1-8d36-4917-8e63-5a86c424ae7d" status: 200 len: 1267 microversion: 2.1 time: 0.090338 Oct 22 22:15:29.906910 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3475/6921] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:15:29 2022] GET /compute/v2.1/servers/2e93f0d1-8d36-4917-8e63-5a86c424ae7d => generated 1267 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:15:30.930986 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-2e2887d5-4827-4208-ad5e-5ee259bbc7ef tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:15:30.931636 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-2e2887d5-4827-4208-ad5e-5ee259bbc7ef tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] [instance: 2e93f0d1-8d36-4917-8e63-5a86c424ae7d] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:15:30.939483 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2e2887d5-4827-4208-ad5e-5ee259bbc7ef tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:15:30.940375 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2e2887d5-4827-4208-ad5e-5ee259bbc7ef tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:15:30.941004 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2e2887d5-4827-4208-ad5e-5ee259bbc7ef tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:15:30.941912 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2e2887d5-4827-4208-ad5e-5ee259bbc7ef tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:15:30.942565 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2e2887d5-4827-4208-ad5e-5ee259bbc7ef tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:15:30.943006 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2e2887d5-4827-4208-ad5e-5ee259bbc7ef tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:15:31.014502 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-2e2887d5-4827-4208-ad5e-5ee259bbc7ef tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3841796765145e1876ddee315b81bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2463781199104e15aea02b6280ceaacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:15:31.031659 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-2e2887d5-4827-4208-ad5e-5ee259bbc7ef tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] 10.222.0.18 "GET /compute/v2.1/servers/2e93f0d1-8d36-4917-8e63-5a86c424ae7d" status: 200 len: 1327 microversion: 2.1 time: 0.105404 Oct 22 22:15:31.032895 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3447/6922] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:15:30 2022] GET /compute/v2.1/servers/2e93f0d1-8d36-4917-8e63-5a86c424ae7d => generated 1327 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:15:32.058658 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-bb10e041-635f-4c20-a42f-878635e38314 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:15:32.060086 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-bb10e041-635f-4c20-a42f-878635e38314 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] [instance: 2e93f0d1-8d36-4917-8e63-5a86c424ae7d] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:15:32.069012 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bb10e041-635f-4c20-a42f-878635e38314 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:15:32.069860 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bb10e041-635f-4c20-a42f-878635e38314 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:15:32.070553 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bb10e041-635f-4c20-a42f-878635e38314 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:15:32.071583 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bb10e041-635f-4c20-a42f-878635e38314 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:15:32.072861 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bb10e041-635f-4c20-a42f-878635e38314 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:15:32.077250 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bb10e041-635f-4c20-a42f-878635e38314 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:15:32.263241 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-bb10e041-635f-4c20-a42f-878635e38314 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3841796765145e1876ddee315b81bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2463781199104e15aea02b6280ceaacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:15:32.274865 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-bb10e041-635f-4c20-a42f-878635e38314 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] 10.222.0.18 "GET /compute/v2.1/servers/2e93f0d1-8d36-4917-8e63-5a86c424ae7d" status: 200 len: 1393 microversion: 2.1 time: 0.221204 Oct 22 22:15:32.290776 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3476/6923] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:15:32 2022] GET /compute/v2.1/servers/2e93f0d1-8d36-4917-8e63-5a86c424ae7d => generated 1393 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:15:32.812720 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-6b4daf17-4921-42a3-9909-fe639544b512 req-054fc053-f873-42c4-a822-8a39af6fe2a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e93f0d1-8d36-4917-8e63-5a86c424ae7d", "tag": "d6d63268-299e-4421-b482-69cbedf5e1c4"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 22:15:32.823777 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-6b4daf17-4921-42a3-9909-fe639544b512 req-054fc053-f873-42c4-a822-8a39af6fe2a3 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:15:32.824415 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-6b4daf17-4921-42a3-9909-fe639544b512 req-054fc053-f873-42c4-a822-8a39af6fe2a3 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:15:32.824954 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-6b4daf17-4921-42a3-9909-fe639544b512 req-054fc053-f873-42c4-a822-8a39af6fe2a3 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:15:32.839043 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-6b4daf17-4921-42a3-9909-fe639544b512 req-054fc053-f873-42c4-a822-8a39af6fe2a3 service nova] Creating event network-changed:d6d63268-299e-4421-b482-69cbedf5e1c4 for instance 2e93f0d1-8d36-4917-8e63-5a86c424ae7d on nch1-master-1 Oct 22 22:15:32.844373 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-6b4daf17-4921-42a3-9909-fe639544b512 req-054fc053-f873-42c4-a822-8a39af6fe2a3 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035411 Oct 22 22:15:32.844986 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3448/6924] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 22:15:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 22:15:33.298694 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-4cb7d28e-9472-402f-888c-cc634198664d tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:15:33.299298 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-4cb7d28e-9472-402f-888c-cc634198664d tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] [instance: 2e93f0d1-8d36-4917-8e63-5a86c424ae7d] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:15:33.306700 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4cb7d28e-9472-402f-888c-cc634198664d tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:15:33.307206 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4cb7d28e-9472-402f-888c-cc634198664d tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:15:33.307760 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4cb7d28e-9472-402f-888c-cc634198664d tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:15:33.308484 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4cb7d28e-9472-402f-888c-cc634198664d tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:15:33.308956 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4cb7d28e-9472-402f-888c-cc634198664d tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:15:33.309403 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4cb7d28e-9472-402f-888c-cc634198664d tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:15:33.450382 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-4cb7d28e-9472-402f-888c-cc634198664d tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3841796765145e1876ddee315b81bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2463781199104e15aea02b6280ceaacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:15:33.462317 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-4cb7d28e-9472-402f-888c-cc634198664d tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] 10.222.0.18 "GET /compute/v2.1/servers/2e93f0d1-8d36-4917-8e63-5a86c424ae7d" status: 200 len: 1393 microversion: 2.1 time: 0.167528 Oct 22 22:15:33.463090 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3477/6925] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:15:33 2022] GET /compute/v2.1/servers/2e93f0d1-8d36-4917-8e63-5a86c424ae7d => generated 1393 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:15:34.488672 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-677e1ca6-b359-40c1-8a4a-2f5e5880a781 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:15:34.489367 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-677e1ca6-b359-40c1-8a4a-2f5e5880a781 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] [instance: 2e93f0d1-8d36-4917-8e63-5a86c424ae7d] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:15:34.496243 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-677e1ca6-b359-40c1-8a4a-2f5e5880a781 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:15:34.496734 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-677e1ca6-b359-40c1-8a4a-2f5e5880a781 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:15:34.497184 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-677e1ca6-b359-40c1-8a4a-2f5e5880a781 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:15:34.497891 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-677e1ca6-b359-40c1-8a4a-2f5e5880a781 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:15:34.498351 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-677e1ca6-b359-40c1-8a4a-2f5e5880a781 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:15:34.498787 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-677e1ca6-b359-40c1-8a4a-2f5e5880a781 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:15:34.640924 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-677e1ca6-b359-40c1-8a4a-2f5e5880a781 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3841796765145e1876ddee315b81bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2463781199104e15aea02b6280ceaacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:15:34.649551 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-677e1ca6-b359-40c1-8a4a-2f5e5880a781 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] 10.222.0.18 "GET /compute/v2.1/servers/2e93f0d1-8d36-4917-8e63-5a86c424ae7d" status: 200 len: 1393 microversion: 2.1 time: 0.166531 Oct 22 22:15:34.650130 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3449/6926] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:15:34 2022] GET /compute/v2.1/servers/2e93f0d1-8d36-4917-8e63-5a86c424ae7d => generated 1393 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:15:35.672901 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-eeaa7837-92b0-473d-8951-66715f29b2f1 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:15:35.673542 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-eeaa7837-92b0-473d-8951-66715f29b2f1 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] [instance: 2e93f0d1-8d36-4917-8e63-5a86c424ae7d] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:15:35.680968 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-eeaa7837-92b0-473d-8951-66715f29b2f1 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:15:35.681485 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-eeaa7837-92b0-473d-8951-66715f29b2f1 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:15:35.681953 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-eeaa7837-92b0-473d-8951-66715f29b2f1 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:15:35.682689 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-eeaa7837-92b0-473d-8951-66715f29b2f1 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:15:35.683290 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-eeaa7837-92b0-473d-8951-66715f29b2f1 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:15:35.683908 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-eeaa7837-92b0-473d-8951-66715f29b2f1 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:15:35.829063 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-eeaa7837-92b0-473d-8951-66715f29b2f1 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3841796765145e1876ddee315b81bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2463781199104e15aea02b6280ceaacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:15:35.840778 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-eeaa7837-92b0-473d-8951-66715f29b2f1 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] 10.222.0.18 "GET /compute/v2.1/servers/2e93f0d1-8d36-4917-8e63-5a86c424ae7d" status: 200 len: 1393 microversion: 2.1 time: 0.171541 Oct 22 22:15:35.841393 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3478/6927] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:15:35 2022] GET /compute/v2.1/servers/2e93f0d1-8d36-4917-8e63-5a86c424ae7d => generated 1393 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:15:36.866464 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-fb0bd646-b013-4ffd-921e-f0a7f7a27333 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:15:36.867069 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-fb0bd646-b013-4ffd-921e-f0a7f7a27333 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] [instance: 2e93f0d1-8d36-4917-8e63-5a86c424ae7d] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:15:36.877492 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fb0bd646-b013-4ffd-921e-f0a7f7a27333 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:15:36.878140 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fb0bd646-b013-4ffd-921e-f0a7f7a27333 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:15:36.878726 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fb0bd646-b013-4ffd-921e-f0a7f7a27333 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:15:36.879824 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fb0bd646-b013-4ffd-921e-f0a7f7a27333 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:15:36.880515 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fb0bd646-b013-4ffd-921e-f0a7f7a27333 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:15:36.881067 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fb0bd646-b013-4ffd-921e-f0a7f7a27333 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:15:37.021709 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-fb0bd646-b013-4ffd-921e-f0a7f7a27333 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3841796765145e1876ddee315b81bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2463781199104e15aea02b6280ceaacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:15:37.031479 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-fb0bd646-b013-4ffd-921e-f0a7f7a27333 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] 10.222.0.18 "GET /compute/v2.1/servers/2e93f0d1-8d36-4917-8e63-5a86c424ae7d" status: 200 len: 1393 microversion: 2.1 time: 0.171236 Oct 22 22:15:37.032056 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3450/6928] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:15:36 2022] GET /compute/v2.1/servers/2e93f0d1-8d36-4917-8e63-5a86c424ae7d => generated 1393 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:15:38.055593 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-47e63c78-b710-4e63-ad14-f80ec01e9a2f tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:15:38.056236 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-47e63c78-b710-4e63-ad14-f80ec01e9a2f tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] [instance: 2e93f0d1-8d36-4917-8e63-5a86c424ae7d] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:15:38.063653 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-47e63c78-b710-4e63-ad14-f80ec01e9a2f tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:15:38.064172 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-47e63c78-b710-4e63-ad14-f80ec01e9a2f tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:15:38.064641 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-47e63c78-b710-4e63-ad14-f80ec01e9a2f tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:15:38.064983 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-52999e95-ec29-4b6b-8e88-91b40c510742 req-4889c2c1-7a63-4322-b3a1-85dc4c4c5a9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e93f0d1-8d36-4917-8e63-5a86c424ae7d", "name": "network-vif-plugged", "status": "completed", "tag": "d6d63268-299e-4421-b482-69cbedf5e1c4"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 22:15:38.065450 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-47e63c78-b710-4e63-ad14-f80ec01e9a2f tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:15:38.065839 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-47e63c78-b710-4e63-ad14-f80ec01e9a2f tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:15:38.066292 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-47e63c78-b710-4e63-ad14-f80ec01e9a2f tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:15:38.077550 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-52999e95-ec29-4b6b-8e88-91b40c510742 req-4889c2c1-7a63-4322-b3a1-85dc4c4c5a9f service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:15:38.078044 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-52999e95-ec29-4b6b-8e88-91b40c510742 req-4889c2c1-7a63-4322-b3a1-85dc4c4c5a9f service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:15:38.078623 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-52999e95-ec29-4b6b-8e88-91b40c510742 req-4889c2c1-7a63-4322-b3a1-85dc4c4c5a9f service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:15:38.091521 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-52999e95-ec29-4b6b-8e88-91b40c510742 req-4889c2c1-7a63-4322-b3a1-85dc4c4c5a9f service nova] Creating event network-vif-plugged:d6d63268-299e-4421-b482-69cbedf5e1c4 for instance 2e93f0d1-8d36-4917-8e63-5a86c424ae7d on nch1-master-1 Oct 22 22:15:38.096760 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-52999e95-ec29-4b6b-8e88-91b40c510742 req-4889c2c1-7a63-4322-b3a1-85dc4c4c5a9f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036096 Oct 22 22:15:38.097666 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3451/6929] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 22:15:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 22:15:38.217179 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-47e63c78-b710-4e63-ad14-f80ec01e9a2f tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3841796765145e1876ddee315b81bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2463781199104e15aea02b6280ceaacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:15:38.225216 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-47e63c78-b710-4e63-ad14-f80ec01e9a2f tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] 10.222.0.18 "GET /compute/v2.1/servers/2e93f0d1-8d36-4917-8e63-5a86c424ae7d" status: 200 len: 1393 microversion: 2.1 time: 0.173962 Oct 22 22:15:38.225804 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3479/6930] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:15:38 2022] GET /compute/v2.1/servers/2e93f0d1-8d36-4917-8e63-5a86c424ae7d => generated 1393 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:15:39.252695 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-69befdc5-7d65-4a7c-91e5-419bd58e2931 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:15:39.253403 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-69befdc5-7d65-4a7c-91e5-419bd58e2931 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] [instance: 2e93f0d1-8d36-4917-8e63-5a86c424ae7d] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:15:39.260290 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-69befdc5-7d65-4a7c-91e5-419bd58e2931 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:15:39.260775 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-69befdc5-7d65-4a7c-91e5-419bd58e2931 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:15:39.261217 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-69befdc5-7d65-4a7c-91e5-419bd58e2931 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:15:39.261911 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-69befdc5-7d65-4a7c-91e5-419bd58e2931 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:15:39.262367 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-69befdc5-7d65-4a7c-91e5-419bd58e2931 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:15:39.262799 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-69befdc5-7d65-4a7c-91e5-419bd58e2931 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:15:39.404267 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-69befdc5-7d65-4a7c-91e5-419bd58e2931 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3841796765145e1876ddee315b81bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2463781199104e15aea02b6280ceaacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:15:39.412600 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-69befdc5-7d65-4a7c-91e5-419bd58e2931 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] 10.222.0.18 "GET /compute/v2.1/servers/2e93f0d1-8d36-4917-8e63-5a86c424ae7d" status: 200 len: 1393 microversion: 2.1 time: 0.166180 Oct 22 22:15:39.413177 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3452/6931] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:15:39 2022] GET /compute/v2.1/servers/2e93f0d1-8d36-4917-8e63-5a86c424ae7d => generated 1393 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:15:40.438626 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-b009d39a-ba21-4fbb-bd31-5ad71169bc87 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:15:40.439232 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-b009d39a-ba21-4fbb-bd31-5ad71169bc87 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] [instance: 2e93f0d1-8d36-4917-8e63-5a86c424ae7d] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:15:40.442355 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell0:SELECT=6 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:15:40.448088 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b009d39a-ba21-4fbb-bd31-5ad71169bc87 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:15:40.448595 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b009d39a-ba21-4fbb-bd31-5ad71169bc87 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:15:40.449080 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b009d39a-ba21-4fbb-bd31-5ad71169bc87 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:15:40.449795 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b009d39a-ba21-4fbb-bd31-5ad71169bc87 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:15:40.450266 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b009d39a-ba21-4fbb-bd31-5ad71169bc87 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:15:40.450704 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b009d39a-ba21-4fbb-bd31-5ad71169bc87 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:15:40.593554 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-b009d39a-ba21-4fbb-bd31-5ad71169bc87 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3841796765145e1876ddee315b81bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2463781199104e15aea02b6280ceaacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:15:40.601680 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-b009d39a-ba21-4fbb-bd31-5ad71169bc87 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] 10.222.0.18 "GET /compute/v2.1/servers/2e93f0d1-8d36-4917-8e63-5a86c424ae7d" status: 200 len: 1566 microversion: 2.1 time: 0.168641 Oct 22 22:15:40.602564 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3480/6932] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:15:40 2022] GET /compute/v2.1/servers/2e93f0d1-8d36-4917-8e63-5a86c424ae7d => generated 1566 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:15:40.624108 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-b9287292-6e01-474c-a575-e5e00c7e0f42 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:15:40.624727 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-b9287292-6e01-474c-a575-e5e00c7e0f42 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] [instance: 2e93f0d1-8d36-4917-8e63-5a86c424ae7d] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:15:40.626807 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell0:SELECT=2 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:15:40.627593 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell0:SELECT=6 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:15:40.629269 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_api:SELECT=39,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:15:40.635729 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b9287292-6e01-474c-a575-e5e00c7e0f42 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:15:40.636221 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b9287292-6e01-474c-a575-e5e00c7e0f42 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:15:40.636664 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b9287292-6e01-474c-a575-e5e00c7e0f42 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:15:40.637370 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b9287292-6e01-474c-a575-e5e00c7e0f42 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:15:40.637830 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b9287292-6e01-474c-a575-e5e00c7e0f42 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:15:40.638259 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b9287292-6e01-474c-a575-e5e00c7e0f42 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:15:40.784129 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-b9287292-6e01-474c-a575-e5e00c7e0f42 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3841796765145e1876ddee315b81bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2463781199104e15aea02b6280ceaacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:15:40.797701 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-b9287292-6e01-474c-a575-e5e00c7e0f42 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] 10.222.0.18 "GET /compute/v2.1/servers/2e93f0d1-8d36-4917-8e63-5a86c424ae7d" status: 200 len: 1566 microversion: 2.1 time: 0.177302 Oct 22 22:15:40.798197 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3453/6933] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:15:40 2022] GET /compute/v2.1/servers/2e93f0d1-8d36-4917-8e63-5a86c424ae7d => generated 1566 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 22:15:42.448740 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-2878b3b1-9647-4f3a-8ab9-0cad21ccd0e9 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:15:42.449520 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-2878b3b1-9647-4f3a-8ab9-0cad21ccd0e9 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] [instance: 2e93f0d1-8d36-4917-8e63-5a86c424ae7d] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:15:42.450500 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-b2be3b5f-fe93-40d4-bd0c-235773c93599 req-27b57fc5-07d9-47df-82dd-4ff7478d704f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e93f0d1-8d36-4917-8e63-5a86c424ae7d", "tag": "d6d63268-299e-4421-b482-69cbedf5e1c4"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 22:15:42.456811 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2878b3b1-9647-4f3a-8ab9-0cad21ccd0e9 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:15:42.457314 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2878b3b1-9647-4f3a-8ab9-0cad21ccd0e9 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:15:42.457774 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2878b3b1-9647-4f3a-8ab9-0cad21ccd0e9 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:15:42.458499 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2878b3b1-9647-4f3a-8ab9-0cad21ccd0e9 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:15:42.458984 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2878b3b1-9647-4f3a-8ab9-0cad21ccd0e9 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:15:42.459714 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2878b3b1-9647-4f3a-8ab9-0cad21ccd0e9 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:15:42.460851 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-b2be3b5f-fe93-40d4-bd0c-235773c93599 req-27b57fc5-07d9-47df-82dd-4ff7478d704f service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:15:42.461335 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-b2be3b5f-fe93-40d4-bd0c-235773c93599 req-27b57fc5-07d9-47df-82dd-4ff7478d704f service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:15:42.461957 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-b2be3b5f-fe93-40d4-bd0c-235773c93599 req-27b57fc5-07d9-47df-82dd-4ff7478d704f service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:15:42.475551 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-b2be3b5f-fe93-40d4-bd0c-235773c93599 req-27b57fc5-07d9-47df-82dd-4ff7478d704f service nova] Creating event network-changed:d6d63268-299e-4421-b482-69cbedf5e1c4 for instance 2e93f0d1-8d36-4917-8e63-5a86c424ae7d on nch1-master-1 Oct 22 22:15:42.482623 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-b2be3b5f-fe93-40d4-bd0c-235773c93599 req-27b57fc5-07d9-47df-82dd-4ff7478d704f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035674 Oct 22 22:15:42.484130 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3454/6934] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 22:15:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 22:15:42.608861 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-2878b3b1-9647-4f3a-8ab9-0cad21ccd0e9 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3841796765145e1876ddee315b81bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2463781199104e15aea02b6280ceaacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:15:42.617907 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-2878b3b1-9647-4f3a-8ab9-0cad21ccd0e9 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] 10.222.0.18 "GET /compute/v2.1/servers/2e93f0d1-8d36-4917-8e63-5a86c424ae7d" status: 200 len: 1566 microversion: 2.1 time: 0.173655 Oct 22 22:15:42.618828 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3481/6935] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:15:42 2022] GET /compute/v2.1/servers/2e93f0d1-8d36-4917-8e63-5a86c424ae7d => generated 1566 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:16:13.969450 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-437e5955-a034-4b4e-bf11-50fec1390ea9 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 22:16:13.972130 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-437e5955-a034-4b4e-bf11-50fec1390ea9 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] [instance: 2e93f0d1-8d36-4917-8e63-5a86c424ae7d] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:16:13.974502 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_api:SELECT=3 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:16:13.975157 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:SELECT=38 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:16:13.981847 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-437e5955-a034-4b4e-bf11-50fec1390ea9 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:16:13.982328 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-437e5955-a034-4b4e-bf11-50fec1390ea9 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:16:13.982768 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-437e5955-a034-4b4e-bf11-50fec1390ea9 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:16:13.983506 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-437e5955-a034-4b4e-bf11-50fec1390ea9 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:16:13.983968 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-437e5955-a034-4b4e-bf11-50fec1390ea9 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:16:13.984386 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-437e5955-a034-4b4e-bf11-50fec1390ea9 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:16:14.035803 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-437e5955-a034-4b4e-bf11-50fec1390ea9 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] 10.222.0.18 "POST /compute/v2.1/servers/2e93f0d1-8d36-4917-8e63-5a86c424ae7d/action" status: 200 len: 24565 microversion: 2.1 time: 0.071062 Oct 22 22:16:14.036459 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3455/6936] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 22:16:13 2022] POST /compute/v2.1/servers/2e93f0d1-8d36-4917-8e63-5a86c424ae7d/action => generated 24565 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 22 22:16:44.509374 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:16:44.510213 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell1:SELECT=36 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:16:44.511386 ncdv-master-1 devstack@n-api.service[138745]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 22 22:16:44.511559 ncdv-master-1 devstack@n-api.service[138745]: Sat Oct 22 22:16:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2e93f0d1-8d36-4917-8e63-5a86c424ae7d/action (ip 10.222.0.18) !!! Oct 22 22:16:44.516216 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-0eb9198b-f32c-42a5-b5b1-e702afd64cd0 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 22:16:44.526621 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0eb9198b-f32c-42a5-b5b1-e702afd64cd0 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:16:44.527130 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0eb9198b-f32c-42a5-b5b1-e702afd64cd0 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:16:44.527604 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0eb9198b-f32c-42a5-b5b1-e702afd64cd0 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:16:44.552623 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-0eb9198b-f32c-42a5-b5b1-e702afd64cd0 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] [instance: 2e93f0d1-8d36-4917-8e63-5a86c424ae7d] Going to try to stop instance {{(pid=138745) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 22 22:16:44.597840 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-0eb9198b-f32c-42a5-b5b1-e702afd64cd0 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] 10.222.0.18 "POST /compute/v2.1/servers/2e93f0d1-8d36-4917-8e63-5a86c424ae7d/action" status: 202 len: 0 microversion: 2.1 time: 0.090234 Oct 22 22:16:44.598609 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3482/6937] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 22:16:44 2022] POST /compute/v2.1/servers/2e93f0d1-8d36-4917-8e63-5a86c424ae7d/action => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 22:16:44.607962 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-c5501c12-e3e9-4644-9ce2-c0710c861ac0 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:16:44.608776 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-c5501c12-e3e9-4644-9ce2-c0710c861ac0 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] [instance: 2e93f0d1-8d36-4917-8e63-5a86c424ae7d] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:16:44.611520 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_api:SELECT=2 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:16:44.612234 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:SELECT=4 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:16:44.621207 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c5501c12-e3e9-4644-9ce2-c0710c861ac0 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:16:44.622434 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c5501c12-e3e9-4644-9ce2-c0710c861ac0 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:16:44.623135 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c5501c12-e3e9-4644-9ce2-c0710c861ac0 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:16:44.623916 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c5501c12-e3e9-4644-9ce2-c0710c861ac0 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:16:44.624633 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c5501c12-e3e9-4644-9ce2-c0710c861ac0 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:16:44.625027 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c5501c12-e3e9-4644-9ce2-c0710c861ac0 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:16:44.780594 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-c5501c12-e3e9-4644-9ce2-c0710c861ac0 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3841796765145e1876ddee315b81bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2463781199104e15aea02b6280ceaacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:16:44.790546 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-c5501c12-e3e9-4644-9ce2-c0710c861ac0 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] 10.222.0.18 "GET /compute/v2.1/servers/2e93f0d1-8d36-4917-8e63-5a86c424ae7d" status: 200 len: 1694 microversion: 2.1 time: 0.187186 Oct 22 22:16:44.791365 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3456/6938] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:16:44 2022] GET /compute/v2.1/servers/2e93f0d1-8d36-4917-8e63-5a86c424ae7d => generated 1694 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:16:45.821462 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-3d483a3f-d56e-44db-aca4-8f35fa0be0f2 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:16:45.822888 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-3d483a3f-d56e-44db-aca4-8f35fa0be0f2 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] [instance: 2e93f0d1-8d36-4917-8e63-5a86c424ae7d] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:16:45.834194 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3d483a3f-d56e-44db-aca4-8f35fa0be0f2 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:16:45.835168 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3d483a3f-d56e-44db-aca4-8f35fa0be0f2 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:16:45.835842 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3d483a3f-d56e-44db-aca4-8f35fa0be0f2 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:16:45.837038 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3d483a3f-d56e-44db-aca4-8f35fa0be0f2 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:16:45.837814 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3d483a3f-d56e-44db-aca4-8f35fa0be0f2 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:16:45.838461 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3d483a3f-d56e-44db-aca4-8f35fa0be0f2 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:16:45.983814 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-3d483a3f-d56e-44db-aca4-8f35fa0be0f2 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3841796765145e1876ddee315b81bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2463781199104e15aea02b6280ceaacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:16:45.991850 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-3d483a3f-d56e-44db-aca4-8f35fa0be0f2 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] 10.222.0.18 "GET /compute/v2.1/servers/2e93f0d1-8d36-4917-8e63-5a86c424ae7d" status: 200 len: 1694 microversion: 2.1 time: 0.179550 Oct 22 22:16:45.992429 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3483/6939] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:16:45 2022] GET /compute/v2.1/servers/2e93f0d1-8d36-4917-8e63-5a86c424ae7d => generated 1694 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:16:47.020688 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-7dd89673-1acf-45ad-8e6a-a2cc9bea4083 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:16:47.021675 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-7dd89673-1acf-45ad-8e6a-a2cc9bea4083 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] [instance: 2e93f0d1-8d36-4917-8e63-5a86c424ae7d] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:16:47.033896 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7dd89673-1acf-45ad-8e6a-a2cc9bea4083 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:16:47.034769 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7dd89673-1acf-45ad-8e6a-a2cc9bea4083 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:16:47.035803 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7dd89673-1acf-45ad-8e6a-a2cc9bea4083 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:16:47.037024 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7dd89673-1acf-45ad-8e6a-a2cc9bea4083 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:16:47.037800 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7dd89673-1acf-45ad-8e6a-a2cc9bea4083 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:16:47.038752 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7dd89673-1acf-45ad-8e6a-a2cc9bea4083 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:16:47.179451 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-7dd89673-1acf-45ad-8e6a-a2cc9bea4083 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3841796765145e1876ddee315b81bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2463781199104e15aea02b6280ceaacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:16:47.187745 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-7dd89673-1acf-45ad-8e6a-a2cc9bea4083 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] 10.222.0.18 "GET /compute/v2.1/servers/2e93f0d1-8d36-4917-8e63-5a86c424ae7d" status: 200 len: 1694 microversion: 2.1 time: 0.173764 Oct 22 22:16:47.188299 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3457/6940] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:16:47 2022] GET /compute/v2.1/servers/2e93f0d1-8d36-4917-8e63-5a86c424ae7d => generated 1694 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:16:48.214912 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-e9af092c-fc99-400c-b16e-e3fff2aa0c41 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:16:48.215931 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-e9af092c-fc99-400c-b16e-e3fff2aa0c41 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] [instance: 2e93f0d1-8d36-4917-8e63-5a86c424ae7d] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:16:48.223246 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e9af092c-fc99-400c-b16e-e3fff2aa0c41 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:16:48.223816 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e9af092c-fc99-400c-b16e-e3fff2aa0c41 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:16:48.224272 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e9af092c-fc99-400c-b16e-e3fff2aa0c41 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:16:48.224986 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e9af092c-fc99-400c-b16e-e3fff2aa0c41 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:16:48.225457 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e9af092c-fc99-400c-b16e-e3fff2aa0c41 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:16:48.225901 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e9af092c-fc99-400c-b16e-e3fff2aa0c41 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:16:48.365438 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-e9af092c-fc99-400c-b16e-e3fff2aa0c41 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3841796765145e1876ddee315b81bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2463781199104e15aea02b6280ceaacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:16:48.374009 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-e9af092c-fc99-400c-b16e-e3fff2aa0c41 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] 10.222.0.18 "GET /compute/v2.1/servers/2e93f0d1-8d36-4917-8e63-5a86c424ae7d" status: 200 len: 1694 microversion: 2.1 time: 0.165872 Oct 22 22:16:48.374594 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3484/6941] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:16:48 2022] GET /compute/v2.1/servers/2e93f0d1-8d36-4917-8e63-5a86c424ae7d => generated 1694 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:16:49.403694 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-c135e4d2-1369-4391-be2b-9b4d4fcc19fc tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:16:49.404363 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-c135e4d2-1369-4391-be2b-9b4d4fcc19fc tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] [instance: 2e93f0d1-8d36-4917-8e63-5a86c424ae7d] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:16:49.411618 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c135e4d2-1369-4391-be2b-9b4d4fcc19fc tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:16:49.412109 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c135e4d2-1369-4391-be2b-9b4d4fcc19fc tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:16:49.412553 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c135e4d2-1369-4391-be2b-9b4d4fcc19fc tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:16:49.413256 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c135e4d2-1369-4391-be2b-9b4d4fcc19fc tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:16:49.413712 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c135e4d2-1369-4391-be2b-9b4d4fcc19fc tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:16:49.414174 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c135e4d2-1369-4391-be2b-9b4d4fcc19fc tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:16:49.554275 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-c135e4d2-1369-4391-be2b-9b4d4fcc19fc tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3841796765145e1876ddee315b81bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2463781199104e15aea02b6280ceaacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:16:49.563482 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-c135e4d2-1369-4391-be2b-9b4d4fcc19fc tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] 10.222.0.18 "GET /compute/v2.1/servers/2e93f0d1-8d36-4917-8e63-5a86c424ae7d" status: 200 len: 1694 microversion: 2.1 time: 0.165753 Oct 22 22:16:49.564067 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3458/6942] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:16:49 2022] GET /compute/v2.1/servers/2e93f0d1-8d36-4917-8e63-5a86c424ae7d => generated 1694 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:16:50.587414 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-b57f3470-562c-4708-80a1-95e8dfef3d07 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:16:50.588061 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-b57f3470-562c-4708-80a1-95e8dfef3d07 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] [instance: 2e93f0d1-8d36-4917-8e63-5a86c424ae7d] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:16:50.596195 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b57f3470-562c-4708-80a1-95e8dfef3d07 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:16:50.596670 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b57f3470-562c-4708-80a1-95e8dfef3d07 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:16:50.597158 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b57f3470-562c-4708-80a1-95e8dfef3d07 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:16:50.597876 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b57f3470-562c-4708-80a1-95e8dfef3d07 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:16:50.598343 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b57f3470-562c-4708-80a1-95e8dfef3d07 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:16:50.598788 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b57f3470-562c-4708-80a1-95e8dfef3d07 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:16:50.744344 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-b57f3470-562c-4708-80a1-95e8dfef3d07 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3841796765145e1876ddee315b81bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2463781199104e15aea02b6280ceaacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:16:50.752639 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-b57f3470-562c-4708-80a1-95e8dfef3d07 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] 10.222.0.18 "GET /compute/v2.1/servers/2e93f0d1-8d36-4917-8e63-5a86c424ae7d" status: 200 len: 1694 microversion: 2.1 time: 0.169335 Oct 22 22:16:50.753214 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3485/6943] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:16:50 2022] GET /compute/v2.1/servers/2e93f0d1-8d36-4917-8e63-5a86c424ae7d => generated 1694 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:16:51.779287 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-75dcb035-13d3-4d31-83ae-983fa339f6f4 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:16:51.780046 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-75dcb035-13d3-4d31-83ae-983fa339f6f4 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] [instance: 2e93f0d1-8d36-4917-8e63-5a86c424ae7d] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:16:51.788105 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-75dcb035-13d3-4d31-83ae-983fa339f6f4 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:16:51.788657 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-75dcb035-13d3-4d31-83ae-983fa339f6f4 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:16:51.789152 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-75dcb035-13d3-4d31-83ae-983fa339f6f4 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:16:51.789934 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-75dcb035-13d3-4d31-83ae-983fa339f6f4 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:16:51.790446 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-75dcb035-13d3-4d31-83ae-983fa339f6f4 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:16:51.790927 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-75dcb035-13d3-4d31-83ae-983fa339f6f4 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:16:51.936104 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-75dcb035-13d3-4d31-83ae-983fa339f6f4 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3841796765145e1876ddee315b81bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2463781199104e15aea02b6280ceaacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:16:51.944679 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-75dcb035-13d3-4d31-83ae-983fa339f6f4 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] 10.222.0.18 "GET /compute/v2.1/servers/2e93f0d1-8d36-4917-8e63-5a86c424ae7d" status: 200 len: 1694 microversion: 2.1 time: 0.171074 Oct 22 22:16:51.945260 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3459/6944] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:16:51 2022] GET /compute/v2.1/servers/2e93f0d1-8d36-4917-8e63-5a86c424ae7d => generated 1694 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:16:52.968973 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-bfbf9d33-d339-4b78-9604-74bce55c00e1 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:16:52.969592 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-bfbf9d33-d339-4b78-9604-74bce55c00e1 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] [instance: 2e93f0d1-8d36-4917-8e63-5a86c424ae7d] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:16:52.977134 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bfbf9d33-d339-4b78-9604-74bce55c00e1 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:16:52.977644 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bfbf9d33-d339-4b78-9604-74bce55c00e1 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:16:52.978101 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bfbf9d33-d339-4b78-9604-74bce55c00e1 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:16:52.978825 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bfbf9d33-d339-4b78-9604-74bce55c00e1 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:16:52.979301 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bfbf9d33-d339-4b78-9604-74bce55c00e1 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:16:52.979818 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bfbf9d33-d339-4b78-9604-74bce55c00e1 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:16:53.120811 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-bfbf9d33-d339-4b78-9604-74bce55c00e1 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3841796765145e1876ddee315b81bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2463781199104e15aea02b6280ceaacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:16:53.129204 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-bfbf9d33-d339-4b78-9604-74bce55c00e1 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] 10.222.0.18 "GET /compute/v2.1/servers/2e93f0d1-8d36-4917-8e63-5a86c424ae7d" status: 200 len: 1694 microversion: 2.1 time: 0.164757 Oct 22 22:16:53.129777 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3486/6945] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:16:52 2022] GET /compute/v2.1/servers/2e93f0d1-8d36-4917-8e63-5a86c424ae7d => generated 1694 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:16:54.156839 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-7f6d9ce4-4d37-4fbd-b21b-208c40b075fd tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:16:54.157672 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-7f6d9ce4-4d37-4fbd-b21b-208c40b075fd tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] [instance: 2e93f0d1-8d36-4917-8e63-5a86c424ae7d] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:16:54.166988 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7f6d9ce4-4d37-4fbd-b21b-208c40b075fd tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:16:54.167694 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7f6d9ce4-4d37-4fbd-b21b-208c40b075fd tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:16:54.168291 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7f6d9ce4-4d37-4fbd-b21b-208c40b075fd tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:16:54.169650 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7f6d9ce4-4d37-4fbd-b21b-208c40b075fd tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:16:54.170277 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7f6d9ce4-4d37-4fbd-b21b-208c40b075fd tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:16:54.170902 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7f6d9ce4-4d37-4fbd-b21b-208c40b075fd tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:16:54.314384 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-7f6d9ce4-4d37-4fbd-b21b-208c40b075fd tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3841796765145e1876ddee315b81bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2463781199104e15aea02b6280ceaacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:16:54.322430 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-7f6d9ce4-4d37-4fbd-b21b-208c40b075fd tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] 10.222.0.18 "GET /compute/v2.1/servers/2e93f0d1-8d36-4917-8e63-5a86c424ae7d" status: 200 len: 1694 microversion: 2.1 time: 0.171972 Oct 22 22:16:54.322982 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3460/6946] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:16:54 2022] GET /compute/v2.1/servers/2e93f0d1-8d36-4917-8e63-5a86c424ae7d => generated 1694 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:16:55.347303 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-cc97e94c-8050-405d-a4c1-b6ebf2b4b878 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:16:55.347998 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-cc97e94c-8050-405d-a4c1-b6ebf2b4b878 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] [instance: 2e93f0d1-8d36-4917-8e63-5a86c424ae7d] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:16:55.355890 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cc97e94c-8050-405d-a4c1-b6ebf2b4b878 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:16:55.356425 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cc97e94c-8050-405d-a4c1-b6ebf2b4b878 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:16:55.356914 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cc97e94c-8050-405d-a4c1-b6ebf2b4b878 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:16:55.357649 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cc97e94c-8050-405d-a4c1-b6ebf2b4b878 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:16:55.358171 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cc97e94c-8050-405d-a4c1-b6ebf2b4b878 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:16:55.358665 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cc97e94c-8050-405d-a4c1-b6ebf2b4b878 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:16:55.497448 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-cc97e94c-8050-405d-a4c1-b6ebf2b4b878 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3841796765145e1876ddee315b81bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2463781199104e15aea02b6280ceaacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:16:55.505890 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-cc97e94c-8050-405d-a4c1-b6ebf2b4b878 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] 10.222.0.18 "GET /compute/v2.1/servers/2e93f0d1-8d36-4917-8e63-5a86c424ae7d" status: 200 len: 1671 microversion: 2.1 time: 0.162906 Oct 22 22:16:55.506440 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3487/6947] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:16:55 2022] GET /compute/v2.1/servers/2e93f0d1-8d36-4917-8e63-5a86c424ae7d => generated 1671 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:16:56.611251 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-4552248f-bfa6-463e-bf3e-40160c9554e6 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 22:16:56.613912 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-4552248f-bfa6-463e-bf3e-40160c9554e6 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] [instance: 2e93f0d1-8d36-4917-8e63-5a86c424ae7d] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:16:56.622595 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4552248f-bfa6-463e-bf3e-40160c9554e6 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:16:56.623163 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4552248f-bfa6-463e-bf3e-40160c9554e6 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:16:56.623727 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4552248f-bfa6-463e-bf3e-40160c9554e6 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:16:56.624597 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4552248f-bfa6-463e-bf3e-40160c9554e6 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:16:56.625130 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4552248f-bfa6-463e-bf3e-40160c9554e6 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:16:56.625648 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4552248f-bfa6-463e-bf3e-40160c9554e6 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:16:56.680484 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-4552248f-bfa6-463e-bf3e-40160c9554e6 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] 10.222.0.18 "POST /compute/v2.1/servers/2e93f0d1-8d36-4917-8e63-5a86c424ae7d/action" status: 200 len: 35018 microversion: 2.1 time: 0.074711 Oct 22 22:16:56.681143 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3461/6948] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 22:16:56 2022] POST /compute/v2.1/servers/2e93f0d1-8d36-4917-8e63-5a86c424ae7d/action => generated 35018 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 22 22:16:56.696843 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-219f75f7-ded9-4319-90ba-cf01554d2742 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 22:16:56.704547 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-219f75f7-ded9-4319-90ba-cf01554d2742 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:16:56.705127 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-219f75f7-ded9-4319-90ba-cf01554d2742 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:16:56.705590 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-219f75f7-ded9-4319-90ba-cf01554d2742 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:16:56.729966 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-219f75f7-ded9-4319-90ba-cf01554d2742 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] [instance: 2e93f0d1-8d36-4917-8e63-5a86c424ae7d] Going to try to start instance {{(pid=138745) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 22 22:16:56.779300 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-219f75f7-ded9-4319-90ba-cf01554d2742 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] 10.222.0.18 "POST /compute/v2.1/servers/2e93f0d1-8d36-4917-8e63-5a86c424ae7d/action" status: 202 len: 0 microversion: 2.1 time: 0.086214 Oct 22 22:16:56.779851 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3488/6949] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 22:16:56 2022] POST /compute/v2.1/servers/2e93f0d1-8d36-4917-8e63-5a86c424ae7d/action => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 22:16:56.788976 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-2ef7324d-62eb-4e1e-9764-36a2b86d2ed9 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:16:56.789689 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-2ef7324d-62eb-4e1e-9764-36a2b86d2ed9 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] [instance: 2e93f0d1-8d36-4917-8e63-5a86c424ae7d] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:16:56.797574 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2ef7324d-62eb-4e1e-9764-36a2b86d2ed9 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:16:56.798068 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2ef7324d-62eb-4e1e-9764-36a2b86d2ed9 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:16:56.798515 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2ef7324d-62eb-4e1e-9764-36a2b86d2ed9 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:16:56.799438 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2ef7324d-62eb-4e1e-9764-36a2b86d2ed9 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:16:56.799916 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2ef7324d-62eb-4e1e-9764-36a2b86d2ed9 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:16:56.800369 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2ef7324d-62eb-4e1e-9764-36a2b86d2ed9 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:16:56.949277 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-2ef7324d-62eb-4e1e-9764-36a2b86d2ed9 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3841796765145e1876ddee315b81bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2463781199104e15aea02b6280ceaacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:16:56.957956 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-2ef7324d-62eb-4e1e-9764-36a2b86d2ed9 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] 10.222.0.18 "GET /compute/v2.1/servers/2e93f0d1-8d36-4917-8e63-5a86c424ae7d" status: 200 len: 1680 microversion: 2.1 time: 0.173207 Oct 22 22:16:56.958561 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3462/6950] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:16:56 2022] GET /compute/v2.1/servers/2e93f0d1-8d36-4917-8e63-5a86c424ae7d => generated 1680 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:16:57.986895 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-100627f0-d78f-452c-af1d-6eefc1f7b76d tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:16:57.987629 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-100627f0-d78f-452c-af1d-6eefc1f7b76d tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] [instance: 2e93f0d1-8d36-4917-8e63-5a86c424ae7d] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:16:57.994507 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-100627f0-d78f-452c-af1d-6eefc1f7b76d tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:16:57.995011 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-100627f0-d78f-452c-af1d-6eefc1f7b76d tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:16:57.995508 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-100627f0-d78f-452c-af1d-6eefc1f7b76d tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:16:57.996220 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-100627f0-d78f-452c-af1d-6eefc1f7b76d tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:16:57.996687 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-100627f0-d78f-452c-af1d-6eefc1f7b76d tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:16:57.997127 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-100627f0-d78f-452c-af1d-6eefc1f7b76d tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:16:58.137296 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-100627f0-d78f-452c-af1d-6eefc1f7b76d tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3841796765145e1876ddee315b81bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2463781199104e15aea02b6280ceaacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:16:58.145944 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-100627f0-d78f-452c-af1d-6eefc1f7b76d tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] 10.222.0.18 "GET /compute/v2.1/servers/2e93f0d1-8d36-4917-8e63-5a86c424ae7d" status: 200 len: 1680 microversion: 2.1 time: 0.165580 Oct 22 22:16:58.146745 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3489/6951] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:16:57 2022] GET /compute/v2.1/servers/2e93f0d1-8d36-4917-8e63-5a86c424ae7d => generated 1680 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:16:59.173757 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-cb69e818-0c3a-42b1-87d4-47609d41dacd tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:16:59.174746 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-cb69e818-0c3a-42b1-87d4-47609d41dacd tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] [instance: 2e93f0d1-8d36-4917-8e63-5a86c424ae7d] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:16:59.186556 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cb69e818-0c3a-42b1-87d4-47609d41dacd tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:16:59.187226 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cb69e818-0c3a-42b1-87d4-47609d41dacd tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:16:59.187900 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cb69e818-0c3a-42b1-87d4-47609d41dacd tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:16:59.188603 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cb69e818-0c3a-42b1-87d4-47609d41dacd tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:16:59.189060 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cb69e818-0c3a-42b1-87d4-47609d41dacd tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:16:59.189486 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cb69e818-0c3a-42b1-87d4-47609d41dacd tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:16:59.337302 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-cb69e818-0c3a-42b1-87d4-47609d41dacd tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3841796765145e1876ddee315b81bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2463781199104e15aea02b6280ceaacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:16:59.348136 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-cb69e818-0c3a-42b1-87d4-47609d41dacd tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] 10.222.0.18 "GET /compute/v2.1/servers/2e93f0d1-8d36-4917-8e63-5a86c424ae7d" status: 200 len: 1684 microversion: 2.1 time: 0.181119 Oct 22 22:16:59.348841 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3463/6952] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:16:59 2022] GET /compute/v2.1/servers/2e93f0d1-8d36-4917-8e63-5a86c424ae7d => generated 1684 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:17:31.636489 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-a33ed392-0b25-40d5-bf10-e8ad11454d15 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 22:17:31.639034 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-a33ed392-0b25-40d5-bf10-e8ad11454d15 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] [instance: 2e93f0d1-8d36-4917-8e63-5a86c424ae7d] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:17:31.641585 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_api:SELECT=16 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:17:31.642347 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:17:31.649347 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a33ed392-0b25-40d5-bf10-e8ad11454d15 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:17:31.649861 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a33ed392-0b25-40d5-bf10-e8ad11454d15 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:17:31.650586 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a33ed392-0b25-40d5-bf10-e8ad11454d15 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:17:31.651045 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a33ed392-0b25-40d5-bf10-e8ad11454d15 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:17:31.651550 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a33ed392-0b25-40d5-bf10-e8ad11454d15 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:17:31.651993 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a33ed392-0b25-40d5-bf10-e8ad11454d15 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:17:31.707387 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-a33ed392-0b25-40d5-bf10-e8ad11454d15 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] 10.222.0.18 "POST /compute/v2.1/servers/2e93f0d1-8d36-4917-8e63-5a86c424ae7d/action" status: 200 len: 59576 microversion: 2.1 time: 0.075691 Oct 22 22:17:31.708079 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3490/6953] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 22:17:31 2022] POST /compute/v2.1/servers/2e93f0d1-8d36-4917-8e63-5a86c424ae7d/action => generated 59576 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 22 22:17:48.766015 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-84582678-026f-4a47-9801-aa71d7d12dbe tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:17:48.766576 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-84582678-026f-4a47-9801-aa71d7d12dbe tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] [instance: 2e93f0d1-8d36-4917-8e63-5a86c424ae7d] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:17:48.769901 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-6404e2a9-d031-4950-a35a-c8d0c83c5b3c req-eebc2719-b473-4d5f-af4c-8a67540d324f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e93f0d1-8d36-4917-8e63-5a86c424ae7d", "tag": "d6d63268-299e-4421-b482-69cbedf5e1c4"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 22:17:48.770353 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_api:SELECT=16 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:17:48.770776 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:SELECT=46 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:17:48.774383 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-84582678-026f-4a47-9801-aa71d7d12dbe tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:17:48.774875 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-84582678-026f-4a47-9801-aa71d7d12dbe tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:17:48.775314 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-84582678-026f-4a47-9801-aa71d7d12dbe tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:17:48.776070 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-84582678-026f-4a47-9801-aa71d7d12dbe tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:17:48.776531 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-84582678-026f-4a47-9801-aa71d7d12dbe tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:17:48.776689 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_api:SELECT=2 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:17:48.777065 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-84582678-026f-4a47-9801-aa71d7d12dbe tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:17:48.777953 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell1:SELECT=4 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:17:48.786987 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-6404e2a9-d031-4950-a35a-c8d0c83c5b3c req-eebc2719-b473-4d5f-af4c-8a67540d324f service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:17:48.787536 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-6404e2a9-d031-4950-a35a-c8d0c83c5b3c req-eebc2719-b473-4d5f-af4c-8a67540d324f service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:17:48.787989 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-6404e2a9-d031-4950-a35a-c8d0c83c5b3c req-eebc2719-b473-4d5f-af4c-8a67540d324f service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:17:48.799977 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-6404e2a9-d031-4950-a35a-c8d0c83c5b3c req-eebc2719-b473-4d5f-af4c-8a67540d324f service nova] Creating event network-changed:d6d63268-299e-4421-b482-69cbedf5e1c4 for instance 2e93f0d1-8d36-4917-8e63-5a86c424ae7d on nch1-master-1 Oct 22 22:17:48.805469 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-84582678-026f-4a47-9801-aa71d7d12dbe tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] [instance: 2e93f0d1-8d36-4917-8e63-5a86c424ae7d] Going to try to terminate instance {{(pid=138744) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 22:17:48.805706 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-6404e2a9-d031-4950-a35a-c8d0c83c5b3c req-eebc2719-b473-4d5f-af4c-8a67540d324f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040443 Oct 22 22:17:48.806291 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3491/6954] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 22:17:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 22:17:48.905349 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-84582678-026f-4a47-9801-aa71d7d12dbe tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] 10.222.0.18 "DELETE /compute/v2.1/servers/2e93f0d1-8d36-4917-8e63-5a86c424ae7d" status: 204 len: 0 microversion: 2.1 time: 0.142267 Oct 22 22:17:48.906581 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3464/6955] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 22:17:48 2022] DELETE /compute/v2.1/servers/2e93f0d1-8d36-4917-8e63-5a86c424ae7d => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 22:17:48.915618 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-7d033fec-6885-4b4f-8fab-30d2c85fb272 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:17:48.916600 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-7d033fec-6885-4b4f-8fab-30d2c85fb272 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] [instance: 2e93f0d1-8d36-4917-8e63-5a86c424ae7d] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:17:48.923733 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7d033fec-6885-4b4f-8fab-30d2c85fb272 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:17:48.924244 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7d033fec-6885-4b4f-8fab-30d2c85fb272 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:17:48.924700 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7d033fec-6885-4b4f-8fab-30d2c85fb272 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:17:48.925427 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7d033fec-6885-4b4f-8fab-30d2c85fb272 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:17:48.926096 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7d033fec-6885-4b4f-8fab-30d2c85fb272 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:17:48.926735 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7d033fec-6885-4b4f-8fab-30d2c85fb272 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:17:49.072653 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-7d033fec-6885-4b4f-8fab-30d2c85fb272 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3841796765145e1876ddee315b81bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2463781199104e15aea02b6280ceaacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:17:49.080840 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-7d033fec-6885-4b4f-8fab-30d2c85fb272 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] 10.222.0.18 "GET /compute/v2.1/servers/2e93f0d1-8d36-4917-8e63-5a86c424ae7d" status: 200 len: 1690 microversion: 2.1 time: 0.169492 Oct 22 22:17:49.081686 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3492/6956] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:17:48 2022] GET /compute/v2.1/servers/2e93f0d1-8d36-4917-8e63-5a86c424ae7d => generated 1690 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:17:50.107158 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-3c8393d7-4fd4-4181-8d69-157cc33e3f84 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:17:50.107996 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-3c8393d7-4fd4-4181-8d69-157cc33e3f84 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] [instance: 2e93f0d1-8d36-4917-8e63-5a86c424ae7d] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:17:50.115624 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3c8393d7-4fd4-4181-8d69-157cc33e3f84 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:17:50.116114 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3c8393d7-4fd4-4181-8d69-157cc33e3f84 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:17:50.116592 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3c8393d7-4fd4-4181-8d69-157cc33e3f84 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:17:50.117300 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3c8393d7-4fd4-4181-8d69-157cc33e3f84 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:17:50.117789 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3c8393d7-4fd4-4181-8d69-157cc33e3f84 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:17:50.118220 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3c8393d7-4fd4-4181-8d69-157cc33e3f84 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:17:50.257868 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-3c8393d7-4fd4-4181-8d69-157cc33e3f84 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3841796765145e1876ddee315b81bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2463781199104e15aea02b6280ceaacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:17:50.266493 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-3c8393d7-4fd4-4181-8d69-157cc33e3f84 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] 10.222.0.18 "GET /compute/v2.1/servers/2e93f0d1-8d36-4917-8e63-5a86c424ae7d" status: 200 len: 1690 microversion: 2.1 time: 0.163813 Oct 22 22:17:50.267145 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3465/6957] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:17:50 2022] GET /compute/v2.1/servers/2e93f0d1-8d36-4917-8e63-5a86c424ae7d => generated 1690 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:17:51.045677 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-0c1382aa-30e1-4696-a0f2-605ad6034341 req-22ea8625-051e-4774-8086-ffb66e2e2d8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e93f0d1-8d36-4917-8e63-5a86c424ae7d", "name": "network-vif-deleted", "tag": "d6d63268-299e-4421-b482-69cbedf5e1c4"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 22:17:51.056508 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-0c1382aa-30e1-4696-a0f2-605ad6034341 req-22ea8625-051e-4774-8086-ffb66e2e2d8a service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:17:51.057101 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-0c1382aa-30e1-4696-a0f2-605ad6034341 req-22ea8625-051e-4774-8086-ffb66e2e2d8a service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:17:51.057638 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-0c1382aa-30e1-4696-a0f2-605ad6034341 req-22ea8625-051e-4774-8086-ffb66e2e2d8a service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:17:51.070746 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-0c1382aa-30e1-4696-a0f2-605ad6034341 req-22ea8625-051e-4774-8086-ffb66e2e2d8a service nova] Creating event network-vif-deleted:d6d63268-299e-4421-b482-69cbedf5e1c4 for instance 2e93f0d1-8d36-4917-8e63-5a86c424ae7d on nch1-master-1 Oct 22 22:17:51.076210 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-0c1382aa-30e1-4696-a0f2-605ad6034341 req-22ea8625-051e-4774-8086-ffb66e2e2d8a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100595 Oct 22 22:17:51.076814 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3493/6958] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 22:17:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 22:17:51.290660 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-8d826824-f635-4b55-8345-68bc3b6db386 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:17:51.291289 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-8d826824-f635-4b55-8345-68bc3b6db386 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] [instance: 2e93f0d1-8d36-4917-8e63-5a86c424ae7d] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:17:51.298820 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8d826824-f635-4b55-8345-68bc3b6db386 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:17:51.299319 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8d826824-f635-4b55-8345-68bc3b6db386 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:17:51.299798 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8d826824-f635-4b55-8345-68bc3b6db386 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:17:51.300517 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8d826824-f635-4b55-8345-68bc3b6db386 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:17:51.300984 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8d826824-f635-4b55-8345-68bc3b6db386 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:17:51.301417 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8d826824-f635-4b55-8345-68bc3b6db386 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:17:51.335835 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8d826824-f635-4b55-8345-68bc3b6db386 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:17:51.336334 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8d826824-f635-4b55-8345-68bc3b6db386 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:17:51.336777 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8d826824-f635-4b55-8345-68bc3b6db386 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:17:51.337238 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.objects.instance [None req-8d826824-f635-4b55-8345-68bc3b6db386 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lazy-loading 'fault' on Instance uuid 2e93f0d1-8d36-4917-8e63-5a86c424ae7d {{(pid=138744) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 22:17:51.382591 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-8d826824-f635-4b55-8345-68bc3b6db386 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3841796765145e1876ddee315b81bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2463781199104e15aea02b6280ceaacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:17:51.391851 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-8d826824-f635-4b55-8345-68bc3b6db386 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] 10.222.0.18 "GET /compute/v2.1/servers/2e93f0d1-8d36-4917-8e63-5a86c424ae7d" status: 200 len: 1357 microversion: 2.1 time: 0.105203 Oct 22 22:17:51.392777 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3466/6959] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:17:51 2022] GET /compute/v2.1/servers/2e93f0d1-8d36-4917-8e63-5a86c424ae7d => generated 1357 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:17:52.424483 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-4eb99058-557c-4be9-a7b8-b4d5c7444bdc tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:17:52.425673 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-4eb99058-557c-4be9-a7b8-b4d5c7444bdc tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] [instance: 2e93f0d1-8d36-4917-8e63-5a86c424ae7d] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:17:52.435480 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4eb99058-557c-4be9-a7b8-b4d5c7444bdc tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:17:52.435982 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4eb99058-557c-4be9-a7b8-b4d5c7444bdc tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:17:52.436436 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4eb99058-557c-4be9-a7b8-b4d5c7444bdc tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:17:52.437148 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4eb99058-557c-4be9-a7b8-b4d5c7444bdc tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:17:52.437617 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4eb99058-557c-4be9-a7b8-b4d5c7444bdc tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:17:52.438064 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4eb99058-557c-4be9-a7b8-b4d5c7444bdc tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:17:52.452161 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.wsgi [None req-4eb99058-557c-4be9-a7b8-b4d5c7444bdc tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] HTTP exception thrown: Instance 2e93f0d1-8d36-4917-8e63-5a86c424ae7d could not be found. Oct 22 22:17:52.453835 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-4eb99058-557c-4be9-a7b8-b4d5c7444bdc tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Request method failure captured: Oct 22 22:17:52.453835 ncdv-master-1 devstack@n-api.service[138745]: request: GET /compute/v2.1/servers/2e93f0d1-8d36-4917-8e63-5a86c424ae7d HTTP/1.1 Oct 22 22:17:52.453835 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 22:17:52.453835 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 22:17:52.453835 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 22:17:52.453835 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 0 Oct 22 22:17:52.453835 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 22:17:52.453835 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 22:17:52.453835 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 22:17:52.453835 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 22:17:52.453835 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVGn7_hWur8olMNvqY1ci34dTO2aMHkwF2Arh7Vhu0pKEfAIdjPeIgFR3M850xL8FpTR9mXeTguII0a2O-HdxsJf8qZBcfSziKEpwyhdPF7DkzW4kQj6-KDf_OfkhNJyBC-6JgZCrm8JmrvBF_CtA7k23ekrHWftWnFXpuRzAvhnMWRA Oct 22 22:17:52.453835 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 22:17:52.453835 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 22:17:52.453835 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 22:17:52.453835 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 22:17:52.453835 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 22:17:52.453835 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 22:17:52.453835 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: 2463781199104e15aea02b6280ceaacf Oct 22 22:17:52.453835 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-703320975 Oct 22 22:17:52.453835 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 22:17:52.453835 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 22:17:52.453835 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_2463781199104e15aea02b6280ceaacf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2463781199104e15aea02b6280ceaacf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/2463781199104e15aea02b6280ceaacf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2463781199104e15aea02b6280ceaacf"}]}] Oct 22 22:17:52.453835 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-TestNetworkAdvancedServerOps-703320975 Oct 22 22:17:52.453835 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: 2463781199104e15aea02b6280ceaacf Oct 22 22:17:52.453835 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-703320975 Oct 22 22:17:52.453835 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-TestNetworkAdvancedServerOps-703320975-project Oct 22 22:17:52.453835 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 22:17:52.453835 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 22:17:52.453835 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: e3841796765145e1876ddee315b81bea Oct 22 22:17:52.453835 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-TestNetworkAdvancedServerOps-703320975-project Oct 22 22:17:52.453835 ncdv-master-1 devstack@n-api.service[138745]: method: > Oct 22 22:17:52.453835 ncdv-master-1 devstack@n-api.service[138745]: exception: Instance 2e93f0d1-8d36-4917-8e63-5a86c424ae7d could not be found. Oct 22 22:17:52.453835 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'id': '2e93f0d1-8d36-4917-8e63-5a86c424ae7d'} Oct 22 22:17:52.453835 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 22:17:52.453835 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 22:17:52.453835 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 22:17:52.453835 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 22:17:52.453835 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 22:17:52.453835 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 22:17:52.453835 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 22:17:52.453835 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 22:17:52.453835 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 22:17:52.453835 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 22:17:52.453835 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e93f0d1-8d36-4917-8e63-5a86c424ae7d could not be found. Oct 22 22:17:52.453835 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 22:17:52.453835 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 22:17:52.453835 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 22:17:52.453835 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 22:17:52.453835 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 22:17:52.453835 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 22:17:52.453835 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 22:17:52.453835 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 22:17:52.453835 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 22:17:52.453835 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 22:17:52.453835 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 22:17:52.453835 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 22:17:52.453835 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 22:17:52.453835 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 22:17:52.453835 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 22:17:52.453835 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 22:17:52.453835 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e93f0d1-8d36-4917-8e63-5a86c424ae7d could not be found. Oct 22 22:17:52.453835 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 22:17:52.453835 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 22:17:52.460167 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 22:17:52.460167 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 22:17:52.460167 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 22:17:52.460167 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 22:17:52.460167 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 22:17:52.460167 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 22:17:52.460167 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e93f0d1-8d36-4917-8e63-5a86c424ae7d could not be found. Oct 22 22:17:52.460167 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 22:17:52.460167 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-4eb99058-557c-4be9-a7b8-b4d5c7444bdc tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Returning 404 to user: Instance 2e93f0d1-8d36-4917-8e63-5a86c424ae7d could not be found. {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 22:17:52.460167 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-4eb99058-557c-4be9-a7b8-b4d5c7444bdc tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] 10.222.0.18 "GET /compute/v2.1/servers/2e93f0d1-8d36-4917-8e63-5a86c424ae7d" status: 404 len: 111 microversion: 2.1 time: 0.039881 Oct 22 22:17:52.460167 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3494/6960] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:17:52 2022] GET /compute/v2.1/servers/2e93f0d1-8d36-4917-8e63-5a86c424ae7d => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 22:17:55.860256 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-f2c80ab4-bdca-45dc-8155-0058c0b0ed05 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Calling method '.version_select at 0x7fd39ec14550>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:17:55.884572 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-f2c80ab4-bdca-45dc-8155-0058c0b0ed05 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1711707143" status: 202 len: 0 microversion: 2.1 time: 0.028255 Oct 22 22:17:55.885193 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3467/6961] 10.222.0.18 () {58 vars in 1284 bytes} [Sat Oct 22 22:17:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1711707143 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 22:17:55.919381 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-5403bda4-04b7-4353-9933-da16646eefef tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Action: 'create', calling method: .version_select at 0x7fd3a47868b0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-313580921", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA0dUhV6D0qJuFwVWQX7EWFkTm/5v8S5/hxCB32wZSH28F58p4lgjDxKtXGxQnkywF5Y5yzxL0lEIRa02ukF0Ocbzk9aeMn1glefD8r2AgWKyo78O58wJW4cY3JFoL2jRQ=="}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 22:17:55.951812 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-5403bda4-04b7-4353-9933-da16646eefef tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Getting quotas for project 2463781199104e15aea02b6280ceaacf. Resources: {'key_pairs'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 22:17:55.958610 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-5403bda4-04b7-4353-9933-da16646eefef tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Getting quotas for user e3841796765145e1876ddee315b81bea and project 2463781199104e15aea02b6280ceaacf. Resources: {'key_pairs'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 22:17:55.986083 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-5403bda4-04b7-4353-9933-da16646eefef tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.070886 Oct 22 22:17:55.986696 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3495/6962] 10.222.0.18 () {60 vars in 1159 bytes} [Sat Oct 22 22:17:55 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 22:18:01.235641 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-afce74a4-a20d-4e46-96df-64003f211015 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-41979346", "imageRef": "085e4478-6edc-4a69-8e08-f9831713eb65", "flavorRef": "452", "networks": [{"uuid": "552450ec-fc12-41b9-8889-60b899f9b0d1"}], "key_name": "tempest-TestNetworkAdvancedServerOps-313580921", "security_groups": [{"name": "tempest-secgroup-smoke-781065551"}]}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 22:18:01.376283 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.network.neutron [None req-afce74a4-a20d-4e46-96df-64003f211015 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] validate_networks() for [('552450ec-fc12-41b9-8889-60b899f9b0d1', None, None, None, None, None)] {{(pid=138744) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 22:18:01.388026 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:18:01.778773 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-afce74a4-a20d-4e46-96df-64003f211015 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Flavor limits 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 22:18:01.779206 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-afce74a4-a20d-4e46-96df-64003f211015 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Image limits 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 22:18:01.779719 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-afce74a4-a20d-4e46-96df-64003f211015 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Flavor pref 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 22:18:01.780627 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-afce74a4-a20d-4e46-96df-64003f211015 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Image pref 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 22:18:01.781051 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-afce74a4-a20d-4e46-96df-64003f211015 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 22:18:01.793149 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-afce74a4-a20d-4e46-96df-64003f211015 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:18:01.793659 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-afce74a4-a20d-4e46-96df-64003f211015 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:18:01.794306 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-afce74a4-a20d-4e46-96df-64003f211015 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:18:01.795254 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-afce74a4-a20d-4e46-96df-64003f211015 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:18:01.796288 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-afce74a4-a20d-4e46-96df-64003f211015 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:18:01.796431 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-afce74a4-a20d-4e46-96df-64003f211015 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:18:01.822825 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-afce74a4-a20d-4e46-96df-64003f211015 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Getting quotas for project 2463781199104e15aea02b6280ceaacf. Resources: {'cores', 'instances', 'ram'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 22:18:01.834268 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-afce74a4-a20d-4e46-96df-64003f211015 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Getting quotas for user e3841796765145e1876ddee315b81bea and project 2463781199104e15aea02b6280ceaacf. Resources: {'cores', 'instances', 'ram'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 22:18:01.859197 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-afce74a4-a20d-4e46-96df-64003f211015 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Going to run 1 instances... {{(pid=138744) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 22:18:01.863090 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-afce74a4-a20d-4e46-96df-64003f211015 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] [instance: 104c88a4-4885-465b-961c-5e26c3a42f97] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='085e4478-6edc-4a69-8e08-f9831713eb65',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138744) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 22:18:01.916259 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-afce74a4-a20d-4e46-96df-64003f211015 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.684458 Oct 22 22:18:01.923050 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3468/6963] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Oct 22 22:18:01 2022] POST /compute/v2.1/servers => generated 405 bytes in 686 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 22:18:01.930306 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-21520531-bcaa-40e4-8976-53d5588f0bf1 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:18:01.931047 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-21520531-bcaa-40e4-8976-53d5588f0bf1 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] [instance: 104c88a4-4885-465b-961c-5e26c3a42f97] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:18:02.018355 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-21520531-bcaa-40e4-8976-53d5588f0bf1 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3841796765145e1876ddee315b81bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2463781199104e15aea02b6280ceaacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:18:02.039630 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-21520531-bcaa-40e4-8976-53d5588f0bf1 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] 10.222.0.18 "GET /compute/v2.1/servers/104c88a4-4885-465b-961c-5e26c3a42f97" status: 200 len: 1264 microversion: 2.1 time: 0.114562 Oct 22 22:18:02.040231 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3496/6964] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:18:01 2022] GET /compute/v2.1/servers/104c88a4-4885-465b-961c-5e26c3a42f97 => generated 1264 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:18:03.063945 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-b02ce8f8-f66b-406e-a742-fb0c45914b80 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:18:03.064706 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-b02ce8f8-f66b-406e-a742-fb0c45914b80 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] [instance: 104c88a4-4885-465b-961c-5e26c3a42f97] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:18:03.073340 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b02ce8f8-f66b-406e-a742-fb0c45914b80 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:18:03.074334 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b02ce8f8-f66b-406e-a742-fb0c45914b80 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:18:03.075153 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b02ce8f8-f66b-406e-a742-fb0c45914b80 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:18:03.076071 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b02ce8f8-f66b-406e-a742-fb0c45914b80 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:18:03.076701 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b02ce8f8-f66b-406e-a742-fb0c45914b80 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:18:03.077308 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b02ce8f8-f66b-406e-a742-fb0c45914b80 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:18:03.157042 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-b02ce8f8-f66b-406e-a742-fb0c45914b80 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3841796765145e1876ddee315b81bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2463781199104e15aea02b6280ceaacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:18:03.168831 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-b02ce8f8-f66b-406e-a742-fb0c45914b80 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] 10.222.0.18 "GET /compute/v2.1/servers/104c88a4-4885-465b-961c-5e26c3a42f97" status: 200 len: 1324 microversion: 2.1 time: 0.108416 Oct 22 22:18:03.170202 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3469/6965] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:18:03 2022] GET /compute/v2.1/servers/104c88a4-4885-465b-961c-5e26c3a42f97 => generated 1324 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:18:04.192516 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-21585695-e4ed-46ee-aba5-de1660caf616 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:18:04.193354 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-21585695-e4ed-46ee-aba5-de1660caf616 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] [instance: 104c88a4-4885-465b-961c-5e26c3a42f97] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:18:04.195590 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell1:SELECT=12 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:18:04.210266 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-21585695-e4ed-46ee-aba5-de1660caf616 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:18:04.211614 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-21585695-e4ed-46ee-aba5-de1660caf616 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:18:04.212598 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-21585695-e4ed-46ee-aba5-de1660caf616 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:18:04.213401 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-21585695-e4ed-46ee-aba5-de1660caf616 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:18:04.215406 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-21585695-e4ed-46ee-aba5-de1660caf616 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:18:04.218098 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-21585695-e4ed-46ee-aba5-de1660caf616 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:18:04.411241 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-21585695-e4ed-46ee-aba5-de1660caf616 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3841796765145e1876ddee315b81bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2463781199104e15aea02b6280ceaacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:18:04.429087 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-21585695-e4ed-46ee-aba5-de1660caf616 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] 10.222.0.18 "GET /compute/v2.1/servers/104c88a4-4885-465b-961c-5e26c3a42f97" status: 200 len: 1389 microversion: 2.1 time: 0.240477 Oct 22 22:18:04.444793 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3497/6966] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:18:04 2022] GET /compute/v2.1/servers/104c88a4-4885-465b-961c-5e26c3a42f97 => generated 1389 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:18:04.914181 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-540e9832-959c-4472-812f-ae0d9fdf2a13 req-49ee30a3-dd07-43d0-b5b9-c06bdcdd6a69 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "104c88a4-4885-465b-961c-5e26c3a42f97", "tag": "fbda4939-173d-4e7c-a701-7e49f4670cdd"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 22:18:04.929347 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-540e9832-959c-4472-812f-ae0d9fdf2a13 req-49ee30a3-dd07-43d0-b5b9-c06bdcdd6a69 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:18:04.929837 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-540e9832-959c-4472-812f-ae0d9fdf2a13 req-49ee30a3-dd07-43d0-b5b9-c06bdcdd6a69 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:18:04.930279 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-540e9832-959c-4472-812f-ae0d9fdf2a13 req-49ee30a3-dd07-43d0-b5b9-c06bdcdd6a69 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:18:04.943671 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-540e9832-959c-4472-812f-ae0d9fdf2a13 req-49ee30a3-dd07-43d0-b5b9-c06bdcdd6a69 service nova] Creating event network-changed:fbda4939-173d-4e7c-a701-7e49f4670cdd for instance 104c88a4-4885-465b-961c-5e26c3a42f97 on nch1-master-1 Oct 22 22:18:04.948685 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-540e9832-959c-4472-812f-ae0d9fdf2a13 req-49ee30a3-dd07-43d0-b5b9-c06bdcdd6a69 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039562 Oct 22 22:18:04.949407 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3470/6967] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 22:18:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 22:18:05.452981 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-2630c580-180b-4b3d-b1ec-d1acca3bac23 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:18:05.453615 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-2630c580-180b-4b3d-b1ec-d1acca3bac23 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] [instance: 104c88a4-4885-465b-961c-5e26c3a42f97] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:18:05.461892 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2630c580-180b-4b3d-b1ec-d1acca3bac23 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:18:05.462625 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2630c580-180b-4b3d-b1ec-d1acca3bac23 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:18:05.463388 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2630c580-180b-4b3d-b1ec-d1acca3bac23 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:18:05.464488 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2630c580-180b-4b3d-b1ec-d1acca3bac23 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:18:05.465399 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2630c580-180b-4b3d-b1ec-d1acca3bac23 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:18:05.465913 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2630c580-180b-4b3d-b1ec-d1acca3bac23 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:18:05.603329 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-2630c580-180b-4b3d-b1ec-d1acca3bac23 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3841796765145e1876ddee315b81bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2463781199104e15aea02b6280ceaacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:18:05.611476 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-2630c580-180b-4b3d-b1ec-d1acca3bac23 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] 10.222.0.18 "GET /compute/v2.1/servers/104c88a4-4885-465b-961c-5e26c3a42f97" status: 200 len: 1389 microversion: 2.1 time: 0.162572 Oct 22 22:18:05.612073 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3498/6968] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:18:05 2022] GET /compute/v2.1/servers/104c88a4-4885-465b-961c-5e26c3a42f97 => generated 1389 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:18:06.641475 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-f769f470-ef4f-4c76-91ca-5e32426e484e tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:18:06.642485 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-f769f470-ef4f-4c76-91ca-5e32426e484e tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] [instance: 104c88a4-4885-465b-961c-5e26c3a42f97] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:18:06.653180 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f769f470-ef4f-4c76-91ca-5e32426e484e tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:18:06.653735 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f769f470-ef4f-4c76-91ca-5e32426e484e tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:18:06.654455 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f769f470-ef4f-4c76-91ca-5e32426e484e tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:18:06.654865 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f769f470-ef4f-4c76-91ca-5e32426e484e tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:18:06.655371 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f769f470-ef4f-4c76-91ca-5e32426e484e tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:18:06.655800 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f769f470-ef4f-4c76-91ca-5e32426e484e tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:18:06.791229 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-f769f470-ef4f-4c76-91ca-5e32426e484e tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3841796765145e1876ddee315b81bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2463781199104e15aea02b6280ceaacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:18:06.804310 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-f769f470-ef4f-4c76-91ca-5e32426e484e tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] 10.222.0.18 "GET /compute/v2.1/servers/104c88a4-4885-465b-961c-5e26c3a42f97" status: 200 len: 1389 microversion: 2.1 time: 0.171398 Oct 22 22:18:06.805067 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3471/6969] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:18:06 2022] GET /compute/v2.1/servers/104c88a4-4885-465b-961c-5e26c3a42f97 => generated 1389 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:18:07.829182 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-e21dcaa3-c479-4d87-8e80-246abc9876ba tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:18:07.829830 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-e21dcaa3-c479-4d87-8e80-246abc9876ba tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] [instance: 104c88a4-4885-465b-961c-5e26c3a42f97] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:18:07.837378 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e21dcaa3-c479-4d87-8e80-246abc9876ba tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:18:07.837971 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e21dcaa3-c479-4d87-8e80-246abc9876ba tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:18:07.838491 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e21dcaa3-c479-4d87-8e80-246abc9876ba tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:18:07.839296 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e21dcaa3-c479-4d87-8e80-246abc9876ba tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:18:07.839992 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e21dcaa3-c479-4d87-8e80-246abc9876ba tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:18:07.840849 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e21dcaa3-c479-4d87-8e80-246abc9876ba tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:18:07.974871 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-e21dcaa3-c479-4d87-8e80-246abc9876ba tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3841796765145e1876ddee315b81bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2463781199104e15aea02b6280ceaacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:18:07.983240 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-e21dcaa3-c479-4d87-8e80-246abc9876ba tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] 10.222.0.18 "GET /compute/v2.1/servers/104c88a4-4885-465b-961c-5e26c3a42f97" status: 200 len: 1389 microversion: 2.1 time: 0.158217 Oct 22 22:18:07.983869 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3499/6970] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:18:07 2022] GET /compute/v2.1/servers/104c88a4-4885-465b-961c-5e26c3a42f97 => generated 1389 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:18:09.006794 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-e796b5a8-c7a7-4aea-a6b9-016e8ef3a6e0 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:18:09.007538 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-e796b5a8-c7a7-4aea-a6b9-016e8ef3a6e0 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] [instance: 104c88a4-4885-465b-961c-5e26c3a42f97] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:18:09.015632 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e796b5a8-c7a7-4aea-a6b9-016e8ef3a6e0 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:18:09.016141 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e796b5a8-c7a7-4aea-a6b9-016e8ef3a6e0 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:18:09.016593 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e796b5a8-c7a7-4aea-a6b9-016e8ef3a6e0 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:18:09.017336 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e796b5a8-c7a7-4aea-a6b9-016e8ef3a6e0 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:18:09.017804 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e796b5a8-c7a7-4aea-a6b9-016e8ef3a6e0 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:18:09.018492 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e796b5a8-c7a7-4aea-a6b9-016e8ef3a6e0 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:18:09.168270 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-e796b5a8-c7a7-4aea-a6b9-016e8ef3a6e0 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3841796765145e1876ddee315b81bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2463781199104e15aea02b6280ceaacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:18:09.176362 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-e796b5a8-c7a7-4aea-a6b9-016e8ef3a6e0 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] 10.222.0.18 "GET /compute/v2.1/servers/104c88a4-4885-465b-961c-5e26c3a42f97" status: 200 len: 1389 microversion: 2.1 time: 0.173801 Oct 22 22:18:09.176960 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3472/6971] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:18:09 2022] GET /compute/v2.1/servers/104c88a4-4885-465b-961c-5e26c3a42f97 => generated 1389 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:18:10.201963 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-062f0d12-48e0-4baf-8968-a5cb86918c36 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:18:10.202574 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-062f0d12-48e0-4baf-8968-a5cb86918c36 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] [instance: 104c88a4-4885-465b-961c-5e26c3a42f97] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:18:10.210147 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-062f0d12-48e0-4baf-8968-a5cb86918c36 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:18:10.210706 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-062f0d12-48e0-4baf-8968-a5cb86918c36 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:18:10.211221 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-062f0d12-48e0-4baf-8968-a5cb86918c36 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:18:10.212079 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-062f0d12-48e0-4baf-8968-a5cb86918c36 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:18:10.212556 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-062f0d12-48e0-4baf-8968-a5cb86918c36 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:18:10.213110 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-062f0d12-48e0-4baf-8968-a5cb86918c36 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:18:10.349620 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-062f0d12-48e0-4baf-8968-a5cb86918c36 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3841796765145e1876ddee315b81bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2463781199104e15aea02b6280ceaacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:18:10.359001 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-062f0d12-48e0-4baf-8968-a5cb86918c36 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] 10.222.0.18 "GET /compute/v2.1/servers/104c88a4-4885-465b-961c-5e26c3a42f97" status: 200 len: 1389 microversion: 2.1 time: 0.162001 Oct 22 22:18:10.359653 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3500/6972] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:18:10 2022] GET /compute/v2.1/servers/104c88a4-4885-465b-961c-5e26c3a42f97 => generated 1389 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:18:10.936788 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-dc8eaef0-a69b-4e1b-9290-8baca1a67137 req-fbd2940c-c50f-4f0f-833a-8dc9fe2d2b39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "104c88a4-4885-465b-961c-5e26c3a42f97", "name": "network-vif-plugged", "status": "completed", "tag": "fbda4939-173d-4e7c-a701-7e49f4670cdd"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 22:18:10.947331 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-dc8eaef0-a69b-4e1b-9290-8baca1a67137 req-fbd2940c-c50f-4f0f-833a-8dc9fe2d2b39 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:18:10.948062 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-dc8eaef0-a69b-4e1b-9290-8baca1a67137 req-fbd2940c-c50f-4f0f-833a-8dc9fe2d2b39 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:18:10.948609 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-dc8eaef0-a69b-4e1b-9290-8baca1a67137 req-fbd2940c-c50f-4f0f-833a-8dc9fe2d2b39 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:18:10.961694 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-dc8eaef0-a69b-4e1b-9290-8baca1a67137 req-fbd2940c-c50f-4f0f-833a-8dc9fe2d2b39 service nova] Creating event network-vif-plugged:fbda4939-173d-4e7c-a701-7e49f4670cdd for instance 104c88a4-4885-465b-961c-5e26c3a42f97 on nch1-master-1 Oct 22 22:18:10.967253 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-dc8eaef0-a69b-4e1b-9290-8baca1a67137 req-fbd2940c-c50f-4f0f-833a-8dc9fe2d2b39 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035554 Oct 22 22:18:10.967905 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3473/6973] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 22:18:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 22:18:11.383889 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-4b97da10-b911-419e-8312-987c402a2136 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:18:11.384497 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-4b97da10-b911-419e-8312-987c402a2136 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] [instance: 104c88a4-4885-465b-961c-5e26c3a42f97] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:18:11.392043 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4b97da10-b911-419e-8312-987c402a2136 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:18:11.392598 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4b97da10-b911-419e-8312-987c402a2136 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:18:11.393134 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4b97da10-b911-419e-8312-987c402a2136 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:18:11.393935 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4b97da10-b911-419e-8312-987c402a2136 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:18:11.394462 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4b97da10-b911-419e-8312-987c402a2136 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:18:11.394953 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4b97da10-b911-419e-8312-987c402a2136 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:18:11.891169 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-4b97da10-b911-419e-8312-987c402a2136 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3841796765145e1876ddee315b81bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2463781199104e15aea02b6280ceaacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:18:11.899671 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-4b97da10-b911-419e-8312-987c402a2136 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] 10.222.0.18 "GET /compute/v2.1/servers/104c88a4-4885-465b-961c-5e26c3a42f97" status: 200 len: 1389 microversion: 2.1 time: 0.520338 Oct 22 22:18:11.900292 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3501/6974] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:18:11 2022] GET /compute/v2.1/servers/104c88a4-4885-465b-961c-5e26c3a42f97 => generated 1389 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:18:12.922138 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell0:SELECT=2 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:18:12.924135 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell0:SELECT=6 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:18:12.931302 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-fe0f8d9e-add8-4c8c-94f3-7eb9749e8a6f tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:18:12.932357 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-fe0f8d9e-add8-4c8c-94f3-7eb9749e8a6f tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] [instance: 104c88a4-4885-465b-961c-5e26c3a42f97] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:18:12.940299 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fe0f8d9e-add8-4c8c-94f3-7eb9749e8a6f tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:18:12.940781 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fe0f8d9e-add8-4c8c-94f3-7eb9749e8a6f tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:18:12.941223 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fe0f8d9e-add8-4c8c-94f3-7eb9749e8a6f tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:18:12.941913 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fe0f8d9e-add8-4c8c-94f3-7eb9749e8a6f tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:18:12.942371 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fe0f8d9e-add8-4c8c-94f3-7eb9749e8a6f tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:18:12.942802 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fe0f8d9e-add8-4c8c-94f3-7eb9749e8a6f tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:18:13.074389 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-fe0f8d9e-add8-4c8c-94f3-7eb9749e8a6f tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3841796765145e1876ddee315b81bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2463781199104e15aea02b6280ceaacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:18:13.082488 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-fe0f8d9e-add8-4c8c-94f3-7eb9749e8a6f tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] 10.222.0.18 "GET /compute/v2.1/servers/104c88a4-4885-465b-961c-5e26c3a42f97" status: 200 len: 1562 microversion: 2.1 time: 0.161884 Oct 22 22:18:13.083070 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3474/6975] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:18:12 2022] GET /compute/v2.1/servers/104c88a4-4885-465b-961c-5e26c3a42f97 => generated 1562 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:18:13.104915 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-f86f5980-8c20-480f-8a99-8bed29cf3355 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:18:13.105543 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-f86f5980-8c20-480f-8a99-8bed29cf3355 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] [instance: 104c88a4-4885-465b-961c-5e26c3a42f97] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:18:13.107761 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell0:SELECT=6 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:18:13.114270 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f86f5980-8c20-480f-8a99-8bed29cf3355 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:18:13.114777 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f86f5980-8c20-480f-8a99-8bed29cf3355 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:18:13.115234 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f86f5980-8c20-480f-8a99-8bed29cf3355 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:18:13.115980 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f86f5980-8c20-480f-8a99-8bed29cf3355 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:18:13.116458 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f86f5980-8c20-480f-8a99-8bed29cf3355 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:18:13.116904 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f86f5980-8c20-480f-8a99-8bed29cf3355 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:18:13.260122 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-f86f5980-8c20-480f-8a99-8bed29cf3355 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3841796765145e1876ddee315b81bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2463781199104e15aea02b6280ceaacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:18:13.268552 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-f86f5980-8c20-480f-8a99-8bed29cf3355 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] 10.222.0.18 "GET /compute/v2.1/servers/104c88a4-4885-465b-961c-5e26c3a42f97" status: 200 len: 1562 microversion: 2.1 time: 0.167706 Oct 22 22:18:13.269162 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3502/6976] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:18:13 2022] GET /compute/v2.1/servers/104c88a4-4885-465b-961c-5e26c3a42f97 => generated 1562 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:18:14.882475 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-3267d964-e639-4944-a29a-5cf5cd182b4a req-3da80a14-53fb-4134-9c66-ed386de0f122 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "104c88a4-4885-465b-961c-5e26c3a42f97", "tag": "fbda4939-173d-4e7c-a701-7e49f4670cdd"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 22:18:14.890148 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-cb41a5ad-8de5-4322-b513-6c34eeee6d4b tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:18:14.890795 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-cb41a5ad-8de5-4322-b513-6c34eeee6d4b tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] [instance: 104c88a4-4885-465b-961c-5e26c3a42f97] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:18:14.898751 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cb41a5ad-8de5-4322-b513-6c34eeee6d4b tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:18:14.899564 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cb41a5ad-8de5-4322-b513-6c34eeee6d4b tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:18:14.900217 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cb41a5ad-8de5-4322-b513-6c34eeee6d4b tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:18:14.900635 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-3267d964-e639-4944-a29a-5cf5cd182b4a req-3da80a14-53fb-4134-9c66-ed386de0f122 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:18:14.901128 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-3267d964-e639-4944-a29a-5cf5cd182b4a req-3da80a14-53fb-4134-9c66-ed386de0f122 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:18:14.901275 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cb41a5ad-8de5-4322-b513-6c34eeee6d4b tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:18:14.901612 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cb41a5ad-8de5-4322-b513-6c34eeee6d4b tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:18:14.901873 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-3267d964-e639-4944-a29a-5cf5cd182b4a req-3da80a14-53fb-4134-9c66-ed386de0f122 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:18:14.902082 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cb41a5ad-8de5-4322-b513-6c34eeee6d4b tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:18:14.914175 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-3267d964-e639-4944-a29a-5cf5cd182b4a req-3da80a14-53fb-4134-9c66-ed386de0f122 service nova] Creating event network-changed:fbda4939-173d-4e7c-a701-7e49f4670cdd for instance 104c88a4-4885-465b-961c-5e26c3a42f97 on nch1-master-1 Oct 22 22:18:14.920114 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-3267d964-e639-4944-a29a-5cf5cd182b4a req-3da80a14-53fb-4134-9c66-ed386de0f122 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041214 Oct 22 22:18:14.921141 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3503/6977] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 22:18:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 22:18:15.051790 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-cb41a5ad-8de5-4322-b513-6c34eeee6d4b tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3841796765145e1876ddee315b81bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2463781199104e15aea02b6280ceaacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:18:15.060709 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-cb41a5ad-8de5-4322-b513-6c34eeee6d4b tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] 10.222.0.18 "GET /compute/v2.1/servers/104c88a4-4885-465b-961c-5e26c3a42f97" status: 200 len: 1562 microversion: 2.1 time: 0.184935 Oct 22 22:18:15.061630 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3475/6978] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:18:14 2022] GET /compute/v2.1/servers/104c88a4-4885-465b-961c-5e26c3a42f97 => generated 1562 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:18:48.446790 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-efac0d7d-e402-4829-b333-aa7810c796f8 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 22:18:48.449195 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-efac0d7d-e402-4829-b333-aa7810c796f8 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] [instance: 104c88a4-4885-465b-961c-5e26c3a42f97] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:18:48.452400 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=1 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:18:48.453065 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell1:SELECT=38 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:18:48.459368 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-efac0d7d-e402-4829-b333-aa7810c796f8 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:18:48.459891 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-efac0d7d-e402-4829-b333-aa7810c796f8 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:18:48.460339 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-efac0d7d-e402-4829-b333-aa7810c796f8 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:18:48.461051 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-efac0d7d-e402-4829-b333-aa7810c796f8 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:18:48.461515 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-efac0d7d-e402-4829-b333-aa7810c796f8 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:18:48.461957 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-efac0d7d-e402-4829-b333-aa7810c796f8 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:18:48.520632 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-efac0d7d-e402-4829-b333-aa7810c796f8 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] 10.222.0.18 "POST /compute/v2.1/servers/104c88a4-4885-465b-961c-5e26c3a42f97/action" status: 200 len: 24570 microversion: 2.1 time: 0.077918 Oct 22 22:18:48.521219 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3504/6979] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 22:18:48 2022] POST /compute/v2.1/servers/104c88a4-4885-465b-961c-5e26c3a42f97/action => generated 24570 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 22 22:19:18.920217 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:19:18.920979 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:SELECT=36 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:19:18.925241 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-3bd7714b-db11-42f2-bf6c-1a2c10e71981 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 22:19:18.925811 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-3bd7714b-db11-42f2-bf6c-1a2c10e71981 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] [instance: 104c88a4-4885-465b-961c-5e26c3a42f97] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:19:18.933467 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3bd7714b-db11-42f2-bf6c-1a2c10e71981 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:19:18.933944 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3bd7714b-db11-42f2-bf6c-1a2c10e71981 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:19:18.934386 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3bd7714b-db11-42f2-bf6c-1a2c10e71981 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:19:18.935105 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3bd7714b-db11-42f2-bf6c-1a2c10e71981 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:19:18.935588 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3bd7714b-db11-42f2-bf6c-1a2c10e71981 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:19:18.936026 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3bd7714b-db11-42f2-bf6c-1a2c10e71981 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:19:18.961773 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.objects.instance [None req-3bd7714b-db11-42f2-bf6c-1a2c10e71981 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lazy-loading 'flavor' on Instance uuid 104c88a4-4885-465b-961c-5e26c3a42f97 {{(pid=138744) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 22:19:19.048574 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-3bd7714b-db11-42f2-bf6c-1a2c10e71981 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] 10.222.0.18 "POST /compute/v2.1/servers/104c88a4-4885-465b-961c-5e26c3a42f97/action" status: 202 len: 0 microversion: 2.1 time: 0.129653 Oct 22 22:19:19.049419 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3476/6980] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 22:19:18 2022] POST /compute/v2.1/servers/104c88a4-4885-465b-961c-5e26c3a42f97/action => generated 0 bytes in 132 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 22:19:19.059151 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-a30867a8-3eaa-4d3a-93b2-3bd0f8092fdc tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:19:19.060798 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-a30867a8-3eaa-4d3a-93b2-3bd0f8092fdc tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] [instance: 104c88a4-4885-465b-961c-5e26c3a42f97] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:19:19.062625 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_api:SELECT=2 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:19:19.063409 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell1:SELECT=4 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:19:19.069520 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a30867a8-3eaa-4d3a-93b2-3bd0f8092fdc tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:19:19.070097 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a30867a8-3eaa-4d3a-93b2-3bd0f8092fdc tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:19:19.070597 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a30867a8-3eaa-4d3a-93b2-3bd0f8092fdc tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:19:19.074619 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a30867a8-3eaa-4d3a-93b2-3bd0f8092fdc tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:19:19.075134 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a30867a8-3eaa-4d3a-93b2-3bd0f8092fdc tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:19:19.075626 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a30867a8-3eaa-4d3a-93b2-3bd0f8092fdc tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:19:19.240358 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-a30867a8-3eaa-4d3a-93b2-3bd0f8092fdc tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3841796765145e1876ddee315b81bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2463781199104e15aea02b6280ceaacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:19:19.249219 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-a30867a8-3eaa-4d3a-93b2-3bd0f8092fdc tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] 10.222.0.18 "GET /compute/v2.1/servers/104c88a4-4885-465b-961c-5e26c3a42f97" status: 200 len: 1689 microversion: 2.1 time: 0.195028 Oct 22 22:19:19.249804 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3505/6981] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:19:19 2022] GET /compute/v2.1/servers/104c88a4-4885-465b-961c-5e26c3a42f97 => generated 1689 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 22:19:20.274265 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-64a1f4e3-a5ea-4148-a8d5-784a31e83d9a tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:19:20.274926 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-64a1f4e3-a5ea-4148-a8d5-784a31e83d9a tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] [instance: 104c88a4-4885-465b-961c-5e26c3a42f97] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:19:20.283112 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-64a1f4e3-a5ea-4148-a8d5-784a31e83d9a tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:19:20.283622 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-64a1f4e3-a5ea-4148-a8d5-784a31e83d9a tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:19:20.284064 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-64a1f4e3-a5ea-4148-a8d5-784a31e83d9a tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:19:20.284784 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-64a1f4e3-a5ea-4148-a8d5-784a31e83d9a tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:19:20.285235 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-64a1f4e3-a5ea-4148-a8d5-784a31e83d9a tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:19:20.285661 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-64a1f4e3-a5ea-4148-a8d5-784a31e83d9a tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:19:20.426579 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-64a1f4e3-a5ea-4148-a8d5-784a31e83d9a tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3841796765145e1876ddee315b81bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2463781199104e15aea02b6280ceaacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:19:20.434567 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-64a1f4e3-a5ea-4148-a8d5-784a31e83d9a tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] 10.222.0.18 "GET /compute/v2.1/servers/104c88a4-4885-465b-961c-5e26c3a42f97" status: 200 len: 1689 microversion: 2.1 time: 0.164876 Oct 22 22:19:20.435165 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3477/6982] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:19:20 2022] GET /compute/v2.1/servers/104c88a4-4885-465b-961c-5e26c3a42f97 => generated 1689 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:19:21.470630 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-a4a62de2-1a10-43f8-9141-e70b86ab4150 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:19:21.471691 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-a4a62de2-1a10-43f8-9141-e70b86ab4150 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] [instance: 104c88a4-4885-465b-961c-5e26c3a42f97] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:19:21.483276 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a4a62de2-1a10-43f8-9141-e70b86ab4150 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:19:21.483818 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a4a62de2-1a10-43f8-9141-e70b86ab4150 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:19:21.484281 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a4a62de2-1a10-43f8-9141-e70b86ab4150 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:19:21.485007 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a4a62de2-1a10-43f8-9141-e70b86ab4150 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:19:21.485484 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a4a62de2-1a10-43f8-9141-e70b86ab4150 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:19:21.485957 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a4a62de2-1a10-43f8-9141-e70b86ab4150 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:19:21.634830 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-a4a62de2-1a10-43f8-9141-e70b86ab4150 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3841796765145e1876ddee315b81bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2463781199104e15aea02b6280ceaacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:19:21.644310 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-a4a62de2-1a10-43f8-9141-e70b86ab4150 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] 10.222.0.18 "GET /compute/v2.1/servers/104c88a4-4885-465b-961c-5e26c3a42f97" status: 200 len: 1672 microversion: 2.1 time: 0.181182 Oct 22 22:19:21.644889 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3506/6983] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:19:21 2022] GET /compute/v2.1/servers/104c88a4-4885-465b-961c-5e26c3a42f97 => generated 1672 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:19:22.749399 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-a064cf59-2b0f-4a7f-aab2-0412fc7662fc tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 22:19:22.753167 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-a064cf59-2b0f-4a7f-aab2-0412fc7662fc tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] [instance: 104c88a4-4885-465b-961c-5e26c3a42f97] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:19:22.764833 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a064cf59-2b0f-4a7f-aab2-0412fc7662fc tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:19:22.765331 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a064cf59-2b0f-4a7f-aab2-0412fc7662fc tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:19:22.765779 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a064cf59-2b0f-4a7f-aab2-0412fc7662fc tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:19:22.766490 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a064cf59-2b0f-4a7f-aab2-0412fc7662fc tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:19:22.766957 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a064cf59-2b0f-4a7f-aab2-0412fc7662fc tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:19:22.767431 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a064cf59-2b0f-4a7f-aab2-0412fc7662fc tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:19:22.818638 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-a064cf59-2b0f-4a7f-aab2-0412fc7662fc tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] 10.222.0.18 "POST /compute/v2.1/servers/104c88a4-4885-465b-961c-5e26c3a42f97/action" status: 200 len: 38309 microversion: 2.1 time: 0.076111 Oct 22 22:19:22.819292 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3478/6984] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 22:19:22 2022] POST /compute/v2.1/servers/104c88a4-4885-465b-961c-5e26c3a42f97/action => generated 38309 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 22 22:19:22.834987 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-ee0328af-61a3-4557-91ea-226f400a1012 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 22:19:22.835672 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-ee0328af-61a3-4557-91ea-226f400a1012 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] [instance: 104c88a4-4885-465b-961c-5e26c3a42f97] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:19:22.843675 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ee0328af-61a3-4557-91ea-226f400a1012 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:19:22.844192 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ee0328af-61a3-4557-91ea-226f400a1012 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:19:22.844653 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ee0328af-61a3-4557-91ea-226f400a1012 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:19:22.845374 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ee0328af-61a3-4557-91ea-226f400a1012 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:19:22.845855 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ee0328af-61a3-4557-91ea-226f400a1012 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:19:22.846307 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ee0328af-61a3-4557-91ea-226f400a1012 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:19:22.926398 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-ee0328af-61a3-4557-91ea-226f400a1012 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] 10.222.0.18 "POST /compute/v2.1/servers/104c88a4-4885-465b-961c-5e26c3a42f97/action" status: 202 len: 0 microversion: 2.1 time: 0.095285 Oct 22 22:19:22.927052 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3507/6985] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 22:19:22 2022] POST /compute/v2.1/servers/104c88a4-4885-465b-961c-5e26c3a42f97/action => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 22:19:22.936411 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-33356413-fde2-4ace-8cc4-94f318f23237 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:19:22.937173 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-33356413-fde2-4ace-8cc4-94f318f23237 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] [instance: 104c88a4-4885-465b-961c-5e26c3a42f97] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:19:22.944831 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-33356413-fde2-4ace-8cc4-94f318f23237 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:19:22.945322 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-33356413-fde2-4ace-8cc4-94f318f23237 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:19:22.945763 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-33356413-fde2-4ace-8cc4-94f318f23237 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:19:22.946460 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-33356413-fde2-4ace-8cc4-94f318f23237 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:19:22.946964 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-33356413-fde2-4ace-8cc4-94f318f23237 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:19:22.947570 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-33356413-fde2-4ace-8cc4-94f318f23237 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:19:23.087526 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-33356413-fde2-4ace-8cc4-94f318f23237 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3841796765145e1876ddee315b81bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2463781199104e15aea02b6280ceaacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:19:23.096176 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-33356413-fde2-4ace-8cc4-94f318f23237 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] 10.222.0.18 "GET /compute/v2.1/servers/104c88a4-4885-465b-961c-5e26c3a42f97" status: 200 len: 1678 microversion: 2.1 time: 0.164445 Oct 22 22:19:23.096778 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3479/6986] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:19:22 2022] GET /compute/v2.1/servers/104c88a4-4885-465b-961c-5e26c3a42f97 => generated 1678 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:19:24.125337 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-9f8bf412-5f95-4e2e-912e-5e8fa1f07ed1 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:19:24.125922 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-9f8bf412-5f95-4e2e-912e-5e8fa1f07ed1 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] [instance: 104c88a4-4885-465b-961c-5e26c3a42f97] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:19:24.133115 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9f8bf412-5f95-4e2e-912e-5e8fa1f07ed1 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:19:24.133629 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9f8bf412-5f95-4e2e-912e-5e8fa1f07ed1 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:19:24.134185 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9f8bf412-5f95-4e2e-912e-5e8fa1f07ed1 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:19:24.134905 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9f8bf412-5f95-4e2e-912e-5e8fa1f07ed1 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:19:24.135379 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9f8bf412-5f95-4e2e-912e-5e8fa1f07ed1 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:19:24.135860 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9f8bf412-5f95-4e2e-912e-5e8fa1f07ed1 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:19:24.287732 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-9f8bf412-5f95-4e2e-912e-5e8fa1f07ed1 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3841796765145e1876ddee315b81bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2463781199104e15aea02b6280ceaacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:19:24.296713 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-9f8bf412-5f95-4e2e-912e-5e8fa1f07ed1 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] 10.222.0.18 "GET /compute/v2.1/servers/104c88a4-4885-465b-961c-5e26c3a42f97" status: 200 len: 1678 microversion: 2.1 time: 0.179151 Oct 22 22:19:24.297319 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3508/6987] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:19:24 2022] GET /compute/v2.1/servers/104c88a4-4885-465b-961c-5e26c3a42f97 => generated 1678 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:19:25.325222 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-0a762090-ddd3-4386-9fc5-03433e039dfc tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:19:25.326194 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-0a762090-ddd3-4386-9fc5-03433e039dfc tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] [instance: 104c88a4-4885-465b-961c-5e26c3a42f97] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:19:25.338004 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0a762090-ddd3-4386-9fc5-03433e039dfc tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:19:25.338860 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0a762090-ddd3-4386-9fc5-03433e039dfc tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:19:25.339637 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0a762090-ddd3-4386-9fc5-03433e039dfc tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:19:25.341172 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0a762090-ddd3-4386-9fc5-03433e039dfc tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:19:25.341954 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0a762090-ddd3-4386-9fc5-03433e039dfc tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:19:25.342618 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0a762090-ddd3-4386-9fc5-03433e039dfc tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:19:25.486655 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-0a762090-ddd3-4386-9fc5-03433e039dfc tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3841796765145e1876ddee315b81bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2463781199104e15aea02b6280ceaacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:19:25.495051 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-0a762090-ddd3-4386-9fc5-03433e039dfc tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] 10.222.0.18 "GET /compute/v2.1/servers/104c88a4-4885-465b-961c-5e26c3a42f97" status: 200 len: 1681 microversion: 2.1 time: 0.176627 Oct 22 22:19:25.495664 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3480/6988] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:19:25 2022] GET /compute/v2.1/servers/104c88a4-4885-465b-961c-5e26c3a42f97 => generated 1681 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:19:25.599121 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-b1d898f0-f135-41d1-b134-beaf1fd42bba tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 22:19:25.601383 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-b1d898f0-f135-41d1-b134-beaf1fd42bba tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] [instance: 104c88a4-4885-465b-961c-5e26c3a42f97] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:19:25.608745 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b1d898f0-f135-41d1-b134-beaf1fd42bba tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:19:25.609242 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b1d898f0-f135-41d1-b134-beaf1fd42bba tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:19:25.609697 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b1d898f0-f135-41d1-b134-beaf1fd42bba tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:19:25.610407 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b1d898f0-f135-41d1-b134-beaf1fd42bba tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:19:25.610877 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b1d898f0-f135-41d1-b134-beaf1fd42bba tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:19:25.611378 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b1d898f0-f135-41d1-b134-beaf1fd42bba tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:19:25.661836 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-b1d898f0-f135-41d1-b134-beaf1fd42bba tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] 10.222.0.18 "POST /compute/v2.1/servers/104c88a4-4885-465b-961c-5e26c3a42f97/action" status: 200 len: 38309 microversion: 2.1 time: 0.066168 Oct 22 22:19:25.662674 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3509/6989] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 22:19:25 2022] POST /compute/v2.1/servers/104c88a4-4885-465b-961c-5e26c3a42f97/action => generated 38309 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 22 22:19:26.876984 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-a24a9ebc-7fdc-48c8-93ca-92eadd60161d req-850ec2ce-9f41-4f65-bb09-f755bdc7b0ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "104c88a4-4885-465b-961c-5e26c3a42f97", "tag": "fbda4939-173d-4e7c-a701-7e49f4670cdd"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 22:19:26.887496 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-7e0deffb-3a0b-42e2-9a9b-6d9d592a68f6 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:19:26.888010 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-7e0deffb-3a0b-42e2-9a9b-6d9d592a68f6 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] [instance: 104c88a4-4885-465b-961c-5e26c3a42f97] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:19:26.896792 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-a24a9ebc-7fdc-48c8-93ca-92eadd60161d req-850ec2ce-9f41-4f65-bb09-f755bdc7b0ff service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:19:26.897425 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-a24a9ebc-7fdc-48c8-93ca-92eadd60161d req-850ec2ce-9f41-4f65-bb09-f755bdc7b0ff service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:19:26.897620 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7e0deffb-3a0b-42e2-9a9b-6d9d592a68f6 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:19:26.897922 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7e0deffb-3a0b-42e2-9a9b-6d9d592a68f6 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:19:26.898079 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-a24a9ebc-7fdc-48c8-93ca-92eadd60161d req-850ec2ce-9f41-4f65-bb09-f755bdc7b0ff service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:19:26.898363 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7e0deffb-3a0b-42e2-9a9b-6d9d592a68f6 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:19:26.899062 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7e0deffb-3a0b-42e2-9a9b-6d9d592a68f6 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:19:26.899542 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7e0deffb-3a0b-42e2-9a9b-6d9d592a68f6 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:19:26.899968 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7e0deffb-3a0b-42e2-9a9b-6d9d592a68f6 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:19:26.911489 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-a24a9ebc-7fdc-48c8-93ca-92eadd60161d req-850ec2ce-9f41-4f65-bb09-f755bdc7b0ff service nova] Creating event network-changed:fbda4939-173d-4e7c-a701-7e49f4670cdd for instance 104c88a4-4885-465b-961c-5e26c3a42f97 on nch1-master-1 Oct 22 22:19:26.917036 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-a24a9ebc-7fdc-48c8-93ca-92eadd60161d req-850ec2ce-9f41-4f65-bb09-f755bdc7b0ff service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044251 Oct 22 22:19:26.917643 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3510/6990] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 22:19:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 22:19:26.929257 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-7e0deffb-3a0b-42e2-9a9b-6d9d592a68f6 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] [instance: 104c88a4-4885-465b-961c-5e26c3a42f97] Going to try to terminate instance {{(pid=138744) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 22:19:27.034656 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-7e0deffb-3a0b-42e2-9a9b-6d9d592a68f6 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] 10.222.0.18 "DELETE /compute/v2.1/servers/104c88a4-4885-465b-961c-5e26c3a42f97" status: 204 len: 0 microversion: 2.1 time: 0.163504 Oct 22 22:19:27.038798 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3481/6991] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 22:19:26 2022] DELETE /compute/v2.1/servers/104c88a4-4885-465b-961c-5e26c3a42f97 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 22:19:27.045506 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-ce84cb16-5ca1-4c72-915e-8f601d075b2d tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:19:27.046482 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-ce84cb16-5ca1-4c72-915e-8f601d075b2d tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] [instance: 104c88a4-4885-465b-961c-5e26c3a42f97] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:19:27.054133 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ce84cb16-5ca1-4c72-915e-8f601d075b2d tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:19:27.054701 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ce84cb16-5ca1-4c72-915e-8f601d075b2d tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:19:27.055165 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ce84cb16-5ca1-4c72-915e-8f601d075b2d tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:19:27.056246 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ce84cb16-5ca1-4c72-915e-8f601d075b2d tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:19:27.056776 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ce84cb16-5ca1-4c72-915e-8f601d075b2d tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:19:27.057321 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ce84cb16-5ca1-4c72-915e-8f601d075b2d tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:19:27.347386 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-ce84cb16-5ca1-4c72-915e-8f601d075b2d tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3841796765145e1876ddee315b81bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2463781199104e15aea02b6280ceaacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:19:27.355761 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-ce84cb16-5ca1-4c72-915e-8f601d075b2d tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] 10.222.0.18 "GET /compute/v2.1/servers/104c88a4-4885-465b-961c-5e26c3a42f97" status: 200 len: 1687 microversion: 2.1 time: 0.315406 Oct 22 22:19:27.356357 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3511/6992] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:19:27 2022] GET /compute/v2.1/servers/104c88a4-4885-465b-961c-5e26c3a42f97 => generated 1687 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:19:28.381441 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-33cbbd1e-ef75-4b56-8264-4c8323b8f9c0 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:19:28.382159 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-33cbbd1e-ef75-4b56-8264-4c8323b8f9c0 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] [instance: 104c88a4-4885-465b-961c-5e26c3a42f97] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:19:28.389671 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-33cbbd1e-ef75-4b56-8264-4c8323b8f9c0 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:19:28.390191 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-33cbbd1e-ef75-4b56-8264-4c8323b8f9c0 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:19:28.390677 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-33cbbd1e-ef75-4b56-8264-4c8323b8f9c0 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:19:28.391385 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-33cbbd1e-ef75-4b56-8264-4c8323b8f9c0 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:19:28.391885 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-33cbbd1e-ef75-4b56-8264-4c8323b8f9c0 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:19:28.392319 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-33cbbd1e-ef75-4b56-8264-4c8323b8f9c0 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:19:28.587993 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-33cbbd1e-ef75-4b56-8264-4c8323b8f9c0 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3841796765145e1876ddee315b81bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2463781199104e15aea02b6280ceaacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:19:28.597723 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-33cbbd1e-ef75-4b56-8264-4c8323b8f9c0 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] 10.222.0.18 "GET /compute/v2.1/servers/104c88a4-4885-465b-961c-5e26c3a42f97" status: 200 len: 1687 microversion: 2.1 time: 0.220644 Oct 22 22:19:28.598503 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3482/6993] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:19:28 2022] GET /compute/v2.1/servers/104c88a4-4885-465b-961c-5e26c3a42f97 => generated 1687 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:19:29.343498 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-8ef08904-f303-480a-89dc-44129ab6a69e req-2659b848-f1c3-4a65-af8c-e85c7eac4883 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "104c88a4-4885-465b-961c-5e26c3a42f97", "name": "network-vif-deleted", "tag": "fbda4939-173d-4e7c-a701-7e49f4670cdd"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 22:19:29.354333 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-8ef08904-f303-480a-89dc-44129ab6a69e req-2659b848-f1c3-4a65-af8c-e85c7eac4883 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:19:29.354854 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-8ef08904-f303-480a-89dc-44129ab6a69e req-2659b848-f1c3-4a65-af8c-e85c7eac4883 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:19:29.355364 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-8ef08904-f303-480a-89dc-44129ab6a69e req-2659b848-f1c3-4a65-af8c-e85c7eac4883 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:19:29.366413 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-8ef08904-f303-480a-89dc-44129ab6a69e req-2659b848-f1c3-4a65-af8c-e85c7eac4883 service nova] Creating event network-vif-deleted:fbda4939-173d-4e7c-a701-7e49f4670cdd for instance 104c88a4-4885-465b-961c-5e26c3a42f97 on nch1-master-1 Oct 22 22:19:29.372239 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-8ef08904-f303-480a-89dc-44129ab6a69e req-2659b848-f1c3-4a65-af8c-e85c7eac4883 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087755 Oct 22 22:19:29.372806 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3512/6994] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 22:19:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 22:19:29.622246 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-75b1b32f-fc66-4fae-9eb4-062f7b695d3c tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:19:29.622883 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-75b1b32f-fc66-4fae-9eb4-062f7b695d3c tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] [instance: 104c88a4-4885-465b-961c-5e26c3a42f97] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:19:29.630986 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-75b1b32f-fc66-4fae-9eb4-062f7b695d3c tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:19:29.631527 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-75b1b32f-fc66-4fae-9eb4-062f7b695d3c tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:19:29.631976 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-75b1b32f-fc66-4fae-9eb4-062f7b695d3c tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:19:29.632705 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-75b1b32f-fc66-4fae-9eb4-062f7b695d3c tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:19:29.638125 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-75b1b32f-fc66-4fae-9eb4-062f7b695d3c tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:19:29.638582 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-75b1b32f-fc66-4fae-9eb4-062f7b695d3c tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:19:29.674377 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-75b1b32f-fc66-4fae-9eb4-062f7b695d3c tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:19:29.674876 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-75b1b32f-fc66-4fae-9eb4-062f7b695d3c tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:19:29.675325 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-75b1b32f-fc66-4fae-9eb4-062f7b695d3c tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:19:29.675821 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.objects.instance [None req-75b1b32f-fc66-4fae-9eb4-062f7b695d3c tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lazy-loading 'fault' on Instance uuid 104c88a4-4885-465b-961c-5e26c3a42f97 {{(pid=138744) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 22:19:29.719999 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-75b1b32f-fc66-4fae-9eb4-062f7b695d3c tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3841796765145e1876ddee315b81bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2463781199104e15aea02b6280ceaacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:19:29.728469 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-75b1b32f-fc66-4fae-9eb4-062f7b695d3c tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] 10.222.0.18 "GET /compute/v2.1/servers/104c88a4-4885-465b-961c-5e26c3a42f97" status: 200 len: 1354 microversion: 2.1 time: 0.110444 Oct 22 22:19:29.729294 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3483/6995] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:19:29 2022] GET /compute/v2.1/servers/104c88a4-4885-465b-961c-5e26c3a42f97 => generated 1354 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:19:30.759174 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-1740a13a-9ca3-44f6-b202-7c72ab59e461 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:19:30.760409 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-1740a13a-9ca3-44f6-b202-7c72ab59e461 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] [instance: 104c88a4-4885-465b-961c-5e26c3a42f97] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:19:30.771520 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1740a13a-9ca3-44f6-b202-7c72ab59e461 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:19:30.772369 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1740a13a-9ca3-44f6-b202-7c72ab59e461 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:19:30.773128 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1740a13a-9ca3-44f6-b202-7c72ab59e461 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:19:30.774319 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1740a13a-9ca3-44f6-b202-7c72ab59e461 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:19:30.775118 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1740a13a-9ca3-44f6-b202-7c72ab59e461 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:19:30.775919 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1740a13a-9ca3-44f6-b202-7c72ab59e461 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:19:30.792248 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.wsgi [None req-1740a13a-9ca3-44f6-b202-7c72ab59e461 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] HTTP exception thrown: Instance 104c88a4-4885-465b-961c-5e26c3a42f97 could not be found. Oct 22 22:19:30.793911 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-1740a13a-9ca3-44f6-b202-7c72ab59e461 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Request method failure captured: Oct 22 22:19:30.793911 ncdv-master-1 devstack@n-api.service[138745]: request: GET /compute/v2.1/servers/104c88a4-4885-465b-961c-5e26c3a42f97 HTTP/1.1 Oct 22 22:19:30.793911 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 22:19:30.793911 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 22:19:30.793911 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 22:19:30.793911 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 0 Oct 22 22:19:30.793911 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 22:19:30.793911 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 22:19:30.793911 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 22:19:30.793911 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 22:19:30.793911 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVGn7_hWur8olMNvqY1ci34dTO2aMHkwF2Arh7Vhu0pKEfAIdjPeIgFR3M850xL8FpTR9mXeTguII0a2O-HdxsJf8qZBcfSziKEpwyhdPF7DkzW4kQj6-KDf_OfkhNJyBC-6JgZCrm8JmrvBF_CtA7k23ekrHWftWnFXpuRzAvhnMWRA Oct 22 22:19:30.793911 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 22:19:30.793911 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 22:19:30.793911 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 22:19:30.793911 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 22:19:30.793911 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 22:19:30.793911 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 22:19:30.793911 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: 2463781199104e15aea02b6280ceaacf Oct 22 22:19:30.793911 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-703320975 Oct 22 22:19:30.793911 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 22:19:30.793911 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 22:19:30.793911 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_2463781199104e15aea02b6280ceaacf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2463781199104e15aea02b6280ceaacf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/2463781199104e15aea02b6280ceaacf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2463781199104e15aea02b6280ceaacf"}]}] Oct 22 22:19:30.793911 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-TestNetworkAdvancedServerOps-703320975 Oct 22 22:19:30.793911 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: 2463781199104e15aea02b6280ceaacf Oct 22 22:19:30.793911 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-703320975 Oct 22 22:19:30.793911 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-TestNetworkAdvancedServerOps-703320975-project Oct 22 22:19:30.793911 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 22:19:30.793911 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 22:19:30.793911 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: e3841796765145e1876ddee315b81bea Oct 22 22:19:30.793911 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-TestNetworkAdvancedServerOps-703320975-project Oct 22 22:19:30.793911 ncdv-master-1 devstack@n-api.service[138745]: method: > Oct 22 22:19:30.793911 ncdv-master-1 devstack@n-api.service[138745]: exception: Instance 104c88a4-4885-465b-961c-5e26c3a42f97 could not be found. Oct 22 22:19:30.793911 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'id': '104c88a4-4885-465b-961c-5e26c3a42f97'} Oct 22 22:19:30.793911 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 22:19:30.793911 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 22:19:30.793911 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 22:19:30.793911 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 22:19:30.793911 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 22:19:30.793911 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 22:19:30.793911 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 22:19:30.793911 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 22:19:30.793911 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 22:19:30.793911 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 22:19:30.793911 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 104c88a4-4885-465b-961c-5e26c3a42f97 could not be found. Oct 22 22:19:30.793911 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 22:19:30.793911 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 22:19:30.793911 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 22:19:30.793911 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 22:19:30.793911 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 22:19:30.793911 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 22:19:30.793911 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 22:19:30.793911 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 22:19:30.793911 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 22:19:30.793911 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 22:19:30.793911 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 22:19:30.793911 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 22:19:30.793911 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 22:19:30.793911 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 22:19:30.793911 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 22:19:30.793911 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 22:19:30.793911 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 104c88a4-4885-465b-961c-5e26c3a42f97 could not be found. Oct 22 22:19:30.793911 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 22:19:30.793911 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 22:19:30.800330 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 22:19:30.800330 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 22:19:30.800330 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 22:19:30.800330 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 22:19:30.800330 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 22:19:30.800330 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 22:19:30.800330 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 104c88a4-4885-465b-961c-5e26c3a42f97 could not be found. Oct 22 22:19:30.800330 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 22:19:30.800330 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-1740a13a-9ca3-44f6-b202-7c72ab59e461 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Returning 404 to user: Instance 104c88a4-4885-465b-961c-5e26c3a42f97 could not be found. {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 22:19:30.800330 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-1740a13a-9ca3-44f6-b202-7c72ab59e461 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] 10.222.0.18 "GET /compute/v2.1/servers/104c88a4-4885-465b-961c-5e26c3a42f97" status: 404 len: 111 microversion: 2.1 time: 0.044789 Oct 22 22:19:30.800330 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3513/6996] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:19:30 2022] GET /compute/v2.1/servers/104c88a4-4885-465b-961c-5e26c3a42f97 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 22:19:33.842544 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-02158d2a-3c5e-403a-bacb-e78f4ec20a12 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] Calling method '.version_select at 0x7fd39eda90d0>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:19:33.866204 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-02158d2a-3c5e-403a-bacb-e78f4ec20a12 tempest-TestNetworkAdvancedServerOps-703320975 tempest-TestNetworkAdvancedServerOps-703320975-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-313580921" status: 202 len: 0 microversion: 2.1 time: 0.027977 Oct 22 22:19:33.867061 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3484/6997] 10.222.0.18 () {58 vars in 1281 bytes} [Sat Oct 22 22:19:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-313580921 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 22:19:45.387640 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_api:SELECT=18 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:19:45.388415 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:19:45.566761 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-7914c61a-fbe9-4999-95f8-af3e46af06b9 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Action: 'create', calling method: .version_select at 0x7fd39fc94dc0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1281534188", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI3k8AKce6iFeTrLMzBXjAhrINHoSJkk4xSu5zrWkjfPioTPXvlIcvIytnc0orQ1PwZxZGbyuDLIbXtevZT0IsrJU8xUEP9u0L6KoZqonHuGAjmpNdmv9NXShudg68Cczg=="}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 22:19:45.583235 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-7914c61a-fbe9-4999-95f8-af3e46af06b9 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Getting quotas for project 4d0a5546dd7e4676b6e1ae44898972e9. Resources: {'key_pairs'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 22:19:45.590296 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-7914c61a-fbe9-4999-95f8-af3e46af06b9 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Getting quotas for user d12dda477f454a20aff297708f052dd9 and project 4d0a5546dd7e4676b6e1ae44898972e9. Resources: {'key_pairs'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 22:19:45.620320 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-7914c61a-fbe9-4999-95f8-af3e46af06b9 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.238233 Oct 22 22:19:45.620940 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3514/6998] 10.222.0.18 () {60 vars in 1159 bytes} [Sat Oct 22 22:19:45 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 22:19:46.632535 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-fdeba39e-ef83-4a0a-a04b-40b1287f75ef tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1211405025", "imageRef": "085e4478-6edc-4a69-8e08-f9831713eb65", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1281534188", "security_groups": [{"name": "tempest-secgroup-smoke-1450530995"}], "networks": [{"uuid": "e56f3e9a-1603-4dd4-931a-65eadb095ac7"}]}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 22:19:46.643886 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:SELECT=63,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:19:46.644538 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:19:46.752987 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.network.neutron [None req-fdeba39e-ef83-4a0a-a04b-40b1287f75ef tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] validate_networks() for [('e56f3e9a-1603-4dd4-931a-65eadb095ac7', None, None, None, None, None)] {{(pid=138744) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 22:19:47.255083 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-fdeba39e-ef83-4a0a-a04b-40b1287f75ef tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Flavor limits 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 22:19:47.255638 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-fdeba39e-ef83-4a0a-a04b-40b1287f75ef tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Image limits 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 22:19:47.256277 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-fdeba39e-ef83-4a0a-a04b-40b1287f75ef tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Flavor pref 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 22:19:47.256782 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-fdeba39e-ef83-4a0a-a04b-40b1287f75ef tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Image pref 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 22:19:47.257292 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-fdeba39e-ef83-4a0a-a04b-40b1287f75ef tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 22:19:47.266863 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fdeba39e-ef83-4a0a-a04b-40b1287f75ef tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:19:47.267476 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fdeba39e-ef83-4a0a-a04b-40b1287f75ef tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:19:47.267990 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fdeba39e-ef83-4a0a-a04b-40b1287f75ef tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:19:47.268851 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fdeba39e-ef83-4a0a-a04b-40b1287f75ef tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:19:47.269382 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fdeba39e-ef83-4a0a-a04b-40b1287f75ef tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:19:47.269884 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fdeba39e-ef83-4a0a-a04b-40b1287f75ef tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:19:47.290007 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-fdeba39e-ef83-4a0a-a04b-40b1287f75ef tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Getting quotas for project 4d0a5546dd7e4676b6e1ae44898972e9. Resources: {'cores', 'instances', 'ram'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 22:19:47.295411 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-fdeba39e-ef83-4a0a-a04b-40b1287f75ef tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Getting quotas for user d12dda477f454a20aff297708f052dd9 and project 4d0a5546dd7e4676b6e1ae44898972e9. Resources: {'cores', 'instances', 'ram'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 22:19:47.308498 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-fdeba39e-ef83-4a0a-a04b-40b1287f75ef tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Going to run 1 instances... {{(pid=138744) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 22:19:47.310897 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-fdeba39e-ef83-4a0a-a04b-40b1287f75ef tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] [instance: 6de86b94-5727-477c-a3ce-913a3d77764f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='085e4478-6edc-4a69-8e08-f9831713eb65',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138744) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 22:19:47.360146 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-fdeba39e-ef83-4a0a-a04b-40b1287f75ef tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.731803 Oct 22 22:19:47.360853 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3485/6999] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Oct 22 22:19:46 2022] POST /compute/v2.1/servers => generated 406 bytes in 733 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 22:19:47.373284 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-a39818cc-5536-4aff-b46b-f336e80eb7e3 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:19:47.374386 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-a39818cc-5536-4aff-b46b-f336e80eb7e3 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] [instance: 6de86b94-5727-477c-a3ce-913a3d77764f] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:19:47.431488 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-a39818cc-5536-4aff-b46b-f336e80eb7e3 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12dda477f454a20aff297708f052dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0a5546dd7e4676b6e1ae44898972e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:19:47.448680 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-a39818cc-5536-4aff-b46b-f336e80eb7e3 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] 10.222.0.18 "GET /compute/v2.1/servers/6de86b94-5727-477c-a3ce-913a3d77764f" status: 200 len: 1247 microversion: 2.1 time: 0.080390 Oct 22 22:19:47.449283 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3515/7000] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:19:47 2022] GET /compute/v2.1/servers/6de86b94-5727-477c-a3ce-913a3d77764f => generated 1247 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:19:48.472659 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-baf1dcdd-0d1f-4fa1-979a-93b63810432c tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:19:48.473455 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-baf1dcdd-0d1f-4fa1-979a-93b63810432c tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] [instance: 6de86b94-5727-477c-a3ce-913a3d77764f] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:19:48.481778 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-baf1dcdd-0d1f-4fa1-979a-93b63810432c tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:19:48.482502 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-baf1dcdd-0d1f-4fa1-979a-93b63810432c tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:19:48.482922 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-baf1dcdd-0d1f-4fa1-979a-93b63810432c tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:19:48.483796 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-baf1dcdd-0d1f-4fa1-979a-93b63810432c tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:19:48.484490 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-baf1dcdd-0d1f-4fa1-979a-93b63810432c tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:19:48.484861 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-baf1dcdd-0d1f-4fa1-979a-93b63810432c tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:19:48.568629 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-baf1dcdd-0d1f-4fa1-979a-93b63810432c tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12dda477f454a20aff297708f052dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0a5546dd7e4676b6e1ae44898972e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:19:48.577284 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-baf1dcdd-0d1f-4fa1-979a-93b63810432c tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] 10.222.0.18 "GET /compute/v2.1/servers/6de86b94-5727-477c-a3ce-913a3d77764f" status: 200 len: 1299 microversion: 2.1 time: 0.109114 Oct 22 22:19:48.577918 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3486/7001] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:19:48 2022] GET /compute/v2.1/servers/6de86b94-5727-477c-a3ce-913a3d77764f => generated 1299 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:19:49.600762 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-6e9ed8de-186d-40eb-bd5e-66f390235b01 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:19:49.601576 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-6e9ed8de-186d-40eb-bd5e-66f390235b01 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] [instance: 6de86b94-5727-477c-a3ce-913a3d77764f] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:19:49.610522 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6e9ed8de-186d-40eb-bd5e-66f390235b01 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:19:49.611033 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6e9ed8de-186d-40eb-bd5e-66f390235b01 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:19:49.611547 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6e9ed8de-186d-40eb-bd5e-66f390235b01 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:19:49.612280 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6e9ed8de-186d-40eb-bd5e-66f390235b01 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:19:49.612933 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6e9ed8de-186d-40eb-bd5e-66f390235b01 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:19:49.613394 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6e9ed8de-186d-40eb-bd5e-66f390235b01 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:19:49.845410 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-6e9ed8de-186d-40eb-bd5e-66f390235b01 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12dda477f454a20aff297708f052dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0a5546dd7e4676b6e1ae44898972e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:19:49.856726 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-6e9ed8de-186d-40eb-bd5e-66f390235b01 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] 10.222.0.18 "GET /compute/v2.1/servers/6de86b94-5727-477c-a3ce-913a3d77764f" status: 200 len: 1373 microversion: 2.1 time: 0.259759 Oct 22 22:19:49.857445 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3516/7002] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:19:49 2022] GET /compute/v2.1/servers/6de86b94-5727-477c-a3ce-913a3d77764f => generated 1373 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:19:50.507815 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-a5d07776-0765-45dd-a87f-d21ac653e9ea req-942d5a16-68ab-46d3-bfe2-fc9fbbef1fd0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6de86b94-5727-477c-a3ce-913a3d77764f", "tag": "802b5db4-b15e-4714-8ab4-a1dfca1177bb"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 22:19:50.519098 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-a5d07776-0765-45dd-a87f-d21ac653e9ea req-942d5a16-68ab-46d3-bfe2-fc9fbbef1fd0 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:19:50.519616 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-a5d07776-0765-45dd-a87f-d21ac653e9ea req-942d5a16-68ab-46d3-bfe2-fc9fbbef1fd0 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:19:50.520058 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-a5d07776-0765-45dd-a87f-d21ac653e9ea req-942d5a16-68ab-46d3-bfe2-fc9fbbef1fd0 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:19:50.538430 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-a5d07776-0765-45dd-a87f-d21ac653e9ea req-942d5a16-68ab-46d3-bfe2-fc9fbbef1fd0 service nova] Creating event network-changed:802b5db4-b15e-4714-8ab4-a1dfca1177bb for instance 6de86b94-5727-477c-a3ce-913a3d77764f on nch1-master-1 Oct 22 22:19:50.543366 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-a5d07776-0765-45dd-a87f-d21ac653e9ea req-942d5a16-68ab-46d3-bfe2-fc9fbbef1fd0 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039699 Oct 22 22:19:50.543985 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3487/7003] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 22:19:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 22:19:50.880299 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-96aa798c-54b9-4022-958a-1f46d4f5397c tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:19:50.881233 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-96aa798c-54b9-4022-958a-1f46d4f5397c tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] [instance: 6de86b94-5727-477c-a3ce-913a3d77764f] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:19:50.889059 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-96aa798c-54b9-4022-958a-1f46d4f5397c tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:19:50.889700 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-96aa798c-54b9-4022-958a-1f46d4f5397c tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:19:50.890239 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-96aa798c-54b9-4022-958a-1f46d4f5397c tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:19:50.891107 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-96aa798c-54b9-4022-958a-1f46d4f5397c tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:19:50.891857 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-96aa798c-54b9-4022-958a-1f46d4f5397c tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:19:50.892385 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-96aa798c-54b9-4022-958a-1f46d4f5397c tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:19:51.053805 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-96aa798c-54b9-4022-958a-1f46d4f5397c tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12dda477f454a20aff297708f052dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0a5546dd7e4676b6e1ae44898972e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:19:51.062168 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-96aa798c-54b9-4022-958a-1f46d4f5397c tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] 10.222.0.18 "GET /compute/v2.1/servers/6de86b94-5727-477c-a3ce-913a3d77764f" status: 200 len: 1373 microversion: 2.1 time: 0.185859 Oct 22 22:19:51.063213 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3517/7004] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:19:50 2022] GET /compute/v2.1/servers/6de86b94-5727-477c-a3ce-913a3d77764f => generated 1373 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:19:52.086699 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-7564d559-e750-4942-99b7-76a0601888d7 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:19:52.087297 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-7564d559-e750-4942-99b7-76a0601888d7 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] [instance: 6de86b94-5727-477c-a3ce-913a3d77764f] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:19:52.094674 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7564d559-e750-4942-99b7-76a0601888d7 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:19:52.095174 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7564d559-e750-4942-99b7-76a0601888d7 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:19:52.095814 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7564d559-e750-4942-99b7-76a0601888d7 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:19:52.096669 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7564d559-e750-4942-99b7-76a0601888d7 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:19:52.097271 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7564d559-e750-4942-99b7-76a0601888d7 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:19:52.097844 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7564d559-e750-4942-99b7-76a0601888d7 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:19:52.237707 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-7564d559-e750-4942-99b7-76a0601888d7 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12dda477f454a20aff297708f052dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0a5546dd7e4676b6e1ae44898972e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:19:52.245691 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-7564d559-e750-4942-99b7-76a0601888d7 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] 10.222.0.18 "GET /compute/v2.1/servers/6de86b94-5727-477c-a3ce-913a3d77764f" status: 200 len: 1373 microversion: 2.1 time: 0.164314 Oct 22 22:19:52.259426 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3488/7005] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:19:52 2022] GET /compute/v2.1/servers/6de86b94-5727-477c-a3ce-913a3d77764f => generated 1373 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:19:53.269563 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-b6743916-4c53-46b8-b265-305a4d1a19cd tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:19:53.270201 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-b6743916-4c53-46b8-b265-305a4d1a19cd tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] [instance: 6de86b94-5727-477c-a3ce-913a3d77764f] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:19:53.277342 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b6743916-4c53-46b8-b265-305a4d1a19cd tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:19:53.277825 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b6743916-4c53-46b8-b265-305a4d1a19cd tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:19:53.278292 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b6743916-4c53-46b8-b265-305a4d1a19cd tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:19:53.279003 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b6743916-4c53-46b8-b265-305a4d1a19cd tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:19:53.279512 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b6743916-4c53-46b8-b265-305a4d1a19cd tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:19:53.279981 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b6743916-4c53-46b8-b265-305a4d1a19cd tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:19:53.492389 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-b6743916-4c53-46b8-b265-305a4d1a19cd tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12dda477f454a20aff297708f052dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0a5546dd7e4676b6e1ae44898972e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:19:53.501251 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-b6743916-4c53-46b8-b265-305a4d1a19cd tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] 10.222.0.18 "GET /compute/v2.1/servers/6de86b94-5727-477c-a3ce-913a3d77764f" status: 200 len: 1373 microversion: 2.1 time: 0.235657 Oct 22 22:19:53.501854 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3518/7006] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:19:53 2022] GET /compute/v2.1/servers/6de86b94-5727-477c-a3ce-913a3d77764f => generated 1373 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:19:54.529104 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-b3bb6bff-96f9-42a5-8516-45f4fdad8da6 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:19:54.529843 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-b3bb6bff-96f9-42a5-8516-45f4fdad8da6 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] [instance: 6de86b94-5727-477c-a3ce-913a3d77764f] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:19:54.537533 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b3bb6bff-96f9-42a5-8516-45f4fdad8da6 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:19:54.538025 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b3bb6bff-96f9-42a5-8516-45f4fdad8da6 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:19:54.538499 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b3bb6bff-96f9-42a5-8516-45f4fdad8da6 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:19:54.539183 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b3bb6bff-96f9-42a5-8516-45f4fdad8da6 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:19:54.539683 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b3bb6bff-96f9-42a5-8516-45f4fdad8da6 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:19:54.540145 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b3bb6bff-96f9-42a5-8516-45f4fdad8da6 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:19:54.678092 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-b3bb6bff-96f9-42a5-8516-45f4fdad8da6 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12dda477f454a20aff297708f052dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0a5546dd7e4676b6e1ae44898972e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:19:54.689246 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-b3bb6bff-96f9-42a5-8516-45f4fdad8da6 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] 10.222.0.18 "GET /compute/v2.1/servers/6de86b94-5727-477c-a3ce-913a3d77764f" status: 200 len: 1373 microversion: 2.1 time: 0.164219 Oct 22 22:19:54.689841 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3489/7007] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:19:54 2022] GET /compute/v2.1/servers/6de86b94-5727-477c-a3ce-913a3d77764f => generated 1373 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:19:55.712425 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-ee6ffc65-84b0-40ef-ac7a-2362c2047334 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:19:55.713084 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-ee6ffc65-84b0-40ef-ac7a-2362c2047334 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] [instance: 6de86b94-5727-477c-a3ce-913a3d77764f] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:19:55.721142 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ee6ffc65-84b0-40ef-ac7a-2362c2047334 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:19:55.721650 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ee6ffc65-84b0-40ef-ac7a-2362c2047334 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:19:55.722109 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ee6ffc65-84b0-40ef-ac7a-2362c2047334 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:19:55.722833 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ee6ffc65-84b0-40ef-ac7a-2362c2047334 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:19:55.723310 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ee6ffc65-84b0-40ef-ac7a-2362c2047334 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:19:55.723800 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ee6ffc65-84b0-40ef-ac7a-2362c2047334 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:19:55.872081 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-ee6ffc65-84b0-40ef-ac7a-2362c2047334 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12dda477f454a20aff297708f052dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0a5546dd7e4676b6e1ae44898972e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:19:55.880919 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-ee6ffc65-84b0-40ef-ac7a-2362c2047334 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] 10.222.0.18 "GET /compute/v2.1/servers/6de86b94-5727-477c-a3ce-913a3d77764f" status: 200 len: 1373 microversion: 2.1 time: 0.172086 Oct 22 22:19:55.881450 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3519/7008] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:19:55 2022] GET /compute/v2.1/servers/6de86b94-5727-477c-a3ce-913a3d77764f => generated 1373 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:19:56.907863 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-c0ce4093-1746-4703-8092-0621e79a407a tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:19:56.908401 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-c0ce4093-1746-4703-8092-0621e79a407a tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] [instance: 6de86b94-5727-477c-a3ce-913a3d77764f] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:19:56.916061 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c0ce4093-1746-4703-8092-0621e79a407a tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:19:56.916556 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c0ce4093-1746-4703-8092-0621e79a407a tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:19:56.917005 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c0ce4093-1746-4703-8092-0621e79a407a tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:19:56.917710 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c0ce4093-1746-4703-8092-0621e79a407a tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:19:56.918170 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c0ce4093-1746-4703-8092-0621e79a407a tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:19:56.918605 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c0ce4093-1746-4703-8092-0621e79a407a tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:19:57.060665 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-c0ce4093-1746-4703-8092-0621e79a407a tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12dda477f454a20aff297708f052dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0a5546dd7e4676b6e1ae44898972e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:19:57.069669 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-c0ce4093-1746-4703-8092-0621e79a407a tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] 10.222.0.18 "GET /compute/v2.1/servers/6de86b94-5727-477c-a3ce-913a3d77764f" status: 200 len: 1373 microversion: 2.1 time: 0.168059 Oct 22 22:19:57.070252 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3490/7009] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:19:56 2022] GET /compute/v2.1/servers/6de86b94-5727-477c-a3ce-913a3d77764f => generated 1373 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:19:57.552049 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell0:SELECT=6 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:19:57.614859 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-e3f1804e-492e-4bcd-8ed9-1bdb73189dd3 req-91aada35-7cbd-4e8b-870b-0ac0e5e0701d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6de86b94-5727-477c-a3ce-913a3d77764f", "name": "network-vif-plugged", "status": "completed", "tag": "802b5db4-b15e-4714-8ab4-a1dfca1177bb"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 22:19:57.625376 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-e3f1804e-492e-4bcd-8ed9-1bdb73189dd3 req-91aada35-7cbd-4e8b-870b-0ac0e5e0701d service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:19:57.625616 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-e3f1804e-492e-4bcd-8ed9-1bdb73189dd3 req-91aada35-7cbd-4e8b-870b-0ac0e5e0701d service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:19:57.626071 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-e3f1804e-492e-4bcd-8ed9-1bdb73189dd3 req-91aada35-7cbd-4e8b-870b-0ac0e5e0701d service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:19:57.638196 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-e3f1804e-492e-4bcd-8ed9-1bdb73189dd3 req-91aada35-7cbd-4e8b-870b-0ac0e5e0701d service nova] Creating event network-vif-plugged:802b5db4-b15e-4714-8ab4-a1dfca1177bb for instance 6de86b94-5727-477c-a3ce-913a3d77764f on nch1-master-1 Oct 22 22:19:57.644131 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-e3f1804e-492e-4bcd-8ed9-1bdb73189dd3 req-91aada35-7cbd-4e8b-870b-0ac0e5e0701d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097816 Oct 22 22:19:57.644751 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3520/7010] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 22:19:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 22:19:58.097518 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-849e55b1-db4a-45d1-abad-cbc12f4cb517 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:19:58.098328 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-849e55b1-db4a-45d1-abad-cbc12f4cb517 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] [instance: 6de86b94-5727-477c-a3ce-913a3d77764f] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:19:58.101296 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell0:SELECT=2 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:19:58.102321 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell0:SELECT=6 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:19:58.113603 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-849e55b1-db4a-45d1-abad-cbc12f4cb517 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:19:58.114116 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-849e55b1-db4a-45d1-abad-cbc12f4cb517 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:19:58.114557 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-849e55b1-db4a-45d1-abad-cbc12f4cb517 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:19:58.115243 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-849e55b1-db4a-45d1-abad-cbc12f4cb517 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:19:58.115822 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-849e55b1-db4a-45d1-abad-cbc12f4cb517 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:19:58.116275 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-849e55b1-db4a-45d1-abad-cbc12f4cb517 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:19:58.264197 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-849e55b1-db4a-45d1-abad-cbc12f4cb517 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12dda477f454a20aff297708f052dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0a5546dd7e4676b6e1ae44898972e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:19:58.272693 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-849e55b1-db4a-45d1-abad-cbc12f4cb517 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] 10.222.0.18 "GET /compute/v2.1/servers/6de86b94-5727-477c-a3ce-913a3d77764f" status: 200 len: 1373 microversion: 2.1 time: 0.181670 Oct 22 22:19:58.273281 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3491/7011] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:19:58 2022] GET /compute/v2.1/servers/6de86b94-5727-477c-a3ce-913a3d77764f => generated 1373 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:19:59.299848 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-9da0911b-c3a4-46c6-a503-de73b999515e tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:19:59.300612 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-9da0911b-c3a4-46c6-a503-de73b999515e tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] [instance: 6de86b94-5727-477c-a3ce-913a3d77764f] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:19:59.308371 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9da0911b-c3a4-46c6-a503-de73b999515e tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:19:59.308853 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9da0911b-c3a4-46c6-a503-de73b999515e tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:19:59.309319 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9da0911b-c3a4-46c6-a503-de73b999515e tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:19:59.310052 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9da0911b-c3a4-46c6-a503-de73b999515e tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:19:59.310556 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9da0911b-c3a4-46c6-a503-de73b999515e tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:19:59.311014 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9da0911b-c3a4-46c6-a503-de73b999515e tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:19:59.450768 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-9da0911b-c3a4-46c6-a503-de73b999515e tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12dda477f454a20aff297708f052dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0a5546dd7e4676b6e1ae44898972e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:19:59.459356 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-9da0911b-c3a4-46c6-a503-de73b999515e tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] 10.222.0.18 "GET /compute/v2.1/servers/6de86b94-5727-477c-a3ce-913a3d77764f" status: 200 len: 1557 microversion: 2.1 time: 0.165687 Oct 22 22:19:59.459944 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3521/7012] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:19:59 2022] GET /compute/v2.1/servers/6de86b94-5727-477c-a3ce-913a3d77764f => generated 1557 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:19:59.481943 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-63f22af3-9fbe-4245-be06-590fbac50e70 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:19:59.482561 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-63f22af3-9fbe-4245-be06-590fbac50e70 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] [instance: 6de86b94-5727-477c-a3ce-913a3d77764f] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:19:59.490008 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-63f22af3-9fbe-4245-be06-590fbac50e70 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:19:59.490509 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-63f22af3-9fbe-4245-be06-590fbac50e70 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:19:59.490946 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-63f22af3-9fbe-4245-be06-590fbac50e70 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:19:59.491682 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-63f22af3-9fbe-4245-be06-590fbac50e70 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:19:59.492155 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-63f22af3-9fbe-4245-be06-590fbac50e70 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:19:59.492582 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-63f22af3-9fbe-4245-be06-590fbac50e70 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:19:59.633254 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-63f22af3-9fbe-4245-be06-590fbac50e70 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12dda477f454a20aff297708f052dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0a5546dd7e4676b6e1ae44898972e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:19:59.641751 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-63f22af3-9fbe-4245-be06-590fbac50e70 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] 10.222.0.18 "GET /compute/v2.1/servers/6de86b94-5727-477c-a3ce-913a3d77764f" status: 200 len: 1557 microversion: 2.1 time: 0.163747 Oct 22 22:19:59.642338 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3492/7013] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:19:59 2022] GET /compute/v2.1/servers/6de86b94-5727-477c-a3ce-913a3d77764f => generated 1557 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:20:01.352260 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-8064103b-6d5f-4edc-9382-758d550ead9b req-eca3b7c8-1657-45c3-8af9-ca388f3d8fbb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6de86b94-5727-477c-a3ce-913a3d77764f", "tag": "802b5db4-b15e-4714-8ab4-a1dfca1177bb"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 22:20:01.362589 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-8064103b-6d5f-4edc-9382-758d550ead9b req-eca3b7c8-1657-45c3-8af9-ca388f3d8fbb service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:20:01.363085 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-8064103b-6d5f-4edc-9382-758d550ead9b req-eca3b7c8-1657-45c3-8af9-ca388f3d8fbb service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:20:01.363557 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-8064103b-6d5f-4edc-9382-758d550ead9b req-eca3b7c8-1657-45c3-8af9-ca388f3d8fbb service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:20:01.375006 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-8064103b-6d5f-4edc-9382-758d550ead9b req-eca3b7c8-1657-45c3-8af9-ca388f3d8fbb service nova] Creating event network-changed:802b5db4-b15e-4714-8ab4-a1dfca1177bb for instance 6de86b94-5727-477c-a3ce-913a3d77764f on nch1-master-1 Oct 22 22:20:01.380977 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-8064103b-6d5f-4edc-9382-758d550ead9b req-eca3b7c8-1657-45c3-8af9-ca388f3d8fbb service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032335 Oct 22 22:20:01.381894 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3522/7014] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 22:20:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 22:22:27.302313 ncdv-master-1 devstack@n-api.service[138744]: ERROR oslo.messaging._drivers.impl_rabbit [-] [04d2594c-31df-45b7-a94b-e87da15c0f2c] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 22 22:22:27.303273 ncdv-master-1 devstack@n-api.service[138744]: ERROR oslo.messaging._drivers.impl_rabbit [-] [81790953-1e28-46a4-954d-7f89676de4fb] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 22 22:22:27.303884 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:22:27.304648 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:SELECT=40 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:22:27.305729 ncdv-master-1 devstack@n-api.service[138744]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 22 22:22:27.305915 ncdv-master-1 devstack@n-api.service[138744]: Sat Oct 22 22:22:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6de86b94-5727-477c-a3ce-913a3d77764f/action (ip 10.222.0.18) !!! Oct 22 22:22:27.307080 ncdv-master-1 devstack@n-api.service[138744]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 22 22:22:27.307220 ncdv-master-1 devstack@n-api.service[138744]: Sat Oct 22 22:22:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6de86b94-5727-477c-a3ce-913a3d77764f/action (ip 10.222.0.18) !!! Oct 22 22:22:27.309961 ncdv-master-1 devstack@n-api.service[138744]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 22 22:22:27.310096 ncdv-master-1 devstack@n-api.service[138744]: Sat Oct 22 22:22:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6de86b94-5727-477c-a3ce-913a3d77764f/action (ip 10.222.0.18) !!! Oct 22 22:22:27.315566 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-7f1372a2-7f3e-44f3-971e-6a3556c6ae13 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 22:22:27.316117 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-7f1372a2-7f3e-44f3-971e-6a3556c6ae13 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] [instance: 6de86b94-5727-477c-a3ce-913a3d77764f] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:22:27.326671 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7f1372a2-7f3e-44f3-971e-6a3556c6ae13 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:22:27.327164 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7f1372a2-7f3e-44f3-971e-6a3556c6ae13 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:22:27.327770 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7f1372a2-7f3e-44f3-971e-6a3556c6ae13 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:22:27.328485 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7f1372a2-7f3e-44f3-971e-6a3556c6ae13 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:22:27.328950 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7f1372a2-7f3e-44f3-971e-6a3556c6ae13 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:22:27.329385 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7f1372a2-7f3e-44f3-971e-6a3556c6ae13 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:22:27.356009 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.objects.instance [None req-7f1372a2-7f3e-44f3-971e-6a3556c6ae13 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lazy-loading 'flavor' on Instance uuid 6de86b94-5727-477c-a3ce-913a3d77764f {{(pid=138744) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 22:22:27.564776 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-7f1372a2-7f3e-44f3-971e-6a3556c6ae13 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] 10.222.0.18 "POST /compute/v2.1/servers/6de86b94-5727-477c-a3ce-913a3d77764f/action" status: 202 len: 0 microversion: 2.1 time: 0.264795 Oct 22 22:22:27.565313 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3493/7015] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 22:22:27 2022] POST /compute/v2.1/servers/6de86b94-5727-477c-a3ce-913a3d77764f/action => generated 0 bytes in 267 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 22 22:22:27.572976 ncdv-master-1 devstack@n-api.service[138745]: ERROR oslo.messaging._drivers.impl_rabbit [-] [82d96799-6494-46cc-9c4c-c1ce995f6091] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 22 22:22:27.577224 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-ef9f6300-5dcc-4a93-b428-5e4318081dd2 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:22:27.578164 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-ef9f6300-5dcc-4a93-b428-5e4318081dd2 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] [instance: 6de86b94-5727-477c-a3ce-913a3d77764f] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:22:27.580915 ncdv-master-1 devstack@n-api.service[138745]: ERROR oslo.messaging._drivers.impl_rabbit [-] [dbe685c1-0e25-4156-906e-a0926e5c28f4] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 22 22:22:27.581494 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:22:27.582180 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell1:SELECT=34 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:22:27.583185 ncdv-master-1 devstack@n-api.service[138745]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 22 22:22:27.583324 ncdv-master-1 devstack@n-api.service[138745]: Sat Oct 22 22:22:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6de86b94-5727-477c-a3ce-913a3d77764f (ip 10.222.0.18) !!! Oct 22 22:22:27.585020 ncdv-master-1 devstack@n-api.service[138745]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 22 22:22:27.585175 ncdv-master-1 devstack@n-api.service[138745]: Sat Oct 22 22:22:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6de86b94-5727-477c-a3ce-913a3d77764f (ip 10.222.0.18) !!! Oct 22 22:22:27.586257 ncdv-master-1 devstack@n-api.service[138745]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 22 22:22:27.586383 ncdv-master-1 devstack@n-api.service[138745]: Sat Oct 22 22:22:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6de86b94-5727-477c-a3ce-913a3d77764f (ip 10.222.0.18) !!! Oct 22 22:22:27.606064 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ef9f6300-5dcc-4a93-b428-5e4318081dd2 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:22:27.606611 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ef9f6300-5dcc-4a93-b428-5e4318081dd2 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:22:27.607074 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ef9f6300-5dcc-4a93-b428-5e4318081dd2 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:22:27.607849 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ef9f6300-5dcc-4a93-b428-5e4318081dd2 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:22:27.608322 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ef9f6300-5dcc-4a93-b428-5e4318081dd2 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:22:27.608766 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ef9f6300-5dcc-4a93-b428-5e4318081dd2 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:22:27.769788 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-ef9f6300-5dcc-4a93-b428-5e4318081dd2 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12dda477f454a20aff297708f052dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0a5546dd7e4676b6e1ae44898972e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:22:27.778317 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-ef9f6300-5dcc-4a93-b428-5e4318081dd2 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] 10.222.0.18 "GET /compute/v2.1/servers/6de86b94-5727-477c-a3ce-913a3d77764f" status: 200 len: 1682 microversion: 2.1 time: 0.207439 Oct 22 22:22:27.778897 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3523/7016] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:22:27 2022] GET /compute/v2.1/servers/6de86b94-5727-477c-a3ce-913a3d77764f => generated 1682 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:22:28.808317 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-784412b8-6552-4ab5-b453-13904adbf734 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:22:28.809246 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-784412b8-6552-4ab5-b453-13904adbf734 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] [instance: 6de86b94-5727-477c-a3ce-913a3d77764f] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:22:28.821780 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-784412b8-6552-4ab5-b453-13904adbf734 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:22:28.822446 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-784412b8-6552-4ab5-b453-13904adbf734 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:22:28.823004 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-784412b8-6552-4ab5-b453-13904adbf734 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:22:28.823969 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-784412b8-6552-4ab5-b453-13904adbf734 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:22:28.824571 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-784412b8-6552-4ab5-b453-13904adbf734 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:22:28.825140 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-784412b8-6552-4ab5-b453-13904adbf734 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:22:28.830954 ncdv-master-1 devstack@n-api.service[138744]: INFO oslo.messaging._drivers.impl_rabbit [-] [81790953-1e28-46a4-954d-7f89676de4fb] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 40156. Oct 22 22:22:28.832019 ncdv-master-1 devstack@n-api.service[138744]: INFO oslo.messaging._drivers.impl_rabbit [-] [04d2594c-31df-45b7-a94b-e87da15c0f2c] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 40154. Oct 22 22:22:28.962353 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-784412b8-6552-4ab5-b453-13904adbf734 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12dda477f454a20aff297708f052dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0a5546dd7e4676b6e1ae44898972e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:22:28.971078 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-784412b8-6552-4ab5-b453-13904adbf734 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] 10.222.0.18 "GET /compute/v2.1/servers/6de86b94-5727-477c-a3ce-913a3d77764f" status: 200 len: 1682 microversion: 2.1 time: 0.171317 Oct 22 22:22:28.971689 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3494/7017] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:22:28 2022] GET /compute/v2.1/servers/6de86b94-5727-477c-a3ce-913a3d77764f => generated 1682 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:22:29.996246 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-63473ad0-11b4-42b5-8ce2-33fa39142a76 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:22:29.996857 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-63473ad0-11b4-42b5-8ce2-33fa39142a76 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] [instance: 6de86b94-5727-477c-a3ce-913a3d77764f] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:22:30.005882 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-63473ad0-11b4-42b5-8ce2-33fa39142a76 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:22:30.006402 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-63473ad0-11b4-42b5-8ce2-33fa39142a76 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:22:30.006856 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-63473ad0-11b4-42b5-8ce2-33fa39142a76 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:22:30.007695 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-63473ad0-11b4-42b5-8ce2-33fa39142a76 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:22:30.008386 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-63473ad0-11b4-42b5-8ce2-33fa39142a76 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:22:30.008839 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-63473ad0-11b4-42b5-8ce2-33fa39142a76 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:22:30.013620 ncdv-master-1 devstack@n-api.service[138745]: INFO oslo.messaging._drivers.impl_rabbit [-] [82d96799-6494-46cc-9c4c-c1ce995f6091] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 40160. Oct 22 22:22:30.030854 ncdv-master-1 devstack@n-api.service[138745]: INFO oslo.messaging._drivers.impl_rabbit [-] [dbe685c1-0e25-4156-906e-a0926e5c28f4] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 40162. Oct 22 22:22:30.155621 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-63473ad0-11b4-42b5-8ce2-33fa39142a76 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12dda477f454a20aff297708f052dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0a5546dd7e4676b6e1ae44898972e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:22:30.167829 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-63473ad0-11b4-42b5-8ce2-33fa39142a76 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] 10.222.0.18 "GET /compute/v2.1/servers/6de86b94-5727-477c-a3ce-913a3d77764f" status: 200 len: 1682 microversion: 2.1 time: 0.175853 Oct 22 22:22:30.168586 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3524/7018] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:22:29 2022] GET /compute/v2.1/servers/6de86b94-5727-477c-a3ce-913a3d77764f => generated 1682 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:22:31.191178 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-9fb7b314-dc06-490f-a6d1-dedcf83e847f tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:22:31.191819 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-9fb7b314-dc06-490f-a6d1-dedcf83e847f tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] [instance: 6de86b94-5727-477c-a3ce-913a3d77764f] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:22:31.199216 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9fb7b314-dc06-490f-a6d1-dedcf83e847f tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:22:31.199740 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9fb7b314-dc06-490f-a6d1-dedcf83e847f tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:22:31.200181 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9fb7b314-dc06-490f-a6d1-dedcf83e847f tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:22:31.200873 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9fb7b314-dc06-490f-a6d1-dedcf83e847f tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:22:31.201336 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9fb7b314-dc06-490f-a6d1-dedcf83e847f tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:22:31.201766 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9fb7b314-dc06-490f-a6d1-dedcf83e847f tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:22:31.340095 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-9fb7b314-dc06-490f-a6d1-dedcf83e847f tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12dda477f454a20aff297708f052dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0a5546dd7e4676b6e1ae44898972e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:22:31.348312 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-9fb7b314-dc06-490f-a6d1-dedcf83e847f tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] 10.222.0.18 "GET /compute/v2.1/servers/6de86b94-5727-477c-a3ce-913a3d77764f" status: 200 len: 1682 microversion: 2.1 time: 0.161135 Oct 22 22:22:31.349106 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3495/7019] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:22:31 2022] GET /compute/v2.1/servers/6de86b94-5727-477c-a3ce-913a3d77764f => generated 1682 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:22:32.373872 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-27d77153-1821-4809-9d78-cf48416f833c tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:22:32.374632 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-27d77153-1821-4809-9d78-cf48416f833c tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] [instance: 6de86b94-5727-477c-a3ce-913a3d77764f] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:22:32.383931 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-27d77153-1821-4809-9d78-cf48416f833c tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:22:32.384596 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-27d77153-1821-4809-9d78-cf48416f833c tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:22:32.385197 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-27d77153-1821-4809-9d78-cf48416f833c tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:22:32.386092 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-27d77153-1821-4809-9d78-cf48416f833c tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:22:32.386706 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-27d77153-1821-4809-9d78-cf48416f833c tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:22:32.387261 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-27d77153-1821-4809-9d78-cf48416f833c tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:22:32.525606 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-27d77153-1821-4809-9d78-cf48416f833c tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12dda477f454a20aff297708f052dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0a5546dd7e4676b6e1ae44898972e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:22:32.534020 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-27d77153-1821-4809-9d78-cf48416f833c tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] 10.222.0.18 "GET /compute/v2.1/servers/6de86b94-5727-477c-a3ce-913a3d77764f" status: 200 len: 1682 microversion: 2.1 time: 0.165361 Oct 22 22:22:32.534606 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3525/7020] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:22:32 2022] GET /compute/v2.1/servers/6de86b94-5727-477c-a3ce-913a3d77764f => generated 1682 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:22:33.561813 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-7327fa81-71bf-46d4-ba79-96cdcd3ada37 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:22:33.562676 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-7327fa81-71bf-46d4-ba79-96cdcd3ada37 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] [instance: 6de86b94-5727-477c-a3ce-913a3d77764f] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:22:33.573703 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7327fa81-71bf-46d4-ba79-96cdcd3ada37 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:22:33.574192 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7327fa81-71bf-46d4-ba79-96cdcd3ada37 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:22:33.574634 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7327fa81-71bf-46d4-ba79-96cdcd3ada37 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:22:33.575332 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7327fa81-71bf-46d4-ba79-96cdcd3ada37 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:22:33.575824 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7327fa81-71bf-46d4-ba79-96cdcd3ada37 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:22:33.576250 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-7327fa81-71bf-46d4-ba79-96cdcd3ada37 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:22:33.729411 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-7327fa81-71bf-46d4-ba79-96cdcd3ada37 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12dda477f454a20aff297708f052dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0a5546dd7e4676b6e1ae44898972e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:22:33.737851 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-7327fa81-71bf-46d4-ba79-96cdcd3ada37 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] 10.222.0.18 "GET /compute/v2.1/servers/6de86b94-5727-477c-a3ce-913a3d77764f" status: 200 len: 1682 microversion: 2.1 time: 0.182972 Oct 22 22:22:33.738437 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3496/7021] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:22:33 2022] GET /compute/v2.1/servers/6de86b94-5727-477c-a3ce-913a3d77764f => generated 1682 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:22:34.762501 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-bbd5cadc-9bef-4bb0-b168-34076e9f29ac tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:22:34.763110 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-bbd5cadc-9bef-4bb0-b168-34076e9f29ac tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] [instance: 6de86b94-5727-477c-a3ce-913a3d77764f] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:22:34.770642 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bbd5cadc-9bef-4bb0-b168-34076e9f29ac tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:22:34.771191 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bbd5cadc-9bef-4bb0-b168-34076e9f29ac tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:22:34.771687 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bbd5cadc-9bef-4bb0-b168-34076e9f29ac tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:22:34.772416 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bbd5cadc-9bef-4bb0-b168-34076e9f29ac tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:22:34.772897 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bbd5cadc-9bef-4bb0-b168-34076e9f29ac tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:22:34.773345 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bbd5cadc-9bef-4bb0-b168-34076e9f29ac tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:22:34.930648 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-bbd5cadc-9bef-4bb0-b168-34076e9f29ac tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12dda477f454a20aff297708f052dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0a5546dd7e4676b6e1ae44898972e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:22:34.941110 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-bbd5cadc-9bef-4bb0-b168-34076e9f29ac tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] 10.222.0.18 "GET /compute/v2.1/servers/6de86b94-5727-477c-a3ce-913a3d77764f" status: 200 len: 1682 microversion: 2.1 time: 0.182736 Oct 22 22:22:34.941697 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3526/7022] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:22:34 2022] GET /compute/v2.1/servers/6de86b94-5727-477c-a3ce-913a3d77764f => generated 1682 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:22:35.964358 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-5b301ce8-d0d3-4b60-abb2-8750d445a811 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:22:35.965366 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-5b301ce8-d0d3-4b60-abb2-8750d445a811 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] [instance: 6de86b94-5727-477c-a3ce-913a3d77764f] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:22:35.972988 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5b301ce8-d0d3-4b60-abb2-8750d445a811 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:22:35.973478 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5b301ce8-d0d3-4b60-abb2-8750d445a811 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:22:35.973929 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5b301ce8-d0d3-4b60-abb2-8750d445a811 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:22:35.974637 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5b301ce8-d0d3-4b60-abb2-8750d445a811 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:22:35.975106 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5b301ce8-d0d3-4b60-abb2-8750d445a811 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:22:35.975578 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5b301ce8-d0d3-4b60-abb2-8750d445a811 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:22:36.117176 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-5b301ce8-d0d3-4b60-abb2-8750d445a811 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12dda477f454a20aff297708f052dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0a5546dd7e4676b6e1ae44898972e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:22:36.125588 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-5b301ce8-d0d3-4b60-abb2-8750d445a811 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] 10.222.0.18 "GET /compute/v2.1/servers/6de86b94-5727-477c-a3ce-913a3d77764f" status: 200 len: 1682 microversion: 2.1 time: 0.165344 Oct 22 22:22:36.126209 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3497/7023] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:22:35 2022] GET /compute/v2.1/servers/6de86b94-5727-477c-a3ce-913a3d77764f => generated 1682 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:22:37.153615 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-1ba98b4e-3be0-432d-8df1-4ca25fb9931d tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:22:37.154745 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-1ba98b4e-3be0-432d-8df1-4ca25fb9931d tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] [instance: 6de86b94-5727-477c-a3ce-913a3d77764f] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:22:37.167842 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1ba98b4e-3be0-432d-8df1-4ca25fb9931d tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:22:37.168342 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1ba98b4e-3be0-432d-8df1-4ca25fb9931d tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:22:37.168803 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1ba98b4e-3be0-432d-8df1-4ca25fb9931d tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:22:37.169547 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1ba98b4e-3be0-432d-8df1-4ca25fb9931d tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:22:37.170048 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1ba98b4e-3be0-432d-8df1-4ca25fb9931d tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:22:37.170496 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1ba98b4e-3be0-432d-8df1-4ca25fb9931d tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:22:37.310270 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-1ba98b4e-3be0-432d-8df1-4ca25fb9931d tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12dda477f454a20aff297708f052dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0a5546dd7e4676b6e1ae44898972e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:22:37.319415 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-1ba98b4e-3be0-432d-8df1-4ca25fb9931d tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] 10.222.0.18 "GET /compute/v2.1/servers/6de86b94-5727-477c-a3ce-913a3d77764f" status: 200 len: 1682 microversion: 2.1 time: 0.172641 Oct 22 22:22:37.320002 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3527/7024] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:22:37 2022] GET /compute/v2.1/servers/6de86b94-5727-477c-a3ce-913a3d77764f => generated 1682 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:22:38.343384 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-d738b989-8b0d-41c9-8bb9-3332925b271a tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:22:38.343936 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-d738b989-8b0d-41c9-8bb9-3332925b271a tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] [instance: 6de86b94-5727-477c-a3ce-913a3d77764f] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:22:38.351576 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d738b989-8b0d-41c9-8bb9-3332925b271a tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:22:38.352071 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d738b989-8b0d-41c9-8bb9-3332925b271a tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:22:38.352518 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d738b989-8b0d-41c9-8bb9-3332925b271a tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:22:38.353225 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d738b989-8b0d-41c9-8bb9-3332925b271a tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:22:38.353840 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d738b989-8b0d-41c9-8bb9-3332925b271a tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:22:38.354305 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d738b989-8b0d-41c9-8bb9-3332925b271a tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:22:38.506038 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-d738b989-8b0d-41c9-8bb9-3332925b271a tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12dda477f454a20aff297708f052dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0a5546dd7e4676b6e1ae44898972e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:22:38.514423 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-d738b989-8b0d-41c9-8bb9-3332925b271a tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] 10.222.0.18 "GET /compute/v2.1/servers/6de86b94-5727-477c-a3ce-913a3d77764f" status: 200 len: 1682 microversion: 2.1 time: 0.175553 Oct 22 22:22:38.515006 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3498/7025] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:22:38 2022] GET /compute/v2.1/servers/6de86b94-5727-477c-a3ce-913a3d77764f => generated 1682 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:22:39.541642 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-cbdf4724-f935-4721-80f3-aa63ecd3be93 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:22:39.542317 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-cbdf4724-f935-4721-80f3-aa63ecd3be93 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] [instance: 6de86b94-5727-477c-a3ce-913a3d77764f] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:22:39.550312 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cbdf4724-f935-4721-80f3-aa63ecd3be93 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:22:39.550853 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cbdf4724-f935-4721-80f3-aa63ecd3be93 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:22:39.551367 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cbdf4724-f935-4721-80f3-aa63ecd3be93 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:22:39.552137 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cbdf4724-f935-4721-80f3-aa63ecd3be93 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:22:39.552643 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cbdf4724-f935-4721-80f3-aa63ecd3be93 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:22:39.553117 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cbdf4724-f935-4721-80f3-aa63ecd3be93 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:22:39.692198 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-cbdf4724-f935-4721-80f3-aa63ecd3be93 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12dda477f454a20aff297708f052dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0a5546dd7e4676b6e1ae44898972e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:22:39.704491 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-cbdf4724-f935-4721-80f3-aa63ecd3be93 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] 10.222.0.18 "GET /compute/v2.1/servers/6de86b94-5727-477c-a3ce-913a3d77764f" status: 200 len: 1703 microversion: 2.1 time: 0.169495 Oct 22 22:22:39.705273 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3528/7026] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:22:39 2022] GET /compute/v2.1/servers/6de86b94-5727-477c-a3ce-913a3d77764f => generated 1703 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:22:40.734513 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-8d56c5a2-403b-4893-a3f4-471194677b56 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:22:40.735576 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-8d56c5a2-403b-4893-a3f4-471194677b56 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] [instance: 6de86b94-5727-477c-a3ce-913a3d77764f] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:22:40.746129 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8d56c5a2-403b-4893-a3f4-471194677b56 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:22:40.746624 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8d56c5a2-403b-4893-a3f4-471194677b56 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:22:40.747068 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8d56c5a2-403b-4893-a3f4-471194677b56 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:22:40.747818 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8d56c5a2-403b-4893-a3f4-471194677b56 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:22:40.748283 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8d56c5a2-403b-4893-a3f4-471194677b56 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:22:40.748720 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8d56c5a2-403b-4893-a3f4-471194677b56 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:22:40.888635 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-8d56c5a2-403b-4893-a3f4-471194677b56 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12dda477f454a20aff297708f052dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0a5546dd7e4676b6e1ae44898972e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:22:40.896952 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-8d56c5a2-403b-4893-a3f4-471194677b56 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] 10.222.0.18 "GET /compute/v2.1/servers/6de86b94-5727-477c-a3ce-913a3d77764f" status: 200 len: 1703 microversion: 2.1 time: 0.169092 Oct 22 22:22:40.897538 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3499/7027] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:22:40 2022] GET /compute/v2.1/servers/6de86b94-5727-477c-a3ce-913a3d77764f => generated 1703 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:22:41.924869 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-59bfcfe7-560e-4998-af7d-d8a7df100570 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:22:41.925923 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-59bfcfe7-560e-4998-af7d-d8a7df100570 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] [instance: 6de86b94-5727-477c-a3ce-913a3d77764f] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:22:41.935333 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-59bfcfe7-560e-4998-af7d-d8a7df100570 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:22:41.935878 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-59bfcfe7-560e-4998-af7d-d8a7df100570 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:22:41.936342 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-59bfcfe7-560e-4998-af7d-d8a7df100570 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:22:41.937073 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-59bfcfe7-560e-4998-af7d-d8a7df100570 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:22:41.937562 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-59bfcfe7-560e-4998-af7d-d8a7df100570 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:22:41.938017 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-59bfcfe7-560e-4998-af7d-d8a7df100570 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:22:42.086865 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-59bfcfe7-560e-4998-af7d-d8a7df100570 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12dda477f454a20aff297708f052dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0a5546dd7e4676b6e1ae44898972e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:22:42.096120 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-59bfcfe7-560e-4998-af7d-d8a7df100570 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] 10.222.0.18 "GET /compute/v2.1/servers/6de86b94-5727-477c-a3ce-913a3d77764f" status: 200 len: 1703 microversion: 2.1 time: 0.178147 Oct 22 22:22:42.096679 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3529/7028] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:22:41 2022] GET /compute/v2.1/servers/6de86b94-5727-477c-a3ce-913a3d77764f => generated 1703 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:22:42.483724 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-aa0b0fea-795c-4812-ba89-cdc9069549d5 req-7aca71e3-397b-4e0f-96c8-d9a9dd5a4e2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6de86b94-5727-477c-a3ce-913a3d77764f", "name": "network-vif-plugged", "status": "completed", "tag": "802b5db4-b15e-4714-8ab4-a1dfca1177bb"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 22:22:42.494240 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-aa0b0fea-795c-4812-ba89-cdc9069549d5 req-7aca71e3-397b-4e0f-96c8-d9a9dd5a4e2f service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:22:42.494743 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-aa0b0fea-795c-4812-ba89-cdc9069549d5 req-7aca71e3-397b-4e0f-96c8-d9a9dd5a4e2f service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:22:42.495188 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-aa0b0fea-795c-4812-ba89-cdc9069549d5 req-7aca71e3-397b-4e0f-96c8-d9a9dd5a4e2f service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:22:42.507142 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-aa0b0fea-795c-4812-ba89-cdc9069549d5 req-7aca71e3-397b-4e0f-96c8-d9a9dd5a4e2f service nova] Creating event network-vif-plugged:802b5db4-b15e-4714-8ab4-a1dfca1177bb for instance 6de86b94-5727-477c-a3ce-913a3d77764f on nch1-master-1 Oct 22 22:22:42.512562 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-aa0b0fea-795c-4812-ba89-cdc9069549d5 req-7aca71e3-397b-4e0f-96c8-d9a9dd5a4e2f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032660 Oct 22 22:22:42.513139 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3500/7029] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 22:22:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 22:22:43.123701 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-336c870e-e5ab-4376-8f92-eff29b32161e tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:22:43.124743 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-336c870e-e5ab-4376-8f92-eff29b32161e tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] [instance: 6de86b94-5727-477c-a3ce-913a3d77764f] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:22:43.135792 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-336c870e-e5ab-4376-8f92-eff29b32161e tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:22:43.136300 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-336c870e-e5ab-4376-8f92-eff29b32161e tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:22:43.136766 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-336c870e-e5ab-4376-8f92-eff29b32161e tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:22:43.137489 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-336c870e-e5ab-4376-8f92-eff29b32161e tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:22:43.137972 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-336c870e-e5ab-4376-8f92-eff29b32161e tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:22:43.138416 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-336c870e-e5ab-4376-8f92-eff29b32161e tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:22:43.282014 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-336c870e-e5ab-4376-8f92-eff29b32161e tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12dda477f454a20aff297708f052dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0a5546dd7e4676b6e1ae44898972e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:22:43.290505 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-336c870e-e5ab-4376-8f92-eff29b32161e tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] 10.222.0.18 "GET /compute/v2.1/servers/6de86b94-5727-477c-a3ce-913a3d77764f" status: 200 len: 1703 microversion: 2.1 time: 0.173582 Oct 22 22:22:43.291086 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3530/7030] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:22:43 2022] GET /compute/v2.1/servers/6de86b94-5727-477c-a3ce-913a3d77764f => generated 1703 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:22:44.315969 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-cca1503d-6224-4e89-b3b9-f327f3b3f99e tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:22:44.316641 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-cca1503d-6224-4e89-b3b9-f327f3b3f99e tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] [instance: 6de86b94-5727-477c-a3ce-913a3d77764f] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:22:44.323241 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cca1503d-6224-4e89-b3b9-f327f3b3f99e tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:22:44.323761 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cca1503d-6224-4e89-b3b9-f327f3b3f99e tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:22:44.324191 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cca1503d-6224-4e89-b3b9-f327f3b3f99e tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:22:44.324883 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cca1503d-6224-4e89-b3b9-f327f3b3f99e tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:22:44.325334 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cca1503d-6224-4e89-b3b9-f327f3b3f99e tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:22:44.325760 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-cca1503d-6224-4e89-b3b9-f327f3b3f99e tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:22:44.492425 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-cca1503d-6224-4e89-b3b9-f327f3b3f99e tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12dda477f454a20aff297708f052dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0a5546dd7e4676b6e1ae44898972e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:22:44.505973 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-cca1503d-6224-4e89-b3b9-f327f3b3f99e tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] 10.222.0.18 "GET /compute/v2.1/servers/6de86b94-5727-477c-a3ce-913a3d77764f" status: 200 len: 1698 microversion: 2.1 time: 0.195304 Oct 22 22:22:44.506727 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3501/7031] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:22:44 2022] GET /compute/v2.1/servers/6de86b94-5727-477c-a3ce-913a3d77764f => generated 1698 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:22:45.530457 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-c88ca531-5c93-43fe-8c9c-194ff75228ae tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:22:45.530976 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-c88ca531-5c93-43fe-8c9c-194ff75228ae tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] [instance: 6de86b94-5727-477c-a3ce-913a3d77764f] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:22:45.541615 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c88ca531-5c93-43fe-8c9c-194ff75228ae tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:22:45.542130 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c88ca531-5c93-43fe-8c9c-194ff75228ae tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:22:45.542611 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c88ca531-5c93-43fe-8c9c-194ff75228ae tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:22:45.543486 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c88ca531-5c93-43fe-8c9c-194ff75228ae tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:22:45.544114 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c88ca531-5c93-43fe-8c9c-194ff75228ae tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:22:45.544579 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c88ca531-5c93-43fe-8c9c-194ff75228ae tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:22:45.695169 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-c88ca531-5c93-43fe-8c9c-194ff75228ae tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12dda477f454a20aff297708f052dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0a5546dd7e4676b6e1ae44898972e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:22:45.704907 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-c88ca531-5c93-43fe-8c9c-194ff75228ae tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] 10.222.0.18 "GET /compute/v2.1/servers/6de86b94-5727-477c-a3ce-913a3d77764f" status: 200 len: 1698 microversion: 2.1 time: 0.178560 Oct 22 22:22:45.705949 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3531/7032] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:22:45 2022] GET /compute/v2.1/servers/6de86b94-5727-477c-a3ce-913a3d77764f => generated 1698 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:22:46.733779 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-fe24faef-fd9e-4f2d-9cd0-1e2b4a6b368b tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:22:46.734411 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-fe24faef-fd9e-4f2d-9cd0-1e2b4a6b368b tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] [instance: 6de86b94-5727-477c-a3ce-913a3d77764f] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:22:46.742284 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fe24faef-fd9e-4f2d-9cd0-1e2b4a6b368b tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:22:46.743051 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fe24faef-fd9e-4f2d-9cd0-1e2b4a6b368b tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:22:46.743620 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fe24faef-fd9e-4f2d-9cd0-1e2b4a6b368b tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:22:46.744539 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fe24faef-fd9e-4f2d-9cd0-1e2b4a6b368b tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:22:46.745001 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fe24faef-fd9e-4f2d-9cd0-1e2b4a6b368b tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:22:46.745446 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-fe24faef-fd9e-4f2d-9cd0-1e2b4a6b368b tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:22:46.891742 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-fe24faef-fd9e-4f2d-9cd0-1e2b4a6b368b tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12dda477f454a20aff297708f052dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0a5546dd7e4676b6e1ae44898972e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:22:46.901321 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-fe24faef-fd9e-4f2d-9cd0-1e2b4a6b368b tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] 10.222.0.18 "GET /compute/v2.1/servers/6de86b94-5727-477c-a3ce-913a3d77764f" status: 200 len: 1698 microversion: 2.1 time: 0.171727 Oct 22 22:22:46.901959 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3502/7033] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:22:46 2022] GET /compute/v2.1/servers/6de86b94-5727-477c-a3ce-913a3d77764f => generated 1698 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:22:47.930698 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-a8035f4c-c20e-40f5-9123-3d94987b8e12 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:22:47.931553 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-a8035f4c-c20e-40f5-9123-3d94987b8e12 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] [instance: 6de86b94-5727-477c-a3ce-913a3d77764f] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:22:47.942041 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a8035f4c-c20e-40f5-9123-3d94987b8e12 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:22:47.942575 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a8035f4c-c20e-40f5-9123-3d94987b8e12 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:22:47.943065 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a8035f4c-c20e-40f5-9123-3d94987b8e12 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:22:47.945454 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a8035f4c-c20e-40f5-9123-3d94987b8e12 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:22:47.945985 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a8035f4c-c20e-40f5-9123-3d94987b8e12 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:22:47.946473 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a8035f4c-c20e-40f5-9123-3d94987b8e12 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:22:48.114597 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-a8035f4c-c20e-40f5-9123-3d94987b8e12 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12dda477f454a20aff297708f052dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0a5546dd7e4676b6e1ae44898972e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:22:48.123675 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-a8035f4c-c20e-40f5-9123-3d94987b8e12 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] 10.222.0.18 "GET /compute/v2.1/servers/6de86b94-5727-477c-a3ce-913a3d77764f" status: 200 len: 1698 microversion: 2.1 time: 0.201990 Oct 22 22:22:48.124485 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3532/7034] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:22:47 2022] GET /compute/v2.1/servers/6de86b94-5727-477c-a3ce-913a3d77764f => generated 1698 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:22:49.151086 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-30de93a8-2ec9-4535-9cc4-2b779b95d235 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:22:49.152052 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-30de93a8-2ec9-4535-9cc4-2b779b95d235 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] [instance: 6de86b94-5727-477c-a3ce-913a3d77764f] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:22:49.161190 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-30de93a8-2ec9-4535-9cc4-2b779b95d235 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:22:49.161886 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-30de93a8-2ec9-4535-9cc4-2b779b95d235 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:22:49.162340 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-30de93a8-2ec9-4535-9cc4-2b779b95d235 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:22:49.163042 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-30de93a8-2ec9-4535-9cc4-2b779b95d235 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:22:49.163559 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-30de93a8-2ec9-4535-9cc4-2b779b95d235 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:22:49.163993 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-30de93a8-2ec9-4535-9cc4-2b779b95d235 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:22:49.311171 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-30de93a8-2ec9-4535-9cc4-2b779b95d235 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12dda477f454a20aff297708f052dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0a5546dd7e4676b6e1ae44898972e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:22:49.319874 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-30de93a8-2ec9-4535-9cc4-2b779b95d235 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] 10.222.0.18 "GET /compute/v2.1/servers/6de86b94-5727-477c-a3ce-913a3d77764f" status: 200 len: 1698 microversion: 2.1 time: 0.172616 Oct 22 22:22:49.320474 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3503/7035] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:22:49 2022] GET /compute/v2.1/servers/6de86b94-5727-477c-a3ce-913a3d77764f => generated 1698 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:22:50.345039 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-4d019b95-9a17-40ad-8f6c-c55ae5cc8fa4 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:22:50.345693 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-4d019b95-9a17-40ad-8f6c-c55ae5cc8fa4 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] [instance: 6de86b94-5727-477c-a3ce-913a3d77764f] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:22:50.354657 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4d019b95-9a17-40ad-8f6c-c55ae5cc8fa4 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:22:50.355271 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4d019b95-9a17-40ad-8f6c-c55ae5cc8fa4 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:22:50.355832 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4d019b95-9a17-40ad-8f6c-c55ae5cc8fa4 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:22:50.356645 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4d019b95-9a17-40ad-8f6c-c55ae5cc8fa4 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:22:50.357413 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4d019b95-9a17-40ad-8f6c-c55ae5cc8fa4 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:22:50.357943 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4d019b95-9a17-40ad-8f6c-c55ae5cc8fa4 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:22:50.522867 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-4d019b95-9a17-40ad-8f6c-c55ae5cc8fa4 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12dda477f454a20aff297708f052dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0a5546dd7e4676b6e1ae44898972e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:22:50.533660 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-4d019b95-9a17-40ad-8f6c-c55ae5cc8fa4 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] 10.222.0.18 "GET /compute/v2.1/servers/6de86b94-5727-477c-a3ce-913a3d77764f" status: 200 len: 1698 microversion: 2.1 time: 0.193130 Oct 22 22:22:50.534301 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3533/7036] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:22:50 2022] GET /compute/v2.1/servers/6de86b94-5727-477c-a3ce-913a3d77764f => generated 1698 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:22:51.558335 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-b2aff03d-6cba-4af6-b2aa-e6d4e31d3b1b tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:22:51.559657 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-b2aff03d-6cba-4af6-b2aa-e6d4e31d3b1b tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] [instance: 6de86b94-5727-477c-a3ce-913a3d77764f] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:22:51.566947 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b2aff03d-6cba-4af6-b2aa-e6d4e31d3b1b tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:22:51.567522 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b2aff03d-6cba-4af6-b2aa-e6d4e31d3b1b tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:22:51.567984 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b2aff03d-6cba-4af6-b2aa-e6d4e31d3b1b tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:22:51.568707 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b2aff03d-6cba-4af6-b2aa-e6d4e31d3b1b tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:22:51.569146 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b2aff03d-6cba-4af6-b2aa-e6d4e31d3b1b tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:22:51.569588 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b2aff03d-6cba-4af6-b2aa-e6d4e31d3b1b tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:22:51.720936 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-b2aff03d-6cba-4af6-b2aa-e6d4e31d3b1b tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12dda477f454a20aff297708f052dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0a5546dd7e4676b6e1ae44898972e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:22:51.729947 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-b2aff03d-6cba-4af6-b2aa-e6d4e31d3b1b tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] 10.222.0.18 "GET /compute/v2.1/servers/6de86b94-5727-477c-a3ce-913a3d77764f" status: 200 len: 1698 microversion: 2.1 time: 0.175661 Oct 22 22:22:51.730900 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3504/7037] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:22:51 2022] GET /compute/v2.1/servers/6de86b94-5727-477c-a3ce-913a3d77764f => generated 1698 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:22:52.754269 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-918057ac-142d-4aa7-96ab-6d4fc324adc8 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:22:52.755693 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-918057ac-142d-4aa7-96ab-6d4fc324adc8 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] [instance: 6de86b94-5727-477c-a3ce-913a3d77764f] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:22:52.766785 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-918057ac-142d-4aa7-96ab-6d4fc324adc8 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:22:52.767307 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-918057ac-142d-4aa7-96ab-6d4fc324adc8 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:22:52.767802 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-918057ac-142d-4aa7-96ab-6d4fc324adc8 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:22:52.768529 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-918057ac-142d-4aa7-96ab-6d4fc324adc8 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:22:52.769133 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-918057ac-142d-4aa7-96ab-6d4fc324adc8 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:22:52.769728 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-918057ac-142d-4aa7-96ab-6d4fc324adc8 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:22:52.945307 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-918057ac-142d-4aa7-96ab-6d4fc324adc8 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12dda477f454a20aff297708f052dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0a5546dd7e4676b6e1ae44898972e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:22:52.954207 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-918057ac-142d-4aa7-96ab-6d4fc324adc8 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] 10.222.0.18 "GET /compute/v2.1/servers/6de86b94-5727-477c-a3ce-913a3d77764f" status: 200 len: 1698 microversion: 2.1 time: 0.204200 Oct 22 22:22:52.955512 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3534/7038] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:22:52 2022] GET /compute/v2.1/servers/6de86b94-5727-477c-a3ce-913a3d77764f => generated 1698 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:22:53.981108 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-1343bcb9-3d09-43aa-a587-e098eb983ebf tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:22:53.981792 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-1343bcb9-3d09-43aa-a587-e098eb983ebf tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] [instance: 6de86b94-5727-477c-a3ce-913a3d77764f] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:22:53.988937 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1343bcb9-3d09-43aa-a587-e098eb983ebf tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:22:53.989391 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1343bcb9-3d09-43aa-a587-e098eb983ebf tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:22:53.989836 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1343bcb9-3d09-43aa-a587-e098eb983ebf tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:22:53.990547 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1343bcb9-3d09-43aa-a587-e098eb983ebf tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:22:53.991006 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1343bcb9-3d09-43aa-a587-e098eb983ebf tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:22:53.991482 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1343bcb9-3d09-43aa-a587-e098eb983ebf tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:22:54.202248 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-1343bcb9-3d09-43aa-a587-e098eb983ebf tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12dda477f454a20aff297708f052dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0a5546dd7e4676b6e1ae44898972e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:22:54.210611 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-1343bcb9-3d09-43aa-a587-e098eb983ebf tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] 10.222.0.18 "GET /compute/v2.1/servers/6de86b94-5727-477c-a3ce-913a3d77764f" status: 200 len: 1680 microversion: 2.1 time: 0.233601 Oct 22 22:22:54.211164 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3505/7039] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:22:53 2022] GET /compute/v2.1/servers/6de86b94-5727-477c-a3ce-913a3d77764f => generated 1680 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:22:55.234849 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-595e3a61-457d-4d8c-9533-4575348795ef tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:22:55.235573 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-595e3a61-457d-4d8c-9533-4575348795ef tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] [instance: 6de86b94-5727-477c-a3ce-913a3d77764f] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:22:55.242933 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-595e3a61-457d-4d8c-9533-4575348795ef tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:22:55.243773 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-595e3a61-457d-4d8c-9533-4575348795ef tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:22:55.244255 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-595e3a61-457d-4d8c-9533-4575348795ef tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:22:55.244968 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-595e3a61-457d-4d8c-9533-4575348795ef tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:22:55.245454 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-595e3a61-457d-4d8c-9533-4575348795ef tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:22:55.245898 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-595e3a61-457d-4d8c-9533-4575348795ef tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:22:55.388954 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-595e3a61-457d-4d8c-9533-4575348795ef tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12dda477f454a20aff297708f052dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0a5546dd7e4676b6e1ae44898972e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:22:55.397526 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-595e3a61-457d-4d8c-9533-4575348795ef tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] 10.222.0.18 "GET /compute/v2.1/servers/6de86b94-5727-477c-a3ce-913a3d77764f" status: 200 len: 1680 microversion: 2.1 time: 0.166749 Oct 22 22:22:55.398111 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3535/7040] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:22:55 2022] GET /compute/v2.1/servers/6de86b94-5727-477c-a3ce-913a3d77764f => generated 1680 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:22:56.338257 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-1ce33b5d-2cb7-4372-9da3-681d5ae6e9e0 req-1befde90-422f-4854-a782-70153927aa04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6de86b94-5727-477c-a3ce-913a3d77764f", "name": "network-vif-unplugged", "status": "completed", "tag": "802b5db4-b15e-4714-8ab4-a1dfca1177bb"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 22:22:56.350681 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-1ce33b5d-2cb7-4372-9da3-681d5ae6e9e0 req-1befde90-422f-4854-a782-70153927aa04 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:22:56.351240 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-1ce33b5d-2cb7-4372-9da3-681d5ae6e9e0 req-1befde90-422f-4854-a782-70153927aa04 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:22:56.352109 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-1ce33b5d-2cb7-4372-9da3-681d5ae6e9e0 req-1befde90-422f-4854-a782-70153927aa04 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:22:56.365550 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-1ce33b5d-2cb7-4372-9da3-681d5ae6e9e0 req-1befde90-422f-4854-a782-70153927aa04 service nova] Creating event network-vif-unplugged:802b5db4-b15e-4714-8ab4-a1dfca1177bb for instance 6de86b94-5727-477c-a3ce-913a3d77764f on nch1-master-1 Oct 22 22:22:56.371640 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-1ce33b5d-2cb7-4372-9da3-681d5ae6e9e0 req-1befde90-422f-4854-a782-70153927aa04 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037233 Oct 22 22:22:56.373050 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3506/7041] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 22:22:56 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 22:22:56.422695 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-3b1f85d3-f54c-49b3-81dd-a3e8aab329e9 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:22:56.423438 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-3b1f85d3-f54c-49b3-81dd-a3e8aab329e9 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] [instance: 6de86b94-5727-477c-a3ce-913a3d77764f] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:22:56.430555 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3b1f85d3-f54c-49b3-81dd-a3e8aab329e9 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:22:56.431040 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3b1f85d3-f54c-49b3-81dd-a3e8aab329e9 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:22:56.431652 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3b1f85d3-f54c-49b3-81dd-a3e8aab329e9 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:22:56.432467 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3b1f85d3-f54c-49b3-81dd-a3e8aab329e9 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:22:56.432938 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3b1f85d3-f54c-49b3-81dd-a3e8aab329e9 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:22:56.433381 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3b1f85d3-f54c-49b3-81dd-a3e8aab329e9 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:22:56.583472 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-3b1f85d3-f54c-49b3-81dd-a3e8aab329e9 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12dda477f454a20aff297708f052dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0a5546dd7e4676b6e1ae44898972e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:22:56.592062 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-3b1f85d3-f54c-49b3-81dd-a3e8aab329e9 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] 10.222.0.18 "GET /compute/v2.1/servers/6de86b94-5727-477c-a3ce-913a3d77764f" status: 200 len: 1623 microversion: 2.1 time: 0.174461 Oct 22 22:22:56.592651 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3536/7042] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:22:56 2022] GET /compute/v2.1/servers/6de86b94-5727-477c-a3ce-913a3d77764f => generated 1623 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:22:56.615320 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-754dff5e-ee79-454c-b96d-be83c54286ff tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 22:22:56.616091 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-754dff5e-ee79-454c-b96d-be83c54286ff tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] [instance: 6de86b94-5727-477c-a3ce-913a3d77764f] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:22:56.622662 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-754dff5e-ee79-454c-b96d-be83c54286ff tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:22:56.623365 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-754dff5e-ee79-454c-b96d-be83c54286ff tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:22:56.623810 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-754dff5e-ee79-454c-b96d-be83c54286ff tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:22:56.624511 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-754dff5e-ee79-454c-b96d-be83c54286ff tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:22:56.624974 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-754dff5e-ee79-454c-b96d-be83c54286ff tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:22:56.625411 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-754dff5e-ee79-454c-b96d-be83c54286ff tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:22:56.669172 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-754dff5e-ee79-454c-b96d-be83c54286ff tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] [instance: 6de86b94-5727-477c-a3ce-913a3d77764f] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=138744) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 22 22:22:56.730295 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:22:56.749658 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-754dff5e-ee79-454c-b96d-be83c54286ff tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] 10.222.0.18 "POST /compute/v2.1/servers/6de86b94-5727-477c-a3ce-913a3d77764f/action" status: 202 len: 0 microversion: 2.1 time: 0.138674 Oct 22 22:22:56.750442 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3507/7043] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 22:22:56 2022] POST /compute/v2.1/servers/6de86b94-5727-477c-a3ce-913a3d77764f/action => generated 0 bytes in 140 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 22:22:56.758972 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-727c808d-9c86-42e1-8f86-49eb67aefc46 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:22:56.759623 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-727c808d-9c86-42e1-8f86-49eb67aefc46 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] [instance: 6de86b94-5727-477c-a3ce-913a3d77764f] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:22:56.765904 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-727c808d-9c86-42e1-8f86-49eb67aefc46 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:22:56.766406 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-727c808d-9c86-42e1-8f86-49eb67aefc46 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:22:56.766859 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-727c808d-9c86-42e1-8f86-49eb67aefc46 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:22:56.767620 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-727c808d-9c86-42e1-8f86-49eb67aefc46 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:22:56.768072 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-727c808d-9c86-42e1-8f86-49eb67aefc46 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:22:56.768510 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-727c808d-9c86-42e1-8f86-49eb67aefc46 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:22:56.903918 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-727c808d-9c86-42e1-8f86-49eb67aefc46 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12dda477f454a20aff297708f052dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0a5546dd7e4676b6e1ae44898972e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:22:56.912035 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-727c808d-9c86-42e1-8f86-49eb67aefc46 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] 10.222.0.18 "GET /compute/v2.1/servers/6de86b94-5727-477c-a3ce-913a3d77764f" status: 200 len: 1631 microversion: 2.1 time: 0.157075 Oct 22 22:22:56.912820 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3537/7044] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:22:56 2022] GET /compute/v2.1/servers/6de86b94-5727-477c-a3ce-913a3d77764f => generated 1631 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:22:57.938149 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-3a7f9f60-2964-47c3-ab75-01aaae00525f tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:22:57.938786 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-3a7f9f60-2964-47c3-ab75-01aaae00525f tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] [instance: 6de86b94-5727-477c-a3ce-913a3d77764f] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:22:57.940684 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:22:57.946297 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3a7f9f60-2964-47c3-ab75-01aaae00525f tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:22:57.946802 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3a7f9f60-2964-47c3-ab75-01aaae00525f tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:22:57.947363 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3a7f9f60-2964-47c3-ab75-01aaae00525f tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:22:57.948096 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3a7f9f60-2964-47c3-ab75-01aaae00525f tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:22:57.948559 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3a7f9f60-2964-47c3-ab75-01aaae00525f tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:22:57.949165 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3a7f9f60-2964-47c3-ab75-01aaae00525f tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:22:58.474592 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-3a7f9f60-2964-47c3-ab75-01aaae00525f tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12dda477f454a20aff297708f052dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0a5546dd7e4676b6e1ae44898972e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:22:58.484183 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-3a7f9f60-2964-47c3-ab75-01aaae00525f tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] 10.222.0.18 "GET /compute/v2.1/servers/6de86b94-5727-477c-a3ce-913a3d77764f" status: 200 len: 1631 microversion: 2.1 time: 0.551187 Oct 22 22:22:58.485066 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3508/7045] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:22:57 2022] GET /compute/v2.1/servers/6de86b94-5727-477c-a3ce-913a3d77764f => generated 1631 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:22:59.513988 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-63c37e11-7fa5-442c-a51d-afeefd8a17f7 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:22:59.514700 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-63c37e11-7fa5-442c-a51d-afeefd8a17f7 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] [instance: 6de86b94-5727-477c-a3ce-913a3d77764f] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:22:59.517774 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_api:SELECT=33 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:22:59.523925 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-63c37e11-7fa5-442c-a51d-afeefd8a17f7 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:22:59.524486 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-63c37e11-7fa5-442c-a51d-afeefd8a17f7 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:22:59.524994 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-63c37e11-7fa5-442c-a51d-afeefd8a17f7 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:22:59.525799 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-63c37e11-7fa5-442c-a51d-afeefd8a17f7 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:22:59.526326 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-63c37e11-7fa5-442c-a51d-afeefd8a17f7 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:22:59.526823 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-63c37e11-7fa5-442c-a51d-afeefd8a17f7 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:22:59.530010 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell1:SELECT=91 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:22:59.676254 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-63c37e11-7fa5-442c-a51d-afeefd8a17f7 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12dda477f454a20aff297708f052dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0a5546dd7e4676b6e1ae44898972e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:22:59.684913 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-63c37e11-7fa5-442c-a51d-afeefd8a17f7 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] 10.222.0.18 "GET /compute/v2.1/servers/6de86b94-5727-477c-a3ce-913a3d77764f" status: 200 len: 1631 microversion: 2.1 time: 0.176618 Oct 22 22:22:59.685464 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3538/7046] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:22:59 2022] GET /compute/v2.1/servers/6de86b94-5727-477c-a3ce-913a3d77764f => generated 1631 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:23:00.713070 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-0f1a977b-a64c-40e0-bf22-2873226a4888 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:23:00.714044 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-0f1a977b-a64c-40e0-bf22-2873226a4888 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] [instance: 6de86b94-5727-477c-a3ce-913a3d77764f] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:23:00.722366 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0f1a977b-a64c-40e0-bf22-2873226a4888 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:23:00.722853 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0f1a977b-a64c-40e0-bf22-2873226a4888 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:23:00.723304 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0f1a977b-a64c-40e0-bf22-2873226a4888 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:23:00.724032 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0f1a977b-a64c-40e0-bf22-2873226a4888 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:23:00.724490 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0f1a977b-a64c-40e0-bf22-2873226a4888 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:23:00.724921 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0f1a977b-a64c-40e0-bf22-2873226a4888 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:23:00.858292 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-0f1a977b-a64c-40e0-bf22-2873226a4888 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12dda477f454a20aff297708f052dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0a5546dd7e4676b6e1ae44898972e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:23:00.866556 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-0f1a977b-a64c-40e0-bf22-2873226a4888 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] 10.222.0.18 "GET /compute/v2.1/servers/6de86b94-5727-477c-a3ce-913a3d77764f" status: 200 len: 1631 microversion: 2.1 time: 0.160266 Oct 22 22:23:00.867174 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3509/7047] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:23:00 2022] GET /compute/v2.1/servers/6de86b94-5727-477c-a3ce-913a3d77764f => generated 1631 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:23:01.892819 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-9b03b8a6-92e0-4fb8-b75e-b708f38075f4 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:23:01.893656 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-9b03b8a6-92e0-4fb8-b75e-b708f38075f4 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] [instance: 6de86b94-5727-477c-a3ce-913a3d77764f] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:23:01.901202 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9b03b8a6-92e0-4fb8-b75e-b708f38075f4 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:23:01.901755 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9b03b8a6-92e0-4fb8-b75e-b708f38075f4 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:23:01.902289 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9b03b8a6-92e0-4fb8-b75e-b708f38075f4 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:23:01.903109 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9b03b8a6-92e0-4fb8-b75e-b708f38075f4 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:23:01.903709 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9b03b8a6-92e0-4fb8-b75e-b708f38075f4 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:23:01.904229 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-9b03b8a6-92e0-4fb8-b75e-b708f38075f4 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:23:02.037501 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-9b03b8a6-92e0-4fb8-b75e-b708f38075f4 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12dda477f454a20aff297708f052dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0a5546dd7e4676b6e1ae44898972e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:23:02.045915 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-9b03b8a6-92e0-4fb8-b75e-b708f38075f4 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] 10.222.0.18 "GET /compute/v2.1/servers/6de86b94-5727-477c-a3ce-913a3d77764f" status: 200 len: 1631 microversion: 2.1 time: 0.158202 Oct 22 22:23:02.046474 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3539/7048] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:23:01 2022] GET /compute/v2.1/servers/6de86b94-5727-477c-a3ce-913a3d77764f => generated 1631 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:23:03.071087 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-9b667e2b-7333-4717-8f97-eaf9115fbf26 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:23:03.071739 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-9b667e2b-7333-4717-8f97-eaf9115fbf26 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] [instance: 6de86b94-5727-477c-a3ce-913a3d77764f] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:23:03.078849 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9b667e2b-7333-4717-8f97-eaf9115fbf26 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:23:03.079356 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9b667e2b-7333-4717-8f97-eaf9115fbf26 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:23:03.080392 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9b667e2b-7333-4717-8f97-eaf9115fbf26 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:23:03.081098 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9b667e2b-7333-4717-8f97-eaf9115fbf26 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:23:03.081556 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9b667e2b-7333-4717-8f97-eaf9115fbf26 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:23:03.082025 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-9b667e2b-7333-4717-8f97-eaf9115fbf26 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:23:03.221384 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-9b667e2b-7333-4717-8f97-eaf9115fbf26 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12dda477f454a20aff297708f052dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0a5546dd7e4676b6e1ae44898972e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:23:03.233487 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-9b667e2b-7333-4717-8f97-eaf9115fbf26 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] 10.222.0.18 "GET /compute/v2.1/servers/6de86b94-5727-477c-a3ce-913a3d77764f" status: 200 len: 1689 microversion: 2.1 time: 0.166302 Oct 22 22:23:03.234330 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3510/7049] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:23:03 2022] GET /compute/v2.1/servers/6de86b94-5727-477c-a3ce-913a3d77764f => generated 1689 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:23:04.261371 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-a6e18b0c-5290-49bc-8b4e-7603472e8721 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:23:04.262594 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-a6e18b0c-5290-49bc-8b4e-7603472e8721 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] [instance: 6de86b94-5727-477c-a3ce-913a3d77764f] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:23:04.271570 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a6e18b0c-5290-49bc-8b4e-7603472e8721 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:23:04.272349 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a6e18b0c-5290-49bc-8b4e-7603472e8721 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:23:04.272970 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a6e18b0c-5290-49bc-8b4e-7603472e8721 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:23:04.273873 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a6e18b0c-5290-49bc-8b4e-7603472e8721 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:23:04.274497 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a6e18b0c-5290-49bc-8b4e-7603472e8721 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:23:04.275094 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a6e18b0c-5290-49bc-8b4e-7603472e8721 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:23:04.423180 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-a6e18b0c-5290-49bc-8b4e-7603472e8721 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12dda477f454a20aff297708f052dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0a5546dd7e4676b6e1ae44898972e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:23:04.431441 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-a6e18b0c-5290-49bc-8b4e-7603472e8721 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] 10.222.0.18 "GET /compute/v2.1/servers/6de86b94-5727-477c-a3ce-913a3d77764f" status: 200 len: 1689 microversion: 2.1 time: 0.174309 Oct 22 22:23:04.432014 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3540/7050] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:23:04 2022] GET /compute/v2.1/servers/6de86b94-5727-477c-a3ce-913a3d77764f => generated 1689 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:23:05.454828 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-1a054ad8-3ef2-4ddf-af14-0b10f3ca9d5e tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:23:05.455474 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-1a054ad8-3ef2-4ddf-af14-0b10f3ca9d5e tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] [instance: 6de86b94-5727-477c-a3ce-913a3d77764f] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:23:05.463329 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1a054ad8-3ef2-4ddf-af14-0b10f3ca9d5e tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:23:05.464209 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1a054ad8-3ef2-4ddf-af14-0b10f3ca9d5e tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:23:05.465212 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1a054ad8-3ef2-4ddf-af14-0b10f3ca9d5e tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:23:05.466613 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1a054ad8-3ef2-4ddf-af14-0b10f3ca9d5e tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:23:05.467278 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1a054ad8-3ef2-4ddf-af14-0b10f3ca9d5e tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:23:05.468039 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1a054ad8-3ef2-4ddf-af14-0b10f3ca9d5e tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:23:05.610273 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-1a054ad8-3ef2-4ddf-af14-0b10f3ca9d5e tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12dda477f454a20aff297708f052dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0a5546dd7e4676b6e1ae44898972e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:23:05.619038 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-1a054ad8-3ef2-4ddf-af14-0b10f3ca9d5e tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] 10.222.0.18 "GET /compute/v2.1/servers/6de86b94-5727-477c-a3ce-913a3d77764f" status: 200 len: 1689 microversion: 2.1 time: 0.168326 Oct 22 22:23:05.619648 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3511/7051] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:23:05 2022] GET /compute/v2.1/servers/6de86b94-5727-477c-a3ce-913a3d77764f => generated 1689 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:23:06.643877 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-d29d6904-5e37-4f8f-9a3c-b66899172a2a tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:23:06.647483 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-d29d6904-5e37-4f8f-9a3c-b66899172a2a tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] [instance: 6de86b94-5727-477c-a3ce-913a3d77764f] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:23:06.655478 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d29d6904-5e37-4f8f-9a3c-b66899172a2a tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:23:06.656306 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d29d6904-5e37-4f8f-9a3c-b66899172a2a tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:23:06.656775 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d29d6904-5e37-4f8f-9a3c-b66899172a2a tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:23:06.657629 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d29d6904-5e37-4f8f-9a3c-b66899172a2a tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:23:06.658138 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d29d6904-5e37-4f8f-9a3c-b66899172a2a tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:23:06.658559 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-d29d6904-5e37-4f8f-9a3c-b66899172a2a tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:23:06.808455 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-d29d6904-5e37-4f8f-9a3c-b66899172a2a tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12dda477f454a20aff297708f052dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0a5546dd7e4676b6e1ae44898972e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:23:06.816762 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-d29d6904-5e37-4f8f-9a3c-b66899172a2a tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] 10.222.0.18 "GET /compute/v2.1/servers/6de86b94-5727-477c-a3ce-913a3d77764f" status: 200 len: 1689 microversion: 2.1 time: 0.177820 Oct 22 22:23:06.817332 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3541/7052] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:23:06 2022] GET /compute/v2.1/servers/6de86b94-5727-477c-a3ce-913a3d77764f => generated 1689 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:23:07.845598 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-12b75c5f-a28b-41e3-bd47-314a6f82a57a tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:23:07.846984 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-12b75c5f-a28b-41e3-bd47-314a6f82a57a tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] [instance: 6de86b94-5727-477c-a3ce-913a3d77764f] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:23:07.855458 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-12b75c5f-a28b-41e3-bd47-314a6f82a57a tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:23:07.855972 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-12b75c5f-a28b-41e3-bd47-314a6f82a57a tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:23:07.857086 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-12b75c5f-a28b-41e3-bd47-314a6f82a57a tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:23:07.858001 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-12b75c5f-a28b-41e3-bd47-314a6f82a57a tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:23:07.858465 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-12b75c5f-a28b-41e3-bd47-314a6f82a57a tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:23:07.858922 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-12b75c5f-a28b-41e3-bd47-314a6f82a57a tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:23:08.021238 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-12b75c5f-a28b-41e3-bd47-314a6f82a57a tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12dda477f454a20aff297708f052dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0a5546dd7e4676b6e1ae44898972e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:23:08.031659 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-12b75c5f-a28b-41e3-bd47-314a6f82a57a tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] 10.222.0.18 "GET /compute/v2.1/servers/6de86b94-5727-477c-a3ce-913a3d77764f" status: 200 len: 1689 microversion: 2.1 time: 0.193255 Oct 22 22:23:08.032261 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3512/7053] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:23:07 2022] GET /compute/v2.1/servers/6de86b94-5727-477c-a3ce-913a3d77764f => generated 1689 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:23:09.110178 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-6fdceeff-07ad-4b4f-ab5a-241a25c9a08a tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:23:09.112171 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-6fdceeff-07ad-4b4f-ab5a-241a25c9a08a tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] [instance: 6de86b94-5727-477c-a3ce-913a3d77764f] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:23:09.121674 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6fdceeff-07ad-4b4f-ab5a-241a25c9a08a tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:23:09.122143 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6fdceeff-07ad-4b4f-ab5a-241a25c9a08a tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:23:09.122606 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6fdceeff-07ad-4b4f-ab5a-241a25c9a08a tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:23:09.123417 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6fdceeff-07ad-4b4f-ab5a-241a25c9a08a tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:23:09.123913 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6fdceeff-07ad-4b4f-ab5a-241a25c9a08a tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:23:09.124473 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6fdceeff-07ad-4b4f-ab5a-241a25c9a08a tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:23:09.272504 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-6fdceeff-07ad-4b4f-ab5a-241a25c9a08a tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12dda477f454a20aff297708f052dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0a5546dd7e4676b6e1ae44898972e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:23:09.280551 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-6fdceeff-07ad-4b4f-ab5a-241a25c9a08a tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] 10.222.0.18 "GET /compute/v2.1/servers/6de86b94-5727-477c-a3ce-913a3d77764f" status: 200 len: 1689 microversion: 2.1 time: 0.175928 Oct 22 22:23:09.281149 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3542/7054] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:23:09 2022] GET /compute/v2.1/servers/6de86b94-5727-477c-a3ce-913a3d77764f => generated 1689 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:23:10.303774 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-992286da-663d-437b-b720-7b18d629cf72 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:23:10.304599 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-992286da-663d-437b-b720-7b18d629cf72 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] [instance: 6de86b94-5727-477c-a3ce-913a3d77764f] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:23:10.311837 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-992286da-663d-437b-b720-7b18d629cf72 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:23:10.312329 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-992286da-663d-437b-b720-7b18d629cf72 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:23:10.312767 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-992286da-663d-437b-b720-7b18d629cf72 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:23:10.313475 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-992286da-663d-437b-b720-7b18d629cf72 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:23:10.313931 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-992286da-663d-437b-b720-7b18d629cf72 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:23:10.314426 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-992286da-663d-437b-b720-7b18d629cf72 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:23:10.473367 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-992286da-663d-437b-b720-7b18d629cf72 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12dda477f454a20aff297708f052dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0a5546dd7e4676b6e1ae44898972e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:23:10.484949 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-992286da-663d-437b-b720-7b18d629cf72 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] 10.222.0.18 "GET /compute/v2.1/servers/6de86b94-5727-477c-a3ce-913a3d77764f" status: 200 len: 1689 microversion: 2.1 time: 0.185269 Oct 22 22:23:10.485777 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3513/7055] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:23:10 2022] GET /compute/v2.1/servers/6de86b94-5727-477c-a3ce-913a3d77764f => generated 1689 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:23:11.508877 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-a6a566d0-39d8-45ea-afb5-870bc6f7aec5 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:23:11.510189 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-a6a566d0-39d8-45ea-afb5-870bc6f7aec5 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] [instance: 6de86b94-5727-477c-a3ce-913a3d77764f] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:23:11.519388 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a6a566d0-39d8-45ea-afb5-870bc6f7aec5 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:23:11.519388 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a6a566d0-39d8-45ea-afb5-870bc6f7aec5 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:23:11.519725 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a6a566d0-39d8-45ea-afb5-870bc6f7aec5 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:23:11.520222 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a6a566d0-39d8-45ea-afb5-870bc6f7aec5 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:23:11.520706 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a6a566d0-39d8-45ea-afb5-870bc6f7aec5 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:23:11.521151 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a6a566d0-39d8-45ea-afb5-870bc6f7aec5 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:23:11.673981 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-a6a566d0-39d8-45ea-afb5-870bc6f7aec5 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12dda477f454a20aff297708f052dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0a5546dd7e4676b6e1ae44898972e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:23:11.682621 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-a6a566d0-39d8-45ea-afb5-870bc6f7aec5 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] 10.222.0.18 "GET /compute/v2.1/servers/6de86b94-5727-477c-a3ce-913a3d77764f" status: 200 len: 1689 microversion: 2.1 time: 0.177749 Oct 22 22:23:11.683203 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3543/7056] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:23:11 2022] GET /compute/v2.1/servers/6de86b94-5727-477c-a3ce-913a3d77764f => generated 1689 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:23:12.706572 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-e7dfd406-6bab-4c1e-bb89-1a700bb25b8b tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:23:12.707168 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-e7dfd406-6bab-4c1e-bb89-1a700bb25b8b tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] [instance: 6de86b94-5727-477c-a3ce-913a3d77764f] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:23:12.715085 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e7dfd406-6bab-4c1e-bb89-1a700bb25b8b tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:23:12.715619 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e7dfd406-6bab-4c1e-bb89-1a700bb25b8b tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:23:12.716067 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e7dfd406-6bab-4c1e-bb89-1a700bb25b8b tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:23:12.716771 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e7dfd406-6bab-4c1e-bb89-1a700bb25b8b tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:23:12.717231 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e7dfd406-6bab-4c1e-bb89-1a700bb25b8b tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:23:12.717668 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-e7dfd406-6bab-4c1e-bb89-1a700bb25b8b tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:23:12.861275 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-e7dfd406-6bab-4c1e-bb89-1a700bb25b8b tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12dda477f454a20aff297708f052dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0a5546dd7e4676b6e1ae44898972e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:23:12.869798 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-e7dfd406-6bab-4c1e-bb89-1a700bb25b8b tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] 10.222.0.18 "GET /compute/v2.1/servers/6de86b94-5727-477c-a3ce-913a3d77764f" status: 200 len: 1689 microversion: 2.1 time: 0.167397 Oct 22 22:23:12.870390 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3514/7057] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:23:12 2022] GET /compute/v2.1/servers/6de86b94-5727-477c-a3ce-913a3d77764f => generated 1689 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:23:13.905565 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-e961f732-0d36-40d1-8fbb-e4524d3081fd tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:23:13.906344 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-e961f732-0d36-40d1-8fbb-e4524d3081fd tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] [instance: 6de86b94-5727-477c-a3ce-913a3d77764f] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:23:13.915190 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e961f732-0d36-40d1-8fbb-e4524d3081fd tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:23:13.915752 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e961f732-0d36-40d1-8fbb-e4524d3081fd tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:23:13.916206 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e961f732-0d36-40d1-8fbb-e4524d3081fd tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:23:13.916916 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e961f732-0d36-40d1-8fbb-e4524d3081fd tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:23:13.917386 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e961f732-0d36-40d1-8fbb-e4524d3081fd tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:23:13.917845 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e961f732-0d36-40d1-8fbb-e4524d3081fd tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:23:14.060272 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-e961f732-0d36-40d1-8fbb-e4524d3081fd tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12dda477f454a20aff297708f052dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0a5546dd7e4676b6e1ae44898972e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:23:14.069361 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-e961f732-0d36-40d1-8fbb-e4524d3081fd tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] 10.222.0.18 "GET /compute/v2.1/servers/6de86b94-5727-477c-a3ce-913a3d77764f" status: 200 len: 1689 microversion: 2.1 time: 0.169723 Oct 22 22:23:14.069950 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3544/7058] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:23:13 2022] GET /compute/v2.1/servers/6de86b94-5727-477c-a3ce-913a3d77764f => generated 1689 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:23:15.100258 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-18bfb8b1-30cd-4ad7-b1a2-9f99868e376e tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:23:15.100838 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-18bfb8b1-30cd-4ad7-b1a2-9f99868e376e tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] [instance: 6de86b94-5727-477c-a3ce-913a3d77764f] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:23:15.108857 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-18bfb8b1-30cd-4ad7-b1a2-9f99868e376e tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:23:15.109352 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-18bfb8b1-30cd-4ad7-b1a2-9f99868e376e tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:23:15.109797 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-18bfb8b1-30cd-4ad7-b1a2-9f99868e376e tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:23:15.110503 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-18bfb8b1-30cd-4ad7-b1a2-9f99868e376e tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:23:15.110984 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-18bfb8b1-30cd-4ad7-b1a2-9f99868e376e tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:23:15.111463 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-18bfb8b1-30cd-4ad7-b1a2-9f99868e376e tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:23:15.246290 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-18bfb8b1-30cd-4ad7-b1a2-9f99868e376e tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12dda477f454a20aff297708f052dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0a5546dd7e4676b6e1ae44898972e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:23:15.254792 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-18bfb8b1-30cd-4ad7-b1a2-9f99868e376e tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] 10.222.0.18 "GET /compute/v2.1/servers/6de86b94-5727-477c-a3ce-913a3d77764f" status: 200 len: 1689 microversion: 2.1 time: 0.160182 Oct 22 22:23:15.255476 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3515/7059] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:23:15 2022] GET /compute/v2.1/servers/6de86b94-5727-477c-a3ce-913a3d77764f => generated 1689 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:23:16.282273 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-8c6dce6d-36d5-4767-bc8b-ecaa832a5a37 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:23:16.282972 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-8c6dce6d-36d5-4767-bc8b-ecaa832a5a37 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] [instance: 6de86b94-5727-477c-a3ce-913a3d77764f] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:23:16.292696 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8c6dce6d-36d5-4767-bc8b-ecaa832a5a37 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:23:16.293423 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8c6dce6d-36d5-4767-bc8b-ecaa832a5a37 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:23:16.294085 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8c6dce6d-36d5-4767-bc8b-ecaa832a5a37 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:23:16.295086 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8c6dce6d-36d5-4767-bc8b-ecaa832a5a37 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:23:16.295819 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8c6dce6d-36d5-4767-bc8b-ecaa832a5a37 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:23:16.296466 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-8c6dce6d-36d5-4767-bc8b-ecaa832a5a37 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:23:16.445523 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-8c6dce6d-36d5-4767-bc8b-ecaa832a5a37 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12dda477f454a20aff297708f052dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0a5546dd7e4676b6e1ae44898972e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:23:16.453667 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-8c6dce6d-36d5-4767-bc8b-ecaa832a5a37 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] 10.222.0.18 "GET /compute/v2.1/servers/6de86b94-5727-477c-a3ce-913a3d77764f" status: 200 len: 1689 microversion: 2.1 time: 0.177324 Oct 22 22:23:16.454249 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3545/7060] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:23:16 2022] GET /compute/v2.1/servers/6de86b94-5727-477c-a3ce-913a3d77764f => generated 1689 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:23:17.481585 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-3638e7db-ca33-4e66-aeb3-6d375ffcc2f9 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:23:17.482574 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-3638e7db-ca33-4e66-aeb3-6d375ffcc2f9 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] [instance: 6de86b94-5727-477c-a3ce-913a3d77764f] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:23:17.493969 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3638e7db-ca33-4e66-aeb3-6d375ffcc2f9 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:23:17.494776 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3638e7db-ca33-4e66-aeb3-6d375ffcc2f9 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:23:17.495547 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3638e7db-ca33-4e66-aeb3-6d375ffcc2f9 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:23:17.496730 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3638e7db-ca33-4e66-aeb3-6d375ffcc2f9 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:23:17.497452 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3638e7db-ca33-4e66-aeb3-6d375ffcc2f9 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:23:17.498163 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3638e7db-ca33-4e66-aeb3-6d375ffcc2f9 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:23:17.637067 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-3638e7db-ca33-4e66-aeb3-6d375ffcc2f9 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12dda477f454a20aff297708f052dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0a5546dd7e4676b6e1ae44898972e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:23:17.645808 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-3638e7db-ca33-4e66-aeb3-6d375ffcc2f9 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] 10.222.0.18 "GET /compute/v2.1/servers/6de86b94-5727-477c-a3ce-913a3d77764f" status: 200 len: 1689 microversion: 2.1 time: 0.170649 Oct 22 22:23:17.646404 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3516/7061] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:23:17 2022] GET /compute/v2.1/servers/6de86b94-5727-477c-a3ce-913a3d77764f => generated 1689 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:23:18.670068 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-957b49dc-aadc-48e4-95ad-e723a1cd8e9e tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:23:18.670748 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-957b49dc-aadc-48e4-95ad-e723a1cd8e9e tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] [instance: 6de86b94-5727-477c-a3ce-913a3d77764f] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:23:18.678343 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-957b49dc-aadc-48e4-95ad-e723a1cd8e9e tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:23:18.678886 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-957b49dc-aadc-48e4-95ad-e723a1cd8e9e tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:23:18.679379 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-957b49dc-aadc-48e4-95ad-e723a1cd8e9e tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:23:18.680111 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-957b49dc-aadc-48e4-95ad-e723a1cd8e9e tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:23:18.680593 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-957b49dc-aadc-48e4-95ad-e723a1cd8e9e tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:23:18.681041 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-957b49dc-aadc-48e4-95ad-e723a1cd8e9e tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:23:18.820356 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-957b49dc-aadc-48e4-95ad-e723a1cd8e9e tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12dda477f454a20aff297708f052dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0a5546dd7e4676b6e1ae44898972e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:23:18.828502 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-957b49dc-aadc-48e4-95ad-e723a1cd8e9e tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] 10.222.0.18 "GET /compute/v2.1/servers/6de86b94-5727-477c-a3ce-913a3d77764f" status: 200 len: 1689 microversion: 2.1 time: 0.162603 Oct 22 22:23:18.829082 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3546/7062] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:23:18 2022] GET /compute/v2.1/servers/6de86b94-5727-477c-a3ce-913a3d77764f => generated 1689 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:23:19.851935 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-6c5ded01-b9e9-4371-bda2-b239b54630b7 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:23:19.852552 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-6c5ded01-b9e9-4371-bda2-b239b54630b7 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] [instance: 6de86b94-5727-477c-a3ce-913a3d77764f] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:23:19.859948 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6c5ded01-b9e9-4371-bda2-b239b54630b7 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:23:19.860435 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6c5ded01-b9e9-4371-bda2-b239b54630b7 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:23:19.860878 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6c5ded01-b9e9-4371-bda2-b239b54630b7 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:23:19.861574 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6c5ded01-b9e9-4371-bda2-b239b54630b7 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:23:19.862028 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6c5ded01-b9e9-4371-bda2-b239b54630b7 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:23:19.862462 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6c5ded01-b9e9-4371-bda2-b239b54630b7 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:23:20.001865 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-6c5ded01-b9e9-4371-bda2-b239b54630b7 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12dda477f454a20aff297708f052dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0a5546dd7e4676b6e1ae44898972e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:23:20.010271 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-6c5ded01-b9e9-4371-bda2-b239b54630b7 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] 10.222.0.18 "GET /compute/v2.1/servers/6de86b94-5727-477c-a3ce-913a3d77764f" status: 200 len: 1689 microversion: 2.1 time: 0.162566 Oct 22 22:23:20.010849 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3517/7063] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:23:19 2022] GET /compute/v2.1/servers/6de86b94-5727-477c-a3ce-913a3d77764f => generated 1689 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:23:21.036796 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-3d9c8109-967b-4d78-933f-036c91d4df76 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:23:21.037793 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-3d9c8109-967b-4d78-933f-036c91d4df76 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] [instance: 6de86b94-5727-477c-a3ce-913a3d77764f] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:23:21.045375 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3d9c8109-967b-4d78-933f-036c91d4df76 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:23:21.046298 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3d9c8109-967b-4d78-933f-036c91d4df76 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:23:21.046413 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3d9c8109-967b-4d78-933f-036c91d4df76 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:23:21.047082 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3d9c8109-967b-4d78-933f-036c91d4df76 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:23:21.047642 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3d9c8109-967b-4d78-933f-036c91d4df76 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:23:21.048246 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-3d9c8109-967b-4d78-933f-036c91d4df76 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:23:21.205548 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-3d9c8109-967b-4d78-933f-036c91d4df76 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12dda477f454a20aff297708f052dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0a5546dd7e4676b6e1ae44898972e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:23:21.214350 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-3d9c8109-967b-4d78-933f-036c91d4df76 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] 10.222.0.18 "GET /compute/v2.1/servers/6de86b94-5727-477c-a3ce-913a3d77764f" status: 200 len: 1689 microversion: 2.1 time: 0.183365 Oct 22 22:23:21.215163 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3547/7064] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:23:21 2022] GET /compute/v2.1/servers/6de86b94-5727-477c-a3ce-913a3d77764f => generated 1689 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:23:22.242755 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-4cc56c9b-2d15-4855-99db-a2a3fbd16023 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:23:22.243380 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-4cc56c9b-2d15-4855-99db-a2a3fbd16023 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] [instance: 6de86b94-5727-477c-a3ce-913a3d77764f] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:23:22.251594 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4cc56c9b-2d15-4855-99db-a2a3fbd16023 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:23:22.252144 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4cc56c9b-2d15-4855-99db-a2a3fbd16023 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:23:22.252773 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4cc56c9b-2d15-4855-99db-a2a3fbd16023 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:23:22.253569 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4cc56c9b-2d15-4855-99db-a2a3fbd16023 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:23:22.254152 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4cc56c9b-2d15-4855-99db-a2a3fbd16023 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:23:22.254648 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4cc56c9b-2d15-4855-99db-a2a3fbd16023 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:23:22.405858 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-4cc56c9b-2d15-4855-99db-a2a3fbd16023 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12dda477f454a20aff297708f052dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0a5546dd7e4676b6e1ae44898972e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:23:22.414471 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-4cc56c9b-2d15-4855-99db-a2a3fbd16023 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] 10.222.0.18 "GET /compute/v2.1/servers/6de86b94-5727-477c-a3ce-913a3d77764f" status: 200 len: 1689 microversion: 2.1 time: 0.177970 Oct 22 22:23:22.415061 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3518/7065] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:23:22 2022] GET /compute/v2.1/servers/6de86b94-5727-477c-a3ce-913a3d77764f => generated 1689 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:23:22.570950 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-e05979ec-8881-4b3c-a362-4d6054f91dfb req-6d958e67-3bb6-4339-afe2-1a694a26fa19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6de86b94-5727-477c-a3ce-913a3d77764f", "name": "network-vif-plugged", "status": "completed", "tag": "802b5db4-b15e-4714-8ab4-a1dfca1177bb"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 22:23:22.582218 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-e05979ec-8881-4b3c-a362-4d6054f91dfb req-6d958e67-3bb6-4339-afe2-1a694a26fa19 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:23:22.582724 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-e05979ec-8881-4b3c-a362-4d6054f91dfb req-6d958e67-3bb6-4339-afe2-1a694a26fa19 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:23:22.583234 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-e05979ec-8881-4b3c-a362-4d6054f91dfb req-6d958e67-3bb6-4339-afe2-1a694a26fa19 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:23:22.595917 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-e05979ec-8881-4b3c-a362-4d6054f91dfb req-6d958e67-3bb6-4339-afe2-1a694a26fa19 service nova] Creating event network-vif-plugged:802b5db4-b15e-4714-8ab4-a1dfca1177bb for instance 6de86b94-5727-477c-a3ce-913a3d77764f on nch1-master-1 Oct 22 22:23:22.602688 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-e05979ec-8881-4b3c-a362-4d6054f91dfb req-6d958e67-3bb6-4339-afe2-1a694a26fa19 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035654 Oct 22 22:23:22.603558 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3548/7066] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 22:23:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 22:23:23.442251 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-bbb90cd3-1ae7-4168-a110-5b1d74a89838 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:23:23.443302 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-bbb90cd3-1ae7-4168-a110-5b1d74a89838 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] [instance: 6de86b94-5727-477c-a3ce-913a3d77764f] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:23:23.456021 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bbb90cd3-1ae7-4168-a110-5b1d74a89838 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:23:23.456879 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bbb90cd3-1ae7-4168-a110-5b1d74a89838 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:23:23.457575 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bbb90cd3-1ae7-4168-a110-5b1d74a89838 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:23:23.458737 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bbb90cd3-1ae7-4168-a110-5b1d74a89838 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:23:23.459515 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bbb90cd3-1ae7-4168-a110-5b1d74a89838 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:23:23.460269 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-bbb90cd3-1ae7-4168-a110-5b1d74a89838 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:23:23.612648 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-bbb90cd3-1ae7-4168-a110-5b1d74a89838 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12dda477f454a20aff297708f052dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0a5546dd7e4676b6e1ae44898972e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:23:23.621338 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-bbb90cd3-1ae7-4168-a110-5b1d74a89838 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] 10.222.0.18 "GET /compute/v2.1/servers/6de86b94-5727-477c-a3ce-913a3d77764f" status: 200 len: 1689 microversion: 2.1 time: 0.185817 Oct 22 22:23:23.621922 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3519/7067] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:23:23 2022] GET /compute/v2.1/servers/6de86b94-5727-477c-a3ce-913a3d77764f => generated 1689 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:23:24.647841 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-4b464420-f38b-4d09-83c0-46d80b8df656 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:23:24.648654 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-4b464420-f38b-4d09-83c0-46d80b8df656 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] [instance: 6de86b94-5727-477c-a3ce-913a3d77764f] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:23:24.655536 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4b464420-f38b-4d09-83c0-46d80b8df656 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:23:24.656062 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4b464420-f38b-4d09-83c0-46d80b8df656 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:23:24.656547 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4b464420-f38b-4d09-83c0-46d80b8df656 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:23:24.657279 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4b464420-f38b-4d09-83c0-46d80b8df656 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:23:24.657756 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4b464420-f38b-4d09-83c0-46d80b8df656 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:23:24.658206 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-4b464420-f38b-4d09-83c0-46d80b8df656 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:23:24.802168 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-4b464420-f38b-4d09-83c0-46d80b8df656 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12dda477f454a20aff297708f052dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0a5546dd7e4676b6e1ae44898972e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:23:24.810686 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-4b464420-f38b-4d09-83c0-46d80b8df656 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] 10.222.0.18 "GET /compute/v2.1/servers/6de86b94-5727-477c-a3ce-913a3d77764f" status: 200 len: 1689 microversion: 2.1 time: 0.169033 Oct 22 22:23:24.811199 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3549/7068] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:23:24 2022] GET /compute/v2.1/servers/6de86b94-5727-477c-a3ce-913a3d77764f => generated 1689 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:23:25.838306 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-678f16a5-b79b-47a2-a1fd-354166bb92b4 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:23:25.838947 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-678f16a5-b79b-47a2-a1fd-354166bb92b4 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] [instance: 6de86b94-5727-477c-a3ce-913a3d77764f] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:23:25.847505 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-678f16a5-b79b-47a2-a1fd-354166bb92b4 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:23:25.848202 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-678f16a5-b79b-47a2-a1fd-354166bb92b4 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:23:25.848497 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-678f16a5-b79b-47a2-a1fd-354166bb92b4 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:23:25.849315 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-678f16a5-b79b-47a2-a1fd-354166bb92b4 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:23:25.849802 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-678f16a5-b79b-47a2-a1fd-354166bb92b4 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:23:25.850286 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-678f16a5-b79b-47a2-a1fd-354166bb92b4 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:23:25.999754 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-678f16a5-b79b-47a2-a1fd-354166bb92b4 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12dda477f454a20aff297708f052dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0a5546dd7e4676b6e1ae44898972e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:23:26.008266 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-678f16a5-b79b-47a2-a1fd-354166bb92b4 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] 10.222.0.18 "GET /compute/v2.1/servers/6de86b94-5727-477c-a3ce-913a3d77764f" status: 200 len: 1676 microversion: 2.1 time: 0.176229 Oct 22 22:23:26.009009 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3520/7069] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:23:25 2022] GET /compute/v2.1/servers/6de86b94-5727-477c-a3ce-913a3d77764f => generated 1676 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:25:03.120611 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_api:SELECT=23 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:25:03.121916 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell1:SELECT=67 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:25:03.124554 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_api:SELECT=25 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:25:03.125295 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:SELECT=78 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:25:03.129024 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-dcf7c50a-57d0-4bb9-a6d6-6c8a2acb651e tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:25:03.129658 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-dcf7c50a-57d0-4bb9-a6d6-6c8a2acb651e tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] [instance: 6de86b94-5727-477c-a3ce-913a3d77764f] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:25:03.137613 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-dcf7c50a-57d0-4bb9-a6d6-6c8a2acb651e tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:25:03.138120 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-dcf7c50a-57d0-4bb9-a6d6-6c8a2acb651e tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:25:03.138554 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-dcf7c50a-57d0-4bb9-a6d6-6c8a2acb651e tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:25:03.139579 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-dcf7c50a-57d0-4bb9-a6d6-6c8a2acb651e tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:25:03.140115 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-dcf7c50a-57d0-4bb9-a6d6-6c8a2acb651e tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:25:03.140766 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-dcf7c50a-57d0-4bb9-a6d6-6c8a2acb651e tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:25:03.168856 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-dcf7c50a-57d0-4bb9-a6d6-6c8a2acb651e tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] [instance: 6de86b94-5727-477c-a3ce-913a3d77764f] Going to try to terminate instance {{(pid=138745) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 22:25:03.209859 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-d28c8c10-bb3e-44d7-9884-13df4adca119 req-d782da9f-7c66-4719-906d-9183dfca819b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6de86b94-5727-477c-a3ce-913a3d77764f", "tag": "802b5db4-b15e-4714-8ab4-a1dfca1177bb"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 22:25:03.221811 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-d28c8c10-bb3e-44d7-9884-13df4adca119 req-d782da9f-7c66-4719-906d-9183dfca819b service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:25:03.222228 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-d28c8c10-bb3e-44d7-9884-13df4adca119 req-d782da9f-7c66-4719-906d-9183dfca819b service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:25:03.222674 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-d28c8c10-bb3e-44d7-9884-13df4adca119 req-d782da9f-7c66-4719-906d-9183dfca819b service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:25:03.234424 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-d28c8c10-bb3e-44d7-9884-13df4adca119 req-d782da9f-7c66-4719-906d-9183dfca819b service nova] Creating event network-changed:802b5db4-b15e-4714-8ab4-a1dfca1177bb for instance 6de86b94-5727-477c-a3ce-913a3d77764f on nch1-master-1 Oct 22 22:25:03.240250 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-d28c8c10-bb3e-44d7-9884-13df4adca119 req-d782da9f-7c66-4719-906d-9183dfca819b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118790 Oct 22 22:25:03.241416 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3521/7070] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 22:25:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 22:25:03.271483 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-dcf7c50a-57d0-4bb9-a6d6-6c8a2acb651e tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] 10.222.0.18 "DELETE /compute/v2.1/servers/6de86b94-5727-477c-a3ce-913a3d77764f" status: 204 len: 0 microversion: 2.1 time: 0.152941 Oct 22 22:25:03.275441 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3550/7071] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 22:25:03 2022] DELETE /compute/v2.1/servers/6de86b94-5727-477c-a3ce-913a3d77764f => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 22:25:03.285019 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-66130273-8c5c-41b2-a327-2b8fbb5d043f tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:25:03.286084 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-66130273-8c5c-41b2-a327-2b8fbb5d043f tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] [instance: 6de86b94-5727-477c-a3ce-913a3d77764f] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:25:03.295066 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-66130273-8c5c-41b2-a327-2b8fbb5d043f tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:25:03.295916 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-66130273-8c5c-41b2-a327-2b8fbb5d043f tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:25:03.296631 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-66130273-8c5c-41b2-a327-2b8fbb5d043f tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:25:03.297496 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-66130273-8c5c-41b2-a327-2b8fbb5d043f tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:25:03.298063 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-66130273-8c5c-41b2-a327-2b8fbb5d043f tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:25:03.298703 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-66130273-8c5c-41b2-a327-2b8fbb5d043f tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:25:03.490898 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-66130273-8c5c-41b2-a327-2b8fbb5d043f tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12dda477f454a20aff297708f052dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0a5546dd7e4676b6e1ae44898972e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:25:03.499113 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-66130273-8c5c-41b2-a327-2b8fbb5d043f tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] 10.222.0.18 "GET /compute/v2.1/servers/6de86b94-5727-477c-a3ce-913a3d77764f" status: 200 len: 1682 microversion: 2.1 time: 0.218905 Oct 22 22:25:03.499703 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3522/7072] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:25:03 2022] GET /compute/v2.1/servers/6de86b94-5727-477c-a3ce-913a3d77764f => generated 1682 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 22:25:04.527399 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-79b810f2-c84c-493b-b2ac-51cc3a8ffeed tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:25:04.528150 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-79b810f2-c84c-493b-b2ac-51cc3a8ffeed tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] [instance: 6de86b94-5727-477c-a3ce-913a3d77764f] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:25:04.536218 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-79b810f2-c84c-493b-b2ac-51cc3a8ffeed tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:25:04.536729 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-79b810f2-c84c-493b-b2ac-51cc3a8ffeed tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:25:04.537189 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-79b810f2-c84c-493b-b2ac-51cc3a8ffeed tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:25:04.537912 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-79b810f2-c84c-493b-b2ac-51cc3a8ffeed tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:25:04.538395 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-79b810f2-c84c-493b-b2ac-51cc3a8ffeed tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:25:04.538839 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-79b810f2-c84c-493b-b2ac-51cc3a8ffeed tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:25:04.802854 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-79b810f2-c84c-493b-b2ac-51cc3a8ffeed tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12dda477f454a20aff297708f052dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0a5546dd7e4676b6e1ae44898972e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:25:04.813022 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-79b810f2-c84c-493b-b2ac-51cc3a8ffeed tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] 10.222.0.18 "GET /compute/v2.1/servers/6de86b94-5727-477c-a3ce-913a3d77764f" status: 200 len: 1682 microversion: 2.1 time: 0.292724 Oct 22 22:25:04.814223 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3551/7073] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:25:04 2022] GET /compute/v2.1/servers/6de86b94-5727-477c-a3ce-913a3d77764f => generated 1682 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:25:05.257836 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-0f3ca98b-ccc4-4215-9617-0a13b82c229c req-89c39346-e7ee-4b84-b2f5-17415e3fdc4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6de86b94-5727-477c-a3ce-913a3d77764f", "name": "network-vif-deleted", "tag": "802b5db4-b15e-4714-8ab4-a1dfca1177bb"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 22:25:05.270851 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-0f3ca98b-ccc4-4215-9617-0a13b82c229c req-89c39346-e7ee-4b84-b2f5-17415e3fdc4a service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:25:05.271379 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-0f3ca98b-ccc4-4215-9617-0a13b82c229c req-89c39346-e7ee-4b84-b2f5-17415e3fdc4a service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:25:05.272002 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-0f3ca98b-ccc4-4215-9617-0a13b82c229c req-89c39346-e7ee-4b84-b2f5-17415e3fdc4a service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:25:05.284493 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-0f3ca98b-ccc4-4215-9617-0a13b82c229c req-89c39346-e7ee-4b84-b2f5-17415e3fdc4a service nova] Creating event network-vif-deleted:802b5db4-b15e-4714-8ab4-a1dfca1177bb for instance 6de86b94-5727-477c-a3ce-913a3d77764f on nch1-master-1 Oct 22 22:25:05.289744 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-0f3ca98b-ccc4-4215-9617-0a13b82c229c req-89c39346-e7ee-4b84-b2f5-17415e3fdc4a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037384 Oct 22 22:25:05.290340 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3523/7074] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 22:25:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 22:25:05.841897 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-cd6d886b-a40f-4b11-9150-cfe9a0cd8b85 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:25:05.842784 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-cd6d886b-a40f-4b11-9150-cfe9a0cd8b85 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] [instance: 6de86b94-5727-477c-a3ce-913a3d77764f] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:25:05.854544 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cd6d886b-a40f-4b11-9150-cfe9a0cd8b85 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:25:05.855630 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cd6d886b-a40f-4b11-9150-cfe9a0cd8b85 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:25:05.856450 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cd6d886b-a40f-4b11-9150-cfe9a0cd8b85 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:25:05.857193 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cd6d886b-a40f-4b11-9150-cfe9a0cd8b85 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:25:05.857677 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cd6d886b-a40f-4b11-9150-cfe9a0cd8b85 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:25:05.858127 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cd6d886b-a40f-4b11-9150-cfe9a0cd8b85 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:25:05.872431 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.wsgi [None req-cd6d886b-a40f-4b11-9150-cfe9a0cd8b85 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] HTTP exception thrown: Instance 6de86b94-5727-477c-a3ce-913a3d77764f could not be found. Oct 22 22:25:05.874157 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-cd6d886b-a40f-4b11-9150-cfe9a0cd8b85 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Request method failure captured: Oct 22 22:25:05.874157 ncdv-master-1 devstack@n-api.service[138745]: request: GET /compute/v2.1/servers/6de86b94-5727-477c-a3ce-913a3d77764f HTTP/1.1 Oct 22 22:25:05.874157 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 22:25:05.874157 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 22:25:05.874157 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 22:25:05.874157 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 0 Oct 22 22:25:05.874157 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 22:25:05.874157 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 22:25:05.874157 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 22:25:05.874157 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 22:25:05.874157 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVGx8WGme9oVuTg6FWPrXvzhRbk4I-D9C4t_bR7zXOchbIjKhfFd0_SBG0F5_WxHRq2hjmiGp2mhiuKCxu8yaxIcoPtMDX5EH71kXbkERJBWoNoQbzABgtu4vbuHurl-0fw8bxDk9aLkjXNhO0sf7b-fDDyUKj6cWuDAQd28_fHg88cQ Oct 22 22:25:05.874157 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 22:25:05.874157 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 22:25:05.874157 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 22:25:05.874157 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 22:25:05.874157 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 22:25:05.874157 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 22:25:05.874157 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: 4d0a5546dd7e4676b6e1ae44898972e9 Oct 22 22:25:05.874157 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-TestShelveInstance-1901158978 Oct 22 22:25:05.874157 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 22:25:05.874157 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 22:25:05.874157 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_4d0a5546dd7e4676b6e1ae44898972e9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4d0a5546dd7e4676b6e1ae44898972e9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/4d0a5546dd7e4676b6e1ae44898972e9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4d0a5546dd7e4676b6e1ae44898972e9"}]}] Oct 22 22:25:05.874157 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-TestShelveInstance-1901158978 Oct 22 22:25:05.874157 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: 4d0a5546dd7e4676b6e1ae44898972e9 Oct 22 22:25:05.874157 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-TestShelveInstance-1901158978 Oct 22 22:25:05.874157 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-TestShelveInstance-1901158978-project Oct 22 22:25:05.874157 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 22:25:05.874157 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 22:25:05.874157 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: d12dda477f454a20aff297708f052dd9 Oct 22 22:25:05.874157 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-TestShelveInstance-1901158978-project Oct 22 22:25:05.874157 ncdv-master-1 devstack@n-api.service[138745]: method: > Oct 22 22:25:05.874157 ncdv-master-1 devstack@n-api.service[138745]: exception: Instance 6de86b94-5727-477c-a3ce-913a3d77764f could not be found. Oct 22 22:25:05.874157 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'id': '6de86b94-5727-477c-a3ce-913a3d77764f'} Oct 22 22:25:05.874157 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 22:25:05.874157 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 22:25:05.874157 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 22:25:05.874157 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 22:25:05.874157 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 22:25:05.874157 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 22:25:05.874157 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 22:25:05.874157 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 22:25:05.874157 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 22:25:05.874157 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 22:25:05.874157 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6de86b94-5727-477c-a3ce-913a3d77764f could not be found. Oct 22 22:25:05.874157 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 22:25:05.874157 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 22:25:05.874157 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 22:25:05.874157 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 22:25:05.874157 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 22:25:05.874157 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 22:25:05.874157 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 22:25:05.874157 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 22:25:05.874157 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 22:25:05.874157 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 22:25:05.874157 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 22:25:05.874157 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 22:25:05.874157 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 22:25:05.874157 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 22:25:05.874157 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 22:25:05.874157 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 22:25:05.874157 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6de86b94-5727-477c-a3ce-913a3d77764f could not be found. Oct 22 22:25:05.874157 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 22:25:05.874157 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 22:25:05.874157 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 22:25:05.878653 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 22:25:05.878653 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 22:25:05.878653 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 22:25:05.878653 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 22:25:05.878653 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 22:25:05.878653 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6de86b94-5727-477c-a3ce-913a3d77764f could not be found. Oct 22 22:25:05.878653 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 22:25:05.878653 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-cd6d886b-a40f-4b11-9150-cfe9a0cd8b85 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Returning 404 to user: Instance 6de86b94-5727-477c-a3ce-913a3d77764f could not be found. {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 22:25:05.878653 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-cd6d886b-a40f-4b11-9150-cfe9a0cd8b85 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] 10.222.0.18 "GET /compute/v2.1/servers/6de86b94-5727-477c-a3ce-913a3d77764f" status: 404 len: 111 microversion: 2.1 time: 0.041203 Oct 22 22:25:05.878653 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3552/7075] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:25:05 2022] GET /compute/v2.1/servers/6de86b94-5727-477c-a3ce-913a3d77764f => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 22:25:06.049336 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-9420ef55-451b-48e8-a636-aa26d889a041 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Calling method '.version_select at 0x7fd39f198790>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:25:06.076039 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-9420ef55-451b-48e8-a636-aa26d889a041 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1281534188" status: 202 len: 0 microversion: 2.1 time: 0.031001 Oct 22 22:25:06.076688 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3524/7076] 10.222.0.18 () {58 vars in 1254 bytes} [Sat Oct 22 22:25:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1281534188 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 22:25:06.103838 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-3dfb8c23-909c-4c97-88fb-b8d52b348c7f tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Action: 'create', calling method: .version_select at 0x7fd3a46d1b80>, body: {"keypair": {"name": "tempest-TestShelveInstance-675202201", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBy0o6KU+ECAefE6r3w2OFbPGol7/CEjMTUz+QgUsuLd+R8EUOnwt/EDpeGgV8TUDQKbS8GQujd1uJ1iYZ301HpRdy1adxiZJ6LQKGEC3UBARb4BsFcf4cA3tiPf2+3ezA=="}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 22:25:06.119737 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-3dfb8c23-909c-4c97-88fb-b8d52b348c7f tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Getting quotas for project 4d0a5546dd7e4676b6e1ae44898972e9. Resources: {'key_pairs'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 22:25:06.125260 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-3dfb8c23-909c-4c97-88fb-b8d52b348c7f tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Getting quotas for user d12dda477f454a20aff297708f052dd9 and project 4d0a5546dd7e4676b6e1ae44898972e9. Resources: {'key_pairs'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 22:25:06.153011 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-3dfb8c23-909c-4c97-88fb-b8d52b348c7f tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.053277 Oct 22 22:25:06.153877 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3553/7077] 10.222.0.18 () {60 vars in 1159 bytes} [Sat Oct 22 22:25:06 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 22:25:08.681977 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-5dcd88dd-9847-4425-8652-5f9e48a736dd tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1194069929", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-675202201", "security_groups": [{"name": "tempest-secgroup-smoke-1989856028"}], "networks": [{"uuid": "e56f3e9a-1603-4dd4-931a-65eadb095ac7"}], "block_device_mapping_v2": [{"uuid": "3edfe8c6-0401-48df-9c79-34326927843b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 22:25:08.805956 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.network.neutron [None req-5dcd88dd-9847-4425-8652-5f9e48a736dd tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] validate_networks() for [('e56f3e9a-1603-4dd4-931a-65eadb095ac7', None, None, None, None, None)] {{(pid=138744) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 22:25:09.220797 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-5dcd88dd-9847-4425-8652-5f9e48a736dd tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Flavor limits 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 22:25:09.221254 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-5dcd88dd-9847-4425-8652-5f9e48a736dd tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Image limits 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 22:25:09.221729 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-5dcd88dd-9847-4425-8652-5f9e48a736dd tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Flavor pref 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 22:25:09.222518 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-5dcd88dd-9847-4425-8652-5f9e48a736dd tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Image pref 0:0:0 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 22:25:09.222935 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.virt.hardware [None req-5dcd88dd-9847-4425-8652-5f9e48a736dd tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 22:25:09.232459 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5dcd88dd-9847-4425-8652-5f9e48a736dd tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:25:09.232944 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5dcd88dd-9847-4425-8652-5f9e48a736dd tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:25:09.233601 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5dcd88dd-9847-4425-8652-5f9e48a736dd tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:25:09.234329 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5dcd88dd-9847-4425-8652-5f9e48a736dd tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:25:09.234785 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5dcd88dd-9847-4425-8652-5f9e48a736dd tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:25:09.235216 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5dcd88dd-9847-4425-8652-5f9e48a736dd tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:25:09.253146 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-5dcd88dd-9847-4425-8652-5f9e48a736dd tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Getting quotas for project 4d0a5546dd7e4676b6e1ae44898972e9. Resources: {'cores', 'instances', 'ram'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 22:25:09.258587 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-5dcd88dd-9847-4425-8652-5f9e48a736dd tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Getting quotas for user d12dda477f454a20aff297708f052dd9 and project 4d0a5546dd7e4676b6e1ae44898972e9. Resources: {'cores', 'instances', 'ram'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 22:25:09.319322 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-5dcd88dd-9847-4425-8652-5f9e48a736dd tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Going to run 1 instances... {{(pid=138744) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 22:25:09.321663 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-5dcd88dd-9847-4425-8652-5f9e48a736dd tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] [instance: c3396b38-a6a0-40a5-baf4-808452c614fb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='3edfe8c6-0401-48df-9c79-34326927843b',volume_size=None,volume_type=None)] {{(pid=138744) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 22:25:09.467376 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-5dcd88dd-9847-4425-8652-5f9e48a736dd tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.789991 Oct 22 22:25:09.474243 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3525/7078] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Oct 22 22:25:08 2022] POST /compute/v2.1/servers => generated 406 bytes in 792 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 22:25:09.480685 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-690a72ee-1501-4b72-8b82-08e1d067ef87 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:25:09.481417 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-690a72ee-1501-4b72-8b82-08e1d067ef87 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] [instance: c3396b38-a6a0-40a5-baf4-808452c614fb] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:25:09.541308 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-690a72ee-1501-4b72-8b82-08e1d067ef87 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12dda477f454a20aff297708f052dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0a5546dd7e4676b6e1ae44898972e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:25:09.548971 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-690a72ee-1501-4b72-8b82-08e1d067ef87 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] 10.222.0.18 "GET /compute/v2.1/servers/c3396b38-a6a0-40a5-baf4-808452c614fb" status: 200 len: 1088 microversion: 2.1 time: 0.073317 Oct 22 22:25:09.549672 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3554/7079] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:25:09 2022] GET /compute/v2.1/servers/c3396b38-a6a0-40a5-baf4-808452c614fb => generated 1088 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:25:10.571993 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-4f0015b9-ebe4-4eaf-8471-2f9416b43fa5 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:25:10.572543 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-4f0015b9-ebe4-4eaf-8471-2f9416b43fa5 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] [instance: c3396b38-a6a0-40a5-baf4-808452c614fb] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:25:10.581547 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4f0015b9-ebe4-4eaf-8471-2f9416b43fa5 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:25:10.582183 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4f0015b9-ebe4-4eaf-8471-2f9416b43fa5 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:25:10.582764 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4f0015b9-ebe4-4eaf-8471-2f9416b43fa5 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:25:10.583858 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4f0015b9-ebe4-4eaf-8471-2f9416b43fa5 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:25:10.584354 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4f0015b9-ebe4-4eaf-8471-2f9416b43fa5 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:25:10.584847 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4f0015b9-ebe4-4eaf-8471-2f9416b43fa5 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:25:10.659500 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-4f0015b9-ebe4-4eaf-8471-2f9416b43fa5 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12dda477f454a20aff297708f052dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0a5546dd7e4676b6e1ae44898972e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:25:10.668394 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-4f0015b9-ebe4-4eaf-8471-2f9416b43fa5 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] 10.222.0.18 "GET /compute/v2.1/servers/c3396b38-a6a0-40a5-baf4-808452c614fb" status: 200 len: 1186 microversion: 2.1 time: 0.100561 Oct 22 22:25:10.668958 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3526/7080] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:25:10 2022] GET /compute/v2.1/servers/c3396b38-a6a0-40a5-baf4-808452c614fb => generated 1186 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:25:11.691891 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-fbc1b2be-a9c3-4b67-add9-8be415f0ca49 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:25:11.693130 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-fbc1b2be-a9c3-4b67-add9-8be415f0ca49 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] [instance: c3396b38-a6a0-40a5-baf4-808452c614fb] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:25:11.700131 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fbc1b2be-a9c3-4b67-add9-8be415f0ca49 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:25:11.700871 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fbc1b2be-a9c3-4b67-add9-8be415f0ca49 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:25:11.701334 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fbc1b2be-a9c3-4b67-add9-8be415f0ca49 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:25:11.702210 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fbc1b2be-a9c3-4b67-add9-8be415f0ca49 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:25:11.702674 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fbc1b2be-a9c3-4b67-add9-8be415f0ca49 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:25:11.703288 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-fbc1b2be-a9c3-4b67-add9-8be415f0ca49 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:25:11.852166 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-fbc1b2be-a9c3-4b67-add9-8be415f0ca49 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12dda477f454a20aff297708f052dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0a5546dd7e4676b6e1ae44898972e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:25:11.861421 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-fbc1b2be-a9c3-4b67-add9-8be415f0ca49 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] 10.222.0.18 "GET /compute/v2.1/servers/c3396b38-a6a0-40a5-baf4-808452c614fb" status: 200 len: 1272 microversion: 2.1 time: 0.173689 Oct 22 22:25:11.862672 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3555/7081] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:25:11 2022] GET /compute/v2.1/servers/c3396b38-a6a0-40a5-baf4-808452c614fb => generated 1272 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:25:12.176413 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-7c144248-6a6d-45d1-beba-be8254a7968f req-3d8e64d1-8535-4b04-89fe-083f4ce50da5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3396b38-a6a0-40a5-baf4-808452c614fb", "tag": "8e491f5a-9404-4b77-9069-de459390231b"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 22:25:12.187636 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-7c144248-6a6d-45d1-beba-be8254a7968f req-3d8e64d1-8535-4b04-89fe-083f4ce50da5 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:25:12.188187 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-7c144248-6a6d-45d1-beba-be8254a7968f req-3d8e64d1-8535-4b04-89fe-083f4ce50da5 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:25:12.188686 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-7c144248-6a6d-45d1-beba-be8254a7968f req-3d8e64d1-8535-4b04-89fe-083f4ce50da5 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:25:12.201788 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-7c144248-6a6d-45d1-beba-be8254a7968f req-3d8e64d1-8535-4b04-89fe-083f4ce50da5 service nova] Creating event network-changed:8e491f5a-9404-4b77-9069-de459390231b for instance c3396b38-a6a0-40a5-baf4-808452c614fb on nch2-master-1 Oct 22 22:25:12.208361 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-7c144248-6a6d-45d1-beba-be8254a7968f req-3d8e64d1-8535-4b04-89fe-083f4ce50da5 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036234 Oct 22 22:25:12.208981 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3527/7082] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 22:25:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 22:25:12.885433 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-25e5c4ba-23df-4be6-9181-0a98d1b01f7d tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:25:12.886077 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-25e5c4ba-23df-4be6-9181-0a98d1b01f7d tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] [instance: c3396b38-a6a0-40a5-baf4-808452c614fb] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:25:12.893472 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-25e5c4ba-23df-4be6-9181-0a98d1b01f7d tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:25:12.894007 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-25e5c4ba-23df-4be6-9181-0a98d1b01f7d tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:25:12.894469 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-25e5c4ba-23df-4be6-9181-0a98d1b01f7d tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:25:12.895192 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-25e5c4ba-23df-4be6-9181-0a98d1b01f7d tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:25:12.896134 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-25e5c4ba-23df-4be6-9181-0a98d1b01f7d tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:25:12.896134 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-25e5c4ba-23df-4be6-9181-0a98d1b01f7d tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:25:13.035510 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-25e5c4ba-23df-4be6-9181-0a98d1b01f7d tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12dda477f454a20aff297708f052dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0a5546dd7e4676b6e1ae44898972e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:25:13.046890 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-25e5c4ba-23df-4be6-9181-0a98d1b01f7d tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] 10.222.0.18 "GET /compute/v2.1/servers/c3396b38-a6a0-40a5-baf4-808452c614fb" status: 200 len: 1260 microversion: 2.1 time: 0.165434 Oct 22 22:25:13.047585 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3556/7083] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:25:12 2022] GET /compute/v2.1/servers/c3396b38-a6a0-40a5-baf4-808452c614fb => generated 1260 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:25:14.071713 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-19e6c81b-af4c-402a-bf27-61b2376cee46 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:25:14.072426 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-19e6c81b-af4c-402a-bf27-61b2376cee46 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] [instance: c3396b38-a6a0-40a5-baf4-808452c614fb] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:25:14.079507 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-19e6c81b-af4c-402a-bf27-61b2376cee46 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:25:14.080061 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-19e6c81b-af4c-402a-bf27-61b2376cee46 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:25:14.080506 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-19e6c81b-af4c-402a-bf27-61b2376cee46 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:25:14.081209 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-19e6c81b-af4c-402a-bf27-61b2376cee46 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:25:14.081675 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-19e6c81b-af4c-402a-bf27-61b2376cee46 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:25:14.082104 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-19e6c81b-af4c-402a-bf27-61b2376cee46 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:25:14.226802 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-19e6c81b-af4c-402a-bf27-61b2376cee46 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12dda477f454a20aff297708f052dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0a5546dd7e4676b6e1ae44898972e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:25:14.235993 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-19e6c81b-af4c-402a-bf27-61b2376cee46 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] 10.222.0.18 "GET /compute/v2.1/servers/c3396b38-a6a0-40a5-baf4-808452c614fb" status: 200 len: 1260 microversion: 2.1 time: 0.169845 Oct 22 22:25:14.236613 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3528/7084] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:25:14 2022] GET /compute/v2.1/servers/c3396b38-a6a0-40a5-baf4-808452c614fb => generated 1260 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:25:15.264786 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-89a82189-9689-40c5-9511-44d8cc8240d6 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:25:15.265860 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-89a82189-9689-40c5-9511-44d8cc8240d6 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] [instance: c3396b38-a6a0-40a5-baf4-808452c614fb] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:25:15.275036 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-89a82189-9689-40c5-9511-44d8cc8240d6 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:25:15.275994 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-89a82189-9689-40c5-9511-44d8cc8240d6 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:25:15.276250 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-89a82189-9689-40c5-9511-44d8cc8240d6 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:25:15.277046 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-89a82189-9689-40c5-9511-44d8cc8240d6 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:25:15.277644 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-89a82189-9689-40c5-9511-44d8cc8240d6 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:25:15.278114 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-89a82189-9689-40c5-9511-44d8cc8240d6 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:25:15.417271 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-89a82189-9689-40c5-9511-44d8cc8240d6 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12dda477f454a20aff297708f052dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0a5546dd7e4676b6e1ae44898972e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:25:15.425418 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-89a82189-9689-40c5-9511-44d8cc8240d6 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] 10.222.0.18 "GET /compute/v2.1/servers/c3396b38-a6a0-40a5-baf4-808452c614fb" status: 200 len: 1260 microversion: 2.1 time: 0.167537 Oct 22 22:25:15.426117 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3557/7085] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:25:15 2022] GET /compute/v2.1/servers/c3396b38-a6a0-40a5-baf4-808452c614fb => generated 1260 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:25:16.452419 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-b26133fc-70ae-441b-b587-fee0f714e5be tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:25:16.453403 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-b26133fc-70ae-441b-b587-fee0f714e5be tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] [instance: c3396b38-a6a0-40a5-baf4-808452c614fb] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:25:16.464623 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b26133fc-70ae-441b-b587-fee0f714e5be tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:25:16.465405 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b26133fc-70ae-441b-b587-fee0f714e5be tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:25:16.466077 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b26133fc-70ae-441b-b587-fee0f714e5be tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:25:16.467140 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b26133fc-70ae-441b-b587-fee0f714e5be tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:25:16.467858 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b26133fc-70ae-441b-b587-fee0f714e5be tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:25:16.468537 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b26133fc-70ae-441b-b587-fee0f714e5be tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:25:16.611811 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-b26133fc-70ae-441b-b587-fee0f714e5be tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12dda477f454a20aff297708f052dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0a5546dd7e4676b6e1ae44898972e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:25:16.620824 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-b26133fc-70ae-441b-b587-fee0f714e5be tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] 10.222.0.18 "GET /compute/v2.1/servers/c3396b38-a6a0-40a5-baf4-808452c614fb" status: 200 len: 1260 microversion: 2.1 time: 0.174595 Oct 22 22:25:16.621397 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3529/7086] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:25:16 2022] GET /compute/v2.1/servers/c3396b38-a6a0-40a5-baf4-808452c614fb => generated 1260 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:25:17.648712 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-e2f86eb6-91a4-4d1b-8769-38271ab8ac02 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:25:17.649239 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-e2f86eb6-91a4-4d1b-8769-38271ab8ac02 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] [instance: c3396b38-a6a0-40a5-baf4-808452c614fb] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:25:17.656750 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e2f86eb6-91a4-4d1b-8769-38271ab8ac02 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:25:17.657252 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e2f86eb6-91a4-4d1b-8769-38271ab8ac02 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:25:17.657707 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e2f86eb6-91a4-4d1b-8769-38271ab8ac02 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:25:17.658419 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e2f86eb6-91a4-4d1b-8769-38271ab8ac02 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:25:17.658892 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e2f86eb6-91a4-4d1b-8769-38271ab8ac02 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:25:17.659353 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e2f86eb6-91a4-4d1b-8769-38271ab8ac02 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:25:17.798590 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-e2f86eb6-91a4-4d1b-8769-38271ab8ac02 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12dda477f454a20aff297708f052dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0a5546dd7e4676b6e1ae44898972e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:25:17.806979 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-e2f86eb6-91a4-4d1b-8769-38271ab8ac02 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] 10.222.0.18 "GET /compute/v2.1/servers/c3396b38-a6a0-40a5-baf4-808452c614fb" status: 200 len: 1260 microversion: 2.1 time: 0.162762 Oct 22 22:25:17.807593 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3558/7087] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:25:17 2022] GET /compute/v2.1/servers/c3396b38-a6a0-40a5-baf4-808452c614fb => generated 1260 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:25:18.834527 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-64e74beb-7787-4b08-8db0-70543357e0fa tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:25:18.835571 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-64e74beb-7787-4b08-8db0-70543357e0fa tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] [instance: c3396b38-a6a0-40a5-baf4-808452c614fb] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:25:18.847775 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-64e74beb-7787-4b08-8db0-70543357e0fa tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:25:18.848490 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-64e74beb-7787-4b08-8db0-70543357e0fa tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:25:18.849000 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-64e74beb-7787-4b08-8db0-70543357e0fa tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:25:18.849704 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-64e74beb-7787-4b08-8db0-70543357e0fa tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:25:18.850163 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-64e74beb-7787-4b08-8db0-70543357e0fa tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:25:18.850593 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-64e74beb-7787-4b08-8db0-70543357e0fa tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:25:18.988373 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-64e74beb-7787-4b08-8db0-70543357e0fa tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12dda477f454a20aff297708f052dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0a5546dd7e4676b6e1ae44898972e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:25:18.997358 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-64e74beb-7787-4b08-8db0-70543357e0fa tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] 10.222.0.18 "GET /compute/v2.1/servers/c3396b38-a6a0-40a5-baf4-808452c614fb" status: 200 len: 1260 microversion: 2.1 time: 0.169585 Oct 22 22:25:18.998144 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3530/7088] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:25:18 2022] GET /compute/v2.1/servers/c3396b38-a6a0-40a5-baf4-808452c614fb => generated 1260 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:25:19.960734 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell0:SELECT=6 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:25:20.013658 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-07d8e867-e806-442f-9ae8-cce5992a47e8 req-896a092b-cfa5-48f2-903a-fa89033dacf6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3396b38-a6a0-40a5-baf4-808452c614fb", "name": "network-vif-plugged", "status": "completed", "tag": "8e491f5a-9404-4b77-9069-de459390231b"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 22:25:20.019374 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-1ff7206e-5432-46bd-b922-083478eb1a62 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:25:20.020870 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-1ff7206e-5432-46bd-b922-083478eb1a62 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] [instance: c3396b38-a6a0-40a5-baf4-808452c614fb] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:25:20.023124 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell0:SELECT=2 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:25:20.024013 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell0:SELECT=6 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:25:20.024379 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-07d8e867-e806-442f-9ae8-cce5992a47e8 req-896a092b-cfa5-48f2-903a-fa89033dacf6 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:25:20.024945 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-07d8e867-e806-442f-9ae8-cce5992a47e8 req-896a092b-cfa5-48f2-903a-fa89033dacf6 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:25:20.025632 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-07d8e867-e806-442f-9ae8-cce5992a47e8 req-896a092b-cfa5-48f2-903a-fa89033dacf6 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:25:20.031195 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1ff7206e-5432-46bd-b922-083478eb1a62 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:25:20.031736 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1ff7206e-5432-46bd-b922-083478eb1a62 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:25:20.032188 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1ff7206e-5432-46bd-b922-083478eb1a62 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:25:20.032909 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1ff7206e-5432-46bd-b922-083478eb1a62 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:25:20.033371 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1ff7206e-5432-46bd-b922-083478eb1a62 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:25:20.033979 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1ff7206e-5432-46bd-b922-083478eb1a62 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:25:20.038619 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-07d8e867-e806-442f-9ae8-cce5992a47e8 req-896a092b-cfa5-48f2-903a-fa89033dacf6 service nova] Creating event network-vif-plugged:8e491f5a-9404-4b77-9069-de459390231b for instance c3396b38-a6a0-40a5-baf4-808452c614fb on nch2-master-1 Oct 22 22:25:20.044523 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-07d8e867-e806-442f-9ae8-cce5992a47e8 req-896a092b-cfa5-48f2-903a-fa89033dacf6 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089410 Oct 22 22:25:20.045218 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3559/7089] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 22:25:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 22:25:20.171072 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-1ff7206e-5432-46bd-b922-083478eb1a62 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12dda477f454a20aff297708f052dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0a5546dd7e4676b6e1ae44898972e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:25:20.179074 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-1ff7206e-5432-46bd-b922-083478eb1a62 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] 10.222.0.18 "GET /compute/v2.1/servers/c3396b38-a6a0-40a5-baf4-808452c614fb" status: 200 len: 1260 microversion: 2.1 time: 0.163674 Oct 22 22:25:20.179914 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3531/7090] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:25:20 2022] GET /compute/v2.1/servers/c3396b38-a6a0-40a5-baf4-808452c614fb => generated 1260 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 22:25:21.202403 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-e2a886a3-2642-439b-915e-a75ba3aa29df tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:25:21.203144 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-e2a886a3-2642-439b-915e-a75ba3aa29df tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] [instance: c3396b38-a6a0-40a5-baf4-808452c614fb] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:25:21.210609 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e2a886a3-2642-439b-915e-a75ba3aa29df tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:25:21.211110 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e2a886a3-2642-439b-915e-a75ba3aa29df tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:25:21.211605 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e2a886a3-2642-439b-915e-a75ba3aa29df tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:25:21.212314 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e2a886a3-2642-439b-915e-a75ba3aa29df tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:25:21.212786 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e2a886a3-2642-439b-915e-a75ba3aa29df tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:25:21.213226 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e2a886a3-2642-439b-915e-a75ba3aa29df tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:25:21.353866 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-e2a886a3-2642-439b-915e-a75ba3aa29df tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12dda477f454a20aff297708f052dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0a5546dd7e4676b6e1ae44898972e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:25:21.362326 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-e2a886a3-2642-439b-915e-a75ba3aa29df tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] 10.222.0.18 "GET /compute/v2.1/servers/c3396b38-a6a0-40a5-baf4-808452c614fb" status: 200 len: 1260 microversion: 2.1 time: 0.164281 Oct 22 22:25:21.362905 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3560/7091] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:25:21 2022] GET /compute/v2.1/servers/c3396b38-a6a0-40a5-baf4-808452c614fb => generated 1260 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:25:22.391058 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-ea4340e5-f626-45d2-a349-b42a9cab458f tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:25:22.392241 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-ea4340e5-f626-45d2-a349-b42a9cab458f tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] [instance: c3396b38-a6a0-40a5-baf4-808452c614fb] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:25:22.404163 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ea4340e5-f626-45d2-a349-b42a9cab458f tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:25:22.404940 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ea4340e5-f626-45d2-a349-b42a9cab458f tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:25:22.405708 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ea4340e5-f626-45d2-a349-b42a9cab458f tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:25:22.406867 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ea4340e5-f626-45d2-a349-b42a9cab458f tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:25:22.407700 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ea4340e5-f626-45d2-a349-b42a9cab458f tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:25:22.408426 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ea4340e5-f626-45d2-a349-b42a9cab458f tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:25:22.545407 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-ea4340e5-f626-45d2-a349-b42a9cab458f tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12dda477f454a20aff297708f052dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0a5546dd7e4676b6e1ae44898972e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:25:22.553970 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-ea4340e5-f626-45d2-a349-b42a9cab458f tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] 10.222.0.18 "GET /compute/v2.1/servers/c3396b38-a6a0-40a5-baf4-808452c614fb" status: 200 len: 1445 microversion: 2.1 time: 0.169617 Oct 22 22:25:22.554553 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3532/7092] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:25:22 2022] GET /compute/v2.1/servers/c3396b38-a6a0-40a5-baf4-808452c614fb => generated 1445 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:25:22.579118 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-89adc9ee-791f-4b2b-a5d2-4c22c86f8dbf tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:25:22.579804 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-89adc9ee-791f-4b2b-a5d2-4c22c86f8dbf tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] [instance: c3396b38-a6a0-40a5-baf4-808452c614fb] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:25:22.590951 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-89adc9ee-791f-4b2b-a5d2-4c22c86f8dbf tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:25:22.591703 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-89adc9ee-791f-4b2b-a5d2-4c22c86f8dbf tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:25:22.592326 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-89adc9ee-791f-4b2b-a5d2-4c22c86f8dbf tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:25:22.593477 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-89adc9ee-791f-4b2b-a5d2-4c22c86f8dbf tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:25:22.594119 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-89adc9ee-791f-4b2b-a5d2-4c22c86f8dbf tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:25:22.594567 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-89adc9ee-791f-4b2b-a5d2-4c22c86f8dbf tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:25:22.732820 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-89adc9ee-791f-4b2b-a5d2-4c22c86f8dbf tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12dda477f454a20aff297708f052dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0a5546dd7e4676b6e1ae44898972e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:25:22.741455 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-89adc9ee-791f-4b2b-a5d2-4c22c86f8dbf tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] 10.222.0.18 "GET /compute/v2.1/servers/c3396b38-a6a0-40a5-baf4-808452c614fb" status: 200 len: 1445 microversion: 2.1 time: 0.168769 Oct 22 22:25:22.742046 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3561/7093] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:25:22 2022] GET /compute/v2.1/servers/c3396b38-a6a0-40a5-baf4-808452c614fb => generated 1445 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:25:24.532320 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-2e31c57b-85b5-47af-bc32-c27b1c958492 req-2380ec6e-3bb3-4ef6-9210-7b4734a26717 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3396b38-a6a0-40a5-baf4-808452c614fb", "tag": "8e491f5a-9404-4b77-9069-de459390231b"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 22:25:24.542983 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-2e31c57b-85b5-47af-bc32-c27b1c958492 req-2380ec6e-3bb3-4ef6-9210-7b4734a26717 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:25:24.543507 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-2e31c57b-85b5-47af-bc32-c27b1c958492 req-2380ec6e-3bb3-4ef6-9210-7b4734a26717 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:25:24.543934 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-2e31c57b-85b5-47af-bc32-c27b1c958492 req-2380ec6e-3bb3-4ef6-9210-7b4734a26717 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:25:24.556344 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-2e31c57b-85b5-47af-bc32-c27b1c958492 req-2380ec6e-3bb3-4ef6-9210-7b4734a26717 service nova] Creating event network-changed:8e491f5a-9404-4b77-9069-de459390231b for instance c3396b38-a6a0-40a5-baf4-808452c614fb on nch2-master-1 Oct 22 22:25:24.561570 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-2e31c57b-85b5-47af-bc32-c27b1c958492 req-2380ec6e-3bb3-4ef6-9210-7b4734a26717 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033076 Oct 22 22:25:24.563540 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3533/7094] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 22:25:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 22:27:38.054610 ncdv-master-1 devstack@n-api.service[138745]: ERROR oslo.messaging._drivers.impl_rabbit [-] [82d96799-6494-46cc-9c4c-c1ce995f6091] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 22 22:27:38.056756 ncdv-master-1 devstack@n-api.service[138745]: ERROR oslo.messaging._drivers.impl_rabbit [-] [dbe685c1-0e25-4156-906e-a0926e5c28f4] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 22 22:27:38.057351 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:27:38.058132 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:27:38.058939 ncdv-master-1 devstack@n-api.service[138745]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 22 22:27:38.059175 ncdv-master-1 devstack@n-api.service[138745]: Sat Oct 22 22:27:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c3396b38-a6a0-40a5-baf4-808452c614fb/action (ip 10.222.0.18) !!! Oct 22 22:27:38.060464 ncdv-master-1 devstack@n-api.service[138745]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 22 22:27:38.060620 ncdv-master-1 devstack@n-api.service[138745]: Sat Oct 22 22:27:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c3396b38-a6a0-40a5-baf4-808452c614fb/action (ip 10.222.0.18) !!! Oct 22 22:27:38.061750 ncdv-master-1 devstack@n-api.service[138745]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 22 22:27:38.061906 ncdv-master-1 devstack@n-api.service[138745]: Sat Oct 22 22:27:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c3396b38-a6a0-40a5-baf4-808452c614fb/action (ip 10.222.0.18) !!! Oct 22 22:27:38.067847 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-41e5ccbf-34b8-4c19-9e42-eb90fc9ca8fe tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 22:27:38.068410 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-41e5ccbf-34b8-4c19-9e42-eb90fc9ca8fe tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] [instance: c3396b38-a6a0-40a5-baf4-808452c614fb] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:27:38.080851 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-41e5ccbf-34b8-4c19-9e42-eb90fc9ca8fe tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:27:38.081426 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-41e5ccbf-34b8-4c19-9e42-eb90fc9ca8fe tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:27:38.081964 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-41e5ccbf-34b8-4c19-9e42-eb90fc9ca8fe tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:27:38.082840 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-41e5ccbf-34b8-4c19-9e42-eb90fc9ca8fe tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:27:38.083463 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-41e5ccbf-34b8-4c19-9e42-eb90fc9ca8fe tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:27:38.083926 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-41e5ccbf-34b8-4c19-9e42-eb90fc9ca8fe tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:27:38.111921 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.objects.instance [None req-41e5ccbf-34b8-4c19-9e42-eb90fc9ca8fe tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lazy-loading 'flavor' on Instance uuid c3396b38-a6a0-40a5-baf4-808452c614fb {{(pid=138745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 22:27:38.191016 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-41e5ccbf-34b8-4c19-9e42-eb90fc9ca8fe tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] 10.222.0.18 "POST /compute/v2.1/servers/c3396b38-a6a0-40a5-baf4-808452c614fb/action" status: 202 len: 0 microversion: 2.1 time: 0.139659 Oct 22 22:27:38.191685 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3562/7095] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 22:27:38 2022] POST /compute/v2.1/servers/c3396b38-a6a0-40a5-baf4-808452c614fb/action => generated 0 bytes in 142 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 22:27:38.198511 ncdv-master-1 devstack@n-api.service[138744]: ERROR oslo.messaging._drivers.impl_rabbit [-] [81790953-1e28-46a4-954d-7f89676de4fb] AMQP server on 10.222.0.18:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 22 22:27:38.199368 ncdv-master-1 devstack@n-api.service[138744]: ERROR oslo.messaging._drivers.impl_rabbit [-] [04d2594c-31df-45b7-a94b-e87da15c0f2c] AMQP server on 10.222.0.18:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 22 22:27:38.200031 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_api:SELECT=42,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:27:38.200756 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:SELECT=52 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:27:38.201723 ncdv-master-1 devstack@n-api.service[138744]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 22 22:27:38.201853 ncdv-master-1 devstack@n-api.service[138744]: Sat Oct 22 22:27:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c3396b38-a6a0-40a5-baf4-808452c614fb (ip 10.222.0.18) !!! Oct 22 22:27:38.203007 ncdv-master-1 devstack@n-api.service[138744]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 22 22:27:38.203356 ncdv-master-1 devstack@n-api.service[138744]: Sat Oct 22 22:27:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c3396b38-a6a0-40a5-baf4-808452c614fb (ip 10.222.0.18) !!! Oct 22 22:27:38.204451 ncdv-master-1 devstack@n-api.service[138744]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 22 22:27:38.204557 ncdv-master-1 devstack@n-api.service[138744]: Sat Oct 22 22:27:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c3396b38-a6a0-40a5-baf4-808452c614fb (ip 10.222.0.18) !!! Oct 22 22:27:38.210400 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-11d9960e-00f9-4e29-a322-78741c5f2be6 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:27:38.211099 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-11d9960e-00f9-4e29-a322-78741c5f2be6 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] [instance: c3396b38-a6a0-40a5-baf4-808452c614fb] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:27:38.224261 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-11d9960e-00f9-4e29-a322-78741c5f2be6 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:27:38.224759 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-11d9960e-00f9-4e29-a322-78741c5f2be6 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:27:38.225206 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-11d9960e-00f9-4e29-a322-78741c5f2be6 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:27:38.225921 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-11d9960e-00f9-4e29-a322-78741c5f2be6 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:27:38.226385 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-11d9960e-00f9-4e29-a322-78741c5f2be6 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:27:38.226813 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-11d9960e-00f9-4e29-a322-78741c5f2be6 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:27:38.375588 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-11d9960e-00f9-4e29-a322-78741c5f2be6 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12dda477f454a20aff297708f052dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0a5546dd7e4676b6e1ae44898972e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:27:38.386584 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-11d9960e-00f9-4e29-a322-78741c5f2be6 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] 10.222.0.18 "GET /compute/v2.1/servers/c3396b38-a6a0-40a5-baf4-808452c614fb" status: 200 len: 1570 microversion: 2.1 time: 0.190116 Oct 22 22:27:38.387188 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3534/7096] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:27:38 2022] GET /compute/v2.1/servers/c3396b38-a6a0-40a5-baf4-808452c614fb => generated 1570 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 22:27:39.414946 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-1d91031d-2c1d-441d-a31c-d1abbd3fcdd7 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:27:39.415791 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-1d91031d-2c1d-441d-a31c-d1abbd3fcdd7 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] [instance: c3396b38-a6a0-40a5-baf4-808452c614fb] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:27:39.424349 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1d91031d-2c1d-441d-a31c-d1abbd3fcdd7 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:27:39.424850 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1d91031d-2c1d-441d-a31c-d1abbd3fcdd7 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:27:39.425305 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1d91031d-2c1d-441d-a31c-d1abbd3fcdd7 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:27:39.426018 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1d91031d-2c1d-441d-a31c-d1abbd3fcdd7 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:27:39.426494 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1d91031d-2c1d-441d-a31c-d1abbd3fcdd7 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:27:39.426942 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1d91031d-2c1d-441d-a31c-d1abbd3fcdd7 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:27:39.431856 ncdv-master-1 devstack@n-api.service[138745]: INFO oslo.messaging._drivers.impl_rabbit [-] [82d96799-6494-46cc-9c4c-c1ce995f6091] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 40798. Oct 22 22:27:39.432621 ncdv-master-1 devstack@n-api.service[138745]: INFO oslo.messaging._drivers.impl_rabbit [-] [dbe685c1-0e25-4156-906e-a0926e5c28f4] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 40800. Oct 22 22:27:39.572655 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-1d91031d-2c1d-441d-a31c-d1abbd3fcdd7 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12dda477f454a20aff297708f052dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0a5546dd7e4676b6e1ae44898972e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:27:39.581223 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-1d91031d-2c1d-441d-a31c-d1abbd3fcdd7 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] 10.222.0.18 "GET /compute/v2.1/servers/c3396b38-a6a0-40a5-baf4-808452c614fb" status: 200 len: 1570 microversion: 2.1 time: 0.174094 Oct 22 22:27:39.581805 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3563/7097] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:27:39 2022] GET /compute/v2.1/servers/c3396b38-a6a0-40a5-baf4-808452c614fb => generated 1570 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:27:40.609438 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-16e8572e-abe5-4201-ba4b-385e34c4de1a tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:27:40.610197 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-16e8572e-abe5-4201-ba4b-385e34c4de1a tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] [instance: c3396b38-a6a0-40a5-baf4-808452c614fb] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:27:40.625722 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-16e8572e-abe5-4201-ba4b-385e34c4de1a tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:27:40.626373 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-16e8572e-abe5-4201-ba4b-385e34c4de1a tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:27:40.627039 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-16e8572e-abe5-4201-ba4b-385e34c4de1a tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:27:40.628015 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-16e8572e-abe5-4201-ba4b-385e34c4de1a tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:27:40.628599 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-16e8572e-abe5-4201-ba4b-385e34c4de1a tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:27:40.629176 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-16e8572e-abe5-4201-ba4b-385e34c4de1a tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:27:40.650301 ncdv-master-1 devstack@n-api.service[138744]: INFO oslo.messaging._drivers.impl_rabbit [-] [04d2594c-31df-45b7-a94b-e87da15c0f2c] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 40806. Oct 22 22:27:40.651130 ncdv-master-1 devstack@n-api.service[138744]: INFO oslo.messaging._drivers.impl_rabbit [-] [81790953-1e28-46a4-954d-7f89676de4fb] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 40804. Oct 22 22:27:40.781395 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-16e8572e-abe5-4201-ba4b-385e34c4de1a tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12dda477f454a20aff297708f052dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0a5546dd7e4676b6e1ae44898972e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:27:40.789781 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-16e8572e-abe5-4201-ba4b-385e34c4de1a tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] 10.222.0.18 "GET /compute/v2.1/servers/c3396b38-a6a0-40a5-baf4-808452c614fb" status: 200 len: 1570 microversion: 2.1 time: 0.185769 Oct 22 22:27:40.790367 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3535/7098] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:27:40 2022] GET /compute/v2.1/servers/c3396b38-a6a0-40a5-baf4-808452c614fb => generated 1570 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:27:41.816727 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-5be902af-74aa-438e-b612-29f1fe18f571 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:27:41.817688 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-5be902af-74aa-438e-b612-29f1fe18f571 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] [instance: c3396b38-a6a0-40a5-baf4-808452c614fb] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:27:41.828732 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5be902af-74aa-438e-b612-29f1fe18f571 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:27:41.829511 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5be902af-74aa-438e-b612-29f1fe18f571 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:27:41.830221 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5be902af-74aa-438e-b612-29f1fe18f571 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:27:41.831314 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5be902af-74aa-438e-b612-29f1fe18f571 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:27:41.832086 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5be902af-74aa-438e-b612-29f1fe18f571 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:27:41.832780 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5be902af-74aa-438e-b612-29f1fe18f571 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:27:41.970160 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-5be902af-74aa-438e-b612-29f1fe18f571 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12dda477f454a20aff297708f052dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0a5546dd7e4676b6e1ae44898972e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:27:41.982651 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-5be902af-74aa-438e-b612-29f1fe18f571 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] 10.222.0.18 "GET /compute/v2.1/servers/c3396b38-a6a0-40a5-baf4-808452c614fb" status: 200 len: 1570 microversion: 2.1 time: 0.171996 Oct 22 22:27:41.983478 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3564/7099] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:27:41 2022] GET /compute/v2.1/servers/c3396b38-a6a0-40a5-baf4-808452c614fb => generated 1570 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:27:43.010896 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-200b4b6c-2cc2-4a53-a34d-f0e0223a8c64 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:27:43.011563 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-200b4b6c-2cc2-4a53-a34d-f0e0223a8c64 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] [instance: c3396b38-a6a0-40a5-baf4-808452c614fb] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:27:43.019649 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-200b4b6c-2cc2-4a53-a34d-f0e0223a8c64 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:27:43.020201 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-200b4b6c-2cc2-4a53-a34d-f0e0223a8c64 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:27:43.020687 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-200b4b6c-2cc2-4a53-a34d-f0e0223a8c64 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:27:43.021455 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-200b4b6c-2cc2-4a53-a34d-f0e0223a8c64 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:27:43.021961 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-200b4b6c-2cc2-4a53-a34d-f0e0223a8c64 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:27:43.022440 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-200b4b6c-2cc2-4a53-a34d-f0e0223a8c64 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:27:43.168943 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-200b4b6c-2cc2-4a53-a34d-f0e0223a8c64 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12dda477f454a20aff297708f052dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0a5546dd7e4676b6e1ae44898972e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:27:43.177668 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-200b4b6c-2cc2-4a53-a34d-f0e0223a8c64 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] 10.222.0.18 "GET /compute/v2.1/servers/c3396b38-a6a0-40a5-baf4-808452c614fb" status: 200 len: 1570 microversion: 2.1 time: 0.173370 Oct 22 22:27:43.178256 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3536/7100] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:27:43 2022] GET /compute/v2.1/servers/c3396b38-a6a0-40a5-baf4-808452c614fb => generated 1570 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:27:44.205789 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-2e641341-bb2a-4c22-95c3-da5aa49896d9 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:27:44.206817 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-2e641341-bb2a-4c22-95c3-da5aa49896d9 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] [instance: c3396b38-a6a0-40a5-baf4-808452c614fb] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:27:44.217631 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2e641341-bb2a-4c22-95c3-da5aa49896d9 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:27:44.218133 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2e641341-bb2a-4c22-95c3-da5aa49896d9 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:27:44.218587 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2e641341-bb2a-4c22-95c3-da5aa49896d9 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:27:44.219302 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2e641341-bb2a-4c22-95c3-da5aa49896d9 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:27:44.219822 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2e641341-bb2a-4c22-95c3-da5aa49896d9 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:27:44.220264 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2e641341-bb2a-4c22-95c3-da5aa49896d9 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:27:44.359949 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-2e641341-bb2a-4c22-95c3-da5aa49896d9 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12dda477f454a20aff297708f052dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0a5546dd7e4676b6e1ae44898972e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:27:44.372258 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-2e641341-bb2a-4c22-95c3-da5aa49896d9 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] 10.222.0.18 "GET /compute/v2.1/servers/c3396b38-a6a0-40a5-baf4-808452c614fb" status: 200 len: 1570 microversion: 2.1 time: 0.172924 Oct 22 22:27:44.373216 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3565/7101] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:27:44 2022] GET /compute/v2.1/servers/c3396b38-a6a0-40a5-baf4-808452c614fb => generated 1570 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:27:45.401023 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-739f36bf-1bbc-4061-aaa4-ae597e9ce6f7 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:27:45.401703 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-739f36bf-1bbc-4061-aaa4-ae597e9ce6f7 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] [instance: c3396b38-a6a0-40a5-baf4-808452c614fb] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:27:45.409251 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-739f36bf-1bbc-4061-aaa4-ae597e9ce6f7 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:27:45.409740 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-739f36bf-1bbc-4061-aaa4-ae597e9ce6f7 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:27:45.410184 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-739f36bf-1bbc-4061-aaa4-ae597e9ce6f7 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:27:45.410889 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-739f36bf-1bbc-4061-aaa4-ae597e9ce6f7 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:27:45.411367 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-739f36bf-1bbc-4061-aaa4-ae597e9ce6f7 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:27:45.411816 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-739f36bf-1bbc-4061-aaa4-ae597e9ce6f7 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:27:45.549822 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-739f36bf-1bbc-4061-aaa4-ae597e9ce6f7 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12dda477f454a20aff297708f052dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0a5546dd7e4676b6e1ae44898972e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:27:45.558709 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-739f36bf-1bbc-4061-aaa4-ae597e9ce6f7 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] 10.222.0.18 "GET /compute/v2.1/servers/c3396b38-a6a0-40a5-baf4-808452c614fb" status: 200 len: 1570 microversion: 2.1 time: 0.161708 Oct 22 22:27:45.559324 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3537/7102] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:27:45 2022] GET /compute/v2.1/servers/c3396b38-a6a0-40a5-baf4-808452c614fb => generated 1570 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:27:46.582257 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-34c79b66-aff9-48d2-a6fb-15fbdb2154f3 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:27:46.582880 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-34c79b66-aff9-48d2-a6fb-15fbdb2154f3 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] [instance: c3396b38-a6a0-40a5-baf4-808452c614fb] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:27:46.590919 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-34c79b66-aff9-48d2-a6fb-15fbdb2154f3 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:27:46.591458 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-34c79b66-aff9-48d2-a6fb-15fbdb2154f3 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:27:46.592009 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-34c79b66-aff9-48d2-a6fb-15fbdb2154f3 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:27:46.593098 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-34c79b66-aff9-48d2-a6fb-15fbdb2154f3 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:27:46.593797 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-34c79b66-aff9-48d2-a6fb-15fbdb2154f3 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:27:46.594477 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-34c79b66-aff9-48d2-a6fb-15fbdb2154f3 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:27:46.747183 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-34c79b66-aff9-48d2-a6fb-15fbdb2154f3 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12dda477f454a20aff297708f052dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0a5546dd7e4676b6e1ae44898972e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:27:46.755553 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-34c79b66-aff9-48d2-a6fb-15fbdb2154f3 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] 10.222.0.18 "GET /compute/v2.1/servers/c3396b38-a6a0-40a5-baf4-808452c614fb" status: 200 len: 1570 microversion: 2.1 time: 0.177167 Oct 22 22:27:46.756136 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3566/7103] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:27:46 2022] GET /compute/v2.1/servers/c3396b38-a6a0-40a5-baf4-808452c614fb => generated 1570 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:27:47.778687 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-d61c167f-158b-4634-b0d3-63b50872a35a tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:27:47.779428 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-d61c167f-158b-4634-b0d3-63b50872a35a tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] [instance: c3396b38-a6a0-40a5-baf4-808452c614fb] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:27:47.787210 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d61c167f-158b-4634-b0d3-63b50872a35a tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:27:47.787745 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d61c167f-158b-4634-b0d3-63b50872a35a tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:27:47.788183 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d61c167f-158b-4634-b0d3-63b50872a35a tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:27:47.788882 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d61c167f-158b-4634-b0d3-63b50872a35a tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:27:47.789336 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d61c167f-158b-4634-b0d3-63b50872a35a tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:27:47.789767 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d61c167f-158b-4634-b0d3-63b50872a35a tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:27:47.929059 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-d61c167f-158b-4634-b0d3-63b50872a35a tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12dda477f454a20aff297708f052dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0a5546dd7e4676b6e1ae44898972e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:27:47.941731 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-d61c167f-158b-4634-b0d3-63b50872a35a tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] 10.222.0.18 "GET /compute/v2.1/servers/c3396b38-a6a0-40a5-baf4-808452c614fb" status: 200 len: 1570 microversion: 2.1 time: 0.166908 Oct 22 22:27:47.942531 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3538/7104] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:27:47 2022] GET /compute/v2.1/servers/c3396b38-a6a0-40a5-baf4-808452c614fb => generated 1570 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:27:48.969193 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-196726d8-721d-4f5e-999f-89dccd0d223d tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:27:48.969794 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-196726d8-721d-4f5e-999f-89dccd0d223d tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] [instance: c3396b38-a6a0-40a5-baf4-808452c614fb] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:27:48.977078 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-196726d8-721d-4f5e-999f-89dccd0d223d tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:27:48.977579 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-196726d8-721d-4f5e-999f-89dccd0d223d tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:27:48.978037 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-196726d8-721d-4f5e-999f-89dccd0d223d tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:27:48.978752 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-196726d8-721d-4f5e-999f-89dccd0d223d tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:27:48.979228 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-196726d8-721d-4f5e-999f-89dccd0d223d tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:27:48.979713 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-196726d8-721d-4f5e-999f-89dccd0d223d tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:27:49.118637 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-196726d8-721d-4f5e-999f-89dccd0d223d tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12dda477f454a20aff297708f052dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0a5546dd7e4676b6e1ae44898972e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:27:49.128432 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-196726d8-721d-4f5e-999f-89dccd0d223d tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] 10.222.0.18 "GET /compute/v2.1/servers/c3396b38-a6a0-40a5-baf4-808452c614fb" status: 200 len: 1570 microversion: 2.1 time: 0.162969 Oct 22 22:27:49.129208 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3567/7105] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:27:48 2022] GET /compute/v2.1/servers/c3396b38-a6a0-40a5-baf4-808452c614fb => generated 1570 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:27:50.164177 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-6f326af9-d7a3-4614-8e6a-c81d5b313bb9 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:27:50.165209 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-6f326af9-d7a3-4614-8e6a-c81d5b313bb9 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] [instance: c3396b38-a6a0-40a5-baf4-808452c614fb] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:27:50.174596 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6f326af9-d7a3-4614-8e6a-c81d5b313bb9 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:27:50.175090 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6f326af9-d7a3-4614-8e6a-c81d5b313bb9 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:27:50.175586 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6f326af9-d7a3-4614-8e6a-c81d5b313bb9 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:27:50.176296 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6f326af9-d7a3-4614-8e6a-c81d5b313bb9 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:27:50.176758 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6f326af9-d7a3-4614-8e6a-c81d5b313bb9 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:27:50.177192 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-6f326af9-d7a3-4614-8e6a-c81d5b313bb9 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:27:50.322086 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-6f326af9-d7a3-4614-8e6a-c81d5b313bb9 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12dda477f454a20aff297708f052dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0a5546dd7e4676b6e1ae44898972e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:27:50.330493 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-6f326af9-d7a3-4614-8e6a-c81d5b313bb9 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] 10.222.0.18 "GET /compute/v2.1/servers/c3396b38-a6a0-40a5-baf4-808452c614fb" status: 200 len: 1570 microversion: 2.1 time: 0.172898 Oct 22 22:27:50.331163 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3539/7106] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:27:50 2022] GET /compute/v2.1/servers/c3396b38-a6a0-40a5-baf4-808452c614fb => generated 1570 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:27:51.356917 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-249c2dc1-9dda-4248-9ae7-fbec659cb64f tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:27:51.357811 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-249c2dc1-9dda-4248-9ae7-fbec659cb64f tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] [instance: c3396b38-a6a0-40a5-baf4-808452c614fb] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:27:51.367533 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-249c2dc1-9dda-4248-9ae7-fbec659cb64f tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:27:51.368210 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-249c2dc1-9dda-4248-9ae7-fbec659cb64f tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:27:51.368822 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-249c2dc1-9dda-4248-9ae7-fbec659cb64f tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:27:51.369821 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-249c2dc1-9dda-4248-9ae7-fbec659cb64f tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:27:51.370457 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-249c2dc1-9dda-4248-9ae7-fbec659cb64f tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:27:51.371058 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-249c2dc1-9dda-4248-9ae7-fbec659cb64f tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:27:51.512905 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-249c2dc1-9dda-4248-9ae7-fbec659cb64f tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12dda477f454a20aff297708f052dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0a5546dd7e4676b6e1ae44898972e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:27:51.520930 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-249c2dc1-9dda-4248-9ae7-fbec659cb64f tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] 10.222.0.18 "GET /compute/v2.1/servers/c3396b38-a6a0-40a5-baf4-808452c614fb" status: 200 len: 1571 microversion: 2.1 time: 0.169682 Oct 22 22:27:51.521509 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3568/7107] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:27:51 2022] GET /compute/v2.1/servers/c3396b38-a6a0-40a5-baf4-808452c614fb => generated 1571 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:27:51.545711 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-5d459b85-ac39-4a10-bc02-4510631cd4d2 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 22:27:51.546326 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-5d459b85-ac39-4a10-bc02-4510631cd4d2 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] [instance: c3396b38-a6a0-40a5-baf4-808452c614fb] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:27:51.553583 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5d459b85-ac39-4a10-bc02-4510631cd4d2 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:27:51.554085 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5d459b85-ac39-4a10-bc02-4510631cd4d2 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:27:51.554538 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5d459b85-ac39-4a10-bc02-4510631cd4d2 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:27:51.555252 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5d459b85-ac39-4a10-bc02-4510631cd4d2 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:27:51.555748 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5d459b85-ac39-4a10-bc02-4510631cd4d2 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:27:51.556186 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-5d459b85-ac39-4a10-bc02-4510631cd4d2 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:27:51.586066 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-5d459b85-ac39-4a10-bc02-4510631cd4d2 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] [instance: c3396b38-a6a0-40a5-baf4-808452c614fb] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=138744) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 22 22:27:51.663288 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-5d459b85-ac39-4a10-bc02-4510631cd4d2 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] 10.222.0.18 "POST /compute/v2.1/servers/c3396b38-a6a0-40a5-baf4-808452c614fb/action" status: 202 len: 0 microversion: 2.1 time: 0.121768 Oct 22 22:27:51.666900 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3540/7108] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 22:27:51 2022] POST /compute/v2.1/servers/c3396b38-a6a0-40a5-baf4-808452c614fb/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 22:27:51.672550 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-bafeb8bd-f40a-4e37-8958-a9bf35c93b0f tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:27:51.673178 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-bafeb8bd-f40a-4e37-8958-a9bf35c93b0f tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] [instance: c3396b38-a6a0-40a5-baf4-808452c614fb] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:27:51.679487 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bafeb8bd-f40a-4e37-8958-a9bf35c93b0f tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:27:51.679976 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bafeb8bd-f40a-4e37-8958-a9bf35c93b0f tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:27:51.680444 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bafeb8bd-f40a-4e37-8958-a9bf35c93b0f tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:27:51.681179 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bafeb8bd-f40a-4e37-8958-a9bf35c93b0f tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:27:51.681645 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bafeb8bd-f40a-4e37-8958-a9bf35c93b0f tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:27:51.682086 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-bafeb8bd-f40a-4e37-8958-a9bf35c93b0f tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:27:51.857036 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-bafeb8bd-f40a-4e37-8958-a9bf35c93b0f tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12dda477f454a20aff297708f052dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0a5546dd7e4676b6e1ae44898972e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:27:51.865510 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-bafeb8bd-f40a-4e37-8958-a9bf35c93b0f tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] 10.222.0.18 "GET /compute/v2.1/servers/c3396b38-a6a0-40a5-baf4-808452c614fb" status: 200 len: 1519 microversion: 2.1 time: 0.197033 Oct 22 22:27:51.872603 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3569/7109] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:27:51 2022] GET /compute/v2.1/servers/c3396b38-a6a0-40a5-baf4-808452c614fb => generated 1519 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:27:52.890324 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-def59fd0-5d71-4659-861a-135f39fd3e74 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:27:52.890996 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-def59fd0-5d71-4659-861a-135f39fd3e74 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] [instance: c3396b38-a6a0-40a5-baf4-808452c614fb] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:27:52.897953 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-def59fd0-5d71-4659-861a-135f39fd3e74 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:27:52.898477 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-def59fd0-5d71-4659-861a-135f39fd3e74 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:27:52.898923 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-def59fd0-5d71-4659-861a-135f39fd3e74 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:27:52.899685 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-def59fd0-5d71-4659-861a-135f39fd3e74 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:27:52.900204 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-def59fd0-5d71-4659-861a-135f39fd3e74 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:27:52.900577 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-def59fd0-5d71-4659-861a-135f39fd3e74 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:27:53.036111 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-def59fd0-5d71-4659-861a-135f39fd3e74 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12dda477f454a20aff297708f052dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0a5546dd7e4676b6e1ae44898972e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:27:53.044699 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-def59fd0-5d71-4659-861a-135f39fd3e74 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] 10.222.0.18 "GET /compute/v2.1/servers/c3396b38-a6a0-40a5-baf4-808452c614fb" status: 200 len: 1521 microversion: 2.1 time: 0.159098 Oct 22 22:27:53.045323 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3541/7110] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:27:52 2022] GET /compute/v2.1/servers/c3396b38-a6a0-40a5-baf4-808452c614fb => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:27:54.069290 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-a0ef1cfe-464e-4226-b4d7-845b894bc044 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:27:54.070075 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-a0ef1cfe-464e-4226-b4d7-845b894bc044 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] [instance: c3396b38-a6a0-40a5-baf4-808452c614fb] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:27:54.078192 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a0ef1cfe-464e-4226-b4d7-845b894bc044 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:27:54.078777 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a0ef1cfe-464e-4226-b4d7-845b894bc044 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:27:54.079364 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a0ef1cfe-464e-4226-b4d7-845b894bc044 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:27:54.080135 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a0ef1cfe-464e-4226-b4d7-845b894bc044 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:27:54.080670 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a0ef1cfe-464e-4226-b4d7-845b894bc044 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:27:54.081159 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a0ef1cfe-464e-4226-b4d7-845b894bc044 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:27:54.219597 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-a0ef1cfe-464e-4226-b4d7-845b894bc044 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12dda477f454a20aff297708f052dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0a5546dd7e4676b6e1ae44898972e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:27:54.227611 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-a0ef1cfe-464e-4226-b4d7-845b894bc044 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] 10.222.0.18 "GET /compute/v2.1/servers/c3396b38-a6a0-40a5-baf4-808452c614fb" status: 200 len: 1577 microversion: 2.1 time: 0.162850 Oct 22 22:27:54.228776 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3570/7111] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:27:54 2022] GET /compute/v2.1/servers/c3396b38-a6a0-40a5-baf4-808452c614fb => generated 1577 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:27:54.327359 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-84418e7d-75d5-4a33-ab0d-162df9b2d102 req-5aa04a0c-1254-4c4e-a530-abcffb77b43a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3396b38-a6a0-40a5-baf4-808452c614fb", "name": "network-vif-unplugged", "status": "completed", "tag": "8e491f5a-9404-4b77-9069-de459390231b"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 22:27:54.338364 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-84418e7d-75d5-4a33-ab0d-162df9b2d102 req-5aa04a0c-1254-4c4e-a530-abcffb77b43a service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:27:54.338846 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-84418e7d-75d5-4a33-ab0d-162df9b2d102 req-5aa04a0c-1254-4c4e-a530-abcffb77b43a service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:27:54.339744 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-84418e7d-75d5-4a33-ab0d-162df9b2d102 req-5aa04a0c-1254-4c4e-a530-abcffb77b43a service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:27:54.355819 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-84418e7d-75d5-4a33-ab0d-162df9b2d102 req-5aa04a0c-1254-4c4e-a530-abcffb77b43a service nova] Creating event network-vif-unplugged:8e491f5a-9404-4b77-9069-de459390231b for instance c3396b38-a6a0-40a5-baf4-808452c614fb on nch1-master-1 Oct 22 22:27:54.374378 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-84418e7d-75d5-4a33-ab0d-162df9b2d102 req-5aa04a0c-1254-4c4e-a530-abcffb77b43a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.050977 Oct 22 22:27:54.375404 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3542/7112] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 22:27:54 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 22:27:55.252015 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-80649694-2bc6-4031-b990-d2e1b9059674 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:27:55.253237 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-80649694-2bc6-4031-b990-d2e1b9059674 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] [instance: c3396b38-a6a0-40a5-baf4-808452c614fb] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:27:55.260530 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-80649694-2bc6-4031-b990-d2e1b9059674 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:27:55.261041 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-80649694-2bc6-4031-b990-d2e1b9059674 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:27:55.261536 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-80649694-2bc6-4031-b990-d2e1b9059674 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:27:55.262264 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-80649694-2bc6-4031-b990-d2e1b9059674 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:27:55.262737 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-80649694-2bc6-4031-b990-d2e1b9059674 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:27:55.263187 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-80649694-2bc6-4031-b990-d2e1b9059674 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:27:55.403702 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-80649694-2bc6-4031-b990-d2e1b9059674 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12dda477f454a20aff297708f052dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0a5546dd7e4676b6e1ae44898972e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:27:55.412664 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-80649694-2bc6-4031-b990-d2e1b9059674 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] 10.222.0.18 "GET /compute/v2.1/servers/c3396b38-a6a0-40a5-baf4-808452c614fb" status: 200 len: 1577 microversion: 2.1 time: 0.164728 Oct 22 22:27:55.413231 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3571/7113] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:27:55 2022] GET /compute/v2.1/servers/c3396b38-a6a0-40a5-baf4-808452c614fb => generated 1577 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:27:56.422846 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-20bfee78-2807-42bb-909f-e15b4314c1b3 req-a2b9f040-766e-4d62-b9ca-3d4b826191a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3396b38-a6a0-40a5-baf4-808452c614fb", "tag": "8e491f5a-9404-4b77-9069-de459390231b"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 22:27:56.433654 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-20bfee78-2807-42bb-909f-e15b4314c1b3 req-a2b9f040-766e-4d62-b9ca-3d4b826191a0 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:27:56.434221 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-20bfee78-2807-42bb-909f-e15b4314c1b3 req-a2b9f040-766e-4d62-b9ca-3d4b826191a0 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:27:56.434720 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-20bfee78-2807-42bb-909f-e15b4314c1b3 req-a2b9f040-766e-4d62-b9ca-3d4b826191a0 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:27:56.435913 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-5289cede-e16d-4f83-8af4-3cc30c247688 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:27:56.436537 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-5289cede-e16d-4f83-8af4-3cc30c247688 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] [instance: c3396b38-a6a0-40a5-baf4-808452c614fb] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:27:56.443590 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5289cede-e16d-4f83-8af4-3cc30c247688 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:27:56.444073 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5289cede-e16d-4f83-8af4-3cc30c247688 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:27:56.444532 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5289cede-e16d-4f83-8af4-3cc30c247688 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:27:56.445249 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5289cede-e16d-4f83-8af4-3cc30c247688 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:27:56.445716 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5289cede-e16d-4f83-8af4-3cc30c247688 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:27:56.446162 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-5289cede-e16d-4f83-8af4-3cc30c247688 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:27:56.446693 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-20bfee78-2807-42bb-909f-e15b4314c1b3 req-a2b9f040-766e-4d62-b9ca-3d4b826191a0 service nova] Creating event network-changed:8e491f5a-9404-4b77-9069-de459390231b for instance c3396b38-a6a0-40a5-baf4-808452c614fb on nch1-master-1 Oct 22 22:27:56.451973 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-20bfee78-2807-42bb-909f-e15b4314c1b3 req-a2b9f040-766e-4d62-b9ca-3d4b826191a0 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037256 Oct 22 22:27:56.452583 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3543/7114] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 22:27:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 22:27:56.581347 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-5289cede-e16d-4f83-8af4-3cc30c247688 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12dda477f454a20aff297708f052dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0a5546dd7e4676b6e1ae44898972e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:27:56.590263 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-5289cede-e16d-4f83-8af4-3cc30c247688 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] 10.222.0.18 "GET /compute/v2.1/servers/c3396b38-a6a0-40a5-baf4-808452c614fb" status: 200 len: 1577 microversion: 2.1 time: 0.158245 Oct 22 22:27:56.590824 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3572/7115] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:27:56 2022] GET /compute/v2.1/servers/c3396b38-a6a0-40a5-baf4-808452c614fb => generated 1577 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:27:57.620341 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-3883f721-8718-4de2-b8b7-d1409820dbb0 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:27:57.621505 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-3883f721-8718-4de2-b8b7-d1409820dbb0 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] [instance: c3396b38-a6a0-40a5-baf4-808452c614fb] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:27:57.629416 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3883f721-8718-4de2-b8b7-d1409820dbb0 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:27:57.629903 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3883f721-8718-4de2-b8b7-d1409820dbb0 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:27:57.630344 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3883f721-8718-4de2-b8b7-d1409820dbb0 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:27:57.631021 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3883f721-8718-4de2-b8b7-d1409820dbb0 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:27:57.631529 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3883f721-8718-4de2-b8b7-d1409820dbb0 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:27:57.631946 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3883f721-8718-4de2-b8b7-d1409820dbb0 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:27:57.771585 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-3883f721-8718-4de2-b8b7-d1409820dbb0 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12dda477f454a20aff297708f052dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0a5546dd7e4676b6e1ae44898972e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:27:57.784399 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-3883f721-8718-4de2-b8b7-d1409820dbb0 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] 10.222.0.18 "GET /compute/v2.1/servers/c3396b38-a6a0-40a5-baf4-808452c614fb" status: 200 len: 1577 microversion: 2.1 time: 0.172566 Oct 22 22:27:57.785254 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3544/7116] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:27:57 2022] GET /compute/v2.1/servers/c3396b38-a6a0-40a5-baf4-808452c614fb => generated 1577 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:27:58.813118 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-e4c04646-39bd-4d30-b562-2ab21a4b5dff tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:27:58.813774 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-e4c04646-39bd-4d30-b562-2ab21a4b5dff tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] [instance: c3396b38-a6a0-40a5-baf4-808452c614fb] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:27:58.820978 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e4c04646-39bd-4d30-b562-2ab21a4b5dff tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:27:58.821475 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e4c04646-39bd-4d30-b562-2ab21a4b5dff tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:27:58.821925 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e4c04646-39bd-4d30-b562-2ab21a4b5dff tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:27:58.822634 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e4c04646-39bd-4d30-b562-2ab21a4b5dff tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:27:58.823105 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e4c04646-39bd-4d30-b562-2ab21a4b5dff tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:27:58.823579 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e4c04646-39bd-4d30-b562-2ab21a4b5dff tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:27:58.965174 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-e4c04646-39bd-4d30-b562-2ab21a4b5dff tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12dda477f454a20aff297708f052dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0a5546dd7e4676b6e1ae44898972e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:27:58.973500 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-e4c04646-39bd-4d30-b562-2ab21a4b5dff tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] 10.222.0.18 "GET /compute/v2.1/servers/c3396b38-a6a0-40a5-baf4-808452c614fb" status: 200 len: 1577 microversion: 2.1 time: 0.164992 Oct 22 22:27:58.974080 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3573/7117] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:27:58 2022] GET /compute/v2.1/servers/c3396b38-a6a0-40a5-baf4-808452c614fb => generated 1577 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:27:59.997355 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-f930b495-3cb7-428e-a1fa-0abfde7b9e4a tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:27:59.997967 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-f930b495-3cb7-428e-a1fa-0abfde7b9e4a tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] [instance: c3396b38-a6a0-40a5-baf4-808452c614fb] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:28:00.005422 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f930b495-3cb7-428e-a1fa-0abfde7b9e4a tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:28:00.005918 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f930b495-3cb7-428e-a1fa-0abfde7b9e4a tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:28:00.006388 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f930b495-3cb7-428e-a1fa-0abfde7b9e4a tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:28:00.007091 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f930b495-3cb7-428e-a1fa-0abfde7b9e4a tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:28:00.007584 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f930b495-3cb7-428e-a1fa-0abfde7b9e4a tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:28:00.008202 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f930b495-3cb7-428e-a1fa-0abfde7b9e4a tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:28:00.141661 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-f930b495-3cb7-428e-a1fa-0abfde7b9e4a tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12dda477f454a20aff297708f052dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0a5546dd7e4676b6e1ae44898972e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:28:00.149859 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-f930b495-3cb7-428e-a1fa-0abfde7b9e4a tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] 10.222.0.18 "GET /compute/v2.1/servers/c3396b38-a6a0-40a5-baf4-808452c614fb" status: 200 len: 1577 microversion: 2.1 time: 0.156669 Oct 22 22:28:00.150437 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3545/7118] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:27:59 2022] GET /compute/v2.1/servers/c3396b38-a6a0-40a5-baf4-808452c614fb => generated 1577 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:28:01.254645 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-e4e6ecbd-6b21-41aa-97d1-a817a1a50305 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:28:01.255249 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-e4e6ecbd-6b21-41aa-97d1-a817a1a50305 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] [instance: c3396b38-a6a0-40a5-baf4-808452c614fb] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:28:01.263105 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e4e6ecbd-6b21-41aa-97d1-a817a1a50305 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:28:01.263645 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e4e6ecbd-6b21-41aa-97d1-a817a1a50305 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:28:01.264110 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e4e6ecbd-6b21-41aa-97d1-a817a1a50305 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:28:01.264839 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e4e6ecbd-6b21-41aa-97d1-a817a1a50305 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:28:01.265317 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e4e6ecbd-6b21-41aa-97d1-a817a1a50305 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:28:01.265738 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e4e6ecbd-6b21-41aa-97d1-a817a1a50305 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:28:01.404785 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-e4e6ecbd-6b21-41aa-97d1-a817a1a50305 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12dda477f454a20aff297708f052dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0a5546dd7e4676b6e1ae44898972e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:28:01.417003 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-e4e6ecbd-6b21-41aa-97d1-a817a1a50305 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] 10.222.0.18 "GET /compute/v2.1/servers/c3396b38-a6a0-40a5-baf4-808452c614fb" status: 200 len: 1577 microversion: 2.1 time: 0.166638 Oct 22 22:28:01.417791 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3574/7119] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:28:01 2022] GET /compute/v2.1/servers/c3396b38-a6a0-40a5-baf4-808452c614fb => generated 1577 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:28:02.002419 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-f4133eae-c324-4b55-8d3e-cba9e485bfff req-57bf8777-ec8d-4c02-ba0c-2341eee16357 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3396b38-a6a0-40a5-baf4-808452c614fb", "name": "network-vif-plugged", "status": "completed", "tag": "8e491f5a-9404-4b77-9069-de459390231b"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 22:28:02.014114 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-f4133eae-c324-4b55-8d3e-cba9e485bfff req-57bf8777-ec8d-4c02-ba0c-2341eee16357 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:28:02.014601 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-f4133eae-c324-4b55-8d3e-cba9e485bfff req-57bf8777-ec8d-4c02-ba0c-2341eee16357 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:28:02.015047 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-f4133eae-c324-4b55-8d3e-cba9e485bfff req-57bf8777-ec8d-4c02-ba0c-2341eee16357 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:28:02.027721 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-f4133eae-c324-4b55-8d3e-cba9e485bfff req-57bf8777-ec8d-4c02-ba0c-2341eee16357 service nova] Creating event network-vif-plugged:8e491f5a-9404-4b77-9069-de459390231b for instance c3396b38-a6a0-40a5-baf4-808452c614fb on nch1-master-1 Oct 22 22:28:02.033036 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-f4133eae-c324-4b55-8d3e-cba9e485bfff req-57bf8777-ec8d-4c02-ba0c-2341eee16357 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034454 Oct 22 22:28:02.033552 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3546/7120] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 22:28:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 22:28:02.447122 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-c8c4f5b7-b321-4daa-bd0f-9cf16d09531d tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:28:02.448199 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-c8c4f5b7-b321-4daa-bd0f-9cf16d09531d tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] [instance: c3396b38-a6a0-40a5-baf4-808452c614fb] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:28:02.460355 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c8c4f5b7-b321-4daa-bd0f-9cf16d09531d tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:28:02.461195 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c8c4f5b7-b321-4daa-bd0f-9cf16d09531d tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:28:02.461962 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c8c4f5b7-b321-4daa-bd0f-9cf16d09531d tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:28:02.463159 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c8c4f5b7-b321-4daa-bd0f-9cf16d09531d tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:28:02.464393 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c8c4f5b7-b321-4daa-bd0f-9cf16d09531d tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:28:02.465147 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c8c4f5b7-b321-4daa-bd0f-9cf16d09531d tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:28:02.616889 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-c8c4f5b7-b321-4daa-bd0f-9cf16d09531d tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12dda477f454a20aff297708f052dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0a5546dd7e4676b6e1ae44898972e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:28:02.625161 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-c8c4f5b7-b321-4daa-bd0f-9cf16d09531d tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] 10.222.0.18 "GET /compute/v2.1/servers/c3396b38-a6a0-40a5-baf4-808452c614fb" status: 200 len: 1577 microversion: 2.1 time: 0.184620 Oct 22 22:28:02.625757 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3575/7121] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:28:02 2022] GET /compute/v2.1/servers/c3396b38-a6a0-40a5-baf4-808452c614fb => generated 1577 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:28:03.651232 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-066c31d6-0af3-4423-8da7-22d1bd9b4d25 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:28:03.652007 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-066c31d6-0af3-4423-8da7-22d1bd9b4d25 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] [instance: c3396b38-a6a0-40a5-baf4-808452c614fb] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:28:03.659004 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-066c31d6-0af3-4423-8da7-22d1bd9b4d25 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:28:03.659669 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-066c31d6-0af3-4423-8da7-22d1bd9b4d25 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:28:03.660151 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-066c31d6-0af3-4423-8da7-22d1bd9b4d25 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:28:03.660861 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-066c31d6-0af3-4423-8da7-22d1bd9b4d25 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:28:03.661320 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-066c31d6-0af3-4423-8da7-22d1bd9b4d25 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:28:03.661754 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-066c31d6-0af3-4423-8da7-22d1bd9b4d25 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:28:03.806009 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-066c31d6-0af3-4423-8da7-22d1bd9b4d25 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12dda477f454a20aff297708f052dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0a5546dd7e4676b6e1ae44898972e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:28:03.818339 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-066c31d6-0af3-4423-8da7-22d1bd9b4d25 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] 10.222.0.18 "GET /compute/v2.1/servers/c3396b38-a6a0-40a5-baf4-808452c614fb" status: 200 len: 1564 microversion: 2.1 time: 0.172041 Oct 22 22:28:03.819212 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3547/7122] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:28:03 2022] GET /compute/v2.1/servers/c3396b38-a6a0-40a5-baf4-808452c614fb => generated 1564 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:29:26.351847 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_api:SELECT=28 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:29:26.353322 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:29:26.358441 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-1765330c-542c-4009-9b62-31781d627e47 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:29:26.358855 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-2791d6b8-bdb2-46e2-aad2-0b90af1fab41 req-bcaed252-c8fa-4a66-945f-562b93c16671 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3396b38-a6a0-40a5-baf4-808452c614fb", "tag": "8e491f5a-9404-4b77-9069-de459390231b"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 22:29:26.359579 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-1765330c-542c-4009-9b62-31781d627e47 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] [instance: c3396b38-a6a0-40a5-baf4-808452c614fb] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:29:26.366646 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1765330c-542c-4009-9b62-31781d627e47 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:29:26.367395 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1765330c-542c-4009-9b62-31781d627e47 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:29:26.367880 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1765330c-542c-4009-9b62-31781d627e47 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:29:26.368654 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1765330c-542c-4009-9b62-31781d627e47 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:29:26.369273 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1765330c-542c-4009-9b62-31781d627e47 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:29:26.369389 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:29:26.369719 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1765330c-542c-4009-9b62-31781d627e47 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:29:26.370152 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:29:26.373421 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-2791d6b8-bdb2-46e2-aad2-0b90af1fab41 req-bcaed252-c8fa-4a66-945f-562b93c16671 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:29:26.374440 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-2791d6b8-bdb2-46e2-aad2-0b90af1fab41 req-bcaed252-c8fa-4a66-945f-562b93c16671 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:29:26.375309 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-2791d6b8-bdb2-46e2-aad2-0b90af1fab41 req-bcaed252-c8fa-4a66-945f-562b93c16671 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:29:26.393907 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-2791d6b8-bdb2-46e2-aad2-0b90af1fab41 req-bcaed252-c8fa-4a66-945f-562b93c16671 service nova] Creating event network-changed:8e491f5a-9404-4b77-9069-de459390231b for instance c3396b38-a6a0-40a5-baf4-808452c614fb on nch1-master-1 Oct 22 22:29:26.399193 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-1765330c-542c-4009-9b62-31781d627e47 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] [instance: c3396b38-a6a0-40a5-baf4-808452c614fb] Going to try to terminate instance {{(pid=138745) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 22:29:26.400780 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-2791d6b8-bdb2-46e2-aad2-0b90af1fab41 req-bcaed252-c8fa-4a66-945f-562b93c16671 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047865 Oct 22 22:29:26.401735 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3548/7123] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 22:29:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 22:29:26.492168 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-1765330c-542c-4009-9b62-31781d627e47 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] 10.222.0.18 "DELETE /compute/v2.1/servers/c3396b38-a6a0-40a5-baf4-808452c614fb" status: 204 len: 0 microversion: 2.1 time: 0.141845 Oct 22 22:29:26.492796 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3576/7124] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 22:29:26 2022] DELETE /compute/v2.1/servers/c3396b38-a6a0-40a5-baf4-808452c614fb => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 22:29:26.502399 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-ea0eae21-bfe7-46d7-98b6-021efba7c3dd tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:29:26.503115 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-ea0eae21-bfe7-46d7-98b6-021efba7c3dd tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] [instance: c3396b38-a6a0-40a5-baf4-808452c614fb] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:29:26.509801 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ea0eae21-bfe7-46d7-98b6-021efba7c3dd tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:29:26.510803 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ea0eae21-bfe7-46d7-98b6-021efba7c3dd tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:29:26.510803 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ea0eae21-bfe7-46d7-98b6-021efba7c3dd tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:29:26.511690 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ea0eae21-bfe7-46d7-98b6-021efba7c3dd tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:29:26.511947 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ea0eae21-bfe7-46d7-98b6-021efba7c3dd tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:29:26.512491 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-ea0eae21-bfe7-46d7-98b6-021efba7c3dd tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:29:26.674491 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-ea0eae21-bfe7-46d7-98b6-021efba7c3dd tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12dda477f454a20aff297708f052dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0a5546dd7e4676b6e1ae44898972e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:29:26.684239 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-ea0eae21-bfe7-46d7-98b6-021efba7c3dd tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] 10.222.0.18 "GET /compute/v2.1/servers/c3396b38-a6a0-40a5-baf4-808452c614fb" status: 200 len: 1570 microversion: 2.1 time: 0.186655 Oct 22 22:29:26.685231 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3549/7125] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:29:26 2022] GET /compute/v2.1/servers/c3396b38-a6a0-40a5-baf4-808452c614fb => generated 1570 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 22:29:27.708649 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-a133bc93-d1f5-4315-b47d-394db3595135 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:29:27.709413 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-a133bc93-d1f5-4315-b47d-394db3595135 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] [instance: c3396b38-a6a0-40a5-baf4-808452c614fb] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:29:27.717376 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a133bc93-d1f5-4315-b47d-394db3595135 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:29:27.717908 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a133bc93-d1f5-4315-b47d-394db3595135 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:29:27.718369 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a133bc93-d1f5-4315-b47d-394db3595135 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:29:27.719137 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a133bc93-d1f5-4315-b47d-394db3595135 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:29:27.719625 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a133bc93-d1f5-4315-b47d-394db3595135 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:29:27.720064 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-a133bc93-d1f5-4315-b47d-394db3595135 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:29:27.858651 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-a133bc93-d1f5-4315-b47d-394db3595135 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12dda477f454a20aff297708f052dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0a5546dd7e4676b6e1ae44898972e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:29:27.867008 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-a133bc93-d1f5-4315-b47d-394db3595135 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] 10.222.0.18 "GET /compute/v2.1/servers/c3396b38-a6a0-40a5-baf4-808452c614fb" status: 200 len: 1570 microversion: 2.1 time: 0.162771 Oct 22 22:29:27.867637 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3577/7126] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:29:27 2022] GET /compute/v2.1/servers/c3396b38-a6a0-40a5-baf4-808452c614fb => generated 1570 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:29:28.628722 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-72431d66-fcfb-4795-be20-257ede7429f6 req-092db42e-52eb-4850-8510-f744f543bbd4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3396b38-a6a0-40a5-baf4-808452c614fb", "name": "network-vif-deleted", "tag": "8e491f5a-9404-4b77-9069-de459390231b"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 22:29:28.649439 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-72431d66-fcfb-4795-be20-257ede7429f6 req-092db42e-52eb-4850-8510-f744f543bbd4 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:29:28.650077 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-72431d66-fcfb-4795-be20-257ede7429f6 req-092db42e-52eb-4850-8510-f744f543bbd4 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:29:28.650574 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-72431d66-fcfb-4795-be20-257ede7429f6 req-092db42e-52eb-4850-8510-f744f543bbd4 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:29:28.668708 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-72431d66-fcfb-4795-be20-257ede7429f6 req-092db42e-52eb-4850-8510-f744f543bbd4 service nova] Creating event network-vif-deleted:8e491f5a-9404-4b77-9069-de459390231b for instance c3396b38-a6a0-40a5-baf4-808452c614fb on nch1-master-1 Oct 22 22:29:28.674668 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-72431d66-fcfb-4795-be20-257ede7429f6 req-092db42e-52eb-4850-8510-f744f543bbd4 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050601 Oct 22 22:29:28.675287 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3550/7127] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 22:29:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 22:29:28.892948 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-1e0793fc-7289-4838-b742-9521ea138582 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:29:28.893573 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-1e0793fc-7289-4838-b742-9521ea138582 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] [instance: c3396b38-a6a0-40a5-baf4-808452c614fb] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:29:28.900389 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1e0793fc-7289-4838-b742-9521ea138582 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:29:28.900899 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1e0793fc-7289-4838-b742-9521ea138582 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:29:28.901348 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1e0793fc-7289-4838-b742-9521ea138582 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:29:28.902291 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1e0793fc-7289-4838-b742-9521ea138582 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:29:28.902757 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1e0793fc-7289-4838-b742-9521ea138582 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:29:28.903201 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1e0793fc-7289-4838-b742-9521ea138582 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:29:28.957775 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1e0793fc-7289-4838-b742-9521ea138582 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:29:28.958683 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1e0793fc-7289-4838-b742-9521ea138582 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:29:28.960571 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-1e0793fc-7289-4838-b742-9521ea138582 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:29:28.961148 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.objects.instance [None req-1e0793fc-7289-4838-b742-9521ea138582 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lazy-loading 'fault' on Instance uuid c3396b38-a6a0-40a5-baf4-808452c614fb {{(pid=138745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 22:29:29.015803 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-1e0793fc-7289-4838-b742-9521ea138582 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12dda477f454a20aff297708f052dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0a5546dd7e4676b6e1ae44898972e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:29:29.025514 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-1e0793fc-7289-4838-b742-9521ea138582 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] 10.222.0.18 "GET /compute/v2.1/servers/c3396b38-a6a0-40a5-baf4-808452c614fb" status: 200 len: 1224 microversion: 2.1 time: 0.138563 Oct 22 22:29:29.026121 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3578/7128] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:29:28 2022] GET /compute/v2.1/servers/c3396b38-a6a0-40a5-baf4-808452c614fb => generated 1224 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:29:30.051386 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-11d9f70f-8905-4f19-b06f-e051237a6d17 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:29:30.052491 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-11d9f70f-8905-4f19-b06f-e051237a6d17 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] [instance: c3396b38-a6a0-40a5-baf4-808452c614fb] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:29:30.060167 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-11d9f70f-8905-4f19-b06f-e051237a6d17 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:29:30.060677 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-11d9f70f-8905-4f19-b06f-e051237a6d17 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:29:30.061115 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-11d9f70f-8905-4f19-b06f-e051237a6d17 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:29:30.061805 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-11d9f70f-8905-4f19-b06f-e051237a6d17 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:29:30.062264 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-11d9f70f-8905-4f19-b06f-e051237a6d17 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:29:30.062727 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-11d9f70f-8905-4f19-b06f-e051237a6d17 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:29:30.076787 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-11d9f70f-8905-4f19-b06f-e051237a6d17 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] HTTP exception thrown: Instance c3396b38-a6a0-40a5-baf4-808452c614fb could not be found. Oct 22 22:29:30.078416 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-11d9f70f-8905-4f19-b06f-e051237a6d17 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Request method failure captured: Oct 22 22:29:30.078416 ncdv-master-1 devstack@n-api.service[138744]: request: GET /compute/v2.1/servers/c3396b38-a6a0-40a5-baf4-808452c614fb HTTP/1.1 Oct 22 22:29:30.078416 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 22:29:30.078416 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 22:29:30.078416 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 22:29:30.078416 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 0 Oct 22 22:29:30.078416 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 22:29:30.078416 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 22:29:30.078416 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 22:29:30.078416 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 22:29:30.078416 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVGx8WGme9oVuTg6FWPrXvzhRbk4I-D9C4t_bR7zXOchbIjKhfFd0_SBG0F5_WxHRq2hjmiGp2mhiuKCxu8yaxIcoPtMDX5EH71kXbkERJBWoNoQbzABgtu4vbuHurl-0fw8bxDk9aLkjXNhO0sf7b-fDDyUKj6cWuDAQd28_fHg88cQ Oct 22 22:29:30.078416 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 22:29:30.078416 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 22:29:30.078416 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 22:29:30.078416 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 22:29:30.078416 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 22:29:30.078416 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 22:29:30.078416 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: 4d0a5546dd7e4676b6e1ae44898972e9 Oct 22 22:29:30.078416 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-TestShelveInstance-1901158978 Oct 22 22:29:30.078416 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 22:29:30.078416 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 22:29:30.078416 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_4d0a5546dd7e4676b6e1ae44898972e9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4d0a5546dd7e4676b6e1ae44898972e9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/4d0a5546dd7e4676b6e1ae44898972e9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4d0a5546dd7e4676b6e1ae44898972e9"}]}] Oct 22 22:29:30.078416 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-TestShelveInstance-1901158978 Oct 22 22:29:30.078416 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: 4d0a5546dd7e4676b6e1ae44898972e9 Oct 22 22:29:30.078416 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-TestShelveInstance-1901158978 Oct 22 22:29:30.078416 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-TestShelveInstance-1901158978-project Oct 22 22:29:30.078416 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 22:29:30.078416 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 22:29:30.078416 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: d12dda477f454a20aff297708f052dd9 Oct 22 22:29:30.078416 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-TestShelveInstance-1901158978-project Oct 22 22:29:30.078416 ncdv-master-1 devstack@n-api.service[138744]: method: > Oct 22 22:29:30.078416 ncdv-master-1 devstack@n-api.service[138744]: exception: Instance c3396b38-a6a0-40a5-baf4-808452c614fb could not be found. Oct 22 22:29:30.078416 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': 'c3396b38-a6a0-40a5-baf4-808452c614fb'} Oct 22 22:29:30.078416 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 22:29:30.078416 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 22:29:30.078416 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 22:29:30.078416 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 22:29:30.078416 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 22:29:30.078416 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 22:29:30.078416 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 22:29:30.078416 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 22:29:30.078416 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 22:29:30.078416 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 22:29:30.078416 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c3396b38-a6a0-40a5-baf4-808452c614fb could not be found. Oct 22 22:29:30.078416 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 22:29:30.078416 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 22:29:30.078416 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 22:29:30.078416 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 22:29:30.078416 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 22:29:30.078416 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 22:29:30.078416 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 22:29:30.078416 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 22:29:30.078416 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 22:29:30.078416 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 22:29:30.078416 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 22:29:30.078416 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 22:29:30.078416 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 22:29:30.078416 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 22:29:30.078416 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 22:29:30.078416 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 22:29:30.078416 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c3396b38-a6a0-40a5-baf4-808452c614fb could not be found. Oct 22 22:29:30.078416 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 22:29:30.078416 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 22:29:30.078416 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 22:29:30.082245 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 22:29:30.082245 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 22:29:30.082245 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 22:29:30.082245 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 22:29:30.082245 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 22:29:30.082245 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c3396b38-a6a0-40a5-baf4-808452c614fb could not be found. Oct 22 22:29:30.082245 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 22:29:30.082245 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-11d9f70f-8905-4f19-b06f-e051237a6d17 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Returning 404 to user: Instance c3396b38-a6a0-40a5-baf4-808452c614fb could not be found. {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 22:29:30.082245 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-11d9f70f-8905-4f19-b06f-e051237a6d17 tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] 10.222.0.18 "GET /compute/v2.1/servers/c3396b38-a6a0-40a5-baf4-808452c614fb" status: 404 len: 111 microversion: 2.1 time: 0.032972 Oct 22 22:29:30.082245 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3551/7129] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:29:30 2022] GET /compute/v2.1/servers/c3396b38-a6a0-40a5-baf4-808452c614fb => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 22:29:30.254540 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-c07d6012-449e-4854-89ea-7ad14d14cd2f tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] Calling method '.version_select at 0x7fd3a45113a0>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:29:30.294844 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-c07d6012-449e-4854-89ea-7ad14d14cd2f tempest-TestShelveInstance-1901158978 tempest-TestShelveInstance-1901158978-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-675202201" status: 202 len: 0 microversion: 2.1 time: 0.044391 Oct 22 22:29:30.296220 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3579/7130] 10.222.0.18 () {58 vars in 1251 bytes} [Sat Oct 22 22:29:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-675202201 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 22 22:29:48.049291 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_api:SELECT=8 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:29:48.050461 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:SELECT=12 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:29:48.271198 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-2b540c0b-21b3-4769-b054-eb3814a5e689 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Action: 'create', calling method: .version_select at 0x7fd3a89ed550>, body: {"keypair": {"name": "tempest-TestSnapshotPattern-321450768", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH/8I0vsXG8WNj0dT1hLAG3QqV4oI30y/a63g9Wsc6XTrYXVUs8O2ioEeOoW0NY5JNFZrTFklpTOI6kKmIVtOIzOG3tLEjGeVRhlFUNrQyXncO/jfzbpBJwA5xnZopiTsg=="}} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 22:29:48.289427 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-2b540c0b-21b3-4769-b054-eb3814a5e689 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Getting quotas for project 2f440a34638f4bf1ab18f1c819aa48d6. Resources: {'key_pairs'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 22:29:48.296013 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.quota [None req-2b540c0b-21b3-4769-b054-eb3814a5e689 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Getting quotas for user 60243645bd55419d885180da80e843b5 and project 2f440a34638f4bf1ab18f1c819aa48d6. Resources: {'key_pairs'} {{(pid=138744) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 22:29:48.334885 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-2b540c0b-21b3-4769-b054-eb3814a5e689 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.290827 Oct 22 22:29:48.339509 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3552/7131] 10.222.0.18 () {60 vars in 1159 bytes} [Sat Oct 22 22:29:48 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 22:29:49.437866 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-cb11c3f1-89a9-4ee8-b4fa-3184ec0b0c1b tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-159018686", "imageRef": "085e4478-6edc-4a69-8e08-f9831713eb65", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-321450768", "security_groups": [{"name": "tempest-secgroup-smoke-91977071"}], "networks": [{"uuid": "85f563af-3a28-40f1-a891-d4a70ec12b6a"}]}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 22:29:49.447862 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:29:49.448506 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:29:49.550682 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.network.neutron [None req-cb11c3f1-89a9-4ee8-b4fa-3184ec0b0c1b tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] validate_networks() for [('85f563af-3a28-40f1-a891-d4a70ec12b6a', None, None, None, None, None)] {{(pid=138745) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 22:29:50.064135 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-cb11c3f1-89a9-4ee8-b4fa-3184ec0b0c1b tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Flavor limits 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 22:29:50.064584 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-cb11c3f1-89a9-4ee8-b4fa-3184ec0b0c1b tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Image limits 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 22:29:50.065075 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-cb11c3f1-89a9-4ee8-b4fa-3184ec0b0c1b tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Flavor pref 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 22:29:50.065502 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-cb11c3f1-89a9-4ee8-b4fa-3184ec0b0c1b tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Image pref 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 22:29:50.065934 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-cb11c3f1-89a9-4ee8-b4fa-3184ec0b0c1b tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 22:29:50.076512 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cb11c3f1-89a9-4ee8-b4fa-3184ec0b0c1b tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:29:50.077110 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cb11c3f1-89a9-4ee8-b4fa-3184ec0b0c1b tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:29:50.077644 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cb11c3f1-89a9-4ee8-b4fa-3184ec0b0c1b tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:29:50.078519 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cb11c3f1-89a9-4ee8-b4fa-3184ec0b0c1b tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:29:50.079400 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cb11c3f1-89a9-4ee8-b4fa-3184ec0b0c1b tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:29:50.079950 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-cb11c3f1-89a9-4ee8-b4fa-3184ec0b0c1b tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:29:50.098382 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-cb11c3f1-89a9-4ee8-b4fa-3184ec0b0c1b tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Getting quotas for project 2f440a34638f4bf1ab18f1c819aa48d6. Resources: {'cores', 'instances', 'ram'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 22:29:50.103732 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-cb11c3f1-89a9-4ee8-b4fa-3184ec0b0c1b tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Getting quotas for user 60243645bd55419d885180da80e843b5 and project 2f440a34638f4bf1ab18f1c819aa48d6. Resources: {'cores', 'instances', 'ram'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 22:29:50.116794 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-cb11c3f1-89a9-4ee8-b4fa-3184ec0b0c1b tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Going to run 1 instances... {{(pid=138745) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 22:29:50.119194 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-cb11c3f1-89a9-4ee8-b4fa-3184ec0b0c1b tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] [instance: 97b04d30-8fd9-4214-917c-a77e062f0da8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='085e4478-6edc-4a69-8e08-f9831713eb65',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138745) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 22:29:50.173572 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-cb11c3f1-89a9-4ee8-b4fa-3184ec0b0c1b tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.739599 Oct 22 22:29:50.181105 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3580/7132] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Oct 22 22:29:49 2022] POST /compute/v2.1/servers => generated 404 bytes in 741 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 22:29:50.193479 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-a6cf489d-5ed3-4631-8069-3fd996f58137 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:29:50.195925 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-a6cf489d-5ed3-4631-8069-3fd996f58137 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] [instance: 97b04d30-8fd9-4214-917c-a77e062f0da8] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:29:50.262078 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-a6cf489d-5ed3-4631-8069-3fd996f58137 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60243645bd55419d885180da80e843b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f440a34638f4bf1ab18f1c819aa48d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:29:50.269460 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-a6cf489d-5ed3-4631-8069-3fd996f58137 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] 10.222.0.18 "GET /compute/v2.1/servers/97b04d30-8fd9-4214-917c-a77e062f0da8" status: 200 len: 1247 microversion: 2.1 time: 0.087295 Oct 22 22:29:50.270802 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3553/7133] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:29:50 2022] GET /compute/v2.1/servers/97b04d30-8fd9-4214-917c-a77e062f0da8 => generated 1247 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:29:51.295655 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-aa5e1ee4-58f3-4cd0-9405-b897a9ebf2af tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:29:51.296327 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-aa5e1ee4-58f3-4cd0-9405-b897a9ebf2af tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] [instance: 97b04d30-8fd9-4214-917c-a77e062f0da8] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:29:51.303405 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-aa5e1ee4-58f3-4cd0-9405-b897a9ebf2af tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:29:51.304205 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-aa5e1ee4-58f3-4cd0-9405-b897a9ebf2af tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:29:51.304634 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-aa5e1ee4-58f3-4cd0-9405-b897a9ebf2af tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:29:51.305385 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-aa5e1ee4-58f3-4cd0-9405-b897a9ebf2af tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:29:51.305898 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-aa5e1ee4-58f3-4cd0-9405-b897a9ebf2af tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:29:51.306416 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-aa5e1ee4-58f3-4cd0-9405-b897a9ebf2af tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:29:51.394923 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-aa5e1ee4-58f3-4cd0-9405-b897a9ebf2af tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60243645bd55419d885180da80e843b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f440a34638f4bf1ab18f1c819aa48d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:29:51.405889 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-aa5e1ee4-58f3-4cd0-9405-b897a9ebf2af tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] 10.222.0.18 "GET /compute/v2.1/servers/97b04d30-8fd9-4214-917c-a77e062f0da8" status: 200 len: 1307 microversion: 2.1 time: 0.116957 Oct 22 22:29:51.407583 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3581/7134] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:29:51 2022] GET /compute/v2.1/servers/97b04d30-8fd9-4214-917c-a77e062f0da8 => generated 1307 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:29:52.432242 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-0cc9ed0c-ba8d-49e0-ab2d-1d4824203b5c tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:29:52.433871 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-0cc9ed0c-ba8d-49e0-ab2d-1d4824203b5c tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] [instance: 97b04d30-8fd9-4214-917c-a77e062f0da8] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:29:52.444168 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0cc9ed0c-ba8d-49e0-ab2d-1d4824203b5c tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:29:52.444727 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0cc9ed0c-ba8d-49e0-ab2d-1d4824203b5c tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:29:52.445583 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0cc9ed0c-ba8d-49e0-ab2d-1d4824203b5c tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:29:52.446597 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0cc9ed0c-ba8d-49e0-ab2d-1d4824203b5c tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:29:52.447259 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0cc9ed0c-ba8d-49e0-ab2d-1d4824203b5c tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:29:52.447884 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0cc9ed0c-ba8d-49e0-ab2d-1d4824203b5c tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:29:52.612100 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-0cc9ed0c-ba8d-49e0-ab2d-1d4824203b5c tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60243645bd55419d885180da80e843b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f440a34638f4bf1ab18f1c819aa48d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:29:52.627934 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-0cc9ed0c-ba8d-49e0-ab2d-1d4824203b5c tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] 10.222.0.18 "GET /compute/v2.1/servers/97b04d30-8fd9-4214-917c-a77e062f0da8" status: 200 len: 1371 microversion: 2.1 time: 0.200145 Oct 22 22:29:52.629117 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3554/7135] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:29:52 2022] GET /compute/v2.1/servers/97b04d30-8fd9-4214-917c-a77e062f0da8 => generated 1371 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:29:52.938657 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-9253e1e0-ef78-46ea-a508-ac47aab807f3 req-2751bf24-30f8-4f58-b797-e3499e080f08 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97b04d30-8fd9-4214-917c-a77e062f0da8", "tag": "2f64bcad-e7af-4d3c-9554-92fda3f94ae9"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 22:29:52.953324 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-9253e1e0-ef78-46ea-a508-ac47aab807f3 req-2751bf24-30f8-4f58-b797-e3499e080f08 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:29:52.954150 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-9253e1e0-ef78-46ea-a508-ac47aab807f3 req-2751bf24-30f8-4f58-b797-e3499e080f08 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:29:52.954848 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-9253e1e0-ef78-46ea-a508-ac47aab807f3 req-2751bf24-30f8-4f58-b797-e3499e080f08 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:29:52.967373 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-9253e1e0-ef78-46ea-a508-ac47aab807f3 req-2751bf24-30f8-4f58-b797-e3499e080f08 service nova] Creating event network-changed:2f64bcad-e7af-4d3c-9554-92fda3f94ae9 for instance 97b04d30-8fd9-4214-917c-a77e062f0da8 on nch2-master-1 Oct 22 22:29:52.972544 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-9253e1e0-ef78-46ea-a508-ac47aab807f3 req-2751bf24-30f8-4f58-b797-e3499e080f08 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037813 Oct 22 22:29:52.973150 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3582/7136] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 22:29:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 22:29:53.654816 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-a46e2cf5-8d5f-48a3-be52-e74e467454d9 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:29:53.655465 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-a46e2cf5-8d5f-48a3-be52-e74e467454d9 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] [instance: 97b04d30-8fd9-4214-917c-a77e062f0da8] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:29:53.663461 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a46e2cf5-8d5f-48a3-be52-e74e467454d9 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:29:53.663964 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a46e2cf5-8d5f-48a3-be52-e74e467454d9 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:29:53.664407 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a46e2cf5-8d5f-48a3-be52-e74e467454d9 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:29:53.665124 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a46e2cf5-8d5f-48a3-be52-e74e467454d9 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:29:53.665611 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a46e2cf5-8d5f-48a3-be52-e74e467454d9 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:29:53.666044 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-a46e2cf5-8d5f-48a3-be52-e74e467454d9 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:29:53.804531 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-a46e2cf5-8d5f-48a3-be52-e74e467454d9 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60243645bd55419d885180da80e843b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f440a34638f4bf1ab18f1c819aa48d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:29:53.812733 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-a46e2cf5-8d5f-48a3-be52-e74e467454d9 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] 10.222.0.18 "GET /compute/v2.1/servers/97b04d30-8fd9-4214-917c-a77e062f0da8" status: 200 len: 1371 microversion: 2.1 time: 0.162180 Oct 22 22:29:53.813366 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3555/7137] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:29:53 2022] GET /compute/v2.1/servers/97b04d30-8fd9-4214-917c-a77e062f0da8 => generated 1371 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:29:54.837761 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-f3dc6b0d-f49e-4125-8034-a51dc590326e tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:29:54.839581 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-f3dc6b0d-f49e-4125-8034-a51dc590326e tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] [instance: 97b04d30-8fd9-4214-917c-a77e062f0da8] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:29:54.846422 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f3dc6b0d-f49e-4125-8034-a51dc590326e tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:29:54.847016 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f3dc6b0d-f49e-4125-8034-a51dc590326e tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:29:54.847616 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f3dc6b0d-f49e-4125-8034-a51dc590326e tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:29:54.848416 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f3dc6b0d-f49e-4125-8034-a51dc590326e tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:29:54.848957 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f3dc6b0d-f49e-4125-8034-a51dc590326e tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:29:54.849469 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-f3dc6b0d-f49e-4125-8034-a51dc590326e tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:29:54.998992 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-f3dc6b0d-f49e-4125-8034-a51dc590326e tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60243645bd55419d885180da80e843b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f440a34638f4bf1ab18f1c819aa48d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:29:55.008545 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-f3dc6b0d-f49e-4125-8034-a51dc590326e tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] 10.222.0.18 "GET /compute/v2.1/servers/97b04d30-8fd9-4214-917c-a77e062f0da8" status: 200 len: 1371 microversion: 2.1 time: 0.176060 Oct 22 22:29:55.009042 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3583/7138] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:29:54 2022] GET /compute/v2.1/servers/97b04d30-8fd9-4214-917c-a77e062f0da8 => generated 1371 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:29:56.031541 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-4e1a31fe-01d0-486e-b818-639d715a6657 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:29:56.032409 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-4e1a31fe-01d0-486e-b818-639d715a6657 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] [instance: 97b04d30-8fd9-4214-917c-a77e062f0da8] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:29:56.040503 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4e1a31fe-01d0-486e-b818-639d715a6657 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:29:56.040976 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4e1a31fe-01d0-486e-b818-639d715a6657 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:29:56.041463 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4e1a31fe-01d0-486e-b818-639d715a6657 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:29:56.042191 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4e1a31fe-01d0-486e-b818-639d715a6657 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:29:56.043148 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4e1a31fe-01d0-486e-b818-639d715a6657 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:29:56.043635 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4e1a31fe-01d0-486e-b818-639d715a6657 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:29:56.187875 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-4e1a31fe-01d0-486e-b818-639d715a6657 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60243645bd55419d885180da80e843b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f440a34638f4bf1ab18f1c819aa48d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:29:56.199702 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-4e1a31fe-01d0-486e-b818-639d715a6657 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] 10.222.0.18 "GET /compute/v2.1/servers/97b04d30-8fd9-4214-917c-a77e062f0da8" status: 200 len: 1371 microversion: 2.1 time: 0.172087 Oct 22 22:29:56.200493 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3556/7139] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:29:56 2022] GET /compute/v2.1/servers/97b04d30-8fd9-4214-917c-a77e062f0da8 => generated 1371 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:29:57.199663 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-78415b6d-08b4-49ce-96d2-c7a26019ef7f req-d3aa5a46-8073-4938-9512-8716b4348de5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97b04d30-8fd9-4214-917c-a77e062f0da8", "name": "network-vif-plugged", "status": "completed", "tag": "2f64bcad-e7af-4d3c-9554-92fda3f94ae9"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 22:29:57.212315 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-78415b6d-08b4-49ce-96d2-c7a26019ef7f req-d3aa5a46-8073-4938-9512-8716b4348de5 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:29:57.212817 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-78415b6d-08b4-49ce-96d2-c7a26019ef7f req-d3aa5a46-8073-4938-9512-8716b4348de5 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:29:57.213260 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-78415b6d-08b4-49ce-96d2-c7a26019ef7f req-d3aa5a46-8073-4938-9512-8716b4348de5 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:29:57.224006 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-0b9e43fd-5683-4303-bd8e-dc1a411590f2 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:29:57.224622 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-0b9e43fd-5683-4303-bd8e-dc1a411590f2 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] [instance: 97b04d30-8fd9-4214-917c-a77e062f0da8] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:29:57.232063 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0b9e43fd-5683-4303-bd8e-dc1a411590f2 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:29:57.232564 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0b9e43fd-5683-4303-bd8e-dc1a411590f2 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:29:57.233408 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0b9e43fd-5683-4303-bd8e-dc1a411590f2 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:29:57.234101 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0b9e43fd-5683-4303-bd8e-dc1a411590f2 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:29:57.234577 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0b9e43fd-5683-4303-bd8e-dc1a411590f2 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:29:57.234995 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-0b9e43fd-5683-4303-bd8e-dc1a411590f2 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:29:57.235967 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-78415b6d-08b4-49ce-96d2-c7a26019ef7f req-d3aa5a46-8073-4938-9512-8716b4348de5 service nova] Creating event network-vif-plugged:2f64bcad-e7af-4d3c-9554-92fda3f94ae9 for instance 97b04d30-8fd9-4214-917c-a77e062f0da8 on nch2-master-1 Oct 22 22:29:57.241414 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-78415b6d-08b4-49ce-96d2-c7a26019ef7f req-d3aa5a46-8073-4938-9512-8716b4348de5 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046551 Oct 22 22:29:57.242373 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3584/7140] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 22:29:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 22:29:57.379218 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-0b9e43fd-5683-4303-bd8e-dc1a411590f2 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60243645bd55419d885180da80e843b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f440a34638f4bf1ab18f1c819aa48d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:29:57.387532 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-0b9e43fd-5683-4303-bd8e-dc1a411590f2 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] 10.222.0.18 "GET /compute/v2.1/servers/97b04d30-8fd9-4214-917c-a77e062f0da8" status: 200 len: 1371 microversion: 2.1 time: 0.167715 Oct 22 22:29:57.388196 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3557/7141] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:29:57 2022] GET /compute/v2.1/servers/97b04d30-8fd9-4214-917c-a77e062f0da8 => generated 1371 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 22:29:58.417007 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-40ea61e4-5d89-41e1-ad6d-8c258868fb5a tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:29:58.419406 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-40ea61e4-5d89-41e1-ad6d-8c258868fb5a tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] [instance: 97b04d30-8fd9-4214-917c-a77e062f0da8] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:29:58.429708 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-40ea61e4-5d89-41e1-ad6d-8c258868fb5a tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:29:58.430225 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-40ea61e4-5d89-41e1-ad6d-8c258868fb5a tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:29:58.430841 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-40ea61e4-5d89-41e1-ad6d-8c258868fb5a tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:29:58.431840 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-40ea61e4-5d89-41e1-ad6d-8c258868fb5a tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:29:58.432328 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-40ea61e4-5d89-41e1-ad6d-8c258868fb5a tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:29:58.433040 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-40ea61e4-5d89-41e1-ad6d-8c258868fb5a tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:29:58.584079 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-40ea61e4-5d89-41e1-ad6d-8c258868fb5a tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60243645bd55419d885180da80e843b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f440a34638f4bf1ab18f1c819aa48d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:29:58.593436 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-40ea61e4-5d89-41e1-ad6d-8c258868fb5a tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] 10.222.0.18 "GET /compute/v2.1/servers/97b04d30-8fd9-4214-917c-a77e062f0da8" status: 200 len: 1371 microversion: 2.1 time: 0.184751 Oct 22 22:29:58.594034 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3585/7142] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:29:58 2022] GET /compute/v2.1/servers/97b04d30-8fd9-4214-917c-a77e062f0da8 => generated 1371 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:29:59.620478 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-c1ccb380-4227-4883-98fd-9a23935f5f26 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:29:59.621545 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-c1ccb380-4227-4883-98fd-9a23935f5f26 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] [instance: 97b04d30-8fd9-4214-917c-a77e062f0da8] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:29:59.631208 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c1ccb380-4227-4883-98fd-9a23935f5f26 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:29:59.631745 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c1ccb380-4227-4883-98fd-9a23935f5f26 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:29:59.632193 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c1ccb380-4227-4883-98fd-9a23935f5f26 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:29:59.632929 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c1ccb380-4227-4883-98fd-9a23935f5f26 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:29:59.633393 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c1ccb380-4227-4883-98fd-9a23935f5f26 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:29:59.633828 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-c1ccb380-4227-4883-98fd-9a23935f5f26 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:29:59.768941 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-c1ccb380-4227-4883-98fd-9a23935f5f26 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60243645bd55419d885180da80e843b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f440a34638f4bf1ab18f1c819aa48d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:29:59.778904 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-c1ccb380-4227-4883-98fd-9a23935f5f26 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] 10.222.0.18 "GET /compute/v2.1/servers/97b04d30-8fd9-4214-917c-a77e062f0da8" status: 200 len: 1557 microversion: 2.1 time: 0.165170 Oct 22 22:29:59.779840 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3558/7143] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:29:59 2022] GET /compute/v2.1/servers/97b04d30-8fd9-4214-917c-a77e062f0da8 => generated 1557 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:29:59.801490 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-801b448e-404c-43d3-b01f-a6d9ad29987f tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:29:59.802116 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-801b448e-404c-43d3-b01f-a6d9ad29987f tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] [instance: 97b04d30-8fd9-4214-917c-a77e062f0da8] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:29:59.809438 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-801b448e-404c-43d3-b01f-a6d9ad29987f tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:29:59.809946 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-801b448e-404c-43d3-b01f-a6d9ad29987f tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:29:59.810397 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-801b448e-404c-43d3-b01f-a6d9ad29987f tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:29:59.811220 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-801b448e-404c-43d3-b01f-a6d9ad29987f tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:29:59.811727 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-801b448e-404c-43d3-b01f-a6d9ad29987f tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:29:59.812171 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-801b448e-404c-43d3-b01f-a6d9ad29987f tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:29:59.954676 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-801b448e-404c-43d3-b01f-a6d9ad29987f tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60243645bd55419d885180da80e843b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f440a34638f4bf1ab18f1c819aa48d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:29:59.963472 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-801b448e-404c-43d3-b01f-a6d9ad29987f tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] 10.222.0.18 "GET /compute/v2.1/servers/97b04d30-8fd9-4214-917c-a77e062f0da8" status: 200 len: 1557 microversion: 2.1 time: 0.165884 Oct 22 22:29:59.964398 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3586/7144] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:29:59 2022] GET /compute/v2.1/servers/97b04d30-8fd9-4214-917c-a77e062f0da8 => generated 1557 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:30:01.959203 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-a70aa129-ec83-4a46-8e95-1421b0a01d57 req-76bb8ff7-c792-4317-9eb9-af182034c911 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97b04d30-8fd9-4214-917c-a77e062f0da8", "tag": "2f64bcad-e7af-4d3c-9554-92fda3f94ae9"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 22:30:01.964795 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell0:SELECT=6 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:30:01.972479 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-a70aa129-ec83-4a46-8e95-1421b0a01d57 req-76bb8ff7-c792-4317-9eb9-af182034c911 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:30:01.972961 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-a70aa129-ec83-4a46-8e95-1421b0a01d57 req-76bb8ff7-c792-4317-9eb9-af182034c911 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:30:01.973399 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-a70aa129-ec83-4a46-8e95-1421b0a01d57 req-76bb8ff7-c792-4317-9eb9-af182034c911 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:30:01.985294 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-a70aa129-ec83-4a46-8e95-1421b0a01d57 req-76bb8ff7-c792-4317-9eb9-af182034c911 service nova] Creating event network-changed:2f64bcad-e7af-4d3c-9554-92fda3f94ae9 for instance 97b04d30-8fd9-4214-917c-a77e062f0da8 on nch2-master-1 Oct 22 22:30:01.991074 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-a70aa129-ec83-4a46-8e95-1421b0a01d57 req-76bb8ff7-c792-4317-9eb9-af182034c911 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035488 Oct 22 22:30:01.991692 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3559/7145] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 22:30:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 22:31:59.281906 ncdv-master-1 devstack@n-api.service[138745]: ERROR oslo.messaging._drivers.impl_rabbit [-] [82d96799-6494-46cc-9c4c-c1ce995f6091] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 22 22:31:59.283144 ncdv-master-1 devstack@n-api.service[138745]: ERROR oslo.messaging._drivers.impl_rabbit [-] [dbe685c1-0e25-4156-906e-a0926e5c28f4] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 22 22:31:59.283627 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell0:SELECT=2 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:31:59.284511 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell0:SELECT=6 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:31:59.285333 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:31:59.286086 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell1:SELECT=30 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:31:59.287725 ncdv-master-1 devstack@n-api.service[138745]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 22 22:31:59.287900 ncdv-master-1 devstack@n-api.service[138745]: Sat Oct 22 22:31:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/97b04d30-8fd9-4214-917c-a77e062f0da8/action (ip 10.222.0.18) !!! Oct 22 22:31:59.293098 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-0528c8b8-a3c1-4e79-b472-d42b77f8d0c3 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-1719448762"}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 22:31:59.295722 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-0528c8b8-a3c1-4e79-b472-d42b77f8d0c3 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] [instance: 97b04d30-8fd9-4214-917c-a77e062f0da8] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:31:59.306767 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0528c8b8-a3c1-4e79-b472-d42b77f8d0c3 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:31:59.307268 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0528c8b8-a3c1-4e79-b472-d42b77f8d0c3 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:31:59.307740 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0528c8b8-a3c1-4e79-b472-d42b77f8d0c3 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:31:59.308458 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0528c8b8-a3c1-4e79-b472-d42b77f8d0c3 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:31:59.308930 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0528c8b8-a3c1-4e79-b472-d42b77f8d0c3 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:31:59.309376 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0528c8b8-a3c1-4e79-b472-d42b77f8d0c3 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:31:59.632529 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-0528c8b8-a3c1-4e79-b472-d42b77f8d0c3 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] 10.222.0.18 "POST /compute/v2.1/servers/97b04d30-8fd9-4214-917c-a77e062f0da8/action" status: 202 len: 0 microversion: 2.1 time: 0.352761 Oct 22 22:31:59.633197 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3587/7146] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 22:31:59 2022] POST /compute/v2.1/servers/97b04d30-8fd9-4214-917c-a77e062f0da8/action => generated 0 bytes in 354 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 22 22:32:05.764122 ncdv-master-1 devstack@n-api.service[138744]: ERROR oslo.messaging._drivers.impl_rabbit [-] [04d2594c-31df-45b7-a94b-e87da15c0f2c] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 22 22:32:05.766072 ncdv-master-1 devstack@n-api.service[138744]: ERROR oslo.messaging._drivers.impl_rabbit [-] [81790953-1e28-46a4-954d-7f89676de4fb] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 22 22:32:05.766350 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:32:05.767142 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:SELECT=32 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:32:05.768645 ncdv-master-1 devstack@n-api.service[138744]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 22 22:32:05.768645 ncdv-master-1 devstack@n-api.service[138744]: Sat Oct 22 22:32:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.18) !!! Oct 22 22:32:05.854580 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-9c67ba7a-33e4-4bf3-b47d-365f0a829163 req-7d1f5c24-9ce0-4a9f-b118-06a3389c4e61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97b04d30-8fd9-4214-917c-a77e062f0da8", "name": "network-vif-plugged", "status": "completed", "tag": "2f64bcad-e7af-4d3c-9554-92fda3f94ae9"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 22:32:05.866413 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-9c67ba7a-33e4-4bf3-b47d-365f0a829163 req-7d1f5c24-9ce0-4a9f-b118-06a3389c4e61 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:32:05.867133 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-9c67ba7a-33e4-4bf3-b47d-365f0a829163 req-7d1f5c24-9ce0-4a9f-b118-06a3389c4e61 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:32:05.867812 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-9c67ba7a-33e4-4bf3-b47d-365f0a829163 req-7d1f5c24-9ce0-4a9f-b118-06a3389c4e61 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:32:05.880398 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-9c67ba7a-33e4-4bf3-b47d-365f0a829163 req-7d1f5c24-9ce0-4a9f-b118-06a3389c4e61 service nova] Creating event network-vif-plugged:2f64bcad-e7af-4d3c-9554-92fda3f94ae9 for instance 97b04d30-8fd9-4214-917c-a77e062f0da8 on nch2-master-1 Oct 22 22:32:05.886344 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-9c67ba7a-33e4-4bf3-b47d-365f0a829163 req-7d1f5c24-9ce0-4a9f-b118-06a3389c4e61 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124050 Oct 22 22:32:05.887080 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3560/7147] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 22:32:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 22:32:13.251601 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_api:SELECT=2 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:32:13.252406 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:32:13.259149 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-43c2b77a-584f-457a-8afa-fcbe08040bf9 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-440933915", "imageRef": "1ef22e68-498f-4815-884c-12ed09083907", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-321450768", "security_groups": [{"name": "tempest-secgroup-smoke-91977071"}], "networks": [{"uuid": "85f563af-3a28-40f1-a891-d4a70ec12b6a"}]}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 22:32:13.283824 ncdv-master-1 devstack@n-api.service[138745]: INFO oslo.messaging._drivers.impl_rabbit [-] [82d96799-6494-46cc-9c4c-c1ce995f6091] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 41382. Oct 22 22:32:13.284738 ncdv-master-1 devstack@n-api.service[138745]: INFO oslo.messaging._drivers.impl_rabbit [-] [dbe685c1-0e25-4156-906e-a0926e5c28f4] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 41384. Oct 22 22:32:13.377173 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.network.neutron [None req-43c2b77a-584f-457a-8afa-fcbe08040bf9 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] validate_networks() for [('85f563af-3a28-40f1-a891-d4a70ec12b6a', None, None, None, None, None)] {{(pid=138745) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 22:32:14.108291 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-43c2b77a-584f-457a-8afa-fcbe08040bf9 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Flavor limits 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 22:32:14.108917 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-43c2b77a-584f-457a-8afa-fcbe08040bf9 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Image limits 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 22:32:14.109624 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-43c2b77a-584f-457a-8afa-fcbe08040bf9 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Flavor pref 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 22:32:14.110208 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-43c2b77a-584f-457a-8afa-fcbe08040bf9 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Image pref 0:0:0 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 22:32:14.110780 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.virt.hardware [None req-43c2b77a-584f-457a-8afa-fcbe08040bf9 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 22:32:14.121980 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-43c2b77a-584f-457a-8afa-fcbe08040bf9 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:32:14.122478 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-43c2b77a-584f-457a-8afa-fcbe08040bf9 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:32:14.122934 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-43c2b77a-584f-457a-8afa-fcbe08040bf9 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:32:14.123710 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-43c2b77a-584f-457a-8afa-fcbe08040bf9 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:32:14.124183 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-43c2b77a-584f-457a-8afa-fcbe08040bf9 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:32:14.124627 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-43c2b77a-584f-457a-8afa-fcbe08040bf9 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:32:14.142419 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-43c2b77a-584f-457a-8afa-fcbe08040bf9 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Getting quotas for project 2f440a34638f4bf1ab18f1c819aa48d6. Resources: {'cores', 'instances', 'ram'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 22:32:14.148290 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.quota [None req-43c2b77a-584f-457a-8afa-fcbe08040bf9 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Getting quotas for user 60243645bd55419d885180da80e843b5 and project 2f440a34638f4bf1ab18f1c819aa48d6. Resources: {'cores', 'instances', 'ram'} {{(pid=138745) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 22:32:14.161345 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-43c2b77a-584f-457a-8afa-fcbe08040bf9 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Going to run 1 instances... {{(pid=138745) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 22:32:14.163985 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-43c2b77a-584f-457a-8afa-fcbe08040bf9 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] [instance: 6377e82b-3b8e-4aea-95b0-9549b2a4090c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1ef22e68-498f-4815-884c-12ed09083907',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138745) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 22:32:14.211267 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-43c2b77a-584f-457a-8afa-fcbe08040bf9 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.962937 Oct 22 22:32:14.211974 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3588/7148] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Oct 22 22:32:13 2022] POST /compute/v2.1/servers => generated 404 bytes in 965 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 22:32:14.225984 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-ce0bfab9-f544-4753-bb17-8291cb65961a tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:32:14.226702 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-ce0bfab9-f544-4753-bb17-8291cb65961a tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] [instance: 6377e82b-3b8e-4aea-95b0-9549b2a4090c] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:32:14.236914 ncdv-master-1 devstack@n-api.service[138744]: INFO oslo.messaging._drivers.impl_rabbit [-] [04d2594c-31df-45b7-a94b-e87da15c0f2c] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 41398. Oct 22 22:32:14.240438 ncdv-master-1 devstack@n-api.service[138744]: INFO oslo.messaging._drivers.impl_rabbit [-] [81790953-1e28-46a4-954d-7f89676de4fb] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 41400. Oct 22 22:32:14.338006 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-ce0bfab9-f544-4753-bb17-8291cb65961a tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60243645bd55419d885180da80e843b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f440a34638f4bf1ab18f1c819aa48d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:32:14.346104 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-ce0bfab9-f544-4753-bb17-8291cb65961a tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] 10.222.0.18 "GET /compute/v2.1/servers/6377e82b-3b8e-4aea-95b0-9549b2a4090c" status: 200 len: 1247 microversion: 2.1 time: 0.126302 Oct 22 22:32:14.346679 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3561/7149] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:32:14 2022] GET /compute/v2.1/servers/6377e82b-3b8e-4aea-95b0-9549b2a4090c => generated 1247 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:32:15.370252 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-2a794e92-9d9e-46c8-93ee-fbeba803a17e tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:32:15.370960 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-2a794e92-9d9e-46c8-93ee-fbeba803a17e tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] [instance: 6377e82b-3b8e-4aea-95b0-9549b2a4090c] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:32:15.377635 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2a794e92-9d9e-46c8-93ee-fbeba803a17e tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:32:15.378134 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2a794e92-9d9e-46c8-93ee-fbeba803a17e tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:32:15.378589 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2a794e92-9d9e-46c8-93ee-fbeba803a17e tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:32:15.379315 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2a794e92-9d9e-46c8-93ee-fbeba803a17e tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:32:15.379818 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2a794e92-9d9e-46c8-93ee-fbeba803a17e tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:32:15.380263 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-2a794e92-9d9e-46c8-93ee-fbeba803a17e tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:32:15.448636 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-2a794e92-9d9e-46c8-93ee-fbeba803a17e tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60243645bd55419d885180da80e843b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f440a34638f4bf1ab18f1c819aa48d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:32:15.456887 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-2a794e92-9d9e-46c8-93ee-fbeba803a17e tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] 10.222.0.18 "GET /compute/v2.1/servers/6377e82b-3b8e-4aea-95b0-9549b2a4090c" status: 200 len: 1317 microversion: 2.1 time: 0.091876 Oct 22 22:32:15.457466 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3589/7150] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:32:15 2022] GET /compute/v2.1/servers/6377e82b-3b8e-4aea-95b0-9549b2a4090c => generated 1317 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:32:16.480638 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-08ac49fc-257e-4696-b633-dec34e2f1710 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:32:16.481263 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-08ac49fc-257e-4696-b633-dec34e2f1710 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] [instance: 6377e82b-3b8e-4aea-95b0-9549b2a4090c] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:32:16.484513 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:SELECT=2 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:32:16.491611 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-08ac49fc-257e-4696-b633-dec34e2f1710 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:32:16.492574 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-08ac49fc-257e-4696-b633-dec34e2f1710 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:32:16.493288 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-08ac49fc-257e-4696-b633-dec34e2f1710 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:32:16.494148 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-08ac49fc-257e-4696-b633-dec34e2f1710 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:32:16.494614 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-08ac49fc-257e-4696-b633-dec34e2f1710 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:32:16.495052 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-08ac49fc-257e-4696-b633-dec34e2f1710 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:32:16.656060 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-08ac49fc-257e-4696-b633-dec34e2f1710 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60243645bd55419d885180da80e843b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f440a34638f4bf1ab18f1c819aa48d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:32:16.665605 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-08ac49fc-257e-4696-b633-dec34e2f1710 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] 10.222.0.18 "GET /compute/v2.1/servers/6377e82b-3b8e-4aea-95b0-9549b2a4090c" status: 200 len: 1371 microversion: 2.1 time: 0.188930 Oct 22 22:32:16.666200 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3562/7151] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:32:16 2022] GET /compute/v2.1/servers/6377e82b-3b8e-4aea-95b0-9549b2a4090c => generated 1371 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:32:17.689945 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-ad4cc35e-0fe5-4e19-8085-74acc490cf82 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:32:17.690563 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-ad4cc35e-0fe5-4e19-8085-74acc490cf82 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] [instance: 6377e82b-3b8e-4aea-95b0-9549b2a4090c] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:32:17.698227 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ad4cc35e-0fe5-4e19-8085-74acc490cf82 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:32:17.699059 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ad4cc35e-0fe5-4e19-8085-74acc490cf82 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:32:17.699870 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ad4cc35e-0fe5-4e19-8085-74acc490cf82 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:32:17.700677 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ad4cc35e-0fe5-4e19-8085-74acc490cf82 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:32:17.701510 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ad4cc35e-0fe5-4e19-8085-74acc490cf82 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:32:17.702163 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-ad4cc35e-0fe5-4e19-8085-74acc490cf82 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:32:17.778979 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-c9716832-de70-4fce-9c1d-b160e10e1581 req-6084472a-13a7-49a0-9b23-cadceded0502 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97b04d30-8fd9-4214-917c-a77e062f0da8", "name": "network-vif-unplugged", "status": "completed", "tag": "2f64bcad-e7af-4d3c-9554-92fda3f94ae9"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 22:32:17.791182 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-c9716832-de70-4fce-9c1d-b160e10e1581 req-6084472a-13a7-49a0-9b23-cadceded0502 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:32:17.791879 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-c9716832-de70-4fce-9c1d-b160e10e1581 req-6084472a-13a7-49a0-9b23-cadceded0502 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:32:17.792609 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-c9716832-de70-4fce-9c1d-b160e10e1581 req-6084472a-13a7-49a0-9b23-cadceded0502 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:32:17.824656 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-c9716832-de70-4fce-9c1d-b160e10e1581 req-6084472a-13a7-49a0-9b23-cadceded0502 service nova] Creating event network-vif-unplugged:2f64bcad-e7af-4d3c-9554-92fda3f94ae9 for instance 97b04d30-8fd9-4214-917c-a77e062f0da8 on nch2-master-1 Oct 22 22:32:17.839320 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-c9716832-de70-4fce-9c1d-b160e10e1581 req-6084472a-13a7-49a0-9b23-cadceded0502 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.062685 Oct 22 22:32:17.841067 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3563/7152] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 22:32:17 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 22:32:17.878961 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-ad4cc35e-0fe5-4e19-8085-74acc490cf82 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60243645bd55419d885180da80e843b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f440a34638f4bf1ab18f1c819aa48d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:32:17.900565 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-ad4cc35e-0fe5-4e19-8085-74acc490cf82 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] 10.222.0.18 "GET /compute/v2.1/servers/6377e82b-3b8e-4aea-95b0-9549b2a4090c" status: 200 len: 1371 microversion: 2.1 time: 0.214483 Oct 22 22:32:17.901310 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3590/7153] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:32:17 2022] GET /compute/v2.1/servers/6377e82b-3b8e-4aea-95b0-9549b2a4090c => generated 1371 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:32:18.925711 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-1761f342-7ad4-46ba-a6e7-cf667e0b2f72 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:32:18.927137 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-1761f342-7ad4-46ba-a6e7-cf667e0b2f72 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] [instance: 6377e82b-3b8e-4aea-95b0-9549b2a4090c] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:32:18.934584 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1761f342-7ad4-46ba-a6e7-cf667e0b2f72 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:32:18.935409 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1761f342-7ad4-46ba-a6e7-cf667e0b2f72 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:32:18.935860 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1761f342-7ad4-46ba-a6e7-cf667e0b2f72 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:32:18.936558 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1761f342-7ad4-46ba-a6e7-cf667e0b2f72 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:32:18.937009 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1761f342-7ad4-46ba-a6e7-cf667e0b2f72 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:32:18.937439 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-1761f342-7ad4-46ba-a6e7-cf667e0b2f72 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:32:19.117107 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-1761f342-7ad4-46ba-a6e7-cf667e0b2f72 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60243645bd55419d885180da80e843b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f440a34638f4bf1ab18f1c819aa48d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:32:19.129470 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-1761f342-7ad4-46ba-a6e7-cf667e0b2f72 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] 10.222.0.18 "GET /compute/v2.1/servers/6377e82b-3b8e-4aea-95b0-9549b2a4090c" status: 200 len: 1371 microversion: 2.1 time: 0.205609 Oct 22 22:32:19.131528 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3564/7154] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:32:18 2022] GET /compute/v2.1/servers/6377e82b-3b8e-4aea-95b0-9549b2a4090c => generated 1371 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 22:32:20.153948 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-c9fea71e-5a73-46cd-9dbb-4b60b1ca53bc tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:32:20.154826 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-c9fea71e-5a73-46cd-9dbb-4b60b1ca53bc tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] [instance: 6377e82b-3b8e-4aea-95b0-9549b2a4090c] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:32:20.162543 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c9fea71e-5a73-46cd-9dbb-4b60b1ca53bc tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:32:20.163045 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c9fea71e-5a73-46cd-9dbb-4b60b1ca53bc tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:32:20.163605 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c9fea71e-5a73-46cd-9dbb-4b60b1ca53bc tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:32:20.164353 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c9fea71e-5a73-46cd-9dbb-4b60b1ca53bc tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:32:20.164799 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c9fea71e-5a73-46cd-9dbb-4b60b1ca53bc tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:32:20.165823 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-c9fea71e-5a73-46cd-9dbb-4b60b1ca53bc tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:32:20.305601 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-c9fea71e-5a73-46cd-9dbb-4b60b1ca53bc tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60243645bd55419d885180da80e843b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f440a34638f4bf1ab18f1c819aa48d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:32:20.313854 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-c9fea71e-5a73-46cd-9dbb-4b60b1ca53bc tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] 10.222.0.18 "GET /compute/v2.1/servers/6377e82b-3b8e-4aea-95b0-9549b2a4090c" status: 200 len: 1371 microversion: 2.1 time: 0.163894 Oct 22 22:32:20.316549 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3591/7155] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:32:20 2022] GET /compute/v2.1/servers/6377e82b-3b8e-4aea-95b0-9549b2a4090c => generated 1371 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:32:21.340772 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-4309bae5-6bd2-43f9-a00f-6f32fcd644ca tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:32:21.342578 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-4309bae5-6bd2-43f9-a00f-6f32fcd644ca tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] [instance: 6377e82b-3b8e-4aea-95b0-9549b2a4090c] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:32:21.352954 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4309bae5-6bd2-43f9-a00f-6f32fcd644ca tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:32:21.353961 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4309bae5-6bd2-43f9-a00f-6f32fcd644ca tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:32:21.355416 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4309bae5-6bd2-43f9-a00f-6f32fcd644ca tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:32:21.356269 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4309bae5-6bd2-43f9-a00f-6f32fcd644ca tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:32:21.356771 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4309bae5-6bd2-43f9-a00f-6f32fcd644ca tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:32:21.357209 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4309bae5-6bd2-43f9-a00f-6f32fcd644ca tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:32:21.518987 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-4309bae5-6bd2-43f9-a00f-6f32fcd644ca tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60243645bd55419d885180da80e843b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f440a34638f4bf1ab18f1c819aa48d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:32:21.527068 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-4309bae5-6bd2-43f9-a00f-6f32fcd644ca tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] 10.222.0.18 "GET /compute/v2.1/servers/6377e82b-3b8e-4aea-95b0-9549b2a4090c" status: 200 len: 1371 microversion: 2.1 time: 0.192796 Oct 22 22:32:21.527690 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3565/7156] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:32:21 2022] GET /compute/v2.1/servers/6377e82b-3b8e-4aea-95b0-9549b2a4090c => generated 1371 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:32:22.552682 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-348e70a0-2f49-4212-bfa7-1f3ab52e7c94 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:32:22.553361 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-348e70a0-2f49-4212-bfa7-1f3ab52e7c94 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] [instance: 6377e82b-3b8e-4aea-95b0-9549b2a4090c] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:32:22.561161 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-348e70a0-2f49-4212-bfa7-1f3ab52e7c94 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:32:22.561681 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-348e70a0-2f49-4212-bfa7-1f3ab52e7c94 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:32:22.562181 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-348e70a0-2f49-4212-bfa7-1f3ab52e7c94 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:32:22.562929 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-348e70a0-2f49-4212-bfa7-1f3ab52e7c94 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:32:22.563552 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-348e70a0-2f49-4212-bfa7-1f3ab52e7c94 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:32:22.564013 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-348e70a0-2f49-4212-bfa7-1f3ab52e7c94 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:32:22.721040 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-348e70a0-2f49-4212-bfa7-1f3ab52e7c94 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60243645bd55419d885180da80e843b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f440a34638f4bf1ab18f1c819aa48d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:32:22.729576 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-348e70a0-2f49-4212-bfa7-1f3ab52e7c94 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] 10.222.0.18 "GET /compute/v2.1/servers/6377e82b-3b8e-4aea-95b0-9549b2a4090c" status: 200 len: 1371 microversion: 2.1 time: 0.180758 Oct 22 22:32:22.730388 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3592/7157] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:32:22 2022] GET /compute/v2.1/servers/6377e82b-3b8e-4aea-95b0-9549b2a4090c => generated 1371 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:32:23.757125 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-4269cee7-980f-4186-8595-f579fd3486e7 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:32:23.757898 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-4269cee7-980f-4186-8595-f579fd3486e7 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] [instance: 6377e82b-3b8e-4aea-95b0-9549b2a4090c] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:32:23.765358 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4269cee7-980f-4186-8595-f579fd3486e7 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:32:23.765853 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4269cee7-980f-4186-8595-f579fd3486e7 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:32:23.766305 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4269cee7-980f-4186-8595-f579fd3486e7 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:32:23.767014 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4269cee7-980f-4186-8595-f579fd3486e7 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:32:23.767520 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4269cee7-980f-4186-8595-f579fd3486e7 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:32:23.767956 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4269cee7-980f-4186-8595-f579fd3486e7 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:32:23.905727 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-4269cee7-980f-4186-8595-f579fd3486e7 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60243645bd55419d885180da80e843b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f440a34638f4bf1ab18f1c819aa48d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:32:23.914354 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-4269cee7-980f-4186-8595-f579fd3486e7 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] 10.222.0.18 "GET /compute/v2.1/servers/6377e82b-3b8e-4aea-95b0-9549b2a4090c" status: 200 len: 1371 microversion: 2.1 time: 0.163943 Oct 22 22:32:23.914947 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3566/7158] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:32:23 2022] GET /compute/v2.1/servers/6377e82b-3b8e-4aea-95b0-9549b2a4090c => generated 1371 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:32:24.942233 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-887ed70a-fd5d-49f5-aab0-f5f952a1d1e2 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:32:24.943202 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-887ed70a-fd5d-49f5-aab0-f5f952a1d1e2 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] [instance: 6377e82b-3b8e-4aea-95b0-9549b2a4090c] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:32:24.947671 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell0:SELECT=2 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:32:24.948793 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell0:SELECT=6 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:32:24.958801 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-887ed70a-fd5d-49f5-aab0-f5f952a1d1e2 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:32:24.959734 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-887ed70a-fd5d-49f5-aab0-f5f952a1d1e2 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:32:24.960618 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-887ed70a-fd5d-49f5-aab0-f5f952a1d1e2 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:32:24.961374 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-887ed70a-fd5d-49f5-aab0-f5f952a1d1e2 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:32:24.961848 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-887ed70a-fd5d-49f5-aab0-f5f952a1d1e2 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:32:24.962294 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-887ed70a-fd5d-49f5-aab0-f5f952a1d1e2 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:32:25.103597 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-887ed70a-fd5d-49f5-aab0-f5f952a1d1e2 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60243645bd55419d885180da80e843b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f440a34638f4bf1ab18f1c819aa48d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:32:25.111850 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-887ed70a-fd5d-49f5-aab0-f5f952a1d1e2 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] 10.222.0.18 "GET /compute/v2.1/servers/6377e82b-3b8e-4aea-95b0-9549b2a4090c" status: 200 len: 1371 microversion: 2.1 time: 0.176223 Oct 22 22:32:25.112444 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3593/7159] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:32:24 2022] GET /compute/v2.1/servers/6377e82b-3b8e-4aea-95b0-9549b2a4090c => generated 1371 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:32:25.755173 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell0:SELECT=2 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:32:25.821806 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-69007310-589e-47f5-b8a5-ffee940a0a03 req-8377c61a-94c7-4939-9a4b-0a99f3d2364f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6377e82b-3b8e-4aea-95b0-9549b2a4090c", "tag": "ef53f21a-3d14-4bd1-b51a-003465e932ea"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 22:32:25.832032 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-69007310-589e-47f5-b8a5-ffee940a0a03 req-8377c61a-94c7-4939-9a4b-0a99f3d2364f service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:32:25.832502 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-69007310-589e-47f5-b8a5-ffee940a0a03 req-8377c61a-94c7-4939-9a4b-0a99f3d2364f service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:32:25.832952 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-69007310-589e-47f5-b8a5-ffee940a0a03 req-8377c61a-94c7-4939-9a4b-0a99f3d2364f service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:32:25.845071 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-69007310-589e-47f5-b8a5-ffee940a0a03 req-8377c61a-94c7-4939-9a4b-0a99f3d2364f service nova] Creating event network-changed:ef53f21a-3d14-4bd1-b51a-003465e932ea for instance 6377e82b-3b8e-4aea-95b0-9549b2a4090c on nch1-master-1 Oct 22 22:32:25.850106 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-69007310-589e-47f5-b8a5-ffee940a0a03 req-8377c61a-94c7-4939-9a4b-0a99f3d2364f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099560 Oct 22 22:32:25.850714 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3567/7160] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 22:32:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 22:32:26.136836 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-e2d279cb-850e-466f-9651-f7f56b28b93a tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:32:26.138211 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-e2d279cb-850e-466f-9651-f7f56b28b93a tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] [instance: 6377e82b-3b8e-4aea-95b0-9549b2a4090c] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:32:26.146289 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e2d279cb-850e-466f-9651-f7f56b28b93a tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:32:26.146864 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e2d279cb-850e-466f-9651-f7f56b28b93a tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:32:26.147546 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e2d279cb-850e-466f-9651-f7f56b28b93a tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:32:26.148515 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e2d279cb-850e-466f-9651-f7f56b28b93a tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:32:26.149140 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e2d279cb-850e-466f-9651-f7f56b28b93a tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:32:26.149723 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e2d279cb-850e-466f-9651-f7f56b28b93a tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:32:26.303793 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-e2d279cb-850e-466f-9651-f7f56b28b93a tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60243645bd55419d885180da80e843b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f440a34638f4bf1ab18f1c819aa48d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:32:26.312039 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-e2d279cb-850e-466f-9651-f7f56b28b93a tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] 10.222.0.18 "GET /compute/v2.1/servers/6377e82b-3b8e-4aea-95b0-9549b2a4090c" status: 200 len: 1371 microversion: 2.1 time: 0.180035 Oct 22 22:32:26.312614 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3594/7161] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:32:26 2022] GET /compute/v2.1/servers/6377e82b-3b8e-4aea-95b0-9549b2a4090c => generated 1371 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:32:27.341658 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-4900d305-bbbe-4209-adf1-6f6a05060b00 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:32:27.342848 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-4900d305-bbbe-4209-adf1-6f6a05060b00 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] [instance: 6377e82b-3b8e-4aea-95b0-9549b2a4090c] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:32:27.352881 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4900d305-bbbe-4209-adf1-6f6a05060b00 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:32:27.353369 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4900d305-bbbe-4209-adf1-6f6a05060b00 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:32:27.353825 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4900d305-bbbe-4209-adf1-6f6a05060b00 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:32:27.354521 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4900d305-bbbe-4209-adf1-6f6a05060b00 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:32:27.354982 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4900d305-bbbe-4209-adf1-6f6a05060b00 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:32:27.355443 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4900d305-bbbe-4209-adf1-6f6a05060b00 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:32:27.500050 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-4900d305-bbbe-4209-adf1-6f6a05060b00 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60243645bd55419d885180da80e843b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f440a34638f4bf1ab18f1c819aa48d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:32:27.508267 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-4900d305-bbbe-4209-adf1-6f6a05060b00 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] 10.222.0.18 "GET /compute/v2.1/servers/6377e82b-3b8e-4aea-95b0-9549b2a4090c" status: 200 len: 1371 microversion: 2.1 time: 0.175770 Oct 22 22:32:27.508821 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3568/7162] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:32:27 2022] GET /compute/v2.1/servers/6377e82b-3b8e-4aea-95b0-9549b2a4090c => generated 1371 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:32:28.532118 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-38ca167e-0bab-4026-bb5c-3b85aa0ef4e7 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:32:28.532975 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-38ca167e-0bab-4026-bb5c-3b85aa0ef4e7 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] [instance: 6377e82b-3b8e-4aea-95b0-9549b2a4090c] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:32:28.540749 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-38ca167e-0bab-4026-bb5c-3b85aa0ef4e7 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:32:28.541276 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-38ca167e-0bab-4026-bb5c-3b85aa0ef4e7 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:32:28.541733 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-38ca167e-0bab-4026-bb5c-3b85aa0ef4e7 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:32:28.542453 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-38ca167e-0bab-4026-bb5c-3b85aa0ef4e7 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:32:28.542924 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-38ca167e-0bab-4026-bb5c-3b85aa0ef4e7 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:32:28.543371 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-38ca167e-0bab-4026-bb5c-3b85aa0ef4e7 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:32:28.685830 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-38ca167e-0bab-4026-bb5c-3b85aa0ef4e7 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60243645bd55419d885180da80e843b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f440a34638f4bf1ab18f1c819aa48d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:32:28.693881 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-38ca167e-0bab-4026-bb5c-3b85aa0ef4e7 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] 10.222.0.18 "GET /compute/v2.1/servers/6377e82b-3b8e-4aea-95b0-9549b2a4090c" status: 200 len: 1371 microversion: 2.1 time: 0.166137 Oct 22 22:32:28.694465 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3595/7163] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:32:28 2022] GET /compute/v2.1/servers/6377e82b-3b8e-4aea-95b0-9549b2a4090c => generated 1371 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:32:29.717874 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-f0f0478c-3258-4f46-9631-9a676eccf599 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:32:29.718483 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-f0f0478c-3258-4f46-9631-9a676eccf599 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] [instance: 6377e82b-3b8e-4aea-95b0-9549b2a4090c] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:32:29.726245 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f0f0478c-3258-4f46-9631-9a676eccf599 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:32:29.726785 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f0f0478c-3258-4f46-9631-9a676eccf599 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:32:29.727215 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f0f0478c-3258-4f46-9631-9a676eccf599 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:32:29.727974 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f0f0478c-3258-4f46-9631-9a676eccf599 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:32:29.728462 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f0f0478c-3258-4f46-9631-9a676eccf599 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:32:29.728897 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-f0f0478c-3258-4f46-9631-9a676eccf599 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:32:29.878145 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-f0f0478c-3258-4f46-9631-9a676eccf599 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60243645bd55419d885180da80e843b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f440a34638f4bf1ab18f1c819aa48d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:32:29.886668 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-f0f0478c-3258-4f46-9631-9a676eccf599 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] 10.222.0.18 "GET /compute/v2.1/servers/6377e82b-3b8e-4aea-95b0-9549b2a4090c" status: 200 len: 1371 microversion: 2.1 time: 0.173084 Oct 22 22:32:29.887261 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3569/7164] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:32:29 2022] GET /compute/v2.1/servers/6377e82b-3b8e-4aea-95b0-9549b2a4090c => generated 1371 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:32:30.918139 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-7676446d-6eb4-4007-b42e-926a2d3a4d70 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:32:30.918765 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-7676446d-6eb4-4007-b42e-926a2d3a4d70 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] [instance: 6377e82b-3b8e-4aea-95b0-9549b2a4090c] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:32:30.926194 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7676446d-6eb4-4007-b42e-926a2d3a4d70 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:32:30.926694 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7676446d-6eb4-4007-b42e-926a2d3a4d70 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:32:30.927129 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7676446d-6eb4-4007-b42e-926a2d3a4d70 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:32:30.927911 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7676446d-6eb4-4007-b42e-926a2d3a4d70 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:32:30.928380 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7676446d-6eb4-4007-b42e-926a2d3a4d70 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:32:30.928822 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-7676446d-6eb4-4007-b42e-926a2d3a4d70 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:32:31.073243 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-7676446d-6eb4-4007-b42e-926a2d3a4d70 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60243645bd55419d885180da80e843b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f440a34638f4bf1ab18f1c819aa48d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:32:31.081911 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-7676446d-6eb4-4007-b42e-926a2d3a4d70 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] 10.222.0.18 "GET /compute/v2.1/servers/6377e82b-3b8e-4aea-95b0-9549b2a4090c" status: 200 len: 1371 microversion: 2.1 time: 0.167799 Oct 22 22:32:31.082526 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3596/7165] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:32:30 2022] GET /compute/v2.1/servers/6377e82b-3b8e-4aea-95b0-9549b2a4090c => generated 1371 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:32:31.578929 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-71e9f5a8-5607-4e67-97b1-16a1d36684aa req-96c237f6-7e69-488e-b45d-b611cd1f7f99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6377e82b-3b8e-4aea-95b0-9549b2a4090c", "name": "network-vif-plugged", "status": "completed", "tag": "ef53f21a-3d14-4bd1-b51a-003465e932ea"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 22:32:31.591743 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-71e9f5a8-5607-4e67-97b1-16a1d36684aa req-96c237f6-7e69-488e-b45d-b611cd1f7f99 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:32:31.592234 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-71e9f5a8-5607-4e67-97b1-16a1d36684aa req-96c237f6-7e69-488e-b45d-b611cd1f7f99 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:32:31.593486 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-71e9f5a8-5607-4e67-97b1-16a1d36684aa req-96c237f6-7e69-488e-b45d-b611cd1f7f99 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:32:31.605917 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-71e9f5a8-5607-4e67-97b1-16a1d36684aa req-96c237f6-7e69-488e-b45d-b611cd1f7f99 service nova] Creating event network-vif-plugged:ef53f21a-3d14-4bd1-b51a-003465e932ea for instance 6377e82b-3b8e-4aea-95b0-9549b2a4090c on nch1-master-1 Oct 22 22:32:31.611317 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-71e9f5a8-5607-4e67-97b1-16a1d36684aa req-96c237f6-7e69-488e-b45d-b611cd1f7f99 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036678 Oct 22 22:32:31.612175 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3570/7166] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 22:32:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 22:32:32.111625 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-b07e4519-03eb-4eaf-80b3-f42664d7d1c6 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:32:32.112590 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-b07e4519-03eb-4eaf-80b3-f42664d7d1c6 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] [instance: 6377e82b-3b8e-4aea-95b0-9549b2a4090c] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:32:32.122777 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b07e4519-03eb-4eaf-80b3-f42664d7d1c6 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:32:32.123286 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b07e4519-03eb-4eaf-80b3-f42664d7d1c6 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:32:32.123761 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b07e4519-03eb-4eaf-80b3-f42664d7d1c6 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:32:32.124502 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b07e4519-03eb-4eaf-80b3-f42664d7d1c6 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:32:32.124978 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b07e4519-03eb-4eaf-80b3-f42664d7d1c6 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:32:32.125427 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-b07e4519-03eb-4eaf-80b3-f42664d7d1c6 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:32:32.270959 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-b07e4519-03eb-4eaf-80b3-f42664d7d1c6 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60243645bd55419d885180da80e843b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f440a34638f4bf1ab18f1c819aa48d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:32:32.281458 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-b07e4519-03eb-4eaf-80b3-f42664d7d1c6 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] 10.222.0.18 "GET /compute/v2.1/servers/6377e82b-3b8e-4aea-95b0-9549b2a4090c" status: 200 len: 1371 microversion: 2.1 time: 0.177240 Oct 22 22:32:32.282344 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3597/7167] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:32:32 2022] GET /compute/v2.1/servers/6377e82b-3b8e-4aea-95b0-9549b2a4090c => generated 1371 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:32:33.317543 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-8a621e0a-c5ea-46b4-882d-e9871a108a33 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:32:33.318740 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-8a621e0a-c5ea-46b4-882d-e9871a108a33 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] [instance: 6377e82b-3b8e-4aea-95b0-9549b2a4090c] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:32:33.328130 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8a621e0a-c5ea-46b4-882d-e9871a108a33 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:32:33.328677 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8a621e0a-c5ea-46b4-882d-e9871a108a33 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:32:33.329144 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8a621e0a-c5ea-46b4-882d-e9871a108a33 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:32:33.329947 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8a621e0a-c5ea-46b4-882d-e9871a108a33 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:32:33.330531 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8a621e0a-c5ea-46b4-882d-e9871a108a33 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:32:33.331058 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-8a621e0a-c5ea-46b4-882d-e9871a108a33 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:32:33.475216 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-8a621e0a-c5ea-46b4-882d-e9871a108a33 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60243645bd55419d885180da80e843b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f440a34638f4bf1ab18f1c819aa48d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:32:33.483689 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-8a621e0a-c5ea-46b4-882d-e9871a108a33 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] 10.222.0.18 "GET /compute/v2.1/servers/6377e82b-3b8e-4aea-95b0-9549b2a4090c" status: 200 len: 1557 microversion: 2.1 time: 0.172913 Oct 22 22:32:33.484244 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3571/7168] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:32:33 2022] GET /compute/v2.1/servers/6377e82b-3b8e-4aea-95b0-9549b2a4090c => generated 1557 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:32:33.506001 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-e2741ca3-1df1-4088-b286-4d1406890057 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:32:33.506603 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-e2741ca3-1df1-4088-b286-4d1406890057 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] [instance: 6377e82b-3b8e-4aea-95b0-9549b2a4090c] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:32:33.516125 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e2741ca3-1df1-4088-b286-4d1406890057 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:32:33.516933 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e2741ca3-1df1-4088-b286-4d1406890057 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:32:33.517605 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e2741ca3-1df1-4088-b286-4d1406890057 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:32:33.518792 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e2741ca3-1df1-4088-b286-4d1406890057 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:32:33.519536 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e2741ca3-1df1-4088-b286-4d1406890057 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:32:33.520224 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-e2741ca3-1df1-4088-b286-4d1406890057 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:32:33.673674 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-e2741ca3-1df1-4088-b286-4d1406890057 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60243645bd55419d885180da80e843b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f440a34638f4bf1ab18f1c819aa48d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:32:33.682195 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-e2741ca3-1df1-4088-b286-4d1406890057 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] 10.222.0.18 "GET /compute/v2.1/servers/6377e82b-3b8e-4aea-95b0-9549b2a4090c" status: 200 len: 1557 microversion: 2.1 time: 0.180120 Oct 22 22:32:33.682928 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3598/7169] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:32:33 2022] GET /compute/v2.1/servers/6377e82b-3b8e-4aea-95b0-9549b2a4090c => generated 1557 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:32:35.635889 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-37dc2b22-1e17-479a-9e43-dbca710242c4 req-3b4cfa9d-db12-4e12-95a4-c85c39a29605 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6377e82b-3b8e-4aea-95b0-9549b2a4090c", "tag": "ef53f21a-3d14-4bd1-b51a-003465e932ea"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 22:32:35.651848 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-37dc2b22-1e17-479a-9e43-dbca710242c4 req-3b4cfa9d-db12-4e12-95a4-c85c39a29605 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:32:35.651978 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-37dc2b22-1e17-479a-9e43-dbca710242c4 req-3b4cfa9d-db12-4e12-95a4-c85c39a29605 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:32:35.652377 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-37dc2b22-1e17-479a-9e43-dbca710242c4 req-3b4cfa9d-db12-4e12-95a4-c85c39a29605 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:32:35.664398 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-37dc2b22-1e17-479a-9e43-dbca710242c4 req-3b4cfa9d-db12-4e12-95a4-c85c39a29605 service nova] Creating event network-changed:ef53f21a-3d14-4bd1-b51a-003465e932ea for instance 6377e82b-3b8e-4aea-95b0-9549b2a4090c on nch1-master-1 Oct 22 22:32:35.669529 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-37dc2b22-1e17-479a-9e43-dbca710242c4 req-3b4cfa9d-db12-4e12-95a4-c85c39a29605 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037842 Oct 22 22:32:35.670140 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3572/7170] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 22:32:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 22:34:37.637743 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:34:37.638638 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell1:SELECT=62 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:34:37.644412 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-0f288f9a-fd13-4868-b5ad-c58693ce243c tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-1681212750"}} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 22:34:37.646871 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-0f288f9a-fd13-4868-b5ad-c58693ce243c tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] [instance: 6377e82b-3b8e-4aea-95b0-9549b2a4090c] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:34:37.654488 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0f288f9a-fd13-4868-b5ad-c58693ce243c tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:34:37.655099 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0f288f9a-fd13-4868-b5ad-c58693ce243c tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:34:37.655642 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0f288f9a-fd13-4868-b5ad-c58693ce243c tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:34:37.656410 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0f288f9a-fd13-4868-b5ad-c58693ce243c tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:34:37.656866 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0f288f9a-fd13-4868-b5ad-c58693ce243c tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:34:37.658150 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-0f288f9a-fd13-4868-b5ad-c58693ce243c tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:34:37.882061 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-0f288f9a-fd13-4868-b5ad-c58693ce243c tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] 10.222.0.18 "POST /compute/v2.1/servers/6377e82b-3b8e-4aea-95b0-9549b2a4090c/action" status: 202 len: 0 microversion: 2.1 time: 0.245834 Oct 22 22:34:37.882660 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3599/7171] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Oct 22 22:34:37 2022] POST /compute/v2.1/servers/6377e82b-3b8e-4aea-95b0-9549b2a4090c/action => generated 0 bytes in 248 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 22 22:34:44.257359 ncdv-master-1 devstack@n-api.service[138744]: ERROR oslo.messaging._drivers.impl_rabbit [-] [04d2594c-31df-45b7-a94b-e87da15c0f2c] AMQP server on 10.222.0.18:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Oct 22 22:34:44.258890 ncdv-master-1 devstack@n-api.service[138744]: ERROR oslo.messaging._drivers.impl_rabbit [-] [81790953-1e28-46a4-954d-7f89676de4fb] AMQP server on 10.222.0.18:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Oct 22 22:34:44.259733 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_api:SELECT=28 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:34:44.260706 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:SELECT=50 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:34:44.261468 ncdv-master-1 devstack@n-api.service[138744]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 22 22:34:44.261617 ncdv-master-1 devstack@n-api.service[138744]: Sat Oct 22 22:34:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.18) !!! Oct 22 22:34:44.262780 ncdv-master-1 devstack@n-api.service[138744]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 22 22:34:44.262966 ncdv-master-1 devstack@n-api.service[138744]: Sat Oct 22 22:34:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.18) !!! Oct 22 22:34:44.269391 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-abab3872-dfe3-4715-8a1d-783ceef8ab75 req-049434d6-5f45-401c-8969-7d0d0997062c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6377e82b-3b8e-4aea-95b0-9549b2a4090c", "name": "network-vif-plugged", "status": "completed", "tag": "ef53f21a-3d14-4bd1-b51a-003465e932ea"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 22:34:44.282451 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-abab3872-dfe3-4715-8a1d-783ceef8ab75 req-049434d6-5f45-401c-8969-7d0d0997062c service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:34:44.282929 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-abab3872-dfe3-4715-8a1d-783ceef8ab75 req-049434d6-5f45-401c-8969-7d0d0997062c service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:34:44.283362 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-abab3872-dfe3-4715-8a1d-783ceef8ab75 req-049434d6-5f45-401c-8969-7d0d0997062c service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:34:44.296530 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-abab3872-dfe3-4715-8a1d-783ceef8ab75 req-049434d6-5f45-401c-8969-7d0d0997062c service nova] Creating event network-vif-plugged:ef53f21a-3d14-4bd1-b51a-003465e932ea for instance 6377e82b-3b8e-4aea-95b0-9549b2a4090c on nch1-master-1 Oct 22 22:34:44.304046 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-abab3872-dfe3-4715-8a1d-783ceef8ab75 req-049434d6-5f45-401c-8969-7d0d0997062c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048151 Oct 22 22:34:44.304901 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3573/7172] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 22:34:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 22:34:56.948962 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_api:SELECT=2 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:34:56.950109 ncdv-master-1 devstack@n-api.service[138745]: DEBUG dbcounter [-] [138745] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:34:56.953889 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_api:SELECT=2 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:34:56.954749 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-14cfdfea-8348-41f2-8811-7b0bac30bf43 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:34:56.954882 ncdv-master-1 devstack@n-api.service[138744]: DEBUG dbcounter [-] [138744] Writing DB stats nova_cell1:SELECT=2 {{(pid=138744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:34:56.955746 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-14cfdfea-8348-41f2-8811-7b0bac30bf43 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] [instance: 6377e82b-3b8e-4aea-95b0-9549b2a4090c] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:34:56.961876 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [req-a6c1e645-17ba-49c2-b841-1f096f53bdc1 req-9573334d-a299-45f4-bbee-c157bf83c63a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6377e82b-3b8e-4aea-95b0-9549b2a4090c", "tag": "ef53f21a-3d14-4bd1-b51a-003465e932ea"}]} {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 22:34:56.964365 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-14cfdfea-8348-41f2-8811-7b0bac30bf43 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:34:56.965014 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-14cfdfea-8348-41f2-8811-7b0bac30bf43 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:34:56.965567 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-14cfdfea-8348-41f2-8811-7b0bac30bf43 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:34:56.966439 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-14cfdfea-8348-41f2-8811-7b0bac30bf43 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:34:56.967012 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-14cfdfea-8348-41f2-8811-7b0bac30bf43 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:34:56.967588 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-14cfdfea-8348-41f2-8811-7b0bac30bf43 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:34:56.982386 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-a6c1e645-17ba-49c2-b841-1f096f53bdc1 req-9573334d-a299-45f4-bbee-c157bf83c63a service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:34:56.982954 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-a6c1e645-17ba-49c2-b841-1f096f53bdc1 req-9573334d-a299-45f4-bbee-c157bf83c63a service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:34:56.983435 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [req-a6c1e645-17ba-49c2-b841-1f096f53bdc1 req-9573334d-a299-45f4-bbee-c157bf83c63a service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:34:56.986646 ncdv-master-1 devstack@n-api.service[138744]: INFO oslo.messaging._drivers.impl_rabbit [-] [04d2594c-31df-45b7-a94b-e87da15c0f2c] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 41762. Oct 22 22:34:56.987623 ncdv-master-1 devstack@n-api.service[138744]: INFO oslo.messaging._drivers.impl_rabbit [-] [81790953-1e28-46a4-954d-7f89676de4fb] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 41764. Oct 22 22:34:56.997757 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.compute.server_external_events [req-a6c1e645-17ba-49c2-b841-1f096f53bdc1 req-9573334d-a299-45f4-bbee-c157bf83c63a service nova] Creating event network-changed:ef53f21a-3d14-4bd1-b51a-003465e932ea for instance 6377e82b-3b8e-4aea-95b0-9549b2a4090c on nch1-master-1 Oct 22 22:34:57.000588 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-14cfdfea-8348-41f2-8811-7b0bac30bf43 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] [instance: 6377e82b-3b8e-4aea-95b0-9549b2a4090c] Going to try to terminate instance {{(pid=138745) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 22:34:57.003126 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [req-a6c1e645-17ba-49c2-b841-1f096f53bdc1 req-9573334d-a299-45f4-bbee-c157bf83c63a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053828 Oct 22 22:34:57.004287 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3574/7173] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 22:34:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 22:34:57.100431 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-14cfdfea-8348-41f2-8811-7b0bac30bf43 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] 10.222.0.18 "DELETE /compute/v2.1/servers/6377e82b-3b8e-4aea-95b0-9549b2a4090c" status: 204 len: 0 microversion: 2.1 time: 0.153572 Oct 22 22:34:57.102145 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3600/7174] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 22:34:56 2022] DELETE /compute/v2.1/servers/6377e82b-3b8e-4aea-95b0-9549b2a4090c => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 22:34:57.110760 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-4e2cac6f-502d-4c41-9f1d-b676ab5211c0 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:34:57.111545 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-4e2cac6f-502d-4c41-9f1d-b676ab5211c0 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] [instance: 6377e82b-3b8e-4aea-95b0-9549b2a4090c] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:34:57.118124 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4e2cac6f-502d-4c41-9f1d-b676ab5211c0 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:34:57.118622 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4e2cac6f-502d-4c41-9f1d-b676ab5211c0 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:34:57.119097 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4e2cac6f-502d-4c41-9f1d-b676ab5211c0 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:34:57.120029 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4e2cac6f-502d-4c41-9f1d-b676ab5211c0 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:34:57.120490 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4e2cac6f-502d-4c41-9f1d-b676ab5211c0 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:34:57.120927 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-4e2cac6f-502d-4c41-9f1d-b676ab5211c0 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:34:57.268011 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-4e2cac6f-502d-4c41-9f1d-b676ab5211c0 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60243645bd55419d885180da80e843b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f440a34638f4bf1ab18f1c819aa48d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:34:57.276372 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-4e2cac6f-502d-4c41-9f1d-b676ab5211c0 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] 10.222.0.18 "GET /compute/v2.1/servers/6377e82b-3b8e-4aea-95b0-9549b2a4090c" status: 200 len: 1682 microversion: 2.1 time: 0.170046 Oct 22 22:34:57.276925 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3575/7175] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:34:57 2022] GET /compute/v2.1/servers/6377e82b-3b8e-4aea-95b0-9549b2a4090c => generated 1682 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:34:58.278907 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-b45d2470-95f2-4094-95b4-9e4a9a220f89 req-6744517c-4de5-4553-802b-2f5dcf4237f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6377e82b-3b8e-4aea-95b0-9549b2a4090c", "name": "network-vif-unplugged", "status": "completed", "tag": "ef53f21a-3d14-4bd1-b51a-003465e932ea"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 22:34:58.290869 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-b45d2470-95f2-4094-95b4-9e4a9a220f89 req-6744517c-4de5-4553-802b-2f5dcf4237f3 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:34:58.292472 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-b45d2470-95f2-4094-95b4-9e4a9a220f89 req-6744517c-4de5-4553-802b-2f5dcf4237f3 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:34:58.293000 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-b45d2470-95f2-4094-95b4-9e4a9a220f89 req-6744517c-4de5-4553-802b-2f5dcf4237f3 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:34:58.301055 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-d58395e5-70e2-4138-95d6-4faa72bcf697 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:34:58.302582 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-d58395e5-70e2-4138-95d6-4faa72bcf697 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] [instance: 6377e82b-3b8e-4aea-95b0-9549b2a4090c] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:34:58.312698 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d58395e5-70e2-4138-95d6-4faa72bcf697 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:34:58.313493 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d58395e5-70e2-4138-95d6-4faa72bcf697 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:34:58.314781 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d58395e5-70e2-4138-95d6-4faa72bcf697 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:34:58.315576 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d58395e5-70e2-4138-95d6-4faa72bcf697 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:34:58.316043 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d58395e5-70e2-4138-95d6-4faa72bcf697 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:34:58.316478 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-d58395e5-70e2-4138-95d6-4faa72bcf697 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:34:58.329111 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-b45d2470-95f2-4094-95b4-9e4a9a220f89 req-6744517c-4de5-4553-802b-2f5dcf4237f3 service nova] Creating event network-vif-unplugged:ef53f21a-3d14-4bd1-b51a-003465e932ea for instance 6377e82b-3b8e-4aea-95b0-9549b2a4090c on nch1-master-1 Oct 22 22:34:58.335044 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-b45d2470-95f2-4094-95b4-9e4a9a220f89 req-6744517c-4de5-4553-802b-2f5dcf4237f3 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.060914 Oct 22 22:34:58.335722 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3601/7176] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 22:34:58 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 22:34:58.456362 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-d58395e5-70e2-4138-95d6-4faa72bcf697 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60243645bd55419d885180da80e843b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f440a34638f4bf1ab18f1c819aa48d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:34:58.464850 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-d58395e5-70e2-4138-95d6-4faa72bcf697 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] 10.222.0.18 "GET /compute/v2.1/servers/6377e82b-3b8e-4aea-95b0-9549b2a4090c" status: 200 len: 1682 microversion: 2.1 time: 0.167766 Oct 22 22:34:58.465444 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3576/7177] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:34:58 2022] GET /compute/v2.1/servers/6377e82b-3b8e-4aea-95b0-9549b2a4090c => generated 1682 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 22:34:59.343309 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-4b39b5f5-36d8-4469-bbd6-35932155a8a6 req-628b4ee6-c16f-4667-b9f0-9f782f145593 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6377e82b-3b8e-4aea-95b0-9549b2a4090c", "name": "network-vif-deleted", "tag": "ef53f21a-3d14-4bd1-b51a-003465e932ea"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 22:34:59.358146 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-4b39b5f5-36d8-4469-bbd6-35932155a8a6 req-628b4ee6-c16f-4667-b9f0-9f782f145593 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:34:59.358637 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-4b39b5f5-36d8-4469-bbd6-35932155a8a6 req-628b4ee6-c16f-4667-b9f0-9f782f145593 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:34:59.359406 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-4b39b5f5-36d8-4469-bbd6-35932155a8a6 req-628b4ee6-c16f-4667-b9f0-9f782f145593 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:34:59.373911 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-4b39b5f5-36d8-4469-bbd6-35932155a8a6 req-628b4ee6-c16f-4667-b9f0-9f782f145593 service nova] Creating event network-vif-deleted:ef53f21a-3d14-4bd1-b51a-003465e932ea for instance 6377e82b-3b8e-4aea-95b0-9549b2a4090c on nch1-master-1 Oct 22 22:34:59.379057 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-4b39b5f5-36d8-4469-bbd6-35932155a8a6 req-628b4ee6-c16f-4667-b9f0-9f782f145593 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040981 Oct 22 22:34:59.379720 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3602/7178] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 22:34:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 22:34:59.488166 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-2fc7790c-fc88-4865-beee-96fa8e50ba0f tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:34:59.488878 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-2fc7790c-fc88-4865-beee-96fa8e50ba0f tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] [instance: 6377e82b-3b8e-4aea-95b0-9549b2a4090c] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:34:59.496751 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2fc7790c-fc88-4865-beee-96fa8e50ba0f tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:34:59.497170 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2fc7790c-fc88-4865-beee-96fa8e50ba0f tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:34:59.497606 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2fc7790c-fc88-4865-beee-96fa8e50ba0f tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:34:59.498341 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2fc7790c-fc88-4865-beee-96fa8e50ba0f tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:34:59.498878 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2fc7790c-fc88-4865-beee-96fa8e50ba0f tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:34:59.499303 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2fc7790c-fc88-4865-beee-96fa8e50ba0f tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:34:59.532551 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2fc7790c-fc88-4865-beee-96fa8e50ba0f tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:34:59.533050 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2fc7790c-fc88-4865-beee-96fa8e50ba0f tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:34:59.533492 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-2fc7790c-fc88-4865-beee-96fa8e50ba0f tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:34:59.533953 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.objects.instance [None req-2fc7790c-fc88-4865-beee-96fa8e50ba0f tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Lazy-loading 'fault' on Instance uuid 6377e82b-3b8e-4aea-95b0-9549b2a4090c {{(pid=138744) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 22:34:59.575912 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-2fc7790c-fc88-4865-beee-96fa8e50ba0f tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60243645bd55419d885180da80e843b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f440a34638f4bf1ab18f1c819aa48d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:34:59.584040 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-2fc7790c-fc88-4865-beee-96fa8e50ba0f tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] 10.222.0.18 "GET /compute/v2.1/servers/6377e82b-3b8e-4aea-95b0-9549b2a4090c" status: 200 len: 1337 microversion: 2.1 time: 0.099985 Oct 22 22:34:59.584612 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3577/7179] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:34:59 2022] GET /compute/v2.1/servers/6377e82b-3b8e-4aea-95b0-9549b2a4090c => generated 1337 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:35:00.611211 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-6716f1b8-4486-4a3c-81dc-89cbec46f53f tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:35:00.612163 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-6716f1b8-4486-4a3c-81dc-89cbec46f53f tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] [instance: 6377e82b-3b8e-4aea-95b0-9549b2a4090c] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:35:00.622090 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6716f1b8-4486-4a3c-81dc-89cbec46f53f tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:35:00.622752 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6716f1b8-4486-4a3c-81dc-89cbec46f53f tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:35:00.623586 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6716f1b8-4486-4a3c-81dc-89cbec46f53f tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:35:00.624380 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6716f1b8-4486-4a3c-81dc-89cbec46f53f tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:35:00.624854 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6716f1b8-4486-4a3c-81dc-89cbec46f53f tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:35:00.625301 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-6716f1b8-4486-4a3c-81dc-89cbec46f53f tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:35:00.639530 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.wsgi [None req-6716f1b8-4486-4a3c-81dc-89cbec46f53f tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] HTTP exception thrown: Instance 6377e82b-3b8e-4aea-95b0-9549b2a4090c could not be found. Oct 22 22:35:00.641214 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-6716f1b8-4486-4a3c-81dc-89cbec46f53f tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Request method failure captured: Oct 22 22:35:00.641214 ncdv-master-1 devstack@n-api.service[138745]: request: GET /compute/v2.1/servers/6377e82b-3b8e-4aea-95b0-9549b2a4090c HTTP/1.1 Oct 22 22:35:00.641214 ncdv-master-1 devstack@n-api.service[138745]: Accept: application/json Oct 22 22:35:00.641214 ncdv-master-1 devstack@n-api.service[138745]: Accept-Encoding: identity Oct 22 22:35:00.641214 ncdv-master-1 devstack@n-api.service[138745]: Connection: close Oct 22 22:35:00.641214 ncdv-master-1 devstack@n-api.service[138745]: Content-Length: 0 Oct 22 22:35:00.641214 ncdv-master-1 devstack@n-api.service[138745]: Content-Type: application/json Oct 22 22:35:00.641214 ncdv-master-1 devstack@n-api.service[138745]: Host: 10.222.0.18 Oct 22 22:35:00.641214 ncdv-master-1 devstack@n-api.service[138745]: Openstack-System-Scope: None Oct 22 22:35:00.641214 ncdv-master-1 devstack@n-api.service[138745]: User-Agent: python-urllib3/1.26.12 Oct 22 22:35:00.641214 ncdv-master-1 devstack@n-api.service[138745]: X-Auth-Token: gAAAAABjVG7WpB0qf-HvgF97VMd70pM-Tdik0R8uBzR6_sU5e6j2eNlzjXK7nUHGMOCrjNukMI_p3Tss5liMDxvNL0SeQwYQykDoWt6ofEJh9i_nDICXAGTD-AfYuhtrxbVZbF_uHiH8gdmMGWmhsQhgq-A1P5-5_tn8nIA-FFaNbxrGj3B_2vg Oct 22 22:35:00.641214 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Id: None Oct 22 22:35:00.641214 ncdv-master-1 devstack@n-api.service[138745]: X-Domain-Name: None Oct 22 22:35:00.641214 ncdv-master-1 devstack@n-api.service[138745]: X-Identity-Status: Confirmed Oct 22 22:35:00.641214 ncdv-master-1 devstack@n-api.service[138745]: X-Is-Admin-Project: True Oct 22 22:35:00.641214 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Id: default Oct 22 22:35:00.641214 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Domain-Name: Default Oct 22 22:35:00.641214 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Id: 2f440a34638f4bf1ab18f1c819aa48d6 Oct 22 22:35:00.641214 ncdv-master-1 devstack@n-api.service[138745]: X-Project-Name: tempest-TestSnapshotPattern-494258518 Oct 22 22:35:00.641214 ncdv-master-1 devstack@n-api.service[138745]: X-Role: member,reader Oct 22 22:35:00.641214 ncdv-master-1 devstack@n-api.service[138745]: X-Roles: member,reader Oct 22 22:35:00.641214 ncdv-master-1 devstack@n-api.service[138745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_2f440a34638f4bf1ab18f1c819aa48d6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2f440a34638f4bf1ab18f1c819aa48d6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/2f440a34638f4bf1ab18f1c819aa48d6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2f440a34638f4bf1ab18f1c819aa48d6"}]}] Oct 22 22:35:00.641214 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant: tempest-TestSnapshotPattern-494258518 Oct 22 22:35:00.641214 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Id: 2f440a34638f4bf1ab18f1c819aa48d6 Oct 22 22:35:00.641214 ncdv-master-1 devstack@n-api.service[138745]: X-Tenant-Name: tempest-TestSnapshotPattern-494258518 Oct 22 22:35:00.641214 ncdv-master-1 devstack@n-api.service[138745]: X-User: tempest-TestSnapshotPattern-494258518-project Oct 22 22:35:00.641214 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Id: default Oct 22 22:35:00.641214 ncdv-master-1 devstack@n-api.service[138745]: X-User-Domain-Name: Default Oct 22 22:35:00.641214 ncdv-master-1 devstack@n-api.service[138745]: X-User-Id: 60243645bd55419d885180da80e843b5 Oct 22 22:35:00.641214 ncdv-master-1 devstack@n-api.service[138745]: X-User-Name: tempest-TestSnapshotPattern-494258518-project Oct 22 22:35:00.641214 ncdv-master-1 devstack@n-api.service[138745]: method: > Oct 22 22:35:00.641214 ncdv-master-1 devstack@n-api.service[138745]: exception: Instance 6377e82b-3b8e-4aea-95b0-9549b2a4090c could not be found. Oct 22 22:35:00.641214 ncdv-master-1 devstack@n-api.service[138745]: action_args: {'id': '6377e82b-3b8e-4aea-95b0-9549b2a4090c'} Oct 22 22:35:00.641214 ncdv-master-1 devstack@n-api.service[138745]: {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 22:35:00.641214 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 22:35:00.641214 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 22:35:00.641214 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 22:35:00.641214 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 22:35:00.641214 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 22:35:00.641214 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 22:35:00.641214 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 22:35:00.641214 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 22:35:00.641214 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 22:35:00.641214 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6377e82b-3b8e-4aea-95b0-9549b2a4090c could not be found. Oct 22 22:35:00.641214 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 22:35:00.641214 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 22:35:00.641214 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 22:35:00.641214 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 22:35:00.641214 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 22:35:00.641214 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 22:35:00.641214 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 22:35:00.641214 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 22:35:00.641214 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 22:35:00.641214 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 22:35:00.641214 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 22:35:00.641214 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 22:35:00.641214 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 22:35:00.641214 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 22:35:00.641214 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 22:35:00.641214 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 22:35:00.641214 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6377e82b-3b8e-4aea-95b0-9549b2a4090c could not be found. Oct 22 22:35:00.641214 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 22:35:00.641214 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 22:35:00.641214 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 22:35:00.646497 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 22:35:00.646497 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 22:35:00.646497 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 22:35:00.646497 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 22:35:00.646497 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 22:35:00.646497 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6377e82b-3b8e-4aea-95b0-9549b2a4090c could not be found. Oct 22 22:35:00.646497 ncdv-master-1 devstack@n-api.service[138745]: ERROR nova.api.openstack.wsgi Oct 22 22:35:00.646497 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-6716f1b8-4486-4a3c-81dc-89cbec46f53f tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Returning 404 to user: Instance 6377e82b-3b8e-4aea-95b0-9549b2a4090c could not be found. {{(pid=138745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 22:35:00.646497 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-6716f1b8-4486-4a3c-81dc-89cbec46f53f tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] 10.222.0.18 "GET /compute/v2.1/servers/6377e82b-3b8e-4aea-95b0-9549b2a4090c" status: 404 len: 111 microversion: 2.1 time: 0.037487 Oct 22 22:35:00.646497 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3603/7180] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:35:00 2022] GET /compute/v2.1/servers/6377e82b-3b8e-4aea-95b0-9549b2a4090c => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 22:35:02.050763 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-b8ecb6c6-53d6-4c81-85ff-d4852f0e0cf6 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:35:02.051261 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-b8ecb6c6-53d6-4c81-85ff-d4852f0e0cf6 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] [instance: 97b04d30-8fd9-4214-917c-a77e062f0da8] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:35:02.059762 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b8ecb6c6-53d6-4c81-85ff-d4852f0e0cf6 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:35:02.060279 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b8ecb6c6-53d6-4c81-85ff-d4852f0e0cf6 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:35:02.060814 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b8ecb6c6-53d6-4c81-85ff-d4852f0e0cf6 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:35:02.061463 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b8ecb6c6-53d6-4c81-85ff-d4852f0e0cf6 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:35:02.061931 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b8ecb6c6-53d6-4c81-85ff-d4852f0e0cf6 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:35:02.062430 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-b8ecb6c6-53d6-4c81-85ff-d4852f0e0cf6 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:35:02.090074 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-b8ecb6c6-53d6-4c81-85ff-d4852f0e0cf6 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] [instance: 97b04d30-8fd9-4214-917c-a77e062f0da8] Going to try to terminate instance {{(pid=138744) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 22:35:02.122835 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-0b46ad2e-3fc4-4f7f-b734-82b277e6d446 req-360e6aa5-8eb5-4448-bd2c-fb1c5e6ccee5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97b04d30-8fd9-4214-917c-a77e062f0da8", "tag": "2f64bcad-e7af-4d3c-9554-92fda3f94ae9"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 22:35:02.135945 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-0b46ad2e-3fc4-4f7f-b734-82b277e6d446 req-360e6aa5-8eb5-4448-bd2c-fb1c5e6ccee5 service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:35:02.136442 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-0b46ad2e-3fc4-4f7f-b734-82b277e6d446 req-360e6aa5-8eb5-4448-bd2c-fb1c5e6ccee5 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:35:02.137182 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-0b46ad2e-3fc4-4f7f-b734-82b277e6d446 req-360e6aa5-8eb5-4448-bd2c-fb1c5e6ccee5 service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:35:02.149456 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-0b46ad2e-3fc4-4f7f-b734-82b277e6d446 req-360e6aa5-8eb5-4448-bd2c-fb1c5e6ccee5 service nova] Creating event network-changed:2f64bcad-e7af-4d3c-9554-92fda3f94ae9 for instance 97b04d30-8fd9-4214-917c-a77e062f0da8 on nch2-master-1 Oct 22 22:35:02.155402 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-0b46ad2e-3fc4-4f7f-b734-82b277e6d446 req-360e6aa5-8eb5-4448-bd2c-fb1c5e6ccee5 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103826 Oct 22 22:35:02.156380 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3604/7181] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 22:35:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 22:35:02.181847 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-b8ecb6c6-53d6-4c81-85ff-d4852f0e0cf6 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] 10.222.0.18 "DELETE /compute/v2.1/servers/97b04d30-8fd9-4214-917c-a77e062f0da8" status: 204 len: 0 microversion: 2.1 time: 0.134357 Oct 22 22:35:02.182308 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3578/7182] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Oct 22 22:35:02 2022] DELETE /compute/v2.1/servers/97b04d30-8fd9-4214-917c-a77e062f0da8 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 22:35:02.191975 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-dc1d21db-63d9-44ff-8067-38c0f05e5c1b tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Calling method '>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:35:02.192810 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.compute.api [None req-dc1d21db-63d9-44ff-8067-38c0f05e5c1b tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] [instance: 97b04d30-8fd9-4214-917c-a77e062f0da8] Fetching instance by UUID {{(pid=138745) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:35:02.199724 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-dc1d21db-63d9-44ff-8067-38c0f05e5c1b tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:35:02.200246 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-dc1d21db-63d9-44ff-8067-38c0f05e5c1b tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:35:02.200702 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-dc1d21db-63d9-44ff-8067-38c0f05e5c1b tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:35:02.201594 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-dc1d21db-63d9-44ff-8067-38c0f05e5c1b tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:35:02.202211 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-dc1d21db-63d9-44ff-8067-38c0f05e5c1b tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:35:02.202789 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [None req-dc1d21db-63d9-44ff-8067-38c0f05e5c1b tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:35:02.345547 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.policy [None req-dc1d21db-63d9-44ff-8067-38c0f05e5c1b tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60243645bd55419d885180da80e843b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f440a34638f4bf1ab18f1c819aa48d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138745) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:35:02.353701 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-dc1d21db-63d9-44ff-8067-38c0f05e5c1b tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] 10.222.0.18 "GET /compute/v2.1/servers/97b04d30-8fd9-4214-917c-a77e062f0da8" status: 200 len: 1682 microversion: 2.1 time: 0.166605 Oct 22 22:35:02.354281 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3605/7183] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:35:02 2022] GET /compute/v2.1/servers/97b04d30-8fd9-4214-917c-a77e062f0da8 => generated 1682 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:35:03.379421 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-3954c622-410d-423c-97a3-478d5e328d54 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:35:03.380741 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-3954c622-410d-423c-97a3-478d5e328d54 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] [instance: 97b04d30-8fd9-4214-917c-a77e062f0da8] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:35:03.388970 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3954c622-410d-423c-97a3-478d5e328d54 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:35:03.390110 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3954c622-410d-423c-97a3-478d5e328d54 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:35:03.390110 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3954c622-410d-423c-97a3-478d5e328d54 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:35:03.391133 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3954c622-410d-423c-97a3-478d5e328d54 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:35:03.391731 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3954c622-410d-423c-97a3-478d5e328d54 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:35:03.392526 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-3954c622-410d-423c-97a3-478d5e328d54 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:35:03.465213 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.policy [None req-3954c622-410d-423c-97a3-478d5e328d54 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60243645bd55419d885180da80e843b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f440a34638f4bf1ab18f1c819aa48d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138744) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 22:35:03.473742 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-3954c622-410d-423c-97a3-478d5e328d54 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] 10.222.0.18 "GET /compute/v2.1/servers/97b04d30-8fd9-4214-917c-a77e062f0da8" status: 200 len: 1497 microversion: 2.1 time: 0.099276 Oct 22 22:35:03.474337 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3579/7184] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:35:03 2022] GET /compute/v2.1/servers/97b04d30-8fd9-4214-917c-a77e062f0da8 => generated 1497 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 22:35:04.174633 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [req-c1047f1d-1361-42d0-9839-e31087dfbcee req-b6cd8b73-718a-4148-89a5-e5ff5370f56c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97b04d30-8fd9-4214-917c-a77e062f0da8", "name": "network-vif-deleted", "tag": "2f64bcad-e7af-4d3c-9554-92fda3f94ae9"}]} {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 22:35:04.185706 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-c1047f1d-1361-42d0-9839-e31087dfbcee req-b6cd8b73-718a-4148-89a5-e5ff5370f56c service nova] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:35:04.186198 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-c1047f1d-1361-42d0-9839-e31087dfbcee req-b6cd8b73-718a-4148-89a5-e5ff5370f56c service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:35:04.186652 ncdv-master-1 devstack@n-api.service[138745]: DEBUG oslo_concurrency.lockutils [req-c1047f1d-1361-42d0-9839-e31087dfbcee req-b6cd8b73-718a-4148-89a5-e5ff5370f56c service nova] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:35:04.198831 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.compute.server_external_events [req-c1047f1d-1361-42d0-9839-e31087dfbcee req-b6cd8b73-718a-4148-89a5-e5ff5370f56c service nova] Creating event network-vif-deleted:2f64bcad-e7af-4d3c-9554-92fda3f94ae9 for instance 97b04d30-8fd9-4214-917c-a77e062f0da8 on nch2-master-1 Oct 22 22:35:04.203866 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [req-c1047f1d-1361-42d0-9839-e31087dfbcee req-b6cd8b73-718a-4148-89a5-e5ff5370f56c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033856 Oct 22 22:35:04.204463 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3606/7185] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Oct 22 22:35:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 22:35:04.498692 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-51eab5c8-94b7-4c55-9c92-bb3dfae7399e tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Calling method '>' {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:35:04.499435 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.compute.api [None req-51eab5c8-94b7-4c55-9c92-bb3dfae7399e tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] [instance: 97b04d30-8fd9-4214-917c-a77e062f0da8] Fetching instance by UUID {{(pid=138744) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 22:35:04.506809 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-51eab5c8-94b7-4c55-9c92-bb3dfae7399e tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:35:04.507445 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-51eab5c8-94b7-4c55-9c92-bb3dfae7399e tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:35:04.507957 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-51eab5c8-94b7-4c55-9c92-bb3dfae7399e tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:35:04.508785 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-51eab5c8-94b7-4c55-9c92-bb3dfae7399e tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Acquiring lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 22:35:04.509323 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-51eab5c8-94b7-4c55-9c92-bb3dfae7399e tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 22:35:04.509832 ncdv-master-1 devstack@n-api.service[138744]: DEBUG oslo_concurrency.lockutils [None req-51eab5c8-94b7-4c55-9c92-bb3dfae7399e tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Lock "5972cb63-1ab7-4825-b0ae-86c7acab764c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 22:35:04.524419 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.wsgi [None req-51eab5c8-94b7-4c55-9c92-bb3dfae7399e tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] HTTP exception thrown: Instance 97b04d30-8fd9-4214-917c-a77e062f0da8 could not be found. Oct 22 22:35:04.526154 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-51eab5c8-94b7-4c55-9c92-bb3dfae7399e tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Request method failure captured: Oct 22 22:35:04.526154 ncdv-master-1 devstack@n-api.service[138744]: request: GET /compute/v2.1/servers/97b04d30-8fd9-4214-917c-a77e062f0da8 HTTP/1.1 Oct 22 22:35:04.526154 ncdv-master-1 devstack@n-api.service[138744]: Accept: application/json Oct 22 22:35:04.526154 ncdv-master-1 devstack@n-api.service[138744]: Accept-Encoding: identity Oct 22 22:35:04.526154 ncdv-master-1 devstack@n-api.service[138744]: Connection: close Oct 22 22:35:04.526154 ncdv-master-1 devstack@n-api.service[138744]: Content-Length: 0 Oct 22 22:35:04.526154 ncdv-master-1 devstack@n-api.service[138744]: Content-Type: application/json Oct 22 22:35:04.526154 ncdv-master-1 devstack@n-api.service[138744]: Host: 10.222.0.18 Oct 22 22:35:04.526154 ncdv-master-1 devstack@n-api.service[138744]: Openstack-System-Scope: None Oct 22 22:35:04.526154 ncdv-master-1 devstack@n-api.service[138744]: User-Agent: python-urllib3/1.26.12 Oct 22 22:35:04.526154 ncdv-master-1 devstack@n-api.service[138744]: X-Auth-Token: gAAAAABjVG7WpB0qf-HvgF97VMd70pM-Tdik0R8uBzR6_sU5e6j2eNlzjXK7nUHGMOCrjNukMI_p3Tss5liMDxvNL0SeQwYQykDoWt6ofEJh9i_nDICXAGTD-AfYuhtrxbVZbF_uHiH8gdmMGWmhsQhgq-A1P5-5_tn8nIA-FFaNbxrGj3B_2vg Oct 22 22:35:04.526154 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Id: None Oct 22 22:35:04.526154 ncdv-master-1 devstack@n-api.service[138744]: X-Domain-Name: None Oct 22 22:35:04.526154 ncdv-master-1 devstack@n-api.service[138744]: X-Identity-Status: Confirmed Oct 22 22:35:04.526154 ncdv-master-1 devstack@n-api.service[138744]: X-Is-Admin-Project: True Oct 22 22:35:04.526154 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Id: default Oct 22 22:35:04.526154 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Domain-Name: Default Oct 22 22:35:04.526154 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Id: 2f440a34638f4bf1ab18f1c819aa48d6 Oct 22 22:35:04.526154 ncdv-master-1 devstack@n-api.service[138744]: X-Project-Name: tempest-TestSnapshotPattern-494258518 Oct 22 22:35:04.526154 ncdv-master-1 devstack@n-api.service[138744]: X-Role: member,reader Oct 22 22:35:04.526154 ncdv-master-1 devstack@n-api.service[138744]: X-Roles: member,reader Oct 22 22:35:04.526154 ncdv-master-1 devstack@n-api.service[138744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_2f440a34638f4bf1ab18f1c819aa48d6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2f440a34638f4bf1ab18f1c819aa48d6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/2f440a34638f4bf1ab18f1c819aa48d6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2f440a34638f4bf1ab18f1c819aa48d6"}]}] Oct 22 22:35:04.526154 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant: tempest-TestSnapshotPattern-494258518 Oct 22 22:35:04.526154 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Id: 2f440a34638f4bf1ab18f1c819aa48d6 Oct 22 22:35:04.526154 ncdv-master-1 devstack@n-api.service[138744]: X-Tenant-Name: tempest-TestSnapshotPattern-494258518 Oct 22 22:35:04.526154 ncdv-master-1 devstack@n-api.service[138744]: X-User: tempest-TestSnapshotPattern-494258518-project Oct 22 22:35:04.526154 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Id: default Oct 22 22:35:04.526154 ncdv-master-1 devstack@n-api.service[138744]: X-User-Domain-Name: Default Oct 22 22:35:04.526154 ncdv-master-1 devstack@n-api.service[138744]: X-User-Id: 60243645bd55419d885180da80e843b5 Oct 22 22:35:04.526154 ncdv-master-1 devstack@n-api.service[138744]: X-User-Name: tempest-TestSnapshotPattern-494258518-project Oct 22 22:35:04.526154 ncdv-master-1 devstack@n-api.service[138744]: method: > Oct 22 22:35:04.526154 ncdv-master-1 devstack@n-api.service[138744]: exception: Instance 97b04d30-8fd9-4214-917c-a77e062f0da8 could not be found. Oct 22 22:35:04.526154 ncdv-master-1 devstack@n-api.service[138744]: action_args: {'id': '97b04d30-8fd9-4214-917c-a77e062f0da8'} Oct 22 22:35:04.526154 ncdv-master-1 devstack@n-api.service[138744]: {{(pid=138744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 22:35:04.526154 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 22:35:04.526154 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 22:35:04.526154 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 22:35:04.526154 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 22:35:04.526154 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 22:35:04.526154 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 22:35:04.526154 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 22:35:04.526154 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 22:35:04.526154 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 22:35:04.526154 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 97b04d30-8fd9-4214-917c-a77e062f0da8 could not be found. Oct 22 22:35:04.526154 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 22:35:04.526154 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 22:35:04.526154 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 22:35:04.526154 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 22:35:04.526154 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 22:35:04.526154 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 22:35:04.526154 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 22:35:04.526154 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 22:35:04.526154 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 22:35:04.526154 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 22:35:04.526154 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 22:35:04.526154 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 22:35:04.526154 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 22:35:04.526154 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 22:35:04.526154 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 22:35:04.526154 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 22:35:04.526154 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97b04d30-8fd9-4214-917c-a77e062f0da8 could not be found. Oct 22 22:35:04.526154 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 22:35:04.526154 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 22:35:04.526154 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 22:35:04.530407 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 22:35:04.530407 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 22:35:04.530407 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 22:35:04.530407 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 22:35:04.530407 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 22:35:04.530407 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97b04d30-8fd9-4214-917c-a77e062f0da8 could not be found. Oct 22 22:35:04.530407 ncdv-master-1 devstack@n-api.service[138744]: ERROR nova.api.openstack.wsgi Oct 22 22:35:04.530407 ncdv-master-1 devstack@n-api.service[138744]: DEBUG nova.api.openstack.wsgi [None req-51eab5c8-94b7-4c55-9c92-bb3dfae7399e tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Returning 404 to user: Instance 97b04d30-8fd9-4214-917c-a77e062f0da8 could not be found. {{(pid=138744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 22:35:04.530407 ncdv-master-1 devstack@n-api.service[138744]: INFO nova.api.openstack.requestlog [None req-51eab5c8-94b7-4c55-9c92-bb3dfae7399e tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] 10.222.0.18 "GET /compute/v2.1/servers/97b04d30-8fd9-4214-917c-a77e062f0da8" status: 404 len: 111 microversion: 2.1 time: 0.033580 Oct 22 22:35:04.530407 ncdv-master-1 devstack@n-api.service[138744]: [pid: 138744|app: 0|req: 3580/7186] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Oct 22 22:35:04 2022] GET /compute/v2.1/servers/97b04d30-8fd9-4214-917c-a77e062f0da8 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 22:35:04.696062 ncdv-master-1 devstack@n-api.service[138745]: DEBUG nova.api.openstack.wsgi [None req-28b790ec-fa08-447d-ad52-cdc12b99b520 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] Calling method '.version_select at 0x7fd39c51b700>' {{(pid=138745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 22:35:04.700577 ncdv-master-1 devstack@n-api.service[138745]: ERROR oslo.messaging._drivers.impl_rabbit [None req-28b790ec-fa08-447d-ad52-cdc12b99b520 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] [fdffe6b9-9d4b-45b8-9714-1ef9d5132dcd] AMQP server on 10.222.0.18:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 22 22:35:05.714449 ncdv-master-1 devstack@n-api.service[138745]: INFO oslo.messaging._drivers.impl_rabbit [None req-28b790ec-fa08-447d-ad52-cdc12b99b520 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] [fdffe6b9-9d4b-45b8-9714-1ef9d5132dcd] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 41844. Oct 22 22:35:05.740547 ncdv-master-1 devstack@n-api.service[138745]: INFO nova.api.openstack.requestlog [None req-28b790ec-fa08-447d-ad52-cdc12b99b520 tempest-TestSnapshotPattern-494258518 tempest-TestSnapshotPattern-494258518-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-321450768" status: 202 len: 0 microversion: 2.1 time: 1.049242 Oct 22 22:35:05.741133 ncdv-master-1 devstack@n-api.service[138745]: [pid: 138745|app: 0|req: 3607/7187] 10.222.0.18 () {58 vars in 1254 bytes} [Sat Oct 22 22:35:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-321450768 => generated 0 bytes in 1051 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)